Build 'Ignite Tests 2.x (JDK 8/11) / Basic 3' #95, branch 'pull/9539/head' Triggered 2021-11-19 20:59:29 by 'Maxim Muzafarov (mmuzaf)' Started 2021-11-19 20:59:54 on agent 'aitc-lin02_03' Is running with status FAILURE 'Tests failed: 1 (1 new), passed: 78; Running org.apache.ignite.internal.encryption.CacheGroupKeyChangeTest' VCS revisions: 'GitHubApacheIgnite' (Git, instance id 302): 'c6d91d0fa04338c406d0857a9a1008a36ea8a030' (branch: 'refs/pull/9539/head') TeamCity URL http://ci.ignite.apache.org/viewLog.html?buildId=6278078&buildTypeId=IgniteTests24Java8_Basic3 TeamCity server version is 2021.2 (build 99542), server timezone: MSK (UTC+03:00) [20:59:29]E: bt1460 (running for 1h:13m:04s) [20:59:29]i: TeamCity server version is 2021.2 (build 99542) [20:59:29] : Collecting changes in 1 VCS root (6s) [20:59:29] : [Collecting changes in 1 VCS root] VCS Root details [20:59:29] : [VCS Root details] "GitHub [apache/ignite]" {instance id=302, parent internal id=79, parent id=GitHubApacheIgnite, description: "https://github.com/apache/ignite.git#refs/heads/master"} [20:59:30]i: [Collecting changes in 1 VCS root] Waiting for completion of current operations for the VCS root 'GitHub [apache/ignite]' [20:59:32]i: [Collecting changes in 1 VCS root] Detecting changes in VCS root 'GitHub [apache/ignite]' (used in '--> Run :: All', '--> Run :: All' and 431 other configurations) [20:59:32]i: [Collecting changes in 1 VCS root] Will collect changes for 'GitHub [apache/ignite]' starting from revision 2e7235d39b0940ee384a609c2621498bd2e57e27 [20:59:35] : [Collecting changes in 1 VCS root] Compute revision for 'GitHub [apache/ignite]' [20:59:35] : [Compute revision for 'GitHub [apache/ignite]'] Upper limit revision: c6d91d0fa04338c406d0857a9a1008a36ea8a030 [20:59:35]i: [Compute revision for 'GitHub [apache/ignite]'] MaxModId = 940306 [20:59:35] : [Compute revision for 'GitHub [apache/ignite]'] The first revision that was detected in the branch refs/pull/9539/head: efd59f32cb3ae63d41a389638d028036a6f3bfed [20:59:35] : [Compute revision for 'GitHub [apache/ignite]'] The first revision that was detected in the branch refs/pull/9539/head after the last change of the VCS root or checkout rules: efd59f32cb3ae63d41a389638d028036a6f3bfed [20:59:35] : [Compute revision for 'GitHub [apache/ignite]'] Latest commit attached to build configuration (with id <= 940306): c6d91d0fa04338c406d0857a9a1008a36ea8a030 [20:59:35] : [Compute revision for 'GitHub [apache/ignite]'] Computed revision: c6d91d0fa04338c406d0857a9a1008a36ea8a030 [20:59:54] : The build is removed from the queue to be prepared for the start [20:59:54] : Starting the build on the agent "aitc-lin02_03" [20:59:54]i: Agent time zone: Europe/Moscow [20:59:54]i: Agent is running under JRE: 1.8.0_252-b09 [20:59:54] : Updating tools for build [20:59:54] : [Updating tools for build] Found 1 tool used by the build: maven3_6 [20:59:54] : [Updating tools for build] All used tools are up-to-date [20:59:54] : Clearing temporary directory: /opt/buildagent/temp/buildTmp [20:59:54] : Publishing internal artifacts [20:59:54] : [Publishing internal artifacts] Publishing 1 file using [ArtifactsCachePublisher] [20:59:54] : [Publishing internal artifacts] Publishing 1 file using [WebPublisher] [20:59:54] : Using vcs information from agent file: 7bc1c54bc719b67c.xml [20:59:54] : Checkout directory: /opt/buildagent/work/7bc1c54bc719b67c [20:59:54] : Updating sources: server side checkout (1s) [20:59:55] : [Updating sources] Building incremental patch for VCS root: GitHub [apache/ignite]; checkout rules: =>; revision: 2e7235d39b0940ee384a609c2621498bd2e57e27 --> c6d91d0fa04338c406d0857a9a1008a36ea8a030 [20:59:56] : [Updating sources] Repository sources transferred (1.01 MB) [20:59:56] : [Updating sources] Updating /opt/buildagent/work/7bc1c54bc719b67c [20:59:56] : Resolving artifact dependencies (20s) [20:59:56] : [Resolving artifact dependencies] Downloading files from Build, build #117 [id 6277416]> for pattern [ignite.zip!** => . repository.zip!** => .] [20:59:56]i: [Resolving artifact dependencies] Downloading 2 artifacts [21:00:16] : [Resolving artifact dependencies] 36848 files retrieved [21:00:16] : [Resolving artifact dependencies] HTTP transport has processed 2 files (total size: 287.38 MB, average download speed: 71.48 MB/s) [21:00:16] : Build preparation done [21:00:16]W: Step 1/5: Pre-build cleanup (Command Line) (1s) [21:00:16]i: [Step 1/5] Content of /opt/buildagent/temp/agentTmp/custom_script6623554020872898680 file: #!/usr/bin/env bash set -o nounset; set -o errexit; set -o pipefail; set -o errtrace; set -o functrace set -x # Pre-clean info echo "User: $(whoami)" echo "JPS (before): " for process in $(/opt/java/jdk-ora-8/bin/jps) do echo " ${process}" done echo # Kill processes echo "Killing processes starters" for processName in GridHadoopExternalProcessStarter HadoopExternalProcessStarter MainWithArgsInFile do for PID in $(/opt/java/jdk-ora-8/bin/jps | grep ${processName} | awk '{ print $1 }') do echo -n " Killing ${processName} process with PID ${PID}... " processInfo="$(ps aux -p $PID)" kill -9 ${PID} && echo "[OK]" || { echo "[ERROR] Unable to kill process ${PID}" && exit 1 } echo " Killed process info: ${processInfo}" done done echo echo "Killing IgniteNodeRunner processes (before tests)" for PID in $(/opt/java/jdk-ora-8/bin/jps | grep IgniteNodeRunner | awk '{ print $1 }') do echo -n " Killing process with PID ${PID}... " kill -9 ${PID} && echo "[OK]" || { echo "[ERROR] Unable to kill process ${PID}" && exit 1 } done echo # Post-clean info echo "JPS (after): " for process in $(/opt/java/jdk-ora-8/bin/jps) do echo " ${process}" done echo # ULimit ulimit -n 65535 && echo "Max number of OPEN FILE DESCRIPTORS: $(ulimit -n)" ulimit -u 65535 && echo "Max number of SINGLE USER AVAILABLE PROCESSES: $(ulimit -u)" echo # Finalize IPC cleaning echo "Cleaning IPC resources" for param in m s do for ipcs in $(ipcs -${param} | grep 'teamcity' | awk '{ print $2 }') do ipcrm -${param} ${ipcs} || { echo "[ERROR] Unable to remove ${param}/${ipcs}" && exit 1 } done done [21:00:16] : [Step 1/5] Starting: /opt/buildagent/temp/agentTmp/custom_script6623554020872898680 [21:00:16] : [Step 1/5] in directory: /opt/buildagent/work/7bc1c54bc719b67c [21:00:16]W: [Step 1/5] ++ whoami [21:00:16]W: [Step 1/5] + echo 'User: teamcity' [21:00:16]W: [Step 1/5] + echo 'JPS (before): ' [21:00:16]W: [Step 1/5] ++ /opt/java/jdk-ora-8/bin/jps [21:00:16] : [Step 1/5] User: teamcity [21:00:16] : [Step 1/5] JPS (before): [21:00:17] : [Step 1/5] 16343 [21:00:17]W: [Step 1/5] + for process in $(/opt/java/jdk-ora-8/bin/jps) [21:00:17] : [Step 1/5] Jps [21:00:17]W: [Step 1/5] + echo ' 16343' [21:00:17]W: [Step 1/5] + for process in $(/opt/java/jdk-ora-8/bin/jps) [21:00:17] : [Step 1/5] 1207 [21:00:17]W: [Step 1/5] + echo ' Jps' [21:00:17] : [Step 1/5] Launcher [21:00:17]W: [Step 1/5] + for process in $(/opt/java/jdk-ora-8/bin/jps) [21:00:17] : [Step 1/5] 1247 [21:00:17]W: [Step 1/5] + echo ' 1207' [21:00:17] : [Step 1/5] AgentMain [21:00:17]W: [Step 1/5] + for process in $(/opt/java/jdk-ora-8/bin/jps) [21:00:17] : [Step 1/5] [21:00:17]W: [Step 1/5] + echo ' Launcher' [21:00:17] : [Step 1/5] Killing processes starters [21:00:17]W: [Step 1/5] + for process in $(/opt/java/jdk-ora-8/bin/jps) [21:00:17]W: [Step 1/5] + echo ' 1247' [21:00:17]W: [Step 1/5] + for process in $(/opt/java/jdk-ora-8/bin/jps) [21:00:17]W: [Step 1/5] + echo ' AgentMain' [21:00:17]W: [Step 1/5] + echo [21:00:17]W: [Step 1/5] + echo 'Killing processes starters' [21:00:17]W: [Step 1/5] + for processName in GridHadoopExternalProcessStarter HadoopExternalProcessStarter MainWithArgsInFile [21:00:17]W: [Step 1/5] ++ /opt/java/jdk-ora-8/bin/jps [21:00:17]W: [Step 1/5] ++ grep GridHadoopExternalProcessStarter [21:00:17]W: [Step 1/5] ++ awk '{ print $1 }' [21:00:17]W: [Step 1/5] + for processName in GridHadoopExternalProcessStarter HadoopExternalProcessStarter MainWithArgsInFile [21:00:17]W: [Step 1/5] ++ /opt/java/jdk-ora-8/bin/jps [21:00:17]W: [Step 1/5] ++ grep HadoopExternalProcessStarter [21:00:17]W: [Step 1/5] ++ awk '{ print $1 }' [21:00:17]W: [Step 1/5] + for processName in GridHadoopExternalProcessStarter HadoopExternalProcessStarter MainWithArgsInFile [21:00:17]W: [Step 1/5] ++ /opt/java/jdk-ora-8/bin/jps [21:00:17]W: [Step 1/5] ++ grep MainWithArgsInFile [21:00:17]W: [Step 1/5] ++ awk '{ print $1 }' [21:00:17]W: [Step 1/5] + echo [21:00:17]W: [Step 1/5] + echo 'Killing IgniteNodeRunner processes (before tests)' [21:00:17] : [Step 1/5] [21:00:17] : [Step 1/5] Killing IgniteNodeRunner processes (before tests) [21:00:17]W: [Step 1/5] ++ /opt/java/jdk-ora-8/bin/jps [21:00:17]W: [Step 1/5] ++ grep IgniteNodeRunner [21:00:17]W: [Step 1/5] ++ awk '{ print $1 }' [21:00:18] : [Step 1/5] [21:00:18] : [Step 1/5] JPS (after): [21:00:18]W: [Step 1/5] + echo [21:00:18]W: [Step 1/5] + echo 'JPS (after): ' [21:00:18]W: [Step 1/5] ++ /opt/java/jdk-ora-8/bin/jps [21:00:18] : [Step 1/5] 16545 [21:00:18] : [Step 1/5] Jps [21:00:18]W: [Step 1/5] + for process in $(/opt/java/jdk-ora-8/bin/jps) [21:00:18] : [Step 1/5] 1207 [21:00:18]W: [Step 1/5] + echo ' 16545' [21:00:18] : [Step 1/5] Launcher [21:00:18]W: [Step 1/5] + for process in $(/opt/java/jdk-ora-8/bin/jps) [21:00:18] : [Step 1/5] 1247 [21:00:18]W: [Step 1/5] + echo ' Jps' [21:00:18] : [Step 1/5] AgentMain [21:00:18]W: [Step 1/5] + for process in $(/opt/java/jdk-ora-8/bin/jps) [21:00:18] : [Step 1/5] [21:00:18]W: [Step 1/5] + echo ' 1207' [21:00:18] : [Step 1/5] Max number of OPEN FILE DESCRIPTORS: 65535 [21:00:18]W: [Step 1/5] + for process in $(/opt/java/jdk-ora-8/bin/jps) [21:00:18]W: [Step 1/5] + echo ' Launcher' [21:00:18]W: [Step 1/5] + for process in $(/opt/java/jdk-ora-8/bin/jps) [21:00:18]W: [Step 1/5] + echo ' 1247' [21:00:18]W: [Step 1/5] + for process in $(/opt/java/jdk-ora-8/bin/jps) [21:00:18]W: [Step 1/5] + echo ' AgentMain' [21:00:18]W: [Step 1/5] + echo [21:00:18]W: [Step 1/5] + ulimit -n 65535 [21:00:18]W: [Step 1/5] ++ ulimit -n [21:00:18]W: [Step 1/5] + echo 'Max number of OPEN FILE DESCRIPTORS: 65535' [21:00:18]W: [Step 1/5] + ulimit -u 65535 [21:00:18]W: [Step 1/5] ++ ulimit -u [21:00:18]W: [Step 1/5] + echo 'Max number of SINGLE USER AVAILABLE PROCESSES: 65535' [21:00:18]W: [Step 1/5] + echo [21:00:18]W: [Step 1/5] + echo 'Cleaning IPC resources' [21:00:18]W: [Step 1/5] + for param in m s [21:00:18]W: [Step 1/5] ++ ipcs -m [21:00:18]W: [Step 1/5] ++ grep teamcity [21:00:18]W: [Step 1/5] ++ awk '{ print $2 }' [21:00:18] : [Step 1/5] Max number of SINGLE USER AVAILABLE PROCESSES: 65535 [21:00:18] : [Step 1/5] [21:00:18] : [Step 1/5] Cleaning IPC resources [21:00:18]W: [Step 1/5] + for param in m s [21:00:18]W: [Step 1/5] ++ ipcs -s [21:00:18]W: [Step 1/5] ++ grep teamcity [21:00:18]W: [Step 1/5] ++ awk '{ print $2 }' [21:00:18] : [Step 1/5] Process exited with code 0 [21:00:18]W: Step 2/5: Install built artifacts to local maven repository (Command Line) [21:00:18]i: [Step 2/5] Content of /opt/buildagent/temp/agentTmp/custom_script1860611263920941429 file: #!/usr/bin/env bash set -o nounset; set -o errexit; set -o pipefail; set -o errtrace; set -o functrace set -x cp -rfv repository ~/.m2/ [21:00:18] : [Step 2/5] Starting: /opt/buildagent/temp/agentTmp/custom_script1860611263920941429 [21:00:18] : [Step 2/5] in directory: /opt/buildagent/work/7bc1c54bc719b67c [21:00:18]W: [Step 2/5] + cp -rfv repository /opt/buildagent/.m2/ [21:00:18] : [Step 2/5] 'repository/org/apache/ignite/ignite-yardstick/maven-metadata-local.xml' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-yardstick/maven-metadata-local.xml' [21:00:18] : [Step 2/5] 'repository/org/apache/ignite/ignite-yardstick/2.13.0-SNAPSHOT/ignite-yardstick-2.13.0-SNAPSHOT.pom' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-yardstick/2.13.0-SNAPSHOT/ignite-yardstick-2.13.0-SNAPSHOT.pom' [21:00:18] : [Step 2/5] 'repository/org/apache/ignite/ignite-yardstick/2.13.0-SNAPSHOT/maven-metadata-local.xml' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-yardstick/2.13.0-SNAPSHOT/maven-metadata-local.xml' [21:00:18] : [Step 2/5] 'repository/org/apache/ignite/ignite-yardstick/2.13.0-SNAPSHOT/ignite-yardstick-2.13.0-SNAPSHOT.jar' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-yardstick/2.13.0-SNAPSHOT/ignite-yardstick-2.13.0-SNAPSHOT.jar' [21:00:18] : [Step 2/5] 'repository/org/apache/ignite/ignite-yardstick/2.13.0-SNAPSHOT/_remote.repositories' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-yardstick/2.13.0-SNAPSHOT/_remote.repositories' [21:00:18] : [Step 2/5] 'repository/org/apache/ignite/ignite-yardstick/2.13.0-SNAPSHOT/ignite-yardstick-2.13.0-SNAPSHOT-sources.jar' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-yardstick/2.13.0-SNAPSHOT/ignite-yardstick-2.13.0-SNAPSHOT-sources.jar' [21:00:18] : [Step 2/5] 'repository/org/apache/ignite/ignite-zookeeper/maven-metadata-local.xml' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-zookeeper/maven-metadata-local.xml' [21:00:18] : [Step 2/5] 'repository/org/apache/ignite/ignite-zookeeper/2.13.0-SNAPSHOT/maven-metadata-local.xml' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-zookeeper/2.13.0-SNAPSHOT/maven-metadata-local.xml' [21:00:18] : [Step 2/5] 'repository/org/apache/ignite/ignite-zookeeper/2.13.0-SNAPSHOT/ignite-zookeeper-2.13.0-SNAPSHOT.pom' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-zookeeper/2.13.0-SNAPSHOT/ignite-zookeeper-2.13.0-SNAPSHOT.pom' [21:00:18] : [Step 2/5] 'repository/org/apache/ignite/ignite-zookeeper/2.13.0-SNAPSHOT/_remote.repositories' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-zookeeper/2.13.0-SNAPSHOT/_remote.repositories' [21:00:18] : [Step 2/5] 'repository/org/apache/ignite/ignite-zookeeper/2.13.0-SNAPSHOT/ignite-zookeeper-2.13.0-SNAPSHOT.jar' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-zookeeper/2.13.0-SNAPSHOT/ignite-zookeeper-2.13.0-SNAPSHOT.jar' [21:00:18] : [Step 2/5] 'repository/org/apache/ignite/ignite-zookeeper/2.13.0-SNAPSHOT/ignite-zookeeper-2.13.0-SNAPSHOT-sources.jar' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-zookeeper/2.13.0-SNAPSHOT/ignite-zookeeper-2.13.0-SNAPSHOT-sources.jar' [21:00:18] : [Step 2/5] 'repository/org/apache/ignite/ignite-zookeeper/2.13.0-SNAPSHOT/ignite-zookeeper-2.13.0-SNAPSHOT-tests.jar' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-zookeeper/2.13.0-SNAPSHOT/ignite-zookeeper-2.13.0-SNAPSHOT-tests.jar' [21:00:18] : [Step 2/5] 'repository/org/apache/ignite/ignite-extdata-p2p/maven-metadata-local.xml' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-extdata-p2p/maven-metadata-local.xml' [21:00:18] : [Step 2/5] 'repository/org/apache/ignite/ignite-extdata-p2p/2.13.0-SNAPSHOT/ignite-extdata-p2p-2.13.0-SNAPSHOT.jar' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-extdata-p2p/2.13.0-SNAPSHOT/ignite-extdata-p2p-2.13.0-SNAPSHOT.jar' [21:00:18] : [Step 2/5] 'repository/org/apache/ignite/ignite-extdata-p2p/2.13.0-SNAPSHOT/maven-metadata-local.xml' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-extdata-p2p/2.13.0-SNAPSHOT/maven-metadata-local.xml' [21:00:18] : [Step 2/5] 'repository/org/apache/ignite/ignite-extdata-p2p/2.13.0-SNAPSHOT/_remote.repositories' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-extdata-p2p/2.13.0-SNAPSHOT/_remote.repositories' [21:00:18] : [Step 2/5] 'repository/org/apache/ignite/ignite-extdata-p2p/2.13.0-SNAPSHOT/ignite-extdata-p2p-2.13.0-SNAPSHOT-sources.jar' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-extdata-p2p/2.13.0-SNAPSHOT/ignite-extdata-p2p-2.13.0-SNAPSHOT-sources.jar' [21:00:18] : [Step 2/5] 'repository/org/apache/ignite/ignite-extdata-p2p/2.13.0-SNAPSHOT/ignite-extdata-p2p-2.13.0-SNAPSHOT.pom' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-extdata-p2p/2.13.0-SNAPSHOT/ignite-extdata-p2p-2.13.0-SNAPSHOT.pom' [21:00:18] : [Step 2/5] 'repository/org/apache/ignite/ignite-clients/maven-metadata-local.xml' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-clients/maven-metadata-local.xml' [21:00:18] : [Step 2/5] 'repository/org/apache/ignite/ignite-clients/2.13.0-SNAPSHOT/ignite-clients-2.13.0-SNAPSHOT.jar' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-clients/2.13.0-SNAPSHOT/ignite-clients-2.13.0-SNAPSHOT.jar' [21:00:18] : [Step 2/5] 'repository/org/apache/ignite/ignite-clients/2.13.0-SNAPSHOT/maven-metadata-local.xml' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-clients/2.13.0-SNAPSHOT/maven-metadata-local.xml' [21:00:18] : [Step 2/5] 'repository/org/apache/ignite/ignite-clients/2.13.0-SNAPSHOT/ignite-clients-2.13.0-SNAPSHOT-tests.jar' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-clients/2.13.0-SNAPSHOT/ignite-clients-2.13.0-SNAPSHOT-tests.jar' [21:00:18] : [Step 2/5] 'repository/org/apache/ignite/ignite-clients/2.13.0-SNAPSHOT/_remote.repositories' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-clients/2.13.0-SNAPSHOT/_remote.repositories' [21:00:18] : [Step 2/5] 'repository/org/apache/ignite/ignite-clients/2.13.0-SNAPSHOT/ignite-clients-2.13.0-SNAPSHOT.pom' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-clients/2.13.0-SNAPSHOT/ignite-clients-2.13.0-SNAPSHOT.pom' [21:00:18] : [Step 2/5] 'repository/org/apache/ignite/ignite-clients/2.13.0-SNAPSHOT/ignite-clients-2.13.0-SNAPSHOT-sources.jar' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-clients/2.13.0-SNAPSHOT/ignite-clients-2.13.0-SNAPSHOT-sources.jar' [21:00:18] : [Step 2/5] 'repository/org/apache/ignite/ignite-osgi-paxlogging/maven-metadata-local.xml' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-osgi-paxlogging/maven-metadata-local.xml' [21:00:18] : [Step 2/5] 'repository/org/apache/ignite/ignite-osgi-paxlogging/2.13.0-SNAPSHOT/ignite-osgi-paxlogging-2.13.0-SNAPSHOT-sources.jar' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-osgi-paxlogging/2.13.0-SNAPSHOT/ignite-osgi-paxlogging-2.13.0-SNAPSHOT-sources.jar' [21:00:18] : [Step 2/5] 'repository/org/apache/ignite/ignite-osgi-paxlogging/2.13.0-SNAPSHOT/maven-metadata-local.xml' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-osgi-paxlogging/2.13.0-SNAPSHOT/maven-metadata-local.xml' [21:00:18] : [Step 2/5] 'repository/org/apache/ignite/ignite-osgi-paxlogging/2.13.0-SNAPSHOT/ignite-osgi-paxlogging-2.13.0-SNAPSHOT.pom' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-osgi-paxlogging/2.13.0-SNAPSHOT/ignite-osgi-paxlogging-2.13.0-SNAPSHOT.pom' [21:00:18] : [Step 2/5] 'repository/org/apache/ignite/ignite-osgi-paxlogging/2.13.0-SNAPSHOT/_remote.repositories' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-osgi-paxlogging/2.13.0-SNAPSHOT/_remote.repositories' [21:00:18] : [Step 2/5] 'repository/org/apache/ignite/ignite-osgi-paxlogging/2.13.0-SNAPSHOT/ignite-osgi-paxlogging-2.13.0-SNAPSHOT.jar' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-osgi-paxlogging/2.13.0-SNAPSHOT/ignite-osgi-paxlogging-2.13.0-SNAPSHOT.jar' [21:00:18] : [Step 2/5] 'repository/org/apache/ignite/ignite-jcl/maven-metadata-local.xml' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-jcl/maven-metadata-local.xml' [21:00:18] : [Step 2/5] 'repository/org/apache/ignite/ignite-jcl/2.13.0-SNAPSHOT/maven-metadata-local.xml' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-jcl/2.13.0-SNAPSHOT/maven-metadata-local.xml' [21:00:18] : [Step 2/5] 'repository/org/apache/ignite/ignite-jcl/2.13.0-SNAPSHOT/ignite-jcl-2.13.0-SNAPSHOT.jar' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-jcl/2.13.0-SNAPSHOT/ignite-jcl-2.13.0-SNAPSHOT.jar' [21:00:18] : [Step 2/5] 'repository/org/apache/ignite/ignite-jcl/2.13.0-SNAPSHOT/_remote.repositories' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-jcl/2.13.0-SNAPSHOT/_remote.repositories' [21:00:18] : [Step 2/5] 'repository/org/apache/ignite/ignite-jcl/2.13.0-SNAPSHOT/ignite-jcl-2.13.0-SNAPSHOT.pom' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-jcl/2.13.0-SNAPSHOT/ignite-jcl-2.13.0-SNAPSHOT.pom' [21:00:18] : [Step 2/5] 'repository/org/apache/ignite/ignite-jcl/2.13.0-SNAPSHOT/ignite-jcl-2.13.0-SNAPSHOT-sources.jar' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-jcl/2.13.0-SNAPSHOT/ignite-jcl-2.13.0-SNAPSHOT-sources.jar' [21:00:18] : [Step 2/5] 'repository/org/apache/ignite/ignite-compress/maven-metadata-local.xml' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-compress/maven-metadata-local.xml' [21:00:18] : [Step 2/5] 'repository/org/apache/ignite/ignite-compress/2.13.0-SNAPSHOT/maven-metadata-local.xml' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-compress/2.13.0-SNAPSHOT/maven-metadata-local.xml' [21:00:18] : [Step 2/5] 'repository/org/apache/ignite/ignite-compress/2.13.0-SNAPSHOT/ignite-compress-2.13.0-SNAPSHOT-sources.jar' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-compress/2.13.0-SNAPSHOT/ignite-compress-2.13.0-SNAPSHOT-sources.jar' [21:00:18] : [Step 2/5] 'repository/org/apache/ignite/ignite-compress/2.13.0-SNAPSHOT/ignite-compress-2.13.0-SNAPSHOT.pom' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-compress/2.13.0-SNAPSHOT/ignite-compress-2.13.0-SNAPSHOT.pom' [21:00:18] : [Step 2/5] 'repository/org/apache/ignite/ignite-compress/2.13.0-SNAPSHOT/_remote.repositories' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-compress/2.13.0-SNAPSHOT/_remote.repositories' [21:00:18] : [Step 2/5] 'repository/org/apache/ignite/ignite-compress/2.13.0-SNAPSHOT/ignite-compress-2.13.0-SNAPSHOT.jar' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-compress/2.13.0-SNAPSHOT/ignite-compress-2.13.0-SNAPSHOT.jar' [21:00:18] : [Step 2/5] 'repository/org/apache/ignite/ignite-compress/2.13.0-SNAPSHOT/ignite-compress-2.13.0-SNAPSHOT-tests.jar' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-compress/2.13.0-SNAPSHOT/ignite-compress-2.13.0-SNAPSHOT-tests.jar' [21:00:18] : [Step 2/5] 'repository/org/apache/ignite/ignite-ducktests/maven-metadata-local.xml' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-ducktests/maven-metadata-local.xml' [21:00:18] : [Step 2/5] 'repository/org/apache/ignite/ignite-ducktests/2.13.0-SNAPSHOT/maven-metadata-local.xml' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-ducktests/2.13.0-SNAPSHOT/maven-metadata-local.xml' [21:00:18] : [Step 2/5] 'repository/org/apache/ignite/ignite-ducktests/2.13.0-SNAPSHOT/ignite-ducktests-2.13.0-SNAPSHOT.jar' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-ducktests/2.13.0-SNAPSHOT/ignite-ducktests-2.13.0-SNAPSHOT.jar' [21:00:18] : [Step 2/5] 'repository/org/apache/ignite/ignite-ducktests/2.13.0-SNAPSHOT/ignite-ducktests-2.13.0-SNAPSHOT.pom' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-ducktests/2.13.0-SNAPSHOT/ignite-ducktests-2.13.0-SNAPSHOT.pom' [21:00:18] : [Step 2/5] 'repository/org/apache/ignite/ignite-ducktests/2.13.0-SNAPSHOT/_remote.repositories' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-ducktests/2.13.0-SNAPSHOT/_remote.repositories' [21:00:18] : [Step 2/5] 'repository/org/apache/ignite/ignite-ducktests/2.13.0-SNAPSHOT/ignite-ducktests-2.13.0-SNAPSHOT-sources.jar' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-ducktests/2.13.0-SNAPSHOT/ignite-ducktests-2.13.0-SNAPSHOT-sources.jar' [21:00:18] : [Step 2/5] 'repository/org/apache/ignite/ignite-log4j2/maven-metadata-local.xml' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-log4j2/maven-metadata-local.xml' [21:00:18] : [Step 2/5] 'repository/org/apache/ignite/ignite-log4j2/2.13.0-SNAPSHOT/ignite-log4j2-2.13.0-SNAPSHOT.pom' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-log4j2/2.13.0-SNAPSHOT/ignite-log4j2-2.13.0-SNAPSHOT.pom' [21:00:18] : [Step 2/5] 'repository/org/apache/ignite/ignite-log4j2/2.13.0-SNAPSHOT/maven-metadata-local.xml' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-log4j2/2.13.0-SNAPSHOT/maven-metadata-local.xml' [21:00:18] : [Step 2/5] 'repository/org/apache/ignite/ignite-log4j2/2.13.0-SNAPSHOT/_remote.repositories' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-log4j2/2.13.0-SNAPSHOT/_remote.repositories' [21:00:18] : [Step 2/5] 'repository/org/apache/ignite/ignite-log4j2/2.13.0-SNAPSHOT/ignite-log4j2-2.13.0-SNAPSHOT-sources.jar' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-log4j2/2.13.0-SNAPSHOT/ignite-log4j2-2.13.0-SNAPSHOT-sources.jar' [21:00:18] : [Step 2/5] 'repository/org/apache/ignite/ignite-log4j2/2.13.0-SNAPSHOT/ignite-log4j2-2.13.0-SNAPSHOT.jar' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-log4j2/2.13.0-SNAPSHOT/ignite-log4j2-2.13.0-SNAPSHOT.jar' [21:00:18] : [Step 2/5] 'repository/org/apache/ignite/ignite-spark-2.4/maven-metadata-local.xml' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-spark-2.4/maven-metadata-local.xml' [21:00:18] : [Step 2/5] 'repository/org/apache/ignite/ignite-spark-2.4/2.13.0-SNAPSHOT/maven-metadata-local.xml' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-spark-2.4/2.13.0-SNAPSHOT/maven-metadata-local.xml' [21:00:18] : [Step 2/5] 'repository/org/apache/ignite/ignite-spark-2.4/2.13.0-SNAPSHOT/ignite-spark-2.4-2.13.0-SNAPSHOT-sources.jar' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-spark-2.4/2.13.0-SNAPSHOT/ignite-spark-2.4-2.13.0-SNAPSHOT-sources.jar' [21:00:18] : [Step 2/5] 'repository/org/apache/ignite/ignite-spark-2.4/2.13.0-SNAPSHOT/ignite-spark-2.4-2.13.0-SNAPSHOT.pom' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-spark-2.4/2.13.0-SNAPSHOT/ignite-spark-2.4-2.13.0-SNAPSHOT.pom' [21:00:18] : [Step 2/5] 'repository/org/apache/ignite/ignite-spark-2.4/2.13.0-SNAPSHOT/_remote.repositories' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-spark-2.4/2.13.0-SNAPSHOT/_remote.repositories' [21:00:18] : [Step 2/5] 'repository/org/apache/ignite/ignite-spark-2.4/2.13.0-SNAPSHOT/ignite-spark-2.4-2.13.0-SNAPSHOT.jar' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-spark-2.4/2.13.0-SNAPSHOT/ignite-spark-2.4-2.13.0-SNAPSHOT.jar' [21:00:18] : [Step 2/5] 'repository/org/apache/ignite/ignite-tools/maven-metadata-local.xml' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-tools/maven-metadata-local.xml' [21:00:18] : [Step 2/5] 'repository/org/apache/ignite/ignite-tools/2.13.0-SNAPSHOT/maven-metadata-local.xml' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-tools/2.13.0-SNAPSHOT/maven-metadata-local.xml' [21:00:18] : [Step 2/5] 'repository/org/apache/ignite/ignite-tools/2.13.0-SNAPSHOT/ignite-tools-2.13.0-SNAPSHOT.jar' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-tools/2.13.0-SNAPSHOT/ignite-tools-2.13.0-SNAPSHOT.jar' [21:00:18] : [Step 2/5] 'repository/org/apache/ignite/ignite-tools/2.13.0-SNAPSHOT/_remote.repositories' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-tools/2.13.0-SNAPSHOT/_remote.repositories' [21:00:18] : [Step 2/5] 'repository/org/apache/ignite/ignite-tools/2.13.0-SNAPSHOT/ignite-tools-2.13.0-SNAPSHOT-sources.jar' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-tools/2.13.0-SNAPSHOT/ignite-tools-2.13.0-SNAPSHOT-sources.jar' [21:00:18] : [Step 2/5] 'repository/org/apache/ignite/ignite-tools/2.13.0-SNAPSHOT/ignite-tools-2.13.0-SNAPSHOT.pom' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-tools/2.13.0-SNAPSHOT/ignite-tools-2.13.0-SNAPSHOT.pom' [21:00:18] : [Step 2/5] 'repository/org/apache/ignite/ignite-slf4j/maven-metadata-local.xml' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-slf4j/maven-metadata-local.xml' [21:00:18] : [Step 2/5] 'repository/org/apache/ignite/ignite-slf4j/2.13.0-SNAPSHOT/maven-metadata-local.xml' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-slf4j/2.13.0-SNAPSHOT/maven-metadata-local.xml' [21:00:18] : [Step 2/5] 'repository/org/apache/ignite/ignite-slf4j/2.13.0-SNAPSHOT/_remote.repositories' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-slf4j/2.13.0-SNAPSHOT/_remote.repositories' [21:00:18] : [Step 2/5] 'repository/org/apache/ignite/ignite-slf4j/2.13.0-SNAPSHOT/ignite-slf4j-2.13.0-SNAPSHOT.pom' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-slf4j/2.13.0-SNAPSHOT/ignite-slf4j-2.13.0-SNAPSHOT.pom' [21:00:18] : [Step 2/5] 'repository/org/apache/ignite/ignite-slf4j/2.13.0-SNAPSHOT/ignite-slf4j-2.13.0-SNAPSHOT.jar' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-slf4j/2.13.0-SNAPSHOT/ignite-slf4j-2.13.0-SNAPSHOT.jar' [21:00:18] : [Step 2/5] 'repository/org/apache/ignite/ignite-slf4j/2.13.0-SNAPSHOT/ignite-slf4j-2.13.0-SNAPSHOT-sources.jar' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-slf4j/2.13.0-SNAPSHOT/ignite-slf4j-2.13.0-SNAPSHOT-sources.jar' [21:00:18] : [Step 2/5] 'repository/org/apache/ignite/ignite-hibernate_5.1/maven-metadata-local.xml' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-hibernate_5.1/maven-metadata-local.xml' [21:00:18] : [Step 2/5] 'repository/org/apache/ignite/ignite-hibernate_5.1/2.13.0-SNAPSHOT/ignite-hibernate_5.1-2.13.0-SNAPSHOT.pom' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-hibernate_5.1/2.13.0-SNAPSHOT/ignite-hibernate_5.1-2.13.0-SNAPSHOT.pom' [21:00:18] : [Step 2/5] 'repository/org/apache/ignite/ignite-hibernate_5.1/2.13.0-SNAPSHOT/maven-metadata-local.xml' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-hibernate_5.1/2.13.0-SNAPSHOT/maven-metadata-local.xml' [21:00:18] : [Step 2/5] 'repository/org/apache/ignite/ignite-hibernate_5.1/2.13.0-SNAPSHOT/ignite-hibernate_5.1-2.13.0-SNAPSHOT-sources.jar' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-hibernate_5.1/2.13.0-SNAPSHOT/ignite-hibernate_5.1-2.13.0-SNAPSHOT-sources.jar' [21:00:18] : [Step 2/5] 'repository/org/apache/ignite/ignite-hibernate_5.1/2.13.0-SNAPSHOT/_remote.repositories' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-hibernate_5.1/2.13.0-SNAPSHOT/_remote.repositories' [21:00:18] : [Step 2/5] 'repository/org/apache/ignite/ignite-hibernate_5.1/2.13.0-SNAPSHOT/ignite-hibernate_5.1-2.13.0-SNAPSHOT.jar' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-hibernate_5.1/2.13.0-SNAPSHOT/ignite-hibernate_5.1-2.13.0-SNAPSHOT.jar' [21:00:18] : [Step 2/5] 'repository/org/apache/ignite/ignite-osgi/maven-metadata-local.xml' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-osgi/maven-metadata-local.xml' [21:00:18] : [Step 2/5] 'repository/org/apache/ignite/ignite-osgi/2.13.0-SNAPSHOT/ignite-osgi-2.13.0-SNAPSHOT-sources.jar' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-osgi/2.13.0-SNAPSHOT/ignite-osgi-2.13.0-SNAPSHOT-sources.jar' [21:00:18] : [Step 2/5] 'repository/org/apache/ignite/ignite-osgi/2.13.0-SNAPSHOT/ignite-osgi-2.13.0-SNAPSHOT.jar' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-osgi/2.13.0-SNAPSHOT/ignite-osgi-2.13.0-SNAPSHOT.jar' [21:00:18] : [Step 2/5] 'repository/org/apache/ignite/ignite-osgi/2.13.0-SNAPSHOT/maven-metadata-local.xml' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-osgi/2.13.0-SNAPSHOT/maven-metadata-local.xml' [21:00:18] : [Step 2/5] 'repository/org/apache/ignite/ignite-osgi/2.13.0-SNAPSHOT/_remote.repositories' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-osgi/2.13.0-SNAPSHOT/_remote.repositories' [21:00:18] : [Step 2/5] 'repository/org/apache/ignite/ignite-osgi/2.13.0-SNAPSHOT/ignite-osgi-2.13.0-SNAPSHOT-tests.jar' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-osgi/2.13.0-SNAPSHOT/ignite-osgi-2.13.0-SNAPSHOT-tests.jar' [21:00:18] : [Step 2/5] 'repository/org/apache/ignite/ignite-osgi/2.13.0-SNAPSHOT/ignite-osgi-2.13.0-SNAPSHOT.pom' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-osgi/2.13.0-SNAPSHOT/ignite-osgi-2.13.0-SNAPSHOT.pom' [21:00:18] : [Step 2/5] 'repository/org/apache/ignite/ignite-appserver-test/maven-metadata-local.xml' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-appserver-test/maven-metadata-local.xml' [21:00:18] : [Step 2/5] 'repository/org/apache/ignite/ignite-appserver-test/2.13.0-SNAPSHOT/maven-metadata-local.xml' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-appserver-test/2.13.0-SNAPSHOT/maven-metadata-local.xml' [21:00:18] : [Step 2/5] 'repository/org/apache/ignite/ignite-appserver-test/2.13.0-SNAPSHOT/ignite-appserver-test-2.13.0-SNAPSHOT-sources.jar' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-appserver-test/2.13.0-SNAPSHOT/ignite-appserver-test-2.13.0-SNAPSHOT-sources.jar' [21:00:18] : [Step 2/5] 'repository/org/apache/ignite/ignite-appserver-test/2.13.0-SNAPSHOT/_remote.repositories' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-appserver-test/2.13.0-SNAPSHOT/_remote.repositories' [21:00:18] : [Step 2/5] 'repository/org/apache/ignite/ignite-appserver-test/2.13.0-SNAPSHOT/ignite-appserver-test-2.13.0-SNAPSHOT.pom' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-appserver-test/2.13.0-SNAPSHOT/ignite-appserver-test-2.13.0-SNAPSHOT.pom' [21:00:18] : [Step 2/5] 'repository/org/apache/ignite/ignite-appserver-test/2.13.0-SNAPSHOT/ignite-appserver-test-2.13.0-SNAPSHOT.jar' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-appserver-test/2.13.0-SNAPSHOT/ignite-appserver-test-2.13.0-SNAPSHOT.jar' [21:00:18] : [Step 2/5] 'repository/org/apache/ignite/ignite-examples/maven-metadata-local.xml' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-examples/maven-metadata-local.xml' [21:00:18] : [Step 2/5] 'repository/org/apache/ignite/ignite-examples/2.13.0-SNAPSHOT/maven-metadata-local.xml' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-examples/2.13.0-SNAPSHOT/maven-metadata-local.xml' [21:00:18] : [Step 2/5] 'repository/org/apache/ignite/ignite-examples/2.13.0-SNAPSHOT/ignite-examples-2.13.0-SNAPSHOT.pom' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-examples/2.13.0-SNAPSHOT/ignite-examples-2.13.0-SNAPSHOT.pom' [21:00:18] : [Step 2/5] 'repository/org/apache/ignite/ignite-examples/2.13.0-SNAPSHOT/_remote.repositories' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-examples/2.13.0-SNAPSHOT/_remote.repositories' [21:00:18] : [Step 2/5] 'repository/org/apache/ignite/ignite-examples/2.13.0-SNAPSHOT/ignite-examples-2.13.0-SNAPSHOT-sources.jar' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-examples/2.13.0-SNAPSHOT/ignite-examples-2.13.0-SNAPSHOT-sources.jar' [21:00:18] : [Step 2/5] 'repository/org/apache/ignite/ignite-examples/2.13.0-SNAPSHOT/ignite-examples-2.13.0-SNAPSHOT.jar' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-examples/2.13.0-SNAPSHOT/ignite-examples-2.13.0-SNAPSHOT.jar' [21:00:18] : [Step 2/5] 'repository/org/apache/ignite/ignite-cassandra-serializers/maven-metadata-local.xml' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-cassandra-serializers/maven-metadata-local.xml' [21:00:18] : [Step 2/5] 'repository/org/apache/ignite/ignite-cassandra-serializers/2.13.0-SNAPSHOT/ignite-cassandra-serializers-2.13.0-SNAPSHOT.pom' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-cassandra-serializers/2.13.0-SNAPSHOT/ignite-cassandra-serializers-2.13.0-SNAPSHOT.pom' [21:00:18] : [Step 2/5] 'repository/org/apache/ignite/ignite-cassandra-serializers/2.13.0-SNAPSHOT/maven-metadata-local.xml' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-cassandra-serializers/2.13.0-SNAPSHOT/maven-metadata-local.xml' [21:00:18] : [Step 2/5] 'repository/org/apache/ignite/ignite-cassandra-serializers/2.13.0-SNAPSHOT/ignite-cassandra-serializers-2.13.0-SNAPSHOT-sources.jar' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-cassandra-serializers/2.13.0-SNAPSHOT/ignite-cassandra-serializers-2.13.0-SNAPSHOT-sources.jar' [21:00:18] : [Step 2/5] 'repository/org/apache/ignite/ignite-cassandra-serializers/2.13.0-SNAPSHOT/_remote.repositories' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-cassandra-serializers/2.13.0-SNAPSHOT/_remote.repositories' [21:00:18] : [Step 2/5] 'repository/org/apache/ignite/ignite-cassandra-serializers/2.13.0-SNAPSHOT/ignite-cassandra-serializers-2.13.0-SNAPSHOT.jar' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-cassandra-serializers/2.13.0-SNAPSHOT/ignite-cassandra-serializers-2.13.0-SNAPSHOT.jar' [21:00:18] : [Step 2/5] 'repository/org/apache/ignite/ignite-hibernate_4.2/maven-metadata-local.xml' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-hibernate_4.2/maven-metadata-local.xml' [21:00:18] : [Step 2/5] 'repository/org/apache/ignite/ignite-hibernate_4.2/2.13.0-SNAPSHOT/ignite-hibernate_4.2-2.13.0-SNAPSHOT.pom' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-hibernate_4.2/2.13.0-SNAPSHOT/ignite-hibernate_4.2-2.13.0-SNAPSHOT.pom' [21:00:18] : [Step 2/5] 'repository/org/apache/ignite/ignite-hibernate_4.2/2.13.0-SNAPSHOT/ignite-hibernate_4.2-2.13.0-SNAPSHOT-sources.jar' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-hibernate_4.2/2.13.0-SNAPSHOT/ignite-hibernate_4.2-2.13.0-SNAPSHOT-sources.jar' [21:00:18] : [Step 2/5] 'repository/org/apache/ignite/ignite-hibernate_4.2/2.13.0-SNAPSHOT/maven-metadata-local.xml' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-hibernate_4.2/2.13.0-SNAPSHOT/maven-metadata-local.xml' [21:00:18] : [Step 2/5] 'repository/org/apache/ignite/ignite-hibernate_4.2/2.13.0-SNAPSHOT/ignite-hibernate_4.2-2.13.0-SNAPSHOT.jar' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-hibernate_4.2/2.13.0-SNAPSHOT/ignite-hibernate_4.2-2.13.0-SNAPSHOT.jar' [21:00:18] : [Step 2/5] 'repository/org/apache/ignite/ignite-hibernate_4.2/2.13.0-SNAPSHOT/_remote.repositories' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-hibernate_4.2/2.13.0-SNAPSHOT/_remote.repositories' [21:00:18] : [Step 2/5] 'repository/org/apache/ignite/ignite-cloud/maven-metadata-local.xml' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-cloud/maven-metadata-local.xml' [21:00:18] : [Step 2/5] 'repository/org/apache/ignite/ignite-cloud/2.13.0-SNAPSHOT/maven-metadata-local.xml' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-cloud/2.13.0-SNAPSHOT/maven-metadata-local.xml' [21:00:18] : [Step 2/5] 'repository/org/apache/ignite/ignite-cloud/2.13.0-SNAPSHOT/ignite-cloud-2.13.0-SNAPSHOT.jar' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-cloud/2.13.0-SNAPSHOT/ignite-cloud-2.13.0-SNAPSHOT.jar' [21:00:18] : [Step 2/5] 'repository/org/apache/ignite/ignite-cloud/2.13.0-SNAPSHOT/_remote.repositories' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-cloud/2.13.0-SNAPSHOT/_remote.repositories' [21:00:18] : [Step 2/5] 'repository/org/apache/ignite/ignite-cloud/2.13.0-SNAPSHOT/ignite-cloud-2.13.0-SNAPSHOT-sources.jar' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-cloud/2.13.0-SNAPSHOT/ignite-cloud-2.13.0-SNAPSHOT-sources.jar' [21:00:18] : [Step 2/5] 'repository/org/apache/ignite/ignite-cloud/2.13.0-SNAPSHOT/ignite-cloud-2.13.0-SNAPSHOT.pom' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-cloud/2.13.0-SNAPSHOT/ignite-cloud-2.13.0-SNAPSHOT.pom' [21:00:18] : [Step 2/5] 'repository/org/apache/ignite/ignite-websphere-test/maven-metadata-local.xml' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-websphere-test/maven-metadata-local.xml' [21:00:18] : [Step 2/5] 'repository/org/apache/ignite/ignite-websphere-test/2.13.0-SNAPSHOT/maven-metadata-local.xml' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-websphere-test/2.13.0-SNAPSHOT/maven-metadata-local.xml' [21:00:18] : [Step 2/5] 'repository/org/apache/ignite/ignite-websphere-test/2.13.0-SNAPSHOT/_remote.repositories' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-websphere-test/2.13.0-SNAPSHOT/_remote.repositories' [21:00:18] : [Step 2/5] 'repository/org/apache/ignite/ignite-websphere-test/2.13.0-SNAPSHOT/ignite-websphere-test-2.13.0-SNAPSHOT.pom' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-websphere-test/2.13.0-SNAPSHOT/ignite-websphere-test-2.13.0-SNAPSHOT.pom' [21:00:18] : [Step 2/5] 'repository/org/apache/ignite/ignite-websphere-test/2.13.0-SNAPSHOT/ignite-websphere-test-2.13.0-SNAPSHOT-sources.jar' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-websphere-test/2.13.0-SNAPSHOT/ignite-websphere-test-2.13.0-SNAPSHOT-sources.jar' [21:00:18] : [Step 2/5] 'repository/org/apache/ignite/ignite-websphere-test/2.13.0-SNAPSHOT/ignite-websphere-test-2.13.0-SNAPSHOT.war' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-websphere-test/2.13.0-SNAPSHOT/ignite-websphere-test-2.13.0-SNAPSHOT.war' [21:00:18] : [Step 2/5] 'repository/org/apache/ignite/ignite-codegen/maven-metadata-local.xml' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-codegen/maven-metadata-local.xml' [21:00:18] : [Step 2/5] 'repository/org/apache/ignite/ignite-codegen/2.13.0-SNAPSHOT/ignite-codegen-2.13.0-SNAPSHOT.jar' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-codegen/2.13.0-SNAPSHOT/ignite-codegen-2.13.0-SNAPSHOT.jar' [21:00:18] : [Step 2/5] 'repository/org/apache/ignite/ignite-codegen/2.13.0-SNAPSHOT/maven-metadata-local.xml' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-codegen/2.13.0-SNAPSHOT/maven-metadata-local.xml' [21:00:18] : [Step 2/5] 'repository/org/apache/ignite/ignite-codegen/2.13.0-SNAPSHOT/ignite-codegen-2.13.0-SNAPSHOT-sources.jar' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-codegen/2.13.0-SNAPSHOT/ignite-codegen-2.13.0-SNAPSHOT-sources.jar' [21:00:18] : [Step 2/5] 'repository/org/apache/ignite/ignite-codegen/2.13.0-SNAPSHOT/_remote.repositories' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-codegen/2.13.0-SNAPSHOT/_remote.repositories' [21:00:18] : [Step 2/5] 'repository/org/apache/ignite/ignite-codegen/2.13.0-SNAPSHOT/ignite-codegen-2.13.0-SNAPSHOT.pom' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-codegen/2.13.0-SNAPSHOT/ignite-codegen-2.13.0-SNAPSHOT.pom' [21:00:18] : [Step 2/5] 'repository/org/apache/ignite/ignite-osgi-karaf/maven-metadata-local.xml' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-osgi-karaf/maven-metadata-local.xml' [21:00:18] : [Step 2/5] 'repository/org/apache/ignite/ignite-osgi-karaf/2.13.0-SNAPSHOT/ignite-osgi-karaf-2.13.0-SNAPSHOT-features.xml' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-osgi-karaf/2.13.0-SNAPSHOT/ignite-osgi-karaf-2.13.0-SNAPSHOT-features.xml' [21:00:18] : [Step 2/5] 'repository/org/apache/ignite/ignite-osgi-karaf/2.13.0-SNAPSHOT/maven-metadata-local.xml' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-osgi-karaf/2.13.0-SNAPSHOT/maven-metadata-local.xml' [21:00:18] : [Step 2/5] 'repository/org/apache/ignite/ignite-osgi-karaf/2.13.0-SNAPSHOT/_remote.repositories' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-osgi-karaf/2.13.0-SNAPSHOT/_remote.repositories' [21:00:18] : [Step 2/5] 'repository/org/apache/ignite/ignite-osgi-karaf/2.13.0-SNAPSHOT/ignite-osgi-karaf-2.13.0-SNAPSHOT.pom' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-osgi-karaf/2.13.0-SNAPSHOT/ignite-osgi-karaf-2.13.0-SNAPSHOT.pom' [21:00:18] : [Step 2/5] 'repository/org/apache/ignite/ignite-benchmarks/maven-metadata-local.xml' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-benchmarks/maven-metadata-local.xml' [21:00:18] : [Step 2/5] 'repository/org/apache/ignite/ignite-benchmarks/2.13.0-SNAPSHOT/ignite-benchmarks-2.13.0-SNAPSHOT-tests.jar' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-benchmarks/2.13.0-SNAPSHOT/ignite-benchmarks-2.13.0-SNAPSHOT-tests.jar' [21:00:18] : [Step 2/5] 'repository/org/apache/ignite/ignite-benchmarks/2.13.0-SNAPSHOT/ignite-benchmarks-2.13.0-SNAPSHOT-sources.jar' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-benchmarks/2.13.0-SNAPSHOT/ignite-benchmarks-2.13.0-SNAPSHOT-sources.jar' [21:00:18] : [Step 2/5] 'repository/org/apache/ignite/ignite-benchmarks/2.13.0-SNAPSHOT/maven-metadata-local.xml' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-benchmarks/2.13.0-SNAPSHOT/maven-metadata-local.xml' [21:00:18] : [Step 2/5] 'repository/org/apache/ignite/ignite-benchmarks/2.13.0-SNAPSHOT/_remote.repositories' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-benchmarks/2.13.0-SNAPSHOT/_remote.repositories' [21:00:18] : [Step 2/5] 'repository/org/apache/ignite/ignite-benchmarks/2.13.0-SNAPSHOT/ignite-benchmarks-2.13.0-SNAPSHOT.pom' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-benchmarks/2.13.0-SNAPSHOT/ignite-benchmarks-2.13.0-SNAPSHOT.pom' [21:00:18] : [Step 2/5] 'repository/org/apache/ignite/ignite-benchmarks/2.13.0-SNAPSHOT/ignite-benchmarks-2.13.0-SNAPSHOT.jar' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-benchmarks/2.13.0-SNAPSHOT/ignite-benchmarks-2.13.0-SNAPSHOT.jar' [21:00:18] : [Step 2/5] 'repository/org/apache/ignite/ignite-extdata-uri/maven-metadata-local.xml' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-extdata-uri/maven-metadata-local.xml' [21:00:18] : [Step 2/5] 'repository/org/apache/ignite/ignite-extdata-uri/2.13.0-SNAPSHOT/maven-metadata-local.xml' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-extdata-uri/2.13.0-SNAPSHOT/maven-metadata-local.xml' [21:00:18] : [Step 2/5] 'repository/org/apache/ignite/ignite-extdata-uri/2.13.0-SNAPSHOT/_remote.repositories' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-extdata-uri/2.13.0-SNAPSHOT/_remote.repositories' [21:00:18] : [Step 2/5] 'repository/org/apache/ignite/ignite-extdata-uri/2.13.0-SNAPSHOT/ignite-extdata-uri-2.13.0-SNAPSHOT.pom' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-extdata-uri/2.13.0-SNAPSHOT/ignite-extdata-uri-2.13.0-SNAPSHOT.pom' [21:00:18] : [Step 2/5] 'repository/org/apache/ignite/ignite-extdata-uri/2.13.0-SNAPSHOT/ignite-extdata-uri-2.13.0-SNAPSHOT-well-signed.jar' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-extdata-uri/2.13.0-SNAPSHOT/ignite-extdata-uri-2.13.0-SNAPSHOT-well-signed.jar' [21:00:18] : [Step 2/5] 'repository/org/apache/ignite/ignite-extdata-uri/2.13.0-SNAPSHOT/ignite-extdata-uri-2.13.0-SNAPSHOT-plain.jar' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-extdata-uri/2.13.0-SNAPSHOT/ignite-extdata-uri-2.13.0-SNAPSHOT-plain.jar' [21:00:18] : [Step 2/5] 'repository/org/apache/ignite/ignite-extdata-uri/2.13.0-SNAPSHOT/ignite-extdata-uri-2.13.0-SNAPSHOT-bad-signed.jar' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-extdata-uri/2.13.0-SNAPSHOT/ignite-extdata-uri-2.13.0-SNAPSHOT-bad-signed.jar' [21:00:18] : [Step 2/5] 'repository/org/apache/ignite/ignite-dev-utils/maven-metadata-local.xml' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-dev-utils/maven-metadata-local.xml' [21:00:18] : [Step 2/5] 'repository/org/apache/ignite/ignite-dev-utils/2.13.0-SNAPSHOT/ignite-dev-utils-2.13.0-SNAPSHOT.jar' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-dev-utils/2.13.0-SNAPSHOT/ignite-dev-utils-2.13.0-SNAPSHOT.jar' [21:00:18] : [Step 2/5] 'repository/org/apache/ignite/ignite-dev-utils/2.13.0-SNAPSHOT/ignite-dev-utils-2.13.0-SNAPSHOT-sources.jar' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-dev-utils/2.13.0-SNAPSHOT/ignite-dev-utils-2.13.0-SNAPSHOT-sources.jar' [21:00:18] : [Step 2/5] 'repository/org/apache/ignite/ignite-dev-utils/2.13.0-SNAPSHOT/maven-metadata-local.xml' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-dev-utils/2.13.0-SNAPSHOT/maven-metadata-local.xml' [21:00:18] : [Step 2/5] 'repository/org/apache/ignite/ignite-dev-utils/2.13.0-SNAPSHOT/ignite-dev-utils-2.13.0-SNAPSHOT.pom' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-dev-utils/2.13.0-SNAPSHOT/ignite-dev-utils-2.13.0-SNAPSHOT.pom' [21:00:18] : [Step 2/5] 'repository/org/apache/ignite/ignite-dev-utils/2.13.0-SNAPSHOT/_remote.repositories' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-dev-utils/2.13.0-SNAPSHOT/_remote.repositories' [21:00:18] : [Step 2/5] 'repository/org/apache/ignite/ignite-dev-utils/2.13.0-SNAPSHOT/ignite-dev-utils-2.13.0-SNAPSHOT-jar-with-dependencies.jar' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-dev-utils/2.13.0-SNAPSHOT/ignite-dev-utils-2.13.0-SNAPSHOT-jar-with-dependencies.jar' [21:00:18] : [Step 2/5] 'repository/org/apache/ignite/apache-ignite/maven-metadata-local.xml' -> '/opt/buildagent/.m2/repository/org/apache/ignite/apache-ignite/maven-metadata-local.xml' [21:00:18] : [Step 2/5] 'repository/org/apache/ignite/apache-ignite/2.13.0-SNAPSHOT/maven-metadata-local.xml' -> '/opt/buildagent/.m2/repository/org/apache/ignite/apache-ignite/2.13.0-SNAPSHOT/maven-metadata-local.xml' [21:00:18] : [Step 2/5] 'repository/org/apache/ignite/apache-ignite/2.13.0-SNAPSHOT/_remote.repositories' -> '/opt/buildagent/.m2/repository/org/apache/ignite/apache-ignite/2.13.0-SNAPSHOT/_remote.repositories' [21:00:18] : [Step 2/5] 'repository/org/apache/ignite/apache-ignite/2.13.0-SNAPSHOT/apache-ignite-2.13.0-SNAPSHOT.pom' -> '/opt/buildagent/.m2/repository/org/apache/ignite/apache-ignite/2.13.0-SNAPSHOT/apache-ignite-2.13.0-SNAPSHOT.pom' [21:00:18] : [Step 2/5] 'repository/org/apache/ignite/ignite-ml-h2o-model-parser/maven-metadata-local.xml' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-ml-h2o-model-parser/maven-metadata-local.xml' [21:00:18] : [Step 2/5] 'repository/org/apache/ignite/ignite-ml-h2o-model-parser/2.13.0-SNAPSHOT/ignite-ml-h2o-model-parser-2.13.0-SNAPSHOT-sources.jar' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-ml-h2o-model-parser/2.13.0-SNAPSHOT/ignite-ml-h2o-model-parser-2.13.0-SNAPSHOT-sources.jar' [21:00:18] : [Step 2/5] 'repository/org/apache/ignite/ignite-ml-h2o-model-parser/2.13.0-SNAPSHOT/maven-metadata-local.xml' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-ml-h2o-model-parser/2.13.0-SNAPSHOT/maven-metadata-local.xml' [21:00:18] : [Step 2/5] 'repository/org/apache/ignite/ignite-ml-h2o-model-parser/2.13.0-SNAPSHOT/ignite-ml-h2o-model-parser-2.13.0-SNAPSHOT.jar' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-ml-h2o-model-parser/2.13.0-SNAPSHOT/ignite-ml-h2o-model-parser-2.13.0-SNAPSHOT.jar' [21:00:18] : [Step 2/5] 'repository/org/apache/ignite/ignite-ml-h2o-model-parser/2.13.0-SNAPSHOT/_remote.repositories' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-ml-h2o-model-parser/2.13.0-SNAPSHOT/_remote.repositories' [21:00:18] : [Step 2/5] 'repository/org/apache/ignite/ignite-ml-h2o-model-parser/2.13.0-SNAPSHOT/ignite-ml-h2o-model-parser-2.13.0-SNAPSHOT.pom' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-ml-h2o-model-parser/2.13.0-SNAPSHOT/ignite-ml-h2o-model-parser-2.13.0-SNAPSHOT.pom' [21:00:18] : [Step 2/5] 'repository/org/apache/ignite/ignite-mesos/maven-metadata-local.xml' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-mesos/maven-metadata-local.xml' [21:00:18] : [Step 2/5] 'repository/org/apache/ignite/ignite-mesos/2.13.0-SNAPSHOT/maven-metadata-local.xml' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-mesos/2.13.0-SNAPSHOT/maven-metadata-local.xml' [21:00:18] : [Step 2/5] 'repository/org/apache/ignite/ignite-mesos/2.13.0-SNAPSHOT/_remote.repositories' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-mesos/2.13.0-SNAPSHOT/_remote.repositories' [21:00:18] : [Step 2/5] 'repository/org/apache/ignite/ignite-mesos/2.13.0-SNAPSHOT/ignite-mesos-2.13.0-SNAPSHOT.jar' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-mesos/2.13.0-SNAPSHOT/ignite-mesos-2.13.0-SNAPSHOT.jar' [21:00:18] : [Step 2/5] 'repository/org/apache/ignite/ignite-mesos/2.13.0-SNAPSHOT/ignite-mesos-2.13.0-SNAPSHOT.pom' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-mesos/2.13.0-SNAPSHOT/ignite-mesos-2.13.0-SNAPSHOT.pom' [21:00:18] : [Step 2/5] 'repository/org/apache/ignite/ignite-mesos/2.13.0-SNAPSHOT/ignite-mesos-2.13.0-SNAPSHOT-sources.jar' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-mesos/2.13.0-SNAPSHOT/ignite-mesos-2.13.0-SNAPSHOT-sources.jar' [21:00:18] : [Step 2/5] 'repository/org/apache/ignite/ignite-web/maven-metadata-local.xml' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-web/maven-metadata-local.xml' [21:00:18] : [Step 2/5] 'repository/org/apache/ignite/ignite-web/2.13.0-SNAPSHOT/maven-metadata-local.xml' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-web/2.13.0-SNAPSHOT/maven-metadata-local.xml' [21:00:18] : [Step 2/5] 'repository/org/apache/ignite/ignite-web/2.13.0-SNAPSHOT/_remote.repositories' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-web/2.13.0-SNAPSHOT/_remote.repositories' [21:00:18] : [Step 2/5] 'repository/org/apache/ignite/ignite-web/2.13.0-SNAPSHOT/ignite-web-2.13.0-SNAPSHOT-sources.jar' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-web/2.13.0-SNAPSHOT/ignite-web-2.13.0-SNAPSHOT-sources.jar' [21:00:18] : [Step 2/5] 'repository/org/apache/ignite/ignite-web/2.13.0-SNAPSHOT/ignite-web-2.13.0-SNAPSHOT.pom' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-web/2.13.0-SNAPSHOT/ignite-web-2.13.0-SNAPSHOT.pom' [21:00:18] : [Step 2/5] 'repository/org/apache/ignite/ignite-web/2.13.0-SNAPSHOT/ignite-web-2.13.0-SNAPSHOT.jar' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-web/2.13.0-SNAPSHOT/ignite-web-2.13.0-SNAPSHOT.jar' [21:00:18] : [Step 2/5] 'repository/org/apache/ignite/ignite-ml/maven-metadata-local.xml' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-ml/maven-metadata-local.xml' [21:00:18] : [Step 2/5] 'repository/org/apache/ignite/ignite-ml/2.13.0-SNAPSHOT/ignite-ml-2.13.0-SNAPSHOT-sources.jar' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-ml/2.13.0-SNAPSHOT/ignite-ml-2.13.0-SNAPSHOT-sources.jar' [21:00:18] : [Step 2/5] 'repository/org/apache/ignite/ignite-ml/2.13.0-SNAPSHOT/maven-metadata-local.xml' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-ml/2.13.0-SNAPSHOT/maven-metadata-local.xml' [21:00:18] : [Step 2/5] 'repository/org/apache/ignite/ignite-ml/2.13.0-SNAPSHOT/ignite-ml-2.13.0-SNAPSHOT.pom' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-ml/2.13.0-SNAPSHOT/ignite-ml-2.13.0-SNAPSHOT.pom' [21:00:18] : [Step 2/5] 'repository/org/apache/ignite/ignite-ml/2.13.0-SNAPSHOT/_remote.repositories' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-ml/2.13.0-SNAPSHOT/_remote.repositories' [21:00:18] : [Step 2/5] 'repository/org/apache/ignite/ignite-ml/2.13.0-SNAPSHOT/ignite-ml-2.13.0-SNAPSHOT.jar' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-ml/2.13.0-SNAPSHOT/ignite-ml-2.13.0-SNAPSHOT.jar' [21:00:18] : [Step 2/5] 'repository/org/apache/ignite/ignite-extdata-uri-dep/maven-metadata-local.xml' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-extdata-uri-dep/maven-metadata-local.xml' [21:00:18] : [Step 2/5] 'repository/org/apache/ignite/ignite-extdata-uri-dep/2.13.0-SNAPSHOT/maven-metadata-local.xml' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-extdata-uri-dep/2.13.0-SNAPSHOT/maven-metadata-local.xml' [21:00:18] : [Step 2/5] 'repository/org/apache/ignite/ignite-extdata-uri-dep/2.13.0-SNAPSHOT/ignite-extdata-uri-dep-2.13.0-SNAPSHOT.pom' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-extdata-uri-dep/2.13.0-SNAPSHOT/ignite-extdata-uri-dep-2.13.0-SNAPSHOT.pom' [21:00:18] : [Step 2/5] 'repository/org/apache/ignite/ignite-extdata-uri-dep/2.13.0-SNAPSHOT/ignite-extdata-uri-dep-2.13.0-SNAPSHOT.jar' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-extdata-uri-dep/2.13.0-SNAPSHOT/ignite-extdata-uri-dep-2.13.0-SNAPSHOT.jar' [21:00:18] : [Step 2/5] 'repository/org/apache/ignite/ignite-extdata-uri-dep/2.13.0-SNAPSHOT/_remote.repositories' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-extdata-uri-dep/2.13.0-SNAPSHOT/_remote.repositories' [21:00:18] : [Step 2/5] 'repository/org/apache/ignite/ignite-extdata-uri-dep/2.13.0-SNAPSHOT/ignite-extdata-uri-dep-2.13.0-SNAPSHOT-sources.jar' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-extdata-uri-dep/2.13.0-SNAPSHOT/ignite-extdata-uri-dep-2.13.0-SNAPSHOT-sources.jar' [21:00:18] : [Step 2/5] 'repository/org/apache/ignite/ignite-ssh/maven-metadata-local.xml' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-ssh/maven-metadata-local.xml' [21:00:18] : [Step 2/5] 'repository/org/apache/ignite/ignite-ssh/2.13.0-SNAPSHOT/ignite-ssh-2.13.0-SNAPSHOT.jar' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-ssh/2.13.0-SNAPSHOT/ignite-ssh-2.13.0-SNAPSHOT.jar' [21:00:18] : [Step 2/5] 'repository/org/apache/ignite/ignite-ssh/2.13.0-SNAPSHOT/maven-metadata-local.xml' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-ssh/2.13.0-SNAPSHOT/maven-metadata-local.xml' [21:00:18] : [Step 2/5] 'repository/org/apache/ignite/ignite-ssh/2.13.0-SNAPSHOT/_remote.repositories' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-ssh/2.13.0-SNAPSHOT/_remote.repositories' [21:00:18] : [Step 2/5] 'repository/org/apache/ignite/ignite-ssh/2.13.0-SNAPSHOT/ignite-ssh-2.13.0-SNAPSHOT.pom' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-ssh/2.13.0-SNAPSHOT/ignite-ssh-2.13.0-SNAPSHOT.pom' [21:00:18] : [Step 2/5] 'repository/org/apache/ignite/ignite-ssh/2.13.0-SNAPSHOT/ignite-ssh-2.13.0-SNAPSHOT-sources.jar' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-ssh/2.13.0-SNAPSHOT/ignite-ssh-2.13.0-SNAPSHOT-sources.jar' [21:00:18] : [Step 2/5] 'repository/org/apache/ignite/ignite-visor-plugins/maven-metadata-local.xml' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-visor-plugins/maven-metadata-local.xml' [21:00:18] : [Step 2/5] 'repository/org/apache/ignite/ignite-visor-plugins/2.13.0-SNAPSHOT/ignite-visor-plugins-2.13.0-SNAPSHOT.jar' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-visor-plugins/2.13.0-SNAPSHOT/ignite-visor-plugins-2.13.0-SNAPSHOT.jar' [21:00:18] : [Step 2/5] 'repository/org/apache/ignite/ignite-visor-plugins/2.13.0-SNAPSHOT/maven-metadata-local.xml' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-visor-plugins/2.13.0-SNAPSHOT/maven-metadata-local.xml' [21:00:18] : [Step 2/5] 'repository/org/apache/ignite/ignite-visor-plugins/2.13.0-SNAPSHOT/ignite-visor-plugins-2.13.0-SNAPSHOT-sources.jar' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-visor-plugins/2.13.0-SNAPSHOT/ignite-visor-plugins-2.13.0-SNAPSHOT-sources.jar' [21:00:18] : [Step 2/5] 'repository/org/apache/ignite/ignite-visor-plugins/2.13.0-SNAPSHOT/_remote.repositories' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-visor-plugins/2.13.0-SNAPSHOT/_remote.repositories' [21:00:18] : [Step 2/5] 'repository/org/apache/ignite/ignite-visor-plugins/2.13.0-SNAPSHOT/ignite-visor-plugins-2.13.0-SNAPSHOT.pom' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-visor-plugins/2.13.0-SNAPSHOT/ignite-visor-plugins-2.13.0-SNAPSHOT.pom' [21:00:18] : [Step 2/5] 'repository/org/apache/ignite/ignite-visor-console_2.10/maven-metadata-local.xml' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-visor-console_2.10/maven-metadata-local.xml' [21:00:18] : [Step 2/5] 'repository/org/apache/ignite/ignite-visor-console_2.10/2.13.0-SNAPSHOT/ignite-visor-console_2.10-2.13.0-SNAPSHOT-sources.jar' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-visor-console_2.10/2.13.0-SNAPSHOT/ignite-visor-console_2.10-2.13.0-SNAPSHOT-sources.jar' [21:00:18] : [Step 2/5] 'repository/org/apache/ignite/ignite-visor-console_2.10/2.13.0-SNAPSHOT/maven-metadata-local.xml' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-visor-console_2.10/2.13.0-SNAPSHOT/maven-metadata-local.xml' [21:00:18] : [Step 2/5] 'repository/org/apache/ignite/ignite-visor-console_2.10/2.13.0-SNAPSHOT/ignite-visor-console_2.10-2.13.0-SNAPSHOT.pom' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-visor-console_2.10/2.13.0-SNAPSHOT/ignite-visor-console_2.10-2.13.0-SNAPSHOT.pom' [21:00:18] : [Step 2/5] 'repository/org/apache/ignite/ignite-visor-console_2.10/2.13.0-SNAPSHOT/_remote.repositories' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-visor-console_2.10/2.13.0-SNAPSHOT/_remote.repositories' [21:00:18] : [Step 2/5] 'repository/org/apache/ignite/ignite-visor-console_2.10/2.13.0-SNAPSHOT/ignite-visor-console_2.10-2.13.0-SNAPSHOT.jar' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-visor-console_2.10/2.13.0-SNAPSHOT/ignite-visor-console_2.10-2.13.0-SNAPSHOT.jar' [21:00:18] : [Step 2/5] 'repository/org/apache/ignite/ignite-compatibility/maven-metadata-local.xml' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-compatibility/maven-metadata-local.xml' [21:00:18] : [Step 2/5] 'repository/org/apache/ignite/ignite-compatibility/2.13.0-SNAPSHOT/ignite-compatibility-2.13.0-SNAPSHOT.pom' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-compatibility/2.13.0-SNAPSHOT/ignite-compatibility-2.13.0-SNAPSHOT.pom' [21:00:18] : [Step 2/5] 'repository/org/apache/ignite/ignite-compatibility/2.13.0-SNAPSHOT/ignite-compatibility-2.13.0-SNAPSHOT-sources.jar' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-compatibility/2.13.0-SNAPSHOT/ignite-compatibility-2.13.0-SNAPSHOT-sources.jar' [21:00:18] : [Step 2/5] 'repository/org/apache/ignite/ignite-compatibility/2.13.0-SNAPSHOT/maven-metadata-local.xml' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-compatibility/2.13.0-SNAPSHOT/maven-metadata-local.xml' [21:00:18] : [Step 2/5] 'repository/org/apache/ignite/ignite-compatibility/2.13.0-SNAPSHOT/_remote.repositories' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-compatibility/2.13.0-SNAPSHOT/_remote.repositories' [21:00:18] : [Step 2/5] 'repository/org/apache/ignite/ignite-compatibility/2.13.0-SNAPSHOT/ignite-compatibility-2.13.0-SNAPSHOT-tests.jar' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-compatibility/2.13.0-SNAPSHOT/ignite-compatibility-2.13.0-SNAPSHOT-tests.jar' [21:00:18] : [Step 2/5] 'repository/org/apache/ignite/ignite-compatibility/2.13.0-SNAPSHOT/ignite-compatibility-2.13.0-SNAPSHOT.jar' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-compatibility/2.13.0-SNAPSHOT/ignite-compatibility-2.13.0-SNAPSHOT.jar' [21:00:18] : [Step 2/5] 'repository/org/apache/ignite/ignite-scalar/maven-metadata-local.xml' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-scalar/maven-metadata-local.xml' [21:00:18] : [Step 2/5] 'repository/org/apache/ignite/ignite-scalar/2.13.0-SNAPSHOT/maven-metadata-local.xml' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-scalar/2.13.0-SNAPSHOT/maven-metadata-local.xml' [21:00:18] : [Step 2/5] 'repository/org/apache/ignite/ignite-scalar/2.13.0-SNAPSHOT/_remote.repositories' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-scalar/2.13.0-SNAPSHOT/_remote.repositories' [21:00:18] : [Step 2/5] 'repository/org/apache/ignite/ignite-scalar/2.13.0-SNAPSHOT/ignite-scalar-2.13.0-SNAPSHOT-sources.jar' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-scalar/2.13.0-SNAPSHOT/ignite-scalar-2.13.0-SNAPSHOT-sources.jar' [21:00:18] : [Step 2/5] 'repository/org/apache/ignite/ignite-scalar/2.13.0-SNAPSHOT/ignite-scalar-2.13.0-SNAPSHOT.jar' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-scalar/2.13.0-SNAPSHOT/ignite-scalar-2.13.0-SNAPSHOT.jar' [21:00:18] : [Step 2/5] 'repository/org/apache/ignite/ignite-scalar/2.13.0-SNAPSHOT/ignite-scalar-2.13.0-SNAPSHOT.pom' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-scalar/2.13.0-SNAPSHOT/ignite-scalar-2.13.0-SNAPSHOT.pom' [21:00:18] : [Step 2/5] 'repository/org/apache/ignite/ignite-schedule/maven-metadata-local.xml' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-schedule/maven-metadata-local.xml' [21:00:18] : [Step 2/5] 'repository/org/apache/ignite/ignite-schedule/2.13.0-SNAPSHOT/maven-metadata-local.xml' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-schedule/2.13.0-SNAPSHOT/maven-metadata-local.xml' [21:00:18] : [Step 2/5] 'repository/org/apache/ignite/ignite-schedule/2.13.0-SNAPSHOT/ignite-schedule-2.13.0-SNAPSHOT-sources.jar' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-schedule/2.13.0-SNAPSHOT/ignite-schedule-2.13.0-SNAPSHOT-sources.jar' [21:00:18] : [Step 2/5] 'repository/org/apache/ignite/ignite-schedule/2.13.0-SNAPSHOT/ignite-schedule-2.13.0-SNAPSHOT.jar' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-schedule/2.13.0-SNAPSHOT/ignite-schedule-2.13.0-SNAPSHOT.jar' [21:00:18] : [Step 2/5] 'repository/org/apache/ignite/ignite-schedule/2.13.0-SNAPSHOT/_remote.repositories' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-schedule/2.13.0-SNAPSHOT/_remote.repositories' [21:00:18] : [Step 2/5] 'repository/org/apache/ignite/ignite-schedule/2.13.0-SNAPSHOT/ignite-schedule-2.13.0-SNAPSHOT.pom' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-schedule/2.13.0-SNAPSHOT/ignite-schedule-2.13.0-SNAPSHOT.pom' [21:00:18] : [Step 2/5] 'repository/org/apache/ignite/ignite-opencensus/maven-metadata-local.xml' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-opencensus/maven-metadata-local.xml' [21:00:18] : [Step 2/5] 'repository/org/apache/ignite/ignite-opencensus/2.13.0-SNAPSHOT/maven-metadata-local.xml' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-opencensus/2.13.0-SNAPSHOT/maven-metadata-local.xml' [21:00:18] : [Step 2/5] 'repository/org/apache/ignite/ignite-opencensus/2.13.0-SNAPSHOT/ignite-opencensus-2.13.0-SNAPSHOT.jar' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-opencensus/2.13.0-SNAPSHOT/ignite-opencensus-2.13.0-SNAPSHOT.jar' [21:00:18] : [Step 2/5] 'repository/org/apache/ignite/ignite-opencensus/2.13.0-SNAPSHOT/_remote.repositories' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-opencensus/2.13.0-SNAPSHOT/_remote.repositories' [21:00:18] : [Step 2/5] 'repository/org/apache/ignite/ignite-opencensus/2.13.0-SNAPSHOT/ignite-opencensus-2.13.0-SNAPSHOT-sources.jar' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-opencensus/2.13.0-SNAPSHOT/ignite-opencensus-2.13.0-SNAPSHOT-sources.jar' [21:00:18] : [Step 2/5] 'repository/org/apache/ignite/ignite-opencensus/2.13.0-SNAPSHOT/ignite-opencensus-2.13.0-SNAPSHOT.pom' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-opencensus/2.13.0-SNAPSHOT/ignite-opencensus-2.13.0-SNAPSHOT.pom' [21:00:18] : [Step 2/5] 'repository/org/apache/ignite/ignite-spring/maven-metadata-local.xml' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-spring/maven-metadata-local.xml' [21:00:18] : [Step 2/5] 'repository/org/apache/ignite/ignite-spring/2.13.0-SNAPSHOT/maven-metadata-local.xml' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-spring/2.13.0-SNAPSHOT/maven-metadata-local.xml' [21:00:18] : [Step 2/5] 'repository/org/apache/ignite/ignite-spring/2.13.0-SNAPSHOT/ignite-spring-2.13.0-SNAPSHOT-sources.jar' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-spring/2.13.0-SNAPSHOT/ignite-spring-2.13.0-SNAPSHOT-sources.jar' [21:00:18] : [Step 2/5] 'repository/org/apache/ignite/ignite-spring/2.13.0-SNAPSHOT/ignite-spring-2.13.0-SNAPSHOT.jar' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-spring/2.13.0-SNAPSHOT/ignite-spring-2.13.0-SNAPSHOT.jar' [21:00:18] : [Step 2/5] 'repository/org/apache/ignite/ignite-spring/2.13.0-SNAPSHOT/_remote.repositories' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-spring/2.13.0-SNAPSHOT/_remote.repositories' [21:00:18] : [Step 2/5] 'repository/org/apache/ignite/ignite-spring/2.13.0-SNAPSHOT/ignite-spring-2.13.0-SNAPSHOT.pom' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-spring/2.13.0-SNAPSHOT/ignite-spring-2.13.0-SNAPSHOT.pom' [21:00:18] : [Step 2/5] 'repository/org/apache/ignite/ignite-yarn/maven-metadata-local.xml' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-yarn/maven-metadata-local.xml' [21:00:18] : [Step 2/5] 'repository/org/apache/ignite/ignite-yarn/2.13.0-SNAPSHOT/ignite-yarn-2.13.0-SNAPSHOT.jar' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-yarn/2.13.0-SNAPSHOT/ignite-yarn-2.13.0-SNAPSHOT.jar' [21:00:18] : [Step 2/5] 'repository/org/apache/ignite/ignite-yarn/2.13.0-SNAPSHOT/maven-metadata-local.xml' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-yarn/2.13.0-SNAPSHOT/maven-metadata-local.xml' [21:00:18] : [Step 2/5] 'repository/org/apache/ignite/ignite-yarn/2.13.0-SNAPSHOT/ignite-yarn-2.13.0-SNAPSHOT-sources.jar' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-yarn/2.13.0-SNAPSHOT/ignite-yarn-2.13.0-SNAPSHOT-sources.jar' [21:00:18] : [Step 2/5] 'repository/org/apache/ignite/ignite-yarn/2.13.0-SNAPSHOT/_remote.repositories' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-yarn/2.13.0-SNAPSHOT/_remote.repositories' [21:00:18] : [Step 2/5] 'repository/org/apache/ignite/ignite-yarn/2.13.0-SNAPSHOT/ignite-yarn-2.13.0-SNAPSHOT.pom' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-yarn/2.13.0-SNAPSHOT/ignite-yarn-2.13.0-SNAPSHOT.pom' [21:00:18] : [Step 2/5] 'repository/org/apache/ignite/ignite-kubernetes/maven-metadata-local.xml' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-kubernetes/maven-metadata-local.xml' [21:00:18] : [Step 2/5] 'repository/org/apache/ignite/ignite-kubernetes/2.13.0-SNAPSHOT/ignite-kubernetes-2.13.0-SNAPSHOT-sources.jar' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-kubernetes/2.13.0-SNAPSHOT/ignite-kubernetes-2.13.0-SNAPSHOT-sources.jar' [21:00:18] : [Step 2/5] 'repository/org/apache/ignite/ignite-kubernetes/2.13.0-SNAPSHOT/maven-metadata-local.xml' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-kubernetes/2.13.0-SNAPSHOT/maven-metadata-local.xml' [21:00:18] : [Step 2/5] 'repository/org/apache/ignite/ignite-kubernetes/2.13.0-SNAPSHOT/ignite-kubernetes-2.13.0-SNAPSHOT.jar' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-kubernetes/2.13.0-SNAPSHOT/ignite-kubernetes-2.13.0-SNAPSHOT.jar' [21:00:18] : [Step 2/5] 'repository/org/apache/ignite/ignite-kubernetes/2.13.0-SNAPSHOT/ignite-kubernetes-2.13.0-SNAPSHOT.pom' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-kubernetes/2.13.0-SNAPSHOT/ignite-kubernetes-2.13.0-SNAPSHOT.pom' [21:00:18] : [Step 2/5] 'repository/org/apache/ignite/ignite-kubernetes/2.13.0-SNAPSHOT/_remote.repositories' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-kubernetes/2.13.0-SNAPSHOT/_remote.repositories' [21:00:18] : [Step 2/5] 'repository/org/apache/ignite/ignite-cassandra-store/maven-metadata-local.xml' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-cassandra-store/maven-metadata-local.xml' [21:00:19] : [Step 2/5] 'repository/org/apache/ignite/ignite-cassandra-store/2.13.0-SNAPSHOT/ignite-cassandra-store-2.13.0-SNAPSHOT.pom' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-cassandra-store/2.13.0-SNAPSHOT/ignite-cassandra-store-2.13.0-SNAPSHOT.pom' [21:00:19] : [Step 2/5] 'repository/org/apache/ignite/ignite-cassandra-store/2.13.0-SNAPSHOT/maven-metadata-local.xml' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-cassandra-store/2.13.0-SNAPSHOT/maven-metadata-local.xml' [21:00:19] : [Step 2/5] 'repository/org/apache/ignite/ignite-cassandra-store/2.13.0-SNAPSHOT/_remote.repositories' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-cassandra-store/2.13.0-SNAPSHOT/_remote.repositories' [21:00:19] : [Step 2/5] 'repository/org/apache/ignite/ignite-cassandra-store/2.13.0-SNAPSHOT/ignite-cassandra-store-2.13.0-SNAPSHOT.jar' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-cassandra-store/2.13.0-SNAPSHOT/ignite-cassandra-store-2.13.0-SNAPSHOT.jar' [21:00:19] : [Step 2/5] 'repository/org/apache/ignite/ignite-cassandra-store/2.13.0-SNAPSHOT/ignite-cassandra-store-2.13.0-SNAPSHOT-sources.jar' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-cassandra-store/2.13.0-SNAPSHOT/ignite-cassandra-store-2.13.0-SNAPSHOT-sources.jar' [21:00:19] : [Step 2/5] 'repository/org/apache/ignite/ignite-ml-catboost-model-parser/maven-metadata-local.xml' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-ml-catboost-model-parser/maven-metadata-local.xml' [21:00:19] : [Step 2/5] 'repository/org/apache/ignite/ignite-ml-catboost-model-parser/2.13.0-SNAPSHOT/ignite-ml-catboost-model-parser-2.13.0-SNAPSHOT.jar' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-ml-catboost-model-parser/2.13.0-SNAPSHOT/ignite-ml-catboost-model-parser-2.13.0-SNAPSHOT.jar' [21:00:19] : [Step 2/5] 'repository/org/apache/ignite/ignite-ml-catboost-model-parser/2.13.0-SNAPSHOT/maven-metadata-local.xml' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-ml-catboost-model-parser/2.13.0-SNAPSHOT/maven-metadata-local.xml' [21:00:19] : [Step 2/5] 'repository/org/apache/ignite/ignite-ml-catboost-model-parser/2.13.0-SNAPSHOT/_remote.repositories' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-ml-catboost-model-parser/2.13.0-SNAPSHOT/_remote.repositories' [21:00:19] : [Step 2/5] 'repository/org/apache/ignite/ignite-ml-catboost-model-parser/2.13.0-SNAPSHOT/ignite-ml-catboost-model-parser-2.13.0-SNAPSHOT-sources.jar' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-ml-catboost-model-parser/2.13.0-SNAPSHOT/ignite-ml-catboost-model-parser-2.13.0-SNAPSHOT-sources.jar' [21:00:19] : [Step 2/5] 'repository/org/apache/ignite/ignite-ml-catboost-model-parser/2.13.0-SNAPSHOT/ignite-ml-catboost-model-parser-2.13.0-SNAPSHOT.pom' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-ml-catboost-model-parser/2.13.0-SNAPSHOT/ignite-ml-catboost-model-parser-2.13.0-SNAPSHOT.pom' [21:00:19] : [Step 2/5] 'repository/org/apache/ignite/ignite-core/maven-metadata-local.xml' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-core/maven-metadata-local.xml' [21:00:19] : [Step 2/5] 'repository/org/apache/ignite/ignite-core/2.13.0-SNAPSHOT/ignite-core-2.13.0-SNAPSHOT.jar' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-core/2.13.0-SNAPSHOT/ignite-core-2.13.0-SNAPSHOT.jar' [21:00:19] : [Step 2/5] 'repository/org/apache/ignite/ignite-core/2.13.0-SNAPSHOT/maven-metadata-local.xml' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-core/2.13.0-SNAPSHOT/maven-metadata-local.xml' [21:00:19] : [Step 2/5] 'repository/org/apache/ignite/ignite-core/2.13.0-SNAPSHOT/ignite-core-2.13.0-SNAPSHOT-tests.jar' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-core/2.13.0-SNAPSHOT/ignite-core-2.13.0-SNAPSHOT-tests.jar' [21:00:19] : [Step 2/5] 'repository/org/apache/ignite/ignite-core/2.13.0-SNAPSHOT/ignite-core-2.13.0-SNAPSHOT.pom' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-core/2.13.0-SNAPSHOT/ignite-core-2.13.0-SNAPSHOT.pom' [21:00:19] : [Step 2/5] 'repository/org/apache/ignite/ignite-core/2.13.0-SNAPSHOT/_remote.repositories' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-core/2.13.0-SNAPSHOT/_remote.repositories' [21:00:19] : [Step 2/5] 'repository/org/apache/ignite/ignite-core/2.13.0-SNAPSHOT/ignite-core-2.13.0-SNAPSHOT-sources.jar' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-core/2.13.0-SNAPSHOT/ignite-core-2.13.0-SNAPSHOT-sources.jar' [21:00:19] : [Step 2/5] 'repository/org/apache/ignite/ignite-aop/maven-metadata-local.xml' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-aop/maven-metadata-local.xml' [21:00:19] : [Step 2/5] 'repository/org/apache/ignite/ignite-aop/2.13.0-SNAPSHOT/ignite-aop-2.13.0-SNAPSHOT-sources.jar' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-aop/2.13.0-SNAPSHOT/ignite-aop-2.13.0-SNAPSHOT-sources.jar' [21:00:19] : [Step 2/5] 'repository/org/apache/ignite/ignite-aop/2.13.0-SNAPSHOT/maven-metadata-local.xml' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-aop/2.13.0-SNAPSHOT/maven-metadata-local.xml' [21:00:19] : [Step 2/5] 'repository/org/apache/ignite/ignite-aop/2.13.0-SNAPSHOT/ignite-aop-2.13.0-SNAPSHOT.pom' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-aop/2.13.0-SNAPSHOT/ignite-aop-2.13.0-SNAPSHOT.pom' [21:00:19] : [Step 2/5] 'repository/org/apache/ignite/ignite-aop/2.13.0-SNAPSHOT/_remote.repositories' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-aop/2.13.0-SNAPSHOT/_remote.repositories' [21:00:19] : [Step 2/5] 'repository/org/apache/ignite/ignite-aop/2.13.0-SNAPSHOT/ignite-aop-2.13.0-SNAPSHOT.jar' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-aop/2.13.0-SNAPSHOT/ignite-aop-2.13.0-SNAPSHOT.jar' [21:00:19] : [Step 2/5] 'repository/org/apache/ignite/ignite-jta/maven-metadata-local.xml' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-jta/maven-metadata-local.xml' [21:00:19] : [Step 2/5] 'repository/org/apache/ignite/ignite-jta/2.13.0-SNAPSHOT/maven-metadata-local.xml' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-jta/2.13.0-SNAPSHOT/maven-metadata-local.xml' [21:00:19] : [Step 2/5] 'repository/org/apache/ignite/ignite-jta/2.13.0-SNAPSHOT/ignite-jta-2.13.0-SNAPSHOT.pom' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-jta/2.13.0-SNAPSHOT/ignite-jta-2.13.0-SNAPSHOT.pom' [21:00:19] : [Step 2/5] 'repository/org/apache/ignite/ignite-jta/2.13.0-SNAPSHOT/ignite-jta-2.13.0-SNAPSHOT.jar' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-jta/2.13.0-SNAPSHOT/ignite-jta-2.13.0-SNAPSHOT.jar' [21:00:19] : [Step 2/5] 'repository/org/apache/ignite/ignite-jta/2.13.0-SNAPSHOT/_remote.repositories' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-jta/2.13.0-SNAPSHOT/_remote.repositories' [21:00:19] : [Step 2/5] 'repository/org/apache/ignite/ignite-jta/2.13.0-SNAPSHOT/ignite-jta-2.13.0-SNAPSHOT-sources.jar' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-jta/2.13.0-SNAPSHOT/ignite-jta-2.13.0-SNAPSHOT-sources.jar' [21:00:19] : [Step 2/5] 'repository/org/apache/ignite/ignite-sqlline/maven-metadata-local.xml' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-sqlline/maven-metadata-local.xml' [21:00:19] : [Step 2/5] 'repository/org/apache/ignite/ignite-sqlline/2.13.0-SNAPSHOT/maven-metadata-local.xml' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-sqlline/2.13.0-SNAPSHOT/maven-metadata-local.xml' [21:00:19] : [Step 2/5] 'repository/org/apache/ignite/ignite-sqlline/2.13.0-SNAPSHOT/ignite-sqlline-2.13.0-SNAPSHOT.jar' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-sqlline/2.13.0-SNAPSHOT/ignite-sqlline-2.13.0-SNAPSHOT.jar' [21:00:19] : [Step 2/5] 'repository/org/apache/ignite/ignite-sqlline/2.13.0-SNAPSHOT/ignite-sqlline-2.13.0-SNAPSHOT.pom' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-sqlline/2.13.0-SNAPSHOT/ignite-sqlline-2.13.0-SNAPSHOT.pom' [21:00:19] : [Step 2/5] 'repository/org/apache/ignite/ignite-sqlline/2.13.0-SNAPSHOT/_remote.repositories' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-sqlline/2.13.0-SNAPSHOT/_remote.repositories' [21:00:19] : [Step 2/5] 'repository/org/apache/ignite/ignite-sqlline/2.13.0-SNAPSHOT/ignite-sqlline-2.13.0-SNAPSHOT-sources.jar' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-sqlline/2.13.0-SNAPSHOT/ignite-sqlline-2.13.0-SNAPSHOT-sources.jar' [21:00:19] : [Step 2/5] 'repository/org/apache/ignite/ignite-rest-http/maven-metadata-local.xml' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-rest-http/maven-metadata-local.xml' [21:00:19] : [Step 2/5] 'repository/org/apache/ignite/ignite-rest-http/2.13.0-SNAPSHOT/maven-metadata-local.xml' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-rest-http/2.13.0-SNAPSHOT/maven-metadata-local.xml' [21:00:19] : [Step 2/5] 'repository/org/apache/ignite/ignite-rest-http/2.13.0-SNAPSHOT/_remote.repositories' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-rest-http/2.13.0-SNAPSHOT/_remote.repositories' [21:00:19] : [Step 2/5] 'repository/org/apache/ignite/ignite-rest-http/2.13.0-SNAPSHOT/ignite-rest-http-2.13.0-SNAPSHOT-sources.jar' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-rest-http/2.13.0-SNAPSHOT/ignite-rest-http-2.13.0-SNAPSHOT-sources.jar' [21:00:19] : [Step 2/5] 'repository/org/apache/ignite/ignite-rest-http/2.13.0-SNAPSHOT/ignite-rest-http-2.13.0-SNAPSHOT.jar' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-rest-http/2.13.0-SNAPSHOT/ignite-rest-http-2.13.0-SNAPSHOT.jar' [21:00:19] : [Step 2/5] 'repository/org/apache/ignite/ignite-rest-http/2.13.0-SNAPSHOT/ignite-rest-http-2.13.0-SNAPSHOT.pom' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-rest-http/2.13.0-SNAPSHOT/ignite-rest-http-2.13.0-SNAPSHOT.pom' [21:00:19] : [Step 2/5] 'repository/org/apache/ignite/ignite-geospatial/maven-metadata-local.xml' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-geospatial/maven-metadata-local.xml' [21:00:19] : [Step 2/5] 'repository/org/apache/ignite/ignite-geospatial/2.13.0-SNAPSHOT/maven-metadata-local.xml' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-geospatial/2.13.0-SNAPSHOT/maven-metadata-local.xml' [21:00:19] : [Step 2/5] 'repository/org/apache/ignite/ignite-geospatial/2.13.0-SNAPSHOT/ignite-geospatial-2.13.0-SNAPSHOT-sources.jar' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-geospatial/2.13.0-SNAPSHOT/ignite-geospatial-2.13.0-SNAPSHOT-sources.jar' [21:00:19] : [Step 2/5] 'repository/org/apache/ignite/ignite-geospatial/2.13.0-SNAPSHOT/_remote.repositories' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-geospatial/2.13.0-SNAPSHOT/_remote.repositories' [21:00:19] : [Step 2/5] 'repository/org/apache/ignite/ignite-geospatial/2.13.0-SNAPSHOT/ignite-geospatial-2.13.0-SNAPSHOT.pom' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-geospatial/2.13.0-SNAPSHOT/ignite-geospatial-2.13.0-SNAPSHOT.pom' [21:00:19] : [Step 2/5] 'repository/org/apache/ignite/ignite-geospatial/2.13.0-SNAPSHOT/ignite-geospatial-2.13.0-SNAPSHOT.jar' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-geospatial/2.13.0-SNAPSHOT/ignite-geospatial-2.13.0-SNAPSHOT.jar' [21:00:19] : [Step 2/5] 'repository/org/apache/ignite/binary/test1/1.1/test1-1.1.jar' -> '/opt/buildagent/.m2/repository/org/apache/ignite/binary/test1/1.1/test1-1.1.jar' [21:00:19] : [Step 2/5] 'repository/org/apache/ignite/binary/test1/1.1/test1-1.1.pom.lastUpdated' -> '/opt/buildagent/.m2/repository/org/apache/ignite/binary/test1/1.1/test1-1.1.pom.lastUpdated' [21:00:19] : [Step 2/5] 'repository/org/apache/ignite/binary/test1/1.1/_remote.repositories' -> '/opt/buildagent/.m2/repository/org/apache/ignite/binary/test1/1.1/_remote.repositories' [21:00:19] : [Step 2/5] 'repository/org/apache/ignite/binary/test1/1.1/test1-1.1.pom' -> '/opt/buildagent/.m2/repository/org/apache/ignite/binary/test1/1.1/test1-1.1.pom' [21:00:19] : [Step 2/5] 'repository/org/apache/ignite/binary/test1/1.1/test1-1.1.jar.lastUpdated' -> '/opt/buildagent/.m2/repository/org/apache/ignite/binary/test1/1.1/test1-1.1.jar.lastUpdated' [21:00:19] : [Step 2/5] 'repository/org/apache/ignite/binary/test2/1.1/test2-1.1.jar' -> '/opt/buildagent/.m2/repository/org/apache/ignite/binary/test2/1.1/test2-1.1.jar' [21:00:19] : [Step 2/5] 'repository/org/apache/ignite/binary/test2/1.1/test2-1.1.pom.lastUpdated' -> '/opt/buildagent/.m2/repository/org/apache/ignite/binary/test2/1.1/test2-1.1.pom.lastUpdated' [21:00:19] : [Step 2/5] 'repository/org/apache/ignite/binary/test2/1.1/_remote.repositories' -> '/opt/buildagent/.m2/repository/org/apache/ignite/binary/test2/1.1/_remote.repositories' [21:00:19] : [Step 2/5] 'repository/org/apache/ignite/binary/test2/1.1/test2-1.1.jar.lastUpdated' -> '/opt/buildagent/.m2/repository/org/apache/ignite/binary/test2/1.1/test2-1.1.jar.lastUpdated' [21:00:19] : [Step 2/5] 'repository/org/apache/ignite/binary/test2/1.1/test2-1.1.pom' -> '/opt/buildagent/.m2/repository/org/apache/ignite/binary/test2/1.1/test2-1.1.pom' [21:00:19] : [Step 2/5] 'repository/org/apache/ignite/ignite-direct-io/maven-metadata-local.xml' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-direct-io/maven-metadata-local.xml' [21:00:19] : [Step 2/5] 'repository/org/apache/ignite/ignite-direct-io/2.13.0-SNAPSHOT/ignite-direct-io-2.13.0-SNAPSHOT.jar' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-direct-io/2.13.0-SNAPSHOT/ignite-direct-io-2.13.0-SNAPSHOT.jar' [21:00:19] : [Step 2/5] 'repository/org/apache/ignite/ignite-direct-io/2.13.0-SNAPSHOT/maven-metadata-local.xml' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-direct-io/2.13.0-SNAPSHOT/maven-metadata-local.xml' [21:00:19] : [Step 2/5] 'repository/org/apache/ignite/ignite-direct-io/2.13.0-SNAPSHOT/ignite-direct-io-2.13.0-SNAPSHOT.pom' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-direct-io/2.13.0-SNAPSHOT/ignite-direct-io-2.13.0-SNAPSHOT.pom' [21:00:19] : [Step 2/5] 'repository/org/apache/ignite/ignite-direct-io/2.13.0-SNAPSHOT/_remote.repositories' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-direct-io/2.13.0-SNAPSHOT/_remote.repositories' [21:00:19] : [Step 2/5] 'repository/org/apache/ignite/ignite-direct-io/2.13.0-SNAPSHOT/ignite-direct-io-2.13.0-SNAPSHOT-sources.jar' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-direct-io/2.13.0-SNAPSHOT/ignite-direct-io-2.13.0-SNAPSHOT-sources.jar' [21:00:19] : [Step 2/5] 'repository/org/apache/ignite/ignite-visor-console/maven-metadata-local.xml' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-visor-console/maven-metadata-local.xml' [21:00:19] : [Step 2/5] 'repository/org/apache/ignite/ignite-visor-console/2.13.0-SNAPSHOT/maven-metadata-local.xml' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-visor-console/2.13.0-SNAPSHOT/maven-metadata-local.xml' [21:00:19] : [Step 2/5] 'repository/org/apache/ignite/ignite-visor-console/2.13.0-SNAPSHOT/ignite-visor-console-2.13.0-SNAPSHOT-sources.jar' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-visor-console/2.13.0-SNAPSHOT/ignite-visor-console-2.13.0-SNAPSHOT-sources.jar' [21:00:19] : [Step 2/5] 'repository/org/apache/ignite/ignite-visor-console/2.13.0-SNAPSHOT/_remote.repositories' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-visor-console/2.13.0-SNAPSHOT/_remote.repositories' [21:00:19] : [Step 2/5] 'repository/org/apache/ignite/ignite-visor-console/2.13.0-SNAPSHOT/ignite-visor-console-2.13.0-SNAPSHOT.jar' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-visor-console/2.13.0-SNAPSHOT/ignite-visor-console-2.13.0-SNAPSHOT.jar' [21:00:19] : [Step 2/5] 'repository/org/apache/ignite/ignite-visor-console/2.13.0-SNAPSHOT/ignite-visor-console-2.13.0-SNAPSHOT.pom' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-visor-console/2.13.0-SNAPSHOT/ignite-visor-console-2.13.0-SNAPSHOT.pom' [21:00:19] : [Step 2/5] 'repository/org/apache/ignite/ignite-urideploy/maven-metadata-local.xml' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-urideploy/maven-metadata-local.xml' [21:00:19] : [Step 2/5] 'repository/org/apache/ignite/ignite-urideploy/2.13.0-SNAPSHOT/maven-metadata-local.xml' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-urideploy/2.13.0-SNAPSHOT/maven-metadata-local.xml' [21:00:19] : [Step 2/5] 'repository/org/apache/ignite/ignite-urideploy/2.13.0-SNAPSHOT/_remote.repositories' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-urideploy/2.13.0-SNAPSHOT/_remote.repositories' [21:00:19] : [Step 2/5] 'repository/org/apache/ignite/ignite-urideploy/2.13.0-SNAPSHOT/ignite-urideploy-2.13.0-SNAPSHOT-sources.jar' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-urideploy/2.13.0-SNAPSHOT/ignite-urideploy-2.13.0-SNAPSHOT-sources.jar' [21:00:19] : [Step 2/5] 'repository/org/apache/ignite/ignite-urideploy/2.13.0-SNAPSHOT/ignite-urideploy-2.13.0-SNAPSHOT.pom' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-urideploy/2.13.0-SNAPSHOT/ignite-urideploy-2.13.0-SNAPSHOT.pom' [21:00:19] : [Step 2/5] 'repository/org/apache/ignite/ignite-urideploy/2.13.0-SNAPSHOT/ignite-urideploy-2.13.0-SNAPSHOT.jar' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-urideploy/2.13.0-SNAPSHOT/ignite-urideploy-2.13.0-SNAPSHOT.jar' [21:00:19] : [Step 2/5] 'repository/org/apache/ignite/ignite-spark/maven-metadata-local.xml' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-spark/maven-metadata-local.xml' [21:00:19] : [Step 2/5] 'repository/org/apache/ignite/ignite-spark/2.13.0-SNAPSHOT/ignite-spark-2.13.0-SNAPSHOT.jar' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-spark/2.13.0-SNAPSHOT/ignite-spark-2.13.0-SNAPSHOT.jar' [21:00:19] : [Step 2/5] 'repository/org/apache/ignite/ignite-spark/2.13.0-SNAPSHOT/maven-metadata-local.xml' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-spark/2.13.0-SNAPSHOT/maven-metadata-local.xml' [21:00:19] : [Step 2/5] 'repository/org/apache/ignite/ignite-spark/2.13.0-SNAPSHOT/ignite-spark-2.13.0-SNAPSHOT-sources.jar' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-spark/2.13.0-SNAPSHOT/ignite-spark-2.13.0-SNAPSHOT-sources.jar' [21:00:19] : [Step 2/5] 'repository/org/apache/ignite/ignite-spark/2.13.0-SNAPSHOT/ignite-spark-2.13.0-SNAPSHOT.pom' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-spark/2.13.0-SNAPSHOT/ignite-spark-2.13.0-SNAPSHOT.pom' [21:00:19] : [Step 2/5] 'repository/org/apache/ignite/ignite-spark/2.13.0-SNAPSHOT/_remote.repositories' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-spark/2.13.0-SNAPSHOT/_remote.repositories' [21:00:19] : [Step 2/5] 'repository/org/apache/ignite/ignite-extdata-platform/maven-metadata-local.xml' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-extdata-platform/maven-metadata-local.xml' [21:00:19] : [Step 2/5] 'repository/org/apache/ignite/ignite-extdata-platform/2.13.0-SNAPSHOT/ignite-extdata-platform-2.13.0-SNAPSHOT-sources.jar' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-extdata-platform/2.13.0-SNAPSHOT/ignite-extdata-platform-2.13.0-SNAPSHOT-sources.jar' [21:00:19] : [Step 2/5] 'repository/org/apache/ignite/ignite-extdata-platform/2.13.0-SNAPSHOT/maven-metadata-local.xml' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-extdata-platform/2.13.0-SNAPSHOT/maven-metadata-local.xml' [21:00:19] : [Step 2/5] 'repository/org/apache/ignite/ignite-extdata-platform/2.13.0-SNAPSHOT/ignite-extdata-platform-2.13.0-SNAPSHOT.jar' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-extdata-platform/2.13.0-SNAPSHOT/ignite-extdata-platform-2.13.0-SNAPSHOT.jar' [21:00:19] : [Step 2/5] 'repository/org/apache/ignite/ignite-extdata-platform/2.13.0-SNAPSHOT/ignite-extdata-platform-2.13.0-SNAPSHOT.pom' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-extdata-platform/2.13.0-SNAPSHOT/ignite-extdata-platform-2.13.0-SNAPSHOT.pom' [21:00:19] : [Step 2/5] 'repository/org/apache/ignite/ignite-extdata-platform/2.13.0-SNAPSHOT/_remote.repositories' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-extdata-platform/2.13.0-SNAPSHOT/_remote.repositories' [21:00:19] : [Step 2/5] 'repository/org/apache/ignite/ignite-control-utility/maven-metadata-local.xml' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-control-utility/maven-metadata-local.xml' [21:00:19] : [Step 2/5] 'repository/org/apache/ignite/ignite-control-utility/2.13.0-SNAPSHOT/ignite-control-utility-2.13.0-SNAPSHOT.pom' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-control-utility/2.13.0-SNAPSHOT/ignite-control-utility-2.13.0-SNAPSHOT.pom' [21:00:19] : [Step 2/5] 'repository/org/apache/ignite/ignite-control-utility/2.13.0-SNAPSHOT/maven-metadata-local.xml' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-control-utility/2.13.0-SNAPSHOT/maven-metadata-local.xml' [21:00:19] : [Step 2/5] 'repository/org/apache/ignite/ignite-control-utility/2.13.0-SNAPSHOT/ignite-control-utility-2.13.0-SNAPSHOT-sources.jar' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-control-utility/2.13.0-SNAPSHOT/ignite-control-utility-2.13.0-SNAPSHOT-sources.jar' [21:00:19] : [Step 2/5] 'repository/org/apache/ignite/ignite-control-utility/2.13.0-SNAPSHOT/ignite-control-utility-2.13.0-SNAPSHOT.jar' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-control-utility/2.13.0-SNAPSHOT/ignite-control-utility-2.13.0-SNAPSHOT.jar' [21:00:19] : [Step 2/5] 'repository/org/apache/ignite/ignite-control-utility/2.13.0-SNAPSHOT/_remote.repositories' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-control-utility/2.13.0-SNAPSHOT/_remote.repositories' [21:00:19] : [Step 2/5] 'repository/org/apache/ignite/ignite-indexing/maven-metadata-local.xml' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-indexing/maven-metadata-local.xml' [21:00:19] : [Step 2/5] 'repository/org/apache/ignite/ignite-indexing/2.13.0-SNAPSHOT/ignite-indexing-2.13.0-SNAPSHOT.pom' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-indexing/2.13.0-SNAPSHOT/ignite-indexing-2.13.0-SNAPSHOT.pom' [21:00:19] : [Step 2/5] 'repository/org/apache/ignite/ignite-indexing/2.13.0-SNAPSHOT/ignite-indexing-2.13.0-SNAPSHOT-tests.jar' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-indexing/2.13.0-SNAPSHOT/ignite-indexing-2.13.0-SNAPSHOT-tests.jar' [21:00:19] : [Step 2/5] 'repository/org/apache/ignite/ignite-indexing/2.13.0-SNAPSHOT/maven-metadata-local.xml' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-indexing/2.13.0-SNAPSHOT/maven-metadata-local.xml' [21:00:19] : [Step 2/5] 'repository/org/apache/ignite/ignite-indexing/2.13.0-SNAPSHOT/ignite-indexing-2.13.0-SNAPSHOT.jar' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-indexing/2.13.0-SNAPSHOT/ignite-indexing-2.13.0-SNAPSHOT.jar' [21:00:19] : [Step 2/5] 'repository/org/apache/ignite/ignite-indexing/2.13.0-SNAPSHOT/_remote.repositories' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-indexing/2.13.0-SNAPSHOT/_remote.repositories' [21:00:19] : [Step 2/5] 'repository/org/apache/ignite/ignite-indexing/2.13.0-SNAPSHOT/ignite-indexing-2.13.0-SNAPSHOT-sources.jar' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-indexing/2.13.0-SNAPSHOT/ignite-indexing-2.13.0-SNAPSHOT-sources.jar' [21:00:19] : [Step 2/5] 'repository/org/apache/ignite/ignite-ml-spark-model-parser/maven-metadata-local.xml' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-ml-spark-model-parser/maven-metadata-local.xml' [21:00:19] : [Step 2/5] 'repository/org/apache/ignite/ignite-ml-spark-model-parser/2.13.0-SNAPSHOT/maven-metadata-local.xml' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-ml-spark-model-parser/2.13.0-SNAPSHOT/maven-metadata-local.xml' [21:00:19] : [Step 2/5] 'repository/org/apache/ignite/ignite-ml-spark-model-parser/2.13.0-SNAPSHOT/_remote.repositories' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-ml-spark-model-parser/2.13.0-SNAPSHOT/_remote.repositories' [21:00:19] : [Step 2/5] 'repository/org/apache/ignite/ignite-ml-spark-model-parser/2.13.0-SNAPSHOT/ignite-ml-spark-model-parser-2.13.0-SNAPSHOT.jar' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-ml-spark-model-parser/2.13.0-SNAPSHOT/ignite-ml-spark-model-parser-2.13.0-SNAPSHOT.jar' [21:00:19] : [Step 2/5] 'repository/org/apache/ignite/ignite-ml-spark-model-parser/2.13.0-SNAPSHOT/ignite-ml-spark-model-parser-2.13.0-SNAPSHOT.pom' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-ml-spark-model-parser/2.13.0-SNAPSHOT/ignite-ml-spark-model-parser-2.13.0-SNAPSHOT.pom' [21:00:19] : [Step 2/5] 'repository/org/apache/ignite/ignite-ml-spark-model-parser/2.13.0-SNAPSHOT/ignite-ml-spark-model-parser-2.13.0-SNAPSHOT-sources.jar' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-ml-spark-model-parser/2.13.0-SNAPSHOT/ignite-ml-spark-model-parser-2.13.0-SNAPSHOT-sources.jar' [21:00:19] : [Step 2/5] 'repository/org/apache/ignite/ignite-log4j/maven-metadata-local.xml' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-log4j/maven-metadata-local.xml' [21:00:19] : [Step 2/5] 'repository/org/apache/ignite/ignite-log4j/2.13.0-SNAPSHOT/ignite-log4j-2.13.0-SNAPSHOT.pom' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-log4j/2.13.0-SNAPSHOT/ignite-log4j-2.13.0-SNAPSHOT.pom' [21:00:19] : [Step 2/5] 'repository/org/apache/ignite/ignite-log4j/2.13.0-SNAPSHOT/maven-metadata-local.xml' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-log4j/2.13.0-SNAPSHOT/maven-metadata-local.xml' [21:00:19] : [Step 2/5] 'repository/org/apache/ignite/ignite-log4j/2.13.0-SNAPSHOT/ignite-log4j-2.13.0-SNAPSHOT-sources.jar' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-log4j/2.13.0-SNAPSHOT/ignite-log4j-2.13.0-SNAPSHOT-sources.jar' [21:00:19] : [Step 2/5] 'repository/org/apache/ignite/ignite-log4j/2.13.0-SNAPSHOT/_remote.repositories' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-log4j/2.13.0-SNAPSHOT/_remote.repositories' [21:00:19] : [Step 2/5] 'repository/org/apache/ignite/ignite-log4j/2.13.0-SNAPSHOT/ignite-log4j-2.13.0-SNAPSHOT.jar' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-log4j/2.13.0-SNAPSHOT/ignite-log4j-2.13.0-SNAPSHOT.jar' [21:00:19] : [Step 2/5] 'repository/org/apache/ignite/ignite-scalar_2.10/maven-metadata-local.xml' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-scalar_2.10/maven-metadata-local.xml' [21:00:19] : [Step 2/5] 'repository/org/apache/ignite/ignite-scalar_2.10/2.13.0-SNAPSHOT/ignite-scalar_2.10-2.13.0-SNAPSHOT.jar' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-scalar_2.10/2.13.0-SNAPSHOT/ignite-scalar_2.10-2.13.0-SNAPSHOT.jar' [21:00:19] : [Step 2/5] 'repository/org/apache/ignite/ignite-scalar_2.10/2.13.0-SNAPSHOT/ignite-scalar_2.10-2.13.0-SNAPSHOT.pom' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-scalar_2.10/2.13.0-SNAPSHOT/ignite-scalar_2.10-2.13.0-SNAPSHOT.pom' [21:00:19] : [Step 2/5] 'repository/org/apache/ignite/ignite-scalar_2.10/2.13.0-SNAPSHOT/maven-metadata-local.xml' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-scalar_2.10/2.13.0-SNAPSHOT/maven-metadata-local.xml' [21:00:19] : [Step 2/5] 'repository/org/apache/ignite/ignite-scalar_2.10/2.13.0-SNAPSHOT/_remote.repositories' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-scalar_2.10/2.13.0-SNAPSHOT/_remote.repositories' [21:00:19] : [Step 2/5] 'repository/org/apache/ignite/ignite-scalar_2.10/2.13.0-SNAPSHOT/ignite-scalar_2.10-2.13.0-SNAPSHOT-sources.jar' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-scalar_2.10/2.13.0-SNAPSHOT/ignite-scalar_2.10-2.13.0-SNAPSHOT-sources.jar' [21:00:19] : [Step 2/5] 'repository/org/apache/ignite/ignite-cassandra/maven-metadata-local.xml' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-cassandra/maven-metadata-local.xml' [21:00:19] : [Step 2/5] 'repository/org/apache/ignite/ignite-cassandra/2.13.0-SNAPSHOT/maven-metadata-local.xml' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-cassandra/2.13.0-SNAPSHOT/maven-metadata-local.xml' [21:00:19] : [Step 2/5] 'repository/org/apache/ignite/ignite-cassandra/2.13.0-SNAPSHOT/_remote.repositories' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-cassandra/2.13.0-SNAPSHOT/_remote.repositories' [21:00:19] : [Step 2/5] 'repository/org/apache/ignite/ignite-cassandra/2.13.0-SNAPSHOT/ignite-cassandra-2.13.0-SNAPSHOT.pom' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-cassandra/2.13.0-SNAPSHOT/ignite-cassandra-2.13.0-SNAPSHOT.pom' [21:00:19] : [Step 2/5] 'repository/org/apache/ignite/ignite-ml-xgboost-model-parser/maven-metadata-local.xml' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-ml-xgboost-model-parser/maven-metadata-local.xml' [21:00:19] : [Step 2/5] 'repository/org/apache/ignite/ignite-ml-xgboost-model-parser/2.13.0-SNAPSHOT/maven-metadata-local.xml' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-ml-xgboost-model-parser/2.13.0-SNAPSHOT/maven-metadata-local.xml' [21:00:19] : [Step 2/5] 'repository/org/apache/ignite/ignite-ml-xgboost-model-parser/2.13.0-SNAPSHOT/_remote.repositories' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-ml-xgboost-model-parser/2.13.0-SNAPSHOT/_remote.repositories' [21:00:19] : [Step 2/5] 'repository/org/apache/ignite/ignite-ml-xgboost-model-parser/2.13.0-SNAPSHOT/ignite-ml-xgboost-model-parser-2.13.0-SNAPSHOT-sources.jar' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-ml-xgboost-model-parser/2.13.0-SNAPSHOT/ignite-ml-xgboost-model-parser-2.13.0-SNAPSHOT-sources.jar' [21:00:19] : [Step 2/5] 'repository/org/apache/ignite/ignite-ml-xgboost-model-parser/2.13.0-SNAPSHOT/ignite-ml-xgboost-model-parser-2.13.0-SNAPSHOT.pom' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-ml-xgboost-model-parser/2.13.0-SNAPSHOT/ignite-ml-xgboost-model-parser-2.13.0-SNAPSHOT.pom' [21:00:19] : [Step 2/5] 'repository/org/apache/ignite/ignite-ml-xgboost-model-parser/2.13.0-SNAPSHOT/ignite-ml-xgboost-model-parser-2.13.0-SNAPSHOT.jar' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-ml-xgboost-model-parser/2.13.0-SNAPSHOT/ignite-ml-xgboost-model-parser-2.13.0-SNAPSHOT.jar' [21:00:19] : [Step 2/5] 'repository/org/apache/ignite/ignite-hibernate-core/maven-metadata-local.xml' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-hibernate-core/maven-metadata-local.xml' [21:00:19] : [Step 2/5] 'repository/org/apache/ignite/ignite-hibernate-core/2.13.0-SNAPSHOT/maven-metadata-local.xml' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-hibernate-core/2.13.0-SNAPSHOT/maven-metadata-local.xml' [21:00:19] : [Step 2/5] 'repository/org/apache/ignite/ignite-hibernate-core/2.13.0-SNAPSHOT/_remote.repositories' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-hibernate-core/2.13.0-SNAPSHOT/_remote.repositories' [21:00:19] : [Step 2/5] 'repository/org/apache/ignite/ignite-hibernate-core/2.13.0-SNAPSHOT/ignite-hibernate-core-2.13.0-SNAPSHOT-sources.jar' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-hibernate-core/2.13.0-SNAPSHOT/ignite-hibernate-core-2.13.0-SNAPSHOT-sources.jar' [21:00:19] : [Step 2/5] 'repository/org/apache/ignite/ignite-hibernate-core/2.13.0-SNAPSHOT/ignite-hibernate-core-2.13.0-SNAPSHOT.pom' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-hibernate-core/2.13.0-SNAPSHOT/ignite-hibernate-core-2.13.0-SNAPSHOT.pom' [21:00:19] : [Step 2/5] 'repository/org/apache/ignite/ignite-hibernate-core/2.13.0-SNAPSHOT/ignite-hibernate-core-2.13.0-SNAPSHOT.jar' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-hibernate-core/2.13.0-SNAPSHOT/ignite-hibernate-core-2.13.0-SNAPSHOT.jar' [21:00:19] : [Step 2/5] 'repository/org/apache/ignite/ignite-hibernate_5.3/maven-metadata-local.xml' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-hibernate_5.3/maven-metadata-local.xml' [21:00:19] : [Step 2/5] 'repository/org/apache/ignite/ignite-hibernate_5.3/2.13.0-SNAPSHOT/ignite-hibernate_5.3-2.13.0-SNAPSHOT-sources.jar' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-hibernate_5.3/2.13.0-SNAPSHOT/ignite-hibernate_5.3-2.13.0-SNAPSHOT-sources.jar' [21:00:19] : [Step 2/5] 'repository/org/apache/ignite/ignite-hibernate_5.3/2.13.0-SNAPSHOT/ignite-hibernate_5.3-2.13.0-SNAPSHOT.jar' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-hibernate_5.3/2.13.0-SNAPSHOT/ignite-hibernate_5.3-2.13.0-SNAPSHOT.jar' [21:00:19] : [Step 2/5] 'repository/org/apache/ignite/ignite-hibernate_5.3/2.13.0-SNAPSHOT/maven-metadata-local.xml' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-hibernate_5.3/2.13.0-SNAPSHOT/maven-metadata-local.xml' [21:00:19] : [Step 2/5] 'repository/org/apache/ignite/ignite-hibernate_5.3/2.13.0-SNAPSHOT/ignite-hibernate_5.3-2.13.0-SNAPSHOT.pom' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-hibernate_5.3/2.13.0-SNAPSHOT/ignite-hibernate_5.3-2.13.0-SNAPSHOT.pom' [21:00:19] : [Step 2/5] 'repository/org/apache/ignite/ignite-hibernate_5.3/2.13.0-SNAPSHOT/_remote.repositories' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-hibernate_5.3/2.13.0-SNAPSHOT/_remote.repositories' [21:00:19] : [Step 2/5] 'repository/org/apache/ignite/ignite-apache-license-gen/maven-metadata-local.xml' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-apache-license-gen/maven-metadata-local.xml' [21:00:19] : [Step 2/5] 'repository/org/apache/ignite/ignite-apache-license-gen/2.13.0-SNAPSHOT/ignite-apache-license-gen-2.13.0-SNAPSHOT.pom' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-apache-license-gen/2.13.0-SNAPSHOT/ignite-apache-license-gen-2.13.0-SNAPSHOT.pom' [21:00:19] : [Step 2/5] 'repository/org/apache/ignite/ignite-apache-license-gen/2.13.0-SNAPSHOT/maven-metadata-local.xml' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-apache-license-gen/2.13.0-SNAPSHOT/maven-metadata-local.xml' [21:00:19] : [Step 2/5] 'repository/org/apache/ignite/ignite-apache-license-gen/2.13.0-SNAPSHOT/_remote.repositories' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-apache-license-gen/2.13.0-SNAPSHOT/_remote.repositories' [21:00:19] : [Step 2/5] 'repository/org/apache/ignite/ignite-apache-license-gen/2.13.0-SNAPSHOT/ignite-apache-license-gen-2.13.0-SNAPSHOT.jar' -> '/opt/buildagent/.m2/repository/org/apache/ignite/ignite-apache-license-gen/2.13.0-SNAPSHOT/ignite-apache-license-gen-2.13.0-SNAPSHOT.jar' [21:00:19] : [Step 2/5] Process exited with code 0 [21:00:19]W: Step 3/5: Add JDK9+ libraries to local Maven repository (~/.m2/repository) [JDK8] (Maven) (9s) [21:00:19] : [Step 3/5] Using predefined Maven user settings: local-proxy.xml [21:00:19] : [Step 3/5] Using predefined Maven user settings: local-proxy.xml [21:00:19] : [Step 3/5] Initial M2_HOME not set [21:00:19] : [Step 3/5] Current M2_HOME = /opt/buildagent/tools/maven3_6 [21:00:19] : [Step 3/5] PATH = /opt/buildagent/tools/maven3_6/bin:/opt/node/bin:/opt/node/bin:/opt/java/openjdk/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin [21:00:19] : [Step 3/5] Using watcher: /opt/buildagent/plugins/mavenPlugin/maven-watcher-jdk16/maven-watcher-agent.jar [21:00:19] : [Step 3/5] *** Start reading the project structure *** [21:00:19]i: [Step 3/5] Initial MAVEN_OPTS not set [21:00:19]i: [Step 3/5] Current MAVEN_OPTS not set [21:00:21]i: [Step 3/5] [INFO] Scanning for projects... [21:00:22]i: [Step 3/5] [WARNING] [21:00:22]i: [Step 3/5] [WARNING] Some problems were encountered while building the effective model for org.apache.ignite:apache-ignite:pom:2.13.0-SNAPSHOT [21:00:22]i: [Step 3/5] [WARNING] 'parent.relativePath' of POM org.apache.ignite:ignite-parent:1 (/opt/buildagent/work/7bc1c54bc719b67c/parent/pom.xml) points at org.apache.ignite:apache-ignite instead of org.apache:apache, please verify your project structure @ org.apache.ignite:ignite-parent:1, /opt/buildagent/work/7bc1c54bc719b67c/parent/pom.xml, line 29, column 13 [21:00:22]i: [Step 3/5] [WARNING] [21:00:22]i: [Step 3/5] [WARNING] It is highly recommended to fix these problems because they threaten the stability of your build. [21:00:22]i: [Step 3/5] [WARNING] [21:00:22]i: [Step 3/5] [WARNING] For this reason, future Maven versions might no longer support building such malformed projects. [21:00:22]i: [Step 3/5] [WARNING] [21:00:22]i: [Step 3/5] [INFO] ------------------------------------------------------------------------ [21:00:22]i: [Step 3/5] [INFO] Reactor Build Order: [21:00:22]i: [Step 3/5] [INFO] [21:00:22]i: [Step 3/5] [INFO] ignite-apache-license-gen [jar] [21:00:22]i: [Step 3/5] [INFO] ignite-tools [jar] [21:00:22]i: [Step 3/5] [INFO] ignite-core [jar] [21:00:22]i: [Step 3/5] [INFO] ignite-indexing [jar] [21:00:22]i: [Step 3/5] [INFO] ignite-compress [jar] [21:00:22]i: [Step 3/5] [INFO] ignite-dev-utils [jar] [21:00:22]i: [Step 3/5] [INFO] ignite-direct-io [jar] [21:00:22]i: [Step 3/5] [INFO] ignite-ml [jar] [21:00:22]i: [Step 3/5] [INFO] ignite-extdata-p2p [jar] [21:00:22]i: [Step 3/5] [INFO] ignite-extdata-uri-dep [jar] [21:00:22]i: [Step 3/5] [INFO] ignite-extdata-uri [pom] [21:00:22]i: [Step 3/5] [INFO] ignite-extdata-platform [jar] [21:00:22]i: [Step 3/5] [INFO] ignite-urideploy [jar] [21:00:22]i: [Step 3/5] [INFO] ignite-log4j [jar] [21:00:22]i: [Step 3/5] [INFO] ignite-spring [jar] [21:00:22]i: [Step 3/5] [INFO] ignite-rest-http [jar] [21:00:22]i: [Step 3/5] [INFO] ignite-clients [jar] [21:00:22]i: [Step 3/5] [INFO] ignite-web [jar] [21:00:22]i: [Step 3/5] [INFO] ignite-aop [jar] [21:00:22]i: [Step 3/5] [INFO] ignite-ssh [jar] [21:00:22]i: [Step 3/5] [INFO] ignite-jta [jar] [21:00:22]i: [Step 3/5] [INFO] ignite-log4j2 [jar] [21:00:22]i: [Step 3/5] [INFO] ignite-slf4j [jar] [21:00:22]i: [Step 3/5] [INFO] ignite-jcl [jar] [21:00:22]i: [Step 3/5] [INFO] ignite-codegen [jar] [21:00:22]i: [Step 3/5] [INFO] ignite-cloud [jar] [21:00:22]i: [Step 3/5] [INFO] ignite-mesos [jar] [21:00:22]i: [Step 3/5] [INFO] ignite-yarn [jar] [21:00:22]i: [Step 3/5] [INFO] ignite-zookeeper [jar] [21:00:22]i: [Step 3/5] [INFO] ignite-hibernate-core [jar] [21:00:22]i: [Step 3/5] [INFO] ignite-osgi-paxlogging [jar] [21:00:22]i: [Step 3/5] [INFO] ignite-osgi-karaf [pom] [21:00:22]i: [Step 3/5] [INFO] ignite-osgi [jar] [21:00:22]i: [Step 3/5] [INFO] ignite-appserver-test [jar] [21:00:22]i: [Step 3/5] [INFO] ignite-websphere-test [war] [21:00:22]i: [Step 3/5] [INFO] ignite-cassandra [pom] [21:00:22]i: [Step 3/5] [INFO] ignite-cassandra-store [jar] [21:00:22]i: [Step 3/5] [INFO] ignite-cassandra-serializers [jar] [21:00:22]i: [Step 3/5] [INFO] ignite-kubernetes [jar] [21:00:22]i: [Step 3/5] [INFO] ignite-sqlline [jar] [21:00:22]i: [Step 3/5] [INFO] ignite-ml-spark-model-parser [jar] [21:00:22]i: [Step 3/5] [INFO] ignite-ml-xgboost-model-parser [jar] [21:00:22]i: [Step 3/5] [INFO] ignite-ml-catboost-model-parser [jar] [21:00:22]i: [Step 3/5] [INFO] ignite-ml-h2o-model-parser [jar] [21:00:22]i: [Step 3/5] [INFO] ignite-opencensus [jar] [21:00:22]i: [Step 3/5] [INFO] ignite-control-utility [jar] [21:00:22]i: [Step 3/5] [INFO] ignite-scalar [jar] [21:00:22]i: [Step 3/5] [INFO] ignite-spark [jar] [21:00:22]i: [Step 3/5] [INFO] ignite-visor-console [jar] [21:00:22]i: [Step 3/5] [INFO] ignite-visor-plugins [jar] [21:00:22]i: [Step 3/5] [INFO] ignite-spark-2.4 [jar] [21:00:22]i: [Step 3/5] [INFO] apache-ignite [pom] [21:00:23]i: [Step 3/5] [INFO] [21:00:23]i: [Step 3/5] [INFO] ------------------< org.apache.ignite:apache-ignite >------------------- [21:00:23]i: [Step 3/5] [INFO] Building apache-ignite 2.13.0-SNAPSHOT [1/52] [21:00:23]i: [Step 3/5] [INFO] --------------------------------[ pom ]--------------------------------- [21:00:23]i: [Step 3/5] [INFO] [21:00:23]i: [Step 3/5] [INFO] --- info-maven3-plugin:1.0.2:info (default-cli) @ apache-ignite --- [21:00:23]i: [Step 3/5] [INFO] ------------------------------------------------------------------------ [21:00:23]i: [Step 3/5] [INFO] Reactor Summary for apache-ignite 2.13.0-SNAPSHOT: [21:00:23]i: [Step 3/5] [INFO] [21:00:23]i: [Step 3/5] [INFO] ignite-apache-license-gen .......................... SKIPPED [21:00:23]i: [Step 3/5] [INFO] ignite-tools ....................................... SKIPPED [21:00:23]i: [Step 3/5] [INFO] ignite-core ........................................ SKIPPED [21:00:23]i: [Step 3/5] [INFO] ignite-indexing .................................... SKIPPED [21:00:23]i: [Step 3/5] [INFO] ignite-compress .................................... SKIPPED [21:00:23]i: [Step 3/5] [INFO] ignite-dev-utils ................................... SKIPPED [21:00:23]i: [Step 3/5] [INFO] ignite-direct-io ................................... SKIPPED [21:00:23]i: [Step 3/5] [INFO] ignite-ml .......................................... SKIPPED [21:00:23]i: [Step 3/5] [INFO] ignite-extdata-p2p ................................. SKIPPED [21:00:23]i: [Step 3/5] [INFO] ignite-extdata-uri-dep ............................. SKIPPED [21:00:23]i: [Step 3/5] [INFO] ignite-extdata-uri ................................. SKIPPED [21:00:23]i: [Step 3/5] [INFO] ignite-extdata-platform ............................ SKIPPED [21:00:23]i: [Step 3/5] [INFO] ignite-urideploy ................................... SKIPPED [21:00:23]i: [Step 3/5] [INFO] ignite-log4j ....................................... SKIPPED [21:00:23]i: [Step 3/5] [INFO] ignite-spring ...................................... SKIPPED [21:00:23]i: [Step 3/5] [INFO] ignite-rest-http ................................... SKIPPED [21:00:23]i: [Step 3/5] [INFO] ignite-clients ..................................... SKIPPED [21:00:23]i: [Step 3/5] [INFO] ignite-web ......................................... SKIPPED [21:00:23]i: [Step 3/5] [INFO] ignite-aop ......................................... SKIPPED [21:00:23]i: [Step 3/5] [INFO] ignite-ssh ......................................... SKIPPED [21:00:23]i: [Step 3/5] [INFO] ignite-jta ......................................... SKIPPED [21:00:23]i: [Step 3/5] [INFO] ignite-log4j2 ...................................... SKIPPED [21:00:23]i: [Step 3/5] [INFO] ignite-slf4j ....................................... SKIPPED [21:00:23]i: [Step 3/5] [INFO] ignite-jcl ......................................... SKIPPED [21:00:23]i: [Step 3/5] [INFO] ignite-codegen ..................................... SKIPPED [21:00:23]i: [Step 3/5] [INFO] ignite-cloud ....................................... SKIPPED [21:00:23]i: [Step 3/5] [INFO] ignite-mesos ....................................... SKIPPED [21:00:23]i: [Step 3/5] [INFO] ignite-yarn ........................................ SKIPPED [21:00:23]i: [Step 3/5] [INFO] ignite-zookeeper ................................... SKIPPED [21:00:23]i: [Step 3/5] [INFO] ignite-hibernate-core .............................. SKIPPED [21:00:23]i: [Step 3/5] [INFO] ignite-osgi-paxlogging ............................. SKIPPED [21:00:23]i: [Step 3/5] [INFO] ignite-osgi-karaf .................................. SKIPPED [21:00:23]i: [Step 3/5] [INFO] ignite-osgi ........................................ SKIPPED [21:00:23]i: [Step 3/5] [INFO] ignite-appserver-test .............................. SKIPPED [21:00:23]i: [Step 3/5] [INFO] ignite-websphere-test .............................. SKIPPED [21:00:23]i: [Step 3/5] [INFO] ignite-cassandra ................................... SKIPPED [21:00:23]i: [Step 3/5] [INFO] ignite-cassandra-store ............................. SKIPPED [21:00:23]i: [Step 3/5] [INFO] ignite-cassandra-serializers ....................... SKIPPED [21:00:23]i: [Step 3/5] [INFO] ignite-kubernetes .................................. SKIPPED [21:00:23]i: [Step 3/5] [INFO] ignite-sqlline ..................................... SKIPPED [21:00:23]i: [Step 3/5] [INFO] ignite-ml-spark-model-parser ....................... SKIPPED [21:00:23]i: [Step 3/5] [INFO] ignite-ml-xgboost-model-parser ..................... SKIPPED [21:00:23]i: [Step 3/5] [INFO] ignite-ml-catboost-model-parser .................... SKIPPED [21:00:23]i: [Step 3/5] [INFO] ignite-ml-h2o-model-parser ......................... SKIPPED [21:00:23]i: [Step 3/5] [INFO] ignite-opencensus .................................. SKIPPED [21:00:23]i: [Step 3/5] [INFO] ignite-control-utility ............................. SKIPPED [21:00:23]i: [Step 3/5] [INFO] ignite-scalar ...................................... SKIPPED [21:00:23]i: [Step 3/5] [INFO] ignite-spark ....................................... SKIPPED [21:00:23]i: [Step 3/5] [INFO] ignite-visor-console ............................... SKIPPED [21:00:23]i: [Step 3/5] [INFO] ignite-visor-plugins ............................... SKIPPED [21:00:23]i: [Step 3/5] [INFO] ignite-spark-2.4 ................................... SKIPPED [21:00:23]i: [Step 3/5] [INFO] apache-ignite ...................................... SUCCESS [ 0.091 s] [21:00:23]i: [Step 3/5] [INFO] ------------------------------------------------------------------------ [21:00:23]i: [Step 3/5] [INFO] BUILD SUCCESS [21:00:23]i: [Step 3/5] [INFO] ------------------------------------------------------------------------ [21:00:23]i: [Step 3/5] [INFO] Total time: 2.005 s [21:00:23]i: [Step 3/5] [INFO] Finished at: 2021-11-19T21:00:23+03:00 [21:00:23]i: [Step 3/5] [INFO] ------------------------------------------------------------------------ [21:00:23]i: [Step 3/5] Process exited with code 0 [21:00:23] : [Step 3/5] Initial MAVEN_OPTS not set [21:00:23] : [Step 3/5] Current MAVEN_OPTS not set [21:00:23] : [Step 3/5] Starting: /opt/java/jdk-ora-8/bin/java -DIGNITE_DUMP_THREADS_ON_FAILURE=false -DMono=/usr/bin/mono-sgen -DMono4.0_x64=/usr/lib/mono/4.0 -DMono4.5_x64=/usr/lib/mono/4.5 -DMonoVersion=6.12.0.90 -DSKIP_BUILD=false -Dagent.home.dir=/opt/buildagent -Dagent.name=aitc-lin02_03 -Dagent.ownPort=9090 -Dagent.work.dir=/opt/buildagent/work -Dbuild.number=95 -Dbuild.vcs.number=c6d91d0fa04338c406d0857a9a1008a36ea8a030 -Dbuild.vcs.number.1=c6d91d0fa04338c406d0857a9a1008a36ea8a030 -Dbuild.vcs.number.GitHubApacheIgnite=c6d91d0fa04338c406d0857a9a1008a36ea8a030 -Dclassworlds.conf=/opt/buildagent/temp/buildTmp/teamcity.m2.conf -Dcom.jetbrains.maven.watcher.report.file=/opt/buildagent/temp/buildTmp/maven-build-info.xml -Djava.io.tmpdir=/opt/buildagent/temp/buildTmp -Dmaven.home=/opt/buildagent/tools/maven3_6 -Dmaven.multiModuleProjectDirectory=/opt/buildagent/work/7bc1c54bc719b67c -Dteamcity.agent.cpuBenchmark=457 -Dteamcity.agent.dotnet.agent_url=http://localhost:9090/RPC2 -Dteamcity.agent.dotnet.build_id=6278078 -Dteamcity.auth.password=******* -Dteamcity.auth.userId=TeamCityBuildId=6278078 -Dteamcity.build.changedFiles.file=/opt/buildagent/temp/buildTmp/changedFiles6342607772318147725.txt -Dteamcity.build.checkoutDir=/opt/buildagent/work/7bc1c54bc719b67c -Dteamcity.build.id=6278078 -Dteamcity.build.properties.file=/opt/buildagent/temp/buildTmp/teamcity.build5164517880467851002.properties -Dteamcity.build.tempDir=/opt/buildagent/temp/buildTmp -Dteamcity.build.workingDir=/opt/buildagent/work/7bc1c54bc719b67c "-Dteamcity.buildConfName=Basic 3" -Dteamcity.buildType.id=IgniteTests24Java8_Basic3 -Dteamcity.configuration.properties.file=/opt/buildagent/temp/buildTmp/teamcity.config5591980786735343870.properties -Dteamcity.maven.userSettings.path=/opt/buildagent/temp/buildTmp/maven_settings_4594983054265045002.xml -Dteamcity.maven.watcher.home=/opt/buildagent/plugins/mavenPlugin/maven-watcher-jdk16 "-Dteamcity.projectName=Ignite Tests 2.x (JDK 8/11)" -Dteamcity.runner.properties.file=/opt/buildagent/temp/buildTmp/teamcity.runner9098465561618137420.properties -Dteamcity.tests.recentlyFailedTests.file=/opt/buildagent/temp/buildTmp/testsToRunFirst3891775683130404069.txt "-Dteamcity.version=2021.2 (build 99542)" -Dmaven.repo.local=/opt/buildagent/.m2/repository -classpath /opt/buildagent/tools/maven3_6/boot/plexus-classworlds-2.6.0.jar: org.codehaus.plexus.classworlds.launcher.Launcher -f /opt/buildagent/work/7bc1c54bc719b67c/pom.xml -B -s /opt/buildagent/temp/buildTmp/maven_settings_4594983054265045002.xml -Dartifact=javax.transaction:javax.transaction-api:1.3 org.apache.maven.plugins:maven-dependency-plugin:2.8:get [21:00:23] : [Step 3/5] in directory: /opt/buildagent/work/7bc1c54bc719b67c [21:00:25] : [Step 3/5] [INFO] Scanning for projects... [21:00:27]W: [Step 3/5] [WARNING] [21:00:27]W: [Step 3/5] [WARNING] Some problems were encountered while building the effective model for org.apache.ignite:apache-ignite:pom:2.13.0-SNAPSHOT [21:00:27]W: [Step 3/5] [WARNING] 'parent.relativePath' of POM org.apache.ignite:ignite-parent:1 (/opt/buildagent/work/7bc1c54bc719b67c/parent/pom.xml) points at org.apache.ignite:apache-ignite instead of org.apache:apache, please verify your project structure @ org.apache.ignite:ignite-parent:1, /opt/buildagent/work/7bc1c54bc719b67c/parent/pom.xml, line 29, column 13 [21:00:27]W: [Step 3/5] [WARNING] [21:00:27]W: [Step 3/5] [WARNING] It is highly recommended to fix these problems because they threaten the stability of your build. [21:00:27]W: [Step 3/5] [WARNING] [21:00:27]W: [Step 3/5] [WARNING] For this reason, future Maven versions might no longer support building such malformed projects. [21:00:27]W: [Step 3/5] [WARNING] [21:00:27] : [Step 3/5] [INFO] ------------------------------------------------------------------------ [21:00:27] : [Step 3/5] [INFO] Reactor Build Order: [21:00:27] : [Step 3/5] [INFO] [21:00:27] : [Step 3/5] [INFO] ignite-apache-license-gen [jar] [21:00:27] : [Step 3/5] [INFO] ignite-tools [jar] [21:00:27] : [Step 3/5] [INFO] ignite-core [jar] [21:00:27] : [Step 3/5] [INFO] ignite-indexing [jar] [21:00:27] : [Step 3/5] [INFO] ignite-compress [jar] [21:00:27] : [Step 3/5] [INFO] ignite-dev-utils [jar] [21:00:27] : [Step 3/5] [INFO] ignite-direct-io [jar] [21:00:27] : [Step 3/5] [INFO] ignite-ml [jar] [21:00:27] : [Step 3/5] [INFO] ignite-extdata-p2p [jar] [21:00:27] : [Step 3/5] [INFO] ignite-extdata-uri-dep [jar] [21:00:27] : [Step 3/5] [INFO] ignite-extdata-uri [pom] [21:00:27] : [Step 3/5] [INFO] ignite-extdata-platform [jar] [21:00:27] : [Step 3/5] [INFO] ignite-urideploy [jar] [21:00:27] : [Step 3/5] [INFO] ignite-log4j [jar] [21:00:27] : [Step 3/5] [INFO] ignite-spring [jar] [21:00:27] : [Step 3/5] [INFO] ignite-rest-http [jar] [21:00:27] : [Step 3/5] [INFO] ignite-clients [jar] [21:00:27] : [Step 3/5] [INFO] ignite-web [jar] [21:00:27] : [Step 3/5] [INFO] ignite-aop [jar] [21:00:27] : [Step 3/5] [INFO] ignite-ssh [jar] [21:00:27] : [Step 3/5] [INFO] ignite-jta [jar] [21:00:27] : [Step 3/5] [INFO] ignite-log4j2 [jar] [21:00:27] : [Step 3/5] [INFO] ignite-slf4j [jar] [21:00:27] : [Step 3/5] [INFO] ignite-jcl [jar] [21:00:27] : [Step 3/5] [INFO] ignite-codegen [jar] [21:00:27] : [Step 3/5] [INFO] ignite-cloud [jar] [21:00:27] : [Step 3/5] [INFO] ignite-mesos [jar] [21:00:27] : [Step 3/5] [INFO] ignite-yarn [jar] [21:00:27] : [Step 3/5] [INFO] ignite-zookeeper [jar] [21:00:27] : [Step 3/5] [INFO] ignite-hibernate-core [jar] [21:00:27] : [Step 3/5] [INFO] ignite-osgi-paxlogging [jar] [21:00:27] : [Step 3/5] [INFO] ignite-osgi-karaf [pom] [21:00:27] : [Step 3/5] [INFO] ignite-osgi [jar] [21:00:27] : [Step 3/5] [INFO] ignite-appserver-test [jar] [21:00:27] : [Step 3/5] [INFO] ignite-websphere-test [war] [21:00:27] : [Step 3/5] [INFO] ignite-cassandra [pom] [21:00:27] : [Step 3/5] [INFO] ignite-cassandra-store [jar] [21:00:27] : [Step 3/5] [INFO] ignite-cassandra-serializers [jar] [21:00:27] : [Step 3/5] [INFO] ignite-kubernetes [jar] [21:00:27] : [Step 3/5] [INFO] ignite-sqlline [jar] [21:00:27] : [Step 3/5] [INFO] ignite-ml-spark-model-parser [jar] [21:00:27] : [Step 3/5] [INFO] ignite-ml-xgboost-model-parser [jar] [21:00:27] : [Step 3/5] [INFO] ignite-ml-catboost-model-parser [jar] [21:00:27] : [Step 3/5] [INFO] ignite-ml-h2o-model-parser [jar] [21:00:27] : [Step 3/5] [INFO] ignite-opencensus [jar] [21:00:27] : [Step 3/5] [INFO] ignite-control-utility [jar] [21:00:27] : [Step 3/5] [INFO] ignite-scalar [jar] [21:00:27] : [Step 3/5] [INFO] ignite-spark [jar] [21:00:27] : [Step 3/5] [INFO] ignite-visor-console [jar] [21:00:27] : [Step 3/5] [INFO] ignite-visor-plugins [jar] [21:00:27] : [Step 3/5] [INFO] ignite-spark-2.4 [jar] [21:00:27] : [Step 3/5] [INFO] apache-ignite [pom] [21:00:27] : [Step 3/5] [INFO] [21:00:27] : [Step 3/5] [INFO] ------------------< org.apache.ignite:apache-ignite >------------------- [21:00:27] : [Step 3/5] [INFO] Building apache-ignite 2.13.0-SNAPSHOT [1/52] [21:00:27] : [Step 3/5] [INFO] --------------------------------[ pom ]--------------------------------- [21:00:27] : [Step 3/5] [Maven Watcher] project started: org.apache.ignite:apache-ignite:pom:2.13.0-SNAPSHOT [21:00:27] : [Step 3/5] org.apache.ignite:apache-ignite [21:00:27]i: [org.apache.ignite:apache-ignite] ##teamcity[importData tc:tags='tc:internal' type='surefire' path='/opt/buildagent/work/7bc1c54bc719b67c/target/failsafe-reports/TEST-*.xml' whenNoDataPublished='nothing' logAsInternal='true'] [21:00:27] : [Step 3/5] Importing data from '/opt/buildagent/work/7bc1c54bc719b67c/target/failsafe-reports/TEST-*.xml' (not existing file) with 'surefire' processor [21:00:27]i: [org.apache.ignite:apache-ignite] ##teamcity[importData tc:tags='tc:internal' type='surefire' path='/opt/buildagent/work/7bc1c54bc719b67c/target/surefire-reports/TEST-*.xml' whenNoDataPublished='nothing' logAsInternal='true'] [21:00:27] : [Step 3/5] [Maven Watcher] [21:00:27]i: [Step 3/5] ##teamcity[projectStarted tc:tags='tc:internal' projectId='org.apache.ignite:apache-ignite:pom:2.13.0-SNAPSHOT' groupId='org.apache.ignite' artifactId='apache-ignite' testReportsDir0='/opt/buildagent/work/7bc1c54bc719b67c/target/failsafe-reports' testReportsDir1='/opt/buildagent/work/7bc1c54bc719b67c/target/surefire-reports'] [21:00:27] : [Step 3/5] Importing data from '/opt/buildagent/work/7bc1c54bc719b67c/target/surefire-reports/TEST-*.xml' (not existing file) with 'surefire' processor [21:00:27] : [Step 3/5] [INFO] [21:00:27] : [Step 3/5] [INFO] --- maven-dependency-plugin:2.8:get (default-cli) @ apache-ignite --- [21:00:27] : [Step 3/5] Surefire report watcher [21:00:27] : [Surefire report watcher] Watching paths: [21:00:27] : [Surefire report watcher] /opt/buildagent/work/7bc1c54bc719b67c/target/failsafe-reports/TEST-*.xml [21:00:27] : [Step 3/5] Surefire report watcher [21:00:27] : [Surefire report watcher] Watching paths: [21:00:27] : [Surefire report watcher] /opt/buildagent/work/7bc1c54bc719b67c/target/surefire-reports/TEST-*.xml [21:00:28] : [Step 3/5] [INFO] Resolving javax.transaction:javax.transaction-api:jar:1.3 with transitive dependencies [21:00:28] : [Step 3/5] [Maven Watcher] [21:00:28]i: [Step 3/5] ##teamcity[projectFinished tc:tags='tc:internal' projectId='org.apache.ignite:apache-ignite:pom:2.13.0-SNAPSHOT'] [21:00:28] : [Step 3/5] [INFO] ------------------------------------------------------------------------ [21:00:28] : [Step 3/5] [INFO] Reactor Summary for apache-ignite 2.13.0-SNAPSHOT: [21:00:28] : [Step 3/5] [INFO] [21:00:28] : [Step 3/5] [INFO] ignite-apache-license-gen .......................... SKIPPED [21:00:28] : [Step 3/5] [INFO] ignite-tools ....................................... SKIPPED [21:00:28] : [Step 3/5] [INFO] ignite-core ........................................ SKIPPED [21:00:28] : [Step 3/5] [INFO] ignite-indexing .................................... SKIPPED [21:00:28] : [Step 3/5] [INFO] ignite-compress .................................... SKIPPED [21:00:28] : [Step 3/5] [INFO] ignite-dev-utils ................................... SKIPPED [21:00:28] : [Step 3/5] [INFO] ignite-direct-io ................................... SKIPPED [21:00:28] : [Step 3/5] [INFO] ignite-ml .......................................... SKIPPED [21:00:28] : [Step 3/5] [INFO] ignite-extdata-p2p ................................. SKIPPED [21:00:28] : [Step 3/5] [INFO] ignite-extdata-uri-dep ............................. SKIPPED [21:00:28] : [Step 3/5] [INFO] ignite-extdata-uri ................................. SKIPPED [21:00:28] : [Step 3/5] [INFO] ignite-extdata-platform ............................ SKIPPED [21:00:28] : [Step 3/5] [INFO] ignite-urideploy ................................... SKIPPED [21:00:28] : [Step 3/5] [INFO] ignite-log4j ....................................... SKIPPED [21:00:28] : [Step 3/5] [INFO] ignite-spring ...................................... SKIPPED [21:00:28] : [Step 3/5] [INFO] ignite-rest-http ................................... SKIPPED [21:00:28] : [Step 3/5] [INFO] ignite-clients ..................................... SKIPPED [21:00:28] : [Step 3/5] [INFO] ignite-web ......................................... SKIPPED [21:00:28] : [Step 3/5] [INFO] ignite-aop ......................................... SKIPPED [21:00:28] : [Step 3/5] [INFO] ignite-ssh ......................................... SKIPPED [21:00:28] : [Step 3/5] [INFO] ignite-jta ......................................... SKIPPED [21:00:28] : [Step 3/5] [INFO] ignite-log4j2 ...................................... SKIPPED [21:00:28] : [Step 3/5] [INFO] ignite-slf4j ....................................... SKIPPED [21:00:28] : [Step 3/5] [INFO] ignite-jcl ......................................... SKIPPED [21:00:28] : [Step 3/5] [INFO] ignite-codegen ..................................... SKIPPED [21:00:28] : [Step 3/5] [INFO] ignite-cloud ....................................... SKIPPED [21:00:28] : [Step 3/5] [INFO] ignite-mesos ....................................... SKIPPED [21:00:28] : [Step 3/5] [INFO] ignite-yarn ........................................ SKIPPED [21:00:28] : [Step 3/5] [INFO] ignite-zookeeper ................................... SKIPPED [21:00:28] : [Step 3/5] [INFO] ignite-hibernate-core .............................. SKIPPED [21:00:28] : [Step 3/5] [INFO] ignite-osgi-paxlogging ............................. SKIPPED [21:00:28] : [Step 3/5] [INFO] ignite-osgi-karaf .................................. SKIPPED [21:00:28] : [Step 3/5] [INFO] ignite-osgi ........................................ SKIPPED [21:00:28] : [Step 3/5] [INFO] ignite-appserver-test .............................. SKIPPED [21:00:28] : [Step 3/5] [INFO] ignite-websphere-test .............................. SKIPPED [21:00:28] : [Step 3/5] [INFO] ignite-cassandra ................................... SKIPPED [21:00:28] : [Step 3/5] [INFO] ignite-cassandra-store ............................. SKIPPED [21:00:28] : [Step 3/5] [INFO] ignite-cassandra-serializers ....................... SKIPPED [21:00:28] : [Step 3/5] [INFO] ignite-kubernetes .................................. SKIPPED [21:00:28] : [Step 3/5] [INFO] ignite-sqlline ..................................... SKIPPED [21:00:28] : [Step 3/5] [INFO] ignite-ml-spark-model-parser ....................... SKIPPED [21:00:28] : [Step 3/5] [INFO] ignite-ml-xgboost-model-parser ..................... SKIPPED [21:00:28] : [Step 3/5] [INFO] ignite-ml-catboost-model-parser .................... SKIPPED [21:00:28] : [Step 3/5] [INFO] ignite-ml-h2o-model-parser ......................... SKIPPED [21:00:28] : [Step 3/5] [INFO] ignite-opencensus .................................. SKIPPED [21:00:28] : [Step 3/5] [INFO] ignite-control-utility ............................. SKIPPED [21:00:28] : [Step 3/5] [INFO] ignite-scalar ...................................... SKIPPED [21:00:28] : [Step 3/5] [INFO] ignite-spark ....................................... SKIPPED [21:00:28] : [Step 3/5] [INFO] ignite-visor-console ............................... SKIPPED [21:00:28] : [Step 3/5] [INFO] ignite-visor-plugins ............................... SKIPPED [21:00:28] : [Step 3/5] [INFO] ignite-spark-2.4 ................................... SKIPPED [21:00:28] : [Step 3/5] [INFO] apache-ignite ...................................... SUCCESS [ 0.848 s] [21:00:28] : [Step 3/5] [INFO] ------------------------------------------------------------------------ [21:00:28] : [Step 3/5] [INFO] BUILD SUCCESS [21:00:28] : [Step 3/5] [INFO] ------------------------------------------------------------------------ [21:00:28] : [Step 3/5] [INFO] Total time: 3.230 s [21:00:28] : [Step 3/5] [INFO] Finished at: 2021-11-19T21:00:28+03:00 [21:00:28] : [Step 3/5] [INFO] ------------------------------------------------------------------------ [21:00:28] : [Step 3/5] [Maven Watcher] building report document... [21:00:28] : [Step 3/5] [Maven Watcher] building report document done [21:00:28] : [Step 3/5] [Maven Watcher] writing report to /opt/buildagent/temp/buildTmp/maven-build-info.xml [21:00:28] : [Step 3/5] [Maven Watcher] done writing report [21:00:28] : [Step 3/5] Process exited with code 0 [21:00:28] : [Step 3/5] Publishing artifacts [21:00:28] : [Publishing artifacts] Collecting files to publish: [/opt/buildagent/temp/buildTmp/.tc-maven-bi/maven-build-info.xml.gz => .teamcity] [21:00:28] : [Publishing artifacts] Publishing 1 file using [ArtifactsCachePublisher]: /opt/buildagent/temp/buildTmp/.tc-maven-bi/maven-build-info.xml.gz => .teamcity [21:00:28] : [Publishing artifacts] Publishing 1 file using [WebPublisher]: /opt/buildagent/temp/buildTmp/.tc-maven-bi/maven-build-info.xml.gz => .teamcity [21:00:29] : [Step 3/5] Waiting for 2 service processes to complete [21:00:29]E: Step 4/5: Run test suite (Maven) (running for 1h:12m:05s) [21:00:29] : [Step 4/5] Using predefined Maven user settings: local-proxy.xml [21:00:29] : [Step 4/5] Using predefined Maven user settings: local-proxy.xml [21:00:29] : [Step 4/5] Initial M2_HOME not set [21:00:29] : [Step 4/5] Current M2_HOME = /opt/buildagent/tools/maven3_6 [21:00:29] : [Step 4/5] PATH = /opt/buildagent/tools/maven3_6/bin:/opt/node/bin:/opt/node/bin:/opt/java/openjdk/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin [21:00:29] : [Step 4/5] Using watcher: /opt/buildagent/plugins/mavenPlugin/maven-watcher-jdk16/maven-watcher-agent.jar [21:00:29] : [Step 4/5] *** Start reading the project structure *** [21:00:29]i: [Step 4/5] Initial MAVEN_OPTS not set [21:00:29]i: [Step 4/5] Current MAVEN_OPTS = -ea -server -Xms2g -Xmx2g -XX:+HeapDumpOnOutOfMemoryError -DIGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c -DIGNITE_TEST_HOME=/opt/buildagent/work/7bc1c54bc719b67c -DIGNITE_UPDATE_NOTIFIER=false -DIGNITE_NO_DISCO_ORDER=true -DIGNITE_PERFORMANCE_SUGGESTIONS_DISABLED=true -Djava.net.preferIPv4Stack=true -DTEST_SCALE_FACTOR=1.0 -DIGNITE_TEST_PROP_LOG4J_FILE=log4j-tc-test.xml -DIGNITE_QUIET=false -DIGNITE_MARSHAL_BUFFERS_RECHECK=1000 [21:00:30]i: [Step 4/5] [INFO] Scanning for projects... [21:00:32]i: [Step 4/5] [WARNING] [21:00:32]i: [Step 4/5] [WARNING] Some problems were encountered while building the effective model for org.apache.ignite:ignite-examples:jar:2.13.0-SNAPSHOT [21:00:32]i: [Step 4/5] [WARNING] 'build.plugins.plugin.version' for org.codehaus.mojo:build-helper-maven-plugin is missing. @ org.apache.ignite:ignite-examples:${revision}, /opt/buildagent/work/7bc1c54bc719b67c/examples/pom.xml, line 396, column 21 [21:00:32]i: [Step 4/5] [WARNING] [21:00:32]i: [Step 4/5] [WARNING] Some problems were encountered while building the effective model for org.apache.ignite:ignite-ducktests:jar:2.13.0-SNAPSHOT [21:00:32]i: [Step 4/5] [WARNING] 'build.plugins.plugin.version' for org.codehaus.mojo:build-helper-maven-plugin is missing. @ org.apache.ignite:ignite-ducktests:${revision}, /opt/buildagent/work/7bc1c54bc719b67c/modules/ducktests/pom.xml, line 200, column 21 [21:00:32]i: [Step 4/5] [WARNING] [21:00:32]i: [Step 4/5] [WARNING] Some problems were encountered while building the effective model for org.apache.ignite:apache-ignite:pom:2.13.0-SNAPSHOT [21:00:32]i: [Step 4/5] [WARNING] 'parent.relativePath' of POM org.apache.ignite:ignite-parent:1 (/opt/buildagent/work/7bc1c54bc719b67c/parent/pom.xml) points at org.apache.ignite:apache-ignite instead of org.apache:apache, please verify your project structure @ org.apache.ignite:ignite-parent:1, /opt/buildagent/work/7bc1c54bc719b67c/parent/pom.xml, line 29, column 13 [21:00:32]i: [Step 4/5] [WARNING] [21:00:32]i: [Step 4/5] [WARNING] It is highly recommended to fix these problems because they threaten the stability of your build. [21:00:32]i: [Step 4/5] [WARNING] [21:00:32]i: [Step 4/5] [WARNING] For this reason, future Maven versions might no longer support building such malformed projects. [21:00:32]i: [Step 4/5] [WARNING] [21:00:33]i: [Step 4/5] [INFO] [21:00:33]i: [Step 4/5] [INFO] -------------------< org.apache.ignite:ignite-core >-------------------- [21:00:33]i: [Step 4/5] [INFO] Building ignite-core 2.13.0-SNAPSHOT [21:00:33]i: [Step 4/5] [INFO] --------------------------------[ jar ]--------------------------------- [21:00:33]i: [Step 4/5] [INFO] [21:00:33]i: [Step 4/5] [INFO] --- info-maven3-plugin:1.0.2:info (default-cli) @ ignite-core --- [21:00:33]i: [Step 4/5] [INFO] ------------------------------------------------------------------------ [21:00:33]i: [Step 4/5] [INFO] BUILD SUCCESS [21:00:33]i: [Step 4/5] [INFO] ------------------------------------------------------------------------ [21:00:33]i: [Step 4/5] [INFO] Total time: 2.235 s [21:00:33]i: [Step 4/5] [INFO] Finished at: 2021-11-19T21:00:33+03:00 [21:00:33]i: [Step 4/5] [INFO] ------------------------------------------------------------------------ [21:00:33]i: [Step 4/5] [WARNING] The requested profile "all-java" could not be activated because it does not exist. [21:00:33]i: [Step 4/5] [WARNING] The requested profile "all-scala" could not be activated because it does not exist. [21:00:33]i: [Step 4/5] [WARNING] The requested profile "scala" could not be activated because it does not exist. [21:00:33]i: [Step 4/5] [WARNING] The requested profile "all-other" could not be activated because it does not exist. [21:00:33]i: [Step 4/5] [WARNING] The requested profile "compatibility" could not be activated because it does not exist. [21:00:33]i: [Step 4/5] [WARNING] The requested profile "lgpl" could not be activated because it does not exist. [21:00:33]i: [Step 4/5] [WARNING] The requested profile "yardstick" could not be activated because it does not exist. [21:00:33]i: [Step 4/5] [WARNING] The requested profile "benchmarks" could not be activated because it does not exist. [21:00:33]i: [Step 4/5] [WARNING] The requested profile "examples" could not be activated because it does not exist. [21:00:33]i: [Step 4/5] Process exited with code 0 [21:00:33] : [Step 4/5] Initial MAVEN_OPTS not set [21:00:33] : [Step 4/5] Current MAVEN_OPTS = -ea -server -Xms2g -Xmx2g -XX:+HeapDumpOnOutOfMemoryError -DIGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c -DIGNITE_TEST_HOME=/opt/buildagent/work/7bc1c54bc719b67c -DIGNITE_UPDATE_NOTIFIER=false -DIGNITE_NO_DISCO_ORDER=true -DIGNITE_PERFORMANCE_SUGGESTIONS_DISABLED=true -Djava.net.preferIPv4Stack=true -DTEST_SCALE_FACTOR=1.0 -DIGNITE_TEST_PROP_LOG4J_FILE=log4j-tc-test.xml -DIGNITE_QUIET=false -DIGNITE_MARSHAL_BUFFERS_RECHECK=1000 [21:00:33] : [Step 4/5] Starting: /opt/java/jdk-ora-8/bin/java -DIGNITE_DUMP_THREADS_ON_FAILURE=false -DMono=/usr/bin/mono-sgen -DMono4.0_x64=/usr/lib/mono/4.0 -DMono4.5_x64=/usr/lib/mono/4.5 -DMonoVersion=6.12.0.90 -DSKIP_BUILD=false -Dagent.home.dir=/opt/buildagent -Dagent.name=aitc-lin02_03 -Dagent.ownPort=9090 -Dagent.work.dir=/opt/buildagent/work -Dbuild.number=95 -Dbuild.vcs.number=c6d91d0fa04338c406d0857a9a1008a36ea8a030 -Dbuild.vcs.number.1=c6d91d0fa04338c406d0857a9a1008a36ea8a030 -Dbuild.vcs.number.GitHubApacheIgnite=c6d91d0fa04338c406d0857a9a1008a36ea8a030 -Dclassworlds.conf=/opt/buildagent/temp/buildTmp/teamcity.m2.conf -Dcom.jetbrains.maven.watcher.report.file=/opt/buildagent/temp/buildTmp/maven-build-info.xml -Djava.io.tmpdir=/opt/buildagent/temp/buildTmp -Dmaven.home=/opt/buildagent/tools/maven3_6 -Dmaven.multiModuleProjectDirectory=/opt/buildagent/work/7bc1c54bc719b67c -Dteamcity.agent.cpuBenchmark=457 -Dteamcity.agent.dotnet.agent_url=http://localhost:9090/RPC2 -Dteamcity.agent.dotnet.build_id=6278078 -Dteamcity.auth.password=******* -Dteamcity.auth.userId=TeamCityBuildId=6278078 -Dteamcity.build.changedFiles.file=/opt/buildagent/temp/buildTmp/changedFiles6342607772318147725.txt -Dteamcity.build.checkoutDir=/opt/buildagent/work/7bc1c54bc719b67c -Dteamcity.build.id=6278078 -Dteamcity.build.properties.file=/opt/buildagent/temp/buildTmp/teamcity.build5164517880467851002.properties -Dteamcity.build.tempDir=/opt/buildagent/temp/buildTmp -Dteamcity.build.workingDir=/opt/buildagent/work/7bc1c54bc719b67c "-Dteamcity.buildConfName=Basic 3" -Dteamcity.buildType.id=IgniteTests24Java8_Basic3 -Dteamcity.configuration.properties.file=/opt/buildagent/temp/buildTmp/teamcity.config5591980786735343870.properties -Dteamcity.maven.userSettings.path=/opt/buildagent/temp/buildTmp/maven_settings_585072866407032347.xml -Dteamcity.maven.watcher.home=/opt/buildagent/plugins/mavenPlugin/maven-watcher-jdk16 "-Dteamcity.projectName=Ignite Tests 2.x (JDK 8/11)" -Dteamcity.runner.properties.file=/opt/buildagent/temp/buildTmp/teamcity.runner9098465561618137420.properties -Dteamcity.tests.recentlyFailedTests.file=/opt/buildagent/temp/buildTmp/testsToRunFirst3891775683130404069.txt "-Dteamcity.version=2021.2 (build 99542)" -ea -server -Xms2g -Xmx2g -XX:+HeapDumpOnOutOfMemoryError -DIGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c -DIGNITE_TEST_HOME=/opt/buildagent/work/7bc1c54bc719b67c -DIGNITE_UPDATE_NOTIFIER=false -DIGNITE_NO_DISCO_ORDER=true -DIGNITE_PERFORMANCE_SUGGESTIONS_DISABLED=true -Djava.net.preferIPv4Stack=true -DTEST_SCALE_FACTOR=1.0 -DIGNITE_TEST_PROP_LOG4J_FILE=log4j-tc-test.xml -DIGNITE_QUIET=false -DIGNITE_MARSHAL_BUFFERS_RECHECK=1000 -Dmaven.repo.local=/opt/buildagent/.m2/repository -classpath /opt/buildagent/tools/maven3_6/boot/plexus-classworlds-2.6.0.jar: org.codehaus.plexus.classworlds.launcher.Launcher -f /opt/buildagent/work/7bc1c54bc719b67c/pom.xml -B -s /opt/buildagent/temp/buildTmp/maven_settings_585072866407032347.xml -P all-java,all-scala,scala,all-other,compatibility,lgpl,yardstick,benchmarks,examples -pl :ignite-core -Dmaven.test.failure.ignore=true -DfailIfNoTests=false -Dtest=IgniteBasicWithPersistenceTestSuite -Dmaven.javadoc.skip=true surefire:test [21:00:33] : [Step 4/5] in directory: /opt/buildagent/work/7bc1c54bc719b67c [21:00:34] : [Step 4/5] [INFO] Scanning for projects... [21:00:37]W: [Step 4/5] [WARNING] [21:00:37]W: [Step 4/5] [WARNING] Some problems were encountered while building the effective model for org.apache.ignite:ignite-examples:jar:2.13.0-SNAPSHOT [21:00:37]W: [Step 4/5] [WARNING] 'build.plugins.plugin.version' for org.codehaus.mojo:build-helper-maven-plugin is missing. @ org.apache.ignite:ignite-examples:${revision}, /opt/buildagent/work/7bc1c54bc719b67c/examples/pom.xml, line 396, column 21 [21:00:37]W: [Step 4/5] [WARNING] [21:00:37]W: [Step 4/5] [WARNING] Some problems were encountered while building the effective model for org.apache.ignite:ignite-ducktests:jar:2.13.0-SNAPSHOT [21:00:37]W: [Step 4/5] [WARNING] 'build.plugins.plugin.version' for org.codehaus.mojo:build-helper-maven-plugin is missing. @ org.apache.ignite:ignite-ducktests:${revision}, /opt/buildagent/work/7bc1c54bc719b67c/modules/ducktests/pom.xml, line 200, column 21 [21:00:37]W: [Step 4/5] [WARNING] [21:00:37]W: [Step 4/5] [WARNING] Some problems were encountered while building the effective model for org.apache.ignite:apache-ignite:pom:2.13.0-SNAPSHOT [21:00:37]W: [Step 4/5] [WARNING] 'parent.relativePath' of POM org.apache.ignite:ignite-parent:1 (/opt/buildagent/work/7bc1c54bc719b67c/parent/pom.xml) points at org.apache.ignite:apache-ignite instead of org.apache:apache, please verify your project structure @ org.apache.ignite:ignite-parent:1, /opt/buildagent/work/7bc1c54bc719b67c/parent/pom.xml, line 29, column 13 [21:00:37]W: [Step 4/5] [WARNING] [21:00:37]W: [Step 4/5] [WARNING] It is highly recommended to fix these problems because they threaten the stability of your build. [21:00:37]W: [Step 4/5] [WARNING] [21:00:37]W: [Step 4/5] [WARNING] For this reason, future Maven versions might no longer support building such malformed projects. [21:00:37]W: [Step 4/5] [WARNING] [21:00:37] : [Step 4/5] [INFO] [21:00:37] : [Step 4/5] [INFO] -------------------< org.apache.ignite:ignite-core >-------------------- [21:00:37] : [Step 4/5] [INFO] Building ignite-core 2.13.0-SNAPSHOT [21:00:37] : [Step 4/5] [INFO] --------------------------------[ jar ]--------------------------------- [21:00:37] : [Step 4/5] [Maven Watcher] project started: org.apache.ignite:ignite-core:jar:2.13.0-SNAPSHOT [21:00:37]W: [Step 4/5] org.apache.ignite:ignite-core (running for 1h:11m:56s) [21:00:37]i: [org.apache.ignite:ignite-core] ##teamcity[importData tc:tags='tc:internal' type='surefire' path='/opt/buildagent/work/7bc1c54bc719b67c/modules/core/target/surefire-reports/TEST-*.xml' whenNoDataPublished='nothing' logAsInternal='true'] [21:00:37] : [Step 4/5] Importing data from '/opt/buildagent/work/7bc1c54bc719b67c/modules/core/target/surefire-reports/TEST-*.xml' (not existing file) with 'surefire' processor [21:00:37]i: [org.apache.ignite:ignite-core] ##teamcity[importData tc:tags='tc:internal' type='surefire' path='/opt/buildagent/work/7bc1c54bc719b67c/modules/core/target/failsafe-reports/TEST-*.xml' whenNoDataPublished='nothing' logAsInternal='true'] [21:00:37] : [Step 4/5] [Maven Watcher] [21:00:37]i: [Step 4/5] ##teamcity[projectStarted tc:tags='tc:internal' projectId='org.apache.ignite:ignite-core:jar:2.13.0-SNAPSHOT' groupId='org.apache.ignite' artifactId='ignite-core' testReportsDir0='/opt/buildagent/work/7bc1c54bc719b67c/modules/core/target/surefire-reports' testReportsDir1='/opt/buildagent/work/7bc1c54bc719b67c/modules/core/target/failsafe-reports'] [21:00:37] : [Step 4/5] Importing data from '/opt/buildagent/work/7bc1c54bc719b67c/modules/core/target/failsafe-reports/TEST-*.xml' (not existing file) with 'surefire' processor [21:00:37] : [Step 4/5] Surefire report watcher [21:00:37] : [Surefire report watcher] Watching paths: [21:00:37] : [Surefire report watcher] /opt/buildagent/work/7bc1c54bc719b67c/modules/core/target/surefire-reports/TEST-*.xml [21:00:37] : [Step 4/5] Surefire report watcher [21:00:37] : [Surefire report watcher] Watching paths: [21:00:37] : [Surefire report watcher] /opt/buildagent/work/7bc1c54bc719b67c/modules/core/target/failsafe-reports/TEST-*.xml [21:00:37] : [Step 4/5] [INFO] [21:00:37] : [Step 4/5] [INFO] --- maven-surefire-plugin:3.0.0-M4:test (default-cli) @ ignite-core --- [21:00:38]W: [Step 4/5] [WARNING] useSystemClassloader setting has no effect when not forking [21:00:39] : [Step 4/5] [INFO] Running org.apache.ignite.testsuites.IgniteBasicWithPersistenceTestSuite [21:00:40] : [Step 4/5] Configured log4j from: /opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/config/log4j-tc-test.xml [21:00:40] : [Step 4/5] [21:00:40] >>> Starting test class: IoomFailureHandlerTest <<< [21:00:40] : [Step 4/5] Running org.apache.ignite.failure.IoomFailureHandlerTest [21:00:40] : [Step 4/5] [21:00:40] >>> Starting test: IoomFailureHandlerTest#testIoomErrorMvccNoStoreHandling <<< [21:00:40] : [Step 4/5] [21:00:40] >>> Heap: 172 MB used / 1963 MB commited / 1963 MB max <<< [21:00:40] : [Step 4/5] [21:00:40] >>> Non-Heap: 51 MB used / 52 MB commited / 0 MB max <<< [21:00:41]W: [org.apache.ignite:ignite-core] [2021-11-19 21:00:41,060][WARN ][test-runner-#1%failure.IoomFailureHandlerTest%][G] Ignite work directory is not provided, automatically resolved to: /opt/buildagent/work/7bc1c54bc719b67c/work [21:00:41] : [Step 4/5] [2021-11-19 21:00:41,112][INFO ][test-runner-#1%failure.IoomFailureHandlerTest%][IoomFailureHandlerTest0] [21:00:41] : [Step 4/5] [21:00:41] : [Step 4/5] >>> __________ ________________ [21:00:41] : [Step 4/5] >>> / _/ ___/ |/ / _/_ __/ __/ [21:00:41] : [Step 4/5] >>> _/ // (7 7 // / / / / _/ [21:00:41] : [Step 4/5] >>> /___/\___/_/|_/___/ /_/ /___/ [21:00:41] : [Step 4/5] >>> [21:00:41] : [Step 4/5] >>> ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:00:41] : [Step 4/5] >>> 2021 Copyright(C) Apache Software Foundation [21:00:41] : [Step 4/5] >>> [21:00:41] : [Step 4/5] >>> Ignite documentation: http://ignite.apache.org [21:00:41] : [Step 4/5] [21:00:41] : [Step 4/5] [2021-11-19 21:00:41,113][INFO ][test-runner-#1%failure.IoomFailureHandlerTest%][IoomFailureHandlerTest0] Config URL: n/a [21:00:41] : [Step 4/5] [2021-11-19 21:00:41,150][INFO ][test-runner-#1%failure.IoomFailureHandlerTest%][IoomFailureHandlerTest0] IgniteConfiguration [igniteInstanceName=failure.IoomFailureHandlerTest0, pubPoolSize=24, svcPoolSize=24, callbackPoolSize=24, stripedPoolSize=24, sysPoolSize=24, mgmtPoolSize=4, dataStreamerPoolSize=24, utilityCachePoolSize=24, utilityCacheKeepAliveTime=60000, p2pPoolSize=2, qryPoolSize=24, buildIdxPoolSize=4, igniteHome=/opt/buildagent/work/7bc1c54bc719b67c, igniteWorkDir=/opt/buildagent/work/7bc1c54bc719b67c/work, mbeanSrv=com.sun.jmx.mbeanserver.JmxMBeanServer@6fe85038, nodeId=b0b77bfd-fcbd-47c8-9b37-1d00f0a00000, marsh=BinaryMarshaller [], marshLocJobs=false, daemon=false, p2pEnabled=true, netTimeout=10000, netCompressionLevel=1, sndRetryDelay=1000, sndRetryCnt=3, metricsHistSize=10000, metricsUpdateFreq=1000, metricsExpTime=9223372036854775807, discoSpi=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=0, ackTimeout=0, marsh=null, reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], segPlc=STOP, segResolveAttempts=2, waitForSegOnStart=true, allResolversPassReq=true, segChkFreq=10000, commSpi=TcpCommunicationSpi [connectGate=org.apache.ignite.spi.communication.tcp.internal.ConnectGateway@330752e4, ctxInitLatch=java.util.concurrent.CountDownLatch@5b659833[Count = 1], stopping=false, clientPool=null, nioSrvWrapper=null, stateProvider=null], evtSpi=MemoryEventStorageSpi [expireAgeMs=9223372036854775807, expireCnt=10000, filter=null], colSpi=NoopCollisionSpi [], deploySpi=LocalDeploymentSpi [], indexingSpi=org.apache.ignite.spi.indexing.noop.NoopIndexingSpi@1ef10976, addrRslvr=null, encryptionSpi=org.apache.ignite.spi.encryption.noop.NoopEncryptionSpi@13ffa97f, tracingSpi=org.apache.ignite.spi.tracing.NoopTracingSpi@5960d25b, clientMode=false, rebalanceThreadPoolSize=4, rebalanceTimeout=10000, rebalanceBatchesPrefetchCnt=3, rebalanceThrottle=0, rebalanceBatchSize=524288, txCfg=TransactionConfiguration [txSerEnabled=false, dfltIsolation=REPEATABLE_READ, dfltConcurrency=PESSIMISTIC, dfltTxTimeout=0, txTimeoutOnPartitionMapExchange=0, deadlockTimeout=10000, pessimisticTxLogSize=0, pessimisticTxLogLinger=10000, tmLookupClsName=null, txManagerFactory=null, useJtaSync=false], cacheSanityCheckEnabled=true, discoStartupDelay=60000, deployMode=SHARED, p2pMissedCacheSize=100, locHost=127.0.0.1, timeSrvPortBase=31100, timeSrvPortRange=100, failureDetectionTimeout=10000, sysWorkerBlockedTimeout=null, clientFailureDetectionTimeout=10000, metricsLogFreq=0, connectorCfg=null, odbcCfg=null, warmupClos=null, atomicCfg=AtomicConfiguration [seqReserveSize=1000, cacheMode=PARTITIONED, backups=1, aff=null, grpName=null], classLdr=null, sslCtxFactory=null, platformCfg=null, binaryCfg=null, memCfg=null, pstCfg=null, dsCfg=DataStorageConfiguration [sysRegionInitSize=41943040, sysRegionMaxSize=104857600, pageSize=2048, concLvl=0, dfltDataRegConf=DataRegionConfiguration [name=dfltPlc, maxSize=10485760, initSize=10485760, swapPath=null, pageEvictionMode=DISABLED, pageReplacementMode=CLOCK, evictionThreshold=0.9, emptyPagesPoolSize=100, metricsEnabled=false, metricsSubIntervalCount=5, metricsRateTimeInterval=60000, persistenceEnabled=false, checkpointPageBufSize=0, lazyMemoryAllocation=true, warmUpCfg=null], dataRegions=null, storagePath=null, checkpointFreq=180000, lockWaitTime=10000, checkpointThreads=4, checkpointWriteOrder=SEQUENTIAL, walHistSize=20, maxWalArchiveSize=1073741824, walSegments=10, walSegmentSize=67108864, walPath=db/wal, walArchivePath=db/wal/archive, cdcWalPath=db/wal/cdc, cdcEnabled=false, metricsEnabled=false, walMode=LOG_ONLY, walTlbSize=131072, walBuffSize=0, walFlushFreq=2000, walFsyncDelay=1000, walRecordIterBuffSize=67108864, alwaysWriteFullPages=false, fileIOFactory=org.apache.ignite.internal.processors.cache.persistence.file.AsyncFileIOFactory@641b9711, metricsSubIntervalCnt=5, metricsRateTimeInterval=60000, walAutoArchiveAfterInactivity=-1, walForceArchiveTimeout=-1, writeThrottlingEnabled=false, walCompactionEnabled=false, walCompactionLevel=1, checkpointReadLockTimeout=null, walPageCompression=DISABLED, walPageCompressionLevel=null, dfltWarmUpCfg=null, encCfg=org.apache.ignite.configuration.EncryptionConfiguration@2790a1a2, defragmentationThreadPoolSize=4, minWalArchiveSize=-1], snapshotPath=snapshots, activeOnStart=true, activeOnStartPropSetFlag=false, autoActivation=true, autoActivationPropSetFlag=false, clusterStateOnStart=null, sqlConnCfg=null, cliConnCfg=ClientConnectorConfiguration [host=null, port=10800, portRange=100, sockSndBufSize=0, sockRcvBufSize=0, tcpNoDelay=true, maxOpenCursorsPerConn=128, threadPoolSize=24, selectorCnt=12, idleTimeout=0, handshakeTimeout=10000, jdbcEnabled=true, odbcEnabled=true, thinCliEnabled=true, sslEnabled=false, useIgniteSslCtxFactory=true, sslClientAuth=false, sslCtxFactory=null, thinCliCfg=ThinClientConfiguration [maxActiveTxPerConn=100, maxActiveComputeTasksPerConn=0]], mvccVacuumThreadCnt=2, mvccVacuumFreq=5000, authEnabled=false, failureHnd=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]], commFailureRslvr=null, sqlCfg=SqlConfiguration [longQryWarnTimeout=3000, dfltQryTimeout=0, sqlQryHistSize=1000, validationEnabled=false], asyncContinuationExecutor=null] [21:00:41] : [Step 4/5] [2021-11-19 21:00:41,171][INFO ][test-runner-#1%failure.IoomFailureHandlerTest%][IoomFailureHandlerTest0] Daemon mode: off [21:00:41] : [Step 4/5] [2021-11-19 21:00:41,172][INFO ][test-runner-#1%failure.IoomFailureHandlerTest%][IoomFailureHandlerTest0] OS: Linux 4.15.0-151-generic amd64 [21:00:41] : [Step 4/5] [2021-11-19 21:00:41,173][INFO ][test-runner-#1%failure.IoomFailureHandlerTest%][IoomFailureHandlerTest0] OS user: teamcity [21:00:41] : [Step 4/5] [2021-11-19 21:00:41,175][INFO ][test-runner-#1%failure.IoomFailureHandlerTest%][IoomFailureHandlerTest0] PID: 16724 [21:00:41] : [Step 4/5] [2021-11-19 21:00:41,176][INFO ][test-runner-#1%failure.IoomFailureHandlerTest%][IoomFailureHandlerTest0] Language runtime: Java Platform API Specification ver. 1.8 [21:00:41] : [Step 4/5] [2021-11-19 21:00:41,176][INFO ][test-runner-#1%failure.IoomFailureHandlerTest%][IoomFailureHandlerTest0] VM information: Java(TM) SE Runtime Environment 1.8.0_261-b12 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 25.261-b12 [21:00:41] : [Step 4/5] [2021-11-19 21:00:41,177][INFO ][test-runner-#1%failure.IoomFailureHandlerTest%][IoomFailureHandlerTest0] VM total memory: 1.9GB [21:00:41] : [Step 4/5] [2021-11-19 21:00:41,178][INFO ][test-runner-#1%failure.IoomFailureHandlerTest%][IoomFailureHandlerTest0] Remote Management [restart: off, REST: off, JMX (remote: off)] [21:00:41] : [Step 4/5] [2021-11-19 21:00:41,179][INFO ][test-runner-#1%failure.IoomFailureHandlerTest%][IoomFailureHandlerTest0] Logger: GridTestLog4jLogger [quiet=false, config=null] [21:00:41] : [Step 4/5] [2021-11-19 21:00:41,180][INFO ][test-runner-#1%failure.IoomFailureHandlerTest%][IoomFailureHandlerTest0] IGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c [21:00:41] : [Step 4/5] [2021-11-19 21:00:41,181][INFO ][test-runner-#1%failure.IoomFailureHandlerTest%][IoomFailureHandlerTest0] VM arguments: [-DIGNITE_DUMP_THREADS_ON_FAILURE=false, -DMono=/usr/bin/mono-sgen, -DMono4.0_x64=/usr/lib/mono/4.0, -DMono4.5_x64=/usr/lib/mono/4.5, -DMonoVersion=6.12.0.90, -DSKIP_BUILD=false, -Dagent.home.dir=/opt/buildagent, -Dagent.name=aitc-lin02_03, -Dagent.ownPort=9090, -Dagent.work.dir=/opt/buildagent/work, -Dbuild.number=95, -Dbuild.vcs.number=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.1=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.GitHubApacheIgnite=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dclassworlds.conf=/opt/buildagent/temp/buildTmp/teamcity.m2.conf, -Dcom.jetbrains.maven.watcher.report.file=/opt/buildagent/temp/buildTmp/maven-build-info.xml, -Djava.io.tmpdir=/opt/buildagent/temp/buildTmp, -Dmaven.home=/opt/buildagent/tools/maven3_6, -Dmaven.multiModuleProjectDirectory=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.agent.cpuBenchmark=457, -Dteamcity.agent.dotnet.agent_url=http://localhost:9090/RPC2, -Dteamcity.agent.dotnet.build_id=6278078, -Dteamcity.auth.password=*******, -Dteamcity.auth.userId=TeamCityBuildId=6278078, -Dteamcity.build.changedFiles.file=/opt/buildagent/temp/buildTmp/changedFiles6342607772318147725.txt, -Dteamcity.build.checkoutDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.build.id=6278078, -Dteamcity.build.properties.file=/opt/buildagent/temp/buildTmp/teamcity.build5164517880467851002.properties, -Dteamcity.build.tempDir=/opt/buildagent/temp/buildTmp, -Dteamcity.build.workingDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.buildConfName=Basic 3, -Dteamcity.buildType.id=IgniteTests24Java8_Basic3, -Dteamcity.configuration.properties.file=/opt/buildagent/temp/buildTmp/teamcity.config5591980786735343870.properties, -Dteamcity.maven.userSettings.path=/opt/buildagent/temp/buildTmp/maven_settings_585072866407032347.xml, -Dteamcity.maven.watcher.home=/opt/buildagent/plugins/mavenPlugin/maven-watcher-jdk16, -Dteamcity.projectName=Ignite Tests 2.x (JDK 8/11), -Dteamcity.runner.properties.file=/opt/buildagent/temp/buildTmp/teamcity.runner9098465561618137420.properties, -Dteamcity.tests.recentlyFailedTests.file=/opt/buildagent/temp/buildTmp/testsToRunFirst3891775683130404069.txt, -Dteamcity.version=2021.2 (build 99542), -ea, -Xms2g, -Xmx2g, -XX:+HeapDumpOnOutOfMemoryError, -DIGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_TEST_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_UPDATE_NOTIFIER=false, -DIGNITE_NO_DISCO_ORDER=true, -DIGNITE_PERFORMANCE_SUGGESTIONS_DISABLED=true, -Djava.net.preferIPv4Stack=true, -DTEST_SCALE_FACTOR=1.0, -DIGNITE_TEST_PROP_LOG4J_FILE=log4j-tc-test.xml, -DIGNITE_QUIET=false, -DIGNITE_MARSHAL_BUFFERS_RECHECK=1000, -Dmaven.repo.local=/opt/buildagent/.m2/repository] [21:00:41] : [Step 4/5] [2021-11-19 21:00:41,187][INFO ][test-runner-#1%failure.IoomFailureHandlerTest%][IoomFailureHandlerTest0] System cache's DataRegion size is configured to 40 MB. Use DataStorageConfiguration.systemRegionInitialSize property to change the setting. [21:00:41]W: [org.apache.ignite:ignite-core] [2021-11-19 21:00:41,188][WARN ][test-runner-#1%failure.IoomFailureHandlerTest%][IoomFailureHandlerTest0] Peer class loading is enabled (disable it in production for performance and deployment consistency reasons) [21:00:41] : [Step 4/5] [2021-11-19 21:00:41,187][INFO ][test-runner-#1%failure.IoomFailureHandlerTest%][IoomFailureHandlerTest0] Configured caches [in 'sysMemPlc' dataRegion: ['ignite-sys-cache'], in 'dfltPlc' dataRegion: ['default']] [21:00:41] : [Step 4/5] [2021-11-19 21:00:41,188][INFO ][test-runner-#1%failure.IoomFailureHandlerTest%][IoomFailureHandlerTest0] 3-rd party licenses can be found at: /opt/buildagent/work/7bc1c54bc719b67c/libs/licenses [21:00:41] : [Step 4/5] [2021-11-19 21:00:41,218][INFO ][test-runner-#1%failure.IoomFailureHandlerTest%][IgnitePluginProcessor] Configured plugins: [21:00:41] : [Step 4/5] [2021-11-19 21:00:41,218][INFO ][test-runner-#1%failure.IoomFailureHandlerTest%][IgnitePluginProcessor] ^-- StanByClusterTestProvider 1.0 [21:00:41] : [Step 4/5] [2021-11-19 21:00:41,218][INFO ][test-runner-#1%failure.IoomFailureHandlerTest%][IgnitePluginProcessor] ^-- null [21:00:41] : [Step 4/5] [2021-11-19 21:00:41,219][INFO ][test-runner-#1%failure.IoomFailureHandlerTest%][IgnitePluginProcessor] [21:00:41] : [Step 4/5] [2021-11-19 21:00:41,219][INFO ][test-runner-#1%failure.IoomFailureHandlerTest%][IgnitePluginProcessor] ^-- PageMemory tracker plugin 1.0 [21:00:41] : [Step 4/5] [2021-11-19 21:00:41,219][INFO ][test-runner-#1%failure.IoomFailureHandlerTest%][IgnitePluginProcessor] ^-- null [21:00:41] : [Step 4/5] [2021-11-19 21:00:41,219][INFO ][test-runner-#1%failure.IoomFailureHandlerTest%][IgnitePluginProcessor] [21:00:41] : [Step 4/5] [2021-11-19 21:00:41,220][INFO ][test-runner-#1%failure.IoomFailureHandlerTest%][IgnitePluginProcessor] ^-- TestDistibutedConfigurationPlugin 1.0 [21:00:41] : [Step 4/5] [2021-11-19 21:00:41,220][INFO ][test-runner-#1%failure.IoomFailureHandlerTest%][IgnitePluginProcessor] ^-- null [21:00:41] : [Step 4/5] [2021-11-19 21:00:41,220][INFO ][test-runner-#1%failure.IoomFailureHandlerTest%][IgnitePluginProcessor] [21:00:41] : [Step 4/5] [2021-11-19 21:00:41,221][INFO ][test-runner-#1%failure.IoomFailureHandlerTest%][IgnitePluginProcessor] ^-- NodeValidationPluginProvider 1.0 [21:00:41] : [Step 4/5] [2021-11-19 21:00:41,221][INFO ][test-runner-#1%failure.IoomFailureHandlerTest%][IgnitePluginProcessor] ^-- null [21:00:41] : [Step 4/5] [2021-11-19 21:00:41,221][INFO ][test-runner-#1%failure.IoomFailureHandlerTest%][IgnitePluginProcessor] [21:00:41] : [Step 4/5] [2021-11-19 21:00:41,222][INFO ][test-runner-#1%failure.IoomFailureHandlerTest%][FailureProcessor] Configured failure handler: [hnd=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]] [21:00:41]W: [org.apache.ignite:ignite-core] [2021-11-19 21:00:41,499][WARN ][test-runner-#1%failure.IoomFailureHandlerTest%][TcpCommunicationSpi] Message queue limit is set to 0 which may lead to potential OOMEs when running cache operations in FULL_ASYNC or PRIMARY_SYNC modes due to message queues growth on sender and receiver sides. [21:00:41] : [Step 4/5] [2021-11-19 21:00:41,498][INFO ][test-runner-#1%failure.IoomFailureHandlerTest%][TcpCommunicationSpi] Successfully bound communication NIO server to TCP port [port=45010, locHost=/127.0.0.1, selectorsCnt=12, selectorSpins=0, pairedConn=false] [21:00:41] : [Step 4/5] [2021-11-19 21:00:41,544][INFO ][test-runner-#1%failure.IoomFailureHandlerTest%][GridCollisionManager] Collision resolution is disabled (all jobs will be activated upon arrival). [21:00:41] : [Step 4/5] [2021-11-19 21:00:41,545][INFO ][test-runner-#1%failure.IoomFailureHandlerTest%][IoomFailureHandlerTest0] Security status [authentication=off, sandbox=off, tls/ssl=off] [21:00:41] : [Step 4/5] [2021-11-19 21:00:41,865][INFO ][test-runner-#1%failure.IoomFailureHandlerTest%][TestTcpDiscoverySpi] Successfully bound to TCP port [port=47500, localHost=localhost/127.0.0.1, locNodeId=b0b77bfd-fcbd-47c8-9b37-1d00f0a00000] [21:00:41] : [Step 4/5] [2021-11-19 21:00:41,946][INFO ][test-runner-#1%failure.IoomFailureHandlerTest%][IgniteCacheDatabaseSharedManager] Configured data regions initialized successfully [total=4] [21:00:42] : [Step 4/5] [2021-11-19 21:00:42,122][INFO ][test-runner-#1%failure.IoomFailureHandlerTest%][ClientListenerProcessor] Client connector processor has started on TCP port 10800 [21:00:42] : [Step 4/5] [2021-11-19 21:00:42,241][INFO ][test-runner-#1%failure.IoomFailureHandlerTest%][IoomFailureHandlerTest0] Non-loopback local IPs: 172.17.0.4 [21:00:42] : [Step 4/5] [2021-11-19 21:00:42,242][INFO ][test-runner-#1%failure.IoomFailureHandlerTest%][IoomFailureHandlerTest0] Enabled local MACs: 0242AC110004 [21:00:42] : [Step 4/5] [2021-11-19 21:00:42,253][INFO ][test-runner-#1%failure.IoomFailureHandlerTest%][ClusterProcessor] Cluster ID and tag has been read from metastorage: null [21:00:42] : [Step 4/5] [2021-11-19 21:00:42,266][INFO ][test-runner-#1%failure.IoomFailureHandlerTest%][IgniteClusterImpl] Shutdown policy was updated [oldVal=null, newVal=null] [21:00:42] : [Step 4/5] [2021-11-19 21:00:42,387][INFO ][disco-notifier-worker-#85%failure.IoomFailureHandlerTest0%][GridClusterStateProcessor] Received activate cluster request with BaselineTopology[id=0] initiator node ID: b0b77bfd-fcbd-47c8-9b37-1d00f0a00000 [21:00:42] : [Step 4/5] [2021-11-19 21:00:42,393][INFO ][disco-notifier-worker-#85%failure.IoomFailureHandlerTest0%][GridClusterStateProcessor] Started state transition: activate cluster [21:00:42] : [Step 4/5] [2021-11-19 21:00:42,395][INFO ][disco-notifier-worker-#85%failure.IoomFailureHandlerTest0%][GridClusterStateProcessor] Received state change finish message: ACTIVE [21:00:42] : [Step 4/5] [2021-11-19 21:00:42,395][INFO ][disco-notifier-worker-#85%failure.IoomFailureHandlerTest0%][GridClusterStateProcessor] Cluster state was changed from ACTIVE to ACTIVE [21:00:42] : [Step 4/5] [2021-11-19 21:00:42,399][INFO ][disco-notifier-worker-#85%failure.IoomFailureHandlerTest0%][MvccProcessorImpl] Assigned mvcc coordinator [crd=MvccCoordinator [topVer=AffinityTopologyVersion [topVer=1, minorTopVer=0], nodeId=b0b77bfd-fcbd-47c8-9b37-1d00f0a00000, ver=1637344842370, local=true, initialized=false]] [21:00:42] : [Step 4/5] [2021-11-19 21:00:42,441][INFO ][sys-#90%failure.IoomFailureHandlerTest0%][ClusterProcessor] Writing cluster ID and tag to metastorage on ready for write ClusterIdAndTag [id=9b83d72a-2eb8-4f72-a18a-5f8735f817d6, tag=magical_wright] [21:00:42] : [Step 4/5] [2021-11-19 21:00:42,474][INFO ][disco-notifier-worker-#85%failure.IoomFailureHandlerTest0%][ClusterProcessor] magical_wright [21:00:42] : [Step 4/5] [2021-11-19 21:00:42,478][INFO ][disco-notifier-worker-#85%failure.IoomFailureHandlerTest0%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustEnabled' was changed from 'null' to 'true' [21:00:42] : [Step 4/5] [2021-11-19 21:00:42,481][INFO ][disco-notifier-worker-#85%failure.IoomFailureHandlerTest0%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustTimeout' was changed from 'null' to '0' [21:00:42] : [Step 4/5] [2021-11-19 21:00:42,483][INFO ][disco-notifier-worker-#85%failure.IoomFailureHandlerTest0%][IgniteTxManager] Transactions parameter 'longOperationsDumpTimeout' was changed from 'null' to '60000' [21:00:42] : [Step 4/5] [2021-11-19 21:00:42,486][INFO ][disco-notifier-worker-#85%failure.IoomFailureHandlerTest0%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpThreshold' was changed from 'null' to '0' [21:00:42] : [Step 4/5] [2021-11-19 21:00:42,488][INFO ][disco-notifier-worker-#85%failure.IoomFailureHandlerTest0%][IgniteTxManager] Transactions parameter 'transactionTimeDumpSamplesCoefficient' was changed from 'null' to '0.0' [21:00:42] : [Step 4/5] [2021-11-19 21:00:42,490][INFO ][disco-notifier-worker-#85%failure.IoomFailureHandlerTest0%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpSamplesPerSecondLimit' was changed from 'null' to '5' [21:00:42] : [Step 4/5] [2021-11-19 21:00:42,492][INFO ][disco-notifier-worker-#85%failure.IoomFailureHandlerTest0%][IgniteTxManager] Transactions parameter 'collisionsDumpInterval' was changed from 'null' to '1000' [21:00:42] : [Step 4/5] [2021-11-19 21:00:42,495][INFO ][disco-notifier-worker-#85%failure.IoomFailureHandlerTest0%][IgniteTxManager] Transactions parameter 'txOwnerDumpRequestsAllowed' was changed from 'null' to 'true' [21:00:42] : [Step 4/5] [2021-11-19 21:00:42,608][INFO ][exchange-worker-#91%failure.IoomFailureHandlerTest0%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=1, minorTopVer=0], crd=true, evt=NODE_JOINED, evtNode=b0b77bfd-fcbd-47c8-9b37-1d00f0a00000, customEvt=null, allowMerge=false, exchangeFreeSwitch=false] [21:00:42] : [Step 4/5] [2021-11-19 21:00:42,640][INFO ][exchange-worker-#91%failure.IoomFailureHandlerTest0%][IgniteCacheDatabaseSharedManager] Data Regions Started: 4 [21:00:42] : [Step 4/5] [2021-11-19 21:00:42,641][INFO ][exchange-worker-#91%failure.IoomFailureHandlerTest0%][IgniteCacheDatabaseSharedManager] ^-- sysMemPlc region [type=internal, persistence=false, lazyAlloc=false, [21:00:42] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=40MB] [21:00:42] : [Step 4/5] ^-- TxLog region [type=internal, persistence=false, lazyAlloc=false, [21:00:42] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=40MB] [21:00:42] : [Step 4/5] ^-- dfltPlc region [type=default, persistence=false, lazyAlloc=true, [21:00:42] : [Step 4/5] ... initCfg=10MB, maxCfg=10MB, usedRam=0MB, freeRam=100%, allocRam=0MB] [21:00:42] : [Step 4/5] ^-- volatileDsMemPlc region [type=user, persistence=false, lazyAlloc=true, [21:00:42] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB] [21:00:42] : [Step 4/5] [21:00:42] : [Step 4/5] [2021-11-19 21:00:42,643][INFO ][exchange-worker-#91%failure.IoomFailureHandlerTest0%][msg] Components activation performed in 34 ms. [21:00:42] : [Step 4/5] [2021-11-19 21:00:42,764][INFO ][exchange-worker-#91%failure.IoomFailureHandlerTest0%][MvccProcessorImpl] Mvcc processor started. [21:00:42] : [Step 4/5] [2021-11-19 21:00:42,850][INFO ][sys-#98%failure.IoomFailureHandlerTest0%][GridCacheProcessor] Started cache [name=default, id=1544803905, dataRegionName=dfltPlc, mode=PARTITIONED, atomicity=TRANSACTIONAL_SNAPSHOT, backups=0, mvcc=true] [21:00:42] : [Step 4/5] [2021-11-19 21:00:42,850][INFO ][exchange-worker-#91%failure.IoomFailureHandlerTest0%][GridCacheProcessor] Started cache [name=ignite-sys-cache, id=-2100569601, dataRegionName=sysMemPlc, mode=REPLICATED, atomicity=TRANSACTIONAL, backups=2147483647, mvcc=false] [21:00:42] : [Step 4/5] [2021-11-19 21:00:42,855][INFO ][exchange-worker-#91%failure.IoomFailureHandlerTest0%][GridCacheProcessor] Starting caches on local join performed in 212 ms. [21:00:42] : [Step 4/5] [2021-11-19 21:00:42,884][INFO ][exchange-worker-#91%failure.IoomFailureHandlerTest0%][GridDhtPartitionsExchangeFuture] Skipped waiting for partitions release future (local node is joining) [topVer=AffinityTopologyVersion [topVer=1, minorTopVer=0]] [21:00:43] : [Step 4/5] [2021-11-19 21:00:43,202][INFO ][exchange-worker-#91%failure.IoomFailureHandlerTest0%][GridDhtPartitionsExchangeFuture] finishExchangeOnCoordinator [topVer=AffinityTopologyVersion [topVer=1, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=1, minorTopVer=0]] [21:00:43] : [Step 4/5] [2021-11-19 21:00:43,273][INFO ][exchange-worker-#91%failure.IoomFailureHandlerTest0%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=1, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=1, minorTopVer=0], err=null, rebalanced=true, wasRebalanced=false] [21:00:43] : [Step 4/5] [2021-11-19 21:00:43,299][INFO ][exchange-worker-#91%failure.IoomFailureHandlerTest0%][GridCacheProcessor] Finish proxy initialization, cacheName=default, localNodeId=b0b77bfd-fcbd-47c8-9b37-1d00f0a00000 [21:00:43] : [Step 4/5] [2021-11-19 21:00:43,300][INFO ][exchange-worker-#91%failure.IoomFailureHandlerTest0%][GridCacheProcessor] Finish proxy initialization, cacheName=ignite-sys-cache, localNodeId=b0b77bfd-fcbd-47c8-9b37-1d00f0a00000 [21:00:43] : [Step 4/5] [2021-11-19 21:00:43,304][INFO ][exchange-worker-#91%failure.IoomFailureHandlerTest0%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=b0b77bfd-fcbd-47c8-9b37-1d00f0a00000, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=1, minorTopVer=0], evt=NODE_JOINED, evtNode=TcpDiscoveryNode [id=b0b77bfd-fcbd-47c8-9b37-1d00f0a00000, consistentId=127.0.0.1:47500, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637344842308, loc=true, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=1, minorTopVer=0]] [21:00:43] : [Step 4/5] [2021-11-19 21:00:43,305][INFO ][exchange-worker-#91%failure.IoomFailureHandlerTest0%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=1, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=1, minorTopVer=0], stage="Waiting in exchange queue" (179 ms), stage="Exchange parameters initialization" (4 ms), stage="Components activation" (34 ms), stage="Determine exchange type" (239 ms), stage="Preloading notification" (0 ms), stage="After states restored callback" (316 ms), stage="WAL history reservation" (0 ms), stage="Waiting for all single messages" (0 ms), stage="Affinity recalculation (crd)" (1 ms), stage="Collect update counters and create affinity messages" (0 ms), stage="Assign partitions states" (5 ms), stage="Validate partitions states" (8 ms), stage="Apply update counters" (5 ms), stage="Full message preparing" (49 ms), stage="Full message sending" (0 ms), stage="State finish message sending" (0 ms), stage="Exchange done" (31 ms), stage="Total time" (871 ms)] [21:00:43] : [Step 4/5] [2021-11-19 21:00:43,307][INFO ][exchange-worker-#91%failure.IoomFailureHandlerTest0%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=1, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=1, minorTopVer=0], stage="First node affinity initialization (node join) [grp=default]" (236 ms) (parent=Determine exchange type), stage="Coordinator affinity cache init [grp=ignite-sys-cache]" (215 ms) (parent=Determine exchange type), stage="Coordinator affinity cache init [grp=default]" (215 ms) (parent=Determine exchange type)] [21:00:43] : [Step 4/5] [2021-11-19 21:00:43,310][INFO ][exchange-worker-#91%failure.IoomFailureHandlerTest0%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=1, minorTopVer=0], crd=true] [21:00:43] : [Step 4/5] [2021-11-19 21:00:43,323][INFO ][exchange-worker-#91%failure.IoomFailureHandlerTest0%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=1, minorTopVer=0], force=false, evt=NODE_JOINED, node=b0b77bfd-fcbd-47c8-9b37-1d00f0a00000] [21:00:43] : [Step 4/5] [2021-11-19 21:00:43,382][INFO ][test-runner-#1%failure.IoomFailureHandlerTest%][IoomFailureHandlerTest0] To start Console Management & Monitoring run ignitevisorcmd.{sh|bat} [21:00:43] : [Step 4/5] [2021-11-19 21:00:43,387][INFO ][test-runner-#1%failure.IoomFailureHandlerTest%][IoomFailureHandlerTest0] [21:00:43] : [Step 4/5] [21:00:43] : [Step 4/5] >>> +-------------------------------------------+ [21:00:43] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:00:43] : [Step 4/5] >>> +-------------------------------------------+ [21:00:43] : [Step 4/5] >>> OS name: Linux 4.15.0-151-generic amd64 [21:00:43] : [Step 4/5] >>> CPU(s): 24 [21:00:43] : [Step 4/5] >>> Heap: 2.0GB [21:00:43] : [Step 4/5] >>> VM name: 16724@c4dfe9a430b2 [21:00:43] : [Step 4/5] >>> Ignite instance name: failure.IoomFailureHandlerTest0 [21:00:43] : [Step 4/5] >>> Local node [ID=B0B77BFD-FCBD-47C8-9B37-1D00F0A00000, order=1, clientMode=false] [21:00:43] : [Step 4/5] >>> Local node addresses: [127.0.0.1] [21:00:43] : [Step 4/5] >>> Local ports: TCP:10800 TCP:45010 TCP:47500 [21:00:43] : [Step 4/5] [21:00:43] : [Step 4/5] [2021-11-19 21:00:43,391][INFO ][test-runner-#1%failure.IoomFailureHandlerTest%][GridDiscoveryManager] Topology snapshot [ver=1, locNode=b0b77bfd, servers=1, clients=0, state=ACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=b0b77bfd-fcbd-47c8-9b37-1d00f0a00000, consistentId=127.0.0.1:47500, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:00:43] : [Step 4/5] [2021-11-19 21:00:43,392][INFO ][test-runner-#1%failure.IoomFailureHandlerTest%][GridDiscoveryManager] ^-- Baseline [id=0, size=1, online=1, offline=0] [21:00:43] : [Step 4/5] [2021-11-19 21:00:43,396][INFO ][test-runner-#1%failure.IoomFailureHandlerTest%][G] Node started : [stage="Configure system pool" (12 ms),stage="Start managers" (489 ms),stage="Configure binary metadata" (24 ms),stage="Start processors" (614 ms),stage="Start 'StanByClusterTestProvider' plugin" (1 ms),stage="Start 'PageMemory tracker plugin' plugin" (0 ms),stage="Start 'TestDistibutedConfigurationPlugin' plugin" (0 ms),stage="Start 'NodeValidationPluginProvider' plugin" (0 ms),stage="Init metastore" (37 ms),stage="Finish recovery" (0 ms),stage="Join topology" (126 ms),stage="Await transition" (68 ms),stage="Await exchange" (924 ms),stage="Total time" (2295 ms)] [21:00:43] : [Step 4/5] [2021-11-19 21:00:43,398][INFO ][test-runner-#1%failure.IoomFailureHandlerTest%][root] Node started with the following configuration [id=b0b77bfd-fcbd-47c8-9b37-1d00f0a00000, marshaller=BinaryMarshaller [], discovery=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=5000, ackTimeout=5000, marsh=JdkMarshaller [clsFilter=org.apache.ignite.marshaller.MarshallerUtils$1@21495b4e], reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], binaryCfg=null, lateAff=true] [21:00:43]W: [org.apache.ignite:ignite-core] [2021-11-19 21:00:43,410][WARN ][test-runner-#1%failure.IoomFailureHandlerTest%][G] Ignite work directory is not provided, automatically resolved to: /opt/buildagent/work/7bc1c54bc719b67c/work [21:00:43] : [Step 4/5] [2021-11-19 21:00:43,411][INFO ][test-runner-#1%failure.IoomFailureHandlerTest%][IoomFailureHandlerTest1] [21:00:43] : [Step 4/5] [21:00:43] : [Step 4/5] >>> __________ ________________ [21:00:43] : [Step 4/5] >>> / _/ ___/ |/ / _/_ __/ __/ [21:00:43] : [Step 4/5] >>> _/ // (7 7 // / / / / _/ [21:00:43] : [Step 4/5] >>> /___/\___/_/|_/___/ /_/ /___/ [21:00:43] : [Step 4/5] >>> [21:00:43] : [Step 4/5] >>> ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:00:43] : [Step 4/5] >>> 2021 Copyright(C) Apache Software Foundation [21:00:43] : [Step 4/5] >>> [21:00:43] : [Step 4/5] >>> Ignite documentation: http://ignite.apache.org [21:00:43] : [Step 4/5] [21:00:43] : [Step 4/5] [2021-11-19 21:00:43,412][INFO ][test-runner-#1%failure.IoomFailureHandlerTest%][IoomFailureHandlerTest1] Config URL: n/a [21:00:43] : [Step 4/5] [2021-11-19 21:00:43,414][INFO ][test-runner-#1%failure.IoomFailureHandlerTest%][IoomFailureHandlerTest1] IgniteConfiguration [igniteInstanceName=failure.IoomFailureHandlerTest1, pubPoolSize=24, svcPoolSize=24, callbackPoolSize=24, stripedPoolSize=24, sysPoolSize=24, mgmtPoolSize=4, dataStreamerPoolSize=24, utilityCachePoolSize=24, utilityCacheKeepAliveTime=60000, p2pPoolSize=2, qryPoolSize=24, buildIdxPoolSize=4, igniteHome=/opt/buildagent/work/7bc1c54bc719b67c, igniteWorkDir=/opt/buildagent/work/7bc1c54bc719b67c/work, mbeanSrv=com.sun.jmx.mbeanserver.JmxMBeanServer@6fe85038, nodeId=2008e1bd-d6b9-41ed-88ed-0e1656700001, marsh=BinaryMarshaller [], marshLocJobs=false, daemon=false, p2pEnabled=true, netTimeout=10000, netCompressionLevel=1, sndRetryDelay=1000, sndRetryCnt=3, metricsHistSize=10000, metricsUpdateFreq=1000, metricsExpTime=9223372036854775807, discoSpi=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=0, ackTimeout=0, marsh=null, reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], segPlc=STOP, segResolveAttempts=2, waitForSegOnStart=true, allResolversPassReq=true, segChkFreq=10000, commSpi=TcpCommunicationSpi [connectGate=org.apache.ignite.spi.communication.tcp.internal.ConnectGateway@409cdc5b, ctxInitLatch=java.util.concurrent.CountDownLatch@4d58be9[Count = 1], stopping=false, clientPool=null, nioSrvWrapper=null, stateProvider=null], evtSpi=MemoryEventStorageSpi [expireAgeMs=9223372036854775807, expireCnt=10000, filter=null], colSpi=NoopCollisionSpi [], deploySpi=LocalDeploymentSpi [], indexingSpi=org.apache.ignite.spi.indexing.noop.NoopIndexingSpi@244c9f9d, addrRslvr=null, encryptionSpi=org.apache.ignite.spi.encryption.noop.NoopEncryptionSpi@ea328b7, tracingSpi=org.apache.ignite.spi.tracing.NoopTracingSpi@11cbeef0, clientMode=false, rebalanceThreadPoolSize=4, rebalanceTimeout=10000, rebalanceBatchesPrefetchCnt=3, rebalanceThrottle=0, rebalanceBatchSize=524288, txCfg=TransactionConfiguration [txSerEnabled=false, dfltIsolation=REPEATABLE_READ, dfltConcurrency=PESSIMISTIC, dfltTxTimeout=0, txTimeoutOnPartitionMapExchange=0, deadlockTimeout=10000, pessimisticTxLogSize=0, pessimisticTxLogLinger=10000, tmLookupClsName=null, txManagerFactory=null, useJtaSync=false], cacheSanityCheckEnabled=true, discoStartupDelay=60000, deployMode=SHARED, p2pMissedCacheSize=100, locHost=127.0.0.1, timeSrvPortBase=31100, timeSrvPortRange=100, failureDetectionTimeout=10000, sysWorkerBlockedTimeout=null, clientFailureDetectionTimeout=10000, metricsLogFreq=0, connectorCfg=null, odbcCfg=null, warmupClos=null, atomicCfg=AtomicConfiguration [seqReserveSize=1000, cacheMode=PARTITIONED, backups=1, aff=null, grpName=null], classLdr=null, sslCtxFactory=null, platformCfg=null, binaryCfg=null, memCfg=null, pstCfg=null, dsCfg=DataStorageConfiguration [sysRegionInitSize=41943040, sysRegionMaxSize=104857600, pageSize=2048, concLvl=0, dfltDataRegConf=DataRegionConfiguration [name=dfltPlc, maxSize=10485760, initSize=10485760, swapPath=null, pageEvictionMode=DISABLED, pageReplacementMode=CLOCK, evictionThreshold=0.9, emptyPagesPoolSize=100, metricsEnabled=false, metricsSubIntervalCount=5, metricsRateTimeInterval=60000, persistenceEnabled=false, checkpointPageBufSize=0, lazyMemoryAllocation=true, warmUpCfg=null], dataRegions=null, storagePath=null, checkpointFreq=180000, lockWaitTime=10000, checkpointThreads=4, checkpointWriteOrder=SEQUENTIAL, walHistSize=20, maxWalArchiveSize=1073741824, walSegments=10, walSegmentSize=67108864, walPath=db/wal, walArchivePath=db/wal/archive, cdcWalPath=db/wal/cdc, cdcEnabled=false, metricsEnabled=false, walMode=LOG_ONLY, walTlbSize=131072, walBuffSize=0, walFlushFreq=2000, walFsyncDelay=1000, walRecordIterBuffSize=67108864, alwaysWriteFullPages=false, fileIOFactory=org.apache.ignite.internal.processors.cache.persistence.file.AsyncFileIOFactory@303d6086, metricsSubIntervalCnt=5, metricsRateTimeInterval=60000, walAutoArchiveAfterInactivity=-1, walForceArchiveTimeout=-1, writeThrottlingEnabled=false, walCompactionEnabled=false, walCompactionLevel=1, checkpointReadLockTimeout=null, walPageCompression=DISABLED, walPageCompressionLevel=null, dfltWarmUpCfg=null, encCfg=org.apache.ignite.configuration.EncryptionConfiguration@6c759a5c, defragmentationThreadPoolSize=4, minWalArchiveSize=-1], snapshotPath=snapshots, activeOnStart=true, activeOnStartPropSetFlag=false, autoActivation=true, autoActivationPropSetFlag=false, clusterStateOnStart=null, sqlConnCfg=null, cliConnCfg=ClientConnectorConfiguration [host=null, port=10800, portRange=100, sockSndBufSize=0, sockRcvBufSize=0, tcpNoDelay=true, maxOpenCursorsPerConn=128, threadPoolSize=24, selectorCnt=12, idleTimeout=0, handshakeTimeout=10000, jdbcEnabled=true, odbcEnabled=true, thinCliEnabled=true, sslEnabled=false, useIgniteSslCtxFactory=true, sslClientAuth=false, sslCtxFactory=null, thinCliCfg=ThinClientConfiguration [maxActiveTxPerConn=100, maxActiveComputeTasksPerConn=0]], mvccVacuumThreadCnt=2, mvccVacuumFreq=5000, authEnabled=false, failureHnd=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]], commFailureRslvr=null, sqlCfg=SqlConfiguration [longQryWarnTimeout=3000, dfltQryTimeout=0, sqlQryHistSize=1000, validationEnabled=false], asyncContinuationExecutor=null] [21:00:43] : [Step 4/5] [2021-11-19 21:00:43,424][INFO ][test-runner-#1%failure.IoomFailureHandlerTest%][IoomFailureHandlerTest1] Daemon mode: off [21:00:43] : [Step 4/5] [2021-11-19 21:00:43,425][INFO ][test-runner-#1%failure.IoomFailureHandlerTest%][IoomFailureHandlerTest1] OS: Linux 4.15.0-151-generic amd64 [21:00:43] : [Step 4/5] [2021-11-19 21:00:43,425][INFO ][test-runner-#1%failure.IoomFailureHandlerTest%][IoomFailureHandlerTest1] OS user: teamcity [21:00:43] : [Step 4/5] [2021-11-19 21:00:43,425][INFO ][test-runner-#1%failure.IoomFailureHandlerTest%][IoomFailureHandlerTest1] PID: 16724 [21:00:43] : [Step 4/5] [2021-11-19 21:00:43,426][INFO ][test-runner-#1%failure.IoomFailureHandlerTest%][IoomFailureHandlerTest1] Language runtime: Java Platform API Specification ver. 1.8 [21:00:43] : [Step 4/5] [2021-11-19 21:00:43,426][INFO ][test-runner-#1%failure.IoomFailureHandlerTest%][IoomFailureHandlerTest1] VM information: Java(TM) SE Runtime Environment 1.8.0_261-b12 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 25.261-b12 [21:00:43] : [Step 4/5] [2021-11-19 21:00:43,427][INFO ][test-runner-#1%failure.IoomFailureHandlerTest%][IoomFailureHandlerTest1] VM total memory: 1.9GB [21:00:43] : [Step 4/5] [2021-11-19 21:00:43,427][INFO ][test-runner-#1%failure.IoomFailureHandlerTest%][IoomFailureHandlerTest1] Remote Management [restart: off, REST: off, JMX (remote: off)] [21:00:43] : [Step 4/5] [2021-11-19 21:00:43,428][INFO ][test-runner-#1%failure.IoomFailureHandlerTest%][IoomFailureHandlerTest1] Logger: GridTestLog4jLogger [quiet=false, config=null] [21:00:43] : [Step 4/5] [2021-11-19 21:00:43,428][INFO ][test-runner-#1%failure.IoomFailureHandlerTest%][IoomFailureHandlerTest1] IGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c [21:00:43] : [Step 4/5] [2021-11-19 21:00:43,429][INFO ][test-runner-#1%failure.IoomFailureHandlerTest%][IoomFailureHandlerTest1] VM arguments: [-DIGNITE_DUMP_THREADS_ON_FAILURE=false, -DMono=/usr/bin/mono-sgen, -DMono4.0_x64=/usr/lib/mono/4.0, -DMono4.5_x64=/usr/lib/mono/4.5, -DMonoVersion=6.12.0.90, -DSKIP_BUILD=false, -Dagent.home.dir=/opt/buildagent, -Dagent.name=aitc-lin02_03, -Dagent.ownPort=9090, -Dagent.work.dir=/opt/buildagent/work, -Dbuild.number=95, -Dbuild.vcs.number=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.1=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.GitHubApacheIgnite=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dclassworlds.conf=/opt/buildagent/temp/buildTmp/teamcity.m2.conf, -Dcom.jetbrains.maven.watcher.report.file=/opt/buildagent/temp/buildTmp/maven-build-info.xml, -Djava.io.tmpdir=/opt/buildagent/temp/buildTmp, -Dmaven.home=/opt/buildagent/tools/maven3_6, -Dmaven.multiModuleProjectDirectory=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.agent.cpuBenchmark=457, -Dteamcity.agent.dotnet.agent_url=http://localhost:9090/RPC2, -Dteamcity.agent.dotnet.build_id=6278078, -Dteamcity.auth.password=*******, -Dteamcity.auth.userId=TeamCityBuildId=6278078, -Dteamcity.build.changedFiles.file=/opt/buildagent/temp/buildTmp/changedFiles6342607772318147725.txt, -Dteamcity.build.checkoutDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.build.id=6278078, -Dteamcity.build.properties.file=/opt/buildagent/temp/buildTmp/teamcity.build5164517880467851002.properties, -Dteamcity.build.tempDir=/opt/buildagent/temp/buildTmp, -Dteamcity.build.workingDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.buildConfName=Basic 3, -Dteamcity.buildType.id=IgniteTests24Java8_Basic3, -Dteamcity.configuration.properties.file=/opt/buildagent/temp/buildTmp/teamcity.config5591980786735343870.properties, -Dteamcity.maven.userSettings.path=/opt/buildagent/temp/buildTmp/maven_settings_585072866407032347.xml, -Dteamcity.maven.watcher.home=/opt/buildagent/plugins/mavenPlugin/maven-watcher-jdk16, -Dteamcity.projectName=Ignite Tests 2.x (JDK 8/11), -Dteamcity.runner.properties.file=/opt/buildagent/temp/buildTmp/teamcity.runner9098465561618137420.properties, -Dteamcity.tests.recentlyFailedTests.file=/opt/buildagent/temp/buildTmp/testsToRunFirst3891775683130404069.txt, -Dteamcity.version=2021.2 (build 99542), -ea, -Xms2g, -Xmx2g, -XX:+HeapDumpOnOutOfMemoryError, -DIGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_TEST_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_UPDATE_NOTIFIER=false, -DIGNITE_NO_DISCO_ORDER=true, -DIGNITE_PERFORMANCE_SUGGESTIONS_DISABLED=true, -Djava.net.preferIPv4Stack=true, -DTEST_SCALE_FACTOR=1.0, -DIGNITE_TEST_PROP_LOG4J_FILE=log4j-tc-test.xml, -DIGNITE_QUIET=false, -DIGNITE_MARSHAL_BUFFERS_RECHECK=1000, -Dmaven.repo.local=/opt/buildagent/.m2/repository] [21:00:43] : [Step 4/5] [2021-11-19 21:00:43,435][INFO ][test-runner-#1%failure.IoomFailureHandlerTest%][IoomFailureHandlerTest1] System cache's DataRegion size is configured to 40 MB. Use DataStorageConfiguration.systemRegionInitialSize property to change the setting. [21:00:43] : [Step 4/5] [2021-11-19 21:00:43,435][INFO ][test-runner-#1%failure.IoomFailureHandlerTest%][IoomFailureHandlerTest1] Configured caches [in 'sysMemPlc' dataRegion: ['ignite-sys-cache'], in 'dfltPlc' dataRegion: ['default']] [21:00:43]W: [org.apache.ignite:ignite-core] [2021-11-19 21:00:43,436][WARN ][test-runner-#1%failure.IoomFailureHandlerTest%][IoomFailureHandlerTest1] Peer class loading is enabled (disable it in production for performance and deployment consistency reasons) [21:00:43] : [Step 4/5] [2021-11-19 21:00:43,436][INFO ][test-runner-#1%failure.IoomFailureHandlerTest%][IoomFailureHandlerTest1] 3-rd party licenses can be found at: /opt/buildagent/work/7bc1c54bc719b67c/libs/licenses [21:00:43] : [Step 4/5] [2021-11-19 21:00:43,444][INFO ][test-runner-#1%failure.IoomFailureHandlerTest%][IgnitePluginProcessor] Configured plugins: [21:00:43] : [Step 4/5] [2021-11-19 21:00:43,444][INFO ][test-runner-#1%failure.IoomFailureHandlerTest%][IgnitePluginProcessor] ^-- StanByClusterTestProvider 1.0 [21:00:43] : [Step 4/5] [2021-11-19 21:00:43,445][INFO ][test-runner-#1%failure.IoomFailureHandlerTest%][IgnitePluginProcessor] ^-- null [21:00:43] : [Step 4/5] [2021-11-19 21:00:43,445][INFO ][test-runner-#1%failure.IoomFailureHandlerTest%][IgnitePluginProcessor] [21:00:43] : [Step 4/5] [2021-11-19 21:00:43,446][INFO ][test-runner-#1%failure.IoomFailureHandlerTest%][IgnitePluginProcessor] ^-- PageMemory tracker plugin 1.0 [21:00:43] : [Step 4/5] [2021-11-19 21:00:43,446][INFO ][test-runner-#1%failure.IoomFailureHandlerTest%][IgnitePluginProcessor] ^-- null [21:00:43] : [Step 4/5] [2021-11-19 21:00:43,446][INFO ][test-runner-#1%failure.IoomFailureHandlerTest%][IgnitePluginProcessor] [21:00:43] : [Step 4/5] [2021-11-19 21:00:43,447][INFO ][test-runner-#1%failure.IoomFailureHandlerTest%][IgnitePluginProcessor] ^-- TestDistibutedConfigurationPlugin 1.0 [21:00:43] : [Step 4/5] [2021-11-19 21:00:43,447][INFO ][test-runner-#1%failure.IoomFailureHandlerTest%][IgnitePluginProcessor] ^-- null [21:00:43] : [Step 4/5] [2021-11-19 21:00:43,447][INFO ][test-runner-#1%failure.IoomFailureHandlerTest%][IgnitePluginProcessor] [21:00:43] : [Step 4/5] [2021-11-19 21:00:43,448][INFO ][test-runner-#1%failure.IoomFailureHandlerTest%][IgnitePluginProcessor] ^-- NodeValidationPluginProvider 1.0 [21:00:43] : [Step 4/5] [2021-11-19 21:00:43,448][INFO ][test-runner-#1%failure.IoomFailureHandlerTest%][IgnitePluginProcessor] ^-- null [21:00:43] : [Step 4/5] [2021-11-19 21:00:43,448][INFO ][test-runner-#1%failure.IoomFailureHandlerTest%][IgnitePluginProcessor] [21:00:43] : [Step 4/5] [2021-11-19 21:00:43,449][INFO ][test-runner-#1%failure.IoomFailureHandlerTest%][FailureProcessor] Configured failure handler: [hnd=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]] [21:00:43] : [Step 4/5] [2021-11-19 21:00:43,515][INFO ][test-runner-#1%failure.IoomFailureHandlerTest%][TcpCommunicationSpi] Successfully bound communication NIO server to TCP port [port=45011, locHost=/127.0.0.1, selectorsCnt=12, selectorSpins=0, pairedConn=false] [21:00:43]W: [org.apache.ignite:ignite-core] [2021-11-19 21:00:43,516][WARN ][test-runner-#1%failure.IoomFailureHandlerTest%][TcpCommunicationSpi] Message queue limit is set to 0 which may lead to potential OOMEs when running cache operations in FULL_ASYNC or PRIMARY_SYNC modes due to message queues growth on sender and receiver sides. [21:00:43] : [Step 4/5] [2021-11-19 21:00:43,532][INFO ][test-runner-#1%failure.IoomFailureHandlerTest%][GridCollisionManager] Collision resolution is disabled (all jobs will be activated upon arrival). [21:00:43] : [Step 4/5] [2021-11-19 21:00:43,532][INFO ][test-runner-#1%failure.IoomFailureHandlerTest%][IoomFailureHandlerTest1] Security status [authentication=off, sandbox=off, tls/ssl=off] [21:00:43] : [Step 4/5] [2021-11-19 21:00:43,544][INFO ][test-runner-#1%failure.IoomFailureHandlerTest%][TestTcpDiscoverySpi] Successfully bound to TCP port [port=47501, localHost=localhost/127.0.0.1, locNodeId=2008e1bd-d6b9-41ed-88ed-0e1656700001] [21:00:43] : [Step 4/5] [2021-11-19 21:00:43,548][INFO ][test-runner-#1%failure.IoomFailureHandlerTest%][IgniteCacheDatabaseSharedManager] Configured data regions initialized successfully [total=4] [21:00:43] : [Step 4/5] [2021-11-19 21:00:43,560][INFO ][test-runner-#1%failure.IoomFailureHandlerTest%][ClientListenerProcessor] Client connector processor has started on TCP port 10801 [21:00:43] : [Step 4/5] [2021-11-19 21:00:43,569][INFO ][test-runner-#1%failure.IoomFailureHandlerTest%][IoomFailureHandlerTest1] Non-loopback local IPs: 172.17.0.4 [21:00:43] : [Step 4/5] [2021-11-19 21:00:43,569][INFO ][test-runner-#1%failure.IoomFailureHandlerTest%][IoomFailureHandlerTest1] Enabled local MACs: 0242AC110004 [21:00:43] : [Step 4/5] [2021-11-19 21:00:43,573][INFO ][test-runner-#1%failure.IoomFailureHandlerTest%][ClusterProcessor] Cluster ID and tag has been read from metastorage: null [21:00:43] : [Step 4/5] [2021-11-19 21:00:43,574][INFO ][test-runner-#1%failure.IoomFailureHandlerTest%][IgniteClusterImpl] Shutdown policy was updated [oldVal=null, newVal=null] [21:00:43] : [Step 4/5] [2021-11-19 21:00:43,588][INFO ][tcp-disco-srvr-[:47500]-#4%failure.IoomFailureHandlerTest0%-#87%failure.IoomFailureHandlerTest0%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=47801] [21:00:43] : [Step 4/5] [2021-11-19 21:00:43,612][INFO ][tcp-disco-srvr-[:47500]-#4%failure.IoomFailureHandlerTest0%-#87%failure.IoomFailureHandlerTest0%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=47801] [21:00:43] : [Step 4/5] [2021-11-19 21:00:43,614][INFO ][tcp-disco-sock-reader-[]-#10%failure.IoomFailureHandlerTest0%-#201%failure.IoomFailureHandlerTest0%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:47801, rmtPort=47801] [21:00:43] : [Step 4/5] [2021-11-19 21:00:43,620][INFO ][tcp-disco-sock-reader-[2008e1bd 127.0.0.1:47801]-#10%failure.IoomFailureHandlerTest0%-#201%failure.IoomFailureHandlerTest0%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=2008e1bd-d6b9-41ed-88ed-0e1656700001, rmtAddr=/127.0.0.1:47801] [21:00:43] : [Step 4/5] [2021-11-19 21:00:43,649][INFO ][tcp-disco-srvr-[:47501]-#9%failure.IoomFailureHandlerTest1%-#200%failure.IoomFailureHandlerTest1%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=59721] [21:00:43] : [Step 4/5] [2021-11-19 21:00:43,649][INFO ][tcp-disco-srvr-[:47501]-#9%failure.IoomFailureHandlerTest1%-#200%failure.IoomFailureHandlerTest1%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=59721] [21:00:43] : [Step 4/5] [2021-11-19 21:00:43,654][INFO ][tcp-disco-sock-reader-[]-#11%failure.IoomFailureHandlerTest1%-#202%failure.IoomFailureHandlerTest1%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:59721, rmtPort=59721] [21:00:43] : [Step 4/5] [2021-11-19 21:00:43,656][INFO ][tcp-disco-sock-reader-[]-#11%failure.IoomFailureHandlerTest1%-#202%failure.IoomFailureHandlerTest1%][TestTcpDiscoverySpi] Received ping request from the remote node [rmtNodeId=b0b77bfd-fcbd-47c8-9b37-1d00f0a00000, rmtAddr=/127.0.0.1:59721, rmtPort=59721] [21:00:43] : [Step 4/5] [2021-11-19 21:00:43,659][INFO ][tcp-disco-sock-reader-[]-#11%failure.IoomFailureHandlerTest1%-#202%failure.IoomFailureHandlerTest1%][TestTcpDiscoverySpi] Finished writing ping response [rmtNodeId=b0b77bfd-fcbd-47c8-9b37-1d00f0a00000, rmtAddr=/127.0.0.1:59721, rmtPort=59721] [21:00:43] : [Step 4/5] [2021-11-19 21:00:43,660][INFO ][tcp-disco-sock-reader-[2008e1bd 127.0.0.1:47801]-#10%failure.IoomFailureHandlerTest0%-#201%failure.IoomFailureHandlerTest0%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:47801, rmtPort=47801, rmtNodeId=2008e1bd-d6b9-41ed-88ed-0e1656700001] [21:00:43]W: [org.apache.ignite:ignite-core] [2021-11-19 21:00:43,662][WARN ][tcp-disco-sock-reader-[]-#11%failure.IoomFailureHandlerTest1%-#202%failure.IoomFailureHandlerTest1%][TestTcpDiscoverySpi] Failed to shutdown socket [21:00:43]W: [org.apache.ignite:ignite-core] java.net.SocketException: Socket output is already shutdown [21:00:43]W: [org.apache.ignite:ignite-core] at java.net.Socket.shutdownOutput(Socket.java:1572) [21:00:43]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.close(IgniteUtils.java:4247) [21:00:43]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.discovery.tcp.ServerImpl$SocketReader.body(ServerImpl.java:7370) [21:00:43]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.IgniteSpiThread.run(IgniteSpiThread.java:58) [21:00:43] : [Step 4/5] [2021-11-19 21:00:43,668][INFO ][tcp-disco-sock-reader-[]-#11%failure.IoomFailureHandlerTest1%-#202%failure.IoomFailureHandlerTest1%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:59721, rmtPort=59721, rmtNodeId=null] [21:00:43] : [Step 4/5] [2021-11-19 21:00:43,681][INFO ][tcp-disco-msg-worker-[crd]-#3%failure.IoomFailureHandlerTest0%-#86%failure.IoomFailureHandlerTest0%][GridEncryptionManager] Joining node doesn't have stored group keys [node=2008e1bd-d6b9-41ed-88ed-0e1656700001] [21:00:43] : [Step 4/5] [2021-11-19 21:00:43,761][INFO ][tcp-disco-msg-worker-[crd]-#3%failure.IoomFailureHandlerTest0%-#86%failure.IoomFailureHandlerTest0%][TestTcpDiscoverySpi] New next node [newNext=TcpDiscoveryNode [id=2008e1bd-d6b9-41ed-88ed-0e1656700001, consistentId=127.0.0.1:47501, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=0, intOrder=2, lastExchangeTime=1637344843631, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false]] [21:00:43] : [Step 4/5] [2021-11-19 21:00:43,763][INFO ][tcp-disco-srvr-[:47501]-#9%failure.IoomFailureHandlerTest1%-#200%failure.IoomFailureHandlerTest1%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=53801] [21:00:43] : [Step 4/5] [2021-11-19 21:00:43,763][INFO ][tcp-disco-srvr-[:47501]-#9%failure.IoomFailureHandlerTest1%-#200%failure.IoomFailureHandlerTest1%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=53801] [21:00:43] : [Step 4/5] [2021-11-19 21:00:43,766][INFO ][tcp-disco-sock-reader-[]-#12%failure.IoomFailureHandlerTest1%-#203%failure.IoomFailureHandlerTest1%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:53801, rmtPort=53801] [21:00:43] : [Step 4/5] [2021-11-19 21:00:43,769][INFO ][tcp-disco-sock-reader-[b0b77bfd 127.0.0.1:53801]-#12%failure.IoomFailureHandlerTest1%-#203%failure.IoomFailureHandlerTest1%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=b0b77bfd-fcbd-47c8-9b37-1d00f0a00000, rmtAddr=/127.0.0.1:53801] [21:00:43] : [Step 4/5] [2021-11-19 21:00:43,784][INFO ][tcp-disco-msg-worker-[]-#8%failure.IoomFailureHandlerTest1%-#199%failure.IoomFailureHandlerTest1%][TestTcpDiscoverySpi] New next node [newNext=TcpDiscoveryNode [id=b0b77bfd-fcbd-47c8-9b37-1d00f0a00000, consistentId=127.0.0.1:47500, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637344843777, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false]] [21:00:43] : [Step 4/5] [2021-11-19 21:00:43,785][INFO ][tcp-disco-srvr-[:47500]-#4%failure.IoomFailureHandlerTest0%-#87%failure.IoomFailureHandlerTest0%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=44413] [21:00:43] : [Step 4/5] [2021-11-19 21:00:43,786][INFO ][tcp-disco-srvr-[:47500]-#4%failure.IoomFailureHandlerTest0%-#87%failure.IoomFailureHandlerTest0%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=44413] [21:00:43] : [Step 4/5] [2021-11-19 21:00:43,786][INFO ][tcp-disco-sock-reader-[]-#13%failure.IoomFailureHandlerTest0%-#204%failure.IoomFailureHandlerTest0%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:44413, rmtPort=44413] [21:00:43] : [Step 4/5] [2021-11-19 21:00:43,788][INFO ][tcp-disco-sock-reader-[2008e1bd 127.0.0.1:44413]-#13%failure.IoomFailureHandlerTest0%-#204%failure.IoomFailureHandlerTest0%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=2008e1bd-d6b9-41ed-88ed-0e1656700001, rmtAddr=/127.0.0.1:44413] [21:00:43] : [Step 4/5] [2021-11-19 21:00:43,800][INFO ][disco-notifier-worker-#85%failure.IoomFailureHandlerTest0%][GridClusterStateProcessor] Received activate cluster request with BaselineTopology[id=0] initiator node ID: 2008e1bd-d6b9-41ed-88ed-0e1656700001 [21:00:43] : [Step 4/5] [2021-11-19 21:00:43,800][INFO ][disco-notifier-worker-#85%failure.IoomFailureHandlerTest0%][GridClusterStateProcessor] Started state transition: activate cluster [21:00:43] : [Step 4/5] [2021-11-19 21:00:43,801][INFO ][disco-notifier-worker-#85%failure.IoomFailureHandlerTest0%][GridClusterStateProcessor] Received state change finish message: ACTIVE [21:00:43] : [Step 4/5] [2021-11-19 21:00:43,801][INFO ][disco-notifier-worker-#85%failure.IoomFailureHandlerTest0%][GridClusterStateProcessor] Cluster state was changed from ACTIVE to ACTIVE [21:00:43] : [Step 4/5] [2021-11-19 21:00:43,802][INFO ][disco-event-worker-#89%failure.IoomFailureHandlerTest0%][GridDiscoveryManager] Added new node to topology: TcpDiscoveryNode [id=2008e1bd-d6b9-41ed-88ed-0e1656700001, consistentId=127.0.0.1:47501, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637344843631, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false] [21:00:43] : [Step 4/5] [2021-11-19 21:00:43,810][INFO ][disco-event-worker-#89%failure.IoomFailureHandlerTest0%][GridDiscoveryManager] Topology snapshot [ver=2, locNode=b0b77bfd, servers=2, clients=0, state=ACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=b0b77bfd-fcbd-47c8-9b37-1d00f0a00000, consistentId=127.0.0.1:47500, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=2008e1bd-d6b9-41ed-88ed-0e1656700001, consistentId=127.0.0.1:47501, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:00:43] : [Step 4/5] [2021-11-19 21:00:43,811][INFO ][disco-event-worker-#89%failure.IoomFailureHandlerTest0%][GridDiscoveryManager] ^-- Baseline [id=0, size=2, online=2, offline=0] [21:00:43] : [Step 4/5] [2021-11-19 21:00:43,814][INFO ][exchange-worker-#91%failure.IoomFailureHandlerTest0%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=0], crd=true, evt=NODE_JOINED, evtNode=2008e1bd-d6b9-41ed-88ed-0e1656700001, customEvt=null, allowMerge=true, exchangeFreeSwitch=false] [21:00:43] : [Step 4/5] [2021-11-19 21:00:43,826][INFO ][tcp-disco-msg-worker-[b0b77bfd 127.0.0.1:47500]-#8%failure.IoomFailureHandlerTest1%-#199%failure.IoomFailureHandlerTest1%][ClusterProcessor] magical_wright [21:00:43] : [Step 4/5] [2021-11-19 21:00:43,827][INFO ][tcp-disco-msg-worker-[b0b77bfd 127.0.0.1:47500]-#8%failure.IoomFailureHandlerTest1%-#199%failure.IoomFailureHandlerTest1%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustEnabled' was changed from 'null' to 'true' [21:00:43] : [Step 4/5] [2021-11-19 21:00:43,828][INFO ][exchange-worker-#91%failure.IoomFailureHandlerTest0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=0], waitTime=0ms, futInfo=NA, mode=DISTRIBUTED] [21:00:43] : [Step 4/5] [2021-11-19 21:00:43,829][INFO ][tcp-disco-msg-worker-[b0b77bfd 127.0.0.1:47500]-#8%failure.IoomFailureHandlerTest1%-#199%failure.IoomFailureHandlerTest1%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustTimeout' was changed from 'null' to '0' [21:00:43] : [Step 4/5] [2021-11-19 21:00:43,830][INFO ][tcp-disco-msg-worker-[b0b77bfd 127.0.0.1:47500]-#8%failure.IoomFailureHandlerTest1%-#199%failure.IoomFailureHandlerTest1%][IgniteTxManager] Transactions parameter 'longOperationsDumpTimeout' was changed from 'null' to '60000' [21:00:43] : [Step 4/5] [2021-11-19 21:00:43,832][INFO ][tcp-disco-msg-worker-[b0b77bfd 127.0.0.1:47500]-#8%failure.IoomFailureHandlerTest1%-#199%failure.IoomFailureHandlerTest1%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpThreshold' was changed from 'null' to '0' [21:00:43] : [Step 4/5] [2021-11-19 21:00:43,832][INFO ][tcp-disco-msg-worker-[b0b77bfd 127.0.0.1:47500]-#8%failure.IoomFailureHandlerTest1%-#199%failure.IoomFailureHandlerTest1%][IgniteTxManager] Transactions parameter 'transactionTimeDumpSamplesCoefficient' was changed from 'null' to '0.0' [21:00:43] : [Step 4/5] [2021-11-19 21:00:43,833][INFO ][tcp-disco-msg-worker-[b0b77bfd 127.0.0.1:47500]-#8%failure.IoomFailureHandlerTest1%-#199%failure.IoomFailureHandlerTest1%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpSamplesPerSecondLimit' was changed from 'null' to '5' [21:00:43] : [Step 4/5] [2021-11-19 21:00:43,834][INFO ][tcp-disco-msg-worker-[b0b77bfd 127.0.0.1:47500]-#8%failure.IoomFailureHandlerTest1%-#199%failure.IoomFailureHandlerTest1%][IgniteTxManager] Transactions parameter 'collisionsDumpInterval' was changed from 'null' to '1000' [21:00:43] : [Step 4/5] [2021-11-19 21:00:43,835][INFO ][tcp-disco-msg-worker-[b0b77bfd 127.0.0.1:47500]-#8%failure.IoomFailureHandlerTest1%-#199%failure.IoomFailureHandlerTest1%][IgniteTxManager] Transactions parameter 'txOwnerDumpRequestsAllowed' was changed from 'null' to 'true' [21:00:43] : [Step 4/5] [2021-11-19 21:00:43,837][INFO ][exchange-worker-#91%failure.IoomFailureHandlerTest0%][GridDhtPartitionsExchangeFuture] Finished waiting for partitions release latch: ServerLatch [permits=0, pendingAcks=HashSet [], super=CompletableLatch [id=CompletableLatchUid [id=exchange, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=0]]]] [21:00:43] : [Step 4/5] [2021-11-19 21:00:43,838][INFO ][exchange-worker-#91%failure.IoomFailureHandlerTest0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=0], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:00:43] : [Step 4/5] [2021-11-19 21:00:43,838][INFO ][disco-notifier-worker-#198%failure.IoomFailureHandlerTest1%][GridClusterStateProcessor] Received activate cluster request with BaselineTopology[id=0] initiator node ID: 2008e1bd-d6b9-41ed-88ed-0e1656700001 [21:00:43] : [Step 4/5] [2021-11-19 21:00:43,840][INFO ][exchange-worker-#91%failure.IoomFailureHandlerTest0%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=0], crd=true] [21:00:43] : [Step 4/5] [2021-11-19 21:00:43,841][INFO ][disco-notifier-worker-#198%failure.IoomFailureHandlerTest1%][GridClusterStateProcessor] Started state transition: activate cluster [21:00:43] : [Step 4/5] [2021-11-19 21:00:43,841][INFO ][disco-notifier-worker-#198%failure.IoomFailureHandlerTest1%][GridClusterStateProcessor] Received state change finish message: ACTIVE [21:00:43] : [Step 4/5] [2021-11-19 21:00:43,842][INFO ][disco-notifier-worker-#198%failure.IoomFailureHandlerTest1%][GridClusterStateProcessor] Cluster state was changed from ACTIVE to ACTIVE [21:00:43] : [Step 4/5] [2021-11-19 21:00:43,843][INFO ][disco-notifier-worker-#198%failure.IoomFailureHandlerTest1%][MvccProcessorImpl] Assigned mvcc coordinator [crd=MvccCoordinator [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=0], nodeId=b0b77bfd-fcbd-47c8-9b37-1d00f0a00000, ver=1637344842370, local=false, initialized=false]] [21:00:43] : [Step 4/5] [2021-11-19 21:00:43,850][INFO ][sys-#207%failure.IoomFailureHandlerTest1%][ClusterProcessor] Writing cluster ID and tag to metastorage on ready for write ClusterIdAndTag [id=9b83d72a-2eb8-4f72-a18a-5f8735f817d6, tag=magical_wright] [21:00:43] : [Step 4/5] [2021-11-19 21:00:43,890][INFO ][exchange-worker-#208%failure.IoomFailureHandlerTest1%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=0], crd=false, evt=NODE_JOINED, evtNode=2008e1bd-d6b9-41ed-88ed-0e1656700001, customEvt=null, allowMerge=true, exchangeFreeSwitch=false] [21:00:43] : [Step 4/5] [2021-11-19 21:00:43,913][INFO ][exchange-worker-#208%failure.IoomFailureHandlerTest1%][IgniteCacheDatabaseSharedManager] Data Regions Started: 4 [21:00:43] : [Step 4/5] [2021-11-19 21:00:43,914][INFO ][exchange-worker-#208%failure.IoomFailureHandlerTest1%][IgniteCacheDatabaseSharedManager] ^-- sysMemPlc region [type=internal, persistence=false, lazyAlloc=false, [21:00:43] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=40MB] [21:00:43] : [Step 4/5] ^-- TxLog region [type=internal, persistence=false, lazyAlloc=false, [21:00:43] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=40MB] [21:00:43] : [Step 4/5] ^-- dfltPlc region [type=default, persistence=false, lazyAlloc=true, [21:00:43] : [Step 4/5] ... initCfg=10MB, maxCfg=10MB, usedRam=0MB, freeRam=100%, allocRam=0MB] [21:00:43] : [Step 4/5] ^-- volatileDsMemPlc region [type=user, persistence=false, lazyAlloc=true, [21:00:43] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB] [21:00:43] : [Step 4/5] [21:00:43] : [Step 4/5] [2021-11-19 21:00:43,916][INFO ][exchange-worker-#208%failure.IoomFailureHandlerTest1%][msg] Components activation performed in 23 ms. [21:00:43] : [Step 4/5] [2021-11-19 21:00:43,924][INFO ][exchange-worker-#208%failure.IoomFailureHandlerTest1%][MvccProcessorImpl] Mvcc processor started. [21:00:43] : [Step 4/5] [2021-11-19 21:00:43,936][INFO ][sys-#215%failure.IoomFailureHandlerTest1%][GridCacheProcessor] Started cache [name=default, id=1544803905, dataRegionName=dfltPlc, mode=PARTITIONED, atomicity=TRANSACTIONAL_SNAPSHOT, backups=0, mvcc=true] [21:00:43] : [Step 4/5] [2021-11-19 21:00:43,937][INFO ][exchange-worker-#208%failure.IoomFailureHandlerTest1%][GridCacheProcessor] Started cache [name=ignite-sys-cache, id=-2100569601, dataRegionName=sysMemPlc, mode=REPLICATED, atomicity=TRANSACTIONAL, backups=2147483647, mvcc=false] [21:00:43] : [Step 4/5] [2021-11-19 21:00:43,939][INFO ][exchange-worker-#208%failure.IoomFailureHandlerTest1%][GridCacheProcessor] Starting caches on local join performed in 20 ms. [21:00:43] : [Step 4/5] [2021-11-19 21:00:43,942][INFO ][exchange-worker-#208%failure.IoomFailureHandlerTest1%][GridDhtPartitionsExchangeFuture] Skipped waiting for partitions release future (local node is joining) [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=0]] [21:00:43] : [Step 4/5] [2021-11-19 21:00:43,966][INFO ][grid-nio-worker-tcp-comm-0-#56%TcpCommunicationSpi%][TcpCommunicationSpi] Accepted incoming communication connection [locAddr=/127.0.0.1:45010, rmtAddr=/127.0.0.1:38458] [21:00:43] : [Step 4/5] [2021-11-19 21:00:43,986][INFO ][grid-nio-worker-tcp-comm-0-#169%TcpCommunicationSpi%][TcpCommunicationSpi] Established outgoing communication connection [locAddr=/127.0.0.1:38458, rmtAddr=/127.0.0.1:45010] [21:00:43] : [Step 4/5] [2021-11-19 21:00:43,987][INFO ][exchange-worker-#208%failure.IoomFailureHandlerTest1%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=0], crd=false] [21:00:44] : [Step 4/5] [2021-11-19 21:00:44,021][INFO ][sys-#222%failure.IoomFailureHandlerTest0%][GridDhtPartitionsExchangeFuture] Coordinator received single message [ver=AffinityTopologyVersion [topVer=2, minorTopVer=0], node=2008e1bd-d6b9-41ed-88ed-0e1656700001, allReceived=true] [21:00:44] : [Step 4/5] [2021-11-19 21:00:44,022][INFO ][sys-#222%failure.IoomFailureHandlerTest0%][GridDhtPartitionsExchangeFuture] Coordinator received all messages, try merge [ver=AffinityTopologyVersion [topVer=2, minorTopVer=0]] [21:00:44] : [Step 4/5] [2021-11-19 21:00:44,023][INFO ][sys-#222%failure.IoomFailureHandlerTest0%][GridDhtPartitionsExchangeFuture] finishExchangeOnCoordinator [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=0]] [21:00:44] : [Step 4/5] [2021-11-19 21:00:44,119][INFO ][sys-#222%failure.IoomFailureHandlerTest0%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=0], err=null, rebalanced=false, wasRebalanced=true] [21:00:44] : [Step 4/5] [2021-11-19 21:00:44,125][INFO ][sys-#222%failure.IoomFailureHandlerTest0%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=b0b77bfd-fcbd-47c8-9b37-1d00f0a00000, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=0], evt=NODE_JOINED, evtNode=TcpDiscoveryNode [id=2008e1bd-d6b9-41ed-88ed-0e1656700001, consistentId=127.0.0.1:47501, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637344843631, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=false, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=2, minorTopVer=0]] [21:00:44] : [Step 4/5] [2021-11-19 21:00:44,127][INFO ][sys-#222%failure.IoomFailureHandlerTest0%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=0], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (3 ms), stage="Determine exchange type" (3 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (11 ms), stage="Wait partitions release latch [latch=exchange]" (6 ms), stage="Wait partitions release [latch=exchange]" (2 ms), stage="After states restored callback" (0 ms), stage="WAL history reservation" (0 ms), stage="Waiting for all single messages" (181 ms), stage="Exchanges merge" (0 ms), stage="Affinity recalculation (crd)" (65 ms), stage="Collect update counters and create affinity messages" (4 ms), stage="Assign partitions states" (2 ms), stage="Validate partitions states" (1 ms), stage="Apply update counters" (1 ms), stage="Full message preparing" (10 ms), stage="Full message sending" (9 ms), stage="State finish message sending" (0 ms), stage="Exchange done" (7 ms), stage="Total time" (305 ms), Discovery lag=32 ms, Latest started node id=2008e1bd-d6b9-41ed-88ed-0e1656700001] [21:00:44] : [Step 4/5] [2021-11-19 21:00:44,130][INFO ][sys-#222%failure.IoomFailureHandlerTest0%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=0], stage="Affinity initialization (node join) [grp=default, crd=true]" (46 ms) (parent=Affinity recalculation (crd)), stage="Affinity initialization (node join) [grp=ignite-sys-cache, crd=true]" (15 ms) (parent=Affinity recalculation (crd))] [21:00:44] : [Step 4/5] [2021-11-19 21:00:44,130][INFO ][exchange-worker-#91%failure.IoomFailureHandlerTest0%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=2, minorTopVer=0], force=false, evt=NODE_JOINED, node=2008e1bd-d6b9-41ed-88ed-0e1656700001] [21:00:44] : [Step 4/5] [2021-11-19 21:00:44,163][INFO ][sys-#228%failure.IoomFailureHandlerTest1%][GridDhtPartitionsExchangeFuture] Received full message, will finish exchange [node=b0b77bfd-fcbd-47c8-9b37-1d00f0a00000, resVer=AffinityTopologyVersion [topVer=2, minorTopVer=0]] [21:00:44] : [Step 4/5] [2021-11-19 21:00:44,277][INFO ][sys-#228%failure.IoomFailureHandlerTest1%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=0], err=null, rebalanced=false, wasRebalanced=false] [21:00:44] : [Step 4/5] [2021-11-19 21:00:44,279][INFO ][sys-#228%failure.IoomFailureHandlerTest1%][GridCacheProcessor] Finish proxy initialization, cacheName=default, localNodeId=2008e1bd-d6b9-41ed-88ed-0e1656700001 [21:00:44] : [Step 4/5] [2021-11-19 21:00:44,280][INFO ][sys-#228%failure.IoomFailureHandlerTest1%][GridCacheProcessor] Finish proxy initialization, cacheName=ignite-sys-cache, localNodeId=2008e1bd-d6b9-41ed-88ed-0e1656700001 [21:00:44] : [Step 4/5] [2021-11-19 21:00:44,280][INFO ][sys-#228%failure.IoomFailureHandlerTest1%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=2008e1bd-d6b9-41ed-88ed-0e1656700001, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=0], evt=NODE_JOINED, evtNode=TcpDiscoveryNode [id=2008e1bd-d6b9-41ed-88ed-0e1656700001, consistentId=127.0.0.1:47501, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637344843869, loc=true, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=false, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=2, minorTopVer=0]] [21:00:44] : [Step 4/5] [2021-11-19 21:00:44,282][INFO ][sys-#228%failure.IoomFailureHandlerTest1%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=0], stage="Waiting in exchange queue" (45 ms), stage="Exchange parameters initialization" (3 ms), stage="Components activation" (23 ms), stage="Determine exchange type" (24 ms), stage="Preloading notification" (0 ms), stage="After states restored callback" (1 ms), stage="WAL history reservation" (0 ms), stage="Waiting for Full message" (219 ms), stage="Affinity recalculation" (95 ms), stage="Full map updating" (17 ms), stage="Exchange done" (5 ms), stage="Total time" (432 ms)] [21:00:44] : [Step 4/5] [2021-11-19 21:00:44,283][INFO ][sys-#228%failure.IoomFailureHandlerTest1%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=0], stage="Affinity fetch" (24 ms) (parent=Determine exchange type), stage="Affinity initialization (local join) [grp=default]" (95 ms) (parent=Affinity recalculation), stage="Affinity initialization (local join) [grp=ignite-sys-cache]" (28 ms) (parent=Affinity recalculation)] [21:00:44] : [Step 4/5] [2021-11-19 21:00:44,309][INFO ][exchange-worker-#208%failure.IoomFailureHandlerTest1%][GridCachePartitionExchangeManager] Rebalancing scheduled [order=[ignite-sys-cache, default], top=AffinityTopologyVersion [topVer=2, minorTopVer=0], rebalanceId=1, evt=NODE_JOINED, node=2008e1bd-d6b9-41ed-88ed-0e1656700001] [21:00:44] : [Step 4/5] [2021-11-19 21:00:44,311][INFO ][exchange-worker-#208%failure.IoomFailureHandlerTest1%][GridDhtPartitionDemander] Prepared rebalancing [grp=ignite-sys-cache, mode=SYNC, supplier=b0b77bfd-fcbd-47c8-9b37-1d00f0a00000, partitionsCount=100, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=0], rebalanceId=1] [21:00:44] : [Step 4/5] [2021-11-19 21:00:44,318][INFO ][exchange-worker-#208%failure.IoomFailureHandlerTest1%][PartitionsEvictManager] Eviction in progress [groups=1, remainingPartsToEvict=0] [21:00:44] : [Step 4/5] [2021-11-19 21:00:44,319][INFO ][exchange-worker-#208%failure.IoomFailureHandlerTest1%][PartitionsEvictManager] Group eviction in progress [grpName=ignite-sys-cache, grpId=-2100569601, remainingPartsToEvict=1, partsEvictInProgress=0, totalParts=100] [21:00:44] : [Step 4/5] [2021-11-19 21:00:44,329][INFO ][exchange-worker-#208%failure.IoomFailureHandlerTest1%][PartitionsEvictManager] Partitions have been scheduled for eviction: [grpId=-2100569601, grpName=ignite-sys-cache, clearing=[0]] [21:00:44] : [Step 4/5] [2021-11-19 21:00:44,354][INFO ][sys-#241%failure.IoomFailureHandlerTest1%][GridDhtPartitionDemander] Starting rebalance routine [ignite-sys-cache, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=0], supplier=b0b77bfd-fcbd-47c8-9b37-1d00f0a00000, fullPartitions=[0-99], histPartitions=[], rebalanceId=1] [21:00:44] : [Step 4/5] [2021-11-19 21:00:44,398][INFO ][rebalance-striped-#243%failure.IoomFailureHandlerTest0%][GridDhtPartitionSupplier] Finished supplying rebalancing [grp=ignite-sys-cache, demander=2008e1bd-d6b9-41ed-88ed-0e1656700001, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=0]] [21:00:44] : [Step 4/5] [2021-11-19 21:00:44,435][INFO ][rebalance-#237%failure.IoomFailureHandlerTest1%][GridDhtPartitionDemander] Completed (final) rebalancing [rebalanceId=1, grp=ignite-sys-cache, supplier=b0b77bfd-fcbd-47c8-9b37-1d00f0a00000, partitions=100, entries=0, duration=122ms, bytesRcvd=0.0 B, bandwidth=0.0 B/sec, histPartitions=0, histEntries=0, histBytesRcvd=0.0 B, fullPartitions=100, fullEntries=0, fullBytesRcvd=0.0 B, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=0], progress=1/1] [21:00:44] : [Step 4/5] [2021-11-19 21:00:44,439][INFO ][rebalance-#237%failure.IoomFailureHandlerTest1%][GridDhtPartitionDemander] Completed rebalance future: RebalanceFuture [state=STARTED, grp=CacheGroupContext [grp=ignite-sys-cache], topVer=AffinityTopologyVersion [topVer=2, minorTopVer=0], rebalanceId=1, routines=1, receivedBytes=1200, receivedKeys=0, partitionsLeft=0, partitionsTotal=100, startTime=1637344844311, endTime=1637344844436, lastCancelledTime=-1, result=true] [21:00:44] : [Step 4/5] [2021-11-19 21:00:44,441][INFO ][rebalance-#237%failure.IoomFailureHandlerTest1%][GridDhtPartitionDemander] Prepared rebalancing [grp=default, mode=ASYNC, supplier=b0b77bfd-fcbd-47c8-9b37-1d00f0a00000, partitionsCount=524, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=0], rebalanceId=1] [21:00:44] : [Step 4/5] [2021-11-19 21:00:44,494][INFO ][test-runner-#1%failure.IoomFailureHandlerTest%][IoomFailureHandlerTest1] To start Console Management & Monitoring run ignitevisorcmd.{sh|bat} [21:00:44] : [Step 4/5] [2021-11-19 21:00:44,495][INFO ][test-runner-#1%failure.IoomFailureHandlerTest%][IoomFailureHandlerTest1] [21:00:44] : [Step 4/5] [21:00:44] : [Step 4/5] >>> +-------------------------------------------+ [21:00:44] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:00:44] : [Step 4/5] >>> +-------------------------------------------+ [21:00:44] : [Step 4/5] >>> OS name: Linux 4.15.0-151-generic amd64 [21:00:44] : [Step 4/5] >>> CPU(s): 24 [21:00:44] : [Step 4/5] >>> Heap: 2.0GB [21:00:44] : [Step 4/5] >>> VM name: 16724@c4dfe9a430b2 [21:00:44] : [Step 4/5] >>> Ignite instance name: failure.IoomFailureHandlerTest1 [21:00:44] : [Step 4/5] >>> Local node [ID=2008E1BD-D6B9-41ED-88ED-0E1656700001, order=2, clientMode=false] [21:00:44] : [Step 4/5] >>> Local node addresses: [127.0.0.1] [21:00:44] : [Step 4/5] >>> Local ports: TCP:10801 TCP:45011 TCP:47501 [21:00:44] : [Step 4/5] [21:00:44] : [Step 4/5] [2021-11-19 21:00:44,496][INFO ][test-runner-#1%failure.IoomFailureHandlerTest%][GridDiscoveryManager] Topology snapshot [ver=2, locNode=2008e1bd, servers=2, clients=0, state=ACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=b0b77bfd-fcbd-47c8-9b37-1d00f0a00000, consistentId=127.0.0.1:47500, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=2008e1bd-d6b9-41ed-88ed-0e1656700001, consistentId=127.0.0.1:47501, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:00:44] : [Step 4/5] [2021-11-19 21:00:44,498][INFO ][test-runner-#1%failure.IoomFailureHandlerTest%][GridDiscoveryManager] ^-- Baseline [id=0, size=2, online=2, offline=0] [21:00:44] : [Step 4/5] [2021-11-19 21:00:44,498][INFO ][test-runner-#1%failure.IoomFailureHandlerTest%][G] Node started : [stage="Configure system pool" (0 ms),stage="Start managers" (123 ms),stage="Configure binary metadata" (4 ms),stage="Start processors" (26 ms),stage="Start 'StanByClusterTestProvider' plugin" (0 ms),stage="Start 'PageMemory tracker plugin' plugin" (0 ms),stage="Start 'TestDistibutedConfigurationPlugin' plugin" (0 ms),stage="Start 'NodeValidationPluginProvider' plugin" (0 ms),stage="Init metastore" (9 ms),stage="Finish recovery" (0 ms),stage="Join topology" (268 ms),stage="Await transition" (4 ms),stage="Await exchange" (650 ms),stage="Total time" (1084 ms)] [21:00:44] : [Step 4/5] [2021-11-19 21:00:44,500][INFO ][test-runner-#1%failure.IoomFailureHandlerTest%][root] Node started with the following configuration [id=2008e1bd-d6b9-41ed-88ed-0e1656700001, marshaller=BinaryMarshaller [], discovery=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=5000, ackTimeout=5000, marsh=JdkMarshaller [clsFilter=org.apache.ignite.marshaller.MarshallerUtils$1@904d056], reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], binaryCfg=null, lateAff=true] [21:00:44]W: [org.apache.ignite:ignite-core] [2021-11-19 21:00:44,543][WARN ][test-runner-#1%failure.IoomFailureHandlerTest%][root] Waiting for topology map update [igniteInstanceName=failure.IoomFailureHandlerTest0, cache=default, cacheId=1544803905, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=0], p=1, affNodesCnt=1, ownersCnt=1, affNodes=[2008e1bd-d6b9-41ed-88ed-0e1656700001], owners=[b0b77bfd-fcbd-47c8-9b37-1d00f0a00000], topFut=GridDhtPartitionsExchangeFuture [firstDiscoEvt=DiscoveryEvent [evtNode=TcpDiscoveryNode [id=2008e1bd-d6b9-41ed-88ed-0e1656700001, consistentId=127.0.0.1:47501, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637344843631, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], topVer=2, msgTemplate=null, span=o.a.i.i.processors.tracing.NoopSpan@61742ff0, nodeId8=b0b77bfd, msg=Node joined, type=NODE_JOINED, tstamp=1637344843809], crd=TcpDiscoveryNode [id=b0b77bfd-fcbd-47c8-9b37-1d00f0a00000, consistentId=127.0.0.1:47500, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637344844431, loc=true, ver=2.13.0#20211119-sha1:00000000, isClient=false], exchId=GridDhtPartitionExchangeId [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=0], discoEvt=DiscoveryEvent [evtNode=TcpDiscoveryNode [id=2008e1bd-d6b9-41ed-88ed-0e1656700001, consistentId=127.0.0.1:47501, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637344843631, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], topVer=2, msgTemplate=null, span=o.a.i.i.processors.tracing.NoopSpan@61742ff0, nodeId8=b0b77bfd, msg=Node joined, type=NODE_JOINED, tstamp=1637344843809], nodeId=2008e1bd, evt=NODE_JOINED], added=true, exchangeType=ALL, initFut=GridFutureAdapter [ignoreInterrupts=false, state=DONE, res=true, hash=2090840150], init=true, lastVer=GridCacheVersion [topVer=0, order=1637344843535, nodeOrder=0], partReleaseFut=PartitionReleaseFuture [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=0], futures=[ExplicitLockReleaseFuture [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=0], futures=[]], AtomicUpdateReleaseFuture [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=0], futures=[]], DataStreamerReleaseFuture [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=0], futures=[]], LocalTxReleaseFuture [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=0], futures=[]], AllTxReleaseFuture [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=0], futures=[RemoteTxReleaseFuture [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=0], futures=[]]]]]], exchActions=ExchangeActions [startCaches=null, stopCaches=null, startGrps=[], stopGrps=[], resetParts=null, stateChangeRequest=StateChangeRequest [msg=ChangeGlobalStateMessage [id=e409b593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqId=e5c2f34e-2311-4bf5-bf84-bb58d83e2864, initiatingNodeId=b0b77bfd-fcbd-47c8-9b37-1d00f0a00000, state=ACTIVE, baselineTopology=BaselineTopology [id=0, branchingHash=-2222647637, branchingType='New BaselineTopology', baselineNodes=[127.0.0.1:47501, 127.0.0.1:47500]], forceChangeBaselineTopology=true, timestamp=1637344843812, forceDeactivation=true], prevBltHistItem=o.a.i.i.processors.cluster.BaselineTopologyHistoryItem@49f4c8f9, prevState=ACTIVE, topVer=null]], secCtx=null, affChangeMsg=null, centralizedAff=false, forceAffReassignment=false, exchangeLocE=null, cacheChangeFailureMsgSent=false, done=true, state=DONE, registerCachesFuture=GridFinishedFuture [resFlag=2], startTime=1637344843812, initTime=1637344843813, rebalanced=false, affinityReassign=false, span=o.a.i.i.processors.tracing.NoopSpan@61742ff0, evtLatch=0, remaining=HashSet [], mergedJoinExchMsgs=null, awaitMergedMsgs=0, super=GridFutureAdapter [ignoreInterrupts=false, state=DONE, res=AffinityTopologyVersion [topVer=2, minorTopVer=0], hash=1623449457]], locNode=TcpDiscoveryNode [id=b0b77bfd-fcbd-47c8-9b37-1d00f0a00000, consistentId=127.0.0.1:47500, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637344844431, loc=true, ver=2.13.0#20211119-sha1:00000000, isClient=false]] [21:00:44] : [Step 4/5] [2021-11-19 21:00:44,561][INFO ][sys-#247%failure.IoomFailureHandlerTest1%][GridDhtPartitionDemander] Starting rebalance routine [default, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=0], supplier=b0b77bfd-fcbd-47c8-9b37-1d00f0a00000, fullPartitions=[1, 4-8, 12, 14-17, 21, 23-24, 26-28, 30-31, 33-37, 39-41, 43, 45-47, 49-50, 54-56, 58-64, 66-68, 70-71, 73-74, 76, 78, 80, 83-86, 88, 91-94, 99, 102, 105, 107-111, 113, 115, 117-120, 124, 126, 129-130, 134-135, 137-143, 145-149, 153-155, 159, 161, 163, 166-167, 170-173, 177, 179, 181, 183, 187, 192, 194-197, 202, 205-208, 212-220, 222, 224, 227, 230, 233, 235, 237-238, 240-242, 246-247, 249-250, 252-255, 258, 261, 265-267, 269, 274-275, 277, 279-280, 284, 290-291, 293, 295, 297, 300, 302, 304, 307, 310-311, 314-315, 317, 320, 323, 325-333, 342, 344, 350-351, 354, 357, 359, 362-363, 366, 368-369, 373-374, 377-383, 385-387, 389-393, 395, 399, 403-404, 407, 412, 415, 417-418, 422-423, 425, 428, 430-432, 435-436, 441-444, 447, 454, 459-460, 462, 465, 468-469, 471, 474, 478-479, 481, 483-484, 489, 491, 493-494, 500, 506, 509-510, 514-517, 520, 522, 525-528, 532, 535, 537, 539, 541, 543, 547, 549, 552-554, 557-560, 564-565, 570-572, 574, 582-584, 591-593, 597-600, 602-610, 614, 616-622, 624, 627-628, 630, 633-635, 637, 640, 645, 648-650, 654, 656, 662, 674, 677, 679-682, 686-689, 691, 693, 696, 702-704, 706-709, 714, 716-719, 723-725, 728-729, 731, 733-736, 738, 740-743, 746-747, 750-752, 754, 756-757, 759-761, 763, 765-771, 773, 775, 777-779, 784, 786-788, 790-791, 795-797, 801-805, 807, 809, 811-815, 817, 820, 822, 827, 829-830, 832, 834-835, 840, 843, 845, 849, 851, 853, 855-856, 858-863, 865-866, 868, 872, 874-877, 879-881, 883, 885, 892, 894-895, 897, 899, 901, 904, 906, 908-909, 911-912, 914-916, 920-921, 925, 929-933, 936-944, 947, 951-952, 954, 957-959, 961-962, 966-969, 972, 980-984, 987, 991, 993, 995, 997-998, 1002, 1004-1005, 1008-1009, 1012-1015, 1017, 1020, 1022], histPartitions=[], rebalanceId=1] [21:00:44] : [Step 4/5] [2021-11-19 21:00:44,588][INFO ][rebalance-striped-#243%failure.IoomFailureHandlerTest0%][GridDhtPartitionSupplier] Finished supplying rebalancing [grp=default, demander=2008e1bd-d6b9-41ed-88ed-0e1656700001, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=0]] [21:00:44] : [Step 4/5] [2021-11-19 21:00:44,637][INFO ][rebalance-#237%failure.IoomFailureHandlerTest1%][GridDhtPartitionDemander] Completed (final) rebalancing [rebalanceId=1, grp=default, supplier=b0b77bfd-fcbd-47c8-9b37-1d00f0a00000, partitions=524, entries=0, duration=196ms, bytesRcvd=0.0 B, bandwidth=0.0 B/sec, histPartitions=0, histEntries=0, histBytesRcvd=0.0 B, fullPartitions=524, fullEntries=0, fullBytesRcvd=0.0 B, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=0], progress=1/1] [21:00:44] : [Step 4/5] [2021-11-19 21:00:44,641][INFO ][rebalance-#237%failure.IoomFailureHandlerTest1%][GridDhtPartitionDemander] Completed rebalance future: RebalanceFuture [state=STARTED, grp=CacheGroupContext [grp=default], topVer=AffinityTopologyVersion [topVer=2, minorTopVer=0], rebalanceId=1, routines=1, receivedBytes=6288, receivedKeys=0, partitionsLeft=0, partitionsTotal=524, startTime=1637344844441, endTime=1637344844640, lastCancelledTime=-1, result=true] [21:00:44] : [Step 4/5] [2021-11-19 21:00:44,651][INFO ][rebalance-#237%failure.IoomFailureHandlerTest1%][GridDhtPartitionDemander] Completed rebalance chain: [rebalanceId=1, partitions=624, entries=0, duration=340ms, bytesRcvd=0.0 B] [21:00:44] : [Step 4/5] [2021-11-19 21:00:44,676][INFO ][exchange-worker-#91%failure.IoomFailureHandlerTest0%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], crd=true, evt=DISCOVERY_CUSTOM_EVT, evtNode=b0b77bfd-fcbd-47c8-9b37-1d00f0a00000, customEvt=CacheAffinityChangeMessage [id=7909b593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=0], exchId=null, partsMsg=null, exchangeNeeded=true], allowMerge=false, exchangeFreeSwitch=false] [21:00:44] : [Step 4/5] [2021-11-19 21:00:44,682][INFO ][exchange-worker-#208%failure.IoomFailureHandlerTest1%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], crd=false, evt=DISCOVERY_CUSTOM_EVT, evtNode=b0b77bfd-fcbd-47c8-9b37-1d00f0a00000, customEvt=CacheAffinityChangeMessage [id=7909b593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=0], exchId=null, partsMsg=null, exchangeNeeded=true], allowMerge=false, exchangeFreeSwitch=false] [21:00:44] : [Step 4/5] [2021-11-19 21:00:44,684][INFO ][exchange-worker-#91%failure.IoomFailureHandlerTest0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], waitTime=0ms, futInfo=NA, mode=DISTRIBUTED] [21:00:44] : [Step 4/5] [2021-11-19 21:00:44,690][INFO ][exchange-worker-#208%failure.IoomFailureHandlerTest1%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], waitTime=0ms, futInfo=NA, mode=DISTRIBUTED] [21:00:44] : [Step 4/5] [2021-11-19 21:00:44,695][INFO ][exchange-worker-#91%failure.IoomFailureHandlerTest0%][GridDhtPartitionsExchangeFuture] Finished waiting for partitions release latch: ServerLatch [permits=0, pendingAcks=HashSet [], super=CompletableLatch [id=CompletableLatchUid [id=exchange, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]]]] [21:00:44] : [Step 4/5] [2021-11-19 21:00:44,696][INFO ][exchange-worker-#91%failure.IoomFailureHandlerTest0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:00:44] : [Step 4/5] [2021-11-19 21:00:44,701][INFO ][exchange-worker-#91%failure.IoomFailureHandlerTest0%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], crd=true] [21:00:44] : [Step 4/5] [2021-11-19 21:00:44,703][INFO ][exchange-worker-#208%failure.IoomFailureHandlerTest1%][GridDhtPartitionsExchangeFuture] Finished waiting for partitions release latch: ClientLatch [coordinator=TcpDiscoveryNode [id=b0b77bfd-fcbd-47c8-9b37-1d00f0a00000, consistentId=127.0.0.1:47500, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637344843777, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], ackSent=true, super=CompletableLatch [id=CompletableLatchUid [id=exchange, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]]]] [21:00:44] : [Step 4/5] [2021-11-19 21:00:44,704][INFO ][exchange-worker-#208%failure.IoomFailureHandlerTest1%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:00:44] : [Step 4/5] [2021-11-19 21:00:44,712][INFO ][exchange-worker-#208%failure.IoomFailureHandlerTest1%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], crd=false] [21:00:44] : [Step 4/5] [2021-11-19 21:00:44,714][INFO ][sys-#109%failure.IoomFailureHandlerTest0%][GridDhtPartitionsExchangeFuture] Coordinator received single message [ver=AffinityTopologyVersion [topVer=2, minorTopVer=1], node=2008e1bd-d6b9-41ed-88ed-0e1656700001, allReceived=true] [21:00:44] : [Step 4/5] [2021-11-19 21:00:44,716][INFO ][sys-#109%failure.IoomFailureHandlerTest0%][GridDhtPartitionsExchangeFuture] finishExchangeOnCoordinator [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:00:44] : [Step 4/5] [2021-11-19 21:00:44,732][INFO ][sys-#109%failure.IoomFailureHandlerTest0%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], err=null, rebalanced=true, wasRebalanced=false] [21:00:44] : [Step 4/5] [2021-11-19 21:00:44,739][INFO ][sys-#207%failure.IoomFailureHandlerTest1%][GridDhtPartitionsExchangeFuture] Received full message, will finish exchange [node=b0b77bfd-fcbd-47c8-9b37-1d00f0a00000, resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:00:44] : [Step 4/5] [2021-11-19 21:00:44,740][INFO ][sys-#109%failure.IoomFailureHandlerTest0%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=b0b77bfd-fcbd-47c8-9b37-1d00f0a00000, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=b0b77bfd-fcbd-47c8-9b37-1d00f0a00000, consistentId=127.0.0.1:47500, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637344844675, loc=true, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:00:44] : [Step 4/5] [2021-11-19 21:00:44,747][INFO ][sys-#207%failure.IoomFailureHandlerTest1%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], err=null, rebalanced=true, wasRebalanced=false] [21:00:44] : [Step 4/5] [2021-11-19 21:00:44,740][INFO ][exchange-worker-#91%failure.IoomFailureHandlerTest0%][PartitionsEvictManager] Eviction in progress [groups=1, remainingPartsToEvict=0] [21:00:44] : [Step 4/5] [2021-11-19 21:00:44,758][INFO ][exchange-worker-#91%failure.IoomFailureHandlerTest0%][PartitionsEvictManager] Group eviction in progress [grpName=default, grpId=1544803905, remainingPartsToEvict=1, partsEvictInProgress=0, totalParts=1024] [21:00:44] : [Step 4/5] [2021-11-19 21:00:44,759][INFO ][exchange-worker-#91%failure.IoomFailureHandlerTest0%][PartitionsEvictManager] Partitions have been scheduled for eviction: [grpId=1544803905, grpName=default, eviction=[1]] [21:00:44] : [Step 4/5] [2021-11-19 21:00:44,765][INFO ][sys-#109%failure.IoomFailureHandlerTest0%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (1 ms), stage="Determine exchange type" (5 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (1 ms), stage="Wait partitions release latch [latch=exchange]" (11 ms), stage="Wait partitions release [latch=exchange]" (1 ms), stage="After states restored callback" (3 ms), stage="WAL history reservation" (0 ms), stage="Waiting for all single messages" (15 ms), stage="Affinity recalculation (crd)" (0 ms), stage="Collect update counters and create affinity messages" (0 ms), stage="Validate partitions states" (2 ms), stage="Apply update counters" (1 ms), stage="Full message preparing" (10 ms), stage="Full message sending" (0 ms), stage="Exchange done" (32 ms), stage="Total time" (82 ms), Discovery lag=4 ms, Latest started node id=2008e1bd-d6b9-41ed-88ed-0e1656700001] [21:00:44] : [Step 4/5] [2021-11-19 21:00:44,817][INFO ][sys-#109%failure.IoomFailureHandlerTest0%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], stage="Affinity change by custom message [grp=default]" (5 ms) (parent=Determine exchange type), stage="Affinity change by custom message [grp=ignite-sys-cache]" (2 ms) (parent=Determine exchange type)] [21:00:44] : [Step 4/5] [2021-11-19 21:00:44,819][INFO ][sys-#207%failure.IoomFailureHandlerTest1%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=2008e1bd-d6b9-41ed-88ed-0e1656700001, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=b0b77bfd-fcbd-47c8-9b37-1d00f0a00000, consistentId=127.0.0.1:47500, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637344843777, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:00:44] : [Step 4/5] [2021-11-19 21:00:44,829][INFO ][exchange-worker-#208%failure.IoomFailureHandlerTest1%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=2, minorTopVer=1], force=false, evt=DISCOVERY_CUSTOM_EVT, node=b0b77bfd-fcbd-47c8-9b37-1d00f0a00000] [21:00:44] : [Step 4/5] [2021-11-19 21:00:44,846][INFO ][sys-#207%failure.IoomFailureHandlerTest1%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], stage="Waiting in exchange queue" (1 ms), stage="Exchange parameters initialization" (1 ms), stage="Determine exchange type" (6 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (1 ms), stage="Wait partitions release latch [latch=exchange]" (13 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="After states restored callback" (2 ms), stage="WAL history reservation" (0 ms), stage="Waiting for Full message" (30 ms), stage="Affinity recalculation" (0 ms), stage="Full map updating" (7 ms), stage="Exchange done" (90 ms), stage="Total time" (151 ms)] [21:00:44] : [Step 4/5] [2021-11-19 21:00:44,874][INFO ][sys-#207%failure.IoomFailureHandlerTest1%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], stage="Affinity change by custom message [grp=default]" (3 ms) (parent=Determine exchange type), stage="Affinity change by custom message [grp=ignite-sys-cache]" (2 ms) (parent=Determine exchange type)] [21:00:44]W: [org.apache.ignite:ignite-core] [2021-11-19 21:00:44,877][WARN ][test-runner-#1%failure.IoomFailureHandlerTest%][root] Finished waiting for topology map update [igniteInstanceName=failure.IoomFailureHandlerTest0, p=1, duration=325ms] [21:00:44] : [Step 4/5] [2021-11-19 21:00:44,888][INFO ][exchange-worker-#91%failure.IoomFailureHandlerTest0%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=2, minorTopVer=1], force=false, evt=DISCOVERY_CUSTOM_EVT, node=b0b77bfd-fcbd-47c8-9b37-1d00f0a00000] [21:00:45] : [Step 4/5] [2021-11-19 21:00:45,062][INFO ][test-runner-#1%failure.IoomFailureHandlerTest%][root] awaitPartitionMapExchange finished [21:00:45] : [Step 4/5] [2021-11-19 21:00:45,754][INFO ][test-runner-#1%failure.IoomFailureHandlerTest%][GridDeploymentLocalStore] Class locally deployed: class [B [21:00:52]W: [org.apache.ignite:ignite-core] [2021-11-19 21:00:52,793][ERROR][sys-stripe-22-#137%failure.IoomFailureHandlerTest1%][IgniteTestResources] Critical system error detected. Will be handled accordingly to configured handler [hnd=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]], failureCtx=FailureContext [type=CRITICAL_ERROR, err=class o.a.i.i.mem.IgniteOutOfMemoryException: Out of memory in data region [name=dfltPlc, initSize=10.0 MiB, maxSize=10.0 MiB, persistenceEnabled=false] Try the following: [21:00:52]W: [org.apache.ignite:ignite-core] ^-- Increase maximum off-heap memory size (DataRegionConfiguration.maxSize) [21:00:52]W: [org.apache.ignite:ignite-core] ^-- Enable Ignite persistence (DataRegionConfiguration.persistenceEnabled) [21:00:52]W: [org.apache.ignite:ignite-core] ^-- Enable eviction or expiration policies]] [21:00:52]W: [org.apache.ignite:ignite-core] class org.apache.ignite.internal.mem.IgniteOutOfMemoryException: Out of memory in data region [name=dfltPlc, initSize=10.0 MiB, maxSize=10.0 MiB, persistenceEnabled=false] Try the following: [21:00:52]W: [org.apache.ignite:ignite-core] ^-- Increase maximum off-heap memory size (DataRegionConfiguration.maxSize) [21:00:52]W: [org.apache.ignite:ignite-core] ^-- Enable Ignite persistence (DataRegionConfiguration.persistenceEnabled) [21:00:52]W: [org.apache.ignite:ignite-core] ^-- Enable eviction or expiration policies [21:00:52]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.IgniteCacheDatabaseSharedManager.ensureFreeSpaceForInsert(IgniteCacheDatabaseSharedManager.java:1234) [21:00:52]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.RowStore.addRow(RowStore.java:109) [21:00:52]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.IgniteCacheOffheapManagerImpl$CacheDataStoreImpl.mvccUpdate(IgniteCacheOffheapManagerImpl.java:2153) [21:00:52]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.IgniteCacheOffheapManagerImpl.mvccUpdate(IgniteCacheOffheapManagerImpl.java:538) [21:00:52]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.GridCacheMapEntry.mvccSet(GridCacheMapEntry.java:1130) [21:00:52]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.distributed.dht.GridDhtTxAbstractEnlistFuture.continueLoop(GridDhtTxAbstractEnlistFuture.java:462) [21:00:52]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.distributed.dht.GridDhtTxAbstractEnlistFuture.init(GridDhtTxAbstractEnlistFuture.java:364) [21:00:52]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.distributed.dht.GridDhtTransactionalCacheAdapter.processNearTxEnlistRequest(GridDhtTransactionalCacheAdapter.java:2086) [21:00:52]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.distributed.dht.GridDhtTransactionalCacheAdapter.access$900(GridDhtTransactionalCacheAdapter.java:115) [21:00:52]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.distributed.dht.GridDhtTransactionalCacheAdapter$14.apply(GridDhtTransactionalCacheAdapter.java:232) [21:00:52]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.distributed.dht.GridDhtTransactionalCacheAdapter$14.apply(GridDhtTransactionalCacheAdapter.java:230) [21:00:52]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.GridCacheIoManager.processMessage(GridCacheIoManager.java:1151) [21:00:52]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.GridCacheIoManager.onMessage0(GridCacheIoManager.java:592) [21:00:52]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.GridCacheIoManager.handleMessage(GridCacheIoManager.java:393) [21:00:52]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.GridCacheIoManager.handleMessage(GridCacheIoManager.java:319) [21:00:52]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.GridCacheIoManager.access$100(GridCacheIoManager.java:110) [21:00:52]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.GridCacheIoManager$1.onMessage(GridCacheIoManager.java:309) [21:00:52]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.managers.communication.GridIoManager.invokeListener(GridIoManager.java:1907) [21:00:52]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.managers.communication.GridIoManager.processRegularMessage0(GridIoManager.java:1528) [21:00:52]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.managers.communication.GridIoManager.access$5300(GridIoManager.java:242) [21:00:52]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.managers.communication.GridIoManager$9.execute(GridIoManager.java:1421) [21:00:52]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.managers.communication.TraceRunnable.run(TraceRunnable.java:55) [21:00:52]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.StripedExecutor$Stripe.body(StripedExecutor.java:569) [21:00:52]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:125) [21:00:52]W: [org.apache.ignite:ignite-core] at java.lang.Thread.run(Thread.java:748) [21:00:52]W: [org.apache.ignite:ignite-core] [2021-11-19 21:00:52,821][WARN ][sys-stripe-22-#137%failure.IoomFailureHandlerTest1%][CacheDiagnosticManager] Page locks dump: [21:00:52]W: [org.apache.ignite:ignite-core] [21:00:52]W: [org.apache.ignite:ignite-core] [21:00:52]W: [org.apache.ignite:ignite-core] [21:00:52]W: [org.apache.ignite:ignite-core] [21:00:52]W: [org.apache.ignite:ignite-core] [21:00:52]W: [org.apache.ignite:ignite-core] [21:00:52]W: [org.apache.ignite:ignite-core] [21:00:52]W: [org.apache.ignite:ignite-core] [21:00:52]W: [org.apache.ignite:ignite-core] [21:00:52]W: [org.apache.ignite:ignite-core] [21:00:52]W: [org.apache.ignite:ignite-core] [21:00:52]W: [org.apache.ignite:ignite-core] [21:00:52]W: [org.apache.ignite:ignite-core] [21:00:52]W: [org.apache.ignite:ignite-core] [21:00:52]W: [org.apache.ignite:ignite-core] [21:00:52]W: [org.apache.ignite:ignite-core] [21:00:52]W: [org.apache.ignite:ignite-core] [21:00:52]W: [org.apache.ignite:ignite-core] [21:00:52]W: [org.apache.ignite:ignite-core] [21:00:52]W: [org.apache.ignite:ignite-core] [21:00:52]W: [org.apache.ignite:ignite-core] [21:00:52]W: [org.apache.ignite:ignite-core] [21:00:52]W: [org.apache.ignite:ignite-core] [21:00:52]W: [org.apache.ignite:ignite-core] [21:00:52]W: [org.apache.ignite:ignite-core] [21:00:52]W: [org.apache.ignite:ignite-core] [21:00:52]W: [org.apache.ignite:ignite-core] [21:00:52]W: [org.apache.ignite:ignite-core] [21:00:52]W: [org.apache.ignite:ignite-core] [21:00:52]W: [org.apache.ignite:ignite-core] [21:00:52]W: [org.apache.ignite:ignite-core] [21:00:52]W: [org.apache.ignite:ignite-core] [21:00:52]W: [org.apache.ignite:ignite-core] [21:00:52]W: [org.apache.ignite:ignite-core] [21:00:52]W: [org.apache.ignite:ignite-core] [21:00:52]W: [org.apache.ignite:ignite-core] [21:00:52]W: [org.apache.ignite:ignite-core] [2021-11-19 21:00:52,822][ERROR][sys-stripe-22-#137%failure.IoomFailureHandlerTest1%][FailureProcessor] Ignite node is in invalid state due to a critical failure. [21:00:52] : [Step 4/5] [2021-11-19 21:00:52,833][INFO ][sys-stripe-16-#18%failure.IoomFailureHandlerTest0%][GridDeploymentLocalStore] Class locally deployed: class org.apache.ignite.IgniteCheckedException [21:00:52] : [Step 4/5] [2021-11-19 21:00:52,838][INFO ][sys-stripe-16-#18%failure.IoomFailureHandlerTest0%][GridDeploymentLocalStore] Class locally deployed: class org.apache.ignite.IgniteException [21:00:52] : [Step 4/5] [2021-11-19 21:00:52,838][INFO ][sys-stripe-16-#18%failure.IoomFailureHandlerTest0%][GridDeploymentLocalStore] Class locally deployed: class [Ljava.lang.StackTraceElement; [21:00:52] : [Step 4/5] [2021-11-19 21:00:52,888][INFO ][test-runner-#1%failure.IoomFailureHandlerTest%][root] >>> Stopping grid [name=failure.IoomFailureHandlerTest1, id=2008e1bd-d6b9-41ed-88ed-0e1656700001] [21:00:52] : [Step 4/5] [2021-11-19 21:00:52,930][INFO ][tcp-disco-sock-reader-[b0b77bfd 127.0.0.1:53801]-#12%failure.IoomFailureHandlerTest1%-#203%failure.IoomFailureHandlerTest1%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:53801, rmtPort=53801, rmtNodeId=b0b77bfd-fcbd-47c8-9b37-1d00f0a00000] [21:00:52] : [Step 4/5] [2021-11-19 21:00:52,937][INFO ][disco-notifier-worker-#85%failure.IoomFailureHandlerTest0%][GridClusterStateProcessor] Received activate cluster request with BaselineTopology[id=0] initiator node ID: 2008e1bd-d6b9-41ed-88ed-0e1656700001 [21:00:52] : [Step 4/5] [2021-11-19 21:00:52,937][INFO ][disco-notifier-worker-#85%failure.IoomFailureHandlerTest0%][GridClusterStateProcessor] Started state transition: activate cluster [21:00:52] : [Step 4/5] [2021-11-19 21:00:52,938][INFO ][disco-notifier-worker-#85%failure.IoomFailureHandlerTest0%][GridClusterStateProcessor] Received state change finish message: ACTIVE [21:00:52] : [Step 4/5] [2021-11-19 21:00:52,938][INFO ][disco-notifier-worker-#85%failure.IoomFailureHandlerTest0%][GridClusterStateProcessor] Cluster state was changed from ACTIVE to ACTIVE [21:00:52] : [Step 4/5] [2021-11-19 21:00:52,939][INFO ][test-runner-#1%failure.IoomFailureHandlerTest%][GridCacheProcessor] Stopped cache [cacheName=default] [21:00:52] : [Step 4/5] [2021-11-19 21:00:52,939][INFO ][disco-event-worker-#89%failure.IoomFailureHandlerTest0%][GridDiscoveryManager] Node left topology: TcpDiscoveryNode [id=2008e1bd-d6b9-41ed-88ed-0e1656700001, consistentId=127.0.0.1:47501, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637344843631, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false] [21:00:52] : [Step 4/5] [2021-11-19 21:00:52,941][INFO ][test-runner-#1%failure.IoomFailureHandlerTest%][GridCacheProcessor] Stopped cache [cacheName=ignite-sys-cache] [21:00:52] : [Step 4/5] [2021-11-19 21:00:52,941][INFO ][disco-event-worker-#89%failure.IoomFailureHandlerTest0%][GridDiscoveryManager] Topology snapshot [ver=3, locNode=b0b77bfd, servers=1, clients=0, state=ACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=b0b77bfd-fcbd-47c8-9b37-1d00f0a00000, consistentId=127.0.0.1:47500, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:00:52] : [Step 4/5] [2021-11-19 21:00:52,942][INFO ][disco-event-worker-#89%failure.IoomFailureHandlerTest0%][GridDiscoveryManager] ^-- Baseline [id=0, size=1, online=1, offline=0] [21:00:52]W: [org.apache.ignite:ignite-core] [2021-11-19 21:00:52,950][WARN ][grid-nio-worker-tcp-comm-0-#56%TcpCommunicationSpi%][TcpCommunicationSpi] Failed to shutdown socket [21:00:52]W: [org.apache.ignite:ignite-core] java.nio.channels.ClosedChannelException [21:00:52]W: [org.apache.ignite:ignite-core] at sun.nio.ch.SocketChannelImpl.shutdownOutput(SocketChannelImpl.java:795) [21:00:52]W: [org.apache.ignite:ignite-core] at sun.nio.ch.SocketAdaptor.shutdownOutput(SocketAdaptor.java:407) [21:00:52]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.close(IgniteUtils.java:4247) [21:00:52]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.closeKey(GridNioServer.java:2784) [21:00:52]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.close(GridNioServer.java:2835) [21:00:52]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.close(GridNioServer.java:2794) [21:00:52]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.bodyInternal(GridNioServer.java:2157) [21:00:52]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.body(GridNioServer.java:1910) [21:00:52]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:125) [21:00:52]W: [org.apache.ignite:ignite-core] at java.lang.Thread.run(Thread.java:748) [21:00:53] : [Step 4/5] [2021-11-19 21:00:52,999][INFO ][exchange-worker-#91%failure.IoomFailureHandlerTest0%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], crd=true, evt=NODE_LEFT, evtNode=2008e1bd-d6b9-41ed-88ed-0e1656700001, customEvt=null, allowMerge=true, exchangeFreeSwitch=false] [21:00:53] : [Step 4/5] [2021-11-19 21:00:53,001][INFO ][exchange-worker-#91%failure.IoomFailureHandlerTest0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], waitTime=0ms, futInfo=NA, mode=DISTRIBUTED] [21:00:53] : [Step 4/5] [2021-11-19 21:00:53,002][INFO ][exchange-worker-#91%failure.IoomFailureHandlerTest0%][GridDhtPartitionsExchangeFuture] Finished waiting for partitions release latch: ServerLatch [permits=0, pendingAcks=HashSet [], super=CompletableLatch [id=CompletableLatchUid [id=exchange, topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0]]]] [21:00:53] : [Step 4/5] [2021-11-19 21:00:53,004][INFO ][exchange-worker-#91%failure.IoomFailureHandlerTest0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:00:53] : [Step 4/5] [2021-11-19 21:00:53,025][INFO ][exchange-worker-#91%failure.IoomFailureHandlerTest0%][GridDhtPartitionsExchangeFuture] Coordinator received all messages, try merge [ver=AffinityTopologyVersion [topVer=3, minorTopVer=0]] [21:00:53] : [Step 4/5] [2021-11-19 21:00:53,025][INFO ][exchange-worker-#91%failure.IoomFailureHandlerTest0%][GridDhtPartitionsExchangeFuture] finishExchangeOnCoordinator [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=0]] [21:00:53] : [Step 4/5] [2021-11-19 21:00:53,081][INFO ][test-runner-#1%failure.IoomFailureHandlerTest%][GridDeploymentLocalStore] Removed undeployed class: GridDeployment [ts=1637344844149, depMode=SHARED, clsLdr=IsolatedClassLoader{roleName='test'}, clsLdrId=d709b593d71-2008e1bd-d6b9-41ed-88ed-0e1656700001, userVer=0, loc=true, sampleClsName=org.apache.ignite.internal.processors.cache.distributed.dht.preloader.GridDhtPartitionFullMap, pendingUndeploy=false, undeployed=true, usage=0] [21:00:53] : [Step 4/5] [2021-11-19 21:00:53,172][INFO ][test-runner-#1%failure.IoomFailureHandlerTest%][IoomFailureHandlerTest1] [21:00:53] : [Step 4/5] [21:00:53] : [Step 4/5] >>> +------------------------------------------------------+ [21:00:53] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV stopped OK [21:00:53] : [Step 4/5] >>> +------------------------------------------------------+ [21:00:53] : [Step 4/5] >>> Ignite instance name: failure.IoomFailureHandlerTest1 [21:00:53] : [Step 4/5] >>> Grid uptime: 00:00:08.679 [21:00:53] : [Step 4/5] [21:00:53] : [Step 4/5] [21:00:53] : [Step 4/5] [2021-11-19 21:00:53,173][INFO ][test-runner-#1%failure.IoomFailureHandlerTest%][root] Topology version mismatch [node=failure.IoomFailureHandlerTest0, exchVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0]] [21:00:53] : [Step 4/5] [2021-11-19 21:00:53,199][INFO ][exchange-worker-#91%failure.IoomFailureHandlerTest0%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], err=null, rebalanced=true, wasRebalanced=true] [21:00:53] : [Step 4/5] [2021-11-19 21:00:53,214][INFO ][exchange-worker-#91%failure.IoomFailureHandlerTest0%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=b0b77bfd-fcbd-47c8-9b37-1d00f0a00000, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], evt=NODE_LEFT, evtNode=TcpDiscoveryNode [id=2008e1bd-d6b9-41ed-88ed-0e1656700001, consistentId=127.0.0.1:47501, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637344843631, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0]] [21:00:53] : [Step 4/5] [2021-11-19 21:00:53,216][INFO ][exchange-worker-#91%failure.IoomFailureHandlerTest0%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (0 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Wait partitions release latch [latch=exchange]" (2 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="After states restored callback" (0 ms), stage="WAL history reservation" (0 ms), stage="Finalize update counters" (19 ms), stage="Waiting for all single messages" (0 ms), stage="Exchanges merge" (0 ms), stage="Affinity recalculation (crd)" (166 ms), stage="Collect update counters and create affinity messages" (0 ms), stage="Assign partitions states" (0 ms), stage="Validate partitions states" (1 ms), stage="Apply update counters" (0 ms), stage="Full message preparing" (4 ms), stage="Full message sending" (0 ms), stage="State finish message sending" (0 ms), stage="Detect lost partitions" (11 ms), stage="Exchange done" (6 ms), stage="Total time" (209 ms)] [21:00:53] : [Step 4/5] [2021-11-19 21:00:53,219][INFO ][exchange-worker-#91%failure.IoomFailureHandlerTest0%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], stage="Affinity recalculation (partitions availability) [grp=default]" (30 ms) (parent=Affinity recalculation (crd)), stage="Affinity recalculation (partitions availability) [grp=ignite-sys-cache]" (12 ms) (parent=Affinity recalculation (crd)), stage="Affinity initialization (enforced) [grp=default]" (5 ms) (parent=Affinity recalculation (crd))] [21:00:53] : [Step 4/5] [2021-11-19 21:00:53,221][INFO ][exchange-worker-#91%failure.IoomFailureHandlerTest0%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], crd=true] [21:00:53] : [Step 4/5] [2021-11-19 21:00:53,226][INFO ][exchange-worker-#91%failure.IoomFailureHandlerTest0%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=3, minorTopVer=0], force=false, evt=NODE_LEFT, node=2008e1bd-d6b9-41ed-88ed-0e1656700001] [21:00:53] : [Step 4/5] [2021-11-19 21:00:53,375][INFO ][test-runner-#1%failure.IoomFailureHandlerTest%][root] >>> Stopping grid [name=failure.IoomFailureHandlerTest0, id=b0b77bfd-fcbd-47c8-9b37-1d00f0a00000] [21:00:53] : [Step 4/5] [2021-11-19 21:00:53,395][INFO ][tcp-disco-sock-reader-[2008e1bd 127.0.0.1:44413]-#13%failure.IoomFailureHandlerTest0%-#204%failure.IoomFailureHandlerTest0%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:44413, rmtPort=44413, rmtNodeId=2008e1bd-d6b9-41ed-88ed-0e1656700001] [21:00:53] : [Step 4/5] [2021-11-19 21:00:53,398][INFO ][test-runner-#1%failure.IoomFailureHandlerTest%][GridCacheProcessor] Stopped cache [cacheName=default] [21:00:53] : [Step 4/5] [2021-11-19 21:00:53,400][INFO ][test-runner-#1%failure.IoomFailureHandlerTest%][GridCacheProcessor] Stopped cache [cacheName=ignite-sys-cache] [21:00:53] : [Step 4/5] [2021-11-19 21:00:53,422][INFO ][test-runner-#1%failure.IoomFailureHandlerTest%][GridDeploymentLocalStore] Removed undeployed class: GridDeployment [ts=1637344844003, depMode=SHARED, clsLdr=IsolatedClassLoader{roleName='test'}, clsLdrId=c709b593d71-b0b77bfd-fcbd-47c8-9b37-1d00f0a00000, userVer=0, loc=true, sampleClsName=org.apache.ignite.internal.processors.cache.distributed.dht.preloader.GridDhtPartitionMap, pendingUndeploy=false, undeployed=true, usage=0] [21:00:53] : [Step 4/5] [2021-11-19 21:00:53,492][INFO ][test-runner-#1%failure.IoomFailureHandlerTest%][IoomFailureHandlerTest0] [21:00:53] : [Step 4/5] [21:00:53] : [Step 4/5] >>> +------------------------------------------------------+ [21:00:53] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV stopped OK [21:00:53] : [Step 4/5] >>> +------------------------------------------------------+ [21:00:53] : [Step 4/5] >>> Ignite instance name: failure.IoomFailureHandlerTest0 [21:00:53] : [Step 4/5] >>> Grid uptime: 00:00:10.115 [21:00:53] : [Step 4/5] [21:00:53] : [Step 4/5] [21:00:53] : [Step 4/5] [21:00:53] >>> Stopping test: IoomFailureHandlerTest#testIoomErrorMvccNoStoreHandling in 12925 ms <<< [21:00:53] : [Step 4/5] [2021-11-19 21:00:53,495][INFO ][main][root] >>> Stopping test: IoomFailureHandlerTest#testIoomErrorMvccNoStoreHandling in 12925 ms <<< [21:00:53] : [Step 4/5] [21:00:53] >>> Heap: 482 MB used / 1963 MB commited / 1963 MB max <<< [21:00:53] : [Step 4/5] [2021-11-19 21:00:53,495][INFO ][main][root] >>> Heap: 482 MB used / 1963 MB commited / 1963 MB max <<< [21:00:53] : [Step 4/5] [21:00:53] >>> Non-Heap: 90 MB used / 94 MB commited / 0 MB max <<< [21:00:53] : [Step 4/5] [2021-11-19 21:00:53,496][INFO ][main][root] >>> Non-Heap: 90 MB used / 94 MB commited / 0 MB max <<< [21:00:53] : [Step 4/5] [21:00:53] >>> Starting test: IoomFailureHandlerTest#testIoomErrorMvccPdsHandling <<< [21:00:53] : [Step 4/5] [2021-11-19 21:00:53,509][INFO ][main][root] >>> Starting test: IoomFailureHandlerTest#testIoomErrorMvccPdsHandling <<< [21:00:53] : [Step 4/5] [21:00:53] >>> Heap: 482 MB used / 1963 MB commited / 1963 MB max <<< [21:00:53] : [Step 4/5] [2021-11-19 21:00:53,510][INFO ][main][root] >>> Heap: 482 MB used / 1963 MB commited / 1963 MB max <<< [21:00:53] : [Step 4/5] [21:00:53] >>> Non-Heap: 90 MB used / 94 MB commited / 0 MB max <<< [21:00:53] : [Step 4/5] [2021-11-19 21:00:53,510][INFO ][main][root] >>> Non-Heap: 90 MB used / 94 MB commited / 0 MB max <<< [21:00:53]W: [org.apache.ignite:ignite-core] [2021-11-19 21:00:53,529][WARN ][test-runner-#258%failure.IoomFailureHandlerTest%][G] Ignite work directory is not provided, automatically resolved to: /opt/buildagent/work/7bc1c54bc719b67c/work [21:00:53]W: [org.apache.ignite:ignite-core] [2021-11-19 21:00:53,537][WARN ][test-runner-#258%failure.IoomFailureHandlerTest%][G] Consistent ID is not set, it is recommended to set consistent ID for production clusters (use IgniteConfiguration.setConsistentId property) [21:00:53] : [Step 4/5] [2021-11-19 21:00:53,543][INFO ][test-runner-#258%failure.IoomFailureHandlerTest%][IoomFailureHandlerTest0] [21:00:53] : [Step 4/5] [21:00:53] : [Step 4/5] >>> __________ ________________ [21:00:53] : [Step 4/5] >>> / _/ ___/ |/ / _/_ __/ __/ [21:00:53] : [Step 4/5] >>> _/ // (7 7 // / / / / _/ [21:00:53] : [Step 4/5] >>> /___/\___/_/|_/___/ /_/ /___/ [21:00:53] : [Step 4/5] >>> [21:00:53] : [Step 4/5] >>> ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:00:53] : [Step 4/5] >>> 2021 Copyright(C) Apache Software Foundation [21:00:53] : [Step 4/5] >>> [21:00:53] : [Step 4/5] >>> Ignite documentation: http://ignite.apache.org [21:00:53] : [Step 4/5] [21:00:53] : [Step 4/5] [2021-11-19 21:00:53,545][INFO ][test-runner-#258%failure.IoomFailureHandlerTest%][IoomFailureHandlerTest0] Config URL: n/a [21:00:53] : [Step 4/5] [2021-11-19 21:00:53,547][INFO ][test-runner-#258%failure.IoomFailureHandlerTest%][IoomFailureHandlerTest0] IgniteConfiguration [igniteInstanceName=failure.IoomFailureHandlerTest0, pubPoolSize=24, svcPoolSize=24, callbackPoolSize=24, stripedPoolSize=24, sysPoolSize=24, mgmtPoolSize=4, dataStreamerPoolSize=24, utilityCachePoolSize=24, utilityCacheKeepAliveTime=60000, p2pPoolSize=2, qryPoolSize=24, buildIdxPoolSize=4, igniteHome=/opt/buildagent/work/7bc1c54bc719b67c, igniteWorkDir=/opt/buildagent/work/7bc1c54bc719b67c/work, mbeanSrv=com.sun.jmx.mbeanserver.JmxMBeanServer@6fe85038, nodeId=a0102b3f-b99f-4ba5-b90d-322d78800000, marsh=BinaryMarshaller [], marshLocJobs=false, daemon=false, p2pEnabled=true, netTimeout=10000, netCompressionLevel=1, sndRetryDelay=1000, sndRetryCnt=3, metricsHistSize=10000, metricsUpdateFreq=1000, metricsExpTime=9223372036854775807, discoSpi=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=0, ackTimeout=0, marsh=null, reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], segPlc=STOP, segResolveAttempts=2, waitForSegOnStart=true, allResolversPassReq=true, segChkFreq=10000, commSpi=TcpCommunicationSpi [connectGate=org.apache.ignite.spi.communication.tcp.internal.ConnectGateway@747ebed7, ctxInitLatch=java.util.concurrent.CountDownLatch@29599e7a[Count = 1], stopping=false, clientPool=null, nioSrvWrapper=null, stateProvider=null], evtSpi=MemoryEventStorageSpi [expireAgeMs=9223372036854775807, expireCnt=10000, filter=null], colSpi=NoopCollisionSpi [], deploySpi=LocalDeploymentSpi [], indexingSpi=org.apache.ignite.spi.indexing.noop.NoopIndexingSpi@4e261c84, addrRslvr=null, encryptionSpi=org.apache.ignite.spi.encryption.noop.NoopEncryptionSpi@41c61431, tracingSpi=org.apache.ignite.spi.tracing.NoopTracingSpi@68bda8af, clientMode=false, rebalanceThreadPoolSize=4, rebalanceTimeout=10000, rebalanceBatchesPrefetchCnt=3, rebalanceThrottle=0, rebalanceBatchSize=524288, txCfg=TransactionConfiguration [txSerEnabled=false, dfltIsolation=REPEATABLE_READ, dfltConcurrency=PESSIMISTIC, dfltTxTimeout=0, txTimeoutOnPartitionMapExchange=0, deadlockTimeout=10000, pessimisticTxLogSize=0, pessimisticTxLogLinger=10000, tmLookupClsName=null, txManagerFactory=null, useJtaSync=false], cacheSanityCheckEnabled=true, discoStartupDelay=60000, deployMode=SHARED, p2pMissedCacheSize=100, locHost=127.0.0.1, timeSrvPortBase=31100, timeSrvPortRange=100, failureDetectionTimeout=30000, sysWorkerBlockedTimeout=null, clientFailureDetectionTimeout=10000, metricsLogFreq=0, connectorCfg=null, odbcCfg=null, warmupClos=null, atomicCfg=AtomicConfiguration [seqReserveSize=1000, cacheMode=PARTITIONED, backups=1, aff=null, grpName=null], classLdr=null, sslCtxFactory=null, platformCfg=null, binaryCfg=null, memCfg=null, pstCfg=null, dsCfg=DataStorageConfiguration [sysRegionInitSize=41943040, sysRegionMaxSize=104857600, pageSize=2048, concLvl=0, dfltDataRegConf=DataRegionConfiguration [name=dfltPlc, maxSize=10485760, initSize=10485760, swapPath=null, pageEvictionMode=DISABLED, pageReplacementMode=CLOCK, evictionThreshold=0.9, emptyPagesPoolSize=100, metricsEnabled=false, metricsSubIntervalCount=5, metricsRateTimeInterval=60000, persistenceEnabled=true, checkpointPageBufSize=0, lazyMemoryAllocation=true, warmUpCfg=null], dataRegions=null, storagePath=null, checkpointFreq=180000, lockWaitTime=10000, checkpointThreads=4, checkpointWriteOrder=SEQUENTIAL, walHistSize=20, maxWalArchiveSize=1073741824, walSegments=10, walSegmentSize=67108864, walPath=db/wal, walArchivePath=db/wal/archive, cdcWalPath=db/wal/cdc, cdcEnabled=false, metricsEnabled=false, walMode=LOG_ONLY, walTlbSize=131072, walBuffSize=0, walFlushFreq=2000, walFsyncDelay=1000, walRecordIterBuffSize=67108864, alwaysWriteFullPages=false, fileIOFactory=org.apache.ignite.internal.processors.cache.persistence.file.AsyncFileIOFactory@3d6e1f21, metricsSubIntervalCnt=5, metricsRateTimeInterval=60000, walAutoArchiveAfterInactivity=-1, walForceArchiveTimeout=-1, writeThrottlingEnabled=false, walCompactionEnabled=false, walCompactionLevel=1, checkpointReadLockTimeout=null, walPageCompression=DISABLED, walPageCompressionLevel=null, dfltWarmUpCfg=null, encCfg=org.apache.ignite.configuration.EncryptionConfiguration@73843132, defragmentationThreadPoolSize=4, minWalArchiveSize=-1], snapshotPath=snapshots, activeOnStart=true, activeOnStartPropSetFlag=false, autoActivation=true, autoActivationPropSetFlag=false, clusterStateOnStart=null, sqlConnCfg=null, cliConnCfg=ClientConnectorConfiguration [host=null, port=10800, portRange=100, sockSndBufSize=0, sockRcvBufSize=0, tcpNoDelay=true, maxOpenCursorsPerConn=128, threadPoolSize=24, selectorCnt=12, idleTimeout=0, handshakeTimeout=10000, jdbcEnabled=true, odbcEnabled=true, thinCliEnabled=true, sslEnabled=false, useIgniteSslCtxFactory=true, sslClientAuth=false, sslCtxFactory=null, thinCliCfg=ThinClientConfiguration [maxActiveTxPerConn=100, maxActiveComputeTasksPerConn=0]], mvccVacuumThreadCnt=2, mvccVacuumFreq=5000, authEnabled=false, failureHnd=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]], commFailureRslvr=null, sqlCfg=SqlConfiguration [longQryWarnTimeout=3000, dfltQryTimeout=0, sqlQryHistSize=1000, validationEnabled=false], asyncContinuationExecutor=null] [21:00:53] : [Step 4/5] [2021-11-19 21:00:53,559][INFO ][test-runner-#258%failure.IoomFailureHandlerTest%][IoomFailureHandlerTest0] Daemon mode: off [21:00:53] : [Step 4/5] [2021-11-19 21:00:53,560][INFO ][test-runner-#258%failure.IoomFailureHandlerTest%][IoomFailureHandlerTest0] OS: Linux 4.15.0-151-generic amd64 [21:00:53] : [Step 4/5] [2021-11-19 21:00:53,560][INFO ][test-runner-#258%failure.IoomFailureHandlerTest%][IoomFailureHandlerTest0] OS user: teamcity [21:00:53] : [Step 4/5] [2021-11-19 21:00:53,561][INFO ][test-runner-#258%failure.IoomFailureHandlerTest%][IoomFailureHandlerTest0] PID: 16724 [21:00:53] : [Step 4/5] [2021-11-19 21:00:53,561][INFO ][test-runner-#258%failure.IoomFailureHandlerTest%][IoomFailureHandlerTest0] Language runtime: Java Platform API Specification ver. 1.8 [21:00:53] : [Step 4/5] [2021-11-19 21:00:53,562][INFO ][test-runner-#258%failure.IoomFailureHandlerTest%][IoomFailureHandlerTest0] VM information: Java(TM) SE Runtime Environment 1.8.0_261-b12 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 25.261-b12 [21:00:53] : [Step 4/5] [2021-11-19 21:00:53,562][INFO ][test-runner-#258%failure.IoomFailureHandlerTest%][IoomFailureHandlerTest0] VM total memory: 1.9GB [21:00:53] : [Step 4/5] [2021-11-19 21:00:53,563][INFO ][test-runner-#258%failure.IoomFailureHandlerTest%][IoomFailureHandlerTest0] Remote Management [restart: off, REST: off, JMX (remote: off)] [21:00:53] : [Step 4/5] [2021-11-19 21:00:53,563][INFO ][test-runner-#258%failure.IoomFailureHandlerTest%][IoomFailureHandlerTest0] Logger: GridTestLog4jLogger [quiet=false, config=null] [21:00:53] : [Step 4/5] [2021-11-19 21:00:53,563][INFO ][test-runner-#258%failure.IoomFailureHandlerTest%][IoomFailureHandlerTest0] IGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c [21:00:53] : [Step 4/5] [2021-11-19 21:00:53,564][INFO ][test-runner-#258%failure.IoomFailureHandlerTest%][IoomFailureHandlerTest0] VM arguments: [-DIGNITE_DUMP_THREADS_ON_FAILURE=false, -DMono=/usr/bin/mono-sgen, -DMono4.0_x64=/usr/lib/mono/4.0, -DMono4.5_x64=/usr/lib/mono/4.5, -DMonoVersion=6.12.0.90, -DSKIP_BUILD=false, -Dagent.home.dir=/opt/buildagent, -Dagent.name=aitc-lin02_03, -Dagent.ownPort=9090, -Dagent.work.dir=/opt/buildagent/work, -Dbuild.number=95, -Dbuild.vcs.number=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.1=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.GitHubApacheIgnite=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dclassworlds.conf=/opt/buildagent/temp/buildTmp/teamcity.m2.conf, -Dcom.jetbrains.maven.watcher.report.file=/opt/buildagent/temp/buildTmp/maven-build-info.xml, -Djava.io.tmpdir=/opt/buildagent/temp/buildTmp, -Dmaven.home=/opt/buildagent/tools/maven3_6, -Dmaven.multiModuleProjectDirectory=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.agent.cpuBenchmark=457, -Dteamcity.agent.dotnet.agent_url=http://localhost:9090/RPC2, -Dteamcity.agent.dotnet.build_id=6278078, -Dteamcity.auth.password=*******, -Dteamcity.auth.userId=TeamCityBuildId=6278078, -Dteamcity.build.changedFiles.file=/opt/buildagent/temp/buildTmp/changedFiles6342607772318147725.txt, -Dteamcity.build.checkoutDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.build.id=6278078, -Dteamcity.build.properties.file=/opt/buildagent/temp/buildTmp/teamcity.build5164517880467851002.properties, -Dteamcity.build.tempDir=/opt/buildagent/temp/buildTmp, -Dteamcity.build.workingDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.buildConfName=Basic 3, -Dteamcity.buildType.id=IgniteTests24Java8_Basic3, -Dteamcity.configuration.properties.file=/opt/buildagent/temp/buildTmp/teamcity.config5591980786735343870.properties, -Dteamcity.maven.userSettings.path=/opt/buildagent/temp/buildTmp/maven_settings_585072866407032347.xml, -Dteamcity.maven.watcher.home=/opt/buildagent/plugins/mavenPlugin/maven-watcher-jdk16, -Dteamcity.projectName=Ignite Tests 2.x (JDK 8/11), -Dteamcity.runner.properties.file=/opt/buildagent/temp/buildTmp/teamcity.runner9098465561618137420.properties, -Dteamcity.tests.recentlyFailedTests.file=/opt/buildagent/temp/buildTmp/testsToRunFirst3891775683130404069.txt, -Dteamcity.version=2021.2 (build 99542), -ea, -Xms2g, -Xmx2g, -XX:+HeapDumpOnOutOfMemoryError, -DIGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_TEST_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_UPDATE_NOTIFIER=false, -DIGNITE_NO_DISCO_ORDER=true, -DIGNITE_PERFORMANCE_SUGGESTIONS_DISABLED=true, -Djava.net.preferIPv4Stack=true, -DTEST_SCALE_FACTOR=1.0, -DIGNITE_TEST_PROP_LOG4J_FILE=log4j-tc-test.xml, -DIGNITE_QUIET=false, -DIGNITE_MARSHAL_BUFFERS_RECHECK=1000, -Dmaven.repo.local=/opt/buildagent/.m2/repository] [21:00:53] : [Step 4/5] [2021-11-19 21:00:53,569][INFO ][test-runner-#258%failure.IoomFailureHandlerTest%][IoomFailureHandlerTest0] System cache's DataRegion size is configured to 40 MB. Use DataStorageConfiguration.systemRegionInitialSize property to change the setting. [21:00:53]W: [org.apache.ignite:ignite-core] [2021-11-19 21:00:53,570][WARN ][test-runner-#258%failure.IoomFailureHandlerTest%][IoomFailureHandlerTest0] Peer class loading is enabled (disable it in production for performance and deployment consistency reasons) [21:00:53] : [Step 4/5] [2021-11-19 21:00:53,569][INFO ][test-runner-#258%failure.IoomFailureHandlerTest%][IoomFailureHandlerTest0] Configured caches [in 'sysMemPlc' dataRegion: ['ignite-sys-cache'], in 'dfltPlc' dataRegion: ['default']] [21:00:53] : [Step 4/5] [2021-11-19 21:00:53,570][INFO ][test-runner-#258%failure.IoomFailureHandlerTest%][IoomFailureHandlerTest0] 3-rd party licenses can be found at: /opt/buildagent/work/7bc1c54bc719b67c/libs/licenses [21:00:53] : [Step 4/5] [2021-11-19 21:00:53,579][INFO ][test-runner-#258%failure.IoomFailureHandlerTest%][IgnitePluginProcessor] Configured plugins: [21:00:53] : [Step 4/5] [2021-11-19 21:00:53,579][INFO ][test-runner-#258%failure.IoomFailureHandlerTest%][IgnitePluginProcessor] ^-- StanByClusterTestProvider 1.0 [21:00:53] : [Step 4/5] [2021-11-19 21:00:53,580][INFO ][test-runner-#258%failure.IoomFailureHandlerTest%][IgnitePluginProcessor] ^-- null [21:00:53] : [Step 4/5] [2021-11-19 21:00:53,580][INFO ][test-runner-#258%failure.IoomFailureHandlerTest%][IgnitePluginProcessor] [21:00:53] : [Step 4/5] [2021-11-19 21:00:53,580][INFO ][test-runner-#258%failure.IoomFailureHandlerTest%][IgnitePluginProcessor] ^-- PageMemory tracker plugin 1.0 [21:00:53] : [Step 4/5] [2021-11-19 21:00:53,581][INFO ][test-runner-#258%failure.IoomFailureHandlerTest%][IgnitePluginProcessor] ^-- null [21:00:53] : [Step 4/5] [2021-11-19 21:00:53,581][INFO ][test-runner-#258%failure.IoomFailureHandlerTest%][IgnitePluginProcessor] [21:00:53] : [Step 4/5] [2021-11-19 21:00:53,581][INFO ][test-runner-#258%failure.IoomFailureHandlerTest%][IgnitePluginProcessor] ^-- TestDistibutedConfigurationPlugin 1.0 [21:00:53] : [Step 4/5] [2021-11-19 21:00:53,582][INFO ][test-runner-#258%failure.IoomFailureHandlerTest%][IgnitePluginProcessor] ^-- null [21:00:53] : [Step 4/5] [2021-11-19 21:00:53,582][INFO ][test-runner-#258%failure.IoomFailureHandlerTest%][IgnitePluginProcessor] [21:00:53] : [Step 4/5] [2021-11-19 21:00:53,582][INFO ][test-runner-#258%failure.IoomFailureHandlerTest%][IgnitePluginProcessor] ^-- NodeValidationPluginProvider 1.0 [21:00:53] : [Step 4/5] [2021-11-19 21:00:53,582][INFO ][test-runner-#258%failure.IoomFailureHandlerTest%][IgnitePluginProcessor] ^-- null [21:00:53] : [Step 4/5] [2021-11-19 21:00:53,583][INFO ][test-runner-#258%failure.IoomFailureHandlerTest%][IgnitePluginProcessor] [21:00:53] : [Step 4/5] [2021-11-19 21:00:53,583][INFO ][test-runner-#258%failure.IoomFailureHandlerTest%][FailureProcessor] Configured failure handler: [hnd=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]] [21:00:53] : [Step 4/5] [2021-11-19 21:00:53,696][INFO ][test-runner-#258%failure.IoomFailureHandlerTest%][TcpCommunicationSpi] Successfully bound communication NIO server to TCP port [port=45010, locHost=/127.0.0.1, selectorsCnt=12, selectorSpins=0, pairedConn=false] [21:00:53]W: [org.apache.ignite:ignite-core] [2021-11-19 21:00:53,697][WARN ][test-runner-#258%failure.IoomFailureHandlerTest%][TcpCommunicationSpi] Message queue limit is set to 0 which may lead to potential OOMEs when running cache operations in FULL_ASYNC or PRIMARY_SYNC modes due to message queues growth on sender and receiver sides. [21:00:53] : [Step 4/5] [2021-11-19 21:00:53,761][INFO ][test-runner-#258%failure.IoomFailureHandlerTest%][GridCollisionManager] Collision resolution is disabled (all jobs will be activated upon arrival). [21:00:53] : [Step 4/5] [2021-11-19 21:00:53,761][INFO ][test-runner-#258%failure.IoomFailureHandlerTest%][IoomFailureHandlerTest0] Security status [authentication=off, sandbox=off, tls/ssl=off] [21:00:53] : [Step 4/5] [2021-11-19 21:00:53,765][INFO ][test-runner-#258%failure.IoomFailureHandlerTest%][TestTcpDiscoverySpi] Successfully bound to TCP port [port=47500, localHost=localhost/127.0.0.1, locNodeId=a0102b3f-b99f-4ba5-b90d-322d78800000] [21:00:53] : [Step 4/5] [2021-11-19 21:00:53,782][INFO ][test-runner-#258%failure.IoomFailureHandlerTest%][PdsFoldersResolver] Successfully created new persistent storage folder [/opt/buildagent/work/7bc1c54bc719b67c/work/db/node00-144ec592-3f61-4150-b22b-c2c554b8328c] [21:00:53] : [Step 4/5] [2021-11-19 21:00:53,783][INFO ][test-runner-#258%failure.IoomFailureHandlerTest%][PdsFoldersResolver] Consistent ID used for local node is [144ec592-3f61-4150-b22b-c2c554b8328c] according to persistence data storage folders [21:00:53] : [Step 4/5] [2021-11-19 21:00:53,783][INFO ][test-runner-#258%failure.IoomFailureHandlerTest%][MaintenanceProcessor] Resolved store directory for node persistent data: /opt/buildagent/work/7bc1c54bc719b67c/work/db/node00-144ec592-3f61-4150-b22b-c2c554b8328c [21:00:53] : [Step 4/5] [2021-11-19 21:00:53,796][INFO ][test-runner-#258%failure.IoomFailureHandlerTest%][CacheObjectBinaryProcessorImpl] Resolved directory for serialized binary metadata: /opt/buildagent/work/7bc1c54bc719b67c/work/db/binary_meta/node00-144ec592-3f61-4150-b22b-c2c554b8328c [21:00:53] : [Step 4/5] [2021-11-19 21:00:53,877][INFO ][test-runner-#258%failure.IoomFailureHandlerTest%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/node00-144ec592-3f61-4150-b22b-c2c554b8328c [21:00:53] : [Step 4/5] [2021-11-19 21:00:53,878][INFO ][test-runner-#258%failure.IoomFailureHandlerTest%][FileWriteAheadLogManager] Resolved write ahead log work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/node00-144ec592-3f61-4150-b22b-c2c554b8328c [21:00:53] : [Step 4/5] [2021-11-19 21:00:53,879][INFO ][test-runner-#258%failure.IoomFailureHandlerTest%][FileWriteAheadLogManager] Resolved write ahead log archive directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/node00-144ec592-3f61-4150-b22b-c2c554b8328c [21:00:54] : [Step 4/5] [2021-11-19 21:00:54,384][INFO ][test-runner-#258%failure.IoomFailureHandlerTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/node00-144ec592-3f61-4150-b22b-c2c554b8328c/0000000000000000.wal [21:00:54] : [Step 4/5] [2021-11-19 21:00:54,389][INFO ][test-runner-#258%failure.IoomFailureHandlerTest%][FileHandleManagerImpl] Initialized write-ahead log manager [mode=LOG_ONLY] [21:00:54] : [Step 4/5] [2021-11-19 21:00:54,429][INFO ][test-runner-#258%failure.IoomFailureHandlerTest%][GridCacheDatabaseSharedManager] Configured data regions initialized successfully [total=5] [21:00:54] : [Step 4/5] [2021-11-19 21:00:54,479][INFO ][test-runner-#258%failure.IoomFailureHandlerTest%][IgniteSnapshotManager] Resolved snapshot work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/snapshots [21:00:54] : [Step 4/5] [2021-11-19 21:00:54,479][INFO ][test-runner-#258%failure.IoomFailureHandlerTest%][IgniteSnapshotManager] Resolved temp directory for snapshot creation: /opt/buildagent/work/7bc1c54bc719b67c/work/db/node00-144ec592-3f61-4150-b22b-c2c554b8328c/snp [21:00:54] : [Step 4/5] [2021-11-19 21:00:54,490][INFO ][test-runner-#258%failure.IoomFailureHandlerTest%][ClientListenerProcessor] Client connector processor has started on TCP port 10800 [21:00:54] : [Step 4/5] [2021-11-19 21:00:54,527][INFO ][test-runner-#258%failure.IoomFailureHandlerTest%][IoomFailureHandlerTest0] Non-loopback local IPs: 172.17.0.4 [21:00:54] : [Step 4/5] [2021-11-19 21:00:54,528][INFO ][test-runner-#258%failure.IoomFailureHandlerTest%][IoomFailureHandlerTest0] Enabled local MACs: 0242AC110004 [21:00:54] : [Step 4/5] [2021-11-19 21:00:54,534][INFO ][test-runner-#258%failure.IoomFailureHandlerTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:00:54] : [Step 4/5] [2021-11-19 21:00:54,546][INFO ][test-runner-#258%failure.IoomFailureHandlerTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=48096, tableSize=3.8 MiB, replacementSize=6.0 KiB, checkpointBuffer=100.0 MiB] [21:00:54] : [Step 4/5] [2021-11-19 21:00:54,548][INFO ][test-runner-#258%failure.IoomFailureHandlerTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:00:55]W: [org.apache.ignite:ignite-core] [2021-11-19 21:00:55,109][WARN ][jvm-pause-detector-worker][IoomFailureHandlerTest0] Possible too long JVM pause: 509 milliseconds. [21:00:55] : [Step 4/5] [2021-11-19 21:00:55,160][INFO ][test-runner-#258%failure.IoomFailureHandlerTest%][GridCacheDatabaseSharedManager] Applying lost metastore updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:00:55] : [Step 4/5] [2021-11-19 21:00:55,169][INFO ][test-runner-#258%failure.IoomFailureHandlerTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=10 ms] [21:00:55] : [Step 4/5] [2021-11-19 21:00:55,170][INFO ][test-runner-#258%failure.IoomFailureHandlerTest%][GridCacheProcessor] Restoring partition state for local groups. [21:00:55] : [Step 4/5] [2021-11-19 21:00:55,172][INFO ][test-runner-#258%failure.IoomFailureHandlerTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=0, partitionsProcessed=0, time=10ms] [21:00:55] : [Step 4/5] [2021-11-19 21:00:55,176][INFO ][test-runner-#258%failure.IoomFailureHandlerTest%][GridEncryptionManager] Encryption keys loaded from metastore. [grps=, masterKeyName=null] [21:00:55] : [Step 4/5] [2021-11-19 21:00:55,204][INFO ][test-runner-#258%failure.IoomFailureHandlerTest%][ClusterProcessor] Cluster ID and tag has been read from metastorage: null [21:00:55] : [Step 4/5] [2021-11-19 21:00:55,205][INFO ][test-runner-#258%failure.IoomFailureHandlerTest%][IgniteClusterImpl] Shutdown policy was updated [oldVal=null, newVal=null] [21:00:55] : [Step 4/5] [2021-11-19 21:00:55,207][INFO ][test-runner-#258%failure.IoomFailureHandlerTest%][GridCacheDatabaseSharedManager] Checkpoint frequency deviation changed [oldVal=null, newVal=null] [21:00:55] : [Step 4/5] [2021-11-19 21:00:55,224][INFO ][test-runner-#258%failure.IoomFailureHandlerTest%][FilePageStoreManager] Cleanup cache stores [total=1, left=0, cleanFiles=false] [21:00:55] : [Step 4/5] [2021-11-19 21:00:55,266][INFO ][test-runner-#258%failure.IoomFailureHandlerTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=48096, tableSize=3.8 MiB, replacementSize=6.0 KiB, checkpointBuffer=100.0 MiB] [21:00:55] : [Step 4/5] [2021-11-19 21:00:55,270][INFO ][test-runner-#258%failure.IoomFailureHandlerTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=48096, tableSize=3.8 MiB, replacementSize=6.0 KiB, checkpointBuffer=100.0 MiB] [21:00:55] : [Step 4/5] [2021-11-19 21:00:55,276][INFO ][test-runner-#258%failure.IoomFailureHandlerTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=48096, tableSize=3.8 MiB, replacementSize=6.0 KiB, checkpointBuffer=100.0 MiB] [21:00:55] : [Step 4/5] [2021-11-19 21:00:55,277][INFO ][test-runner-#258%failure.IoomFailureHandlerTest%][GridCacheDatabaseSharedManager] Data Regions Started: 5 [21:00:55] : [Step 4/5] [2021-11-19 21:00:55,278][INFO ][test-runner-#258%failure.IoomFailureHandlerTest%][GridCacheDatabaseSharedManager] ^-- sysMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:00:55] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:00:55] : [Step 4/5] ^-- metastoreMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:00:55] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:00:55] : [Step 4/5] ^-- TxLog region [type=internal, persistence=true, lazyAlloc=false, [21:00:55] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:00:55] : [Step 4/5] ^-- dfltPlc region [type=default, persistence=true, lazyAlloc=true, [21:00:55] : [Step 4/5] ... initCfg=10MB, maxCfg=10MB, usedRam=0MB, freeRam=100%, allocRam=0MB, allocTotal=0MB] [21:00:55] : [Step 4/5] ^-- volatileDsMemPlc region [type=user, persistence=false, lazyAlloc=true, [21:00:55] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB] [21:00:55] : [Step 4/5] ^-- Ignite persistence [used=0MB] [21:00:55] : [Step 4/5] [21:00:55] : [Step 4/5] [2021-11-19 21:00:55,281][INFO ][test-runner-#258%failure.IoomFailureHandlerTest%][GridCacheDatabaseSharedManager] Starting binary memory restore for: [1544803905, -2100569601] [21:00:55] : [Step 4/5] [2021-11-19 21:00:55,460][INFO ][test-runner-#258%failure.IoomFailureHandlerTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:00:55] : [Step 4/5] [2021-11-19 21:00:55,460][INFO ][test-runner-#258%failure.IoomFailureHandlerTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:00:55] : [Step 4/5] [2021-11-19 21:00:55,469][INFO ][test-runner-#258%failure.IoomFailureHandlerTest%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/node00-144ec592-3f61-4150-b22b-c2c554b8328c/0000000000000000.wal, offset=0, ver=2] [21:00:55] : [Step 4/5] [2021-11-19 21:00:55,517][INFO ][test-runner-#258%failure.IoomFailureHandlerTest%][PageMemoryImpl] Started page memory [memoryAllocated=24.0 MiB, pages=11544, tableSize=937.7 KiB, replacementSize=1.5 KiB, checkpointBuffer=10.0 MiB] [21:00:55] : [Step 4/5] [2021-11-19 21:00:55,570][INFO ][test-runner-#258%failure.IoomFailureHandlerTest%][GridCacheProcessor] Started cache in recovery mode [name=default, id=1544803905, dataRegionName=dfltPlc, mode=PARTITIONED, atomicity=TRANSACTIONAL_SNAPSHOT, backups=0, mvcc=true] [21:00:55] : [Step 4/5] [2021-11-19 21:00:55,578][INFO ][test-runner-#258%failure.IoomFailureHandlerTest%][GridCacheProcessor] Started cache in recovery mode [name=ignite-sys-cache, id=-2100569601, dataRegionName=sysMemPlc, mode=REPLICATED, atomicity=TRANSACTIONAL, backups=2147483647, mvcc=false] [21:00:55] : [Step 4/5] [2021-11-19 21:00:55,589][INFO ][test-runner-#258%failure.IoomFailureHandlerTest%][GridCacheDatabaseSharedManager] Binary recovery performed in 308 ms. [21:00:55] : [Step 4/5] [2021-11-19 21:00:55,590][INFO ][test-runner-#258%failure.IoomFailureHandlerTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:00:55] : [Step 4/5] [2021-11-19 21:00:55,591][INFO ][test-runner-#258%failure.IoomFailureHandlerTest%][GridCacheDatabaseSharedManager] Applying lost cache updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:00:55] : [Step 4/5] [2021-11-19 21:00:55,684][INFO ][test-runner-#258%failure.IoomFailureHandlerTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=91 ms] [21:00:55] : [Step 4/5] [2021-11-19 21:00:55,684][INFO ][test-runner-#258%failure.IoomFailureHandlerTest%][GridCacheProcessor] Restoring partition state for local groups. [21:00:55] : [Step 4/5] [2021-11-19 21:00:55,781][INFO ][test-runner-#258%failure.IoomFailureHandlerTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=2, partitionsProcessed=1124, time=100ms] [21:00:55] : [Step 4/5] [2021-11-19 21:00:55,965][INFO ][disco-notifier-worker-#371%failure.IoomFailureHandlerTest0%][MvccProcessorImpl] Assigned mvcc coordinator [crd=MvccCoordinator [topVer=AffinityTopologyVersion [topVer=1, minorTopVer=0], nodeId=a0102b3f-b99f-4ba5-b90d-322d78800000, ver=1637344855957, local=true, initialized=false]] [21:00:55] : [Step 4/5] [2021-11-19 21:00:55,974][INFO ][sys-#361%failure.IoomFailureHandlerTest0%][ClusterProcessor] Writing cluster ID and tag to metastorage on ready for write ClusterIdAndTag [id=ab43e38f-7e05-40ce-95d8-260d959a3247, tag=peaceful_faraday] [21:00:55] : [Step 4/5] [2021-11-19 21:00:55,998][INFO ][disco-notifier-worker-#371%failure.IoomFailureHandlerTest0%][ClusterProcessor] peaceful_faraday [21:00:56] : [Step 4/5] [2021-11-19 21:00:56,002][INFO ][disco-notifier-worker-#371%failure.IoomFailureHandlerTest0%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustEnabled' was changed from 'null' to 'false' [21:00:56] : [Step 4/5] [2021-11-19 21:00:56,004][INFO ][disco-notifier-worker-#371%failure.IoomFailureHandlerTest0%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustTimeout' was changed from 'null' to '300000' [21:00:56] : [Step 4/5] [2021-11-19 21:00:56,005][INFO ][disco-notifier-worker-#371%failure.IoomFailureHandlerTest0%][IgniteTxManager] Transactions parameter 'longOperationsDumpTimeout' was changed from 'null' to '60000' [21:00:56] : [Step 4/5] [2021-11-19 21:00:56,007][INFO ][disco-notifier-worker-#371%failure.IoomFailureHandlerTest0%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpThreshold' was changed from 'null' to '0' [21:00:56] : [Step 4/5] [2021-11-19 21:00:56,008][INFO ][disco-notifier-worker-#371%failure.IoomFailureHandlerTest0%][IgniteTxManager] Transactions parameter 'transactionTimeDumpSamplesCoefficient' was changed from 'null' to '0.0' [21:00:56] : [Step 4/5] [2021-11-19 21:00:56,011][INFO ][disco-notifier-worker-#371%failure.IoomFailureHandlerTest0%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpSamplesPerSecondLimit' was changed from 'null' to '5' [21:00:56] : [Step 4/5] [2021-11-19 21:00:56,012][INFO ][disco-notifier-worker-#371%failure.IoomFailureHandlerTest0%][IgniteTxManager] Transactions parameter 'collisionsDumpInterval' was changed from 'null' to '1000' [21:00:56] : [Step 4/5] [2021-11-19 21:00:56,014][INFO ][disco-notifier-worker-#371%failure.IoomFailureHandlerTest0%][IgniteTxManager] Transactions parameter 'txOwnerDumpRequestsAllowed' was changed from 'null' to 'true' [21:00:56] : [Step 4/5] [2021-11-19 21:00:56,018][INFO ][disco-notifier-worker-#371%failure.IoomFailureHandlerTest0%][GridCacheDatabaseSharedManager] Historical rebalance WAL threshold changed [property=historical.rebalance.threshold, oldVal=null, newVal=500] [21:00:56] : [Step 4/5] [2021-11-19 21:00:56,058][INFO ][test-runner-#258%failure.IoomFailureHandlerTest%][IoomFailureHandlerTest0] To start Console Management & Monitoring run ignitevisorcmd.{sh|bat} [21:00:56] : [Step 4/5] [2021-11-19 21:00:56,059][INFO ][test-runner-#258%failure.IoomFailureHandlerTest%][IoomFailureHandlerTest0] [21:00:56] : [Step 4/5] [21:00:56] : [Step 4/5] >>> +-------------------------------------------+ [21:00:56] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:00:56] : [Step 4/5] >>> +-------------------------------------------+ [21:00:56] : [Step 4/5] >>> OS name: Linux 4.15.0-151-generic amd64 [21:00:56] : [Step 4/5] >>> CPU(s): 24 [21:00:56] : [Step 4/5] >>> Heap: 2.0GB [21:00:56] : [Step 4/5] >>> VM name: 16724@c4dfe9a430b2 [21:00:56] : [Step 4/5] >>> Ignite instance name: failure.IoomFailureHandlerTest0 [21:00:56] : [Step 4/5] >>> Local node [ID=A0102B3F-B99F-4BA5-B90D-322D78800000, order=1, clientMode=false] [21:00:56] : [Step 4/5] >>> Local node addresses: [127.0.0.1] [21:00:56] : [Step 4/5] >>> Local ports: TCP:10800 TCP:45010 TCP:47500 [21:00:56] : [Step 4/5] [21:00:56] : [Step 4/5] [2021-11-19 21:00:56,060][INFO ][test-runner-#258%failure.IoomFailureHandlerTest%][IoomFailureHandlerTest0] >>> Ignite cluster is in INACTIVE state (limited functionality available). Use control.(sh|bat) script or IgniteCluster.state(ClusterState.ACTIVE) to change the state. [21:00:56] : [Step 4/5] [2021-11-19 21:00:56,061][INFO ][test-runner-#258%failure.IoomFailureHandlerTest%][GridDiscoveryManager] Topology snapshot [ver=1, locNode=a0102b3f, servers=1, clients=0, state=INACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=a0102b3f-b99f-4ba5-b90d-322d78800000, consistentId=144ec592-3f61-4150-b22b-c2c554b8328c, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:00:56] : [Step 4/5] [2021-11-19 21:00:56,062][INFO ][test-runner-#258%failure.IoomFailureHandlerTest%][G] Node started : [stage="Configure system pool" (2 ms),stage="Start managers" (255 ms),stage="Configure binary metadata" (7 ms),stage="Start processors" (723 ms),stage="Start 'StanByClusterTestProvider' plugin" (0 ms),stage="Start 'PageMemory tracker plugin' plugin" (0 ms),stage="Start 'TestDistibutedConfigurationPlugin' plugin" (0 ms),stage="Start 'NodeValidationPluginProvider' plugin" (0 ms),stage="Init metastore" (697 ms),stage="Init and start regions" (55 ms),stage="Restore binary memory" (309 ms),stage="Restore logical state" (191 ms),stage="Finish recovery" (147 ms),stage="Join topology" (44 ms),stage="Await transition" (5 ms),stage="Await exchange" (82 ms),stage="Total time" (2517 ms)] [21:00:56] : [Step 4/5] [2021-11-19 21:00:56,064][INFO ][test-runner-#258%failure.IoomFailureHandlerTest%][root] Node started with the following configuration [id=a0102b3f-b99f-4ba5-b90d-322d78800000, marshaller=BinaryMarshaller [], discovery=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=5000, ackTimeout=5000, marsh=JdkMarshaller [clsFilter=org.apache.ignite.marshaller.MarshallerUtils$1@faad6e1], reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], binaryCfg=null, lateAff=true] [21:00:56]W: [org.apache.ignite:ignite-core] [2021-11-19 21:00:56,079][WARN ][test-runner-#258%failure.IoomFailureHandlerTest%][G] Ignite work directory is not provided, automatically resolved to: /opt/buildagent/work/7bc1c54bc719b67c/work [21:00:56]W: [org.apache.ignite:ignite-core] [2021-11-19 21:00:56,080][WARN ][test-runner-#258%failure.IoomFailureHandlerTest%][G] Consistent ID is not set, it is recommended to set consistent ID for production clusters (use IgniteConfiguration.setConsistentId property) [21:00:56] : [Step 4/5] [2021-11-19 21:00:56,081][INFO ][test-runner-#258%failure.IoomFailureHandlerTest%][IoomFailureHandlerTest1] [21:00:56] : [Step 4/5] [21:00:56] : [Step 4/5] >>> __________ ________________ [21:00:56] : [Step 4/5] >>> / _/ ___/ |/ / _/_ __/ __/ [21:00:56] : [Step 4/5] >>> _/ // (7 7 // / / / / _/ [21:00:56] : [Step 4/5] >>> /___/\___/_/|_/___/ /_/ /___/ [21:00:56] : [Step 4/5] >>> [21:00:56] : [Step 4/5] >>> ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:00:56] : [Step 4/5] >>> 2021 Copyright(C) Apache Software Foundation [21:00:56] : [Step 4/5] >>> [21:00:56] : [Step 4/5] >>> Ignite documentation: http://ignite.apache.org [21:00:56] : [Step 4/5] [21:00:56] : [Step 4/5] [2021-11-19 21:00:56,082][INFO ][test-runner-#258%failure.IoomFailureHandlerTest%][IoomFailureHandlerTest1] Config URL: n/a [21:00:56] : [Step 4/5] [2021-11-19 21:00:56,083][INFO ][test-runner-#258%failure.IoomFailureHandlerTest%][IoomFailureHandlerTest1] IgniteConfiguration [igniteInstanceName=failure.IoomFailureHandlerTest1, pubPoolSize=24, svcPoolSize=24, callbackPoolSize=24, stripedPoolSize=24, sysPoolSize=24, mgmtPoolSize=4, dataStreamerPoolSize=24, utilityCachePoolSize=24, utilityCacheKeepAliveTime=60000, p2pPoolSize=2, qryPoolSize=24, buildIdxPoolSize=4, igniteHome=/opt/buildagent/work/7bc1c54bc719b67c, igniteWorkDir=/opt/buildagent/work/7bc1c54bc719b67c/work, mbeanSrv=com.sun.jmx.mbeanserver.JmxMBeanServer@6fe85038, nodeId=13e69dcd-2739-4ed1-84d2-2dea0c500001, marsh=BinaryMarshaller [], marshLocJobs=false, daemon=false, p2pEnabled=true, netTimeout=10000, netCompressionLevel=1, sndRetryDelay=1000, sndRetryCnt=3, metricsHistSize=10000, metricsUpdateFreq=1000, metricsExpTime=9223372036854775807, discoSpi=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=0, ackTimeout=0, marsh=null, reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], segPlc=STOP, segResolveAttempts=2, waitForSegOnStart=true, allResolversPassReq=true, segChkFreq=10000, commSpi=TcpCommunicationSpi [connectGate=org.apache.ignite.spi.communication.tcp.internal.ConnectGateway@41d0761e, ctxInitLatch=java.util.concurrent.CountDownLatch@57acaef[Count = 1], stopping=false, clientPool=null, nioSrvWrapper=null, stateProvider=null], evtSpi=MemoryEventStorageSpi [expireAgeMs=9223372036854775807, expireCnt=10000, filter=null], colSpi=NoopCollisionSpi [], deploySpi=LocalDeploymentSpi [], indexingSpi=org.apache.ignite.spi.indexing.noop.NoopIndexingSpi@db71c03, addrRslvr=null, encryptionSpi=org.apache.ignite.spi.encryption.noop.NoopEncryptionSpi@66feddd4, tracingSpi=org.apache.ignite.spi.tracing.NoopTracingSpi@213eab74, clientMode=false, rebalanceThreadPoolSize=4, rebalanceTimeout=10000, rebalanceBatchesPrefetchCnt=3, rebalanceThrottle=0, rebalanceBatchSize=524288, txCfg=TransactionConfiguration [txSerEnabled=false, dfltIsolation=REPEATABLE_READ, dfltConcurrency=PESSIMISTIC, dfltTxTimeout=0, txTimeoutOnPartitionMapExchange=0, deadlockTimeout=10000, pessimisticTxLogSize=0, pessimisticTxLogLinger=10000, tmLookupClsName=null, txManagerFactory=null, useJtaSync=false], cacheSanityCheckEnabled=true, discoStartupDelay=60000, deployMode=SHARED, p2pMissedCacheSize=100, locHost=127.0.0.1, timeSrvPortBase=31100, timeSrvPortRange=100, failureDetectionTimeout=30000, sysWorkerBlockedTimeout=null, clientFailureDetectionTimeout=10000, metricsLogFreq=0, connectorCfg=null, odbcCfg=null, warmupClos=null, atomicCfg=AtomicConfiguration [seqReserveSize=1000, cacheMode=PARTITIONED, backups=1, aff=null, grpName=null], classLdr=null, sslCtxFactory=null, platformCfg=null, binaryCfg=null, memCfg=null, pstCfg=null, dsCfg=DataStorageConfiguration [sysRegionInitSize=41943040, sysRegionMaxSize=104857600, pageSize=2048, concLvl=0, dfltDataRegConf=DataRegionConfiguration [name=dfltPlc, maxSize=10485760, initSize=10485760, swapPath=null, pageEvictionMode=DISABLED, pageReplacementMode=CLOCK, evictionThreshold=0.9, emptyPagesPoolSize=100, metricsEnabled=false, metricsSubIntervalCount=5, metricsRateTimeInterval=60000, persistenceEnabled=true, checkpointPageBufSize=0, lazyMemoryAllocation=true, warmUpCfg=null], dataRegions=null, storagePath=null, checkpointFreq=180000, lockWaitTime=10000, checkpointThreads=4, checkpointWriteOrder=SEQUENTIAL, walHistSize=20, maxWalArchiveSize=1073741824, walSegments=10, walSegmentSize=67108864, walPath=db/wal, walArchivePath=db/wal/archive, cdcWalPath=db/wal/cdc, cdcEnabled=false, metricsEnabled=false, walMode=LOG_ONLY, walTlbSize=131072, walBuffSize=0, walFlushFreq=2000, walFsyncDelay=1000, walRecordIterBuffSize=67108864, alwaysWriteFullPages=false, fileIOFactory=org.apache.ignite.internal.processors.cache.persistence.file.AsyncFileIOFactory@6a834341, metricsSubIntervalCnt=5, metricsRateTimeInterval=60000, walAutoArchiveAfterInactivity=-1, walForceArchiveTimeout=-1, writeThrottlingEnabled=false, walCompactionEnabled=false, walCompactionLevel=1, checkpointReadLockTimeout=null, walPageCompression=DISABLED, walPageCompressionLevel=null, dfltWarmUpCfg=null, encCfg=org.apache.ignite.configuration.EncryptionConfiguration@3a97440e, defragmentationThreadPoolSize=4, minWalArchiveSize=-1], snapshotPath=snapshots, activeOnStart=true, activeOnStartPropSetFlag=false, autoActivation=true, autoActivationPropSetFlag=false, clusterStateOnStart=null, sqlConnCfg=null, cliConnCfg=ClientConnectorConfiguration [host=null, port=10800, portRange=100, sockSndBufSize=0, sockRcvBufSize=0, tcpNoDelay=true, maxOpenCursorsPerConn=128, threadPoolSize=24, selectorCnt=12, idleTimeout=0, handshakeTimeout=10000, jdbcEnabled=true, odbcEnabled=true, thinCliEnabled=true, sslEnabled=false, useIgniteSslCtxFactory=true, sslClientAuth=false, sslCtxFactory=null, thinCliCfg=ThinClientConfiguration [maxActiveTxPerConn=100, maxActiveComputeTasksPerConn=0]], mvccVacuumThreadCnt=2, mvccVacuumFreq=5000, authEnabled=false, failureHnd=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]], commFailureRslvr=null, sqlCfg=SqlConfiguration [longQryWarnTimeout=3000, dfltQryTimeout=0, sqlQryHistSize=1000, validationEnabled=false], asyncContinuationExecutor=null] [21:00:56] : [Step 4/5] [2021-11-19 21:00:56,093][INFO ][test-runner-#258%failure.IoomFailureHandlerTest%][IoomFailureHandlerTest1] Daemon mode: off [21:00:56] : [Step 4/5] [2021-11-19 21:00:56,094][INFO ][test-runner-#258%failure.IoomFailureHandlerTest%][IoomFailureHandlerTest1] OS: Linux 4.15.0-151-generic amd64 [21:00:56] : [Step 4/5] [2021-11-19 21:00:56,094][INFO ][test-runner-#258%failure.IoomFailureHandlerTest%][IoomFailureHandlerTest1] OS user: teamcity [21:00:56] : [Step 4/5] [2021-11-19 21:00:56,094][INFO ][test-runner-#258%failure.IoomFailureHandlerTest%][IoomFailureHandlerTest1] PID: 16724 [21:00:56] : [Step 4/5] [2021-11-19 21:00:56,095][INFO ][test-runner-#258%failure.IoomFailureHandlerTest%][IoomFailureHandlerTest1] Language runtime: Java Platform API Specification ver. 1.8 [21:00:56] : [Step 4/5] [2021-11-19 21:00:56,095][INFO ][test-runner-#258%failure.IoomFailureHandlerTest%][IoomFailureHandlerTest1] VM information: Java(TM) SE Runtime Environment 1.8.0_261-b12 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 25.261-b12 [21:00:56] : [Step 4/5] [2021-11-19 21:00:56,096][INFO ][test-runner-#258%failure.IoomFailureHandlerTest%][IoomFailureHandlerTest1] VM total memory: 1.9GB [21:00:56] : [Step 4/5] [2021-11-19 21:00:56,096][INFO ][test-runner-#258%failure.IoomFailureHandlerTest%][IoomFailureHandlerTest1] Remote Management [restart: off, REST: off, JMX (remote: off)] [21:00:56] : [Step 4/5] [2021-11-19 21:00:56,096][INFO ][test-runner-#258%failure.IoomFailureHandlerTest%][IoomFailureHandlerTest1] Logger: GridTestLog4jLogger [quiet=false, config=null] [21:00:56] : [Step 4/5] [2021-11-19 21:00:56,097][INFO ][test-runner-#258%failure.IoomFailureHandlerTest%][IoomFailureHandlerTest1] IGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c [21:00:56] : [Step 4/5] [2021-11-19 21:00:56,097][INFO ][test-runner-#258%failure.IoomFailureHandlerTest%][IoomFailureHandlerTest1] VM arguments: [-DIGNITE_DUMP_THREADS_ON_FAILURE=false, -DMono=/usr/bin/mono-sgen, -DMono4.0_x64=/usr/lib/mono/4.0, -DMono4.5_x64=/usr/lib/mono/4.5, -DMonoVersion=6.12.0.90, -DSKIP_BUILD=false, -Dagent.home.dir=/opt/buildagent, -Dagent.name=aitc-lin02_03, -Dagent.ownPort=9090, -Dagent.work.dir=/opt/buildagent/work, -Dbuild.number=95, -Dbuild.vcs.number=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.1=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.GitHubApacheIgnite=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dclassworlds.conf=/opt/buildagent/temp/buildTmp/teamcity.m2.conf, -Dcom.jetbrains.maven.watcher.report.file=/opt/buildagent/temp/buildTmp/maven-build-info.xml, -Djava.io.tmpdir=/opt/buildagent/temp/buildTmp, -Dmaven.home=/opt/buildagent/tools/maven3_6, -Dmaven.multiModuleProjectDirectory=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.agent.cpuBenchmark=457, -Dteamcity.agent.dotnet.agent_url=http://localhost:9090/RPC2, -Dteamcity.agent.dotnet.build_id=6278078, -Dteamcity.auth.password=*******, -Dteamcity.auth.userId=TeamCityBuildId=6278078, -Dteamcity.build.changedFiles.file=/opt/buildagent/temp/buildTmp/changedFiles6342607772318147725.txt, -Dteamcity.build.checkoutDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.build.id=6278078, -Dteamcity.build.properties.file=/opt/buildagent/temp/buildTmp/teamcity.build5164517880467851002.properties, -Dteamcity.build.tempDir=/opt/buildagent/temp/buildTmp, -Dteamcity.build.workingDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.buildConfName=Basic 3, -Dteamcity.buildType.id=IgniteTests24Java8_Basic3, -Dteamcity.configuration.properties.file=/opt/buildagent/temp/buildTmp/teamcity.config5591980786735343870.properties, -Dteamcity.maven.userSettings.path=/opt/buildagent/temp/buildTmp/maven_settings_585072866407032347.xml, -Dteamcity.maven.watcher.home=/opt/buildagent/plugins/mavenPlugin/maven-watcher-jdk16, -Dteamcity.projectName=Ignite Tests 2.x (JDK 8/11), -Dteamcity.runner.properties.file=/opt/buildagent/temp/buildTmp/teamcity.runner9098465561618137420.properties, -Dteamcity.tests.recentlyFailedTests.file=/opt/buildagent/temp/buildTmp/testsToRunFirst3891775683130404069.txt, -Dteamcity.version=2021.2 (build 99542), -ea, -Xms2g, -Xmx2g, -XX:+HeapDumpOnOutOfMemoryError, -DIGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_TEST_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_UPDATE_NOTIFIER=false, -DIGNITE_NO_DISCO_ORDER=true, -DIGNITE_PERFORMANCE_SUGGESTIONS_DISABLED=true, -Djava.net.preferIPv4Stack=true, -DTEST_SCALE_FACTOR=1.0, -DIGNITE_TEST_PROP_LOG4J_FILE=log4j-tc-test.xml, -DIGNITE_QUIET=false, -DIGNITE_MARSHAL_BUFFERS_RECHECK=1000, -Dmaven.repo.local=/opt/buildagent/.m2/repository] [21:00:56] : [Step 4/5] [2021-11-19 21:00:56,102][INFO ][test-runner-#258%failure.IoomFailureHandlerTest%][IoomFailureHandlerTest1] System cache's DataRegion size is configured to 40 MB. Use DataStorageConfiguration.systemRegionInitialSize property to change the setting. [21:00:56] : [Step 4/5] [2021-11-19 21:00:56,102][INFO ][test-runner-#258%failure.IoomFailureHandlerTest%][IoomFailureHandlerTest1] Configured caches [in 'sysMemPlc' dataRegion: ['ignite-sys-cache'], in 'dfltPlc' dataRegion: ['default']] [21:00:56]W: [org.apache.ignite:ignite-core] [2021-11-19 21:00:56,103][WARN ][test-runner-#258%failure.IoomFailureHandlerTest%][IoomFailureHandlerTest1] Peer class loading is enabled (disable it in production for performance and deployment consistency reasons) [21:00:56] : [Step 4/5] [2021-11-19 21:00:56,103][INFO ][test-runner-#258%failure.IoomFailureHandlerTest%][IoomFailureHandlerTest1] 3-rd party licenses can be found at: /opt/buildagent/work/7bc1c54bc719b67c/libs/licenses [21:00:56] : [Step 4/5] [2021-11-19 21:00:56,110][INFO ][test-runner-#258%failure.IoomFailureHandlerTest%][IgnitePluginProcessor] Configured plugins: [21:00:56] : [Step 4/5] [2021-11-19 21:00:56,110][INFO ][test-runner-#258%failure.IoomFailureHandlerTest%][IgnitePluginProcessor] ^-- StanByClusterTestProvider 1.0 [21:00:56] : [Step 4/5] [2021-11-19 21:00:56,110][INFO ][test-runner-#258%failure.IoomFailureHandlerTest%][IgnitePluginProcessor] ^-- null [21:00:56] : [Step 4/5] [2021-11-19 21:00:56,110][INFO ][test-runner-#258%failure.IoomFailureHandlerTest%][IgnitePluginProcessor] [21:00:56] : [Step 4/5] [2021-11-19 21:00:56,111][INFO ][test-runner-#258%failure.IoomFailureHandlerTest%][IgnitePluginProcessor] ^-- PageMemory tracker plugin 1.0 [21:00:56] : [Step 4/5] [2021-11-19 21:00:56,111][INFO ][test-runner-#258%failure.IoomFailureHandlerTest%][IgnitePluginProcessor] ^-- null [21:00:56] : [Step 4/5] [2021-11-19 21:00:56,111][INFO ][test-runner-#258%failure.IoomFailureHandlerTest%][IgnitePluginProcessor] [21:00:56] : [Step 4/5] [2021-11-19 21:00:56,111][INFO ][test-runner-#258%failure.IoomFailureHandlerTest%][IgnitePluginProcessor] ^-- TestDistibutedConfigurationPlugin 1.0 [21:00:56] : [Step 4/5] [2021-11-19 21:00:56,111][INFO ][test-runner-#258%failure.IoomFailureHandlerTest%][IgnitePluginProcessor] ^-- null [21:00:56] : [Step 4/5] [2021-11-19 21:00:56,112][INFO ][test-runner-#258%failure.IoomFailureHandlerTest%][IgnitePluginProcessor] [21:00:56] : [Step 4/5] [2021-11-19 21:00:56,112][INFO ][test-runner-#258%failure.IoomFailureHandlerTest%][IgnitePluginProcessor] ^-- NodeValidationPluginProvider 1.0 [21:00:56] : [Step 4/5] [2021-11-19 21:00:56,112][INFO ][test-runner-#258%failure.IoomFailureHandlerTest%][IgnitePluginProcessor] ^-- null [21:00:56] : [Step 4/5] [2021-11-19 21:00:56,112][INFO ][test-runner-#258%failure.IoomFailureHandlerTest%][IgnitePluginProcessor] [21:00:56] : [Step 4/5] [2021-11-19 21:00:56,113][INFO ][test-runner-#258%failure.IoomFailureHandlerTest%][FailureProcessor] Configured failure handler: [hnd=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]] [21:00:56] : [Step 4/5] [2021-11-19 21:00:56,198][INFO ][test-runner-#258%failure.IoomFailureHandlerTest%][TcpCommunicationSpi] Successfully bound communication NIO server to TCP port [port=45011, locHost=/127.0.0.1, selectorsCnt=12, selectorSpins=0, pairedConn=false] [21:00:56]W: [org.apache.ignite:ignite-core] [2021-11-19 21:00:56,199][WARN ][test-runner-#258%failure.IoomFailureHandlerTest%][TcpCommunicationSpi] Message queue limit is set to 0 which may lead to potential OOMEs when running cache operations in FULL_ASYNC or PRIMARY_SYNC modes due to message queues growth on sender and receiver sides. [21:00:56] : [Step 4/5] [2021-11-19 21:00:56,231][INFO ][test-runner-#258%failure.IoomFailureHandlerTest%][GridCollisionManager] Collision resolution is disabled (all jobs will be activated upon arrival). [21:00:56] : [Step 4/5] [2021-11-19 21:00:56,232][INFO ][test-runner-#258%failure.IoomFailureHandlerTest%][IoomFailureHandlerTest1] Security status [authentication=off, sandbox=off, tls/ssl=off] [21:00:56] : [Step 4/5] [2021-11-19 21:00:56,234][INFO ][test-runner-#258%failure.IoomFailureHandlerTest%][TestTcpDiscoverySpi] Successfully bound to TCP port [port=47501, localHost=localhost/127.0.0.1, locNodeId=13e69dcd-2739-4ed1-84d2-2dea0c500001] [21:00:56]W: [org.apache.ignite:ignite-core] [2021-11-19 21:00:56,237][WARN ][test-runner-#258%failure.IoomFailureHandlerTest%][PdsFoldersResolver] Failed to acquire file lock. Will try again in 1s [nodeId=13e69dcd-2739-4ed1-84d2-2dea0c500001, holder=[a0102b3f-b99f-4ba5-b90d-322d78800000][], path=/opt/buildagent/work/7bc1c54bc719b67c/work/db/node00-144ec592-3f61-4150-b22b-c2c554b8328c/lock] [21:00:57] : [Step 4/5] [2021-11-19 21:00:57,238][INFO ][test-runner-#258%failure.IoomFailureHandlerTest%][PdsFoldersResolver] Unable to acquire lock to file [/opt/buildagent/work/7bc1c54bc719b67c/work/db/node00-144ec592-3f61-4150-b22b-c2c554b8328c], reason: Failed to acquire file lock [holder=[a0102b3f-b99f-4ba5-b90d-322d78800000][], time=1 sec, path=/opt/buildagent/work/7bc1c54bc719b67c/work/db/node00-144ec592-3f61-4150-b22b-c2c554b8328c/lock] [21:00:57] : [Step 4/5] [2021-11-19 21:00:57,241][INFO ][test-runner-#258%failure.IoomFailureHandlerTest%][PdsFoldersResolver] Successfully created new persistent storage folder [/opt/buildagent/work/7bc1c54bc719b67c/work/db/node01-b036289d-7287-4e61-88c1-20e0b0ee26a0] [21:00:57] : [Step 4/5] [2021-11-19 21:00:57,242][INFO ][test-runner-#258%failure.IoomFailureHandlerTest%][PdsFoldersResolver] Consistent ID used for local node is [b036289d-7287-4e61-88c1-20e0b0ee26a0] according to persistence data storage folders [21:00:57] : [Step 4/5] [2021-11-19 21:00:57,242][INFO ][test-runner-#258%failure.IoomFailureHandlerTest%][MaintenanceProcessor] Resolved store directory for node persistent data: /opt/buildagent/work/7bc1c54bc719b67c/work/db/node01-b036289d-7287-4e61-88c1-20e0b0ee26a0 [21:00:57] : [Step 4/5] [2021-11-19 21:00:57,245][INFO ][test-runner-#258%failure.IoomFailureHandlerTest%][CacheObjectBinaryProcessorImpl] Resolved directory for serialized binary metadata: /opt/buildagent/work/7bc1c54bc719b67c/work/db/binary_meta/node01-b036289d-7287-4e61-88c1-20e0b0ee26a0 [21:00:57] : [Step 4/5] [2021-11-19 21:00:57,253][INFO ][test-runner-#258%failure.IoomFailureHandlerTest%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/node01-b036289d-7287-4e61-88c1-20e0b0ee26a0 [21:00:57] : [Step 4/5] [2021-11-19 21:00:57,253][INFO ][test-runner-#258%failure.IoomFailureHandlerTest%][FileWriteAheadLogManager] Resolved write ahead log work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/node01-b036289d-7287-4e61-88c1-20e0b0ee26a0 [21:00:57] : [Step 4/5] [2021-11-19 21:00:57,254][INFO ][test-runner-#258%failure.IoomFailureHandlerTest%][FileWriteAheadLogManager] Resolved write ahead log archive directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/node01-b036289d-7287-4e61-88c1-20e0b0ee26a0 [21:00:57] : [Step 4/5] [2021-11-19 21:00:57,655][INFO ][test-runner-#258%failure.IoomFailureHandlerTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/node01-b036289d-7287-4e61-88c1-20e0b0ee26a0/0000000000000000.wal [21:00:57] : [Step 4/5] [2021-11-19 21:00:57,656][INFO ][test-runner-#258%failure.IoomFailureHandlerTest%][FileHandleManagerImpl] Initialized write-ahead log manager [mode=LOG_ONLY] [21:00:57] : [Step 4/5] [2021-11-19 21:00:57,665][INFO ][test-runner-#258%failure.IoomFailureHandlerTest%][GridCacheDatabaseSharedManager] Configured data regions initialized successfully [total=5] [21:00:57] : [Step 4/5] [2021-11-19 21:00:57,666][INFO ][test-runner-#258%failure.IoomFailureHandlerTest%][IgniteSnapshotManager] Resolved snapshot work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/snapshots [21:00:57] : [Step 4/5] [2021-11-19 21:00:57,667][INFO ][test-runner-#258%failure.IoomFailureHandlerTest%][IgniteSnapshotManager] Resolved temp directory for snapshot creation: /opt/buildagent/work/7bc1c54bc719b67c/work/db/node01-b036289d-7287-4e61-88c1-20e0b0ee26a0/snp [21:00:57] : [Step 4/5] [2021-11-19 21:00:57,672][INFO ][test-runner-#258%failure.IoomFailureHandlerTest%][ClientListenerProcessor] Client connector processor has started on TCP port 10801 [21:00:57] : [Step 4/5] [2021-11-19 21:00:57,678][INFO ][test-runner-#258%failure.IoomFailureHandlerTest%][IoomFailureHandlerTest1] Non-loopback local IPs: 172.17.0.4 [21:00:57] : [Step 4/5] [2021-11-19 21:00:57,678][INFO ][test-runner-#258%failure.IoomFailureHandlerTest%][IoomFailureHandlerTest1] Enabled local MACs: 0242AC110004 [21:00:57] : [Step 4/5] [2021-11-19 21:00:57,679][INFO ][test-runner-#258%failure.IoomFailureHandlerTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:00:57] : [Step 4/5] [2021-11-19 21:00:57,685][INFO ][test-runner-#258%failure.IoomFailureHandlerTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=48096, tableSize=3.8 MiB, replacementSize=6.0 KiB, checkpointBuffer=100.0 MiB] [21:00:57] : [Step 4/5] [2021-11-19 21:00:57,685][INFO ][test-runner-#258%failure.IoomFailureHandlerTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:00:57] : [Step 4/5] [2021-11-19 21:00:57,689][INFO ][test-runner-#258%failure.IoomFailureHandlerTest%][GridCacheDatabaseSharedManager] Applying lost metastore updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:00:57] : [Step 4/5] [2021-11-19 21:00:57,691][INFO ][test-runner-#258%failure.IoomFailureHandlerTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=0 ms] [21:00:57] : [Step 4/5] [2021-11-19 21:00:57,691][INFO ][test-runner-#258%failure.IoomFailureHandlerTest%][GridCacheProcessor] Restoring partition state for local groups. [21:00:57] : [Step 4/5] [2021-11-19 21:00:57,692][INFO ][test-runner-#258%failure.IoomFailureHandlerTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=0, partitionsProcessed=0, time=0ms] [21:00:57] : [Step 4/5] [2021-11-19 21:00:57,693][INFO ][test-runner-#258%failure.IoomFailureHandlerTest%][GridEncryptionManager] Encryption keys loaded from metastore. [grps=, masterKeyName=null] [21:00:57] : [Step 4/5] [2021-11-19 21:00:57,699][INFO ][test-runner-#258%failure.IoomFailureHandlerTest%][ClusterProcessor] Cluster ID and tag has been read from metastorage: null [21:00:57] : [Step 4/5] [2021-11-19 21:00:57,700][INFO ][test-runner-#258%failure.IoomFailureHandlerTest%][IgniteClusterImpl] Shutdown policy was updated [oldVal=null, newVal=null] [21:00:57] : [Step 4/5] [2021-11-19 21:00:57,700][INFO ][test-runner-#258%failure.IoomFailureHandlerTest%][GridCacheDatabaseSharedManager] Checkpoint frequency deviation changed [oldVal=null, newVal=null] [21:00:57] : [Step 4/5] [2021-11-19 21:00:57,713][INFO ][test-runner-#258%failure.IoomFailureHandlerTest%][FilePageStoreManager] Cleanup cache stores [total=1, left=0, cleanFiles=false] [21:00:57] : [Step 4/5] [2021-11-19 21:00:57,722][INFO ][test-runner-#258%failure.IoomFailureHandlerTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=48096, tableSize=3.8 MiB, replacementSize=6.0 KiB, checkpointBuffer=100.0 MiB] [21:00:57] : [Step 4/5] [2021-11-19 21:00:57,725][INFO ][test-runner-#258%failure.IoomFailureHandlerTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=48096, tableSize=3.8 MiB, replacementSize=6.0 KiB, checkpointBuffer=100.0 MiB] [21:00:57] : [Step 4/5] [2021-11-19 21:00:57,730][INFO ][test-runner-#258%failure.IoomFailureHandlerTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=48096, tableSize=3.8 MiB, replacementSize=6.0 KiB, checkpointBuffer=100.0 MiB] [21:00:57] : [Step 4/5] [2021-11-19 21:00:57,731][INFO ][test-runner-#258%failure.IoomFailureHandlerTest%][GridCacheDatabaseSharedManager] Data Regions Started: 5 [21:00:57] : [Step 4/5] [2021-11-19 21:00:57,732][INFO ][test-runner-#258%failure.IoomFailureHandlerTest%][GridCacheDatabaseSharedManager] ^-- sysMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:00:57] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:00:57] : [Step 4/5] ^-- metastoreMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:00:57] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:00:57] : [Step 4/5] ^-- TxLog region [type=internal, persistence=true, lazyAlloc=false, [21:00:57] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:00:57] : [Step 4/5] ^-- dfltPlc region [type=default, persistence=true, lazyAlloc=true, [21:00:57] : [Step 4/5] ... initCfg=10MB, maxCfg=10MB, usedRam=0MB, freeRam=100%, allocRam=0MB, allocTotal=0MB] [21:00:57] : [Step 4/5] ^-- volatileDsMemPlc region [type=user, persistence=false, lazyAlloc=true, [21:00:57] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB] [21:00:57] : [Step 4/5] ^-- Ignite persistence [used=0MB] [21:00:57] : [Step 4/5] [21:00:57] : [Step 4/5] [2021-11-19 21:00:57,734][INFO ][test-runner-#258%failure.IoomFailureHandlerTest%][GridCacheDatabaseSharedManager] Starting binary memory restore for: [1544803905, -2100569601] [21:00:57] : [Step 4/5] [2021-11-19 21:00:57,891][INFO ][test-runner-#258%failure.IoomFailureHandlerTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:00:57] : [Step 4/5] [2021-11-19 21:00:57,892][INFO ][test-runner-#258%failure.IoomFailureHandlerTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:00:57] : [Step 4/5] [2021-11-19 21:00:57,898][INFO ][test-runner-#258%failure.IoomFailureHandlerTest%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/node01-b036289d-7287-4e61-88c1-20e0b0ee26a0/0000000000000000.wal, offset=0, ver=2] [21:00:57] : [Step 4/5] [2021-11-19 21:00:57,905][INFO ][test-runner-#258%failure.IoomFailureHandlerTest%][PageMemoryImpl] Started page memory [memoryAllocated=24.0 MiB, pages=11544, tableSize=937.7 KiB, replacementSize=1.5 KiB, checkpointBuffer=10.0 MiB] [21:00:57] : [Step 4/5] [2021-11-19 21:00:57,913][INFO ][test-runner-#258%failure.IoomFailureHandlerTest%][GridCacheProcessor] Started cache in recovery mode [name=default, id=1544803905, dataRegionName=dfltPlc, mode=PARTITIONED, atomicity=TRANSACTIONAL_SNAPSHOT, backups=0, mvcc=true] [21:00:57] : [Step 4/5] [2021-11-19 21:00:57,919][INFO ][test-runner-#258%failure.IoomFailureHandlerTest%][GridCacheProcessor] Started cache in recovery mode [name=ignite-sys-cache, id=-2100569601, dataRegionName=sysMemPlc, mode=REPLICATED, atomicity=TRANSACTIONAL, backups=2147483647, mvcc=false] [21:00:57] : [Step 4/5] [2021-11-19 21:00:57,922][INFO ][test-runner-#258%failure.IoomFailureHandlerTest%][GridCacheDatabaseSharedManager] Binary recovery performed in 188 ms. [21:00:57] : [Step 4/5] [2021-11-19 21:00:57,923][INFO ][test-runner-#258%failure.IoomFailureHandlerTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:00:57] : [Step 4/5] [2021-11-19 21:00:57,923][INFO ][test-runner-#258%failure.IoomFailureHandlerTest%][GridCacheDatabaseSharedManager] Applying lost cache updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:00:58] : [Step 4/5] [2021-11-19 21:00:58,017][INFO ][test-runner-#258%failure.IoomFailureHandlerTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=95 ms] [21:00:58] : [Step 4/5] [2021-11-19 21:00:58,018][INFO ][test-runner-#258%failure.IoomFailureHandlerTest%][GridCacheProcessor] Restoring partition state for local groups. [21:00:58] : [Step 4/5] [2021-11-19 21:00:58,074][INFO ][test-runner-#258%failure.IoomFailureHandlerTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=2, partitionsProcessed=1124, time=51ms] [21:00:58] : [Step 4/5] [2021-11-19 21:00:58,312][INFO ][tcp-disco-srvr-[:47500]-#18%failure.IoomFailureHandlerTest0%-#373%failure.IoomFailureHandlerTest0%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=48539] [21:00:58] : [Step 4/5] [2021-11-19 21:00:58,317][INFO ][tcp-disco-srvr-[:47500]-#18%failure.IoomFailureHandlerTest0%-#373%failure.IoomFailureHandlerTest0%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=48539] [21:00:58] : [Step 4/5] [2021-11-19 21:00:58,322][INFO ][tcp-disco-sock-reader-[]-#24%failure.IoomFailureHandlerTest0%-#494%failure.IoomFailureHandlerTest0%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:48539, rmtPort=48539] [21:00:58] : [Step 4/5] [2021-11-19 21:00:58,326][INFO ][tcp-disco-sock-reader-[13e69dcd 127.0.0.1:48539]-#24%failure.IoomFailureHandlerTest0%-#494%failure.IoomFailureHandlerTest0%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=13e69dcd-2739-4ed1-84d2-2dea0c500001, rmtAddr=/127.0.0.1:48539] [21:00:58] : [Step 4/5] [2021-11-19 21:00:58,346][INFO ][tcp-disco-srvr-[:47501]-#23%failure.IoomFailureHandlerTest1%-#493%failure.IoomFailureHandlerTest1%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=33891] [21:00:58] : [Step 4/5] [2021-11-19 21:00:58,347][INFO ][tcp-disco-srvr-[:47501]-#23%failure.IoomFailureHandlerTest1%-#493%failure.IoomFailureHandlerTest1%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=33891] [21:00:58] : [Step 4/5] [2021-11-19 21:00:58,349][INFO ][tcp-disco-sock-reader-[]-#25%failure.IoomFailureHandlerTest1%-#495%failure.IoomFailureHandlerTest1%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:33891, rmtPort=33891] [21:00:58] : [Step 4/5] [2021-11-19 21:00:58,350][INFO ][tcp-disco-sock-reader-[]-#25%failure.IoomFailureHandlerTest1%-#495%failure.IoomFailureHandlerTest1%][TestTcpDiscoverySpi] Received ping request from the remote node [rmtNodeId=a0102b3f-b99f-4ba5-b90d-322d78800000, rmtAddr=/127.0.0.1:33891, rmtPort=33891] [21:00:58] : [Step 4/5] [2021-11-19 21:00:58,353][INFO ][tcp-disco-sock-reader-[]-#25%failure.IoomFailureHandlerTest1%-#495%failure.IoomFailureHandlerTest1%][TestTcpDiscoverySpi] Finished writing ping response [rmtNodeId=a0102b3f-b99f-4ba5-b90d-322d78800000, rmtAddr=/127.0.0.1:33891, rmtPort=33891] [21:00:58]W: [org.apache.ignite:ignite-core] [2021-11-19 21:00:58,354][WARN ][tcp-disco-sock-reader-[]-#25%failure.IoomFailureHandlerTest1%-#495%failure.IoomFailureHandlerTest1%][TestTcpDiscoverySpi] Failed to shutdown socket [21:00:58]W: [org.apache.ignite:ignite-core] java.net.SocketException: Socket output is already shutdown [21:00:58]W: [org.apache.ignite:ignite-core] at java.net.Socket.shutdownOutput(Socket.java:1572) [21:00:58]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.close(IgniteUtils.java:4247) [21:00:58]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.discovery.tcp.ServerImpl$SocketReader.body(ServerImpl.java:7370) [21:00:58]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.IgniteSpiThread.run(IgniteSpiThread.java:58) [21:00:58] : [Step 4/5] [2021-11-19 21:00:58,354][INFO ][tcp-disco-sock-reader-[13e69dcd 127.0.0.1:48539]-#24%failure.IoomFailureHandlerTest0%-#494%failure.IoomFailureHandlerTest0%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:48539, rmtPort=48539, rmtNodeId=13e69dcd-2739-4ed1-84d2-2dea0c500001] [21:00:58] : [Step 4/5] [2021-11-19 21:00:58,355][INFO ][tcp-disco-sock-reader-[]-#25%failure.IoomFailureHandlerTest1%-#495%failure.IoomFailureHandlerTest1%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:33891, rmtPort=33891, rmtNodeId=null] [21:00:58] : [Step 4/5] [2021-11-19 21:00:58,361][INFO ][tcp-disco-msg-worker-[crd]-#17%failure.IoomFailureHandlerTest0%-#372%failure.IoomFailureHandlerTest0%][GridEncryptionManager] Joining node doesn't have stored group keys [node=13e69dcd-2739-4ed1-84d2-2dea0c500001] [21:00:58] : [Step 4/5] [2021-11-19 21:00:58,402][INFO ][tcp-disco-msg-worker-[crd]-#17%failure.IoomFailureHandlerTest0%-#372%failure.IoomFailureHandlerTest0%][TestTcpDiscoverySpi] New next node [newNext=TcpDiscoveryNode [id=13e69dcd-2739-4ed1-84d2-2dea0c500001, consistentId=b036289d-7287-4e61-88c1-20e0b0ee26a0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=0, intOrder=2, lastExchangeTime=1637344858327, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false]] [21:00:58] : [Step 4/5] [2021-11-19 21:00:58,403][INFO ][tcp-disco-srvr-[:47501]-#23%failure.IoomFailureHandlerTest1%-#493%failure.IoomFailureHandlerTest1%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=37647] [21:00:58] : [Step 4/5] [2021-11-19 21:00:58,404][INFO ][tcp-disco-srvr-[:47501]-#23%failure.IoomFailureHandlerTest1%-#493%failure.IoomFailureHandlerTest1%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=37647] [21:00:58] : [Step 4/5] [2021-11-19 21:00:58,408][INFO ][tcp-disco-sock-reader-[]-#26%failure.IoomFailureHandlerTest1%-#496%failure.IoomFailureHandlerTest1%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:37647, rmtPort=37647] [21:00:58] : [Step 4/5] [2021-11-19 21:00:58,412][INFO ][tcp-disco-sock-reader-[a0102b3f 127.0.0.1:37647]-#26%failure.IoomFailureHandlerTest1%-#496%failure.IoomFailureHandlerTest1%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=a0102b3f-b99f-4ba5-b90d-322d78800000, rmtAddr=/127.0.0.1:37647] [21:00:58] : [Step 4/5] [2021-11-19 21:00:58,426][INFO ][tcp-disco-msg-worker-[]-#22%failure.IoomFailureHandlerTest1%-#492%failure.IoomFailureHandlerTest1%][TestTcpDiscoverySpi] New next node [newNext=TcpDiscoveryNode [id=a0102b3f-b99f-4ba5-b90d-322d78800000, consistentId=144ec592-3f61-4150-b22b-c2c554b8328c, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637344858420, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false]] [21:00:58] : [Step 4/5] [2021-11-19 21:00:58,428][INFO ][tcp-disco-srvr-[:47500]-#18%failure.IoomFailureHandlerTest0%-#373%failure.IoomFailureHandlerTest0%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=49221] [21:00:58] : [Step 4/5] [2021-11-19 21:00:58,429][INFO ][tcp-disco-srvr-[:47500]-#18%failure.IoomFailureHandlerTest0%-#373%failure.IoomFailureHandlerTest0%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=49221] [21:00:58] : [Step 4/5] [2021-11-19 21:00:58,431][INFO ][tcp-disco-sock-reader-[]-#27%failure.IoomFailureHandlerTest0%-#497%failure.IoomFailureHandlerTest0%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:49221, rmtPort=49221] [21:00:58] : [Step 4/5] [2021-11-19 21:00:58,438][INFO ][tcp-disco-sock-reader-[13e69dcd 127.0.0.1:49221]-#27%failure.IoomFailureHandlerTest0%-#497%failure.IoomFailureHandlerTest0%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=13e69dcd-2739-4ed1-84d2-2dea0c500001, rmtAddr=/127.0.0.1:49221] [21:00:58] : [Step 4/5] [2021-11-19 21:00:58,445][INFO ][disco-event-worker-#375%failure.IoomFailureHandlerTest0%][GridDiscoveryManager] Added new node to topology: TcpDiscoveryNode [id=13e69dcd-2739-4ed1-84d2-2dea0c500001, consistentId=b036289d-7287-4e61-88c1-20e0b0ee26a0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637344858327, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false] [21:00:58] : [Step 4/5] [2021-11-19 21:00:58,447][INFO ][disco-event-worker-#375%failure.IoomFailureHandlerTest0%][GridDiscoveryManager] Topology snapshot [ver=2, locNode=a0102b3f, servers=2, clients=0, state=INACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=a0102b3f-b99f-4ba5-b90d-322d78800000, consistentId=144ec592-3f61-4150-b22b-c2c554b8328c, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=13e69dcd-2739-4ed1-84d2-2dea0c500001, consistentId=b036289d-7287-4e61-88c1-20e0b0ee26a0, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:00:58] : [Step 4/5] [2021-11-19 21:00:58,455][INFO ][tcp-disco-msg-worker-[a0102b3f 127.0.0.1:47500]-#22%failure.IoomFailureHandlerTest1%-#492%failure.IoomFailureHandlerTest1%][ClusterProcessor] peaceful_faraday [21:00:58] : [Step 4/5] [2021-11-19 21:00:58,456][INFO ][tcp-disco-msg-worker-[a0102b3f 127.0.0.1:47500]-#22%failure.IoomFailureHandlerTest1%-#492%failure.IoomFailureHandlerTest1%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustEnabled' was changed from 'null' to 'false' [21:00:58] : [Step 4/5] [2021-11-19 21:00:58,457][INFO ][tcp-disco-msg-worker-[a0102b3f 127.0.0.1:47500]-#22%failure.IoomFailureHandlerTest1%-#492%failure.IoomFailureHandlerTest1%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustTimeout' was changed from 'null' to '300000' [21:00:58] : [Step 4/5] [2021-11-19 21:00:58,458][INFO ][tcp-disco-msg-worker-[a0102b3f 127.0.0.1:47500]-#22%failure.IoomFailureHandlerTest1%-#492%failure.IoomFailureHandlerTest1%][IgniteTxManager] Transactions parameter 'longOperationsDumpTimeout' was changed from 'null' to '60000' [21:00:58] : [Step 4/5] [2021-11-19 21:00:58,458][INFO ][tcp-disco-msg-worker-[a0102b3f 127.0.0.1:47500]-#22%failure.IoomFailureHandlerTest1%-#492%failure.IoomFailureHandlerTest1%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpThreshold' was changed from 'null' to '0' [21:00:58] : [Step 4/5] [2021-11-19 21:00:58,459][INFO ][tcp-disco-msg-worker-[a0102b3f 127.0.0.1:47500]-#22%failure.IoomFailureHandlerTest1%-#492%failure.IoomFailureHandlerTest1%][IgniteTxManager] Transactions parameter 'transactionTimeDumpSamplesCoefficient' was changed from 'null' to '0.0' [21:00:58] : [Step 4/5] [2021-11-19 21:00:58,460][INFO ][tcp-disco-msg-worker-[a0102b3f 127.0.0.1:47500]-#22%failure.IoomFailureHandlerTest1%-#492%failure.IoomFailureHandlerTest1%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpSamplesPerSecondLimit' was changed from 'null' to '5' [21:00:58] : [Step 4/5] [2021-11-19 21:00:58,463][INFO ][tcp-disco-msg-worker-[a0102b3f 127.0.0.1:47500]-#22%failure.IoomFailureHandlerTest1%-#492%failure.IoomFailureHandlerTest1%][IgniteTxManager] Transactions parameter 'collisionsDumpInterval' was changed from 'null' to '1000' [21:00:58] : [Step 4/5] [2021-11-19 21:00:58,463][INFO ][tcp-disco-msg-worker-[a0102b3f 127.0.0.1:47500]-#22%failure.IoomFailureHandlerTest1%-#492%failure.IoomFailureHandlerTest1%][IgniteTxManager] Transactions parameter 'txOwnerDumpRequestsAllowed' was changed from 'null' to 'true' [21:00:58] : [Step 4/5] [2021-11-19 21:00:58,464][INFO ][tcp-disco-msg-worker-[a0102b3f 127.0.0.1:47500]-#22%failure.IoomFailureHandlerTest1%-#492%failure.IoomFailureHandlerTest1%][GridCacheDatabaseSharedManager] Historical rebalance WAL threshold changed [property=historical.rebalance.threshold, oldVal=null, newVal=500] [21:00:58] : [Step 4/5] [2021-11-19 21:00:58,468][INFO ][disco-notifier-worker-#491%failure.IoomFailureHandlerTest1%][MvccProcessorImpl] Assigned mvcc coordinator [crd=MvccCoordinator [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=0], nodeId=a0102b3f-b99f-4ba5-b90d-322d78800000, ver=1637344855957, local=false, initialized=false]] [21:00:58] : [Step 4/5] [2021-11-19 21:00:58,469][INFO ][sys-#480%failure.IoomFailureHandlerTest1%][ClusterProcessor] Writing cluster ID and tag to metastorage on ready for write ClusterIdAndTag [id=ab43e38f-7e05-40ce-95d8-260d959a3247, tag=peaceful_faraday] [21:00:58] : [Step 4/5] [2021-11-19 21:00:58,583][INFO ][test-runner-#258%failure.IoomFailureHandlerTest%][IoomFailureHandlerTest1] To start Console Management & Monitoring run ignitevisorcmd.{sh|bat} [21:00:58] : [Step 4/5] [2021-11-19 21:00:58,584][INFO ][test-runner-#258%failure.IoomFailureHandlerTest%][IoomFailureHandlerTest1] [21:00:58] : [Step 4/5] [21:00:58] : [Step 4/5] >>> +-------------------------------------------+ [21:00:58] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:00:58] : [Step 4/5] >>> +-------------------------------------------+ [21:00:58] : [Step 4/5] >>> OS name: Linux 4.15.0-151-generic amd64 [21:00:58] : [Step 4/5] >>> CPU(s): 24 [21:00:58] : [Step 4/5] >>> Heap: 2.0GB [21:00:58] : [Step 4/5] >>> VM name: 16724@c4dfe9a430b2 [21:00:58] : [Step 4/5] >>> Ignite instance name: failure.IoomFailureHandlerTest1 [21:00:58] : [Step 4/5] >>> Local node [ID=13E69DCD-2739-4ED1-84D2-2DEA0C500001, order=2, clientMode=false] [21:00:58] : [Step 4/5] >>> Local node addresses: [127.0.0.1] [21:00:58] : [Step 4/5] >>> Local ports: TCP:10801 TCP:45011 TCP:47501 [21:00:58] : [Step 4/5] [21:00:58] : [Step 4/5] [2021-11-19 21:00:58,585][INFO ][test-runner-#258%failure.IoomFailureHandlerTest%][IoomFailureHandlerTest1] >>> Ignite cluster is in INACTIVE state (limited functionality available). Use control.(sh|bat) script or IgniteCluster.state(ClusterState.ACTIVE) to change the state. [21:00:58] : [Step 4/5] [2021-11-19 21:00:58,586][INFO ][test-runner-#258%failure.IoomFailureHandlerTest%][GridDiscoveryManager] Topology snapshot [ver=2, locNode=13e69dcd, servers=2, clients=0, state=INACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=a0102b3f-b99f-4ba5-b90d-322d78800000, consistentId=144ec592-3f61-4150-b22b-c2c554b8328c, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=13e69dcd-2739-4ed1-84d2-2dea0c500001, consistentId=b036289d-7287-4e61-88c1-20e0b0ee26a0, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:00:58] : [Step 4/5] [2021-11-19 21:00:58,588][INFO ][test-runner-#258%failure.IoomFailureHandlerTest%][G] Node started : [stage="Configure system pool" (0 ms),stage="Start managers" (1163 ms),stage="Configure binary metadata" (4 ms),stage="Start processors" (428 ms),stage="Start 'StanByClusterTestProvider' plugin" (0 ms),stage="Start 'PageMemory tracker plugin' plugin" (0 ms),stage="Start 'TestDistibutedConfigurationPlugin' plugin" (0 ms),stage="Start 'NodeValidationPluginProvider' plugin" (0 ms),stage="Init metastore" (36 ms),stage="Init and start regions" (20 ms),stage="Restore binary memory" (188 ms),stage="Restore logical state" (152 ms),stage="Finish recovery" (230 ms),stage="Join topology" (174 ms),stage="Await transition" (3 ms),stage="Await exchange" (103 ms),stage="Total time" (2501 ms)] [21:00:58] : [Step 4/5] [2021-11-19 21:00:58,589][INFO ][test-runner-#258%failure.IoomFailureHandlerTest%][root] Node started with the following configuration [id=13e69dcd-2739-4ed1-84d2-2dea0c500001, marshaller=BinaryMarshaller [], discovery=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=5000, ackTimeout=5000, marsh=JdkMarshaller [clsFilter=org.apache.ignite.marshaller.MarshallerUtils$1@367c269c], reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], binaryCfg=null, lateAff=true] [21:00:58] : [Step 4/5] [2021-11-19 21:00:58,598][INFO ][test-runner-#258%failure.IoomFailureHandlerTest%][GridClusterStateProcessor] Sending activate cluster request with BaselineTopology BaselineTopology [id=0, branchingHash=-933571257, branchingType='New BaselineTopology', baselineNodes=[b036289d-7287-4e61-88c1-20e0b0ee26a0, 144ec592-3f61-4150-b22b-c2c554b8328c]] [21:00:58] : [Step 4/5] [2021-11-19 21:00:58,630][INFO ][disco-notifier-worker-#371%failure.IoomFailureHandlerTest0%][GridClusterStateProcessor] Received activate cluster request with BaselineTopology[id=0] initiator node ID: a0102b3f-b99f-4ba5-b90d-322d78800000 [21:00:58] : [Step 4/5] [2021-11-19 21:00:58,632][INFO ][disco-notifier-worker-#371%failure.IoomFailureHandlerTest0%][GridClusterStateProcessor] Started state transition: activate cluster [21:00:58] : [Step 4/5] [2021-11-19 21:00:58,636][INFO ][exchange-worker-#376%failure.IoomFailureHandlerTest0%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], crd=true, evt=DISCOVERY_CUSTOM_EVT, evtNode=a0102b3f-b99f-4ba5-b90d-322d78800000, customEvt=ChangeGlobalStateMessage [id=10fab593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqId=7ef1f1a4-a98b-4296-b698-ac1de977670e, initiatingNodeId=a0102b3f-b99f-4ba5-b90d-322d78800000, state=ACTIVE, baselineTopology=BaselineTopology [id=0, branchingHash=-933571257, branchingType='New BaselineTopology', baselineNodes=[b036289d-7287-4e61-88c1-20e0b0ee26a0, 144ec592-3f61-4150-b22b-c2c554b8328c]], forceChangeBaselineTopology=false, timestamp=1637344858598, forceDeactivation=true], allowMerge=false, exchangeFreeSwitch=false] [21:00:58] : [Step 4/5] [2021-11-19 21:00:58,637][INFO ][exchange-worker-#376%failure.IoomFailureHandlerTest0%][GridDhtPartitionsExchangeFuture] Start activation process [nodeId=a0102b3f-b99f-4ba5-b90d-322d78800000, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]]. New state: ACTIVE [21:00:58] : [Step 4/5] [2021-11-19 21:00:58,638][INFO ][exchange-worker-#376%failure.IoomFailureHandlerTest0%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/node00-144ec592-3f61-4150-b22b-c2c554b8328c [21:00:58] : [Step 4/5] [2021-11-19 21:00:58,641][INFO ][disco-notifier-worker-#491%failure.IoomFailureHandlerTest1%][GridClusterStateProcessor] Received activate cluster request with BaselineTopology[id=0] initiator node ID: a0102b3f-b99f-4ba5-b90d-322d78800000 [21:00:58] : [Step 4/5] [2021-11-19 21:00:58,651][INFO ][exchange-worker-#376%failure.IoomFailureHandlerTest0%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/node00-144ec592-3f61-4150-b22b-c2c554b8328c/0000000000000000.wal, offset=9438, ver=2] [21:00:58] : [Step 4/5] [2021-11-19 21:00:58,655][INFO ][disco-notifier-worker-#491%failure.IoomFailureHandlerTest1%][GridClusterStateProcessor] Started state transition: activate cluster [21:00:58] : [Step 4/5] [2021-11-19 21:00:58,661][INFO ][exchange-worker-#376%failure.IoomFailureHandlerTest0%][GridClusterStateProcessor] Writing BaselineTopology[id=0] [21:00:58] : [Step 4/5] [2021-11-19 21:00:58,664][INFO ][exchange-worker-#500%failure.IoomFailureHandlerTest1%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], crd=false, evt=DISCOVERY_CUSTOM_EVT, evtNode=a0102b3f-b99f-4ba5-b90d-322d78800000, customEvt=ChangeGlobalStateMessage [id=10fab593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqId=7ef1f1a4-a98b-4296-b698-ac1de977670e, initiatingNodeId=a0102b3f-b99f-4ba5-b90d-322d78800000, state=ACTIVE, baselineTopology=BaselineTopology [id=0, branchingHash=-933571257, branchingType='New BaselineTopology', baselineNodes=[b036289d-7287-4e61-88c1-20e0b0ee26a0, 144ec592-3f61-4150-b22b-c2c554b8328c]], forceChangeBaselineTopology=false, timestamp=1637344858598, forceDeactivation=true], allowMerge=false, exchangeFreeSwitch=false] [21:00:58] : [Step 4/5] [2021-11-19 21:00:58,665][INFO ][exchange-worker-#500%failure.IoomFailureHandlerTest1%][GridDhtPartitionsExchangeFuture] Start activation process [nodeId=13e69dcd-2739-4ed1-84d2-2dea0c500001, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]]. New state: ACTIVE [21:00:58] : [Step 4/5] [2021-11-19 21:00:58,666][INFO ][exchange-worker-#500%failure.IoomFailureHandlerTest1%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/node01-b036289d-7287-4e61-88c1-20e0b0ee26a0 [21:00:58] : [Step 4/5] [2021-11-19 21:00:58,680][INFO ][exchange-worker-#500%failure.IoomFailureHandlerTest1%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/node01-b036289d-7287-4e61-88c1-20e0b0ee26a0/0000000000000000.wal, offset=9438, ver=2] [21:00:58] : [Step 4/5] [2021-11-19 21:00:58,682][INFO ][exchange-worker-#500%failure.IoomFailureHandlerTest1%][GridClusterStateProcessor] Writing BaselineTopology[id=0] [21:00:58] : [Step 4/5] [2021-11-19 21:00:58,703][INFO ][exchange-worker-#500%failure.IoomFailureHandlerTest1%][GridCacheDatabaseSharedManager] Finish recovery performed in 36 ms. [21:00:58] : [Step 4/5] [2021-11-19 21:00:58,705][INFO ][exchange-worker-#376%failure.IoomFailureHandlerTest0%][GridCacheDatabaseSharedManager] Finish recovery performed in 64 ms. [21:00:58] : [Step 4/5] [2021-11-19 21:00:58,715][INFO ][exchange-worker-#500%failure.IoomFailureHandlerTest1%][msg] Components activation performed in 49 ms. [21:00:58] : [Step 4/5] [2021-11-19 21:00:58,716][INFO ][exchange-worker-#376%failure.IoomFailureHandlerTest0%][msg] Components activation performed in 78 ms. [21:00:58] : [Step 4/5] [2021-11-19 21:00:58,751][INFO ][exchange-worker-#376%failure.IoomFailureHandlerTest0%][GridCacheProcessor] Finished recovery for cache [cache=ignite-sys-cache, grp=ignite-sys-cache, startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:00:58] : [Step 4/5] [2021-11-19 21:00:58,757][INFO ][exchange-worker-#500%failure.IoomFailureHandlerTest1%][GridCacheProcessor] Finished recovery for cache [cache=ignite-sys-cache, grp=ignite-sys-cache, startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:00:58] : [Step 4/5] [2021-11-19 21:00:58,795][INFO ][sys-#486%failure.IoomFailureHandlerTest1%][MvccProcessorImpl] Mvcc processor started. [21:00:58] : [Step 4/5] [2021-11-19 21:00:58,796][INFO ][sys-#486%failure.IoomFailureHandlerTest1%][GridCacheProcessor] Finished recovery for cache [cache=default, grp=default, startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:00:58] : [Step 4/5] [2021-11-19 21:00:58,804][INFO ][exchange-worker-#376%failure.IoomFailureHandlerTest0%][MvccProcessorImpl] Mvcc processor started. [21:00:58] : [Step 4/5] [2021-11-19 21:00:58,805][INFO ][exchange-worker-#376%failure.IoomFailureHandlerTest0%][GridCacheProcessor] Finished recovery for cache [cache=default, grp=default, startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:00:58] : [Step 4/5] [2021-11-19 21:00:58,840][INFO ][exchange-worker-#500%failure.IoomFailureHandlerTest1%][GridDhtPartitionsExchangeFuture] Successfully activated caches [nodeId=13e69dcd-2739-4ed1-84d2-2dea0c500001, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], newState=ACTIVE] [21:00:58] : [Step 4/5] [2021-11-19 21:00:58,841][INFO ][exchange-worker-#376%failure.IoomFailureHandlerTest0%][GridDhtPartitionsExchangeFuture] Successfully activated caches [nodeId=a0102b3f-b99f-4ba5-b90d-322d78800000, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], newState=ACTIVE] [21:00:58] : [Step 4/5] [2021-11-19 21:00:58,846][INFO ][exchange-worker-#376%failure.IoomFailureHandlerTest0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:00:58] : [Step 4/5] [2021-11-19 21:00:58,846][INFO ][exchange-worker-#500%failure.IoomFailureHandlerTest1%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:00:59] : [Step 4/5] [2021-11-19 21:00:59,124][INFO ][exchange-worker-#376%failure.IoomFailureHandlerTest0%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], crd=true] [21:00:59] : [Step 4/5] [2021-11-19 21:00:59,131][INFO ][grid-nio-worker-tcp-comm-0-#313%TcpCommunicationSpi%][TcpCommunicationSpi] Accepted incoming communication connection [locAddr=/127.0.0.1:45010, rmtAddr=/127.0.0.1:38674] [21:00:59] : [Step 4/5] [2021-11-19 21:00:59,134][INFO ][grid-nio-worker-tcp-comm-0-#433%TcpCommunicationSpi%][TcpCommunicationSpi] Established outgoing communication connection [locAddr=/127.0.0.1:38674, rmtAddr=/127.0.0.1:45010] [21:00:59] : [Step 4/5] [2021-11-19 21:00:59,135][INFO ][exchange-worker-#500%failure.IoomFailureHandlerTest1%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], crd=false] [21:00:59] : [Step 4/5] [2021-11-19 21:00:59,147][INFO ][sys-#358%failure.IoomFailureHandlerTest0%][GridDhtPartitionsExchangeFuture] Coordinator received single message [ver=AffinityTopologyVersion [topVer=2, minorTopVer=1], node=13e69dcd-2739-4ed1-84d2-2dea0c500001, allReceived=true] [21:00:59] : [Step 4/5] [2021-11-19 21:00:59,148][INFO ][sys-#358%failure.IoomFailureHandlerTest0%][GridDhtPartitionsExchangeFuture] finishExchangeOnCoordinator [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:00:59] : [Step 4/5] [2021-11-19 21:00:59,203][INFO ][sys-#358%failure.IoomFailureHandlerTest0%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], err=null, rebalanced=true, wasRebalanced=false] [21:00:59] : [Step 4/5] [2021-11-19 21:00:59,203][INFO ][disco-notifier-worker-#371%failure.IoomFailureHandlerTest0%][GridClusterStateProcessor] Received state change finish message: ACTIVE [21:00:59] : [Step 4/5] [2021-11-19 21:00:59,204][INFO ][disco-notifier-worker-#371%failure.IoomFailureHandlerTest0%][GridClusterStateProcessor] Cluster state was changed from INACTIVE to ACTIVE [21:00:59] : [Step 4/5] [2021-11-19 21:00:59,211][INFO ][disco-notifier-worker-#491%failure.IoomFailureHandlerTest1%][GridClusterStateProcessor] Received state change finish message: ACTIVE [21:00:59] : [Step 4/5] [2021-11-19 21:00:59,211][INFO ][disco-notifier-worker-#491%failure.IoomFailureHandlerTest1%][GridClusterStateProcessor] Cluster state was changed from INACTIVE to ACTIVE [21:00:59] : [Step 4/5] [2021-11-19 21:00:59,228][INFO ][sys-#473%failure.IoomFailureHandlerTest1%][GridDhtPartitionsExchangeFuture] Received full message, will finish exchange [node=a0102b3f-b99f-4ba5-b90d-322d78800000, resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:00:59] : [Step 4/5] [2021-11-19 21:00:59,239][INFO ][sys-#474%failure.IoomFailureHandlerTest1%][GridCachePartitionExchangeManager] Delay process full message without exchange id (there is exchange in progress) [nodeId=a0102b3f-b99f-4ba5-b90d-322d78800000] [21:00:59] : [Step 4/5] [2021-11-19 21:00:59,246][INFO ][sys-#473%failure.IoomFailureHandlerTest1%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], err=null, rebalanced=true, wasRebalanced=false] [21:00:59] : [Step 4/5] [2021-11-19 21:00:59,263][INFO ][sys-#358%failure.IoomFailureHandlerTest0%][GridCacheProcessor] Finish proxy initialization, cacheName=default, localNodeId=a0102b3f-b99f-4ba5-b90d-322d78800000 [21:00:59] : [Step 4/5] [2021-11-19 21:00:59,263][INFO ][sys-#358%failure.IoomFailureHandlerTest0%][GridCacheProcessor] Finish proxy initialization, cacheName=ignite-sys-cache, localNodeId=a0102b3f-b99f-4ba5-b90d-322d78800000 [21:00:59] : [Step 4/5] [2021-11-19 21:00:59,266][INFO ][sys-#359%failure.IoomFailureHandlerTest0%][DistributedBaselineConfiguration] Baseline auto-adjust is 'disabled' with timeout='300000' ms [21:00:59] : [Step 4/5] [2021-11-19 21:00:59,267][INFO ][sys-#359%failure.IoomFailureHandlerTest0%][GridClusterStateProcessor] Successfully performed final activation steps [nodeId=a0102b3f-b99f-4ba5-b90d-322d78800000, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:00:59] : [Step 4/5] [2021-11-19 21:00:59,274][INFO ][exchange-worker-#376%failure.IoomFailureHandlerTest0%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=2, minorTopVer=1], force=false, evt=DISCOVERY_CUSTOM_EVT, node=a0102b3f-b99f-4ba5-b90d-322d78800000] [21:00:59] : [Step 4/5] [2021-11-19 21:00:59,275][INFO ][sys-#473%failure.IoomFailureHandlerTest1%][GridCacheProcessor] Finish proxy initialization, cacheName=default, localNodeId=13e69dcd-2739-4ed1-84d2-2dea0c500001 [21:00:59] : [Step 4/5] [2021-11-19 21:00:59,275][INFO ][sys-#473%failure.IoomFailureHandlerTest1%][GridCacheProcessor] Finish proxy initialization, cacheName=ignite-sys-cache, localNodeId=13e69dcd-2739-4ed1-84d2-2dea0c500001 [21:00:59] : [Step 4/5] [2021-11-19 21:00:59,275][INFO ][sys-#358%failure.IoomFailureHandlerTest0%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=a0102b3f-b99f-4ba5-b90d-322d78800000, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=a0102b3f-b99f-4ba5-b90d-322d78800000, consistentId=144ec592-3f61-4150-b22b-c2c554b8328c, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637344859228, loc=true, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:00:59] : [Step 4/5] [2021-11-19 21:00:59,278][INFO ][sys-#467%failure.IoomFailureHandlerTest1%][DistributedBaselineConfiguration] Baseline auto-adjust is 'disabled' with timeout='300000' ms [21:00:59] : [Step 4/5] [2021-11-19 21:00:59,280][INFO ][sys-#467%failure.IoomFailureHandlerTest1%][GridClusterStateProcessor] Successfully performed final activation steps [nodeId=13e69dcd-2739-4ed1-84d2-2dea0c500001, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:00:59] : [Step 4/5] [2021-11-19 21:00:59,281][INFO ][sys-#473%failure.IoomFailureHandlerTest1%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=13e69dcd-2739-4ed1-84d2-2dea0c500001, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=a0102b3f-b99f-4ba5-b90d-322d78800000, consistentId=144ec592-3f61-4150-b22b-c2c554b8328c, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637344858420, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:00:59] : [Step 4/5] [2021-11-19 21:00:59,280][INFO ][sys-#358%failure.IoomFailureHandlerTest0%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], stage="Waiting in exchange queue" (1 ms), stage="Exchange parameters initialization" (1 ms), stage="Update caches registry" (111 ms), stage="Start caches" (56 ms), stage="Affinity initialization on cache group start" (35 ms), stage="Determine exchange type" (5 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Restore partition states" (6 ms), stage="After states restored callback" (267 ms), stage="WAL history reservation" (2 ms), stage="Waiting for all single messages" (24 ms), stage="Affinity recalculation (crd)" (0 ms), stage="Collect update counters and create affinity messages" (0 ms), stage="Assign partitions states" (12 ms), stage="Validate partitions states" (1 ms), stage="Ideal affinity diff calculation (enforced)" (7 ms), stage="Apply update counters" (0 ms), stage="Full message preparing" (30 ms), stage="Full message sending" (0 ms), stage="State finish message sending" (1 ms), stage="Detect lost partitions" (32 ms), stage="Exchange done" (44 ms), stage="Total time" (635 ms), Discovery lag=31 ms, Latest started node id=13e69dcd-2739-4ed1-84d2-2dea0c500001] [21:00:59] : [Step 4/5] [2021-11-19 21:00:59,285][INFO ][sys-#358%failure.IoomFailureHandlerTest0%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], stage="Affinity initialization on cache group start [grp=default]" (13 ms) (parent=Affinity initialization on cache group start), stage="Affinity initialization on cache group start [grp=ignite-sys-cache]" (7 ms) (parent=Affinity initialization on cache group start), stage="Affinity centralized initialization (crd) [grp=ignite-sys-cache, crd=true]" (1 ms) (parent=Determine exchange type), stage="Affinity centralized initialization (crd) [grp=default, crd=true]" (0 ms) (parent=Determine exchange type), stage="Restore partition states [grp=ignite-sys-cache]" (6 ms) (parent=Restore partition states), stage="Restore partition states [grp=default]" (6 ms) (parent=Restore partition states), stage="Affinity recalculation (partitions availability) [grp=default]" (6 ms) (parent=Ideal affinity diff calculation (enforced)), stage="Affinity recalculation (partitions availability) [grp=ignite-sys-cache]" (1 ms) (parent=Ideal affinity diff calculation (enforced))] [21:00:59] : [Step 4/5] [2021-11-19 21:00:59,282][INFO ][sys-#473%failure.IoomFailureHandlerTest1%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (1 ms), stage="Update caches registry" (79 ms), stage="Start caches" (52 ms), stage="Affinity initialization on cache group start" (41 ms), stage="Determine exchange type" (6 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (1 ms), stage="Restore partition states" (11 ms), stage="After states restored callback" (262 ms), stage="WAL history reservation" (1 ms), stage="Waiting for Full message" (104 ms), stage="Affinity recalculation" (6 ms), stage="Full map updating" (11 ms), stage="Detect lost partitions" (17 ms), stage="Exchange done" (18 ms), stage="Total time" (610 ms)] [21:00:59] : [Step 4/5] [2021-11-19 21:00:59,290][INFO ][sys-#473%failure.IoomFailureHandlerTest1%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], stage="Affinity initialization on cache group start [grp=ignite-sys-cache]" (26 ms) (parent=Affinity initialization on cache group start), stage="Affinity initialization on cache group start [grp=default]" (25 ms) (parent=Affinity initialization on cache group start), stage="Affinity centralized initialization (crd) [grp=ignite-sys-cache, crd=false]" (1 ms) (parent=Determine exchange type), stage="Affinity centralized initialization (crd) [grp=default, crd=false]" (1 ms) (parent=Determine exchange type), stage="Restore partition states [grp=ignite-sys-cache]" (11 ms) (parent=Restore partition states), stage="Restore partition states [grp=default]" (11 ms) (parent=Restore partition states), stage="Affinity applying from full message [grp=ignite-sys-cache]" (5 ms) (parent=Affinity recalculation), stage="Affinity applying from full message [grp=default]" (4 ms) (parent=Affinity recalculation)] [21:00:59] : [Step 4/5] [2021-11-19 21:00:59,282][INFO ][exchange-worker-#500%failure.IoomFailureHandlerTest1%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=2, minorTopVer=1], force=false, evt=DISCOVERY_CUSTOM_EVT, node=a0102b3f-b99f-4ba5-b90d-322d78800000] [21:00:59] : [Step 4/5] [2021-11-19 21:00:59,292][INFO ][test-runner-#258%failure.IoomFailureHandlerTest%][root] awaitPartitionMapExchange finished [21:00:59] : [Step 4/5] [2021-11-19 21:00:59,434][INFO ][db-checkpoint-thread-#519%failure.IoomFailureHandlerTest1%][Checkpointer] Checkpoint started [checkpointId=244c0e25-bf0e-4242-9ec6-66ad4997e61c, startPtr=WALPointer [idx=0, fileOff=126604, len=12134], checkpointBeforeLockTime=55ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=6ms, checkpointLockHoldTime=24ms, walCpRecordFsyncDuration=210ms, writeCheckpointEntryDuration=93ms, splitAndSortCpPagesDuration=9ms, pages=36, reason='node started'] [21:00:59] : [Step 4/5] [2021-11-19 21:00:59,434][INFO ][db-checkpoint-thread-#517%failure.IoomFailureHandlerTest0%][Checkpointer] Checkpoint started [checkpointId=933291b2-f661-4974-ad7e-220af4c53611, startPtr=WALPointer [idx=0, fileOff=123108, len=11260], checkpointBeforeLockTime=57ms, checkpointLockWait=1ms, checkpointListenersExecuteTime=12ms, checkpointLockHoldTime=33ms, walCpRecordFsyncDuration=210ms, writeCheckpointEntryDuration=94ms, splitAndSortCpPagesDuration=7ms, pages=36, reason='node started'] [21:00:59] : [Step 4/5] [2021-11-19 21:00:59,551][INFO ][db-checkpoint-thread-#519%failure.IoomFailureHandlerTest1%][Checkpointer] Checkpoint finished [cpId=244c0e25-bf0e-4242-9ec6-66ad4997e61c, pages=36, markPos=WALPointer [idx=0, fileOff=126604, len=12134], walSegmentsCovered=[], markDuration=342ms, pagesWrite=66ms, fsync=46ms, total=509ms] [21:00:59] : [Step 4/5] [2021-11-19 21:00:59,577][INFO ][db-checkpoint-thread-#517%failure.IoomFailureHandlerTest0%][Checkpointer] Checkpoint finished [cpId=933291b2-f661-4974-ad7e-220af4c53611, pages=36, markPos=WALPointer [idx=0, fileOff=123108, len=11260], walSegmentsCovered=[], markDuration=351ms, pagesWrite=97ms, fsync=41ms, total=547ms] [21:00:59] : [Step 4/5] [2021-11-19 21:00:59,937][INFO ][test-runner-#258%failure.IoomFailureHandlerTest%][GridDeploymentLocalStore] Class locally deployed: class [B [21:01:06] : [Step 4/5] [2021-11-19 21:01:06,007][INFO ][db-checkpoint-thread-#519%failure.IoomFailureHandlerTest1%][Checkpointer] Checkpoint started [checkpointId=2411fe4c-e424-4b2d-99bd-b2d7b064b607, startPtr=WALPointer [idx=0, fileOff=10804500, len=12118], checkpointBeforeLockTime=85ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=26ms, checkpointLockHoldTime=27ms, walCpRecordFsyncDuration=8ms, writeCheckpointEntryDuration=4ms, splitAndSortCpPagesDuration=24ms, pages=7371, reason='too many dirty pages'] [21:01:08]W: [org.apache.ignite:ignite-core] [2021-11-19 21:01:08,367][WARN ][sys-stripe-4-#383%failure.IoomFailureHandlerTest1%][PageMemoryImpl] Page replacements started, pages will be rotated with disk, this will affect storage performance (consider increasing DataRegionConfiguration#setMaxSize for data region): dfltPlc [21:01:10] : [Step 4/5] [2021-11-19 21:01:10,976][INFO ][db-checkpoint-thread-#519%failure.IoomFailureHandlerTest1%][Checkpointer] Checkpoint finished [cpId=2411fe4c-e424-4b2d-99bd-b2d7b064b607, pages=7371, markPos=WALPointer [idx=0, fileOff=10804500, len=12118], walSegmentsCovered=[], markDuration=66ms, pagesWrite=333ms, fsync=4634ms, total=5118ms] [21:01:12] : [Step 4/5] [2021-11-19 21:01:12,774][INFO ][db-checkpoint-thread-#519%failure.IoomFailureHandlerTest1%][Checkpointer] Checkpoint started [checkpointId=85e605fc-305f-4f92-9126-b7799ff77a86, startPtr=WALPointer [idx=0, fileOff=34526104, len=12118], checkpointBeforeLockTime=31ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=2ms, checkpointLockHoldTime=4ms, walCpRecordFsyncDuration=19ms, writeCheckpointEntryDuration=2ms, splitAndSortCpPagesDuration=9ms, pages=7823, reason='too many dirty pages'] [21:01:13] : [Step 4/5] [2021-11-19 21:01:13,105][INFO ][test-runner-#258%failure.IoomFailureHandlerTest%][root] >>> Stopping grid [name=failure.IoomFailureHandlerTest1, id=13e69dcd-2739-4ed1-84d2-2dea0c500001] [21:01:17] : [Step 4/5] [2021-11-19 21:01:17,523][INFO ][db-checkpoint-thread-#519%failure.IoomFailureHandlerTest1%][Checkpointer] Checkpoint finished [cpId=85e605fc-305f-4f92-9126-b7799ff77a86, pages=7823, markPos=WALPointer [idx=0, fileOff=34526104, len=12118], walSegmentsCovered=[], markDuration=35ms, pagesWrite=95ms, fsync=4653ms, total=4814ms] [21:01:17] : [Step 4/5] [2021-11-19 21:01:17,581][INFO ][db-checkpoint-thread-#519%failure.IoomFailureHandlerTest1%][Checkpointer] Checkpoint started [checkpointId=9a36a32c-238b-40bb-9f5b-11ccfbf5053e, startPtr=WALPointer [idx=0, fileOff=40013464, len=12118], checkpointBeforeLockTime=29ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=4ms, checkpointLockHoldTime=5ms, walCpRecordFsyncDuration=13ms, writeCheckpointEntryDuration=3ms, splitAndSortCpPagesDuration=5ms, pages=2297, reason='timeout'] [21:01:21] : [Step 4/5] [2021-11-19 21:01:21,149][INFO ][db-checkpoint-thread-#519%failure.IoomFailureHandlerTest1%][Checkpointer] Checkpoint finished [cpId=9a36a32c-238b-40bb-9f5b-11ccfbf5053e, pages=2297, markPos=WALPointer [idx=0, fileOff=40013464, len=12118], walSegmentsCovered=[], markDuration=28ms, pagesWrite=40ms, fsync=3528ms, total=3625ms] [21:01:21] : [Step 4/5] [2021-11-19 21:01:21,158][INFO ][tcp-disco-sock-reader-[a0102b3f 127.0.0.1:37647]-#26%failure.IoomFailureHandlerTest1%-#496%failure.IoomFailureHandlerTest1%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:37647, rmtPort=37647, rmtNodeId=a0102b3f-b99f-4ba5-b90d-322d78800000] [21:01:21] : [Step 4/5] [2021-11-19 21:01:21,159][INFO ][disco-event-worker-#375%failure.IoomFailureHandlerTest0%][GridDiscoveryManager] Node left topology: TcpDiscoveryNode [id=13e69dcd-2739-4ed1-84d2-2dea0c500001, consistentId=b036289d-7287-4e61-88c1-20e0b0ee26a0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637344858327, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false] [21:01:21] : [Step 4/5] [2021-11-19 21:01:21,161][INFO ][disco-event-worker-#375%failure.IoomFailureHandlerTest0%][GridDiscoveryManager] Topology snapshot [ver=3, locNode=a0102b3f, servers=1, clients=0, state=ACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=a0102b3f-b99f-4ba5-b90d-322d78800000, consistentId=144ec592-3f61-4150-b22b-c2c554b8328c, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:01:21] : [Step 4/5] [2021-11-19 21:01:21,162][INFO ][test-runner-#258%failure.IoomFailureHandlerTest%][GridCacheProcessor] Stopped cache [cacheName=default] [21:01:21] : [Step 4/5] [2021-11-19 21:01:21,162][INFO ][disco-event-worker-#375%failure.IoomFailureHandlerTest0%][GridDiscoveryManager] ^-- Baseline [id=0, size=2, online=1, offline=1] [21:01:21] : [Step 4/5] [2021-11-19 21:01:21,163][INFO ][test-runner-#258%failure.IoomFailureHandlerTest%][GridCacheProcessor] Stopped cache [cacheName=ignite-sys-cache] [21:01:21]W: [org.apache.ignite:ignite-core] [2021-11-19 21:01:21,164][WARN ][grid-nio-worker-tcp-comm-0-#313%TcpCommunicationSpi%][TcpCommunicationSpi] Failed to shutdown socket [21:01:21]W: [org.apache.ignite:ignite-core] java.nio.channels.ClosedChannelException [21:01:21]W: [org.apache.ignite:ignite-core] at sun.nio.ch.SocketChannelImpl.shutdownOutput(SocketChannelImpl.java:795) [21:01:21]W: [org.apache.ignite:ignite-core] at sun.nio.ch.SocketAdaptor.shutdownOutput(SocketAdaptor.java:407) [21:01:21]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.close(IgniteUtils.java:4247) [21:01:21]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.closeKey(GridNioServer.java:2784) [21:01:21]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.close(GridNioServer.java:2835) [21:01:21]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.close(GridNioServer.java:2794) [21:01:21]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.bodyInternal(GridNioServer.java:2157) [21:01:21]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.body(GridNioServer.java:1910) [21:01:21]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:125) [21:01:21]W: [org.apache.ignite:ignite-core] at java.lang.Thread.run(Thread.java:748) [21:01:21] : [Step 4/5] [2021-11-19 21:01:21,168][INFO ][exchange-worker-#376%failure.IoomFailureHandlerTest0%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], crd=true, evt=NODE_LEFT, evtNode=13e69dcd-2739-4ed1-84d2-2dea0c500001, customEvt=null, allowMerge=false, exchangeFreeSwitch=true] [21:01:21] : [Step 4/5] [2021-11-19 21:01:21,176][INFO ][sys-#353%failure.IoomFailureHandlerTest0%][GridAffinityAssignmentCache] Local node affinity assignment distribution is not ideal [cache=default, expectedPrimary=1024.00, actualPrimary=489, expectedBackups=0.00, actualBackups=0, warningThreshold=50.00%] [21:01:21] : [Step 4/5] [2021-11-19 21:01:21,178][INFO ][exchange-worker-#376%failure.IoomFailureHandlerTest0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], waitTime=0ms, futInfo=NA, mode=DISTRIBUTED] [21:01:21] : [Step 4/5] [2021-11-19 21:01:21,179][INFO ][exchange-worker-#376%failure.IoomFailureHandlerTest0%][GridDhtPartitionsExchangeFuture] Finished waiting for partitions release latch: ServerLatch [permits=0, pendingAcks=HashSet [], super=CompletableLatch [id=CompletableLatchUid [id=exchange-free, topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0]]]] [21:01:21] : [Step 4/5] [2021-11-19 21:01:21,183][INFO ][exchange-worker-#376%failure.IoomFailureHandlerTest0%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], err=null, rebalanced=true, wasRebalanced=true] [21:01:21]W: [org.apache.ignite:ignite-core] [2021-11-19 21:01:21,188][WARN ][sys-#363%failure.IoomFailureHandlerTest0%][GridDhtPartitionTopologyImpl] Detected lost partitions [grp=default, parts=[0-1, 3, 5, 8, 10-11, 14, 16-18, 20-25, 27-28, 30, 33, 36-37, 42-43, 47, 50, 52-56, 58, 60-62, 64, 66, 69-72, 78-81, 83, 85-86, 88, 90-92, 95-97, 103, 106, 108-110, 112-115, 117, 119, 127-128, 135, 137, 139, 142, 144-145, 148-150, 159-160, 162, 164-165, 168, 170-172, 175, 178-180, 186, 191-192, 194, 196-205, 207-209, 214, 220, 223-225, 230-231, 233-236, 238-239, 242, 244-245, 247, 249-252, 254, 256, 260-261, 263, 265, 267, 271-274, 278, 280-281, 284-288, 291-293, 296-298, 302, 304-306, 308, 310, 316-318, 321, 323-325, 328, 330-332, 334, 337, 339-340, 342, 344, 346, 349-351, 353-354, 358, 360-362, 364, 366-371, 374-378, 380, 385-386, 388-391, 393-397, 405-411, 413-415, 417-419, 423, 427, 430, 432, 435-438, 441-446, 448, 453-458, 461-463, 466-469, 471, 473, 475, 478-480, 490-491, 495-499, 501-502, 505-506, 510-511, 513-515, 520-521, 523-526, 528-529, 531-532, 536-538, 541, 543, 550-551, 555-556, 559-560, 569, 573-576, 578, 583-585, 588, 590, 593-594, 599-601, 603, 606-609, 612-613, 616-619, 626, 628, 631, 633, 637, 641, 643-644, 646, 650-655, 657-658, 662-670, 673-675, 678-681, 683, 686, 688, 691-695, 697, 699, 701-703, 709, 713, 716, 718, 722-726, 730-731, 733-734, 737, 739, 741, 744-745, 747-748, 750, 755-761, 763, 766, 769, 772-774, 776, 779-789, 791, 795-799, 801-806, 811-812, 814-815, 818-819, 822, 825-826, 828, 831, 835-837, 839-840, 843-846, 849-850, 852-854, 857, 863-865, 867-870, 873-874, 876, 878-880, 882, 886-889, 891-894, 897, 899, 901, 905, 914-915, 917-918, 921, 925, 928-930, 932, 934-935, 938, 942-944, 946-949, 955-959, 961-964, 969-970, 975-976, 978-979, 982-983, 985, 988, 992-993, 995, 1000-1002, 1004, 1007, 1009, 1011-1015, 1018-1021], topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0]] [21:01:21] : [Step 4/5] [2021-11-19 21:01:21,195][INFO ][exchange-worker-#376%failure.IoomFailureHandlerTest0%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=a0102b3f-b99f-4ba5-b90d-322d78800000, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], evt=NODE_LEFT, evtNode=TcpDiscoveryNode [id=13e69dcd-2739-4ed1-84d2-2dea0c500001, consistentId=b036289d-7287-4e61-88c1-20e0b0ee26a0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637344858327, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0]] [21:01:21] : [Step 4/5] [2021-11-19 21:01:21,197][INFO ][exchange-worker-#376%failure.IoomFailureHandlerTest0%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (0 ms), stage="Determine exchange type" (8 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release latch [latch=exchange-free]" (1 ms), stage="After states restored callback" (0 ms), stage="WAL history reservation" (0 ms), stage="Finalize update counters" (1 ms), stage="Detect lost partitions" (11 ms), stage="Exchange done" (3 ms), stage="Total time" (24 ms)] [21:01:21] : [Step 4/5] [2021-11-19 21:01:21,198][INFO ][exchange-worker-#376%failure.IoomFailureHandlerTest0%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], stage="Affinity initialization (exchange-free switch on fully-rebalanced topology) [grp=default]" (8 ms) (parent=Determine exchange type), stage="Affinity initialization (exchange-free switch on fully-rebalanced topology) [grp=ignite-sys-cache]" (5 ms) (parent=Determine exchange type)] [21:01:21] : [Step 4/5] [2021-11-19 21:01:21,200][INFO ][exchange-worker-#376%failure.IoomFailureHandlerTest0%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], crd=true] [21:01:21] : [Step 4/5] [2021-11-19 21:01:21,204][INFO ][exchange-worker-#376%failure.IoomFailureHandlerTest0%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=3, minorTopVer=0], force=false, evt=NODE_LEFT, node=13e69dcd-2739-4ed1-84d2-2dea0c500001] [21:01:21] : [Step 4/5] [2021-11-19 21:01:21,221][INFO ][test-runner-#258%failure.IoomFailureHandlerTest%][FilePageStoreManager] Cleanup cache stores [total=4, left=0, cleanFiles=false] [21:01:21] : [Step 4/5] [2021-11-19 21:01:21,224][INFO ][test-runner-#258%failure.IoomFailureHandlerTest%][GridDeploymentLocalStore] Removed undeployed class: GridDeployment [ts=1637344859196, depMode=SHARED, clsLdr=IsolatedClassLoader{roleName='test'}, clsLdrId=d1fab593d71-13e69dcd-2739-4ed1-84d2-2dea0c500001, userVer=0, loc=true, sampleClsName=org.apache.ignite.internal.processors.cache.distributed.dht.preloader.GridDhtPartitionFullMap, pendingUndeploy=false, undeployed=true, usage=0] [21:01:21] : [Step 4/5] [2021-11-19 21:01:21,237][INFO ][test-runner-#258%failure.IoomFailureHandlerTest%][IoomFailureHandlerTest1] [21:01:21] : [Step 4/5] [21:01:21] : [Step 4/5] >>> +------------------------------------------------------+ [21:01:21] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV stopped OK [21:01:21] : [Step 4/5] >>> +------------------------------------------------------+ [21:01:21] : [Step 4/5] >>> Ignite instance name: failure.IoomFailureHandlerTest1 [21:01:21] : [Step 4/5] >>> Grid uptime: 00:00:22.654 [21:01:21] : [Step 4/5] [21:01:21] : [Step 4/5] [21:01:21] : [Step 4/5] [2021-11-19 21:01:21,238][INFO ][test-runner-#258%failure.IoomFailureHandlerTest%][root] >>> Stopping grid [name=failure.IoomFailureHandlerTest0, id=a0102b3f-b99f-4ba5-b90d-322d78800000] [21:01:21] : [Step 4/5] [2021-11-19 21:01:21,252][INFO ][db-checkpoint-thread-#517%failure.IoomFailureHandlerTest0%][Checkpointer] Checkpoint started [checkpointId=7b9eb82f-f518-4f25-b851-0786ec9ce29e, startPtr=WALPointer [idx=0, fileOff=136765, len=11244], checkpointBeforeLockTime=3ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=2ms, walCpRecordFsyncDuration=0ms, writeCheckpointEntryDuration=2ms, splitAndSortCpPagesDuration=0ms, pages=1, reason='timeout'] [21:01:21] : [Step 4/5] [2021-11-19 21:01:21,263][INFO ][db-checkpoint-thread-#517%failure.IoomFailureHandlerTest0%][Checkpointer] Checkpoint finished [cpId=7b9eb82f-f518-4f25-b851-0786ec9ce29e, pages=1, markPos=WALPointer [idx=0, fileOff=136765, len=11244], walSegmentsCovered=[], markDuration=6ms, pagesWrite=0ms, fsync=10ms, total=19ms] [21:01:21] : [Step 4/5] [2021-11-19 21:01:21,268][INFO ][db-checkpoint-thread-#517%failure.IoomFailureHandlerTest0%][Checkpointer] Skipping checkpoint (no pages were modified) [checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=1ms, checkpointLockHoldTime=3ms, reason='timeout'] [21:01:21]W: [org.apache.ignite:ignite-core] [2021-11-19 21:01:21,275][WARN ][tcp-disco-sock-reader-[13e69dcd 127.0.0.1:49221]-#27%failure.IoomFailureHandlerTest0%-#497%failure.IoomFailureHandlerTest0%][TestTcpDiscoverySpi] Failed to shutdown socket [21:01:21]W: [org.apache.ignite:ignite-core] java.net.SocketException: Socket is closed [21:01:21]W: [org.apache.ignite:ignite-core] at java.net.Socket.shutdownOutput(Socket.java:1568) [21:01:21]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.close(IgniteUtils.java:4247) [21:01:21]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.discovery.tcp.ServerImpl$SocketReader.body(ServerImpl.java:7370) [21:01:21]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.IgniteSpiThread.run(IgniteSpiThread.java:58) [21:01:21] : [Step 4/5] [2021-11-19 21:01:21,276][INFO ][tcp-disco-sock-reader-[13e69dcd 127.0.0.1:49221]-#27%failure.IoomFailureHandlerTest0%-#497%failure.IoomFailureHandlerTest0%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:49221, rmtPort=49221, rmtNodeId=13e69dcd-2739-4ed1-84d2-2dea0c500001] [21:01:21] : [Step 4/5] [2021-11-19 21:01:21,279][INFO ][test-runner-#258%failure.IoomFailureHandlerTest%][GridCacheProcessor] Stopped cache [cacheName=default] [21:01:21] : [Step 4/5] [2021-11-19 21:01:21,280][INFO ][test-runner-#258%failure.IoomFailureHandlerTest%][GridCacheProcessor] Stopped cache [cacheName=ignite-sys-cache] [21:01:21] : [Step 4/5] [2021-11-19 21:01:21,287][INFO ][test-runner-#258%failure.IoomFailureHandlerTest%][FilePageStoreManager] Cleanup cache stores [total=4, left=0, cleanFiles=false] [21:01:21] : [Step 4/5] [2021-11-19 21:01:21,289][INFO ][test-runner-#258%failure.IoomFailureHandlerTest%][GridDeploymentLocalStore] Removed undeployed class: GridDeployment [ts=1637344859132, depMode=SHARED, clsLdr=IsolatedClassLoader{roleName='test'}, clsLdrId=a1fab593d71-a0102b3f-b99f-4ba5-b90d-322d78800000, userVer=0, loc=true, sampleClsName=org.apache.ignite.internal.processors.cache.distributed.dht.preloader.GridDhtPartitionMap, pendingUndeploy=false, undeployed=true, usage=0] [21:01:21] : [Step 4/5] [2021-11-19 21:01:21,303][INFO ][test-runner-#258%failure.IoomFailureHandlerTest%][IoomFailureHandlerTest0] [21:01:21] : [Step 4/5] [21:01:21] : [Step 4/5] >>> +------------------------------------------------------+ [21:01:21] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV stopped OK [21:01:21] : [Step 4/5] >>> +------------------------------------------------------+ [21:01:21] : [Step 4/5] >>> Ignite instance name: failure.IoomFailureHandlerTest0 [21:01:21] : [Step 4/5] >>> Grid uptime: 00:00:25.248 [21:01:21] : [Step 4/5] [21:01:21] : [Step 4/5] [21:01:21] : [Step 4/5] [21:01:21] >>> Stopping test: IoomFailureHandlerTest#testIoomErrorMvccPdsHandling in 27793 ms <<< [21:01:21] : [Step 4/5] [2021-11-19 21:01:21,305][INFO ][main][root] >>> Stopping test: IoomFailureHandlerTest#testIoomErrorMvccPdsHandling in 27793 ms <<< [21:01:21] : [Step 4/5] [21:01:21] >>> Heap: 410 MB used / 1963 MB commited / 1963 MB max <<< [21:01:21] : [Step 4/5] [2021-11-19 21:01:21,306][INFO ][main][root] >>> Heap: 410 MB used / 1963 MB commited / 1963 MB max <<< [21:01:21] : [Step 4/5] [21:01:21] >>> Non-Heap: 98 MB used / 104 MB commited / 0 MB max <<< [21:01:21] : [Step 4/5] [2021-11-19 21:01:21,306][INFO ][main][root] >>> Non-Heap: 98 MB used / 104 MB commited / 0 MB max <<< [21:01:21] : [Step 4/5] [21:01:21] >>> Starting test: IoomFailureHandlerTest#testIoomErrorNoStoreHandling <<< [21:01:21] : [Step 4/5] [2021-11-19 21:01:21,675][INFO ][main][root] >>> Starting test: IoomFailureHandlerTest#testIoomErrorNoStoreHandling <<< [21:01:21] : [Step 4/5] [21:01:21] >>> Heap: 410 MB used / 1963 MB commited / 1963 MB max <<< [21:01:21] : [Step 4/5] [2021-11-19 21:01:21,675][INFO ][main][root] >>> Heap: 410 MB used / 1963 MB commited / 1963 MB max <<< [21:01:21] : [Step 4/5] [21:01:21] >>> Non-Heap: 98 MB used / 104 MB commited / 0 MB max <<< [21:01:21] : [Step 4/5] [2021-11-19 21:01:21,676][INFO ][main][root] >>> Non-Heap: 98 MB used / 104 MB commited / 0 MB max <<< [21:01:21]W: [org.apache.ignite:ignite-core] [2021-11-19 21:01:21,684][WARN ][test-runner-#538%failure.IoomFailureHandlerTest%][G] Ignite work directory is not provided, automatically resolved to: /opt/buildagent/work/7bc1c54bc719b67c/work [21:01:21] : [Step 4/5] [2021-11-19 21:01:21,686][INFO ][test-runner-#538%failure.IoomFailureHandlerTest%][IoomFailureHandlerTest0] [21:01:21] : [Step 4/5] [21:01:21] : [Step 4/5] >>> __________ ________________ [21:01:21] : [Step 4/5] >>> / _/ ___/ |/ / _/_ __/ __/ [21:01:21] : [Step 4/5] >>> _/ // (7 7 // / / / / _/ [21:01:21] : [Step 4/5] >>> /___/\___/_/|_/___/ /_/ /___/ [21:01:21] : [Step 4/5] >>> [21:01:21] : [Step 4/5] >>> ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:01:21] : [Step 4/5] >>> 2021 Copyright(C) Apache Software Foundation [21:01:21] : [Step 4/5] >>> [21:01:21] : [Step 4/5] >>> Ignite documentation: http://ignite.apache.org [21:01:21] : [Step 4/5] [21:01:21] : [Step 4/5] [2021-11-19 21:01:21,687][INFO ][test-runner-#538%failure.IoomFailureHandlerTest%][IoomFailureHandlerTest0] Config URL: n/a [21:01:21] : [Step 4/5] [2021-11-19 21:01:21,689][INFO ][test-runner-#538%failure.IoomFailureHandlerTest%][IoomFailureHandlerTest0] IgniteConfiguration [igniteInstanceName=failure.IoomFailureHandlerTest0, pubPoolSize=24, svcPoolSize=24, callbackPoolSize=24, stripedPoolSize=24, sysPoolSize=24, mgmtPoolSize=4, dataStreamerPoolSize=24, utilityCachePoolSize=24, utilityCacheKeepAliveTime=60000, p2pPoolSize=2, qryPoolSize=24, buildIdxPoolSize=4, igniteHome=/opt/buildagent/work/7bc1c54bc719b67c, igniteWorkDir=/opt/buildagent/work/7bc1c54bc719b67c/work, mbeanSrv=com.sun.jmx.mbeanserver.JmxMBeanServer@6fe85038, nodeId=1647b40b-5fc1-4c2b-96a4-2e569fb00000, marsh=BinaryMarshaller [], marshLocJobs=false, daemon=false, p2pEnabled=true, netTimeout=10000, netCompressionLevel=1, sndRetryDelay=1000, sndRetryCnt=3, metricsHistSize=10000, metricsUpdateFreq=1000, metricsExpTime=9223372036854775807, discoSpi=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=0, ackTimeout=0, marsh=null, reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], segPlc=STOP, segResolveAttempts=2, waitForSegOnStart=true, allResolversPassReq=true, segChkFreq=10000, commSpi=TcpCommunicationSpi [connectGate=org.apache.ignite.spi.communication.tcp.internal.ConnectGateway@7997049e, ctxInitLatch=java.util.concurrent.CountDownLatch@3058d6a5[Count = 1], stopping=false, clientPool=null, nioSrvWrapper=null, stateProvider=null], evtSpi=MemoryEventStorageSpi [expireAgeMs=9223372036854775807, expireCnt=10000, filter=null], colSpi=NoopCollisionSpi [], deploySpi=LocalDeploymentSpi [], indexingSpi=org.apache.ignite.spi.indexing.noop.NoopIndexingSpi@240aa945, addrRslvr=null, encryptionSpi=org.apache.ignite.spi.encryption.noop.NoopEncryptionSpi@4aa43880, tracingSpi=org.apache.ignite.spi.tracing.NoopTracingSpi@46e14d3b, clientMode=false, rebalanceThreadPoolSize=4, rebalanceTimeout=10000, rebalanceBatchesPrefetchCnt=3, rebalanceThrottle=0, rebalanceBatchSize=524288, txCfg=TransactionConfiguration [txSerEnabled=false, dfltIsolation=REPEATABLE_READ, dfltConcurrency=PESSIMISTIC, dfltTxTimeout=0, txTimeoutOnPartitionMapExchange=0, deadlockTimeout=10000, pessimisticTxLogSize=0, pessimisticTxLogLinger=10000, tmLookupClsName=null, txManagerFactory=null, useJtaSync=false], cacheSanityCheckEnabled=true, discoStartupDelay=60000, deployMode=SHARED, p2pMissedCacheSize=100, locHost=127.0.0.1, timeSrvPortBase=31100, timeSrvPortRange=100, failureDetectionTimeout=10000, sysWorkerBlockedTimeout=null, clientFailureDetectionTimeout=10000, metricsLogFreq=0, connectorCfg=null, odbcCfg=null, warmupClos=null, atomicCfg=AtomicConfiguration [seqReserveSize=1000, cacheMode=PARTITIONED, backups=1, aff=null, grpName=null], classLdr=null, sslCtxFactory=null, platformCfg=null, binaryCfg=null, memCfg=null, pstCfg=null, dsCfg=DataStorageConfiguration [sysRegionInitSize=41943040, sysRegionMaxSize=104857600, pageSize=2048, concLvl=0, dfltDataRegConf=DataRegionConfiguration [name=dfltPlc, maxSize=10485760, initSize=10485760, swapPath=null, pageEvictionMode=DISABLED, pageReplacementMode=CLOCK, evictionThreshold=0.9, emptyPagesPoolSize=100, metricsEnabled=false, metricsSubIntervalCount=5, metricsRateTimeInterval=60000, persistenceEnabled=false, checkpointPageBufSize=0, lazyMemoryAllocation=true, warmUpCfg=null], dataRegions=null, storagePath=null, checkpointFreq=180000, lockWaitTime=10000, checkpointThreads=4, checkpointWriteOrder=SEQUENTIAL, walHistSize=20, maxWalArchiveSize=1073741824, walSegments=10, walSegmentSize=67108864, walPath=db/wal, walArchivePath=db/wal/archive, cdcWalPath=db/wal/cdc, cdcEnabled=false, metricsEnabled=false, walMode=LOG_ONLY, walTlbSize=131072, walBuffSize=0, walFlushFreq=2000, walFsyncDelay=1000, walRecordIterBuffSize=67108864, alwaysWriteFullPages=false, fileIOFactory=org.apache.ignite.internal.processors.cache.persistence.file.AsyncFileIOFactory@f2bef42, metricsSubIntervalCnt=5, metricsRateTimeInterval=60000, walAutoArchiveAfterInactivity=-1, walForceArchiveTimeout=-1, writeThrottlingEnabled=false, walCompactionEnabled=false, walCompactionLevel=1, checkpointReadLockTimeout=null, walPageCompression=DISABLED, walPageCompressionLevel=null, dfltWarmUpCfg=null, encCfg=org.apache.ignite.configuration.EncryptionConfiguration@5c4caeae, defragmentationThreadPoolSize=4, minWalArchiveSize=-1], snapshotPath=snapshots, activeOnStart=true, activeOnStartPropSetFlag=false, autoActivation=true, autoActivationPropSetFlag=false, clusterStateOnStart=null, sqlConnCfg=null, cliConnCfg=ClientConnectorConfiguration [host=null, port=10800, portRange=100, sockSndBufSize=0, sockRcvBufSize=0, tcpNoDelay=true, maxOpenCursorsPerConn=128, threadPoolSize=24, selectorCnt=12, idleTimeout=0, handshakeTimeout=10000, jdbcEnabled=true, odbcEnabled=true, thinCliEnabled=true, sslEnabled=false, useIgniteSslCtxFactory=true, sslClientAuth=false, sslCtxFactory=null, thinCliCfg=ThinClientConfiguration [maxActiveTxPerConn=100, maxActiveComputeTasksPerConn=0]], mvccVacuumThreadCnt=2, mvccVacuumFreq=5000, authEnabled=false, failureHnd=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]], commFailureRslvr=null, sqlCfg=SqlConfiguration [longQryWarnTimeout=3000, dfltQryTimeout=0, sqlQryHistSize=1000, validationEnabled=false], asyncContinuationExecutor=null] [21:01:21] : [Step 4/5] [2021-11-19 21:01:21,698][INFO ][test-runner-#538%failure.IoomFailureHandlerTest%][IoomFailureHandlerTest0] Daemon mode: off [21:01:21] : [Step 4/5] [2021-11-19 21:01:21,698][INFO ][test-runner-#538%failure.IoomFailureHandlerTest%][IoomFailureHandlerTest0] OS: Linux 4.15.0-151-generic amd64 [21:01:21] : [Step 4/5] [2021-11-19 21:01:21,699][INFO ][test-runner-#538%failure.IoomFailureHandlerTest%][IoomFailureHandlerTest0] OS user: teamcity [21:01:21] : [Step 4/5] [2021-11-19 21:01:21,699][INFO ][test-runner-#538%failure.IoomFailureHandlerTest%][IoomFailureHandlerTest0] PID: 16724 [21:01:21] : [Step 4/5] [2021-11-19 21:01:21,700][INFO ][test-runner-#538%failure.IoomFailureHandlerTest%][IoomFailureHandlerTest0] Language runtime: Java Platform API Specification ver. 1.8 [21:01:21] : [Step 4/5] [2021-11-19 21:01:21,700][INFO ][test-runner-#538%failure.IoomFailureHandlerTest%][IoomFailureHandlerTest0] VM information: Java(TM) SE Runtime Environment 1.8.0_261-b12 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 25.261-b12 [21:01:21] : [Step 4/5] [2021-11-19 21:01:21,700][INFO ][test-runner-#538%failure.IoomFailureHandlerTest%][IoomFailureHandlerTest0] VM total memory: 1.9GB [21:01:21] : [Step 4/5] [2021-11-19 21:01:21,700][INFO ][test-runner-#538%failure.IoomFailureHandlerTest%][IoomFailureHandlerTest0] Remote Management [restart: off, REST: off, JMX (remote: off)] [21:01:21] : [Step 4/5] [2021-11-19 21:01:21,701][INFO ][test-runner-#538%failure.IoomFailureHandlerTest%][IoomFailureHandlerTest0] Logger: GridTestLog4jLogger [quiet=false, config=null] [21:01:21] : [Step 4/5] [2021-11-19 21:01:21,701][INFO ][test-runner-#538%failure.IoomFailureHandlerTest%][IoomFailureHandlerTest0] IGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c [21:01:21] : [Step 4/5] [2021-11-19 21:01:21,702][INFO ][test-runner-#538%failure.IoomFailureHandlerTest%][IoomFailureHandlerTest0] VM arguments: [-DIGNITE_DUMP_THREADS_ON_FAILURE=false, -DMono=/usr/bin/mono-sgen, -DMono4.0_x64=/usr/lib/mono/4.0, -DMono4.5_x64=/usr/lib/mono/4.5, -DMonoVersion=6.12.0.90, -DSKIP_BUILD=false, -Dagent.home.dir=/opt/buildagent, -Dagent.name=aitc-lin02_03, -Dagent.ownPort=9090, -Dagent.work.dir=/opt/buildagent/work, -Dbuild.number=95, -Dbuild.vcs.number=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.1=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.GitHubApacheIgnite=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dclassworlds.conf=/opt/buildagent/temp/buildTmp/teamcity.m2.conf, -Dcom.jetbrains.maven.watcher.report.file=/opt/buildagent/temp/buildTmp/maven-build-info.xml, -Djava.io.tmpdir=/opt/buildagent/temp/buildTmp, -Dmaven.home=/opt/buildagent/tools/maven3_6, -Dmaven.multiModuleProjectDirectory=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.agent.cpuBenchmark=457, -Dteamcity.agent.dotnet.agent_url=http://localhost:9090/RPC2, -Dteamcity.agent.dotnet.build_id=6278078, -Dteamcity.auth.password=*******, -Dteamcity.auth.userId=TeamCityBuildId=6278078, -Dteamcity.build.changedFiles.file=/opt/buildagent/temp/buildTmp/changedFiles6342607772318147725.txt, -Dteamcity.build.checkoutDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.build.id=6278078, -Dteamcity.build.properties.file=/opt/buildagent/temp/buildTmp/teamcity.build5164517880467851002.properties, -Dteamcity.build.tempDir=/opt/buildagent/temp/buildTmp, -Dteamcity.build.workingDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.buildConfName=Basic 3, -Dteamcity.buildType.id=IgniteTests24Java8_Basic3, -Dteamcity.configuration.properties.file=/opt/buildagent/temp/buildTmp/teamcity.config5591980786735343870.properties, -Dteamcity.maven.userSettings.path=/opt/buildagent/temp/buildTmp/maven_settings_585072866407032347.xml, -Dteamcity.maven.watcher.home=/opt/buildagent/plugins/mavenPlugin/maven-watcher-jdk16, -Dteamcity.projectName=Ignite Tests 2.x (JDK 8/11), -Dteamcity.runner.properties.file=/opt/buildagent/temp/buildTmp/teamcity.runner9098465561618137420.properties, -Dteamcity.tests.recentlyFailedTests.file=/opt/buildagent/temp/buildTmp/testsToRunFirst3891775683130404069.txt, -Dteamcity.version=2021.2 (build 99542), -ea, -Xms2g, -Xmx2g, -XX:+HeapDumpOnOutOfMemoryError, -DIGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_TEST_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_UPDATE_NOTIFIER=false, -DIGNITE_NO_DISCO_ORDER=true, -DIGNITE_PERFORMANCE_SUGGESTIONS_DISABLED=true, -Djava.net.preferIPv4Stack=true, -DTEST_SCALE_FACTOR=1.0, -DIGNITE_TEST_PROP_LOG4J_FILE=log4j-tc-test.xml, -DIGNITE_QUIET=false, -DIGNITE_MARSHAL_BUFFERS_RECHECK=1000, -Dmaven.repo.local=/opt/buildagent/.m2/repository] [21:01:21] : [Step 4/5] [2021-11-19 21:01:21,706][INFO ][test-runner-#538%failure.IoomFailureHandlerTest%][IoomFailureHandlerTest0] System cache's DataRegion size is configured to 40 MB. Use DataStorageConfiguration.systemRegionInitialSize property to change the setting. [21:01:21] : [Step 4/5] [2021-11-19 21:01:21,707][INFO ][test-runner-#538%failure.IoomFailureHandlerTest%][IoomFailureHandlerTest0] Configured caches [in 'sysMemPlc' dataRegion: ['ignite-sys-cache'], in 'dfltPlc' dataRegion: ['default']] [21:01:21]W: [org.apache.ignite:ignite-core] [2021-11-19 21:01:21,707][WARN ][test-runner-#538%failure.IoomFailureHandlerTest%][IoomFailureHandlerTest0] Peer class loading is enabled (disable it in production for performance and deployment consistency reasons) [21:01:21] : [Step 4/5] [2021-11-19 21:01:21,708][INFO ][test-runner-#538%failure.IoomFailureHandlerTest%][IoomFailureHandlerTest0] 3-rd party licenses can be found at: /opt/buildagent/work/7bc1c54bc719b67c/libs/licenses [21:01:21] : [Step 4/5] [2021-11-19 21:01:21,713][INFO ][test-runner-#538%failure.IoomFailureHandlerTest%][IgnitePluginProcessor] Configured plugins: [21:01:21] : [Step 4/5] [2021-11-19 21:01:21,713][INFO ][test-runner-#538%failure.IoomFailureHandlerTest%][IgnitePluginProcessor] ^-- StanByClusterTestProvider 1.0 [21:01:21] : [Step 4/5] [2021-11-19 21:01:21,713][INFO ][test-runner-#538%failure.IoomFailureHandlerTest%][IgnitePluginProcessor] ^-- null [21:01:21] : [Step 4/5] [2021-11-19 21:01:21,713][INFO ][test-runner-#538%failure.IoomFailureHandlerTest%][IgnitePluginProcessor] [21:01:21] : [Step 4/5] [2021-11-19 21:01:21,714][INFO ][test-runner-#538%failure.IoomFailureHandlerTest%][IgnitePluginProcessor] ^-- PageMemory tracker plugin 1.0 [21:01:21] : [Step 4/5] [2021-11-19 21:01:21,714][INFO ][test-runner-#538%failure.IoomFailureHandlerTest%][IgnitePluginProcessor] ^-- null [21:01:21] : [Step 4/5] [2021-11-19 21:01:21,714][INFO ][test-runner-#538%failure.IoomFailureHandlerTest%][IgnitePluginProcessor] [21:01:21] : [Step 4/5] [2021-11-19 21:01:21,714][INFO ][test-runner-#538%failure.IoomFailureHandlerTest%][IgnitePluginProcessor] ^-- TestDistibutedConfigurationPlugin 1.0 [21:01:21] : [Step 4/5] [2021-11-19 21:01:21,715][INFO ][test-runner-#538%failure.IoomFailureHandlerTest%][IgnitePluginProcessor] ^-- null [21:01:21] : [Step 4/5] [2021-11-19 21:01:21,715][INFO ][test-runner-#538%failure.IoomFailureHandlerTest%][IgnitePluginProcessor] [21:01:21] : [Step 4/5] [2021-11-19 21:01:21,715][INFO ][test-runner-#538%failure.IoomFailureHandlerTest%][IgnitePluginProcessor] ^-- NodeValidationPluginProvider 1.0 [21:01:21] : [Step 4/5] [2021-11-19 21:01:21,715][INFO ][test-runner-#538%failure.IoomFailureHandlerTest%][IgnitePluginProcessor] ^-- null [21:01:21] : [Step 4/5] [2021-11-19 21:01:21,716][INFO ][test-runner-#538%failure.IoomFailureHandlerTest%][IgnitePluginProcessor] [21:01:21] : [Step 4/5] [2021-11-19 21:01:21,716][INFO ][test-runner-#538%failure.IoomFailureHandlerTest%][FailureProcessor] Configured failure handler: [hnd=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]] [21:01:21] : [Step 4/5] [2021-11-19 21:01:21,743][INFO ][test-runner-#538%failure.IoomFailureHandlerTest%][TcpCommunicationSpi] Successfully bound communication NIO server to TCP port [port=45010, locHost=/127.0.0.1, selectorsCnt=12, selectorSpins=0, pairedConn=false] [21:01:21]W: [org.apache.ignite:ignite-core] [2021-11-19 21:01:21,743][WARN ][test-runner-#538%failure.IoomFailureHandlerTest%][TcpCommunicationSpi] Message queue limit is set to 0 which may lead to potential OOMEs when running cache operations in FULL_ASYNC or PRIMARY_SYNC modes due to message queues growth on sender and receiver sides. [21:01:21] : [Step 4/5] [2021-11-19 21:01:21,753][INFO ][test-runner-#538%failure.IoomFailureHandlerTest%][GridCollisionManager] Collision resolution is disabled (all jobs will be activated upon arrival). [21:01:21] : [Step 4/5] [2021-11-19 21:01:21,754][INFO ][test-runner-#538%failure.IoomFailureHandlerTest%][IoomFailureHandlerTest0] Security status [authentication=off, sandbox=off, tls/ssl=off] [21:01:21] : [Step 4/5] [2021-11-19 21:01:21,763][INFO ][test-runner-#538%failure.IoomFailureHandlerTest%][TestTcpDiscoverySpi] Successfully bound to TCP port [port=47500, localHost=localhost/127.0.0.1, locNodeId=1647b40b-5fc1-4c2b-96a4-2e569fb00000] [21:01:21] : [Step 4/5] [2021-11-19 21:01:21,766][INFO ][test-runner-#538%failure.IoomFailureHandlerTest%][IgniteCacheDatabaseSharedManager] Configured data regions initialized successfully [total=4] [21:01:21] : [Step 4/5] [2021-11-19 21:01:21,781][INFO ][test-runner-#538%failure.IoomFailureHandlerTest%][ClientListenerProcessor] Client connector processor has started on TCP port 10800 [21:01:21] : [Step 4/5] [2021-11-19 21:01:21,792][INFO ][test-runner-#538%failure.IoomFailureHandlerTest%][IoomFailureHandlerTest0] Non-loopback local IPs: 172.17.0.4 [21:01:21] : [Step 4/5] [2021-11-19 21:01:21,792][INFO ][test-runner-#538%failure.IoomFailureHandlerTest%][IoomFailureHandlerTest0] Enabled local MACs: 0242AC110004 [21:01:21] : [Step 4/5] [2021-11-19 21:01:21,796][INFO ][test-runner-#538%failure.IoomFailureHandlerTest%][ClusterProcessor] Cluster ID and tag has been read from metastorage: null [21:01:21] : [Step 4/5] [2021-11-19 21:01:21,796][INFO ][test-runner-#538%failure.IoomFailureHandlerTest%][IgniteClusterImpl] Shutdown policy was updated [oldVal=null, newVal=null] [21:01:21] : [Step 4/5] [2021-11-19 21:01:21,813][INFO ][disco-notifier-worker-#622%failure.IoomFailureHandlerTest0%][GridClusterStateProcessor] Received activate cluster request with BaselineTopology[id=0] initiator node ID: 1647b40b-5fc1-4c2b-96a4-2e569fb00000 [21:01:21] : [Step 4/5] [2021-11-19 21:01:21,814][INFO ][disco-notifier-worker-#622%failure.IoomFailureHandlerTest0%][GridClusterStateProcessor] Started state transition: activate cluster [21:01:21] : [Step 4/5] [2021-11-19 21:01:21,814][INFO ][disco-notifier-worker-#622%failure.IoomFailureHandlerTest0%][GridClusterStateProcessor] Received state change finish message: ACTIVE [21:01:21] : [Step 4/5] [2021-11-19 21:01:21,814][INFO ][disco-notifier-worker-#622%failure.IoomFailureHandlerTest0%][GridClusterStateProcessor] Cluster state was changed from ACTIVE to ACTIVE [21:01:21] : [Step 4/5] [2021-11-19 21:01:21,815][INFO ][disco-notifier-worker-#622%failure.IoomFailureHandlerTest0%][MvccProcessorImpl] Assigned mvcc coordinator [crd=MvccCoordinator [topVer=AffinityTopologyVersion [topVer=1, minorTopVer=0], nodeId=1647b40b-5fc1-4c2b-96a4-2e569fb00000, ver=1637344881804, local=true, initialized=false]] [21:01:21] : [Step 4/5] [2021-11-19 21:01:21,817][INFO ][sys-#627%failure.IoomFailureHandlerTest0%][ClusterProcessor] Writing cluster ID and tag to metastorage on ready for write ClusterIdAndTag [id=0bfeb73e-9e5f-4ea0-9328-ee0902b43f1f, tag=modest_borg] [21:01:21] : [Step 4/5] [2021-11-19 21:01:21,823][INFO ][disco-notifier-worker-#622%failure.IoomFailureHandlerTest0%][ClusterProcessor] modest_borg [21:01:21] : [Step 4/5] [2021-11-19 21:01:21,825][INFO ][disco-notifier-worker-#622%failure.IoomFailureHandlerTest0%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustEnabled' was changed from 'null' to 'true' [21:01:21] : [Step 4/5] [2021-11-19 21:01:21,831][INFO ][disco-notifier-worker-#622%failure.IoomFailureHandlerTest0%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustTimeout' was changed from 'null' to '0' [21:01:21] : [Step 4/5] [2021-11-19 21:01:21,847][INFO ][disco-notifier-worker-#622%failure.IoomFailureHandlerTest0%][IgniteTxManager] Transactions parameter 'longOperationsDumpTimeout' was changed from 'null' to '60000' [21:01:21] : [Step 4/5] [2021-11-19 21:01:21,847][INFO ][exchange-worker-#628%failure.IoomFailureHandlerTest0%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=1, minorTopVer=0], crd=true, evt=NODE_JOINED, evtNode=1647b40b-5fc1-4c2b-96a4-2e569fb00000, customEvt=null, allowMerge=false, exchangeFreeSwitch=false] [21:01:21] : [Step 4/5] [2021-11-19 21:01:21,849][INFO ][disco-notifier-worker-#622%failure.IoomFailureHandlerTest0%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpThreshold' was changed from 'null' to '0' [21:01:21] : [Step 4/5] [2021-11-19 21:01:21,850][INFO ][exchange-worker-#628%failure.IoomFailureHandlerTest0%][IgniteCacheDatabaseSharedManager] Data Regions Started: 4 [21:01:21] : [Step 4/5] [2021-11-19 21:01:21,850][INFO ][disco-notifier-worker-#622%failure.IoomFailureHandlerTest0%][IgniteTxManager] Transactions parameter 'transactionTimeDumpSamplesCoefficient' was changed from 'null' to '0.0' [21:01:21] : [Step 4/5] [2021-11-19 21:01:21,851][INFO ][exchange-worker-#628%failure.IoomFailureHandlerTest0%][IgniteCacheDatabaseSharedManager] ^-- sysMemPlc region [type=internal, persistence=false, lazyAlloc=false, [21:01:21] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=40MB] [21:01:21] : [Step 4/5] ^-- TxLog region [type=internal, persistence=false, lazyAlloc=false, [21:01:21] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=40MB] [21:01:21] : [Step 4/5] ^-- dfltPlc region [type=default, persistence=false, lazyAlloc=true, [21:01:21] : [Step 4/5] ... initCfg=10MB, maxCfg=10MB, usedRam=0MB, freeRam=100%, allocRam=0MB] [21:01:21] : [Step 4/5] ^-- volatileDsMemPlc region [type=user, persistence=false, lazyAlloc=true, [21:01:21] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB] [21:01:21] : [Step 4/5] [21:01:21] : [Step 4/5] [2021-11-19 21:01:21,851][INFO ][disco-notifier-worker-#622%failure.IoomFailureHandlerTest0%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpSamplesPerSecondLimit' was changed from 'null' to '5' [21:01:21] : [Step 4/5] [2021-11-19 21:01:21,852][INFO ][exchange-worker-#628%failure.IoomFailureHandlerTest0%][msg] Components activation performed in 4 ms. [21:01:21] : [Step 4/5] [2021-11-19 21:01:21,853][INFO ][disco-notifier-worker-#622%failure.IoomFailureHandlerTest0%][IgniteTxManager] Transactions parameter 'collisionsDumpInterval' was changed from 'null' to '1000' [21:01:21] : [Step 4/5] [2021-11-19 21:01:21,854][INFO ][disco-notifier-worker-#622%failure.IoomFailureHandlerTest0%][IgniteTxManager] Transactions parameter 'txOwnerDumpRequestsAllowed' was changed from 'null' to 'true' [21:01:21] : [Step 4/5] [2021-11-19 21:01:21,861][INFO ][sys-#632%failure.IoomFailureHandlerTest0%][GridCacheProcessor] Started cache [name=ignite-sys-cache, id=-2100569601, dataRegionName=sysMemPlc, mode=REPLICATED, atomicity=TRANSACTIONAL, backups=2147483647, mvcc=false] [21:01:21] : [Step 4/5] [2021-11-19 21:01:21,862][INFO ][exchange-worker-#628%failure.IoomFailureHandlerTest0%][GridCacheProcessor] Started cache [name=default, id=1544803905, dataRegionName=dfltPlc, mode=PARTITIONED, atomicity=TRANSACTIONAL, backups=0, mvcc=false] [21:01:21] : [Step 4/5] [2021-11-19 21:01:21,863][INFO ][exchange-worker-#628%failure.IoomFailureHandlerTest0%][GridCacheProcessor] Starting caches on local join performed in 0 ms. [21:01:21] : [Step 4/5] [2021-11-19 21:01:21,871][INFO ][exchange-worker-#628%failure.IoomFailureHandlerTest0%][GridDhtPartitionsExchangeFuture] Skipped waiting for partitions release future (local node is joining) [topVer=AffinityTopologyVersion [topVer=1, minorTopVer=0]] [21:01:21] : [Step 4/5] [2021-11-19 21:01:21,971][INFO ][exchange-worker-#628%failure.IoomFailureHandlerTest0%][GridDhtPartitionsExchangeFuture] finishExchangeOnCoordinator [topVer=AffinityTopologyVersion [topVer=1, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=1, minorTopVer=0]] [21:01:21] : [Step 4/5] [2021-11-19 21:01:21,980][INFO ][exchange-worker-#628%failure.IoomFailureHandlerTest0%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=1, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=1, minorTopVer=0], err=null, rebalanced=true, wasRebalanced=false] [21:01:21] : [Step 4/5] [2021-11-19 21:01:21,983][INFO ][exchange-worker-#628%failure.IoomFailureHandlerTest0%][GridCacheProcessor] Finish proxy initialization, cacheName=default, localNodeId=1647b40b-5fc1-4c2b-96a4-2e569fb00000 [21:01:21] : [Step 4/5] [2021-11-19 21:01:21,983][INFO ][exchange-worker-#628%failure.IoomFailureHandlerTest0%][GridCacheProcessor] Finish proxy initialization, cacheName=ignite-sys-cache, localNodeId=1647b40b-5fc1-4c2b-96a4-2e569fb00000 [21:01:21] : [Step 4/5] [2021-11-19 21:01:21,984][INFO ][exchange-worker-#628%failure.IoomFailureHandlerTest0%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=1647b40b-5fc1-4c2b-96a4-2e569fb00000, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=1, minorTopVer=0], evt=NODE_JOINED, evtNode=TcpDiscoveryNode [id=1647b40b-5fc1-4c2b-96a4-2e569fb00000, consistentId=127.0.0.1:47500, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637344881793, loc=true, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=1, minorTopVer=0]] [21:01:21] : [Step 4/5] [2021-11-19 21:01:21,985][INFO ][exchange-worker-#628%failure.IoomFailureHandlerTest0%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=1, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=1, minorTopVer=0], stage="Waiting in exchange queue" (31 ms), stage="Exchange parameters initialization" (0 ms), stage="Components activation" (5 ms), stage="Determine exchange type" (17 ms), stage="Preloading notification" (0 ms), stage="After states restored callback" (100 ms), stage="WAL history reservation" (0 ms), stage="Waiting for all single messages" (0 ms), stage="Affinity recalculation (crd)" (0 ms), stage="Collect update counters and create affinity messages" (0 ms), stage="Assign partitions states" (1 ms), stage="Validate partitions states" (1 ms), stage="Apply update counters" (0 ms), stage="Full message preparing" (5 ms), stage="Full message sending" (0 ms), stage="State finish message sending" (0 ms), stage="Exchange done" (5 ms), stage="Total time" (165 ms)] [21:01:21] : [Step 4/5] [2021-11-19 21:01:21,988][INFO ][exchange-worker-#628%failure.IoomFailureHandlerTest0%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=1, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=1, minorTopVer=0], stage="First node affinity initialization (node join) [grp=default]" (17 ms) (parent=Determine exchange type), stage="Coordinator affinity cache init [grp=ignite-sys-cache]" (11 ms) (parent=Determine exchange type), stage="Coordinator affinity cache init [grp=default]" (11 ms) (parent=Determine exchange type)] [21:01:21] : [Step 4/5] [2021-11-19 21:01:21,989][INFO ][exchange-worker-#628%failure.IoomFailureHandlerTest0%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=1, minorTopVer=0], crd=true] [21:01:21] : [Step 4/5] [2021-11-19 21:01:21,992][INFO ][exchange-worker-#628%failure.IoomFailureHandlerTest0%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=1, minorTopVer=0], force=false, evt=NODE_JOINED, node=1647b40b-5fc1-4c2b-96a4-2e569fb00000] [21:01:21] : [Step 4/5] [2021-11-19 21:01:21,996][INFO ][test-runner-#538%failure.IoomFailureHandlerTest%][IoomFailureHandlerTest0] To start Console Management & Monitoring run ignitevisorcmd.{sh|bat} [21:01:21] : [Step 4/5] [2021-11-19 21:01:21,997][INFO ][test-runner-#538%failure.IoomFailureHandlerTest%][IoomFailureHandlerTest0] [21:01:21] : [Step 4/5] [21:01:21] : [Step 4/5] >>> +-------------------------------------------+ [21:01:21] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:01:21] : [Step 4/5] >>> +-------------------------------------------+ [21:01:21] : [Step 4/5] >>> OS name: Linux 4.15.0-151-generic amd64 [21:01:21] : [Step 4/5] >>> CPU(s): 24 [21:01:21] : [Step 4/5] >>> Heap: 2.0GB [21:01:21] : [Step 4/5] >>> VM name: 16724@c4dfe9a430b2 [21:01:21] : [Step 4/5] >>> Ignite instance name: failure.IoomFailureHandlerTest0 [21:01:21] : [Step 4/5] >>> Local node [ID=1647B40B-5FC1-4C2B-96A4-2E569FB00000, order=1, clientMode=false] [21:01:21] : [Step 4/5] >>> Local node addresses: [127.0.0.1] [21:01:21] : [Step 4/5] >>> Local ports: TCP:10800 TCP:45010 TCP:47500 [21:01:21] : [Step 4/5] [21:01:22] : [Step 4/5] [2021-11-19 21:01:21,999][INFO ][test-runner-#538%failure.IoomFailureHandlerTest%][GridDiscoveryManager] Topology snapshot [ver=1, locNode=1647b40b, servers=1, clients=0, state=ACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=1647b40b-5fc1-4c2b-96a4-2e569fb00000, consistentId=127.0.0.1:47500, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:01:22] : [Step 4/5] [2021-11-19 21:01:22,000][INFO ][test-runner-#538%failure.IoomFailureHandlerTest%][GridDiscoveryManager] ^-- Baseline [id=0, size=1, online=1, offline=0] [21:01:22] : [Step 4/5] [2021-11-19 21:01:22,000][INFO ][test-runner-#538%failure.IoomFailureHandlerTest%][G] Node started : [stage="Configure system pool" (1 ms),stage="Start managers" (70 ms),stage="Configure binary metadata" (3 ms),stage="Start processors" (31 ms),stage="Start 'StanByClusterTestProvider' plugin" (0 ms),stage="Start 'PageMemory tracker plugin' plugin" (0 ms),stage="Start 'TestDistibutedConfigurationPlugin' plugin" (0 ms),stage="Start 'NodeValidationPluginProvider' plugin" (0 ms),stage="Init metastore" (6 ms),stage="Finish recovery" (0 ms),stage="Join topology" (18 ms),stage="Await transition" (3 ms),stage="Await exchange" (181 ms),stage="Total time" (313 ms)] [21:01:22] : [Step 4/5] [2021-11-19 21:01:22,002][INFO ][test-runner-#538%failure.IoomFailureHandlerTest%][root] Node started with the following configuration [id=1647b40b-5fc1-4c2b-96a4-2e569fb00000, marshaller=BinaryMarshaller [], discovery=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=5000, ackTimeout=5000, marsh=JdkMarshaller [clsFilter=org.apache.ignite.marshaller.MarshallerUtils$1@3b47a327], reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], binaryCfg=null, lateAff=true] [21:01:22]W: [org.apache.ignite:ignite-core] [2021-11-19 21:01:22,009][WARN ][test-runner-#538%failure.IoomFailureHandlerTest%][G] Ignite work directory is not provided, automatically resolved to: /opt/buildagent/work/7bc1c54bc719b67c/work [21:01:22] : [Step 4/5] [2021-11-19 21:01:22,010][INFO ][test-runner-#538%failure.IoomFailureHandlerTest%][IoomFailureHandlerTest1] [21:01:22] : [Step 4/5] [21:01:22] : [Step 4/5] >>> __________ ________________ [21:01:22] : [Step 4/5] >>> / _/ ___/ |/ / _/_ __/ __/ [21:01:22] : [Step 4/5] >>> _/ // (7 7 // / / / / _/ [21:01:22] : [Step 4/5] >>> /___/\___/_/|_/___/ /_/ /___/ [21:01:22] : [Step 4/5] >>> [21:01:22] : [Step 4/5] >>> ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:01:22] : [Step 4/5] >>> 2021 Copyright(C) Apache Software Foundation [21:01:22] : [Step 4/5] >>> [21:01:22] : [Step 4/5] >>> Ignite documentation: http://ignite.apache.org [21:01:22] : [Step 4/5] [21:01:22] : [Step 4/5] [2021-11-19 21:01:22,010][INFO ][test-runner-#538%failure.IoomFailureHandlerTest%][IoomFailureHandlerTest1] Config URL: n/a [21:01:22] : [Step 4/5] [2021-11-19 21:01:22,011][INFO ][test-runner-#538%failure.IoomFailureHandlerTest%][IoomFailureHandlerTest1] IgniteConfiguration [igniteInstanceName=failure.IoomFailureHandlerTest1, pubPoolSize=24, svcPoolSize=24, callbackPoolSize=24, stripedPoolSize=24, sysPoolSize=24, mgmtPoolSize=4, dataStreamerPoolSize=24, utilityCachePoolSize=24, utilityCacheKeepAliveTime=60000, p2pPoolSize=2, qryPoolSize=24, buildIdxPoolSize=4, igniteHome=/opt/buildagent/work/7bc1c54bc719b67c, igniteWorkDir=/opt/buildagent/work/7bc1c54bc719b67c/work, mbeanSrv=com.sun.jmx.mbeanserver.JmxMBeanServer@6fe85038, nodeId=7f2de1b2-bdc3-4427-b854-d8d96a200001, marsh=BinaryMarshaller [], marshLocJobs=false, daemon=false, p2pEnabled=true, netTimeout=10000, netCompressionLevel=1, sndRetryDelay=1000, sndRetryCnt=3, metricsHistSize=10000, metricsUpdateFreq=1000, metricsExpTime=9223372036854775807, discoSpi=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=0, ackTimeout=0, marsh=null, reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], segPlc=STOP, segResolveAttempts=2, waitForSegOnStart=true, allResolversPassReq=true, segChkFreq=10000, commSpi=TcpCommunicationSpi [connectGate=org.apache.ignite.spi.communication.tcp.internal.ConnectGateway@163952c8, ctxInitLatch=java.util.concurrent.CountDownLatch@14f19c9e[Count = 1], stopping=false, clientPool=null, nioSrvWrapper=null, stateProvider=null], evtSpi=MemoryEventStorageSpi [expireAgeMs=9223372036854775807, expireCnt=10000, filter=null], colSpi=NoopCollisionSpi [], deploySpi=LocalDeploymentSpi [], indexingSpi=org.apache.ignite.spi.indexing.noop.NoopIndexingSpi@57b31661, addrRslvr=null, encryptionSpi=org.apache.ignite.spi.encryption.noop.NoopEncryptionSpi@530c668, tracingSpi=org.apache.ignite.spi.tracing.NoopTracingSpi@784e3478, clientMode=false, rebalanceThreadPoolSize=4, rebalanceTimeout=10000, rebalanceBatchesPrefetchCnt=3, rebalanceThrottle=0, rebalanceBatchSize=524288, txCfg=TransactionConfiguration [txSerEnabled=false, dfltIsolation=REPEATABLE_READ, dfltConcurrency=PESSIMISTIC, dfltTxTimeout=0, txTimeoutOnPartitionMapExchange=0, deadlockTimeout=10000, pessimisticTxLogSize=0, pessimisticTxLogLinger=10000, tmLookupClsName=null, txManagerFactory=null, useJtaSync=false], cacheSanityCheckEnabled=true, discoStartupDelay=60000, deployMode=SHARED, p2pMissedCacheSize=100, locHost=127.0.0.1, timeSrvPortBase=31100, timeSrvPortRange=100, failureDetectionTimeout=10000, sysWorkerBlockedTimeout=null, clientFailureDetectionTimeout=10000, metricsLogFreq=0, connectorCfg=null, odbcCfg=null, warmupClos=null, atomicCfg=AtomicConfiguration [seqReserveSize=1000, cacheMode=PARTITIONED, backups=1, aff=null, grpName=null], classLdr=null, sslCtxFactory=null, platformCfg=null, binaryCfg=null, memCfg=null, pstCfg=null, dsCfg=DataStorageConfiguration [sysRegionInitSize=41943040, sysRegionMaxSize=104857600, pageSize=2048, concLvl=0, dfltDataRegConf=DataRegionConfiguration [name=dfltPlc, maxSize=10485760, initSize=10485760, swapPath=null, pageEvictionMode=DISABLED, pageReplacementMode=CLOCK, evictionThreshold=0.9, emptyPagesPoolSize=100, metricsEnabled=false, metricsSubIntervalCount=5, metricsRateTimeInterval=60000, persistenceEnabled=false, checkpointPageBufSize=0, lazyMemoryAllocation=true, warmUpCfg=null], dataRegions=null, storagePath=null, checkpointFreq=180000, lockWaitTime=10000, checkpointThreads=4, checkpointWriteOrder=SEQUENTIAL, walHistSize=20, maxWalArchiveSize=1073741824, walSegments=10, walSegmentSize=67108864, walPath=db/wal, walArchivePath=db/wal/archive, cdcWalPath=db/wal/cdc, cdcEnabled=false, metricsEnabled=false, walMode=LOG_ONLY, walTlbSize=131072, walBuffSize=0, walFlushFreq=2000, walFsyncDelay=1000, walRecordIterBuffSize=67108864, alwaysWriteFullPages=false, fileIOFactory=org.apache.ignite.internal.processors.cache.persistence.file.AsyncFileIOFactory@39351efd, metricsSubIntervalCnt=5, metricsRateTimeInterval=60000, walAutoArchiveAfterInactivity=-1, walForceArchiveTimeout=-1, writeThrottlingEnabled=false, walCompactionEnabled=false, walCompactionLevel=1, checkpointReadLockTimeout=null, walPageCompression=DISABLED, walPageCompressionLevel=null, dfltWarmUpCfg=null, encCfg=org.apache.ignite.configuration.EncryptionConfiguration@1f12ea08, defragmentationThreadPoolSize=4, minWalArchiveSize=-1], snapshotPath=snapshots, activeOnStart=true, activeOnStartPropSetFlag=false, autoActivation=true, autoActivationPropSetFlag=false, clusterStateOnStart=null, sqlConnCfg=null, cliConnCfg=ClientConnectorConfiguration [host=null, port=10800, portRange=100, sockSndBufSize=0, sockRcvBufSize=0, tcpNoDelay=true, maxOpenCursorsPerConn=128, threadPoolSize=24, selectorCnt=12, idleTimeout=0, handshakeTimeout=10000, jdbcEnabled=true, odbcEnabled=true, thinCliEnabled=true, sslEnabled=false, useIgniteSslCtxFactory=true, sslClientAuth=false, sslCtxFactory=null, thinCliCfg=ThinClientConfiguration [maxActiveTxPerConn=100, maxActiveComputeTasksPerConn=0]], mvccVacuumThreadCnt=2, mvccVacuumFreq=5000, authEnabled=false, failureHnd=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]], commFailureRslvr=null, sqlCfg=SqlConfiguration [longQryWarnTimeout=3000, dfltQryTimeout=0, sqlQryHistSize=1000, validationEnabled=false], asyncContinuationExecutor=null] [21:01:22] : [Step 4/5] [2021-11-19 21:01:22,019][INFO ][test-runner-#538%failure.IoomFailureHandlerTest%][IoomFailureHandlerTest1] Daemon mode: off [21:01:22] : [Step 4/5] [2021-11-19 21:01:22,019][INFO ][test-runner-#538%failure.IoomFailureHandlerTest%][IoomFailureHandlerTest1] OS: Linux 4.15.0-151-generic amd64 [21:01:22] : [Step 4/5] [2021-11-19 21:01:22,019][INFO ][test-runner-#538%failure.IoomFailureHandlerTest%][IoomFailureHandlerTest1] OS user: teamcity [21:01:22] : [Step 4/5] [2021-11-19 21:01:22,019][INFO ][test-runner-#538%failure.IoomFailureHandlerTest%][IoomFailureHandlerTest1] PID: 16724 [21:01:22] : [Step 4/5] [2021-11-19 21:01:22,020][INFO ][test-runner-#538%failure.IoomFailureHandlerTest%][IoomFailureHandlerTest1] Language runtime: Java Platform API Specification ver. 1.8 [21:01:22] : [Step 4/5] [2021-11-19 21:01:22,020][INFO ][test-runner-#538%failure.IoomFailureHandlerTest%][IoomFailureHandlerTest1] VM information: Java(TM) SE Runtime Environment 1.8.0_261-b12 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 25.261-b12 [21:01:22] : [Step 4/5] [2021-11-19 21:01:22,021][INFO ][test-runner-#538%failure.IoomFailureHandlerTest%][IoomFailureHandlerTest1] VM total memory: 1.9GB [21:01:22] : [Step 4/5] [2021-11-19 21:01:22,021][INFO ][test-runner-#538%failure.IoomFailureHandlerTest%][IoomFailureHandlerTest1] Remote Management [restart: off, REST: off, JMX (remote: off)] [21:01:22] : [Step 4/5] [2021-11-19 21:01:22,021][INFO ][test-runner-#538%failure.IoomFailureHandlerTest%][IoomFailureHandlerTest1] Logger: GridTestLog4jLogger [quiet=false, config=null] [21:01:22] : [Step 4/5] [2021-11-19 21:01:22,022][INFO ][test-runner-#538%failure.IoomFailureHandlerTest%][IoomFailureHandlerTest1] IGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c [21:01:22] : [Step 4/5] [2021-11-19 21:01:22,022][INFO ][test-runner-#538%failure.IoomFailureHandlerTest%][IoomFailureHandlerTest1] VM arguments: [-DIGNITE_DUMP_THREADS_ON_FAILURE=false, -DMono=/usr/bin/mono-sgen, -DMono4.0_x64=/usr/lib/mono/4.0, -DMono4.5_x64=/usr/lib/mono/4.5, -DMonoVersion=6.12.0.90, -DSKIP_BUILD=false, -Dagent.home.dir=/opt/buildagent, -Dagent.name=aitc-lin02_03, -Dagent.ownPort=9090, -Dagent.work.dir=/opt/buildagent/work, -Dbuild.number=95, -Dbuild.vcs.number=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.1=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.GitHubApacheIgnite=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dclassworlds.conf=/opt/buildagent/temp/buildTmp/teamcity.m2.conf, -Dcom.jetbrains.maven.watcher.report.file=/opt/buildagent/temp/buildTmp/maven-build-info.xml, -Djava.io.tmpdir=/opt/buildagent/temp/buildTmp, -Dmaven.home=/opt/buildagent/tools/maven3_6, -Dmaven.multiModuleProjectDirectory=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.agent.cpuBenchmark=457, -Dteamcity.agent.dotnet.agent_url=http://localhost:9090/RPC2, -Dteamcity.agent.dotnet.build_id=6278078, -Dteamcity.auth.password=*******, -Dteamcity.auth.userId=TeamCityBuildId=6278078, -Dteamcity.build.changedFiles.file=/opt/buildagent/temp/buildTmp/changedFiles6342607772318147725.txt, -Dteamcity.build.checkoutDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.build.id=6278078, -Dteamcity.build.properties.file=/opt/buildagent/temp/buildTmp/teamcity.build5164517880467851002.properties, -Dteamcity.build.tempDir=/opt/buildagent/temp/buildTmp, -Dteamcity.build.workingDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.buildConfName=Basic 3, -Dteamcity.buildType.id=IgniteTests24Java8_Basic3, -Dteamcity.configuration.properties.file=/opt/buildagent/temp/buildTmp/teamcity.config5591980786735343870.properties, -Dteamcity.maven.userSettings.path=/opt/buildagent/temp/buildTmp/maven_settings_585072866407032347.xml, -Dteamcity.maven.watcher.home=/opt/buildagent/plugins/mavenPlugin/maven-watcher-jdk16, -Dteamcity.projectName=Ignite Tests 2.x (JDK 8/11), -Dteamcity.runner.properties.file=/opt/buildagent/temp/buildTmp/teamcity.runner9098465561618137420.properties, -Dteamcity.tests.recentlyFailedTests.file=/opt/buildagent/temp/buildTmp/testsToRunFirst3891775683130404069.txt, -Dteamcity.version=2021.2 (build 99542), -ea, -Xms2g, -Xmx2g, -XX:+HeapDumpOnOutOfMemoryError, -DIGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_TEST_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_UPDATE_NOTIFIER=false, -DIGNITE_NO_DISCO_ORDER=true, -DIGNITE_PERFORMANCE_SUGGESTIONS_DISABLED=true, -Djava.net.preferIPv4Stack=true, -DTEST_SCALE_FACTOR=1.0, -DIGNITE_TEST_PROP_LOG4J_FILE=log4j-tc-test.xml, -DIGNITE_QUIET=false, -DIGNITE_MARSHAL_BUFFERS_RECHECK=1000, -Dmaven.repo.local=/opt/buildagent/.m2/repository] [21:01:22] : [Step 4/5] [2021-11-19 21:01:22,027][INFO ][test-runner-#538%failure.IoomFailureHandlerTest%][IoomFailureHandlerTest1] System cache's DataRegion size is configured to 40 MB. Use DataStorageConfiguration.systemRegionInitialSize property to change the setting. [21:01:22]W: [org.apache.ignite:ignite-core] [2021-11-19 21:01:22,028][WARN ][test-runner-#538%failure.IoomFailureHandlerTest%][IoomFailureHandlerTest1] Peer class loading is enabled (disable it in production for performance and deployment consistency reasons) [21:01:22] : [Step 4/5] [2021-11-19 21:01:22,027][INFO ][test-runner-#538%failure.IoomFailureHandlerTest%][IoomFailureHandlerTest1] Configured caches [in 'sysMemPlc' dataRegion: ['ignite-sys-cache'], in 'dfltPlc' dataRegion: ['default']] [21:01:22] : [Step 4/5] [2021-11-19 21:01:22,028][INFO ][test-runner-#538%failure.IoomFailureHandlerTest%][IoomFailureHandlerTest1] 3-rd party licenses can be found at: /opt/buildagent/work/7bc1c54bc719b67c/libs/licenses [21:01:22] : [Step 4/5] [2021-11-19 21:01:22,032][INFO ][test-runner-#538%failure.IoomFailureHandlerTest%][IgnitePluginProcessor] Configured plugins: [21:01:22] : [Step 4/5] [2021-11-19 21:01:22,033][INFO ][test-runner-#538%failure.IoomFailureHandlerTest%][IgnitePluginProcessor] ^-- StanByClusterTestProvider 1.0 [21:01:22] : [Step 4/5] [2021-11-19 21:01:22,033][INFO ][test-runner-#538%failure.IoomFailureHandlerTest%][IgnitePluginProcessor] ^-- null [21:01:22] : [Step 4/5] [2021-11-19 21:01:22,033][INFO ][test-runner-#538%failure.IoomFailureHandlerTest%][IgnitePluginProcessor] [21:01:22] : [Step 4/5] [2021-11-19 21:01:22,033][INFO ][test-runner-#538%failure.IoomFailureHandlerTest%][IgnitePluginProcessor] ^-- PageMemory tracker plugin 1.0 [21:01:22] : [Step 4/5] [2021-11-19 21:01:22,033][INFO ][test-runner-#538%failure.IoomFailureHandlerTest%][IgnitePluginProcessor] ^-- null [21:01:22] : [Step 4/5] [2021-11-19 21:01:22,033][INFO ][test-runner-#538%failure.IoomFailureHandlerTest%][IgnitePluginProcessor] [21:01:22] : [Step 4/5] [2021-11-19 21:01:22,034][INFO ][test-runner-#538%failure.IoomFailureHandlerTest%][IgnitePluginProcessor] ^-- TestDistibutedConfigurationPlugin 1.0 [21:01:22] : [Step 4/5] [2021-11-19 21:01:22,034][INFO ][test-runner-#538%failure.IoomFailureHandlerTest%][IgnitePluginProcessor] ^-- null [21:01:22] : [Step 4/5] [2021-11-19 21:01:22,034][INFO ][test-runner-#538%failure.IoomFailureHandlerTest%][IgnitePluginProcessor] [21:01:22] : [Step 4/5] [2021-11-19 21:01:22,034][INFO ][test-runner-#538%failure.IoomFailureHandlerTest%][IgnitePluginProcessor] ^-- NodeValidationPluginProvider 1.0 [21:01:22] : [Step 4/5] [2021-11-19 21:01:22,034][INFO ][test-runner-#538%failure.IoomFailureHandlerTest%][IgnitePluginProcessor] ^-- null [21:01:22] : [Step 4/5] [2021-11-19 21:01:22,035][INFO ][test-runner-#538%failure.IoomFailureHandlerTest%][IgnitePluginProcessor] [21:01:22] : [Step 4/5] [2021-11-19 21:01:22,035][INFO ][test-runner-#538%failure.IoomFailureHandlerTest%][FailureProcessor] Configured failure handler: [hnd=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]] [21:01:22] : [Step 4/5] [2021-11-19 21:01:22,047][INFO ][test-runner-#538%failure.IoomFailureHandlerTest%][TcpCommunicationSpi] Successfully bound communication NIO server to TCP port [port=45011, locHost=/127.0.0.1, selectorsCnt=12, selectorSpins=0, pairedConn=false] [21:01:22]W: [org.apache.ignite:ignite-core] [2021-11-19 21:01:22,048][WARN ][test-runner-#538%failure.IoomFailureHandlerTest%][TcpCommunicationSpi] Message queue limit is set to 0 which may lead to potential OOMEs when running cache operations in FULL_ASYNC or PRIMARY_SYNC modes due to message queues growth on sender and receiver sides. [21:01:22] : [Step 4/5] [2021-11-19 21:01:22,054][INFO ][test-runner-#538%failure.IoomFailureHandlerTest%][GridCollisionManager] Collision resolution is disabled (all jobs will be activated upon arrival). [21:01:22] : [Step 4/5] [2021-11-19 21:01:22,054][INFO ][test-runner-#538%failure.IoomFailureHandlerTest%][IoomFailureHandlerTest1] Security status [authentication=off, sandbox=off, tls/ssl=off] [21:01:22] : [Step 4/5] [2021-11-19 21:01:22,063][INFO ][test-runner-#538%failure.IoomFailureHandlerTest%][TestTcpDiscoverySpi] Successfully bound to TCP port [port=47501, localHost=localhost/127.0.0.1, locNodeId=7f2de1b2-bdc3-4427-b854-d8d96a200001] [21:01:22] : [Step 4/5] [2021-11-19 21:01:22,067][INFO ][test-runner-#538%failure.IoomFailureHandlerTest%][IgniteCacheDatabaseSharedManager] Configured data regions initialized successfully [total=4] [21:01:22] : [Step 4/5] [2021-11-19 21:01:22,074][INFO ][test-runner-#538%failure.IoomFailureHandlerTest%][ClientListenerProcessor] Client connector processor has started on TCP port 10801 [21:01:22] : [Step 4/5] [2021-11-19 21:01:22,081][INFO ][test-runner-#538%failure.IoomFailureHandlerTest%][IoomFailureHandlerTest1] Non-loopback local IPs: 172.17.0.4 [21:01:22] : [Step 4/5] [2021-11-19 21:01:22,081][INFO ][test-runner-#538%failure.IoomFailureHandlerTest%][IoomFailureHandlerTest1] Enabled local MACs: 0242AC110004 [21:01:22] : [Step 4/5] [2021-11-19 21:01:22,082][INFO ][test-runner-#538%failure.IoomFailureHandlerTest%][ClusterProcessor] Cluster ID and tag has been read from metastorage: null [21:01:22] : [Step 4/5] [2021-11-19 21:01:22,082][INFO ][test-runner-#538%failure.IoomFailureHandlerTest%][IgniteClusterImpl] Shutdown policy was updated [oldVal=null, newVal=null] [21:01:22] : [Step 4/5] [2021-11-19 21:01:22,087][INFO ][tcp-disco-srvr-[:47500]-#32%failure.IoomFailureHandlerTest0%-#624%failure.IoomFailureHandlerTest0%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=59127] [21:01:22] : [Step 4/5] [2021-11-19 21:01:22,088][INFO ][tcp-disco-srvr-[:47500]-#32%failure.IoomFailureHandlerTest0%-#624%failure.IoomFailureHandlerTest0%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=59127] [21:01:22] : [Step 4/5] [2021-11-19 21:01:22,088][INFO ][tcp-disco-sock-reader-[]-#38%failure.IoomFailureHandlerTest0%-#735%failure.IoomFailureHandlerTest0%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:59127, rmtPort=59127] [21:01:22] : [Step 4/5] [2021-11-19 21:01:22,091][INFO ][tcp-disco-sock-reader-[7f2de1b2 127.0.0.1:59127]-#38%failure.IoomFailureHandlerTest0%-#735%failure.IoomFailureHandlerTest0%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=7f2de1b2-bdc3-4427-b854-d8d96a200001, rmtAddr=/127.0.0.1:59127] [21:01:22] : [Step 4/5] [2021-11-19 21:01:22,097][INFO ][tcp-disco-srvr-[:47501]-#37%failure.IoomFailureHandlerTest1%-#734%failure.IoomFailureHandlerTest1%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=53961] [21:01:22] : [Step 4/5] [2021-11-19 21:01:22,098][INFO ][tcp-disco-srvr-[:47501]-#37%failure.IoomFailureHandlerTest1%-#734%failure.IoomFailureHandlerTest1%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=53961] [21:01:22] : [Step 4/5] [2021-11-19 21:01:22,098][INFO ][tcp-disco-sock-reader-[]-#39%failure.IoomFailureHandlerTest1%-#736%failure.IoomFailureHandlerTest1%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:53961, rmtPort=53961] [21:01:22] : [Step 4/5] [2021-11-19 21:01:22,099][INFO ][tcp-disco-sock-reader-[]-#39%failure.IoomFailureHandlerTest1%-#736%failure.IoomFailureHandlerTest1%][TestTcpDiscoverySpi] Received ping request from the remote node [rmtNodeId=1647b40b-5fc1-4c2b-96a4-2e569fb00000, rmtAddr=/127.0.0.1:53961, rmtPort=53961] [21:01:22] : [Step 4/5] [2021-11-19 21:01:22,100][INFO ][tcp-disco-sock-reader-[]-#39%failure.IoomFailureHandlerTest1%-#736%failure.IoomFailureHandlerTest1%][TestTcpDiscoverySpi] Finished writing ping response [rmtNodeId=1647b40b-5fc1-4c2b-96a4-2e569fb00000, rmtAddr=/127.0.0.1:53961, rmtPort=53961] [21:01:22]W: [org.apache.ignite:ignite-core] [2021-11-19 21:01:22,101][WARN ][tcp-disco-sock-reader-[]-#39%failure.IoomFailureHandlerTest1%-#736%failure.IoomFailureHandlerTest1%][TestTcpDiscoverySpi] Failed to shutdown socket [21:01:22]W: [org.apache.ignite:ignite-core] java.net.SocketException: Socket output is already shutdown [21:01:22]W: [org.apache.ignite:ignite-core] at java.net.Socket.shutdownOutput(Socket.java:1572) [21:01:22]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.close(IgniteUtils.java:4247) [21:01:22]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.discovery.tcp.ServerImpl$SocketReader.body(ServerImpl.java:7370) [21:01:22]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.IgniteSpiThread.run(IgniteSpiThread.java:58) [21:01:22] : [Step 4/5] [2021-11-19 21:01:22,102][INFO ][tcp-disco-sock-reader-[]-#39%failure.IoomFailureHandlerTest1%-#736%failure.IoomFailureHandlerTest1%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:53961, rmtPort=53961, rmtNodeId=null] [21:01:22] : [Step 4/5] [2021-11-19 21:01:22,101][INFO ][tcp-disco-sock-reader-[7f2de1b2 127.0.0.1:59127]-#38%failure.IoomFailureHandlerTest0%-#735%failure.IoomFailureHandlerTest0%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:59127, rmtPort=59127, rmtNodeId=7f2de1b2-bdc3-4427-b854-d8d96a200001] [21:01:22] : [Step 4/5] [2021-11-19 21:01:22,106][INFO ][tcp-disco-msg-worker-[crd]-#31%failure.IoomFailureHandlerTest0%-#623%failure.IoomFailureHandlerTest0%][GridEncryptionManager] Joining node doesn't have stored group keys [node=7f2de1b2-bdc3-4427-b854-d8d96a200001] [21:01:22] : [Step 4/5] [2021-11-19 21:01:22,130][INFO ][tcp-disco-msg-worker-[crd]-#31%failure.IoomFailureHandlerTest0%-#623%failure.IoomFailureHandlerTest0%][TestTcpDiscoverySpi] New next node [newNext=TcpDiscoveryNode [id=7f2de1b2-bdc3-4427-b854-d8d96a200001, consistentId=127.0.0.1:47501, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=0, intOrder=2, lastExchangeTime=1637344882095, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false]] [21:01:22] : [Step 4/5] [2021-11-19 21:01:22,131][INFO ][tcp-disco-srvr-[:47501]-#37%failure.IoomFailureHandlerTest1%-#734%failure.IoomFailureHandlerTest1%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=44743] [21:01:22] : [Step 4/5] [2021-11-19 21:01:22,132][INFO ][tcp-disco-srvr-[:47501]-#37%failure.IoomFailureHandlerTest1%-#734%failure.IoomFailureHandlerTest1%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=44743] [21:01:22] : [Step 4/5] [2021-11-19 21:01:22,132][INFO ][tcp-disco-sock-reader-[]-#40%failure.IoomFailureHandlerTest1%-#737%failure.IoomFailureHandlerTest1%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:44743, rmtPort=44743] [21:01:22] : [Step 4/5] [2021-11-19 21:01:22,134][INFO ][tcp-disco-sock-reader-[1647b40b 127.0.0.1:44743]-#40%failure.IoomFailureHandlerTest1%-#737%failure.IoomFailureHandlerTest1%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=1647b40b-5fc1-4c2b-96a4-2e569fb00000, rmtAddr=/127.0.0.1:44743] [21:01:22] : [Step 4/5] [2021-11-19 21:01:22,139][INFO ][tcp-disco-msg-worker-[]-#36%failure.IoomFailureHandlerTest1%-#733%failure.IoomFailureHandlerTest1%][TestTcpDiscoverySpi] New next node [newNext=TcpDiscoveryNode [id=1647b40b-5fc1-4c2b-96a4-2e569fb00000, consistentId=127.0.0.1:47500, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637344882128, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false]] [21:01:22] : [Step 4/5] [2021-11-19 21:01:22,140][INFO ][tcp-disco-srvr-[:47500]-#32%failure.IoomFailureHandlerTest0%-#624%failure.IoomFailureHandlerTest0%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=44237] [21:01:22] : [Step 4/5] [2021-11-19 21:01:22,140][INFO ][tcp-disco-srvr-[:47500]-#32%failure.IoomFailureHandlerTest0%-#624%failure.IoomFailureHandlerTest0%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=44237] [21:01:22] : [Step 4/5] [2021-11-19 21:01:22,141][INFO ][tcp-disco-sock-reader-[]-#41%failure.IoomFailureHandlerTest0%-#738%failure.IoomFailureHandlerTest0%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:44237, rmtPort=44237] [21:01:22] : [Step 4/5] [2021-11-19 21:01:22,143][INFO ][tcp-disco-sock-reader-[7f2de1b2 127.0.0.1:44237]-#41%failure.IoomFailureHandlerTest0%-#738%failure.IoomFailureHandlerTest0%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=7f2de1b2-bdc3-4427-b854-d8d96a200001, rmtAddr=/127.0.0.1:44237] [21:01:22] : [Step 4/5] [2021-11-19 21:01:22,146][INFO ][disco-notifier-worker-#622%failure.IoomFailureHandlerTest0%][GridClusterStateProcessor] Received activate cluster request with BaselineTopology[id=0] initiator node ID: 7f2de1b2-bdc3-4427-b854-d8d96a200001 [21:01:22] : [Step 4/5] [2021-11-19 21:01:22,146][INFO ][disco-notifier-worker-#622%failure.IoomFailureHandlerTest0%][GridClusterStateProcessor] Started state transition: activate cluster [21:01:22] : [Step 4/5] [2021-11-19 21:01:22,147][INFO ][disco-notifier-worker-#622%failure.IoomFailureHandlerTest0%][GridClusterStateProcessor] Received state change finish message: ACTIVE [21:01:22] : [Step 4/5] [2021-11-19 21:01:22,147][INFO ][disco-notifier-worker-#622%failure.IoomFailureHandlerTest0%][GridClusterStateProcessor] Cluster state was changed from ACTIVE to ACTIVE [21:01:22] : [Step 4/5] [2021-11-19 21:01:22,148][INFO ][disco-event-worker-#626%failure.IoomFailureHandlerTest0%][GridDiscoveryManager] Added new node to topology: TcpDiscoveryNode [id=7f2de1b2-bdc3-4427-b854-d8d96a200001, consistentId=127.0.0.1:47501, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637344882095, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false] [21:01:22] : [Step 4/5] [2021-11-19 21:01:22,149][INFO ][disco-event-worker-#626%failure.IoomFailureHandlerTest0%][GridDiscoveryManager] Topology snapshot [ver=2, locNode=1647b40b, servers=2, clients=0, state=ACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=1647b40b-5fc1-4c2b-96a4-2e569fb00000, consistentId=127.0.0.1:47500, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=7f2de1b2-bdc3-4427-b854-d8d96a200001, consistentId=127.0.0.1:47501, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:01:22] : [Step 4/5] [2021-11-19 21:01:22,150][INFO ][disco-event-worker-#626%failure.IoomFailureHandlerTest0%][GridDiscoveryManager] ^-- Baseline [id=0, size=2, online=2, offline=0] [21:01:22] : [Step 4/5] [2021-11-19 21:01:22,151][INFO ][exchange-worker-#628%failure.IoomFailureHandlerTest0%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=0], crd=true, evt=NODE_JOINED, evtNode=7f2de1b2-bdc3-4427-b854-d8d96a200001, customEvt=null, allowMerge=true, exchangeFreeSwitch=false] [21:01:22] : [Step 4/5] [2021-11-19 21:01:22,151][INFO ][exchange-worker-#628%failure.IoomFailureHandlerTest0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=0], waitTime=0ms, futInfo=NA, mode=DISTRIBUTED] [21:01:22] : [Step 4/5] [2021-11-19 21:01:22,152][INFO ][exchange-worker-#628%failure.IoomFailureHandlerTest0%][GridDhtPartitionsExchangeFuture] Finished waiting for partitions release latch: ServerLatch [permits=0, pendingAcks=HashSet [], super=CompletableLatch [id=CompletableLatchUid [id=exchange, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=0]]]] [21:01:22] : [Step 4/5] [2021-11-19 21:01:22,153][INFO ][tcp-disco-msg-worker-[1647b40b 127.0.0.1:47500]-#36%failure.IoomFailureHandlerTest1%-#733%failure.IoomFailureHandlerTest1%][ClusterProcessor] modest_borg [21:01:22] : [Step 4/5] [2021-11-19 21:01:22,153][INFO ][exchange-worker-#628%failure.IoomFailureHandlerTest0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=0], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:01:22] : [Step 4/5] [2021-11-19 21:01:22,154][INFO ][exchange-worker-#628%failure.IoomFailureHandlerTest0%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=0], crd=true] [21:01:22] : [Step 4/5] [2021-11-19 21:01:22,153][INFO ][tcp-disco-msg-worker-[1647b40b 127.0.0.1:47500]-#36%failure.IoomFailureHandlerTest1%-#733%failure.IoomFailureHandlerTest1%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustEnabled' was changed from 'null' to 'true' [21:01:22] : [Step 4/5] [2021-11-19 21:01:22,155][INFO ][tcp-disco-msg-worker-[1647b40b 127.0.0.1:47500]-#36%failure.IoomFailureHandlerTest1%-#733%failure.IoomFailureHandlerTest1%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustTimeout' was changed from 'null' to '0' [21:01:22] : [Step 4/5] [2021-11-19 21:01:22,156][INFO ][tcp-disco-msg-worker-[1647b40b 127.0.0.1:47500]-#36%failure.IoomFailureHandlerTest1%-#733%failure.IoomFailureHandlerTest1%][IgniteTxManager] Transactions parameter 'longOperationsDumpTimeout' was changed from 'null' to '60000' [21:01:22] : [Step 4/5] [2021-11-19 21:01:22,156][INFO ][tcp-disco-msg-worker-[1647b40b 127.0.0.1:47500]-#36%failure.IoomFailureHandlerTest1%-#733%failure.IoomFailureHandlerTest1%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpThreshold' was changed from 'null' to '0' [21:01:22] : [Step 4/5] [2021-11-19 21:01:22,157][INFO ][tcp-disco-msg-worker-[1647b40b 127.0.0.1:47500]-#36%failure.IoomFailureHandlerTest1%-#733%failure.IoomFailureHandlerTest1%][IgniteTxManager] Transactions parameter 'transactionTimeDumpSamplesCoefficient' was changed from 'null' to '0.0' [21:01:22] : [Step 4/5] [2021-11-19 21:01:22,157][INFO ][tcp-disco-msg-worker-[1647b40b 127.0.0.1:47500]-#36%failure.IoomFailureHandlerTest1%-#733%failure.IoomFailureHandlerTest1%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpSamplesPerSecondLimit' was changed from 'null' to '5' [21:01:22] : [Step 4/5] [2021-11-19 21:01:22,158][INFO ][tcp-disco-msg-worker-[1647b40b 127.0.0.1:47500]-#36%failure.IoomFailureHandlerTest1%-#733%failure.IoomFailureHandlerTest1%][IgniteTxManager] Transactions parameter 'collisionsDumpInterval' was changed from 'null' to '1000' [21:01:22] : [Step 4/5] [2021-11-19 21:01:22,158][INFO ][tcp-disco-msg-worker-[1647b40b 127.0.0.1:47500]-#36%failure.IoomFailureHandlerTest1%-#733%failure.IoomFailureHandlerTest1%][IgniteTxManager] Transactions parameter 'txOwnerDumpRequestsAllowed' was changed from 'null' to 'true' [21:01:22] : [Step 4/5] [2021-11-19 21:01:22,160][INFO ][disco-notifier-worker-#732%failure.IoomFailureHandlerTest1%][GridClusterStateProcessor] Received activate cluster request with BaselineTopology[id=0] initiator node ID: 7f2de1b2-bdc3-4427-b854-d8d96a200001 [21:01:22] : [Step 4/5] [2021-11-19 21:01:22,160][INFO ][disco-notifier-worker-#732%failure.IoomFailureHandlerTest1%][GridClusterStateProcessor] Started state transition: activate cluster [21:01:22] : [Step 4/5] [2021-11-19 21:01:22,161][INFO ][disco-notifier-worker-#732%failure.IoomFailureHandlerTest1%][GridClusterStateProcessor] Received state change finish message: ACTIVE [21:01:22] : [Step 4/5] [2021-11-19 21:01:22,161][INFO ][disco-notifier-worker-#732%failure.IoomFailureHandlerTest1%][GridClusterStateProcessor] Cluster state was changed from ACTIVE to ACTIVE [21:01:22] : [Step 4/5] [2021-11-19 21:01:22,162][INFO ][disco-notifier-worker-#732%failure.IoomFailureHandlerTest1%][MvccProcessorImpl] Assigned mvcc coordinator [crd=MvccCoordinator [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=0], nodeId=1647b40b-5fc1-4c2b-96a4-2e569fb00000, ver=1637344881804, local=false, initialized=false]] [21:01:22] : [Step 4/5] [2021-11-19 21:01:22,165][INFO ][sys-#741%failure.IoomFailureHandlerTest1%][ClusterProcessor] Writing cluster ID and tag to metastorage on ready for write ClusterIdAndTag [id=0bfeb73e-9e5f-4ea0-9328-ee0902b43f1f, tag=modest_borg] [21:01:22] : [Step 4/5] [2021-11-19 21:01:22,191][INFO ][exchange-worker-#742%failure.IoomFailureHandlerTest1%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=0], crd=false, evt=NODE_JOINED, evtNode=7f2de1b2-bdc3-4427-b854-d8d96a200001, customEvt=null, allowMerge=true, exchangeFreeSwitch=false] [21:01:22] : [Step 4/5] [2021-11-19 21:01:22,193][INFO ][exchange-worker-#742%failure.IoomFailureHandlerTest1%][IgniteCacheDatabaseSharedManager] Data Regions Started: 4 [21:01:22] : [Step 4/5] [2021-11-19 21:01:22,194][INFO ][exchange-worker-#742%failure.IoomFailureHandlerTest1%][IgniteCacheDatabaseSharedManager] ^-- sysMemPlc region [type=internal, persistence=false, lazyAlloc=false, [21:01:22] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=40MB] [21:01:22] : [Step 4/5] ^-- TxLog region [type=internal, persistence=false, lazyAlloc=false, [21:01:22] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=40MB] [21:01:22] : [Step 4/5] ^-- dfltPlc region [type=default, persistence=false, lazyAlloc=true, [21:01:22] : [Step 4/5] ... initCfg=10MB, maxCfg=10MB, usedRam=0MB, freeRam=100%, allocRam=0MB] [21:01:22] : [Step 4/5] ^-- volatileDsMemPlc region [type=user, persistence=false, lazyAlloc=true, [21:01:22] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB] [21:01:22] : [Step 4/5] [21:01:22] : [Step 4/5] [2021-11-19 21:01:22,196][INFO ][exchange-worker-#742%failure.IoomFailureHandlerTest1%][msg] Components activation performed in 5 ms. [21:01:22] : [Step 4/5] [2021-11-19 21:01:22,208][INFO ][sys-#746%failure.IoomFailureHandlerTest1%][GridCacheProcessor] Started cache [name=default, id=1544803905, dataRegionName=dfltPlc, mode=PARTITIONED, atomicity=TRANSACTIONAL, backups=0, mvcc=false] [21:01:22] : [Step 4/5] [2021-11-19 21:01:22,208][INFO ][exchange-worker-#742%failure.IoomFailureHandlerTest1%][GridCacheProcessor] Started cache [name=ignite-sys-cache, id=-2100569601, dataRegionName=sysMemPlc, mode=REPLICATED, atomicity=TRANSACTIONAL, backups=2147483647, mvcc=false] [21:01:22] : [Step 4/5] [2021-11-19 21:01:22,209][INFO ][exchange-worker-#742%failure.IoomFailureHandlerTest1%][GridCacheProcessor] Starting caches on local join performed in 21 ms. [21:01:22] : [Step 4/5] [2021-11-19 21:01:22,217][INFO ][exchange-worker-#742%failure.IoomFailureHandlerTest1%][GridDhtPartitionsExchangeFuture] Skipped waiting for partitions release future (local node is joining) [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=0]] [21:01:22] : [Step 4/5] [2021-11-19 21:01:22,221][INFO ][grid-nio-worker-tcp-comm-0-#593%TcpCommunicationSpi%][TcpCommunicationSpi] Accepted incoming communication connection [locAddr=/127.0.0.1:45010, rmtAddr=/127.0.0.1:39016] [21:01:22] : [Step 4/5] [2021-11-19 21:01:22,224][INFO ][grid-nio-worker-tcp-comm-0-#703%TcpCommunicationSpi%][TcpCommunicationSpi] Established outgoing communication connection [locAddr=/127.0.0.1:39016, rmtAddr=/127.0.0.1:45010] [21:01:22] : [Step 4/5] [2021-11-19 21:01:22,224][INFO ][exchange-worker-#742%failure.IoomFailureHandlerTest1%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=0], crd=false] [21:01:22] : [Step 4/5] [2021-11-19 21:01:22,230][INFO ][sys-#753%failure.IoomFailureHandlerTest0%][GridDhtPartitionsExchangeFuture] Coordinator received single message [ver=AffinityTopologyVersion [topVer=2, minorTopVer=0], node=7f2de1b2-bdc3-4427-b854-d8d96a200001, allReceived=true] [21:01:22] : [Step 4/5] [2021-11-19 21:01:22,230][INFO ][sys-#753%failure.IoomFailureHandlerTest0%][GridDhtPartitionsExchangeFuture] Coordinator received all messages, try merge [ver=AffinityTopologyVersion [topVer=2, minorTopVer=0]] [21:01:22] : [Step 4/5] [2021-11-19 21:01:22,231][INFO ][sys-#753%failure.IoomFailureHandlerTest0%][GridDhtPartitionsExchangeFuture] finishExchangeOnCoordinator [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=0]] [21:01:22] : [Step 4/5] [2021-11-19 21:01:22,264][INFO ][sys-#753%failure.IoomFailureHandlerTest0%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=0], err=null, rebalanced=false, wasRebalanced=true] [21:01:22] : [Step 4/5] [2021-11-19 21:01:22,267][INFO ][sys-#753%failure.IoomFailureHandlerTest0%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=1647b40b-5fc1-4c2b-96a4-2e569fb00000, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=0], evt=NODE_JOINED, evtNode=TcpDiscoveryNode [id=7f2de1b2-bdc3-4427-b854-d8d96a200001, consistentId=127.0.0.1:47501, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637344882095, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=false, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=2, minorTopVer=0]] [21:01:22] : [Step 4/5] [2021-11-19 21:01:22,268][INFO ][sys-#753%failure.IoomFailureHandlerTest0%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=0], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (0 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Wait partitions release latch [latch=exchange]" (1 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="After states restored callback" (0 ms), stage="WAL history reservation" (0 ms), stage="Waiting for all single messages" (76 ms), stage="Exchanges merge" (0 ms), stage="Affinity recalculation (crd)" (24 ms), stage="Collect update counters and create affinity messages" (1 ms), stage="Assign partitions states" (1 ms), stage="Validate partitions states" (1 ms), stage="Apply update counters" (0 ms), stage="Full message preparing" (4 ms), stage="Full message sending" (0 ms), stage="State finish message sending" (0 ms), stage="Exchange done" (4 ms), stage="Total time" (112 ms), Discovery lag=12 ms, Latest started node id=7f2de1b2-bdc3-4427-b854-d8d96a200001] [21:01:22] : [Step 4/5] [2021-11-19 21:01:22,269][INFO ][exchange-worker-#628%failure.IoomFailureHandlerTest0%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=2, minorTopVer=0], force=false, evt=NODE_JOINED, node=7f2de1b2-bdc3-4427-b854-d8d96a200001] [21:01:22] : [Step 4/5] [2021-11-19 21:01:22,270][INFO ][sys-#753%failure.IoomFailureHandlerTest0%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=0], stage="Affinity initialization (node join) [grp=default, crd=true]" (21 ms) (parent=Affinity recalculation (crd)), stage="Affinity initialization (node join) [grp=ignite-sys-cache, crd=true]" (3 ms) (parent=Affinity recalculation (crd))] [21:01:22] : [Step 4/5] [2021-11-19 21:01:22,276][INFO ][sys-#759%failure.IoomFailureHandlerTest1%][GridDhtPartitionsExchangeFuture] Received full message, will finish exchange [node=1647b40b-5fc1-4c2b-96a4-2e569fb00000, resVer=AffinityTopologyVersion [topVer=2, minorTopVer=0]] [21:01:22] : [Step 4/5] [2021-11-19 21:01:22,349][INFO ][sys-#759%failure.IoomFailureHandlerTest1%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=0], err=null, rebalanced=false, wasRebalanced=false] [21:01:22] : [Step 4/5] [2021-11-19 21:01:22,351][INFO ][sys-#759%failure.IoomFailureHandlerTest1%][GridCacheProcessor] Finish proxy initialization, cacheName=default, localNodeId=7f2de1b2-bdc3-4427-b854-d8d96a200001 [21:01:22] : [Step 4/5] [2021-11-19 21:01:22,351][INFO ][sys-#759%failure.IoomFailureHandlerTest1%][GridCacheProcessor] Finish proxy initialization, cacheName=ignite-sys-cache, localNodeId=7f2de1b2-bdc3-4427-b854-d8d96a200001 [21:01:22] : [Step 4/5] [2021-11-19 21:01:22,352][INFO ][sys-#759%failure.IoomFailureHandlerTest1%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=7f2de1b2-bdc3-4427-b854-d8d96a200001, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=0], evt=NODE_JOINED, evtNode=TcpDiscoveryNode [id=7f2de1b2-bdc3-4427-b854-d8d96a200001, consistentId=127.0.0.1:47501, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637344882168, loc=true, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=false, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=2, minorTopVer=0]] [21:01:22] : [Step 4/5] [2021-11-19 21:01:22,353][INFO ][sys-#759%failure.IoomFailureHandlerTest1%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=0], stage="Waiting in exchange queue" (28 ms), stage="Exchange parameters initialization" (0 ms), stage="Components activation" (4 ms), stage="Determine exchange type" (20 ms), stage="Preloading notification" (0 ms), stage="After states restored callback" (0 ms), stage="WAL history reservation" (0 ms), stage="Waiting for Full message" (58 ms), stage="Affinity recalculation" (65 ms), stage="Full map updating" (7 ms), stage="Exchange done" (4 ms), stage="Total time" (186 ms)] [21:01:22] : [Step 4/5] [2021-11-19 21:01:22,354][INFO ][sys-#759%failure.IoomFailureHandlerTest1%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=0], stage="Affinity fetch" (20 ms) (parent=Determine exchange type), stage="Affinity initialization (local join) [grp=default]" (65 ms) (parent=Affinity recalculation), stage="Affinity initialization (local join) [grp=ignite-sys-cache]" (22 ms) (parent=Affinity recalculation)] [21:01:22] : [Step 4/5] [2021-11-19 21:01:22,362][INFO ][exchange-worker-#742%failure.IoomFailureHandlerTest1%][GridCachePartitionExchangeManager] Rebalancing scheduled [order=[ignite-sys-cache, default], top=AffinityTopologyVersion [topVer=2, minorTopVer=0], rebalanceId=1, evt=NODE_JOINED, node=7f2de1b2-bdc3-4427-b854-d8d96a200001] [21:01:22] : [Step 4/5] [2021-11-19 21:01:22,363][INFO ][exchange-worker-#742%failure.IoomFailureHandlerTest1%][GridDhtPartitionDemander] Prepared rebalancing [grp=ignite-sys-cache, mode=SYNC, supplier=1647b40b-5fc1-4c2b-96a4-2e569fb00000, partitionsCount=100, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=0], rebalanceId=1] [21:01:22] : [Step 4/5] [2021-11-19 21:01:22,364][INFO ][exchange-worker-#742%failure.IoomFailureHandlerTest1%][PartitionsEvictManager] Eviction in progress [groups=1, remainingPartsToEvict=0] [21:01:22] : [Step 4/5] [2021-11-19 21:01:22,365][INFO ][exchange-worker-#742%failure.IoomFailureHandlerTest1%][PartitionsEvictManager] Group eviction in progress [grpName=ignite-sys-cache, grpId=-2100569601, remainingPartsToEvict=1, partsEvictInProgress=0, totalParts=100] [21:01:22] : [Step 4/5] [2021-11-19 21:01:22,365][INFO ][exchange-worker-#742%failure.IoomFailureHandlerTest1%][PartitionsEvictManager] Partitions have been scheduled for eviction: [grpId=-2100569601, grpName=ignite-sys-cache, clearing=[0]] [21:01:22] : [Step 4/5] [2021-11-19 21:01:22,373][INFO ][sys-#772%failure.IoomFailureHandlerTest1%][GridDhtPartitionDemander] Starting rebalance routine [ignite-sys-cache, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=0], supplier=1647b40b-5fc1-4c2b-96a4-2e569fb00000, fullPartitions=[0-99], histPartitions=[], rebalanceId=1] [21:01:22] : [Step 4/5] [2021-11-19 21:01:22,385][INFO ][rebalance-striped-#774%failure.IoomFailureHandlerTest0%][GridDhtPartitionSupplier] Finished supplying rebalancing [grp=ignite-sys-cache, demander=7f2de1b2-bdc3-4427-b854-d8d96a200001, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=0]] [21:01:22] : [Step 4/5] [2021-11-19 21:01:22,390][INFO ][rebalance-#771%failure.IoomFailureHandlerTest1%][GridDhtPartitionDemander] Completed (final) rebalancing [rebalanceId=1, grp=ignite-sys-cache, supplier=1647b40b-5fc1-4c2b-96a4-2e569fb00000, partitions=100, entries=0, duration=26ms, bytesRcvd=0.0 B, bandwidth=0.0 B/sec, histPartitions=0, histEntries=0, histBytesRcvd=0.0 B, fullPartitions=100, fullEntries=0, fullBytesRcvd=0.0 B, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=0], progress=1/1] [21:01:22] : [Step 4/5] [2021-11-19 21:01:22,392][INFO ][rebalance-#771%failure.IoomFailureHandlerTest1%][GridDhtPartitionDemander] Completed rebalance future: RebalanceFuture [state=STARTED, grp=CacheGroupContext [grp=ignite-sys-cache], topVer=AffinityTopologyVersion [topVer=2, minorTopVer=0], rebalanceId=1, routines=1, receivedBytes=1200, receivedKeys=0, partitionsLeft=0, partitionsTotal=100, startTime=1637344882363, endTime=1637344882391, lastCancelledTime=-1, result=true] [21:01:22] : [Step 4/5] [2021-11-19 21:01:22,393][INFO ][rebalance-#771%failure.IoomFailureHandlerTest1%][GridDhtPartitionDemander] Prepared rebalancing [grp=default, mode=ASYNC, supplier=1647b40b-5fc1-4c2b-96a4-2e569fb00000, partitionsCount=524, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=0], rebalanceId=1] [21:01:22] : [Step 4/5] [2021-11-19 21:01:22,417][INFO ][sys-#777%failure.IoomFailureHandlerTest1%][GridDhtPartitionDemander] Starting rebalance routine [default, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=0], supplier=1647b40b-5fc1-4c2b-96a4-2e569fb00000, fullPartitions=[1, 4-8, 12, 14-17, 21, 23-24, 26-28, 30-31, 33-37, 39-41, 43, 45-47, 49-50, 54-56, 58-64, 66-68, 70-71, 73-74, 76, 78, 80, 83-86, 88, 91-94, 99, 102, 105, 107-111, 113, 115, 117-120, 124, 126, 129-130, 134-135, 137-143, 145-149, 153-155, 159, 161, 163, 166-167, 170-173, 177, 179, 181, 183, 187, 192, 194-197, 202, 205-208, 212-220, 222, 224, 227, 230, 233, 235, 237-238, 240-242, 246-247, 249-250, 252-255, 258, 261, 265-267, 269, 274-275, 277, 279-280, 284, 290-291, 293, 295, 297, 300, 302, 304, 307, 310-311, 314-315, 317, 320, 323, 325-333, 342, 344, 350-351, 354, 357, 359, 362-363, 366, 368-369, 373-374, 377-383, 385-387, 389-393, 395, 399, 403-404, 407, 412, 415, 417-418, 422-423, 425, 428, 430-432, 435-436, 441-444, 447, 454, 459-460, 462, 465, 468-469, 471, 474, 478-479, 481, 483-484, 489, 491, 493-494, 500, 506, 509-510, 514-517, 520, 522, 525-528, 532, 535, 537, 539, 541, 543, 547, 549, 552-554, 557-560, 564-565, 570-572, 574, 582-584, 591-593, 597-600, 602-610, 614, 616-622, 624, 627-628, 630, 633-635, 637, 640, 645, 648-650, 654, 656, 662, 674, 677, 679-682, 686-689, 691, 693, 696, 702-704, 706-709, 714, 716-719, 723-725, 728-729, 731, 733-736, 738, 740-743, 746-747, 750-752, 754, 756-757, 759-761, 763, 765-771, 773, 775, 777-779, 784, 786-788, 790-791, 795-797, 801-805, 807, 809, 811-815, 817, 820, 822, 827, 829-830, 832, 834-835, 840, 843, 845, 849, 851, 853, 855-856, 858-863, 865-866, 868, 872, 874-877, 879-881, 883, 885, 892, 894-895, 897, 899, 901, 904, 906, 908-909, 911-912, 914-916, 920-921, 925, 929-933, 936-944, 947, 951-952, 954, 957-959, 961-962, 966-969, 972, 980-984, 987, 991, 993, 995, 997-998, 1002, 1004-1005, 1008-1009, 1012-1015, 1017, 1020, 1022], histPartitions=[], rebalanceId=1] [21:01:22] : [Step 4/5] [2021-11-19 21:01:22,427][INFO ][test-runner-#538%failure.IoomFailureHandlerTest%][IoomFailureHandlerTest1] To start Console Management & Monitoring run ignitevisorcmd.{sh|bat} [21:01:22] : [Step 4/5] [2021-11-19 21:01:22,428][INFO ][test-runner-#538%failure.IoomFailureHandlerTest%][IoomFailureHandlerTest1] [21:01:22] : [Step 4/5] [21:01:22] : [Step 4/5] >>> +-------------------------------------------+ [21:01:22] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:01:22] : [Step 4/5] >>> +-------------------------------------------+ [21:01:22] : [Step 4/5] >>> OS name: Linux 4.15.0-151-generic amd64 [21:01:22] : [Step 4/5] >>> CPU(s): 24 [21:01:22] : [Step 4/5] >>> Heap: 2.0GB [21:01:22] : [Step 4/5] >>> VM name: 16724@c4dfe9a430b2 [21:01:22] : [Step 4/5] >>> Ignite instance name: failure.IoomFailureHandlerTest1 [21:01:22] : [Step 4/5] >>> Local node [ID=7F2DE1B2-BDC3-4427-B854-D8D96A200001, order=2, clientMode=false] [21:01:22] : [Step 4/5] >>> Local node addresses: [127.0.0.1] [21:01:22] : [Step 4/5] >>> Local ports: TCP:10801 TCP:45011 TCP:47501 [21:01:22] : [Step 4/5] [21:01:22] : [Step 4/5] [2021-11-19 21:01:22,429][INFO ][test-runner-#538%failure.IoomFailureHandlerTest%][GridDiscoveryManager] Topology snapshot [ver=2, locNode=7f2de1b2, servers=2, clients=0, state=ACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=1647b40b-5fc1-4c2b-96a4-2e569fb00000, consistentId=127.0.0.1:47500, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=7f2de1b2-bdc3-4427-b854-d8d96a200001, consistentId=127.0.0.1:47501, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:01:22] : [Step 4/5] [2021-11-19 21:01:22,429][INFO ][rebalance-striped-#774%failure.IoomFailureHandlerTest0%][GridDhtPartitionSupplier] Finished supplying rebalancing [grp=default, demander=7f2de1b2-bdc3-4427-b854-d8d96a200001, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=0]] [21:01:22] : [Step 4/5] [2021-11-19 21:01:22,430][INFO ][test-runner-#538%failure.IoomFailureHandlerTest%][GridDiscoveryManager] ^-- Baseline [id=0, size=2, online=2, offline=0] [21:01:22] : [Step 4/5] [2021-11-19 21:01:22,432][INFO ][test-runner-#538%failure.IoomFailureHandlerTest%][G] Node started : [stage="Configure system pool" (0 ms),stage="Start managers" (46 ms),stage="Configure binary metadata" (3 ms),stage="Start processors" (20 ms),stage="Start 'StanByClusterTestProvider' plugin" (0 ms),stage="Start 'PageMemory tracker plugin' plugin" (0 ms),stage="Start 'TestDistibutedConfigurationPlugin' plugin" (0 ms),stage="Start 'NodeValidationPluginProvider' plugin" (0 ms),stage="Init metastore" (2 ms),stage="Finish recovery" (0 ms),stage="Join topology" (79 ms),stage="Await transition" (3 ms),stage="Await exchange" (265 ms),stage="Total time" (418 ms)] [21:01:22] : [Step 4/5] [2021-11-19 21:01:22,433][INFO ][test-runner-#538%failure.IoomFailureHandlerTest%][root] Node started with the following configuration [id=7f2de1b2-bdc3-4427-b854-d8d96a200001, marshaller=BinaryMarshaller [], discovery=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=5000, ackTimeout=5000, marsh=JdkMarshaller [clsFilter=org.apache.ignite.marshaller.MarshallerUtils$1@73d7194e], reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], binaryCfg=null, lateAff=true] [21:01:22]W: [org.apache.ignite:ignite-core] [2021-11-19 21:01:22,441][WARN ][test-runner-#538%failure.IoomFailureHandlerTest%][root] Waiting for topology map update [igniteInstanceName=failure.IoomFailureHandlerTest0, cache=default, cacheId=1544803905, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=0], p=1, affNodesCnt=1, ownersCnt=1, affNodes=[7f2de1b2-bdc3-4427-b854-d8d96a200001], owners=[1647b40b-5fc1-4c2b-96a4-2e569fb00000], topFut=GridDhtPartitionsExchangeFuture [firstDiscoEvt=DiscoveryEvent [evtNode=TcpDiscoveryNode [id=7f2de1b2-bdc3-4427-b854-d8d96a200001, consistentId=127.0.0.1:47501, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637344882095, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], topVer=2, msgTemplate=null, span=o.a.i.i.processors.tracing.NoopSpan@61742ff0, nodeId8=1647b40b, msg=Node joined, type=NODE_JOINED, tstamp=1637344882148], crd=TcpDiscoveryNode [id=1647b40b-5fc1-4c2b-96a4-2e569fb00000, consistentId=127.0.0.1:47500, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637344882168, loc=true, ver=2.13.0#20211119-sha1:00000000, isClient=false], exchId=GridDhtPartitionExchangeId [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=0], discoEvt=DiscoveryEvent [evtNode=TcpDiscoveryNode [id=7f2de1b2-bdc3-4427-b854-d8d96a200001, consistentId=127.0.0.1:47501, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637344882095, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], topVer=2, msgTemplate=null, span=o.a.i.i.processors.tracing.NoopSpan@61742ff0, nodeId8=1647b40b, msg=Node joined, type=NODE_JOINED, tstamp=1637344882148], nodeId=7f2de1b2, evt=NODE_JOINED], added=true, exchangeType=ALL, initFut=GridFutureAdapter [ignoreInterrupts=false, state=DONE, res=true, hash=1305743672], init=true, lastVer=GridCacheVersion [topVer=0, order=1637344882055, nodeOrder=0], partReleaseFut=PartitionReleaseFuture [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=0], futures=[ExplicitLockReleaseFuture [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=0], futures=[]], AtomicUpdateReleaseFuture [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=0], futures=[]], DataStreamerReleaseFuture [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=0], futures=[]], LocalTxReleaseFuture [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=0], futures=[]], AllTxReleaseFuture [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=0], futures=[RemoteTxReleaseFuture [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=0], futures=[]]]]]], exchActions=ExchangeActions [startCaches=null, stopCaches=null, startGrps=[], stopGrps=[], resetParts=null, stateChangeRequest=StateChangeRequest [msg=ChangeGlobalStateMessage [id=08ffb593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqId=8a1c1b53-bb53-4a48-b3b3-f1033a1d83ef, initiatingNodeId=1647b40b-5fc1-4c2b-96a4-2e569fb00000, state=ACTIVE, baselineTopology=BaselineTopology [id=0, branchingHash=-2222647637, branchingType='New BaselineTopology', baselineNodes=[127.0.0.1:47501, 127.0.0.1:47500]], forceChangeBaselineTopology=true, timestamp=1637344882150, forceDeactivation=true], prevBltHistItem=o.a.i.i.processors.cluster.BaselineTopologyHistoryItem@39f790e4, prevState=ACTIVE, topVer=null]], secCtx=null, affChangeMsg=null, centralizedAff=false, forceAffReassignment=false, exchangeLocE=null, cacheChangeFailureMsgSent=false, done=true, state=DONE, registerCachesFuture=GridFinishedFuture [resFlag=2], startTime=1637344882150, initTime=1637344882151, rebalanced=false, affinityReassign=false, span=o.a.i.i.processors.tracing.NoopSpan@61742ff0, evtLatch=0, remaining=HashSet [], mergedJoinExchMsgs=null, awaitMergedMsgs=0, super=GridFutureAdapter [ignoreInterrupts=false, state=DONE, res=AffinityTopologyVersion [topVer=2, minorTopVer=0], hash=1180084122]], locNode=TcpDiscoveryNode [id=1647b40b-5fc1-4c2b-96a4-2e569fb00000, consistentId=127.0.0.1:47500, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637344882168, loc=true, ver=2.13.0#20211119-sha1:00000000, isClient=false]] [21:01:22] : [Step 4/5] [2021-11-19 21:01:22,445][INFO ][rebalance-#768%failure.IoomFailureHandlerTest1%][GridDhtPartitionDemander] Completed (final) rebalancing [rebalanceId=1, grp=default, supplier=1647b40b-5fc1-4c2b-96a4-2e569fb00000, partitions=524, entries=0, duration=51ms, bytesRcvd=0.0 B, bandwidth=0.0 B/sec, histPartitions=0, histEntries=0, histBytesRcvd=0.0 B, fullPartitions=524, fullEntries=0, fullBytesRcvd=0.0 B, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=0], progress=1/1] [21:01:22] : [Step 4/5] [2021-11-19 21:01:22,449][INFO ][rebalance-#768%failure.IoomFailureHandlerTest1%][GridDhtPartitionDemander] Completed rebalance future: RebalanceFuture [state=STARTED, grp=CacheGroupContext [grp=default], topVer=AffinityTopologyVersion [topVer=2, minorTopVer=0], rebalanceId=1, routines=1, receivedBytes=6288, receivedKeys=0, partitionsLeft=0, partitionsTotal=524, startTime=1637344882393, endTime=1637344882448, lastCancelledTime=-1, result=true] [21:01:22] : [Step 4/5] [2021-11-19 21:01:22,450][INFO ][rebalance-#768%failure.IoomFailureHandlerTest1%][GridDhtPartitionDemander] Completed rebalance chain: [rebalanceId=1, partitions=624, entries=0, duration=87ms, bytesRcvd=0.0 B] [21:01:22] : [Step 4/5] [2021-11-19 21:01:22,460][INFO ][exchange-worker-#628%failure.IoomFailureHandlerTest0%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], crd=true, evt=DISCOVERY_CUSTOM_EVT, evtNode=1647b40b-5fc1-4c2b-96a4-2e569fb00000, customEvt=CacheAffinityChangeMessage [id=6bffb593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=0], exchId=null, partsMsg=null, exchangeNeeded=true], allowMerge=false, exchangeFreeSwitch=false] [21:01:22] : [Step 4/5] [2021-11-19 21:01:22,461][INFO ][exchange-worker-#742%failure.IoomFailureHandlerTest1%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], crd=false, evt=DISCOVERY_CUSTOM_EVT, evtNode=1647b40b-5fc1-4c2b-96a4-2e569fb00000, customEvt=CacheAffinityChangeMessage [id=6bffb593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=0], exchId=null, partsMsg=null, exchangeNeeded=true], allowMerge=false, exchangeFreeSwitch=false] [21:01:22] : [Step 4/5] [2021-11-19 21:01:22,464][INFO ][exchange-worker-#628%failure.IoomFailureHandlerTest0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], waitTime=0ms, futInfo=NA, mode=DISTRIBUTED] [21:01:22] : [Step 4/5] [2021-11-19 21:01:22,465][INFO ][exchange-worker-#742%failure.IoomFailureHandlerTest1%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], waitTime=0ms, futInfo=NA, mode=DISTRIBUTED] [21:01:22] : [Step 4/5] [2021-11-19 21:01:22,466][INFO ][exchange-worker-#628%failure.IoomFailureHandlerTest0%][GridDhtPartitionsExchangeFuture] Finished waiting for partitions release latch: ServerLatch [permits=0, pendingAcks=HashSet [], super=CompletableLatch [id=CompletableLatchUid [id=exchange, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]]]] [21:01:22] : [Step 4/5] [2021-11-19 21:01:22,467][INFO ][exchange-worker-#742%failure.IoomFailureHandlerTest1%][GridDhtPartitionsExchangeFuture] Finished waiting for partitions release latch: ClientLatch [coordinator=TcpDiscoveryNode [id=1647b40b-5fc1-4c2b-96a4-2e569fb00000, consistentId=127.0.0.1:47500, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637344882128, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], ackSent=true, super=CompletableLatch [id=CompletableLatchUid [id=exchange, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]]]] [21:01:22] : [Step 4/5] [2021-11-19 21:01:22,467][INFO ][exchange-worker-#628%failure.IoomFailureHandlerTest0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:01:22] : [Step 4/5] [2021-11-19 21:01:22,468][INFO ][exchange-worker-#742%failure.IoomFailureHandlerTest1%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:01:22] : [Step 4/5] [2021-11-19 21:01:22,469][INFO ][exchange-worker-#628%failure.IoomFailureHandlerTest0%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], crd=true] [21:01:22] : [Step 4/5] [2021-11-19 21:01:22,472][INFO ][exchange-worker-#742%failure.IoomFailureHandlerTest1%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], crd=false] [21:01:22] : [Step 4/5] [2021-11-19 21:01:22,473][INFO ][sys-#644%failure.IoomFailureHandlerTest0%][GridDhtPartitionsExchangeFuture] Coordinator received single message [ver=AffinityTopologyVersion [topVer=2, minorTopVer=1], node=7f2de1b2-bdc3-4427-b854-d8d96a200001, allReceived=true] [21:01:22] : [Step 4/5] [2021-11-19 21:01:22,474][INFO ][sys-#644%failure.IoomFailureHandlerTest0%][GridDhtPartitionsExchangeFuture] finishExchangeOnCoordinator [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:01:22] : [Step 4/5] [2021-11-19 21:01:22,482][INFO ][sys-#644%failure.IoomFailureHandlerTest0%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], err=null, rebalanced=true, wasRebalanced=false] [21:01:22] : [Step 4/5] [2021-11-19 21:01:22,484][INFO ][sys-#741%failure.IoomFailureHandlerTest1%][GridDhtPartitionsExchangeFuture] Received full message, will finish exchange [node=1647b40b-5fc1-4c2b-96a4-2e569fb00000, resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:01:22] : [Step 4/5] [2021-11-19 21:01:22,487][INFO ][sys-#644%failure.IoomFailureHandlerTest0%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=1647b40b-5fc1-4c2b-96a4-2e569fb00000, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=1647b40b-5fc1-4c2b-96a4-2e569fb00000, consistentId=127.0.0.1:47500, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637344882461, loc=true, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:01:22] : [Step 4/5] [2021-11-19 21:01:22,488][INFO ][sys-#741%failure.IoomFailureHandlerTest1%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], err=null, rebalanced=true, wasRebalanced=false] [21:01:22] : [Step 4/5] [2021-11-19 21:01:22,489][INFO ][exchange-worker-#628%failure.IoomFailureHandlerTest0%][PartitionsEvictManager] Eviction in progress [groups=1, remainingPartsToEvict=0] [21:01:22] : [Step 4/5] [2021-11-19 21:01:22,489][INFO ][sys-#644%failure.IoomFailureHandlerTest0%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (1 ms), stage="Determine exchange type" (2 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (1 ms), stage="Wait partitions release latch [latch=exchange]" (1 ms), stage="Wait partitions release [latch=exchange]" (1 ms), stage="After states restored callback" (1 ms), stage="WAL history reservation" (0 ms), stage="Waiting for all single messages" (4 ms), stage="Affinity recalculation (crd)" (0 ms), stage="Collect update counters and create affinity messages" (0 ms), stage="Validate partitions states" (1 ms), stage="Apply update counters" (0 ms), stage="Full message preparing" (5 ms), stage="Full message sending" (0 ms), stage="Exchange done" (6 ms), stage="Total time" (23 ms), Discovery lag=1 ms, Latest started node id=7f2de1b2-bdc3-4427-b854-d8d96a200001] [21:01:22] : [Step 4/5] [2021-11-19 21:01:22,490][INFO ][exchange-worker-#628%failure.IoomFailureHandlerTest0%][PartitionsEvictManager] Group eviction in progress [grpName=default, grpId=1544803905, remainingPartsToEvict=1, partsEvictInProgress=0, totalParts=1024] [21:01:22] : [Step 4/5] [2021-11-19 21:01:22,492][INFO ][sys-#644%failure.IoomFailureHandlerTest0%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], stage="Affinity change by custom message [grp=default]" (2 ms) (parent=Determine exchange type), stage="Affinity change by custom message [grp=ignite-sys-cache]" (0 ms) (parent=Determine exchange type)] [21:01:22] : [Step 4/5] [2021-11-19 21:01:22,492][INFO ][sys-#741%failure.IoomFailureHandlerTest1%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=7f2de1b2-bdc3-4427-b854-d8d96a200001, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=1647b40b-5fc1-4c2b-96a4-2e569fb00000, consistentId=127.0.0.1:47500, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637344882128, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:01:22] : [Step 4/5] [2021-11-19 21:01:22,493][INFO ][exchange-worker-#742%failure.IoomFailureHandlerTest1%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=2, minorTopVer=1], force=false, evt=DISCOVERY_CUSTOM_EVT, node=1647b40b-5fc1-4c2b-96a4-2e569fb00000] [21:01:22] : [Step 4/5] [2021-11-19 21:01:22,492][INFO ][exchange-worker-#628%failure.IoomFailureHandlerTest0%][PartitionsEvictManager] Partitions have been scheduled for eviction: [grpId=1544803905, grpName=default, eviction=[1]] [21:01:22] : [Step 4/5] [2021-11-19 21:01:22,494][INFO ][sys-#741%failure.IoomFailureHandlerTest1%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (1 ms), stage="Determine exchange type" (2 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Wait partitions release latch [latch=exchange]" (2 ms), stage="Wait partitions release [latch=exchange]" (1 ms), stage="After states restored callback" (0 ms), stage="WAL history reservation" (0 ms), stage="Waiting for Full message" (14 ms), stage="Affinity recalculation" (0 ms), stage="Full map updating" (2 ms), stage="Exchange done" (6 ms), stage="Total time" (28 ms)] [21:01:22] : [Step 4/5] [2021-11-19 21:01:22,497][INFO ][sys-#741%failure.IoomFailureHandlerTest1%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], stage="Affinity change by custom message [grp=default]" (2 ms) (parent=Determine exchange type), stage="Affinity change by custom message [grp=ignite-sys-cache]" (0 ms) (parent=Determine exchange type)] [21:01:22]W: [org.apache.ignite:ignite-core] [2021-11-19 21:01:22,507][WARN ][test-runner-#538%failure.IoomFailureHandlerTest%][root] Finished waiting for topology map update [igniteInstanceName=failure.IoomFailureHandlerTest0, p=1, duration=60ms] [21:01:22] : [Step 4/5] [2021-11-19 21:01:22,512][INFO ][exchange-worker-#628%failure.IoomFailureHandlerTest0%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=2, minorTopVer=1], force=false, evt=DISCOVERY_CUSTOM_EVT, node=1647b40b-5fc1-4c2b-96a4-2e569fb00000] [21:01:22] : [Step 4/5] [2021-11-19 21:01:22,566][INFO ][test-runner-#538%failure.IoomFailureHandlerTest%][root] awaitPartitionMapExchange finished [21:01:29]W: [org.apache.ignite:ignite-core] [2021-11-19 21:01:29,841][ERROR][sys-stripe-17-#666%failure.IoomFailureHandlerTest1%][IgniteTestResources] Critical system error detected. Will be handled accordingly to configured handler [hnd=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]], failureCtx=FailureContext [type=CRITICAL_ERROR, err=class o.a.i.i.mem.IgniteOutOfMemoryException: Out of memory in data region [name=dfltPlc, initSize=10.0 MiB, maxSize=10.0 MiB, persistenceEnabled=false] Try the following: [21:01:29]W: [org.apache.ignite:ignite-core] ^-- Increase maximum off-heap memory size (DataRegionConfiguration.maxSize) [21:01:29]W: [org.apache.ignite:ignite-core] ^-- Enable Ignite persistence (DataRegionConfiguration.persistenceEnabled) [21:01:29]W: [org.apache.ignite:ignite-core] ^-- Enable eviction or expiration policies]] [21:01:29]W: [org.apache.ignite:ignite-core] class org.apache.ignite.internal.mem.IgniteOutOfMemoryException: Out of memory in data region [name=dfltPlc, initSize=10.0 MiB, maxSize=10.0 MiB, persistenceEnabled=false] Try the following: [21:01:29]W: [org.apache.ignite:ignite-core] ^-- Increase maximum off-heap memory size (DataRegionConfiguration.maxSize) [21:01:29]W: [org.apache.ignite:ignite-core] ^-- Enable Ignite persistence (DataRegionConfiguration.persistenceEnabled) [21:01:29]W: [org.apache.ignite:ignite-core] ^-- Enable eviction or expiration policies [21:01:29]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.IgniteCacheDatabaseSharedManager.ensureFreeSpaceForInsert(IgniteCacheDatabaseSharedManager.java:1234) [21:01:29]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.RowStore.addRow(RowStore.java:109) [21:01:29]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.IgniteCacheOffheapManagerImpl$CacheDataStoreImpl.createRow(IgniteCacheOffheapManagerImpl.java:1792) [21:01:29]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.GridCacheMapEntry$UpdateClosure.call(GridCacheMapEntry.java:5833) [21:01:29]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.GridCacheMapEntry$UpdateClosure.call(GridCacheMapEntry.java:5770) [21:01:29]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.BPlusTree$Invoke.invokeClosure(BPlusTree.java:4041) [21:01:29]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.BPlusTree$Invoke.access$5700(BPlusTree.java:3935) [21:01:29]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.BPlusTree.invokeDown(BPlusTree.java:2039) [21:01:29]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.BPlusTree.invoke(BPlusTree.java:1923) [21:01:29]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.IgniteCacheOffheapManagerImpl$CacheDataStoreImpl.invoke0(IgniteCacheOffheapManagerImpl.java:1742) [21:01:29]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.IgniteCacheOffheapManagerImpl$CacheDataStoreImpl.invoke(IgniteCacheOffheapManagerImpl.java:1725) [21:01:29]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.IgniteCacheOffheapManagerImpl.invoke(IgniteCacheOffheapManagerImpl.java:449) [21:01:29]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.GridCacheMapEntry.storeValue(GridCacheMapEntry.java:4304) [21:01:29]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.GridCacheMapEntry.storeValue(GridCacheMapEntry.java:4278) [21:01:29]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.GridCacheMapEntry.innerSet(GridCacheMapEntry.java:1553) [21:01:29]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.transactions.IgniteTxLocalAdapter.userCommit(IgniteTxLocalAdapter.java:735) [21:01:29]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.distributed.dht.GridDhtTxLocalAdapter.localFinish(GridDhtTxLocalAdapter.java:789) [21:01:29]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.distributed.dht.GridDhtTxLocal.localFinish(GridDhtTxLocal.java:595) [21:01:29]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.distributed.dht.GridDhtTxLocal.finishTx(GridDhtTxLocal.java:467) [21:01:29]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.distributed.dht.GridDhtTxLocal.commitDhtLocalAsync(GridDhtTxLocal.java:512) [21:01:29]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.distributed.dht.GridDhtTxLocal.commitAsync(GridDhtTxLocal.java:532) [21:01:29]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.distributed.dht.GridDhtTxPrepareFuture.onDone(GridDhtTxPrepareFuture.java:799) [21:01:29]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.distributed.dht.GridDhtTxPrepareFuture.onDone(GridDhtTxPrepareFuture.java:120) [21:01:29]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.onDone(GridFutureAdapter.java:467) [21:01:29]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridCompoundFuture.checkComplete(GridCompoundFuture.java:351) [21:01:29]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridCompoundFuture.markInitialized(GridCompoundFuture.java:340) [21:01:29]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.distributed.dht.GridDhtTxPrepareFuture.prepare0(GridDhtTxPrepareFuture.java:1380) [21:01:29]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.distributed.dht.GridDhtTxPrepareFuture.mapIfLocked(GridDhtTxPrepareFuture.java:732) [21:01:29]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.distributed.dht.GridDhtTxPrepareFuture.prepare(GridDhtTxPrepareFuture.java:1138) [21:01:29]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.distributed.dht.GridDhtTxLocal.prepareAsync(GridDhtTxLocal.java:400) [21:01:29]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.transactions.IgniteTxHandler.prepareNearTx(IgniteTxHandler.java:580) [21:01:29]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.transactions.IgniteTxHandler.prepareNearTx(IgniteTxHandler.java:377) [21:01:29]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.transactions.IgniteTxHandler.processNearTxPrepareRequest0(IgniteTxHandler.java:200) [21:01:29]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.transactions.IgniteTxHandler.processNearTxPrepareRequest(IgniteTxHandler.java:174) [21:01:29]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.transactions.IgniteTxHandler.access$000(IgniteTxHandler.java:134) [21:01:29]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.transactions.IgniteTxHandler$1.apply(IgniteTxHandler.java:222) [21:01:29]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.transactions.IgniteTxHandler$1.apply(IgniteTxHandler.java:220) [21:01:29]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.GridCacheIoManager.processMessage(GridCacheIoManager.java:1151) [21:01:29]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.GridCacheIoManager.onMessage0(GridCacheIoManager.java:592) [21:01:29]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.GridCacheIoManager.handleMessage(GridCacheIoManager.java:393) [21:01:29]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.GridCacheIoManager.handleMessage(GridCacheIoManager.java:319) [21:01:29]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.GridCacheIoManager.access$100(GridCacheIoManager.java:110) [21:01:29]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.GridCacheIoManager$1.onMessage(GridCacheIoManager.java:309) [21:01:29]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.managers.communication.GridIoManager.invokeListener(GridIoManager.java:1907) [21:01:29]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.managers.communication.GridIoManager.processRegularMessage0(GridIoManager.java:1528) [21:01:29]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.managers.communication.GridIoManager.access$5300(GridIoManager.java:242) [21:01:29]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.managers.communication.GridIoManager$9.execute(GridIoManager.java:1421) [21:01:29]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.managers.communication.TraceRunnable.run(TraceRunnable.java:55) [21:01:29]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.StripedExecutor$Stripe.body(StripedExecutor.java:569) [21:01:29]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:125) [21:01:29]W: [org.apache.ignite:ignite-core] at java.lang.Thread.run(Thread.java:748) [21:01:29]W: [org.apache.ignite:ignite-core] [2021-11-19 21:01:29,855][WARN ][sys-stripe-17-#666%failure.IoomFailureHandlerTest1%][CacheDiagnosticManager] Page locks dump: [21:01:29]W: [org.apache.ignite:ignite-core] [21:01:29]W: [org.apache.ignite:ignite-core] [21:01:29]W: [org.apache.ignite:ignite-core] [21:01:29]W: [org.apache.ignite:ignite-core] [21:01:29]W: [org.apache.ignite:ignite-core] [21:01:29]W: [org.apache.ignite:ignite-core] [21:01:29]W: [org.apache.ignite:ignite-core] [21:01:29]W: [org.apache.ignite:ignite-core] [21:01:29]W: [org.apache.ignite:ignite-core] [21:01:29]W: [org.apache.ignite:ignite-core] [21:01:29]W: [org.apache.ignite:ignite-core] [21:01:29]W: [org.apache.ignite:ignite-core] [21:01:29]W: [org.apache.ignite:ignite-core] [21:01:29]W: [org.apache.ignite:ignite-core] [21:01:29]W: [org.apache.ignite:ignite-core] [21:01:29]W: [org.apache.ignite:ignite-core] [21:01:29]W: [org.apache.ignite:ignite-core] [21:01:29]W: [org.apache.ignite:ignite-core] [21:01:29]W: [org.apache.ignite:ignite-core] [21:01:29]W: [org.apache.ignite:ignite-core] [21:01:29]W: [org.apache.ignite:ignite-core] [21:01:29]W: [org.apache.ignite:ignite-core] [21:01:29]W: [org.apache.ignite:ignite-core] [21:01:29]W: [org.apache.ignite:ignite-core] [21:01:29]W: [org.apache.ignite:ignite-core] [21:01:29]W: [org.apache.ignite:ignite-core] [21:01:29]W: [org.apache.ignite:ignite-core] [21:01:29]W: [org.apache.ignite:ignite-core] [21:01:29]W: [org.apache.ignite:ignite-core] [21:01:29]W: [org.apache.ignite:ignite-core] [21:01:29]W: [org.apache.ignite:ignite-core] [21:01:29]W: [org.apache.ignite:ignite-core] [21:01:29]W: [org.apache.ignite:ignite-core] [21:01:29]W: [org.apache.ignite:ignite-core] [2021-11-19 21:01:29,855][ERROR][sys-stripe-17-#666%failure.IoomFailureHandlerTest1%][FailureProcessor] Ignite node is in invalid state due to a critical failure. [21:01:30]W: [org.apache.ignite:ignite-core] [2021-11-19 21:01:30,014][WARN ][sys-stripe-17-#666%failure.IoomFailureHandlerTest1%][GridNearTxLocal] Set transaction invalidation flag to true due to error [tx=GridDhtTxLocal[xid=98d2c593d71-00000000-0ed4-c433-0000-000000000002, xidVersion=GridCacheVersion [topVer=248824883, order=1637344882057, nodeOrder=2], nearXidVersion=GridCacheVersion [topVer=248824883, order=1637344882056, nodeOrder=1], concurrency=PESSIMISTIC, isolation=REPEATABLE_READ, state=UNKNOWN, invalidate=false, rollbackOnly=false, nodeId=7f2de1b2-bdc3-4427-b854-d8d96a200001, timeout=0, startTime=1637344883056, duration=6949], err=class o.a.i.i.transactions.IgniteTxHeuristicCheckedException: Committing a transaction has produced runtime exception] [21:01:30]W: [org.apache.ignite:ignite-core] [2021-11-19 21:01:30,109][ERROR][sys-stripe-17-#666%failure.IoomFailureHandlerTest1%][GridNearTxLocal] Failed completing the transaction: [commit=true, tx=GridDhtTxLocal [nearNodeId=1647b40b-5fc1-4c2b-96a4-2e569fb00000, nearFutId=9c15c593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, nearMiniId=1, nearFinFutId=null, nearFinMiniId=0, nearXidVer=GridCacheVersion [topVer=248824883, order=1637344882056, nodeOrder=1], lb=null, super=GridDhtTxLocalAdapter [nearOnOriginatingNode=false, span=o.a.i.i.processors.tracing.NoopSpan@61742ff0, nearNodes=KeySetView [], dhtNodes=KeySetView [], explicitLock=false, super=IgniteTxLocalAdapter [completedBase=null, sndTransformedVals=false, depEnabled=false, txState=IgniteTxStateImpl [activeCacheIds=[1544803905], recovery=false, mvccEnabled=false, mvccCachingCacheIds=[], txMap=ArrayList [IgniteTxEntry [txKey=IgniteTxKey [key=KeyCacheObjectImpl [part=1, val=1, hasValBytes=true], cacheId=1544803905], val=TxEntryValueHolder [val=CacheObjectByteArrayImpl [arrLen=1364], op=CREATE], prevVal=TxEntryValueHolder [val=null, op=NOOP], oldVal=TxEntryValueHolder [val=null, op=NOOP], entryProcessorsCol=null, ttl=-1, conflictExpireTime=-1, conflictVer=null, explicitVer=null, dhtVer=null, filters=CacheEntryPredicate[] [], filtersPassed=false, filtersSet=false, entry=GridDhtCacheEntry [rdrs=ReaderId[] [], part=1, super=GridDistributedCacheEntry [super=GridCacheMapEntry [key=KeyCacheObjectImpl [part=1, val=1, hasValBytes=true], val=null, ver=GridCacheVersion [topVer=248824883, order=1637344882057, nodeOrder=2], hash=1, extras=GridCacheObsoleteEntryExtras [obsoleteVer=GridCacheVersion [topVer=2147483647, order=0, nodeOrder=0]], flags=2]]], prepared=0, locked=false, nodeId=null, locMapped=false, expiryPlc=null, transferExpiryPlc=false, flags=0, partUpdateCntr=1, serReadVer=null, xidVer=GridCacheVersion [topVer=248824883, order=1637344882057, nodeOrder=2]], IgniteTxEntry [txKey=IgniteTxKey [key=KeyCacheObjectImpl [part=4, val=4, hasValBytes=true], cacheId=1544803905], val=TxEntryValueHolder [val=CacheObjectByteArrayImpl [arrLen=1364], op=CREATE], prevVal=TxEntryValueHolder [val=null, op=NOOP], oldVal=TxEntryValueHolder [val=null, op=NOOP], entryProcessorsCol=null, ttl=-1, conflictExpireTime=-1, conflictVer=null, explicitVer=null, dhtVer=null, filters=CacheEntryPredicate[] [], filtersPassed=false, filtersSet=false, entry=GridDhtCacheEntry [rdrs=ReaderId[] [], part=4, super=GridDistributedCacheEntry [super=GridCacheMapEntry [key=KeyCacheObjectImpl [part=4, val=4, hasValBytes=true], val=null, ver=GridCacheVersion [topVer=248824883, order=1637344882057, nodeOrder=2], hash=4, extras=GridCacheObsoleteEntryExtras [obsoleteVer=GridCacheVersion [topVer=2147483647, order=0, nodeOrder=0]], flags=2]]], prepared=0, locked=false, nodeId=null, locMapped=false, expiryPlc=null, transferExpiryPlc=false, flags=0, partUpdateCntr=1, serReadVer=null, xidVer=GridCacheVersion [topVer=248824883, order=1637344882057, nodeOrder=2]], IgniteTxEntry [txKey=IgniteTxKey [key=KeyCacheObjectImpl [part=5, val=5, hasValBytes=true], cacheId=1544803905], val=TxEntryValueHolder [val=CacheObjectByteArrayImpl [arrLen=1364], op=CREATE], prevVal=TxEntryValueHolder [val=null, op=NOOP], oldVal=TxEntryValueHolder [val=null, op=NOOP], entryProcessorsCol=null, ttl=-1, conflictExpireTime=-1, conflictVer=null, explicitVer=null, dhtVer=null, filters=CacheEntryPredicate[] [], filtersPassed=false, filtersSet=false, entry=GridDhtCacheEntry [rdrs=ReaderId[] [], part=5, super=GridDistributedCacheEntry [super=GridCacheMapEntry [key=KeyCacheObjectImpl [part=5, val=5, hasValBytes=true], val=null, ver=GridCacheVersion [topVer=248824883, order=1637344882057, nodeOrder=2], hash=5, extras=GridCacheObsoleteEntryExtras [obsoleteVer=GridCacheVersion [topVer=2147483647, order=0, nodeOrder=0]], flags=2]]], prepared=0, locked=false, nodeId=null, locMapped=false, expiryPlc=null, transferExpiryPlc=false, flags=0, partUpdateCntr=1, serReadVer=null, xidVer=GridCacheVersion [topVer=248824883, order=1637344882057, nodeOrder=2]], IgniteTxEntry [txKey=IgniteTxKey [key=KeyCacheObjectImpl [part=6, val=6, hasValBytes=true], cacheId=1544803905], val=TxEntryValueHolder [val=CacheObjectByteArrayImpl [arrLen=1364], op=CREATE], prevVal=TxEntryValueHolder [val=null, op=NOOP], oldVal=TxEntryValueHolder [val=null, op=NOOP], entryProcessorsCol=null, ttl=-1, conflictExpireTime=-1, conflictVer=null, explicitVer=null, dhtVer=null, filters=CacheEntryPredicate[] [], filtersPassed=false, filtersSet=false, entry=GridDhtCacheEntry [rdrs=ReaderId[] [], part=6, super=GridDistributedCacheEntry [super=GridCacheMapEntry [key=KeyCacheObjectImpl [part=6, val=6, hasValBytes=true], val=null, ver=GridCacheVersion [topVer=248824883, order=1637344882057, nodeOrder=2], hash=6, extras=GridCacheObsoleteEntryExtras [obsoleteVer=GridCacheVersion [topVer=2147483647, order=0, nodeOrder=0]], flags=2]]], prepared=0, locked=false, nodeId=null, locMapped=false, expiryPlc=null, transferExpiryPlc=false, flags=0, partUpdateCntr=1, serReadVer=null, xidVer=GridCacheVersion [topVer=248824883, order=1637344882057, nodeOrder=2]], IgniteTxEntry [txKey=IgniteTxKey [key=KeyCacheObjectImpl [part=7, val=7, hasValBytes=true], cacheId=1544803905], val=TxEntryValueHolder [val=CacheObjectByteArrayImpl [arrLen=1364], op=CREATE], prevVal=TxEntryValueHolder [val=null, op=NOOP], oldVal=TxEntryValueHolder [val=null, op=NOOP], entryProcessorsCol=null, ttl=-1, conflictExpireTime=-1, conflictVer=null, explicitVer=null, dhtVer=null, filters=CacheEntryPredicate[] [], filtersPassed=false, filtersSet=false, entry=GridDhtCacheEntry [rdrs=ReaderId[] [], part=7, super=GridDistributedCacheEntry [super=GridCacheMapEntry [key=KeyCacheObjectImpl [part=7, val=7, hasValBytes=true], val=null, ver=GridCacheVersion [topVer=248824883, order=1637344882057, nodeOrder=2], hash=7, extras=GridCacheObsoleteEntryExtras [obsoleteVer=GridCacheVersion [topVer=2147483647, order=0, nodeOrder=0]], flags=2]]], prepared=0, locked=false, nodeId=null, locMapped=false, expiryPlc=null, transferExpiryPlc=false, flags=0, partUpdateCntr=1, serReadVer=null, xidVer=GridCacheVersion [topVer=248824883, order=1637344882057, nodeOrder=2]], IgniteTxEntry [txKey=IgniteTxKey [key=KeyCacheObjectImpl [part=8, val=8, hasValBytes=true], cacheId=1544803905], val=TxEntryValueHolder [val=CacheObjectByteArrayImpl [arrLen=1364], op=CREATE], prevVal=TxEntryValueHolder [val=null, op=NOOP], oldVal=TxEntryValueHolder [val=null, op=NOOP], entryProcessorsCol=null, ttl=-1, conflictExpireTime=-1, conflictVer=null, explicitVer=null, dhtVer=null, filters=CacheEntryPredicate[] [], filtersPassed=false, filtersSet=false, entry=GridDhtCacheEntry [rdrs=ReaderId[] [], part=8, super=GridDistributedCacheEntry [super=GridCacheMapEntry [key=KeyCacheObjectImpl [part=8, val=8, hasValBytes=true], val=null, ver=GridCacheVersion [topVer=248824883, order=1637344882057, nodeOrder=2], hash=8, extras=GridCacheObsoleteEntryExtras [obsoleteVer=GridCacheVersion [topVer=2147483647, order=0, nodeOrder=0]], flags=2]]], prepared=0, locked=false, nodeId=null, locMapped=false, expiryPlc=null, transferExpiryPlc=false, flags=0, partUpdateCntr=1, serReadVer=null, xidVer=GridCacheVersion [topVer=248824883, order=1637344882057, nodeOrder=2]], IgniteTxEntry [txKey=IgniteTxKey [key=KeyCacheObjectImpl [part=12, val=12, hasValBytes=true], cacheId=1544803905], val=TxEntryValueHolder [val=CacheObjectByteArrayImpl [arrLen=1364], op=CREATE], prevVal=TxEntryValueHolder [val=null, op=NOOP], oldVal=TxEntryValueHolder [val=null, op=NOOP], entryProcessorsCol=null, ttl=-1, conflictExpireTime=-1, conflictVer=null, explicitVer=null, dhtVer=null, filters=CacheEntryPredicate[] [], filtersPassed=false, filtersSet=false, entry=GridDhtCacheEntry [rdrs=ReaderId[] [], part=12, super=GridDistributedCacheEntry [super=GridCacheMapEntry [key=KeyCacheObjectImpl [part=12, val=12, hasValBytes=true], val=null, ver=GridCacheVersion [topVer=248824883, order=1637344882057, nodeOrder=2], hash=12, extras=GridCacheObsoleteEntryExtras [obsoleteVer=GridCacheVersion [topVer=2147483647, order=0, nodeOrder=0]], flags=2]]], prepared=0, locked=false, nodeId=null,... and 2297 skipped ...=GridCacheObsoleteEntryExtras [obsoleteVer=GridCacheVersion [topVer=2147483647, order=0, nodeOrder=0]], flags=2]]], prepared=0, locked=false, nodeId=null, locMapped=false, expiryPlc=null, transferExpiryPlc=false, flags=0, partUpdateCntr=1, serReadVer=null, xidVer=GridCacheVersion [topVer=248824883, order=1637344882057, nodeOrder=2]], IgniteTxEntry [txKey=IgniteTxKey [key=KeyCacheObjectImpl [part=163, val=163, hasValBytes=true], cacheId=1544803905], val=TxEntryValueHolder [val=CacheObjectByteArrayImpl [arrLen=1364], op=CREATE], prevVal=TxEntryValueHolder [val=null, op=NOOP], oldVal=TxEntryValueHolder [val=null, op=NOOP], entryProcessorsCol=null, ttl=-1, conflictExpireTime=-1, conflictVer=null, explicitVer=null, dhtVer=null, filters=CacheEntryPredicate[] [], filtersPassed=false, filtersSet=false, entry=GridCacheMapEntry [key=KeyCacheObjectImpl [part=163, val=163, hasValBytes=true], val=null, ver=GridCacheVersion [topVer=248824883, order=1637344882057, nodeOrder=2], hash=163, extras=GridCacheObsoleteEntryExtras [obsoleteVer=GridCacheVersion [topVer=2147483647, order=0, nodeOrder=0]], flags=2]]], prepared=0, locked=false, nodeId=null, locMapped=false, expiryPlc=null, transferExpiryPlc=false, flags=0, partUpdateCntr=1, serReadVer=null, xidVer=GridCacheVersion [topVer=248824883, order=1637344882057, nodeOrder=2]]... and 9900 more]], super=IgniteTxAdapter [xidVer=GridCacheVersion [topVer=248824883, order=1637344882057, nodeOrder=2], writeVer=GridCacheVersion [topVer=248824883, order=1637344882058, nodeOrder=2], implicit=false, loc=true, threadId=582, startTime=1637344883056, nodeId=7f2de1b2-bdc3-4427-b854-d8d96a200001, isolation=REPEATABLE_READ, concurrency=PESSIMISTIC, timeout=0, sysInvalidate=true, sys=false, plc=2, commitVer=null, finalizing=USER_FINISH, invalidParts=null, state=UNKNOWN, timedOut=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], mvccSnapshot=null, skipCompletedVers=false, parentTx=null, duration=6949ms, onePhaseCommit=true], size=10000]]]] [21:01:30]W: [org.apache.ignite:ignite-core] class org.apache.ignite.internal.transactions.IgniteTxHeuristicCheckedException: Committing a transaction has produced runtime exception [21:01:30]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.transactions.IgniteTxAdapter.heuristicException(IgniteTxAdapter.java:800) [21:01:30]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.transactions.IgniteTxLocalAdapter.userCommit(IgniteTxLocalAdapter.java:949) [21:01:30]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.distributed.dht.GridDhtTxLocalAdapter.localFinish(GridDhtTxLocalAdapter.java:789) [21:01:30]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.distributed.dht.GridDhtTxLocal.localFinish(GridDhtTxLocal.java:595) [21:01:30]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.distributed.dht.GridDhtTxLocal.finishTx(GridDhtTxLocal.java:467) [21:01:30]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.distributed.dht.GridDhtTxLocal.commitDhtLocalAsync(GridDhtTxLocal.java:512) [21:01:30]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.distributed.dht.GridDhtTxLocal.commitAsync(GridDhtTxLocal.java:532) [21:01:30]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.distributed.dht.GridDhtTxPrepareFuture.onDone(GridDhtTxPrepareFuture.java:799) [21:01:30]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.distributed.dht.GridDhtTxPrepareFuture.onDone(GridDhtTxPrepareFuture.java:120) [21:01:30]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.onDone(GridFutureAdapter.java:467) [21:01:30]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridCompoundFuture.checkComplete(GridCompoundFuture.java:351) [21:01:30]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridCompoundFuture.markInitialized(GridCompoundFuture.java:340) [21:01:30]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.distributed.dht.GridDhtTxPrepareFuture.prepare0(GridDhtTxPrepareFuture.java:1380) [21:01:30]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.distributed.dht.GridDhtTxPrepareFuture.mapIfLocked(GridDhtTxPrepareFuture.java:732) [21:01:30]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.distributed.dht.GridDhtTxPrepareFuture.prepare(GridDhtTxPrepareFuture.java:1138) [21:01:30]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.distributed.dht.GridDhtTxLocal.prepareAsync(GridDhtTxLocal.java:400) [21:01:30]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.transactions.IgniteTxHandler.prepareNearTx(IgniteTxHandler.java:580) [21:01:30]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.transactions.IgniteTxHandler.prepareNearTx(IgniteTxHandler.java:377) [21:01:30]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.transactions.IgniteTxHandler.processNearTxPrepareRequest0(IgniteTxHandler.java:200) [21:01:30]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.transactions.IgniteTxHandler.processNearTxPrepareRequest(IgniteTxHandler.java:174) [21:01:30]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.transactions.IgniteTxHandler.access$000(IgniteTxHandler.java:134) [21:01:30]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.transactions.IgniteTxHandler$1.apply(IgniteTxHandler.java:222) [21:01:30]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.transactions.IgniteTxHandler$1.apply(IgniteTxHandler.java:220) [21:01:30]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.GridCacheIoManager.processMessage(GridCacheIoManager.java:1151) [21:01:30]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.GridCacheIoManager.onMessage0(GridCacheIoManager.java:592) [21:01:30]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.GridCacheIoManager.handleMessage(GridCacheIoManager.java:393) [21:01:30]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.GridCacheIoManager.handleMessage(GridCacheIoManager.java:319) [21:01:30]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.GridCacheIoManager.access$100(GridCacheIoManager.java:110) [21:01:30]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.GridCacheIoManager$1.onMessage(GridCacheIoManager.java:309) [21:01:30]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.managers.communication.GridIoManager.invokeListener(GridIoManager.java:1907) [21:01:30]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.managers.communication.GridIoManager.processRegularMessage0(GridIoManager.java:1528) [21:01:30]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.managers.communication.GridIoManager.access$5300(GridIoManager.java:242) [21:01:30]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.managers.communication.GridIoManager$9.execute(GridIoManager.java:1421) [21:01:30]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.managers.communication.TraceRunnable.run(TraceRunnable.java:55) [21:01:30]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.StripedExecutor$Stripe.body(StripedExecutor.java:569) [21:01:30]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:125) [21:01:30]W: [org.apache.ignite:ignite-core] at java.lang.Thread.run(Thread.java:748) [21:01:30]W: [org.apache.ignite:ignite-core] Caused by: class org.apache.ignite.internal.processors.cache.persistence.tree.CorruptedTreeException: B+Tree is corrupted [groupId=1544803905, pageIds=[844420635164761], msg=Runtime failure on search row: SearchRow [key=KeyCacheObjectImpl [part=66, val=7234, hasValBytes=true], hash=7234, cacheId=0]] [21:01:30]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.BPlusTree.corruptedTreeException(BPlusTree.java:6162) [21:01:30]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.BPlusTree.invoke(BPlusTree.java:1956) [21:01:30]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.IgniteCacheOffheapManagerImpl$CacheDataStoreImpl.invoke0(IgniteCacheOffheapManagerImpl.java:1742) [21:01:30]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.IgniteCacheOffheapManagerImpl$CacheDataStoreImpl.invoke(IgniteCacheOffheapManagerImpl.java:1725) [21:01:30]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.IgniteCacheOffheapManagerImpl.invoke(IgniteCacheOffheapManagerImpl.java:449) [21:01:30]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.GridCacheMapEntry.storeValue(GridCacheMapEntry.java:4304) [21:01:30]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.GridCacheMapEntry.storeValue(GridCacheMapEntry.java:4278) [21:01:30]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.GridCacheMapEntry.innerSet(GridCacheMapEntry.java:1553) [21:01:30]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.transactions.IgniteTxLocalAdapter.userCommit(IgniteTxLocalAdapter.java:735) [21:01:30]W: [org.apache.ignite:ignite-core] ... 35 more [21:01:30]W: [org.apache.ignite:ignite-core] Caused by: class org.apache.ignite.internal.mem.IgniteOutOfMemoryException: Out of memory in data region [name=dfltPlc, initSize=10.0 MiB, maxSize=10.0 MiB, persistenceEnabled=false] Try the following: [21:01:30]W: [org.apache.ignite:ignite-core] ^-- Increase maximum off-heap memory size (DataRegionConfiguration.maxSize) [21:01:30]W: [org.apache.ignite:ignite-core] ^-- Enable Ignite persistence (DataRegionConfiguration.persistenceEnabled) [21:01:30]W: [org.apache.ignite:ignite-core] ^-- Enable eviction or expiration policies [21:01:30]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.IgniteCacheDatabaseSharedManager.ensureFreeSpaceForInsert(IgniteCacheDatabaseSharedManager.java:1234) [21:01:30]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.RowStore.addRow(RowStore.java:109) [21:01:30]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.IgniteCacheOffheapManagerImpl$CacheDataStoreImpl.createRow(IgniteCacheOffheapManagerImpl.java:1792) [21:01:30]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.GridCacheMapEntry$UpdateClosure.call(GridCacheMapEntry.java:5833) [21:01:30]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.GridCacheMapEntry$UpdateClosure.call(GridCacheMapEntry.java:5770) [21:01:30]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.BPlusTree$Invoke.invokeClosure(BPlusTree.java:4041) [21:01:30]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.BPlusTree$Invoke.access$5700(BPlusTree.java:3935) [21:01:30]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.BPlusTree.invokeDown(BPlusTree.java:2039) [21:01:30]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.BPlusTree.invoke(BPlusTree.java:1923) [21:01:30]W: [org.apache.ignite:ignite-core] ... 42 more [21:01:30] : [Step 4/5] [2021-11-19 21:01:30,162][INFO ][sys-stripe-20-#559%failure.IoomFailureHandlerTest0%][GridDeploymentLocalStore] Class locally deployed: class org.apache.ignite.IgniteCheckedException [21:01:30] : [Step 4/5] [2021-11-19 21:01:30,163][INFO ][sys-stripe-20-#559%failure.IoomFailureHandlerTest0%][GridDeploymentLocalStore] Class locally deployed: class org.apache.ignite.IgniteException [21:01:30] : [Step 4/5] [2021-11-19 21:01:30,163][INFO ][sys-stripe-20-#559%failure.IoomFailureHandlerTest0%][GridDeploymentLocalStore] Class locally deployed: class [Ljava.lang.StackTraceElement; [21:01:30] : [Step 4/5] [2021-11-19 21:01:30,165][INFO ][sys-stripe-20-#559%failure.IoomFailureHandlerTest0%][GridDeploymentLocalStore] Class locally deployed: class [J [21:01:30]W: [org.apache.ignite:ignite-core] [2021-11-19 21:01:30,209][WARN ][sys-stripe-17-#666%failure.IoomFailureHandlerTest1%][finish] Received finish request for completed transaction (the message may be too late) [txId=GridCacheVersion [topVer=248824883, order=1637344882056, nodeOrder=1], dhtTxId=null, node=1647b40b-5fc1-4c2b-96a4-2e569fb00000, commit=false] [21:01:30] : [Step 4/5] [2021-11-19 21:01:30,213][INFO ][test-runner-#538%failure.IoomFailureHandlerTest%][root] >>> Stopping grid [name=failure.IoomFailureHandlerTest1, id=7f2de1b2-bdc3-4427-b854-d8d96a200001] [21:01:30] : [Step 4/5] [2021-11-19 21:01:30,228][INFO ][tcp-disco-sock-reader-[1647b40b 127.0.0.1:44743]-#40%failure.IoomFailureHandlerTest1%-#737%failure.IoomFailureHandlerTest1%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:44743, rmtPort=44743, rmtNodeId=1647b40b-5fc1-4c2b-96a4-2e569fb00000] [21:01:30] : [Step 4/5] [2021-11-19 21:01:30,228][INFO ][disco-notifier-worker-#622%failure.IoomFailureHandlerTest0%][GridClusterStateProcessor] Received activate cluster request with BaselineTopology[id=0] initiator node ID: 7f2de1b2-bdc3-4427-b854-d8d96a200001 [21:01:30] : [Step 4/5] [2021-11-19 21:01:30,229][INFO ][disco-notifier-worker-#622%failure.IoomFailureHandlerTest0%][GridClusterStateProcessor] Started state transition: activate cluster [21:01:30] : [Step 4/5] [2021-11-19 21:01:30,230][INFO ][disco-notifier-worker-#622%failure.IoomFailureHandlerTest0%][GridClusterStateProcessor] Received state change finish message: ACTIVE [21:01:30] : [Step 4/5] [2021-11-19 21:01:30,230][INFO ][disco-notifier-worker-#622%failure.IoomFailureHandlerTest0%][GridClusterStateProcessor] Cluster state was changed from ACTIVE to ACTIVE [21:01:30] : [Step 4/5] [2021-11-19 21:01:30,231][INFO ][disco-event-worker-#626%failure.IoomFailureHandlerTest0%][GridDiscoveryManager] Node left topology: TcpDiscoveryNode [id=7f2de1b2-bdc3-4427-b854-d8d96a200001, consistentId=127.0.0.1:47501, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637344882095, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false] [21:01:30] : [Step 4/5] [2021-11-19 21:01:30,233][INFO ][disco-event-worker-#626%failure.IoomFailureHandlerTest0%][GridDiscoveryManager] Topology snapshot [ver=3, locNode=1647b40b, servers=1, clients=0, state=ACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=1647b40b-5fc1-4c2b-96a4-2e569fb00000, consistentId=127.0.0.1:47500, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:01:30] : [Step 4/5] [2021-11-19 21:01:30,234][INFO ][disco-event-worker-#626%failure.IoomFailureHandlerTest0%][GridDiscoveryManager] ^-- Baseline [id=0, size=1, online=1, offline=0] [21:01:30]W: [org.apache.ignite:ignite-core] [2021-11-19 21:01:30,235][WARN ][grid-nio-worker-tcp-comm-0-#593%TcpCommunicationSpi%][TcpCommunicationSpi] Failed to shutdown socket [21:01:30]W: [org.apache.ignite:ignite-core] java.nio.channels.ClosedChannelException [21:01:30]W: [org.apache.ignite:ignite-core] at sun.nio.ch.SocketChannelImpl.shutdownOutput(SocketChannelImpl.java:795) [21:01:30]W: [org.apache.ignite:ignite-core] at sun.nio.ch.SocketAdaptor.shutdownOutput(SocketAdaptor.java:407) [21:01:30]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.close(IgniteUtils.java:4247) [21:01:30]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.closeKey(GridNioServer.java:2784) [21:01:30]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.close(GridNioServer.java:2835) [21:01:30]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.close(GridNioServer.java:2794) [21:01:30]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.bodyInternal(GridNioServer.java:2157) [21:01:30]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.body(GridNioServer.java:1910) [21:01:30]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:125) [21:01:30]W: [org.apache.ignite:ignite-core] at java.lang.Thread.run(Thread.java:748) [21:01:30] : [Step 4/5] [2021-11-19 21:01:30,271][INFO ][test-runner-#538%failure.IoomFailureHandlerTest%][GridCacheProcessor] Stopped cache [cacheName=default] [21:01:30] : [Step 4/5] [2021-11-19 21:01:30,271][INFO ][exchange-worker-#628%failure.IoomFailureHandlerTest0%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], crd=true, evt=NODE_LEFT, evtNode=7f2de1b2-bdc3-4427-b854-d8d96a200001, customEvt=null, allowMerge=true, exchangeFreeSwitch=false] [21:01:30] : [Step 4/5] [2021-11-19 21:01:30,282][INFO ][test-runner-#538%failure.IoomFailureHandlerTest%][GridCacheProcessor] Stopped cache [cacheName=ignite-sys-cache] [21:01:30] : [Step 4/5] [2021-11-19 21:01:30,293][INFO ][exchange-worker-#628%failure.IoomFailureHandlerTest0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], waitTime=0ms, futInfo=NA, mode=DISTRIBUTED] [21:01:30] : [Step 4/5] [2021-11-19 21:01:30,294][INFO ][exchange-worker-#628%failure.IoomFailureHandlerTest0%][GridDhtPartitionsExchangeFuture] Finished waiting for partitions release latch: ServerLatch [permits=0, pendingAcks=HashSet [], super=CompletableLatch [id=CompletableLatchUid [id=exchange, topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0]]]] [21:01:30] : [Step 4/5] [2021-11-19 21:01:30,295][INFO ][exchange-worker-#628%failure.IoomFailureHandlerTest0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:01:30] : [Step 4/5] [2021-11-19 21:01:30,298][INFO ][exchange-worker-#628%failure.IoomFailureHandlerTest0%][GridDhtPartitionsExchangeFuture] Coordinator received all messages, try merge [ver=AffinityTopologyVersion [topVer=3, minorTopVer=0]] [21:01:30] : [Step 4/5] [2021-11-19 21:01:30,299][INFO ][exchange-worker-#628%failure.IoomFailureHandlerTest0%][GridDhtPartitionsExchangeFuture] finishExchangeOnCoordinator [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=0]] [21:01:30] : [Step 4/5] [2021-11-19 21:01:30,319][INFO ][test-runner-#538%failure.IoomFailureHandlerTest%][GridDeploymentLocalStore] Removed undeployed class: GridDeployment [ts=1637344882259, depMode=SHARED, clsLdr=IsolatedClassLoader{roleName='test'}, clsLdrId=faffb593d71-7f2de1b2-bdc3-4427-b854-d8d96a200001, userVer=0, loc=true, sampleClsName=org.apache.ignite.internal.processors.cache.distributed.dht.preloader.GridDhtPartitionFullMap, pendingUndeploy=false, undeployed=true, usage=0] [21:01:30] : [Step 4/5] [2021-11-19 21:01:30,340][INFO ][test-runner-#538%failure.IoomFailureHandlerTest%][IoomFailureHandlerTest1] [21:01:30] : [Step 4/5] [21:01:30] : [Step 4/5] >>> +------------------------------------------------------+ [21:01:30] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV stopped OK [21:01:30] : [Step 4/5] >>> +------------------------------------------------------+ [21:01:30] : [Step 4/5] >>> Ignite instance name: failure.IoomFailureHandlerTest1 [21:01:30] : [Step 4/5] >>> Grid uptime: 00:00:07.910 [21:01:30] : [Step 4/5] [21:01:30] : [Step 4/5] [21:01:30] : [Step 4/5] [2021-11-19 21:01:30,341][INFO ][test-runner-#538%failure.IoomFailureHandlerTest%][root] Topology version mismatch [node=failure.IoomFailureHandlerTest0, exchVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0]] [21:01:30] : [Step 4/5] [2021-11-19 21:01:30,392][INFO ][exchange-worker-#628%failure.IoomFailureHandlerTest0%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], err=null, rebalanced=true, wasRebalanced=true] [21:01:30] : [Step 4/5] [2021-11-19 21:01:30,410][INFO ][exchange-worker-#628%failure.IoomFailureHandlerTest0%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=1647b40b-5fc1-4c2b-96a4-2e569fb00000, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], evt=NODE_LEFT, evtNode=TcpDiscoveryNode [id=7f2de1b2-bdc3-4427-b854-d8d96a200001, consistentId=127.0.0.1:47501, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637344882095, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0]] [21:01:30] : [Step 4/5] [2021-11-19 21:01:30,412][INFO ][exchange-worker-#628%failure.IoomFailureHandlerTest0%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], stage="Waiting in exchange queue" (8 ms), stage="Exchange parameters initialization" (1 ms), stage="Determine exchange type" (20 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (1 ms), stage="Wait partitions release latch [latch=exchange]" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="After states restored callback" (0 ms), stage="WAL history reservation" (0 ms), stage="Finalize update counters" (2 ms), stage="Waiting for all single messages" (0 ms), stage="Exchanges merge" (0 ms), stage="Affinity recalculation (crd)" (83 ms), stage="Collect update counters and create affinity messages" (0 ms), stage="Assign partitions states" (0 ms), stage="Validate partitions states" (1 ms), stage="Apply update counters" (1 ms), stage="Full message preparing" (6 ms), stage="Full message sending" (0 ms), stage="State finish message sending" (0 ms), stage="Detect lost partitions" (13 ms), stage="Exchange done" (6 ms), stage="Total time" (142 ms)] [21:01:30] : [Step 4/5] [2021-11-19 21:01:30,414][INFO ][exchange-worker-#628%failure.IoomFailureHandlerTest0%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], stage="Affinity recalculation (partitions availability) [grp=default]" (10 ms) (parent=Affinity recalculation (crd)), stage="Affinity recalculation (partitions availability) [grp=ignite-sys-cache]" (6 ms) (parent=Affinity recalculation (crd)), stage="Affinity initialization (enforced) [grp=ignite-sys-cache]" (5 ms) (parent=Affinity recalculation (crd))] [21:01:30] : [Step 4/5] [2021-11-19 21:01:30,416][INFO ][exchange-worker-#628%failure.IoomFailureHandlerTest0%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], crd=true] [21:01:30] : [Step 4/5] [2021-11-19 21:01:30,419][INFO ][exchange-worker-#628%failure.IoomFailureHandlerTest0%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=3, minorTopVer=0], force=false, evt=NODE_LEFT, node=7f2de1b2-bdc3-4427-b854-d8d96a200001] [21:01:30] : [Step 4/5] [2021-11-19 21:01:30,541][INFO ][test-runner-#538%failure.IoomFailureHandlerTest%][root] >>> Stopping grid [name=failure.IoomFailureHandlerTest0, id=1647b40b-5fc1-4c2b-96a4-2e569fb00000] [21:01:30]W: [org.apache.ignite:ignite-core] [2021-11-19 21:01:30,553][WARN ][tcp-disco-sock-reader-[7f2de1b2 127.0.0.1:44237]-#41%failure.IoomFailureHandlerTest0%-#738%failure.IoomFailureHandlerTest0%][TestTcpDiscoverySpi] Failed to shutdown socket [21:01:30]W: [org.apache.ignite:ignite-core] java.net.SocketException: Socket is closed [21:01:30]W: [org.apache.ignite:ignite-core] at java.net.Socket.shutdownOutput(Socket.java:1568) [21:01:30]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.close(IgniteUtils.java:4247) [21:01:30]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.discovery.tcp.ServerImpl$SocketReader.body(ServerImpl.java:7370) [21:01:30]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.IgniteSpiThread.run(IgniteSpiThread.java:58) [21:01:30] : [Step 4/5] [2021-11-19 21:01:30,554][INFO ][tcp-disco-sock-reader-[7f2de1b2 127.0.0.1:44237]-#41%failure.IoomFailureHandlerTest0%-#738%failure.IoomFailureHandlerTest0%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:44237, rmtPort=44237, rmtNodeId=7f2de1b2-bdc3-4427-b854-d8d96a200001] [21:01:30] : [Step 4/5] [2021-11-19 21:01:30,557][INFO ][test-runner-#538%failure.IoomFailureHandlerTest%][GridCacheProcessor] Stopped cache [cacheName=default] [21:01:30] : [Step 4/5] [2021-11-19 21:01:30,558][INFO ][test-runner-#538%failure.IoomFailureHandlerTest%][GridCacheProcessor] Stopped cache [cacheName=ignite-sys-cache] [21:01:30] : [Step 4/5] [2021-11-19 21:01:30,568][INFO ][test-runner-#538%failure.IoomFailureHandlerTest%][GridDeploymentLocalStore] Removed undeployed class: GridDeployment [ts=1637344882219, depMode=SHARED, clsLdr=IsolatedClassLoader{roleName='test'}, clsLdrId=eaffb593d71-1647b40b-5fc1-4c2b-96a4-2e569fb00000, userVer=0, loc=true, sampleClsName=org.apache.ignite.internal.processors.cache.distributed.dht.preloader.GridDhtPartitionMap, pendingUndeploy=false, undeployed=true, usage=0] [21:01:30] : [Step 4/5] [2021-11-19 21:01:30,609][INFO ][test-runner-#538%failure.IoomFailureHandlerTest%][IoomFailureHandlerTest0] [21:01:30] : [Step 4/5] [21:01:30] : [Step 4/5] >>> +------------------------------------------------------+ [21:01:30] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV stopped OK [21:01:30] : [Step 4/5] >>> +------------------------------------------------------+ [21:01:30] : [Step 4/5] >>> Ignite instance name: failure.IoomFailureHandlerTest0 [21:01:30] : [Step 4/5] >>> Grid uptime: 00:00:08.609 [21:01:30] : [Step 4/5] [21:01:30] : [Step 4/5] [21:01:30] : [Step 4/5] [21:01:30] >>> Stopping test: IoomFailureHandlerTest#testIoomErrorNoStoreHandling in 8933 ms <<< [21:01:30] : [Step 4/5] [2021-11-19 21:01:30,610][INFO ][main][root] >>> Stopping test: IoomFailureHandlerTest#testIoomErrorNoStoreHandling in 8933 ms <<< [21:01:30] : [Step 4/5] [21:01:30] >>> Heap: 273 MB used / 1960 MB commited / 1960 MB max <<< [21:01:30] : [Step 4/5] [2021-11-19 21:01:30,610][INFO ][main][root] >>> Heap: 273 MB used / 1960 MB commited / 1960 MB max <<< [21:01:30] : [Step 4/5] [21:01:30] >>> Non-Heap: 106 MB used / 113 MB commited / 0 MB max <<< [21:01:30] : [Step 4/5] [2021-11-19 21:01:30,611][INFO ][main][root] >>> Non-Heap: 106 MB used / 113 MB commited / 0 MB max <<< [21:01:30] : [Step 4/5] [21:01:30] >>> Starting test: IoomFailureHandlerTest#testIoomErrorPdsHandling <<< [21:01:30] : [Step 4/5] [2021-11-19 21:01:30,615][INFO ][main][root] >>> Starting test: IoomFailureHandlerTest#testIoomErrorPdsHandling <<< [21:01:30] : [Step 4/5] [21:01:30] >>> Heap: 273 MB used / 1960 MB commited / 1960 MB max <<< [21:01:30] : [Step 4/5] [2021-11-19 21:01:30,615][INFO ][main][root] >>> Heap: 273 MB used / 1960 MB commited / 1960 MB max <<< [21:01:30] : [Step 4/5] [21:01:30] >>> Non-Heap: 106 MB used / 113 MB commited / 0 MB max <<< [21:01:30] : [Step 4/5] [2021-11-19 21:01:30,616][INFO ][main][root] >>> Non-Heap: 106 MB used / 113 MB commited / 0 MB max <<< [21:01:30]W: [org.apache.ignite:ignite-core] [2021-11-19 21:01:30,624][WARN ][test-runner-#789%failure.IoomFailureHandlerTest%][G] Ignite work directory is not provided, automatically resolved to: /opt/buildagent/work/7bc1c54bc719b67c/work [21:01:30]W: [org.apache.ignite:ignite-core] [2021-11-19 21:01:30,625][WARN ][test-runner-#789%failure.IoomFailureHandlerTest%][G] Consistent ID is not set, it is recommended to set consistent ID for production clusters (use IgniteConfiguration.setConsistentId property) [21:01:30] : [Step 4/5] [2021-11-19 21:01:30,629][INFO ][test-runner-#789%failure.IoomFailureHandlerTest%][IoomFailureHandlerTest0] [21:01:30] : [Step 4/5] [21:01:30] : [Step 4/5] >>> __________ ________________ [21:01:30] : [Step 4/5] >>> / _/ ___/ |/ / _/_ __/ __/ [21:01:30] : [Step 4/5] >>> _/ // (7 7 // / / / / _/ [21:01:30] : [Step 4/5] >>> /___/\___/_/|_/___/ /_/ /___/ [21:01:30] : [Step 4/5] >>> [21:01:30] : [Step 4/5] >>> ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:01:30] : [Step 4/5] >>> 2021 Copyright(C) Apache Software Foundation [21:01:30] : [Step 4/5] >>> [21:01:30] : [Step 4/5] >>> Ignite documentation: http://ignite.apache.org [21:01:30] : [Step 4/5] [21:01:30] : [Step 4/5] [2021-11-19 21:01:30,634][INFO ][test-runner-#789%failure.IoomFailureHandlerTest%][IoomFailureHandlerTest0] Config URL: n/a [21:01:30] : [Step 4/5] [2021-11-19 21:01:30,635][INFO ][test-runner-#789%failure.IoomFailureHandlerTest%][IoomFailureHandlerTest0] IgniteConfiguration [igniteInstanceName=failure.IoomFailureHandlerTest0, pubPoolSize=24, svcPoolSize=24, callbackPoolSize=24, stripedPoolSize=24, sysPoolSize=24, mgmtPoolSize=4, dataStreamerPoolSize=24, utilityCachePoolSize=24, utilityCacheKeepAliveTime=60000, p2pPoolSize=2, qryPoolSize=24, buildIdxPoolSize=4, igniteHome=/opt/buildagent/work/7bc1c54bc719b67c, igniteWorkDir=/opt/buildagent/work/7bc1c54bc719b67c/work, mbeanSrv=com.sun.jmx.mbeanserver.JmxMBeanServer@6fe85038, nodeId=9d5c1368-d764-4b5a-a895-4879ea800000, marsh=BinaryMarshaller [], marshLocJobs=false, daemon=false, p2pEnabled=true, netTimeout=10000, netCompressionLevel=1, sndRetryDelay=1000, sndRetryCnt=3, metricsHistSize=10000, metricsUpdateFreq=1000, metricsExpTime=9223372036854775807, discoSpi=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=0, ackTimeout=0, marsh=null, reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], segPlc=STOP, segResolveAttempts=2, waitForSegOnStart=true, allResolversPassReq=true, segChkFreq=10000, commSpi=TcpCommunicationSpi [connectGate=org.apache.ignite.spi.communication.tcp.internal.ConnectGateway@5d7e4e42, ctxInitLatch=java.util.concurrent.CountDownLatch@67cc456d[Count = 1], stopping=false, clientPool=null, nioSrvWrapper=null, stateProvider=null], evtSpi=MemoryEventStorageSpi [expireAgeMs=9223372036854775807, expireCnt=10000, filter=null], colSpi=NoopCollisionSpi [], deploySpi=LocalDeploymentSpi [], indexingSpi=org.apache.ignite.spi.indexing.noop.NoopIndexingSpi@499ae6f5, addrRslvr=null, encryptionSpi=org.apache.ignite.spi.encryption.noop.NoopEncryptionSpi@703e0fc2, tracingSpi=org.apache.ignite.spi.tracing.NoopTracingSpi@4807031b, clientMode=false, rebalanceThreadPoolSize=4, rebalanceTimeout=10000, rebalanceBatchesPrefetchCnt=3, rebalanceThrottle=0, rebalanceBatchSize=524288, txCfg=TransactionConfiguration [txSerEnabled=false, dfltIsolation=REPEATABLE_READ, dfltConcurrency=PESSIMISTIC, dfltTxTimeout=0, txTimeoutOnPartitionMapExchange=0, deadlockTimeout=10000, pessimisticTxLogSize=0, pessimisticTxLogLinger=10000, tmLookupClsName=null, txManagerFactory=null, useJtaSync=false], cacheSanityCheckEnabled=true, discoStartupDelay=60000, deployMode=SHARED, p2pMissedCacheSize=100, locHost=127.0.0.1, timeSrvPortBase=31100, timeSrvPortRange=100, failureDetectionTimeout=30000, sysWorkerBlockedTimeout=null, clientFailureDetectionTimeout=10000, metricsLogFreq=0, connectorCfg=null, odbcCfg=null, warmupClos=null, atomicCfg=AtomicConfiguration [seqReserveSize=1000, cacheMode=PARTITIONED, backups=1, aff=null, grpName=null], classLdr=null, sslCtxFactory=null, platformCfg=null, binaryCfg=null, memCfg=null, pstCfg=null, dsCfg=DataStorageConfiguration [sysRegionInitSize=41943040, sysRegionMaxSize=104857600, pageSize=2048, concLvl=0, dfltDataRegConf=DataRegionConfiguration [name=dfltPlc, maxSize=10485760, initSize=10485760, swapPath=null, pageEvictionMode=DISABLED, pageReplacementMode=CLOCK, evictionThreshold=0.9, emptyPagesPoolSize=100, metricsEnabled=false, metricsSubIntervalCount=5, metricsRateTimeInterval=60000, persistenceEnabled=true, checkpointPageBufSize=0, lazyMemoryAllocation=true, warmUpCfg=null], dataRegions=null, storagePath=null, checkpointFreq=180000, lockWaitTime=10000, checkpointThreads=4, checkpointWriteOrder=SEQUENTIAL, walHistSize=20, maxWalArchiveSize=1073741824, walSegments=10, walSegmentSize=67108864, walPath=db/wal, walArchivePath=db/wal/archive, cdcWalPath=db/wal/cdc, cdcEnabled=false, metricsEnabled=false, walMode=LOG_ONLY, walTlbSize=131072, walBuffSize=0, walFlushFreq=2000, walFsyncDelay=1000, walRecordIterBuffSize=67108864, alwaysWriteFullPages=false, fileIOFactory=org.apache.ignite.internal.processors.cache.persistence.file.AsyncFileIOFactory@3591dabc, metricsSubIntervalCnt=5, metricsRateTimeInterval=60000, walAutoArchiveAfterInactivity=-1, walForceArchiveTimeout=-1, writeThrottlingEnabled=false, walCompactionEnabled=false, walCompactionLevel=1, checkpointReadLockTimeout=null, walPageCompression=DISABLED, walPageCompressionLevel=null, dfltWarmUpCfg=null, encCfg=org.apache.ignite.configuration.EncryptionConfiguration@24b13b99, defragmentationThreadPoolSize=4, minWalArchiveSize=-1], snapshotPath=snapshots, activeOnStart=true, activeOnStartPropSetFlag=false, autoActivation=true, autoActivationPropSetFlag=false, clusterStateOnStart=null, sqlConnCfg=null, cliConnCfg=ClientConnectorConfiguration [host=null, port=10800, portRange=100, sockSndBufSize=0, sockRcvBufSize=0, tcpNoDelay=true, maxOpenCursorsPerConn=128, threadPoolSize=24, selectorCnt=12, idleTimeout=0, handshakeTimeout=10000, jdbcEnabled=true, odbcEnabled=true, thinCliEnabled=true, sslEnabled=false, useIgniteSslCtxFactory=true, sslClientAuth=false, sslCtxFactory=null, thinCliCfg=ThinClientConfiguration [maxActiveTxPerConn=100, maxActiveComputeTasksPerConn=0]], mvccVacuumThreadCnt=2, mvccVacuumFreq=5000, authEnabled=false, failureHnd=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]], commFailureRslvr=null, sqlCfg=SqlConfiguration [longQryWarnTimeout=3000, dfltQryTimeout=0, sqlQryHistSize=1000, validationEnabled=false], asyncContinuationExecutor=null] [21:01:30] : [Step 4/5] [2021-11-19 21:01:30,646][INFO ][test-runner-#789%failure.IoomFailureHandlerTest%][IoomFailureHandlerTest0] Daemon mode: off [21:01:30] : [Step 4/5] [2021-11-19 21:01:30,646][INFO ][test-runner-#789%failure.IoomFailureHandlerTest%][IoomFailureHandlerTest0] OS: Linux 4.15.0-151-generic amd64 [21:01:30] : [Step 4/5] [2021-11-19 21:01:30,646][INFO ][test-runner-#789%failure.IoomFailureHandlerTest%][IoomFailureHandlerTest0] OS user: teamcity [21:01:30] : [Step 4/5] [2021-11-19 21:01:30,647][INFO ][test-runner-#789%failure.IoomFailureHandlerTest%][IoomFailureHandlerTest0] PID: 16724 [21:01:30] : [Step 4/5] [2021-11-19 21:01:30,647][INFO ][test-runner-#789%failure.IoomFailureHandlerTest%][IoomFailureHandlerTest0] Language runtime: Java Platform API Specification ver. 1.8 [21:01:30] : [Step 4/5] [2021-11-19 21:01:30,648][INFO ][test-runner-#789%failure.IoomFailureHandlerTest%][IoomFailureHandlerTest0] VM information: Java(TM) SE Runtime Environment 1.8.0_261-b12 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 25.261-b12 [21:01:30] : [Step 4/5] [2021-11-19 21:01:30,648][INFO ][test-runner-#789%failure.IoomFailureHandlerTest%][IoomFailureHandlerTest0] VM total memory: 1.9GB [21:01:30] : [Step 4/5] [2021-11-19 21:01:30,649][INFO ][test-runner-#789%failure.IoomFailureHandlerTest%][IoomFailureHandlerTest0] Remote Management [restart: off, REST: off, JMX (remote: off)] [21:01:30] : [Step 4/5] [2021-11-19 21:01:30,649][INFO ][test-runner-#789%failure.IoomFailureHandlerTest%][IoomFailureHandlerTest0] Logger: GridTestLog4jLogger [quiet=false, config=null] [21:01:30] : [Step 4/5] [2021-11-19 21:01:30,649][INFO ][test-runner-#789%failure.IoomFailureHandlerTest%][IoomFailureHandlerTest0] IGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c [21:01:30] : [Step 4/5] [2021-11-19 21:01:30,650][INFO ][test-runner-#789%failure.IoomFailureHandlerTest%][IoomFailureHandlerTest0] VM arguments: [-DIGNITE_DUMP_THREADS_ON_FAILURE=false, -DMono=/usr/bin/mono-sgen, -DMono4.0_x64=/usr/lib/mono/4.0, -DMono4.5_x64=/usr/lib/mono/4.5, -DMonoVersion=6.12.0.90, -DSKIP_BUILD=false, -Dagent.home.dir=/opt/buildagent, -Dagent.name=aitc-lin02_03, -Dagent.ownPort=9090, -Dagent.work.dir=/opt/buildagent/work, -Dbuild.number=95, -Dbuild.vcs.number=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.1=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.GitHubApacheIgnite=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dclassworlds.conf=/opt/buildagent/temp/buildTmp/teamcity.m2.conf, -Dcom.jetbrains.maven.watcher.report.file=/opt/buildagent/temp/buildTmp/maven-build-info.xml, -Djava.io.tmpdir=/opt/buildagent/temp/buildTmp, -Dmaven.home=/opt/buildagent/tools/maven3_6, -Dmaven.multiModuleProjectDirectory=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.agent.cpuBenchmark=457, -Dteamcity.agent.dotnet.agent_url=http://localhost:9090/RPC2, -Dteamcity.agent.dotnet.build_id=6278078, -Dteamcity.auth.password=*******, -Dteamcity.auth.userId=TeamCityBuildId=6278078, -Dteamcity.build.changedFiles.file=/opt/buildagent/temp/buildTmp/changedFiles6342607772318147725.txt, -Dteamcity.build.checkoutDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.build.id=6278078, -Dteamcity.build.properties.file=/opt/buildagent/temp/buildTmp/teamcity.build5164517880467851002.properties, -Dteamcity.build.tempDir=/opt/buildagent/temp/buildTmp, -Dteamcity.build.workingDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.buildConfName=Basic 3, -Dteamcity.buildType.id=IgniteTests24Java8_Basic3, -Dteamcity.configuration.properties.file=/opt/buildagent/temp/buildTmp/teamcity.config5591980786735343870.properties, -Dteamcity.maven.userSettings.path=/opt/buildagent/temp/buildTmp/maven_settings_585072866407032347.xml, -Dteamcity.maven.watcher.home=/opt/buildagent/plugins/mavenPlugin/maven-watcher-jdk16, -Dteamcity.projectName=Ignite Tests 2.x (JDK 8/11), -Dteamcity.runner.properties.file=/opt/buildagent/temp/buildTmp/teamcity.runner9098465561618137420.properties, -Dteamcity.tests.recentlyFailedTests.file=/opt/buildagent/temp/buildTmp/testsToRunFirst3891775683130404069.txt, -Dteamcity.version=2021.2 (build 99542), -ea, -Xms2g, -Xmx2g, -XX:+HeapDumpOnOutOfMemoryError, -DIGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_TEST_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_UPDATE_NOTIFIER=false, -DIGNITE_NO_DISCO_ORDER=true, -DIGNITE_PERFORMANCE_SUGGESTIONS_DISABLED=true, -Djava.net.preferIPv4Stack=true, -DTEST_SCALE_FACTOR=1.0, -DIGNITE_TEST_PROP_LOG4J_FILE=log4j-tc-test.xml, -DIGNITE_QUIET=false, -DIGNITE_MARSHAL_BUFFERS_RECHECK=1000, -Dmaven.repo.local=/opt/buildagent/.m2/repository] [21:01:30] : [Step 4/5] [2021-11-19 21:01:30,655][INFO ][test-runner-#789%failure.IoomFailureHandlerTest%][IoomFailureHandlerTest0] System cache's DataRegion size is configured to 40 MB. Use DataStorageConfiguration.systemRegionInitialSize property to change the setting. [21:01:30]W: [org.apache.ignite:ignite-core] [2021-11-19 21:01:30,657][WARN ][test-runner-#789%failure.IoomFailureHandlerTest%][IoomFailureHandlerTest0] Peer class loading is enabled (disable it in production for performance and deployment consistency reasons) [21:01:30] : [Step 4/5] [2021-11-19 21:01:30,656][INFO ][test-runner-#789%failure.IoomFailureHandlerTest%][IoomFailureHandlerTest0] Configured caches [in 'sysMemPlc' dataRegion: ['ignite-sys-cache'], in 'dfltPlc' dataRegion: ['default']] [21:01:30] : [Step 4/5] [2021-11-19 21:01:30,657][INFO ][test-runner-#789%failure.IoomFailureHandlerTest%][IoomFailureHandlerTest0] 3-rd party licenses can be found at: /opt/buildagent/work/7bc1c54bc719b67c/libs/licenses [21:01:30] : [Step 4/5] [2021-11-19 21:01:30,665][INFO ][test-runner-#789%failure.IoomFailureHandlerTest%][IgnitePluginProcessor] Configured plugins: [21:01:30] : [Step 4/5] [2021-11-19 21:01:30,665][INFO ][test-runner-#789%failure.IoomFailureHandlerTest%][IgnitePluginProcessor] ^-- StanByClusterTestProvider 1.0 [21:01:30] : [Step 4/5] [2021-11-19 21:01:30,665][INFO ][test-runner-#789%failure.IoomFailureHandlerTest%][IgnitePluginProcessor] ^-- null [21:01:30] : [Step 4/5] [2021-11-19 21:01:30,666][INFO ][test-runner-#789%failure.IoomFailureHandlerTest%][IgnitePluginProcessor] [21:01:30] : [Step 4/5] [2021-11-19 21:01:30,666][INFO ][test-runner-#789%failure.IoomFailureHandlerTest%][IgnitePluginProcessor] ^-- PageMemory tracker plugin 1.0 [21:01:30] : [Step 4/5] [2021-11-19 21:01:30,666][INFO ][test-runner-#789%failure.IoomFailureHandlerTest%][IgnitePluginProcessor] ^-- null [21:01:30] : [Step 4/5] [2021-11-19 21:01:30,667][INFO ][test-runner-#789%failure.IoomFailureHandlerTest%][IgnitePluginProcessor] [21:01:30] : [Step 4/5] [2021-11-19 21:01:30,667][INFO ][test-runner-#789%failure.IoomFailureHandlerTest%][IgnitePluginProcessor] ^-- TestDistibutedConfigurationPlugin 1.0 [21:01:30] : [Step 4/5] [2021-11-19 21:01:30,667][INFO ][test-runner-#789%failure.IoomFailureHandlerTest%][IgnitePluginProcessor] ^-- null [21:01:30] : [Step 4/5] [2021-11-19 21:01:30,667][INFO ][test-runner-#789%failure.IoomFailureHandlerTest%][IgnitePluginProcessor] [21:01:30] : [Step 4/5] [2021-11-19 21:01:30,668][INFO ][test-runner-#789%failure.IoomFailureHandlerTest%][IgnitePluginProcessor] ^-- NodeValidationPluginProvider 1.0 [21:01:30] : [Step 4/5] [2021-11-19 21:01:30,668][INFO ][test-runner-#789%failure.IoomFailureHandlerTest%][IgnitePluginProcessor] ^-- null [21:01:30] : [Step 4/5] [2021-11-19 21:01:30,668][INFO ][test-runner-#789%failure.IoomFailureHandlerTest%][IgnitePluginProcessor] [21:01:30] : [Step 4/5] [2021-11-19 21:01:30,669][INFO ][test-runner-#789%failure.IoomFailureHandlerTest%][FailureProcessor] Configured failure handler: [hnd=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]] [21:01:30] : [Step 4/5] [2021-11-19 21:01:30,754][INFO ][test-runner-#789%failure.IoomFailureHandlerTest%][TcpCommunicationSpi] Successfully bound communication NIO server to TCP port [port=45010, locHost=/127.0.0.1, selectorsCnt=12, selectorSpins=0, pairedConn=false] [21:01:30]W: [org.apache.ignite:ignite-core] [2021-11-19 21:01:30,755][WARN ][test-runner-#789%failure.IoomFailureHandlerTest%][TcpCommunicationSpi] Message queue limit is set to 0 which may lead to potential OOMEs when running cache operations in FULL_ASYNC or PRIMARY_SYNC modes due to message queues growth on sender and receiver sides. [21:01:30] : [Step 4/5] [2021-11-19 21:01:30,778][INFO ][test-runner-#789%failure.IoomFailureHandlerTest%][GridCollisionManager] Collision resolution is disabled (all jobs will be activated upon arrival). [21:01:30] : [Step 4/5] [2021-11-19 21:01:30,778][INFO ][test-runner-#789%failure.IoomFailureHandlerTest%][IoomFailureHandlerTest0] Security status [authentication=off, sandbox=off, tls/ssl=off] [21:01:30] : [Step 4/5] [2021-11-19 21:01:30,780][INFO ][test-runner-#789%failure.IoomFailureHandlerTest%][TestTcpDiscoverySpi] Successfully bound to TCP port [port=47500, localHost=localhost/127.0.0.1, locNodeId=9d5c1368-d764-4b5a-a895-4879ea800000] [21:01:30] : [Step 4/5] [2021-11-19 21:01:30,791][INFO ][test-runner-#789%failure.IoomFailureHandlerTest%][PdsFoldersResolver] Successfully created new persistent storage folder [/opt/buildagent/work/7bc1c54bc719b67c/work/db/node00-a571b31d-b6bc-4984-9a28-b3fa77ead9f4] [21:01:30] : [Step 4/5] [2021-11-19 21:01:30,792][INFO ][test-runner-#789%failure.IoomFailureHandlerTest%][PdsFoldersResolver] Consistent ID used for local node is [a571b31d-b6bc-4984-9a28-b3fa77ead9f4] according to persistence data storage folders [21:01:30] : [Step 4/5] [2021-11-19 21:01:30,792][INFO ][test-runner-#789%failure.IoomFailureHandlerTest%][MaintenanceProcessor] Resolved store directory for node persistent data: /opt/buildagent/work/7bc1c54bc719b67c/work/db/node00-a571b31d-b6bc-4984-9a28-b3fa77ead9f4 [21:01:30] : [Step 4/5] [2021-11-19 21:01:30,795][INFO ][test-runner-#789%failure.IoomFailureHandlerTest%][CacheObjectBinaryProcessorImpl] Resolved directory for serialized binary metadata: /opt/buildagent/work/7bc1c54bc719b67c/work/db/binary_meta/node00-a571b31d-b6bc-4984-9a28-b3fa77ead9f4 [21:01:30] : [Step 4/5] [2021-11-19 21:01:30,804][INFO ][test-runner-#789%failure.IoomFailureHandlerTest%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/node00-a571b31d-b6bc-4984-9a28-b3fa77ead9f4 [21:01:30] : [Step 4/5] [2021-11-19 21:01:30,805][INFO ][test-runner-#789%failure.IoomFailureHandlerTest%][FileWriteAheadLogManager] Resolved write ahead log work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/node00-a571b31d-b6bc-4984-9a28-b3fa77ead9f4 [21:01:30] : [Step 4/5] [2021-11-19 21:01:30,806][INFO ][test-runner-#789%failure.IoomFailureHandlerTest%][FileWriteAheadLogManager] Resolved write ahead log archive directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/node00-a571b31d-b6bc-4984-9a28-b3fa77ead9f4 [21:01:31] : [Step 4/5] [2021-11-19 21:01:31,160][INFO ][test-runner-#789%failure.IoomFailureHandlerTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/node00-a571b31d-b6bc-4984-9a28-b3fa77ead9f4/0000000000000000.wal [21:01:31] : [Step 4/5] [2021-11-19 21:01:31,161][INFO ][test-runner-#789%failure.IoomFailureHandlerTest%][FileHandleManagerImpl] Initialized write-ahead log manager [mode=LOG_ONLY] [21:01:31] : [Step 4/5] [2021-11-19 21:01:31,168][INFO ][test-runner-#789%failure.IoomFailureHandlerTest%][GridCacheDatabaseSharedManager] Configured data regions initialized successfully [total=5] [21:01:31] : [Step 4/5] [2021-11-19 21:01:31,169][INFO ][test-runner-#789%failure.IoomFailureHandlerTest%][IgniteSnapshotManager] Resolved snapshot work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/snapshots [21:01:31] : [Step 4/5] [2021-11-19 21:01:31,170][INFO ][test-runner-#789%failure.IoomFailureHandlerTest%][IgniteSnapshotManager] Resolved temp directory for snapshot creation: /opt/buildagent/work/7bc1c54bc719b67c/work/db/node00-a571b31d-b6bc-4984-9a28-b3fa77ead9f4/snp [21:01:31] : [Step 4/5] [2021-11-19 21:01:31,174][INFO ][test-runner-#789%failure.IoomFailureHandlerTest%][ClientListenerProcessor] Client connector processor has started on TCP port 10800 [21:01:31] : [Step 4/5] [2021-11-19 21:01:31,183][INFO ][test-runner-#789%failure.IoomFailureHandlerTest%][IoomFailureHandlerTest0] Non-loopback local IPs: 172.17.0.4 [21:01:31] : [Step 4/5] [2021-11-19 21:01:31,183][INFO ][test-runner-#789%failure.IoomFailureHandlerTest%][IoomFailureHandlerTest0] Enabled local MACs: 0242AC110004 [21:01:31] : [Step 4/5] [2021-11-19 21:01:31,187][INFO ][test-runner-#789%failure.IoomFailureHandlerTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:01:31] : [Step 4/5] [2021-11-19 21:01:31,191][INFO ][test-runner-#789%failure.IoomFailureHandlerTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=48096, tableSize=3.8 MiB, replacementSize=6.0 KiB, checkpointBuffer=100.0 MiB] [21:01:31] : [Step 4/5] [2021-11-19 21:01:31,192][INFO ][test-runner-#789%failure.IoomFailureHandlerTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:01:31] : [Step 4/5] [2021-11-19 21:01:31,196][INFO ][test-runner-#789%failure.IoomFailureHandlerTest%][GridCacheDatabaseSharedManager] Applying lost metastore updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:01:31] : [Step 4/5] [2021-11-19 21:01:31,198][INFO ][test-runner-#789%failure.IoomFailureHandlerTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=0 ms] [21:01:31] : [Step 4/5] [2021-11-19 21:01:31,198][INFO ][test-runner-#789%failure.IoomFailureHandlerTest%][GridCacheProcessor] Restoring partition state for local groups. [21:01:31] : [Step 4/5] [2021-11-19 21:01:31,198][INFO ][test-runner-#789%failure.IoomFailureHandlerTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=0, partitionsProcessed=0, time=0ms] [21:01:31] : [Step 4/5] [2021-11-19 21:01:31,199][INFO ][test-runner-#789%failure.IoomFailureHandlerTest%][GridEncryptionManager] Encryption keys loaded from metastore. [grps=, masterKeyName=null] [21:01:31] : [Step 4/5] [2021-11-19 21:01:31,209][INFO ][test-runner-#789%failure.IoomFailureHandlerTest%][ClusterProcessor] Cluster ID and tag has been read from metastorage: null [21:01:31] : [Step 4/5] [2021-11-19 21:01:31,209][INFO ][test-runner-#789%failure.IoomFailureHandlerTest%][IgniteClusterImpl] Shutdown policy was updated [oldVal=null, newVal=null] [21:01:31] : [Step 4/5] [2021-11-19 21:01:31,210][INFO ][test-runner-#789%failure.IoomFailureHandlerTest%][GridCacheDatabaseSharedManager] Checkpoint frequency deviation changed [oldVal=null, newVal=null] [21:01:31] : [Step 4/5] [2021-11-19 21:01:31,220][INFO ][test-runner-#789%failure.IoomFailureHandlerTest%][FilePageStoreManager] Cleanup cache stores [total=1, left=0, cleanFiles=false] [21:01:31] : [Step 4/5] [2021-11-19 21:01:31,226][INFO ][test-runner-#789%failure.IoomFailureHandlerTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=48096, tableSize=3.8 MiB, replacementSize=6.0 KiB, checkpointBuffer=100.0 MiB] [21:01:31] : [Step 4/5] [2021-11-19 21:01:31,228][INFO ][test-runner-#789%failure.IoomFailureHandlerTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=48096, tableSize=3.8 MiB, replacementSize=6.0 KiB, checkpointBuffer=100.0 MiB] [21:01:31] : [Step 4/5] [2021-11-19 21:01:31,233][INFO ][test-runner-#789%failure.IoomFailureHandlerTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=48096, tableSize=3.8 MiB, replacementSize=6.0 KiB, checkpointBuffer=100.0 MiB] [21:01:31] : [Step 4/5] [2021-11-19 21:01:31,233][INFO ][test-runner-#789%failure.IoomFailureHandlerTest%][GridCacheDatabaseSharedManager] Data Regions Started: 5 [21:01:31] : [Step 4/5] [2021-11-19 21:01:31,234][INFO ][test-runner-#789%failure.IoomFailureHandlerTest%][GridCacheDatabaseSharedManager] ^-- sysMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:01:31] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:01:31] : [Step 4/5] ^-- metastoreMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:01:31] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:01:31] : [Step 4/5] ^-- TxLog region [type=internal, persistence=true, lazyAlloc=false, [21:01:31] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:01:31] : [Step 4/5] ^-- dfltPlc region [type=default, persistence=true, lazyAlloc=true, [21:01:31] : [Step 4/5] ... initCfg=10MB, maxCfg=10MB, usedRam=0MB, freeRam=100%, allocRam=0MB, allocTotal=0MB] [21:01:31] : [Step 4/5] ^-- volatileDsMemPlc region [type=user, persistence=false, lazyAlloc=true, [21:01:31] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB] [21:01:31] : [Step 4/5] ^-- Ignite persistence [used=0MB] [21:01:31] : [Step 4/5] [21:01:31] : [Step 4/5] [2021-11-19 21:01:31,236][INFO ][test-runner-#789%failure.IoomFailureHandlerTest%][GridCacheDatabaseSharedManager] Starting binary memory restore for: [1544803905, -2100569601] [21:01:31] : [Step 4/5] [2021-11-19 21:01:31,362][INFO ][test-runner-#789%failure.IoomFailureHandlerTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:01:31] : [Step 4/5] [2021-11-19 21:01:31,363][INFO ][test-runner-#789%failure.IoomFailureHandlerTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:01:31] : [Step 4/5] [2021-11-19 21:01:31,373][INFO ][test-runner-#789%failure.IoomFailureHandlerTest%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/node00-a571b31d-b6bc-4984-9a28-b3fa77ead9f4/0000000000000000.wal, offset=0, ver=2] [21:01:31] : [Step 4/5] [2021-11-19 21:01:31,376][INFO ][test-runner-#789%failure.IoomFailureHandlerTest%][PageMemoryImpl] Started page memory [memoryAllocated=24.0 MiB, pages=11544, tableSize=937.7 KiB, replacementSize=1.5 KiB, checkpointBuffer=10.0 MiB] [21:01:31] : [Step 4/5] [2021-11-19 21:01:31,389][INFO ][test-runner-#789%failure.IoomFailureHandlerTest%][GridCacheProcessor] Started cache in recovery mode [name=default, id=1544803905, dataRegionName=dfltPlc, mode=PARTITIONED, atomicity=TRANSACTIONAL, backups=0, mvcc=false] [21:01:31] : [Step 4/5] [2021-11-19 21:01:31,393][INFO ][test-runner-#789%failure.IoomFailureHandlerTest%][GridCacheProcessor] Started cache in recovery mode [name=ignite-sys-cache, id=-2100569601, dataRegionName=sysMemPlc, mode=REPLICATED, atomicity=TRANSACTIONAL, backups=2147483647, mvcc=false] [21:01:31] : [Step 4/5] [2021-11-19 21:01:31,394][INFO ][test-runner-#789%failure.IoomFailureHandlerTest%][GridCacheDatabaseSharedManager] Binary recovery performed in 158 ms. [21:01:31] : [Step 4/5] [2021-11-19 21:01:31,395][INFO ][test-runner-#789%failure.IoomFailureHandlerTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:01:31] : [Step 4/5] [2021-11-19 21:01:31,395][INFO ][test-runner-#789%failure.IoomFailureHandlerTest%][GridCacheDatabaseSharedManager] Applying lost cache updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:01:31] : [Step 4/5] [2021-11-19 21:01:31,483][INFO ][test-runner-#789%failure.IoomFailureHandlerTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=91 ms] [21:01:31] : [Step 4/5] [2021-11-19 21:01:31,484][INFO ][test-runner-#789%failure.IoomFailureHandlerTest%][GridCacheProcessor] Restoring partition state for local groups. [21:01:31] : [Step 4/5] [2021-11-19 21:01:31,536][INFO ][test-runner-#789%failure.IoomFailureHandlerTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=2, partitionsProcessed=1124, time=52ms] [21:01:31] : [Step 4/5] [2021-11-19 21:01:31,743][INFO ][disco-notifier-worker-#902%failure.IoomFailureHandlerTest0%][MvccProcessorImpl] Assigned mvcc coordinator [crd=MvccCoordinator [topVer=AffinityTopologyVersion [topVer=1, minorTopVer=0], nodeId=9d5c1368-d764-4b5a-a895-4879ea800000, ver=1637344891737, local=true, initialized=false]] [21:01:31] : [Step 4/5] [2021-11-19 21:01:31,745][INFO ][sys-#889%failure.IoomFailureHandlerTest0%][ClusterProcessor] Writing cluster ID and tag to metastorage on ready for write ClusterIdAndTag [id=895f05ab-6f96-4de8-9bc9-1aeb8fe38c93, tag=objective_knuth] [21:01:31] : [Step 4/5] [2021-11-19 21:01:31,750][INFO ][disco-notifier-worker-#902%failure.IoomFailureHandlerTest0%][ClusterProcessor] objective_knuth [21:01:31] : [Step 4/5] [2021-11-19 21:01:31,751][INFO ][disco-notifier-worker-#902%failure.IoomFailureHandlerTest0%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustEnabled' was changed from 'null' to 'false' [21:01:31] : [Step 4/5] [2021-11-19 21:01:31,753][INFO ][disco-notifier-worker-#902%failure.IoomFailureHandlerTest0%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustTimeout' was changed from 'null' to '300000' [21:01:31] : [Step 4/5] [2021-11-19 21:01:31,754][INFO ][disco-notifier-worker-#902%failure.IoomFailureHandlerTest0%][IgniteTxManager] Transactions parameter 'longOperationsDumpTimeout' was changed from 'null' to '60000' [21:01:31] : [Step 4/5] [2021-11-19 21:01:31,756][INFO ][disco-notifier-worker-#902%failure.IoomFailureHandlerTest0%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpThreshold' was changed from 'null' to '0' [21:01:31] : [Step 4/5] [2021-11-19 21:01:31,757][INFO ][disco-notifier-worker-#902%failure.IoomFailureHandlerTest0%][IgniteTxManager] Transactions parameter 'transactionTimeDumpSamplesCoefficient' was changed from 'null' to '0.0' [21:01:31] : [Step 4/5] [2021-11-19 21:01:31,758][INFO ][disco-notifier-worker-#902%failure.IoomFailureHandlerTest0%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpSamplesPerSecondLimit' was changed from 'null' to '5' [21:01:31] : [Step 4/5] [2021-11-19 21:01:31,772][INFO ][disco-notifier-worker-#902%failure.IoomFailureHandlerTest0%][IgniteTxManager] Transactions parameter 'collisionsDumpInterval' was changed from 'null' to '1000' [21:01:31] : [Step 4/5] [2021-11-19 21:01:31,788][INFO ][disco-notifier-worker-#902%failure.IoomFailureHandlerTest0%][IgniteTxManager] Transactions parameter 'txOwnerDumpRequestsAllowed' was changed from 'null' to 'true' [21:01:31] : [Step 4/5] [2021-11-19 21:01:31,808][INFO ][disco-notifier-worker-#902%failure.IoomFailureHandlerTest0%][GridCacheDatabaseSharedManager] Historical rebalance WAL threshold changed [property=historical.rebalance.threshold, oldVal=null, newVal=500] [21:01:31] : [Step 4/5] [2021-11-19 21:01:31,885][INFO ][test-runner-#789%failure.IoomFailureHandlerTest%][IoomFailureHandlerTest0] To start Console Management & Monitoring run ignitevisorcmd.{sh|bat} [21:01:31] : [Step 4/5] [2021-11-19 21:01:31,886][INFO ][test-runner-#789%failure.IoomFailureHandlerTest%][IoomFailureHandlerTest0] [21:01:31] : [Step 4/5] [21:01:31] : [Step 4/5] >>> +-------------------------------------------+ [21:01:31] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:01:31] : [Step 4/5] >>> +-------------------------------------------+ [21:01:31] : [Step 4/5] >>> OS name: Linux 4.15.0-151-generic amd64 [21:01:31] : [Step 4/5] >>> CPU(s): 24 [21:01:31] : [Step 4/5] >>> Heap: 2.0GB [21:01:31] : [Step 4/5] >>> VM name: 16724@c4dfe9a430b2 [21:01:31] : [Step 4/5] >>> Ignite instance name: failure.IoomFailureHandlerTest0 [21:01:31] : [Step 4/5] >>> Local node [ID=9D5C1368-D764-4B5A-A895-4879EA800000, order=1, clientMode=false] [21:01:31] : [Step 4/5] >>> Local node addresses: [127.0.0.1] [21:01:31] : [Step 4/5] >>> Local ports: TCP:10800 TCP:45010 TCP:47500 [21:01:31] : [Step 4/5] [21:01:31] : [Step 4/5] [2021-11-19 21:01:31,887][INFO ][test-runner-#789%failure.IoomFailureHandlerTest%][IoomFailureHandlerTest0] >>> Ignite cluster is in INACTIVE state (limited functionality available). Use control.(sh|bat) script or IgniteCluster.state(ClusterState.ACTIVE) to change the state. [21:01:31] : [Step 4/5] [2021-11-19 21:01:31,893][INFO ][test-runner-#789%failure.IoomFailureHandlerTest%][GridDiscoveryManager] Topology snapshot [ver=1, locNode=9d5c1368, servers=1, clients=0, state=INACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=9d5c1368-d764-4b5a-a895-4879ea800000, consistentId=a571b31d-b6bc-4984-9a28-b3fa77ead9f4, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:01:31] : [Step 4/5] [2021-11-19 21:01:31,894][INFO ][test-runner-#789%failure.IoomFailureHandlerTest%][G] Node started : [stage="Configure system pool" (1 ms),stage="Start managers" (167 ms),stage="Configure binary metadata" (3 ms),stage="Start processors" (384 ms),stage="Start 'StanByClusterTestProvider' plugin" (0 ms),stage="Start 'PageMemory tracker plugin' plugin" (0 ms),stage="Start 'TestDistibutedConfigurationPlugin' plugin" (0 ms),stage="Start 'NodeValidationPluginProvider' plugin" (0 ms),stage="Init metastore" (38 ms),stage="Init and start regions" (15 ms),stage="Restore binary memory" (158 ms),stage="Restore logical state" (141 ms),stage="Finish recovery" (189 ms),stage="Join topology" (18 ms),stage="Await transition" (2 ms),stage="Await exchange" (146 ms),stage="Total time" (1262 ms)] [21:01:31] : [Step 4/5] [2021-11-19 21:01:31,895][INFO ][test-runner-#789%failure.IoomFailureHandlerTest%][root] Node started with the following configuration [id=9d5c1368-d764-4b5a-a895-4879ea800000, marshaller=BinaryMarshaller [], discovery=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=5000, ackTimeout=5000, marsh=JdkMarshaller [clsFilter=org.apache.ignite.marshaller.MarshallerUtils$1@4d47dcdd], reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], binaryCfg=null, lateAff=true] [21:01:31]W: [org.apache.ignite:ignite-core] [2021-11-19 21:01:31,908][WARN ][test-runner-#789%failure.IoomFailureHandlerTest%][G] Ignite work directory is not provided, automatically resolved to: /opt/buildagent/work/7bc1c54bc719b67c/work [21:01:31]W: [org.apache.ignite:ignite-core] [2021-11-19 21:01:31,908][WARN ][test-runner-#789%failure.IoomFailureHandlerTest%][G] Consistent ID is not set, it is recommended to set consistent ID for production clusters (use IgniteConfiguration.setConsistentId property) [21:01:31] : [Step 4/5] [2021-11-19 21:01:31,924][INFO ][test-runner-#789%failure.IoomFailureHandlerTest%][IoomFailureHandlerTest1] [21:01:31] : [Step 4/5] [21:01:31] : [Step 4/5] >>> __________ ________________ [21:01:31] : [Step 4/5] >>> / _/ ___/ |/ / _/_ __/ __/ [21:01:31] : [Step 4/5] >>> _/ // (7 7 // / / / / _/ [21:01:31] : [Step 4/5] >>> /___/\___/_/|_/___/ /_/ /___/ [21:01:31] : [Step 4/5] >>> [21:01:31] : [Step 4/5] >>> ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:01:31] : [Step 4/5] >>> 2021 Copyright(C) Apache Software Foundation [21:01:31] : [Step 4/5] >>> [21:01:31] : [Step 4/5] >>> Ignite documentation: http://ignite.apache.org [21:01:31] : [Step 4/5] [21:01:31] : [Step 4/5] [2021-11-19 21:01:31,925][INFO ][test-runner-#789%failure.IoomFailureHandlerTest%][IoomFailureHandlerTest1] Config URL: n/a [21:01:31] : [Step 4/5] [2021-11-19 21:01:31,926][INFO ][test-runner-#789%failure.IoomFailureHandlerTest%][IoomFailureHandlerTest1] IgniteConfiguration [igniteInstanceName=failure.IoomFailureHandlerTest1, pubPoolSize=24, svcPoolSize=24, callbackPoolSize=24, stripedPoolSize=24, sysPoolSize=24, mgmtPoolSize=4, dataStreamerPoolSize=24, utilityCachePoolSize=24, utilityCacheKeepAliveTime=60000, p2pPoolSize=2, qryPoolSize=24, buildIdxPoolSize=4, igniteHome=/opt/buildagent/work/7bc1c54bc719b67c, igniteWorkDir=/opt/buildagent/work/7bc1c54bc719b67c/work, mbeanSrv=com.sun.jmx.mbeanserver.JmxMBeanServer@6fe85038, nodeId=fe65148c-4d17-4fff-9236-05b24cf00001, marsh=BinaryMarshaller [], marshLocJobs=false, daemon=false, p2pEnabled=true, netTimeout=10000, netCompressionLevel=1, sndRetryDelay=1000, sndRetryCnt=3, metricsHistSize=10000, metricsUpdateFreq=1000, metricsExpTime=9223372036854775807, discoSpi=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=0, ackTimeout=0, marsh=null, reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], segPlc=STOP, segResolveAttempts=2, waitForSegOnStart=true, allResolversPassReq=true, segChkFreq=10000, commSpi=TcpCommunicationSpi [connectGate=org.apache.ignite.spi.communication.tcp.internal.ConnectGateway@6d2d4d43, ctxInitLatch=java.util.concurrent.CountDownLatch@247dbba4[Count = 1], stopping=false, clientPool=null, nioSrvWrapper=null, stateProvider=null], evtSpi=MemoryEventStorageSpi [expireAgeMs=9223372036854775807, expireCnt=10000, filter=null], colSpi=NoopCollisionSpi [], deploySpi=LocalDeploymentSpi [], indexingSpi=org.apache.ignite.spi.indexing.noop.NoopIndexingSpi@16eada70, addrRslvr=null, encryptionSpi=org.apache.ignite.spi.encryption.noop.NoopEncryptionSpi@24ff30a5, tracingSpi=org.apache.ignite.spi.tracing.NoopTracingSpi@63e68170, clientMode=false, rebalanceThreadPoolSize=4, rebalanceTimeout=10000, rebalanceBatchesPrefetchCnt=3, rebalanceThrottle=0, rebalanceBatchSize=524288, txCfg=TransactionConfiguration [txSerEnabled=false, dfltIsolation=REPEATABLE_READ, dfltConcurrency=PESSIMISTIC, dfltTxTimeout=0, txTimeoutOnPartitionMapExchange=0, deadlockTimeout=10000, pessimisticTxLogSize=0, pessimisticTxLogLinger=10000, tmLookupClsName=null, txManagerFactory=null, useJtaSync=false], cacheSanityCheckEnabled=true, discoStartupDelay=60000, deployMode=SHARED, p2pMissedCacheSize=100, locHost=127.0.0.1, timeSrvPortBase=31100, timeSrvPortRange=100, failureDetectionTimeout=30000, sysWorkerBlockedTimeout=null, clientFailureDetectionTimeout=10000, metricsLogFreq=0, connectorCfg=null, odbcCfg=null, warmupClos=null, atomicCfg=AtomicConfiguration [seqReserveSize=1000, cacheMode=PARTITIONED, backups=1, aff=null, grpName=null], classLdr=null, sslCtxFactory=null, platformCfg=null, binaryCfg=null, memCfg=null, pstCfg=null, dsCfg=DataStorageConfiguration [sysRegionInitSize=41943040, sysRegionMaxSize=104857600, pageSize=2048, concLvl=0, dfltDataRegConf=DataRegionConfiguration [name=dfltPlc, maxSize=10485760, initSize=10485760, swapPath=null, pageEvictionMode=DISABLED, pageReplacementMode=CLOCK, evictionThreshold=0.9, emptyPagesPoolSize=100, metricsEnabled=false, metricsSubIntervalCount=5, metricsRateTimeInterval=60000, persistenceEnabled=true, checkpointPageBufSize=0, lazyMemoryAllocation=true, warmUpCfg=null], dataRegions=null, storagePath=null, checkpointFreq=180000, lockWaitTime=10000, checkpointThreads=4, checkpointWriteOrder=SEQUENTIAL, walHistSize=20, maxWalArchiveSize=1073741824, walSegments=10, walSegmentSize=67108864, walPath=db/wal, walArchivePath=db/wal/archive, cdcWalPath=db/wal/cdc, cdcEnabled=false, metricsEnabled=false, walMode=LOG_ONLY, walTlbSize=131072, walBuffSize=0, walFlushFreq=2000, walFsyncDelay=1000, walRecordIterBuffSize=67108864, alwaysWriteFullPages=false, fileIOFactory=org.apache.ignite.internal.processors.cache.persistence.file.AsyncFileIOFactory@2a3b00d7, metricsSubIntervalCnt=5, metricsRateTimeInterval=60000, walAutoArchiveAfterInactivity=-1, walForceArchiveTimeout=-1, writeThrottlingEnabled=false, walCompactionEnabled=false, walCompactionLevel=1, checkpointReadLockTimeout=null, walPageCompression=DISABLED, walPageCompressionLevel=null, dfltWarmUpCfg=null, encCfg=org.apache.ignite.configuration.EncryptionConfiguration@623b8e4e, defragmentationThreadPoolSize=4, minWalArchiveSize=-1], snapshotPath=snapshots, activeOnStart=true, activeOnStartPropSetFlag=false, autoActivation=true, autoActivationPropSetFlag=false, clusterStateOnStart=null, sqlConnCfg=null, cliConnCfg=ClientConnectorConfiguration [host=null, port=10800, portRange=100, sockSndBufSize=0, sockRcvBufSize=0, tcpNoDelay=true, maxOpenCursorsPerConn=128, threadPoolSize=24, selectorCnt=12, idleTimeout=0, handshakeTimeout=10000, jdbcEnabled=true, odbcEnabled=true, thinCliEnabled=true, sslEnabled=false, useIgniteSslCtxFactory=true, sslClientAuth=false, sslCtxFactory=null, thinCliCfg=ThinClientConfiguration [maxActiveTxPerConn=100, maxActiveComputeTasksPerConn=0]], mvccVacuumThreadCnt=2, mvccVacuumFreq=5000, authEnabled=false, failureHnd=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]], commFailureRslvr=null, sqlCfg=SqlConfiguration [longQryWarnTimeout=3000, dfltQryTimeout=0, sqlQryHistSize=1000, validationEnabled=false], asyncContinuationExecutor=null] [21:01:31] : [Step 4/5] [2021-11-19 21:01:31,939][INFO ][test-runner-#789%failure.IoomFailureHandlerTest%][IoomFailureHandlerTest1] Daemon mode: off [21:01:31] : [Step 4/5] [2021-11-19 21:01:31,939][INFO ][test-runner-#789%failure.IoomFailureHandlerTest%][IoomFailureHandlerTest1] OS: Linux 4.15.0-151-generic amd64 [21:01:31] : [Step 4/5] [2021-11-19 21:01:31,940][INFO ][test-runner-#789%failure.IoomFailureHandlerTest%][IoomFailureHandlerTest1] OS user: teamcity [21:01:31] : [Step 4/5] [2021-11-19 21:01:31,940][INFO ][test-runner-#789%failure.IoomFailureHandlerTest%][IoomFailureHandlerTest1] PID: 16724 [21:01:31] : [Step 4/5] [2021-11-19 21:01:31,941][INFO ][test-runner-#789%failure.IoomFailureHandlerTest%][IoomFailureHandlerTest1] Language runtime: Java Platform API Specification ver. 1.8 [21:01:31] : [Step 4/5] [2021-11-19 21:01:31,941][INFO ][test-runner-#789%failure.IoomFailureHandlerTest%][IoomFailureHandlerTest1] VM information: Java(TM) SE Runtime Environment 1.8.0_261-b12 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 25.261-b12 [21:01:31] : [Step 4/5] [2021-11-19 21:01:31,941][INFO ][test-runner-#789%failure.IoomFailureHandlerTest%][IoomFailureHandlerTest1] VM total memory: 1.9GB [21:01:31] : [Step 4/5] [2021-11-19 21:01:31,942][INFO ][test-runner-#789%failure.IoomFailureHandlerTest%][IoomFailureHandlerTest1] Remote Management [restart: off, REST: off, JMX (remote: off)] [21:01:31] : [Step 4/5] [2021-11-19 21:01:31,942][INFO ][test-runner-#789%failure.IoomFailureHandlerTest%][IoomFailureHandlerTest1] Logger: GridTestLog4jLogger [quiet=false, config=null] [21:01:31] : [Step 4/5] [2021-11-19 21:01:31,942][INFO ][test-runner-#789%failure.IoomFailureHandlerTest%][IoomFailureHandlerTest1] IGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c [21:01:31] : [Step 4/5] [2021-11-19 21:01:31,943][INFO ][test-runner-#789%failure.IoomFailureHandlerTest%][IoomFailureHandlerTest1] VM arguments: [-DIGNITE_DUMP_THREADS_ON_FAILURE=false, -DMono=/usr/bin/mono-sgen, -DMono4.0_x64=/usr/lib/mono/4.0, -DMono4.5_x64=/usr/lib/mono/4.5, -DMonoVersion=6.12.0.90, -DSKIP_BUILD=false, -Dagent.home.dir=/opt/buildagent, -Dagent.name=aitc-lin02_03, -Dagent.ownPort=9090, -Dagent.work.dir=/opt/buildagent/work, -Dbuild.number=95, -Dbuild.vcs.number=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.1=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.GitHubApacheIgnite=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dclassworlds.conf=/opt/buildagent/temp/buildTmp/teamcity.m2.conf, -Dcom.jetbrains.maven.watcher.report.file=/opt/buildagent/temp/buildTmp/maven-build-info.xml, -Djava.io.tmpdir=/opt/buildagent/temp/buildTmp, -Dmaven.home=/opt/buildagent/tools/maven3_6, -Dmaven.multiModuleProjectDirectory=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.agent.cpuBenchmark=457, -Dteamcity.agent.dotnet.agent_url=http://localhost:9090/RPC2, -Dteamcity.agent.dotnet.build_id=6278078, -Dteamcity.auth.password=*******, -Dteamcity.auth.userId=TeamCityBuildId=6278078, -Dteamcity.build.changedFiles.file=/opt/buildagent/temp/buildTmp/changedFiles6342607772318147725.txt, -Dteamcity.build.checkoutDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.build.id=6278078, -Dteamcity.build.properties.file=/opt/buildagent/temp/buildTmp/teamcity.build5164517880467851002.properties, -Dteamcity.build.tempDir=/opt/buildagent/temp/buildTmp, -Dteamcity.build.workingDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.buildConfName=Basic 3, -Dteamcity.buildType.id=IgniteTests24Java8_Basic3, -Dteamcity.configuration.properties.file=/opt/buildagent/temp/buildTmp/teamcity.config5591980786735343870.properties, -Dteamcity.maven.userSettings.path=/opt/buildagent/temp/buildTmp/maven_settings_585072866407032347.xml, -Dteamcity.maven.watcher.home=/opt/buildagent/plugins/mavenPlugin/maven-watcher-jdk16, -Dteamcity.projectName=Ignite Tests 2.x (JDK 8/11), -Dteamcity.runner.properties.file=/opt/buildagent/temp/buildTmp/teamcity.runner9098465561618137420.properties, -Dteamcity.tests.recentlyFailedTests.file=/opt/buildagent/temp/buildTmp/testsToRunFirst3891775683130404069.txt, -Dteamcity.version=2021.2 (build 99542), -ea, -Xms2g, -Xmx2g, -XX:+HeapDumpOnOutOfMemoryError, -DIGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_TEST_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_UPDATE_NOTIFIER=false, -DIGNITE_NO_DISCO_ORDER=true, -DIGNITE_PERFORMANCE_SUGGESTIONS_DISABLED=true, -Djava.net.preferIPv4Stack=true, -DTEST_SCALE_FACTOR=1.0, -DIGNITE_TEST_PROP_LOG4J_FILE=log4j-tc-test.xml, -DIGNITE_QUIET=false, -DIGNITE_MARSHAL_BUFFERS_RECHECK=1000, -Dmaven.repo.local=/opt/buildagent/.m2/repository] [21:01:31] : [Step 4/5] [2021-11-19 21:01:31,952][INFO ][test-runner-#789%failure.IoomFailureHandlerTest%][IoomFailureHandlerTest1] System cache's DataRegion size is configured to 40 MB. Use DataStorageConfiguration.systemRegionInitialSize property to change the setting. [21:01:31] : [Step 4/5] [2021-11-19 21:01:31,953][INFO ][test-runner-#789%failure.IoomFailureHandlerTest%][IoomFailureHandlerTest1] Configured caches [in 'sysMemPlc' dataRegion: ['ignite-sys-cache'], in 'dfltPlc' dataRegion: ['default']] [21:01:31]W: [org.apache.ignite:ignite-core] [2021-11-19 21:01:31,953][WARN ][test-runner-#789%failure.IoomFailureHandlerTest%][IoomFailureHandlerTest1] Peer class loading is enabled (disable it in production for performance and deployment consistency reasons) [21:01:31] : [Step 4/5] [2021-11-19 21:01:31,954][INFO ][test-runner-#789%failure.IoomFailureHandlerTest%][IoomFailureHandlerTest1] 3-rd party licenses can be found at: /opt/buildagent/work/7bc1c54bc719b67c/libs/licenses [21:01:31] : [Step 4/5] [2021-11-19 21:01:31,961][INFO ][test-runner-#789%failure.IoomFailureHandlerTest%][IgnitePluginProcessor] Configured plugins: [21:01:31] : [Step 4/5] [2021-11-19 21:01:31,962][INFO ][test-runner-#789%failure.IoomFailureHandlerTest%][IgnitePluginProcessor] ^-- StanByClusterTestProvider 1.0 [21:01:31] : [Step 4/5] [2021-11-19 21:01:31,962][INFO ][test-runner-#789%failure.IoomFailureHandlerTest%][IgnitePluginProcessor] ^-- null [21:01:31] : [Step 4/5] [2021-11-19 21:01:31,962][INFO ][test-runner-#789%failure.IoomFailureHandlerTest%][IgnitePluginProcessor] [21:01:31] : [Step 4/5] [2021-11-19 21:01:31,962][INFO ][test-runner-#789%failure.IoomFailureHandlerTest%][IgnitePluginProcessor] ^-- PageMemory tracker plugin 1.0 [21:01:31] : [Step 4/5] [2021-11-19 21:01:31,963][INFO ][test-runner-#789%failure.IoomFailureHandlerTest%][IgnitePluginProcessor] ^-- null [21:01:31] : [Step 4/5] [2021-11-19 21:01:31,963][INFO ][test-runner-#789%failure.IoomFailureHandlerTest%][IgnitePluginProcessor] [21:01:31] : [Step 4/5] [2021-11-19 21:01:31,963][INFO ][test-runner-#789%failure.IoomFailureHandlerTest%][IgnitePluginProcessor] ^-- TestDistibutedConfigurationPlugin 1.0 [21:01:31] : [Step 4/5] [2021-11-19 21:01:31,963][INFO ][test-runner-#789%failure.IoomFailureHandlerTest%][IgnitePluginProcessor] ^-- null [21:01:31] : [Step 4/5] [2021-11-19 21:01:31,964][INFO ][test-runner-#789%failure.IoomFailureHandlerTest%][IgnitePluginProcessor] [21:01:31] : [Step 4/5] [2021-11-19 21:01:31,964][INFO ][test-runner-#789%failure.IoomFailureHandlerTest%][IgnitePluginProcessor] ^-- NodeValidationPluginProvider 1.0 [21:01:31] : [Step 4/5] [2021-11-19 21:01:31,964][INFO ][test-runner-#789%failure.IoomFailureHandlerTest%][IgnitePluginProcessor] ^-- null [21:01:31] : [Step 4/5] [2021-11-19 21:01:31,964][INFO ][test-runner-#789%failure.IoomFailureHandlerTest%][IgnitePluginProcessor] [21:01:31] : [Step 4/5] [2021-11-19 21:01:31,965][INFO ][test-runner-#789%failure.IoomFailureHandlerTest%][FailureProcessor] Configured failure handler: [hnd=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]] [21:01:32] : [Step 4/5] [2021-11-19 21:01:32,025][INFO ][test-runner-#789%failure.IoomFailureHandlerTest%][TcpCommunicationSpi] Successfully bound communication NIO server to TCP port [port=45011, locHost=/127.0.0.1, selectorsCnt=12, selectorSpins=0, pairedConn=false] [21:01:32]W: [org.apache.ignite:ignite-core] [2021-11-19 21:01:32,026][WARN ][test-runner-#789%failure.IoomFailureHandlerTest%][TcpCommunicationSpi] Message queue limit is set to 0 which may lead to potential OOMEs when running cache operations in FULL_ASYNC or PRIMARY_SYNC modes due to message queues growth on sender and receiver sides. [21:01:32] : [Step 4/5] [2021-11-19 21:01:32,045][INFO ][test-runner-#789%failure.IoomFailureHandlerTest%][GridCollisionManager] Collision resolution is disabled (all jobs will be activated upon arrival). [21:01:32] : [Step 4/5] [2021-11-19 21:01:32,046][INFO ][test-runner-#789%failure.IoomFailureHandlerTest%][IoomFailureHandlerTest1] Security status [authentication=off, sandbox=off, tls/ssl=off] [21:01:32] : [Step 4/5] [2021-11-19 21:01:32,047][INFO ][test-runner-#789%failure.IoomFailureHandlerTest%][TestTcpDiscoverySpi] Successfully bound to TCP port [port=47501, localHost=localhost/127.0.0.1, locNodeId=fe65148c-4d17-4fff-9236-05b24cf00001] [21:01:32]W: [org.apache.ignite:ignite-core] [2021-11-19 21:01:32,049][WARN ][test-runner-#789%failure.IoomFailureHandlerTest%][PdsFoldersResolver] Failed to acquire file lock. Will try again in 1s [nodeId=fe65148c-4d17-4fff-9236-05b24cf00001, holder=[9d5c1368-d764-4b5a-a895-4879ea800000][], path=/opt/buildagent/work/7bc1c54bc719b67c/work/db/node00-a571b31d-b6bc-4984-9a28-b3fa77ead9f4/lock] [21:01:33] : [Step 4/5] [2021-11-19 21:01:33,050][INFO ][test-runner-#789%failure.IoomFailureHandlerTest%][PdsFoldersResolver] Unable to acquire lock to file [/opt/buildagent/work/7bc1c54bc719b67c/work/db/node00-a571b31d-b6bc-4984-9a28-b3fa77ead9f4], reason: Failed to acquire file lock [holder=[9d5c1368-d764-4b5a-a895-4879ea800000][], time=1 sec, path=/opt/buildagent/work/7bc1c54bc719b67c/work/db/node00-a571b31d-b6bc-4984-9a28-b3fa77ead9f4/lock] [21:01:33] : [Step 4/5] [2021-11-19 21:01:33,053][INFO ][test-runner-#789%failure.IoomFailureHandlerTest%][PdsFoldersResolver] Successfully created new persistent storage folder [/opt/buildagent/work/7bc1c54bc719b67c/work/db/node01-bc754eaf-364f-41c4-9df3-ae5b24c02e12] [21:01:33] : [Step 4/5] [2021-11-19 21:01:33,054][INFO ][test-runner-#789%failure.IoomFailureHandlerTest%][PdsFoldersResolver] Consistent ID used for local node is [bc754eaf-364f-41c4-9df3-ae5b24c02e12] according to persistence data storage folders [21:01:33] : [Step 4/5] [2021-11-19 21:01:33,054][INFO ][test-runner-#789%failure.IoomFailureHandlerTest%][MaintenanceProcessor] Resolved store directory for node persistent data: /opt/buildagent/work/7bc1c54bc719b67c/work/db/node01-bc754eaf-364f-41c4-9df3-ae5b24c02e12 [21:01:33] : [Step 4/5] [2021-11-19 21:01:33,057][INFO ][test-runner-#789%failure.IoomFailureHandlerTest%][CacheObjectBinaryProcessorImpl] Resolved directory for serialized binary metadata: /opt/buildagent/work/7bc1c54bc719b67c/work/db/binary_meta/node01-bc754eaf-364f-41c4-9df3-ae5b24c02e12 [21:01:33] : [Step 4/5] [2021-11-19 21:01:33,070][INFO ][test-runner-#789%failure.IoomFailureHandlerTest%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/node01-bc754eaf-364f-41c4-9df3-ae5b24c02e12 [21:01:33] : [Step 4/5] [2021-11-19 21:01:33,070][INFO ][test-runner-#789%failure.IoomFailureHandlerTest%][FileWriteAheadLogManager] Resolved write ahead log work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/node01-bc754eaf-364f-41c4-9df3-ae5b24c02e12 [21:01:33] : [Step 4/5] [2021-11-19 21:01:33,071][INFO ][test-runner-#789%failure.IoomFailureHandlerTest%][FileWriteAheadLogManager] Resolved write ahead log archive directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/node01-bc754eaf-364f-41c4-9df3-ae5b24c02e12 [21:01:33] : [Step 4/5] [2021-11-19 21:01:33,446][INFO ][test-runner-#789%failure.IoomFailureHandlerTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/node01-bc754eaf-364f-41c4-9df3-ae5b24c02e12/0000000000000000.wal [21:01:33] : [Step 4/5] [2021-11-19 21:01:33,446][INFO ][test-runner-#789%failure.IoomFailureHandlerTest%][FileHandleManagerImpl] Initialized write-ahead log manager [mode=LOG_ONLY] [21:01:33] : [Step 4/5] [2021-11-19 21:01:33,455][INFO ][test-runner-#789%failure.IoomFailureHandlerTest%][GridCacheDatabaseSharedManager] Configured data regions initialized successfully [total=5] [21:01:33] : [Step 4/5] [2021-11-19 21:01:33,457][INFO ][test-runner-#789%failure.IoomFailureHandlerTest%][IgniteSnapshotManager] Resolved snapshot work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/snapshots [21:01:33] : [Step 4/5] [2021-11-19 21:01:33,457][INFO ][test-runner-#789%failure.IoomFailureHandlerTest%][IgniteSnapshotManager] Resolved temp directory for snapshot creation: /opt/buildagent/work/7bc1c54bc719b67c/work/db/node01-bc754eaf-364f-41c4-9df3-ae5b24c02e12/snp [21:01:33] : [Step 4/5] [2021-11-19 21:01:33,462][INFO ][test-runner-#789%failure.IoomFailureHandlerTest%][ClientListenerProcessor] Client connector processor has started on TCP port 10801 [21:01:33] : [Step 4/5] [2021-11-19 21:01:33,466][INFO ][test-runner-#789%failure.IoomFailureHandlerTest%][IoomFailureHandlerTest1] Non-loopback local IPs: 172.17.0.4 [21:01:33] : [Step 4/5] [2021-11-19 21:01:33,467][INFO ][test-runner-#789%failure.IoomFailureHandlerTest%][IoomFailureHandlerTest1] Enabled local MACs: 0242AC110004 [21:01:33] : [Step 4/5] [2021-11-19 21:01:33,468][INFO ][test-runner-#789%failure.IoomFailureHandlerTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:01:33] : [Step 4/5] [2021-11-19 21:01:33,472][INFO ][test-runner-#789%failure.IoomFailureHandlerTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=48096, tableSize=3.8 MiB, replacementSize=6.0 KiB, checkpointBuffer=100.0 MiB] [21:01:33] : [Step 4/5] [2021-11-19 21:01:33,472][INFO ][test-runner-#789%failure.IoomFailureHandlerTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:01:33] : [Step 4/5] [2021-11-19 21:01:33,475][INFO ][test-runner-#789%failure.IoomFailureHandlerTest%][GridCacheDatabaseSharedManager] Applying lost metastore updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:01:33] : [Step 4/5] [2021-11-19 21:01:33,480][INFO ][test-runner-#789%failure.IoomFailureHandlerTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=10 ms] [21:01:33] : [Step 4/5] [2021-11-19 21:01:33,480][INFO ][test-runner-#789%failure.IoomFailureHandlerTest%][GridCacheProcessor] Restoring partition state for local groups. [21:01:33] : [Step 4/5] [2021-11-19 21:01:33,481][INFO ][test-runner-#789%failure.IoomFailureHandlerTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=0, partitionsProcessed=0, time=0ms] [21:01:33] : [Step 4/5] [2021-11-19 21:01:33,482][INFO ][test-runner-#789%failure.IoomFailureHandlerTest%][GridEncryptionManager] Encryption keys loaded from metastore. [grps=, masterKeyName=null] [21:01:33] : [Step 4/5] [2021-11-19 21:01:33,486][INFO ][test-runner-#789%failure.IoomFailureHandlerTest%][ClusterProcessor] Cluster ID and tag has been read from metastorage: null [21:01:33] : [Step 4/5] [2021-11-19 21:01:33,486][INFO ][test-runner-#789%failure.IoomFailureHandlerTest%][IgniteClusterImpl] Shutdown policy was updated [oldVal=null, newVal=null] [21:01:33] : [Step 4/5] [2021-11-19 21:01:33,487][INFO ][test-runner-#789%failure.IoomFailureHandlerTest%][GridCacheDatabaseSharedManager] Checkpoint frequency deviation changed [oldVal=null, newVal=null] [21:01:33] : [Step 4/5] [2021-11-19 21:01:33,497][INFO ][test-runner-#789%failure.IoomFailureHandlerTest%][FilePageStoreManager] Cleanup cache stores [total=1, left=0, cleanFiles=false] [21:01:33] : [Step 4/5] [2021-11-19 21:01:33,503][INFO ][test-runner-#789%failure.IoomFailureHandlerTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=48096, tableSize=3.8 MiB, replacementSize=6.0 KiB, checkpointBuffer=100.0 MiB] [21:01:33] : [Step 4/5] [2021-11-19 21:01:33,504][INFO ][test-runner-#789%failure.IoomFailureHandlerTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=48096, tableSize=3.8 MiB, replacementSize=6.0 KiB, checkpointBuffer=100.0 MiB] [21:01:33] : [Step 4/5] [2021-11-19 21:01:33,509][INFO ][test-runner-#789%failure.IoomFailureHandlerTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=48096, tableSize=3.8 MiB, replacementSize=6.0 KiB, checkpointBuffer=100.0 MiB] [21:01:33] : [Step 4/5] [2021-11-19 21:01:33,509][INFO ][test-runner-#789%failure.IoomFailureHandlerTest%][GridCacheDatabaseSharedManager] Data Regions Started: 5 [21:01:33] : [Step 4/5] [2021-11-19 21:01:33,510][INFO ][test-runner-#789%failure.IoomFailureHandlerTest%][GridCacheDatabaseSharedManager] ^-- sysMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:01:33] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:01:33] : [Step 4/5] ^-- metastoreMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:01:33] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:01:33] : [Step 4/5] ^-- TxLog region [type=internal, persistence=true, lazyAlloc=false, [21:01:33] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:01:33] : [Step 4/5] ^-- dfltPlc region [type=default, persistence=true, lazyAlloc=true, [21:01:33] : [Step 4/5] ... initCfg=10MB, maxCfg=10MB, usedRam=0MB, freeRam=100%, allocRam=0MB, allocTotal=0MB] [21:01:33] : [Step 4/5] ^-- volatileDsMemPlc region [type=user, persistence=false, lazyAlloc=true, [21:01:33] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB] [21:01:33] : [Step 4/5] ^-- Ignite persistence [used=0MB] [21:01:33] : [Step 4/5] [21:01:33] : [Step 4/5] [2021-11-19 21:01:33,512][INFO ][test-runner-#789%failure.IoomFailureHandlerTest%][GridCacheDatabaseSharedManager] Starting binary memory restore for: [1544803905, -2100569601] [21:01:33] : [Step 4/5] [2021-11-19 21:01:33,644][INFO ][test-runner-#789%failure.IoomFailureHandlerTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:01:33] : [Step 4/5] [2021-11-19 21:01:33,645][INFO ][test-runner-#789%failure.IoomFailureHandlerTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:01:33] : [Step 4/5] [2021-11-19 21:01:33,665][INFO ][test-runner-#789%failure.IoomFailureHandlerTest%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/node01-bc754eaf-364f-41c4-9df3-ae5b24c02e12/0000000000000000.wal, offset=0, ver=2] [21:01:33] : [Step 4/5] [2021-11-19 21:01:33,668][INFO ][test-runner-#789%failure.IoomFailureHandlerTest%][PageMemoryImpl] Started page memory [memoryAllocated=24.0 MiB, pages=11544, tableSize=937.7 KiB, replacementSize=1.5 KiB, checkpointBuffer=10.0 MiB] [21:01:33] : [Step 4/5] [2021-11-19 21:01:33,678][INFO ][test-runner-#789%failure.IoomFailureHandlerTest%][GridCacheProcessor] Started cache in recovery mode [name=default, id=1544803905, dataRegionName=dfltPlc, mode=PARTITIONED, atomicity=TRANSACTIONAL, backups=0, mvcc=false] [21:01:33] : [Step 4/5] [2021-11-19 21:01:33,690][INFO ][test-runner-#789%failure.IoomFailureHandlerTest%][GridCacheProcessor] Started cache in recovery mode [name=ignite-sys-cache, id=-2100569601, dataRegionName=sysMemPlc, mode=REPLICATED, atomicity=TRANSACTIONAL, backups=2147483647, mvcc=false] [21:01:33] : [Step 4/5] [2021-11-19 21:01:33,693][INFO ][test-runner-#789%failure.IoomFailureHandlerTest%][GridCacheDatabaseSharedManager] Binary recovery performed in 181 ms. [21:01:33] : [Step 4/5] [2021-11-19 21:01:33,693][INFO ][test-runner-#789%failure.IoomFailureHandlerTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:01:33] : [Step 4/5] [2021-11-19 21:01:33,694][INFO ][test-runner-#789%failure.IoomFailureHandlerTest%][GridCacheDatabaseSharedManager] Applying lost cache updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:01:33] : [Step 4/5] [2021-11-19 21:01:33,784][INFO ][test-runner-#789%failure.IoomFailureHandlerTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=91 ms] [21:01:33] : [Step 4/5] [2021-11-19 21:01:33,784][INFO ][test-runner-#789%failure.IoomFailureHandlerTest%][GridCacheProcessor] Restoring partition state for local groups. [21:01:33] : [Step 4/5] [2021-11-19 21:01:33,844][INFO ][test-runner-#789%failure.IoomFailureHandlerTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=2, partitionsProcessed=1124, time=60ms] [21:01:34] : [Step 4/5] [2021-11-19 21:01:34,048][INFO ][tcp-disco-srvr-[:47500]-#46%failure.IoomFailureHandlerTest0%-#904%failure.IoomFailureHandlerTest0%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=47979] [21:01:34] : [Step 4/5] [2021-11-19 21:01:34,049][INFO ][tcp-disco-srvr-[:47500]-#46%failure.IoomFailureHandlerTest0%-#904%failure.IoomFailureHandlerTest0%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=47979] [21:01:34] : [Step 4/5] [2021-11-19 21:01:34,050][INFO ][tcp-disco-sock-reader-[]-#52%failure.IoomFailureHandlerTest0%-#1025%failure.IoomFailureHandlerTest0%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:47979, rmtPort=47979] [21:01:34] : [Step 4/5] [2021-11-19 21:01:34,053][INFO ][tcp-disco-sock-reader-[fe65148c 127.0.0.1:47979]-#52%failure.IoomFailureHandlerTest0%-#1025%failure.IoomFailureHandlerTest0%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=fe65148c-4d17-4fff-9236-05b24cf00001, rmtAddr=/127.0.0.1:47979] [21:01:34] : [Step 4/5] [2021-11-19 21:01:34,062][INFO ][tcp-disco-srvr-[:47501]-#51%failure.IoomFailureHandlerTest1%-#1024%failure.IoomFailureHandlerTest1%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=37239] [21:01:34] : [Step 4/5] [2021-11-19 21:01:34,062][INFO ][tcp-disco-srvr-[:47501]-#51%failure.IoomFailureHandlerTest1%-#1024%failure.IoomFailureHandlerTest1%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=37239] [21:01:34] : [Step 4/5] [2021-11-19 21:01:34,064][INFO ][tcp-disco-sock-reader-[]-#53%failure.IoomFailureHandlerTest1%-#1026%failure.IoomFailureHandlerTest1%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:37239, rmtPort=37239] [21:01:34] : [Step 4/5] [2021-11-19 21:01:34,065][INFO ][tcp-disco-sock-reader-[]-#53%failure.IoomFailureHandlerTest1%-#1026%failure.IoomFailureHandlerTest1%][TestTcpDiscoverySpi] Received ping request from the remote node [rmtNodeId=9d5c1368-d764-4b5a-a895-4879ea800000, rmtAddr=/127.0.0.1:37239, rmtPort=37239] [21:01:34] : [Step 4/5] [2021-11-19 21:01:34,067][INFO ][tcp-disco-sock-reader-[]-#53%failure.IoomFailureHandlerTest1%-#1026%failure.IoomFailureHandlerTest1%][TestTcpDiscoverySpi] Finished writing ping response [rmtNodeId=9d5c1368-d764-4b5a-a895-4879ea800000, rmtAddr=/127.0.0.1:37239, rmtPort=37239] [21:01:34] : [Step 4/5] [2021-11-19 21:01:34,070][INFO ][tcp-disco-sock-reader-[]-#53%failure.IoomFailureHandlerTest1%-#1026%failure.IoomFailureHandlerTest1%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:37239, rmtPort=37239, rmtNodeId=null] [21:01:34]W: [org.apache.ignite:ignite-core] [2021-11-19 21:01:34,067][WARN ][tcp-disco-sock-reader-[]-#53%failure.IoomFailureHandlerTest1%-#1026%failure.IoomFailureHandlerTest1%][TestTcpDiscoverySpi] Failed to shutdown socket [21:01:34]W: [org.apache.ignite:ignite-core] java.net.SocketException: Socket output is already shutdown [21:01:34]W: [org.apache.ignite:ignite-core] at java.net.Socket.shutdownOutput(Socket.java:1572) [21:01:34]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.close(IgniteUtils.java:4247) [21:01:34]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.discovery.tcp.ServerImpl$SocketReader.body(ServerImpl.java:7370) [21:01:34]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.IgniteSpiThread.run(IgniteSpiThread.java:58) [21:01:34] : [Step 4/5] [2021-11-19 21:01:34,067][INFO ][tcp-disco-sock-reader-[fe65148c 127.0.0.1:47979]-#52%failure.IoomFailureHandlerTest0%-#1025%failure.IoomFailureHandlerTest0%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:47979, rmtPort=47979, rmtNodeId=fe65148c-4d17-4fff-9236-05b24cf00001] [21:01:34] : [Step 4/5] [2021-11-19 21:01:34,078][INFO ][tcp-disco-msg-worker-[crd]-#45%failure.IoomFailureHandlerTest0%-#903%failure.IoomFailureHandlerTest0%][GridEncryptionManager] Joining node doesn't have stored group keys [node=fe65148c-4d17-4fff-9236-05b24cf00001] [21:01:34] : [Step 4/5] [2021-11-19 21:01:34,098][INFO ][tcp-disco-msg-worker-[crd]-#45%failure.IoomFailureHandlerTest0%-#903%failure.IoomFailureHandlerTest0%][TestTcpDiscoverySpi] New next node [newNext=TcpDiscoveryNode [id=fe65148c-4d17-4fff-9236-05b24cf00001, consistentId=bc754eaf-364f-41c4-9df3-ae5b24c02e12, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=0, intOrder=2, lastExchangeTime=1637344894059, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false]] [21:01:34] : [Step 4/5] [2021-11-19 21:01:34,101][INFO ][tcp-disco-srvr-[:47501]-#51%failure.IoomFailureHandlerTest1%-#1024%failure.IoomFailureHandlerTest1%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=34285] [21:01:34] : [Step 4/5] [2021-11-19 21:01:34,102][INFO ][tcp-disco-srvr-[:47501]-#51%failure.IoomFailureHandlerTest1%-#1024%failure.IoomFailureHandlerTest1%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=34285] [21:01:34] : [Step 4/5] [2021-11-19 21:01:34,104][INFO ][tcp-disco-sock-reader-[]-#54%failure.IoomFailureHandlerTest1%-#1027%failure.IoomFailureHandlerTest1%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:34285, rmtPort=34285] [21:01:34] : [Step 4/5] [2021-11-19 21:01:34,107][INFO ][tcp-disco-sock-reader-[9d5c1368 127.0.0.1:34285]-#54%failure.IoomFailureHandlerTest1%-#1027%failure.IoomFailureHandlerTest1%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=9d5c1368-d764-4b5a-a895-4879ea800000, rmtAddr=/127.0.0.1:34285] [21:01:34] : [Step 4/5] [2021-11-19 21:01:34,114][INFO ][tcp-disco-msg-worker-[]-#50%failure.IoomFailureHandlerTest1%-#1023%failure.IoomFailureHandlerTest1%][TestTcpDiscoverySpi] New next node [newNext=TcpDiscoveryNode [id=9d5c1368-d764-4b5a-a895-4879ea800000, consistentId=a571b31d-b6bc-4984-9a28-b3fa77ead9f4, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637344894104, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false]] [21:01:34] : [Step 4/5] [2021-11-19 21:01:34,116][INFO ][tcp-disco-srvr-[:47500]-#46%failure.IoomFailureHandlerTest0%-#904%failure.IoomFailureHandlerTest0%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=51557] [21:01:34] : [Step 4/5] [2021-11-19 21:01:34,116][INFO ][tcp-disco-srvr-[:47500]-#46%failure.IoomFailureHandlerTest0%-#904%failure.IoomFailureHandlerTest0%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=51557] [21:01:34] : [Step 4/5] [2021-11-19 21:01:34,121][INFO ][tcp-disco-sock-reader-[]-#55%failure.IoomFailureHandlerTest0%-#1028%failure.IoomFailureHandlerTest0%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:51557, rmtPort=51557] [21:01:34] : [Step 4/5] [2021-11-19 21:01:34,124][INFO ][tcp-disco-sock-reader-[fe65148c 127.0.0.1:51557]-#55%failure.IoomFailureHandlerTest0%-#1028%failure.IoomFailureHandlerTest0%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=fe65148c-4d17-4fff-9236-05b24cf00001, rmtAddr=/127.0.0.1:51557] [21:01:34] : [Step 4/5] [2021-11-19 21:01:34,131][INFO ][disco-event-worker-#906%failure.IoomFailureHandlerTest0%][GridDiscoveryManager] Added new node to topology: TcpDiscoveryNode [id=fe65148c-4d17-4fff-9236-05b24cf00001, consistentId=bc754eaf-364f-41c4-9df3-ae5b24c02e12, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637344894059, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false] [21:01:34] : [Step 4/5] [2021-11-19 21:01:34,135][INFO ][disco-event-worker-#906%failure.IoomFailureHandlerTest0%][GridDiscoveryManager] Topology snapshot [ver=2, locNode=9d5c1368, servers=2, clients=0, state=INACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=9d5c1368-d764-4b5a-a895-4879ea800000, consistentId=a571b31d-b6bc-4984-9a28-b3fa77ead9f4, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=fe65148c-4d17-4fff-9236-05b24cf00001, consistentId=bc754eaf-364f-41c4-9df3-ae5b24c02e12, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:01:34] : [Step 4/5] [2021-11-19 21:01:34,147][INFO ][tcp-disco-msg-worker-[9d5c1368 127.0.0.1:47500]-#50%failure.IoomFailureHandlerTest1%-#1023%failure.IoomFailureHandlerTest1%][ClusterProcessor] objective_knuth [21:01:34] : [Step 4/5] [2021-11-19 21:01:34,148][INFO ][tcp-disco-msg-worker-[9d5c1368 127.0.0.1:47500]-#50%failure.IoomFailureHandlerTest1%-#1023%failure.IoomFailureHandlerTest1%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustEnabled' was changed from 'null' to 'false' [21:01:34] : [Step 4/5] [2021-11-19 21:01:34,149][INFO ][tcp-disco-msg-worker-[9d5c1368 127.0.0.1:47500]-#50%failure.IoomFailureHandlerTest1%-#1023%failure.IoomFailureHandlerTest1%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustTimeout' was changed from 'null' to '300000' [21:01:34] : [Step 4/5] [2021-11-19 21:01:34,150][INFO ][tcp-disco-msg-worker-[9d5c1368 127.0.0.1:47500]-#50%failure.IoomFailureHandlerTest1%-#1023%failure.IoomFailureHandlerTest1%][IgniteTxManager] Transactions parameter 'longOperationsDumpTimeout' was changed from 'null' to '60000' [21:01:34] : [Step 4/5] [2021-11-19 21:01:34,150][INFO ][tcp-disco-msg-worker-[9d5c1368 127.0.0.1:47500]-#50%failure.IoomFailureHandlerTest1%-#1023%failure.IoomFailureHandlerTest1%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpThreshold' was changed from 'null' to '0' [21:01:34] : [Step 4/5] [2021-11-19 21:01:34,151][INFO ][tcp-disco-msg-worker-[9d5c1368 127.0.0.1:47500]-#50%failure.IoomFailureHandlerTest1%-#1023%failure.IoomFailureHandlerTest1%][IgniteTxManager] Transactions parameter 'transactionTimeDumpSamplesCoefficient' was changed from 'null' to '0.0' [21:01:34] : [Step 4/5] [2021-11-19 21:01:34,155][INFO ][tcp-disco-msg-worker-[9d5c1368 127.0.0.1:47500]-#50%failure.IoomFailureHandlerTest1%-#1023%failure.IoomFailureHandlerTest1%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpSamplesPerSecondLimit' was changed from 'null' to '5' [21:01:34] : [Step 4/5] [2021-11-19 21:01:34,156][INFO ][tcp-disco-msg-worker-[9d5c1368 127.0.0.1:47500]-#50%failure.IoomFailureHandlerTest1%-#1023%failure.IoomFailureHandlerTest1%][IgniteTxManager] Transactions parameter 'collisionsDumpInterval' was changed from 'null' to '1000' [21:01:34] : [Step 4/5] [2021-11-19 21:01:34,157][INFO ][tcp-disco-msg-worker-[9d5c1368 127.0.0.1:47500]-#50%failure.IoomFailureHandlerTest1%-#1023%failure.IoomFailureHandlerTest1%][IgniteTxManager] Transactions parameter 'txOwnerDumpRequestsAllowed' was changed from 'null' to 'true' [21:01:34] : [Step 4/5] [2021-11-19 21:01:34,158][INFO ][tcp-disco-msg-worker-[9d5c1368 127.0.0.1:47500]-#50%failure.IoomFailureHandlerTest1%-#1023%failure.IoomFailureHandlerTest1%][GridCacheDatabaseSharedManager] Historical rebalance WAL threshold changed [property=historical.rebalance.threshold, oldVal=null, newVal=500] [21:01:34] : [Step 4/5] [2021-11-19 21:01:34,161][INFO ][disco-notifier-worker-#1022%failure.IoomFailureHandlerTest1%][MvccProcessorImpl] Assigned mvcc coordinator [crd=MvccCoordinator [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=0], nodeId=9d5c1368-d764-4b5a-a895-4879ea800000, ver=1637344891737, local=false, initialized=false]] [21:01:34] : [Step 4/5] [2021-11-19 21:01:34,163][INFO ][sys-#1008%failure.IoomFailureHandlerTest1%][ClusterProcessor] Writing cluster ID and tag to metastorage on ready for write ClusterIdAndTag [id=895f05ab-6f96-4de8-9bc9-1aeb8fe38c93, tag=objective_knuth] [21:01:34] : [Step 4/5] [2021-11-19 21:01:34,231][INFO ][test-runner-#789%failure.IoomFailureHandlerTest%][IoomFailureHandlerTest1] To start Console Management & Monitoring run ignitevisorcmd.{sh|bat} [21:01:34] : [Step 4/5] [2021-11-19 21:01:34,232][INFO ][test-runner-#789%failure.IoomFailureHandlerTest%][IoomFailureHandlerTest1] [21:01:34] : [Step 4/5] [21:01:34] : [Step 4/5] >>> +-------------------------------------------+ [21:01:34] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:01:34] : [Step 4/5] >>> +-------------------------------------------+ [21:01:34] : [Step 4/5] >>> OS name: Linux 4.15.0-151-generic amd64 [21:01:34] : [Step 4/5] >>> CPU(s): 24 [21:01:34] : [Step 4/5] >>> Heap: 2.0GB [21:01:34] : [Step 4/5] >>> VM name: 16724@c4dfe9a430b2 [21:01:34] : [Step 4/5] >>> Ignite instance name: failure.IoomFailureHandlerTest1 [21:01:34] : [Step 4/5] >>> Local node [ID=FE65148C-4D17-4FFF-9236-05B24CF00001, order=2, clientMode=false] [21:01:34] : [Step 4/5] >>> Local node addresses: [127.0.0.1] [21:01:34] : [Step 4/5] >>> Local ports: TCP:10801 TCP:45011 TCP:47501 [21:01:34] : [Step 4/5] [21:01:34] : [Step 4/5] [2021-11-19 21:01:34,233][INFO ][test-runner-#789%failure.IoomFailureHandlerTest%][IoomFailureHandlerTest1] >>> Ignite cluster is in INACTIVE state (limited functionality available). Use control.(sh|bat) script or IgniteCluster.state(ClusterState.ACTIVE) to change the state. [21:01:34] : [Step 4/5] [2021-11-19 21:01:34,234][INFO ][test-runner-#789%failure.IoomFailureHandlerTest%][GridDiscoveryManager] Topology snapshot [ver=2, locNode=fe65148c, servers=2, clients=0, state=INACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=9d5c1368-d764-4b5a-a895-4879ea800000, consistentId=a571b31d-b6bc-4984-9a28-b3fa77ead9f4, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=fe65148c-4d17-4fff-9236-05b24cf00001, consistentId=bc754eaf-364f-41c4-9df3-ae5b24c02e12, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:01:34] : [Step 4/5] [2021-11-19 21:01:34,241][INFO ][test-runner-#789%failure.IoomFailureHandlerTest%][G] Node started : [stage="Configure system pool" (0 ms),stage="Start managers" (1147 ms),stage="Configure binary metadata" (8 ms),stage="Start processors" (400 ms),stage="Start 'StanByClusterTestProvider' plugin" (0 ms),stage="Start 'PageMemory tracker plugin' plugin" (0 ms),stage="Start 'TestDistibutedConfigurationPlugin' plugin" (0 ms),stage="Start 'NodeValidationPluginProvider' plugin" (0 ms),stage="Init metastore" (31 ms),stage="Init and start regions" (14 ms),stage="Restore binary memory" (181 ms),stage="Restore logical state" (151 ms),stage="Finish recovery" (198 ms),stage="Join topology" (117 ms),stage="Await transition" (5 ms),stage="Await exchange" (75 ms),stage="Total time" (2327 ms)] [21:01:34] : [Step 4/5] [2021-11-19 21:01:34,243][INFO ][test-runner-#789%failure.IoomFailureHandlerTest%][root] Node started with the following configuration [id=fe65148c-4d17-4fff-9236-05b24cf00001, marshaller=BinaryMarshaller [], discovery=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=5000, ackTimeout=5000, marsh=JdkMarshaller [clsFilter=org.apache.ignite.marshaller.MarshallerUtils$1@67560978], reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], binaryCfg=null, lateAff=true] [21:01:34] : [Step 4/5] [2021-11-19 21:01:34,247][INFO ][test-runner-#789%failure.IoomFailureHandlerTest%][GridClusterStateProcessor] Sending activate cluster request with BaselineTopology BaselineTopology [id=0, branchingHash=823730105, branchingType='New BaselineTopology', baselineNodes=[a571b31d-b6bc-4984-9a28-b3fa77ead9f4, bc754eaf-364f-41c4-9df3-ae5b24c02e12]] [21:01:34] : [Step 4/5] [2021-11-19 21:01:34,255][INFO ][disco-notifier-worker-#902%failure.IoomFailureHandlerTest0%][GridClusterStateProcessor] Received activate cluster request with BaselineTopology[id=0] initiator node ID: 9d5c1368-d764-4b5a-a895-4879ea800000 [21:01:34] : [Step 4/5] [2021-11-19 21:01:34,256][INFO ][disco-notifier-worker-#902%failure.IoomFailureHandlerTest0%][GridClusterStateProcessor] Started state transition: activate cluster [21:01:34] : [Step 4/5] [2021-11-19 21:01:34,258][INFO ][disco-notifier-worker-#1022%failure.IoomFailureHandlerTest1%][GridClusterStateProcessor] Received activate cluster request with BaselineTopology[id=0] initiator node ID: 9d5c1368-d764-4b5a-a895-4879ea800000 [21:01:34] : [Step 4/5] [2021-11-19 21:01:34,259][INFO ][disco-notifier-worker-#1022%failure.IoomFailureHandlerTest1%][GridClusterStateProcessor] Started state transition: activate cluster [21:01:34] : [Step 4/5] [2021-11-19 21:01:34,262][INFO ][exchange-worker-#1031%failure.IoomFailureHandlerTest1%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], crd=false, evt=DISCOVERY_CUSTOM_EVT, evtNode=9d5c1368-d764-4b5a-a895-4879ea800000, customEvt=ChangeGlobalStateMessage [id=c925c593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqId=aff1195f-5489-45e8-9f4b-853ca93894a5, initiatingNodeId=9d5c1368-d764-4b5a-a895-4879ea800000, state=ACTIVE, baselineTopology=BaselineTopology [id=0, branchingHash=823730105, branchingType='New BaselineTopology', baselineNodes=[a571b31d-b6bc-4984-9a28-b3fa77ead9f4, bc754eaf-364f-41c4-9df3-ae5b24c02e12]], forceChangeBaselineTopology=false, timestamp=1637344894246, forceDeactivation=true], allowMerge=false, exchangeFreeSwitch=false] [21:01:34] : [Step 4/5] [2021-11-19 21:01:34,264][INFO ][exchange-worker-#1031%failure.IoomFailureHandlerTest1%][GridDhtPartitionsExchangeFuture] Start activation process [nodeId=fe65148c-4d17-4fff-9236-05b24cf00001, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]]. New state: ACTIVE [21:01:34] : [Step 4/5] [2021-11-19 21:01:34,265][INFO ][exchange-worker-#1031%failure.IoomFailureHandlerTest1%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/node01-bc754eaf-364f-41c4-9df3-ae5b24c02e12 [21:01:34] : [Step 4/5] [2021-11-19 21:01:34,270][INFO ][exchange-worker-#907%failure.IoomFailureHandlerTest0%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], crd=true, evt=DISCOVERY_CUSTOM_EVT, evtNode=9d5c1368-d764-4b5a-a895-4879ea800000, customEvt=ChangeGlobalStateMessage [id=c925c593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqId=aff1195f-5489-45e8-9f4b-853ca93894a5, initiatingNodeId=9d5c1368-d764-4b5a-a895-4879ea800000, state=ACTIVE, baselineTopology=BaselineTopology [id=0, branchingHash=823730105, branchingType='New BaselineTopology', baselineNodes=[a571b31d-b6bc-4984-9a28-b3fa77ead9f4, bc754eaf-364f-41c4-9df3-ae5b24c02e12]], forceChangeBaselineTopology=false, timestamp=1637344894246, forceDeactivation=true], allowMerge=false, exchangeFreeSwitch=false] [21:01:34] : [Step 4/5] [2021-11-19 21:01:34,272][INFO ][exchange-worker-#907%failure.IoomFailureHandlerTest0%][GridDhtPartitionsExchangeFuture] Start activation process [nodeId=9d5c1368-d764-4b5a-a895-4879ea800000, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]]. New state: ACTIVE [21:01:34] : [Step 4/5] [2021-11-19 21:01:34,273][INFO ][exchange-worker-#907%failure.IoomFailureHandlerTest0%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/node00-a571b31d-b6bc-4984-9a28-b3fa77ead9f4 [21:01:34] : [Step 4/5] [2021-11-19 21:01:34,281][INFO ][exchange-worker-#1031%failure.IoomFailureHandlerTest1%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/node01-bc754eaf-364f-41c4-9df3-ae5b24c02e12/0000000000000000.wal, offset=7042, ver=2] [21:01:34] : [Step 4/5] [2021-11-19 21:01:34,297][INFO ][exchange-worker-#907%failure.IoomFailureHandlerTest0%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/node00-a571b31d-b6bc-4984-9a28-b3fa77ead9f4/0000000000000000.wal, offset=7042, ver=2] [21:01:34] : [Step 4/5] [2021-11-19 21:01:34,297][INFO ][exchange-worker-#1031%failure.IoomFailureHandlerTest1%][GridClusterStateProcessor] Writing BaselineTopology[id=0] [21:01:34] : [Step 4/5] [2021-11-19 21:01:34,303][INFO ][exchange-worker-#907%failure.IoomFailureHandlerTest0%][GridClusterStateProcessor] Writing BaselineTopology[id=0] [21:01:34] : [Step 4/5] [2021-11-19 21:01:34,312][INFO ][exchange-worker-#907%failure.IoomFailureHandlerTest0%][GridCacheDatabaseSharedManager] Finish recovery performed in 34 ms. [21:01:34] : [Step 4/5] [2021-11-19 21:01:34,316][INFO ][exchange-worker-#907%failure.IoomFailureHandlerTest0%][msg] Components activation performed in 44 ms. [21:01:34] : [Step 4/5] [2021-11-19 21:01:34,323][INFO ][exchange-worker-#1031%failure.IoomFailureHandlerTest1%][GridCacheDatabaseSharedManager] Finish recovery performed in 57 ms. [21:01:34] : [Step 4/5] [2021-11-19 21:01:34,324][INFO ][exchange-worker-#1031%failure.IoomFailureHandlerTest1%][msg] Components activation performed in 59 ms. [21:01:34] : [Step 4/5] [2021-11-19 21:01:34,325][INFO ][exchange-worker-#907%failure.IoomFailureHandlerTest0%][GridCacheProcessor] Finished recovery for cache [cache=ignite-sys-cache, grp=ignite-sys-cache, startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:01:34] : [Step 4/5] [2021-11-19 21:01:34,325][INFO ][sys-#888%failure.IoomFailureHandlerTest0%][GridCacheProcessor] Finished recovery for cache [cache=default, grp=default, startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:01:34] : [Step 4/5] [2021-11-19 21:01:34,339][INFO ][exchange-worker-#1031%failure.IoomFailureHandlerTest1%][GridCacheProcessor] Finished recovery for cache [cache=default, grp=default, startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:01:34] : [Step 4/5] [2021-11-19 21:01:34,341][INFO ][exchange-worker-#1031%failure.IoomFailureHandlerTest1%][GridCacheProcessor] Finished recovery for cache [cache=ignite-sys-cache, grp=ignite-sys-cache, startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:01:34] : [Step 4/5] [2021-11-19 21:01:34,363][INFO ][exchange-worker-#1031%failure.IoomFailureHandlerTest1%][GridDhtPartitionsExchangeFuture] Successfully activated caches [nodeId=fe65148c-4d17-4fff-9236-05b24cf00001, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], newState=ACTIVE] [21:01:34] : [Step 4/5] [2021-11-19 21:01:34,363][INFO ][exchange-worker-#907%failure.IoomFailureHandlerTest0%][GridDhtPartitionsExchangeFuture] Successfully activated caches [nodeId=9d5c1368-d764-4b5a-a895-4879ea800000, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], newState=ACTIVE] [21:01:34] : [Step 4/5] [2021-11-19 21:01:34,367][INFO ][exchange-worker-#907%failure.IoomFailureHandlerTest0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:01:34] : [Step 4/5] [2021-11-19 21:01:34,377][INFO ][exchange-worker-#1031%failure.IoomFailureHandlerTest1%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:01:34] : [Step 4/5] [2021-11-19 21:01:34,486][INFO ][grid-nio-worker-tcp-comm-0-#844%TcpCommunicationSpi%][TcpCommunicationSpi] Accepted incoming communication connection [locAddr=/127.0.0.1:45010, rmtAddr=/127.0.0.1:39184] [21:01:34] : [Step 4/5] [2021-11-19 21:01:34,490][INFO ][grid-nio-worker-tcp-comm-0-#964%TcpCommunicationSpi%][TcpCommunicationSpi] Established outgoing communication connection [locAddr=/127.0.0.1:39184, rmtAddr=/127.0.0.1:45010] [21:01:34] : [Step 4/5] [2021-11-19 21:01:34,491][INFO ][exchange-worker-#1031%failure.IoomFailureHandlerTest1%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], crd=false] [21:01:34] : [Step 4/5] [2021-11-19 21:01:34,494][INFO ][exchange-worker-#907%failure.IoomFailureHandlerTest0%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], crd=true] [21:01:34] : [Step 4/5] [2021-11-19 21:01:34,496][INFO ][sys-#886%failure.IoomFailureHandlerTest0%][GridDhtPartitionsExchangeFuture] Coordinator received single message [ver=AffinityTopologyVersion [topVer=2, minorTopVer=1], node=fe65148c-4d17-4fff-9236-05b24cf00001, allReceived=true] [21:01:34] : [Step 4/5] [2021-11-19 21:01:34,497][INFO ][sys-#886%failure.IoomFailureHandlerTest0%][GridDhtPartitionsExchangeFuture] finishExchangeOnCoordinator [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:01:34] : [Step 4/5] [2021-11-19 21:01:34,550][INFO ][sys-#886%failure.IoomFailureHandlerTest0%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], err=null, rebalanced=true, wasRebalanced=false] [21:01:34] : [Step 4/5] [2021-11-19 21:01:34,550][INFO ][disco-notifier-worker-#902%failure.IoomFailureHandlerTest0%][GridClusterStateProcessor] Received state change finish message: ACTIVE [21:01:34] : [Step 4/5] [2021-11-19 21:01:34,554][INFO ][disco-notifier-worker-#1022%failure.IoomFailureHandlerTest1%][GridClusterStateProcessor] Received state change finish message: ACTIVE [21:01:34] : [Step 4/5] [2021-11-19 21:01:34,557][INFO ][disco-notifier-worker-#1022%failure.IoomFailureHandlerTest1%][GridClusterStateProcessor] Cluster state was changed from INACTIVE to ACTIVE [21:01:34] : [Step 4/5] [2021-11-19 21:01:34,556][INFO ][disco-notifier-worker-#902%failure.IoomFailureHandlerTest0%][GridClusterStateProcessor] Cluster state was changed from INACTIVE to ACTIVE [21:01:34] : [Step 4/5] [2021-11-19 21:01:34,558][INFO ][sys-#1007%failure.IoomFailureHandlerTest1%][GridDhtPartitionsExchangeFuture] Received full message, will finish exchange [node=9d5c1368-d764-4b5a-a895-4879ea800000, resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:01:34] : [Step 4/5] [2021-11-19 21:01:34,566][INFO ][sys-#1018%failure.IoomFailureHandlerTest1%][GridCachePartitionExchangeManager] Delay process full message without exchange id (there is exchange in progress) [nodeId=9d5c1368-d764-4b5a-a895-4879ea800000] [21:01:34] : [Step 4/5] [2021-11-19 21:01:34,573][INFO ][sys-#886%failure.IoomFailureHandlerTest0%][GridCacheProcessor] Finish proxy initialization, cacheName=default, localNodeId=9d5c1368-d764-4b5a-a895-4879ea800000 [21:01:34] : [Step 4/5] [2021-11-19 21:01:34,574][INFO ][sys-#886%failure.IoomFailureHandlerTest0%][GridCacheProcessor] Finish proxy initialization, cacheName=ignite-sys-cache, localNodeId=9d5c1368-d764-4b5a-a895-4879ea800000 [21:01:34] : [Step 4/5] [2021-11-19 21:01:34,574][INFO ][sys-#1007%failure.IoomFailureHandlerTest1%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], err=null, rebalanced=true, wasRebalanced=false] [21:01:34] : [Step 4/5] [2021-11-19 21:01:34,576][INFO ][sys-#885%failure.IoomFailureHandlerTest0%][DistributedBaselineConfiguration] Baseline auto-adjust is 'disabled' with timeout='300000' ms [21:01:34] : [Step 4/5] [2021-11-19 21:01:34,576][INFO ][exchange-worker-#907%failure.IoomFailureHandlerTest0%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=2, minorTopVer=1], force=false, evt=DISCOVERY_CUSTOM_EVT, node=9d5c1368-d764-4b5a-a895-4879ea800000] [21:01:34] : [Step 4/5] [2021-11-19 21:01:34,580][INFO ][sys-#886%failure.IoomFailureHandlerTest0%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=9d5c1368-d764-4b5a-a895-4879ea800000, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=9d5c1368-d764-4b5a-a895-4879ea800000, consistentId=a571b31d-b6bc-4984-9a28-b3fa77ead9f4, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637344894553, loc=true, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:01:34] : [Step 4/5] [2021-11-19 21:01:34,576][INFO ][sys-#885%failure.IoomFailureHandlerTest0%][GridClusterStateProcessor] Successfully performed final activation steps [nodeId=9d5c1368-d764-4b5a-a895-4879ea800000, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:01:34] : [Step 4/5] [2021-11-19 21:01:34,581][INFO ][sys-#886%failure.IoomFailureHandlerTest0%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], stage="Waiting in exchange queue" (5 ms), stage="Exchange parameters initialization" (4 ms), stage="Update caches registry" (48 ms), stage="Start caches" (20 ms), stage="Affinity initialization on cache group start" (22 ms), stage="Determine exchange type" (3 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Restore partition states" (0 ms), stage="After states restored callback" (124 ms), stage="WAL history reservation" (0 ms), stage="Waiting for all single messages" (2 ms), stage="Affinity recalculation (crd)" (0 ms), stage="Collect update counters and create affinity messages" (0 ms), stage="Assign partitions states" (4 ms), stage="Validate partitions states" (0 ms), stage="Ideal affinity diff calculation (enforced)" (19 ms), stage="Apply update counters" (4 ms), stage="Full message preparing" (16 ms), stage="Full message sending" (1 ms), stage="State finish message sending" (3 ms), stage="Detect lost partitions" (20 ms), stage="Exchange done" (10 ms), stage="Total time" (305 ms)] [21:01:34] : [Step 4/5] [2021-11-19 21:01:34,584][INFO ][sys-#1007%failure.IoomFailureHandlerTest1%][GridCacheProcessor] Finish proxy initialization, cacheName=default, localNodeId=fe65148c-4d17-4fff-9236-05b24cf00001 [21:01:34] : [Step 4/5] [2021-11-19 21:01:34,585][INFO ][sys-#886%failure.IoomFailureHandlerTest0%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], stage="Affinity initialization on cache group start [grp=default]" (5 ms) (parent=Affinity initialization on cache group start), stage="Affinity initialization on cache group start [grp=ignite-sys-cache]" (0 ms) (parent=Affinity initialization on cache group start), stage="Affinity centralized initialization (crd) [grp=ignite-sys-cache, crd=true]" (1 ms) (parent=Determine exchange type), stage="Affinity centralized initialization (crd) [grp=default, crd=true]" (1 ms) (parent=Determine exchange type), stage="Restore partition states [grp=ignite-sys-cache]" (0 ms) (parent=Restore partition states), stage="Restore partition states [grp=default]" (0 ms) (parent=Restore partition states), stage="Affinity recalculation (partitions availability) [grp=ignite-sys-cache]" (11 ms) (parent=Ideal affinity diff calculation (enforced)), stage="Affinity recalculation (partitions availability) [grp=default]" (8 ms) (parent=Ideal affinity diff calculation (enforced))] [21:01:34] : [Step 4/5] [2021-11-19 21:01:34,585][INFO ][sys-#1007%failure.IoomFailureHandlerTest1%][GridCacheProcessor] Finish proxy initialization, cacheName=ignite-sys-cache, localNodeId=fe65148c-4d17-4fff-9236-05b24cf00001 [21:01:34] : [Step 4/5] [2021-11-19 21:01:34,593][INFO ][sys-#1021%failure.IoomFailureHandlerTest1%][DistributedBaselineConfiguration] Baseline auto-adjust is 'disabled' with timeout='300000' ms [21:01:34] : [Step 4/5] [2021-11-19 21:01:34,593][INFO ][sys-#1021%failure.IoomFailureHandlerTest1%][GridClusterStateProcessor] Successfully performed final activation steps [nodeId=fe65148c-4d17-4fff-9236-05b24cf00001, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:01:34] : [Step 4/5] [2021-11-19 21:01:34,599][INFO ][exchange-worker-#1031%failure.IoomFailureHandlerTest1%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=2, minorTopVer=1], force=false, evt=DISCOVERY_CUSTOM_EVT, node=9d5c1368-d764-4b5a-a895-4879ea800000] [21:01:34] : [Step 4/5] [2021-11-19 21:01:34,600][INFO ][sys-#1007%failure.IoomFailureHandlerTest1%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=fe65148c-4d17-4fff-9236-05b24cf00001, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=9d5c1368-d764-4b5a-a895-4879ea800000, consistentId=a571b31d-b6bc-4984-9a28-b3fa77ead9f4, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637344894104, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:01:34] : [Step 4/5] [2021-11-19 21:01:34,602][INFO ][sys-#1007%failure.IoomFailureHandlerTest1%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (1 ms), stage="Update caches registry" (61 ms), stage="Start caches" (16 ms), stage="Affinity initialization on cache group start" (21 ms), stage="Determine exchange type" (13 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Restore partition states" (0 ms), stage="After states restored callback" (102 ms), stage="WAL history reservation" (0 ms), stage="Waiting for Full message" (77 ms), stage="Affinity recalculation" (4 ms), stage="Full map updating" (12 ms), stage="Detect lost partitions" (6 ms), stage="Exchange done" (20 ms), stage="Total time" (333 ms)] [21:01:34] : [Step 4/5] [2021-11-19 21:01:34,604][INFO ][sys-#1007%failure.IoomFailureHandlerTest1%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], stage="Affinity initialization on cache group start [grp=default]" (6 ms) (parent=Affinity initialization on cache group start), stage="Affinity initialization on cache group start [grp=ignite-sys-cache]" (1 ms) (parent=Affinity initialization on cache group start), stage="Affinity centralized initialization (crd) [grp=ignite-sys-cache, crd=false]" (0 ms) (parent=Determine exchange type), stage="Affinity centralized initialization (crd) [grp=default, crd=false]" (0 ms) (parent=Determine exchange type), stage="Restore partition states [grp=ignite-sys-cache]" (0 ms) (parent=Restore partition states), stage="Restore partition states [grp=default]" (0 ms) (parent=Restore partition states), stage="Affinity applying from full message [grp=default]" (4 ms) (parent=Affinity recalculation), stage="Affinity applying from full message [grp=ignite-sys-cache]" (1 ms) (parent=Affinity recalculation)] [21:01:34] : [Step 4/5] [2021-11-19 21:01:34,605][INFO ][test-runner-#789%failure.IoomFailureHandlerTest%][root] awaitPartitionMapExchange finished [21:01:34] : [Step 4/5] [2021-11-19 21:01:34,951][INFO ][db-checkpoint-thread-#1042%failure.IoomFailureHandlerTest1%][Checkpointer] Checkpoint started [checkpointId=880dfcd1-f3da-4fdf-b409-a2056f8f5bea, startPtr=WALPointer [idx=0, fileOff=121620, len=11488], checkpointBeforeLockTime=33ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=1ms, checkpointLockHoldTime=4ms, walCpRecordFsyncDuration=236ms, writeCheckpointEntryDuration=236ms, splitAndSortCpPagesDuration=0ms, pages=31, reason='node started'] [21:01:34] : [Step 4/5] [2021-11-19 21:01:34,951][INFO ][db-checkpoint-thread-#1047%failure.IoomFailureHandlerTest0%][Checkpointer] Checkpoint started [checkpointId=ccbee5c5-5dbe-4517-aad8-e8915337cfbd, startPtr=WALPointer [idx=0, fileOff=123292, len=11906], checkpointBeforeLockTime=19ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=4ms, checkpointLockHoldTime=6ms, walCpRecordFsyncDuration=222ms, writeCheckpointEntryDuration=236ms, splitAndSortCpPagesDuration=0ms, pages=31, reason='node started'] [21:01:34] : [Step 4/5] [2021-11-19 21:01:34,987][INFO ][db-checkpoint-thread-#1042%failure.IoomFailureHandlerTest1%][Checkpointer] Checkpoint finished [cpId=880dfcd1-f3da-4fdf-b409-a2056f8f5bea, pages=31, markPos=WALPointer [idx=0, fileOff=121620, len=11488], walSegmentsCovered=[], markDuration=477ms, pagesWrite=7ms, fsync=28ms, total=545ms] [21:01:34] : [Step 4/5] [2021-11-19 21:01:34,995][INFO ][db-checkpoint-thread-#1047%failure.IoomFailureHandlerTest0%][Checkpointer] Checkpoint finished [cpId=ccbee5c5-5dbe-4517-aad8-e8915337cfbd, pages=31, markPos=WALPointer [idx=0, fileOff=123292, len=11906], walSegmentsCovered=[], markDuration=466ms, pagesWrite=8ms, fsync=34ms, total=527ms] [21:01:45]W: [org.apache.ignite:ignite-core] [2021-11-19 21:01:45,446][WARN ][sys-stripe-7-#917%failure.IoomFailureHandlerTest1%][PageMemoryImpl] Page replacements started, pages will be rotated with disk, this will affect storage performance (consider increasing DataRegionConfiguration#setMaxSize for data region): dfltPlc [21:01:45]W: [org.apache.ignite:ignite-core] [2021-11-19 21:01:45,448][ERROR][sys-stripe-7-#917%failure.IoomFailureHandlerTest1%][IgniteTestResources] Critical system error detected. Will be handled accordingly to configured handler [hnd=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]], failureCtx=FailureContext [type=CRITICAL_ERROR, err=class o.a.i.i.mem.IgniteOutOfMemoryException: Out of memory in data region [name=dfltPlc, initSize=10.0 MiB, maxSize=10.0 MiB, persistenceEnabled=true] Try the following: [21:01:45]W: [org.apache.ignite:ignite-core] ^-- Increase maximum off-heap memory size (DataRegionConfiguration.maxSize) [21:01:45]W: [org.apache.ignite:ignite-core] ^-- Enable eviction or expiration policies]] [21:01:45]W: [org.apache.ignite:ignite-core] class org.apache.ignite.internal.mem.IgniteOutOfMemoryException: Out of memory in data region [name=dfltPlc, initSize=10.0 MiB, maxSize=10.0 MiB, persistenceEnabled=true] Try the following: [21:01:45]W: [org.apache.ignite:ignite-core] ^-- Increase maximum off-heap memory size (DataRegionConfiguration.maxSize) [21:01:45]W: [org.apache.ignite:ignite-core] ^-- Enable eviction or expiration policies [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.pagemem.PageMemoryImpl.allocatePage(PageMemoryImpl.java:645) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.AbstractFreeList.allocateDataPage(AbstractFreeList.java:575) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.AbstractFreeList.writeSinglePage(AbstractFreeList.java:693) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.AbstractFreeList.insertDataRow(AbstractFreeList.java:587) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.CacheFreeList.insertDataRow(CacheFreeList.java:74) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.CacheFreeList.insertDataRow(CacheFreeList.java:35) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.RowStore.addRow(RowStore.java:117) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.IgniteCacheOffheapManagerImpl$CacheDataStoreImpl.createRow(IgniteCacheOffheapManagerImpl.java:1792) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager$GridCacheDataStore.createRow(GridCacheOffheapManager.java:2785) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.GridCacheMapEntry$UpdateClosure.call(GridCacheMapEntry.java:5833) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.GridCacheMapEntry$UpdateClosure.call(GridCacheMapEntry.java:5770) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.BPlusTree$Invoke.invokeClosure(BPlusTree.java:4041) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.BPlusTree$Invoke.access$5700(BPlusTree.java:3935) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.BPlusTree.invokeDown(BPlusTree.java:2039) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.BPlusTree.invoke(BPlusTree.java:1923) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.IgniteCacheOffheapManagerImpl$CacheDataStoreImpl.invoke0(IgniteCacheOffheapManagerImpl.java:1742) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.IgniteCacheOffheapManagerImpl$CacheDataStoreImpl.invoke(IgniteCacheOffheapManagerImpl.java:1725) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager$GridCacheDataStore.invoke(GridCacheOffheapManager.java:2818) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.IgniteCacheOffheapManagerImpl.invoke(IgniteCacheOffheapManagerImpl.java:449) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.GridCacheMapEntry.storeValue(GridCacheMapEntry.java:4304) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.GridCacheMapEntry.storeValue(GridCacheMapEntry.java:4278) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.GridCacheMapEntry.innerSet(GridCacheMapEntry.java:1553) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.transactions.IgniteTxLocalAdapter.userCommit(IgniteTxLocalAdapter.java:735) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.distributed.dht.GridDhtTxLocalAdapter.localFinish(GridDhtTxLocalAdapter.java:789) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.distributed.dht.GridDhtTxLocal.localFinish(GridDhtTxLocal.java:595) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.distributed.dht.GridDhtTxLocal.finishTx(GridDhtTxLocal.java:467) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.distributed.dht.GridDhtTxLocal.commitDhtLocalAsync(GridDhtTxLocal.java:512) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.distributed.dht.GridDhtTxLocal.commitAsync(GridDhtTxLocal.java:532) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.distributed.dht.GridDhtTxPrepareFuture.onDone(GridDhtTxPrepareFuture.java:799) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.distributed.dht.GridDhtTxPrepareFuture.onDone(GridDhtTxPrepareFuture.java:120) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.onDone(GridFutureAdapter.java:467) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridCompoundFuture.checkComplete(GridCompoundFuture.java:351) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridCompoundFuture.markInitialized(GridCompoundFuture.java:340) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.distributed.dht.GridDhtTxPrepareFuture.prepare0(GridDhtTxPrepareFuture.java:1380) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.distributed.dht.GridDhtTxPrepareFuture.mapIfLocked(GridDhtTxPrepareFuture.java:732) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.distributed.dht.GridDhtTxPrepareFuture.prepare(GridDhtTxPrepareFuture.java:1138) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.distributed.dht.GridDhtTxLocal.prepareAsync(GridDhtTxLocal.java:400) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.transactions.IgniteTxHandler.prepareNearTx(IgniteTxHandler.java:580) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.transactions.IgniteTxHandler.prepareNearTx(IgniteTxHandler.java:377) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.transactions.IgniteTxHandler.processNearTxPrepareRequest0(IgniteTxHandler.java:200) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.transactions.IgniteTxHandler.processNearTxPrepareRequest(IgniteTxHandler.java:174) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.transactions.IgniteTxHandler.access$000(IgniteTxHandler.java:134) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.transactions.IgniteTxHandler$1.apply(IgniteTxHandler.java:222) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.transactions.IgniteTxHandler$1.apply(IgniteTxHandler.java:220) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.GridCacheIoManager.processMessage(GridCacheIoManager.java:1151) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.GridCacheIoManager.onMessage0(GridCacheIoManager.java:592) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.GridCacheIoManager.handleMessage(GridCacheIoManager.java:393) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.GridCacheIoManager.handleMessage(GridCacheIoManager.java:319) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.GridCacheIoManager.access$100(GridCacheIoManager.java:110) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.GridCacheIoManager$1.onMessage(GridCacheIoManager.java:309) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.managers.communication.GridIoManager.invokeListener(GridIoManager.java:1907) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.managers.communication.GridIoManager.processRegularMessage0(GridIoManager.java:1528) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.managers.communication.GridIoManager.access$5300(GridIoManager.java:242) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.managers.communication.GridIoManager$9.execute(GridIoManager.java:1421) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.managers.communication.TraceRunnable.run(TraceRunnable.java:55) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.StripedExecutor$Stripe.body(StripedExecutor.java:569) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:125) [21:01:45]W: [org.apache.ignite:ignite-core] at java.lang.Thread.run(Thread.java:748) [21:01:45]W: [org.apache.ignite:ignite-core] Caused by: class org.apache.ignite.internal.mem.IgniteOutOfMemoryException: Failed to find a page for eviction (no pages to replace) [segmentCapacity=1250, loaded=481, maxDirtyPages=360, dirtyPages=481, cpPages=0, pinned=1] [21:01:45]W: [org.apache.ignite:ignite-core] Out of memory in data region [name=dfltPlc, initSize=10.0 MiB, maxSize=10.0 MiB, persistenceEnabled=true] Try the following: [21:01:45]W: [org.apache.ignite:ignite-core] ^-- Increase maximum off-heap memory size (DataRegionConfiguration.maxSize) [21:01:45]W: [org.apache.ignite:ignite-core] ^-- Enable eviction or expiration policies [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.pagemem.PageMemoryImpl$Segment.oomException(PageMemoryImpl.java:2345) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.pagemem.ClockPageReplacementPolicy.replace(ClockPageReplacementPolicy.java:94) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.pagemem.PageMemoryImpl$Segment.removePageForReplacement(PageMemoryImpl.java:2322) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.pagemem.PageMemoryImpl$Segment.access$900(PageMemoryImpl.java:1962) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.pagemem.PageMemoryImpl.allocatePage(PageMemoryImpl.java:587) [21:01:45]W: [org.apache.ignite:ignite-core] ... 57 more [21:01:45]W: [org.apache.ignite:ignite-core] [2021-11-19 21:01:45,469][WARN ][sys-stripe-7-#917%failure.IoomFailureHandlerTest1%][CacheDiagnosticManager] Page locks dump: [21:01:45]W: [org.apache.ignite:ignite-core] [21:01:45]W: [org.apache.ignite:ignite-core] [21:01:45]W: [org.apache.ignite:ignite-core] [21:01:45]W: [org.apache.ignite:ignite-core] [21:01:45]W: [org.apache.ignite:ignite-core] [21:01:45]W: [org.apache.ignite:ignite-core] [21:01:45]W: [org.apache.ignite:ignite-core] [21:01:45]W: [org.apache.ignite:ignite-core] [2021-11-19 21:01:45,470][ERROR][sys-stripe-7-#917%failure.IoomFailureHandlerTest1%][FailureProcessor] Ignite node is in invalid state due to a critical failure. [21:01:45]W: [org.apache.ignite:ignite-core] [2021-11-19 21:01:45,563][WARN ][sys-stripe-7-#917%failure.IoomFailureHandlerTest1%][GridNearTxLocal] Set transaction invalidation flag to true due to error [tx=GridDhtTxLocal[xid=9885c593d71-00000000-0ed4-c43d-0000-000000000002, xidVersion=GridCacheVersion [topVer=248824893, order=1637344893065, nodeOrder=2], nearXidVersion=GridCacheVersion [topVer=248824893, order=1637344893064, nodeOrder=1], concurrency=PESSIMISTIC, isolation=REPEATABLE_READ, state=UNKNOWN, invalidate=false, rollbackOnly=false, nodeId=fe65148c-4d17-4fff-9236-05b24cf00001, timeout=0, startTime=1637344895184, duration=10371], err=class o.a.i.i.transactions.IgniteTxHeuristicCheckedException: Committing a transaction has produced runtime exception] [21:01:45]W: [org.apache.ignite:ignite-core] [21:01:45] (err) Failed to execute compound future reducer: GridCompoundFuture [rdc=null, initFlag=1, lsnrCalls=1, size=603, done=false, cancelled=false, err=null, futs=TransformCollectionView [true, true, true, true, false, false, false, false, false, false, false, false, false, false, false, false, false, fal[21:se, false[21:01:45] (err) Failed to execute compound future reducer: GridCompoundFuture [rdc=null, initFlag=1, lsnrCalls=1, size=603, done=false, cancelled=false, err=null, futs=TransformCollectionView [true, true, true, true, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false... and 503 more]]class org.apache.ignite.IgniteCheckedException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:45]W: [org.apache.ignite:ignite-core] 01:4[21:01:45] (e, frr) at org.apache.ignite.internal.util.IgniteUtils.cast(IgniteUtils.java:7773) [21:01:45]W: [org.apache.ignite:ignite-core] F at org.apache.ignite.internal.util.future.GridFutureAdapter.resolve(GridFutureAdapter.java:260) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.get0(GridFutureAdapter.java:172) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.get(GridFutureAdapter.java:141) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridCompoundFuture.apply(GridCompoundFuture.java:100) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridCompoundFuture.apply(GridCompoundFuture.java:47) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.notifyListener(GridFutureAdapter.java:399) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.unblock(GridFutureAdapter.java:347) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.unblockAll(GridFutureAdapter.java:335) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.onDone(GridFutureAdapter.java:511) [21:01:45]W: [org.apache.ignite:ignite-core] 5] (err) Failed to execute compound future reducer: GridCompoundFuture [rdc=null, initFlag=1, lsnrCalls=1, size=603, done=false, cancelled=false, err=null, futs=TransformCollectionView [true, true, true, true, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false... and 503 more]]alailed to execute co at org.aspache.ignite.internal.util.future.GridFutureAdapter.onDone(GridFutureAdapter.java:490) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.onDone(GridFutureAdapter.java:478) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.lambda$wrapIgniteFuture$3(IgniteUtils.java:11719) [21:01:45]W: [org.apache.ignite:ignite-core] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [21:01:45]W: [org.apache.ignite:ignite-core] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [21:01:45]W: [org.apache.ignite:ignite-core] at java.lang.Thread.run(Thread.java:748) [21:01:45]W: [org.apache.ignite:ignite-core] Caused by: class org.apache.ignite.IgniteException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.lambda$syncMetadata$2(GridCacheOffheapManager.java:381) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.lambda$wrapIgniteFuture$3(IgniteUtils.java:11714) [21:01:45]W: [org.apache.ignite:ignite-core] ... 3 more [21:01:45]W: [org.apache.ignite:ignite-core] Caused by: class org.apache.ignite.internal.processors.cache.persistence.StorageException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:45]W: [org.apache.ignite:ignite-core] e, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false... and 503 more]]mpound future reducer: GridCompoundFuture [rdc=null, initFlag=1, lsnrCalls=1, size=603, done=false, cancelled=false, err=null, futs=TransformCollectionView [true, true, true, true, true, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false... and 503 more]] at org.apache.ignite.internal.processors.cache.persistence.wal.filehandle.FileWriteHandleImpl.checkNode(FileWriteHandleImpl.java:208) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.filehandle.FileWriteHandleImpl.addRecord(FileWriteHandleImpl.java:235) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager.log(FileWriteAheadLogManager.java:910) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager.log(FileWriteAheadLogManager.java:863) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.doInitPage(PageHandler.java:471) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.writePage(PageHandler.java:307) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.initPage(PageHandler.java:244) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.DataStructure.init(DataStructure.java:425) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.addStripe(PagesList.java:623) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.getPageForPut(PagesList.java:754) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.put(PagesList.java:859) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList$PutBucket.run(PagesList.java:199) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList$PutBucket.run(PagesList.java:173) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.writePage(PageHandler.java:313) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.DataStructure.write(DataStructure.java:304) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.flushBucketsCache(PagesList.java:415) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.saveMetadata(PagesList.java:356) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.saveStoreMetadata(GridCacheOffheapManager.java:403) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.lambda$syncMetadata$2(GridCacheOffheapManager.java:378) [21:01:45]W: [org.apache.ignite:ignite-core] ... 4 more [21:01:45]W: [org.apache.ignite:ignite-core] class org.apache.ignite.IgniteCheckedException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.cast(IgniteUtils.java:7773) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.resolve(GridFutureAdapter.java:260) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.get0(GridFutureAdapter.java:172) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.get(GridFutureAdapter.java:141) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridCompoundFuture.apply(GridCompoundFuture.java:100) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridCompoundFuture.apply(GridCompoundFuture.java:47) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.notifyListener(GridFutureAdapter.java:399) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.unblock(GridFutureAdapter.java:347) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.unblockAll(GridFutureAdapter.java:335) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.onDone(GridFutureAdapter.java:511) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.onDone(GridFutureAdapter.java:490) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.onDone(GridFutureAdapter.java:478) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.lambda$wrapIgniteFuture$3(IgniteUtils.java:11719) [21:01:45]W: [org.apache.ignite:ignite-core] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [21:01:45]W: [org.apache.ignite:ignite-core] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [21:01:45]W: [org.apache.ignite:ignite-core] at java.lang.Thread.run(Thread.java:748) [21:01:45]W: [org.apache.ignite:ignite-core] Caused by: class org.apache.ignite.IgniteException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.lambda$syncMetadata$2(GridCacheOffheapManager.java:381) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.lambda$wrapIgniteFuture$3(IgniteUtils.java:11714) [21:01:45]W: [org.apache.ignite:ignite-core] ... 3 more [21:01:45]W: [org.apache.ignite:ignite-core] Caused by: class org.apache.ignite.internal.processors.cache.persistence.StorageException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.filehandle.FileWriteHandleImpl.checkNode(FileWriteHandleImpl.java:208) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.filehandle.FileWriteHandleImpl.addRecord(FileWriteHandleImpl.java:235) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager.log(FileWriteAheadLogManager.java:910) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager.log(FileWriteAheadLogManager.java:863) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.doInitPage(PageHandler.java:471) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.writePage(PageHandler.java:307) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.initPage(PageHandler.java:244) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.DataStructure.init(DataStructure.java:425) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.addStripe(PagesList.java:623) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.getPageForPut(PagesList.java:754) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.put(PagesList.java:859) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList$PutBucket.run(PagesList.java:199) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList$PutBucket.run(PagesList.java:173) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.writePage(PageHandler.java:313) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.DataStructure.write(DataStructure.java:304) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.flushBucketsCache(PagesList.java:415) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.saveMetadata(PagesList.java:356) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.saveStoreMetadata(GridCacheOffheapManager.java:403) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.lambda$syncMetadata$2(GridCacheOffheapManager.java:378) [21:01:45]W: [org.apache.ignite:ignite-core] ... 4 more [21:01:45]W: [org.apache.ignite:ignite-core] class org.apache.ignite.IgniteCheckedException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.cast(IgniteUtils.java:7773) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.resolve(GridFutureAdapter.java:260) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.get0(GridFutureAdapter.java:172) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.get(GridFutureAdapter.java:141) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridCompoundFuture.apply(GridCompoundFuture.java:100) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridCompoundFuture.apply(GridCompoundFuture.java:47) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.notifyListener(GridFutureAdapter.java:399) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.unblock(GridFutureAdapter.java:347) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.unblockAll(GridFutureAdapter.java:335) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.onDone(GridFutureAdapter.java:511) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.onDone(GridFutureAdapter.java:490) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.onDone(GridFutureAdapter.java:478) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.lambda$wrapIgniteFuture$3(IgniteUtils.java:11719) [21:01:45]W: [org.apache.ignite:ignite-core] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [21:01:45]W: [org.apache.ignite:ignite-core] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [21:01:45]W: [org.apache.ignite:ignite-core] at java.lang.Thread.run(Thread.java:748) [21:01:45]W: [org.apache.ignite:ignite-core] Caused by: class org.apache.ignite.IgniteException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.lambda$syncMetadata$2(GridCacheOffheapManager.java:381) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.lambda$wrapIgniteFuture$3(IgniteUtils.java:11714) [21:01:45]W: [org.apache.ignite:ignite-core] ... 3 more [21:01:45]W: [org.apache.ignite:ignite-core] Caused by: class org.apache.ignite.internal.processors.cache.persistence.StorageException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.filehandle.FileWriteHandleImpl.checkNode(FileWriteHandleImpl.java:208) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.filehandle.FileWriteHandleImpl.addRecord(FileWriteHandleImpl.java:235) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager.log(FileWriteAheadLogManager.java:910) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager.log(FileWriteAheadLogManager.java:863) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.doInitPage(PageHandler.java:471) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.writePage(PageHandler.java:307) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.initPage(PageHandler.java:244) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.DataStructure.init(DataStructure.java:425) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.addStripe(PagesList.java:623) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.getPageForPut(PagesList.java:754) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.put(PagesList.java:859) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList$PutBucket.run(PagesList.java:199) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList$PutBucket.run(PagesList.java:173) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.writePage(PageHandler.java:313) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.DataStructure.write(DataStructure.java:304) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.flushBucketsCache(PagesList.java:415) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.saveMetadata(PagesList.java:356) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.saveStoreMetadata(GridCacheOffheapManager.java:403) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.lambda$syncMetadata$2(GridCacheOffheapManager.java:378) [21:01:45]W: [org.apache.ignite:ignite-core] ... 4 more [21:01:45]W: [org.apache.ignite:ignite-core] [[[2122021-11-19 21:01:45,670][ERROR][db-checkpoint-thread-#1042%failure.IoomFailureHandlerTest1%][Checkpointer] Runtime error caught during grid runnable execution: GridWorker [name=db-checkpoint-thread, igniteInstanceName=failure.IoomFailureHandlerTest1, finished=false, heartbeatTs=1637344905645, hashCode=1764600342, interrupted=false, runner=db-checkpoint-thread-#1042%failure.IoomFailureHandlerTest1%] [21:01:45]W: [org.apache.ignite:ignite-core] class org.apache.ignite.IgniteException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.checkpoint.Checkpointer.doCheckpoint(Checkpointer.java:428) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.checkpoint.Checkpointer.body(Checkpointer.java:277) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apacheclass org.apache.ignite.IgniteCheckedException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.cast(IgniteUtils.java:7773) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.resolve(GridFutureAdapter.java:260) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.get0(GridFutureAdapter.java:172) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.get(GridFutureAdapter.java:141) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridCompoundFuture.apply(GridCompoundFuture.java:100) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridCompoundFuture.apply(GridCompoundFuture.java:47) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.notifyListener(GridFutureAdapter.java:399) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.unblock(GridFutureAdapter.java:347) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.unblockAll(GridFutureAdapter.java:335) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.onDone(GridFutureAdapter.java:511) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.onDone(GridFutureAdapter.java:490) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.onDone(GridFutureAdapter.java:478) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.lambda$wrapIgniteFuture$3(IgniteUtils.java:11719) [21:01:45]W: [org.apache.ignite:ignite-core] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [21:01:45]W: [org.apache.ignite:ignite-core] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [21:01:45]W: [org.apache.ignite:ignite-core] at java.lang.Thread.run(Thread.java:748) [21:01:45]W: [org.apache.ignite:ignite-core] .ignite.internal.util.worker.GridWorkCaused by: class org.apache.ignite.IgniteException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.lambda$syncMetadata$2(GridCacheOffheapManager.java:381) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.lambda$wrapIgniteFuture$3(IgniteUtils.java:11714) [21:01:45]W: [org.apache.ignite:ignite-core] ... 3 more [21:01:45]W: [org.apache.ignite:ignite-core] Caused by: class org.apache.ignite.internal.processors.cache.persistence.StorageException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.filehandle.FileWriteHandleImpl.checkNode(FileWriteHandleImpl.java:208) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.filehandle.FileWriteHandleImpl.addRecord(FileWriteHandleImpl.java:235) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager.log(FileWriteAheadLogManager.java:910) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager.log(FileWriteAheadLogManager.java:863) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.doInitPage(PageHandler.java:471) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.writePage(PageHandler.java:307) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.initPage(PageHandler.java:244) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.DataStructure.init(DataStructure.java:425) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.addStripe(PagesList.java:623) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.inte:EErEnal.processors.cache.persistence.freelist.PagesList.getPageForPut(PagesList.java:754) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.put(PagesList.java:859) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList$PutBucket.run(PagesList.java:199) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList$PutBucket.run(PagesList.java:173) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.writePage(PageHandler.java:313) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.DataStructure.write(DataStructure.java:304) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.flushBucketsCache(PagesList.java:415) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.saveMetadata(PagesList.java:356) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.saveStoreMetadata(GridCacheOffheapManager.java:403) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.lambda$syncMetadata$2(GridCacheOffheapManager.java:378) [21:01:45]W: [org.apache.ignite:ignite-core] ... 4 more [21:01:45]W: [org.apache.ignite:ignite-core] xception in thread "checkpoint-runner-cpu-#1046%failure.IoomFailureHandlerTest1%" class org.apache.ignite.IgniteException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.lambda$syncMetadata$2(GridCacheOffheapManager.java:381) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.lambda$wrapIgniteFuture$3(IgniteUtils.java:11714) [21:01:45]W: [org.apache.ignite:ignite-core] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [21:01:45]W: [org.apache.ignite:ignite-core] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [21:01:45]W: [org.apache.ignite:ignite-core] at java.lang.Thread.run(Thread.java:748) [21:01:45]W: [org.apache.ignite:ignite-core] Caused by: class org.apache.ignite.internal.processors.cache.persistence.StorageException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.filehandle.FileWriteHandleImpl.checkNode(FileWriteHandleImpl.java:208) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.filehandle.FileWriteHandleImpl.addRecord(FileWriteHandleImpl.java:235) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager.log(FileWriteAheadLogManager.java:910) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager.log(FileWriteAheadLogManager.java:863) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.doInitPage(PageHandler.java:471) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.writePage(PageHandler.java:307) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.initPage(PageHandler.java:244) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.DataStructure.init(DataStructure.java:425) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.addStripe(PagesList.java:623) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.getPageForPut(PagesList.java:754) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.put(PagesList.java:859) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList$PutBucket.run(PagesList.java:199) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList$PutBucket.run(PagesList.java:173) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.writePage(PageHandler.java:313) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.DataStructure.write(DataStructure.java:304) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.flushBucketsCache(PagesList.java:415) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.saveMetadata(PagesList.java:356) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.saveStoreMetadata(GridCacheOffheapManager.java:403) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.lambda$syncMetadata$2(GridCacheOffheapManager.java:378) [21:01:45]W: [org.apache.ignite:ignite-core] ... 4 more [21:01:45]W: [org.apache.ignite:ignite-core] xcxc1:ept0er.run(eption in thread "checkpoint-runner-cpu-#1044%failure.IoomFailureHandlerTest1%" class org.apache.ignite.IgniteException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.lambda$syncMetadata$2(GridCacheOffheapManager.java:381) [21:01:45]W: [org.apache.ignite:ignite-core] [EG1i0 at org.apache.ignite.internal.util.IgniteUtils.lambda$wrapIgniteFuture$3(IgniteUtils.java:11714) [21:01:45]W: [org.apache.ignite:ignite-core] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [21:01:45]W: [org.apache.ignite:ignite-core] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [21:01:45]W: [org.apache.ignite:ignite-core] at java.lang.Thread.run(Thread.java:748) [21:01:45]W: [org.apache.ignite:ignite-core] Caused by: class org.apache.ignite.internal.processors.cache.persistence.StorageException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:45]W: [org.apache.ignite:ignite-core] at1 org.apache.ignite.internal.processors.cache.persistence.wal.filehandle.FileWriteHandleImpl.checkNode(FileWriteHandleImpl.java:208) [21:01:45]W: [org.apache.ignite:ignite-core] o at org.apache.ignite.internal.processors.cache.persistence.wal.filehandle.FileWriteHandleImpl.addRecord(FileWriteHandleImpl.java:235) [21:01:45]W: [org.apache.ignite:ignite-core] :45] at org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager.log(FileWriteAheadLogManager.java:910) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager.log(FileWriteAheadLogManager.java:863) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.doInitPage(PageHandler.java:471) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.writePage(PageHandler.java:307) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.initPage(PageHandler.java:244) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.DataStructure.init(DataStructure.java:425) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.addStripe(PagesList.java:623) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.getPageForPut(PagesList.java:754) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.put(PagesList.java:859) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList$PutBucket.run(PagesList.java:199) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList$PutBucket.run(PagesList.java:173) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.writePage(PageHandler.java:313) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.DataStructure.write(DataStructure.java:304) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.flushBucketsCache(PagesList.java:415) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.saveMetadata(PagesList.java:356) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.saveStoreMetadata(GridCacheOffheapManager.java:403) [21:01:45]W: [org.apache.ignite:ignite-core] ridWorker.java:125) [21:01:45]W: [org.apache.ignite:ignite-core] at xception in thj at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.lambda$syncMetadata$2(GridCacheOffheapManager.java:378) [21:01:45]W: [org.apache.ignite:ignite-core] ... 4 more [21:01:45]W: [org.apache.ignite:ignite-core] ava.lang.Thread.run(Thread.java:748) [21:01:45]W: [org.apache.ignite:ignite-core] Caused by: class org.apache.ignite.IgniteCheckedException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.cast(IgniteUtils.java:7773) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.resolve(GridFutureAdapter.java:260) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.get0(GridFutureAdapter.java:172) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdaptern in thread "checkpoint-runner-cpu-#1045%failure.IoomFailureHandlerTest1%" class org.apache.ignite.IgniteException: Failed to perform WAL operation (environment was invalidated by a previous error)2 [21:01:45]W: [org.apache.ignite:ignite-core] .get(Gri a rt org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.lambda$syncMetadata$2(GridCacheOffheapManager.java:381) [21:01:45]W: [org.apache.ignite:ignite-core] at: org.apache.ignite.internal.util.IgniteUtils.lambda$wrapIgniteFuture$3(IgniteUtils.java:11714) [21:01:45]W: [org.apache.ignite:ignite-core] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [21:01:45]W: [org.apache.ignite:ignite-core] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [21:01:45]W: [org.apache.ignite:ignite-core] at java.lang.Thread.run(Thread.java:748) [21:01:45]W: [org.apache.ignite:ignite-core] Caused by: class org.apache.ignite.internal.processors.cache.persistence.StorageException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.filehandle.FileWriteHandleImpl.checkNode(FileWriteHandleImpl.java:208) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.filehandle.FileWriteHandleImpl.addRecord(FileWriteHandleImpl.java:235) [21:01:45]W: [org.apache.ignite:ignite-core] [ at org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager.log(FileWriteAheadLogManager.java:910) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apac4he.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager.log(FileWriteAheadLogManager.java:863) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.doInitPage(PageHandler.java:471) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.writePage(PageHandler.java:307) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.initPage(PageHandler.java:244) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.DataStructure.init(DataStructure.java:425) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.addStripe(PagesList.java:623) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.getPageForPut(PagesList.java:754) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.put(PagesList.java:859) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList$PutBucket.run(PagesList.java:199) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList$PutBucket.run(PagesList.java:173) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.writePage(PageHandler.java:313) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.DataStructure.write(DataStructure.java:304) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.flushBucketsCache(PagesList.java:415) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.saveMetadata(PagesList.java:356) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.saveStoreMetadata(GridCacheOffheapManager.java:403) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.lambda$syncMetadata$2(GridCacheOffheapManager.java:378) [21:01:45]W: [org.apache.ignite:ignite-core] ... 4 more [21:01:45]W: [org.apache.ignite:ignite-core] (err) Failed to execute compound future reducer: GridCompoundFuture [rdc=null, initFlag=1, lsnrCalls=3, size=603, done=true, cancelled=false, err=class o.a.i.IgniteCheckedException: Failed to perform WAL operation (environment was invalidated by a previous error), futs=TransformCollectionView [true, true, true, true, true, true, true, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false... and 503 more]]class org.apache.ignite.IgniteCheckedException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.cast(IgniteUtils.java:7773) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.resolve(GridFutureAdapter.java:260) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.get0(GridFutureAdapter.java:172) [21:01:45]W: [org.apache.ignite:ignite-core] dFutureAdapt a1e5t org.apache.ignite.internal.util.future.GridFutureAdapter.get(GridFutureAdapter.java:141) [21:01:45]W: [org.apache.ignite:ignite-core] 2 at org.apache.ignite.internal.util.future.GridCompoundFuture.apply(GridCompoundFuture.java:100) [21:01:45]W: [org.apache.ignite:ignite-core] ] :at org.apache.ignite.internal.util.future.GridCompoundFuture.apply(GridCompoundFuture.java:47) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.notifyListener(GridFutureAdapter.java:399) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.unblock(GridFutureAdapter.java:347) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.unblockAll(GridFutureAdapter.java:335) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.onDone(GridFutureAdapter.java:511) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.onDone(GridFutureAdapter.java:490) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.onDone(GridFutureAdapter.java:478) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.lambda$wrapIgniteFuture$3(IgniteUtils.java:11719) [21:01:45]W: [org.apache.ignite:ignite-core] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [21:01:45]W: [org.apache.ignite:ignite-core] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [21:01:45]W: [org.apache.ignite:ignite-core] at java.lang.Thread.run(Thread.java:748) [21:01:45]W: [org.apache.ignite:ignite-core] ad "checkpoint-runner-cpu-#1043%failure.IoCaused by: class org.apache.ignite.IgniteException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:45]W: [org.apache.ignite:ignite-core] er.java:141) [21:01:45]W: [org.apache.ignite:ignite-core] o at org.apa che.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.lambda$syncMetadata$2(GridCacheOffheapManager.java:381) [21:01:45]W: [org.apache.ignite:ignite-core] 0at org.apache.ignite.internal.util.IgniteUtils.lambda$wrapIgniteFuture$3(IgniteUtils.java:11714) [21:01:45]W: [org.apache.ignite:ignite-core] ... 3 more [21:01:45]W: [org.apache.ignite:ignite-core] Caused by: class org.apache.ignite.internal.processors.cache.persistence.StorageException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.filehandle.FileWriteHandleImpl.checkNode(FileWriteHandleImpl.java:208) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.filehandle.FileWriteHandleImpl.addRecord(FileWriteHandleImpl.java:235) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager.log(FileWriteAheadLogManager.java:910) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager.log(FileWriteAheadLogManager.java:863) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.doInitPage(PageHandler.java:471) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.writePage(PageHandler.java:307) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.initPage(PageHandler.java:244) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.DataStructure.init(DataStructure.java:425) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.addStripe(PagesList.java:623) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.getPageForPut(PagesList.java:754) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.put(PagesList.java:859) [21:01:45]W: [org.apache.ignite:ignite-core] 1 at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList$PutBucket.run(PagesList.java:199) [21:01:45]W: [org.apache.ignite:ignite-core] (err) Failed to execute compound future reducer: GridCompoundFuture [rdc=null, initFlag=1, lsnrCalls=3, size=603, done=true, cancelled=false, err=class o.a.i.IgniteCheckedException: Failed to perform WAL operation (environment was invalidated by a previous error), futs=TransformCollectionView [true, true, true, true, true, true, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false... and 503 more]] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList$PutBucket.run(PagesList.java:173) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.writePage(PageHandler.java:313) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.DataStructure.write(DataStructure.java:304) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.flushBucketsCache(PagesList.java:415) [21:01:45]W: [org.apache.ignite:ignite-core] at org1.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.saveMetadata(PagesList.java:356) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.saveStoreMetadata(GridCacheOffheapManager.java:403) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.lambda$syncMetadata$2(GridCacheOffheapManager.java:378) [21:01:45]W: [org.apache.ignite:ignite-core] ... 4 more [21:01:45]W: [org.apache.ignite:ignite-core] class org.apache.ignite.IgniteCheckedException: Out of memory in data region [name=dfltPlc, initSize=10.0 MiB, maxSize=10.0 MiB, persistenceEnabled=true] Try the following: [21:01:45]W: [org.apache.ignite:ignite-core] ^-- Increase maximum off-heap memory size (DataRegionConfiguration.maxSize) [21:01:45]W: [org.apache.ignite:ignite-core] ^-- Enable eviction or expiration policies [21:01:45]W: [org.apache.ignite:ignite-core] am att org.apache.ignite.internal.util.IgniteUtils.cast(IgniteUtils.java:7773) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.resolve(GridFutureAdapter.java:260) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.get0(GridFutureAdapter.java:172) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.get(GridFutureAdapter.java:141) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridCompoundFuture.apply(GridCompoundFuture.java:100) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridCompoundFuture.apply(GridCompoundFuture.java:47) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.notifyListener(GridFutureAdapter.java:399) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.unblock(GridFutureAdapter.java:347) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.unblockAll(GridFutureAdapter.java:335) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.onDone(GridFutureAdapter.java:511) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.onDone(GridFutureAdapter.java:490) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.onDone(GridFutureAdapter.java:478) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.lambda$wrapIgniteFuture$3(IgniteUtils.java:11719) [21:01:45]W: [org.apache.ignite:ignite-core] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [21:01:45]W: [org.apache.ignite:ignite-core] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [21:01:45]W: [org.apache.ignite:ignite-core] at java.lang.Thread.run(Thread.java:748) [21:01:45]W: [org.apache.ignite:ignite-core] Caused by: class org.apache.ignite.internal.mem.IgniteOutOfMemoryException: Out of memory in data region [name=dfltPlc, initSize=10.0 MiB, maxSize=10.0 MiB, persistenceEnabled=true] Try the following: [21:01:45]W: [org.apache.ignite:ignite-core] ^-- Increase maximum off-heap memory size (DataRegionConfiguration.maxSize) [21:01:45]W: [org.apache.ignite:ignite-core] ^-- Enable eviction or expiration policies [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.pagemem.PageMemoryImpl.allocatePage(PageMemoryImpl.java:645) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager$GridCacheDataStore$1.allocatePageNoReuse(GridCacheOffheapManager.java:2049) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.DataStructure.allocatePage(DataStructure.java:177) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.addStripe(PagesList.java:621) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.getPageForPut(PagesList.java:754) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.put(PagesList.java:859) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList$PutBucket.run(PagesList.java:199) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList$PutBucket.run(PagesList.java:173) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.writePage(PageHandler.java:313) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.DataStructure.write(DataStructure.java:304) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.flushBucketsCache(PagesList.java:415) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.saveMetadata(PagesList.java:356) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.saveStoreMetadata(GridCacheOffheapManager.java:403) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.lambda$syncMetadata$2(GridCacheOffheapManager.java:378) [21:01:45]W: [org.apache.ignite:ignite-core] at org.:apache.ignite.internal.util.IgniteUtils.lambda$wrapIgniteFuture$3(IgniteUtils.java:11714) [21:01:45]W: [org.apache.ignite:ignite-core] :01:45] (err) Failed to execute compound future reducer: GridCompoundFuture [rdc=null, initFlag=1, lsnrCalls=5, size=603, done=true, cancelled=false, err=class o.a.i.IgniteCheckedException: Failed to perform WAL operation (environment was invalidated by a previous error), futs=TransformCollectionView [true, true, true, true, true, true, true, true, true, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false,E false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false , false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false... and 503 more]]45] (err) Failed to execute compound future reducer: GridCompoundFuture [rdcFailureHa ... 3 more [21:01:45]W: [org.apache.ignite:ignite-core] ndlerTest1%" Caused by: class org.apache.ignite.internal.mem.IgniteOutOfMemoryException: Failed to find a page for eviction (no pages to replace) [segmentCapacity=1250, loaded=481, maxDirtyPages=360, dirtyPages=481, cpPages=0, pinned=0] [21:01:45]W: [org.apache.ignite:ignite-core] Out of memory in data region [name=dfltPlc, initSize=10.0 MiB, maxSize=10.0 MiB, persistenceEnabled=true] Try the following: [21:01:45]W: [org.apache.ignite:ignite-core] ^-- Increase maximum off-heap memory size (DataRegionConfiguration.maxSize) [21:01:45]W: [org.apache.ignite:ignite-core] ^-- Enable eviction or expiration policies [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.pagemem.PageMemoryImpl$Segment.oomException(PageMemoryImpl.java:2345) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apacheox[.ig=nite.internal.processors.cache.persistence.pagemem.ClockPageReplacementPolicy.replace(ClockPageReplacementPolicy.java:94) [21:01:45]W: [org.apache.ignite:ignite-core] n at org.apache.ignite.internal.processors.cache.persistence.pagemem.PageMemoryImpl$Segment.removePageForReplacement(PageMemoryImpl.java:2322) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.pagemem.PageMemoryImpl$Segment.access$900(PageMemoryImpl.java:1962) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.pagemem.PageMemoryImpl.allocatePage(PageMemoryImpl.java:587) [21:01:45]W: [org.apache.ignite:ignite-core] 2... 17 more [21:01:45]W: [org.apache.ignite:ignite-core] ception1r class org.apache.ignite.IgniteException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.lambda$syncMetadata$2(GridCacheOffheapManager.java:381) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.lambda$wrapIgniteFuture$3(IgniteUtils.java:11714) [21:01:45]W: [org.apache.ignite:ignite-core] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [21:01:45]W: [org.apache.ignite:ignite-core] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [21:01:45]W: [org.apache.ignite:ignite-core] at java.lang.Thread.run(Thread.java:748) [21:01:45]W: [org.apache.ignite:ignite-core] Caused by: class org.apache.ignite.internal.processors.cache.persistence.StorageException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.filehandle.FileWriteHandleImpl.checkNode(FileWriteHandleImpl.java:208) [21:01:45]W: [org.apache.ignite:ignite-core] uat org.apache.ignite.internal.processors.cache.persistence.wal.filehandle.FileWriteHandleImpl.addRecord(FileWriteHandleImpl.java:235) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager.log(FileWriteAheadLogManager.java:910) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager.log(FileWriteAheadLogManager.java:863) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.doInitPage(PageHandler.java:471) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.writePage(PageHandler.java:307) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.initPage(PageHandler.java:244) [21:01:45]W: [org.apache.ignite:ignite-core] at orgi.apache.ignite.internal.processors.cache.persistence.DataStructure.init(DataStructure.java:425) [21:01:45]W: [org.apache.ignite:ignite-core] agt org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.addStripe(PagesList.java:623) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.getPageForPut(PagesList.java:754) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.put(PagesList.java:859) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList$PutBucket.run(PagesList.java:199) [21:01:45]W: [org.apache.ignite:ignite-core] : at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList$PutBucket.run(PagesList.java:173) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apach0e.ignite.internal.processors.cache.persistence.tree.util.PageHandler.writePage(PageHandler.java:313) [21:01:45]W: [org.apache.ignite:ignite-core] . at org.apache.ignite.internal.processors.cache.persistence.DataStructure.write(DataStructure.java:304) [21:01:45]W: [org.apache.ignite:ignite-core] nat org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.flushBucketsCache(PagesList.java:415) [21:01:45]W: [org.apache.ignite:ignite-core] [ at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.saveMetadata(PagesList.java:356) [21:01:45]W: [org.apache.ignite:ignite-core] E at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.saveStoreMetadata(GridCacheOffheapManager.java:403) [21:01:45]W: [org.apache.ignite:ignite-core] atl org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.lambda$syncMetadata$2(GridCacheOffheapManager.java:378) [21:01:45]W: [org.apache.ignite:ignite-core] ... 4 more [21:01:45]W: [org.apache.ignite:ignite-core] xc2ecl ass org.apache.ignite.IgniteCh1eckedException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.cast(IgniteUtils.java:7773) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.resolve(GridFutureAdapter.java:260) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.get0(GridFutureAdapter.java:172) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.get(GridFutureAdapter.java:141) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridCompoundFuture.apply(GridCompoundFuture.java:100) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridCompoundFuture.apply(GridCompoundFuture.java:47) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.notifyListener(GridFutureAdapter.java:399) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.unblock(GridFutureAdapter.java:347) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.unblockAll(GridFutureAdapter.java:335) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.onDone(GridFutureAdapter.java:511) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.onDone(GridFutureAdapter.java:490) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.onDone(GridFutureAdapter.java:478) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.lambda$wrapIgniteFuture$3(IgniteUtils.java:11719) [21:01:45]W: [org.apache.ignite:ignite-core] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [21:01:45]W: [org.apache.ignite:ignite-core] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [21:01:45]W: [org.apache.ignite:ignite-core] at java.lang.Thread.run(Thread.java:748) [21:01:45]W: [org.apache.ignite:ignite-core] Caused by: class org.apache.ignite.IgniteException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:45]W: [org.apache.ignite:ignite-core] apache.ignite.internal.util.future.GridCompoundFuture.apply(GridCompoundFuture.java:100) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridCompoundFuture.apply(GridCompoundFuture.java:47) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.notifyListener(GridFutureAdapter.java:399) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.unblock(GridFutureAdapter.java:347) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.unblockAll(GridFutureAdapter.java:335) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.onDone(GridFutureAdapter.java:511) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.onDone(GridFutureAdapter.java:490) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.onDone(GridFutureAdapter.java:478) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.lambda$wrapIgniteFuture$3(IgniteUtils.java:11719) [21:01:45]W: [org.apache.ignite:ignite-core] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [21:01:45]W: [org.apache.ignite:ignite-core] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [21:01:45]W: [org.apache.ignite:ignite-core] ... 1 more [21:01:45]W: [org.apache.ignite:ignite-core] Caused by: class org.apache.ignite.IgniteException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.lambda$syncMetadata$2(GridCacheOffheapManager.java:381) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.lambda$wrapIgniteFuture$3(IgniteUtils.java:11714) [21:01:45]W: [org.apache.ignite:ignite-core] ... 3 more [21:01:45]W: [org.apache.ignite:ignite-core] Caused by: class org.apache.ignite.internal.processors.cache.persistence.StorageException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.filehandle.FileWriteHandleImpl.checkNode(FileWriteHandleImpl.java:208) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.filehandle.FileWriteHandleImpl.addRecord(FileWriteHandleImpl.java:235) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager.log(FileWriteAheadLogManager.java:910) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager.log(FileWriteAheadLogManager.java:863) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.doInitPage(PageHandler.java:471) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.writePage(PageHandler.java:307) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.initPage(PageHandler.java:244) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.DataStructure.init(DataStructure.java:425) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.addStripe(PagesList.java:623) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.getPageForPut(PagesList.java:754) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.put(PagesList.java:859) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList$PutBucket.run(PagesList.java:199) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList$PutBucket.run(PagesList.java:173) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.writePage(PageHandler.java:313) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.DataStructure.write(DataStructure.java:304) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.flushBucketsCache(PagesList.java:415) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.saveMetadata(PagesList.java:356) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.saveStoreMetadata(GridCacheOffheapManager.java:403) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cach at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.lambda$syncMetadata$2(GridCacheOffheapManager.java:381) [21:01:45]W: [org.apache.ignite:ignite-core] 1 at org.apache.ignite.internal.util.IgniteUtils.lambda$wrapIgniteFuture$3(IgniteUtils.java:11714) [21:01:45]W: [org.apache.ignite:ignite-core] .e.. 3 more [21:01:45]W: [org.apache.ignite:ignite-core] Caused by: class org.apache.ignite.internal.processors.cache.persistence.StorageException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.filehandle.FileWriteHandleImpl.checkNode(FileWriteHandleImpl.java:208) [21:01:45]W: [org.apache.ignite:ignite-core] at o:rg.apache.ignite.internal.processors.cache.persistence.wal.filehandle.FileWriteHandleImpl.addRecord(FileWriteHandleImpl.java:235) [21:01:45]W: [org.apache.ignite:ignite-core] at org.aptache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager.log(FileWriteAheadLogManager.java:910) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager.log(FileWriteAheadLogManager.java:863) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.doInitPage(PageHandler.java:471) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.writePage(PageHandler.java:307) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.initPage(PageHandler.java:244) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.DataStructure.init(DataStructure.java:425) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.addStripe(PagesList.java:623) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.getPageForPut(PagesList.java:754) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.put(PagesList.java:859) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList$PutBucket.run(PagesList.java:199) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList$PutBucket.run(PagesList.java:173) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.writePage(PageHandler.java:313) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.DataStructure.write(DataStructure.java:304) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.flushBucketsCache(PagesList.java:415) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.saveMetadata(PagesList.java:356) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.saveStoreMetadata(GridCacheOffheapManager.java:403) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.lambda$syncMetadata$2(GridCacheOffheapManager.java:378) [21:01:45]W: [org.apache.ignite:ignite-core] ... 4 more [21:01:45]W: [org.apache.ignite:ignite-core] Exception in thread "checkpoint-runner-cpu-#1063%failure.IoomFailureHandlerTest1%" class org.apache.ignite.IgniteException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.lambda$syncMetadata$2(GridCacheOffheapManager.java:381) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.lambda$wrapIgniteFuture$3(IgniteUtils.java:11714) [21:01:45]W: [org.apache.ignite:ignite-core] [ at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [21:01:45]W: [org.apache.ignite:ignite-core] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [21:01:45]W: [org.apache.ignite:ignite-core] at java.lang.Thread.run(Thread.java:748) [21:01:45]W: [org.apache.ignite:ignite-core] ption in thread "checkpoint-runner-cpu-#1062%failure.IoomFailureHandlerTest1%" Caused by: class org.apache.ignite.internal.processors.cache.persistence.StorageException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.filehandle.FileWriteHandleImpl.checkNode(FileWriteHandleImpl.java:208) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.filehandle.FileWriteHandleImpl.addRecord(FileWriteHandleImpl.java:235) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager.log(FileWriteAheadLogManager.java:910) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager.log(FileWriteAheadLogManager.java:863) [21:01:45]W: [org.apache.ignite:ignite-core] at lorg.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.doInitPage(PageHandler.java:471) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.i2nternal.processors.cache.persistence.tree.util.PageHandler.writePage(PageHandler.java:307) [21:01:45]W: [org.apache.ignite:ignite-core] hat org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.initPage(PageHandler.java:244) [21:01:45]W: [org.apache.ignite:ignite-core] 01:45] (err) Failed to e at org.apache.ignite.internal.processors.cache.persistence.DataStructure.init(DataStructure.java:425) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.addStripe(PagesList.java:623) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.getPageForPut(PagesList.java:754) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.put(PagesList.java:859) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList$PutBucket.run(PagesList.java:199) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList$PutBucket.run(PagesList.java:173) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.writePage(PageHandler.java:313) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.DataStructure.write(DataStructure.java:304) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.flushBucketsCache(PagesList.java:415) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.saveMetadata(PagesList.java:356) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.saveStoreMetadata(GridCacheOffheapManager.java:403) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.lambda$syncMetadata$2(GridCacheOffheapManager.java:378) [21:01:45]W: [org.apache.ignite:ignite-core] ... 4 more [21:01:45]W: [org.apache.ignite:ignite-core] class org.apache.ignite.internal.mem.IgniteOutOfMemoryException: Out of memory in data region [name=dfltPlc, initSize=10.0 MiB, maxSize=10.0 MiB, persistenceEnabled=true] Try the following: [21:01:45]W: [org.apache.ignite:ignite-core] ^-- Increase maximum off-heap memory size (DataRegionConfiguration.maxSize) [21:01:45]W: [org.apache.ignite:ignite-core] ^-- Enable eviction or expiration policies [21:01:45]W: [org.apache.ignite:ignite-core] a.t org.apache.ignite.internal.processors.cache.persistence.pagemem.PageMemoryImpl.allocatePage(PageMemoryImpl.java:645) [21:01:45]W: [org.apache.ignite:ignite-core] at: org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager$GridCacheDataStore$1.allocatePageNoReuse(GridCacheOffheapManager.java:2049) [21:01:45]W: [org.apache.ignite:ignite-core] at org.axpache.ignite.internal.processors.cache.persistence.DataStructure.allocatePage(DataStructure.java:177) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.addStripe(PagesList.java:621) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.getPageForPut(PagesList.java:754) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.put(PagesList.java:859) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList$PutBucket.run(PagesList.java:199) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList$PutBucket.run(PagesList.java:173) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.writePage(PageHandler.java:313) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.DataStructure.write(DataStructure.java:304) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.flushBucketsCache(PagesList.java:415) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.saveMetadata(PagesList.java:356) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.saveStoreMetadata(GridCacheOffheapManager.java:403) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.lambda$syncMetadata$2(GridCacheOffheapManager.java:378) [21:01:45]W: [org.apache.ignite:ignite-core] r at org.apache.ignite.internal.util.IgniteUtils.lambda$wrapIgniteFuture$3(IgniteUtils.java:11714) [21:01:45]W: [org.apache.ignite:ignite-core] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [21:01:45]W: [org.apache.ignite:ignite-core] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [21:01:45]W: [org.apache.ignite:ignite-core] at java.lang.Thread.run(Thread.java:748) [21:01:45]W: [org.apache.ignite:ignite-core] Caused by: class org.apache.ignite.internal.mem.IgniteOutOfMemoryException: Failed to find a page for eviction (no pages to replace) [segmentCapacity=1250, loaded=481, maxDirtyPages=360, dirtyPages=481, cpPages=0, pinned=0] [21:01:45]W: [org.apache.ignite:ignite-core] Out of memory in data region [name=dfltPlc, initSize=10.0 MiB, maxSize=10.0 MiB, persistenceEnabled=true] Try the following: [21:01:45]W: [org.apache.ignite:ignite-core] ^-- Increase maximum off-heap memory size (DataRegionConfiguration.maxSize) [21:01:45]W: [org.apache.ignite:ignite-core] ^-- Enable eviction or expiration policies [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.pagemem.PageMemoryImpl$Segment.oomException(PageMemoryImpl.java:2345) [21:01:45]W: [org.apache.ignite:ignite-core] 1 at org.apache.ignite.internal.processors.cache.persistence.pagemem.ClockPageReplacementPolicy.replace(ClockPageReplacementPolicy.java:94) [21:01:45]W: [org.apache.ignite:ignite-core] , at org.apache.ignite.internal.processors.cache.persistence.pagemem.PageMemoryImpl$Segment.removePageForReplacement(PageMemoryImpl.java:2322) [21:01:45]W: [org.apache.ignite:ignite-core] at o:rg.apache.ignite.internal.processors.cache.persistence.pagemem.PageMemoryImpl$Segment.access$900(PageMemoryImpl.java:1962) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apaeche.ignite.internal.processors.cache.persistence.pagemem.PageMemoryImpl.allocatePage(PageMemoryImpl.java:587) [21:01:45]W: [org.apache.ignite:ignite-core] ... 17 more [21:01:45]W: [org.apache.ignite:ignite-core] ecute compound future reducer: GridCompoundFuture [rdc=null, initFlag=1, lsnrCalls=7, size=603, done=true, cancelled=false, err=class o.a.i.IgniteCheckedException: Failed to perform WAL operation (environment was invalidated by a previous error), futs=TransformCollectionView [true, true, true, true, true, true, true, true, true, true, true, false, false, false, fals45] (err) Failed to execute compound future reducer: GridCompoundFuture [rdc=null, initFlag=1, lsnrCalls=6, size=603, done=true, cancelled=false, err=class o.a.i.IgniteCheckedException: Failed to perform WAL operation (environment was invalidated by a previous error), futs=TransformCollectionView [true, true, true, true, true, true, true, true, true, true, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false... and 503 more]]class org.apache.ignite.IgniteCheckedException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.cast(IgniteUtils.java:7773) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.resolve(GridFutureAdapter.java:260) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.get0(GridFutureAdapter.java:172) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.get(GridFutureAdapter.java:141) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridCompoundFuture.apply(GridCompoundFuture.java:100) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridCompoundFuture.apply(GridCompoundFuture.java:47) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.notifyListener(GridFutureAdapter.java:399) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.unblock(GridFutureAdapter.java:347) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.unblockAll(GridFutureAdapter.java:335) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.onDone(GridFutureAdapter.java:511) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.onDone(GridFutureAdapter.java:490) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.onDone(GridFutureAdapter.java:478) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.lambda$wrapIgniteFuture$3(IgniteUtils.java:11719) [21:01:45]W: [org.apache.ignite:ignite-core] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [21:01:45]W: [org.apache.ignite:ignite-core] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [21:01:45]W: [org.apache.ignite:ignite-core] at java.lang.Thread.run(Thread.java:748) [21:01:45]W: [org.apache.ignite:ignite-core] Caused by: class org.apache.ignite.IgniteException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.lambda$syncMetadata$2(GridCacheOffheapManager.java:381) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.lambda$wrapIgniteFuture$3(IgniteUtils.java:11714) [21:01:45]W: [org.apache.ignite:ignite-core] ... 3 more [21:01:45]W: [org.apache.ignite:ignite-core] Caused by: class org.apache.ignite.internal.processors.cache.persistence.StorageException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.filehandle.FileWriteHandleImpl.checkNode(FileWriteHandleImpl.java:208) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.filehandle.FileWriteHandleImpl.addRecord(FileWriteHandleImpl.java:235) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager.log(FileWriteAheadLogManager.java:910) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager.log(FileWriteAheadLogManager.java:863) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.doInitPage(PageHandler.java:471) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.writePage(PageHandler.java:307) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.initPage(PageHandler.java:244) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.DataStructure.init(DataStructure.java:425) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.addStripe(PagesList.java:623) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.getPageForPut(PagesList.java:754) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.put(PagesList.java:859) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList$PutBucket.run(PagesList.java:199) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList$PutBucket.run(PagesList.java:173) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.writePage(PageHandler.java:313) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.DataStructure.write(DataStructure.java:304)e [21:01:45]W: [org.apache.ignite:ignite-core] p a,t org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.flushBucketsCache(PagesList.java:415) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.saveMetadata(PagesList.java:356) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.saveStoreMetadata(GridCacheOffheapManager.java:403) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.lambda$syncMetadata$2(GridCacheOffheapManager.java:378) [21:01:45]W: [org.apache.ignite:ignite-core] ... 4 more [21:01:45]W: [org.apache.ignite:ignite-core] ad "checkpoint-runner-cpu-#1061%failure.IoomFailureHandlerTest1%" class org.apache.ignite.IgniteException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.lambda$syncMetadata$2(GridCacheOffheapManager.java:381) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.lambda$wrapIgniteFuture$3(IgniteUtils.java:11714) [21:01:45]W: [org.apache.ignite:ignite-core] 0 at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [21:01:45]W: [org.apache.ignite:ignite-core] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [21:01:45]W: [org.apache.ignite:ignite-core] Eat java.lang.Thread.run(Thread.java:748) [21:01:45]W: [org.apache.ignite:ignite-core] 1:45] (errCaused by: class org.apache.ignite.internal.processors.cache.persistence.StorageException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.filehandle.FileWriteHandleImpl.checkNode(FileWriteHandleImpl.java:208) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.filehandle.FileWriteHandleImpl.addRecord(FileWriteHandleImpl.java:235) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager.log(FileWriteAheadLogManager.java:910) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager.log(FileWriteAheadLogManager.java:863) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.doInitPage(PageHandler.java:471) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.writePage(PageHandler.java:307) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.initPage(PageHandler.java:244) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.DataStructure.init(DataStructure.java:425) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.addStripe(PagesList.java:623) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.getPageForPut(PagesList.java:754) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.put(PagesList.java:859) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList$PutBucket.run(PagesList.java:199) [21:01:45]W: [org.apache.ignite:ignite-core] ate org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList$PutBucket.run(PagesList.java:173) [21:01:45]W: [org.apache.ignite:ignite-core] f at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.writePage(PageHandler.java:313) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.DataStructure.write(DataStructure.java:304) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.flushBucketsCache(PagesList.java:415) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.saveMetadata(PagesList.java:356) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.saveStoreMetadata(GridCacheOffheapManager.java:403) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.lambda$syncMetadata$2(GridCacheOffheapManager.java:378) [21:01:45]W: [org.apache.ignite:ignite-core] ... 4 more [21:01:45]W: [org.apache.ignite:ignite-core] [21:) Faileiniarsistenc01:45] (err) Failed to execute compound future reducer: GridCompoundFuture [rdc=null, initFlag=1, lsnrCalls=9, size=603, done=true, cancelled=false, err=class o.a.i.IgniteCheckedException: Failed to perform WAL operation (environment was invalidated by a previous error), futs=TransformCollectionView [true, true, true, true, true, true, true, true, true, true, true, true, true, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false... and 503 more]]class org.apache.ignite.IgniteCheckedException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.cast(IgniteUtils.java:7773) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.resolve(GridFutureAdapter.java:260) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.get0(GridFutureAdapter.java:172) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.get(GridFutureAdapter.java:141) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridCompoundFuture.apply(GridCompoundFuture.java:100) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridCompoundFuture.apply(GridCompoundFuture.java:47) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.notifyListener(GridFutureAdapter.java:399) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.unblock(GridFutureAdapter.java:347) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.unblockAll(GridFutureAdapter.java:335) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.onDone(exltdGridFutureAdapter.java:511) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.onDone(GridFutureAdapter.java:490) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.onDone(GridFutureAdapter.java:478) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.lambda$wrapIgniteFuture$3(IgniteUtils.java:11719) [21:01:45]W: [org.apache.ignite:ignite-core] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [21:01:45]W: [org.apache.ignite:ignite-core] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [21:01:45]W: [org.apache.ignite:ignite-core] at java.lang.Thread.run(Thread.java:748) [21:01:45]W: [org.apache.ignite:ignite-core] Caused by: class org.apache.ignite.IgniteException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.lambda$syncMetadata$2(GridCacheOffheapManager.java:381) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.lambda$wrapIgniteFuture$3(IgniteUtils.java:11714) [21:01:45]W: [org.apache.ignite:ignite-core] ... 3 more [21:01:45]W: [org.apache.ignite:ignite-core] Caused by: class org.apache.ignite.internal.processors.cache.persistence.StorageException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.filehandle.FileWriteHandleImpl.checkNode(FileWriteHandleImpl.java:208) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.filehandle.FileWriteHandleImpl.addRecord(FileWriteHandleImpl.java:235) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager.log(FileWriteAheadLogManager.java:910) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager.log(FileWriteAheadLogManager.java:863) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.doInitPage(PageHandler.java:471) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.writePage(PageHandler.java:307) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.initPage(PageHandler.java:244) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.DataStructure.init(DataStructure.java:425) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.addStripe(PagesList.java:623) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.getPageForPut(PagesList.java:754) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.put(PagesList.java:859) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList$PutBucket.run(PagesList.java:199) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList$PutBucket.run(PagesList.java:173) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.writePage(PageHandler.java:313) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.DataStructure.write(DataStructure.java:304) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.flushBucketsCache(PagesList.java:415) [21:01:45]W: [org.apache.ignite:ignite-core] .GridCacheOffheapManager.lambda$syncMetadata$2(GridCacheOffheapManager.java:378) [21:01:45]W: [org.apache.ignite:ignite-core] ... 4 more [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.saveMetadata(PagesList.java:356) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.saveStoreMetadata(GridCacheOffheapManager.java:403) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.lambda$syncMetadata$2(GridCacheOffheapManager.java:378) [21:01:45]W: [org.apache.ignite:ignite-core] ... 4 more [21:01:45]W: [org.apache.ignite:ignite-core] [2021-11-19 21:01:45,713][ERROR][sys-stripe-7-#917%failure.IoomFailureHandlerTest1%][GridNearTxLocal] Failed completing the transaction: [commit=true, tx=GridDhtTxLocal [nearNodeId=9d5c1368-d764-4b5a-a895-4879ea800000, nearFutId=c91ac593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, nearMiniId=1, nearFinFutId=null, nearFinMiniId=0, nearXidVer=GridCacheVersion [topVer=248824893, order=1637344893064, nodeOrder=1], lb=null, super=GridDhtTxLocalAdapter [nearOnOriginatingNode=false, span=o.a.i.i.processors.tracing.NoopSpan@61742ff0, nearNodes=KeySetView [], dhtNodes=KeySetView [], explicitLock=false, super=IgniteTxLocalAdapter [completedBase=null, sndTransformedVals=false, depEnabled=false, txState=IgniteTxStateImpl [activeCacheIds=[1544803905], recovery=false, mvccEnabled=false, mvccCachingCacheIds=[], txMap=ArrayList [IgniteTxEntry [txKey=IgniteTxKey [key=KeyCacheObjectImpl [part=3, val=3, hasValBytes=true], cacheId=1544803905], val=TxEntryValueHolder [val=CacheObjectByteArrayImpl [arrLen=1364], op=CREATE], prevVal=TxEntryValueHolder [val=null, op=NOOP], oldVal=TxEntryValueHolder [val=null, op=NOOP], entryProcessorsCol=null, ttl=-1, conflictExpireTime=-1, conflictVer=null, explicitVer=null, dhtVer=null, filters=CacheEntryPredicate[] [], filtersPassed=false, filtersSet=false, entry=GridDhtCacheEntry [rdrs=ReaderId[] [], part=3, super=GridDistributedCacExcep to execuse, falsFlage, falception in thread "checkpoint-runner-cpu-#1065%failure.IoomFailureHandlerTest1%" class org.apache.ignite.IgniteException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.lambda$syncMetadata$2(GridCacheOffheapManager.java:381) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.lambda$wrapIgniteFuture$3(IgniteUtils.java:11714) [21:01:45]W: [org.apache.ignite:ignite-core] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [21:01:45]W: [org.apache.ignite:ignite-core] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [21:01:45]W: [org.apache.ignite:ignite-core] at java.lang.Thread.run(Thread.java:748) [21:01:45]W: [org.apache.ignite:ignite-core] Caused by: class org.apache.ignite.internal.processors.cache.persistence.StorageException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.filehandle.FileWriteHandleImpl.checkNode(FileWriteHandleImpl.java:208) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.filehandle.FileWriteHandleImpl.addRecord(FileWriteHandleImpl.java:235) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager.log(FileWriteAheadLogManager.java:910) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persisthesnce.wal.FileWriteAheadLogManager.log(FileWriteAheadLogManager.java:863) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.doInitPage(PageHandler.java:471) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.writePage(PageHandler.java:307) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.initPage(PageHandler.java:244) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.DataStructure.init(DataStructure.java:425) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.addStripe(PagesList.java:623) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.getPageForPut(PagesList.java:754) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.put(PagesList.java:t=t859) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList$PutBucket.run(PagesList.java:199) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList$PutBucket.run(PagesList.java:173) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.writePage(PageHandler.java:313) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.DataStructure.write(DataStructure.java:304) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.flushBucketsCache(PagesList.java:415) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.saveMetadata(PagesList.java:356) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.saveStoreMetadata(GridCacheOffheapManager.java:403) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.lambda$syncMetadata$2(GridCacheOffheapManager.java:378) [21:01:45]W: [org.apache.ignite:ignite-core] ... 4 more [21:01:45]W: [org.apache.ignite:ignite-core] [21:01:45] (err) Failed to execute compound future reducer: GridCompoundFuture [rdc=null, initFlag=1, lsnrCalls=10, size=603, done=true, cancelled=false, err=class o.a.i.IgniteCheckedException: Failed to perform WAL operation (environment was invalidated by a previous error), futs=TransformCollectionView [true, true, true, true, true, true, true, true, true, true, true, true, true, true, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false... and 503 more]]class org.apache.ignite.IgniteCheckedException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.cast(IgniteUtils.java:7773) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.resolve(GridFutureAdapter.java:260) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.get0(GridFutureAdapter.java:172) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.get(GridFutureAdapter.java:141) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridCompoundFuture.apply(GridCompoundFuture.java:100) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridCompoundFuture.apply(GridCompoundFuture.java:47) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.notifyListener(GridFutureAdapter.java:399) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.unblock(GridFutureAdapter.java:347) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.unblockAll(GridFutureAdapter.java:335) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.onDone(GridFutureAdapter.java:511) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.onDone(GridFutureAdapter.java:490) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.onDone(GridFutureAdapter.java:478) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.lambda$wrapIgniteFuture$3(IgniteUtils.java:11719) [21:01:45]W: [org.apache.ignite:ignite-core] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [21:01:45]W: [org.apache.ignite:ignite-core] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [21:01:45]W: [org.apache.ignite:ignite-core] at java.lang.Thread.run(Thread.java:748) [21:01:45]W: [org.apache.ignite:ignite-core] Caused by: class org.apache.ignite.IgniteException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:45]W: [org.apache.ignite:ignite-core] ion in thread "checkpoint-runner-cpu-#1068%failure.IoomFailureHandlerTest1%" 1, ee c, false, at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.lambda$syncMetadata$2(GridCacheOffheapMalnager.java:381) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.lambda$wrapIgniteFouture$3(IgniteUtils.java:11714) [21:01:45]W: [org.apache.ignite:ignite-core] ... 3 meore [21:01:45]W: [org.apache.ignite:ignite-core] mpos false, false, falseund fCa,Enused by: class org.apache.ignite.internal.processors.cache.persistence.StorageException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.filehandle.FileWriteHandleImpl.checkNode(FileWriteHandleImpl.java:208) [21:01:45]W: [org.apache.ignite:ignite-core] art org.apache.ignite.internal.processors.cache.persistence.wal.filehandle.FileWriteHandleImpl.addRecord(FileWriteHandleImpl.java:235) [21:01:45]W: [org.apache.ignite:ignite-core] ntry [super=GridCacheMapEntry [key=KeyCacheObjectImpl [part=3, val=3, hasValBytes=true], val=null, ver=GridCacheVersion [topVer fauture reducer: GridCompoundFuture [rdc=null, initFlag=1, lsnrCalls=8, size=603, done=true, cancelled=false, err=class o.a.i.IgniteCheckedException: Failed to pe=248824 atrlC org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager.log(FileWriteAheadLogManager.java:910) [21:01:45]W: [org.apache.ignite:ignite-core] alls=5, size=603, done=true, cancelled=false, err=class o.a.i.Ignitse, fal at org.eapache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager.log(FileWriteAheadLogManager.java:863) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.doInitPage(PageHandler.java:471) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.writePage(PageHandler.java:307) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.initPage(PageHandler.java:244) [21:01:45]W: [org.apache.ignite:ignite-core] at org.fapache.ignite.internal.processors.cache.persistence.DataStructure.init(DataStructure.java:425) [21:01:45]W: [org.apache.ignite:ignite-core] at org8.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.addStripe(PagesList.java:623) [21:01:45]W: [org.apache.ignite:ignite-core] at orgo.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.getPageForPut(PagesList.java:754) [21:01:45]W: [org.apache.ignite:ignite-core] aCt org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.put(PagesList.java:859) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList$PutBucket.run(PagesList.java:199) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList$PutBucket.run(PagesList.java:173) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.writePage(PageHandler.java:313) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.DataStructure.write(DataStructure.java:304) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.flushBucketsCache(PagesList.java:415) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.saveMetadata(PagesList.java:356) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.saveStoreMetadata(GridCacheOffheapManager.java:403) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.lambda$syncMetadata$2(GridCacheOffheapManager.java:378) [21:01:45]W: [org.apache.ignite:ignite-core] ... 4 more [21:01:45]W: [org.apache.ignite:ignite-core] class org.apache.ignite.IgniteException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.lambda$syncMetadata$2(GridCacheOffheapManager.java:381) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.lambda$wrapIgniteFuture$3(IgniteUtils.java:11714) [21:01:45]W: [org.apache.ignite:ignite-core] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [21:01:45]W: [org.apache.ignite:ignite-core] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [21:01:45]W: [org.apache.ignite:ignite-core] at java.lang.Thread.run(Thread.java:748) [21:01:45]W: [org.apache.ignite:ignite-core] Caused by: class org.apache.ignite.internal.processors.cache.persistence.StorageException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.filehandle.FileWriteHandleImpl.checkNode(FileWriteHandleImpl.java:208) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.filehandle.FileWriteHandleImpl.addRecord(FileWriteHandleImpl.java:235) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager.log(FileWriteAheadLogManager.java:910) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager.log(FileWriteAheadLogManager.java:863) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.doInitPage(PageHandler.java:471) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.writePage(PageHandler.java:307) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.initPage(PageHandler.java:244) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.DataStructure.init(DataStructure.java:425) [21:01:45]W: [org.apache.ignite:ignite-core] s at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.addStripe(PagesList.java:623) [21:01:45]W: [org.apache.ignite:ignite-core] aht org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.getPageForPut(PagesList.java:754) [21:01:45]W: [org.apache.ignite:ignite-core] rat org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.put(PagesList.java:859) [21:01:45]W: [org.apache.ignite:ignite-core] 93, order=1637344893065, nodeOrder=2], hash=3, extras=GridCacheObsoleteEntryExtras [obsoleteVer=GridCacheVersion [topVer=2147483647, order=0, nodeOrder=0]], flags=2]]], prepared=0, locked=false, nodeId=null, locMapped=false, expiryPlc=null, transferExpiryPlc=false, flags=0, partUpdateCntr=1, serReadVer=null, xidVer=GridCacheVersion [topVer=248824893, order=1637344893065, nodeOrder=2]], IgniteTxEntry [txKey=IgniteTxKey [key=KeyCacheObjectImpl [part=7, val=7, hasValBytes=true], cacheId=1544803905], val=TxEntryValueHolder [val=CacheObjectByteArrayImpl [arrLen=1364], op=CREATE], prevVal=TxEntryValueHolder [val=null, op=NOOP], oldVal=TxEntryValueHolder [val=null, op=NOOP], entryProcessorsCol=null, ttl=-1, conflictExpireTime=-1, conflictVer=null, explicitVer=null, dhtVer=null, filters=CacheEntryPredicate[] [], filtersPassed=false, filtersSet=false, entry=GridDhtCacheEntry [rdrs=ReaderId[] [], part=7, super=GridDistributedCacheEntry [super=GridCacheMapEntry [key=KeyCacheObjectImpl [part=7, val=7, hasValBytes=true], val=null, ver=GridCacheVersion [topVer=248824893, order=1637344893065, nodeOrder=2], hash=7, extras=GridCacheObsoleteEntryExtras [obsoleteVer=GridCacheVersion [topVer=2147483647, order=0, nodeOrder=0]], flags=2]]], prepared=0, locked=false, nodeId=null, locMappedm=false, expiryPlc=null, transferExpiryPlc=false, flags=0, partUpdateCntr=1, serReadVer=null, xidVer=Grid WAL opeCee at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList$PutBucket.run(PagesList.java:199) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList$PutBucket.run(PagesList.java:173) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.writePage(PageHandler.java:313) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.DataStructure.write(DataStructure.java:304) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.flushBucketsCache(PagesList.java:415) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.saveMetadata(PagesList.java:356) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.saveStoreMetadata(GridCacheOffheapManager.java:403) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.lambda$syncMetadata$2(GridCacheOffheapManager.java:378) [21:01:45]W: [org.apache.ignite:ignite-core] ... 4 more [21:01:45]W: [org.apache.ignite:ignite-core] Exception ckedE, afaxin thread "checkpoint-runner-cpu-#1069%failure.IoomFailureHandlerTest1%" class org.apache.ignite.IgniteException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:45]W: [org.apache.ignite:ignite-core] rclcat org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.lambda$syncMetadata$2(GridCacheOffheapManager.java:381) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.lambda$wrapIgniteFuture$3(IgniteUtils.java:11714) [21:01:45]W: [org.apache.ignite:ignite-core] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [21:01:45]W: [org.apache.ignite:ignite-core] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [21:01:45]W: [org.apache.ignite:ignite-core] at java.lang.Thread.run(Thread.java:748) [21:01:45]W: [org.apache.ignite:ignite-core] Caused by: class org.apache.ignite.internal.processors.cache.persistence.StorageException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.filehandle.FileWriteHandleImpl.checkNode(FileWriteHandleImpl.java:208) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.filehandle.FileWriteHandleImpl.addRecord(FileWriteHandleImpl.java:235) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager.log(FileWriteAheadLogManager.java:910) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager.log(FileWriteAheadLogManager.java:863) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.doInitPage(PageHandler.java:471) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.writePage(PageHandler.java:307) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.initPage(PageHandler.java:244) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.DataStructure.init(DataStructure.java:425) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.addStripe(PagesList.java:623) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.getPageForPut(PagesList.java:754) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.put(PagesList.java:859) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList$PutBucket.run(PagesList.java:199) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList$PutBucket.run(PagesList.java:173) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.writePage(PageHandler.java:313) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.DataStructure.write(DataStructure.java:304) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.flushBucketsCache(PagesList.java:415) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.saveMetadata(PagesList.java:356) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.saveStoreMetadata(GridCacheOffheapManager.java:403) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.lambda$syncMetadata$2(GridCacheOffheapManager.java:378) [21:01:45]W: [org.apache.ignite:ignite-core] ... 4 more [21:01:45]W: [org.apache.ignite:ignite-core] [heVe21:01rsioeption: Faile:45] (err) Fse, faaild to peration (envirn [onmeform WAL operation (environment was invalidated by a previous error), futs=TransformCollectionView [true, true, true, true, true, true, true, true, true, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false... and 503 more]]class org.apache.ignite.IgniteCheckedException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.cast(IgniteUtils.java:7773) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.resolve(GridFutureAdapter.java:260) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.get0(GridFutureAdapter.java:172) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.get(GridFutureAdapter.java:141) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridCompoundFuture.apply(GridCompoundFuture.java:100) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridCompoundFuture.apply(GridCompoundFuture.java:47) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.futelure.GntridFutureAdapter.notifyListener(GridFutureAdapter.java:399) [21:01:45]W: [org.apache.ignite:ignite-core] o at org.apache.ignite.internal.util.future.GridFutureAdapter.unblock(GridFutureAdapter.java:347) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.unblockAll(GridFutureAdapter.java:335) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.onDone(GridFutureAdapter.java:511) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.onDone(GridFutureAdapter.java:490) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.onDone(GridFutureAdapter.java:478) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.lambda$wrapIgniteFuture$3(IgniteUtils.java:11719) [21:01:45]W: [org.apache.ignite:ignite-core] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [21:01:45]W: [org.apache.ignite:ignite-core] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [21:01:45]W: [org.apache.ignite:ignite-core] at java.lang.Thread.run(Thread.java:748) [21:01:45]W: [org.apache.ignite:ignite-core] Caused by: class org.apache.ignite.IgniteException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.lambda$syncMetadata$2(GridCacheOffheapManager.java:381) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.lambda$wrapIgniteFuture$3(IgniteUtils.java:11714) [21:01:45]W: [org.apache.ignite:ignite-core] ... 3 more [21:01:45]W: [org.apache.ignite:ignite-core] Caused by: class org.apache.ignite.internal.processors.cache.persistence.StorageException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.filehandle.FileWriteHandleImpl.checkNode(FileWriteHandleImpl.java:208) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.filehandle.FileWriteHandleImpl.addRecord(FileWriteHandleImpl.java:235) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager.log(FileWriteAheadLogManager.java:910) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager.log(FileWriteAheadLogManager.java:863) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.doInitPage(PageHandler.java:471) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.writePage(PageHandler.java:307) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.initPage(PageHandler.java:244) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.DataStructure.init(DataStructure.java:425) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.addStripe(PagesList.java:623) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.getPageForPut(PagesList.java:754) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.put(PagesList.java:859) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList$PutBucket.run(PagesList.java:199) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList$PutBucket.run(PagesList.java:173) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.writePage(PageHandler.java:313) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.DataStructure.write(DataStructure.java:304) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.flushBucketsCache(PagesList.java:415) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.saveMetadata(PagesList.java:356) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.saveStoreMetadata(GridCacheOffheapManager.java:403) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.lambda$syncMetadata$2(GridCacheOffheapManager.java:378) [21:01:45]W: [org.apache.ignite:ignite-core] ... 4 more [21:01:45]W: [org.apache.ignite:ignite-core] Exception in thread "checkpoint-runner-cpu-#1064%failure.IoomFailureHandlerTest1%" class org.apache.ignite.IgniteException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.lambda$syncMetadata$2(GridCacheOffheapManager.java:381) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.lambda$wrapIgniteFuture$3(IgniteUtils.java:11714) [21:01:45]W: [org.apache.ignite:ignite-core] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [21:01:45]W: [org.apache.ignite:ignite-core] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [21:01:45]W: [org.apache.ignite:ignite-core] at java.lang.Thread.run(Thread.java:748) [21:01:45]W: [org.apache.ignite:ignite-core] Caused by: class org.apache.ignite.internal.processors.cache.persistence.StorageException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.filehandle.FileWriteHandleImpl.checkNode(FileWriteHandleImpl.java:208) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.filehandle.FileWriteHandleImpl.addRecord(FileWriteHandleImpl.java:235) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager.log(FileWriteAheadLogManager.java:910) [21:01:45]W: [org.apache.ignite:ignite-core] at org.tapache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager.log(FileWriteAheadLogManager.java:863) [21:01:45]W: [org.apache.ignite:ignite-core] sat org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.doInitPage(PageHandler.java:471) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.writePage(PageHandler.java:307) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.initPage(PageHandler.java:244) [21:01:45]W: [org.apache.ignite:ignite-core] at ordg.apache.ignite.internal.processors.cache.persistence.DataStructure.init(DataStructure.java:425) [21:01:45]W: [org.apache.ignite:ignite-core] e at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.addStripe(PagesList.java:623) [21:01:45]W: [org.apache.ignite:ignite-core] at org.a pache.ignite.internal.processors.cache.persistence.freelist.PagesList.getPageForPut(PagesList.java:754) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.put(PagesList.java:859) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apa[che.ignite.internal.processors.cache.persistence.freelist.PagesList$PutBucket.run(PagesList.java:199) [21:01:45]W: [org.apache.ignite:ignite-core] pVer=248824893, order=16373244893065, false, f atw1 ,org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList$PutBucket.run(PagesList.java:173) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.pers istence.tree.util.PageHandler.writePage(PageHandler.java:313) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.DataStructure.write(DataStructure.java:304) [21:01:45]W: [org.apache.ignite:ignite-core] :at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.flushBucketsCache(PagesList.java:415) [21:01:45]W: [org.apache.ignite:ignite-core] at orag.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.saveMetadata(PagesList.java:356) [21:01:45]W: [org.apache.ignite:ignite-core] a at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.saveStoreMetadata(GridCacheOffheapManager.java:403) [21:01:45]W: [org.apache.ignite:ignite-core] sat org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.lambda$syncMetadata$2(GridCacheOffheapManager.java:378) [21:01:45]W: [org.apache.ignite:ignite-core] 0... 4 more [21:01:45]W: [org.apache.ignite:ignite-core] nodetoO 1:45] (err) Failed to execute compound future reducer: GridCompoundFuture [rdc=null, initFlag=1, lsnrCalls=12, size=603, done=true, cancelled=false, err=class o.a.i.IgniteCheckedException: Failed to perform WAL operation (environment was invalidate invalslidatede, false, false, false, false, false, false, false, false, false, false, false, false, false, false, fald byexecute compound future reducer: GridCompoundFuture [rdc=nul ase, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false... and 503 more]]class org.apache.ignite.IgniteCheckedException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.cast(IgniteUtils.java:7773) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.resolve(GridFutureAdapter.java:260) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.get0(GridFutureAdapter.java:172) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.get(GridFutureAdapter.java:141) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridCompoundFuture.apply(GridCompoundFuture.java:100) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridCompoundFuture.apply(GridCompoundFuture.jablva:47) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.notifyListener(GridFutureAdapter.java:399) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.unblock(GridFutureAdapter.java:347) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.unblockAll(GridFutureAdapter.java:335) [21:01:45]W: [org.apache.ignite:ignite-core] rat org.apache.ignite.internal.util.future.GridFutureAdapter.onDone(GridFutureAdapter.java:511) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.onDone(GridFutureAdapter.java:490) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.onDone(GridFutureAdapter.java:478) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.lambda$wrapIgniteFuture$3(IgniteUtils.java:11719) [21:01:45]W: [org.apache.ignite:ignite-core] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [21:01:45]W: [org.apache.ignite:ignite-core] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [21:01:45]W: [org.apache.ignite:ignite-core] at java.lang.Thread.run(Thread.java:748) [21:01:45]W: [org.apache.ignite:ignite-core] , initFlag=1, lsnrCalls=11, size=603, done=true, cancelled=false, err=class o.a.i.IgniteCheckedException: Failed to perform WAL operation (environment was invalidated by a previous error), futs=TransformCollectionView [true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false... and 503 more]]Caused by: class org.apache.ignite.IgniteException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.lambda$syncMetadata$2(GridCacheOffheapManager.java:381) [21:01:45]W: [org.apache.ignite:ignite-core] aty org.apache.ignite.internal.util.IgniteUtils.lambda$wrapIgniteFuture$3(IgniteUtils.java:11714) [21:01:45]W: [org.apache.ignite:ignite-core] ... 3 more [21:01:45]W: [org.apache.ignite:ignite-core] a previous error), futs=TransformCollectionView [true, true, true, trueCaused by: class org.apache.ignite.internal.processors.cache.persistence.StorageException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:45]W: [org.apache.ignite:ignite-core] d at org.apache.ignite.internal.processors.cache.persistence.wal.filehandle.FileWriteHandleImpl.checkNode(FileWriteHandleImpl.java:208) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.filehandle.FileWriteHandleImpl.addRecord(FileWriteHandleImpl.java:235) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager.log(FileWriteAheadLogManager.java:910) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager.log(FileWriteAheadLogManager.java:863) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.doInitPage(PageHandler.java:471) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.writePage(PageHandler.java:307) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.initPage(PageHandler.java:244) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.DataStructure.init(DataStructure.java:425) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.addStripe(PagesList.java:623) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.getPageForPut(PagesList.java:754) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.put(PagesList.java:859) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList$PutBucket.run(PagesList.java:199) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList$PutBucket.run(PagesList.java:173) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.writePage(PageHandler.java:313) [21:01:45]W: [org.apache.ignite:ignite-core] ,at org.apache.ignite.internal.processors.cache.persistence.DataStructure.write(DataStructure.java:304) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.flushBucketsCache(PagesList.java:415) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.saveMetadata(PagesList.java:356) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.saveStoreMetadata(GridCacheOffheapManager.java:403) [21:01:45]W: [org.apache.ignite:ignite-core] pat org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.lambda$syncMetadata$2(GridCacheOffheapManager.java:378) [21:01:45]W: [org.apache.ignite:ignite-core] ... 4 more [21:01:45]W: [org.apache.ignite:ignite-core] class org.apache.ignite.IgniteCheckedException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.cast(IgniteUtils.java:7773) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.resolve(GridFutureAdapter.java:260) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.get0(GridFutureAdapter.java:172) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.get(GridFutureAdapter.java:141) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridCompoundFuture.apply(GridCompoundFuture.java:100) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridCompoundFuture.apply(GridCompoundFuture.java:47) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.notifyListener(GridFutureAdapter.java:399) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.unblock(GridFutureAdapter.java:347) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.unblockAll(GridFutureAdapter.java:335) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.onDone(GridFutureAdapter.java:511) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.onDone(GridFutureAdapter.java:490) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.onDone(GridFutureAdapter.java:478) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.lambda$wrapIgniteFuture$3(IgniteUtils.java:11719) [21:01:45]W: [org.apache.ignite:ignite-core] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [21:01:45]W: [org.apache.ignite:ignite-core] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [21:01:45]W: [org.apache.ignite:ignite-core] at java.lang.Thread.run(Thread.java:748) [21:01:45]W: [org.apache.ignite:ignite-core] Caused by: class org.apache.ignite.IgniteException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.lambda$syncMetadata$2(GridCacheOffheapManager.java:381) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.lambda$wrapIgniteFuture$3(IgniteUtils.java:11714) [21:01:45]W: [org.apache.ignite:ignite-core] ... 3 more [21:01:45]W: [org.apache.ignite:ignite-core] Caused by: class org.apache.ignite.internal.processors.cache.persistence.StorageException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.filehandle.FileWriteHandleImpl.checkNode(FileWriteHandleImpl.java:208) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.filehandle.FileWriteHandleImpl.addRecord(FileWriteHandleImpl.java:235) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager.log(FileWriteAheadLogManager.java:910) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager.log(FileWriteAheadLogManager.java:863) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.doInitPage(PageHandler.java:471) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.writePage(PageHandler.java:307) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.initPage(PageHandler.java:244) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.DataStructure.init(DataStructure.java:425) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.addStripe(PagesList.java:623) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.getPageForPut(PagesList.java:754) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.put(PagesList.java:859) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList$PutBucket.run(PagesList.java:199) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList$PutBucket.run(PagesList.java:173) [21:01:45]W: [org.apache.ignite:ignite-core] e at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.writePage(PageHandler.java:313) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.DataStructure.write(DataStructure.java:304) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.flushBucketsCache(PagesList.java:415) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.saveMetadata(PagesList.java:356) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.saveStoreMetadata(GridCacheOffheapManager.java:403) [21:01:45]W: [org.apache.ignite:ignite-core] r=2]true], IgniteTxEntry [txKey=IgniteTxKey, at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.lambda$syncMetadata$2(GridCacheOffheapManager.java:378) [21:01:45]W: [org.apache.ignite:ignite-core] ... 4 more [21:01:45]W: [org.apache.ignite:ignite-core] [21:01:45] (err) Failed to execute compound future reducer: GridCompoundFuture [rdc=null, initFlag=1, lsnrCalls=13, size=603, done=true, cancelled=false, err=class o.a.i.IgniteCheckedException: Failed to perform WAL operation (environment was invalidated by a previous error), futs=TransformCollectionView [true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, falExceptse, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false... and 503 more]]class org.apache.ignite.IgniteCheckedException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:45]W: [org.apache.ignite:ignite-core] ion in thread "checkpoint-run at org.apache.ignite.internal.util.IgniteUtils.cast(IgniteUtils.java:7773) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.resolve(GridFutureAdapter.java:260) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.get0(GridFutureAdapter.java:172) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.get(GridFutureAdapter.java:141) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridCompoundFuture.apply(GridCompoundFuture.java:100) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridCompoundFuture.apply(GridCompoundFuture.java:47) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.notifyListener(GridFutureAdapter.java:399) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.unblock(GridFutureAdapter.java:347) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.unblockAll(GridFutureAdapter.java:335) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.onDone(GridFutureAdapter.java:511) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.onDone(GridFutureAdapter.java:490) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.onDone(GridFutureAdapter.java:478) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.lambda$wrapIgniteFuture$3(IgniteUtils.java:11719) [21:01:45]W: [org.apache.ignite:ignite-core] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [21:01:45]W: [org.apache.ignite:ignite-core] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [21:01:45]W: [org.apache.ignite:ignite-core] r at java.lang.Thread.run(Thread.java:748) [21:01:45]W: [org.apache.ignite:ignite-core] Caused by: class org.apache.ignite.IgniteException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.lambda$syncMetadata$2(GridCacheOffheapManager.java:381) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.lambda$wrapIgniteFuture$3(IgniteUtils.java:11714) [21:01:45]W: [org.apache.ignite:ignite-core] ... 3 more [21:01:45]W: [org.apache.ignite:ignite-core] Caused by: class org.apache.ignite.internal.processors.cache.persistence.StorageException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.filehandle.FileWriteHandleImpl.checkNode(FileWriteHandleImpl.java:208) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.filehandle.FileWriteHandleImpl.addRecord(FileWriteHandleImpl.java:235) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager.log(FileWriteAheadLogManager.java:910) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager.log(FileWriteAheadLogManager.java:863) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.doInitPage(PageHandler.java:471) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.writePage(PageHandler.java:307) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.initPage(PageHandler.java:244) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.DataStructure.init(DataStructure.java:425) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.addStripe(PagesList.java:623) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.getPageForPut(PagesList.java:754) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.put(PagesList.java:859) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList$PutBucket.run(PagesList.java:199) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList$PutBucket.run(PagesList.java:173) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.writePage(PageHandler.java:313) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.DataStructure.write(DataStructure.java:304) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.flushBucketsCache(PagesList.java:415) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.saveMetadata(PagesList.java:356) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.saveStoreMetadata(GridCacheOffheapManager.java:403) [21:01:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.lambda$syncMetadata$2(GridCacheOffheapManager.java:378) [21:01:45]W: [org.apache.ignite:ignite-core] ... 4 more [21:01:45]W: [org.apache.ignite:ignite-core] ner-[ trukey=KeyCacheObjectImpl [part=8, val=8, hasValBytes=true], cacheId=1544803905], val=TxEntryValueHolder [val=CacheObjectByteArrayImpl [arrLen=1364], op=CREATE], prevVal=TxEntryValueHolder [val=null, op=NOOP], oldVal=TxEntryValueHolder [val[21:01:4cpu-#1066%failure.IoomFai5=null,E] (err) Failed to execute compound future reducer: GridCompoundFuture [rdc=null, initFlag=1, lsnrCalls=15, size=603, done=true, cancelled=false, err=class o.a.i.IgniteCheckedException: Failed to perform WAL operation (environment was invalidated by a previous erroe, true, true, true, true, true, true, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false... and 503 more]]class org.apache.ignite.IgniteCheckedException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.cast(IgniteUtils.java:7773) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.resolve(GridFutureAdapter.java:260) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.get0(GridFutureAdapter.java:172) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.get(GridFutureAdapter.java:141) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridCompoundFuture.apply(GridCompoundFuture.java:100) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridCompoundFuture.apply(GridCompoundFuture.java:47) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.notifyListener(GridFutureAdapteer.java:399) [21:01:46]W: [org.apache.ignite:ignite-core] vious error), futs=TransformCollectionView [true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false... and 503 more]]Exception in thread "checkpoint-runner-cpu-#1072%failure.IoomFailureHandlerTest1%" at org.apache.ignite.internal.util.future.GridFutureAdapter.unblock(GridFutureAdapter.java:x l347) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.unblockAll(GridFutureAdapter.java:335) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.onDone(GridFutureAdapter.java:511) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.onDone(GridFutureAdapter.java:490) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.onDone(GridFutureAdapter.java:478) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.lambda$wrapIgniteFuture$3(IgniteUtils.java:11719) [21:01:46]W: [org.apache.ignite:ignite-core] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [21:01:46]W: [org.apache.ignite:ignite-core] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [21:01:46]W: [org.apache.ignite:ignite-core] at java.lang.Thread.run(Thread.java:748) [21:01:46]W: [org.apache.ignite:ignite-core] Caused by: class org.apache.ignite.IgniteException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.lambda$syncMetadata$2(GridCacheOffheapManager.java:381) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.lambda$wrapIgniteFuture$3(IgniteUtils.java:11714) [21:01:46]W: [org.apache.ignite:ignite-core] ... 3 more [21:01:46]W: [org.apache.ignite:ignite-core] Caused by: class org.apache.ignite.internal.processors.cache.persistence.StorageException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.filehandle.FileWriteHandleImpl.checkNode(FileWriteHandleImpl.java:208) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.filehandle.FileWriteHandleImpl.addRecord(FileWriteHandleImpl.java:235) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager.log(FileWriteAheadLogManager.java:910) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager.log(FileWriteAheadLogManager.java:863) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.doInitPage(PageHandler.java:471) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.writePage(PageHandler.java:307) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.initPage(PageHandler.java:244) [21:01:46]W: [org.apache.ignite:ignite-core] [ at org.apache.ignite.internal.processors.cache.persistence.DataStructure.init(DataStructure.java:425) [21:01:46]W: [org.apache.ignite:ignite-core] act org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.addStripe(PagesList.java:623) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.getPageForPut(PagesList.java:754) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.put(PagesList.java:859) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList$PutBucket.run(PagesList.java:199) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList$PutBucket.run(PagesList.java:173) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.writePage(PageHandler.java:313) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.DataStructure.write(DataStructure.java:304) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.flushBucketsCache(PagesList.java:415) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.saveMetadata(PagesList.java:356) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.saveStoreMetadata(GridCacheOffheapManager.java:403) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.lambda$syncMetadata$2(GridCacheOffheapManager.java:378) [21:01:46]W: [org.apache.ignite:ignite-core] ... 4 more [21:01:46]W: [org.apache.ignite:ignite-core] class org.apache.ignite.IgniteException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.lambda$syncMetadata$2(GridCacheOffheapManager.java:381) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.lambda$wrapIgniteFuture$3(IgniteUtils.java:11714) [21:01:46]W: [org.apache.ignite:ignite-core] aut java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [21:01:46]W: [org.apache.ignite:ignite-core] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [21:01:46]W: [org.apache.ignite:ignite-core] at java.lang.Thread.run(Thread.java:748) [21:01:46]W: [org.apache.ignite:ignite-core] Caused by: class org.apache.ignite.internal.processors.cache.persistence.StorageException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.filehandle.FileWriteHandleImpl.checkNode(FileWriteHandleImpl.java:208) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.filehandle.FileWriteHandleImpl.addRecord(FileWriteHandleImpl.java:235) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager.log(FileWriteAheadLogManager.java:910) [21:01:46]W: [org.apache.ignite:ignite-core] o at org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager.log(FileWriteAheadLogManager.java:863) [21:01:46]W: [org.apache.ignite:ignite-core] r), futs=TransfoprmCollectionView [true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, fa=NOOrel21eHandlerTest1%" at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.doInitPage(PageHandler.java:471) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.writePage(PageHandler.java:307) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.initPage(PageHandler.java:244) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.DataStructure.init(DataStructure.java:425) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.addStripe(PagesList.java:623) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.getPageForPut(PagesList.java:754) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.put(PagesList.java:859) [21:01:46]W: [org.apache.ignite:ignite-core] at org.aEpache.ignite.internal.processors.cache.persistence.freelist.PagesList$PutBucket.run(PagesList.java:199) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList$PutBucket.run(PagesList.java:173) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.writePage(PageHandler.java:313) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.DataStructure.write(DataStructure.java:304) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.flushBucketsCache(PagesList.java:415) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.saveMetadata(PagesList.java:356) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.saveStoreMetadata(GridCacheOffheapManager.java:403) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.lambda$syncMetadata$2(GridCacheOffheapManager.java:378) [21:01:46]W: [org.apache.ignite:ignite-core] ... 4 more [21:01:46]W: [org.apache.ignite:ignite-core] class org.apache.ignite.IgniteCheckedException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:46]W: [org.apache.ignite:ignite-core] x:spP at org.apache.ignite.internal.util.IgniteUtils.cast(IgniteUtils.java:7773) [21:01:46]W: [org.apache.ignite:ignite-core] at] org.apache.ignite.internal.util.future.GridFutureAdapter.resolve(GridFutureAdapter.java:260) [21:01:46]W: [org.apache.ignite:ignite-core] att org.apache.ignite.internal.util.future.GridFutureAdapter.get0(GridFutureAdapter.java:172) [21:01:46]W: [org.apache.ignite:ignite-core] at eorg.apache.ignite.internal.util.future.GridFutureAdapter.get(GridFutureAdapter.java:141) [21:01:46]W: [org.apache.ignite:ignite-core] 0 at org.apache.ignite.internal.util.future.GridCompoundFuture.apply(GridCompoundFuture.java:100) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridCompoundFuture.apply(GridCompoundFuture.java:47) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apachce.ignite.internal.util.future.GridFutureAdapter.notifyListener(GridFutureAdapter.java:399) [21:01:46]W: [org.apache.ignite:ignite-core] 1 at org.apache.ignite.internal.util.future.GridFutureAdapter.unblock(GridFutureAdapter.java:347) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.unblockAll(GridFutureAdapter.java:335) [21:01:46]W: [org.apache.ignite:ignite-core] a,t org.apache.ignite.internal.util.future.GridFutureAdapter.onDone(GridFutureAdapter.java:511) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.onDone(GridFutureAdapter.java:490) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.onDone(GridFutureAdapter.java:478) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.lambda$wrapIgniteFuture$3(IgniteUtils.java:11719) [21:01:46]W: [org.apache.ignite:ignite-core] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [21:01:46]W: [org.apache.ignite:ignite-core] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [21:01:46]W: [org.apache.ignite:ignite-core] at java.lang.Thread.run(Thread.java:748) [21:01:46]W: [org.apache.ignite:ignite-core] Caused by: class org.apache.ignite.IgniteException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.lambda$syncMetadata$2(GridCacheOffheapManager.java:381) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.lambda$wrapIgniteFuture$3(IgniteUtils.java:11714) [21:01:46]W: [org.apache.ignite:ignite-core] ... 3 more [21:01:46]W: [org.apache.ignite:ignite-core] [21:01:46] (err) Failed to execute compound future reducer: GridCompoundFuture [rdc=null, initFlag=1, lsnrCalls=16, size=603, done=true, cancelled=false, err=class o.a.i.IgniteCheckedException: Failed to perform WAL operation (environment was invalidated by a previous error), futs=TransformCollectionView [true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, falion se, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, falsein thread "checkpoint-runne, false, false, false, falsr-e, false, false, false, false, false, false, false, false, false, false... and 503 more]]cpu-#1070, ent far%:flse, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false... and 503 more]]ailure.IoCa4yused by: class org.apache.ignite.internal.processors.cache.persistence.StorageException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:46]W: [org.apache.ignite:ignite-core] at eorg.apache.ignite.internal.processors.cache.persistence.wal.filehandle.FileWriteHandleImpl.checkNode(FileWriteHandleImpl.java:208) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.filehandle.FileWriteHandleImpl.addRecord(FileWriteHandleImpl.java:235) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager.log(FileWriteAheadLogManager.java:910) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager.log(FileWriteAheadLogManager.java:863) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.doInitPage(PageHandler.java:471) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.writePage(PageHandler.java:307) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.initPage(PageHandler.java:244) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.DataStructure.init(DataStructure.java:425) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.addStripe(PagesList.java:623) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.getPageForPut(PagesList.java:754) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.put(PagesList.java:859) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList$PutBucket.run(PagesList.java:199) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList$PutBucket.run(PagesList.java:173) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.writePage(PageHandler.java:313) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.DataStructure.write(DataStructure.java:304) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.flushBucketsCache(PagesList.java:415) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.saveMetadata(PagesList.java:356) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.saveStoreMetadata(GridCacheOffheapManager.java:403) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.lambda$syncMetadata$2(GridCacheOffheapManager.java:378) [21:01:46]W: [org.apache.ignite:ignite-core] ... 4 more [21:01:46]W: [org.apache.ignite:ignite-core] 6P] rcl(ass org.apache.ignite.IgniteCheckedException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.cast(IgniteUtils.java:7773) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.resolve(GridFutureAdapter.java:260) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.get0(GridFutureAdapter.java:172) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.get(GridFutureAdapter.java:141) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridCompoundFuture.apply(GridCompoundFuture.java:100) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridCompoundFuture.apply(GridCompoundFuture.java:47) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.notifyListener(GridFutureAdapter.java:399) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.unblock(GridFutureAdapter.java:347) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.unblockAll(GridFutureAdapter.java:335) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.onDone(GridFutureAdapter.java:511) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.onDone(GridFutureAdapter.java:490) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.onDone(GridFutureAdapter.java:478) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.lambda$wrapIgniteFuture$3(IgniteUtils.java:11719) [21:01:46]W: [org.apache.ignite:ignite-core] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [21:01:46]W: [org.apache.ignite:ignite-core] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [21:01:46]W: [org.apache.ignite:ignite-core] at java.lang.Thread.run(Thread.java:748) [21:01:46]W: [org.apache.ignite:ignite-core] oCaused by: class org.apache.ignite.IgniteException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.lambda$syncMetadata$2(GridCacheOffheapManager.java:381) [21:01:46]W: [org.apache.ignite:ignite-core] [at org.apache.ignite.internal.util.IgniteUtils.lambda$wrapIgniteFuture$3(IgniteUtils.java:11714) [21:01:46]W: [org.apache.ignite:ignite-core] ... 3 more [21:01:46]W: [org.apache.ignite:ignite-core] Caused by: class org.apache.ignite.internal.processors.cache.persistence.StorageException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.filehandle.FileWriteHandleImpl.checkNode(FileWriteHandleImpl.java:208) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.filehandle.FileWriteHandleImpl.addRecord(FileWriteHandleImpl.java:235) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager.log(FileWriteAheadLogManager.java:910) [21:01:46]W: [org.apache.ignite:ignite-core] E at org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager.log(FileWriteAheadLogManager.java:863) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.doInitPage(PageHandler.java:471) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.writePage(PageHandler.java:307) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.initPage(PageHandler.java:244) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.DataStructure.init(DataStructure.java:425) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.addStripe(PagesList.java:623) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.getPageForPut(PagesList.java:754) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.put(PagesList.java:859) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList$PutBucket.run(PagesList.java:199) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList$PutBucket.run(PagesList.java:173) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.writePage(PageHandler.java:313) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.DataStructure.write(DataStructure.java:304) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.flushBucketsCache(PagesList.java:415) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.saveMetadata(PagesList.java:356) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.saveStoreMetadata(GridCacheOffheapManager.java:403) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.lambda$syncMetadata$2(GridCacheOffheapManager.java:378) [21:01:46]W: [org.apache.ignite:ignite-core] ... 4 more [21:01:46]W: [org.apache.ignite:ignite-core] class org.apache.ignite.IgniteCheckedException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.cast(IgniteUtils.java:7773) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.resolve(GridFutureAdapter.java:260) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.get0(GridFutureAdapter.java:172) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.get(GridFutureAdapter.java:141) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridCompoundFuture.apply(GridCompoundFuture.java:100) [21:01:46]W: [org.apache.ignite:ignite-core] Except at org.apache.ignite.internal.util.future.GridCompoundFuture.apply(GridCompoundFuture.java:47) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.notifyListener(GridFutureAdapter.java:399) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.unblock(GridFutureAdapter.java:347) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.unblockAll(GridFutureAdapter.java:335) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.onDone(GridFutureAdapter.java:511) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.onDone(GridFutureAdapter.java:490) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.inteernal.util.future.GridFutureAdapter.onDone(GridFutureAdapter.java:478) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.lambda$wrapIgniteFuture$3(IgniteUtils.java:11719) [21:01:46]W: [org.apache.ignite:ignite-core] at java.utiol.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [21:01:46]W: [org.apache.ignite:ignite-core] ption in thread "checkpoint-runner-cpu-#1067%failure.IoomFailureHandlerTest1%" at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [21:01:46]W: [org.apache.ignite:ignite-core] c at java.lang.Thread.run(Thread.java:748) [21:01:46]W: [org.apache.ignite:ignite-core] Caused by: class org.apache.ignite.IgniteException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.lambda$syncMetadata$2(GridCacheOffheapManager.java:381) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.lambda$wrapIgniteFuture$3(IgniteUtils.java:11714) [21:01:46]W: [org.apache.ignite:ignite-core] ... 3 more [21:01:46]W: [org.apache.ignite:ignite-core] Caused by: class org.apache.ignite.internal.processors.cache.persistence.StorageException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:46]W: [org.apache.ignite:ignite-core] r at org.apache.ignite.internal.processors.cache.persistence.wal.filehandle.FileWriteHandleImpl.checkNode(FileWriteHandleImpl.java:208) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.filehandle.FileWriteHandleImpl.addRecord(FileWriteHandleImpl.java:235) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager.log(FileWriteAheadLogManager.java:910) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager.log(FileWriteAheadLogManager.java:863) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.doInitPage(PageHandler.java:471) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.writePage(PageHandler.java:307) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.initPage(PageHandler.java:244) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.DataStructure.init(DataStructure.java:425) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.addStripe(PagesList.java:623) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.getPageForPut(PagesList.java:754) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.put(PagesList.java:859) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList$PutBucket.run(PagesList.java:199) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList$PutBucket.run(PagesList.java:173) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.writePage(PageHandler.java:313) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.DataStructure.write(DataStructure.java:304) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.flushBucketsCache(PagesList.java:415) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.saveMetadata(PagesList.java:356) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.saveStoreMetadata(GridCacheOffheapManager.java:403) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.lambda$syncMetadata$2(GridCacheOffheapManager.java:378) [21:01:46]W: [org.apache.ignite:ignite-core] ... 4 more [21:01:46]W: [org.apache.ignite:ignite-core] class org.apache.ignite.IgniteException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.lambda$syncMetadata$2(GridCacheOffheapManager.java:381) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.lambda$wrapIgniteFuture$3(IgniteUtils.java:11714) [21:01:46]W: [org.apache.ignite:ignite-core] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [21:01:46]W: [org.apache.ignite:ignite-core] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [21:01:46]W: [org.apache.ignite:ignite-core] at java.lang.Thread.run(Thread.java:748) [21:01:46]W: [org.apache.ignite:ignite-core] [21:01:Caused by: class org.apache.ignite.internal.processors.cache.persistence.StorageException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.filehandle.FileWriteHandleImpl.checkNode(FileWriteHandleImpl.java:208) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.filehandle.FileWriteHandleImpl.addRecord(FileWriteHandleImpl.java:235) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager.log(FileWriteAheadLogManager.java:910) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager.log(FileWriteAheadLogManager.java:863) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.doInitPage(PageHandler.java:471) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.writePage(PageHandler.java:307) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.initPage(PageHandler.java:244) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.DataStructure.init(DataStructure.java:425) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.addStripe(PagesList.java:623) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.getPageForPut(PagesList.java:754) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.put(PagesList.java:859) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList$PutBucket.run(PagesList.java:199) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList$PutBucket.run(PagesList.java:173) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.writePage(PageHandler.java:313) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.DataStructure.write(DataStructure.java:304) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.flushBucketsCache(PagesList.java:415) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.saveMetadata(PagesList.java:356) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.saveStoreMetadata(GridCacheOffheapManager.java:403) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.lambda$syncMetadata$2(GridCacheOffheapManager.java:378) [21:01:46]W: [org.apache.ignite:ignite-core] ... 4 more [21:01:46]W: [org.apache.ignite:ignite-core] xception in thread "checkpoint-runner-cpu-#1071%failure.IoomFailureHandlerTest1%" class org.apache.ignite.IgniteException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.lambda$syncMetadata$2(GridCacheOffheapManager.java:381) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.lambda$wrapIgniteFuture$3(IgniteUtils.java:11714) [21:01:46]W: [org.apache.ignite:ignite-core] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [21:01:46]W: [org.apache.ignite:ignite-core] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [21:01:46]W: [org.apache.ignite:ignite-core] at java.lang.Thread.run(Thread.java:748) [21:01:46]W: [org.apache.ignite:ignite-core] Caused by: class org.apache.ignite.internal.processors.cache.persistence.StorageException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.filehandle.FileWriteHandleImpl.checkNode(FileWriteHandleImpl.java:208) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.filehandle.FileWriteHandleImpl.addRecord(FileWriteHandleImpl.java:235) [21:01:46]W: [org.apache.ignite:ignite-core] 2 at org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager.log(FileWriteAheadLogManager.java:910) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager.log(FileWriteAheadLogManager.java:863) [21:01:46]W: [org.apache.ignite:ignite-core] mi at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.doInitPage(PageHandler.java:471) [21:01:46]W: [org.apache.ignite:ignite-core] 1 at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.writePage(PageHandler.java:307) [21:01:46]W: [org.apache.ignite:ignite-core] [at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.initPage(PageHandler.java:244) [21:01:46]W: [org.apache.ignite:ignite-core] Eat org.apache.ignite.internal.processors.cache.persistence.DataStructure.init(DataStructure.java:425) [21:01:46]W: [org.apache.ignite:ignite-core] at4 org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.addStripe(PagesList.java:623) [21:01:46]W: [org.apache.ignite:ignite-core] r at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.getPageForPut(PagesList.java:754) [21:01:46]W: [org.apache.ignite:ignite-core] e at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.put(PagesList.java:859) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList$PutBucket.run(PagesList.java:199) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList$PutBucket.run(PagesList.java:173) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.writePage(PageHandler.java:313) [21:01:46]W: [org.apache.ignite:ignite-core] a)t org.apache.ignite.internal.processors.cache.persistence.DataStructure.write(DataStructure.java:304) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.flushBucketsCache(PagesList.java:415) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.saveMetadata(PagesList.java:356) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.saveStoreMetadata(GridCacheOffheapManager.java:403) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.lambda$syncMetadata$2(GridCacheOffheapManager.java:378) [21:01:46]W: [org.apache.ignite:ignite-core] ... 4 more [21:01:46]W: [org.apache.ignite:ignite-core] class org.apache.ignite.IgniteException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.lambda$syncMetadata$2(GridCacheOffheapManager.java:381) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.lambda$wrapIgniteFuture$3(IgniteUtils.java:11714) [21:01:46]W: [org.apache.ignite:ignite-core] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [21:01:46]W: [org.apache.ignite:ignite-core] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [21:01:46]W: [org.apache.ignite:ignite-core] at java.lang.Thread.run(Thread.java:748) [21:01:46]W: [org.apache.ignite:ignite-core] 6] (eCaused by: class org.apache.ignite.internal.processors.cache.persistence.StorageException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.filehandle.FileWriteHandleImpl.checkNode(FileWriteHandleImpl.java:208) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.filehandle.FileWriteHandleImpl.addRecord(FileWriteHandleImpl.java:235) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager.log(FileWriteAheadLogManager.java:910) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager.log(FileWriteAheadLogManager.java:863) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.doInitPage(PageHandler.java:471) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.writePage(PageHandler.java:307) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.initPage(PageHandler.java:244) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.DataStructure.init(DataStructure.java:425) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.addStripe(PagesList.java:623) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.getPageForPut(PagesList.java:754) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.put(PagesList.java:859) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList$PutBucket.run(PagesList.java:199) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList$PutBucket.run(PagesList.java:173) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.writePage(PageHandler.java:313) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.DataStructure.write(DataStructure.java:304) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.flushBucketsCache(PagesList.java:415) [21:01:46]W: [org.apache.ignite:ignite-core] xat org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.saveMetadata(PagesList.java:356) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.saveStoreMetadata(GridCacheOffheapManager.java:403) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.lambda$syncMetadata$2(GridCacheOffheapManager.java:378) [21:01:46]W: [org.apache.ignite:ignite-core] ... 4 more [21:01:46]W: [org.apache.ignite:ignite-core] 21:01:01:46] (err) Failed to execute compound future reducer: GridCompoundFuture [rdc=null, initFlag=1, lsnrCalls=17, size=603, done=true, cancelled=false, err=class o.a.i.IgniteCheckedException: Failed to perform WAL operation (environment was invalidated by a :46] (err) Failed to execuFailureHandlerTest1%" ception in thread class org.apache.ignite.IgniteException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.lambda$syncMetadata$2(GridCacheOffheapManager.java:381) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.lambda$wrapIgniteFuture$3(IgniteUtils.java:11714) [21:01:46]W: [org.apache.ignite:ignite-core] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [21:01:46]W: [org.apache.ignite:ignite-core] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [21:01:46]W: [org.apache.ignite:ignite-core] at java.lang.Thread.run(Thread.java:748) [21:01:46]W: [org.apache.ignite:ignite-core] Caused by: class org.apache.ignite.internal.processors.cache.persistence.StorageException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.filehandle.FileWriteHandleImpl.checkNode(FileWriteHandleImppl.jtoava:208) [21:01:46]W: [org.apache.ignite:ignite-core] at rorg.apache.ignite.internal.processors.cache.persistence.wal.filehandle.FileWriteHandleImpl.addRecord(FileWriteHandleImpl.java:235) [21:01:46]W: [org.apache.ignite:ignite-core] at org .apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager.log(FileWriteAheadLogManager.java:910) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.insternal.processors.cache.persistence.wal.FileWriteAheadLogManager.log(FileWriteAheadLogManager.java:863) [21:01:46]W: [org.apache.ignite:ignite-core] F at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.doInitPage(PageHandler.java:471) [21:01:46]W: [org.apache.ignite:ignite-core] atr org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.writePage(PageHandler.java:307) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.initPage(PageHandler.java:244) [21:01:46]W: [org.apache.ignite:ignite-core] atn org.apache.ignite.internal.processors.cache.persistence.DataStructure.init(DataStructure.java:425) [21:01:46]W: [org.apache.ignite:ignite-core] e at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.addStripe(PagesList.java:623) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.getPageForPut(PagesList.java:754) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.put(PagesList.java:859) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList$PutBucket.run(PagesList.java:199) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList$PutBucket.run(PagesList.java:173) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.writePage(PageHanrdler.java:313) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.DataStructure.write(DataStructure.java:304) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.flushBucketsCache(PagesList.java:415) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.saveMetadata(PagesList.java:356) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.saveStoreMetadata(GridCacheOffheapManager.java:403) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.lambda$syncMetadata$2(GridCacheOffheapManager.java:378) [21:01:46]W: [org.apache.ignite:ignite-core] ... 4 more [21:01:46]W: [org.apache.ignite:ignite-core] "checkpoint-runner-cpu-#1075%failure.IoomFailureHandlerTest1%" class org.apache.ignite.IgniteException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.lambda$syncMetadata$2(GridCacheOffheapManager.java:381) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.lambda$wrapIgniteFuture$3(IgniteUtils.java:11714) [21:01:46]W: [org.apache.ignite:ignite-core] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [21:01:46]W: [org.apache.ignite:ignite-core] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [21:01:46]W: [org.apache.ignite:ignite-core] e at java.lang.Thread.run(Thread.java:748) [21:01:46]W: [org.apache.ignite:ignite-core] coCaused by: class o rg.apache.ignite.internal.processors.cache.persistence.StorageException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:46]W: [org.apache.ignite:ignite-core] ) at org.apache.ignite.internal.processors.cache.persistence.wal.filehandle.FileWriteHandleImpl.checkNode(FileWriteHandleImpl.java:208) [21:01:46]W: [org.apache.ignite:ignite-core] ata org.apache.ignite.internal.processors.cache.persistence.wal.filehandle.FileWriteHandleImpl.addRecord(FileWriteHandleImpl.java:235) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager.log(FileWriteAheadLogManager.java:910) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager.log(FileWriteAheadLogManager.java:863) [21:01:46]W: [org.apache.ignite:ignite-core] sio at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.doInitPage(PageHandler.java:471) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.writePage(PageHandler.java:307) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.initPage(PageHandler.java:244) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.DataStructure.init(DataStructure.java:425) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.addStripe(PagesList.java:623) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.getPageForPut(PagesList.java:754) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.put(PagesList.java:859) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList$PutBucket.run(PagesList.java:199) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList$PutBucket.run(PagesList.java:173) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.writePage(PageHandler.java:313) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.DataStructure.write(DataStructure.java:304) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.flushBucketsCache(PagesList.java:415) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.saveMetadata(PagesList.java:356) [21:01:46]W: [org.apache.ignite:ignite-core] atF org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.saveStoreMetadata(GridCacheOffheapManager.java:403) [21:01:46]W: [org.apache.ignite:ignite-core] at iorg.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.lambda$syncMetadata$2(GridCacheOffheapManager.java:378) [21:01:46]W: [org.apache.ignite:ignite-core] ... 4 more [21:01:46]W: [org.apache.ignite:ignite-core] mvin thread "pochecous kpoint-runner-cpu-#1073%failure.IoomFailureHandlerTest1%" class org.apacuhe.iegnite.IgniteException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.lambda$syncMetadata$2(GridCacheOffheapManager.java:381) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.lambda$wrapIgniteFuture$3(IgniteUtils.java:11714) [21:01:46]W: [org.apache.ignite:ignite-core] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [21:01:46]W: [org.apache.ignite:ignite-core] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [21:01:46]W: [org.apache.ignite:ignite-core] at java.lang.Thread.run(Thread.java:748) [21:01:46]W: [org.apache.ignite:ignite-core] Caused by: class org.apache.ignite.internal.processors.cache.persistence.StorageException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.filehandle.FileWriteHandleImpl.checkNode(FileWriteHandleImpl.java:208) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.filehandle.FileWriteHandleImpl.addRecord(FileWriteHandleImpl.java:235) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager.log(FileWriteAheadLogManager.java:910) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager.log(FileWriteAheadLogManager.java:863) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.doInitPage(PageHandler.java:471) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.writePage(PageHandler.java:307) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.initPage(PageHandler.java:244) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.DataStructure.init(DataStructure.java:425) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.addStripe(PagesList.java:623) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.getPageForPut(PagesList.java:754) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.put(PagesList.java:859) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList$PutBucket.run(PagesList.java:199) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList$PutBucket.run(PagesList.java:173) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.writePage(PageHandler.java:313) [21:01:46]W: [org.apache.ignite:ignite-core] a at org.apache.ignite.internal.processors.cache.persistence.DataStructure.write(DataStructure.java:304) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.flushBucketsCache(PagesList.java:415) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.saveMetadata(PagesList.java:356) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.saveStoreMetadata(GridCacheOffheapManager.java:403) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.lambda$syncMetadata$2(GridCacheOffheapManager.java:378) [21:01:46]W: [org.apache.ignite:ignite-core] ... 4 more [21:01:46]W: [org.apache.ignite:ignite-core] rsColed to execute compound future reducer: GridCompoundFuture [rdc=null, initFlag=1, lsnrCalls=iled to execute compound future reducer: GridCompoundFuture [rdc=null, initFlag=1, lsnrCalls=18, size=603, done=true, cancelled=false, err=class o.a.i.IgniteCheckedException: Failed to perform WAL operation (environment was invalidated by a previol=null, rrorus error), futs=Tr15ansformCollec), futs=Tranttl=-1, sfotionView [true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, fa, sizelse, false, false, false, false, false, false, false, false,rmCollectionView [true, true, true, tconflictExprue, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, fa =60lfalse, se, false, false, false, false, false, false, false, false, false, faireTime=-1, conflicnd lse, false, fa3, done=true, cancelled=false, err=class o.a.i.IgniteCheckedExceptilsfalse, false, false, false, fafuture reducer: GridCotVer=null, explimpoundFuture [rdc=null, initFlag=1, lsnrCalls=19, size=603, done=true, cancelled=false, err=class o.a.i.IgniteCheckedException: Failed to perform WAL operation (environmlse, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false... and 503 more]]e, false, false, false, falseclass org.apache.ignite.IgniteCheckedException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:46]W: [org.apache.ignite:ignite-core] on, falsee act org.apache.ignite.internal.util.IgniteUtils.cast(IgniteUtils.java:7773) [21:01:46]W: [org.apache.ignite:ignite-core] ,: at org.apache.ignite.internal.util.future.GridFutureAdapter.resolve(GridFutureAdapter.java:260) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.get0(GridFutureAdapter.java:172) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.get(GridFutureAdapter.java:141) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridCompoundFuture.apply(GridCompoundFuture.java:100) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridCompoundFuture.apply(nGridCompoundFuture.java:47) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.notifyListener(GridFutureAdapter.java:399) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.unblock(GridFutureAdapter.java:347) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.unblockAll(GridFutureAdapter.java:335) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.onDone(GridFutureAdapter.java:511) [21:01:46]W: [org.apache.ignite:ignite-core] iat org.apache.ignite.internal.util.future.GridFutureAdapter.onDone(GridFutureAdapter.java:490) [21:01:46]W: [org.apache.ignite:ignite-core] t at org.apac he.ignite.internal.util.future.GridFutureAdapter.onDone(GridFutureAdapter.java:478) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.lambda$wrapIgniteFuture$3(IgniteUtils.java:11719) [21:01:46]W: [org.apache.ignite:ignite-core] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [21:01:46]W: [org.apache.ignite:ignite-core] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [21:01:46]W: [org.apache.ignite:ignite-core] at java.lang.Thread.run(Thread.java:748) [21:01:46]W: [org.apache.ignite:ignite-core] falFsCaused by: class org.apache.ignite.IgniteException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.lambda$syncMetadata$2(GridCacheOffheapManager.java:381) [21:01:46]W: [org.apache.ignite:ignite-core] at otrg.apache.ignite.internal.util.IgniteUtils.lambda$wrapIgniteFuture$3(IgniteUtils.java:11714) [21:01:46]W: [org.apache.ignite:ignite-core] w... 3 more [21:01:46]W: [org.apache.ignite:ignite-core] ailed to pae, false, VerCausfseed by: class org.apache.ignite.internal.processors.cache.persistence.StorageException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:46]W: [org.apache.ignite:ignite-core] rat org.apache.ignite.internal.processors.cache.persistence.wal.filehandle.FileWriteHandleImpl.checkNode(FileWriteHandleImpl.java:208) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.filehandle.FileWriteHandleImpl.addRecord(FileWriteHandleImpl.java:235) [21:01:46]W: [org.apache.ignite:ignite-core] a at org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager.log(FileWriteAheadLogManager.java:910) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager.log(FileWriteAheadLogManager.java:863) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.doInitPage(PageHandler.java:471) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.writePage(PageHandler.java:307) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.initPage(PageHandler.java:244) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.DataStructure.init(DataStructure.java:425) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.addStripe(PagesList.java:623) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.getPageForPut(PagesList.java:754) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.put(PagesList.java:859) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList$PutBucket.run(PagesList.java:199) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList$PutBucket.run(PagesList.java:173) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.writePage(PageHandler.java:313) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.DataStructure.write(DataStructure.java:304) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.flushBucketsCache(PagesList.java:415) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.saveMetadata(PagesList.java:356) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.saveStoreMetadata(GridCacheOffheapManager.java:403) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.lambda$syncMetadata$2(GridCacheOffheapManager.java:378) [21:01:46]W: [org.apache.ignite:ignite-core] ... 4 more [21:01:46]W: [org.apache.ignite:ignite-core] =null, dhtVer=null, filters=CacheEntryPredicate[] [], filtersPassed=false, filtersSet=false, entry=GridDhtCacheEntry [rdrs=ReaderId[] [], part=8, super=GridDistributedCacheEntry [super=GridCacheMapEntry [key=KeyCacheObjectImpl [part=8, val=8, hasValBytes=true], val=null, ver=GridCache[21:01:46] (err) Failed to execute compound future reducer: GridCompoundFuture [rdc=null, initFlag=1, lsnrCalls=20, size=603, done=true, cancelled=false, err=class o.a.i.IgniteCheckedException: Failed to perform WAL operation (environment was invalidated by a previous error), futs=TransformCollectionView [true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, Exception in thread "checkpoint-runner-cpu-#1076%failurie.IoomFailureHandlerlfalse, falsVersion [topVer=248824893, order=1637344893065, nodeOrder=2], hash=8, extras=GridCacheObsoleteEntryExtras [obsoleteVer=GridCacheVersion [te, false, false, false, false, false, false, false, false, faform WAL operatiTest1%" nvalidaclolsoass org.apache.ignite.IgniteException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.lambda$syncMetadata$2(GridCacheOffheapManager.java:381) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.lambda$wrapIgniteFuture$3(IgniteUtils.java:11714) [21:01:46]W: [org.apache.ignite:ignite-core] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [21:01:46]W: [org.apache.ignite:ignite-core] pat java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [21:01:46]W: [org.apache.ignite:ignite-core] at java.lang.Thread.run(Thread.java:748) [21:01:46]W: [org.apache.ignite:ignite-core] Caused by: class org.apache.ignite.internal.processors.cache.persistence.StorageException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.filehandle.FileWriteHandleImpl.checkNode(FileWriteHandleImpl.java:208) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.filehandle.FileWriteHandleImpl.addRecord(FileWriteHandleImpl.java:235) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager.log(FileWriteAheadLogManager.java:910) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager.log(FileWriteAheadLogManager.java:863) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.doInitPage(PageHandler.java:471) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.writePage(PageHandler.java:307) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.initPage(PageHandler.java:244) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.DataStructure.init(DataStructure.java:425) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.addStripe(PagesList.java:623) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.getPageForPut(PagesList.java:754) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.put(PagesList.java:859) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList$PutBucket.run(PagesList.java:199) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList$PutBucket.run(PagesList.java:173) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.writePage(PageHandler.java:313) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.DataStructure.write(DataStructure.java:304) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.flushBucketsCache(PagesList.java:415) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.saveMetadata(PagesList.java:356) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.saveStoreMetadata(GridCacheOffheapManager.java:403) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.lambda$syncMetadata$2(GridCacheOffheapManager.java:378) [21:01:46]W: [org.apache.ignite:ignite-core] ... 4 more [21:01:46]W: [org.apache.ignite:ignite-core] e, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false... and 503 more]]class org.apache.ignite.IgniteCheckedException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.cast(IgniteUtils.java:7773) [21:01:46]W: [org.apache.ignite:ignite-core] se, false, false, false, false, false, false, false, false, false, false, false, false, false, false... and 503 more]]nteVer=21 (e4748d by3647, order=0, nodnvironment w at oe rg.apache.ignite.internal.util.future.GridFutureAdapter.resolve(GridFutureAdapter.java:260) [21:01:46]W: [org.apache.ignite:ignite-core] a at org.apache.ignite.internal.util.future.GridFutureAdapter.get0(GridFutureAdapter.java:172) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.get(GridFutureAdapter.java:141) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridCompoundFuture.apply(GridCompoundFuture.java:100) [21:01:46]W: [org.apache.ignite:ignite-core] O at org.apache.ignite.internal.util.future.GridCompoundFuture.apply(GridCompoundFuture.java:47) [21:01:46]W: [org.apache.ignite:ignite-core] aat org.apache.ignite.internal.util.future.GridFutureAdapter.notifyListener(GridFutureAdapter.java:399) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.unblock(GridFutureAdapter.java:347) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.unblockAll(GridFutureAdapter.java:335) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.onDone(GridFutureAdapter.java:511) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.onDone(GridFutureAdapter.java:490) [21:01:46]W: [org.apache.ignite:ignite-core] r at org.apache.ignite.internal.util.future.GridFutureAdapter.onDone(GridFutureAdapter.java:478) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.lambda$wrapIgniteFuture$3(IgniteUtils.java:11719) [21:01:46]W: [org.apache.ignite:ignite-core] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [21:01:46]W: [org.apache.ignite:ignite-core] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [21:01:46]W: [org.apache.ignite:ignite-core] at java.lang.Thread.run(Thread.java:748) [21:01:46]W: [org.apache.ignite:ignite-core] Caused by: class org.apache.ignite.IgniteException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:46]W: [org.apache.ignite:ignite-core] previous error), futs=TransformCollectionView [true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, defalse, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false... and 503 more]] at org.apache.ignite.internal.processors.cache.perssisternce.GridCacheOffheapManager.lambda$syncMetadata$2(GridCacheOffheapManager.java:381) [21:01:46]W: [org.apache.ignite:ignite-core] = at org.apache.ignite.internal.util.IgniteUtils.lambda$wrapIgniteFuture$3(IgniteUtils.java:11714) [21:01:46]W: [org.apache.ignite:ignite-core] ... 3 more [21:01:46]W: [org.apache.ignite:ignite-core] Caused by: class org.apache.ignite.internal.processors.cache.persistence.StorageException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.filehandle.FileWriteHandleImpl.checkNode(FileWriteHandleImpl.java:208) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.filehandle.FileWriteHandleImpl.addRecord(FileWriteHandleImpl.java:235) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager.log(FileWriteAheadLogManager.java:910) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager.log(FileWriteAheadLogManager.java:863) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.doInitPage(PageHandler.java:471) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.writePage(PageHandler.java:307) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.initPage(PageHandler.java:244) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.DataStructure.init(DataStructure.java:425) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.addStripe(PagesList.java:623) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.getPageForPut(PagesList.java:754) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.put(PagesList.java:859) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList$PutBucket.run(PagesList.java:199) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList$PutBucket.run(PagesList.java:173) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.writePage(PageHandler.java:313) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.DataStructure.write(DataStructure.java:304) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.flushBucketsCache(PagesList.java:415) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.saveMetadata(PagesList.java:356) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.saveStoreMetadata(GridCacheOffheapManager.java:403) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.lambda$syncMetadata$2(GridCacheOffheapManager.java:378) [21:01:46]W: [org.apache.ignite:ignite-core] ... 4 more [21:01:46]W: [org.apache.ignite:ignite-core] class org.apache.ignite.IgniteCheckedException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.cast(IgniteUtils.java:7773) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.resolve(GridFutureAdapter.java:260) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.get0(GridFutureAdapter.java:172) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.get(GridFutureAdapter.java:141) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridCompoundFuture.apply(GridCompoundFuture.java:100) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridCompoundFuture.apply(GridCompoundFuture.java:47) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.notifyListener(GridFutureAdapter.java:399) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.unblock(GridFutureAdapter.java:347) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.unblockAll(GridFutureAdapter.java:335) [21:01:46]W: [org.apache.ignite:ignite-core] E at org.apache.ignite.internal.util.future.GridFutureAdapter.onDone(GridFutureAdapter.java:511) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.onDone(GridFutureAdapter.java:490) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.onDone(GridFutureAdapter.java:478) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.lambda$wrapIgniteFuture$3(IgniteUtils.java:11719) [21:01:46]W: [org.apache.ignite:ignite-core] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [21:01:46]W: [org.apache.ignite:ignite-core] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [21:01:46]W: [org.apache.ignite:ignite-core] at java.lang.Thread.run(Thread.java:748) [21:01:46]W: [org.apache.ignite:ignite-core] Caused by: class org.apache.ignite.IgniteException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.lambda$syncMetadata$2(GridCacheOffheapManager.java:381) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.lambda$wrapIgniteFuture$3(IgniteUtils.java:11714) [21:01:46]W: [org.apache.ignite:ignite-core] ... 3 more [21:01:46]W: [org.apache.ignite:ignite-core] 0]][xception in thread "checkpoint-runner-cpu-#1079%failure.IoomFailureHandlerTest1%" Caused by: class org.apache.ignite.internal.processors.cache.persistence.StorageException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.filehandle.FileWriteHandleImpl.checkNode(FileWriteHandleImpl.java:208) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.filehandle.FileWriteHandleImpl.addRecord(FileWriteHandleImpl.java:235) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager.log(FileWriteAheadLogManager.java:910) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager.log(FileWriteAheadLogManager.java:863) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.doInitPage(PageHandler.java:471) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.writePage(PageHandler.java:307) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.initPage(PageHandler.java:244) [21:01:46]W: [org.apache.ignite:ignite-core] , at org.apache.ignite.internal.processors.cache.persistei2nce.DataStructure.init(DataStructure.java:425) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.addStripe(PagesList.java:623) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.getPageForPut(PagesList.java:754) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.put(PagesList.java:859) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList$PutBucket.run(PagesList.java:199) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList$PutBucket.run(PagesList.java:173) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.writePage(PageHandler.java:313) [21:01:46]W: [org.apache.ignite:ignite-core] 1 at org.apache.ignite.internal.processors.cache.persistence.DataStructure.write(DataStructure.java:304) [21:01:46]W: [org.apache.ignite:ignite-core] nvalidated by a previous error), futs=TransformCollectionView [true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, fals flage, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, falses=2]]], , at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.flushBucketsCache(PagesList.java:415) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.saveMetadata(PagesList.java:356) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.saveStoreMetadata(GridCacheOffheapManager.java:403)p [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.lambda$syncMetadata$2(GridCacheOffheapManager.java:378) [21:01:46]W: [org.apache.ignite:ignite-core] ... 4 more [21:01:46]W: [org.apache.ignite:ignite-core] class org.apache.ignite.IgniteCheckedException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.cast(IgniteUtils.java:7773) [21:01:46]W: [org.apache.ignite:ignite-core] : at org.apache.ignite.internal.util.future.GridFutureAdapter.resolve(GridFutureAdapter.java:260) [21:01:46]W: [org.apache.ignite:ignite-core] E at org.apache.ignite.internal.util.future.GridFutureAdapter.get0(GridFutureAdapter.java:172) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.get(GridFutureAdapter.java:141) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridCompoundFuture.apply(GridCompoundFuture.java:100) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridCompoundFuture.apply(GridCompoundFuture.java:47) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.notifyListener(GridFutureAdapter.java:399) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.unblock(GridFutureAdapter.java:347) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.unblockAll(GridFutureAdapter.java:335) [21:01:46]W: [org.apache.ignite:ignite-core] 0 at org.apache.ignite.internal.util.future.GridFutureAdapter.onDone(GridFutureAdapter.java:511) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.onDone(GridFutureAdapter.java:490) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.onDone(GridFutureAdapter.java:478) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.lambda$wrapIgniteFuture$3(IgniteUtils.java:11719) [21:01:46]W: [org.apache.ignite:ignite-core] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [21:01:46]W: [org.apache.ignite:ignite-core] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [21:01:46]W: [org.apache.ignite:ignite-core] at java.lang.Thread.run(Thread.java:748) [21:01:46]W: [org.apache.ignite:ignite-core] Caused by: class org.apache.ignite.IgniteException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.lambda$syncMetadata$2(GridCacheOffheapManager.java:381) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.lambda$wrapIgniteFuture$3(IgniteUtils.java:11714) [21:01:46]W: [org.apache.ignite:ignite-core] ... 3 more [21:01:46]W: [org.apache.ignite:ignite-core] Caused by: class org.apache.ignite.internal.processors.cache.persistence.StorageException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.filehandle.FileWriteHandleImpl.checkNode(FileWriteHandleImpl.java:208) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.filehandle.FileWriteHandleImpl.addRecord(FileWriteHandleImpl.java:235) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager.log(FileWriteAheadLogManager.java:910) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager.log(FileWriteAheadLogManager.java:863) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.doInitPage(PageHandler.java:471) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.writePage(PageHandler.java:307) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.initPage(PageHandler.java:244) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.DataStructure.init(DataStructure.java:425) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.addStripe(PagesList.java:623) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.getPageForPut(PagesList.java:754) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.put(PagesList.java:859) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList$PutBucket.run(PagesList.java:199) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList$PutBucket.run(PagesList.java:173) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.writePage(PageHandler.java:313) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.DataStructure.write(DataStructure.java:304) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.flushBucketsCache(PagesList.java:415) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.saveMetadata(PagesList.java:356) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.saveStoreMetadata(GridCacheOffheapManager.java:403) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.lambda$syncMetadata$2(GridCacheOffheapManager.java:378) [21:01:46]W: [org.apache.ignite:ignite-core] ... 4 more [21:01:46]W: [org.apache.ignite:ignite-core] class org.apache.ignite.IgniteException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.lambda$syncMetadata$2(GridCacheOffheapManager.java:381) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.lambda$wrapIgniteFuture$3(IgniteUtils.java:11714) [21:01:46]W: [org.apache.ignite:ignite-core] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [21:01:46]W: [org.apache.ignite:ignite-core] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [21:01:46]W: [org.apache.ignite:ignite-core] at java.lang.Thread.run(Thread.java:748) [21:01:46]W: [org.apache.ignite:ignite-core] Caused by: class org.apache.ignite.internal.processors.cache.persistence.StorageException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.filehandle.FileWriteHandleImpl.checkNode(FileWriteHandleImpl.java:208) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.filehandle.FileWriteHandleImpl.addRecord(FileWriteHandleImpl.java:235) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager.log(FileWriteAheadLogManager.java:910) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager.log(FileWriteAheadLogManager.java:863) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.doInitPage(PageHandler.java:471) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.writePage(PageHandler.java:307) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.initPage(PageHandler.java:244) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.DataStructure.init(DataStructure.java:425) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.addStripe(PagesList.java:623) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.getPageForPut(PagesList.java:754) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.put(PagesList.java:859) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList$PutBucket.run(PagesList.java:199) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList$PutBucket.run(PagesList.java:173) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.writePage(PageHandler.java:313) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.DataStructure.write(DataStructure.java:304) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.flushBucketsCache(PagesList.java:415) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.saveMetadata(PagesList.java:356) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.saveStoreMetadata(GridCacheOffheapManager.java:403) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.lambda$syncMetadata$2(GridCacheOffheapManager.java:378) [21:01:46]W: [org.apache.ignite:ignite-core] ... 4 more [21:01:46]W: [org.apache.ignite:ignite-core] repared=0, locked= false, false, false, [21:01:46] (err) Failed to execute compound future reducer: GridCompoundFuture [rdc=null, initFlag=1, lsnrCalls=23, size=603, done=true, cancelled=false, err=class o.a.i.IgniteCheckedException: Failed to perform WAL operation (environment was invEalidated by a previous error), futs=TransformCollectionVfalse, nodeId=null, locMapped=false, expiryPlc=null, transferExpiryPlc=false, flags=0, partUpdateCntr=1, serReadVer=null, xidVer=GridCacheVersion [topVer=248824893, order=1637344893065, nodeOrder=2]], IgniteTxEntry [txKey=IgniteTxKey [key=KeyCacheObjectImpl [part=11, val=11, hasValBytes=true], cacheId=1544803905], val=TxEntryValueHolder [val=CacheObjectByteArrayImpl [arrLen=1364], op=CREATE], prevVal=TxEntryValueHolder [val=null, op=NOOP], oldVal=TxEntryValueHolder [val=null, op=NOOP], entryProcessorsCol=null, ttl=-1, conflictExpireTime=-1, conflictVer=null, explicitVer=null, dhtVer=null, filters=CacheEntryP1:46] (err) Failed to execute compound future reducer: GridCompoundFuture [rdc=null, initFlag=1, lsnrCalls=21, size=603, done=true, cancelled=false, err=class o.a.i.IgniteCheckedExceptio[2n: Failed to perform WAL operation (environment was invalidated by a previous error), futs=TransformCollectionView [true, true, true, true, true, true, true, truiew [true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false... and 503 more]]class org.apache.ignite.IgniteCheckedException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ixfgnite.internal.util.IgniteUtils.cast(IgniteUtils.java:7773) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.resolve(GridFutureAdapter.java:260) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.get0(GridFutureAdapter.java:172) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.get(GridFutureAdapter.java:141) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridCompoundFuture.apply(GridCompoundFuture.java:100) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridCompoundFuture.apply(GridCompoundFuture.java:47) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.notifyListener(GridFutureAdapter.java:399) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.unblock(GridFutureAdapter.java:347) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.unblockAll(GridFutureAdapter.java:335) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.onDone(GridFutureAdapter.java:511) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.onDone(GridFutureAdapter.java:490) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.onDone(GridFutureAdapter.java:478) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.lambda$wrapIgniteFuture$3(IgniteUtils.java:11719) [21:01:46]W: [org.apache.ignite:ignite-core] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [21:01:46]W: [org.apache.ignite:ignite-core] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [21:01:46]W: [org.apache.ignite:ignite-core] at java.lang.Thread.run(Thread.java:748) [21:01:46]W: [org.apache.ignite:ignite-core] Caused by: class org.apache.ignite.IgniteException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.lambda$syncMetadata$2(GridCacheOffheapManager.java:381) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.lambda$wrapIgniteFuture$3(IgniteUtils.java:11714) [21:01:46]W: [org.apache.ignite:ignite-core] ... 3 more [21:01:46]W: [org.apache.ignite:ignite-core] Caused by: class org.apache.ignite.internal.processors.cache.persistence.StorageException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.filehandle.FileWriteHandleImpl.checkNode(FileWriteHandleImpl.java:208) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.filehandle.FileWriteHandleImpl.addRecord(FileWriteHandleImpl.java:235) [21:01:46]W: [org.apache.ignite:ignite-core] xe1r at org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager.log(FileWriteAheadLogManager.java:910) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager.log(FileWriteAheadLogManager.java:863) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.doInitPage(PageHandler.java:471) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.writePage(PageHandler.java:307) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.initPage(PageHandler.java:244) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.DataStructure.init(DataStructure.java:425) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.addStripe(PagesList.java:623) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.getPageForPut(PagesList.java:754) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.put(PagesList.java:859) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList$PutBucket.run(PagesList.java:199) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList$PutBucket.run(PagesList.java:173) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.writePage(PageHandler.java:313) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.DataStructure.write(DataStructure.java:304) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.flushBucketsCache(PagesList.java:415) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.saveMetadata(PagesList.java:356) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.saveStoreMetadata(GridCacheOffheapManager.java:403) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.lambda$syncMetadata$2(GridCacheOffheapManager.java:378) [21:01:46]W: [org.apache.ignite:ignite-core] ... 4 more [21:01:46]W: [org.apache.ignite:ignite-core] Exceptioe:,01:46dican ite[] [],] (err) Failed to execute compound future reducer: GridCompoundFuture [rdc=null, initFlag=1, lsnrCalls=22, size=603, done=true, cancelled=false, err=class o.a.i.IgniteCheckedException: Failed to perform WAL operation (environment was invalidated by a previous error), futs=Transfo[ true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, false, false, false, false, false, false, false, false, false, false, false, false, false21:01:46] (err) Failed to execute compound ceaception in thread "checkpoint-runner-cpu-#1077%failure.IoomFailureHandlerTest1rmCollectionView filtersPassed=falsen thre, filtersSet=false, [tr%" lse, false, falseclass org.apache.ignite.IgniteException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:46]W: [org.apache.ignite:ignite-core] , at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.lambda$syncMetadata$2(GridCacheOffheapManager.java:381) [21:01:46]W: [org.apache.ignite:ignite-core] pf, at org.apache.ignite.internal.util.IgniteUtils.lambda$wrapIgniteFuture$3(IgniteUtils.java:11714) [21:01:46]W: [org.apache.ignite:ignite-core] u aat java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [21:01:46]W: [org.apache.ignite:ignite-core] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [21:01:46]W: [org.apache.ignite:ignite-core] at java.lang.Thread.run(Thread.java:748) [21:01:46]W: [org.apache.ignite:ignite-core] Caused by: class org.apache.ignite.internal.processors.cache.persistence.StorageException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.filehandle.FileWriteHandleImpl.checkNode(FileWriteHandleImpl.java:208) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.filehandle.FileWriteHandleImpl.addRecord(FileWriteHandleImpl.java:235) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager.log(FileWriteAheadLogManager.java:910) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager.log(FileWriteAheadLogManager.java:863) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.doInitPage(PageHandler.java:471) [21:01:46]W: [org.apache.ignite:ignite-core] uat org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.writePage(PageHandler.java:307) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.initPage(PageHandler.java:244) [21:01:46]W: [org.apache.ignite:ignite-core] tat org.apache.ignite.internal.processors.cache.persistence.DataStructure.init(DataStructure.java:425) [21:01:46]W: [org.apache.ignite:ignite-core] false, false, false, false, false, false, false, false... and 503 more]] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.addStripe(PagesList.java:623) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.getPageForPut(PagesList.java:754) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.put(PagesList.java:859) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList$PutBucket.run(PagesList.java:199) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList$PutBucket.run(PagesList.java:173) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.writePage(PageHandler.java:313) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.DataStructure.write(DataStructure.java:304) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.flushBucketsCache(PagesList.java:415) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.igniite.internal.processors.cache.persistence.freelist.PagesList.saveMetadata(PagesList.java:356) [21:01:46]W: [org.apache.ignite:ignite-core] t at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.saveStoreMetadata(GridCacheOffheapManager.java:403) [21:01:46]W: [org.apache.ignite:ignite-core] at ofrg.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.lambda$syncMetadata$2(GridCacheOffheapManager.java:378) [21:01:46]W: [org.apache.ignite:ignite-core] ... 4 more [21:01:46]W: [org.apache.ignite:ignite-core] class org.apache.ignite.IgniteCheckedException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.cast(IgniteUtils.java:7773) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.resolve(GridFutureAdapter.java:260) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.get0(GridFutureAdapter.java:172) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.get(GridFutureAdapter.java:141) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridCompoundFuture.apply(GridCompoundFuture.java:100) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridCompoundFuture.apply(GridCompoundFuture.java:47) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.notifyListener(GridFutureAdapter.java:399) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.unblock(GridFutureAdapter.java:347) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.unblockAll(GridFutureAdapter.java:335) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.onDone(GridFutureAdapter.java:511) [21:01:46]W: [org.apache.ignite:ignite-core] adt org.apache.ignite.internal.util.future.GridFutureAdapter.onDone(GridFutureAdapter.java:490) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.onDone(GridFutureAdapter.java:478) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.lambda$wrapIgniteFuture$3(IgniteUtils.java:11719) [21:01:46]W: [org.apache.ignite:ignite-core] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [21:01:46]W: [org.apache.ignite:ignite-core] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [21:01:46]W: [org.apache.ignite:ignite-core] e at java.lang.Thread.run(Thread.java:748) [21:01:46]W: [org.apache.ignite:ignite-core] Caused by: class org.apache.ignite.IgniteException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.lambda$syncMetadata$2(GridCacheOffheapManager.java:381) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.lambda$wrapIgniteFuture$3(IgniteUtils.java:11714) [21:01:46]W: [org.apache.ignite:ignite-core] ... 3 more [21:01:46]W: [org.apache.ignite:ignite-core] e, true, true, true, true, true, true, true, true, Caused by: class org.apache.ignite.internal.processors.cache.persistence.StorageException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.filehandle.FileWriteHandleImpl.checkNode(FileWriteHandleImpl.java:208) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.filehandle.FileWriteHandleImpl.addRecord(FileWriteHandleImpl.java:235) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager.log(FileWriteAheadLogManager.java:910) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager.log(FileWriteAheadLogManager.java:863) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.doInitPage(PageHandler.java:471) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.writePage(PageHandler.java:307) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.initPage(PageHandler.java:244) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.DataStructure.init(DataStructure.java:425) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.addStripe(PagesList.java:623) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.getPageForPut(PagesList.java:754) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.put(PagesList.java:859) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList$PutBucket.run(PagesList.java:199) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList$PutBucket.run(PagesList.java:173) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.writePage(PageHandler.java:313) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.DataStructure.write(DataStructure.java:304) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.flushBucketsCache(PagesList.java:415) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.saveMetadata(PagesList.java:356) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.saveStoreMetadata(GridCacheOffheapManager.java:403) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.lambda$syncMetadata$2(GridCacheOffheapManager.java:378) [21:01:46]W: [org.apache.ignite:ignite-core] ... 4 more [21:01:46]W: [org.apache.ignite:ignite-core] ntry=G alse, urrie reduceon in threadfalse, false,"checkpoint-runner-cpu-#108 f "checkpoint-runner-cpu-#1078%failure.IoomFailureHandlerTest1%" class org.apache.ignite.IgniteException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.lambda$syncMetadata$2(GridCacheOffheapManager.java:381) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.lambda$wrapIgniteFuture$3(IgniteUtils.java:11714) [21:01:46]W: [org.apache.ignite:ignite-core] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [21:01:46]W: [org.apache.ignite:ignite-core] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [21:01:46]W: [org.apache.ignite:ignite-core] E at java.rtdlang.Threada2.run(Thread.java:748) [21:01:46]W: [org.apache.ignite:ignite-core] %Caused by: class org.apache.ignite.internal.processors.cache.persistence.StorageException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.filehandle.FileWriteHandleImpl.checkNode(FileWriteHandleImpl.java:208) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.filehandle.FileWriteHandleImpl.addRecord(FileWriteHandleImpl.java:235) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager.log(FileWriteAheadLogManager.java:910) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager.log(FileWriteAheadLogManager.java:863) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.doInitPage(PageHandler.java:471) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.writePage(PageHandler.java:307) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.initPage(PageHandler.java:244) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.DataStructure.init(DataStructure.java:425) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.addStripe(PagesList.java:623) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.getPageForPut(PagesList.java:754) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.put(PagesList.java:859) [21:01:46]W: [org.apache.ignite:ignite-core] lat org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList$PutBucket.run(PagesList.java:199) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.inteDrnal.processors.cache.persistence.freelist.PagesList$PutBucket.run(PagesList.java:173) [21:01:46]W: [org.apache.ignite:ignite-core] art org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.writePage(PageHandler.java:313) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.DataStructure.write(DataStructure.java:304): [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.flushBucketsCache(PagesList.java:415) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.saveMetadata(PagesList.java:356) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.saveStoreMetadata(GridCacheOffheapManager.java:403) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.lambda$syncMetadata$2(GridCacheOffheapManager.java:378) [21:01:46]W: [org.apache.ignite:ignite-core] ... 4 more [21:01:46]W: [org.apache.ignite:ignite-core] xcep GridCompotiundFuture [rdc=null, initFlag=1on in threa, lsnrCd "checkalls=24, size=603, done=true, cancepoinlled=falst-e, ruerr=clnnerass -o.a.cpui.IgniteCheckedException: Failed to perform WAL operation (environment was invalidated by a previous error), futs=TransformCollectionView [true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, fals-#1074%faie, false, falselur, fae.IoomFailse, false, fallureHasendle, farTlsest1%e, " falsclass org.apache.ignite.IgniteException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.lambda$syncMetadata$2(GridCacheOffheapManager.java:381) [21:01:46]W: [org.apache.ignite:ignite-core] u at org.apache.ignite.internal.util.IgniteUtils.lambda$wrapIgniteFuture$3(IgniteUtils.java:11714) [21:01:46]W: [org.apache.ignite:ignite-core] hat java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [21:01:46]W: [org.apache.ignite:ignite-core] sat java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [21:01:46]W: [org.apache.ignite:ignite-core] [ at java.lang.Thread.run(Thread.java:748) [21:01:46]W: [org.apache.ignite:ignite-core] Caused by: class org.apache.ignite.internal.processors.cache.persistence.StorageException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.filehandle.FileWriteHandleImpl.checkNode(FileWriteHandleImpl.java:208) [21:01:46]W: [org.apache.ignite:ignite-core] fat org.apache.ignite.internal.processors.cache.persistence.wal.filehandle.FileWriteHandleImpl.addRecord(FileWriteHandleImpl.java:235) [21:01:46]W: [org.apache.ignite:ignite-core] a2t org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager.log(FileWriteAheadLogManager.java:910) [21:01:46]W: [org.apache.ignite:ignite-core] eat org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager.log(FileWriteAheadLogManager.java:863) [21:01:46]W: [org.apache.ignite:ignite-core] at org.atpache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.doInitPage(PageHandler.java:471) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.writePage(PageHandler.java:307) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.initPage(PageHandler.java:244) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.DataStructure.init(DataStructure.java:425) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.addStripe(PagesList.java:623) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.getPageForPut(PagesList.java:754) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.put(PagesList.java:859) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList$PutBucket.run(PagesList.java:199) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList$PutBucket.run(PagesList.java:173) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.writePage(PageHandler.java:313) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.DataStructure.write(DataStructure.java:304) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.flushBucketsCache(PagesList.java:415) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.saveMetadata(PagesList.java:356) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.saveStoreMetadata(GridCacheOffheapManager.java:403) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.lambda$syncMetadata$2(GridCacheOffheapManager.java:378) [21:01:46]W: [org.apache.ignite:ignite-core] ... 4 more [21:01:46]W: [org.apache.ignite:ignite-core] e, true, true, true, true, true, true, true, truee,, t false, false, falrusee,, trufae,ls te, fruale,se t, farue, true, true, true, true,ls fe,al fsealCac, false, false,, false, false, false, false, false, 1:0heEntry [rdrs=ReaderId[] [], part=11, super=GridDistributedCacheEntry [super=GridCacheMapEntry [key=KeyCacheObjectImpl [part=11, val=11, hasValBytes=true], val=null, ver=GridCacheVersion [topVer=248824893, order=1637344893065, nodeOrder=2], se, false, false, false, false, false, fhash1:46] (err) Failed to execute compound future reducer: GridCompoundFuture [rdc=null, initFlagfalse, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false... and 503 more]]class org.apache.ignite.IgniteCheckedException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.cast(IgniteUtils.java:7773) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.resolve(GridFutureAdapter.java:260) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.get0(GridFutureAdapter.java:172) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.get(GridFutureAdapter.java:141) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridCompoundFuture.apply(GridCompoundFuture.java:100) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridCompoundFuture.apply(GridCompoundFuture.java:47) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.notifyListener(GridFutureAdapter.java:399) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.unblock(GridFutureAdapter.java:347) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.unblockAll(GridFutureAdapter.java:335) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.onDone(GridFutureAdapter.java:511) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.onDone(GridFutureAdapter.java:490) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.onDone(GridFutureAdapter.java:478) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.lambda$wrapIgniteFuture$3(IgniteUtils.java:11719) [21:01:46]W: [org.apache.ignite:ignite-core] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [21:01:46]W: [org.apache.ignite:ignite-core] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [21:01:46]W: [org.apache.ignite:ignite-core] at java.lang.Thread.run(Thread.java:748) [21:01:46]W: [org.apache.ignite:ignite-core] Caused by: class org.apache.ignite.IgniteException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.lambda$syncMetadata$2(GridCacheOffheapManager.java:381) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.lambda$wrapIgniteFuture$3(IgniteUtils.java:11714) [21:01:46]W: [org.apache.ignite:ignite-core] ... 3 more [21:01:46]W: [org.apache.ignite:ignite-core] ailure.IoomFailureHandlerTest1Caused by: class org.apache.ignite.internal.processors.cache.persistence.StorageException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.filehandle.FileWriteHandleImpl.checkNode(FileWriteHandleImpl.java:208) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.filehandle.FileWriteHandleImpl.addRecord(FileWriteHandleImpl.java:235) [21:01:46]W: [org.apache.ignite:ignite-core] % at org==a.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager.log(FileWriteAheadLogManager.java:910) [21:01:46]W: [org.apache.ignite:ignite-core] atl org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager.log(FileWriteAheadLogManager.java:863) [21:01:46]W: [org.apache.ignite:ignite-core] 11, extras=GridCacheObsoleteEntryExtras [obsoleteVer=GridCacheVersion [topVer=2147483647, order=0, nodeOr1,false" , false, falsese,der=0]], flags=2]]], prepared=0, locked=false fal at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.doInitPage(PageHandler.java:471) [21:01:46]W: [org.apache.ignite:ignite-core] s, ,at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.writePage(PageHandler.java:307) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.initPage(PageHandler.java:244) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.DataStructure.init(DataStructure.java:425) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.addStripe(PagesList.java:623) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.getPageForPut(PagesList.java:754) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.put(PagesList.java:859) [21:01:46]W: [org.apache.ignite:ignite-core] atl org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList$PutBucket.run(PagesList.java:199) [21:01:46]W: [org.apache.ignite:ignite-core] fae, flssnrC at orage.apache.ignite.internal.processors.cache.persistence.freelist.PagesList$PutBucket.run(PagesList.java:173) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.writePage(PageHandler.java:313) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.DataStructure.write(DataStructure.java:304) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.flushBucketsCache(PagesList.java:415) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.saveMetadata(PagesList.java:356) [21:01:46]W: [org.apache.ignite:ignite-core] at norg.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.saveStoreMetadata(GridCacheOffheapManager.java:403) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.lambda$syncMetadata$2(GridCacheOffheapManager.java:378) [21:01:46]W: [org.apache.ignite:ignite-core] ... 4 more [21:01:46]W: [org.apache.ignite:ignite-core] , false, fclass org.apache.ignite.IgniteException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:46]W: [org.apache.ignite:ignite-core] at lorg.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.lambda$syncMetadata$2(GridCacheOffheapManager.java:381) [21:01:46]W: [org.apache.ignite:ignite-core] aat org.apache.ignite.internal.util.IgniteUtils.lambda$wrapIgniteFuture$3(IgniteUtils.java:11714) [21:01:46]W: [org.apache.ignite:ignite-core] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [21:01:46]W: [org.apache.ignite:ignite-core] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [21:01:46]W: [org.apache.ignite:ignite-core] at java.lang.Thread.run(Thread.java:748) [21:01:46]W: [org.apache.ignite:ignite-core] Caused by: class org.apache.ignite.internal.processors.cache.persistence.StorageException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.filehandle.FileWriteHandleImpl.checkNode(FileWriteHandleImpl.java:208) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.filehandle.FileWriteHandleImpl.addRecord(FileWriteHandleImpl.java:235) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager.log(FileWriteAheadLogManager.java:910) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager.log(FileWriteAheadLogManager.java:863) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.doInitPage(PageHandler.java:471) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.writePage(PageHandler.java:307) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.initPage(PageHandler.java:244) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.DataStructure.init(DataStructure.java:425) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.addStripe(PagesList.java:623) [21:01:46]W: [org.apache.ignite:ignite-core] s at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.getPageForPut(PagesList.java:754) [21:01:46]W: [org.apache.ignite:ignite-core] aat org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.put(PagesList.java:859) [21:01:46]W: [org.apache.ignite:ignite-core] o at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList$PutBucket.run(PagesList.java:199) [21:01:46]W: [org.apache.ignite:ignite-core] at dorg.apache.ignite.internal.processors.cache.persistence.freelist.PagesList$PutBucket.run(PagesList.java:173) [21:01:46]W: [org.apache.ignite:ignite-core] lat org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.writePage(PageHandler.java:313) [21:01:46]W: [org.apache.ignite:ignite-core] ate org.apache.ignite.internal.processors.cache.persistence.DataStructure.write(DataStructure.java:304) [21:01:46]W: [org.apache.ignite:ignite-core] [ at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.flushBucketsCache(PagesList.java:415) [21:01:46]W: [org.apache.ignite:ignite-core] E at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.saveMetadata(PagesList.java:356) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.saveStoreMetadata(GridCacheOffheapManager.java:403) [21:01:46]W: [org.apache.ignite:ignite-core] lat org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.lambda$syncMetadata$2(GridCacheOffheapManager.java:378) [21:01:46]W: [org.apache.ignite:ignite-core] ... 4 more [21:01:46]W: [org.apache.ignite:ignite-core] xception in thread "checkpoint-runner-cpu-#1081%failure.IoomFailureHandlerTest1%" class org.apache.ignite.IgniteException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.lambda$syncMetadata$2(GridCacheOffheapManager.java:381) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.lambda$wrapIgniteFuture$3(IgniteUtils.java:11714) [21:01:46]W: [org.apache.ignite:ignite-core] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [21:01:46]W: [org.apache.ignite:ignite-core] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [21:01:46]W: [org.apache.ignite:ignite-core] at java.lang.Thread.run(Thread.java:748) [21:01:46]W: [org.apache.ignite:ignite-core] 2Caused by: class org.apache.ignite.internal.processors.cache.persistence.StorageException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:46]W: [org.apache.ignite:ignite-core] at or,g.apache.ignite.internal.processors.cache.persistence.wal.filehandle.FileWriteHandleImpl.checkNode(FileWriteHandleImpl.java:208) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.filehandle.FileWriteHandleImpl.addRecord(FileWriteHandleImpl.java:235) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager.log(FileWriteAheadLogManager.java:910) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager.log(FileWriteAheadLogManager.java:863) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.doInitPage(PageHandler.java:471) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.writePage(PageHandler.java:307) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.initPage(PageHandler.java:244) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.DataStructure.init(DataStructure.java:425) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.addStripe(PagesList.java:623) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.getPageForPut(PagesList.java:754) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.put(PagesList.java:859) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList$PutBucket.run(PagesList.java:199) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList$PutBucket.run(PagesList.java:173) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.writePage(PageHandler.java:313) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.DataStructure.write(DataStructure.java:304) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.flushBucketsCache(PagesList.java:415) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.saveMetadata(PagesList.java:356) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.saveStoreMetadata(GridCacheOffheapManager.java:403) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.lambda$syncMetadata$2(GridCacheOffheapManager.java:378) [21:01:46]W: [org.apache.ignite:ignite-core] ... 4 more [21:01:46]W: [org.apache.ignite:ignite-core] seId=null 1:01:46] (err) Failed to execute compound future reducer: GridCompoundFuture [rdc=null, initFlag=1, lsnrCalls=26, size=603, done=true, cancelled=false, err=class o.a.i.IgniteCheckedException: Failed to perform WAL operation (environment was invalidated by a previous error), futs=TransformCollectionView [true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false... and 503 more]]e, false, fls=25, siclasf,s orag.apache.ignite.IgniteCheckedException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:46]W: [org.apache.ignite:ignite-core] lse, false, faz at org.apachlae.ignite.internal.util.IgniteUtils.cast(IgniteUtils.java:7773) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignlite.internal.util.future.GridFutureAdapter.resolve(GridFutureAdapter.java:260) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.get0(GridFutureAdapter.java:172) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.get(GridFutureAdapter.java:141) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridCompoundFuture.apply(GridCompoundFuture.java:100) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridCompoundFuture.apply(GridCompoundFuture.java:47) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.notifyListener(GridFutureAdapter.java:399) [21:01:46]W: [org.apache.ignite:ignite-core] ast org.apache.ignite.internal.util.future.GridFutureAdapter.unblock(GridFutureAdapter.java:347) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.unblockAll(GridFutureAdapter.java:335) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.onDone(GridFutureAdapter.java:511) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.onDone(GridFutureAdapter.java:490) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.onDone(GridFutureAdapter.java:478) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.lambda$wrapIgniteFuture$3(IgniteUtils.java:11719) [21:01:46]W: [org.apache.ignite:ignite-core] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [21:01:46]W: [org.apache.ignite:ignite-core] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [21:01:46]W: [org.apache.ignite:ignite-core] at java.lang.Thread.run(Thread.java:748) [21:01:46]W: [org.apache.ignite:ignite-core] Caused by: class org.apache.ignite.IgniteException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.lambda$syncMetadata$2(GridCacheOffheapManager.java:381) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.lambda$wrapIgniteFuture$3(IgniteUtils.java:11714) [21:01:46]W: [org.apache.ignite:ignite-core] ... 3 more [21:01:46]W: [org.apache.ignite:ignite-core] locMapped=false, expe=603, done=true, cancelled=false, err=class o.a.e, false, falsi.IgniteCheckedException: Failed to perform WAL operiryPlc=null, tCaused by: class org.apache.igniteae.internal.processors.cache.persistence.StorageException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.filehandle.FileWriteHandleImpl.checkNode(FileWriteHandleImpl.java:208) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.filehandle.FileWriteHandleImpl.addRecord(FileWriteHandleImpl.java:235) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager.log(FileWriteAheadLogManager.java:910) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager.log(FileWriteAheadLogManager.java:863) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.doInitPage(PageHandler.java:471) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.writePage(PageHandler.java:307) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.initPage(PageHandler.java:244) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apsache.ignite.internal.processors.cache.persistence.DataStructure.init(DataStructure.java:425) [21:01:46]W: [org.apache.ignite:ignite-core] a,t org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.addStripe(PagesList.java:623) [21:01:46]W: [org.apache.ignite:ignite-core] t at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.getPageForPut(PagesList.java:754) [21:01:46]W: [org.apache.ignite:ignite-core] at rorg.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.put(PagesList.java:859) [21:01:46]W: [org.apache.ignite:ignite-core] iat org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList$PutBucket.run(PagesList.java:199) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList$PutBucket.run(PagesList.java:173) [21:01:46]W: [org.apache.ignite:ignite-core] a t org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.writePage(PageHandler.java:313) [21:01:46]W: [org.apache.ignite:ignite-core] eat org.apache.ignite.internal.processors.cache.persistence.DataStructure.write(DataStructure.java:304) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.flushBucketsCache(PagesList.java:415) [21:01:46]W: [org.apache.ignite:ignite-core] fat org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.saveMetadata(PagesList.java:356) [21:01:46]W: [org.apache.ignite:ignite-core] o at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.saveStoreMetadata(GridCacheOffheapManager.java:403) [21:01:46]W: [org.apache.ignite:ignite-core] at orga.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.lambda$syncMetadata$2(GridCacheOffheapManager.java:378) [21:01:46]W: [org.apache.ignite:ignite-core] ... 4 more [21:01:46]W: [org.apache.ignite:ignite-core] n (enalse,viro false, false, fa,nsferExnmepiryPlc=false, fla false... anlse, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false... and 503 more]]class org.apache.ignite.IgniteCheckedException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.cast(IgniteUtils.java:7773) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.resolve(GridFutureAdapter.java:260) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.get0(GridFutureAdapter.java:172) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.get(GridFutureAdapter.java:141) [21:01:46]W: [org.apache.ignite:ignite-core] [dgn at org.apache.ignite.internal.util.future.GridCompoundFuture.apply(GridCompoundFuture.java:100) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridCompoundFutEure.apply(GridCompoundFuture.java:47) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.notifyListener(GridFutureAdapter.java:399) [21:01:46]W: [org.apache.ignite:ignite-core] tat org.apache.ignite.internal.util.future.GridFutureAdapter.unblock(GridFutureAdapter.java:347) [21:01:46]W: [org.apache.ignite:ignite-core] ast org.apache.ignite.internal.util.future.GridFutureAdapter.unblockAll(GridFutureAdapter.java:335) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.onDone(GridFutureAdapter.java:511) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.onDone(GridFutureAdapter.java:490) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.onDone(GridFutureAdapter.java:478) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.lambda$wrapIgniteFuture$3(IgniteUtils.java:11719) [21:01:46]W: [org.apache.ignite:ignite-core] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [21:01:46]W: [org.apache.ignite:ignite-core] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [21:01:46]W: [org.apache.ignite:ignite-core] at java.lang.Thread.run(Thread.java:748) [21:01:46]W: [org.apache.ignite:ignite-core] Caused by: class org.apache.ignite.IgniteException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:46]W: [org.apache.ignite:ignite-core] a t org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.lambda$syncMetadata$2(GridCacheOffheapManager.java:381) [21:01:46]W: [org.apache.ignite:ignite-core] 2at org.apache.ignite.internal.util.IgniteUtils.lambda$wrapIgniteFuture$3(IgniteUtils.java:11714) [21:01:46]W: [org.apache.ignite:ignite-core] ... 3 more [21:01:46]W: [org.apache.ignite:ignite-core] Caused by: class org.apache.ignite.internal.processors.cache.persistence.StorageException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.filehandle.FileWriteHandleImpl.checkNode(FileWriteHandleImpl.java:208) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.filehandle.FileWriteHandleImpl.addRecord(FileWriteHandleImpl.java:235) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager.log(FileWriteAheadLogManager.java:910) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager.log(FileWriteAheadLogManager.java:863) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.doInitPage(PageHandler.java:471) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.writePage(PageHandler.java:307) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.initPage(PageHandler.java:244) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.DataStructure.init(DataStructure.java:425) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.addStripe(PagesList.java:623) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.getPageForPut(PagesList.java:754) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.put(PagesList.java:859) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList$PutBucket.run(PagesList.java:199) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList$PutBucket.run(PagesList.java:173) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.writePage(PageHandler.java:313) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.DataStructure.write(DataStructure.java:304) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.flushBucketsCache(PagesList.java:415) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.saveMetadata(PagesList.java:356) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.saveStoreMetadata(GridCacheOffheapManager.java:403) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apach5e.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.lambda$syncMetadata$2(GridCacheOffheapManager.java:378) [21:01:46]W: [org.apache.ignite:ignite-core] = ... 4 more [21:01:46]W: [org.apache.ignite:ignite-core] was invalidated by a previous error), futs=TransformCollectionView [true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false... and 503 more]]xcep03 01:01:46] (err) more]]class org.apache.ignite.IgniteCheckedException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:46]W: [org.apache.ignite:ignite-core] Exception in thread "checkpoint-runner at org.apache.ignite.internal.util.IgniteUtils.cast(IgniteUtils.java:7773) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.resolve(GridFutureAdapter.java:260) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.get0(GridFutureAdapter.java:172) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.get(GridFutureAdapter.java:141) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridCompoundFuture.apply(GridCompoundFuture.java:100) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridCompoundFuture.apply(GridCompoundFuture.java:47) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.notifyListener(GridFutureAdapter.java:399) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.unblock(GridFutureAdapter.java:347) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.unblockAll(GridFutureAdapter.java:335) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.onDone(GridFutureAdapter.java:511) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.onDone(GridFutureAdapter.java:490) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.onDone(GridFutureAdapter.java:478) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.lambda$wrapIgniteFuture$3(IgniteUtils.java:11719) [21:01:46]W: [org.apache.ignite:ignite-core] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [21:01:46]W: [org.apache.ignite:ignite-core] at java.uttil.concurrent.ThreadPoolExeF,cutor$Worker.run(ThreadPoolExecutor.java:624) [21:01:46]W: [org.apache.ignite:ignite-core] at java.lang.Thread.run(Thread.java:748) [21:01:46]W: [org.apache.ignite:ignite-core] Caused by: class org.apache.ignite.IgniteException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.lambda$syncMetadata$2(GridCacheOffheapManager.java:381) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.lambda$wrapIgniteFuture$3(IgniteUtils.java:11714) [21:01:46]W: [org.apache.ignite:ignite-core] ... 3 more [21:01:46]W: [org.apache.ignite:ignite-core] Caused by: class org.apache.ignite.internal.processors.cache.persistence.StorageException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.filehandle.FileWriteHandleImpl.checkNode(FileWriteHandleImpl.java:208) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.filehandle.FileWriteHandleImpl.addRecord(FileWriteHandleImpl.java:235) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager.log(FileWriteAheadLogManager.java:910) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager.log(FileWriteAheadLogManager.java:863) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.doInitPage(PageHandler.java:471) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.writePage(PageHandler.java:307) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.initPage(PageHandler.java:244) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.DataStructure.init(DataStructure.java:425) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.addStripe(PagesList.java:623) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.getPageForPut(PagesList.java:754) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.put(PagesList.java:859) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList$PutBucket.run(PagesList.java:199) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList$PutBucket.run(PagesList.java:173) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.writePage(PageHandler.java:313) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.DataStructure.write(DataStructure.java:304) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.flushBucketsCache(PagesList.java:415) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.saveMetadata(PagesList.java:356) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.saveStoreMetadata(GridCacheOffheapManager.java:403) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.lambda$syncMetadata$2(GridCacheOffheapManager.java:378) [21:01:46]W: [org.apache.ignite:ignite-core] ... 4 more [21:01:46]W: [org.apache.ignite:ignite-core] [21:01:46] (err) Failed to execute compound future reducer: GridCompoundFuture [rdc=null, initFlag=1, lsnrCalls=28, size=603, done=true, cancelled=false, err=class o.a.i.IgniteCheckedException: Failed to perform WAL operation (environment was invalidated by a previous class org.apache.ignite.IgniteCheckedException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.cast(IgniteUtils.java:7773) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.resolve(GridFutureAdapter.java:260) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.get0(GridFutureAdapter.java:172) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.get(GridFutureAdapter.java:141) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridCompoundFuture.apply(GridCompoundFuture.java:100) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridCompoundFuture.apply(GridCompoundFuture.java:47) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.notifyListener(GridFutureAdapter.java:399) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.unblock(GridFutureAdapter.java:347) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.unblockAll(GridFutureAdapter.java:335) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.onDone(GridFutureAdapter.java:511) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.onDone(GridFutureAdapter.java:490) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.onDone(GridFutureAdapter.java:478) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.lambda$wrapIgniteFuture$3(IgniteUtils.java:11719) [21:01:46]W: [org.apache.ignite:ignite-core] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [21:01:46]W: [org.apache.ignite:ignite-core] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [21:01:46]W: [org.apache.ignite:ignite-core] at java.lang.Thread.run(Thread.java:748) [21:01:46]W: [org.apache.ignite:ignite-core] Caused by: class org.apache.ignite.IgniteException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.lambda$syncMetadata$2(GridCacheOffheapManager.java:381) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.lambda$wrapIgniteFuture$3(IgniteUtils.java:11714) [21:01:46]W: [org.apache.ignite:ignite-core] - ... 3 more [21:01:46]W: [org.apache.ignite:ignite-core] [21:01:46] (err) Failed to execute compound future reCaused by: class org.apache.ignite.internal.processors.cache.persistence.StorageException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:46]W: [org.apache.ignite:ignite-core] E at org.apache.ignite.internal.processors.cache.persistence.wal.filehandle.FileWriteHandleImpl.checkNode(FileWriteHandleImpl.java:208) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.filehandle.FileWriteHandleImpl.addRecord(FileWriteHandleImpl.java:235) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager.log(FileWriteAheadLogManager.java:910) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager.log(FileWriteAheadLogManager.java:863) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.doInitPage(PageHandler.java:471) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.writePage(PageHandler.java:307) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.initPage(PageHandler.java:244) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.DataStructure.init(DataStructure.java:425) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.addStripe(PagesList.java:623) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.getPageForPut(PagesList.java:754) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.put(PagesList.java:859) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList$PutBucket.run(PagesList.java:199) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList$PutBucket.run(PagesList.java:173) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.writePage(PageHandler.java:313) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.DataStructure.write(DataStructure.java:304) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.flushBucketsCache(PagesList.java:415) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.saveMetadata(PagesList.java:356) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.saveStoreMetadata(GridCacheOffheapManager.java:403) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.lambda$syncMetadata$2(GridCacheOffheapManager.java:378) [21:01:46]W: [org.apache.ignite:ignite-core] ... 4 more [21:01:46]W: [org.apache.ignite:ignite-core] Exception in thread "checkpoint-runner-cpu-#1084%failure.IoomFailureHandlerTest1%" class org.apache.ignite.IgniteException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.lambda$syncMetadata$2(GridCacheOffheapManager.java:381) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.lambda$wrapIgniteFuture$3(IgniteUtils.java:11714) [21:01:46]W: [org.apache.ignite:ignite-core] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [21:01:46]W: [org.apache.ignite:ignite-core] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [21:01:46]W: [org.apache.ignite:ignite-core] at java.lang.Thread.run(Thread.java:748) [21:01:46]W: [org.apache.ignite:ignite-core] Caused by:e class org.apache.ignite.internal.processors.cache.persistence.StorageException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.filehandle.FileWriteHandleImpl.checkNode(FileWriteHandleImpl.java:208) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.filehandle.FileWriteHandleImpl.addRecord(FileWriteHandleImpl.java:235) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager.log(FileWriteAheadLogManager.java:910) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager.log(FileWriteAheadLogManager.java:863) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.doInitPage(PageHandler.java:471) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.writePage(PageHandler.java:307) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.initPage(PageHandler.java:244) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.DataStructure.init(DataStructure.java:425) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.addStripe(PagesList.java:623) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.getPageForPut(PagesList.java:754) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.put(PagesList.java:859) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList$PutBucket.run(PagesList.java:199) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList$PutBucket.run(PagesList.java:173) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.writePage(PageHandler.java:313) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.DataStructure.write(DataStructure.java:304) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.free laist.PagesList.flushBucketsCache(PagesList.java:415) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.saveMetadata(PagesList.java:356) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.saveStoreMetadata(GridCacheOffheapManager.java:403) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.lambda$syncMetadata$2(GridCacheOffheapManager.java:378) [21:01:46]W: [org.apache.ignite:ignite-core] ... 4 more [21:01:46]W: [org.apache.ignite:ignite-core] ion iled to execute compound futin thread "checkpure reducer: GridCompoundFuture [rdc=oint-runnenull, r-cpu-#108init5%Flagfailu=1, lre.IoomFsnrCalailurelsHandlerTest1%" =27, size=603, donclass org.apache.ignite.IgniteException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.lambda$syncMetadata$2(GridCacheOffheapManager.java:381) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.lambda$wrapIgniteFuture$3(IgniteUtils.java:11714) [21:01:46]W: [org.apache.ignite:ignite-core] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [21:01:46]W: [org.apache.ignite:ignite-core] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [21:01:46]W: [org.apache.ignite:ignite-core] at java.lang.Thread.run(Thread.java:748) [21:01:46]W: [org.apache.ignite:ignite-core] Caused by: class org.apache.ignite.internal.processors.cache.persistence.StorageException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.filehandle.FileWriteHandleImpl.checkNode(FileWriteHandleImpl.java:208) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.filehandle.FileWriteHandleImpl.addRecord(FileWriteHandleImpl.java:235) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager.log(FileWriteAheadLogManager.java:910) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager.log(FileWriteAheadLogManager.java:863) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.doInitPage(PageHandler.java:471) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.writePage(PageHandler.java:307) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.initPage(PageHandler.java:244) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.DataStructure.init(DataStructure.java:425) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.addStripe(PagesList.java:623) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.getPageForPut(PagesList.java:754) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.put(PagesList.java:859) [21:01:46]W: [org.apache.ignite:ignite-core] at porg.apache.ignite.internal.processors.cache.persistence.freelist.PagesList$PutBucket.run(PagesList.java:199) [21:01:46]W: [org.apache.ignite:ignite-core] [ at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList$PutBucket.run(PagesList.java:173) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.writePage(PageHandler.java:313) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.DataStructure.write(DataStructure.java:304) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.flushBucketsCache(PagesList.java:415) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.saveMetadata(PagesList.java:356) [21:01:46]W: [org.apache.ignite:ignite-core] rat org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.saveStoreMetadata(GridCacheOffheapManager.java:403) [21:01:46]W: [org.apache.ignite:ignite-core] x at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.lambda$syncMetadata$2(GridCacheOffheapManager.java:378) [21:01:46]W: [org.apache.ignite:ignite-core] ... 4 more [21:01:46]W: [org.apache.ignite:ignite-core] cpu-#1080%failure.IoomFailureHandlerTest1%" class org.apache.ignite.IgniteException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.lambda$syncMetadata$2(GridCacheOffheapManager.java:381) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.lambda$wrapIgniteFuture$3(IgniteUtils.java:11714) [21:01:46]W: [org.apache.ignite:ignite-core] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [21:01:46]W: [org.apache.ignite:ignite-core] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [21:01:46]W: [org.apache.ignite:ignite-core] at java.lang.Thread.rdun(Thread.java:748) [21:01:46]W: [org.apache.ignite:ignite-core] Caused by: class org.apache.ignite.internal.processors.cache.persistence.StorageException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.filehandle.FileWriteHandleImpl.checkNode(FileWriteHandleImpl.java:208) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.filehandle.FileWriteHandleImpl.addRecord(FileWriteHandleImpl.java:235) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager.log(FileWriteAheadLogManager.java:910) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager.log(FileWriteAheadLogManager.java:863) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.doInitPage(PageHandler.java:471) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.writePage(PageHandler.java:307) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.initPage(PageHandler.java:244) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.DataStructure.init(DataStructure.java:425) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.addStripe(PagesList.java:623) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.getPageForPut(PagesList.java:754) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.put(PagesList.java:859) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList$PutBucket.run(PagesList.java:199) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList$PutBucket.run(PagesList.java:173) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.writePage(PageHandler.java:313) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.DataStructure.write(DataStructure.java:304) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.flushBucketsCache(PagesList.java:415) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.saveMetadata(PagesList.java:356) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.saveStoreMetadata(GridCacheOffheapManager.java:403) [21:01:46]W: [org.apache.ignite:ignite-core] ception in thread "checkpoint-runner-cpu-#1083%failure.IoomFailureHandlerTest1%" at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.lambda$syncMetadata$2(GridCacheOffheapManager.java:378) [21:01:46]W: [org.apache.ignite:ignite-core] ... 4 more [21:01:46]W: [org.apache.ignite:ignite-core] class org.apache.ignite.IgniteException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.lambda$syncMetadata$2(GridCacheOffheapManager.java:381) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.lambda$wrapIgniteFuture$3(IgniteUtils.java:11714) [21:01:46]W: [org.apache.ignite:ignite-core] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [21:01:46]W: [org.apache.ignite:ignite-core] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [21:01:46]W: [org.apache.ignite:ignite-core] at java.lang.Thread.run(Thread.java:748) [21:01:46]W: [org.apache.ignite:ignite-core] Caused by: class org.apache.ignite.internal.processors.cache.persistence.StorageException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.filehandle.FileWriteHandleImpl.checkNode(FileWriteHandleImpl.java:208) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.filehandle.FileWriteHandleImpl.addRecord(FileWriteHandleImpl.java:235) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager.log(FileWriteAheadLogManager.java:910) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager.log(FileWriteAheadLogManager.java:863) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.doInitPage(PageHandler.java:471) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.writePage(PageHandler.java:307) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.initPage(PageHandler.java:244) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.DataStructure.init(DataStructure.java:425) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.addStripe(PagesList.java:623) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.getPageForPut(PagesList.java:754) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.put(PagesList.java:859) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList$PutBucket.run(PagesList.java:199) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList$PutBucket.run(PagesList.java:173) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.writePage(PageHandler.java:313) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.DataStructure.write(DataStructure.java:304) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.flushBucketsCache(PagesList.java:415) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.saveMetadata(PagesList.java:356) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.saveStoreMetadata(GridCacheOffheapManager.java:403) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.lambda$syncMetadata$2(GridCacheOffheapManager.java:378) [21:01:46]W: [org.apache.ignite:ignite-core] ... 4 more [21:01:46]W: [org.apache.ignite:ignite-core] ror), futs=TransformCollectionView [true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, tru21:01:46] (err) Failed to execute compound future reducer: GridCompoundFuture [rdc=null, initFlag=1, lsnrCalls=30, size=603, done=true, cancelled=false, err=class o.a.i.IgniteCheckedException: Failed to perform WAL operation (environment was invalidated by a previous error), futs=TransformCollectionView [true, true, true, true, true, true, true, true, true, true, true, true, true, true, true,ea,e=true, cancelled=false, err=class o.a.i.Igni truteCheckedException: Failed to perform WAL operation (environment was invalidated by a previous error), futs=TransformCollectionView [true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false... and 503 more]]class org.apache.ignite.IgniteCheckedException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:46]W: [org.apache.ignite:ignite-core] rt at org.apache.ignite.internal.util.IgniteUtils.cast(IgniteUtils.java:7773) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAda pter.resolve(GridFutureAdapter.javea:260) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.get0(GridFutureAdapter.java:172) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.get(GridFutureAdapter.java:141) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridCompoundFuture.apply(GridCompoundFuture.java:100) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridCompoundFuture.apply(GridCompoundFuture.java:47) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.notifyListener(GridFutureAdapter.java:399) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.unblock(GridFutureAdapter.java:347) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.unblockAll(GridFutureAdapter.java:335) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.onDone(GridFutureAdapter.java:511) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.onDone(GridFutureAdapter.java:490) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.onDone(GridFutureAdapter.java:478) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.lambda$wrapIgniteFuture$3(IgniteUtils.java:11719) [21:01:46]W: [org.apache.ignite:ignite-core] aut java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [21:01:46]W: [org.apache.ignite:ignite-core] ,at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [21:01:46]W: [org.apache.ignite:ignite-core] at java.lang.Thread.run(Thread.java:748) [21:01:46]W: [org.apache.ignite:ignite-core] Caused by: class org.apache.ignite.IgniteException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.lambda$syncMetadata$2(GridCacheOffheapManager.java:381) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.lambda$wrapIgniteFuture$3(IgniteUtils.java:11714) [21:01:46]W: [org.apache.ignite:ignite-core] ... 3 more [21:01:46]W: [org.apache.ignite:ignite-core] Caused by: class org.apache.ignite.internal.processors.cache.persistence.StorageException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.filehandle.FileWriteHandleImpl.checkNode(FileWriteHandleImpl.java:208) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.filehandle.FileWriteHandleImpl.addRecord(FileWriteHandleImpl.java:235) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager.log(FileWriteAheadLogManager.java:910) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager.log(FileWriteAheadLogManager.java:863) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.doInitPage(PageHandler.java:471) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.writePage(PageHandler.java:307) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.initPage(PageHandler.java:244) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.DataStructure.init(DataStructure.java:425) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.addStripe(PagesList.java:623) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.getPageForPut(PagesList.java:754) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.put(PagesList.java:859) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList$PutBucket.run(PagesList.java:199) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList$PutBucket.run(PagesList.java:173) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.writePage(PageHandler.java:313) [21:01:46]W: [org.apache.ignite:ignite-core] t at org.apache.ignite.internal.processors.cache.persistence.DataStructure.write(DataStructure.java:304) [21:01:46]W: [org.apache.ignite:ignite-core] Uat org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.flushBucketsCache(PagesList.java:415) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.saveMetadata(PagesList.java:356) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.saveStoreMetadata(GridCacheOffheapManager.java:403) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.lambda$syncMetadata$2(GridCacheOffheapManager.java:378) [21:01:46]W: [org.apache.ignite:ignite-core] ... 4 more [21:01:46]W: [org.apache.ignite:ignite-core] Exception in thread "checkpoint-runner-cpu-#1086%failure.IoomFailureHandlerTest1%" class org.apache.ignite.IgniteException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.lambda$syncMetadata$2(GridCacheOffheapManager.java:381) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.lambda$wrapIgniteFuture$3(IgniteUtils.java:11714) [21:01:46]W: [org.apache.ignite:ignite-core] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [21:01:46]W: [org.apache.ignite:ignite-core] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [21:01:46]W: [org.apache.ignite:ignite-core] at java.lang.Thread.run(Thread.java:748) [21:01:46]W: [org.apache.ignite:ignite-core] Caused by: class org.apache.ignite.internal.processors.cache.persistence.StorageException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.filehandle.FileWriteHandleImpl.checkNode(FileWriteHandleImpl.java:208) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.filehandle.FileWriteHandleImpl.addRecord(FileWriteHandleImpl.java:235) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager.log(FileWriteAheadLogManager.java:910) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager.log(FileWriteAheadLogManager.java:863) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.doInitPage(PageHandler.java:471) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.writePage(PageHandler.java:307) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.initPage(PageHandler.java:244) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.DataStructure.init(DataStructure.java:425) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.addStripe(PagesList.java:623) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.getPageForPut(PagesList.java:754) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.put(PagesList.java:859) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList$PutBucket.run(PagesList.java:199) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList$PutBucket.run(PagesList.java:173) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.writePage(PageHandler.java:313) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.DataStructure.write(DataStructure.java:304) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.flushBucketsCache(PagesList.java:415) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.saveMetadata(PagesList.java:356) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.saveStoreMetadata(GridCacheOffheapManager.java:403) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.lambda$syncMetadata$2(GridCacheOffheapManager.java:378) [21:01:46]W: [org.apache.ignite:ignite-core] ... 4 more [21:01:46]W: [org.apache.ignite:ignite-core] rue, true, [21:01:46] (err) Failed to execute compound future reducer: GridCompoundFuture [rdc=null, initFlag=1, lsnrCalls=31, size=603, done=true, cancelled=false, err=class o.a.i.IgniteCheckedException: Failed to perform WAL operation (environment was invalidated by a previous error), futs=TransformCollectionView [true, false, faltruepdateCntr=1, serReadVer=null, xidVer=GridCacheVersion [topVer=2true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, cer: GridCompoundFuture [rdc=null, initFlag=1, lsnrCalls=29, size=603, done=true, cancelled=false, err=class o.a.i.IgniteCheckedException: Failed to perform WAL operation (environment was invalidated by a previous error), futs=TransformCollectionView [true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false... and 503 more]]class org.apache.ignite.IgniteCheckedException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.cast(IgniteUtils.java:7773) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.resolve(GridFutureAdapter.java:260) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.get0(GridFutureAdapter.java:172) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.get(GridFutureAdapter.java:141) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridCompoundFuture.apply(GridCompoundFuture.java:100) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridCompoundFuture.apply(GridCompoundFuture.java:47) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.notifyListener(GridFutureAdapter.java:399) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.unblock(GridFutureAdapter.java:347) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.unblockAll(GridFutureAdapter.java:335) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.onDone(GridFutureAdapter.java:511) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.onDone(GridFutureAdapter.java:490) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.onDone(GridFutureAdapter.java:478) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.lambda$wrapIgniteFuture$3(IgniteUtils.java:11719) [21:01:46]W: [org.apache.ignite:ignite-core] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [21:01:46]W: [org.apache.ignite:ignite-core] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [21:01:46]W: [org.apache.ignite:ignite-core] at java.lang.Thread.run(Thread.java:748) [21:01:46]W: [org.apache.ignite:ignite-core] Caused by: class org.apache.ignite.IgniteException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.lambda$syncMetadata$2(GridCacheOffheapManager.java:381) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.lambda$wrapIgniteFuture$3(IgniteUtils.java:11714) [21:01:46]W: [org.apache.ignite:ignite-core] ... 3 more [21:01:46]W: [org.apache.ignite:ignite-core] Caused by: class org.apache.ignite.internal.processors.cache.persifstence.StorageException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:46]W: [org.apache.ignite:ignite-core] a at org.apache.ignite.internal.processors.cache4,s.persistence.wal.filehandle.FileWriteHandleImpl.checkNode(FileWriteHandleImpl.java:208) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.filehandle.FileWriteHandleImpl.addRecord(FileWriteHandleImpl.java:235) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager.log(FileWriteAheadLogManager.java:910) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager.log(FileWriteAheadLogManager.java:863) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.doInitPage(PageHandler.java:471) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.writePage(PageHandler.java:307) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.initPage(PageHandler.java:244) [21:01:46]W: [org.apache.ignite:ignite-core] at org.aepache.ignite.internal.processors.cache.persistence.DataStructure.init(DataStructure.java:425) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.addStripe(PagesList.java:623) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.getPageForPut(PagesList.java:754) [21:01:46]W: [org.apache.ignite:ignite-core] at org.ap ache.ignite.internal.processors.cache.persistence.freelist.PagesList.put(PagesList.java:859) [21:01:46]W: [org.apache.ignite:ignite-core] at org8.apache.ignite.internal.processors.cache.persistence.freelist.PagesList$PutBucket.run(PagesList.java:199) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList$PutBucket.run(PagesList.java:173) [21:01:46]W: [org.apache.ignite:ignite-core] alt org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.writePage(PageHandler.java:313) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.DataStructure.write(DataStructure.java:304) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.flushBucketsCache(PagesList.java:415) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.saveMetadata(PagesList.java:356) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.saveStoreMetadata(GridCacheOffheapManager.java:403) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.lambda$syncMetadata$2(GridCacheOffheapManager.java:378) [21:01:46]W: [org.apache.ignite:ignite-core] ... 4 more [21:01:46]W: [org.apache.ignite:ignite-core] 824893, order=1637344893065, nodeOrder=2]], IgniteTxEntry [txKey=IgniteTxKey [key=KeyCacheObjectImpl [part=13, val=13, hasValBytes=true], cacheId=1544803905], val=TxEntryValueHolder [val=CacheObjectByteArrayImpl [arrLen=1364], op=CREATE], prevVal=TxEntryValueHolder [val=null, op=NOOP], oldVal=TxEntryValueHolder [val=null, op=NOOP], entryProcessorsCol=null, ttl=-1, conflictExpireTime=-1, conflictVer=null, explicitVer=null, dhtVer=null, filters=CacheEntryPredicate[] [], filtersPassed=false, filtersSet=false, entry=GridDhtCacheEntry [rdrs=ReaderId[] [], part=13, super=GridDistributedCacheEntry [super=GridCacheMapEntry [key=KeyCacheObjectImpl [part=13, val=13, hasValBytes=true], val=null, ver=GridCacheVersion [topVer=248824893, order=1637344893065, nodeOrdertrue, tse, fal=2se, farue, true, tru, fe, true, true, true, tExclse, fa], lse, false, false, false, false, false, false, false, false, false, faleprue, alstrution inse, false, false, false, false, fhash=13, extras=GridCacheObsoleteEntryExtras [obsoleteVer=GridCacheVersion [topVer=2147483als thre, true, true, true,e, truead "checkpoint-runner-cpu-#10e, false, fal647, order=0, nodeOrder=0]], flags=2]]], prepared=0, locked=false, nodeId=null, locMapped=false, expiryPlc=nusle, false, false, false, false, false, false, f88%e, t farue, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, failure.Ioomalse, false, false, false, false, false, false, false, false, falsl, trane, fFailureHandlerTetrue, true, true, false, false, lse, false, false, false, false, false, fast1%" alsescl,lfass org.apache.ignite.IgniteException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:46]W: [org.apache.ignite:ignite-core] alsse at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.lambda$syncMetadata$2(GridCacheOffheapManager.java:381) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.lambda$wrapIgniteFuture$3(IgniteUtils.java:11714) [21:01:46]W: [org.apache.ignite:ignite-core] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [21:01:46]W: [org.apache.ignite:ignite-core] [ at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [21:01:46]W: [org.apache.ignite:ignite-core] at java.lang.Thread.run(Thread.java:748) [21:01:46]W: [org.apache.ignite:ignite-core] Caused by: class org.apache.ignite.internal.processors.cache.persistence.StorageException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.filehandle.FileWriteHandleImpl.checkNode(FileWriteHandleImpl.java:208) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.filehandle.FileWriteHandleImpl.addRecord(FileWriteHandleImpl.java:235) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager.log(FileWriteAheadLogManager.java:910) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager.log(FileWriteAheadLogManager.java:863) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.doInitPage(PageHandler.java:471) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.writePage(PageHandler.java:307) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.initPage(PageHandler.java:244) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.DataStructure.init(DataStructure.java:425) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.addStripe(PagesList.java:623) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.getPageForPut(PagesList.java:754) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.put(PagesList.java:859) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList$PutBucket.run(PagesList.java:199) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList$PutBucket.run(PagesList.java:173) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.writePage(PageHandler.java:313) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.DataStructure.write(DataStructure.java:304) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.flushBucketsCache(PagesList.java:415) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.saveMetadata(PagesList.java:356) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.saveStoreMetadata(GridCacheOffheapManager.java:403) [21:01:46]W: [org.apache.ignite:ignite-core] atf org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.lambda$syncMetadata$2(GridCacheOffheapManager.java:378) [21:01:46]W: [org.apache.ignite:ignite-core] ... 4 more [21:01:46]W: [org.apache.ignite:ignite-core] 21:01:46] (err) Failed to execute compound future reducer:f, f Ge, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, falsealse, false, false, falseals, fa, ferExpiryPlc=false, flags=0, partUpdateCntr=1, serReadVer=null, xidVer=GriridCompoundFuture [rdc=null, initFlag=1, lsnrCalls=32, size=603, done=true, cancelled=false, err=class o.a.i.IgniteCheckedException: Failed to perform WAL operation (environment was invalidated by a previodCalse, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false,lse, fe, alse, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false.. facheVus erersion [topVer=alse, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false... and 503 more]]class org.apache.ignite.IgniteCheckedException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.cast(IgniteUtils.java:7773) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.resolve(GridFutureAdapter.java:260) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.get0(GridFutureAdapter.java:172) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.get(GridFutureAdapter.java:141) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridCompoundFuture.apply(GridCompoundFuture.java:100) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridCompoundFuture.apply(GridCompoundFuture.java:47) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.notifyListener(GridFutureAdapter.java:399) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.unblock(GridFutureAdapter.java:347) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.unblockAll(GridFutureAdapter.java:335) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.onDone(GridFutureAdapter.java:511) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.onDone(GridFutureAdapter.java:490) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.onDone(GridFutureAdapter.java:478) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.lambda$wrapIgniteFuture$3(IgniteUtils.java:11719) [21:01:46]W: [org.apache.ignite:ignite-core] at java.util.concurrent.Thr.feadP2roolExecutor.runWorker(ThreadPoolExecutor.java:1149) [21:01:46]W: [org.apache.ignite:ignite-core] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [21:01:46]W: [org.apache.ignite:ignite-core] at java.lang.Thread.run(Thread.java:748) [21:01:46]W: [org.apache.ignite:ignite-core] Caused by: class org.apache.ignite.IgniteException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.lambda$syncMetadata$2(GridCacheOffheapManager.java:381) [21:01:46]W: [org.apache.ignite:ignite-core] oat org.apache.ignite.internal.util.IgniteUtils.lambda$wrapIgniteFuture$3(IgniteUtils.java:11714) [21:01:46]W: [org.apache.ignite:ignite-core] 4... 3 more [21:01:46]W: [org.apache.ignite:ignite-core] Caused by: class org.apache.ignite.internal.processors.cache.persistence.StorageException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.filehandle.FileWriteHandleImpl.checkNode(FileWriteHandleImpl.java:208) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.filehandle.FileWriteHandleImpl.addRecord(FileWriteHandleImpl.java:235) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager.log(FileWriteAheadLogManager.java:910) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager.log(FileWriteAheadLogManager.java:863) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.doInitPage(PageHandler.java:471) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.writePage(PageHandler.java:307) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.initPage(PageHandler.java:244) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.DataStructure.init(DataStructure.java:425) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.addStripe(PagesList.java:623) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.getPageForPut(PagesList.java:754) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.put(PagesList.java:859) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList$PutBucket.run(PagesList.java:199) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList$PutBucket.run(PagesList.java:173) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.writePage(PageHandler.java:313) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.DataStructure.write(DataStructure.java:304) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.flushBucketsCache(PagesList.java:415) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.saveMetadata(PagesList.java:356) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.saveStoreMetadata(GridCacheOffheapManager.java:403) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.lambda$syncMetadata$2(GridCacheOffheapManager.java:378) [21:01:46]W: [org.apache.ignite:ignite-core] ... 4 more [21:01:46]W: [org.apache.ignite:ignite-core] a and 50ls3 m88ore]]e, fa2class org.apache.ignite.IgniteCheckedException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.cast(IgniteUtils.java:7773) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.resolve(GridFutureAdapter.java:260) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.get0(GridFutureAdapter.java:172) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.get(GridFutureAdapter.java:141) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridCompoundFuture.apply(GridCompoundFuture.java:100) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridCompoundFuture.apply(GridCompoundFuture.java:47) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.notifyListener(GridFutureAdapter.java:399) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.unblock(GridFutureAdapter.java:347) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.unblockAll(GridFutureAdapter.java:335) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.onDone(GridFutureAdapter.java:511) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.onDone(GridFutureAdapter.java:490) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.onDone(GridFutureAdapter.java:478) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.lambda$wrapIgniteFuture$3(IgniteUtils.java:11719) [21:01:46]W: [org.apache.ignite:ignite-core] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [21:01:46]W: [org.apache.ignite:ignite-core] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [21:01:46]W: [org.apache.ignite:ignite-core] at java.lang.Thread.run(Thread.java:748) [21:01:46]W: [org.apache.ignite:ignite-core] Caused by: class org.apache.ignite.IgniteException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.lambda$syncMetadata$2(GridCacheOffheapManager.java:381) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.lambda$wrapIgniteFuture$3(IgniteUtils.java:11714) [21:01:46]W: [org.apache.ignite:ignite-core] ... 3 more [21:01:46]W: [org.apache.ignite:ignite-core] Exception in thread "checkpCaused by: class org.apache.ignite.internal.processors.cache.persistence.StorageException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:46]W: [org.apache.ignite:ignite-core] rat org.apache.ignite.internal.processors.cache.persistence.wal.filehandle.FileWriteHandleImpl.checkNode(FileWriteHandleImpl.java:208) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.filehandle.FileWriteHandleImpl.addRecord(FileWriteHandleImpl.java:235) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager.log(FileWriteAheadLogManager.java:910) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager.log(FileWriteAheadLogManager.java:863) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.doInitPage(PageHandler.java:471) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.writePage(PageHandler.java:307) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.initPage(PageHandler.java:244) [21:01:46]W: [org.apache.ignite:ignite-core] oat org.apache.ignite.internal.processors.cache.persistence.DataStructure.init(DataStructure.java:425) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.addStripe(PagesList.java:623) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.getPageForPut(PagesList.java:754) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.put(PagesList.java:859) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList$PutBucket.run(PagesList.java:199) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList$PutBucket.run(PagesList.java:173) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.writePage(PageHandler.java:313) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.DataStructure.write(DataStructure.java:304) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.flushBucketsCache(PagesList.java:415) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.saveMetadata(PagesList.java:356) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.saveStoreMetadata(GridCacheOffheapManager.java:403) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.lambda$syncMetadata$2(GridCacheOffheapManager.java:378) [21:01:46]W: [org.apache.ignite:ignite-core] ... 4 more [21:01:46]W: [org.apache.ignite:ignite-core] Exception in thread "checklse... and 503 4893, ordermore]int-runner-cpu-#1090%failure.IoomFailupoint-runner-cpu-#1087%failure.IoomFailureHandlerTestr]c=la1ss org.apache.ignite.IgniteCheckedException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.cast(IgniteUtils.java:7773) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.resolve(GridFutureAdapter.java:260) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.get0(GridFutureAdapter.java:172) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.get(GridFutureAdapter.java:141) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridCompoundFuture.apply(GridCompoundFuture.java:100) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridCompoundFuture.apply(GridCompoundFuture.java:47) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.notifyListener(GridFutureAdapter.java:399) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.unblock(GridFutureAdapter.java:347) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.unblockAll(GridFutureAdapter.java:335) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.onDone(GridFutureAdapter.java:511) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.onDone(GridFutureAdapter.java:490) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.onDone(GridFutureAdapter.java:478) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.lambda$wrapIgniteFuture$3(IgniteUtils.java:11719) [21:01:46]W: [org.apache.ignite:ignite-core] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [21:01:46]W: [org.apache.ignite:ignite-core] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [21:01:46]W: [org.apache.ignite:ignite-core] at java.lang.Thread.run(Thread.java:748) [21:01:46]W: [org.apache.ignite:ignite-core] Caused by: class org.apache.ignite.IgniteException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.lambda$syncMetadata$2(GridCacheOffheapManager.java:381) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.lambda$wrapIgniteFuture$3(IgniteUtils.java:11714) [21:01:46]W: [org.apache.ignite:ignite-core] ... 3 more [21:01:46]W: [org.apache.ignite:ignite-core] Caused by: class org.apache.ignite.internal.processors.cache.persistence.StorageException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.filehandle.FileWriteHandleImpl.checkNode(FileWriteHandleImpl.java:208) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.filehandle.FileWriteHandleImpl.addRecord(FileWriteHandleImpl.java:235) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager.log(FileWriteAheadLogManager.java:910) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager.log(FileWriteAheadLogManager.java:863) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.doInitPage(PageHandler.java:471) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.writePage(PageHandler.java:307) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.initPage(PageHandler.java:244) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.DataStructure.init(DataStructure.java:425) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.addStripe(PagesList.java:623) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.getPageForPut(PagesList.java:754) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.put(PagesList.java:859) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList$PutBucket.run(PagesList.java:199) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList$PutBucket.run(PagesList.java:173) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.writePage(PageHandler.java:313) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.DataStructure.write(DataStructure.java:304) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.flushBucketsCache(PagesList.java:415) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.saveMetadata(PagesList.java:356) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.saveStoreMetadata(GridCacheOffheapManager.java:403) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.lambda$syncMetadata$2(GridCacheOffheapManager.java:378) [21:01:46]W: [org.apache.ignite:ignite-core] ... 4 more [21:01:46]W: [org.apache.ignite:ignite-core] Exception in thread "checkpoint-runner-cpu-#1089%failure.IoomFailureHandlerTest1%" class org.apache.ignite.IgniteException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.lambda$syncMetadata$2(GridCacheOffheapManager.java:381) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.lambda$wrapIgniteFuture$3(IgniteUtils.java:11714) [21:01:46]W: [org.apache.ignite:ignite-core] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [21:01:46]W: [org.apache.ignite:ignite-core] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [21:01:46]W: [org.apache.ignite:ignite-core] at java.lang.Thread.run(Thread.java:748) [21:01:46]W: [org.apache.ignite:ignite-core] Caused by: class org.apache.ignite.internal.processors.cache.persistence.StorageException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.filehandle.FileWriteHandleImpl.checkNode(FileWriteHandleImpl.java:208) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.filehandle.FileWriteHandleImpl.addRecord(FileWriteHandleImpl.java:235) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager.log(FileWriteAheadLogManager.java:910) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager.log(FileWriteAheadLogManager.java:863) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.doInitPage(PageHandler.java:471) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.writePage(PageHandler.java:307) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.initPage(PageHandler.java:244) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.DataStructure.init(DataStructure.java:425) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.addStripe(PagesList.java:623) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.getPageForPut(PagesList.java:754) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.put(PagesList.java:859) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList$PutBucket.run(PagesList.java:199) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList$PutBucket.run(PagesList.java:173) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.writePage(PageHandler.java:313) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.DataStructure.write(DataStructure.java:304) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.flushBucketsCache(PagesList.java:415) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.saveMetadata(PagesList.java:356) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.saveStoreMetadata(GridCacheOffheapManager.java:403) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.lambda$syncMetadata$2(GridCacheOffheapManager.java:378) [21:01:46]W: [org.apache.ignite:ignite-core] ... 4 more [21:01:46]W: [org.apache.ignite:ignite-core] [),21:01:46] (err) Failed to execute compound future reducer: GridCompoundFuture futs=TransformCollectionView [true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, f[21:01:46][rdc=nu[21:01:46] (err) Failed to execute compound future reducer: GridCompoundFuture [rdc=null, initFlag=1, lsnrCalls=35, size=603, done=true, cancelled=false, err=class o.a.i.IgniteCheckedException: Failed to perform WAL operation (environment was invalidated by a previous error), futs=TransformCollectionView [true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false... and 503 more]]class org.apache.ignite.IgniteCheckedException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.cast(IgniteUtils.java:7773) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.resolve(GridFutureAdapter.java:260) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.get0(GridFutureAdapter.java:172) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.get(GridFutureAdapter.java:141) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridCompoundFuture.apply(GridCompoundFuture.java:100) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridCompoundFuture.apply(GridCompoundFuture.java:47) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.notifyListener(GridFutureAdapter.java:399) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.unblock(GridFutureAdapter.java:347) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.unblockAll(GridFutureAdapter.java:335) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.onDone(GridFutureAdapter.java:511) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.onDone(GridFutureAdapter.java:490) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.onDone(GridFutureAdapter.java:478) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.lambda$wrapIgniteFuture$3(IgniteUtils.java:11719) [21:01:46]W: [org.apache.ignite:ignite-core] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [21:01:46]W: [org.apache.ignite:ignite-core] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [21:01:46]W: [org.apache.ignite:ignite-core] at java.lang.Thread.run(Thread.java:748) [21:01:46]W: [org.apache.ignite:ignite-core] Caused by: class org.apache.ignite.IgniteException: Failed to perform WAL operation (environment was invalidated l aby a previous error) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.lambda$syncMetadata$2(GridCacheOffheapManager.java:381) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.lambda$wrapIgniteFuture$3(IgniteUtils.java:11714) [21:01:46]W: [org.apache.ignite:ignite-core] ... 3 more [21:01:46]W: [org.apache.ignite:ignite-core] Caused by: class org.apache.ignite.internal.processors.cache.persistence.StorageException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.filehandle.FileWriteHandleImpl.checkNode(FileWriteHandleImpl.java:208) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.filehandle.FileWriteHandleImpl.addRecord(FileWriteHandleImpl.java:235) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager.log(FileWriteAheadLogManager.java:910) [21:01:46]W: [org.apache.ignite:ignite-core] a%t org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager.log(FileWriteAheadLogManager.java:863) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.doInitPage(PageHandler.java:471) [21:01:46]W: [org.apache.ignite:ignite-core] a1t org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.writePage(PageHandler.java:307) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.initPage(PageHandler.java:244) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.DataStructure.init(DataStructure.java:425) [21:01:46]W: [org.apache.ignite:ignite-core] e at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.addStripe(PagesList.java:623) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.getPageForPut(PagesList.java:754) [21:01:46]W: [org.apache.ignite:ignite-core] Hat org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.put(PagesList.java:859) [21:01:46]W: [org.apache.ignite:ignite-core] at6 org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList$PutBucket.run(PagesList.java:199) [21:01:46]W: [org.apache.ignite:ignite-core] " at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList$PutBucket.run(PagesList.java:173) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.writePage(PageHandler.java:313) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.DataStructure.write(DataStructure.java:304) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.flushBucketsCache(PagesList.java:415) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.saveMetadata(PagesList.java:356) [21:01:46]W: [org.apache.ignite:ignite-core] atl org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.saveStoreMetadata(GridCacheOffheapManager.java:403) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.lambda$syncMetadata$2(GridCacheOffheapManager.java:378) [21:01:46]W: [org.apache.ignite:ignite-core] ... 4 more [21:01:46]W: [org.apache.ignite:ignite-core] (err) Failed to execute compound future reducer: GridCompoundFuture [rdc=null, initFlag=1, lsnrCalls=34, size=603, done=true, cancelled=false, err=class o.a.i.IgniteCheckedException: Failed to perform WAL operation (environment was invalidated by a previous error), futs=TransformCollectionView [true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false... and 503 more]]class org.apache.ignite.IgniteCheckedException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.cast(IgniteUtils.java:7773) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.resolve(GridFutureAdapter.java:260) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.get0(GridFutureAdapter.java:172) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.get(GridFutureAdapter.java:141) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridCompoundFuture.apply(GridCompoundFuture.java:100) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridCompoundFuture.apply(GridCompoundFuture.java:47) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.notifyListener(GridFutureAdapter.java:399) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.unblock(GridFutureAdapter.java:347) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.unblockAll(GridFutureAdapter.java:335) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.onDone(GridFutureAdapter.java:511) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.onDone(GridFutureAdapter.java:490) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.onDone(GridFutureAdapter.java:478) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.lambda$wrapIgniteFuture$3(IgniteUtils.java:11719) [21:01:46]W: [org.apache.ignite:ignite-core] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [21:01:46]W: [org.apache.ignite:ignite-core] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [21:01:46]W: [org.apache.ignite:ignite-core] at java.lang.Thread.run(Thread.java:748) [21:01:46]W: [org.apache.ignite:ignite-core] 37344893065, nodeOrder=2]],andlerException in Caused by: class org.apache.ignite.IgniteException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:46]W: [org.apache.ignite:ignite-core] t at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.lambda$syncMetadata$2(GridCacheOffheapManager.java:381) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.lambda$wrapIgniteFuture$3(IgniteUtils.java:11714) [21:01:46]W: [org.apache.ignite:ignite-core] ... 3 more [21:01:46]W: [org.apache.ignite:ignite-core] Caused by: class org.apache.ignite.internal.processors.cache.persistence.StorageException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.filehandle.FileWriteHandleImpl.checkNode(FileWriteHandleImpl.java:208) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.filehandle.FileWriteHandleImpl.addRecord(FileWriteHandleImpl.java:235) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager.log(FileWriteAheadLogManager.java:910) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager.log(FileWriteAheadLogManager.java:863) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.doInitPage(PageHandler.java:471) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.writePage(PageHandler.java:307) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.initPage(PageHandler.java:244) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.DataStructure.init(DataStructure.java:425) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.addStripe(PagesList.java:623) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.getPageForPut(PagesList.java:754) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.put(PagesList.java:859) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList$PutBucket.run(PagesList.java:199) [21:01:46]W: [org.apache.ignite:ignite-core] h at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList$PutBucket.run(PagesList.java:173) [21:01:46]W: [org.apache.ignite:ignite-core] rl at orT[ sg.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.writePage(PageHandler.java:313) [21:01:46]W: [org.apache.ignite:ignite-core] e at org.apache.ignite.internal.processors.cache.persistence.DataStructure.write(DataStructure.java:304) [21:01:46]W: [org.apache.ignite:ignite-core] Ign21:0iteTx1:e Eat org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.flushBucketsCache(PagesList.java:415) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.saveMetadata(PagesList.java:356) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.saveStoreMetadata(GridCacheOffheapManager.java:403) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.lambda$syncMetadata$2(GridCacheOffheapManager.java:378) [21:01:46]W: [org.apache.ignite:ignite-core] ... 4 more [21:01:46]W: [org.apache.ignite:ignite-core] class org.apache.ignite.IgniteException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.lambda$syncMetadata$2(GridCacheOffheapManager.java:381) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.lambda$wrapIgniteFuture$3(IgniteUtils.java:11714) [21:01:46]W: [org.apache.ignite:ignite-core] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [21:01:46]W: [org.apache.ignite:ignite-core] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [21:01:46]W: [org.apache.ignite:ignite-core] at java.lang.Thread.run(Thread.java:748) [21:01:46]W: [org.apache.ignite:ignite-core] Caused by: class org.apache.ignite.internal.processors.cache.persistence.StorageException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.filehandle.FileWriteHandleImpl.checkNode(FileWriteHandleImpl.java:208) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.filehandle.FileWriteHandleImpl.addRecord(FileWriteHandleImpl.java:235) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager.log(FileWriteAheadLogManager.java:910) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager.log(FileWriteAheadLogManager.java:863) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.doInitPage(PageHandler.java:471) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.writePage(PageHandler.java:307) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.initPage(PageHandler.java:244) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.DataStructure.init(DataStructure.java:425) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.addStripe(PagesList.java:623) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.getPageForPut(PagesList.java:754) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.put(PagesList.java:859) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList$PutBucket.run(PagesList.java:199) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList$PutBucket.run(PagesList.java:173) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.writePage(PageHandler.java:313) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.DataStructure.write(DataStructure.java:304) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.flushBucketsCache(PagesList.java:415) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.saveMetadata(PagesList.java:356) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.saveStoreMetadata(GridCacheOffheapManager.java:403) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.lambda$syncMetadata$2(GridCacheOffheapManager.java:378) [21:01:46]W: [org.apache.ignite:ignite-core] ... 4 more [21:01:46]W: [org.apache.ignite:ignite-core] , initFlag=1, lsnrCalls=33, size=603, done=true, cancelled=false, err=class o.a.i.IgniteCheckedException: Failed to perform WAL operation (environment was invalidated by a previous error), futs=TransformCollectionView [true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false... and 503 more]]class org.apache.ignite.IgniteCheckedException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.cast(IgniteUtils.java:7773) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.resolve(GridFutureAdapter.java:260) [21:01:46]W: [org.apache.ignite:ignite-core] e at org.apache.ignite.internal.util.future.GridFutureAdapter.get0(GridFutureAdapter.java:172) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.get(GridFutureAdapter.java:141) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridCompoundFuture.apply(GridCompoundFuture.java:100) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridCompoundFuture.apply(GridCompoundFuture.java:47) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.notifyListener(GridFutureAdapter.java:399) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.unblock(GridFutureAdapter.java:347) [21:01:46]W: [org.apache.ignite:ignite-core] Exception in thread "checkpoint-runner-cpu-#1093%failure.IoomFailureHandlerTest1%" ntry [txKey=IgniteTxKey [key=KeyCacheObjectImpl [part=14, val=14, hasValBytes=true], cacheId=1544803905], val=TxEntryValueHolder [val=CacheObjectByteArrayImpl [arrLen=1364], op=CREATE], prevVal=TxEntryValueHolder [val=null, op=NOOP], oldVal=TxEntryValueHolder [val=null, op=NOOP], entryProcessorsCol=null, ttl=-1, conflictExpireTime=-1, conflictVer=null, explicitVer=null, dhtVer=null, filters=CacheEntryPredicate[] [], filtersPassed=false, filtersSet=false, entry=GridDhtCacheEntry [rdrs=ReaderId[] [], part=14, super=GridDistributedCacheEntry [super=GridCacheMapEntry [key=KeyCacheObjectImpl [part=14, val=14, hasValBytes=true], val=null, ver=GridCacheVersion [topVer=248824893, order=1637344893065, nodeOrder=2], hash=14, extras=GridCacheObsoleteEntryExtras [obsoleteVer=GridCacheVersion [topVer=2147483647, order=0, nodeOrder=0]], flags=2]]], prepared=0, locked=false, nodeId=null, locMapped=false, expiryPlc=null, transferExpiryPlc=false, flags=0, partUpdateCntr=1, serReadVer=null, xidVer=GridCacheVersion [topVer=248824893, order=1637344893065, nodeOrder=2]], IgniteTxEntry [txKey=IgniteTxKey [key=KeyCacheObjectImpl [part=19, val=19, hasValBytes=true], cacheId=1544803905], val=TxEntryValueHolder [val=CacheObjectByteArrayImpl [arrLen=1364], op=CREATE], prevVal=TxEntryValueHolder [val=null, op=NOOP], oldVal=TxEntryValueHolder [val=null, op=NOOP], entryProcessorsCol=null, ttl=-1, conflictExpireTime=-1, conflictVer=null, explicitVer=null, dhtVer=null, filters=CacheEntryPredicate[] [], filtersPassed=false, filtersSet=false, entry=GridDhtCacheEntry [rdrs=ReaderId[] [], part=19, super=GridDistributedCacheEnstry [s,ta[21:01:46 false, false, fal at org.apu4a]d1che.ignite.internal.util.future.GridFutureAdapter.unblockAll(GridFutureAdapter.java:335) [21:01:46]W: [org.apache.ignite:ignite-core] at o rg.apache.ignite.internal.util.future.GridFutureAdapter.onDone(GridFutureAdapter.java:511) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.onDone(GridFutureAdapter.java:490) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.onDone(GridFutureAdapter.java:478) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.lambda$wrapIgniteFuture$3(IgniteUtils.java:11719) [21:01:46]W: [org.apache.ignite:ignite-core] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [21:01:46]W: [org.apache.ignite:ignite-core] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [21:01:46]W: [org.apache.ignite:ignite-core] at java.lang.Thread.run(Thread.java:748) [21:01:46]W: [org.apache.ignite:ignite-core] %" (err) Failed to exe6per=GridCachcutse,e"MapEntry [key=KeyCacheObjectImpl Caus]ed by: class c eorg.apache.ignite.IgniteException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:46]W: [org.apache.ignite:ignite-core] comph f[o at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.lambda$syncMetadata$2(GridCacheOffheapManager.java:381) [21:01:46]W: [org.apache.ignite:ignite-core] und future reducer: GridCompoundFuture [rdc=null, initFlag=1, lsnrCalls=37, size=603, done=true, cancelled=false, err=class o.a.i.IgniteCheckedException: Failed to perform WAL operation (environment was invalidated by a previous error), futs=TransformCollectionView [true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, false, false, false, false, false, false, false, false, false,eckpoint-ru false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, falspart=19, val=19, has at org.apache.ignite.internal.util.IgniteUtils.lambda$wrapIgniteFuture$3(IgniteUtils.java:11714) [21:01:46]W: [org.apache.ignite:ignite-core] ... 3 more [21:01:46]W: [org.apache.ignite:ignite-core] ValBytes=true], val=null, ver=GridCacheVersion [topVer=248824893, order=1637344893065, nodeOrder=2], hash=19Caused by: class org.apache.ignite.internal.processors.cache.persistence.StorageException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:46]W: [org.apache.ignite:ignite-core] ,n at o(aerg.apache.ignite.internal.processors.cache.persistence.wal.filehandle.FileWriteHandleImpl.checkNode(FileWriteHandleImpl.java:208) [21:01:46]W: [org.apache.ignite:ignite-core] , false, flse, false, falsealse, false, fal, falsse, false, false, e, false, false, false, false,f at org.apache.ignite.internal.processors.cache.persistence.wal.filehandle.FileWriteHandleImpl.addRecord(FileWriteHandleImpl.java:235) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager.log(FileWriteAheadLogManager.java:910) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager.log(FileWriteAheadLogManager.java:863) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.doInitPage(PageHandler.java:471) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.writePage(PageHandler.java:307) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.initPage(PageHandler.java:244) [21:01:46]W: [org.apache.ignite:ignite-core] e at org.apache.ignite.internal.processors.cache.persistence.DataStructure.init(DataStructure.java:425) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.addStripe(PagesList.java:623) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.getPageForPut(PagesList.java:754) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.put(PagesList.java:859) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList$PutBucket.run(PagesList.java:199) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList$PutBucket.run(PagesList.java:173) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.writePage(PageHandler.java:313) [21:01:46]W: [org.apache.ignite:ignite-core] ner-cpu-#1094%failure.IoomFailureHandlerTest1%" at org.apache.ignite.internal.processors.cache.persistence.DataStructure.write(DataStructure.java:304) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.flushBucketsCache(PagesList.java:415) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.saveMetadata(PagesList.java:356) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.saveStoreMetadata(GridCacheOffheapManager.java:403) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.lambda$syncMetadata$2(GridCacheOffheapManager.java:378) [21:01:46]W: [org.apache.ignite:ignite-core] ... 4 more [21:01:46]W: [org.apache.ignite:ignite-core] class org.apache.ignite.IgniteException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.lambda$syncMetadata$2(GridCacheOffheapManager.java:381) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.lambda$wrapIgniteFuture$3(IgniteUtils.java:11714) [21:01:46]W: [org.apache.ignite:ignite-core] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [21:01:46]W: [org.apache.ignite:ignite-core] e at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [21:01:46]W: [org.apache.ignite:ignite-core] art java.lang.Thread.run(Thread.java:748) [21:01:46]W: [org.apache.ignite:ignite-core] alse,rCau sed by: class org.apache.ignite.internal.processors.cache.persistence.StorageException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.filehandle.FileWriteHandleImpl.checkNode(FileWriteHandleImpl.java:208) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.filehandle.FileWriteHandleImpl.addRecord(FileWriteHandleImpl.java:235) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager.log(FileWriteAheadLogManager.java:910) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager.log(FileWriteAheadLogManager.java:863) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.doInitPage(PageHandler.java:471) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.writePage(PageHandler.java:307) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.initPage(PageHandler.java:244) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.DataStructure.init(DataStructure.java:425) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.addStripe(PagesList.java:623) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.getPageForPut(PagesList.java:754) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.put(PagesList.java:859) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList$PutBucket.run(PagesList.java:199) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList$PutBucket.run(PagesList.java:173) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.writePage(PageHandler.java:313) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.DataStructure.write(DataStructure.java:304) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.flushBucketsCache(PagesList.java:415) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.saveMetadata(PagesList.java:356) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.saveStoreMetadata(GridCacheOffheapManager.java:403) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.lambda$syncMetadata$2(GridCacheOffheapManager.java:378) [21:01:46]W: [org.apache.ignite:ignite-core] ... 4 more [21:01:46]W: [org.apache.ignite:ignite-core] class org.apache.ignite.IgniteException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.lambda$syncMetadata$2(GridCacheOffheapManager.java:381) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.lambda$wrapIgniteFuture$3(IgniteUtils.java:11714) [21:01:46]W: [org.apache.ignite:ignite-core] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [21:01:46]W: [org.apache.ignite:ignite-core] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [21:01:46]W: [org.apache.ignite:ignite-core] at java.lang.Thread.run(Thread.java:748) [21:01:46]W: [org.apache.ignite:ignite-core] Caused by: class org.apache.ignite.internal.processors.cache.persistence.StorageException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.filehandle.FileWriteHandleImpl.checkNode(FileWriteHandleImpl.java:208) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.filehandle.FileWriteHandleImpl.addRecord(FileWriteHandleImpl.java:235) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager.log(FileWriteAheadLogManager.java:910) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager.log(FileWriteAheadLogManager.java:863) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.doInitPage(PageHandler.java:471) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.writePage(PageHandler.java:307) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.initPage(PageHandler.java:244) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.DataStructure.init(DataStructure.java:425) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.addStripe(PagesList.java:623) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.getPageForPut(PagesList.java:754) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.put(PagesList.java:859) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList$PutBucket.run(PagesList.java:199) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList$PutBucket.run(PagesList.java:173) [21:01:46]W: [org.apache.ignite:ignite-core] x at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.writePage(PageHandler.java:313) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.DataStructure.write(DataStructure.java:304) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.flushBucketsCache(PagesList.java:415) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.saveMetadata(PagesList.java:356) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.saveStoreMetadata(GridCacheOffheapManager.java:403) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.lambda$syncMetadata$2(GridCacheOffheapManager.java:378) [21:01:46]W: [org.apache.ignite:ignite-core] ... 4 more [21:01:46]W: [org.apache.ignite:ignite-core] class org.apache.ignite.IgniteException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.lambda$syncMetadata$2(GridCacheOffheapManager.java:381) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.lambda$wrapIgniteFuture$3(IgniteUtils.java:11714) [21:01:46]W: [org.apache.ignite:ignite-core] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [21:01:46]W: [org.apache.ignite:ignite-core] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [21:01:46]W: [org.apache.ignite:ignite-core] at java.lang.Thread.run(Thread.java:748) [21:01:46]W: [org.apache.ignite:ignite-core] Caused by: class org.apache.ignite.internal.processors.cache.persistence.StorageException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.filehandle.FileWriteHandleImpl.checkNode(FileWriteHandleImpl.java:208) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.filehandle.FileWriteHandleImpl.addRecord(FileWriteHandleImpl.java:235) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager.log(FileWriteAheadLogManager.java:910) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager.log(FileWriteAheadLogManager.java:863) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.doInitPage(PageHandler.java:471) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.writePage(PageHandler.java:307) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.initPage(PageHandler.java:244) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.DataStructure.init(DataStructure.java:425) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.addStripe(PagesList.java:623) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.getPageForPut(PagesList.java:754) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.put(PagesList.java:859) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList$PutBucket.run(PagesList.java:199) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList$PutBucket.run(PagesList.java:173) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.writePage(PageHandler.java:313) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.DataStructure.write(DataStructure.java:304) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.flushBucketsCache(PagesList.java:415) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.saveMetadata(PagesList.java:356) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.saveStoreMetadata(GridCacheOffheapManager.java:403) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.lambda$syncMetadata$2(GridCacheOffheapManager.java:378) [21:01:46]W: [org.apache.ignite:ignite-core] ... 4 more [21:01:46]W: [org.apache.ignite:ignite-core] Exception in thre) F false, false, false, false, false, false, false... and 503 more]]class org.apache.ignite.IgniteCheckedException: Failed to perform WAL operation (envirofnment was invalidated by a previous error) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.cast(IgniteUtils.java:7773) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.resolve(GridFutureAdapter.java:260) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.get0(GridFutureAdapter.java:172) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.get(GridFutureAdapter.java:141) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridCompoundFuture.apply(GridCompoundFuture.java:100) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridCompoundFuture.apply(GridCompoundFuture.java:47) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.notifyListener(GridFutureAdapter.java:399) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.unblock(GridFutureAdapter.java:347) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.unblockAll(GridFutureAdapter.java:335) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.onDone(GridFutureAdapter.java:511) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.onDone(GridFutureAdapter.java:490) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.onDone(GridFutureAdapter.java:478) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.lambda$wrapIgniteFuture$3(IgniteUtils.java:11719) [21:01:46]W: [org.apache.ignite:ignite-core] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [21:01:46]W: [org.apache.ignite:ignite-core] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [21:01:46]W: [org.apache.ignite:ignite-core] at java.lang.Thread.run(Thread.java:748) [21:01:46]W: [org.apache.ignite:ignite-core] Caused by: class org.apache.ignite.IgniteException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.lambda$syncMetadata$2(GridCacheOffheapManager.java:381) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.lambda$wrapIgniteFuture$3(IgniteUtils.java:11714) [21:01:46]W: [org.apache.ignite:ignite-core] ... 3 more [21:01:46]W: [org.apache.ignite:ignite-core] Caused by: class org.apache.ignite.internal.processors.cache.persistence.StorageException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.filehandle.FileWriteHandleImpl.checkNode(FileWriteHandleImpl.java:208) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.filehandle.FileWriteHandleImpl.addRecord(FileWriteHandleImpl.java:235) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager.log(FileWriteAheadLogManager.java:910) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager.log(FileWriteAheadLogManager.java:863) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.doInitPage(PageHandler.java:471) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.writePage(PageHandler.java:307) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.initPage(PageHandler.java:244) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.DataStructure.init(DataStructure.java:425) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.addStripe(PagesList.java:623) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.getPageForPut(PagesList.java:754) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.put(PagesList.java:859) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList$PutBucket.run(PagesList.java:199) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList$PutBucket.run(PagesList.java:173) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.writePage(PageHandler.java:313) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.DataStructure.write(DataStructure.java:304) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.flushaBucketsCache(PagesList.java:415) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.saveMetadata(PagesList.java:356) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.saveStoreMetadata(GridCacheOffheapManager.java:403) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.lambda$syncMetadata$2(GridCacheOffheapManager.java:378) [21:01:46]W: [org.apache.ignite:ignite-core] ... 4 more [21:01:46]W: [org.apache.ignite:ignite-core] Exception in thread "checkpoint-runner-cpu-#1096%failure.IoomFailureHandlerTest1%" class org.apache.ignite.IgniteException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.lambda$syncMetadata$2(GridCacheOffheapManager.java:381) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.lambda$wrapIgniteFuture$3(IgniteUtils.java:11714) [21:01:46]W: [org.apache.ignite:ignite-core] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [21:01:46]W: [org.apache.ignite:ignite-core] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [21:01:46]W: [org.apache.ignite:ignite-core] at java.lang.Thread.run(Thread.java:748) [21:01:46]W: [org.apache.ignite:ignite-core] Caused by: class org.apache.ignite.internal.processors.cache.persistence.StorageException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:46]W: [org.apache.ignite:ignite-core] [a at org.apache.ignite.internal.processors.cache.persistence.wal.filehandle.FileWriteHandleImpl.checkNode(FileWriteHandleImpl.java:208) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.filehandle.FileWriteHandleImpl.addRecord(FileWriteHandleImpl.java:235) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager.log(FileWriteAheadLogManager.java:910) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager.log(FileWriteAheadLogManager.java:863) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.doInitPage(PageHandler.java:471) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.writePage(PageHandler.java:307) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.initPage(PageHandler.java:244) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.DataStructure.init(DataStructure.java:425) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.addStripe(PagesList.java:623) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.getPageForPut(PagesList.java:754) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.put(PagesList.java:859) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList$PutBucket.run(PagesList.java:199) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList$PutBucket.run(PagesList.java:173) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.writePage(PageHandler.java:313) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.DataStructure.write(DataStructure.java:304) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.flushBucketsCache(PagesList.java:415) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.saveMetadata(PagesList.java:356) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.saveStoreMetadata(GridCacheOffheapManager.java:403) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.lambda$syncMetadata$2(GridCacheOffheapManager.java:378) [21:01:46]W: [org.apache.ignite:ignite-core] ... 4 more [21:01:46]W: [org.apache.ignite:ignite-core] [21:01:46] (err) Failed to execute compound future reducer: GridCompoundFuture [rdc=null, initFlag=1, lsnrCalls=38, size=603, done=true, cancelled=false, err=class o.a.i.IgniteCheckedException: Failed to perform WAL operation (environment was invalidated by a previous error), futs=TransformCollectionView [true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false... and 503 more]]class org.apache.ignite.IgniteCheckedException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.cast(IgniteUtils.java:7773) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.resolve(GridFutureAdapter.java:260) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.get0(GridFutureAdapter.java:172) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.get(GridFutureAdapter.java:141) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridCompoundFuture.apply(GridCompoundFuture.java:100) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridCompoundFuture.apply(GridCompoundFuture.java:47) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.notifyListener(GridFutureAdapter.java:399) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.unblock(GridFutureAdapter.java:347) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.unblockAll(GridFutureAdapter.java:335) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.onDone(GridFutureAdapter.java:511) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.onDone(GridFutureAdapter.java:490) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.onDone(GridFutureAdapter.java:478) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.lambda$wrapIgniteFuture$3(IgniteUtils.java:11719) [21:01:46]W: [org.apache.ignite:ignite-core] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [21:01:46]W: [org.apache.ignite:ignite-core] att java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [21:01:46]W: [org.apache.ignite:ignite-core] at java.lang.Thread.run(Thread.java:748) [21:01:46]W: [org.apache.ignite:ignite-core] Caused by: class org.apache.ignite.IgniteException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.lambda$syncMetadata$2(GridCacheOffheapManager.java:381) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.lambda$wrapIgniteFuture$3(IgniteUtils.java:11714) [21:01:46]W: [org.apache.ignite:ignite-core] ... 3 more [21:01:46]W: [org.apache.ignite:ignite-core] Caused by: class org.apache.ignite.internal.processors.cache.persistence.StorageException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.filehandle.FileWriteHandleImpl.checkNode(FileWriteHandleImpl.java:208) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.filehandle.FileWriteHandleImpl.addRecord(FileWriteHandleImpl.java:235) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager.log(FileWriteAheadLogManager.java:910) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager.log(FileWriteAheadLogManager.java:863) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.doInitPage(PageHandler.java:471) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.writePage(PageHandler.java:307) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.initPage(PageHandler.java:244) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.DataStructure.init(DataStructure.java:425) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.addStripe(PagesList.java:623) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.getPageForPut(PagesList.java:754) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.put(PagesList.java:859) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList$PutBucket.run(PagesList.java:199) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList$PutBucket.run(PagesList.java:173) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.writePage(PageHandler.java:313) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.DataStructure.write(DataStructure.java:304) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.flushBucketsCache(PagesList.java:415) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.saveMetadata(PagesList.java:356) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.saveStoreMetadata(GridCacheOffheapManager.java:403) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.lambda$syncMetadata$2(GridCacheOffheapManager.java:378) [21:01:46]W: [org.apache.ignite:ignite-core] ... 4 more [21:01:46]W: [org.apache.ignite:ignite-core] d "checkpo21:01:46] (err) Failed to execute compound future reducer: GridCompoundFuture [rdc=null, initFlag=1, lsnrCalls=39, size=603, done=true, cancelled=false, err=class o.a.i.IgniteCheckedException: Failed to perform WAL operation (environment was invalidated by a previous error), futs=TransformCollectionView [true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false... and 503 more]]class org.apache.ignite.IgniteCheckedException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.cast(IgniteUtils.java:7773) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.resolve(GridFutureAdapter.java:260) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.get0(GridFutureAdapter.java:172) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.get(GridFutureAdapter.java:141) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridCompoundFuture.apply(GridCompoundFuture.java:100) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridCompoundFuture.apply(GridCompoundFuture.javia:47) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.notifyListener(GridFutureAdapter.java:399) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.unblock(GridFutureAdapter.java:347) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.unblockAll(GridFutureAdapter.java:335) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.onDone(GridFutureAdapter.java:511) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.onDone(GridFutureAdapter.java:490) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.onDone(GridFutureAdapter.java:478) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.lambda$wrapIgniteFuture$3(IgniteUtils.java:11719) [21:01:46]W: [org.apache.ignite:ignite-core] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [21:01:46]W: [org.apache.ignite:ignite-core] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [21:01:46]W: [org.apache.ignite:ignite-core] at java.lang.Thread.run(Thread.java:748) [21:01:46]W: [org.apache.ignite:ignite-core] iled to execute compound future reducer: GridCompoundFuture [rdc=null, initFlag=1, lsnrCalls=36, size=603, done=true, cancelled=false, err=class o.a.i.IgniteCheckedException: Failed to perform WAL operation (environment was invalidated by a previous error), futs=TransformCollectionView [true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, falsalse, eCaused by: class org.apache.ignite.IgniteException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.lambda$syncMetadata$2(GridCacheOffheapManager.java:381) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.lambda$wrapIgniteFuture$3(IgniteUtils.java:11714) [21:01:46]W: [org.apache.ignite:ignite-core] ... 3 more [21:01:46]W: [org.apache.ignite:ignite-core] Caused by: class org.apache.ignite.internal.processors.cache.persistence.StorageException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.filehandle.FileWriteHandleImpl.checkNode(FileWriteHandleImpl.java:208) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.filehandle.FileWriteHandleImpl.addRecord(FileWriteHandleImpl.java:235) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager.log(FileWriteAheadLogManager.java:910) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager.log(FileWriteAheadLogManager.java:863) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.doInitPage(PageHandler.java:471) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.writePage(PageHandler.java:307) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.initPage(PageHandler.java:244) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.DataStructure.init(DataStructure.java:425) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.addStripe(PagesList.java:623) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.getPageForPut(PagesList.java:754) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.put(PagesList.java:859) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList$PutBucket.run(PagesList.java:199) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList$PutBucket.run(PagesList.java:173) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.writePage(PageHandler.java:313) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.DataStructure.write(DataStructure.java:304) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.flushBucketsCache(PagesList.java:415) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.saveMetadata(PagesList.java:356) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.saveStoreMetadata(GridCacheOffheapManager.java:403) [21:01:46]W: [org.apache.ignite:ignite-core] [ at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.lambda$syncMetadata$2(GridCacheOffheapManager.java:378) [21:01:46]W: [org.apache.ignite:ignite-core] ... 4 more [21:01:46]W: [org.apache.ignite:ignite-core] Exception in thread "checkpoint-runner-cpu-#1098%failure.IoomFailureHandlerTest1%" class org.apache.ignite.IgniteException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.lambda$syncMetadata$2(GridCacheOffheapManager.java:381) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.lambda$wrapIgniteFuture$3(IgniteUtils.java:11714) [21:01:46]W: [org.apache.ignite:ignite-core] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [21:01:46]W: [org.apache.ignite:ignite-core] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [21:01:46]W: [org.apache.ignite:ignite-core] at java.lang.Thread.run(Thread.java:748) [21:01:46]W: [org.apache.ignite:ignite-core] Caused by: class org.apache.ignite.internal.processors.cache.persistence.StorageException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.filehandle.FileWriteHandleImpl.checkNode(FileWriteHandleImpl.java:208) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.filehandle.FileWriteHandleImpl.addRecord(FileWriteHandleImpl.java:235) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager.log(FileWriteAheadLogManager.java:910) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager.log(FileWriteAheadLogManager.java:863) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.doInitPage(PageHandler.java:471) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.writePage(PageHandler.java:307) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.initPage(PageHandler.java:244) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.DataStructure.init(DataStructure.java:425) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.addStripe(PagesList.java:623) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.getPageForPut(PagesList.java:754) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.put(PagesList.java:859) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList$PutBucket.run(PagesList.java:199) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList$PutBucket.run(PagesList.java:173) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.writePage(PageHandler.java:313) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.DataStructure.write(DataStructure.java:304) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.flushBucketsCache(PagesList.java:415) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.saveMetadata(PagesList.java:356) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.saveStoreMetadata(GridCacheOffheapManager.java:403) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.lambda$syncMetadata$2(GridCacheOffheapManager.java:378) [21:01:46]W: [org.apache.ignite:ignite-core] ... 4 more [21:01:46]W: [org.apache.ignite:ignite-core] Exception in thread "checkpoint-runner-cpu-#1097%failure.IoomFailureHandlerTest1%" class org.apache.ignite.IgniteException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.lambda$syncMetadata$2(GridCacheOffheapManager.java:381) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.lambda$wrapIgniteFuture$3(IgniteUtils.java:11714) [21:01:46]W: [org.apache.ignite:ignite-core] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [21:01:46]W: [org.apache.ignite:ignite-core] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [21:01:46]W: [org.apache.ignite:ignite-core] at java.lang.Thread.run(Thread.java:748) [21:01:46]W: [org.apache.ignite:ignite-core] Caused by: class org.apache.ignite.internal.processors.cache.persistence.StorageException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.filehandle.FileWriteHandleImpl.checkNode(FileWriteHandleImpl.java:208) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.filehandle.FileWriteHandleImpl.addRecord(FileWriteHandleImpl.java:235) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager.log(FileWriteAheadLogManager.java:910) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager.log(FileWriteAheadLogManager.java:863) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.doInitPage(PageHandler.java:471) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.writePage(PageHandler.java:307) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.initPage(PageHandler.java:244) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.DataStructure.init(DataStructure.java:425) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.addStripe(PagesList.java:623) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.getPageForPut(PagesList.java:754) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.put(PagesList.java:859) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList$PutBucket.run(PagesList.java:199) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList$PutBucket.run(PagesList.java:173) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.writePage(PageHandler.java:313) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.DataStructure.write(DataStructure.java:304) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.flushBucketsCache(PagesList.java:415) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.saveMetadata(PagesList.java:356) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.saveStoreMetadata(GridCacheOffheapManager.java:403) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.lambda$syncMetadata$2(GridCacheOffheapManager.java:378) [21:01:46]W: [org.apache.ignite:ignite-core] ... 4 more [21:01:46]W: [org.apache.ignite:ignite-core] r[nas=Gri2,121:01:46] (err) Failed to execute compound future reducer: GridCompoundFuture [rdc=null, initFlag=1, lsnrCalls=41, size=603, done=true, cancelled=false, err=class o.a.i.IgniteCheckedException: Failed to perform WAL operation (environment was invalidated by a previous error), futs=TransformCollectionView [true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false... and 503 more]]class org.apache.ignite.IgniteCheckedException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.cast(IgniteUtils.java:7773) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.resolve(GridFutureAdapter.java:260) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.get0(GridFutureAdapter.java:172) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.get(GridFutureAdapter.java:141) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridCompoundFuture.apply(GridCompoundFuture.java:100) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridCompoundFuture.apply(GridCompoundFuture.java:47) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.notifyListener(GridFutureAdapter.java:399) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.unblock(GridFutureAdapter.java:347) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.unblockAll(GridFutureAdapter.t: dfjava:335) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.onDone(GridFutureAdapter.java:511) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.onDone(GridFutureAdapter.java:490) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.onDone(GridFutureAdapter.java:478) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.lambda$wrapIgniteFuture$3(IgniteUtils.java:11719) [21:01:46]W: [org.apache.ignite:ignite-core] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [21:01:46]W: [org.apache.ignite:ignite-core] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [21:01:46]W: [org.apache.ignite:ignite-core] at java.lang.Thread.run(Thread.java:748) [21:01:46]W: [org.apache.ignite:ignite-core] Caused by: class org.apache.ignite.IgniteException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.lambda$syncMetadata$2(GridCacheOffheapManager.java:381) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.lambda$wrapIgniteFuture$3(IgniteUtils.java:11714) [21:01:46]W: [org.apache.ignite:ignite-core] ... 3 more [21:01:46]W: [org.apache.ignite:ignite-core] Caused by: class org.apache.ignite.internal.processors.cache.persistence.StorageException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.filehandle.FileWriteHandleImpl.checkNode(FileWriteHandleImpl.java:208) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.filehandle.FileWriteHandleImpl.addRecord(FileWriteHandleImpl.java:235) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager.log(FileWriteAheadLogManager.java:910) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager.log(FileWriteAheadLogManager.java:863) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.doInitPage(PageHandler.java:471) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.writePage(PageHandler.java:307) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.initPage(PageHandler.java:244) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.DataStructure.init(DataStructure.java:425) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.addStripe(PagesList.java:623) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.getPageForPut(PagesList.java:754) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.put(PagesList.java:859) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList$PutBucket.run(PagesList.java:199) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList$PutBucket.run(PagesList.java:173) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.writePage(PageHandler.java:313) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.DataStructure.write(DataStructure.java:304) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.flushBucketsCache(PagesList.java:415) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.saveMetadata(PagesList.java:356) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.saveStoreMetadata(GridCacheOffheapManager.java:403) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.lambda$syncMetadata$2(GridCacheOffheapManager.java:378) [21:01:46]W: [org.apache.ignite:ignite-core] ... 4 more [21:01:46]W: [org.apache.ignite:ignite-core] alse, false, false,Exception in thread "checkpoint-runner-cpu-#1100%failure.IoomFailureHandlerTest1%" class org.apache.ignite.IgniteException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.lambda$syncMetadata$2(GridCacheOffheapManager.java:381) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.lambda$wrapIgniteFuture$3(IgniteUtils.java:11714) [21:01:46]W: [org.apache.ignite:ignite-core] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [21:01:46]W: [org.apache.ignite:ignite-core] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [21:01:46]W: [org.apache.ignite:ignite-core] at java.lang.Thread.run(Thread.java:748) [21:01:46]W: [org.apache.ignite:ignite-core] Caused by: class org.apache.ignite.internal.processors.cache.persistence.StorageException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.filehandle.F ileWriteHandleImpl.checkNode(FileWriteHandleImpl.java:208) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.filehandle.FileWriteHandleImpl.addRecord(FileWriteHandleImpl.java:235) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager.log(FileWriteAheadLogManager.java:910) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager.log(FileWriteAheadLogManager.java:863) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.doInitPage(PageHandler.java:471) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.writePage(PageHandler.java:307) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.initPage(PageHandler.java:244) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.DataStructure.init(DataStructure.java:425) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.addStripe(PagesList.java:623) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.getPageForPut(PagesList.java:754) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.put(PagesList.java:859) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList$PutBucket.run(PagesList.java:199) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList$PutBucket.run(PagesList.java:173) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.writePage(PageHandler.java:313) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.DataStructure.write(DataStructure.java:304) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.flushBucketsCache(PagesList.java:415) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.saveMetadata(PagesList.java:356) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.saveStoreMetadata(GridCacheOffheapManager.java:403) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.lambda$syncMetadata$2(GridCacheOffheapManager.java:378) [21:01:46]W: [org.apache.ignite:ignite-core] ... 4 more [21:01:46]W: [org.apache.ignite:ignite-core] CacheObsoleteEntryExtras [obsoleteVer=GridCacheVersion [topVer=2147483647, order=0, nodeOrder=0]], flags=2]]], prepared=0, locked=f... and 2297 skipped ...GridCacheObsoleteEntryExtras [obsoleteVer=GridCacheVersion [topVer=2147483647, order=0, nodeOrder=0]], flags=2]]], prepared=0, locked=false, nodeId=null, lfocMapped=false, expiryPlc=null, transferExpiryPlc=false, flags=0, partUpdateCntr=1, serReadVer=null, xidVer=GridCacheVersion [topVer=248824893, order=1637344893065, nodeOrder=2]], IgniteTxEntry [txKey=IgniteTxKey [key=KeyCacheObjectImpl [part=199, val=199, hasValBytes=true], cacheId=1544803905], val=TxEntryValueHolder [val=CacheObjectByteArrayImpl [arrLen=1364], op=CREATE], prevVal=TxEntryValueHolder [val=null, op=NOOP], oldVal=TxEntryValueHolder [val=null, op=NOOP], entryProcessorsCol=null, ttl=-1, conflictExpireTime=-1, conflictVer=null, explicitVer=null, dhtVer=null, filters=CacheEntryPredicate[] [], filtersPassed=false, filtersSet=false, entry=GridCacheMapEntry [key=KeyCacheObjectImpl [part=199, val=199, hasValBytes=true], val=null, ver=GridCacheVersion [topVer=248824893, order=1637344893065, nodeOrder=2], hash=199, extras=GridCacheObsoleteEntryExtras [obsoleteVer=GridCacheVersion [topVer=2147483647, order=0, nodeOrder=0]], flags=2]]], prepared=0, locked=false, nodeId=null, locMapped=false, expiryPlc=null, transferExpiryPlc=false, flags=0, partUpdateCntr=1, serReadVer=null, xidVer=GridCacheVersion [topVer=248824893, order=1637344893065, nodeOrder=2]]... and 9900 more]], super=IgniteTxAdapter [xidVer=GridCacheVersion [topVer=248824893, order=1637344893065, nodeOrder=2], writeVer=GridCacheVersion [topVer=248824893, order=1637344893066, nodeOrder=2], implicit=false, loc=true, threadId=839, startTime=1637344895184, nodeId=fe65148c-4d17-4fff-9236-05b24cf00001, isolation=REPEATABLE_READ, concurrency=PESSIMISTIC, timeout=0, sysInvalidate=true, sys=false, plc=2, commitVer=null, finalizing=USER_FINISH, invalidParts=null, state=UNKNOWN, timedOut=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], mvccSnapshot=null, skipCompletedVers=false, parentTx=null, duration=10381ms, onePhaseCommit=true], size=10000]]]] [21:01:46]W: [org.apache.ignite:ignite-core] class org.apache.ignite.internal.transactions.IgniteTxHeuristicCheckedException: Committing a transaction has produced runtime exception [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.transactions.IgniteTxAdapter.heuristicException(IgniteTxAdapter.java:800) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.transactions.IgniteTxLocalAdapter.userCommit(IgniteTxLocalAdapter.java:949) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.distributed.dht.GridDhtTxLocalAdapter.localFinish(GridDhtTxLocalAdapter.java:789) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.distributed.dht.GridDhtTxLocal.localFinish(GridDhtTxLocal.java:595) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.distributed.dht.GridDhtTxLocal.finishTx(GridDhtTxLocal.java:467) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.distributed.dht.GridDhtTxLocal.commitDhtLocalAsync(GridDhtTxLocal.java:512) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.distributed.dht.GridDhtTxLocal.commitAsync(GridDhtTxLocal.java:532) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.distributed.dht.GridDhtTxPrepareFuture.onDone(GridDhtTxPrepareFuture.java:799) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.distributed.dht.GridDhtTxPrepareFuture.onDone(GridDhtTxPrepareFuture.java:120) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.ia01:46] (err) n-runnFailed to execute compound future reducer: GridCompoundFuture [rdc=null, initFlag=1, lsnrCalls=40, size=603, done=true, cancelled=false, err=class o.a.i.IgniteCheckedException: Failed fals[21:01:46] (err) Failed to execute compound future reducer: GridCompoundFuture [rdc=null, initFlag=1, lsnrCalls=42, size=603, done=true, cancelled=false, err=class o.a.i.IgniteCheckedException: Failed to perform WAL operation (environment was invalidated by a previous error), futs=TransformCollectionView [true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false... and 503 more]]class org.apache.ignite.IgniteCheckedException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.cast(IgniteUtils.java:7773) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.resolve(GridFutureAdapter.java:260) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.get0(GridFutureAdapter.java:172) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.get(GridFutureAdapter.java:141) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridCompoundFuture.apply(GridCompoundFuture.java:100) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridCompoundFuture.apply(GridCompoundFuture.java:47) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.notifyListener(GridFutureAdapter.java:399) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.unblock(GridFutureAdapter.java:347) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.unblockAll(GridFutureAdapter.java:335) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.onDone(GridFutureAdapter.java:511) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.onDone(GridFutureAdapter.java:490) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.onDone(GridFutureAdapter.java:478) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.lambda$wrapIgniteFuture$3(IgniteUtils.java:11719) [21:01:46]W: [org.apache.ignite:ignite-core] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [21:01:46]W: [org.apache.ignite:ignite-core] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [21:01:46]W: [org.apache.ignite:ignite-core] at java.lang.Thread.run(Thread.java:748) [21:01:46]W: [org.apache.ignite:ignite-core] Caused by: class org.apache.ignite.IgniteException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.lambda$syncMetadata$2(GridCacheOffheapManager.java:381) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.lambda$wrapIgniteFuture$3(IgniteUtils.java:11714) [21:01:46]W: [org.apache.ignite:ignite-core] ... 3 more [21:01:46]W: [org.apache.ignite:ignite-core] Caused by: class org.apache.ignite.internal.processors.cache.persistence.StorageException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.filehandle.FileWriteHandleImpl.checkNode(FileWriteHandleImpl.java:208) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.filehandle.FileWriteHandleImpl.addRecord(FileWriteHandleImpl.java:235) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager.log(FileWriteAheadLogManager.java:910) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager.log(FileWriteAheadLogManager.java:863) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.doInitPage(PageHandler.java:471) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.writePage(PageHandler.java:307) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.initPage(PageHandler.java:244) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.DataStructure.init(DataStructure.java:425) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.addStripe(PagesList.java:623) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.getPageForPut(PagesList.java:754) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.put(PagesList.java:859) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList$PutBucket.run(PagesList.java:199) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList$PutBucket.run(PagesList.java:173) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.writePage(PageHandler.java:313) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.DataStructure.write(DataStructure.java:304) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.flushBuckletsCache(PagesList.java:415) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.saveMetadata(PagesList.java:356) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.saveStoreMetadata(GridCacheOffheapManager.java:403) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.lambda$syncMetadata$2(GridCacheOffheapManager.java:378) [21:01:46]W: [org.apache.ignite:ignite-core] ... 4 more [21:01:46]W: [org.apache.ignite:ignite-core] Exception in thread "checkpoint-runner-cpu-#1101%failure.IoomFailureHandlerTest1%" class org.apache.ignite.IgniteException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.lambda$syncMetadata$2(GridCacheOffheapManager.java:381) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.lambda$wrapIgniteFuture$3(IgniteUtils.java:11714) [21:01:46]W: [org.apache.ignite:ignite-core] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [21:01:46]W: [org.apache.ignite:ignite-core] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [21:01:46]W: [org.apache.ignite:ignite-core] at java.lang.Thread.run(Thread.java:748) [21:01:46]W: [org.apache.ignite:ignite-core] Caused by: class org.apache.ignite.internal.processors.cache.persistence.StorageException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.filehandle.FileWriteHandleImpl.checkNode(FileWriteHandleImpl.java:208) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.filehandle.FileWriteHandleImpl.addRecord(FileWriteHandleImpl.java:235) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager.log(FileWriteAheadLogManager.java:910) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager.log(FileWriteAheadLogManager.java:863) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.doInitPage(PageHandler.java:471) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.writePage(PageHandler.java:307) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.initPage(PageHandler.java:244) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.DataStructure.init(DataStructure.java:425) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.addStripe(PagesList.java:623) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.getPageForPut(PagesList.java:754) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.put(PagesList.java:859) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList$PutBucket.run(PagesList.java:199) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList$PutBucket.run(PagesList.java:173) [21:01:46]W: [org.apache.ignite:ignite-core] etet at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.writePage(PageHandler.java:313) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.DataStructure.write(DataStructure.java:304) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.flushBucketsCache(PagesList.java:415) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.saveMetadata(PagesList.java:356) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.saveStoreMetadata(GridCacheOffheapManager.java:403) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.lambda$syncMetadata$2(GridCacheOffheapManager.java:378) [21:01:46]W: [org.apache.ignite:ignite-core] ... 4 more [21:01:46]W: [org.apache.ignite:ignite-core] se, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false... and 503 more]]class org.apache.ignite.IgniteCheckedException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.cast(IgniteUtils.java:7773) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.resolve(GridFutureAdapter.java:260) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.get0(GridFutureAdapter.java:172) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.get(GridFutureAdapter.java:141) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridCompoundFuture.apply(GridCompoundFuture.java:100) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridCompoundFuture.apply(GridCompoundFuture.java:47) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.notifyListener(GridFutureAdapter.java:399) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.unblock(GridFutureAdapter.java:347) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.unblockAll(GridFutureAdapter.java:335) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.onDone(GridFutureAdapter.java:511) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.onDone(GridFutureAdapter.java:490) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.onDone(GridFutureAdapter.java:478) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.lambda$wrapIgniteFuture$3(IgniteUtils.java:11719) [21:01:46]W: [org.apache.ignite:ignite-core] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [21:01:46]W: [org.apache.ignite:ignite-core] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [21:01:46]W: [org.apache.ignite:ignite-core] at java.lang.Thread.run(Thread.java:748) [21:01:46]W: [org.apache.ignite:ignite-core] Caused by: class org.apache.ignite.IgniteException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.lambda$syncMetadata$2(GridCacheOffheapManager.java:381) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.lambda$wrapIgniteFuture$3(IgniteUtils.java:11714) [21:01:46]W: [org.apache.ignite:ignite-core] ... 3 more [21:01:46]W: [org.apache.ignite:ignite-core] Caused by: class org.apache.ignite.internal.processors.cache.persistence.StorageException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.filehandle.FileWriteHandleImpl.checkNode(FileWriteHandleImpl.java:208) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.filehandle.FileWriteHandleImpl.addRecord(FileWriteHandleImpl.java:235) [21:01:46]W: [org.apache.ignite:ignite-core] aet org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager.log(FileWriteAheadLogManager.java:910) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager.log(FileWriteAheadLogManager.java:863) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.doInitPage(PageHandler.java:471) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.writePage(PageHandler.java:307) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.initPage(PageHandler.java:244) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.DataStructure.init(DataStructure.java:425) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.addStripe(PagesList.java:623) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.getPageForPut(PagesList.java:754) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.put(PagesList.java:859) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList$PutBucket.run(PagesList.java:199) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList$PutBucket.run(PagesList.java:173) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.writePage(PageHandler.java:313) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.DataStructure.write(DataStructure.java:304) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.flushBucketsCache(PagesList.java:415) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.saveMetadata(PagesList.java:356) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.saveStoreMetadata(GridCacheOffheapManager.java:403) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.lambda$syncMetadata$2(GridCacheOffheapManager.java:378) [21:01:46]W: [org.apache.ignite:ignite-core] ... 4 more [21:01:46]W: [org.apache.ignite:ignite-core] Exception in thread "checkpoint-runner-cpu-#1095%failure.IoomFailureHandlerTest1%" class org.apache.ignite.IgniteException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.lambda$syncMetadata$2(GridCacheOffheapManager.java:381) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.lambda$wrapIgniteFuture$3(IgniteUtils.java:11714) [21:01:46]W: [org.apache.ignite:ignite-core] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [21:01:46]W: [org.apache.ignite:ignite-core] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [21:01:46]W: [org.apache.ignite:ignite-core] at java.lang.Thread.run(Thread.java:748) [21:01:46]W: [org.apache.ignite:ignite-core] Caused by: class org.apache.ignite.internal.processors.cache.persistence.StorageException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.filehandle.FileWriteHandleImpl.checkNode(FileWriteHandleImpl.java:208) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.filehandle.FileWriteHandleImpl.addRecord(FileWriteHandleImpl.java:235) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager.log(FileWriteAheadLogManager.java:910) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager.log(FileWriteAheadLogManager.java:863) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.doInitPage(PageHandler.java:471) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.writePage(PageHandler.java:307) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.initPage(PageHandler.java:244) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.DataStructure.init(DataStructure.java:425) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.addStripe(PagesList.java:623) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.getPageForPut(PagesList.java:754) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.put(PagesList.java:859) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList$PutBucket.run(PagesList.java:199) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList$PutBucket.run(PagesList.java:173) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.writePage(PageHandler.java:313) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.DataStructure.write(DataStructure.java:304) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.flushBucketsCache(PagesList.java:415) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.saveMetadata(PagesList.java:356) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.saveStoreMetadata(GridCacheOffheapManager.java:403) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.lambda$syncMetadata$2(GridCacheOffheapManager.java:378) [21:01:46]W: [org.apache.ignite:ignite-core] ... 4 more [21:01:46]W: [org.apache.ignite:ignite-core] r-cpu-#1092%failure.IoomFailureHandlerTest1%" class org.apache.ignite.IgniteException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:46]W: [org.apache.ignite:ignite-core] at org.aopache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.lambda$syncMetadata$2(GridCacheOffheapManager.java:381) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.lambda$wrapIgniteFuture$3(IgniteUtils.java:11714) [21:01:46]W: [org.apache.ignite:ignite-core] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [21:01:46]W: [org.apache.ignite:ignite-core] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [21:01:46]W: [org.apache.ignite:ignite-core] at java.lang.Thread.run(Thread.java:748) [21:01:46]W: [org.apache.ignite:ignite-core] Caused by: class org.apache.ignite.internal.processors.cache.persistence.StorageException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.filehandle.FileWriteHandleImpl.checkNode(FileWriteHandleImpl.java:208) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.filehandle.FileWriteHandleImpl.addRecord(FileWriteHandleImpl.java:235) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager.log(FileWriteAheadLogManager.java:910) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager.log(FileWriteAheadLogManager.java:863) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.doInitPage(PageHandler.java:471) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.writePage(PageHandler.java:307) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.initPage(PageHandler.java:244) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.DataStructure.init(DataStructure.java:425) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.addStripe(PagesList.java:623) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.getPageForPut(PagesList.java:754) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.put(PagesList.java:859) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList$PutBucket.run(PagesList.java:199) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList$PutBucket.run(PagesList.java:173) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.writePage(PageHandler.java:313) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.DataStructure.write(DataStructure.java:304) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.flushBucketsCache(PagesList.java:415) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.saveMetadata(PagesList.java:356) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.saveStoreMetadata(GridCacheOffheapManager.java:403) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.lambda$syncMetadata$2(GridCacheOffheapManager.java:378) [21:01:46]W: [org.apache.ignite:ignite-core] ... 4 more [21:01:46]W: [org.apache.ignite:ignite-core] , false, false, false, false... and 503 more]]class org.apache.ignite.IgniteCheckedException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.cast(IgniteUtils.java:7773) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.resolve(GridFutureAdapter.java:260) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.get0(GridFutureAdapter.java:172) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.get(GridFutureAdapter.java:141) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridCompoundFuture.apply(GridCompoundFuture.java:100) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridCompoundFuture.apply(GridCompoundFuture.java:47) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.notifyListener(GridFutureAdapter.java:399) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.unblock(GridFutureAdapter.java:347) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.unblockAll(GridFutureAdapter.java:335) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.onDone(GridFutureAdapter.java:511) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.onDone(GridFutureAdapter.java:490) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.onDone(GridFutureAdapter.java:478) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.lambda$wrapIgniteFuture$3(IgniteUtils.java:11719) [21:01:46]W: [org.apache.ignite:ignite-core] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [21:01:46]W: [org.apache.ignite:ignite-core] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [21:01:46]W: [org.apache.ignite:ignite-core] at java.lang.Thread.run(Thread.java:748) [21:01:46]W: [org.apache.ignite:ignite-core] Caused by: class org.apache.ignite.IgniteException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.lambda$syncMetadata$2(GridCacheOffheapManager.java:381) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.lambda$wrapIgniteFuture$3(IgniteUtils.java:11714) [21:01:46]W: [org.apache.ignite:ignite-core] ... 3 more [21:01:46]W: [org.apache.ignite:ignite-core] [21:01:46] (err) Failed to execute compound future reducer: GridCompoundFuture [rdc=null, initFlag=1, lsnrCalls=43, size=603, done=true, cancelled=false, err=class o.a.i.IgniteCheckedException: Failed to perform WAL operation (environment was invalidated by a previous error), futs=Transfo perrmCollectiofonVrm WAL operation (environment was invalidated by a previous error), futs=TransformCollectionView [trueCauised by: class org.apache.ignite.internal.processors.cache.persistence.StorageException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.filehandle.FileWriteHandleImpl.checkNode(FileWriteHandleImpl.java:208) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.filehandle.FileWriteHandleImpl.addRecord(FileWriteHandleImpl.java:235) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager.log(FileWriteAheadLogManager.java:910) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager.log(FileWriteAheadLogManager.java:863) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.doInitPage(PageHandler.java:471) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.writePage(PageHandler.java:307) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.initPage(PageHandler.java:244) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.DataStructure.init(DataStructure.java:425) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.addStripe(PagesList.java:623) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.getPageForPut(PagesList.java:754) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.put(PagesList.java:859) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList$PutBucket.run(PagesList.java:199) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList$PutBucket.run(PagesList.java:173) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.writePage(PageHandler.java:313) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.DataStructure.write(DataStructure.java:304) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.flushBucketsCache(PagesList.java:415) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.saveMetadata(PagesList.java:356) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.saveStoreMetadata(GridCacheOffheapManager.java:403) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.lambda$syncMetadata$2(GridCacheOffheapManager.java:378) [21:01:46]W: [org.apache.ignite:ignite-core] ... 4 more [21:01:46]W: [org.apache.ignite:ignite-core] rnal.util.future.GridFutureAdapter.onDone(GridFutureAdapter.java:467) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridCompoundFuture.checkComplete(GridCompoundFuture.java:351) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridCompoundFuture.markInitialized(GridCompoundFuture.java:340) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.distributed.dht.GridDhtTxPrepareFuture.prepare0(GridDhtTxPrepareFuture.java:1380) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.distributed.dht.GridDhtTxPrepareFuture.mapIfLocked(GridDhtTxPrepareFuture.java:732) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.distributed.dht.GridDhtTxPrepareFuture.prepare(GridDhtTxPrepareFuture.java:1138) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.distributed.dht.GridDhtTxLocal.prepare[21:Async(GridDhtTxLocal.java:400) [21:01:46]W: [org.apache.ignite:ignite-core] 01:46] (err) Failed to execute compound future reducer: GridCompoundFuture [rdc=null, initFlag, true, true, true, true, true, trueException in thread "checkpoint-runner-cpu-#1091%failure.IoomFailureHandlerTest1%" class org.apache.ignite.IgniteException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.lambda$syncMetadata$2(GridCacheOffheapManager.java:381) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.lambda$wrapIgniteFuture$3(IgniteUtils.java:11714) [21:01:46]W: [org.apache.ignite:ignite-core] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [21:01:46]W: [org.apache.ignite:ignite-core] at jea,=va.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [21:01:46]W: [org.apache.ignite:ignite-core] 1, lsnrCalls=44, size=603, done=true, cancelled=false, err=class o.a.i.IgniteCheckedException: Failed to perform WAL operation (environment was invalidated by a previous error), futs=TransformCollectionView [true, true, true, true, true, true, true, true, at org.apache.ignite.internal.procestw at java.lang.Thread.run(Thread.java:748) [21:01:46]W: [org.apache.ignite:ignite-core] [true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false... and 503 more]]Caused by: class org.apache.ignite.internal.processors.cache.persistence.StorageException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.filehandle.FileWriteHandleImpl.checkNode(FileWriteHandleImpl.java:208) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.filehandle.FileWriteHandleImpl.addRecord(FileWriteHandleImpl.java:235) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager.log(FileWriteAheadLogManager.java:910) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager.log(FileWriteAheadLogManager.java:863) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.doInitPage(PageHandler.java:471) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.writePage(PageHandler.java:307) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.initPage(PageHandler.java:244) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.DataStructure.init(DataStructure.java:425) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.addStripe(PagesList.java:623) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.getPageForPut(PagesList.java:754) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.put(PagesList.java:859) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList$PutBucket.run(PagesList.java:199) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList$PutBucket.run(PagesList.java:173) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.writePage(PageHandler.java:313) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.DataStructure.write(DataStructure.java:304) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.flushBucketsCache(PagesList.java:415) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.saveMetadata(PagesList.java:356) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.saveStoreMetadata(GridCacheOffheapManager.java:403) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.lambda$syncMetadata$2(GridCacheOffheapManager.java:378) [21:01:46]W: [org.apache.ignite:ignite-core] ... 4 more [21:01:46]W: [org.apache.ignite:ignite-core] class org.apache.ignite.IgniteCheckedException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.cast(IgniteUtils.java:7773) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.resolve(GridFutureAdapter.java:260) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.get0(GridFutureAdapter.java:172) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.get(GridFutureAdapter.java:141) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridCompoundFuture.apply(GridCompoundFuture.java:100) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridCompoundFuture.apply(GridCompoundFuture.java:47) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.notifyListener(GridFutureAdapter.java:399) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.unblock(GridFutureAdapter.java:347) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.unblockAll(GridFutureAdapter.java:335) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.onDone(GridFutureAdapter.java:511) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.onDone(GridFutureAdapter.java:490) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.onDone(GridFutureAdapter.java:478) [21:01:46]W: [org.apache.ignite:ignite-core] [ rat org.apache.ignite.internal.util.IgniteUtils.lambda$wrapIgniteFuture$3(IgniteUtils.java:11719) [21:01:46]W: [org.apache.ignite:ignite-core] ue, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false... and 503 more]] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [21:01:46]W: [org.apache.ignite:ignite-core] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [21:01:46]W: [org.apache.ignite:ignite-core] at java.lang.Thread.run(Thread.java:748) [21:01:46]W: [org.apache.ignite:ignite-core] Caused by: class ostrg.apache.ignite.IgniteException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.lambda$syncMetadata$2(GridCacheOffheapManager.java:381) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.lambda$wrapIgniteFuture$3(IgniteUtils.java:11714) [21:01:46]W: [org.apache.ignite:ignite-core] ... 3 more [21:01:46]W: [org.apache.ignite:ignite-core] Caused by: class org.apache.ignite.internal.processors.cache.persistence.StorageException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.filehandle.FileWriteHandleImpl.checkNode(FileWriteHandleImpl.java:208) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.filehandle.FileWriteHandleImpl.addRecord(FileWriteHandleImpl.java:235) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager.log(FileWriteAheadLogManager.java:910) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager.log(FileWriteAheadLogManager.java:863) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.doInitPage(PageHandler.java:471) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.writePage(PageHandler.java:307) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.initPage(PageHandler.java:244) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.DataStructure.init(DataStructure.java:425) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.addStripe(PagesList.java:623) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.getPageForPut(PagesList.java:754) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.put(PagesList.java:859) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList$PutBucket.run(PagesList.java:199) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList$PutBucket.run(PagesList.java:173) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.writePage(PageHandler.java:313) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.DataStructure.write(DataStructure.java:304) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.flushBucketsCache(PagesList.java:415) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.saveMetadata(PagesList.java:356) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.saveStoreMetadata(GridCacheOffheapManager.java:403) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.lambda$syncMetadata$2(GridCacheOffheapManager.java:378) [21:01:46]W: [org.apache.ignite:ignite-core] ... 4 more [21:01:46]W: [org.apache.ignite:ignite-core] class org.apache.ignite.IgniteCheckedException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.cast(IgniteUtils.java:7773) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.resolve(GridFutureAdapter.java:260) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.get0(GridFutureAdapter.java:172) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.get(GridFutureAdapter.java:141) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridCompoundFuture.apply(GridCompoundFuture.java:100) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridCompoundFuture.apply(GridCompoundFuture.java:47) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.notifyListener(GridFutureAdapter.java:399) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.unblock(GridFutureAdapter.java:347) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.unblockAll(GridFutureAdapter.java:335) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.onDone(GridFutureAdapter.java:511) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.onDone(GridFutureAdapter.java:490) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.onDone(GridFutureAdapter.java:478) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.lambda$wrapIgniteFuture$3(IgniteUtils.java:11719) [21:01:46]W: [org.apache.ignite:ignite-core] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [21:01:46]W: [org.apache.ignite:ignite-core] [ at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [21:01:46]W: [org.apache.ignite:ignite-core] at java.lang.Thread.run(Thread.java:748) [21:01:46]W: [org.apache.ignite:ignite-core] Caused by: class org.apache.ignite.IgniteException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.lambda$syncMetadata$2(GridCacheOffheapManager.java:381) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.lambda$wrapIgniteFuture$3(IgniteUtils.java:11714) [21:01:46]W: [org.apache.ignite:ignite-core] ... 3 more [21:01:46]W: [org.apache.ignite:ignite-core] Caused by: class org.apache.ignite.internal.processors.cache.persistence.StorageException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.filehandle.FileWriteHandleImpl.checkNode(FileWriteHandleImpl.java:208) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.filehandle.FileWriteHandleImpl.addRecord(FileWriteHandleImpl.java:235) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager.log(FileWriteAheadLogManager.java:910) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager.log(FileWriteAheadLogManager.java:863) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.doInitPage(PageHandler.java:471) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.writePage(PageHandler.java:307) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.initPage(PageHandler.java:244) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.DataStructure.init(DataStructure.java:425) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.addStripe(PagesList.java:623) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.getPageForPut(PagesList.java:754) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.put(PagesList.java:859) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList$PutBucket.run(PagesList.java:199) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList$PutBucket.run(PagesList.java:173) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.writePage(PageHandler.java:313) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.DataStructure.write(DataStructure.java:304) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.flushBucketsCache(PagesList.java:415) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.saveMetadata(PagesList.java:356) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.saveStoreMetadata(GridCacheOffheapManager.java:403) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.lambda$syncMetadata$2(GridCacheOffheapManager.java:378) [21:01:46]W: [org.apache.ignite:ignite-core] ... 4 more [21:01:46]W: [org.apache.ignite:ignite-core] Exception in thread "checkpoint-runner-cpu-#1103%failure.IoomFailureHandlerTest1%" class org.apache.ignite.IgniteException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.lambda$syncMetadata$2(GridCacheOffheapManager.java:381) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.lambda$wrapIgniteFuture$3(IgniteUtils.java:11714) [21:01:46]W: [org.apache.ignite:ignite-core] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [21:01:46]W: [org.apache.ignite:ignite-core] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [21:01:46]W: [org.apache.ignite:ignite-core] at java.lang.Thread.run(Thread.java:748) [21:01:46]W: [org.apache.ignite:ignite-core] Caused by: class org.apache.ignite.internal.processors.cache.persistence.StorageException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.filehandle.FileWriteHandleImpl.checkNode(FileWriteHandleImpl.java:208) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.filehandle.FileWriteHandleImpl.addRecord(FileWriteHandleImpl.java:235) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager.log(FileWriteAheadLogManager.java:910) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager.log(FileWriteAheadLogManager.java:863) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.doInitPage(PageHandler.java:471) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.writePage(PageHandler.java:307) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.initPage(PageHandler.java:244) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.DataStructure.init(DataStructure.java:425) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.addStripe(PagesList.java:623) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.getPageForPut(PagesList.java:754) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.put(PagesList.java:859) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList$PutBucket.run(PagesList.java:199) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList$PutBucket.run(PagesList.java:173) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.writePage(PageHandler.java:313) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.DataStructure.write(DataStructure.java:304) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.flushBucketsCache(PagesList.java:415) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.saveMetadata(PagesList.java:356) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.saveStoreMetadata(GridCacheOffheapManager.java:403) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.lambda$syncMetadata$2(GridCacheOffheapManager.java:378) [21:01:46]W: [org.apache.ignite:ignite-core] ... 4 more [21:01:46]W: [org.apache.ignite:ignite-core] 21:01:46] (err) Failed to execute compound future reducer: GridCompoundFuture [rdc=null, initFlag=1, lsnrCalls=45, size=603, done=true, cancelled=false, err=class o.a.i.IgniteCheckedException: Failed to perform WAL operation (environment was invalidated by a previous error), futs=TransformCollectionView [true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false... and 503 more]]class org.apache.ignite.IgniteCheckedException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.cast(IgniteUtils.java:7773) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.resolve(GridFutureAdapter.java:260) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.get0(GridFutureAdapter.java:172) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.get(GridFutureAdapter.java:141) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridCompoundFuture.apply(GridCompoundFuture.java:100) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridCompoundFuture.apply(GridCompoundFuture.java:47) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.notifyListener(GridFutureAdapter.java:399) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.unblock(GridFutureAdapter.java:347) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.unblockAll(GridFutureAdapter.java:335) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.onDone(GridFutureAdapter.java:511) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.onDone(GridFutureAdapter.java:490) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.onDone(GridFutureAdapter.java:478) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.lambda$wrapIgniteFuture$3(IgniteUtils.java:11719) [21:01:46]W: [org.apache.ignite:ignite-core] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [21:01:46]W: [org.apache.ignite:ignite-core] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [21:01:46]W: [org.apache.ignite:ignite-core] at java.lang.Thread.run(Thread.java:748) [21:01:46]W: [org.apache.ignite:ignite-core] 21:01:4Caused by: class org.apache.ignite.IgniteException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:46]W: [org.apache.ignite:ignite-core] E at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.lambda$syncMetadata$2(GridCacheOffheapManager.java:381) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.lambda$wrapIgniteFuture$3(IgniteUtils.java:11714) [21:01:46]W: [org.apache.ignite:ignite-core] ... 3 more [21:01:46]W: [org.apache.ignite:ignite-core] Caused by: class org.apache.ignite.internal.processors.cache.persistence.StorageException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.filehandle.FileWriteHandleImpl.checkNode(FileWriteHandleImpl.java:208) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.filehandle.FileWriteHandleImpl.addRecord(FileWriteHandleImpl.java:235) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager.log(FileWriteAheadLogManager.java:910) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager.log(FileWriteAheadLogManager.java:863) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.doInitPage(PageHandler.java:471) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.writePage(PageHandler.java:307) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.initPage(PageHandler.java:244) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.DataStructure.init(DataStructure.java:425) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.addStripe(PagesList.java:623) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.getPageForPut(PagesList.java:754) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.put(PagesList.java:859) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList$PutBucket.run(PagesList.java:199) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList$PutBucket.run(PagesList.java:173) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.writePage(PageHandler.java:313) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.DataStructure.write(DataStructure.java:304) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.flushBucketsCache(PagesList.java:415) [21:01:46]W: [org.apache.ignite:ignite-core] rue, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, false, false, falseors.x, fal at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.saveMetadata(PagesList.java:356) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.saveStoreMetadata(GridCacheOffheapManager.java:403) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.lambda$syncMetadata$2(GridCacheOffheapManager.java:378) [21:01:46]W: [org.apache.ignite:ignite-core] ... 4 more [21:01:46]W: [org.apache.ignite:ignite-core] 6] (err) Failed to execute compound future reducer: GridCompoundFuture [rdc=null, initFlag=1, lsnrCalls=46, size=603, done=true, cancelled=false, err=class o.a.i.IgniteCheckedException: Failed to perform WAL operation (environment was invalidated by a previous error), futs=TransformCollectionView [true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true,[ true, se, false, false, false,Exception in thread "checkpoint-runner-cpu-#1104%failure.IoomFailureHandlerTest1%" class org.apache.ignite.IgniteException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.lambda$syncMetadata$2(GridCacheOffheapManager.java:381) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.lambda$wrapIgniteFuture$3(IgniteUtils.java:11714) [21:01:46]W: [org.apache.ignite:ignite-core] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [21:01:46]W: [org.apache.ignite:ignite-core] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [21:01:46]W: [org.apache.ignite:ignite-core] at java.lang.Thread.run(Thread.java:748) [21:01:46]W: [org.apache.ignite:ignite-core] Caused by: class org.apache.ignite.internal.processors.cache.persistence.StorageException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.filehandle.FileWriteHandleImpl.checkNode(FileWriteHandleImpl.java:208) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.filehandle.FileWriteHandleImpl.addRecord(FileWriteHandleImpl.java:235) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager.log(FileWriteAheadLogManager.java:910) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager.log(FileWriteAheadLogManager.java:863) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.doInitPage(PageHandler.java:471) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.writePage(PageHandler.java:307) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.initPage(PageHandler.java:244) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.DataStructure.init(DataStructure.java:425) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.addStripe(PagesList.java:623) [21:01:46]W: [org.apache.ignite:ignite-core] [ at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.getPageForPut(PagesList.java:754) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.put(PagesList.java:859) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList$PutBucket.run(PagesList.java:199) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList$PutBucket.run(PagesList.java:173) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.writePage(PageHandler.java:313) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.DataStructure.write(DataStructure.java:304) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.flushBucketsCache(PagesList.java:415) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.saveMetadata(PagesList.java:356) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.saveStoreMetadata(GridCacheOffheapManager.java:403) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.lambda$syncMetadata$2(GridCacheOffheapManager.java:378) [21:01:46]W: [org.apache.ignite:ignite-core] ... 4 more [21:01:46]W: [org.apache.ignite:ignite-core] ception incache.transactions.IgniteTxHandler. thread "checkpoint-runner-cpu-#1102%failure.IoomFailureHandlerTest1%" class org.apache.ignite.IgniteException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.lambda$syncMetadata$2(GridCacheOffheapManager.java:381) [21:01:46]W: [org.apache.ignite:ignite-core] at org.ap t2ache.ignite.internal.util.IgniteUtils.lambda$wrapIgniteFuture$3(IgniteUtils.java:11714) [21:01:46]W: [org.apache.ignite:ignite-core] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [21:01:46]W: [org.apache.ignite:ignite-core] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [21:01:46]W: [org.apache.ignite:ignite-core] at java.lang.Thread.run(Thread.java:748) [21:01:46]W: [org.apache.ignite:ignite-core] Caused by: class org.apache.ignite.internal.processors.cache.persistence.StorageException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.filehandle.FileWriteHandleImpl.checkNode(FileWriteHandleImpl.java:208) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.filehandle.FileWriteHandleImpl.addRecord(FileWriteHandleImpl.java:235) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager.log(FileWriteAheadLogManager.java:910) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager.log(FileWriteAheadLogManager.java:863) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.doInitPage(PageHandler.java:471) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.writePage(PageHandler.java:307) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.initPage(PageHandler.java:244) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.DataStructure.init(DataStructure.java:425) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.addStripe(PagesList.java:623) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.getPageForPut(PagesList.java:754) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.put(PagesList.java:859) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList$PutBucket.run(PagesList.java:199) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList$PutBucket.run(PagesList.java:173) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.writePage(PageHandler.java:313) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.DataStructure.write(DataStructure.java:304) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.flushBucketsCache(PagesList.java:415) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.saveMetadata(PagesList.java:356) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.saveStoreMetadata(GridCacheOffheapManager.java:403) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.lambda$syncMe2ptadata$2(GridCacheOffheapManager.java:378) [21:01:46]W: [org.apache.ignite:ignite-core] ... 4 more [21:01:46]W: [org.apache.ignite:ignite-core] 1:01:46] (err) Failed to execute compounruefrepareNearTx(IgniteTxHandler.java:580) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.transactions.IgniteTxHandler.prepareNearTx(IgniteTxHandler.java:377) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.transactions.IgniteTxHandler.processNearTxPrepareRequest0(IgniteTxHandler.java:200) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.transactions.IgniteTxHandler.processNearTxPrepareRequest(IgniteTxHandler.java:174) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.transactions.IgniteTxHandler.access$000(IgniteTxHandler.java:134) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.transactions.IgniteTxHandler$1.apply(IgniteTxHandler.java:222) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.transactions.IgniteTxHandler$1.apply(IgniteTxHandler.java:220) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.GridCacheIoManager.processMessage(GridCacheIoManager.java:1151) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.GridCacheIoManager.onMessage0(GridCacheIoManager.java:592) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.GridCacheIoManager.handleMessage(GridCacheIoManager.java:393) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.GridCacheIoManager.handleMessage(GridCacheIoManager.java:319) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.GridCacheIoManager.access$100(GridCacheIoManager.java:110) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.GridCacheIoManager$1.onMessage(GridCacheIoManager.java:309) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.managers.communication.GridIoManager.invokeListener(GridIoManager.java:1907) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.managers.communication.GridIoManager.processRegularMessage0(GridIoManager.java:1528) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.managers.communication.GridIoManager.access$5300(GridIoManager.java:242) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.managers.communication.GridIoManager$9.execute(GridIoManager.java:1421) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.managers.communication.TraceRunnable.run(TraceRunnable.java:55) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.StripedExecutor$Stripe.body(StripedExecutor.java:569) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:125) [21:01:46]W: [org.apache.ignite:ignite-core] at java.lang.Thread.run(Thread.java:748) [21:01:46]W: [org.apache.ignite:ignite-core] Caused by: class org.apache.ignite.internal.processors.cache.persistence.freelist.CorruptedFreeListException: Failed to insert data row [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.AbstractFreeList.insertDataRow(AbstractFreeList.java:595) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.CacheFreeList.insertDataRow(CacheFreeList.java:74) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.CacheFreeList.insertDataRow(CacheFreeList.java:35) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.RowStore.addRow(RowStore.java:117) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.IgniteCacheOffheapManagerImpl$CacheDataStoreImpl.createRow(IgniteCacheOffheapManagerImpl.java:1792) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager$GridCacheDataStore.createRow(GridCacheOffheapManager.java:2785) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.GridCacheMapEntry$UpdateClosure.call(GridCacheMapEntry.java:5833) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.GridCacheMapEntry$UpdateClosure.call(GridCacheMapEntry.java:5770) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.BPlusTree$Invoke.invokeClosure(BPlusTree.java:4041) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.BPlusTree$Invoke.access$5700(BPlusTree.java:3935) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.BPlusTree.invokeDown(BPlusTree.java:2039) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.BPlusTree.invoke(BPlusTree.java:1923) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.IgniteCacheOffheapManagerImpl$CacheDataStoreImpl.invoke0(IgniteCacheOffheapManagerImpl.java:1742) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.IgniteCacheOffheapManagerImpl$CacheDataStoreImpl.invoke(IgniteCacheOffheapManagerImpl.java:1725) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager$GridCacheDataStore.invoke(GridCacheOffheapManager.java:2818) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.IgniteCacheOffheapManagerImpl.invoke(IgniteCacheOffheapManagerImpl.java:449) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.GridCacheMapEntry.storeValue(GridCacheMapEntry.java:4304) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.GridCacheMapEntry.storeValue(GridCacheMapEntry.java:4278) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.GridCacheMapEntry.innerSet(GridCacheMapEntry.java:1553) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.transactions.IgniteTxLocalAdapter.userCommit(IgniteTxLocd future reducer: GridCompoundFuture [rdc=null, initFlag=1, lsnrCalls=47, size=603, done=true, cancelled=false, err=class o.a.i.IgniteCheckedException: Failed to perform WAL operation (environment was invalidated by a previous error), futs=TransformCollectionView [true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, false, false, false, false, false, false, false, false, faalAdapter.java:71alse, fa,:01:46] (err) Failed to execute compound future reducer: GridCompoundFuture [rdc=null, initFlag=1, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false... and 503 more]]class org.apache.ignite.IgniteCheckedException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.cast(IgniteUtils.java:7773) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.l3lutil.future.GridFutureAdapter.resolve(GridFutureAdapter.java:260) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.get0(GridFutureAdapter.java:172) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.get(GridFutureAdapter.java:141) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridCompoundFuture.apply(GridCompoundFuture.java:100) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridCompoundFuture.apply(GridCompoundFuture.java:47) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.notifyListener(GridFutureAdapter.java:399) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.unblock(GridFutureAdapter.java:347) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.unblockAll(GridFutureAdapter.java:335) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.onDone(GridFutureAdapter.java:511) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.onDone(GridFutureAdapter.java:490) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.onDone(GridFutureAdapter.java:478) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.lambda$wrapIgniteFuture$3(IgniteUtils.java:11719) [21:01:46]W: [org.apache.ignite:ignite-core] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [21:01:46]W: [org.apache.ignite:ignite-core] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [21:01:46]W: [org.apache.ignite:ignite-core] at java.lang.Thread.run(Thread.java:748) [21:01:46]W: [org.apache.ignite:ignite-core] Caused by: class org.apache.ignite.IgniteException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.lambda$syncMetadata$2(GridCacheOffheapManager.java:381) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.lambda$wrapIgniteFuture$3(IgniteUtils.java:11714) [21:01:46]W: [org.apache.ignite:ignite-core] se, f5) [21:01:46]W: [org.apache.ignite:ignite-core] ... 3sl a... 3 more [21:01:46]W: [org.apache.ignite:ignite-core] Caused by: class org.apache.ignite.internal.processors.cache.persistence.StorageException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.filehandle.FileWriteHandleImpl.checkNode(FileWriteHandleImpl.java:208) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.filehandle.FileWriteHandleImpl.addRecord(FileWriteHandleImpl.java:235) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager.log(FileWriteAheadLogManager.java:910) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager.log(FileWriteAheadLogManager.java:863) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.doInitPage(PageHandler.java:471) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.writePage(PageHandler.java:307) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.initPage(PageHandler.java:244) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.DataStructure.init(DataStructure.java:425) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.addStripe(PagesList.java:623) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.getPageForPut(PagesList.java:754) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.put(PagesList.java:859) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList$PutBucket.run(PagesList.java:199) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList$PutBucket.run(PagesList.java:173) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.writePage(PageHandler.java:313) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.DataStructure.write(DataStructure.java:304) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.flushBucketsCache(PagesList.java:415) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.saveMetadata(PagesList.java:356) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.saveStoreMetadata(GridCacheOffheapManager.java:403) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.lambda$syncMetadata$2(GridCacheOffheapManager.java:378) [21:01:46]W: [org.apache.ignite:ignite-core] ... 4 more [21:01:46]W: [org.apache.ignite:ignite-core] lse, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false... and 503 more,5 false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, falsees]n, fal rCamore [21:01:46]W: [org.apache.ignite:ignite-core] CException in thread "checkpoint-runner-cpu-#1105%failure.IoomFailureHandlerTest1%" class org.apache.ignite.IgniteException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.lambda$syncMetadata$2(GridCacheOffheapManager.java:381) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.lambda$wrapIgniteFuture$3(IgniteUtils.java:11714) [21:01:46]W: [org.apache.ignite:ignite-core] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [21:01:46]W: [org.apache.ignite:ignite-core] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [21:01:46]W: [org.apache.ignite:ignite-core] at java.lang.Thread.run(Thread.java:748) [21:01:46]W: [org.apache.ignite:ignite-core] Caused by: class org.apache.ignite.internal.processors.cache.persistence.StorageException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.filehandle.FileWriteHandleImpl.checkNode(FileWriteHandleImpl.java:208) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.filehandle.FileWriteHandleImpl.addRecord(FileWriteHandleImpl.java:235) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager.log(FileWriteAheadLogManager.java:910) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager.log(FileWriteAheadLogManager.java:863) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.doInitPage(PageHandler.java:471) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.writePage(PageHandler.java:307) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.initPage(PageHandler.java:244) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.DataStructure.init(DataStructure.java:425) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.addStripe(PagesList.java:623) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.getPageForPut(PagesList.java:754) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.put(PagesList.java:859) [21:01:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList$PutBucket.run(PagesList.java:199) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList$PutBucket.run(PagesList.javs]a:17al3) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.writePage(PageHandler.java:313) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.DataStructure.write(DataStructure.java:304) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.flushBucketsCache(PagesList.java:415) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.saveMetadata(PagesList.java:356) [21:01:47]W: [org.apache.ignite:ignite-core] [ at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.saveStoreMetadata(GridCacheOffheapManager.java:403) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.lambda$syncMetadata$2(GridCacheOffheapManager.java:378) [21:01:47]W: [org.apache.ignite:ignite-core] ... 4 more [21:01:47]W: [org.apache.ignite:ignite-core] class org.apache.ignite.IgniteCheckedException: Out of memory in data region [name=dfltPlc, initSize=10.0 MiB, maxSize=10.0 MiB, persistenceEnabled=true] Try the following: [21:01:47]W: [org.apache.ignite:ignite-core] ^-- Increase maximum off-heap memory size (DataRegionConfiguration.maxSize) [21:01:47]W: [org.apache.ignite:ignite-core] ^-- Enable eviction or expiration policies [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.cast(IgniteUtils.java:7773) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.resolve(GridFutureAdapter.java:260) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.get0(GridFutureAdapter.java:172) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.get(GridFutureAdapter.java:141) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridCompoundFuture.apply(GridCompoundFuture.java:100) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridCompoundFuture.apply(GridCompoundFuture.java:47) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.notifyListener(GridFutureAdapter.java:399) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.unblock(GridFutureAdapter.java:347) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.unblockAll(GridFutureAdapter.java:335) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.onDone(GridFutureAdapter.java:511) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.onDone(GridFutureAdapter.java:490) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.onDone(GridFutureAdapter.java:478) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.lambda$wrapIgniteFuture$3(IgniteUtils.java:11719) [21:01:47]W: [org.apache.ignite:ignite-core] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [21:01:47]W: [org.apache.ignite:ignite-core] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [21:01:47]W: [org.apache.ignite:ignite-core] at java.lang.Thread.run(Thread.java:748) [21:01:47]W: [org.apache.ignite:ignite-core] Caused by: class org.apache.ignite.internal.mem.IgniteOutOfMemoryException: Out of memory in data region [name=dfltPlc, initSize=10.0 MiB, maxSize=10.0 MiB, persistenceEnabled=true] Try the following: [21:01:47]W: [org.apache.ignite:ignite-core] ^-- Increase maximum off-heap memory size (DataRegionConfiguration.maxSize) [21:01:47]W: [org.apache.ignite:ignite-core] ^-- Enable eviction or expiration policies [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.pagemem.PageMemoryImpl.allocatePage(PageMemoryImpl.java:645) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager$GridCacheDataStore$1.allocatePageNoReuse(GridCacheOffheapManager.java:2049) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.DataStructure.allocatePage(DataStructure.java:177) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.addStripe(PagesList.java:621) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.getPageForPut(PagesList.java:754) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.put(PagesList.java:859) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList$PutBucket.run(PagesList.java:199) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList$PutBucket.run(PagesList.java:173) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.writePage(PageHandler.java:313) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.DataStructure.write(DataStructure.java:304) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.flushBucketsCache(PagesList.java:415) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.saveMetadata(PagesList.java:356) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.saveStoreMetadata(GridCacheOffheapManager.java:403) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.lambda$syncMetadata$2(GridCacheOffheapManager.java:378) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.lambda$wrapIgniteFuture$3(IgniteUtils.java:11714) [21:01:47]W: [org.apache.ignite:ignite-core] ... 3 more [21:01:47]W: [org.apache.ignite:ignite-core] Caused by: class org.apache.ignite.internal.mem.IgniteOutOfMemoryException: Failed to find a page for eviction (no pages to replace) [segmentCapacity=1250, loaded=481, maxDirtyPages=360, dirtyPages=481, cpPages=0, pinned=0] [21:01:47]W: [org.apache.ignite:ignite-core] Out of memory in data region [name=dfltPlc, initSize=10.0 MiB, maxSize=10.0 MiB, persistenceEnabled=true] Try the following: [21:01:47]W: [org.apache.ignite:ignite-core] ^-- Increase maximum off-heap memory size (DataRegionConfiguration.maxSize) [21:01:47]W: [org.apache.ignite:ignite-core] ^-- Enable eviction or expiration policies [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.pagemem.PageMemoryImpl$Segment.oomException(PageMemoryImpl.java:2345) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.pagemem.ClockPageReplacementPolicy.replace(ClockPageReplacementPolicy.java:94) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.pagemem.PageMemoryImpl$Segment.removePageForReplacement(PageMemoryImpl.java:2322) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.pagemem.PageMemoryImpl$Segment.access$900(PageMemoryImpl.java:1962) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.pagemem.PageMemoryImpl.allocatePage(PageMemoryImpl.java:587) [21:01:47]W: [org.apache.ignite:ignite-core] ... 17 more [21:01:47]W: [org.apache.ignite:ignite-core] ls=48, siused by: class org.apache.ignite.internal.mem.IgniteOutOfMemoryException: Out of memory in data region [name=dfltPlc, initSize=10.0 MiB, maxSize=10.0 MiB, persistenceEnabled=true] Try the following: [21:01:47]W: [org.apache.ignite:ignite-core] ^-- Increase maximum off-heap memory size (DataRegionConfiguration.maxSize) [21:01:47]W: [org.apache.ignite:ignite-core] ^-- Enable eviction or expiration policies [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.pagemem.PageMemoryImpl.allocatePage(PageMemoryImpl.java:645) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.AbstractFreeList.allocateDataPage(AbstractFreeList.java:575) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.AbstractFreeList.writeSinglePage(AbstractFreeListe, false, false, false, false, false, false, false, fa21:01:46] (err) Failed to execute compound future reducer: GridCompoundFuture [rdc=null, initFlag=1, lsnrCalls=49, size=603, done=true, cancelled=false, err=class o.a.i.IgniteCheckedException: Failed to perform WAL operation (environment was invalidated by a previous error), futs=TransformCollectionView [true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false... and 503 more]]class org.apache.ignite.IgniteCheckedException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.cast(IgniteUtils.java:7773) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.resolve(GridFutureAdapter.java:260) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.get0(GridFutureAdapter.java:172) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.get(GridFutureAdapter.java:141) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridCompoundFuture.apply(GridCompoundFuture.jazva:100) [21:01:47]W: [org.apache.ignite:ignite-core] lE.e at org.apache.ignite.internal.util.future.GridCompoundFuture.apply(GridCompoundFuture.java:47) [21:01:47]W: [org.apache.ignite:ignite-core] a=t org.apache.ignite.internal.util.future.GridFutureAdapter.notifyListener(GridFutureAdapter.java:399) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.unblock(GridFutureAdapter.java:347) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.unblockAll(GridFutureAdapter.java:335) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.onDone(GridFutureAdapter.java:511) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.onDone(GridFutureAdapter.java:490) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.onDone(GridFutureAdapter.java:478) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.lambda$wrapIgniteFuture$3(IgniteUtils.java:11719) [21:01:47]W: [org.apache.ignite:ignite-core] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [21:01:47]W: [org.apache.ignite:ignite-core] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [21:01:47]W: [org.apache.ignite:ignite-core] at java.lang.Thread.run(Thread.java:748) [21:01:47]W: [org.apache.ignite:ignite-core] Caused by: class org.apache.ignite.IgniteException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.lambda$syncMetadata$2(GridCacheOffheapManager.java:381) [21:01:47]W: [org.apache.ignite:ignite-core] java:693) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.AbstractFreeList.insertDataRoxw at org.apache.ignite.internal.util.IgniteUtils.lambda$wrapIgniteFuture$3(IgniteUtils.java:11714) [21:01:47]W: [org.apache.ignite:ignite-core] ... 3 more [21:01:47]W: [org.apache.ignite:ignite-core] Caused by: class org.apache.ignite.internal.processors.cache.persistence.StorageException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.filehandle.FileWriteHandleImpl.checkNode(FileWriteHandleImpl.java:208) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.filehandle.FileWriteHandleImpl.addRecord(FileWriteHandleImpl.java:235) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager.log(FileWriteAheadLogManager.java:910) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager.log(FileWriteAheadLogManager.java:863) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.doInitPage(PageHandler.java:471) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.writePage(PageHandler.java:307) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.initPage(PageHandler.java:244) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.DataStructure.init(DataStructure.java:425) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.addStripe(PagesList.java:623) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.getPageForPut(PagesList.java:754) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.put(PagesList.java:859) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList$PutBucket.run(PagesList.java:199) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList$PutBucket.run(PagesList.java:173) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.writePage(PageHandler.java:313) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.DataStructure.write(DataStructure.java:304) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.flushBucketsCache(PagesList.java:415) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.saveMetadata(PagesList.java:356) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.saveStoreMetadata(GridCacheOffheapManager.java:403) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.lambda$syncMetadata$2(GridCacheOffheapManager.java:378) [21:01:47]W: [org.apache.ignite:ignite-core] ... 4 more [21:01:47]W: [org.apache.ignite:ignite-core] [21:01:47] se, (err) Fai(AbstractFreeList.java:587) [21:01:47]W: [org.apache.ignite:ignite-core] ... 54 more [21:01:47]W: [org.apache.ignite:ignite-core] Caused by: class org.apache.ignite.internal.mem.IgniteOutOfMemoryException: Failed to find a page for eviction (no pages to replace) [segmentCapacity=1250, loaded=481, maxDirtyPages=360, dirtyPages=481, cpPages=0, pinned=1] [21:01:47]W: [org.apache.ignite:ignite-core] Out of memory in data region [name=dfltPlc, initSize=10.0 MiB, maxSize=10.0 MiB, persistenceEnabled=truled to execute compound future reducer: GridCompoundFuture [rdc=null, initFlag=1, lsnrCalls=50, size=603, done=true, cancelled=false, cerr603, done=true, cancelled=false, err=class o.a.i.IgniteCheckedException: Failed to perform WAL operation (environment was invalidated by a previous error), futs=TransformCollectionView [true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false... and 503 more]]class org.apache.ignite.IgniteCheckedException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.cast(IgniteUtils.java:7773) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.resolve(GridFutureAdapter.java:260) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.get0(GridFutureAdapter.java:172) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.get(GridFutureAdapter.java:141) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridCompoundFuture.apply(GridCompoundFuture.java:100) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridCompoundFuture.apply(GridCompoundFuture.java:47) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.notifyListener(GridFutureAdapter.java:399) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.unblock(GridFutureAdapter.java:347) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.unblockAll(GridFutureAdapter.java:335) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.onDone(GridFutureAdapter.java:511) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.onDone(GridFutureAdapter.java:490) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.onDone(GridFutureAdapter.java:478) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.lambda$wrapIgniteFuture$3(IgniteUtils.java:11719) [21:01:47]W: [org.apache.ignite:ignite-core] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [21:01:47]W: [org.apache.ignite:ignite-core] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [21:01:47]W: [org.apache.ignite:ignite-core] at java.lang.Thread.run(Thread.java:748) [21:01:47]W: [org.apache.ignite:ignite-core] Caused by: class org.apache.ignite.IgniteException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.lambda$syncMetadata$2(GridCacheOffheapManager.java:381) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.lambda$wrapIgniteFuture$3(IgniteUtils.java:11714) [21:01:47]W: [org.apache.ignite:ignite-core] ... 3 more [21:01:47]W: [org.apache.ignite:ignite-core] Caused by: class org.apache.ignite.internal.processors.cache.persistence.StorageException: Failed to perfofrm WAL operation =ee(environment was invalidated by a previous error) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.filehandle.FileWriteHandleImpl.checkNode(FileWriteHandleImpl.java:208) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.filehandle.FileWriteHandleImpl.addRecord(FileWriteHandleImpl.java:235) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager.log(FileWriteAheadLogManager.java:910) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager.log(FileWriteAheadLogManager.java:863) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.doInitPage(PageHandler.java:471) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.writePage(PageHandler.java:307) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.initPage(PageHandler.java:244) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.DataStructure.init(DataStructure.java:425) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.addStripe(PagesList.java:623) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.getPageForPut(PagesList.java:754) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.put(PagesList.java:859) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList$PutBucket.run(PagesList.java:199) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList$PutBucket.run(PagesList.java:173) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.writePage(PageHandler.java:313) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.DataStructure.write(DataStructure.java:304) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.flushBucketsCache(PagesList.java:415) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.saveMetadata(PagesList.java:356) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.saveStoreMetadata(GridCacheOffheapManager.java:403) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.lambda$syncMetadata$2(GridCacheOffheapManager.java:378) [21:01:47]W: [org.apache.ignite:ignite-core] ... 4 more [21:01:47]W: [org.apache.ignite:ignite-core] ] Try the following: [21:01:47]W: [org.apache.ignite:ignite-core] ^-- Increase maximum off-heap memory size (DataRegionConfiguration.maxSize) [21:01:47]W: [org.apache.ignite:ignite-core] ^-- Enable eviction or expiration policies [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.pagemem.PageMemoryImpl$Segment.oomExceptEptxion(PageMemoryImpl.java:2345) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.pagemem.ClockPageReplacementPolicy.replace(ClockPageReplacementPolicy.java:94) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.pagemem.PageMemoryImpl$Segment.removePageForReplacement(PageMemoryImpl.java:2322) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.pagemem.PageMemoryImpl$Segment.access$900(PageMemoryImpl.java:1962) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.pagemem.PageMemoryImpl.allocatePage(PageMemoryImpl.java:587) [21:01:47]W: [org.apache.ignite:ignite-core] ... 57 more [21:01:47]W: [org.apache.ignite:ignite-core] [2021-11-19 21:01:45,671][ERROR][ttl-cleanup-worker-#997%failure.IoomFailureHandlerTest1%][GridCacheSharedTtlCleanupManager] Runtime error caught during grid runnable execution: GridWorker [name=ttl-cleanup-worker, igniteInstanceName=failure.IoomFailureHandlerTest1, finished=false, heartbeatTs=1637344905585, hashCode=336553230, interrupted=false, runner=ttl-cleanup-worker-#997%failure.IoomFailureHandlerTest1%] [21:01:47]W: [org.apache.ignite:ignite-core] class org.apache.ignite.IgniteException: Failed to wait for checkpoint begin. [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.checkpoint.CheckpointTimeoutLock.checkpointReadLock(CheckpointTimeoutLock.java:150) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheDatabaseSharedManager.checkpointReadLock(GridCacheDatabaseSharedManager.java:1645) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.GridCacheSharedTtlCleanupManager$CleanupWorker.body(GridCacheSharedTtlCleanupManager.java:187) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:125) [21:01:47]W: [org.apache.ignite:ignite-core] at java.lang.Th[21:01:47] (err) Failed to execute compound future reducer: GridCompoundFuture [rdc=null, initFlag=1, lsnrCalls=51, size=603, done=true, cancelled=false, err=class o.a.i.IgniteCheckedException: Failed to perform WAL operation (environment was invalidated by a previous error), futs=TransformCollectionView [true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true[21:01:47] (err) Failed to execute compound future reducer: GridCompoundFuture [rdc=null, initFlag=1, lsnrCalls=52, size=603, done=true, cancelled=false, err=class o.a.i.IgniteCheckedException: Failed to perform WAL operation (environment was invalidated by a previous error), futs=TransformCollectionView [true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false,Ex falsealse, false, false, false, false, false... and 503 more]]class org.apache.ignite.IgniteCheckedException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.cast(IgniteUtils.java:7773) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.resolve(GridFutureAdapter.java:260) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.get0(GridFutureAdapter.java:172) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.get(GridFutureAdapter.java:141) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridCompoundFuture.apply(GridCompoundFuture.java:100) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridCompoundFuture.apply(GridCompoundFuture.java:47) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.notifyListener(GridFutureAdapter.java:399) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.unblock(GridFutureAdapter.java:347) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.unblockAll(GridFutureAdapter.java:335) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.onDone(GridFutureAdapter.java:511) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.onDone(GridFutureAdapter.java:490) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.onDone(GridFutureAdapter.java:478) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.lambda$wrapIgniteFuture$3(IgniteUtils.java:11719) [21:01:47]W: [org.apache.ignite:ignite-core] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [21:01:47]W: [org.apache.ignite:ignite-core] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [21:01:47]W: [org.apache.ignite:ignite-core] at java.lang.Thread.run(Thread.java:748) [21:01:47]W: [org.apache.ignite:ignite-core] Caused by: class org.apache.ignite.IgniteException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.lambda$syncMetadata$2(GridCacheOffheapManager.java:381) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.lambda$wrapIgniteFuture$3(IgniteUtils.java:11714) [21:01:47]W: [org.apache.ignite:ignite-core] ... 3 more [21:01:47]W: [org.apache.ignite:ignite-core] cCaused by: class org.apache.ignite.internal.processors.cache.persistence.StorageException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.filehandle.FileWriteHandleImpl.checkNode(FileWriteHandleImpl.java:208) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.filehandle.FileWriteHandleImpl.addRecord(FileWriteHandleImpl.java:235) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager.log(FileWriteAheadLogManager.java:910) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager.log(FileWriteAheadLogManager.java:863) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.doInitPage(PageHandler.java:471) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.writePage(PageHandler.java:307) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.initPage(PageHandler.java:244) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.DataStructure.init(DataStructure.java:425) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.addStripe(PagesList.java:623) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.getPageForPut(PagesList.java:754) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.put(PagesList.java:859) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList$PutBucket.run(PagesList.java:199) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList$PutBucket.run(PagesList.java:173) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.writePage(PageHandler.java:313) [21:01:47]W: [org.apache.ignite:ignite-core] ei at or,c,rcg.apache.ignite.internal.processors.cache.persistence.DataStructure.write(DataStructure.java:304) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.flushBucketsCache(PagesList.java:415) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.saveMetadata(PagesList.java:356) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.saveStoreMetadata(GridCacheOffheapManager.java:403) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.lambda$syncMetadata$2(GridCacheOffheapManager.java:378) [21:01:47]W: [org.apache.ignite:ignite-core] ... 4 more [21:01:47]W: [org.apache.ignite:ignite-core] lass o.a.i.IgniteCheckedException: Failed to perform WAL operation (environment was invalidated by a previous error), futs=TransformCollectionView [true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false... and 503 more]]class org.apache.ignite.IgniteCheckedException: Out of memory in data region [name=dfltPlc, initSize=10.0 MiB, maxSize=10.0 MiB, persistenceEnabled=true] Try the following: [21:01:47]W: [org.apache.ignite:ignite-core] ^-- Increase maximum off-heap memory size (DataRegionConfiguration.maxSize) [21:01:47]W: [org.apache.ignite:ignite-core] ^-- Enable eviction or expiration policies [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.cast(IgniteUtils.java:7773) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.resolve(GridFutureAdapter.java:260) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.get0(GridFutureAdapter.java:172) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.get(GridFutureAdapter.java:141) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridCompoundFuture.apply(GridCompoundFuture.java:100) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridCompoundFuture.apply(GridCompoundFuture.java:47) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.notifyListener(GridFutureAdapter.java:399) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.unblock(GridFutureAdapter.java:347) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.unblockAll(GridFutureAdapter.java:335) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.onDone(GridFutureAdapter.java:511) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.onDone(GridFutureAdapter.java:490) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.onDone(GridFutureAdapter.java:478) [21:01:47]W: [org.apache.ignite:ignite-core] ead.run(Thread.java:748) [21:01:47]W: [org.apache.ignite:ignite-core] Caused by: class org.apache.ignite.IgniteCheckedException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.cast(IgniteUtils.java:7773) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.resolve(GridFutureAdapter.java:260) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.get0(GridFutureAdapter.java:172) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.get(GridFutureAdapter.java:141) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridCompoundFuture.apply(GridCompoundFuture.java:100) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridCompoundFuture.apply(GridCompoundFuture.java:47) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.notifyListener(GridFutureAdapter.java:399) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.unblock(GridFutureAdapter.java:347) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.unblockAll(GridFutureAdapter.java:335) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.onDone(GridFutu r at org.apache.ignite.internal.util.IgniteUtils.lambda$wrapIgniteFuture$3(IgniteUtils.java:11719) [21:01:47]W: [org.apache.ignite:ignite-core] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [21:01:47]W: [org.apache.ignite:ignite-core] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [21:01:47]W: [org.apache.ignite:ignite-core] at java.lang.Thread.run(Thread.java:748) [21:01:47]W: [org.apache.ignite:ignite-core] Caused by: class org.apache.ignite.internal.mem.IgniteOutOfMemoryException: Out of memory in data region [name=dfltPlc, initSize=10.0 MiB, maxSize=10.0 MiB, persistenceEnabled=true] Try the following: [21:01:47]W: [org.apache.ignite:ignite-core] ^-- Increase maximum off-heap memory size (DataRegionConfiguration.maxSize) [21:01:47]W: [org.apache.ignite:ignite-core] ^-- Enable eviction or expiration policies [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.pagemem.PageMemoryImpl.allocatePage(PageMemoryImpl.java:645) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager$GridCacheDataStore$1.allocatePageNoReuse(GridCacheOffheapManager.java:2049) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.DataStructure.allocatePage(DataStructure.java:177) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.addStripe(PagesList.java:621) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.getPageForPut(PagesList.java:754) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.put(PagesList.java:859) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList$PutBucket.run(PagesList.java:199) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList$PutBucket.run(PagesList.java:173) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.writePage(PageHandler.java:313) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.DataStructure.write(DataStructure.java:304) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.flushBucketsCache(PagesList.java:415) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.saveMetadata(PagesList.java:356) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.saveStoreMetadata(GridCacheOffheapManager.java:403) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.lambda$syncMetadata$2(GridCacheOffheapManager.java:378) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.lambda$wrapIgniteFuture$3(IgniteUtils.java:11714) [21:01:47]W: [org.apache.ignite:ignite-core] ... 3 more [21:01:47]W: [org.apache.ignite:ignite-core] Caused by: class org.apache.ignite.internal.mem.IgniteOutOfMemoryException: Failed to find a page for eviction (no pages to replace) [segmentCapacity=1250, loaded=481, maxDirtyPages=360, dirtyPages=481, cpPages=0, pinned=0] [21:01:47]W: [org.apache.ignite:ignite-core] Out of memory in data region [name=dfltPlc, initSize=10.0 MiB, maxSize=10.0 MiB, persistenceEnabled=true] Try the following: [21:01:47]W: [org.apache.ignite:ignite-core] ^-- Increase maximum off-heap memory size (DataRegionConfiguration.maxSize) [21:01:47]W: [org.apache.ignite:ignite-core] ^-- Enable eviction or expiration policies [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.pagemem.PageMemoryImpl$Segment.oomException(PageMemoryImpl.java:2345) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.pagemem.ClockPageReplacementPolicy.replace(ClockPageReplacementPolicy.java:94) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.pagemem.PageMemoryImpl$Segment.removePageForReplacement(PageMemoryImpl.java:2322) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.pagemem.PageMemoryImpl$Segment.access$900(PageMemoryImpl.java:1962) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.pagemem.PageMemoryImpl.allocatePage(PageMemoryImpl.java:587) [21:01:47]W: [org.apache.ignite:ignite-core] ... 17 more [21:01:47]W: [org.apache.ignite:ignite-core] eption in thread "checkpoint-runner-cpu-#1108%failure.IoomFailureHandlerTest1%" class org.apache.ignite.IgniteException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.lambda$syncMetadata$2(GridCacheOffheapManager.java:381) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.lambda$wrapIgniteFuture$3(IgniteUtils.java:11714) [21:01:47]W: [org.apache.ignite:ignite-core] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [21:01:47]W: [org.apache.ignite:ignite-core] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [21:01:47]W: [org.apache.ignite:ignite-core] at java.lang.Thread.run(Thread.java:748) [21:01:47]W: [org.apache.ignite:ignite-core] Caused by: class org.apache.ignite.internal.processors.cache.persistence.StorageException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.filehandle.FileWriteHandleImpl.checkNode(FileWriteHandleImpl.java:208) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.filehandle.FileWriteHandleImpl.addRecord(FileWriteHandleImpl.java:235) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager.log(FileWriteAheadLogManager.java:910) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager.log(FileWriteAheadLogManager.java:863) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.doInitPage(PageHandler.java:471) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.writePage(PageHandler.java:307) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.initPage(PageHandler.java:244) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.DataStructure.init(DataStructure.java:425) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.addStripe(PagesList.java:623) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.getPageForPut(PagesList.java:754) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.put(PagesList.java:859) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList$PutBucket.run(PagesList.java:199) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList$PutBucket.run(PagesList.java:173) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.writePage(PageHandler.java:313) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.DataStructure.write(DataStructure.java:304) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.flushBucketsCache(PagesList.java:415) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.saveMetadata(PagesList.java:356) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.saveStoreMetadata(GridCacheOffheapManager.java:403) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.lambda$syncMetadata$2(GridCacheOffheapManager.java:378) [21:01:47]W: [org.apache.ignite:ignite-core] ... 4 more [21:01:47]W: [org.apache.ignite:ignite-core] false,on in thread "checkpoint-runner-cpu-#1106%failure.IoomFailureHandlerTest1%" false, false, false, false,class org.apache.ignite.internal.mem.IgniteOutOfMemoryException: Out of memory in data region [name=dfltPlc, initSize=10.0 MiB, maxSize=10.0 MiB, persistenceEnabled=true] Try the following: [21:01:47]W: [org.apache.ignite:ignite-core] ^-- Increase maximum off-heap memory size (DataRegionConfiguration.maxSize) [21:01:47]W: [org.apache.ignite:ignite-core] ^-- Enable eviction or expiration policies [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.pagemem.PageMemoryImpl.allocatePage(PageMemoryImpl.java:645) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager$GridCacheDataStore$1.allocatePageNoReuse(GridCacheOffheapManager.java:2049) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.DataStructure.allocatePage(DataStructure.java:177) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.addStripe(PagesList.java:621) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.getPageForPut(PagesList.java:754) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.put(PagesList.java:859) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList$PutBucket.run(PagesList.java:199) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList$PutBucket.run(PagesList.java:173) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.writePage(PageHandler.java:313) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.DataStructure.write(DataStructure.java:304) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.flushBucketsCache(PagesList.java:415) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.saveMetadata(PagesList.java:356) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.saveStoreMetadata(GridCacheOffheapManager.java:403) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.lambda$syncMetadata$2(GridCacheOffheapManager.java:378) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.lambda$wrapIgniteFuture$3(IgniteUtils.java:11714) [21:01:47]W: [org.apache.ignite:ignite-core] p at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [21:01:47]W: [org.apache.ignite:ignite-core] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [21:01:47]W: [org.apache.ignite:ignite-core] at java.lang.Thread.run(Thread.java:748) [21:01:47]W: [org.apache.ignite:ignite-core] Caused by: class org.apache.ignite.internal.mem.IgniteOutOfMemoryException: Failed to find a page for eviction (no pages to replace) [segmentCapacity=1250, loaded=481, maxDirtyPages=360, dirtyPages=481, cpPages=0, pinned=0] [21:01:47]W: [org.apache.ignite:ignite-core] Out of memory in data region [name=dfltPlc, initSize=10.0 MiB, maxSize=10.0 MiB, persistenceEnabled=true] Try the following: [21:01:47]W: [org.apache.ignite:ignite-core] ^-- Increase maximum off-heap memory size (DataRegionConfiguration.maxSize) [21:01:47]W: [org.apache.ignite:ignite-core] ^-- Enable eviction or expiration policies [21:01:47]W: [org.apache.ignite:ignite-core] tat org.apache.ignite.internal.processors.cache.persistence.pagemem.PageMemoryImpl$Segment.oomException(PageMemoryImpl.java:2345) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.pagemem.ClockPageReplacementPolicy.replace(ClockPageReplacementPolicy.java:94) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.pagemem.PageMemoryImpl$Segment.removePageForReplacement(PageMemoryImpl.java:2322) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.pagemem.PageMemoryImpl$Segment.access$900(PageMemoryImpl.java:1962) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.pagemem.PageMemoryImpl.allocatePage(PageMemoryImpl.java:587) [21:01:47]W: [org.apache.ignite:ignite-core] ... 17 more [21:01:47]W: [org.apache.ignite:ignite-core] false, false, false, f[21Excalse, false, false, false, false, false, false, false, false, false, false, false, false... and 503 more]]class org.apache.ignite.IgniteCheckedException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.cast(IgniteUtils.java:7773) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.resolve(GridFutureAdapter.java:260) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.get0(GridFutureAdapter.java:172) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.get(GridFutureAdapter.java:141) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridCompoundFuture.apply(GridCompoundFuture.java:100) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridCompoundFuture.apply(GridCompoundFuture.java:47) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.notifyListener(GridFutureAdapter.java:399) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.unblock(GridFutureAdapter.java:347) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.unblockAll(GridFutureAdapter.java:335) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.onDone(GridFutureAdapter.java:511) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.onDone(GridFutureAdapter.java:490) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.onDone(GridFutureAdapter.java:478) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.lambda$wrapIgniteFuture$3(Ignite:eUtils.java:11719) [21:01:47]W: [org.apache.ignite:ignite-core] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [21:01:47]W: [org.apache.ignite:ignite-core] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [21:01:47]W: [org.apache.ignite:ignite-core] at java.lang.Thread.run(Thread.java:748) [21:01:47]W: [org.apache.ignite:ignite-core] e[Caused by: class org.apache.ignite.IgniteException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.lambda$syncMetadata$2(GridCacheOffheapManager.java:381) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.lambda$wrapIgniteFuture$3(IgniteUtils.java:11714) [21:01:47]W: [org.apache.ignite:ignite-core] ... 3 more [21:01:47]W: [org.apache.ignite:ignite-core] Caused by: class org.apache.ignite.internal.processors.cache.persistence.StorageException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.filehandle.FileWriteHandleImpl.checkNode(FileWriteHandleImpl.java:208) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.filehandle.FileWriteHandleImpl.addRecord(FileWriteHandleImpl.java:235) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager.log(FileWriteAheadLogManager.java:910) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager.log(FileWriteAheadLogManager.java:863) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.doInitPage(PageHandler.java:471) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.writePage(PageHandler.java:307) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.initPage(PageHandler.java:244) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.DataStructure.init(DataStructure.java:425) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.addStripe(PagesList.java:623) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.getPageForPut(PagesList.java:754) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.put(PagesList.java:859) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList$PutBucket.run(PagesList.java:199) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList$PutBucket.run(PagesList.java:173) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.writePage(PageHandler.java:313) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.DataStructure.write(DataStructure.java:304) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.flushBucketsCache(PagesList.java:415) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.saveMetadata(PagesList.java:356) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.saveStoreMetadata(GridCacheOffheapManager.java:403) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.lambda$syncMetadata$2(GridCacheOffheapManager.java:378) [21:01:47]W: [org.apache.ignite:ignite-core] ... 4 more [21:01:47]W: [org.apache.ignite:ignite-core] Exception in thread "checkpoint-runner-cpu-#1099%failure.IoomFailureHandlerTest1%" class org.apache.ignite.IgniteException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:47]W: [org.apache.ignite:ignite-core] A at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.lambda$syncMetadata$2(GridCacheOffheapManager.java:381) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.lambda$wrapIgniteFuture$3(IgniteUtils.java:11714) [21:01:47]W: [org.apache.ignite:ignite-core] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [21:01:47]W: [org.apache.ignite:ignite-core] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [21:01:47]W: [org.apache.ignite:ignite-core] at java.lang.Thread.run(Thread.java:748) [21:01:47]W: [org.apache.ignite:ignite-core] Caused by: class org.apache.ignite.internal.processors.cache.persistence.StorageException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.filehandle.FileWriteHandleImpl.checkNode(FileWriteHandleImpl.java:208) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.filehandle.FileWriteHandleImpl.addRecord(FileWriteHandleImpl.java:235) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager.log(FileWriteAheadLogManager.java:910) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager.log(FileWriteAheadLogManager.java:863) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.doInitPage(PageHandler.java:471) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.writePage(PageHandler.java:307) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.initPage(PageHandler.java:244) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.DataStructure.init(DataStructure.java:425) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.addStripe(PagesList.java:623) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.getPageForPut(PagesList.java:754) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.put(PagesList.java:859) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList$PutBucket.run(PagesList.java:199) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList$PutBucket.run(PagesList.java:173) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.writePage(PageHandler.java:313) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.DataStructure.write(DataStructure.java:304) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.flushBucketsCache(PagesList.java:415) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.saveMetadata(PagesList.java:356) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.saveStoreMetadata(GridCacheOffheapManager.java:403) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.lambda$syncMetadata$2(GridCacheOffheapManager.java:378) [21:01:47]W: [org.apache.ignite:ignite-core] ... 4 more [21:01:47]W: [org.apache.ignite:ignite-core] true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, 01:47] (err) Failed to execute compound future reducer: GridCompoundFuture [rdc=null, initFlag=1, lsnrCalls=54, size=603, done=true, cancelled=false, err=class o.a.i.IgniteCheckedException: Failed to perform WAL operation (enException in thread "checkpoint-runner-cpu-#1111%failure.IoomFailureHandlerTest1%" class org.apache.ignite.IgniteException2: Failed to perform WAL operation (environment wavts invalidated by a previous error) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.lambda$syncMetadata$2(GridCacheOffheapManager.java:381) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.lambda$wrapIgniteFuture$3(IgniteUtils.java:11714) [21:01:47]W: [org.apache.ignite:ignite-core] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [21:01:47]W: [org.apache.ignite:ignite-core] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [21:01:47]W: [org.apache.ignite:ignite-core] at java.lang.Thread.run(Thread.java:748) [21:01:47]W: [org.apache.ignite:ignite-core] Caused by: class org.apache.ignite.internal.processors.cache.persistence.StorageException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.filehandle.FileWriteHandleImpl.checkNode(FileWriteHandleImpl.java:208) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.filehandle.FileWriteHandleImpl.addRecord(FileWriteHandleImpl.java:235) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager.log(FileWriteAheadLogManager.java:910) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager.log(FileWriteAheadLogManager.java:863) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.doInitPage(PageHandler.java:471) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.writePage(PageHandler.java:307) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.initPage(PageHandler.java:244) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.DataStructure.init(DataStructure.java:425) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.addStripe(PagesList.java:623) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.getPageForPut(PagesList.java:754) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.put(PagesList.java:859) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList$PutBucket.run(PagesList.java:199) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList$PutBucket.run(PagesList.java:173) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.writePage(PageHandler.java:313) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.DataStructure.write(DataStructure.java:304) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.flushBucketsCache(PagesList.java:415) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.saveMetadata(PagesList.java:356) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.saveStoreMetadata(GridCacheOffheapManager.java:403) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.lambda$syncMetadata$2(GridCacheOffheapManager.java:378) [21:01:47]W: [org.apache.ignite:ignite-core] ... 4 more [21:01:47]W: [org.apache.ignite:ignite-core] ion in thread "checkpoint-runner-cpu-#1107%failure.IoomFailureHandlerTest1%" class org.apache.ignite.IgniteException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.lambda$syncMetadata$2(GridCacheOffheapManager.java:381) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.lambda$wrapIgniteFuture$3(IgniteUtils.java:11714) [21:01:47]W: [org.apache.ignite:ignite-core] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [21:01:47]W: [org.apache.ignite:ignite-core] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [21:01:47]W: [org.apache.ignite:ignite-core] at java.lang.Thread.run(Thread.java:748) [21:01:47]W: [org.apache.ignite:ignite-core] Caused by: class org.apache.ignite.internal.processors.cache.persistence.StorageException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.filehandle.FileWriteHandleImpl.checkNode(FileWriteHandleImpl.java:208) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.filehandle.FileWriteHandleImpl.addRecord(FileWriteHandleImpl.java:235) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager.log(FileWriteAheadLogManager.java:910) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager.log(FileWriteAheadLogManager.java:863) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.doInitPage(PageHandler.java:471) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.writePage(PageHandler.java:307) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.initPage(PageHandler.java:244) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.DataStructure.init(DataStructure.java:425) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.addStripe(PagesList.java:623) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.getPageForPut(PagesList.java:754) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.put(PagesList.java:859) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList$PutBucket.run(PagesList.java:199) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList$PutBucket.run(PagesList.java:173) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.writePage(PageHandler.java:313) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.DataStructure.write(DataStructure.java:304) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.flushBucketsCache(PagesList.java:415) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.saveMetadata(PagesList.java:356) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.saveStoreMetadata(GridCacheOffheapManager.java:403) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.lambda$syncMetadata$2(GridCacheOffheapManager.java:378) [21:01:47]W: [org.apache.ignite:ignite-core] ... 4 more [21:01:47]W: [org.apache.ignite:ignite-core] ptionrue, f in thread "checkpoint-runner-cpu-#[21:01ironment was invalidated by a previous error), futs=TransformCollectionView [true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false... and 503 more]]class org.apache.ignite.IgniteCheckedException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.cast(IgniteUtils.java:7773) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.resolve(GridFutureAdapter.java:260) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.get0(GridFutureAdapter.java:172) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.get(GridFutureAdapter.java:1a41) [21:01:47]W: [org.apache.ignite:ignite-core] : at org.apache.ign1ite.internal.util.future.GridCompoundFuture.apply(GridCompoundFuture.java:100) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridCompoundFuture.apply(GridCompoundFuture.java:47) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.notifyListener(GridFutureAdapter.java:399) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.unblock(GridFutureAdapter.java:347) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.unblockAll(GridFutureAdapter.java:335) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.onDone(GridFutureAdapter.java:511) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.onDone(GridFutureAdapter.java:490) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.onDone(GridFutureAdapter.java:478) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.lambda$wrapIgniteFuture$3(IgniteUtils.java:11719) [21:01:47]W: [org.apache.ignite:ignite-core] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [21:01:47]W: [org.apache.ignite:ignite-core] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [21:01:47]W: [org.apache.ignite:ignite-core] at java.lang.Thread.run(Thread.java:748) [21:01:47]W: [org.apache.ignite:ignite-core] Caused by: class org.apache.ignite.IgniteException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.lambda$syncMetadata$2(GridCacheOffheapManager.java:381) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.lambda$wrapIgniteFuture$3(IgniteUtils.java:11714) [21:01:47]W: [org.apache.ignite:ignite-core] ... 3 more [21:01:47]W: [org.apache.ignite:ignite-core] Caused by: class org.apache.ignite.internal.processors.cache.persistence.StorageException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.filehandle.FileWriteHandleImpl.checkNode(FileWriteHandleImpl.java:208) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.filehandle.FileWriteHandleImpl.addRecord(FileWriteHandleImpl.java:235) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager.log(FileWriteAheadLogManager.java:910) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager.log(FileWriteAheadLogManager.java:863) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.doInitPage(PageHandler.java:471) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.writePage(PageHandler.java:307) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.initPage(PageHandler.java:244) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.DataStructure.init(DataStructure.java:425) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.addStripe(PagesList.java:623) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.getPageForPut(PagesList.java:754) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.put(PagesList.java:859) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList$PutBucket.run(PagesList.java:199) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList$PutBucket.run(PagesList.java:173) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.writePage(PageHandler.java:313) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.DataStructure.write(DataStructure.java:304) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.flushBucketsCache(PagesList.java:415) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.saveMetadata(PagesList.java:356) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.saveStoreMetadata(GridCacheOffheapManager.java:403) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.lambda$syncMetadata$2(GridCacheOffheapManager.java:378) [21:01:47]W: [org.apache.ignite:ignite-core] ... 4 more [21:01:47]W: [org.apache.ignite:ignite-core] Exception in thread "checkpoint-runner-cpu-#1113%failure.IoomFailureHandlerTest1%" class org.apache.ignite.IgniteException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.lambda$syncMetadata$2(GridCacheOffheapManager.java:381) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.lambda$wrapIgniteFuture$3(IgniteUtils.java:11714) [21:01:47]W: [org.apache.ignite:ignite-core] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [21:01:47]W: [org.apache.ignite:ignite-core] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [21:01:47]W: [org.apache.ignite:ignite-core] at java.lang.Thread.run(Thread.java:748) [21:01:47]W: [org.apache.ignite:ignite-core] Caused by: class org.apache.ignite.internal.processors.cache.persistence.StorageException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.filehandle.FileWriteHandleImpl.checkNode(FileWriteHandleImpl.java:208) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.filehandle.FileWriteHandleImpl.addRecord(FileWriteHandleImpl.java:235) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager.log(FileWriteAheadLogManager.java:910) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager.log(FileWriteAheadLogManager.java:863) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.doInitPage(PageHandler.java:471) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.writePage(PageHandler.java:307) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.initPage(PageHandler.java:244) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.DataStructure.init(DataStructure.java:425) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.addStripe(PagesList.java:623) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.getPageForPut(PagesList.java:754) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.put(PagesList.java:859) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList$PutBucket.run(PagesList.java:199) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList$PutBucket.run(PagesList.java:173) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.writePage(PageHandler.java:313) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.DataStructure.write(DataStructure.java:304) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.flushBucketsCache(PagesList.java:415) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.saveMetadata(PagesList.java:356) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.saveStoreMetadata(GridCacheOffheapManager.java:403) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.lambda$syncMetadata$2(GridCacheOffheapManager.java:378) [21:01:47]W: [org.apache.ignite:ignite-core] ... 4 more [21:01:47]W: [org.apache.ignite:ignite-core] dapter.java:511) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.onDone(GridFutureAdapter.java:490) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.onDone(GridFutureAdapter.java:478) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.lambda$wrapIgniteFuture$3(IgniteUtils.java:11719) [21:01:47]W: [org.apache.ignite:ignite-core] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [21:01:47]W: [org.apache.ignite:ignite-core] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [21:01:47]W: [org.apache.ignite:ignite-core] ... 1 more [21:01:47]W: [org.apache.ignite:ignite-core] Caused by: class org.apache.ignite.IgniteException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.lambda$syncMetadata$2(GridCacheOffheapManager.java:381) [21:01:47]W: [org.apache.ignite:ignite-core] at org[1.apache.ignite.internal.util.IgniteUtils.lambda$wrapIgniteFuture$3(IgniteUtils.java:11714) [21:01:47]W: [org.apache.ignite:ignite-core] ... 3 more [21:01:47]W: [org.apache.ignite:ignite-core] Caused by: class org.apache.ignite.internal.processors.cache.persistence.StorageException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.filehandle.FileWriteHand4leImpl.checkNode(FileWriteHandleImpl.java:208) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.filehandle.FileWriteHandleImpl.addRecord(FileWriteHandleImpl.java:235) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager.log(FileWriteAheadLogManager.java:910) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager.log(FileWriteAheadLogManager.java:863) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.doInitPage(PageHandler.java:471) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.writePage(PageHandler.java:307) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.initPage(PageHandler.java:244) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.DataStructure.init(DataStructure.java:425) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.addStripe(PagesList.java:623) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.getPageForPut(PagesList.java:754) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.put(PagesList.java:859) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList$PutBucket.run(PagesList.java:199) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList$PutBucket.run(PagesList.java:173) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.writePage(PageHandler.java:313) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.DataStructure.write(DataStructure.java:304) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.flushBucketsCache(PagesList.java:415) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.saveMetadata(PagesList.java:356) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.saveStoreMetadata(GridCacheOffheapManager.java:403) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.lambda$syncMetadata$2(GridCacheOffheapManager.java:378) [21:01:47] : [Step 4/5] [2021-11-19 21:01:47,081][INFO ][sys-stripe-15-#805%failure.IoomFailureHandlerTest0%][GridDeploymentLocalStore] Class locally deployed: class org.apache.ignite.IgniteCheckedException [21:01:47]W: [org.apache.ignite:ignite-core] ... 4 more [21:01:47] : [Step 4/5] [2021-11-19 21:01:47,197][INFO ][sys-stripe-15-#805%failure.IoomFailureHandlerTest0%][GridDeploymentLocalStore] Class locally deployed: class org.apache.ignite.IgniteException [21:01:47] : [Step 4/5] [2021-11-19 21:01:47,197][INFO ][sys-stripe-15-#805%failure.IoomFailureHandlerTest0%][GridDeploymentLocalStore] Class locally deployed: class [Ljava.lang.StackTraceElement; [21:01:47] : [Step 4/5] [2021-11-19 21:01:47,199][INFO ][sys-stripe-15-#805%failure.IoomFailureHandlerTest0%][GridDeploymentLocalStore] Class locally deployed: class [J [21:01:47]W: [org.apache.ignite:ignite-core] :01:47] (err) Failed to execute compound future reducer: GridCompoundFuture [rdc=null, initFlag=1, lsnrCalls=53, size=603, done=true, cancelled=false, err=class o.a.i.IgniteCheckedException: Failed to perform WAL operation (environment was invalidated by a previous error), futs=TransformCollectionView [true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, false, false, false, false,109%21:01:47] (err) Failed to execute compound future reducer: GridCompoundFuture [rdc=null, initFlag=1, lsnrCalls=56, size=603, done=true, cancelled=false, err=class o.a.i.IgniteCheckedException: Failed to perform WAL operation (environment was invalidated by a previous error), futs=TransformCollectionView [true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, trufailure.IoomFailureHandlerTest1%" class org.apache.ignite.internal.mem.IgniteOutOfMemoryException: Out of memory in data region [name=dfltPlc, initSize=10.0 MiB, maxSize=10.0 MiB, persistenceEnabled=true] Try the following: [21:01:47]W: [org.apache.ignite:ignite-core] ^-- Increase maximum off-heap memory size (DataRegionConfiguration.maxSize) [21:01:47]W: [org.apache.ignite:ignite-core] ^-- Enable eviction or expiration policies [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.pagemem.PageMemoryImpl.allocatePage(PageMemoryImpl.java:645) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager$GridCacheDataStore$1.allocatePageNoReuse(GridCacheOffheapManager.java:2049) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.DataStructure.allocatePage(DataStructure.java:177) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.addStripe(PagesList.java:621) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.getPageForPut(PagesList.java:75 l74) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.put(PagesList.java:859) [21:01:47]W: [org.apache.ignite:ignite-core] ]e at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList$PutBucket.run(PagesList.java:199) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList$PutBucket.run(PagesList.java:173) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.writePage(PageHandler.java:313) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.DataStructure.write(DataStructure.java:304) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.flushBucketsCache(PagesList.java:415) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.saveMetadata(PagesList.java:356) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.saveStoreMetadata(GridCacheOffheapManager.java:403) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.lambda$syncMetadata$2(GridCacheOffheapManager.java:378) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.lambda$wrapIgniteFuture$3(IgniteUtils.java:11714) [21:01:47]W: [org.apache.ignite:ignite-core] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [21:01:47]W: [org.apache.ignite:ignite-core] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [21:01:47]W: [org.apache.ignite:ignite-core] at java.lang.Thread.run(Thread.java:748) [21:01:47]W: [org.apache.ignite:ignite-core] Causesd by: class org.apache.ignite.internal.mem.IgniteOutOfMemoryException: Failed to find a page for eviction (no pages to replace) [segmentCapacity=1250, loaded=481, maxDirtyPages=360, dirtyPages=481, cpPages=0, pinned=0] [21:01:47]W: [org.apache.ignite:ignite-core] Out of memory in data region [name=dfltPlc, initSize=10.0 MiB, maxSize=10.0 MiB, persistenceEnabled=true] Try the following: [21:01:47]W: [org.apache.ignite:ignite-core] ^-- Increase maximum off-heap memory size (DataRegionConfiguration.maxSize) [21:01:47]W: [org.apache.ignite:ignite-core] ^-- Enable eviction or expiration policies [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.pagemem.PageMemoryImpl$Segment.oomException(PageMemoryImpl.java:2345) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.pagemem.ClockPageReplacementPolicy.replace(ClockPageReplacementPolicy.java:94) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.pagemem.PageMemoryImpl$Segment.removePageForReplacement(PageMemoryImpl.java:2322) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.pagemem.PageMemoryImpl$Segment.access$900(PageMemoryImpl.java:1962) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.pagemem.PageMemoryImpl.allocatePage(PageMemoryImpl.java:587) [21:01:47]W: [org.apache.ignite:ignite-core] ... 17 more [21:01:47]W: [org.apache.ignite:ignite-core] false, false, false, false, false, false, false, false, false, false, false, false, faelse, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false.., false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false... and 503 more]]class org.apache.ignite.IgniteCheckedException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.cast(IgniteUtils.java:7773) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.resolve(GridFutureAdapter.java:260) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.get0(GridFutureAdapter.java:172) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.get(GridFutureAdapter.java:141) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridCompoundFuture.apply(GridCompoundFuture.java:100) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridCompoundFuture.apply(GridCompoundFuture.java:47) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.notifyListener(GridFutureAdapter.java:399) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.unblock(GridFutureAdapter.java:347) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.unblockAll(GridFutureAdapter.java:335) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.onDone(GridFutureAdapter.java:511) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.onDone(GridFutureAdapter.java:490) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.onDone(GridFutureAdapter.java:478) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.lambda$wrapIgniteFuture$3(IgniteUtils.java:11719) [21:01:47]W: [org.apache.ignite:ignite-core] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [21:01:47]W: [org.apache.ignite:ignite-core] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [21:01:47]W: [org.apache.ignite:ignite-core] at java.lang.Thread.run(Thread.java:748) [21:01:47]W: [org.apache.ignite:ignite-core] Caused by: class org.apache.ignite.IgniteException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.lambda$syncMetadata$2(GridCacheOffheapManager.java:381) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.lambda$wrapIgniteFuture$3(IgniteUtils.java:11714) [21:01:47]W: [org.apache.ignite:ignite-core] ... 3 more [21:01:47]W: [org.apache.ignite:ignite-core] , (err) FaileCaused by: class org.apache.ignite.internal.processors.cache.persistence.StorageException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.filehandle.FileWriteHandleImpl.checkNode(FileWriteHandleImpl.java:208) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.filehandle.FileWriteHandleImpl.addRecord(FileWriteHandleImpl.java:235) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager.log(FileWriteAheadLogManager.java:910) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager.log(FileWriteAheadLogManager.java:863) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.doInitPage(PageHandler.java:471) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.writePage(PageHandler.java:307) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.initPage(PageHandler.java:244) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.DataStructure.init(DataStructure.java:425) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.addStripe(PagesList.java:623) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.getPageForPut(PagesList.java:754) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.put(PagesList.java:859) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList$PutBucket.run(PagesList.java:199) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList$PutBucket.run(PagesList.java:173) [21:01:47]W: [org.apache.ignite:ignite-core] d. at org.apache. ignite.internal.processors.cache.persistence.tree.util.PageHandler.writePage(PageHandler.java:313) [21:01:47]W: [org.apache.ignite:ignite-core] t at org.apache.ignite.internal.processors.cache.persistence.DataStructure.write(DataStructure.java:304) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.flushBucketsCache(PagesList.java:415) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.saveMetadata(PagesList.java:356) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.saveStoreMetadata(GridCacheOffheapManager.java:403) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.lambda$syncMetadata$2(GridCacheOffheapManager.java:378) [21:01:47]W: [org.apache.ignite:ignite-core] ... 4 more [21:01:47]W: [org.apache.ignite:ignite-core] and 503 more]]class org.apache.ignite.IgniteCheckedException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.cast(IgniteUtils.java:7773) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.resolve(GridFutureAdapter.java:260) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.get0(GridFutureAdapter.java:172) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.get(GridFutureAdapter.java:141) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridCompoundFuture.apply(GridCompoundFuture.java:100) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridCompoundFuture.apply(GridCompoundFuture.java:47) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.notifyListener(GridFutureAdapter.java:399) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.unblock(GridFutureAdapter.java:347) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.unblockAll(GridFutureAdapter.java:335) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.onDone(GridFutureAdapter.java:511) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.onDone(GridFutureAdapter.java:490) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.onDone(GridFutureAdapter.java:478) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.lambda$wrapIgniteFuture$3(IgniteUtils.java:11719) [21:01:47]W: [org.apache.ignite:ignite-core] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [21:01:47]W: [org.apache.ignite:ignite-core] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [21:01:47]W: [org.apache.ignite:ignite-core] at java.lang.Thread.run(Thread.java:748) [21:01:47]W: [org.apache.ignite:ignite-core] Caused by: class org.apache.ignite.IgniteException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.lambda$syncMetadata$2(GridCacheOffheapManager.java:381) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.lambda$wrapIgniteFuture$3(IgniteUtils.java:11714) [21:01:47]W: [org.apache.ignite:ignite-core] ... 3 more [21:01:47]W: [org.apache.ignite:ignite-core] Caused by: class org.apache.ignite.internal.processors.cache.persistence.StorageException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.filehandle.FileWriteHandleImpl.checkNode(FileWriteHandleImpl.java:208) [21:01:47]W: [org.apache.ignite:ignite-core] a[t org.apache.ignite.internal.processors.cache.persistence.wal.filehandle.FileWriteHandleImpl.addRecord(FileWriteHandleImpl.java:235) [21:01:47]W: [org.apache.ignite:ignite-core] E at org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager.log(FileWriteAheadLogManager.java:910) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager.log(FileWriteAheadLogManager.java:863) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.doInitPage(PageHandler.java:471) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.writePage(PageHandler.java:307) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.initPage(PageHandler.java:244) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.DataStructure.init(DataStructure.java:425) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.addStripe(PagesList.java:623) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.getPageForPut(PagesList.java:754) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.put(PagesList.java:859) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList$PutBucket.run(PagesList.java:199) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList$PutBucket.run(PagesList.java:173) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.writePage(PageHandler.java:313) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.DataStructure.write(DataStructure.java:304) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.flushBucketsCache(PagesList.java:415) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.saveMetadata(PagesList.java:356) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.saveStoreMetadata(GridCacheOffheapManager.java:403) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.lambda$syncMetadata$2(GridCacheOffheapManager.java:378) [21:01:47]W: [org.apache.ignite:ignite-core] ... 4 more [21:01:47]W: [org.apache.ignite:ignite-core] Exception in thread "checkpoint-runner-cpu-#1112%failure.IoomFailureHandlerTest1%" class org.apache.ignite.IgniteException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.lambda$syncMetadata$2(GridCacheOffheapManager.java:381) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.lambda$wrapIgniteFuture$3(IgniteUtils.java:11714) [21:01:47]W: [org.apache.ignite:ignite-core] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [21:01:47]W: [org.apache.ignite:ignite-core] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [21:01:47]W: [org.apache.ignite:ignite-core] at java.lang.Thread.run(Thread.java:748) [21:01:47]W: [org.apache.ignite:ignite-core] rCaused by: class org.apache.ignite.internal.processors.cache.persistence.StorageException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.filehandle.FileWriteHandleImpl.checkNode(FileWriteHandleImpl.java:208) [21:01:47]W: [org.apache.ignite:ignite-core] [ at org.apache.ignite.internal.processors.cache.persistence.wal.filehandle.FileWriteHandleImpl.addRecord(FileWriteHandleImpl.java:235) [21:01:47]W: [org.apache.ignite:ignite-core] x at org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager.log(FileWriteAheadLogManager.java:910) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager.log(FileWriteAheadLogManager.java:863) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.doInitPage(PageHandler.java:471) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.writePage(PageHandler.java:307) [21:01:47]W: [org.apache.ignite:ignite-core] at2 org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.initPage(PageHandler.java:244) [21:01:47]W: [org.apache.ignite:ignite-core] t at org.apache.ignite.internal.processors.cache.persistence.DataStructure.init(DataStructure.java:425) [21:01:47]W: [org.apache.ignite:ignite-core] o execute compound future reducer: GridCompoundFuture [rdc=null, initFlag=1, lsnrCalls=55, size=603, done=true, cancelled=false, err=class o.a.i.IgniteCheckedException: Failed to perform WAL op1:01 at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.addStripe(PagesList.java:623) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.getPageForPut(PagesList.java:754) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.put(PagesList.java:859) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList$PutBucket.run(PagesList.java:199) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList$PutBucket.run(PagesList.java:173) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.writePage(PageHandler.java:313) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.DataStructure.write(DataStructure.java:304) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.flushBucketsCache(PagesList.java:415) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.saveMetadata(PagesList.java:356) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.saveStoreMetadata(GridCacheOffheapManager.java:403) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.lambda$syncMetadata$2(GridCacheOffheapManager.java:378) [21:01:47]W: [org.apache.ignite:ignite-core] ... 4 more [21:01:47]W: [org.apache.ignite:ignite-core] ception in thread "checkpoint-runner-cpu-#1110%failure.Ioo21:01[2021-11-19 21:01:47,251][WARN ][sys-stripe-7-#917%failure.IoomFailureHandlerTest1%][finish] Received finish request for completed transaction (the message may be too late) [txId=GridCacheVersion [topVer=248824893, order=1637344893064, nodeOrder=1], dhtTxId=null, node=9d5c1368-d764-4b5a-a895-4879ea800000, commit=falue, tse] [21:01:47]W: [org.apache.ignite:ignite-core] mFailureHandlerTest1%" class org.apache.ignite.IgniteException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.lambda$syncMetadata$2(GridCacheOffheapManager.java:381) [21:01:47]W: [org.apache.ignite:ignite-core] eat org.apar:che.ignite.internal.util.IgniteUtils.lambda$wrapIgniteFuture$3(IgniteUtils.java:11714) [21:01:47]W: [org.apache.ignite:ignite-core] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [21:01:47]W: [org.apache.ignite:ignite-core] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [21:01:47]W: [org.apache.ignite:ignite-core] at java.lang.Thread.run(Thread.java:748) [21:01:47]W: [org.apache.ignite:ignite-core] Caused by: class org.apache.ignite.internal.processors.cache.persistence.StorageException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.filehandle.FileWriteHandleImpl.checkNode(FileWriteHandleImpl.java:208) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.filehandle.FileWriteHandleImpl.addRecord(FileWriteHandleImpl.java:235) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager.log(FileWriteAheadLogManager.java:910) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager.log(FileWriteAheadLogManager.java:863) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.doInitPage(PageHandler.java:471) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.writePage(PageHandler.java:307) [21:01:47]W: [org.apache.ignite:ignite-core] a:t org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.initPage(PageHandler.java:244) [21:01:47] : [Step 4/5] [2021-11-19 21:01:47,268][INFO ][test-runner-#789%failure.IoomFailureHandlerTest%][root] >>> Stopping grid [name=failure.IoomFailureHandlerTest1, id=fe65148c-4d17-4fff-9236-05b24cf00001] [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.DataStructure.init(DataStructure.java:425) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.addStripe(PagesList.java:623) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.getPageForPut(PagesList.java:754) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.put(PagesList.java:859) [21:01:47]W: [org.apache.ignite:ignite-core] 4 at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList$PutBucket.run(PagesList.java:199) [21:01:47]W: [org.apache.ignite:ignite-core] at ourg.apache.ignite.internal.processors.cache.persistence.freelist.PagesList$PutBucket.run(PagesList.java:173) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.writePage(PageHandler.java:313) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.DataStructure.write(DataStructure.java:304) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.flushBucketsCache(PagesList.java:415) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.saveMetadata(PagesList.java:356) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.saveStoreMetadata(GridCacheOffheapManager.java:403) [21:01:47]W: [org.apache.ignite:ignite-core] r at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.lambda$syncMetadata$2(GridCacheOffheapManager.java:378) [21:01:47]W: [org.apache.ignite:ignite-core] ... 4 more [21:01:47]W: [org.apache.ignite:ignite-core] ation (e, true, true, true, true, true, true, true, true, true, true, true, true, true, true, environm7]enttrue, t47rue, t was invalidated by a previous error), futs=TransformCollectionView [true, true, true, true, true, true, (err) Failed to execute compound future reducer: GridCompoundFuture [rdc=null, initFlag=1, lsnrCalls=58, size=603, done=true, cancelled=false, err=class o.a.i.IgniteCheckedExceptiontrue, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false... and 503 more]]class org.apache.ignite.IgniteCheckedException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.cast(IgniteUtils.java:7773) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.resolve(GridFutureAdapter.java:260) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.get0(GridFutureAdapter.java:172) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.get(GridFutureAdapter.java:141) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridCompoundFuture.apply(GridCompoundFuture.java:100) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridCompoundFuture.apply(GridCompoundFuture.java:47) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.notifyListener(GridFutureAdapter.java:399) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.unblock(GridFutureAdapter.java:347) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.unblockAll(GridFutureAdapter.java:335) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.onDone(GridFutureAdapter.java:511) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.onDone(GridFutureAdapter.java:490) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.onDone(GridFutureAdapter.java:478) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.lambda$wrapIgniteFuture$3(IgniteUtils.java:11719) [21:01:47]W: [org.apache.ignite:ignite-core] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [21:01:47]W: [org.apache.ignite:ignite-core] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [21:01:47]W: [org.apache.ignite:ignite-core] at java.lang.Thread.run(Thread.java:748) [21:01:47]W: [org.apache.ignite:ignite-core] Caused by: class org.apache.ignite.IgniteException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.lambda$syncMetadata$2(GridCacheOffheapManager.java:381) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.lambda$wrapIgniteFuture$3(IgniteUtils.java:11714) [21:01:47]W: [org.apache.ignite:ignite-core] ... 3 more [21:01:47]W: [org.apache.ignite:ignite-core] Caused by: class org.apache.ignite.internal.processors.cache.persistence.StorageException: Failed to perform WAL operr]ation (:environment was invalidated by a previous error) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.filehandle.FileWriteHandleImpl.checkNode(FileWriteHandleImpl.java:208) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.filehandle.FileWriteHandleImpl.addRecord(FileWriteHandleImpl.java:235) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager.log(FileWriteAheadLogManager.java:910) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager.log(FileWriteAheadLogManager.java:863) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.doInitPage(PageHandler.java:471) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.writePage(PageHandler.java:307) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.initPage(PageHandler.java:244) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.DataStructure.init(DataStructure.java:425) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.addStripe(PagesList.java:623) [21:01:47]W: [org.apache.ignite:ignite-core] ue, tr(erruFe, t)ra at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.getPageForPut(PagesList.java:754) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.put(PagesList.java:859) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.igniite.internal.processors.cache.persistence.freelist.PagesList$PutBucket.run(PagesList.java:199) [21:01:47]W: [org.apache.ignite:ignite-core] u at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList$PutBucket.run(PagesList.java:173) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.writePage(PageHandler.java:313) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.DataStructure.write(DataStructure.java:304) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.flushBucketsCache(PagesList.java:415) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.saveMetadata(PagesList.java:356) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.saveStoreMetadata(GridCacheOffheapManager.java:403) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.lambda$syncMetadata$2(GridCacheOffheapManager.java:378) [21:01:47]W: [org.apache.ignite:ignite-core] ... 4 more [21:01:47]W: [org.apache.ignite:ignite-core] Exception in thread "checkpoint-runner-cpu-#1114%failure.IoomFailureHandlerT est1%" Failed to class org.apache.ignite.IgniteException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.lambda$syncMetadata$2(GridCacheOffheapManager.java:381) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.lambda$wrapIgniteFuture$3(IgniteUtils.java:11714) [21:01:47]W: [org.apache.ignite:ignite-core] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [21:01:47]W: [org.apache.ignite:ignite-core] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [21:01:47]W: [org.apache.ignite:ignite-core] at java.lang.Thread.run(Thread.java:748) [21:01:47]W: [org.apache.ignite:ignite-core] Caused by: class org.apache.ignite.internal.processors.cache.persistence.StorageException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.filehandle.FileWriteHandleImpl.checkNode(FileWriteHandleImpl.java:208) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.filehandle.FileWriteHandleImpl.addRecord(FileWriteHandleImpl.java:235) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager.log(FileWriteAheadLogManager.java:910) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager.log(FileWriteAheadLogManager.java:863) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.doInitPage(PageHandler.java:471) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.writePage(PageHandler.java:307) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.initPage(PageHandler.java:244) [21:01:47]W: [org.apache.ignite:ignite-core] e, true, true, true, true, true, true, true, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false... and 503 more]] at org.apache.ignite.internal.processors.cache.persistence.DataStructure.init(DataStructure.java:425) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.addStripe(PagesList.java:623) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.getPageForPut(PagesList.java:754) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.put(PagesList.java:859) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList$PutBucket.run(PagesList.java:199) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList$PutBucket.run(PagesList.java:173) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.writePage(PageHandler.java:313) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.DataStructure.write(DataStructure.java:304) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.flushBucketsCache(PagesList.java:415) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.saveMetadata(PagesList.java:356) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.saveStoreMetadata(GridCacheOffheapManager.java:403) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.lambda$syncMetadata$2(GridCacheOffheapManager.java:378) [21:01:47]W: [org.apache.ignite:ignite-core] ... 4 more [21:01:47]W: [org.apache.ignite:ignite-core] led to perform WAL operation (environment was invalidated by a previousexecute compclass org.apache.ignite.IgniteCheckedException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:47]W: [org.apache.ignite:ignite-core] ound future reducer: GridCompoun at org.apache.ignite.internal.util.IgniteUtils.cast(IgniteUtils.java:7773) [21:01:47]W: [org.apache.ignite:ignite-core] d at org.apache.ignite.internal.util.future.GridFutureAdapter.resolve(GridFutureAdapter.java:260) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.get0(GridFutureAdapter.java:172) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.get(GridFutureAdapter.java:141) [21:01:47]W: [org.apache.ignite:ignite-core] F at org.apache.ignite.internal.util.future.GridCompoundFuture.apply(GridCompoundFuture.java:100) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridCompoundFuture.apply(GridCompoundFuture.java:47) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.notifyListener(GridFutureAdapter.java:399) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.unblock(GridFutureAdapter.java:347) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.unblockAll(GridFutureAdapter.java:335) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.onDone(GridFutureAdapter.java:511) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.onDone(GridFutureAdapter.java:490) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.onDone(GridFutureAdapter.java:478) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.lambda$wrapIgniteFuture$3(IgniteUtils.java:11719) [21:01:47]W: [org.apache.ignite:ignite-core] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [21:01:47]W: [org.apache.ignite:ignite-core] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [21:01:47]W: [org.apache.ignite:ignite-core] at java.lang.Thread.run(Thread.java:748) [21:01:47]W: [org.apache.ignite:ignite-core] Caused by: class org.apache.ignite.IgniteException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.lambda$syncMetadata$2(GridCacheOffheapManager.java:381) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.lambda$wrapIgniteFuture$3(IgniteUtils.java:11714) [21:01:47]W: [org.apache.ignite:ignite-core] ... 3 more [21:01:47]W: [org.apache.ignite:ignite-core] Caused by: class org.apache.ignite.internal.processors.cache.persistence.StorageException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.filehandle.FileWriteHandleImpl.checkNode(FileWriteHandleImpl.java:208) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.filehandle.FileWriteHandleImpl.addRecord(FileWriteHandleImpl.java:235) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager.log(FileWriteAheadLogManager.java:910) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager.log(FileWriteAheadLogManager.java:863) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.doInitPage(PageHandler.java:471) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.writePage(PageHandler.java:307) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.initPage(PageHandler.java:244) [21:01:47]W: [org.apache.ignite:ignite-core] u at org.apache.ignite.internal.processors.cache.persistence.DataStructure.init(DataStructure.java:425) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.addStripe(PagesList.java:623) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.getPageForPut(PagesList.java:754) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.put(PagesList.java:859) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList$PutBucket.run(PagesList.java:199) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList$PutBucket.run(PagesList.java:173) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.writePage(PageHandler.java:313) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.DataStructure.write(DataStructure.java:304) [21:01:47]W: [org.apache.ignite:ignite-core] e at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.flushBucketsCache(PagesList.java:415) [21:01:47]W: [org.apache.ignite:ignite-core] r at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.saveMetadata(PagesList.java:356) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.saveStoreMetadata(GridCacheOffheapManager.java:403) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.lambda$syncMetadata$2(GridCacheOffheapManager.java:378) [21:01:47]W: [org.apache.ignite:ignite-core] ... 4 more [21:01:47]W: [org.apache.ignite:ignite-core] ture [rdc=null, initFlag=1, lsrornrCalls=57, size=603, done=trExceptiue, cancelled=fa), lse, err=class o.a.i.IgniteCheckedException: Failed to perform WAL operation (environment was invalidated by a previous error), futs=TransformCollectionView [truone, true, true, true, truefu, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, tru in thread "checkpoint-runner-cpu-#1115%failure.IoomFaile, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, fats=Transformlse, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false... and 503 more]]class org.apache.ignite.IgniteCheckedException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.cast(IgniteUtils.java:7773) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.resolve(GridFutureAdapter.java:260) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.get0(GridFutureAdapter.java:172) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.get(GridFutureAdapter.java:141) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridCompoundFuture.apply(GridCompoundFuture.java:100) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridCompoundFuture.apply(GridCompoundFuture.java:47) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.notifyListener(GridFutureAdapter.java:399) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.unblock(GridFutureAdapter.java:347) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.unblockAll(GridFutureAdapter.java:335) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.onDone(GridFutureAdapter.java:511) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.onDone(GridFutureAdapter.java:490) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.onDone(GridFutureAdapter.java:478) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.lambda$wrapIgniteFuture$3(IgniteUtils.java:11719) [21:01:47]W: [org.apache.ignite:ignite-core] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [21:01:47]W: [org.apache.ignite:ignite-core] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [21:01:47]W: [org.apache.ignite:ignite-core] at java.lang.Thread.run(Thread.java:748) [21:01:47]W: [org.apache.ignite:ignite-core] ureHandlerTest1%" Caused by: class org.apache.ignite.IgniteException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.lambda$syncMetadata$2(GridCacheOffheapManager.java:381) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.lambda$wrapIgniteFuture$3(IgniteUtils.java:11714) [21:01:47]W: [org.apache.ignite:ignite-core] ... 3 more [21:01:47]W: [org.apache.ignite:ignite-core] Caused by: class org.apache.ignite.internal.processors.cache.persistence.StorageException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.filehandle.FileWriteHandleImpl.checkNode(FileWriteHandleImpl.java:208) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.filehandle.FileWriteHandleImpl.addRecord(FileWriteHandleImpl.java:235) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager.log(FileWriteAheadLogManager.java:910) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager.log(FileWriteAheadLogManager.java:863) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.doInitPage(PageHandler.java:471) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.writePage(PageHandler.java:307) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.initPage(PageHandler.java:244) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.DataStructure.init(DataStructure.java:425) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.addStripe(PagesList.java:623) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.getPageForPut(PagesList.java:754) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.Cfreelist.PagesList.put(PagesList.java:859) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList$PutBucket.run(PagesList.java:199) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList$PutBucket.run(PagesList.java:173) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.writePage(PageHandler.java:313) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.DataStructure.write(DataStructure.java:304) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.flushBucketsCache(PagesList.java:415) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.saveMetadata(PagesList.java:356) [21:01:47]W: [org.apache.ignite:ignite-core] o at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.saveStoreMetadata(GridCacheOffheapManager.java:403) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.lambda$syncMetadata$2(GridCacheOffheapManager.java:378) [21:01:47]W: [org.apache.ignite:ignite-core] ... 4 more [21:01:47]W: [org.apache.ignite:ignite-core] llectionView [truclass org.apache.ignite.IgniteException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.lambda$syncMetadata$2(GridCacheOffheapManager.java:381) [21:01:47]W: [org.apache.ignite:ignite-core] e at org.apache.ignite.internal.util.IgniteUtils.lambda$wrapIgniteFuture$3(IgniteUtils.java:11714) [21:01:47]W: [org.apache.ignite:ignite-core] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [21:01:47]W: [org.apache.ignite:ignite-core] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [21:01:47]W: [org.apache.ignite:ignite-core] ,E at java.lang.Thread.run(Thread.java:748) [21:01:47]W: [org.apache.ignite:ignite-core] Caused by: class org.apache.ignite.internal.processors.cache.persistence.StorageException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.filehandle.FileWriteHandleImpl.checkNode(FileWriteHandleImpl.java:208) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.filehandle.FileWriteHandleImpl.addRecord(FileWriteHandleImpl.java:235) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager.log(FileWriteAheadLogManager.java:910) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager.log(FileWriteAheadLogManager.java:863) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.doInitPage(PageHandler.java:471) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.writePage(PageHandler.java:307) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.initPage(PageHandler.java:244) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.DataStructure.init(DataStructure.java:425) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.addStripe(PagesList.java:623) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.getPageForPut(PagesList.java:754) [21:01:47]W: [org.apache.ignite:ignite-core] axt org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.put(PagesList.java:859) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList$PutBucket.run(PagesList.java:199) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList$PutBucket.run(PagesList.java:173) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.writePage(PageHandler.java:313) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.DataStructure.write(DataStructure.java:304) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.flushBucketsCache(PagesList.java:415) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.saveMetadata(PagesList.java:356) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.saveStoreMetadata(GridCacheOffheapManager.java:403) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.lambda$syncMetadata$2(GridCacheOffheapManager.java:378) [21:01:47]W: [org.apache.ignite:ignite-core] ... 4 more [21:01:47]W: [org.apache.ignite:ignite-core] tceptionr in thread "checkpoint-runner-cpu-#1116%uefailure.Io, omFtrailureHandlerTest1%" ue, true, true, trueclass org.apache.ignite.IgniteException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:47]W: [org.apache.ignite:ignite-core] , at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.lambda$syncMetadata$2(GridCacheOffheapManager.java:381) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.lambda$wrapIgniteFuture$3(IgniteUtils.java:11714) [21:01:47]W: [org.apache.ignite:ignite-core] t at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [21:01:47]W: [org.apache.ignite:ignite-core] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [21:01:47]W: [org.apache.ignite:ignite-core] at java.lang.Thread.run(Thread.java:748) [21:01:47]W: [org.apache.ignite:ignite-core] rCaused by: class org.apache.ignite.internal.processors.cache.persistence.StorageException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.filehandle.FileWriteHandleImpl.checkNode(FileWriteHandleImpl.java:208) [21:01:47]W: [org.apache.ignite:ignite-core] u at org.apache.ignite.internal.processors.cache.persistence.wal.filehandle.FileWriteHandleImpl.addRecord(FileWriteHandleImpl.java:235) [21:01:47]W: [org.apache.ignite:ignite-core] e at org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager.log(FileWriteAheadLogManager.java:910) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager.log(FileWriteAheadLogManager.java:863) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.doInitPage(PageHandler.java:471) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.writePage(PageHandler.java:307) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.initPage(PageHandler.java:244) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.DataStructure.init(DataStructure.java:425) [21:01:47]W: [org.apache.ignite:ignite-core] , at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.addStripe(PagesList.java:623) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.getPageForPut(PagesList.java:754) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.put(PagesList.java:859) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList$PutBucket.run(PagesList.java:199) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList$PutBucket.run(PagesList.java:173) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.writePage(PageHandler.java:313) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.DataStructure.write(DataStructure.java:304) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.flushBucketsCache(PagesList.java:415) [21:01:47]W: [org.apache.ignite:ignite-core] t at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.saveMetadata(PagesList.java:356) [21:01:47]W: [org.apache.ignite:ignite-core] r at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.saveStoreMetadata(GridCacheOffheapManager.java:403) [21:01:47]W: [org.apache.ignite:ignite-core] u at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.lambda$syncMetadata$2(GridCacheOffheapManager.java:378) [21:01:47]W: [org.apache.ignite:ignite-core] ... 4 more [21:01:47]W: [org.apache.ignite:ignite-core] e, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, true, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false, false... and 503 more]]class org.apache.ignite.IgniteCheckedException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.cast(IgniteUtils.java:7773) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.resolve(GridFutureAdapter.java:260) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.get0(GridFutureAdapter.java:172) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.get(GridFutureAdapter.java:141) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridCompoundFuture.apply(GridCompoundFuture.java:100) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridCompoundFuture.apply(GridCompoundFuture.java:47) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.notifyListener(GridFutureAdapter.java:399) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.unblock(GridFutureAdapter.java:347) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.unblockAll(GridFutureAdapter.java:335) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.onDone(GridFutureAdapter.java:511) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.onDone(GridFutureAdapter.java:490) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.onDone(GridFutureAdapter.java:478) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.lambda$wrapIgniteFuture$3(IgniteUtils.java:11719) [21:01:47]W: [org.apache.ignite:ignite-core] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [21:01:47]W: [org.apache.ignite:ignite-core] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [21:01:47]W: [org.apache.ignite:ignite-core] at java.lang.Thread.run(Thread.java:748) [21:01:47]W: [org.apache.ignite:ignite-core] Caused by: class org.apache.ignite.IgniteException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.lambda$syncMetadata$2(GridCacheOffheapManager.java:381) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.lambda$wrapIgniteFuture$3(IgniteUtils.java:11714) [21:01:47]W: [org.apache.ignite:ignite-core] ... 3 more [21:01:47]W: [org.apache.ignite:ignite-core] Caused by: class org.apache.ignite.internal.processors.cache.persistence.StorageException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.filehandle.FileWriteHandleImpl.checkNode(FileWriteHandleImpl.java:208) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.filehandle.FileWriteHandleImpl.addRecord(FileWriteHandleImpl.java:235) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager.log(FileWriteAheadLogManager.java:910) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager.log(FileWriteAheadLogManager.java:863) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.doInitPage(PageHandler.java:471) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.writePage(PageHandler.java:307) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.initPage(PageHandler.java:244) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.DataStructure.init(DataStructure.java:425) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.addStripe(PagesList.java:623) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.getPageForPut(PagesList.java:754) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.put(PagesList.java:859) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList$PutBucket.run(PagesList.java:199) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList$PutBucket.run(PagesList.java:173) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.writePage(PageHandler.java:313) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.DataStructure.write(DataStructure.java:304) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.flushBucketsCache(PagesList.java:415) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.saveMetadata(PagesList.java:356) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.saveStoreMetadata(GridCacheOffheapManager.java:403) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.lambda$syncMetadata$2(GridCacheOffheapManager.java:378) [21:01:47]W: [org.apache.ignite:ignite-core] ... 4 more [21:01:47]W: [org.apache.ignite:ignite-core] Exception in thread "checkpoint-runner-cpu-#1117%failure.IoomFailureHandlerTest1%" class org.apache.ignite.IgniteException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.lambda$syncMetadata$2(GridCacheOffheapManager.java:381) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.lambda$wrapIgniteFuture$3(IgniteUtils.java:11714) [21:01:47]W: [org.apache.ignite:ignite-core] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [21:01:47]W: [org.apache.ignite:ignite-core] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [21:01:47]W: [org.apache.ignite:ignite-core] at java.lang.Thread.run(Thread.java:748) [21:01:47]W: [org.apache.ignite:ignite-core] Caused by: class org.apache.ignite.internal.processors.cache.persistence.StorageException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.filehandle.FileWriteHandleImpl.checkNode(FileWriteHandleImpl.java:208) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.filehandle.FileWriteHandleImpl.addRecord(FileWriteHandleImpl.java:235) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager.log(FileWriteAheadLogManager.java:910) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager.log(FileWriteAheadLogManager.java:863) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.doInitPage(PageHandler.java:471) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.writePage(PageHandler.java:307) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.initPage(PageHandler.java:244) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.DataStructure.init(DataStructure.java:425) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.addStripe(PagesList.java:623) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.getPageForPut(PagesList.java:754) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.put(PagesList.java:859) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList$PutBucket.run(PagesList.java:199) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList$PutBucket.run(PagesList.java:173) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.writePage(PageHandler.java:313) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.DataStructure.write(DataStructure.java:304) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.flushBucketsCache(PagesList.java:415) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.freelist.PagesList.saveMetadata(PagesList.java:356) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.saveStoreMetadata(GridCacheOffheapManager.java:403) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager.lambda$syncMetadata$2(GridCacheOffheapManager.java:378) [21:01:47]W: [org.apache.ignite:ignite-core] ... 4 more [21:01:47] : [Step 4/5] [2021-11-19 21:01:47,377][INFO ][tcp-disco-sock-reader-[9d5c1368 127.0.0.1:34285]-#54%failure.IoomFailureHandlerTest1%-#1027%failure.IoomFailureHandlerTest1%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:34285, rmtPort=34285, rmtNodeId=9d5c1368-d764-4b5a-a895-4879ea800000] [21:01:47] : [Step 4/5] [2021-11-19 21:01:47,378][INFO ][disco-event-worker-#906%failure.IoomFailureHandlerTest0%][GridDiscoveryManager] Node left topology: TcpDiscoveryNode [id=fe65148c-4d17-4fff-9236-05b24cf00001, consistentId=bc754eaf-364f-41c4-9df3-ae5b24c02e12, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637344894059, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false] [21:01:47] : [Step 4/5] [2021-11-19 21:01:47,380][INFO ][disco-event-worker-#906%failure.IoomFailureHandlerTest0%][GridDiscoveryManager] Topology snapshot [ver=3, locNode=9d5c1368, servers=1, clients=0, state=ACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=9d5c1368-d764-4b5a-a895-4879ea800000, consistentId=a571b31d-b6bc-4984-9a28-b3fa77ead9f4, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:01:47] : [Step 4/5] [2021-11-19 21:01:47,381][INFO ][disco-event-worker-#906%failure.IoomFailureHandlerTest0%][GridDiscoveryManager] ^-- Baseline [id=0, size=2, online=1, offline=1] [21:01:47] : [Step 4/5] [2021-11-19 21:01:47,416][INFO ][test-runner-#789%failure.IoomFailureHandlerTest%][GridCacheProcessor] Stopped cache [cacheName=default] [21:01:47]W: [org.apache.ignite:ignite-core] [2021-11-19 21:01:47,383][WARN ][grid-nio-worker-tcp-comm-0-#844%TcpCommunicationSpi%][TcpCommunicationSpi] Failed to shutdown socket [21:01:47]W: [org.apache.ignite:ignite-core] java.nio.channels.ClosedChannelException [21:01:47] : [Step 4/5] [2021-11-19 21:01:47,415][INFO ][exchange-worker-#907%failure.IoomFailureHandlerTest0%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], crd=true, evt=NODE_LEFT, evtNode=fe65148c-4d17-4fff-9236-05b24cf00001, customEvt=null, allowMerge=false, exchangeFreeSwitch=true] [21:01:47]W: [org.apache.ignite:ignite-core] at sun.nio.ch.SocketChannelImpl.shutdownOutput(SocketChannelImpl.java:795) [21:01:47] : [Step 4/5] [2021-11-19 21:01:47,428][INFO ][test-runner-#789%failure.IoomFailureHandlerTest%][GridCacheProcessor] Stopped cache [cacheName=ignite-sys-cache] [21:01:47]W: [org.apache.ignite:ignite-core] at sun.nio.ch.SocketAdaptor.shutdownOutput(SocketAdaptor.java:407) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.close(IgniteUtils.java:4247) [21:01:47] : [Step 4/5] [2021-11-19 21:01:47,429][INFO ][exchange-worker-#907%failure.IoomFailureHandlerTest0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.closeKey(GridNioServer.java:2784) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.close(GridNioServer.java:2835) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.close(GridNioServer.java:2794) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.bodyInternal(GridNioServer.java:2157) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.body(GridNioServer.java:1910) [21:01:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:125) [21:01:47]W: [org.apache.ignite:ignite-core] at java.lang.Thread.run(Thread.java:748) [21:01:47] : [Step 4/5] [2021-11-19 21:01:47,443][INFO ][exchange-worker-#907%failure.IoomFailureHandlerTest0%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], err=null, rebalanced=true, wasRebalanced=true] [21:01:47]W: [org.apache.ignite:ignite-core] [2021-11-19 21:01:47,448][WARN ][exchange-worker-#907%failure.IoomFailureHandlerTest0%][GridDhtPartitionTopologyImpl] Detected lost partitions [grp=default, parts=[3, 7-8, 11, 13-14, 19, 26-27, 30-33, 35, 37, 39-44, 46, 49-50, 52-54, 57, 59-61, 66-68, 70, 73-74, 78, 80-86, 88-89, 92, 95, 98, 100-101, 103, 105-107, 109, 111-114, 118, 121-124, 126-127, 130-131, 134, 137, 139, 141-143, 148, 150, 152, 157-158, 162-165, 173-176, 181, 183, 185, 187-189, 191, 194, 197-202, 204-206, 209, 212-213, 216-217, 219-220, 222-223, 225, 227, 229-230, 232, 234-239, 248, 250-251, 257, 259, 261-263, 266-269, 278, 280-281, 286-287, 290, 292, 294-296, 299, 301, 308-309, 311-312, 315-318, 322, 324-325, 327, 329-330, 332, 334, 338, 344-348, 351, 354-355, 358-359, 363, 366, 371-372, 374-375, 377-379, 382-386, 389, 392-393, 395, 397-401, 405, 407, 410, 414-416, 421-423, 430-431, 434, 436-439, 441-442, 447, 450, 454-455, 460, 462-465, 467-468, 473, 475-476, 479-482, 485, 487-489, 492, 496, 499, 501-504, 506, 508, 512, 514-516, 519-520, 522, 524-526, 528-530, 532-535, 541-543, 546-548, 550-551, 555, 557-564, 568, 570-571, 573, 575-576, 578-579, 583-585, 588, 592-594, 598, 600, 603, 605-607, 609, 611-614, 619-621, 624-626, 628-629, 633-635, 637-638, 640-641, 644, 647, 649, 651, 654-655, 659-662, 664, 666-669, 671-672, 675-676, 678, 682, 684, 686-689, 696-699, 704, 706, 708, 712, 714-715, 717, 724-725, 732-734, 743-748, 750, 753-757, 759, 768-769, 771, 776, 779-781, 785-786, 789-791, 795, 797, 799, 801, 803, 805-806, 809-811, 813, 816, 819, 825-828, 832, 835, 837, 839, 841, 845, 849, 851-852, 855-856, 858-859, 861-862, 864, 867, 869, 871-873, 875, 877-878, 881, 885-886, 888-889, 892, 894-896, 898-901, 916-917, 921, 925, 930, 933-935, 937-939, 943, 945-951, 953, 955, 957, 960-961, 964-966, 968, 970, 973, 975, 978-979, 982, 984-985, 987-989, 992, 994-995, 999-1001, 1003-1005, 1007, 1009, 1014-1015, 1018, 1020, 1022-1023], topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0]] [21:01:47] : [Step 4/5] [2021-11-19 21:01:47,459][INFO ][exchange-worker-#907%failure.IoomFailureHandlerTest0%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=9d5c1368-d764-4b5a-a895-4879ea800000, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], evt=NODE_LEFT, evtNode=TcpDiscoveryNode [id=fe65148c-4d17-4fff-9236-05b24cf00001, consistentId=bc754eaf-364f-41c4-9df3-ae5b24c02e12, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637344894059, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0]] [21:01:47] : [Step 4/5] [2021-11-19 21:01:47,461][INFO ][exchange-worker-#907%failure.IoomFailureHandlerTest0%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (1 ms), stage="Determine exchange type" (12 ms), stage="Preloading notification" (0 ms), stage="After states restored callback" (0 ms), stage="WAL history reservation" (10 ms), stage="Finalize update counters" (1 ms), stage="Detect lost partitions" (15 ms), stage="Exchange done" (3 ms), stage="Total time" (42 ms)] [21:01:47] : [Step 4/5] [2021-11-19 21:01:47,463][INFO ][exchange-worker-#907%failure.IoomFailureHandlerTest0%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], stage="Affinity initialization (exchange-free switch on fully-rebalanced topology) [grp=default]" (11 ms) (parent=Determine exchange type), stage="Affinity initialization (exchange-free switch on fully-rebalanced topology) [grp=ignite-sys-cache]" (0 ms) (parent=Determine exchange type)] [21:01:47] : [Step 4/5] [2021-11-19 21:01:47,464][INFO ][exchange-worker-#907%failure.IoomFailureHandlerTest0%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], crd=true] [21:01:47] : [Step 4/5] [2021-11-19 21:01:47,467][INFO ][exchange-worker-#907%failure.IoomFailureHandlerTest0%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=3, minorTopVer=0], force=false, evt=NODE_LEFT, node=fe65148c-4d17-4fff-9236-05b24cf00001] [21:01:51] : [Step 4/5] [2021-11-19 21:01:51,611][INFO ][test-runner-#789%failure.IoomFailureHandlerTest%][FilePageStoreManager] Cleanup cache stores [total=4, left=0, cleanFiles=false] [21:01:51] : [Step 4/5] [2021-11-19 21:01:51,614][INFO ][test-runner-#789%failure.IoomFailureHandlerTest%][GridDeploymentLocalStore] Removed undeployed class: GridDeployment [ts=1637344894542, depMode=SHARED, clsLdr=IsolatedClassLoader{roleName='test'}, clsLdrId=aa25c593d71-fe65148c-4d17-4fff-9236-05b24cf00001, userVer=0, loc=true, sampleClsName=org.apache.ignite.internal.processors.cache.distributed.dht.preloader.IgniteDhtPartitionHistorySuppliersMap, pendingUndeploy=false, undeployed=true, usage=0] [21:01:51] : [Step 4/5] [2021-11-19 21:01:51,632][INFO ][test-runner-#789%failure.IoomFailureHandlerTest%][IoomFailureHandlerTest1] [21:01:51] : [Step 4/5] [21:01:51] : [Step 4/5] >>> +------------------------------------------------------+ [21:01:51] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV stopped OK [21:01:51] : [Step 4/5] >>> +------------------------------------------------------+ [21:01:51] : [Step 4/5] >>> Ignite instance name: failure.IoomFailureHandlerTest1 [21:01:51] : [Step 4/5] >>> Grid uptime: 00:00:17.400 [21:01:51] : [Step 4/5] [21:01:51] : [Step 4/5] [21:01:51] : [Step 4/5] [2021-11-19 21:01:51,633][INFO ][test-runner-#789%failure.IoomFailureHandlerTest%][root] >>> Stopping grid [name=failure.IoomFailureHandlerTest0, id=9d5c1368-d764-4b5a-a895-4879ea800000] [21:01:51] : [Step 4/5] [2021-11-19 21:01:51,648][INFO ][db-checkpoint-thread-#1047%failure.IoomFailureHandlerTest0%][Checkpointer] Skipping checkpoint (no pages were modified) [checkpointBeforeLockTime=2ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=1ms, checkpointLockHoldTime=5ms, reason='timeout'] [21:01:51] : [Step 4/5] [2021-11-19 21:01:51,656][INFO ][db-checkpoint-thread-#1047%failure.IoomFailureHandlerTest0%][Checkpointer] Skipping checkpoint (no pages were modified) [checkpointBeforeLockTime=2ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=2ms, checkpointLockHoldTime=3ms, reason='timeout'] [21:01:51] : [Step 4/5] [2021-11-19 21:01:51,677][INFO ][tcp-disco-sock-reader-[fe65148c 127.0.0.1:51557]-#55%failure.IoomFailureHandlerTest0%-#1028%failure.IoomFailureHandlerTest0%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:51557, rmtPort=51557, rmtNodeId=fe65148c-4d17-4fff-9236-05b24cf00001] [21:01:51] : [Step 4/5] [2021-11-19 21:01:51,682][INFO ][test-runner-#789%failure.IoomFailureHandlerTest%][GridCacheProcessor] Stopped cache [cacheName=default] [21:01:51] : [Step 4/5] [2021-11-19 21:01:51,683][INFO ][test-runner-#789%failure.IoomFailureHandlerTest%][GridCacheProcessor] Stopped cache [cacheName=ignite-sys-cache] [21:01:51] : [Step 4/5] [2021-11-19 21:01:51,691][INFO ][test-runner-#789%failure.IoomFailureHandlerTest%][FilePageStoreManager] Cleanup cache stores [total=4, left=0, cleanFiles=false] [21:01:51] : [Step 4/5] [2021-11-19 21:01:51,693][INFO ][test-runner-#789%failure.IoomFailureHandlerTest%][GridDeploymentLocalStore] Removed undeployed class: GridDeployment [ts=1637344894488, depMode=SHARED, clsLdr=IsolatedClassLoader{roleName='test'}, clsLdrId=8a25c593d71-9d5c1368-d764-4b5a-a895-4879ea800000, userVer=0, loc=true, sampleClsName=org.apache.ignite.internal.processors.cache.distributed.dht.preloader.GridDhtPartitionMap, pendingUndeploy=false, undeployed=true, usage=0] [21:01:51] : [Step 4/5] [2021-11-19 21:01:51,772][INFO ][test-runner-#789%failure.IoomFailureHandlerTest%][IoomFailureHandlerTest0] [21:01:51] : [Step 4/5] [21:01:51] : [Step 4/5] >>> +------------------------------------------------------+ [21:01:51] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV stopped OK [21:01:51] : [Step 4/5] >>> +------------------------------------------------------+ [21:01:51] : [Step 4/5] >>> Ignite instance name: failure.IoomFailureHandlerTest0 [21:01:51] : [Step 4/5] >>> Grid uptime: 00:00:19.884 [21:01:51] : [Step 4/5] [21:01:51] : [Step 4/5] [21:01:51] : [Step 4/5] [21:01:51] >>> Stopping test: IoomFailureHandlerTest#testIoomErrorPdsHandling in 21156 ms <<< [21:01:51] : [Step 4/5] [2021-11-19 21:01:51,780][INFO ][main][root] >>> Stopping test: IoomFailureHandlerTest#testIoomErrorPdsHandling in 21156 ms <<< [21:01:51] : [Step 4/5] [21:01:51] >>> Heap: 635 MB used / 1960 MB commited / 1960 MB max <<< [21:01:51] : [Step 4/5] [2021-11-19 21:01:51,781][INFO ][main][root] >>> Heap: 635 MB used / 1960 MB commited / 1960 MB max <<< [21:01:51] : [Step 4/5] [21:01:51] >>> Non-Heap: 107 MB used / 114 MB commited / 0 MB max <<< [21:01:51] : [Step 4/5] [2021-11-19 21:01:51,782][INFO ][main][root] >>> Non-Heap: 107 MB used / 114 MB commited / 0 MB max <<< [21:01:52] : [Step 4/5] [21:01:52] >>> Stopping test class: IoomFailureHandlerTest <<< [21:01:52] : [Step 4/5] [2021-11-19 21:01:52,173][INFO ][main][root] >>> Stopping test class: IoomFailureHandlerTest <<< [21:01:52] : [Step 4/5] [21:01:52] >>> Starting test class: ClusterBaselineNodesMetricsSelfTest <<< [21:01:52] : [Step 4/5] [2021-11-19 21:01:52,178][INFO ][main][root] >>> Starting test class: ClusterBaselineNodesMetricsSelfTest <<< [21:01:52] : [Step 4/5] Running org.apache.ignite.internal.ClusterBaselineNodesMetricsSelfTest [21:01:52]i: [Step 4/5] ##teamcity[importData type='surefire' path='/opt/buildagent/temp/buildTmp/ignite-tools-junit-reports1777670380320881607/test-org.apache.ignite.testsuites.IgniteBasicWithPersistenceTestSuite1637344840551.xml'] [21:01:52] : [Step 4/5] Importing data from '/opt/buildagent/temp/buildTmp/ignite-tools-junit-reports1777670380320881607/test-org.apache.ignite.testsuites.IgniteBasicWithPersistenceTestSuite1637344840551.xml' (639 B) with 'surefire' processor [21:01:52] : [Step 4/5] [21:01:52] >>> Starting test: ClusterBaselineNodesMetricsSelfTest#testBaselineNodes <<< [21:01:52] : [Step 4/5] [2021-11-19 21:01:52,221][INFO ][main][root] >>> Starting test: ClusterBaselineNodesMetricsSelfTest#testBaselineNodes <<< [21:01:52] : [Step 4/5] [21:01:52] >>> Heap: 639 MB used / 1960 MB commited / 1960 MB max <<< [21:01:52] : [Step 4/5] [2021-11-19 21:01:52,222][INFO ][main][root] >>> Heap: 639 MB used / 1960 MB commited / 1960 MB max <<< [21:01:52] : [Step 4/5] [21:01:52] >>> Non-Heap: 107 MB used / 114 MB commited / 0 MB max <<< [21:01:52] : [Step 4/5] [2021-11-19 21:01:52,223][INFO ][main][root] >>> Non-Heap: 107 MB used / 114 MB commited / 0 MB max <<< [21:01:52]W: [org.apache.ignite:ignite-core] [2021-11-19 21:01:52,245][WARN ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][G] Ignite work directory is not provided, automatically resolved to: /opt/buildagent/work/7bc1c54bc719b67c/work [21:01:52] : [Step 4/5] [2021-11-19 21:01:52,254][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][ClusterBaselineNodesMetricsSelfTest0] [21:01:52] : [Step 4/5] [21:01:52] : [Step 4/5] >>> __________ ________________ [21:01:52] : [Step 4/5] >>> / _/ ___/ |/ / _/_ __/ __/ [21:01:52] : [Step 4/5] >>> _/ // (7 7 // / / / / _/ [21:01:52] : [Step 4/5] >>> /___/\___/_/|_/___/ /_/ /___/ [21:01:52] : [Step 4/5] >>> [21:01:52] : [Step 4/5] >>> ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:01:52] : [Step 4/5] >>> 2021 Copyright(C) Apache Software Foundation [21:01:52] : [Step 4/5] >>> [21:01:52] : [Step 4/5] >>> Ignite documentation: http://ignite.apache.org [21:01:52] : [Step 4/5] [21:01:52] : [Step 4/5] [2021-11-19 21:01:52,263][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][ClusterBaselineNodesMetricsSelfTest0] Config URL: n/a [21:01:52] : [Step 4/5] [2021-11-19 21:01:52,264][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][ClusterBaselineNodesMetricsSelfTest0] IgniteConfiguration [igniteInstanceName=internal.ClusterBaselineNodesMetricsSelfTest0, pubPoolSize=24, svcPoolSize=24, callbackPoolSize=24, stripedPoolSize=24, sysPoolSize=24, mgmtPoolSize=4, dataStreamerPoolSize=24, utilityCachePoolSize=24, utilityCacheKeepAliveTime=60000, p2pPoolSize=2, qryPoolSize=24, buildIdxPoolSize=4, igniteHome=/opt/buildagent/work/7bc1c54bc719b67c, igniteWorkDir=/opt/buildagent/work/7bc1c54bc719b67c/work, mbeanSrv=com.sun.jmx.mbeanserver.JmxMBeanServer@6fe85038, nodeId=4f8845b3-7744-4ec1-9404-43c3d1f00000, marsh=BinaryMarshaller [], marshLocJobs=false, daemon=false, p2pEnabled=true, netTimeout=10000, netCompressionLevel=1, sndRetryDelay=1000, sndRetryCnt=3, metricsHistSize=10000, metricsUpdateFreq=1000, metricsExpTime=9223372036854775807, discoSpi=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=0, ackTimeout=0, marsh=null, reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], segPlc=STOP, segResolveAttempts=2, waitForSegOnStart=true, allResolversPassReq=true, segChkFreq=10000, commSpi=TcpCommunicationSpi [connectGate=org.apache.ignite.spi.communication.tcp.internal.ConnectGateway@69376244, ctxInitLatch=java.util.concurrent.CountDownLatch@605aecc3[Count = 1], stopping=false, clientPool=null, nioSrvWrapper=null, stateProvider=null], evtSpi=MemoryEventStorageSpi [expireAgeMs=9223372036854775807, expireCnt=10000, filter=null], colSpi=NoopCollisionSpi [], deploySpi=LocalDeploymentSpi [], indexingSpi=org.apache.ignite.spi.indexing.noop.NoopIndexingSpi@7b0c3b20, addrRslvr=null, encryptionSpi=org.apache.ignite.spi.encryption.noop.NoopEncryptionSpi@72f82e56, tracingSpi=org.apache.ignite.spi.tracing.NoopTracingSpi@68e0c430, clientMode=false, rebalanceThreadPoolSize=4, rebalanceTimeout=10000, rebalanceBatchesPrefetchCnt=3, rebalanceThrottle=0, rebalanceBatchSize=524288, txCfg=TransactionConfiguration [txSerEnabled=false, dfltIsolation=REPEATABLE_READ, dfltConcurrency=PESSIMISTIC, dfltTxTimeout=0, txTimeoutOnPartitionMapExchange=0, deadlockTimeout=10000, pessimisticTxLogSize=0, pessimisticTxLogLinger=10000, tmLookupClsName=null, txManagerFactory=null, useJtaSync=false], cacheSanityCheckEnabled=true, discoStartupDelay=60000, deployMode=SHARED, p2pMissedCacheSize=100, locHost=127.0.0.1, timeSrvPortBase=31100, timeSrvPortRange=100, failureDetectionTimeout=10000, sysWorkerBlockedTimeout=null, clientFailureDetectionTimeout=10000, metricsLogFreq=0, connectorCfg=null, odbcCfg=null, warmupClos=null, atomicCfg=AtomicConfiguration [seqReserveSize=1000, cacheMode=PARTITIONED, backups=1, aff=null, grpName=null], classLdr=null, sslCtxFactory=null, platformCfg=null, binaryCfg=null, memCfg=null, pstCfg=null, dsCfg=DataStorageConfiguration [sysRegionInitSize=41943040, sysRegionMaxSize=104857600, pageSize=0, concLvl=0, dfltDataRegConf=DataRegionConfiguration [name=default, maxSize=2147483648, initSize=268435456, swapPath=null, pageEvictionMode=DISABLED, pageReplacementMode=CLOCK, evictionThreshold=0.9, emptyPagesPoolSize=100, metricsEnabled=false, metricsSubIntervalCount=5, metricsRateTimeInterval=60000, persistenceEnabled=true, checkpointPageBufSize=0, lazyMemoryAllocation=true, warmUpCfg=null], dataRegions=null, storagePath=clusterbaselinenodesmetricsselftest/testBaselineNodes, checkpointFreq=180000, lockWaitTime=10000, checkpointThreads=4, checkpointWriteOrder=SEQUENTIAL, walHistSize=20, maxWalArchiveSize=1073741824, walSegments=10, walSegmentSize=67108864, walPath=clusterbaselinenodesmetricsselftest/testBaselineNodes/wal, walArchivePath=clusterbaselinenodesmetricsselftest/testBaselineNodes/archive, cdcWalPath=db/wal/cdc, cdcEnabled=false, metricsEnabled=false, walMode=LOG_ONLY, walTlbSize=131072, walBuffSize=0, walFlushFreq=2000, walFsyncDelay=1000, walRecordIterBuffSize=67108864, alwaysWriteFullPages=false, fileIOFactory=org.apache.ignite.internal.processors.cache.persistence.file.AsyncFileIOFactory@29d7c54a, metricsSubIntervalCnt=5, metricsRateTimeInterval=60000, walAutoArchiveAfterInactivity=-1, walForceArchiveTimeout=-1, writeThrottlingEnabled=false, walCompactionEnabled=false, walCompactionLevel=1, checkpointReadLockTimeout=null, walPageCompression=DISABLED, walPageCompressionLevel=null, dfltWarmUpCfg=null, encCfg=org.apache.ignite.configuration.EncryptionConfiguration@48071ae, defragmentationThreadPoolSize=4, minWalArchiveSize=-1], snapshotPath=snapshots, activeOnStart=true, activeOnStartPropSetFlag=false, autoActivation=true, autoActivationPropSetFlag=false, clusterStateOnStart=null, sqlConnCfg=null, cliConnCfg=ClientConnectorConfiguration [host=null, port=10800, portRange=100, sockSndBufSize=0, sockRcvBufSize=0, tcpNoDelay=true, maxOpenCursorsPerConn=128, threadPoolSize=24, selectorCnt=12, idleTimeout=0, handshakeTimeout=10000, jdbcEnabled=true, odbcEnabled=true, thinCliEnabled=true, sslEnabled=false, useIgniteSslCtxFactory=true, sslClientAuth=false, sslCtxFactory=null, thinCliCfg=ThinClientConfiguration [maxActiveTxPerConn=100, maxActiveComputeTasksPerConn=0]], mvccVacuumThreadCnt=2, mvccVacuumFreq=5000, authEnabled=false, failureHnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]], commFailureRslvr=null, sqlCfg=SqlConfiguration [longQryWarnTimeout=3000, dfltQryTimeout=0, sqlQryHistSize=1000, validationEnabled=false], asyncContinuationExecutor=null] [21:01:52] : [Step 4/5] [2021-11-19 21:01:52,279][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][ClusterBaselineNodesMetricsSelfTest0] Daemon mode: off [21:01:52] : [Step 4/5] [2021-11-19 21:01:52,279][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][ClusterBaselineNodesMetricsSelfTest0] OS: Linux 4.15.0-151-generic amd64 [21:01:52] : [Step 4/5] [2021-11-19 21:01:52,280][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][ClusterBaselineNodesMetricsSelfTest0] OS user: teamcity [21:01:52] : [Step 4/5] [2021-11-19 21:01:52,285][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][ClusterBaselineNodesMetricsSelfTest0] PID: 16724 [21:01:52] : [Step 4/5] [2021-11-19 21:01:52,285][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][ClusterBaselineNodesMetricsSelfTest0] Language runtime: Java Platform API Specification ver. 1.8 [21:01:52] : [Step 4/5] [2021-11-19 21:01:52,285][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][ClusterBaselineNodesMetricsSelfTest0] VM information: Java(TM) SE Runtime Environment 1.8.0_261-b12 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 25.261-b12 [21:01:52] : [Step 4/5] [2021-11-19 21:01:52,286][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][ClusterBaselineNodesMetricsSelfTest0] VM total memory: 1.9GB [21:01:52] : [Step 4/5] [2021-11-19 21:01:52,286][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][ClusterBaselineNodesMetricsSelfTest0] Remote Management [restart: off, REST: off, JMX (remote: off)] [21:01:52] : [Step 4/5] [2021-11-19 21:01:52,287][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][ClusterBaselineNodesMetricsSelfTest0] Logger: GridTestLog4jLogger [quiet=false, config=null] [21:01:52] : [Step 4/5] [2021-11-19 21:01:52,287][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][ClusterBaselineNodesMetricsSelfTest0] IGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c [21:01:52] : [Step 4/5] [2021-11-19 21:01:52,288][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][ClusterBaselineNodesMetricsSelfTest0] VM arguments: [-DIGNITE_DUMP_THREADS_ON_FAILURE=false, -DMono=/usr/bin/mono-sgen, -DMono4.0_x64=/usr/lib/mono/4.0, -DMono4.5_x64=/usr/lib/mono/4.5, -DMonoVersion=6.12.0.90, -DSKIP_BUILD=false, -Dagent.home.dir=/opt/buildagent, -Dagent.name=aitc-lin02_03, -Dagent.ownPort=9090, -Dagent.work.dir=/opt/buildagent/work, -Dbuild.number=95, -Dbuild.vcs.number=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.1=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.GitHubApacheIgnite=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dclassworlds.conf=/opt/buildagent/temp/buildTmp/teamcity.m2.conf, -Dcom.jetbrains.maven.watcher.report.file=/opt/buildagent/temp/buildTmp/maven-build-info.xml, -Djava.io.tmpdir=/opt/buildagent/temp/buildTmp, -Dmaven.home=/opt/buildagent/tools/maven3_6, -Dmaven.multiModuleProjectDirectory=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.agent.cpuBenchmark=457, -Dteamcity.agent.dotnet.agent_url=http://localhost:9090/RPC2, -Dteamcity.agent.dotnet.build_id=6278078, -Dteamcity.auth.password=*******, -Dteamcity.auth.userId=TeamCityBuildId=6278078, -Dteamcity.build.changedFiles.file=/opt/buildagent/temp/buildTmp/changedFiles6342607772318147725.txt, -Dteamcity.build.checkoutDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.build.id=6278078, -Dteamcity.build.properties.file=/opt/buildagent/temp/buildTmp/teamcity.build5164517880467851002.properties, -Dteamcity.build.tempDir=/opt/buildagent/temp/buildTmp, -Dteamcity.build.workingDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.buildConfName=Basic 3, -Dteamcity.buildType.id=IgniteTests24Java8_Basic3, -Dteamcity.configuration.properties.file=/opt/buildagent/temp/buildTmp/teamcity.config5591980786735343870.properties, -Dteamcity.maven.userSettings.path=/opt/buildagent/temp/buildTmp/maven_settings_585072866407032347.xml, -Dteamcity.maven.watcher.home=/opt/buildagent/plugins/mavenPlugin/maven-watcher-jdk16, -Dteamcity.projectName=Ignite Tests 2.x (JDK 8/11), -Dteamcity.runner.properties.file=/opt/buildagent/temp/buildTmp/teamcity.runner9098465561618137420.properties, -Dteamcity.tests.recentlyFailedTests.file=/opt/buildagent/temp/buildTmp/testsToRunFirst3891775683130404069.txt, -Dteamcity.version=2021.2 (build 99542), -ea, -Xms2g, -Xmx2g, -XX:+HeapDumpOnOutOfMemoryError, -DIGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_TEST_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_UPDATE_NOTIFIER=false, -DIGNITE_NO_DISCO_ORDER=true, -DIGNITE_PERFORMANCE_SUGGESTIONS_DISABLED=true, -Djava.net.preferIPv4Stack=true, -DTEST_SCALE_FACTOR=1.0, -DIGNITE_TEST_PROP_LOG4J_FILE=log4j-tc-test.xml, -DIGNITE_QUIET=false, -DIGNITE_MARSHAL_BUFFERS_RECHECK=1000, -Dmaven.repo.local=/opt/buildagent/.m2/repository] [21:01:52] : [Step 4/5] [2021-11-19 21:01:52,292][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][ClusterBaselineNodesMetricsSelfTest0] System cache's DataRegion size is configured to 40 MB. Use DataStorageConfiguration.systemRegionInitialSize property to change the setting. [21:01:52] : [Step 4/5] [2021-11-19 21:01:52,293][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][ClusterBaselineNodesMetricsSelfTest0] Configured caches [in 'sysMemPlc' dataRegion: ['ignite-sys-cache']] [21:01:52]W: [org.apache.ignite:ignite-core] [2021-11-19 21:01:52,293][WARN ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][ClusterBaselineNodesMetricsSelfTest0] Peer class loading is enabled (disable it in production for performance and deployment consistency reasons) [21:01:52] : [Step 4/5] [2021-11-19 21:01:52,294][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][ClusterBaselineNodesMetricsSelfTest0] 3-rd party licenses can be found at: /opt/buildagent/work/7bc1c54bc719b67c/libs/licenses [21:01:52] : [Step 4/5] [2021-11-19 21:01:52,303][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][IgnitePluginProcessor] Configured plugins: [21:01:52] : [Step 4/5] [2021-11-19 21:01:52,303][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][IgnitePluginProcessor] ^-- StanByClusterTestProvider 1.0 [21:01:52] : [Step 4/5] [2021-11-19 21:01:52,303][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][IgnitePluginProcessor] ^-- null [21:01:52] : [Step 4/5] [2021-11-19 21:01:52,304][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][IgnitePluginProcessor] [21:01:52] : [Step 4/5] [2021-11-19 21:01:52,304][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][IgnitePluginProcessor] ^-- PageMemory tracker plugin 1.0 [21:01:52] : [Step 4/5] [2021-11-19 21:01:52,304][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][IgnitePluginProcessor] ^-- null [21:01:52] : [Step 4/5] [2021-11-19 21:01:52,304][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][IgnitePluginProcessor] [21:01:52] : [Step 4/5] [2021-11-19 21:01:52,305][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][IgnitePluginProcessor] ^-- TestDistibutedConfigurationPlugin 1.0 [21:01:52] : [Step 4/5] [2021-11-19 21:01:52,305][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][IgnitePluginProcessor] ^-- null [21:01:52] : [Step 4/5] [2021-11-19 21:01:52,305][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][IgnitePluginProcessor] [21:01:52] : [Step 4/5] [2021-11-19 21:01:52,305][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][IgnitePluginProcessor] ^-- NodeValidationPluginProvider 1.0 [21:01:52] : [Step 4/5] [2021-11-19 21:01:52,305][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][IgnitePluginProcessor] ^-- null [21:01:52] : [Step 4/5] [2021-11-19 21:01:52,306][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][IgnitePluginProcessor] [21:01:52] : [Step 4/5] [2021-11-19 21:01:52,306][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][FailureProcessor] Configured failure handler: [hnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]]] [21:01:52]W: [org.apache.ignite:ignite-core] [2021-11-19 21:01:52,391][WARN ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][TcpCommunicationSpi] Message queue limit is set to 0 which may lead to potential OOMEs when running cache operations in FULL_ASYNC or PRIMARY_SYNC modes due to message queues growth on sender and receiver sides. [21:01:52] : [Step 4/5] [2021-11-19 21:01:52,391][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][TcpCommunicationSpi] Successfully bound communication NIO server to TCP port [port=45020, locHost=/127.0.0.1, selectorsCnt=12, selectorSpins=0, pairedConn=false] [21:01:52] : [Step 4/5] [2021-11-19 21:01:52,430][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][GridCollisionManager] Collision resolution is disabled (all jobs will be activated upon arrival). [21:01:52] : [Step 4/5] [2021-11-19 21:01:52,430][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][ClusterBaselineNodesMetricsSelfTest0] Security status [authentication=off, sandbox=off, tls/ssl=off] [21:01:52] : [Step 4/5] [2021-11-19 21:01:52,434][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][MaintenanceProcessor] Resolved store directory for node persistent data: /opt/buildagent/work/7bc1c54bc719b67c/work/clusterbaselinenodesmetricsselftest/testBaselineNodes/internal_ClusterBaselineNodesMetricsSelfTest0 [21:01:52] : [Step 4/5] [2021-11-19 21:01:52,436][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][CacheObjectBinaryProcessorImpl] Resolved directory for serialized binary metadata: /opt/buildagent/work/7bc1c54bc719b67c/work/db/binary_meta/internal_ClusterBaselineNodesMetricsSelfTest0 [21:01:52] : [Step 4/5] [2021-11-19 21:01:52,449][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/clusterbaselinenodesmetricsselftest/testBaselineNodes/internal_ClusterBaselineNodesMetricsSelfTest0 [21:01:52] : [Step 4/5] [2021-11-19 21:01:52,450][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][FileWriteAheadLogManager] Resolved write ahead log work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/clusterbaselinenodesmetricsselftest/testBaselineNodes/wal/internal_ClusterBaselineNodesMetricsSelfTest0 [21:01:52] : [Step 4/5] [2021-11-19 21:01:52,450][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][FileWriteAheadLogManager] Resolved write ahead log archive directory: /opt/buildagent/work/7bc1c54bc719b67c/work/clusterbaselinenodesmetricsselftest/testBaselineNodes/archive/internal_ClusterBaselineNodesMetricsSelfTest0 [21:01:52] : [Step 4/5] Surefire report watcher [21:01:52] : [Surefire report watcher] Watching paths: [21:01:52] : [Surefire report watcher] /opt/buildagent/temp/buildTmp/ignite-tools-junit-reports1777670380320881607/test-org.apache.ignite.testsuites.IgniteBasicWithPersistenceTestSuite1637344840551.xml [21:01:52]i: [Step 4/5] org.apache.ignite.testsuites.IgniteBasicWithPersistenceTestSuite [21:01:52]i: [org.apache.ignite.testsuites.IgniteBasicWithPersistenceTestSuite] org.apache.ignite.failure.IoomFailureHandlerTest.testIoomErrorMvccNoStoreHandling [21:01:52]i: [org.apache.ignite.testsuites.IgniteBasicWithPersistenceTestSuite] org.apache.ignite.failure.IoomFailureHandlerTest.testIoomErrorMvccPdsHandling [21:01:52]i: [org.apache.ignite.testsuites.IgniteBasicWithPersistenceTestSuite] org.apache.ignite.failure.IoomFailureHandlerTest.testIoomErrorNoStoreHandling [21:01:52]i: [org.apache.ignite.testsuites.IgniteBasicWithPersistenceTestSuite] org.apache.ignite.failure.IoomFailureHandlerTest.testIoomErrorPdsHandling [21:01:53] : [Step 4/5] [2021-11-19 21:01:53,025][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/clusterbaselinenodesmetricsselftest/testBaselineNodes/wal/internal_ClusterBaselineNodesMetricsSelfTest0/0000000000000000.wal [21:01:53] : [Step 4/5] [2021-11-19 21:01:53,026][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][FileHandleManagerImpl] Initialized write-ahead log manager [mode=LOG_ONLY] [21:01:53] : [Step 4/5] [2021-11-19 21:01:53,037][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][GridCacheDatabaseSharedManager] Configured data regions initialized successfully [total=5] [21:01:53] : [Step 4/5] [2021-11-19 21:01:53,039][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][IgniteSnapshotManager] Resolved snapshot work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/snapshots [21:01:53] : [Step 4/5] [2021-11-19 21:01:53,040][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][IgniteSnapshotManager] Resolved temp directory for snapshot creation: /opt/buildagent/work/7bc1c54bc719b67c/work/clusterbaselinenodesmetricsselftest/testBaselineNodes/internal_ClusterBaselineNodesMetricsSelfTest0/snp [21:01:53] : [Step 4/5] [2021-11-19 21:01:53,045][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][ClientListenerProcessor] Client connector processor has started on TCP port 10800 [21:01:53] : [Step 4/5] [2021-11-19 21:01:53,053][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][ClusterBaselineNodesMetricsSelfTest0] Non-loopback local IPs: 172.17.0.4 [21:01:53] : [Step 4/5] [2021-11-19 21:01:53,053][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][ClusterBaselineNodesMetricsSelfTest0] Enabled local MACs: 0242AC110004 [21:01:53] : [Step 4/5] [2021-11-19 21:01:53,057][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:01:53] : [Step 4/5] [2021-11-19 21:01:53,060][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:01:53] : [Step 4/5] [2021-11-19 21:01:53,060][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:01:53] : [Step 4/5] [2021-11-19 21:01:53,065][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][GridCacheDatabaseSharedManager] Applying lost metastore updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:01:53] : [Step 4/5] [2021-11-19 21:01:53,067][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=0 ms] [21:01:53] : [Step 4/5] [2021-11-19 21:01:53,067][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][GridCacheProcessor] Restoring partition state for local groups. [21:01:53] : [Step 4/5] [2021-11-19 21:01:53,067][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=0, partitionsProcessed=0, time=10ms] [21:01:53] : [Step 4/5] [2021-11-19 21:01:53,068][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][GridEncryptionManager] Encryption keys loaded from metastore. [grps=, masterKeyName=null] [21:01:53] : [Step 4/5] [2021-11-19 21:01:53,074][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][ClusterProcessor] Cluster ID and tag has been read from metastorage: null [21:01:53] : [Step 4/5] [2021-11-19 21:01:53,074][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][IgniteClusterImpl] Shutdown policy was updated [oldVal=null, newVal=null] [21:01:53] : [Step 4/5] [2021-11-19 21:01:53,074][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][GridCacheDatabaseSharedManager] Checkpoint frequency deviation changed [oldVal=null, newVal=null] [21:01:53] : [Step 4/5] [2021-11-19 21:01:53,084][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][FilePageStoreManager] Cleanup cache stores [total=1, left=0, cleanFiles=false] [21:01:53] : [Step 4/5] [2021-11-19 21:01:53,089][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:01:53] : [Step 4/5] [2021-11-19 21:01:53,091][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:01:53] : [Step 4/5] [2021-11-19 21:01:53,094][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:01:53] : [Step 4/5] [2021-11-19 21:01:53,095][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][GridCacheDatabaseSharedManager] Data Regions Started: 5 [21:01:53] : [Step 4/5] [2021-11-19 21:01:53,095][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][GridCacheDatabaseSharedManager] ^-- sysMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:01:53] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:01:53] : [Step 4/5] ^-- default region [type=default, persistence=true, lazyAlloc=true, [21:01:53] : [Step 4/5] ... initCfg=256MB, maxCfg=2048MB, usedRam=0MB, freeRam=100%, allocRam=0MB, allocTotal=0MB] [21:01:53] : [Step 4/5] ^-- metastoreMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:01:53] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:01:53] : [Step 4/5] ^-- TxLog region [type=internal, persistence=true, lazyAlloc=false, [21:01:53] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:01:53] : [Step 4/5] ^-- volatileDsMemPlc region [type=user, persistence=false, lazyAlloc=true, [21:01:53] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB] [21:01:53] : [Step 4/5] ^-- Ignite persistence [used=0MB] [21:01:53] : [Step 4/5] [21:01:53] : [Step 4/5] [2021-11-19 21:01:53,097][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][GridCacheDatabaseSharedManager] Starting binary memory restore for: [-2100569601] [21:01:53] : [Step 4/5] [2021-11-19 21:01:53,112][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:01:53] : [Step 4/5] [2021-11-19 21:01:53,112][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:01:53] : [Step 4/5] [2021-11-19 21:01:53,119][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/clusterbaselinenodesmetricsselftest/testBaselineNodes/wal/internal_ClusterBaselineNodesMetricsSelfTest0/0000000000000000.wal, offset=0, ver=2] [21:01:53] : [Step 4/5] [2021-11-19 21:01:53,129][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][GridCacheProcessor] Started cache in recovery mode [name=ignite-sys-cache, id=-2100569601, dataRegionName=sysMemPlc, mode=REPLICATED, atomicity=TRANSACTIONAL, backups=2147483647, mvcc=false] [21:01:53] : [Step 4/5] [2021-11-19 21:01:53,130][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][GridCacheDatabaseSharedManager] Binary recovery performed in 33 ms. [21:01:53] : [Step 4/5] [2021-11-19 21:01:53,130][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:01:53] : [Step 4/5] [2021-11-19 21:01:53,131][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][GridCacheDatabaseSharedManager] Applying lost cache updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:01:53] : [Step 4/5] [2021-11-19 21:01:53,244][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=107 ms] [21:01:53] : [Step 4/5] [2021-11-19 21:01:53,244][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][GridCacheProcessor] Restoring partition state for local groups. [21:01:53] : [Step 4/5] [2021-11-19 21:01:53,313][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=1, partitionsProcessed=100, time=72ms] [21:01:53] : [Step 4/5] [2021-11-19 21:01:53,665][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][TestTcpDiscoverySpi] Successfully bound to TCP port [port=47500, localHost=localhost/127.0.0.1, locNodeId=4f8845b3-7744-4ec1-9404-43c3d1f00000] [21:01:53] : [Step 4/5] [2021-11-19 21:01:53,682][INFO ][disco-notifier-worker-#1232%internal.ClusterBaselineNodesMetricsSelfTest0%][MvccProcessorImpl] Assigned mvcc coordinator [crd=MvccCoordinator [topVer=AffinityTopologyVersion [topVer=1, minorTopVer=0], nodeId=4f8845b3-7744-4ec1-9404-43c3d1f00000, ver=1637344913679, local=true, initialized=false]] [21:01:53] : [Step 4/5] [2021-11-19 21:01:53,683][INFO ][sys-#1213%internal.ClusterBaselineNodesMetricsSelfTest0%][ClusterProcessor] Writing cluster ID and tag to metastorage on ready for write ClusterIdAndTag [id=aeea33f2-f76a-4ae8-9c30-3b901d5f028f, tag=affectionate_sanderson] [21:01:53] : [Step 4/5] [2021-11-19 21:01:53,703][INFO ][disco-notifier-worker-#1232%internal.ClusterBaselineNodesMetricsSelfTest0%][ClusterProcessor] affectionate_sanderson [21:01:53] : [Step 4/5] [2021-11-19 21:01:53,705][INFO ][disco-notifier-worker-#1232%internal.ClusterBaselineNodesMetricsSelfTest0%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustEnabled' was changed from 'null' to 'false' [21:01:53] : [Step 4/5] [2021-11-19 21:01:53,707][INFO ][disco-notifier-worker-#1232%internal.ClusterBaselineNodesMetricsSelfTest0%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustTimeout' was changed from 'null' to '300000' [21:01:53] : [Step 4/5] [2021-11-19 21:01:53,708][INFO ][disco-notifier-worker-#1232%internal.ClusterBaselineNodesMetricsSelfTest0%][IgniteTxManager] Transactions parameter 'longOperationsDumpTimeout' was changed from 'null' to '60000' [21:01:53] : [Step 4/5] [2021-11-19 21:01:53,709][INFO ][disco-notifier-worker-#1232%internal.ClusterBaselineNodesMetricsSelfTest0%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpThreshold' was changed from 'null' to '0' [21:01:53] : [Step 4/5] [2021-11-19 21:01:53,712][INFO ][disco-notifier-worker-#1232%internal.ClusterBaselineNodesMetricsSelfTest0%][IgniteTxManager] Transactions parameter 'transactionTimeDumpSamplesCoefficient' was changed from 'null' to '0.0' [21:01:53] : [Step 4/5] [2021-11-19 21:01:53,728][INFO ][disco-notifier-worker-#1232%internal.ClusterBaselineNodesMetricsSelfTest0%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpSamplesPerSecondLimit' was changed from 'null' to '5' [21:01:53] : [Step 4/5] [2021-11-19 21:01:53,753][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][ClusterBaselineNodesMetricsSelfTest0] To start Console Management & Monitoring run ignitevisorcmd.{sh|bat} [21:01:53] : [Step 4/5] [2021-11-19 21:01:53,754][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][ClusterBaselineNodesMetricsSelfTest0] [21:01:53] : [Step 4/5] [21:01:53] : [Step 4/5] >>> +-------------------------------------------+ [21:01:53] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:01:53] : [Step 4/5] >>> +-------------------------------------------+ [21:01:53] : [Step 4/5] >>> OS name: Linux 4.15.0-151-generic amd64 [21:01:53] : [Step 4/5] >>> CPU(s): 24 [21:01:53] : [Step 4/5] >>> Heap: 2.0GB [21:01:53] : [Step 4/5] >>> VM name: 16724@c4dfe9a430b2 [21:01:53] : [Step 4/5] >>> Ignite instance name: internal.ClusterBaselineNodesMetricsSelfTest0 [21:01:53] : [Step 4/5] >>> Local node [ID=4F8845B3-7744-4EC1-9404-43C3D1F00000, order=1, clientMode=false] [21:01:53] : [Step 4/5] >>> Local node addresses: [127.0.0.1] [21:01:53] : [Step 4/5] >>> Local ports: TCP:10800 TCP:45020 TCP:47500 [21:01:53] : [Step 4/5] [21:01:53] : [Step 4/5] [2021-11-19 21:01:53,756][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][ClusterBaselineNodesMetricsSelfTest0] >>> Ignite cluster is in INACTIVE state (limited functionality available). Use control.(sh|bat) script or IgniteCluster.state(ClusterState.ACTIVE) to change the state. [21:01:53] : [Step 4/5] [2021-11-19 21:01:53,754][INFO ][disco-notifier-worker-#1232%internal.ClusterBaselineNodesMetricsSelfTest0%][IgniteTxManager] Transactions parameter 'collisionsDumpInterval' was changed from 'null' to '1000' [21:01:53] : [Step 4/5] [2021-11-19 21:01:53,758][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][GridDiscoveryManager] Topology snapshot [ver=1, locNode=4f8845b3, servers=1, clients=0, state=INACTIVE, CPUs=24, offheap=2.0GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=4f8845b3-7744-4ec1-9404-43c3d1f00000, consistentId=internal.ClusterBaselineNodesMetricsSelfTest0, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:01:53] : [Step 4/5] [2021-11-19 21:01:53,758][INFO ][disco-notifier-worker-#1232%internal.ClusterBaselineNodesMetricsSelfTest0%][IgniteTxManager] Transactions parameter 'txOwnerDumpRequestsAllowed' was changed from 'null' to 'true' [21:01:53] : [Step 4/5] [2021-11-19 21:01:53,759][INFO ][disco-notifier-worker-#1232%internal.ClusterBaselineNodesMetricsSelfTest0%][GridCacheDatabaseSharedManager] Historical rebalance WAL threshold changed [property=historical.rebalance.threshold, oldVal=null, newVal=500] [21:01:53] : [Step 4/5] [2021-11-19 21:01:53,758][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][G] Node started : [stage="Configure system pool" (1 ms),stage="Start managers" (186 ms),stage="Configure binary metadata" (7 ms),stage="Start processors" (609 ms),stage="Start 'StanByClusterTestProvider' plugin" (0 ms),stage="Start 'PageMemory tracker plugin' plugin" (0 ms),stage="Start 'TestDistibutedConfigurationPlugin' plugin" (0 ms),stage="Start 'NodeValidationPluginProvider' plugin" (0 ms),stage="Init metastore" (32 ms),stage="Init and start regions" (12 ms),stage="Restore binary memory" (33 ms),stage="Restore logical state" (182 ms),stage="Finish recovery" (349 ms),stage="Join topology" (24 ms),stage="Await transition" (8 ms),stage="Await exchange" (62 ms),stage="Total time" (1505 ms)] [21:01:53] : [Step 4/5] [2021-11-19 21:01:53,767][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][root] Node started with the following configuration [id=4f8845b3-7744-4ec1-9404-43c3d1f00000, marshaller=BinaryMarshaller [], discovery=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=5000, ackTimeout=5000, marsh=JdkMarshaller [clsFilter=org.apache.ignite.marshaller.MarshallerUtils$1@2e375a64], reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], binaryCfg=null, lateAff=true] [21:01:53]W: [org.apache.ignite:ignite-core] [2021-11-19 21:01:53,776][WARN ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][G] Ignite work directory is not provided, automatically resolved to: /opt/buildagent/work/7bc1c54bc719b67c/work [21:01:53] : [Step 4/5] [2021-11-19 21:01:53,784][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][ClusterBaselineNodesMetricsSelfTest1] [21:01:53] : [Step 4/5] [21:01:53] : [Step 4/5] >>> __________ ________________ [21:01:53] : [Step 4/5] >>> / _/ ___/ |/ / _/_ __/ __/ [21:01:53] : [Step 4/5] >>> _/ // (7 7 // / / / / _/ [21:01:53] : [Step 4/5] >>> /___/\___/_/|_/___/ /_/ /___/ [21:01:53] : [Step 4/5] >>> [21:01:53] : [Step 4/5] >>> ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:01:53] : [Step 4/5] >>> 2021 Copyright(C) Apache Software Foundation [21:01:53] : [Step 4/5] >>> [21:01:53] : [Step 4/5] >>> Ignite documentation: http://ignite.apache.org [21:01:53] : [Step 4/5] [21:01:53] : [Step 4/5] [2021-11-19 21:01:53,785][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][ClusterBaselineNodesMetricsSelfTest1] Config URL: n/a [21:01:53] : [Step 4/5] [2021-11-19 21:01:53,786][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][ClusterBaselineNodesMetricsSelfTest1] IgniteConfiguration [igniteInstanceName=internal.ClusterBaselineNodesMetricsSelfTest1, pubPoolSize=24, svcPoolSize=24, callbackPoolSize=24, stripedPoolSize=24, sysPoolSize=24, mgmtPoolSize=4, dataStreamerPoolSize=24, utilityCachePoolSize=24, utilityCacheKeepAliveTime=60000, p2pPoolSize=2, qryPoolSize=24, buildIdxPoolSize=4, igniteHome=/opt/buildagent/work/7bc1c54bc719b67c, igniteWorkDir=/opt/buildagent/work/7bc1c54bc719b67c/work, mbeanSrv=com.sun.jmx.mbeanserver.JmxMBeanServer@6fe85038, nodeId=5ff14d92-b955-4988-af16-a71774900001, marsh=BinaryMarshaller [], marshLocJobs=false, daemon=false, p2pEnabled=true, netTimeout=10000, netCompressionLevel=1, sndRetryDelay=1000, sndRetryCnt=3, metricsHistSize=10000, metricsUpdateFreq=1000, metricsExpTime=9223372036854775807, discoSpi=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=0, ackTimeout=0, marsh=null, reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], segPlc=STOP, segResolveAttempts=2, waitForSegOnStart=true, allResolversPassReq=true, segChkFreq=10000, commSpi=TcpCommunicationSpi [connectGate=org.apache.ignite.spi.communication.tcp.internal.ConnectGateway@77a6ce82, ctxInitLatch=java.util.concurrent.CountDownLatch@481fad9[Count = 1], stopping=false, clientPool=null, nioSrvWrapper=null, stateProvider=null], evtSpi=MemoryEventStorageSpi [expireAgeMs=9223372036854775807, expireCnt=10000, filter=null], colSpi=NoopCollisionSpi [], deploySpi=LocalDeploymentSpi [], indexingSpi=org.apache.ignite.spi.indexing.noop.NoopIndexingSpi@2cf1b500, addrRslvr=null, encryptionSpi=org.apache.ignite.spi.encryption.noop.NoopEncryptionSpi@6c4358e4, tracingSpi=org.apache.ignite.spi.tracing.NoopTracingSpi@7c493395, clientMode=false, rebalanceThreadPoolSize=4, rebalanceTimeout=10000, rebalanceBatchesPrefetchCnt=3, rebalanceThrottle=0, rebalanceBatchSize=524288, txCfg=TransactionConfiguration [txSerEnabled=false, dfltIsolation=REPEATABLE_READ, dfltConcurrency=PESSIMISTIC, dfltTxTimeout=0, txTimeoutOnPartitionMapExchange=0, deadlockTimeout=10000, pessimisticTxLogSize=0, pessimisticTxLogLinger=10000, tmLookupClsName=null, txManagerFactory=null, useJtaSync=false], cacheSanityCheckEnabled=true, discoStartupDelay=60000, deployMode=SHARED, p2pMissedCacheSize=100, locHost=127.0.0.1, timeSrvPortBase=31100, timeSrvPortRange=100, failureDetectionTimeout=10000, sysWorkerBlockedTimeout=null, clientFailureDetectionTimeout=10000, metricsLogFreq=0, connectorCfg=null, odbcCfg=null, warmupClos=null, atomicCfg=AtomicConfiguration [seqReserveSize=1000, cacheMode=PARTITIONED, backups=1, aff=null, grpName=null], classLdr=null, sslCtxFactory=null, platformCfg=null, binaryCfg=null, memCfg=null, pstCfg=null, dsCfg=DataStorageConfiguration [sysRegionInitSize=41943040, sysRegionMaxSize=104857600, pageSize=0, concLvl=0, dfltDataRegConf=DataRegionConfiguration [name=default, maxSize=2147483648, initSize=268435456, swapPath=null, pageEvictionMode=DISABLED, pageReplacementMode=CLOCK, evictionThreshold=0.9, emptyPagesPoolSize=100, metricsEnabled=false, metricsSubIntervalCount=5, metricsRateTimeInterval=60000, persistenceEnabled=true, checkpointPageBufSize=0, lazyMemoryAllocation=true, warmUpCfg=null], dataRegions=null, storagePath=clusterbaselinenodesmetricsselftest/testBaselineNodes, checkpointFreq=180000, lockWaitTime=10000, checkpointThreads=4, checkpointWriteOrder=SEQUENTIAL, walHistSize=20, maxWalArchiveSize=1073741824, walSegments=10, walSegmentSize=67108864, walPath=clusterbaselinenodesmetricsselftest/testBaselineNodes/wal, walArchivePath=clusterbaselinenodesmetricsselftest/testBaselineNodes/archive, cdcWalPath=db/wal/cdc, cdcEnabled=false, metricsEnabled=false, walMode=LOG_ONLY, walTlbSize=131072, walBuffSize=0, walFlushFreq=2000, walFsyncDelay=1000, walRecordIterBuffSize=67108864, alwaysWriteFullPages=false, fileIOFactory=org.apache.ignite.internal.processors.cache.persistence.file.AsyncFileIOFactory@26cbfbb5, metricsSubIntervalCnt=5, metricsRateTimeInterval=60000, walAutoArchiveAfterInactivity=-1, walForceArchiveTimeout=-1, writeThrottlingEnabled=false, walCompactionEnabled=false, walCompactionLevel=1, checkpointReadLockTimeout=null, walPageCompression=DISABLED, walPageCompressionLevel=null, dfltWarmUpCfg=null, encCfg=org.apache.ignite.configuration.EncryptionConfiguration@a8c518, defragmentationThreadPoolSize=4, minWalArchiveSize=-1], snapshotPath=snapshots, activeOnStart=true, activeOnStartPropSetFlag=false, autoActivation=true, autoActivationPropSetFlag=false, clusterStateOnStart=null, sqlConnCfg=null, cliConnCfg=ClientConnectorConfiguration [host=null, port=10800, portRange=100, sockSndBufSize=0, sockRcvBufSize=0, tcpNoDelay=true, maxOpenCursorsPerConn=128, threadPoolSize=24, selectorCnt=12, idleTimeout=0, handshakeTimeout=10000, jdbcEnabled=true, odbcEnabled=true, thinCliEnabled=true, sslEnabled=false, useIgniteSslCtxFactory=true, sslClientAuth=false, sslCtxFactory=null, thinCliCfg=ThinClientConfiguration [maxActiveTxPerConn=100, maxActiveComputeTasksPerConn=0]], mvccVacuumThreadCnt=2, mvccVacuumFreq=5000, authEnabled=false, failureHnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]], commFailureRslvr=null, sqlCfg=SqlConfiguration [longQryWarnTimeout=3000, dfltQryTimeout=0, sqlQryHistSize=1000, validationEnabled=false], asyncContinuationExecutor=null] [21:01:53] : [Step 4/5] [2021-11-19 21:01:53,796][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][ClusterBaselineNodesMetricsSelfTest1] Daemon mode: off [21:01:53] : [Step 4/5] [2021-11-19 21:01:53,796][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][ClusterBaselineNodesMetricsSelfTest1] OS: Linux 4.15.0-151-generic amd64 [21:01:53] : [Step 4/5] [2021-11-19 21:01:53,797][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][ClusterBaselineNodesMetricsSelfTest1] OS user: teamcity [21:01:53] : [Step 4/5] [2021-11-19 21:01:53,797][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][ClusterBaselineNodesMetricsSelfTest1] PID: 16724 [21:01:53] : [Step 4/5] [2021-11-19 21:01:53,797][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][ClusterBaselineNodesMetricsSelfTest1] Language runtime: Java Platform API Specification ver. 1.8 [21:01:53] : [Step 4/5] [2021-11-19 21:01:53,798][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][ClusterBaselineNodesMetricsSelfTest1] VM information: Java(TM) SE Runtime Environment 1.8.0_261-b12 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 25.261-b12 [21:01:53] : [Step 4/5] [2021-11-19 21:01:53,798][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][ClusterBaselineNodesMetricsSelfTest1] VM total memory: 1.9GB [21:01:53] : [Step 4/5] [2021-11-19 21:01:53,799][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][ClusterBaselineNodesMetricsSelfTest1] Remote Management [restart: off, REST: off, JMX (remote: off)] [21:01:53] : [Step 4/5] [2021-11-19 21:01:53,799][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][ClusterBaselineNodesMetricsSelfTest1] Logger: GridTestLog4jLogger [quiet=false, config=null] [21:01:53] : [Step 4/5] [2021-11-19 21:01:53,799][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][ClusterBaselineNodesMetricsSelfTest1] IGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c [21:01:53] : [Step 4/5] [2021-11-19 21:01:53,800][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][ClusterBaselineNodesMetricsSelfTest1] VM arguments: [-DIGNITE_DUMP_THREADS_ON_FAILURE=false, -DMono=/usr/bin/mono-sgen, -DMono4.0_x64=/usr/lib/mono/4.0, -DMono4.5_x64=/usr/lib/mono/4.5, -DMonoVersion=6.12.0.90, -DSKIP_BUILD=false, -Dagent.home.dir=/opt/buildagent, -Dagent.name=aitc-lin02_03, -Dagent.ownPort=9090, -Dagent.work.dir=/opt/buildagent/work, -Dbuild.number=95, -Dbuild.vcs.number=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.1=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.GitHubApacheIgnite=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dclassworlds.conf=/opt/buildagent/temp/buildTmp/teamcity.m2.conf, -Dcom.jetbrains.maven.watcher.report.file=/opt/buildagent/temp/buildTmp/maven-build-info.xml, -Djava.io.tmpdir=/opt/buildagent/temp/buildTmp, -Dmaven.home=/opt/buildagent/tools/maven3_6, -Dmaven.multiModuleProjectDirectory=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.agent.cpuBenchmark=457, -Dteamcity.agent.dotnet.agent_url=http://localhost:9090/RPC2, -Dteamcity.agent.dotnet.build_id=6278078, -Dteamcity.auth.password=*******, -Dteamcity.auth.userId=TeamCityBuildId=6278078, -Dteamcity.build.changedFiles.file=/opt/buildagent/temp/buildTmp/changedFiles6342607772318147725.txt, -Dteamcity.build.checkoutDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.build.id=6278078, -Dteamcity.build.properties.file=/opt/buildagent/temp/buildTmp/teamcity.build5164517880467851002.properties, -Dteamcity.build.tempDir=/opt/buildagent/temp/buildTmp, -Dteamcity.build.workingDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.buildConfName=Basic 3, -Dteamcity.buildType.id=IgniteTests24Java8_Basic3, -Dteamcity.configuration.properties.file=/opt/buildagent/temp/buildTmp/teamcity.config5591980786735343870.properties, -Dteamcity.maven.userSettings.path=/opt/buildagent/temp/buildTmp/maven_settings_585072866407032347.xml, -Dteamcity.maven.watcher.home=/opt/buildagent/plugins/mavenPlugin/maven-watcher-jdk16, -Dteamcity.projectName=Ignite Tests 2.x (JDK 8/11), -Dteamcity.runner.properties.file=/opt/buildagent/temp/buildTmp/teamcity.runner9098465561618137420.properties, -Dteamcity.tests.recentlyFailedTests.file=/opt/buildagent/temp/buildTmp/testsToRunFirst3891775683130404069.txt, -Dteamcity.version=2021.2 (build 99542), -ea, -Xms2g, -Xmx2g, -XX:+HeapDumpOnOutOfMemoryError, -DIGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_TEST_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_UPDATE_NOTIFIER=false, -DIGNITE_NO_DISCO_ORDER=true, -DIGNITE_PERFORMANCE_SUGGESTIONS_DISABLED=true, -Djava.net.preferIPv4Stack=true, -DTEST_SCALE_FACTOR=1.0, -DIGNITE_TEST_PROP_LOG4J_FILE=log4j-tc-test.xml, -DIGNITE_QUIET=false, -DIGNITE_MARSHAL_BUFFERS_RECHECK=1000, -Dmaven.repo.local=/opt/buildagent/.m2/repository] [21:01:53] : [Step 4/5] [2021-11-19 21:01:53,805][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][ClusterBaselineNodesMetricsSelfTest1] System cache's DataRegion size is configured to 40 MB. Use DataStorageConfiguration.systemRegionInitialSize property to change the setting. [21:01:53] : [Step 4/5] [2021-11-19 21:01:53,805][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][ClusterBaselineNodesMetricsSelfTest1] Configured caches [in 'sysMemPlc' dataRegion: ['ignite-sys-cache']] [21:01:53] : [Step 4/5] [2021-11-19 21:01:53,806][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][ClusterBaselineNodesMetricsSelfTest1] 3-rd party licenses can be found at: /opt/buildagent/work/7bc1c54bc719b67c/libs/licenses [21:01:53]W: [org.apache.ignite:ignite-core] [2021-11-19 21:01:53,806][WARN ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][ClusterBaselineNodesMetricsSelfTest1] Peer class loading is enabled (disable it in production for performance and deployment consistency reasons) [21:01:53] : [Step 4/5] [2021-11-19 21:01:53,813][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][IgnitePluginProcessor] Configured plugins: [21:01:53] : [Step 4/5] [2021-11-19 21:01:53,813][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][IgnitePluginProcessor] ^-- StanByClusterTestProvider 1.0 [21:01:53] : [Step 4/5] [2021-11-19 21:01:53,813][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][IgnitePluginProcessor] ^-- null [21:01:53] : [Step 4/5] [2021-11-19 21:01:53,814][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][IgnitePluginProcessor] [21:01:53] : [Step 4/5] [2021-11-19 21:01:53,814][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][IgnitePluginProcessor] ^-- PageMemory tracker plugin 1.0 [21:01:53] : [Step 4/5] [2021-11-19 21:01:53,814][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][IgnitePluginProcessor] ^-- null [21:01:53] : [Step 4/5] [2021-11-19 21:01:53,815][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][IgnitePluginProcessor] [21:01:53] : [Step 4/5] [2021-11-19 21:01:53,815][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][IgnitePluginProcessor] ^-- TestDistibutedConfigurationPlugin 1.0 [21:01:53] : [Step 4/5] [2021-11-19 21:01:53,815][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][IgnitePluginProcessor] ^-- null [21:01:53] : [Step 4/5] [2021-11-19 21:01:53,816][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][IgnitePluginProcessor] [21:01:53] : [Step 4/5] [2021-11-19 21:01:53,816][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][IgnitePluginProcessor] ^-- NodeValidationPluginProvider 1.0 [21:01:53] : [Step 4/5] [2021-11-19 21:01:53,816][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][IgnitePluginProcessor] ^-- null [21:01:53] : [Step 4/5] [2021-11-19 21:01:53,816][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][IgnitePluginProcessor] [21:01:53] : [Step 4/5] [2021-11-19 21:01:53,822][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][FailureProcessor] Configured failure handler: [hnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]]] [21:01:54] : [Step 4/5] [2021-11-19 21:01:54,175][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][TcpCommunicationSpi] Successfully bound communication NIO server to TCP port [port=45021, locHost=/127.0.0.1, selectorsCnt=12, selectorSpins=0, pairedConn=false] [21:01:54]W: [org.apache.ignite:ignite-core] [2021-11-19 21:01:54,175][WARN ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][TcpCommunicationSpi] Message queue limit is set to 0 which may lead to potential OOMEs when running cache operations in FULL_ASYNC or PRIMARY_SYNC modes due to message queues growth on sender and receiver sides. [21:01:54] : [Step 4/5] [2021-11-19 21:01:54,204][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][GridCollisionManager] Collision resolution is disabled (all jobs will be activated upon arrival). [21:01:54] : [Step 4/5] [2021-11-19 21:01:54,205][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][ClusterBaselineNodesMetricsSelfTest1] Security status [authentication=off, sandbox=off, tls/ssl=off] [21:01:54] : [Step 4/5] [2021-11-19 21:01:54,207][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][MaintenanceProcessor] Resolved store directory for node persistent data: /opt/buildagent/work/7bc1c54bc719b67c/work/clusterbaselinenodesmetricsselftest/testBaselineNodes/internal_ClusterBaselineNodesMetricsSelfTest1 [21:01:54] : [Step 4/5] [2021-11-19 21:01:54,212][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][CacheObjectBinaryProcessorImpl] Resolved directory for serialized binary metadata: /opt/buildagent/work/7bc1c54bc719b67c/work/db/binary_meta/internal_ClusterBaselineNodesMetricsSelfTest1 [21:01:54] : [Step 4/5] [2021-11-19 21:01:54,220][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/clusterbaselinenodesmetricsselftest/testBaselineNodes/internal_ClusterBaselineNodesMetricsSelfTest1 [21:01:54] : [Step 4/5] [2021-11-19 21:01:54,221][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][FileWriteAheadLogManager] Resolved write ahead log work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/clusterbaselinenodesmetricsselftest/testBaselineNodes/wal/internal_ClusterBaselineNodesMetricsSelfTest1 [21:01:54] : [Step 4/5] [2021-11-19 21:01:54,221][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][FileWriteAheadLogManager] Resolved write ahead log archive directory: /opt/buildagent/work/7bc1c54bc719b67c/work/clusterbaselinenodesmetricsselftest/testBaselineNodes/archive/internal_ClusterBaselineNodesMetricsSelfTest1 [21:01:54] : [Step 4/5] [2021-11-19 21:01:54,763][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/clusterbaselinenodesmetricsselftest/testBaselineNodes/wal/internal_ClusterBaselineNodesMetricsSelfTest1/0000000000000000.wal [21:01:54] : [Step 4/5] [2021-11-19 21:01:54,764][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][FileHandleManagerImpl] Initialized write-ahead log manager [mode=LOG_ONLY] [21:01:54] : [Step 4/5] [2021-11-19 21:01:54,771][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][GridCacheDatabaseSharedManager] Configured data regions initialized successfully [total=5] [21:01:54] : [Step 4/5] [2021-11-19 21:01:54,773][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][IgniteSnapshotManager] Resolved snapshot work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/snapshots [21:01:54] : [Step 4/5] [2021-11-19 21:01:54,774][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][IgniteSnapshotManager] Resolved temp directory for snapshot creation: /opt/buildagent/work/7bc1c54bc719b67c/work/clusterbaselinenodesmetricsselftest/testBaselineNodes/internal_ClusterBaselineNodesMetricsSelfTest1/snp [21:01:54] : [Step 4/5] [2021-11-19 21:01:54,779][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][ClientListenerProcessor] Client connector processor has started on TCP port 10801 [21:01:54] : [Step 4/5] [2021-11-19 21:01:54,784][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][ClusterBaselineNodesMetricsSelfTest1] Non-loopback local IPs: 172.17.0.4 [21:01:54] : [Step 4/5] [2021-11-19 21:01:54,784][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][ClusterBaselineNodesMetricsSelfTest1] Enabled local MACs: 0242AC110004 [21:01:54] : [Step 4/5] [2021-11-19 21:01:54,785][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:01:54] : [Step 4/5] [2021-11-19 21:01:54,787][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:01:54] : [Step 4/5] [2021-11-19 21:01:54,788][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:01:54] : [Step 4/5] [2021-11-19 21:01:54,792][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][GridCacheDatabaseSharedManager] Applying lost metastore updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:01:54] : [Step 4/5] [2021-11-19 21:01:54,796][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=10 ms] [21:01:54] : [Step 4/5] [2021-11-19 21:01:54,796][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][GridCacheProcessor] Restoring partition state for local groups. [21:01:54] : [Step 4/5] [2021-11-19 21:01:54,797][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=0, partitionsProcessed=0, time=0ms] [21:01:54] : [Step 4/5] [2021-11-19 21:01:54,797][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][GridEncryptionManager] Encryption keys loaded from metastore. [grps=, masterKeyName=null] [21:01:54] : [Step 4/5] [2021-11-19 21:01:54,799][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][ClusterProcessor] Cluster ID and tag has been read from metastorage: null [21:01:54] : [Step 4/5] [2021-11-19 21:01:54,800][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][IgniteClusterImpl] Shutdown policy was updated [oldVal=null, newVal=null] [21:01:54] : [Step 4/5] [2021-11-19 21:01:54,801][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][GridCacheDatabaseSharedManager] Checkpoint frequency deviation changed [oldVal=null, newVal=null] [21:01:54] : [Step 4/5] [2021-11-19 21:01:54,810][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][FilePageStoreManager] Cleanup cache stores [total=1, left=0, cleanFiles=false] [21:01:54] : [Step 4/5] [2021-11-19 21:01:54,815][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:01:54] : [Step 4/5] [2021-11-19 21:01:54,817][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:01:54] : [Step 4/5] [2021-11-19 21:01:54,820][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:01:54] : [Step 4/5] [2021-11-19 21:01:54,820][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][GridCacheDatabaseSharedManager] Data Regions Started: 5 [21:01:54] : [Step 4/5] [2021-11-19 21:01:54,845][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][GridCacheDatabaseSharedManager] ^-- sysMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:01:54] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:01:54] : [Step 4/5] ^-- default region [type=default, persistence=true, lazyAlloc=true, [21:01:54] : [Step 4/5] ... initCfg=256MB, maxCfg=2048MB, usedRam=0MB, freeRam=100%, allocRam=0MB, allocTotal=0MB] [21:01:54] : [Step 4/5] ^-- metastoreMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:01:54] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:01:54] : [Step 4/5] ^-- TxLog region [type=internal, persistence=true, lazyAlloc=false, [21:01:54] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:01:54] : [Step 4/5] ^-- volatileDsMemPlc region [type=user, persistence=false, lazyAlloc=true, [21:01:54] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB] [21:01:54] : [Step 4/5] ^-- Ignite persistence [used=0MB] [21:01:54] : [Step 4/5] [21:01:54] : [Step 4/5] [2021-11-19 21:01:54,847][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][GridCacheDatabaseSharedManager] Starting binary memory restore for: [-2100569601] [21:01:54] : [Step 4/5] [2021-11-19 21:01:54,861][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:01:54] : [Step 4/5] [2021-11-19 21:01:54,861][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:01:54] : [Step 4/5] [2021-11-19 21:01:54,877][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/clusterbaselinenodesmetricsselftest/testBaselineNodes/wal/internal_ClusterBaselineNodesMetricsSelfTest1/0000000000000000.wal, offset=0, ver=2] [21:01:54] : [Step 4/5] [2021-11-19 21:01:54,882][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][GridCacheProcessor] Started cache in recovery mode [name=ignite-sys-cache, id=-2100569601, dataRegionName=sysMemPlc, mode=REPLICATED, atomicity=TRANSACTIONAL, backups=2147483647, mvcc=false] [21:01:54] : [Step 4/5] [2021-11-19 21:01:54,883][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][GridCacheDatabaseSharedManager] Binary recovery performed in 36 ms. [21:01:54] : [Step 4/5] [2021-11-19 21:01:54,884][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:01:54] : [Step 4/5] [2021-11-19 21:01:54,884][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][GridCacheDatabaseSharedManager] Applying lost cache updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:01:54] : [Step 4/5] [2021-11-19 21:01:54,992][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=114 ms] [21:01:54] : [Step 4/5] [2021-11-19 21:01:54,992][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][GridCacheProcessor] Restoring partition state for local groups. [21:01:55] : [Step 4/5] [2021-11-19 21:01:55,018][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=1, partitionsProcessed=100, time=20ms] [21:01:55] : [Step 4/5] [2021-11-19 21:01:55,443][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][TestTcpDiscoverySpi] Successfully bound to TCP port [port=47501, localHost=localhost/127.0.0.1, locNodeId=5ff14d92-b955-4988-af16-a71774900001] [21:01:55] : [Step 4/5] [2021-11-19 21:01:55,450][INFO ][tcp-disco-srvr-[:47500]-#60%internal.ClusterBaselineNodesMetricsSelfTest0%-#1234%internal.ClusterBaselineNodesMetricsSelfTest0%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=36009] [21:01:55] : [Step 4/5] [2021-11-19 21:01:55,450][INFO ][tcp-disco-srvr-[:47500]-#60%internal.ClusterBaselineNodesMetricsSelfTest0%-#1234%internal.ClusterBaselineNodesMetricsSelfTest0%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=36009] [21:01:55] : [Step 4/5] [2021-11-19 21:01:55,452][INFO ][tcp-disco-sock-reader-[]-#66%internal.ClusterBaselineNodesMetricsSelfTest0%-#1354%internal.ClusterBaselineNodesMetricsSelfTest0%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:36009, rmtPort=36009] [21:01:55] : [Step 4/5] [2021-11-19 21:01:55,456][INFO ][tcp-disco-sock-reader-[5ff14d92 127.0.0.1:36009]-#66%internal.ClusterBaselineNodesMetricsSelfTest0%-#1354%internal.ClusterBaselineNodesMetricsSelfTest0%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=5ff14d92-b955-4988-af16-a71774900001, rmtAddr=/127.0.0.1:36009] [21:01:55] : [Step 4/5] [2021-11-19 21:01:55,470][INFO ][tcp-disco-srvr-[:47501]-#65%internal.ClusterBaselineNodesMetricsSelfTest1%-#1353%internal.ClusterBaselineNodesMetricsSelfTest1%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=40733] [21:01:55] : [Step 4/5] [2021-11-19 21:01:55,470][INFO ][tcp-disco-srvr-[:47501]-#65%internal.ClusterBaselineNodesMetricsSelfTest1%-#1353%internal.ClusterBaselineNodesMetricsSelfTest1%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=40733] [21:01:55] : [Step 4/5] [2021-11-19 21:01:55,473][INFO ][tcp-disco-sock-reader-[]-#67%internal.ClusterBaselineNodesMetricsSelfTest1%-#1355%internal.ClusterBaselineNodesMetricsSelfTest1%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:40733, rmtPort=40733] [21:01:55] : [Step 4/5] [2021-11-19 21:01:55,473][INFO ][tcp-disco-sock-reader-[]-#67%internal.ClusterBaselineNodesMetricsSelfTest1%-#1355%internal.ClusterBaselineNodesMetricsSelfTest1%][TestTcpDiscoverySpi] Received ping request from the remote node [rmtNodeId=4f8845b3-7744-4ec1-9404-43c3d1f00000, rmtAddr=/127.0.0.1:40733, rmtPort=40733] [21:01:55] : [Step 4/5] [2021-11-19 21:01:55,476][INFO ][tcp-disco-sock-reader-[5ff14d92 127.0.0.1:36009]-#66%internal.ClusterBaselineNodesMetricsSelfTest0%-#1354%internal.ClusterBaselineNodesMetricsSelfTest0%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:36009, rmtPort=36009, rmtNodeId=5ff14d92-b955-4988-af16-a71774900001] [21:01:55] : [Step 4/5] [2021-11-19 21:01:55,482][INFO ][tcp-disco-sock-reader-[]-#67%internal.ClusterBaselineNodesMetricsSelfTest1%-#1355%internal.ClusterBaselineNodesMetricsSelfTest1%][TestTcpDiscoverySpi] Finished writing ping response [rmtNodeId=4f8845b3-7744-4ec1-9404-43c3d1f00000, rmtAddr=/127.0.0.1:40733, rmtPort=40733] [21:01:55]W: [org.apache.ignite:ignite-core] [2021-11-19 21:01:55,482][WARN ][tcp-disco-sock-reader-[]-#67%internal.ClusterBaselineNodesMetricsSelfTest1%-#1355%internal.ClusterBaselineNodesMetricsSelfTest1%][TestTcpDiscoverySpi] Failed to shutdown socket [21:01:55]W: [org.apache.ignite:ignite-core] java.net.SocketException: Socket output is already shutdown [21:01:55]W: [org.apache.ignite:ignite-core] at java.net.Socket.shutdownOutput(Socket.java:1572) [21:01:55]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.close(IgniteUtils.java:4247) [21:01:55]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.discovery.tcp.ServerImpl$SocketReader.body(ServerImpl.java:7370) [21:01:55]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.IgniteSpiThread.run(IgniteSpiThread.java:58) [21:01:55] : [Step 4/5] [2021-11-19 21:01:55,485][INFO ][tcp-disco-msg-worker-[crd]-#59%internal.ClusterBaselineNodesMetricsSelfTest0%-#1233%internal.ClusterBaselineNodesMetricsSelfTest0%][GridEncryptionManager] Joining node doesn't have stored group keys [node=5ff14d92-b955-4988-af16-a71774900001] [21:01:55] : [Step 4/5] [2021-11-19 21:01:55,485][INFO ][tcp-disco-sock-reader-[]-#67%internal.ClusterBaselineNodesMetricsSelfTest1%-#1355%internal.ClusterBaselineNodesMetricsSelfTest1%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:40733, rmtPort=40733, rmtNodeId=null] [21:01:55] : [Step 4/5] [2021-11-19 21:01:55,509][INFO ][tcp-disco-msg-worker-[crd]-#59%internal.ClusterBaselineNodesMetricsSelfTest0%-#1233%internal.ClusterBaselineNodesMetricsSelfTest0%][TestTcpDiscoverySpi] New next node [newNext=TcpDiscoveryNode [id=5ff14d92-b955-4988-af16-a71774900001, consistentId=internal.ClusterBaselineNodesMetricsSelfTest1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=0, intOrder=2, lastExchangeTime=1637344915461, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false]] [21:01:55] : [Step 4/5] [2021-11-19 21:01:55,511][INFO ][tcp-disco-srvr-[:47501]-#65%internal.ClusterBaselineNodesMetricsSelfTest1%-#1353%internal.ClusterBaselineNodesMetricsSelfTest1%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=44743] [21:01:55] : [Step 4/5] [2021-11-19 21:01:55,511][INFO ][tcp-disco-srvr-[:47501]-#65%internal.ClusterBaselineNodesMetricsSelfTest1%-#1353%internal.ClusterBaselineNodesMetricsSelfTest1%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=44743] [21:01:55] : [Step 4/5] [2021-11-19 21:01:55,512][INFO ][tcp-disco-sock-reader-[]-#68%internal.ClusterBaselineNodesMetricsSelfTest1%-#1356%internal.ClusterBaselineNodesMetricsSelfTest1%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:44743, rmtPort=44743] [21:01:55] : [Step 4/5] [2021-11-19 21:01:55,515][INFO ][tcp-disco-sock-reader-[4f8845b3 127.0.0.1:44743]-#68%internal.ClusterBaselineNodesMetricsSelfTest1%-#1356%internal.ClusterBaselineNodesMetricsSelfTest1%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=4f8845b3-7744-4ec1-9404-43c3d1f00000, rmtAddr=/127.0.0.1:44743] [21:01:55] : [Step 4/5] [2021-11-19 21:01:55,528][INFO ][tcp-disco-msg-worker-[]-#64%internal.ClusterBaselineNodesMetricsSelfTest1%-#1352%internal.ClusterBaselineNodesMetricsSelfTest1%][TestTcpDiscoverySpi] New next node [newNext=TcpDiscoveryNode [id=4f8845b3-7744-4ec1-9404-43c3d1f00000, consistentId=internal.ClusterBaselineNodesMetricsSelfTest0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637344915514, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false]] [21:01:55] : [Step 4/5] [2021-11-19 21:01:55,529][INFO ][tcp-disco-srvr-[:47500]-#60%internal.ClusterBaselineNodesMetricsSelfTest0%-#1234%internal.ClusterBaselineNodesMetricsSelfTest0%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=59833] [21:01:55] : [Step 4/5] [2021-11-19 21:01:55,530][INFO ][tcp-disco-srvr-[:47500]-#60%internal.ClusterBaselineNodesMetricsSelfTest0%-#1234%internal.ClusterBaselineNodesMetricsSelfTest0%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=59833] [21:01:55] : [Step 4/5] [2021-11-19 21:01:55,532][INFO ][tcp-disco-sock-reader-[]-#69%internal.ClusterBaselineNodesMetricsSelfTest0%-#1357%internal.ClusterBaselineNodesMetricsSelfTest0%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:59833, rmtPort=59833] [21:01:55] : [Step 4/5] [2021-11-19 21:01:55,539][INFO ][tcp-disco-sock-reader-[5ff14d92 127.0.0.1:59833]-#69%internal.ClusterBaselineNodesMetricsSelfTest0%-#1357%internal.ClusterBaselineNodesMetricsSelfTest0%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=5ff14d92-b955-4988-af16-a71774900001, rmtAddr=/127.0.0.1:59833] [21:01:55] : [Step 4/5] [2021-11-19 21:01:55,549][INFO ][disco-event-worker-#1236%internal.ClusterBaselineNodesMetricsSelfTest0%][GridDiscoveryManager] Added new node to topology: TcpDiscoveryNode [id=5ff14d92-b955-4988-af16-a71774900001, consistentId=internal.ClusterBaselineNodesMetricsSelfTest1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637344915461, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false] [21:01:55] : [Step 4/5] [2021-11-19 21:01:55,550][INFO ][tcp-disco-msg-worker-[4f8845b3 127.0.0.1:47500]-#64%internal.ClusterBaselineNodesMetricsSelfTest1%-#1352%internal.ClusterBaselineNodesMetricsSelfTest1%][ClusterProcessor] affectionate_sanderson [21:01:55] : [Step 4/5] [2021-11-19 21:01:55,551][INFO ][disco-event-worker-#1236%internal.ClusterBaselineNodesMetricsSelfTest0%][GridDiscoveryManager] Topology snapshot [ver=2, locNode=4f8845b3, servers=2, clients=0, state=INACTIVE, CPUs=24, offheap=2.0GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=4f8845b3-7744-4ec1-9404-43c3d1f00000, consistentId=internal.ClusterBaselineNodesMetricsSelfTest0, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=5ff14d92-b955-4988-af16-a71774900001, consistentId=internal.ClusterBaselineNodesMetricsSelfTest1, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:01:55] : [Step 4/5] [2021-11-19 21:01:55,551][INFO ][tcp-disco-msg-worker-[4f8845b3 127.0.0.1:47500]-#64%internal.ClusterBaselineNodesMetricsSelfTest1%-#1352%internal.ClusterBaselineNodesMetricsSelfTest1%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustEnabled' was changed from 'null' to 'false' [21:01:55] : [Step 4/5] [2021-11-19 21:01:55,555][INFO ][tcp-disco-msg-worker-[4f8845b3 127.0.0.1:47500]-#64%internal.ClusterBaselineNodesMetricsSelfTest1%-#1352%internal.ClusterBaselineNodesMetricsSelfTest1%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustTimeout' was changed from 'null' to '300000' [21:01:55] : [Step 4/5] [2021-11-19 21:01:55,555][INFO ][tcp-disco-msg-worker-[4f8845b3 127.0.0.1:47500]-#64%internal.ClusterBaselineNodesMetricsSelfTest1%-#1352%internal.ClusterBaselineNodesMetricsSelfTest1%][IgniteTxManager] Transactions parameter 'longOperationsDumpTimeout' was changed from 'null' to '60000' [21:01:55] : [Step 4/5] [2021-11-19 21:01:55,556][INFO ][tcp-disco-msg-worker-[4f8845b3 127.0.0.1:47500]-#64%internal.ClusterBaselineNodesMetricsSelfTest1%-#1352%internal.ClusterBaselineNodesMetricsSelfTest1%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpThreshold' was changed from 'null' to '0' [21:01:55] : [Step 4/5] [2021-11-19 21:01:55,556][INFO ][tcp-disco-msg-worker-[4f8845b3 127.0.0.1:47500]-#64%internal.ClusterBaselineNodesMetricsSelfTest1%-#1352%internal.ClusterBaselineNodesMetricsSelfTest1%][IgniteTxManager] Transactions parameter 'transactionTimeDumpSamplesCoefficient' was changed from 'null' to '0.0' [21:01:55] : [Step 4/5] [2021-11-19 21:01:55,557][INFO ][tcp-disco-msg-worker-[4f8845b3 127.0.0.1:47500]-#64%internal.ClusterBaselineNodesMetricsSelfTest1%-#1352%internal.ClusterBaselineNodesMetricsSelfTest1%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpSamplesPerSecondLimit' was changed from 'null' to '5' [21:01:55] : [Step 4/5] [2021-11-19 21:01:55,557][INFO ][tcp-disco-msg-worker-[4f8845b3 127.0.0.1:47500]-#64%internal.ClusterBaselineNodesMetricsSelfTest1%-#1352%internal.ClusterBaselineNodesMetricsSelfTest1%][IgniteTxManager] Transactions parameter 'collisionsDumpInterval' was changed from 'null' to '1000' [21:01:55] : [Step 4/5] [2021-11-19 21:01:55,558][INFO ][tcp-disco-msg-worker-[4f8845b3 127.0.0.1:47500]-#64%internal.ClusterBaselineNodesMetricsSelfTest1%-#1352%internal.ClusterBaselineNodesMetricsSelfTest1%][IgniteTxManager] Transactions parameter 'txOwnerDumpRequestsAllowed' was changed from 'null' to 'true' [21:01:55] : [Step 4/5] [2021-11-19 21:01:55,558][INFO ][tcp-disco-msg-worker-[4f8845b3 127.0.0.1:47500]-#64%internal.ClusterBaselineNodesMetricsSelfTest1%-#1352%internal.ClusterBaselineNodesMetricsSelfTest1%][GridCacheDatabaseSharedManager] Historical rebalance WAL threshold changed [property=historical.rebalance.threshold, oldVal=null, newVal=500] [21:01:55] : [Step 4/5] [2021-11-19 21:01:55,561][INFO ][disco-notifier-worker-#1351%internal.ClusterBaselineNodesMetricsSelfTest1%][MvccProcessorImpl] Assigned mvcc coordinator [crd=MvccCoordinator [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=0], nodeId=4f8845b3-7744-4ec1-9404-43c3d1f00000, ver=1637344913679, local=false, initialized=false]] [21:01:55] : [Step 4/5] [2021-11-19 21:01:55,573][INFO ][sys-#1349%internal.ClusterBaselineNodesMetricsSelfTest1%][ClusterProcessor] Writing cluster ID and tag to metastorage on ready for write ClusterIdAndTag [id=aeea33f2-f76a-4ae8-9c30-3b901d5f028f, tag=affectionate_sanderson] [21:01:55] : [Step 4/5] [2021-11-19 21:01:55,657][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][ClusterBaselineNodesMetricsSelfTest1] To start Console Management & Monitoring run ignitevisorcmd.{sh|bat} [21:01:55] : [Step 4/5] [2021-11-19 21:01:55,659][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][ClusterBaselineNodesMetricsSelfTest1] [21:01:55] : [Step 4/5] [21:01:55] : [Step 4/5] >>> +-------------------------------------------+ [21:01:55] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:01:55] : [Step 4/5] >>> +-------------------------------------------+ [21:01:55] : [Step 4/5] >>> OS name: Linux 4.15.0-151-generic amd64 [21:01:55] : [Step 4/5] >>> CPU(s): 24 [21:01:55] : [Step 4/5] >>> Heap: 2.0GB [21:01:55] : [Step 4/5] >>> VM name: 16724@c4dfe9a430b2 [21:01:55] : [Step 4/5] >>> Ignite instance name: internal.ClusterBaselineNodesMetricsSelfTest1 [21:01:55] : [Step 4/5] >>> Local node [ID=5FF14D92-B955-4988-AF16-A71774900001, order=2, clientMode=false] [21:01:55] : [Step 4/5] >>> Local node addresses: [127.0.0.1] [21:01:55] : [Step 4/5] >>> Local ports: TCP:10801 TCP:45021 TCP:47501 [21:01:55] : [Step 4/5] [21:01:55] : [Step 4/5] [2021-11-19 21:01:55,660][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][ClusterBaselineNodesMetricsSelfTest1] >>> Ignite cluster is in INACTIVE state (limited functionality available). Use control.(sh|bat) script or IgniteCluster.state(ClusterState.ACTIVE) to change the state. [21:01:55] : [Step 4/5] [2021-11-19 21:01:55,661][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][GridDiscoveryManager] Topology snapshot [ver=2, locNode=5ff14d92, servers=2, clients=0, state=INACTIVE, CPUs=24, offheap=2.0GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=4f8845b3-7744-4ec1-9404-43c3d1f00000, consistentId=internal.ClusterBaselineNodesMetricsSelfTest0, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=5ff14d92-b955-4988-af16-a71774900001, consistentId=internal.ClusterBaselineNodesMetricsSelfTest1, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:01:55] : [Step 4/5] [2021-11-19 21:01:55,662][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][G] Node started : [stage="Configure system pool" (0 ms),stage="Start managers" (431 ms),stage="Configure binary metadata" (3 ms),stage="Start processors" (568 ms),stage="Start 'StanByClusterTestProvider' plugin" (0 ms),stage="Start 'PageMemory tracker plugin' plugin" (0 ms),stage="Start 'TestDistibutedConfigurationPlugin' plugin" (0 ms),stage="Start 'NodeValidationPluginProvider' plugin" (0 ms),stage="Init metastore" (27 ms),stage="Init and start regions" (36 ms),stage="Restore binary memory" (36 ms),stage="Restore logical state" (134 ms),stage="Finish recovery" (417 ms),stage="Join topology" (128 ms),stage="Await transition" (12 ms),stage="Await exchange" (85 ms),stage="Total time" (1877 ms)] [21:01:55] : [Step 4/5] [2021-11-19 21:01:55,672][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][root] Node started with the following configuration [id=5ff14d92-b955-4988-af16-a71774900001, marshaller=BinaryMarshaller [], discovery=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=5000, ackTimeout=5000, marsh=JdkMarshaller [clsFilter=org.apache.ignite.marshaller.MarshallerUtils$1@d1ec985], reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], binaryCfg=null, lateAff=true] [21:01:55] : [Step 4/5] [2021-11-19 21:01:55,684][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][GridClusterStateProcessor] Sending activate cluster request with BaselineTopology BaselineTopology [id=0, branchingHash=-3606546011, branchingType='New BaselineTopology', baselineNodes=[internal.ClusterBaselineNodesMetricsSelfTest0, internal.ClusterBaselineNodesMetricsSelfTest1]] [21:01:55] : [Step 4/5] [2021-11-19 21:01:55,695][INFO ][disco-notifier-worker-#1232%internal.ClusterBaselineNodesMetricsSelfTest0%][GridClusterStateProcessor] Received activate cluster request with BaselineTopology[id=0] initiator node ID: 4f8845b3-7744-4ec1-9404-43c3d1f00000 [21:01:55] : [Step 4/5] [2021-11-19 21:01:55,696][INFO ][disco-notifier-worker-#1232%internal.ClusterBaselineNodesMetricsSelfTest0%][GridClusterStateProcessor] Started state transition: activate cluster [21:01:55] : [Step 4/5] [2021-11-19 21:01:55,698][INFO ][exchange-worker-#1237%internal.ClusterBaselineNodesMetricsSelfTest0%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], crd=true, evt=DISCOVERY_CUSTOM_EVT, evtNode=4f8845b3-7744-4ec1-9404-43c3d1f00000, customEvt=ChangeGlobalStateMessage [id=5a2ac593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqId=1b952e62-7ada-454f-9a20-fa48ecd67d5e, initiatingNodeId=4f8845b3-7744-4ec1-9404-43c3d1f00000, state=ACTIVE, baselineTopology=BaselineTopology [id=0, branchingHash=-3606546011, branchingType='New BaselineTopology', baselineNodes=[internal.ClusterBaselineNodesMetricsSelfTest0, internal.ClusterBaselineNodesMetricsSelfTest1]], forceChangeBaselineTopology=false, timestamp=1637344915684, forceDeactivation=true], allowMerge=false, exchangeFreeSwitch=false] [21:01:55] : [Step 4/5] [2021-11-19 21:01:55,700][INFO ][exchange-worker-#1237%internal.ClusterBaselineNodesMetricsSelfTest0%][GridDhtPartitionsExchangeFuture] Start activation process [nodeId=4f8845b3-7744-4ec1-9404-43c3d1f00000, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]]. New state: ACTIVE [21:01:55] : [Step 4/5] [2021-11-19 21:01:55,704][INFO ][exchange-worker-#1237%internal.ClusterBaselineNodesMetricsSelfTest0%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/clusterbaselinenodesmetricsselftest/testBaselineNodes/internal_ClusterBaselineNodesMetricsSelfTest0 [21:01:55] : [Step 4/5] [2021-11-19 21:01:55,704][INFO ][disco-notifier-worker-#1351%internal.ClusterBaselineNodesMetricsSelfTest1%][GridClusterStateProcessor] Received activate cluster request with BaselineTopology[id=0] initiator node ID: 4f8845b3-7744-4ec1-9404-43c3d1f00000 [21:01:55] : [Step 4/5] [2021-11-19 21:01:55,706][INFO ][disco-notifier-worker-#1351%internal.ClusterBaselineNodesMetricsSelfTest1%][GridClusterStateProcessor] Started state transition: activate cluster [21:01:55] : [Step 4/5] [2021-11-19 21:01:55,714][INFO ][exchange-worker-#1237%internal.ClusterBaselineNodesMetricsSelfTest0%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/clusterbaselinenodesmetricsselftest/testBaselineNodes/wal/internal_ClusterBaselineNodesMetricsSelfTest0/0000000000000000.wal, offset=8795, ver=2] [21:01:55] : [Step 4/5] [2021-11-19 21:01:55,721][INFO ][exchange-worker-#1237%internal.ClusterBaselineNodesMetricsSelfTest0%][GridClusterStateProcessor] Writing BaselineTopology[id=0] [21:01:55] : [Step 4/5] [2021-11-19 21:01:55,724][INFO ][exchange-worker-#1360%internal.ClusterBaselineNodesMetricsSelfTest1%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], crd=false, evt=DISCOVERY_CUSTOM_EVT, evtNode=4f8845b3-7744-4ec1-9404-43c3d1f00000, customEvt=ChangeGlobalStateMessage [id=5a2ac593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqId=1b952e62-7ada-454f-9a20-fa48ecd67d5e, initiatingNodeId=4f8845b3-7744-4ec1-9404-43c3d1f00000, state=ACTIVE, baselineTopology=BaselineTopology [id=0, branchingHash=-3606546011, branchingType='New BaselineTopology', baselineNodes=[internal.ClusterBaselineNodesMetricsSelfTest0, internal.ClusterBaselineNodesMetricsSelfTest1]], forceChangeBaselineTopology=false, timestamp=1637344915684, forceDeactivation=true], allowMerge=false, exchangeFreeSwitch=false] [21:01:55] : [Step 4/5] [2021-11-19 21:01:55,724][INFO ][exchange-worker-#1237%internal.ClusterBaselineNodesMetricsSelfTest0%][GridCacheDatabaseSharedManager] Finish recovery performed in 19 ms. [21:01:55] : [Step 4/5] [2021-11-19 21:01:55,725][INFO ][exchange-worker-#1360%internal.ClusterBaselineNodesMetricsSelfTest1%][GridDhtPartitionsExchangeFuture] Start activation process [nodeId=5ff14d92-b955-4988-af16-a71774900001, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]]. New state: ACTIVE [21:01:55] : [Step 4/5] [2021-11-19 21:01:55,726][INFO ][exchange-worker-#1237%internal.ClusterBaselineNodesMetricsSelfTest0%][msg] Components activation performed in 22 ms. [21:01:55] : [Step 4/5] [2021-11-19 21:01:55,727][INFO ][exchange-worker-#1360%internal.ClusterBaselineNodesMetricsSelfTest1%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/clusterbaselinenodesmetricsselftest/testBaselineNodes/internal_ClusterBaselineNodesMetricsSelfTest1 [21:01:55] : [Step 4/5] [2021-11-19 21:01:55,744][INFO ][exchange-worker-#1360%internal.ClusterBaselineNodesMetricsSelfTest1%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/clusterbaselinenodesmetricsselftest/testBaselineNodes/wal/internal_ClusterBaselineNodesMetricsSelfTest1/0000000000000000.wal, offset=8795, ver=2] [21:01:55] : [Step 4/5] [2021-11-19 21:01:55,752][INFO ][exchange-worker-#1360%internal.ClusterBaselineNodesMetricsSelfTest1%][GridClusterStateProcessor] Writing BaselineTopology[id=0] [21:01:55] : [Step 4/5] [2021-11-19 21:01:55,753][INFO ][exchange-worker-#1237%internal.ClusterBaselineNodesMetricsSelfTest0%][GridCacheProcessor] Finished recovery for cache [cache=ignite-sys-cache, grp=ignite-sys-cache, startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:01:55] : [Step 4/5] [2021-11-19 21:01:55,754][INFO ][exchange-worker-#1237%internal.ClusterBaselineNodesMetricsSelfTest0%][GridDhtPartitionsExchangeFuture] Successfully activated caches [nodeId=4f8845b3-7744-4ec1-9404-43c3d1f00000, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], newState=ACTIVE] [21:01:55] : [Step 4/5] [2021-11-19 21:01:55,755][INFO ][exchange-worker-#1237%internal.ClusterBaselineNodesMetricsSelfTest0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:01:55] : [Step 4/5] [2021-11-19 21:01:55,774][INFO ][exchange-worker-#1360%internal.ClusterBaselineNodesMetricsSelfTest1%][GridCacheDatabaseSharedManager] Finish recovery performed in 46 ms. [21:01:55] : [Step 4/5] [2021-11-19 21:01:55,774][INFO ][exchange-worker-#1360%internal.ClusterBaselineNodesMetricsSelfTest1%][msg] Components activation performed in 47 ms. [21:01:55] : [Step 4/5] [2021-11-19 21:01:55,781][INFO ][exchange-worker-#1360%internal.ClusterBaselineNodesMetricsSelfTest1%][GridCacheProcessor] Finished recovery for cache [cache=ignite-sys-cache, grp=ignite-sys-cache, startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:01:55] : [Step 4/5] [2021-11-19 21:01:55,782][INFO ][exchange-worker-#1360%internal.ClusterBaselineNodesMetricsSelfTest1%][GridDhtPartitionsExchangeFuture] Successfully activated caches [nodeId=5ff14d92-b955-4988-af16-a71774900001, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], newState=ACTIVE] [21:01:55] : [Step 4/5] [2021-11-19 21:01:55,783][INFO ][exchange-worker-#1360%internal.ClusterBaselineNodesMetricsSelfTest1%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:01:55] : [Step 4/5] [2021-11-19 21:01:55,788][INFO ][exchange-worker-#1237%internal.ClusterBaselineNodesMetricsSelfTest0%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], crd=true] [21:01:55] : [Step 4/5] [2021-11-19 21:01:55,798][INFO ][db-checkpoint-thread-#1371%internal.ClusterBaselineNodesMetricsSelfTest0%][Checkpointer] Checkpoint started [checkpointId=ec7292d0-83c5-4f98-b2e6-e20e3ff3a2db, startPtr=WALPointer [idx=0, fileOff=87026, len=1963], checkpointBeforeLockTime=2ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=8ms, walCpRecordFsyncDuration=8ms, writeCheckpointEntryDuration=2ms, splitAndSortCpPagesDuration=0ms, pages=17, reason='node started'] [21:01:55] : [Step 4/5] [2021-11-19 21:01:55,848][INFO ][grid-nio-worker-tcp-comm-0-#1175%TcpCommunicationSpi%][TcpCommunicationSpi] Accepted incoming communication connection [locAddr=/127.0.0.1:45020, rmtAddr=/127.0.0.1:47134] [21:01:55] : [Step 4/5] [2021-11-19 21:01:55,854][INFO ][grid-nio-worker-tcp-comm-0-#1294%TcpCommunicationSpi%][TcpCommunicationSpi] Established outgoing communication connection [locAddr=/127.0.0.1:47134, rmtAddr=/127.0.0.1:45020] [21:01:55] : [Step 4/5] [2021-11-19 21:01:55,855][INFO ][exchange-worker-#1360%internal.ClusterBaselineNodesMetricsSelfTest1%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], crd=false] [21:01:55] : [Step 4/5] [2021-11-19 21:01:55,855][INFO ][db-checkpoint-thread-#1376%internal.ClusterBaselineNodesMetricsSelfTest1%][Checkpointer] Checkpoint started [checkpointId=12170d7f-04a4-4f4c-8283-03d4c73f94b2, startPtr=WALPointer [idx=0, fileOff=87026, len=1963], checkpointBeforeLockTime=24ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=8ms, checkpointLockHoldTime=8ms, walCpRecordFsyncDuration=8ms, writeCheckpointEntryDuration=7ms, splitAndSortCpPagesDuration=0ms, pages=17, reason='node started'] [21:01:55] : [Step 4/5] [2021-11-19 21:01:55,861][INFO ][db-checkpoint-thread-#1371%internal.ClusterBaselineNodesMetricsSelfTest0%][Checkpointer] Checkpoint finished [cpId=ec7292d0-83c5-4f98-b2e6-e20e3ff3a2db, pages=17, markPos=WALPointer [idx=0, fileOff=87026, len=1963], walSegmentsCovered=[], markDuration=19ms, pagesWrite=37ms, fsync=24ms, total=82ms] [21:01:55] : [Step 4/5] [2021-11-19 21:01:55,869][INFO ][sys-#1209%internal.ClusterBaselineNodesMetricsSelfTest0%][GridDhtPartitionsExchangeFuture] Coordinator received single message [ver=AffinityTopologyVersion [topVer=2, minorTopVer=1], node=5ff14d92-b955-4988-af16-a71774900001, allReceived=true] [21:01:55] : [Step 4/5] [2021-11-19 21:01:55,870][INFO ][sys-#1209%internal.ClusterBaselineNodesMetricsSelfTest0%][GridDhtPartitionsExchangeFuture] finishExchangeOnCoordinator [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:01:55] : [Step 4/5] [2021-11-19 21:01:55,898][INFO ][db-checkpoint-thread-#1376%internal.ClusterBaselineNodesMetricsSelfTest1%][Checkpointer] Checkpoint finished [cpId=12170d7f-04a4-4f4c-8283-03d4c73f94b2, pages=17, markPos=WALPointer [idx=0, fileOff=87026, len=1963], walSegmentsCovered=[], markDuration=24ms, pagesWrite=16ms, fsync=26ms, total=90ms] [21:01:55] : [Step 4/5] [2021-11-19 21:01:55,899][INFO ][disco-notifier-worker-#1232%internal.ClusterBaselineNodesMetricsSelfTest0%][GridClusterStateProcessor] Received state change finish message: ACTIVE [21:01:55] : [Step 4/5] [2021-11-19 21:01:55,899][INFO ][disco-notifier-worker-#1232%internal.ClusterBaselineNodesMetricsSelfTest0%][GridClusterStateProcessor] Cluster state was changed from INACTIVE to ACTIVE [21:01:55] : [Step 4/5] [2021-11-19 21:01:55,899][INFO ][sys-#1209%internal.ClusterBaselineNodesMetricsSelfTest0%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], err=null, rebalanced=true, wasRebalanced=false] [21:01:55] : [Step 4/5] [2021-11-19 21:01:55,908][INFO ][disco-notifier-worker-#1351%internal.ClusterBaselineNodesMetricsSelfTest1%][GridClusterStateProcessor] Received state change finish message: ACTIVE [21:01:55] : [Step 4/5] [2021-11-19 21:01:55,908][INFO ][disco-notifier-worker-#1351%internal.ClusterBaselineNodesMetricsSelfTest1%][GridClusterStateProcessor] Cluster state was changed from INACTIVE to ACTIVE [21:01:55] : [Step 4/5] [2021-11-19 21:01:55,909][INFO ][sys-#1332%internal.ClusterBaselineNodesMetricsSelfTest1%][GridDhtPartitionsExchangeFuture] Received full message, will finish exchange [node=4f8845b3-7744-4ec1-9404-43c3d1f00000, resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:01:55] : [Step 4/5] [2021-11-19 21:01:55,911][INFO ][sys-#1332%internal.ClusterBaselineNodesMetricsSelfTest1%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], err=null, rebalanced=true, wasRebalanced=false] [21:01:55] : [Step 4/5] [2021-11-19 21:01:55,913][INFO ][sys-#1209%internal.ClusterBaselineNodesMetricsSelfTest0%][GridCacheProcessor] Finish proxy initialization, cacheName=ignite-sys-cache, localNodeId=4f8845b3-7744-4ec1-9404-43c3d1f00000 [21:01:55] : [Step 4/5] [2021-11-19 21:01:55,926][INFO ][sys-#1332%internal.ClusterBaselineNodesMetricsSelfTest1%][GridCacheProcessor] Finish proxy initialization, cacheName=ignite-sys-cache, localNodeId=5ff14d92-b955-4988-af16-a71774900001 [21:01:55] : [Step 4/5] [2021-11-19 21:01:55,927][INFO ][exchange-worker-#1360%internal.ClusterBaselineNodesMetricsSelfTest1%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=2, minorTopVer=1], force=false, evt=DISCOVERY_CUSTOM_EVT, node=4f8845b3-7744-4ec1-9404-43c3d1f00000] [21:01:55] : [Step 4/5] [2021-11-19 21:01:55,927][INFO ][sys-#1332%internal.ClusterBaselineNodesMetricsSelfTest1%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=5ff14d92-b955-4988-af16-a71774900001, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=4f8845b3-7744-4ec1-9404-43c3d1f00000, consistentId=internal.ClusterBaselineNodesMetricsSelfTest0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637344915514, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:01:55] : [Step 4/5] [2021-11-19 21:01:55,929][INFO ][sys-#1332%internal.ClusterBaselineNodesMetricsSelfTest1%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], stage="Waiting in exchange queue" (11 ms), stage="Exchange parameters initialization" (1 ms), stage="Update caches registry" (50 ms), stage="Start caches" (6 ms), stage="Affinity initialization on cache group start" (0 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Restore partition states" (0 ms), stage="After states restored callback" (56 ms), stage="WAL history reservation" (0 ms), stage="Waiting for Full message" (68 ms), stage="Affinity recalculation" (0 ms), stage="Full map updating" (0 ms), stage="Detect lost partitions" (3 ms), stage="Exchange done" (14 ms), stage="Total time" (209 ms)] [21:01:55] : [Step 4/5] [2021-11-19 21:01:55,931][INFO ][sys-#1332%internal.ClusterBaselineNodesMetricsSelfTest1%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], stage="Affinity initialization on cache group start [grp=ignite-sys-cache]" (0 ms) (parent=Affinity initialization on cache group start), stage="Affinity centralized initialization (crd) [grp=ignite-sys-cache, crd=false]" (0 ms) (parent=Determine exchange type), stage="Restore partition states [grp=ignite-sys-cache]" (0 ms) (parent=Restore partition states), stage="Affinity applying from full message [grp=ignite-sys-cache]" (0 ms) (parent=Affinity recalculation)] [21:01:55] : [Step 4/5] [2021-11-19 21:01:55,933][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][root] awaitPartitionMapExchange finished [21:01:55] : [Step 4/5] [2021-11-19 21:01:55,938][INFO ][sys-#1332%internal.ClusterBaselineNodesMetricsSelfTest1%][DistributedBaselineConfiguration] Baseline auto-adjust is 'disabled' with timeout='300000' ms [21:01:55] : [Step 4/5] [2021-11-19 21:01:55,938][INFO ][sys-#1209%internal.ClusterBaselineNodesMetricsSelfTest0%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=4f8845b3-7744-4ec1-9404-43c3d1f00000, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=4f8845b3-7744-4ec1-9404-43c3d1f00000, consistentId=internal.ClusterBaselineNodesMetricsSelfTest0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637344915899, loc=true, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:01:55] : [Step 4/5] [2021-11-19 21:01:55,938][INFO ][sys-#1225%internal.ClusterBaselineNodesMetricsSelfTest0%][DistributedBaselineConfiguration] Baseline auto-adjust is 'disabled' with timeout='300000' ms [21:01:55] : [Step 4/5] [2021-11-19 21:01:55,940][INFO ][sys-#1225%internal.ClusterBaselineNodesMetricsSelfTest0%][GridClusterStateProcessor] Successfully performed final activation steps [nodeId=4f8845b3-7744-4ec1-9404-43c3d1f00000, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:01:55] : [Step 4/5] [2021-11-19 21:01:55,940][INFO ][sys-#1209%internal.ClusterBaselineNodesMetricsSelfTest0%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (1 ms), stage="Update caches registry" (27 ms), stage="Start caches" (25 ms), stage="Affinity initialization on cache group start" (0 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Restore partition states" (0 ms), stage="After states restored callback" (32 ms), stage="WAL history reservation" (0 ms), stage="Waiting for all single messages" (82 ms), stage="Affinity recalculation (crd)" (0 ms), stage="Collect update counters and create affinity messages" (1 ms), stage="Assign partitions states" (1 ms), stage="Validate partitions states" (0 ms), stage="Ideal affinity diff calculation (enforced)" (3 ms), stage="Apply update counters" (0 ms), stage="Full message preparing" (18 ms), stage="Full message sending" (0 ms), stage="State finish message sending" (1 ms), stage="Detect lost partitions" (10 ms), stage="Exchange done" (30 ms), stage="Total time" (231 ms), Discovery lag=15 ms, Latest started node id=5ff14d92-b955-4988-af16-a71774900001] [21:01:55] : [Step 4/5] [2021-11-19 21:01:55,938][INFO ][sys-#1332%internal.ClusterBaselineNodesMetricsSelfTest1%][GridClusterStateProcessor] Successfully performed final activation steps [nodeId=5ff14d92-b955-4988-af16-a71774900001, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:01:55] : [Step 4/5] [2021-11-19 21:01:55,945][INFO ][sys-#1209%internal.ClusterBaselineNodesMetricsSelfTest0%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], stage="Affinity initialization on cache group start [grp=ignite-sys-cache]" (0 ms) (parent=Affinity initialization on cache group start), stage="Affinity centralized initialization (crd) [grp=ignite-sys-cache, crd=true]" (0 ms) (parent=Determine exchange type), stage="Restore partition states [grp=ignite-sys-cache]" (0 ms) (parent=Restore partition states), stage="Affinity recalculation (partitions availability) [grp=ignite-sys-cache]" (3 ms) (parent=Ideal affinity diff calculation (enforced))] [21:01:55] : [Step 4/5] [2021-11-19 21:01:55,944][INFO ][exchange-worker-#1237%internal.ClusterBaselineNodesMetricsSelfTest0%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=2, minorTopVer=1], force=false, evt=DISCOVERY_CUSTOM_EVT, node=4f8845b3-7744-4ec1-9404-43c3d1f00000] [21:01:55]W: [org.apache.ignite:ignite-core] [2021-11-19 21:01:55,963][WARN ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][G] Ignite work directory is not provided, automatically resolved to: /opt/buildagent/work/7bc1c54bc719b67c/work [21:01:55] : [Step 4/5] [2021-11-19 21:01:55,969][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][ClusterBaselineNodesMetricsSelfTest2] [21:01:55] : [Step 4/5] [21:01:55] : [Step 4/5] >>> __________ ________________ [21:01:55] : [Step 4/5] >>> / _/ ___/ |/ / _/_ __/ __/ [21:01:55] : [Step 4/5] >>> _/ // (7 7 // / / / / _/ [21:01:55] : [Step 4/5] >>> /___/\___/_/|_/___/ /_/ /___/ [21:01:55] : [Step 4/5] >>> [21:01:55] : [Step 4/5] >>> ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:01:55] : [Step 4/5] >>> 2021 Copyright(C) Apache Software Foundation [21:01:55] : [Step 4/5] >>> [21:01:55] : [Step 4/5] >>> Ignite documentation: http://ignite.apache.org [21:01:55] : [Step 4/5] [21:01:55] : [Step 4/5] [2021-11-19 21:01:55,970][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][ClusterBaselineNodesMetricsSelfTest2] Config URL: n/a [21:01:55] : [Step 4/5] [2021-11-19 21:01:55,971][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][ClusterBaselineNodesMetricsSelfTest2] IgniteConfiguration [igniteInstanceName=internal.ClusterBaselineNodesMetricsSelfTest2, pubPoolSize=24, svcPoolSize=24, callbackPoolSize=24, stripedPoolSize=24, sysPoolSize=24, mgmtPoolSize=4, dataStreamerPoolSize=24, utilityCachePoolSize=24, utilityCacheKeepAliveTime=60000, p2pPoolSize=2, qryPoolSize=24, buildIdxPoolSize=4, igniteHome=/opt/buildagent/work/7bc1c54bc719b67c, igniteWorkDir=/opt/buildagent/work/7bc1c54bc719b67c/work, mbeanSrv=com.sun.jmx.mbeanserver.JmxMBeanServer@6fe85038, nodeId=f054f218-1e85-4528-9e50-191c6f500002, marsh=BinaryMarshaller [], marshLocJobs=false, daemon=false, p2pEnabled=true, netTimeout=10000, netCompressionLevel=1, sndRetryDelay=1000, sndRetryCnt=3, metricsHistSize=10000, metricsUpdateFreq=1000, metricsExpTime=9223372036854775807, discoSpi=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=0, ackTimeout=0, marsh=null, reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], segPlc=STOP, segResolveAttempts=2, waitForSegOnStart=true, allResolversPassReq=true, segChkFreq=10000, commSpi=TcpCommunicationSpi [connectGate=org.apache.ignite.spi.communication.tcp.internal.ConnectGateway@309a1c5a, ctxInitLatch=java.util.concurrent.CountDownLatch@7a47d6d6[Count = 1], stopping=false, clientPool=null, nioSrvWrapper=null, stateProvider=null], evtSpi=MemoryEventStorageSpi [expireAgeMs=9223372036854775807, expireCnt=10000, filter=null], colSpi=NoopCollisionSpi [], deploySpi=LocalDeploymentSpi [], indexingSpi=org.apache.ignite.spi.indexing.noop.NoopIndexingSpi@4eab3b2f, addrRslvr=null, encryptionSpi=org.apache.ignite.spi.encryption.noop.NoopEncryptionSpi@24fc5d2, tracingSpi=org.apache.ignite.spi.tracing.NoopTracingSpi@58b337d5, clientMode=false, rebalanceThreadPoolSize=4, rebalanceTimeout=10000, rebalanceBatchesPrefetchCnt=3, rebalanceThrottle=0, rebalanceBatchSize=524288, txCfg=TransactionConfiguration [txSerEnabled=false, dfltIsolation=REPEATABLE_READ, dfltConcurrency=PESSIMISTIC, dfltTxTimeout=0, txTimeoutOnPartitionMapExchange=0, deadlockTimeout=10000, pessimisticTxLogSize=0, pessimisticTxLogLinger=10000, tmLookupClsName=null, txManagerFactory=null, useJtaSync=false], cacheSanityCheckEnabled=true, discoStartupDelay=60000, deployMode=SHARED, p2pMissedCacheSize=100, locHost=127.0.0.1, timeSrvPortBase=31100, timeSrvPortRange=100, failureDetectionTimeout=10000, sysWorkerBlockedTimeout=null, clientFailureDetectionTimeout=10000, metricsLogFreq=0, connectorCfg=null, odbcCfg=null, warmupClos=null, atomicCfg=AtomicConfiguration [seqReserveSize=1000, cacheMode=PARTITIONED, backups=1, aff=null, grpName=null], classLdr=null, sslCtxFactory=null, platformCfg=null, binaryCfg=null, memCfg=null, pstCfg=null, dsCfg=DataStorageConfiguration [sysRegionInitSize=41943040, sysRegionMaxSize=104857600, pageSize=0, concLvl=0, dfltDataRegConf=DataRegionConfiguration [name=default, maxSize=2147483648, initSize=268435456, swapPath=null, pageEvictionMode=DISABLED, pageReplacementMode=CLOCK, evictionThreshold=0.9, emptyPagesPoolSize=100, metricsEnabled=false, metricsSubIntervalCount=5, metricsRateTimeInterval=60000, persistenceEnabled=true, checkpointPageBufSize=0, lazyMemoryAllocation=true, warmUpCfg=null], dataRegions=null, storagePath=clusterbaselinenodesmetricsselftest/testBaselineNodes, checkpointFreq=180000, lockWaitTime=10000, checkpointThreads=4, checkpointWriteOrder=SEQUENTIAL, walHistSize=20, maxWalArchiveSize=1073741824, walSegments=10, walSegmentSize=67108864, walPath=clusterbaselinenodesmetricsselftest/testBaselineNodes/wal, walArchivePath=clusterbaselinenodesmetricsselftest/testBaselineNodes/archive, cdcWalPath=db/wal/cdc, cdcEnabled=false, metricsEnabled=false, walMode=LOG_ONLY, walTlbSize=131072, walBuffSize=0, walFlushFreq=2000, walFsyncDelay=1000, walRecordIterBuffSize=67108864, alwaysWriteFullPages=false, fileIOFactory=org.apache.ignite.internal.processors.cache.persistence.file.AsyncFileIOFactory@5bd0ba81, metricsSubIntervalCnt=5, metricsRateTimeInterval=60000, walAutoArchiveAfterInactivity=-1, walForceArchiveTimeout=-1, writeThrottlingEnabled=false, walCompactionEnabled=false, walCompactionLevel=1, checkpointReadLockTimeout=null, walPageCompression=DISABLED, walPageCompressionLevel=null, dfltWarmUpCfg=null, encCfg=org.apache.ignite.configuration.EncryptionConfiguration@2bbd0b57, defragmentationThreadPoolSize=4, minWalArchiveSize=-1], snapshotPath=snapshots, activeOnStart=true, activeOnStartPropSetFlag=false, autoActivation=true, autoActivationPropSetFlag=false, clusterStateOnStart=null, sqlConnCfg=null, cliConnCfg=ClientConnectorConfiguration [host=null, port=10800, portRange=100, sockSndBufSize=0, sockRcvBufSize=0, tcpNoDelay=true, maxOpenCursorsPerConn=128, threadPoolSize=24, selectorCnt=12, idleTimeout=0, handshakeTimeout=10000, jdbcEnabled=true, odbcEnabled=true, thinCliEnabled=true, sslEnabled=false, useIgniteSslCtxFactory=true, sslClientAuth=false, sslCtxFactory=null, thinCliCfg=ThinClientConfiguration [maxActiveTxPerConn=100, maxActiveComputeTasksPerConn=0]], mvccVacuumThreadCnt=2, mvccVacuumFreq=5000, authEnabled=false, failureHnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]], commFailureRslvr=null, sqlCfg=SqlConfiguration [longQryWarnTimeout=3000, dfltQryTimeout=0, sqlQryHistSize=1000, validationEnabled=false], asyncContinuationExecutor=null] [21:01:55] : [Step 4/5] [2021-11-19 21:01:55,984][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][ClusterBaselineNodesMetricsSelfTest2] Daemon mode: off [21:01:55] : [Step 4/5] [2021-11-19 21:01:55,984][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][ClusterBaselineNodesMetricsSelfTest2] OS: Linux 4.15.0-151-generic amd64 [21:01:55] : [Step 4/5] [2021-11-19 21:01:55,985][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][ClusterBaselineNodesMetricsSelfTest2] OS user: teamcity [21:01:55] : [Step 4/5] [2021-11-19 21:01:55,985][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][ClusterBaselineNodesMetricsSelfTest2] PID: 16724 [21:01:55] : [Step 4/5] [2021-11-19 21:01:55,986][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][ClusterBaselineNodesMetricsSelfTest2] Language runtime: Java Platform API Specification ver. 1.8 [21:01:55] : [Step 4/5] [2021-11-19 21:01:55,986][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][ClusterBaselineNodesMetricsSelfTest2] VM information: Java(TM) SE Runtime Environment 1.8.0_261-b12 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 25.261-b12 [21:01:55] : [Step 4/5] [2021-11-19 21:01:55,987][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][ClusterBaselineNodesMetricsSelfTest2] VM total memory: 1.9GB [21:01:55] : [Step 4/5] [2021-11-19 21:01:55,987][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][ClusterBaselineNodesMetricsSelfTest2] Remote Management [restart: off, REST: off, JMX (remote: off)] [21:01:55] : [Step 4/5] [2021-11-19 21:01:55,987][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][ClusterBaselineNodesMetricsSelfTest2] Logger: GridTestLog4jLogger [quiet=false, config=null] [21:01:55] : [Step 4/5] [2021-11-19 21:01:55,988][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][ClusterBaselineNodesMetricsSelfTest2] IGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c [21:01:55] : [Step 4/5] [2021-11-19 21:01:55,988][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][ClusterBaselineNodesMetricsSelfTest2] VM arguments: [-DIGNITE_DUMP_THREADS_ON_FAILURE=false, -DMono=/usr/bin/mono-sgen, -DMono4.0_x64=/usr/lib/mono/4.0, -DMono4.5_x64=/usr/lib/mono/4.5, -DMonoVersion=6.12.0.90, -DSKIP_BUILD=false, -Dagent.home.dir=/opt/buildagent, -Dagent.name=aitc-lin02_03, -Dagent.ownPort=9090, -Dagent.work.dir=/opt/buildagent/work, -Dbuild.number=95, -Dbuild.vcs.number=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.1=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.GitHubApacheIgnite=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dclassworlds.conf=/opt/buildagent/temp/buildTmp/teamcity.m2.conf, -Dcom.jetbrains.maven.watcher.report.file=/opt/buildagent/temp/buildTmp/maven-build-info.xml, -Djava.io.tmpdir=/opt/buildagent/temp/buildTmp, -Dmaven.home=/opt/buildagent/tools/maven3_6, -Dmaven.multiModuleProjectDirectory=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.agent.cpuBenchmark=457, -Dteamcity.agent.dotnet.agent_url=http://localhost:9090/RPC2, -Dteamcity.agent.dotnet.build_id=6278078, -Dteamcity.auth.password=*******, -Dteamcity.auth.userId=TeamCityBuildId=6278078, -Dteamcity.build.changedFiles.file=/opt/buildagent/temp/buildTmp/changedFiles6342607772318147725.txt, -Dteamcity.build.checkoutDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.build.id=6278078, -Dteamcity.build.properties.file=/opt/buildagent/temp/buildTmp/teamcity.build5164517880467851002.properties, -Dteamcity.build.tempDir=/opt/buildagent/temp/buildTmp, -Dteamcity.build.workingDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.buildConfName=Basic 3, -Dteamcity.buildType.id=IgniteTests24Java8_Basic3, -Dteamcity.configuration.properties.file=/opt/buildagent/temp/buildTmp/teamcity.config5591980786735343870.properties, -Dteamcity.maven.userSettings.path=/opt/buildagent/temp/buildTmp/maven_settings_585072866407032347.xml, -Dteamcity.maven.watcher.home=/opt/buildagent/plugins/mavenPlugin/maven-watcher-jdk16, -Dteamcity.projectName=Ignite Tests 2.x (JDK 8/11), -Dteamcity.runner.properties.file=/opt/buildagent/temp/buildTmp/teamcity.runner9098465561618137420.properties, -Dteamcity.tests.recentlyFailedTests.file=/opt/buildagent/temp/buildTmp/testsToRunFirst3891775683130404069.txt, -Dteamcity.version=2021.2 (build 99542), -ea, -Xms2g, -Xmx2g, -XX:+HeapDumpOnOutOfMemoryError, -DIGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_TEST_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_UPDATE_NOTIFIER=false, -DIGNITE_NO_DISCO_ORDER=true, -DIGNITE_PERFORMANCE_SUGGESTIONS_DISABLED=true, -Djava.net.preferIPv4Stack=true, -DTEST_SCALE_FACTOR=1.0, -DIGNITE_TEST_PROP_LOG4J_FILE=log4j-tc-test.xml, -DIGNITE_QUIET=false, -DIGNITE_MARSHAL_BUFFERS_RECHECK=1000, -Dmaven.repo.local=/opt/buildagent/.m2/repository] [21:01:55] : [Step 4/5] [2021-11-19 21:01:55,997][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][ClusterBaselineNodesMetricsSelfTest2] System cache's DataRegion size is configured to 40 MB. Use DataStorageConfiguration.systemRegionInitialSize property to change the setting. [21:01:55] : [Step 4/5] [2021-11-19 21:01:55,997][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][ClusterBaselineNodesMetricsSelfTest2] Configured caches [in 'sysMemPlc' dataRegion: ['ignite-sys-cache']] [21:01:55] : [Step 4/5] [2021-11-19 21:01:55,998][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][ClusterBaselineNodesMetricsSelfTest2] 3-rd party licenses can be found at: /opt/buildagent/work/7bc1c54bc719b67c/libs/licenses [21:01:56]W: [org.apache.ignite:ignite-core] [2021-11-19 21:01:55,998][WARN ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][ClusterBaselineNodesMetricsSelfTest2] Peer class loading is enabled (disable it in production for performance and deployment consistency reasons) [21:01:56] : [Step 4/5] [2021-11-19 21:01:56,004][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][IgnitePluginProcessor] Configured plugins: [21:01:56] : [Step 4/5] [2021-11-19 21:01:56,004][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][IgnitePluginProcessor] ^-- StanByClusterTestProvider 1.0 [21:01:56] : [Step 4/5] [2021-11-19 21:01:56,005][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][IgnitePluginProcessor] ^-- null [21:01:56] : [Step 4/5] [2021-11-19 21:01:56,005][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][IgnitePluginProcessor] [21:01:56] : [Step 4/5] [2021-11-19 21:01:56,005][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][IgnitePluginProcessor] ^-- PageMemory tracker plugin 1.0 [21:01:56] : [Step 4/5] [2021-11-19 21:01:56,005][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][IgnitePluginProcessor] ^-- null [21:01:56] : [Step 4/5] [2021-11-19 21:01:56,005][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][IgnitePluginProcessor] [21:01:56] : [Step 4/5] [2021-11-19 21:01:56,006][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][IgnitePluginProcessor] ^-- TestDistibutedConfigurationPlugin 1.0 [21:01:56] : [Step 4/5] [2021-11-19 21:01:56,006][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][IgnitePluginProcessor] ^-- null [21:01:56] : [Step 4/5] [2021-11-19 21:01:56,006][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][IgnitePluginProcessor] [21:01:56] : [Step 4/5] [2021-11-19 21:01:56,007][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][IgnitePluginProcessor] ^-- NodeValidationPluginProvider 1.0 [21:01:56] : [Step 4/5] [2021-11-19 21:01:56,007][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][IgnitePluginProcessor] ^-- null [21:01:56] : [Step 4/5] [2021-11-19 21:01:56,007][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][IgnitePluginProcessor] [21:01:56] : [Step 4/5] [2021-11-19 21:01:56,008][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][FailureProcessor] Configured failure handler: [hnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]]] [21:01:56] : [Step 4/5] [2021-11-19 21:01:56,134][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][TcpCommunicationSpi] Successfully bound communication NIO server to TCP port [port=45022, locHost=/127.0.0.1, selectorsCnt=12, selectorSpins=0, pairedConn=false] [21:01:56]W: [org.apache.ignite:ignite-core] [2021-11-19 21:01:56,135][WARN ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][TcpCommunicationSpi] Message queue limit is set to 0 which may lead to potential OOMEs when running cache operations in FULL_ASYNC or PRIMARY_SYNC modes due to message queues growth on sender and receiver sides. [21:01:56] : [Step 4/5] [2021-11-19 21:01:56,176][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][GridCollisionManager] Collision resolution is disabled (all jobs will be activated upon arrival). [21:01:56] : [Step 4/5] [2021-11-19 21:01:56,176][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][ClusterBaselineNodesMetricsSelfTest2] Security status [authentication=off, sandbox=off, tls/ssl=off] [21:01:56] : [Step 4/5] [2021-11-19 21:01:56,178][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][MaintenanceProcessor] Resolved store directory for node persistent data: /opt/buildagent/work/7bc1c54bc719b67c/work/clusterbaselinenodesmetricsselftest/testBaselineNodes/internal_ClusterBaselineNodesMetricsSelfTest2 [21:01:56] : [Step 4/5] [2021-11-19 21:01:56,181][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][CacheObjectBinaryProcessorImpl] Resolved directory for serialized binary metadata: /opt/buildagent/work/7bc1c54bc719b67c/work/db/binary_meta/internal_ClusterBaselineNodesMetricsSelfTest2 [21:01:56] : [Step 4/5] [2021-11-19 21:01:56,196][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/clusterbaselinenodesmetricsselftest/testBaselineNodes/internal_ClusterBaselineNodesMetricsSelfTest2 [21:01:56] : [Step 4/5] [2021-11-19 21:01:56,197][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][FileWriteAheadLogManager] Resolved write ahead log work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/clusterbaselinenodesmetricsselftest/testBaselineNodes/wal/internal_ClusterBaselineNodesMetricsSelfTest2 [21:01:56] : [Step 4/5] [2021-11-19 21:01:56,198][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][FileWriteAheadLogManager] Resolved write ahead log archive directory: /opt/buildagent/work/7bc1c54bc719b67c/work/clusterbaselinenodesmetricsselftest/testBaselineNodes/archive/internal_ClusterBaselineNodesMetricsSelfTest2 [21:01:57] : [Step 4/5] [2021-11-19 21:01:57,249][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/clusterbaselinenodesmetricsselftest/testBaselineNodes/wal/internal_ClusterBaselineNodesMetricsSelfTest2/0000000000000000.wal [21:01:57] : [Step 4/5] [2021-11-19 21:01:57,250][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][FileHandleManagerImpl] Initialized write-ahead log manager [mode=LOG_ONLY] [21:01:57] : [Step 4/5] [2021-11-19 21:01:57,261][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][GridCacheDatabaseSharedManager] Configured data regions initialized successfully [total=5] [21:01:57] : [Step 4/5] [2021-11-19 21:01:57,272][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][IgniteSnapshotManager] Resolved snapshot work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/snapshots [21:01:57] : [Step 4/5] [2021-11-19 21:01:57,273][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][IgniteSnapshotManager] Resolved temp directory for snapshot creation: /opt/buildagent/work/7bc1c54bc719b67c/work/clusterbaselinenodesmetricsselftest/testBaselineNodes/internal_ClusterBaselineNodesMetricsSelfTest2/snp [21:01:57] : [Step 4/5] [2021-11-19 21:01:57,280][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][ClientListenerProcessor] Client connector processor has started on TCP port 10802 [21:01:57] : [Step 4/5] [2021-11-19 21:01:57,297][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][ClusterBaselineNodesMetricsSelfTest2] Non-loopback local IPs: 172.17.0.4 [21:01:57] : [Step 4/5] [2021-11-19 21:01:57,298][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][ClusterBaselineNodesMetricsSelfTest2] Enabled local MACs: 0242AC110004 [21:01:57] : [Step 4/5] [2021-11-19 21:01:57,299][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:01:57] : [Step 4/5] [2021-11-19 21:01:57,302][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:01:57] : [Step 4/5] [2021-11-19 21:01:57,303][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:01:57] : [Step 4/5] [2021-11-19 21:01:57,317][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][GridCacheDatabaseSharedManager] Applying lost metastore updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:01:57] : [Step 4/5] [2021-11-19 21:01:57,324][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=11 ms] [21:01:57] : [Step 4/5] [2021-11-19 21:01:57,325][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][GridCacheProcessor] Restoring partition state for local groups. [21:01:57] : [Step 4/5] [2021-11-19 21:01:57,325][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=0, partitionsProcessed=0, time=0ms] [21:01:57] : [Step 4/5] [2021-11-19 21:01:57,327][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][GridEncryptionManager] Encryption keys loaded from metastore. [grps=, masterKeyName=null] [21:01:57] : [Step 4/5] [2021-11-19 21:01:57,334][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][ClusterProcessor] Cluster ID and tag has been read from metastorage: null [21:01:57] : [Step 4/5] [2021-11-19 21:01:57,334][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][IgniteClusterImpl] Shutdown policy was updated [oldVal=null, newVal=null] [21:01:57] : [Step 4/5] [2021-11-19 21:01:57,335][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][GridCacheDatabaseSharedManager] Checkpoint frequency deviation changed [oldVal=null, newVal=null] [21:01:57] : [Step 4/5] [2021-11-19 21:01:57,345][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][FilePageStoreManager] Cleanup cache stores [total=1, left=0, cleanFiles=false] [21:01:57] : [Step 4/5] [2021-11-19 21:01:57,351][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:01:57] : [Step 4/5] [2021-11-19 21:01:57,353][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:01:57] : [Step 4/5] [2021-11-19 21:01:57,356][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:01:57] : [Step 4/5] [2021-11-19 21:01:57,357][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][GridCacheDatabaseSharedManager] Data Regions Started: 5 [21:01:57] : [Step 4/5] [2021-11-19 21:01:57,359][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][GridCacheDatabaseSharedManager] ^-- sysMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:01:57] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:01:57] : [Step 4/5] ^-- default region [type=default, persistence=true, lazyAlloc=true, [21:01:57] : [Step 4/5] ... initCfg=256MB, maxCfg=2048MB, usedRam=0MB, freeRam=100%, allocRam=0MB, allocTotal=0MB] [21:01:57] : [Step 4/5] ^-- metastoreMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:01:57] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:01:57] : [Step 4/5] ^-- TxLog region [type=internal, persistence=true, lazyAlloc=false, [21:01:57] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:01:57] : [Step 4/5] ^-- volatileDsMemPlc region [type=user, persistence=false, lazyAlloc=true, [21:01:57] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB] [21:01:57] : [Step 4/5] ^-- Ignite persistence [used=0MB] [21:01:57] : [Step 4/5] [21:01:57] : [Step 4/5] [2021-11-19 21:01:57,361][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][GridCacheDatabaseSharedManager] Starting binary memory restore for: [-2100569601] [21:01:57] : [Step 4/5] [2021-11-19 21:01:57,378][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:01:57] : [Step 4/5] [2021-11-19 21:01:57,378][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:01:57] : [Step 4/5] [2021-11-19 21:01:57,388][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/clusterbaselinenodesmetricsselftest/testBaselineNodes/wal/internal_ClusterBaselineNodesMetricsSelfTest2/0000000000000000.wal, offset=0, ver=2] [21:01:57] : [Step 4/5] [2021-11-19 21:01:57,409][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][GridCacheProcessor] Started cache in recovery mode [name=ignite-sys-cache, id=-2100569601, dataRegionName=sysMemPlc, mode=REPLICATED, atomicity=TRANSACTIONAL, backups=2147483647, mvcc=false] [21:01:57] : [Step 4/5] [2021-11-19 21:01:57,411][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][GridCacheDatabaseSharedManager] Binary recovery performed in 50 ms. [21:01:57] : [Step 4/5] [2021-11-19 21:01:57,411][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:01:57] : [Step 4/5] [2021-11-19 21:01:57,412][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][GridCacheDatabaseSharedManager] Applying lost cache updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:01:57] : [Step 4/5] [2021-11-19 21:01:57,516][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=104 ms] [21:01:57] : [Step 4/5] [2021-11-19 21:01:57,516][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][GridCacheProcessor] Restoring partition state for local groups. [21:01:57] : [Step 4/5] [2021-11-19 21:01:57,566][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=1, partitionsProcessed=100, time=54ms] [21:01:58] : [Step 4/5] [2021-11-19 21:01:58,311][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][TestTcpDiscoverySpi] Successfully bound to TCP port [port=47502, localHost=localhost/127.0.0.1, locNodeId=f054f218-1e85-4528-9e50-191c6f500002] [21:01:58] : [Step 4/5] [2021-11-19 21:01:58,319][INFO ][tcp-disco-srvr-[:47501]-#65%internal.ClusterBaselineNodesMetricsSelfTest1%-#1353%internal.ClusterBaselineNodesMetricsSelfTest1%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=58325] [21:01:58] : [Step 4/5] [2021-11-19 21:01:58,320][INFO ][tcp-disco-srvr-[:47501]-#65%internal.ClusterBaselineNodesMetricsSelfTest1%-#1353%internal.ClusterBaselineNodesMetricsSelfTest1%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=58325] [21:01:58] : [Step 4/5] [2021-11-19 21:01:58,336][INFO ][tcp-disco-sock-reader-[]-#75%internal.ClusterBaselineNodesMetricsSelfTest1%-#1504%internal.ClusterBaselineNodesMetricsSelfTest1%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:58325, rmtPort=58325] [21:01:58] : [Step 4/5] [2021-11-19 21:01:58,339][INFO ][tcp-disco-sock-reader-[f054f218 127.0.0.1:58325]-#75%internal.ClusterBaselineNodesMetricsSelfTest1%-#1504%internal.ClusterBaselineNodesMetricsSelfTest1%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=f054f218-1e85-4528-9e50-191c6f500002, rmtAddr=/127.0.0.1:58325] [21:01:58] : [Step 4/5] [2021-11-19 21:01:58,343][INFO ][tcp-disco-srvr-[:47502]-#74%internal.ClusterBaselineNodesMetricsSelfTest2%-#1503%internal.ClusterBaselineNodesMetricsSelfTest2%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=38199] [21:01:58] : [Step 4/5] [2021-11-19 21:01:58,344][INFO ][tcp-disco-srvr-[:47502]-#74%internal.ClusterBaselineNodesMetricsSelfTest2%-#1503%internal.ClusterBaselineNodesMetricsSelfTest2%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=38199] [21:01:58] : [Step 4/5] [2021-11-19 21:01:58,345][INFO ][tcp-disco-sock-reader-[]-#76%internal.ClusterBaselineNodesMetricsSelfTest2%-#1505%internal.ClusterBaselineNodesMetricsSelfTest2%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:38199, rmtPort=38199] [21:01:58] : [Step 4/5] [2021-11-19 21:01:58,346][INFO ][tcp-disco-sock-reader-[]-#76%internal.ClusterBaselineNodesMetricsSelfTest2%-#1505%internal.ClusterBaselineNodesMetricsSelfTest2%][TestTcpDiscoverySpi] Received ping request from the remote node [rmtNodeId=5ff14d92-b955-4988-af16-a71774900001, rmtAddr=/127.0.0.1:38199, rmtPort=38199] [21:01:58] : [Step 4/5] [2021-11-19 21:01:58,348][INFO ][tcp-disco-sock-reader-[]-#76%internal.ClusterBaselineNodesMetricsSelfTest2%-#1505%internal.ClusterBaselineNodesMetricsSelfTest2%][TestTcpDiscoverySpi] Finished writing ping response [rmtNodeId=5ff14d92-b955-4988-af16-a71774900001, rmtAddr=/127.0.0.1:38199, rmtPort=38199] [21:01:58] : [Step 4/5] [2021-11-19 21:01:58,348][INFO ][tcp-disco-sock-reader-[]-#76%internal.ClusterBaselineNodesMetricsSelfTest2%-#1505%internal.ClusterBaselineNodesMetricsSelfTest2%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:38199, rmtPort=38199, rmtNodeId=null] [21:01:58] : [Step 4/5] [2021-11-19 21:01:58,350][INFO ][tcp-disco-sock-reader-[f054f218 127.0.0.1:58325]-#75%internal.ClusterBaselineNodesMetricsSelfTest1%-#1504%internal.ClusterBaselineNodesMetricsSelfTest1%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:58325, rmtPort=58325, rmtNodeId=f054f218-1e85-4528-9e50-191c6f500002] [21:01:58] : [Step 4/5] [2021-11-19 21:01:58,362][INFO ][tcp-disco-msg-worker-[5ff14d92 127.0.0.1:47501 crd]-#59%internal.ClusterBaselineNodesMetricsSelfTest0%-#1233%internal.ClusterBaselineNodesMetricsSelfTest0%][GridEncryptionManager] Joining node doesn't have stored group keys [node=f054f218-1e85-4528-9e50-191c6f500002] [21:01:58] : [Step 4/5] [2021-11-19 21:01:58,387][INFO ][tcp-disco-msg-worker-[4f8845b3 127.0.0.1:47500]-#64%internal.ClusterBaselineNodesMetricsSelfTest1%-#1352%internal.ClusterBaselineNodesMetricsSelfTest1%][TestTcpDiscoverySpi] New next node [newNext=TcpDiscoveryNode [id=f054f218-1e85-4528-9e50-191c6f500002, consistentId=internal.ClusterBaselineNodesMetricsSelfTest2, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47502], discPort=47502, order=0, intOrder=3, lastExchangeTime=1637344918381, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false]] [21:01:58] : [Step 4/5] [2021-11-19 21:01:58,389][INFO ][tcp-disco-srvr-[:47502]-#74%internal.ClusterBaselineNodesMetricsSelfTest2%-#1503%internal.ClusterBaselineNodesMetricsSelfTest2%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=60417] [21:01:58] : [Step 4/5] [2021-11-19 21:01:58,390][INFO ][tcp-disco-srvr-[:47502]-#74%internal.ClusterBaselineNodesMetricsSelfTest2%-#1503%internal.ClusterBaselineNodesMetricsSelfTest2%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=60417] [21:01:58] : [Step 4/5] [2021-11-19 21:01:58,390][INFO ][tcp-disco-sock-reader-[5ff14d92 127.0.0.1:59833]-#69%internal.ClusterBaselineNodesMetricsSelfTest0%-#1357%internal.ClusterBaselineNodesMetricsSelfTest0%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:59833, rmtPort=59833, rmtNodeId=5ff14d92-b955-4988-af16-a71774900001] [21:01:58] : [Step 4/5] [2021-11-19 21:01:58,394][INFO ][tcp-disco-sock-reader-[]-#77%internal.ClusterBaselineNodesMetricsSelfTest2%-#1506%internal.ClusterBaselineNodesMetricsSelfTest2%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:60417, rmtPort=60417] [21:01:58] : [Step 4/5] [2021-11-19 21:01:58,399][INFO ][tcp-disco-sock-reader-[5ff14d92 127.0.0.1:60417]-#77%internal.ClusterBaselineNodesMetricsSelfTest2%-#1506%internal.ClusterBaselineNodesMetricsSelfTest2%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=5ff14d92-b955-4988-af16-a71774900001, rmtAddr=/127.0.0.1:60417] [21:01:58] : [Step 4/5] [2021-11-19 21:01:58,405][INFO ][tcp-disco-msg-worker-[]-#73%internal.ClusterBaselineNodesMetricsSelfTest2%-#1502%internal.ClusterBaselineNodesMetricsSelfTest2%][TestTcpDiscoverySpi] New next node [newNext=TcpDiscoveryNode [id=4f8845b3-7744-4ec1-9404-43c3d1f00000, consistentId=internal.ClusterBaselineNodesMetricsSelfTest0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637344918402, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false]] [21:01:58] : [Step 4/5] [2021-11-19 21:01:58,406][INFO ][tcp-disco-srvr-[:47500]-#60%internal.ClusterBaselineNodesMetricsSelfTest0%-#1234%internal.ClusterBaselineNodesMetricsSelfTest0%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=36355] [21:01:58] : [Step 4/5] [2021-11-19 21:01:58,407][INFO ][tcp-disco-srvr-[:47500]-#60%internal.ClusterBaselineNodesMetricsSelfTest0%-#1234%internal.ClusterBaselineNodesMetricsSelfTest0%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=36355] [21:01:58] : [Step 4/5] [2021-11-19 21:01:58,419][INFO ][tcp-disco-sock-reader-[]-#78%internal.ClusterBaselineNodesMetricsSelfTest0%-#1507%internal.ClusterBaselineNodesMetricsSelfTest0%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:36355, rmtPort=36355] [21:01:58] : [Step 4/5] [2021-11-19 21:01:58,423][INFO ][tcp-disco-sock-reader-[f054f218 127.0.0.1:36355]-#78%internal.ClusterBaselineNodesMetricsSelfTest0%-#1507%internal.ClusterBaselineNodesMetricsSelfTest0%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=f054f218-1e85-4528-9e50-191c6f500002, rmtAddr=/127.0.0.1:36355] [21:01:58] : [Step 4/5] [2021-11-19 21:01:58,430][INFO ][disco-event-worker-#1359%internal.ClusterBaselineNodesMetricsSelfTest1%][GridDiscoveryManager] Added new node to topology: TcpDiscoveryNode [id=f054f218-1e85-4528-9e50-191c6f500002, consistentId=internal.ClusterBaselineNodesMetricsSelfTest2, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47502], discPort=47502, order=3, intOrder=3, lastExchangeTime=1637344918381, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false] [21:01:58] : [Step 4/5] [2021-11-19 21:01:58,432][INFO ][disco-event-worker-#1359%internal.ClusterBaselineNodesMetricsSelfTest1%][GridDiscoveryManager] Topology snapshot [ver=3, locNode=5ff14d92, servers=3, clients=0, state=ACTIVE, CPUs=24, offheap=2.0GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=4f8845b3-7744-4ec1-9404-43c3d1f00000, consistentId=internal.ClusterBaselineNodesMetricsSelfTest0, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=5ff14d92-b955-4988-af16-a71774900001, consistentId=internal.ClusterBaselineNodesMetricsSelfTest1, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=f054f218-1e85-4528-9e50-191c6f500002, consistentId=internal.ClusterBaselineNodesMetricsSelfTest2, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:01:58] : [Step 4/5] [2021-11-19 21:01:58,432][INFO ][disco-event-worker-#1236%internal.ClusterBaselineNodesMetricsSelfTest0%][GridDiscoveryManager] Added new node to topology: TcpDiscoveryNode [id=f054f218-1e85-4528-9e50-191c6f500002, consistentId=internal.ClusterBaselineNodesMetricsSelfTest2, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47502], discPort=47502, order=3, intOrder=3, lastExchangeTime=1637344918350, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false] [21:01:58] : [Step 4/5] [2021-11-19 21:01:58,436][INFO ][disco-event-worker-#1236%internal.ClusterBaselineNodesMetricsSelfTest0%][GridDiscoveryManager] Topology snapshot [ver=3, locNode=4f8845b3, servers=3, clients=0, state=ACTIVE, CPUs=24, offheap=2.0GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=4f8845b3-7744-4ec1-9404-43c3d1f00000, consistentId=internal.ClusterBaselineNodesMetricsSelfTest0, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=5ff14d92-b955-4988-af16-a71774900001, consistentId=internal.ClusterBaselineNodesMetricsSelfTest1, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=f054f218-1e85-4528-9e50-191c6f500002, consistentId=internal.ClusterBaselineNodesMetricsSelfTest2, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:01:58] : [Step 4/5] [2021-11-19 21:01:58,438][INFO ][disco-event-worker-#1236%internal.ClusterBaselineNodesMetricsSelfTest0%][GridDiscoveryManager] ^-- Baseline [id=0, size=2, online=2, offline=0] [21:01:58] : [Step 4/5] [2021-11-19 21:01:58,433][INFO ][disco-event-worker-#1359%internal.ClusterBaselineNodesMetricsSelfTest1%][GridDiscoveryManager] ^-- Baseline [id=0, size=2, online=2, offline=0] [21:01:58] : [Step 4/5] [2021-11-19 21:01:58,440][INFO ][exchange-worker-#1360%internal.ClusterBaselineNodesMetricsSelfTest1%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], crd=false, evt=NODE_JOINED, evtNode=f054f218-1e85-4528-9e50-191c6f500002, customEvt=null, allowMerge=true, exchangeFreeSwitch=false] [21:01:58] : [Step 4/5] [2021-11-19 21:01:58,441][INFO ][exchange-worker-#1360%internal.ClusterBaselineNodesMetricsSelfTest1%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], waitTime=0ms, futInfo=NA, mode=DISTRIBUTED] [21:01:58] : [Step 4/5] [2021-11-19 21:01:58,443][INFO ][exchange-worker-#1237%internal.ClusterBaselineNodesMetricsSelfTest0%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], crd=true, evt=NODE_JOINED, evtNode=f054f218-1e85-4528-9e50-191c6f500002, customEvt=null, allowMerge=true, exchangeFreeSwitch=false] [21:01:58] : [Step 4/5] [2021-11-19 21:01:58,443][INFO ][tcp-disco-msg-worker-[4f8845b3 127.0.0.1:47500]-#73%internal.ClusterBaselineNodesMetricsSelfTest2%-#1502%internal.ClusterBaselineNodesMetricsSelfTest2%][ClusterProcessor] affectionate_sanderson [21:01:58] : [Step 4/5] [2021-11-19 21:01:58,444][INFO ][tcp-disco-msg-worker-[4f8845b3 127.0.0.1:47500]-#73%internal.ClusterBaselineNodesMetricsSelfTest2%-#1502%internal.ClusterBaselineNodesMetricsSelfTest2%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustEnabled' was changed from 'null' to 'false' [21:01:58] : [Step 4/5] [2021-11-19 21:01:58,445][INFO ][tcp-disco-msg-worker-[4f8845b3 127.0.0.1:47500]-#73%internal.ClusterBaselineNodesMetricsSelfTest2%-#1502%internal.ClusterBaselineNodesMetricsSelfTest2%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustTimeout' was changed from 'null' to '300000' [21:01:58] : [Step 4/5] [2021-11-19 21:01:58,446][INFO ][tcp-disco-msg-worker-[4f8845b3 127.0.0.1:47500]-#73%internal.ClusterBaselineNodesMetricsSelfTest2%-#1502%internal.ClusterBaselineNodesMetricsSelfTest2%][IgniteTxManager] Transactions parameter 'longOperationsDumpTimeout' was changed from 'null' to '60000' [21:01:58] : [Step 4/5] [2021-11-19 21:01:58,446][INFO ][exchange-worker-#1237%internal.ClusterBaselineNodesMetricsSelfTest0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], waitTime=0ms, futInfo=NA, mode=DISTRIBUTED] [21:01:58] : [Step 4/5] [2021-11-19 21:01:58,447][INFO ][tcp-disco-msg-worker-[4f8845b3 127.0.0.1:47500]-#73%internal.ClusterBaselineNodesMetricsSelfTest2%-#1502%internal.ClusterBaselineNodesMetricsSelfTest2%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpThreshold' was changed from 'null' to '0' [21:01:58] : [Step 4/5] [2021-11-19 21:01:58,448][INFO ][exchange-worker-#1237%internal.ClusterBaselineNodesMetricsSelfTest0%][GridDhtPartitionsExchangeFuture] Finished waiting for partitions release latch: ServerLatch [permits=0, pendingAcks=HashSet [], super=CompletableLatch [id=CompletableLatchUid [id=exchange, topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0]]]] [21:01:58] : [Step 4/5] [2021-11-19 21:01:58,449][INFO ][exchange-worker-#1237%internal.ClusterBaselineNodesMetricsSelfTest0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:01:58] : [Step 4/5] [2021-11-19 21:01:58,450][INFO ][exchange-worker-#1237%internal.ClusterBaselineNodesMetricsSelfTest0%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], crd=true] [21:01:58] : [Step 4/5] [2021-11-19 21:01:58,451][INFO ][tcp-disco-msg-worker-[4f8845b3 127.0.0.1:47500]-#73%internal.ClusterBaselineNodesMetricsSelfTest2%-#1502%internal.ClusterBaselineNodesMetricsSelfTest2%][IgniteTxManager] Transactions parameter 'transactionTimeDumpSamplesCoefficient' was changed from 'null' to '0.0' [21:01:58] : [Step 4/5] [2021-11-19 21:01:58,451][INFO ][tcp-disco-msg-worker-[4f8845b3 127.0.0.1:47500]-#73%internal.ClusterBaselineNodesMetricsSelfTest2%-#1502%internal.ClusterBaselineNodesMetricsSelfTest2%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpSamplesPerSecondLimit' was changed from 'null' to '5' [21:01:58] : [Step 4/5] [2021-11-19 21:01:58,452][INFO ][exchange-worker-#1360%internal.ClusterBaselineNodesMetricsSelfTest1%][GridDhtPartitionsExchangeFuture] Finished waiting for partitions release latch: ClientLatch [coordinator=TcpDiscoveryNode [id=4f8845b3-7744-4ec1-9404-43c3d1f00000, consistentId=internal.ClusterBaselineNodesMetricsSelfTest0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637344915514, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], ackSent=true, super=CompletableLatch [id=CompletableLatchUid [id=exchange, topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0]]]] [21:01:58] : [Step 4/5] [2021-11-19 21:01:58,454][INFO ][exchange-worker-#1360%internal.ClusterBaselineNodesMetricsSelfTest1%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:01:58] : [Step 4/5] [2021-11-19 21:01:58,452][INFO ][tcp-disco-msg-worker-[4f8845b3 127.0.0.1:47500]-#73%internal.ClusterBaselineNodesMetricsSelfTest2%-#1502%internal.ClusterBaselineNodesMetricsSelfTest2%][IgniteTxManager] Transactions parameter 'collisionsDumpInterval' was changed from 'null' to '1000' [21:01:58] : [Step 4/5] [2021-11-19 21:01:58,456][INFO ][tcp-disco-msg-worker-[4f8845b3 127.0.0.1:47500]-#73%internal.ClusterBaselineNodesMetricsSelfTest2%-#1502%internal.ClusterBaselineNodesMetricsSelfTest2%][IgniteTxManager] Transactions parameter 'txOwnerDumpRequestsAllowed' was changed from 'null' to 'true' [21:01:58] : [Step 4/5] [2021-11-19 21:01:58,457][INFO ][tcp-disco-msg-worker-[4f8845b3 127.0.0.1:47500]-#73%internal.ClusterBaselineNodesMetricsSelfTest2%-#1502%internal.ClusterBaselineNodesMetricsSelfTest2%][GridCacheDatabaseSharedManager] Historical rebalance WAL threshold changed [property=historical.rebalance.threshold, oldVal=null, newVal=500] [21:01:58] : [Step 4/5] [2021-11-19 21:01:58,457][INFO ][exchange-worker-#1360%internal.ClusterBaselineNodesMetricsSelfTest1%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], crd=false] [21:01:58] : [Step 4/5] [2021-11-19 21:01:58,459][INFO ][disco-notifier-worker-#1501%internal.ClusterBaselineNodesMetricsSelfTest2%][MvccProcessorImpl] Assigned mvcc coordinator [crd=MvccCoordinator [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], nodeId=4f8845b3-7744-4ec1-9404-43c3d1f00000, ver=1637344913679, local=false, initialized=false]] [21:01:58]W: [org.apache.ignite:ignite-core] [2021-11-19 21:01:58,460][WARN ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][ClusterBaselineNodesMetricsSelfTest2] Nodes started on local machine require more than 80% of physical RAM what can lead to significant slowdown due to swapping (please decrease JVM heap size, data region size or checkpoint buffer size) [required=13816MB, available=15360MB] [21:01:58] : [Step 4/5] [2021-11-19 21:01:58,461][INFO ][disco-notifier-worker-#1501%internal.ClusterBaselineNodesMetricsSelfTest2%][GridClusterStateProcessor] Local node is not included in Baseline Topology and will not be used for data storage. Use control.(sh|bat) script or IgniteCluster interface to include the node to Baseline Topology. [21:01:58] : [Step 4/5] [2021-11-19 21:01:58,461][INFO ][sys-#1214%internal.ClusterBaselineNodesMetricsSelfTest0%][GridDhtPartitionsExchangeFuture] Coordinator received single message [ver=AffinityTopologyVersion [topVer=3, minorTopVer=0], node=5ff14d92-b955-4988-af16-a71774900001, remainingNodes=1, allReceived=false] [21:01:58] : [Step 4/5] [2021-11-19 21:01:58,468][INFO ][sys-#1478%internal.ClusterBaselineNodesMetricsSelfTest2%][ClusterProcessor] Writing cluster ID and tag to metastorage on ready for write ClusterIdAndTag [id=aeea33f2-f76a-4ae8-9c30-3b901d5f028f, tag=affectionate_sanderson] [21:01:58] : [Step 4/5] [2021-11-19 21:01:58,492][INFO ][exchange-worker-#1510%internal.ClusterBaselineNodesMetricsSelfTest2%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], crd=false, evt=NODE_JOINED, evtNode=f054f218-1e85-4528-9e50-191c6f500002, customEvt=null, allowMerge=true, exchangeFreeSwitch=false] [21:01:58] : [Step 4/5] [2021-11-19 21:01:58,495][INFO ][exchange-worker-#1510%internal.ClusterBaselineNodesMetricsSelfTest2%][GridCacheProcessor] Stopped cache [cacheName=ignite-sys-cache] [21:01:58] : [Step 4/5] [2021-11-19 21:01:58,497][INFO ][exchange-worker-#1510%internal.ClusterBaselineNodesMetricsSelfTest2%][GridCacheDatabaseSharedManager] Page memory sysMemPlc for CacheGroupDescriptor [grpId=-2100569601, grpName=null, startTopVer=null, rcvdFrom=4f8845b3-7744-4ec1-9404-43c3d1f00000, deploymentId=fe1ac593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, caches=SingletonMap {ignite-sys-cache=-2100569601}, rcvdFromVer=null, persistenceEnabled=true, walEnabled=true, cacheCfgEnrichment=CacheConfigurationEnrichment [fieldClassNames=HashMap {storeFactory=null, storeSesLsnrs=null, evictFilter=null, interceptor=null, evictPlcFactory=null}], cacheCfgEnriched=false, cacheName=ignite-sys-cache] has invalidated. [21:01:58] : [Step 4/5] [2021-11-19 21:01:58,503][INFO ][exchange-worker-#1510%internal.ClusterBaselineNodesMetricsSelfTest2%][FilePageStoreManager] Cache stores cleanup started asynchronously [21:01:58] : [Step 4/5] [2021-11-19 21:01:58,503][INFO ][exchange-worker-#1510%internal.ClusterBaselineNodesMetricsSelfTest2%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/clusterbaselinenodesmetricsselftest/testBaselineNodes/internal_ClusterBaselineNodesMetricsSelfTest2 [21:01:59] : [Step 4/5] [2021-11-19 21:01:59,340][INFO ][async-file-store-cleanup-task-0-#1511%internal.ClusterBaselineNodesMetricsSelfTest2%][FilePageStoreManager] Cleanup cache stores [total=2, left=1, cleanFiles=true] [21:01:59] : [Step 4/5] [2021-11-19 21:01:59,342][INFO ][exchange-worker-#1510%internal.ClusterBaselineNodesMetricsSelfTest2%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/clusterbaselinenodesmetricsselftest/testBaselineNodes/wal/internal_ClusterBaselineNodesMetricsSelfTest2/0000000000000000.wal, offset=8795, ver=2] [21:01:59] : [Step 4/5] [2021-11-19 21:01:59,345][INFO ][exchange-worker-#1510%internal.ClusterBaselineNodesMetricsSelfTest2%][GridClusterStateProcessor] Writing BaselineTopology[id=0] [21:01:59] : [Step 4/5] [2021-11-19 21:01:59,353][INFO ][exchange-worker-#1510%internal.ClusterBaselineNodesMetricsSelfTest2%][GridCacheDatabaseSharedManager] Finish recovery performed in 848 ms. [21:01:59] : [Step 4/5] [2021-11-19 21:01:59,354][INFO ][exchange-worker-#1510%internal.ClusterBaselineNodesMetricsSelfTest2%][msg] Components activation performed in 851 ms. [21:01:59] : [Step 4/5] [2021-11-19 21:01:59,376][INFO ][exchange-worker-#1510%internal.ClusterBaselineNodesMetricsSelfTest2%][GridCacheProcessor] Started cache [name=ignite-sys-cache, id=-2100569601, dataRegionName=sysMemPlc, mode=REPLICATED, atomicity=TRANSACTIONAL, backups=2147483647, mvcc=false] [21:01:59] : [Step 4/5] [2021-11-19 21:01:59,377][INFO ][exchange-worker-#1510%internal.ClusterBaselineNodesMetricsSelfTest2%][GridCacheProcessor] Starting caches on local join performed in 21 ms. [21:01:59] : [Step 4/5] [2021-11-19 21:01:59,378][INFO ][exchange-worker-#1510%internal.ClusterBaselineNodesMetricsSelfTest2%][GridDhtPartitionsExchangeFuture] Skipped waiting for partitions release future (local node is joining) [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0]] [21:01:59] : [Step 4/5] [2021-11-19 21:01:59,400][INFO ][grid-nio-worker-tcp-comm-1-#1176%TcpCommunicationSpi%][TcpCommunicationSpi] Accepted incoming communication connection [locAddr=/127.0.0.1:45020, rmtAddr=/127.0.0.1:47170] [21:01:59] : [Step 4/5] [2021-11-19 21:01:59,400][INFO ][db-checkpoint-thread-#1516%internal.ClusterBaselineNodesMetricsSelfTest2%][Checkpointer] Checkpoint started [checkpointId=f08ec852-007a-4df9-b3b0-4a1946436c4e, startPtr=WALPointer [idx=0, fileOff=83817, len=63], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=12ms, checkpointLockHoldTime=12ms, walCpRecordFsyncDuration=2ms, writeCheckpointEntryDuration=2ms, splitAndSortCpPagesDuration=0ms, pages=17, reason='node started'] [21:01:59] : [Step 4/5] [2021-11-19 21:01:59,420][INFO ][grid-nio-worker-tcp-comm-0-#1444%TcpCommunicationSpi%][TcpCommunicationSpi] Established outgoing communication connection [locAddr=/127.0.0.1:47170, rmtAddr=/127.0.0.1:45020] [21:01:59] : [Step 4/5] [2021-11-19 21:01:59,421][INFO ][exchange-worker-#1510%internal.ClusterBaselineNodesMetricsSelfTest2%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], crd=false] [21:01:59] : [Step 4/5] [2021-11-19 21:01:59,422][INFO ][sys-#1208%internal.ClusterBaselineNodesMetricsSelfTest0%][GridDhtPartitionsExchangeFuture] Coordinator received single message [ver=AffinityTopologyVersion [topVer=3, minorTopVer=0], node=f054f218-1e85-4528-9e50-191c6f500002, allReceived=true] [21:01:59] : [Step 4/5] [2021-11-19 21:01:59,422][INFO ][sys-#1208%internal.ClusterBaselineNodesMetricsSelfTest0%][GridDhtPartitionsExchangeFuture] Coordinator received all messages, try merge [ver=AffinityTopologyVersion [topVer=3, minorTopVer=0]] [21:01:59] : [Step 4/5] [2021-11-19 21:01:59,423][INFO ][sys-#1208%internal.ClusterBaselineNodesMetricsSelfTest0%][GridDhtPartitionsExchangeFuture] finishExchangeOnCoordinator [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=0]] [21:01:59] : [Step 4/5] [2021-11-19 21:01:59,428][INFO ][sys-#1208%internal.ClusterBaselineNodesMetricsSelfTest0%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], err=null, rebalanced=true, wasRebalanced=true] [21:01:59] : [Step 4/5] [2021-11-19 21:01:59,429][INFO ][sys-#1347%internal.ClusterBaselineNodesMetricsSelfTest1%][GridDhtPartitionsExchangeFuture] Received full message, will finish exchange [node=4f8845b3-7744-4ec1-9404-43c3d1f00000, resVer=AffinityTopologyVersion [topVer=3, minorTopVer=0]] [21:01:59] : [Step 4/5] [2021-11-19 21:01:59,429][INFO ][exchange-worker-#1237%internal.ClusterBaselineNodesMetricsSelfTest0%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=3, minorTopVer=0], force=false, evt=NODE_JOINED, node=f054f218-1e85-4528-9e50-191c6f500002] [21:01:59] : [Step 4/5] [2021-11-19 21:01:59,430][INFO ][sys-#1481%internal.ClusterBaselineNodesMetricsSelfTest2%][GridDhtPartitionsExchangeFuture] Received full message, will finish exchange [node=4f8845b3-7744-4ec1-9404-43c3d1f00000, resVer=AffinityTopologyVersion [topVer=3, minorTopVer=0]] [21:01:59] : [Step 4/5] [2021-11-19 21:01:59,430][INFO ][sys-#1208%internal.ClusterBaselineNodesMetricsSelfTest0%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=4f8845b3-7744-4ec1-9404-43c3d1f00000, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], evt=NODE_JOINED, evtNode=TcpDiscoveryNode [id=f054f218-1e85-4528-9e50-191c6f500002, consistentId=internal.ClusterBaselineNodesMetricsSelfTest2, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47502], discPort=47502, order=3, intOrder=3, lastExchangeTime=1637344918350, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0]] [21:01:59] : [Step 4/5] [2021-11-19 21:01:59,431][INFO ][sys-#1347%internal.ClusterBaselineNodesMetricsSelfTest1%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], err=null, rebalanced=true, wasRebalanced=true] [21:01:59] : [Step 4/5] [2021-11-19 21:01:59,432][INFO ][sys-#1208%internal.ClusterBaselineNodesMetricsSelfTest0%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (0 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (3 ms), stage="Wait partitions release latch [latch=exchange]" (1 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="After states restored callback" (0 ms), stage="WAL history reservation" (0 ms), stage="Waiting for all single messages" (972 ms), stage="Exchanges merge" (0 ms), stage="Affinity recalculation (crd)" (1 ms), stage="Collect update counters and create affinity messages" (0 ms), stage="Assign partitions states" (0 ms), stage="Validate partitions states" (0 ms), stage="Apply update counters" (0 ms), stage="Full message preparing" (1 ms), stage="Full message sending" (0 ms), stage="Exchange done" (3 ms), stage="Total time" (981 ms), Discovery lag=22 ms, Latest started node id=f054f218-1e85-4528-9e50-191c6f500002] [21:01:59] : [Step 4/5] [2021-11-19 21:01:59,433][INFO ][exchange-worker-#1360%internal.ClusterBaselineNodesMetricsSelfTest1%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=3, minorTopVer=0], force=false, evt=NODE_JOINED, node=f054f218-1e85-4528-9e50-191c6f500002] [21:01:59] : [Step 4/5] [2021-11-19 21:01:59,433][INFO ][sys-#1347%internal.ClusterBaselineNodesMetricsSelfTest1%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=5ff14d92-b955-4988-af16-a71774900001, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], evt=NODE_JOINED, evtNode=TcpDiscoveryNode [id=f054f218-1e85-4528-9e50-191c6f500002, consistentId=internal.ClusterBaselineNodesMetricsSelfTest2, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47502], discPort=47502, order=3, intOrder=3, lastExchangeTime=1637344918381, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0]] [21:01:59] : [Step 4/5] [2021-11-19 21:01:59,434][INFO ][sys-#1208%internal.ClusterBaselineNodesMetricsSelfTest0%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], stage="Affinity initialization (node join) [grp=ignite-sys-cache, crd=true]" (1 ms) (parent=Affinity recalculation (crd))] [21:01:59] : [Step 4/5] [2021-11-19 21:01:59,436][INFO ][sys-#1347%internal.ClusterBaselineNodesMetricsSelfTest1%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (0 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (1 ms), stage="Wait partitions release latch [latch=exchange]" (11 ms), stage="Wait partitions release [latch=exchange]" (1 ms), stage="After states restored callback" (0 ms), stage="WAL history reservation" (0 ms), stage="Waiting for Full message" (973 ms), stage="Affinity recalculation" (1 ms), stage="Full map updating" (0 ms), stage="Exchange done" (4 ms), stage="Total time" (991 ms)] [21:01:59] : [Step 4/5] [2021-11-19 21:01:59,438][INFO ][sys-#1347%internal.ClusterBaselineNodesMetricsSelfTest1%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], stage="Affinity initialization (node join) [grp=ignite-sys-cache, crd=false]" (1 ms) (parent=Affinity recalculation)] [21:01:59] : [Step 4/5] [2021-11-19 21:01:59,443][INFO ][sys-#1481%internal.ClusterBaselineNodesMetricsSelfTest2%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], err=null, rebalanced=true, wasRebalanced=false] [21:01:59] : [Step 4/5] [2021-11-19 21:01:59,445][INFO ][sys-#1481%internal.ClusterBaselineNodesMetricsSelfTest2%][GridCacheProcessor] Finish proxy initialization, cacheName=ignite-sys-cache, localNodeId=f054f218-1e85-4528-9e50-191c6f500002 [21:01:59] : [Step 4/5] [2021-11-19 21:01:59,446][INFO ][sys-#1481%internal.ClusterBaselineNodesMetricsSelfTest2%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=f054f218-1e85-4528-9e50-191c6f500002, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], evt=NODE_JOINED, evtNode=TcpDiscoveryNode [id=f054f218-1e85-4528-9e50-191c6f500002, consistentId=internal.ClusterBaselineNodesMetricsSelfTest2, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47502], discPort=47502, order=3, intOrder=3, lastExchangeTime=1637344919225, loc=true, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0]] [21:01:59] : [Step 4/5] [2021-11-19 21:01:59,446][INFO ][exchange-worker-#1510%internal.ClusterBaselineNodesMetricsSelfTest2%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=3, minorTopVer=0], force=false, evt=NODE_JOINED, node=f054f218-1e85-4528-9e50-191c6f500002] [21:01:59] : [Step 4/5] [2021-11-19 21:01:59,447][INFO ][sys-#1481%internal.ClusterBaselineNodesMetricsSelfTest2%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], stage="Waiting in exchange queue" (31 ms), stage="Exchange parameters initialization" (0 ms), stage="Baseline change callback" (10 ms), stage="Components activation" (851 ms), stage="Determine exchange type" (23 ms), stage="Preloading notification" (0 ms), stage="Restore partition states" (4 ms), stage="After states restored callback" (13 ms), stage="WAL history reservation" (0 ms), stage="Waiting for Full message" (33 ms), stage="Affinity recalculation" (12 ms), stage="Full map updating" (0 ms), stage="Exchange done" (4 ms), stage="Total time" (981 ms)] [21:01:59] : [Step 4/5] [2021-11-19 21:01:59,450][INFO ][sys-#1481%internal.ClusterBaselineNodesMetricsSelfTest2%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], stage="Affinity fetch" (23 ms) (parent=Determine exchange type), stage="Restore partition states [grp=ignite-sys-cache]" (4 ms) (parent=Restore partition states), stage="Affinity initialization (local join) [grp=ignite-sys-cache]" (12 ms) (parent=Affinity recalculation)] [21:01:59] : [Step 4/5] [2021-11-19 21:01:59,457][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][ClusterBaselineNodesMetricsSelfTest2] To start Console Management & Monitoring run ignitevisorcmd.{sh|bat} [21:01:59] : [Step 4/5] [2021-11-19 21:01:59,459][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][ClusterBaselineNodesMetricsSelfTest2] [21:01:59] : [Step 4/5] [21:01:59] : [Step 4/5] >>> +-------------------------------------------+ [21:01:59] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:01:59] : [Step 4/5] >>> +-------------------------------------------+ [21:01:59] : [Step 4/5] >>> OS name: Linux 4.15.0-151-generic amd64 [21:01:59] : [Step 4/5] >>> CPU(s): 24 [21:01:59] : [Step 4/5] >>> Heap: 2.0GB [21:01:59] : [Step 4/5] >>> VM name: 16724@c4dfe9a430b2 [21:01:59] : [Step 4/5] >>> Ignite instance name: internal.ClusterBaselineNodesMetricsSelfTest2 [21:01:59] : [Step 4/5] >>> Local node [ID=F054F218-1E85-4528-9E50-191C6F500002, order=3, clientMode=false] [21:01:59] : [Step 4/5] >>> Local node addresses: [127.0.0.1] [21:01:59] : [Step 4/5] >>> Local ports: TCP:10802 TCP:45022 TCP:47502 [21:01:59] : [Step 4/5] [21:01:59] : [Step 4/5] [2021-11-19 21:01:59,461][INFO ][db-checkpoint-thread-#1516%internal.ClusterBaselineNodesMetricsSelfTest2%][Checkpointer] Checkpoint finished [cpId=f08ec852-007a-4df9-b3b0-4a1946436c4e, pages=17, markPos=WALPointer [idx=0, fileOff=83817, len=63], walSegmentsCovered=[], markDuration=17ms, pagesWrite=41ms, fsync=19ms, total=78ms] [21:01:59] : [Step 4/5] [2021-11-19 21:01:59,461][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][GridDiscoveryManager] Topology snapshot [ver=3, locNode=f054f218, servers=3, clients=0, state=ACTIVE, CPUs=24, offheap=2.0GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=4f8845b3-7744-4ec1-9404-43c3d1f00000, consistentId=internal.ClusterBaselineNodesMetricsSelfTest0, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=5ff14d92-b955-4988-af16-a71774900001, consistentId=internal.ClusterBaselineNodesMetricsSelfTest1, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=f054f218-1e85-4528-9e50-191c6f500002, consistentId=internal.ClusterBaselineNodesMetricsSelfTest2, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:01:59] : [Step 4/5] [2021-11-19 21:01:59,463][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][GridDiscoveryManager] ^-- Baseline [id=0, size=2, online=2, offline=0] [21:01:59] : [Step 4/5] [2021-11-19 21:01:59,464][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][G] Node started : [stage="Configure system pool" (0 ms),stage="Start managers" (215 ms),stage="Configure binary metadata" (4 ms),stage="Start processors" (1111 ms),stage="Start 'StanByClusterTestProvider' plugin" (0 ms),stage="Start 'PageMemory tracker plugin' plugin" (0 ms),stage="Start 'TestDistibutedConfigurationPlugin' plugin" (0 ms),stage="Start 'NodeValidationPluginProvider' plugin" (0 ms),stage="Init metastore" (48 ms),stage="Init and start regions" (15 ms),stage="Restore binary memory" (50 ms),stage="Restore logical state" (156 ms),stage="Finish recovery" (740 ms),stage="Join topology" (150 ms),stage="Await transition" (6 ms),stage="Await exchange" (997 ms),stage="Total time" (3492 ms)] [21:01:59] : [Step 4/5] [2021-11-19 21:01:59,466][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][root] Node started with the following configuration [id=f054f218-1e85-4528-9e50-191c6f500002, marshaller=BinaryMarshaller [], discovery=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=5000, ackTimeout=5000, marsh=JdkMarshaller [clsFilter=org.apache.ignite.marshaller.MarshallerUtils$1@41a466a2], reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], binaryCfg=null, lateAff=true] [21:01:59]W: [org.apache.ignite:ignite-core] [2021-11-19 21:01:59,476][WARN ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][G] Ignite work directory is not provided, automatically resolved to: /opt/buildagent/work/7bc1c54bc719b67c/work [21:01:59] : [Step 4/5] [2021-11-19 21:01:59,477][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][ClusterBaselineNodesMetricsSelfTest3] [21:01:59] : [Step 4/5] [21:01:59] : [Step 4/5] >>> __________ ________________ [21:01:59] : [Step 4/5] >>> / _/ ___/ |/ / _/_ __/ __/ [21:01:59] : [Step 4/5] >>> _/ // (7 7 // / / / / _/ [21:01:59] : [Step 4/5] >>> /___/\___/_/|_/___/ /_/ /___/ [21:01:59] : [Step 4/5] >>> [21:01:59] : [Step 4/5] >>> ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:01:59] : [Step 4/5] >>> 2021 Copyright(C) Apache Software Foundation [21:01:59] : [Step 4/5] >>> [21:01:59] : [Step 4/5] >>> Ignite documentation: http://ignite.apache.org [21:01:59] : [Step 4/5] [21:01:59] : [Step 4/5] [2021-11-19 21:01:59,478][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][ClusterBaselineNodesMetricsSelfTest3] Config URL: n/a [21:01:59] : [Step 4/5] [2021-11-19 21:01:59,479][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][ClusterBaselineNodesMetricsSelfTest3] IgniteConfiguration [igniteInstanceName=internal.ClusterBaselineNodesMetricsSelfTest3, pubPoolSize=24, svcPoolSize=24, callbackPoolSize=24, stripedPoolSize=24, sysPoolSize=24, mgmtPoolSize=4, dataStreamerPoolSize=24, utilityCachePoolSize=24, utilityCacheKeepAliveTime=60000, p2pPoolSize=2, qryPoolSize=24, buildIdxPoolSize=4, igniteHome=/opt/buildagent/work/7bc1c54bc719b67c, igniteWorkDir=/opt/buildagent/work/7bc1c54bc719b67c/work, mbeanSrv=com.sun.jmx.mbeanserver.JmxMBeanServer@6fe85038, nodeId=a3cd6747-87a1-4b63-a114-5ba56c600003, marsh=BinaryMarshaller [], marshLocJobs=false, daemon=false, p2pEnabled=true, netTimeout=10000, netCompressionLevel=1, sndRetryDelay=1000, sndRetryCnt=3, metricsHistSize=10000, metricsUpdateFreq=1000, metricsExpTime=9223372036854775807, discoSpi=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=0, ackTimeout=0, marsh=null, reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], segPlc=STOP, segResolveAttempts=2, waitForSegOnStart=true, allResolversPassReq=true, segChkFreq=10000, commSpi=TcpCommunicationSpi [connectGate=org.apache.ignite.spi.communication.tcp.internal.ConnectGateway@1636e5d6, ctxInitLatch=java.util.concurrent.CountDownLatch@633b9179[Count = 1], stopping=false, clientPool=null, nioSrvWrapper=null, stateProvider=null], evtSpi=MemoryEventStorageSpi [expireAgeMs=9223372036854775807, expireCnt=10000, filter=null], colSpi=NoopCollisionSpi [], deploySpi=LocalDeploymentSpi [], indexingSpi=org.apache.ignite.spi.indexing.noop.NoopIndexingSpi@55c6862c, addrRslvr=null, encryptionSpi=org.apache.ignite.spi.encryption.noop.NoopEncryptionSpi@7e56f23c, tracingSpi=org.apache.ignite.spi.tracing.NoopTracingSpi@34d9ceb8, clientMode=true, rebalanceThreadPoolSize=4, rebalanceTimeout=10000, rebalanceBatchesPrefetchCnt=3, rebalanceThrottle=0, rebalanceBatchSize=524288, txCfg=TransactionConfiguration [txSerEnabled=false, dfltIsolation=REPEATABLE_READ, dfltConcurrency=PESSIMISTIC, dfltTxTimeout=0, txTimeoutOnPartitionMapExchange=0, deadlockTimeout=10000, pessimisticTxLogSize=0, pessimisticTxLogLinger=10000, tmLookupClsName=null, txManagerFactory=null, useJtaSync=false], cacheSanityCheckEnabled=true, discoStartupDelay=60000, deployMode=SHARED, p2pMissedCacheSize=100, locHost=127.0.0.1, timeSrvPortBase=31100, timeSrvPortRange=100, failureDetectionTimeout=10000, sysWorkerBlockedTimeout=null, clientFailureDetectionTimeout=10000, metricsLogFreq=0, connectorCfg=null, odbcCfg=null, warmupClos=null, atomicCfg=AtomicConfiguration [seqReserveSize=1000, cacheMode=PARTITIONED, backups=1, aff=null, grpName=null], classLdr=null, sslCtxFactory=null, platformCfg=null, binaryCfg=null, memCfg=null, pstCfg=null, dsCfg=DataStorageConfiguration [sysRegionInitSize=41943040, sysRegionMaxSize=104857600, pageSize=0, concLvl=0, dfltDataRegConf=DataRegionConfiguration [name=default, maxSize=2147483648, initSize=268435456, swapPath=null, pageEvictionMode=DISABLED, pageReplacementMode=CLOCK, evictionThreshold=0.9, emptyPagesPoolSize=100, metricsEnabled=false, metricsSubIntervalCount=5, metricsRateTimeInterval=60000, persistenceEnabled=true, checkpointPageBufSize=0, lazyMemoryAllocation=true, warmUpCfg=null], dataRegions=null, storagePath=clusterbaselinenodesmetricsselftest/testBaselineNodes, checkpointFreq=180000, lockWaitTime=10000, checkpointThreads=4, checkpointWriteOrder=SEQUENTIAL, walHistSize=20, maxWalArchiveSize=1073741824, walSegments=10, walSegmentSize=67108864, walPath=clusterbaselinenodesmetricsselftest/testBaselineNodes/wal, walArchivePath=clusterbaselinenodesmetricsselftest/testBaselineNodes/archive, cdcWalPath=db/wal/cdc, cdcEnabled=false, metricsEnabled=false, walMode=LOG_ONLY, walTlbSize=131072, walBuffSize=0, walFlushFreq=2000, walFsyncDelay=1000, walRecordIterBuffSize=67108864, alwaysWriteFullPages=false, fileIOFactory=org.apache.ignite.internal.processors.cache.persistence.file.AsyncFileIOFactory@4a2ac486, metricsSubIntervalCnt=5, metricsRateTimeInterval=60000, walAutoArchiveAfterInactivity=-1, walForceArchiveTimeout=-1, writeThrottlingEnabled=false, walCompactionEnabled=false, walCompactionLevel=1, checkpointReadLockTimeout=null, walPageCompression=DISABLED, walPageCompressionLevel=null, dfltWarmUpCfg=null, encCfg=org.apache.ignite.configuration.EncryptionConfiguration@1cdbea24, defragmentationThreadPoolSize=4, minWalArchiveSize=-1], snapshotPath=snapshots, activeOnStart=true, activeOnStartPropSetFlag=false, autoActivation=true, autoActivationPropSetFlag=false, clusterStateOnStart=null, sqlConnCfg=null, cliConnCfg=ClientConnectorConfiguration [host=null, port=10800, portRange=100, sockSndBufSize=0, sockRcvBufSize=0, tcpNoDelay=true, maxOpenCursorsPerConn=128, threadPoolSize=24, selectorCnt=12, idleTimeout=0, handshakeTimeout=10000, jdbcEnabled=true, odbcEnabled=true, thinCliEnabled=true, sslEnabled=false, useIgniteSslCtxFactory=true, sslClientAuth=false, sslCtxFactory=null, thinCliCfg=ThinClientConfiguration [maxActiveTxPerConn=100, maxActiveComputeTasksPerConn=0]], mvccVacuumThreadCnt=2, mvccVacuumFreq=5000, authEnabled=false, failureHnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]], commFailureRslvr=null, sqlCfg=SqlConfiguration [longQryWarnTimeout=3000, dfltQryTimeout=0, sqlQryHistSize=1000, validationEnabled=false], asyncContinuationExecutor=null] [21:01:59] : [Step 4/5] [2021-11-19 21:01:59,491][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][ClusterBaselineNodesMetricsSelfTest3] Daemon mode: off [21:01:59] : [Step 4/5] [2021-11-19 21:01:59,491][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][ClusterBaselineNodesMetricsSelfTest3] OS: Linux 4.15.0-151-generic amd64 [21:01:59] : [Step 4/5] [2021-11-19 21:01:59,492][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][ClusterBaselineNodesMetricsSelfTest3] OS user: teamcity [21:01:59] : [Step 4/5] [2021-11-19 21:01:59,492][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][ClusterBaselineNodesMetricsSelfTest3] PID: 16724 [21:01:59] : [Step 4/5] [2021-11-19 21:01:59,493][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][ClusterBaselineNodesMetricsSelfTest3] Language runtime: Java Platform API Specification ver. 1.8 [21:01:59] : [Step 4/5] [2021-11-19 21:01:59,493][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][ClusterBaselineNodesMetricsSelfTest3] VM information: Java(TM) SE Runtime Environment 1.8.0_261-b12 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 25.261-b12 [21:01:59] : [Step 4/5] [2021-11-19 21:01:59,495][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][ClusterBaselineNodesMetricsSelfTest3] VM total memory: 1.9GB [21:01:59] : [Step 4/5] [2021-11-19 21:01:59,496][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][ClusterBaselineNodesMetricsSelfTest3] Remote Management [restart: off, REST: off, JMX (remote: off)] [21:01:59] : [Step 4/5] [2021-11-19 21:01:59,496][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][ClusterBaselineNodesMetricsSelfTest3] Logger: GridTestLog4jLogger [quiet=false, config=null] [21:01:59] : [Step 4/5] [2021-11-19 21:01:59,497][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][ClusterBaselineNodesMetricsSelfTest3] IGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c [21:01:59] : [Step 4/5] [2021-11-19 21:01:59,497][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][ClusterBaselineNodesMetricsSelfTest3] VM arguments: [-DIGNITE_DUMP_THREADS_ON_FAILURE=false, -DMono=/usr/bin/mono-sgen, -DMono4.0_x64=/usr/lib/mono/4.0, -DMono4.5_x64=/usr/lib/mono/4.5, -DMonoVersion=6.12.0.90, -DSKIP_BUILD=false, -Dagent.home.dir=/opt/buildagent, -Dagent.name=aitc-lin02_03, -Dagent.ownPort=9090, -Dagent.work.dir=/opt/buildagent/work, -Dbuild.number=95, -Dbuild.vcs.number=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.1=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.GitHubApacheIgnite=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dclassworlds.conf=/opt/buildagent/temp/buildTmp/teamcity.m2.conf, -Dcom.jetbrains.maven.watcher.report.file=/opt/buildagent/temp/buildTmp/maven-build-info.xml, -Djava.io.tmpdir=/opt/buildagent/temp/buildTmp, -Dmaven.home=/opt/buildagent/tools/maven3_6, -Dmaven.multiModuleProjectDirectory=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.agent.cpuBenchmark=457, -Dteamcity.agent.dotnet.agent_url=http://localhost:9090/RPC2, -Dteamcity.agent.dotnet.build_id=6278078, -Dteamcity.auth.password=*******, -Dteamcity.auth.userId=TeamCityBuildId=6278078, -Dteamcity.build.changedFiles.file=/opt/buildagent/temp/buildTmp/changedFiles6342607772318147725.txt, -Dteamcity.build.checkoutDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.build.id=6278078, -Dteamcity.build.properties.file=/opt/buildagent/temp/buildTmp/teamcity.build5164517880467851002.properties, -Dteamcity.build.tempDir=/opt/buildagent/temp/buildTmp, -Dteamcity.build.workingDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.buildConfName=Basic 3, -Dteamcity.buildType.id=IgniteTests24Java8_Basic3, -Dteamcity.configuration.properties.file=/opt/buildagent/temp/buildTmp/teamcity.config5591980786735343870.properties, -Dteamcity.maven.userSettings.path=/opt/buildagent/temp/buildTmp/maven_settings_585072866407032347.xml, -Dteamcity.maven.watcher.home=/opt/buildagent/plugins/mavenPlugin/maven-watcher-jdk16, -Dteamcity.projectName=Ignite Tests 2.x (JDK 8/11), -Dteamcity.runner.properties.file=/opt/buildagent/temp/buildTmp/teamcity.runner9098465561618137420.properties, -Dteamcity.tests.recentlyFailedTests.file=/opt/buildagent/temp/buildTmp/testsToRunFirst3891775683130404069.txt, -Dteamcity.version=2021.2 (build 99542), -ea, -Xms2g, -Xmx2g, -XX:+HeapDumpOnOutOfMemoryError, -DIGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_TEST_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_UPDATE_NOTIFIER=false, -DIGNITE_NO_DISCO_ORDER=true, -DIGNITE_PERFORMANCE_SUGGESTIONS_DISABLED=true, -Djava.net.preferIPv4Stack=true, -DTEST_SCALE_FACTOR=1.0, -DIGNITE_TEST_PROP_LOG4J_FILE=log4j-tc-test.xml, -DIGNITE_QUIET=false, -DIGNITE_MARSHAL_BUFFERS_RECHECK=1000, -Dmaven.repo.local=/opt/buildagent/.m2/repository] [21:01:59] : [Step 4/5] [2021-11-19 21:01:59,503][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][ClusterBaselineNodesMetricsSelfTest3] System cache's DataRegion size is configured to 40 MB. Use DataStorageConfiguration.systemRegionInitialSize property to change the setting. [21:01:59] : [Step 4/5] [2021-11-19 21:01:59,504][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][ClusterBaselineNodesMetricsSelfTest3] Configured caches [in 'sysMemPlc' dataRegion: ['ignite-sys-cache']] [21:01:59]W: [org.apache.ignite:ignite-core] [2021-11-19 21:01:59,504][WARN ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][ClusterBaselineNodesMetricsSelfTest3] Peer class loading is enabled (disable it in production for performance and deployment consistency reasons) [21:01:59] : [Step 4/5] [2021-11-19 21:01:59,505][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][ClusterBaselineNodesMetricsSelfTest3] 3-rd party licenses can be found at: /opt/buildagent/work/7bc1c54bc719b67c/libs/licenses [21:01:59] : [Step 4/5] [2021-11-19 21:01:59,512][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][IgnitePluginProcessor] Configured plugins: [21:01:59] : [Step 4/5] [2021-11-19 21:01:59,512][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][IgnitePluginProcessor] ^-- StanByClusterTestProvider 1.0 [21:01:59] : [Step 4/5] [2021-11-19 21:01:59,513][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][IgnitePluginProcessor] ^-- null [21:01:59] : [Step 4/5] [2021-11-19 21:01:59,513][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][IgnitePluginProcessor] [21:01:59] : [Step 4/5] [2021-11-19 21:01:59,513][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][IgnitePluginProcessor] ^-- PageMemory tracker plugin 1.0 [21:01:59] : [Step 4/5] [2021-11-19 21:01:59,514][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][IgnitePluginProcessor] ^-- null [21:01:59] : [Step 4/5] [2021-11-19 21:01:59,514][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][IgnitePluginProcessor] [21:01:59] : [Step 4/5] [2021-11-19 21:01:59,514][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][IgnitePluginProcessor] ^-- TestDistibutedConfigurationPlugin 1.0 [21:01:59] : [Step 4/5] [2021-11-19 21:01:59,515][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][IgnitePluginProcessor] ^-- null [21:01:59] : [Step 4/5] [2021-11-19 21:01:59,515][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][IgnitePluginProcessor] [21:01:59] : [Step 4/5] [2021-11-19 21:01:59,515][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][IgnitePluginProcessor] ^-- NodeValidationPluginProvider 1.0 [21:01:59] : [Step 4/5] [2021-11-19 21:01:59,515][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][IgnitePluginProcessor] ^-- null [21:01:59] : [Step 4/5] [2021-11-19 21:01:59,516][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][IgnitePluginProcessor] [21:01:59] : [Step 4/5] [2021-11-19 21:01:59,516][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][FailureProcessor] Configured failure handler: [hnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]]] [21:01:59] : [Step 4/5] [2021-11-19 21:01:59,545][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][TcpCommunicationSpi] Successfully bound communication NIO server to TCP port [port=45023, locHost=/127.0.0.1, selectorsCnt=12, selectorSpins=0, pairedConn=false] [21:01:59]W: [org.apache.ignite:ignite-core] [2021-11-19 21:01:59,546][WARN ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][TcpCommunicationSpi] Message queue limit is set to 0 which may lead to potential OOMEs when running cache operations in FULL_ASYNC or PRIMARY_SYNC modes due to message queues growth on sender and receiver sides. [21:01:59] : [Step 4/5] [2021-11-19 21:01:59,555][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][GridCollisionManager] Collision resolution is disabled (all jobs will be activated upon arrival). [21:01:59] : [Step 4/5] [2021-11-19 21:01:59,556][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][ClusterBaselineNodesMetricsSelfTest3] Security status [authentication=off, sandbox=off, tls/ssl=off] [21:01:59]W: [org.apache.ignite:ignite-core] [2021-11-19 21:01:59,562][WARN ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][GridCacheProcessor] Persistent Store is not supported on client nodes (Persistent Store's configuration will be ignored). [21:01:59] : [Step 4/5] [2021-11-19 21:01:59,570][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][IgniteCacheDatabaseSharedManager] Configured data regions initialized successfully [total=4] [21:01:59] : [Step 4/5] [2021-11-19 21:01:59,574][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][ClientListenerProcessor] Client connector processor has started on TCP port 10803 [21:01:59] : [Step 4/5] [2021-11-19 21:01:59,581][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][ClusterBaselineNodesMetricsSelfTest3] Non-loopback local IPs: 172.17.0.4 [21:01:59] : [Step 4/5] [2021-11-19 21:01:59,581][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][ClusterBaselineNodesMetricsSelfTest3] Enabled local MACs: 0242AC110004 [21:01:59] : [Step 4/5] [2021-11-19 21:01:59,582][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][ClusterProcessor] Cluster ID and tag has been read from metastorage: null [21:01:59] : [Step 4/5] [2021-11-19 21:01:59,583][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][IgniteClusterImpl] Shutdown policy was updated [oldVal=null, newVal=null] [21:01:59] : [Step 4/5] [2021-11-19 21:01:59,594][INFO ][tcp-disco-srvr-[:47500]-#60%internal.ClusterBaselineNodesMetricsSelfTest0%-#1234%internal.ClusterBaselineNodesMetricsSelfTest0%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=43809] [21:01:59] : [Step 4/5] [2021-11-19 21:01:59,594][INFO ][tcp-disco-srvr-[:47500]-#60%internal.ClusterBaselineNodesMetricsSelfTest0%-#1234%internal.ClusterBaselineNodesMetricsSelfTest0%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=43809] [21:01:59] : [Step 4/5] [2021-11-19 21:01:59,598][INFO ][tcp-disco-sock-reader-[]-#85%internal.ClusterBaselineNodesMetricsSelfTest0%-#1616%internal.ClusterBaselineNodesMetricsSelfTest0%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:43809, rmtPort=43809] [21:01:59] : [Step 4/5] [2021-11-19 21:01:59,602][INFO ][tcp-disco-sock-reader-[a3cd6747 127.0.0.1:43809 client]-#85%internal.ClusterBaselineNodesMetricsSelfTest0%-#1616%internal.ClusterBaselineNodesMetricsSelfTest0%][TestTcpDiscoverySpi] Initialized connection with remote client node [nodeId=a3cd6747-87a1-4b63-a114-5ba56c600003, rmtAddr=/127.0.0.1:43809] [21:01:59] : [Step 4/5] [2021-11-19 21:01:59,634][INFO ][disco-event-worker-#1236%internal.ClusterBaselineNodesMetricsSelfTest0%][GridDiscoveryManager] Added new node to topology: TcpDiscoveryNode [id=a3cd6747-87a1-4b63-a114-5ba56c600003, consistentId=internal.ClusterBaselineNodesMetricsSelfTest3, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:0], discPort=0, order=4, intOrder=4, lastExchangeTime=1637344919604, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=true] [21:01:59] : [Step 4/5] [2021-11-19 21:01:59,635][INFO ][tcp-client-disco-msg-worker-#84%internal.ClusterBaselineNodesMetricsSelfTest3%-#1614%internal.ClusterBaselineNodesMetricsSelfTest3%][TestTcpDiscoverySpi] Router node: TcpDiscoveryNode [id=4f8845b3-7744-4ec1-9404-43c3d1f00000, consistentId=internal.ClusterBaselineNodesMetricsSelfTest0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637344919624, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false] [21:01:59] : [Step 4/5] [2021-11-19 21:01:59,636][INFO ][disco-event-worker-#1359%internal.ClusterBaselineNodesMetricsSelfTest1%][GridDiscoveryManager] Added new node to topology: TcpDiscoveryNode [id=a3cd6747-87a1-4b63-a114-5ba56c600003, consistentId=internal.ClusterBaselineNodesMetricsSelfTest3, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:0], discPort=0, order=4, intOrder=4, lastExchangeTime=1637344919614, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=true] [21:01:59] : [Step 4/5] [2021-11-19 21:01:59,636][INFO ][disco-event-worker-#1236%internal.ClusterBaselineNodesMetricsSelfTest0%][GridDiscoveryManager] Topology snapshot [ver=4, locNode=4f8845b3, servers=3, clients=1, state=ACTIVE, CPUs=24, offheap=2.0GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=4f8845b3-7744-4ec1-9404-43c3d1f00000, consistentId=internal.ClusterBaselineNodesMetricsSelfTest0, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=5ff14d92-b955-4988-af16-a71774900001, consistentId=internal.ClusterBaselineNodesMetricsSelfTest1, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=f054f218-1e85-4528-9e50-191c6f500002, consistentId=internal.ClusterBaselineNodesMetricsSelfTest2, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=a3cd6747-87a1-4b63-a114-5ba56c600003, consistentId=internal.ClusterBaselineNodesMetricsSelfTest3, isClient=true, ver=2.13.0#20211119-sha1:00000000]]] [21:01:59] : [Step 4/5] [2021-11-19 21:01:59,638][INFO ][disco-event-worker-#1509%internal.ClusterBaselineNodesMetricsSelfTest2%][GridDiscoveryManager] Added new node to topology: TcpDiscoveryNode [id=a3cd6747-87a1-4b63-a114-5ba56c600003, consistentId=internal.ClusterBaselineNodesMetricsSelfTest3, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:0], discPort=0, order=4, intOrder=4, lastExchangeTime=1637344919624, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=true] [21:01:59] : [Step 4/5] [2021-11-19 21:01:59,638][INFO ][disco-event-worker-#1359%internal.ClusterBaselineNodesMetricsSelfTest1%][GridDiscoveryManager] Topology snapshot [ver=4, locNode=5ff14d92, servers=3, clients=1, state=ACTIVE, CPUs=24, offheap=2.0GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=4f8845b3-7744-4ec1-9404-43c3d1f00000, consistentId=internal.ClusterBaselineNodesMetricsSelfTest0, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=5ff14d92-b955-4988-af16-a71774900001, consistentId=internal.ClusterBaselineNodesMetricsSelfTest1, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=f054f218-1e85-4528-9e50-191c6f500002, consistentId=internal.ClusterBaselineNodesMetricsSelfTest2, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=a3cd6747-87a1-4b63-a114-5ba56c600003, consistentId=internal.ClusterBaselineNodesMetricsSelfTest3, isClient=true, ver=2.13.0#20211119-sha1:00000000]]] [21:01:59] : [Step 4/5] [2021-11-19 21:01:59,640][INFO ][disco-event-worker-#1509%internal.ClusterBaselineNodesMetricsSelfTest2%][GridDiscoveryManager] Topology snapshot [ver=4, locNode=f054f218, servers=3, clients=1, state=ACTIVE, CPUs=24, offheap=2.0GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=4f8845b3-7744-4ec1-9404-43c3d1f00000, consistentId=internal.ClusterBaselineNodesMetricsSelfTest0, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=5ff14d92-b955-4988-af16-a71774900001, consistentId=internal.ClusterBaselineNodesMetricsSelfTest1, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=f054f218-1e85-4528-9e50-191c6f500002, consistentId=internal.ClusterBaselineNodesMetricsSelfTest2, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=a3cd6747-87a1-4b63-a114-5ba56c600003, consistentId=internal.ClusterBaselineNodesMetricsSelfTest3, isClient=true, ver=2.13.0#20211119-sha1:00000000]]] [21:01:59] : [Step 4/5] [2021-11-19 21:01:59,639][INFO ][disco-event-worker-#1236%internal.ClusterBaselineNodesMetricsSelfTest0%][GridDiscoveryManager] ^-- Baseline [id=0, size=2, online=2, offline=0] [21:01:59] : [Step 4/5] [2021-11-19 21:01:59,643][INFO ][disco-event-worker-#1509%internal.ClusterBaselineNodesMetricsSelfTest2%][GridDiscoveryManager] ^-- Baseline [id=0, size=2, online=2, offline=0] [21:01:59] : [Step 4/5] [2021-11-19 21:01:59,643][INFO ][tcp-client-disco-msg-worker-#84%internal.ClusterBaselineNodesMetricsSelfTest3%-#1614%internal.ClusterBaselineNodesMetricsSelfTest3%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustEnabled' was changed from 'null' to 'false' [21:01:59] : [Step 4/5] [2021-11-19 21:01:59,642][INFO ][disco-event-worker-#1359%internal.ClusterBaselineNodesMetricsSelfTest1%][GridDiscoveryManager] ^-- Baseline [id=0, size=2, online=2, offline=0] [21:01:59] : [Step 4/5] [2021-11-19 21:01:59,645][INFO ][tcp-client-disco-msg-worker-#84%internal.ClusterBaselineNodesMetricsSelfTest3%-#1614%internal.ClusterBaselineNodesMetricsSelfTest3%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustTimeout' was changed from 'null' to '300000' [21:01:59] : [Step 4/5] [2021-11-19 21:01:59,644][INFO ][exchange-worker-#1510%internal.ClusterBaselineNodesMetricsSelfTest2%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], crd=false, evt=NODE_JOINED, evtNode=a3cd6747-87a1-4b63-a114-5ba56c600003, customEvt=null, allowMerge=true, exchangeFreeSwitch=false] [21:01:59] : [Step 4/5] [2021-11-19 21:01:59,644][INFO ][exchange-worker-#1237%internal.ClusterBaselineNodesMetricsSelfTest0%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], crd=true, evt=NODE_JOINED, evtNode=a3cd6747-87a1-4b63-a114-5ba56c600003, customEvt=null, allowMerge=true, exchangeFreeSwitch=false] [21:01:59] : [Step 4/5] [2021-11-19 21:01:59,645][INFO ][tcp-client-disco-msg-worker-#84%internal.ClusterBaselineNodesMetricsSelfTest3%-#1614%internal.ClusterBaselineNodesMetricsSelfTest3%][IgniteTxManager] Transactions parameter 'collisionsDumpInterval' was changed from 'null' to '1000' [21:01:59] : [Step 4/5] [2021-11-19 21:01:59,645][INFO ][exchange-worker-#1360%internal.ClusterBaselineNodesMetricsSelfTest1%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], crd=false, evt=NODE_JOINED, evtNode=a3cd6747-87a1-4b63-a114-5ba56c600003, customEvt=null, allowMerge=true, exchangeFreeSwitch=false] [21:01:59] : [Step 4/5] [2021-11-19 21:01:59,647][INFO ][tcp-client-disco-msg-worker-#84%internal.ClusterBaselineNodesMetricsSelfTest3%-#1614%internal.ClusterBaselineNodesMetricsSelfTest3%][IgniteTxManager] Transactions parameter 'longOperationsDumpTimeout' was changed from 'null' to '60000' [21:01:59] : [Step 4/5] [2021-11-19 21:01:59,647][INFO ][exchange-worker-#1510%internal.ClusterBaselineNodesMetricsSelfTest2%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], err=null, rebalanced=true, wasRebalanced=true] [21:01:59] : [Step 4/5] [2021-11-19 21:01:59,647][INFO ][exchange-worker-#1237%internal.ClusterBaselineNodesMetricsSelfTest0%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], err=null, rebalanced=true, wasRebalanced=true] [21:01:59] : [Step 4/5] [2021-11-19 21:01:59,649][INFO ][exchange-worker-#1510%internal.ClusterBaselineNodesMetricsSelfTest2%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=f054f218-1e85-4528-9e50-191c6f500002, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], evt=NODE_JOINED, evtNode=TcpDiscoveryNode [id=a3cd6747-87a1-4b63-a114-5ba56c600003, consistentId=internal.ClusterBaselineNodesMetricsSelfTest3, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:0], discPort=0, order=4, intOrder=4, lastExchangeTime=1637344919624, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=true], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0]] [21:01:59] : [Step 4/5] [2021-11-19 21:01:59,648][INFO ][tcp-client-disco-msg-worker-#84%internal.ClusterBaselineNodesMetricsSelfTest3%-#1614%internal.ClusterBaselineNodesMetricsSelfTest3%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpSamplesPerSecondLimit' was changed from 'null' to '5' [21:01:59] : [Step 4/5] [2021-11-19 21:01:59,648][INFO ][exchange-worker-#1360%internal.ClusterBaselineNodesMetricsSelfTest1%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], err=null, rebalanced=true, wasRebalanced=true] [21:01:59] : [Step 4/5] [2021-11-19 21:01:59,652][INFO ][tcp-client-disco-msg-worker-#84%internal.ClusterBaselineNodesMetricsSelfTest3%-#1614%internal.ClusterBaselineNodesMetricsSelfTest3%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpThreshold' was changed from 'null' to '0' [21:01:59] : [Step 4/5] [2021-11-19 21:01:59,651][INFO ][exchange-worker-#1510%internal.ClusterBaselineNodesMetricsSelfTest2%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (1 ms), stage="Determine exchange type" (0 ms), stage="Exchange done" (4 ms), stage="Total time" (5 ms)] [21:01:59] : [Step 4/5] [2021-11-19 21:01:59,654][INFO ][exchange-worker-#1510%internal.ClusterBaselineNodesMetricsSelfTest2%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=0]] [21:01:59] : [Step 4/5] [2021-11-19 21:01:59,650][INFO ][exchange-worker-#1237%internal.ClusterBaselineNodesMetricsSelfTest0%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=4f8845b3-7744-4ec1-9404-43c3d1f00000, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], evt=NODE_JOINED, evtNode=TcpDiscoveryNode [id=a3cd6747-87a1-4b63-a114-5ba56c600003, consistentId=internal.ClusterBaselineNodesMetricsSelfTest3, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:0], discPort=0, order=4, intOrder=4, lastExchangeTime=1637344919604, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=true], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0]] [21:01:59] : [Step 4/5] [2021-11-19 21:01:59,654][INFO ][exchange-worker-#1510%internal.ClusterBaselineNodesMetricsSelfTest2%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], crd=false] [21:01:59] : [Step 4/5] [2021-11-19 21:01:59,653][INFO ][tcp-client-disco-msg-worker-#84%internal.ClusterBaselineNodesMetricsSelfTest3%-#1614%internal.ClusterBaselineNodesMetricsSelfTest3%][IgniteTxManager] Transactions parameter 'transactionTimeDumpSamplesCoefficient' was changed from 'null' to '0.0' [21:01:59] : [Step 4/5] [2021-11-19 21:01:59,652][INFO ][exchange-worker-#1360%internal.ClusterBaselineNodesMetricsSelfTest1%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=5ff14d92-b955-4988-af16-a71774900001, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], evt=NODE_JOINED, evtNode=TcpDiscoveryNode [id=a3cd6747-87a1-4b63-a114-5ba56c600003, consistentId=internal.ClusterBaselineNodesMetricsSelfTest3, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:0], discPort=0, order=4, intOrder=4, lastExchangeTime=1637344919614, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=true], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0]] [21:01:59] : [Step 4/5] [2021-11-19 21:01:59,656][INFO ][tcp-client-disco-msg-worker-#84%internal.ClusterBaselineNodesMetricsSelfTest3%-#1614%internal.ClusterBaselineNodesMetricsSelfTest3%][IgniteTxManager] Transactions parameter 'txOwnerDumpRequestsAllowed' was changed from 'null' to 'true' [21:01:59] : [Step 4/5] [2021-11-19 21:01:59,656][INFO ][exchange-worker-#1510%internal.ClusterBaselineNodesMetricsSelfTest2%][GridCachePartitionExchangeManager] AffinityTopologyVersion [topVer=4, minorTopVer=0], evt=NODE_JOINED, evtNode=a3cd6747-87a1-4b63-a114-5ba56c600003, client=false] [21:01:59] : [Step 4/5] [2021-11-19 21:01:59,655][INFO ][exchange-worker-#1237%internal.ClusterBaselineNodesMetricsSelfTest0%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (1 ms), stage="Determine exchange type" (0 ms), stage="Exchange done" (8 ms), stage="Total time" (9 ms)] [21:01:59] : [Step 4/5] [2021-11-19 21:01:59,658][INFO ][tcp-client-disco-msg-worker-#84%internal.ClusterBaselineNodesMetricsSelfTest3%-#1614%internal.ClusterBaselineNodesMetricsSelfTest3%][ClusterProcessor] affectionate_sanderson [21:01:59] : [Step 4/5] [2021-11-19 21:01:59,657][INFO ][exchange-worker-#1360%internal.ClusterBaselineNodesMetricsSelfTest1%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (2 ms), stage="Determine exchange type" (0 ms), stage="Exchange done" (9 ms), stage="Total time" (11 ms)] [21:01:59] : [Step 4/5] [2021-11-19 21:01:59,660][INFO ][exchange-worker-#1360%internal.ClusterBaselineNodesMetricsSelfTest1%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=0]] [21:01:59] : [Step 4/5] [2021-11-19 21:01:59,661][INFO ][exchange-worker-#1360%internal.ClusterBaselineNodesMetricsSelfTest1%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], crd=false] [21:01:59] : [Step 4/5] [2021-11-19 21:01:59,659][INFO ][exchange-worker-#1237%internal.ClusterBaselineNodesMetricsSelfTest0%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=0]] [21:01:59] : [Step 4/5] [2021-11-19 21:01:59,661][INFO ][exchange-worker-#1237%internal.ClusterBaselineNodesMetricsSelfTest0%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], crd=true] [21:01:59] : [Step 4/5] [2021-11-19 21:01:59,661][INFO ][exchange-worker-#1360%internal.ClusterBaselineNodesMetricsSelfTest1%][GridCachePartitionExchangeManager] AffinityTopologyVersion [topVer=4, minorTopVer=0], evt=NODE_JOINED, evtNode=a3cd6747-87a1-4b63-a114-5ba56c600003, client=false] [21:01:59] : [Step 4/5] [2021-11-19 21:01:59,661][INFO ][disco-notifier-worker-#1611%internal.ClusterBaselineNodesMetricsSelfTest3%][MvccProcessorImpl] Assigned mvcc coordinator [crd=MvccCoordinator [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], nodeId=4f8845b3-7744-4ec1-9404-43c3d1f00000, ver=1637344913679, local=false, initialized=false]] [21:01:59] : [Step 4/5] [2021-11-19 21:01:59,662][INFO ][exchange-worker-#1237%internal.ClusterBaselineNodesMetricsSelfTest0%][GridCachePartitionExchangeManager] AffinityTopologyVersion [topVer=4, minorTopVer=0], evt=NODE_JOINED, evtNode=a3cd6747-87a1-4b63-a114-5ba56c600003, client=false] [21:01:59] : [Step 4/5] [2021-11-19 21:01:59,665][INFO ][sys-#1618%internal.ClusterBaselineNodesMetricsSelfTest3%][ClusterProcessor] Writing cluster ID and tag to metastorage on ready for write ClusterIdAndTag [id=aeea33f2-f76a-4ae8-9c30-3b901d5f028f, tag=affectionate_sanderson] [21:01:59]W: [org.apache.ignite:ignite-core] [2021-11-19 21:01:59,669][WARN ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][ClusterBaselineNodesMetricsSelfTest3] Nodes started on local machine require more than 80% of physical RAM what can lead to significant slowdown due to swapping (please decrease JVM heap size, data region size or checkpoint buffer size) [required=15762MB, available=15360MB] [21:01:59] : [Step 4/5] [2021-11-19 21:01:59,686][INFO ][exchange-worker-#1620%internal.ClusterBaselineNodesMetricsSelfTest3%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], crd=false, evt=NODE_JOINED, evtNode=a3cd6747-87a1-4b63-a114-5ba56c600003, customEvt=null, allowMerge=true, exchangeFreeSwitch=false] [21:01:59] : [Step 4/5] [2021-11-19 21:01:59,687][INFO ][exchange-worker-#1620%internal.ClusterBaselineNodesMetricsSelfTest3%][IgniteCacheDatabaseSharedManager] Data Regions Started: 4 [21:01:59] : [Step 4/5] [2021-11-19 21:01:59,688][INFO ][exchange-worker-#1620%internal.ClusterBaselineNodesMetricsSelfTest3%][IgniteCacheDatabaseSharedManager] ^-- sysMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:01:59] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB, allocTotal=0MB] [21:01:59] : [Step 4/5] ^-- default region [type=default, persistence=true, lazyAlloc=true, [21:01:59] : [Step 4/5] ... initCfg=256MB, maxCfg=2048MB, usedRam=0MB, freeRam=100%, allocRam=0MB, allocTotal=0MB] [21:01:59] : [Step 4/5] ^-- TxLog region [type=internal, persistence=true, lazyAlloc=false, [21:01:59] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB, allocTotal=0MB] [21:01:59] : [Step 4/5] ^-- volatileDsMemPlc region [type=user, persistence=false, lazyAlloc=true, [21:01:59] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB] [21:01:59] : [Step 4/5] ^-- Ignite persistence [used=0MB] [21:01:59] : [Step 4/5] [21:01:59] : [Step 4/5] [2021-11-19 21:01:59,690][INFO ][exchange-worker-#1620%internal.ClusterBaselineNodesMetricsSelfTest3%][msg] Components activation performed in 4 ms. [21:01:59] : [Step 4/5] [2021-11-19 21:01:59,693][INFO ][exchange-worker-#1620%internal.ClusterBaselineNodesMetricsSelfTest3%][GridCacheProcessor] Started cache [name=ignite-sys-cache, id=-2100569601, dataRegionName=sysMemPlc, mode=REPLICATED, atomicity=TRANSACTIONAL, backups=2147483647, mvcc=false] [21:01:59] : [Step 4/5] [2021-11-19 21:01:59,693][INFO ][exchange-worker-#1620%internal.ClusterBaselineNodesMetricsSelfTest3%][GridCacheProcessor] Starting caches on local join performed in 0 ms. [21:01:59] : [Step 4/5] [2021-11-19 21:01:59,694][INFO ][grid-nio-worker-tcp-comm-2-#1177%TcpCommunicationSpi%][TcpCommunicationSpi] Accepted incoming communication connection [locAddr=/127.0.0.1:45020, rmtAddr=/127.0.0.1:47182] [21:01:59] : [Step 4/5] [2021-11-19 21:01:59,696][INFO ][grid-nio-worker-tcp-comm-0-#1582%TcpCommunicationSpi%][TcpCommunicationSpi] Established outgoing communication connection [locAddr=/127.0.0.1:47182, rmtAddr=/127.0.0.1:45020] [21:01:59] : [Step 4/5] [2021-11-19 21:01:59,697][INFO ][exchange-worker-#1620%internal.ClusterBaselineNodesMetricsSelfTest3%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], crd=false] [21:01:59] : [Step 4/5] [2021-11-19 21:01:59,701][INFO ][sys-#1219%internal.ClusterBaselineNodesMetricsSelfTest0%][GridCachePartitionExchangeManager] Fast replied to single message [exchId=GridDhtPartitionExchangeId [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], discoEvt=null, nodeId=a3cd6747, evt=NODE_JOINED], nodeId=a3cd6747-87a1-4b63-a114-5ba56c600003] [21:01:59] : [Step 4/5] [2021-11-19 21:01:59,708][INFO ][sys-#1623%internal.ClusterBaselineNodesMetricsSelfTest3%][GridDhtPartitionsExchangeFuture] Received full message, will finish exchange [node=4f8845b3-7744-4ec1-9404-43c3d1f00000, resVer=AffinityTopologyVersion [topVer=4, minorTopVer=0]] [21:01:59] : [Step 4/5] [2021-11-19 21:01:59,712][INFO ][sys-#1623%internal.ClusterBaselineNodesMetricsSelfTest3%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], err=null, rebalanced=true, wasRebalanced=false] [21:01:59] : [Step 4/5] [2021-11-19 21:01:59,713][INFO ][sys-#1623%internal.ClusterBaselineNodesMetricsSelfTest3%][GridCacheProcessor] Finish proxy initialization, cacheName=ignite-sys-cache, localNodeId=a3cd6747-87a1-4b63-a114-5ba56c600003 [21:01:59] : [Step 4/5] [2021-11-19 21:01:59,714][INFO ][exchange-worker-#1620%internal.ClusterBaselineNodesMetricsSelfTest3%][GridCachePartitionExchangeManager] AffinityTopologyVersion [topVer=4, minorTopVer=0], evt=NODE_JOINED, evtNode=a3cd6747-87a1-4b63-a114-5ba56c600003, client=true] [21:01:59] : [Step 4/5] [2021-11-19 21:01:59,714][INFO ][sys-#1623%internal.ClusterBaselineNodesMetricsSelfTest3%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=a3cd6747-87a1-4b63-a114-5ba56c600003, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], evt=NODE_JOINED, evtNode=TcpDiscoveryNode [id=a3cd6747-87a1-4b63-a114-5ba56c600003, consistentId=internal.ClusterBaselineNodesMetricsSelfTest3, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:0], discPort=0, order=4, intOrder=0, lastExchangeTime=1637344919574, loc=true, ver=2.13.0#20211119-sha1:00000000, isClient=true], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0]] [21:01:59] : [Step 4/5] [2021-11-19 21:01:59,717][INFO ][sys-#1623%internal.ClusterBaselineNodesMetricsSelfTest3%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], stage="Waiting in exchange queue" (22 ms), stage="Exchange parameters initialization" (0 ms), stage="Components activation" (3 ms), stage="Determine exchange type" (3 ms), stage="Waiting for Full message" (13 ms), stage="Affinity recalculation" (2 ms), stage="Full map updating" (1 ms), stage="Exchange done" (4 ms), stage="Total time" (48 ms)] [21:01:59] : [Step 4/5] [2021-11-19 21:01:59,717][INFO ][sys-#1623%internal.ClusterBaselineNodesMetricsSelfTest3%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], stage="Affinity initialization (local join) [grp=ignite-sys-cache]" (2 ms) (parent=Affinity recalculation)] [21:01:59] : [Step 4/5] [2021-11-19 21:01:59,729][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][ClusterBaselineNodesMetricsSelfTest3] To start Console Management & Monitoring run ignitevisorcmd.{sh|bat} [21:01:59] : [Step 4/5] [2021-11-19 21:01:59,730][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][ClusterBaselineNodesMetricsSelfTest3] [21:01:59] : [Step 4/5] [21:01:59] : [Step 4/5] >>> +-------------------------------------------+ [21:01:59] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:01:59] : [Step 4/5] >>> +-------------------------------------------+ [21:01:59] : [Step 4/5] >>> OS name: Linux 4.15.0-151-generic amd64 [21:01:59] : [Step 4/5] >>> CPU(s): 24 [21:01:59] : [Step 4/5] >>> Heap: 2.0GB [21:01:59] : [Step 4/5] >>> VM name: 16724@c4dfe9a430b2 [21:01:59] : [Step 4/5] >>> Ignite instance name: internal.ClusterBaselineNodesMetricsSelfTest3 [21:01:59] : [Step 4/5] >>> Local node [ID=A3CD6747-87A1-4B63-A114-5BA56C600003, order=4, clientMode=true] [21:01:59] : [Step 4/5] >>> Local node addresses: [127.0.0.1] [21:01:59] : [Step 4/5] >>> Local ports: TCP:10803 TCP:45023 [21:01:59] : [Step 4/5] [21:01:59] : [Step 4/5] [2021-11-19 21:01:59,731][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][GridDiscoveryManager] Topology snapshot [ver=4, locNode=a3cd6747, servers=3, clients=1, state=ACTIVE, CPUs=24, offheap=2.0GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=a3cd6747-87a1-4b63-a114-5ba56c600003, consistentId=internal.ClusterBaselineNodesMetricsSelfTest3, isClient=true, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=4f8845b3-7744-4ec1-9404-43c3d1f00000, consistentId=internal.ClusterBaselineNodesMetricsSelfTest0, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=5ff14d92-b955-4988-af16-a71774900001, consistentId=internal.ClusterBaselineNodesMetricsSelfTest1, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=f054f218-1e85-4528-9e50-191c6f500002, consistentId=internal.ClusterBaselineNodesMetricsSelfTest2, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:01:59] : [Step 4/5] [2021-11-19 21:01:59,732][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][GridDiscoveryManager] ^-- Baseline [id=0, size=2, online=2, offline=0] [21:01:59] : [Step 4/5] [2021-11-19 21:01:59,733][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][G] Node started : [stage="Configure system pool" (0 ms),stage="Start managers" (81 ms),stage="Configure binary metadata" (2 ms),stage="Start processors" (19 ms),stage="Start 'StanByClusterTestProvider' plugin" (0 ms),stage="Start 'PageMemory tracker plugin' plugin" (0 ms),stage="Start 'TestDistibutedConfigurationPlugin' plugin" (0 ms),stage="Start 'NodeValidationPluginProvider' plugin" (0 ms),stage="Init metastore" (2 ms),stage="Finish recovery" (0 ms),stage="Join topology" (84 ms),stage="Await transition" (3 ms),stage="Await exchange" (61 ms),stage="Total time" (252 ms)] [21:01:59] : [Step 4/5] [2021-11-19 21:01:59,734][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][root] Node started with the following configuration [id=a3cd6747-87a1-4b63-a114-5ba56c600003, marshaller=BinaryMarshaller [], discovery=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=5000, ackTimeout=5000, marsh=JdkMarshaller [clsFilter=org.apache.ignite.marshaller.MarshallerUtils$1@68fbf47a], reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], binaryCfg=null, lateAff=true] [21:01:59] : [Step 4/5] [2021-11-19 21:01:59,735][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][root] >>> State #0: topology version = 4 [21:01:59] : [Step 4/5] [2021-11-19 21:01:59,737][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][root] >>> Stopping grid [name=internal.ClusterBaselineNodesMetricsSelfTest1, id=5ff14d92-b955-4988-af16-a71774900001] [21:01:59] : [Step 4/5] [2021-11-19 21:01:59,743][INFO ][db-checkpoint-thread-#1376%internal.ClusterBaselineNodesMetricsSelfTest1%][Checkpointer] Skipping checkpoint (no pages were modified) [checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=1ms, reason='timeout'] [21:01:59] : [Step 4/5] [2021-11-19 21:01:59,750][INFO ][tcp-disco-msg-worker-[5ff14d92 127.0.0.1:47501 crd]-#59%internal.ClusterBaselineNodesMetricsSelfTest0%-#1233%internal.ClusterBaselineNodesMetricsSelfTest0%][TestTcpDiscoverySpi] New next node [newNext=TcpDiscoveryNode [id=f054f218-1e85-4528-9e50-191c6f500002, consistentId=internal.ClusterBaselineNodesMetricsSelfTest2, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47502], discPort=47502, order=3, intOrder=3, lastExchangeTime=1637344918350, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false]] [21:01:59] : [Step 4/5] [2021-11-19 21:01:59,751][INFO ][disco-event-worker-#1619%internal.ClusterBaselineNodesMetricsSelfTest3%][GridDiscoveryManager] Node left topology: TcpDiscoveryNode [id=5ff14d92-b955-4988-af16-a71774900001, consistentId=internal.ClusterBaselineNodesMetricsSelfTest1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637344919624, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false] [21:01:59] : [Step 4/5] [2021-11-19 21:01:59,751][INFO ][disco-event-worker-#1236%internal.ClusterBaselineNodesMetricsSelfTest0%][GridDiscoveryManager] Node left topology: TcpDiscoveryNode [id=5ff14d92-b955-4988-af16-a71774900001, consistentId=internal.ClusterBaselineNodesMetricsSelfTest1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637344915461, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false] [21:01:59] : [Step 4/5] [2021-11-19 21:01:59,750][INFO ][tcp-disco-sock-reader-[4f8845b3 127.0.0.1:44743]-#68%internal.ClusterBaselineNodesMetricsSelfTest1%-#1356%internal.ClusterBaselineNodesMetricsSelfTest1%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:44743, rmtPort=44743, rmtNodeId=4f8845b3-7744-4ec1-9404-43c3d1f00000] [21:01:59] : [Step 4/5] [2021-11-19 21:01:59,754][INFO ][disco-event-worker-#1236%internal.ClusterBaselineNodesMetricsSelfTest0%][GridDiscoveryManager] Topology snapshot [ver=5, locNode=4f8845b3, servers=2, clients=1, state=ACTIVE, CPUs=24, offheap=2.0GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=4f8845b3-7744-4ec1-9404-43c3d1f00000, consistentId=internal.ClusterBaselineNodesMetricsSelfTest0, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=f054f218-1e85-4528-9e50-191c6f500002, consistentId=internal.ClusterBaselineNodesMetricsSelfTest2, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=a3cd6747-87a1-4b63-a114-5ba56c600003, consistentId=internal.ClusterBaselineNodesMetricsSelfTest3, isClient=true, ver=2.13.0#20211119-sha1:00000000]]] [21:01:59] : [Step 4/5] [2021-11-19 21:01:59,754][INFO ][disco-event-worker-#1619%internal.ClusterBaselineNodesMetricsSelfTest3%][GridDiscoveryManager] Topology snapshot [ver=5, locNode=a3cd6747, servers=2, clients=1, state=ACTIVE, CPUs=24, offheap=2.0GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=a3cd6747-87a1-4b63-a114-5ba56c600003, consistentId=internal.ClusterBaselineNodesMetricsSelfTest3, isClient=true, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=4f8845b3-7744-4ec1-9404-43c3d1f00000, consistentId=internal.ClusterBaselineNodesMetricsSelfTest0, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=f054f218-1e85-4528-9e50-191c6f500002, consistentId=internal.ClusterBaselineNodesMetricsSelfTest2, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:01:59] : [Step 4/5] [2021-11-19 21:01:59,758][INFO ][disco-event-worker-#1619%internal.ClusterBaselineNodesMetricsSelfTest3%][GridDiscoveryManager] ^-- Baseline [id=0, size=2, online=1, offline=1] [21:01:59] : [Step 4/5] [2021-11-19 21:01:59,753][INFO ][tcp-disco-srvr-[:47502]-#74%internal.ClusterBaselineNodesMetricsSelfTest2%-#1503%internal.ClusterBaselineNodesMetricsSelfTest2%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=45821] [21:01:59] : [Step 4/5] [2021-11-19 21:01:59,757][INFO ][disco-event-worker-#1236%internal.ClusterBaselineNodesMetricsSelfTest0%][GridDiscoveryManager] ^-- Baseline [id=0, size=2, online=1, offline=1] [21:01:59] : [Step 4/5] [2021-11-19 21:01:59,756][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][GridCacheProcessor] Stopped cache [cacheName=ignite-sys-cache] [21:01:59] : [Step 4/5] [2021-11-19 21:01:59,758][INFO ][tcp-disco-srvr-[:47502]-#74%internal.ClusterBaselineNodesMetricsSelfTest2%-#1503%internal.ClusterBaselineNodesMetricsSelfTest2%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=45821] [21:01:59]W: [org.apache.ignite:ignite-core] [2021-11-19 21:01:59,759][WARN ][grid-nio-worker-tcp-comm-0-#1175%TcpCommunicationSpi%][TcpCommunicationSpi] Failed to shutdown socket [21:01:59]W: [org.apache.ignite:ignite-core] java.nio.channels.ClosedChannelException [21:01:59]W: [org.apache.ignite:ignite-core] at sun.nio.ch.SocketChannelImpl.shutdownOutput(SocketChannelImpl.java:795) [21:01:59]W: [org.apache.ignite:ignite-core] at sun.nio.ch.SocketAdaptor.shutdownOutput(SocketAdaptor.java:407) [21:01:59]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.close(IgniteUtils.java:4247) [21:01:59]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.closeKey(GridNioServer.java:2784) [21:01:59]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.close(GridNioServer.java:2835) [21:01:59]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.close(GridNioServer.java:2794) [21:01:59] : [Step 4/5] [2021-11-19 21:01:59,760][INFO ][exchange-worker-#1237%internal.ClusterBaselineNodesMetricsSelfTest0%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], crd=true, evt=NODE_LEFT, evtNode=5ff14d92-b955-4988-af16-a71774900001, customEvt=null, allowMerge=false, exchangeFreeSwitch=true] [21:01:59]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.bodyInternal(GridNioServer.java:2157) [21:01:59]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.body(GridNioServer.java:1910) [21:01:59]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:125) [21:01:59]W: [org.apache.ignite:ignite-core] at java.lang.Thread.run(Thread.java:748) [21:01:59] : [Step 4/5] [2021-11-19 21:01:59,760][INFO ][tcp-disco-sock-reader-[]-#87%internal.ClusterBaselineNodesMetricsSelfTest2%-#1633%internal.ClusterBaselineNodesMetricsSelfTest2%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:45821, rmtPort=45821] [21:01:59] : [Step 4/5] [2021-11-19 21:01:59,760][INFO ][exchange-worker-#1620%internal.ClusterBaselineNodesMetricsSelfTest3%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], crd=false, evt=NODE_LEFT, evtNode=5ff14d92-b955-4988-af16-a71774900001, customEvt=null, allowMerge=false, exchangeFreeSwitch=true] [21:01:59] : [Step 4/5] [2021-11-19 21:01:59,763][INFO ][exchange-worker-#1237%internal.ClusterBaselineNodesMetricsSelfTest0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:01:59] : [Step 4/5] [2021-11-19 21:01:59,766][INFO ][tcp-disco-sock-reader-[4f8845b3 127.0.0.1:45821]-#87%internal.ClusterBaselineNodesMetricsSelfTest2%-#1633%internal.ClusterBaselineNodesMetricsSelfTest2%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=4f8845b3-7744-4ec1-9404-43c3d1f00000, rmtAddr=/127.0.0.1:45821] [21:01:59] : [Step 4/5] [2021-11-19 21:01:59,767][INFO ][exchange-worker-#1237%internal.ClusterBaselineNodesMetricsSelfTest0%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], err=null, rebalanced=true, wasRebalanced=true] [21:01:59] : [Step 4/5] [2021-11-19 21:01:59,766][INFO ][exchange-worker-#1620%internal.ClusterBaselineNodesMetricsSelfTest3%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], err=null, rebalanced=true, wasRebalanced=true] [21:01:59] : [Step 4/5] [2021-11-19 21:01:59,768][INFO ][disco-event-worker-#1509%internal.ClusterBaselineNodesMetricsSelfTest2%][GridDiscoveryManager] Node left topology: TcpDiscoveryNode [id=5ff14d92-b955-4988-af16-a71774900001, consistentId=internal.ClusterBaselineNodesMetricsSelfTest1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637344918402, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false] [21:01:59] : [Step 4/5] [2021-11-19 21:01:59,769][INFO ][exchange-worker-#1237%internal.ClusterBaselineNodesMetricsSelfTest0%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=4f8845b3-7744-4ec1-9404-43c3d1f00000, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], evt=NODE_LEFT, evtNode=TcpDiscoveryNode [id=5ff14d92-b955-4988-af16-a71774900001, consistentId=internal.ClusterBaselineNodesMetricsSelfTest1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637344915461, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=5, minorTopVer=0]] [21:01:59] : [Step 4/5] [2021-11-19 21:01:59,769][INFO ][disco-event-worker-#1509%internal.ClusterBaselineNodesMetricsSelfTest2%][GridDiscoveryManager] Topology snapshot [ver=5, locNode=f054f218, servers=2, clients=1, state=ACTIVE, CPUs=24, offheap=2.0GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=4f8845b3-7744-4ec1-9404-43c3d1f00000, consistentId=internal.ClusterBaselineNodesMetricsSelfTest0, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=f054f218-1e85-4528-9e50-191c6f500002, consistentId=internal.ClusterBaselineNodesMetricsSelfTest2, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=a3cd6747-87a1-4b63-a114-5ba56c600003, consistentId=internal.ClusterBaselineNodesMetricsSelfTest3, isClient=true, ver=2.13.0#20211119-sha1:00000000]]] [21:01:59] : [Step 4/5] [2021-11-19 21:01:59,772][INFO ][disco-event-worker-#1509%internal.ClusterBaselineNodesMetricsSelfTest2%][GridDiscoveryManager] ^-- Baseline [id=0, size=2, online=1, offline=1] [21:01:59] : [Step 4/5] [2021-11-19 21:01:59,769][INFO ][exchange-worker-#1620%internal.ClusterBaselineNodesMetricsSelfTest3%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=a3cd6747-87a1-4b63-a114-5ba56c600003, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], evt=NODE_LEFT, evtNode=TcpDiscoveryNode [id=5ff14d92-b955-4988-af16-a71774900001, consistentId=internal.ClusterBaselineNodesMetricsSelfTest1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637344919624, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=5, minorTopVer=0]] [21:01:59] : [Step 4/5] [2021-11-19 21:01:59,773][INFO ][exchange-worker-#1510%internal.ClusterBaselineNodesMetricsSelfTest2%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], crd=false, evt=NODE_LEFT, evtNode=5ff14d92-b955-4988-af16-a71774900001, customEvt=null, allowMerge=false, exchangeFreeSwitch=true] [21:01:59] : [Step 4/5] [2021-11-19 21:01:59,771][INFO ][exchange-worker-#1237%internal.ClusterBaselineNodesMetricsSelfTest0%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (1 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="After states restored callback" (0 ms), stage="WAL history reservation" (1 ms), stage="Finalize update counters" (0 ms), stage="Detect lost partitions" (1 ms), stage="Exchange done" (2 ms), stage="Total time" (5 ms)] [21:01:59] : [Step 4/5] [2021-11-19 21:01:59,775][INFO ][exchange-worker-#1510%internal.ClusterBaselineNodesMetricsSelfTest2%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:01:59] : [Step 4/5] [2021-11-19 21:01:59,773][INFO ][exchange-worker-#1620%internal.ClusterBaselineNodesMetricsSelfTest3%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (3 ms), stage="Determine exchange type" (3 ms), stage="Detect lost partitions" (2 ms), stage="Exchange done" (4 ms), stage="Total time" (12 ms)] [21:01:59] : [Step 4/5] [2021-11-19 21:01:59,776][INFO ][exchange-worker-#1510%internal.ClusterBaselineNodesMetricsSelfTest2%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], err=null, rebalanced=true, wasRebalanced=true] [21:01:59] : [Step 4/5] [2021-11-19 21:01:59,775][INFO ][exchange-worker-#1237%internal.ClusterBaselineNodesMetricsSelfTest0%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], stage="Affinity initialization (exchange-free switch on fully-rebalanced topology) [grp=ignite-sys-cache]" (0 ms) (parent=Determine exchange type)] [21:01:59] : [Step 4/5] [2021-11-19 21:01:59,777][INFO ][exchange-worker-#1510%internal.ClusterBaselineNodesMetricsSelfTest2%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=f054f218-1e85-4528-9e50-191c6f500002, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], evt=NODE_LEFT, evtNode=TcpDiscoveryNode [id=5ff14d92-b955-4988-af16-a71774900001, consistentId=internal.ClusterBaselineNodesMetricsSelfTest1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637344918402, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=5, minorTopVer=0]] [21:01:59] : [Step 4/5] [2021-11-19 21:01:59,776][INFO ][exchange-worker-#1620%internal.ClusterBaselineNodesMetricsSelfTest3%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], stage="Affinity initialization (exchange-free switch on fully-rebalanced topology) [grp=ignite-sys-cache]" (3 ms) (parent=Determine exchange type)] [21:01:59] : [Step 4/5] [2021-11-19 21:01:59,779][INFO ][exchange-worker-#1510%internal.ClusterBaselineNodesMetricsSelfTest2%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (0 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="After states restored callback" (0 ms), stage="WAL history reservation" (0 ms), stage="Finalize update counters" (0 ms), stage="Detect lost partitions" (1 ms), stage="Exchange done" (1 ms), stage="Total time" (2 ms)] [21:01:59] : [Step 4/5] [2021-11-19 21:01:59,778][INFO ][exchange-worker-#1237%internal.ClusterBaselineNodesMetricsSelfTest0%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], crd=true] [21:01:59] : [Step 4/5] [2021-11-19 21:01:59,781][INFO ][exchange-worker-#1510%internal.ClusterBaselineNodesMetricsSelfTest2%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], stage="Affinity initialization (exchange-free switch on fully-rebalanced topology) [grp=ignite-sys-cache]" (0 ms) (parent=Determine exchange type)] [21:01:59] : [Step 4/5] [2021-11-19 21:01:59,780][INFO ][exchange-worker-#1620%internal.ClusterBaselineNodesMetricsSelfTest3%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], crd=false] [21:01:59] : [Step 4/5] [2021-11-19 21:01:59,782][INFO ][exchange-worker-#1510%internal.ClusterBaselineNodesMetricsSelfTest2%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], crd=false] [21:01:59] : [Step 4/5] [2021-11-19 21:01:59,781][INFO ][exchange-worker-#1237%internal.ClusterBaselineNodesMetricsSelfTest0%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=5, minorTopVer=0], force=false, evt=NODE_LEFT, node=5ff14d92-b955-4988-af16-a71774900001] [21:01:59] : [Step 4/5] [2021-11-19 21:01:59,783][INFO ][exchange-worker-#1510%internal.ClusterBaselineNodesMetricsSelfTest2%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=5, minorTopVer=0], force=false, evt=NODE_LEFT, node=5ff14d92-b955-4988-af16-a71774900001] [21:01:59] : [Step 4/5] [2021-11-19 21:01:59,782][INFO ][exchange-worker-#1620%internal.ClusterBaselineNodesMetricsSelfTest3%][GridCachePartitionExchangeManager] AffinityTopologyVersion [topVer=5, minorTopVer=0], evt=NODE_LEFT, evtNode=5ff14d92-b955-4988-af16-a71774900001, client=true] [21:02:00] : [Step 4/5] [2021-11-19 21:02:00,803][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][FilePageStoreManager] Cleanup cache stores [total=3, left=0, cleanFiles=false] [21:02:00] : [Step 4/5] [2021-11-19 21:02:00,806][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][GridDeploymentLocalStore] Removed undeployed class: GridDeployment [ts=1637344915899, depMode=SHARED, clsLdr=IsolatedClassLoader{roleName='test'}, clsLdrId=2c2ac593d71-5ff14d92-b955-4988-af16-a71774900001, userVer=0, loc=true, sampleClsName=org.apache.ignite.internal.processors.cache.distributed.dht.preloader.GridDhtPartitionFullMap, pendingUndeploy=false, undeployed=true, usage=0] [21:02:00] : [Step 4/5] [2021-11-19 21:02:00,818][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][ClusterBaselineNodesMetricsSelfTest1] [21:02:00] : [Step 4/5] [21:02:00] : [Step 4/5] >>> +------------------------------------------------------+ [21:02:00] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV stopped OK [21:02:00] : [Step 4/5] >>> +------------------------------------------------------+ [21:02:00] : [Step 4/5] >>> Ignite instance name: internal.ClusterBaselineNodesMetricsSelfTest1 [21:02:00] : [Step 4/5] >>> Grid uptime: 00:00:05.156 [21:02:00] : [Step 4/5] [21:02:00] : [Step 4/5] [21:02:00] : [Step 4/5] [2021-11-19 21:02:00,819][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][root] >>> State #1: topology version = 5 [21:02:00]W: [org.apache.ignite:ignite-core] [2021-11-19 21:02:00,828][WARN ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][G] Ignite work directory is not provided, automatically resolved to: /opt/buildagent/work/7bc1c54bc719b67c/work [21:02:00] : [Step 4/5] [2021-11-19 21:02:00,829][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][ClusterBaselineNodesMetricsSelfTest1] [21:02:00] : [Step 4/5] [21:02:00] : [Step 4/5] >>> __________ ________________ [21:02:00] : [Step 4/5] >>> / _/ ___/ |/ / _/_ __/ __/ [21:02:00] : [Step 4/5] >>> _/ // (7 7 // / / / / _/ [21:02:00] : [Step 4/5] >>> /___/\___/_/|_/___/ /_/ /___/ [21:02:00] : [Step 4/5] >>> [21:02:00] : [Step 4/5] >>> ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:02:00] : [Step 4/5] >>> 2021 Copyright(C) Apache Software Foundation [21:02:00] : [Step 4/5] >>> [21:02:00] : [Step 4/5] >>> Ignite documentation: http://ignite.apache.org [21:02:00] : [Step 4/5] [21:02:00] : [Step 4/5] [2021-11-19 21:02:00,830][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][ClusterBaselineNodesMetricsSelfTest1] Config URL: n/a [21:02:00] : [Step 4/5] [2021-11-19 21:02:00,832][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][ClusterBaselineNodesMetricsSelfTest1] IgniteConfiguration [igniteInstanceName=internal.ClusterBaselineNodesMetricsSelfTest1, pubPoolSize=24, svcPoolSize=24, callbackPoolSize=24, stripedPoolSize=24, sysPoolSize=24, mgmtPoolSize=4, dataStreamerPoolSize=24, utilityCachePoolSize=24, utilityCacheKeepAliveTime=60000, p2pPoolSize=2, qryPoolSize=24, buildIdxPoolSize=4, igniteHome=/opt/buildagent/work/7bc1c54bc719b67c, igniteWorkDir=/opt/buildagent/work/7bc1c54bc719b67c/work, mbeanSrv=com.sun.jmx.mbeanserver.JmxMBeanServer@6fe85038, nodeId=f2be5aeb-dacc-4e5b-9786-82c46a500001, marsh=BinaryMarshaller [], marshLocJobs=false, daemon=false, p2pEnabled=true, netTimeout=10000, netCompressionLevel=1, sndRetryDelay=1000, sndRetryCnt=3, metricsHistSize=10000, metricsUpdateFreq=1000, metricsExpTime=9223372036854775807, discoSpi=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=0, ackTimeout=0, marsh=null, reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], segPlc=STOP, segResolveAttempts=2, waitForSegOnStart=true, allResolversPassReq=true, segChkFreq=10000, commSpi=TcpCommunicationSpi [connectGate=org.apache.ignite.spi.communication.tcp.internal.ConnectGateway@1740049a, ctxInitLatch=java.util.concurrent.CountDownLatch@7d49b84b[Count = 1], stopping=false, clientPool=null, nioSrvWrapper=null, stateProvider=null], evtSpi=MemoryEventStorageSpi [expireAgeMs=9223372036854775807, expireCnt=10000, filter=null], colSpi=NoopCollisionSpi [], deploySpi=LocalDeploymentSpi [], indexingSpi=org.apache.ignite.spi.indexing.noop.NoopIndexingSpi@4422241c, addrRslvr=null, encryptionSpi=org.apache.ignite.spi.encryption.noop.NoopEncryptionSpi@4c9ab189, tracingSpi=org.apache.ignite.spi.tracing.NoopTracingSpi@78ac6f48, clientMode=false, rebalanceThreadPoolSize=4, rebalanceTimeout=10000, rebalanceBatchesPrefetchCnt=3, rebalanceThrottle=0, rebalanceBatchSize=524288, txCfg=TransactionConfiguration [txSerEnabled=false, dfltIsolation=REPEATABLE_READ, dfltConcurrency=PESSIMISTIC, dfltTxTimeout=0, txTimeoutOnPartitionMapExchange=0, deadlockTimeout=10000, pessimisticTxLogSize=0, pessimisticTxLogLinger=10000, tmLookupClsName=null, txManagerFactory=null, useJtaSync=false], cacheSanityCheckEnabled=true, discoStartupDelay=60000, deployMode=SHARED, p2pMissedCacheSize=100, locHost=127.0.0.1, timeSrvPortBase=31100, timeSrvPortRange=100, failureDetectionTimeout=10000, sysWorkerBlockedTimeout=null, clientFailureDetectionTimeout=10000, metricsLogFreq=0, connectorCfg=null, odbcCfg=null, warmupClos=null, atomicCfg=AtomicConfiguration [seqReserveSize=1000, cacheMode=PARTITIONED, backups=1, aff=null, grpName=null], classLdr=null, sslCtxFactory=null, platformCfg=null, binaryCfg=null, memCfg=null, pstCfg=null, dsCfg=DataStorageConfiguration [sysRegionInitSize=41943040, sysRegionMaxSize=104857600, pageSize=0, concLvl=0, dfltDataRegConf=DataRegionConfiguration [name=default, maxSize=2147483648, initSize=268435456, swapPath=null, pageEvictionMode=DISABLED, pageReplacementMode=CLOCK, evictionThreshold=0.9, emptyPagesPoolSize=100, metricsEnabled=false, metricsSubIntervalCount=5, metricsRateTimeInterval=60000, persistenceEnabled=true, checkpointPageBufSize=0, lazyMemoryAllocation=true, warmUpCfg=null], dataRegions=null, storagePath=clusterbaselinenodesmetricsselftest/testBaselineNodes, checkpointFreq=180000, lockWaitTime=10000, checkpointThreads=4, checkpointWriteOrder=SEQUENTIAL, walHistSize=20, maxWalArchiveSize=1073741824, walSegments=10, walSegmentSize=67108864, walPath=clusterbaselinenodesmetricsselftest/testBaselineNodes/wal, walArchivePath=clusterbaselinenodesmetricsselftest/testBaselineNodes/archive, cdcWalPath=db/wal/cdc, cdcEnabled=false, metricsEnabled=false, walMode=LOG_ONLY, walTlbSize=131072, walBuffSize=0, walFlushFreq=2000, walFsyncDelay=1000, walRecordIterBuffSize=67108864, alwaysWriteFullPages=false, fileIOFactory=org.apache.ignite.internal.processors.cache.persistence.file.AsyncFileIOFactory@14d8ceac, metricsSubIntervalCnt=5, metricsRateTimeInterval=60000, walAutoArchiveAfterInactivity=-1, walForceArchiveTimeout=-1, writeThrottlingEnabled=false, walCompactionEnabled=false, walCompactionLevel=1, checkpointReadLockTimeout=null, walPageCompression=DISABLED, walPageCompressionLevel=null, dfltWarmUpCfg=null, encCfg=org.apache.ignite.configuration.EncryptionConfiguration@4797da65, defragmentationThreadPoolSize=4, minWalArchiveSize=-1], snapshotPath=snapshots, activeOnStart=true, activeOnStartPropSetFlag=false, autoActivation=true, autoActivationPropSetFlag=false, clusterStateOnStart=null, sqlConnCfg=null, cliConnCfg=ClientConnectorConfiguration [host=null, port=10800, portRange=100, sockSndBufSize=0, sockRcvBufSize=0, tcpNoDelay=true, maxOpenCursorsPerConn=128, threadPoolSize=24, selectorCnt=12, idleTimeout=0, handshakeTimeout=10000, jdbcEnabled=true, odbcEnabled=true, thinCliEnabled=true, sslEnabled=false, useIgniteSslCtxFactory=true, sslClientAuth=false, sslCtxFactory=null, thinCliCfg=ThinClientConfiguration [maxActiveTxPerConn=100, maxActiveComputeTasksPerConn=0]], mvccVacuumThreadCnt=2, mvccVacuumFreq=5000, authEnabled=false, failureHnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]], commFailureRslvr=null, sqlCfg=SqlConfiguration [longQryWarnTimeout=3000, dfltQryTimeout=0, sqlQryHistSize=1000, validationEnabled=false], asyncContinuationExecutor=null] [21:02:00] : [Step 4/5] [2021-11-19 21:02:00,843][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][ClusterBaselineNodesMetricsSelfTest1] Daemon mode: off [21:02:00] : [Step 4/5] [2021-11-19 21:02:00,844][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][ClusterBaselineNodesMetricsSelfTest1] OS: Linux 4.15.0-151-generic amd64 [21:02:00] : [Step 4/5] [2021-11-19 21:02:00,844][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][ClusterBaselineNodesMetricsSelfTest1] OS user: teamcity [21:02:00] : [Step 4/5] [2021-11-19 21:02:00,845][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][ClusterBaselineNodesMetricsSelfTest1] PID: 16724 [21:02:00] : [Step 4/5] [2021-11-19 21:02:00,845][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][ClusterBaselineNodesMetricsSelfTest1] Language runtime: Java Platform API Specification ver. 1.8 [21:02:00] : [Step 4/5] [2021-11-19 21:02:00,845][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][ClusterBaselineNodesMetricsSelfTest1] VM information: Java(TM) SE Runtime Environment 1.8.0_261-b12 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 25.261-b12 [21:02:00] : [Step 4/5] [2021-11-19 21:02:00,846][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][ClusterBaselineNodesMetricsSelfTest1] VM total memory: 1.9GB [21:02:00] : [Step 4/5] [2021-11-19 21:02:00,846][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][ClusterBaselineNodesMetricsSelfTest1] Remote Management [restart: off, REST: off, JMX (remote: off)] [21:02:00] : [Step 4/5] [2021-11-19 21:02:00,847][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][ClusterBaselineNodesMetricsSelfTest1] Logger: GridTestLog4jLogger [quiet=false, config=null] [21:02:00] : [Step 4/5] [2021-11-19 21:02:00,847][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][ClusterBaselineNodesMetricsSelfTest1] IGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c [21:02:00] : [Step 4/5] [2021-11-19 21:02:00,847][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][ClusterBaselineNodesMetricsSelfTest1] VM arguments: [-DIGNITE_DUMP_THREADS_ON_FAILURE=false, -DMono=/usr/bin/mono-sgen, -DMono4.0_x64=/usr/lib/mono/4.0, -DMono4.5_x64=/usr/lib/mono/4.5, -DMonoVersion=6.12.0.90, -DSKIP_BUILD=false, -Dagent.home.dir=/opt/buildagent, -Dagent.name=aitc-lin02_03, -Dagent.ownPort=9090, -Dagent.work.dir=/opt/buildagent/work, -Dbuild.number=95, -Dbuild.vcs.number=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.1=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.GitHubApacheIgnite=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dclassworlds.conf=/opt/buildagent/temp/buildTmp/teamcity.m2.conf, -Dcom.jetbrains.maven.watcher.report.file=/opt/buildagent/temp/buildTmp/maven-build-info.xml, -Djava.io.tmpdir=/opt/buildagent/temp/buildTmp, -Dmaven.home=/opt/buildagent/tools/maven3_6, -Dmaven.multiModuleProjectDirectory=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.agent.cpuBenchmark=457, -Dteamcity.agent.dotnet.agent_url=http://localhost:9090/RPC2, -Dteamcity.agent.dotnet.build_id=6278078, -Dteamcity.auth.password=*******, -Dteamcity.auth.userId=TeamCityBuildId=6278078, -Dteamcity.build.changedFiles.file=/opt/buildagent/temp/buildTmp/changedFiles6342607772318147725.txt, -Dteamcity.build.checkoutDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.build.id=6278078, -Dteamcity.build.properties.file=/opt/buildagent/temp/buildTmp/teamcity.build5164517880467851002.properties, -Dteamcity.build.tempDir=/opt/buildagent/temp/buildTmp, -Dteamcity.build.workingDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.buildConfName=Basic 3, -Dteamcity.buildType.id=IgniteTests24Java8_Basic3, -Dteamcity.configuration.properties.file=/opt/buildagent/temp/buildTmp/teamcity.config5591980786735343870.properties, -Dteamcity.maven.userSettings.path=/opt/buildagent/temp/buildTmp/maven_settings_585072866407032347.xml, -Dteamcity.maven.watcher.home=/opt/buildagent/plugins/mavenPlugin/maven-watcher-jdk16, -Dteamcity.projectName=Ignite Tests 2.x (JDK 8/11), -Dteamcity.runner.properties.file=/opt/buildagent/temp/buildTmp/teamcity.runner9098465561618137420.properties, -Dteamcity.tests.recentlyFailedTests.file=/opt/buildagent/temp/buildTmp/testsToRunFirst3891775683130404069.txt, -Dteamcity.version=2021.2 (build 99542), -ea, -Xms2g, -Xmx2g, -XX:+HeapDumpOnOutOfMemoryError, -DIGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_TEST_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_UPDATE_NOTIFIER=false, -DIGNITE_NO_DISCO_ORDER=true, -DIGNITE_PERFORMANCE_SUGGESTIONS_DISABLED=true, -Djava.net.preferIPv4Stack=true, -DTEST_SCALE_FACTOR=1.0, -DIGNITE_TEST_PROP_LOG4J_FILE=log4j-tc-test.xml, -DIGNITE_QUIET=false, -DIGNITE_MARSHAL_BUFFERS_RECHECK=1000, -Dmaven.repo.local=/opt/buildagent/.m2/repository] [21:02:00] : [Step 4/5] [2021-11-19 21:02:00,851][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][ClusterBaselineNodesMetricsSelfTest1] System cache's DataRegion size is configured to 40 MB. Use DataStorageConfiguration.systemRegionInitialSize property to change the setting. [21:02:00] : [Step 4/5] [2021-11-19 21:02:00,852][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][ClusterBaselineNodesMetricsSelfTest1] Configured caches [in 'sysMemPlc' dataRegion: ['ignite-sys-cache']] [21:02:00]W: [org.apache.ignite:ignite-core] [2021-11-19 21:02:00,852][WARN ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][ClusterBaselineNodesMetricsSelfTest1] Peer class loading is enabled (disable it in production for performance and deployment consistency reasons) [21:02:00] : [Step 4/5] [2021-11-19 21:02:00,852][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][ClusterBaselineNodesMetricsSelfTest1] 3-rd party licenses can be found at: /opt/buildagent/work/7bc1c54bc719b67c/libs/licenses [21:02:00] : [Step 4/5] [2021-11-19 21:02:00,857][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][IgnitePluginProcessor] Configured plugins: [21:02:00] : [Step 4/5] [2021-11-19 21:02:00,858][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][IgnitePluginProcessor] ^-- StanByClusterTestProvider 1.0 [21:02:00] : [Step 4/5] [2021-11-19 21:02:00,858][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][IgnitePluginProcessor] ^-- null [21:02:00] : [Step 4/5] [2021-11-19 21:02:00,858][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][IgnitePluginProcessor] [21:02:00] : [Step 4/5] [2021-11-19 21:02:00,858][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][IgnitePluginProcessor] ^-- PageMemory tracker plugin 1.0 [21:02:00] : [Step 4/5] [2021-11-19 21:02:00,858][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][IgnitePluginProcessor] ^-- null [21:02:00] : [Step 4/5] [2021-11-19 21:02:00,858][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][IgnitePluginProcessor] [21:02:00] : [Step 4/5] [2021-11-19 21:02:00,859][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][IgnitePluginProcessor] ^-- TestDistibutedConfigurationPlugin 1.0 [21:02:00] : [Step 4/5] [2021-11-19 21:02:00,859][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][IgnitePluginProcessor] ^-- null [21:02:00] : [Step 4/5] [2021-11-19 21:02:00,859][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][IgnitePluginProcessor] [21:02:00] : [Step 4/5] [2021-11-19 21:02:00,859][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][IgnitePluginProcessor] ^-- NodeValidationPluginProvider 1.0 [21:02:00] : [Step 4/5] [2021-11-19 21:02:00,859][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][IgnitePluginProcessor] ^-- null [21:02:00] : [Step 4/5] [2021-11-19 21:02:00,859][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][IgnitePluginProcessor] [21:02:00] : [Step 4/5] [2021-11-19 21:02:00,860][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][FailureProcessor] Configured failure handler: [hnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]]] [21:02:00]W: [org.apache.ignite:ignite-core] [2021-11-19 21:02:00,888][WARN ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][TcpCommunicationSpi] Message queue limit is set to 0 which may lead to potential OOMEs when running cache operations in FULL_ASYNC or PRIMARY_SYNC modes due to message queues growth on sender and receiver sides. [21:02:00] : [Step 4/5] [2021-11-19 21:02:00,887][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][TcpCommunicationSpi] Successfully bound communication NIO server to TCP port [port=45021, locHost=/127.0.0.1, selectorsCnt=12, selectorSpins=0, pairedConn=false] [21:02:00] : [Step 4/5] [2021-11-19 21:02:00,897][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][GridCollisionManager] Collision resolution is disabled (all jobs will be activated upon arrival). [21:02:00] : [Step 4/5] [2021-11-19 21:02:00,897][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][ClusterBaselineNodesMetricsSelfTest1] Security status [authentication=off, sandbox=off, tls/ssl=off] [21:02:00] : [Step 4/5] [2021-11-19 21:02:00,899][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][MaintenanceProcessor] Resolved store directory for node persistent data: /opt/buildagent/work/7bc1c54bc719b67c/work/clusterbaselinenodesmetricsselftest/testBaselineNodes/internal_ClusterBaselineNodesMetricsSelfTest1 [21:02:00] : [Step 4/5] [2021-11-19 21:02:00,901][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][CacheObjectBinaryProcessorImpl] Resolved directory for serialized binary metadata: /opt/buildagent/work/7bc1c54bc719b67c/work/db/binary_meta/internal_ClusterBaselineNodesMetricsSelfTest1 [21:02:00] : [Step 4/5] [2021-11-19 21:02:00,909][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/clusterbaselinenodesmetricsselftest/testBaselineNodes/internal_ClusterBaselineNodesMetricsSelfTest1 [21:02:00] : [Step 4/5] [2021-11-19 21:02:00,910][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][FileWriteAheadLogManager] Resolved write ahead log work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/clusterbaselinenodesmetricsselftest/testBaselineNodes/wal/internal_ClusterBaselineNodesMetricsSelfTest1 [21:02:00] : [Step 4/5] [2021-11-19 21:02:00,911][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][FileWriteAheadLogManager] Resolved write ahead log archive directory: /opt/buildagent/work/7bc1c54bc719b67c/work/clusterbaselinenodesmetricsselftest/testBaselineNodes/archive/internal_ClusterBaselineNodesMetricsSelfTest1 [21:02:00] : [Step 4/5] [2021-11-19 21:02:00,913][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/clusterbaselinenodesmetricsselftest/testBaselineNodes/wal/internal_ClusterBaselineNodesMetricsSelfTest1/0000000000000005.wal [21:02:00] : [Step 4/5] [2021-11-19 21:02:00,913][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/clusterbaselinenodesmetricsselftest/testBaselineNodes/wal/internal_ClusterBaselineNodesMetricsSelfTest1/0000000000000004.wal [21:02:00] : [Step 4/5] [2021-11-19 21:02:00,914][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/clusterbaselinenodesmetricsselftest/testBaselineNodes/wal/internal_ClusterBaselineNodesMetricsSelfTest1/0000000000000003.wal [21:02:00] : [Step 4/5] [2021-11-19 21:02:00,915][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/clusterbaselinenodesmetricsselftest/testBaselineNodes/wal/internal_ClusterBaselineNodesMetricsSelfTest1/0000000000000002.wal [21:02:00] : [Step 4/5] [2021-11-19 21:02:00,915][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/clusterbaselinenodesmetricsselftest/testBaselineNodes/wal/internal_ClusterBaselineNodesMetricsSelfTest1/0000000000000001.wal [21:02:00] : [Step 4/5] [2021-11-19 21:02:00,916][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][FileHandleManagerImpl] Initialized write-ahead log manager [mode=LOG_ONLY] [21:02:00] : [Step 4/5] [2021-11-19 21:02:00,922][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][GridCacheDatabaseSharedManager] Configured data regions initialized successfully [total=5] [21:02:01] : [Step 4/5] [2021-11-19 21:02:01,476][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][IgniteSnapshotManager] Resolved snapshot work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/snapshots [21:02:01] : [Step 4/5] [2021-11-19 21:02:01,476][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][IgniteSnapshotManager] Resolved temp directory for snapshot creation: /opt/buildagent/work/7bc1c54bc719b67c/work/clusterbaselinenodesmetricsselftest/testBaselineNodes/internal_ClusterBaselineNodesMetricsSelfTest1/snp [21:02:01] : [Step 4/5] [2021-11-19 21:02:01,481][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][ClientListenerProcessor] Client connector processor has started on TCP port 10801 [21:02:01] : [Step 4/5] [2021-11-19 21:02:01,488][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][ClusterBaselineNodesMetricsSelfTest1] Non-loopback local IPs: 172.17.0.4 [21:02:01] : [Step 4/5] [2021-11-19 21:02:01,488][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][ClusterBaselineNodesMetricsSelfTest1] Enabled local MACs: 0242AC110004 [21:02:01] : [Step 4/5] [2021-11-19 21:02:01,492][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=/opt/buildagent/work/7bc1c54bc719b67c/work/clusterbaselinenodesmetricsselftest/testBaselineNodes/internal_ClusterBaselineNodesMetricsSelfTest1/cp/1637344915808-12170d7f-04a4-4f4c-8283-03d4c73f94b2-START.bin, endMarker=/opt/buildagent/work/7bc1c54bc719b67c/work/clusterbaselinenodesmetricsselftest/testBaselineNodes/internal_ClusterBaselineNodesMetricsSelfTest1/cp/1637344915808-12170d7f-04a4-4f4c-8283-03d4c73f94b2-END.bin] [21:02:01] : [Step 4/5] [2021-11-19 21:02:01,494][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:02:01] : [Step 4/5] [2021-11-19 21:02:01,494][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=87026, len=1963], lastMarked=WALPointer [idx=0, fileOff=87026, len=1963], lastCheckpointId=12170d7f-04a4-4f4c-8283-03d4c73f94b2] [21:02:01] : [Step 4/5] [2021-11-19 21:02:01,611][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][GridCacheDatabaseSharedManager] Found last checkpoint marker [cpId=12170d7f-04a4-4f4c-8283-03d4c73f94b2, pos=WALPointer [idx=0, fileOff=87026, len=1963]] [21:02:01] : [Step 4/5] [2021-11-19 21:02:01,699][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][GridCacheDatabaseSharedManager] Applying lost metastore updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=87026, len=1963], lastCheckpointId=12170d7f-04a4-4f4c-8283-03d4c73f94b2] [21:02:01] : [Step 4/5] [2021-11-19 21:02:01,773][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=71 ms] [21:02:01] : [Step 4/5] [2021-11-19 21:02:01,773][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][GridCacheProcessor] Restoring partition state for local groups. [21:02:01] : [Step 4/5] [2021-11-19 21:02:01,774][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=0, partitionsProcessed=0, time=0ms] [21:02:01] : [Step 4/5] [2021-11-19 21:02:01,841][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][GridEncryptionManager] Encryption keys loaded from metastore. [grps=, masterKeyName=null] [21:02:01] : [Step 4/5] [2021-11-19 21:02:01,851][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][GridClusterStateProcessor] Restoring history for BaselineTopology[id=0] [21:02:01] : [Step 4/5] [2021-11-19 21:02:01,867][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][ClusterProcessor] Cluster ID and tag has been read from metastorage: ClusterIdAndTag [id=aeea33f2-f76a-4ae8-9c30-3b901d5f028f, tag=affectionate_sanderson] [21:02:01] : [Step 4/5] [2021-11-19 21:02:01,867][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][IgniteClusterImpl] Shutdown policy was updated [oldVal=null, newVal=null] [21:02:01] : [Step 4/5] [2021-11-19 21:02:01,868][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustEnabled' was changed from 'null' to 'false' [21:02:01] : [Step 4/5] [2021-11-19 21:02:01,868][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustTimeout' was changed from 'null' to '300000' [21:02:01] : [Step 4/5] [2021-11-19 21:02:01,869][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][IgniteTxManager] Transactions parameter 'txOwnerDumpRequestsAllowed' was changed from 'null' to 'true' [21:02:01] : [Step 4/5] [2021-11-19 21:02:01,869][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][IgniteTxManager] Transactions parameter 'longOperationsDumpTimeout' was changed from 'null' to '60000' [21:02:01] : [Step 4/5] [2021-11-19 21:02:01,870][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpThreshold' was changed from 'null' to '0' [21:02:01] : [Step 4/5] [2021-11-19 21:02:01,871][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][IgniteTxManager] Transactions parameter 'transactionTimeDumpSamplesCoefficient' was changed from 'null' to '0.0' [21:02:01] : [Step 4/5] [2021-11-19 21:02:01,871][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpSamplesPerSecondLimit' was changed from 'null' to '5' [21:02:01] : [Step 4/5] [2021-11-19 21:02:01,871][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][IgniteTxManager] Transactions parameter 'collisionsDumpInterval' was changed from 'null' to '1000' [21:02:01] : [Step 4/5] [2021-11-19 21:02:01,872][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][GridCacheDatabaseSharedManager] Historical rebalance WAL threshold changed [property=historical.rebalance.threshold, oldVal=null, newVal=500] [21:02:01] : [Step 4/5] [2021-11-19 21:02:01,872][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][GridCacheDatabaseSharedManager] Checkpoint frequency deviation changed [oldVal=null, newVal=null] [21:02:02] : [Step 4/5] [2021-11-19 21:02:02,137][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][FilePageStoreManager] Cleanup cache stores [total=1, left=0, cleanFiles=false] [21:02:02] : [Step 4/5] [2021-11-19 21:02:02,140][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:02:02] : [Step 4/5] [2021-11-19 21:02:02,141][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:02:02] : [Step 4/5] [2021-11-19 21:02:02,143][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:02:02] : [Step 4/5] [2021-11-19 21:02:02,144][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][GridCacheDatabaseSharedManager] Data Regions Started: 5 [21:02:02] : [Step 4/5] [2021-11-19 21:02:02,144][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][GridCacheDatabaseSharedManager] ^-- sysMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:02:02] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:02:02] : [Step 4/5] ^-- default region [type=default, persistence=true, lazyAlloc=true, [21:02:02] : [Step 4/5] ... initCfg=256MB, maxCfg=2048MB, usedRam=0MB, freeRam=100%, allocRam=0MB, allocTotal=0MB] [21:02:02] : [Step 4/5] ^-- metastoreMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:02:02] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:02:02] : [Step 4/5] ^-- TxLog region [type=internal, persistence=true, lazyAlloc=false, [21:02:02] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:02:02] : [Step 4/5] ^-- volatileDsMemPlc region [type=user, persistence=false, lazyAlloc=true, [21:02:02] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB] [21:02:02] : [Step 4/5] ^-- Ignite persistence [used=0MB] [21:02:02] : [Step 4/5] [21:02:02] : [Step 4/5] [2021-11-19 21:02:02,146][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][GridCacheDatabaseSharedManager] Starting binary memory restore for: [-2100569601] [21:02:02] : [Step 4/5] [2021-11-19 21:02:02,160][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=/opt/buildagent/work/7bc1c54bc719b67c/work/clusterbaselinenodesmetricsselftest/testBaselineNodes/internal_ClusterBaselineNodesMetricsSelfTest1/cp/1637344915808-12170d7f-04a4-4f4c-8283-03d4c73f94b2-START.bin, endMarker=/opt/buildagent/work/7bc1c54bc719b67c/work/clusterbaselinenodesmetricsselftest/testBaselineNodes/internal_ClusterBaselineNodesMetricsSelfTest1/cp/1637344915808-12170d7f-04a4-4f4c-8283-03d4c73f94b2-END.bin] [21:02:02] : [Step 4/5] [2021-11-19 21:02:02,161][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=87026, len=1963], lastMarked=WALPointer [idx=0, fileOff=87026, len=1963], lastCheckpointId=12170d7f-04a4-4f4c-8283-03d4c73f94b2] [21:02:02] : [Step 4/5] [2021-11-19 21:02:02,291][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][GridCacheDatabaseSharedManager] Found last checkpoint marker [cpId=12170d7f-04a4-4f4c-8283-03d4c73f94b2, pos=WALPointer [idx=0, fileOff=87026, len=1963]] [21:02:02] : [Step 4/5] [2021-11-19 21:02:02,374][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][GridCacheDatabaseSharedManager] Binary memory state restored at node startup [restoredPtr=WALPointer [idx=0, fileOff=88989, len=0]] [21:02:02] : [Step 4/5] [2021-11-19 21:02:02,376][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/clusterbaselinenodesmetricsselftest/testBaselineNodes/wal/internal_ClusterBaselineNodesMetricsSelfTest1/0000000000000000.wal, offset=88989, ver=2] [21:02:02] : [Step 4/5] [2021-11-19 21:02:02,379][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][GridCacheProcessor] Started cache in recovery mode [name=ignite-sys-cache, id=-2100569601, dataRegionName=sysMemPlc, mode=REPLICATED, atomicity=TRANSACTIONAL, backups=2147483647, mvcc=false] [21:02:02] : [Step 4/5] [2021-11-19 21:02:02,380][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][GridCacheDatabaseSharedManager] Binary recovery performed in 234 ms. [21:02:02] : [Step 4/5] [2021-11-19 21:02:02,381][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=/opt/buildagent/work/7bc1c54bc719b67c/work/clusterbaselinenodesmetricsselftest/testBaselineNodes/internal_ClusterBaselineNodesMetricsSelfTest1/cp/1637344915808-12170d7f-04a4-4f4c-8283-03d4c73f94b2-START.bin, endMarker=/opt/buildagent/work/7bc1c54bc719b67c/work/clusterbaselinenodesmetricsselftest/testBaselineNodes/internal_ClusterBaselineNodesMetricsSelfTest1/cp/1637344915808-12170d7f-04a4-4f4c-8283-03d4c73f94b2-END.bin] [21:02:02] : [Step 4/5] [2021-11-19 21:02:02,382][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][GridCacheDatabaseSharedManager] Applying lost cache updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=87026, len=1963], lastCheckpointId=12170d7f-04a4-4f4c-8283-03d4c73f94b2] [21:02:02] : [Step 4/5] [2021-11-19 21:02:02,450][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=60 ms] [21:02:02] : [Step 4/5] [2021-11-19 21:02:02,450][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][GridCacheProcessor] Restoring partition state for local groups. [21:02:02] : [Step 4/5] [2021-11-19 21:02:02,498][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=1, partitionsProcessed=100, time=53ms] [21:02:02] : [Step 4/5] [2021-11-19 21:02:02,911][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][TestTcpDiscoverySpi] Successfully bound to TCP port [port=47501, localHost=localhost/127.0.0.1, locNodeId=f2be5aeb-dacc-4e5b-9786-82c46a500001] [21:02:02] : [Step 4/5] [2021-11-19 21:02:02,922][INFO ][tcp-disco-srvr-[:47500]-#60%internal.ClusterBaselineNodesMetricsSelfTest0%-#1234%internal.ClusterBaselineNodesMetricsSelfTest0%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=38425] [21:02:02] : [Step 4/5] [2021-11-19 21:02:02,922][INFO ][tcp-disco-srvr-[:47500]-#60%internal.ClusterBaselineNodesMetricsSelfTest0%-#1234%internal.ClusterBaselineNodesMetricsSelfTest0%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=38425] [21:02:02] : [Step 4/5] [2021-11-19 21:02:02,923][INFO ][tcp-disco-sock-reader-[]-#92%internal.ClusterBaselineNodesMetricsSelfTest0%-#1757%internal.ClusterBaselineNodesMetricsSelfTest0%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:38425, rmtPort=38425] [21:02:02] : [Step 4/5] [2021-11-19 21:02:02,928][INFO ][tcp-disco-sock-reader-[f2be5aeb 127.0.0.1:38425]-#92%internal.ClusterBaselineNodesMetricsSelfTest0%-#1757%internal.ClusterBaselineNodesMetricsSelfTest0%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=f2be5aeb-dacc-4e5b-9786-82c46a500001, rmtAddr=/127.0.0.1:38425] [21:02:02] : [Step 4/5] [2021-11-19 21:02:02,932][INFO ][tcp-disco-srvr-[:47501]-#91%internal.ClusterBaselineNodesMetricsSelfTest1%-#1756%internal.ClusterBaselineNodesMetricsSelfTest1%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=51177] [21:02:02] : [Step 4/5] [2021-11-19 21:02:02,933][INFO ][tcp-disco-srvr-[:47501]-#91%internal.ClusterBaselineNodesMetricsSelfTest1%-#1756%internal.ClusterBaselineNodesMetricsSelfTest1%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=51177] [21:02:02] : [Step 4/5] [2021-11-19 21:02:02,934][INFO ][tcp-disco-sock-reader-[]-#93%internal.ClusterBaselineNodesMetricsSelfTest1%-#1758%internal.ClusterBaselineNodesMetricsSelfTest1%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:51177, rmtPort=51177] [21:02:02] : [Step 4/5] [2021-11-19 21:02:02,934][INFO ][tcp-disco-sock-reader-[]-#93%internal.ClusterBaselineNodesMetricsSelfTest1%-#1758%internal.ClusterBaselineNodesMetricsSelfTest1%][TestTcpDiscoverySpi] Received ping request from the remote node [rmtNodeId=4f8845b3-7744-4ec1-9404-43c3d1f00000, rmtAddr=/127.0.0.1:51177, rmtPort=51177] [21:02:02] : [Step 4/5] [2021-11-19 21:02:02,936][INFO ][tcp-disco-sock-reader-[]-#93%internal.ClusterBaselineNodesMetricsSelfTest1%-#1758%internal.ClusterBaselineNodesMetricsSelfTest1%][TestTcpDiscoverySpi] Finished writing ping response [rmtNodeId=4f8845b3-7744-4ec1-9404-43c3d1f00000, rmtAddr=/127.0.0.1:51177, rmtPort=51177] [21:02:02] : [Step 4/5] [2021-11-19 21:02:02,937][INFO ][tcp-disco-sock-reader-[f2be5aeb 127.0.0.1:38425]-#92%internal.ClusterBaselineNodesMetricsSelfTest0%-#1757%internal.ClusterBaselineNodesMetricsSelfTest0%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:38425, rmtPort=38425, rmtNodeId=f2be5aeb-dacc-4e5b-9786-82c46a500001] [21:02:02] : [Step 4/5] [2021-11-19 21:02:02,937][INFO ][tcp-disco-sock-reader-[]-#93%internal.ClusterBaselineNodesMetricsSelfTest1%-#1758%internal.ClusterBaselineNodesMetricsSelfTest1%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:51177, rmtPort=51177, rmtNodeId=null] [21:02:02] : [Step 4/5] [2021-11-19 21:02:02,941][INFO ][tcp-disco-msg-worker-[f054f218 127.0.0.1:47502 crd]-#59%internal.ClusterBaselineNodesMetricsSelfTest0%-#1233%internal.ClusterBaselineNodesMetricsSelfTest0%][GridEncryptionManager] Joining node doesn't have stored group keys [node=f2be5aeb-dacc-4e5b-9786-82c46a500001] [21:02:02] : [Step 4/5] [2021-11-19 21:02:02,962][INFO ][tcp-disco-msg-worker-[4f8845b3 127.0.0.1:47500]-#73%internal.ClusterBaselineNodesMetricsSelfTest2%-#1502%internal.ClusterBaselineNodesMetricsSelfTest2%][TestTcpDiscoverySpi] New next node [newNext=TcpDiscoveryNode [id=f2be5aeb-dacc-4e5b-9786-82c46a500001, consistentId=internal.ClusterBaselineNodesMetricsSelfTest1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=0, intOrder=5, lastExchangeTime=1637344922950, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false]] [21:02:02] : [Step 4/5] [2021-11-19 21:02:02,963][INFO ][tcp-disco-sock-reader-[f054f218 127.0.0.1:36355]-#78%internal.ClusterBaselineNodesMetricsSelfTest0%-#1507%internal.ClusterBaselineNodesMetricsSelfTest0%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:36355, rmtPort=36355, rmtNodeId=f054f218-1e85-4528-9e50-191c6f500002] [21:02:02] : [Step 4/5] [2021-11-19 21:02:02,964][INFO ][tcp-disco-srvr-[:47501]-#91%internal.ClusterBaselineNodesMetricsSelfTest1%-#1756%internal.ClusterBaselineNodesMetricsSelfTest1%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=33625] [21:02:02] : [Step 4/5] [2021-11-19 21:02:02,965][INFO ][tcp-disco-srvr-[:47501]-#91%internal.ClusterBaselineNodesMetricsSelfTest1%-#1756%internal.ClusterBaselineNodesMetricsSelfTest1%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=33625] [21:02:02] : [Step 4/5] [2021-11-19 21:02:02,966][INFO ][tcp-disco-sock-reader-[]-#94%internal.ClusterBaselineNodesMetricsSelfTest1%-#1759%internal.ClusterBaselineNodesMetricsSelfTest1%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:33625, rmtPort=33625] [21:02:02] : [Step 4/5] [2021-11-19 21:02:02,968][INFO ][tcp-disco-sock-reader-[f054f218 127.0.0.1:33625]-#94%internal.ClusterBaselineNodesMetricsSelfTest1%-#1759%internal.ClusterBaselineNodesMetricsSelfTest1%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=f054f218-1e85-4528-9e50-191c6f500002, rmtAddr=/127.0.0.1:33625] [21:02:02] : [Step 4/5] [2021-11-19 21:02:02,977][INFO ][tcp-disco-msg-worker-[]-#90%internal.ClusterBaselineNodesMetricsSelfTest1%-#1755%internal.ClusterBaselineNodesMetricsSelfTest1%][TestTcpDiscoverySpi] New next node [newNext=TcpDiscoveryNode [id=4f8845b3-7744-4ec1-9404-43c3d1f00000, consistentId=internal.ClusterBaselineNodesMetricsSelfTest0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637344922971, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false]] [21:02:02] : [Step 4/5] [2021-11-19 21:02:02,979][INFO ][tcp-disco-srvr-[:47500]-#60%internal.ClusterBaselineNodesMetricsSelfTest0%-#1234%internal.ClusterBaselineNodesMetricsSelfTest0%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=55651] [21:02:02] : [Step 4/5] [2021-11-19 21:02:02,979][INFO ][tcp-disco-srvr-[:47500]-#60%internal.ClusterBaselineNodesMetricsSelfTest0%-#1234%internal.ClusterBaselineNodesMetricsSelfTest0%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=55651] [21:02:02] : [Step 4/5] [2021-11-19 21:02:02,980][INFO ][tcp-disco-sock-reader-[]-#95%internal.ClusterBaselineNodesMetricsSelfTest0%-#1760%internal.ClusterBaselineNodesMetricsSelfTest0%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:55651, rmtPort=55651] [21:02:02] : [Step 4/5] [2021-11-19 21:02:02,983][INFO ][tcp-disco-sock-reader-[f2be5aeb 127.0.0.1:55651]-#95%internal.ClusterBaselineNodesMetricsSelfTest0%-#1760%internal.ClusterBaselineNodesMetricsSelfTest0%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=f2be5aeb-dacc-4e5b-9786-82c46a500001, rmtAddr=/127.0.0.1:55651] [21:02:02] : [Step 4/5] [2021-11-19 21:02:02,989][INFO ][disco-event-worker-#1236%internal.ClusterBaselineNodesMetricsSelfTest0%][GridDiscoveryManager] Added new node to topology: TcpDiscoveryNode [id=f2be5aeb-dacc-4e5b-9786-82c46a500001, consistentId=internal.ClusterBaselineNodesMetricsSelfTest1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=6, intOrder=5, lastExchangeTime=1637344922930, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false] [21:02:02] : [Step 4/5] [2021-11-19 21:02:02,990][INFO ][disco-event-worker-#1509%internal.ClusterBaselineNodesMetricsSelfTest2%][GridDiscoveryManager] Added new node to topology: TcpDiscoveryNode [id=f2be5aeb-dacc-4e5b-9786-82c46a500001, consistentId=internal.ClusterBaselineNodesMetricsSelfTest1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=6, intOrder=5, lastExchangeTime=1637344922950, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false] [21:02:02] : [Step 4/5] [2021-11-19 21:02:02,991][INFO ][disco-event-worker-#1509%internal.ClusterBaselineNodesMetricsSelfTest2%][GridDiscoveryManager] Topology snapshot [ver=6, locNode=f054f218, servers=3, clients=1, state=ACTIVE, CPUs=24, offheap=2.0GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=4f8845b3-7744-4ec1-9404-43c3d1f00000, consistentId=internal.ClusterBaselineNodesMetricsSelfTest0, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=f054f218-1e85-4528-9e50-191c6f500002, consistentId=internal.ClusterBaselineNodesMetricsSelfTest2, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=a3cd6747-87a1-4b63-a114-5ba56c600003, consistentId=internal.ClusterBaselineNodesMetricsSelfTest3, isClient=true, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=f2be5aeb-dacc-4e5b-9786-82c46a500001, consistentId=internal.ClusterBaselineNodesMetricsSelfTest1, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:02:02] : [Step 4/5] [2021-11-19 21:02:02,990][INFO ][tcp-client-disco-msg-worker-#84%internal.ClusterBaselineNodesMetricsSelfTest3%-#1614%internal.ClusterBaselineNodesMetricsSelfTest3%][TestTcpDiscoverySpi] Router node: TcpDiscoveryNode [id=4f8845b3-7744-4ec1-9404-43c3d1f00000, consistentId=internal.ClusterBaselineNodesMetricsSelfTest0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637344919624, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false] [21:02:02] : [Step 4/5] [2021-11-19 21:02:02,993][INFO ][disco-event-worker-#1509%internal.ClusterBaselineNodesMetricsSelfTest2%][GridDiscoveryManager] ^-- Baseline [id=0, size=2, online=2, offline=0] [21:02:02] : [Step 4/5] [2021-11-19 21:02:02,991][INFO ][disco-event-worker-#1236%internal.ClusterBaselineNodesMetricsSelfTest0%][GridDiscoveryManager] Topology snapshot [ver=6, locNode=4f8845b3, servers=3, clients=1, state=ACTIVE, CPUs=24, offheap=2.0GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=4f8845b3-7744-4ec1-9404-43c3d1f00000, consistentId=internal.ClusterBaselineNodesMetricsSelfTest0, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=f054f218-1e85-4528-9e50-191c6f500002, consistentId=internal.ClusterBaselineNodesMetricsSelfTest2, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=a3cd6747-87a1-4b63-a114-5ba56c600003, consistentId=internal.ClusterBaselineNodesMetricsSelfTest3, isClient=true, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=f2be5aeb-dacc-4e5b-9786-82c46a500001, consistentId=internal.ClusterBaselineNodesMetricsSelfTest1, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:02:02] : [Step 4/5] [2021-11-19 21:02:02,995][INFO ][exchange-worker-#1510%internal.ClusterBaselineNodesMetricsSelfTest2%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=6, minorTopVer=0], crd=false, evt=NODE_JOINED, evtNode=f2be5aeb-dacc-4e5b-9786-82c46a500001, customEvt=null, allowMerge=true, exchangeFreeSwitch=false] [21:02:02] : [Step 4/5] [2021-11-19 21:02:02,995][INFO ][disco-event-worker-#1619%internal.ClusterBaselineNodesMetricsSelfTest3%][GridDiscoveryManager] Added new node to topology: TcpDiscoveryNode [id=f2be5aeb-dacc-4e5b-9786-82c46a500001, consistentId=internal.ClusterBaselineNodesMetricsSelfTest1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=6, intOrder=5, lastExchangeTime=1637344922950, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false] [21:02:02] : [Step 4/5] [2021-11-19 21:02:02,997][INFO ][exchange-worker-#1510%internal.ClusterBaselineNodesMetricsSelfTest2%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=6, minorTopVer=0], waitTime=0ms, futInfo=NA, mode=DISTRIBUTED] [21:02:02] : [Step 4/5] [2021-11-19 21:02:02,996][INFO ][disco-event-worker-#1236%internal.ClusterBaselineNodesMetricsSelfTest0%][GridDiscoveryManager] ^-- Baseline [id=0, size=2, online=2, offline=0] [21:02:03] : [Step 4/5] [2021-11-19 21:02:02,998][INFO ][disco-event-worker-#1619%internal.ClusterBaselineNodesMetricsSelfTest3%][GridDiscoveryManager] Topology snapshot [ver=6, locNode=a3cd6747, servers=3, clients=1, state=ACTIVE, CPUs=24, offheap=2.0GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=a3cd6747-87a1-4b63-a114-5ba56c600003, consistentId=internal.ClusterBaselineNodesMetricsSelfTest3, isClient=true, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=4f8845b3-7744-4ec1-9404-43c3d1f00000, consistentId=internal.ClusterBaselineNodesMetricsSelfTest0, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=f054f218-1e85-4528-9e50-191c6f500002, consistentId=internal.ClusterBaselineNodesMetricsSelfTest2, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=f2be5aeb-dacc-4e5b-9786-82c46a500001, consistentId=internal.ClusterBaselineNodesMetricsSelfTest1, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:02:03] : [Step 4/5] [2021-11-19 21:02:03,000][INFO ][disco-event-worker-#1619%internal.ClusterBaselineNodesMetricsSelfTest3%][GridDiscoveryManager] ^-- Baseline [id=0, size=2, online=2, offline=0] [21:02:03] : [Step 4/5] [2021-11-19 21:02:03,001][INFO ][disco-notifier-worker-#1754%internal.ClusterBaselineNodesMetricsSelfTest1%][MvccProcessorImpl] Assigned mvcc coordinator [crd=MvccCoordinator [topVer=AffinityTopologyVersion [topVer=6, minorTopVer=0], nodeId=4f8845b3-7744-4ec1-9404-43c3d1f00000, ver=1637344913679, local=false, initialized=false]] [21:02:03] : [Step 4/5] [2021-11-19 21:02:02,999][INFO ][exchange-worker-#1237%internal.ClusterBaselineNodesMetricsSelfTest0%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=6, minorTopVer=0], crd=true, evt=NODE_JOINED, evtNode=f2be5aeb-dacc-4e5b-9786-82c46a500001, customEvt=null, allowMerge=true, exchangeFreeSwitch=false] [21:02:03] : [Step 4/5] [2021-11-19 21:02:03,006][INFO ][exchange-worker-#1237%internal.ClusterBaselineNodesMetricsSelfTest0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=6, minorTopVer=0], waitTime=0ms, futInfo=NA, mode=DISTRIBUTED] [21:02:03] : [Step 4/5] [2021-11-19 21:02:03,002][INFO ][sys-#1749%internal.ClusterBaselineNodesMetricsSelfTest1%][ClusterProcessor] Writing cluster ID and tag to metastorage on ready for write ClusterIdAndTag [id=aeea33f2-f76a-4ae8-9c30-3b901d5f028f, tag=affectionate_sanderson] [21:02:03] : [Step 4/5] [2021-11-19 21:02:03,007][INFO ][exchange-worker-#1510%internal.ClusterBaselineNodesMetricsSelfTest2%][GridDhtPartitionsExchangeFuture] Finished waiting for partitions release latch: ClientLatch [coordinator=TcpDiscoveryNode [id=4f8845b3-7744-4ec1-9404-43c3d1f00000, consistentId=internal.ClusterBaselineNodesMetricsSelfTest0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637344918402, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], ackSent=true, super=CompletableLatch [id=CompletableLatchUid [id=exchange, topVer=AffinityTopologyVersion [topVer=6, minorTopVer=0]]]] [21:02:03]W: [org.apache.ignite:ignite-core] [2021-11-19 21:02:03,001][WARN ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][ClusterBaselineNodesMetricsSelfTest1] Nodes started on local machine require more than 80% of physical RAM what can lead to significant slowdown due to swapping (please decrease JVM heap size, data region size or checkpoint buffer size) [required=15762MB, available=15360MB] [21:02:03] : [Step 4/5] [2021-11-19 21:02:03,001][INFO ][exchange-worker-#1620%internal.ClusterBaselineNodesMetricsSelfTest3%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=6, minorTopVer=0], crd=false, evt=NODE_JOINED, evtNode=f2be5aeb-dacc-4e5b-9786-82c46a500001, customEvt=null, allowMerge=true, exchangeFreeSwitch=false] [21:02:03] : [Step 4/5] [2021-11-19 21:02:03,009][INFO ][exchange-worker-#1510%internal.ClusterBaselineNodesMetricsSelfTest2%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=6, minorTopVer=0], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:02:03] : [Step 4/5] [2021-11-19 21:02:03,007][INFO ][exchange-worker-#1237%internal.ClusterBaselineNodesMetricsSelfTest0%][GridDhtPartitionsExchangeFuture] Finished waiting for partitions release latch: ServerLatch [permits=0, pendingAcks=HashSet [], super=CompletableLatch [id=CompletableLatchUid [id=exchange, topVer=AffinityTopologyVersion [topVer=6, minorTopVer=0]]]] [21:02:03] : [Step 4/5] [2021-11-19 21:02:03,010][INFO ][exchange-worker-#1620%internal.ClusterBaselineNodesMetricsSelfTest3%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=6, minorTopVer=0], crd=false] [21:02:03] : [Step 4/5] [2021-11-19 21:02:03,011][INFO ][exchange-worker-#1510%internal.ClusterBaselineNodesMetricsSelfTest2%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=6, minorTopVer=0], crd=false] [21:02:03] : [Step 4/5] [2021-11-19 21:02:03,011][INFO ][exchange-worker-#1237%internal.ClusterBaselineNodesMetricsSelfTest0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=6, minorTopVer=0], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:02:03] : [Step 4/5] [2021-11-19 21:02:03,013][INFO ][exchange-worker-#1237%internal.ClusterBaselineNodesMetricsSelfTest0%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=6, minorTopVer=0], crd=true] [21:02:03] : [Step 4/5] [2021-11-19 21:02:03,013][INFO ][sys-#1212%internal.ClusterBaselineNodesMetricsSelfTest0%][GridDhtPartitionsExchangeFuture] Coordinator received single message [ver=AffinityTopologyVersion [topVer=6, minorTopVer=0], node=f054f218-1e85-4528-9e50-191c6f500002, remainingNodes=1, allReceived=false] [21:02:03] : [Step 4/5] [2021-11-19 21:02:03,031][INFO ][exchange-worker-#1763%internal.ClusterBaselineNodesMetricsSelfTest1%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=6, minorTopVer=0], crd=false, evt=NODE_JOINED, evtNode=f2be5aeb-dacc-4e5b-9786-82c46a500001, customEvt=null, allowMerge=true, exchangeFreeSwitch=false] [21:02:03] : [Step 4/5] [2021-11-19 21:02:03,032][INFO ][exchange-worker-#1763%internal.ClusterBaselineNodesMetricsSelfTest1%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/clusterbaselinenodesmetricsselftest/testBaselineNodes/internal_ClusterBaselineNodesMetricsSelfTest1 [21:02:03] : [Step 4/5] [2021-11-19 21:02:03,040][INFO ][exchange-worker-#1763%internal.ClusterBaselineNodesMetricsSelfTest1%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/clusterbaselinenodesmetricsselftest/testBaselineNodes/wal/internal_ClusterBaselineNodesMetricsSelfTest1/0000000000000000.wal, offset=89018, ver=2] [21:02:03] : [Step 4/5] [2021-11-19 21:02:03,046][INFO ][exchange-worker-#1763%internal.ClusterBaselineNodesMetricsSelfTest1%][GridClusterStateProcessor] Writing BaselineTopology[id=0] [21:02:03] : [Step 4/5] [2021-11-19 21:02:03,054][INFO ][exchange-worker-#1763%internal.ClusterBaselineNodesMetricsSelfTest1%][GridCacheDatabaseSharedManager] Finish recovery performed in 21 ms. [21:02:03] : [Step 4/5] [2021-11-19 21:02:03,056][INFO ][exchange-worker-#1763%internal.ClusterBaselineNodesMetricsSelfTest1%][msg] Components activation performed in 24 ms. [21:02:03] : [Step 4/5] [2021-11-19 21:02:03,058][INFO ][exchange-worker-#1763%internal.ClusterBaselineNodesMetricsSelfTest1%][GridCacheProcessor] Finished recovery for cache [cache=ignite-sys-cache, grp=ignite-sys-cache, startVer=AffinityTopologyVersion [topVer=6, minorTopVer=0]] [21:02:03] : [Step 4/5] [2021-11-19 21:02:03,058][INFO ][exchange-worker-#1763%internal.ClusterBaselineNodesMetricsSelfTest1%][GridCacheProcessor] Starting caches on local join performed in 0 ms. [21:02:03] : [Step 4/5] [2021-11-19 21:02:03,059][INFO ][exchange-worker-#1763%internal.ClusterBaselineNodesMetricsSelfTest1%][GridDhtPartitionsExchangeFuture] Skipped waiting for partitions release future (local node is joining) [topVer=AffinityTopologyVersion [topVer=6, minorTopVer=0]] [21:02:03] : [Step 4/5] [2021-11-19 21:02:03,075][INFO ][grid-nio-worker-tcp-comm-3-#1178%TcpCommunicationSpi%][TcpCommunicationSpi] Accepted incoming communication connection [locAddr=/127.0.0.1:45020, rmtAddr=/127.0.0.1:47252] [21:02:03] : [Step 4/5] [2021-11-19 21:02:03,082][INFO ][grid-nio-worker-tcp-comm-0-#1697%TcpCommunicationSpi%][TcpCommunicationSpi] Established outgoing communication connection [locAddr=/127.0.0.1:47252, rmtAddr=/127.0.0.1:45020] [21:02:03] : [Step 4/5] [2021-11-19 21:02:03,083][INFO ][exchange-worker-#1763%internal.ClusterBaselineNodesMetricsSelfTest1%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=6, minorTopVer=0], crd=false] [21:02:03] : [Step 4/5] [2021-11-19 21:02:03,085][INFO ][sys-#1215%internal.ClusterBaselineNodesMetricsSelfTest0%][GridDhtPartitionsExchangeFuture] Coordinator received single message [ver=AffinityTopologyVersion [topVer=6, minorTopVer=0], node=f2be5aeb-dacc-4e5b-9786-82c46a500001, allReceived=true] [21:02:03] : [Step 4/5] [2021-11-19 21:02:03,085][INFO ][sys-#1215%internal.ClusterBaselineNodesMetricsSelfTest0%][GridDhtPartitionsExchangeFuture] Coordinator received all messages, try merge [ver=AffinityTopologyVersion [topVer=6, minorTopVer=0]] [21:02:03] : [Step 4/5] [2021-11-19 21:02:03,086][INFO ][sys-#1215%internal.ClusterBaselineNodesMetricsSelfTest0%][GridDhtPartitionsExchangeFuture] finishExchangeOnCoordinator [topVer=AffinityTopologyVersion [topVer=6, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=6, minorTopVer=0]] [21:02:03] : [Step 4/5] [2021-11-19 21:02:03,106][INFO ][sys-#1215%internal.ClusterBaselineNodesMetricsSelfTest0%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=6, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=6, minorTopVer=0], err=null, rebalanced=false, wasRebalanced=true] [21:02:03] : [Step 4/5] [2021-11-19 21:02:03,112][INFO ][sys-#1731%internal.ClusterBaselineNodesMetricsSelfTest1%][GridDhtPartitionsExchangeFuture] Received full message, will finish exchange [node=4f8845b3-7744-4ec1-9404-43c3d1f00000, resVer=AffinityTopologyVersion [topVer=6, minorTopVer=0]] [21:02:03] : [Step 4/5] [2021-11-19 21:02:03,107][INFO ][sys-#1498%internal.ClusterBaselineNodesMetricsSelfTest2%][GridDhtPartitionsExchangeFuture] Received full message, will finish exchange [node=4f8845b3-7744-4ec1-9404-43c3d1f00000, resVer=AffinityTopologyVersion [topVer=6, minorTopVer=0]] [21:02:03] : [Step 4/5] [2021-11-19 21:02:03,210][INFO ][exchange-worker-#1237%internal.ClusterBaselineNodesMetricsSelfTest0%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=6, minorTopVer=0], force=false, evt=NODE_JOINED, node=f2be5aeb-dacc-4e5b-9786-82c46a500001] [21:02:03] : [Step 4/5] [2021-11-19 21:02:03,209][INFO ][sys-#1215%internal.ClusterBaselineNodesMetricsSelfTest0%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=4f8845b3-7744-4ec1-9404-43c3d1f00000, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=6, minorTopVer=0], evt=NODE_JOINED, evtNode=TcpDiscoveryNode [id=f2be5aeb-dacc-4e5b-9786-82c46a500001, consistentId=internal.ClusterBaselineNodesMetricsSelfTest1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=6, intOrder=5, lastExchangeTime=1637344922930, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=false, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=6, minorTopVer=0]] [21:02:03] : [Step 4/5] [2021-11-19 21:02:03,211][INFO ][sys-#1731%internal.ClusterBaselineNodesMetricsSelfTest1%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=6, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=6, minorTopVer=0], err=null, rebalanced=false, wasRebalanced=false] [21:02:03] : [Step 4/5] [2021-11-19 21:02:03,211][INFO ][sys-#1498%internal.ClusterBaselineNodesMetricsSelfTest2%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=6, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=6, minorTopVer=0], err=null, rebalanced=false, wasRebalanced=true] [21:02:03] : [Step 4/5] [2021-11-19 21:02:03,216][INFO ][sys-#1731%internal.ClusterBaselineNodesMetricsSelfTest1%][GridCacheProcessor] Finish proxy initialization, cacheName=ignite-sys-cache, localNodeId=f2be5aeb-dacc-4e5b-9786-82c46a500001 [21:02:03] : [Step 4/5] [2021-11-19 21:02:03,217][INFO ][exchange-worker-#1510%internal.ClusterBaselineNodesMetricsSelfTest2%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=6, minorTopVer=0], force=false, evt=NODE_JOINED, node=f2be5aeb-dacc-4e5b-9786-82c46a500001] [21:02:03] : [Step 4/5] [2021-11-19 21:02:03,212][INFO ][sys-#1215%internal.ClusterBaselineNodesMetricsSelfTest0%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=6, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=6, minorTopVer=0], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (6 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Wait partitions release latch [latch=exchange]" (4 ms), stage="Wait partitions release [latch=exchange]" (1 ms), stage="After states restored callback" (0 ms), stage="WAL history reservation" (0 ms), stage="Waiting for all single messages" (72 ms), stage="Exchanges merge" (0 ms), stage="Affinity recalculation (crd)" (2 ms), stage="Collect update counters and create affinity messages" (4 ms), stage="Assign partitions states" (1 ms), stage="Validate partitions states" (0 ms), stage="Apply update counters" (0 ms), stage="Full message preparing" (10 ms), stage="Full message sending" (0 ms), stage="Exchange done" (106 ms), stage="Total time" (206 ms), Discovery lag=7 ms, Latest started node id=f2be5aeb-dacc-4e5b-9786-82c46a500001] [21:02:03] : [Step 4/5] [2021-11-19 21:02:03,217][INFO ][exchange-worker-#1763%internal.ClusterBaselineNodesMetricsSelfTest1%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=6, minorTopVer=0], force=false, evt=NODE_JOINED, node=f2be5aeb-dacc-4e5b-9786-82c46a500001] [21:02:03] : [Step 4/5] [2021-11-19 21:02:03,217][INFO ][sys-#1731%internal.ClusterBaselineNodesMetricsSelfTest1%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=f2be5aeb-dacc-4e5b-9786-82c46a500001, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=6, minorTopVer=0], evt=NODE_JOINED, evtNode=TcpDiscoveryNode [id=f2be5aeb-dacc-4e5b-9786-82c46a500001, consistentId=internal.ClusterBaselineNodesMetricsSelfTest1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=6, intOrder=5, lastExchangeTime=1637344923016, loc=true, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=false, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=6, minorTopVer=0]] [21:02:03] : [Step 4/5] [2021-11-19 21:02:03,217][INFO ][sys-#1498%internal.ClusterBaselineNodesMetricsSelfTest2%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=f054f218-1e85-4528-9e50-191c6f500002, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=6, minorTopVer=0], evt=NODE_JOINED, evtNode=TcpDiscoveryNode [id=f2be5aeb-dacc-4e5b-9786-82c46a500001, consistentId=internal.ClusterBaselineNodesMetricsSelfTest1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=6, intOrder=5, lastExchangeTime=1637344922950, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=false, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=6, minorTopVer=0]] [21:02:03] : [Step 4/5] [2021-11-19 21:02:03,222][INFO ][sys-#1731%internal.ClusterBaselineNodesMetricsSelfTest1%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=6, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=6, minorTopVer=0], stage="Waiting in exchange queue" (29 ms), stage="Exchange parameters initialization" (0 ms), stage="Components activation" (25 ms), stage="Determine exchange type" (2 ms), stage="Preloading notification" (0 ms), stage="Restore partition states" (1 ms), stage="After states restored callback" (9 ms), stage="WAL history reservation" (0 ms), stage="Waiting for Full message" (41 ms), stage="Affinity recalculation" (98 ms), stage="Full map updating" (0 ms), stage="Exchange done" (10 ms), stage="Total time" (215 ms)] [21:02:03] : [Step 4/5] [2021-11-19 21:02:03,225][INFO ][sys-#1731%internal.ClusterBaselineNodesMetricsSelfTest1%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=6, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=6, minorTopVer=0], stage="Affinity fetch" (2 ms) (parent=Determine exchange type), stage="Restore partition states [grp=ignite-sys-cache]" (1 ms) (parent=Restore partition states), stage="Affinity initialization (local join) [grp=ignite-sys-cache]" (98 ms) (parent=Affinity recalculation)] [21:02:03] : [Step 4/5] [2021-11-19 21:02:03,220][INFO ][sys-#1215%internal.ClusterBaselineNodesMetricsSelfTest0%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=6, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=6, minorTopVer=0], stage="Affinity initialization (node join) [grp=ignite-sys-cache, crd=true]" (1 ms) (parent=Affinity recalculation (crd))] [21:02:03] : [Step 4/5] [2021-11-19 21:02:03,223][INFO ][sys-#1498%internal.ClusterBaselineNodesMetricsSelfTest2%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=6, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=6, minorTopVer=0], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (1 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (1 ms), stage="Wait partitions release latch [latch=exchange]" (10 ms), stage="Wait partitions release [latch=exchange]" (1 ms), stage="After states restored callback" (0 ms), stage="WAL history reservation" (0 ms), stage="Waiting for Full message" (96 ms), stage="Affinity recalculation" (103 ms), stage="Full map updating" (0 ms), stage="Exchange done" (12 ms), stage="Total time" (224 ms)] [21:02:03] : [Step 4/5] [2021-11-19 21:02:03,230][INFO ][sys-#1498%internal.ClusterBaselineNodesMetricsSelfTest2%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=6, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=6, minorTopVer=0], stage="Affinity initialization (node join) [grp=ignite-sys-cache, crd=false]" (103 ms) (parent=Affinity recalculation)] [21:02:03] : [Step 4/5] [2021-11-19 21:02:03,246][INFO ][sys-#1774%internal.ClusterBaselineNodesMetricsSelfTest3%][GridDhtPartitionsExchangeFuture] Received full message, will finish exchange [node=4f8845b3-7744-4ec1-9404-43c3d1f00000, resVer=AffinityTopologyVersion [topVer=6, minorTopVer=0]] [21:02:03] : [Step 4/5] [2021-11-19 21:02:03,254][INFO ][exchange-worker-#1237%internal.ClusterBaselineNodesMetricsSelfTest0%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=6, minorTopVer=1], crd=true, evt=DISCOVERY_CUSTOM_EVT, evtNode=4f8845b3-7744-4ec1-9404-43c3d1f00000, customEvt=CacheAffinityChangeMessage [id=4f4ac593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, topVer=AffinityTopologyVersion [topVer=6, minorTopVer=0], exchId=null, partsMsg=null, exchangeNeeded=true], allowMerge=false, exchangeFreeSwitch=false] [21:02:03] : [Step 4/5] [2021-11-19 21:02:03,256][INFO ][exchange-worker-#1510%internal.ClusterBaselineNodesMetricsSelfTest2%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=6, minorTopVer=1], crd=false, evt=DISCOVERY_CUSTOM_EVT, evtNode=4f8845b3-7744-4ec1-9404-43c3d1f00000, customEvt=CacheAffinityChangeMessage [id=4f4ac593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, topVer=AffinityTopologyVersion [topVer=6, minorTopVer=0], exchId=null, partsMsg=null, exchangeNeeded=true], allowMerge=false, exchangeFreeSwitch=false] [21:02:03] : [Step 4/5] [2021-11-19 21:02:03,258][INFO ][exchange-worker-#1510%internal.ClusterBaselineNodesMetricsSelfTest2%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=6, minorTopVer=1], waitTime=0ms, futInfo=NA, mode=DISTRIBUTED] [21:02:03] : [Step 4/5] [2021-11-19 21:02:03,256][INFO ][exchange-worker-#1237%internal.ClusterBaselineNodesMetricsSelfTest0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=6, minorTopVer=1], waitTime=0ms, futInfo=NA, mode=DISTRIBUTED] [21:02:03] : [Step 4/5] [2021-11-19 21:02:03,257][INFO ][exchange-worker-#1763%internal.ClusterBaselineNodesMetricsSelfTest1%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=6, minorTopVer=1], crd=false, evt=DISCOVERY_CUSTOM_EVT, evtNode=4f8845b3-7744-4ec1-9404-43c3d1f00000, customEvt=CacheAffinityChangeMessage [id=4f4ac593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, topVer=AffinityTopologyVersion [topVer=6, minorTopVer=0], exchId=null, partsMsg=null, exchangeNeeded=true], allowMerge=false, exchangeFreeSwitch=false] [21:02:03] : [Step 4/5] [2021-11-19 21:02:03,257][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][ClusterBaselineNodesMetricsSelfTest1] To start Console Management & Monitoring run ignitevisorcmd.{sh|bat} [21:02:03] : [Step 4/5] [2021-11-19 21:02:03,262][INFO ][exchange-worker-#1763%internal.ClusterBaselineNodesMetricsSelfTest1%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=6, minorTopVer=1], waitTime=0ms, futInfo=NA, mode=DISTRIBUTED] [21:02:03] : [Step 4/5] [2021-11-19 21:02:03,260][INFO ][sys-#1774%internal.ClusterBaselineNodesMetricsSelfTest3%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=6, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=6, minorTopVer=0], err=null, rebalanced=false, wasRebalanced=true] [21:02:03] : [Step 4/5] [2021-11-19 21:02:03,264][INFO ][exchange-worker-#1620%internal.ClusterBaselineNodesMetricsSelfTest3%][GridCachePartitionExchangeManager] AffinityTopologyVersion [topVer=6, minorTopVer=0], evt=NODE_JOINED, evtNode=f2be5aeb-dacc-4e5b-9786-82c46a500001, client=true] [21:02:03] : [Step 4/5] [2021-11-19 21:02:03,262][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][ClusterBaselineNodesMetricsSelfTest1] [21:02:03] : [Step 4/5] [21:02:03] : [Step 4/5] >>> +-------------------------------------------+ [21:02:03] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:02:03] : [Step 4/5] >>> +-------------------------------------------+ [21:02:03] : [Step 4/5] >>> OS name: Linux 4.15.0-151-generic amd64 [21:02:03] : [Step 4/5] >>> CPU(s): 24 [21:02:03] : [Step 4/5] >>> Heap: 2.0GB [21:02:03] : [Step 4/5] >>> VM name: 16724@c4dfe9a430b2 [21:02:03] : [Step 4/5] >>> Ignite instance name: internal.ClusterBaselineNodesMetricsSelfTest1 [21:02:03] : [Step 4/5] >>> Local node [ID=F2BE5AEB-DACC-4E5B-9786-82C46A500001, order=6, clientMode=false] [21:02:03] : [Step 4/5] >>> Local node addresses: [127.0.0.1] [21:02:03] : [Step 4/5] >>> Local ports: TCP:10801 TCP:45021 TCP:47501 [21:02:03] : [Step 4/5] [21:02:03] : [Step 4/5] [2021-11-19 21:02:03,266][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][GridDiscoveryManager] Topology snapshot [ver=6, locNode=f2be5aeb, servers=3, clients=1, state=ACTIVE, CPUs=24, offheap=2.0GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=4f8845b3-7744-4ec1-9404-43c3d1f00000, consistentId=internal.ClusterBaselineNodesMetricsSelfTest0, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=f054f218-1e85-4528-9e50-191c6f500002, consistentId=internal.ClusterBaselineNodesMetricsSelfTest2, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=a3cd6747-87a1-4b63-a114-5ba56c600003, consistentId=internal.ClusterBaselineNodesMetricsSelfTest3, isClient=true, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=f2be5aeb-dacc-4e5b-9786-82c46a500001, consistentId=internal.ClusterBaselineNodesMetricsSelfTest1, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:02:03] : [Step 4/5] [2021-11-19 21:02:03,265][INFO ][exchange-worker-#1763%internal.ClusterBaselineNodesMetricsSelfTest1%][GridDhtPartitionsExchangeFuture] Finished waiting for partitions release latch: ClientLatch [coordinator=TcpDiscoveryNode [id=4f8845b3-7744-4ec1-9404-43c3d1f00000, consistentId=internal.ClusterBaselineNodesMetricsSelfTest0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637344922971, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], ackSent=true, super=CompletableLatch [id=CompletableLatchUid [id=exchange, topVer=AffinityTopologyVersion [topVer=6, minorTopVer=1]]]] [21:02:03] : [Step 4/5] [2021-11-19 21:02:03,265][INFO ][exchange-worker-#1510%internal.ClusterBaselineNodesMetricsSelfTest2%][GridDhtPartitionsExchangeFuture] Finished waiting for partitions release latch: ClientLatch [coordinator=TcpDiscoveryNode [id=4f8845b3-7744-4ec1-9404-43c3d1f00000, consistentId=internal.ClusterBaselineNodesMetricsSelfTest0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637344918402, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], ackSent=true, super=CompletableLatch [id=CompletableLatchUid [id=exchange, topVer=AffinityTopologyVersion [topVer=6, minorTopVer=1]]]] [21:02:03] : [Step 4/5] [2021-11-19 21:02:03,265][INFO ][exchange-worker-#1620%internal.ClusterBaselineNodesMetricsSelfTest3%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=6, minorTopVer=1], crd=false, evt=DISCOVERY_CUSTOM_EVT, evtNode=4f8845b3-7744-4ec1-9404-43c3d1f00000, customEvt=CacheAffinityChangeMessage [id=4f4ac593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, topVer=AffinityTopologyVersion [topVer=6, minorTopVer=0], exchId=null, partsMsg=null, exchangeNeeded=true], allowMerge=false, exchangeFreeSwitch=false] [21:02:03] : [Step 4/5] [2021-11-19 21:02:03,265][INFO ][exchange-worker-#1237%internal.ClusterBaselineNodesMetricsSelfTest0%][GridDhtPartitionsExchangeFuture] Finished waiting for partitions release latch: ServerLatch [permits=0, pendingAcks=HashSet [], super=CompletableLatch [id=CompletableLatchUid [id=exchange, topVer=AffinityTopologyVersion [topVer=6, minorTopVer=1]]]] [21:02:03] : [Step 4/5] [2021-11-19 21:02:03,264][INFO ][sys-#1774%internal.ClusterBaselineNodesMetricsSelfTest3%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=a3cd6747-87a1-4b63-a114-5ba56c600003, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=6, minorTopVer=0], evt=NODE_JOINED, evtNode=TcpDiscoveryNode [id=f2be5aeb-dacc-4e5b-9786-82c46a500001, consistentId=internal.ClusterBaselineNodesMetricsSelfTest1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=6, intOrder=5, lastExchangeTime=1637344922950, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=false, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=6, minorTopVer=0]] [21:02:03] : [Step 4/5] [2021-11-19 21:02:03,272][INFO ][exchange-worker-#1620%internal.ClusterBaselineNodesMetricsSelfTest3%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=6, minorTopVer=1], crd=false] [21:02:03] : [Step 4/5] [2021-11-19 21:02:03,272][INFO ][exchange-worker-#1237%internal.ClusterBaselineNodesMetricsSelfTest0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=6, minorTopVer=1], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:02:03] : [Step 4/5] [2021-11-19 21:02:03,271][INFO ][exchange-worker-#1510%internal.ClusterBaselineNodesMetricsSelfTest2%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=6, minorTopVer=1], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:02:03] : [Step 4/5] [2021-11-19 21:02:03,269][INFO ][exchange-worker-#1763%internal.ClusterBaselineNodesMetricsSelfTest1%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=6, minorTopVer=1], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:02:03] : [Step 4/5] [2021-11-19 21:02:03,268][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][GridDiscoveryManager] ^-- Baseline [id=0, size=2, online=2, offline=0] [21:02:03] : [Step 4/5] [2021-11-19 21:02:03,275][INFO ][exchange-worker-#1510%internal.ClusterBaselineNodesMetricsSelfTest2%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=6, minorTopVer=1], crd=false] [21:02:03] : [Step 4/5] [2021-11-19 21:02:03,274][INFO ][exchange-worker-#1237%internal.ClusterBaselineNodesMetricsSelfTest0%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=6, minorTopVer=1], crd=true] [21:02:03] : [Step 4/5] [2021-11-19 21:02:03,273][INFO ][sys-#1774%internal.ClusterBaselineNodesMetricsSelfTest3%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=6, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=6, minorTopVer=0], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (8 ms), stage="Determine exchange type" (0 ms), stage="Waiting for Full message" (235 ms), stage="Affinity recalculation" (12 ms), stage="Full map updating" (2 ms), stage="Exchange done" (12 ms), stage="Total time" (269 ms)] [21:02:03] : [Step 4/5] [2021-11-19 21:02:03,277][INFO ][sys-#1774%internal.ClusterBaselineNodesMetricsSelfTest3%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=6, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=6, minorTopVer=0], stage="Affinity initialization (node join) [grp=ignite-sys-cache, crd=false]" (12 ms) (parent=Affinity recalculation)] [21:02:03] : [Step 4/5] [2021-11-19 21:02:03,276][INFO ][exchange-worker-#1763%internal.ClusterBaselineNodesMetricsSelfTest1%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=6, minorTopVer=1], crd=false] [21:02:03] : [Step 4/5] [2021-11-19 21:02:03,275][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][G] Node started : [stage="Configure system pool" (0 ms),stage="Start managers" (71 ms),stage="Configure binary metadata" (3 ms),stage="Start processors" (583 ms),stage="Start 'StanByClusterTestProvider' plugin" (0 ms),stage="Start 'PageMemory tracker plugin' plugin" (0 ms),stage="Start 'TestDistibutedConfigurationPlugin' plugin" (0 ms),stage="Start 'NodeValidationPluginProvider' plugin" (0 ms),stage="Init metastore" (649 ms),stage="Init and start regions" (9 ms),stage="Restore binary memory" (234 ms),stage="Restore logical state" (117 ms),stage="Finish recovery" (411 ms),stage="Join topology" (91 ms),stage="Await transition" (12 ms),stage="Await exchange" (261 ms),stage="Total time" (2441 ms)] [21:02:03] : [Step 4/5] [2021-11-19 21:02:03,275][INFO ][sys-#1226%internal.ClusterBaselineNodesMetricsSelfTest0%][GridDhtPartitionsExchangeFuture] Coordinator received single message [ver=AffinityTopologyVersion [topVer=6, minorTopVer=1], node=f054f218-1e85-4528-9e50-191c6f500002, remainingNodes=1, allReceived=false] [21:02:03] : [Step 4/5] [2021-11-19 21:02:03,280][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][root] Node started with the following configuration [id=f2be5aeb-dacc-4e5b-9786-82c46a500001, marshaller=BinaryMarshaller [], discovery=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=5000, ackTimeout=5000, marsh=JdkMarshaller [clsFilter=org.apache.ignite.marshaller.MarshallerUtils$1@7a379422], reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], binaryCfg=null, lateAff=true] [21:02:03] : [Step 4/5] [2021-11-19 21:02:03,280][INFO ][sys-#1209%internal.ClusterBaselineNodesMetricsSelfTest0%][GridDhtPartitionsExchangeFuture] Coordinator received single message [ver=AffinityTopologyVersion [topVer=6, minorTopVer=1], node=f2be5aeb-dacc-4e5b-9786-82c46a500001, allReceived=true] [21:02:03] : [Step 4/5] [2021-11-19 21:02:03,281][INFO ][test-runner-#1120%internal.ClusterBaselineNodesMetricsSelfTest%][root] >>> State #2: topology version = 6 [21:02:03] : [Step 4/5] [2021-11-19 21:02:03,282][INFO ][sys-#1209%internal.ClusterBaselineNodesMetricsSelfTest0%][GridDhtPartitionsExchangeFuture] finishExchangeOnCoordinator [topVer=AffinityTopologyVersion [topVer=6, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=6, minorTopVer=1]] [21:02:03] : [Step 4/5] [21:02:03] >>> Stopping test: ClusterBaselineNodesMetricsSelfTest#testBaselineNodes in 11065 ms <<< [21:02:03] : [Step 4/5] [2021-11-19 21:02:03,288][INFO ][main][root] >>> Stopping test: ClusterBaselineNodesMetricsSelfTest#testBaselineNodes in 11065 ms <<< [21:02:03] : [Step 4/5] [21:02:03] >>> Heap: 332 MB used / 1945 MB commited / 1945 MB max <<< [21:02:03] : [Step 4/5] [2021-11-19 21:02:03,289][INFO ][main][root] >>> Heap: 332 MB used / 1945 MB commited / 1945 MB max <<< [21:02:03] : [Step 4/5] [21:02:03] >>> Non-Heap: 110 MB used / 116 MB commited / 0 MB max <<< [21:02:03] : [Step 4/5] [2021-11-19 21:02:03,289][INFO ][main][root] >>> Non-Heap: 110 MB used / 116 MB commited / 0 MB max <<< [21:02:03] : [Step 4/5] [2021-11-19 21:02:03,289][INFO ][main][root] >>> Stopping grid [name=internal.ClusterBaselineNodesMetricsSelfTest3, id=a3cd6747-87a1-4b63-a114-5ba56c600003] [21:02:03] : [Step 4/5] [2021-11-19 21:02:03,290][INFO ][sys-#1209%internal.ClusterBaselineNodesMetricsSelfTest0%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=6, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=6, minorTopVer=1], err=null, rebalanced=true, wasRebalanced=false] [21:02:03] : [Step 4/5] [2021-11-19 21:02:03,295][INFO ][sys-#1485%internal.ClusterBaselineNodesMetricsSelfTest2%][GridDhtPartitionsExchangeFuture] Received full message, will finish exchange [node=4f8845b3-7744-4ec1-9404-43c3d1f00000, resVer=AffinityTopologyVersion [topVer=6, minorTopVer=1]] [21:02:03] : [Step 4/5] [2021-11-19 21:02:03,295][INFO ][sys-#1209%internal.ClusterBaselineNodesMetricsSelfTest0%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=4f8845b3-7744-4ec1-9404-43c3d1f00000, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=6, minorTopVer=1], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=4f8845b3-7744-4ec1-9404-43c3d1f00000, consistentId=internal.ClusterBaselineNodesMetricsSelfTest0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637344923254, loc=true, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=6, minorTopVer=1]] [21:02:03] : [Step 4/5] [2021-11-19 21:02:03,295][INFO ][sys-#1738%internal.ClusterBaselineNodesMetricsSelfTest1%][GridDhtPartitionsExchangeFuture] Received full message, will finish exchange [node=4f8845b3-7744-4ec1-9404-43c3d1f00000, resVer=AffinityTopologyVersion [topVer=6, minorTopVer=1]] [21:02:03] : [Step 4/5] [2021-11-19 21:02:03,305][INFO ][sys-#1784%internal.ClusterBaselineNodesMetricsSelfTest3%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=6, minorTopVer=1], resVer=null, err=class org.apache.ignite.internal.NodeStoppingException: Node is stopping: internal.ClusterBaselineNodesMetricsSelfTest3, rebalanced=false, wasRebalanced=false] [21:02:03] : [Step 4/5] [2021-11-19 21:02:03,302][INFO ][sys-#1485%internal.ClusterBaselineNodesMetricsSelfTest2%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=6, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=6, minorTopVer=1], err=null, rebalanced=true, wasRebalanced=false] [21:02:03] : [Step 4/5] [2021-11-19 21:02:03,296][INFO ][exchange-worker-#1237%internal.ClusterBaselineNodesMetricsSelfTest0%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=6, minorTopVer=1], force=false, evt=DISCOVERY_CUSTOM_EVT, node=4f8845b3-7744-4ec1-9404-43c3d1f00000] [21:02:03] : [Step 4/5] [2021-11-19 21:02:03,307][INFO ][exchange-worker-#1510%internal.ClusterBaselineNodesMetricsSelfTest2%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=6, minorTopVer=1], force=false, evt=DISCOVERY_CUSTOM_EVT, node=4f8845b3-7744-4ec1-9404-43c3d1f00000] [21:02:03] : [Step 4/5] [2021-11-19 21:02:03,307][INFO ][sys-#1784%internal.ClusterBaselineNodesMetricsSelfTest3%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=a3cd6747-87a1-4b63-a114-5ba56c600003, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=6, minorTopVer=1], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=4f8845b3-7744-4ec1-9404-43c3d1f00000, consistentId=internal.ClusterBaselineNodesMetricsSelfTest0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637344919624, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=false, done=true, newCrdFut=null], topVer=null] [21:02:03] : [Step 4/5] [2021-11-19 21:02:03,307][INFO ][sys-#1485%internal.ClusterBaselineNodesMetricsSelfTest2%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=f054f218-1e85-4528-9e50-191c6f500002, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=6, minorTopVer=1], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=4f8845b3-7744-4ec1-9404-43c3d1f00000, consistentId=internal.ClusterBaselineNodesMetricsSelfTest0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637344918402, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=6, minorTopVer=1]] [21:02:03] : [Step 4/5] [2021-11-19 21:02:03,306][INFO ][sys-#1209%internal.ClusterBaselineNodesMetricsSelfTest0%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=6, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=6, minorTopVer=1], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (1 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (4 ms), stage="Wait partitions release latch [latch=exchange]" (12 ms), stage="Wait partitions release [latch=exchange]" (1 ms), stage="After states restored callback" (0 ms), stage="WAL history reservation" (0 ms), stage="Waiting for all single messages" (7 ms), stage="Affinity recalculation (crd)" (5 ms), stage="Collect update counters and create affinity messages" (0 ms), stage="Validate partitions states" (0 ms), stage="Apply update counters" (0 ms), stage="Full message preparing" (1 ms), stage="Full message sending" (0 ms), stage="Exchange done" (16 ms), stage="Total time" (47 ms), Discovery lag=3 ms, Latest started node id=f2be5aeb-dacc-4e5b-9786-82c46a500001] [21:02:03] : [Step 4/5] [2021-11-19 21:02:03,306][INFO ][sys-#1738%internal.ClusterBaselineNodesMetricsSelfTest1%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=6, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=6, minorTopVer=1], err=null, rebalanced=true, wasRebalanced=false] [21:02:03] : [Step 4/5] [2021-11-19 21:02:03,313][INFO ][sys-#1209%internal.ClusterBaselineNodesMetricsSelfTest0%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=6, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=6, minorTopVer=1], stage="Affinity change by custom message [grp=ignite-sys-cache]" (0 ms) (parent=Determine exchange type)] [21:02:03] : [Step 4/5] [2021-11-19 21:02:03,311][INFO ][sys-#1485%internal.ClusterBaselineNodesMetricsSelfTest2%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=6, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=6, minorTopVer=1], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (1 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Wait partitions release latch [latch=exchange]" (11 ms), stage="Wait partitions release [latch=exchange]" (3 ms), stage="After states restored callback" (0 ms), stage="WAL history reservation" (0 ms), stage="Waiting for Full message" (20 ms), stage="Affinity recalculation" (0 ms), stage="Full map updating" (1 ms), stage="Exchange done" (13 ms), stage="Total time" (49 ms)] [21:02:03] : [Step 4/5] [2021-11-19 21:02:03,310][INFO ][sys-#1784%internal.ClusterBaselineNodesMetricsSelfTest3%][GridDhtPartitionsExchangeFuture] Received full message, will finish exchange [node=4f8845b3-7744-4ec1-9404-43c3d1f00000, resVer=AffinityTopologyVersion [topVer=6, minorTopVer=1]] [21:02:03] : [Step 4/5] [2021-11-19 21:02:03,316][INFO ][sys-#1485%internal.ClusterBaselineNodesMetricsSelfTest2%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=6, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=6, minorTopVer=1], stage="Affinity change by custom message [grp=ignite-sys-cache]" (0 ms) (parent=Determine exchange type)] [21:02:03] : [Step 4/5] [2021-11-19 21:02:03,315][INFO ][exchange-worker-#1763%internal.ClusterBaselineNodesMetricsSelfTest1%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=6, minorTopVer=1], force=false, evt=DISCOVERY_CUSTOM_EVT, node=4f8845b3-7744-4ec1-9404-43c3d1f00000] [21:02:03] : [Step 4/5] [2021-11-19 21:02:03,314][INFO ][sys-#1738%internal.ClusterBaselineNodesMetricsSelfTest1%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=f2be5aeb-dacc-4e5b-9786-82c46a500001, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=6, minorTopVer=1], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=4f8845b3-7744-4ec1-9404-43c3d1f00000, consistentId=internal.ClusterBaselineNodesMetricsSelfTest0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637344922971, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=6, minorTopVer=1]] [21:02:03] : [Step 4/5] [2021-11-19 21:02:03,323][INFO ][sys-#1738%internal.ClusterBaselineNodesMetricsSelfTest1%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=6, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=6, minorTopVer=1], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (4 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (1 ms), stage="Wait partitions release latch [latch=exchange]" (6 ms), stage="Wait partitions release [latch=exchange]" (5 ms), stage="After states restored callback" (0 ms), stage="WAL history reservation" (0 ms), stage="Waiting for Full message" (20 ms), stage="Affinity recalculation" (10 ms), stage="Full map updating" (0 ms), stage="Exchange done" (15 ms), stage="Total time" (61 ms)] [21:02:03] : [Step 4/5] [2021-11-19 21:02:03,324][INFO ][sys-#1738%internal.ClusterBaselineNodesMetricsSelfTest1%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=6, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=6, minorTopVer=1], stage="Affinity change by custom message [grp=ignite-sys-cache]" (0 ms) (parent=Determine exchange type)] [21:02:03] : [Step 4/5] [2021-11-19 21:02:03,325][INFO ][disco-event-worker-#1509%internal.ClusterBaselineNodesMetricsSelfTest2%][GridDiscoveryManager] Node left topology: TcpDiscoveryNode [id=a3cd6747-87a1-4b63-a114-5ba56c600003, consistentId=internal.ClusterBaselineNodesMetricsSelfTest3, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:0], discPort=0, order=4, intOrder=4, lastExchangeTime=1637344919624, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=true] [21:02:03] : [Step 4/5] [2021-11-19 21:02:03,326][INFO ][disco-event-worker-#1762%internal.ClusterBaselineNodesMetricsSelfTest1%][GridDiscoveryManager] Node left topology: TcpDiscoveryNode [id=a3cd6747-87a1-4b63-a114-5ba56c600003, consistentId=internal.ClusterBaselineNodesMetricsSelfTest3, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:0], discPort=0, order=4, intOrder=4, lastExchangeTime=1637344922971, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=true] [21:02:03] : [Step 4/5] [2021-11-19 21:02:03,326][INFO ][disco-event-worker-#1236%internal.ClusterBaselineNodesMetricsSelfTest0%][GridDiscoveryManager] Node left topology: TcpDiscoveryNode [id=a3cd6747-87a1-4b63-a114-5ba56c600003, consistentId=internal.ClusterBaselineNodesMetricsSelfTest3, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:0], discPort=0, order=4, intOrder=4, lastExchangeTime=1637344919604, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=true] [21:02:03] : [Step 4/5] [2021-11-19 21:02:03,330][INFO ][tcp-disco-sock-reader-[a3cd6747 127.0.0.1:43809 client]-#85%internal.ClusterBaselineNodesMetricsSelfTest0%-#1616%internal.ClusterBaselineNodesMetricsSelfTest0%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:43809, rmtPort=43809, rmtNodeId=a3cd6747-87a1-4b63-a114-5ba56c600003] [21:02:03] : [Step 4/5] [2021-11-19 21:02:03,329][INFO ][disco-event-worker-#1762%internal.ClusterBaselineNodesMetricsSelfTest1%][GridDiscoveryManager] Topology snapshot [ver=7, locNode=f2be5aeb, servers=3, clients=0, state=ACTIVE, CPUs=24, offheap=2.0GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=4f8845b3-7744-4ec1-9404-43c3d1f00000, consistentId=internal.ClusterBaselineNodesMetricsSelfTest0, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=f054f218-1e85-4528-9e50-191c6f500002, consistentId=internal.ClusterBaselineNodesMetricsSelfTest2, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=f2be5aeb-dacc-4e5b-9786-82c46a500001, consistentId=internal.ClusterBaselineNodesMetricsSelfTest1, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:02:03] : [Step 4/5] [2021-11-19 21:02:03,326][INFO ][disco-event-worker-#1509%internal.ClusterBaselineNodesMetricsSelfTest2%][GridDiscoveryManager] Topology snapshot [ver=7, locNode=f054f218, servers=3, clients=0, state=ACTIVE, CPUs=24, offheap=2.0GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=4f8845b3-7744-4ec1-9404-43c3d1f00000, consistentId=internal.ClusterBaselineNodesMetricsSelfTest0, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=f054f218-1e85-4528-9e50-191c6f500002, consistentId=internal.ClusterBaselineNodesMetricsSelfTest2, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=f2be5aeb-dacc-4e5b-9786-82c46a500001, consistentId=internal.ClusterBaselineNodesMetricsSelfTest1, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:02:03] : [Step 4/5] [2021-11-19 21:02:03,349][INFO ][disco-event-worker-#1509%internal.ClusterBaselineNodesMetricsSelfTest2%][GridDiscoveryManager] ^-- Baseline [id=0, size=2, online=2, offline=0] [21:02:03] : [Step 4/5] [2021-11-19 21:02:03,348][INFO ][disco-event-worker-#1762%internal.ClusterBaselineNodesMetricsSelfTest1%][GridDiscoveryManager] ^-- Baseline [id=0, size=2, online=2, offline=0] [21:02:03] : [Step 4/5] [2021-11-19 21:02:03,345][INFO ][main][GridCacheProcessor] Stopped cache [cacheName=ignite-sys-cache] [21:02:03] : [Step 4/5] [2021-11-19 21:02:03,337][INFO ][disco-event-worker-#1236%internal.ClusterBaselineNodesMetricsSelfTest0%][GridDiscoveryManager] Topology snapshot [ver=7, locNode=4f8845b3, servers=3, clients=0, state=ACTIVE, CPUs=24, offheap=2.0GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=4f8845b3-7744-4ec1-9404-43c3d1f00000, consistentId=internal.ClusterBaselineNodesMetricsSelfTest0, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=f054f218-1e85-4528-9e50-191c6f500002, consistentId=internal.ClusterBaselineNodesMetricsSelfTest2, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=f2be5aeb-dacc-4e5b-9786-82c46a500001, consistentId=internal.ClusterBaselineNodesMetricsSelfTest1, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:02:03] : [Step 4/5] [2021-11-19 21:02:03,358][INFO ][exchange-worker-#1763%internal.ClusterBaselineNodesMetricsSelfTest1%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=7, minorTopVer=0], crd=false, evt=NODE_LEFT, evtNode=a3cd6747-87a1-4b63-a114-5ba56c600003, customEvt=null, allowMerge=true, exchangeFreeSwitch=false] [21:02:03] : [Step 4/5] [2021-11-19 21:02:03,360][INFO ][exchange-worker-#1510%internal.ClusterBaselineNodesMetricsSelfTest2%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=7, minorTopVer=0], crd=false, evt=NODE_LEFT, evtNode=a3cd6747-87a1-4b63-a114-5ba56c600003, customEvt=null, allowMerge=true, exchangeFreeSwitch=false] [21:02:03] : [Step 4/5] [2021-11-19 21:02:03,360][INFO ][disco-event-worker-#1236%internal.ClusterBaselineNodesMetricsSelfTest0%][GridDiscoveryManager] ^-- Baseline [id=0, size=2, online=2, offline=0] [21:02:03] : [Step 4/5] [2021-11-19 21:02:03,361][INFO ][exchange-worker-#1510%internal.ClusterBaselineNodesMetricsSelfTest2%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=7, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=7, minorTopVer=0], err=null, rebalanced=true, wasRebalanced=true] [21:02:03] : [Step 4/5] [2021-11-19 21:02:03,361][INFO ][exchange-worker-#1763%internal.ClusterBaselineNodesMetricsSelfTest1%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=7, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=7, minorTopVer=0], err=null, rebalanced=true, wasRebalanced=true] [21:02:03] : [Step 4/5] [2021-11-19 21:02:03,361][INFO ][main][GridDeploymentLocalStore] Removed undeployed class: GridDeployment [ts=1637344919695, depMode=SHARED, clsLdr=IsolatedClassLoader{roleName='test'}, clsLdrId=1e3ac593d71-a3cd6747-87a1-4b63-a114-5ba56c600003, userVer=0, loc=true, sampleClsName=org.apache.ignite.internal.processors.cache.distributed.dht.preloader.GridDhtPartitionFullMap, pendingUndeploy=false, undeployed=true, usage=0] [21:02:03] : [Step 4/5] [2021-11-19 21:02:03,363][INFO ][exchange-worker-#1763%internal.ClusterBaselineNodesMetricsSelfTest1%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=f2be5aeb-dacc-4e5b-9786-82c46a500001, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=7, minorTopVer=0], evt=NODE_LEFT, evtNode=TcpDiscoveryNode [id=a3cd6747-87a1-4b63-a114-5ba56c600003, consistentId=internal.ClusterBaselineNodesMetricsSelfTest3, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:0], discPort=0, order=4, intOrder=4, lastExchangeTime=1637344922971, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=true], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=7, minorTopVer=0]] [21:02:03] : [Step 4/5] [2021-11-19 21:02:03,363][INFO ][exchange-worker-#1510%internal.ClusterBaselineNodesMetricsSelfTest2%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=f054f218-1e85-4528-9e50-191c6f500002, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=7, minorTopVer=0], evt=NODE_LEFT, evtNode=TcpDiscoveryNode [id=a3cd6747-87a1-4b63-a114-5ba56c600003, consistentId=internal.ClusterBaselineNodesMetricsSelfTest3, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:0], discPort=0, order=4, intOrder=4, lastExchangeTime=1637344919624, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=true], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=7, minorTopVer=0]] [21:02:03] : [Step 4/5] [2021-11-19 21:02:03,374][INFO ][exchange-worker-#1763%internal.ClusterBaselineNodesMetricsSelfTest1%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=7, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=7, minorTopVer=0], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (2 ms), stage="Determine exchange type" (0 ms), stage="Exchange done" (13 ms), stage="Total time" (15 ms)] [21:02:03] : [Step 4/5] [2021-11-19 21:02:03,369][INFO ][exchange-worker-#1237%internal.ClusterBaselineNodesMetricsSelfTest0%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=7, minorTopVer=0], crd=true, evt=NODE_LEFT, evtNode=a3cd6747-87a1-4b63-a114-5ba56c600003, customEvt=null, allowMerge=true, exchangeFreeSwitch=false] [21:02:03] : [Step 4/5] [2021-11-19 21:02:03,376][INFO ][exchange-worker-#1763%internal.ClusterBaselineNodesMetricsSelfTest1%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=7, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=7, minorTopVer=0]] [21:02:03] : [Step 4/5] [2021-11-19 21:02:03,376][INFO ][exchange-worker-#1510%internal.ClusterBaselineNodesMetricsSelfTest2%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=7, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=7, minorTopVer=0], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (0 ms), stage="Determine exchange type" (0 ms), stage="Exchange done" (14 ms), stage="Total time" (14 ms)] [21:02:03] : [Step 4/5] [2021-11-19 21:02:03,379][INFO ][exchange-worker-#1763%internal.ClusterBaselineNodesMetricsSelfTest1%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=7, minorTopVer=0], crd=false] [21:02:03] : [Step 4/5] [2021-11-19 21:02:03,379][INFO ][exchange-worker-#1237%internal.ClusterBaselineNodesMetricsSelfTest0%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=7, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=7, minorTopVer=0], err=null, rebalanced=true, wasRebalanced=true] [21:02:03] : [Step 4/5] [2021-11-19 21:02:03,385][INFO ][exchange-worker-#1763%internal.ClusterBaselineNodesMetricsSelfTest1%][GridCachePartitionExchangeManager] AffinityTopologyVersion [topVer=7, minorTopVer=0], evt=NODE_LEFT, evtNode=a3cd6747-87a1-4b63-a114-5ba56c600003, client=false] [21:02:03] : [Step 4/5] [2021-11-19 21:02:03,381][INFO ][exchange-worker-#1510%internal.ClusterBaselineNodesMetricsSelfTest2%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=7, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=7, minorTopVer=0]] [21:02:03] : [Step 4/5] [2021-11-19 21:02:03,387][INFO ][exchange-worker-#1510%internal.ClusterBaselineNodesMetricsSelfTest2%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=7, minorTopVer=0], crd=false] [21:02:03] : [Step 4/5] [2021-11-19 21:02:03,387][INFO ][exchange-worker-#1237%internal.ClusterBaselineNodesMetricsSelfTest0%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=4f8845b3-7744-4ec1-9404-43c3d1f00000, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=7, minorTopVer=0], evt=NODE_LEFT, evtNode=TcpDiscoveryNode [id=a3cd6747-87a1-4b63-a114-5ba56c600003, consistentId=internal.ClusterBaselineNodesMetricsSelfTest3, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:0], discPort=0, order=4, intOrder=4, lastExchangeTime=1637344919604, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=true], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=7, minorTopVer=0]] [21:02:03] : [Step 4/5] [2021-11-19 21:02:03,416][INFO ][main][ClusterBaselineNodesMetricsSelfTest3] [21:02:03] : [Step 4/5] [21:02:03] : [Step 4/5] >>> +------------------------------------------------------+ [21:02:03] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV stopped OK [21:02:03] : [Step 4/5] >>> +------------------------------------------------------+ [21:02:03] : [Step 4/5] >>> Ignite instance name: internal.ClusterBaselineNodesMetricsSelfTest3 [21:02:03] : [Step 4/5] >>> Grid uptime: 00:00:03.687 [21:02:03] : [Step 4/5] [21:02:03] : [Step 4/5] [21:02:03] : [Step 4/5] [2021-11-19 21:02:03,416][INFO ][exchange-worker-#1510%internal.ClusterBaselineNodesMetricsSelfTest2%][GridCachePartitionExchangeManager] AffinityTopologyVersion [topVer=7, minorTopVer=0], evt=NODE_LEFT, evtNode=a3cd6747-87a1-4b63-a114-5ba56c600003, client=false] [21:02:03] : [Step 4/5] [2021-11-19 21:02:03,421][INFO ][main][root] >>> Stopping grid [name=internal.ClusterBaselineNodesMetricsSelfTest2, id=f054f218-1e85-4528-9e50-191c6f500002] [21:02:03] : [Step 4/5] [2021-11-19 21:02:03,419][INFO ][exchange-worker-#1237%internal.ClusterBaselineNodesMetricsSelfTest0%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=7, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=7, minorTopVer=0], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (10 ms), stage="Determine exchange type" (0 ms), stage="Exchange done" (39 ms), stage="Total time" (49 ms)] [21:02:03] : [Step 4/5] [2021-11-19 21:02:03,425][INFO ][exchange-worker-#1237%internal.ClusterBaselineNodesMetricsSelfTest0%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=7, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=7, minorTopVer=0]] [21:02:03] : [Step 4/5] [2021-11-19 21:02:03,426][INFO ][exchange-worker-#1237%internal.ClusterBaselineNodesMetricsSelfTest0%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=7, minorTopVer=0], crd=true] [21:02:03] : [Step 4/5] [2021-11-19 21:02:03,428][INFO ][exchange-worker-#1237%internal.ClusterBaselineNodesMetricsSelfTest0%][GridCachePartitionExchangeManager] AffinityTopologyVersion [topVer=7, minorTopVer=0], evt=NODE_LEFT, evtNode=a3cd6747-87a1-4b63-a114-5ba56c600003, client=false] [21:02:03] : [Step 4/5] [2021-11-19 21:02:03,444][INFO ][db-checkpoint-thread-#1516%internal.ClusterBaselineNodesMetricsSelfTest2%][Checkpointer] Skipping checkpoint (no pages were modified) [checkpointBeforeLockTime=3ms, checkpointLockWait=1ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, reason='timeout'] [21:02:03] : [Step 4/5] [2021-11-19 21:02:03,459][INFO ][tcp-disco-msg-worker-[f054f218 127.0.0.1:47502 crd]-#59%internal.ClusterBaselineNodesMetricsSelfTest0%-#1233%internal.ClusterBaselineNodesMetricsSelfTest0%][TestTcpDiscoverySpi] New next node [newNext=TcpDiscoveryNode [id=f2be5aeb-dacc-4e5b-9786-82c46a500001, consistentId=internal.ClusterBaselineNodesMetricsSelfTest1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=6, intOrder=5, lastExchangeTime=1637344922930, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false]] [21:02:03]W: [org.apache.ignite:ignite-core] [2021-11-19 21:02:03,460][WARN ][tcp-disco-sock-reader-[5ff14d92 127.0.0.1:60417]-#77%internal.ClusterBaselineNodesMetricsSelfTest2%-#1506%internal.ClusterBaselineNodesMetricsSelfTest2%][TestTcpDiscoverySpi] Failed to shutdown socket [21:02:03]W: [org.apache.ignite:ignite-core] java.net.SocketException: Socket is closed [21:02:03]W: [org.apache.ignite:ignite-core] at java.net.Socket.shutdownOutput(Socket.java:1568) [21:02:03]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.close(IgniteUtils.java:4247) [21:02:03]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.discovery.tcp.ServerImpl$SocketReader.body(ServerImpl.java:7370) [21:02:03]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.IgniteSpiThread.run(IgniteSpiThread.java:58) [21:02:03] : [Step 4/5] [2021-11-19 21:02:03,459][INFO ][tcp-disco-sock-reader-[4f8845b3 127.0.0.1:45821]-#87%internal.ClusterBaselineNodesMetricsSelfTest2%-#1633%internal.ClusterBaselineNodesMetricsSelfTest2%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:45821, rmtPort=45821, rmtNodeId=4f8845b3-7744-4ec1-9404-43c3d1f00000] [21:02:03] : [Step 4/5] [2021-11-19 21:02:03,465][INFO ][tcp-disco-srvr-[:47501]-#91%internal.ClusterBaselineNodesMetricsSelfTest1%-#1756%internal.ClusterBaselineNodesMetricsSelfTest1%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=38317] [21:02:03] : [Step 4/5] [2021-11-19 21:02:03,466][INFO ][tcp-disco-srvr-[:47501]-#91%internal.ClusterBaselineNodesMetricsSelfTest1%-#1756%internal.ClusterBaselineNodesMetricsSelfTest1%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=38317] [21:02:03] : [Step 4/5] [2021-11-19 21:02:03,467][INFO ][tcp-disco-sock-reader-[]-#97%internal.ClusterBaselineNodesMetricsSelfTest1%-#1793%internal.ClusterBaselineNodesMetricsSelfTest1%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:38317, rmtPort=38317] [21:02:03] : [Step 4/5] [2021-11-19 21:02:03,465][INFO ][tcp-disco-sock-reader-[5ff14d92 127.0.0.1:60417]-#77%internal.ClusterBaselineNodesMetricsSelfTest2%-#1506%internal.ClusterBaselineNodesMetricsSelfTest2%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:60417, rmtPort=60417, rmtNodeId=5ff14d92-b955-4988-af16-a71774900001] [21:02:03] : [Step 4/5] [2021-11-19 21:02:03,463][INFO ][disco-event-worker-#1236%internal.ClusterBaselineNodesMetricsSelfTest0%][GridDiscoveryManager] Node left topology: TcpDiscoveryNode [id=f054f218-1e85-4528-9e50-191c6f500002, consistentId=internal.ClusterBaselineNodesMetricsSelfTest2, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47502], discPort=47502, order=3, intOrder=3, lastExchangeTime=1637344918350, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false] [21:02:03] : [Step 4/5] [2021-11-19 21:02:03,471][INFO ][tcp-disco-sock-reader-[4f8845b3 127.0.0.1:38317]-#97%internal.ClusterBaselineNodesMetricsSelfTest1%-#1793%internal.ClusterBaselineNodesMetricsSelfTest1%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=4f8845b3-7744-4ec1-9404-43c3d1f00000, rmtAddr=/127.0.0.1:38317] [21:02:03] : [Step 4/5] [2021-11-19 21:02:03,472][INFO ][disco-event-worker-#1236%internal.ClusterBaselineNodesMetricsSelfTest0%][GridDiscoveryManager] Topology snapshot [ver=8, locNode=4f8845b3, servers=2, clients=0, state=ACTIVE, CPUs=24, offheap=2.0GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=4f8845b3-7744-4ec1-9404-43c3d1f00000, consistentId=internal.ClusterBaselineNodesMetricsSelfTest0, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=f2be5aeb-dacc-4e5b-9786-82c46a500001, consistentId=internal.ClusterBaselineNodesMetricsSelfTest1, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:02:03] : [Step 4/5] [2021-11-19 21:02:03,476][INFO ][main][GridCacheProcessor] Stopped cache [cacheName=ignite-sys-cache] [21:02:03] : [Step 4/5] [2021-11-19 21:02:03,474][INFO ][disco-event-worker-#1762%internal.ClusterBaselineNodesMetricsSelfTest1%][GridDiscoveryManager] Node left topology: TcpDiscoveryNode [id=f054f218-1e85-4528-9e50-191c6f500002, consistentId=internal.ClusterBaselineNodesMetricsSelfTest2, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47502], discPort=47502, order=3, intOrder=3, lastExchangeTime=1637344922971, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false] [21:02:03] : [Step 4/5] [2021-11-19 21:02:03,476][INFO ][disco-event-worker-#1236%internal.ClusterBaselineNodesMetricsSelfTest0%][GridDiscoveryManager] ^-- Baseline [id=0, size=2, online=2, offline=0] [21:02:03] : [Step 4/5] [2021-11-19 21:02:03,477][INFO ][disco-event-worker-#1762%internal.ClusterBaselineNodesMetricsSelfTest1%][GridDiscoveryManager] Topology snapshot [ver=8, locNode=f2be5aeb, servers=2, clients=0, state=ACTIVE, CPUs=24, offheap=2.0GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=4f8845b3-7744-4ec1-9404-43c3d1f00000, consistentId=internal.ClusterBaselineNodesMetricsSelfTest0, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=f2be5aeb-dacc-4e5b-9786-82c46a500001, consistentId=internal.ClusterBaselineNodesMetricsSelfTest1, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:02:03] : [Step 4/5] [2021-11-19 21:02:03,479][INFO ][disco-event-worker-#1762%internal.ClusterBaselineNodesMetricsSelfTest1%][GridDiscoveryManager] ^-- Baseline [id=0, size=2, online=2, offline=0] [21:02:03] : [Step 4/5] [2021-11-19 21:02:03,480][INFO ][exchange-worker-#1237%internal.ClusterBaselineNodesMetricsSelfTest0%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=8, minorTopVer=0], crd=true, evt=NODE_LEFT, evtNode=f054f218-1e85-4528-9e50-191c6f500002, customEvt=null, allowMerge=true, exchangeFreeSwitch=false] [21:02:03] : [Step 4/5] [2021-11-19 21:02:03,484][INFO ][exchange-worker-#1763%internal.ClusterBaselineNodesMetricsSelfTest1%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=8, minorTopVer=0], crd=false, evt=NODE_LEFT, evtNode=f054f218-1e85-4528-9e50-191c6f500002, customEvt=null, allowMerge=true, exchangeFreeSwitch=false] [21:02:03] : [Step 4/5] [2021-11-19 21:02:03,485][INFO ][exchange-worker-#1237%internal.ClusterBaselineNodesMetricsSelfTest0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=8, minorTopVer=0], waitTime=0ms, futInfo=NA, mode=DISTRIBUTED] [21:02:03] : [Step 4/5] [2021-11-19 21:02:03,485][INFO ][exchange-worker-#1763%internal.ClusterBaselineNodesMetricsSelfTest1%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=8, minorTopVer=0], waitTime=0ms, futInfo=NA, mode=DISTRIBUTED] [21:02:03] : [Step 4/5] [2021-11-19 21:02:03,488][INFO ][exchange-worker-#1763%internal.ClusterBaselineNodesMetricsSelfTest1%][GridDhtPartitionsExchangeFuture] Finished waiting for partitions release latch: ClientLatch [coordinator=TcpDiscoveryNode [id=4f8845b3-7744-4ec1-9404-43c3d1f00000, consistentId=internal.ClusterBaselineNodesMetricsSelfTest0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637344922971, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], ackSent=true, super=CompletableLatch [id=CompletableLatchUid [id=exchange, topVer=AffinityTopologyVersion [topVer=8, minorTopVer=0]]]] [21:02:03] : [Step 4/5] [2021-11-19 21:02:03,489][INFO ][exchange-worker-#1763%internal.ClusterBaselineNodesMetricsSelfTest1%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=8, minorTopVer=0], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:02:03] : [Step 4/5] [2021-11-19 21:02:03,488][INFO ][exchange-worker-#1237%internal.ClusterBaselineNodesMetricsSelfTest0%][GridDhtPartitionsExchangeFuture] Finished waiting for partitions release latch: ServerLatch [permits=0, pendingAcks=HashSet [], super=CompletableLatch [id=CompletableLatchUid [id=exchange, topVer=AffinityTopologyVersion [topVer=8, minorTopVer=0]]]] [21:02:03] : [Step 4/5] [2021-11-19 21:02:03,490][INFO ][exchange-worker-#1237%internal.ClusterBaselineNodesMetricsSelfTest0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=8, minorTopVer=0], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:02:03] : [Step 4/5] [2021-11-19 21:02:03,493][INFO ][exchange-worker-#1237%internal.ClusterBaselineNodesMetricsSelfTest0%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=8, minorTopVer=0], crd=true] [21:02:03] : [Step 4/5] [2021-11-19 21:02:03,493][INFO ][exchange-worker-#1763%internal.ClusterBaselineNodesMetricsSelfTest1%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=8, minorTopVer=0], crd=false] [21:02:03] : [Step 4/5] [2021-11-19 21:02:03,495][INFO ][sys-#1208%internal.ClusterBaselineNodesMetricsSelfTest0%][GridDhtPartitionsExchangeFuture] Coordinator received single message [ver=AffinityTopologyVersion [topVer=8, minorTopVer=0], node=f2be5aeb-dacc-4e5b-9786-82c46a500001, allReceived=true] [21:02:03] : [Step 4/5] [2021-11-19 21:02:03,495][INFO ][sys-#1208%internal.ClusterBaselineNodesMetricsSelfTest0%][GridDhtPartitionsExchangeFuture] Coordinator received all messages, try merge [ver=AffinityTopologyVersion [topVer=8, minorTopVer=0]] [21:02:03] : [Step 4/5] [2021-11-19 21:02:03,496][INFO ][sys-#1208%internal.ClusterBaselineNodesMetricsSelfTest0%][GridDhtPartitionsExchangeFuture] finishExchangeOnCoordinator [topVer=AffinityTopologyVersion [topVer=8, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=8, minorTopVer=0]] [21:02:03] : [Step 4/5] [2021-11-19 21:02:03,504][INFO ][sys-#1208%internal.ClusterBaselineNodesMetricsSelfTest0%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=8, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=8, minorTopVer=0], err=null, rebalanced=true, wasRebalanced=true] [21:02:03] : [Step 4/5] [2021-11-19 21:02:03,506][INFO ][sys-#1208%internal.ClusterBaselineNodesMetricsSelfTest0%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=4f8845b3-7744-4ec1-9404-43c3d1f00000, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=8, minorTopVer=0], evt=NODE_LEFT, evtNode=TcpDiscoveryNode [id=f054f218-1e85-4528-9e50-191c6f500002, consistentId=internal.ClusterBaselineNodesMetricsSelfTest2, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47502], discPort=47502, order=3, intOrder=3, lastExchangeTime=1637344918350, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=8, minorTopVer=0]] [21:02:03] : [Step 4/5] [2021-11-19 21:02:03,506][INFO ][exchange-worker-#1237%internal.ClusterBaselineNodesMetricsSelfTest0%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=8, minorTopVer=0], force=false, evt=NODE_LEFT, node=f054f218-1e85-4528-9e50-191c6f500002] [21:02:03] : [Step 4/5] [2021-11-19 21:02:03,507][INFO ][sys-#1733%internal.ClusterBaselineNodesMetricsSelfTest1%][GridDhtPartitionsExchangeFuture] Received full message, will finish exchange [node=4f8845b3-7744-4ec1-9404-43c3d1f00000, resVer=AffinityTopologyVersion [topVer=8, minorTopVer=0]] [21:02:03] : [Step 4/5] [2021-11-19 21:02:03,507][INFO ][sys-#1208%internal.ClusterBaselineNodesMetricsSelfTest0%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=8, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=8, minorTopVer=0], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (4 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (1 ms), stage="Wait partitions release latch [latch=exchange]" (4 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="After states restored callback" (0 ms), stage="WAL history reservation" (0 ms), stage="Finalize update counters" (1 ms), stage="Waiting for all single messages" (3 ms), stage="Exchanges merge" (0 ms), stage="Affinity recalculation (crd)" (2 ms), stage="Collect update counters and create affinity messages" (0 ms), stage="Assign partitions states" (0 ms), stage="Validate partitions states" (0 ms), stage="Apply update counters" (0 ms), stage="Full message preparing" (4 ms), stage="Full message sending" (0 ms), stage="Detect lost partitions" (1 ms), stage="Exchange done" (1 ms), stage="Total time" (21 ms), Discovery lag=1 ms, Latest started node id=f2be5aeb-dacc-4e5b-9786-82c46a500001] [21:02:03] : [Step 4/5] [2021-11-19 21:02:03,510][INFO ][sys-#1208%internal.ClusterBaselineNodesMetricsSelfTest0%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=8, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=8, minorTopVer=0], stage="Affinity initialization (enforced) [grp=ignite-sys-cache]" (1 ms) (parent=Affinity recalculation (crd)), stage="Affinity recalculation (partitions availability) [grp=ignite-sys-cache]" (0 ms) (parent=Affinity recalculation (crd))] [21:02:03] : [Step 4/5] [2021-11-19 21:02:03,511][INFO ][sys-#1733%internal.ClusterBaselineNodesMetricsSelfTest1%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=8, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=8, minorTopVer=0], err=null, rebalanced=true, wasRebalanced=true] [21:02:03] : [Step 4/5] [2021-11-19 21:02:03,513][INFO ][sys-#1733%internal.ClusterBaselineNodesMetricsSelfTest1%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=f2be5aeb-dacc-4e5b-9786-82c46a500001, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=8, minorTopVer=0], evt=NODE_LEFT, evtNode=TcpDiscoveryNode [id=f054f218-1e85-4528-9e50-191c6f500002, consistentId=internal.ClusterBaselineNodesMetricsSelfTest2, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47502], discPort=47502, order=3, intOrder=3, lastExchangeTime=1637344922971, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=8, minorTopVer=0]] [21:02:03] : [Step 4/5] [2021-11-19 21:02:03,513][INFO ][exchange-worker-#1763%internal.ClusterBaselineNodesMetricsSelfTest1%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=8, minorTopVer=0], force=false, evt=NODE_LEFT, node=f054f218-1e85-4528-9e50-191c6f500002] [21:02:03] : [Step 4/5] [2021-11-19 21:02:03,514][INFO ][sys-#1733%internal.ClusterBaselineNodesMetricsSelfTest1%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=8, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=8, minorTopVer=0], stage="Waiting in exchange queue" (2 ms), stage="Exchange parameters initialization" (1 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (1 ms), stage="Wait partitions release latch [latch=exchange]" (2 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="After states restored callback" (0 ms), stage="WAL history reservation" (0 ms), stage="Finalize update counters" (0 ms), stage="Waiting for Full message" (17 ms), stage="Affinity recalculation" (1 ms), stage="Full map updating" (1 ms), stage="Detect lost partitions" (1 ms), stage="Exchange done" (1 ms), stage="Total time" (27 ms)] [21:02:03] : [Step 4/5] [2021-11-19 21:02:03,516][INFO ][sys-#1733%internal.ClusterBaselineNodesMetricsSelfTest1%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=8, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=8, minorTopVer=0], stage="Affinity applying from full message [grp=ignite-sys-cache]" (1 ms) (parent=Affinity recalculation)] [21:02:03] : [Step 4/5] [2021-11-19 21:02:03,653][INFO ][db-checkpoint-thread-#1768%internal.ClusterBaselineNodesMetricsSelfTest1%][Checkpointer] Checkpoint started [checkpointId=11eeb04d-d360-4755-a83f-5715f8d01cc5, startPtr=WALPointer [idx=0, fileOff=168770, len=1963], checkpointBeforeLockTime=5ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=1ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=275ms, writeCheckpointEntryDuration=307ms, splitAndSortCpPagesDuration=0ms, pages=14, reason='node started'] [21:02:03] : [Step 4/5] [2021-11-19 21:02:03,677][INFO ][db-checkpoint-thread-#1768%internal.ClusterBaselineNodesMetricsSelfTest1%][Checkpointer] Checkpoint finished [cpId=11eeb04d-d360-4755-a83f-5715f8d01cc5, pages=14, markPos=WALPointer [idx=0, fileOff=168770, len=1963], walSegmentsCovered=[], markDuration=585ms, pagesWrite=12ms, fsync=11ms, total=613ms] [21:02:04] : [Step 4/5] [2021-11-19 21:02:04,589][INFO ][main][FilePageStoreManager] Cleanup cache stores [total=3, left=0, cleanFiles=false] [21:02:04] : [Step 4/5] [2021-11-19 21:02:04,594][INFO ][main][GridDeploymentLocalStore] Removed undeployed class: GridDeployment [ts=1637344919420, depMode=SHARED, clsLdr=IsolatedClassLoader{roleName='test'}, clsLdrId=483ac593d71-f054f218-1e85-4528-9e50-191c6f500002, userVer=0, loc=true, sampleClsName=org.apache.ignite.internal.processors.cache.distributed.dht.preloader.IgniteDhtPartitionCountersMap2, pendingUndeploy=false, undeployed=true, usage=0] [21:02:04] : [Step 4/5] [2021-11-19 21:02:04,612][INFO ][main][ClusterBaselineNodesMetricsSelfTest2] [21:02:04] : [Step 4/5] [21:02:04] : [Step 4/5] >>> +------------------------------------------------------+ [21:02:04] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV stopped OK [21:02:04] : [Step 4/5] >>> +------------------------------------------------------+ [21:02:04] : [Step 4/5] >>> Ignite instance name: internal.ClusterBaselineNodesMetricsSelfTest2 [21:02:04] : [Step 4/5] >>> Grid uptime: 00:00:05.154 [21:02:04] : [Step 4/5] [21:02:04] : [Step 4/5] [21:02:04] : [Step 4/5] [2021-11-19 21:02:04,616][INFO ][main][root] >>> Stopping grid [name=internal.ClusterBaselineNodesMetricsSelfTest0, id=4f8845b3-7744-4ec1-9404-43c3d1f00000] [21:02:04] : [Step 4/5] [2021-11-19 21:02:04,637][INFO ][db-checkpoint-thread-#1371%internal.ClusterBaselineNodesMetricsSelfTest0%][Checkpointer] Skipping checkpoint (no pages were modified) [checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=1ms, checkpointLockHoldTime=1ms, reason='timeout'] [21:02:04] : [Step 4/5] [2021-11-19 21:02:04,654][INFO ][tcp-disco-sock-reader-[f2be5aeb 127.0.0.1:55651]-#95%internal.ClusterBaselineNodesMetricsSelfTest0%-#1760%internal.ClusterBaselineNodesMetricsSelfTest0%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:55651, rmtPort=55651, rmtNodeId=f2be5aeb-dacc-4e5b-9786-82c46a500001] [21:02:04] : [Step 4/5] [2021-11-19 21:02:04,666][INFO ][disco-event-worker-#1762%internal.ClusterBaselineNodesMetricsSelfTest1%][GridDiscoveryManager] Node left topology: TcpDiscoveryNode [id=4f8845b3-7744-4ec1-9404-43c3d1f00000, consistentId=internal.ClusterBaselineNodesMetricsSelfTest0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637344922971, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false] [21:02:04] : [Step 4/5] [2021-11-19 21:02:04,667][INFO ][disco-event-worker-#1762%internal.ClusterBaselineNodesMetricsSelfTest1%][GridDiscoveryManager] Topology snapshot [ver=9, locNode=f2be5aeb, servers=1, clients=0, state=ACTIVE, CPUs=24, offheap=2.0GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=f2be5aeb-dacc-4e5b-9786-82c46a500001, consistentId=internal.ClusterBaselineNodesMetricsSelfTest1, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:02:04] : [Step 4/5] [2021-11-19 21:02:04,672][INFO ][main][GridCacheProcessor] Stopped cache [cacheName=ignite-sys-cache] [21:02:04] : [Step 4/5] [2021-11-19 21:02:04,672][INFO ][disco-event-worker-#1762%internal.ClusterBaselineNodesMetricsSelfTest1%][GridDiscoveryManager] Coordinator changed [prev=TcpDiscoveryNode [id=4f8845b3-7744-4ec1-9404-43c3d1f00000, consistentId=internal.ClusterBaselineNodesMetricsSelfTest0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637344922971, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], cur=TcpDiscoveryNode [id=f2be5aeb-dacc-4e5b-9786-82c46a500001, consistentId=internal.ClusterBaselineNodesMetricsSelfTest1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=6, intOrder=5, lastExchangeTime=1637344924648, loc=true, ver=2.13.0#20211119-sha1:00000000, isClient=false]] [21:02:04] : [Step 4/5] [2021-11-19 21:02:04,673][INFO ][disco-event-worker-#1762%internal.ClusterBaselineNodesMetricsSelfTest1%][GridDiscoveryManager] ^-- Baseline [id=0, size=2, online=1, offline=1] [21:02:04] : [Step 4/5] [2021-11-19 21:02:04,676][INFO ][disco-event-worker-#1762%internal.ClusterBaselineNodesMetricsSelfTest1%][MvccProcessorImpl] Assigned mvcc coordinator [crd=MvccCoordinator [topVer=AffinityTopologyVersion [topVer=9, minorTopVer=0], nodeId=f2be5aeb-dacc-4e5b-9786-82c46a500001, ver=1637344913684, local=true, initialized=false]] [21:02:04] : [Step 4/5] [2021-11-19 21:02:04,689][INFO ][main][FilePageStoreManager] Cleanup cache stores [total=3, left=0, cleanFiles=false] [21:02:04] : [Step 4/5] [2021-11-19 21:02:04,700][INFO ][main][GridDeploymentLocalStore] Removed undeployed class: GridDeployment [ts=1637344915860, depMode=SHARED, clsLdr=IsolatedClassLoader{roleName='test'}, clsLdrId=eb2ac593d71-4f8845b3-7744-4ec1-9404-43c3d1f00000, userVer=0, loc=true, sampleClsName=org.apache.ignite.internal.processors.cache.distributed.dht.preloader.GridDhtPartitionMap, pendingUndeploy=false, undeployed=true, usage=0] [21:02:04] : [Step 4/5] [2021-11-19 21:02:04,703][INFO ][exchange-worker-#1763%internal.ClusterBaselineNodesMetricsSelfTest1%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=9, minorTopVer=0], crd=true, evt=NODE_LEFT, evtNode=4f8845b3-7744-4ec1-9404-43c3d1f00000, customEvt=null, allowMerge=false, exchangeFreeSwitch=true] [21:02:04] : [Step 4/5] [2021-11-19 21:02:04,704][INFO ][sys-#1741%internal.ClusterBaselineNodesMetricsSelfTest1%][ExchangeLatchManager] Become new coordinator f2be5aeb-dacc-4e5b-9786-82c46a500001 [21:02:04] : [Step 4/5] [2021-11-19 21:02:04,704][INFO ][exchange-worker-#1763%internal.ClusterBaselineNodesMetricsSelfTest1%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=9, minorTopVer=0], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:02:04] : [Step 4/5] [2021-11-19 21:02:04,706][INFO ][exchange-worker-#1763%internal.ClusterBaselineNodesMetricsSelfTest1%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=9, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=9, minorTopVer=0], err=null, rebalanced=true, wasRebalanced=true] [21:02:04] : [Step 4/5] [2021-11-19 21:02:04,714][INFO ][exchange-worker-#1763%internal.ClusterBaselineNodesMetricsSelfTest1%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=f2be5aeb-dacc-4e5b-9786-82c46a500001, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=9, minorTopVer=0], evt=NODE_LEFT, evtNode=TcpDiscoveryNode [id=4f8845b3-7744-4ec1-9404-43c3d1f00000, consistentId=internal.ClusterBaselineNodesMetricsSelfTest0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637344922971, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=9, minorTopVer=0]] [21:02:04] : [Step 4/5] [2021-11-19 21:02:04,716][INFO ][exchange-worker-#1763%internal.ClusterBaselineNodesMetricsSelfTest1%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=9, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=9, minorTopVer=0], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (2 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="After states restored callback" (0 ms), stage="WAL history reservation" (0 ms), stage="Finalize update counters" (0 ms), stage="Detect lost partitions" (7 ms), stage="Exchange done" (2 ms), stage="Total time" (11 ms)] [21:02:04] : [Step 4/5] [2021-11-19 21:02:04,717][INFO ][exchange-worker-#1763%internal.ClusterBaselineNodesMetricsSelfTest1%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=9, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=9, minorTopVer=0], stage="Affinity initialization (exchange-free switch on fully-rebalanced topology) [grp=ignite-sys-cache]" (0 ms) (parent=Determine exchange type)] [21:02:04] : [Step 4/5] [2021-11-19 21:02:04,723][INFO ][exchange-worker-#1763%internal.ClusterBaselineNodesMetricsSelfTest1%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=9, minorTopVer=0], crd=true] [21:02:04] : [Step 4/5] [2021-11-19 21:02:04,724][INFO ][exchange-worker-#1763%internal.ClusterBaselineNodesMetricsSelfTest1%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=9, minorTopVer=0], force=false, evt=NODE_LEFT, node=4f8845b3-7744-4ec1-9404-43c3d1f00000] [21:02:04] : [Step 4/5] [2021-11-19 21:02:04,761][INFO ][main][ClusterBaselineNodesMetricsSelfTest0] [21:02:04] : [Step 4/5] [21:02:04] : [Step 4/5] >>> +------------------------------------------------------+ [21:02:04] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV stopped OK [21:02:04] : [Step 4/5] >>> +------------------------------------------------------+ [21:02:04] : [Step 4/5] >>> Ignite instance name: internal.ClusterBaselineNodesMetricsSelfTest0 [21:02:04] : [Step 4/5] >>> Grid uptime: 00:00:11.008 [21:02:04] : [Step 4/5] [21:02:04] : [Step 4/5] [21:02:04] : [Step 4/5] [2021-11-19 21:02:04,763][INFO ][main][root] >>> Stopping grid [name=internal.ClusterBaselineNodesMetricsSelfTest1, id=f2be5aeb-dacc-4e5b-9786-82c46a500001] [21:02:04] : [Step 4/5] [2021-11-19 21:02:04,792][INFO ][tcp-disco-sock-reader-[f054f218 127.0.0.1:33625]-#94%internal.ClusterBaselineNodesMetricsSelfTest1%-#1759%internal.ClusterBaselineNodesMetricsSelfTest1%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:33625, rmtPort=33625, rmtNodeId=f054f218-1e85-4528-9e50-191c6f500002] [21:02:04] : [Step 4/5] [2021-11-19 21:02:04,792][INFO ][tcp-disco-sock-reader-[4f8845b3 127.0.0.1:38317]-#97%internal.ClusterBaselineNodesMetricsSelfTest1%-#1793%internal.ClusterBaselineNodesMetricsSelfTest1%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:38317, rmtPort=38317, rmtNodeId=4f8845b3-7744-4ec1-9404-43c3d1f00000] [21:02:04] : [Step 4/5] [2021-11-19 21:02:04,797][INFO ][main][GridCacheProcessor] Stopped cache [cacheName=ignite-sys-cache] [21:02:05] : [Step 4/5] [2021-11-19 21:02:05,017][INFO ][main][FilePageStoreManager] Cleanup cache stores [total=3, left=0, cleanFiles=false] [21:02:05] : [Step 4/5] [2021-11-19 21:02:05,019][INFO ][main][GridDeploymentLocalStore] Removed undeployed class: GridDeployment [ts=1637344923101, depMode=SHARED, clsLdr=IsolatedClassLoader{roleName='test'}, clsLdrId=1f4ac593d71-f2be5aeb-dacc-4e5b-9786-82c46a500001, userVer=0, loc=true, sampleClsName=org.apache.ignite.internal.processors.cache.distributed.dht.preloader.IgniteDhtPartitionHistorySuppliersMap, pendingUndeploy=false, undeployed=true, usage=0] [21:02:05] : [Step 4/5] [2021-11-19 21:02:05,028][INFO ][main][ClusterBaselineNodesMetricsSelfTest1] [21:02:05] : [Step 4/5] [21:02:05] : [Step 4/5] >>> +------------------------------------------------------+ [21:02:05] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV stopped OK [21:02:05] : [Step 4/5] >>> +------------------------------------------------------+ [21:02:05] : [Step 4/5] >>> Ignite instance name: internal.ClusterBaselineNodesMetricsSelfTest1 [21:02:05] : [Step 4/5] >>> Grid uptime: 00:00:01.771 [21:02:05] : [Step 4/5] [21:02:05] : [Step 4/5] [21:02:05] : [Step 4/5] [21:02:05] >>> Stopping test class: ClusterBaselineNodesMetricsSelfTest <<< [21:02:05] : [Step 4/5] [2021-11-19 21:02:05,030][INFO ][main][root] >>> Stopping test class: ClusterBaselineNodesMetricsSelfTest <<< [21:02:05] : [Step 4/5] [21:02:05] >>> Starting test class: GridMarshallerMappingConsistencyTest <<< [21:02:05] : [Step 4/5] [2021-11-19 21:02:05,031][INFO ][main][root] >>> Starting test class: GridMarshallerMappingConsistencyTest <<< [21:02:05] : [Step 4/5] Running org.apache.ignite.marshaller.GridMarshallerMappingConsistencyTest [21:02:05]i: [Step 4/5] ##teamcity[importData type='surefire' path='/opt/buildagent/temp/buildTmp/ignite-tools-junit-reports1777670380320881607/test-org.apache.ignite.testsuites.IgniteBasicWithPersistenceTestSuite1637344912220.xml'] [21:02:05] : [Step 4/5] Importing data from '/opt/buildagent/temp/buildTmp/ignite-tools-junit-reports1777670380320881607/test-org.apache.ignite.testsuites.IgniteBasicWithPersistenceTestSuite1637344912220.xml' (261 B) with 'surefire' processor [21:02:05] : [Step 4/5] [21:02:05] >>> Starting test: GridMarshallerMappingConsistencyTest#testPersistedMappingsSharedOnJoin <<< [21:02:05] : [Step 4/5] [2021-11-19 21:02:05,047][INFO ][main][root] >>> Starting test: GridMarshallerMappingConsistencyTest#testPersistedMappingsSharedOnJoin <<< [21:02:05] : [Step 4/5] [21:02:05] >>> Heap: 352 MB used / 1945 MB commited / 1945 MB max <<< [21:02:05] : [Step 4/5] [2021-11-19 21:02:05,048][INFO ][main][root] >>> Heap: 352 MB used / 1945 MB commited / 1945 MB max <<< [21:02:05] : [Step 4/5] [21:02:05] >>> Non-Heap: 110 MB used / 117 MB commited / 0 MB max <<< [21:02:05] : [Step 4/5] [2021-11-19 21:02:05,048][INFO ][main][root] >>> Non-Heap: 110 MB used / 117 MB commited / 0 MB max <<< [21:02:05] : [Step 4/5] [2021-11-19 21:02:05,071][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][GridMarshallerMappingConsistencyTest1] [21:02:05] : [Step 4/5] [21:02:05] : [Step 4/5] >>> __________ ________________ [21:02:05] : [Step 4/5] >>> / _/ ___/ |/ / _/_ __/ __/ [21:02:05] : [Step 4/5] >>> _/ // (7 7 // / / / / _/ [21:02:05] : [Step 4/5] >>> /___/\___/_/|_/___/ /_/ /___/ [21:02:05] : [Step 4/5] >>> [21:02:05] : [Step 4/5] >>> ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:02:05] : [Step 4/5] >>> 2021 Copyright(C) Apache Software Foundation [21:02:05] : [Step 4/5] >>> [21:02:05] : [Step 4/5] >>> Ignite documentation: http://ignite.apache.org [21:02:05] : [Step 4/5] [21:02:05] : [Step 4/5] [2021-11-19 21:02:05,072][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][GridMarshallerMappingConsistencyTest1] Config URL: n/a [21:02:05] : [Step 4/5] [2021-11-19 21:02:05,073][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][GridMarshallerMappingConsistencyTest1] IgniteConfiguration [igniteInstanceName=marshaller.GridMarshallerMappingConsistencyTest1, pubPoolSize=24, svcPoolSize=24, callbackPoolSize=24, stripedPoolSize=24, sysPoolSize=24, mgmtPoolSize=4, dataStreamerPoolSize=24, utilityCachePoolSize=24, utilityCacheKeepAliveTime=60000, p2pPoolSize=2, qryPoolSize=24, buildIdxPoolSize=4, igniteHome=/opt/buildagent/work/7bc1c54bc719b67c, igniteWorkDir=/opt/buildagent/work/7bc1c54bc719b67c/work/test/marshaller.GridMarshallerMappingConsistencyTest1, mbeanSrv=com.sun.jmx.mbeanserver.JmxMBeanServer@6fe85038, nodeId=7fe8a8f0-201c-4a97-8573-abfb8c600001, marsh=BinaryMarshaller [], marshLocJobs=false, daemon=false, p2pEnabled=true, netTimeout=10000, netCompressionLevel=1, sndRetryDelay=1000, sndRetryCnt=3, metricsHistSize=10000, metricsUpdateFreq=1000, metricsExpTime=9223372036854775807, discoSpi=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=0, ackTimeout=0, marsh=null, reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], segPlc=STOP, segResolveAttempts=2, waitForSegOnStart=true, allResolversPassReq=true, segChkFreq=10000, commSpi=TcpCommunicationSpi [connectGate=org.apache.ignite.spi.communication.tcp.internal.ConnectGateway@3b53cdc7, ctxInitLatch=java.util.concurrent.CountDownLatch@4890ca0c[Count = 1], stopping=false, clientPool=null, nioSrvWrapper=null, stateProvider=null], evtSpi=MemoryEventStorageSpi [expireAgeMs=9223372036854775807, expireCnt=10000, filter=null], colSpi=NoopCollisionSpi [], deploySpi=LocalDeploymentSpi [], indexingSpi=org.apache.ignite.spi.indexing.noop.NoopIndexingSpi@5a6e1032, addrRslvr=null, encryptionSpi=org.apache.ignite.spi.encryption.noop.NoopEncryptionSpi@1916289c, tracingSpi=org.apache.ignite.spi.tracing.NoopTracingSpi@6d2a6d25, clientMode=false, rebalanceThreadPoolSize=4, rebalanceTimeout=10000, rebalanceBatchesPrefetchCnt=3, rebalanceThrottle=0, rebalanceBatchSize=524288, txCfg=TransactionConfiguration [txSerEnabled=false, dfltIsolation=REPEATABLE_READ, dfltConcurrency=PESSIMISTIC, dfltTxTimeout=0, txTimeoutOnPartitionMapExchange=0, deadlockTimeout=10000, pessimisticTxLogSize=0, pessimisticTxLogLinger=10000, tmLookupClsName=null, txManagerFactory=null, useJtaSync=false], cacheSanityCheckEnabled=true, discoStartupDelay=60000, deployMode=SHARED, p2pMissedCacheSize=100, locHost=127.0.0.1, timeSrvPortBase=31100, timeSrvPortRange=100, failureDetectionTimeout=10000, sysWorkerBlockedTimeout=null, clientFailureDetectionTimeout=10000, metricsLogFreq=0, connectorCfg=null, odbcCfg=null, warmupClos=null, atomicCfg=AtomicConfiguration [seqReserveSize=1000, cacheMode=PARTITIONED, backups=1, aff=null, grpName=null], classLdr=null, sslCtxFactory=null, platformCfg=null, binaryCfg=null, memCfg=null, pstCfg=null, dsCfg=DataStorageConfiguration [sysRegionInitSize=41943040, sysRegionMaxSize=104857600, pageSize=0, concLvl=0, dfltDataRegConf=DataRegionConfiguration [name=default, maxSize=268435456, initSize=268435456, swapPath=null, pageEvictionMode=DISABLED, pageReplacementMode=CLOCK, evictionThreshold=0.9, emptyPagesPoolSize=100, metricsEnabled=false, metricsSubIntervalCount=5, metricsRateTimeInterval=60000, persistenceEnabled=true, checkpointPageBufSize=0, lazyMemoryAllocation=true, warmUpCfg=null], dataRegions=null, storagePath=null, checkpointFreq=180000, lockWaitTime=10000, checkpointThreads=4, checkpointWriteOrder=SEQUENTIAL, walHistSize=20, maxWalArchiveSize=1073741824, walSegments=10, walSegmentSize=67108864, walPath=db/wal, walArchivePath=db/wal/archive, cdcWalPath=db/wal/cdc, cdcEnabled=false, metricsEnabled=false, walMode=LOG_ONLY, walTlbSize=131072, walBuffSize=0, walFlushFreq=2000, walFsyncDelay=1000, walRecordIterBuffSize=67108864, alwaysWriteFullPages=false, fileIOFactory=org.apache.ignite.internal.processors.cache.persistence.file.AsyncFileIOFactory@2b963fcf, metricsSubIntervalCnt=5, metricsRateTimeInterval=60000, walAutoArchiveAfterInactivity=-1, walForceArchiveTimeout=-1, writeThrottlingEnabled=false, walCompactionEnabled=false, walCompactionLevel=1, checkpointReadLockTimeout=null, walPageCompression=DISABLED, walPageCompressionLevel=null, dfltWarmUpCfg=null, encCfg=org.apache.ignite.configuration.EncryptionConfiguration@117cab16, defragmentationThreadPoolSize=4, minWalArchiveSize=-1], snapshotPath=snapshots, activeOnStart=true, activeOnStartPropSetFlag=false, autoActivation=true, autoActivationPropSetFlag=false, clusterStateOnStart=null, sqlConnCfg=null, cliConnCfg=ClientConnectorConfiguration [host=null, port=10800, portRange=100, sockSndBufSize=0, sockRcvBufSize=0, tcpNoDelay=true, maxOpenCursorsPerConn=128, threadPoolSize=24, selectorCnt=12, idleTimeout=0, handshakeTimeout=10000, jdbcEnabled=true, odbcEnabled=true, thinCliEnabled=true, sslEnabled=false, useIgniteSslCtxFactory=true, sslClientAuth=false, sslCtxFactory=null, thinCliCfg=ThinClientConfiguration [maxActiveTxPerConn=100, maxActiveComputeTasksPerConn=0]], mvccVacuumThreadCnt=2, mvccVacuumFreq=5000, authEnabled=false, failureHnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]], commFailureRslvr=null, sqlCfg=SqlConfiguration [longQryWarnTimeout=3000, dfltQryTimeout=0, sqlQryHistSize=1000, validationEnabled=false], asyncContinuationExecutor=null] [21:02:05] : [Step 4/5] [2021-11-19 21:02:05,080][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][GridMarshallerMappingConsistencyTest1] Daemon mode: off [21:02:05] : [Step 4/5] [2021-11-19 21:02:05,080][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][GridMarshallerMappingConsistencyTest1] OS: Linux 4.15.0-151-generic amd64 [21:02:05] : [Step 4/5] [2021-11-19 21:02:05,081][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][GridMarshallerMappingConsistencyTest1] OS user: teamcity [21:02:05] : [Step 4/5] [2021-11-19 21:02:05,081][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][GridMarshallerMappingConsistencyTest1] PID: 16724 [21:02:05] : [Step 4/5] [2021-11-19 21:02:05,081][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][GridMarshallerMappingConsistencyTest1] Language runtime: Java Platform API Specification ver. 1.8 [21:02:05] : [Step 4/5] [2021-11-19 21:02:05,082][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][GridMarshallerMappingConsistencyTest1] VM information: Java(TM) SE Runtime Environment 1.8.0_261-b12 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 25.261-b12 [21:02:05] : [Step 4/5] [2021-11-19 21:02:05,082][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][GridMarshallerMappingConsistencyTest1] VM total memory: 1.9GB [21:02:05] : [Step 4/5] [2021-11-19 21:02:05,082][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][GridMarshallerMappingConsistencyTest1] Remote Management [restart: off, REST: off, JMX (remote: off)] [21:02:05] : [Step 4/5] [2021-11-19 21:02:05,083][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][GridMarshallerMappingConsistencyTest1] Logger: GridTestLog4jLogger [quiet=false, config=null] [21:02:05] : [Step 4/5] [2021-11-19 21:02:05,083][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][GridMarshallerMappingConsistencyTest1] IGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c [21:02:05] : [Step 4/5] [2021-11-19 21:02:05,083][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][GridMarshallerMappingConsistencyTest1] VM arguments: [-DIGNITE_DUMP_THREADS_ON_FAILURE=false, -DMono=/usr/bin/mono-sgen, -DMono4.0_x64=/usr/lib/mono/4.0, -DMono4.5_x64=/usr/lib/mono/4.5, -DMonoVersion=6.12.0.90, -DSKIP_BUILD=false, -Dagent.home.dir=/opt/buildagent, -Dagent.name=aitc-lin02_03, -Dagent.ownPort=9090, -Dagent.work.dir=/opt/buildagent/work, -Dbuild.number=95, -Dbuild.vcs.number=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.1=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.GitHubApacheIgnite=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dclassworlds.conf=/opt/buildagent/temp/buildTmp/teamcity.m2.conf, -Dcom.jetbrains.maven.watcher.report.file=/opt/buildagent/temp/buildTmp/maven-build-info.xml, -Djava.io.tmpdir=/opt/buildagent/temp/buildTmp, -Dmaven.home=/opt/buildagent/tools/maven3_6, -Dmaven.multiModuleProjectDirectory=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.agent.cpuBenchmark=457, -Dteamcity.agent.dotnet.agent_url=http://localhost:9090/RPC2, -Dteamcity.agent.dotnet.build_id=6278078, -Dteamcity.auth.password=*******, -Dteamcity.auth.userId=TeamCityBuildId=6278078, -Dteamcity.build.changedFiles.file=/opt/buildagent/temp/buildTmp/changedFiles6342607772318147725.txt, -Dteamcity.build.checkoutDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.build.id=6278078, -Dteamcity.build.properties.file=/opt/buildagent/temp/buildTmp/teamcity.build5164517880467851002.properties, -Dteamcity.build.tempDir=/opt/buildagent/temp/buildTmp, -Dteamcity.build.workingDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.buildConfName=Basic 3, -Dteamcity.buildType.id=IgniteTests24Java8_Basic3, -Dteamcity.configuration.properties.file=/opt/buildagent/temp/buildTmp/teamcity.config5591980786735343870.properties, -Dteamcity.maven.userSettings.path=/opt/buildagent/temp/buildTmp/maven_settings_585072866407032347.xml, -Dteamcity.maven.watcher.home=/opt/buildagent/plugins/mavenPlugin/maven-watcher-jdk16, -Dteamcity.projectName=Ignite Tests 2.x (JDK 8/11), -Dteamcity.runner.properties.file=/opt/buildagent/temp/buildTmp/teamcity.runner9098465561618137420.properties, -Dteamcity.tests.recentlyFailedTests.file=/opt/buildagent/temp/buildTmp/testsToRunFirst3891775683130404069.txt, -Dteamcity.version=2021.2 (build 99542), -ea, -Xms2g, -Xmx2g, -XX:+HeapDumpOnOutOfMemoryError, -DIGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_TEST_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_UPDATE_NOTIFIER=false, -DIGNITE_NO_DISCO_ORDER=true, -DIGNITE_PERFORMANCE_SUGGESTIONS_DISABLED=true, -Djava.net.preferIPv4Stack=true, -DTEST_SCALE_FACTOR=1.0, -DIGNITE_TEST_PROP_LOG4J_FILE=log4j-tc-test.xml, -DIGNITE_QUIET=false, -DIGNITE_MARSHAL_BUFFERS_RECHECK=1000, -Dmaven.repo.local=/opt/buildagent/.m2/repository] [21:02:05] : [Step 4/5] [2021-11-19 21:02:05,087][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][GridMarshallerMappingConsistencyTest1] System cache's DataRegion size is configured to 40 MB. Use DataStorageConfiguration.systemRegionInitialSize property to change the setting. [21:02:05] : [Step 4/5] [2021-11-19 21:02:05,088][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][GridMarshallerMappingConsistencyTest1] Configured caches [in 'sysMemPlc' dataRegion: ['ignite-sys-cache']] [21:02:05]W: [org.apache.ignite:ignite-core] [2021-11-19 21:02:05,088][WARN ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][GridMarshallerMappingConsistencyTest1] Peer class loading is enabled (disable it in production for performance and deployment consistency reasons) [21:02:05] : [Step 4/5] [2021-11-19 21:02:05,089][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][GridMarshallerMappingConsistencyTest1] 3-rd party licenses can be found at: /opt/buildagent/work/7bc1c54bc719b67c/libs/licenses [21:02:05] : [Step 4/5] Surefire report watcher [21:02:05] : [Surefire report watcher] Watching paths: [21:02:05] : [Surefire report watcher] /opt/buildagent/temp/buildTmp/ignite-tools-junit-reports1777670380320881607/test-org.apache.ignite.testsuites.IgniteBasicWithPersistenceTestSuite1637344912220.xml [21:02:05] : [Step 4/5] [2021-11-19 21:02:05,093][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][IgnitePluginProcessor] Configured plugins: [21:02:05]i: [Step 4/5] org.apache.ignite.testsuites.IgniteBasicWithPersistenceTestSuite [21:02:05]i: [org.apache.ignite.testsuites.IgniteBasicWithPersistenceTestSuite] org.apache.ignite.internal.ClusterBaselineNodesMetricsSelfTest.testBaselineNodes [21:02:05] : [Step 4/5] [2021-11-19 21:02:05,094][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][IgnitePluginProcessor] ^-- StanByClusterTestProvider 1.0 [21:02:05] : [Step 4/5] [2021-11-19 21:02:05,094][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][IgnitePluginProcessor] ^-- null [21:02:05] : [Step 4/5] [2021-11-19 21:02:05,094][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][IgnitePluginProcessor] [21:02:05] : [Step 4/5] [2021-11-19 21:02:05,094][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][IgnitePluginProcessor] ^-- PageMemory tracker plugin 1.0 [21:02:05] : [Step 4/5] [2021-11-19 21:02:05,094][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][IgnitePluginProcessor] ^-- null [21:02:05] : [Step 4/5] [2021-11-19 21:02:05,095][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][IgnitePluginProcessor] [21:02:05] : [Step 4/5] [2021-11-19 21:02:05,095][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][IgnitePluginProcessor] ^-- TestDistibutedConfigurationPlugin 1.0 [21:02:05] : [Step 4/5] [2021-11-19 21:02:05,095][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][IgnitePluginProcessor] ^-- null [21:02:05] : [Step 4/5] [2021-11-19 21:02:05,095][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][IgnitePluginProcessor] [21:02:05] : [Step 4/5] [2021-11-19 21:02:05,095][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][IgnitePluginProcessor] ^-- NodeValidationPluginProvider 1.0 [21:02:05] : [Step 4/5] [2021-11-19 21:02:05,096][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][IgnitePluginProcessor] ^-- null [21:02:05] : [Step 4/5] [2021-11-19 21:02:05,096][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][IgnitePluginProcessor] [21:02:05] : [Step 4/5] [2021-11-19 21:02:05,096][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][FailureProcessor] Configured failure handler: [hnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]]] [21:02:05] : [Step 4/5] [2021-11-19 21:02:05,113][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][TcpCommunicationSpi] Successfully bound communication NIO server to TCP port [port=45030, locHost=/127.0.0.1, selectorsCnt=12, selectorSpins=0, pairedConn=false] [21:02:05]W: [org.apache.ignite:ignite-core] [2021-11-19 21:02:05,114][WARN ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][TcpCommunicationSpi] Message queue limit is set to 0 which may lead to potential OOMEs when running cache operations in FULL_ASYNC or PRIMARY_SYNC modes due to message queues growth on sender and receiver sides. [21:02:05] : [Step 4/5] [2021-11-19 21:02:05,120][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][GridCollisionManager] Collision resolution is disabled (all jobs will be activated upon arrival). [21:02:05] : [Step 4/5] [2021-11-19 21:02:05,121][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][GridMarshallerMappingConsistencyTest1] Security status [authentication=off, sandbox=off, tls/ssl=off] [21:02:05] : [Step 4/5] [2021-11-19 21:02:05,123][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][MaintenanceProcessor] Resolved store directory for node persistent data: /opt/buildagent/work/7bc1c54bc719b67c/work/test/marshaller.GridMarshallerMappingConsistencyTest1/db/marshaller_GridMarshallerMappingConsistencyTest1 [21:02:05] : [Step 4/5] [2021-11-19 21:02:05,125][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][CacheObjectBinaryProcessorImpl] Resolved directory for serialized binary metadata: /opt/buildagent/work/7bc1c54bc719b67c/work/test/marshaller.GridMarshallerMappingConsistencyTest1/db/binary_meta/marshaller_GridMarshallerMappingConsistencyTest1 [21:02:05] : [Step 4/5] [2021-11-19 21:02:05,131][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/test/marshaller.GridMarshallerMappingConsistencyTest1/db/marshaller_GridMarshallerMappingConsistencyTest1 [21:02:05] : [Step 4/5] [2021-11-19 21:02:05,132][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][FileWriteAheadLogManager] Resolved write ahead log work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/test/marshaller.GridMarshallerMappingConsistencyTest1/db/wal/marshaller_GridMarshallerMappingConsistencyTest1 [21:02:05] : [Step 4/5] [2021-11-19 21:02:05,132][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][FileWriteAheadLogManager] Resolved write ahead log archive directory: /opt/buildagent/work/7bc1c54bc719b67c/work/test/marshaller.GridMarshallerMappingConsistencyTest1/db/wal/archive/marshaller_GridMarshallerMappingConsistencyTest1 [21:02:05] : [Step 4/5] [2021-11-19 21:02:05,640][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/test/marshaller.GridMarshallerMappingConsistencyTest1/db/wal/marshaller_GridMarshallerMappingConsistencyTest1/0000000000000000.wal [21:02:05] : [Step 4/5] [2021-11-19 21:02:05,641][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][FileHandleManagerImpl] Initialized write-ahead log manager [mode=LOG_ONLY] [21:02:05] : [Step 4/5] [2021-11-19 21:02:05,648][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][GridCacheDatabaseSharedManager] Configured data regions initialized successfully [total=5] [21:02:05] : [Step 4/5] [2021-11-19 21:02:05,651][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][IgniteSnapshotManager] Resolved snapshot work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/test/marshaller.GridMarshallerMappingConsistencyTest1/snapshots [21:02:05] : [Step 4/5] [2021-11-19 21:02:05,652][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][IgniteSnapshotManager] Resolved temp directory for snapshot creation: /opt/buildagent/work/7bc1c54bc719b67c/work/test/marshaller.GridMarshallerMappingConsistencyTest1/db/marshaller_GridMarshallerMappingConsistencyTest1/snp [21:02:05] : [Step 4/5] [2021-11-19 21:02:05,657][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][ClientListenerProcessor] Client connector processor has started on TCP port 10800 [21:02:05] : [Step 4/5] [2021-11-19 21:02:05,665][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][GridMarshallerMappingConsistencyTest1] Non-loopback local IPs: 172.17.0.4 [21:02:05] : [Step 4/5] [2021-11-19 21:02:05,666][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][GridMarshallerMappingConsistencyTest1] Enabled local MACs: 0242AC110004 [21:02:05] : [Step 4/5] [2021-11-19 21:02:05,668][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:02:05] : [Step 4/5] [2021-11-19 21:02:05,670][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:02:05] : [Step 4/5] [2021-11-19 21:02:05,671][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:02:05] : [Step 4/5] [2021-11-19 21:02:05,674][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][GridCacheDatabaseSharedManager] Applying lost metastore updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:02:05] : [Step 4/5] [2021-11-19 21:02:05,675][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=0 ms] [21:02:05] : [Step 4/5] [2021-11-19 21:02:05,675][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][GridCacheProcessor] Restoring partition state for local groups. [21:02:05] : [Step 4/5] [2021-11-19 21:02:05,676][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=0, partitionsProcessed=0, time=0ms] [21:02:05] : [Step 4/5] [2021-11-19 21:02:05,677][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][GridEncryptionManager] Encryption keys loaded from metastore. [grps=, masterKeyName=null] [21:02:05] : [Step 4/5] [2021-11-19 21:02:05,682][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][ClusterProcessor] Cluster ID and tag has been read from metastorage: null [21:02:05] : [Step 4/5] [2021-11-19 21:02:05,683][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][IgniteClusterImpl] Shutdown policy was updated [oldVal=null, newVal=null] [21:02:05] : [Step 4/5] [2021-11-19 21:02:05,684][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][GridCacheDatabaseSharedManager] Checkpoint frequency deviation changed [oldVal=null, newVal=null] [21:02:05] : [Step 4/5] [2021-11-19 21:02:05,693][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][FilePageStoreManager] Cleanup cache stores [total=1, left=0, cleanFiles=false] [21:02:05] : [Step 4/5] [2021-11-19 21:02:05,697][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:02:05] : [Step 4/5] [2021-11-19 21:02:05,698][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:02:05] : [Step 4/5] [2021-11-19 21:02:05,699][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:02:05] : [Step 4/5] [2021-11-19 21:02:05,700][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][GridCacheDatabaseSharedManager] Data Regions Started: 5 [21:02:05] : [Step 4/5] [2021-11-19 21:02:05,700][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][GridCacheDatabaseSharedManager] ^-- sysMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:02:05] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:02:05] : [Step 4/5] ^-- default region [type=default, persistence=true, lazyAlloc=true, [21:02:05] : [Step 4/5] ... initCfg=256MB, maxCfg=256MB, usedRam=0MB, freeRam=100%, allocRam=0MB, allocTotal=0MB] [21:02:05] : [Step 4/5] ^-- metastoreMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:02:05] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:02:05] : [Step 4/5] ^-- TxLog region [type=internal, persistence=true, lazyAlloc=false, [21:02:05] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:02:05] : [Step 4/5] ^-- volatileDsMemPlc region [type=user, persistence=false, lazyAlloc=true, [21:02:05] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB] [21:02:05] : [Step 4/5] ^-- Ignite persistence [used=0MB] [21:02:05] : [Step 4/5] [21:02:05] : [Step 4/5] [2021-11-19 21:02:05,702][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][GridCacheDatabaseSharedManager] Starting binary memory restore for: [-2100569601] [21:02:05] : [Step 4/5] [2021-11-19 21:02:05,711][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:02:05] : [Step 4/5] [2021-11-19 21:02:05,711][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:02:05] : [Step 4/5] [2021-11-19 21:02:05,713][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/test/marshaller.GridMarshallerMappingConsistencyTest1/db/wal/marshaller_GridMarshallerMappingConsistencyTest1/0000000000000000.wal, offset=0, ver=2] [21:02:05] : [Step 4/5] [2021-11-19 21:02:05,717][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][GridCacheProcessor] Started cache in recovery mode [name=ignite-sys-cache, id=-2100569601, dataRegionName=sysMemPlc, mode=REPLICATED, atomicity=TRANSACTIONAL, backups=2147483647, mvcc=false] [21:02:05] : [Step 4/5] [2021-11-19 21:02:05,718][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][GridCacheDatabaseSharedManager] Binary recovery performed in 16 ms. [21:02:05] : [Step 4/5] [2021-11-19 21:02:05,718][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:02:05] : [Step 4/5] [2021-11-19 21:02:05,719][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][GridCacheDatabaseSharedManager] Applying lost cache updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:02:05] : [Step 4/5] [2021-11-19 21:02:05,784][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=61 ms] [21:02:05] : [Step 4/5] [2021-11-19 21:02:05,785][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][GridCacheProcessor] Restoring partition state for local groups. [21:02:05] : [Step 4/5] [2021-11-19 21:02:05,793][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=1, partitionsProcessed=100, time=0ms] [21:02:06] : [Step 4/5] [2021-11-19 21:02:06,291][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][TestTcpDiscoverySpi] Successfully bound to TCP port [port=47500, localHost=localhost/127.0.0.1, locNodeId=7fe8a8f0-201c-4a97-8573-abfb8c600001] [21:02:06] : [Step 4/5] [2021-11-19 21:02:06,303][INFO ][disco-notifier-worker-#1916%marshaller.GridMarshallerMappingConsistencyTest1%][MvccProcessorImpl] Assigned mvcc coordinator [crd=MvccCoordinator [topVer=AffinityTopologyVersion [topVer=1, minorTopVer=0], nodeId=7fe8a8f0-201c-4a97-8573-abfb8c600001, ver=1637344926294, local=true, initialized=false]] [21:02:06] : [Step 4/5] [2021-11-19 21:02:06,305][INFO ][sys-#1905%marshaller.GridMarshallerMappingConsistencyTest1%][ClusterProcessor] Writing cluster ID and tag to metastorage on ready for write ClusterIdAndTag [id=34c655b9-4134-491f-9fcb-73e726dd8bbc, tag=stupefied_chaplygin] [21:02:06] : [Step 4/5] [2021-11-19 21:02:06,321][INFO ][disco-notifier-worker-#1916%marshaller.GridMarshallerMappingConsistencyTest1%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustEnabled' was changed from 'null' to 'false' [21:02:06] : [Step 4/5] [2021-11-19 21:02:06,323][INFO ][disco-notifier-worker-#1916%marshaller.GridMarshallerMappingConsistencyTest1%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustTimeout' was changed from 'null' to '300000' [21:02:06] : [Step 4/5] [2021-11-19 21:02:06,324][INFO ][disco-notifier-worker-#1916%marshaller.GridMarshallerMappingConsistencyTest1%][ClusterProcessor] stupefied_chaplygin [21:02:06] : [Step 4/5] [2021-11-19 21:02:06,324][INFO ][disco-notifier-worker-#1916%marshaller.GridMarshallerMappingConsistencyTest1%][IgniteTxManager] Transactions parameter 'longOperationsDumpTimeout' was changed from 'null' to '60000' [21:02:06] : [Step 4/5] [2021-11-19 21:02:06,325][INFO ][disco-notifier-worker-#1916%marshaller.GridMarshallerMappingConsistencyTest1%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpThreshold' was changed from 'null' to '0' [21:02:06] : [Step 4/5] [2021-11-19 21:02:06,326][INFO ][disco-notifier-worker-#1916%marshaller.GridMarshallerMappingConsistencyTest1%][IgniteTxManager] Transactions parameter 'transactionTimeDumpSamplesCoefficient' was changed from 'null' to '0.0' [21:02:06] : [Step 4/5] [2021-11-19 21:02:06,327][INFO ][disco-notifier-worker-#1916%marshaller.GridMarshallerMappingConsistencyTest1%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpSamplesPerSecondLimit' was changed from 'null' to '5' [21:02:06] : [Step 4/5] [2021-11-19 21:02:06,328][INFO ][disco-notifier-worker-#1916%marshaller.GridMarshallerMappingConsistencyTest1%][IgniteTxManager] Transactions parameter 'collisionsDumpInterval' was changed from 'null' to '1000' [21:02:06] : [Step 4/5] [2021-11-19 21:02:06,329][INFO ][disco-notifier-worker-#1916%marshaller.GridMarshallerMappingConsistencyTest1%][IgniteTxManager] Transactions parameter 'txOwnerDumpRequestsAllowed' was changed from 'null' to 'true' [21:02:06] : [Step 4/5] [2021-11-19 21:02:06,329][INFO ][disco-notifier-worker-#1916%marshaller.GridMarshallerMappingConsistencyTest1%][GridCacheDatabaseSharedManager] Historical rebalance WAL threshold changed [property=historical.rebalance.threshold, oldVal=null, newVal=500] [21:02:06] : [Step 4/5] [2021-11-19 21:02:06,371][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][GridMarshallerMappingConsistencyTest1] To start Console Management & Monitoring run ignitevisorcmd.{sh|bat} [21:02:06] : [Step 4/5] [2021-11-19 21:02:06,372][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][GridMarshallerMappingConsistencyTest1] [21:02:06] : [Step 4/5] [21:02:06] : [Step 4/5] >>> +-------------------------------------------+ [21:02:06] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:02:06] : [Step 4/5] >>> +-------------------------------------------+ [21:02:06] : [Step 4/5] >>> OS name: Linux 4.15.0-151-generic amd64 [21:02:06] : [Step 4/5] >>> CPU(s): 24 [21:02:06] : [Step 4/5] >>> Heap: 2.0GB [21:02:06] : [Step 4/5] >>> VM name: 16724@c4dfe9a430b2 [21:02:06] : [Step 4/5] >>> Ignite instance name: marshaller.GridMarshallerMappingConsistencyTest1 [21:02:06] : [Step 4/5] >>> Local node [ID=7FE8A8F0-201C-4A97-8573-ABFB8C600001, order=1, clientMode=false] [21:02:06] : [Step 4/5] >>> Local node addresses: [127.0.0.1] [21:02:06] : [Step 4/5] >>> Local ports: TCP:10800 TCP:45030 TCP:47500 [21:02:06] : [Step 4/5] [21:02:06] : [Step 4/5] [2021-11-19 21:02:06,373][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][GridMarshallerMappingConsistencyTest1] >>> Ignite cluster is in INACTIVE state (limited functionality available). Use control.(sh|bat) script or IgniteCluster.state(ClusterState.ACTIVE) to change the state. [21:02:06] : [Step 4/5] [2021-11-19 21:02:06,374][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][GridDiscoveryManager] Topology snapshot [ver=1, locNode=7fe8a8f0, servers=1, clients=0, state=INACTIVE, CPUs=24, offheap=0.25GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=7fe8a8f0-201c-4a97-8573-abfb8c600001, consistentId=marshaller.GridMarshallerMappingConsistencyTest1, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:02:06] : [Step 4/5] [2021-11-19 21:02:06,375][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][G] Node started : [stage="Configure system pool" (0 ms),stage="Start managers" (54 ms),stage="Configure binary metadata" (2 ms),stage="Start processors" (536 ms),stage="Start 'StanByClusterTestProvider' plugin" (0 ms),stage="Start 'PageMemory tracker plugin' plugin" (0 ms),stage="Start 'TestDistibutedConfigurationPlugin' plugin" (0 ms),stage="Start 'NodeValidationPluginProvider' plugin" (0 ms),stage="Init metastore" (29 ms),stage="Init and start regions" (7 ms),stage="Restore binary memory" (16 ms),stage="Restore logical state" (75 ms),stage="Finish recovery" (495 ms),stage="Join topology" (13 ms),stage="Await transition" (12 ms),stage="Await exchange" (58 ms),stage="Total time" (1297 ms)] [21:02:06] : [Step 4/5] [2021-11-19 21:02:06,377][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][root] Node started with the following configuration [id=7fe8a8f0-201c-4a97-8573-abfb8c600001, marshaller=BinaryMarshaller [], discovery=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=5000, ackTimeout=5000, marsh=JdkMarshaller [clsFilter=org.apache.ignite.marshaller.MarshallerUtils$1@14caa75f], reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], binaryCfg=null, lateAff=true] [21:02:06] : [Step 4/5] [2021-11-19 21:02:06,386][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][GridMarshallerMappingConsistencyTest2] [21:02:06] : [Step 4/5] [21:02:06] : [Step 4/5] >>> __________ ________________ [21:02:06] : [Step 4/5] >>> / _/ ___/ |/ / _/_ __/ __/ [21:02:06] : [Step 4/5] >>> _/ // (7 7 // / / / / _/ [21:02:06] : [Step 4/5] >>> /___/\___/_/|_/___/ /_/ /___/ [21:02:06] : [Step 4/5] >>> [21:02:06] : [Step 4/5] >>> ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:02:06] : [Step 4/5] >>> 2021 Copyright(C) Apache Software Foundation [21:02:06] : [Step 4/5] >>> [21:02:06] : [Step 4/5] >>> Ignite documentation: http://ignite.apache.org [21:02:06] : [Step 4/5] [21:02:06] : [Step 4/5] [2021-11-19 21:02:06,386][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][GridMarshallerMappingConsistencyTest2] Config URL: n/a [21:02:06] : [Step 4/5] [2021-11-19 21:02:06,387][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][GridMarshallerMappingConsistencyTest2] IgniteConfiguration [igniteInstanceName=marshaller.GridMarshallerMappingConsistencyTest2, pubPoolSize=24, svcPoolSize=24, callbackPoolSize=24, stripedPoolSize=24, sysPoolSize=24, mgmtPoolSize=4, dataStreamerPoolSize=24, utilityCachePoolSize=24, utilityCacheKeepAliveTime=60000, p2pPoolSize=2, qryPoolSize=24, buildIdxPoolSize=4, igniteHome=/opt/buildagent/work/7bc1c54bc719b67c, igniteWorkDir=/opt/buildagent/work/7bc1c54bc719b67c/work/test/marshaller.GridMarshallerMappingConsistencyTest2, mbeanSrv=com.sun.jmx.mbeanserver.JmxMBeanServer@6fe85038, nodeId=44fc68b2-4a69-4d45-96a9-74a049a00002, marsh=BinaryMarshaller [], marshLocJobs=false, daemon=false, p2pEnabled=true, netTimeout=10000, netCompressionLevel=1, sndRetryDelay=1000, sndRetryCnt=3, metricsHistSize=10000, metricsUpdateFreq=1000, metricsExpTime=9223372036854775807, discoSpi=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=0, ackTimeout=0, marsh=null, reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], segPlc=STOP, segResolveAttempts=2, waitForSegOnStart=true, allResolversPassReq=true, segChkFreq=10000, commSpi=TcpCommunicationSpi [connectGate=org.apache.ignite.spi.communication.tcp.internal.ConnectGateway@42c88ee3, ctxInitLatch=java.util.concurrent.CountDownLatch@9e47c04[Count = 1], stopping=false, clientPool=null, nioSrvWrapper=null, stateProvider=null], evtSpi=MemoryEventStorageSpi [expireAgeMs=9223372036854775807, expireCnt=10000, filter=null], colSpi=NoopCollisionSpi [], deploySpi=LocalDeploymentSpi [], indexingSpi=org.apache.ignite.spi.indexing.noop.NoopIndexingSpi@2decd8f9, addrRslvr=null, encryptionSpi=org.apache.ignite.spi.encryption.noop.NoopEncryptionSpi@20992c5f, tracingSpi=org.apache.ignite.spi.tracing.NoopTracingSpi@7c762a7e, clientMode=false, rebalanceThreadPoolSize=4, rebalanceTimeout=10000, rebalanceBatchesPrefetchCnt=3, rebalanceThrottle=0, rebalanceBatchSize=524288, txCfg=TransactionConfiguration [txSerEnabled=false, dfltIsolation=REPEATABLE_READ, dfltConcurrency=PESSIMISTIC, dfltTxTimeout=0, txTimeoutOnPartitionMapExchange=0, deadlockTimeout=10000, pessimisticTxLogSize=0, pessimisticTxLogLinger=10000, tmLookupClsName=null, txManagerFactory=null, useJtaSync=false], cacheSanityCheckEnabled=true, discoStartupDelay=60000, deployMode=SHARED, p2pMissedCacheSize=100, locHost=127.0.0.1, timeSrvPortBase=31100, timeSrvPortRange=100, failureDetectionTimeout=10000, sysWorkerBlockedTimeout=null, clientFailureDetectionTimeout=10000, metricsLogFreq=0, connectorCfg=null, odbcCfg=null, warmupClos=null, atomicCfg=AtomicConfiguration [seqReserveSize=1000, cacheMode=PARTITIONED, backups=1, aff=null, grpName=null], classLdr=null, sslCtxFactory=null, platformCfg=null, binaryCfg=null, memCfg=null, pstCfg=null, dsCfg=DataStorageConfiguration [sysRegionInitSize=41943040, sysRegionMaxSize=104857600, pageSize=0, concLvl=0, dfltDataRegConf=DataRegionConfiguration [name=default, maxSize=268435456, initSize=268435456, swapPath=null, pageEvictionMode=DISABLED, pageReplacementMode=CLOCK, evictionThreshold=0.9, emptyPagesPoolSize=100, metricsEnabled=false, metricsSubIntervalCount=5, metricsRateTimeInterval=60000, persistenceEnabled=true, checkpointPageBufSize=0, lazyMemoryAllocation=true, warmUpCfg=null], dataRegions=null, storagePath=null, checkpointFreq=180000, lockWaitTime=10000, checkpointThreads=4, checkpointWriteOrder=SEQUENTIAL, walHistSize=20, maxWalArchiveSize=1073741824, walSegments=10, walSegmentSize=67108864, walPath=db/wal, walArchivePath=db/wal/archive, cdcWalPath=db/wal/cdc, cdcEnabled=false, metricsEnabled=false, walMode=LOG_ONLY, walTlbSize=131072, walBuffSize=0, walFlushFreq=2000, walFsyncDelay=1000, walRecordIterBuffSize=67108864, alwaysWriteFullPages=false, fileIOFactory=org.apache.ignite.internal.processors.cache.persistence.file.AsyncFileIOFactory@3e81d110, metricsSubIntervalCnt=5, metricsRateTimeInterval=60000, walAutoArchiveAfterInactivity=-1, walForceArchiveTimeout=-1, writeThrottlingEnabled=false, walCompactionEnabled=false, walCompactionLevel=1, checkpointReadLockTimeout=null, walPageCompression=DISABLED, walPageCompressionLevel=null, dfltWarmUpCfg=null, encCfg=org.apache.ignite.configuration.EncryptionConfiguration@40f7807f, defragmentationThreadPoolSize=4, minWalArchiveSize=-1], snapshotPath=snapshots, activeOnStart=true, activeOnStartPropSetFlag=false, autoActivation=true, autoActivationPropSetFlag=false, clusterStateOnStart=null, sqlConnCfg=null, cliConnCfg=ClientConnectorConfiguration [host=null, port=10800, portRange=100, sockSndBufSize=0, sockRcvBufSize=0, tcpNoDelay=true, maxOpenCursorsPerConn=128, threadPoolSize=24, selectorCnt=12, idleTimeout=0, handshakeTimeout=10000, jdbcEnabled=true, odbcEnabled=true, thinCliEnabled=true, sslEnabled=false, useIgniteSslCtxFactory=true, sslClientAuth=false, sslCtxFactory=null, thinCliCfg=ThinClientConfiguration [maxActiveTxPerConn=100, maxActiveComputeTasksPerConn=0]], mvccVacuumThreadCnt=2, mvccVacuumFreq=5000, authEnabled=false, failureHnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]], commFailureRslvr=null, sqlCfg=SqlConfiguration [longQryWarnTimeout=3000, dfltQryTimeout=0, sqlQryHistSize=1000, validationEnabled=false], asyncContinuationExecutor=null] [21:02:06] : [Step 4/5] [2021-11-19 21:02:06,398][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][GridMarshallerMappingConsistencyTest2] Daemon mode: off [21:02:06] : [Step 4/5] [2021-11-19 21:02:06,398][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][GridMarshallerMappingConsistencyTest2] OS: Linux 4.15.0-151-generic amd64 [21:02:06] : [Step 4/5] [2021-11-19 21:02:06,398][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][GridMarshallerMappingConsistencyTest2] OS user: teamcity [21:02:06] : [Step 4/5] [2021-11-19 21:02:06,399][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][GridMarshallerMappingConsistencyTest2] PID: 16724 [21:02:06] : [Step 4/5] [2021-11-19 21:02:06,399][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][GridMarshallerMappingConsistencyTest2] Language runtime: Java Platform API Specification ver. 1.8 [21:02:06] : [Step 4/5] [2021-11-19 21:02:06,399][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][GridMarshallerMappingConsistencyTest2] VM information: Java(TM) SE Runtime Environment 1.8.0_261-b12 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 25.261-b12 [21:02:06] : [Step 4/5] [2021-11-19 21:02:06,400][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][GridMarshallerMappingConsistencyTest2] VM total memory: 1.9GB [21:02:06] : [Step 4/5] [2021-11-19 21:02:06,400][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][GridMarshallerMappingConsistencyTest2] Remote Management [restart: off, REST: off, JMX (remote: off)] [21:02:06] : [Step 4/5] [2021-11-19 21:02:06,401][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][GridMarshallerMappingConsistencyTest2] Logger: GridTestLog4jLogger [quiet=false, config=null] [21:02:06] : [Step 4/5] [2021-11-19 21:02:06,401][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][GridMarshallerMappingConsistencyTest2] IGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c [21:02:06] : [Step 4/5] [2021-11-19 21:02:06,402][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][GridMarshallerMappingConsistencyTest2] VM arguments: [-DIGNITE_DUMP_THREADS_ON_FAILURE=false, -DMono=/usr/bin/mono-sgen, -DMono4.0_x64=/usr/lib/mono/4.0, -DMono4.5_x64=/usr/lib/mono/4.5, -DMonoVersion=6.12.0.90, -DSKIP_BUILD=false, -Dagent.home.dir=/opt/buildagent, -Dagent.name=aitc-lin02_03, -Dagent.ownPort=9090, -Dagent.work.dir=/opt/buildagent/work, -Dbuild.number=95, -Dbuild.vcs.number=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.1=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.GitHubApacheIgnite=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dclassworlds.conf=/opt/buildagent/temp/buildTmp/teamcity.m2.conf, -Dcom.jetbrains.maven.watcher.report.file=/opt/buildagent/temp/buildTmp/maven-build-info.xml, -Djava.io.tmpdir=/opt/buildagent/temp/buildTmp, -Dmaven.home=/opt/buildagent/tools/maven3_6, -Dmaven.multiModuleProjectDirectory=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.agent.cpuBenchmark=457, -Dteamcity.agent.dotnet.agent_url=http://localhost:9090/RPC2, -Dteamcity.agent.dotnet.build_id=6278078, -Dteamcity.auth.password=*******, -Dteamcity.auth.userId=TeamCityBuildId=6278078, -Dteamcity.build.changedFiles.file=/opt/buildagent/temp/buildTmp/changedFiles6342607772318147725.txt, -Dteamcity.build.checkoutDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.build.id=6278078, -Dteamcity.build.properties.file=/opt/buildagent/temp/buildTmp/teamcity.build5164517880467851002.properties, -Dteamcity.build.tempDir=/opt/buildagent/temp/buildTmp, -Dteamcity.build.workingDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.buildConfName=Basic 3, -Dteamcity.buildType.id=IgniteTests24Java8_Basic3, -Dteamcity.configuration.properties.file=/opt/buildagent/temp/buildTmp/teamcity.config5591980786735343870.properties, -Dteamcity.maven.userSettings.path=/opt/buildagent/temp/buildTmp/maven_settings_585072866407032347.xml, -Dteamcity.maven.watcher.home=/opt/buildagent/plugins/mavenPlugin/maven-watcher-jdk16, -Dteamcity.projectName=Ignite Tests 2.x (JDK 8/11), -Dteamcity.runner.properties.file=/opt/buildagent/temp/buildTmp/teamcity.runner9098465561618137420.properties, -Dteamcity.tests.recentlyFailedTests.file=/opt/buildagent/temp/buildTmp/testsToRunFirst3891775683130404069.txt, -Dteamcity.version=2021.2 (build 99542), -ea, -Xms2g, -Xmx2g, -XX:+HeapDumpOnOutOfMemoryError, -DIGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_TEST_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_UPDATE_NOTIFIER=false, -DIGNITE_NO_DISCO_ORDER=true, -DIGNITE_PERFORMANCE_SUGGESTIONS_DISABLED=true, -Djava.net.preferIPv4Stack=true, -DTEST_SCALE_FACTOR=1.0, -DIGNITE_TEST_PROP_LOG4J_FILE=log4j-tc-test.xml, -DIGNITE_QUIET=false, -DIGNITE_MARSHAL_BUFFERS_RECHECK=1000, -Dmaven.repo.local=/opt/buildagent/.m2/repository] [21:02:06] : [Step 4/5] [2021-11-19 21:02:06,407][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][GridMarshallerMappingConsistencyTest2] System cache's DataRegion size is configured to 40 MB. Use DataStorageConfiguration.systemRegionInitialSize property to change the setting. [21:02:06] : [Step 4/5] [2021-11-19 21:02:06,407][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][GridMarshallerMappingConsistencyTest2] Configured caches [in 'sysMemPlc' dataRegion: ['ignite-sys-cache']] [21:02:06]W: [org.apache.ignite:ignite-core] [2021-11-19 21:02:06,408][WARN ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][GridMarshallerMappingConsistencyTest2] Peer class loading is enabled (disable it in production for performance and deployment consistency reasons) [21:02:06] : [Step 4/5] [2021-11-19 21:02:06,409][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][GridMarshallerMappingConsistencyTest2] 3-rd party licenses can be found at: /opt/buildagent/work/7bc1c54bc719b67c/libs/licenses [21:02:06] : [Step 4/5] [2021-11-19 21:02:06,414][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][IgnitePluginProcessor] Configured plugins: [21:02:06] : [Step 4/5] [2021-11-19 21:02:06,415][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][IgnitePluginProcessor] ^-- StanByClusterTestProvider 1.0 [21:02:06] : [Step 4/5] [2021-11-19 21:02:06,415][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][IgnitePluginProcessor] ^-- null [21:02:06] : [Step 4/5] [2021-11-19 21:02:06,415][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][IgnitePluginProcessor] [21:02:06] : [Step 4/5] [2021-11-19 21:02:06,416][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][IgnitePluginProcessor] ^-- PageMemory tracker plugin 1.0 [21:02:06] : [Step 4/5] [2021-11-19 21:02:06,416][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][IgnitePluginProcessor] ^-- null [21:02:06] : [Step 4/5] [2021-11-19 21:02:06,416][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][IgnitePluginProcessor] [21:02:06] : [Step 4/5] [2021-11-19 21:02:06,417][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][IgnitePluginProcessor] ^-- TestDistibutedConfigurationPlugin 1.0 [21:02:06] : [Step 4/5] [2021-11-19 21:02:06,417][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][IgnitePluginProcessor] ^-- null [21:02:06] : [Step 4/5] [2021-11-19 21:02:06,417][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][IgnitePluginProcessor] [21:02:06] : [Step 4/5] [2021-11-19 21:02:06,418][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][IgnitePluginProcessor] ^-- NodeValidationPluginProvider 1.0 [21:02:06] : [Step 4/5] [2021-11-19 21:02:06,418][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][IgnitePluginProcessor] ^-- null [21:02:06] : [Step 4/5] [2021-11-19 21:02:06,418][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][IgnitePluginProcessor] [21:02:06] : [Step 4/5] [2021-11-19 21:02:06,419][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][FailureProcessor] Configured failure handler: [hnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]]] [21:02:06] : [Step 4/5] [2021-11-19 21:02:06,503][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][TcpCommunicationSpi] Successfully bound communication NIO server to TCP port [port=45031, locHost=/127.0.0.1, selectorsCnt=12, selectorSpins=0, pairedConn=false] [21:02:06]W: [org.apache.ignite:ignite-core] [2021-11-19 21:02:06,504][WARN ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][TcpCommunicationSpi] Message queue limit is set to 0 which may lead to potential OOMEs when running cache operations in FULL_ASYNC or PRIMARY_SYNC modes due to message queues growth on sender and receiver sides. [21:02:06] : [Step 4/5] [2021-11-19 21:02:06,517][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][GridCollisionManager] Collision resolution is disabled (all jobs will be activated upon arrival). [21:02:06] : [Step 4/5] [2021-11-19 21:02:06,517][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][GridMarshallerMappingConsistencyTest2] Security status [authentication=off, sandbox=off, tls/ssl=off] [21:02:06] : [Step 4/5] [2021-11-19 21:02:06,519][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][MaintenanceProcessor] Resolved store directory for node persistent data: /opt/buildagent/work/7bc1c54bc719b67c/work/test/marshaller.GridMarshallerMappingConsistencyTest2/db/marshaller_GridMarshallerMappingConsistencyTest2 [21:02:06] : [Step 4/5] [2021-11-19 21:02:06,521][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][CacheObjectBinaryProcessorImpl] Resolved directory for serialized binary metadata: /opt/buildagent/work/7bc1c54bc719b67c/work/test/marshaller.GridMarshallerMappingConsistencyTest2/db/binary_meta/marshaller_GridMarshallerMappingConsistencyTest2 [21:02:06] : [Step 4/5] [2021-11-19 21:02:06,530][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/test/marshaller.GridMarshallerMappingConsistencyTest2/db/marshaller_GridMarshallerMappingConsistencyTest2 [21:02:06] : [Step 4/5] [2021-11-19 21:02:06,531][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][FileWriteAheadLogManager] Resolved write ahead log work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/test/marshaller.GridMarshallerMappingConsistencyTest2/db/wal/marshaller_GridMarshallerMappingConsistencyTest2 [21:02:06] : [Step 4/5] [2021-11-19 21:02:06,532][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][FileWriteAheadLogManager] Resolved write ahead log archive directory: /opt/buildagent/work/7bc1c54bc719b67c/work/test/marshaller.GridMarshallerMappingConsistencyTest2/db/wal/archive/marshaller_GridMarshallerMappingConsistencyTest2 [21:02:07] : [Step 4/5] [2021-11-19 21:02:07,156][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/test/marshaller.GridMarshallerMappingConsistencyTest2/db/wal/marshaller_GridMarshallerMappingConsistencyTest2/0000000000000000.wal [21:02:07] : [Step 4/5] [2021-11-19 21:02:07,156][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][FileHandleManagerImpl] Initialized write-ahead log manager [mode=LOG_ONLY] [21:02:07] : [Step 4/5] [2021-11-19 21:02:07,162][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][GridCacheDatabaseSharedManager] Configured data regions initialized successfully [total=5] [21:02:07] : [Step 4/5] [2021-11-19 21:02:07,164][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][IgniteSnapshotManager] Resolved snapshot work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/test/marshaller.GridMarshallerMappingConsistencyTest2/snapshots [21:02:07] : [Step 4/5] [2021-11-19 21:02:07,165][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][IgniteSnapshotManager] Resolved temp directory for snapshot creation: /opt/buildagent/work/7bc1c54bc719b67c/work/test/marshaller.GridMarshallerMappingConsistencyTest2/db/marshaller_GridMarshallerMappingConsistencyTest2/snp [21:02:07] : [Step 4/5] [2021-11-19 21:02:07,169][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][ClientListenerProcessor] Client connector processor has started on TCP port 10801 [21:02:07] : [Step 4/5] [2021-11-19 21:02:07,172][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][GridMarshallerMappingConsistencyTest2] Non-loopback local IPs: 172.17.0.4 [21:02:07] : [Step 4/5] [2021-11-19 21:02:07,172][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][GridMarshallerMappingConsistencyTest2] Enabled local MACs: 0242AC110004 [21:02:07] : [Step 4/5] [2021-11-19 21:02:07,173][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:02:07] : [Step 4/5] [2021-11-19 21:02:07,174][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:02:07] : [Step 4/5] [2021-11-19 21:02:07,174][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:02:07] : [Step 4/5] [2021-11-19 21:02:07,177][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][GridCacheDatabaseSharedManager] Applying lost metastore updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:02:07] : [Step 4/5] [2021-11-19 21:02:07,178][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=0 ms] [21:02:07] : [Step 4/5] [2021-11-19 21:02:07,178][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][GridCacheProcessor] Restoring partition state for local groups. [21:02:07] : [Step 4/5] [2021-11-19 21:02:07,178][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=0, partitionsProcessed=0, time=0ms] [21:02:07] : [Step 4/5] [2021-11-19 21:02:07,179][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][GridEncryptionManager] Encryption keys loaded from metastore. [grps=, masterKeyName=null] [21:02:07] : [Step 4/5] [2021-11-19 21:02:07,181][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][ClusterProcessor] Cluster ID and tag has been read from metastorage: null [21:02:07] : [Step 4/5] [2021-11-19 21:02:07,181][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][IgniteClusterImpl] Shutdown policy was updated [oldVal=null, newVal=null] [21:02:07] : [Step 4/5] [2021-11-19 21:02:07,182][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][GridCacheDatabaseSharedManager] Checkpoint frequency deviation changed [oldVal=null, newVal=null] [21:02:07] : [Step 4/5] [2021-11-19 21:02:07,191][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][FilePageStoreManager] Cleanup cache stores [total=1, left=0, cleanFiles=false] [21:02:07] : [Step 4/5] [2021-11-19 21:02:07,195][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:02:07] : [Step 4/5] [2021-11-19 21:02:07,196][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:02:07] : [Step 4/5] [2021-11-19 21:02:07,197][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:02:07] : [Step 4/5] [2021-11-19 21:02:07,198][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][GridCacheDatabaseSharedManager] Data Regions Started: 5 [21:02:07] : [Step 4/5] [2021-11-19 21:02:07,198][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][GridCacheDatabaseSharedManager] ^-- sysMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:02:07] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:02:07] : [Step 4/5] ^-- default region [type=default, persistence=true, lazyAlloc=true, [21:02:07] : [Step 4/5] ... initCfg=256MB, maxCfg=256MB, usedRam=0MB, freeRam=100%, allocRam=0MB, allocTotal=0MB] [21:02:07] : [Step 4/5] ^-- metastoreMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:02:07] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:02:07] : [Step 4/5] ^-- TxLog region [type=internal, persistence=true, lazyAlloc=false, [21:02:07] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:02:07] : [Step 4/5] ^-- volatileDsMemPlc region [type=user, persistence=false, lazyAlloc=true, [21:02:07] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB] [21:02:07] : [Step 4/5] ^-- Ignite persistence [used=0MB] [21:02:07] : [Step 4/5] [21:02:07] : [Step 4/5] [2021-11-19 21:02:07,200][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][GridCacheDatabaseSharedManager] Starting binary memory restore for: [-2100569601] [21:02:07] : [Step 4/5] [2021-11-19 21:02:07,211][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:02:07] : [Step 4/5] [2021-11-19 21:02:07,212][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:02:07] : [Step 4/5] [2021-11-19 21:02:07,217][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/test/marshaller.GridMarshallerMappingConsistencyTest2/db/wal/marshaller_GridMarshallerMappingConsistencyTest2/0000000000000000.wal, offset=0, ver=2] [21:02:07] : [Step 4/5] [2021-11-19 21:02:07,220][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][GridCacheProcessor] Started cache in recovery mode [name=ignite-sys-cache, id=-2100569601, dataRegionName=sysMemPlc, mode=REPLICATED, atomicity=TRANSACTIONAL, backups=2147483647, mvcc=false] [21:02:07] : [Step 4/5] [2021-11-19 21:02:07,222][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][GridCacheDatabaseSharedManager] Binary recovery performed in 22 ms. [21:02:07] : [Step 4/5] [2021-11-19 21:02:07,222][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:02:07] : [Step 4/5] [2021-11-19 21:02:07,222][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][GridCacheDatabaseSharedManager] Applying lost cache updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:02:07] : [Step 4/5] [2021-11-19 21:02:07,288][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=61 ms] [21:02:07] : [Step 4/5] [2021-11-19 21:02:07,288][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][GridCacheProcessor] Restoring partition state for local groups. [21:02:07] : [Step 4/5] [2021-11-19 21:02:07,306][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=1, partitionsProcessed=100, time=20ms] [21:02:07] : [Step 4/5] [2021-11-19 21:02:07,713][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][TestTcpDiscoverySpi] Successfully bound to TCP port [port=47501, localHost=localhost/127.0.0.1, locNodeId=44fc68b2-4a69-4d45-96a9-74a049a00002] [21:02:07] : [Step 4/5] [2021-11-19 21:02:07,717][INFO ][tcp-disco-srvr-[:47500]-#101%marshaller.GridMarshallerMappingConsistencyTest1%-#1918%marshaller.GridMarshallerMappingConsistencyTest1%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=58069] [21:02:07] : [Step 4/5] [2021-11-19 21:02:07,717][INFO ][tcp-disco-srvr-[:47500]-#101%marshaller.GridMarshallerMappingConsistencyTest1%-#1918%marshaller.GridMarshallerMappingConsistencyTest1%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=58069] [21:02:07] : [Step 4/5] [2021-11-19 21:02:07,718][INFO ][tcp-disco-sock-reader-[]-#107%marshaller.GridMarshallerMappingConsistencyTest1%-#2038%marshaller.GridMarshallerMappingConsistencyTest1%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:58069, rmtPort=58069] [21:02:07] : [Step 4/5] [2021-11-19 21:02:07,721][INFO ][tcp-disco-sock-reader-[44fc68b2 127.0.0.1:58069]-#107%marshaller.GridMarshallerMappingConsistencyTest1%-#2038%marshaller.GridMarshallerMappingConsistencyTest1%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=44fc68b2-4a69-4d45-96a9-74a049a00002, rmtAddr=/127.0.0.1:58069] [21:02:07] : [Step 4/5] [2021-11-19 21:02:07,732][INFO ][tcp-disco-srvr-[:47501]-#106%marshaller.GridMarshallerMappingConsistencyTest2%-#2037%marshaller.GridMarshallerMappingConsistencyTest2%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=41921] [21:02:07] : [Step 4/5] [2021-11-19 21:02:07,733][INFO ][tcp-disco-srvr-[:47501]-#106%marshaller.GridMarshallerMappingConsistencyTest2%-#2037%marshaller.GridMarshallerMappingConsistencyTest2%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=41921] [21:02:07] : [Step 4/5] [2021-11-19 21:02:07,734][INFO ][tcp-disco-sock-reader-[]-#108%marshaller.GridMarshallerMappingConsistencyTest2%-#2039%marshaller.GridMarshallerMappingConsistencyTest2%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:41921, rmtPort=41921] [21:02:07] : [Step 4/5] [2021-11-19 21:02:07,734][INFO ][tcp-disco-sock-reader-[]-#108%marshaller.GridMarshallerMappingConsistencyTest2%-#2039%marshaller.GridMarshallerMappingConsistencyTest2%][TestTcpDiscoverySpi] Received ping request from the remote node [rmtNodeId=7fe8a8f0-201c-4a97-8573-abfb8c600001, rmtAddr=/127.0.0.1:41921, rmtPort=41921] [21:02:07] : [Step 4/5] [2021-11-19 21:02:07,736][INFO ][tcp-disco-sock-reader-[]-#108%marshaller.GridMarshallerMappingConsistencyTest2%-#2039%marshaller.GridMarshallerMappingConsistencyTest2%][TestTcpDiscoverySpi] Finished writing ping response [rmtNodeId=7fe8a8f0-201c-4a97-8573-abfb8c600001, rmtAddr=/127.0.0.1:41921, rmtPort=41921] [21:02:07] : [Step 4/5] [2021-11-19 21:02:07,737][INFO ][tcp-disco-sock-reader-[44fc68b2 127.0.0.1:58069]-#107%marshaller.GridMarshallerMappingConsistencyTest1%-#2038%marshaller.GridMarshallerMappingConsistencyTest1%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:58069, rmtPort=58069, rmtNodeId=44fc68b2-4a69-4d45-96a9-74a049a00002] [21:02:07]W: [org.apache.ignite:ignite-core] [2021-11-19 21:02:07,737][WARN ][tcp-disco-sock-reader-[]-#108%marshaller.GridMarshallerMappingConsistencyTest2%-#2039%marshaller.GridMarshallerMappingConsistencyTest2%][TestTcpDiscoverySpi] Failed to shutdown socket [21:02:07]W: [org.apache.ignite:ignite-core] java.net.SocketException: Socket output is already shutdown [21:02:07]W: [org.apache.ignite:ignite-core] at java.net.Socket.shutdownOutput(Socket.java:1572) [21:02:07]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.close(IgniteUtils.java:4247) [21:02:07]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.discovery.tcp.ServerImpl$SocketReader.body(ServerImpl.java:7370) [21:02:07]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.IgniteSpiThread.run(IgniteSpiThread.java:58) [21:02:07] : [Step 4/5] [2021-11-19 21:02:07,741][INFO ][tcp-disco-sock-reader-[]-#108%marshaller.GridMarshallerMappingConsistencyTest2%-#2039%marshaller.GridMarshallerMappingConsistencyTest2%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:41921, rmtPort=41921, rmtNodeId=null] [21:02:07] : [Step 4/5] [2021-11-19 21:02:07,741][INFO ][tcp-disco-msg-worker-[crd]-#100%marshaller.GridMarshallerMappingConsistencyTest1%-#1917%marshaller.GridMarshallerMappingConsistencyTest1%][GridEncryptionManager] Joining node doesn't have stored group keys [node=44fc68b2-4a69-4d45-96a9-74a049a00002] [21:02:07] : [Step 4/5] [2021-11-19 21:02:07,757][INFO ][tcp-disco-msg-worker-[crd]-#100%marshaller.GridMarshallerMappingConsistencyTest1%-#1917%marshaller.GridMarshallerMappingConsistencyTest1%][TestTcpDiscoverySpi] New next node [newNext=TcpDiscoveryNode [id=44fc68b2-4a69-4d45-96a9-74a049a00002, consistentId=marshaller.GridMarshallerMappingConsistencyTest2, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=0, intOrder=2, lastExchangeTime=1637344927724, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false]] [21:02:07] : [Step 4/5] [2021-11-19 21:02:07,759][INFO ][tcp-disco-srvr-[:47501]-#106%marshaller.GridMarshallerMappingConsistencyTest2%-#2037%marshaller.GridMarshallerMappingConsistencyTest2%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=44795] [21:02:07] : [Step 4/5] [2021-11-19 21:02:07,759][INFO ][tcp-disco-srvr-[:47501]-#106%marshaller.GridMarshallerMappingConsistencyTest2%-#2037%marshaller.GridMarshallerMappingConsistencyTest2%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=44795] [21:02:07] : [Step 4/5] [2021-11-19 21:02:07,760][INFO ][tcp-disco-sock-reader-[]-#109%marshaller.GridMarshallerMappingConsistencyTest2%-#2040%marshaller.GridMarshallerMappingConsistencyTest2%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:44795, rmtPort=44795] [21:02:07] : [Step 4/5] [2021-11-19 21:02:07,762][INFO ][tcp-disco-sock-reader-[7fe8a8f0 127.0.0.1:44795]-#109%marshaller.GridMarshallerMappingConsistencyTest2%-#2040%marshaller.GridMarshallerMappingConsistencyTest2%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=7fe8a8f0-201c-4a97-8573-abfb8c600001, rmtAddr=/127.0.0.1:44795] [21:02:07] : [Step 4/5] [2021-11-19 21:02:07,767][INFO ][tcp-disco-msg-worker-[]-#105%marshaller.GridMarshallerMappingConsistencyTest2%-#2036%marshaller.GridMarshallerMappingConsistencyTest2%][TestTcpDiscoverySpi] New next node [newNext=TcpDiscoveryNode [id=7fe8a8f0-201c-4a97-8573-abfb8c600001, consistentId=marshaller.GridMarshallerMappingConsistencyTest1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637344927764, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false]] [21:02:07] : [Step 4/5] [2021-11-19 21:02:07,768][INFO ][tcp-disco-srvr-[:47500]-#101%marshaller.GridMarshallerMappingConsistencyTest1%-#1918%marshaller.GridMarshallerMappingConsistencyTest1%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=55487] [21:02:07] : [Step 4/5] [2021-11-19 21:02:07,769][INFO ][tcp-disco-srvr-[:47500]-#101%marshaller.GridMarshallerMappingConsistencyTest1%-#1918%marshaller.GridMarshallerMappingConsistencyTest1%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=55487] [21:02:07] : [Step 4/5] [2021-11-19 21:02:07,769][INFO ][tcp-disco-sock-reader-[]-#110%marshaller.GridMarshallerMappingConsistencyTest1%-#2041%marshaller.GridMarshallerMappingConsistencyTest1%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:55487, rmtPort=55487] [21:02:07] : [Step 4/5] [2021-11-19 21:02:07,771][INFO ][tcp-disco-sock-reader-[44fc68b2 127.0.0.1:55487]-#110%marshaller.GridMarshallerMappingConsistencyTest1%-#2041%marshaller.GridMarshallerMappingConsistencyTest1%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=44fc68b2-4a69-4d45-96a9-74a049a00002, rmtAddr=/127.0.0.1:55487] [21:02:07] : [Step 4/5] [2021-11-19 21:02:07,775][INFO ][disco-event-worker-#1920%marshaller.GridMarshallerMappingConsistencyTest1%][GridDiscoveryManager] Added new node to topology: TcpDiscoveryNode [id=44fc68b2-4a69-4d45-96a9-74a049a00002, consistentId=marshaller.GridMarshallerMappingConsistencyTest2, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637344927724, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false] [21:02:07] : [Step 4/5] [2021-11-19 21:02:07,776][INFO ][disco-event-worker-#1920%marshaller.GridMarshallerMappingConsistencyTest1%][GridDiscoveryManager] Topology snapshot [ver=2, locNode=7fe8a8f0, servers=2, clients=0, state=INACTIVE, CPUs=24, offheap=0.25GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=7fe8a8f0-201c-4a97-8573-abfb8c600001, consistentId=marshaller.GridMarshallerMappingConsistencyTest1, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=44fc68b2-4a69-4d45-96a9-74a049a00002, consistentId=marshaller.GridMarshallerMappingConsistencyTest2, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:02:07] : [Step 4/5] [2021-11-19 21:02:07,778][INFO ][tcp-disco-msg-worker-[7fe8a8f0 127.0.0.1:47500]-#105%marshaller.GridMarshallerMappingConsistencyTest2%-#2036%marshaller.GridMarshallerMappingConsistencyTest2%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustEnabled' was changed from 'null' to 'false' [21:02:07] : [Step 4/5] [2021-11-19 21:02:07,778][INFO ][tcp-disco-msg-worker-[7fe8a8f0 127.0.0.1:47500]-#105%marshaller.GridMarshallerMappingConsistencyTest2%-#2036%marshaller.GridMarshallerMappingConsistencyTest2%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustTimeout' was changed from 'null' to '300000' [21:02:07] : [Step 4/5] [2021-11-19 21:02:07,779][INFO ][tcp-disco-msg-worker-[7fe8a8f0 127.0.0.1:47500]-#105%marshaller.GridMarshallerMappingConsistencyTest2%-#2036%marshaller.GridMarshallerMappingConsistencyTest2%][ClusterProcessor] stupefied_chaplygin [21:02:07] : [Step 4/5] [2021-11-19 21:02:07,779][INFO ][tcp-disco-msg-worker-[7fe8a8f0 127.0.0.1:47500]-#105%marshaller.GridMarshallerMappingConsistencyTest2%-#2036%marshaller.GridMarshallerMappingConsistencyTest2%][IgniteTxManager] Transactions parameter 'longOperationsDumpTimeout' was changed from 'null' to '60000' [21:02:07] : [Step 4/5] [2021-11-19 21:02:07,780][INFO ][tcp-disco-msg-worker-[7fe8a8f0 127.0.0.1:47500]-#105%marshaller.GridMarshallerMappingConsistencyTest2%-#2036%marshaller.GridMarshallerMappingConsistencyTest2%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpThreshold' was changed from 'null' to '0' [21:02:07] : [Step 4/5] [2021-11-19 21:02:07,781][INFO ][tcp-disco-msg-worker-[7fe8a8f0 127.0.0.1:47500]-#105%marshaller.GridMarshallerMappingConsistencyTest2%-#2036%marshaller.GridMarshallerMappingConsistencyTest2%][IgniteTxManager] Transactions parameter 'transactionTimeDumpSamplesCoefficient' was changed from 'null' to '0.0' [21:02:07] : [Step 4/5] [2021-11-19 21:02:07,782][INFO ][tcp-disco-msg-worker-[7fe8a8f0 127.0.0.1:47500]-#105%marshaller.GridMarshallerMappingConsistencyTest2%-#2036%marshaller.GridMarshallerMappingConsistencyTest2%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpSamplesPerSecondLimit' was changed from 'null' to '5' [21:02:07] : [Step 4/5] [2021-11-19 21:02:07,783][INFO ][tcp-disco-msg-worker-[7fe8a8f0 127.0.0.1:47500]-#105%marshaller.GridMarshallerMappingConsistencyTest2%-#2036%marshaller.GridMarshallerMappingConsistencyTest2%][IgniteTxManager] Transactions parameter 'collisionsDumpInterval' was changed from 'null' to '1000' [21:02:07] : [Step 4/5] [2021-11-19 21:02:07,784][INFO ][tcp-disco-msg-worker-[7fe8a8f0 127.0.0.1:47500]-#105%marshaller.GridMarshallerMappingConsistencyTest2%-#2036%marshaller.GridMarshallerMappingConsistencyTest2%][IgniteTxManager] Transactions parameter 'txOwnerDumpRequestsAllowed' was changed from 'null' to 'true' [21:02:07] : [Step 4/5] [2021-11-19 21:02:07,784][INFO ][tcp-disco-msg-worker-[7fe8a8f0 127.0.0.1:47500]-#105%marshaller.GridMarshallerMappingConsistencyTest2%-#2036%marshaller.GridMarshallerMappingConsistencyTest2%][GridCacheDatabaseSharedManager] Historical rebalance WAL threshold changed [property=historical.rebalance.threshold, oldVal=null, newVal=500] [21:02:07] : [Step 4/5] [2021-11-19 21:02:07,786][INFO ][disco-notifier-worker-#2035%marshaller.GridMarshallerMappingConsistencyTest2%][MvccProcessorImpl] Assigned mvcc coordinator [crd=MvccCoordinator [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=0], nodeId=7fe8a8f0-201c-4a97-8573-abfb8c600001, ver=1637344926294, local=false, initialized=false]] [21:02:07] : [Step 4/5] [2021-11-19 21:02:07,786][INFO ][sys-#2011%marshaller.GridMarshallerMappingConsistencyTest2%][ClusterProcessor] Writing cluster ID and tag to metastorage on ready for write ClusterIdAndTag [id=34c655b9-4134-491f-9fcb-73e726dd8bbc, tag=stupefied_chaplygin] [21:02:07] : [Step 4/5] [2021-11-19 21:02:07,811][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][GridMarshallerMappingConsistencyTest2] To start Console Management & Monitoring run ignitevisorcmd.{sh|bat} [21:02:07] : [Step 4/5] [2021-11-19 21:02:07,812][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][GridMarshallerMappingConsistencyTest2] [21:02:07] : [Step 4/5] [21:02:07] : [Step 4/5] >>> +-------------------------------------------+ [21:02:07] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:02:07] : [Step 4/5] >>> +-------------------------------------------+ [21:02:07] : [Step 4/5] >>> OS name: Linux 4.15.0-151-generic amd64 [21:02:07] : [Step 4/5] >>> CPU(s): 24 [21:02:07] : [Step 4/5] >>> Heap: 2.0GB [21:02:07] : [Step 4/5] >>> VM name: 16724@c4dfe9a430b2 [21:02:07] : [Step 4/5] >>> Ignite instance name: marshaller.GridMarshallerMappingConsistencyTest2 [21:02:07] : [Step 4/5] >>> Local node [ID=44FC68B2-4A69-4D45-96A9-74A049A00002, order=2, clientMode=false] [21:02:07] : [Step 4/5] >>> Local node addresses: [127.0.0.1] [21:02:07] : [Step 4/5] >>> Local ports: TCP:10801 TCP:45031 TCP:47501 [21:02:07] : [Step 4/5] [21:02:07] : [Step 4/5] [2021-11-19 21:02:07,813][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][GridMarshallerMappingConsistencyTest2] >>> Ignite cluster is in INACTIVE state (limited functionality available). Use control.(sh|bat) script or IgniteCluster.state(ClusterState.ACTIVE) to change the state. [21:02:07] : [Step 4/5] [2021-11-19 21:02:07,814][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][GridDiscoveryManager] Topology snapshot [ver=2, locNode=44fc68b2, servers=2, clients=0, state=INACTIVE, CPUs=24, offheap=0.25GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=7fe8a8f0-201c-4a97-8573-abfb8c600001, consistentId=marshaller.GridMarshallerMappingConsistencyTest1, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=44fc68b2-4a69-4d45-96a9-74a049a00002, consistentId=marshaller.GridMarshallerMappingConsistencyTest2, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:02:07] : [Step 4/5] [2021-11-19 21:02:07,815][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][G] Node started : [stage="Configure system pool" (0 ms),stage="Start managers" (135 ms),stage="Configure binary metadata" (5 ms),stage="Start processors" (645 ms),stage="Start 'StanByClusterTestProvider' plugin" (0 ms),stage="Start 'PageMemory tracker plugin' plugin" (0 ms),stage="Start 'TestDistibutedConfigurationPlugin' plugin" (0 ms),stage="Start 'NodeValidationPluginProvider' plugin" (0 ms),stage="Init metastore" (20 ms),stage="Init and start regions" (8 ms),stage="Restore binary memory" (21 ms),stage="Restore logical state" (84 ms),stage="Finish recovery" (405 ms),stage="Join topology" (74 ms),stage="Await transition" (4 ms),stage="Await exchange" (24 ms),stage="Total time" (1425 ms)] [21:02:07] : [Step 4/5] [2021-11-19 21:02:07,817][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][root] Node started with the following configuration [id=44fc68b2-4a69-4d45-96a9-74a049a00002, marshaller=BinaryMarshaller [], discovery=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=5000, ackTimeout=5000, marsh=JdkMarshaller [clsFilter=org.apache.ignite.marshaller.MarshallerUtils$1@7ebcd68e], reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], binaryCfg=null, lateAff=true] [21:02:07] : [Step 4/5] [2021-11-19 21:02:07,819][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][GridClusterStateProcessor] Sending activate cluster request with BaselineTopology BaselineTopology [id=0, branchingHash=-4276398781, branchingType='New BaselineTopology', baselineNodes=[marshaller.GridMarshallerMappingConsistencyTest1, marshaller.GridMarshallerMappingConsistencyTest2]] [21:02:07] : [Step 4/5] [2021-11-19 21:02:07,824][INFO ][disco-notifier-worker-#1916%marshaller.GridMarshallerMappingConsistencyTest1%][GridClusterStateProcessor] Received activate cluster request with BaselineTopology[id=0] initiator node ID: 7fe8a8f0-201c-4a97-8573-abfb8c600001 [21:02:07] : [Step 4/5] [2021-11-19 21:02:07,825][INFO ][disco-notifier-worker-#1916%marshaller.GridMarshallerMappingConsistencyTest1%][GridClusterStateProcessor] Started state transition: activate cluster [21:02:07] : [Step 4/5] [2021-11-19 21:02:07,826][INFO ][exchange-worker-#1921%marshaller.GridMarshallerMappingConsistencyTest1%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], crd=true, evt=DISCOVERY_CUSTOM_EVT, evtNode=7fe8a8f0-201c-4a97-8573-abfb8c600001, customEvt=ChangeGlobalStateMessage [id=bf5ac593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqId=c4f462cf-8a17-4420-b0ba-c69d1058ff82, initiatingNodeId=7fe8a8f0-201c-4a97-8573-abfb8c600001, state=ACTIVE, baselineTopology=BaselineTopology [id=0, branchingHash=-4276398781, branchingType='New BaselineTopology', baselineNodes=[marshaller.GridMarshallerMappingConsistencyTest1, marshaller.GridMarshallerMappingConsistencyTest2]], forceChangeBaselineTopology=false, timestamp=1637344927819, forceDeactivation=true], allowMerge=false, exchangeFreeSwitch=false] [21:02:07] : [Step 4/5] [2021-11-19 21:02:07,826][INFO ][disco-notifier-worker-#2035%marshaller.GridMarshallerMappingConsistencyTest2%][GridClusterStateProcessor] Received activate cluster request with BaselineTopology[id=0] initiator node ID: 7fe8a8f0-201c-4a97-8573-abfb8c600001 [21:02:07] : [Step 4/5] [2021-11-19 21:02:07,828][INFO ][exchange-worker-#1921%marshaller.GridMarshallerMappingConsistencyTest1%][GridDhtPartitionsExchangeFuture] Start activation process [nodeId=7fe8a8f0-201c-4a97-8573-abfb8c600001, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]]. New state: ACTIVE [21:02:07] : [Step 4/5] [2021-11-19 21:02:07,828][INFO ][disco-notifier-worker-#2035%marshaller.GridMarshallerMappingConsistencyTest2%][GridClusterStateProcessor] Started state transition: activate cluster [21:02:07] : [Step 4/5] [2021-11-19 21:02:07,829][INFO ][exchange-worker-#1921%marshaller.GridMarshallerMappingConsistencyTest1%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/test/marshaller.GridMarshallerMappingConsistencyTest1/db/marshaller_GridMarshallerMappingConsistencyTest1 [21:02:07] : [Step 4/5] [2021-11-19 21:02:07,830][INFO ][exchange-worker-#2044%marshaller.GridMarshallerMappingConsistencyTest2%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], crd=false, evt=DISCOVERY_CUSTOM_EVT, evtNode=7fe8a8f0-201c-4a97-8573-abfb8c600001, customEvt=ChangeGlobalStateMessage [id=bf5ac593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqId=c4f462cf-8a17-4420-b0ba-c69d1058ff82, initiatingNodeId=7fe8a8f0-201c-4a97-8573-abfb8c600001, state=ACTIVE, baselineTopology=BaselineTopology [id=0, branchingHash=-4276398781, branchingType='New BaselineTopology', baselineNodes=[marshaller.GridMarshallerMappingConsistencyTest1, marshaller.GridMarshallerMappingConsistencyTest2]], forceChangeBaselineTopology=false, timestamp=1637344927819, forceDeactivation=true], allowMerge=false, exchangeFreeSwitch=false] [21:02:07] : [Step 4/5] [2021-11-19 21:02:07,833][INFO ][exchange-worker-#2044%marshaller.GridMarshallerMappingConsistencyTest2%][GridDhtPartitionsExchangeFuture] Start activation process [nodeId=44fc68b2-4a69-4d45-96a9-74a049a00002, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]]. New state: ACTIVE [21:02:07] : [Step 4/5] [2021-11-19 21:02:07,832][INFO ][exchange-worker-#1921%marshaller.GridMarshallerMappingConsistencyTest1%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/test/marshaller.GridMarshallerMappingConsistencyTest1/db/wal/marshaller_GridMarshallerMappingConsistencyTest1/0000000000000000.wal, offset=8795, ver=2] [21:02:07] : [Step 4/5] [2021-11-19 21:02:07,834][INFO ][exchange-worker-#2044%marshaller.GridMarshallerMappingConsistencyTest2%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/test/marshaller.GridMarshallerMappingConsistencyTest2/db/marshaller_GridMarshallerMappingConsistencyTest2 [21:02:07] : [Step 4/5] [2021-11-19 21:02:07,836][INFO ][exchange-worker-#1921%marshaller.GridMarshallerMappingConsistencyTest1%][GridClusterStateProcessor] Writing BaselineTopology[id=0] [21:02:07] : [Step 4/5] [2021-11-19 21:02:07,844][INFO ][exchange-worker-#1921%marshaller.GridMarshallerMappingConsistencyTest1%][GridCacheDatabaseSharedManager] Finish recovery performed in 14 ms. [21:02:07] : [Step 4/5] [2021-11-19 21:02:07,844][INFO ][exchange-worker-#2044%marshaller.GridMarshallerMappingConsistencyTest2%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/test/marshaller.GridMarshallerMappingConsistencyTest2/db/wal/marshaller_GridMarshallerMappingConsistencyTest2/0000000000000000.wal, offset=8795, ver=2] [21:02:07] : [Step 4/5] [2021-11-19 21:02:07,845][INFO ][exchange-worker-#1921%marshaller.GridMarshallerMappingConsistencyTest1%][msg] Components activation performed in 16 ms. [21:02:07] : [Step 4/5] [2021-11-19 21:02:07,847][INFO ][exchange-worker-#2044%marshaller.GridMarshallerMappingConsistencyTest2%][GridClusterStateProcessor] Writing BaselineTopology[id=0] [21:02:07] : [Step 4/5] [2021-11-19 21:02:07,850][INFO ][exchange-worker-#1921%marshaller.GridMarshallerMappingConsistencyTest1%][GridCacheProcessor] Finished recovery for cache [cache=ignite-sys-cache, grp=ignite-sys-cache, startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:02:07] : [Step 4/5] [2021-11-19 21:02:07,852][INFO ][exchange-worker-#1921%marshaller.GridMarshallerMappingConsistencyTest1%][GridDhtPartitionsExchangeFuture] Successfully activated caches [nodeId=7fe8a8f0-201c-4a97-8573-abfb8c600001, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], newState=ACTIVE] [21:02:07] : [Step 4/5] [2021-11-19 21:02:07,853][INFO ][exchange-worker-#2044%marshaller.GridMarshallerMappingConsistencyTest2%][GridCacheDatabaseSharedManager] Finish recovery performed in 17 ms. [21:02:07] : [Step 4/5] [2021-11-19 21:02:07,854][INFO ][exchange-worker-#2044%marshaller.GridMarshallerMappingConsistencyTest2%][msg] Components activation performed in 20 ms. [21:02:07] : [Step 4/5] [2021-11-19 21:02:07,854][INFO ][exchange-worker-#1921%marshaller.GridMarshallerMappingConsistencyTest1%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:02:07] : [Step 4/5] [2021-11-19 21:02:07,855][INFO ][exchange-worker-#2044%marshaller.GridMarshallerMappingConsistencyTest2%][GridCacheProcessor] Finished recovery for cache [cache=ignite-sys-cache, grp=ignite-sys-cache, startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:02:07] : [Step 4/5] [2021-11-19 21:02:07,857][INFO ][exchange-worker-#2044%marshaller.GridMarshallerMappingConsistencyTest2%][GridDhtPartitionsExchangeFuture] Successfully activated caches [nodeId=44fc68b2-4a69-4d45-96a9-74a049a00002, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], newState=ACTIVE] [21:02:07] : [Step 4/5] [2021-11-19 21:02:07,858][INFO ][exchange-worker-#2044%marshaller.GridMarshallerMappingConsistencyTest2%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:02:07] : [Step 4/5] [2021-11-19 21:02:07,873][INFO ][exchange-worker-#1921%marshaller.GridMarshallerMappingConsistencyTest1%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], crd=true] [21:02:07] : [Step 4/5] [2021-11-19 21:02:07,876][INFO ][db-checkpoint-thread-#2055%marshaller.GridMarshallerMappingConsistencyTest1%][Checkpointer] Checkpoint started [checkpointId=6bf3e142-0fe6-4298-b764-dfb224a918a3, startPtr=WALPointer [idx=0, fileOff=86541, len=1963], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=5ms, checkpointLockHoldTime=6ms, walCpRecordFsyncDuration=1ms, writeCheckpointEntryDuration=2ms, splitAndSortCpPagesDuration=0ms, pages=18, reason='node started'] [21:02:07] : [Step 4/5] [2021-11-19 21:02:07,903][INFO ][grid-nio-worker-tcp-comm-0-#1859%TcpCommunicationSpi%][TcpCommunicationSpi] Accepted incoming communication connection [locAddr=/127.0.0.1:45030, rmtAddr=/127.0.0.1:42038] [21:02:07] : [Step 4/5] [2021-11-19 21:02:07,905][INFO ][grid-nio-worker-tcp-comm-0-#1978%TcpCommunicationSpi%][TcpCommunicationSpi] Established outgoing communication connection [locAddr=/127.0.0.1:42038, rmtAddr=/127.0.0.1:45030] [21:02:07] : [Step 4/5] [2021-11-19 21:02:07,906][INFO ][exchange-worker-#2044%marshaller.GridMarshallerMappingConsistencyTest2%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], crd=false] [21:02:07] : [Step 4/5] [2021-11-19 21:02:07,909][INFO ][sys-#1903%marshaller.GridMarshallerMappingConsistencyTest1%][GridDhtPartitionsExchangeFuture] Coordinator received single message [ver=AffinityTopologyVersion [topVer=2, minorTopVer=1], node=44fc68b2-4a69-4d45-96a9-74a049a00002, allReceived=true] [21:02:07] : [Step 4/5] [2021-11-19 21:02:07,909][INFO ][db-checkpoint-thread-#2060%marshaller.GridMarshallerMappingConsistencyTest2%][Checkpointer] Checkpoint started [checkpointId=1ea4bd57-d2e9-44a3-b96d-c851b80b9058, startPtr=WALPointer [idx=0, fileOff=86541, len=1963], checkpointBeforeLockTime=24ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=1ms, writeCheckpointEntryDuration=11ms, splitAndSortCpPagesDuration=0ms, pages=18, reason='node started'] [21:02:07] : [Step 4/5] [2021-11-19 21:02:07,909][INFO ][sys-#1903%marshaller.GridMarshallerMappingConsistencyTest1%][GridDhtPartitionsExchangeFuture] finishExchangeOnCoordinator [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:02:07] : [Step 4/5] [2021-11-19 21:02:07,922][INFO ][sys-#1903%marshaller.GridMarshallerMappingConsistencyTest1%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], err=null, rebalanced=true, wasRebalanced=false] [21:02:07] : [Step 4/5] [2021-11-19 21:02:07,923][INFO ][disco-notifier-worker-#1916%marshaller.GridMarshallerMappingConsistencyTest1%][GridClusterStateProcessor] Received state change finish message: ACTIVE [21:02:07] : [Step 4/5] [2021-11-19 21:02:07,924][INFO ][sys-#2018%marshaller.GridMarshallerMappingConsistencyTest2%][GridDhtPartitionsExchangeFuture] Received full message, will finish exchange [node=7fe8a8f0-201c-4a97-8573-abfb8c600001, resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:02:07] : [Step 4/5] [2021-11-19 21:02:07,923][INFO ][disco-notifier-worker-#2035%marshaller.GridMarshallerMappingConsistencyTest2%][GridClusterStateProcessor] Received state change finish message: ACTIVE [21:02:07] : [Step 4/5] [2021-11-19 21:02:07,928][INFO ][disco-notifier-worker-#1916%marshaller.GridMarshallerMappingConsistencyTest1%][GridClusterStateProcessor] Cluster state was changed from INACTIVE to ACTIVE [21:02:07] : [Step 4/5] [2021-11-19 21:02:07,929][INFO ][disco-notifier-worker-#2035%marshaller.GridMarshallerMappingConsistencyTest2%][GridClusterStateProcessor] Cluster state was changed from INACTIVE to ACTIVE [21:02:07] : [Step 4/5] [2021-11-19 21:02:07,933][INFO ][sys-#2018%marshaller.GridMarshallerMappingConsistencyTest2%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], err=null, rebalanced=true, wasRebalanced=false] [21:02:07] : [Step 4/5] [2021-11-19 21:02:07,932][INFO ][sys-#2028%marshaller.GridMarshallerMappingConsistencyTest2%][GridCachePartitionExchangeManager] Delay process full message without exchange id (there is exchange in progress) [nodeId=7fe8a8f0-201c-4a97-8573-abfb8c600001] [21:02:07] : [Step 4/5] [2021-11-19 21:02:07,931][INFO ][db-checkpoint-thread-#2055%marshaller.GridMarshallerMappingConsistencyTest1%][Checkpointer] Checkpoint finished [cpId=6bf3e142-0fe6-4298-b764-dfb224a918a3, pages=18, markPos=WALPointer [idx=0, fileOff=86541, len=1963], walSegmentsCovered=[], markDuration=10ms, pagesWrite=32ms, fsync=22ms, total=65ms] [21:02:07] : [Step 4/5] [2021-11-19 21:02:07,941][INFO ][sys-#2018%marshaller.GridMarshallerMappingConsistencyTest2%][GridCacheProcessor] Finish proxy initialization, cacheName=ignite-sys-cache, localNodeId=44fc68b2-4a69-4d45-96a9-74a049a00002 [21:02:07] : [Step 4/5] [2021-11-19 21:02:07,940][INFO ][db-checkpoint-thread-#2060%marshaller.GridMarshallerMappingConsistencyTest2%][Checkpointer] Checkpoint finished [cpId=1ea4bd57-d2e9-44a3-b96d-c851b80b9058, pages=18, markPos=WALPointer [idx=0, fileOff=86541, len=1963], walSegmentsCovered=[], markDuration=14ms, pagesWrite=6ms, fsync=24ms, total=68ms] [21:02:07] : [Step 4/5] [2021-11-19 21:02:07,939][INFO ][sys-#1903%marshaller.GridMarshallerMappingConsistencyTest1%][GridCacheProcessor] Finish proxy initialization, cacheName=ignite-sys-cache, localNodeId=7fe8a8f0-201c-4a97-8573-abfb8c600001 [21:02:07] : [Step 4/5] [2021-11-19 21:02:07,944][INFO ][exchange-worker-#2044%marshaller.GridMarshallerMappingConsistencyTest2%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=2, minorTopVer=1], force=false, evt=DISCOVERY_CUSTOM_EVT, node=7fe8a8f0-201c-4a97-8573-abfb8c600001] [21:02:07] : [Step 4/5] [2021-11-19 21:02:07,944][INFO ][sys-#2018%marshaller.GridMarshallerMappingConsistencyTest2%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=44fc68b2-4a69-4d45-96a9-74a049a00002, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=7fe8a8f0-201c-4a97-8573-abfb8c600001, consistentId=marshaller.GridMarshallerMappingConsistencyTest1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637344927764, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:02:07] : [Step 4/5] [2021-11-19 21:02:07,943][INFO ][sys-#2032%marshaller.GridMarshallerMappingConsistencyTest2%][DistributedBaselineConfiguration] Baseline auto-adjust is 'disabled' with timeout='300000' ms [21:02:07] : [Step 4/5] [2021-11-19 21:02:07,946][INFO ][sys-#2018%marshaller.GridMarshallerMappingConsistencyTest2%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (3 ms), stage="Update caches registry" (21 ms), stage="Start caches" (1 ms), stage="Affinity initialization on cache group start" (0 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Restore partition states" (0 ms), stage="After states restored callback" (38 ms), stage="WAL history reservation" (0 ms), stage="Waiting for Full message" (27 ms), stage="Affinity recalculation" (4 ms), stage="Full map updating" (3 ms), stage="Detect lost partitions" (7 ms), stage="Exchange done" (6 ms), stage="Total time" (110 ms)] [21:02:07] : [Step 4/5] [2021-11-19 21:02:07,948][INFO ][sys-#2018%marshaller.GridMarshallerMappingConsistencyTest2%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], stage="Affinity initialization on cache group start [grp=ignite-sys-cache]" (0 ms) (parent=Affinity initialization on cache group start), stage="Affinity centralized initialization (crd) [grp=ignite-sys-cache, crd=false]" (0 ms) (parent=Determine exchange type), stage="Restore partition states [grp=ignite-sys-cache]" (0 ms) (parent=Restore partition states), stage="Affinity applying from full message [grp=ignite-sys-cache]" (4 ms) (parent=Affinity recalculation)] [21:02:07] : [Step 4/5] [2021-11-19 21:02:07,946][INFO ][sys-#1903%marshaller.GridMarshallerMappingConsistencyTest1%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=7fe8a8f0-201c-4a97-8573-abfb8c600001, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=7fe8a8f0-201c-4a97-8573-abfb8c600001, consistentId=marshaller.GridMarshallerMappingConsistencyTest1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637344927920, loc=true, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:02:07] : [Step 4/5] [2021-11-19 21:02:07,946][INFO ][exchange-worker-#1921%marshaller.GridMarshallerMappingConsistencyTest1%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=2, minorTopVer=1], force=false, evt=DISCOVERY_CUSTOM_EVT, node=7fe8a8f0-201c-4a97-8573-abfb8c600001] [21:02:07] : [Step 4/5] [2021-11-19 21:02:07,946][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][root] >>> Stopping grid [name=marshaller.GridMarshallerMappingConsistencyTest2, id=44fc68b2-4a69-4d45-96a9-74a049a00002] [21:02:07] : [Step 4/5] [2021-11-19 21:02:07,946][INFO ][sys-#1901%marshaller.GridMarshallerMappingConsistencyTest1%][DistributedBaselineConfiguration] Baseline auto-adjust is 'disabled' with timeout='300000' ms [21:02:07] : [Step 4/5] [2021-11-19 21:02:07,951][INFO ][sys-#1903%marshaller.GridMarshallerMappingConsistencyTest1%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (1 ms), stage="Update caches registry" (21 ms), stage="Start caches" (0 ms), stage="Affinity initialization on cache group start" (1 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (1 ms), stage="Restore partition states" (0 ms), stage="After states restored callback" (17 ms), stage="WAL history reservation" (0 ms), stage="Waiting for all single messages" (36 ms), stage="Affinity recalculation (crd)" (1 ms), stage="Collect update counters and create affinity messages" (0 ms), stage="Assign partitions states" (2 ms), stage="Validate partitions states" (2 ms), stage="Ideal affinity diff calculation (enforced)" (0 ms), stage="Apply update counters" (0 ms), stage="Full message preparing" (4 ms), stage="Full message sending" (0 ms), stage="State finish message sending" (0 ms), stage="Detect lost partitions" (6 ms), stage="Exchange done" (21 ms), stage="Total time" (113 ms), Discovery lag=3 ms, Latest started node id=44fc68b2-4a69-4d45-96a9-74a049a00002] [21:02:07] : [Step 4/5] [2021-11-19 21:02:07,947][INFO ][sys-#2032%marshaller.GridMarshallerMappingConsistencyTest2%][GridClusterStateProcessor] Successfully performed final activation steps [nodeId=44fc68b2-4a69-4d45-96a9-74a049a00002, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:02:07] : [Step 4/5] [2021-11-19 21:02:07,955][INFO ][sys-#1903%marshaller.GridMarshallerMappingConsistencyTest1%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], stage="Affinity initialization on cache group start [grp=ignite-sys-cache]" (1 ms) (parent=Affinity initialization on cache group start), stage="Affinity centralized initialization (crd) [grp=ignite-sys-cache, crd=true]" (0 ms) (parent=Determine exchange type), stage="Restore partition states [grp=ignite-sys-cache]" (0 ms) (parent=Restore partition states), stage="Affinity recalculation (partitions availability) [grp=ignite-sys-cache]" (0 ms) (parent=Ideal affinity diff calculation (enforced))] [21:02:07] : [Step 4/5] [2021-11-19 21:02:07,953][INFO ][sys-#1901%marshaller.GridMarshallerMappingConsistencyTest1%][GridClusterStateProcessor] Successfully performed final activation steps [nodeId=7fe8a8f0-201c-4a97-8573-abfb8c600001, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:02:07] : [Step 4/5] [2021-11-19 21:02:07,958][INFO ][db-checkpoint-thread-#2060%marshaller.GridMarshallerMappingConsistencyTest2%][Checkpointer] Skipping checkpoint (no pages were modified) [checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=1ms, checkpointLockHoldTime=1ms, reason='timeout'] [21:02:07] : [Step 4/5] [2021-11-19 21:02:07,967][INFO ][tcp-disco-sock-reader-[7fe8a8f0 127.0.0.1:44795]-#109%marshaller.GridMarshallerMappingConsistencyTest2%-#2040%marshaller.GridMarshallerMappingConsistencyTest2%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:44795, rmtPort=44795, rmtNodeId=7fe8a8f0-201c-4a97-8573-abfb8c600001] [21:02:07] : [Step 4/5] [2021-11-19 21:02:07,967][INFO ][disco-event-worker-#1920%marshaller.GridMarshallerMappingConsistencyTest1%][GridDiscoveryManager] Node left topology: TcpDiscoveryNode [id=44fc68b2-4a69-4d45-96a9-74a049a00002, consistentId=marshaller.GridMarshallerMappingConsistencyTest2, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637344927724, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false] [21:02:07] : [Step 4/5] [2021-11-19 21:02:07,970][INFO ][disco-event-worker-#1920%marshaller.GridMarshallerMappingConsistencyTest1%][GridDiscoveryManager] Topology snapshot [ver=3, locNode=7fe8a8f0, servers=1, clients=0, state=ACTIVE, CPUs=24, offheap=0.25GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=7fe8a8f0-201c-4a97-8573-abfb8c600001, consistentId=marshaller.GridMarshallerMappingConsistencyTest1, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:02:07] : [Step 4/5] [2021-11-19 21:02:07,971][INFO ][disco-event-worker-#1920%marshaller.GridMarshallerMappingConsistencyTest1%][GridDiscoveryManager] ^-- Baseline [id=0, size=2, online=1, offline=1] [21:02:07]W: [org.apache.ignite:ignite-core] [2021-11-19 21:02:07,972][WARN ][grid-nio-worker-tcp-comm-0-#1859%TcpCommunicationSpi%][TcpCommunicationSpi] Failed to shutdown socket [21:02:07]W: [org.apache.ignite:ignite-core] java.nio.channels.ClosedChannelException [21:02:07]W: [org.apache.ignite:ignite-core] at sun.nio.ch.SocketChannelImpl.shutdownOutput(SocketChannelImpl.java:795) [21:02:07]W: [org.apache.ignite:ignite-core] at sun.nio.ch.SocketAdaptor.shutdownOutput(SocketAdaptor.java:407) [21:02:07]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.close(IgniteUtils.java:4247) [21:02:07]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.closeKey(GridNioServer.java:2784) [21:02:07]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.close(GridNioServer.java:2835) [21:02:07]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.close(GridNioServer.java:2794) [21:02:07]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.bodyInternal(GridNioServer.java:2157) [21:02:07]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.body(GridNioServer.java:1910) [21:02:07]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:125) [21:02:07]W: [org.apache.ignite:ignite-core] at java.lang.Thread.run(Thread.java:748) [21:02:07] : [Step 4/5] [2021-11-19 21:02:07,973][INFO ][exchange-worker-#1921%marshaller.GridMarshallerMappingConsistencyTest1%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], crd=true, evt=NODE_LEFT, evtNode=44fc68b2-4a69-4d45-96a9-74a049a00002, customEvt=null, allowMerge=false, exchangeFreeSwitch=true] [21:02:07] : [Step 4/5] [2021-11-19 21:02:07,973][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][GridCacheProcessor] Stopped cache [cacheName=ignite-sys-cache] [21:02:07] : [Step 4/5] [2021-11-19 21:02:07,976][INFO ][exchange-worker-#1921%marshaller.GridMarshallerMappingConsistencyTest1%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:02:07] : [Step 4/5] [2021-11-19 21:02:07,977][INFO ][exchange-worker-#1921%marshaller.GridMarshallerMappingConsistencyTest1%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], err=null, rebalanced=true, wasRebalanced=true] [21:02:07] : [Step 4/5] [2021-11-19 21:02:07,978][INFO ][exchange-worker-#1921%marshaller.GridMarshallerMappingConsistencyTest1%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=7fe8a8f0-201c-4a97-8573-abfb8c600001, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], evt=NODE_LEFT, evtNode=TcpDiscoveryNode [id=44fc68b2-4a69-4d45-96a9-74a049a00002, consistentId=marshaller.GridMarshallerMappingConsistencyTest2, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637344927724, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0]] [21:02:07] : [Step 4/5] [2021-11-19 21:02:07,979][INFO ][exchange-worker-#1921%marshaller.GridMarshallerMappingConsistencyTest1%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (2 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="After states restored callback" (0 ms), stage="WAL history reservation" (0 ms), stage="Finalize update counters" (0 ms), stage="Detect lost partitions" (1 ms), stage="Exchange done" (1 ms), stage="Total time" (4 ms)] [21:02:07] : [Step 4/5] [2021-11-19 21:02:07,981][INFO ][exchange-worker-#1921%marshaller.GridMarshallerMappingConsistencyTest1%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], stage="Affinity initialization (exchange-free switch on fully-rebalanced topology) [grp=ignite-sys-cache]" (0 ms) (parent=Determine exchange type)] [21:02:07] : [Step 4/5] [2021-11-19 21:02:07,982][INFO ][exchange-worker-#1921%marshaller.GridMarshallerMappingConsistencyTest1%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], crd=true] [21:02:07] : [Step 4/5] [2021-11-19 21:02:07,983][INFO ][exchange-worker-#1921%marshaller.GridMarshallerMappingConsistencyTest1%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=3, minorTopVer=0], force=false, evt=NODE_LEFT, node=44fc68b2-4a69-4d45-96a9-74a049a00002] [21:02:08] : [Step 4/5] [2021-11-19 21:02:08,786][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][FilePageStoreManager] Cleanup cache stores [total=3, left=0, cleanFiles=false] [21:02:08] : [Step 4/5] [2021-11-19 21:02:08,788][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][GridDeploymentLocalStore] Removed undeployed class: GridDeployment [ts=1637344927920, depMode=SHARED, clsLdr=IsolatedClassLoader{roleName='test'}, clsLdrId=906ac593d71-44fc68b2-4a69-4d45-96a9-74a049a00002, userVer=0, loc=true, sampleClsName=org.apache.ignite.internal.processors.cache.distributed.dht.preloader.IgniteDhtPartitionCountersMap2, pendingUndeploy=false, undeployed=true, usage=0] [21:02:08] : [Step 4/5] [2021-11-19 21:02:08,797][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][GridMarshallerMappingConsistencyTest2] [21:02:08] : [Step 4/5] [21:02:08] : [Step 4/5] >>> +------------------------------------------------------+ [21:02:08] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV stopped OK [21:02:08] : [Step 4/5] >>> +------------------------------------------------------+ [21:02:08] : [Step 4/5] >>> Ignite instance name: marshaller.GridMarshallerMappingConsistencyTest2 [21:02:08] : [Step 4/5] >>> Grid uptime: 00:00:00.988 [21:02:08] : [Step 4/5] [21:02:08] : [Step 4/5] [21:02:08] : [Step 4/5] [2021-11-19 21:02:08,825][INFO ][exchange-worker-#1921%marshaller.GridMarshallerMappingConsistencyTest1%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], crd=true, evt=DISCOVERY_CUSTOM_EVT, evtNode=7fe8a8f0-201c-4a97-8573-abfb8c600001, customEvt=DynamicCacheChangeBatch [id=726ac593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqs=ArrayList [DynamicCacheChangeRequest [cacheName=cache, hasCfg=true, nodeId=7fe8a8f0-201c-4a97-8573-abfb8c600001, clientStartOnly=false, stop=false, destroy=false, disabledAfterStart=false]], exchangeActions=ExchangeActions [startCaches=[cache], stopCaches=null, startGrps=[cache], stopGrps=[], resetParts=null, stateChangeRequest=null], startCaches=false], allowMerge=false, exchangeFreeSwitch=false] [21:02:08] : [Step 4/5] [2021-11-19 21:02:08,831][INFO ][exchange-worker-#1921%marshaller.GridMarshallerMappingConsistencyTest1%][PageMemoryImpl] Started page memory [memoryAllocated=256.0 MiB, pages=63504, tableSize=4.9 MiB, replacementSize=7.9 KiB, checkpointBuffer=256.0 MiB] [21:02:08] : [Step 4/5] [2021-11-19 21:02:08,976][INFO ][exchange-worker-#1921%marshaller.GridMarshallerMappingConsistencyTest1%][GridCacheProcessor] Started cache [name=cache, id=94416770, dataRegionName=default, mode=PARTITIONED, atomicity=ATOMIC, backups=0, mvcc=false] [21:02:08] : [Step 4/5] [2021-11-19 21:02:08,985][INFO ][exchange-worker-#1921%marshaller.GridMarshallerMappingConsistencyTest1%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], waitTime=0ms, futInfo=NA, mode=DISTRIBUTED] [21:02:08] : [Step 4/5] [2021-11-19 21:02:08,985][INFO ][exchange-worker-#1921%marshaller.GridMarshallerMappingConsistencyTest1%][GridDhtPartitionsExchangeFuture] Finished waiting for partitions release latch: ServerLatch [permits=0, pendingAcks=HashSet [], super=CompletableLatch [id=CompletableLatchUid [id=exchange, topVer=AffinityTopologyVersion [topVer=3, minorTopVer=1]]]] [21:02:08] : [Step 4/5] [2021-11-19 21:02:08,986][INFO ][exchange-worker-#1921%marshaller.GridMarshallerMappingConsistencyTest1%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:02:09] : [Step 4/5] [2021-11-19 21:02:09,051][INFO ][exchange-worker-#1921%marshaller.GridMarshallerMappingConsistencyTest1%][GridDhtPartitionsExchangeFuture] finishExchangeOnCoordinator [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=1]] [21:02:09] : [Step 4/5] [2021-11-19 21:02:09,063][INFO ][exchange-worker-#1921%marshaller.GridMarshallerMappingConsistencyTest1%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], err=null, rebalanced=true, wasRebalanced=true] [21:02:09] : [Step 4/5] [2021-11-19 21:02:09,065][INFO ][exchange-worker-#1921%marshaller.GridMarshallerMappingConsistencyTest1%][GridCacheProcessor] Finish proxy initialization, cacheName=cache, localNodeId=7fe8a8f0-201c-4a97-8573-abfb8c600001 [21:02:09] : [Step 4/5] [2021-11-19 21:02:09,066][INFO ][exchange-worker-#1921%marshaller.GridMarshallerMappingConsistencyTest1%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=7fe8a8f0-201c-4a97-8573-abfb8c600001, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=7fe8a8f0-201c-4a97-8573-abfb8c600001, consistentId=marshaller.GridMarshallerMappingConsistencyTest1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637344927961, loc=true, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=3, minorTopVer=1]] [21:02:09] : [Step 4/5] [2021-11-19 21:02:09,068][INFO ][exchange-worker-#1921%marshaller.GridMarshallerMappingConsistencyTest1%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (1 ms), stage="Update caches registry" (0 ms), stage="Start caches" (149 ms), stage="Affinity initialization on cache group start" (7 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Wait partitions release latch [latch=exchange]" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Restore partition states" (20 ms), stage="After states restored callback" (43 ms), stage="WAL history reservation" (0 ms), stage="Waiting for all single messages" (0 ms), stage="Affinity recalculation (crd)" (0 ms), stage="Collect update counters and create affinity messages" (0 ms), stage="Assign partitions states" (5 ms), stage="Validate partitions states" (0 ms), stage="Apply update counters" (0 ms), stage="Full message preparing" (4 ms), stage="Full message sending" (0 ms), stage="Exchange done" (4 ms), stage="Total time" (233 ms)] [21:02:09] : [Step 4/5] [2021-11-19 21:02:09,071][INFO ][exchange-worker-#1921%marshaller.GridMarshallerMappingConsistencyTest1%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], stage="Affinity initialization on cache group start [grp=cache]" (6 ms) (parent=Affinity initialization on cache group start), stage="Restore partition states [grp=cache]" (20 ms) (parent=Restore partition states), stage="Restore partition states [grp=ignite-sys-cache]" (0 ms) (parent=Restore partition states)] [21:02:09] : [Step 4/5] [2021-11-19 21:02:09,072][INFO ][exchange-worker-#1921%marshaller.GridMarshallerMappingConsistencyTest1%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], crd=true] [21:02:09] : [Step 4/5] [2021-11-19 21:02:09,074][INFO ][exchange-worker-#1921%marshaller.GridMarshallerMappingConsistencyTest1%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=3, minorTopVer=1], force=false, evt=DISCOVERY_CUSTOM_EVT, node=7fe8a8f0-201c-4a97-8573-abfb8c600001] [21:02:09] : [Step 4/5] [2021-11-19 21:02:09,348][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][root] >>> Stopping grid [name=marshaller.GridMarshallerMappingConsistencyTest1, id=7fe8a8f0-201c-4a97-8573-abfb8c600001] [21:02:09] : [Step 4/5] [2021-11-19 21:02:09,378][INFO ][db-checkpoint-thread-#2055%marshaller.GridMarshallerMappingConsistencyTest1%][Checkpointer] Checkpoint started [checkpointId=1c1894f0-8b9f-4f89-8c8c-f2f1d27e8fee, startPtr=WALPointer [idx=0, fileOff=142335, len=11985], checkpointBeforeLockTime=2ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=2ms, checkpointLockHoldTime=4ms, walCpRecordFsyncDuration=4ms, writeCheckpointEntryDuration=14ms, splitAndSortCpPagesDuration=0ms, pages=15, reason='timeout'] [21:02:09]W: [org.apache.ignite:ignite-core] [2021-11-19 21:02:09,392][WARN ][tcp-disco-sock-reader-[44fc68b2 127.0.0.1:55487]-#110%marshaller.GridMarshallerMappingConsistencyTest1%-#2041%marshaller.GridMarshallerMappingConsistencyTest1%][TestTcpDiscoverySpi] Failed to shutdown socket [21:02:09]W: [org.apache.ignite:ignite-core] java.net.SocketException: Socket is closed [21:02:09]W: [org.apache.ignite:ignite-core] at java.net.Socket.shutdownOutput(Socket.java:1568) [21:02:09]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.close(IgniteUtils.java:4247) [21:02:09]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.discovery.tcp.ServerImpl$SocketReader.body(ServerImpl.java:7370) [21:02:09]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.IgniteSpiThread.run(IgniteSpiThread.java:58) [21:02:09] : [Step 4/5] [2021-11-19 21:02:09,394][INFO ][tcp-disco-sock-reader-[44fc68b2 127.0.0.1:55487]-#110%marshaller.GridMarshallerMappingConsistencyTest1%-#2041%marshaller.GridMarshallerMappingConsistencyTest1%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:55487, rmtPort=55487, rmtNodeId=44fc68b2-4a69-4d45-96a9-74a049a00002] [21:02:09] : [Step 4/5] [2021-11-19 21:02:09,396][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][GridCacheProcessor] Stopped cache [cacheName=ignite-sys-cache] [21:02:09] : [Step 4/5] [2021-11-19 21:02:09,397][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][GridCacheProcessor] Stopped cache [cacheName=cache] [21:02:09] : [Step 4/5] [2021-11-19 21:02:09,870][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][FilePageStoreManager] Cleanup cache stores [total=4, left=0, cleanFiles=false] [21:02:09] : [Step 4/5] [2021-11-19 21:02:09,873][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][GridDeploymentLocalStore] Removed undeployed class: GridDeployment [ts=1637344927899, depMode=SHARED, clsLdr=IsolatedClassLoader{roleName='test'}, clsLdrId=706ac593d71-7fe8a8f0-201c-4a97-8573-abfb8c600001, userVer=0, loc=true, sampleClsName=org.apache.ignite.internal.processors.cache.distributed.dht.preloader.GridDhtPartitionMap, pendingUndeploy=false, undeployed=true, usage=0] [21:02:09] : [Step 4/5] [2021-11-19 21:02:09,882][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][GridMarshallerMappingConsistencyTest1] [21:02:09] : [Step 4/5] [21:02:09] : [Step 4/5] >>> +------------------------------------------------------+ [21:02:09] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV stopped OK [21:02:09] : [Step 4/5] >>> +------------------------------------------------------+ [21:02:09] : [Step 4/5] >>> Ignite instance name: marshaller.GridMarshallerMappingConsistencyTest1 [21:02:09] : [Step 4/5] >>> Grid uptime: 00:00:03.506 [21:02:09] : [Step 4/5] [21:02:09] : [Step 4/5] [21:02:09] : [Step 4/5] [2021-11-19 21:02:09,891][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][GridMarshallerMappingConsistencyTest1] [21:02:09] : [Step 4/5] [21:02:09] : [Step 4/5] >>> __________ ________________ [21:02:09] : [Step 4/5] >>> / _/ ___/ |/ / _/_ __/ __/ [21:02:09] : [Step 4/5] >>> _/ // (7 7 // / / / / _/ [21:02:09] : [Step 4/5] >>> /___/\___/_/|_/___/ /_/ /___/ [21:02:09] : [Step 4/5] >>> [21:02:09] : [Step 4/5] >>> ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:02:09] : [Step 4/5] >>> 2021 Copyright(C) Apache Software Foundation [21:02:09] : [Step 4/5] >>> [21:02:09] : [Step 4/5] >>> Ignite documentation: http://ignite.apache.org [21:02:09] : [Step 4/5] [21:02:09] : [Step 4/5] [2021-11-19 21:02:09,892][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][GridMarshallerMappingConsistencyTest1] Config URL: n/a [21:02:09] : [Step 4/5] [2021-11-19 21:02:09,893][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][GridMarshallerMappingConsistencyTest1] IgniteConfiguration [igniteInstanceName=marshaller.GridMarshallerMappingConsistencyTest1, pubPoolSize=24, svcPoolSize=24, callbackPoolSize=24, stripedPoolSize=24, sysPoolSize=24, mgmtPoolSize=4, dataStreamerPoolSize=24, utilityCachePoolSize=24, utilityCacheKeepAliveTime=60000, p2pPoolSize=2, qryPoolSize=24, buildIdxPoolSize=4, igniteHome=/opt/buildagent/work/7bc1c54bc719b67c, igniteWorkDir=/opt/buildagent/work/7bc1c54bc719b67c/work/test/marshaller.GridMarshallerMappingConsistencyTest1, mbeanSrv=com.sun.jmx.mbeanserver.JmxMBeanServer@6fe85038, nodeId=0bcd3ba0-9d78-447c-910a-834571b00001, marsh=BinaryMarshaller [], marshLocJobs=false, daemon=false, p2pEnabled=true, netTimeout=10000, netCompressionLevel=1, sndRetryDelay=1000, sndRetryCnt=3, metricsHistSize=10000, metricsUpdateFreq=1000, metricsExpTime=9223372036854775807, discoSpi=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=0, ackTimeout=0, marsh=null, reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], segPlc=STOP, segResolveAttempts=2, waitForSegOnStart=true, allResolversPassReq=true, segChkFreq=10000, commSpi=TcpCommunicationSpi [connectGate=org.apache.ignite.spi.communication.tcp.internal.ConnectGateway@501e2b0, ctxInitLatch=java.util.concurrent.CountDownLatch@3c28264e[Count = 1], stopping=false, clientPool=null, nioSrvWrapper=null, stateProvider=null], evtSpi=MemoryEventStorageSpi [expireAgeMs=9223372036854775807, expireCnt=10000, filter=null], colSpi=NoopCollisionSpi [], deploySpi=LocalDeploymentSpi [], indexingSpi=org.apache.ignite.spi.indexing.noop.NoopIndexingSpi@5f51ba6b, addrRslvr=null, encryptionSpi=org.apache.ignite.spi.encryption.noop.NoopEncryptionSpi@55af8bc1, tracingSpi=org.apache.ignite.spi.tracing.NoopTracingSpi@39e4a707, clientMode=false, rebalanceThreadPoolSize=4, rebalanceTimeout=10000, rebalanceBatchesPrefetchCnt=3, rebalanceThrottle=0, rebalanceBatchSize=524288, txCfg=TransactionConfiguration [txSerEnabled=false, dfltIsolation=REPEATABLE_READ, dfltConcurrency=PESSIMISTIC, dfltTxTimeout=0, txTimeoutOnPartitionMapExchange=0, deadlockTimeout=10000, pessimisticTxLogSize=0, pessimisticTxLogLinger=10000, tmLookupClsName=null, txManagerFactory=null, useJtaSync=false], cacheSanityCheckEnabled=true, discoStartupDelay=60000, deployMode=SHARED, p2pMissedCacheSize=100, locHost=127.0.0.1, timeSrvPortBase=31100, timeSrvPortRange=100, failureDetectionTimeout=10000, sysWorkerBlockedTimeout=null, clientFailureDetectionTimeout=10000, metricsLogFreq=0, connectorCfg=null, odbcCfg=null, warmupClos=null, atomicCfg=AtomicConfiguration [seqReserveSize=1000, cacheMode=PARTITIONED, backups=1, aff=null, grpName=null], classLdr=null, sslCtxFactory=null, platformCfg=null, binaryCfg=null, memCfg=null, pstCfg=null, dsCfg=DataStorageConfiguration [sysRegionInitSize=41943040, sysRegionMaxSize=104857600, pageSize=0, concLvl=0, dfltDataRegConf=DataRegionConfiguration [name=default, maxSize=268435456, initSize=268435456, swapPath=null, pageEvictionMode=DISABLED, pageReplacementMode=CLOCK, evictionThreshold=0.9, emptyPagesPoolSize=100, metricsEnabled=false, metricsSubIntervalCount=5, metricsRateTimeInterval=60000, persistenceEnabled=true, checkpointPageBufSize=0, lazyMemoryAllocation=true, warmUpCfg=null], dataRegions=null, storagePath=null, checkpointFreq=180000, lockWaitTime=10000, checkpointThreads=4, checkpointWriteOrder=SEQUENTIAL, walHistSize=20, maxWalArchiveSize=1073741824, walSegments=10, walSegmentSize=67108864, walPath=db/wal, walArchivePath=db/wal/archive, cdcWalPath=db/wal/cdc, cdcEnabled=false, metricsEnabled=false, walMode=LOG_ONLY, walTlbSize=131072, walBuffSize=0, walFlushFreq=2000, walFsyncDelay=1000, walRecordIterBuffSize=67108864, alwaysWriteFullPages=false, fileIOFactory=org.apache.ignite.internal.processors.cache.persistence.file.AsyncFileIOFactory@3b628062, metricsSubIntervalCnt=5, metricsRateTimeInterval=60000, walAutoArchiveAfterInactivity=-1, walForceArchiveTimeout=-1, writeThrottlingEnabled=false, walCompactionEnabled=false, walCompactionLevel=1, checkpointReadLockTimeout=null, walPageCompression=DISABLED, walPageCompressionLevel=null, dfltWarmUpCfg=null, encCfg=org.apache.ignite.configuration.EncryptionConfiguration@422d494, defragmentationThreadPoolSize=4, minWalArchiveSize=-1], snapshotPath=snapshots, activeOnStart=true, activeOnStartPropSetFlag=false, autoActivation=true, autoActivationPropSetFlag=false, clusterStateOnStart=null, sqlConnCfg=null, cliConnCfg=ClientConnectorConfiguration [host=null, port=10800, portRange=100, sockSndBufSize=0, sockRcvBufSize=0, tcpNoDelay=true, maxOpenCursorsPerConn=128, threadPoolSize=24, selectorCnt=12, idleTimeout=0, handshakeTimeout=10000, jdbcEnabled=true, odbcEnabled=true, thinCliEnabled=true, sslEnabled=false, useIgniteSslCtxFactory=true, sslClientAuth=false, sslCtxFactory=null, thinCliCfg=ThinClientConfiguration [maxActiveTxPerConn=100, maxActiveComputeTasksPerConn=0]], mvccVacuumThreadCnt=2, mvccVacuumFreq=5000, authEnabled=false, failureHnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]], commFailureRslvr=null, sqlCfg=SqlConfiguration [longQryWarnTimeout=3000, dfltQryTimeout=0, sqlQryHistSize=1000, validationEnabled=false], asyncContinuationExecutor=null] [21:02:09] : [Step 4/5] [2021-11-19 21:02:09,906][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][GridMarshallerMappingConsistencyTest1] Daemon mode: off [21:02:09] : [Step 4/5] [2021-11-19 21:02:09,907][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][GridMarshallerMappingConsistencyTest1] OS: Linux 4.15.0-151-generic amd64 [21:02:09] : [Step 4/5] [2021-11-19 21:02:09,907][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][GridMarshallerMappingConsistencyTest1] OS user: teamcity [21:02:09] : [Step 4/5] [2021-11-19 21:02:09,908][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][GridMarshallerMappingConsistencyTest1] PID: 16724 [21:02:09] : [Step 4/5] [2021-11-19 21:02:09,908][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][GridMarshallerMappingConsistencyTest1] Language runtime: Java Platform API Specification ver. 1.8 [21:02:09] : [Step 4/5] [2021-11-19 21:02:09,909][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][GridMarshallerMappingConsistencyTest1] VM information: Java(TM) SE Runtime Environment 1.8.0_261-b12 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 25.261-b12 [21:02:09] : [Step 4/5] [2021-11-19 21:02:09,909][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][GridMarshallerMappingConsistencyTest1] VM total memory: 1.9GB [21:02:09] : [Step 4/5] [2021-11-19 21:02:09,910][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][GridMarshallerMappingConsistencyTest1] Remote Management [restart: off, REST: off, JMX (remote: off)] [21:02:09] : [Step 4/5] [2021-11-19 21:02:09,910][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][GridMarshallerMappingConsistencyTest1] Logger: GridTestLog4jLogger [quiet=false, config=null] [21:02:09] : [Step 4/5] [2021-11-19 21:02:09,911][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][GridMarshallerMappingConsistencyTest1] IGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c [21:02:09] : [Step 4/5] [2021-11-19 21:02:09,911][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][GridMarshallerMappingConsistencyTest1] VM arguments: [-DIGNITE_DUMP_THREADS_ON_FAILURE=false, -DMono=/usr/bin/mono-sgen, -DMono4.0_x64=/usr/lib/mono/4.0, -DMono4.5_x64=/usr/lib/mono/4.5, -DMonoVersion=6.12.0.90, -DSKIP_BUILD=false, -Dagent.home.dir=/opt/buildagent, -Dagent.name=aitc-lin02_03, -Dagent.ownPort=9090, -Dagent.work.dir=/opt/buildagent/work, -Dbuild.number=95, -Dbuild.vcs.number=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.1=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.GitHubApacheIgnite=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dclassworlds.conf=/opt/buildagent/temp/buildTmp/teamcity.m2.conf, -Dcom.jetbrains.maven.watcher.report.file=/opt/buildagent/temp/buildTmp/maven-build-info.xml, -Djava.io.tmpdir=/opt/buildagent/temp/buildTmp, -Dmaven.home=/opt/buildagent/tools/maven3_6, -Dmaven.multiModuleProjectDirectory=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.agent.cpuBenchmark=457, -Dteamcity.agent.dotnet.agent_url=http://localhost:9090/RPC2, -Dteamcity.agent.dotnet.build_id=6278078, -Dteamcity.auth.password=*******, -Dteamcity.auth.userId=TeamCityBuildId=6278078, -Dteamcity.build.changedFiles.file=/opt/buildagent/temp/buildTmp/changedFiles6342607772318147725.txt, -Dteamcity.build.checkoutDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.build.id=6278078, -Dteamcity.build.properties.file=/opt/buildagent/temp/buildTmp/teamcity.build5164517880467851002.properties, -Dteamcity.build.tempDir=/opt/buildagent/temp/buildTmp, -Dteamcity.build.workingDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.buildConfName=Basic 3, -Dteamcity.buildType.id=IgniteTests24Java8_Basic3, -Dteamcity.configuration.properties.file=/opt/buildagent/temp/buildTmp/teamcity.config5591980786735343870.properties, -Dteamcity.maven.userSettings.path=/opt/buildagent/temp/buildTmp/maven_settings_585072866407032347.xml, -Dteamcity.maven.watcher.home=/opt/buildagent/plugins/mavenPlugin/maven-watcher-jdk16, -Dteamcity.projectName=Ignite Tests 2.x (JDK 8/11), -Dteamcity.runner.properties.file=/opt/buildagent/temp/buildTmp/teamcity.runner9098465561618137420.properties, -Dteamcity.tests.recentlyFailedTests.file=/opt/buildagent/temp/buildTmp/testsToRunFirst3891775683130404069.txt, -Dteamcity.version=2021.2 (build 99542), -ea, -Xms2g, -Xmx2g, -XX:+HeapDumpOnOutOfMemoryError, -DIGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_TEST_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_UPDATE_NOTIFIER=false, -DIGNITE_NO_DISCO_ORDER=true, -DIGNITE_PERFORMANCE_SUGGESTIONS_DISABLED=true, -Djava.net.preferIPv4Stack=true, -DTEST_SCALE_FACTOR=1.0, -DIGNITE_TEST_PROP_LOG4J_FILE=log4j-tc-test.xml, -DIGNITE_QUIET=false, -DIGNITE_MARSHAL_BUFFERS_RECHECK=1000, -Dmaven.repo.local=/opt/buildagent/.m2/repository] [21:02:09] : [Step 4/5] [2021-11-19 21:02:09,917][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][GridMarshallerMappingConsistencyTest1] System cache's DataRegion size is configured to 40 MB. Use DataStorageConfiguration.systemRegionInitialSize property to change the setting. [21:02:09] : [Step 4/5] [2021-11-19 21:02:09,918][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][GridMarshallerMappingConsistencyTest1] Configured caches [in 'sysMemPlc' dataRegion: ['ignite-sys-cache']] [21:02:09]W: [org.apache.ignite:ignite-core] [2021-11-19 21:02:09,918][WARN ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][GridMarshallerMappingConsistencyTest1] Peer class loading is enabled (disable it in production for performance and deployment consistency reasons) [21:02:09] : [Step 4/5] [2021-11-19 21:02:09,919][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][GridMarshallerMappingConsistencyTest1] 3-rd party licenses can be found at: /opt/buildagent/work/7bc1c54bc719b67c/libs/licenses [21:02:09] : [Step 4/5] [2021-11-19 21:02:09,924][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][IgnitePluginProcessor] Configured plugins: [21:02:09] : [Step 4/5] [2021-11-19 21:02:09,925][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][IgnitePluginProcessor] ^-- StanByClusterTestProvider 1.0 [21:02:09] : [Step 4/5] [2021-11-19 21:02:09,925][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][IgnitePluginProcessor] ^-- null [21:02:09] : [Step 4/5] [2021-11-19 21:02:09,925][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][IgnitePluginProcessor] [21:02:09] : [Step 4/5] [2021-11-19 21:02:09,926][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][IgnitePluginProcessor] ^-- PageMemory tracker plugin 1.0 [21:02:09] : [Step 4/5] [2021-11-19 21:02:09,926][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][IgnitePluginProcessor] ^-- null [21:02:09] : [Step 4/5] [2021-11-19 21:02:09,926][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][IgnitePluginProcessor] [21:02:09] : [Step 4/5] [2021-11-19 21:02:09,927][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][IgnitePluginProcessor] ^-- TestDistibutedConfigurationPlugin 1.0 [21:02:09] : [Step 4/5] [2021-11-19 21:02:09,927][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][IgnitePluginProcessor] ^-- null [21:02:09] : [Step 4/5] [2021-11-19 21:02:09,927][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][IgnitePluginProcessor] [21:02:09] : [Step 4/5] [2021-11-19 21:02:09,928][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][IgnitePluginProcessor] ^-- NodeValidationPluginProvider 1.0 [21:02:09] : [Step 4/5] [2021-11-19 21:02:09,928][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][IgnitePluginProcessor] ^-- null [21:02:09] : [Step 4/5] [2021-11-19 21:02:09,928][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][IgnitePluginProcessor] [21:02:09] : [Step 4/5] [2021-11-19 21:02:09,929][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][FailureProcessor] Configured failure handler: [hnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]]] [21:02:10] : [Step 4/5] [2021-11-19 21:02:10,082][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][TcpCommunicationSpi] Successfully bound communication NIO server to TCP port [port=45030, locHost=/127.0.0.1, selectorsCnt=12, selectorSpins=0, pairedConn=false] [21:02:10]W: [org.apache.ignite:ignite-core] [2021-11-19 21:02:10,082][WARN ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][TcpCommunicationSpi] Message queue limit is set to 0 which may lead to potential OOMEs when running cache operations in FULL_ASYNC or PRIMARY_SYNC modes due to message queues growth on sender and receiver sides. [21:02:10] : [Step 4/5] [2021-11-19 21:02:10,119][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][GridCollisionManager] Collision resolution is disabled (all jobs will be activated upon arrival). [21:02:10] : [Step 4/5] [2021-11-19 21:02:10,120][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][GridMarshallerMappingConsistencyTest1] Security status [authentication=off, sandbox=off, tls/ssl=off] [21:02:10] : [Step 4/5] [2021-11-19 21:02:10,122][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][MaintenanceProcessor] Resolved store directory for node persistent data: /opt/buildagent/work/7bc1c54bc719b67c/work/test/marshaller.GridMarshallerMappingConsistencyTest1/db/marshaller_GridMarshallerMappingConsistencyTest1 [21:02:10] : [Step 4/5] [2021-11-19 21:02:10,127][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][CacheObjectBinaryProcessorImpl] Resolved directory for serialized binary metadata: /opt/buildagent/work/7bc1c54bc719b67c/work/test/marshaller.GridMarshallerMappingConsistencyTest1/db/binary_meta/marshaller_GridMarshallerMappingConsistencyTest1 [21:02:10] : [Step 4/5] [2021-11-19 21:02:10,141][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/test/marshaller.GridMarshallerMappingConsistencyTest1/db/marshaller_GridMarshallerMappingConsistencyTest1 [21:02:10] : [Step 4/5] [2021-11-19 21:02:10,142][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][FileWriteAheadLogManager] Resolved write ahead log work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/test/marshaller.GridMarshallerMappingConsistencyTest1/db/wal/marshaller_GridMarshallerMappingConsistencyTest1 [21:02:10] : [Step 4/5] [2021-11-19 21:02:10,143][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][FileWriteAheadLogManager] Resolved write ahead log archive directory: /opt/buildagent/work/7bc1c54bc719b67c/work/test/marshaller.GridMarshallerMappingConsistencyTest1/db/wal/archive/marshaller_GridMarshallerMappingConsistencyTest1 [21:02:10] : [Step 4/5] [2021-11-19 21:02:10,146][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/test/marshaller.GridMarshallerMappingConsistencyTest1/db/wal/marshaller_GridMarshallerMappingConsistencyTest1/0000000000000004.wal [21:02:10] : [Step 4/5] [2021-11-19 21:02:10,147][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/test/marshaller.GridMarshallerMappingConsistencyTest1/db/wal/marshaller_GridMarshallerMappingConsistencyTest1/0000000000000003.wal [21:02:10] : [Step 4/5] [2021-11-19 21:02:10,148][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/test/marshaller.GridMarshallerMappingConsistencyTest1/db/wal/marshaller_GridMarshallerMappingConsistencyTest1/0000000000000002.wal [21:02:10] : [Step 4/5] [2021-11-19 21:02:10,149][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/test/marshaller.GridMarshallerMappingConsistencyTest1/db/wal/marshaller_GridMarshallerMappingConsistencyTest1/0000000000000001.wal [21:02:10] : [Step 4/5] [2021-11-19 21:02:10,150][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][FileHandleManagerImpl] Initialized write-ahead log manager [mode=LOG_ONLY] [21:02:10] : [Step 4/5] [2021-11-19 21:02:10,158][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][GridCacheDatabaseSharedManager] Configured data regions initialized successfully [total=5] [21:02:10] : [Step 4/5] [2021-11-19 21:02:10,160][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][IgniteSnapshotManager] Resolved snapshot work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/test/marshaller.GridMarshallerMappingConsistencyTest1/snapshots [21:02:10] : [Step 4/5] [2021-11-19 21:02:10,161][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][IgniteSnapshotManager] Resolved temp directory for snapshot creation: /opt/buildagent/work/7bc1c54bc719b67c/work/test/marshaller.GridMarshallerMappingConsistencyTest1/db/marshaller_GridMarshallerMappingConsistencyTest1/snp [21:02:10] : [Step 4/5] [2021-11-19 21:02:10,169][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][ClientListenerProcessor] Client connector processor has started on TCP port 10800 [21:02:10] : [Step 4/5] [2021-11-19 21:02:10,182][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][GridMarshallerMappingConsistencyTest1] Non-loopback local IPs: 172.17.0.4 [21:02:10] : [Step 4/5] [2021-11-19 21:02:10,182][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][GridMarshallerMappingConsistencyTest1] Enabled local MACs: 0242AC110004 [21:02:10] : [Step 4/5] [2021-11-19 21:02:10,188][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=/opt/buildagent/work/7bc1c54bc719b67c/work/test/marshaller.GridMarshallerMappingConsistencyTest1/db/marshaller_GridMarshallerMappingConsistencyTest1/cp/1637344929354-1c1894f0-8b9f-4f89-8c8c-f2f1d27e8fee-START.bin, endMarker=/opt/buildagent/work/7bc1c54bc719b67c/work/test/marshaller.GridMarshallerMappingConsistencyTest1/db/marshaller_GridMarshallerMappingConsistencyTest1/cp/1637344927866-6bf3e142-0fe6-4298-b764-dfb224a918a3-END.bin] [21:02:10] : [Step 4/5] [2021-11-19 21:02:10,190][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:02:10] : [Step 4/5] [2021-11-19 21:02:10,191][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=86541, len=1963], lastMarked=WALPointer [idx=0, fileOff=142335, len=11985], lastCheckpointId=1c1894f0-8b9f-4f89-8c8c-f2f1d27e8fee] [21:02:10] : [Step 4/5] [2021-11-19 21:02:10,370][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][GridCacheDatabaseSharedManager] Found last checkpoint marker [cpId=1c1894f0-8b9f-4f89-8c8c-f2f1d27e8fee, pos=WALPointer [idx=0, fileOff=142335, len=11985]] [21:02:10] : [Step 4/5] [2021-11-19 21:02:10,380][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][GridCacheDatabaseSharedManager] Applying lost metastore updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=142335, len=11985], lastCheckpointId=1c1894f0-8b9f-4f89-8c8c-f2f1d27e8fee] [21:02:10] : [Step 4/5] [2021-11-19 21:02:10,448][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=70 ms] [21:02:10] : [Step 4/5] [2021-11-19 21:02:10,449][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][GridCacheProcessor] Restoring partition state for local groups. [21:02:10] : [Step 4/5] [2021-11-19 21:02:10,449][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=0, partitionsProcessed=0, time=0ms] [21:02:10] : [Step 4/5] [2021-11-19 21:02:10,617][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][GridEncryptionManager] Encryption keys loaded from metastore. [grps=, masterKeyName=null] [21:02:10] : [Step 4/5] [2021-11-19 21:02:10,629][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][GridClusterStateProcessor] Restoring history for BaselineTopology[id=0] [21:02:10] : [Step 4/5] [2021-11-19 21:02:10,644][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][ClusterProcessor] Cluster ID and tag has been read from metastorage: ClusterIdAndTag [id=34c655b9-4134-491f-9fcb-73e726dd8bbc, tag=stupefied_chaplygin] [21:02:10] : [Step 4/5] [2021-11-19 21:02:10,645][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][IgniteClusterImpl] Shutdown policy was updated [oldVal=null, newVal=null] [21:02:10] : [Step 4/5] [2021-11-19 21:02:10,645][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustEnabled' was changed from 'null' to 'false' [21:02:10] : [Step 4/5] [2021-11-19 21:02:10,646][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustTimeout' was changed from 'null' to '300000' [21:02:10] : [Step 4/5] [2021-11-19 21:02:10,646][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][IgniteTxManager] Transactions parameter 'txOwnerDumpRequestsAllowed' was changed from 'null' to 'true' [21:02:10] : [Step 4/5] [2021-11-19 21:02:10,647][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][IgniteTxManager] Transactions parameter 'longOperationsDumpTimeout' was changed from 'null' to '60000' [21:02:10] : [Step 4/5] [2021-11-19 21:02:10,647][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpThreshold' was changed from 'null' to '0' [21:02:10] : [Step 4/5] [2021-11-19 21:02:10,649][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][IgniteTxManager] Transactions parameter 'transactionTimeDumpSamplesCoefficient' was changed from 'null' to '0.0' [21:02:10] : [Step 4/5] [2021-11-19 21:02:10,649][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpSamplesPerSecondLimit' was changed from 'null' to '5' [21:02:10] : [Step 4/5] [2021-11-19 21:02:10,650][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][IgniteTxManager] Transactions parameter 'collisionsDumpInterval' was changed from 'null' to '1000' [21:02:10] : [Step 4/5] [2021-11-19 21:02:10,650][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][GridCacheDatabaseSharedManager] Historical rebalance WAL threshold changed [property=historical.rebalance.threshold, oldVal=null, newVal=500] [21:02:10] : [Step 4/5] [2021-11-19 21:02:10,651][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][GridCacheDatabaseSharedManager] Checkpoint frequency deviation changed [oldVal=null, newVal=null] [21:02:10] : [Step 4/5] [2021-11-19 21:02:10,652][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][FilePageStoreManager] Cleanup cache stores [total=1, left=0, cleanFiles=false] [21:02:10] : [Step 4/5] [2021-11-19 21:02:10,656][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:02:10] : [Step 4/5] [2021-11-19 21:02:10,658][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:02:10] : [Step 4/5] [2021-11-19 21:02:10,660][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:02:10] : [Step 4/5] [2021-11-19 21:02:10,660][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][GridCacheDatabaseSharedManager] Data Regions Started: 5 [21:02:10] : [Step 4/5] [2021-11-19 21:02:10,661][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][GridCacheDatabaseSharedManager] ^-- sysMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:02:10] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:02:10] : [Step 4/5] ^-- default region [type=default, persistence=true, lazyAlloc=true, [21:02:10] : [Step 4/5] ... initCfg=256MB, maxCfg=256MB, usedRam=0MB, freeRam=100%, allocRam=0MB, allocTotal=0MB] [21:02:10] : [Step 4/5] ^-- metastoreMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:02:10] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:02:10] : [Step 4/5] ^-- TxLog region [type=internal, persistence=true, lazyAlloc=false, [21:02:10] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:02:10] : [Step 4/5] ^-- volatileDsMemPlc region [type=user, persistence=false, lazyAlloc=true, [21:02:10] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB] [21:02:10] : [Step 4/5] ^-- Ignite persistence [used=0MB] [21:02:10] : [Step 4/5] [21:02:10] : [Step 4/5] [2021-11-19 21:02:10,663][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][GridCacheDatabaseSharedManager] Starting binary memory restore for: [94416770, -2100569601] [21:02:10] : [Step 4/5] [2021-11-19 21:02:10,766][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=/opt/buildagent/work/7bc1c54bc719b67c/work/test/marshaller.GridMarshallerMappingConsistencyTest1/db/marshaller_GridMarshallerMappingConsistencyTest1/cp/1637344929354-1c1894f0-8b9f-4f89-8c8c-f2f1d27e8fee-START.bin, endMarker=/opt/buildagent/work/7bc1c54bc719b67c/work/test/marshaller.GridMarshallerMappingConsistencyTest1/db/marshaller_GridMarshallerMappingConsistencyTest1/cp/1637344927866-6bf3e142-0fe6-4298-b764-dfb224a918a3-END.bin] [21:02:10] : [Step 4/5] [2021-11-19 21:02:10,767][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=86541, len=1963], lastMarked=WALPointer [idx=0, fileOff=142335, len=11985], lastCheckpointId=1c1894f0-8b9f-4f89-8c8c-f2f1d27e8fee] [21:02:10]W: [org.apache.ignite:ignite-core] [2021-11-19 21:02:10,835][WARN ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][GridCacheDatabaseSharedManager] Ignite node stopped in the middle of checkpoint. Will restore memory state and finish checkpoint on node start. [21:02:10] : [Step 4/5] [2021-11-19 21:02:10,839][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][PageMemoryImpl] Started page memory [memoryAllocated=256.0 MiB, pages=63504, tableSize=4.9 MiB, replacementSize=7.9 KiB, checkpointBuffer=256.0 MiB] [21:02:10] : [Step 4/5] [2021-11-19 21:02:10,927][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][GridCacheDatabaseSharedManager] Found last checkpoint marker [cpId=1c1894f0-8b9f-4f89-8c8c-f2f1d27e8fee, pos=WALPointer [idx=0, fileOff=142335, len=11985]] [21:02:10] : [Step 4/5] [2021-11-19 21:02:10,931][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][GridCacheDatabaseSharedManager] Finished applying memory changes [changesApplied=24, time=87 ms] [21:02:10] : [Step 4/5] [2021-11-19 21:02:10,954][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][CheckpointWorkflow] Checkpoint finished [cpId=1c1894f0-8b9f-4f89-8c8c-f2f1d27e8fee, pages=15, markPos=WALPointer [idx=0, fileOff=142335, len=11985], pagesWrite=-4ms, fsync=11ms, total=7ms] [21:02:10] : [Step 4/5] [2021-11-19 21:02:10,955][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][GridCacheDatabaseSharedManager] Binary memory state restored at node startup [restoredPtr=WALPointer [idx=0, fileOff=154320, len=0]] [21:02:10] : [Step 4/5] [2021-11-19 21:02:10,957][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/test/marshaller.GridMarshallerMappingConsistencyTest1/db/wal/marshaller_GridMarshallerMappingConsistencyTest1/0000000000000000.wal, offset=154320, ver=2] [21:02:10] : [Step 4/5] [2021-11-19 21:02:10,962][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][GridCacheProcessor] Started cache in recovery mode [name=cache, id=94416770, dataRegionName=default, mode=PARTITIONED, atomicity=ATOMIC, backups=0, mvcc=false] [21:02:10] : [Step 4/5] [2021-11-19 21:02:10,968][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][GridCacheProcessor] Started cache in recovery mode [name=ignite-sys-cache, id=-2100569601, dataRegionName=sysMemPlc, mode=REPLICATED, atomicity=TRANSACTIONAL, backups=2147483647, mvcc=false] [21:02:10] : [Step 4/5] [2021-11-19 21:02:10,969][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][GridCacheDatabaseSharedManager] Binary recovery performed in 306 ms. [21:02:10] : [Step 4/5] [2021-11-19 21:02:10,970][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=/opt/buildagent/work/7bc1c54bc719b67c/work/test/marshaller.GridMarshallerMappingConsistencyTest1/db/marshaller_GridMarshallerMappingConsistencyTest1/cp/1637344929354-1c1894f0-8b9f-4f89-8c8c-f2f1d27e8fee-START.bin, endMarker=/opt/buildagent/work/7bc1c54bc719b67c/work/test/marshaller.GridMarshallerMappingConsistencyTest1/db/marshaller_GridMarshallerMappingConsistencyTest1/cp/1637344929354-1c1894f0-8b9f-4f89-8c8c-f2f1d27e8fee-END.bin] [21:02:10] : [Step 4/5] [2021-11-19 21:02:10,971][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][GridCacheDatabaseSharedManager] Applying lost cache updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=142335, len=11985], lastCheckpointId=1c1894f0-8b9f-4f89-8c8c-f2f1d27e8fee] [21:02:11] : [Step 4/5] [2021-11-19 21:02:11,040][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=76 ms] [21:02:11] : [Step 4/5] [2021-11-19 21:02:11,040][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][GridCacheProcessor] Restoring partition state for local groups. [21:02:11] : [Step 4/5] [2021-11-19 21:02:11,173][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=2, partitionsProcessed=1124, time=132ms] [21:02:11] : [Step 4/5] [2021-11-19 21:02:11,469][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][TestTcpDiscoverySpi] Successfully bound to TCP port [port=47500, localHost=localhost/127.0.0.1, locNodeId=0bcd3ba0-9d78-447c-910a-834571b00001] [21:02:11] : [Step 4/5] [2021-11-19 21:02:11,486][INFO ][disco-notifier-worker-#2189%marshaller.GridMarshallerMappingConsistencyTest1%][MvccProcessorImpl] Assigned mvcc coordinator [crd=MvccCoordinator [topVer=AffinityTopologyVersion [topVer=1, minorTopVer=0], nodeId=0bcd3ba0-9d78-447c-910a-834571b00001, ver=1637344931479, local=true, initialized=false]] [21:02:11] : [Step 4/5] [2021-11-19 21:02:11,488][INFO ][sys-#2187%marshaller.GridMarshallerMappingConsistencyTest1%][ClusterProcessor] Writing cluster ID and tag to metastorage on ready for write ClusterIdAndTag [id=34c655b9-4134-491f-9fcb-73e726dd8bbc, tag=stupefied_chaplygin] [21:02:11] : [Step 4/5] [2021-11-19 21:02:11,520][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][GridMarshallerMappingConsistencyTest1] To start Console Management & Monitoring run ignitevisorcmd.{sh|bat} [21:02:11] : [Step 4/5] [2021-11-19 21:02:11,521][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][GridMarshallerMappingConsistencyTest1] [21:02:11] : [Step 4/5] [21:02:11] : [Step 4/5] >>> +-------------------------------------------+ [21:02:11] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:02:11] : [Step 4/5] >>> +-------------------------------------------+ [21:02:11] : [Step 4/5] >>> OS name: Linux 4.15.0-151-generic amd64 [21:02:11] : [Step 4/5] >>> CPU(s): 24 [21:02:11] : [Step 4/5] >>> Heap: 2.0GB [21:02:11] : [Step 4/5] >>> VM name: 16724@c4dfe9a430b2 [21:02:11] : [Step 4/5] >>> Ignite instance name: marshaller.GridMarshallerMappingConsistencyTest1 [21:02:11] : [Step 4/5] >>> Local node [ID=0BCD3BA0-9D78-447C-910A-834571B00001, order=1, clientMode=false] [21:02:11] : [Step 4/5] >>> Local node addresses: [127.0.0.1] [21:02:11] : [Step 4/5] >>> Local ports: TCP:10800 TCP:45030 TCP:47500 [21:02:11] : [Step 4/5] [21:02:11] : [Step 4/5] [2021-11-19 21:02:11,523][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][GridMarshallerMappingConsistencyTest1] >>> Ignite cluster is in INACTIVE state (limited functionality available). Use control.(sh|bat) script or IgniteCluster.state(ClusterState.ACTIVE) to change the state. [21:02:11] : [Step 4/5] [2021-11-19 21:02:11,524][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][GridDiscoveryManager] Topology snapshot [ver=1, locNode=0bcd3ba0, servers=1, clients=0, state=INACTIVE, CPUs=24, offheap=0.25GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=0bcd3ba0-9d78-447c-910a-834571b00001, consistentId=marshaller.GridMarshallerMappingConsistencyTest1, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:02:11] : [Step 4/5] [2021-11-19 21:02:11,524][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][GridDiscoveryManager] ^-- Baseline [id=0, size=2, online=1, offline=1] [21:02:11] : [Step 4/5] [2021-11-19 21:02:11,525][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][GridDiscoveryManager] ^-- 1 nodes left for auto-activation [marshaller.GridMarshallerMappingConsistencyTest2] [21:02:11] : [Step 4/5] [2021-11-19 21:02:11,525][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][G] Node started : [stage="Configure system pool" (0 ms),stage="Start managers" (235 ms),stage="Configure binary metadata" (6 ms),stage="Start processors" (47 ms),stage="Start 'StanByClusterTestProvider' plugin" (0 ms),stage="Start 'PageMemory tracker plugin' plugin" (0 ms),stage="Start 'TestDistibutedConfigurationPlugin' plugin" (0 ms),stage="Start 'NodeValidationPluginProvider' plugin" (0 ms),stage="Init metastore" (471 ms),stage="Init and start regions" (10 ms),stage="Restore binary memory" (306 ms),stage="Restore logical state" (203 ms),stage="Finish recovery" (293 ms),stage="Join topology" (19 ms),stage="Await transition" (2 ms),stage="Await exchange" (36 ms),stage="Total time" (1628 ms)] [21:02:11] : [Step 4/5] [2021-11-19 21:02:11,527][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][root] Node started with the following configuration [id=0bcd3ba0-9d78-447c-910a-834571b00001, marshaller=BinaryMarshaller [], discovery=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=5000, ackTimeout=5000, marsh=JdkMarshaller [clsFilter=org.apache.ignite.marshaller.MarshallerUtils$1@568df30d], reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], binaryCfg=null, lateAff=true] [21:02:11] : [Step 4/5] [2021-11-19 21:02:11,535][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][GridMarshallerMappingConsistencyTest2] [21:02:11] : [Step 4/5] [21:02:11] : [Step 4/5] >>> __________ ________________ [21:02:11] : [Step 4/5] >>> / _/ ___/ |/ / _/_ __/ __/ [21:02:11] : [Step 4/5] >>> _/ // (7 7 // / / / / _/ [21:02:11] : [Step 4/5] >>> /___/\___/_/|_/___/ /_/ /___/ [21:02:11] : [Step 4/5] >>> [21:02:11] : [Step 4/5] >>> ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:02:11] : [Step 4/5] >>> 2021 Copyright(C) Apache Software Foundation [21:02:11] : [Step 4/5] >>> [21:02:11] : [Step 4/5] >>> Ignite documentation: http://ignite.apache.org [21:02:11] : [Step 4/5] [21:02:11] : [Step 4/5] [2021-11-19 21:02:11,535][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][GridMarshallerMappingConsistencyTest2] Config URL: n/a [21:02:11] : [Step 4/5] [2021-11-19 21:02:11,536][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][GridMarshallerMappingConsistencyTest2] IgniteConfiguration [igniteInstanceName=marshaller.GridMarshallerMappingConsistencyTest2, pubPoolSize=24, svcPoolSize=24, callbackPoolSize=24, stripedPoolSize=24, sysPoolSize=24, mgmtPoolSize=4, dataStreamerPoolSize=24, utilityCachePoolSize=24, utilityCacheKeepAliveTime=60000, p2pPoolSize=2, qryPoolSize=24, buildIdxPoolSize=4, igniteHome=/opt/buildagent/work/7bc1c54bc719b67c, igniteWorkDir=/opt/buildagent/work/7bc1c54bc719b67c/work/test/marshaller.GridMarshallerMappingConsistencyTest2, mbeanSrv=com.sun.jmx.mbeanserver.JmxMBeanServer@6fe85038, nodeId=e490e76d-6b6e-44b7-a9bf-1e4f44700002, marsh=BinaryMarshaller [], marshLocJobs=false, daemon=false, p2pEnabled=true, netTimeout=10000, netCompressionLevel=1, sndRetryDelay=1000, sndRetryCnt=3, metricsHistSize=10000, metricsUpdateFreq=1000, metricsExpTime=9223372036854775807, discoSpi=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=0, ackTimeout=0, marsh=null, reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], segPlc=STOP, segResolveAttempts=2, waitForSegOnStart=true, allResolversPassReq=true, segChkFreq=10000, commSpi=TcpCommunicationSpi [connectGate=org.apache.ignite.spi.communication.tcp.internal.ConnectGateway@349d07cd, ctxInitLatch=java.util.concurrent.CountDownLatch@1ca4b562[Count = 1], stopping=false, clientPool=null, nioSrvWrapper=null, stateProvider=null], evtSpi=MemoryEventStorageSpi [expireAgeMs=9223372036854775807, expireCnt=10000, filter=null], colSpi=NoopCollisionSpi [], deploySpi=LocalDeploymentSpi [], indexingSpi=org.apache.ignite.spi.indexing.noop.NoopIndexingSpi@28409eab, addrRslvr=null, encryptionSpi=org.apache.ignite.spi.encryption.noop.NoopEncryptionSpi@4a897156, tracingSpi=org.apache.ignite.spi.tracing.NoopTracingSpi@4898802d, clientMode=false, rebalanceThreadPoolSize=4, rebalanceTimeout=10000, rebalanceBatchesPrefetchCnt=3, rebalanceThrottle=0, rebalanceBatchSize=524288, txCfg=TransactionConfiguration [txSerEnabled=false, dfltIsolation=REPEATABLE_READ, dfltConcurrency=PESSIMISTIC, dfltTxTimeout=0, txTimeoutOnPartitionMapExchange=0, deadlockTimeout=10000, pessimisticTxLogSize=0, pessimisticTxLogLinger=10000, tmLookupClsName=null, txManagerFactory=null, useJtaSync=false], cacheSanityCheckEnabled=true, discoStartupDelay=60000, deployMode=SHARED, p2pMissedCacheSize=100, locHost=127.0.0.1, timeSrvPortBase=31100, timeSrvPortRange=100, failureDetectionTimeout=10000, sysWorkerBlockedTimeout=null, clientFailureDetectionTimeout=10000, metricsLogFreq=0, connectorCfg=null, odbcCfg=null, warmupClos=null, atomicCfg=AtomicConfiguration [seqReserveSize=1000, cacheMode=PARTITIONED, backups=1, aff=null, grpName=null], classLdr=null, sslCtxFactory=null, platformCfg=null, binaryCfg=null, memCfg=null, pstCfg=null, dsCfg=DataStorageConfiguration [sysRegionInitSize=41943040, sysRegionMaxSize=104857600, pageSize=0, concLvl=0, dfltDataRegConf=DataRegionConfiguration [name=default, maxSize=268435456, initSize=268435456, swapPath=null, pageEvictionMode=DISABLED, pageReplacementMode=CLOCK, evictionThreshold=0.9, emptyPagesPoolSize=100, metricsEnabled=false, metricsSubIntervalCount=5, metricsRateTimeInterval=60000, persistenceEnabled=true, checkpointPageBufSize=0, lazyMemoryAllocation=true, warmUpCfg=null], dataRegions=null, storagePath=null, checkpointFreq=180000, lockWaitTime=10000, checkpointThreads=4, checkpointWriteOrder=SEQUENTIAL, walHistSize=20, maxWalArchiveSize=1073741824, walSegments=10, walSegmentSize=67108864, walPath=db/wal, walArchivePath=db/wal/archive, cdcWalPath=db/wal/cdc, cdcEnabled=false, metricsEnabled=false, walMode=LOG_ONLY, walTlbSize=131072, walBuffSize=0, walFlushFreq=2000, walFsyncDelay=1000, walRecordIterBuffSize=67108864, alwaysWriteFullPages=false, fileIOFactory=org.apache.ignite.internal.processors.cache.persistence.file.AsyncFileIOFactory@511aeb88, metricsSubIntervalCnt=5, metricsRateTimeInterval=60000, walAutoArchiveAfterInactivity=-1, walForceArchiveTimeout=-1, writeThrottlingEnabled=false, walCompactionEnabled=false, walCompactionLevel=1, checkpointReadLockTimeout=null, walPageCompression=DISABLED, walPageCompressionLevel=null, dfltWarmUpCfg=null, encCfg=org.apache.ignite.configuration.EncryptionConfiguration@9865387, defragmentationThreadPoolSize=4, minWalArchiveSize=-1], snapshotPath=snapshots, activeOnStart=true, activeOnStartPropSetFlag=false, autoActivation=true, autoActivationPropSetFlag=false, clusterStateOnStart=null, sqlConnCfg=null, cliConnCfg=ClientConnectorConfiguration [host=null, port=10800, portRange=100, sockSndBufSize=0, sockRcvBufSize=0, tcpNoDelay=true, maxOpenCursorsPerConn=128, threadPoolSize=24, selectorCnt=12, idleTimeout=0, handshakeTimeout=10000, jdbcEnabled=true, odbcEnabled=true, thinCliEnabled=true, sslEnabled=false, useIgniteSslCtxFactory=true, sslClientAuth=false, sslCtxFactory=null, thinCliCfg=ThinClientConfiguration [maxActiveTxPerConn=100, maxActiveComputeTasksPerConn=0]], mvccVacuumThreadCnt=2, mvccVacuumFreq=5000, authEnabled=false, failureHnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]], commFailureRslvr=null, sqlCfg=SqlConfiguration [longQryWarnTimeout=3000, dfltQryTimeout=0, sqlQryHistSize=1000, validationEnabled=false], asyncContinuationExecutor=null] [21:02:11] : [Step 4/5] [2021-11-19 21:02:11,545][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][GridMarshallerMappingConsistencyTest2] Daemon mode: off [21:02:11] : [Step 4/5] [2021-11-19 21:02:11,546][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][GridMarshallerMappingConsistencyTest2] OS: Linux 4.15.0-151-generic amd64 [21:02:11] : [Step 4/5] [2021-11-19 21:02:11,546][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][GridMarshallerMappingConsistencyTest2] OS user: teamcity [21:02:11] : [Step 4/5] [2021-11-19 21:02:11,546][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][GridMarshallerMappingConsistencyTest2] PID: 16724 [21:02:11] : [Step 4/5] [2021-11-19 21:02:11,547][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][GridMarshallerMappingConsistencyTest2] Language runtime: Java Platform API Specification ver. 1.8 [21:02:11] : [Step 4/5] [2021-11-19 21:02:11,547][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][GridMarshallerMappingConsistencyTest2] VM information: Java(TM) SE Runtime Environment 1.8.0_261-b12 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 25.261-b12 [21:02:11] : [Step 4/5] [2021-11-19 21:02:11,548][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][GridMarshallerMappingConsistencyTest2] VM total memory: 1.9GB [21:02:11] : [Step 4/5] [2021-11-19 21:02:11,548][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][GridMarshallerMappingConsistencyTest2] Remote Management [restart: off, REST: off, JMX (remote: off)] [21:02:11] : [Step 4/5] [2021-11-19 21:02:11,548][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][GridMarshallerMappingConsistencyTest2] Logger: GridTestLog4jLogger [quiet=false, config=null] [21:02:11] : [Step 4/5] [2021-11-19 21:02:11,549][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][GridMarshallerMappingConsistencyTest2] IGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c [21:02:11] : [Step 4/5] [2021-11-19 21:02:11,549][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][GridMarshallerMappingConsistencyTest2] VM arguments: [-DIGNITE_DUMP_THREADS_ON_FAILURE=false, -DMono=/usr/bin/mono-sgen, -DMono4.0_x64=/usr/lib/mono/4.0, -DMono4.5_x64=/usr/lib/mono/4.5, -DMonoVersion=6.12.0.90, -DSKIP_BUILD=false, -Dagent.home.dir=/opt/buildagent, -Dagent.name=aitc-lin02_03, -Dagent.ownPort=9090, -Dagent.work.dir=/opt/buildagent/work, -Dbuild.number=95, -Dbuild.vcs.number=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.1=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.GitHubApacheIgnite=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dclassworlds.conf=/opt/buildagent/temp/buildTmp/teamcity.m2.conf, -Dcom.jetbrains.maven.watcher.report.file=/opt/buildagent/temp/buildTmp/maven-build-info.xml, -Djava.io.tmpdir=/opt/buildagent/temp/buildTmp, -Dmaven.home=/opt/buildagent/tools/maven3_6, -Dmaven.multiModuleProjectDirectory=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.agent.cpuBenchmark=457, -Dteamcity.agent.dotnet.agent_url=http://localhost:9090/RPC2, -Dteamcity.agent.dotnet.build_id=6278078, -Dteamcity.auth.password=*******, -Dteamcity.auth.userId=TeamCityBuildId=6278078, -Dteamcity.build.changedFiles.file=/opt/buildagent/temp/buildTmp/changedFiles6342607772318147725.txt, -Dteamcity.build.checkoutDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.build.id=6278078, -Dteamcity.build.properties.file=/opt/buildagent/temp/buildTmp/teamcity.build5164517880467851002.properties, -Dteamcity.build.tempDir=/opt/buildagent/temp/buildTmp, -Dteamcity.build.workingDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.buildConfName=Basic 3, -Dteamcity.buildType.id=IgniteTests24Java8_Basic3, -Dteamcity.configuration.properties.file=/opt/buildagent/temp/buildTmp/teamcity.config5591980786735343870.properties, -Dteamcity.maven.userSettings.path=/opt/buildagent/temp/buildTmp/maven_settings_585072866407032347.xml, -Dteamcity.maven.watcher.home=/opt/buildagent/plugins/mavenPlugin/maven-watcher-jdk16, -Dteamcity.projectName=Ignite Tests 2.x (JDK 8/11), -Dteamcity.runner.properties.file=/opt/buildagent/temp/buildTmp/teamcity.runner9098465561618137420.properties, -Dteamcity.tests.recentlyFailedTests.file=/opt/buildagent/temp/buildTmp/testsToRunFirst3891775683130404069.txt, -Dteamcity.version=2021.2 (build 99542), -ea, -Xms2g, -Xmx2g, -XX:+HeapDumpOnOutOfMemoryError, -DIGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_TEST_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_UPDATE_NOTIFIER=false, -DIGNITE_NO_DISCO_ORDER=true, -DIGNITE_PERFORMANCE_SUGGESTIONS_DISABLED=true, -Djava.net.preferIPv4Stack=true, -DTEST_SCALE_FACTOR=1.0, -DIGNITE_TEST_PROP_LOG4J_FILE=log4j-tc-test.xml, -DIGNITE_QUIET=false, -DIGNITE_MARSHAL_BUFFERS_RECHECK=1000, -Dmaven.repo.local=/opt/buildagent/.m2/repository] [21:02:11] : [Step 4/5] [2021-11-19 21:02:11,554][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][GridMarshallerMappingConsistencyTest2] System cache's DataRegion size is configured to 40 MB. Use DataStorageConfiguration.systemRegionInitialSize property to change the setting. [21:02:11] : [Step 4/5] [2021-11-19 21:02:11,554][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][GridMarshallerMappingConsistencyTest2] Configured caches [in 'sysMemPlc' dataRegion: ['ignite-sys-cache']] [21:02:11]W: [org.apache.ignite:ignite-core] [2021-11-19 21:02:11,554][WARN ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][GridMarshallerMappingConsistencyTest2] Peer class loading is enabled (disable it in production for performance and deployment consistency reasons) [21:02:11] : [Step 4/5] [2021-11-19 21:02:11,555][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][GridMarshallerMappingConsistencyTest2] 3-rd party licenses can be found at: /opt/buildagent/work/7bc1c54bc719b67c/libs/licenses [21:02:11] : [Step 4/5] [2021-11-19 21:02:11,559][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][IgnitePluginProcessor] Configured plugins: [21:02:11] : [Step 4/5] [2021-11-19 21:02:11,559][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][IgnitePluginProcessor] ^-- StanByClusterTestProvider 1.0 [21:02:11] : [Step 4/5] [2021-11-19 21:02:11,560][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][IgnitePluginProcessor] ^-- null [21:02:11] : [Step 4/5] [2021-11-19 21:02:11,560][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][IgnitePluginProcessor] [21:02:11] : [Step 4/5] [2021-11-19 21:02:11,560][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][IgnitePluginProcessor] ^-- PageMemory tracker plugin 1.0 [21:02:11] : [Step 4/5] [2021-11-19 21:02:11,560][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][IgnitePluginProcessor] ^-- null [21:02:11] : [Step 4/5] [2021-11-19 21:02:11,561][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][IgnitePluginProcessor] [21:02:11] : [Step 4/5] [2021-11-19 21:02:11,561][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][IgnitePluginProcessor] ^-- TestDistibutedConfigurationPlugin 1.0 [21:02:11] : [Step 4/5] [2021-11-19 21:02:11,561][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][IgnitePluginProcessor] ^-- null [21:02:11] : [Step 4/5] [2021-11-19 21:02:11,562][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][IgnitePluginProcessor] [21:02:11] : [Step 4/5] [2021-11-19 21:02:11,562][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][IgnitePluginProcessor] ^-- NodeValidationPluginProvider 1.0 [21:02:11] : [Step 4/5] [2021-11-19 21:02:11,562][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][IgnitePluginProcessor] ^-- null [21:02:11] : [Step 4/5] [2021-11-19 21:02:11,562][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][IgnitePluginProcessor] [21:02:11] : [Step 4/5] [2021-11-19 21:02:11,563][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][FailureProcessor] Configured failure handler: [hnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]]] [21:02:11]W: [org.apache.ignite:ignite-core] [2021-11-19 21:02:11,602][WARN ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][TcpCommunicationSpi] Message queue limit is set to 0 which may lead to potential OOMEs when running cache operations in FULL_ASYNC or PRIMARY_SYNC modes due to message queues growth on sender and receiver sides. [21:02:11] : [Step 4/5] [2021-11-19 21:02:11,602][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][TcpCommunicationSpi] Successfully bound communication NIO server to TCP port [port=45031, locHost=/127.0.0.1, selectorsCnt=12, selectorSpins=0, pairedConn=false] [21:02:11] : [Step 4/5] [2021-11-19 21:02:11,607][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][GridCollisionManager] Collision resolution is disabled (all jobs will be activated upon arrival). [21:02:11] : [Step 4/5] [2021-11-19 21:02:11,608][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][GridMarshallerMappingConsistencyTest2] Security status [authentication=off, sandbox=off, tls/ssl=off] [21:02:11] : [Step 4/5] [2021-11-19 21:02:11,609][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][MaintenanceProcessor] Resolved store directory for node persistent data: /opt/buildagent/work/7bc1c54bc719b67c/work/test/marshaller.GridMarshallerMappingConsistencyTest2/db/marshaller_GridMarshallerMappingConsistencyTest2 [21:02:11] : [Step 4/5] [2021-11-19 21:02:11,611][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][CacheObjectBinaryProcessorImpl] Resolved directory for serialized binary metadata: /opt/buildagent/work/7bc1c54bc719b67c/work/test/marshaller.GridMarshallerMappingConsistencyTest2/db/binary_meta/marshaller_GridMarshallerMappingConsistencyTest2 [21:02:11] : [Step 4/5] [2021-11-19 21:02:11,618][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/test/marshaller.GridMarshallerMappingConsistencyTest2/db/marshaller_GridMarshallerMappingConsistencyTest2 [21:02:11] : [Step 4/5] [2021-11-19 21:02:11,619][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][FileWriteAheadLogManager] Resolved write ahead log work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/test/marshaller.GridMarshallerMappingConsistencyTest2/db/wal/marshaller_GridMarshallerMappingConsistencyTest2 [21:02:11] : [Step 4/5] [2021-11-19 21:02:11,620][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][FileWriteAheadLogManager] Resolved write ahead log archive directory: /opt/buildagent/work/7bc1c54bc719b67c/work/test/marshaller.GridMarshallerMappingConsistencyTest2/db/wal/archive/marshaller_GridMarshallerMappingConsistencyTest2 [21:02:11] : [Step 4/5] [2021-11-19 21:02:11,621][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/test/marshaller.GridMarshallerMappingConsistencyTest2/db/wal/marshaller_GridMarshallerMappingConsistencyTest2/0000000000000002.wal [21:02:11] : [Step 4/5] [2021-11-19 21:02:11,622][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/test/marshaller.GridMarshallerMappingConsistencyTest2/db/wal/marshaller_GridMarshallerMappingConsistencyTest2/0000000000000001.wal [21:02:11] : [Step 4/5] [2021-11-19 21:02:11,622][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][FileHandleManagerImpl] Initialized write-ahead log manager [mode=LOG_ONLY] [21:02:11] : [Step 4/5] [2021-11-19 21:02:11,628][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][GridCacheDatabaseSharedManager] Configured data regions initialized successfully [total=5] [21:02:11] : [Step 4/5] [2021-11-19 21:02:11,629][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][IgniteSnapshotManager] Resolved snapshot work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/test/marshaller.GridMarshallerMappingConsistencyTest2/snapshots [21:02:11] : [Step 4/5] [2021-11-19 21:02:11,630][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][IgniteSnapshotManager] Resolved temp directory for snapshot creation: /opt/buildagent/work/7bc1c54bc719b67c/work/test/marshaller.GridMarshallerMappingConsistencyTest2/db/marshaller_GridMarshallerMappingConsistencyTest2/snp [21:02:11] : [Step 4/5] [2021-11-19 21:02:11,633][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][ClientListenerProcessor] Client connector processor has started on TCP port 10801 [21:02:11] : [Step 4/5] [2021-11-19 21:02:11,637][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][GridMarshallerMappingConsistencyTest2] Non-loopback local IPs: 172.17.0.4 [21:02:11] : [Step 4/5] [2021-11-19 21:02:11,637][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][GridMarshallerMappingConsistencyTest2] Enabled local MACs: 0242AC110004 [21:02:11] : [Step 4/5] [2021-11-19 21:02:11,639][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=/opt/buildagent/work/7bc1c54bc719b67c/work/test/marshaller.GridMarshallerMappingConsistencyTest2/db/marshaller_GridMarshallerMappingConsistencyTest2/cp/1637344927872-1ea4bd57-d2e9-44a3-b96d-c851b80b9058-START.bin, endMarker=/opt/buildagent/work/7bc1c54bc719b67c/work/test/marshaller.GridMarshallerMappingConsistencyTest2/db/marshaller_GridMarshallerMappingConsistencyTest2/cp/1637344927872-1ea4bd57-d2e9-44a3-b96d-c851b80b9058-END.bin] [21:02:11] : [Step 4/5] [2021-11-19 21:02:11,641][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:02:11] : [Step 4/5] [2021-11-19 21:02:11,642][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=86541, len=1963], lastMarked=WALPointer [idx=0, fileOff=86541, len=1963], lastCheckpointId=1ea4bd57-d2e9-44a3-b96d-c851b80b9058] [21:02:11] : [Step 4/5] [2021-11-19 21:02:11,765][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][GridCacheDatabaseSharedManager] Found last checkpoint marker [cpId=1ea4bd57-d2e9-44a3-b96d-c851b80b9058, pos=WALPointer [idx=0, fileOff=86541, len=1963]] [21:02:11] : [Step 4/5] [2021-11-19 21:02:11,771][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][GridCacheDatabaseSharedManager] Applying lost metastore updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=86541, len=1963], lastCheckpointId=1ea4bd57-d2e9-44a3-b96d-c851b80b9058] [21:02:11] : [Step 4/5] [2021-11-19 21:02:11,832][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=61 ms] [21:02:11] : [Step 4/5] [2021-11-19 21:02:11,833][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][GridCacheProcessor] Restoring partition state for local groups. [21:02:11] : [Step 4/5] [2021-11-19 21:02:11,833][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=0, partitionsProcessed=0, time=0ms] [21:02:11] : [Step 4/5] [2021-11-19 21:02:11,894][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][GridEncryptionManager] Encryption keys loaded from metastore. [grps=, masterKeyName=null] [21:02:11] : [Step 4/5] [2021-11-19 21:02:11,896][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][GridClusterStateProcessor] Restoring history for BaselineTopology[id=0] [21:02:11] : [Step 4/5] [2021-11-19 21:02:11,899][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][ClusterProcessor] Cluster ID and tag has been read from metastorage: ClusterIdAndTag [id=34c655b9-4134-491f-9fcb-73e726dd8bbc, tag=stupefied_chaplygin] [21:02:11] : [Step 4/5] [2021-11-19 21:02:11,899][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][IgniteClusterImpl] Shutdown policy was updated [oldVal=null, newVal=null] [21:02:11] : [Step 4/5] [2021-11-19 21:02:11,900][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustEnabled' was changed from 'null' to 'false' [21:02:11] : [Step 4/5] [2021-11-19 21:02:11,900][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustTimeout' was changed from 'null' to '300000' [21:02:11] : [Step 4/5] [2021-11-19 21:02:11,901][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][IgniteTxManager] Transactions parameter 'txOwnerDumpRequestsAllowed' was changed from 'null' to 'true' [21:02:11] : [Step 4/5] [2021-11-19 21:02:11,901][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][IgniteTxManager] Transactions parameter 'longOperationsDumpTimeout' was changed from 'null' to '60000' [21:02:11] : [Step 4/5] [2021-11-19 21:02:11,902][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpThreshold' was changed from 'null' to '0' [21:02:11] : [Step 4/5] [2021-11-19 21:02:11,902][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][IgniteTxManager] Transactions parameter 'transactionTimeDumpSamplesCoefficient' was changed from 'null' to '0.0' [21:02:11] : [Step 4/5] [2021-11-19 21:02:11,902][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpSamplesPerSecondLimit' was changed from 'null' to '5' [21:02:11] : [Step 4/5] [2021-11-19 21:02:11,903][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][IgniteTxManager] Transactions parameter 'collisionsDumpInterval' was changed from 'null' to '1000' [21:02:11] : [Step 4/5] [2021-11-19 21:02:11,903][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][GridCacheDatabaseSharedManager] Historical rebalance WAL threshold changed [property=historical.rebalance.threshold, oldVal=null, newVal=500] [21:02:11] : [Step 4/5] [2021-11-19 21:02:11,904][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][GridCacheDatabaseSharedManager] Checkpoint frequency deviation changed [oldVal=null, newVal=null] [21:02:11] : [Step 4/5] [2021-11-19 21:02:11,904][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][FilePageStoreManager] Cleanup cache stores [total=1, left=0, cleanFiles=false] [21:02:11] : [Step 4/5] [2021-11-19 21:02:11,909][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:02:11] : [Step 4/5] [2021-11-19 21:02:11,910][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:02:11] : [Step 4/5] [2021-11-19 21:02:11,913][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:02:11] : [Step 4/5] [2021-11-19 21:02:11,913][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][GridCacheDatabaseSharedManager] Data Regions Started: 5 [21:02:11] : [Step 4/5] [2021-11-19 21:02:11,914][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][GridCacheDatabaseSharedManager] ^-- sysMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:02:11] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:02:11] : [Step 4/5] ^-- default region [type=default, persistence=true, lazyAlloc=true, [21:02:11] : [Step 4/5] ... initCfg=256MB, maxCfg=256MB, usedRam=0MB, freeRam=100%, allocRam=0MB, allocTotal=0MB] [21:02:11] : [Step 4/5] ^-- metastoreMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:02:11] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:02:11] : [Step 4/5] ^-- TxLog region [type=internal, persistence=true, lazyAlloc=false, [21:02:11] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:02:11] : [Step 4/5] ^-- volatileDsMemPlc region [type=user, persistence=false, lazyAlloc=true, [21:02:11] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB] [21:02:11] : [Step 4/5] ^-- Ignite persistence [used=0MB] [21:02:11] : [Step 4/5] [21:02:11] : [Step 4/5] [2021-11-19 21:02:11,916][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][GridCacheDatabaseSharedManager] Starting binary memory restore for: [-2100569601] [21:02:11] : [Step 4/5] [2021-11-19 21:02:11,926][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=/opt/buildagent/work/7bc1c54bc719b67c/work/test/marshaller.GridMarshallerMappingConsistencyTest2/db/marshaller_GridMarshallerMappingConsistencyTest2/cp/1637344927872-1ea4bd57-d2e9-44a3-b96d-c851b80b9058-START.bin, endMarker=/opt/buildagent/work/7bc1c54bc719b67c/work/test/marshaller.GridMarshallerMappingConsistencyTest2/db/marshaller_GridMarshallerMappingConsistencyTest2/cp/1637344927872-1ea4bd57-d2e9-44a3-b96d-c851b80b9058-END.bin] [21:02:11] : [Step 4/5] [2021-11-19 21:02:11,927][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=86541, len=1963], lastMarked=WALPointer [idx=0, fileOff=86541, len=1963], lastCheckpointId=1ea4bd57-d2e9-44a3-b96d-c851b80b9058] [21:02:12] : [Step 4/5] [2021-11-19 21:02:12,068][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][GridCacheDatabaseSharedManager] Found last checkpoint marker [cpId=1ea4bd57-d2e9-44a3-b96d-c851b80b9058, pos=WALPointer [idx=0, fileOff=86541, len=1963]] [21:02:12] : [Step 4/5] [2021-11-19 21:02:12,075][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][GridCacheDatabaseSharedManager] Binary memory state restored at node startup [restoredPtr=WALPointer [idx=0, fileOff=88504, len=0]] [21:02:12] : [Step 4/5] [2021-11-19 21:02:12,080][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/test/marshaller.GridMarshallerMappingConsistencyTest2/db/wal/marshaller_GridMarshallerMappingConsistencyTest2/0000000000000000.wal, offset=88504, ver=2] [21:02:12] : [Step 4/5] [2021-11-19 21:02:12,085][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][GridCacheProcessor] Started cache in recovery mode [name=ignite-sys-cache, id=-2100569601, dataRegionName=sysMemPlc, mode=REPLICATED, atomicity=TRANSACTIONAL, backups=2147483647, mvcc=false] [21:02:12] : [Step 4/5] [2021-11-19 21:02:12,086][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][GridCacheDatabaseSharedManager] Binary recovery performed in 170 ms. [21:02:12] : [Step 4/5] [2021-11-19 21:02:12,087][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=/opt/buildagent/work/7bc1c54bc719b67c/work/test/marshaller.GridMarshallerMappingConsistencyTest2/db/marshaller_GridMarshallerMappingConsistencyTest2/cp/1637344927872-1ea4bd57-d2e9-44a3-b96d-c851b80b9058-START.bin, endMarker=/opt/buildagent/work/7bc1c54bc719b67c/work/test/marshaller.GridMarshallerMappingConsistencyTest2/db/marshaller_GridMarshallerMappingConsistencyTest2/cp/1637344927872-1ea4bd57-d2e9-44a3-b96d-c851b80b9058-END.bin] [21:02:12] : [Step 4/5] [2021-11-19 21:02:12,088][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][GridCacheDatabaseSharedManager] Applying lost cache updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=86541, len=1963], lastCheckpointId=1ea4bd57-d2e9-44a3-b96d-c851b80b9058] [21:02:12] : [Step 4/5] [2021-11-19 21:02:12,156][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=71 ms] [21:02:12] : [Step 4/5] [2021-11-19 21:02:12,157][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][GridCacheProcessor] Restoring partition state for local groups. [21:02:12] : [Step 4/5] [2021-11-19 21:02:12,200][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=1, partitionsProcessed=100, time=41ms] [21:02:12] : [Step 4/5] [2021-11-19 21:02:12,615][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][TestTcpDiscoverySpi] Successfully bound to TCP port [port=47501, localHost=localhost/127.0.0.1, locNodeId=e490e76d-6b6e-44b7-a9bf-1e4f44700002] [21:02:12] : [Step 4/5] [2021-11-19 21:02:12,621][INFO ][tcp-disco-srvr-[:47500]-#115%marshaller.GridMarshallerMappingConsistencyTest1%-#2191%marshaller.GridMarshallerMappingConsistencyTest1%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=58023] [21:02:12] : [Step 4/5] [2021-11-19 21:02:12,621][INFO ][tcp-disco-srvr-[:47500]-#115%marshaller.GridMarshallerMappingConsistencyTest1%-#2191%marshaller.GridMarshallerMappingConsistencyTest1%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=58023] [21:02:12] : [Step 4/5] [2021-11-19 21:02:12,623][INFO ][tcp-disco-sock-reader-[]-#121%marshaller.GridMarshallerMappingConsistencyTest1%-#2311%marshaller.GridMarshallerMappingConsistencyTest1%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:58023, rmtPort=58023] [21:02:12] : [Step 4/5] [2021-11-19 21:02:12,626][INFO ][tcp-disco-sock-reader-[e490e76d 127.0.0.1:58023]-#121%marshaller.GridMarshallerMappingConsistencyTest1%-#2311%marshaller.GridMarshallerMappingConsistencyTest1%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=e490e76d-6b6e-44b7-a9bf-1e4f44700002, rmtAddr=/127.0.0.1:58023] [21:02:12] : [Step 4/5] [2021-11-19 21:02:12,631][INFO ][tcp-disco-srvr-[:47501]-#120%marshaller.GridMarshallerMappingConsistencyTest2%-#2310%marshaller.GridMarshallerMappingConsistencyTest2%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=50823] [21:02:12] : [Step 4/5] [2021-11-19 21:02:12,632][INFO ][tcp-disco-srvr-[:47501]-#120%marshaller.GridMarshallerMappingConsistencyTest2%-#2310%marshaller.GridMarshallerMappingConsistencyTest2%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=50823] [21:02:12] : [Step 4/5] [2021-11-19 21:02:12,633][INFO ][tcp-disco-sock-reader-[]-#122%marshaller.GridMarshallerMappingConsistencyTest2%-#2312%marshaller.GridMarshallerMappingConsistencyTest2%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:50823, rmtPort=50823] [21:02:12] : [Step 4/5] [2021-11-19 21:02:12,634][INFO ][tcp-disco-sock-reader-[]-#122%marshaller.GridMarshallerMappingConsistencyTest2%-#2312%marshaller.GridMarshallerMappingConsistencyTest2%][TestTcpDiscoverySpi] Received ping request from the remote node [rmtNodeId=0bcd3ba0-9d78-447c-910a-834571b00001, rmtAddr=/127.0.0.1:50823, rmtPort=50823] [21:02:12] : [Step 4/5] [2021-11-19 21:02:12,636][INFO ][tcp-disco-sock-reader-[]-#122%marshaller.GridMarshallerMappingConsistencyTest2%-#2312%marshaller.GridMarshallerMappingConsistencyTest2%][TestTcpDiscoverySpi] Finished writing ping response [rmtNodeId=0bcd3ba0-9d78-447c-910a-834571b00001, rmtAddr=/127.0.0.1:50823, rmtPort=50823] [21:02:12] : [Step 4/5] [2021-11-19 21:02:12,636][INFO ][tcp-disco-sock-reader-[e490e76d 127.0.0.1:58023]-#121%marshaller.GridMarshallerMappingConsistencyTest1%-#2311%marshaller.GridMarshallerMappingConsistencyTest1%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:58023, rmtPort=58023, rmtNodeId=e490e76d-6b6e-44b7-a9bf-1e4f44700002] [21:02:12] : [Step 4/5] [2021-11-19 21:02:12,637][INFO ][tcp-disco-sock-reader-[]-#122%marshaller.GridMarshallerMappingConsistencyTest2%-#2312%marshaller.GridMarshallerMappingConsistencyTest2%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:50823, rmtPort=50823, rmtNodeId=null] [21:02:12] : [Step 4/5] [2021-11-19 21:02:12,641][INFO ][tcp-disco-msg-worker-[crd]-#114%marshaller.GridMarshallerMappingConsistencyTest1%-#2190%marshaller.GridMarshallerMappingConsistencyTest1%][GridEncryptionManager] Joining node doesn't have stored group keys [node=e490e76d-6b6e-44b7-a9bf-1e4f44700002] [21:02:12] : [Step 4/5] [2021-11-19 21:02:12,658][INFO ][tcp-disco-msg-worker-[crd]-#114%marshaller.GridMarshallerMappingConsistencyTest1%-#2190%marshaller.GridMarshallerMappingConsistencyTest1%][TestTcpDiscoverySpi] New next node [newNext=TcpDiscoveryNode [id=e490e76d-6b6e-44b7-a9bf-1e4f44700002, consistentId=marshaller.GridMarshallerMappingConsistencyTest2, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=0, intOrder=2, lastExchangeTime=1637344932628, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false]] [21:02:12] : [Step 4/5] [2021-11-19 21:02:12,660][INFO ][tcp-disco-srvr-[:47501]-#120%marshaller.GridMarshallerMappingConsistencyTest2%-#2310%marshaller.GridMarshallerMappingConsistencyTest2%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=48641] [21:02:12] : [Step 4/5] [2021-11-19 21:02:12,660][INFO ][tcp-disco-srvr-[:47501]-#120%marshaller.GridMarshallerMappingConsistencyTest2%-#2310%marshaller.GridMarshallerMappingConsistencyTest2%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=48641] [21:02:12] : [Step 4/5] [2021-11-19 21:02:12,661][INFO ][tcp-disco-sock-reader-[]-#123%marshaller.GridMarshallerMappingConsistencyTest2%-#2313%marshaller.GridMarshallerMappingConsistencyTest2%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:48641, rmtPort=48641] [21:02:12] : [Step 4/5] [2021-11-19 21:02:12,663][INFO ][tcp-disco-sock-reader-[0bcd3ba0 127.0.0.1:48641]-#123%marshaller.GridMarshallerMappingConsistencyTest2%-#2313%marshaller.GridMarshallerMappingConsistencyTest2%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=0bcd3ba0-9d78-447c-910a-834571b00001, rmtAddr=/127.0.0.1:48641] [21:02:12] : [Step 4/5] [2021-11-19 21:02:12,668][INFO ][tcp-disco-msg-worker-[]-#119%marshaller.GridMarshallerMappingConsistencyTest2%-#2309%marshaller.GridMarshallerMappingConsistencyTest2%][TestTcpDiscoverySpi] New next node [newNext=TcpDiscoveryNode [id=0bcd3ba0-9d78-447c-910a-834571b00001, consistentId=marshaller.GridMarshallerMappingConsistencyTest1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637344932659, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false]] [21:02:12] : [Step 4/5] [2021-11-19 21:02:12,669][INFO ][tcp-disco-srvr-[:47500]-#115%marshaller.GridMarshallerMappingConsistencyTest1%-#2191%marshaller.GridMarshallerMappingConsistencyTest1%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=51543] [21:02:12] : [Step 4/5] [2021-11-19 21:02:12,670][INFO ][tcp-disco-srvr-[:47500]-#115%marshaller.GridMarshallerMappingConsistencyTest1%-#2191%marshaller.GridMarshallerMappingConsistencyTest1%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=51543] [21:02:12] : [Step 4/5] [2021-11-19 21:02:12,671][INFO ][tcp-disco-sock-reader-[]-#124%marshaller.GridMarshallerMappingConsistencyTest1%-#2314%marshaller.GridMarshallerMappingConsistencyTest1%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:51543, rmtPort=51543] [21:02:12] : [Step 4/5] [2021-11-19 21:02:12,675][INFO ][tcp-disco-sock-reader-[e490e76d 127.0.0.1:51543]-#124%marshaller.GridMarshallerMappingConsistencyTest1%-#2314%marshaller.GridMarshallerMappingConsistencyTest1%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=e490e76d-6b6e-44b7-a9bf-1e4f44700002, rmtAddr=/127.0.0.1:51543] [21:02:12] : [Step 4/5] [2021-11-19 21:02:12,677][INFO ][disco-event-worker-#2193%marshaller.GridMarshallerMappingConsistencyTest1%][GridDiscoveryManager] Added new node to topology: TcpDiscoveryNode [id=e490e76d-6b6e-44b7-a9bf-1e4f44700002, consistentId=marshaller.GridMarshallerMappingConsistencyTest2, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637344932628, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false] [21:02:12] : [Step 4/5] [2021-11-19 21:02:12,679][INFO ][disco-event-worker-#2193%marshaller.GridMarshallerMappingConsistencyTest1%][GridDiscoveryManager] Topology snapshot [ver=2, locNode=0bcd3ba0, servers=2, clients=0, state=INACTIVE, CPUs=24, offheap=0.25GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=0bcd3ba0-9d78-447c-910a-834571b00001, consistentId=marshaller.GridMarshallerMappingConsistencyTest1, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=e490e76d-6b6e-44b7-a9bf-1e4f44700002, consistentId=marshaller.GridMarshallerMappingConsistencyTest2, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:02:12] : [Step 4/5] [2021-11-19 21:02:12,680][INFO ][disco-event-worker-#2193%marshaller.GridMarshallerMappingConsistencyTest1%][GridDiscoveryManager] ^-- Baseline [id=0, size=2, online=2, offline=0] [21:02:12] : [Step 4/5] [2021-11-19 21:02:12,681][INFO ][disco-event-worker-#2193%marshaller.GridMarshallerMappingConsistencyTest1%][GridDiscoveryManager] ^-- All baseline nodes are online, will start auto-activation [21:02:12] : [Step 4/5] [2021-11-19 21:02:12,688][INFO ][disco-notifier-worker-#2308%marshaller.GridMarshallerMappingConsistencyTest2%][MvccProcessorImpl] Assigned mvcc coordinator [crd=MvccCoordinator [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=0], nodeId=0bcd3ba0-9d78-447c-910a-834571b00001, ver=1637344931479, local=false, initialized=false]] [21:02:12] : [Step 4/5] [2021-11-19 21:02:12,690][INFO ][disco-notifier-worker-#2308%marshaller.GridMarshallerMappingConsistencyTest2%][GridClusterStateProcessor] Sending activate cluster request with BaselineTopology BaselineTopology [id=0, branchingHash=-4276398781, branchingType='Cluster activation', baselineNodes=[marshaller.GridMarshallerMappingConsistencyTest1, marshaller.GridMarshallerMappingConsistencyTest2]] [21:02:12] : [Step 4/5] [2021-11-19 21:02:12,700][INFO ][sys-#2300%marshaller.GridMarshallerMappingConsistencyTest2%][ClusterProcessor] Writing cluster ID and tag to metastorage on ready for write ClusterIdAndTag [id=34c655b9-4134-491f-9fcb-73e726dd8bbc, tag=stupefied_chaplygin] [21:02:12] : [Step 4/5] [2021-11-19 21:02:12,703][INFO ][disco-notifier-worker-#2189%marshaller.GridMarshallerMappingConsistencyTest1%][GridClusterStateProcessor] Received activate cluster request with BaselineTopology[id=0] initiator node ID: e490e76d-6b6e-44b7-a9bf-1e4f44700002 [21:02:12] : [Step 4/5] [2021-11-19 21:02:12,703][INFO ][disco-notifier-worker-#2189%marshaller.GridMarshallerMappingConsistencyTest1%][GridClusterStateProcessor] Started state transition: activate cluster [21:02:12] : [Step 4/5] [2021-11-19 21:02:12,704][INFO ][exchange-worker-#2194%marshaller.GridMarshallerMappingConsistencyTest1%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], crd=true, evt=DISCOVERY_CUSTOM_EVT, evtNode=e490e76d-6b6e-44b7-a9bf-1e4f44700002, customEvt=ChangeGlobalStateMessage [id=886ac593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqId=baaca596-b98d-4b1b-88a2-06dde2e1806a, initiatingNodeId=e490e76d-6b6e-44b7-a9bf-1e4f44700002, state=ACTIVE, baselineTopology=BaselineTopology [id=0, branchingHash=-4276398781, branchingType='Cluster activation', baselineNodes=[marshaller.GridMarshallerMappingConsistencyTest1, marshaller.GridMarshallerMappingConsistencyTest2]], forceChangeBaselineTopology=false, timestamp=1637344932690, forceDeactivation=true], allowMerge=false, exchangeFreeSwitch=false] [21:02:12] : [Step 4/5] [2021-11-19 21:02:12,706][INFO ][exchange-worker-#2194%marshaller.GridMarshallerMappingConsistencyTest1%][GridDhtPartitionsExchangeFuture] Start activation process [nodeId=0bcd3ba0-9d78-447c-910a-834571b00001, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]]. New state: ACTIVE [21:02:12] : [Step 4/5] [2021-11-19 21:02:12,706][INFO ][exchange-worker-#2194%marshaller.GridMarshallerMappingConsistencyTest1%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/test/marshaller.GridMarshallerMappingConsistencyTest1/db/marshaller_GridMarshallerMappingConsistencyTest1 [21:02:12] : [Step 4/5] [2021-11-19 21:02:12,704][INFO ][disco-notifier-worker-#2308%marshaller.GridMarshallerMappingConsistencyTest2%][GridClusterStateProcessor] Received activate cluster request with BaselineTopology[id=0] initiator node ID: e490e76d-6b6e-44b7-a9bf-1e4f44700002 [21:02:12] : [Step 4/5] [2021-11-19 21:02:12,708][INFO ][disco-notifier-worker-#2308%marshaller.GridMarshallerMappingConsistencyTest2%][GridClusterStateProcessor] Started state transition: activate cluster [21:02:12] : [Step 4/5] [2021-11-19 21:02:12,711][INFO ][exchange-worker-#2194%marshaller.GridMarshallerMappingConsistencyTest1%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/test/marshaller.GridMarshallerMappingConsistencyTest1/db/wal/marshaller_GridMarshallerMappingConsistencyTest1/0000000000000000.wal, offset=154349, ver=2] [21:02:12] : [Step 4/5] [2021-11-19 21:02:12,713][INFO ][exchange-worker-#2194%marshaller.GridMarshallerMappingConsistencyTest1%][GridClusterStateProcessor] Writing BaselineTopology[id=0] [21:02:12] : [Step 4/5] [2021-11-19 21:02:12,725][INFO ][exchange-worker-#2320%marshaller.GridMarshallerMappingConsistencyTest2%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], crd=false, evt=DISCOVERY_CUSTOM_EVT, evtNode=e490e76d-6b6e-44b7-a9bf-1e4f44700002, customEvt=ChangeGlobalStateMessage [id=886ac593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqId=baaca596-b98d-4b1b-88a2-06dde2e1806a, initiatingNodeId=e490e76d-6b6e-44b7-a9bf-1e4f44700002, state=ACTIVE, baselineTopology=BaselineTopology [id=0, branchingHash=-4276398781, branchingType='Cluster activation', baselineNodes=[marshaller.GridMarshallerMappingConsistencyTest1, marshaller.GridMarshallerMappingConsistencyTest2]], forceChangeBaselineTopology=false, timestamp=1637344932690, forceDeactivation=true], allowMerge=false, exchangeFreeSwitch=false] [21:02:12] : [Step 4/5] [2021-11-19 21:02:12,731][INFO ][exchange-worker-#2194%marshaller.GridMarshallerMappingConsistencyTest1%][GridCacheDatabaseSharedManager] Finish recovery performed in 24 ms. [21:02:12] : [Step 4/5] [2021-11-19 21:02:12,733][INFO ][exchange-worker-#2320%marshaller.GridMarshallerMappingConsistencyTest2%][GridDhtPartitionsExchangeFuture] Start activation process [nodeId=e490e76d-6b6e-44b7-a9bf-1e4f44700002, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]]. New state: ACTIVE [21:02:12] : [Step 4/5] [2021-11-19 21:02:12,735][INFO ][exchange-worker-#2194%marshaller.GridMarshallerMappingConsistencyTest1%][msg] Components activation performed in 29 ms. [21:02:12] : [Step 4/5] [2021-11-19 21:02:12,735][INFO ][exchange-worker-#2320%marshaller.GridMarshallerMappingConsistencyTest2%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/test/marshaller.GridMarshallerMappingConsistencyTest2/db/marshaller_GridMarshallerMappingConsistencyTest2 [21:02:12] : [Step 4/5] [2021-11-19 21:02:12,736][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][GridMarshallerMappingConsistencyTest2] To start Console Management & Monitoring run ignitevisorcmd.{sh|bat} [21:02:12] : [Step 4/5] [2021-11-19 21:02:12,739][INFO ][sys-#2172%marshaller.GridMarshallerMappingConsistencyTest1%][GridCacheProcessor] Finished recovery for cache [cache=ignite-sys-cache, grp=ignite-sys-cache, startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:02:12] : [Step 4/5] [2021-11-19 21:02:12,739][INFO ][exchange-worker-#2320%marshaller.GridMarshallerMappingConsistencyTest2%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/test/marshaller.GridMarshallerMappingConsistencyTest2/db/wal/marshaller_GridMarshallerMappingConsistencyTest2/0000000000000000.wal, offset=88533, ver=2] [21:02:12] : [Step 4/5] [2021-11-19 21:02:12,739][INFO ][exchange-worker-#2194%marshaller.GridMarshallerMappingConsistencyTest1%][GridCacheProcessor] Finished recovery for cache [cache=cache, grp=cache, startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:02:12] : [Step 4/5] [2021-11-19 21:02:12,739][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][GridMarshallerMappingConsistencyTest2] [21:02:12] : [Step 4/5] [21:02:12] : [Step 4/5] >>> +-------------------------------------------+ [21:02:12] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:02:12] : [Step 4/5] >>> +-------------------------------------------+ [21:02:12] : [Step 4/5] >>> OS name: Linux 4.15.0-151-generic amd64 [21:02:12] : [Step 4/5] >>> CPU(s): 24 [21:02:12] : [Step 4/5] >>> Heap: 2.0GB [21:02:12] : [Step 4/5] >>> VM name: 16724@c4dfe9a430b2 [21:02:12] : [Step 4/5] >>> Ignite instance name: marshaller.GridMarshallerMappingConsistencyTest2 [21:02:12] : [Step 4/5] >>> Local node [ID=E490E76D-6B6E-44B7-A9BF-1E4F44700002, order=2, clientMode=false] [21:02:12] : [Step 4/5] >>> Local node addresses: [127.0.0.1] [21:02:12] : [Step 4/5] >>> Local ports: TCP:10801 TCP:45031 TCP:47501 [21:02:12] : [Step 4/5] [21:02:12] : [Step 4/5] [2021-11-19 21:02:12,741][INFO ][exchange-worker-#2320%marshaller.GridMarshallerMappingConsistencyTest2%][GridClusterStateProcessor] Writing BaselineTopology[id=0] [21:02:12] : [Step 4/5] [2021-11-19 21:02:12,743][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][GridDiscoveryManager] Topology snapshot [ver=2, locNode=e490e76d, servers=2, clients=0, state=INACTIVE, CPUs=24, offheap=0.25GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=0bcd3ba0-9d78-447c-910a-834571b00001, consistentId=marshaller.GridMarshallerMappingConsistencyTest1, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=e490e76d-6b6e-44b7-a9bf-1e4f44700002, consistentId=marshaller.GridMarshallerMappingConsistencyTest2, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:02:12] : [Step 4/5] [2021-11-19 21:02:12,745][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][GridDiscoveryManager] ^-- Baseline [id=0, size=2, online=2, offline=0] [21:02:12] : [Step 4/5] [2021-11-19 21:02:12,746][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][GridDiscoveryManager] ^-- All baseline nodes are online, will start auto-activation [21:02:12] : [Step 4/5] [2021-11-19 21:02:12,747][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][G] Node started : [stage="Configure system pool" (0 ms),stage="Start managers" (76 ms),stage="Configure binary metadata" (3 ms),stage="Start processors" (22 ms),stage="Start 'StanByClusterTestProvider' plugin" (0 ms),stage="Start 'PageMemory tracker plugin' plugin" (0 ms),stage="Start 'TestDistibutedConfigurationPlugin' plugin" (0 ms),stage="Start 'NodeValidationPluginProvider' plugin" (0 ms),stage="Init metastore" (268 ms),stage="Init and start regions" (10 ms),stage="Restore binary memory" (171 ms),stage="Restore logical state" (113 ms),stage="Finish recovery" (413 ms),stage="Join topology" (75 ms),stage="Await transition" (7 ms),stage="Await exchange" (50 ms),stage="Total time" (1208 ms)] [21:02:12] : [Step 4/5] [2021-11-19 21:02:12,748][INFO ][test-runner-#1804%marshaller.GridMarshallerMappingConsistencyTest%][root] Node started with the following configuration [id=e490e76d-6b6e-44b7-a9bf-1e4f44700002, marshaller=BinaryMarshaller [], discovery=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=5000, ackTimeout=5000, marsh=JdkMarshaller [clsFilter=org.apache.ignite.marshaller.MarshallerUtils$1@56075b01], reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], binaryCfg=null, lateAff=true] [21:02:12] : [Step 4/5] [2021-11-19 21:02:12,749][INFO ][exchange-worker-#2320%marshaller.GridMarshallerMappingConsistencyTest2%][GridCacheDatabaseSharedManager] Finish recovery performed in 12 ms. [21:02:12] : [Step 4/5] [2021-11-19 21:02:12,752][INFO ][exchange-worker-#2320%marshaller.GridMarshallerMappingConsistencyTest2%][msg] Components activation performed in 17 ms. [21:02:12] : [Step 4/5] [2021-11-19 21:02:12,753][INFO ][exchange-worker-#2194%marshaller.GridMarshallerMappingConsistencyTest1%][GridDhtPartitionsExchangeFuture] Successfully activated caches [nodeId=0bcd3ba0-9d78-447c-910a-834571b00001, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], newState=ACTIVE] [21:02:12] : [Step 4/5] [2021-11-19 21:02:12,760][INFO ][exchange-worker-#2194%marshaller.GridMarshallerMappingConsistencyTest1%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:02:12] : [Step 4/5] [2021-11-19 21:02:12,764][INFO ][sys-#2285%marshaller.GridMarshallerMappingConsistencyTest2%][PageMemoryImpl] Started page memory [memoryAllocated=256.0 MiB, pages=63504, tableSize=4.9 MiB, replacementSize=7.9 KiB, checkpointBuffer=256.0 MiB] [21:02:12] : [Step 4/5] [2021-11-19 21:02:12,789][INFO ][exchange-worker-#2194%marshaller.GridMarshallerMappingConsistencyTest1%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], crd=true] [21:02:12] : [Step 4/5] [2021-11-19 21:02:12,791][INFO ][db-checkpoint-thread-#2328%marshaller.GridMarshallerMappingConsistencyTest1%][Checkpointer] Checkpoint started [checkpointId=e0cdc529-a8f1-42a4-b3c4-00083e475c9d, startPtr=WALPointer [idx=0, fileOff=241753, len=12001], checkpointBeforeLockTime=19ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=2ms, checkpointLockHoldTime=5ms, walCpRecordFsyncDuration=1ms, writeCheckpointEntryDuration=2ms, splitAndSortCpPagesDuration=1ms, pages=16, reason='node started'] [21:02:12] : [Step 4/5] [2021-11-19 21:02:12,810][INFO ][db-checkpoint-thread-#2328%marshaller.GridMarshallerMappingConsistencyTest1%][Checkpointer] Checkpoint finished [cpId=e0cdc529-a8f1-42a4-b3c4-00083e475c9d, pages=16, markPos=WALPointer [idx=0, fileOff=241753, len=12001], walSegmentsCovered=[], markDuration=10ms, pagesWrite=3ms, fsync=15ms, total=47ms] [21:02:12] : [Step 4/5] [2021-11-19 21:02:12,880][INFO ][exchange-worker-#2320%marshaller.GridMarshallerMappingConsistencyTest2%][GridCacheProcessor] Started cache [name=cache, id=94416770, dataRegionName=default, mode=PARTITIONED, atomicity=ATOMIC, backups=0, mvcc=false] [21:02:12] : [Step 4/5] [2021-11-19 21:02:12,881][INFO ][sys-#2284%marshaller.GridMarshallerMappingConsistencyTest2%][GridCacheProcessor] Finished recovery for cache [cache=ignite-sys-cache, grp=ignite-sys-cache, startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:02:12] : [Step 4/5] [2021-11-19 21:02:12,886][INFO ][exchange-worker-#2320%marshaller.GridMarshallerMappingConsistencyTest2%][GridDhtPartitionsExchangeFuture] Successfully activated caches [nodeId=e490e76d-6b6e-44b7-a9bf-1e4f44700002, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], newState=ACTIVE] [21:02:12] : [Step 4/5] [2021-11-19 21:02:12,887][INFO ][exchange-worker-#2320%marshaller.GridMarshallerMappingConsistencyTest2%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:02:12] : [Step 4/5] [2021-11-19 21:02:12,974][INFO ][grid-nio-worker-tcp-comm-0-#2131%TcpCommunicationSpi%][TcpCommunicationSpi] Accepted incoming communication connection [locAddr=/127.0.0.1:45030, rmtAddr=/127.0.0.1:42074] [21:02:12] : [Step 4/5] [2021-11-19 21:02:12,980][INFO ][grid-nio-worker-tcp-comm-0-#2251%TcpCommunicationSpi%][TcpCommunicationSpi] Established outgoing communication connection [locAddr=/127.0.0.1:42074, rmtAddr=/127.0.0.1:45030] [21:02:12] : [Step 4/5] [2021-11-19 21:02:12,980][INFO ][exchange-worker-#2320%marshaller.GridMarshallerMappingConsistencyTest2%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], crd=false] [21:02:12] : [Step 4/5] [2021-11-19 21:02:12,983][INFO ][sys-#2168%marshaller.GridMarshallerMappingConsistencyTest1%][GridDhtPartitionsExchangeFuture] Coordinator received single message [ver=AffinityTopologyVersion [topVer=2, minorTopVer=1], node=e490e76d-6b6e-44b7-a9bf-1e4f44700002, allReceived=true] [21:02:12] : [Step 4/5] [2021-11-19 21:02:12,984][INFO ][sys-#2168%marshaller.GridMarshallerMappingConsistencyTest1%][GridDhtPartitionsExchangeFuture] finishExchangeOnCoordinator [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:02:13] : [Step 4/5] [2021-11-19 21:02:13,004][INFO ][sys-#2292%marshaller.GridMarshallerMappingConsistencyTest2%][GridDhtPartitionsExchangeFuture] Received full message, will finish exchange [node=0bcd3ba0-9d78-447c-910a-834571b00001, resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:02:13] : [Step 4/5] [2021-11-19 21:02:13,004][INFO ][sys-#2168%marshaller.GridMarshallerMappingConsistencyTest1%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], err=null, rebalanced=true, wasRebalanced=false] [21:02:13] : [Step 4/5] [2021-11-19 21:02:13,005][INFO ][disco-notifier-worker-#2308%marshaller.GridMarshallerMappingConsistencyTest2%][GridClusterStateProcessor] Received state change finish message: ACTIVE [21:02:13] : [Step 4/5] [2021-11-19 21:02:13,006][INFO ][disco-notifier-worker-#2308%marshaller.GridMarshallerMappingConsistencyTest2%][GridClusterStateProcessor] Cluster state was changed from INACTIVE to ACTIVE [21:02:13] : [Step 4/5] [2021-11-19 21:02:13,008][INFO ][disco-notifier-worker-#2189%marshaller.GridMarshallerMappingConsistencyTest1%][GridClusterStateProcessor] Received state change finish message: ACTIVE [21:02:13] : [Step 4/5] [2021-11-19 21:02:13,008][INFO ][disco-notifier-worker-#2189%marshaller.GridMarshallerMappingConsistencyTest1%][GridClusterStateProcessor] Cluster state was changed from INACTIVE to ACTIVE [21:02:13] : [Step 4/5] [2021-11-19 21:02:13,011][INFO ][sys-#2292%marshaller.GridMarshallerMappingConsistencyTest2%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], err=null, rebalanced=true, wasRebalanced=false] [21:02:13] : [Step 4/5] [2021-11-19 21:02:13,019][INFO ][sys-#2292%marshaller.GridMarshallerMappingConsistencyTest2%][GridCacheProcessor] Finish proxy initialization, cacheName=cache, localNodeId=e490e76d-6b6e-44b7-a9bf-1e4f44700002 [21:02:13] : [Step 4/5] [2021-11-19 21:02:13,019][INFO ][sys-#2292%marshaller.GridMarshallerMappingConsistencyTest2%][GridCacheProcessor] Finish proxy initialization, cacheName=ignite-sys-cache, localNodeId=e490e76d-6b6e-44b7-a9bf-1e4f44700002 [21:02:13] : [Step 4/5] [2021-11-19 21:02:13,020][INFO ][sys-#2300%marshaller.GridMarshallerMappingConsistencyTest2%][DistributedBaselineConfiguration] Baseline auto-adjust is 'disabled' with timeout='300000' ms [21:02:13] : [Step 4/5] [2021-11-19 21:02:13,021][INFO ][sys-#2300%marshaller.GridMarshallerMappingConsistencyTest2%][GridClusterStateProcessor] Successfully performed final activation steps [nodeId=e490e76d-6b6e-44b7-a9bf-1e4f44700002, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:02:13] : [Step 4/5] [2021-11-19 21:02:13,020][INFO ][sys-#2292%marshaller.GridMarshallerMappingConsistencyTest2%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=e490e76d-6b6e-44b7-a9bf-1e4f44700002, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=e490e76d-6b6e-44b7-a9bf-1e4f44700002, consistentId=marshaller.GridMarshallerMappingConsistencyTest2, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637344933000, loc=true, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:02:13] : [Step 4/5] [2021-11-19 21:02:13,022][INFO ][exchange-worker-#2320%marshaller.GridMarshallerMappingConsistencyTest2%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=2, minorTopVer=1], force=false, evt=DISCOVERY_CUSTOM_EVT, node=e490e76d-6b6e-44b7-a9bf-1e4f44700002] [21:02:13] : [Step 4/5] [2021-11-19 21:02:13,023][INFO ][sys-#2292%marshaller.GridMarshallerMappingConsistencyTest2%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], stage="Waiting in exchange queue" (5 ms), stage="Exchange parameters initialization" (16 ms), stage="Update caches registry" (20 ms), stage="Start caches" (127 ms), stage="Affinity initialization on cache group start" (4 ms), stage="Determine exchange type" (1 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Restore partition states" (28 ms), stage="After states restored callback" (54 ms), stage="WAL history reservation" (0 ms), stage="Waiting for Full message" (32 ms), stage="Affinity recalculation" (1 ms), stage="Full map updating" (5 ms), stage="Detect lost partitions" (4 ms), stage="Exchange done" (6 ms), stage="Total time" (303 ms)] [21:02:13] : [Step 4/5] [2021-11-19 21:02:13,025][INFO ][sys-#2292%marshaller.GridMarshallerMappingConsistencyTest2%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], stage="Affinity initialization on cache group start [grp=cache]" (4 ms) (parent=Affinity initialization on cache group start), stage="Affinity initialization on cache group start [grp=ignite-sys-cache]" (0 ms) (parent=Affinity initialization on cache group start), stage="Affinity centralized initialization (crd) [grp=ignite-sys-cache, crd=false]" (0 ms) (parent=Determine exchange type), stage="Affinity centralized initialization (crd) [grp=cache, crd=false]" (0 ms) (parent=Determine exchange type), stage="Restore partition states [grp=cache]" (28 ms) (parent=Restore partition states), stage="Restore partition states [grp=ignite-sys-cache]" (0 ms) (parent=Restore partition states), stage="Affinity applying from full message [grp=ignite-sys-cache]" (1 ms) (parent=Affinity recalculation), stage="Affinity applying from full message [grp=cache]" (1 ms) (parent=Affinity recalculation)] [21:02:13] : [Step 4/5] [2021-11-19 21:02:13,031][INFO ][sys-#2168%marshaller.GridMarshallerMappingConsistencyTest1%][GridCacheProcessor] Finish proxy initialization, cacheName=cache, localNodeId=0bcd3ba0-9d78-447c-910a-834571b00001 [21:02:13] : [Step 4/5] [2021-11-19 21:02:13,032][INFO ][sys-#2168%marshaller.GridMarshallerMappingConsistencyTest1%][GridCacheProcessor] Finish proxy initialization, cacheName=ignite-sys-cache, localNodeId=0bcd3ba0-9d78-447c-910a-834571b00001 [21:02:13] : [Step 4/5] [2021-11-19 21:02:13,033][INFO ][sys-#2183%marshaller.GridMarshallerMappingConsistencyTest1%][DistributedBaselineConfiguration] Baseline auto-adjust is 'disabled' with timeout='300000' ms [21:02:13] : [Step 4/5] [2021-11-19 21:02:13,034][INFO ][sys-#2183%marshaller.GridMarshallerMappingConsistencyTest1%][GridClusterStateProcessor] Successfully performed final activation steps [nodeId=0bcd3ba0-9d78-447c-910a-834571b00001, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:02:13] : [Step 4/5] [2021-11-19 21:02:13,036][INFO ][exchange-worker-#2194%marshaller.GridMarshallerMappingConsistencyTest1%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=2, minorTopVer=1], force=false, evt=DISCOVERY_CUSTOM_EVT, node=e490e76d-6b6e-44b7-a9bf-1e4f44700002] [21:02:13] : [Step 4/5] [2021-11-19 21:02:13,037][INFO ][sys-#2168%marshaller.GridMarshallerMappingConsistencyTest1%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=0bcd3ba0-9d78-447c-910a-834571b00001, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=e490e76d-6b6e-44b7-a9bf-1e4f44700002, consistentId=marshaller.GridMarshallerMappingConsistencyTest2, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637344932628, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:02:13] : [Step 4/5] [2021-11-19 21:02:13,039][INFO ][sys-#2168%marshaller.GridMarshallerMappingConsistencyTest1%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (1 ms), stage="Update caches registry" (30 ms), stage="Start caches" (5 ms), stage="Affinity initialization on cache group start" (11 ms), stage="Determine exchange type" (7 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Restore partition states" (0 ms), stage="After states restored callback" (25 ms), stage="WAL history reservation" (1 ms), stage="Waiting for all single messages" (194 ms), stage="Affinity recalculation (crd)" (0 ms), stage="Collect update counters and create affinity messages" (0 ms), stage="Assign partitions states" (4 ms), stage="Validate partitions states" (0 ms), stage="Ideal affinity diff calculation (enforced)" (4 ms), stage="Apply update counters" (0 ms), stage="Full message preparing" (6 ms), stage="Full message sending" (0 ms), stage="State finish message sending" (3 ms), stage="Detect lost partitions" (22 ms), stage="Exchange done" (11 ms), stage="Total time" (324 ms), Discovery lag=7 ms, Latest started node id=e490e76d-6b6e-44b7-a9bf-1e4f44700002] [21:02:13] : [Step 4/5] [2021-11-19 21:02:13,041][INFO ][sys-#2168%marshaller.GridMarshallerMappingConsistencyTest1%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], stage="Affinity initialization on cache group start [grp=cache]" (9 ms) (parent=Affinity initialization on cache group start), stage="Affinity initialization on cache group start [grp=ignite-sys-cache]" (1 ms) (parent=Affinity initialization on cache group start), stage="Affinity centralized initialization (crd) [grp=ignite-sys-cache, crd=true]" (0 ms) (parent=Determine exchange type), stage="Affinity centralized initialization (crd) [grp=cache, crd=true]" (0 ms) (parent=Determine exchange type), stage="Restore partition states [grp=ignite-sys-cache]" (0 ms) (parent=Restore partition states), stage="Restore partition states [grp=cache]" (0 ms) (parent=Restore partition states), stage="Affinity recalculation (partitions availability) [grp=cache]" (4 ms) (parent=Ideal affinity diff calculation (enforced)), stage="Affinity recalculation (partitions availability) [grp=ignite-sys-cache]" (0 ms) (parent=Ideal affinity diff calculation (enforced))] [21:02:13] : [Step 4/5] [21:02:13] >>> Stopping test: GridMarshallerMappingConsistencyTest#testPersistedMappingsSharedOnJoin in 8010 ms <<< [21:02:13] : [Step 4/5] [2021-11-19 21:02:13,066][INFO ][main][root] >>> Stopping test: GridMarshallerMappingConsistencyTest#testPersistedMappingsSharedOnJoin in 8010 ms <<< [21:02:13] : [Step 4/5] [21:02:13] >>> Heap: 548 MB used / 1945 MB commited / 1945 MB max <<< [21:02:13] : [Step 4/5] [2021-11-19 21:02:13,067][INFO ][main][root] >>> Heap: 548 MB used / 1945 MB commited / 1945 MB max <<< [21:02:13] : [Step 4/5] [21:02:13] >>> Non-Heap: 114 MB used / 120 MB commited / 0 MB max <<< [21:02:13] : [Step 4/5] [2021-11-19 21:02:13,067][INFO ][main][root] >>> Non-Heap: 114 MB used / 120 MB commited / 0 MB max <<< [21:02:13] : [Step 4/5] [2021-11-19 21:02:13,068][INFO ][main][root] >>> Stopping grid [name=marshaller.GridMarshallerMappingConsistencyTest1, id=0bcd3ba0-9d78-447c-910a-834571b00001] [21:02:13] : [Step 4/5] [2021-11-19 21:02:13,094][INFO ][db-checkpoint-thread-#2328%marshaller.GridMarshallerMappingConsistencyTest1%][Checkpointer] Skipping checkpoint (no pages were modified) [checkpointBeforeLockTime=6ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=2ms, checkpointLockHoldTime=5ms, reason='timeout'] [21:02:13] : [Step 4/5] [2021-11-19 21:02:13,102][INFO ][tcp-disco-sock-reader-[e490e76d 127.0.0.1:51543]-#124%marshaller.GridMarshallerMappingConsistencyTest1%-#2314%marshaller.GridMarshallerMappingConsistencyTest1%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:51543, rmtPort=51543, rmtNodeId=e490e76d-6b6e-44b7-a9bf-1e4f44700002] [21:02:13] : [Step 4/5] [2021-11-19 21:02:13,102][INFO ][disco-event-worker-#2316%marshaller.GridMarshallerMappingConsistencyTest2%][GridDiscoveryManager] Node left topology: TcpDiscoveryNode [id=0bcd3ba0-9d78-447c-910a-834571b00001, consistentId=marshaller.GridMarshallerMappingConsistencyTest1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637344932659, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false] [21:02:13] : [Step 4/5] [2021-11-19 21:02:13,106][INFO ][disco-event-worker-#2316%marshaller.GridMarshallerMappingConsistencyTest2%][GridDiscoveryManager] Topology snapshot [ver=3, locNode=e490e76d, servers=1, clients=0, state=ACTIVE, CPUs=24, offheap=0.25GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=e490e76d-6b6e-44b7-a9bf-1e4f44700002, consistentId=marshaller.GridMarshallerMappingConsistencyTest2, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:02:13] : [Step 4/5] [2021-11-19 21:02:13,107][INFO ][disco-event-worker-#2316%marshaller.GridMarshallerMappingConsistencyTest2%][GridDiscoveryManager] Coordinator changed [prev=TcpDiscoveryNode [id=0bcd3ba0-9d78-447c-910a-834571b00001, consistentId=marshaller.GridMarshallerMappingConsistencyTest1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637344932659, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], cur=TcpDiscoveryNode [id=e490e76d-6b6e-44b7-a9bf-1e4f44700002, consistentId=marshaller.GridMarshallerMappingConsistencyTest2, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637344933101, loc=true, ver=2.13.0#20211119-sha1:00000000, isClient=false]] [21:02:13] : [Step 4/5] [2021-11-19 21:02:13,108][INFO ][disco-event-worker-#2316%marshaller.GridMarshallerMappingConsistencyTest2%][GridDiscoveryManager] ^-- Baseline [id=0, size=2, online=1, offline=1] [21:02:13] : [Step 4/5] [2021-11-19 21:02:13,109][INFO ][main][GridCacheProcessor] Stopped cache [cacheName=cache] [21:02:13] : [Step 4/5] [2021-11-19 21:02:13,109][INFO ][disco-event-worker-#2316%marshaller.GridMarshallerMappingConsistencyTest2%][MvccProcessorImpl] Assigned mvcc coordinator [crd=MvccCoordinator [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], nodeId=e490e76d-6b6e-44b7-a9bf-1e4f44700002, ver=1637344931480, local=true, initialized=false]] [21:02:13] : [Step 4/5] [2021-11-19 21:02:13,109][INFO ][main][GridCacheProcessor] Stopped cache [cacheName=ignite-sys-cache] [21:02:13] : [Step 4/5] [2021-11-19 21:02:13,111][INFO ][sys-#2284%marshaller.GridMarshallerMappingConsistencyTest2%][ExchangeLatchManager] Become new coordinator e490e76d-6b6e-44b7-a9bf-1e4f44700002 [21:02:13] : [Step 4/5] [2021-11-19 21:02:13,124][INFO ][exchange-worker-#2320%marshaller.GridMarshallerMappingConsistencyTest2%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], crd=true, evt=NODE_LEFT, evtNode=0bcd3ba0-9d78-447c-910a-834571b00001, customEvt=null, allowMerge=false, exchangeFreeSwitch=true] [21:02:13] : [Step 4/5] [2021-11-19 21:02:13,128][INFO ][exchange-worker-#2320%marshaller.GridMarshallerMappingConsistencyTest2%][GridAffinityAssignmentCache] Local node affinity assignment distribution is not ideal [cache=cache, expectedPrimary=1024.00, actualPrimary=496, expectedBackups=0.00, actualBackups=0, warningThreshold=50.00%] [21:02:13] : [Step 4/5] [2021-11-19 21:02:13,132][INFO ][exchange-worker-#2320%marshaller.GridMarshallerMappingConsistencyTest2%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:02:13] : [Step 4/5] [2021-11-19 21:02:13,135][INFO ][exchange-worker-#2320%marshaller.GridMarshallerMappingConsistencyTest2%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], err=null, rebalanced=true, wasRebalanced=true] [21:02:13]W: [org.apache.ignite:ignite-core] [2021-11-19 21:02:13,139][WARN ][exchange-worker-#2320%marshaller.GridMarshallerMappingConsistencyTest2%][GridDhtPartitionTopologyImpl] Detected lost partitions [grp=cache, parts=[0-1, 4-6, 8, 10-11, 13, 25, 29, 31-35, 37-40, 42, 46-49, 51, 53, 55-56, 59-60, 62-66, 70, 72-74, 77, 80, 83-84, 86, 88-89, 92, 94-95, 97, 99, 101, 103, 105, 108-110, 113-114, 117-121, 123, 125, 130-131, 133, 138-139, 141, 143-145, 147-150, 152, 154-157, 159, 161-162, 164, 166, 169, 171-172, 178-181, 183, 188-189, 191-192, 194, 196-197, 201, 205-206, 208, 211, 214-215, 217-221, 223, 225-228, 232-234, 236, 238-240, 242, 244, 246-247, 252, 255, 259-261, 263-267, 271-273, 276-277, 280, 282, 284-285, 287-292, 294-295, 303-305, 307, 309, 312, 316, 318-322, 324-330, 333-334, 338, 345-346, 348, 351, 353-354, 363-365, 367-368, 371-373, 380, 382, 385, 387, 390, 392-393, 396-397, 399-402, 405, 407, 409-412, 414, 418, 420, 423-428, 430-433, 436-438, 440, 446, 448, 450, 453-454, 456-457, 459-460, 464-465, 468-469, 471-472, 475-476, 479, 486-488, 492, 497, 499-503, 505, 509, 513, 517, 519-520, 523, 525, 528, 530-532, 535-536, 539, 542, 544, 547-548, 550, 554, 557, 559-561, 564-565, 567, 571, 573, 575-576, 578, 580-584, 587-591, 593-596, 598, 602-604, 606-608, 610, 612, 614-618, 620, 622-624, 626, 628-630, 632-633, 637, 641-642, 647, 649, 651-652, 655-657, 662-663, 665-667, 670, 673, 676, 679-682, 685-686, 700, 702-705, 707, 709, 711, 716, 719, 721-724, 728-729, 731, 737-740, 745-746, 748-749, 751-752, 754, 763-765, 769, 771, 773, 776, 779-780, 782, 784, 790, 792, 794-796, 798-801, 803-805, 808-809, 811-813, 815-816, 820, 824-825, 827-830, 833, 835, 840, 842-843, 845, 848, 851-853, 855, 857-859, 866, 868, 874, 876-878, 880-881, 884, 887-888, 891-893, 895-899, 901-902, 906-909, 914, 917, 920-922, 924, 927-929, 931, 934, 936-937, 939-944, 946-948, 950-952, 954-964, 966-968, 974, 976-977, 981-984, 986-987, 989-991, 994-999, 1001-1003, 1005, 1008-1009, 1012, 1014, 1017, 1019, 1022-1023], topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0]] [21:02:13] : [Step 4/5] [2021-11-19 21:02:13,145][INFO ][exchange-worker-#2320%marshaller.GridMarshallerMappingConsistencyTest2%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=e490e76d-6b6e-44b7-a9bf-1e4f44700002, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], evt=NODE_LEFT, evtNode=TcpDiscoveryNode [id=0bcd3ba0-9d78-447c-910a-834571b00001, consistentId=marshaller.GridMarshallerMappingConsistencyTest1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637344932659, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0]] [21:02:13] : [Step 4/5] [2021-11-19 21:02:13,147][INFO ][exchange-worker-#2320%marshaller.GridMarshallerMappingConsistencyTest2%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (13 ms), stage="Determine exchange type" (7 ms), stage="Preloading notification" (0 ms), stage="After states restored callback" (0 ms), stage="WAL history reservation" (0 ms), stage="Finalize update counters" (0 ms), stage="Detect lost partitions" (8 ms), stage="Exchange done" (3 ms), stage="Total time" (31 ms)] [21:02:13] : [Step 4/5] [2021-11-19 21:02:13,148][INFO ][exchange-worker-#2320%marshaller.GridMarshallerMappingConsistencyTest2%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], stage="Affinity initialization (exchange-free switch on fully-rebalanced topology) [grp=cache]" (6 ms) (parent=Determine exchange type), stage="Affinity initialization (exchange-free switch on fully-rebalanced topology) [grp=ignite-sys-cache]" (0 ms) (parent=Determine exchange type)] [21:02:13] : [Step 4/5] [2021-11-19 21:02:13,150][INFO ][exchange-worker-#2320%marshaller.GridMarshallerMappingConsistencyTest2%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], crd=true] [21:02:13] : [Step 4/5] [2021-11-19 21:02:13,152][INFO ][exchange-worker-#2320%marshaller.GridMarshallerMappingConsistencyTest2%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=3, minorTopVer=0], force=false, evt=NODE_LEFT, node=0bcd3ba0-9d78-447c-910a-834571b00001] [21:02:13] : [Step 4/5] [2021-11-19 21:02:13,690][INFO ][main][FilePageStoreManager] Cleanup cache stores [total=4, left=0, cleanFiles=false] [21:02:13] : [Step 4/5] [2021-11-19 21:02:13,693][INFO ][main][GridDeploymentLocalStore] Removed undeployed class: GridDeployment [ts=1637344932980, depMode=SHARED, clsLdr=IsolatedClassLoader{roleName='test'}, clsLdrId=6b6ac593d71-0bcd3ba0-9d78-447c-910a-834571b00001, userVer=0, loc=true, sampleClsName=org.apache.ignite.internal.processors.cache.distributed.dht.preloader.GridDhtPartitionMap, pendingUndeploy=false, undeployed=true, usage=0] [21:02:13] : [Step 4/5] [2021-11-19 21:02:13,698][INFO ][db-checkpoint-thread-#2338%marshaller.GridMarshallerMappingConsistencyTest2%][Checkpointer] Checkpoint started [checkpointId=93bef4be-f6a9-42c3-8a0f-042964c2a1d1, startPtr=WALPointer [idx=0, fileOff=213895, len=11393], checkpointBeforeLockTime=4ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=2ms, checkpointLockHoldTime=6ms, walCpRecordFsyncDuration=717ms, writeCheckpointEntryDuration=10ms, splitAndSortCpPagesDuration=0ms, pages=20, reason='node started'] [21:02:13] : [Step 4/5] [2021-11-19 21:02:13,708][INFO ][main][GridMarshallerMappingConsistencyTest1] [21:02:13] : [Step 4/5] [21:02:13] : [Step 4/5] >>> +------------------------------------------------------+ [21:02:13] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV stopped OK [21:02:13] : [Step 4/5] >>> +------------------------------------------------------+ [21:02:13] : [Step 4/5] >>> Ignite instance name: marshaller.GridMarshallerMappingConsistencyTest1 [21:02:13] : [Step 4/5] >>> Grid uptime: 00:00:02.185 [21:02:13] : [Step 4/5] [21:02:13] : [Step 4/5] [21:02:13] : [Step 4/5] [2021-11-19 21:02:13,709][INFO ][main][root] >>> Stopping grid [name=marshaller.GridMarshallerMappingConsistencyTest2, id=e490e76d-6b6e-44b7-a9bf-1e4f44700002] [21:02:13] : [Step 4/5] [2021-11-19 21:02:13,727][INFO ][db-checkpoint-thread-#2338%marshaller.GridMarshallerMappingConsistencyTest2%][Checkpointer] Checkpoint finished [cpId=93bef4be-f6a9-42c3-8a0f-042964c2a1d1, pages=20, markPos=WALPointer [idx=0, fileOff=213895, len=11393], walSegmentsCovered=[], markDuration=736ms, pagesWrite=8ms, fsync=19ms, total=767ms] [21:02:13] : [Step 4/5] [2021-11-19 21:02:13,739][INFO ][tcp-disco-sock-reader-[0bcd3ba0 127.0.0.1:48641]-#123%marshaller.GridMarshallerMappingConsistencyTest2%-#2313%marshaller.GridMarshallerMappingConsistencyTest2%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:48641, rmtPort=48641, rmtNodeId=0bcd3ba0-9d78-447c-910a-834571b00001] [21:02:13] : [Step 4/5] [2021-11-19 21:02:13,741][INFO ][main][GridCacheProcessor] Stopped cache [cacheName=ignite-sys-cache] [21:02:13] : [Step 4/5] [2021-11-19 21:02:13,741][INFO ][main][GridCacheProcessor] Stopped cache [cacheName=cache] [21:02:14] : [Step 4/5] [2021-11-19 21:02:14,238][INFO ][main][FilePageStoreManager] Cleanup cache stores [total=4, left=0, cleanFiles=false] [21:02:14] : [Step 4/5] [2021-11-19 21:02:14,240][INFO ][main][GridDeploymentLocalStore] Removed undeployed class: GridDeployment [ts=1637344933000, depMode=SHARED, clsLdr=IsolatedClassLoader{roleName='test'}, clsLdrId=8b6ac593d71-e490e76d-6b6e-44b7-a9bf-1e4f44700002, userVer=0, loc=true, sampleClsName=org.apache.ignite.internal.processors.cache.distributed.dht.preloader.IgniteDhtPartitionHistorySuppliersMap, pendingUndeploy=false, undeployed=true, usage=0] [21:02:14] : [Step 4/5] [2021-11-19 21:02:14,247][INFO ][main][GridMarshallerMappingConsistencyTest2] [21:02:14] : [Step 4/5] [21:02:14] : [Step 4/5] >>> +------------------------------------------------------+ [21:02:14] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV stopped OK [21:02:14] : [Step 4/5] >>> +------------------------------------------------------+ [21:02:14] : [Step 4/5] >>> Ignite instance name: marshaller.GridMarshallerMappingConsistencyTest2 [21:02:14] : [Step 4/5] >>> Grid uptime: 00:00:01.516 [21:02:14] : [Step 4/5] [21:02:14] : [Step 4/5] [21:02:14] : [Step 4/5] [21:02:14] >>> Starting test: GridMarshallerMappingConsistencyTest#testMappingsPersistedOnJoin <<< [21:02:14] : [Step 4/5] [2021-11-19 21:02:14,452][INFO ][main][root] >>> Starting test: GridMarshallerMappingConsistencyTest#testMappingsPersistedOnJoin <<< [21:02:14] : [Step 4/5] [21:02:14] >>> Heap: 554 MB used / 1945 MB commited / 1945 MB max <<< [21:02:14] : [Step 4/5] [2021-11-19 21:02:14,453][INFO ][main][root] >>> Heap: 554 MB used / 1945 MB commited / 1945 MB max <<< [21:02:14] : [Step 4/5] [21:02:14] >>> Non-Heap: 114 MB used / 121 MB commited / 0 MB max <<< [21:02:14] : [Step 4/5] [2021-11-19 21:02:14,453][INFO ][main][root] >>> Non-Heap: 114 MB used / 121 MB commited / 0 MB max <<< [21:02:14] : [Step 4/5] [2021-11-19 21:02:14,462][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][GridMarshallerMappingConsistencyTest1] [21:02:14] : [Step 4/5] [21:02:14] : [Step 4/5] >>> __________ ________________ [21:02:14] : [Step 4/5] >>> / _/ ___/ |/ / _/_ __/ __/ [21:02:14] : [Step 4/5] >>> _/ // (7 7 // / / / / _/ [21:02:14] : [Step 4/5] >>> /___/\___/_/|_/___/ /_/ /___/ [21:02:14] : [Step 4/5] >>> [21:02:14] : [Step 4/5] >>> ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:02:14] : [Step 4/5] >>> 2021 Copyright(C) Apache Software Foundation [21:02:14] : [Step 4/5] >>> [21:02:14] : [Step 4/5] >>> Ignite documentation: http://ignite.apache.org [21:02:14] : [Step 4/5] [21:02:14] : [Step 4/5] [2021-11-19 21:02:14,463][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][GridMarshallerMappingConsistencyTest1] Config URL: n/a [21:02:14] : [Step 4/5] [2021-11-19 21:02:14,464][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][GridMarshallerMappingConsistencyTest1] IgniteConfiguration [igniteInstanceName=marshaller.GridMarshallerMappingConsistencyTest1, pubPoolSize=24, svcPoolSize=24, callbackPoolSize=24, stripedPoolSize=24, sysPoolSize=24, mgmtPoolSize=4, dataStreamerPoolSize=24, utilityCachePoolSize=24, utilityCacheKeepAliveTime=60000, p2pPoolSize=2, qryPoolSize=24, buildIdxPoolSize=4, igniteHome=/opt/buildagent/work/7bc1c54bc719b67c, igniteWorkDir=/opt/buildagent/work/7bc1c54bc719b67c/work/test/marshaller.GridMarshallerMappingConsistencyTest1, mbeanSrv=com.sun.jmx.mbeanserver.JmxMBeanServer@6fe85038, nodeId=96da3d10-9365-4ae3-9783-33321c700001, marsh=BinaryMarshaller [], marshLocJobs=false, daemon=false, p2pEnabled=true, netTimeout=10000, netCompressionLevel=1, sndRetryDelay=1000, sndRetryCnt=3, metricsHistSize=10000, metricsUpdateFreq=1000, metricsExpTime=9223372036854775807, discoSpi=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=0, ackTimeout=0, marsh=null, reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], segPlc=STOP, segResolveAttempts=2, waitForSegOnStart=true, allResolversPassReq=true, segChkFreq=10000, commSpi=TcpCommunicationSpi [connectGate=org.apache.ignite.spi.communication.tcp.internal.ConnectGateway@43ed14d9, ctxInitLatch=java.util.concurrent.CountDownLatch@4ecf27a3[Count = 1], stopping=false, clientPool=null, nioSrvWrapper=null, stateProvider=null], evtSpi=MemoryEventStorageSpi [expireAgeMs=9223372036854775807, expireCnt=10000, filter=null], colSpi=NoopCollisionSpi [], deploySpi=LocalDeploymentSpi [], indexingSpi=org.apache.ignite.spi.indexing.noop.NoopIndexingSpi@bec3e7, addrRslvr=null, encryptionSpi=org.apache.ignite.spi.encryption.noop.NoopEncryptionSpi@237bfd87, tracingSpi=org.apache.ignite.spi.tracing.NoopTracingSpi@63409ef6, clientMode=false, rebalanceThreadPoolSize=4, rebalanceTimeout=10000, rebalanceBatchesPrefetchCnt=3, rebalanceThrottle=0, rebalanceBatchSize=524288, txCfg=TransactionConfiguration [txSerEnabled=false, dfltIsolation=REPEATABLE_READ, dfltConcurrency=PESSIMISTIC, dfltTxTimeout=0, txTimeoutOnPartitionMapExchange=0, deadlockTimeout=10000, pessimisticTxLogSize=0, pessimisticTxLogLinger=10000, tmLookupClsName=null, txManagerFactory=null, useJtaSync=false], cacheSanityCheckEnabled=true, discoStartupDelay=60000, deployMode=SHARED, p2pMissedCacheSize=100, locHost=127.0.0.1, timeSrvPortBase=31100, timeSrvPortRange=100, failureDetectionTimeout=10000, sysWorkerBlockedTimeout=null, clientFailureDetectionTimeout=10000, metricsLogFreq=0, connectorCfg=null, odbcCfg=null, warmupClos=null, atomicCfg=AtomicConfiguration [seqReserveSize=1000, cacheMode=PARTITIONED, backups=1, aff=null, grpName=null], classLdr=null, sslCtxFactory=null, platformCfg=null, binaryCfg=null, memCfg=null, pstCfg=null, dsCfg=DataStorageConfiguration [sysRegionInitSize=41943040, sysRegionMaxSize=104857600, pageSize=0, concLvl=0, dfltDataRegConf=DataRegionConfiguration [name=default, maxSize=268435456, initSize=268435456, swapPath=null, pageEvictionMode=DISABLED, pageReplacementMode=CLOCK, evictionThreshold=0.9, emptyPagesPoolSize=100, metricsEnabled=false, metricsSubIntervalCount=5, metricsRateTimeInterval=60000, persistenceEnabled=true, checkpointPageBufSize=0, lazyMemoryAllocation=true, warmUpCfg=null], dataRegions=null, storagePath=null, checkpointFreq=180000, lockWaitTime=10000, checkpointThreads=4, checkpointWriteOrder=SEQUENTIAL, walHistSize=20, maxWalArchiveSize=1073741824, walSegments=10, walSegmentSize=67108864, walPath=db/wal, walArchivePath=db/wal/archive, cdcWalPath=db/wal/cdc, cdcEnabled=false, metricsEnabled=false, walMode=LOG_ONLY, walTlbSize=131072, walBuffSize=0, walFlushFreq=2000, walFsyncDelay=1000, walRecordIterBuffSize=67108864, alwaysWriteFullPages=false, fileIOFactory=org.apache.ignite.internal.processors.cache.persistence.file.AsyncFileIOFactory@4fe8bcba, metricsSubIntervalCnt=5, metricsRateTimeInterval=60000, walAutoArchiveAfterInactivity=-1, walForceArchiveTimeout=-1, writeThrottlingEnabled=false, walCompactionEnabled=false, walCompactionLevel=1, checkpointReadLockTimeout=null, walPageCompression=DISABLED, walPageCompressionLevel=null, dfltWarmUpCfg=null, encCfg=org.apache.ignite.configuration.EncryptionConfiguration@4e40de2e, defragmentationThreadPoolSize=4, minWalArchiveSize=-1], snapshotPath=snapshots, activeOnStart=true, activeOnStartPropSetFlag=false, autoActivation=true, autoActivationPropSetFlag=false, clusterStateOnStart=null, sqlConnCfg=null, cliConnCfg=ClientConnectorConfiguration [host=null, port=10800, portRange=100, sockSndBufSize=0, sockRcvBufSize=0, tcpNoDelay=true, maxOpenCursorsPerConn=128, threadPoolSize=24, selectorCnt=12, idleTimeout=0, handshakeTimeout=10000, jdbcEnabled=true, odbcEnabled=true, thinCliEnabled=true, sslEnabled=false, useIgniteSslCtxFactory=true, sslClientAuth=false, sslCtxFactory=null, thinCliCfg=ThinClientConfiguration [maxActiveTxPerConn=100, maxActiveComputeTasksPerConn=0]], mvccVacuumThreadCnt=2, mvccVacuumFreq=5000, authEnabled=false, failureHnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]], commFailureRslvr=null, sqlCfg=SqlConfiguration [longQryWarnTimeout=3000, dfltQryTimeout=0, sqlQryHistSize=1000, validationEnabled=false], asyncContinuationExecutor=null] [21:02:14] : [Step 4/5] [2021-11-19 21:02:14,473][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][GridMarshallerMappingConsistencyTest1] Daemon mode: off [21:02:14] : [Step 4/5] [2021-11-19 21:02:14,473][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][GridMarshallerMappingConsistencyTest1] OS: Linux 4.15.0-151-generic amd64 [21:02:14] : [Step 4/5] [2021-11-19 21:02:14,473][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][GridMarshallerMappingConsistencyTest1] OS user: teamcity [21:02:14] : [Step 4/5] [2021-11-19 21:02:14,474][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][GridMarshallerMappingConsistencyTest1] PID: 16724 [21:02:14] : [Step 4/5] [2021-11-19 21:02:14,474][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][GridMarshallerMappingConsistencyTest1] Language runtime: Java Platform API Specification ver. 1.8 [21:02:14] : [Step 4/5] [2021-11-19 21:02:14,474][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][GridMarshallerMappingConsistencyTest1] VM information: Java(TM) SE Runtime Environment 1.8.0_261-b12 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 25.261-b12 [21:02:14] : [Step 4/5] [2021-11-19 21:02:14,475][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][GridMarshallerMappingConsistencyTest1] VM total memory: 1.9GB [21:02:14] : [Step 4/5] [2021-11-19 21:02:14,475][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][GridMarshallerMappingConsistencyTest1] Remote Management [restart: off, REST: off, JMX (remote: off)] [21:02:14] : [Step 4/5] [2021-11-19 21:02:14,476][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][GridMarshallerMappingConsistencyTest1] Logger: GridTestLog4jLogger [quiet=false, config=null] [21:02:14] : [Step 4/5] [2021-11-19 21:02:14,476][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][GridMarshallerMappingConsistencyTest1] IGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c [21:02:14] : [Step 4/5] [2021-11-19 21:02:14,476][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][GridMarshallerMappingConsistencyTest1] VM arguments: [-DIGNITE_DUMP_THREADS_ON_FAILURE=false, -DMono=/usr/bin/mono-sgen, -DMono4.0_x64=/usr/lib/mono/4.0, -DMono4.5_x64=/usr/lib/mono/4.5, -DMonoVersion=6.12.0.90, -DSKIP_BUILD=false, -Dagent.home.dir=/opt/buildagent, -Dagent.name=aitc-lin02_03, -Dagent.ownPort=9090, -Dagent.work.dir=/opt/buildagent/work, -Dbuild.number=95, -Dbuild.vcs.number=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.1=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.GitHubApacheIgnite=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dclassworlds.conf=/opt/buildagent/temp/buildTmp/teamcity.m2.conf, -Dcom.jetbrains.maven.watcher.report.file=/opt/buildagent/temp/buildTmp/maven-build-info.xml, -Djava.io.tmpdir=/opt/buildagent/temp/buildTmp, -Dmaven.home=/opt/buildagent/tools/maven3_6, -Dmaven.multiModuleProjectDirectory=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.agent.cpuBenchmark=457, -Dteamcity.agent.dotnet.agent_url=http://localhost:9090/RPC2, -Dteamcity.agent.dotnet.build_id=6278078, -Dteamcity.auth.password=*******, -Dteamcity.auth.userId=TeamCityBuildId=6278078, -Dteamcity.build.changedFiles.file=/opt/buildagent/temp/buildTmp/changedFiles6342607772318147725.txt, -Dteamcity.build.checkoutDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.build.id=6278078, -Dteamcity.build.properties.file=/opt/buildagent/temp/buildTmp/teamcity.build5164517880467851002.properties, -Dteamcity.build.tempDir=/opt/buildagent/temp/buildTmp, -Dteamcity.build.workingDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.buildConfName=Basic 3, -Dteamcity.buildType.id=IgniteTests24Java8_Basic3, -Dteamcity.configuration.properties.file=/opt/buildagent/temp/buildTmp/teamcity.config5591980786735343870.properties, -Dteamcity.maven.userSettings.path=/opt/buildagent/temp/buildTmp/maven_settings_585072866407032347.xml, -Dteamcity.maven.watcher.home=/opt/buildagent/plugins/mavenPlugin/maven-watcher-jdk16, -Dteamcity.projectName=Ignite Tests 2.x (JDK 8/11), -Dteamcity.runner.properties.file=/opt/buildagent/temp/buildTmp/teamcity.runner9098465561618137420.properties, -Dteamcity.tests.recentlyFailedTests.file=/opt/buildagent/temp/buildTmp/testsToRunFirst3891775683130404069.txt, -Dteamcity.version=2021.2 (build 99542), -ea, -Xms2g, -Xmx2g, -XX:+HeapDumpOnOutOfMemoryError, -DIGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_TEST_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_UPDATE_NOTIFIER=false, -DIGNITE_NO_DISCO_ORDER=true, -DIGNITE_PERFORMANCE_SUGGESTIONS_DISABLED=true, -Djava.net.preferIPv4Stack=true, -DTEST_SCALE_FACTOR=1.0, -DIGNITE_TEST_PROP_LOG4J_FILE=log4j-tc-test.xml, -DIGNITE_QUIET=false, -DIGNITE_MARSHAL_BUFFERS_RECHECK=1000, -Dmaven.repo.local=/opt/buildagent/.m2/repository] [21:02:14] : [Step 4/5] [2021-11-19 21:02:14,481][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][GridMarshallerMappingConsistencyTest1] System cache's DataRegion size is configured to 40 MB. Use DataStorageConfiguration.systemRegionInitialSize property to change the setting. [21:02:14] : [Step 4/5] [2021-11-19 21:02:14,482][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][GridMarshallerMappingConsistencyTest1] Configured caches [in 'sysMemPlc' dataRegion: ['ignite-sys-cache']] [21:02:14] : [Step 4/5] [2021-11-19 21:02:14,483][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][GridMarshallerMappingConsistencyTest1] 3-rd party licenses can be found at: /opt/buildagent/work/7bc1c54bc719b67c/libs/licenses [21:02:14]W: [org.apache.ignite:ignite-core] [2021-11-19 21:02:14,482][WARN ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][GridMarshallerMappingConsistencyTest1] Peer class loading is enabled (disable it in production for performance and deployment consistency reasons) [21:02:14] : [Step 4/5] [2021-11-19 21:02:14,489][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][IgnitePluginProcessor] Configured plugins: [21:02:14] : [Step 4/5] [2021-11-19 21:02:14,489][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][IgnitePluginProcessor] ^-- StanByClusterTestProvider 1.0 [21:02:14] : [Step 4/5] [2021-11-19 21:02:14,489][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][IgnitePluginProcessor] ^-- null [21:02:14] : [Step 4/5] [2021-11-19 21:02:14,489][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][IgnitePluginProcessor] [21:02:14] : [Step 4/5] [2021-11-19 21:02:14,490][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][IgnitePluginProcessor] ^-- PageMemory tracker plugin 1.0 [21:02:14] : [Step 4/5] [2021-11-19 21:02:14,490][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][IgnitePluginProcessor] ^-- null [21:02:14] : [Step 4/5] [2021-11-19 21:02:14,490][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][IgnitePluginProcessor] [21:02:14] : [Step 4/5] [2021-11-19 21:02:14,490][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][IgnitePluginProcessor] ^-- TestDistibutedConfigurationPlugin 1.0 [21:02:14] : [Step 4/5] [2021-11-19 21:02:14,491][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][IgnitePluginProcessor] ^-- null [21:02:14] : [Step 4/5] [2021-11-19 21:02:14,491][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][IgnitePluginProcessor] [21:02:14] : [Step 4/5] [2021-11-19 21:02:14,491][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][IgnitePluginProcessor] ^-- NodeValidationPluginProvider 1.0 [21:02:14] : [Step 4/5] [2021-11-19 21:02:14,492][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][IgnitePluginProcessor] ^-- null [21:02:14] : [Step 4/5] [2021-11-19 21:02:14,492][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][IgnitePluginProcessor] [21:02:14] : [Step 4/5] [2021-11-19 21:02:14,492][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][FailureProcessor] Configured failure handler: [hnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]]] [21:02:14] : [Step 4/5] [2021-11-19 21:02:14,527][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][TcpCommunicationSpi] Successfully bound communication NIO server to TCP port [port=45030, locHost=/127.0.0.1, selectorsCnt=12, selectorSpins=0, pairedConn=false] [21:02:14]W: [org.apache.ignite:ignite-core] [2021-11-19 21:02:14,528][WARN ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][TcpCommunicationSpi] Message queue limit is set to 0 which may lead to potential OOMEs when running cache operations in FULL_ASYNC or PRIMARY_SYNC modes due to message queues growth on sender and receiver sides. [21:02:14] : [Step 4/5] [2021-11-19 21:02:14,548][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][GridCollisionManager] Collision resolution is disabled (all jobs will be activated upon arrival). [21:02:14] : [Step 4/5] [2021-11-19 21:02:14,548][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][GridMarshallerMappingConsistencyTest1] Security status [authentication=off, sandbox=off, tls/ssl=off] [21:02:14] : [Step 4/5] [2021-11-19 21:02:14,550][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][MaintenanceProcessor] Resolved store directory for node persistent data: /opt/buildagent/work/7bc1c54bc719b67c/work/test/marshaller.GridMarshallerMappingConsistencyTest1/db/marshaller_GridMarshallerMappingConsistencyTest1 [21:02:14] : [Step 4/5] [2021-11-19 21:02:14,552][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][CacheObjectBinaryProcessorImpl] Resolved directory for serialized binary metadata: /opt/buildagent/work/7bc1c54bc719b67c/work/test/marshaller.GridMarshallerMappingConsistencyTest1/db/binary_meta/marshaller_GridMarshallerMappingConsistencyTest1 [21:02:14] : [Step 4/5] [2021-11-19 21:02:14,561][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/test/marshaller.GridMarshallerMappingConsistencyTest1/db/marshaller_GridMarshallerMappingConsistencyTest1 [21:02:14] : [Step 4/5] [2021-11-19 21:02:14,562][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][FileWriteAheadLogManager] Resolved write ahead log work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/test/marshaller.GridMarshallerMappingConsistencyTest1/db/wal/marshaller_GridMarshallerMappingConsistencyTest1 [21:02:14] : [Step 4/5] [2021-11-19 21:02:14,564][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][FileWriteAheadLogManager] Resolved write ahead log archive directory: /opt/buildagent/work/7bc1c54bc719b67c/work/test/marshaller.GridMarshallerMappingConsistencyTest1/db/wal/archive/marshaller_GridMarshallerMappingConsistencyTest1 [21:02:15] : [Step 4/5] [2021-11-19 21:02:15,113][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/test/marshaller.GridMarshallerMappingConsistencyTest1/db/wal/marshaller_GridMarshallerMappingConsistencyTest1/0000000000000000.wal [21:02:15] : [Step 4/5] [2021-11-19 21:02:15,114][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][FileHandleManagerImpl] Initialized write-ahead log manager [mode=LOG_ONLY] [21:02:15] : [Step 4/5] [2021-11-19 21:02:15,118][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][GridCacheDatabaseSharedManager] Configured data regions initialized successfully [total=5] [21:02:15] : [Step 4/5] [2021-11-19 21:02:15,121][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][IgniteSnapshotManager] Resolved snapshot work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/test/marshaller.GridMarshallerMappingConsistencyTest1/snapshots [21:02:15] : [Step 4/5] [2021-11-19 21:02:15,121][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][IgniteSnapshotManager] Resolved temp directory for snapshot creation: /opt/buildagent/work/7bc1c54bc719b67c/work/test/marshaller.GridMarshallerMappingConsistencyTest1/db/marshaller_GridMarshallerMappingConsistencyTest1/snp [21:02:15] : [Step 4/5] [2021-11-19 21:02:15,124][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][ClientListenerProcessor] Client connector processor has started on TCP port 10800 [21:02:15] : [Step 4/5] [2021-11-19 21:02:15,130][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][GridMarshallerMappingConsistencyTest1] Non-loopback local IPs: 172.17.0.4 [21:02:15] : [Step 4/5] [2021-11-19 21:02:15,130][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][GridMarshallerMappingConsistencyTest1] Enabled local MACs: 0242AC110004 [21:02:15] : [Step 4/5] [2021-11-19 21:02:15,133][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:02:15] : [Step 4/5] [2021-11-19 21:02:15,135][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:02:15] : [Step 4/5] [2021-11-19 21:02:15,135][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:02:15] : [Step 4/5] [2021-11-19 21:02:15,138][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][GridCacheDatabaseSharedManager] Applying lost metastore updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:02:15] : [Step 4/5] [2021-11-19 21:02:15,139][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=0 ms] [21:02:15] : [Step 4/5] [2021-11-19 21:02:15,140][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][GridCacheProcessor] Restoring partition state for local groups. [21:02:15] : [Step 4/5] [2021-11-19 21:02:15,140][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=0, partitionsProcessed=0, time=0ms] [21:02:15] : [Step 4/5] [2021-11-19 21:02:15,141][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][GridEncryptionManager] Encryption keys loaded from metastore. [grps=, masterKeyName=null] [21:02:15] : [Step 4/5] [2021-11-19 21:02:15,145][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][ClusterProcessor] Cluster ID and tag has been read from metastorage: null [21:02:15] : [Step 4/5] [2021-11-19 21:02:15,145][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][IgniteClusterImpl] Shutdown policy was updated [oldVal=null, newVal=null] [21:02:15] : [Step 4/5] [2021-11-19 21:02:15,146][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][GridCacheDatabaseSharedManager] Checkpoint frequency deviation changed [oldVal=null, newVal=null] [21:02:15] : [Step 4/5] [2021-11-19 21:02:15,155][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][FilePageStoreManager] Cleanup cache stores [total=1, left=0, cleanFiles=false] [21:02:15] : [Step 4/5] [2021-11-19 21:02:15,159][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:02:15] : [Step 4/5] [2021-11-19 21:02:15,159][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:02:15] : [Step 4/5] [2021-11-19 21:02:15,161][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:02:15] : [Step 4/5] [2021-11-19 21:02:15,162][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][GridCacheDatabaseSharedManager] Data Regions Started: 5 [21:02:15] : [Step 4/5] [2021-11-19 21:02:15,162][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][GridCacheDatabaseSharedManager] ^-- sysMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:02:15] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:02:15] : [Step 4/5] ^-- default region [type=default, persistence=true, lazyAlloc=true, [21:02:15] : [Step 4/5] ... initCfg=256MB, maxCfg=256MB, usedRam=0MB, freeRam=100%, allocRam=0MB, allocTotal=0MB] [21:02:15] : [Step 4/5] ^-- metastoreMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:02:15] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:02:15] : [Step 4/5] ^-- TxLog region [type=internal, persistence=true, lazyAlloc=false, [21:02:15] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:02:15] : [Step 4/5] ^-- volatileDsMemPlc region [type=user, persistence=false, lazyAlloc=true, [21:02:15] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB] [21:02:15] : [Step 4/5] ^-- Ignite persistence [used=0MB] [21:02:15] : [Step 4/5] [21:02:15] : [Step 4/5] [2021-11-19 21:02:15,164][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][GridCacheDatabaseSharedManager] Starting binary memory restore for: [-2100569601] [21:02:15] : [Step 4/5] [2021-11-19 21:02:15,173][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:02:15] : [Step 4/5] [2021-11-19 21:02:15,173][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:02:15] : [Step 4/5] [2021-11-19 21:02:15,175][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/test/marshaller.GridMarshallerMappingConsistencyTest1/db/wal/marshaller_GridMarshallerMappingConsistencyTest1/0000000000000000.wal, offset=0, ver=2] [21:02:15] : [Step 4/5] [2021-11-19 21:02:15,178][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][GridCacheProcessor] Started cache in recovery mode [name=ignite-sys-cache, id=-2100569601, dataRegionName=sysMemPlc, mode=REPLICATED, atomicity=TRANSACTIONAL, backups=2147483647, mvcc=false] [21:02:15] : [Step 4/5] [2021-11-19 21:02:15,179][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][GridCacheDatabaseSharedManager] Binary recovery performed in 15 ms. [21:02:15] : [Step 4/5] [2021-11-19 21:02:15,179][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:02:15] : [Step 4/5] [2021-11-19 21:02:15,180][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][GridCacheDatabaseSharedManager] Applying lost cache updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:02:15] : [Step 4/5] [2021-11-19 21:02:15,235][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=61 ms] [21:02:15] : [Step 4/5] [2021-11-19 21:02:15,236][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][GridCacheProcessor] Restoring partition state for local groups. [21:02:15] : [Step 4/5] [2021-11-19 21:02:15,249][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=1, partitionsProcessed=100, time=10ms] [21:02:15] : [Step 4/5] [2021-11-19 21:02:15,715][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][TestTcpDiscoverySpi] Successfully bound to TCP port [port=47500, localHost=localhost/127.0.0.1, locNodeId=96da3d10-9365-4ae3-9783-33321c700001] [21:02:15] : [Step 4/5] [2021-11-19 21:02:15,724][INFO ][disco-notifier-worker-#2462%marshaller.GridMarshallerMappingConsistencyTest1%][MvccProcessorImpl] Assigned mvcc coordinator [crd=MvccCoordinator [topVer=AffinityTopologyVersion [topVer=1, minorTopVer=0], nodeId=96da3d10-9365-4ae3-9783-33321c700001, ver=1637344935721, local=true, initialized=false]] [21:02:15] : [Step 4/5] [2021-11-19 21:02:15,726][INFO ][sys-#2445%marshaller.GridMarshallerMappingConsistencyTest1%][ClusterProcessor] Writing cluster ID and tag to metastorage on ready for write ClusterIdAndTag [id=2818301c-185b-4985-b230-d27f2cec6a5a, tag=amazing_margulis] [21:02:15] : [Step 4/5] [2021-11-19 21:02:15,730][INFO ][disco-notifier-worker-#2462%marshaller.GridMarshallerMappingConsistencyTest1%][ClusterProcessor] amazing_margulis [21:02:15] : [Step 4/5] [2021-11-19 21:02:15,731][INFO ][disco-notifier-worker-#2462%marshaller.GridMarshallerMappingConsistencyTest1%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustEnabled' was changed from 'null' to 'false' [21:02:15] : [Step 4/5] [2021-11-19 21:02:15,733][INFO ][disco-notifier-worker-#2462%marshaller.GridMarshallerMappingConsistencyTest1%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustTimeout' was changed from 'null' to '300000' [21:02:15] : [Step 4/5] [2021-11-19 21:02:15,733][INFO ][disco-notifier-worker-#2462%marshaller.GridMarshallerMappingConsistencyTest1%][IgniteTxManager] Transactions parameter 'longOperationsDumpTimeout' was changed from 'null' to '60000' [21:02:15] : [Step 4/5] [2021-11-19 21:02:15,734][INFO ][disco-notifier-worker-#2462%marshaller.GridMarshallerMappingConsistencyTest1%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpThreshold' was changed from 'null' to '0' [21:02:15] : [Step 4/5] [2021-11-19 21:02:15,735][INFO ][disco-notifier-worker-#2462%marshaller.GridMarshallerMappingConsistencyTest1%][IgniteTxManager] Transactions parameter 'transactionTimeDumpSamplesCoefficient' was changed from 'null' to '0.0' [21:02:15] : [Step 4/5] [2021-11-19 21:02:15,736][INFO ][disco-notifier-worker-#2462%marshaller.GridMarshallerMappingConsistencyTest1%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpSamplesPerSecondLimit' was changed from 'null' to '5' [21:02:15] : [Step 4/5] [2021-11-19 21:02:15,737][INFO ][disco-notifier-worker-#2462%marshaller.GridMarshallerMappingConsistencyTest1%][IgniteTxManager] Transactions parameter 'collisionsDumpInterval' was changed from 'null' to '1000' [21:02:15] : [Step 4/5] [2021-11-19 21:02:15,738][INFO ][disco-notifier-worker-#2462%marshaller.GridMarshallerMappingConsistencyTest1%][IgniteTxManager] Transactions parameter 'txOwnerDumpRequestsAllowed' was changed from 'null' to 'true' [21:02:15] : [Step 4/5] [2021-11-19 21:02:15,739][INFO ][disco-notifier-worker-#2462%marshaller.GridMarshallerMappingConsistencyTest1%][GridCacheDatabaseSharedManager] Historical rebalance WAL threshold changed [property=historical.rebalance.threshold, oldVal=null, newVal=500] [21:02:15] : [Step 4/5] [2021-11-19 21:02:15,746][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][GridMarshallerMappingConsistencyTest1] To start Console Management & Monitoring run ignitevisorcmd.{sh|bat} [21:02:15] : [Step 4/5] [2021-11-19 21:02:15,747][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][GridMarshallerMappingConsistencyTest1] [21:02:15] : [Step 4/5] [21:02:15] : [Step 4/5] >>> +-------------------------------------------+ [21:02:15] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:02:15] : [Step 4/5] >>> +-------------------------------------------+ [21:02:15] : [Step 4/5] >>> OS name: Linux 4.15.0-151-generic amd64 [21:02:15] : [Step 4/5] >>> CPU(s): 24 [21:02:15] : [Step 4/5] >>> Heap: 2.0GB [21:02:15] : [Step 4/5] >>> VM name: 16724@c4dfe9a430b2 [21:02:15] : [Step 4/5] >>> Ignite instance name: marshaller.GridMarshallerMappingConsistencyTest1 [21:02:15] : [Step 4/5] >>> Local node [ID=96DA3D10-9365-4AE3-9783-33321C700001, order=1, clientMode=false] [21:02:15] : [Step 4/5] >>> Local node addresses: [127.0.0.1] [21:02:15] : [Step 4/5] >>> Local ports: TCP:10800 TCP:45030 TCP:47500 [21:02:15] : [Step 4/5] [21:02:15] : [Step 4/5] [2021-11-19 21:02:15,748][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][GridMarshallerMappingConsistencyTest1] >>> Ignite cluster is in INACTIVE state (limited functionality available). Use control.(sh|bat) script or IgniteCluster.state(ClusterState.ACTIVE) to change the state. [21:02:15] : [Step 4/5] [2021-11-19 21:02:15,749][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][GridDiscoveryManager] Topology snapshot [ver=1, locNode=96da3d10, servers=1, clients=0, state=INACTIVE, CPUs=24, offheap=0.25GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=96da3d10-9365-4ae3-9783-33321c700001, consistentId=marshaller.GridMarshallerMappingConsistencyTest1, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:02:15] : [Step 4/5] [2021-11-19 21:02:15,749][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][G] Node started : [stage="Configure system pool" (0 ms),stage="Start managers" (90 ms),stage="Configure binary metadata" (5 ms),stage="Start processors" (572 ms),stage="Start 'StanByClusterTestProvider' plugin" (0 ms),stage="Start 'PageMemory tracker plugin' plugin" (0 ms),stage="Start 'TestDistibutedConfigurationPlugin' plugin" (0 ms),stage="Start 'NodeValidationPluginProvider' plugin" (0 ms),stage="Init metastore" (26 ms),stage="Init and start regions" (7 ms),stage="Restore binary memory" (15 ms),stage="Restore logical state" (69 ms),stage="Finish recovery" (465 ms),stage="Join topology" (10 ms),stage="Await transition" (2 ms),stage="Await exchange" (21 ms),stage="Total time" (1282 ms)] [21:02:15] : [Step 4/5] [2021-11-19 21:02:15,750][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][root] Node started with the following configuration [id=96da3d10-9365-4ae3-9783-33321c700001, marshaller=BinaryMarshaller [], discovery=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=5000, ackTimeout=5000, marsh=JdkMarshaller [clsFilter=org.apache.ignite.marshaller.MarshallerUtils$1@202bcd3a], reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], binaryCfg=null, lateAff=true] [21:02:15] : [Step 4/5] [2021-11-19 21:02:15,756][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][GridMarshallerMappingConsistencyTest2] [21:02:15] : [Step 4/5] [21:02:15] : [Step 4/5] >>> __________ ________________ [21:02:15] : [Step 4/5] >>> / _/ ___/ |/ / _/_ __/ __/ [21:02:15] : [Step 4/5] >>> _/ // (7 7 // / / / / _/ [21:02:15] : [Step 4/5] >>> /___/\___/_/|_/___/ /_/ /___/ [21:02:15] : [Step 4/5] >>> [21:02:15] : [Step 4/5] >>> ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:02:15] : [Step 4/5] >>> 2021 Copyright(C) Apache Software Foundation [21:02:15] : [Step 4/5] >>> [21:02:15] : [Step 4/5] >>> Ignite documentation: http://ignite.apache.org [21:02:15] : [Step 4/5] [21:02:15] : [Step 4/5] [2021-11-19 21:02:15,757][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][GridMarshallerMappingConsistencyTest2] Config URL: n/a [21:02:15] : [Step 4/5] [2021-11-19 21:02:15,757][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][GridMarshallerMappingConsistencyTest2] IgniteConfiguration [igniteInstanceName=marshaller.GridMarshallerMappingConsistencyTest2, pubPoolSize=24, svcPoolSize=24, callbackPoolSize=24, stripedPoolSize=24, sysPoolSize=24, mgmtPoolSize=4, dataStreamerPoolSize=24, utilityCachePoolSize=24, utilityCacheKeepAliveTime=60000, p2pPoolSize=2, qryPoolSize=24, buildIdxPoolSize=4, igniteHome=/opt/buildagent/work/7bc1c54bc719b67c, igniteWorkDir=/opt/buildagent/work/7bc1c54bc719b67c/work/test/marshaller.GridMarshallerMappingConsistencyTest2, mbeanSrv=com.sun.jmx.mbeanserver.JmxMBeanServer@6fe85038, nodeId=6057dd11-6d2a-4e45-8208-78ac4b700002, marsh=BinaryMarshaller [], marshLocJobs=false, daemon=false, p2pEnabled=true, netTimeout=10000, netCompressionLevel=1, sndRetryDelay=1000, sndRetryCnt=3, metricsHistSize=10000, metricsUpdateFreq=1000, metricsExpTime=9223372036854775807, discoSpi=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=0, ackTimeout=0, marsh=null, reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], segPlc=STOP, segResolveAttempts=2, waitForSegOnStart=true, allResolversPassReq=true, segChkFreq=10000, commSpi=TcpCommunicationSpi [connectGate=org.apache.ignite.spi.communication.tcp.internal.ConnectGateway@c8beb1d, ctxInitLatch=java.util.concurrent.CountDownLatch@53ea0fc1[Count = 1], stopping=false, clientPool=null, nioSrvWrapper=null, stateProvider=null], evtSpi=MemoryEventStorageSpi [expireAgeMs=9223372036854775807, expireCnt=10000, filter=null], colSpi=NoopCollisionSpi [], deploySpi=LocalDeploymentSpi [], indexingSpi=org.apache.ignite.spi.indexing.noop.NoopIndexingSpi@227d4ec4, addrRslvr=null, encryptionSpi=org.apache.ignite.spi.encryption.noop.NoopEncryptionSpi@46d08548, tracingSpi=org.apache.ignite.spi.tracing.NoopTracingSpi@64233b19, clientMode=false, rebalanceThreadPoolSize=4, rebalanceTimeout=10000, rebalanceBatchesPrefetchCnt=3, rebalanceThrottle=0, rebalanceBatchSize=524288, txCfg=TransactionConfiguration [txSerEnabled=false, dfltIsolation=REPEATABLE_READ, dfltConcurrency=PESSIMISTIC, dfltTxTimeout=0, txTimeoutOnPartitionMapExchange=0, deadlockTimeout=10000, pessimisticTxLogSize=0, pessimisticTxLogLinger=10000, tmLookupClsName=null, txManagerFactory=null, useJtaSync=false], cacheSanityCheckEnabled=true, discoStartupDelay=60000, deployMode=SHARED, p2pMissedCacheSize=100, locHost=127.0.0.1, timeSrvPortBase=31100, timeSrvPortRange=100, failureDetectionTimeout=10000, sysWorkerBlockedTimeout=null, clientFailureDetectionTimeout=10000, metricsLogFreq=0, connectorCfg=null, odbcCfg=null, warmupClos=null, atomicCfg=AtomicConfiguration [seqReserveSize=1000, cacheMode=PARTITIONED, backups=1, aff=null, grpName=null], classLdr=null, sslCtxFactory=null, platformCfg=null, binaryCfg=null, memCfg=null, pstCfg=null, dsCfg=DataStorageConfiguration [sysRegionInitSize=41943040, sysRegionMaxSize=104857600, pageSize=0, concLvl=0, dfltDataRegConf=DataRegionConfiguration [name=default, maxSize=268435456, initSize=268435456, swapPath=null, pageEvictionMode=DISABLED, pageReplacementMode=CLOCK, evictionThreshold=0.9, emptyPagesPoolSize=100, metricsEnabled=false, metricsSubIntervalCount=5, metricsRateTimeInterval=60000, persistenceEnabled=true, checkpointPageBufSize=0, lazyMemoryAllocation=true, warmUpCfg=null], dataRegions=null, storagePath=null, checkpointFreq=180000, lockWaitTime=10000, checkpointThreads=4, checkpointWriteOrder=SEQUENTIAL, walHistSize=20, maxWalArchiveSize=1073741824, walSegments=10, walSegmentSize=67108864, walPath=db/wal, walArchivePath=db/wal/archive, cdcWalPath=db/wal/cdc, cdcEnabled=false, metricsEnabled=false, walMode=LOG_ONLY, walTlbSize=131072, walBuffSize=0, walFlushFreq=2000, walFsyncDelay=1000, walRecordIterBuffSize=67108864, alwaysWriteFullPages=false, fileIOFactory=org.apache.ignite.internal.processors.cache.persistence.file.AsyncFileIOFactory@4de7eb64, metricsSubIntervalCnt=5, metricsRateTimeInterval=60000, walAutoArchiveAfterInactivity=-1, walForceArchiveTimeout=-1, writeThrottlingEnabled=false, walCompactionEnabled=false, walCompactionLevel=1, checkpointReadLockTimeout=null, walPageCompression=DISABLED, walPageCompressionLevel=null, dfltWarmUpCfg=null, encCfg=org.apache.ignite.configuration.EncryptionConfiguration@7ab1c67a, defragmentationThreadPoolSize=4, minWalArchiveSize=-1], snapshotPath=snapshots, activeOnStart=true, activeOnStartPropSetFlag=false, autoActivation=true, autoActivationPropSetFlag=false, clusterStateOnStart=null, sqlConnCfg=null, cliConnCfg=ClientConnectorConfiguration [host=null, port=10800, portRange=100, sockSndBufSize=0, sockRcvBufSize=0, tcpNoDelay=true, maxOpenCursorsPerConn=128, threadPoolSize=24, selectorCnt=12, idleTimeout=0, handshakeTimeout=10000, jdbcEnabled=true, odbcEnabled=true, thinCliEnabled=true, sslEnabled=false, useIgniteSslCtxFactory=true, sslClientAuth=false, sslCtxFactory=null, thinCliCfg=ThinClientConfiguration [maxActiveTxPerConn=100, maxActiveComputeTasksPerConn=0]], mvccVacuumThreadCnt=2, mvccVacuumFreq=5000, authEnabled=false, failureHnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]], commFailureRslvr=null, sqlCfg=SqlConfiguration [longQryWarnTimeout=3000, dfltQryTimeout=0, sqlQryHistSize=1000, validationEnabled=false], asyncContinuationExecutor=null] [21:02:15] : [Step 4/5] [2021-11-19 21:02:15,764][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][GridMarshallerMappingConsistencyTest2] Daemon mode: off [21:02:15] : [Step 4/5] [2021-11-19 21:02:15,764][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][GridMarshallerMappingConsistencyTest2] OS: Linux 4.15.0-151-generic amd64 [21:02:15] : [Step 4/5] [2021-11-19 21:02:15,765][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][GridMarshallerMappingConsistencyTest2] OS user: teamcity [21:02:15] : [Step 4/5] [2021-11-19 21:02:15,765][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][GridMarshallerMappingConsistencyTest2] PID: 16724 [21:02:15] : [Step 4/5] [2021-11-19 21:02:15,765][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][GridMarshallerMappingConsistencyTest2] Language runtime: Java Platform API Specification ver. 1.8 [21:02:15] : [Step 4/5] [2021-11-19 21:02:15,765][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][GridMarshallerMappingConsistencyTest2] VM information: Java(TM) SE Runtime Environment 1.8.0_261-b12 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 25.261-b12 [21:02:15] : [Step 4/5] [2021-11-19 21:02:15,766][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][GridMarshallerMappingConsistencyTest2] VM total memory: 1.9GB [21:02:15] : [Step 4/5] [2021-11-19 21:02:15,766][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][GridMarshallerMappingConsistencyTest2] Remote Management [restart: off, REST: off, JMX (remote: off)] [21:02:15] : [Step 4/5] [2021-11-19 21:02:15,766][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][GridMarshallerMappingConsistencyTest2] Logger: GridTestLog4jLogger [quiet=false, config=null] [21:02:15] : [Step 4/5] [2021-11-19 21:02:15,767][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][GridMarshallerMappingConsistencyTest2] IGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c [21:02:15] : [Step 4/5] [2021-11-19 21:02:15,767][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][GridMarshallerMappingConsistencyTest2] VM arguments: [-DIGNITE_DUMP_THREADS_ON_FAILURE=false, -DMono=/usr/bin/mono-sgen, -DMono4.0_x64=/usr/lib/mono/4.0, -DMono4.5_x64=/usr/lib/mono/4.5, -DMonoVersion=6.12.0.90, -DSKIP_BUILD=false, -Dagent.home.dir=/opt/buildagent, -Dagent.name=aitc-lin02_03, -Dagent.ownPort=9090, -Dagent.work.dir=/opt/buildagent/work, -Dbuild.number=95, -Dbuild.vcs.number=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.1=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.GitHubApacheIgnite=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dclassworlds.conf=/opt/buildagent/temp/buildTmp/teamcity.m2.conf, -Dcom.jetbrains.maven.watcher.report.file=/opt/buildagent/temp/buildTmp/maven-build-info.xml, -Djava.io.tmpdir=/opt/buildagent/temp/buildTmp, -Dmaven.home=/opt/buildagent/tools/maven3_6, -Dmaven.multiModuleProjectDirectory=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.agent.cpuBenchmark=457, -Dteamcity.agent.dotnet.agent_url=http://localhost:9090/RPC2, -Dteamcity.agent.dotnet.build_id=6278078, -Dteamcity.auth.password=*******, -Dteamcity.auth.userId=TeamCityBuildId=6278078, -Dteamcity.build.changedFiles.file=/opt/buildagent/temp/buildTmp/changedFiles6342607772318147725.txt, -Dteamcity.build.checkoutDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.build.id=6278078, -Dteamcity.build.properties.file=/opt/buildagent/temp/buildTmp/teamcity.build5164517880467851002.properties, -Dteamcity.build.tempDir=/opt/buildagent/temp/buildTmp, -Dteamcity.build.workingDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.buildConfName=Basic 3, -Dteamcity.buildType.id=IgniteTests24Java8_Basic3, -Dteamcity.configuration.properties.file=/opt/buildagent/temp/buildTmp/teamcity.config5591980786735343870.properties, -Dteamcity.maven.userSettings.path=/opt/buildagent/temp/buildTmp/maven_settings_585072866407032347.xml, -Dteamcity.maven.watcher.home=/opt/buildagent/plugins/mavenPlugin/maven-watcher-jdk16, -Dteamcity.projectName=Ignite Tests 2.x (JDK 8/11), -Dteamcity.runner.properties.file=/opt/buildagent/temp/buildTmp/teamcity.runner9098465561618137420.properties, -Dteamcity.tests.recentlyFailedTests.file=/opt/buildagent/temp/buildTmp/testsToRunFirst3891775683130404069.txt, -Dteamcity.version=2021.2 (build 99542), -ea, -Xms2g, -Xmx2g, -XX:+HeapDumpOnOutOfMemoryError, -DIGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_TEST_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_UPDATE_NOTIFIER=false, -DIGNITE_NO_DISCO_ORDER=true, -DIGNITE_PERFORMANCE_SUGGESTIONS_DISABLED=true, -Djava.net.preferIPv4Stack=true, -DTEST_SCALE_FACTOR=1.0, -DIGNITE_TEST_PROP_LOG4J_FILE=log4j-tc-test.xml, -DIGNITE_QUIET=false, -DIGNITE_MARSHAL_BUFFERS_RECHECK=1000, -Dmaven.repo.local=/opt/buildagent/.m2/repository] [21:02:15] : [Step 4/5] [2021-11-19 21:02:15,771][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][GridMarshallerMappingConsistencyTest2] System cache's DataRegion size is configured to 40 MB. Use DataStorageConfiguration.systemRegionInitialSize property to change the setting. [21:02:15] : [Step 4/5] [2021-11-19 21:02:15,771][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][GridMarshallerMappingConsistencyTest2] Configured caches [in 'sysMemPlc' dataRegion: ['ignite-sys-cache']] [21:02:15]W: [org.apache.ignite:ignite-core] [2021-11-19 21:02:15,771][WARN ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][GridMarshallerMappingConsistencyTest2] Peer class loading is enabled (disable it in production for performance and deployment consistency reasons) [21:02:15] : [Step 4/5] [2021-11-19 21:02:15,772][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][GridMarshallerMappingConsistencyTest2] 3-rd party licenses can be found at: /opt/buildagent/work/7bc1c54bc719b67c/libs/licenses [21:02:15] : [Step 4/5] [2021-11-19 21:02:15,776][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][IgnitePluginProcessor] Configured plugins: [21:02:15] : [Step 4/5] [2021-11-19 21:02:15,776][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][IgnitePluginProcessor] ^-- StanByClusterTestProvider 1.0 [21:02:15] : [Step 4/5] [2021-11-19 21:02:15,776][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][IgnitePluginProcessor] ^-- null [21:02:15] : [Step 4/5] [2021-11-19 21:02:15,776][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][IgnitePluginProcessor] [21:02:15] : [Step 4/5] [2021-11-19 21:02:15,776][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][IgnitePluginProcessor] ^-- PageMemory tracker plugin 1.0 [21:02:15] : [Step 4/5] [2021-11-19 21:02:15,776][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][IgnitePluginProcessor] ^-- null [21:02:15] : [Step 4/5] [2021-11-19 21:02:15,777][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][IgnitePluginProcessor] [21:02:15] : [Step 4/5] [2021-11-19 21:02:15,777][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][IgnitePluginProcessor] ^-- TestDistibutedConfigurationPlugin 1.0 [21:02:15] : [Step 4/5] [2021-11-19 21:02:15,777][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][IgnitePluginProcessor] ^-- null [21:02:15] : [Step 4/5] [2021-11-19 21:02:15,777][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][IgnitePluginProcessor] [21:02:15] : [Step 4/5] [2021-11-19 21:02:15,777][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][IgnitePluginProcessor] ^-- NodeValidationPluginProvider 1.0 [21:02:15] : [Step 4/5] [2021-11-19 21:02:15,778][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][IgnitePluginProcessor] ^-- null [21:02:15] : [Step 4/5] [2021-11-19 21:02:15,778][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][IgnitePluginProcessor] [21:02:15] : [Step 4/5] [2021-11-19 21:02:15,778][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][FailureProcessor] Configured failure handler: [hnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]]] [21:02:15] : [Step 4/5] [2021-11-19 21:02:15,788][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][TcpCommunicationSpi] Successfully bound communication NIO server to TCP port [port=45031, locHost=/127.0.0.1, selectorsCnt=12, selectorSpins=0, pairedConn=false] [21:02:15]W: [org.apache.ignite:ignite-core] [2021-11-19 21:02:15,789][WARN ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][TcpCommunicationSpi] Message queue limit is set to 0 which may lead to potential OOMEs when running cache operations in FULL_ASYNC or PRIMARY_SYNC modes due to message queues growth on sender and receiver sides. [21:02:15] : [Step 4/5] [2021-11-19 21:02:15,794][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][GridCollisionManager] Collision resolution is disabled (all jobs will be activated upon arrival). [21:02:15] : [Step 4/5] [2021-11-19 21:02:15,794][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][GridMarshallerMappingConsistencyTest2] Security status [authentication=off, sandbox=off, tls/ssl=off] [21:02:15] : [Step 4/5] [2021-11-19 21:02:15,795][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][MaintenanceProcessor] Resolved store directory for node persistent data: /opt/buildagent/work/7bc1c54bc719b67c/work/test/marshaller.GridMarshallerMappingConsistencyTest2/db/marshaller_GridMarshallerMappingConsistencyTest2 [21:02:15] : [Step 4/5] [2021-11-19 21:02:15,797][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][CacheObjectBinaryProcessorImpl] Resolved directory for serialized binary metadata: /opt/buildagent/work/7bc1c54bc719b67c/work/test/marshaller.GridMarshallerMappingConsistencyTest2/db/binary_meta/marshaller_GridMarshallerMappingConsistencyTest2 [21:02:15] : [Step 4/5] [2021-11-19 21:02:15,801][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/test/marshaller.GridMarshallerMappingConsistencyTest2/db/marshaller_GridMarshallerMappingConsistencyTest2 [21:02:15] : [Step 4/5] [2021-11-19 21:02:15,802][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][FileWriteAheadLogManager] Resolved write ahead log work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/test/marshaller.GridMarshallerMappingConsistencyTest2/db/wal/marshaller_GridMarshallerMappingConsistencyTest2 [21:02:15] : [Step 4/5] [2021-11-19 21:02:15,802][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][FileWriteAheadLogManager] Resolved write ahead log archive directory: /opt/buildagent/work/7bc1c54bc719b67c/work/test/marshaller.GridMarshallerMappingConsistencyTest2/db/wal/archive/marshaller_GridMarshallerMappingConsistencyTest2 [21:02:16] : [Step 4/5] [2021-11-19 21:02:16,317][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/test/marshaller.GridMarshallerMappingConsistencyTest2/db/wal/marshaller_GridMarshallerMappingConsistencyTest2/0000000000000000.wal [21:02:16] : [Step 4/5] [2021-11-19 21:02:16,317][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][FileHandleManagerImpl] Initialized write-ahead log manager [mode=LOG_ONLY] [21:02:16] : [Step 4/5] [2021-11-19 21:02:16,324][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][GridCacheDatabaseSharedManager] Configured data regions initialized successfully [total=5] [21:02:16] : [Step 4/5] [2021-11-19 21:02:16,326][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][IgniteSnapshotManager] Resolved snapshot work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/test/marshaller.GridMarshallerMappingConsistencyTest2/snapshots [21:02:16] : [Step 4/5] [2021-11-19 21:02:16,326][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][IgniteSnapshotManager] Resolved temp directory for snapshot creation: /opt/buildagent/work/7bc1c54bc719b67c/work/test/marshaller.GridMarshallerMappingConsistencyTest2/db/marshaller_GridMarshallerMappingConsistencyTest2/snp [21:02:16] : [Step 4/5] [2021-11-19 21:02:16,330][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][ClientListenerProcessor] Client connector processor has started on TCP port 10801 [21:02:16] : [Step 4/5] [2021-11-19 21:02:16,334][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][GridMarshallerMappingConsistencyTest2] Non-loopback local IPs: 172.17.0.4 [21:02:16] : [Step 4/5] [2021-11-19 21:02:16,334][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][GridMarshallerMappingConsistencyTest2] Enabled local MACs: 0242AC110004 [21:02:16] : [Step 4/5] [2021-11-19 21:02:16,335][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:02:16] : [Step 4/5] [2021-11-19 21:02:16,337][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:02:16] : [Step 4/5] [2021-11-19 21:02:16,338][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:02:16] : [Step 4/5] [2021-11-19 21:02:16,340][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][GridCacheDatabaseSharedManager] Applying lost metastore updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:02:16] : [Step 4/5] [2021-11-19 21:02:16,342][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=0 ms] [21:02:16] : [Step 4/5] [2021-11-19 21:02:16,342][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][GridCacheProcessor] Restoring partition state for local groups. [21:02:16] : [Step 4/5] [2021-11-19 21:02:16,342][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=0, partitionsProcessed=0, time=0ms] [21:02:16] : [Step 4/5] [2021-11-19 21:02:16,343][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][GridEncryptionManager] Encryption keys loaded from metastore. [grps=, masterKeyName=null] [21:02:16] : [Step 4/5] [2021-11-19 21:02:16,345][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][ClusterProcessor] Cluster ID and tag has been read from metastorage: null [21:02:16] : [Step 4/5] [2021-11-19 21:02:16,345][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][IgniteClusterImpl] Shutdown policy was updated [oldVal=null, newVal=null] [21:02:16] : [Step 4/5] [2021-11-19 21:02:16,346][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][GridCacheDatabaseSharedManager] Checkpoint frequency deviation changed [oldVal=null, newVal=null] [21:02:16] : [Step 4/5] [2021-11-19 21:02:16,355][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][FilePageStoreManager] Cleanup cache stores [total=1, left=0, cleanFiles=false] [21:02:16] : [Step 4/5] [2021-11-19 21:02:16,359][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:02:16] : [Step 4/5] [2021-11-19 21:02:16,360][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:02:16] : [Step 4/5] [2021-11-19 21:02:16,362][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:02:16] : [Step 4/5] [2021-11-19 21:02:16,363][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][GridCacheDatabaseSharedManager] Data Regions Started: 5 [21:02:16] : [Step 4/5] [2021-11-19 21:02:16,363][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][GridCacheDatabaseSharedManager] ^-- sysMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:02:16] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:02:16] : [Step 4/5] ^-- default region [type=default, persistence=true, lazyAlloc=true, [21:02:16] : [Step 4/5] ... initCfg=256MB, maxCfg=256MB, usedRam=0MB, freeRam=100%, allocRam=0MB, allocTotal=0MB] [21:02:16] : [Step 4/5] ^-- metastoreMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:02:16] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:02:16] : [Step 4/5] ^-- TxLog region [type=internal, persistence=true, lazyAlloc=false, [21:02:16] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:02:16] : [Step 4/5] ^-- volatileDsMemPlc region [type=user, persistence=false, lazyAlloc=true, [21:02:16] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB] [21:02:16] : [Step 4/5] ^-- Ignite persistence [used=0MB] [21:02:16] : [Step 4/5] [21:02:16] : [Step 4/5] [2021-11-19 21:02:16,365][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][GridCacheDatabaseSharedManager] Starting binary memory restore for: [-2100569601] [21:02:16] : [Step 4/5] [2021-11-19 21:02:16,377][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:02:16] : [Step 4/5] [2021-11-19 21:02:16,377][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:02:16] : [Step 4/5] [2021-11-19 21:02:16,382][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/test/marshaller.GridMarshallerMappingConsistencyTest2/db/wal/marshaller_GridMarshallerMappingConsistencyTest2/0000000000000000.wal, offset=0, ver=2] [21:02:16] : [Step 4/5] [2021-11-19 21:02:16,387][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][GridCacheProcessor] Started cache in recovery mode [name=ignite-sys-cache, id=-2100569601, dataRegionName=sysMemPlc, mode=REPLICATED, atomicity=TRANSACTIONAL, backups=2147483647, mvcc=false] [21:02:16] : [Step 4/5] [2021-11-19 21:02:16,388][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][GridCacheDatabaseSharedManager] Binary recovery performed in 23 ms. [21:02:16] : [Step 4/5] [2021-11-19 21:02:16,389][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:02:16] : [Step 4/5] [2021-11-19 21:02:16,389][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][GridCacheDatabaseSharedManager] Applying lost cache updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:02:16] : [Step 4/5] [2021-11-19 21:02:16,467][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=71 ms] [21:02:16] : [Step 4/5] [2021-11-19 21:02:16,467][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][GridCacheProcessor] Restoring partition state for local groups. [21:02:16] : [Step 4/5] [2021-11-19 21:02:16,483][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=1, partitionsProcessed=100, time=20ms] [21:02:16] : [Step 4/5] [2021-11-19 21:02:16,912][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][TestTcpDiscoverySpi] Successfully bound to TCP port [port=47501, localHost=localhost/127.0.0.1, locNodeId=6057dd11-6d2a-4e45-8208-78ac4b700002] [21:02:16] : [Step 4/5] [2021-11-19 21:02:16,916][INFO ][tcp-disco-srvr-[:47500]-#129%marshaller.GridMarshallerMappingConsistencyTest1%-#2464%marshaller.GridMarshallerMappingConsistencyTest1%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=41401] [21:02:16] : [Step 4/5] [2021-11-19 21:02:16,917][INFO ][tcp-disco-srvr-[:47500]-#129%marshaller.GridMarshallerMappingConsistencyTest1%-#2464%marshaller.GridMarshallerMappingConsistencyTest1%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=41401] [21:02:16] : [Step 4/5] [2021-11-19 21:02:16,917][INFO ][tcp-disco-sock-reader-[]-#135%marshaller.GridMarshallerMappingConsistencyTest1%-#2584%marshaller.GridMarshallerMappingConsistencyTest1%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:41401, rmtPort=41401] [21:02:16] : [Step 4/5] [2021-11-19 21:02:16,919][INFO ][tcp-disco-sock-reader-[6057dd11 127.0.0.1:41401]-#135%marshaller.GridMarshallerMappingConsistencyTest1%-#2584%marshaller.GridMarshallerMappingConsistencyTest1%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=6057dd11-6d2a-4e45-8208-78ac4b700002, rmtAddr=/127.0.0.1:41401] [21:02:16] : [Step 4/5] [2021-11-19 21:02:16,926][INFO ][tcp-disco-srvr-[:47501]-#134%marshaller.GridMarshallerMappingConsistencyTest2%-#2583%marshaller.GridMarshallerMappingConsistencyTest2%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=35763] [21:02:16] : [Step 4/5] [2021-11-19 21:02:16,927][INFO ][tcp-disco-srvr-[:47501]-#134%marshaller.GridMarshallerMappingConsistencyTest2%-#2583%marshaller.GridMarshallerMappingConsistencyTest2%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=35763] [21:02:16] : [Step 4/5] [2021-11-19 21:02:16,928][INFO ][tcp-disco-sock-reader-[]-#136%marshaller.GridMarshallerMappingConsistencyTest2%-#2585%marshaller.GridMarshallerMappingConsistencyTest2%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:35763, rmtPort=35763] [21:02:16] : [Step 4/5] [2021-11-19 21:02:16,929][INFO ][tcp-disco-sock-reader-[]-#136%marshaller.GridMarshallerMappingConsistencyTest2%-#2585%marshaller.GridMarshallerMappingConsistencyTest2%][TestTcpDiscoverySpi] Received ping request from the remote node [rmtNodeId=96da3d10-9365-4ae3-9783-33321c700001, rmtAddr=/127.0.0.1:35763, rmtPort=35763] [21:02:16] : [Step 4/5] [2021-11-19 21:02:16,931][INFO ][tcp-disco-sock-reader-[]-#136%marshaller.GridMarshallerMappingConsistencyTest2%-#2585%marshaller.GridMarshallerMappingConsistencyTest2%][TestTcpDiscoverySpi] Finished writing ping response [rmtNodeId=96da3d10-9365-4ae3-9783-33321c700001, rmtAddr=/127.0.0.1:35763, rmtPort=35763] [21:02:16] : [Step 4/5] [2021-11-19 21:02:16,931][INFO ][tcp-disco-sock-reader-[6057dd11 127.0.0.1:41401]-#135%marshaller.GridMarshallerMappingConsistencyTest1%-#2584%marshaller.GridMarshallerMappingConsistencyTest1%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:41401, rmtPort=41401, rmtNodeId=6057dd11-6d2a-4e45-8208-78ac4b700002] [21:02:16]W: [org.apache.ignite:ignite-core] [2021-11-19 21:02:16,931][WARN ][tcp-disco-sock-reader-[]-#136%marshaller.GridMarshallerMappingConsistencyTest2%-#2585%marshaller.GridMarshallerMappingConsistencyTest2%][TestTcpDiscoverySpi] Failed to shutdown socket [21:02:16]W: [org.apache.ignite:ignite-core] java.net.SocketException: Socket output is already shutdown [21:02:16]W: [org.apache.ignite:ignite-core] at java.net.Socket.shutdownOutput(Socket.java:1572) [21:02:16]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.close(IgniteUtils.java:4247) [21:02:16]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.discovery.tcp.ServerImpl$SocketReader.body(ServerImpl.java:7370) [21:02:16]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.IgniteSpiThread.run(IgniteSpiThread.java:58) [21:02:16] : [Step 4/5] [2021-11-19 21:02:16,937][INFO ][tcp-disco-sock-reader-[]-#136%marshaller.GridMarshallerMappingConsistencyTest2%-#2585%marshaller.GridMarshallerMappingConsistencyTest2%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:35763, rmtPort=35763, rmtNodeId=null] [21:02:16] : [Step 4/5] [2021-11-19 21:02:16,938][INFO ][tcp-disco-msg-worker-[crd]-#128%marshaller.GridMarshallerMappingConsistencyTest1%-#2463%marshaller.GridMarshallerMappingConsistencyTest1%][GridEncryptionManager] Joining node doesn't have stored group keys [node=6057dd11-6d2a-4e45-8208-78ac4b700002] [21:02:16] : [Step 4/5] [2021-11-19 21:02:16,950][INFO ][tcp-disco-msg-worker-[crd]-#128%marshaller.GridMarshallerMappingConsistencyTest1%-#2463%marshaller.GridMarshallerMappingConsistencyTest1%][TestTcpDiscoverySpi] New next node [newNext=TcpDiscoveryNode [id=6057dd11-6d2a-4e45-8208-78ac4b700002, consistentId=marshaller.GridMarshallerMappingConsistencyTest2, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=0, intOrder=2, lastExchangeTime=1637344936924, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false]] [21:02:16] : [Step 4/5] [2021-11-19 21:02:16,951][INFO ][tcp-disco-srvr-[:47501]-#134%marshaller.GridMarshallerMappingConsistencyTest2%-#2583%marshaller.GridMarshallerMappingConsistencyTest2%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=35721] [21:02:16] : [Step 4/5] [2021-11-19 21:02:16,951][INFO ][tcp-disco-srvr-[:47501]-#134%marshaller.GridMarshallerMappingConsistencyTest2%-#2583%marshaller.GridMarshallerMappingConsistencyTest2%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=35721] [21:02:16] : [Step 4/5] [2021-11-19 21:02:16,952][INFO ][tcp-disco-sock-reader-[]-#137%marshaller.GridMarshallerMappingConsistencyTest2%-#2586%marshaller.GridMarshallerMappingConsistencyTest2%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:35721, rmtPort=35721] [21:02:16] : [Step 4/5] [2021-11-19 21:02:16,953][INFO ][tcp-disco-sock-reader-[96da3d10 127.0.0.1:35721]-#137%marshaller.GridMarshallerMappingConsistencyTest2%-#2586%marshaller.GridMarshallerMappingConsistencyTest2%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=96da3d10-9365-4ae3-9783-33321c700001, rmtAddr=/127.0.0.1:35721] [21:02:16] : [Step 4/5] [2021-11-19 21:02:16,958][INFO ][tcp-disco-msg-worker-[]-#133%marshaller.GridMarshallerMappingConsistencyTest2%-#2582%marshaller.GridMarshallerMappingConsistencyTest2%][TestTcpDiscoverySpi] New next node [newNext=TcpDiscoveryNode [id=96da3d10-9365-4ae3-9783-33321c700001, consistentId=marshaller.GridMarshallerMappingConsistencyTest1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637344936955, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false]] [21:02:16] : [Step 4/5] [2021-11-19 21:02:16,959][INFO ][tcp-disco-srvr-[:47500]-#129%marshaller.GridMarshallerMappingConsistencyTest1%-#2464%marshaller.GridMarshallerMappingConsistencyTest1%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=59859] [21:02:16] : [Step 4/5] [2021-11-19 21:02:16,959][INFO ][tcp-disco-srvr-[:47500]-#129%marshaller.GridMarshallerMappingConsistencyTest1%-#2464%marshaller.GridMarshallerMappingConsistencyTest1%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=59859] [21:02:16] : [Step 4/5] [2021-11-19 21:02:16,960][INFO ][tcp-disco-sock-reader-[]-#138%marshaller.GridMarshallerMappingConsistencyTest1%-#2587%marshaller.GridMarshallerMappingConsistencyTest1%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:59859, rmtPort=59859] [21:02:16] : [Step 4/5] [2021-11-19 21:02:16,961][INFO ][tcp-disco-sock-reader-[6057dd11 127.0.0.1:59859]-#138%marshaller.GridMarshallerMappingConsistencyTest1%-#2587%marshaller.GridMarshallerMappingConsistencyTest1%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=6057dd11-6d2a-4e45-8208-78ac4b700002, rmtAddr=/127.0.0.1:59859] [21:02:16] : [Step 4/5] [2021-11-19 21:02:16,964][INFO ][disco-event-worker-#2466%marshaller.GridMarshallerMappingConsistencyTest1%][GridDiscoveryManager] Added new node to topology: TcpDiscoveryNode [id=6057dd11-6d2a-4e45-8208-78ac4b700002, consistentId=marshaller.GridMarshallerMappingConsistencyTest2, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637344936924, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false] [21:02:16] : [Step 4/5] [2021-11-19 21:02:16,966][INFO ][disco-event-worker-#2466%marshaller.GridMarshallerMappingConsistencyTest1%][GridDiscoveryManager] Topology snapshot [ver=2, locNode=96da3d10, servers=2, clients=0, state=INACTIVE, CPUs=24, offheap=0.25GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=96da3d10-9365-4ae3-9783-33321c700001, consistentId=marshaller.GridMarshallerMappingConsistencyTest1, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=6057dd11-6d2a-4e45-8208-78ac4b700002, consistentId=marshaller.GridMarshallerMappingConsistencyTest2, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:02:16] : [Step 4/5] [2021-11-19 21:02:16,968][INFO ][tcp-disco-msg-worker-[96da3d10 127.0.0.1:47500]-#133%marshaller.GridMarshallerMappingConsistencyTest2%-#2582%marshaller.GridMarshallerMappingConsistencyTest2%][ClusterProcessor] amazing_margulis [21:02:16] : [Step 4/5] [2021-11-19 21:02:16,969][INFO ][tcp-disco-msg-worker-[96da3d10 127.0.0.1:47500]-#133%marshaller.GridMarshallerMappingConsistencyTest2%-#2582%marshaller.GridMarshallerMappingConsistencyTest2%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustEnabled' was changed from 'null' to 'false' [21:02:16] : [Step 4/5] [2021-11-19 21:02:16,970][INFO ][tcp-disco-msg-worker-[96da3d10 127.0.0.1:47500]-#133%marshaller.GridMarshallerMappingConsistencyTest2%-#2582%marshaller.GridMarshallerMappingConsistencyTest2%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustTimeout' was changed from 'null' to '300000' [21:02:16] : [Step 4/5] [2021-11-19 21:02:16,971][INFO ][tcp-disco-msg-worker-[96da3d10 127.0.0.1:47500]-#133%marshaller.GridMarshallerMappingConsistencyTest2%-#2582%marshaller.GridMarshallerMappingConsistencyTest2%][IgniteTxManager] Transactions parameter 'longOperationsDumpTimeout' was changed from 'null' to '60000' [21:02:16] : [Step 4/5] [2021-11-19 21:02:16,971][INFO ][tcp-disco-msg-worker-[96da3d10 127.0.0.1:47500]-#133%marshaller.GridMarshallerMappingConsistencyTest2%-#2582%marshaller.GridMarshallerMappingConsistencyTest2%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpThreshold' was changed from 'null' to '0' [21:02:16] : [Step 4/5] [2021-11-19 21:02:16,972][INFO ][tcp-disco-msg-worker-[96da3d10 127.0.0.1:47500]-#133%marshaller.GridMarshallerMappingConsistencyTest2%-#2582%marshaller.GridMarshallerMappingConsistencyTest2%][IgniteTxManager] Transactions parameter 'transactionTimeDumpSamplesCoefficient' was changed from 'null' to '0.0' [21:02:16] : [Step 4/5] [2021-11-19 21:02:16,973][INFO ][tcp-disco-msg-worker-[96da3d10 127.0.0.1:47500]-#133%marshaller.GridMarshallerMappingConsistencyTest2%-#2582%marshaller.GridMarshallerMappingConsistencyTest2%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpSamplesPerSecondLimit' was changed from 'null' to '5' [21:02:16] : [Step 4/5] [2021-11-19 21:02:16,973][INFO ][tcp-disco-msg-worker-[96da3d10 127.0.0.1:47500]-#133%marshaller.GridMarshallerMappingConsistencyTest2%-#2582%marshaller.GridMarshallerMappingConsistencyTest2%][IgniteTxManager] Transactions parameter 'collisionsDumpInterval' was changed from 'null' to '1000' [21:02:16] : [Step 4/5] [2021-11-19 21:02:16,974][INFO ][tcp-disco-msg-worker-[96da3d10 127.0.0.1:47500]-#133%marshaller.GridMarshallerMappingConsistencyTest2%-#2582%marshaller.GridMarshallerMappingConsistencyTest2%][IgniteTxManager] Transactions parameter 'txOwnerDumpRequestsAllowed' was changed from 'null' to 'true' [21:02:16] : [Step 4/5] [2021-11-19 21:02:16,974][INFO ][tcp-disco-msg-worker-[96da3d10 127.0.0.1:47500]-#133%marshaller.GridMarshallerMappingConsistencyTest2%-#2582%marshaller.GridMarshallerMappingConsistencyTest2%][GridCacheDatabaseSharedManager] Historical rebalance WAL threshold changed [property=historical.rebalance.threshold, oldVal=null, newVal=500] [21:02:16] : [Step 4/5] [2021-11-19 21:02:16,976][INFO ][disco-notifier-worker-#2581%marshaller.GridMarshallerMappingConsistencyTest2%][MvccProcessorImpl] Assigned mvcc coordinator [crd=MvccCoordinator [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=0], nodeId=96da3d10-9365-4ae3-9783-33321c700001, ver=1637344935721, local=false, initialized=false]] [21:02:16] : [Step 4/5] [2021-11-19 21:02:16,977][INFO ][sys-#2557%marshaller.GridMarshallerMappingConsistencyTest2%][ClusterProcessor] Writing cluster ID and tag to metastorage on ready for write ClusterIdAndTag [id=2818301c-185b-4985-b230-d27f2cec6a5a, tag=amazing_margulis] [21:02:17] : [Step 4/5] [2021-11-19 21:02:17,000][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][GridMarshallerMappingConsistencyTest2] To start Console Management & Monitoring run ignitevisorcmd.{sh|bat} [21:02:17] : [Step 4/5] [2021-11-19 21:02:17,001][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][GridMarshallerMappingConsistencyTest2] [21:02:17] : [Step 4/5] [21:02:17] : [Step 4/5] >>> +-------------------------------------------+ [21:02:17] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:02:17] : [Step 4/5] >>> +-------------------------------------------+ [21:02:17] : [Step 4/5] >>> OS name: Linux 4.15.0-151-generic amd64 [21:02:17] : [Step 4/5] >>> CPU(s): 24 [21:02:17] : [Step 4/5] >>> Heap: 2.0GB [21:02:17] : [Step 4/5] >>> VM name: 16724@c4dfe9a430b2 [21:02:17] : [Step 4/5] >>> Ignite instance name: marshaller.GridMarshallerMappingConsistencyTest2 [21:02:17] : [Step 4/5] >>> Local node [ID=6057DD11-6D2A-4E45-8208-78AC4B700002, order=2, clientMode=false] [21:02:17] : [Step 4/5] >>> Local node addresses: [127.0.0.1] [21:02:17] : [Step 4/5] >>> Local ports: TCP:10801 TCP:45031 TCP:47501 [21:02:17] : [Step 4/5] [21:02:17] : [Step 4/5] [2021-11-19 21:02:17,002][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][GridMarshallerMappingConsistencyTest2] >>> Ignite cluster is in INACTIVE state (limited functionality available). Use control.(sh|bat) script or IgniteCluster.state(ClusterState.ACTIVE) to change the state. [21:02:17] : [Step 4/5] [2021-11-19 21:02:17,003][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][GridDiscoveryManager] Topology snapshot [ver=2, locNode=6057dd11, servers=2, clients=0, state=INACTIVE, CPUs=24, offheap=0.25GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=96da3d10-9365-4ae3-9783-33321c700001, consistentId=marshaller.GridMarshallerMappingConsistencyTest1, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=6057dd11-6d2a-4e45-8208-78ac4b700002, consistentId=marshaller.GridMarshallerMappingConsistencyTest2, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:02:17] : [Step 4/5] [2021-11-19 21:02:17,004][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][G] Node started : [stage="Configure system pool" (0 ms),stage="Start managers" (40 ms),stage="Configure binary metadata" (2 ms),stage="Start processors" (534 ms),stage="Start 'StanByClusterTestProvider' plugin" (0 ms),stage="Start 'PageMemory tracker plugin' plugin" (0 ms),stage="Start 'TestDistibutedConfigurationPlugin' plugin" (0 ms),stage="Start 'NodeValidationPluginProvider' plugin" (0 ms),stage="Init metastore" (22 ms),stage="Init and start regions" (9 ms),stage="Restore binary memory" (23 ms),stage="Restore logical state" (94 ms),stage="Finish recovery" (427 ms),stage="Join topology" (65 ms),stage="Await transition" (3 ms),stage="Await exchange" (24 ms),stage="Total time" (1243 ms)] [21:02:17] : [Step 4/5] [2021-11-19 21:02:17,005][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][root] Node started with the following configuration [id=6057dd11-6d2a-4e45-8208-78ac4b700002, marshaller=BinaryMarshaller [], discovery=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=5000, ackTimeout=5000, marsh=JdkMarshaller [clsFilter=org.apache.ignite.marshaller.MarshallerUtils$1@68549bc9], reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], binaryCfg=null, lateAff=true] [21:02:17] : [Step 4/5] [2021-11-19 21:02:17,008][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][GridClusterStateProcessor] Sending activate cluster request with BaselineTopology BaselineTopology [id=0, branchingHash=-4276398781, branchingType='New BaselineTopology', baselineNodes=[marshaller.GridMarshallerMappingConsistencyTest1, marshaller.GridMarshallerMappingConsistencyTest2]] [21:02:17] : [Step 4/5] [2021-11-19 21:02:17,014][INFO ][disco-notifier-worker-#2462%marshaller.GridMarshallerMappingConsistencyTest1%][GridClusterStateProcessor] Received activate cluster request with BaselineTopology[id=0] initiator node ID: 96da3d10-9365-4ae3-9783-33321c700001 [21:02:17] : [Step 4/5] [2021-11-19 21:02:17,015][INFO ][disco-notifier-worker-#2462%marshaller.GridMarshallerMappingConsistencyTest1%][GridClusterStateProcessor] Started state transition: activate cluster [21:02:17] : [Step 4/5] [2021-11-19 21:02:17,016][INFO ][exchange-worker-#2467%marshaller.GridMarshallerMappingConsistencyTest1%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], crd=true, evt=DISCOVERY_CUSTOM_EVT, evtNode=96da3d10-9365-4ae3-9783-33321c700001, customEvt=ChangeGlobalStateMessage [id=787ac593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqId=5b137c54-bd7a-4502-9b9e-2f2a6c5be431, initiatingNodeId=96da3d10-9365-4ae3-9783-33321c700001, state=ACTIVE, baselineTopology=BaselineTopology [id=0, branchingHash=-4276398781, branchingType='New BaselineTopology', baselineNodes=[marshaller.GridMarshallerMappingConsistencyTest1, marshaller.GridMarshallerMappingConsistencyTest2]], forceChangeBaselineTopology=false, timestamp=1637344937008, forceDeactivation=true], allowMerge=false, exchangeFreeSwitch=false] [21:02:17] : [Step 4/5] [2021-11-19 21:02:17,018][INFO ][exchange-worker-#2467%marshaller.GridMarshallerMappingConsistencyTest1%][GridDhtPartitionsExchangeFuture] Start activation process [nodeId=96da3d10-9365-4ae3-9783-33321c700001, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]]. New state: ACTIVE [21:02:17] : [Step 4/5] [2021-11-19 21:02:17,019][INFO ][exchange-worker-#2467%marshaller.GridMarshallerMappingConsistencyTest1%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/test/marshaller.GridMarshallerMappingConsistencyTest1/db/marshaller_GridMarshallerMappingConsistencyTest1 [21:02:17] : [Step 4/5] [2021-11-19 21:02:17,024][INFO ][disco-notifier-worker-#2581%marshaller.GridMarshallerMappingConsistencyTest2%][GridClusterStateProcessor] Received activate cluster request with BaselineTopology[id=0] initiator node ID: 96da3d10-9365-4ae3-9783-33321c700001 [21:02:17] : [Step 4/5] [2021-11-19 21:02:17,024][INFO ][exchange-worker-#2467%marshaller.GridMarshallerMappingConsistencyTest1%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/test/marshaller.GridMarshallerMappingConsistencyTest1/db/wal/marshaller_GridMarshallerMappingConsistencyTest1/0000000000000000.wal, offset=8795, ver=2] [21:02:17] : [Step 4/5] [2021-11-19 21:02:17,025][INFO ][disco-notifier-worker-#2581%marshaller.GridMarshallerMappingConsistencyTest2%][GridClusterStateProcessor] Started state transition: activate cluster [21:02:17] : [Step 4/5] [2021-11-19 21:02:17,027][INFO ][exchange-worker-#2467%marshaller.GridMarshallerMappingConsistencyTest1%][GridClusterStateProcessor] Writing BaselineTopology[id=0] [21:02:17] : [Step 4/5] [2021-11-19 21:02:17,028][INFO ][exchange-worker-#2590%marshaller.GridMarshallerMappingConsistencyTest2%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], crd=false, evt=DISCOVERY_CUSTOM_EVT, evtNode=96da3d10-9365-4ae3-9783-33321c700001, customEvt=ChangeGlobalStateMessage [id=787ac593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqId=5b137c54-bd7a-4502-9b9e-2f2a6c5be431, initiatingNodeId=96da3d10-9365-4ae3-9783-33321c700001, state=ACTIVE, baselineTopology=BaselineTopology [id=0, branchingHash=-4276398781, branchingType='New BaselineTopology', baselineNodes=[marshaller.GridMarshallerMappingConsistencyTest1, marshaller.GridMarshallerMappingConsistencyTest2]], forceChangeBaselineTopology=false, timestamp=1637344937008, forceDeactivation=true], allowMerge=false, exchangeFreeSwitch=false] [21:02:17] : [Step 4/5] [2021-11-19 21:02:17,030][INFO ][exchange-worker-#2467%marshaller.GridMarshallerMappingConsistencyTest1%][GridCacheDatabaseSharedManager] Finish recovery performed in 9 ms. [21:02:17] : [Step 4/5] [2021-11-19 21:02:17,032][INFO ][exchange-worker-#2590%marshaller.GridMarshallerMappingConsistencyTest2%][GridDhtPartitionsExchangeFuture] Start activation process [nodeId=6057dd11-6d2a-4e45-8208-78ac4b700002, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]]. New state: ACTIVE [21:02:17] : [Step 4/5] [2021-11-19 21:02:17,033][INFO ][exchange-worker-#2467%marshaller.GridMarshallerMappingConsistencyTest1%][msg] Components activation performed in 14 ms. [21:02:17] : [Step 4/5] [2021-11-19 21:02:17,033][INFO ][exchange-worker-#2590%marshaller.GridMarshallerMappingConsistencyTest2%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/test/marshaller.GridMarshallerMappingConsistencyTest2/db/marshaller_GridMarshallerMappingConsistencyTest2 [21:02:17] : [Step 4/5] [2021-11-19 21:02:17,035][INFO ][exchange-worker-#2467%marshaller.GridMarshallerMappingConsistencyTest1%][GridCacheProcessor] Finished recovery for cache [cache=ignite-sys-cache, grp=ignite-sys-cache, startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:02:17] : [Step 4/5] [2021-11-19 21:02:17,037][INFO ][exchange-worker-#2590%marshaller.GridMarshallerMappingConsistencyTest2%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/test/marshaller.GridMarshallerMappingConsistencyTest2/db/wal/marshaller_GridMarshallerMappingConsistencyTest2/0000000000000000.wal, offset=8795, ver=2] [21:02:17] : [Step 4/5] [2021-11-19 21:02:17,038][INFO ][exchange-worker-#2467%marshaller.GridMarshallerMappingConsistencyTest1%][GridDhtPartitionsExchangeFuture] Successfully activated caches [nodeId=96da3d10-9365-4ae3-9783-33321c700001, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], newState=ACTIVE] [21:02:17] : [Step 4/5] [2021-11-19 21:02:17,039][INFO ][exchange-worker-#2590%marshaller.GridMarshallerMappingConsistencyTest2%][GridClusterStateProcessor] Writing BaselineTopology[id=0] [21:02:17] : [Step 4/5] [2021-11-19 21:02:17,041][INFO ][exchange-worker-#2467%marshaller.GridMarshallerMappingConsistencyTest1%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:02:17] : [Step 4/5] [2021-11-19 21:02:17,043][INFO ][exchange-worker-#2590%marshaller.GridMarshallerMappingConsistencyTest2%][GridCacheDatabaseSharedManager] Finish recovery performed in 8 ms. [21:02:17] : [Step 4/5] [2021-11-19 21:02:17,049][INFO ][exchange-worker-#2590%marshaller.GridMarshallerMappingConsistencyTest2%][msg] Components activation performed in 16 ms. [21:02:17] : [Step 4/5] [2021-11-19 21:02:17,050][INFO ][exchange-worker-#2590%marshaller.GridMarshallerMappingConsistencyTest2%][GridCacheProcessor] Finished recovery for cache [cache=ignite-sys-cache, grp=ignite-sys-cache, startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:02:17] : [Step 4/5] [2021-11-19 21:02:17,051][INFO ][exchange-worker-#2590%marshaller.GridMarshallerMappingConsistencyTest2%][GridDhtPartitionsExchangeFuture] Successfully activated caches [nodeId=6057dd11-6d2a-4e45-8208-78ac4b700002, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], newState=ACTIVE] [21:02:17] : [Step 4/5] [2021-11-19 21:02:17,052][INFO ][exchange-worker-#2590%marshaller.GridMarshallerMappingConsistencyTest2%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:02:17] : [Step 4/5] [2021-11-19 21:02:17,099][INFO ][exchange-worker-#2467%marshaller.GridMarshallerMappingConsistencyTest1%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], crd=true] [21:02:17] : [Step 4/5] [2021-11-19 21:02:17,103][INFO ][db-checkpoint-thread-#2601%marshaller.GridMarshallerMappingConsistencyTest1%][Checkpointer] Checkpoint started [checkpointId=bbbe0313-6b28-4ac7-8f4d-744b784d2b42, startPtr=WALPointer [idx=0, fileOff=86529, len=1963], checkpointBeforeLockTime=40ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=1ms, checkpointLockHoldTime=3ms, walCpRecordFsyncDuration=2ms, writeCheckpointEntryDuration=2ms, splitAndSortCpPagesDuration=0ms, pages=18, reason='node started'] [21:02:17] : [Step 4/5] [2021-11-19 21:02:17,104][INFO ][grid-nio-worker-tcp-comm-0-#2405%TcpCommunicationSpi%][TcpCommunicationSpi] Accepted incoming communication connection [locAddr=/127.0.0.1:45030, rmtAddr=/127.0.0.1:42120] [21:02:17] : [Step 4/5] [2021-11-19 21:02:17,103][INFO ][db-checkpoint-thread-#2603%marshaller.GridMarshallerMappingConsistencyTest2%][Checkpointer] Checkpoint started [checkpointId=afbf2d06-e3a6-4586-be02-2b1634eba74e, startPtr=WALPointer [idx=0, fileOff=86529, len=1963], checkpointBeforeLockTime=25ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=3ms, writeCheckpointEntryDuration=2ms, splitAndSortCpPagesDuration=0ms, pages=18, reason='node started'] [21:02:17] : [Step 4/5] [2021-11-19 21:02:17,113][INFO ][grid-nio-worker-tcp-comm-0-#2524%TcpCommunicationSpi%][TcpCommunicationSpi] Established outgoing communication connection [locAddr=/127.0.0.1:42120, rmtAddr=/127.0.0.1:45030] [21:02:17] : [Step 4/5] [2021-11-19 21:02:17,114][INFO ][exchange-worker-#2590%marshaller.GridMarshallerMappingConsistencyTest2%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], crd=false] [21:02:17] : [Step 4/5] [2021-11-19 21:02:17,128][INFO ][sys-#2439%marshaller.GridMarshallerMappingConsistencyTest1%][GridDhtPartitionsExchangeFuture] Coordinator received single message [ver=AffinityTopologyVersion [topVer=2, minorTopVer=1], node=6057dd11-6d2a-4e45-8208-78ac4b700002, allReceived=true] [21:02:17] : [Step 4/5] [2021-11-19 21:02:17,129][INFO ][sys-#2439%marshaller.GridMarshallerMappingConsistencyTest1%][GridDhtPartitionsExchangeFuture] finishExchangeOnCoordinator [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:02:17] : [Step 4/5] [2021-11-19 21:02:17,144][INFO ][sys-#2439%marshaller.GridMarshallerMappingConsistencyTest1%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], err=null, rebalanced=true, wasRebalanced=false] [21:02:17] : [Step 4/5] [2021-11-19 21:02:17,144][INFO ][disco-notifier-worker-#2462%marshaller.GridMarshallerMappingConsistencyTest1%][GridClusterStateProcessor] Received state change finish message: ACTIVE [21:02:17] : [Step 4/5] [2021-11-19 21:02:17,146][INFO ][sys-#2580%marshaller.GridMarshallerMappingConsistencyTest2%][GridDhtPartitionsExchangeFuture] Received full message, will finish exchange [node=96da3d10-9365-4ae3-9783-33321c700001, resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:02:17] : [Step 4/5] [2021-11-19 21:02:17,145][INFO ][disco-notifier-worker-#2581%marshaller.GridMarshallerMappingConsistencyTest2%][GridClusterStateProcessor] Received state change finish message: ACTIVE [21:02:17] : [Step 4/5] [2021-11-19 21:02:17,147][INFO ][disco-notifier-worker-#2462%marshaller.GridMarshallerMappingConsistencyTest1%][GridClusterStateProcessor] Cluster state was changed from INACTIVE to ACTIVE [21:02:17] : [Step 4/5] [2021-11-19 21:02:17,150][INFO ][sys-#2580%marshaller.GridMarshallerMappingConsistencyTest2%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], err=null, rebalanced=true, wasRebalanced=false] [21:02:17] : [Step 4/5] [2021-11-19 21:02:17,150][INFO ][sys-#2439%marshaller.GridMarshallerMappingConsistencyTest1%][GridCacheProcessor] Finish proxy initialization, cacheName=ignite-sys-cache, localNodeId=96da3d10-9365-4ae3-9783-33321c700001 [21:02:17] : [Step 4/5] [2021-11-19 21:02:17,150][INFO ][sys-#2562%marshaller.GridMarshallerMappingConsistencyTest2%][GridCachePartitionExchangeManager] Delay process full message without exchange id (there is exchange in progress) [nodeId=96da3d10-9365-4ae3-9783-33321c700001] [21:02:17] : [Step 4/5] [2021-11-19 21:02:17,361][INFO ][sys-#2439%marshaller.GridMarshallerMappingConsistencyTest1%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=96da3d10-9365-4ae3-9783-33321c700001, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=96da3d10-9365-4ae3-9783-33321c700001, consistentId=marshaller.GridMarshallerMappingConsistencyTest1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637344937139, loc=true, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:02:17] : [Step 4/5] [2021-11-19 21:02:17,148][INFO ][disco-notifier-worker-#2581%marshaller.GridMarshallerMappingConsistencyTest2%][GridClusterStateProcessor] Cluster state was changed from INACTIVE to ACTIVE [21:02:17] : [Step 4/5] [2021-11-19 21:02:17,364][INFO ][sys-#2439%marshaller.GridMarshallerMappingConsistencyTest1%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (2 ms), stage="Update caches registry" (16 ms), stage="Start caches" (2 ms), stage="Affinity initialization on cache group start" (0 ms), stage="Determine exchange type" (2 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (5 ms), stage="Restore partition states" (0 ms), stage="After states restored callback" (52 ms), stage="WAL history reservation" (0 ms), stage="Waiting for all single messages" (30 ms), stage="Affinity recalculation (crd)" (0 ms), stage="Collect update counters and create affinity messages" (0 ms), stage="Assign partitions states" (1 ms), stage="Validate partitions states" (0 ms), stage="Ideal affinity diff calculation (enforced)" (0 ms), stage="Apply update counters" (0 ms), stage="Full message preparing" (10 ms), stage="Full message sending" (0 ms), stage="State finish message sending" (0 ms), stage="Detect lost partitions" (4 ms), stage="Exchange done" (215 ms), stage="Total time" (339 ms), Discovery lag=11 ms, Latest started node id=6057dd11-6d2a-4e45-8208-78ac4b700002] [21:02:17] : [Step 4/5] [2021-11-19 21:02:17,363][INFO ][sys-#2580%marshaller.GridMarshallerMappingConsistencyTest2%][GridCacheProcessor] Finish proxy initialization, cacheName=ignite-sys-cache, localNodeId=6057dd11-6d2a-4e45-8208-78ac4b700002 [21:02:17] : [Step 4/5] [2021-11-19 21:02:17,362][INFO ][exchange-worker-#2467%marshaller.GridMarshallerMappingConsistencyTest1%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=2, minorTopVer=1], force=false, evt=DISCOVERY_CUSTOM_EVT, node=96da3d10-9365-4ae3-9783-33321c700001] [21:02:17] : [Step 4/5] [2021-11-19 21:02:17,361][INFO ][sys-#2444%marshaller.GridMarshallerMappingConsistencyTest1%][DistributedBaselineConfiguration] Baseline auto-adjust is 'disabled' with timeout='300000' ms [21:02:17] : [Step 4/5] [2021-11-19 21:02:17,369][INFO ][sys-#2580%marshaller.GridMarshallerMappingConsistencyTest2%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=6057dd11-6d2a-4e45-8208-78ac4b700002, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=96da3d10-9365-4ae3-9783-33321c700001, consistentId=marshaller.GridMarshallerMappingConsistencyTest1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637344936955, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:02:17] : [Step 4/5] [2021-11-19 21:02:17,369][INFO ][sys-#2444%marshaller.GridMarshallerMappingConsistencyTest1%][GridClusterStateProcessor] Successfully performed final activation steps [nodeId=96da3d10-9365-4ae3-9783-33321c700001, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:02:17] : [Step 4/5] [2021-11-19 21:02:17,369][INFO ][exchange-worker-#2590%marshaller.GridMarshallerMappingConsistencyTest2%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=2, minorTopVer=1], force=false, evt=DISCOVERY_CUSTOM_EVT, node=96da3d10-9365-4ae3-9783-33321c700001] [21:02:17] : [Step 4/5] [2021-11-19 21:02:17,368][INFO ][sys-#2559%marshaller.GridMarshallerMappingConsistencyTest2%][DistributedBaselineConfiguration] Baseline auto-adjust is 'disabled' with timeout='300000' ms [21:02:17] : [Step 4/5] [2021-11-19 21:02:17,367][INFO ][sys-#2439%marshaller.GridMarshallerMappingConsistencyTest1%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], stage="Affinity initialization on cache group start [grp=ignite-sys-cache]" (0 ms) (parent=Affinity initialization on cache group start), stage="Affinity centralized initialization (crd) [grp=ignite-sys-cache, crd=true]" (1 ms) (parent=Determine exchange type), stage="Restore partition states [grp=ignite-sys-cache]" (0 ms) (parent=Restore partition states), stage="Affinity recalculation (partitions availability) [grp=ignite-sys-cache]" (0 ms) (parent=Ideal affinity diff calculation (enforced))] [21:02:17] : [Step 4/5] [2021-11-19 21:02:17,374][INFO ][exchange-worker-#2590%marshaller.GridMarshallerMappingConsistencyTest2%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], crd=false, evt=DISCOVERY_CUSTOM_EVT, evtNode=96da3d10-9365-4ae3-9783-33321c700001, customEvt=DynamicCacheChangeBatch [id=ba7ac593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqs=ArrayList [DynamicCacheChangeRequest [cacheName=cache, hasCfg=true, nodeId=96da3d10-9365-4ae3-9783-33321c700001, clientStartOnly=false, stop=false, destroy=false, disabledAfterStart=false]], exchangeActions=ExchangeActions [startCaches=[cache], stopCaches=null, startGrps=[cache], stopGrps=[], resetParts=null, stateChangeRequest=null], startCaches=false], allowMerge=false, exchangeFreeSwitch=false] [21:02:17] : [Step 4/5] [2021-11-19 21:02:17,373][INFO ][exchange-worker-#2467%marshaller.GridMarshallerMappingConsistencyTest1%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], crd=true, evt=DISCOVERY_CUSTOM_EVT, evtNode=96da3d10-9365-4ae3-9783-33321c700001, customEvt=DynamicCacheChangeBatch [id=ba7ac593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqs=ArrayList [DynamicCacheChangeRequest [cacheName=cache, hasCfg=true, nodeId=96da3d10-9365-4ae3-9783-33321c700001, clientStartOnly=false, stop=false, destroy=false, disabledAfterStart=false]], exchangeActions=ExchangeActions [startCaches=[cache], stopCaches=null, startGrps=[cache], stopGrps=[], resetParts=null, stateChangeRequest=null], startCaches=false], allowMerge=false, exchangeFreeSwitch=false] [21:02:17] : [Step 4/5] [2021-11-19 21:02:17,372][INFO ][sys-#2559%marshaller.GridMarshallerMappingConsistencyTest2%][GridClusterStateProcessor] Successfully performed final activation steps [nodeId=6057dd11-6d2a-4e45-8208-78ac4b700002, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:02:17] : [Step 4/5] [2021-11-19 21:02:17,371][INFO ][sys-#2580%marshaller.GridMarshallerMappingConsistencyTest2%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (3 ms), stage="Update caches registry" (18 ms), stage="Start caches" (0 ms), stage="Affinity initialization on cache group start" (0 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Restore partition states" (0 ms), stage="After states restored callback" (45 ms), stage="WAL history reservation" (0 ms), stage="Waiting for Full message" (47 ms), stage="Affinity recalculation" (2 ms), stage="Full map updating" (2 ms), stage="Detect lost partitions" (211 ms), stage="Exchange done" (8 ms), stage="Total time" (336 ms)] [21:02:17] : [Step 4/5] [2021-11-19 21:02:17,378][INFO ][exchange-worker-#2590%marshaller.GridMarshallerMappingConsistencyTest2%][PageMemoryImpl] Started page memory [memoryAllocated=256.0 MiB, pages=63504, tableSize=4.9 MiB, replacementSize=7.9 KiB, checkpointBuffer=256.0 MiB] [21:02:17] : [Step 4/5] [2021-11-19 21:02:17,379][INFO ][sys-#2580%marshaller.GridMarshallerMappingConsistencyTest2%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], stage="Affinity initialization on cache group start [grp=ignite-sys-cache]" (0 ms) (parent=Affinity initialization on cache group start), stage="Affinity centralized initialization (crd) [grp=ignite-sys-cache, crd=false]" (0 ms) (parent=Determine exchange type), stage="Restore partition states [grp=ignite-sys-cache]" (0 ms) (parent=Restore partition states), stage="Affinity applying from full message [grp=ignite-sys-cache]" (2 ms) (parent=Affinity recalculation)] [21:02:17] : [Step 4/5] [2021-11-19 21:02:17,382][INFO ][exchange-worker-#2467%marshaller.GridMarshallerMappingConsistencyTest1%][PageMemoryImpl] Started page memory [memoryAllocated=256.0 MiB, pages=63504, tableSize=4.9 MiB, replacementSize=7.9 KiB, checkpointBuffer=256.0 MiB] [21:02:17] : [Step 4/5] [2021-11-19 21:02:17,477][INFO ][exchange-worker-#2590%marshaller.GridMarshallerMappingConsistencyTest2%][GridCacheProcessor] Started cache [name=cache, id=94416770, dataRegionName=default, mode=PARTITIONED, atomicity=ATOMIC, backups=1, mvcc=false] [21:02:17] : [Step 4/5] [2021-11-19 21:02:17,484][INFO ][exchange-worker-#2467%marshaller.GridMarshallerMappingConsistencyTest1%][GridCacheProcessor] Started cache [name=cache, id=94416770, dataRegionName=default, mode=PARTITIONED, atomicity=ATOMIC, backups=1, mvcc=false] [21:02:17] : [Step 4/5] [2021-11-19 21:02:17,486][INFO ][exchange-worker-#2590%marshaller.GridMarshallerMappingConsistencyTest2%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], waitTime=0ms, futInfo=NA, mode=DISTRIBUTED] [21:02:17] : [Step 4/5] [2021-11-19 21:02:17,492][INFO ][exchange-worker-#2467%marshaller.GridMarshallerMappingConsistencyTest1%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], waitTime=0ms, futInfo=NA, mode=DISTRIBUTED] [21:02:17] : [Step 4/5] [2021-11-19 21:02:17,493][INFO ][exchange-worker-#2467%marshaller.GridMarshallerMappingConsistencyTest1%][GridDhtPartitionsExchangeFuture] Finished waiting for partitions release latch: ServerLatch [permits=0, pendingAcks=HashSet [], super=CompletableLatch [id=CompletableLatchUid [id=exchange, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2]]]] [21:02:17] : [Step 4/5] [2021-11-19 21:02:17,494][INFO ][exchange-worker-#2467%marshaller.GridMarshallerMappingConsistencyTest1%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:02:17] : [Step 4/5] [2021-11-19 21:02:17,494][INFO ][exchange-worker-#2590%marshaller.GridMarshallerMappingConsistencyTest2%][GridDhtPartitionsExchangeFuture] Finished waiting for partitions release latch: ClientLatch [coordinator=TcpDiscoveryNode [id=96da3d10-9365-4ae3-9783-33321c700001, consistentId=marshaller.GridMarshallerMappingConsistencyTest1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637344936955, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], ackSent=true, super=CompletableLatch [id=CompletableLatchUid [id=exchange, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2]]]] [21:02:17] : [Step 4/5] [2021-11-19 21:02:17,496][INFO ][exchange-worker-#2590%marshaller.GridMarshallerMappingConsistencyTest2%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:02:17] : [Step 4/5] [2021-11-19 21:02:17,546][INFO ][db-checkpoint-thread-#2603%marshaller.GridMarshallerMappingConsistencyTest2%][Checkpointer] Checkpoint finished [cpId=afbf2d06-e3a6-4586-be02-2b1634eba74e, pages=18, markPos=WALPointer [idx=0, fileOff=86529, len=1963], walSegmentsCovered=[], markDuration=9ms, pagesWrite=26ms, fsync=414ms, total=474ms] [21:02:17] : [Step 4/5] [2021-11-19 21:02:17,618][INFO ][exchange-worker-#2467%marshaller.GridMarshallerMappingConsistencyTest1%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], crd=true] [21:02:17] : [Step 4/5] [2021-11-19 21:02:17,619][INFO ][exchange-worker-#2590%marshaller.GridMarshallerMappingConsistencyTest2%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], crd=false] [21:02:17] : [Step 4/5] [2021-11-19 21:02:17,620][INFO ][sys-#2443%marshaller.GridMarshallerMappingConsistencyTest1%][GridDhtPartitionsExchangeFuture] Coordinator received single message [ver=AffinityTopologyVersion [topVer=2, minorTopVer=2], node=6057dd11-6d2a-4e45-8208-78ac4b700002, allReceived=true] [21:02:17] : [Step 4/5] [2021-11-19 21:02:17,620][INFO ][sys-#2443%marshaller.GridMarshallerMappingConsistencyTest1%][GridDhtPartitionsExchangeFuture] finishExchangeOnCoordinator [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2]] [21:02:17] : [Step 4/5] [2021-11-19 21:02:17,644][INFO ][sys-#2443%marshaller.GridMarshallerMappingConsistencyTest1%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], err=null, rebalanced=true, wasRebalanced=true] [21:02:17] : [Step 4/5] [2021-11-19 21:02:17,647][INFO ][sys-#2571%marshaller.GridMarshallerMappingConsistencyTest2%][GridDhtPartitionsExchangeFuture] Received full message, will finish exchange [node=96da3d10-9365-4ae3-9783-33321c700001, resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2]] [21:02:17] : [Step 4/5] [2021-11-19 21:02:17,648][INFO ][sys-#2443%marshaller.GridMarshallerMappingConsistencyTest1%][GridCacheProcessor] Finish proxy initialization, cacheName=cache, localNodeId=96da3d10-9365-4ae3-9783-33321c700001 [21:02:17] : [Step 4/5] [2021-11-19 21:02:17,654][INFO ][sys-#2571%marshaller.GridMarshallerMappingConsistencyTest2%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], err=null, rebalanced=true, wasRebalanced=true] [21:02:17] : [Step 4/5] [2021-11-19 21:02:17,657][INFO ][exchange-worker-#2467%marshaller.GridMarshallerMappingConsistencyTest1%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=2, minorTopVer=2], force=false, evt=DISCOVERY_CUSTOM_EVT, node=96da3d10-9365-4ae3-9783-33321c700001] [21:02:17] : [Step 4/5] [2021-11-19 21:02:17,657][INFO ][sys-#2443%marshaller.GridMarshallerMappingConsistencyTest1%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=96da3d10-9365-4ae3-9783-33321c700001, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=96da3d10-9365-4ae3-9783-33321c700001, consistentId=marshaller.GridMarshallerMappingConsistencyTest1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637344937371, loc=true, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2]] [21:02:17] : [Step 4/5] [2021-11-19 21:02:17,657][INFO ][sys-#2571%marshaller.GridMarshallerMappingConsistencyTest2%][GridCacheProcessor] Finish proxy initialization, cacheName=cache, localNodeId=6057dd11-6d2a-4e45-8208-78ac4b700002 [21:02:17] : [Step 4/5] [2021-11-19 21:02:17,659][INFO ][sys-#2571%marshaller.GridMarshallerMappingConsistencyTest2%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=6057dd11-6d2a-4e45-8208-78ac4b700002, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=96da3d10-9365-4ae3-9783-33321c700001, consistentId=marshaller.GridMarshallerMappingConsistencyTest1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637344936955, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2]] [21:02:17] : [Step 4/5] [2021-11-19 21:02:17,659][INFO ][sys-#2443%marshaller.GridMarshallerMappingConsistencyTest1%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (4 ms), stage="Update caches registry" (0 ms), stage="Start caches" (107 ms), stage="Affinity initialization on cache group start" (6 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (1 ms), stage="Wait partitions release latch [latch=exchange]" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Restore partition states" (25 ms), stage="After states restored callback" (97 ms), stage="WAL history reservation" (0 ms), stage="Waiting for all single messages" (2 ms), stage="Affinity recalculation (crd)" (0 ms), stage="Collect update counters and create affinity messages" (0 ms), stage="Assign partitions states" (8 ms), stage="Validate partitions states" (1 ms), stage="Apply update counters" (0 ms), stage="Full message preparing" (12 ms), stage="Full message sending" (0 ms), stage="Exchange done" (14 ms), stage="Total time" (277 ms), Discovery lag=1 ms, Latest started node id=6057dd11-6d2a-4e45-8208-78ac4b700002] [21:02:17] : [Step 4/5] [2021-11-19 21:02:17,662][INFO ][exchange-worker-#2590%marshaller.GridMarshallerMappingConsistencyTest2%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=2, minorTopVer=2], force=false, evt=DISCOVERY_CUSTOM_EVT, node=96da3d10-9365-4ae3-9783-33321c700001] [21:02:17] : [Step 4/5] [2021-11-19 21:02:17,665][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][root] >>> Stopping grid [name=marshaller.GridMarshallerMappingConsistencyTest2, id=6057dd11-6d2a-4e45-8208-78ac4b700002] [21:02:17] : [Step 4/5] [2021-11-19 21:02:17,660][INFO ][sys-#2571%marshaller.GridMarshallerMappingConsistencyTest2%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (1 ms), stage="Update caches registry" (0 ms), stage="Start caches" (100 ms), stage="Affinity initialization on cache group start" (8 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Wait partitions release latch [latch=exchange]" (8 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Restore partition states" (30 ms), stage="After states restored callback" (89 ms), stage="WAL history reservation" (0 ms), stage="Waiting for Full message" (30 ms), stage="Affinity recalculation" (0 ms), stage="Full map updating" (5 ms), stage="Exchange done" (6 ms), stage="Total time" (277 ms)] [21:02:17] : [Step 4/5] [2021-11-19 21:02:17,663][INFO ][sys-#2443%marshaller.GridMarshallerMappingConsistencyTest1%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], stage="Affinity initialization on cache group start [grp=cache]" (6 ms) (parent=Affinity initialization on cache group start), stage="Restore partition states [grp=cache]" (25 ms) (parent=Restore partition states), stage="Restore partition states [grp=ignite-sys-cache]" (0 ms) (parent=Restore partition states)] [21:02:17] : [Step 4/5] [2021-11-19 21:02:17,674][INFO ][sys-#2571%marshaller.GridMarshallerMappingConsistencyTest2%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], stage="Affinity initialization on cache group start [grp=cache]" (8 ms) (parent=Affinity initialization on cache group start), stage="Restore partition states [grp=cache]" (30 ms) (parent=Restore partition states), stage="Restore partition states [grp=ignite-sys-cache]" (1 ms) (parent=Restore partition states)] [21:02:18] : [Step 4/5] [2021-11-19 21:02:18,012][INFO ][db-checkpoint-thread-#2601%marshaller.GridMarshallerMappingConsistencyTest1%][Checkpointer] Checkpoint finished [cpId=bbbe0313-6b28-4ac7-8f4d-744b784d2b42, pages=18, markPos=WALPointer [idx=0, fileOff=86529, len=1963], walSegmentsCovered=[], markDuration=8ms, pagesWrite=38ms, fsync=870ms, total=956ms] [21:02:18] : [Step 4/5] [2021-11-19 21:02:18,020][INFO ][db-checkpoint-thread-#2603%marshaller.GridMarshallerMappingConsistencyTest2%][Checkpointer] Checkpoint started [checkpointId=ccb8d1e0-7d17-4a2b-9329-a4c601275f42, startPtr=WALPointer [idx=0, fileOff=170707, len=21409], checkpointBeforeLockTime=2ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=2ms, checkpointLockHoldTime=5ms, walCpRecordFsyncDuration=324ms, writeCheckpointEntryDuration=11ms, splitAndSortCpPagesDuration=0ms, pages=5, reason='timeout'] [21:02:18] : [Step 4/5] [2021-11-19 21:02:18,037][INFO ][db-checkpoint-thread-#2603%marshaller.GridMarshallerMappingConsistencyTest2%][Checkpointer] Checkpoint finished [cpId=ccb8d1e0-7d17-4a2b-9329-a4c601275f42, pages=5, markPos=WALPointer [idx=0, fileOff=170707, len=21409], walSegmentsCovered=[], markDuration=341ms, pagesWrite=0ms, fsync=16ms, total=359ms] [21:02:18] : [Step 4/5] [2021-11-19 21:02:18,044][INFO ][db-checkpoint-thread-#2603%marshaller.GridMarshallerMappingConsistencyTest2%][Checkpointer] Skipping checkpoint (no pages were modified) [checkpointBeforeLockTime=2ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=2ms, checkpointLockHoldTime=4ms, reason='timeout'] [21:02:18] : [Step 4/5] [2021-11-19 21:02:18,051][INFO ][tcp-disco-sock-reader-[96da3d10 127.0.0.1:35721]-#137%marshaller.GridMarshallerMappingConsistencyTest2%-#2586%marshaller.GridMarshallerMappingConsistencyTest2%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:35721, rmtPort=35721, rmtNodeId=96da3d10-9365-4ae3-9783-33321c700001] [21:02:18] : [Step 4/5] [2021-11-19 21:02:18,052][INFO ][disco-event-worker-#2466%marshaller.GridMarshallerMappingConsistencyTest1%][GridDiscoveryManager] Node left topology: TcpDiscoveryNode [id=6057dd11-6d2a-4e45-8208-78ac4b700002, consistentId=marshaller.GridMarshallerMappingConsistencyTest2, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637344936924, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false] [21:02:18] : [Step 4/5] [2021-11-19 21:02:18,054][INFO ][disco-event-worker-#2466%marshaller.GridMarshallerMappingConsistencyTest1%][GridDiscoveryManager] Topology snapshot [ver=3, locNode=96da3d10, servers=1, clients=0, state=ACTIVE, CPUs=24, offheap=0.25GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=96da3d10-9365-4ae3-9783-33321c700001, consistentId=marshaller.GridMarshallerMappingConsistencyTest1, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:02:18] : [Step 4/5] [2021-11-19 21:02:18,054][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][GridCacheProcessor] Stopped cache [cacheName=ignite-sys-cache] [21:02:18] : [Step 4/5] [2021-11-19 21:02:18,055][INFO ][disco-event-worker-#2466%marshaller.GridMarshallerMappingConsistencyTest1%][GridDiscoveryManager] ^-- Baseline [id=0, size=2, online=1, offline=1] [21:02:18] : [Step 4/5] [2021-11-19 21:02:18,056][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][GridCacheProcessor] Stopped cache [cacheName=cache] [21:02:18]W: [org.apache.ignite:ignite-core] [2021-11-19 21:02:18,057][WARN ][grid-nio-worker-tcp-comm-0-#2405%TcpCommunicationSpi%][TcpCommunicationSpi] Failed to shutdown socket [21:02:18]W: [org.apache.ignite:ignite-core] java.nio.channels.ClosedChannelException [21:02:18]W: [org.apache.ignite:ignite-core] at sun.nio.ch.SocketChannelImpl.shutdownOutput(SocketChannelImpl.java:795) [21:02:18]W: [org.apache.ignite:ignite-core] at sun.nio.ch.SocketAdaptor.shutdownOutput(SocketAdaptor.java:407) [21:02:18]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.close(IgniteUtils.java:4247) [21:02:18]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.closeKey(GridNioServer.java:2784) [21:02:18]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.close(GridNioServer.java:2835) [21:02:18]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.close(GridNioServer.java:2794) [21:02:18]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.bodyInternal(GridNioServer.java:2157) [21:02:18]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.body(GridNioServer.java:1910) [21:02:18]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:125) [21:02:18]W: [org.apache.ignite:ignite-core] at java.lang.Thread.run(Thread.java:748) [21:02:18] : [Step 4/5] [2021-11-19 21:02:18,058][INFO ][exchange-worker-#2467%marshaller.GridMarshallerMappingConsistencyTest1%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], crd=true, evt=NODE_LEFT, evtNode=6057dd11-6d2a-4e45-8208-78ac4b700002, customEvt=null, allowMerge=false, exchangeFreeSwitch=true] [21:02:18] : [Step 4/5] [2021-11-19 21:02:18,063][INFO ][sys-#2438%marshaller.GridMarshallerMappingConsistencyTest1%][GridAffinityAssignmentCache] Local node affinity assignment distribution is not ideal [cache=cache, expectedPrimary=1024.00, actualPrimary=1024, expectedBackups=1024.00, actualBackups=0, warningThreshold=50.00%] [21:02:18] : [Step 4/5] [2021-11-19 21:02:18,066][INFO ][exchange-worker-#2467%marshaller.GridMarshallerMappingConsistencyTest1%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:02:18] : [Step 4/5] [2021-11-19 21:02:18,071][INFO ][exchange-worker-#2467%marshaller.GridMarshallerMappingConsistencyTest1%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], err=null, rebalanced=true, wasRebalanced=true] [21:02:18] : [Step 4/5] [2021-11-19 21:02:18,076][INFO ][exchange-worker-#2467%marshaller.GridMarshallerMappingConsistencyTest1%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=96da3d10-9365-4ae3-9783-33321c700001, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], evt=NODE_LEFT, evtNode=TcpDiscoveryNode [id=6057dd11-6d2a-4e45-8208-78ac4b700002, consistentId=marshaller.GridMarshallerMappingConsistencyTest2, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637344936924, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0]] [21:02:18] : [Step 4/5] [2021-11-19 21:02:18,078][INFO ][exchange-worker-#2467%marshaller.GridMarshallerMappingConsistencyTest1%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (1 ms), stage="Determine exchange type" (5 ms), stage="Preloading notification" (0 ms), stage="After states restored callback" (0 ms), stage="WAL history reservation" (0 ms), stage="Finalize update counters" (1 ms), stage="Detect lost partitions" (4 ms), stage="Exchange done" (4 ms), stage="Total time" (15 ms)] [21:02:18] : [Step 4/5] [2021-11-19 21:02:18,079][INFO ][exchange-worker-#2467%marshaller.GridMarshallerMappingConsistencyTest1%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], stage="Affinity initialization (exchange-free switch on fully-rebalanced topology) [grp=cache]" (5 ms) (parent=Determine exchange type), stage="Affinity initialization (exchange-free switch on fully-rebalanced topology) [grp=ignite-sys-cache]" (1 ms) (parent=Determine exchange type)] [21:02:18] : [Step 4/5] [2021-11-19 21:02:18,080][INFO ][exchange-worker-#2467%marshaller.GridMarshallerMappingConsistencyTest1%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], crd=true] [21:02:18] : [Step 4/5] [2021-11-19 21:02:18,082][INFO ][exchange-worker-#2467%marshaller.GridMarshallerMappingConsistencyTest1%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=3, minorTopVer=0], force=false, evt=NODE_LEFT, node=6057dd11-6d2a-4e45-8208-78ac4b700002] [21:02:18] : [Step 4/5] [2021-11-19 21:02:18,962][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][FilePageStoreManager] Cleanup cache stores [total=4, left=0, cleanFiles=false] [21:02:18] : [Step 4/5] [2021-11-19 21:02:18,965][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][GridDeploymentLocalStore] Removed undeployed class: GridDeployment [ts=1637344937139, depMode=SHARED, clsLdr=IsolatedClassLoader{roleName='test'}, clsLdrId=697ac593d71-6057dd11-6d2a-4e45-8208-78ac4b700002, userVer=0, loc=true, sampleClsName=org.apache.ignite.internal.processors.cache.distributed.dht.preloader.IgniteDhtPartitionHistorySuppliersMap, pendingUndeploy=false, undeployed=true, usage=0] [21:02:18] : [Step 4/5] [2021-11-19 21:02:18,979][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][GridMarshallerMappingConsistencyTest2] [21:02:18] : [Step 4/5] [21:02:18] : [Step 4/5] >>> +------------------------------------------------------+ [21:02:18] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV stopped OK [21:02:18] : [Step 4/5] >>> +------------------------------------------------------+ [21:02:18] : [Step 4/5] >>> Ignite instance name: marshaller.GridMarshallerMappingConsistencyTest2 [21:02:18] : [Step 4/5] >>> Grid uptime: 00:00:01.975 [21:02:18] : [Step 4/5] [21:02:18] : [Step 4/5] [21:02:19] : [Step 4/5] [2021-11-19 21:02:19,010][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][GridMarshallerMappingConsistencyTest2] [21:02:19] : [Step 4/5] [21:02:19] : [Step 4/5] >>> __________ ________________ [21:02:19] : [Step 4/5] >>> / _/ ___/ |/ / _/_ __/ __/ [21:02:19] : [Step 4/5] >>> _/ // (7 7 // / / / / _/ [21:02:19] : [Step 4/5] >>> /___/\___/_/|_/___/ /_/ /___/ [21:02:19] : [Step 4/5] >>> [21:02:19] : [Step 4/5] >>> ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:02:19] : [Step 4/5] >>> 2021 Copyright(C) Apache Software Foundation [21:02:19] : [Step 4/5] >>> [21:02:19] : [Step 4/5] >>> Ignite documentation: http://ignite.apache.org [21:02:19] : [Step 4/5] [21:02:19] : [Step 4/5] [2021-11-19 21:02:19,011][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][GridMarshallerMappingConsistencyTest2] Config URL: n/a [21:02:19] : [Step 4/5] [2021-11-19 21:02:19,012][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][GridMarshallerMappingConsistencyTest2] IgniteConfiguration [igniteInstanceName=marshaller.GridMarshallerMappingConsistencyTest2, pubPoolSize=24, svcPoolSize=24, callbackPoolSize=24, stripedPoolSize=24, sysPoolSize=24, mgmtPoolSize=4, dataStreamerPoolSize=24, utilityCachePoolSize=24, utilityCacheKeepAliveTime=60000, p2pPoolSize=2, qryPoolSize=24, buildIdxPoolSize=4, igniteHome=/opt/buildagent/work/7bc1c54bc719b67c, igniteWorkDir=/opt/buildagent/work/7bc1c54bc719b67c/work/test/marshaller.GridMarshallerMappingConsistencyTest2, mbeanSrv=com.sun.jmx.mbeanserver.JmxMBeanServer@6fe85038, nodeId=850afc57-48b6-4649-99c9-a7f22de00002, marsh=BinaryMarshaller [], marshLocJobs=false, daemon=false, p2pEnabled=true, netTimeout=10000, netCompressionLevel=1, sndRetryDelay=1000, sndRetryCnt=3, metricsHistSize=10000, metricsUpdateFreq=1000, metricsExpTime=9223372036854775807, discoSpi=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=0, ackTimeout=0, marsh=null, reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], segPlc=STOP, segResolveAttempts=2, waitForSegOnStart=true, allResolversPassReq=true, segChkFreq=10000, commSpi=TcpCommunicationSpi [connectGate=org.apache.ignite.spi.communication.tcp.internal.ConnectGateway@29c0f761, ctxInitLatch=java.util.concurrent.CountDownLatch@423c827d[Count = 1], stopping=false, clientPool=null, nioSrvWrapper=null, stateProvider=null], evtSpi=MemoryEventStorageSpi [expireAgeMs=9223372036854775807, expireCnt=10000, filter=null], colSpi=NoopCollisionSpi [], deploySpi=LocalDeploymentSpi [], indexingSpi=org.apache.ignite.spi.indexing.noop.NoopIndexingSpi@3aeed9dc, addrRslvr=null, encryptionSpi=org.apache.ignite.spi.encryption.noop.NoopEncryptionSpi@4f10abe5, tracingSpi=org.apache.ignite.spi.tracing.NoopTracingSpi@6dec09fd, clientMode=false, rebalanceThreadPoolSize=4, rebalanceTimeout=10000, rebalanceBatchesPrefetchCnt=3, rebalanceThrottle=0, rebalanceBatchSize=524288, txCfg=TransactionConfiguration [txSerEnabled=false, dfltIsolation=REPEATABLE_READ, dfltConcurrency=PESSIMISTIC, dfltTxTimeout=0, txTimeoutOnPartitionMapExchange=0, deadlockTimeout=10000, pessimisticTxLogSize=0, pessimisticTxLogLinger=10000, tmLookupClsName=null, txManagerFactory=null, useJtaSync=false], cacheSanityCheckEnabled=true, discoStartupDelay=60000, deployMode=SHARED, p2pMissedCacheSize=100, locHost=127.0.0.1, timeSrvPortBase=31100, timeSrvPortRange=100, failureDetectionTimeout=10000, sysWorkerBlockedTimeout=null, clientFailureDetectionTimeout=10000, metricsLogFreq=0, connectorCfg=null, odbcCfg=null, warmupClos=null, atomicCfg=AtomicConfiguration [seqReserveSize=1000, cacheMode=PARTITIONED, backups=1, aff=null, grpName=null], classLdr=null, sslCtxFactory=null, platformCfg=null, binaryCfg=null, memCfg=null, pstCfg=null, dsCfg=DataStorageConfiguration [sysRegionInitSize=41943040, sysRegionMaxSize=104857600, pageSize=0, concLvl=0, dfltDataRegConf=DataRegionConfiguration [name=default, maxSize=268435456, initSize=268435456, swapPath=null, pageEvictionMode=DISABLED, pageReplacementMode=CLOCK, evictionThreshold=0.9, emptyPagesPoolSize=100, metricsEnabled=false, metricsSubIntervalCount=5, metricsRateTimeInterval=60000, persistenceEnabled=true, checkpointPageBufSize=0, lazyMemoryAllocation=true, warmUpCfg=null], dataRegions=null, storagePath=null, checkpointFreq=180000, lockWaitTime=10000, checkpointThreads=4, checkpointWriteOrder=SEQUENTIAL, walHistSize=20, maxWalArchiveSize=1073741824, walSegments=10, walSegmentSize=67108864, walPath=db/wal, walArchivePath=db/wal/archive, cdcWalPath=db/wal/cdc, cdcEnabled=false, metricsEnabled=false, walMode=LOG_ONLY, walTlbSize=131072, walBuffSize=0, walFlushFreq=2000, walFsyncDelay=1000, walRecordIterBuffSize=67108864, alwaysWriteFullPages=false, fileIOFactory=org.apache.ignite.internal.processors.cache.persistence.file.AsyncFileIOFactory@66751598, metricsSubIntervalCnt=5, metricsRateTimeInterval=60000, walAutoArchiveAfterInactivity=-1, walForceArchiveTimeout=-1, writeThrottlingEnabled=false, walCompactionEnabled=false, walCompactionLevel=1, checkpointReadLockTimeout=null, walPageCompression=DISABLED, walPageCompressionLevel=null, dfltWarmUpCfg=null, encCfg=org.apache.ignite.configuration.EncryptionConfiguration@15ded002, defragmentationThreadPoolSize=4, minWalArchiveSize=-1], snapshotPath=snapshots, activeOnStart=true, activeOnStartPropSetFlag=false, autoActivation=true, autoActivationPropSetFlag=false, clusterStateOnStart=null, sqlConnCfg=null, cliConnCfg=ClientConnectorConfiguration [host=null, port=10800, portRange=100, sockSndBufSize=0, sockRcvBufSize=0, tcpNoDelay=true, maxOpenCursorsPerConn=128, threadPoolSize=24, selectorCnt=12, idleTimeout=0, handshakeTimeout=10000, jdbcEnabled=true, odbcEnabled=true, thinCliEnabled=true, sslEnabled=false, useIgniteSslCtxFactory=true, sslClientAuth=false, sslCtxFactory=null, thinCliCfg=ThinClientConfiguration [maxActiveTxPerConn=100, maxActiveComputeTasksPerConn=0]], mvccVacuumThreadCnt=2, mvccVacuumFreq=5000, authEnabled=false, failureHnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]], commFailureRslvr=null, sqlCfg=SqlConfiguration [longQryWarnTimeout=3000, dfltQryTimeout=0, sqlQryHistSize=1000, validationEnabled=false], asyncContinuationExecutor=null] [21:02:19] : [Step 4/5] [2021-11-19 21:02:19,024][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][GridMarshallerMappingConsistencyTest2] Daemon mode: off [21:02:19] : [Step 4/5] [2021-11-19 21:02:19,025][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][GridMarshallerMappingConsistencyTest2] OS: Linux 4.15.0-151-generic amd64 [21:02:19] : [Step 4/5] [2021-11-19 21:02:19,025][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][GridMarshallerMappingConsistencyTest2] OS user: teamcity [21:02:19] : [Step 4/5] [2021-11-19 21:02:19,026][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][GridMarshallerMappingConsistencyTest2] PID: 16724 [21:02:19] : [Step 4/5] [2021-11-19 21:02:19,026][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][GridMarshallerMappingConsistencyTest2] Language runtime: Java Platform API Specification ver. 1.8 [21:02:19] : [Step 4/5] [2021-11-19 21:02:19,027][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][GridMarshallerMappingConsistencyTest2] VM information: Java(TM) SE Runtime Environment 1.8.0_261-b12 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 25.261-b12 [21:02:19] : [Step 4/5] [2021-11-19 21:02:19,027][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][GridMarshallerMappingConsistencyTest2] VM total memory: 1.9GB [21:02:19] : [Step 4/5] [2021-11-19 21:02:19,028][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][GridMarshallerMappingConsistencyTest2] Remote Management [restart: off, REST: off, JMX (remote: off)] [21:02:19] : [Step 4/5] [2021-11-19 21:02:19,028][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][GridMarshallerMappingConsistencyTest2] Logger: GridTestLog4jLogger [quiet=false, config=null] [21:02:19] : [Step 4/5] [2021-11-19 21:02:19,029][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][GridMarshallerMappingConsistencyTest2] IGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c [21:02:19] : [Step 4/5] [2021-11-19 21:02:19,029][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][GridMarshallerMappingConsistencyTest2] VM arguments: [-DIGNITE_DUMP_THREADS_ON_FAILURE=false, -DMono=/usr/bin/mono-sgen, -DMono4.0_x64=/usr/lib/mono/4.0, -DMono4.5_x64=/usr/lib/mono/4.5, -DMonoVersion=6.12.0.90, -DSKIP_BUILD=false, -Dagent.home.dir=/opt/buildagent, -Dagent.name=aitc-lin02_03, -Dagent.ownPort=9090, -Dagent.work.dir=/opt/buildagent/work, -Dbuild.number=95, -Dbuild.vcs.number=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.1=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.GitHubApacheIgnite=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dclassworlds.conf=/opt/buildagent/temp/buildTmp/teamcity.m2.conf, -Dcom.jetbrains.maven.watcher.report.file=/opt/buildagent/temp/buildTmp/maven-build-info.xml, -Djava.io.tmpdir=/opt/buildagent/temp/buildTmp, -Dmaven.home=/opt/buildagent/tools/maven3_6, -Dmaven.multiModuleProjectDirectory=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.agent.cpuBenchmark=457, -Dteamcity.agent.dotnet.agent_url=http://localhost:9090/RPC2, -Dteamcity.agent.dotnet.build_id=6278078, -Dteamcity.auth.password=*******, -Dteamcity.auth.userId=TeamCityBuildId=6278078, -Dteamcity.build.changedFiles.file=/opt/buildagent/temp/buildTmp/changedFiles6342607772318147725.txt, -Dteamcity.build.checkoutDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.build.id=6278078, -Dteamcity.build.properties.file=/opt/buildagent/temp/buildTmp/teamcity.build5164517880467851002.properties, -Dteamcity.build.tempDir=/opt/buildagent/temp/buildTmp, -Dteamcity.build.workingDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.buildConfName=Basic 3, -Dteamcity.buildType.id=IgniteTests24Java8_Basic3, -Dteamcity.configuration.properties.file=/opt/buildagent/temp/buildTmp/teamcity.config5591980786735343870.properties, -Dteamcity.maven.userSettings.path=/opt/buildagent/temp/buildTmp/maven_settings_585072866407032347.xml, -Dteamcity.maven.watcher.home=/opt/buildagent/plugins/mavenPlugin/maven-watcher-jdk16, -Dteamcity.projectName=Ignite Tests 2.x (JDK 8/11), -Dteamcity.runner.properties.file=/opt/buildagent/temp/buildTmp/teamcity.runner9098465561618137420.properties, -Dteamcity.tests.recentlyFailedTests.file=/opt/buildagent/temp/buildTmp/testsToRunFirst3891775683130404069.txt, -Dteamcity.version=2021.2 (build 99542), -ea, -Xms2g, -Xmx2g, -XX:+HeapDumpOnOutOfMemoryError, -DIGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_TEST_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_UPDATE_NOTIFIER=false, -DIGNITE_NO_DISCO_ORDER=true, -DIGNITE_PERFORMANCE_SUGGESTIONS_DISABLED=true, -Djava.net.preferIPv4Stack=true, -DTEST_SCALE_FACTOR=1.0, -DIGNITE_TEST_PROP_LOG4J_FILE=log4j-tc-test.xml, -DIGNITE_QUIET=false, -DIGNITE_MARSHAL_BUFFERS_RECHECK=1000, -Dmaven.repo.local=/opt/buildagent/.m2/repository] [21:02:19] : [Step 4/5] [2021-11-19 21:02:19,035][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][GridMarshallerMappingConsistencyTest2] System cache's DataRegion size is configured to 40 MB. Use DataStorageConfiguration.systemRegionInitialSize property to change the setting. [21:02:19]W: [org.apache.ignite:ignite-core] [2021-11-19 21:02:19,036][WARN ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][GridMarshallerMappingConsistencyTest2] Peer class loading is enabled (disable it in production for performance and deployment consistency reasons) [21:02:19] : [Step 4/5] [2021-11-19 21:02:19,035][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][GridMarshallerMappingConsistencyTest2] Configured caches [in 'sysMemPlc' dataRegion: ['ignite-sys-cache']] [21:02:19] : [Step 4/5] [2021-11-19 21:02:19,036][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][GridMarshallerMappingConsistencyTest2] 3-rd party licenses can be found at: /opt/buildagent/work/7bc1c54bc719b67c/libs/licenses [21:02:19] : [Step 4/5] [2021-11-19 21:02:19,043][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][IgnitePluginProcessor] Configured plugins: [21:02:19] : [Step 4/5] [2021-11-19 21:02:19,043][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][IgnitePluginProcessor] ^-- StanByClusterTestProvider 1.0 [21:02:19] : [Step 4/5] [2021-11-19 21:02:19,044][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][IgnitePluginProcessor] ^-- null [21:02:19] : [Step 4/5] [2021-11-19 21:02:19,044][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][IgnitePluginProcessor] [21:02:19] : [Step 4/5] [2021-11-19 21:02:19,044][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][IgnitePluginProcessor] ^-- PageMemory tracker plugin 1.0 [21:02:19] : [Step 4/5] [2021-11-19 21:02:19,045][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][IgnitePluginProcessor] ^-- null [21:02:19] : [Step 4/5] [2021-11-19 21:02:19,045][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][IgnitePluginProcessor] [21:02:19] : [Step 4/5] [2021-11-19 21:02:19,045][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][IgnitePluginProcessor] ^-- TestDistibutedConfigurationPlugin 1.0 [21:02:19] : [Step 4/5] [2021-11-19 21:02:19,046][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][IgnitePluginProcessor] ^-- null [21:02:19] : [Step 4/5] [2021-11-19 21:02:19,046][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][IgnitePluginProcessor] [21:02:19] : [Step 4/5] [2021-11-19 21:02:19,046][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][IgnitePluginProcessor] ^-- NodeValidationPluginProvider 1.0 [21:02:19] : [Step 4/5] [2021-11-19 21:02:19,047][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][IgnitePluginProcessor] ^-- null [21:02:19] : [Step 4/5] [2021-11-19 21:02:19,047][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][IgnitePluginProcessor] [21:02:19] : [Step 4/5] [2021-11-19 21:02:19,047][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][FailureProcessor] Configured failure handler: [hnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]]] [21:02:19] : [Step 4/5] [2021-11-19 21:02:19,220][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][TcpCommunicationSpi] Successfully bound communication NIO server to TCP port [port=45031, locHost=/127.0.0.1, selectorsCnt=12, selectorSpins=0, pairedConn=false] [21:02:19]W: [org.apache.ignite:ignite-core] [2021-11-19 21:02:19,221][WARN ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][TcpCommunicationSpi] Message queue limit is set to 0 which may lead to potential OOMEs when running cache operations in FULL_ASYNC or PRIMARY_SYNC modes due to message queues growth on sender and receiver sides. [21:02:19] : [Step 4/5] [2021-11-19 21:02:19,227][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][GridCollisionManager] Collision resolution is disabled (all jobs will be activated upon arrival). [21:02:19] : [Step 4/5] [2021-11-19 21:02:19,227][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][GridMarshallerMappingConsistencyTest2] Security status [authentication=off, sandbox=off, tls/ssl=off] [21:02:19] : [Step 4/5] [2021-11-19 21:02:19,229][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][MaintenanceProcessor] Resolved store directory for node persistent data: /opt/buildagent/work/7bc1c54bc719b67c/work/test/marshaller.GridMarshallerMappingConsistencyTest2/db/marshaller_GridMarshallerMappingConsistencyTest2 [21:02:19] : [Step 4/5] [2021-11-19 21:02:19,231][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][CacheObjectBinaryProcessorImpl] Resolved directory for serialized binary metadata: /opt/buildagent/work/7bc1c54bc719b67c/work/test/marshaller.GridMarshallerMappingConsistencyTest2/db/binary_meta/marshaller_GridMarshallerMappingConsistencyTest2 [21:02:19] : [Step 4/5] [2021-11-19 21:02:19,239][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/test/marshaller.GridMarshallerMappingConsistencyTest2/db/marshaller_GridMarshallerMappingConsistencyTest2 [21:02:19] : [Step 4/5] [2021-11-19 21:02:19,240][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][FileWriteAheadLogManager] Resolved write ahead log work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/test/marshaller.GridMarshallerMappingConsistencyTest2/db/wal/marshaller_GridMarshallerMappingConsistencyTest2 [21:02:19] : [Step 4/5] [2021-11-19 21:02:19,240][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][FileWriteAheadLogManager] Resolved write ahead log archive directory: /opt/buildagent/work/7bc1c54bc719b67c/work/test/marshaller.GridMarshallerMappingConsistencyTest2/db/wal/archive/marshaller_GridMarshallerMappingConsistencyTest2 [21:02:19] : [Step 4/5] [2021-11-19 21:02:19,242][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/test/marshaller.GridMarshallerMappingConsistencyTest2/db/wal/marshaller_GridMarshallerMappingConsistencyTest2/0000000000000003.wal [21:02:19] : [Step 4/5] [2021-11-19 21:02:19,243][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/test/marshaller.GridMarshallerMappingConsistencyTest2/db/wal/marshaller_GridMarshallerMappingConsistencyTest2/0000000000000002.wal [21:02:19] : [Step 4/5] [2021-11-19 21:02:19,244][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/test/marshaller.GridMarshallerMappingConsistencyTest2/db/wal/marshaller_GridMarshallerMappingConsistencyTest2/0000000000000001.wal [21:02:19] : [Step 4/5] [2021-11-19 21:02:19,244][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][FileHandleManagerImpl] Initialized write-ahead log manager [mode=LOG_ONLY] [21:02:19] : [Step 4/5] [2021-11-19 21:02:19,252][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][GridCacheDatabaseSharedManager] Configured data regions initialized successfully [total=5] [21:02:19] : [Step 4/5] [2021-11-19 21:02:19,628][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][IgniteSnapshotManager] Resolved snapshot work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/test/marshaller.GridMarshallerMappingConsistencyTest2/snapshots [21:02:19] : [Step 4/5] [2021-11-19 21:02:19,628][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][IgniteSnapshotManager] Resolved temp directory for snapshot creation: /opt/buildagent/work/7bc1c54bc719b67c/work/test/marshaller.GridMarshallerMappingConsistencyTest2/db/marshaller_GridMarshallerMappingConsistencyTest2/snp [21:02:19] : [Step 4/5] [2021-11-19 21:02:19,633][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][ClientListenerProcessor] Client connector processor has started on TCP port 10801 [21:02:19] : [Step 4/5] [2021-11-19 21:02:19,642][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][GridMarshallerMappingConsistencyTest2] Non-loopback local IPs: 172.17.0.4 [21:02:19] : [Step 4/5] [2021-11-19 21:02:19,642][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][GridMarshallerMappingConsistencyTest2] Enabled local MACs: 0242AC110004 [21:02:19] : [Step 4/5] [2021-11-19 21:02:19,646][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=/opt/buildagent/work/7bc1c54bc719b67c/work/test/marshaller.GridMarshallerMappingConsistencyTest2/db/marshaller_GridMarshallerMappingConsistencyTest2/cp/1637344937678-ccb8d1e0-7d17-4a2b-9329-a4c601275f42-START.bin, endMarker=/opt/buildagent/work/7bc1c54bc719b67c/work/test/marshaller.GridMarshallerMappingConsistencyTest2/db/marshaller_GridMarshallerMappingConsistencyTest2/cp/1637344937678-ccb8d1e0-7d17-4a2b-9329-a4c601275f42-END.bin] [21:02:19] : [Step 4/5] [2021-11-19 21:02:19,650][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:02:19] : [Step 4/5] [2021-11-19 21:02:19,650][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=170707, len=21409], lastMarked=WALPointer [idx=0, fileOff=170707, len=21409], lastCheckpointId=ccb8d1e0-7d17-4a2b-9329-a4c601275f42] [21:02:19] : [Step 4/5] [2021-11-19 21:02:19,774][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][GridCacheDatabaseSharedManager] Found last checkpoint marker [cpId=ccb8d1e0-7d17-4a2b-9329-a4c601275f42, pos=WALPointer [idx=0, fileOff=170707, len=21409]] [21:02:19] : [Step 4/5] [2021-11-19 21:02:19,781][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][GridCacheDatabaseSharedManager] Applying lost metastore updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=170707, len=21409], lastCheckpointId=ccb8d1e0-7d17-4a2b-9329-a4c601275f42] [21:02:19] : [Step 4/5] [2021-11-19 21:02:19,846][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=60 ms] [21:02:19] : [Step 4/5] [2021-11-19 21:02:19,846][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][GridCacheProcessor] Restoring partition state for local groups. [21:02:19] : [Step 4/5] [2021-11-19 21:02:19,847][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=0, partitionsProcessed=0, time=0ms] [21:02:19] : [Step 4/5] [2021-11-19 21:02:19,978][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][GridEncryptionManager] Encryption keys loaded from metastore. [grps=, masterKeyName=null] [21:02:19] : [Step 4/5] [2021-11-19 21:02:19,987][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][GridClusterStateProcessor] Restoring history for BaselineTopology[id=0] [21:02:20] : [Step 4/5] [2021-11-19 21:02:20,000][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][ClusterProcessor] Cluster ID and tag has been read from metastorage: ClusterIdAndTag [id=2818301c-185b-4985-b230-d27f2cec6a5a, tag=amazing_margulis] [21:02:20] : [Step 4/5] [2021-11-19 21:02:20,000][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][IgniteClusterImpl] Shutdown policy was updated [oldVal=null, newVal=null] [21:02:20] : [Step 4/5] [2021-11-19 21:02:20,001][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustEnabled' was changed from 'null' to 'false' [21:02:20] : [Step 4/5] [2021-11-19 21:02:20,002][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustTimeout' was changed from 'null' to '300000' [21:02:20] : [Step 4/5] [2021-11-19 21:02:20,002][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][IgniteTxManager] Transactions parameter 'txOwnerDumpRequestsAllowed' was changed from 'null' to 'true' [21:02:20] : [Step 4/5] [2021-11-19 21:02:20,002][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][IgniteTxManager] Transactions parameter 'longOperationsDumpTimeout' was changed from 'null' to '60000' [21:02:20] : [Step 4/5] [2021-11-19 21:02:20,003][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpThreshold' was changed from 'null' to '0' [21:02:20] : [Step 4/5] [2021-11-19 21:02:20,004][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][IgniteTxManager] Transactions parameter 'transactionTimeDumpSamplesCoefficient' was changed from 'null' to '0.0' [21:02:20] : [Step 4/5] [2021-11-19 21:02:20,004][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpSamplesPerSecondLimit' was changed from 'null' to '5' [21:02:20] : [Step 4/5] [2021-11-19 21:02:20,005][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][IgniteTxManager] Transactions parameter 'collisionsDumpInterval' was changed from 'null' to '1000' [21:02:20] : [Step 4/5] [2021-11-19 21:02:20,006][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][GridCacheDatabaseSharedManager] Historical rebalance WAL threshold changed [property=historical.rebalance.threshold, oldVal=null, newVal=500] [21:02:20] : [Step 4/5] [2021-11-19 21:02:20,006][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][GridCacheDatabaseSharedManager] Checkpoint frequency deviation changed [oldVal=null, newVal=null] [21:02:20] : [Step 4/5] [2021-11-19 21:02:20,096][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][FilePageStoreManager] Cleanup cache stores [total=1, left=0, cleanFiles=false] [21:02:20] : [Step 4/5] [2021-11-19 21:02:20,101][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:02:20] : [Step 4/5] [2021-11-19 21:02:20,103][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:02:20] : [Step 4/5] [2021-11-19 21:02:20,105][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:02:20] : [Step 4/5] [2021-11-19 21:02:20,106][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][GridCacheDatabaseSharedManager] Data Regions Started: 5 [21:02:20] : [Step 4/5] [2021-11-19 21:02:20,106][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][GridCacheDatabaseSharedManager] ^-- sysMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:02:20] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:02:20] : [Step 4/5] ^-- default region [type=default, persistence=true, lazyAlloc=true, [21:02:20] : [Step 4/5] ... initCfg=256MB, maxCfg=256MB, usedRam=0MB, freeRam=100%, allocRam=0MB, allocTotal=0MB] [21:02:20] : [Step 4/5] ^-- metastoreMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:02:20] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:02:20] : [Step 4/5] ^-- TxLog region [type=internal, persistence=true, lazyAlloc=false, [21:02:20] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:02:20] : [Step 4/5] ^-- volatileDsMemPlc region [type=user, persistence=false, lazyAlloc=true, [21:02:20] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB] [21:02:20] : [Step 4/5] ^-- Ignite persistence [used=0MB] [21:02:20] : [Step 4/5] [21:02:20] : [Step 4/5] [2021-11-19 21:02:20,108][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][GridCacheDatabaseSharedManager] Starting binary memory restore for: [94416770, -2100569601] [21:02:20] : [Step 4/5] [2021-11-19 21:02:20,210][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=/opt/buildagent/work/7bc1c54bc719b67c/work/test/marshaller.GridMarshallerMappingConsistencyTest2/db/marshaller_GridMarshallerMappingConsistencyTest2/cp/1637344937678-ccb8d1e0-7d17-4a2b-9329-a4c601275f42-START.bin, endMarker=/opt/buildagent/work/7bc1c54bc719b67c/work/test/marshaller.GridMarshallerMappingConsistencyTest2/db/marshaller_GridMarshallerMappingConsistencyTest2/cp/1637344937678-ccb8d1e0-7d17-4a2b-9329-a4c601275f42-END.bin] [21:02:20] : [Step 4/5] [2021-11-19 21:02:20,211][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=170707, len=21409], lastMarked=WALPointer [idx=0, fileOff=170707, len=21409], lastCheckpointId=ccb8d1e0-7d17-4a2b-9329-a4c601275f42] [21:02:20] : [Step 4/5] [2021-11-19 21:02:20,341][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][GridCacheDatabaseSharedManager] Found last checkpoint marker [cpId=ccb8d1e0-7d17-4a2b-9329-a4c601275f42, pos=WALPointer [idx=0, fileOff=170707, len=21409]] [21:02:20] : [Step 4/5] [2021-11-19 21:02:20,346][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][GridCacheDatabaseSharedManager] Binary memory state restored at node startup [restoredPtr=WALPointer [idx=0, fileOff=192116, len=0]] [21:02:20] : [Step 4/5] [2021-11-19 21:02:20,356][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/test/marshaller.GridMarshallerMappingConsistencyTest2/db/wal/marshaller_GridMarshallerMappingConsistencyTest2/0000000000000000.wal, offset=192116, ver=2] [21:02:20] : [Step 4/5] [2021-11-19 21:02:20,365][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][PageMemoryImpl] Started page memory [memoryAllocated=256.0 MiB, pages=63504, tableSize=4.9 MiB, replacementSize=7.9 KiB, checkpointBuffer=256.0 MiB] [21:02:20] : [Step 4/5] [2021-11-19 21:02:20,373][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][GridCacheProcessor] Started cache in recovery mode [name=cache, id=94416770, dataRegionName=default, mode=PARTITIONED, atomicity=ATOMIC, backups=1, mvcc=false] [21:02:20] : [Step 4/5] [2021-11-19 21:02:20,376][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][GridCacheProcessor] Started cache in recovery mode [name=ignite-sys-cache, id=-2100569601, dataRegionName=sysMemPlc, mode=REPLICATED, atomicity=TRANSACTIONAL, backups=2147483647, mvcc=false] [21:02:20] : [Step 4/5] [2021-11-19 21:02:20,379][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][GridCacheDatabaseSharedManager] Binary recovery performed in 271 ms. [21:02:20] : [Step 4/5] [2021-11-19 21:02:20,381][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=/opt/buildagent/work/7bc1c54bc719b67c/work/test/marshaller.GridMarshallerMappingConsistencyTest2/db/marshaller_GridMarshallerMappingConsistencyTest2/cp/1637344937678-ccb8d1e0-7d17-4a2b-9329-a4c601275f42-START.bin, endMarker=/opt/buildagent/work/7bc1c54bc719b67c/work/test/marshaller.GridMarshallerMappingConsistencyTest2/db/marshaller_GridMarshallerMappingConsistencyTest2/cp/1637344937678-ccb8d1e0-7d17-4a2b-9329-a4c601275f42-END.bin] [21:02:20] : [Step 4/5] [2021-11-19 21:02:20,382][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][GridCacheDatabaseSharedManager] Applying lost cache updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=170707, len=21409], lastCheckpointId=ccb8d1e0-7d17-4a2b-9329-a4c601275f42] [21:02:20] : [Step 4/5] [2021-11-19 21:02:20,462][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=85 ms] [21:02:20] : [Step 4/5] [2021-11-19 21:02:20,462][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][GridCacheProcessor] Restoring partition state for local groups. [21:02:20] : [Step 4/5] [2021-11-19 21:02:20,635][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=2, partitionsProcessed=1124, time=173ms] [21:02:20] : [Step 4/5] [2021-11-19 21:02:20,761][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][TestTcpDiscoverySpi] Successfully bound to TCP port [port=47501, localHost=localhost/127.0.0.1, locNodeId=850afc57-48b6-4649-99c9-a7f22de00002] [21:02:20] : [Step 4/5] [2021-11-19 21:02:20,774][INFO ][tcp-disco-srvr-[:47500]-#129%marshaller.GridMarshallerMappingConsistencyTest1%-#2464%marshaller.GridMarshallerMappingConsistencyTest1%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=57683] [21:02:20] : [Step 4/5] [2021-11-19 21:02:20,774][INFO ][tcp-disco-srvr-[:47500]-#129%marshaller.GridMarshallerMappingConsistencyTest1%-#2464%marshaller.GridMarshallerMappingConsistencyTest1%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=57683] [21:02:20] : [Step 4/5] [2021-11-19 21:02:20,775][INFO ][tcp-disco-sock-reader-[]-#144%marshaller.GridMarshallerMappingConsistencyTest1%-#2739%marshaller.GridMarshallerMappingConsistencyTest1%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:57683, rmtPort=57683] [21:02:20] : [Step 4/5] [2021-11-19 21:02:20,779][INFO ][tcp-disco-sock-reader-[850afc57 127.0.0.1:57683]-#144%marshaller.GridMarshallerMappingConsistencyTest1%-#2739%marshaller.GridMarshallerMappingConsistencyTest1%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=850afc57-48b6-4649-99c9-a7f22de00002, rmtAddr=/127.0.0.1:57683] [21:02:20] : [Step 4/5] [2021-11-19 21:02:20,788][INFO ][tcp-disco-srvr-[:47501]-#143%marshaller.GridMarshallerMappingConsistencyTest2%-#2738%marshaller.GridMarshallerMappingConsistencyTest2%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=49777] [21:02:20] : [Step 4/5] [2021-11-19 21:02:20,788][INFO ][tcp-disco-srvr-[:47501]-#143%marshaller.GridMarshallerMappingConsistencyTest2%-#2738%marshaller.GridMarshallerMappingConsistencyTest2%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=49777] [21:02:20] : [Step 4/5] [2021-11-19 21:02:20,790][INFO ][tcp-disco-sock-reader-[]-#145%marshaller.GridMarshallerMappingConsistencyTest2%-#2740%marshaller.GridMarshallerMappingConsistencyTest2%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:49777, rmtPort=49777] [21:02:20] : [Step 4/5] [2021-11-19 21:02:20,791][INFO ][tcp-disco-sock-reader-[]-#145%marshaller.GridMarshallerMappingConsistencyTest2%-#2740%marshaller.GridMarshallerMappingConsistencyTest2%][TestTcpDiscoverySpi] Received ping request from the remote node [rmtNodeId=96da3d10-9365-4ae3-9783-33321c700001, rmtAddr=/127.0.0.1:49777, rmtPort=49777] [21:02:20] : [Step 4/5] [2021-11-19 21:02:20,793][INFO ][tcp-disco-sock-reader-[]-#145%marshaller.GridMarshallerMappingConsistencyTest2%-#2740%marshaller.GridMarshallerMappingConsistencyTest2%][TestTcpDiscoverySpi] Finished writing ping response [rmtNodeId=96da3d10-9365-4ae3-9783-33321c700001, rmtAddr=/127.0.0.1:49777, rmtPort=49777] [21:02:20] : [Step 4/5] [2021-11-19 21:02:20,793][INFO ][tcp-disco-sock-reader-[]-#145%marshaller.GridMarshallerMappingConsistencyTest2%-#2740%marshaller.GridMarshallerMappingConsistencyTest2%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:49777, rmtPort=49777, rmtNodeId=null] [21:02:20] : [Step 4/5] [2021-11-19 21:02:20,794][INFO ][tcp-disco-sock-reader-[850afc57 127.0.0.1:57683]-#144%marshaller.GridMarshallerMappingConsistencyTest1%-#2739%marshaller.GridMarshallerMappingConsistencyTest1%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:57683, rmtPort=57683, rmtNodeId=850afc57-48b6-4649-99c9-a7f22de00002] [21:02:20] : [Step 4/5] [2021-11-19 21:02:20,797][INFO ][tcp-disco-msg-worker-[crd]-#128%marshaller.GridMarshallerMappingConsistencyTest1%-#2463%marshaller.GridMarshallerMappingConsistencyTest1%][GridEncryptionManager] Joining node doesn't have stored group keys [node=850afc57-48b6-4649-99c9-a7f22de00002] [21:02:20] : [Step 4/5] [2021-11-19 21:02:20,822][INFO ][tcp-disco-msg-worker-[crd]-#128%marshaller.GridMarshallerMappingConsistencyTest1%-#2463%marshaller.GridMarshallerMappingConsistencyTest1%][TestTcpDiscoverySpi] New next node [newNext=TcpDiscoveryNode [id=850afc57-48b6-4649-99c9-a7f22de00002, consistentId=marshaller.GridMarshallerMappingConsistencyTest2, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=0, intOrder=3, lastExchangeTime=1637344940785, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false]] [21:02:20] : [Step 4/5] [2021-11-19 21:02:20,823][INFO ][tcp-disco-srvr-[:47501]-#143%marshaller.GridMarshallerMappingConsistencyTest2%-#2738%marshaller.GridMarshallerMappingConsistencyTest2%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=43777] [21:02:20] : [Step 4/5] [2021-11-19 21:02:20,824][INFO ][tcp-disco-srvr-[:47501]-#143%marshaller.GridMarshallerMappingConsistencyTest2%-#2738%marshaller.GridMarshallerMappingConsistencyTest2%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=43777] [21:02:20] : [Step 4/5] [2021-11-19 21:02:20,825][INFO ][tcp-disco-sock-reader-[]-#146%marshaller.GridMarshallerMappingConsistencyTest2%-#2741%marshaller.GridMarshallerMappingConsistencyTest2%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:43777, rmtPort=43777] [21:02:20] : [Step 4/5] [2021-11-19 21:02:20,826][INFO ][tcp-disco-sock-reader-[96da3d10 127.0.0.1:43777]-#146%marshaller.GridMarshallerMappingConsistencyTest2%-#2741%marshaller.GridMarshallerMappingConsistencyTest2%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=96da3d10-9365-4ae3-9783-33321c700001, rmtAddr=/127.0.0.1:43777] [21:02:20] : [Step 4/5] [2021-11-19 21:02:20,836][INFO ][tcp-disco-msg-worker-[]-#142%marshaller.GridMarshallerMappingConsistencyTest2%-#2737%marshaller.GridMarshallerMappingConsistencyTest2%][TestTcpDiscoverySpi] New next node [newNext=TcpDiscoveryNode [id=96da3d10-9365-4ae3-9783-33321c700001, consistentId=marshaller.GridMarshallerMappingConsistencyTest1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637344940831, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false]] [21:02:20] : [Step 4/5] [2021-11-19 21:02:20,837][INFO ][tcp-disco-srvr-[:47500]-#129%marshaller.GridMarshallerMappingConsistencyTest1%-#2464%marshaller.GridMarshallerMappingConsistencyTest1%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=49699] [21:02:20] : [Step 4/5] [2021-11-19 21:02:20,838][INFO ][tcp-disco-srvr-[:47500]-#129%marshaller.GridMarshallerMappingConsistencyTest1%-#2464%marshaller.GridMarshallerMappingConsistencyTest1%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=49699] [21:02:20] : [Step 4/5] [2021-11-19 21:02:20,839][INFO ][tcp-disco-sock-reader-[]-#147%marshaller.GridMarshallerMappingConsistencyTest1%-#2742%marshaller.GridMarshallerMappingConsistencyTest1%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:49699, rmtPort=49699] [21:02:20] : [Step 4/5] [2021-11-19 21:02:20,840][INFO ][tcp-disco-sock-reader-[850afc57 127.0.0.1:49699]-#147%marshaller.GridMarshallerMappingConsistencyTest1%-#2742%marshaller.GridMarshallerMappingConsistencyTest1%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=850afc57-48b6-4649-99c9-a7f22de00002, rmtAddr=/127.0.0.1:49699] [21:02:20] : [Step 4/5] [2021-11-19 21:02:20,845][INFO ][disco-event-worker-#2466%marshaller.GridMarshallerMappingConsistencyTest1%][GridDiscoveryManager] Added new node to topology: TcpDiscoveryNode [id=850afc57-48b6-4649-99c9-a7f22de00002, consistentId=marshaller.GridMarshallerMappingConsistencyTest2, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=4, intOrder=3, lastExchangeTime=1637344940785, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false] [21:02:20] : [Step 4/5] [2021-11-19 21:02:20,847][INFO ][disco-event-worker-#2466%marshaller.GridMarshallerMappingConsistencyTest1%][GridDiscoveryManager] Topology snapshot [ver=4, locNode=96da3d10, servers=2, clients=0, state=ACTIVE, CPUs=24, offheap=0.25GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=96da3d10-9365-4ae3-9783-33321c700001, consistentId=marshaller.GridMarshallerMappingConsistencyTest1, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=850afc57-48b6-4649-99c9-a7f22de00002, consistentId=marshaller.GridMarshallerMappingConsistencyTest2, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:02:20] : [Step 4/5] [2021-11-19 21:02:20,848][INFO ][disco-event-worker-#2466%marshaller.GridMarshallerMappingConsistencyTest1%][GridDiscoveryManager] ^-- Baseline [id=0, size=2, online=2, offline=0] [21:02:20] : [Step 4/5] [2021-11-19 21:02:20,849][INFO ][exchange-worker-#2467%marshaller.GridMarshallerMappingConsistencyTest1%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], crd=true, evt=NODE_JOINED, evtNode=850afc57-48b6-4649-99c9-a7f22de00002, customEvt=null, allowMerge=true, exchangeFreeSwitch=false] [21:02:20] : [Step 4/5] [2021-11-19 21:02:20,849][INFO ][exchange-worker-#2467%marshaller.GridMarshallerMappingConsistencyTest1%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], waitTime=0ms, futInfo=NA, mode=DISTRIBUTED] [21:02:20] : [Step 4/5] [2021-11-19 21:02:20,850][INFO ][exchange-worker-#2467%marshaller.GridMarshallerMappingConsistencyTest1%][GridDhtPartitionsExchangeFuture] Finished waiting for partitions release latch: ServerLatch [permits=0, pendingAcks=HashSet [], super=CompletableLatch [id=CompletableLatchUid [id=exchange, topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0]]]] [21:02:20] : [Step 4/5] [2021-11-19 21:02:20,851][INFO ][exchange-worker-#2467%marshaller.GridMarshallerMappingConsistencyTest1%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:02:20] : [Step 4/5] [2021-11-19 21:02:20,855][INFO ][exchange-worker-#2467%marshaller.GridMarshallerMappingConsistencyTest1%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], crd=true] [21:02:20] : [Step 4/5] [2021-11-19 21:02:20,857][INFO ][disco-notifier-worker-#2736%marshaller.GridMarshallerMappingConsistencyTest2%][MvccProcessorImpl] Assigned mvcc coordinator [crd=MvccCoordinator [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], nodeId=96da3d10-9365-4ae3-9783-33321c700001, ver=1637344935721, local=false, initialized=false]] [21:02:20] : [Step 4/5] [2021-11-19 21:02:20,866][INFO ][sys-#2723%marshaller.GridMarshallerMappingConsistencyTest2%][ClusterProcessor] Writing cluster ID and tag to metastorage on ready for write ClusterIdAndTag [id=2818301c-185b-4985-b230-d27f2cec6a5a, tag=amazing_margulis] [21:02:20] : [Step 4/5] [2021-11-19 21:02:20,891][INFO ][exchange-worker-#2745%marshaller.GridMarshallerMappingConsistencyTest2%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], crd=false, evt=NODE_JOINED, evtNode=850afc57-48b6-4649-99c9-a7f22de00002, customEvt=null, allowMerge=true, exchangeFreeSwitch=false] [21:02:20] : [Step 4/5] [2021-11-19 21:02:20,891][INFO ][exchange-worker-#2745%marshaller.GridMarshallerMappingConsistencyTest2%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/test/marshaller.GridMarshallerMappingConsistencyTest2/db/marshaller_GridMarshallerMappingConsistencyTest2 [21:02:20] : [Step 4/5] [2021-11-19 21:02:20,897][INFO ][exchange-worker-#2745%marshaller.GridMarshallerMappingConsistencyTest2%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/test/marshaller.GridMarshallerMappingConsistencyTest2/db/wal/marshaller_GridMarshallerMappingConsistencyTest2/0000000000000000.wal, offset=192145, ver=2] [21:02:20] : [Step 4/5] [2021-11-19 21:02:20,899][INFO ][exchange-worker-#2745%marshaller.GridMarshallerMappingConsistencyTest2%][GridClusterStateProcessor] Writing BaselineTopology[id=0] [21:02:20] : [Step 4/5] [2021-11-19 21:02:20,904][INFO ][exchange-worker-#2745%marshaller.GridMarshallerMappingConsistencyTest2%][GridCacheDatabaseSharedManager] Finish recovery performed in 12 ms. [21:02:20] : [Step 4/5] [2021-11-19 21:02:20,908][INFO ][exchange-worker-#2745%marshaller.GridMarshallerMappingConsistencyTest2%][msg] Components activation performed in 17 ms. [21:02:20] : [Step 4/5] [2021-11-19 21:02:20,909][INFO ][exchange-worker-#2745%marshaller.GridMarshallerMappingConsistencyTest2%][GridCacheProcessor] Finished recovery for cache [cache=ignite-sys-cache, grp=ignite-sys-cache, startVer=AffinityTopologyVersion [topVer=4, minorTopVer=0]] [21:02:20] : [Step 4/5] [2021-11-19 21:02:20,909][INFO ][sys-#2726%marshaller.GridMarshallerMappingConsistencyTest2%][GridCacheProcessor] Finished recovery for cache [cache=cache, grp=cache, startVer=AffinityTopologyVersion [topVer=4, minorTopVer=0]] [21:02:20] : [Step 4/5] [2021-11-19 21:02:20,910][INFO ][exchange-worker-#2745%marshaller.GridMarshallerMappingConsistencyTest2%][GridCacheProcessor] Starting caches on local join performed in 0 ms. [21:02:20] : [Step 4/5] [2021-11-19 21:02:20,912][INFO ][exchange-worker-#2745%marshaller.GridMarshallerMappingConsistencyTest2%][GridDhtPartitionsExchangeFuture] Skipped waiting for partitions release future (local node is joining) [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0]] [21:02:20] : [Step 4/5] [2021-11-19 21:02:20,928][INFO ][grid-nio-worker-tcp-comm-1-#2406%TcpCommunicationSpi%][TcpCommunicationSpi] Accepted incoming communication connection [locAddr=/127.0.0.1:45030, rmtAddr=/127.0.0.1:42152] [21:02:20] : [Step 4/5] [2021-11-19 21:02:20,931][INFO ][grid-nio-worker-tcp-comm-0-#2678%TcpCommunicationSpi%][TcpCommunicationSpi] Established outgoing communication connection [locAddr=/127.0.0.1:42152, rmtAddr=/127.0.0.1:45030] [21:02:20] : [Step 4/5] [2021-11-19 21:02:20,931][INFO ][exchange-worker-#2745%marshaller.GridMarshallerMappingConsistencyTest2%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], crd=false] [21:02:20] : [Step 4/5] [2021-11-19 21:02:20,933][INFO ][sys-#2452%marshaller.GridMarshallerMappingConsistencyTest1%][GridDhtPartitionsExchangeFuture] Coordinator received single message [ver=AffinityTopologyVersion [topVer=4, minorTopVer=0], node=850afc57-48b6-4649-99c9-a7f22de00002, allReceived=true] [21:02:20] : [Step 4/5] [2021-11-19 21:02:20,934][INFO ][sys-#2452%marshaller.GridMarshallerMappingConsistencyTest1%][GridDhtPartitionsExchangeFuture] Coordinator received all messages, try merge [ver=AffinityTopologyVersion [topVer=4, minorTopVer=0]] [21:02:20] : [Step 4/5] [2021-11-19 21:02:20,934][INFO ][sys-#2452%marshaller.GridMarshallerMappingConsistencyTest1%][GridDhtPartitionsExchangeFuture] finishExchangeOnCoordinator [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=0]] [21:02:20]W: [org.apache.ignite:ignite-core] [2021-11-19 21:02:20,961][WARN ][sys-#2452%marshaller.GridMarshallerMappingConsistencyTest1%][GridDhtPartitionTopologyImpl] Partitions have been scheduled for rebalancing due to outdated update counter [grp=cache, readyTopVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], nodeId=850afc57-48b6-4649-99c9-a7f22de00002, partsFull=[2], partsHistorical=[]] [21:02:20] : [Step 4/5] [2021-11-19 21:02:20,969][INFO ][sys-#2452%marshaller.GridMarshallerMappingConsistencyTest1%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], err=null, rebalanced=false, wasRebalanced=true] [21:02:20] : [Step 4/5] [2021-11-19 21:02:20,975][INFO ][sys-#2731%marshaller.GridMarshallerMappingConsistencyTest2%][GridDhtPartitionsExchangeFuture] Received full message, will finish exchange [node=96da3d10-9365-4ae3-9783-33321c700001, resVer=AffinityTopologyVersion [topVer=4, minorTopVer=0]] [21:02:20] : [Step 4/5] [2021-11-19 21:02:20,976][INFO ][sys-#2452%marshaller.GridMarshallerMappingConsistencyTest1%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=96da3d10-9365-4ae3-9783-33321c700001, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], evt=NODE_JOINED, evtNode=TcpDiscoveryNode [id=850afc57-48b6-4649-99c9-a7f22de00002, consistentId=marshaller.GridMarshallerMappingConsistencyTest2, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=4, intOrder=3, lastExchangeTime=1637344940785, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=false, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0]] [21:02:20] : [Step 4/5] [2021-11-19 21:02:20,978][INFO ][exchange-worker-#2467%marshaller.GridMarshallerMappingConsistencyTest1%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=4, minorTopVer=0], force=false, evt=NODE_JOINED, node=850afc57-48b6-4649-99c9-a7f22de00002] [21:02:20] : [Step 4/5] [2021-11-19 21:02:20,980][INFO ][sys-#2452%marshaller.GridMarshallerMappingConsistencyTest1%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (0 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Wait partitions release latch [latch=exchange]" (1 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="After states restored callback" (0 ms), stage="WAL history reservation" (3 ms), stage="Waiting for all single messages" (78 ms), stage="Exchanges merge" (0 ms), stage="Affinity recalculation (crd)" (13 ms), stage="Collect update counters and create affinity messages" (1 ms), stage="Assign partitions states" (11 ms), stage="Validate partitions states" (1 ms), stage="Apply update counters" (0 ms), stage="Full message preparing" (5 ms), stage="Full message sending" (0 ms), stage="Exchange done" (10 ms), stage="Total time" (123 ms), Discovery lag=12 ms, Latest started node id=850afc57-48b6-4649-99c9-a7f22de00002] [21:02:20] : [Step 4/5] [2021-11-19 21:02:20,983][INFO ][sys-#2452%marshaller.GridMarshallerMappingConsistencyTest1%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], stage="Affinity initialization (node join) [grp=cache, crd=true]" (12 ms) (parent=Affinity recalculation (crd)), stage="Affinity initialization (node join) [grp=ignite-sys-cache, crd=true]" (3 ms) (parent=Affinity recalculation (crd))] [21:02:20] : [Step 4/5] [2021-11-19 21:02:20,992][INFO ][sys-#2731%marshaller.GridMarshallerMappingConsistencyTest2%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], err=null, rebalanced=false, wasRebalanced=false] [21:02:20] : [Step 4/5] [2021-11-19 21:02:20,998][INFO ][sys-#2731%marshaller.GridMarshallerMappingConsistencyTest2%][GridCacheProcessor] Finish proxy initialization, cacheName=cache, localNodeId=850afc57-48b6-4649-99c9-a7f22de00002 [21:02:20] : [Step 4/5] [2021-11-19 21:02:20,998][INFO ][sys-#2731%marshaller.GridMarshallerMappingConsistencyTest2%][GridCacheProcessor] Finish proxy initialization, cacheName=ignite-sys-cache, localNodeId=850afc57-48b6-4649-99c9-a7f22de00002 [21:02:21] : [Step 4/5] [2021-11-19 21:02:20,999][INFO ][sys-#2731%marshaller.GridMarshallerMappingConsistencyTest2%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=850afc57-48b6-4649-99c9-a7f22de00002, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], evt=NODE_JOINED, evtNode=TcpDiscoveryNode [id=850afc57-48b6-4649-99c9-a7f22de00002, consistentId=marshaller.GridMarshallerMappingConsistencyTest2, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=4, intOrder=3, lastExchangeTime=1637344940876, loc=true, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=false, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0]] [21:02:21] : [Step 4/5] [2021-11-19 21:02:21,004][INFO ][sys-#2731%marshaller.GridMarshallerMappingConsistencyTest2%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], stage="Waiting in exchange queue" (30 ms), stage="Exchange parameters initialization" (0 ms), stage="Components activation" (16 ms), stage="Determine exchange type" (3 ms), stage="Preloading notification" (0 ms), stage="Restore partition states" (0 ms), stage="After states restored callback" (10 ms), stage="WAL history reservation" (0 ms), stage="Waiting for Full message" (52 ms), stage="Affinity recalculation" (8 ms), stage="Full map updating" (8 ms), stage="Exchange done" (12 ms), stage="Total time" (139 ms)] [21:02:21] : [Step 4/5] [2021-11-19 21:02:21,006][INFO ][sys-#2731%marshaller.GridMarshallerMappingConsistencyTest2%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], stage="Affinity fetch" (3 ms) (parent=Determine exchange type), stage="Restore partition states [grp=ignite-sys-cache]" (0 ms) (parent=Restore partition states), stage="Restore partition states [grp=cache]" (0 ms) (parent=Restore partition states), stage="Affinity initialization (local join) [grp=cache]" (8 ms) (parent=Affinity recalculation), stage="Affinity initialization (local join) [grp=ignite-sys-cache]" (3 ms) (parent=Affinity recalculation)] [21:02:21] : [Step 4/5] [2021-11-19 21:02:21,006][INFO ][exchange-worker-#2745%marshaller.GridMarshallerMappingConsistencyTest2%][GridCachePartitionExchangeManager] Rebalancing scheduled [order=[ignite-sys-cache, cache], top=AffinityTopologyVersion [topVer=4, minorTopVer=0], rebalanceId=1, evt=NODE_JOINED, node=850afc57-48b6-4649-99c9-a7f22de00002] [21:02:21] : [Step 4/5] [2021-11-19 21:02:21,011][INFO ][exchange-worker-#2745%marshaller.GridMarshallerMappingConsistencyTest2%][GridDhtPartitionDemander] Prepared rebalancing [grp=cache, mode=ASYNC, supplier=96da3d10-9365-4ae3-9783-33321c700001, partitionsCount=1, topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], rebalanceId=1] [21:02:21] : [Step 4/5] [2021-11-19 21:02:21,012][INFO ][exchange-worker-#2745%marshaller.GridMarshallerMappingConsistencyTest2%][PartitionsEvictManager] Eviction in progress [groups=1, remainingPartsToEvict=0] [21:02:21] : [Step 4/5] [2021-11-19 21:02:21,012][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][GridMarshallerMappingConsistencyTest2] To start Console Management & Monitoring run ignitevisorcmd.{sh|bat} [21:02:21] : [Step 4/5] [2021-11-19 21:02:21,012][INFO ][exchange-worker-#2745%marshaller.GridMarshallerMappingConsistencyTest2%][PartitionsEvictManager] Group eviction in progress [grpName=cache, grpId=94416770, remainingPartsToEvict=1, partsEvictInProgress=0, totalParts=1024] [21:02:21] : [Step 4/5] [2021-11-19 21:02:21,013][INFO ][exchange-worker-#2745%marshaller.GridMarshallerMappingConsistencyTest2%][PartitionsEvictManager] Partitions have been scheduled for eviction: [grpId=94416770, grpName=cache, clearing=[2]] [21:02:21] : [Step 4/5] [2021-11-19 21:02:21,013][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][GridMarshallerMappingConsistencyTest2] [21:02:21] : [Step 4/5] [21:02:21] : [Step 4/5] >>> +-------------------------------------------+ [21:02:21] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:02:21] : [Step 4/5] >>> +-------------------------------------------+ [21:02:21] : [Step 4/5] >>> OS name: Linux 4.15.0-151-generic amd64 [21:02:21] : [Step 4/5] >>> CPU(s): 24 [21:02:21] : [Step 4/5] >>> Heap: 2.0GB [21:02:21] : [Step 4/5] >>> VM name: 16724@c4dfe9a430b2 [21:02:21] : [Step 4/5] >>> Ignite instance name: marshaller.GridMarshallerMappingConsistencyTest2 [21:02:21] : [Step 4/5] >>> Local node [ID=850AFC57-48B6-4649-99C9-A7F22DE00002, order=4, clientMode=false] [21:02:21] : [Step 4/5] >>> Local node addresses: [127.0.0.1] [21:02:21] : [Step 4/5] >>> Local ports: TCP:10801 TCP:45031 TCP:47501 [21:02:21] : [Step 4/5] [21:02:21] : [Step 4/5] [2021-11-19 21:02:21,014][INFO ][sys-#2717%marshaller.GridMarshallerMappingConsistencyTest2%][GridDhtPartitionDemander] Starting rebalance routine [cache, topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], supplier=96da3d10-9365-4ae3-9783-33321c700001, fullPartitions=[2], histPartitions=[], rebalanceId=1] [21:02:21] : [Step 4/5] [2021-11-19 21:02:21,015][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][GridDiscoveryManager] Topology snapshot [ver=4, locNode=850afc57, servers=2, clients=0, state=ACTIVE, CPUs=24, offheap=0.25GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=96da3d10-9365-4ae3-9783-33321c700001, consistentId=marshaller.GridMarshallerMappingConsistencyTest1, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=850afc57-48b6-4649-99c9-a7f22de00002, consistentId=marshaller.GridMarshallerMappingConsistencyTest2, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:02:21] : [Step 4/5] [2021-11-19 21:02:21,019][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][GridDiscoveryManager] ^-- Baseline [id=0, size=2, online=2, offline=0] [21:02:21] : [Step 4/5] [2021-11-19 21:02:21,019][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][G] Node started : [stage="Configure system pool" (0 ms),stage="Start managers" (224 ms),stage="Configure binary metadata" (3 ms),stage="Start processors" (406 ms),stage="Start 'StanByClusterTestProvider' plugin" (0 ms),stage="Start 'PageMemory tracker plugin' plugin" (0 ms),stage="Start 'TestDistibutedConfigurationPlugin' plugin" (0 ms),stage="Start 'NodeValidationPluginProvider' plugin" (0 ms),stage="Init metastore" (455 ms),stage="Init and start regions" (10 ms),stage="Restore binary memory" (271 ms),stage="Restore logical state" (256 ms),stage="Finish recovery" (122 ms),stage="Join topology" (99 ms),stage="Await transition" (10 ms),stage="Await exchange" (151 ms),stage="Total time" (2007 ms)] [21:02:21] : [Step 4/5] [2021-11-19 21:02:21,022][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][root] Node started with the following configuration [id=850afc57-48b6-4649-99c9-a7f22de00002, marshaller=BinaryMarshaller [], discovery=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=5000, ackTimeout=5000, marsh=JdkMarshaller [clsFilter=org.apache.ignite.marshaller.MarshallerUtils$1@9e5260d], reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], binaryCfg=null, lateAff=true] [21:02:21] : [Step 4/5] [2021-11-19 21:02:21,023][INFO ][rebalance-striped-#2759%marshaller.GridMarshallerMappingConsistencyTest1%][GridDhtPartitionSupplier] Finished supplying rebalancing [grp=cache, demander=850afc57-48b6-4649-99c9-a7f22de00002, topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0]] [21:02:21]W: [org.apache.ignite:ignite-core] [2021-11-19 21:02:21,025][WARN ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][root] Waiting for topology map update [igniteInstanceName=marshaller.GridMarshallerMappingConsistencyTest1, cache=cache, cacheId=94416770, topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], p=2, affNodesCnt=2, ownersCnt=1, affNodes=[850afc57-48b6-4649-99c9-a7f22de00002, 96da3d10-9365-4ae3-9783-33321c700001], owners=[96da3d10-9365-4ae3-9783-33321c700001], topFut=GridDhtPartitionsExchangeFuture [firstDiscoEvt=DiscoveryEvent [evtNode=TcpDiscoveryNode [id=850afc57-48b6-4649-99c9-a7f22de00002, consistentId=marshaller.GridMarshallerMappingConsistencyTest2, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=4, intOrder=3, lastExchangeTime=1637344940785, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], topVer=4, msgTemplate=null, span=o.a.i.i.processors.tracing.NoopSpan@61742ff0, nodeId8=96da3d10, msg=Node joined, type=NODE_JOINED, tstamp=1637344940841], crd=TcpDiscoveryNode [id=96da3d10-9365-4ae3-9783-33321c700001, consistentId=marshaller.GridMarshallerMappingConsistencyTest1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637344940876, loc=true, ver=2.13.0#20211119-sha1:00000000, isClient=false], exchId=GridDhtPartitionExchangeId [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], discoEvt=DiscoveryEvent [evtNode=TcpDiscoveryNode [id=850afc57-48b6-4649-99c9-a7f22de00002, consistentId=marshaller.GridMarshallerMappingConsistencyTest2, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=4, intOrder=3, lastExchangeTime=1637344940785, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], topVer=4, msgTemplate=null, span=o.a.i.i.processors.tracing.NoopSpan@61742ff0, nodeId8=96da3d10, msg=Node joined, type=NODE_JOINED, tstamp=1637344940841], nodeId=850afc57, evt=NODE_JOINED], added=true, exchangeType=ALL, initFut=GridFutureAdapter [ignoreInterrupts=false, state=DONE, res=true, hash=1560933086], init=true, lastVer=GridCacheVersion [topVer=0, order=1637344939231, nodeOrder=0], partReleaseFut=PartitionReleaseFuture [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], futures=[ExplicitLockReleaseFuture [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], futures=[]], AtomicUpdateReleaseFuture [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], futures=[]], DataStreamerReleaseFuture [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], futures=[]], LocalTxReleaseFuture [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], futures=[]], AllTxReleaseFuture [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], futures=[RemoteTxReleaseFuture [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], futures=[]]]]]], exchActions=null, secCtx=null, affChangeMsg=null, centralizedAff=false, forceAffReassignment=false, exchangeLocE=null, cacheChangeFailureMsgSent=false, done=true, state=DONE, registerCachesFuture=GridFinishedFuture [resFlag=2], startTime=1637344940848, initTime=1637344940849, rebalanced=false, affinityReassign=false, span=o.a.i.i.processors.tracing.NoopSpan@61742ff0, evtLatch=0, remaining=HashSet [], mergedJoinExchMsgs=null, awaitMergedMsgs=0, super=GridFutureAdapter [ignoreInterrupts=false, state=DONE, res=AffinityTopologyVersion [topVer=4, minorTopVer=0], hash=122549941]], locNode=TcpDiscoveryNode [id=96da3d10-9365-4ae3-9783-33321c700001, consistentId=marshaller.GridMarshallerMappingConsistencyTest1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637344940876, loc=true, ver=2.13.0#20211119-sha1:00000000, isClient=false]] [21:02:21] : [Step 4/5] [2021-11-19 21:02:21,035][INFO ][rebalance-#2760%marshaller.GridMarshallerMappingConsistencyTest2%][GridDhtPartitionDemander] Completed (final) rebalancing [rebalanceId=1, grp=cache, supplier=96da3d10-9365-4ae3-9783-33321c700001, partitions=1, entries=1, duration=27ms, bytesRcvd=111.0 B, bandwidth=111.0 B/sec, histPartitions=0, histEntries=0, histBytesRcvd=0.0 B, fullPartitions=1, fullEntries=1, fullBytesRcvd=111.0 B, topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], progress=1/1] [21:02:21] : [Step 4/5] [2021-11-19 21:02:21,038][INFO ][rebalance-#2760%marshaller.GridMarshallerMappingConsistencyTest2%][GridDhtPartitionDemander] Completed rebalance future: RebalanceFuture [state=STARTED, grp=CacheGroupContext [grp=cache], topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], rebalanceId=1, routines=1, receivedBytes=127, receivedKeys=1, partitionsLeft=0, partitionsTotal=1, startTime=1637344941008, endTime=1637344941037, lastCancelledTime=-1, result=true] [21:02:21] : [Step 4/5] [2021-11-19 21:02:21,039][INFO ][rebalance-#2760%marshaller.GridMarshallerMappingConsistencyTest2%][GridDhtPartitionDemander] Completed rebalance chain: [rebalanceId=1, partitions=1, entries=1, duration=31ms, bytesRcvd=111.0 B] [21:02:21] : [Step 4/5] [2021-11-19 21:02:21,047][INFO ][exchange-worker-#2467%marshaller.GridMarshallerMappingConsistencyTest1%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], crd=true, evt=DISCOVERY_CUSTOM_EVT, evtNode=96da3d10-9365-4ae3-9783-33321c700001, customEvt=CacheAffinityChangeMessage [id=348ac593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], exchId=null, partsMsg=null, exchangeNeeded=true], allowMerge=false, exchangeFreeSwitch=false] [21:02:21] : [Step 4/5] [2021-11-19 21:02:21,048][INFO ][exchange-worker-#2745%marshaller.GridMarshallerMappingConsistencyTest2%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], crd=false, evt=DISCOVERY_CUSTOM_EVT, evtNode=96da3d10-9365-4ae3-9783-33321c700001, customEvt=CacheAffinityChangeMessage [id=348ac593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], exchId=null, partsMsg=null, exchangeNeeded=true], allowMerge=false, exchangeFreeSwitch=false] [21:02:21] : [Step 4/5] [2021-11-19 21:02:21,050][INFO ][exchange-worker-#2467%marshaller.GridMarshallerMappingConsistencyTest1%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], waitTime=0ms, futInfo=NA, mode=DISTRIBUTED] [21:02:21] : [Step 4/5] [2021-11-19 21:02:21,052][INFO ][exchange-worker-#2745%marshaller.GridMarshallerMappingConsistencyTest2%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], waitTime=0ms, futInfo=NA, mode=DISTRIBUTED] [21:02:21] : [Step 4/5] [2021-11-19 21:02:21,053][INFO ][exchange-worker-#2467%marshaller.GridMarshallerMappingConsistencyTest1%][GridDhtPartitionsExchangeFuture] Finished waiting for partitions release latch: ServerLatch [permits=0, pendingAcks=HashSet [], super=CompletableLatch [id=CompletableLatchUid [id=exchange, topVer=AffinityTopologyVersion [topVer=4, minorTopVer=1]]]] [21:02:21] : [Step 4/5] [2021-11-19 21:02:21,053][INFO ][exchange-worker-#2745%marshaller.GridMarshallerMappingConsistencyTest2%][GridDhtPartitionsExchangeFuture] Finished waiting for partitions release latch: ClientLatch [coordinator=TcpDiscoveryNode [id=96da3d10-9365-4ae3-9783-33321c700001, consistentId=marshaller.GridMarshallerMappingConsistencyTest1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637344940831, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], ackSent=true, super=CompletableLatch [id=CompletableLatchUid [id=exchange, topVer=AffinityTopologyVersion [topVer=4, minorTopVer=1]]]] [21:02:21] : [Step 4/5] [2021-11-19 21:02:21,053][INFO ][exchange-worker-#2467%marshaller.GridMarshallerMappingConsistencyTest1%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:02:21] : [Step 4/5] [2021-11-19 21:02:21,055][INFO ][exchange-worker-#2745%marshaller.GridMarshallerMappingConsistencyTest2%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:02:21] : [Step 4/5] [2021-11-19 21:02:21,057][INFO ][exchange-worker-#2467%marshaller.GridMarshallerMappingConsistencyTest1%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], crd=true] [21:02:21] : [Step 4/5] [2021-11-19 21:02:21,061][INFO ][exchange-worker-#2745%marshaller.GridMarshallerMappingConsistencyTest2%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], crd=false] [21:02:21] : [Step 4/5] [2021-11-19 21:02:21,062][INFO ][sys-#2450%marshaller.GridMarshallerMappingConsistencyTest1%][GridDhtPartitionsExchangeFuture] Coordinator received single message [ver=AffinityTopologyVersion [topVer=4, minorTopVer=1], node=850afc57-48b6-4649-99c9-a7f22de00002, allReceived=true] [21:02:21] : [Step 4/5] [2021-11-19 21:02:21,063][INFO ][sys-#2450%marshaller.GridMarshallerMappingConsistencyTest1%][GridDhtPartitionsExchangeFuture] finishExchangeOnCoordinator [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=1]] [21:02:21] : [Step 4/5] [2021-11-19 21:02:21,075][INFO ][sys-#2450%marshaller.GridMarshallerMappingConsistencyTest1%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], err=null, rebalanced=true, wasRebalanced=false] [21:02:21] : [Step 4/5] [2021-11-19 21:02:21,076][INFO ][sys-#2719%marshaller.GridMarshallerMappingConsistencyTest2%][GridDhtPartitionsExchangeFuture] Received full message, will finish exchange [node=96da3d10-9365-4ae3-9783-33321c700001, resVer=AffinityTopologyVersion [topVer=4, minorTopVer=1]] [21:02:21] : [Step 4/5] [2021-11-19 21:02:21,080][INFO ][sys-#2450%marshaller.GridMarshallerMappingConsistencyTest1%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=96da3d10-9365-4ae3-9783-33321c700001, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=96da3d10-9365-4ae3-9783-33321c700001, consistentId=marshaller.GridMarshallerMappingConsistencyTest1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637344941039, loc=true, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=4, minorTopVer=1]] [21:02:21] : [Step 4/5] [2021-11-19 21:02:21,081][INFO ][exchange-worker-#2467%marshaller.GridMarshallerMappingConsistencyTest1%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=4, minorTopVer=1], force=false, evt=DISCOVERY_CUSTOM_EVT, node=96da3d10-9365-4ae3-9783-33321c700001] [21:02:21] : [Step 4/5] [2021-11-19 21:02:21,080][INFO ][sys-#2719%marshaller.GridMarshallerMappingConsistencyTest2%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], err=null, rebalanced=true, wasRebalanced=false] [21:02:21]W: [org.apache.ignite:ignite-core] [2021-11-19 21:02:21,080][WARN ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][root] Finished waiting for topology map update [igniteInstanceName=marshaller.GridMarshallerMappingConsistencyTest1, p=2, duration=45ms] [21:02:21] : [Step 4/5] [2021-11-19 21:02:21,081][INFO ][sys-#2450%marshaller.GridMarshallerMappingConsistencyTest1%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (1 ms), stage="Determine exchange type" (1 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Wait partitions release latch [latch=exchange]" (2 ms), stage="Wait partitions release [latch=exchange]" (1 ms), stage="After states restored callback" (1 ms), stage="WAL history reservation" (0 ms), stage="Waiting for all single messages" (5 ms), stage="Affinity recalculation (crd)" (0 ms), stage="Collect update counters and create affinity messages" (0 ms), stage="Validate partitions states" (1 ms), stage="Apply update counters" (0 ms), stage="Full message preparing" (9 ms), stage="Full message sending" (0 ms), stage="Exchange done" (6 ms), stage="Total time" (27 ms), Discovery lag=1 ms, Latest started node id=850afc57-48b6-4649-99c9-a7f22de00002] [21:02:21] : [Step 4/5] [2021-11-19 21:02:21,085][INFO ][sys-#2719%marshaller.GridMarshallerMappingConsistencyTest2%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=850afc57-48b6-4649-99c9-a7f22de00002, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=96da3d10-9365-4ae3-9783-33321c700001, consistentId=marshaller.GridMarshallerMappingConsistencyTest1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637344940831, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=4, minorTopVer=1]] [21:02:21] : [Step 4/5] [2021-11-19 21:02:21,087][INFO ][exchange-worker-#2745%marshaller.GridMarshallerMappingConsistencyTest2%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=4, minorTopVer=1], force=false, evt=DISCOVERY_CUSTOM_EVT, node=96da3d10-9365-4ae3-9783-33321c700001] [21:02:21] : [Step 4/5] [2021-11-19 21:02:21,086][INFO ][sys-#2450%marshaller.GridMarshallerMappingConsistencyTest1%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], stage="Affinity change by custom message [grp=cache]" (1 ms) (parent=Determine exchange type), stage="Affinity change by custom message [grp=ignite-sys-cache]" (0 ms) (parent=Determine exchange type)] [21:02:21] : [Step 4/5] [2021-11-19 21:02:21,088][INFO ][sys-#2719%marshaller.GridMarshallerMappingConsistencyTest2%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (1 ms), stage="Determine exchange type" (1 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Wait partitions release latch [latch=exchange]" (2 ms), stage="Wait partitions release [latch=exchange]" (1 ms), stage="After states restored callback" (1 ms), stage="WAL history reservation" (0 ms), stage="Waiting for Full message" (17 ms), stage="Affinity recalculation" (0 ms), stage="Full map updating" (3 ms), stage="Exchange done" (7 ms), stage="Total time" (33 ms)] [21:02:21] : [Step 4/5] [2021-11-19 21:02:21,093][INFO ][sys-#2719%marshaller.GridMarshallerMappingConsistencyTest2%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], stage="Affinity change by custom message [grp=cache]" (1 ms) (parent=Determine exchange type), stage="Affinity change by custom message [grp=ignite-sys-cache]" (0 ms) (parent=Determine exchange type)] [21:02:21] : [Step 4/5] [2021-11-19 21:02:21,100][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][root] awaitPartitionMapExchange finished [21:02:21] : [Step 4/5] [2021-11-19 21:02:21,100][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][root] >>> Stopping grid [name=marshaller.GridMarshallerMappingConsistencyTest1, id=96da3d10-9365-4ae3-9783-33321c700001] [21:02:21] : [Step 4/5] [2021-11-19 21:02:21,421][INFO ][db-checkpoint-thread-#2750%marshaller.GridMarshallerMappingConsistencyTest2%][Checkpointer] Checkpoint started [checkpointId=b42ff3d3-7db3-44d8-858b-f6181f57db14, startPtr=WALPointer [idx=0, fileOff=275426, len=21425], checkpointBeforeLockTime=5ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=2ms, checkpointLockHoldTime=5ms, walCpRecordFsyncDuration=227ms, writeCheckpointEntryDuration=271ms, splitAndSortCpPagesDuration=0ms, pages=15, reason='node started'] [21:02:21] : [Step 4/5] [2021-11-19 21:02:21,422][INFO ][db-checkpoint-thread-#2601%marshaller.GridMarshallerMappingConsistencyTest1%][Checkpointer] Checkpoint started [checkpointId=9d071e8c-b69a-442d-a277-2f3a98820eb5, startPtr=WALPointer [idx=0, fileOff=180054, len=21409], checkpointBeforeLockTime=3ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=1ms, checkpointLockHoldTime=4ms, walCpRecordFsyncDuration=277ms, writeCheckpointEntryDuration=30ms, splitAndSortCpPagesDuration=0ms, pages=15, reason='timeout'] [21:02:21] : [Step 4/5] [2021-11-19 21:02:21,432][INFO ][tcp-disco-sock-reader-[850afc57 127.0.0.1:49699]-#147%marshaller.GridMarshallerMappingConsistencyTest1%-#2742%marshaller.GridMarshallerMappingConsistencyTest1%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:49699, rmtPort=49699, rmtNodeId=850afc57-48b6-4649-99c9-a7f22de00002] [21:02:21] : [Step 4/5] [2021-11-19 21:02:21,435][INFO ][disco-event-worker-#2744%marshaller.GridMarshallerMappingConsistencyTest2%][GridDiscoveryManager] Node left topology: TcpDiscoveryNode [id=96da3d10-9365-4ae3-9783-33321c700001, consistentId=marshaller.GridMarshallerMappingConsistencyTest1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637344940831, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false] [21:02:21]W: [org.apache.ignite:ignite-core] [2021-11-19 21:02:21,432][WARN ][tcp-disco-sock-reader-[6057dd11 127.0.0.1:59859]-#138%marshaller.GridMarshallerMappingConsistencyTest1%-#2587%marshaller.GridMarshallerMappingConsistencyTest1%][TestTcpDiscoverySpi] Failed to shutdown socket [21:02:21]W: [org.apache.ignite:ignite-core] java.net.SocketException: Socket is closed [21:02:21]W: [org.apache.ignite:ignite-core] at java.net.Socket.shutdownOutput(Socket.java:1568) [21:02:21]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.close(IgniteUtils.java:4247) [21:02:21]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.discovery.tcp.ServerImpl$SocketReader.body(ServerImpl.java:7370) [21:02:21]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.IgniteSpiThread.run(IgniteSpiThread.java:58) [21:02:21] : [Step 4/5] [2021-11-19 21:02:21,438][INFO ][disco-event-worker-#2744%marshaller.GridMarshallerMappingConsistencyTest2%][GridDiscoveryManager] Topology snapshot [ver=5, locNode=850afc57, servers=1, clients=0, state=ACTIVE, CPUs=24, offheap=0.25GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=850afc57-48b6-4649-99c9-a7f22de00002, consistentId=marshaller.GridMarshallerMappingConsistencyTest2, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:02:21] : [Step 4/5] [2021-11-19 21:02:21,439][INFO ][tcp-disco-sock-reader-[6057dd11 127.0.0.1:59859]-#138%marshaller.GridMarshallerMappingConsistencyTest1%-#2587%marshaller.GridMarshallerMappingConsistencyTest1%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:59859, rmtPort=59859, rmtNodeId=6057dd11-6d2a-4e45-8208-78ac4b700002] [21:02:21] : [Step 4/5] [2021-11-19 21:02:21,439][INFO ][db-checkpoint-thread-#2750%marshaller.GridMarshallerMappingConsistencyTest2%][Checkpointer] Checkpoint finished [cpId=b42ff3d3-7db3-44d8-858b-f6181f57db14, pages=15, markPos=WALPointer [idx=0, fileOff=275426, len=21425], walSegmentsCovered=[], markDuration=504ms, pagesWrite=3ms, fsync=14ms, total=526ms] [21:02:21] : [Step 4/5] [2021-11-19 21:02:21,439][INFO ][disco-event-worker-#2744%marshaller.GridMarshallerMappingConsistencyTest2%][GridDiscoveryManager] Coordinator changed [prev=TcpDiscoveryNode [id=96da3d10-9365-4ae3-9783-33321c700001, consistentId=marshaller.GridMarshallerMappingConsistencyTest1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637344940831, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], cur=TcpDiscoveryNode [id=850afc57-48b6-4649-99c9-a7f22de00002, consistentId=marshaller.GridMarshallerMappingConsistencyTest2, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=4, intOrder=3, lastExchangeTime=1637344941427, loc=true, ver=2.13.0#20211119-sha1:00000000, isClient=false]] [21:02:21] : [Step 4/5] [2021-11-19 21:02:21,445][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][GridCacheProcessor] Stopped cache [cacheName=ignite-sys-cache] [21:02:21] : [Step 4/5] [2021-11-19 21:02:21,446][INFO ][disco-event-worker-#2744%marshaller.GridMarshallerMappingConsistencyTest2%][GridDiscoveryManager] ^-- Baseline [id=0, size=2, online=1, offline=1] [21:02:21] : [Step 4/5] [2021-11-19 21:02:21,448][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][GridCacheProcessor] Stopped cache [cacheName=cache] [21:02:21] : [Step 4/5] [2021-11-19 21:02:21,448][INFO ][disco-event-worker-#2744%marshaller.GridMarshallerMappingConsistencyTest2%][MvccProcessorImpl] Assigned mvcc coordinator [crd=MvccCoordinator [topVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], nodeId=850afc57-48b6-4649-99c9-a7f22de00002, ver=1637344935724, local=true, initialized=false]] [21:02:21] : [Step 4/5] [2021-11-19 21:02:21,451][INFO ][sys-#2732%marshaller.GridMarshallerMappingConsistencyTest2%][ExchangeLatchManager] Become new coordinator 850afc57-48b6-4649-99c9-a7f22de00002 [21:02:21] : [Step 4/5] [2021-11-19 21:02:21,452][INFO ][exchange-worker-#2745%marshaller.GridMarshallerMappingConsistencyTest2%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], crd=true, evt=NODE_LEFT, evtNode=96da3d10-9365-4ae3-9783-33321c700001, customEvt=null, allowMerge=false, exchangeFreeSwitch=true] [21:02:21] : [Step 4/5] [2021-11-19 21:02:21,455][INFO ][sys-#2721%marshaller.GridMarshallerMappingConsistencyTest2%][GridAffinityAssignmentCache] Local node affinity assignment distribution is not ideal [cache=cache, expectedPrimary=1024.00, actualPrimary=1024, expectedBackups=1024.00, actualBackups=0, warningThreshold=50.00%] [21:02:21] : [Step 4/5] [2021-11-19 21:02:21,457][INFO ][exchange-worker-#2745%marshaller.GridMarshallerMappingConsistencyTest2%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:02:21] : [Step 4/5] [2021-11-19 21:02:21,461][INFO ][exchange-worker-#2745%marshaller.GridMarshallerMappingConsistencyTest2%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], err=null, rebalanced=true, wasRebalanced=true] [21:02:21] : [Step 4/5] [2021-11-19 21:02:21,464][INFO ][exchange-worker-#2745%marshaller.GridMarshallerMappingConsistencyTest2%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=850afc57-48b6-4649-99c9-a7f22de00002, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], evt=NODE_LEFT, evtNode=TcpDiscoveryNode [id=96da3d10-9365-4ae3-9783-33321c700001, consistentId=marshaller.GridMarshallerMappingConsistencyTest1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637344940831, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=5, minorTopVer=0]] [21:02:21] : [Step 4/5] [2021-11-19 21:02:21,466][INFO ][exchange-worker-#2745%marshaller.GridMarshallerMappingConsistencyTest2%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (0 ms), stage="Determine exchange type" (3 ms), stage="Preloading notification" (0 ms), stage="After states restored callback" (0 ms), stage="WAL history reservation" (0 ms), stage="Finalize update counters" (1 ms), stage="Detect lost partitions" (3 ms), stage="Exchange done" (2 ms), stage="Total time" (9 ms)] [21:02:21] : [Step 4/5] [2021-11-19 21:02:21,467][INFO ][exchange-worker-#2745%marshaller.GridMarshallerMappingConsistencyTest2%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], stage="Affinity initialization (exchange-free switch on fully-rebalanced topology) [grp=cache]" (3 ms) (parent=Determine exchange type), stage="Affinity initialization (exchange-free switch on fully-rebalanced topology) [grp=ignite-sys-cache]" (0 ms) (parent=Determine exchange type)] [21:02:21] : [Step 4/5] [2021-11-19 21:02:21,468][INFO ][exchange-worker-#2745%marshaller.GridMarshallerMappingConsistencyTest2%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], crd=true] [21:02:21] : [Step 4/5] [2021-11-19 21:02:21,470][INFO ][exchange-worker-#2745%marshaller.GridMarshallerMappingConsistencyTest2%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=5, minorTopVer=0], force=false, evt=NODE_LEFT, node=96da3d10-9365-4ae3-9783-33321c700001] [21:02:22] : [Step 4/5] [2021-11-19 21:02:22,102][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][FilePageStoreManager] Cleanup cache stores [total=4, left=0, cleanFiles=false] [21:02:22] : [Step 4/5] [2021-11-19 21:02:22,108][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][GridDeploymentLocalStore] Removed undeployed class: GridDeployment [ts=1637344937108, depMode=SHARED, clsLdr=IsolatedClassLoader{roleName='test'}, clsLdrId=397ac593d71-96da3d10-9365-4ae3-9783-33321c700001, userVer=0, loc=true, sampleClsName=org.apache.ignite.internal.processors.cache.distributed.dht.preloader.GridDhtPartitionMap, pendingUndeploy=false, undeployed=true, usage=0] [21:02:22] : [Step 4/5] [2021-11-19 21:02:22,124][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][GridMarshallerMappingConsistencyTest1] [21:02:22] : [Step 4/5] [21:02:22] : [Step 4/5] >>> +------------------------------------------------------+ [21:02:22] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV stopped OK [21:02:22] : [Step 4/5] >>> +------------------------------------------------------+ [21:02:22] : [Step 4/5] >>> Ignite instance name: marshaller.GridMarshallerMappingConsistencyTest1 [21:02:22] : [Step 4/5] >>> Grid uptime: 00:00:06.384 [21:02:22] : [Step 4/5] [21:02:22] : [Step 4/5] [21:02:22] : [Step 4/5] [2021-11-19 21:02:22,125][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][root] >>> Stopping grid [name=marshaller.GridMarshallerMappingConsistencyTest2, id=850afc57-48b6-4649-99c9-a7f22de00002] [21:02:22] : [Step 4/5] [2021-11-19 21:02:22,139][INFO ][db-checkpoint-thread-#2750%marshaller.GridMarshallerMappingConsistencyTest2%][Checkpointer] Checkpoint started [checkpointId=7a3a402d-875b-4516-a0bf-98c9458769e7, startPtr=WALPointer [idx=0, fileOff=331340, len=21409], checkpointBeforeLockTime=3ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=1ms, checkpointLockHoldTime=4ms, walCpRecordFsyncDuration=1ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=1ms, pages=16, reason='timeout'] [21:02:22] : [Step 4/5] [2021-11-19 21:02:22,147][INFO ][tcp-disco-sock-reader-[96da3d10 127.0.0.1:43777]-#146%marshaller.GridMarshallerMappingConsistencyTest2%-#2741%marshaller.GridMarshallerMappingConsistencyTest2%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:43777, rmtPort=43777, rmtNodeId=96da3d10-9365-4ae3-9783-33321c700001] [21:02:22] : [Step 4/5] [2021-11-19 21:02:22,150][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][GridCacheProcessor] Stopped cache [cacheName=cache] [21:02:22] : [Step 4/5] [2021-11-19 21:02:22,151][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][GridCacheProcessor] Stopped cache [cacheName=ignite-sys-cache] [21:02:22] : [Step 4/5] [2021-11-19 21:02:22,479][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][FilePageStoreManager] Cleanup cache stores [total=4, left=0, cleanFiles=false] [21:02:22] : [Step 4/5] [2021-11-19 21:02:22,480][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][GridDeploymentLocalStore] Removed undeployed class: GridDeployment [ts=1637344940968, depMode=SHARED, clsLdr=IsolatedClassLoader{roleName='test'}, clsLdrId=b38ac593d71-850afc57-48b6-4649-99c9-a7f22de00002, userVer=0, loc=true, sampleClsName=org.apache.ignite.internal.processors.cache.distributed.dht.preloader.IgniteDhtPartitionCountersMap2, pendingUndeploy=false, undeployed=true, usage=0] [21:02:22] : [Step 4/5] [2021-11-19 21:02:22,490][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][GridMarshallerMappingConsistencyTest2] [21:02:22] : [Step 4/5] [21:02:22] : [Step 4/5] >>> +------------------------------------------------------+ [21:02:22] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV stopped OK [21:02:22] : [Step 4/5] >>> +------------------------------------------------------+ [21:02:22] : [Step 4/5] >>> Ignite instance name: marshaller.GridMarshallerMappingConsistencyTest2 [21:02:22] : [Step 4/5] >>> Grid uptime: 00:00:01.478 [21:02:22] : [Step 4/5] [21:02:22] : [Step 4/5] [21:02:22] : [Step 4/5] [2021-11-19 21:02:22,499][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][GridMarshallerMappingConsistencyTest2] [21:02:22] : [Step 4/5] [21:02:22] : [Step 4/5] >>> __________ ________________ [21:02:22] : [Step 4/5] >>> / _/ ___/ |/ / _/_ __/ __/ [21:02:22] : [Step 4/5] >>> _/ // (7 7 // / / / / _/ [21:02:22] : [Step 4/5] >>> /___/\___/_/|_/___/ /_/ /___/ [21:02:22] : [Step 4/5] >>> [21:02:22] : [Step 4/5] >>> ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:02:22] : [Step 4/5] >>> 2021 Copyright(C) Apache Software Foundation [21:02:22] : [Step 4/5] >>> [21:02:22] : [Step 4/5] >>> Ignite documentation: http://ignite.apache.org [21:02:22] : [Step 4/5] [21:02:22] : [Step 4/5] [2021-11-19 21:02:22,500][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][GridMarshallerMappingConsistencyTest2] Config URL: n/a [21:02:22] : [Step 4/5] [2021-11-19 21:02:22,500][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][GridMarshallerMappingConsistencyTest2] IgniteConfiguration [igniteInstanceName=marshaller.GridMarshallerMappingConsistencyTest2, pubPoolSize=24, svcPoolSize=24, callbackPoolSize=24, stripedPoolSize=24, sysPoolSize=24, mgmtPoolSize=4, dataStreamerPoolSize=24, utilityCachePoolSize=24, utilityCacheKeepAliveTime=60000, p2pPoolSize=2, qryPoolSize=24, buildIdxPoolSize=4, igniteHome=/opt/buildagent/work/7bc1c54bc719b67c, igniteWorkDir=/opt/buildagent/work/7bc1c54bc719b67c/work/test/marshaller.GridMarshallerMappingConsistencyTest2, mbeanSrv=com.sun.jmx.mbeanserver.JmxMBeanServer@6fe85038, nodeId=b2d92c77-6daa-40af-9fe0-4d696a800002, marsh=BinaryMarshaller [], marshLocJobs=false, daemon=false, p2pEnabled=true, netTimeout=10000, netCompressionLevel=1, sndRetryDelay=1000, sndRetryCnt=3, metricsHistSize=10000, metricsUpdateFreq=1000, metricsExpTime=9223372036854775807, discoSpi=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=0, ackTimeout=0, marsh=null, reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], segPlc=STOP, segResolveAttempts=2, waitForSegOnStart=true, allResolversPassReq=true, segChkFreq=10000, commSpi=TcpCommunicationSpi [connectGate=org.apache.ignite.spi.communication.tcp.internal.ConnectGateway@125e4800, ctxInitLatch=java.util.concurrent.CountDownLatch@c75eb30[Count = 1], stopping=false, clientPool=null, nioSrvWrapper=null, stateProvider=null], evtSpi=MemoryEventStorageSpi [expireAgeMs=9223372036854775807, expireCnt=10000, filter=null], colSpi=NoopCollisionSpi [], deploySpi=LocalDeploymentSpi [], indexingSpi=org.apache.ignite.spi.indexing.noop.NoopIndexingSpi@52853883, addrRslvr=null, encryptionSpi=org.apache.ignite.spi.encryption.noop.NoopEncryptionSpi@67216693, tracingSpi=org.apache.ignite.spi.tracing.NoopTracingSpi@57c9ef35, clientMode=false, rebalanceThreadPoolSize=4, rebalanceTimeout=10000, rebalanceBatchesPrefetchCnt=3, rebalanceThrottle=0, rebalanceBatchSize=524288, txCfg=TransactionConfiguration [txSerEnabled=false, dfltIsolation=REPEATABLE_READ, dfltConcurrency=PESSIMISTIC, dfltTxTimeout=0, txTimeoutOnPartitionMapExchange=0, deadlockTimeout=10000, pessimisticTxLogSize=0, pessimisticTxLogLinger=10000, tmLookupClsName=null, txManagerFactory=null, useJtaSync=false], cacheSanityCheckEnabled=true, discoStartupDelay=60000, deployMode=SHARED, p2pMissedCacheSize=100, locHost=127.0.0.1, timeSrvPortBase=31100, timeSrvPortRange=100, failureDetectionTimeout=10000, sysWorkerBlockedTimeout=null, clientFailureDetectionTimeout=10000, metricsLogFreq=0, connectorCfg=null, odbcCfg=null, warmupClos=null, atomicCfg=AtomicConfiguration [seqReserveSize=1000, cacheMode=PARTITIONED, backups=1, aff=null, grpName=null], classLdr=null, sslCtxFactory=null, platformCfg=null, binaryCfg=null, memCfg=null, pstCfg=null, dsCfg=DataStorageConfiguration [sysRegionInitSize=41943040, sysRegionMaxSize=104857600, pageSize=0, concLvl=0, dfltDataRegConf=DataRegionConfiguration [name=default, maxSize=268435456, initSize=268435456, swapPath=null, pageEvictionMode=DISABLED, pageReplacementMode=CLOCK, evictionThreshold=0.9, emptyPagesPoolSize=100, metricsEnabled=false, metricsSubIntervalCount=5, metricsRateTimeInterval=60000, persistenceEnabled=true, checkpointPageBufSize=0, lazyMemoryAllocation=true, warmUpCfg=null], dataRegions=null, storagePath=null, checkpointFreq=180000, lockWaitTime=10000, checkpointThreads=4, checkpointWriteOrder=SEQUENTIAL, walHistSize=20, maxWalArchiveSize=1073741824, walSegments=10, walSegmentSize=67108864, walPath=db/wal, walArchivePath=db/wal/archive, cdcWalPath=db/wal/cdc, cdcEnabled=false, metricsEnabled=false, walMode=LOG_ONLY, walTlbSize=131072, walBuffSize=0, walFlushFreq=2000, walFsyncDelay=1000, walRecordIterBuffSize=67108864, alwaysWriteFullPages=false, fileIOFactory=org.apache.ignite.internal.processors.cache.persistence.file.AsyncFileIOFactory@5aab58fb, metricsSubIntervalCnt=5, metricsRateTimeInterval=60000, walAutoArchiveAfterInactivity=-1, walForceArchiveTimeout=-1, writeThrottlingEnabled=false, walCompactionEnabled=false, walCompactionLevel=1, checkpointReadLockTimeout=null, walPageCompression=DISABLED, walPageCompressionLevel=null, dfltWarmUpCfg=null, encCfg=org.apache.ignite.configuration.EncryptionConfiguration@dc1c98b, defragmentationThreadPoolSize=4, minWalArchiveSize=-1], snapshotPath=snapshots, activeOnStart=true, activeOnStartPropSetFlag=false, autoActivation=true, autoActivationPropSetFlag=false, clusterStateOnStart=null, sqlConnCfg=null, cliConnCfg=ClientConnectorConfiguration [host=null, port=10800, portRange=100, sockSndBufSize=0, sockRcvBufSize=0, tcpNoDelay=true, maxOpenCursorsPerConn=128, threadPoolSize=24, selectorCnt=12, idleTimeout=0, handshakeTimeout=10000, jdbcEnabled=true, odbcEnabled=true, thinCliEnabled=true, sslEnabled=false, useIgniteSslCtxFactory=true, sslClientAuth=false, sslCtxFactory=null, thinCliCfg=ThinClientConfiguration [maxActiveTxPerConn=100, maxActiveComputeTasksPerConn=0]], mvccVacuumThreadCnt=2, mvccVacuumFreq=5000, authEnabled=false, failureHnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]], commFailureRslvr=null, sqlCfg=SqlConfiguration [longQryWarnTimeout=3000, dfltQryTimeout=0, sqlQryHistSize=1000, validationEnabled=false], asyncContinuationExecutor=null] [21:02:22] : [Step 4/5] [2021-11-19 21:02:22,510][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][GridMarshallerMappingConsistencyTest2] Daemon mode: off [21:02:22] : [Step 4/5] [2021-11-19 21:02:22,510][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][GridMarshallerMappingConsistencyTest2] OS: Linux 4.15.0-151-generic amd64 [21:02:22] : [Step 4/5] [2021-11-19 21:02:22,510][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][GridMarshallerMappingConsistencyTest2] OS user: teamcity [21:02:22] : [Step 4/5] [2021-11-19 21:02:22,511][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][GridMarshallerMappingConsistencyTest2] PID: 16724 [21:02:22] : [Step 4/5] [2021-11-19 21:02:22,511][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][GridMarshallerMappingConsistencyTest2] Language runtime: Java Platform API Specification ver. 1.8 [21:02:22] : [Step 4/5] [2021-11-19 21:02:22,512][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][GridMarshallerMappingConsistencyTest2] VM information: Java(TM) SE Runtime Environment 1.8.0_261-b12 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 25.261-b12 [21:02:22] : [Step 4/5] [2021-11-19 21:02:22,512][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][GridMarshallerMappingConsistencyTest2] VM total memory: 1.9GB [21:02:22] : [Step 4/5] [2021-11-19 21:02:22,512][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][GridMarshallerMappingConsistencyTest2] Remote Management [restart: off, REST: off, JMX (remote: off)] [21:02:22] : [Step 4/5] [2021-11-19 21:02:22,513][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][GridMarshallerMappingConsistencyTest2] Logger: GridTestLog4jLogger [quiet=false, config=null] [21:02:22] : [Step 4/5] [2021-11-19 21:02:22,513][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][GridMarshallerMappingConsistencyTest2] IGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c [21:02:22] : [Step 4/5] [2021-11-19 21:02:22,513][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][GridMarshallerMappingConsistencyTest2] VM arguments: [-DIGNITE_DUMP_THREADS_ON_FAILURE=false, -DMono=/usr/bin/mono-sgen, -DMono4.0_x64=/usr/lib/mono/4.0, -DMono4.5_x64=/usr/lib/mono/4.5, -DMonoVersion=6.12.0.90, -DSKIP_BUILD=false, -Dagent.home.dir=/opt/buildagent, -Dagent.name=aitc-lin02_03, -Dagent.ownPort=9090, -Dagent.work.dir=/opt/buildagent/work, -Dbuild.number=95, -Dbuild.vcs.number=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.1=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.GitHubApacheIgnite=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dclassworlds.conf=/opt/buildagent/temp/buildTmp/teamcity.m2.conf, -Dcom.jetbrains.maven.watcher.report.file=/opt/buildagent/temp/buildTmp/maven-build-info.xml, -Djava.io.tmpdir=/opt/buildagent/temp/buildTmp, -Dmaven.home=/opt/buildagent/tools/maven3_6, -Dmaven.multiModuleProjectDirectory=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.agent.cpuBenchmark=457, -Dteamcity.agent.dotnet.agent_url=http://localhost:9090/RPC2, -Dteamcity.agent.dotnet.build_id=6278078, -Dteamcity.auth.password=*******, -Dteamcity.auth.userId=TeamCityBuildId=6278078, -Dteamcity.build.changedFiles.file=/opt/buildagent/temp/buildTmp/changedFiles6342607772318147725.txt, -Dteamcity.build.checkoutDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.build.id=6278078, -Dteamcity.build.properties.file=/opt/buildagent/temp/buildTmp/teamcity.build5164517880467851002.properties, -Dteamcity.build.tempDir=/opt/buildagent/temp/buildTmp, -Dteamcity.build.workingDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.buildConfName=Basic 3, -Dteamcity.buildType.id=IgniteTests24Java8_Basic3, -Dteamcity.configuration.properties.file=/opt/buildagent/temp/buildTmp/teamcity.config5591980786735343870.properties, -Dteamcity.maven.userSettings.path=/opt/buildagent/temp/buildTmp/maven_settings_585072866407032347.xml, -Dteamcity.maven.watcher.home=/opt/buildagent/plugins/mavenPlugin/maven-watcher-jdk16, -Dteamcity.projectName=Ignite Tests 2.x (JDK 8/11), -Dteamcity.runner.properties.file=/opt/buildagent/temp/buildTmp/teamcity.runner9098465561618137420.properties, -Dteamcity.tests.recentlyFailedTests.file=/opt/buildagent/temp/buildTmp/testsToRunFirst3891775683130404069.txt, -Dteamcity.version=2021.2 (build 99542), -ea, -Xms2g, -Xmx2g, -XX:+HeapDumpOnOutOfMemoryError, -DIGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_TEST_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_UPDATE_NOTIFIER=false, -DIGNITE_NO_DISCO_ORDER=true, -DIGNITE_PERFORMANCE_SUGGESTIONS_DISABLED=true, -Djava.net.preferIPv4Stack=true, -DTEST_SCALE_FACTOR=1.0, -DIGNITE_TEST_PROP_LOG4J_FILE=log4j-tc-test.xml, -DIGNITE_QUIET=false, -DIGNITE_MARSHAL_BUFFERS_RECHECK=1000, -Dmaven.repo.local=/opt/buildagent/.m2/repository] [21:02:22] : [Step 4/5] [2021-11-19 21:02:22,518][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][GridMarshallerMappingConsistencyTest2] System cache's DataRegion size is configured to 40 MB. Use DataStorageConfiguration.systemRegionInitialSize property to change the setting. [21:02:22] : [Step 4/5] [2021-11-19 21:02:22,519][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][GridMarshallerMappingConsistencyTest2] Configured caches [in 'sysMemPlc' dataRegion: ['ignite-sys-cache']] [21:02:22]W: [org.apache.ignite:ignite-core] [2021-11-19 21:02:22,519][WARN ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][GridMarshallerMappingConsistencyTest2] Peer class loading is enabled (disable it in production for performance and deployment consistency reasons) [21:02:22] : [Step 4/5] [2021-11-19 21:02:22,520][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][GridMarshallerMappingConsistencyTest2] 3-rd party licenses can be found at: /opt/buildagent/work/7bc1c54bc719b67c/libs/licenses [21:02:22] : [Step 4/5] [2021-11-19 21:02:22,524][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][IgnitePluginProcessor] Configured plugins: [21:02:22] : [Step 4/5] [2021-11-19 21:02:22,525][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][IgnitePluginProcessor] ^-- StanByClusterTestProvider 1.0 [21:02:22] : [Step 4/5] [2021-11-19 21:02:22,525][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][IgnitePluginProcessor] ^-- null [21:02:22] : [Step 4/5] [2021-11-19 21:02:22,525][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][IgnitePluginProcessor] [21:02:22] : [Step 4/5] [2021-11-19 21:02:22,526][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][IgnitePluginProcessor] ^-- PageMemory tracker plugin 1.0 [21:02:22] : [Step 4/5] [2021-11-19 21:02:22,526][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][IgnitePluginProcessor] ^-- null [21:02:22] : [Step 4/5] [2021-11-19 21:02:22,526][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][IgnitePluginProcessor] [21:02:22] : [Step 4/5] [2021-11-19 21:02:22,526][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][IgnitePluginProcessor] ^-- TestDistibutedConfigurationPlugin 1.0 [21:02:22] : [Step 4/5] [2021-11-19 21:02:22,527][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][IgnitePluginProcessor] ^-- null [21:02:22] : [Step 4/5] [2021-11-19 21:02:22,527][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][IgnitePluginProcessor] [21:02:22] : [Step 4/5] [2021-11-19 21:02:22,527][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][IgnitePluginProcessor] ^-- NodeValidationPluginProvider 1.0 [21:02:22] : [Step 4/5] [2021-11-19 21:02:22,528][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][IgnitePluginProcessor] ^-- null [21:02:22] : [Step 4/5] [2021-11-19 21:02:22,528][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][IgnitePluginProcessor] [21:02:22] : [Step 4/5] [2021-11-19 21:02:22,528][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][FailureProcessor] Configured failure handler: [hnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]]] [21:02:22] : [Step 4/5] [2021-11-19 21:02:22,551][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][TcpCommunicationSpi] Successfully bound communication NIO server to TCP port [port=45030, locHost=/127.0.0.1, selectorsCnt=12, selectorSpins=0, pairedConn=false] [21:02:22]W: [org.apache.ignite:ignite-core] [2021-11-19 21:02:22,552][WARN ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][TcpCommunicationSpi] Message queue limit is set to 0 which may lead to potential OOMEs when running cache operations in FULL_ASYNC or PRIMARY_SYNC modes due to message queues growth on sender and receiver sides. [21:02:22] : [Step 4/5] [2021-11-19 21:02:22,567][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][GridCollisionManager] Collision resolution is disabled (all jobs will be activated upon arrival). [21:02:22] : [Step 4/5] [2021-11-19 21:02:22,568][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][GridMarshallerMappingConsistencyTest2] Security status [authentication=off, sandbox=off, tls/ssl=off] [21:02:22] : [Step 4/5] [2021-11-19 21:02:22,569][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][MaintenanceProcessor] Resolved store directory for node persistent data: /opt/buildagent/work/7bc1c54bc719b67c/work/test/marshaller.GridMarshallerMappingConsistencyTest2/db/marshaller_GridMarshallerMappingConsistencyTest2 [21:02:22] : [Step 4/5] [2021-11-19 21:02:22,571][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][CacheObjectBinaryProcessorImpl] Resolved directory for serialized binary metadata: /opt/buildagent/work/7bc1c54bc719b67c/work/test/marshaller.GridMarshallerMappingConsistencyTest2/db/binary_meta/marshaller_GridMarshallerMappingConsistencyTest2 [21:02:22] : [Step 4/5] [2021-11-19 21:02:22,581][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/test/marshaller.GridMarshallerMappingConsistencyTest2/db/marshaller_GridMarshallerMappingConsistencyTest2 [21:02:22] : [Step 4/5] [2021-11-19 21:02:22,582][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][FileWriteAheadLogManager] Resolved write ahead log work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/test/marshaller.GridMarshallerMappingConsistencyTest2/db/wal/marshaller_GridMarshallerMappingConsistencyTest2 [21:02:22] : [Step 4/5] [2021-11-19 21:02:22,582][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][FileWriteAheadLogManager] Resolved write ahead log archive directory: /opt/buildagent/work/7bc1c54bc719b67c/work/test/marshaller.GridMarshallerMappingConsistencyTest2/db/wal/archive/marshaller_GridMarshallerMappingConsistencyTest2 [21:02:22] : [Step 4/5] [2021-11-19 21:02:22,585][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/test/marshaller.GridMarshallerMappingConsistencyTest2/db/wal/marshaller_GridMarshallerMappingConsistencyTest2/0000000000000005.wal [21:02:22] : [Step 4/5] [2021-11-19 21:02:22,586][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/test/marshaller.GridMarshallerMappingConsistencyTest2/db/wal/marshaller_GridMarshallerMappingConsistencyTest2/0000000000000006.wal [21:02:22] : [Step 4/5] [2021-11-19 21:02:22,587][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/test/marshaller.GridMarshallerMappingConsistencyTest2/db/wal/marshaller_GridMarshallerMappingConsistencyTest2/0000000000000004.wal [21:02:22] : [Step 4/5] [2021-11-19 21:02:22,587][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/test/marshaller.GridMarshallerMappingConsistencyTest2/db/wal/marshaller_GridMarshallerMappingConsistencyTest2/0000000000000003.wal [21:02:22] : [Step 4/5] [2021-11-19 21:02:22,588][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/test/marshaller.GridMarshallerMappingConsistencyTest2/db/wal/marshaller_GridMarshallerMappingConsistencyTest2/0000000000000002.wal [21:02:22] : [Step 4/5] [2021-11-19 21:02:22,589][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/test/marshaller.GridMarshallerMappingConsistencyTest2/db/wal/marshaller_GridMarshallerMappingConsistencyTest2/0000000000000007.wal [21:02:22] : [Step 4/5] [2021-11-19 21:02:22,590][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/test/marshaller.GridMarshallerMappingConsistencyTest2/db/wal/marshaller_GridMarshallerMappingConsistencyTest2/0000000000000001.wal [21:02:22] : [Step 4/5] [2021-11-19 21:02:22,591][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][FileHandleManagerImpl] Initialized write-ahead log manager [mode=LOG_ONLY] [21:02:22] : [Step 4/5] [2021-11-19 21:02:22,599][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][GridCacheDatabaseSharedManager] Configured data regions initialized successfully [total=5] [21:02:22] : [Step 4/5] [2021-11-19 21:02:22,600][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][IgniteSnapshotManager] Resolved snapshot work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/test/marshaller.GridMarshallerMappingConsistencyTest2/snapshots [21:02:22] : [Step 4/5] [2021-11-19 21:02:22,601][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][IgniteSnapshotManager] Resolved temp directory for snapshot creation: /opt/buildagent/work/7bc1c54bc719b67c/work/test/marshaller.GridMarshallerMappingConsistencyTest2/db/marshaller_GridMarshallerMappingConsistencyTest2/snp [21:02:22] : [Step 4/5] [2021-11-19 21:02:22,604][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][ClientListenerProcessor] Client connector processor has started on TCP port 10800 [21:02:22] : [Step 4/5] [2021-11-19 21:02:22,611][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][GridMarshallerMappingConsistencyTest2] Non-loopback local IPs: 172.17.0.4 [21:02:22] : [Step 4/5] [2021-11-19 21:02:22,611][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][GridMarshallerMappingConsistencyTest2] Enabled local MACs: 0242AC110004 [21:02:22] : [Step 4/5] [2021-11-19 21:02:22,615][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=/opt/buildagent/work/7bc1c54bc719b67c/work/test/marshaller.GridMarshallerMappingConsistencyTest2/db/marshaller_GridMarshallerMappingConsistencyTest2/cp/1637344942129-7a3a402d-875b-4516-a0bf-98c9458769e7-START.bin, endMarker=/opt/buildagent/work/7bc1c54bc719b67c/work/test/marshaller.GridMarshallerMappingConsistencyTest2/db/marshaller_GridMarshallerMappingConsistencyTest2/cp/1637344940913-b42ff3d3-7db3-44d8-858b-f6181f57db14-END.bin] [21:02:22] : [Step 4/5] [2021-11-19 21:02:22,617][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:02:22] : [Step 4/5] [2021-11-19 21:02:22,618][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=275426, len=21425], lastMarked=WALPointer [idx=0, fileOff=331340, len=21409], lastCheckpointId=7a3a402d-875b-4516-a0bf-98c9458769e7] [21:02:22] : [Step 4/5] [2021-11-19 21:02:22,747][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][GridCacheDatabaseSharedManager] Found last checkpoint marker [cpId=7a3a402d-875b-4516-a0bf-98c9458769e7, pos=WALPointer [idx=0, fileOff=331340, len=21409]] [21:02:22] : [Step 4/5] [2021-11-19 21:02:22,756][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][GridCacheDatabaseSharedManager] Applying lost metastore updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=331340, len=21409], lastCheckpointId=7a3a402d-875b-4516-a0bf-98c9458769e7] [21:02:22] : [Step 4/5] [2021-11-19 21:02:22,823][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=70 ms] [21:02:22] : [Step 4/5] [2021-11-19 21:02:22,823][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][GridCacheProcessor] Restoring partition state for local groups. [21:02:22] : [Step 4/5] [2021-11-19 21:02:22,823][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=0, partitionsProcessed=0, time=0ms] [21:02:23] : [Step 4/5] [2021-11-19 21:02:23,092][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][GridEncryptionManager] Encryption keys loaded from metastore. [grps=, masterKeyName=null] [21:02:23] : [Step 4/5] [2021-11-19 21:02:23,100][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][GridClusterStateProcessor] Restoring history for BaselineTopology[id=0] [21:02:23] : [Step 4/5] [2021-11-19 21:02:23,111][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][ClusterProcessor] Cluster ID and tag has been read from metastorage: ClusterIdAndTag [id=2818301c-185b-4985-b230-d27f2cec6a5a, tag=amazing_margulis] [21:02:23] : [Step 4/5] [2021-11-19 21:02:23,112][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][IgniteClusterImpl] Shutdown policy was updated [oldVal=null, newVal=null] [21:02:23] : [Step 4/5] [2021-11-19 21:02:23,112][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustEnabled' was changed from 'null' to 'false' [21:02:23] : [Step 4/5] [2021-11-19 21:02:23,113][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustTimeout' was changed from 'null' to '300000' [21:02:23] : [Step 4/5] [2021-11-19 21:02:23,113][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][IgniteTxManager] Transactions parameter 'txOwnerDumpRequestsAllowed' was changed from 'null' to 'true' [21:02:23] : [Step 4/5] [2021-11-19 21:02:23,114][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][IgniteTxManager] Transactions parameter 'longOperationsDumpTimeout' was changed from 'null' to '60000' [21:02:23] : [Step 4/5] [2021-11-19 21:02:23,114][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpThreshold' was changed from 'null' to '0' [21:02:23] : [Step 4/5] [2021-11-19 21:02:23,115][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][IgniteTxManager] Transactions parameter 'transactionTimeDumpSamplesCoefficient' was changed from 'null' to '0.0' [21:02:23] : [Step 4/5] [2021-11-19 21:02:23,115][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpSamplesPerSecondLimit' was changed from 'null' to '5' [21:02:23] : [Step 4/5] [2021-11-19 21:02:23,116][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][IgniteTxManager] Transactions parameter 'collisionsDumpInterval' was changed from 'null' to '1000' [21:02:23] : [Step 4/5] [2021-11-19 21:02:23,116][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][GridCacheDatabaseSharedManager] Historical rebalance WAL threshold changed [property=historical.rebalance.threshold, oldVal=null, newVal=500] [21:02:23] : [Step 4/5] [2021-11-19 21:02:23,117][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][GridCacheDatabaseSharedManager] Checkpoint frequency deviation changed [oldVal=null, newVal=null] [21:02:23] : [Step 4/5] [2021-11-19 21:02:23,118][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][FilePageStoreManager] Cleanup cache stores [total=1, left=0, cleanFiles=false] [21:02:23] : [Step 4/5] [2021-11-19 21:02:23,122][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:02:23] : [Step 4/5] [2021-11-19 21:02:23,123][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:02:23] : [Step 4/5] [2021-11-19 21:02:23,125][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:02:23] : [Step 4/5] [2021-11-19 21:02:23,125][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][GridCacheDatabaseSharedManager] Data Regions Started: 5 [21:02:23] : [Step 4/5] [2021-11-19 21:02:23,126][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][GridCacheDatabaseSharedManager] ^-- sysMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:02:23] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:02:23] : [Step 4/5] ^-- default region [type=default, persistence=true, lazyAlloc=true, [21:02:23] : [Step 4/5] ... initCfg=256MB, maxCfg=256MB, usedRam=0MB, freeRam=100%, allocRam=0MB, allocTotal=0MB] [21:02:23] : [Step 4/5] ^-- metastoreMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:02:23] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:02:23] : [Step 4/5] ^-- TxLog region [type=internal, persistence=true, lazyAlloc=false, [21:02:23] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:02:23] : [Step 4/5] ^-- volatileDsMemPlc region [type=user, persistence=false, lazyAlloc=true, [21:02:23] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB] [21:02:23] : [Step 4/5] ^-- Ignite persistence [used=0MB] [21:02:23] : [Step 4/5] [21:02:23] : [Step 4/5] [2021-11-19 21:02:23,127][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][GridCacheDatabaseSharedManager] Starting binary memory restore for: [94416770, -2100569601] [21:02:23] : [Step 4/5] [2021-11-19 21:02:23,218][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=/opt/buildagent/work/7bc1c54bc719b67c/work/test/marshaller.GridMarshallerMappingConsistencyTest2/db/marshaller_GridMarshallerMappingConsistencyTest2/cp/1637344942129-7a3a402d-875b-4516-a0bf-98c9458769e7-START.bin, endMarker=/opt/buildagent/work/7bc1c54bc719b67c/work/test/marshaller.GridMarshallerMappingConsistencyTest2/db/marshaller_GridMarshallerMappingConsistencyTest2/cp/1637344940913-b42ff3d3-7db3-44d8-858b-f6181f57db14-END.bin] [21:02:23] : [Step 4/5] [2021-11-19 21:02:23,220][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=275426, len=21425], lastMarked=WALPointer [idx=0, fileOff=331340, len=21409], lastCheckpointId=7a3a402d-875b-4516-a0bf-98c9458769e7] [21:02:23]W: [org.apache.ignite:ignite-core] [2021-11-19 21:02:23,283][WARN ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][GridCacheDatabaseSharedManager] Ignite node stopped in the middle of checkpoint. Will restore memory state and finish checkpoint on node start. [21:02:23] : [Step 4/5] [2021-11-19 21:02:23,287][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][PageMemoryImpl] Started page memory [memoryAllocated=256.0 MiB, pages=63504, tableSize=4.9 MiB, replacementSize=7.9 KiB, checkpointBuffer=256.0 MiB] [21:02:23] : [Step 4/5] [2021-11-19 21:02:23,348][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][GridCacheDatabaseSharedManager] Found last checkpoint marker [cpId=7a3a402d-875b-4516-a0bf-98c9458769e7, pos=WALPointer [idx=0, fileOff=331340, len=21409]] [21:02:23] : [Step 4/5] [2021-11-19 21:02:23,353][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][GridCacheDatabaseSharedManager] Finished applying memory changes [changesApplied=27, time=61 ms] [21:02:23] : [Step 4/5] [2021-11-19 21:02:23,366][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][CheckpointWorkflow] Checkpoint finished [cpId=7a3a402d-875b-4516-a0bf-98c9458769e7, pages=16, markPos=WALPointer [idx=0, fileOff=331340, len=21409], pagesWrite=-6ms, fsync=10ms, total=4ms] [21:02:23] : [Step 4/5] [2021-11-19 21:02:23,367][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][GridCacheDatabaseSharedManager] Binary memory state restored at node startup [restoredPtr=WALPointer [idx=0, fileOff=352749, len=0]] [21:02:23] : [Step 4/5] [2021-11-19 21:02:23,370][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/test/marshaller.GridMarshallerMappingConsistencyTest2/db/wal/marshaller_GridMarshallerMappingConsistencyTest2/0000000000000000.wal, offset=352749, ver=2] [21:02:23] : [Step 4/5] [2021-11-19 21:02:23,375][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][GridCacheProcessor] Started cache in recovery mode [name=cache, id=94416770, dataRegionName=default, mode=PARTITIONED, atomicity=ATOMIC, backups=1, mvcc=false] [21:02:23] : [Step 4/5] [2021-11-19 21:02:23,378][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][GridCacheProcessor] Started cache in recovery mode [name=ignite-sys-cache, id=-2100569601, dataRegionName=sysMemPlc, mode=REPLICATED, atomicity=TRANSACTIONAL, backups=2147483647, mvcc=false] [21:02:23] : [Step 4/5] [2021-11-19 21:02:23,380][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][GridCacheDatabaseSharedManager] Binary recovery performed in 253 ms. [21:02:23] : [Step 4/5] [2021-11-19 21:02:23,381][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=/opt/buildagent/work/7bc1c54bc719b67c/work/test/marshaller.GridMarshallerMappingConsistencyTest2/db/marshaller_GridMarshallerMappingConsistencyTest2/cp/1637344942129-7a3a402d-875b-4516-a0bf-98c9458769e7-START.bin, endMarker=/opt/buildagent/work/7bc1c54bc719b67c/work/test/marshaller.GridMarshallerMappingConsistencyTest2/db/marshaller_GridMarshallerMappingConsistencyTest2/cp/1637344942129-7a3a402d-875b-4516-a0bf-98c9458769e7-END.bin] [21:02:23] : [Step 4/5] [2021-11-19 21:02:23,382][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][GridCacheDatabaseSharedManager] Applying lost cache updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=331340, len=21409], lastCheckpointId=7a3a402d-875b-4516-a0bf-98c9458769e7] [21:02:23] : [Step 4/5] [2021-11-19 21:02:23,453][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=70 ms] [21:02:23] : [Step 4/5] [2021-11-19 21:02:23,454][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][GridCacheProcessor] Restoring partition state for local groups. [21:02:23] : [Step 4/5] [2021-11-19 21:02:23,623][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=2, partitionsProcessed=1124, time=172ms] [21:02:24] : [Step 4/5] [2021-11-19 21:02:24,157][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][TestTcpDiscoverySpi] Successfully bound to TCP port [port=47500, localHost=localhost/127.0.0.1, locNodeId=b2d92c77-6daa-40af-9fe0-4d696a800002] [21:02:24] : [Step 4/5] [2021-11-19 21:02:24,177][INFO ][disco-notifier-worker-#2879%marshaller.GridMarshallerMappingConsistencyTest2%][MvccProcessorImpl] Assigned mvcc coordinator [crd=MvccCoordinator [topVer=AffinityTopologyVersion [topVer=1, minorTopVer=0], nodeId=b2d92c77-6daa-40af-9fe0-4d696a800002, ver=1637344944171, local=true, initialized=false]] [21:02:24] : [Step 4/5] [2021-11-19 21:02:24,177][INFO ][sys-#2875%marshaller.GridMarshallerMappingConsistencyTest2%][ClusterProcessor] Writing cluster ID and tag to metastorage on ready for write ClusterIdAndTag [id=2818301c-185b-4985-b230-d27f2cec6a5a, tag=amazing_margulis] [21:02:24] : [Step 4/5] [2021-11-19 21:02:24,197][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][GridMarshallerMappingConsistencyTest2] To start Console Management & Monitoring run ignitevisorcmd.{sh|bat} [21:02:24] : [Step 4/5] [2021-11-19 21:02:24,198][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][GridMarshallerMappingConsistencyTest2] [21:02:24] : [Step 4/5] [21:02:24] : [Step 4/5] >>> +-------------------------------------------+ [21:02:24] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:02:24] : [Step 4/5] >>> +-------------------------------------------+ [21:02:24] : [Step 4/5] >>> OS name: Linux 4.15.0-151-generic amd64 [21:02:24] : [Step 4/5] >>> CPU(s): 24 [21:02:24] : [Step 4/5] >>> Heap: 2.0GB [21:02:24] : [Step 4/5] >>> VM name: 16724@c4dfe9a430b2 [21:02:24] : [Step 4/5] >>> Ignite instance name: marshaller.GridMarshallerMappingConsistencyTest2 [21:02:24] : [Step 4/5] >>> Local node [ID=B2D92C77-6DAA-40AF-9FE0-4D696A800002, order=1, clientMode=false] [21:02:24] : [Step 4/5] >>> Local node addresses: [127.0.0.1] [21:02:24] : [Step 4/5] >>> Local ports: TCP:10800 TCP:45030 TCP:47500 [21:02:24] : [Step 4/5] [21:02:24] : [Step 4/5] [2021-11-19 21:02:24,199][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][GridMarshallerMappingConsistencyTest2] >>> Ignite cluster is in INACTIVE state (limited functionality available). Use control.(sh|bat) script or IgniteCluster.state(ClusterState.ACTIVE) to change the state. [21:02:24] : [Step 4/5] [2021-11-19 21:02:24,200][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][GridDiscoveryManager] Topology snapshot [ver=1, locNode=b2d92c77, servers=1, clients=0, state=INACTIVE, CPUs=24, offheap=0.25GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=b2d92c77-6daa-40af-9fe0-4d696a800002, consistentId=marshaller.GridMarshallerMappingConsistencyTest2, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:02:24] : [Step 4/5] [2021-11-19 21:02:24,201][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][GridDiscoveryManager] ^-- Baseline [id=0, size=2, online=1, offline=1] [21:02:24] : [Step 4/5] [2021-11-19 21:02:24,202][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][GridDiscoveryManager] ^-- 1 nodes left for auto-activation [marshaller.GridMarshallerMappingConsistencyTest1] [21:02:24] : [Step 4/5] [2021-11-19 21:02:24,202][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][G] Node started : [stage="Configure system pool" (0 ms),stage="Start managers" (72 ms),stage="Configure binary metadata" (3 ms),stage="Start processors" (35 ms),stage="Start 'StanByClusterTestProvider' plugin" (0 ms),stage="Start 'PageMemory tracker plugin' plugin" (0 ms),stage="Start 'TestDistibutedConfigurationPlugin' plugin" (0 ms),stage="Start 'NodeValidationPluginProvider' plugin" (0 ms),stage="Init metastore" (507 ms),stage="Init and start regions" (9 ms),stage="Restore binary memory" (253 ms),stage="Restore logical state" (243 ms),stage="Finish recovery" (531 ms),stage="Join topology" (21 ms),stage="Await transition" (2 ms),stage="Await exchange" (22 ms),stage="Total time" (1698 ms)] [21:02:24] : [Step 4/5] [2021-11-19 21:02:24,205][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][root] Node started with the following configuration [id=b2d92c77-6daa-40af-9fe0-4d696a800002, marshaller=BinaryMarshaller [], discovery=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=5000, ackTimeout=5000, marsh=JdkMarshaller [clsFilter=org.apache.ignite.marshaller.MarshallerUtils$1@5c8a871c], reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], binaryCfg=null, lateAff=true] [21:02:24] : [Step 4/5] [2021-11-19 21:02:24,208][INFO ][test-runner-#2350%marshaller.GridMarshallerMappingConsistencyTest%][GridClusterStateProcessor] Sending activate cluster request with BaselineTopology BaselineTopology [id=0, branchingHash=-2138199390, branchingType='Cluster activation', baselineNodes=[marshaller.GridMarshallerMappingConsistencyTest1, marshaller.GridMarshallerMappingConsistencyTest2]] [21:02:24] : [Step 4/5] [2021-11-19 21:02:24,210][INFO ][disco-notifier-worker-#2879%marshaller.GridMarshallerMappingConsistencyTest2%][GridClusterStateProcessor] Received activate cluster request with BaselineTopology[id=0] initiator node ID: b2d92c77-6daa-40af-9fe0-4d696a800002 [21:02:24] : [Step 4/5] [2021-11-19 21:02:24,211][INFO ][disco-notifier-worker-#2879%marshaller.GridMarshallerMappingConsistencyTest2%][GridClusterStateProcessor] Started state transition: activate cluster [21:02:24] : [Step 4/5] [2021-11-19 21:02:24,212][INFO ][exchange-worker-#2884%marshaller.GridMarshallerMappingConsistencyTest2%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=1, minorTopVer=1], crd=true, evt=DISCOVERY_CUSTOM_EVT, evtNode=b2d92c77-6daa-40af-9fe0-4d696a800002, customEvt=ChangeGlobalStateMessage [id=078ac593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqId=be155e8c-4109-4c65-a5e2-090ab80fec9a, initiatingNodeId=b2d92c77-6daa-40af-9fe0-4d696a800002, state=ACTIVE, baselineTopology=BaselineTopology [id=0, branchingHash=-2138199390, branchingType='Cluster activation', baselineNodes=[marshaller.GridMarshallerMappingConsistencyTest1, marshaller.GridMarshallerMappingConsistencyTest2]], forceChangeBaselineTopology=false, timestamp=1637344944208, forceDeactivation=true], allowMerge=false, exchangeFreeSwitch=false] [21:02:24] : [Step 4/5] [2021-11-19 21:02:24,214][INFO ][exchange-worker-#2884%marshaller.GridMarshallerMappingConsistencyTest2%][GridDhtPartitionsExchangeFuture] Start activation process [nodeId=b2d92c77-6daa-40af-9fe0-4d696a800002, client=false, topVer=AffinityTopologyVersion [topVer=1, minorTopVer=1]]. New state: ACTIVE [21:02:24] : [Step 4/5] [2021-11-19 21:02:24,214][INFO ][exchange-worker-#2884%marshaller.GridMarshallerMappingConsistencyTest2%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/test/marshaller.GridMarshallerMappingConsistencyTest2/db/marshaller_GridMarshallerMappingConsistencyTest2 [21:02:24] : [Step 4/5] [2021-11-19 21:02:24,217][INFO ][exchange-worker-#2884%marshaller.GridMarshallerMappingConsistencyTest2%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/test/marshaller.GridMarshallerMappingConsistencyTest2/db/wal/marshaller_GridMarshallerMappingConsistencyTest2/0000000000000000.wal, offset=352778, ver=2] [21:02:24] : [Step 4/5] [2021-11-19 21:02:24,219][INFO ][exchange-worker-#2884%marshaller.GridMarshallerMappingConsistencyTest2%][GridClusterStateProcessor] Writing BaselineTopology[id=0] [21:02:24] : [Step 4/5] [2021-11-19 21:02:24,222][INFO ][exchange-worker-#2884%marshaller.GridMarshallerMappingConsistencyTest2%][GridCacheDatabaseSharedManager] Finish recovery performed in 6 ms. [21:02:24] : [Step 4/5] [2021-11-19 21:02:24,223][INFO ][exchange-worker-#2884%marshaller.GridMarshallerMappingConsistencyTest2%][msg] Components activation performed in 9 ms. [21:02:24] : [Step 4/5] [2021-11-19 21:02:24,225][INFO ][exchange-worker-#2884%marshaller.GridMarshallerMappingConsistencyTest2%][GridCacheProcessor] Finished recovery for cache [cache=cache, grp=cache, startVer=AffinityTopologyVersion [topVer=1, minorTopVer=1]] [21:02:24] : [Step 4/5] [2021-11-19 21:02:24,225][INFO ][sys-#2860%marshaller.GridMarshallerMappingConsistencyTest2%][GridCacheProcessor] Finished recovery for cache [cache=ignite-sys-cache, grp=ignite-sys-cache, startVer=AffinityTopologyVersion [topVer=1, minorTopVer=1]] [21:02:24] : [Step 4/5] [2021-11-19 21:02:24,229][INFO ][exchange-worker-#2884%marshaller.GridMarshallerMappingConsistencyTest2%][GridAffinityAssignmentCache] Local node affinity assignment distribution is not ideal [cache=cache, expectedPrimary=1024.00, actualPrimary=1024, expectedBackups=1024.00, actualBackups=0, warningThreshold=50.00%] [21:02:24] : [Step 4/5] [2021-11-19 21:02:24,231][INFO ][exchange-worker-#2884%marshaller.GridMarshallerMappingConsistencyTest2%][GridDhtPartitionsExchangeFuture] Successfully activated caches [nodeId=b2d92c77-6daa-40af-9fe0-4d696a800002, client=false, topVer=AffinityTopologyVersion [topVer=1, minorTopVer=1], newState=ACTIVE] [21:02:24] : [Step 4/5] [2021-11-19 21:02:24,232][INFO ][exchange-worker-#2884%marshaller.GridMarshallerMappingConsistencyTest2%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=1, minorTopVer=1], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:02:24] : [Step 4/5] [2021-11-19 21:02:24,258][INFO ][exchange-worker-#2884%marshaller.GridMarshallerMappingConsistencyTest2%][GridDhtPartitionsExchangeFuture] finishExchangeOnCoordinator [topVer=AffinityTopologyVersion [topVer=1, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=1, minorTopVer=1]] [21:02:24] : [Step 4/5] [2021-11-19 21:02:24,260][INFO ][db-checkpoint-thread-#2891%marshaller.GridMarshallerMappingConsistencyTest2%][Checkpointer] Checkpoint started [checkpointId=d001292a-173a-41f2-b029-37ec1b347e1b, startPtr=WALPointer [idx=0, fileOff=454081, len=21425], checkpointBeforeLockTime=13ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=2ms, checkpointLockHoldTime=4ms, walCpRecordFsyncDuration=1ms, writeCheckpointEntryDuration=2ms, splitAndSortCpPagesDuration=0ms, pages=18, reason='node started'] [21:02:24] : [Step 4/5] [2021-11-19 21:02:24,287][INFO ][exchange-worker-#2884%marshaller.GridMarshallerMappingConsistencyTest2%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=1, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=1, minorTopVer=1], err=null, rebalanced=true, wasRebalanced=false] [21:02:24] : [Step 4/5] [2021-11-19 21:02:24,287][INFO ][disco-notifier-worker-#2879%marshaller.GridMarshallerMappingConsistencyTest2%][GridClusterStateProcessor] Received state change finish message: ACTIVE [21:02:24] : [Step 4/5] [2021-11-19 21:02:24,288][INFO ][disco-notifier-worker-#2879%marshaller.GridMarshallerMappingConsistencyTest2%][GridClusterStateProcessor] Cluster state was changed from INACTIVE to ACTIVE [21:02:24] : [Step 4/5] [2021-11-19 21:02:24,294][INFO ][exchange-worker-#2884%marshaller.GridMarshallerMappingConsistencyTest2%][GridCacheProcessor] Finish proxy initialization, cacheName=cache, localNodeId=b2d92c77-6daa-40af-9fe0-4d696a800002 [21:02:24] : [Step 4/5] [2021-11-19 21:02:24,294][INFO ][exchange-worker-#2884%marshaller.GridMarshallerMappingConsistencyTest2%][GridCacheProcessor] Finish proxy initialization, cacheName=ignite-sys-cache, localNodeId=b2d92c77-6daa-40af-9fe0-4d696a800002 [21:02:24] : [Step 4/5] [2021-11-19 21:02:24,295][INFO ][sys-#2860%marshaller.GridMarshallerMappingConsistencyTest2%][DistributedBaselineConfiguration] Baseline auto-adjust is 'disabled' with timeout='300000' ms [21:02:24] : [Step 4/5] [2021-11-19 21:02:24,295][INFO ][sys-#2860%marshaller.GridMarshallerMappingConsistencyTest2%][GridClusterStateProcessor] Successfully performed final activation steps [nodeId=b2d92c77-6daa-40af-9fe0-4d696a800002, client=false, topVer=AffinityTopologyVersion [topVer=1, minorTopVer=1]] [21:02:24] : [Step 4/5] [2021-11-19 21:02:24,295][INFO ][exchange-worker-#2884%marshaller.GridMarshallerMappingConsistencyTest2%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=b2d92c77-6daa-40af-9fe0-4d696a800002, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topV[er=1, minorTopVer=21:01], evt=DISCOVERY_CUSTO2:24M_EVT, evtNode=TcpDiscoveryN] >>> ode [iStopping d=b2d92c77-6tesdaa-40af-9fe0-4dt: 696a800002, consistentId=GridMarshallerMmarshaller.GridMarshallerMappingCappingConsistencyTest#testMappingsPersistedOnJoin in 9842 ms <<< [21:02:24] : [Step 4/5] onsistencyTest2, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637344944148, loc=true, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=1, minorTopVer=1]] [21:02:24] : [Step 4/5] [2021-11-19 21:02:24,298][INFO ][main][root] >>> Stopping test: GridMarshallerMappingConsistencyTest#testMappingsPersistedOnJoin in 9842 ms <<< [21:02:24] : [Step 4/5] [2021-11-19 21:02:24,297][INFO ][db-checkpoint-thread-#2891%marsh[21:02:24]all >>> Heaer.GridMarshallerMappingConsistencp:yTest 295 MB use2%][Checkpointer] Checkpd /oin 1944 MB committ finished [cpId=d001292a-173a-41f2-b029-37ec1b347e1b, pages=18, markPos=WALPedointer [idx=0, fil / 194eOff=454081, len=21425], walSegmentsCovered=[], markDuration=8ms, pagesWrite=25ms, fsync=11ms, total=574 MB max <<< [21:02:24] : [Step 4/5] ms] [21:02:24] : [Step 4/5] [2021-11-19 21:02:24,300][INFO ][main][root] >>> Heap: 295 MB used / 1944 MB commited / 1944 MB max <<< [21:02:24] : [Step 4/5] [21:02:24] >>> Non-Heap: 117 MB used / 124 MB commited / 0 MB max <<< [21:02:24] : [Step 4/5] [2021-11-19 21:02:24,298][INFO ][exchange-worker-#2884%marshaller.GridMarshallerMappingConsistencyTest2%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=1, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=1, minorTopVer=1], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (1 ms), stage="Update caches registry" (10 ms), stage="Start caches" (1 ms), stage="Affinity initialization on cache group start" (4 ms), stage="Determine exchange type" (1 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Restore partition states" (0 ms), stage="After states restored callback" (23 ms), stage="WAL history reservation" (0 ms), stage="Waiting for all single messages" (0 ms), stage="Affinity recalculation (crd)" (0 ms), stage="Collect update counters and create affinity messages" (0 ms), stage="Assign partitions states" (7 ms), stage="Validate partitions states" (1 ms), stage="Ideal affinity diff calculation (enforced)" (3 ms), stage="Apply update counters" (1 ms), stage="Full message preparing" (14 ms), stage="Full message sending" (0 ms), stage="State finish message sending" (0 ms), stage="Detect lost partitions" (4 ms), stage="Exchange done" (6 ms), stage="Total time" (76 ms)] [21:02:24] : [Step 4/5] [2021-11-19 21:02:24,300][INFO ][main][root] >>> Non-Heap: 117 MB used / 124 MB commited / 0 MB max <<< [21:02:24] : [Step 4/5] [2021-11-19 21:02:24,302][INFO ][main][root] >>> Stopping grid [name=marshaller.GridMarshallerMappingConsistencyTest2, id=b2d92c77-6daa-40af-9fe0-4d696a800002] [21:02:24] : [Step 4/5] [2021-11-19 21:02:24,302][INFO ][exchange-worker-#2884%marshaller.GridMarshallerMappingConsistencyTest2%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=1, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=1, minorTopVer=1], stage="Affinity initialization on cache group start [grp=cache]" (4 ms) (parent=Affinity initialization on cache group start), stage="Affinity initialization on cache group start [grp=ignite-sys-cache]" (1 ms) (parent=Affinity initialization on cache group start), stage="Affinity centralized initialization (crd) [grp=ignite-sys-cache, crd=true]" (1 ms) (parent=Determine exchange type), stage="Affinity centralized initialization (crd) [grp=cache, crd=true]" (0 ms) (parent=Determine exchange type), stage="Restore partition states [grp=ignite-sys-cache]" (0 ms) (parent=Restore partition states), stage="Restore partition states [grp=cache]" (0 ms) (parent=Restore partition states), stage="Affinity recalculation (partitions availability) [grp=cache]" (3 ms) (parent=Ideal affinity diff calculation (enforced)), stage="Affinity recalculation (partitions availability) [grp=ignite-sys-cache]" (0 ms) (parent=Ideal affinity diff calculation (enforced))] [21:02:24] : [Step 4/5] [2021-11-19 21:02:24,309][INFO ][exchange-worker-#2884%marshaller.GridMarshallerMappingConsistencyTest2%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=1, minorTopVer=1], crd=true] [21:02:24] : [Step 4/5] [2021-11-19 21:02:24,313][INFO ][exchange-worker-#2884%marshaller.GridMarshallerMappingConsistencyTest2%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=1, minorTopVer=1], force=false, evt=DISCOVERY_CUSTOM_EVT, node=b2d92c77-6daa-40af-9fe0-4d696a800002] [21:02:24] : [Step 4/5] [2021-11-19 21:02:24,322][INFO ][db-checkpoint-thread-#2891%marshaller.GridMarshallerMappingConsistencyTest2%][Checkpointer] Skipping checkpoint (no pages were modified) [checkpointBeforeLockTime=3ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=1ms, checkpointLockHoldTime=2ms, reason='timeout'] [21:02:24] : [Step 4/5] [2021-11-19 21:02:24,336][INFO ][main][GridCacheProcessor] Stopped cache [cacheName=cache] [21:02:24] : [Step 4/5] [2021-11-19 21:02:24,336][INFO ][main][GridCacheProcessor] Stopped cache [cacheName=ignite-sys-cache] [21:02:24] : [Step 4/5] [2021-11-19 21:02:24,343][INFO ][main][FilePageStoreManager] Cleanup cache stores [total=4, left=0, cleanFiles=false] [21:02:24] : [Step 4/5] [2021-11-19 21:02:24,357][INFO ][main][GridMarshallerMappingConsistencyTest2] [21:02:24] : [Step 4/5] [21:02:24] : [Step 4/5] >>> +------------------------------------------------------+ [21:02:24] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV stopped OK [21:02:24] : [Step 4/5] >>> +------------------------------------------------------+ [21:02:24] : [Step 4/5] >>> Ignite instance name: marshaller.GridMarshallerMappingConsistencyTest2 [21:02:24] : [Step 4/5] >>> Grid uptime: 00:00:00.167 [21:02:24] : [Step 4/5] [21:02:24] : [Step 4/5] [21:02:24] : [Step 4/5] [21:02:24] >>> Stopping test class: GridMarshallerMappingConsistencyTest <<< [21:02:24] : [Step 4/5] [2021-11-19 21:02:24,635][INFO ][main][root] >>> Stopping test class: GridMarshallerMappingConsistencyTest <<< [21:02:24] : [Step 4/5] [21:02:24] >>> Starting test class: SystemWorkersTerminationTest <<< [21:02:24] : [Step 4/5] [2021-11-19 21:02:24,636][INFO ][main][root] >>> Starting test class: SystemWorkersTerminationTest <<< [21:02:24] : [Step 4/5] Running org.apache.ignite.failure.SystemWorkersTerminationTest [21:02:24]i: [Step 4/5] ##teamcity[importData type='surefire' path='/opt/buildagent/temp/buildTmp/ignite-tools-junit-reports1777670380320881607/test-org.apache.ignite.testsuites.IgniteBasicWithPersistenceTestSuite1637344925046.xml'] [21:02:24] : [Step 4/5] Importing data from '/opt/buildagent/temp/buildTmp/ignite-tools-junit-reports1777670380320881607/test-org.apache.ignite.testsuites.IgniteBasicWithPersistenceTestSuite1637344925046.xml' (423 B) with 'surefire' processor [21:02:24] : [Step 4/5] [21:02:24] >>> Starting test: SystemWorkersTerminationTest#testSyntheticWorkerTermination <<< [21:02:24] : [Step 4/5] [2021-11-19 21:02:24,648][INFO ][main][root] >>> Starting test: SystemWorkersTerminationTest#testSyntheticWorkerTermination <<< [21:02:24] : [Step 4/5] [21:02:24] >>> Heap: 300 MB used / 1944 MB commited / 1944 MB max <<< [21:02:24] : [Step 4/5] [2021-11-19 21:02:24,648][INFO ][main][root] >>> Heap: 300 MB used / 1944 MB commited / 1944 MB max <<< [21:02:24] : [Step 4/5] [21:02:24] >>> Non-Heap: 117 MB used / 124 MB commited / 0 MB max <<< [21:02:24] : [Step 4/5] [2021-11-19 21:02:24,649][INFO ][main][root] >>> Non-Heap: 117 MB used / 124 MB commited / 0 MB max <<< [21:02:24]W: [org.apache.ignite:ignite-core] [2021-11-19 21:02:24,662][WARN ][main][G] Ignite work directory is not provided, automatically resolved to: /opt/buildagent/work/7bc1c54bc719b67c/work [21:02:24]W: [org.apache.ignite:ignite-core] [2021-11-19 21:02:24,662][WARN ][main][G] Consistent ID is not set, it is recommended to set consistent ID for production clusters (use IgniteConfiguration.setConsistentId property) [21:02:24] : [Step 4/5] [2021-11-19 21:02:24,665][INFO ][main][SystemWorkersTerminationTest0] [21:02:24] : [Step 4/5] [21:02:24] : [Step 4/5] >>> __________ ________________ [21:02:24] : [Step 4/5] >>> / _/ ___/ |/ / _/_ __/ __/ [21:02:24] : [Step 4/5] >>> _/ // (7 7 // / / / / _/ [21:02:24] : [Step 4/5] >>> /___/\___/_/|_/___/ /_/ /___/ [21:02:24] : [Step 4/5] >>> [21:02:24] : [Step 4/5] >>> ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:02:24] : [Step 4/5] >>> 2021 Copyright(C) Apache Software Foundation [21:02:24] : [Step 4/5] >>> [21:02:24] : [Step 4/5] >>> Ignite documentation: http://ignite.apache.org [21:02:24] : [Step 4/5] [21:02:24] : [Step 4/5] [2021-11-19 21:02:24,665][INFO ][main][SystemWorkersTerminationTest0] Config URL: n/a [21:02:24] : [Step 4/5] [2021-11-19 21:02:24,666][INFO ][main][SystemWorkersTerminationTest0] IgniteConfiguration [igniteInstanceName=failure.SystemWorkersTerminationTest0, pubPoolSize=24, svcPoolSize=24, callbackPoolSize=24, stripedPoolSize=24, sysPoolSize=24, mgmtPoolSize=4, dataStreamerPoolSize=24, utilityCachePoolSize=24, utilityCacheKeepAliveTime=60000, p2pPoolSize=2, qryPoolSize=24, buildIdxPoolSize=4, igniteHome=/opt/buildagent/work/7bc1c54bc719b67c, igniteWorkDir=/opt/buildagent/work/7bc1c54bc719b67c/work, mbeanSrv=com.sun.jmx.mbeanserver.JmxMBeanServer@6fe85038, nodeId=d0e10f0d-0b09-4b7e-979e-d70f7a500000, marsh=BinaryMarshaller [], marshLocJobs=false, daemon=false, p2pEnabled=true, netTimeout=10000, netCompressionLevel=1, sndRetryDelay=1000, sndRetryCnt=3, metricsHistSize=10000, metricsUpdateFreq=1000, metricsExpTime=9223372036854775807, discoSpi=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=0, ackTimeout=0, marsh=null, reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], segPlc=STOP, segResolveAttempts=2, waitForSegOnStart=true, allResolversPassReq=true, segChkFreq=10000, commSpi=TcpCommunicationSpi [connectGate=org.apache.ignite.spi.communication.tcp.internal.ConnectGateway@1d1cbd0f, ctxInitLatch=java.util.concurrent.CountDownLatch@6fa13e6[Count = 1], stopping=false, clientPool=null, nioSrvWrapper=null, stateProvider=null], evtSpi=MemoryEventStorageSpi [expireAgeMs=9223372036854775807, expireCnt=10000, filter=null], colSpi=NoopCollisionSpi [], deploySpi=LocalDeploymentSpi [], indexingSpi=org.apache.ignite.spi.indexing.noop.NoopIndexingSpi@59bbe88a, addrRslvr=null, encryptionSpi=org.apache.ignite.spi.encryption.noop.NoopEncryptionSpi@5d8ab698, tracingSpi=org.apache.ignite.spi.tracing.NoopTracingSpi@ed91d8d, clientMode=false, rebalanceThreadPoolSize=4, rebalanceTimeout=10000, rebalanceBatchesPrefetchCnt=3, rebalanceThrottle=0, rebalanceBatchSize=524288, txCfg=TransactionConfiguration [txSerEnabled=false, dfltIsolation=REPEATABLE_READ, dfltConcurrency=PESSIMISTIC, dfltTxTimeout=0, txTimeoutOnPartitionMapExchange=0, deadlockTimeout=10000, pessimisticTxLogSize=0, pessimisticTxLogLinger=10000, tmLookupClsName=null, txManagerFactory=null, useJtaSync=false], cacheSanityCheckEnabled=true, discoStartupDelay=60000, deployMode=SHARED, p2pMissedCacheSize=100, locHost=127.0.0.1, timeSrvPortBase=31100, timeSrvPortRange=100, failureDetectionTimeout=10000, sysWorkerBlockedTimeout=null, clientFailureDetectionTimeout=10000, metricsLogFreq=0, connectorCfg=null, odbcCfg=null, warmupClos=null, atomicCfg=AtomicConfiguration [seqReserveSize=1000, cacheMode=PARTITIONED, backups=1, aff=null, grpName=null], classLdr=null, sslCtxFactory=null, platformCfg=null, binaryCfg=null, memCfg=null, pstCfg=null, dsCfg=DataStorageConfiguration [sysRegionInitSize=41943040, sysRegionMaxSize=104857600, pageSize=0, concLvl=0, dfltDataRegConf=DataRegionConfiguration [name=default, maxSize=268435456, initSize=268435456, swapPath=null, pageEvictionMode=DISABLED, pageReplacementMode=CLOCK, evictionThreshold=0.9, emptyPagesPoolSize=100, metricsEnabled=false, metricsSubIntervalCount=5, metricsRateTimeInterval=60000, persistenceEnabled=true, checkpointPageBufSize=0, lazyMemoryAllocation=true, warmUpCfg=null], dataRegions=null, storagePath=null, checkpointFreq=180000, lockWaitTime=10000, checkpointThreads=4, checkpointWriteOrder=SEQUENTIAL, walHistSize=20, maxWalArchiveSize=1073741824, walSegments=10, walSegmentSize=67108864, walPath=db/wal, walArchivePath=db/wal/archive, cdcWalPath=db/wal/cdc, cdcEnabled=false, metricsEnabled=false, walMode=LOG_ONLY, walTlbSize=131072, walBuffSize=0, walFlushFreq=2000, walFsyncDelay=1000, walRecordIterBuffSize=67108864, alwaysWriteFullPages=false, fileIOFactory=org.apache.ignite.internal.processors.cache.persistence.file.AsyncFileIOFactory@4375b013, metricsSubIntervalCnt=5, metricsRateTimeInterval=60000, walAutoArchiveAfterInactivity=-1, walForceArchiveTimeout=-1, writeThrottlingEnabled=false, walCompactionEnabled=true, walCompactionLevel=1, checkpointReadLockTimeout=null, walPageCompression=DISABLED, walPageCompressionLevel=null, dfltWarmUpCfg=null, encCfg=org.apache.ignite.configuration.EncryptionConfiguration@1cf0cacc, defragmentationThreadPoolSize=4, minWalArchiveSize=-1], snapshotPath=snapshots, activeOnStart=true, activeOnStartPropSetFlag=false, autoActivation=true, autoActivationPropSetFlag=false, clusterStateOnStart=null, sqlConnCfg=null, cliConnCfg=ClientConnectorConfiguration [host=null, port=10800, portRange=100, sockSndBufSize=0, sockRcvBufSize=0, tcpNoDelay=true, maxOpenCursorsPerConn=128, threadPoolSize=24, selectorCnt=12, idleTimeout=0, handshakeTimeout=10000, jdbcEnabled=true, odbcEnabled=true, thinCliEnabled=true, sslEnabled=false, useIgniteSslCtxFactory=true, sslClientAuth=false, sslCtxFactory=null, thinCliCfg=ThinClientConfiguration [maxActiveTxPerConn=100, maxActiveComputeTasksPerConn=0]], mvccVacuumThreadCnt=2, mvccVacuumFreq=5000, authEnabled=false, failureHnd=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]], commFailureRslvr=null, sqlCfg=SqlConfiguration [longQryWarnTimeout=3000, dfltQryTimeout=0, sqlQryHistSize=1000, validationEnabled=false], asyncContinuationExecutor=null] [21:02:24] : [Step 4/5] [2021-11-19 21:02:24,675][INFO ][main][SystemWorkersTerminationTest0] Daemon mode: off [21:02:24] : [Step 4/5] [2021-11-19 21:02:24,675][INFO ][main][SystemWorkersTerminationTest0] OS: Linux 4.15.0-151-generic amd64 [21:02:24] : [Step 4/5] [2021-11-19 21:02:24,675][INFO ][main][SystemWorkersTerminationTest0] OS user: teamcity [21:02:24] : [Step 4/5] [2021-11-19 21:02:24,675][INFO ][main][SystemWorkersTerminationTest0] PID: 16724 [21:02:24] : [Step 4/5] [2021-11-19 21:02:24,676][INFO ][main][SystemWorkersTerminationTest0] Language runtime: Java Platform API Specification ver. 1.8 [21:02:24] : [Step 4/5] [2021-11-19 21:02:24,676][INFO ][main][SystemWorkersTerminationTest0] VM information: Java(TM) SE Runtime Environment 1.8.0_261-b12 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 25.261-b12 [21:02:24] : [Step 4/5] [2021-11-19 21:02:24,677][INFO ][main][SystemWorkersTerminationTest0] VM total memory: 1.9GB [21:02:24] : [Step 4/5] [2021-11-19 21:02:24,677][INFO ][main][SystemWorkersTerminationTest0] Remote Management [restart: off, REST: off, JMX (remote: off)] [21:02:24] : [Step 4/5] [2021-11-19 21:02:24,677][INFO ][main][SystemWorkersTerminationTest0] Logger: GridTestLog4jLogger [quiet=false, config=null] [21:02:24] : [Step 4/5] [2021-11-19 21:02:24,677][INFO ][main][SystemWorkersTerminationTest0] IGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c [21:02:24] : [Step 4/5] [2021-11-19 21:02:24,677][INFO ][main][SystemWorkersTerminationTest0] VM arguments: [-DIGNITE_DUMP_THREADS_ON_FAILURE=false, -DMono=/usr/bin/mono-sgen, -DMono4.0_x64=/usr/lib/mono/4.0, -DMono4.5_x64=/usr/lib/mono/4.5, -DMonoVersion=6.12.0.90, -DSKIP_BUILD=false, -Dagent.home.dir=/opt/buildagent, -Dagent.name=aitc-lin02_03, -Dagent.ownPort=9090, -Dagent.work.dir=/opt/buildagent/work, -Dbuild.number=95, -Dbuild.vcs.number=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.1=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.GitHubApacheIgnite=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dclassworlds.conf=/opt/buildagent/temp/buildTmp/teamcity.m2.conf, -Dcom.jetbrains.maven.watcher.report.file=/opt/buildagent/temp/buildTmp/maven-build-info.xml, -Djava.io.tmpdir=/opt/buildagent/temp/buildTmp, -Dmaven.home=/opt/buildagent/tools/maven3_6, -Dmaven.multiModuleProjectDirectory=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.agent.cpuBenchmark=457, -Dteamcity.agent.dotnet.agent_url=http://localhost:9090/RPC2, -Dteamcity.agent.dotnet.build_id=6278078, -Dteamcity.auth.password=*******, -Dteamcity.auth.userId=TeamCityBuildId=6278078, -Dteamcity.build.changedFiles.file=/opt/buildagent/temp/buildTmp/changedFiles6342607772318147725.txt, -Dteamcity.build.checkoutDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.build.id=6278078, -Dteamcity.build.properties.file=/opt/buildagent/temp/buildTmp/teamcity.build5164517880467851002.properties, -Dteamcity.build.tempDir=/opt/buildagent/temp/buildTmp, -Dteamcity.build.workingDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.buildConfName=Basic 3, -Dteamcity.buildType.id=IgniteTests24Java8_Basic3, -Dteamcity.configuration.properties.file=/opt/buildagent/temp/buildTmp/teamcity.config5591980786735343870.properties, -Dteamcity.maven.userSettings.path=/opt/buildagent/temp/buildTmp/maven_settings_585072866407032347.xml, -Dteamcity.maven.watcher.home=/opt/buildagent/plugins/mavenPlugin/maven-watcher-jdk16, -Dteamcity.projectName=Ignite Tests 2.x (JDK 8/11), -Dteamcity.runner.properties.file=/opt/buildagent/temp/buildTmp/teamcity.runner9098465561618137420.properties, -Dteamcity.tests.recentlyFailedTests.file=/opt/buildagent/temp/buildTmp/testsToRunFirst3891775683130404069.txt, -Dteamcity.version=2021.2 (build 99542), -ea, -Xms2g, -Xmx2g, -XX:+HeapDumpOnOutOfMemoryError, -DIGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_TEST_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_UPDATE_NOTIFIER=false, -DIGNITE_NO_DISCO_ORDER=true, -DIGNITE_PERFORMANCE_SUGGESTIONS_DISABLED=true, -Djava.net.preferIPv4Stack=true, -DTEST_SCALE_FACTOR=1.0, -DIGNITE_TEST_PROP_LOG4J_FILE=log4j-tc-test.xml, -DIGNITE_QUIET=false, -DIGNITE_MARSHAL_BUFFERS_RECHECK=1000, -Dmaven.repo.local=/opt/buildagent/.m2/repository] [21:02:24] : [Step 4/5] [2021-11-19 21:02:24,682][INFO ][main][SystemWorkersTerminationTest0] System cache's DataRegion size is configured to 40 MB. Use DataStorageConfiguration.systemRegionInitialSize property to change the setting. [21:02:24] : [Step 4/5] [2021-11-19 21:02:24,682][INFO ][main][SystemWorkersTerminationTest0] Configured caches [in 'sysMemPlc' dataRegion: ['ignite-sys-cache']] [21:02:24]W: [org.apache.ignite:ignite-core] [2021-11-19 21:02:24,683][WARN ][main][SystemWorkersTerminationTest0] Peer class loading is enabled (disable it in production for performance and deployment consistency reasons) [21:02:24] : [Step 4/5] [2021-11-19 21:02:24,683][INFO ][main][SystemWorkersTerminationTest0] 3-rd party licenses can be found at: /opt/buildagent/work/7bc1c54bc719b67c/libs/licenses [21:02:24] : [Step 4/5] [2021-11-19 21:02:24,688][INFO ][main][IgnitePluginProcessor] Configured plugins: [21:02:24] : [Step 4/5] [2021-11-19 21:02:24,688][INFO ][main][IgnitePluginProcessor] ^-- StanByClusterTestProvider 1.0 [21:02:24] : [Step 4/5] [2021-11-19 21:02:24,688][INFO ][main][IgnitePluginProcessor] ^-- null [21:02:24] : [Step 4/5] [2021-11-19 21:02:24,688][INFO ][main][IgnitePluginProcessor] [21:02:24] : [Step 4/5] [2021-11-19 21:02:24,688][INFO ][main][IgnitePluginProcessor] ^-- PageMemory tracker plugin 1.0 [21:02:24] : [Step 4/5] [2021-11-19 21:02:24,689][INFO ][main][IgnitePluginProcessor] ^-- null [21:02:24] : [Step 4/5] [2021-11-19 21:02:24,689][INFO ][main][IgnitePluginProcessor] [21:02:24] : [Step 4/5] [2021-11-19 21:02:24,689][INFO ][main][IgnitePluginProcessor] ^-- TestDistibutedConfigurationPlugin 1.0 [21:02:24] : [Step 4/5] [2021-11-19 21:02:24,689][INFO ][main][IgnitePluginProcessor] ^-- null [21:02:24] : [Step 4/5] [2021-11-19 21:02:24,689][INFO ][main][IgnitePluginProcessor] [21:02:24] : [Step 4/5] [2021-11-19 21:02:24,690][INFO ][main][IgnitePluginProcessor] ^-- NodeValidationPluginProvider 1.0 [21:02:24] : [Step 4/5] [2021-11-19 21:02:24,690][INFO ][main][IgnitePluginProcessor] ^-- null [21:02:24] : [Step 4/5] [2021-11-19 21:02:24,690][INFO ][main][IgnitePluginProcessor] [21:02:24] : [Step 4/5] [2021-11-19 21:02:24,690][INFO ][main][FailureProcessor] Configured failure handler: [hnd=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]] [21:02:24] : [Step 4/5] [2021-11-19 21:02:24,707][INFO ][main][TcpCommunicationSpi] Successfully bound communication NIO server to TCP port [port=45040, locHost=/127.0.0.1, selectorsCnt=12, selectorSpins=0, pairedConn=false] [21:02:24]W: [org.apache.ignite:ignite-core] [2021-11-19 21:02:24,707][WARN ][main][TcpCommunicationSpi] Message queue limit is set to 0 which may lead to potential OOMEs when running cache operations in FULL_ASYNC or PRIMARY_SYNC modes due to message queues growth on sender and receiver sides. [21:02:24] : [Step 4/5] [2021-11-19 21:02:24,714][INFO ][main][GridCollisionManager] Collision resolution is disabled (all jobs will be activated upon arrival). [21:02:24] : [Step 4/5] [2021-11-19 21:02:24,714][INFO ][main][SystemWorkersTerminationTest0] Security status [authentication=off, sandbox=off, tls/ssl=off] [21:02:24] : [Step 4/5] [2021-11-19 21:02:24,716][INFO ][main][TestTcpDiscoverySpi] Successfully bound to TCP port [port=47500, localHost=localhost/127.0.0.1, locNodeId=d0e10f0d-0b09-4b7e-979e-d70f7a500000] [21:02:24] : [Step 4/5] [2021-11-19 21:02:24,727][INFO ][main][PdsFoldersResolver] Successfully created new persistent storage folder [/opt/buildagent/work/7bc1c54bc719b67c/work/db/node00-ca473e74-a390-4532-932c-5a93c28c4c7d] [21:02:24] : [Step 4/5] [2021-11-19 21:02:24,727][INFO ][main][PdsFoldersResolver] Consistent ID used for local node is [ca473e74-a390-4532-932c-5a93c28c4c7d] according to persistence data storage folders [21:02:24] : [Step 4/5] [2021-11-19 21:02:24,727][INFO ][main][MaintenanceProcessor] Resolved store directory for node persistent data: /opt/buildagent/work/7bc1c54bc719b67c/work/db/node00-ca473e74-a390-4532-932c-5a93c28c4c7d [21:02:24] : [Step 4/5] [2021-11-19 21:02:24,729][INFO ][main][CacheObjectBinaryProcessorImpl] Resolved directory for serialized binary metadata: /opt/buildagent/work/7bc1c54bc719b67c/work/db/binary_meta/node00-ca473e74-a390-4532-932c-5a93c28c4c7d [21:02:24] : [Step 4/5] [2021-11-19 21:02:24,734][INFO ][main][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/node00-ca473e74-a390-4532-932c-5a93c28c4c7d [21:02:24] : [Step 4/5] [2021-11-19 21:02:24,734][INFO ][main][FileWriteAheadLogManager] Resolved write ahead log work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/node00-ca473e74-a390-4532-932c-5a93c28c4c7d [21:02:24] : [Step 4/5] [2021-11-19 21:02:24,735][INFO ][main][FileWriteAheadLogManager] Resolved write ahead log archive directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/node00-ca473e74-a390-4532-932c-5a93c28c4c7d [21:02:25] : [Step 4/5] [2021-11-19 21:02:25,087][INFO ][main][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/node00-ca473e74-a390-4532-932c-5a93c28c4c7d/0000000000000000.wal [21:02:25] : [Step 4/5] [2021-11-19 21:02:25,088][INFO ][main][FileHandleManagerImpl] Initialized write-ahead log manager [mode=LOG_ONLY] [21:02:25] : [Step 4/5] [2021-11-19 21:02:25,093][INFO ][main][GridCacheDatabaseSharedManager] Configured data regions initialized successfully [total=5] [21:02:25] : [Step 4/5] [2021-11-19 21:02:25,094][INFO ][main][IgniteSnapshotManager] Resolved snapshot work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/snapshots [21:02:25] : [Step 4/5] [2021-11-19 21:02:25,095][INFO ][main][IgniteSnapshotManager] Resolved temp directory for snapshot creation: /opt/buildagent/work/7bc1c54bc719b67c/work/db/node00-ca473e74-a390-4532-932c-5a93c28c4c7d/snp [21:02:25] : [Step 4/5] [2021-11-19 21:02:25,098][INFO ][main][ClientListenerProcessor] Client connector processor has started on TCP port 10800 [21:02:25] : [Step 4/5] [2021-11-19 21:02:25,101][INFO ][main][SystemWorkersTerminationTest0] Non-loopback local IPs: 172.17.0.4 [21:02:25] : [Step 4/5] [2021-11-19 21:02:25,101][INFO ][main][SystemWorkersTerminationTest0] Enabled local MACs: 0242AC110004 [21:02:25] : [Step 4/5] [2021-11-19 21:02:25,102][INFO ][main][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:02:25] : [Step 4/5] [2021-11-19 21:02:25,103][INFO ][main][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:02:25] : [Step 4/5] [2021-11-19 21:02:25,104][INFO ][main][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:02:25] : [Step 4/5] [2021-11-19 21:02:25,106][INFO ][main][GridCacheDatabaseSharedManager] Applying lost metastore updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:02:25] : [Step 4/5] [2021-11-19 21:02:25,107][INFO ][main][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=0 ms] [21:02:25] : [Step 4/5] [2021-11-19 21:02:25,107][INFO ][main][GridCacheProcessor] Restoring partition state for local groups. [21:02:25] : [Step 4/5] [2021-11-19 21:02:25,107][INFO ][main][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=0, partitionsProcessed=0, time=0ms] [21:02:25] : [Step 4/5] [2021-11-19 21:02:25,108][INFO ][main][GridEncryptionManager] Encryption keys loaded from metastore. [grps=, masterKeyName=null] [21:02:25] : [Step 4/5] [2021-11-19 21:02:25,109][INFO ][main][ClusterProcessor] Cluster ID and tag has been read from metastorage: null [21:02:25] : [Step 4/5] [2021-11-19 21:02:25,109][INFO ][main][IgniteClusterImpl] Shutdown policy was updated [oldVal=null, newVal=null] [21:02:25] : [Step 4/5] [2021-11-19 21:02:25,110][INFO ][main][GridCacheDatabaseSharedManager] Checkpoint frequency deviation changed [oldVal=null, newVal=null] [21:02:25] : [Step 4/5] Surefire report watcher [21:02:25] : [Surefire report watcher] Watching paths: [21:02:25] : [Surefire report watcher] /opt/buildagent/temp/buildTmp/ignite-tools-junit-reports1777670380320881607/test-org.apache.ignite.testsuites.IgniteBasicWithPersistenceTestSuite1637344925046.xml [21:02:25]i: [Step 4/5] org.apache.ignite.testsuites.IgniteBasicWithPersistenceTestSuite [21:02:25]i: [org.apache.ignite.testsuites.IgniteBasicWithPersistenceTestSuite] org.apache.ignite.marshaller.GridMarshallerMappingConsistencyTest.testPersistedMappingsSharedOnJoin [21:02:25]i: [org.apache.ignite.testsuites.IgniteBasicWithPersistenceTestSuite] org.apache.ignite.marshaller.GridMarshallerMappingConsistencyTest.testMappingsPersistedOnJoin [21:02:25] : [Step 4/5] [2021-11-19 21:02:25,119][INFO ][main][FilePageStoreManager] Cleanup cache stores [total=1, left=0, cleanFiles=false] [21:02:25] : [Step 4/5] [2021-11-19 21:02:25,122][INFO ][main][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:02:25] : [Step 4/5] [2021-11-19 21:02:25,123][INFO ][main][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:02:25] : [Step 4/5] [2021-11-19 21:02:25,127][INFO ][main][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:02:25] : [Step 4/5] [2021-11-19 21:02:25,127][INFO ][main][GridCacheDatabaseSharedManager] Data Regions Started: 5 [21:02:25] : [Step 4/5] [2021-11-19 21:02:25,127][INFO ][main][GridCacheDatabaseSharedManager] ^-- sysMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:02:25] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:02:25] : [Step 4/5] ^-- default region [type=default, persistence=true, lazyAlloc=true, [21:02:25] : [Step 4/5] ... initCfg=256MB, maxCfg=256MB, usedRam=0MB, freeRam=100%, allocRam=0MB, allocTotal=0MB] [21:02:25] : [Step 4/5] ^-- metastoreMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:02:25] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:02:25] : [Step 4/5] ^-- TxLog region [type=internal, persistence=true, lazyAlloc=false, [21:02:25] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:02:25] : [Step 4/5] ^-- volatileDsMemPlc region [type=user, persistence=false, lazyAlloc=true, [21:02:25] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB] [21:02:25] : [Step 4/5] ^-- Ignite persistence [used=0MB] [21:02:25] : [Step 4/5] [21:02:25] : [Step 4/5] [2021-11-19 21:02:25,129][INFO ][main][GridCacheDatabaseSharedManager] Starting binary memory restore for: [-2100569601] [21:02:25] : [Step 4/5] [2021-11-19 21:02:25,140][INFO ][main][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:02:25] : [Step 4/5] [2021-11-19 21:02:25,140][INFO ][main][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:02:25] : [Step 4/5] [2021-11-19 21:02:25,142][INFO ][main][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/node00-ca473e74-a390-4532-932c-5a93c28c4c7d/0000000000000000.wal, offset=0, ver=2] [21:02:25] : [Step 4/5] [2021-11-19 21:02:25,145][INFO ][main][GridCacheProcessor] Started cache in recovery mode [name=ignite-sys-cache, id=-2100569601, dataRegionName=sysMemPlc, mode=REPLICATED, atomicity=TRANSACTIONAL, backups=2147483647, mvcc=false] [21:02:25] : [Step 4/5] [2021-11-19 21:02:25,146][INFO ][main][GridCacheDatabaseSharedManager] Binary recovery performed in 17 ms. [21:02:25] : [Step 4/5] [2021-11-19 21:02:25,146][INFO ][main][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:02:25] : [Step 4/5] [2021-11-19 21:02:25,147][INFO ][main][GridCacheDatabaseSharedManager] Applying lost cache updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:02:25] : [Step 4/5] [2021-11-19 21:02:25,199][INFO ][main][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=51 ms] [21:02:25] : [Step 4/5] [2021-11-19 21:02:25,199][INFO ][main][GridCacheProcessor] Restoring partition state for local groups. [21:02:25] : [Step 4/5] [2021-11-19 21:02:25,207][INFO ][main][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=1, partitionsProcessed=100, time=10ms] [21:02:25] : [Step 4/5] [2021-11-19 21:02:25,507][INFO ][disco-notifier-worker-#3011%failure.SystemWorkersTerminationTest0%][MvccProcessorImpl] Assigned mvcc coordinator [crd=MvccCoordinator [topVer=AffinityTopologyVersion [topVer=1, minorTopVer=0], nodeId=d0e10f0d-0b09-4b7e-979e-d70f7a500000, ver=1637344945500, local=true, initialized=false]] [21:02:25] : [Step 4/5] [2021-11-19 21:02:25,509][INFO ][sys-#2995%failure.SystemWorkersTerminationTest0%][ClusterProcessor] Writing cluster ID and tag to metastorage on ready for write ClusterIdAndTag [id=d5028ce7-e69a-4fea-bdbf-4df74963ce57, tag=festive_kare] [21:02:25] : [Step 4/5] [2021-11-19 21:02:25,510][INFO ][disco-notifier-worker-#3011%failure.SystemWorkersTerminationTest0%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustEnabled' was changed from 'null' to 'false' [21:02:25] : [Step 4/5] [2021-11-19 21:02:25,512][INFO ][disco-notifier-worker-#3011%failure.SystemWorkersTerminationTest0%][ClusterProcessor] festive_kare [21:02:25] : [Step 4/5] [2021-11-19 21:02:25,513][INFO ][disco-notifier-worker-#3011%failure.SystemWorkersTerminationTest0%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustTimeout' was changed from 'null' to '300000' [21:02:25] : [Step 4/5] [2021-11-19 21:02:25,513][INFO ][disco-notifier-worker-#3011%failure.SystemWorkersTerminationTest0%][IgniteTxManager] Transactions parameter 'longOperationsDumpTimeout' was changed from 'null' to '60000' [21:02:25] : [Step 4/5] [2021-11-19 21:02:25,514][INFO ][disco-notifier-worker-#3011%failure.SystemWorkersTerminationTest0%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpThreshold' was changed from 'null' to '0' [21:02:25] : [Step 4/5] [2021-11-19 21:02:25,515][INFO ][disco-notifier-worker-#3011%failure.SystemWorkersTerminationTest0%][IgniteTxManager] Transactions parameter 'transactionTimeDumpSamplesCoefficient' was changed from 'null' to '0.0' [21:02:25] : [Step 4/5] [2021-11-19 21:02:25,516][INFO ][disco-notifier-worker-#3011%failure.SystemWorkersTerminationTest0%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpSamplesPerSecondLimit' was changed from 'null' to '5' [21:02:25] : [Step 4/5] [2021-11-19 21:02:25,516][INFO ][disco-notifier-worker-#3011%failure.SystemWorkersTerminationTest0%][IgniteTxManager] Transactions parameter 'collisionsDumpInterval' was changed from 'null' to '1000' [21:02:25] : [Step 4/5] [2021-11-19 21:02:25,517][INFO ][disco-notifier-worker-#3011%failure.SystemWorkersTerminationTest0%][IgniteTxManager] Transactions parameter 'txOwnerDumpRequestsAllowed' was changed from 'null' to 'true' [21:02:25] : [Step 4/5] [2021-11-19 21:02:25,518][INFO ][disco-notifier-worker-#3011%failure.SystemWorkersTerminationTest0%][GridCacheDatabaseSharedManager] Historical rebalance WAL threshold changed [property=historical.rebalance.threshold, oldVal=null, newVal=500] [21:02:25] : [Step 4/5] [2021-11-19 21:02:25,521][INFO ][main][SystemWorkersTerminationTest0] To start Console Management & Monitoring run ignitevisorcmd.{sh|bat} [21:02:25] : [Step 4/5] [2021-11-19 21:02:25,521][INFO ][main][SystemWorkersTerminationTest0] [21:02:25] : [Step 4/5] [21:02:25] : [Step 4/5] >>> +-------------------------------------------+ [21:02:25] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:02:25] : [Step 4/5] >>> +-------------------------------------------+ [21:02:25] : [Step 4/5] >>> OS name: Linux 4.15.0-151-generic amd64 [21:02:25] : [Step 4/5] >>> CPU(s): 24 [21:02:25] : [Step 4/5] >>> Heap: 2.0GB [21:02:25] : [Step 4/5] >>> VM name: 16724@c4dfe9a430b2 [21:02:25] : [Step 4/5] >>> Ignite instance name: failure.SystemWorkersTerminationTest0 [21:02:25] : [Step 4/5] >>> Local node [ID=D0E10F0D-0B09-4B7E-979E-D70F7A500000, order=1, clientMode=false] [21:02:25] : [Step 4/5] >>> Local node addresses: [127.0.0.1] [21:02:25] : [Step 4/5] >>> Local ports: TCP:10800 TCP:45040 TCP:47500 [21:02:25] : [Step 4/5] [21:02:25] : [Step 4/5] [2021-11-19 21:02:25,522][INFO ][main][SystemWorkersTerminationTest0] >>> Ignite cluster is in INACTIVE state (limited functionality available). Use control.(sh|bat) script or IgniteCluster.state(ClusterState.ACTIVE) to change the state. [21:02:25] : [Step 4/5] [2021-11-19 21:02:25,523][INFO ][main][GridDiscoveryManager] Topology snapshot [ver=1, locNode=d0e10f0d, servers=1, clients=0, state=INACTIVE, CPUs=24, offheap=0.25GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=d0e10f0d-0b09-4b7e-979e-d70f7a500000, consistentId=ca473e74-a390-4532-932c-5a93c28c4c7d, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:02:25] : [Step 4/5] [2021-11-19 21:02:25,524][INFO ][main][G] Node started : [stage="Configure system pool" (0 ms),stage="Start managers" (65 ms),stage="Configure binary metadata" (2 ms),stage="Start processors" (368 ms),stage="Start 'StanByClusterTestProvider' plugin" (0 ms),stage="Start 'PageMemory tracker plugin' plugin" (0 ms),stage="Start 'TestDistibutedConfigurationPlugin' plugin" (0 ms),stage="Start 'NodeValidationPluginProvider' plugin" (0 ms),stage="Init metastore" (18 ms),stage="Init and start regions" (9 ms),stage="Restore binary memory" (17 ms),stage="Restore logical state" (61 ms),stage="Finish recovery" (292 ms),stage="Join topology" (6 ms),stage="Await transition" (2 ms),stage="Await exchange" (14 ms),stage="Total time" (854 ms)] [21:02:25] : [Step 4/5] [2021-11-19 21:02:25,525][INFO ][main][root] Node started with the following configuration [id=d0e10f0d-0b09-4b7e-979e-d70f7a500000, marshaller=BinaryMarshaller [], discovery=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=5000, ackTimeout=5000, marsh=JdkMarshaller [clsFilter=org.apache.ignite.marshaller.MarshallerUtils$1@4730e0f0], reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], binaryCfg=null, lateAff=true] [21:02:30]W: [org.apache.ignite:ignite-core] [2021-11-19 21:02:30,527][ERROR][test-worker-#3020%failure.SystemWorkersTerminationTest0%][IgniteTestResources] Critical system error detected. Will be handled accordingly to configured handler [hnd=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]], failureCtx=FailureContext [type=SYSTEM_WORKER_TERMINATION, err=class o.a.i.IgniteException: GridWorker [name=test-worker, igniteInstanceName=failure.SystemWorkersTerminationTest0, finished=true, heartbeatTs=1637344945519]]] [21:02:30]W: [org.apache.ignite:ignite-core] class org.apache.ignite.IgniteException: GridWorker [name=test-worker, igniteInstanceName=failure.SystemWorkersTerminationTest0, finished=true, heartbeatTs=1637344945519] [21:02:30]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.IgnitionEx$IgniteNamedInstance$2.apply(IgnitionEx.java:1768) [21:02:30]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.IgnitionEx$IgniteNamedInstance$2.apply(IgnitionEx.java:1766) [21:02:30]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.worker.WorkersRegistry.onStopped(WorkersRegistry.java:169) [21:02:30]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:160) [21:02:30]W: [org.apache.ignite:ignite-core] at java.lang.Thread.run(Thread.java:748) [21:02:30]W: [org.apache.ignite:ignite-core] [2021-11-19 21:02:30,530][WARN ][test-worker-#3020%failure.SystemWorkersTerminationTest0%][CacheDiagnosticManager] Page locks dump: [21:02:30]W: [org.apache.ignite:ignite-core] [21:02:30]W: [org.apache.ignite:ignite-core] [21:02:30]W: [org.apache.ignite:ignite-core] [21:02:30] : [Step 4/5] [21:02:30] >>> Stopping test: SystemWorkersTerminationTest#testSyntheticWorkerTermination in 5006 ms <<< [21:02:30] : [Step 4/5] [2021-11-19 21:02:30,532][INFO ][main][root] >>> Stopping test: SystemWorkersTerminationTest#testSyntheticWorkerTermination in 5006 ms <<< [21:02:30] : [Step 4/5] [21:02:30] >>> Heap: 326 MB used / 1944 MB commited / 1944 MB max <<< [21:02:30] : [Step 4/5] [2021-11-19 21:02:30,532][INFO ][main][root] >>> Heap: 326 MB used / 1944 MB commited / 1944 MB max <<< [21:02:30] : [Step 4/5] [21:02:30] >>> Non-Heap: 116 MB used / 124 MB commited / 0 MB max <<< [21:02:30] : [Step 4/5] [2021-11-19 21:02:30,533][INFO ][main][root] >>> Non-Heap: 116 MB used / 124 MB commited / 0 MB max <<< [21:02:30] : [Step 4/5] [2021-11-19 21:02:30,533][INFO ][main][root] >>> Stopping grid [name=failure.SystemWorkersTerminationTest0, id=d0e10f0d-0b09-4b7e-979e-d70f7a500000] [21:02:30] : [Step 4/5] [2021-11-19 21:02:30,540][INFO ][main][GridCacheProcessor] Stopped cache [cacheName=ignite-sys-cache] [21:02:30] : [Step 4/5] [2021-11-19 21:02:30,542][INFO ][main][FilePageStoreManager] Cleanup cache stores [total=3, left=0, cleanFiles=false] [21:02:30] : [Step 4/5] [2021-11-19 21:02:30,549][INFO ][main][SystemWorkersTerminationTest0] [21:02:30] : [Step 4/5] [21:02:30] : [Step 4/5] >>> +------------------------------------------------------+ [21:02:30] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV stopped OK [21:02:30] : [Step 4/5] >>> +------------------------------------------------------+ [21:02:30] : [Step 4/5] >>> Ignite instance name: failure.SystemWorkersTerminationTest0 [21:02:30] : [Step 4/5] >>> Grid uptime: 00:00:05.027 [21:02:30] : [Step 4/5] [21:02:30] : [Step 4/5] [21:02:30] : [Step 4/5] [21:02:30] >>> Stopping test class: SystemWorkersTerminationTest <<< [21:02:30] : [Step 4/5] [2021-11-19 21:02:30,585][INFO ][main][root] >>> Stopping test class: SystemWorkersTerminationTest <<< [21:02:30] : [Step 4/5] [21:02:30] >>> Starting test class: FailureHandlingConfigurationTest <<< [21:02:30] : [Step 4/5] [2021-11-19 21:02:30,585][INFO ][main][root] >>> Starting test class: FailureHandlingConfigurationTest <<< [21:02:30] : [Step 4/5] Running org.apache.ignite.failure.FailureHandlingConfigurationTest [21:02:30]i: [Step 4/5] ##teamcity[importData type='surefire' path='/opt/buildagent/temp/buildTmp/ignite-tools-junit-reports1777670380320881607/test-org.apache.ignite.testsuites.IgniteBasicWithPersistenceTestSuite1637344944647.xml'] [21:02:30] : [Step 4/5] Importing data from '/opt/buildagent/temp/buildTmp/ignite-tools-junit-reports1777670380320881607/test-org.apache.ignite.testsuites.IgniteBasicWithPersistenceTestSuite1637344944647.xml' (266 B) with 'surefire' processor [21:02:30] : [Step 4/5] [21:02:30] >>> Starting test: FailureHandlingConfigurationTest#testMBeanParamsChanging <<< [21:02:30] : [Step 4/5] [2021-11-19 21:02:30,596][INFO ][main][root] >>> Starting test: FailureHandlingConfigurationTest#testMBeanParamsChanging <<< [21:02:30] : [Step 4/5] [21:02:30] >>> Heap: 329 MB used / 1944 MB commited / 1944 MB max <<< [21:02:30] : [Step 4/5] [2021-11-19 21:02:30,597][INFO ][main][root] >>> Heap: 329 MB used / 1944 MB commited / 1944 MB max <<< [21:02:30] : [Step 4/5] [21:02:30] >>> Non-Heap: 116 MB used / 124 MB commited / 0 MB max <<< [21:02:30] : [Step 4/5] [2021-11-19 21:02:30,597][INFO ][main][root] >>> Non-Heap: 116 MB used / 124 MB commited / 0 MB max <<< [21:02:30]W: [org.apache.ignite:ignite-core] [2021-11-19 21:02:30,609][WARN ][test-runner-#3021%failure.FailureHandlingConfigurationTest%][G] Ignite work directory is not provided, automatically resolved to: /opt/buildagent/work/7bc1c54bc719b67c/work [21:02:30]W: [org.apache.ignite:ignite-core] [2021-11-19 21:02:30,609][WARN ][test-runner-#3021%failure.FailureHandlingConfigurationTest%][G] Consistent ID is not set, it is recommended to set consistent ID for production clusters (use IgniteConfiguration.setConsistentId property) [21:02:30] : [Step 4/5] [2021-11-19 21:02:30,611][INFO ][test-runner-#3021%failure.FailureHandlingConfigurationTest%][FailureHandlingConfigurationTest0] [21:02:30] : [Step 4/5] [21:02:30] : [Step 4/5] >>> __________ ________________ [21:02:30] : [Step 4/5] >>> / _/ ___/ |/ / _/_ __/ __/ [21:02:30] : [Step 4/5] >>> _/ // (7 7 // / / / / _/ [21:02:30] : [Step 4/5] >>> /___/\___/_/|_/___/ /_/ /___/ [21:02:30] : [Step 4/5] >>> [21:02:30] : [Step 4/5] >>> ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:02:30] : [Step 4/5] >>> 2021 Copyright(C) Apache Software Foundation [21:02:30] : [Step 4/5] >>> [21:02:30] : [Step 4/5] >>> Ignite documentation: http://ignite.apache.org [21:02:30] : [Step 4/5] [21:02:30] : [Step 4/5] [2021-11-19 21:02:30,612][INFO ][test-runner-#3021%failure.FailureHandlingConfigurationTest%][FailureHandlingConfigurationTest0] Config URL: n/a [21:02:30] : [Step 4/5] [2021-11-19 21:02:30,613][INFO ][test-runner-#3021%failure.FailureHandlingConfigurationTest%][FailureHandlingConfigurationTest0] IgniteConfiguration [igniteInstanceName=failure.FailureHandlingConfigurationTest0, pubPoolSize=24, svcPoolSize=24, callbackPoolSize=24, stripedPoolSize=24, sysPoolSize=24, mgmtPoolSize=4, dataStreamerPoolSize=24, utilityCachePoolSize=24, utilityCacheKeepAliveTime=60000, p2pPoolSize=2, qryPoolSize=24, buildIdxPoolSize=4, igniteHome=/opt/buildagent/work/7bc1c54bc719b67c, igniteWorkDir=/opt/buildagent/work/7bc1c54bc719b67c/work, mbeanSrv=com.sun.jmx.mbeanserver.JmxMBeanServer@6fe85038, nodeId=25845e5c-4177-4220-9ebe-c43e5fd00000, marsh=BinaryMarshaller [], marshLocJobs=false, daemon=false, p2pEnabled=true, netTimeout=10000, netCompressionLevel=1, sndRetryDelay=1000, sndRetryCnt=3, metricsHistSize=10000, metricsUpdateFreq=1000, metricsExpTime=9223372036854775807, discoSpi=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=0, ackTimeout=0, marsh=null, reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], segPlc=STOP, segResolveAttempts=2, waitForSegOnStart=true, allResolversPassReq=true, segChkFreq=10000, commSpi=TcpCommunicationSpi [connectGate=org.apache.ignite.spi.communication.tcp.internal.ConnectGateway@13dec46b, ctxInitLatch=java.util.concurrent.CountDownLatch@61357a21[Count = 1], stopping=false, clientPool=null, nioSrvWrapper=null, stateProvider=null], evtSpi=MemoryEventStorageSpi [expireAgeMs=9223372036854775807, expireCnt=10000, filter=null], colSpi=NoopCollisionSpi [], deploySpi=LocalDeploymentSpi [], indexingSpi=org.apache.ignite.spi.indexing.noop.NoopIndexingSpi@44c2172d, addrRslvr=null, encryptionSpi=org.apache.ignite.spi.encryption.noop.NoopEncryptionSpi@1eda0160, tracingSpi=org.apache.ignite.spi.tracing.NoopTracingSpi@5283bbbd, clientMode=false, rebalanceThreadPoolSize=4, rebalanceTimeout=10000, rebalanceBatchesPrefetchCnt=3, rebalanceThrottle=0, rebalanceBatchSize=524288, txCfg=TransactionConfiguration [txSerEnabled=false, dfltIsolation=REPEATABLE_READ, dfltConcurrency=PESSIMISTIC, dfltTxTimeout=0, txTimeoutOnPartitionMapExchange=0, deadlockTimeout=10000, pessimisticTxLogSize=0, pessimisticTxLogLinger=10000, tmLookupClsName=null, txManagerFactory=null, useJtaSync=false], cacheSanityCheckEnabled=true, discoStartupDelay=60000, deployMode=SHARED, p2pMissedCacheSize=100, locHost=127.0.0.1, timeSrvPortBase=31100, timeSrvPortRange=100, failureDetectionTimeout=10000, sysWorkerBlockedTimeout=null, clientFailureDetectionTimeout=10000, metricsLogFreq=0, connectorCfg=null, odbcCfg=null, warmupClos=null, atomicCfg=AtomicConfiguration [seqReserveSize=1000, cacheMode=PARTITIONED, backups=1, aff=null, grpName=null], classLdr=null, sslCtxFactory=null, platformCfg=null, binaryCfg=null, memCfg=null, pstCfg=null, dsCfg=DataStorageConfiguration [sysRegionInitSize=41943040, sysRegionMaxSize=104857600, pageSize=0, concLvl=0, dfltDataRegConf=DataRegionConfiguration [name=default, maxSize=268435456, initSize=268435456, swapPath=null, pageEvictionMode=DISABLED, pageReplacementMode=CLOCK, evictionThreshold=0.9, emptyPagesPoolSize=100, metricsEnabled=false, metricsSubIntervalCount=5, metricsRateTimeInterval=60000, persistenceEnabled=true, checkpointPageBufSize=0, lazyMemoryAllocation=true, warmUpCfg=null], dataRegions=null, storagePath=null, checkpointFreq=180000, lockWaitTime=10000, checkpointThreads=4, checkpointWriteOrder=SEQUENTIAL, walHistSize=20, maxWalArchiveSize=1073741824, walSegments=10, walSegmentSize=67108864, walPath=db/wal, walArchivePath=db/wal/archive, cdcWalPath=db/wal/cdc, cdcEnabled=false, metricsEnabled=false, walMode=LOG_ONLY, walTlbSize=131072, walBuffSize=0, walFlushFreq=2000, walFsyncDelay=1000, walRecordIterBuffSize=67108864, alwaysWriteFullPages=false, fileIOFactory=org.apache.ignite.internal.processors.cache.persistence.file.AsyncFileIOFactory@635d6797, metricsSubIntervalCnt=5, metricsRateTimeInterval=60000, walAutoArchiveAfterInactivity=-1, walForceArchiveTimeout=-1, writeThrottlingEnabled=false, walCompactionEnabled=false, walCompactionLevel=1, checkpointReadLockTimeout=null, walPageCompression=DISABLED, walPageCompressionLevel=null, dfltWarmUpCfg=null, encCfg=org.apache.ignite.configuration.EncryptionConfiguration@6a33773, defragmentationThreadPoolSize=4, minWalArchiveSize=-1], snapshotPath=snapshots, activeOnStart=true, activeOnStartPropSetFlag=false, autoActivation=true, autoActivationPropSetFlag=false, clusterStateOnStart=null, sqlConnCfg=null, cliConnCfg=ClientConnectorConfiguration [host=null, port=10800, portRange=100, sockSndBufSize=0, sockRcvBufSize=0, tcpNoDelay=true, maxOpenCursorsPerConn=128, threadPoolSize=24, selectorCnt=12, idleTimeout=0, handshakeTimeout=10000, jdbcEnabled=true, odbcEnabled=true, thinCliEnabled=true, sslEnabled=false, useIgniteSslCtxFactory=true, sslClientAuth=false, sslCtxFactory=null, thinCliCfg=ThinClientConfiguration [maxActiveTxPerConn=100, maxActiveComputeTasksPerConn=0]], mvccVacuumThreadCnt=2, mvccVacuumFreq=5000, authEnabled=false, failureHnd=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]], commFailureRslvr=null, sqlCfg=SqlConfiguration [longQryWarnTimeout=3000, dfltQryTimeout=0, sqlQryHistSize=1000, validationEnabled=false], asyncContinuationExecutor=null] [21:02:30] : [Step 4/5] [2021-11-19 21:02:30,623][INFO ][test-runner-#3021%failure.FailureHandlingConfigurationTest%][FailureHandlingConfigurationTest0] Daemon mode: off [21:02:30] : [Step 4/5] [2021-11-19 21:02:30,624][INFO ][test-runner-#3021%failure.FailureHandlingConfigurationTest%][FailureHandlingConfigurationTest0] OS: Linux 4.15.0-151-generic amd64 [21:02:30] : [Step 4/5] [2021-11-19 21:02:30,624][INFO ][test-runner-#3021%failure.FailureHandlingConfigurationTest%][FailureHandlingConfigurationTest0] OS user: teamcity [21:02:30] : [Step 4/5] [2021-11-19 21:02:30,625][INFO ][test-runner-#3021%failure.FailureHandlingConfigurationTest%][FailureHandlingConfigurationTest0] PID: 16724 [21:02:30] : [Step 4/5] Surefire report watcher [21:02:30] : [Surefire report watcher] Watching paths: [21:02:30] : [Surefire report watcher] /opt/buildagent/temp/buildTmp/ignite-tools-junit-reports1777670380320881607/test-org.apache.ignite.testsuites.IgniteBasicWithPersistenceTestSuite1637344944647.xml [21:02:30] : [Step 4/5] [2021-11-19 21:02:30,625][INFO ][test-runner-#3021%failure.FailureHandlingConfigurationTest%][FailureHandlingConfigurationTest0] Language runtime: Java Platform API Specification ver. 1.8 [21:02:30]i: [Step 4/5] org.apache.ignite.testsuites.IgniteBasicWithPersistenceTestSuite [21:02:30] : [Step 4/5] [2021-11-19 21:02:30,625][INFO ][test-runner-#3021%failure.FailureHandlingConfigurationTest%][FailureHandlingConfigurationTest0] VM information: Java(TM) SE Runtime Environment 1.8.0_261-b12 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 25.261-b12 [21:02:30]i: [org.apache.ignite.testsuites.IgniteBasicWithPersistenceTestSuite] org.apache.ignite.failure.SystemWorkersTerminationTest.testSyntheticWorkerTermination [21:02:30] : [Step 4/5] [2021-11-19 21:02:30,626][INFO ][test-runner-#3021%failure.FailureHandlingConfigurationTest%][FailureHandlingConfigurationTest0] VM total memory: 1.9GB [21:02:30] : [Step 4/5] [2021-11-19 21:02:30,626][INFO ][test-runner-#3021%failure.FailureHandlingConfigurationTest%][FailureHandlingConfigurationTest0] Remote Management [restart: off, REST: off, JMX (remote: off)] [21:02:30] : [Step 4/5] [2021-11-19 21:02:30,627][INFO ][test-runner-#3021%failure.FailureHandlingConfigurationTest%][FailureHandlingConfigurationTest0] Logger: GridTestLog4jLogger [quiet=false, config=null] [21:02:30] : [Step 4/5] [2021-11-19 21:02:30,627][INFO ][test-runner-#3021%failure.FailureHandlingConfigurationTest%][FailureHandlingConfigurationTest0] IGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c [21:02:30] : [Step 4/5] [2021-11-19 21:02:30,627][INFO ][test-runner-#3021%failure.FailureHandlingConfigurationTest%][FailureHandlingConfigurationTest0] VM arguments: [-DIGNITE_DUMP_THREADS_ON_FAILURE=false, -DMono=/usr/bin/mono-sgen, -DMono4.0_x64=/usr/lib/mono/4.0, -DMono4.5_x64=/usr/lib/mono/4.5, -DMonoVersion=6.12.0.90, -DSKIP_BUILD=false, -Dagent.home.dir=/opt/buildagent, -Dagent.name=aitc-lin02_03, -Dagent.ownPort=9090, -Dagent.work.dir=/opt/buildagent/work, -Dbuild.number=95, -Dbuild.vcs.number=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.1=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.GitHubApacheIgnite=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dclassworlds.conf=/opt/buildagent/temp/buildTmp/teamcity.m2.conf, -Dcom.jetbrains.maven.watcher.report.file=/opt/buildagent/temp/buildTmp/maven-build-info.xml, -Djava.io.tmpdir=/opt/buildagent/temp/buildTmp, -Dmaven.home=/opt/buildagent/tools/maven3_6, -Dmaven.multiModuleProjectDirectory=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.agent.cpuBenchmark=457, -Dteamcity.agent.dotnet.agent_url=http://localhost:9090/RPC2, -Dteamcity.agent.dotnet.build_id=6278078, -Dteamcity.auth.password=*******, -Dteamcity.auth.userId=TeamCityBuildId=6278078, -Dteamcity.build.changedFiles.file=/opt/buildagent/temp/buildTmp/changedFiles6342607772318147725.txt, -Dteamcity.build.checkoutDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.build.id=6278078, -Dteamcity.build.properties.file=/opt/buildagent/temp/buildTmp/teamcity.build5164517880467851002.properties, -Dteamcity.build.tempDir=/opt/buildagent/temp/buildTmp, -Dteamcity.build.workingDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.buildConfName=Basic 3, -Dteamcity.buildType.id=IgniteTests24Java8_Basic3, -Dteamcity.configuration.properties.file=/opt/buildagent/temp/buildTmp/teamcity.config5591980786735343870.properties, -Dteamcity.maven.userSettings.path=/opt/buildagent/temp/buildTmp/maven_settings_585072866407032347.xml, -Dteamcity.maven.watcher.home=/opt/buildagent/plugins/mavenPlugin/maven-watcher-jdk16, -Dteamcity.projectName=Ignite Tests 2.x (JDK 8/11), -Dteamcity.runner.properties.file=/opt/buildagent/temp/buildTmp/teamcity.runner9098465561618137420.properties, -Dteamcity.tests.recentlyFailedTests.file=/opt/buildagent/temp/buildTmp/testsToRunFirst3891775683130404069.txt, -Dteamcity.version=2021.2 (build 99542), -ea, -Xms2g, -Xmx2g, -XX:+HeapDumpOnOutOfMemoryError, -DIGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_TEST_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_UPDATE_NOTIFIER=false, -DIGNITE_NO_DISCO_ORDER=true, -DIGNITE_PERFORMANCE_SUGGESTIONS_DISABLED=true, -Djava.net.preferIPv4Stack=true, -DTEST_SCALE_FACTOR=1.0, -DIGNITE_TEST_PROP_LOG4J_FILE=log4j-tc-test.xml, -DIGNITE_QUIET=false, -DIGNITE_MARSHAL_BUFFERS_RECHECK=1000, -Dmaven.repo.local=/opt/buildagent/.m2/repository] [21:02:30] : [Step 4/5] [2021-11-19 21:02:30,633][INFO ][test-runner-#3021%failure.FailureHandlingConfigurationTest%][FailureHandlingConfigurationTest0] System cache's DataRegion size is configured to 40 MB. Use DataStorageConfiguration.systemRegionInitialSize property to change the setting. [21:02:30] : [Step 4/5] [2021-11-19 21:02:30,634][INFO ][test-runner-#3021%failure.FailureHandlingConfigurationTest%][FailureHandlingConfigurationTest0] Configured caches [in 'sysMemPlc' dataRegion: ['ignite-sys-cache']] [21:02:30]W: [org.apache.ignite:ignite-core] [2021-11-19 21:02:30,634][WARN ][test-runner-#3021%failure.FailureHandlingConfigurationTest%][FailureHandlingConfigurationTest0] Peer class loading is enabled (disable it in production for performance and deployment consistency reasons) [21:02:30] : [Step 4/5] [2021-11-19 21:02:30,634][INFO ][test-runner-#3021%failure.FailureHandlingConfigurationTest%][FailureHandlingConfigurationTest0] 3-rd party licenses can be found at: /opt/buildagent/work/7bc1c54bc719b67c/libs/licenses [21:02:30] : [Step 4/5] [2021-11-19 21:02:30,640][INFO ][test-runner-#3021%failure.FailureHandlingConfigurationTest%][IgnitePluginProcessor] Configured plugins: [21:02:30] : [Step 4/5] [2021-11-19 21:02:30,640][INFO ][test-runner-#3021%failure.FailureHandlingConfigurationTest%][IgnitePluginProcessor] ^-- StanByClusterTestProvider 1.0 [21:02:30] : [Step 4/5] [2021-11-19 21:02:30,640][INFO ][test-runner-#3021%failure.FailureHandlingConfigurationTest%][IgnitePluginProcessor] ^-- null [21:02:30] : [Step 4/5] [2021-11-19 21:02:30,641][INFO ][test-runner-#3021%failure.FailureHandlingConfigurationTest%][IgnitePluginProcessor] [21:02:30] : [Step 4/5] [2021-11-19 21:02:30,641][INFO ][test-runner-#3021%failure.FailureHandlingConfigurationTest%][IgnitePluginProcessor] ^-- PageMemory tracker plugin 1.0 [21:02:30] : [Step 4/5] [2021-11-19 21:02:30,641][INFO ][test-runner-#3021%failure.FailureHandlingConfigurationTest%][IgnitePluginProcessor] ^-- null [21:02:30] : [Step 4/5] [2021-11-19 21:02:30,641][INFO ][test-runner-#3021%failure.FailureHandlingConfigurationTest%][IgnitePluginProcessor] [21:02:30] : [Step 4/5] [2021-11-19 21:02:30,642][INFO ][test-runner-#3021%failure.FailureHandlingConfigurationTest%][IgnitePluginProcessor] ^-- TestDistibutedConfigurationPlugin 1.0 [21:02:30] : [Step 4/5] [2021-11-19 21:02:30,642][INFO ][test-runner-#3021%failure.FailureHandlingConfigurationTest%][IgnitePluginProcessor] ^-- null [21:02:30] : [Step 4/5] [2021-11-19 21:02:30,642][INFO ][test-runner-#3021%failure.FailureHandlingConfigurationTest%][IgnitePluginProcessor] [21:02:30] : [Step 4/5] [2021-11-19 21:02:30,642][INFO ][test-runner-#3021%failure.FailureHandlingConfigurationTest%][IgnitePluginProcessor] ^-- NodeValidationPluginProvider 1.0 [21:02:30] : [Step 4/5] [2021-11-19 21:02:30,643][INFO ][test-runner-#3021%failure.FailureHandlingConfigurationTest%][IgnitePluginProcessor] ^-- null [21:02:30] : [Step 4/5] [2021-11-19 21:02:30,643][INFO ][test-runner-#3021%failure.FailureHandlingConfigurationTest%][IgnitePluginProcessor] [21:02:30] : [Step 4/5] [2021-11-19 21:02:30,643][INFO ][test-runner-#3021%failure.FailureHandlingConfigurationTest%][FailureProcessor] Configured failure handler: [hnd=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]] [21:02:30] : [Step 4/5] [2021-11-19 21:02:30,699][INFO ][test-runner-#3021%failure.FailureHandlingConfigurationTest%][TcpCommunicationSpi] Successfully bound communication NIO server to TCP port [port=45050, locHost=/127.0.0.1, selectorsCnt=12, selectorSpins=0, pairedConn=false] [21:02:30]W: [org.apache.ignite:ignite-core] [2021-11-19 21:02:30,699][WARN ][test-runner-#3021%failure.FailureHandlingConfigurationTest%][TcpCommunicationSpi] Message queue limit is set to 0 which may lead to potential OOMEs when running cache operations in FULL_ASYNC or PRIMARY_SYNC modes due to message queues growth on sender and receiver sides. [21:02:30] : [Step 4/5] [2021-11-19 21:02:30,710][INFO ][test-runner-#3021%failure.FailureHandlingConfigurationTest%][GridCollisionManager] Collision resolution is disabled (all jobs will be activated upon arrival). [21:02:30] : [Step 4/5] [2021-11-19 21:02:30,710][INFO ][test-runner-#3021%failure.FailureHandlingConfigurationTest%][FailureHandlingConfigurationTest0] Security status [authentication=off, sandbox=off, tls/ssl=off] [21:02:30] : [Step 4/5] [2021-11-19 21:02:30,711][INFO ][test-runner-#3021%failure.FailureHandlingConfigurationTest%][TestTcpDiscoverySpi] Successfully bound to TCP port [port=47500, localHost=localhost/127.0.0.1, locNodeId=25845e5c-4177-4220-9ebe-c43e5fd00000] [21:02:30] : [Step 4/5] [2021-11-19 21:02:30,721][INFO ][test-runner-#3021%failure.FailureHandlingConfigurationTest%][PdsFoldersResolver] Successfully created new persistent storage folder [/opt/buildagent/work/7bc1c54bc719b67c/work/db/node00-8cb1a4f7-ed1e-4a0d-aa37-52741de6abce] [21:02:30] : [Step 4/5] [2021-11-19 21:02:30,722][INFO ][test-runner-#3021%failure.FailureHandlingConfigurationTest%][PdsFoldersResolver] Consistent ID used for local node is [8cb1a4f7-ed1e-4a0d-aa37-52741de6abce] according to persistence data storage folders [21:02:30] : [Step 4/5] [2021-11-19 21:02:30,723][INFO ][test-runner-#3021%failure.FailureHandlingConfigurationTest%][MaintenanceProcessor] Resolved store directory for node persistent data: /opt/buildagent/work/7bc1c54bc719b67c/work/db/node00-8cb1a4f7-ed1e-4a0d-aa37-52741de6abce [21:02:30] : [Step 4/5] [2021-11-19 21:02:30,725][INFO ][test-runner-#3021%failure.FailureHandlingConfigurationTest%][CacheObjectBinaryProcessorImpl] Resolved directory for serialized binary metadata: /opt/buildagent/work/7bc1c54bc719b67c/work/db/binary_meta/node00-8cb1a4f7-ed1e-4a0d-aa37-52741de6abce [21:02:30] : [Step 4/5] [2021-11-19 21:02:30,730][INFO ][test-runner-#3021%failure.FailureHandlingConfigurationTest%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/node00-8cb1a4f7-ed1e-4a0d-aa37-52741de6abce [21:02:30] : [Step 4/5] [2021-11-19 21:02:30,731][INFO ][test-runner-#3021%failure.FailureHandlingConfigurationTest%][FileWriteAheadLogManager] Resolved write ahead log work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/node00-8cb1a4f7-ed1e-4a0d-aa37-52741de6abce [21:02:30] : [Step 4/5] [2021-11-19 21:02:30,731][INFO ][test-runner-#3021%failure.FailureHandlingConfigurationTest%][FileWriteAheadLogManager] Resolved write ahead log archive directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/node00-8cb1a4f7-ed1e-4a0d-aa37-52741de6abce [21:02:31] : [Step 4/5] [2021-11-19 21:02:31,275][INFO ][test-runner-#3021%failure.FailureHandlingConfigurationTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/node00-8cb1a4f7-ed1e-4a0d-aa37-52741de6abce/0000000000000000.wal [21:02:31] : [Step 4/5] [2021-11-19 21:02:31,275][INFO ][test-runner-#3021%failure.FailureHandlingConfigurationTest%][FileHandleManagerImpl] Initialized write-ahead log manager [mode=LOG_ONLY] [21:02:31] : [Step 4/5] [2021-11-19 21:02:31,282][INFO ][test-runner-#3021%failure.FailureHandlingConfigurationTest%][GridCacheDatabaseSharedManager] Configured data regions initialized successfully [total=5] [21:02:31] : [Step 4/5] [2021-11-19 21:02:31,283][INFO ][test-runner-#3021%failure.FailureHandlingConfigurationTest%][IgniteSnapshotManager] Resolved snapshot work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/snapshots [21:02:31] : [Step 4/5] [2021-11-19 21:02:31,283][INFO ][test-runner-#3021%failure.FailureHandlingConfigurationTest%][IgniteSnapshotManager] Resolved temp directory for snapshot creation: /opt/buildagent/work/7bc1c54bc719b67c/work/db/node00-8cb1a4f7-ed1e-4a0d-aa37-52741de6abce/snp [21:02:31] : [Step 4/5] [2021-11-19 21:02:31,286][INFO ][test-runner-#3021%failure.FailureHandlingConfigurationTest%][ClientListenerProcessor] Client connector processor has started on TCP port 10800 [21:02:31] : [Step 4/5] [2021-11-19 21:02:31,289][INFO ][test-runner-#3021%failure.FailureHandlingConfigurationTest%][FailureHandlingConfigurationTest0] Non-loopback local IPs: 172.17.0.4 [21:02:31] : [Step 4/5] [2021-11-19 21:02:31,290][INFO ][test-runner-#3021%failure.FailureHandlingConfigurationTest%][FailureHandlingConfigurationTest0] Enabled local MACs: 0242AC110004 [21:02:31] : [Step 4/5] [2021-11-19 21:02:31,290][INFO ][test-runner-#3021%failure.FailureHandlingConfigurationTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:02:31] : [Step 4/5] [2021-11-19 21:02:31,292][INFO ][test-runner-#3021%failure.FailureHandlingConfigurationTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:02:31] : [Step 4/5] [2021-11-19 21:02:31,292][INFO ][test-runner-#3021%failure.FailureHandlingConfigurationTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:02:31] : [Step 4/5] [2021-11-19 21:02:31,296][INFO ][test-runner-#3021%failure.FailureHandlingConfigurationTest%][GridCacheDatabaseSharedManager] Applying lost metastore updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:02:31] : [Step 4/5] [2021-11-19 21:02:31,300][INFO ][test-runner-#3021%failure.FailureHandlingConfigurationTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=0 ms] [21:02:31] : [Step 4/5] [2021-11-19 21:02:31,300][INFO ][test-runner-#3021%failure.FailureHandlingConfigurationTest%][GridCacheProcessor] Restoring partition state for local groups. [21:02:31] : [Step 4/5] [2021-11-19 21:02:31,301][INFO ][test-runner-#3021%failure.FailureHandlingConfigurationTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=0, partitionsProcessed=0, time=0ms] [21:02:31] : [Step 4/5] [2021-11-19 21:02:31,301][INFO ][test-runner-#3021%failure.FailureHandlingConfigurationTest%][GridEncryptionManager] Encryption keys loaded from metastore. [grps=, masterKeyName=null] [21:02:31] : [Step 4/5] [2021-11-19 21:02:31,303][INFO ][test-runner-#3021%failure.FailureHandlingConfigurationTest%][ClusterProcessor] Cluster ID and tag has been read from metastorage: null [21:02:31] : [Step 4/5] [2021-11-19 21:02:31,303][INFO ][test-runner-#3021%failure.FailureHandlingConfigurationTest%][IgniteClusterImpl] Shutdown policy was updated [oldVal=null, newVal=null] [21:02:31] : [Step 4/5] [2021-11-19 21:02:31,304][INFO ][test-runner-#3021%failure.FailureHandlingConfigurationTest%][GridCacheDatabaseSharedManager] Checkpoint frequency deviation changed [oldVal=null, newVal=null] [21:02:31] : [Step 4/5] [2021-11-19 21:02:31,314][INFO ][test-runner-#3021%failure.FailureHandlingConfigurationTest%][FilePageStoreManager] Cleanup cache stores [total=1, left=0, cleanFiles=false] [21:02:31] : [Step 4/5] [2021-11-19 21:02:31,318][INFO ][test-runner-#3021%failure.FailureHandlingConfigurationTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:02:31] : [Step 4/5] [2021-11-19 21:02:31,319][INFO ][test-runner-#3021%failure.FailureHandlingConfigurationTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:02:31] : [Step 4/5] [2021-11-19 21:02:31,320][INFO ][test-runner-#3021%failure.FailureHandlingConfigurationTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:02:31] : [Step 4/5] [2021-11-19 21:02:31,321][INFO ][test-runner-#3021%failure.FailureHandlingConfigurationTest%][GridCacheDatabaseSharedManager] Data Regions Started: 5 [21:02:31] : [Step 4/5] [2021-11-19 21:02:31,321][INFO ][test-runner-#3021%failure.FailureHandlingConfigurationTest%][GridCacheDatabaseSharedManager] ^-- sysMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:02:31] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:02:31] : [Step 4/5] ^-- default region [type=default, persistence=true, lazyAlloc=true, [21:02:31] : [Step 4/5] ... initCfg=256MB, maxCfg=256MB, usedRam=0MB, freeRam=100%, allocRam=0MB, allocTotal=0MB] [21:02:31] : [Step 4/5] ^-- metastoreMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:02:31] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:02:31] : [Step 4/5] ^-- TxLog region [type=internal, persistence=true, lazyAlloc=false, [21:02:31] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:02:31] : [Step 4/5] ^-- volatileDsMemPlc region [type=user, persistence=false, lazyAlloc=true, [21:02:31] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB] [21:02:31] : [Step 4/5] ^-- Ignite persistence [used=0MB] [21:02:31] : [Step 4/5] [21:02:31] : [Step 4/5] [2021-11-19 21:02:31,323][INFO ][test-runner-#3021%failure.FailureHandlingConfigurationTest%][GridCacheDatabaseSharedManager] Starting binary memory restore for: [-2100569601] [21:02:31] : [Step 4/5] [2021-11-19 21:02:31,331][INFO ][test-runner-#3021%failure.FailureHandlingConfigurationTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:02:31] : [Step 4/5] [2021-11-19 21:02:31,332][INFO ][test-runner-#3021%failure.FailureHandlingConfigurationTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:02:31] : [Step 4/5] [2021-11-19 21:02:31,336][INFO ][test-runner-#3021%failure.FailureHandlingConfigurationTest%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/node00-8cb1a4f7-ed1e-4a0d-aa37-52741de6abce/0000000000000000.wal, offset=0, ver=2] [21:02:31] : [Step 4/5] [2021-11-19 21:02:31,343][INFO ][test-runner-#3021%failure.FailureHandlingConfigurationTest%][GridCacheProcessor] Started cache in recovery mode [name=ignite-sys-cache, id=-2100569601, dataRegionName=sysMemPlc, mode=REPLICATED, atomicity=TRANSACTIONAL, backups=2147483647, mvcc=false] [21:02:31] : [Step 4/5] [2021-11-19 21:02:31,345][INFO ][test-runner-#3021%failure.FailureHandlingConfigurationTest%][GridCacheDatabaseSharedManager] Binary recovery performed in 22 ms. [21:02:31] : [Step 4/5] [2021-11-19 21:02:31,345][INFO ][test-runner-#3021%failure.FailureHandlingConfigurationTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:02:31] : [Step 4/5] [2021-11-19 21:02:31,345][INFO ][test-runner-#3021%failure.FailureHandlingConfigurationTest%][GridCacheDatabaseSharedManager] Applying lost cache updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:02:31] : [Step 4/5] [2021-11-19 21:02:31,428][INFO ][test-runner-#3021%failure.FailureHandlingConfigurationTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=83 ms] [21:02:31] : [Step 4/5] [2021-11-19 21:02:31,428][INFO ][test-runner-#3021%failure.FailureHandlingConfigurationTest%][GridCacheProcessor] Restoring partition state for local groups. [21:02:31] : [Step 4/5] [2021-11-19 21:02:31,479][INFO ][test-runner-#3021%failure.FailureHandlingConfigurationTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=1, partitionsProcessed=100, time=52ms] [21:02:31] : [Step 4/5] [2021-11-19 21:02:31,886][INFO ][disco-notifier-worker-#3133%failure.FailureHandlingConfigurationTest0%][MvccProcessorImpl] Assigned mvcc coordinator [crd=MvccCoordinator [topVer=AffinityTopologyVersion [topVer=1, minorTopVer=0], nodeId=25845e5c-4177-4220-9ebe-c43e5fd00000, ver=1637344951886, local=true, initialized=false]] [21:02:31] : [Step 4/5] [2021-11-19 21:02:31,887][INFO ][sys-#3132%failure.FailureHandlingConfigurationTest0%][ClusterProcessor] Writing cluster ID and tag to metastorage on ready for write ClusterIdAndTag [id=5e351fd1-db29-4618-84b2-f1ca0eb0a5d3, tag=laughing_albattani] [21:02:31] : [Step 4/5] [2021-11-19 21:02:31,889][INFO ][disco-notifier-worker-#3133%failure.FailureHandlingConfigurationTest0%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustEnabled' was changed from 'null' to 'false' [21:02:31] : [Step 4/5] [2021-11-19 21:02:31,890][INFO ][disco-notifier-worker-#3133%failure.FailureHandlingConfigurationTest0%][ClusterProcessor] laughing_albattani [21:02:31] : [Step 4/5] [2021-11-19 21:02:31,890][INFO ][disco-notifier-worker-#3133%failure.FailureHandlingConfigurationTest0%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustTimeout' was changed from 'null' to '300000' [21:02:31] : [Step 4/5] [2021-11-19 21:02:31,891][INFO ][disco-notifier-worker-#3133%failure.FailureHandlingConfigurationTest0%][IgniteTxManager] Transactions parameter 'longOperationsDumpTimeout' was changed from 'null' to '60000' [21:02:31] : [Step 4/5] [2021-11-19 21:02:31,891][INFO ][disco-notifier-worker-#3133%failure.FailureHandlingConfigurationTest0%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpThreshold' was changed from 'null' to '0' [21:02:31] : [Step 4/5] [2021-11-19 21:02:31,892][INFO ][disco-notifier-worker-#3133%failure.FailureHandlingConfigurationTest0%][IgniteTxManager] Transactions parameter 'transactionTimeDumpSamplesCoefficient' was changed from 'null' to '0.0' [21:02:31] : [Step 4/5] [2021-11-19 21:02:31,893][INFO ][disco-notifier-worker-#3133%failure.FailureHandlingConfigurationTest0%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpSamplesPerSecondLimit' was changed from 'null' to '5' [21:02:31] : [Step 4/5] [2021-11-19 21:02:31,893][INFO ][disco-notifier-worker-#3133%failure.FailureHandlingConfigurationTest0%][IgniteTxManager] Transactions parameter 'collisionsDumpInterval' was changed from 'null' to '1000' [21:02:31] : [Step 4/5] [2021-11-19 21:02:31,894][INFO ][disco-notifier-worker-#3133%failure.FailureHandlingConfigurationTest0%][IgniteTxManager] Transactions parameter 'txOwnerDumpRequestsAllowed' was changed from 'null' to 'true' [21:02:31] : [Step 4/5] [2021-11-19 21:02:31,895][INFO ][disco-notifier-worker-#3133%failure.FailureHandlingConfigurationTest0%][GridCacheDatabaseSharedManager] Historical rebalance WAL threshold changed [property=historical.rebalance.threshold, oldVal=null, newVal=500] [21:02:31] : [Step 4/5] [2021-11-19 21:02:31,903][INFO ][test-runner-#3021%failure.FailureHandlingConfigurationTest%][FailureHandlingConfigurationTest0] To start Console Management & Monitoring run ignitevisorcmd.{sh|bat} [21:02:31] : [Step 4/5] [2021-11-19 21:02:31,904][INFO ][test-runner-#3021%failure.FailureHandlingConfigurationTest%][FailureHandlingConfigurationTest0] [21:02:31] : [Step 4/5] [21:02:31] : [Step 4/5] >>> +-------------------------------------------+ [21:02:31] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:02:31] : [Step 4/5] >>> +-------------------------------------------+ [21:02:31] : [Step 4/5] >>> OS name: Linux 4.15.0-151-generic amd64 [21:02:31] : [Step 4/5] >>> CPU(s): 24 [21:02:31] : [Step 4/5] >>> Heap: 2.0GB [21:02:31] : [Step 4/5] >>> VM name: 16724@c4dfe9a430b2 [21:02:31] : [Step 4/5] >>> Ignite instance name: failure.FailureHandlingConfigurationTest0 [21:02:31] : [Step 4/5] >>> Local node [ID=25845E5C-4177-4220-9EBE-C43E5FD00000, order=1, clientMode=false] [21:02:31] : [Step 4/5] >>> Local node addresses: [127.0.0.1] [21:02:31] : [Step 4/5] >>> Local ports: TCP:10800 TCP:45050 TCP:47500 [21:02:31] : [Step 4/5] [21:02:31] : [Step 4/5] [2021-11-19 21:02:31,905][INFO ][test-runner-#3021%failure.FailureHandlingConfigurationTest%][FailureHandlingConfigurationTest0] >>> Ignite cluster is in INACTIVE state (limited functionality available). Use control.(sh|bat) script or IgniteCluster.state(ClusterState.ACTIVE) to change the state. [21:02:31] : [Step 4/5] [2021-11-19 21:02:31,906][INFO ][test-runner-#3021%failure.FailureHandlingConfigurationTest%][GridDiscoveryManager] Topology snapshot [ver=1, locNode=25845e5c, servers=1, clients=0, state=INACTIVE, CPUs=24, offheap=0.25GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=25845e5c-4177-4220-9ebe-c43e5fd00000, consistentId=8cb1a4f7-ed1e-4a0d-aa37-52741de6abce, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:02:31] : [Step 4/5] [2021-11-19 21:02:31,906][INFO ][test-runner-#3021%failure.FailureHandlingConfigurationTest%][G] Node started : [stage="Configure system pool" (0 ms),stage="Start managers" (113 ms),stage="Configure binary metadata" (3 ms),stage="Start processors" (561 ms),stage="Start 'StanByClusterTestProvider' plugin" (0 ms),stage="Start 'PageMemory tracker plugin' plugin" (0 ms),stage="Start 'TestDistibutedConfigurationPlugin' plugin" (0 ms),stage="Start 'NodeValidationPluginProvider' plugin" (0 ms),stage="Init metastore" (26 ms),stage="Init and start regions" (8 ms),stage="Restore binary memory" (21 ms),stage="Restore logical state" (134 ms),stage="Finish recovery" (402 ms),stage="Join topology" (3 ms),stage="Await transition" (1 ms),stage="Await exchange" (17 ms),stage="Total time" (1289 ms)] [21:02:31] : [Step 4/5] [2021-11-19 21:02:31,907][INFO ][test-runner-#3021%failure.FailureHandlingConfigurationTest%][root] Node started with the following configuration [id=25845e5c-4177-4220-9ebe-c43e5fd00000, marshaller=BinaryMarshaller [], discovery=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=5000, ackTimeout=5000, marsh=JdkMarshaller [clsFilter=org.apache.ignite.marshaller.MarshallerUtils$1@553f92c9], reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], binaryCfg=null, lateAff=true] [21:02:31] : [Step 4/5] [2021-11-19 21:02:31,909][INFO ][test-runner-#3021%failure.FailureHandlingConfigurationTest%][GridClusterStateProcessor] Sending activate cluster request with BaselineTopology BaselineTopology [id=0, branchingHash=-696379584, branchingType='New BaselineTopology', baselineNodes=[8cb1a4f7-ed1e-4a0d-aa37-52741de6abce]] [21:02:31] : [Step 4/5] [2021-11-19 21:02:31,910][INFO ][disco-notifier-worker-#3133%failure.FailureHandlingConfigurationTest0%][GridClusterStateProcessor] Received activate cluster request with BaselineTopology[id=0] initiator node ID: 25845e5c-4177-4220-9ebe-c43e5fd00000 [21:02:31] : [Step 4/5] [2021-11-19 21:02:31,910][INFO ][disco-notifier-worker-#3133%failure.FailureHandlingConfigurationTest0%][GridClusterStateProcessor] Started state transition: activate cluster [21:02:31] : [Step 4/5] [2021-11-19 21:02:31,911][INFO ][exchange-worker-#3138%failure.FailureHandlingConfigurationTest0%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=1, minorTopVer=1], crd=true, evt=DISCOVERY_CUSTOM_EVT, evtNode=25845e5c-4177-4220-9ebe-c43e5fd00000, customEvt=ChangeGlobalStateMessage [id=d39ac593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqId=0d69c53f-1399-4394-a94f-da2eb199fb12, initiatingNodeId=25845e5c-4177-4220-9ebe-c43e5fd00000, state=ACTIVE, baselineTopology=BaselineTopology [id=0, branchingHash=-696379584, branchingType='New BaselineTopology', baselineNodes=[8cb1a4f7-ed1e-4a0d-aa37-52741de6abce]], forceChangeBaselineTopology=false, timestamp=1637344951909, forceDeactivation=true], allowMerge=false, exchangeFreeSwitch=false] [21:02:31] : [Step 4/5] [2021-11-19 21:02:31,912][INFO ][exchange-worker-#3138%failure.FailureHandlingConfigurationTest0%][GridDhtPartitionsExchangeFuture] Start activation process [nodeId=25845e5c-4177-4220-9ebe-c43e5fd00000, client=false, topVer=AffinityTopologyVersion [topVer=1, minorTopVer=1]]. New state: ACTIVE [21:02:31] : [Step 4/5] [2021-11-19 21:02:31,913][INFO ][exchange-worker-#3138%failure.FailureHandlingConfigurationTest0%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/node00-8cb1a4f7-ed1e-4a0d-aa37-52741de6abce [21:02:31] : [Step 4/5] [2021-11-19 21:02:31,915][INFO ][exchange-worker-#3138%failure.FailureHandlingConfigurationTest0%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/node00-8cb1a4f7-ed1e-4a0d-aa37-52741de6abce/0000000000000000.wal, offset=8795, ver=2] [21:02:31] : [Step 4/5] [2021-11-19 21:02:31,916][INFO ][exchange-worker-#3138%failure.FailureHandlingConfigurationTest0%][GridClusterStateProcessor] Writing BaselineTopology[id=0] [21:02:31] : [Step 4/5] [2021-11-19 21:02:31,917][INFO ][exchange-worker-#3138%failure.FailureHandlingConfigurationTest0%][GridCacheDatabaseSharedManager] Finish recovery performed in 4 ms. [21:02:31] : [Step 4/5] [2021-11-19 21:02:31,918][INFO ][exchange-worker-#3138%failure.FailureHandlingConfigurationTest0%][msg] Components activation performed in 5 ms. [21:02:31] : [Step 4/5] [2021-11-19 21:02:31,918][INFO ][exchange-worker-#3138%failure.FailureHandlingConfigurationTest0%][GridCacheProcessor] Finished recovery for cache [cache=ignite-sys-cache, grp=ignite-sys-cache, startVer=AffinityTopologyVersion [topVer=1, minorTopVer=1]] [21:02:31] : [Step 4/5] [2021-11-19 21:02:31,919][INFO ][exchange-worker-#3138%failure.FailureHandlingConfigurationTest0%][GridDhtPartitionsExchangeFuture] Successfully activated caches [nodeId=25845e5c-4177-4220-9ebe-c43e5fd00000, client=false, topVer=AffinityTopologyVersion [topVer=1, minorTopVer=1], newState=ACTIVE] [21:02:31] : [Step 4/5] [2021-11-19 21:02:31,920][INFO ][exchange-worker-#3138%failure.FailureHandlingConfigurationTest0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=1, minorTopVer=1], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:02:31] : [Step 4/5] [2021-11-19 21:02:31,929][INFO ][exchange-worker-#3138%failure.FailureHandlingConfigurationTest0%][GridDhtPartitionsExchangeFuture] finishExchangeOnCoordinator [topVer=AffinityTopologyVersion [topVer=1, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=1, minorTopVer=1]] [21:02:31] : [Step 4/5] [2021-11-19 21:02:31,931][INFO ][db-checkpoint-thread-#3145%failure.FailureHandlingConfigurationTest0%][Checkpointer] Checkpoint started [checkpointId=b16173c4-e574-4ab0-b107-3ab0d16ae774, startPtr=WALPointer [idx=0, fileOff=66411, len=1963], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=1ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=1ms, pages=16, reason='node started'] [21:02:31] : [Step 4/5] [2021-11-19 21:02:31,934][INFO ][exchange-worker-#3138%failure.FailureHandlingConfigurationTest0%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=1, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=1, minorTopVer=1], err=null, rebalanced=true, wasRebalanced=false] [21:02:31] : [Step 4/5] [2021-11-19 21:02:31,934][INFO ][disco-notifier-worker-#3133%failure.FailureHandlingConfigurationTest0%][GridClusterStateProcessor] Received state change finish message: ACTIVE [21:02:31] : [Step 4/5] [2021-11-19 21:02:31,936][INFO ][disco-notifier-worker-#3133%failure.FailureHandlingConfigurationTest0%][GridClusterStateProcessor] Cluster state was changed from INACTIVE to ACTIVE [21:02:31] : [Step 4/5] [2021-11-19 21:02:31,937][INFO ][exchange-worker-#3138%failure.FailureHandlingConfigurationTest0%][GridCacheProcessor] Finish proxy initialization, cacheName=ignite-sys-cache, localNodeId=25845e5c-4177-4220-9ebe-c43e5fd00000 [21:02:31] : [Step 4/5] [2021-11-19 21:02:31,937][INFO ][sys-#3124%failure.FailureHandlingConfigurationTest0%][DistributedBaselineConfiguration] Baseline auto-adjust is 'disabled' with timeout='300000' ms [21:02:31] : [Step 4/5] [2021-11-19 21:02:31,937][INFO ][exchange-worker-#3138%failure.FailureHandlingConfigurationTest0%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=25845e5c-4177-4220-9ebe-c43e5fd00000, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=1, minorTopVer=1], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=25845e5c-4177-4220-9ebe-c43e5fd00000, consistentId=8cb1a4f7-ed1e-4a0d-aa37-52741de6abce, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637344951875, loc=true, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=1, minorTopVer=1]] [21:02:31] : [Step 4/5] [2021-11-19 21:02:31,938][INFO ][sys-#3124%failure.FailureHandlingConfigurationTest0%][GridClusterStateProcessor] Successfully performed final activation steps [nodeId=25845e5c-4177-4220-9ebe-c43e5fd00000, client=false, topVer=AffinityTopologyVersion [topVer=1, minorTopVer=1]] [21:02:31] : [Step 4/5] [2021-11-19 21:02:31,939][INFO ][exchange-worker-#3138%failure.FailureHandlingConfigurationTest0%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=1, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=1, minorTopVer=1], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (1 ms), sta[21:02:31] >>> Stopping test: FailureHandlingConfigurationTest#testMBeanParamsChanging in 1342 ms <<< [21:02:31] : [Step 4/5] ge="Update caches registry" (5 ms), stage="Start caches" (0 ms), stage="Affinity initialization on cache group start" (0 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Restore partition states" (0 ms), stage="After states restored callback" (7 ms), stage="WAL history reservation" (0 ms), stage="Waiting for all single messages" (0 ms), stage="Affinity recalculation (crd)" (0 ms), stage="Collect update counters and create affinity messages" (0 ms), stage="Assign partitions states" (0 ms), stage="Validate partitions states" (0 ms), stage="Ideal affinity diff calculation (enforced)" (0 ms), stage="Apply update counters" (0 ms), stage="Full message preparing" (3 ms), stage="Full message sending" (0 ms), stage="State finish message sending" (0 ms), stage="Detect lost partitions" (1 ms), stage="Exchange done" (2 ms), stage="Total time" (19 ms)] [21:02:31] : [Step 4/5] [2021-11-19 21:02:31,941][INFO ][main][root] >>> Stopping test: FailureHandlingConfigurationTest#testMBeanParamsChanging in 1342 ms <<< [21:02:31] : [Step 4/5] [21:02:31] >>> Heap: 357 MB used / 1944 MB commited / 19[2021-11-144 M9 21:0B max <<2:< [21:02:31] : [Step 4/5] 31,942][INFO ][exchange-worker-#3138%failure.FailureHandlingConfigurationTest0%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=1, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=1, minorTopVer=1], stage="Affinity initialization on cache group start [grp=ignite-sys-cache]" (0 ms) (parent=Affinity initialization on cache group start), stage="Affinity centralized initialization (crd) [grp=ignite-sys-cache, crd=true]" (0 ms) (parent=Determine exchange type), stage="Restore partition states [grp=ignite-sys-cache]" (0 ms) (parent=Restore partition states), stage="Affinity recalculation (partitions availability) [grp=ignite-sys-cache]" (0 ms) (parent=Ideal affinity diff calculation (enforced))] [21:02:31] : [Step 4/5] [2021-11-19 21:02:31,943][INFO ][main][root] >>> Heap: 357 MB used / 1944 MB commited / 1944 MB max <<< [21:02:31] : [Step 4/5] [20[21:02:21-11-19 2311:0] >>> Non-Heap: 116 MB used / 125 MB commited / 0 MB max <<< [21:02:31] : [Step 4/5] 2:31,944][INFO ][exchange-worker-#3138%failure.FailureHandlingConfigurationTest0%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=1, minorTopVer=1], crd=true] [21:02:31] : [Step 4/5] [2021-11-19 21:02:31,945][INFO ][main][root] >>> Non-Heap: 116 MB used / 125 MB commited / 0 MB max <<< [21:02:31] : [Step 4/5] [2021-11-19 21:02:31,945][INFO ][main][root] >>> Stopping grid [name=failure.FailureHandlingConfigurationTest0, id=25845e5c-4177-4220-9ebe-c43e5fd00000] [21:02:31] : [Step 4/5] [2021-11-19 21:02:31,945][INFO ][exchange-worker-#3138%failure.FailureHandlingConfigurationTest0%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=1, minorTopVer=1], force=false, evt=DISCOVERY_CUSTOM_EVT, node=25845e5c-4177-4220-9ebe-c43e5fd00000] [21:02:31] : [Step 4/5] [2021-11-19 21:02:31,956][INFO ][db-checkpoint-thread-#3145%failure.FailureHandlingConfigurationTest0%][Checkpointer] Checkpoint finished [cpId=b16173c4-e574-4ab0-b107-3ab0d16ae774, pages=16, markPos=WALPointer [idx=0, fileOff=66411, len=1963], walSegmentsCovered=[], markDuration=4ms, pagesWrite=3ms, fsync=21ms, total=29ms] [21:02:31] : [Step 4/5] [2021-11-19 21:02:31,961][INFO ][main][GridCacheProcessor] Stopped cache [cacheName=ignite-sys-cache] [21:02:32] : [Step 4/5] [2021-11-19 21:02:32,501][INFO ][main][FilePageStoreManager] Cleanup cache stores [total=3, left=0, cleanFiles=false] [21:02:32] : [Step 4/5] [2021-11-19 21:02:32,508][INFO ][main][FailureHandlingConfigurationTest0] [21:02:32] : [Step 4/5] [21:02:32] : [Step 4/5] >>> +------------------------------------------------------+ [21:02:32] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV stopped OK [21:02:32] : [Step 4/5] >>> +------------------------------------------------------+ [21:02:32] : [Step 4/5] >>> Ignite instance name: failure.FailureHandlingConfigurationTest0 [21:02:32] : [Step 4/5] >>> Grid uptime: 00:00:00.606 [21:02:32] : [Step 4/5] [21:02:32] : [Step 4/5] [21:02:32] : [Step 4/5] [21:02:32] >>> Starting test: FailureHandlingConfigurationTest#testPartialCfgParamsPropagation <<< [21:02:32] : [Step 4/5] [2021-11-19 21:02:32,551][INFO ][main][root] >>> Starting test: FailureHandlingConfigurationTest#testPartialCfgParamsPropagation <<< [21:02:32] : [Step 4/5] [21:02:32] >>> Heap: 358 MB used / 1944 MB commited / 1944 MB max <<< [21:02:32] : [Step 4/5] [2021-11-19 21:02:32,552][INFO ][main][root] >>> Heap: 358 MB used / 1944 MB commited / 1944 MB max <<< [21:02:32] : [Step 4/5] [21:02:32] >>> Non-Heap: 116 MB used / 125 MB commited / 0 MB max <<< [21:02:32] : [Step 4/5] [2021-11-19 21:02:32,552][INFO ][main][root] >>> Non-Heap: 116 MB used / 125 MB commited / 0 MB max <<< [21:02:32]W: [org.apache.ignite:ignite-core] [2021-11-19 21:02:32,560][WARN ][test-runner-#3154%failure.FailureHandlingConfigurationTest%][G] Ignite work directory is not provided, automatically resolved to: /opt/buildagent/work/7bc1c54bc719b67c/work [21:02:32]W: [org.apache.ignite:ignite-core] [2021-11-19 21:02:32,561][WARN ][test-runner-#3154%failure.FailureHandlingConfigurationTest%][G] Consistent ID is not set, it is recommended to set consistent ID for production clusters (use IgniteConfiguration.setConsistentId property) [21:02:32] : [Step 4/5] [2021-11-19 21:02:32,563][INFO ][test-runner-#3154%failure.FailureHandlingConfigurationTest%][FailureHandlingConfigurationTest0] [21:02:32] : [Step 4/5] [21:02:32] : [Step 4/5] >>> __________ ________________ [21:02:32] : [Step 4/5] >>> / _/ ___/ |/ / _/_ __/ __/ [21:02:32] : [Step 4/5] >>> _/ // (7 7 // / / / / _/ [21:02:32] : [Step 4/5] >>> /___/\___/_/|_/___/ /_/ /___/ [21:02:32] : [Step 4/5] >>> [21:02:32] : [Step 4/5] >>> ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:02:32] : [Step 4/5] >>> 2021 Copyright(C) Apache Software Foundation [21:02:32] : [Step 4/5] >>> [21:02:32] : [Step 4/5] >>> Ignite documentation: http://ignite.apache.org [21:02:32] : [Step 4/5] [21:02:32] : [Step 4/5] [2021-11-19 21:02:32,565][INFO ][test-runner-#3154%failure.FailureHandlingConfigurationTest%][FailureHandlingConfigurationTest0] Config URL: n/a [21:02:32] : [Step 4/5] [2021-11-19 21:02:32,566][INFO ][test-runner-#3154%failure.FailureHandlingConfigurationTest%][FailureHandlingConfigurationTest0] IgniteConfiguration [igniteInstanceName=failure.FailureHandlingConfigurationTest0, pubPoolSize=24, svcPoolSize=24, callbackPoolSize=24, stripedPoolSize=24, sysPoolSize=24, mgmtPoolSize=4, dataStreamerPoolSize=24, utilityCachePoolSize=24, utilityCacheKeepAliveTime=60000, p2pPoolSize=2, qryPoolSize=24, buildIdxPoolSize=4, igniteHome=/opt/buildagent/work/7bc1c54bc719b67c, igniteWorkDir=/opt/buildagent/work/7bc1c54bc719b67c/work, mbeanSrv=com.sun.jmx.mbeanserver.JmxMBeanServer@6fe85038, nodeId=2743de01-19ee-4d86-9a34-689d86200000, marsh=BinaryMarshaller [], marshLocJobs=false, daemon=false, p2pEnabled=true, netTimeout=10000, netCompressionLevel=1, sndRetryDelay=1000, sndRetryCnt=3, metricsHistSize=10000, metricsUpdateFreq=1000, metricsExpTime=9223372036854775807, discoSpi=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=0, ackTimeout=0, marsh=null, reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], segPlc=STOP, segResolveAttempts=2, waitForSegOnStart=true, allResolversPassReq=true, segChkFreq=10000, commSpi=TcpCommunicationSpi [connectGate=org.apache.ignite.spi.communication.tcp.internal.ConnectGateway@d3caa10, ctxInitLatch=java.util.concurrent.CountDownLatch@1436ecc3[Count = 1], stopping=false, clientPool=null, nioSrvWrapper=null, stateProvider=null], evtSpi=MemoryEventStorageSpi [expireAgeMs=9223372036854775807, expireCnt=10000, filter=null], colSpi=NoopCollisionSpi [], deploySpi=LocalDeploymentSpi [], indexingSpi=org.apache.ignite.spi.indexing.noop.NoopIndexingSpi@fb92687, addrRslvr=null, encryptionSpi=org.apache.ignite.spi.encryption.noop.NoopEncryptionSpi@75509b36, tracingSpi=org.apache.ignite.spi.tracing.NoopTracingSpi@47608e8f, clientMode=false, rebalanceThreadPoolSize=4, rebalanceTimeout=10000, rebalanceBatchesPrefetchCnt=3, rebalanceThrottle=0, rebalanceBatchSize=524288, txCfg=TransactionConfiguration [txSerEnabled=false, dfltIsolation=REPEATABLE_READ, dfltConcurrency=PESSIMISTIC, dfltTxTimeout=0, txTimeoutOnPartitionMapExchange=0, deadlockTimeout=10000, pessimisticTxLogSize=0, pessimisticTxLogLinger=10000, tmLookupClsName=null, txManagerFactory=null, useJtaSync=false], cacheSanityCheckEnabled=true, discoStartupDelay=60000, deployMode=SHARED, p2pMissedCacheSize=100, locHost=127.0.0.1, timeSrvPortBase=31100, timeSrvPortRange=100, failureDetectionTimeout=10000, sysWorkerBlockedTimeout=30000, clientFailureDetectionTimeout=10000, metricsLogFreq=0, connectorCfg=null, odbcCfg=null, warmupClos=null, atomicCfg=AtomicConfiguration [seqReserveSize=1000, cacheMode=PARTITIONED, backups=1, aff=null, grpName=null], classLdr=null, sslCtxFactory=null, platformCfg=null, binaryCfg=null, memCfg=null, pstCfg=null, dsCfg=DataStorageConfiguration [sysRegionInitSize=41943040, sysRegionMaxSize=104857600, pageSize=0, concLvl=0, dfltDataRegConf=DataRegionConfiguration [name=default, maxSize=268435456, initSize=268435456, swapPath=null, pageEvictionMode=DISABLED, pageReplacementMode=CLOCK, evictionThreshold=0.9, emptyPagesPoolSize=100, metricsEnabled=false, metricsSubIntervalCount=5, metricsRateTimeInterval=60000, persistenceEnabled=true, checkpointPageBufSize=0, lazyMemoryAllocation=true, warmUpCfg=null], dataRegions=null, storagePath=null, checkpointFreq=180000, lockWaitTime=10000, checkpointThreads=4, checkpointWriteOrder=SEQUENTIAL, walHistSize=20, maxWalArchiveSize=1073741824, walSegments=10, walSegmentSize=67108864, walPath=db/wal, walArchivePath=db/wal/archive, cdcWalPath=db/wal/cdc, cdcEnabled=false, metricsEnabled=false, walMode=LOG_ONLY, walTlbSize=131072, walBuffSize=0, walFlushFreq=2000, walFsyncDelay=1000, walRecordIterBuffSize=67108864, alwaysWriteFullPages=false, fileIOFactory=org.apache.ignite.internal.processors.cache.persistence.file.AsyncFileIOFactory@2dcd06b1, metricsSubIntervalCnt=5, metricsRateTimeInterval=60000, walAutoArchiveAfterInactivity=-1, walForceArchiveTimeout=-1, writeThrottlingEnabled=false, walCompactionEnabled=false, walCompactionLevel=1, checkpointReadLockTimeout=null, walPageCompression=DISABLED, walPageCompressionLevel=null, dfltWarmUpCfg=null, encCfg=org.apache.ignite.configuration.EncryptionConfiguration@322247f0, defragmentationThreadPoolSize=4, minWalArchiveSize=-1], snapshotPath=snapshots, activeOnStart=true, activeOnStartPropSetFlag=false, autoActivation=true, autoActivationPropSetFlag=false, clusterStateOnStart=null, sqlConnCfg=null, cliConnCfg=ClientConnectorConfiguration [host=null, port=10800, portRange=100, sockSndBufSize=0, sockRcvBufSize=0, tcpNoDelay=true, maxOpenCursorsPerConn=128, threadPoolSize=24, selectorCnt=12, idleTimeout=0, handshakeTimeout=10000, jdbcEnabled=true, odbcEnabled=true, thinCliEnabled=true, sslEnabled=false, useIgniteSslCtxFactory=true, sslClientAuth=false, sslCtxFactory=null, thinCliCfg=ThinClientConfiguration [maxActiveTxPerConn=100, maxActiveComputeTasksPerConn=0]], mvccVacuumThreadCnt=2, mvccVacuumFreq=5000, authEnabled=false, failureHnd=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]], commFailureRslvr=null, sqlCfg=SqlConfiguration [longQryWarnTimeout=3000, dfltQryTimeout=0, sqlQryHistSize=1000, validationEnabled=false], asyncContinuationExecutor=null] [21:02:32] : [Step 4/5] [2021-11-19 21:02:32,577][INFO ][test-runner-#3154%failure.FailureHandlingConfigurationTest%][FailureHandlingConfigurationTest0] Daemon mode: off [21:02:32] : [Step 4/5] [2021-11-19 21:02:32,578][INFO ][test-runner-#3154%failure.FailureHandlingConfigurationTest%][FailureHandlingConfigurationTest0] OS: Linux 4.15.0-151-generic amd64 [21:02:32] : [Step 4/5] [2021-11-19 21:02:32,578][INFO ][test-runner-#3154%failure.FailureHandlingConfigurationTest%][FailureHandlingConfigurationTest0] OS user: teamcity [21:02:32] : [Step 4/5] [2021-11-19 21:02:32,578][INFO ][test-runner-#3154%failure.FailureHandlingConfigurationTest%][FailureHandlingConfigurationTest0] PID: 16724 [21:02:32] : [Step 4/5] [2021-11-19 21:02:32,579][INFO ][test-runner-#3154%failure.FailureHandlingConfigurationTest%][FailureHandlingConfigurationTest0] Language runtime: Java Platform API Specification ver. 1.8 [21:02:32] : [Step 4/5] [2021-11-19 21:02:32,579][INFO ][test-runner-#3154%failure.FailureHandlingConfigurationTest%][FailureHandlingConfigurationTest0] VM information: Java(TM) SE Runtime Environment 1.8.0_261-b12 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 25.261-b12 [21:02:32] : [Step 4/5] [2021-11-19 21:02:32,580][INFO ][test-runner-#3154%failure.FailureHandlingConfigurationTest%][FailureHandlingConfigurationTest0] VM total memory: 1.9GB [21:02:32] : [Step 4/5] [2021-11-19 21:02:32,580][INFO ][test-runner-#3154%failure.FailureHandlingConfigurationTest%][FailureHandlingConfigurationTest0] Remote Management [restart: off, REST: off, JMX (remote: off)] [21:02:32] : [Step 4/5] [2021-11-19 21:02:32,581][INFO ][test-runner-#3154%failure.FailureHandlingConfigurationTest%][FailureHandlingConfigurationTest0] Logger: GridTestLog4jLogger [quiet=false, config=null] [21:02:32] : [Step 4/5] [2021-11-19 21:02:32,581][INFO ][test-runner-#3154%failure.FailureHandlingConfigurationTest%][FailureHandlingConfigurationTest0] IGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c [21:02:32] : [Step 4/5] [2021-11-19 21:02:32,581][INFO ][test-runner-#3154%failure.FailureHandlingConfigurationTest%][FailureHandlingConfigurationTest0] VM arguments: [-DIGNITE_DUMP_THREADS_ON_FAILURE=false, -DMono=/usr/bin/mono-sgen, -DMono4.0_x64=/usr/lib/mono/4.0, -DMono4.5_x64=/usr/lib/mono/4.5, -DMonoVersion=6.12.0.90, -DSKIP_BUILD=false, -Dagent.home.dir=/opt/buildagent, -Dagent.name=aitc-lin02_03, -Dagent.ownPort=9090, -Dagent.work.dir=/opt/buildagent/work, -Dbuild.number=95, -Dbuild.vcs.number=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.1=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.GitHubApacheIgnite=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dclassworlds.conf=/opt/buildagent/temp/buildTmp/teamcity.m2.conf, -Dcom.jetbrains.maven.watcher.report.file=/opt/buildagent/temp/buildTmp/maven-build-info.xml, -Djava.io.tmpdir=/opt/buildagent/temp/buildTmp, -Dmaven.home=/opt/buildagent/tools/maven3_6, -Dmaven.multiModuleProjectDirectory=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.agent.cpuBenchmark=457, -Dteamcity.agent.dotnet.agent_url=http://localhost:9090/RPC2, -Dteamcity.agent.dotnet.build_id=6278078, -Dteamcity.auth.password=*******, -Dteamcity.auth.userId=TeamCityBuildId=6278078, -Dteamcity.build.changedFiles.file=/opt/buildagent/temp/buildTmp/changedFiles6342607772318147725.txt, -Dteamcity.build.checkoutDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.build.id=6278078, -Dteamcity.build.properties.file=/opt/buildagent/temp/buildTmp/teamcity.build5164517880467851002.properties, -Dteamcity.build.tempDir=/opt/buildagent/temp/buildTmp, -Dteamcity.build.workingDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.buildConfName=Basic 3, -Dteamcity.buildType.id=IgniteTests24Java8_Basic3, -Dteamcity.configuration.properties.file=/opt/buildagent/temp/buildTmp/teamcity.config5591980786735343870.properties, -Dteamcity.maven.userSettings.path=/opt/buildagent/temp/buildTmp/maven_settings_585072866407032347.xml, -Dteamcity.maven.watcher.home=/opt/buildagent/plugins/mavenPlugin/maven-watcher-jdk16, -Dteamcity.projectName=Ignite Tests 2.x (JDK 8/11), -Dteamcity.runner.properties.file=/opt/buildagent/temp/buildTmp/teamcity.runner9098465561618137420.properties, -Dteamcity.tests.recentlyFailedTests.file=/opt/buildagent/temp/buildTmp/testsToRunFirst3891775683130404069.txt, -Dteamcity.version=2021.2 (build 99542), -ea, -Xms2g, -Xmx2g, -XX:+HeapDumpOnOutOfMemoryError, -DIGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_TEST_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_UPDATE_NOTIFIER=false, -DIGNITE_NO_DISCO_ORDER=true, -DIGNITE_PERFORMANCE_SUGGESTIONS_DISABLED=true, -Djava.net.preferIPv4Stack=true, -DTEST_SCALE_FACTOR=1.0, -DIGNITE_TEST_PROP_LOG4J_FILE=log4j-tc-test.xml, -DIGNITE_QUIET=false, -DIGNITE_MARSHAL_BUFFERS_RECHECK=1000, -Dmaven.repo.local=/opt/buildagent/.m2/repository] [21:02:32] : [Step 4/5] [2021-11-19 21:02:32,588][INFO ][test-runner-#3154%failure.FailureHandlingConfigurationTest%][FailureHandlingConfigurationTest0] System cache's DataRegion size is configured to 40 MB. Use DataStorageConfiguration.systemRegionInitialSize property to change the setting. [21:02:32] : [Step 4/5] [2021-11-19 21:02:32,588][INFO ][test-runner-#3154%failure.FailureHandlingConfigurationTest%][FailureHandlingConfigurationTest0] Configured caches [in 'sysMemPlc' dataRegion: ['ignite-sys-cache']] [21:02:32]W: [org.apache.ignite:ignite-core] [2021-11-19 21:02:32,589][WARN ][test-runner-#3154%failure.FailureHandlingConfigurationTest%][FailureHandlingConfigurationTest0] Peer class loading is enabled (disable it in production for performance and deployment consistency reasons) [21:02:32] : [Step 4/5] [2021-11-19 21:02:32,589][INFO ][test-runner-#3154%failure.FailureHandlingConfigurationTest%][FailureHandlingConfigurationTest0] 3-rd party licenses can be found at: /opt/buildagent/work/7bc1c54bc719b67c/libs/licenses [21:02:32] : [Step 4/5] [2021-11-19 21:02:32,595][INFO ][test-runner-#3154%failure.FailureHandlingConfigurationTest%][IgnitePluginProcessor] Configured plugins: [21:02:32] : [Step 4/5] [2021-11-19 21:02:32,596][INFO ][test-runner-#3154%failure.FailureHandlingConfigurationTest%][IgnitePluginProcessor] ^-- StanByClusterTestProvider 1.0 [21:02:32] : [Step 4/5] [2021-11-19 21:02:32,596][INFO ][test-runner-#3154%failure.FailureHandlingConfigurationTest%][IgnitePluginProcessor] ^-- null [21:02:32] : [Step 4/5] [2021-11-19 21:02:32,596][INFO ][test-runner-#3154%failure.FailureHandlingConfigurationTest%][IgnitePluginProcessor] [21:02:32] : [Step 4/5] [2021-11-19 21:02:32,597][INFO ][test-runner-#3154%failure.FailureHandlingConfigurationTest%][IgnitePluginProcessor] ^-- PageMemory tracker plugin 1.0 [21:02:32] : [Step 4/5] [2021-11-19 21:02:32,597][INFO ][test-runner-#3154%failure.FailureHandlingConfigurationTest%][IgnitePluginProcessor] ^-- null [21:02:32] : [Step 4/5] [2021-11-19 21:02:32,597][INFO ][test-runner-#3154%failure.FailureHandlingConfigurationTest%][IgnitePluginProcessor] [21:02:32] : [Step 4/5] [2021-11-19 21:02:32,597][INFO ][test-runner-#3154%failure.FailureHandlingConfigurationTest%][IgnitePluginProcessor] ^-- TestDistibutedConfigurationPlugin 1.0 [21:02:32] : [Step 4/5] [2021-11-19 21:02:32,598][INFO ][test-runner-#3154%failure.FailureHandlingConfigurationTest%][IgnitePluginProcessor] ^-- null [21:02:32] : [Step 4/5] [2021-11-19 21:02:32,598][INFO ][test-runner-#3154%failure.FailureHandlingConfigurationTest%][IgnitePluginProcessor] [21:02:32] : [Step 4/5] [2021-11-19 21:02:32,598][INFO ][test-runner-#3154%failure.FailureHandlingConfigurationTest%][IgnitePluginProcessor] ^-- NodeValidationPluginProvider 1.0 [21:02:32] : [Step 4/5] [2021-11-19 21:02:32,598][INFO ][test-runner-#3154%failure.FailureHandlingConfigurationTest%][IgnitePluginProcessor] ^-- null [21:02:32] : [Step 4/5] [2021-11-19 21:02:32,598][INFO ][test-runner-#3154%failure.FailureHandlingConfigurationTest%][IgnitePluginProcessor] [21:02:32] : [Step 4/5] [2021-11-19 21:02:32,599][INFO ][test-runner-#3154%failure.FailureHandlingConfigurationTest%][FailureProcessor] Configured failure handler: [hnd=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]] [21:02:32] : [Step 4/5] [2021-11-19 21:02:32,620][INFO ][test-runner-#3154%failure.FailureHandlingConfigurationTest%][TcpCommunicationSpi] Successfully bound communication NIO server to TCP port [port=45050, locHost=/127.0.0.1, selectorsCnt=12, selectorSpins=0, pairedConn=false] [21:02:32]W: [org.apache.ignite:ignite-core] [2021-11-19 21:02:32,621][WARN ][test-runner-#3154%failure.FailureHandlingConfigurationTest%][TcpCommunicationSpi] Message queue limit is set to 0 which may lead to potential OOMEs when running cache operations in FULL_ASYNC or PRIMARY_SYNC modes due to message queues growth on sender and receiver sides. [21:02:32] : [Step 4/5] [2021-11-19 21:02:32,625][INFO ][test-runner-#3154%failure.FailureHandlingConfigurationTest%][GridCollisionManager] Collision resolution is disabled (all jobs will be activated upon arrival). [21:02:32] : [Step 4/5] [2021-11-19 21:02:32,625][INFO ][test-runner-#3154%failure.FailureHandlingConfigurationTest%][FailureHandlingConfigurationTest0] Security status [authentication=off, sandbox=off, tls/ssl=off] [21:02:32] : [Step 4/5] [2021-11-19 21:02:32,627][INFO ][test-runner-#3154%failure.FailureHandlingConfigurationTest%][TestTcpDiscoverySpi] Successfully bound to TCP port [port=47500, localHost=localhost/127.0.0.1, locNodeId=2743de01-19ee-4d86-9a34-689d86200000] [21:02:32] : [Step 4/5] [2021-11-19 21:02:32,637][INFO ][test-runner-#3154%failure.FailureHandlingConfigurationTest%][PdsFoldersResolver] Successfully created new persistent storage folder [/opt/buildagent/work/7bc1c54bc719b67c/work/db/node00-ff6fcc4c-1e3c-4ad9-9f14-edb31c38d7cb] [21:02:32] : [Step 4/5] [2021-11-19 21:02:32,637][INFO ][test-runner-#3154%failure.FailureHandlingConfigurationTest%][PdsFoldersResolver] Consistent ID used for local node is [ff6fcc4c-1e3c-4ad9-9f14-edb31c38d7cb] according to persistence data storage folders [21:02:32] : [Step 4/5] [2021-11-19 21:02:32,638][INFO ][test-runner-#3154%failure.FailureHandlingConfigurationTest%][MaintenanceProcessor] Resolved store directory for node persistent data: /opt/buildagent/work/7bc1c54bc719b67c/work/db/node00-ff6fcc4c-1e3c-4ad9-9f14-edb31c38d7cb [21:02:32] : [Step 4/5] [2021-11-19 21:02:32,639][INFO ][test-runner-#3154%failure.FailureHandlingConfigurationTest%][CacheObjectBinaryProcessorImpl] Resolved directory for serialized binary metadata: /opt/buildagent/work/7bc1c54bc719b67c/work/db/binary_meta/node00-ff6fcc4c-1e3c-4ad9-9f14-edb31c38d7cb [21:02:32] : [Step 4/5] [2021-11-19 21:02:32,643][INFO ][test-runner-#3154%failure.FailureHandlingConfigurationTest%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/node00-ff6fcc4c-1e3c-4ad9-9f14-edb31c38d7cb [21:02:32] : [Step 4/5] [2021-11-19 21:02:32,644][INFO ][test-runner-#3154%failure.FailureHandlingConfigurationTest%][FileWriteAheadLogManager] Resolved write ahead log work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/node00-ff6fcc4c-1e3c-4ad9-9f14-edb31c38d7cb [21:02:32] : [Step 4/5] [2021-11-19 21:02:32,644][INFO ][test-runner-#3154%failure.FailureHandlingConfigurationTest%][FileWriteAheadLogManager] Resolved write ahead log archive directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/node00-ff6fcc4c-1e3c-4ad9-9f14-edb31c38d7cb [21:02:33] : [Step 4/5] [2021-11-19 21:02:33,197][INFO ][test-runner-#3154%failure.FailureHandlingConfigurationTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/node00-ff6fcc4c-1e3c-4ad9-9f14-edb31c38d7cb/0000000000000000.wal [21:02:33] : [Step 4/5] [2021-11-19 21:02:33,198][INFO ][test-runner-#3154%failure.FailureHandlingConfigurationTest%][FileHandleManagerImpl] Initialized write-ahead log manager [mode=LOG_ONLY] [21:02:33] : [Step 4/5] [2021-11-19 21:02:33,204][INFO ][test-runner-#3154%failure.FailureHandlingConfigurationTest%][GridCacheDatabaseSharedManager] Configured data regions initialized successfully [total=5] [21:02:33] : [Step 4/5] [2021-11-19 21:02:33,205][INFO ][test-runner-#3154%failure.FailureHandlingConfigurationTest%][IgniteSnapshotManager] Resolved snapshot work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/snapshots [21:02:33] : [Step 4/5] [2021-11-19 21:02:33,206][INFO ][test-runner-#3154%failure.FailureHandlingConfigurationTest%][IgniteSnapshotManager] Resolved temp directory for snapshot creation: /opt/buildagent/work/7bc1c54bc719b67c/work/db/node00-ff6fcc4c-1e3c-4ad9-9f14-edb31c38d7cb/snp [21:02:33] : [Step 4/5] [2021-11-19 21:02:33,208][INFO ][test-runner-#3154%failure.FailureHandlingConfigurationTest%][ClientListenerProcessor] Client connector processor has started on TCP port 10800 [21:02:33] : [Step 4/5] [2021-11-19 21:02:33,210][INFO ][test-runner-#3154%failure.FailureHandlingConfigurationTest%][FailureHandlingConfigurationTest0] Non-loopback local IPs: 172.17.0.4 [21:02:33] : [Step 4/5] [2021-11-19 21:02:33,211][INFO ][test-runner-#3154%failure.FailureHandlingConfigurationTest%][FailureHandlingConfigurationTest0] Enabled local MACs: 0242AC110004 [21:02:33] : [Step 4/5] [2021-11-19 21:02:33,211][INFO ][test-runner-#3154%failure.FailureHandlingConfigurationTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:02:33] : [Step 4/5] [2021-11-19 21:02:33,213][INFO ][test-runner-#3154%failure.FailureHandlingConfigurationTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:02:33] : [Step 4/5] [2021-11-19 21:02:33,214][INFO ][test-runner-#3154%failure.FailureHandlingConfigurationTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:02:33] : [Step 4/5] [2021-11-19 21:02:33,216][INFO ][test-runner-#3154%failure.FailureHandlingConfigurationTest%][GridCacheDatabaseSharedManager] Applying lost metastore updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:02:33] : [Step 4/5] [2021-11-19 21:02:33,216][INFO ][test-runner-#3154%failure.FailureHandlingConfigurationTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=0 ms] [21:02:33] : [Step 4/5] [2021-11-19 21:02:33,217][INFO ][test-runner-#3154%failure.FailureHandlingConfigurationTest%][GridCacheProcessor] Restoring partition state for local groups. [21:02:33] : [Step 4/5] [2021-11-19 21:02:33,217][INFO ][test-runner-#3154%failure.FailureHandlingConfigurationTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=0, partitionsProcessed=0, time=0ms] [21:02:33] : [Step 4/5] [2021-11-19 21:02:33,217][INFO ][test-runner-#3154%failure.FailureHandlingConfigurationTest%][GridEncryptionManager] Encryption keys loaded from metastore. [grps=, masterKeyName=null] [21:02:33] : [Step 4/5] [2021-11-19 21:02:33,219][INFO ][test-runner-#3154%failure.FailureHandlingConfigurationTest%][ClusterProcessor] Cluster ID and tag has been read from metastorage: null [21:02:33] : [Step 4/5] [2021-11-19 21:02:33,219][INFO ][test-runner-#3154%failure.FailureHandlingConfigurationTest%][IgniteClusterImpl] Shutdown policy was updated [oldVal=null, newVal=null] [21:02:33] : [Step 4/5] [2021-11-19 21:02:33,220][INFO ][test-runner-#3154%failure.FailureHandlingConfigurationTest%][GridCacheDatabaseSharedManager] Checkpoint frequency deviation changed [oldVal=null, newVal=null] [21:02:33] : [Step 4/5] [2021-11-19 21:02:33,229][INFO ][test-runner-#3154%failure.FailureHandlingConfigurationTest%][FilePageStoreManager] Cleanup cache stores [total=1, left=0, cleanFiles=false] [21:02:33] : [Step 4/5] [2021-11-19 21:02:33,232][INFO ][test-runner-#3154%failure.FailureHandlingConfigurationTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:02:33] : [Step 4/5] [2021-11-19 21:02:33,233][INFO ][test-runner-#3154%failure.FailureHandlingConfigurationTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:02:33] : [Step 4/5] [2021-11-19 21:02:33,234][INFO ][test-runner-#3154%failure.FailureHandlingConfigurationTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:02:33] : [Step 4/5] [2021-11-19 21:02:33,235][INFO ][test-runner-#3154%failure.FailureHandlingConfigurationTest%][GridCacheDatabaseSharedManager] Data Regions Started: 5 [21:02:33] : [Step 4/5] [2021-11-19 21:02:33,235][INFO ][test-runner-#3154%failure.FailureHandlingConfigurationTest%][GridCacheDatabaseSharedManager] ^-- sysMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:02:33] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:02:33] : [Step 4/5] ^-- default region [type=default, persistence=true, lazyAlloc=true, [21:02:33] : [Step 4/5] ... initCfg=256MB, maxCfg=256MB, usedRam=0MB, freeRam=100%, allocRam=0MB, allocTotal=0MB] [21:02:33] : [Step 4/5] ^-- metastoreMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:02:33] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:02:33] : [Step 4/5] ^-- TxLog region [type=internal, persistence=true, lazyAlloc=false, [21:02:33] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:02:33] : [Step 4/5] ^-- volatileDsMemPlc region [type=user, persistence=false, lazyAlloc=true, [21:02:33] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB] [21:02:33] : [Step 4/5] ^-- Ignite persistence [used=0MB] [21:02:33] : [Step 4/5] [21:02:33] : [Step 4/5] [2021-11-19 21:02:33,237][INFO ][test-runner-#3154%failure.FailureHandlingConfigurationTest%][GridCacheDatabaseSharedManager] Starting binary memory restore for: [-2100569601] [21:02:33] : [Step 4/5] [2021-11-19 21:02:33,244][INFO ][test-runner-#3154%failure.FailureHandlingConfigurationTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:02:33] : [Step 4/5] [2021-11-19 21:02:33,245][INFO ][test-runner-#3154%failure.FailureHandlingConfigurationTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:02:33] : [Step 4/5] [2021-11-19 21:02:33,247][INFO ][test-runner-#3154%failure.FailureHandlingConfigurationTest%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/node00-ff6fcc4c-1e3c-4ad9-9f14-edb31c38d7cb/0000000000000000.wal, offset=0, ver=2] [21:02:33] : [Step 4/5] [2021-11-19 21:02:33,250][INFO ][test-runner-#3154%failure.FailureHandlingConfigurationTest%][GridCacheProcessor] Started cache in recovery mode [name=ignite-sys-cache, id=-2100569601, dataRegionName=sysMemPlc, mode=REPLICATED, atomicity=TRANSACTIONAL, backups=2147483647, mvcc=false] [21:02:33] : [Step 4/5] [2021-11-19 21:02:33,251][INFO ][test-runner-#3154%failure.FailureHandlingConfigurationTest%][GridCacheDatabaseSharedManager] Binary recovery performed in 14 ms. [21:02:33] : [Step 4/5] [2021-11-19 21:02:33,251][INFO ][test-runner-#3154%failure.FailureHandlingConfigurationTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:02:33] : [Step 4/5] [2021-11-19 21:02:33,251][INFO ][test-runner-#3154%failure.FailureHandlingConfigurationTest%][GridCacheDatabaseSharedManager] Applying lost cache updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:02:33] : [Step 4/5] [2021-11-19 21:02:33,302][INFO ][test-runner-#3154%failure.FailureHandlingConfigurationTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=51 ms] [21:02:33] : [Step 4/5] [2021-11-19 21:02:33,302][INFO ][test-runner-#3154%failure.FailureHandlingConfigurationTest%][GridCacheProcessor] Restoring partition state for local groups. [21:02:33] : [Step 4/5] [2021-11-19 21:02:33,310][INFO ][test-runner-#3154%failure.FailureHandlingConfigurationTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=1, partitionsProcessed=100, time=10ms] [21:02:33] : [Step 4/5] [2021-11-19 21:02:33,836][INFO ][disco-notifier-worker-#3266%failure.FailureHandlingConfigurationTest0%][MvccProcessorImpl] Assigned mvcc coordinator [crd=MvccCoordinator [topVer=AffinityTopologyVersion [topVer=1, minorTopVer=0], nodeId=2743de01-19ee-4d86-9a34-689d86200000, ver=1637344953834, local=true, initialized=false]] [21:02:33] : [Step 4/5] [2021-11-19 21:02:33,838][INFO ][sys-#3257%failure.FailureHandlingConfigurationTest0%][ClusterProcessor] Writing cluster ID and tag to metastorage on ready for write ClusterIdAndTag [id=74acea84-973d-49f2-998d-700161a487c5, tag=vigorous_maxwell] [21:02:33] : [Step 4/5] [2021-11-19 21:02:33,839][INFO ][disco-notifier-worker-#3266%failure.FailureHandlingConfigurationTest0%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustEnabled' was changed from 'null' to 'false' [21:02:33] : [Step 4/5] [2021-11-19 21:02:33,839][INFO ][disco-notifier-worker-#3266%failure.FailureHandlingConfigurationTest0%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustTimeout' was changed from 'null' to '300000' [21:02:33] : [Step 4/5] [2021-11-19 21:02:33,840][INFO ][disco-notifier-worker-#3266%failure.FailureHandlingConfigurationTest0%][IgniteTxManager] Transactions parameter 'longOperationsDumpTimeout' was changed from 'null' to '60000' [21:02:33] : [Step 4/5] [2021-11-19 21:02:33,841][INFO ][disco-notifier-worker-#3266%failure.FailureHandlingConfigurationTest0%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpThreshold' was changed from 'null' to '0' [21:02:33] : [Step 4/5] [2021-11-19 21:02:33,842][INFO ][disco-notifier-worker-#3266%failure.FailureHandlingConfigurationTest0%][IgniteTxManager] Transactions parameter 'transactionTimeDumpSamplesCoefficient' was changed from 'null' to '0.0' [21:02:33] : [Step 4/5] [2021-11-19 21:02:33,843][INFO ][disco-notifier-worker-#3266%failure.FailureHandlingConfigurationTest0%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpSamplesPerSecondLimit' was changed from 'null' to '5' [21:02:33] : [Step 4/5] [2021-11-19 21:02:33,843][INFO ][disco-notifier-worker-#3266%failure.FailureHandlingConfigurationTest0%][ClusterProcessor] vigorous_maxwell [21:02:33] : [Step 4/5] [2021-11-19 21:02:33,844][INFO ][disco-notifier-worker-#3266%failure.FailureHandlingConfigurationTest0%][IgniteTxManager] Transactions parameter 'collisionsDumpInterval' was changed from 'null' to '1000' [21:02:33] : [Step 4/5] [2021-11-19 21:02:33,845][INFO ][disco-notifier-worker-#3266%failure.FailureHandlingConfigurationTest0%][IgniteTxManager] Transactions parameter 'txOwnerDumpRequestsAllowed' was changed from 'null' to 'true' [21:02:33] : [Step 4/5] [2021-11-19 21:02:33,845][INFO ][disco-notifier-worker-#3266%failure.FailureHandlingConfigurationTest0%][GridCacheDatabaseSharedManager] Historical rebalance WAL threshold changed [property=historical.rebalance.threshold, oldVal=null, newVal=500] [21:02:33] : [Step 4/5] [2021-11-19 21:02:33,855][INFO ][test-runner-#3154%failure.FailureHandlingConfigurationTest%][FailureHandlingConfigurationTest0] To start Console Management & Monitoring run ignitevisorcmd.{sh|bat} [21:02:33] : [Step 4/5] [2021-11-19 21:02:33,856][INFO ][test-runner-#3154%failure.FailureHandlingConfigurationTest%][FailureHandlingConfigurationTest0] [21:02:33] : [Step 4/5] [21:02:33] : [Step 4/5] >>> +-------------------------------------------+ [21:02:33] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:02:33] : [Step 4/5] >>> +-------------------------------------------+ [21:02:33] : [Step 4/5] >>> OS name: Linux 4.15.0-151-generic amd64 [21:02:33] : [Step 4/5] >>> CPU(s): 24 [21:02:33] : [Step 4/5] >>> Heap: 2.0GB [21:02:33] : [Step 4/5] >>> VM name: 16724@c4dfe9a430b2 [21:02:33] : [Step 4/5] >>> Ignite instance name: failure.FailureHandlingConfigurationTest0 [21:02:33] : [Step 4/5] >>> Local node [ID=2743DE01-19EE-4D86-9A34-689D86200000, order=1, clientMode=false] [21:02:33] : [Step 4/5] >>> Local node addresses: [127.0.0.1] [21:02:33] : [Step 4/5] >>> Local ports: TCP:10800 TCP:45050 TCP:47500 [21:02:33] : [Step 4/5] [21:02:33] : [Step 4/5] [2021-11-19 21:02:33,857][INFO ][test-runner-#3154%failure.FailureHandlingConfigurationTest%][FailureHandlingConfigurationTest0] >>> Ignite cluster is in INACTIVE state (limited functionality available). Use control.(sh|bat) script or IgniteCluster.state(ClusterState.ACTIVE) to change the state. [21:02:33] : [Step 4/5] [2021-11-19 21:02:33,858][INFO ][test-runner-#3154%failure.FailureHandlingConfigurationTest%][GridDiscoveryManager] Topology snapshot [ver=1, locNode=2743de01, servers=1, clients=0, state=INACTIVE, CPUs=24, offheap=0.25GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=2743de01-19ee-4d86-9a34-689d86200000, consistentId=ff6fcc4c-1e3c-4ad9-9f14-edb31c38d7cb, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:02:33] : [Step 4/5] [2021-11-19 21:02:33,859][INFO ][test-runner-#3154%failure.FailureHandlingConfigurationTest%][G] Node started : [stage="Configure system pool" (0 ms),stage="Start managers" (76 ms),stage="Configure binary metadata" (2 ms),stage="Start processors" (569 ms),stage="Start 'StanByClusterTestProvider' plugin" (0 ms),stage="Start 'PageMemory tracker plugin' plugin" (0 ms),stage="Start 'TestDistibutedConfigurationPlugin' plugin" (0 ms),stage="Start 'NodeValidationPluginProvider' plugin" (0 ms),stage="Init metastore" (19 ms),stage="Init and start regions" (7 ms),stage="Restore binary memory" (13 ms),stage="Restore logical state" (59 ms),stage="Finish recovery" (521 ms),stage="Join topology" (4 ms),stage="Await transition" (2 ms),stage="Await exchange" (20 ms),stage="Total time" (1292 ms)] [21:02:33] : [Step 4/5] [2021-11-19 21:02:33,860][INFO ][test-runner-#3154%failure.FailureHandlingConfigurationTest%][root] Node started with the following configuration [id=2743de01-19ee-4d86-9a34-689d86200000, marshaller=BinaryMarshaller [], discovery=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=5000, ackTimeout=5000, marsh=JdkMarshaller [clsFilter=org.apache.ignite.marshaller.MarshallerUtils$1@1adebee1], reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], binaryCfg=null, lateAff=true] [21:02:33] : [Step 4/5] [2021-11-19 21:02:33,862][INFO ][test-runner-#3154%failure.FailureHandlingConfigurationTest%][GridClusterStateProcessor] Sending activate cluster request with BaselineTopology BaselineTopology [id=0, branchingHash=1652538605, branchingType='New BaselineTopology', baselineNodes=[ff6fcc4c-1e3c-4ad9-9f14-edb31c38d7cb]] [21:02:33] : [Step 4/5] [2021-11-19 21:02:33,863][INFO ][disco-notifier-worker-#3266%failure.FailureHandlingConfigurationTest0%][GridClusterStateProcessor] Received activate cluster request with BaselineTopology[id=0] initiator node ID: 2743de01-19ee-4d86-9a34-689d86200000 [21:02:33] : [Step 4/5] [2021-11-19 21:02:33,864][INFO ][disco-notifier-worker-#3266%failure.FailureHandlingConfigurationTest0%][GridClusterStateProcessor] Started state transition: activate cluster [21:02:33] : [Step 4/5] [2021-11-19 21:02:33,864][INFO ][exchange-worker-#3271%failure.FailureHandlingConfigurationTest0%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=1, minorTopVer=1], crd=true, evt=DISCOVERY_CUSTOM_EVT, evtNode=2743de01-19ee-4d86-9a34-689d86200000, customEvt=ChangeGlobalStateMessage [id=5a9ac593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqId=17d98847-ece3-4382-84da-5b0a9fe8e70f, initiatingNodeId=2743de01-19ee-4d86-9a34-689d86200000, state=ACTIVE, baselineTopology=BaselineTopology [id=0, branchingHash=1652538605, branchingType='New BaselineTopology', baselineNodes=[ff6fcc4c-1e3c-4ad9-9f14-edb31c38d7cb]], forceChangeBaselineTopology=false, timestamp=1637344953862, forceDeactivation=true], allowMerge=false, exchangeFreeSwitch=false] [21:02:33] : [Step 4/5] [2021-11-19 21:02:33,866][INFO ][exchange-worker-#3271%failure.FailureHandlingConfigurationTest0%][GridDhtPartitionsExchangeFuture] Start activation process [nodeId=2743de01-19ee-4d86-9a34-689d86200000, client=false, topVer=AffinityTopologyVersion [topVer=1, minorTopVer=1]]. New state: ACTIVE [21:02:33] : [Step 4/5] [2021-11-19 21:02:33,867][INFO ][exchange-worker-#3271%failure.FailureHandlingConfigurationTest0%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/node00-ff6fcc4c-1e3c-4ad9-9f14-edb31c38d7cb [21:02:33] : [Step 4/5] [2021-11-19 21:02:33,869][INFO ][exchange-worker-#3271%failure.FailureHandlingConfigurationTest0%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/node00-ff6fcc4c-1e3c-4ad9-9f14-edb31c38d7cb/0000000000000000.wal, offset=8795, ver=2] [21:02:33] : [Step 4/5] [2021-11-19 21:02:33,870][INFO ][exchange-worker-#3271%failure.FailureHandlingConfigurationTest0%][GridClusterStateProcessor] Writing BaselineTopology[id=0] [21:02:33] : [Step 4/5] [2021-11-19 21:02:33,873][INFO ][exchange-worker-#3271%failure.FailureHandlingConfigurationTest0%][GridCacheDatabaseSharedManager] Finish recovery performed in 6 ms. [21:02:33] : [Step 4/5] [2021-11-19 21:02:33,874][INFO ][exchange-worker-#3271%failure.FailureHandlingConfigurationTest0%][msg] Components activation performed in 8 ms. [21:02:33] : [Step 4/5] [2021-11-19 21:02:33,874][INFO ][exchange-worker-#3271%failure.FailureHandlingConfigurationTest0%][GridCacheProcessor] Finished recovery for cache [cache=ignite-sys-cache, grp=ignite-sys-cache, startVer=AffinityTopologyVersion [topVer=1, minorTopVer=1]] [21:02:33] : [Step 4/5] [2021-11-19 21:02:33,875][INFO ][exchange-worker-#3271%failure.FailureHandlingConfigurationTest0%][GridDhtPartitionsExchangeFuture] Successfully activated caches [nodeId=2743de01-19ee-4d86-9a34-689d86200000, client=false, topVer=AffinityTopologyVersion [topVer=1, minorTopVer=1], newState=ACTIVE] [21:02:33] : [Step 4/5] [2021-11-19 21:02:33,877][INFO ][exchange-worker-#3271%failure.FailureHandlingConfigurationTest0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=1, minorTopVer=1], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:02:33] : [Step 4/5] [2021-11-19 21:02:33,888][INFO ][exchange-worker-#3271%failure.FailureHandlingConfigurationTest0%][GridDhtPartitionsExchangeFuture] finishExchangeOnCoordinator [topVer=AffinityTopologyVersion [topVer=1, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=1, minorTopVer=1]] [21:02:33] : [Step 4/5] [2021-11-19 21:02:33,890][INFO ][db-checkpoint-thread-#3278%failure.FailureHandlingConfigurationTest0%][Checkpointer] Checkpoint started [checkpointId=37cd1479-2f16-4343-87ef-284f7204a386, startPtr=WALPointer [idx=0, fileOff=66403, len=1963], checkpointBeforeLockTime=3ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=0ms, writeCheckpointEntryDuration=2ms, splitAndSortCpPagesDuration=0ms, pages=16, reason='node started'] [21:02:33] : [Step 4/5] [2021-11-19 21:02:33,893][INFO ][exchange-worker-#3271%failure.FailureHandlingConfigurationTest0%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=1, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=1, minorTopVer=1], err=null, rebalanced=true, wasRebalanced=false] [21:02:33] : [Step 4/5] [2021-11-19 21:02:33,896][INFO ][disco-notifier-worker-#3266%failure.FailureHandlingConfigurationTest0%][GridClusterStateProcessor] Received state change finish message: ACTIVE [21:02:33] : [Step 4/5] [2021-11-19 21:02:33,896][INFO ][disco-notifier-worker-#3266%failure.FailureHandlingConfigurationTest0%][GridClusterStateProcessor] Cluster state was changed from INACTIVE to ACTIVE [21:02:33] : [Step 4/5] [2021-11-19 21:02:33,899][INFO ][exchange-worker-#3271%failure.FailureHandlingConfigurationTest0%][GridCacheProcessor] Finish proxy initialization, cacheName=ignite-sys-cache, localNodeId=2743de01-19ee-4d86-9a34-689d86200000 [21:02:33] : [Step 4/5] [2021-11-19 21:02:33,900][INFO ][sys-#3264%failure.FailureHandling[21:02:33] >>> Stopping test: FaConilureHfigaurationTest0ndlingConfiguration%][DistribuTest#testPartedBaselineCtialCfgParamsPropagation in 1347 msonf <<< [21:02:33] : [Step 4/5] iguration] Baseline auto-adjust is 'disabled' with timeout='300000' ms [21:02:33] : [Step 4/5] [2021-11-19 21:02:33,901][INFO ][main][root] >>> Stopping test: FailureHandlingConfigurationTest#testPartialCfgParamsPropagation in 1347 ms <<< [21:02:33] : [Step 4/5] [2021-11-[21:02:33] >>> Heap: 383 MB u19se 21d / 1944 MB commited / 1944 MB m:02:33,900][INFO ][exchange-worker-#3271%failure.Failuax reHandlingConfigurationT<<< [21:02:33] : [Step 4/5] est0%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=2743de01-19ee-4d86-9a34-689d86200000, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=1, minorTopVer=1], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=2743de01-19ee-4d86-9a34-689d86200000, consistentId=ff6fcc4c-1e3c-4ad9-9f14-edb31c38d7cb, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637344953823, loc=true, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=1, minorTopVer=1]] [21:02:33] : [Step 4/5] [2021-11-19 21:02:33,902][INFO ][main][root] >>> Heap: 383 MB used / 1944 MB commited / 1944 MB max <<< [21:02:33] : [Step 4/5] [21:02:33] >>> Non-H[2021-11-19 eap: 117 21:02:33,9MB used / 125 MB commit01]ed / 0[INFO ] MB max <<< [21:02:33] : [Step 4/5] [sys-#3264%failure.FailureHandlingConfigurationTest0%][GridClusterStateProcessor] Successfully performed final activation steps [nodeId=2743de01-19ee-4d86-9a34-689d86200000, client=false, topVer=AffinityTopologyVersion [topVer=1, minorTopVer=1]] [21:02:33] : [Step 4/5] [2021-11-19 21:02:33,903][INFO ][main][root] >>> Non-Heap: 117 MB used / 125 MB commited / 0 MB max <<< [21:02:33] : [Step 4/5] [2021-11-19 21:02:33,903][INFO ][exchange-worker-#3271%failure.FailureHandlingConfigurationTest0%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=1, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=1, minorTopVer=1], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (1 ms), stage="Update caches registry" (8 ms), stage="Start caches" (0 ms), stage="Affinity initialization on cache group start" (0 ms), stage="Determine exchange type" (1 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Restore partition states" (0 ms), stage="After states restored callback" (10 ms), stage="WAL history reservation" (0 ms), stage="Waiting for all single messages" (0 ms), stage="Affinity recalculation (crd)" (0 ms), stage="Collect update counters and create affinity messages" (0 ms), stage="Assign partitions states" (0 ms), stage="Validate partitions states" (0 ms), stage="Ideal affinity diff calculation (enforced)" (0 ms), stage="Apply update counters" (0 ms), stage="Full message preparing" (2 ms), stage="Full message sending" (0 ms), stage="State finish message sending" (0 ms), stage="Detect lost partitions" (3 ms), stage="Exchange done" (6 ms), stage="Total time" (31 ms)] [21:02:33] : [Step 4/5] [2021-11-19 21:02:33,904][INFO ][main][root] >>> Stopping grid [name=failure.FailureHandlingConfigurationTest0, id=2743de01-19ee-4d86-9a34-689d86200000] [21:02:33] : [Step 4/5] [2021-11-19 21:02:33,906][INFO ][exchange-worker-#3271%failure.FailureHandlingConfigurationTest0%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=1, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=1, minorTopVer=1], stage="Affinity initialization on cache group start [grp=ignite-sys-cache]" (0 ms) (parent=Affinity initialization on cache group start), stage="Affinity centralized initialization (crd) [grp=ignite-sys-cache, crd=true]" (0 ms) (parent=Determine exchange type), stage="Restore partition states [grp=ignite-sys-cache]" (0 ms) (parent=Restore partition states), stage="Affinity recalculation (partitions availability) [grp=ignite-sys-cache]" (0 ms) (parent=Ideal affinity diff calculation (enforced))] [21:02:33] : [Step 4/5] [2021-11-19 21:02:33,910][INFO ][exchange-worker-#3271%failure.FailureHandlingConfigurationTest0%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=1, minorTopVer=1], crd=true] [21:02:33] : [Step 4/5] [2021-11-19 21:02:33,911][INFO ][exchange-worker-#3271%failure.FailureHandlingConfigurationTest0%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=1, minorTopVer=1], force=false, evt=DISCOVERY_CUSTOM_EVT, node=2743de01-19ee-4d86-9a34-689d86200000] [21:02:33] : [Step 4/5] [2021-11-19 21:02:33,918][INFO ][db-checkpoint-thread-#3278%failure.FailureHandlingConfigurationTest0%][Checkpointer] Checkpoint finished [cpId=37cd1479-2f16-4343-87ef-284f7204a386, pages=16, markPos=WALPointer [idx=0, fileOff=66403, len=1963], walSegmentsCovered=[], markDuration=6ms, pagesWrite=6ms, fsync=19ms, total=34ms] [21:02:33] : [Step 4/5] [2021-11-19 21:02:33,923][INFO ][main][GridCacheProcessor] Stopped cache [cacheName=ignite-sys-cache] [21:02:34] : [Step 4/5] [2021-11-19 21:02:34,365][INFO ][main][FilePageStoreManager] Cleanup cache stores [total=3, left=0, cleanFiles=false] [21:02:34] : [Step 4/5] [2021-11-19 21:02:34,379][INFO ][main][FailureHandlingConfigurationTest0] [21:02:34] : [Step 4/5] [21:02:34] : [Step 4/5] >>> +------------------------------------------------------+ [21:02:34] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV stopped OK [21:02:34] : [Step 4/5] >>> +------------------------------------------------------+ [21:02:34] : [Step 4/5] >>> Ignite instance name: failure.FailureHandlingConfigurationTest0 [21:02:34] : [Step 4/5] >>> Grid uptime: 00:00:00.526 [21:02:34] : [Step 4/5] [21:02:34] : [Step 4/5] [21:02:34] : [Step 4/5] [21:02:34] >>> Starting test: FailureHandlingConfigurationTest#testCfgParamsPropagation <<< [21:02:34] : [Step 4/5] [2021-11-19 21:02:34,427][INFO ][main][root] >>> Starting test: FailureHandlingConfigurationTest#testCfgParamsPropagation <<< [21:02:34] : [Step 4/5] [21:02:34] >>> Heap: 384 MB used / 1944 MB commited / 1944 MB max <<< [21:02:34] : [Step 4/5] [2021-11-19 21:02:34,427][INFO ][main][root] >>> Heap: 384 MB used / 1944 MB commited / 1944 MB max <<< [21:02:34] : [Step 4/5] [21:02:34] >>> Non-Heap: 117 MB used / 125 MB commited / 0 MB max <<< [21:02:34] : [Step 4/5] [2021-11-19 21:02:34,427][INFO ][main][root] >>> Non-Heap: 117 MB used / 125 MB commited / 0 MB max <<< [21:02:34]W: [org.apache.ignite:ignite-core] [2021-11-19 21:02:34,434][WARN ][test-runner-#3287%failure.FailureHandlingConfigurationTest%][G] Ignite work directory is not provided, automatically resolved to: /opt/buildagent/work/7bc1c54bc719b67c/work [21:02:34]W: [org.apache.ignite:ignite-core] [2021-11-19 21:02:34,435][WARN ][test-runner-#3287%failure.FailureHandlingConfigurationTest%][G] Consistent ID is not set, it is recommended to set consistent ID for production clusters (use IgniteConfiguration.setConsistentId property) [21:02:34] : [Step 4/5] [2021-11-19 21:02:34,436][INFO ][test-runner-#3287%failure.FailureHandlingConfigurationTest%][FailureHandlingConfigurationTest0] [21:02:34] : [Step 4/5] [21:02:34] : [Step 4/5] >>> __________ ________________ [21:02:34] : [Step 4/5] >>> / _/ ___/ |/ / _/_ __/ __/ [21:02:34] : [Step 4/5] >>> _/ // (7 7 // / / / / _/ [21:02:34] : [Step 4/5] >>> /___/\___/_/|_/___/ /_/ /___/ [21:02:34] : [Step 4/5] >>> [21:02:34] : [Step 4/5] >>> ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:02:34] : [Step 4/5] >>> 2021 Copyright(C) Apache Software Foundation [21:02:34] : [Step 4/5] >>> [21:02:34] : [Step 4/5] >>> Ignite documentation: http://ignite.apache.org [21:02:34] : [Step 4/5] [21:02:34] : [Step 4/5] [2021-11-19 21:02:34,437][INFO ][test-runner-#3287%failure.FailureHandlingConfigurationTest%][FailureHandlingConfigurationTest0] Config URL: n/a [21:02:34] : [Step 4/5] [2021-11-19 21:02:34,438][INFO ][test-runner-#3287%failure.FailureHandlingConfigurationTest%][FailureHandlingConfigurationTest0] IgniteConfiguration [igniteInstanceName=failure.FailureHandlingConfigurationTest0, pubPoolSize=24, svcPoolSize=24, callbackPoolSize=24, stripedPoolSize=24, sysPoolSize=24, mgmtPoolSize=4, dataStreamerPoolSize=24, utilityCachePoolSize=24, utilityCacheKeepAliveTime=60000, p2pPoolSize=2, qryPoolSize=24, buildIdxPoolSize=4, igniteHome=/opt/buildagent/work/7bc1c54bc719b67c, igniteWorkDir=/opt/buildagent/work/7bc1c54bc719b67c/work, mbeanSrv=com.sun.jmx.mbeanserver.JmxMBeanServer@6fe85038, nodeId=c2dd8eec-4814-486b-95a5-512db9400000, marsh=BinaryMarshaller [], marshLocJobs=false, daemon=false, p2pEnabled=true, netTimeout=10000, netCompressionLevel=1, sndRetryDelay=1000, sndRetryCnt=3, metricsHistSize=10000, metricsUpdateFreq=1000, metricsExpTime=9223372036854775807, discoSpi=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=0, ackTimeout=0, marsh=null, reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], segPlc=STOP, segResolveAttempts=2, waitForSegOnStart=true, allResolversPassReq=true, segChkFreq=10000, commSpi=TcpCommunicationSpi [connectGate=org.apache.ignite.spi.communication.tcp.internal.ConnectGateway@19004f12, ctxInitLatch=java.util.concurrent.CountDownLatch@2a4389a[Count = 1], stopping=false, clientPool=null, nioSrvWrapper=null, stateProvider=null], evtSpi=MemoryEventStorageSpi [expireAgeMs=9223372036854775807, expireCnt=10000, filter=null], colSpi=NoopCollisionSpi [], deploySpi=LocalDeploymentSpi [], indexingSpi=org.apache.ignite.spi.indexing.noop.NoopIndexingSpi@3f8f164e, addrRslvr=null, encryptionSpi=org.apache.ignite.spi.encryption.noop.NoopEncryptionSpi@1a68fe9a, tracingSpi=org.apache.ignite.spi.tracing.NoopTracingSpi@646dc498, clientMode=false, rebalanceThreadPoolSize=4, rebalanceTimeout=10000, rebalanceBatchesPrefetchCnt=3, rebalanceThrottle=0, rebalanceBatchSize=524288, txCfg=TransactionConfiguration [txSerEnabled=false, dfltIsolation=REPEATABLE_READ, dfltConcurrency=PESSIMISTIC, dfltTxTimeout=0, txTimeoutOnPartitionMapExchange=0, deadlockTimeout=10000, pessimisticTxLogSize=0, pessimisticTxLogLinger=10000, tmLookupClsName=null, txManagerFactory=null, useJtaSync=false], cacheSanityCheckEnabled=true, discoStartupDelay=60000, deployMode=SHARED, p2pMissedCacheSize=100, locHost=127.0.0.1, timeSrvPortBase=31100, timeSrvPortRange=100, failureDetectionTimeout=10000, sysWorkerBlockedTimeout=30000, clientFailureDetectionTimeout=10000, metricsLogFreq=0, connectorCfg=null, odbcCfg=null, warmupClos=null, atomicCfg=AtomicConfiguration [seqReserveSize=1000, cacheMode=PARTITIONED, backups=1, aff=null, grpName=null], classLdr=null, sslCtxFactory=null, platformCfg=null, binaryCfg=null, memCfg=null, pstCfg=null, dsCfg=DataStorageConfiguration [sysRegionInitSize=41943040, sysRegionMaxSize=104857600, pageSize=0, concLvl=0, dfltDataRegConf=DataRegionConfiguration [name=default, maxSize=268435456, initSize=268435456, swapPath=null, pageEvictionMode=DISABLED, pageReplacementMode=CLOCK, evictionThreshold=0.9, emptyPagesPoolSize=100, metricsEnabled=false, metricsSubIntervalCount=5, metricsRateTimeInterval=60000, persistenceEnabled=true, checkpointPageBufSize=0, lazyMemoryAllocation=true, warmUpCfg=null], dataRegions=null, storagePath=null, checkpointFreq=180000, lockWaitTime=10000, checkpointThreads=4, checkpointWriteOrder=SEQUENTIAL, walHistSize=20, maxWalArchiveSize=1073741824, walSegments=10, walSegmentSize=67108864, walPath=db/wal, walArchivePath=db/wal/archive, cdcWalPath=db/wal/cdc, cdcEnabled=false, metricsEnabled=false, walMode=LOG_ONLY, walTlbSize=131072, walBuffSize=0, walFlushFreq=2000, walFsyncDelay=1000, walRecordIterBuffSize=67108864, alwaysWriteFullPages=false, fileIOFactory=org.apache.ignite.internal.processors.cache.persistence.file.AsyncFileIOFactory@95fe37b, metricsSubIntervalCnt=5, metricsRateTimeInterval=60000, walAutoArchiveAfterInactivity=-1, walForceArchiveTimeout=-1, writeThrottlingEnabled=false, walCompactionEnabled=false, walCompactionLevel=1, checkpointReadLockTimeout=20000, walPageCompression=DISABLED, walPageCompressionLevel=null, dfltWarmUpCfg=null, encCfg=org.apache.ignite.configuration.EncryptionConfiguration@2318a3e4, defragmentationThreadPoolSize=4, minWalArchiveSize=-1], snapshotPath=snapshots, activeOnStart=true, activeOnStartPropSetFlag=false, autoActivation=true, autoActivationPropSetFlag=false, clusterStateOnStart=null, sqlConnCfg=null, cliConnCfg=ClientConnectorConfiguration [host=null, port=10800, portRange=100, sockSndBufSize=0, sockRcvBufSize=0, tcpNoDelay=true, maxOpenCursorsPerConn=128, threadPoolSize=24, selectorCnt=12, idleTimeout=0, handshakeTimeout=10000, jdbcEnabled=true, odbcEnabled=true, thinCliEnabled=true, sslEnabled=false, useIgniteSslCtxFactory=true, sslClientAuth=false, sslCtxFactory=null, thinCliCfg=ThinClientConfiguration [maxActiveTxPerConn=100, maxActiveComputeTasksPerConn=0]], mvccVacuumThreadCnt=2, mvccVacuumFreq=5000, authEnabled=false, failureHnd=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]], commFailureRslvr=null, sqlCfg=SqlConfiguration [longQryWarnTimeout=3000, dfltQryTimeout=0, sqlQryHistSize=1000, validationEnabled=false], asyncContinuationExecutor=null] [21:02:34] : [Step 4/5] [2021-11-19 21:02:34,445][INFO ][test-runner-#3287%failure.FailureHandlingConfigurationTest%][FailureHandlingConfigurationTest0] Daemon mode: off [21:02:34] : [Step 4/5] [2021-11-19 21:02:34,445][INFO ][test-runner-#3287%failure.FailureHandlingConfigurationTest%][FailureHandlingConfigurationTest0] OS: Linux 4.15.0-151-generic amd64 [21:02:34] : [Step 4/5] [2021-11-19 21:02:34,445][INFO ][test-runner-#3287%failure.FailureHandlingConfigurationTest%][FailureHandlingConfigurationTest0] OS user: teamcity [21:02:34] : [Step 4/5] [2021-11-19 21:02:34,446][INFO ][test-runner-#3287%failure.FailureHandlingConfigurationTest%][FailureHandlingConfigurationTest0] PID: 16724 [21:02:34] : [Step 4/5] [2021-11-19 21:02:34,446][INFO ][test-runner-#3287%failure.FailureHandlingConfigurationTest%][FailureHandlingConfigurationTest0] Language runtime: Java Platform API Specification ver. 1.8 [21:02:34] : [Step 4/5] [2021-11-19 21:02:34,446][INFO ][test-runner-#3287%failure.FailureHandlingConfigurationTest%][FailureHandlingConfigurationTest0] VM information: Java(TM) SE Runtime Environment 1.8.0_261-b12 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 25.261-b12 [21:02:34] : [Step 4/5] [2021-11-19 21:02:34,447][INFO ][test-runner-#3287%failure.FailureHandlingConfigurationTest%][FailureHandlingConfigurationTest0] VM total memory: 1.9GB [21:02:34] : [Step 4/5] [2021-11-19 21:02:34,447][INFO ][test-runner-#3287%failure.FailureHandlingConfigurationTest%][FailureHandlingConfigurationTest0] Remote Management [restart: off, REST: off, JMX (remote: off)] [21:02:34] : [Step 4/5] [2021-11-19 21:02:34,447][INFO ][test-runner-#3287%failure.FailureHandlingConfigurationTest%][FailureHandlingConfigurationTest0] Logger: GridTestLog4jLogger [quiet=false, config=null] [21:02:34] : [Step 4/5] [2021-11-19 21:02:34,447][INFO ][test-runner-#3287%failure.FailureHandlingConfigurationTest%][FailureHandlingConfigurationTest0] IGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c [21:02:34] : [Step 4/5] [2021-11-19 21:02:34,448][INFO ][test-runner-#3287%failure.FailureHandlingConfigurationTest%][FailureHandlingConfigurationTest0] VM arguments: [-DIGNITE_DUMP_THREADS_ON_FAILURE=false, -DMono=/usr/bin/mono-sgen, -DMono4.0_x64=/usr/lib/mono/4.0, -DMono4.5_x64=/usr/lib/mono/4.5, -DMonoVersion=6.12.0.90, -DSKIP_BUILD=false, -Dagent.home.dir=/opt/buildagent, -Dagent.name=aitc-lin02_03, -Dagent.ownPort=9090, -Dagent.work.dir=/opt/buildagent/work, -Dbuild.number=95, -Dbuild.vcs.number=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.1=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.GitHubApacheIgnite=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dclassworlds.conf=/opt/buildagent/temp/buildTmp/teamcity.m2.conf, -Dcom.jetbrains.maven.watcher.report.file=/opt/buildagent/temp/buildTmp/maven-build-info.xml, -Djava.io.tmpdir=/opt/buildagent/temp/buildTmp, -Dmaven.home=/opt/buildagent/tools/maven3_6, -Dmaven.multiModuleProjectDirectory=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.agent.cpuBenchmark=457, -Dteamcity.agent.dotnet.agent_url=http://localhost:9090/RPC2, -Dteamcity.agent.dotnet.build_id=6278078, -Dteamcity.auth.password=*******, -Dteamcity.auth.userId=TeamCityBuildId=6278078, -Dteamcity.build.changedFiles.file=/opt/buildagent/temp/buildTmp/changedFiles6342607772318147725.txt, -Dteamcity.build.checkoutDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.build.id=6278078, -Dteamcity.build.properties.file=/opt/buildagent/temp/buildTmp/teamcity.build5164517880467851002.properties, -Dteamcity.build.tempDir=/opt/buildagent/temp/buildTmp, -Dteamcity.build.workingDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.buildConfName=Basic 3, -Dteamcity.buildType.id=IgniteTests24Java8_Basic3, -Dteamcity.configuration.properties.file=/opt/buildagent/temp/buildTmp/teamcity.config5591980786735343870.properties, -Dteamcity.maven.userSettings.path=/opt/buildagent/temp/buildTmp/maven_settings_585072866407032347.xml, -Dteamcity.maven.watcher.home=/opt/buildagent/plugins/mavenPlugin/maven-watcher-jdk16, -Dteamcity.projectName=Ignite Tests 2.x (JDK 8/11), -Dteamcity.runner.properties.file=/opt/buildagent/temp/buildTmp/teamcity.runner9098465561618137420.properties, -Dteamcity.tests.recentlyFailedTests.file=/opt/buildagent/temp/buildTmp/testsToRunFirst3891775683130404069.txt, -Dteamcity.version=2021.2 (build 99542), -ea, -Xms2g, -Xmx2g, -XX:+HeapDumpOnOutOfMemoryError, -DIGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_TEST_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_UPDATE_NOTIFIER=false, -DIGNITE_NO_DISCO_ORDER=true, -DIGNITE_PERFORMANCE_SUGGESTIONS_DISABLED=true, -Djava.net.preferIPv4Stack=true, -DTEST_SCALE_FACTOR=1.0, -DIGNITE_TEST_PROP_LOG4J_FILE=log4j-tc-test.xml, -DIGNITE_QUIET=false, -DIGNITE_MARSHAL_BUFFERS_RECHECK=1000, -Dmaven.repo.local=/opt/buildagent/.m2/repository] [21:02:34] : [Step 4/5] [2021-11-19 21:02:34,452][INFO ][test-runner-#3287%failure.FailureHandlingConfigurationTest%][FailureHandlingConfigurationTest0] System cache's DataRegion size is configured to 40 MB. Use DataStorageConfiguration.systemRegionInitialSize property to change the setting. [21:02:34] : [Step 4/5] [2021-11-19 21:02:34,452][INFO ][test-runner-#3287%failure.FailureHandlingConfigurationTest%][FailureHandlingConfigurationTest0] Configured caches [in 'sysMemPlc' dataRegion: ['ignite-sys-cache']] [21:02:34]W: [org.apache.ignite:ignite-core] [2021-11-19 21:02:34,453][WARN ][test-runner-#3287%failure.FailureHandlingConfigurationTest%][FailureHandlingConfigurationTest0] Peer class loading is enabled (disable it in production for performance and deployment consistency reasons) [21:02:34] : [Step 4/5] [2021-11-19 21:02:34,453][INFO ][test-runner-#3287%failure.FailureHandlingConfigurationTest%][FailureHandlingConfigurationTest0] 3-rd party licenses can be found at: /opt/buildagent/work/7bc1c54bc719b67c/libs/licenses [21:02:34] : [Step 4/5] [2021-11-19 21:02:34,458][INFO ][test-runner-#3287%failure.FailureHandlingConfigurationTest%][IgnitePluginProcessor] Configured plugins: [21:02:34] : [Step 4/5] [2021-11-19 21:02:34,458][INFO ][test-runner-#3287%failure.FailureHandlingConfigurationTest%][IgnitePluginProcessor] ^-- StanByClusterTestProvider 1.0 [21:02:34] : [Step 4/5] [2021-11-19 21:02:34,458][INFO ][test-runner-#3287%failure.FailureHandlingConfigurationTest%][IgnitePluginProcessor] ^-- null [21:02:34] : [Step 4/5] [2021-11-19 21:02:34,458][INFO ][test-runner-#3287%failure.FailureHandlingConfigurationTest%][IgnitePluginProcessor] [21:02:34] : [Step 4/5] [2021-11-19 21:02:34,459][INFO ][test-runner-#3287%failure.FailureHandlingConfigurationTest%][IgnitePluginProcessor] ^-- PageMemory tracker plugin 1.0 [21:02:34] : [Step 4/5] [2021-11-19 21:02:34,459][INFO ][test-runner-#3287%failure.FailureHandlingConfigurationTest%][IgnitePluginProcessor] ^-- null [21:02:34] : [Step 4/5] [2021-11-19 21:02:34,459][INFO ][test-runner-#3287%failure.FailureHandlingConfigurationTest%][IgnitePluginProcessor] [21:02:34] : [Step 4/5] [2021-11-19 21:02:34,459][INFO ][test-runner-#3287%failure.FailureHandlingConfigurationTest%][IgnitePluginProcessor] ^-- TestDistibutedConfigurationPlugin 1.0 [21:02:34] : [Step 4/5] [2021-11-19 21:02:34,459][INFO ][test-runner-#3287%failure.FailureHandlingConfigurationTest%][IgnitePluginProcessor] ^-- null [21:02:34] : [Step 4/5] [2021-11-19 21:02:34,459][INFO ][test-runner-#3287%failure.FailureHandlingConfigurationTest%][IgnitePluginProcessor] [21:02:34] : [Step 4/5] [2021-11-19 21:02:34,460][INFO ][test-runner-#3287%failure.FailureHandlingConfigurationTest%][IgnitePluginProcessor] ^-- NodeValidationPluginProvider 1.0 [21:02:34] : [Step 4/5] [2021-11-19 21:02:34,460][INFO ][test-runner-#3287%failure.FailureHandlingConfigurationTest%][IgnitePluginProcessor] ^-- null [21:02:34] : [Step 4/5] [2021-11-19 21:02:34,460][INFO ][test-runner-#3287%failure.FailureHandlingConfigurationTest%][IgnitePluginProcessor] [21:02:34] : [Step 4/5] [2021-11-19 21:02:34,460][INFO ][test-runner-#3287%failure.FailureHandlingConfigurationTest%][FailureProcessor] Configured failure handler: [hnd=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]] [21:02:34] : [Step 4/5] [2021-11-19 21:02:34,483][INFO ][test-runner-#3287%failure.FailureHandlingConfigurationTest%][TcpCommunicationSpi] Successfully bound communication NIO server to TCP port [port=45050, locHost=/127.0.0.1, selectorsCnt=12, selectorSpins=0, pairedConn=false] [21:02:34]W: [org.apache.ignite:ignite-core] [2021-11-19 21:02:34,483][WARN ][test-runner-#3287%failure.FailureHandlingConfigurationTest%][TcpCommunicationSpi] Message queue limit is set to 0 which may lead to potential OOMEs when running cache operations in FULL_ASYNC or PRIMARY_SYNC modes due to message queues growth on sender and receiver sides. [21:02:34] : [Step 4/5] [2021-11-19 21:02:34,490][INFO ][test-runner-#3287%failure.FailureHandlingConfigurationTest%][GridCollisionManager] Collision resolution is disabled (all jobs will be activated upon arrival). [21:02:34] : [Step 4/5] [2021-11-19 21:02:34,490][INFO ][test-runner-#3287%failure.FailureHandlingConfigurationTest%][FailureHandlingConfigurationTest0] Security status [authentication=off, sandbox=off, tls/ssl=off] [21:02:34] : [Step 4/5] [2021-11-19 21:02:34,492][INFO ][test-runner-#3287%failure.FailureHandlingConfigurationTest%][TestTcpDiscoverySpi] Successfully bound to TCP port [port=47500, localHost=localhost/127.0.0.1, locNodeId=c2dd8eec-4814-486b-95a5-512db9400000] [21:02:34] : [Step 4/5] [2021-11-19 21:02:34,502][INFO ][test-runner-#3287%failure.FailureHandlingConfigurationTest%][PdsFoldersResolver] Successfully created new persistent storage folder [/opt/buildagent/work/7bc1c54bc719b67c/work/db/node00-a03d2459-a29d-48ec-9522-b03e6857c7c1] [21:02:34] : [Step 4/5] [2021-11-19 21:02:34,503][INFO ][test-runner-#3287%failure.FailureHandlingConfigurationTest%][PdsFoldersResolver] Consistent ID used for local node is [a03d2459-a29d-48ec-9522-b03e6857c7c1] according to persistence data storage folders [21:02:34] : [Step 4/5] [2021-11-19 21:02:34,504][INFO ][test-runner-#3287%failure.FailureHandlingConfigurationTest%][MaintenanceProcessor] Resolved store directory for node persistent data: /opt/buildagent/work/7bc1c54bc719b67c/work/db/node00-a03d2459-a29d-48ec-9522-b03e6857c7c1 [21:02:34] : [Step 4/5] [2021-11-19 21:02:34,506][INFO ][test-runner-#3287%failure.FailureHandlingConfigurationTest%][CacheObjectBinaryProcessorImpl] Resolved directory for serialized binary metadata: /opt/buildagent/work/7bc1c54bc719b67c/work/db/binary_meta/node00-a03d2459-a29d-48ec-9522-b03e6857c7c1 [21:02:34] : [Step 4/5] [2021-11-19 21:02:34,514][INFO ][test-runner-#3287%failure.FailureHandlingConfigurationTest%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/node00-a03d2459-a29d-48ec-9522-b03e6857c7c1 [21:02:34] : [Step 4/5] [2021-11-19 21:02:34,514][INFO ][test-runner-#3287%failure.FailureHandlingConfigurationTest%][FileWriteAheadLogManager] Resolved write ahead log work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/node00-a03d2459-a29d-48ec-9522-b03e6857c7c1 [21:02:34] : [Step 4/5] [2021-11-19 21:02:34,515][INFO ][test-runner-#3287%failure.FailureHandlingConfigurationTest%][FileWriteAheadLogManager] Resolved write ahead log archive directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/node00-a03d2459-a29d-48ec-9522-b03e6857c7c1 [21:02:35] : [Step 4/5] [2021-11-19 21:02:35,304][INFO ][test-runner-#3287%failure.FailureHandlingConfigurationTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/node00-a03d2459-a29d-48ec-9522-b03e6857c7c1/0000000000000000.wal [21:02:35] : [Step 4/5] [2021-11-19 21:02:35,305][INFO ][test-runner-#3287%failure.FailureHandlingConfigurationTest%][FileHandleManagerImpl] Initialized write-ahead log manager [mode=LOG_ONLY] [21:02:35] : [Step 4/5] [2021-11-19 21:02:35,311][INFO ][test-runner-#3287%failure.FailureHandlingConfigurationTest%][GridCacheDatabaseSharedManager] Configured data regions initialized successfully [total=5] [21:02:35] : [Step 4/5] [2021-11-19 21:02:35,312][INFO ][test-runner-#3287%failure.FailureHandlingConfigurationTest%][IgniteSnapshotManager] Resolved snapshot work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/snapshots [21:02:35] : [Step 4/5] [2021-11-19 21:02:35,313][INFO ][test-runner-#3287%failure.FailureHandlingConfigurationTest%][IgniteSnapshotManager] Resolved temp directory for snapshot creation: /opt/buildagent/work/7bc1c54bc719b67c/work/db/node00-a03d2459-a29d-48ec-9522-b03e6857c7c1/snp [21:02:35] : [Step 4/5] [2021-11-19 21:02:35,317][INFO ][test-runner-#3287%failure.FailureHandlingConfigurationTest%][ClientListenerProcessor] Client connector processor has started on TCP port 10800 [21:02:35] : [Step 4/5] [2021-11-19 21:02:35,321][INFO ][test-runner-#3287%failure.FailureHandlingConfigurationTest%][FailureHandlingConfigurationTest0] Non-loopback local IPs: 172.17.0.4 [21:02:35] : [Step 4/5] [2021-11-19 21:02:35,321][INFO ][test-runner-#3287%failure.FailureHandlingConfigurationTest%][FailureHandlingConfigurationTest0] Enabled local MACs: 0242AC110004 [21:02:35] : [Step 4/5] [2021-11-19 21:02:35,322][INFO ][test-runner-#3287%failure.FailureHandlingConfigurationTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:02:35] : [Step 4/5] [2021-11-19 21:02:35,324][INFO ][test-runner-#3287%failure.FailureHandlingConfigurationTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:02:35] : [Step 4/5] [2021-11-19 21:02:35,324][INFO ][test-runner-#3287%failure.FailureHandlingConfigurationTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:02:35] : [Step 4/5] [2021-11-19 21:02:35,327][INFO ][test-runner-#3287%failure.FailureHandlingConfigurationTest%][GridCacheDatabaseSharedManager] Applying lost metastore updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:02:35] : [Step 4/5] [2021-11-19 21:02:35,328][INFO ][test-runner-#3287%failure.FailureHandlingConfigurationTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=0 ms] [21:02:35] : [Step 4/5] [2021-11-19 21:02:35,328][INFO ][test-runner-#3287%failure.FailureHandlingConfigurationTest%][GridCacheProcessor] Restoring partition state for local groups. [21:02:35] : [Step 4/5] [2021-11-19 21:02:35,328][INFO ][test-runner-#3287%failure.FailureHandlingConfigurationTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=0, partitionsProcessed=0, time=10ms] [21:02:35] : [Step 4/5] [2021-11-19 21:02:35,329][INFO ][test-runner-#3287%failure.FailureHandlingConfigurationTest%][GridEncryptionManager] Encryption keys loaded from metastore. [grps=, masterKeyName=null] [21:02:35] : [Step 4/5] [2021-11-19 21:02:35,330][INFO ][test-runner-#3287%failure.FailureHandlingConfigurationTest%][ClusterProcessor] Cluster ID and tag has been read from metastorage: null [21:02:35] : [Step 4/5] [2021-11-19 21:02:35,331][INFO ][test-runner-#3287%failure.FailureHandlingConfigurationTest%][IgniteClusterImpl] Shutdown policy was updated [oldVal=null, newVal=null] [21:02:35] : [Step 4/5] [2021-11-19 21:02:35,331][INFO ][test-runner-#3287%failure.FailureHandlingConfigurationTest%][GridCacheDatabaseSharedManager] Checkpoint frequency deviation changed [oldVal=null, newVal=null] [21:02:35] : [Step 4/5] [2021-11-19 21:02:35,341][INFO ][test-runner-#3287%failure.FailureHandlingConfigurationTest%][FilePageStoreManager] Cleanup cache stores [total=1, left=0, cleanFiles=false] [21:02:35] : [Step 4/5] [2021-11-19 21:02:35,344][INFO ][test-runner-#3287%failure.FailureHandlingConfigurationTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:02:35] : [Step 4/5] [2021-11-19 21:02:35,344][INFO ][test-runner-#3287%failure.FailureHandlingConfigurationTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:02:35] : [Step 4/5] [2021-11-19 21:02:35,346][INFO ][test-runner-#3287%failure.FailureHandlingConfigurationTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:02:35] : [Step 4/5] [2021-11-19 21:02:35,347][INFO ][test-runner-#3287%failure.FailureHandlingConfigurationTest%][GridCacheDatabaseSharedManager] Data Regions Started: 5 [21:02:35] : [Step 4/5] [2021-11-19 21:02:35,347][INFO ][test-runner-#3287%failure.FailureHandlingConfigurationTest%][GridCacheDatabaseSharedManager] ^-- sysMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:02:35] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:02:35] : [Step 4/5] ^-- default region [type=default, persistence=true, lazyAlloc=true, [21:02:35] : [Step 4/5] ... initCfg=256MB, maxCfg=256MB, usedRam=0MB, freeRam=100%, allocRam=0MB, allocTotal=0MB] [21:02:35] : [Step 4/5] ^-- metastoreMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:02:35] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:02:35] : [Step 4/5] ^-- TxLog region [type=internal, persistence=true, lazyAlloc=false, [21:02:35] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:02:35] : [Step 4/5] ^-- volatileDsMemPlc region [type=user, persistence=false, lazyAlloc=true, [21:02:35] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB] [21:02:35] : [Step 4/5] ^-- Ignite persistence [used=0MB] [21:02:35] : [Step 4/5] [21:02:35] : [Step 4/5] [2021-11-19 21:02:35,349][INFO ][test-runner-#3287%failure.FailureHandlingConfigurationTest%][GridCacheDatabaseSharedManager] Starting binary memory restore for: [-2100569601] [21:02:35] : [Step 4/5] [2021-11-19 21:02:35,357][INFO ][test-runner-#3287%failure.FailureHandlingConfigurationTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:02:35] : [Step 4/5] [2021-11-19 21:02:35,357][INFO ][test-runner-#3287%failure.FailureHandlingConfigurationTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:02:35] : [Step 4/5] [2021-11-19 21:02:35,359][INFO ][test-runner-#3287%failure.FailureHandlingConfigurationTest%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/node00-a03d2459-a29d-48ec-9522-b03e6857c7c1/0000000000000000.wal, offset=0, ver=2] [21:02:35] : [Step 4/5] [2021-11-19 21:02:35,363][INFO ][test-runner-#3287%failure.FailureHandlingConfigurationTest%][GridCacheProcessor] Started cache in recovery mode [name=ignite-sys-cache, id=-2100569601, dataRegionName=sysMemPlc, mode=REPLICATED, atomicity=TRANSACTIONAL, backups=2147483647, mvcc=false] [21:02:35] : [Step 4/5] [2021-11-19 21:02:35,364][INFO ][test-runner-#3287%failure.FailureHandlingConfigurationTest%][GridCacheDatabaseSharedManager] Binary recovery performed in 15 ms. [21:02:35] : [Step 4/5] [2021-11-19 21:02:35,364][INFO ][test-runner-#3287%failure.FailureHandlingConfigurationTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:02:35] : [Step 4/5] [2021-11-19 21:02:35,365][INFO ][test-runner-#3287%failure.FailureHandlingConfigurationTest%][GridCacheDatabaseSharedManager] Applying lost cache updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:02:35] : [Step 4/5] [2021-11-19 21:02:35,423][INFO ][test-runner-#3287%failure.FailureHandlingConfigurationTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=61 ms] [21:02:35] : [Step 4/5] [2021-11-19 21:02:35,424][INFO ][test-runner-#3287%failure.FailureHandlingConfigurationTest%][GridCacheProcessor] Restoring partition state for local groups. [21:02:35] : [Step 4/5] [2021-11-19 21:02:35,429][INFO ][test-runner-#3287%failure.FailureHandlingConfigurationTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=1, partitionsProcessed=100, time=0ms] [21:02:35] : [Step 4/5] [2021-11-19 21:02:35,887][INFO ][disco-notifier-worker-#3399%failure.FailureHandlingConfigurationTest0%][MvccProcessorImpl] Assigned mvcc coordinator [crd=MvccCoordinator [topVer=AffinityTopologyVersion [topVer=1, minorTopVer=0], nodeId=c2dd8eec-4814-486b-95a5-512db9400000, ver=1637344955884, local=true, initialized=false]] [21:02:35] : [Step 4/5] [2021-11-19 21:02:35,888][INFO ][sys-#3375%failure.FailureHandlingConfigurationTest0%][ClusterProcessor] Writing cluster ID and tag to metastorage on ready for write ClusterIdAndTag [id=c83e42cf-4864-4b00-a25e-a5e8d2cd0c17, tag=happy_diffie] [21:02:35] : [Step 4/5] [2021-11-19 21:02:35,889][INFO ][disco-notifier-worker-#3399%failure.FailureHandlingConfigurationTest0%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustEnabled' was changed from 'null' to 'false' [21:02:35] : [Step 4/5] [2021-11-19 21:02:35,890][INFO ][disco-notifier-worker-#3399%failure.FailureHandlingConfigurationTest0%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustTimeout' was changed from 'null' to '300000' [21:02:35] : [Step 4/5] [2021-11-19 21:02:35,891][INFO ][disco-notifier-worker-#3399%failure.FailureHandlingConfigurationTest0%][IgniteTxManager] Transactions parameter 'longOperationsDumpTimeout' was changed from 'null' to '60000' [21:02:35] : [Step 4/5] [2021-11-19 21:02:35,891][INFO ][disco-notifier-worker-#3399%failure.FailureHandlingConfigurationTest0%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpThreshold' was changed from 'null' to '0' [21:02:35] : [Step 4/5] [2021-11-19 21:02:35,892][INFO ][disco-notifier-worker-#3399%failure.FailureHandlingConfigurationTest0%][ClusterProcessor] happy_diffie [21:02:35] : [Step 4/5] [2021-11-19 21:02:35,893][INFO ][disco-notifier-worker-#3399%failure.FailureHandlingConfigurationTest0%][IgniteTxManager] Transactions parameter 'transactionTimeDumpSamplesCoefficient' was changed from 'null' to '0.0' [21:02:35] : [Step 4/5] [2021-11-19 21:02:35,893][INFO ][disco-notifier-worker-#3399%failure.FailureHandlingConfigurationTest0%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpSamplesPerSecondLimit' was changed from 'null' to '5' [21:02:35] : [Step 4/5] [2021-11-19 21:02:35,894][INFO ][disco-notifier-worker-#3399%failure.FailureHandlingConfigurationTest0%][IgniteTxManager] Transactions parameter 'collisionsDumpInterval' was changed from 'null' to '1000' [21:02:35] : [Step 4/5] [2021-11-19 21:02:35,894][INFO ][disco-notifier-worker-#3399%failure.FailureHandlingConfigurationTest0%][IgniteTxManager] Transactions parameter 'txOwnerDumpRequestsAllowed' was changed from 'null' to 'true' [21:02:35] : [Step 4/5] [2021-11-19 21:02:35,895][INFO ][disco-notifier-worker-#3399%failure.FailureHandlingConfigurationTest0%][GridCacheDatabaseSharedManager] Historical rebalance WAL threshold changed [property=historical.rebalance.threshold, oldVal=null, newVal=500] [21:02:35] : [Step 4/5] [2021-11-19 21:02:35,901][INFO ][test-runner-#3287%failure.FailureHandlingConfigurationTest%][FailureHandlingConfigurationTest0] To start Console Management & Monitoring run ignitevisorcmd.{sh|bat} [21:02:35] : [Step 4/5] [2021-11-19 21:02:35,902][INFO ][test-runner-#3287%failure.FailureHandlingConfigurationTest%][FailureHandlingConfigurationTest0] [21:02:35] : [Step 4/5] [21:02:35] : [Step 4/5] >>> +-------------------------------------------+ [21:02:35] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:02:35] : [Step 4/5] >>> +-------------------------------------------+ [21:02:35] : [Step 4/5] >>> OS name: Linux 4.15.0-151-generic amd64 [21:02:35] : [Step 4/5] >>> CPU(s): 24 [21:02:35] : [Step 4/5] >>> Heap: 2.0GB [21:02:35] : [Step 4/5] >>> VM name: 16724@c4dfe9a430b2 [21:02:35] : [Step 4/5] >>> Ignite instance name: failure.FailureHandlingConfigurationTest0 [21:02:35] : [Step 4/5] >>> Local node [ID=C2DD8EEC-4814-486B-95A5-512DB9400000, order=1, clientMode=false] [21:02:35] : [Step 4/5] >>> Local node addresses: [127.0.0.1] [21:02:35] : [Step 4/5] >>> Local ports: TCP:10800 TCP:45050 TCP:47500 [21:02:35] : [Step 4/5] [21:02:35] : [Step 4/5] [2021-11-19 21:02:35,903][INFO ][test-runner-#3287%failure.FailureHandlingConfigurationTest%][FailureHandlingConfigurationTest0] >>> Ignite cluster is in INACTIVE state (limited functionality available). Use control.(sh|bat) script or IgniteCluster.state(ClusterState.ACTIVE) to change the state. [21:02:35] : [Step 4/5] [2021-11-19 21:02:35,904][INFO ][test-runner-#3287%failure.FailureHandlingConfigurationTest%][GridDiscoveryManager] Topology snapshot [ver=1, locNode=c2dd8eec, servers=1, clients=0, state=INACTIVE, CPUs=24, offheap=0.25GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=c2dd8eec-4814-486b-95a5-512db9400000, consistentId=a03d2459-a29d-48ec-9522-b03e6857c7c1, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:02:35] : [Step 4/5] [2021-11-19 21:02:35,905][INFO ][test-runner-#3287%failure.FailureHandlingConfigurationTest%][G] Node started : [stage="Configure system pool" (0 ms),stage="Start managers" (69 ms),stage="Configure binary metadata" (3 ms),stage="Start processors" (811 ms),stage="Start 'StanByClusterTestProvider' plugin" (0 ms),stage="Start 'PageMemory tracker plugin' plugin" (0 ms),stage="Start 'TestDistibutedConfigurationPlugin' plugin" (0 ms),stage="Start 'NodeValidationPluginProvider' plugin" (0 ms),stage="Init metastore" (20 ms),stage="Init and start regions" (8 ms),stage="Restore binary memory" (15 ms),stage="Restore logical state" (65 ms),stage="Finish recovery" (452 ms),stage="Join topology" (4 ms),stage="Await transition" (1 ms),stage="Await exchange" (15 ms),stage="Total time" (1463 ms)] [21:02:35] : [Step 4/5] [2021-11-19 21:02:35,906][INFO ][test-runner-#3287%failure.FailureHandlingConfigurationTest%][root] Node started with the following configuration [id=c2dd8eec-4814-486b-95a5-512db9400000, marshaller=BinaryMarshaller [], discovery=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=5000, ackTimeout=5000, marsh=JdkMarshaller [clsFilter=org.apache.ignite.marshaller.MarshallerUtils$1@28f9ccc], reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], binaryCfg=null, lateAff=true] [21:02:35] : [Step 4/5] [2021-11-19 21:02:35,907][INFO ][test-runner-#3287%failure.FailureHandlingConfigurationTest%][GridClusterStateProcessor] Sending activate cluster request with BaselineTopology BaselineTopology [id=0, branchingHash=-2811062, branchingType='New BaselineTopology', baselineNodes=[a03d2459-a29d-48ec-9522-b03e6857c7c1]] [21:02:35] : [Step 4/5] [2021-11-19 21:02:35,909][INFO ][disco-notifier-worker-#3399%failure.FailureHandlingConfigurationTest0%][GridClusterStateProcessor] Received activate cluster request with BaselineTopology[id=0] initiator node ID: c2dd8eec-4814-486b-95a5-512db9400000 [21:02:35] : [Step 4/5] [2021-11-19 21:02:35,909][INFO ][disco-notifier-worker-#3399%failure.FailureHandlingConfigurationTest0%][GridClusterStateProcessor] Started state transition: activate cluster [21:02:35] : [Step 4/5] [2021-11-19 21:02:35,910][INFO ][exchange-worker-#3404%failure.FailureHandlingConfigurationTest0%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=1, minorTopVer=1], crd=true, evt=DISCOVERY_CUSTOM_EVT, evtNode=c2dd8eec-4814-486b-95a5-512db9400000, customEvt=ChangeGlobalStateMessage [id=d0aac593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqId=5af7cb66-650a-4089-89b4-b3baa4f03458, initiatingNodeId=c2dd8eec-4814-486b-95a5-512db9400000, state=ACTIVE, baselineTopology=BaselineTopology [id=0, branchingHash=-2811062, branchingType='New BaselineTopology', baselineNodes=[a03d2459-a29d-48ec-9522-b03e6857c7c1]], forceChangeBaselineTopology=false, timestamp=1637344955907, forceDeactivation=true], allowMerge=false, exchangeFreeSwitch=false] [21:02:35] : [Step 4/5] [2021-11-19 21:02:35,911][INFO ][exchange-worker-#3404%failure.FailureHandlingConfigurationTest0%][GridDhtPartitionsExchangeFuture] Start activation process [nodeId=c2dd8eec-4814-486b-95a5-512db9400000, client=false, topVer=AffinityTopologyVersion [topVer=1, minorTopVer=1]]. New state: ACTIVE [21:02:35] : [Step 4/5] [2021-11-19 21:02:35,911][INFO ][exchange-worker-#3404%failure.FailureHandlingConfigurationTest0%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/node00-a03d2459-a29d-48ec-9522-b03e6857c7c1 [21:02:35] : [Step 4/5] [2021-11-19 21:02:35,913][INFO ][exchange-worker-#3404%failure.FailureHandlingConfigurationTest0%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/node00-a03d2459-a29d-48ec-9522-b03e6857c7c1/0000000000000000.wal, offset=8795, ver=2] [21:02:35] : [Step 4/5] [2021-11-19 21:02:35,915][INFO ][exchange-worker-#3404%failure.FailureHandlingConfigurationTest0%][GridClusterStateProcessor] Writing BaselineTopology[id=0] [21:02:35] : [Step 4/5] [2021-11-19 21:02:35,916][INFO ][exchange-worker-#3404%failure.FailureHandlingConfigurationTest0%][GridCacheDatabaseSharedManager] Finish recovery performed in 4 ms. [21:02:35] : [Step 4/5] [2021-11-19 21:02:35,917][INFO ][exchange-worker-#3404%failure.FailureHandlingConfigurationTest0%][msg] Components activation performed in 6 ms. [21:02:35] : [Step 4/5] [2021-11-19 21:02:35,917][INFO ][exchange-worker-#3404%failure.FailureHandlingConfigurationTest0%][GridCacheProcessor] Finished recovery for cache [cache=ignite-sys-cache, grp=ignite-sys-cache, startVer=AffinityTopologyVersion [topVer=1, minorTopVer=1]] [21:02:35] : [Step 4/5] [2021-11-19 21:02:35,918][INFO ][exchange-worker-#3404%failure.FailureHandlingConfigurationTest0%][GridDhtPartitionsExchangeFuture] Successfully activated caches [nodeId=c2dd8eec-4814-486b-95a5-512db9400000, client=false, topVer=AffinityTopologyVersion [topVer=1, minorTopVer=1], newState=ACTIVE] [21:02:35] : [Step 4/5] [2021-11-19 21:02:35,919][INFO ][exchange-worker-#3404%failure.FailureHandlingConfigurationTest0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=1, minorTopVer=1], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:02:35] : [Step 4/5] [2021-11-19 21:02:35,927][INFO ][exchange-worker-#3404%failure.FailureHandlingConfigurationTest0%][GridDhtPartitionsExchangeFuture] finishExchangeOnCoordinator [topVer=AffinityTopologyVersion [topVer=1, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=1, minorTopVer=1]] [21:02:35] : [Step 4/5] [2021-11-19 21:02:35,930][INFO ][db-checkpoint-thread-#3411%failure.FailureHandlingConfigurationTest0%][Checkpointer] Checkpoint started [checkpointId=ca38463f-d3ef-4755-be25-878686423e4f, startPtr=WALPointer [idx=0, fileOff=66541, len=1963], checkpointBeforeLockTime=2ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=1ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=1ms, pages=16, reason='node started'] [21:02:35] : [Step 4/5] [2021-11-19 21:02:35,932][INFO ][exchange-worker-#3404%failure.FailureHandlingConfigurationTest0%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=1, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=1, minorTopVer=1], err=null, rebalanced=true, wasRebalanced=false] [21:02:35] : [Step 4/5] [2021-11-19 21:02:35,937][INFO ][disco-notifier-worker-#3399%failure.FailureHandlingConfigurationTest0%][GridClusterStateProcessor] Received state change finish message: ACTIVE [21:02:35] : [Step 4/5] [2021-11-19 21:02:35,937][INFO ][disco-notifier-worker-#3399%failure.FailureHandlingConfigurationTest0%][GridClusterStateProcessor] Cluster state was changed from INACTIVE to ACTIVE [21:02:35] : [Step 4/5] [2021-11-19 21:02:35,939][INFO ][exchange-worker-#3404%failure.FailureHandlingConfigurationTest0%][GridCacheProcessor] Finish proxy initialization, cacheName=ignite-sys-cache, localNodeId=c2dd8eec-4814-486b-95a5-512db9400000 [21:02:35] : [Step 4/5] [2021-11-19 21:02:35,939][INFO ][sys-#3393%failure.FailureHandlingConfigurationTest0%][DistributedBaselineConfiguration] Baseline auto-adjust is 'disabled' with timeout='300000' ms [21:02:35] : [Step 4/5] [21:02:35[202] >>1-> Stop11ping t-1est9 : Failure21:02:35HandlingConfi,939][INgurationFO ][exchange-worker-#3404%failure.FailureHandlingConfigurationTest0%][GridDhtPartitionsExchanTest#tesgeFutCfgture] Completed partition exchange [localNode=c2dd8eec-4814-Para486b-95a5-512db9400000, emsPropagation in 151xchange=Gr0 msidDhtP <<< [21:02:35] : [Step 4/5] artitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=1, minorTopVer=1], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=c2dd8eec-4814-486b-95a5-512db9400000, consistentId=a03d2459-a29d-48ec-9522-b03e6857c7c1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637344955873, loc=true, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=1, minorTopVer=1]] [21:02:35] : [Step 4/5] [2021-11-19 21:02:35,941][INFO ][main][root] >>> Stopping test: FailureHandlingConfigurationTest#testCfgParamsPropagation in 1510 ms <<< [21:02:35] : [Step 4/5] [2021-11-19 21:[21:0202:35] >>> Heap: 412 MB used / 1944 MB commited / 1944 MB max <<< [21:02:35] : [Step 4/5] :35,940][INFO ][sys-#3393%failure.FailureHandlingConfigurationTest0%][GridClusterStateProcessor] Successfully performed final activation steps [nodeId=c2dd8eec-4814-486b-95a5-512db9400000, client=false, topVer=AffinityTopologyVersion [topVer=1, minorTopVer=1]] [21:02:35] : [Step 4/5] [2021-11-19 21:02:35,943][INFO ][main][root] >>> Heap: 412 MB used / 1944 MB commited / 1944 MB max <<< [21:02:35] : [Step 4/5] [21:02:35] >>[20> Non-Heap: 117 MB used / 125 MB commited / 0 MB max <<< [21:02:35] : [Step 4/5] 21-11-19 21:02:35,942][INFO ][exchange-worker-#3404%failure.FailureHandlingConfigurationTest0%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=1, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=1, minorTopVer=1], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (1 ms), stage="Update caches registry" (6 ms), stage="Start caches" (0 ms), stage="Affinity initialization on cache group start" (0 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Restore partition states" (0 ms), stage="After states restored callback" (7 ms), stage="WAL history reservation" (0 ms), stage="Waiting for all single messages" (0 ms), stage="Affinity recalculation (crd)" (0 ms), stage="Collect update counters and create affinity messages" (0 ms), stage="Assign partitions states" (0 ms), stage="Validate partitions states" (0 ms), stage="Ideal affinity diff calculation (enforced)" (0 ms), stage="Apply update counters" (0 ms), stage="Full message preparing" (2 ms), stage="Full message sending" (0 ms), stage="State finish message sending" (0 ms), stage="Detect lost partitions" (6 ms), stage="Exchange done" (4 ms), stage="Total time" (26 ms)] [21:02:35] : [Step 4/5] [2021-11-19 21:02:35,943][INFO ][main][root] >>> Non-Heap: 117 MB used / 125 MB commited / 0 MB max <<< [21:02:35] : [Step 4/5] [2021-11-19 21:02:35,945][INFO ][exchange-worker-#3404%failure.FailureHandlingConfigurationTest0%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=1, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=1, minorTopVer=1], stage="Affinity initialization on cache group start [grp=ignite-sys-cache]" (0 ms) (parent=Affinity initialization on cache group start), stage="Affinity centralized initialization (crd) [grp=ignite-sys-cache, crd=true]" (0 ms) (parent=Determine exchange type), stage="Restore partition states [grp=ignite-sys-cache]" (0 ms) (parent=Restore partition states), stage="Affinity recalculation (partitions availability) [grp=ignite-sys-cache]" (0 ms) (parent=Ideal affinity diff calculation (enforced))] [21:02:35] : [Step 4/5] [2021-11-19 21:02:35,947][INFO ][exchange-worker-#3404%failure.FailureHandlingConfigurationTest0%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=1, minorTopVer=1], crd=true] [21:02:35] : [Step 4/5] [2021-11-19 21:02:35,945][INFO ][main][root] >>> Stopping grid [name=failure.FailureHandlingConfigurationTest0, id=c2dd8eec-4814-486b-95a5-512db9400000] [21:02:35] : [Step 4/5] [2021-11-19 21:02:35,947][INFO ][exchange-worker-#3404%failure.FailureHandlingConfigurationTest0%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=1, minorTopVer=1], force=false, evt=DISCOVERY_CUSTOM_EVT, node=c2dd8eec-4814-486b-95a5-512db9400000] [21:02:35] : [Step 4/5] [2021-11-19 21:02:35,956][INFO ][db-checkpoint-thread-#3411%failure.FailureHandlingConfigurationTest0%][Checkpointer] Checkpoint finished [cpId=ca38463f-d3ef-4755-be25-878686423e4f, pages=16, markPos=WALPointer [idx=0, fileOff=66541, len=1963], walSegmentsCovered=[], markDuration=4ms, pagesWrite=7ms, fsync=18ms, total=31ms] [21:02:35] : [Step 4/5] [2021-11-19 21:02:35,961][INFO ][main][GridCacheProcessor] Stopped cache [cacheName=ignite-sys-cache] [21:02:36] : [Step 4/5] [2021-11-19 21:02:36,458][INFO ][main][FilePageStoreManager] Cleanup cache stores [total=3, left=0, cleanFiles=false] [21:02:36] : [Step 4/5] [2021-11-19 21:02:36,466][INFO ][main][FailureHandlingConfigurationTest0] [21:02:36] : [Step 4/5] [21:02:36] : [Step 4/5] >>> +------------------------------------------------------+ [21:02:36] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV stopped OK [21:02:36] : [Step 4/5] >>> +------------------------------------------------------+ [21:02:36] : [Step 4/5] >>> Ignite instance name: failure.FailureHandlingConfigurationTest0 [21:02:36] : [Step 4/5] >>> Grid uptime: 00:00:00.565 [21:02:36] : [Step 4/5] [21:02:36] : [Step 4/5] [21:02:36] : [Step 4/5] [21:02:36] >>> Starting test: FailureHandlingConfigurationTest#testNegativeParamValues <<< [21:02:36] : [Step 4/5] [2021-11-19 21:02:36,519][INFO ][main][root] >>> Starting test: FailureHandlingConfigurationTest#testNegativeParamValues <<< [21:02:36] : [Step 4/5] [21:02:36] >>> Heap: 413 MB used / 1944 MB commited / 1944 MB max <<< [21:02:36] : [Step 4/5] [2021-11-19 21:02:36,519][INFO ][main][root] >>> Heap: 413 MB used / 1944 MB commited / 1944 MB max <<< [21:02:36] : [Step 4/5] [21:02:36] >>> Non-Heap: 117 MB used / 125 MB commited / 0 MB max <<< [21:02:36] : [Step 4/5] [2021-11-19 21:02:36,519][INFO ][main][root] >>> Non-Heap: 117 MB used / 125 MB commited / 0 MB max <<< [21:02:36]W: [org.apache.ignite:ignite-core] [2021-11-19 21:02:36,525][WARN ][test-runner-#3420%failure.FailureHandlingConfigurationTest%][G] Ignite work directory is not provided, automatically resolved to: /opt/buildagent/work/7bc1c54bc719b67c/work [21:02:36]W: [org.apache.ignite:ignite-core] [2021-11-19 21:02:36,526][WARN ][test-runner-#3420%failure.FailureHandlingConfigurationTest%][G] Consistent ID is not set, it is recommended to set consistent ID for production clusters (use IgniteConfiguration.setConsistentId property) [21:02:36] : [Step 4/5] [2021-11-19 21:02:36,527][INFO ][test-runner-#3420%failure.FailureHandlingConfigurationTest%][FailureHandlingConfigurationTest0] [21:02:36] : [Step 4/5] [21:02:36] : [Step 4/5] >>> __________ ________________ [21:02:36] : [Step 4/5] >>> / _/ ___/ |/ / _/_ __/ __/ [21:02:36] : [Step 4/5] >>> _/ // (7 7 // / / / / _/ [21:02:36] : [Step 4/5] >>> /___/\___/_/|_/___/ /_/ /___/ [21:02:36] : [Step 4/5] >>> [21:02:36] : [Step 4/5] >>> ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:02:36] : [Step 4/5] >>> 2021 Copyright(C) Apache Software Foundation [21:02:36] : [Step 4/5] >>> [21:02:36] : [Step 4/5] >>> Ignite documentation: http://ignite.apache.org [21:02:36] : [Step 4/5] [21:02:36] : [Step 4/5] [2021-11-19 21:02:36,528][INFO ][test-runner-#3420%failure.FailureHandlingConfigurationTest%][FailureHandlingConfigurationTest0] Config URL: n/a [21:02:36] : [Step 4/5] [2021-11-19 21:02:36,529][INFO ][test-runner-#3420%failure.FailureHandlingConfigurationTest%][FailureHandlingConfigurationTest0] IgniteConfiguration [igniteInstanceName=failure.FailureHandlingConfigurationTest0, pubPoolSize=24, svcPoolSize=24, callbackPoolSize=24, stripedPoolSize=24, sysPoolSize=24, mgmtPoolSize=4, dataStreamerPoolSize=24, utilityCachePoolSize=24, utilityCacheKeepAliveTime=60000, p2pPoolSize=2, qryPoolSize=24, buildIdxPoolSize=4, igniteHome=/opt/buildagent/work/7bc1c54bc719b67c, igniteWorkDir=/opt/buildagent/work/7bc1c54bc719b67c/work, mbeanSrv=com.sun.jmx.mbeanserver.JmxMBeanServer@6fe85038, nodeId=982396f4-ac9d-49b5-835c-74204a400000, marsh=BinaryMarshaller [], marshLocJobs=false, daemon=false, p2pEnabled=true, netTimeout=10000, netCompressionLevel=1, sndRetryDelay=1000, sndRetryCnt=3, metricsHistSize=10000, metricsUpdateFreq=1000, metricsExpTime=9223372036854775807, discoSpi=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=0, ackTimeout=0, marsh=null, reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], segPlc=STOP, segResolveAttempts=2, waitForSegOnStart=true, allResolversPassReq=true, segChkFreq=10000, commSpi=TcpCommunicationSpi [connectGate=org.apache.ignite.spi.communication.tcp.internal.ConnectGateway@15acf1db, ctxInitLatch=java.util.concurrent.CountDownLatch@1cb59f35[Count = 1], stopping=false, clientPool=null, nioSrvWrapper=null, stateProvider=null], evtSpi=MemoryEventStorageSpi [expireAgeMs=9223372036854775807, expireCnt=10000, filter=null], colSpi=NoopCollisionSpi [], deploySpi=LocalDeploymentSpi [], indexingSpi=org.apache.ignite.spi.indexing.noop.NoopIndexingSpi@5f4575ae, addrRslvr=null, encryptionSpi=org.apache.ignite.spi.encryption.noop.NoopEncryptionSpi@5dd2380c, tracingSpi=org.apache.ignite.spi.tracing.NoopTracingSpi@8b63989, clientMode=false, rebalanceThreadPoolSize=4, rebalanceTimeout=10000, rebalanceBatchesPrefetchCnt=3, rebalanceThrottle=0, rebalanceBatchSize=524288, txCfg=TransactionConfiguration [txSerEnabled=false, dfltIsolation=REPEATABLE_READ, dfltConcurrency=PESSIMISTIC, dfltTxTimeout=0, txTimeoutOnPartitionMapExchange=0, deadlockTimeout=10000, pessimisticTxLogSize=0, pessimisticTxLogLinger=10000, tmLookupClsName=null, txManagerFactory=null, useJtaSync=false], cacheSanityCheckEnabled=true, discoStartupDelay=60000, deployMode=SHARED, p2pMissedCacheSize=100, locHost=127.0.0.1, timeSrvPortBase=31100, timeSrvPortRange=100, failureDetectionTimeout=10000, sysWorkerBlockedTimeout=-1, clientFailureDetectionTimeout=10000, metricsLogFreq=0, connectorCfg=null, odbcCfg=null, warmupClos=null, atomicCfg=AtomicConfiguration [seqReserveSize=1000, cacheMode=PARTITIONED, backups=1, aff=null, grpName=null], classLdr=null, sslCtxFactory=null, platformCfg=null, binaryCfg=null, memCfg=null, pstCfg=null, dsCfg=DataStorageConfiguration [sysRegionInitSize=41943040, sysRegionMaxSize=104857600, pageSize=0, concLvl=0, dfltDataRegConf=DataRegionConfiguration [name=default, maxSize=268435456, initSize=268435456, swapPath=null, pageEvictionMode=DISABLED, pageReplacementMode=CLOCK, evictionThreshold=0.9, emptyPagesPoolSize=100, metricsEnabled=false, metricsSubIntervalCount=5, metricsRateTimeInterval=60000, persistenceEnabled=true, checkpointPageBufSize=0, lazyMemoryAllocation=true, warmUpCfg=null], dataRegions=null, storagePath=null, checkpointFreq=180000, lockWaitTime=10000, checkpointThreads=4, checkpointWriteOrder=SEQUENTIAL, walHistSize=20, maxWalArchiveSize=1073741824, walSegments=10, walSegmentSize=67108864, walPath=db/wal, walArchivePath=db/wal/archive, cdcWalPath=db/wal/cdc, cdcEnabled=false, metricsEnabled=false, walMode=LOG_ONLY, walTlbSize=131072, walBuffSize=0, walFlushFreq=2000, walFsyncDelay=1000, walRecordIterBuffSize=67108864, alwaysWriteFullPages=false, fileIOFactory=org.apache.ignite.internal.processors.cache.persistence.file.AsyncFileIOFactory@1c5409b3, metricsSubIntervalCnt=5, metricsRateTimeInterval=60000, walAutoArchiveAfterInactivity=-1, walForceArchiveTimeout=-1, writeThrottlingEnabled=false, walCompactionEnabled=false, walCompactionLevel=1, checkpointReadLockTimeout=-85, walPageCompression=DISABLED, walPageCompressionLevel=null, dfltWarmUpCfg=null, encCfg=org.apache.ignite.configuration.EncryptionConfiguration@24baeb96, defragmentationThreadPoolSize=4, minWalArchiveSize=-1], snapshotPath=snapshots, activeOnStart=true, activeOnStartPropSetFlag=false, autoActivation=true, autoActivationPropSetFlag=false, clusterStateOnStart=null, sqlConnCfg=null, cliConnCfg=ClientConnectorConfiguration [host=null, port=10800, portRange=100, sockSndBufSize=0, sockRcvBufSize=0, tcpNoDelay=true, maxOpenCursorsPerConn=128, threadPoolSize=24, selectorCnt=12, idleTimeout=0, handshakeTimeout=10000, jdbcEnabled=true, odbcEnabled=true, thinCliEnabled=true, sslEnabled=false, useIgniteSslCtxFactory=true, sslClientAuth=false, sslCtxFactory=null, thinCliCfg=ThinClientConfiguration [maxActiveTxPerConn=100, maxActiveComputeTasksPerConn=0]], mvccVacuumThreadCnt=2, mvccVacuumFreq=5000, authEnabled=false, failureHnd=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]], commFailureRslvr=null, sqlCfg=SqlConfiguration [longQryWarnTimeout=3000, dfltQryTimeout=0, sqlQryHistSize=1000, validationEnabled=false], asyncContinuationExecutor=null] [21:02:36] : [Step 4/5] [2021-11-19 21:02:36,538][INFO ][test-runner-#3420%failure.FailureHandlingConfigurationTest%][FailureHandlingConfigurationTest0] Daemon mode: off [21:02:36] : [Step 4/5] [2021-11-19 21:02:36,538][INFO ][test-runner-#3420%failure.FailureHandlingConfigurationTest%][FailureHandlingConfigurationTest0] OS: Linux 4.15.0-151-generic amd64 [21:02:36] : [Step 4/5] [2021-11-19 21:02:36,539][INFO ][test-runner-#3420%failure.FailureHandlingConfigurationTest%][FailureHandlingConfigurationTest0] OS user: teamcity [21:02:36] : [Step 4/5] [2021-11-19 21:02:36,539][INFO ][test-runner-#3420%failure.FailureHandlingConfigurationTest%][FailureHandlingConfigurationTest0] PID: 16724 [21:02:36] : [Step 4/5] [2021-11-19 21:02:36,539][INFO ][test-runner-#3420%failure.FailureHandlingConfigurationTest%][FailureHandlingConfigurationTest0] Language runtime: Java Platform API Specification ver. 1.8 [21:02:36] : [Step 4/5] [2021-11-19 21:02:36,540][INFO ][test-runner-#3420%failure.FailureHandlingConfigurationTest%][FailureHandlingConfigurationTest0] VM information: Java(TM) SE Runtime Environment 1.8.0_261-b12 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 25.261-b12 [21:02:36] : [Step 4/5] [2021-11-19 21:02:36,540][INFO ][test-runner-#3420%failure.FailureHandlingConfigurationTest%][FailureHandlingConfigurationTest0] VM total memory: 1.9GB [21:02:36] : [Step 4/5] [2021-11-19 21:02:36,541][INFO ][test-runner-#3420%failure.FailureHandlingConfigurationTest%][FailureHandlingConfigurationTest0] Remote Management [restart: off, REST: off, JMX (remote: off)] [21:02:36] : [Step 4/5] [2021-11-19 21:02:36,541][INFO ][test-runner-#3420%failure.FailureHandlingConfigurationTest%][FailureHandlingConfigurationTest0] Logger: GridTestLog4jLogger [quiet=false, config=null] [21:02:36] : [Step 4/5] [2021-11-19 21:02:36,541][INFO ][test-runner-#3420%failure.FailureHandlingConfigurationTest%][FailureHandlingConfigurationTest0] IGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c [21:02:36] : [Step 4/5] [2021-11-19 21:02:36,542][INFO ][test-runner-#3420%failure.FailureHandlingConfigurationTest%][FailureHandlingConfigurationTest0] VM arguments: [-DIGNITE_DUMP_THREADS_ON_FAILURE=false, -DMono=/usr/bin/mono-sgen, -DMono4.0_x64=/usr/lib/mono/4.0, -DMono4.5_x64=/usr/lib/mono/4.5, -DMonoVersion=6.12.0.90, -DSKIP_BUILD=false, -Dagent.home.dir=/opt/buildagent, -Dagent.name=aitc-lin02_03, -Dagent.ownPort=9090, -Dagent.work.dir=/opt/buildagent/work, -Dbuild.number=95, -Dbuild.vcs.number=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.1=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.GitHubApacheIgnite=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dclassworlds.conf=/opt/buildagent/temp/buildTmp/teamcity.m2.conf, -Dcom.jetbrains.maven.watcher.report.file=/opt/buildagent/temp/buildTmp/maven-build-info.xml, -Djava.io.tmpdir=/opt/buildagent/temp/buildTmp, -Dmaven.home=/opt/buildagent/tools/maven3_6, -Dmaven.multiModuleProjectDirectory=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.agent.cpuBenchmark=457, -Dteamcity.agent.dotnet.agent_url=http://localhost:9090/RPC2, -Dteamcity.agent.dotnet.build_id=6278078, -Dteamcity.auth.password=*******, -Dteamcity.auth.userId=TeamCityBuildId=6278078, -Dteamcity.build.changedFiles.file=/opt/buildagent/temp/buildTmp/changedFiles6342607772318147725.txt, -Dteamcity.build.checkoutDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.build.id=6278078, -Dteamcity.build.properties.file=/opt/buildagent/temp/buildTmp/teamcity.build5164517880467851002.properties, -Dteamcity.build.tempDir=/opt/buildagent/temp/buildTmp, -Dteamcity.build.workingDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.buildConfName=Basic 3, -Dteamcity.buildType.id=IgniteTests24Java8_Basic3, -Dteamcity.configuration.properties.file=/opt/buildagent/temp/buildTmp/teamcity.config5591980786735343870.properties, -Dteamcity.maven.userSettings.path=/opt/buildagent/temp/buildTmp/maven_settings_585072866407032347.xml, -Dteamcity.maven.watcher.home=/opt/buildagent/plugins/mavenPlugin/maven-watcher-jdk16, -Dteamcity.projectName=Ignite Tests 2.x (JDK 8/11), -Dteamcity.runner.properties.file=/opt/buildagent/temp/buildTmp/teamcity.runner9098465561618137420.properties, -Dteamcity.tests.recentlyFailedTests.file=/opt/buildagent/temp/buildTmp/testsToRunFirst3891775683130404069.txt, -Dteamcity.version=2021.2 (build 99542), -ea, -Xms2g, -Xmx2g, -XX:+HeapDumpOnOutOfMemoryError, -DIGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_TEST_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_UPDATE_NOTIFIER=false, -DIGNITE_NO_DISCO_ORDER=true, -DIGNITE_PERFORMANCE_SUGGESTIONS_DISABLED=true, -Djava.net.preferIPv4Stack=true, -DTEST_SCALE_FACTOR=1.0, -DIGNITE_TEST_PROP_LOG4J_FILE=log4j-tc-test.xml, -DIGNITE_QUIET=false, -DIGNITE_MARSHAL_BUFFERS_RECHECK=1000, -Dmaven.repo.local=/opt/buildagent/.m2/repository] [21:02:36] : [Step 4/5] [2021-11-19 21:02:36,546][INFO ][test-runner-#3420%failure.FailureHandlingConfigurationTest%][FailureHandlingConfigurationTest0] System cache's DataRegion size is configured to 40 MB. Use DataStorageConfiguration.systemRegionInitialSize property to change the setting. [21:02:36] : [Step 4/5] [2021-11-19 21:02:36,546][INFO ][test-runner-#3420%failure.FailureHandlingConfigurationTest%][FailureHandlingConfigurationTest0] Configured caches [in 'sysMemPlc' dataRegion: ['ignite-sys-cache']] [21:02:36]W: [org.apache.ignite:ignite-core] [2021-11-19 21:02:36,546][WARN ][test-runner-#3420%failure.FailureHandlingConfigurationTest%][FailureHandlingConfigurationTest0] Peer class loading is enabled (disable it in production for performance and deployment consistency reasons) [21:02:36] : [Step 4/5] [2021-11-19 21:02:36,547][INFO ][test-runner-#3420%failure.FailureHandlingConfigurationTest%][FailureHandlingConfigurationTest0] 3-rd party licenses can be found at: /opt/buildagent/work/7bc1c54bc719b67c/libs/licenses [21:02:36] : [Step 4/5] [2021-11-19 21:02:36,550][INFO ][test-runner-#3420%failure.FailureHandlingConfigurationTest%][IgnitePluginProcessor] Configured plugins: [21:02:36] : [Step 4/5] [2021-11-19 21:02:36,551][INFO ][test-runner-#3420%failure.FailureHandlingConfigurationTest%][IgnitePluginProcessor] ^-- StanByClusterTestProvider 1.0 [21:02:36] : [Step 4/5] [2021-11-19 21:02:36,551][INFO ][test-runner-#3420%failure.FailureHandlingConfigurationTest%][IgnitePluginProcessor] ^-- null [21:02:36] : [Step 4/5] [2021-11-19 21:02:36,551][INFO ][test-runner-#3420%failure.FailureHandlingConfigurationTest%][IgnitePluginProcessor] [21:02:36] : [Step 4/5] [2021-11-19 21:02:36,551][INFO ][test-runner-#3420%failure.FailureHandlingConfigurationTest%][IgnitePluginProcessor] ^-- PageMemory tracker plugin 1.0 [21:02:36] : [Step 4/5] [2021-11-19 21:02:36,551][INFO ][test-runner-#3420%failure.FailureHandlingConfigurationTest%][IgnitePluginProcessor] ^-- null [21:02:36] : [Step 4/5] [2021-11-19 21:02:36,551][INFO ][test-runner-#3420%failure.FailureHandlingConfigurationTest%][IgnitePluginProcessor] [21:02:36] : [Step 4/5] [2021-11-19 21:02:36,552][INFO ][test-runner-#3420%failure.FailureHandlingConfigurationTest%][IgnitePluginProcessor] ^-- TestDistibutedConfigurationPlugin 1.0 [21:02:36] : [Step 4/5] [2021-11-19 21:02:36,552][INFO ][test-runner-#3420%failure.FailureHandlingConfigurationTest%][IgnitePluginProcessor] ^-- null [21:02:36] : [Step 4/5] [2021-11-19 21:02:36,552][INFO ][test-runner-#3420%failure.FailureHandlingConfigurationTest%][IgnitePluginProcessor] [21:02:36] : [Step 4/5] [2021-11-19 21:02:36,552][INFO ][test-runner-#3420%failure.FailureHandlingConfigurationTest%][IgnitePluginProcessor] ^-- NodeValidationPluginProvider 1.0 [21:02:36] : [Step 4/5] [2021-11-19 21:02:36,552][INFO ][test-runner-#3420%failure.FailureHandlingConfigurationTest%][IgnitePluginProcessor] ^-- null [21:02:36] : [Step 4/5] [2021-11-19 21:02:36,553][INFO ][test-runner-#3420%failure.FailureHandlingConfigurationTest%][IgnitePluginProcessor] [21:02:36] : [Step 4/5] [2021-11-19 21:02:36,553][INFO ][test-runner-#3420%failure.FailureHandlingConfigurationTest%][FailureProcessor] Configured failure handler: [hnd=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]] [21:02:36] : [Step 4/5] [2021-11-19 21:02:36,566][INFO ][test-runner-#3420%failure.FailureHandlingConfigurationTest%][TcpCommunicationSpi] Successfully bound communication NIO server to TCP port [port=45050, locHost=/127.0.0.1, selectorsCnt=12, selectorSpins=0, pairedConn=false] [21:02:36]W: [org.apache.ignite:ignite-core] [2021-11-19 21:02:36,566][WARN ][test-runner-#3420%failure.FailureHandlingConfigurationTest%][TcpCommunicationSpi] Message queue limit is set to 0 which may lead to potential OOMEs when running cache operations in FULL_ASYNC or PRIMARY_SYNC modes due to message queues growth on sender and receiver sides. [21:02:36] : [Step 4/5] [2021-11-19 21:02:36,571][INFO ][test-runner-#3420%failure.FailureHandlingConfigurationTest%][GridCollisionManager] Collision resolution is disabled (all jobs will be activated upon arrival). [21:02:36] : [Step 4/5] [2021-11-19 21:02:36,571][INFO ][test-runner-#3420%failure.FailureHandlingConfigurationTest%][FailureHandlingConfigurationTest0] Security status [authentication=off, sandbox=off, tls/ssl=off] [21:02:36] : [Step 4/5] [2021-11-19 21:02:36,573][INFO ][test-runner-#3420%failure.FailureHandlingConfigurationTest%][TestTcpDiscoverySpi] Successfully bound to TCP port [port=47500, localHost=localhost/127.0.0.1, locNodeId=982396f4-ac9d-49b5-835c-74204a400000] [21:02:36] : [Step 4/5] [2021-11-19 21:02:36,583][INFO ][test-runner-#3420%failure.FailureHandlingConfigurationTest%][PdsFoldersResolver] Successfully created new persistent storage folder [/opt/buildagent/work/7bc1c54bc719b67c/work/db/node00-0b244f11-d849-41b9-a792-3afea7d6ba3e] [21:02:36] : [Step 4/5] [2021-11-19 21:02:36,583][INFO ][test-runner-#3420%failure.FailureHandlingConfigurationTest%][PdsFoldersResolver] Consistent ID used for local node is [0b244f11-d849-41b9-a792-3afea7d6ba3e] according to persistence data storage folders [21:02:36] : [Step 4/5] [2021-11-19 21:02:36,584][INFO ][test-runner-#3420%failure.FailureHandlingConfigurationTest%][MaintenanceProcessor] Resolved store directory for node persistent data: /opt/buildagent/work/7bc1c54bc719b67c/work/db/node00-0b244f11-d849-41b9-a792-3afea7d6ba3e [21:02:36] : [Step 4/5] [2021-11-19 21:02:36,585][INFO ][test-runner-#3420%failure.FailureHandlingConfigurationTest%][CacheObjectBinaryProcessorImpl] Resolved directory for serialized binary metadata: /opt/buildagent/work/7bc1c54bc719b67c/work/db/binary_meta/node00-0b244f11-d849-41b9-a792-3afea7d6ba3e [21:02:36] : [Step 4/5] [2021-11-19 21:02:36,590][INFO ][test-runner-#3420%failure.FailureHandlingConfigurationTest%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/node00-0b244f11-d849-41b9-a792-3afea7d6ba3e [21:02:36] : [Step 4/5] [2021-11-19 21:02:36,591][INFO ][test-runner-#3420%failure.FailureHandlingConfigurationTest%][FileWriteAheadLogManager] Resolved write ahead log work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/node00-0b244f11-d849-41b9-a792-3afea7d6ba3e [21:02:36] : [Step 4/5] [2021-11-19 21:02:36,591][INFO ][test-runner-#3420%failure.FailureHandlingConfigurationTest%][FileWriteAheadLogManager] Resolved write ahead log archive directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/node00-0b244f11-d849-41b9-a792-3afea7d6ba3e [21:02:37] : [Step 4/5] [2021-11-19 21:02:37,125][INFO ][test-runner-#3420%failure.FailureHandlingConfigurationTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/node00-0b244f11-d849-41b9-a792-3afea7d6ba3e/0000000000000000.wal [21:02:37] : [Step 4/5] [2021-11-19 21:02:37,126][INFO ][test-runner-#3420%failure.FailureHandlingConfigurationTest%][FileHandleManagerImpl] Initialized write-ahead log manager [mode=LOG_ONLY] [21:02:37] : [Step 4/5] [2021-11-19 21:02:37,131][INFO ][test-runner-#3420%failure.FailureHandlingConfigurationTest%][GridCacheDatabaseSharedManager] Configured data regions initialized successfully [total=5] [21:02:37] : [Step 4/5] [2021-11-19 21:02:37,132][INFO ][test-runner-#3420%failure.FailureHandlingConfigurationTest%][IgniteSnapshotManager] Resolved snapshot work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/snapshots [21:02:37] : [Step 4/5] [2021-11-19 21:02:37,132][INFO ][test-runner-#3420%failure.FailureHandlingConfigurationTest%][IgniteSnapshotManager] Resolved temp directory for snapshot creation: /opt/buildagent/work/7bc1c54bc719b67c/work/db/node00-0b244f11-d849-41b9-a792-3afea7d6ba3e/snp [21:02:37] : [Step 4/5] [2021-11-19 21:02:37,135][INFO ][test-runner-#3420%failure.FailureHandlingConfigurationTest%][ClientListenerProcessor] Client connector processor has started on TCP port 10800 [21:02:37] : [Step 4/5] [2021-11-19 21:02:37,137][INFO ][test-runner-#3420%failure.FailureHandlingConfigurationTest%][FailureHandlingConfigurationTest0] Non-loopback local IPs: 172.17.0.4 [21:02:37] : [Step 4/5] [2021-11-19 21:02:37,137][INFO ][test-runner-#3420%failure.FailureHandlingConfigurationTest%][FailureHandlingConfigurationTest0] Enabled local MACs: 0242AC110004 [21:02:37] : [Step 4/5] [2021-11-19 21:02:37,138][INFO ][test-runner-#3420%failure.FailureHandlingConfigurationTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:02:37] : [Step 4/5] [2021-11-19 21:02:37,139][INFO ][test-runner-#3420%failure.FailureHandlingConfigurationTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:02:37] : [Step 4/5] [2021-11-19 21:02:37,140][INFO ][test-runner-#3420%failure.FailureHandlingConfigurationTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:02:37] : [Step 4/5] [2021-11-19 21:02:37,142][INFO ][test-runner-#3420%failure.FailureHandlingConfigurationTest%][GridCacheDatabaseSharedManager] Applying lost metastore updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:02:37] : [Step 4/5] [2021-11-19 21:02:37,143][INFO ][test-runner-#3420%failure.FailureHandlingConfigurationTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=0 ms] [21:02:37] : [Step 4/5] [2021-11-19 21:02:37,143][INFO ][test-runner-#3420%failure.FailureHandlingConfigurationTest%][GridCacheProcessor] Restoring partition state for local groups. [21:02:37] : [Step 4/5] [2021-11-19 21:02:37,143][INFO ][test-runner-#3420%failure.FailureHandlingConfigurationTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=0, partitionsProcessed=0, time=0ms] [21:02:37] : [Step 4/5] [2021-11-19 21:02:37,144][INFO ][test-runner-#3420%failure.FailureHandlingConfigurationTest%][GridEncryptionManager] Encryption keys loaded from metastore. [grps=, masterKeyName=null] [21:02:37] : [Step 4/5] [2021-11-19 21:02:37,145][INFO ][test-runner-#3420%failure.FailureHandlingConfigurationTest%][ClusterProcessor] Cluster ID and tag has been read from metastorage: null [21:02:37] : [Step 4/5] [2021-11-19 21:02:37,146][INFO ][test-runner-#3420%failure.FailureHandlingConfigurationTest%][IgniteClusterImpl] Shutdown policy was updated [oldVal=null, newVal=null] [21:02:37] : [Step 4/5] [2021-11-19 21:02:37,146][INFO ][test-runner-#3420%failure.FailureHandlingConfigurationTest%][GridCacheDatabaseSharedManager] Checkpoint frequency deviation changed [oldVal=null, newVal=null] [21:02:37] : [Step 4/5] [2021-11-19 21:02:37,156][INFO ][test-runner-#3420%failure.FailureHandlingConfigurationTest%][FilePageStoreManager] Cleanup cache stores [total=1, left=0, cleanFiles=false] [21:02:37] : [Step 4/5] [2021-11-19 21:02:37,159][INFO ][test-runner-#3420%failure.FailureHandlingConfigurationTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:02:37] : [Step 4/5] [2021-11-19 21:02:37,160][INFO ][test-runner-#3420%failure.FailureHandlingConfigurationTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:02:37] : [Step 4/5] [2021-11-19 21:02:37,162][INFO ][test-runner-#3420%failure.FailureHandlingConfigurationTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:02:37] : [Step 4/5] [2021-11-19 21:02:37,163][INFO ][test-runner-#3420%failure.FailureHandlingConfigurationTest%][GridCacheDatabaseSharedManager] Data Regions Started: 5 [21:02:37] : [Step 4/5] [2021-11-19 21:02:37,163][INFO ][test-runner-#3420%failure.FailureHandlingConfigurationTest%][GridCacheDatabaseSharedManager] ^-- sysMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:02:37] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:02:37] : [Step 4/5] ^-- default region [type=default, persistence=true, lazyAlloc=true, [21:02:37] : [Step 4/5] ... initCfg=256MB, maxCfg=256MB, usedRam=0MB, freeRam=100%, allocRam=0MB, allocTotal=0MB] [21:02:37] : [Step 4/5] ^-- metastoreMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:02:37] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:02:37] : [Step 4/5] ^-- TxLog region [type=internal, persistence=true, lazyAlloc=false, [21:02:37] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:02:37] : [Step 4/5] ^-- volatileDsMemPlc region [type=user, persistence=false, lazyAlloc=true, [21:02:37] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB] [21:02:37] : [Step 4/5] ^-- Ignite persistence [used=0MB] [21:02:37] : [Step 4/5] [21:02:37] : [Step 4/5] [2021-11-19 21:02:37,165][INFO ][test-runner-#3420%failure.FailureHandlingConfigurationTest%][GridCacheDatabaseSharedManager] Starting binary memory restore for: [-2100569601] [21:02:37] : [Step 4/5] [2021-11-19 21:02:37,173][INFO ][test-runner-#3420%failure.FailureHandlingConfigurationTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:02:37] : [Step 4/5] [2021-11-19 21:02:37,174][INFO ][test-runner-#3420%failure.FailureHandlingConfigurationTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:02:37] : [Step 4/5] [2021-11-19 21:02:37,183][INFO ][test-runner-#3420%failure.FailureHandlingConfigurationTest%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/node00-0b244f11-d849-41b9-a792-3afea7d6ba3e/0000000000000000.wal, offset=0, ver=2] [21:02:37] : [Step 4/5] [2021-11-19 21:02:37,187][INFO ][test-runner-#3420%failure.FailureHandlingConfigurationTest%][GridCacheProcessor] Started cache in recovery mode [name=ignite-sys-cache, id=-2100569601, dataRegionName=sysMemPlc, mode=REPLICATED, atomicity=TRANSACTIONAL, backups=2147483647, mvcc=false] [21:02:37] : [Step 4/5] [2021-11-19 21:02:37,188][INFO ][test-runner-#3420%failure.FailureHandlingConfigurationTest%][GridCacheDatabaseSharedManager] Binary recovery performed in 23 ms. [21:02:37] : [Step 4/5] [2021-11-19 21:02:37,188][INFO ][test-runner-#3420%failure.FailureHandlingConfigurationTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:02:37] : [Step 4/5] [2021-11-19 21:02:37,188][INFO ][test-runner-#3420%failure.FailureHandlingConfigurationTest%][GridCacheDatabaseSharedManager] Applying lost cache updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:02:37] : [Step 4/5] [2021-11-19 21:02:37,256][INFO ][test-runner-#3420%failure.FailureHandlingConfigurationTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=70 ms] [21:02:37] : [Step 4/5] [2021-11-19 21:02:37,256][INFO ][test-runner-#3420%failure.FailureHandlingConfigurationTest%][GridCacheProcessor] Restoring partition state for local groups. [21:02:37] : [Step 4/5] [2021-11-19 21:02:37,260][INFO ][test-runner-#3420%failure.FailureHandlingConfigurationTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=1, partitionsProcessed=100, time=0ms] [21:02:37] : [Step 4/5] [2021-11-19 21:02:37,768][INFO ][disco-notifier-worker-#3532%failure.FailureHandlingConfigurationTest0%][MvccProcessorImpl] Assigned mvcc coordinator [crd=MvccCoordinator [topVer=AffinityTopologyVersion [topVer=1, minorTopVer=0], nodeId=982396f4-ac9d-49b5-835c-74204a400000, ver=1637344957761, local=true, initialized=false]] [21:02:37] : [Step 4/5] [2021-11-19 21:02:37,770][INFO ][sys-#3516%failure.FailureHandlingConfigurationTest0%][ClusterProcessor] Writing cluster ID and tag to metastorage on ready for write ClusterIdAndTag [id=f0a68a4b-d997-40f8-afb5-c40e33cf4f5f, tag=epic_kepler] [21:02:37] : [Step 4/5] [2021-11-19 21:02:37,771][INFO ][disco-notifier-worker-#3532%failure.FailureHandlingConfigurationTest0%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustEnabled' was changed from 'null' to 'false' [21:02:37] : [Step 4/5] [2021-11-19 21:02:37,771][INFO ][disco-notifier-worker-#3532%failure.FailureHandlingConfigurationTest0%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustTimeout' was changed from 'null' to '300000' [21:02:37] : [Step 4/5] [2021-11-19 21:02:37,772][INFO ][disco-notifier-worker-#3532%failure.FailureHandlingConfigurationTest0%][IgniteTxManager] Transactions parameter 'longOperationsDumpTimeout' was changed from 'null' to '60000' [21:02:37] : [Step 4/5] [2021-11-19 21:02:37,773][INFO ][disco-notifier-worker-#3532%failure.FailureHandlingConfigurationTest0%][ClusterProcessor] epic_kepler [21:02:37] : [Step 4/5] [2021-11-19 21:02:37,773][INFO ][disco-notifier-worker-#3532%failure.FailureHandlingConfigurationTest0%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpThreshold' was changed from 'null' to '0' [21:02:37] : [Step 4/5] [2021-11-19 21:02:37,774][INFO ][disco-notifier-worker-#3532%failure.FailureHandlingConfigurationTest0%][IgniteTxManager] Transactions parameter 'transactionTimeDumpSamplesCoefficient' was changed from 'null' to '0.0' [21:02:37] : [Step 4/5] [2021-11-19 21:02:37,774][INFO ][disco-notifier-worker-#3532%failure.FailureHandlingConfigurationTest0%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpSamplesPerSecondLimit' was changed from 'null' to '5' [21:02:37] : [Step 4/5] [2021-11-19 21:02:37,775][INFO ][disco-notifier-worker-#3532%failure.FailureHandlingConfigurationTest0%][IgniteTxManager] Transactions parameter 'collisionsDumpInterval' was changed from 'null' to '1000' [21:02:37] : [Step 4/5] [2021-11-19 21:02:37,776][INFO ][disco-notifier-worker-#3532%failure.FailureHandlingConfigurationTest0%][IgniteTxManager] Transactions parameter 'txOwnerDumpRequestsAllowed' was changed from 'null' to 'true' [21:02:37] : [Step 4/5] [2021-11-19 21:02:37,776][INFO ][disco-notifier-worker-#3532%failure.FailureHandlingConfigurationTest0%][GridCacheDatabaseSharedManager] Historical rebalance WAL threshold changed [property=historical.rebalance.threshold, oldVal=null, newVal=500] [21:02:37] : [Step 4/5] [2021-11-19 21:02:37,783][INFO ][test-runner-#3420%failure.FailureHandlingConfigurationTest%][FailureHandlingConfigurationTest0] To start Console Management & Monitoring run ignitevisorcmd.{sh|bat} [21:02:37] : [Step 4/5] [2021-11-19 21:02:37,784][INFO ][test-runner-#3420%failure.FailureHandlingConfigurationTest%][FailureHandlingConfigurationTest0] [21:02:37] : [Step 4/5] [21:02:37] : [Step 4/5] >>> +-------------------------------------------+ [21:02:37] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:02:37] : [Step 4/5] >>> +-------------------------------------------+ [21:02:37] : [Step 4/5] >>> OS name: Linux 4.15.0-151-generic amd64 [21:02:37] : [Step 4/5] >>> CPU(s): 24 [21:02:37] : [Step 4/5] >>> Heap: 2.0GB [21:02:37] : [Step 4/5] >>> VM name: 16724@c4dfe9a430b2 [21:02:37] : [Step 4/5] >>> Ignite instance name: failure.FailureHandlingConfigurationTest0 [21:02:37] : [Step 4/5] >>> Local node [ID=982396F4-AC9D-49B5-835C-74204A400000, order=1, clientMode=false] [21:02:37] : [Step 4/5] >>> Local node addresses: [127.0.0.1] [21:02:37] : [Step 4/5] >>> Local ports: TCP:10800 TCP:45050 TCP:47500 [21:02:37] : [Step 4/5] [21:02:37] : [Step 4/5] [2021-11-19 21:02:37,785][INFO ][test-runner-#3420%failure.FailureHandlingConfigurationTest%][FailureHandlingConfigurationTest0] >>> Ignite cluster is in INACTIVE state (limited functionality available). Use control.(sh|bat) script or IgniteCluster.state(ClusterState.ACTIVE) to change the state. [21:02:37] : [Step 4/5] [2021-11-19 21:02:37,785][INFO ][test-runner-#3420%failure.FailureHandlingConfigurationTest%][GridDiscoveryManager] Topology snapshot [ver=1, locNode=982396f4, servers=1, clients=0, state=INACTIVE, CPUs=24, offheap=0.25GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=982396f4-ac9d-49b5-835c-74204a400000, consistentId=0b244f11-d849-41b9-a792-3afea7d6ba3e, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:02:37] : [Step 4/5] [2021-11-19 21:02:37,786][INFO ][test-runner-#3420%failure.FailureHandlingConfigurationTest%][G] Node started : [stage="Configure system pool" (0 ms),stage="Start managers" (58 ms),stage="Configure binary metadata" (2 ms),stage="Start processors" (549 ms),stage="Start 'StanByClusterTestProvider' plugin" (0 ms),stage="Start 'PageMemory tracker plugin' plugin" (0 ms),stage="Start 'TestDistibutedConfigurationPlugin' plugin" (0 ms),stage="Start 'NodeValidationPluginProvider' plugin" (0 ms),stage="Init metastore" (19 ms),stage="Init and start regions" (9 ms),stage="Restore binary memory" (23 ms),stage="Restore logical state" (72 ms),stage="Finish recovery" (501 ms),stage="Join topology" (6 ms),stage="Await transition" (2 ms),stage="Await exchange" (15 ms),stage="Total time" (1256 ms)] [21:02:37] : [Step 4/5] [2021-11-19 21:02:37,787][INFO ][test-runner-#3420%failure.FailureHandlingConfigurationTest%][root] Node started with the following configuration [id=982396f4-ac9d-49b5-835c-74204a400000, marshaller=BinaryMarshaller [], discovery=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=5000, ackTimeout=5000, marsh=JdkMarshaller [clsFilter=org.apache.ignite.marshaller.MarshallerUtils$1@4d8721cf], reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], binaryCfg=null, lateAff=true] [21:02:37] : [Step 4/5] [2021-11-19 21:02:37,789][INFO ][test-runner-#3420%failure.FailureHandlingConfigurationTest%][GridClusterStateProcessor] Sending activate cluster request with BaselineTopology BaselineTopology [id=0, branchingHash=-752251288, branchingType='New BaselineTopology', baselineNodes=[0b244f11-d849-41b9-a792-3afea7d6ba3e]] [21:02:37] : [Step 4/5] [2021-11-19 21:02:37,790][INFO ][disco-notifier-worker-#3532%failure.FailureHandlingConfigurationTest0%][GridClusterStateProcessor] Received activate cluster request with BaselineTopology[id=0] initiator node ID: 982396f4-ac9d-49b5-835c-74204a400000 [21:02:37] : [Step 4/5] [2021-11-19 21:02:37,790][INFO ][disco-notifier-worker-#3532%failure.FailureHandlingConfigurationTest0%][GridClusterStateProcessor] Started state transition: activate cluster [21:02:37] : [Step 4/5] [2021-11-19 21:02:37,791][INFO ][exchange-worker-#3537%failure.FailureHandlingConfigurationTest0%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=1, minorTopVer=1], crd=true, evt=DISCOVERY_CUSTOM_EVT, evtNode=982396f4-ac9d-49b5-835c-74204a400000, customEvt=ChangeGlobalStateMessage [id=57aac593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqId=fe77db40-13cd-456d-8da3-3bc82dbbe604, initiatingNodeId=982396f4-ac9d-49b5-835c-74204a400000, state=ACTIVE, baselineTopology=BaselineTopology [id=0, branchingHash=-752251288, branchingType='New BaselineTopology', baselineNodes=[0b244f11-d849-41b9-a792-3afea7d6ba3e]], forceChangeBaselineTopology=false, timestamp=1637344957789, forceDeactivation=true], allowMerge=false, exchangeFreeSwitch=false] [21:02:37] : [Step 4/5] [2021-11-19 21:02:37,792][INFO ][exchange-worker-#3537%failure.FailureHandlingConfigurationTest0%][GridDhtPartitionsExchangeFuture] Start activation process [nodeId=982396f4-ac9d-49b5-835c-74204a400000, client=false, topVer=AffinityTopologyVersion [topVer=1, minorTopVer=1]]. New state: ACTIVE [21:02:37] : [Step 4/5] [2021-11-19 21:02:37,792][INFO ][exchange-worker-#3537%failure.FailureHandlingConfigurationTest0%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/node00-0b244f11-d849-41b9-a792-3afea7d6ba3e [21:02:37] : [Step 4/5] [2021-11-19 21:02:37,796][INFO ][exchange-worker-#3537%failure.FailureHandlingConfigurationTest0%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/node00-0b244f11-d849-41b9-a792-3afea7d6ba3e/0000000000000000.wal, offset=8795, ver=2] [21:02:37] : [Step 4/5] [2021-11-19 21:02:37,798][INFO ][exchange-worker-#3537%failure.FailureHandlingConfigurationTest0%][GridClusterStateProcessor] Writing BaselineTopology[id=0] [21:02:37] : [Step 4/5] [2021-11-19 21:02:37,800][INFO ][exchange-worker-#3537%failure.FailureHandlingConfigurationTest0%][GridCacheDatabaseSharedManager] Finish recovery performed in 7 ms. [21:02:37] : [Step 4/5] [2021-11-19 21:02:37,800][INFO ][exchange-worker-#3537%failure.FailureHandlingConfigurationTest0%][msg] Components activation performed in 8 ms. [21:02:37] : [Step 4/5] [2021-11-19 21:02:37,801][INFO ][exchange-worker-#3537%failure.FailureHandlingConfigurationTest0%][GridCacheProcessor] Finished recovery for cache [cache=ignite-sys-cache, grp=ignite-sys-cache, startVer=AffinityTopologyVersion [topVer=1, minorTopVer=1]] [21:02:37] : [Step 4/5] [2021-11-19 21:02:37,802][INFO ][exchange-worker-#3537%failure.FailureHandlingConfigurationTest0%][GridDhtPartitionsExchangeFuture] Successfully activated caches [nodeId=982396f4-ac9d-49b5-835c-74204a400000, client=false, topVer=AffinityTopologyVersion [topVer=1, minorTopVer=1], newState=ACTIVE] [21:02:37] : [Step 4/5] [2021-11-19 21:02:37,802][INFO ][exchange-worker-#3537%failure.FailureHandlingConfigurationTest0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=1, minorTopVer=1], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:02:37] : [Step 4/5] [2021-11-19 21:02:37,814][INFO ][exchange-worker-#3537%failure.FailureHandlingConfigurationTest0%][GridDhtPartitionsExchangeFuture] finishExchangeOnCoordinator [topVer=AffinityTopologyVersion [topVer=1, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=1, minorTopVer=1]] [21:02:37] : [Step 4/5] [2021-11-19 21:02:37,816][INFO ][db-checkpoint-thread-#3544%failure.FailureHandlingConfigurationTest0%][Checkpointer] Checkpoint started [checkpointId=0bbbf008-f482-4af1-9ac8-7232e176f5bc, startPtr=WALPointer [idx=0, fileOff=66537, len=1963], checkpointBeforeLockTime=6ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=0ms, writeCheckpointEntryDuration=2ms, splitAndSortCpPagesDuration=0ms, pages=16, reason='node started'] [21:02:37] : [Step 4/5] [2021-11-19 21:02:37,818][INFO ][exchange-worker-#3537%failure.FailureHandlingConfigurationTest0%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=1, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=1, minorTopVer=1], err=null, rebalanced=true, wasRebalanced=false] [21:02:37] : [Step 4/5] [2021-11-19 21:02:37,819][INFO ][disco-notifier-worker-#3532%failure.FailureHandlingConfigurationTest0%][GridClusterStateProcessor] Received state change finish message: ACTIVE [21:02:37] : [Step 4/5] [2021-11-19 21:02:37,819][INFO ][disco-notifier-worker-#3532%failure.FailureHandlingConfigurationTest0%][GridClusterStateProcessor] Cluster state was changed from INACTIVE to ACTIVE [21:02:37] : [Step 4/5] [2021-11-19 21:02:37,820][INFO ][exchange-worker-#3537%failure.FailureHandlingConfigurationTest0%][GridCacheProcessor] Finish proxy initialization, cacheName=ignite-sys-cache, localNodeId=982396f4-ac9d-49b5-835c-74204a400000 [21:02:37] : [Step 4/5] [2021-11-19 21:02:37,821][INFO ][sys-#3528%failure.FailureHandlingConfigurationTest0%][DistributedBaselineConfiguration] Baseline auto-adjust is 'disabled' with timeout='300000' ms [21:02:37] : [Step 4/5] [2021-11-19 21[21:02:37] >>> Stopping test: FailureHandlingConfigurationTest#testNegativeParamValues in 1301 ms <<< [21:02:37] : [Step 4/5] :02:37,821][INFO ][exchange-worker-#3537%failure.FailureHandlingConfigurationTest0%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=982396f4-ac9d-49b5-835c-74204a400000, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=1, minorTopVer=1], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=982396f4-ac9d-49b5-835c-74204a400000, consistentId=0b244f11-d849-41b9-a792-3afea7d6ba3e, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637344957760, loc=true, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=1, minorTopVer=1]] [21:02:37] : [Step 4/5] [2021-11-19 21:02:37,821][INFO ][main][root] >>> Stopping test: FailureHandlingConfigurationTest#testNegativeParamValues in 1301 ms <<< [21:02:37] : [Step 4/5] [2021-11-19 21:02:[21:02:37] >>> Heap: 439 MB used / 1944 MB commited / 1944 MB max <<< [21:02:37] : [Step 4/5] 37,821][INFO ][sys-#3528%failure.FailureHandlingConfigurationTest0%][GridClusterStateProcessor] Successfully performed final activation steps [nodeId=982396f4-ac9d-49b5-835c-74204a400000, client=false, topVer=AffinityTopologyVersion [topVer=1, minorTopVer=1]] [21:02:37] : [Step 4/5] [2021-11-19 21:02:37,824][INFO ][main][root] >>> Heap: 439 MB used / 1944 MB commited / 1944 MB max <<< [21:02:37] : [Step 4/5] [21:02:37] >>> Non-He[20ap: 121-11-19 17 MB21:02:37, u82se3][INFO ][ed / 125 MB commitxchaed nge/ 0 -worMB max <<< [21:02:37] : [Step 4/5] ker-#3537%failure.FailureHandlingConfigurationTest0%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=1, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=1, minorTopVer=1], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (1 ms), stage="Update caches registry" (8 ms), stage="Start caches" (0 ms), stage="Affinity initialization on cache group start" (0 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Restore partition states" (0 ms), stage="After states restored callback" (10 ms), stage="WAL history reservation" (0 ms), stage="Waiting for all single messages" (0 ms), stage="Affinity recalculation (crd)" (0 ms), stage="Collect update counters and create affinity messages" (0 ms), stage="Assign partitions states" (0 ms), stage="Validate partitions states" (0 ms), stage="Ideal affinity diff calculation (enforced)" (0 ms), stage="Apply update counters" (0 ms), stage="Full message preparing" (2 ms), stage="Full message sending" (0 ms), stage="State finish message sending" (0 ms), stage="Detect lost partitions" (1 ms), stage="Exchange done" (3 ms), stage="Total time" (25 ms)] [21:02:37] : [Step 4/5] [2021-11-19 21:02:37,825][INFO ][main][root] >>> Non-Heap: 117 MB used / 125 MB commited / 0 MB max <<< [21:02:37] : [Step 4/5] [2021-11-19 21:02:37,827][INFO ][exchange-worker-#3537%failure.FailureHandlingConfigurationTest0%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=1, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=1, minorTopVer=1], stage="Affinity initialization on cache group start [grp=ignite-sys-cache]" (0 ms) (parent=Affinity initialization on cache group start), stage="Affinity centralized initialization (crd) [grp=ignite-sys-cache, crd=true]" (0 ms) (parent=Determine exchange type), stage="Restore partition states [grp=ignite-sys-cache]" (0 ms) (parent=Restore partition states), stage="Affinity recalculation (partitions availability) [grp=ignite-sys-cache]" (0 ms) (parent=Ideal affinity diff calculation (enforced))] [21:02:37] : [Step 4/5] [2021-11-19 21:02:37,829][INFO ][exchange-worker-#3537%failure.FailureHandlingConfigurationTest0%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=1, minorTopVer=1], crd=true] [21:02:37] : [Step 4/5] [2021-11-19 21:02:37,827][INFO ][main][root] >>> Stopping grid [name=failure.FailureHandlingConfigurationTest0, id=982396f4-ac9d-49b5-835c-74204a400000] [21:02:37] : [Step 4/5] [2021-11-19 21:02:37,830][INFO ][exchange-worker-#3537%failure.FailureHandlingConfigurationTest0%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=1, minorTopVer=1], force=false, evt=DISCOVERY_CUSTOM_EVT, node=982396f4-ac9d-49b5-835c-74204a400000] [21:02:37] : [Step 4/5] [2021-11-19 21:02:37,841][INFO ][db-checkpoint-thread-#3544%failure.FailureHandlingConfigurationTest0%][Checkpointer] Checkpoint finished [cpId=0bbbf008-f482-4af1-9ac8-7232e176f5bc, pages=16, markPos=WALPointer [idx=0, fileOff=66537, len=1963], walSegmentsCovered=[], markDuration=4ms, pagesWrite=6ms, fsync=18ms, total=34ms] [21:02:37] : [Step 4/5] [2021-11-19 21:02:37,850][INFO ][main][GridCacheProcessor] Stopped cache [cacheName=ignite-sys-cache] [21:02:38] : [Step 4/5] [2021-11-19 21:02:38,444][INFO ][main][FilePageStoreManager] Cleanup cache stores [total=3, left=0, cleanFiles=false] [21:02:38] : [Step 4/5] [2021-11-19 21:02:38,452][INFO ][main][FailureHandlingConfigurationTest0] [21:02:38] : [Step 4/5] [21:02:38] : [Step 4/5] >>> +------------------------------------------------------+ [21:02:38] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV stopped OK [21:02:38] : [Step 4/5] >>> +------------------------------------------------------+ [21:02:38] : [Step 4/5] >>> Ignite instance name: failure.FailureHandlingConfigurationTest0 [21:02:38] : [Step 4/5] >>> Grid uptime: 00:00:00.666 [21:02:38] : [Step 4/5] [21:02:38] : [Step 4/5] [21:02:38] : [Step 4/5] [21:02:38] >>> Starting test: FailureHandlingConfigurationTest#testOverridingBySysProps <<< [21:02:38] : [Step 4/5] [2021-11-19 21:02:38,504][INFO ][main][root] >>> Starting test: FailureHandlingConfigurationTest#testOverridingBySysProps <<< [21:02:38] : [Step 4/5] [21:02:38] >>> Heap: 439 MB used / 1944 MB commited / 1944 MB max <<< [21:02:38] : [Step 4/5] [2021-11-19 21:02:38,504][INFO ][main][root] >>> Heap: 439 MB used / 1944 MB commited / 1944 MB max <<< [21:02:38] : [Step 4/5] [21:02:38] >>> Non-Heap: 117 MB used / 125 MB commited / 0 MB max <<< [21:02:38] : [Step 4/5] [2021-11-19 21:02:38,505][INFO ][main][root] >>> Non-Heap: 117 MB used / 125 MB commited / 0 MB max <<< [21:02:38]W: [org.apache.ignite:ignite-core] [2021-11-19 21:02:38,512][WARN ][test-runner-#3553%failure.FailureHandlingConfigurationTest%][G] Ignite work directory is not provided, automatically resolved to: /opt/buildagent/work/7bc1c54bc719b67c/work [21:02:38]W: [org.apache.ignite:ignite-core] [2021-11-19 21:02:38,513][WARN ][test-runner-#3553%failure.FailureHandlingConfigurationTest%][G] Consistent ID is not set, it is recommended to set consistent ID for production clusters (use IgniteConfiguration.setConsistentId property) [21:02:38] : [Step 4/5] [2021-11-19 21:02:38,515][INFO ][test-runner-#3553%failure.FailureHandlingConfigurationTest%][FailureHandlingConfigurationTest0] [21:02:38] : [Step 4/5] [21:02:38] : [Step 4/5] >>> __________ ________________ [21:02:38] : [Step 4/5] >>> / _/ ___/ |/ / _/_ __/ __/ [21:02:38] : [Step 4/5] >>> _/ // (7 7 // / / / / _/ [21:02:38] : [Step 4/5] >>> /___/\___/_/|_/___/ /_/ /___/ [21:02:38] : [Step 4/5] >>> [21:02:38] : [Step 4/5] >>> ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:02:38] : [Step 4/5] >>> 2021 Copyright(C) Apache Software Foundation [21:02:38] : [Step 4/5] >>> [21:02:38] : [Step 4/5] >>> Ignite documentation: http://ignite.apache.org [21:02:38] : [Step 4/5] [21:02:38] : [Step 4/5] [2021-11-19 21:02:38,516][INFO ][test-runner-#3553%failure.FailureHandlingConfigurationTest%][FailureHandlingConfigurationTest0] Config URL: n/a [21:02:38] : [Step 4/5] [2021-11-19 21:02:38,517][INFO ][test-runner-#3553%failure.FailureHandlingConfigurationTest%][FailureHandlingConfigurationTest0] IgniteConfiguration [igniteInstanceName=failure.FailureHandlingConfigurationTest0, pubPoolSize=24, svcPoolSize=24, callbackPoolSize=24, stripedPoolSize=24, sysPoolSize=24, mgmtPoolSize=4, dataStreamerPoolSize=24, utilityCachePoolSize=24, utilityCacheKeepAliveTime=60000, p2pPoolSize=2, qryPoolSize=24, buildIdxPoolSize=4, igniteHome=/opt/buildagent/work/7bc1c54bc719b67c, igniteWorkDir=/opt/buildagent/work/7bc1c54bc719b67c/work, mbeanSrv=com.sun.jmx.mbeanserver.JmxMBeanServer@6fe85038, nodeId=df5023b7-d506-4989-a3b0-12d5b7500000, marsh=BinaryMarshaller [], marshLocJobs=false, daemon=false, p2pEnabled=true, netTimeout=10000, netCompressionLevel=1, sndRetryDelay=1000, sndRetryCnt=3, metricsHistSize=10000, metricsUpdateFreq=1000, metricsExpTime=9223372036854775807, discoSpi=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=0, ackTimeout=0, marsh=null, reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], segPlc=STOP, segResolveAttempts=2, waitForSegOnStart=true, allResolversPassReq=true, segChkFreq=10000, commSpi=TcpCommunicationSpi [connectGate=org.apache.ignite.spi.communication.tcp.internal.ConnectGateway@6cca1374, ctxInitLatch=java.util.concurrent.CountDownLatch@50da1482[Count = 1], stopping=false, clientPool=null, nioSrvWrapper=null, stateProvider=null], evtSpi=MemoryEventStorageSpi [expireAgeMs=9223372036854775807, expireCnt=10000, filter=null], colSpi=NoopCollisionSpi [], deploySpi=LocalDeploymentSpi [], indexingSpi=org.apache.ignite.spi.indexing.noop.NoopIndexingSpi@5c88f736, addrRslvr=null, encryptionSpi=org.apache.ignite.spi.encryption.noop.NoopEncryptionSpi@2eb26df0, tracingSpi=org.apache.ignite.spi.tracing.NoopTracingSpi@15d58ce4, clientMode=false, rebalanceThreadPoolSize=4, rebalanceTimeout=10000, rebalanceBatchesPrefetchCnt=3, rebalanceThrottle=0, rebalanceBatchSize=524288, txCfg=TransactionConfiguration [txSerEnabled=false, dfltIsolation=REPEATABLE_READ, dfltConcurrency=PESSIMISTIC, dfltTxTimeout=0, txTimeoutOnPartitionMapExchange=0, deadlockTimeout=10000, pessimisticTxLogSize=0, pessimisticTxLogLinger=10000, tmLookupClsName=null, txManagerFactory=null, useJtaSync=false], cacheSanityCheckEnabled=true, discoStartupDelay=60000, deployMode=SHARED, p2pMissedCacheSize=100, locHost=127.0.0.1, timeSrvPortBase=31100, timeSrvPortRange=100, failureDetectionTimeout=10000, sysWorkerBlockedTimeout=1, clientFailureDetectionTimeout=10000, metricsLogFreq=0, connectorCfg=null, odbcCfg=null, warmupClos=null, atomicCfg=AtomicConfiguration [seqReserveSize=1000, cacheMode=PARTITIONED, backups=1, aff=null, grpName=null], classLdr=null, sslCtxFactory=null, platformCfg=null, binaryCfg=null, memCfg=null, pstCfg=null, dsCfg=DataStorageConfiguration [sysRegionInitSize=41943040, sysRegionMaxSize=104857600, pageSize=0, concLvl=0, dfltDataRegConf=DataRegionConfiguration [name=default, maxSize=268435456, initSize=268435456, swapPath=null, pageEvictionMode=DISABLED, pageReplacementMode=CLOCK, evictionThreshold=0.9, emptyPagesPoolSize=100, metricsEnabled=false, metricsSubIntervalCount=5, metricsRateTimeInterval=60000, persistenceEnabled=true, checkpointPageBufSize=0, lazyMemoryAllocation=true, warmUpCfg=null], dataRegions=null, storagePath=null, checkpointFreq=180000, lockWaitTime=10000, checkpointThreads=4, checkpointWriteOrder=SEQUENTIAL, walHistSize=20, maxWalArchiveSize=1073741824, walSegments=10, walSegmentSize=67108864, walPath=db/wal, walArchivePath=db/wal/archive, cdcWalPath=db/wal/cdc, cdcEnabled=false, metricsEnabled=false, walMode=LOG_ONLY, walTlbSize=131072, walBuffSize=0, walFlushFreq=2000, walFsyncDelay=1000, walRecordIterBuffSize=67108864, alwaysWriteFullPages=false, fileIOFactory=org.apache.ignite.internal.processors.cache.persistence.file.AsyncFileIOFactory@722b743c, metricsSubIntervalCnt=5, metricsRateTimeInterval=60000, walAutoArchiveAfterInactivity=-1, walForceArchiveTimeout=-1, writeThrottlingEnabled=false, walCompactionEnabled=false, walCompactionLevel=1, checkpointReadLockTimeout=2, walPageCompression=DISABLED, walPageCompressionLevel=null, dfltWarmUpCfg=null, encCfg=org.apache.ignite.configuration.EncryptionConfiguration@4bd4db3f, defragmentationThreadPoolSize=4, minWalArchiveSize=-1], snapshotPath=snapshots, activeOnStart=true, activeOnStartPropSetFlag=false, autoActivation=true, autoActivationPropSetFlag=false, clusterStateOnStart=null, sqlConnCfg=null, cliConnCfg=ClientConnectorConfiguration [host=null, port=10800, portRange=100, sockSndBufSize=0, sockRcvBufSize=0, tcpNoDelay=true, maxOpenCursorsPerConn=128, threadPoolSize=24, selectorCnt=12, idleTimeout=0, handshakeTimeout=10000, jdbcEnabled=true, odbcEnabled=true, thinCliEnabled=true, sslEnabled=false, useIgniteSslCtxFactory=true, sslClientAuth=false, sslCtxFactory=null, thinCliCfg=ThinClientConfiguration [maxActiveTxPerConn=100, maxActiveComputeTasksPerConn=0]], mvccVacuumThreadCnt=2, mvccVacuumFreq=5000, authEnabled=false, failureHnd=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]], commFailureRslvr=null, sqlCfg=SqlConfiguration [longQryWarnTimeout=3000, dfltQryTimeout=0, sqlQryHistSize=1000, validationEnabled=false], asyncContinuationExecutor=null] [21:02:38] : [Step 4/5] [2021-11-19 21:02:38,525][INFO ][test-runner-#3553%failure.FailureHandlingConfigurationTest%][FailureHandlingConfigurationTest0] Daemon mode: off [21:02:38] : [Step 4/5] [2021-11-19 21:02:38,525][INFO ][test-runner-#3553%failure.FailureHandlingConfigurationTest%][FailureHandlingConfigurationTest0] OS: Linux 4.15.0-151-generic amd64 [21:02:38] : [Step 4/5] [2021-11-19 21:02:38,525][INFO ][test-runner-#3553%failure.FailureHandlingConfigurationTest%][FailureHandlingConfigurationTest0] OS user: teamcity [21:02:38] : [Step 4/5] [2021-11-19 21:02:38,525][INFO ][test-runner-#3553%failure.FailureHandlingConfigurationTest%][FailureHandlingConfigurationTest0] PID: 16724 [21:02:38] : [Step 4/5] [2021-11-19 21:02:38,526][INFO ][test-runner-#3553%failure.FailureHandlingConfigurationTest%][FailureHandlingConfigurationTest0] Language runtime: Java Platform API Specification ver. 1.8 [21:02:38] : [Step 4/5] [2021-11-19 21:02:38,526][INFO ][test-runner-#3553%failure.FailureHandlingConfigurationTest%][FailureHandlingConfigurationTest0] VM information: Java(TM) SE Runtime Environment 1.8.0_261-b12 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 25.261-b12 [21:02:38] : [Step 4/5] [2021-11-19 21:02:38,526][INFO ][test-runner-#3553%failure.FailureHandlingConfigurationTest%][FailureHandlingConfigurationTest0] VM total memory: 1.9GB [21:02:38] : [Step 4/5] [2021-11-19 21:02:38,527][INFO ][test-runner-#3553%failure.FailureHandlingConfigurationTest%][FailureHandlingConfigurationTest0] Remote Management [restart: off, REST: off, JMX (remote: off)] [21:02:38] : [Step 4/5] [2021-11-19 21:02:38,527][INFO ][test-runner-#3553%failure.FailureHandlingConfigurationTest%][FailureHandlingConfigurationTest0] Logger: GridTestLog4jLogger [quiet=false, config=null] [21:02:38] : [Step 4/5] [2021-11-19 21:02:38,527][INFO ][test-runner-#3553%failure.FailureHandlingConfigurationTest%][FailureHandlingConfigurationTest0] IGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c [21:02:38] : [Step 4/5] [2021-11-19 21:02:38,527][INFO ][test-runner-#3553%failure.FailureHandlingConfigurationTest%][FailureHandlingConfigurationTest0] VM arguments: [-DIGNITE_DUMP_THREADS_ON_FAILURE=false, -DMono=/usr/bin/mono-sgen, -DMono4.0_x64=/usr/lib/mono/4.0, -DMono4.5_x64=/usr/lib/mono/4.5, -DMonoVersion=6.12.0.90, -DSKIP_BUILD=false, -Dagent.home.dir=/opt/buildagent, -Dagent.name=aitc-lin02_03, -Dagent.ownPort=9090, -Dagent.work.dir=/opt/buildagent/work, -Dbuild.number=95, -Dbuild.vcs.number=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.1=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.GitHubApacheIgnite=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dclassworlds.conf=/opt/buildagent/temp/buildTmp/teamcity.m2.conf, -Dcom.jetbrains.maven.watcher.report.file=/opt/buildagent/temp/buildTmp/maven-build-info.xml, -Djava.io.tmpdir=/opt/buildagent/temp/buildTmp, -Dmaven.home=/opt/buildagent/tools/maven3_6, -Dmaven.multiModuleProjectDirectory=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.agent.cpuBenchmark=457, -Dteamcity.agent.dotnet.agent_url=http://localhost:9090/RPC2, -Dteamcity.agent.dotnet.build_id=6278078, -Dteamcity.auth.password=*******, -Dteamcity.auth.userId=TeamCityBuildId=6278078, -Dteamcity.build.changedFiles.file=/opt/buildagent/temp/buildTmp/changedFiles6342607772318147725.txt, -Dteamcity.build.checkoutDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.build.id=6278078, -Dteamcity.build.properties.file=/opt/buildagent/temp/buildTmp/teamcity.build5164517880467851002.properties, -Dteamcity.build.tempDir=/opt/buildagent/temp/buildTmp, -Dteamcity.build.workingDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.buildConfName=Basic 3, -Dteamcity.buildType.id=IgniteTests24Java8_Basic3, -Dteamcity.configuration.properties.file=/opt/buildagent/temp/buildTmp/teamcity.config5591980786735343870.properties, -Dteamcity.maven.userSettings.path=/opt/buildagent/temp/buildTmp/maven_settings_585072866407032347.xml, -Dteamcity.maven.watcher.home=/opt/buildagent/plugins/mavenPlugin/maven-watcher-jdk16, -Dteamcity.projectName=Ignite Tests 2.x (JDK 8/11), -Dteamcity.runner.properties.file=/opt/buildagent/temp/buildTmp/teamcity.runner9098465561618137420.properties, -Dteamcity.tests.recentlyFailedTests.file=/opt/buildagent/temp/buildTmp/testsToRunFirst3891775683130404069.txt, -Dteamcity.version=2021.2 (build 99542), -ea, -Xms2g, -Xmx2g, -XX:+HeapDumpOnOutOfMemoryError, -DIGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_TEST_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_UPDATE_NOTIFIER=false, -DIGNITE_NO_DISCO_ORDER=true, -DIGNITE_PERFORMANCE_SUGGESTIONS_DISABLED=true, -Djava.net.preferIPv4Stack=true, -DTEST_SCALE_FACTOR=1.0, -DIGNITE_TEST_PROP_LOG4J_FILE=log4j-tc-test.xml, -DIGNITE_QUIET=false, -DIGNITE_MARSHAL_BUFFERS_RECHECK=1000, -Dmaven.repo.local=/opt/buildagent/.m2/repository] [21:02:38] : [Step 4/5] [2021-11-19 21:02:38,532][INFO ][test-runner-#3553%failure.FailureHandlingConfigurationTest%][FailureHandlingConfigurationTest0] System cache's DataRegion size is configured to 40 MB. Use DataStorageConfiguration.systemRegionInitialSize property to change the setting. [21:02:38] : [Step 4/5] [2021-11-19 21:02:38,532][INFO ][test-runner-#3553%failure.FailureHandlingConfigurationTest%][FailureHandlingConfigurationTest0] Configured caches [in 'sysMemPlc' dataRegion: ['ignite-sys-cache']] [21:02:38]W: [org.apache.ignite:ignite-core] [2021-11-19 21:02:38,532][WARN ][test-runner-#3553%failure.FailureHandlingConfigurationTest%][FailureHandlingConfigurationTest0] Peer class loading is enabled (disable it in production for performance and deployment consistency reasons) [21:02:38] : [Step 4/5] [2021-11-19 21:02:38,533][INFO ][test-runner-#3553%failure.FailureHandlingConfigurationTest%][FailureHandlingConfigurationTest0] 3-rd party licenses can be found at: /opt/buildagent/work/7bc1c54bc719b67c/libs/licenses [21:02:38] : [Step 4/5] [2021-11-19 21:02:38,536][INFO ][test-runner-#3553%failure.FailureHandlingConfigurationTest%][IgnitePluginProcessor] Configured plugins: [21:02:38] : [Step 4/5] [2021-11-19 21:02:38,537][INFO ][test-runner-#3553%failure.FailureHandlingConfigurationTest%][IgnitePluginProcessor] ^-- StanByClusterTestProvider 1.0 [21:02:38] : [Step 4/5] [2021-11-19 21:02:38,537][INFO ][test-runner-#3553%failure.FailureHandlingConfigurationTest%][IgnitePluginProcessor] ^-- null [21:02:38] : [Step 4/5] [2021-11-19 21:02:38,537][INFO ][test-runner-#3553%failure.FailureHandlingConfigurationTest%][IgnitePluginProcessor] [21:02:38] : [Step 4/5] [2021-11-19 21:02:38,537][INFO ][test-runner-#3553%failure.FailureHandlingConfigurationTest%][IgnitePluginProcessor] ^-- PageMemory tracker plugin 1.0 [21:02:38] : [Step 4/5] [2021-11-19 21:02:38,537][INFO ][test-runner-#3553%failure.FailureHandlingConfigurationTest%][IgnitePluginProcessor] ^-- null [21:02:38] : [Step 4/5] [2021-11-19 21:02:38,537][INFO ][test-runner-#3553%failure.FailureHandlingConfigurationTest%][IgnitePluginProcessor] [21:02:38] : [Step 4/5] [2021-11-19 21:02:38,538][INFO ][test-runner-#3553%failure.FailureHandlingConfigurationTest%][IgnitePluginProcessor] ^-- TestDistibutedConfigurationPlugin 1.0 [21:02:38] : [Step 4/5] [2021-11-19 21:02:38,538][INFO ][test-runner-#3553%failure.FailureHandlingConfigurationTest%][IgnitePluginProcessor] ^-- null [21:02:38] : [Step 4/5] [2021-11-19 21:02:38,538][INFO ][test-runner-#3553%failure.FailureHandlingConfigurationTest%][IgnitePluginProcessor] [21:02:38] : [Step 4/5] [2021-11-19 21:02:38,538][INFO ][test-runner-#3553%failure.FailureHandlingConfigurationTest%][IgnitePluginProcessor] ^-- NodeValidationPluginProvider 1.0 [21:02:38] : [Step 4/5] [2021-11-19 21:02:38,538][INFO ][test-runner-#3553%failure.FailureHandlingConfigurationTest%][IgnitePluginProcessor] ^-- null [21:02:38] : [Step 4/5] [2021-11-19 21:02:38,538][INFO ][test-runner-#3553%failure.FailureHandlingConfigurationTest%][IgnitePluginProcessor] [21:02:38] : [Step 4/5] [2021-11-19 21:02:38,539][INFO ][test-runner-#3553%failure.FailureHandlingConfigurationTest%][FailureProcessor] Configured failure handler: [hnd=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]] [21:02:38] : [Step 4/5] [2021-11-19 21:02:38,551][INFO ][test-runner-#3553%failure.FailureHandlingConfigurationTest%][TcpCommunicationSpi] Successfully bound communication NIO server to TCP port [port=45050, locHost=/127.0.0.1, selectorsCnt=12, selectorSpins=0, pairedConn=false] [21:02:38]W: [org.apache.ignite:ignite-core] [2021-11-19 21:02:38,552][WARN ][test-runner-#3553%failure.FailureHandlingConfigurationTest%][TcpCommunicationSpi] Message queue limit is set to 0 which may lead to potential OOMEs when running cache operations in FULL_ASYNC or PRIMARY_SYNC modes due to message queues growth on sender and receiver sides. [21:02:38] : [Step 4/5] [2021-11-19 21:02:38,557][INFO ][test-runner-#3553%failure.FailureHandlingConfigurationTest%][GridCollisionManager] Collision resolution is disabled (all jobs will be activated upon arrival). [21:02:38] : [Step 4/5] [2021-11-19 21:02:38,557][INFO ][test-runner-#3553%failure.FailureHandlingConfigurationTest%][FailureHandlingConfigurationTest0] Security status [authentication=off, sandbox=off, tls/ssl=off] [21:02:38] : [Step 4/5] [2021-11-19 21:02:38,558][INFO ][test-runner-#3553%failure.FailureHandlingConfigurationTest%][TestTcpDiscoverySpi] Successfully bound to TCP port [port=47500, localHost=localhost/127.0.0.1, locNodeId=df5023b7-d506-4989-a3b0-12d5b7500000] [21:02:38] : [Step 4/5] [2021-11-19 21:02:38,569][INFO ][test-runner-#3553%failure.FailureHandlingConfigurationTest%][PdsFoldersResolver] Successfully created new persistent storage folder [/opt/buildagent/work/7bc1c54bc719b67c/work/db/node00-8b4c9412-6976-40d8-904d-c5ed0468fa0a] [21:02:38] : [Step 4/5] [2021-11-19 21:02:38,569][INFO ][test-runner-#3553%failure.FailureHandlingConfigurationTest%][PdsFoldersResolver] Consistent ID used for local node is [8b4c9412-6976-40d8-904d-c5ed0468fa0a] according to persistence data storage folders [21:02:38] : [Step 4/5] [2021-11-19 21:02:38,569][INFO ][test-runner-#3553%failure.FailureHandlingConfigurationTest%][MaintenanceProcessor] Resolved store directory for node persistent data: /opt/buildagent/work/7bc1c54bc719b67c/work/db/node00-8b4c9412-6976-40d8-904d-c5ed0468fa0a [21:02:38] : [Step 4/5] [2021-11-19 21:02:38,571][INFO ][test-runner-#3553%failure.FailureHandlingConfigurationTest%][CacheObjectBinaryProcessorImpl] Resolved directory for serialized binary metadata: /opt/buildagent/work/7bc1c54bc719b67c/work/db/binary_meta/node00-8b4c9412-6976-40d8-904d-c5ed0468fa0a [21:02:38] : [Step 4/5] [2021-11-19 21:02:38,576][INFO ][test-runner-#3553%failure.FailureHandlingConfigurationTest%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/node00-8b4c9412-6976-40d8-904d-c5ed0468fa0a [21:02:38] : [Step 4/5] [2021-11-19 21:02:38,577][INFO ][test-runner-#3553%failure.FailureHandlingConfigurationTest%][FileWriteAheadLogManager] Resolved write ahead log work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/node00-8b4c9412-6976-40d8-904d-c5ed0468fa0a [21:02:38] : [Step 4/5] [2021-11-19 21:02:38,577][INFO ][test-runner-#3553%failure.FailureHandlingConfigurationTest%][FileWriteAheadLogManager] Resolved write ahead log archive directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/node00-8b4c9412-6976-40d8-904d-c5ed0468fa0a [21:02:39] : [Step 4/5] [2021-11-19 21:02:39,162][INFO ][test-runner-#3553%failure.FailureHandlingConfigurationTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/node00-8b4c9412-6976-40d8-904d-c5ed0468fa0a/0000000000000000.wal [21:02:39] : [Step 4/5] [2021-11-19 21:02:39,163][INFO ][test-runner-#3553%failure.FailureHandlingConfigurationTest%][FileHandleManagerImpl] Initialized write-ahead log manager [mode=LOG_ONLY] [21:02:39] : [Step 4/5] [2021-11-19 21:02:39,168][INFO ][test-runner-#3553%failure.FailureHandlingConfigurationTest%][GridCacheDatabaseSharedManager] Configured data regions initialized successfully [total=5] [21:02:39] : [Step 4/5] [2021-11-19 21:02:39,169][INFO ][test-runner-#3553%failure.FailureHandlingConfigurationTest%][IgniteSnapshotManager] Resolved snapshot work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/snapshots [21:02:39] : [Step 4/5] [2021-11-19 21:02:39,169][INFO ][test-runner-#3553%failure.FailureHandlingConfigurationTest%][IgniteSnapshotManager] Resolved temp directory for snapshot creation: /opt/buildagent/work/7bc1c54bc719b67c/work/db/node00-8b4c9412-6976-40d8-904d-c5ed0468fa0a/snp [21:02:39] : [Step 4/5] [2021-11-19 21:02:39,173][INFO ][test-runner-#3553%failure.FailureHandlingConfigurationTest%][ClientListenerProcessor] Client connector processor has started on TCP port 10800 [21:02:39] : [Step 4/5] [2021-11-19 21:02:39,175][INFO ][test-runner-#3553%failure.FailureHandlingConfigurationTest%][FailureHandlingConfigurationTest0] Non-loopback local IPs: 172.17.0.4 [21:02:39] : [Step 4/5] [2021-11-19 21:02:39,175][INFO ][test-runner-#3553%failure.FailureHandlingConfigurationTest%][FailureHandlingConfigurationTest0] Enabled local MACs: 0242AC110004 [21:02:39] : [Step 4/5] [2021-11-19 21:02:39,176][INFO ][test-runner-#3553%failure.FailureHandlingConfigurationTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:02:39] : [Step 4/5] [2021-11-19 21:02:39,177][INFO ][test-runner-#3553%failure.FailureHandlingConfigurationTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:02:39] : [Step 4/5] [2021-11-19 21:02:39,177][INFO ][test-runner-#3553%failure.FailureHandlingConfigurationTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:02:39] : [Step 4/5] [2021-11-19 21:02:39,179][INFO ][test-runner-#3553%failure.FailureHandlingConfigurationTest%][GridCacheDatabaseSharedManager] Applying lost metastore updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:02:39] : [Step 4/5] [2021-11-19 21:02:39,180][INFO ][test-runner-#3553%failure.FailureHandlingConfigurationTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=0 ms] [21:02:39] : [Step 4/5] [2021-11-19 21:02:39,181][INFO ][test-runner-#3553%failure.FailureHandlingConfigurationTest%][GridCacheProcessor] Restoring partition state for local groups. [21:02:39] : [Step 4/5] [2021-11-19 21:02:39,181][INFO ][test-runner-#3553%failure.FailureHandlingConfigurationTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=0, partitionsProcessed=0, time=0ms] [21:02:39] : [Step 4/5] [2021-11-19 21:02:39,181][INFO ][test-runner-#3553%failure.FailureHandlingConfigurationTest%][GridEncryptionManager] Encryption keys loaded from metastore. [grps=, masterKeyName=null] [21:02:39] : [Step 4/5] [2021-11-19 21:02:39,183][INFO ][test-runner-#3553%failure.FailureHandlingConfigurationTest%][ClusterProcessor] Cluster ID and tag has been read from metastorage: null [21:02:39] : [Step 4/5] [2021-11-19 21:02:39,183][INFO ][test-runner-#3553%failure.FailureHandlingConfigurationTest%][IgniteClusterImpl] Shutdown policy was updated [oldVal=null, newVal=null] [21:02:39] : [Step 4/5] [2021-11-19 21:02:39,183][INFO ][test-runner-#3553%failure.FailureHandlingConfigurationTest%][GridCacheDatabaseSharedManager] Checkpoint frequency deviation changed [oldVal=null, newVal=null] [21:02:39] : [Step 4/5] [2021-11-19 21:02:39,193][INFO ][test-runner-#3553%failure.FailureHandlingConfigurationTest%][FilePageStoreManager] Cleanup cache stores [total=1, left=0, cleanFiles=false] [21:02:39] : [Step 4/5] [2021-11-19 21:02:39,195][INFO ][test-runner-#3553%failure.FailureHandlingConfigurationTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:02:39] : [Step 4/5] [2021-11-19 21:02:39,196][INFO ][test-runner-#3553%failure.FailureHandlingConfigurationTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:02:39] : [Step 4/5] [2021-11-19 21:02:39,197][INFO ][test-runner-#3553%failure.FailureHandlingConfigurationTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:02:39] : [Step 4/5] [2021-11-19 21:02:39,198][INFO ][test-runner-#3553%failure.FailureHandlingConfigurationTest%][GridCacheDatabaseSharedManager] Data Regions Started: 5 [21:02:39] : [Step 4/5] [2021-11-19 21:02:39,198][INFO ][test-runner-#3553%failure.FailureHandlingConfigurationTest%][GridCacheDatabaseSharedManager] ^-- sysMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:02:39] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:02:39] : [Step 4/5] ^-- default region [type=default, persistence=true, lazyAlloc=true, [21:02:39] : [Step 4/5] ... initCfg=256MB, maxCfg=256MB, usedRam=0MB, freeRam=100%, allocRam=0MB, allocTotal=0MB] [21:02:39] : [Step 4/5] ^-- metastoreMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:02:39] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:02:39] : [Step 4/5] ^-- TxLog region [type=internal, persistence=true, lazyAlloc=false, [21:02:39] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:02:39] : [Step 4/5] ^-- volatileDsMemPlc region [type=user, persistence=false, lazyAlloc=true, [21:02:39] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB] [21:02:39] : [Step 4/5] ^-- Ignite persistence [used=0MB] [21:02:39] : [Step 4/5] [21:02:39] : [Step 4/5] [2021-11-19 21:02:39,199][INFO ][test-runner-#3553%failure.FailureHandlingConfigurationTest%][GridCacheDatabaseSharedManager] Starting binary memory restore for: [-2100569601] [21:02:39] : [Step 4/5] [2021-11-19 21:02:39,206][INFO ][test-runner-#3553%failure.FailureHandlingConfigurationTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:02:39] : [Step 4/5] [2021-11-19 21:02:39,207][INFO ][test-runner-#3553%failure.FailureHandlingConfigurationTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:02:39] : [Step 4/5] [2021-11-19 21:02:39,209][INFO ][test-runner-#3553%failure.FailureHandlingConfigurationTest%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/node00-8b4c9412-6976-40d8-904d-c5ed0468fa0a/0000000000000000.wal, offset=0, ver=2] [21:02:39] : [Step 4/5] [2021-11-19 21:02:39,212][INFO ][test-runner-#3553%failure.FailureHandlingConfigurationTest%][GridCacheProcessor] Started cache in recovery mode [name=ignite-sys-cache, id=-2100569601, dataRegionName=sysMemPlc, mode=REPLICATED, atomicity=TRANSACTIONAL, backups=2147483647, mvcc=false] [21:02:39] : [Step 4/5] [2021-11-19 21:02:39,213][INFO ][test-runner-#3553%failure.FailureHandlingConfigurationTest%][GridCacheDatabaseSharedManager] Binary recovery performed in 14 ms. [21:02:39] : [Step 4/5] [2021-11-19 21:02:39,213][INFO ][test-runner-#3553%failure.FailureHandlingConfigurationTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:02:39] : [Step 4/5] [2021-11-19 21:02:39,213][INFO ][test-runner-#3553%failure.FailureHandlingConfigurationTest%][GridCacheDatabaseSharedManager] Applying lost cache updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:02:39] : [Step 4/5] [2021-11-19 21:02:39,271][INFO ][test-runner-#3553%failure.FailureHandlingConfigurationTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=50 ms] [21:02:39] : [Step 4/5] [2021-11-19 21:02:39,272][INFO ][test-runner-#3553%failure.FailureHandlingConfigurationTest%][GridCacheProcessor] Restoring partition state for local groups. [21:02:39] : [Step 4/5] [2021-11-19 21:02:39,277][INFO ][test-runner-#3553%failure.FailureHandlingConfigurationTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=1, partitionsProcessed=100, time=10ms] [21:02:39] : [Step 4/5] [2021-11-19 21:02:39,749][INFO ][disco-notifier-worker-#3665%failure.FailureHandlingConfigurationTest0%][MvccProcessorImpl] Assigned mvcc coordinator [crd=MvccCoordinator [topVer=AffinityTopologyVersion [topVer=1, minorTopVer=0], nodeId=df5023b7-d506-4989-a3b0-12d5b7500000, ver=1637344959749, local=true, initialized=false]] [21:02:39] : [Step 4/5] [2021-11-19 21:02:39,750][INFO ][sys-#3641%failure.FailureHandlingConfigurationTest0%][ClusterProcessor] Writing cluster ID and tag to metastorage on ready for write ClusterIdAndTag [id=2afd3fde-8605-4b4f-a6fb-88c996d11f00, tag=magical_gates] [21:02:39] : [Step 4/5] [2021-11-19 21:02:39,751][INFO ][disco-notifier-worker-#3665%failure.FailureHandlingConfigurationTest0%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustEnabled' was changed from 'null' to 'false' [21:02:39] : [Step 4/5] [2021-11-19 21:02:39,752][INFO ][disco-notifier-worker-#3665%failure.FailureHandlingConfigurationTest0%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustTimeout' was changed from 'null' to '300000' [21:02:39] : [Step 4/5] [2021-11-19 21:02:39,752][INFO ][disco-notifier-worker-#3665%failure.FailureHandlingConfigurationTest0%][IgniteTxManager] Transactions parameter 'longOperationsDumpTimeout' was changed from 'null' to '60000' [21:02:39] : [Step 4/5] [2021-11-19 21:02:39,753][INFO ][disco-notifier-worker-#3665%failure.FailureHandlingConfigurationTest0%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpThreshold' was changed from 'null' to '0' [21:02:39] : [Step 4/5] [2021-11-19 21:02:39,754][INFO ][disco-notifier-worker-#3665%failure.FailureHandlingConfigurationTest0%][IgniteTxManager] Transactions parameter 'transactionTimeDumpSamplesCoefficient' was changed from 'null' to '0.0' [21:02:39] : [Step 4/5] [2021-11-19 21:02:39,754][INFO ][disco-notifier-worker-#3665%failure.FailureHandlingConfigurationTest0%][ClusterProcessor] magical_gates [21:02:39] : [Step 4/5] [2021-11-19 21:02:39,755][INFO ][disco-notifier-worker-#3665%failure.FailureHandlingConfigurationTest0%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpSamplesPerSecondLimit' was changed from 'null' to '5' [21:02:39] : [Step 4/5] [2021-11-19 21:02:39,755][INFO ][disco-notifier-worker-#3665%failure.FailureHandlingConfigurationTest0%][IgniteTxManager] Transactions parameter 'collisionsDumpInterval' was changed from 'null' to '1000' [21:02:39] : [Step 4/5] [2021-11-19 21:02:39,756][INFO ][disco-notifier-worker-#3665%failure.FailureHandlingConfigurationTest0%][IgniteTxManager] Transactions parameter 'txOwnerDumpRequestsAllowed' was changed from 'null' to 'true' [21:02:39] : [Step 4/5] [2021-11-19 21:02:39,756][INFO ][disco-notifier-worker-#3665%failure.FailureHandlingConfigurationTest0%][GridCacheDatabaseSharedManager] Historical rebalance WAL threshold changed [property=historical.rebalance.threshold, oldVal=null, newVal=500] [21:02:39] : [Step 4/5] [2021-11-19 21:02:39,771][INFO ][test-runner-#3553%failure.FailureHandlingConfigurationTest%][FailureHandlingConfigurationTest0] To start Console Management & Monitoring run ignitevisorcmd.{sh|bat} [21:02:39] : [Step 4/5] [2021-11-19 21:02:39,772][INFO ][test-runner-#3553%failure.FailureHandlingConfigurationTest%][FailureHandlingConfigurationTest0] [21:02:39] : [Step 4/5] [21:02:39] : [Step 4/5] >>> +-------------------------------------------+ [21:02:39] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:02:39] : [Step 4/5] >>> +-------------------------------------------+ [21:02:39] : [Step 4/5] >>> OS name: Linux 4.15.0-151-generic amd64 [21:02:39] : [Step 4/5] >>> CPU(s): 24 [21:02:39] : [Step 4/5] >>> Heap: 2.0GB [21:02:39] : [Step 4/5] >>> VM name: 16724@c4dfe9a430b2 [21:02:39] : [Step 4/5] >>> Ignite instance name: failure.FailureHandlingConfigurationTest0 [21:02:39] : [Step 4/5] >>> Local node [ID=DF5023B7-D506-4989-A3B0-12D5B7500000, order=1, clientMode=false] [21:02:39] : [Step 4/5] >>> Local node addresses: [127.0.0.1] [21:02:39] : [Step 4/5] >>> Local ports: TCP:10800 TCP:45050 TCP:47500 [21:02:39] : [Step 4/5] [21:02:39] : [Step 4/5] [2021-11-19 21:02:39,773][INFO ][test-runner-#3553%failure.FailureHandlingConfigurationTest%][FailureHandlingConfigurationTest0] >>> Ignite cluster is in INACTIVE state (limited functionality available). Use control.(sh|bat) script or IgniteCluster.state(ClusterState.ACTIVE) to change the state. [21:02:39] : [Step 4/5] [2021-11-19 21:02:39,773][INFO ][test-runner-#3553%failure.FailureHandlingConfigurationTest%][GridDiscoveryManager] Topology snapshot [ver=1, locNode=df5023b7, servers=1, clients=0, state=INACTIVE, CPUs=24, offheap=0.25GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=df5023b7-d506-4989-a3b0-12d5b7500000, consistentId=8b4c9412-6976-40d8-904d-c5ed0468fa0a, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:02:39] : [Step 4/5] [2021-11-19 21:02:39,774][INFO ][test-runner-#3553%failure.FailureHandlingConfigurationTest%][G] Node started : [stage="Configure system pool" (0 ms),stage="Start managers" (56 ms),stage="Configure binary metadata" (2 ms),stage="Start processors" (601 ms),stage="Start 'StanByClusterTestProvider' plugin" (0 ms),stage="Start 'PageMemory tracker plugin' plugin" (0 ms),stage="Start 'TestDistibutedConfigurationPlugin' plugin" (0 ms),stage="Start 'NodeValidationPluginProvider' plugin" (0 ms),stage="Init metastore" (18 ms),stage="Init and start regions" (5 ms),stage="Restore binary memory" (13 ms),stage="Restore logical state" (64 ms),stage="Finish recovery" (466 ms),stage="Join topology" (4 ms),stage="Await transition" (2 ms),stage="Await exchange" (22 ms),stage="Total time" (1253 ms)] [21:02:39] : [Step 4/5] [2021-11-19 21:02:39,775][INFO ][test-runner-#3553%failure.FailureHandlingConfigurationTest%][root] Node started with the following configuration [id=df5023b7-d506-4989-a3b0-12d5b7500000, marshaller=BinaryMarshaller [], discovery=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=5000, ackTimeout=5000, marsh=JdkMarshaller [clsFilter=org.apache.ignite.marshaller.MarshallerUtils$1@9f6873f], reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], binaryCfg=null, lateAff=true] [21:02:39] : [Step 4/5] [2021-11-19 21:02:39,777][INFO ][test-runner-#3553%failure.FailureHandlingConfigurationTest%][GridClusterStateProcessor] Sending activate cluster request with BaselineTopology BaselineTopology [id=0, branchingHash=1981803309, branchingType='New BaselineTopology', baselineNodes=[8b4c9412-6976-40d8-904d-c5ed0468fa0a]] [21:02:39] : [Step 4/5] [2021-11-19 21:02:39,778][INFO ][disco-notifier-worker-#3665%failure.FailureHandlingConfigurationTest0%][GridClusterStateProcessor] Received activate cluster request with BaselineTopology[id=0] initiator node ID: df5023b7-d506-4989-a3b0-12d5b7500000 [21:02:39] : [Step 4/5] [2021-11-19 21:02:39,779][INFO ][disco-notifier-worker-#3665%failure.FailureHandlingConfigurationTest0%][GridClusterStateProcessor] Started state transition: activate cluster [21:02:39] : [Step 4/5] [2021-11-19 21:02:39,779][INFO ][exchange-worker-#3670%failure.FailureHandlingConfigurationTest0%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=1, minorTopVer=1], crd=true, evt=DISCOVERY_CUSTOM_EVT, evtNode=df5023b7-d506-4989-a3b0-12d5b7500000, customEvt=ChangeGlobalStateMessage [id=ddaac593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqId=64bad37c-f2c8-4875-9cd8-d7119ef5d9ac, initiatingNodeId=df5023b7-d506-4989-a3b0-12d5b7500000, state=ACTIVE, baselineTopology=BaselineTopology [id=0, branchingHash=1981803309, branchingType='New BaselineTopology', baselineNodes=[8b4c9412-6976-40d8-904d-c5ed0468fa0a]], forceChangeBaselineTopology=false, timestamp=1637344959777, forceDeactivation=true], allowMerge=false, exchangeFreeSwitch=false] [21:02:39] : [Step 4/5] [2021-11-19 21:02:39,780][INFO ][exchange-worker-#3670%failure.FailureHandlingConfigurationTest0%][GridDhtPartitionsExchangeFuture] Start activation process [nodeId=df5023b7-d506-4989-a3b0-12d5b7500000, client=false, topVer=AffinityTopologyVersion [topVer=1, minorTopVer=1]]. New state: ACTIVE [21:02:39] : [Step 4/5] [2021-11-19 21:02:39,781][INFO ][exchange-worker-#3670%failure.FailureHandlingConfigurationTest0%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/node00-8b4c9412-6976-40d8-904d-c5ed0468fa0a [21:02:39] : [Step 4/5] [2021-11-19 21:02:39,783][INFO ][exchange-worker-#3670%failure.FailureHandlingConfigurationTest0%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/node00-8b4c9412-6976-40d8-904d-c5ed0468fa0a/0000000000000000.wal, offset=8795, ver=2] [21:02:39] : [Step 4/5] [2021-11-19 21:02:39,784][INFO ][exchange-worker-#3670%failure.FailureHandlingConfigurationTest0%][GridClusterStateProcessor] Writing BaselineTopology[id=0] [21:02:39] : [Step 4/5] [2021-11-19 21:02:39,785][INFO ][exchange-worker-#3670%failure.FailureHandlingConfigurationTest0%][GridCacheDatabaseSharedManager] Finish recovery performed in 4 ms. [21:02:39] : [Step 4/5] [2021-11-19 21:02:39,786][INFO ][exchange-worker-#3670%failure.FailureHandlingConfigurationTest0%][msg] Components activation performed in 5 ms. [21:02:39] : [Step 4/5] [2021-11-19 21:02:39,787][INFO ][exchange-worker-#3670%failure.FailureHandlingConfigurationTest0%][GridCacheProcessor] Finished recovery for cache [cache=ignite-sys-cache, grp=ignite-sys-cache, startVer=AffinityTopologyVersion [topVer=1, minorTopVer=1]] [21:02:39] : [Step 4/5] [2021-11-19 21:02:39,788][INFO ][exchange-worker-#3670%failure.FailureHandlingConfigurationTest0%][GridDhtPartitionsExchangeFuture] Successfully activated caches [nodeId=df5023b7-d506-4989-a3b0-12d5b7500000, client=false, topVer=AffinityTopologyVersion [topVer=1, minorTopVer=1], newState=ACTIVE] [21:02:39] : [Step 4/5] [2021-11-19 21:02:39,789][INFO ][exchange-worker-#3670%failure.FailureHandlingConfigurationTest0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=1, minorTopVer=1], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:02:39] : [Step 4/5] [2021-11-19 21:02:39,798][INFO ][exchange-worker-#3670%failure.FailureHandlingConfigurationTest0%][GridDhtPartitionsExchangeFuture] finishExchangeOnCoordinator [topVer=AffinityTopologyVersion [topVer=1, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=1, minorTopVer=1]] [21:02:39] : [Step 4/5] [2021-11-19 21:02:39,801][INFO ][db-checkpoint-thread-#3677%failure.FailureHandlingConfigurationTest0%][Checkpointer] Checkpoint started [checkpointId=817d6b06-b613-424b-8b11-02b3c5eed375, startPtr=WALPointer [idx=0, fileOff=66545, len=1963], checkpointBeforeLockTime=2ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=1ms, writeCheckpointEntryDuration=2ms, splitAndSortCpPagesDuration=0ms, pages=16, reason='node started'] [21:02:39] : [Step 4/5] [2021-11-19 21:02:39,812][INFO ][exchange-worker-#3670%failure.FailureHandlingConfigurationTest0%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=1, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=1, minorTopVer=1], err=null, rebalanced=true, wasRebalanced=false] [21:02:39] : [Step 4/5] [2021-11-19 21:02:39,812][INFO ][disco-notifier-worker-#3665%failure.FailureHandlingConfigurationTest0%][GridClusterStateProcessor] Received state change finish message: ACTIVE [21:02:39] : [Step 4/5] [2021-11-19 21:02:39,814][INFO ][exchange-worker-#3670%failure.FailureHandlingConfigurationTest0%][GridCacheProcessor] Finish proxy initialization, cacheName=ignite-sys-cache, localNodeId=df5023b7-d506-4989-a3b0-12d5b7500000 [21:02:39] : [Step 4/5] [2021-11-19 21:02:39,822][INFO ][disco-notifier-worker-#3665%failure.FailureHandlingConfigurationTest0%][GridClusterStateProcessor] Cluster state was changed from INACTIVE to ACTIVE [21:02:39] : [Step 4/5] [2021-11-19 21:02:39,823][INFO ][sys-#3656%failure.FailureHandlingConfigurationTest0%][DistributedBaselineConfiguration] Baseline auto-adjust is 'disabled' with timeout='300000' ms [21:02:39] : [Step 4/5] [2021-11-19 21:02:39,824][INFO ][sys-#3656%failure.FailureHandlingConfigurationTest0%][GridClusterStateProcessor] Successfully [21perf:02or:39] >>> med final activation steps [nodeId=df5023b7-d506-4989-a3b0-12d5b7500000, client=Stoppifalse, topVer=AffinityTopologyVersngion test: FailureHand[topVer=1, milingConfigurationTest#testOverridinorTngBySysPropops iVern 1318 m=1]] [21:02:39] : [Step 4/5] s <<< [21:02:39] : [Step 4/5] [2021-11-19 21:02:39,824][INFO ][exchange-worker-#3670%failure.FailureHandlingConfigurationTest0%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=df5023b7-d506-4989-a3b0-12d5b7500000, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=1, minorTopVer=1], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=df5023b7-d506-4989-a3b0-12d5b7500000, consistentId=8b4c9412-6976-40d8-904d-c5ed0468fa0a, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637344959738, loc=true, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=1, minorTopVer=1]] [21:02:39] : [Step 4/5] [2021-11-19 21:02:39,825][INFO ][main][root] >>> Stopping test: FailureHandlingConfigurationTest#testOverridingBySysProps in 1318 ms <<< [21:02:39] : [Step 4/5] [2021-11-19 21:02:39,826][INFO[21:02:39] >> ][exc> Heap: 465han MB used / 1944 MB commited /ge-worker-#3670%failure.FailureHandlingConfigur 19ationTest0%][GridDhtPartitionsExchangeFutu44re] Exc MB maxhange timings [startVer=AffinityTopologyVersion [topVer=1, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=1, minorT <<< [21:02:39] : [Step 4/5] opVer=1], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (1 ms), stage="Update caches registry" (6 ms), stage="Start caches" (0 ms), stage="Affinity initialization on cache group start" (0 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Restore partition states" (0 ms), stage="After states restored callback" (7 ms), stage="WAL history reservation" (0 ms), stage="Waiting for all single messages" (0 ms), stage="Affinity recalculation (crd)" (0 ms), stage="Collect update counters and create affinity messages" (0 ms), stage="Assign partitions states" (0 ms), stage="Validate partitions states" (0 ms), stage="Ideal affinity diff calculation (enforced)" (0 ms), stage="Apply update counters" (0 ms), stage="Full message preparing" (11 ms), stage="Full message sending" (0 ms), stage="State finish message sending" (0 ms), stage="Detect lost partitions" (2 ms), stage="Exchange done" (12 ms), stage="Total time" (39 ms)] [21:02:39] : [Step 4/5] [2021-11-19 21:02:39,828][INFO ][main][root] >>> Heap: 465 MB used / 1944 MB commited / 1944 MB max <<< [21:02:39] : [Step 4/5] [2021-11-19 21:02:39,830][INFO ][exchange-worker-#3670%failure.[21:02:39] >>> Non-Heap: 117 MB used / 125 MB commitedFai / 0 MB malureHandlingCox <<< [21:02:39] : [Step 4/5] nfigurationTest0%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=1, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=1, minorTopVer=1], stage="Affinity initialization on cache group start [grp=ignite-sys-cache]" (0 ms) (parent=Affinity initialization on cache group start), stage="Affinity centralized initialization (crd) [grp=ignite-sys-cache, crd=true]" (0 ms) (parent=Determine exchange type), stage="Restore partition states [grp=ignite-sys-cache]" (0 ms) (parent=Restore partition states), stage="Affinity recalculation (partitions availability) [grp=ignite-sys-cache]" (0 ms) (parent=Ideal affinity diff calculation (enforced))] [21:02:39] : [Step 4/5] [2021-11-19 21:02:39,830][INFO ][main][root] >>> Non-Heap: 117 MB used / 125 MB commited / 0 MB max <<< [21:02:39] : [Step 4/5] [2021-11-19 21:02:39,831][INFO ][exchange-worker-#3670%failure.FailureHandlingConfigurationTest0%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=1, minorTopVer=1], crd=true] [21:02:39] : [Step 4/5] [2021-11-19 21:02:39,832][INFO ][main][root] >>> Stopping grid [name=failure.FailureHandlingConfigurationTest0, id=df5023b7-d506-4989-a3b0-12d5b7500000] [21:02:39] : [Step 4/5] [2021-11-19 21:02:39,832][INFO ][exchange-worker-#3670%failure.FailureHandlingConfigurationTest0%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=1, minorTopVer=1], force=false, evt=DISCOVERY_CUSTOM_EVT, node=df5023b7-d506-4989-a3b0-12d5b7500000] [21:02:39] : [Step 4/5] [2021-11-19 21:02:39,839][INFO ][db-checkpoint-thread-#3677%failure.FailureHandlingConfigurationTest0%][Checkpointer] Checkpoint finished [cpId=817d6b06-b613-424b-8b11-02b3c5eed375, pages=16, markPos=WALPointer [idx=0, fileOff=66545, len=1963], walSegmentsCovered=[], markDuration=4ms, pagesWrite=11ms, fsync=27ms, total=44ms] [21:02:39] : [Step 4/5] [2021-11-19 21:02:39,845][INFO ][main][GridCacheProcessor] Stopped cache [cacheName=ignite-sys-cache] [21:02:40] : [Step 4/5] [2021-11-19 21:02:40,189][INFO ][main][FilePageStoreManager] Cleanup cache stores [total=3, left=0, cleanFiles=false] [21:02:40] : [Step 4/5] [2021-11-19 21:02:40,200][INFO ][main][FailureHandlingConfigurationTest0] [21:02:40] : [Step 4/5] [21:02:40] : [Step 4/5] >>> +------------------------------------------------------+ [21:02:40] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV stopped OK [21:02:40] : [Step 4/5] >>> +------------------------------------------------------+ [21:02:40] : [Step 4/5] >>> Ignite instance name: failure.FailureHandlingConfigurationTest0 [21:02:40] : [Step 4/5] >>> Grid uptime: 00:00:00.424 [21:02:40] : [Step 4/5] [21:02:40] : [Step 4/5] [21:02:40] : [Step 4/5] [21:02:40] >>> Stopping test class: FailureHandlingConfigurationTest <<< [21:02:40] : [Step 4/5] [2021-11-19 21:02:40,241][INFO ][main][root] >>> Stopping test class: FailureHandlingConfigurationTest <<< [21:02:40] : [Step 4/5] [21:02:40] >>> Starting test class: SystemWorkersBlockingTest <<< [21:02:40] : [Step 4/5] [2021-11-19 21:02:40,242][INFO ][main][root] >>> Starting test class: SystemWorkersBlockingTest <<< [21:02:40] : [Step 4/5] Running org.apache.ignite.failure.SystemWorkersBlockingTest [21:02:40]i: [Step 4/5] ##teamcity[importData type='surefire' path='/opt/buildagent/temp/buildTmp/ignite-tools-junit-reports1777670380320881607/test-org.apache.ignite.testsuites.IgniteBasicWithPersistenceTestSuite1637344950595.xml'] [21:02:40] : [Step 4/5] Importing data from '/opt/buildagent/temp/buildTmp/ignite-tools-junit-reports1777670380320881607/test-org.apache.ignite.testsuites.IgniteBasicWithPersistenceTestSuite1637344950595.xml' (801 B) with 'surefire' processor [21:02:40] : [Step 4/5] [21:02:40] >>> Starting test: SystemWorkersBlockingTest#testBlockingSection <<< [21:02:40] : [Step 4/5] [2021-11-19 21:02:40,255][INFO ][main][root] >>> Starting test: SystemWorkersBlockingTest#testBlockingSection <<< [21:02:40] : [Step 4/5] [21:02:40] >>> Heap: 470 MB used / 1944 MB commited / 1944 MB max <<< [21:02:40] : [Step 4/5] [2021-11-19 21:02:40,256][INFO ][main][root] >>> Heap: 470 MB used / 1944 MB commited / 1944 MB max <<< [21:02:40] : [Step 4/5] [21:02:40] >>> Non-Heap: 117 MB used / 125 MB commited / 0 MB max <<< [21:02:40] : [Step 4/5] [2021-11-19 21:02:40,256][INFO ][main][root] >>> Non-Heap: 117 MB used / 125 MB commited / 0 MB max <<< [21:02:40]W: [org.apache.ignite:ignite-core] [2021-11-19 21:02:40,266][WARN ][test-runner-#3686%failure.SystemWorkersBlockingTest%][G] Ignite work directory is not provided, automatically resolved to: /opt/buildagent/work/7bc1c54bc719b67c/work [21:02:40] : [Step 4/5] [2021-11-19 21:02:40,268][INFO ][test-runner-#3686%failure.SystemWorkersBlockingTest%][SystemWorkersBlockingTest0] [21:02:40] : [Step 4/5] [21:02:40] : [Step 4/5] >>> __________ ________________ [21:02:40] : [Step 4/5] >>> / _/ ___/ |/ / _/_ __/ __/ [21:02:40] : [Step 4/5] >>> _/ // (7 7 // / / / / _/ [21:02:40] : [Step 4/5] >>> /___/\___/_/|_/___/ /_/ /___/ [21:02:40] : [Step 4/5] >>> [21:02:40] : [Step 4/5] >>> ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:02:40] : [Step 4/5] >>> 2021 Copyright(C) Apache Software Foundation [21:02:40] : [Step 4/5] >>> [21:02:40] : [Step 4/5] >>> Ignite documentation: http://ignite.apache.org [21:02:40] : [Step 4/5] [21:02:40] : [Step 4/5] [2021-11-19 21:02:40,269][INFO ][test-runner-#3686%failure.SystemWorkersBlockingTest%][SystemWorkersBlockingTest0] Config URL: n/a [21:02:40] : [Step 4/5] [2021-11-19 21:02:40,270][INFO ][test-runner-#3686%failure.SystemWorkersBlockingTest%][SystemWorkersBlockingTest0] IgniteConfiguration [igniteInstanceName=failure.SystemWorkersBlockingTest0, pubPoolSize=24, svcPoolSize=24, callbackPoolSize=24, stripedPoolSize=24, sysPoolSize=24, mgmtPoolSize=4, dataStreamerPoolSize=24, utilityCachePoolSize=24, utilityCacheKeepAliveTime=60000, p2pPoolSize=2, qryPoolSize=24, buildIdxPoolSize=4, igniteHome=/opt/buildagent/work/7bc1c54bc719b67c, igniteWorkDir=/opt/buildagent/work/7bc1c54bc719b67c/work, mbeanSrv=com.sun.jmx.mbeanserver.JmxMBeanServer@6fe85038, nodeId=f75238c2-3f26-40c4-a4ba-aeed69000000, marsh=BinaryMarshaller [], marshLocJobs=false, daemon=false, p2pEnabled=true, netTimeout=10000, netCompressionLevel=1, sndRetryDelay=1000, sndRetryCnt=3, metricsHistSize=10000, metricsUpdateFreq=1000, metricsExpTime=9223372036854775807, discoSpi=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=0, ackTimeout=0, marsh=null, reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], segPlc=STOP, segResolveAttempts=2, waitForSegOnStart=true, allResolversPassReq=true, segChkFreq=10000, commSpi=TcpCommunicationSpi [connectGate=org.apache.ignite.spi.communication.tcp.internal.ConnectGateway@5ac09392, ctxInitLatch=java.util.concurrent.CountDownLatch@3cac3e35[Count = 1], stopping=false, clientPool=null, nioSrvWrapper=null, stateProvider=null], evtSpi=MemoryEventStorageSpi [expireAgeMs=9223372036854775807, expireCnt=10000, filter=null], colSpi=NoopCollisionSpi [], deploySpi=LocalDeploymentSpi [], indexingSpi=org.apache.ignite.spi.indexing.noop.NoopIndexingSpi@6a1822f2, addrRslvr=null, encryptionSpi=org.apache.ignite.spi.encryption.noop.NoopEncryptionSpi@bebf896, tracingSpi=org.apache.ignite.spi.tracing.NoopTracingSpi@37a5b656, clientMode=false, rebalanceThreadPoolSize=4, rebalanceTimeout=10000, rebalanceBatchesPrefetchCnt=3, rebalanceThrottle=0, rebalanceBatchSize=524288, txCfg=TransactionConfiguration [txSerEnabled=false, dfltIsolation=REPEATABLE_READ, dfltConcurrency=PESSIMISTIC, dfltTxTimeout=0, txTimeoutOnPartitionMapExchange=0, deadlockTimeout=10000, pessimisticTxLogSize=0, pessimisticTxLogLinger=10000, tmLookupClsName=null, txManagerFactory=null, useJtaSync=false], cacheSanityCheckEnabled=true, discoStartupDelay=60000, deployMode=SHARED, p2pMissedCacheSize=100, locHost=127.0.0.1, timeSrvPortBase=31100, timeSrvPortRange=100, failureDetectionTimeout=10000, sysWorkerBlockedTimeout=1000, clientFailureDetectionTimeout=10000, metricsLogFreq=0, connectorCfg=null, odbcCfg=null, warmupClos=null, atomicCfg=AtomicConfiguration [seqReserveSize=1000, cacheMode=PARTITIONED, backups=1, aff=null, grpName=null], classLdr=null, sslCtxFactory=null, platformCfg=null, binaryCfg=null, memCfg=null, pstCfg=null, dsCfg=DataStorageConfiguration [sysRegionInitSize=41943040, sysRegionMaxSize=104857600, pageSize=0, concLvl=0, dfltDataRegConf=DataRegionConfiguration [name=default, maxSize=3221225472, initSize=268435456, swapPath=null, pageEvictionMode=DISABLED, pageReplacementMode=CLOCK, evictionThreshold=0.9, emptyPagesPoolSize=100, metricsEnabled=false, metricsSubIntervalCount=5, metricsRateTimeInterval=60000, persistenceEnabled=false, checkpointPageBufSize=0, lazyMemoryAllocation=true, warmUpCfg=null], dataRegions=null, storagePath=null, checkpointFreq=180000, lockWaitTime=10000, checkpointThreads=4, checkpointWriteOrder=SEQUENTIAL, walHistSize=20, maxWalArchiveSize=1073741824, walSegments=10, walSegmentSize=67108864, walPath=db/wal, walArchivePath=db/wal/archive, cdcWalPath=db/wal/cdc, cdcEnabled=false, metricsEnabled=false, walMode=LOG_ONLY, walTlbSize=131072, walBuffSize=0, walFlushFreq=2000, walFsyncDelay=1000, walRecordIterBuffSize=67108864, alwaysWriteFullPages=false, fileIOFactory=org.apache.ignite.internal.processors.cache.persistence.file.AsyncFileIOFactory@5ea82efc, metricsSubIntervalCnt=5, metricsRateTimeInterval=60000, walAutoArchiveAfterInactivity=-1, walForceArchiveTimeout=-1, writeThrottlingEnabled=false, walCompactionEnabled=false, walCompactionLevel=1, checkpointReadLockTimeout=null, walPageCompression=DISABLED, walPageCompressionLevel=null, dfltWarmUpCfg=null, encCfg=org.apache.ignite.configuration.EncryptionConfiguration@24a0c91e, defragmentationThreadPoolSize=4, minWalArchiveSize=-1], snapshotPath=snapshots, activeOnStart=true, activeOnStartPropSetFlag=false, autoActivation=true, autoActivationPropSetFlag=false, clusterStateOnStart=null, sqlConnCfg=null, cliConnCfg=ClientConnectorConfiguration [host=null, port=10800, portRange=100, sockSndBufSize=0, sockRcvBufSize=0, tcpNoDelay=true, maxOpenCursorsPerConn=128, threadPoolSize=24, selectorCnt=12, idleTimeout=0, handshakeTimeout=10000, jdbcEnabled=true, odbcEnabled=true, thinCliEnabled=true, sslEnabled=false, useIgniteSslCtxFactory=true, sslClientAuth=false, sslCtxFactory=null, thinCliCfg=ThinClientConfiguration [maxActiveTxPerConn=100, maxActiveComputeTasksPerConn=0]], mvccVacuumThreadCnt=2, mvccVacuumFreq=5000, authEnabled=false, failureHnd=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_CRITICAL_OPERATION_TIMEOUT]], commFailureRslvr=null, sqlCfg=SqlConfiguration [longQryWarnTimeout=3000, dfltQryTimeout=0, sqlQryHistSize=1000, validationEnabled=false], asyncContinuationExecutor=null] [21:02:40] : [Step 4/5] [2021-11-19 21:02:40,278][INFO ][test-runner-#3686%failure.SystemWorkersBlockingTest%][SystemWorkersBlockingTest0] Daemon mode: off [21:02:40] : [Step 4/5] [2021-11-19 21:02:40,279][INFO ][test-runner-#3686%failure.SystemWorkersBlockingTest%][SystemWorkersBlockingTest0] OS: Linux 4.15.0-151-generic amd64 [21:02:40] : [Step 4/5] [2021-11-19 21:02:40,279][INFO ][test-runner-#3686%failure.SystemWorkersBlockingTest%][SystemWorkersBlockingTest0] OS user: teamcity [21:02:40] : [Step 4/5] [2021-11-19 21:02:40,279][INFO ][test-runner-#3686%failure.SystemWorkersBlockingTest%][SystemWorkersBlockingTest0] PID: 16724 [21:02:40] : [Step 4/5] [2021-11-19 21:02:40,280][INFO ][test-runner-#3686%failure.SystemWorkersBlockingTest%][SystemWorkersBlockingTest0] Language runtime: Java Platform API Specification ver. 1.8 [21:02:40] : [Step 4/5] [2021-11-19 21:02:40,280][INFO ][test-runner-#3686%failure.SystemWorkersBlockingTest%][SystemWorkersBlockingTest0] VM information: Java(TM) SE Runtime Environment 1.8.0_261-b12 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 25.261-b12 [21:02:40] : [Step 4/5] [2021-11-19 21:02:40,280][INFO ][test-runner-#3686%failure.SystemWorkersBlockingTest%][SystemWorkersBlockingTest0] VM total memory: 1.9GB [21:02:40] : [Step 4/5] [2021-11-19 21:02:40,281][INFO ][test-runner-#3686%failure.SystemWorkersBlockingTest%][SystemWorkersBlockingTest0] Remote Management [restart: off, REST: off, JMX (remote: off)] [21:02:40] : [Step 4/5] [2021-11-19 21:02:40,281][INFO ][test-runner-#3686%failure.SystemWorkersBlockingTest%][SystemWorkersBlockingTest0] Logger: GridTestLog4jLogger [quiet=false, config=null] [21:02:40] : [Step 4/5] [2021-11-19 21:02:40,281][INFO ][test-runner-#3686%failure.SystemWorkersBlockingTest%][SystemWorkersBlockingTest0] IGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c [21:02:40] : [Step 4/5] [2021-11-19 21:02:40,282][INFO ][test-runner-#3686%failure.SystemWorkersBlockingTest%][SystemWorkersBlockingTest0] VM arguments: [-DIGNITE_DUMP_THREADS_ON_FAILURE=false, -DMono=/usr/bin/mono-sgen, -DMono4.0_x64=/usr/lib/mono/4.0, -DMono4.5_x64=/usr/lib/mono/4.5, -DMonoVersion=6.12.0.90, -DSKIP_BUILD=false, -Dagent.home.dir=/opt/buildagent, -Dagent.name=aitc-lin02_03, -Dagent.ownPort=9090, -Dagent.work.dir=/opt/buildagent/work, -Dbuild.number=95, -Dbuild.vcs.number=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.1=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.GitHubApacheIgnite=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dclassworlds.conf=/opt/buildagent/temp/buildTmp/teamcity.m2.conf, -Dcom.jetbrains.maven.watcher.report.file=/opt/buildagent/temp/buildTmp/maven-build-info.xml, -Djava.io.tmpdir=/opt/buildagent/temp/buildTmp, -Dmaven.home=/opt/buildagent/tools/maven3_6, -Dmaven.multiModuleProjectDirectory=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.agent.cpuBenchmark=457, -Dteamcity.agent.dotnet.agent_url=http://localhost:9090/RPC2, -Dteamcity.agent.dotnet.build_id=6278078, -Dteamcity.auth.password=*******, -Dteamcity.auth.userId=TeamCityBuildId=6278078, -Dteamcity.build.changedFiles.file=/opt/buildagent/temp/buildTmp/changedFiles6342607772318147725.txt, -Dteamcity.build.checkoutDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.build.id=6278078, -Dteamcity.build.properties.file=/opt/buildagent/temp/buildTmp/teamcity.build5164517880467851002.properties, -Dteamcity.build.tempDir=/opt/buildagent/temp/buildTmp, -Dteamcity.build.workingDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.buildConfName=Basic 3, -Dteamcity.buildType.id=IgniteTests24Java8_Basic3, -Dteamcity.configuration.properties.file=/opt/buildagent/temp/buildTmp/teamcity.config5591980786735343870.properties, -Dteamcity.maven.userSettings.path=/opt/buildagent/temp/buildTmp/maven_settings_585072866407032347.xml, -Dteamcity.maven.watcher.home=/opt/buildagent/plugins/mavenPlugin/maven-watcher-jdk16, -Dteamcity.projectName=Ignite Tests 2.x (JDK 8/11), -Dteamcity.runner.properties.file=/opt/buildagent/temp/buildTmp/teamcity.runner9098465561618137420.properties, -Dteamcity.tests.recentlyFailedTests.file=/opt/buildagent/temp/buildTmp/testsToRunFirst3891775683130404069.txt, -Dteamcity.version=2021.2 (build 99542), -ea, -Xms2g, -Xmx2g, -XX:+HeapDumpOnOutOfMemoryError, -DIGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_TEST_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_UPDATE_NOTIFIER=false, -DIGNITE_NO_DISCO_ORDER=true, -DIGNITE_PERFORMANCE_SUGGESTIONS_DISABLED=true, -Djava.net.preferIPv4Stack=true, -DTEST_SCALE_FACTOR=1.0, -DIGNITE_TEST_PROP_LOG4J_FILE=log4j-tc-test.xml, -DIGNITE_QUIET=false, -DIGNITE_MARSHAL_BUFFERS_RECHECK=1000, -Dmaven.repo.local=/opt/buildagent/.m2/repository] [21:02:40] : [Step 4/5] [2021-11-19 21:02:40,285][INFO ][test-runner-#3686%failure.SystemWorkersBlockingTest%][SystemWorkersBlockingTest0] System cache's DataRegion size is configured to 40 MB. Use DataStorageConfiguration.systemRegionInitialSize property to change the setting. [21:02:40] : [Step 4/5] [2021-11-19 21:02:40,286][INFO ][test-runner-#3686%failure.SystemWorkersBlockingTest%][SystemWorkersBlockingTest0] Configured caches [in 'sysMemPlc' dataRegion: ['ignite-sys-cache']] [21:02:40]W: [org.apache.ignite:ignite-core] [2021-11-19 21:02:40,286][WARN ][test-runner-#3686%failure.SystemWorkersBlockingTest%][SystemWorkersBlockingTest0] Peer class loading is enabled (disable it in production for performance and deployment consistency reasons) [21:02:40] : [Step 4/5] [2021-11-19 21:02:40,286][INFO ][test-runner-#3686%failure.SystemWorkersBlockingTest%][SystemWorkersBlockingTest0] 3-rd party licenses can be found at: /opt/buildagent/work/7bc1c54bc719b67c/libs/licenses [21:02:40] : [Step 4/5] [2021-11-19 21:02:40,290][INFO ][test-runner-#3686%failure.SystemWorkersBlockingTest%][IgnitePluginProcessor] Configured plugins: [21:02:40] : [Step 4/5] [2021-11-19 21:02:40,290][INFO ][test-runner-#3686%failure.SystemWorkersBlockingTest%][IgnitePluginProcessor] ^-- StanByClusterTestProvider 1.0 [21:02:40] : [Step 4/5] [2021-11-19 21:02:40,291][INFO ][test-runner-#3686%failure.SystemWorkersBlockingTest%][IgnitePluginProcessor] ^-- null [21:02:40] : [Step 4/5] [2021-11-19 21:02:40,291][INFO ][test-runner-#3686%failure.SystemWorkersBlockingTest%][IgnitePluginProcessor] [21:02:40] : [Step 4/5] [2021-11-19 21:02:40,291][INFO ][test-runner-#3686%failure.SystemWorkersBlockingTest%][IgnitePluginProcessor] ^-- PageMemory tracker plugin 1.0 [21:02:40] : [Step 4/5] [2021-11-19 21:02:40,291][INFO ][test-runner-#3686%failure.SystemWorkersBlockingTest%][IgnitePluginProcessor] ^-- null [21:02:40] : [Step 4/5] [2021-11-19 21:02:40,291][INFO ][test-runner-#3686%failure.SystemWorkersBlockingTest%][IgnitePluginProcessor] [21:02:40] : [Step 4/5] [2021-11-19 21:02:40,291][INFO ][test-runner-#3686%failure.SystemWorkersBlockingTest%][IgnitePluginProcessor] ^-- TestDistibutedConfigurationPlugin 1.0 [21:02:40] : [Step 4/5] [2021-11-19 21:02:40,292][INFO ][test-runner-#3686%failure.SystemWorkersBlockingTest%][IgnitePluginProcessor] ^-- null [21:02:40] : [Step 4/5] [2021-11-19 21:02:40,292][INFO ][test-runner-#3686%failure.SystemWorkersBlockingTest%][IgnitePluginProcessor] [21:02:40] : [Step 4/5] [2021-11-19 21:02:40,292][INFO ][test-runner-#3686%failure.SystemWorkersBlockingTest%][IgnitePluginProcessor] ^-- NodeValidationPluginProvider 1.0 [21:02:40] : [Step 4/5] [2021-11-19 21:02:40,292][INFO ][test-runner-#3686%failure.SystemWorkersBlockingTest%][IgnitePluginProcessor] ^-- null [21:02:40] : [Step 4/5] [2021-11-19 21:02:40,292][INFO ][test-runner-#3686%failure.SystemWorkersBlockingTest%][IgnitePluginProcessor] [21:02:40] : [Step 4/5] [2021-11-19 21:02:40,293][INFO ][test-runner-#3686%failure.SystemWorkersBlockingTest%][FailureProcessor] Configured failure handler: [hnd=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_CRITICAL_OPERATION_TIMEOUT]]] [21:02:40]W: [org.apache.ignite:ignite-core] [2021-11-19 21:02:40,303][WARN ][test-runner-#3686%failure.SystemWorkersBlockingTest%][TcpCommunicationSpi] Message queue limit is set to 0 which may lead to potential OOMEs when running cache operations in FULL_ASYNC or PRIMARY_SYNC modes due to message queues growth on sender and receiver sides. [21:02:40] : [Step 4/5] [2021-11-19 21:02:40,303][INFO ][test-runner-#3686%failure.SystemWorkersBlockingTest%][TcpCommunicationSpi] Successfully bound communication NIO server to TCP port [port=45060, locHost=/127.0.0.1, selectorsCnt=12, selectorSpins=0, pairedConn=false] [21:02:40] : [Step 4/5] [2021-11-19 21:02:40,307][INFO ][test-runner-#3686%failure.SystemWorkersBlockingTest%][GridCollisionManager] Collision resolution is disabled (all jobs will be activated upon arrival). [21:02:40] : [Step 4/5] [2021-11-19 21:02:40,307][INFO ][test-runner-#3686%failure.SystemWorkersBlockingTest%][SystemWorkersBlockingTest0] Security status [authentication=off, sandbox=off, tls/ssl=off] [21:02:40] : [Step 4/5] [2021-11-19 21:02:40,313][INFO ][test-runner-#3686%failure.SystemWorkersBlockingTest%][TestTcpDiscoverySpi] Successfully bound to TCP port [port=47500, localHost=localhost/127.0.0.1, locNodeId=f75238c2-3f26-40c4-a4ba-aeed69000000] [21:02:40] : [Step 4/5] [2021-11-19 21:02:40,315][INFO ][test-runner-#3686%failure.SystemWorkersBlockingTest%][IgniteCacheDatabaseSharedManager] Configured data regions initialized successfully [total=4] [21:02:40] : [Step 4/5] [2021-11-19 21:02:40,319][INFO ][test-runner-#3686%failure.SystemWorkersBlockingTest%][ClientListenerProcessor] Client connector processor has started on TCP port 10800 [21:02:40] : [Step 4/5] [2021-11-19 21:02:40,321][INFO ][test-runner-#3686%failure.SystemWorkersBlockingTest%][SystemWorkersBlockingTest0] Non-loopback local IPs: 172.17.0.4 [21:02:40] : [Step 4/5] [2021-11-19 21:02:40,322][INFO ][test-runner-#3686%failure.SystemWorkersBlockingTest%][SystemWorkersBlockingTest0] Enabled local MACs: 0242AC110004 [21:02:40] : [Step 4/5] [2021-11-19 21:02:40,322][INFO ][test-runner-#3686%failure.SystemWorkersBlockingTest%][ClusterProcessor] Cluster ID and tag has been read from metastorage: null [21:02:40] : [Step 4/5] [2021-11-19 21:02:40,322][INFO ][test-runner-#3686%failure.SystemWorkersBlockingTest%][IgniteClusterImpl] Shutdown policy was updated [oldVal=null, newVal=null] [21:02:40] : [Step 4/5] [2021-11-19 21:02:40,326][INFO ][disco-notifier-worker-#3770%failure.SystemWorkersBlockingTest0%][GridClusterStateProcessor] Received activate cluster request with BaselineTopology[id=0] initiator node ID: f75238c2-3f26-40c4-a4ba-aeed69000000 [21:02:40] : [Step 4/5] [2021-11-19 21:02:40,327][INFO ][disco-notifier-worker-#3770%failure.SystemWorkersBlockingTest0%][GridClusterStateProcessor] Started state transition: activate cluster [21:02:40] : [Step 4/5] [2021-11-19 21:02:40,327][INFO ][disco-notifier-worker-#3770%failure.SystemWorkersBlockingTest0%][GridClusterStateProcessor] Received state change finish message: ACTIVE [21:02:40] : [Step 4/5] [2021-11-19 21:02:40,327][INFO ][disco-notifier-worker-#3770%failure.SystemWorkersBlockingTest0%][GridClusterStateProcessor] Cluster state was changed from ACTIVE to ACTIVE [21:02:40] : [Step 4/5] [2021-11-19 21:02:40,328][INFO ][disco-notifier-worker-#3770%failure.SystemWorkersBlockingTest0%][MvccProcessorImpl] Assigned mvcc coordinator [crd=MvccCoordinator [topVer=AffinityTopologyVersion [topVer=1, minorTopVer=0], nodeId=f75238c2-3f26-40c4-a4ba-aeed69000000, ver=1637344960324, local=true, initialized=false]] [21:02:40] : [Step 4/5] [2021-11-19 21:02:40,329][INFO ][sys-#3775%failure.SystemWorkersBlockingTest0%][ClusterProcessor] Writing cluster ID and tag to metastorage on ready for write ClusterIdAndTag [id=4e7e7dc3-10c5-4098-9489-95fbc4d69af2, tag=eloquent_mccarthy] [21:02:40] : [Step 4/5] [2021-11-19 21:02:40,330][INFO ][disco-notifier-worker-#3770%failure.SystemWorkersBlockingTest0%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustEnabled' was changed from 'null' to 'true' [21:02:40] : [Step 4/5] [2021-11-19 21:02:40,331][INFO ][disco-notifier-worker-#3770%failure.SystemWorkersBlockingTest0%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustTimeout' was changed from 'null' to '0' [21:02:40] : [Step 4/5] [2021-11-19 21:02:40,332][INFO ][disco-notifier-worker-#3770%failure.SystemWorkersBlockingTest0%][IgniteTxManager] Transactions parameter 'longOperationsDumpTimeout' was changed from 'null' to '60000' [21:02:40] : [Step 4/5] [2021-11-19 21:02:40,332][INFO ][disco-notifier-worker-#3770%failure.SystemWorkersBlockingTest0%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpThreshold' was changed from 'null' to '0' [21:02:40] : [Step 4/5] [2021-11-19 21:02:40,333][INFO ][disco-notifier-worker-#3770%failure.SystemWorkersBlockingTest0%][ClusterProcessor] eloquent_mccarthy [21:02:40] : [Step 4/5] [2021-11-19 21:02:40,334][INFO ][disco-notifier-worker-#3770%failure.SystemWorkersBlockingTest0%][IgniteTxManager] Transactions parameter 'transactionTimeDumpSamplesCoefficient' was changed from 'null' to '0.0' [21:02:40] : [Step 4/5] [2021-11-19 21:02:40,334][INFO ][disco-notifier-worker-#3770%failure.SystemWorkersBlockingTest0%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpSamplesPerSecondLimit' was changed from 'null' to '5' [21:02:40] : [Step 4/5] [2021-11-19 21:02:40,335][INFO ][disco-notifier-worker-#3770%failure.SystemWorkersBlockingTest0%][IgniteTxManager] Transactions parameter 'collisionsDumpInterval' was changed from 'null' to '1000' [21:02:40] : [Step 4/5] [2021-11-19 21:02:40,336][INFO ][disco-notifier-worker-#3770%failure.SystemWorkersBlockingTest0%][IgniteTxManager] Transactions parameter 'txOwnerDumpRequestsAllowed' was changed from 'null' to 'true' [21:02:40] : [Step 4/5] [2021-11-19 21:02:40,341][INFO ][exchange-worker-#3776%failure.SystemWorkersBlockingTest0%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=1, minorTopVer=0], crd=true, evt=NODE_JOINED, evtNode=f75238c2-3f26-40c4-a4ba-aeed69000000, customEvt=null, allowMerge=false, exchangeFreeSwitch=false] [21:02:40] : [Step 4/5] [2021-11-19 21:02:40,343][INFO ][exchange-worker-#3776%failure.SystemWorkersBlockingTest0%][IgniteCacheDatabaseSharedManager] Data Regions Started: 4 [21:02:40] : [Step 4/5] [2021-11-19 21:02:40,343][INFO ][exchange-worker-#3776%failure.SystemWorkersBlockingTest0%][IgniteCacheDatabaseSharedManager] ^-- sysMemPlc region [type=internal, persistence=false, lazyAlloc=false, [21:02:40] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=40MB] [21:02:40] : [Step 4/5] ^-- default region [type=default, persistence=false, lazyAlloc=true, [21:02:40] : [Step 4/5] ... initCfg=256MB, maxCfg=3072MB, usedRam=0MB, freeRam=100%, allocRam=0MB] [21:02:40] : [Step 4/5] ^-- TxLog region [type=internal, persistence=false, lazyAlloc=false, [21:02:40] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=40MB] [21:02:40] : [Step 4/5] ^-- volatileDsMemPlc region [type=user, persistence=false, lazyAlloc=true, [21:02:40] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB] [21:02:40] : [Step 4/5] [21:02:40] : [Step 4/5] [2021-11-19 21:02:40,344][INFO ][exchange-worker-#3776%failure.SystemWorkersBlockingTest0%][msg] Components activation performed in 2 ms. [21:02:40] : [Step 4/5] [2021-11-19 21:02:40,346][INFO ][exchange-worker-#3776%failure.SystemWorkersBlockingTest0%][GridCacheProcessor] Started cache [name=ignite-sys-cache, id=-2100569601, dataRegionName=sysMemPlc, mode=REPLICATED, atomicity=TRANSACTIONAL, backups=2147483647, mvcc=false] [21:02:40] : [Step 4/5] [2021-11-19 21:02:40,347][INFO ][exchange-worker-#3776%failure.SystemWorkersBlockingTest0%][GridCacheProcessor] Starting caches on local join performed in 0 ms. [21:02:40] : [Step 4/5] [2021-11-19 21:02:40,351][INFO ][exchange-worker-#3776%failure.SystemWorkersBlockingTest0%][GridDhtPartitionsExchangeFuture] Skipped waiting for partitions release future (local node is joining) [topVer=AffinityTopologyVersion [topVer=1, minorTopVer=0]] [21:02:40] : [Step 4/5] [2021-11-19 21:02:40,358][INFO ][exchange-worker-#3776%failure.SystemWorkersBlockingTest0%][GridDhtPartitionsExchangeFuture] finishExchangeOnCoordinator [topVer=AffinityTopologyVersion [topVer=1, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=1, minorTopVer=0]] [21:02:40] : [Step 4/5] [2021-11-19 21:02:40,363][INFO ][exchange-worker-#3776%failure.SystemWorkersBlockingTest0%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=1, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=1, minorTopVer=0], err=null, rebalanced=true, wasRebalanced=false] [21:02:40] : [Step 4/5] [2021-11-19 21:02:40,364][INFO ][exchange-worker-#3776%failure.SystemWorkersBlockingTest0%][GridCacheProcessor] Finish proxy initialization, cacheName=ignite-sys-cache, localNodeId=f75238c2-3f26-40c4-a4ba-aeed69000000 [21:02:40] : [Step 4/5] [2021-11-19 21:02:40,365][INFO ][exchange-worker-#3776%failure.SystemWorkersBlockingTest0%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=f75238c2-3f26-40c4-a4ba-aeed69000000, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=1, minorTopVer=0], evt=NODE_JOINED, evtNode=TcpDiscoveryNode [id=f75238c2-3f26-40c4-a4ba-aeed69000000, consistentId=127.0.0.1:47500, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637344960323, loc=true, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=1, minorTopVer=0]] [21:02:40] : [Step 4/5] [2021-11-19 21:02:40,366][INFO ][exchange-worker-#3776%failure.SystemWorkersBlockingTest0%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=1, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=1, minorTopVer=0], stage="Waiting in exchange queue" (12 ms), stage="Exchange parameters initialization" (0 ms), stage="Components activation" (2 ms), stage="Determine exchange type" (6 ms), stage="Preloading notification" (0 ms), stage="After states restored callback" (6 ms), stage="WAL history reservation" (0 ms), stage="Waiting for all single messages" (0 ms), stage="Affinity recalculation (crd)" (0 ms), stage="Collect update counters and create affinity messages" (0 ms), stage="Assign partitions states" (0 ms), stage="Validate partitions states" (0 ms), stage="Apply update counters" (0 ms), stage="Full message preparing" (4 ms), stage="Full message sending" (0 ms), stage="State finish message sending" (0 ms), stage="Exchange done" (2 ms), stage="Total time" (32 ms)] [21:02:40] : [Step 4/5] [2021-11-19 21:02:40,367][INFO ][exchange-worker-#3776%failure.SystemWorkersBlockingTest0%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=1, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=1, minorTopVer=0], stage="Coordinator affinity cache init [grp=ignite-sys-cache]" (3 ms) (parent=Determine exchange type), stage="First node affinity initialization (node join) [grp=ignite-sys-cache]" (2 ms) (parent=Determine exchange type)] [21:02:40] : [Step 4/5] [2021-11-19 21:02:40,368][INFO ][exchange-worker-#3776%failure.SystemWorkersBlockingTest0%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=1, minorTopVer=0], crd=true] [21:02:40] : [Step 4/5] [2021-11-19 21:02:40,368][INFO ][exchange-worker-#3776%failure.SystemWorkersBlockingTest0%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=1, minorTopVer=0], force=false, evt=NODE_JOINED, node=f75238c2-3f26-40c4-a4ba-aeed69000000] [21:02:40] : [Step 4/5] [2021-11-19 21:02:40,372][INFO ][test-runner-#3686%failure.SystemWorkersBlockingTest%][SystemWorkersBlockingTest0] To start Console Management & Monitoring run ignitevisorcmd.{sh|bat} [21:02:40] : [Step 4/5] [2021-11-19 21:02:40,373][INFO ][test-runner-#3686%failure.SystemWorkersBlockingTest%][SystemWorkersBlockingTest0] [21:02:40] : [Step 4/5] [21:02:40] : [Step 4/5] >>> +-------------------------------------------+ [21:02:40] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:02:40] : [Step 4/5] >>> +-------------------------------------------+ [21:02:40] : [Step 4/5] >>> OS name: Linux 4.15.0-151-generic amd64 [21:02:40] : [Step 4/5] >>> CPU(s): 24 [21:02:40] : [Step 4/5] >>> Heap: 2.0GB [21:02:40] : [Step 4/5] >>> VM name: 16724@c4dfe9a430b2 [21:02:40] : [Step 4/5] >>> Ignite instance name: failure.SystemWorkersBlockingTest0 [21:02:40] : [Step 4/5] >>> Local node [ID=F75238C2-3F26-40C4-A4BA-AEED69000000, order=1, clientMode=false] [21:02:40] : [Step 4/5] >>> Local node addresses: [127.0.0.1] [21:02:40] : [Step 4/5] >>> Local ports: TCP:10800 TCP:45060 TCP:47500 [21:02:40] : [Step 4/5] [21:02:40] : [Step 4/5] [2021-11-19 21:02:40,374][INFO ][test-runner-#3686%failure.SystemWorkersBlockingTest%][GridDiscoveryManager] Topology snapshot [ver=1, locNode=f75238c2, servers=1, clients=0, state=ACTIVE, CPUs=24, offheap=3.0GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=f75238c2-3f26-40c4-a4ba-aeed69000000, consistentId=127.0.0.1:47500, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:02:40] : [Step 4/5] [2021-11-19 21:02:40,374][INFO ][test-runner-#3686%failure.SystemWorkersBlockingTest%][GridDiscoveryManager] ^-- Baseline [id=0, size=1, online=1, offline=0] [21:02:40] : [Step 4/5] [2021-11-19 21:02:40,374][INFO ][test-runner-#3686%failure.SystemWorkersBlockingTest%][G] Node started : [stage="Configure system pool" (0 ms),stage="Start managers" (41 ms),stage="Configure binary metadata" (2 ms),stage="Start processors" (10 ms),stage="Start 'StanByClusterTestProvider' plugin" (0 ms),stage="Start 'PageMemory tracker plugin' plugin" (0 ms),stage="Start 'TestDistibutedConfigurationPlugin' plugin" (0 ms),stage="Start 'NodeValidationPluginProvider' plugin" (0 ms),stage="Init metastore" (1 ms),stage="Finish recovery" (0 ms),stage="Join topology" (5 ms),stage="Await transition" (2 ms),stage="Await exchange" (44 ms),stage="Total time" (105 ms)] [21:02:40] : [Step 4/5] [2021-11-19 21:02:40,375][INFO ][test-runner-#3686%failure.SystemWorkersBlockingTest%][root] Node started with the following configuration [id=f75238c2-3f26-40c4-a4ba-aeed69000000, marshaller=BinaryMarshaller [], discovery=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=5000, ackTimeout=5000, marsh=JdkMarshaller [clsFilter=org.apache.ignite.marshaller.MarshallerUtils$1@412bb76f], reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], binaryCfg=null, lateAff=true] [21:02:40] : [Step 4/5] Surefire report watcher [21:02:40] : [Surefire report watcher] Watching paths: [21:02:40] : [Surefire report watcher] /opt/buildagent/temp/buildTmp/ignite-tools-junit-reports1777670380320881607/test-org.apache.ignite.testsuites.IgniteBasicWithPersistenceTestSuite1637344950595.xml [21:02:40]i: [Step 4/5] org.apache.ignite.testsuites.IgniteBasicWithPersistenceTestSuite [21:02:40]i: [org.apache.ignite.testsuites.IgniteBasicWithPersistenceTestSuite] org.apache.ignite.failure.FailureHandlingConfigurationTest.testMBeanParamsChanging [21:02:40]i: [org.apache.ignite.testsuites.IgniteBasicWithPersistenceTestSuite] org.apache.ignite.failure.FailureHandlingConfigurationTest.testPartialCfgParamsPropagation [21:02:40]i: [org.apache.ignite.testsuites.IgniteBasicWithPersistenceTestSuite] org.apache.ignite.failure.FailureHandlingConfigurationTest.testCfgParamsPropagation [21:02:40]i: [org.apache.ignite.testsuites.IgniteBasicWithPersistenceTestSuite] org.apache.ignite.failure.FailureHandlingConfigurationTest.testNegativeParamValues [21:02:40]i: [org.apache.ignite.testsuites.IgniteBasicWithPersistenceTestSuite] org.apache.ignite.failure.FailureHandlingConfigurationTest.testOverridingBySysProps [21:02:42] : [Step 4/5] [21:02:42] >>> Stopping test: SystemWorkersBlockingTest#testBlockingSection in 2121 ms <<< [21:02:42] : [Step 4/5] [2021-11-19 21:02:42,378][INFO ][main][root] >>> Stopping test: SystemWorkersBlockingTest#testBlockingSection in 2121 ms <<< [21:02:42] : [Step 4/5] [21:02:42] >>> Heap: 492 MB used / 1944 MB commited / 1944 MB max <<< [21:02:42] : [Step 4/5] [2021-11-19 21:02:42,378][INFO ][main][root] >>> Heap: 492 MB used / 1944 MB commited / 1944 MB max <<< [21:02:42] : [Step 4/5] [21:02:42] >>> Non-Heap: 117 MB used / 125 MB commited / 0 MB max <<< [21:02:42] : [Step 4/5] [2021-11-19 21:02:42,378][INFO ][main][root] >>> Non-Heap: 117 MB used / 125 MB commited / 0 MB max <<< [21:02:42] : [Step 4/5] [2021-11-19 21:02:42,379][INFO ][main][root] >>> Stopping grid [name=failure.SystemWorkersBlockingTest0, id=f75238c2-3f26-40c4-a4ba-aeed69000000] [21:02:42] : [Step 4/5] [2021-11-19 21:02:42,388][INFO ][main][GridCacheProcessor] Stopped cache [cacheName=ignite-sys-cache] [21:02:42] : [Step 4/5] [2021-11-19 21:02:42,406][INFO ][main][SystemWorkersBlockingTest0] [21:02:42] : [Step 4/5] [21:02:42] : [Step 4/5] >>> +------------------------------------------------------+ [21:02:42] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV stopped OK [21:02:42] : [Step 4/5] >>> +------------------------------------------------------+ [21:02:42] : [Step 4/5] >>> Ignite instance name: failure.SystemWorkersBlockingTest0 [21:02:42] : [Step 4/5] >>> Grid uptime: 00:00:02.039 [21:02:42] : [Step 4/5] [21:02:42] : [Step 4/5] [21:02:42] : [Step 4/5] [21:02:42] >>> Starting test: SystemWorkersBlockingTest#testSingleWorker_NotInInfiniteLoop <<< [21:02:42] : [Step 4/5] [2021-11-19 21:02:42,408][INFO ][main][root] >>> Starting test: SystemWorkersBlockingTest#testSingleWorker_NotInInfiniteLoop <<< [21:02:42] : [Step 4/5] [21:02:42] >>> Heap: 492 MB used / 1944 MB commited / 1944 MB max <<< [21:02:42] : [Step 4/5] [2021-11-19 21:02:42,408][INFO ][main][root] >>> Heap: 492 MB used / 1944 MB commited / 1944 MB max <<< [21:02:42] : [Step 4/5] [21:02:42] >>> Non-Heap: 117 MB used / 125 MB commited / 0 MB max <<< [21:02:42] : [Step 4/5] [2021-11-19 21:02:42,408][INFO ][main][root] >>> Non-Heap: 117 MB used / 125 MB commited / 0 MB max <<< [21:02:44] : [Step 4/5] [21:02:44] >>> Stopping test: SystemWorkersBlockingTest#testSingleWorker_NotInInfiniteLoop in 2202 ms <<< [21:02:44] : [Step 4/5] [2021-11-19 21:02:44,611][INFO ][main][root] >>> Stopping test: SystemWorkersBlockingTest#testSingleWorker_NotInInfiniteLoop in 2202 ms <<< [21:02:44] : [Step 4/5] [21:02:44] >>> Heap: 493 MB used / 1944 MB commited / 1944 MB max <<< [21:02:44] : [Step 4/5] [2021-11-19 21:02:44,611][INFO ][main][root] >>> Heap: 493 MB used / 1944 MB commited / 1944 MB max <<< [21:02:44] : [Step 4/5] [21:02:44] >>> Non-Heap: 117 MB used / 125 MB commited / 0 MB max <<< [21:02:44] : [Step 4/5] [2021-11-19 21:02:44,612][INFO ][main][root] >>> Non-Heap: 117 MB used / 125 MB commited / 0 MB max <<< [21:02:44] : [Step 4/5] [21:02:44] >>> Starting test: SystemWorkersBlockingTest#testBlockingWorker <<< [21:02:44] : [Step 4/5] [2021-11-19 21:02:44,613][INFO ][main][root] >>> Starting test: SystemWorkersBlockingTest#testBlockingWorker <<< [21:02:44] : [Step 4/5] [21:02:44] >>> Heap: 493 MB used / 1944 MB commited / 1944 MB max <<< [21:02:44] : [Step 4/5] [2021-11-19 21:02:44,614][INFO ][main][root] >>> Heap: 493 MB used / 1944 MB commited / 1944 MB max <<< [21:02:44] : [Step 4/5] [21:02:44] >>> Non-Heap: 117 MB used / 125 MB commited / 0 MB max <<< [21:02:44] : [Step 4/5] [2021-11-19 21:02:44,614][INFO ][main][root] >>> Non-Heap: 117 MB used / 125 MB commited / 0 MB max <<< [21:02:44]W: [org.apache.ignite:ignite-core] [2021-11-19 21:02:44,621][WARN ][test-runner-#3789%failure.SystemWorkersBlockingTest%][G] Ignite work directory is not provided, automatically resolved to: /opt/buildagent/work/7bc1c54bc719b67c/work [21:02:44] : [Step 4/5] [2021-11-19 21:02:44,624][INFO ][test-runner-#3789%failure.SystemWorkersBlockingTest%][SystemWorkersBlockingTest0] [21:02:44] : [Step 4/5] [21:02:44] : [Step 4/5] >>> __________ ________________ [21:02:44] : [Step 4/5] >>> / _/ ___/ |/ / _/_ __/ __/ [21:02:44] : [Step 4/5] >>> _/ // (7 7 // / / / / _/ [21:02:44] : [Step 4/5] >>> /___/\___/_/|_/___/ /_/ /___/ [21:02:44] : [Step 4/5] >>> [21:02:44] : [Step 4/5] >>> ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:02:44] : [Step 4/5] >>> 2021 Copyright(C) Apache Software Foundation [21:02:44] : [Step 4/5] >>> [21:02:44] : [Step 4/5] >>> Ignite documentation: http://ignite.apache.org [21:02:44] : [Step 4/5] [21:02:44] : [Step 4/5] [2021-11-19 21:02:44,625][INFO ][test-runner-#3789%failure.SystemWorkersBlockingTest%][SystemWorkersBlockingTest0] Config URL: n/a [21:02:44] : [Step 4/5] [2021-11-19 21:02:44,626][INFO ][test-runner-#3789%failure.SystemWorkersBlockingTest%][SystemWorkersBlockingTest0] IgniteConfiguration [igniteInstanceName=failure.SystemWorkersBlockingTest0, pubPoolSize=24, svcPoolSize=24, callbackPoolSize=24, stripedPoolSize=24, sysPoolSize=24, mgmtPoolSize=4, dataStreamerPoolSize=24, utilityCachePoolSize=24, utilityCacheKeepAliveTime=60000, p2pPoolSize=2, qryPoolSize=24, buildIdxPoolSize=4, igniteHome=/opt/buildagent/work/7bc1c54bc719b67c, igniteWorkDir=/opt/buildagent/work/7bc1c54bc719b67c/work, mbeanSrv=com.sun.jmx.mbeanserver.JmxMBeanServer@6fe85038, nodeId=7f8d1739-63e1-4d39-9167-f8509de00000, marsh=BinaryMarshaller [], marshLocJobs=false, daemon=false, p2pEnabled=true, netTimeout=10000, netCompressionLevel=1, sndRetryDelay=1000, sndRetryCnt=3, metricsHistSize=10000, metricsUpdateFreq=1000, metricsExpTime=9223372036854775807, discoSpi=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=0, ackTimeout=0, marsh=null, reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], segPlc=STOP, segResolveAttempts=2, waitForSegOnStart=true, allResolversPassReq=true, segChkFreq=10000, commSpi=TcpCommunicationSpi [connectGate=org.apache.ignite.spi.communication.tcp.internal.ConnectGateway@6ba2d42c, ctxInitLatch=java.util.concurrent.CountDownLatch@7fbaeba3[Count = 1], stopping=false, clientPool=null, nioSrvWrapper=null, stateProvider=null], evtSpi=MemoryEventStorageSpi [expireAgeMs=9223372036854775807, expireCnt=10000, filter=null], colSpi=NoopCollisionSpi [], deploySpi=LocalDeploymentSpi [], indexingSpi=org.apache.ignite.spi.indexing.noop.NoopIndexingSpi@e65de11, addrRslvr=null, encryptionSpi=org.apache.ignite.spi.encryption.noop.NoopEncryptionSpi@5c331d2b, tracingSpi=org.apache.ignite.spi.tracing.NoopTracingSpi@240c9399, clientMode=false, rebalanceThreadPoolSize=4, rebalanceTimeout=10000, rebalanceBatchesPrefetchCnt=3, rebalanceThrottle=0, rebalanceBatchSize=524288, txCfg=TransactionConfiguration [txSerEnabled=false, dfltIsolation=REPEATABLE_READ, dfltConcurrency=PESSIMISTIC, dfltTxTimeout=0, txTimeoutOnPartitionMapExchange=0, deadlockTimeout=10000, pessimisticTxLogSize=0, pessimisticTxLogLinger=10000, tmLookupClsName=null, txManagerFactory=null, useJtaSync=false], cacheSanityCheckEnabled=true, discoStartupDelay=60000, deployMode=SHARED, p2pMissedCacheSize=100, locHost=127.0.0.1, timeSrvPortBase=31100, timeSrvPortRange=100, failureDetectionTimeout=10000, sysWorkerBlockedTimeout=1000, clientFailureDetectionTimeout=10000, metricsLogFreq=0, connectorCfg=null, odbcCfg=null, warmupClos=null, atomicCfg=AtomicConfiguration [seqReserveSize=1000, cacheMode=PARTITIONED, backups=1, aff=null, grpName=null], classLdr=null, sslCtxFactory=null, platformCfg=null, binaryCfg=null, memCfg=null, pstCfg=null, dsCfg=DataStorageConfiguration [sysRegionInitSize=41943040, sysRegionMaxSize=104857600, pageSize=0, concLvl=0, dfltDataRegConf=DataRegionConfiguration [name=default, maxSize=3221225472, initSize=268435456, swapPath=null, pageEvictionMode=DISABLED, pageReplacementMode=CLOCK, evictionThreshold=0.9, emptyPagesPoolSize=100, metricsEnabled=false, metricsSubIntervalCount=5, metricsRateTimeInterval=60000, persistenceEnabled=false, checkpointPageBufSize=0, lazyMemoryAllocation=true, warmUpCfg=null], dataRegions=null, storagePath=null, checkpointFreq=180000, lockWaitTime=10000, checkpointThreads=4, checkpointWriteOrder=SEQUENTIAL, walHistSize=20, maxWalArchiveSize=1073741824, walSegments=10, walSegmentSize=67108864, walPath=db/wal, walArchivePath=db/wal/archive, cdcWalPath=db/wal/cdc, cdcEnabled=false, metricsEnabled=false, walMode=LOG_ONLY, walTlbSize=131072, walBuffSize=0, walFlushFreq=2000, walFsyncDelay=1000, walRecordIterBuffSize=67108864, alwaysWriteFullPages=false, fileIOFactory=org.apache.ignite.internal.processors.cache.persistence.file.AsyncFileIOFactory@38d47440, metricsSubIntervalCnt=5, metricsRateTimeInterval=60000, walAutoArchiveAfterInactivity=-1, walForceArchiveTimeout=-1, writeThrottlingEnabled=false, walCompactionEnabled=false, walCompactionLevel=1, checkpointReadLockTimeout=null, walPageCompression=DISABLED, walPageCompressionLevel=null, dfltWarmUpCfg=null, encCfg=org.apache.ignite.configuration.EncryptionConfiguration@1fe6208, defragmentationThreadPoolSize=4, minWalArchiveSize=-1], snapshotPath=snapshots, activeOnStart=true, activeOnStartPropSetFlag=false, autoActivation=true, autoActivationPropSetFlag=false, clusterStateOnStart=null, sqlConnCfg=null, cliConnCfg=ClientConnectorConfiguration [host=null, port=10800, portRange=100, sockSndBufSize=0, sockRcvBufSize=0, tcpNoDelay=true, maxOpenCursorsPerConn=128, threadPoolSize=24, selectorCnt=12, idleTimeout=0, handshakeTimeout=10000, jdbcEnabled=true, odbcEnabled=true, thinCliEnabled=true, sslEnabled=false, useIgniteSslCtxFactory=true, sslClientAuth=false, sslCtxFactory=null, thinCliCfg=ThinClientConfiguration [maxActiveTxPerConn=100, maxActiveComputeTasksPerConn=0]], mvccVacuumThreadCnt=2, mvccVacuumFreq=5000, authEnabled=false, failureHnd=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_CRITICAL_OPERATION_TIMEOUT]], commFailureRslvr=null, sqlCfg=SqlConfiguration [longQryWarnTimeout=3000, dfltQryTimeout=0, sqlQryHistSize=1000, validationEnabled=false], asyncContinuationExecutor=null] [21:02:44] : [Step 4/5] [2021-11-19 21:02:44,634][INFO ][test-runner-#3789%failure.SystemWorkersBlockingTest%][SystemWorkersBlockingTest0] Daemon mode: off [21:02:44] : [Step 4/5] [2021-11-19 21:02:44,634][INFO ][test-runner-#3789%failure.SystemWorkersBlockingTest%][SystemWorkersBlockingTest0] OS: Linux 4.15.0-151-generic amd64 [21:02:44] : [Step 4/5] [2021-11-19 21:02:44,635][INFO ][test-runner-#3789%failure.SystemWorkersBlockingTest%][SystemWorkersBlockingTest0] OS user: teamcity [21:02:44] : [Step 4/5] [2021-11-19 21:02:44,635][INFO ][test-runner-#3789%failure.SystemWorkersBlockingTest%][SystemWorkersBlockingTest0] PID: 16724 [21:02:44] : [Step 4/5] [2021-11-19 21:02:44,635][INFO ][test-runner-#3789%failure.SystemWorkersBlockingTest%][SystemWorkersBlockingTest0] Language runtime: Java Platform API Specification ver. 1.8 [21:02:44] : [Step 4/5] [2021-11-19 21:02:44,635][INFO ][test-runner-#3789%failure.SystemWorkersBlockingTest%][SystemWorkersBlockingTest0] VM information: Java(TM) SE Runtime Environment 1.8.0_261-b12 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 25.261-b12 [21:02:44] : [Step 4/5] [2021-11-19 21:02:44,636][INFO ][test-runner-#3789%failure.SystemWorkersBlockingTest%][SystemWorkersBlockingTest0] VM total memory: 1.9GB [21:02:44] : [Step 4/5] [2021-11-19 21:02:44,636][INFO ][test-runner-#3789%failure.SystemWorkersBlockingTest%][SystemWorkersBlockingTest0] Remote Management [restart: off, REST: off, JMX (remote: off)] [21:02:44] : [Step 4/5] [2021-11-19 21:02:44,636][INFO ][test-runner-#3789%failure.SystemWorkersBlockingTest%][SystemWorkersBlockingTest0] Logger: GridTestLog4jLogger [quiet=false, config=null] [21:02:44] : [Step 4/5] [2021-11-19 21:02:44,637][INFO ][test-runner-#3789%failure.SystemWorkersBlockingTest%][SystemWorkersBlockingTest0] IGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c [21:02:44] : [Step 4/5] [2021-11-19 21:02:44,637][INFO ][test-runner-#3789%failure.SystemWorkersBlockingTest%][SystemWorkersBlockingTest0] VM arguments: [-DIGNITE_DUMP_THREADS_ON_FAILURE=false, -DMono=/usr/bin/mono-sgen, -DMono4.0_x64=/usr/lib/mono/4.0, -DMono4.5_x64=/usr/lib/mono/4.5, -DMonoVersion=6.12.0.90, -DSKIP_BUILD=false, -Dagent.home.dir=/opt/buildagent, -Dagent.name=aitc-lin02_03, -Dagent.ownPort=9090, -Dagent.work.dir=/opt/buildagent/work, -Dbuild.number=95, -Dbuild.vcs.number=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.1=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.GitHubApacheIgnite=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dclassworlds.conf=/opt/buildagent/temp/buildTmp/teamcity.m2.conf, -Dcom.jetbrains.maven.watcher.report.file=/opt/buildagent/temp/buildTmp/maven-build-info.xml, -Djava.io.tmpdir=/opt/buildagent/temp/buildTmp, -Dmaven.home=/opt/buildagent/tools/maven3_6, -Dmaven.multiModuleProjectDirectory=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.agent.cpuBenchmark=457, -Dteamcity.agent.dotnet.agent_url=http://localhost:9090/RPC2, -Dteamcity.agent.dotnet.build_id=6278078, -Dteamcity.auth.password=*******, -Dteamcity.auth.userId=TeamCityBuildId=6278078, -Dteamcity.build.changedFiles.file=/opt/buildagent/temp/buildTmp/changedFiles6342607772318147725.txt, -Dteamcity.build.checkoutDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.build.id=6278078, -Dteamcity.build.properties.file=/opt/buildagent/temp/buildTmp/teamcity.build5164517880467851002.properties, -Dteamcity.build.tempDir=/opt/buildagent/temp/buildTmp, -Dteamcity.build.workingDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.buildConfName=Basic 3, -Dteamcity.buildType.id=IgniteTests24Java8_Basic3, -Dteamcity.configuration.properties.file=/opt/buildagent/temp/buildTmp/teamcity.config5591980786735343870.properties, -Dteamcity.maven.userSettings.path=/opt/buildagent/temp/buildTmp/maven_settings_585072866407032347.xml, -Dteamcity.maven.watcher.home=/opt/buildagent/plugins/mavenPlugin/maven-watcher-jdk16, -Dteamcity.projectName=Ignite Tests 2.x (JDK 8/11), -Dteamcity.runner.properties.file=/opt/buildagent/temp/buildTmp/teamcity.runner9098465561618137420.properties, -Dteamcity.tests.recentlyFailedTests.file=/opt/buildagent/temp/buildTmp/testsToRunFirst3891775683130404069.txt, -Dteamcity.version=2021.2 (build 99542), -ea, -Xms2g, -Xmx2g, -XX:+HeapDumpOnOutOfMemoryError, -DIGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_TEST_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_UPDATE_NOTIFIER=false, -DIGNITE_NO_DISCO_ORDER=true, -DIGNITE_PERFORMANCE_SUGGESTIONS_DISABLED=true, -Djava.net.preferIPv4Stack=true, -DTEST_SCALE_FACTOR=1.0, -DIGNITE_TEST_PROP_LOG4J_FILE=log4j-tc-test.xml, -DIGNITE_QUIET=false, -DIGNITE_MARSHAL_BUFFERS_RECHECK=1000, -Dmaven.repo.local=/opt/buildagent/.m2/repository] [21:02:44] : [Step 4/5] [2021-11-19 21:02:44,643][INFO ][test-runner-#3789%failure.SystemWorkersBlockingTest%][SystemWorkersBlockingTest0] System cache's DataRegion size is configured to 40 MB. Use DataStorageConfiguration.systemRegionInitialSize property to change the setting. [21:02:44] : [Step 4/5] [2021-11-19 21:02:44,643][INFO ][test-runner-#3789%failure.SystemWorkersBlockingTest%][SystemWorkersBlockingTest0] Configured caches [in 'sysMemPlc' dataRegion: ['ignite-sys-cache']] [21:02:44]W: [org.apache.ignite:ignite-core] [2021-11-19 21:02:44,644][WARN ][test-runner-#3789%failure.SystemWorkersBlockingTest%][SystemWorkersBlockingTest0] Peer class loading is enabled (disable it in production for performance and deployment consistency reasons) [21:02:44] : [Step 4/5] [2021-11-19 21:02:44,644][INFO ][test-runner-#3789%failure.SystemWorkersBlockingTest%][SystemWorkersBlockingTest0] 3-rd party licenses can be found at: /opt/buildagent/work/7bc1c54bc719b67c/libs/licenses [21:02:44] : [Step 4/5] [2021-11-19 21:02:44,650][INFO ][test-runner-#3789%failure.SystemWorkersBlockingTest%][IgnitePluginProcessor] Configured plugins: [21:02:44] : [Step 4/5] [2021-11-19 21:02:44,651][INFO ][test-runner-#3789%failure.SystemWorkersBlockingTest%][IgnitePluginProcessor] ^-- StanByClusterTestProvider 1.0 [21:02:44] : [Step 4/5] [2021-11-19 21:02:44,651][INFO ][test-runner-#3789%failure.SystemWorkersBlockingTest%][IgnitePluginProcessor] ^-- null [21:02:44] : [Step 4/5] [2021-11-19 21:02:44,651][INFO ][test-runner-#3789%failure.SystemWorkersBlockingTest%][IgnitePluginProcessor] [21:02:44] : [Step 4/5] [2021-11-19 21:02:44,652][INFO ][test-runner-#3789%failure.SystemWorkersBlockingTest%][IgnitePluginProcessor] ^-- PageMemory tracker plugin 1.0 [21:02:44] : [Step 4/5] [2021-11-19 21:02:44,652][INFO ][test-runner-#3789%failure.SystemWorkersBlockingTest%][IgnitePluginProcessor] ^-- null [21:02:44] : [Step 4/5] [2021-11-19 21:02:44,652][INFO ][test-runner-#3789%failure.SystemWorkersBlockingTest%][IgnitePluginProcessor] [21:02:44] : [Step 4/5] [2021-11-19 21:02:44,652][INFO ][test-runner-#3789%failure.SystemWorkersBlockingTest%][IgnitePluginProcessor] ^-- TestDistibutedConfigurationPlugin 1.0 [21:02:44] : [Step 4/5] [2021-11-19 21:02:44,653][INFO ][test-runner-#3789%failure.SystemWorkersBlockingTest%][IgnitePluginProcessor] ^-- null [21:02:44] : [Step 4/5] [2021-11-19 21:02:44,653][INFO ][test-runner-#3789%failure.SystemWorkersBlockingTest%][IgnitePluginProcessor] [21:02:44] : [Step 4/5] [2021-11-19 21:02:44,653][INFO ][test-runner-#3789%failure.SystemWorkersBlockingTest%][IgnitePluginProcessor] ^-- NodeValidationPluginProvider 1.0 [21:02:44] : [Step 4/5] [2021-11-19 21:02:44,654][INFO ][test-runner-#3789%failure.SystemWorkersBlockingTest%][IgnitePluginProcessor] ^-- null [21:02:44] : [Step 4/5] [2021-11-19 21:02:44,654][INFO ][test-runner-#3789%failure.SystemWorkersBlockingTest%][IgnitePluginProcessor] [21:02:44] : [Step 4/5] [2021-11-19 21:02:44,654][INFO ][test-runner-#3789%failure.SystemWorkersBlockingTest%][FailureProcessor] Configured failure handler: [hnd=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_CRITICAL_OPERATION_TIMEOUT]]] [21:02:44] : [Step 4/5] [2021-11-19 21:02:44,684][INFO ][test-runner-#3789%failure.SystemWorkersBlockingTest%][TcpCommunicationSpi] Successfully bound communication NIO server to TCP port [port=45060, locHost=/127.0.0.1, selectorsCnt=12, selectorSpins=0, pairedConn=false] [21:02:44]W: [org.apache.ignite:ignite-core] [2021-11-19 21:02:44,684][WARN ][test-runner-#3789%failure.SystemWorkersBlockingTest%][TcpCommunicationSpi] Message queue limit is set to 0 which may lead to potential OOMEs when running cache operations in FULL_ASYNC or PRIMARY_SYNC modes due to message queues growth on sender and receiver sides. [21:02:44] : [Step 4/5] [2021-11-19 21:02:44,695][INFO ][test-runner-#3789%failure.SystemWorkersBlockingTest%][GridCollisionManager] Collision resolution is disabled (all jobs will be activated upon arrival). [21:02:44] : [Step 4/5] [2021-11-19 21:02:44,696][INFO ][test-runner-#3789%failure.SystemWorkersBlockingTest%][SystemWorkersBlockingTest0] Security status [authentication=off, sandbox=off, tls/ssl=off] [21:02:44] : [Step 4/5] [2021-11-19 21:02:44,702][INFO ][test-runner-#3789%failure.SystemWorkersBlockingTest%][TestTcpDiscoverySpi] Successfully bound to TCP port [port=47500, localHost=localhost/127.0.0.1, locNodeId=7f8d1739-63e1-4d39-9167-f8509de00000] [21:02:44] : [Step 4/5] [2021-11-19 21:02:44,704][INFO ][test-runner-#3789%failure.SystemWorkersBlockingTest%][IgniteCacheDatabaseSharedManager] Configured data regions initialized successfully [total=4] [21:02:44] : [Step 4/5] [2021-11-19 21:02:44,708][INFO ][test-runner-#3789%failure.SystemWorkersBlockingTest%][ClientListenerProcessor] Client connector processor has started on TCP port 10800 [21:02:44] : [Step 4/5] [2021-11-19 21:02:44,712][INFO ][test-runner-#3789%failure.SystemWorkersBlockingTest%][SystemWorkersBlockingTest0] Non-loopback local IPs: 172.17.0.4 [21:02:44] : [Step 4/5] [2021-11-19 21:02:44,712][INFO ][test-runner-#3789%failure.SystemWorkersBlockingTest%][SystemWorkersBlockingTest0] Enabled local MACs: 0242AC110004 [21:02:44] : [Step 4/5] [2021-11-19 21:02:44,713][INFO ][test-runner-#3789%failure.SystemWorkersBlockingTest%][ClusterProcessor] Cluster ID and tag has been read from metastorage: null [21:02:44] : [Step 4/5] [2021-11-19 21:02:44,713][INFO ][test-runner-#3789%failure.SystemWorkersBlockingTest%][IgniteClusterImpl] Shutdown policy was updated [oldVal=null, newVal=null] [21:02:44] : [Step 4/5] [2021-11-19 21:02:44,718][INFO ][disco-notifier-worker-#3873%failure.SystemWorkersBlockingTest0%][GridClusterStateProcessor] Received activate cluster request with BaselineTopology[id=0] initiator node ID: 7f8d1739-63e1-4d39-9167-f8509de00000 [21:02:44] : [Step 4/5] [2021-11-19 21:02:44,719][INFO ][disco-notifier-worker-#3873%failure.SystemWorkersBlockingTest0%][GridClusterStateProcessor] Started state transition: activate cluster [21:02:44] : [Step 4/5] [2021-11-19 21:02:44,719][INFO ][disco-notifier-worker-#3873%failure.SystemWorkersBlockingTest0%][GridClusterStateProcessor] Received state change finish message: ACTIVE [21:02:44] : [Step 4/5] [2021-11-19 21:02:44,719][INFO ][disco-notifier-worker-#3873%failure.SystemWorkersBlockingTest0%][GridClusterStateProcessor] Cluster state was changed from ACTIVE to ACTIVE [21:02:44] : [Step 4/5] [2021-11-19 21:02:44,720][INFO ][disco-notifier-worker-#3873%failure.SystemWorkersBlockingTest0%][MvccProcessorImpl] Assigned mvcc coordinator [crd=MvccCoordinator [topVer=AffinityTopologyVersion [topVer=1, minorTopVer=0], nodeId=7f8d1739-63e1-4d39-9167-f8509de00000, ver=1637344964712, local=true, initialized=false]] [21:02:44] : [Step 4/5] [2021-11-19 21:02:44,726][INFO ][disco-notifier-worker-#3873%failure.SystemWorkersBlockingTest0%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustEnabled' was changed from 'null' to 'true' [21:02:44] : [Step 4/5] [2021-11-19 21:02:44,727][INFO ][sys-#3878%failure.SystemWorkersBlockingTest0%][ClusterProcessor] Writing cluster ID and tag to metastorage on ready for write ClusterIdAndTag [id=051fb9c2-fabd-489e-897e-b9f67c1785fe, tag=priceless_perlman] [21:02:44] : [Step 4/5] [2021-11-19 21:02:44,727][INFO ][disco-notifier-worker-#3873%failure.SystemWorkersBlockingTest0%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustTimeout' was changed from 'null' to '0' [21:02:44] : [Step 4/5] [2021-11-19 21:02:44,728][INFO ][disco-notifier-worker-#3873%failure.SystemWorkersBlockingTest0%][IgniteTxManager] Transactions parameter 'longOperationsDumpTimeout' was changed from 'null' to '60000' [21:02:44] : [Step 4/5] [2021-11-19 21:02:44,728][INFO ][disco-notifier-worker-#3873%failure.SystemWorkersBlockingTest0%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpThreshold' was changed from 'null' to '0' [21:02:44] : [Step 4/5] [2021-11-19 21:02:44,729][INFO ][disco-notifier-worker-#3873%failure.SystemWorkersBlockingTest0%][IgniteTxManager] Transactions parameter 'transactionTimeDumpSamplesCoefficient' was changed from 'null' to '0.0' [21:02:44] : [Step 4/5] [2021-11-19 21:02:44,730][INFO ][disco-notifier-worker-#3873%failure.SystemWorkersBlockingTest0%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpSamplesPerSecondLimit' was changed from 'null' to '5' [21:02:44] : [Step 4/5] [2021-11-19 21:02:44,730][INFO ][disco-notifier-worker-#3873%failure.SystemWorkersBlockingTest0%][IgniteTxManager] Transactions parameter 'collisionsDumpInterval' was changed from 'null' to '1000' [21:02:44] : [Step 4/5] [2021-11-19 21:02:44,731][INFO ][disco-notifier-worker-#3873%failure.SystemWorkersBlockingTest0%][IgniteTxManager] Transactions parameter 'txOwnerDumpRequestsAllowed' was changed from 'null' to 'true' [21:02:44] : [Step 4/5] [2021-11-19 21:02:44,732][INFO ][disco-notifier-worker-#3873%failure.SystemWorkersBlockingTest0%][ClusterProcessor] priceless_perlman [21:02:44] : [Step 4/5] [2021-11-19 21:02:44,740][INFO ][exchange-worker-#3879%failure.SystemWorkersBlockingTest0%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=1, minorTopVer=0], crd=true, evt=NODE_JOINED, evtNode=7f8d1739-63e1-4d39-9167-f8509de00000, customEvt=null, allowMerge=false, exchangeFreeSwitch=false] [21:02:44] : [Step 4/5] [2021-11-19 21:02:44,741][INFO ][exchange-worker-#3879%failure.SystemWorkersBlockingTest0%][IgniteCacheDatabaseSharedManager] Data Regions Started: 4 [21:02:44] : [Step 4/5] [2021-11-19 21:02:44,742][INFO ][exchange-worker-#3879%failure.SystemWorkersBlockingTest0%][IgniteCacheDatabaseSharedManager] ^-- sysMemPlc region [type=internal, persistence=false, lazyAlloc=false, [21:02:44] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=40MB] [21:02:44] : [Step 4/5] ^-- default region [type=default, persistence=false, lazyAlloc=true, [21:02:44] : [Step 4/5] ... initCfg=256MB, maxCfg=3072MB, usedRam=0MB, freeRam=100%, allocRam=0MB] [21:02:44] : [Step 4/5] ^-- TxLog region [type=internal, persistence=false, lazyAlloc=false, [21:02:44] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=40MB] [21:02:44] : [Step 4/5] ^-- volatileDsMemPlc region [type=user, persistence=false, lazyAlloc=true, [21:02:44] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB] [21:02:44] : [Step 4/5] [21:02:44] : [Step 4/5] [2021-11-19 21:02:44,743][INFO ][exchange-worker-#3879%failure.SystemWorkersBlockingTest0%][msg] Components activation performed in 3 ms. [21:02:44] : [Step 4/5] [2021-11-19 21:02:44,745][INFO ][exchange-worker-#3879%failure.SystemWorkersBlockingTest0%][GridCacheProcessor] Started cache [name=ignite-sys-cache, id=-2100569601, dataRegionName=sysMemPlc, mode=REPLICATED, atomicity=TRANSACTIONAL, backups=2147483647, mvcc=false] [21:02:44] : [Step 4/5] [2021-11-19 21:02:44,745][INFO ][exchange-worker-#3879%failure.SystemWorkersBlockingTest0%][GridCacheProcessor] Starting caches on local join performed in 0 ms. [21:02:44] : [Step 4/5] [2021-11-19 21:02:44,747][INFO ][exchange-worker-#3879%failure.SystemWorkersBlockingTest0%][GridDhtPartitionsExchangeFuture] Skipped waiting for partitions release future (local node is joining) [topVer=AffinityTopologyVersion [topVer=1, minorTopVer=0]] [21:02:44] : [Step 4/5] [2021-11-19 21:02:44,752][INFO ][exchange-worker-#3879%failure.SystemWorkersBlockingTest0%][GridDhtPartitionsExchangeFuture] finishExchangeOnCoordinator [topVer=AffinityTopologyVersion [topVer=1, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=1, minorTopVer=0]] [21:02:44] : [Step 4/5] [2021-11-19 21:02:44,757][INFO ][exchange-worker-#3879%failure.SystemWorkersBlockingTest0%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=1, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=1, minorTopVer=0], err=null, rebalanced=true, wasRebalanced=false] [21:02:44] : [Step 4/5] [2021-11-19 21:02:44,758][INFO ][exchange-worker-#3879%failure.SystemWorkersBlockingTest0%][GridCacheProcessor] Finish proxy initialization, cacheName=ignite-sys-cache, localNodeId=7f8d1739-63e1-4d39-9167-f8509de00000 [21:02:44] : [Step 4/5] [2021-11-19 21:02:44,759][INFO ][exchange-worker-#3879%failure.SystemWorkersBlockingTest0%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=7f8d1739-63e1-4d39-9167-f8509de00000, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=1, minorTopVer=0], evt=NODE_JOINED, evtNode=TcpDiscoveryNode [id=7f8d1739-63e1-4d39-9167-f8509de00000, consistentId=127.0.0.1:47500, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637344964711, loc=true, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=1, minorTopVer=0]] [21:02:44] : [Step 4/5] [2021-11-19 21:02:44,760][INFO ][exchange-worker-#3879%failure.SystemWorkersBlockingTest0%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=1, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=1, minorTopVer=0], stage="Waiting in exchange queue" (18 ms), stage="Exchange parameters initialization" (0 ms), stage="Components activation" (2 ms), stage="Determine exchange type" (3 ms), stage="Preloading notification" (0 ms), stage="After states restored callback" (5 ms), stage="WAL history reservation" (0 ms), stage="Waiting for all single messages" (0 ms), stage="Affinity recalculation (crd)" (0 ms), stage="Collect update counters and create affinity messages" (0 ms), stage="Assign partitions states" (0 ms), stage="Validate partitions states" (0 ms), stage="Apply update counters" (0 ms), stage="Full message preparing" (3 ms), stage="Full message sending" (0 ms), stage="State finish message sending" (0 ms), stage="Exchange done" (3 ms), stage="Total time" (34 ms)] [21:02:44] : [Step 4/5] [2021-11-19 21:02:44,761][INFO ][exchange-worker-#3879%failure.SystemWorkersBlockingTest0%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=1, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=1, minorTopVer=0], stage="Coordinator affinity cache init [grp=ignite-sys-cache]" (3 ms) (parent=Determine exchange type), stage="First node affinity initialization (node join) [grp=ignite-sys-cache]" (0 ms) (parent=Determine exchange type)] [21:02:44] : [Step 4/5] [2021-11-19 21:02:44,762][INFO ][exchange-worker-#3879%failure.SystemWorkersBlockingTest0%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=1, minorTopVer=0], crd=true] [21:02:44] : [Step 4/5] [2021-11-19 21:02:44,763][INFO ][exchange-worker-#3879%failure.SystemWorkersBlockingTest0%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=1, minorTopVer=0], force=false, evt=NODE_JOINED, node=7f8d1739-63e1-4d39-9167-f8509de00000] [21:02:44] : [Step 4/5] [2021-11-19 21:02:44,767][INFO ][test-runner-#3789%failure.SystemWorkersBlockingTest%][SystemWorkersBlockingTest0] To start Console Management & Monitoring run ignitevisorcmd.{sh|bat} [21:02:44] : [Step 4/5] [2021-11-19 21:02:44,768][INFO ][test-runner-#3789%failure.SystemWorkersBlockingTest%][SystemWorkersBlockingTest0] [21:02:44] : [Step 4/5] [21:02:44] : [Step 4/5] >>> +-------------------------------------------+ [21:02:44] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:02:44] : [Step 4/5] >>> +-------------------------------------------+ [21:02:44] : [Step 4/5] >>> OS name: Linux 4.15.0-151-generic amd64 [21:02:44] : [Step 4/5] >>> CPU(s): 24 [21:02:44] : [Step 4/5] >>> Heap: 2.0GB [21:02:44] : [Step 4/5] >>> VM name: 16724@c4dfe9a430b2 [21:02:44] : [Step 4/5] >>> Ignite instance name: failure.SystemWorkersBlockingTest0 [21:02:44] : [Step 4/5] >>> Local node [ID=7F8D1739-63E1-4D39-9167-F8509DE00000, order=1, clientMode=false] [21:02:44] : [Step 4/5] >>> Local node addresses: [127.0.0.1] [21:02:44] : [Step 4/5] >>> Local ports: TCP:10800 TCP:45060 TCP:47500 [21:02:44] : [Step 4/5] [21:02:44] : [Step 4/5] [2021-11-19 21:02:44,769][INFO ][test-runner-#3789%failure.SystemWorkersBlockingTest%][GridDiscoveryManager] Topology snapshot [ver=1, locNode=7f8d1739, servers=1, clients=0, state=ACTIVE, CPUs=24, offheap=3.0GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=7f8d1739-63e1-4d39-9167-f8509de00000, consistentId=127.0.0.1:47500, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:02:44] : [Step 4/5] [2021-11-19 21:02:44,769][INFO ][test-runner-#3789%failure.SystemWorkersBlockingTest%][GridDiscoveryManager] ^-- Baseline [id=0, size=1, online=1, offline=0] [21:02:44] : [Step 4/5] [2021-11-19 21:02:44,770][INFO ][test-runner-#3789%failure.SystemWorkersBlockingTest%][G] Node started : [stage="Configure system pool" (0 ms),stage="Start managers" (74 ms),stage="Configure binary metadata" (2 ms),stage="Start processors" (11 ms),stage="Start 'StanByClusterTestProvider' plugin" (0 ms),stage="Start 'PageMemory tracker plugin' plugin" (0 ms),stage="Start 'TestDistibutedConfigurationPlugin' plugin" (0 ms),stage="Start 'NodeValidationPluginProvider' plugin" (0 ms),stage="Init metastore" (2 ms),stage="Finish recovery" (0 ms),stage="Join topology" (6 ms),stage="Await transition" (2 ms),stage="Await exchange" (47 ms),stage="Total time" (144 ms)] [21:02:44] : [Step 4/5] [2021-11-19 21:02:44,771][INFO ][test-runner-#3789%failure.SystemWorkersBlockingTest%][root] Node started with the following configuration [id=7f8d1739-63e1-4d39-9167-f8509de00000, marshaller=BinaryMarshaller [], discovery=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=5000, ackTimeout=5000, marsh=JdkMarshaller [clsFilter=org.apache.ignite.marshaller.MarshallerUtils$1@104818a4], reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], binaryCfg=null, lateAff=true] [21:02:46]W: [org.apache.ignite:ignite-core] [2021-11-19 21:02:46,632][ERROR][tcp-disco-msg-worker-[crd]-#191%failure.SystemWorkersBlockingTest0%-#3874%failure.SystemWorkersBlockingTest0%][G] Blocked system-critical thread has been detected. This can lead to cluster-wide undefined behaviour [workerName=test-worker, threadName=pool-4-thread-1, blockedFor=1s] [21:02:46]W: [org.apache.ignite:ignite-core] [2021-11-19 21:02:46,634][ERROR][tcp-disco-msg-worker-[crd]-#191%failure.SystemWorkersBlockingTest0%-#3874%failure.SystemWorkersBlockingTest0%][IgniteTestResources] Critical system error detected. Will be handled accordingly to configured handler [hnd=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_CRITICAL_OPERATION_TIMEOUT]], failureCtx=FailureContext [type=SYSTEM_WORKER_BLOCKED, err=class o.a.i.IgniteException: GridWorker [name=test-worker, igniteInstanceName=failure.SystemWorkersBlockingTest0, finished=false, heartbeatTs=1637344964772]]] [21:02:46]W: [org.apache.ignite:ignite-core] class org.apache.ignite.IgniteException: GridWorker [name=test-worker, igniteInstanceName=failure.SystemWorkersBlockingTest0, finished=false, heartbeatTs=1637344964772] [21:02:46]W: [org.apache.ignite:ignite-core] at sun.misc.Unsafe.park(Native Method) [21:02:46]W: [org.apache.ignite:ignite-core] at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) [21:02:46]W: [org.apache.ignite:ignite-core] at java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:836) [21:02:46]W: [org.apache.ignite:ignite-core] at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:997) [21:02:46]W: [org.apache.ignite:ignite-core] at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1304) [21:02:46]W: [org.apache.ignite:ignite-core] at java.util.concurrent.CountDownLatch.await(CountDownLatch.java:231) [21:02:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.failure.SystemWorkersBlockingTest$LatchingGridWorker.body(SystemWorkersBlockingTest.java:235) [21:02:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:125) [21:02:46]W: [org.apache.ignite:ignite-core] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [21:02:46]W: [org.apache.ignite:ignite-core] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [21:02:46]W: [org.apache.ignite:ignite-core] at java.lang.Thread.run(Thread.java:748) [21:02:46]W: [org.apache.ignite:ignite-core] [2021-11-19 21:02:46,637][WARN ][tcp-disco-msg-worker-[crd]-#191%failure.SystemWorkersBlockingTest0%-#3874%failure.SystemWorkersBlockingTest0%][CacheDiagnosticManager] Page locks dump: [21:02:46]W: [org.apache.ignite:ignite-core] [21:02:46]W: [org.apache.ignite:ignite-core] [21:02:46]W: [org.apache.ignite:ignite-core] [21:02:46] : [Step 4/5] [21:02:46] >>> Stopping test: SystemWorkersBlockingTest#testBlockingWorker in 2025 ms <<< [21:02:46] : [Step 4/5] [2021-11-19 21:02:46,639][INFO ][main][root] >>> Stopping test: SystemWorkersBlockingTest#testBlockingWorker in 2025 ms <<< [21:02:46] : [Step 4/5] [21:02:46] >>> Heap: 514 MB used / 1944 MB commited / 1944 MB max <<< [21:02:46] : [Step 4/5] [2021-11-19 21:02:46,640][INFO ][main][root] >>> Heap: 514 MB used / 1944 MB commited / 1944 MB max <<< [21:02:46] : [Step 4/5] [21:02:46] >>> Non-Heap: 117 MB used / 125 MB commited / 0 MB max <<< [21:02:46] : [Step 4/5] [2021-11-19 21:02:46,640][INFO ][main][root] >>> Non-Heap: 117 MB used / 125 MB commited / 0 MB max <<< [21:02:46] : [Step 4/5] [2021-11-19 21:02:46,640][INFO ][main][root] >>> Stopping grid [name=failure.SystemWorkersBlockingTest0, id=7f8d1739-63e1-4d39-9167-f8509de00000] [21:02:46] : [Step 4/5] [2021-11-19 21:02:46,650][INFO ][main][GridCacheProcessor] Stopped cache [cacheName=ignite-sys-cache] [21:02:46] : [Step 4/5] [2021-11-19 21:02:46,660][INFO ][main][SystemWorkersBlockingTest0] [21:02:46] : [Step 4/5] [21:02:46] : [Step 4/5] >>> +------------------------------------------------------+ [21:02:46] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV stopped OK [21:02:46] : [Step 4/5] >>> +------------------------------------------------------+ [21:02:46] : [Step 4/5] >>> Ignite instance name: failure.SystemWorkersBlockingTest0 [21:02:46] : [Step 4/5] >>> Grid uptime: 00:00:01.889 [21:02:46] : [Step 4/5] [21:02:46] : [Step 4/5] [21:02:46] : [Step 4/5] [21:02:46] >>> Stopping test class: SystemWorkersBlockingTest <<< [21:02:46] : [Step 4/5] [2021-11-19 21:02:46,661][INFO ][main][root] >>> Stopping test class: SystemWorkersBlockingTest <<< [21:02:46] : [Step 4/5] [21:02:46] >>> Starting test class: CheckpointReadLockFailureTest <<< [21:02:46] : [Step 4/5] [2021-11-19 21:02:46,662][INFO ][main][root] >>> Starting test class: CheckpointReadLockFailureTest <<< [21:02:46] : [Step 4/5] Running org.apache.ignite.internal.processors.cache.persistence.CheckpointReadLockFailureTest [21:02:46]i: [Step 4/5] ##teamcity[importData type='surefire' path='/opt/buildagent/temp/buildTmp/ignite-tools-junit-reports1777670380320881607/test-org.apache.ignite.testsuites.IgniteBasicWithPersistenceTestSuite1637344960254.xml'] [21:02:46] : [Step 4/5] Importing data from '/opt/buildagent/temp/buildTmp/ignite-tools-junit-reports1777670380320881607/test-org.apache.ignite.testsuites.IgniteBasicWithPersistenceTestSuite1637344960254.xml' (508 B) with 'surefire' processor [21:02:46] : [Step 4/5] [21:02:46] >>> Starting test: CheckpointReadLockFailureTest#testReentrance <<< [21:02:46] : [Step 4/5] [2021-11-19 21:02:46,675][INFO ][main][root] >>> Starting test: CheckpointReadLockFailureTest#testReentrance <<< [21:02:46] : [Step 4/5] [21:02:46] >>> Heap: 518 MB used / 1944 MB commited / 1944 MB max <<< [21:02:46] : [Step 4/5] [2021-11-19 21:02:46,675][INFO ][main][root] >>> Heap: 518 MB used / 1944 MB commited / 1944 MB max <<< [21:02:46] : [Step 4/5] [21:02:46] >>> Non-Heap: 117 MB used / 125 MB commited / 0 MB max <<< [21:02:46] : [Step 4/5] [2021-11-19 21:02:46,675][INFO ][main][root] >>> Non-Heap: 117 MB used / 125 MB commited / 0 MB max <<< [21:02:46]W: [org.apache.ignite:ignite-core] [2021-11-19 21:02:46,687][WARN ][test-runner-#3891%persistence.CheckpointReadLockFailureTest%][G] Ignite work directory is not provided, automatically resolved to: /opt/buildagent/work/7bc1c54bc719b67c/work [21:02:46]W: [org.apache.ignite:ignite-core] [2021-11-19 21:02:46,688][WARN ][test-runner-#3891%persistence.CheckpointReadLockFailureTest%][G] Consistent ID is not set, it is recommended to set consistent ID for production clusters (use IgniteConfiguration.setConsistentId property) [21:02:46] : [Step 4/5] [2021-11-19 21:02:46,690][INFO ][test-runner-#3891%persistence.CheckpointReadLockFailureTest%][CheckpointReadLockFailureTest0] [21:02:46] : [Step 4/5] [21:02:46] : [Step 4/5] >>> __________ ________________ [21:02:46] : [Step 4/5] >>> / _/ ___/ |/ / _/_ __/ __/ [21:02:46] : [Step 4/5] >>> _/ // (7 7 // / / / / _/ [21:02:46] : [Step 4/5] >>> /___/\___/_/|_/___/ /_/ /___/ [21:02:46] : [Step 4/5] >>> [21:02:46] : [Step 4/5] >>> ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:02:46] : [Step 4/5] >>> 2021 Copyright(C) Apache Software Foundation [21:02:46] : [Step 4/5] >>> [21:02:46] : [Step 4/5] >>> Ignite documentation: http://ignite.apache.org [21:02:46] : [Step 4/5] [21:02:46] : [Step 4/5] [2021-11-19 21:02:46,691][INFO ][test-runner-#3891%persistence.CheckpointReadLockFailureTest%][CheckpointReadLockFailureTest0] Config URL: n/a [21:02:46] : [Step 4/5] [2021-11-19 21:02:46,691][INFO ][test-runner-#3891%persistence.CheckpointReadLockFailureTest%][CheckpointReadLockFailureTest0] IgniteConfiguration [igniteInstanceName=persistence.CheckpointReadLockFailureTest0, pubPoolSize=24, svcPoolSize=24, callbackPoolSize=24, stripedPoolSize=24, sysPoolSize=24, mgmtPoolSize=4, dataStreamerPoolSize=24, utilityCachePoolSize=24, utilityCacheKeepAliveTime=60000, p2pPoolSize=2, qryPoolSize=24, buildIdxPoolSize=4, igniteHome=/opt/buildagent/work/7bc1c54bc719b67c, igniteWorkDir=/opt/buildagent/work/7bc1c54bc719b67c/work, mbeanSrv=com.sun.jmx.mbeanserver.JmxMBeanServer@6fe85038, nodeId=e64b8c23-b4a9-49aa-b33d-bc2604700000, marsh=BinaryMarshaller [], marshLocJobs=false, daemon=false, p2pEnabled=true, netTimeout=10000, netCompressionLevel=1, sndRetryDelay=1000, sndRetryCnt=3, metricsHistSize=10000, metricsUpdateFreq=1000, metricsExpTime=9223372036854775807, discoSpi=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=0, ackTimeout=0, marsh=null, reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], segPlc=STOP, segResolveAttempts=2, waitForSegOnStart=true, allResolversPassReq=true, segChkFreq=10000, commSpi=TcpCommunicationSpi [connectGate=org.apache.ignite.spi.communication.tcp.internal.ConnectGateway@44c783a9, ctxInitLatch=java.util.concurrent.CountDownLatch@322fcbd8[Count = 1], stopping=false, clientPool=null, nioSrvWrapper=null, stateProvider=null], evtSpi=MemoryEventStorageSpi [expireAgeMs=9223372036854775807, expireCnt=10000, filter=null], colSpi=NoopCollisionSpi [], deploySpi=LocalDeploymentSpi [], indexingSpi=org.apache.ignite.spi.indexing.noop.NoopIndexingSpi@1f0f7949, addrRslvr=null, encryptionSpi=org.apache.ignite.spi.encryption.noop.NoopEncryptionSpi@5e57ed83, tracingSpi=org.apache.ignite.spi.tracing.NoopTracingSpi@750364d8, clientMode=false, rebalanceThreadPoolSize=4, rebalanceTimeout=10000, rebalanceBatchesPrefetchCnt=3, rebalanceThrottle=0, rebalanceBatchSize=524288, txCfg=TransactionConfiguration [txSerEnabled=false, dfltIsolation=REPEATABLE_READ, dfltConcurrency=PESSIMISTIC, dfltTxTimeout=0, txTimeoutOnPartitionMapExchange=0, deadlockTimeout=10000, pessimisticTxLogSize=0, pessimisticTxLogLinger=10000, tmLookupClsName=null, txManagerFactory=null, useJtaSync=false], cacheSanityCheckEnabled=true, discoStartupDelay=60000, deployMode=SHARED, p2pMissedCacheSize=100, locHost=127.0.0.1, timeSrvPortBase=31100, timeSrvPortRange=100, failureDetectionTimeout=10000, sysWorkerBlockedTimeout=null, clientFailureDetectionTimeout=10000, metricsLogFreq=0, connectorCfg=null, odbcCfg=null, warmupClos=null, atomicCfg=AtomicConfiguration [seqReserveSize=1000, cacheMode=PARTITIONED, backups=1, aff=null, grpName=null], classLdr=null, sslCtxFactory=null, platformCfg=null, binaryCfg=null, memCfg=null, pstCfg=null, dsCfg=DataStorageConfiguration [sysRegionInitSize=41943040, sysRegionMaxSize=104857600, pageSize=0, concLvl=0, dfltDataRegConf=DataRegionConfiguration [name=default, maxSize=268435456, initSize=268435456, swapPath=null, pageEvictionMode=DISABLED, pageReplacementMode=CLOCK, evictionThreshold=0.9, emptyPagesPoolSize=100, metricsEnabled=false, metricsSubIntervalCount=5, metricsRateTimeInterval=60000, persistenceEnabled=true, checkpointPageBufSize=0, lazyMemoryAllocation=true, warmUpCfg=null], dataRegions=null, storagePath=null, checkpointFreq=2147483647, lockWaitTime=10000, checkpointThreads=4, checkpointWriteOrder=SEQUENTIAL, walHistSize=20, maxWalArchiveSize=1073741824, walSegments=10, walSegmentSize=67108864, walPath=db/wal, walArchivePath=db/wal/archive, cdcWalPath=db/wal/cdc, cdcEnabled=false, metricsEnabled=false, walMode=LOG_ONLY, walTlbSize=131072, walBuffSize=0, walFlushFreq=2000, walFsyncDelay=1000, walRecordIterBuffSize=67108864, alwaysWriteFullPages=false, fileIOFactory=org.apache.ignite.internal.processors.cache.persistence.file.AsyncFileIOFactory@33d21939, metricsSubIntervalCnt=5, metricsRateTimeInterval=60000, walAutoArchiveAfterInactivity=-1, walForceArchiveTimeout=-1, writeThrottlingEnabled=false, walCompactionEnabled=false, walCompactionLevel=1, checkpointReadLockTimeout=1, walPageCompression=DISABLED, walPageCompressionLevel=null, dfltWarmUpCfg=null, encCfg=org.apache.ignite.configuration.EncryptionConfiguration@413bee7, defragmentationThreadPoolSize=4, minWalArchiveSize=-1], snapshotPath=snapshots, activeOnStart=true, activeOnStartPropSetFlag=false, autoActivation=true, autoActivationPropSetFlag=false, clusterStateOnStart=null, sqlConnCfg=null, cliConnCfg=ClientConnectorConfiguration [host=null, port=10800, portRange=100, sockSndBufSize=0, sockRcvBufSize=0, tcpNoDelay=true, maxOpenCursorsPerConn=128, threadPoolSize=24, selectorCnt=12, idleTimeout=0, handshakeTimeout=10000, jdbcEnabled=true, odbcEnabled=true, thinCliEnabled=true, sslEnabled=false, useIgniteSslCtxFactory=true, sslClientAuth=false, sslCtxFactory=null, thinCliCfg=ThinClientConfiguration [maxActiveTxPerConn=100, maxActiveComputeTasksPerConn=0]], mvccVacuumThreadCnt=2, mvccVacuumFreq=5000, authEnabled=false, failureHnd=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED]], commFailureRslvr=null, sqlCfg=SqlConfiguration [longQryWarnTimeout=3000, dfltQryTimeout=0, sqlQryHistSize=1000, validationEnabled=false], asyncContinuationExecutor=null] [21:02:46] : [Step 4/5] [2021-11-19 21:02:46,701][INFO ][test-runner-#3891%persistence.CheckpointReadLockFailureTest%][CheckpointReadLockFailureTest0] Daemon mode: off [21:02:46] : [Step 4/5] [2021-11-19 21:02:46,701][INFO ][test-runner-#3891%persistence.CheckpointReadLockFailureTest%][CheckpointReadLockFailureTest0] OS: Linux 4.15.0-151-generic amd64 [21:02:46] : [Step 4/5] [2021-11-19 21:02:46,701][INFO ][test-runner-#3891%persistence.CheckpointReadLockFailureTest%][CheckpointReadLockFailureTest0] OS user: teamcity [21:02:46] : [Step 4/5] [2021-11-19 21:02:46,702][INFO ][test-runner-#3891%persistence.CheckpointReadLockFailureTest%][CheckpointReadLockFailureTest0] PID: 16724 [21:02:46] : [Step 4/5] [2021-11-19 21:02:46,702][INFO ][test-runner-#3891%persistence.CheckpointReadLockFailureTest%][CheckpointReadLockFailureTest0] Language runtime: Java Platform API Specification ver. 1.8 [21:02:46] : [Step 4/5] [2021-11-19 21:02:46,703][INFO ][test-runner-#3891%persistence.CheckpointReadLockFailureTest%][CheckpointReadLockFailureTest0] VM information: Java(TM) SE Runtime Environment 1.8.0_261-b12 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 25.261-b12 [21:02:46] : [Step 4/5] [2021-11-19 21:02:46,703][INFO ][test-runner-#3891%persistence.CheckpointReadLockFailureTest%][CheckpointReadLockFailureTest0] VM total memory: 1.9GB [21:02:46] : [Step 4/5] [2021-11-19 21:02:46,704][INFO ][test-runner-#3891%persistence.CheckpointReadLockFailureTest%][CheckpointReadLockFailureTest0] Remote Management [restart: off, REST: off, JMX (remote: off)] [21:02:46] : [Step 4/5] [2021-11-19 21:02:46,704][INFO ][test-runner-#3891%persistence.CheckpointReadLockFailureTest%][CheckpointReadLockFailureTest0] Logger: GridTestLog4jLogger [quiet=false, config=null] [21:02:46] : [Step 4/5] [2021-11-19 21:02:46,704][INFO ][test-runner-#3891%persistence.CheckpointReadLockFailureTest%][CheckpointReadLockFailureTest0] IGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c [21:02:46] : [Step 4/5] [2021-11-19 21:02:46,705][INFO ][test-runner-#3891%persistence.CheckpointReadLockFailureTest%][CheckpointReadLockFailureTest0] VM arguments: [-DIGNITE_DUMP_THREADS_ON_FAILURE=false, -DMono=/usr/bin/mono-sgen, -DMono4.0_x64=/usr/lib/mono/4.0, -DMono4.5_x64=/usr/lib/mono/4.5, -DMonoVersion=6.12.0.90, -DSKIP_BUILD=false, -Dagent.home.dir=/opt/buildagent, -Dagent.name=aitc-lin02_03, -Dagent.ownPort=9090, -Dagent.work.dir=/opt/buildagent/work, -Dbuild.number=95, -Dbuild.vcs.number=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.1=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.GitHubApacheIgnite=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dclassworlds.conf=/opt/buildagent/temp/buildTmp/teamcity.m2.conf, -Dcom.jetbrains.maven.watcher.report.file=/opt/buildagent/temp/buildTmp/maven-build-info.xml, -Djava.io.tmpdir=/opt/buildagent/temp/buildTmp, -Dmaven.home=/opt/buildagent/tools/maven3_6, -Dmaven.multiModuleProjectDirectory=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.agent.cpuBenchmark=457, -Dteamcity.agent.dotnet.agent_url=http://localhost:9090/RPC2, -Dteamcity.agent.dotnet.build_id=6278078, -Dteamcity.auth.password=*******, -Dteamcity.auth.userId=TeamCityBuildId=6278078, -Dteamcity.build.changedFiles.file=/opt/buildagent/temp/buildTmp/changedFiles6342607772318147725.txt, -Dteamcity.build.checkoutDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.build.id=6278078, -Dteamcity.build.properties.file=/opt/buildagent/temp/buildTmp/teamcity.build5164517880467851002.properties, -Dteamcity.build.tempDir=/opt/buildagent/temp/buildTmp, -Dteamcity.build.workingDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.buildConfName=Basic 3, -Dteamcity.buildType.id=IgniteTests24Java8_Basic3, -Dteamcity.configuration.properties.file=/opt/buildagent/temp/buildTmp/teamcity.config5591980786735343870.properties, -Dteamcity.maven.userSettings.path=/opt/buildagent/temp/buildTmp/maven_settings_585072866407032347.xml, -Dteamcity.maven.watcher.home=/opt/buildagent/plugins/mavenPlugin/maven-watcher-jdk16, -Dteamcity.projectName=Ignite Tests 2.x (JDK 8/11), -Dteamcity.runner.properties.file=/opt/buildagent/temp/buildTmp/teamcity.runner9098465561618137420.properties, -Dteamcity.tests.recentlyFailedTests.file=/opt/buildagent/temp/buildTmp/testsToRunFirst3891775683130404069.txt, -Dteamcity.version=2021.2 (build 99542), -ea, -Xms2g, -Xmx2g, -XX:+HeapDumpOnOutOfMemoryError, -DIGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_TEST_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_UPDATE_NOTIFIER=false, -DIGNITE_NO_DISCO_ORDER=true, -DIGNITE_PERFORMANCE_SUGGESTIONS_DISABLED=true, -Djava.net.preferIPv4Stack=true, -DTEST_SCALE_FACTOR=1.0, -DIGNITE_TEST_PROP_LOG4J_FILE=log4j-tc-test.xml, -DIGNITE_QUIET=false, -DIGNITE_MARSHAL_BUFFERS_RECHECK=1000, -Dmaven.repo.local=/opt/buildagent/.m2/repository] [21:02:46] : [Step 4/5] [2021-11-19 21:02:46,709][INFO ][test-runner-#3891%persistence.CheckpointReadLockFailureTest%][CheckpointReadLockFailureTest0] System cache's DataRegion size is configured to 40 MB. Use DataStorageConfiguration.systemRegionInitialSize property to change the setting. [21:02:46] : [Step 4/5] [2021-11-19 21:02:46,710][INFO ][test-runner-#3891%persistence.CheckpointReadLockFailureTest%][CheckpointReadLockFailureTest0] Configured caches [in 'sysMemPlc' dataRegion: ['ignite-sys-cache']] [21:02:46] : [Step 4/5] [2021-11-19 21:02:46,711][INFO ][test-runner-#3891%persistence.CheckpointReadLockFailureTest%][CheckpointReadLockFailureTest0] 3-rd party licenses can be found at: /opt/buildagent/work/7bc1c54bc719b67c/libs/licenses [21:02:46]W: [org.apache.ignite:ignite-core] [2021-11-19 21:02:46,710][WARN ][test-runner-#3891%persistence.CheckpointReadLockFailureTest%][CheckpointReadLockFailureTest0] Peer class loading is enabled (disable it in production for performance and deployment consistency reasons) [21:02:46] : [Step 4/5] [2021-11-19 21:02:46,716][INFO ][test-runner-#3891%persistence.CheckpointReadLockFailureTest%][IgnitePluginProcessor] Configured plugins: [21:02:46] : [Step 4/5] [2021-11-19 21:02:46,716][INFO ][test-runner-#3891%persistence.CheckpointReadLockFailureTest%][IgnitePluginProcessor] ^-- StanByClusterTestProvider 1.0 [21:02:46] : [Step 4/5] [2021-11-19 21:02:46,716][INFO ][test-runner-#3891%persistence.CheckpointReadLockFailureTest%][IgnitePluginProcessor] ^-- null [21:02:46] : [Step 4/5] [2021-11-19 21:02:46,717][INFO ][test-runner-#3891%persistence.CheckpointReadLockFailureTest%][IgnitePluginProcessor] [21:02:46] : [Step 4/5] [2021-11-19 21:02:46,717][INFO ][test-runner-#3891%persistence.CheckpointReadLockFailureTest%][IgnitePluginProcessor] ^-- PageMemory tracker plugin 1.0 [21:02:46] : [Step 4/5] [2021-11-19 21:02:46,717][INFO ][test-runner-#3891%persistence.CheckpointReadLockFailureTest%][IgnitePluginProcessor] ^-- null [21:02:46] : [Step 4/5] [2021-11-19 21:02:46,717][INFO ][test-runner-#3891%persistence.CheckpointReadLockFailureTest%][IgnitePluginProcessor] [21:02:46] : [Step 4/5] [2021-11-19 21:02:46,718][INFO ][test-runner-#3891%persistence.CheckpointReadLockFailureTest%][IgnitePluginProcessor] ^-- TestDistibutedConfigurationPlugin 1.0 [21:02:46] : [Step 4/5] [2021-11-19 21:02:46,718][INFO ][test-runner-#3891%persistence.CheckpointReadLockFailureTest%][IgnitePluginProcessor] ^-- null [21:02:46] : [Step 4/5] [2021-11-19 21:02:46,718][INFO ][test-runner-#3891%persistence.CheckpointReadLockFailureTest%][IgnitePluginProcessor] [21:02:46] : [Step 4/5] [2021-11-19 21:02:46,718][INFO ][test-runner-#3891%persistence.CheckpointReadLockFailureTest%][IgnitePluginProcessor] ^-- NodeValidationPluginProvider 1.0 [21:02:46] : [Step 4/5] [2021-11-19 21:02:46,719][INFO ][test-runner-#3891%persistence.CheckpointReadLockFailureTest%][IgnitePluginProcessor] ^-- null [21:02:46] : [Step 4/5] [2021-11-19 21:02:46,719][INFO ][test-runner-#3891%persistence.CheckpointReadLockFailureTest%][IgnitePluginProcessor] [21:02:46] : [Step 4/5] [2021-11-19 21:02:46,719][INFO ][test-runner-#3891%persistence.CheckpointReadLockFailureTest%][FailureProcessor] Configured failure handler: [hnd=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED]]] [21:02:46] : [Step 4/5] [2021-11-19 21:02:46,770][INFO ][test-runner-#3891%persistence.CheckpointReadLockFailureTest%][TcpCommunicationSpi] Successfully bound communication NIO server to TCP port [port=45070, locHost=/127.0.0.1, selectorsCnt=12, selectorSpins=0, pairedConn=false] [21:02:46]W: [org.apache.ignite:ignite-core] [2021-11-19 21:02:46,770][WARN ][test-runner-#3891%persistence.CheckpointReadLockFailureTest%][TcpCommunicationSpi] Message queue limit is set to 0 which may lead to potential OOMEs when running cache operations in FULL_ASYNC or PRIMARY_SYNC modes due to message queues growth on sender and receiver sides. [21:02:46] : [Step 4/5] [2021-11-19 21:02:46,781][INFO ][test-runner-#3891%persistence.CheckpointReadLockFailureTest%][GridCollisionManager] Collision resolution is disabled (all jobs will be activated upon arrival). [21:02:46] : [Step 4/5] [2021-11-19 21:02:46,782][INFO ][test-runner-#3891%persistence.CheckpointReadLockFailureTest%][CheckpointReadLockFailureTest0] Security status [authentication=off, sandbox=off, tls/ssl=off] [21:02:46] : [Step 4/5] [2021-11-19 21:02:46,783][INFO ][test-runner-#3891%persistence.CheckpointReadLockFailureTest%][TestTcpDiscoverySpi] Successfully bound to TCP port [port=47500, localHost=localhost/127.0.0.1, locNodeId=e64b8c23-b4a9-49aa-b33d-bc2604700000] [21:02:46] : [Step 4/5] [2021-11-19 21:02:46,793][INFO ][test-runner-#3891%persistence.CheckpointReadLockFailureTest%][PdsFoldersResolver] Successfully created new persistent storage folder [/opt/buildagent/work/7bc1c54bc719b67c/work/db/node00-adb8998f-7bd1-403a-ba3e-a18c892ffb5a] [21:02:46] : [Step 4/5] [2021-11-19 21:02:46,794][INFO ][test-runner-#3891%persistence.CheckpointReadLockFailureTest%][PdsFoldersResolver] Consistent ID used for local node is [adb8998f-7bd1-403a-ba3e-a18c892ffb5a] according to persistence data storage folders [21:02:46] : [Step 4/5] [2021-11-19 21:02:46,794][INFO ][test-runner-#3891%persistence.CheckpointReadLockFailureTest%][MaintenanceProcessor] Resolved store directory for node persistent data: /opt/buildagent/work/7bc1c54bc719b67c/work/db/node00-adb8998f-7bd1-403a-ba3e-a18c892ffb5a [21:02:46] : [Step 4/5] [2021-11-19 21:02:46,797][INFO ][test-runner-#3891%persistence.CheckpointReadLockFailureTest%][CacheObjectBinaryProcessorImpl] Resolved directory for serialized binary metadata: /opt/buildagent/work/7bc1c54bc719b67c/work/db/binary_meta/node00-adb8998f-7bd1-403a-ba3e-a18c892ffb5a [21:02:46] : [Step 4/5] [2021-11-19 21:02:46,801][INFO ][test-runner-#3891%persistence.CheckpointReadLockFailureTest%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/node00-adb8998f-7bd1-403a-ba3e-a18c892ffb5a [21:02:46] : [Step 4/5] [2021-11-19 21:02:46,802][INFO ][test-runner-#3891%persistence.CheckpointReadLockFailureTest%][FileWriteAheadLogManager] Resolved write ahead log work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/node00-adb8998f-7bd1-403a-ba3e-a18c892ffb5a [21:02:46] : [Step 4/5] [2021-11-19 21:02:46,802][INFO ][test-runner-#3891%persistence.CheckpointReadLockFailureTest%][FileWriteAheadLogManager] Resolved write ahead log archive directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/node00-adb8998f-7bd1-403a-ba3e-a18c892ffb5a [21:02:47] : [Step 4/5] Surefire report watcher [21:02:47] : [Surefire report watcher] Watching paths: [21:02:47] : [Surefire report watcher] /opt/buildagent/temp/buildTmp/ignite-tools-junit-reports1777670380320881607/test-org.apache.ignite.testsuites.IgniteBasicWithPersistenceTestSuite1637344960254.xml [21:02:47]i: [Step 4/5] org.apache.ignite.testsuites.IgniteBasicWithPersistenceTestSuite [21:02:47]i: [org.apache.ignite.testsuites.IgniteBasicWithPersistenceTestSuite] org.apache.ignite.failure.SystemWorkersBlockingTest.testBlockingSection [21:02:47]i: [org.apache.ignite.testsuites.IgniteBasicWithPersistenceTestSuite] org.apache.ignite.failure.SystemWorkersBlockingTest.testSingleWorker_NotInInfiniteLoop [21:02:47]i: [org.apache.ignite.testsuites.IgniteBasicWithPersistenceTestSuite] org.apache.ignite.failure.SystemWorkersBlockingTest.testBlockingWorker [21:02:47] : [Step 4/5] [2021-11-19 21:02:47,197][INFO ][test-runner-#3891%persistence.CheckpointReadLockFailureTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/node00-adb8998f-7bd1-403a-ba3e-a18c892ffb5a/0000000000000000.wal [21:02:47] : [Step 4/5] [2021-11-19 21:02:47,197][INFO ][test-runner-#3891%persistence.CheckpointReadLockFailureTest%][FileHandleManagerImpl] Initialized write-ahead log manager [mode=LOG_ONLY] [21:02:47] : [Step 4/5] [2021-11-19 21:02:47,203][INFO ][test-runner-#3891%persistence.CheckpointReadLockFailureTest%][GridCacheDatabaseSharedManager] Configured data regions initialized successfully [total=5] [21:02:47] : [Step 4/5] [2021-11-19 21:02:47,206][INFO ][test-runner-#3891%persistence.CheckpointReadLockFailureTest%][IgniteSnapshotManager] Resolved snapshot work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/snapshots [21:02:47] : [Step 4/5] [2021-11-19 21:02:47,206][INFO ][test-runner-#3891%persistence.CheckpointReadLockFailureTest%][IgniteSnapshotManager] Resolved temp directory for snapshot creation: /opt/buildagent/work/7bc1c54bc719b67c/work/db/node00-adb8998f-7bd1-403a-ba3e-a18c892ffb5a/snp [21:02:47] : [Step 4/5] [2021-11-19 21:02:47,209][INFO ][test-runner-#3891%persistence.CheckpointReadLockFailureTest%][ClientListenerProcessor] Client connector processor has started on TCP port 10800 [21:02:47] : [Step 4/5] [2021-11-19 21:02:47,213][INFO ][test-runner-#3891%persistence.CheckpointReadLockFailureTest%][CheckpointReadLockFailureTest0] Non-loopback local IPs: 172.17.0.4 [21:02:47] : [Step 4/5] [2021-11-19 21:02:47,213][INFO ][test-runner-#3891%persistence.CheckpointReadLockFailureTest%][CheckpointReadLockFailureTest0] Enabled local MACs: 0242AC110004 [21:02:47] : [Step 4/5] [2021-11-19 21:02:47,214][INFO ][test-runner-#3891%persistence.CheckpointReadLockFailureTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:02:47] : [Step 4/5] [2021-11-19 21:02:47,216][INFO ][test-runner-#3891%persistence.CheckpointReadLockFailureTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:02:47] : [Step 4/5] [2021-11-19 21:02:47,216][INFO ][test-runner-#3891%persistence.CheckpointReadLockFailureTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:02:47] : [Step 4/5] [2021-11-19 21:02:47,219][INFO ][test-runner-#3891%persistence.CheckpointReadLockFailureTest%][GridCacheDatabaseSharedManager] Applying lost metastore updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:02:47] : [Step 4/5] [2021-11-19 21:02:47,220][INFO ][test-runner-#3891%persistence.CheckpointReadLockFailureTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=0 ms] [21:02:47] : [Step 4/5] [2021-11-19 21:02:47,220][INFO ][test-runner-#3891%persistence.CheckpointReadLockFailureTest%][GridCacheProcessor] Restoring partition state for local groups. [21:02:47] : [Step 4/5] [2021-11-19 21:02:47,221][INFO ][test-runner-#3891%persistence.CheckpointReadLockFailureTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=0, partitionsProcessed=0, time=0ms] [21:02:47] : [Step 4/5] [2021-11-19 21:02:47,221][INFO ][test-runner-#3891%persistence.CheckpointReadLockFailureTest%][GridEncryptionManager] Encryption keys loaded from metastore. [grps=, masterKeyName=null] [21:02:47] : [Step 4/5] [2021-11-19 21:02:47,223][INFO ][test-runner-#3891%persistence.CheckpointReadLockFailureTest%][ClusterProcessor] Cluster ID and tag has been read from metastorage: null [21:02:47] : [Step 4/5] [2021-11-19 21:02:47,224][INFO ][test-runner-#3891%persistence.CheckpointReadLockFailureTest%][IgniteClusterImpl] Shutdown policy was updated [oldVal=null, newVal=null] [21:02:47] : [Step 4/5] [2021-11-19 21:02:47,224][INFO ][test-runner-#3891%persistence.CheckpointReadLockFailureTest%][GridCacheDatabaseSharedManager] Checkpoint frequency deviation changed [oldVal=null, newVal=null] [21:02:47] : [Step 4/5] [2021-11-19 21:02:47,234][INFO ][test-runner-#3891%persistence.CheckpointReadLockFailureTest%][FilePageStoreManager] Cleanup cache stores [total=1, left=0, cleanFiles=false] [21:02:47] : [Step 4/5] [2021-11-19 21:02:47,238][INFO ][test-runner-#3891%persistence.CheckpointReadLockFailureTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:02:47] : [Step 4/5] [2021-11-19 21:02:47,239][INFO ][test-runner-#3891%persistence.CheckpointReadLockFailureTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:02:47] : [Step 4/5] [2021-11-19 21:02:47,242][INFO ][test-runner-#3891%persistence.CheckpointReadLockFailureTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:02:47] : [Step 4/5] [2021-11-19 21:02:47,243][INFO ][test-runner-#3891%persistence.CheckpointReadLockFailureTest%][GridCacheDatabaseSharedManager] Data Regions Started: 5 [21:02:47] : [Step 4/5] [2021-11-19 21:02:47,243][INFO ][test-runner-#3891%persistence.CheckpointReadLockFailureTest%][GridCacheDatabaseSharedManager] ^-- sysMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:02:47] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:02:47] : [Step 4/5] ^-- default region [type=default, persistence=true, lazyAlloc=true, [21:02:47] : [Step 4/5] ... initCfg=256MB, maxCfg=256MB, usedRam=0MB, freeRam=100%, allocRam=0MB, allocTotal=0MB] [21:02:47] : [Step 4/5] ^-- metastoreMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:02:47] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:02:47] : [Step 4/5] ^-- TxLog region [type=internal, persistence=true, lazyAlloc=false, [21:02:47] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:02:47] : [Step 4/5] ^-- volatileDsMemPlc region [type=user, persistence=false, lazyAlloc=true, [21:02:47] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB] [21:02:47] : [Step 4/5] ^-- Ignite persistence [used=0MB] [21:02:47] : [Step 4/5] [21:02:47] : [Step 4/5] [2021-11-19 21:02:47,245][INFO ][test-runner-#3891%persistence.CheckpointReadLockFailureTest%][GridCacheDatabaseSharedManager] Starting binary memory restore for: [-2100569601] [21:02:47] : [Step 4/5] [2021-11-19 21:02:47,257][INFO ][test-runner-#3891%persistence.CheckpointReadLockFailureTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:02:47] : [Step 4/5] [2021-11-19 21:02:47,258][INFO ][test-runner-#3891%persistence.CheckpointReadLockFailureTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:02:47] : [Step 4/5] [2021-11-19 21:02:47,260][INFO ][test-runner-#3891%persistence.CheckpointReadLockFailureTest%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/node00-adb8998f-7bd1-403a-ba3e-a18c892ffb5a/0000000000000000.wal, offset=0, ver=2] [21:02:47] : [Step 4/5] [2021-11-19 21:02:47,264][INFO ][test-runner-#3891%persistence.CheckpointReadLockFailureTest%][GridCacheProcessor] Started cache in recovery mode [name=ignite-sys-cache, id=-2100569601, dataRegionName=sysMemPlc, mode=REPLICATED, atomicity=TRANSACTIONAL, backups=2147483647, mvcc=false] [21:02:47] : [Step 4/5] [2021-11-19 21:02:47,265][INFO ][test-runner-#3891%persistence.CheckpointReadLockFailureTest%][GridCacheDatabaseSharedManager] Binary recovery performed in 20 ms. [21:02:47] : [Step 4/5] [2021-11-19 21:02:47,266][INFO ][test-runner-#3891%persistence.CheckpointReadLockFailureTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:02:47] : [Step 4/5] [2021-11-19 21:02:47,266][INFO ][test-runner-#3891%persistence.CheckpointReadLockFailureTest%][GridCacheDatabaseSharedManager] Applying lost cache updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:02:47] : [Step 4/5] [2021-11-19 21:02:47,334][INFO ][test-runner-#3891%persistence.CheckpointReadLockFailureTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=60 ms] [21:02:47] : [Step 4/5] [2021-11-19 21:02:47,334][INFO ][test-runner-#3891%persistence.CheckpointReadLockFailureTest%][GridCacheProcessor] Restoring partition state for local groups. [21:02:47] : [Step 4/5] [2021-11-19 21:02:47,345][INFO ][test-runner-#3891%persistence.CheckpointReadLockFailureTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=1, partitionsProcessed=100, time=11ms] [21:02:47] : [Step 4/5] [2021-11-19 21:02:47,633][INFO ][disco-notifier-worker-#4003%persistence.CheckpointReadLockFailureTest0%][MvccProcessorImpl] Assigned mvcc coordinator [crd=MvccCoordinator [topVer=AffinityTopologyVersion [topVer=1, minorTopVer=0], nodeId=e64b8c23-b4a9-49aa-b33d-bc2604700000, ver=1637344967630, local=true, initialized=false]] [21:02:47] : [Step 4/5] [2021-11-19 21:02:47,635][INFO ][sys-#3984%persistence.CheckpointReadLockFailureTest0%][ClusterProcessor] Writing cluster ID and tag to metastorage on ready for write ClusterIdAndTag [id=c25d3c63-ef5d-4b98-aa47-22ae17478cc4, tag=eager_ishizaka] [21:02:47] : [Step 4/5] [2021-11-19 21:02:47,637][INFO ][disco-notifier-worker-#4003%persistence.CheckpointReadLockFailureTest0%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustEnabled' was changed from 'null' to 'false' [21:02:47] : [Step 4/5] [2021-11-19 21:02:47,638][INFO ][disco-notifier-worker-#4003%persistence.CheckpointReadLockFailureTest0%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustTimeout' was changed from 'null' to '300000' [21:02:47] : [Step 4/5] [2021-11-19 21:02:47,639][INFO ][disco-notifier-worker-#4003%persistence.CheckpointReadLockFailureTest0%][IgniteTxManager] Transactions parameter 'longOperationsDumpTimeout' was changed from 'null' to '60000' [21:02:47] : [Step 4/5] [2021-11-19 21:02:47,640][INFO ][disco-notifier-worker-#4003%persistence.CheckpointReadLockFailureTest0%][ClusterProcessor] eager_ishizaka [21:02:47] : [Step 4/5] [2021-11-19 21:02:47,640][INFO ][disco-notifier-worker-#4003%persistence.CheckpointReadLockFailureTest0%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpThreshold' was changed from 'null' to '0' [21:02:47] : [Step 4/5] [2021-11-19 21:02:47,641][INFO ][disco-notifier-worker-#4003%persistence.CheckpointReadLockFailureTest0%][IgniteTxManager] Transactions parameter 'transactionTimeDumpSamplesCoefficient' was changed from 'null' to '0.0' [21:02:47] : [Step 4/5] [2021-11-19 21:02:47,641][INFO ][disco-notifier-worker-#4003%persistence.CheckpointReadLockFailureTest0%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpSamplesPerSecondLimit' was changed from 'null' to '5' [21:02:47] : [Step 4/5] [2021-11-19 21:02:47,642][INFO ][disco-notifier-worker-#4003%persistence.CheckpointReadLockFailureTest0%][IgniteTxManager] Transactions parameter 'collisionsDumpInterval' was changed from 'null' to '1000' [21:02:47] : [Step 4/5] [2021-11-19 21:02:47,643][INFO ][disco-notifier-worker-#4003%persistence.CheckpointReadLockFailureTest0%][IgniteTxManager] Transactions parameter 'txOwnerDumpRequestsAllowed' was changed from 'null' to 'true' [21:02:47] : [Step 4/5] [2021-11-19 21:02:47,644][INFO ][disco-notifier-worker-#4003%persistence.CheckpointReadLockFailureTest0%][GridCacheDatabaseSharedManager] Historical rebalance WAL threshold changed [property=historical.rebalance.threshold, oldVal=null, newVal=500] [21:02:47] : [Step 4/5] [2021-11-19 21:02:47,650][INFO ][test-runner-#3891%persistence.CheckpointReadLockFailureTest%][CheckpointReadLockFailureTest0] To start Console Management & Monitoring run ignitevisorcmd.{sh|bat} [21:02:47] : [Step 4/5] [2021-11-19 21:02:47,651][INFO ][test-runner-#3891%persistence.CheckpointReadLockFailureTest%][CheckpointReadLockFailureTest0] [21:02:47] : [Step 4/5] [21:02:47] : [Step 4/5] >>> +-------------------------------------------+ [21:02:47] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:02:47] : [Step 4/5] >>> +-------------------------------------------+ [21:02:47] : [Step 4/5] >>> OS name: Linux 4.15.0-151-generic amd64 [21:02:47] : [Step 4/5] >>> CPU(s): 24 [21:02:47] : [Step 4/5] >>> Heap: 2.0GB [21:02:47] : [Step 4/5] >>> VM name: 16724@c4dfe9a430b2 [21:02:47] : [Step 4/5] >>> Ignite instance name: persistence.CheckpointReadLockFailureTest0 [21:02:47] : [Step 4/5] >>> Local node [ID=E64B8C23-B4A9-49AA-B33D-BC2604700000, order=1, clientMode=false] [21:02:47] : [Step 4/5] >>> Local node addresses: [127.0.0.1] [21:02:47] : [Step 4/5] >>> Local ports: TCP:10800 TCP:45070 TCP:47500 [21:02:47] : [Step 4/5] [21:02:47] : [Step 4/5] [2021-11-19 21:02:47,652][INFO ][test-runner-#3891%persistence.CheckpointReadLockFailureTest%][CheckpointReadLockFailureTest0] >>> Ignite cluster is in INACTIVE state (limited functionality available). Use control.(sh|bat) script or IgniteCluster.state(ClusterState.ACTIVE) to change the state. [21:02:47] : [Step 4/5] [2021-11-19 21:02:47,653][INFO ][test-runner-#3891%persistence.CheckpointReadLockFailureTest%][GridDiscoveryManager] Topology snapshot [ver=1, locNode=e64b8c23, servers=1, clients=0, state=INACTIVE, CPUs=24, offheap=0.25GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=e64b8c23-b4a9-49aa-b33d-bc2604700000, consistentId=adb8998f-7bd1-403a-ba3e-a18c892ffb5a, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:02:47] : [Step 4/5] [2021-11-19 21:02:47,653][INFO ][test-runner-#3891%persistence.CheckpointReadLockFailureTest%][G] Node started : [stage="Configure system pool" (0 ms),stage="Start managers" (106 ms),stage="Configure binary metadata" (3 ms),stage="Start processors" (413 ms),stage="Start 'StanByClusterTestProvider' plugin" (0 ms),stage="Start 'PageMemory tracker plugin' plugin" (0 ms),stage="Start 'TestDistibutedConfigurationPlugin' plugin" (0 ms),stage="Start 'NodeValidationPluginProvider' plugin" (0 ms),stage="Init metastore" (22 ms),stage="Init and start regions" (10 ms),stage="Restore binary memory" (20 ms),stage="Restore logical state" (79 ms),stage="Finish recovery" (282 ms),stage="Join topology" (5 ms),stage="Await transition" (3 ms),stage="Await exchange" (16 ms),stage="Total time" (959 ms)] [21:02:47] : [Step 4/5] [2021-11-19 21:02:47,655][INFO ][test-runner-#3891%persistence.CheckpointReadLockFailureTest%][root] Node started with the following configuration [id=e64b8c23-b4a9-49aa-b33d-bc2604700000, marshaller=BinaryMarshaller [], discovery=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=5000, ackTimeout=5000, marsh=JdkMarshaller [clsFilter=org.apache.ignite.marshaller.MarshallerUtils$1@15341306], reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], binaryCfg=null, lateAff=true] [21:02:47] : [Step 4/5] [2021-11-19 21:02:47,656][INFO ][test-runner-#3891%persistence.CheckpointReadLockFailureTest%][GridClusterStateProcessor] Sending activate cluster request with BaselineTopology BaselineTopology [id=0, branchingHash=-445086877, branchingType='New BaselineTopology', baselineNodes=[adb8998f-7bd1-403a-ba3e-a18c892ffb5a]] [21:02:47] : [Step 4/5] [2021-11-19 21:02:47,658][INFO ][disco-notifier-worker-#4003%persistence.CheckpointReadLockFailureTest0%][GridClusterStateProcessor] Received activate cluster request with BaselineTopology[id=0] initiator node ID: e64b8c23-b4a9-49aa-b33d-bc2604700000 [21:02:47] : [Step 4/5] [2021-11-19 21:02:47,658][INFO ][disco-notifier-worker-#4003%persistence.CheckpointReadLockFailureTest0%][GridClusterStateProcessor] Started state transition: activate cluster [21:02:47] : [Step 4/5] [2021-11-19 21:02:47,659][INFO ][exchange-worker-#4008%persistence.CheckpointReadLockFailureTest0%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=1, minorTopVer=1], crd=true, evt=DISCOVERY_CUSTOM_EVT, evtNode=e64b8c23-b4a9-49aa-b33d-bc2604700000, customEvt=ChangeGlobalStateMessage [id=bfbac593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqId=43018f80-a98c-47fa-b828-a65073106839, initiatingNodeId=e64b8c23-b4a9-49aa-b33d-bc2604700000, state=ACTIVE, baselineTopology=BaselineTopology [id=0, branchingHash=-445086877, branchingType='New BaselineTopology', baselineNodes=[adb8998f-7bd1-403a-ba3e-a18c892ffb5a]], forceChangeBaselineTopology=false, timestamp=1637344967656, forceDeactivation=true], allowMerge=false, exchangeFreeSwitch=false] [21:02:47] : [Step 4/5] [2021-11-19 21:02:47,660][INFO ][exchange-worker-#4008%persistence.CheckpointReadLockFailureTest0%][GridDhtPartitionsExchangeFuture] Start activation process [nodeId=e64b8c23-b4a9-49aa-b33d-bc2604700000, client=false, topVer=AffinityTopologyVersion [topVer=1, minorTopVer=1]]. New state: ACTIVE [21:02:47] : [Step 4/5] [2021-11-19 21:02:47,661][INFO ][exchange-worker-#4008%persistence.CheckpointReadLockFailureTest0%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/node00-adb8998f-7bd1-403a-ba3e-a18c892ffb5a [21:02:47] : [Step 4/5] [2021-11-19 21:02:47,663][INFO ][exchange-worker-#4008%persistence.CheckpointReadLockFailureTest0%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/node00-adb8998f-7bd1-403a-ba3e-a18c892ffb5a/0000000000000000.wal, offset=8795, ver=2] [21:02:47] : [Step 4/5] [2021-11-19 21:02:47,664][INFO ][exchange-worker-#4008%persistence.CheckpointReadLockFailureTest0%][GridClusterStateProcessor] Writing BaselineTopology[id=0] [21:02:47] : [Step 4/5] [2021-11-19 21:02:47,666][INFO ][exchange-worker-#4008%persistence.CheckpointReadLockFailureTest0%][GridCacheDatabaseSharedManager] Finish recovery performed in 5 ms. [21:02:47] : [Step 4/5] [2021-11-19 21:02:47,667][INFO ][exchange-worker-#4008%persistence.CheckpointReadLockFailureTest0%][msg] Components activation performed in 6 ms. [21:02:47] : [Step 4/5] [2021-11-19 21:02:47,668][INFO ][exchange-worker-#4008%persistence.CheckpointReadLockFailureTest0%][GridCacheProcessor] Finished recovery for cache [cache=ignite-sys-cache, grp=ignite-sys-cache, startVer=AffinityTopologyVersion [topVer=1, minorTopVer=1]] [21:02:47] : [Step 4/5] [2021-11-19 21:02:47,669][INFO ][exchange-worker-#4008%persistence.CheckpointReadLockFailureTest0%][GridDhtPartitionsExchangeFuture] Successfully activated caches [nodeId=e64b8c23-b4a9-49aa-b33d-bc2604700000, client=false, topVer=AffinityTopologyVersion [topVer=1, minorTopVer=1], newState=ACTIVE] [21:02:47] : [Step 4/5] [2021-11-19 21:02:47,670][INFO ][exchange-worker-#4008%persistence.CheckpointReadLockFailureTest0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=1, minorTopVer=1], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:02:47] : [Step 4/5] [2021-11-19 21:02:47,677][INFO ][exchange-worker-#4008%persistence.CheckpointReadLockFailureTest0%][GridDhtPartitionsExchangeFuture] finishExchangeOnCoordinator [topVer=AffinityTopologyVersion [topVer=1, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=1, minorTopVer=1]] [21:02:47] : [Step 4/5] [2021-11-19 21:02:47,680][INFO ][db-checkpoint-thread-#4015%persistence.CheckpointReadLockFailureTest0%][Checkpointer] Checkpoint started [checkpointId=1b2e016f-291d-4ebe-9454-0ce555c8c8c8, startPtr=WALPointer [idx=0, fileOff=66551, len=1963], checkpointBeforeLockTime=2ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=1ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=1ms, pages=16, reason='node started'] [21:02:47] : [Step 4/5] [2021-11-19 21:02:47,683][INFO ][exchange-worker-#4008%persistence.CheckpointReadLockFailureTest0%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=1, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=1, minorTopVer=1], err=null, rebalanced=true, wasRebalanced=false] [21:02:47] : [Step 4/5] [2021-11-19 21:02:47,683][INFO ][disco-notifier-worker-#4003%persistence.CheckpointReadLockFailureTest0%][GridClusterStateProcessor] Received state change finish message: ACTIVE [21:02:47] : [Step 4/5] [2021-11-19 21:02:47,684][INFO ][disco-notifier-worker-#4003%persistence.CheckpointReadLockFailureTest0%][GridClusterStateProcessor] Cluster state was changed from INACTIVE to ACTIVE [21:02:47] : [Step 4/5] [2021-11-19 21:02:47,685][INFO ][exchange-worker-#4008%persistence.CheckpointReadLockFailureTest0%][GridCacheProcessor] Finish proxy initialization, cacheName=ignite-sys-cache, localNodeId=e64b8c23-b4a9-49aa-b33d-bc2604700000 [21:02:47] : [Step 4/5] [2021-11-19 21:02:47,686][INFO ][sys-#4001%persistence.CheckpointReadLockFailureTest0%][DistributedBaselineConfiguration] Baseline auto-adjust is 'disabled' with timeout='300000' ms [21:02:47] : [Step 4/5] [2021-11-19 21:02:47,686][INFO ][sys-#4001%persistence.CheckpointReadLockFailureTest0%][GridClusterStateProcessor] Successfully performed final activation steps [nodeId=e64b8c23-b4a9-49aa-b33d-bc2604700000, client=false, topVer=AffinityTopologyVersion [topVer=1, minorTopVer=1]] [21:02:47] : [Step 4/5] [2021-11-19 21:02:47,686][INFO ][exchange-worker-#4008%persistence.CheckpointReadLockFailureTest0%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=e64b8c23-b4a9-49aa-b33d-bc2604700000, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=1, minorTopVer=1], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=e64b8c23-b4a9-49aa-b33d-bc2604700000, consistentId=adb8998f-7bd1-403a-ba3e-a18c892ffb5a, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637344967629, loc=true, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=1, minorTopVer=1]] [21:02:47] : [Step 4/5] [2021-11-19 21:02:47,689][INFO ][exchange-worker-#4008%persistence.CheckpointReadLockFailureTest0%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=1, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=1, minorTopVer=1], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (1 ms), stage="Update caches registry" (7 ms), stage="Start caches" (1 ms), stage="Affinity initialization on cache group start" (0 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Restore partition states" (0 ms), stage="After states restored callback" (6 ms), stage="WAL history reservation" (0 ms), stage="Waiting for all single messages" (0 ms), stage="Affinity recalculation (crd)" (0 ms), stage="Collect update counters and create affinity messages" (0 ms), stage="Assign partitions states" (0 ms), stage="Validate partitions states" (0 ms), stage="Ideal affinity diff calculation (enforced)" (0 ms), stage="Apply update counters" (0 ms), stage="Full message preparing" (3 ms), stage="Full message sending" (0 ms), stage="State finish message sending" (0 ms), stage="Detect lost partitions" (1 ms), stage="Exchange done" (3 ms), stage="Total time" (22 ms)] [21:02:47] : [Step 4/5] [2021-11-19 21:02:47,691][INFO ][exchange-worker-#4008%persistence.CheckpointReadLockFailureTest0%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=1, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=1, minorTopVer=1], stage="Affinity initialization on cache group start [grp=ignite-sys-cache]" (0 ms) (parent=Affinity initialization on cache group start), stage="Affinity centralized initialization (crd) [grp=ignite-sys-cache, crd=true]" (0 ms) (parent=Determine exchange type), stage="Restore partition states [grp=ignite-sys-cache]" (0 ms) (parent=Restore partition states), stage="Affinity recalculation (partitions availability) [grp=ignite-sys-cache]" (0 ms) (parent=Ideal affinity diff calculation (enforced))] [21:02:47] : [Step 4/5] [2021-11-19 21:02:47,693][INFO ][exchange-worker-#4008%persistence.CheckpointReadLockFailureTest0%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=1, minorTopVer=1], crd=true] [21:02:47] : [Step 4/5] [2021-11-19 21:02:47,693][INFO ][exchange-worker-#4008%persistence.CheckpointReadLockFailureTest0%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=1, minorTopVer=1], force=false, evt=DISCOVERY_CUSTOM_EVT, node=e64b8c23-b4a9-49aa-b33d-bc2604700000] [21:02:47] : [Step 4/5] [2021-11-19 21:02:47,705][INFO ][db-checkpoint-thread-#4015%persistence.CheckpointReadLockFailureTest0%][Checkpointer] Checkpoint finished [cpId=1b2e016f-291d-4ebe-9454-0ce555c8c8c8, pages=16, markPos=WALPointer [idx=0, fileOff=66551, len=1963], walSegmentsCovered=[], markDuration=5ms, pagesWrite=2ms, fsync=21ms, total=30ms] [21:02:48] : [Step 4/5] [2021-11-19 21:02:48,293][INFO ][test-runner-#3891%persistence.CheckpointReadLockFailureTest%][root] >>> Stopping grid [name=persistence.CheckpointReadLockFailureTest0, id=e64b8c23-b4a9-49aa-b33d-bc2604700000] [21:02:48] : [Step 4/5] [2021-11-19 21:02:48,297][INFO ][db-checkpoint-thread-#4015%persistence.CheckpointReadLockFailureTest0%][Checkpointer] Skipping checkpoint (no pages were modified) [checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, reason='timeout'] [21:02:48] : [Step 4/5] [2021-11-19 21:02:48,299][INFO ][db-checkpoint-thread-#4015%persistence.CheckpointReadLockFailureTest0%][Checkpointer] Skipping checkpoint (no pages were modified) [checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=1ms, checkpointLockHoldTime=1ms, reason='timeout'] [21:02:48] : [Step 4/5] [2021-11-19 21:02:48,304][INFO ][test-runner-#3891%persistence.CheckpointReadLockFailureTest%][GridCacheProcessor] Stopped cache [cacheName=ignite-sys-cache] [21:02:48] : [Step 4/5] [2021-11-19 21:02:48,545][INFO ][test-runner-#3891%persistence.CheckpointReadLockFailureTest%][FilePageStoreManager] Cleanup cache stores [total=3, left=0, cleanFiles=false] [21:02:48] : [Step 4/5] [2021-11-19 21:02:48,552][INFO ][test-runner-#3891%persistence.CheckpointReadLockFailureTest%][CheckpointReadLockFailureTest0] [21:02:48] : [Step 4/5] [21:02:48] : [Step 4/5] >>> +------------------------------------------------------+ [21:02:48] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV stopped OK [21:02:48] : [Step 4/5] >>> +------------------------------------------------------+ [21:02:48] : [Step 4/5] >>> Ignite instance name: persistence.CheckpointReadLockFailureTest0 [21:02:48] : [Step 4/5] >>> Grid uptime: 00:00:00.900 [21:02:48] : [Step 4/5] [21:02:48] : [Step 4/5] [21:02:48] : [Step 4/5] [21:02:48] >>> Stopping test: CheckpointReadLockFailureTest#testReentrance in 1930 ms <<< [21:02:48] : [Step 4/5] [2021-11-19 21:02:48,605][INFO ][main][root] >>> Stopping test: CheckpointReadLockFailureTest#testReentrance in 1930 ms <<< [21:02:48] : [Step 4/5] [21:02:48] >>> Heap: 546 MB used / 1944 MB commited / 1944 MB max <<< [21:02:48] : [Step 4/5] [2021-11-19 21:02:48,606][INFO ][main][root] >>> Heap: 546 MB used / 1944 MB commited / 1944 MB max <<< [21:02:48] : [Step 4/5] [21:02:48] >>> Non-Heap: 118 MB used / 125 MB commited / 0 MB max <<< [21:02:48] : [Step 4/5] [2021-11-19 21:02:48,606][INFO ][main][root] >>> Non-Heap: 118 MB used / 125 MB commited / 0 MB max <<< [21:02:48] : [Step 4/5] [21:02:48] >>> Starting test: CheckpointReadLockFailureTest#testFailureTypeOnTimeout <<< [21:02:48] : [Step 4/5] [2021-11-19 21:02:48,607][INFO ][main][root] >>> Starting test: CheckpointReadLockFailureTest#testFailureTypeOnTimeout <<< [21:02:48] : [Step 4/5] [21:02:48] >>> Heap: 546 MB used / 1944 MB commited / 1944 MB max <<< [21:02:48] : [Step 4/5] [2021-11-19 21:02:48,607][INFO ][main][root] >>> Heap: 546 MB used / 1944 MB commited / 1944 MB max <<< [21:02:48] : [Step 4/5] [21:02:48] >>> Non-Heap: 118 MB used / 125 MB commited / 0 MB max <<< [21:02:48] : [Step 4/5] [2021-11-19 21:02:48,607][INFO ][main][root] >>> Non-Heap: 118 MB used / 125 MB commited / 0 MB max <<< [21:02:48]W: [org.apache.ignite:ignite-core] [2021-11-19 21:02:48,613][WARN ][test-runner-#4024%persistence.CheckpointReadLockFailureTest%][G] Ignite work directory is not provided, automatically resolved to: /opt/buildagent/work/7bc1c54bc719b67c/work [21:02:48]W: [org.apache.ignite:ignite-core] [2021-11-19 21:02:48,614][WARN ][test-runner-#4024%persistence.CheckpointReadLockFailureTest%][G] Consistent ID is not set, it is recommended to set consistent ID for production clusters (use IgniteConfiguration.setConsistentId property) [21:02:48] : [Step 4/5] [2021-11-19 21:02:48,615][INFO ][test-runner-#4024%persistence.CheckpointReadLockFailureTest%][CheckpointReadLockFailureTest0] [21:02:48] : [Step 4/5] [21:02:48] : [Step 4/5] >>> __________ ________________ [21:02:48] : [Step 4/5] >>> / _/ ___/ |/ / _/_ __/ __/ [21:02:48] : [Step 4/5] >>> _/ // (7 7 // / / / / _/ [21:02:48] : [Step 4/5] >>> /___/\___/_/|_/___/ /_/ /___/ [21:02:48] : [Step 4/5] >>> [21:02:48] : [Step 4/5] >>> ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:02:48] : [Step 4/5] >>> 2021 Copyright(C) Apache Software Foundation [21:02:48] : [Step 4/5] >>> [21:02:48] : [Step 4/5] >>> Ignite documentation: http://ignite.apache.org [21:02:48] : [Step 4/5] [21:02:48] : [Step 4/5] [2021-11-19 21:02:48,617][INFO ][test-runner-#4024%persistence.CheckpointReadLockFailureTest%][CheckpointReadLockFailureTest0] Config URL: n/a [21:02:48] : [Step 4/5] [2021-11-19 21:02:48,617][INFO ][test-runner-#4024%persistence.CheckpointReadLockFailureTest%][CheckpointReadLockFailureTest0] IgniteConfiguration [igniteInstanceName=persistence.CheckpointReadLockFailureTest0, pubPoolSize=24, svcPoolSize=24, callbackPoolSize=24, stripedPoolSize=24, sysPoolSize=24, mgmtPoolSize=4, dataStreamerPoolSize=24, utilityCachePoolSize=24, utilityCacheKeepAliveTime=60000, p2pPoolSize=2, qryPoolSize=24, buildIdxPoolSize=4, igniteHome=/opt/buildagent/work/7bc1c54bc719b67c, igniteWorkDir=/opt/buildagent/work/7bc1c54bc719b67c/work, mbeanSrv=com.sun.jmx.mbeanserver.JmxMBeanServer@6fe85038, nodeId=6aa7de2d-38bb-498a-bf27-5be5e6c00000, marsh=BinaryMarshaller [], marshLocJobs=false, daemon=false, p2pEnabled=true, netTimeout=10000, netCompressionLevel=1, sndRetryDelay=1000, sndRetryCnt=3, metricsHistSize=10000, metricsUpdateFreq=1000, metricsExpTime=9223372036854775807, discoSpi=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=0, ackTimeout=0, marsh=null, reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], segPlc=STOP, segResolveAttempts=2, waitForSegOnStart=true, allResolversPassReq=true, segChkFreq=10000, commSpi=TcpCommunicationSpi [connectGate=org.apache.ignite.spi.communication.tcp.internal.ConnectGateway@7968d66e, ctxInitLatch=java.util.concurrent.CountDownLatch@2178afe0[Count = 1], stopping=false, clientPool=null, nioSrvWrapper=null, stateProvider=null], evtSpi=MemoryEventStorageSpi [expireAgeMs=9223372036854775807, expireCnt=10000, filter=null], colSpi=NoopCollisionSpi [], deploySpi=LocalDeploymentSpi [], indexingSpi=org.apache.ignite.spi.indexing.noop.NoopIndexingSpi@27529854, addrRslvr=null, encryptionSpi=org.apache.ignite.spi.encryption.noop.NoopEncryptionSpi@37793d17, tracingSpi=org.apache.ignite.spi.tracing.NoopTracingSpi@61ab1d65, clientMode=false, rebalanceThreadPoolSize=4, rebalanceTimeout=10000, rebalanceBatchesPrefetchCnt=3, rebalanceThrottle=0, rebalanceBatchSize=524288, txCfg=TransactionConfiguration [txSerEnabled=false, dfltIsolation=REPEATABLE_READ, dfltConcurrency=PESSIMISTIC, dfltTxTimeout=0, txTimeoutOnPartitionMapExchange=0, deadlockTimeout=10000, pessimisticTxLogSize=0, pessimisticTxLogLinger=10000, tmLookupClsName=null, txManagerFactory=null, useJtaSync=false], cacheSanityCheckEnabled=true, discoStartupDelay=60000, deployMode=SHARED, p2pMissedCacheSize=100, locHost=127.0.0.1, timeSrvPortBase=31100, timeSrvPortRange=100, failureDetectionTimeout=10000, sysWorkerBlockedTimeout=null, clientFailureDetectionTimeout=10000, metricsLogFreq=0, connectorCfg=null, odbcCfg=null, warmupClos=null, atomicCfg=AtomicConfiguration [seqReserveSize=1000, cacheMode=PARTITIONED, backups=1, aff=null, grpName=null], classLdr=null, sslCtxFactory=null, platformCfg=null, binaryCfg=null, memCfg=null, pstCfg=null, dsCfg=DataStorageConfiguration [sysRegionInitSize=41943040, sysRegionMaxSize=104857600, pageSize=0, concLvl=0, dfltDataRegConf=DataRegionConfiguration [name=default, maxSize=268435456, initSize=268435456, swapPath=null, pageEvictionMode=DISABLED, pageReplacementMode=CLOCK, evictionThreshold=0.9, emptyPagesPoolSize=100, metricsEnabled=false, metricsSubIntervalCount=5, metricsRateTimeInterval=60000, persistenceEnabled=true, checkpointPageBufSize=0, lazyMemoryAllocation=true, warmUpCfg=null], dataRegions=null, storagePath=null, checkpointFreq=2147483647, lockWaitTime=10000, checkpointThreads=4, checkpointWriteOrder=SEQUENTIAL, walHistSize=20, maxWalArchiveSize=1073741824, walSegments=10, walSegmentSize=67108864, walPath=db/wal, walArchivePath=db/wal/archive, cdcWalPath=db/wal/cdc, cdcEnabled=false, metricsEnabled=false, walMode=LOG_ONLY, walTlbSize=131072, walBuffSize=0, walFlushFreq=2000, walFsyncDelay=1000, walRecordIterBuffSize=67108864, alwaysWriteFullPages=false, fileIOFactory=org.apache.ignite.internal.processors.cache.persistence.file.AsyncFileIOFactory@6bcdcb06, metricsSubIntervalCnt=5, metricsRateTimeInterval=60000, walAutoArchiveAfterInactivity=-1, walForceArchiveTimeout=-1, writeThrottlingEnabled=false, walCompactionEnabled=false, walCompactionLevel=1, checkpointReadLockTimeout=1, walPageCompression=DISABLED, walPageCompressionLevel=null, dfltWarmUpCfg=null, encCfg=org.apache.ignite.configuration.EncryptionConfiguration@3047703, defragmentationThreadPoolSize=4, minWalArchiveSize=-1], snapshotPath=snapshots, activeOnStart=true, activeOnStartPropSetFlag=false, autoActivation=true, autoActivationPropSetFlag=false, clusterStateOnStart=null, sqlConnCfg=null, cliConnCfg=ClientConnectorConfiguration [host=null, port=10800, portRange=100, sockSndBufSize=0, sockRcvBufSize=0, tcpNoDelay=true, maxOpenCursorsPerConn=128, threadPoolSize=24, selectorCnt=12, idleTimeout=0, handshakeTimeout=10000, jdbcEnabled=true, odbcEnabled=true, thinCliEnabled=true, sslEnabled=false, useIgniteSslCtxFactory=true, sslClientAuth=false, sslCtxFactory=null, thinCliCfg=ThinClientConfiguration [maxActiveTxPerConn=100, maxActiveComputeTasksPerConn=0]], mvccVacuumThreadCnt=2, mvccVacuumFreq=5000, authEnabled=false, failureHnd=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED]], commFailureRslvr=null, sqlCfg=SqlConfiguration [longQryWarnTimeout=3000, dfltQryTimeout=0, sqlQryHistSize=1000, validationEnabled=false], asyncContinuationExecutor=null] [21:02:48] : [Step 4/5] [2021-11-19 21:02:48,626][INFO ][test-runner-#4024%persistence.CheckpointReadLockFailureTest%][CheckpointReadLockFailureTest0] Daemon mode: off [21:02:48] : [Step 4/5] [2021-11-19 21:02:48,626][INFO ][test-runner-#4024%persistence.CheckpointReadLockFailureTest%][CheckpointReadLockFailureTest0] OS: Linux 4.15.0-151-generic amd64 [21:02:48] : [Step 4/5] [2021-11-19 21:02:48,626][INFO ][test-runner-#4024%persistence.CheckpointReadLockFailureTest%][CheckpointReadLockFailureTest0] OS user: teamcity [21:02:48] : [Step 4/5] [2021-11-19 21:02:48,626][INFO ][test-runner-#4024%persistence.CheckpointReadLockFailureTest%][CheckpointReadLockFailureTest0] PID: 16724 [21:02:48] : [Step 4/5] [2021-11-19 21:02:48,627][INFO ][test-runner-#4024%persistence.CheckpointReadLockFailureTest%][CheckpointReadLockFailureTest0] Language runtime: Java Platform API Specification ver. 1.8 [21:02:48] : [Step 4/5] [2021-11-19 21:02:48,627][INFO ][test-runner-#4024%persistence.CheckpointReadLockFailureTest%][CheckpointReadLockFailureTest0] VM information: Java(TM) SE Runtime Environment 1.8.0_261-b12 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 25.261-b12 [21:02:48] : [Step 4/5] [2021-11-19 21:02:48,627][INFO ][test-runner-#4024%persistence.CheckpointReadLockFailureTest%][CheckpointReadLockFailureTest0] VM total memory: 1.9GB [21:02:48] : [Step 4/5] [2021-11-19 21:02:48,628][INFO ][test-runner-#4024%persistence.CheckpointReadLockFailureTest%][CheckpointReadLockFailureTest0] Remote Management [restart: off, REST: off, JMX (remote: off)] [21:02:48] : [Step 4/5] [2021-11-19 21:02:48,628][INFO ][test-runner-#4024%persistence.CheckpointReadLockFailureTest%][CheckpointReadLockFailureTest0] Logger: GridTestLog4jLogger [quiet=false, config=null] [21:02:48] : [Step 4/5] [2021-11-19 21:02:48,628][INFO ][test-runner-#4024%persistence.CheckpointReadLockFailureTest%][CheckpointReadLockFailureTest0] IGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c [21:02:48] : [Step 4/5] [2021-11-19 21:02:48,628][INFO ][test-runner-#4024%persistence.CheckpointReadLockFailureTest%][CheckpointReadLockFailureTest0] VM arguments: [-DIGNITE_DUMP_THREADS_ON_FAILURE=false, -DMono=/usr/bin/mono-sgen, -DMono4.0_x64=/usr/lib/mono/4.0, -DMono4.5_x64=/usr/lib/mono/4.5, -DMonoVersion=6.12.0.90, -DSKIP_BUILD=false, -Dagent.home.dir=/opt/buildagent, -Dagent.name=aitc-lin02_03, -Dagent.ownPort=9090, -Dagent.work.dir=/opt/buildagent/work, -Dbuild.number=95, -Dbuild.vcs.number=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.1=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.GitHubApacheIgnite=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dclassworlds.conf=/opt/buildagent/temp/buildTmp/teamcity.m2.conf, -Dcom.jetbrains.maven.watcher.report.file=/opt/buildagent/temp/buildTmp/maven-build-info.xml, -Djava.io.tmpdir=/opt/buildagent/temp/buildTmp, -Dmaven.home=/opt/buildagent/tools/maven3_6, -Dmaven.multiModuleProjectDirectory=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.agent.cpuBenchmark=457, -Dteamcity.agent.dotnet.agent_url=http://localhost:9090/RPC2, -Dteamcity.agent.dotnet.build_id=6278078, -Dteamcity.auth.password=*******, -Dteamcity.auth.userId=TeamCityBuildId=6278078, -Dteamcity.build.changedFiles.file=/opt/buildagent/temp/buildTmp/changedFiles6342607772318147725.txt, -Dteamcity.build.checkoutDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.build.id=6278078, -Dteamcity.build.properties.file=/opt/buildagent/temp/buildTmp/teamcity.build5164517880467851002.properties, -Dteamcity.build.tempDir=/opt/buildagent/temp/buildTmp, -Dteamcity.build.workingDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.buildConfName=Basic 3, -Dteamcity.buildType.id=IgniteTests24Java8_Basic3, -Dteamcity.configuration.properties.file=/opt/buildagent/temp/buildTmp/teamcity.config5591980786735343870.properties, -Dteamcity.maven.userSettings.path=/opt/buildagent/temp/buildTmp/maven_settings_585072866407032347.xml, -Dteamcity.maven.watcher.home=/opt/buildagent/plugins/mavenPlugin/maven-watcher-jdk16, -Dteamcity.projectName=Ignite Tests 2.x (JDK 8/11), -Dteamcity.runner.properties.file=/opt/buildagent/temp/buildTmp/teamcity.runner9098465561618137420.properties, -Dteamcity.tests.recentlyFailedTests.file=/opt/buildagent/temp/buildTmp/testsToRunFirst3891775683130404069.txt, -Dteamcity.version=2021.2 (build 99542), -ea, -Xms2g, -Xmx2g, -XX:+HeapDumpOnOutOfMemoryError, -DIGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_TEST_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_UPDATE_NOTIFIER=false, -DIGNITE_NO_DISCO_ORDER=true, -DIGNITE_PERFORMANCE_SUGGESTIONS_DISABLED=true, -Djava.net.preferIPv4Stack=true, -DTEST_SCALE_FACTOR=1.0, -DIGNITE_TEST_PROP_LOG4J_FILE=log4j-tc-test.xml, -DIGNITE_QUIET=false, -DIGNITE_MARSHAL_BUFFERS_RECHECK=1000, -Dmaven.repo.local=/opt/buildagent/.m2/repository] [21:02:48] : [Step 4/5] [2021-11-19 21:02:48,632][INFO ][test-runner-#4024%persistence.CheckpointReadLockFailureTest%][CheckpointReadLockFailureTest0] System cache's DataRegion size is configured to 40 MB. Use DataStorageConfiguration.systemRegionInitialSize property to change the setting. [21:02:48] : [Step 4/5] [2021-11-19 21:02:48,633][INFO ][test-runner-#4024%persistence.CheckpointReadLockFailureTest%][CheckpointReadLockFailureTest0] Configured caches [in 'sysMemPlc' dataRegion: ['ignite-sys-cache']] [21:02:48]W: [org.apache.ignite:ignite-core] [2021-11-19 21:02:48,633][WARN ][test-runner-#4024%persistence.CheckpointReadLockFailureTest%][CheckpointReadLockFailureTest0] Peer class loading is enabled (disable it in production for performance and deployment consistency reasons) [21:02:48] : [Step 4/5] [2021-11-19 21:02:48,633][INFO ][test-runner-#4024%persistence.CheckpointReadLockFailureTest%][CheckpointReadLockFailureTest0] 3-rd party licenses can be found at: /opt/buildagent/work/7bc1c54bc719b67c/libs/licenses [21:02:48] : [Step 4/5] [2021-11-19 21:02:48,637][INFO ][test-runner-#4024%persistence.CheckpointReadLockFailureTest%][IgnitePluginProcessor] Configured plugins: [21:02:48] : [Step 4/5] [2021-11-19 21:02:48,637][INFO ][test-runner-#4024%persistence.CheckpointReadLockFailureTest%][IgnitePluginProcessor] ^-- StanByClusterTestProvider 1.0 [21:02:48] : [Step 4/5] [2021-11-19 21:02:48,638][INFO ][test-runner-#4024%persistence.CheckpointReadLockFailureTest%][IgnitePluginProcessor] ^-- null [21:02:48] : [Step 4/5] [2021-11-19 21:02:48,638][INFO ][test-runner-#4024%persistence.CheckpointReadLockFailureTest%][IgnitePluginProcessor] [21:02:48] : [Step 4/5] [2021-11-19 21:02:48,638][INFO ][test-runner-#4024%persistence.CheckpointReadLockFailureTest%][IgnitePluginProcessor] ^-- PageMemory tracker plugin 1.0 [21:02:48] : [Step 4/5] [2021-11-19 21:02:48,638][INFO ][test-runner-#4024%persistence.CheckpointReadLockFailureTest%][IgnitePluginProcessor] ^-- null [21:02:48] : [Step 4/5] [2021-11-19 21:02:48,638][INFO ][test-runner-#4024%persistence.CheckpointReadLockFailureTest%][IgnitePluginProcessor] [21:02:48] : [Step 4/5] [2021-11-19 21:02:48,638][INFO ][test-runner-#4024%persistence.CheckpointReadLockFailureTest%][IgnitePluginProcessor] ^-- TestDistibutedConfigurationPlugin 1.0 [21:02:48] : [Step 4/5] [2021-11-19 21:02:48,639][INFO ][test-runner-#4024%persistence.CheckpointReadLockFailureTest%][IgnitePluginProcessor] ^-- null [21:02:48] : [Step 4/5] [2021-11-19 21:02:48,639][INFO ][test-runner-#4024%persistence.CheckpointReadLockFailureTest%][IgnitePluginProcessor] [21:02:48] : [Step 4/5] [2021-11-19 21:02:48,639][INFO ][test-runner-#4024%persistence.CheckpointReadLockFailureTest%][IgnitePluginProcessor] ^-- NodeValidationPluginProvider 1.0 [21:02:48] : [Step 4/5] [2021-11-19 21:02:48,639][INFO ][test-runner-#4024%persistence.CheckpointReadLockFailureTest%][IgnitePluginProcessor] ^-- null [21:02:48] : [Step 4/5] [2021-11-19 21:02:48,639][INFO ][test-runner-#4024%persistence.CheckpointReadLockFailureTest%][IgnitePluginProcessor] [21:02:48] : [Step 4/5] [2021-11-19 21:02:48,640][INFO ][test-runner-#4024%persistence.CheckpointReadLockFailureTest%][FailureProcessor] Configured failure handler: [hnd=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED]]] [21:02:48] : [Step 4/5] [2021-11-19 21:02:48,653][INFO ][test-runner-#4024%persistence.CheckpointReadLockFailureTest%][TcpCommunicationSpi] Successfully bound communication NIO server to TCP port [port=45070, locHost=/127.0.0.1, selectorsCnt=12, selectorSpins=0, pairedConn=false] [21:02:48]W: [org.apache.ignite:ignite-core] [2021-11-19 21:02:48,653][WARN ][test-runner-#4024%persistence.CheckpointReadLockFailureTest%][TcpCommunicationSpi] Message queue limit is set to 0 which may lead to potential OOMEs when running cache operations in FULL_ASYNC or PRIMARY_SYNC modes due to message queues growth on sender and receiver sides. [21:02:48] : [Step 4/5] [2021-11-19 21:02:48,658][INFO ][test-runner-#4024%persistence.CheckpointReadLockFailureTest%][GridCollisionManager] Collision resolution is disabled (all jobs will be activated upon arrival). [21:02:48] : [Step 4/5] [2021-11-19 21:02:48,658][INFO ][test-runner-#4024%persistence.CheckpointReadLockFailureTest%][CheckpointReadLockFailureTest0] Security status [authentication=off, sandbox=off, tls/ssl=off] [21:02:48] : [Step 4/5] [2021-11-19 21:02:48,659][INFO ][test-runner-#4024%persistence.CheckpointReadLockFailureTest%][TestTcpDiscoverySpi] Successfully bound to TCP port [port=47500, localHost=localhost/127.0.0.1, locNodeId=6aa7de2d-38bb-498a-bf27-5be5e6c00000] [21:02:48] : [Step 4/5] [2021-11-19 21:02:48,677][INFO ][test-runner-#4024%persistence.CheckpointReadLockFailureTest%][PdsFoldersResolver] Successfully created new persistent storage folder [/opt/buildagent/work/7bc1c54bc719b67c/work/db/node00-a5a18317-2580-459a-b487-46e9909ec370] [21:02:48] : [Step 4/5] [2021-11-19 21:02:48,677][INFO ][test-runner-#4024%persistence.CheckpointReadLockFailureTest%][PdsFoldersResolver] Consistent ID used for local node is [a5a18317-2580-459a-b487-46e9909ec370] according to persistence data storage folders [21:02:48] : [Step 4/5] [2021-11-19 21:02:48,677][INFO ][test-runner-#4024%persistence.CheckpointReadLockFailureTest%][MaintenanceProcessor] Resolved store directory for node persistent data: /opt/buildagent/work/7bc1c54bc719b67c/work/db/node00-a5a18317-2580-459a-b487-46e9909ec370 [21:02:48] : [Step 4/5] [2021-11-19 21:02:48,679][INFO ][test-runner-#4024%persistence.CheckpointReadLockFailureTest%][CacheObjectBinaryProcessorImpl] Resolved directory for serialized binary metadata: /opt/buildagent/work/7bc1c54bc719b67c/work/db/binary_meta/node00-a5a18317-2580-459a-b487-46e9909ec370 [21:02:48] : [Step 4/5] [2021-11-19 21:02:48,683][INFO ][test-runner-#4024%persistence.CheckpointReadLockFailureTest%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/node00-a5a18317-2580-459a-b487-46e9909ec370 [21:02:48] : [Step 4/5] [2021-11-19 21:02:48,684][INFO ][test-runner-#4024%persistence.CheckpointReadLockFailureTest%][FileWriteAheadLogManager] Resolved write ahead log work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/node00-a5a18317-2580-459a-b487-46e9909ec370 [21:02:48] : [Step 4/5] [2021-11-19 21:02:48,684][INFO ][test-runner-#4024%persistence.CheckpointReadLockFailureTest%][FileWriteAheadLogManager] Resolved write ahead log archive directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/node00-a5a18317-2580-459a-b487-46e9909ec370 [21:02:49] : [Step 4/5] [2021-11-19 21:02:49,032][INFO ][test-runner-#4024%persistence.CheckpointReadLockFailureTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/node00-a5a18317-2580-459a-b487-46e9909ec370/0000000000000000.wal [21:02:49] : [Step 4/5] [2021-11-19 21:02:49,033][INFO ][test-runner-#4024%persistence.CheckpointReadLockFailureTest%][FileHandleManagerImpl] Initialized write-ahead log manager [mode=LOG_ONLY] [21:02:49] : [Step 4/5] [2021-11-19 21:02:49,039][INFO ][test-runner-#4024%persistence.CheckpointReadLockFailureTest%][GridCacheDatabaseSharedManager] Configured data regions initialized successfully [total=5] [21:02:49] : [Step 4/5] [2021-11-19 21:02:49,040][INFO ][test-runner-#4024%persistence.CheckpointReadLockFailureTest%][IgniteSnapshotManager] Resolved snapshot work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/snapshots [21:02:49] : [Step 4/5] [2021-11-19 21:02:49,040][INFO ][test-runner-#4024%persistence.CheckpointReadLockFailureTest%][IgniteSnapshotManager] Resolved temp directory for snapshot creation: /opt/buildagent/work/7bc1c54bc719b67c/work/db/node00-a5a18317-2580-459a-b487-46e9909ec370/snp [21:02:49] : [Step 4/5] [2021-11-19 21:02:49,043][INFO ][test-runner-#4024%persistence.CheckpointReadLockFailureTest%][ClientListenerProcessor] Client connector processor has started on TCP port 10800 [21:02:49] : [Step 4/5] [2021-11-19 21:02:49,046][INFO ][test-runner-#4024%persistence.CheckpointReadLockFailureTest%][CheckpointReadLockFailureTest0] Non-loopback local IPs: 172.17.0.4 [21:02:49] : [Step 4/5] [2021-11-19 21:02:49,047][INFO ][test-runner-#4024%persistence.CheckpointReadLockFailureTest%][CheckpointReadLockFailureTest0] Enabled local MACs: 0242AC110004 [21:02:49] : [Step 4/5] [2021-11-19 21:02:49,048][INFO ][test-runner-#4024%persistence.CheckpointReadLockFailureTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:02:49] : [Step 4/5] [2021-11-19 21:02:49,049][INFO ][test-runner-#4024%persistence.CheckpointReadLockFailureTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:02:49] : [Step 4/5] [2021-11-19 21:02:49,050][INFO ][test-runner-#4024%persistence.CheckpointReadLockFailureTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:02:49] : [Step 4/5] [2021-11-19 21:02:49,052][INFO ][test-runner-#4024%persistence.CheckpointReadLockFailureTest%][GridCacheDatabaseSharedManager] Applying lost metastore updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:02:49] : [Step 4/5] [2021-11-19 21:02:49,053][INFO ][test-runner-#4024%persistence.CheckpointReadLockFailureTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=0 ms] [21:02:49] : [Step 4/5] [2021-11-19 21:02:49,053][INFO ][test-runner-#4024%persistence.CheckpointReadLockFailureTest%][GridCacheProcessor] Restoring partition state for local groups. [21:02:49] : [Step 4/5] [2021-11-19 21:02:49,053][INFO ][test-runner-#4024%persistence.CheckpointReadLockFailureTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=0, partitionsProcessed=0, time=0ms] [21:02:49] : [Step 4/5] [2021-11-19 21:02:49,054][INFO ][test-runner-#4024%persistence.CheckpointReadLockFailureTest%][GridEncryptionManager] Encryption keys loaded from metastore. [grps=, masterKeyName=null] [21:02:49] : [Step 4/5] [2021-11-19 21:02:49,055][INFO ][test-runner-#4024%persistence.CheckpointReadLockFailureTest%][ClusterProcessor] Cluster ID and tag has been read from metastorage: null [21:02:49] : [Step 4/5] [2021-11-19 21:02:49,055][INFO ][test-runner-#4024%persistence.CheckpointReadLockFailureTest%][IgniteClusterImpl] Shutdown policy was updated [oldVal=null, newVal=null] [21:02:49] : [Step 4/5] [2021-11-19 21:02:49,056][INFO ][test-runner-#4024%persistence.CheckpointReadLockFailureTest%][GridCacheDatabaseSharedManager] Checkpoint frequency deviation changed [oldVal=null, newVal=null] [21:02:49] : [Step 4/5] [2021-11-19 21:02:49,067][INFO ][test-runner-#4024%persistence.CheckpointReadLockFailureTest%][FilePageStoreManager] Cleanup cache stores [total=1, left=0, cleanFiles=false] [21:02:49] : [Step 4/5] [2021-11-19 21:02:49,069][INFO ][test-runner-#4024%persistence.CheckpointReadLockFailureTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:02:49] : [Step 4/5] [2021-11-19 21:02:49,070][INFO ][test-runner-#4024%persistence.CheckpointReadLockFailureTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:02:49] : [Step 4/5] [2021-11-19 21:02:49,072][INFO ][test-runner-#4024%persistence.CheckpointReadLockFailureTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:02:49] : [Step 4/5] [2021-11-19 21:02:49,072][INFO ][test-runner-#4024%persistence.CheckpointReadLockFailureTest%][GridCacheDatabaseSharedManager] Data Regions Started: 5 [21:02:49] : [Step 4/5] [2021-11-19 21:02:49,073][INFO ][test-runner-#4024%persistence.CheckpointReadLockFailureTest%][GridCacheDatabaseSharedManager] ^-- sysMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:02:49] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:02:49] : [Step 4/5] ^-- default region [type=default, persistence=true, lazyAlloc=true, [21:02:49] : [Step 4/5] ... initCfg=256MB, maxCfg=256MB, usedRam=0MB, freeRam=100%, allocRam=0MB, allocTotal=0MB] [21:02:49] : [Step 4/5] ^-- metastoreMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:02:49] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:02:49] : [Step 4/5] ^-- TxLog region [type=internal, persistence=true, lazyAlloc=false, [21:02:49] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:02:49] : [Step 4/5] ^-- volatileDsMemPlc region [type=user, persistence=false, lazyAlloc=true, [21:02:49] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB] [21:02:49] : [Step 4/5] ^-- Ignite persistence [used=0MB] [21:02:49] : [Step 4/5] [21:02:49] : [Step 4/5] [2021-11-19 21:02:49,074][INFO ][test-runner-#4024%persistence.CheckpointReadLockFailureTest%][GridCacheDatabaseSharedManager] Starting binary memory restore for: [-2100569601] [21:02:49] : [Step 4/5] [2021-11-19 21:02:49,082][INFO ][test-runner-#4024%persistence.CheckpointReadLockFailureTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:02:49] : [Step 4/5] [2021-11-19 21:02:49,082][INFO ][test-runner-#4024%persistence.CheckpointReadLockFailureTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:02:49] : [Step 4/5] [2021-11-19 21:02:49,084][INFO ][test-runner-#4024%persistence.CheckpointReadLockFailureTest%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/node00-a5a18317-2580-459a-b487-46e9909ec370/0000000000000000.wal, offset=0, ver=2] [21:02:49] : [Step 4/5] [2021-11-19 21:02:49,087][INFO ][test-runner-#4024%persistence.CheckpointReadLockFailureTest%][GridCacheProcessor] Started cache in recovery mode [name=ignite-sys-cache, id=-2100569601, dataRegionName=sysMemPlc, mode=REPLICATED, atomicity=TRANSACTIONAL, backups=2147483647, mvcc=false] [21:02:49] : [Step 4/5] [2021-11-19 21:02:49,089][INFO ][test-runner-#4024%persistence.CheckpointReadLockFailureTest%][GridCacheDatabaseSharedManager] Binary recovery performed in 15 ms. [21:02:49] : [Step 4/5] [2021-11-19 21:02:49,089][INFO ][test-runner-#4024%persistence.CheckpointReadLockFailureTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:02:49] : [Step 4/5] [2021-11-19 21:02:49,089][INFO ][test-runner-#4024%persistence.CheckpointReadLockFailureTest%][GridCacheDatabaseSharedManager] Applying lost cache updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:02:49] : [Step 4/5] [2021-11-19 21:02:49,139][INFO ][test-runner-#4024%persistence.CheckpointReadLockFailureTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=51 ms] [21:02:49] : [Step 4/5] [2021-11-19 21:02:49,140][INFO ][test-runner-#4024%persistence.CheckpointReadLockFailureTest%][GridCacheProcessor] Restoring partition state for local groups. [21:02:49] : [Step 4/5] [2021-11-19 21:02:49,144][INFO ][test-runner-#4024%persistence.CheckpointReadLockFailureTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=1, partitionsProcessed=100, time=0ms] [21:02:49] : [Step 4/5] [2021-11-19 21:02:49,467][INFO ][disco-notifier-worker-#4136%persistence.CheckpointReadLockFailureTest0%][MvccProcessorImpl] Assigned mvcc coordinator [crd=MvccCoordinator [topVer=AffinityTopologyVersion [topVer=1, minorTopVer=0], nodeId=6aa7de2d-38bb-498a-bf27-5be5e6c00000, ver=1637344969459, local=true, initialized=false]] [21:02:49] : [Step 4/5] [2021-11-19 21:02:49,469][INFO ][sys-#4116%persistence.CheckpointReadLockFailureTest0%][ClusterProcessor] Writing cluster ID and tag to metastorage on ready for write ClusterIdAndTag [id=9f0556b0-d48e-4179-a720-272801370d68, tag=kind_murdock] [21:02:49] : [Step 4/5] [2021-11-19 21:02:49,470][INFO ][disco-notifier-worker-#4136%persistence.CheckpointReadLockFailureTest0%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustEnabled' was changed from 'null' to 'false' [21:02:49] : [Step 4/5] [2021-11-19 21:02:49,471][INFO ][disco-notifier-worker-#4136%persistence.CheckpointReadLockFailureTest0%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustTimeout' was changed from 'null' to '300000' [21:02:49] : [Step 4/5] [2021-11-19 21:02:49,472][INFO ][disco-notifier-worker-#4136%persistence.CheckpointReadLockFailureTest0%][IgniteTxManager] Transactions parameter 'longOperationsDumpTimeout' was changed from 'null' to '60000' [21:02:49] : [Step 4/5] [2021-11-19 21:02:49,473][INFO ][disco-notifier-worker-#4136%persistence.CheckpointReadLockFailureTest0%][ClusterProcessor] kind_murdock [21:02:49] : [Step 4/5] [2021-11-19 21:02:49,474][INFO ][disco-notifier-worker-#4136%persistence.CheckpointReadLockFailureTest0%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpThreshold' was changed from 'null' to '0' [21:02:49] : [Step 4/5] [2021-11-19 21:02:49,474][INFO ][disco-notifier-worker-#4136%persistence.CheckpointReadLockFailureTest0%][IgniteTxManager] Transactions parameter 'transactionTimeDumpSamplesCoefficient' was changed from 'null' to '0.0' [21:02:49] : [Step 4/5] [2021-11-19 21:02:49,475][INFO ][disco-notifier-worker-#4136%persistence.CheckpointReadLockFailureTest0%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpSamplesPerSecondLimit' was changed from 'null' to '5' [21:02:49] : [Step 4/5] [2021-11-19 21:02:49,476][INFO ][disco-notifier-worker-#4136%persistence.CheckpointReadLockFailureTest0%][IgniteTxManager] Transactions parameter 'collisionsDumpInterval' was changed from 'null' to '1000' [21:02:49] : [Step 4/5] [2021-11-19 21:02:49,477][INFO ][disco-notifier-worker-#4136%persistence.CheckpointReadLockFailureTest0%][IgniteTxManager] Transactions parameter 'txOwnerDumpRequestsAllowed' was changed from 'null' to 'true' [21:02:49] : [Step 4/5] [2021-11-19 21:02:49,477][INFO ][disco-notifier-worker-#4136%persistence.CheckpointReadLockFailureTest0%][GridCacheDatabaseSharedManager] Historical rebalance WAL threshold changed [property=historical.rebalance.threshold, oldVal=null, newVal=500] [21:02:49] : [Step 4/5] [2021-11-19 21:02:49,483][INFO ][test-runner-#4024%persistence.CheckpointReadLockFailureTest%][CheckpointReadLockFailureTest0] To start Console Management & Monitoring run ignitevisorcmd.{sh|bat} [21:02:49] : [Step 4/5] [2021-11-19 21:02:49,484][INFO ][test-runner-#4024%persistence.CheckpointReadLockFailureTest%][CheckpointReadLockFailureTest0] [21:02:49] : [Step 4/5] [21:02:49] : [Step 4/5] >>> +-------------------------------------------+ [21:02:49] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:02:49] : [Step 4/5] >>> +-------------------------------------------+ [21:02:49] : [Step 4/5] >>> OS name: Linux 4.15.0-151-generic amd64 [21:02:49] : [Step 4/5] >>> CPU(s): 24 [21:02:49] : [Step 4/5] >>> Heap: 2.0GB [21:02:49] : [Step 4/5] >>> VM name: 16724@c4dfe9a430b2 [21:02:49] : [Step 4/5] >>> Ignite instance name: persistence.CheckpointReadLockFailureTest0 [21:02:49] : [Step 4/5] >>> Local node [ID=6AA7DE2D-38BB-498A-BF27-5BE5E6C00000, order=1, clientMode=false] [21:02:49] : [Step 4/5] >>> Local node addresses: [127.0.0.1] [21:02:49] : [Step 4/5] >>> Local ports: TCP:10800 TCP:45070 TCP:47500 [21:02:49] : [Step 4/5] [21:02:49] : [Step 4/5] [2021-11-19 21:02:49,485][INFO ][test-runner-#4024%persistence.CheckpointReadLockFailureTest%][CheckpointReadLockFailureTest0] >>> Ignite cluster is in INACTIVE state (limited functionality available). Use control.(sh|bat) script or IgniteCluster.state(ClusterState.ACTIVE) to change the state. [21:02:49] : [Step 4/5] [2021-11-19 21:02:49,486][INFO ][test-runner-#4024%persistence.CheckpointReadLockFailureTest%][GridDiscoveryManager] Topology snapshot [ver=1, locNode=6aa7de2d, servers=1, clients=0, state=INACTIVE, CPUs=24, offheap=0.25GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=6aa7de2d-38bb-498a-bf27-5be5e6c00000, consistentId=a5a18317-2580-459a-b487-46e9909ec370, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:02:49] : [Step 4/5] [2021-11-19 21:02:49,487][INFO ][test-runner-#4024%persistence.CheckpointReadLockFailureTest%][G] Node started : [stage="Configure system pool" (0 ms),stage="Start managers" (63 ms),stage="Configure binary metadata" (2 ms),stage="Start processors" (364 ms),stage="Start 'StanByClusterTestProvider' plugin" (0 ms),stage="Start 'PageMemory tracker plugin' plugin" (0 ms),stage="Start 'TestDistibutedConfigurationPlugin' plugin" (0 ms),stage="Start 'NodeValidationPluginProvider' plugin" (0 ms),stage="Init metastore" (21 ms),stage="Init and start regions" (6 ms),stage="Restore binary memory" (14 ms),stage="Restore logical state" (55 ms),stage="Finish recovery" (317 ms),stage="Join topology" (5 ms),stage="Await transition" (2 ms),stage="Await exchange" (16 ms),stage="Total time" (865 ms)] [21:02:49] : [Step 4/5] [2021-11-19 21:02:49,489][INFO ][test-runner-#4024%persistence.CheckpointReadLockFailureTest%][root] Node started with the following configuration [id=6aa7de2d-38bb-498a-bf27-5be5e6c00000, marshaller=BinaryMarshaller [], discovery=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=5000, ackTimeout=5000, marsh=JdkMarshaller [clsFilter=org.apache.ignite.marshaller.MarshallerUtils$1@23902450], reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], binaryCfg=null, lateAff=true] [21:02:49] : [Step 4/5] [2021-11-19 21:02:49,490][INFO ][test-runner-#4024%persistence.CheckpointReadLockFailureTest%][GridClusterStateProcessor] Sending activate cluster request with BaselineTopology BaselineTopology [id=0, branchingHash=-1539816684, branchingType='New BaselineTopology', baselineNodes=[a5a18317-2580-459a-b487-46e9909ec370]] [21:02:49] : [Step 4/5] [2021-11-19 21:02:49,491][INFO ][disco-notifier-worker-#4136%persistence.CheckpointReadLockFailureTest0%][GridClusterStateProcessor] Received activate cluster request with BaselineTopology[id=0] initiator node ID: 6aa7de2d-38bb-498a-bf27-5be5e6c00000 [21:02:49] : [Step 4/5] [2021-11-19 21:02:49,492][INFO ][disco-notifier-worker-#4136%persistence.CheckpointReadLockFailureTest0%][GridClusterStateProcessor] Started state transition: activate cluster [21:02:49] : [Step 4/5] [2021-11-19 21:02:49,493][INFO ][exchange-worker-#4141%persistence.CheckpointReadLockFailureTest0%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=1, minorTopVer=1], crd=true, evt=DISCOVERY_CUSTOM_EVT, evtNode=6aa7de2d-38bb-498a-bf27-5be5e6c00000, customEvt=ChangeGlobalStateMessage [id=36cac593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqId=90dfd034-c55f-41ba-b663-8c6cfd743278, initiatingNodeId=6aa7de2d-38bb-498a-bf27-5be5e6c00000, state=ACTIVE, baselineTopology=BaselineTopology [id=0, branchingHash=-1539816684, branchingType='New BaselineTopology', baselineNodes=[a5a18317-2580-459a-b487-46e9909ec370]], forceChangeBaselineTopology=false, timestamp=1637344969490, forceDeactivation=true], allowMerge=false, exchangeFreeSwitch=false] [21:02:49] : [Step 4/5] [2021-11-19 21:02:49,494][INFO ][exchange-worker-#4141%persistence.CheckpointReadLockFailureTest0%][GridDhtPartitionsExchangeFuture] Start activation process [nodeId=6aa7de2d-38bb-498a-bf27-5be5e6c00000, client=false, topVer=AffinityTopologyVersion [topVer=1, minorTopVer=1]]. New state: ACTIVE [21:02:49] : [Step 4/5] [2021-11-19 21:02:49,495][INFO ][exchange-worker-#4141%persistence.CheckpointReadLockFailureTest0%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/node00-a5a18317-2580-459a-b487-46e9909ec370 [21:02:49] : [Step 4/5] [2021-11-19 21:02:49,497][INFO ][exchange-worker-#4141%persistence.CheckpointReadLockFailureTest0%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/node00-a5a18317-2580-459a-b487-46e9909ec370/0000000000000000.wal, offset=8795, ver=2] [21:02:49] : [Step 4/5] [2021-11-19 21:02:49,498][INFO ][exchange-worker-#4141%persistence.CheckpointReadLockFailureTest0%][GridClusterStateProcessor] Writing BaselineTopology[id=0] [21:02:49] : [Step 4/5] [2021-11-19 21:02:49,500][INFO ][exchange-worker-#4141%persistence.CheckpointReadLockFailureTest0%][GridCacheDatabaseSharedManager] Finish recovery performed in 5 ms. [21:02:49] : [Step 4/5] [2021-11-19 21:02:49,501][INFO ][exchange-worker-#4141%persistence.CheckpointReadLockFailureTest0%][msg] Components activation performed in 6 ms. [21:02:49] : [Step 4/5] [2021-11-19 21:02:49,502][INFO ][exchange-worker-#4141%persistence.CheckpointReadLockFailureTest0%][GridCacheProcessor] Finished recovery for cache [cache=ignite-sys-cache, grp=ignite-sys-cache, startVer=AffinityTopologyVersion [topVer=1, minorTopVer=1]] [21:02:49] : [Step 4/5] [2021-11-19 21:02:49,504][INFO ][exchange-worker-#4141%persistence.CheckpointReadLockFailureTest0%][GridDhtPartitionsExchangeFuture] Successfully activated caches [nodeId=6aa7de2d-38bb-498a-bf27-5be5e6c00000, client=false, topVer=AffinityTopologyVersion [topVer=1, minorTopVer=1], newState=ACTIVE] [21:02:49] : [Step 4/5] [2021-11-19 21:02:49,505][INFO ][exchange-worker-#4141%persistence.CheckpointReadLockFailureTest0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=1, minorTopVer=1], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:02:49] : [Step 4/5] [2021-11-19 21:02:49,513][INFO ][exchange-worker-#4141%persistence.CheckpointReadLockFailureTest0%][GridDhtPartitionsExchangeFuture] finishExchangeOnCoordinator [topVer=AffinityTopologyVersion [topVer=1, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=1, minorTopVer=1]] [21:02:49] : [Step 4/5] [2021-11-19 21:02:49,515][INFO ][db-checkpoint-thread-#4148%persistence.CheckpointReadLockFailureTest0%][Checkpointer] Checkpoint started [checkpointId=0d7db249-7267-4dd5-abb6-442ed1782e27, startPtr=WALPointer [idx=0, fileOff=66543, len=1963], checkpointBeforeLockTime=3ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=1ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=0ms, pages=16, reason='node started'] [21:02:49] : [Step 4/5] [2021-11-19 21:02:49,520][INFO ][exchange-worker-#4141%persistence.CheckpointReadLockFailureTest0%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=1, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=1, minorTopVer=1], err=null, rebalanced=true, wasRebalanced=false] [21:02:49] : [Step 4/5] [2021-11-19 21:02:49,520][INFO ][disco-notifier-worker-#4136%persistence.CheckpointReadLockFailureTest0%][GridClusterStateProcessor] Received state change finish message: ACTIVE [21:02:49] : [Step 4/5] [2021-11-19 21:02:49,521][INFO ][disco-notifier-worker-#4136%persistence.CheckpointReadLockFailureTest0%][GridClusterStateProcessor] Cluster state was changed from INACTIVE to ACTIVE [21:02:49] : [Step 4/5] [2021-11-19 21:02:49,523][INFO ][exchange-worker-#4141%persistence.CheckpointReadLockFailureTest0%][GridCacheProcessor] Finish proxy initialization, cacheName=ignite-sys-cache, localNodeId=6aa7de2d-38bb-498a-bf27-5be5e6c00000 [21:02:49] : [Step 4/5] [2021-11-19 21:02:49,523][INFO ][sys-#4113%persistence.CheckpointReadLockFailureTest0%][DistributedBaselineConfiguration] Baseline auto-adjust is 'disabled' with timeout='300000' ms [21:02:49] : [Step 4/5] [2021-11-19 21:02:49,524][INFO ][sys-#4113%persistence.CheckpointReadLockFailureTest0%][GridClusterStateProcessor] Successfully performed final activation steps [nodeId=6aa7de2d-38bb-498a-bf27-5be5e6c00000, client=false, topVer=AffinityTopologyVersion [topVer=1, minorTopVer=1]] [21:02:49] : [Step 4/5] [2021-11-19 21:02:49,523][INFO ][exchange-worker-#4141%persistence.CheckpointReadLockFailureTest0%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=6aa7de2d-38bb-498a-bf27-5be5e6c00000, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=1, minorTopVer=1], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=6aa7de2d-38bb-498a-bf27-5be5e6c00000, consistentId=a5a18317-2580-459a-b487-46e9909ec370, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637344969458, loc=true, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=1, minorTopVer=1]] [21:02:49] : [Step 4/5] [2021-11-19 21:02:49,525][INFO ][exchange-worker-#4141%persistence.CheckpointReadLockFailureTest0%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=1, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=1, minorTopVer=1], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (1 ms), stage="Update caches registry" (7 ms), stage="Start caches" (0 ms), stage="Affinity initialization on cache group start" (0 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Restore partition states" (0 ms), stage="After states restored callback" (8 ms), stage="WAL history reservation" (0 ms), stage="Waiting for all single messages" (0 ms), stage="Affinity recalculation (crd)" (0 ms), stage="Collect update counters and create affinity messages" (0 ms), stage="Assign partitions states" (0 ms), stage="Validate partitions states" (0 ms), stage="Ideal affinity diff calculation (enforced)" (0 ms), stage="Apply update counters" (0 ms), stage="Full message preparing" (4 ms), stage="Full message sending" (0 ms), stage="State finish message sending" (0 ms), stage="Detect lost partitions" (2 ms), stage="Exchange done" (3 ms), stage="Total time" (25 ms)] [21:02:49] : [Step 4/5] [2021-11-19 21:02:49,527][INFO ][exchange-worker-#4141%persistence.CheckpointReadLockFailureTest0%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=1, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=1, minorTopVer=1], stage="Affinity initialization on cache group start [grp=ignite-sys-cache]" (0 ms) (parent=Affinity initialization on cache group start), stage="Affinity centralized initialization (crd) [grp=ignite-sys-cache, crd=true]" (0 ms) (parent=Determine exchange type), stage="Restore partition states [grp=ignite-sys-cache]" (0 ms) (parent=Restore partition states), stage="Affinity recalculation (partitions availability) [grp=ignite-sys-cache]" (0 ms) (parent=Ideal affinity diff calculation (enforced))] [21:02:49] : [Step 4/5] [2021-11-19 21:02:49,528][INFO ][exchange-worker-#4141%persistence.CheckpointReadLockFailureTest0%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=1, minorTopVer=1], crd=true] [21:02:49]W: [org.apache.ignite:ignite-core] [2021-11-19 21:02:49,529][ERROR][async-runnable-runner-1][IgniteTestResources] Critical system error detected. Will be handled accordingly to configured handler [hnd=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED]], failureCtx=FailureContext [type=SYSTEM_CRITICAL_OPERATION_TIMEOUT, err=class o.a.i.IgniteException: Checkpoint read lock acquisition has been timed out.]] [21:02:49]W: [org.apache.ignite:ignite-core] class org.apache.ignite.IgniteException: Checkpoint read lock acquisition has been timed out. [21:02:49]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.checkpoint.CheckpointTimeoutLock.failCheckpointReadLock(CheckpointTimeoutLock.java:205) [21:02:49]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.checkpoint.CheckpointTimeoutLock.checkpointReadLock(CheckpointTimeoutLock.java:114) [21:02:49]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheDatabaseSharedManager.checkpointReadLock(GridCacheDatabaseSharedManager.java:1645) [21:02:49]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.CheckpointReadLockFailureTest.lambda$testFailureTypeOnTimeout$1(CheckpointReadLockFailureTest.java:149) [21:02:49]W: [org.apache.ignite:ignite-core] at org.apache.ignite.testframework.GridTestUtils.lambda$runAsync$2(GridTestUtils.java:1135) [21:02:49]W: [org.apache.ignite:ignite-core] at org.apache.ignite.testframework.GridTestUtils.lambda$runAsync$3(GridTestUtils.java:1191) [21:02:49]W: [org.apache.ignite:ignite-core] at org.apache.ignite.testframework.GridTestUtils$7.call(GridTestUtils.java:1512) [21:02:49]W: [org.apache.ignite:ignite-core] at org.apache.ignite.testframework.GridTestThread.run(GridTestThread.java:88) [21:02:49]W: [org.apache.ignite:ignite-core] [2021-11-19 21:02:49,533][WARN ][async-runnable-runner-1][CacheDiagnosticManager] Page locks dump: [21:02:49]W: [org.apache.ignite:ignite-core] [21:02:49]W: [org.apache.ignite:ignite-core] [21:02:49]W: [org.apache.ignite:ignite-core] [21:02:49]W: [org.apache.ignite:ignite-core] [21:02:49]W: [org.apache.ignite:ignite-core] [21:02:49]W: [org.apache.ignite:ignite-core] [21:02:49]W: [org.apache.ignite:ignite-core] [2021-11-19 21:02:49,533][ERROR][exchange-worker-#4141%persistence.CheckpointReadLockFailureTest0%][IgniteTestResources] Critical system error detected. Will be handled accordingly to configured handler [hnd=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED]], failureCtx=FailureContext [type=SYSTEM_CRITICAL_OPERATION_TIMEOUT, err=class o.a.i.IgniteException: Checkpoint read lock acquisition has been timed out.]] [21:02:49]W: [org.apache.ignite:ignite-core] class org.apache.ignite.IgniteException: Checkpoint read lock acquisition has been timed out. [21:02:49]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.checkpoint.CheckpointTimeoutLock.failCheckpointReadLock(CheckpointTimeoutLock.java:205) [21:02:49]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.checkpoint.CheckpointTimeoutLock.checkpointReadLock(CheckpointTimeoutLock.java:114) [21:02:49]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheDatabaseSharedManager.checkpointReadLock(GridCacheDatabaseSharedManager.java:1645) [21:02:49]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.distributed.dht.topology.GridDhtPartitionTopologyImpl.afterExchange(GridDhtPartitionTopologyImpl.java:781) [21:02:49]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.GridCachePartitionExchangeManager$ExchangeWorker.body0(GridCachePartitionExchangeManager.java:3464) [21:02:49]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.GridCachePartitionExchangeManager$ExchangeWorker.body(GridCachePartitionExchangeManager.java:3197) [21:02:49]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:125) [21:02:49]W: [org.apache.ignite:ignite-core] at java.lang.Thread.run(Thread.java:748) [21:02:49]W: [org.apache.ignite:ignite-core] [2021-11-19 21:02:49,533][ERROR][async-runnable-runner-1][CheckpointTimeoutLock] Checkpoint read lock acquisition has been timed out. [21:02:49]W: [org.apache.ignite:ignite-core] class org.apache.ignite.internal.processors.cache.persistence.checkpoint.CheckpointTimeoutLock$CheckpointReadLockTimeoutException: Checkpoint read lock acquisition has been timed out. [21:02:49]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.checkpoint.CheckpointTimeoutLock.failCheckpointReadLock(CheckpointTimeoutLock.java:210) [21:02:49]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.checkpoint.CheckpointTimeoutLock.checkpointReadLock(CheckpointTimeoutLock.java:114) [21:02:49]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheDatabaseSharedManager.checkpointReadLock(GridCacheDatabaseSharedManager.java:1645) [21:02:49]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.CheckpointReadLockFailureTest.lambda$testFailureTypeOnTimeout$1(CheckpointReadLockFailureTest.java:149) [21:02:49]W: [org.apache.ignite:ignite-core] at org.apache.ignite.testframework.GridTestUtils.lambda$runAsync$2(GridTestUtils.java:1135) [21:02:49]W: [org.apache.ignite:ignite-core] at org.apache.ignite.testframework.GridTestUtils.lambda$runAsync$3(GridTestUtils.java:1191) [21:02:49]W: [org.apache.ignite:ignite-core] at org.apache.ignite.testframework.GridTestUtils$7.call(GridTestUtils.java:1512) [21:02:49]W: [org.apache.ignite:ignite-core] at org.apache.ignite.testframework.GridTestThread.run(GridTestThread.java:88) [21:02:49]W: [org.apache.ignite:ignite-core] [2021-11-19 21:02:49,538][WARN ][exchange-worker-#4141%persistence.CheckpointReadLockFailureTest0%][CacheDiagnosticManager] Page locks dump: [21:02:49]W: [org.apache.ignite:ignite-core] [21:02:49]W: [org.apache.ignite:ignite-core] [21:02:49]W: [org.apache.ignite:ignite-core] [21:02:49]W: [org.apache.ignite:ignite-core] [21:02:49]W: [org.apache.ignite:ignite-core] [21:02:49]W: [org.apache.ignite:ignite-core] [21:02:49]W: [org.apache.ignite:ignite-core] [2021-11-19 21:02:49,541][ERROR][exchange-worker-#4141%persistence.CheckpointReadLockFailureTest0%][CheckpointTimeoutLock] Checkpoint read lock acquisition has been timed out. [21:02:49]W: [org.apache.ignite:ignite-core] class org.apache.ignite.internal.processors.cache.persistence.checkpoint.CheckpointTimeoutLock$CheckpointReadLockTimeoutException: Checkpoint read lock acquisition has been timed out. [21:02:49]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.checkpoint.CheckpointTimeoutLock.failCheckpointReadLock(CheckpointTimeoutLock.java:210) [21:02:49]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.checkpoint.CheckpointTimeoutLock.checkpointReadLock(CheckpointTimeoutLock.java:114) [21:02:49]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheDatabaseSharedManager.checkpointReadLock(GridCacheDatabaseSharedManager.java:1645) [21:02:49]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.distributed.dht.topology.GridDhtPartitionTopologyImpl.afterExchange(GridDhtPartitionTopologyImpl.java:781) [21:02:49]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.GridCachePartitionExchangeManager$ExchangeWorker.body0(GridCachePartitionExchangeManager.java:3464) [21:02:49] : [Step 4/5] [2021-11-19 21:02:49,541][INFO ][db-checkpoint-thread-#4148%persistence.CheckpointReadLockFailureTest0%][Checkpointer] Checkpoint finished [cpId=0d7db249-7267-4dd5-abb6-442ed1782e27, pages=16, markPos=WALPointer [idx=0, fileOff=66543, len=1963], walSegmentsCovered=[], markDuration=4ms, pagesWrite=3ms, fsync=21ms, total=31ms] [21:02:49]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.GridCachePartitionExchangeManager$ExchangeWorker.body(GridCachePartitionExchangeManager.java:3197) [21:02:49]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:125) [21:02:49]W: [org.apache.ignite:ignite-core] at java.lang.Thread.run(Thread.java:748) [21:02:49] : [Step 4/5] [2021-11-19 21:02:49,543][INFO ][exchange-worker-#4141%persistence.CheckpointReadLockFailureTest0%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=1, minorTopVer=1], force=false, evt=DISCOVERY_CUSTOM_EVT, node=6aa7de2d-38bb-498a-bf27-5be5e6c00000] [21:02:54] : [Step 4/5] [2021-11-19 21:02:54,744][INFO ][test-runner-#4024%persistence.CheckpointReadLockFailureTest%][root] >>> Stopping grid [name=persistence.CheckpointReadLockFailureTest0, id=6aa7de2d-38bb-498a-bf27-5be5e6c00000] [21:02:54] : [Step 4/5] [2021-11-19 21:02:54,748][INFO ][db-checkpoint-thread-#4148%persistence.CheckpointReadLockFailureTest0%][Checkpointer] Skipping checkpoint (no pages were modified) [checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=1ms, checkpointLockHoldTime=1ms, reason='timeout'] [21:02:54] : [Step 4/5] [2021-11-19 21:02:54,749][INFO ][db-checkpoint-thread-#4148%persistence.CheckpointReadLockFailureTest0%][Checkpointer] Skipping checkpoint (no pages were modified) [checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, reason='timeout'] [21:02:54] : [Step 4/5] [2021-11-19 21:02:54,755][INFO ][test-runner-#4024%persistence.CheckpointReadLockFailureTest%][GridCacheProcessor] Stopped cache [cacheName=ignite-sys-cache] [21:02:54] : [Step 4/5] [2021-11-19 21:02:54,756][INFO ][test-runner-#4024%persistence.CheckpointReadLockFailureTest%][FilePageStoreManager] Cleanup cache stores [total=3, left=0, cleanFiles=false] [21:02:54] : [Step 4/5] [2021-11-19 21:02:54,764][INFO ][test-runner-#4024%persistence.CheckpointReadLockFailureTest%][CheckpointReadLockFailureTest0] [21:02:54] : [Step 4/5] [21:02:54] : [Step 4/5] >>> +------------------------------------------------------+ [21:02:54] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV stopped OK [21:02:54] : [Step 4/5] >>> +------------------------------------------------------+ [21:02:54] : [Step 4/5] >>> Ignite instance name: persistence.CheckpointReadLockFailureTest0 [21:02:54] : [Step 4/5] >>> Grid uptime: 00:00:05.280 [21:02:54] : [Step 4/5] [21:02:54] : [Step 4/5] [21:02:54] : [Step 4/5] [21:02:54] >>> Stopping test: CheckpointReadLockFailureTest#testFailureTypeOnTimeout in 6305 ms <<< [21:02:54] : [Step 4/5] [2021-11-19 21:02:54,913][INFO ][main][root] >>> Stopping test: CheckpointReadLockFailureTest#testFailureTypeOnTimeout in 6305 ms <<< [21:02:54] : [Step 4/5] [21:02:54] >>> Heap: 575 MB used / 1944 MB commited / 1944 MB max <<< [21:02:54] : [Step 4/5] [2021-11-19 21:02:54,914][INFO ][main][root] >>> Heap: 575 MB used / 1944 MB commited / 1944 MB max <<< [21:02:54] : [Step 4/5] [21:02:54] >>> Non-Heap: 118 MB used / 125 MB commited / 0 MB max <<< [21:02:54] : [Step 4/5] [2021-11-19 21:02:54,914][INFO ][main][root] >>> Non-Heap: 118 MB used / 125 MB commited / 0 MB max <<< [21:02:54] : [Step 4/5] [21:02:54] >>> Starting test: CheckpointReadLockFailureTest#testWriteLockedByCurrentThread <<< [21:02:54] : [Step 4/5] [2021-11-19 21:02:54,916][INFO ][main][root] >>> Starting test: CheckpointReadLockFailureTest#testWriteLockedByCurrentThread <<< [21:02:54] : [Step 4/5] [21:02:54] >>> Heap: 575 MB used / 1944 MB commited / 1944 MB max <<< [21:02:54] : [Step 4/5] [2021-11-19 21:02:54,917][INFO ][main][root] >>> Heap: 575 MB used / 1944 MB commited / 1944 MB max <<< [21:02:54] : [Step 4/5] [21:02:54] >>> Non-Heap: 118 MB used / 125 MB commited / 0 MB max <<< [21:02:54] : [Step 4/5] [2021-11-19 21:02:54,917][INFO ][main][root] >>> Non-Heap: 118 MB used / 125 MB commited / 0 MB max <<< [21:02:54] : [Step 4/5] [21:02:54] >>> Stopping test: CheckpointReadLockFailureTest#testWriteLockedByCurrentThread in 3 ms <<< [21:02:54] : [Step 4/5] [2021-11-19 21:02:54,921][INFO ][main][root] >>> Stopping test: CheckpointReadLockFailureTest#testWriteLockedByCurrentThread in 3 ms <<< [21:02:54] : [Step 4/5] [21:02:54] >>> Heap: 575 MB used / 1944 MB commited / 1944 MB max <<< [21:02:54] : [Step 4/5] [2021-11-19 21:02:54,921][INFO ][main][root] >>> Heap: 575 MB used / 1944 MB commited / 1944 MB max <<< [21:02:54] : [Step 4/5] [21:02:54] >>> Non-Heap: 118 MB used / 125 MB commited / 0 MB max <<< [21:02:54] : [Step 4/5] [2021-11-19 21:02:54,922][INFO ][main][root] >>> Non-Heap: 118 MB used / 125 MB commited / 0 MB max <<< [21:02:54] : [Step 4/5] [21:02:54] >>> Starting test: CheckpointReadLockFailureTest#testPrintCpRLockHolder <<< [21:02:54] : [Step 4/5] [2021-11-19 21:02:54,924][INFO ][main][root] >>> Starting test: CheckpointReadLockFailureTest#testPrintCpRLockHolder <<< [21:02:54] : [Step 4/5] [21:02:54] >>> Heap: 575 MB used / 1944 MB commited / 1944 MB max <<< [21:02:54] : [Step 4/5] [2021-11-19 21:02:54,924][INFO ][main][root] >>> Heap: 575 MB used / 1944 MB commited / 1944 MB max <<< [21:02:54] : [Step 4/5] [21:02:54] >>> Non-Heap: 118 MB used / 125 MB commited / 0 MB max <<< [21:02:54] : [Step 4/5] [2021-11-19 21:02:54,925][INFO ][main][root] >>> Non-Heap: 118 MB used / 125 MB commited / 0 MB max <<< [21:02:54]W: [org.apache.ignite:ignite-core] [2021-11-19 21:02:54,938][WARN ][test-runner-#4158%persistence.CheckpointReadLockFailureTest%][root] Ignite work directory is not provided, automatically resolved to: /opt/buildagent/work/7bc1c54bc719b67c/work [21:02:54]W: [org.apache.ignite:ignite-core] [2021-11-19 21:02:54,939][WARN ][test-runner-#4158%persistence.CheckpointReadLockFailureTest%][root] Consistent ID is not set, it is recommended to set consistent ID for production clusters (use IgniteConfiguration.setConsistentId property) [21:02:54] : [Step 4/5] [2021-11-19 21:02:54,942][INFO ][test-runner-#4158%persistence.CheckpointReadLockFailureTest%][root] [21:02:54] : [Step 4/5] [21:02:54] : [Step 4/5] >>> __________ ________________ [21:02:54] : [Step 4/5] >>> / _/ ___/ |/ / _/_ __/ __/ [21:02:54] : [Step 4/5] >>> _/ // (7 7 // / / / / _/ [21:02:54] : [Step 4/5] >>> /___/\___/_/|_/___/ /_/ /___/ [21:02:54] : [Step 4/5] >>> [21:02:54] : [Step 4/5] >>> ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:02:54] : [Step 4/5] >>> 2021 Copyright(C) Apache Software Foundation [21:02:54] : [Step 4/5] >>> [21:02:54] : [Step 4/5] >>> Ignite documentation: http://ignite.apache.org [21:02:54] : [Step 4/5] [21:02:54] : [Step 4/5] [2021-11-19 21:02:54,943][INFO ][test-runner-#4158%persistence.CheckpointReadLockFailureTest%][root] Config URL: n/a [21:02:54] : [Step 4/5] [2021-11-19 21:02:54,944][INFO ][test-runner-#4158%persistence.CheckpointReadLockFailureTest%][root] IgniteConfiguration [igniteInstanceName=persistence.CheckpointReadLockFailureTest0, pubPoolSize=24, svcPoolSize=24, callbackPoolSize=24, stripedPoolSize=24, sysPoolSize=24, mgmtPoolSize=4, dataStreamerPoolSize=24, utilityCachePoolSize=24, utilityCacheKeepAliveTime=60000, p2pPoolSize=2, qryPoolSize=24, buildIdxPoolSize=4, igniteHome=/opt/buildagent/work/7bc1c54bc719b67c, igniteWorkDir=/opt/buildagent/work/7bc1c54bc719b67c/work, mbeanSrv=com.sun.jmx.mbeanserver.JmxMBeanServer@6fe85038, nodeId=6c5d0b26-7b60-4c96-aee9-1ef5b1300000, marsh=BinaryMarshaller [], marshLocJobs=false, daemon=false, p2pEnabled=true, netTimeout=10000, netCompressionLevel=1, sndRetryDelay=1000, sndRetryCnt=3, metricsHistSize=10000, metricsUpdateFreq=1000, metricsExpTime=9223372036854775807, discoSpi=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=0, ackTimeout=0, marsh=null, reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], segPlc=STOP, segResolveAttempts=2, waitForSegOnStart=true, allResolversPassReq=true, segChkFreq=10000, commSpi=TcpCommunicationSpi [connectGate=org.apache.ignite.spi.communication.tcp.internal.ConnectGateway@20b84ded, ctxInitLatch=java.util.concurrent.CountDownLatch@3de4198c[Count = 1], stopping=false, clientPool=null, nioSrvWrapper=null, stateProvider=null], evtSpi=MemoryEventStorageSpi [expireAgeMs=9223372036854775807, expireCnt=10000, filter=null], colSpi=NoopCollisionSpi [], deploySpi=LocalDeploymentSpi [], indexingSpi=org.apache.ignite.spi.indexing.noop.NoopIndexingSpi@597a1dff, addrRslvr=null, encryptionSpi=org.apache.ignite.spi.encryption.noop.NoopEncryptionSpi@bce69f1, tracingSpi=org.apache.ignite.spi.tracing.NoopTracingSpi@78d3940e, clientMode=false, rebalanceThreadPoolSize=4, rebalanceTimeout=10000, rebalanceBatchesPrefetchCnt=3, rebalanceThrottle=0, rebalanceBatchSize=524288, txCfg=TransactionConfiguration [txSerEnabled=false, dfltIsolation=REPEATABLE_READ, dfltConcurrency=PESSIMISTIC, dfltTxTimeout=0, txTimeoutOnPartitionMapExchange=0, deadlockTimeout=10000, pessimisticTxLogSize=0, pessimisticTxLogLinger=10000, tmLookupClsName=null, txManagerFactory=null, useJtaSync=false], cacheSanityCheckEnabled=true, discoStartupDelay=60000, deployMode=SHARED, p2pMissedCacheSize=100, locHost=127.0.0.1, timeSrvPortBase=31100, timeSrvPortRange=100, failureDetectionTimeout=10000, sysWorkerBlockedTimeout=null, clientFailureDetectionTimeout=10000, metricsLogFreq=0, connectorCfg=null, odbcCfg=null, warmupClos=null, atomicCfg=AtomicConfiguration [seqReserveSize=1000, cacheMode=PARTITIONED, backups=1, aff=null, grpName=null], classLdr=null, sslCtxFactory=null, platformCfg=null, binaryCfg=null, memCfg=null, pstCfg=null, dsCfg=DataStorageConfiguration [sysRegionInitSize=41943040, sysRegionMaxSize=104857600, pageSize=0, concLvl=0, dfltDataRegConf=DataRegionConfiguration [name=default, maxSize=268435456, initSize=268435456, swapPath=null, pageEvictionMode=DISABLED, pageReplacementMode=CLOCK, evictionThreshold=0.9, emptyPagesPoolSize=100, metricsEnabled=false, metricsSubIntervalCount=5, metricsRateTimeInterval=60000, persistenceEnabled=true, checkpointPageBufSize=0, lazyMemoryAllocation=true, warmUpCfg=null], dataRegions=null, storagePath=null, checkpointFreq=2147483647, lockWaitTime=10000, checkpointThreads=4, checkpointWriteOrder=SEQUENTIAL, walHistSize=20, maxWalArchiveSize=1073741824, walSegments=10, walSegmentSize=67108864, walPath=db/wal, walArchivePath=db/wal/archive, cdcWalPath=db/wal/cdc, cdcEnabled=false, metricsEnabled=false, walMode=LOG_ONLY, walTlbSize=131072, walBuffSize=0, walFlushFreq=2000, walFsyncDelay=1000, walRecordIterBuffSize=67108864, alwaysWriteFullPages=false, fileIOFactory=org.apache.ignite.internal.processors.cache.persistence.file.AsyncFileIOFactory@13e6e293, metricsSubIntervalCnt=5, metricsRateTimeInterval=60000, walAutoArchiveAfterInactivity=-1, walForceArchiveTimeout=-1, writeThrottlingEnabled=false, walCompactionEnabled=false, walCompactionLevel=1, checkpointReadLockTimeout=1, walPageCompression=DISABLED, walPageCompressionLevel=null, dfltWarmUpCfg=null, encCfg=org.apache.ignite.configuration.EncryptionConfiguration@6183eb87, defragmentationThreadPoolSize=4, minWalArchiveSize=-1], snapshotPath=snapshots, activeOnStart=true, activeOnStartPropSetFlag=false, autoActivation=true, autoActivationPropSetFlag=false, clusterStateOnStart=null, sqlConnCfg=null, cliConnCfg=ClientConnectorConfiguration [host=null, port=10800, portRange=100, sockSndBufSize=0, sockRcvBufSize=0, tcpNoDelay=true, maxOpenCursorsPerConn=128, threadPoolSize=24, selectorCnt=12, idleTimeout=0, handshakeTimeout=10000, jdbcEnabled=true, odbcEnabled=true, thinCliEnabled=true, sslEnabled=false, useIgniteSslCtxFactory=true, sslClientAuth=false, sslCtxFactory=null, thinCliCfg=ThinClientConfiguration [maxActiveTxPerConn=100, maxActiveComputeTasksPerConn=0]], mvccVacuumThreadCnt=2, mvccVacuumFreq=5000, authEnabled=false, failureHnd=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED]], commFailureRslvr=null, sqlCfg=SqlConfiguration [longQryWarnTimeout=3000, dfltQryTimeout=0, sqlQryHistSize=1000, validationEnabled=false], asyncContinuationExecutor=null] [21:02:54] : [Step 4/5] [2021-11-19 21:02:54,956][INFO ][test-runner-#4158%persistence.CheckpointReadLockFailureTest%][root] Daemon mode: off [21:02:54] : [Step 4/5] [2021-11-19 21:02:54,956][INFO ][test-runner-#4158%persistence.CheckpointReadLockFailureTest%][root] OS: Linux 4.15.0-151-generic amd64 [21:02:54] : [Step 4/5] [2021-11-19 21:02:54,956][INFO ][test-runner-#4158%persistence.CheckpointReadLockFailureTest%][root] OS user: teamcity [21:02:54] : [Step 4/5] [2021-11-19 21:02:54,957][INFO ][test-runner-#4158%persistence.CheckpointReadLockFailureTest%][root] PID: 16724 [21:02:54] : [Step 4/5] [2021-11-19 21:02:54,957][INFO ][test-runner-#4158%persistence.CheckpointReadLockFailureTest%][root] Language runtime: Java Platform API Specification ver. 1.8 [21:02:54] : [Step 4/5] [2021-11-19 21:02:54,957][INFO ][test-runner-#4158%persistence.CheckpointReadLockFailureTest%][root] VM information: Java(TM) SE Runtime Environment 1.8.0_261-b12 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 25.261-b12 [21:02:54] : [Step 4/5] [2021-11-19 21:02:54,958][INFO ][test-runner-#4158%persistence.CheckpointReadLockFailureTest%][root] VM total memory: 1.9GB [21:02:54] : [Step 4/5] [2021-11-19 21:02:54,958][INFO ][test-runner-#4158%persistence.CheckpointReadLockFailureTest%][root] Remote Management [restart: off, REST: off, JMX (remote: off)] [21:02:54] : [Step 4/5] [2021-11-19 21:02:54,958][INFO ][test-runner-#4158%persistence.CheckpointReadLockFailureTest%][root] Logger: org.apache.ignite.testframework.ListeningTestLogger@47b09705 [21:02:54] : [Step 4/5] [2021-11-19 21:02:54,959][INFO ][test-runner-#4158%persistence.CheckpointReadLockFailureTest%][root] IGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c [21:02:54] : [Step 4/5] [2021-11-19 21:02:54,959][INFO ][test-runner-#4158%persistence.CheckpointReadLockFailureTest%][root] VM arguments: [-DIGNITE_DUMP_THREADS_ON_FAILURE=false, -DMono=/usr/bin/mono-sgen, -DMono4.0_x64=/usr/lib/mono/4.0, -DMono4.5_x64=/usr/lib/mono/4.5, -DMonoVersion=6.12.0.90, -DSKIP_BUILD=false, -Dagent.home.dir=/opt/buildagent, -Dagent.name=aitc-lin02_03, -Dagent.ownPort=9090, -Dagent.work.dir=/opt/buildagent/work, -Dbuild.number=95, -Dbuild.vcs.number=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.1=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.GitHubApacheIgnite=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dclassworlds.conf=/opt/buildagent/temp/buildTmp/teamcity.m2.conf, -Dcom.jetbrains.maven.watcher.report.file=/opt/buildagent/temp/buildTmp/maven-build-info.xml, -Djava.io.tmpdir=/opt/buildagent/temp/buildTmp, -Dmaven.home=/opt/buildagent/tools/maven3_6, -Dmaven.multiModuleProjectDirectory=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.agent.cpuBenchmark=457, -Dteamcity.agent.dotnet.agent_url=http://localhost:9090/RPC2, -Dteamcity.agent.dotnet.build_id=6278078, -Dteamcity.auth.password=*******, -Dteamcity.auth.userId=TeamCityBuildId=6278078, -Dteamcity.build.changedFiles.file=/opt/buildagent/temp/buildTmp/changedFiles6342607772318147725.txt, -Dteamcity.build.checkoutDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.build.id=6278078, -Dteamcity.build.properties.file=/opt/buildagent/temp/buildTmp/teamcity.build5164517880467851002.properties, -Dteamcity.build.tempDir=/opt/buildagent/temp/buildTmp, -Dteamcity.build.workingDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.buildConfName=Basic 3, -Dteamcity.buildType.id=IgniteTests24Java8_Basic3, -Dteamcity.configuration.properties.file=/opt/buildagent/temp/buildTmp/teamcity.config5591980786735343870.properties, -Dteamcity.maven.userSettings.path=/opt/buildagent/temp/buildTmp/maven_settings_585072866407032347.xml, -Dteamcity.maven.watcher.home=/opt/buildagent/plugins/mavenPlugin/maven-watcher-jdk16, -Dteamcity.projectName=Ignite Tests 2.x (JDK 8/11), -Dteamcity.runner.properties.file=/opt/buildagent/temp/buildTmp/teamcity.runner9098465561618137420.properties, -Dteamcity.tests.recentlyFailedTests.file=/opt/buildagent/temp/buildTmp/testsToRunFirst3891775683130404069.txt, -Dteamcity.version=2021.2 (build 99542), -ea, -Xms2g, -Xmx2g, -XX:+HeapDumpOnOutOfMemoryError, -DIGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_TEST_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_UPDATE_NOTIFIER=false, -DIGNITE_NO_DISCO_ORDER=true, -DIGNITE_PERFORMANCE_SUGGESTIONS_DISABLED=true, -Djava.net.preferIPv4Stack=true, -DTEST_SCALE_FACTOR=1.0, -DIGNITE_TEST_PROP_LOG4J_FILE=log4j-tc-test.xml, -DIGNITE_QUIET=false, -DIGNITE_MARSHAL_BUFFERS_RECHECK=1000, -Dmaven.repo.local=/opt/buildagent/.m2/repository] [21:02:54] : [Step 4/5] [2021-11-19 21:02:54,963][INFO ][test-runner-#4158%persistence.CheckpointReadLockFailureTest%][root] System cache's DataRegion size is configured to 40 MB. Use DataStorageConfiguration.systemRegionInitialSize property to change the setting. [21:02:54]W: [org.apache.ignite:ignite-core] [2021-11-19 21:02:54,963][WARN ][test-runner-#4158%persistence.CheckpointReadLockFailureTest%][root] Peer class loading is enabled (disable it in production for performance and deployment consistency reasons) [21:02:54] : [Step 4/5] [2021-11-19 21:02:54,963][INFO ][test-runner-#4158%persistence.CheckpointReadLockFailureTest%][root] Configured caches [in 'sysMemPlc' dataRegion: ['ignite-sys-cache']] [21:02:54] : [Step 4/5] [2021-11-19 21:02:54,964][INFO ][test-runner-#4158%persistence.CheckpointReadLockFailureTest%][root] 3-rd party licenses can be found at: /opt/buildagent/work/7bc1c54bc719b67c/libs/licenses [21:02:54] : [Step 4/5] [2021-11-19 21:02:54,968][INFO ][test-runner-#4158%persistence.CheckpointReadLockFailureTest%][root] Configured plugins: [21:02:54] : [Step 4/5] [2021-11-19 21:02:54,968][INFO ][test-runner-#4158%persistence.CheckpointReadLockFailureTest%][root] ^-- StanByClusterTestProvider 1.0 [21:02:54] : [Step 4/5] [2021-11-19 21:02:54,968][INFO ][test-runner-#4158%persistence.CheckpointReadLockFailureTest%][root] ^-- null [21:02:54] : [Step 4/5] [2021-11-19 21:02:54,968][INFO ][test-runner-#4158%persistence.CheckpointReadLockFailureTest%][root] [21:02:54] : [Step 4/5] [2021-11-19 21:02:54,968][INFO ][test-runner-#4158%persistence.CheckpointReadLockFailureTest%][root] ^-- PageMemory tracker plugin 1.0 [21:02:54] : [Step 4/5] [2021-11-19 21:02:54,969][INFO ][test-runner-#4158%persistence.CheckpointReadLockFailureTest%][root] ^-- null [21:02:54] : [Step 4/5] [2021-11-19 21:02:54,969][INFO ][test-runner-#4158%persistence.CheckpointReadLockFailureTest%][root] [21:02:54] : [Step 4/5] [2021-11-19 21:02:54,969][INFO ][test-runner-#4158%persistence.CheckpointReadLockFailureTest%][root] ^-- TestDistibutedConfigurationPlugin 1.0 [21:02:54] : [Step 4/5] [2021-11-19 21:02:54,969][INFO ][test-runner-#4158%persistence.CheckpointReadLockFailureTest%][root] ^-- null [21:02:54] : [Step 4/5] [2021-11-19 21:02:54,969][INFO ][test-runner-#4158%persistence.CheckpointReadLockFailureTest%][root] [21:02:54] : [Step 4/5] [2021-11-19 21:02:54,969][INFO ][test-runner-#4158%persistence.CheckpointReadLockFailureTest%][root] ^-- NodeValidationPluginProvider 1.0 [21:02:54] : [Step 4/5] [2021-11-19 21:02:54,970][INFO ][test-runner-#4158%persistence.CheckpointReadLockFailureTest%][root] ^-- null [21:02:54] : [Step 4/5] [2021-11-19 21:02:54,970][INFO ][test-runner-#4158%persistence.CheckpointReadLockFailureTest%][root] [21:02:54] : [Step 4/5] [2021-11-19 21:02:54,970][INFO ][test-runner-#4158%persistence.CheckpointReadLockFailureTest%][root] Configured failure handler: [hnd=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED]]] [21:02:54] : [Step 4/5] [2021-11-19 21:02:54,984][INFO ][test-runner-#4158%persistence.CheckpointReadLockFailureTest%][root] Successfully bound communication NIO server to TCP port [port=45070, locHost=/127.0.0.1, selectorsCnt=12, selectorSpins=0, pairedConn=false] [21:02:54]W: [org.apache.ignite:ignite-core] [2021-11-19 21:02:54,984][WARN ][test-runner-#4158%persistence.CheckpointReadLockFailureTest%][root] Message queue limit is set to 0 which may lead to potential OOMEs when running cache operations in FULL_ASYNC or PRIMARY_SYNC modes due to message queues growth on sender and receiver sides. [21:02:54] : [Step 4/5] [2021-11-19 21:02:54,989][INFO ][test-runner-#4158%persistence.CheckpointReadLockFailureTest%][root] Collision resolution is disabled (all jobs will be activated upon arrival). [21:02:54] : [Step 4/5] [2021-11-19 21:02:54,989][INFO ][test-runner-#4158%persistence.CheckpointReadLockFailureTest%][root] Security status [authentication=off, sandbox=off, tls/ssl=off] [21:02:54] : [Step 4/5] [2021-11-19 21:02:54,991][INFO ][test-runner-#4158%persistence.CheckpointReadLockFailureTest%][root] Successfully bound to TCP port [port=47500, localHost=localhost/127.0.0.1, locNodeId=6c5d0b26-7b60-4c96-aee9-1ef5b1300000] [21:02:55] : [Step 4/5] [2021-11-19 21:02:55,001][INFO ][test-runner-#4158%persistence.CheckpointReadLockFailureTest%][root] Successfully created new persistent storage folder [/opt/buildagent/work/7bc1c54bc719b67c/work/db/node00-690f920f-e2de-4d57-a23b-37e277d3f7f9] [21:02:55] : [Step 4/5] [2021-11-19 21:02:55,001][INFO ][test-runner-#4158%persistence.CheckpointReadLockFailureTest%][root] Consistent ID used for local node is [690f920f-e2de-4d57-a23b-37e277d3f7f9] according to persistence data storage folders [21:02:55] : [Step 4/5] [2021-11-19 21:02:55,002][INFO ][test-runner-#4158%persistence.CheckpointReadLockFailureTest%][root] Resolved store directory for node persistent data: /opt/buildagent/work/7bc1c54bc719b67c/work/db/node00-690f920f-e2de-4d57-a23b-37e277d3f7f9 [21:02:55] : [Step 4/5] [2021-11-19 21:02:55,003][INFO ][test-runner-#4158%persistence.CheckpointReadLockFailureTest%][root] Resolved directory for serialized binary metadata: /opt/buildagent/work/7bc1c54bc719b67c/work/db/binary_meta/node00-690f920f-e2de-4d57-a23b-37e277d3f7f9 [21:02:55] : [Step 4/5] [2021-11-19 21:02:55,008][INFO ][test-runner-#4158%persistence.CheckpointReadLockFailureTest%][root] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/node00-690f920f-e2de-4d57-a23b-37e277d3f7f9 [21:02:55] : [Step 4/5] [2021-11-19 21:02:55,009][INFO ][test-runner-#4158%persistence.CheckpointReadLockFailureTest%][root] Resolved write ahead log work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/node00-690f920f-e2de-4d57-a23b-37e277d3f7f9 [21:02:55] : [Step 4/5] [2021-11-19 21:02:55,009][INFO ][test-runner-#4158%persistence.CheckpointReadLockFailureTest%][root] Resolved write ahead log archive directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/node00-690f920f-e2de-4d57-a23b-37e277d3f7f9 [21:02:55] : [Step 4/5] [2021-11-19 21:02:55,766][INFO ][test-runner-#4158%persistence.CheckpointReadLockFailureTest%][root] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/node00-690f920f-e2de-4d57-a23b-37e277d3f7f9/0000000000000000.wal [21:02:55] : [Step 4/5] [2021-11-19 21:02:55,766][INFO ][test-runner-#4158%persistence.CheckpointReadLockFailureTest%][root] Initialized write-ahead log manager [mode=LOG_ONLY] [21:02:55] : [Step 4/5] [2021-11-19 21:02:55,771][INFO ][test-runner-#4158%persistence.CheckpointReadLockFailureTest%][root] Configured data regions initialized successfully [total=5] [21:02:55] : [Step 4/5] [2021-11-19 21:02:55,772][INFO ][test-runner-#4158%persistence.CheckpointReadLockFailureTest%][root] Resolved snapshot work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/snapshots [21:02:55] : [Step 4/5] [2021-11-19 21:02:55,772][INFO ][test-runner-#4158%persistence.CheckpointReadLockFailureTest%][root] Resolved temp directory for snapshot creation: /opt/buildagent/work/7bc1c54bc719b67c/work/db/node00-690f920f-e2de-4d57-a23b-37e277d3f7f9/snp [21:02:55] : [Step 4/5] [2021-11-19 21:02:55,775][INFO ][test-runner-#4158%persistence.CheckpointReadLockFailureTest%][root] Client connector processor has started on TCP port 10800 [21:02:55] : [Step 4/5] [2021-11-19 21:02:55,777][INFO ][test-runner-#4158%persistence.CheckpointReadLockFailureTest%][root] Non-loopback local IPs: 172.17.0.4 [21:02:55] : [Step 4/5] [2021-11-19 21:02:55,777][INFO ][test-runner-#4158%persistence.CheckpointReadLockFailureTest%][root] Enabled local MACs: 0242AC110004 [21:02:55] : [Step 4/5] [2021-11-19 21:02:55,778][INFO ][test-runner-#4158%persistence.CheckpointReadLockFailureTest%][root] Read checkpoint status [startMarker=null, endMarker=null] [21:02:55] : [Step 4/5] [2021-11-19 21:02:55,780][INFO ][test-runner-#4158%persistence.CheckpointReadLockFailureTest%][root] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:02:55] : [Step 4/5] [2021-11-19 21:02:55,780][INFO ][test-runner-#4158%persistence.CheckpointReadLockFailureTest%][root] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:02:55] : [Step 4/5] [2021-11-19 21:02:55,782][INFO ][test-runner-#4158%persistence.CheckpointReadLockFailureTest%][root] Applying lost metastore updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:02:55] : [Step 4/5] [2021-11-19 21:02:55,783][INFO ][test-runner-#4158%persistence.CheckpointReadLockFailureTest%][root] Finished applying WAL changes [updatesApplied=0, time=0 ms] [21:02:55] : [Step 4/5] [2021-11-19 21:02:55,783][INFO ][test-runner-#4158%persistence.CheckpointReadLockFailureTest%][root] Restoring partition state for local groups. [21:02:55] : [Step 4/5] [2021-11-19 21:02:55,783][INFO ][test-runner-#4158%persistence.CheckpointReadLockFailureTest%][root] Finished restoring partition state for local groups [groupsProcessed=0, partitionsProcessed=0, time=0ms] [21:02:55] : [Step 4/5] [2021-11-19 21:02:55,784][INFO ][test-runner-#4158%persistence.CheckpointReadLockFailureTest%][root] Encryption keys loaded from metastore. [grps=, masterKeyName=null] [21:02:55] : [Step 4/5] [2021-11-19 21:02:55,785][INFO ][test-runner-#4158%persistence.CheckpointReadLockFailureTest%][root] Cluster ID and tag has been read from metastorage: null [21:02:55] : [Step 4/5] [2021-11-19 21:02:55,786][INFO ][test-runner-#4158%persistence.CheckpointReadLockFailureTest%][root] Shutdown policy was updated [oldVal=null, newVal=null] [21:02:55] : [Step 4/5] [2021-11-19 21:02:55,786][INFO ][test-runner-#4158%persistence.CheckpointReadLockFailureTest%][root] Checkpoint frequency deviation changed [oldVal=null, newVal=null] [21:02:55] : [Step 4/5] [2021-11-19 21:02:55,796][INFO ][test-runner-#4158%persistence.CheckpointReadLockFailureTest%][root] Cleanup cache stores [total=1, left=0, cleanFiles=false] [21:02:55] : [Step 4/5] [2021-11-19 21:02:55,799][INFO ][test-runner-#4158%persistence.CheckpointReadLockFailureTest%][root] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:02:55] : [Step 4/5] [2021-11-19 21:02:55,800][INFO ][test-runner-#4158%persistence.CheckpointReadLockFailureTest%][root] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:02:55] : [Step 4/5] [2021-11-19 21:02:55,801][INFO ][test-runner-#4158%persistence.CheckpointReadLockFailureTest%][root] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:02:55] : [Step 4/5] [2021-11-19 21:02:55,802][INFO ][test-runner-#4158%persistence.CheckpointReadLockFailureTest%][root] Data Regions Started: 5 [21:02:55] : [Step 4/5] [2021-11-19 21:02:55,802][INFO ][test-runner-#4158%persistence.CheckpointReadLockFailureTest%][root] ^-- sysMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:02:55] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:02:55] : [Step 4/5] ^-- default region [type=default, persistence=true, lazyAlloc=true, [21:02:55] : [Step 4/5] ... initCfg=256MB, maxCfg=256MB, usedRam=0MB, freeRam=100%, allocRam=0MB, allocTotal=0MB] [21:02:55] : [Step 4/5] ^-- metastoreMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:02:55] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:02:55] : [Step 4/5] ^-- TxLog region [type=internal, persistence=true, lazyAlloc=false, [21:02:55] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:02:55] : [Step 4/5] ^-- volatileDsMemPlc region [type=user, persistence=false, lazyAlloc=true, [21:02:55] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB] [21:02:55] : [Step 4/5] ^-- Ignite persistence [used=0MB] [21:02:55] : [Step 4/5] [21:02:55] : [Step 4/5] [2021-11-19 21:02:55,803][INFO ][test-runner-#4158%persistence.CheckpointReadLockFailureTest%][root] Starting binary memory restore for: [-2100569601] [21:02:55] : [Step 4/5] [2021-11-19 21:02:55,811][INFO ][test-runner-#4158%persistence.CheckpointReadLockFailureTest%][root] Read checkpoint status [startMarker=null, endMarker=null] [21:02:55] : [Step 4/5] [2021-11-19 21:02:55,811][INFO ][test-runner-#4158%persistence.CheckpointReadLockFailureTest%][root] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:02:55] : [Step 4/5] [2021-11-19 21:02:55,813][INFO ][test-runner-#4158%persistence.CheckpointReadLockFailureTest%][root] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/node00-690f920f-e2de-4d57-a23b-37e277d3f7f9/0000000000000000.wal, offset=0, ver=2] [21:02:55] : [Step 4/5] [2021-11-19 21:02:55,816][INFO ][test-runner-#4158%persistence.CheckpointReadLockFailureTest%][root] Started cache in recovery mode [name=ignite-sys-cache, id=-2100569601, dataRegionName=sysMemPlc, mode=REPLICATED, atomicity=TRANSACTIONAL, backups=2147483647, mvcc=false] [21:02:55] : [Step 4/5] [2021-11-19 21:02:55,817][INFO ][test-runner-#4158%persistence.CheckpointReadLockFailureTest%][root] Binary recovery performed in 14 ms. [21:02:55] : [Step 4/5] [2021-11-19 21:02:55,817][INFO ][test-runner-#4158%persistence.CheckpointReadLockFailureTest%][root] Read checkpoint status [startMarker=null, endMarker=null] [21:02:55] : [Step 4/5] [2021-11-19 21:02:55,817][INFO ][test-runner-#4158%persistence.CheckpointReadLockFailureTest%][root] Applying lost cache updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:02:55] : [Step 4/5] [2021-11-19 21:02:55,892][INFO ][test-runner-#4158%persistence.CheckpointReadLockFailureTest%][root] Finished applying WAL changes [updatesApplied=0, time=81 ms] [21:02:55] : [Step 4/5] [2021-11-19 21:02:55,892][INFO ][test-runner-#4158%persistence.CheckpointReadLockFailureTest%][root] Restoring partition state for local groups. [21:02:55] : [Step 4/5] [2021-11-19 21:02:55,903][INFO ][test-runner-#4158%persistence.CheckpointReadLockFailureTest%][root] Finished restoring partition state for local groups [groupsProcessed=1, partitionsProcessed=100, time=10ms] [21:02:56] : [Step 4/5] [2021-11-19 21:02:56,630][INFO ][disco-notifier-worker-#4270%persistence.CheckpointReadLockFailureTest0%][root] Assigned mvcc coordinator [crd=MvccCoordinator [topVer=AffinityTopologyVersion [topVer=1, minorTopVer=0], nodeId=6c5d0b26-7b60-4c96-aee9-1ef5b1300000, ver=1637344976628, local=true, initialized=false]] [21:02:56] : [Step 4/5] [2021-11-19 21:02:56,631][INFO ][sys-#4247%persistence.CheckpointReadLockFailureTest0%][root] Writing cluster ID and tag to metastorage on ready for write ClusterIdAndTag [id=ed8d5a48-36c4-4235-8ea2-01a2013d0d53, tag=focused_gagarin] [21:02:56] : [Step 4/5] [2021-11-19 21:02:56,633][INFO ][disco-notifier-worker-#4270%persistence.CheckpointReadLockFailureTest0%][root] Baseline parameter 'baselineAutoAdjustEnabled' was changed from 'null' to 'false' [21:02:56] : [Step 4/5] [2021-11-19 21:02:56,634][INFO ][disco-notifier-worker-#4270%persistence.CheckpointReadLockFailureTest0%][root] Baseline parameter 'baselineAutoAdjustTimeout' was changed from 'null' to '300000' [21:02:56] : [Step 4/5] [2021-11-19 21:02:56,635][INFO ][disco-notifier-worker-#4270%persistence.CheckpointReadLockFailureTest0%][root] focused_gagarin [21:02:56] : [Step 4/5] [2021-11-19 21:02:56,636][INFO ][disco-notifier-worker-#4270%persistence.CheckpointReadLockFailureTest0%][root] Transactions parameter 'longOperationsDumpTimeout' was changed from 'null' to '60000' [21:02:56] : [Step 4/5] [2021-11-19 21:02:56,636][INFO ][disco-notifier-worker-#4270%persistence.CheckpointReadLockFailureTest0%][root] Transactions parameter 'longTransactionTimeDumpThreshold' was changed from 'null' to '0' [21:02:56] : [Step 4/5] [2021-11-19 21:02:56,637][INFO ][disco-notifier-worker-#4270%persistence.CheckpointReadLockFailureTest0%][root] Transactions parameter 'transactionTimeDumpSamplesCoefficient' was changed from 'null' to '0.0' [21:02:56] : [Step 4/5] [2021-11-19 21:02:56,638][INFO ][disco-notifier-worker-#4270%persistence.CheckpointReadLockFailureTest0%][root] Transactions parameter 'longTransactionTimeDumpSamplesPerSecondLimit' was changed from 'null' to '5' [21:02:56] : [Step 4/5] [2021-11-19 21:02:56,639][INFO ][disco-notifier-worker-#4270%persistence.CheckpointReadLockFailureTest0%][root] Transactions parameter 'collisionsDumpInterval' was changed from 'null' to '1000' [21:02:56] : [Step 4/5] [2021-11-19 21:02:56,640][INFO ][disco-notifier-worker-#4270%persistence.CheckpointReadLockFailureTest0%][root] Transactions parameter 'txOwnerDumpRequestsAllowed' was changed from 'null' to 'true' [21:02:56] : [Step 4/5] [2021-11-19 21:02:56,640][INFO ][disco-notifier-worker-#4270%persistence.CheckpointReadLockFailureTest0%][root] Historical rebalance WAL threshold changed [property=historical.rebalance.threshold, oldVal=null, newVal=500] [21:02:56] : [Step 4/5] [2021-11-19 21:02:56,665][INFO ][test-runner-#4158%persistence.CheckpointReadLockFailureTest%][root] To start Console Management & Monitoring run ignitevisorcmd.{sh|bat} [21:02:56] : [Step 4/5] [2021-11-19 21:02:56,666][INFO ][test-runner-#4158%persistence.CheckpointReadLockFailureTest%][root] [21:02:56] : [Step 4/5] [21:02:56] : [Step 4/5] >>> +-------------------------------------------+ [21:02:56] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:02:56] : [Step 4/5] >>> +-------------------------------------------+ [21:02:56] : [Step 4/5] >>> OS name: Linux 4.15.0-151-generic amd64 [21:02:56] : [Step 4/5] >>> CPU(s): 24 [21:02:56] : [Step 4/5] >>> Heap: 2.0GB [21:02:56] : [Step 4/5] >>> VM name: 16724@c4dfe9a430b2 [21:02:56] : [Step 4/5] >>> Ignite instance name: persistence.CheckpointReadLockFailureTest0 [21:02:56] : [Step 4/5] >>> Local node [ID=6C5D0B26-7B60-4C96-AEE9-1EF5B1300000, order=1, clientMode=false] [21:02:56] : [Step 4/5] >>> Local node addresses: [127.0.0.1] [21:02:56] : [Step 4/5] >>> Local ports: TCP:10800 TCP:45070 TCP:47500 [21:02:56] : [Step 4/5] [21:02:56] : [Step 4/5] [2021-11-19 21:02:56,667][INFO ][test-runner-#4158%persistence.CheckpointReadLockFailureTest%][root] >>> Ignite cluster is in INACTIVE state (limited functionality available). Use control.(sh|bat) script or IgniteCluster.state(ClusterState.ACTIVE) to change the state. [21:02:56] : [Step 4/5] [2021-11-19 21:02:56,668][INFO ][test-runner-#4158%persistence.CheckpointReadLockFailureTest%][root] Topology snapshot [ver=1, locNode=6c5d0b26, servers=1, clients=0, state=INACTIVE, CPUs=24, offheap=0.25GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=6c5d0b26-7b60-4c96-aee9-1ef5b1300000, consistentId=690f920f-e2de-4d57-a23b-37e277d3f7f9, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:02:56] : [Step 4/5] [2021-11-19 21:02:56,669][INFO ][test-runner-#4158%persistence.CheckpointReadLockFailureTest%][root] Node started : [stage="Configure system pool" (0 ms),stage="Start managers" (61 ms),stage="Configure binary metadata" (2 ms),stage="Start processors" (771 ms),stage="Start 'StanByClusterTestProvider' plugin" (0 ms),stage="Start 'PageMemory tracker plugin' plugin" (0 ms),stage="Start 'TestDistibutedConfigurationPlugin' plugin" (0 ms),stage="Start 'NodeValidationPluginProvider' plugin" (0 ms),stage="Init metastore" (19 ms),stage="Init and start regions" (7 ms),stage="Restore binary memory" (13 ms),stage="Restore logical state" (86 ms),stage="Finish recovery" (720 ms),stage="Join topology" (5 ms),stage="Await transition" (3 ms),stage="Await exchange" (35 ms),stage="Total time" (1722 ms)] [21:02:56] : [Step 4/5] [2021-11-19 21:02:56,670][INFO ][test-runner-#4158%persistence.CheckpointReadLockFailureTest%][root] Node started with the following configuration [id=6c5d0b26-7b60-4c96-aee9-1ef5b1300000, marshaller=BinaryMarshaller [], discovery=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=5000, ackTimeout=5000, marsh=JdkMarshaller [clsFilter=org.apache.ignite.marshaller.MarshallerUtils$1@4c6b8434], reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], binaryCfg=null, lateAff=true] [21:02:56] : [Step 4/5] [2021-11-19 21:02:56,672][INFO ][test-runner-#4158%persistence.CheckpointReadLockFailureTest%][root] Sending activate cluster request with BaselineTopology BaselineTopology [id=0, branchingHash=1580801859, branchingType='New BaselineTopology', baselineNodes=[690f920f-e2de-4d57-a23b-37e277d3f7f9]] [21:02:56] : [Step 4/5] [2021-11-19 21:02:56,673][INFO ][disco-notifier-worker-#4270%persistence.CheckpointReadLockFailureTest0%][root] Received activate cluster request with BaselineTopology[id=0] initiator node ID: 6c5d0b26-7b60-4c96-aee9-1ef5b1300000 [21:02:56] : [Step 4/5] [2021-11-19 21:02:56,673][INFO ][disco-notifier-worker-#4270%persistence.CheckpointReadLockFailureTest0%][root] Started state transition: activate cluster [21:02:56] : [Step 4/5] [2021-11-19 21:02:56,675][INFO ][exchange-worker-#4275%persistence.CheckpointReadLockFailureTest0%][root] Started exchange init [topVer=AffinityTopologyVersion [topVer=1, minorTopVer=1], crd=true, evt=DISCOVERY_CUSTOM_EVT, evtNode=6c5d0b26-7b60-4c96-aee9-1ef5b1300000, customEvt=ChangeGlobalStateMessage [id=5dcac593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqId=daa9e746-4ae1-48cd-800c-f625bbb91b1d, initiatingNodeId=6c5d0b26-7b60-4c96-aee9-1ef5b1300000, state=ACTIVE, baselineTopology=BaselineTopology [id=0, branchingHash=1580801859, branchingType='New BaselineTopology', baselineNodes=[690f920f-e2de-4d57-a23b-37e277d3f7f9]], forceChangeBaselineTopology=false, timestamp=1637344976672, forceDeactivation=true], allowMerge=false, exchangeFreeSwitch=false] [21:02:56] : [Step 4/5] [2021-11-19 21:02:56,676][INFO ][exchange-worker-#4275%persistence.CheckpointReadLockFailureTest0%][root] Start activation process [nodeId=6c5d0b26-7b60-4c96-aee9-1ef5b1300000, client=false, topVer=AffinityTopologyVersion [topVer=1, minorTopVer=1]]. New state: ACTIVE [21:02:56] : [Step 4/5] [2021-11-19 21:02:56,677][INFO ][exchange-worker-#4275%persistence.CheckpointReadLockFailureTest0%][root] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/node00-690f920f-e2de-4d57-a23b-37e277d3f7f9 [21:02:56] : [Step 4/5] [2021-11-19 21:02:56,679][INFO ][exchange-worker-#4275%persistence.CheckpointReadLockFailureTest0%][root] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/node00-690f920f-e2de-4d57-a23b-37e277d3f7f9/0000000000000000.wal, offset=8795, ver=2] [21:02:56] : [Step 4/5] [2021-11-19 21:02:56,680][INFO ][exchange-worker-#4275%persistence.CheckpointReadLockFailureTest0%][root] Writing BaselineTopology[id=0] [21:02:56] : [Step 4/5] [2021-11-19 21:02:56,684][INFO ][exchange-worker-#4275%persistence.CheckpointReadLockFailureTest0%][root] Finish recovery performed in 6 ms. [21:02:56] : [Step 4/5] [2021-11-19 21:02:56,688][INFO ][exchange-worker-#4275%persistence.CheckpointReadLockFailureTest0%][root] Components activation performed in 11 ms. [21:02:56] : [Step 4/5] [2021-11-19 21:02:56,690][INFO ][exchange-worker-#4275%persistence.CheckpointReadLockFailureTest0%][root] Finished recovery for cache [cache=ignite-sys-cache, grp=ignite-sys-cache, startVer=AffinityTopologyVersion [topVer=1, minorTopVer=1]] [21:02:56] : [Step 4/5] [2021-11-19 21:02:56,691][INFO ][exchange-worker-#4275%persistence.CheckpointReadLockFailureTest0%][root] Successfully activated caches [nodeId=6c5d0b26-7b60-4c96-aee9-1ef5b1300000, client=false, topVer=AffinityTopologyVersion [topVer=1, minorTopVer=1], newState=ACTIVE] [21:02:56] : [Step 4/5] [2021-11-19 21:02:56,692][INFO ][exchange-worker-#4275%persistence.CheckpointReadLockFailureTest0%][root] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=1, minorTopVer=1], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:02:56] : [Step 4/5] [2021-11-19 21:02:56,717][INFO ][exchange-worker-#4275%persistence.CheckpointReadLockFailureTest0%][root] finishExchangeOnCoordinator [topVer=AffinityTopologyVersion [topVer=1, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=1, minorTopVer=1]] [21:02:56] : [Step 4/5] [2021-11-19 21:02:56,720][INFO ][db-checkpoint-thread-#4282%persistence.CheckpointReadLockFailureTest0%][root] Checkpoint started [checkpointId=7c194673-35ab-4f41-b17b-fac45be6fbee, startPtr=WALPointer [idx=0, fileOff=66555, len=1963], checkpointBeforeLockTime=10ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=8ms, walCpRecordFsyncDuration=1ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=0ms, pages=16, reason='node started'] [21:02:56] : [Step 4/5] [2021-11-19 21:02:56,722][INFO ][disco-notifier-worker-#4270%persistence.CheckpointReadLockFailureTest0%][root] Received state change finish message: ACTIVE [21:02:56] : [Step 4/5] [2021-11-19 21:02:56,725][INFO ][disco-notifier-worker-#4270%persistence.CheckpointReadLockFailureTest0%][root] Cluster state was changed from INACTIVE to ACTIVE [21:02:56] : [Step 4/5] [2021-11-19 21:02:56,722][INFO ][exchange-worker-#4275%persistence.CheckpointReadLockFailureTest0%][root] Finish exchange future [startVer=AffinityTopologyVersion [topVer=1, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=1, minorTopVer=1], err=null, rebalanced=true, wasRebalanced=false] [21:02:56] : [Step 4/5] [2021-11-19 21:02:56,729][INFO ][exchange-worker-#4275%persistence.CheckpointReadLockFailureTest0%][root] Finish proxy initialization, cacheName=ignite-sys-cache, localNodeId=6c5d0b26-7b60-4c96-aee9-1ef5b1300000 [21:02:56] : [Step 4/5] [2021-11-19 21:02:56,730][INFO ][sys-#4267%persistence.CheckpointReadLockFailureTest0%][root] Baseline auto-adjust is 'disabled' with timeout='300000' ms [21:02:56] : [Step 4/5] [2021-11-19 21:02:56,731][INFO ][exchange-worker-#4275%persistence.CheckpointReadLockFailureTest0%][root] Completed partition exchange [localNode=6c5d0b26-7b60-4c96-aee9-1ef5b1300000, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=1, minorTopVer=1], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=6c5d0b26-7b60-4c96-aee9-1ef5b1300000, consistentId=690f920f-e2de-4d57-a23b-37e277d3f7f9, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637344976617, loc=true, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=1, minorTopVer=1]] [21:02:56] : [Step 4/5] [2021-11-19 21:02:56,731][INFO ][sys-#4267%persistence.CheckpointReadLockFailureTest0%][root] Successfully performed final activation steps [nodeId=6c5d0b26-7b60-4c96-aee9-1ef5b1300000, client=false, topVer=AffinityTopologyVersion [topVer=1, minorTopVer=1]] [21:02:56] : [Step 4/5] [2021-11-19 21:02:56,733][INFO ][exchange-worker-#4275%persistence.CheckpointReadLockFailureTest0%][root] Exchange timings [startVer=AffinityTopologyVersion [topVer=1, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=1, minorTopVer=1], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (1 ms), stage="Update caches registry" (12 ms), stage="Start caches" (0 ms), stage="Affinity initialization on cache group start" (0 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Restore partition states" (0 ms), stage="After states restored callback" (24 ms), stage="WAL history reservation" (0 ms), stage="Waiting for all single messages" (0 ms), stage="Affinity recalculation (crd)" (0 ms), stage="Collect update counters and create affinity messages" (0 ms), stage="Assign partitions states" (0 ms), stage="Validate partitions states" (0 ms), stage="Ideal affinity diff calculation (enforced)" (0 ms), stage="Apply update counters" (0 ms), stage="Full message preparing" (2 ms), stage="Full message sending" (0 ms), stage="State finish message sending" (0 ms), stage="Detect lost partitions" (6 ms), stage="Exchange done" (4 ms), stage="Total time" (49 ms)] [21:02:56] : [Step 4/5] [2021-11-19 21:02:56,738][INFO ][exchange-worker-#4275%persistence.CheckpointReadLockFailureTest0%][root] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=1, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=1, minorTopVer=1], stage="Affinity initialization on cache group start [grp=ignite-sys-cache]" (0 ms) (parent=Affinity initialization on cache group start), stage="Affinity centralized initialization (crd) [grp=ignite-sys-cache, crd=true]" (0 ms) (parent=Determine exchange type), stage="Restore partition states [grp=ignite-sys-cache]" (0 ms) (parent=Restore partition states), stage="Affinity recalculation (partitions availability) [grp=ignite-sys-cache]" (0 ms) (parent=Ideal affinity diff calculation (enforced))] [21:02:56] : [Step 4/5] [2021-11-19 21:02:56,740][INFO ][exchange-worker-#4275%persistence.CheckpointReadLockFailureTest0%][root] Finished exchange init [topVer=AffinityTopologyVersion [topVer=1, minorTopVer=1], crd=true] [21:02:56] : [Step 4/5] [2021-11-19 21:02:56,741][INFO ][exchange-worker-#4275%persistence.CheckpointReadLockFailureTest0%][root] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=1, minorTopVer=1], force=false, evt=DISCOVERY_CUSTOM_EVT, node=6c5d0b26-7b60-4c96-aee9-1ef5b1300000] [21:02:56] : [Step 4/5] [2021-11-19 21:02:56,747][INFO ][db-checkpoint-thread-#4282%persistence.CheckpointReadLockFailureTest0%][root] Checkpoint finished [cpId=7c194673-35ab-4f41-b17b-fac45be6fbee, pages=16, markPos=WALPointer [idx=0, fileOff=66555, len=1963], walSegmentsCovered=[], markDuration=16ms, pagesWrite=4ms, fsync=18ms, total=48ms] [21:03:02]W: [org.apache.ignite:ignite-core] [2021-11-19 21:03:02,238][WARN ][async-runnable-runner-1-1][root] ReadLock held the lock more than 5497 ms. [21:03:02]W: [org.apache.ignite:ignite-core] Thread [name="async-runnable-runner-1-1", id=4428, state=RUNNABLE, blockCnt=0, waitCnt=1] [21:03:02]W: [org.apache.ignite:ignite-core] at sun.management.ThreadImpl.getThreadInfo1(Native Method) [21:03:02]W: [org.apache.ignite:ignite-core] at sun.management.ThreadImpl.getThreadInfo(ThreadImpl.java:176) [21:03:02]W: [org.apache.ignite:ignite-core] at sun.management.ThreadImpl.getThreadInfo(ThreadImpl.java:139) [21:03:02]W: [org.apache.ignite:ignite-core] at o.a.i.i.util.IgniteUtils.printStackTrace(IgniteUtils.java:1551) [21:03:02]W: [org.apache.ignite:ignite-core] at o.a.i.i.util.ReentrantReadWriteLockWithTracking$ReadLockWithTracking.dec(ReentrantReadWriteLockWithTracking.java:164) [21:03:02]W: [org.apache.ignite:ignite-core] at o.a.i.i.util.ReentrantReadWriteLockWithTracking$ReadLockWithTracking.unlock(ReentrantReadWriteLockWithTracking.java:215) [21:03:02]W: [org.apache.ignite:ignite-core] at o.a.i.i.processors.cache.persistence.checkpoint.CheckpointReadWriteLock.readUnlock(CheckpointReadWriteLock.java:112) [21:03:02]W: [org.apache.ignite:ignite-core] at o.a.i.i.processors.cache.persistence.CheckpointReadLockFailureTest.lambda$testPrintCpRLockHolder$2(CheckpointReadLockFailureTest.java:199) [21:03:02]W: [org.apache.ignite:ignite-core] at o.a.i.i.processors.cache.persistence.CheckpointReadLockFailureTest$$Lambda$1107/178691570.run(Unknown Source) [21:03:02]W: [org.apache.ignite:ignite-core] at o.a.i.testframework.GridTestUtils.lambda$runAsync$2(GridTestUtils.java:1135) [21:03:02]W: [org.apache.ignite:ignite-core] at o.a.i.testframework.GridTestUtils$$Lambda$1099/2142494208.call(Unknown Source) [21:03:02]W: [org.apache.ignite:ignite-core] at o.a.i.testframework.GridTestUtils.lambda$runAsync$3(GridTestUtils.java:1191) [21:03:02]W: [org.apache.ignite:ignite-core] at o.a.i.testframework.GridTestUtils$$Lambda$1100/223287233.run(Unknown Source) [21:03:02]W: [org.apache.ignite:ignite-core] at o.a.i.testframework.GridTestUtils$7.call(GridTestUtils.java:1512) [21:03:02]W: [org.apache.ignite:ignite-core] at o.a.i.testframework.GridTestThread.run(GridTestThread.java:88) [21:03:02]W: [org.apache.ignite:ignite-core] [21:03:02] : [Step 4/5] [2021-11-19 21:03:02,339][INFO ][test-runner-#4158%persistence.CheckpointReadLockFailureTest%][root] >>> Stopping grid [name=persistence.CheckpointReadLockFailureTest0, id=6c5d0b26-7b60-4c96-aee9-1ef5b1300000] [21:03:02] : [Step 4/5] [2021-11-19 21:03:02,344][INFO ][db-checkpoint-thread-#4282%persistence.CheckpointReadLockFailureTest0%][root] Skipping checkpoint (no pages were modified) [checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=1ms, checkpointLockHoldTime=1ms, reason='timeout'] [21:03:02] : [Step 4/5] [2021-11-19 21:03:02,345][INFO ][db-checkpoint-thread-#4282%persistence.CheckpointReadLockFailureTest0%][root] Skipping checkpoint (no pages were modified) [checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, reason='timeout'] [21:03:02] : [Step 4/5] [2021-11-19 21:03:02,351][INFO ][test-runner-#4158%persistence.CheckpointReadLockFailureTest%][root] Stopped cache [cacheName=ignite-sys-cache] [21:03:02] : [Step 4/5] [2021-11-19 21:03:02,353][INFO ][test-runner-#4158%persistence.CheckpointReadLockFailureTest%][root] Cleanup cache stores [total=3, left=0, cleanFiles=false] [21:03:02] : [Step 4/5] [2021-11-19 21:03:02,366][INFO ][test-runner-#4158%persistence.CheckpointReadLockFailureTest%][root] [21:03:02] : [Step 4/5] [21:03:02] : [Step 4/5] >>> +------------------------------------------------------+ [21:03:02] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV stopped OK [21:03:02] : [Step 4/5] >>> +------------------------------------------------------+ [21:03:02] : [Step 4/5] >>> Ignite instance name: persistence.CheckpointReadLockFailureTest0 [21:03:02] : [Step 4/5] >>> Grid uptime: 00:00:05.700 [21:03:02] : [Step 4/5] [21:03:02] : [Step 4/5] [21:03:02] : [Step 4/5] [21:03:02] >>> Stopping test: CheckpointReadLockFailureTest#testPrintCpRLockHolder in 7601 ms <<< [21:03:02] : [Step 4/5] [2021-11-19 21:03:02,526][INFO ][main][root] >>> Stopping test: CheckpointReadLockFailureTest#testPrintCpRLockHolder in 7601 ms <<< [21:03:02] : [Step 4/5] [21:03:02] >>> Heap: 602 MB used / 1944 MB commited / 1944 MB max <<< [21:03:02] : [Step 4/5] [2021-11-19 21:03:02,527][INFO ][main][root] >>> Heap: 602 MB used / 1944 MB commited / 1944 MB max <<< [21:03:02] : [Step 4/5] [21:03:02] >>> Non-Heap: 118 MB used / 126 MB commited / 0 MB max <<< [21:03:02] : [Step 4/5] [2021-11-19 21:03:02,527][INFO ][main][root] >>> Non-Heap: 118 MB used / 126 MB commited / 0 MB max <<< [21:03:02] : [Step 4/5] [21:03:02] >>> Stopping test class: CheckpointReadLockFailureTest <<< [21:03:02] : [Step 4/5] [2021-11-19 21:03:02,528][INFO ][main][root] >>> Stopping test class: CheckpointReadLockFailureTest <<< [21:03:02] : [Step 4/5] [21:03:02] >>> Starting test class: CommonPoolStarvationCheckpointTest <<< [21:03:02] : [Step 4/5] [2021-11-19 21:03:02,528][INFO ][main][root] >>> Starting test class: CommonPoolStarvationCheckpointTest <<< [21:03:02] : [Step 4/5] Running org.apache.ignite.internal.processors.cache.persistence.CommonPoolStarvationCheckpointTest [21:03:02]i: [Step 4/5] ##teamcity[importData type='surefire' path='/opt/buildagent/temp/buildTmp/ignite-tools-junit-reports1777670380320881607/test-org.apache.ignite.testsuites.IgniteBasicWithPersistenceTestSuite1637344966673.xml'] [21:03:02] : [Step 4/5] Importing data from '/opt/buildagent/temp/buildTmp/ignite-tools-junit-reports1777670380320881607/test-org.apache.ignite.testsuites.IgniteBasicWithPersistenceTestSuite1637344966673.xml' (765 B) with 'surefire' processor [21:03:02] : [Step 4/5] [21:03:02] >>> Starting test: CommonPoolStarvationCheckpointTest#testCommonPoolStarvation <<< [21:03:02] : [Step 4/5] [2021-11-19 21:03:02,541][INFO ][main][root] >>> Starting test: CommonPoolStarvationCheckpointTest#testCommonPoolStarvation <<< [21:03:02] : [Step 4/5] [21:03:02] >>> Heap: 606 MB used / 1944 MB commited / 1944 MB max <<< [21:03:02] : [Step 4/5] [2021-11-19 21:03:02,541][INFO ][main][root] >>> Heap: 606 MB used / 1944 MB commited / 1944 MB max <<< [21:03:02] : [Step 4/5] [21:03:02] >>> Non-Heap: 118 MB used / 126 MB commited / 0 MB max <<< [21:03:02] : [Step 4/5] [2021-11-19 21:03:02,542][INFO ][main][root] >>> Non-Heap: 118 MB used / 126 MB commited / 0 MB max <<< [21:03:02]W: [org.apache.ignite:ignite-core] [2021-11-19 21:03:02,558][WARN ][test-runner-#4291%persistence.CommonPoolStarvationCheckpointTest%][G] Ignite work directory is not provided, automatically resolved to: /opt/buildagent/work/7bc1c54bc719b67c/work [21:03:02] : [Step 4/5] [2021-11-19 21:03:02,562][INFO ][test-runner-#4291%persistence.CommonPoolStarvationCheckpointTest%][CommonPoolStarvationCheckpointTest0] [21:03:02] : [Step 4/5] [21:03:02] : [Step 4/5] >>> __________ ________________ [21:03:02] : [Step 4/5] >>> / _/ ___/ |/ / _/_ __/ __/ [21:03:02] : [Step 4/5] >>> _/ // (7 7 // / / / / _/ [21:03:02] : [Step 4/5] >>> /___/\___/_/|_/___/ /_/ /___/ [21:03:02] : [Step 4/5] >>> [21:03:02] : [Step 4/5] >>> ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:03:02] : [Step 4/5] >>> 2021 Copyright(C) Apache Software Foundation [21:03:02] : [Step 4/5] >>> [21:03:02] : [Step 4/5] >>> Ignite documentation: http://ignite.apache.org [21:03:02] : [Step 4/5] [21:03:02] : [Step 4/5] [2021-11-19 21:03:02,563][INFO ][test-runner-#4291%persistence.CommonPoolStarvationCheckpointTest%][CommonPoolStarvationCheckpointTest0] Config URL: n/a [21:03:02] : [Step 4/5] [2021-11-19 21:03:02,564][INFO ][test-runner-#4291%persistence.CommonPoolStarvationCheckpointTest%][CommonPoolStarvationCheckpointTest0] IgniteConfiguration [igniteInstanceName=persistence.CommonPoolStarvationCheckpointTest0, pubPoolSize=24, svcPoolSize=24, callbackPoolSize=24, stripedPoolSize=24, sysPoolSize=24, mgmtPoolSize=4, dataStreamerPoolSize=24, utilityCachePoolSize=24, utilityCacheKeepAliveTime=60000, p2pPoolSize=2, qryPoolSize=24, buildIdxPoolSize=4, igniteHome=/opt/buildagent/work/7bc1c54bc719b67c, igniteWorkDir=/opt/buildagent/work/7bc1c54bc719b67c/work, mbeanSrv=com.sun.jmx.mbeanserver.JmxMBeanServer@6fe85038, nodeId=ae6a9703-5c6d-4b00-94d8-300661c00000, marsh=BinaryMarshaller [], marshLocJobs=false, daemon=false, p2pEnabled=true, netTimeout=10000, netCompressionLevel=1, sndRetryDelay=1000, sndRetryCnt=3, metricsHistSize=10000, metricsUpdateFreq=1000, metricsExpTime=9223372036854775807, discoSpi=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=0, ackTimeout=0, marsh=null, reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], segPlc=STOP, segResolveAttempts=2, waitForSegOnStart=true, allResolversPassReq=true, segChkFreq=10000, commSpi=TcpCommunicationSpi [connectGate=org.apache.ignite.spi.communication.tcp.internal.ConnectGateway@48429d20, ctxInitLatch=java.util.concurrent.CountDownLatch@feecfa2[Count = 1], stopping=false, clientPool=null, nioSrvWrapper=null, stateProvider=null], evtSpi=MemoryEventStorageSpi [expireAgeMs=9223372036854775807, expireCnt=10000, filter=null], colSpi=NoopCollisionSpi [], deploySpi=LocalDeploymentSpi [], indexingSpi=org.apache.ignite.spi.indexing.noop.NoopIndexingSpi@6ddba068, addrRslvr=null, encryptionSpi=org.apache.ignite.spi.encryption.noop.NoopEncryptionSpi@7a63bd1, tracingSpi=org.apache.ignite.spi.tracing.NoopTracingSpi@79171572, clientMode=false, rebalanceThreadPoolSize=4, rebalanceTimeout=10000, rebalanceBatchesPrefetchCnt=3, rebalanceThrottle=0, rebalanceBatchSize=524288, txCfg=TransactionConfiguration [txSerEnabled=false, dfltIsolation=REPEATABLE_READ, dfltConcurrency=PESSIMISTIC, dfltTxTimeout=0, txTimeoutOnPartitionMapExchange=0, deadlockTimeout=10000, pessimisticTxLogSize=0, pessimisticTxLogLinger=10000, tmLookupClsName=null, txManagerFactory=null, useJtaSync=false], cacheSanityCheckEnabled=true, discoStartupDelay=60000, deployMode=SHARED, p2pMissedCacheSize=100, locHost=127.0.0.1, timeSrvPortBase=31100, timeSrvPortRange=100, failureDetectionTimeout=10000, sysWorkerBlockedTimeout=null, clientFailureDetectionTimeout=10000, metricsLogFreq=0, connectorCfg=null, odbcCfg=null, warmupClos=null, atomicCfg=AtomicConfiguration [seqReserveSize=1000, cacheMode=PARTITIONED, backups=1, aff=null, grpName=null], classLdr=null, sslCtxFactory=null, platformCfg=null, binaryCfg=null, memCfg=null, pstCfg=null, dsCfg=DataStorageConfiguration [sysRegionInitSize=41943040, sysRegionMaxSize=104857600, pageSize=1024, concLvl=0, dfltDataRegConf=DataRegionConfiguration [name=default, maxSize=209715200, initSize=268435456, swapPath=null, pageEvictionMode=DISABLED, pageReplacementMode=CLOCK, evictionThreshold=0.9, emptyPagesPoolSize=100, metricsEnabled=false, metricsSubIntervalCount=5, metricsRateTimeInterval=60000, persistenceEnabled=true, checkpointPageBufSize=0, lazyMemoryAllocation=true, warmUpCfg=null], dataRegions=null, storagePath=null, checkpointFreq=4611686018427387903, lockWaitTime=10000, checkpointThreads=4, checkpointWriteOrder=SEQUENTIAL, walHistSize=20, maxWalArchiveSize=1073741824, walSegments=10, walSegmentSize=67108864, walPath=db/wal, walArchivePath=db/wal/archive, cdcWalPath=db/wal/cdc, cdcEnabled=false, metricsEnabled=false, walMode=LOG_ONLY, walTlbSize=131072, walBuffSize=0, walFlushFreq=2000, walFsyncDelay=1000, walRecordIterBuffSize=67108864, alwaysWriteFullPages=false, fileIOFactory=org.apache.ignite.internal.processors.cache.persistence.file.AsyncFileIOFactory@4a3e55ab, metricsSubIntervalCnt=5, metricsRateTimeInterval=60000, walAutoArchiveAfterInactivity=-1, walForceArchiveTimeout=-1, writeThrottlingEnabled=false, walCompactionEnabled=false, walCompactionLevel=1, checkpointReadLockTimeout=null, walPageCompression=DISABLED, walPageCompressionLevel=null, dfltWarmUpCfg=null, encCfg=org.apache.ignite.configuration.EncryptionConfiguration@7c533efd, defragmentationThreadPoolSize=4, minWalArchiveSize=-1], snapshotPath=snapshots, activeOnStart=true, activeOnStartPropSetFlag=false, autoActivation=true, autoActivationPropSetFlag=false, clusterStateOnStart=null, sqlConnCfg=null, cliConnCfg=ClientConnectorConfiguration [host=null, port=10800, portRange=100, sockSndBufSize=0, sockRcvBufSize=0, tcpNoDelay=true, maxOpenCursorsPerConn=128, threadPoolSize=24, selectorCnt=12, idleTimeout=0, handshakeTimeout=10000, jdbcEnabled=true, odbcEnabled=true, thinCliEnabled=true, sslEnabled=false, useIgniteSslCtxFactory=true, sslClientAuth=false, sslCtxFactory=null, thinCliCfg=ThinClientConfiguration [maxActiveTxPerConn=100, maxActiveComputeTasksPerConn=0]], mvccVacuumThreadCnt=2, mvccVacuumFreq=5000, authEnabled=false, failureHnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]], commFailureRslvr=null, sqlCfg=SqlConfiguration [longQryWarnTimeout=3000, dfltQryTimeout=0, sqlQryHistSize=1000, validationEnabled=false], asyncContinuationExecutor=null] [21:03:02] : [Step 4/5] [2021-11-19 21:03:02,574][INFO ][test-runner-#4291%persistence.CommonPoolStarvationCheckpointTest%][CommonPoolStarvationCheckpointTest0] Daemon mode: off [21:03:02] : [Step 4/5] [2021-11-19 21:03:02,575][INFO ][test-runner-#4291%persistence.CommonPoolStarvationCheckpointTest%][CommonPoolStarvationCheckpointTest0] OS: Linux 4.15.0-151-generic amd64 [21:03:02] : [Step 4/5] [2021-11-19 21:03:02,575][INFO ][test-runner-#4291%persistence.CommonPoolStarvationCheckpointTest%][CommonPoolStarvationCheckpointTest0] OS user: teamcity [21:03:02] : [Step 4/5] [2021-11-19 21:03:02,575][INFO ][test-runner-#4291%persistence.CommonPoolStarvationCheckpointTest%][CommonPoolStarvationCheckpointTest0] PID: 16724 [21:03:02] : [Step 4/5] [2021-11-19 21:03:02,576][INFO ][test-runner-#4291%persistence.CommonPoolStarvationCheckpointTest%][CommonPoolStarvationCheckpointTest0] Language runtime: Java Platform API Specification ver. 1.8 [21:03:02] : [Step 4/5] [2021-11-19 21:03:02,576][INFO ][test-runner-#4291%persistence.CommonPoolStarvationCheckpointTest%][CommonPoolStarvationCheckpointTest0] VM information: Java(TM) SE Runtime Environment 1.8.0_261-b12 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 25.261-b12 [21:03:02] : [Step 4/5] [2021-11-19 21:03:02,576][INFO ][test-runner-#4291%persistence.CommonPoolStarvationCheckpointTest%][CommonPoolStarvationCheckpointTest0] VM total memory: 1.9GB [21:03:02] : [Step 4/5] [2021-11-19 21:03:02,577][INFO ][test-runner-#4291%persistence.CommonPoolStarvationCheckpointTest%][CommonPoolStarvationCheckpointTest0] Remote Management [restart: off, REST: off, JMX (remote: off)] [21:03:02] : [Step 4/5] [2021-11-19 21:03:02,577][INFO ][test-runner-#4291%persistence.CommonPoolStarvationCheckpointTest%][CommonPoolStarvationCheckpointTest0] Logger: GridTestLog4jLogger [quiet=false, config=null] [21:03:02] : [Step 4/5] [2021-11-19 21:03:02,577][INFO ][test-runner-#4291%persistence.CommonPoolStarvationCheckpointTest%][CommonPoolStarvationCheckpointTest0] IGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c [21:03:02] : [Step 4/5] [2021-11-19 21:03:02,578][INFO ][test-runner-#4291%persistence.CommonPoolStarvationCheckpointTest%][CommonPoolStarvationCheckpointTest0] VM arguments: [-DIGNITE_DUMP_THREADS_ON_FAILURE=false, -DMono=/usr/bin/mono-sgen, -DMono4.0_x64=/usr/lib/mono/4.0, -DMono4.5_x64=/usr/lib/mono/4.5, -DMonoVersion=6.12.0.90, -DSKIP_BUILD=false, -Dagent.home.dir=/opt/buildagent, -Dagent.name=aitc-lin02_03, -Dagent.ownPort=9090, -Dagent.work.dir=/opt/buildagent/work, -Dbuild.number=95, -Dbuild.vcs.number=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.1=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.GitHubApacheIgnite=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dclassworlds.conf=/opt/buildagent/temp/buildTmp/teamcity.m2.conf, -Dcom.jetbrains.maven.watcher.report.file=/opt/buildagent/temp/buildTmp/maven-build-info.xml, -Djava.io.tmpdir=/opt/buildagent/temp/buildTmp, -Dmaven.home=/opt/buildagent/tools/maven3_6, -Dmaven.multiModuleProjectDirectory=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.agent.cpuBenchmark=457, -Dteamcity.agent.dotnet.agent_url=http://localhost:9090/RPC2, -Dteamcity.agent.dotnet.build_id=6278078, -Dteamcity.auth.password=*******, -Dteamcity.auth.userId=TeamCityBuildId=6278078, -Dteamcity.build.changedFiles.file=/opt/buildagent/temp/buildTmp/changedFiles6342607772318147725.txt, -Dteamcity.build.checkoutDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.build.id=6278078, -Dteamcity.build.properties.file=/opt/buildagent/temp/buildTmp/teamcity.build5164517880467851002.properties, -Dteamcity.build.tempDir=/opt/buildagent/temp/buildTmp, -Dteamcity.build.workingDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.buildConfName=Basic 3, -Dteamcity.buildType.id=IgniteTests24Java8_Basic3, -Dteamcity.configuration.properties.file=/opt/buildagent/temp/buildTmp/teamcity.config5591980786735343870.properties, -Dteamcity.maven.userSettings.path=/opt/buildagent/temp/buildTmp/maven_settings_585072866407032347.xml, -Dteamcity.maven.watcher.home=/opt/buildagent/plugins/mavenPlugin/maven-watcher-jdk16, -Dteamcity.projectName=Ignite Tests 2.x (JDK 8/11), -Dteamcity.runner.properties.file=/opt/buildagent/temp/buildTmp/teamcity.runner9098465561618137420.properties, -Dteamcity.tests.recentlyFailedTests.file=/opt/buildagent/temp/buildTmp/testsToRunFirst3891775683130404069.txt, -Dteamcity.version=2021.2 (build 99542), -ea, -Xms2g, -Xmx2g, -XX:+HeapDumpOnOutOfMemoryError, -DIGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_TEST_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_UPDATE_NOTIFIER=false, -DIGNITE_NO_DISCO_ORDER=true, -DIGNITE_PERFORMANCE_SUGGESTIONS_DISABLED=true, -Djava.net.preferIPv4Stack=true, -DTEST_SCALE_FACTOR=1.0, -DIGNITE_TEST_PROP_LOG4J_FILE=log4j-tc-test.xml, -DIGNITE_QUIET=false, -DIGNITE_MARSHAL_BUFFERS_RECHECK=1000, -Dmaven.repo.local=/opt/buildagent/.m2/repository] [21:03:02] : [Step 4/5] [2021-11-19 21:03:02,582][INFO ][test-runner-#4291%persistence.CommonPoolStarvationCheckpointTest%][CommonPoolStarvationCheckpointTest0] System cache's DataRegion size is configured to 40 MB. Use DataStorageConfiguration.systemRegionInitialSize property to change the setting. [21:03:02] : [Step 4/5] [2021-11-19 21:03:02,582][INFO ][test-runner-#4291%persistence.CommonPoolStarvationCheckpointTest%][CommonPoolStarvationCheckpointTest0] Configured caches [in 'sysMemPlc' dataRegion: ['ignite-sys-cache'], in 'default' dataRegion: ['cache']] [21:03:02]W: [org.apache.ignite:ignite-core] [2021-11-19 21:03:02,583][WARN ][test-runner-#4291%persistence.CommonPoolStarvationCheckpointTest%][CommonPoolStarvationCheckpointTest0] Peer class loading is enabled (disable it in production for performance and deployment consistency reasons) [21:03:02] : [Step 4/5] [2021-11-19 21:03:02,583][INFO ][test-runner-#4291%persistence.CommonPoolStarvationCheckpointTest%][CommonPoolStarvationCheckpointTest0] 3-rd party licenses can be found at: /opt/buildagent/work/7bc1c54bc719b67c/libs/licenses [21:03:02] : [Step 4/5] [2021-11-19 21:03:02,588][INFO ][test-runner-#4291%persistence.CommonPoolStarvationCheckpointTest%][IgnitePluginProcessor] Configured plugins: [21:03:02] : [Step 4/5] [2021-11-19 21:03:02,589][INFO ][test-runner-#4291%persistence.CommonPoolStarvationCheckpointTest%][IgnitePluginProcessor] ^-- StanByClusterTestProvider 1.0 [21:03:02] : [Step 4/5] [2021-11-19 21:03:02,589][INFO ][test-runner-#4291%persistence.CommonPoolStarvationCheckpointTest%][IgnitePluginProcessor] ^-- null [21:03:02] : [Step 4/5] [2021-11-19 21:03:02,589][INFO ][test-runner-#4291%persistence.CommonPoolStarvationCheckpointTest%][IgnitePluginProcessor] [21:03:02] : [Step 4/5] [2021-11-19 21:03:02,589][INFO ][test-runner-#4291%persistence.CommonPoolStarvationCheckpointTest%][IgnitePluginProcessor] ^-- PageMemory tracker plugin 1.0 [21:03:02] : [Step 4/5] [2021-11-19 21:03:02,589][INFO ][test-runner-#4291%persistence.CommonPoolStarvationCheckpointTest%][IgnitePluginProcessor] ^-- null [21:03:02] : [Step 4/5] [2021-11-19 21:03:02,590][INFO ][test-runner-#4291%persistence.CommonPoolStarvationCheckpointTest%][IgnitePluginProcessor] [21:03:02] : [Step 4/5] [2021-11-19 21:03:02,590][INFO ][test-runner-#4291%persistence.CommonPoolStarvationCheckpointTest%][IgnitePluginProcessor] ^-- TestDistibutedConfigurationPlugin 1.0 [21:03:02] : [Step 4/5] [2021-11-19 21:03:02,590][INFO ][test-runner-#4291%persistence.CommonPoolStarvationCheckpointTest%][IgnitePluginProcessor] ^-- null [21:03:02] : [Step 4/5] [2021-11-19 21:03:02,591][INFO ][test-runner-#4291%persistence.CommonPoolStarvationCheckpointTest%][IgnitePluginProcessor] [21:03:02] : [Step 4/5] [2021-11-19 21:03:02,591][INFO ][test-runner-#4291%persistence.CommonPoolStarvationCheckpointTest%][IgnitePluginProcessor] ^-- NodeValidationPluginProvider 1.0 [21:03:02] : [Step 4/5] [2021-11-19 21:03:02,591][INFO ][test-runner-#4291%persistence.CommonPoolStarvationCheckpointTest%][IgnitePluginProcessor] ^-- null [21:03:02] : [Step 4/5] [2021-11-19 21:03:02,591][INFO ][test-runner-#4291%persistence.CommonPoolStarvationCheckpointTest%][IgnitePluginProcessor] [21:03:02] : [Step 4/5] [2021-11-19 21:03:02,592][INFO ][test-runner-#4291%persistence.CommonPoolStarvationCheckpointTest%][FailureProcessor] Configured failure handler: [hnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]]] [21:03:02] : [Step 4/5] [2021-11-19 21:03:02,623][INFO ][test-runner-#4291%persistence.CommonPoolStarvationCheckpointTest%][TcpCommunicationSpi] Successfully bound communication NIO server to TCP port [port=45080, locHost=/127.0.0.1, selectorsCnt=12, selectorSpins=0, pairedConn=false] [21:03:02]W: [org.apache.ignite:ignite-core] [2021-11-19 21:03:02,624][WARN ][test-runner-#4291%persistence.CommonPoolStarvationCheckpointTest%][TcpCommunicationSpi] Message queue limit is set to 0 which may lead to potential OOMEs when running cache operations in FULL_ASYNC or PRIMARY_SYNC modes due to message queues growth on sender and receiver sides. [21:03:02] : [Step 4/5] [2021-11-19 21:03:02,629][INFO ][test-runner-#4291%persistence.CommonPoolStarvationCheckpointTest%][GridCollisionManager] Collision resolution is disabled (all jobs will be activated upon arrival). [21:03:02] : [Step 4/5] [2021-11-19 21:03:02,629][INFO ][test-runner-#4291%persistence.CommonPoolStarvationCheckpointTest%][CommonPoolStarvationCheckpointTest0] Security status [authentication=off, sandbox=off, tls/ssl=off] [21:03:02] : [Step 4/5] [2021-11-19 21:03:02,631][INFO ][test-runner-#4291%persistence.CommonPoolStarvationCheckpointTest%][MaintenanceProcessor] Resolved store directory for node persistent data: /opt/buildagent/work/7bc1c54bc719b67c/work/db/persistence_CommonPoolStarvationCheckpointTest0 [21:03:02] : [Step 4/5] [2021-11-19 21:03:02,632][INFO ][test-runner-#4291%persistence.CommonPoolStarvationCheckpointTest%][CacheObjectBinaryProcessorImpl] Resolved directory for serialized binary metadata: /opt/buildagent/work/7bc1c54bc719b67c/work/db/binary_meta/persistence_CommonPoolStarvationCheckpointTest0 [21:03:02] : [Step 4/5] [2021-11-19 21:03:02,639][INFO ][test-runner-#4291%persistence.CommonPoolStarvationCheckpointTest%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/persistence_CommonPoolStarvationCheckpointTest0 [21:03:02] : [Step 4/5] [2021-11-19 21:03:02,639][INFO ][test-runner-#4291%persistence.CommonPoolStarvationCheckpointTest%][FileWriteAheadLogManager] Resolved write ahead log work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/persistence_CommonPoolStarvationCheckpointTest0 [21:03:02] : [Step 4/5] [2021-11-19 21:03:02,640][INFO ][test-runner-#4291%persistence.CommonPoolStarvationCheckpointTest%][FileWriteAheadLogManager] Resolved write ahead log archive directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/persistence_CommonPoolStarvationCheckpointTest0 [21:03:02] : [Step 4/5] Surefire report watcher [21:03:02] : [Surefire report watcher] Watching paths: [21:03:02] : [Surefire report watcher] /opt/buildagent/temp/buildTmp/ignite-tools-junit-reports1777670380320881607/test-org.apache.ignite.testsuites.IgniteBasicWithPersistenceTestSuite1637344966673.xml [21:03:02]i: [Step 4/5] org.apache.ignite.testsuites.IgniteBasicWithPersistenceTestSuite [21:03:02]i: [org.apache.ignite.testsuites.IgniteBasicWithPersistenceTestSuite] org.apache.ignite.internal.processors.cache.persistence.CheckpointReadLockFailureTest.testReentrance [21:03:02]i: [org.apache.ignite.testsuites.IgniteBasicWithPersistenceTestSuite] org.apache.ignite.internal.processors.cache.persistence.CheckpointReadLockFailureTest.testFailureTypeOnTimeout [21:03:02]i: [org.apache.ignite.testsuites.IgniteBasicWithPersistenceTestSuite] org.apache.ignite.internal.processors.cache.persistence.CheckpointReadLockFailureTest.testWriteLockedByCurrentThread [21:03:02]i: [org.apache.ignite.testsuites.IgniteBasicWithPersistenceTestSuite] org.apache.ignite.internal.processors.cache.persistence.CheckpointReadLockFailureTest.testPrintCpRLockHolder [21:03:03] : [Step 4/5] [2021-11-19 21:03:03,065][INFO ][test-runner-#4291%persistence.CommonPoolStarvationCheckpointTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/persistence_CommonPoolStarvationCheckpointTest0/0000000000000000.wal [21:03:03] : [Step 4/5] [2021-11-19 21:03:03,065][INFO ][test-runner-#4291%persistence.CommonPoolStarvationCheckpointTest%][FileHandleManagerImpl] Initialized write-ahead log manager [mode=LOG_ONLY] [21:03:03]W: [org.apache.ignite:ignite-core] [2021-11-19 21:03:03,066][WARN ][test-runner-#4291%persistence.CommonPoolStarvationCheckpointTest%][GridCacheDatabaseSharedManager] DataRegion maxSize=209.7 MB is smaller than defaultInitialSize=268.4 MB, setting initialSize to 209.7 MB [21:03:03] : [Step 4/5] [2021-11-19 21:03:03,073][INFO ][test-runner-#4291%persistence.CommonPoolStarvationCheckpointTest%][GridCacheDatabaseSharedManager] Configured data regions initialized successfully [total=5] [21:03:03] : [Step 4/5] [2021-11-19 21:03:03,075][INFO ][test-runner-#4291%persistence.CommonPoolStarvationCheckpointTest%][IgniteSnapshotManager] Resolved snapshot work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/snapshots [21:03:03] : [Step 4/5] [2021-11-19 21:03:03,076][INFO ][test-runner-#4291%persistence.CommonPoolStarvationCheckpointTest%][IgniteSnapshotManager] Resolved temp directory for snapshot creation: /opt/buildagent/work/7bc1c54bc719b67c/work/db/persistence_CommonPoolStarvationCheckpointTest0/snp [21:03:03] : [Step 4/5] [2021-11-19 21:03:03,080][INFO ][test-runner-#4291%persistence.CommonPoolStarvationCheckpointTest%][ClientListenerProcessor] Client connector processor has started on TCP port 10800 [21:03:03] : [Step 4/5] [2021-11-19 21:03:03,082][INFO ][test-runner-#4291%persistence.CommonPoolStarvationCheckpointTest%][CommonPoolStarvationCheckpointTest0] Non-loopback local IPs: 172.17.0.4 [21:03:03] : [Step 4/5] [2021-11-19 21:03:03,083][INFO ][test-runner-#4291%persistence.CommonPoolStarvationCheckpointTest%][CommonPoolStarvationCheckpointTest0] Enabled local MACs: 0242AC110004 [21:03:03] : [Step 4/5] [2021-11-19 21:03:03,083][INFO ][test-runner-#4291%persistence.CommonPoolStarvationCheckpointTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:03:03] : [Step 4/5] [2021-11-19 21:03:03,088][INFO ][test-runner-#4291%persistence.CommonPoolStarvationCheckpointTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=90504, tableSize=7.5 MiB, replacementSize=11.1 KiB, checkpointBuffer=100.0 MiB] [21:03:03] : [Step 4/5] [2021-11-19 21:03:03,089][INFO ][test-runner-#4291%persistence.CommonPoolStarvationCheckpointTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:03:03] : [Step 4/5] [2021-11-19 21:03:03,094][INFO ][test-runner-#4291%persistence.CommonPoolStarvationCheckpointTest%][GridCacheDatabaseSharedManager] Applying lost metastore updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:03:03] : [Step 4/5] [2021-11-19 21:03:03,096][INFO ][test-runner-#4291%persistence.CommonPoolStarvationCheckpointTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=0 ms] [21:03:03] : [Step 4/5] [2021-11-19 21:03:03,097][INFO ][test-runner-#4291%persistence.CommonPoolStarvationCheckpointTest%][GridCacheProcessor] Restoring partition state for local groups. [21:03:03] : [Step 4/5] [2021-11-19 21:03:03,097][INFO ][test-runner-#4291%persistence.CommonPoolStarvationCheckpointTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=0, partitionsProcessed=0, time=0ms] [21:03:03] : [Step 4/5] [2021-11-19 21:03:03,098][INFO ][test-runner-#4291%persistence.CommonPoolStarvationCheckpointTest%][GridEncryptionManager] Encryption keys loaded from metastore. [grps=, masterKeyName=null] [21:03:03] : [Step 4/5] [2021-11-19 21:03:03,101][INFO ][test-runner-#4291%persistence.CommonPoolStarvationCheckpointTest%][ClusterProcessor] Cluster ID and tag has been read from metastorage: null [21:03:03] : [Step 4/5] [2021-11-19 21:03:03,102][INFO ][test-runner-#4291%persistence.CommonPoolStarvationCheckpointTest%][IgniteClusterImpl] Shutdown policy was updated [oldVal=null, newVal=null] [21:03:03] : [Step 4/5] [2021-11-19 21:03:03,103][INFO ][test-runner-#4291%persistence.CommonPoolStarvationCheckpointTest%][GridCacheDatabaseSharedManager] Checkpoint frequency deviation changed [oldVal=null, newVal=null] [21:03:03] : [Step 4/5] [2021-11-19 21:03:03,113][INFO ][test-runner-#4291%persistence.CommonPoolStarvationCheckpointTest%][FilePageStoreManager] Cleanup cache stores [total=1, left=0, cleanFiles=false] [21:03:03] : [Step 4/5] [2021-11-19 21:03:03,122][INFO ][test-runner-#4291%persistence.CommonPoolStarvationCheckpointTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=90504, tableSize=7.5 MiB, replacementSize=11.1 KiB, checkpointBuffer=100.0 MiB] [21:03:03] : [Step 4/5] [2021-11-19 21:03:03,126][INFO ][test-runner-#4291%persistence.CommonPoolStarvationCheckpointTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=90504, tableSize=7.5 MiB, replacementSize=11.1 KiB, checkpointBuffer=100.0 MiB] [21:03:03] : [Step 4/5] [2021-11-19 21:03:03,132][INFO ][test-runner-#4291%persistence.CommonPoolStarvationCheckpointTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=90504, tableSize=7.5 MiB, replacementSize=11.1 KiB, checkpointBuffer=100.0 MiB] [21:03:03] : [Step 4/5] [2021-11-19 21:03:03,133][INFO ][test-runner-#4291%persistence.CommonPoolStarvationCheckpointTest%][GridCacheDatabaseSharedManager] Data Regions Started: 5 [21:03:03] : [Step 4/5] [2021-11-19 21:03:03,134][INFO ][test-runner-#4291%persistence.CommonPoolStarvationCheckpointTest%][GridCacheDatabaseSharedManager] ^-- sysMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:03:03] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:03:03] : [Step 4/5] ^-- default region [type=default, persistence=true, lazyAlloc=true, [21:03:03] : [Step 4/5] ... initCfg=200MB, maxCfg=200MB, usedRam=0MB, freeRam=100%, allocRam=0MB, allocTotal=0MB] [21:03:03] : [Step 4/5] ^-- metastoreMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:03:03] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:03:03] : [Step 4/5] ^-- TxLog region [type=internal, persistence=true, lazyAlloc=false, [21:03:03] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:03:03] : [Step 4/5] ^-- volatileDsMemPlc region [type=user, persistence=false, lazyAlloc=true, [21:03:03] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB] [21:03:03] : [Step 4/5] ^-- Ignite persistence [used=0MB] [21:03:03] : [Step 4/5] [21:03:03] : [Step 4/5] [2021-11-19 21:03:03,136][INFO ][test-runner-#4291%persistence.CommonPoolStarvationCheckpointTest%][GridCacheDatabaseSharedManager] Starting binary memory restore for: [94416770, -2100569601] [21:03:03] : [Step 4/5] [2021-11-19 21:03:03,152][INFO ][test-runner-#4291%persistence.CommonPoolStarvationCheckpointTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:03:03] : [Step 4/5] [2021-11-19 21:03:03,152][INFO ][test-runner-#4291%persistence.CommonPoolStarvationCheckpointTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:03:03] : [Step 4/5] [2021-11-19 21:03:03,155][INFO ][test-runner-#4291%persistence.CommonPoolStarvationCheckpointTest%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/persistence_CommonPoolStarvationCheckpointTest0/0000000000000000.wal, offset=0, ver=2] [21:03:03] : [Step 4/5] [2021-11-19 21:03:03,172][INFO ][test-runner-#4291%persistence.CommonPoolStarvationCheckpointTest%][PageMemoryImpl] Started page memory [memoryAllocated=200.0 MiB, pages=181008, tableSize=14.9 MiB, replacementSize=22.1 KiB, checkpointBuffer=200.0 MiB] [21:03:03] : [Step 4/5] [2021-11-19 21:03:03,180][INFO ][test-runner-#4291%persistence.CommonPoolStarvationCheckpointTest%][GridCacheProcessor] Started cache in recovery mode [name=cache, id=94416770, dataRegionName=default, mode=PARTITIONED, atomicity=TRANSACTIONAL, backups=0, mvcc=false] [21:03:03] : [Step 4/5] [2021-11-19 21:03:03,185][INFO ][test-runner-#4291%persistence.CommonPoolStarvationCheckpointTest%][GridCacheProcessor] Started cache in recovery mode [name=ignite-sys-cache, id=-2100569601, dataRegionName=sysMemPlc, mode=REPLICATED, atomicity=TRANSACTIONAL, backups=2147483647, mvcc=false] [21:03:03] : [Step 4/5] [2021-11-19 21:03:03,186][INFO ][test-runner-#4291%persistence.CommonPoolStarvationCheckpointTest%][GridCacheDatabaseSharedManager] Binary recovery performed in 50 ms. [21:03:03] : [Step 4/5] [2021-11-19 21:03:03,187][INFO ][test-runner-#4291%persistence.CommonPoolStarvationCheckpointTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:03:03] : [Step 4/5] [2021-11-19 21:03:03,187][INFO ][test-runner-#4291%persistence.CommonPoolStarvationCheckpointTest%][GridCacheDatabaseSharedManager] Applying lost cache updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:03:03] : [Step 4/5] [2021-11-19 21:03:03,269][INFO ][test-runner-#4291%persistence.CommonPoolStarvationCheckpointTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=81 ms] [21:03:03] : [Step 4/5] [2021-11-19 21:03:03,269][INFO ][test-runner-#4291%persistence.CommonPoolStarvationCheckpointTest%][GridCacheProcessor] Restoring partition state for local groups. [21:03:03] : [Step 4/5] [2021-11-19 21:03:03,280][INFO ][test-runner-#4291%persistence.CommonPoolStarvationCheckpointTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=2, partitionsProcessed=132, time=10ms] [21:03:03] : [Step 4/5] [2021-11-19 21:03:03,598][INFO ][test-runner-#4291%persistence.CommonPoolStarvationCheckpointTest%][TestTcpDiscoverySpi] Successfully bound to TCP port [port=47500, localHost=localhost/127.0.0.1, locNodeId=ae6a9703-5c6d-4b00-94d8-300661c00000] [21:03:03] : [Step 4/5] [2021-11-19 21:03:03,604][INFO ][disco-notifier-worker-#4404%persistence.CommonPoolStarvationCheckpointTest0%][MvccProcessorImpl] Assigned mvcc coordinator [crd=MvccCoordinator [topVer=AffinityTopologyVersion [topVer=1, minorTopVer=0], nodeId=ae6a9703-5c6d-4b00-94d8-300661c00000, ver=1637344983594, local=true, initialized=false]] [21:03:03] : [Step 4/5] [2021-11-19 21:03:03,605][INFO ][sys-#4395%persistence.CommonPoolStarvationCheckpointTest0%][ClusterProcessor] Writing cluster ID and tag to metastorage on ready for write ClusterIdAndTag [id=fafe7ab3-0d9b-4d23-914e-29f810996485, tag=confident_burnell] [21:03:03] : [Step 4/5] [2021-11-19 21:03:03,607][INFO ][disco-notifier-worker-#4404%persistence.CommonPoolStarvationCheckpointTest0%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustEnabled' was changed from 'null' to 'false' [21:03:03] : [Step 4/5] [2021-11-19 21:03:03,608][INFO ][disco-notifier-worker-#4404%persistence.CommonPoolStarvationCheckpointTest0%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustTimeout' was changed from 'null' to '300000' [21:03:03] : [Step 4/5] [2021-11-19 21:03:03,609][INFO ][disco-notifier-worker-#4404%persistence.CommonPoolStarvationCheckpointTest0%][IgniteTxManager] Transactions parameter 'longOperationsDumpTimeout' was changed from 'null' to '60000' [21:03:03] : [Step 4/5] [2021-11-19 21:03:03,610][INFO ][disco-notifier-worker-#4404%persistence.CommonPoolStarvationCheckpointTest0%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpThreshold' was changed from 'null' to '0' [21:03:03] : [Step 4/5] [2021-11-19 21:03:03,611][INFO ][disco-notifier-worker-#4404%persistence.CommonPoolStarvationCheckpointTest0%][IgniteTxManager] Transactions parameter 'transactionTimeDumpSamplesCoefficient' was changed from 'null' to '0.0' [21:03:03] : [Step 4/5] [2021-11-19 21:03:03,612][INFO ][disco-notifier-worker-#4404%persistence.CommonPoolStarvationCheckpointTest0%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpSamplesPerSecondLimit' was changed from 'null' to '5' [21:03:03] : [Step 4/5] [2021-11-19 21:03:03,613][INFO ][disco-notifier-worker-#4404%persistence.CommonPoolStarvationCheckpointTest0%][ClusterProcessor] confident_burnell [21:03:03] : [Step 4/5] [2021-11-19 21:03:03,613][INFO ][disco-notifier-worker-#4404%persistence.CommonPoolStarvationCheckpointTest0%][IgniteTxManager] Transactions parameter 'collisionsDumpInterval' was changed from 'null' to '1000' [21:03:03] : [Step 4/5] [2021-11-19 21:03:03,614][INFO ][disco-notifier-worker-#4404%persistence.CommonPoolStarvationCheckpointTest0%][IgniteTxManager] Transactions parameter 'txOwnerDumpRequestsAllowed' was changed from 'null' to 'true' [21:03:03] : [Step 4/5] [2021-11-19 21:03:03,615][INFO ][disco-notifier-worker-#4404%persistence.CommonPoolStarvationCheckpointTest0%][GridCacheDatabaseSharedManager] Historical rebalance WAL threshold changed [property=historical.rebalance.threshold, oldVal=null, newVal=500] [21:03:03] : [Step 4/5] [2021-11-19 21:03:03,629][INFO ][test-runner-#4291%persistence.CommonPoolStarvationCheckpointTest%][CommonPoolStarvationCheckpointTest0] To start Console Management & Monitoring run ignitevisorcmd.{sh|bat} [21:03:03] : [Step 4/5] [2021-11-19 21:03:03,630][INFO ][test-runner-#4291%persistence.CommonPoolStarvationCheckpointTest%][CommonPoolStarvationCheckpointTest0] [21:03:03] : [Step 4/5] [21:03:03] : [Step 4/5] >>> +-------------------------------------------+ [21:03:03] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:03:03] : [Step 4/5] >>> +-------------------------------------------+ [21:03:03] : [Step 4/5] >>> OS name: Linux 4.15.0-151-generic amd64 [21:03:03] : [Step 4/5] >>> CPU(s): 24 [21:03:03] : [Step 4/5] >>> Heap: 2.0GB [21:03:03] : [Step 4/5] >>> VM name: 16724@c4dfe9a430b2 [21:03:03] : [Step 4/5] >>> Ignite instance name: persistence.CommonPoolStarvationCheckpointTest0 [21:03:03] : [Step 4/5] >>> Local node [ID=AE6A9703-5C6D-4B00-94D8-300661C00000, order=1, clientMode=false] [21:03:03] : [Step 4/5] >>> Local node addresses: [127.0.0.1] [21:03:03] : [Step 4/5] >>> Local ports: TCP:10800 TCP:45080 TCP:47500 [21:03:03] : [Step 4/5] [21:03:03] : [Step 4/5] [2021-11-19 21:03:03,631][INFO ][test-runner-#4291%persistence.CommonPoolStarvationCheckpointTest%][CommonPoolStarvationCheckpointTest0] >>> Ignite cluster is in INACTIVE state (limited functionality available). Use control.(sh|bat) script or IgniteCluster.state(ClusterState.ACTIVE) to change the state. [21:03:03] : [Step 4/5] [2021-11-19 21:03:03,632][INFO ][test-runner-#4291%persistence.CommonPoolStarvationCheckpointTest%][GridDiscoveryManager] Topology snapshot [ver=1, locNode=ae6a9703, servers=1, clients=0, state=INACTIVE, CPUs=24, offheap=0.2GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=ae6a9703-5c6d-4b00-94d8-300661c00000, consistentId=persistence.CommonPoolStarvationCheckpointTest0, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:03:03] : [Step 4/5] [2021-11-19 21:03:03,633][INFO ][test-runner-#4291%persistence.CommonPoolStarvationCheckpointTest%][G] Node started : [stage="Configure system pool" (0 ms),stage="Start managers" (71 ms),stage="Configure binary metadata" (2 ms),stage="Start processors" (447 ms),stage="Start 'StanByClusterTestProvider' plugin" (0 ms),stage="Start 'PageMemory tracker plugin' plugin" (0 ms),stage="Start 'TestDistibutedConfigurationPlugin' plugin" (0 ms),stage="Start 'NodeValidationPluginProvider' plugin" (0 ms),stage="Init metastore" (31 ms),stage="Init and start regions" (22 ms),stage="Restore binary memory" (51 ms),stage="Restore logical state" (93 ms),stage="Finish recovery" (315 ms),stage="Join topology" (7 ms),stage="Await transition" (2 ms),stage="Await exchange" (26 ms),stage="Total time" (1067 ms)] [21:03:03] : [Step 4/5] [2021-11-19 21:03:03,635][INFO ][test-runner-#4291%persistence.CommonPoolStarvationCheckpointTest%][root] Node started with the following configuration [id=ae6a9703-5c6d-4b00-94d8-300661c00000, marshaller=BinaryMarshaller [], discovery=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=5000, ackTimeout=5000, marsh=JdkMarshaller [clsFilter=org.apache.ignite.marshaller.MarshallerUtils$1@413dd311], reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], binaryCfg=null, lateAff=true] [21:03:03] : [Step 4/5] [2021-11-19 21:03:03,637][INFO ][test-runner-#4291%persistence.CommonPoolStarvationCheckpointTest%][GridClusterStateProcessor] Sending activate cluster request with BaselineTopology BaselineTopology [id=0, branchingHash=-1648519921, branchingType='New BaselineTopology', baselineNodes=[persistence.CommonPoolStarvationCheckpointTest0]] [21:03:03] : [Step 4/5] [2021-11-19 21:03:03,639][INFO ][disco-notifier-worker-#4404%persistence.CommonPoolStarvationCheckpointTest0%][GridClusterStateProcessor] Received activate cluster request with BaselineTopology[id=0] initiator node ID: ae6a9703-5c6d-4b00-94d8-300661c00000 [21:03:03] : [Step 4/5] [2021-11-19 21:03:03,639][INFO ][disco-notifier-worker-#4404%persistence.CommonPoolStarvationCheckpointTest0%][GridClusterStateProcessor] Started state transition: activate cluster [21:03:03] : [Step 4/5] [2021-11-19 21:03:03,641][INFO ][exchange-worker-#4409%persistence.CommonPoolStarvationCheckpointTest0%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=1, minorTopVer=1], crd=true, evt=DISCOVERY_CUSTOM_EVT, evtNode=ae6a9703-5c6d-4b00-94d8-300661c00000, customEvt=ChangeGlobalStateMessage [id=84dac593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqId=2ba6af7c-4564-4c7c-a6e9-b96e9ee586a8, initiatingNodeId=ae6a9703-5c6d-4b00-94d8-300661c00000, state=ACTIVE, baselineTopology=BaselineTopology [id=0, branchingHash=-1648519921, branchingType='New BaselineTopology', baselineNodes=[persistence.CommonPoolStarvationCheckpointTest0]], forceChangeBaselineTopology=false, timestamp=1637344983637, forceDeactivation=true], allowMerge=false, exchangeFreeSwitch=false] [21:03:03] : [Step 4/5] [2021-11-19 21:03:03,642][INFO ][exchange-worker-#4409%persistence.CommonPoolStarvationCheckpointTest0%][GridDhtPartitionsExchangeFuture] Start activation process [nodeId=ae6a9703-5c6d-4b00-94d8-300661c00000, client=false, topVer=AffinityTopologyVersion [topVer=1, minorTopVer=1]]. New state: ACTIVE [21:03:03] : [Step 4/5] [2021-11-19 21:03:03,643][INFO ][exchange-worker-#4409%persistence.CommonPoolStarvationCheckpointTest0%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/persistence_CommonPoolStarvationCheckpointTest0 [21:03:03] : [Step 4/5] [2021-11-19 21:03:03,652][INFO ][exchange-worker-#4409%persistence.CommonPoolStarvationCheckpointTest0%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/persistence_CommonPoolStarvationCheckpointTest0/0000000000000000.wal, offset=3970, ver=2] [21:03:03] : [Step 4/5] [2021-11-19 21:03:03,654][INFO ][exchange-worker-#4409%persistence.CommonPoolStarvationCheckpointTest0%][GridClusterStateProcessor] Writing BaselineTopology[id=0] [21:03:03] : [Step 4/5] [2021-11-19 21:03:03,656][INFO ][exchange-worker-#4409%persistence.CommonPoolStarvationCheckpointTest0%][GridCacheDatabaseSharedManager] Finish recovery performed in 13 ms. [21:03:03] : [Step 4/5] [2021-11-19 21:03:03,668][INFO ][exchange-worker-#4409%persistence.CommonPoolStarvationCheckpointTest0%][msg] Components activation performed in 25 ms. [21:03:03] : [Step 4/5] [2021-11-19 21:03:03,669][INFO ][exchange-worker-#4409%persistence.CommonPoolStarvationCheckpointTest0%][GridCacheProcessor] Finished recovery for cache [cache=ignite-sys-cache, grp=ignite-sys-cache, startVer=AffinityTopologyVersion [topVer=1, minorTopVer=1]] [21:03:03] : [Step 4/5] [2021-11-19 21:03:03,673][INFO ][exchange-worker-#4409%persistence.CommonPoolStarvationCheckpointTest0%][GridCacheProcessor] Finished recovery for cache [cache=cache, grp=cache, startVer=AffinityTopologyVersion [topVer=1, minorTopVer=1]] [21:03:03] : [Step 4/5] [2021-11-19 21:03:03,675][INFO ][exchange-worker-#4409%persistence.CommonPoolStarvationCheckpointTest0%][GridDhtPartitionsExchangeFuture] Successfully activated caches [nodeId=ae6a9703-5c6d-4b00-94d8-300661c00000, client=false, topVer=AffinityTopologyVersion [topVer=1, minorTopVer=1], newState=ACTIVE] [21:03:03] : [Step 4/5] [2021-11-19 21:03:03,677][INFO ][exchange-worker-#4409%persistence.CommonPoolStarvationCheckpointTest0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=1, minorTopVer=1], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:03:03] : [Step 4/5] [2021-11-19 21:03:03,710][INFO ][exchange-worker-#4409%persistence.CommonPoolStarvationCheckpointTest0%][GridDhtPartitionsExchangeFuture] finishExchangeOnCoordinator [topVer=AffinityTopologyVersion [topVer=1, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=1, minorTopVer=1]] [21:03:03] : [Step 4/5] [2021-11-19 21:03:03,718][INFO ][exchange-worker-#4409%persistence.CommonPoolStarvationCheckpointTest0%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=1, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=1, minorTopVer=1], err=null, rebalanced=true, wasRebalanced=false] [21:03:03] : [Step 4/5] [2021-11-19 21:03:03,718][INFO ][disco-notifier-worker-#4404%persistence.CommonPoolStarvationCheckpointTest0%][GridClusterStateProcessor] Received state change finish message: ACTIVE [21:03:03] : [Step 4/5] [2021-11-19 21:03:03,720][INFO ][disco-notifier-worker-#4404%persistence.CommonPoolStarvationCheckpointTest0%][GridClusterStateProcessor] Cluster state was changed from INACTIVE to ACTIVE [21:03:03] : [Step 4/5] [2021-11-19 21:03:03,723][INFO ][db-checkpoint-thread-#4416%persistence.CommonPoolStarvationCheckpointTest0%][Checkpointer] Checkpoint started [checkpointId=9e3528c9-d8bd-44a7-bdaf-c9e7aaf28511, startPtr=WALPointer [idx=0, fileOff=63465, len=2577], checkpointBeforeLockTime=11ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=3ms, walCpRecordFsyncDuration=1ms, writeCheckpointEntryDuration=3ms, splitAndSortCpPagesDuration=8ms, pages=40, reason='node started'] [21:03:03] : [Step 4/5] [2021-11-19 21:03:03,724][INFO ][exchange-worker-#4409%persistence.CommonPoolStarvationCheckpointTest0%][GridCacheProcessor] Finish proxy initialization, cacheName=cache, localNodeId=ae6a9703-5c6d-4b00-94d8-300661c00000 [21:03:03] : [Step 4/5] [2021-11-19 21:03:03,725][INFO ][exchange-worker-#4409%persistence.CommonPoolStarvationCheckpointTest0%][GridCacheProcessor] Finish proxy initialization, cacheName=ignite-sys-cache, localNodeId=ae6a9703-5c6d-4b00-94d8-300661c00000 [21:03:03] : [Step 4/5] [2021-11-19 21:03:03,727][INFO ][sys-#4403%persistence.CommonPoolStarvationCheckpointTest0%][DistributedBaselineConfiguration] Baseline auto-adjust is 'disabled' with timeout='300000' ms [21:03:03] : [Step 4/5] [2021-11-19 21:03:03,727][INFO ][exchange-worker-#4409%persistence.CommonPoolStarvationCheckpointTest0%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=ae6a9703-5c6d-4b00-94d8-300661c00000, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=1, minorTopVer=1], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=ae6a9703-5c6d-4b00-94d8-300661c00000, consistentId=persistence.CommonPoolStarvationCheckpointTest0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637344983593, loc=true, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=1, minorTopVer=1]] [21:03:03] : [Step 4/5] [2021-11-19 21:03:03,727][INFO ][sys-#4403%persistence.CommonPoolStarvationCheckpointTest0%][GridClusterStateProcessor] Successfully performed final activation steps [nodeId=ae6a9703-5c6d-4b00-94d8-300661c00000, client=false, topVer=AffinityTopologyVersion [topVer=1, minorTopVer=1]] [21:03:03] : [Step 4/5] [2021-11-19 21:03:03,730][INFO ][exchange-worker-#4409%persistence.CommonPoolStarvationCheckpointTest0%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=1, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=1, minorTopVer=1], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (1 ms), stage="Update caches registry" (26 ms), stage="Start caches" (4 ms), stage="Affinity initialization on cache group start" (0 ms), stage="Determine exchange type" (1 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Restore partition states" (0 ms), stage="After states restored callback" (32 ms), stage="WAL history reservation" (0 ms), stage="Waiting for all single messages" (0 ms), stage="Affinity recalculation (crd)" (0 ms), stage="Collect update counters and create affinity messages" (0 ms), stage="Assign partitions states" (1 ms), stage="Validate partitions states" (0 ms), stage="Ideal affinity diff calculation (enforced)" (0 ms), stage="Apply update counters" (0 ms), stage="Full message preparing" (4 ms), stage="Full message sending" (0 ms), stage="State finish message sending" (0 ms), stage="Detect lost partitions" (5 ms), stage="Exchange done" (6 ms), stage="Total time" (80 ms)] [21:03:03] : [Step 4/5] [2021-11-19 21:03:03,732][INFO ][exchange-worker-#4409%persistence.CommonPoolStarvationCheckpointTest0%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=1, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=1, minorTopVer=1], stage="Affinity initialization on cache group start [grp=ignite-sys-cache]" (0 ms) (parent=Affinity initialization on cache group start), stage="Affinity initialization on cache group start [grp=cache]" (0 ms) (parent=Affinity initialization on cache group start), stage="Affinity centralized initialization (crd) [grp=ignite-sys-cache, crd=true]" (0 ms) (parent=Determine exchange type), stage="Affinity centralized initialization (crd) [grp=cache, crd=true]" (0 ms) (parent=Determine exchange type), stage="Restore partition states [grp=ignite-sys-cache]" (0 ms) (parent=Restore partition states), stage="Restore partition states [grp=cache]" (0 ms) (parent=Restore partition states), stage="Affinity recalculation (partitions availability) [grp=ignite-sys-cache]" (0 ms) (parent=Ideal affinity diff calculation (enforced)), stage="Affinity recalculation (partitions availability) [grp=cache]" (0 ms) (parent=Ideal affinity diff calculation (enforced))] [21:03:03] : [Step 4/5] [2021-11-19 21:03:03,735][INFO ][exchange-worker-#4409%persistence.CommonPoolStarvationCheckpointTest0%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=1, minorTopVer=1], crd=true] [21:03:03] : [Step 4/5] [2021-11-19 21:03:03,736][INFO ][exchange-worker-#4409%persistence.CommonPoolStarvationCheckpointTest0%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=1, minorTopVer=1], force=false, evt=DISCOVERY_CUSTOM_EVT, node=ae6a9703-5c6d-4b00-94d8-300661c00000] [21:03:03] : [Step 4/5] [2021-11-19 21:03:03,756][INFO ][db-checkpoint-thread-#4416%persistence.CommonPoolStarvationCheckpointTest0%][Checkpointer] Checkpoint finished [cpId=9e3528c9-d8bd-44a7-bdaf-c9e7aaf28511, pages=40, markPos=WALPointer [idx=0, fileOff=63465, len=2577], walSegmentsCovered=[], markDuration=18ms, pagesWrite=4ms, fsync=26ms, total=59ms] [21:03:03] : [Step 4/5] [2021-11-19 21:03:03,758][INFO ][db-checkpoint-thread-#4416%persistence.CommonPoolStarvationCheckpointTest0%][Checkpointer] Skipping checkpoint (no pages were modified) [checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=1ms, reason='test'] [21:03:07] : [Step 4/5] [2021-11-19 21:03:07,644][INFO ][db-checkpoint-thread-#4416%persistence.CommonPoolStarvationCheckpointTest0%][Checkpointer] Checkpoint started [checkpointId=f617bbf0-3218-441d-97a1-dfeea8b52e6f, startPtr=WALPointer [idx=0, fileOff=16462942, len=2561], checkpointBeforeLockTime=36ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=12ms, checkpointLockHoldTime=13ms, walCpRecordFsyncDuration=133ms, writeCheckpointEntryDuration=9ms, splitAndSortCpPagesDuration=32ms, pages=8836, reason='test'] [21:03:08] : [Step 4/5] [2021-11-19 21:03:08,129][INFO ][db-check[21:03:08] >>> point-thread-#4416%persistencStope.CommonPoolStarvationCheckpointTest0%][ping test: CommoCheckpointer] Checkpoint finished [cpId=f617bbf0-3218-441d-97a1-dnPoolStarvationCheckpoifeeantT8b52e6f, pages=8836, markPos=WALPointer [idx=0, fileOff=16462942, leest#tn=2561],es walSetCommonPoolSgmentsCovered=[], markDurtarvation in 5586 ms <<< [21:03:08] : [Step 4/5] ation=190ms, pagesWrite=169ms, fsync=314ms, total=709ms] [21:03:08] : [Step 4/5] [2021-11-19 21:03:08,131][INFO ][main][root] >>> Stopping test: CommonPoolStarvationCheckpointTest#testCommonPoolStarvation in 5586 ms <<< [21:03:08] : [Step 4/5] [21:03:08] >>> Heap: 300 MB used / 1956 MB commited / 1956 MB max <<< [21:03:08] : [Step 4/5] [2021-11-19 21:03:08,132][INFO ][main][root] >>> Heap: 300 MB used / 1956 MB commited / 1956 MB max <<< [21:03:08] : [Step 4/5] [21:03:08] >>> Non-Heap: 125 MB used / 133 MB commited / 0 MB max <<< [21:03:08] : [Step 4/5] [2021-11-19 21:03:08,132][INFO ][main][root] >>> Non-Heap: 125 MB used / 133 MB commited / 0 MB max <<< [21:03:08] : [Step 4/5] [2021-11-19 21:03:08,133][INFO ][main][root] >>> Stopping grid [name=persistence.CommonPoolStarvationCheckpointTest0, id=ae6a9703-5c6d-4b00-94d8-300661c00000] [21:03:08] : [Step 4/5] [2021-11-19 21:03:08,156][INFO ][db-checkpoint-thread-#4416%persistence.CommonPoolStarvationCheckpointTest0%][Checkpointer] Skipping checkpoint (no pages were modified) [checkpointBeforeLockTime=2ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=1ms, checkpointLockHoldTime=1ms, reason='timeout'] [21:03:08] : [Step 4/5] [2021-11-19 21:03:08,165][INFO ][main][GridCacheProcessor] Stopped cache [cacheName=cache] [21:03:08] : [Step 4/5] [2021-11-19 21:03:08,165][INFO ][main][GridCacheProcessor] Stopped cache [cacheName=ignite-sys-cache] [21:03:08] : [Step 4/5] [2021-11-19 21:03:08,174][INFO ][main][FilePageStoreManager] Cleanup cache stores [total=4, left=0, cleanFiles=false] [21:03:08] : [Step 4/5] [2021-11-19 21:03:08,187][INFO ][main][CommonPoolStarvationCheckpointTest0] [21:03:08] : [Step 4/5] [21:03:08] : [Step 4/5] >>> +------------------------------------------------------+ [21:03:08] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV stopped OK [21:03:08] : [Step 4/5] >>> +------------------------------------------------------+ [21:03:08] : [Step 4/5] >>> Ignite instance name: persistence.CommonPoolStarvationCheckpointTest0 [21:03:08] : [Step 4/5] >>> Grid uptime: 00:00:04.562 [21:03:08] : [Step 4/5] [21:03:08] : [Step 4/5] [21:03:08] : [Step 4/5] [21:03:08] >>> Stopping test class: CommonPoolStarvationCheckpointTest <<< [21:03:08] : [Step 4/5] [2021-11-19 21:03:08,354][INFO ][main][root] >>> Stopping test class: CommonPoolStarvationCheckpointTest <<< [21:03:08] : [Step 4/5] [21:03:08] >>> Starting test class: GridInternalTaskUnusedWalSegmentsTest <<< [21:03:08] : [Step 4/5] [2021-11-19 21:03:08,355][INFO ][main][root] >>> Starting test class: GridInternalTaskUnusedWalSegmentsTest <<< [21:03:08] : [Step 4/5] Running org.apache.ignite.util.GridInternalTaskUnusedWalSegmentsTest [21:03:08]i: [Step 4/5] ##teamcity[importData type='surefire' path='/opt/buildagent/temp/buildTmp/ignite-tools-junit-reports1777670380320881607/test-org.apache.ignite.testsuites.IgniteBasicWithPersistenceTestSuite1637344982539.xml'] [21:03:08] : [Step 4/5] Importing data from '/opt/buildagent/temp/buildTmp/ignite-tools-junit-reports1777670380320881607/test-org.apache.ignite.testsuites.IgniteBasicWithPersistenceTestSuite1637344982539.xml' (296 B) with 'surefire' processor [21:03:08] : [Step 4/5] [21:03:08] >>> Starting test: GridInternalTaskUnusedWalSegmentsTest#testCorrectnessOfDeletionTaskSegments <<< [21:03:08] : [Step 4/5] [2021-11-19 21:03:08,367][INFO ][main][root] >>> Starting test: GridInternalTaskUnusedWalSegmentsTest#testCorrectnessOfDeletionTaskSegments <<< [21:03:08] : [Step 4/5] [21:03:08] >>> Heap: 306 MB used / 1956 MB commited / 1956 MB max <<< [21:03:08] : [Step 4/5] [2021-11-19 21:03:08,368][INFO ][main][root] >>> Heap: 306 MB used / 1956 MB commited / 1956 MB max <<< [21:03:08] : [Step 4/5] [21:03:08] >>> Non-Heap: 126 MB used / 133 MB commited / 0 MB max <<< [21:03:08] : [Step 4/5] [2021-11-19 21:03:08,369][INFO ][main][root] >>> Non-Heap: 126 MB used / 133 MB commited / 0 MB max <<< [21:03:08]W: [org.apache.ignite:ignite-core] [2021-11-19 21:03:08,384][WARN ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][G] Ignite work directory is not provided, automatically resolved to: /opt/buildagent/work/7bc1c54bc719b67c/work [21:03:08]W: [org.apache.ignite:ignite-core] [2021-11-19 21:03:08,385][WARN ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][G] Consistent ID is not set, it is recommended to set consistent ID for production clusters (use IgniteConfiguration.setConsistentId property) [21:03:08] : [Step 4/5] [2021-11-19 21:03:08,387][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][GridInternalTaskUnusedWalSegmentsTest0] [21:03:08] : [Step 4/5] [21:03:08] : [Step 4/5] >>> __________ ________________ [21:03:08] : [Step 4/5] >>> / _/ ___/ |/ / _/_ __/ __/ [21:03:08] : [Step 4/5] >>> _/ // (7 7 // / / / / _/ [21:03:08] : [Step 4/5] >>> /___/\___/_/|_/___/ /_/ /___/ [21:03:08] : [Step 4/5] >>> [21:03:08] : [Step 4/5] >>> ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:03:08] : [Step 4/5] >>> 2021 Copyright(C) Apache Software Foundation [21:03:08] : [Step 4/5] >>> [21:03:08] : [Step 4/5] >>> Ignite documentation: http://ignite.apache.org [21:03:08] : [Step 4/5] [21:03:08] : [Step 4/5] [2021-11-19 21:03:08,389][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][GridInternalTaskUnusedWalSegmentsTest0] Config URL: n/a [21:03:08] : [Step 4/5] [2021-11-19 21:03:08,389][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][GridInternalTaskUnusedWalSegmentsTest0] IgniteConfiguration [igniteInstanceName=util.GridInternalTaskUnusedWalSegmentsTest0, pubPoolSize=24, svcPoolSize=24, callbackPoolSize=24, stripedPoolSize=24, sysPoolSize=24, mgmtPoolSize=4, dataStreamerPoolSize=24, utilityCachePoolSize=24, utilityCacheKeepAliveTime=60000, p2pPoolSize=2, qryPoolSize=24, buildIdxPoolSize=4, igniteHome=/opt/buildagent/work/7bc1c54bc719b67c, igniteWorkDir=/opt/buildagent/work/7bc1c54bc719b67c/work, mbeanSrv=com.sun.jmx.mbeanserver.JmxMBeanServer@6fe85038, nodeId=e5c7f7dd-47b7-4ab6-9149-6791d3600000, marsh=BinaryMarshaller [], marshLocJobs=false, daemon=false, p2pEnabled=true, netTimeout=10000, netCompressionLevel=1, sndRetryDelay=1000, sndRetryCnt=3, metricsHistSize=10000, metricsUpdateFreq=1000, metricsExpTime=9223372036854775807, discoSpi=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=0, ackTimeout=0, marsh=null, reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], segPlc=STOP, segResolveAttempts=2, waitForSegOnStart=true, allResolversPassReq=true, segChkFreq=10000, commSpi=TcpCommunicationSpi [connectGate=org.apache.ignite.spi.communication.tcp.internal.ConnectGateway@2ca8448c, ctxInitLatch=java.util.concurrent.CountDownLatch@1ef2cab8[Count = 1], stopping=false, clientPool=null, nioSrvWrapper=null, stateProvider=null], evtSpi=MemoryEventStorageSpi [expireAgeMs=9223372036854775807, expireCnt=10000, filter=null], colSpi=NoopCollisionSpi [], deploySpi=LocalDeploymentSpi [], indexingSpi=org.apache.ignite.spi.indexing.noop.NoopIndexingSpi@51fa9111, addrRslvr=null, encryptionSpi=org.apache.ignite.spi.encryption.noop.NoopEncryptionSpi@384a8e7c, tracingSpi=org.apache.ignite.spi.tracing.NoopTracingSpi@3338c103, clientMode=false, rebalanceThreadPoolSize=4, rebalanceTimeout=10000, rebalanceBatchesPrefetchCnt=3, rebalanceThrottle=0, rebalanceBatchSize=524288, txCfg=TransactionConfiguration [txSerEnabled=false, dfltIsolation=REPEATABLE_READ, dfltConcurrency=PESSIMISTIC, dfltTxTimeout=0, txTimeoutOnPartitionMapExchange=0, deadlockTimeout=10000, pessimisticTxLogSize=0, pessimisticTxLogLinger=10000, tmLookupClsName=null, txManagerFactory=null, useJtaSync=false], cacheSanityCheckEnabled=true, discoStartupDelay=60000, deployMode=SHARED, p2pMissedCacheSize=100, locHost=127.0.0.1, timeSrvPortBase=31100, timeSrvPortRange=100, failureDetectionTimeout=10000, sysWorkerBlockedTimeout=null, clientFailureDetectionTimeout=10000, metricsLogFreq=0, connectorCfg=null, odbcCfg=null, warmupClos=null, atomicCfg=AtomicConfiguration [seqReserveSize=1000, cacheMode=PARTITIONED, backups=1, aff=null, grpName=null], classLdr=null, sslCtxFactory=null, platformCfg=null, binaryCfg=null, memCfg=null, pstCfg=null, dsCfg=DataStorageConfiguration [sysRegionInitSize=41943040, sysRegionMaxSize=104857600, pageSize=4096, concLvl=0, dfltDataRegConf=DataRegionConfiguration [name=default, maxSize=104857600, initSize=268435456, swapPath=null, pageEvictionMode=DISABLED, pageReplacementMode=CLOCK, evictionThreshold=0.9, emptyPagesPoolSize=100, metricsEnabled=false, metricsSubIntervalCount=5, metricsRateTimeInterval=60000, persistenceEnabled=true, checkpointPageBufSize=0, lazyMemoryAllocation=true, warmUpCfg=null], dataRegions=null, storagePath=null, checkpointFreq=180000, lockWaitTime=10000, checkpointThreads=4, checkpointWriteOrder=SEQUENTIAL, walHistSize=2147483647, maxWalArchiveSize=1073741824, walSegments=10, walSegmentSize=1048576, walPath=db/wal, walArchivePath=db/wal/archive, cdcWalPath=db/wal/cdc, cdcEnabled=false, metricsEnabled=false, walMode=LOG_ONLY, walTlbSize=131072, walBuffSize=0, walFlushFreq=2000, walFsyncDelay=1000, walRecordIterBuffSize=67108864, alwaysWriteFullPages=false, fileIOFactory=org.apache.ignite.internal.processors.cache.persistence.file.AsyncFileIOFactory@54cf58a6, metricsSubIntervalCnt=5, metricsRateTimeInterval=60000, walAutoArchiveAfterInactivity=-1, walForceArchiveTimeout=-1, writeThrottlingEnabled=false, walCompactionEnabled=false, walCompactionLevel=1, checkpointReadLockTimeout=null, walPageCompression=DISABLED, walPageCompressionLevel=null, dfltWarmUpCfg=null, encCfg=org.apache.ignite.configuration.EncryptionConfiguration@3b6fec62, defragmentationThreadPoolSize=4, minWalArchiveSize=-1], snapshotPath=snapshots, activeOnStart=true, activeOnStartPropSetFlag=false, autoActivation=true, autoActivationPropSetFlag=false, clusterStateOnStart=null, sqlConnCfg=null, cliConnCfg=ClientConnectorConfiguration [host=null, port=10800, portRange=100, sockSndBufSize=0, sockRcvBufSize=0, tcpNoDelay=true, maxOpenCursorsPerConn=128, threadPoolSize=24, selectorCnt=12, idleTimeout=0, handshakeTimeout=10000, jdbcEnabled=true, odbcEnabled=true, thinCliEnabled=true, sslEnabled=false, useIgniteSslCtxFactory=true, sslClientAuth=false, sslCtxFactory=null, thinCliCfg=ThinClientConfiguration [maxActiveTxPerConn=100, maxActiveComputeTasksPerConn=0]], mvccVacuumThreadCnt=2, mvccVacuumFreq=5000, authEnabled=false, failureHnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]], commFailureRslvr=null, sqlCfg=SqlConfiguration [longQryWarnTimeout=3000, dfltQryTimeout=0, sqlQryHistSize=1000, validationEnabled=false], asyncContinuationExecutor=null] [21:03:08] : [Step 4/5] [2021-11-19 21:03:08,399][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][GridInternalTaskUnusedWalSegmentsTest0] Daemon mode: off [21:03:08] : [Step 4/5] [2021-11-19 21:03:08,400][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][GridInternalTaskUnusedWalSegmentsTest0] OS: Linux 4.15.0-151-generic amd64 [21:03:08] : [Step 4/5] [2021-11-19 21:03:08,400][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][GridInternalTaskUnusedWalSegmentsTest0] OS user: teamcity [21:03:08] : [Step 4/5] [2021-11-19 21:03:08,401][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][GridInternalTaskUnusedWalSegmentsTest0] PID: 16724 [21:03:08] : [Step 4/5] [2021-11-19 21:03:08,401][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][GridInternalTaskUnusedWalSegmentsTest0] Language runtime: Java Platform API Specification ver. 1.8 [21:03:08] : [Step 4/5] [2021-11-19 21:03:08,401][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][GridInternalTaskUnusedWalSegmentsTest0] VM information: Java(TM) SE Runtime Environment 1.8.0_261-b12 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 25.261-b12 [21:03:08] : [Step 4/5] [2021-11-19 21:03:08,402][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][GridInternalTaskUnusedWalSegmentsTest0] VM total memory: 1.9GB [21:03:08] : [Step 4/5] [2021-11-19 21:03:08,402][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][GridInternalTaskUnusedWalSegmentsTest0] Remote Management [restart: off, REST: off, JMX (remote: off)] [21:03:08] : [Step 4/5] [2021-11-19 21:03:08,403][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][GridInternalTaskUnusedWalSegmentsTest0] Logger: GridTestLog4jLogger [quiet=false, config=null] [21:03:08] : [Step 4/5] [2021-11-19 21:03:08,403][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][GridInternalTaskUnusedWalSegmentsTest0] IGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c [21:03:08] : [Step 4/5] [2021-11-19 21:03:08,403][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][GridInternalTaskUnusedWalSegmentsTest0] VM arguments: [-DIGNITE_DUMP_THREADS_ON_FAILURE=false, -DMono=/usr/bin/mono-sgen, -DMono4.0_x64=/usr/lib/mono/4.0, -DMono4.5_x64=/usr/lib/mono/4.5, -DMonoVersion=6.12.0.90, -DSKIP_BUILD=false, -Dagent.home.dir=/opt/buildagent, -Dagent.name=aitc-lin02_03, -Dagent.ownPort=9090, -Dagent.work.dir=/opt/buildagent/work, -Dbuild.number=95, -Dbuild.vcs.number=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.1=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.GitHubApacheIgnite=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dclassworlds.conf=/opt/buildagent/temp/buildTmp/teamcity.m2.conf, -Dcom.jetbrains.maven.watcher.report.file=/opt/buildagent/temp/buildTmp/maven-build-info.xml, -Djava.io.tmpdir=/opt/buildagent/temp/buildTmp, -Dmaven.home=/opt/buildagent/tools/maven3_6, -Dmaven.multiModuleProjectDirectory=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.agent.cpuBenchmark=457, -Dteamcity.agent.dotnet.agent_url=http://localhost:9090/RPC2, -Dteamcity.agent.dotnet.build_id=6278078, -Dteamcity.auth.password=*******, -Dteamcity.auth.userId=TeamCityBuildId=6278078, -Dteamcity.build.changedFiles.file=/opt/buildagent/temp/buildTmp/changedFiles6342607772318147725.txt, -Dteamcity.build.checkoutDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.build.id=6278078, -Dteamcity.build.properties.file=/opt/buildagent/temp/buildTmp/teamcity.build5164517880467851002.properties, -Dteamcity.build.tempDir=/opt/buildagent/temp/buildTmp, -Dteamcity.build.workingDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.buildConfName=Basic 3, -Dteamcity.buildType.id=IgniteTests24Java8_Basic3, -Dteamcity.configuration.properties.file=/opt/buildagent/temp/buildTmp/teamcity.config5591980786735343870.properties, -Dteamcity.maven.userSettings.path=/opt/buildagent/temp/buildTmp/maven_settings_585072866407032347.xml, -Dteamcity.maven.watcher.home=/opt/buildagent/plugins/mavenPlugin/maven-watcher-jdk16, -Dteamcity.projectName=Ignite Tests 2.x (JDK 8/11), -Dteamcity.runner.properties.file=/opt/buildagent/temp/buildTmp/teamcity.runner9098465561618137420.properties, -Dteamcity.tests.recentlyFailedTests.file=/opt/buildagent/temp/buildTmp/testsToRunFirst3891775683130404069.txt, -Dteamcity.version=2021.2 (build 99542), -ea, -Xms2g, -Xmx2g, -XX:+HeapDumpOnOutOfMemoryError, -DIGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_TEST_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_UPDATE_NOTIFIER=false, -DIGNITE_NO_DISCO_ORDER=true, -DIGNITE_PERFORMANCE_SUGGESTIONS_DISABLED=true, -Djava.net.preferIPv4Stack=true, -DTEST_SCALE_FACTOR=1.0, -DIGNITE_TEST_PROP_LOG4J_FILE=log4j-tc-test.xml, -DIGNITE_QUIET=false, -DIGNITE_MARSHAL_BUFFERS_RECHECK=1000, -Dmaven.repo.local=/opt/buildagent/.m2/repository] [21:03:08] : [Step 4/5] [2021-11-19 21:03:08,408][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][GridInternalTaskUnusedWalSegmentsTest0] System cache's DataRegion size is configured to 40 MB. Use DataStorageConfiguration.systemRegionInitialSize property to change the setting. [21:03:08] : [Step 4/5] [2021-11-19 21:03:08,408][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][GridInternalTaskUnusedWalSegmentsTest0] Configured caches [in 'sysMemPlc' dataRegion: ['ignite-sys-cache'], in 'default' dataRegion: ['default']] [21:03:08]W: [org.apache.ignite:ignite-core] [2021-11-19 21:03:08,408][WARN ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][GridInternalTaskUnusedWalSegmentsTest0] Peer class loading is enabled (disable it in production for performance and deployment consistency reasons) [21:03:08] : [Step 4/5] [2021-11-19 21:03:08,409][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][GridInternalTaskUnusedWalSegmentsTest0] 3-rd party licenses can be found at: /opt/buildagent/work/7bc1c54bc719b67c/libs/licenses [21:03:08] : [Step 4/5] [2021-11-19 21:03:08,413][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][IgnitePluginProcessor] Configured plugins: [21:03:08] : [Step 4/5] [2021-11-19 21:03:08,413][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][IgnitePluginProcessor] ^-- StanByClusterTestProvider 1.0 [21:03:08] : [Step 4/5] [2021-11-19 21:03:08,413][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][IgnitePluginProcessor] ^-- null [21:03:08] : [Step 4/5] [2021-11-19 21:03:08,413][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][IgnitePluginProcessor] [21:03:08] : [Step 4/5] [2021-11-19 21:03:08,414][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][IgnitePluginProcessor] ^-- PageMemory tracker plugin 1.0 [21:03:08] : [Step 4/5] [2021-11-19 21:03:08,414][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][IgnitePluginProcessor] ^-- null [21:03:08] : [Step 4/5] [2021-11-19 21:03:08,414][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][IgnitePluginProcessor] [21:03:08] : [Step 4/5] [2021-11-19 21:03:08,414][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][IgnitePluginProcessor] ^-- TestDistibutedConfigurationPlugin 1.0 [21:03:08] : [Step 4/5] [2021-11-19 21:03:08,415][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][IgnitePluginProcessor] ^-- null [21:03:08] : [Step 4/5] [2021-11-19 21:03:08,415][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][IgnitePluginProcessor] [21:03:08] : [Step 4/5] [2021-11-19 21:03:08,415][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][IgnitePluginProcessor] ^-- NodeValidationPluginProvider 1.0 [21:03:08] : [Step 4/5] [2021-11-19 21:03:08,416][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][IgnitePluginProcessor] ^-- null [21:03:08] : [Step 4/5] [2021-11-19 21:03:08,416][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][IgnitePluginProcessor] [21:03:08] : [Step 4/5] [2021-11-19 21:03:08,416][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][FailureProcessor] Configured failure handler: [hnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]]] [21:03:08] : [Step 4/5] [2021-11-19 21:03:08,506][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][TcpCommunicationSpi] Successfully bound communication NIO server to TCP port [port=45090, locHost=/127.0.0.1, selectorsCnt=12, selectorSpins=0, pairedConn=false] [21:03:08]W: [org.apache.ignite:ignite-core] [2021-11-19 21:03:08,507][WARN ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][TcpCommunicationSpi] Message queue limit is set to 0 which may lead to potential OOMEs when running cache operations in FULL_ASYNC or PRIMARY_SYNC modes due to message queues growth on sender and receiver sides. [21:03:08] : [Step 4/5] [2021-11-19 21:03:08,530][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][GridCollisionManager] Collision resolution is disabled (all jobs will be activated upon arrival). [21:03:08] : [Step 4/5] [2021-11-19 21:03:08,531][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][GridInternalTaskUnusedWalSegmentsTest0] Security status [authentication=off, sandbox=off, tls/ssl=off] [21:03:08] : [Step 4/5] [2021-11-19 21:03:08,532][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][TestTcpDiscoverySpi] Successfully bound to TCP port [port=47500, localHost=localhost/127.0.0.1, locNodeId=e5c7f7dd-47b7-4ab6-9149-6791d3600000] [21:03:08] : [Step 4/5] [2021-11-19 21:03:08,543][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][PdsFoldersResolver] Successfully created new persistent storage folder [/opt/buildagent/work/7bc1c54bc719b67c/work/db/node00-87f16126-5f72-4dfe-a561-76ce966f5d95] [21:03:08] : [Step 4/5] [2021-11-19 21:03:08,543][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][PdsFoldersResolver] Consistent ID used for local node is [87f16126-5f72-4dfe-a561-76ce966f5d95] according to persistence data storage folders [21:03:08] : [Step 4/5] [2021-11-19 21:03:08,544][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][MaintenanceProcessor] Resolved store directory for node persistent data: /opt/buildagent/work/7bc1c54bc719b67c/work/db/node00-87f16126-5f72-4dfe-a561-76ce966f5d95 [21:03:08] : [Step 4/5] [2021-11-19 21:03:08,545][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][CacheObjectBinaryProcessorImpl] Resolved directory for serialized binary metadata: /opt/buildagent/work/7bc1c54bc719b67c/work/db/binary_meta/node00-87f16126-5f72-4dfe-a561-76ce966f5d95 [21:03:08] : [Step 4/5] [2021-11-19 21:03:08,554][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/node00-87f16126-5f72-4dfe-a561-76ce966f5d95 [21:03:08] : [Step 4/5] [2021-11-19 21:03:08,555][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][FileWriteAheadLogManager] Resolved write ahead log work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/node00-87f16126-5f72-4dfe-a561-76ce966f5d95 [21:03:08] : [Step 4/5] [2021-11-19 21:03:08,555][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][FileWriteAheadLogManager] Resolved write ahead log archive directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/node00-87f16126-5f72-4dfe-a561-76ce966f5d95 [21:03:08] : [Step 4/5] [2021-11-19 21:03:08,565][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/node00-87f16126-5f72-4dfe-a561-76ce966f5d95/0000000000000000.wal [21:03:08] : [Step 4/5] [2021-11-19 21:03:08,566][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][FileHandleManagerImpl] Initialized write-ahead log manager [mode=LOG_ONLY] [21:03:08]W: [org.apache.ignite:ignite-core] [2021-11-19 21:03:08,566][WARN ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][GridCacheDatabaseSharedManager] DataRegion maxSize=104.9 MB is smaller than defaultInitialSize=268.4 MB, setting initialSize to 104.9 MB [21:03:08] : [Step 4/5] [2021-11-19 21:03:08,572][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][GridCacheDatabaseSharedManager] Configured data regions initialized successfully [total=5] [21:03:08] : [Step 4/5] [2021-11-19 21:03:08,573][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][IgniteSnapshotManager] Resolved snapshot work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/snapshots [21:03:08] : [Step 4/5] [2021-11-19 21:03:08,574][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][IgniteSnapshotManager] Resolved temp directory for snapshot creation: /opt/buildagent/work/7bc1c54bc719b67c/work/db/node00-87f16126-5f72-4dfe-a561-76ce966f5d95/snp [21:03:08] : [Step 4/5] [2021-11-19 21:03:08,577][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][ClientListenerProcessor] Client connector processor has started on TCP port 10800 [21:03:08] : [Step 4/5] [2021-11-19 21:03:08,582][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][GridInternalTaskUnusedWalSegmentsTest0] Non-loopback local IPs: 172.17.0.4 [21:03:08] : [Step 4/5] [2021-11-19 21:03:08,582][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][GridInternalTaskUnusedWalSegmentsTest0] Enabled local MACs: 0242AC110004 [21:03:08] : [Step 4/5] [2021-11-19 21:03:08,583][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:03:08] : [Step 4/5] [2021-11-19 21:03:08,584][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:03:08] : [Step 4/5] [2021-11-19 21:03:08,585][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:03:08] : [Step 4/5] [2021-11-19 21:03:08,593][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][GridCacheDatabaseSharedManager] Applying lost metastore updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:03:08] : [Step 4/5] [2021-11-19 21:03:08,596][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=0 ms] [21:03:08] : [Step 4/5] [2021-11-19 21:03:08,596][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][GridCacheProcessor] Restoring partition state for local groups. [21:03:08] : [Step 4/5] [2021-11-19 21:03:08,597][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=0, partitionsProcessed=0, time=0ms] [21:03:08] : [Step 4/5] [2021-11-19 21:03:08,597][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][GridEncryptionManager] Encryption keys loaded from metastore. [grps=, masterKeyName=null] [21:03:08] : [Step 4/5] [2021-11-19 21:03:08,599][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][ClusterProcessor] Cluster ID and tag has been read from metastorage: null [21:03:08] : [Step 4/5] [2021-11-19 21:03:08,599][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][IgniteClusterImpl] Shutdown policy was updated [oldVal=null, newVal=null] [21:03:08] : [Step 4/5] [2021-11-19 21:03:08,600][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][GridCacheDatabaseSharedManager] Checkpoint frequency deviation changed [oldVal=null, newVal=null] [21:03:08] : [Step 4/5] [2021-11-19 21:03:08,610][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][FilePageStoreManager] Cleanup cache stores [total=1, left=0, cleanFiles=false] [21:03:08] : [Step 4/5] [2021-11-19 21:03:08,614][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:03:08] : [Step 4/5] [2021-11-19 21:03:08,616][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:03:08] : [Step 4/5] [2021-11-19 21:03:08,619][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:03:08] : [Step 4/5] [2021-11-19 21:03:08,620][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][GridCacheDatabaseSharedManager] Data Regions Started: 5 [21:03:08] : [Step 4/5] [2021-11-19 21:03:08,621][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][GridCacheDatabaseSharedManager] ^-- sysMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:03:08] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:03:08] : [Step 4/5] ^-- default region [type=default, persistence=true, lazyAlloc=true, [21:03:08] : [Step 4/5] ... initCfg=100MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB, allocTotal=0MB] [21:03:08] : [Step 4/5] ^-- metastoreMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:03:08] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:03:08] : [Step 4/5] ^-- TxLog region [type=internal, persistence=true, lazyAlloc=false, [21:03:08] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:03:08] : [Step 4/5] ^-- volatileDsMemPlc region [type=user, persistence=false, lazyAlloc=true, [21:03:08] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB] [21:03:08] : [Step 4/5] ^-- Ignite persistence [used=0MB] [21:03:08] : [Step 4/5] [21:03:08] : [Step 4/5] [2021-11-19 21:03:08,623][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][GridCacheDatabaseSharedManager] Starting binary memory restore for: [1544803905, -2100569601] [21:03:08] : [Step 4/5] [2021-11-19 21:03:08,643][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:03:08] : [Step 4/5] [2021-11-19 21:03:08,644][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:03:08] : [Step 4/5] [2021-11-19 21:03:08,677][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/node00-87f16126-5f72-4dfe-a561-76ce966f5d95/0000000000000000.wal, offset=0, ver=2] [21:03:08] : [Step 4/5] Surefire report watcher [21:03:08] : [Surefire report watcher] Watching paths: [21:03:08] : [Surefire report watcher] /opt/buildagent/temp/buildTmp/ignite-tools-junit-reports1777670380320881607/test-org.apache.ignite.testsuites.IgniteBasicWithPersistenceTestSuite1637344982539.xml [21:03:08] : [Step 4/5] [2021-11-19 21:03:08,681][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:03:08]i: [Step 4/5] org.apache.ignite.testsuites.IgniteBasicWithPersistenceTestSuite [21:03:08]i: [org.apache.ignite.testsuites.IgniteBasicWithPersistenceTestSuite] org.apache.ignite.internal.processors.cache.persistence.CommonPoolStarvationCheckpointTest.testCommonPoolStarvation [21:03:08] : [Step 4/5] [2021-11-19 21:03:08,691][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][GridCacheProcessor] Started cache in recovery mode [name=default, id=1544803905, dataRegionName=default, mode=PARTITIONED, atomicity=ATOMIC, backups=0, mvcc=false] [21:03:08] : [Step 4/5] [2021-11-19 21:03:08,695][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][GridCacheProcessor] Started cache in recovery mode [name=ignite-sys-cache, id=-2100569601, dataRegionName=sysMemPlc, mode=REPLICATED, atomicity=TRANSACTIONAL, backups=2147483647, mvcc=false] [21:03:08] : [Step 4/5] [2021-11-19 21:03:08,696][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][GridCacheDatabaseSharedManager] Binary recovery performed in 73 ms. [21:03:08] : [Step 4/5] [2021-11-19 21:03:08,696][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:03:08] : [Step 4/5] [2021-11-19 21:03:08,697][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][GridCacheDatabaseSharedManager] Applying lost cache updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:03:08] : [Step 4/5] [2021-11-19 21:03:08,700][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=0 ms] [21:03:08] : [Step 4/5] [2021-11-19 21:03:08,701][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][GridCacheProcessor] Restoring partition state for local groups. [21:03:08] : [Step 4/5] [2021-11-19 21:03:08,728][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=2, partitionsProcessed=132, time=30ms] [21:03:08] : [Step 4/5] [2021-11-19 21:03:08,761][INFO ][disco-notifier-worker-#4538%util.GridInternalTaskUnusedWalSegmentsTest0%][MvccProcessorImpl] Assigned mvcc coordinator [crd=MvccCoordinator [topVer=AffinityTopologyVersion [topVer=1, minorTopVer=0], nodeId=e5c7f7dd-47b7-4ab6-9149-6791d3600000, ver=1637344988753, local=true, initialized=false]] [21:03:08] : [Step 4/5] [2021-11-19 21:03:08,772][INFO ][sys-#4516%util.GridInternalTaskUnusedWalSegmentsTest0%][ClusterProcessor] Writing cluster ID and tag to metastorage on ready for write ClusterIdAndTag [id=3d49fd3a-53f0-4d1a-a0f4-1e83e06bb38e, tag=infallible_faraday] [21:03:08] : [Step 4/5] [2021-11-19 21:03:08,796][INFO ][disco-notifier-worker-#4538%util.GridInternalTaskUnusedWalSegmentsTest0%][ClusterProcessor] infallible_faraday [21:03:08] : [Step 4/5] [2021-11-19 21:03:08,797][INFO ][disco-notifier-worker-#4538%util.GridInternalTaskUnusedWalSegmentsTest0%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustEnabled' was changed from 'null' to 'false' [21:03:08] : [Step 4/5] [2021-11-19 21:03:08,797][INFO ][disco-notifier-worker-#4538%util.GridInternalTaskUnusedWalSegmentsTest0%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustTimeout' was changed from 'null' to '300000' [21:03:08] : [Step 4/5] [2021-11-19 21:03:08,798][INFO ][disco-notifier-worker-#4538%util.GridInternalTaskUnusedWalSegmentsTest0%][IgniteTxManager] Transactions parameter 'longOperationsDumpTimeout' was changed from 'null' to '60000' [21:03:08] : [Step 4/5] [2021-11-19 21:03:08,821][INFO ][disco-notifier-worker-#4538%util.GridInternalTaskUnusedWalSegmentsTest0%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpThreshold' was changed from 'null' to '0' [21:03:08] : [Step 4/5] [2021-11-19 21:03:08,861][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][GridInternalTaskUnusedWalSegmentsTest0] To start Console Management & Monitoring run ignitevisorcmd.{sh|bat} [21:03:08] : [Step 4/5] [2021-11-19 21:03:08,862][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][GridInternalTaskUnusedWalSegmentsTest0] [21:03:08] : [Step 4/5] [21:03:08] : [Step 4/5] >>> +-------------------------------------------+ [21:03:08] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:03:08] : [Step 4/5] >>> +-------------------------------------------+ [21:03:08] : [Step 4/5] >>> OS name: Linux 4.15.0-151-generic amd64 [21:03:08] : [Step 4/5] >>> CPU(s): 24 [21:03:08] : [Step 4/5] >>> Heap: 2.0GB [21:03:08] : [Step 4/5] >>> VM name: 16724@c4dfe9a430b2 [21:03:08] : [Step 4/5] >>> Ignite instance name: util.GridInternalTaskUnusedWalSegmentsTest0 [21:03:08] : [Step 4/5] >>> Local node [ID=E5C7F7DD-47B7-4AB6-9149-6791D3600000, order=1, clientMode=false] [21:03:08] : [Step 4/5] >>> Local node addresses: [127.0.0.1] [21:03:08] : [Step 4/5] >>> Local ports: TCP:10800 TCP:45090 TCP:47500 [21:03:08] : [Step 4/5] [21:03:08] : [Step 4/5] [2021-11-19 21:03:08,863][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][GridInternalTaskUnusedWalSegmentsTest0] >>> Ignite cluster is in INACTIVE state (limited functionality available). Use control.(sh|bat) script or IgniteCluster.state(ClusterState.ACTIVE) to change the state. [21:03:08] : [Step 4/5] [2021-11-19 21:03:08,862][INFO ][disco-notifier-worker-#4538%util.GridInternalTaskUnusedWalSegmentsTest0%][IgniteTxManager] Transactions parameter 'transactionTimeDumpSamplesCoefficient' was changed from 'null' to '0.0' [21:03:08] : [Step 4/5] [2021-11-19 21:03:08,864][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][GridDiscoveryManager] Topology snapshot [ver=1, locNode=e5c7f7dd, servers=1, clients=0, state=INACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=e5c7f7dd-47b7-4ab6-9149-6791d3600000, consistentId=87f16126-5f72-4dfe-a561-76ce966f5d95, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:03:08] : [Step 4/5] [2021-11-19 21:03:08,865][INFO ][disco-notifier-worker-#4538%util.GridInternalTaskUnusedWalSegmentsTest0%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpSamplesPerSecondLimit' was changed from 'null' to '5' [21:03:08] : [Step 4/5] [2021-11-19 21:03:08,865][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][G] Node started : [stage="Configure system pool" (0 ms),stage="Start managers" (158 ms),stage="Configure binary metadata" (5 ms),stage="Start processors" (30 ms),stage="Start 'StanByClusterTestProvider' plugin" (0 ms),stage="Start 'PageMemory tracker plugin' plugin" (0 ms),stage="Start 'TestDistibutedConfigurationPlugin' plugin" (0 ms),stage="Start 'NodeValidationPluginProvider' plugin" (0 ms),stage="Init metastore" (29 ms),stage="Init and start regions" (12 ms),stage="Restore binary memory" (73 ms),stage="Restore logical state" (32 ms),stage="Finish recovery" (18 ms),stage="Join topology" (29 ms),stage="Await transition" (4 ms),stage="Await exchange" (84 ms),stage="Total time" (474 ms)] [21:03:08] : [Step 4/5] [2021-11-19 21:03:08,866][INFO ][disco-notifier-worker-#4538%util.GridInternalTaskUnusedWalSegmentsTest0%][IgniteTxManager] Transactions parameter 'collisionsDumpInterval' was changed from 'null' to '1000' [21:03:08] : [Step 4/5] [2021-11-19 21:03:08,867][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][root] Node started with the following configuration [id=e5c7f7dd-47b7-4ab6-9149-6791d3600000, marshaller=BinaryMarshaller [], discovery=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=5000, ackTimeout=5000, marsh=JdkMarshaller [clsFilter=org.apache.ignite.marshaller.MarshallerUtils$1@235b8abe], reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], binaryCfg=null, lateAff=true] [21:03:08] : [Step 4/5] [2021-11-19 21:03:08,868][INFO ][disco-notifier-worker-#4538%util.GridInternalTaskUnusedWalSegmentsTest0%][IgniteTxManager] Transactions parameter 'txOwnerDumpRequestsAllowed' was changed from 'null' to 'true' [21:03:08] : [Step 4/5] [2021-11-19 21:03:08,874][INFO ][disco-notifier-worker-#4538%util.GridInternalTaskUnusedWalSegmentsTest0%][GridCacheDatabaseSharedManager] Historical rebalance WAL threshold changed [property=historical.rebalance.threshold, oldVal=null, newVal=500] [21:03:08]W: [org.apache.ignite:ignite-core] [2021-11-19 21:03:08,880][WARN ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][G] Ignite work directory is not provided, automatically resolved to: /opt/buildagent/work/7bc1c54bc719b67c/work [21:03:08]W: [org.apache.ignite:ignite-core] [2021-11-19 21:03:08,881][WARN ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][G] Consistent ID is not set, it is recommended to set consistent ID for production clusters (use IgniteConfiguration.setConsistentId property) [21:03:08] : [Step 4/5] [2021-11-19 21:03:08,884][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][GridInternalTaskUnusedWalSegmentsTest1] [21:03:08] : [Step 4/5] [21:03:08] : [Step 4/5] >>> __________ ________________ [21:03:08] : [Step 4/5] >>> / _/ ___/ |/ / _/_ __/ __/ [21:03:08] : [Step 4/5] >>> _/ // (7 7 // / / / / _/ [21:03:08] : [Step 4/5] >>> /___/\___/_/|_/___/ /_/ /___/ [21:03:08] : [Step 4/5] >>> [21:03:08] : [Step 4/5] >>> ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:03:08] : [Step 4/5] >>> 2021 Copyright(C) Apache Software Foundation [21:03:08] : [Step 4/5] >>> [21:03:08] : [Step 4/5] >>> Ignite documentation: http://ignite.apache.org [21:03:08] : [Step 4/5] [21:03:08] : [Step 4/5] [2021-11-19 21:03:08,885][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][GridInternalTaskUnusedWalSegmentsTest1] Config URL: n/a [21:03:08] : [Step 4/5] [2021-11-19 21:03:08,886][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][GridInternalTaskUnusedWalSegmentsTest1] IgniteConfiguration [igniteInstanceName=util.GridInternalTaskUnusedWalSegmentsTest1, pubPoolSize=24, svcPoolSize=24, callbackPoolSize=24, stripedPoolSize=24, sysPoolSize=24, mgmtPoolSize=4, dataStreamerPoolSize=24, utilityCachePoolSize=24, utilityCacheKeepAliveTime=60000, p2pPoolSize=2, qryPoolSize=24, buildIdxPoolSize=4, igniteHome=/opt/buildagent/work/7bc1c54bc719b67c, igniteWorkDir=/opt/buildagent/work/7bc1c54bc719b67c/work, mbeanSrv=com.sun.jmx.mbeanserver.JmxMBeanServer@6fe85038, nodeId=a6e2d1b8-e889-42a6-b138-d6edb8d00001, marsh=BinaryMarshaller [], marshLocJobs=false, daemon=false, p2pEnabled=true, netTimeout=10000, netCompressionLevel=1, sndRetryDelay=1000, sndRetryCnt=3, metricsHistSize=10000, metricsUpdateFreq=1000, metricsExpTime=9223372036854775807, discoSpi=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=0, ackTimeout=0, marsh=null, reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], segPlc=STOP, segResolveAttempts=2, waitForSegOnStart=true, allResolversPassReq=true, segChkFreq=10000, commSpi=TcpCommunicationSpi [connectGate=org.apache.ignite.spi.communication.tcp.internal.ConnectGateway@8fece44, ctxInitLatch=java.util.concurrent.CountDownLatch@2b7b29a3[Count = 1], stopping=false, clientPool=null, nioSrvWrapper=null, stateProvider=null], evtSpi=MemoryEventStorageSpi [expireAgeMs=9223372036854775807, expireCnt=10000, filter=null], colSpi=NoopCollisionSpi [], deploySpi=LocalDeploymentSpi [], indexingSpi=org.apache.ignite.spi.indexing.noop.NoopIndexingSpi@651ffb1c, addrRslvr=null, encryptionSpi=org.apache.ignite.spi.encryption.noop.NoopEncryptionSpi@737eaad5, tracingSpi=org.apache.ignite.spi.tracing.NoopTracingSpi@56fdd301, clientMode=false, rebalanceThreadPoolSize=4, rebalanceTimeout=10000, rebalanceBatchesPrefetchCnt=3, rebalanceThrottle=0, rebalanceBatchSize=524288, txCfg=TransactionConfiguration [txSerEnabled=false, dfltIsolation=REPEATABLE_READ, dfltConcurrency=PESSIMISTIC, dfltTxTimeout=0, txTimeoutOnPartitionMapExchange=0, deadlockTimeout=10000, pessimisticTxLogSize=0, pessimisticTxLogLinger=10000, tmLookupClsName=null, txManagerFactory=null, useJtaSync=false], cacheSanityCheckEnabled=true, discoStartupDelay=60000, deployMode=SHARED, p2pMissedCacheSize=100, locHost=127.0.0.1, timeSrvPortBase=31100, timeSrvPortRange=100, failureDetectionTimeout=10000, sysWorkerBlockedTimeout=null, clientFailureDetectionTimeout=10000, metricsLogFreq=0, connectorCfg=null, odbcCfg=null, warmupClos=null, atomicCfg=AtomicConfiguration [seqReserveSize=1000, cacheMode=PARTITIONED, backups=1, aff=null, grpName=null], classLdr=null, sslCtxFactory=null, platformCfg=null, binaryCfg=null, memCfg=null, pstCfg=null, dsCfg=DataStorageConfiguration [sysRegionInitSize=41943040, sysRegionMaxSize=104857600, pageSize=4096, concLvl=0, dfltDataRegConf=DataRegionConfiguration [name=default, maxSize=104857600, initSize=268435456, swapPath=null, pageEvictionMode=DISABLED, pageReplacementMode=CLOCK, evictionThreshold=0.9, emptyPagesPoolSize=100, metricsEnabled=false, metricsSubIntervalCount=5, metricsRateTimeInterval=60000, persistenceEnabled=true, checkpointPageBufSize=0, lazyMemoryAllocation=true, warmUpCfg=null], dataRegions=null, storagePath=null, checkpointFreq=180000, lockWaitTime=10000, checkpointThreads=4, checkpointWriteOrder=SEQUENTIAL, walHistSize=2147483647, maxWalArchiveSize=1073741824, walSegments=10, walSegmentSize=1048576, walPath=db/wal, walArchivePath=db/wal/archive, cdcWalPath=db/wal/cdc, cdcEnabled=false, metricsEnabled=false, walMode=LOG_ONLY, walTlbSize=131072, walBuffSize=0, walFlushFreq=2000, walFsyncDelay=1000, walRecordIterBuffSize=67108864, alwaysWriteFullPages=false, fileIOFactory=org.apache.ignite.internal.processors.cache.persistence.file.AsyncFileIOFactory@3a693c78, metricsSubIntervalCnt=5, metricsRateTimeInterval=60000, walAutoArchiveAfterInactivity=-1, walForceArchiveTimeout=-1, writeThrottlingEnabled=false, walCompactionEnabled=false, walCompactionLevel=1, checkpointReadLockTimeout=null, walPageCompression=DISABLED, walPageCompressionLevel=null, dfltWarmUpCfg=null, encCfg=org.apache.ignite.configuration.EncryptionConfiguration@1b181f20, defragmentationThreadPoolSize=4, minWalArchiveSize=-1], snapshotPath=snapshots, activeOnStart=true, activeOnStartPropSetFlag=false, autoActivation=true, autoActivationPropSetFlag=false, clusterStateOnStart=null, sqlConnCfg=null, cliConnCfg=ClientConnectorConfiguration [host=null, port=10800, portRange=100, sockSndBufSize=0, sockRcvBufSize=0, tcpNoDelay=true, maxOpenCursorsPerConn=128, threadPoolSize=24, selectorCnt=12, idleTimeout=0, handshakeTimeout=10000, jdbcEnabled=true, odbcEnabled=true, thinCliEnabled=true, sslEnabled=false, useIgniteSslCtxFactory=true, sslClientAuth=false, sslCtxFactory=null, thinCliCfg=ThinClientConfiguration [maxActiveTxPerConn=100, maxActiveComputeTasksPerConn=0]], mvccVacuumThreadCnt=2, mvccVacuumFreq=5000, authEnabled=false, failureHnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]], commFailureRslvr=null, sqlCfg=SqlConfiguration [longQryWarnTimeout=3000, dfltQryTimeout=0, sqlQryHistSize=1000, validationEnabled=false], asyncContinuationExecutor=null] [21:03:08] : [Step 4/5] [2021-11-19 21:03:08,897][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][GridInternalTaskUnusedWalSegmentsTest1] Daemon mode: off [21:03:08] : [Step 4/5] [2021-11-19 21:03:08,897][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][GridInternalTaskUnusedWalSegmentsTest1] OS: Linux 4.15.0-151-generic amd64 [21:03:08] : [Step 4/5] [2021-11-19 21:03:08,897][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][GridInternalTaskUnusedWalSegmentsTest1] OS user: teamcity [21:03:08] : [Step 4/5] [2021-11-19 21:03:08,898][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][GridInternalTaskUnusedWalSegmentsTest1] PID: 16724 [21:03:08] : [Step 4/5] [2021-11-19 21:03:08,898][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][GridInternalTaskUnusedWalSegmentsTest1] Language runtime: Java Platform API Specification ver. 1.8 [21:03:08] : [Step 4/5] [2021-11-19 21:03:08,899][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][GridInternalTaskUnusedWalSegmentsTest1] VM information: Java(TM) SE Runtime Environment 1.8.0_261-b12 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 25.261-b12 [21:03:08] : [Step 4/5] [2021-11-19 21:03:08,899][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][GridInternalTaskUnusedWalSegmentsTest1] VM total memory: 1.9GB [21:03:08] : [Step 4/5] [2021-11-19 21:03:08,900][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][GridInternalTaskUnusedWalSegmentsTest1] Remote Management [restart: off, REST: off, JMX (remote: off)] [21:03:08] : [Step 4/5] [2021-11-19 21:03:08,900][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][GridInternalTaskUnusedWalSegmentsTest1] Logger: GridTestLog4jLogger [quiet=false, config=null] [21:03:08] : [Step 4/5] [2021-11-19 21:03:08,900][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][GridInternalTaskUnusedWalSegmentsTest1] IGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c [21:03:08] : [Step 4/5] [2021-11-19 21:03:08,901][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][GridInternalTaskUnusedWalSegmentsTest1] VM arguments: [-DIGNITE_DUMP_THREADS_ON_FAILURE=false, -DMono=/usr/bin/mono-sgen, -DMono4.0_x64=/usr/lib/mono/4.0, -DMono4.5_x64=/usr/lib/mono/4.5, -DMonoVersion=6.12.0.90, -DSKIP_BUILD=false, -Dagent.home.dir=/opt/buildagent, -Dagent.name=aitc-lin02_03, -Dagent.ownPort=9090, -Dagent.work.dir=/opt/buildagent/work, -Dbuild.number=95, -Dbuild.vcs.number=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.1=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.GitHubApacheIgnite=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dclassworlds.conf=/opt/buildagent/temp/buildTmp/teamcity.m2.conf, -Dcom.jetbrains.maven.watcher.report.file=/opt/buildagent/temp/buildTmp/maven-build-info.xml, -Djava.io.tmpdir=/opt/buildagent/temp/buildTmp, -Dmaven.home=/opt/buildagent/tools/maven3_6, -Dmaven.multiModuleProjectDirectory=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.agent.cpuBenchmark=457, -Dteamcity.agent.dotnet.agent_url=http://localhost:9090/RPC2, -Dteamcity.agent.dotnet.build_id=6278078, -Dteamcity.auth.password=*******, -Dteamcity.auth.userId=TeamCityBuildId=6278078, -Dteamcity.build.changedFiles.file=/opt/buildagent/temp/buildTmp/changedFiles6342607772318147725.txt, -Dteamcity.build.checkoutDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.build.id=6278078, -Dteamcity.build.properties.file=/opt/buildagent/temp/buildTmp/teamcity.build5164517880467851002.properties, -Dteamcity.build.tempDir=/opt/buildagent/temp/buildTmp, -Dteamcity.build.workingDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.buildConfName=Basic 3, -Dteamcity.buildType.id=IgniteTests24Java8_Basic3, -Dteamcity.configuration.properties.file=/opt/buildagent/temp/buildTmp/teamcity.config5591980786735343870.properties, -Dteamcity.maven.userSettings.path=/opt/buildagent/temp/buildTmp/maven_settings_585072866407032347.xml, -Dteamcity.maven.watcher.home=/opt/buildagent/plugins/mavenPlugin/maven-watcher-jdk16, -Dteamcity.projectName=Ignite Tests 2.x (JDK 8/11), -Dteamcity.runner.properties.file=/opt/buildagent/temp/buildTmp/teamcity.runner9098465561618137420.properties, -Dteamcity.tests.recentlyFailedTests.file=/opt/buildagent/temp/buildTmp/testsToRunFirst3891775683130404069.txt, -Dteamcity.version=2021.2 (build 99542), -ea, -Xms2g, -Xmx2g, -XX:+HeapDumpOnOutOfMemoryError, -DIGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_TEST_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_UPDATE_NOTIFIER=false, -DIGNITE_NO_DISCO_ORDER=true, -DIGNITE_PERFORMANCE_SUGGESTIONS_DISABLED=true, -Djava.net.preferIPv4Stack=true, -DTEST_SCALE_FACTOR=1.0, -DIGNITE_TEST_PROP_LOG4J_FILE=log4j-tc-test.xml, -DIGNITE_QUIET=false, -DIGNITE_MARSHAL_BUFFERS_RECHECK=1000, -Dmaven.repo.local=/opt/buildagent/.m2/repository] [21:03:08] : [Step 4/5] [2021-11-19 21:03:08,906][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][GridInternalTaskUnusedWalSegmentsTest1] System cache's DataRegion size is configured to 40 MB. Use DataStorageConfiguration.systemRegionInitialSize property to change the setting. [21:03:08] : [Step 4/5] [2021-11-19 21:03:08,907][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][GridInternalTaskUnusedWalSegmentsTest1] Configured caches [in 'sysMemPlc' dataRegion: ['ignite-sys-cache'], in 'default' dataRegion: ['default']] [21:03:08] : [Step 4/5] [2021-11-19 21:03:08,908][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][GridInternalTaskUnusedWalSegmentsTest1] 3-rd party licenses can be found at: /opt/buildagent/work/7bc1c54bc719b67c/libs/licenses [21:03:08]W: [org.apache.ignite:ignite-core] [2021-11-19 21:03:08,908][WARN ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][GridInternalTaskUnusedWalSegmentsTest1] Peer class loading is enabled (disable it in production for performance and deployment consistency reasons) [21:03:08] : [Step 4/5] [2021-11-19 21:03:08,914][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][IgnitePluginProcessor] Configured plugins: [21:03:08] : [Step 4/5] [2021-11-19 21:03:08,914][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][IgnitePluginProcessor] ^-- StanByClusterTestProvider 1.0 [21:03:08] : [Step 4/5] [2021-11-19 21:03:08,914][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][IgnitePluginProcessor] ^-- null [21:03:08] : [Step 4/5] [2021-11-19 21:03:08,915][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][IgnitePluginProcessor] [21:03:08] : [Step 4/5] [2021-11-19 21:03:08,915][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][IgnitePluginProcessor] ^-- PageMemory tracker plugin 1.0 [21:03:08] : [Step 4/5] [2021-11-19 21:03:08,915][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][IgnitePluginProcessor] ^-- null [21:03:08] : [Step 4/5] [2021-11-19 21:03:08,915][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][IgnitePluginProcessor] [21:03:08] : [Step 4/5] [2021-11-19 21:03:08,916][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][IgnitePluginProcessor] ^-- TestDistibutedConfigurationPlugin 1.0 [21:03:08] : [Step 4/5] [2021-11-19 21:03:08,916][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][IgnitePluginProcessor] ^-- null [21:03:08] : [Step 4/5] [2021-11-19 21:03:08,916][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][IgnitePluginProcessor] [21:03:08] : [Step 4/5] [2021-11-19 21:03:08,917][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][IgnitePluginProcessor] ^-- NodeValidationPluginProvider 1.0 [21:03:08] : [Step 4/5] [2021-11-19 21:03:08,917][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][IgnitePluginProcessor] ^-- null [21:03:08] : [Step 4/5] [2021-11-19 21:03:08,917][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][IgnitePluginProcessor] [21:03:08] : [Step 4/5] [2021-11-19 21:03:08,918][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][FailureProcessor] Configured failure handler: [hnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]]] [21:03:08] : [Step 4/5] [2021-11-19 21:03:08,978][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][TcpCommunicationSpi] Successfully bound communication NIO server to TCP port [port=45091, locHost=/127.0.0.1, selectorsCnt=12, selectorSpins=0, pairedConn=false] [21:03:08]W: [org.apache.ignite:ignite-core] [2021-11-19 21:03:08,979][WARN ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][TcpCommunicationSpi] Message queue limit is set to 0 which may lead to potential OOMEs when running cache operations in FULL_ASYNC or PRIMARY_SYNC modes due to message queues growth on sender and receiver sides. [21:03:09] : [Step 4/5] [2021-11-19 21:03:09,015][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][GridCollisionManager] Collision resolution is disabled (all jobs will be activated upon arrival). [21:03:09] : [Step 4/5] [2021-11-19 21:03:09,015][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][GridInternalTaskUnusedWalSegmentsTest1] Security status [authentication=off, sandbox=off, tls/ssl=off] [21:03:09] : [Step 4/5] [2021-11-19 21:03:09,017][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][TestTcpDiscoverySpi] Successfully bound to TCP port [port=47501, localHost=localhost/127.0.0.1, locNodeId=a6e2d1b8-e889-42a6-b138-d6edb8d00001] [21:03:09]W: [org.apache.ignite:ignite-core] [2021-11-19 21:03:09,018][WARN ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][PdsFoldersResolver] Failed to acquire file lock. Will try again in 1s [nodeId=a6e2d1b8-e889-42a6-b138-d6edb8d00001, holder=[e5c7f7dd-47b7-4ab6-9149-6791d3600000][], path=/opt/buildagent/work/7bc1c54bc719b67c/work/db/node00-87f16126-5f72-4dfe-a561-76ce966f5d95/lock] [21:03:10] : [Step 4/5] [2021-11-19 21:03:10,019][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][PdsFoldersResolver] Unable to acquire lock to file [/opt/buildagent/work/7bc1c54bc719b67c/work/db/node00-87f16126-5f72-4dfe-a561-76ce966f5d95], reason: Failed to acquire file lock [holder=[e5c7f7dd-47b7-4ab6-9149-6791d3600000][], time=1 sec, path=/opt/buildagent/work/7bc1c54bc719b67c/work/db/node00-87f16126-5f72-4dfe-a561-76ce966f5d95/lock] [21:03:10] : [Step 4/5] [2021-11-19 21:03:10,022][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][PdsFoldersResolver] Successfully created new persistent storage folder [/opt/buildagent/work/7bc1c54bc719b67c/work/db/node01-e7427b46-5e04-4060-9e7a-4a56d318815a] [21:03:10] : [Step 4/5] [2021-11-19 21:03:10,023][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][PdsFoldersResolver] Consistent ID used for local node is [e7427b46-5e04-4060-9e7a-4a56d318815a] according to persistence data storage folders [21:03:10] : [Step 4/5] [2021-11-19 21:03:10,023][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][MaintenanceProcessor] Resolved store directory for node persistent data: /opt/buildagent/work/7bc1c54bc719b67c/work/db/node01-e7427b46-5e04-4060-9e7a-4a56d318815a [21:03:10] : [Step 4/5] [2021-11-19 21:03:10,025][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][CacheObjectBinaryProcessorImpl] Resolved directory for serialized binary metadata: /opt/buildagent/work/7bc1c54bc719b67c/work/db/binary_meta/node01-e7427b46-5e04-4060-9e7a-4a56d318815a [21:03:10] : [Step 4/5] [2021-11-19 21:03:10,033][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/node01-e7427b46-5e04-4060-9e7a-4a56d318815a [21:03:10] : [Step 4/5] [2021-11-19 21:03:10,034][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][FileWriteAheadLogManager] Resolved write ahead log work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/node01-e7427b46-5e04-4060-9e7a-4a56d318815a [21:03:10] : [Step 4/5] [2021-11-19 21:03:10,034][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][FileWriteAheadLogManager] Resolved write ahead log archive directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/node01-e7427b46-5e04-4060-9e7a-4a56d318815a [21:03:10] : [Step 4/5] [2021-11-19 21:03:10,043][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/node01-e7427b46-5e04-4060-9e7a-4a56d318815a/0000000000000000.wal [21:03:10] : [Step 4/5] [2021-11-19 21:03:10,044][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][FileHandleManagerImpl] Initialized write-ahead log manager [mode=LOG_ONLY] [21:03:10] : [Step 4/5] [2021-11-19 21:03:10,053][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][GridCacheDatabaseSharedManager] Configured data regions initialized successfully [total=5] [21:03:10] : [Step 4/5] [2021-11-19 21:03:10,055][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][IgniteSnapshotManager] Resolved snapshot work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/snapshots [21:03:10] : [Step 4/5] [2021-11-19 21:03:10,055][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][IgniteSnapshotManager] Resolved temp directory for snapshot creation: /opt/buildagent/work/7bc1c54bc719b67c/work/db/node01-e7427b46-5e04-4060-9e7a-4a56d318815a/snp [21:03:10] : [Step 4/5] [2021-11-19 21:03:10,060][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][ClientListenerProcessor] Client connector processor has started on TCP port 10801 [21:03:10] : [Step 4/5] [2021-11-19 21:03:10,064][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][GridInternalTaskUnusedWalSegmentsTest1] Non-loopback local IPs: 172.17.0.4 [21:03:10] : [Step 4/5] [2021-11-19 21:03:10,064][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][GridInternalTaskUnusedWalSegmentsTest1] Enabled local MACs: 0242AC110004 [21:03:10] : [Step 4/5] [2021-11-19 21:03:10,066][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:03:10] : [Step 4/5] [2021-11-19 21:03:10,068][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:03:10] : [Step 4/5] [2021-11-19 21:03:10,069][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:03:10] : [Step 4/5] [2021-11-19 21:03:10,076][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][GridCacheDatabaseSharedManager] Applying lost metastore updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:03:10] : [Step 4/5] [2021-11-19 21:03:10,079][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=0 ms] [21:03:10] : [Step 4/5] [2021-11-19 21:03:10,079][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][GridCacheProcessor] Restoring partition state for local groups. [21:03:10] : [Step 4/5] [2021-11-19 21:03:10,080][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=0, partitionsProcessed=0, time=0ms] [21:03:10] : [Step 4/5] [2021-11-19 21:03:10,081][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][GridEncryptionManager] Encryption keys loaded from metastore. [grps=, masterKeyName=null] [21:03:10] : [Step 4/5] [2021-11-19 21:03:10,084][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][ClusterProcessor] Cluster ID and tag has been read from metastorage: null [21:03:10] : [Step 4/5] [2021-11-19 21:03:10,084][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][IgniteClusterImpl] Shutdown policy was updated [oldVal=null, newVal=null] [21:03:10] : [Step 4/5] [2021-11-19 21:03:10,085][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][GridCacheDatabaseSharedManager] Checkpoint frequency deviation changed [oldVal=null, newVal=null] [21:03:10] : [Step 4/5] [2021-11-19 21:03:10,095][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][FilePageStoreManager] Cleanup cache stores [total=1, left=0, cleanFiles=false] [21:03:10] : [Step 4/5] [2021-11-19 21:03:10,100][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:03:10] : [Step 4/5] [2021-11-19 21:03:10,102][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:03:10] : [Step 4/5] [2021-11-19 21:03:10,104][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:03:10] : [Step 4/5] [2021-11-19 21:03:10,105][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][GridCacheDatabaseSharedManager] Data Regions Started: 5 [21:03:10] : [Step 4/5] [2021-11-19 21:03:10,106][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][GridCacheDatabaseSharedManager] ^-- sysMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:03:10] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:03:10] : [Step 4/5] ^-- default region [type=default, persistence=true, lazyAlloc=true, [21:03:10] : [Step 4/5] ... initCfg=100MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB, allocTotal=0MB] [21:03:10] : [Step 4/5] ^-- metastoreMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:03:10] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:03:10] : [Step 4/5] ^-- TxLog region [type=internal, persistence=true, lazyAlloc=false, [21:03:10] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:03:10] : [Step 4/5] ^-- volatileDsMemPlc region [type=user, persistence=false, lazyAlloc=true, [21:03:10] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB] [21:03:10] : [Step 4/5] ^-- Ignite persistence [used=0MB] [21:03:10] : [Step 4/5] [21:03:10] : [Step 4/5] [2021-11-19 21:03:10,108][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][GridCacheDatabaseSharedManager] Starting binary memory restore for: [1544803905, -2100569601] [21:03:10] : [Step 4/5] [2021-11-19 21:03:10,125][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:03:10] : [Step 4/5] [2021-11-19 21:03:10,125][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:03:10] : [Step 4/5] [2021-11-19 21:03:10,127][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/node01-e7427b46-5e04-4060-9e7a-4a56d318815a/0000000000000000.wal, offset=0, ver=2] [21:03:10] : [Step 4/5] [2021-11-19 21:03:10,132][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:03:10] : [Step 4/5] [2021-11-19 21:03:10,137][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][GridCacheProcessor] Started cache in recovery mode [name=default, id=1544803905, dataRegionName=default, mode=PARTITIONED, atomicity=ATOMIC, backups=0, mvcc=false] [21:03:10] : [Step 4/5] [2021-11-19 21:03:10,141][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][GridCacheProcessor] Started cache in recovery mode [name=ignite-sys-cache, id=-2100569601, dataRegionName=sysMemPlc, mode=REPLICATED, atomicity=TRANSACTIONAL, backups=2147483647, mvcc=false] [21:03:10] : [Step 4/5] [2021-11-19 21:03:10,142][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][GridCacheDatabaseSharedManager] Binary recovery performed in 34 ms. [21:03:10] : [Step 4/5] [2021-11-19 21:03:10,143][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:03:10] : [Step 4/5] [2021-11-19 21:03:10,143][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][GridCacheDatabaseSharedManager] Applying lost cache updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:03:10] : [Step 4/5] [2021-11-19 21:03:10,147][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=0 ms] [21:03:10] : [Step 4/5] [2021-11-19 21:03:10,147][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][GridCacheProcessor] Restoring partition state for local groups. [21:03:10] : [Step 4/5] [2021-11-19 21:03:10,159][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=2, partitionsProcessed=132, time=21ms] [21:03:10] : [Step 4/5] [2021-11-19 21:03:10,168][INFO ][tcp-disco-srvr-[:47500]-#217%util.GridInternalTaskUnusedWalSegmentsTest0%-#4540%util.GridInternalTaskUnusedWalSegmentsTest0%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=50903] [21:03:10] : [Step 4/5] [2021-11-19 21:03:10,169][INFO ][tcp-disco-srvr-[:47500]-#217%util.GridInternalTaskUnusedWalSegmentsTest0%-#4540%util.GridInternalTaskUnusedWalSegmentsTest0%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=50903] [21:03:10] : [Step 4/5] [2021-11-19 21:03:10,170][INFO ][tcp-disco-sock-reader-[]-#223%util.GridInternalTaskUnusedWalSegmentsTest0%-#4661%util.GridInternalTaskUnusedWalSegmentsTest0%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:50903, rmtPort=50903] [21:03:10] : [Step 4/5] [2021-11-19 21:03:10,171][INFO ][tcp-disco-sock-reader-[a6e2d1b8 127.0.0.1:50903]-#223%util.GridInternalTaskUnusedWalSegmentsTest0%-#4661%util.GridInternalTaskUnusedWalSegmentsTest0%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=a6e2d1b8-e889-42a6-b138-d6edb8d00001, rmtAddr=/127.0.0.1:50903] [21:03:10] : [Step 4/5] [2021-11-19 21:03:10,177][INFO ][tcp-disco-srvr-[:47501]-#222%util.GridInternalTaskUnusedWalSegmentsTest1%-#4660%util.GridInternalTaskUnusedWalSegmentsTest1%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=43529] [21:03:10] : [Step 4/5] [2021-11-19 21:03:10,178][INFO ][tcp-disco-srvr-[:47501]-#222%util.GridInternalTaskUnusedWalSegmentsTest1%-#4660%util.GridInternalTaskUnusedWalSegmentsTest1%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=43529] [21:03:10] : [Step 4/5] [2021-11-19 21:03:10,180][INFO ][tcp-disco-sock-reader-[]-#224%util.GridInternalTaskUnusedWalSegmentsTest1%-#4662%util.GridInternalTaskUnusedWalSegmentsTest1%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:43529, rmtPort=43529] [21:03:10] : [Step 4/5] [2021-11-19 21:03:10,181][INFO ][tcp-disco-sock-reader-[]-#224%util.GridInternalTaskUnusedWalSegmentsTest1%-#4662%util.GridInternalTaskUnusedWalSegmentsTest1%][TestTcpDiscoverySpi] Received ping request from the remote node [rmtNodeId=e5c7f7dd-47b7-4ab6-9149-6791d3600000, rmtAddr=/127.0.0.1:43529, rmtPort=43529] [21:03:10] : [Step 4/5] [2021-11-19 21:03:10,182][INFO ][tcp-disco-sock-reader-[]-#224%util.GridInternalTaskUnusedWalSegmentsTest1%-#4662%util.GridInternalTaskUnusedWalSegmentsTest1%][TestTcpDiscoverySpi] Finished writing ping response [rmtNodeId=e5c7f7dd-47b7-4ab6-9149-6791d3600000, rmtAddr=/127.0.0.1:43529, rmtPort=43529] [21:03:10]W: [org.apache.ignite:ignite-core] [2021-11-19 21:03:10,183][WARN ][tcp-disco-sock-reader-[]-#224%util.GridInternalTaskUnusedWalSegmentsTest1%-#4662%util.GridInternalTaskUnusedWalSegmentsTest1%][TestTcpDiscoverySpi] Failed to shutdown socket [21:03:10]W: [org.apache.ignite:ignite-core] java.net.SocketException: Socket output is already shutdown [21:03:10]W: [org.apache.ignite:ignite-core] at java.net.Socket.shutdownOutput(Socket.java:1572) [21:03:10]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.close(IgniteUtils.java:4247) [21:03:10]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.discovery.tcp.ServerImpl$SocketReader.body(ServerImpl.java:7370) [21:03:10]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.IgniteSpiThread.run(IgniteSpiThread.java:58) [21:03:10] : [Step 4/5] [2021-11-19 21:03:10,183][INFO ][tcp-disco-sock-reader-[a6e2d1b8 127.0.0.1:50903]-#223%util.GridInternalTaskUnusedWalSegmentsTest0%-#4661%util.GridInternalTaskUnusedWalSegmentsTest0%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:50903, rmtPort=50903, rmtNodeId=a6e2d1b8-e889-42a6-b138-d6edb8d00001] [21:03:10] : [Step 4/5] [2021-11-19 21:03:10,185][INFO ][tcp-disco-sock-reader-[]-#224%util.GridInternalTaskUnusedWalSegmentsTest1%-#4662%util.GridInternalTaskUnusedWalSegmentsTest1%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:43529, rmtPort=43529, rmtNodeId=null] [21:03:10] : [Step 4/5] [2021-11-19 21:03:10,187][INFO ][tcp-disco-msg-worker-[crd]-#216%util.GridInternalTaskUnusedWalSegmentsTest0%-#4539%util.GridInternalTaskUnusedWalSegmentsTest0%][GridEncryptionManager] Joining node doesn't have stored group keys [node=a6e2d1b8-e889-42a6-b138-d6edb8d00001] [21:03:10] : [Step 4/5] [2021-11-19 21:03:10,197][INFO ][tcp-disco-msg-worker-[crd]-#216%util.GridInternalTaskUnusedWalSegmentsTest0%-#4539%util.GridInternalTaskUnusedWalSegmentsTest0%][TestTcpDiscoverySpi] New next node [newNext=TcpDiscoveryNode [id=a6e2d1b8-e889-42a6-b138-d6edb8d00001, consistentId=e7427b46-5e04-4060-9e7a-4a56d318815a, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=0, intOrder=2, lastExchangeTime=1637344990169, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false]] [21:03:10] : [Step 4/5] [2021-11-19 21:03:10,198][INFO ][tcp-disco-srvr-[:47501]-#222%util.GridInternalTaskUnusedWalSegmentsTest1%-#4660%util.GridInternalTaskUnusedWalSegmentsTest1%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=57623] [21:03:10] : [Step 4/5] [2021-11-19 21:03:10,199][INFO ][tcp-disco-srvr-[:47501]-#222%util.GridInternalTaskUnusedWalSegmentsTest1%-#4660%util.GridInternalTaskUnusedWalSegmentsTest1%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=57623] [21:03:10] : [Step 4/5] [2021-11-19 21:03:10,199][INFO ][tcp-disco-sock-reader-[]-#225%util.GridInternalTaskUnusedWalSegmentsTest1%-#4663%util.GridInternalTaskUnusedWalSegmentsTest1%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:57623, rmtPort=57623] [21:03:10] : [Step 4/5] [2021-11-19 21:03:10,201][INFO ][tcp-disco-sock-reader-[e5c7f7dd 127.0.0.1:57623]-#225%util.GridInternalTaskUnusedWalSegmentsTest1%-#4663%util.GridInternalTaskUnusedWalSegmentsTest1%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=e5c7f7dd-47b7-4ab6-9149-6791d3600000, rmtAddr=/127.0.0.1:57623] [21:03:10] : [Step 4/5] [2021-11-19 21:03:10,205][INFO ][tcp-disco-msg-worker-[]-#221%util.GridInternalTaskUnusedWalSegmentsTest1%-#4659%util.GridInternalTaskUnusedWalSegmentsTest1%][TestTcpDiscoverySpi] New next node [newNext=TcpDiscoveryNode [id=e5c7f7dd-47b7-4ab6-9149-6791d3600000, consistentId=87f16126-5f72-4dfe-a561-76ce966f5d95, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637344990199, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false]] [21:03:10] : [Step 4/5] [2021-11-19 21:03:10,206][INFO ][tcp-disco-srvr-[:47500]-#217%util.GridInternalTaskUnusedWalSegmentsTest0%-#4540%util.GridInternalTaskUnusedWalSegmentsTest0%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=60179] [21:03:10] : [Step 4/5] [2021-11-19 21:03:10,207][INFO ][tcp-disco-srvr-[:47500]-#217%util.GridInternalTaskUnusedWalSegmentsTest0%-#4540%util.GridInternalTaskUnusedWalSegmentsTest0%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=60179] [21:03:10] : [Step 4/5] [2021-11-19 21:03:10,207][INFO ][tcp-disco-sock-reader-[]-#226%util.GridInternalTaskUnusedWalSegmentsTest0%-#4664%util.GridInternalTaskUnusedWalSegmentsTest0%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:60179, rmtPort=60179] [21:03:10] : [Step 4/5] [2021-11-19 21:03:10,209][INFO ][tcp-disco-sock-reader-[a6e2d1b8 127.0.0.1:60179]-#226%util.GridInternalTaskUnusedWalSegmentsTest0%-#4664%util.GridInternalTaskUnusedWalSegmentsTest0%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=a6e2d1b8-e889-42a6-b138-d6edb8d00001, rmtAddr=/127.0.0.1:60179] [21:03:10] : [Step 4/5] [2021-11-19 21:03:10,212][INFO ][disco-event-worker-#4542%util.GridInternalTaskUnusedWalSegmentsTest0%][GridDiscoveryManager] Added new node to topology: TcpDiscoveryNode [id=a6e2d1b8-e889-42a6-b138-d6edb8d00001, consistentId=e7427b46-5e04-4060-9e7a-4a56d318815a, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637344990169, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false] [21:03:10] : [Step 4/5] [2021-11-19 21:03:10,214][INFO ][disco-event-worker-#4542%util.GridInternalTaskUnusedWalSegmentsTest0%][GridDiscoveryManager] Topology snapshot [ver=2, locNode=e5c7f7dd, servers=2, clients=0, state=INACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=e5c7f7dd-47b7-4ab6-9149-6791d3600000, consistentId=87f16126-5f72-4dfe-a561-76ce966f5d95, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=a6e2d1b8-e889-42a6-b138-d6edb8d00001, consistentId=e7427b46-5e04-4060-9e7a-4a56d318815a, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:03:10] : [Step 4/5] [2021-11-19 21:03:10,217][INFO ][tcp-disco-msg-worker-[e5c7f7dd 127.0.0.1:47500]-#221%util.GridInternalTaskUnusedWalSegmentsTest1%-#4659%util.GridInternalTaskUnusedWalSegmentsTest1%][ClusterProcessor] infallible_faraday [21:03:10] : [Step 4/5] [2021-11-19 21:03:10,217][INFO ][tcp-disco-msg-worker-[e5c7f7dd 127.0.0.1:47500]-#221%util.GridInternalTaskUnusedWalSegmentsTest1%-#4659%util.GridInternalTaskUnusedWalSegmentsTest1%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustEnabled' was changed from 'null' to 'false' [21:03:10] : [Step 4/5] [2021-11-19 21:03:10,218][INFO ][tcp-disco-msg-worker-[e5c7f7dd 127.0.0.1:47500]-#221%util.GridInternalTaskUnusedWalSegmentsTest1%-#4659%util.GridInternalTaskUnusedWalSegmentsTest1%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustTimeout' was changed from 'null' to '300000' [21:03:10] : [Step 4/5] [2021-11-19 21:03:10,218][INFO ][tcp-disco-msg-worker-[e5c7f7dd 127.0.0.1:47500]-#221%util.GridInternalTaskUnusedWalSegmentsTest1%-#4659%util.GridInternalTaskUnusedWalSegmentsTest1%][IgniteTxManager] Transactions parameter 'longOperationsDumpTimeout' was changed from 'null' to '60000' [21:03:10] : [Step 4/5] [2021-11-19 21:03:10,219][INFO ][tcp-disco-msg-worker-[e5c7f7dd 127.0.0.1:47500]-#221%util.GridInternalTaskUnusedWalSegmentsTest1%-#4659%util.GridInternalTaskUnusedWalSegmentsTest1%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpThreshold' was changed from 'null' to '0' [21:03:10] : [Step 4/5] [2021-11-19 21:03:10,219][INFO ][tcp-disco-msg-worker-[e5c7f7dd 127.0.0.1:47500]-#221%util.GridInternalTaskUnusedWalSegmentsTest1%-#4659%util.GridInternalTaskUnusedWalSegmentsTest1%][IgniteTxManager] Transactions parameter 'transactionTimeDumpSamplesCoefficient' was changed from 'null' to '0.0' [21:03:10] : [Step 4/5] [2021-11-19 21:03:10,220][INFO ][tcp-disco-msg-worker-[e5c7f7dd 127.0.0.1:47500]-#221%util.GridInternalTaskUnusedWalSegmentsTest1%-#4659%util.GridInternalTaskUnusedWalSegmentsTest1%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpSamplesPerSecondLimit' was changed from 'null' to '5' [21:03:10] : [Step 4/5] [2021-11-19 21:03:10,220][INFO ][tcp-disco-msg-worker-[e5c7f7dd 127.0.0.1:47500]-#221%util.GridInternalTaskUnusedWalSegmentsTest1%-#4659%util.GridInternalTaskUnusedWalSegmentsTest1%][IgniteTxManager] Transactions parameter 'collisionsDumpInterval' was changed from 'null' to '1000' [21:03:10] : [Step 4/5] [2021-11-19 21:03:10,221][INFO ][tcp-disco-msg-worker-[e5c7f7dd 127.0.0.1:47500]-#221%util.GridInternalTaskUnusedWalSegmentsTest1%-#4659%util.GridInternalTaskUnusedWalSegmentsTest1%][IgniteTxManager] Transactions parameter 'txOwnerDumpRequestsAllowed' was changed from 'null' to 'true' [21:03:10] : [Step 4/5] [2021-11-19 21:03:10,221][INFO ][tcp-disco-msg-worker-[e5c7f7dd 127.0.0.1:47500]-#221%util.GridInternalTaskUnusedWalSegmentsTest1%-#4659%util.GridInternalTaskUnusedWalSegmentsTest1%][GridCacheDatabaseSharedManager] Historical rebalance WAL threshold changed [property=historical.rebalance.threshold, oldVal=null, newVal=500] [21:03:10] : [Step 4/5] [2021-11-19 21:03:10,222][INFO ][disco-notifier-worker-#4658%util.GridInternalTaskUnusedWalSegmentsTest1%][MvccProcessorImpl] Assigned mvcc coordinator [crd=MvccCoordinator [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=0], nodeId=e5c7f7dd-47b7-4ab6-9149-6791d3600000, ver=1637344988753, local=false, initialized=false]] [21:03:10] : [Step 4/5] [2021-11-19 21:03:10,224][INFO ][sys-#4657%util.GridInternalTaskUnusedWalSegmentsTest1%][ClusterProcessor] Writing cluster ID and tag to metastorage on ready for write ClusterIdAndTag [id=3d49fd3a-53f0-4d1a-a0f4-1e83e06bb38e, tag=infallible_faraday] [21:03:10] : [Step 4/5] [2021-11-19 21:03:10,246][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][GridInternalTaskUnusedWalSegmentsTest1] To start Console Management & Monitoring run ignitevisorcmd.{sh|bat} [21:03:10] : [Step 4/5] [2021-11-19 21:03:10,246][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][GridInternalTaskUnusedWalSegmentsTest1] [21:03:10] : [Step 4/5] [21:03:10] : [Step 4/5] >>> +-------------------------------------------+ [21:03:10] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:03:10] : [Step 4/5] >>> +-------------------------------------------+ [21:03:10] : [Step 4/5] >>> OS name: Linux 4.15.0-151-generic amd64 [21:03:10] : [Step 4/5] >>> CPU(s): 24 [21:03:10] : [Step 4/5] >>> Heap: 2.0GB [21:03:10] : [Step 4/5] >>> VM name: 16724@c4dfe9a430b2 [21:03:10] : [Step 4/5] >>> Ignite instance name: util.GridInternalTaskUnusedWalSegmentsTest1 [21:03:10] : [Step 4/5] >>> Local node [ID=A6E2D1B8-E889-42A6-B138-D6EDB8D00001, order=2, clientMode=false] [21:03:10] : [Step 4/5] >>> Local node addresses: [127.0.0.1] [21:03:10] : [Step 4/5] >>> Local ports: TCP:10801 TCP:45091 TCP:47501 [21:03:10] : [Step 4/5] [21:03:10] : [Step 4/5] [2021-11-19 21:03:10,248][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][GridInternalTaskUnusedWalSegmentsTest1] >>> Ignite cluster is in INACTIVE state (limited functionality available). Use control.(sh|bat) script or IgniteCluster.state(ClusterState.ACTIVE) to change the state. [21:03:10] : [Step 4/5] [2021-11-19 21:03:10,248][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][GridDiscoveryManager] Topology snapshot [ver=2, locNode=a6e2d1b8, servers=2, clients=0, state=INACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=e5c7f7dd-47b7-4ab6-9149-6791d3600000, consistentId=87f16126-5f72-4dfe-a561-76ce966f5d95, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=a6e2d1b8-e889-42a6-b138-d6edb8d00001, consistentId=e7427b46-5e04-4060-9e7a-4a56d318815a, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:03:10] : [Step 4/5] [2021-11-19 21:03:10,249][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][G] Node started : [stage="Configure system pool" (0 ms),stage="Start managers" (1143 ms),stage="Configure binary metadata" (4 ms),stage="Start processors" (33 ms),stage="Start 'StanByClusterTestProvider' plugin" (0 ms),stage="Start 'PageMemory tracker plugin' plugin" (0 ms),stage="Start 'TestDistibutedConfigurationPlugin' plugin" (0 ms),stage="Start 'NodeValidationPluginProvider' plugin" (0 ms),stage="Init metastore" (31 ms),stage="Init and start regions" (12 ms),stage="Restore binary memory" (34 ms),stage="Restore logical state" (16 ms),stage="Finish recovery" (4 ms),stage="Join topology" (58 ms),stage="Await transition" (3 ms),stage="Await exchange" (23 ms),stage="Total time" (1361 ms)] [21:03:10] : [Step 4/5] [2021-11-19 21:03:10,250][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][root] Node started with the following configuration [id=a6e2d1b8-e889-42a6-b138-d6edb8d00001, marshaller=BinaryMarshaller [], discovery=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=5000, ackTimeout=5000, marsh=JdkMarshaller [clsFilter=org.apache.ignite.marshaller.MarshallerUtils$1@75eb8511], reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], binaryCfg=null, lateAff=true] [21:03:10]W: [org.apache.ignite:ignite-core] [2021-11-19 21:03:10,258][WARN ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][G] Ignite work directory is not provided, automatically resolved to: /opt/buildagent/work/7bc1c54bc719b67c/work [21:03:10]W: [org.apache.ignite:ignite-core] [2021-11-19 21:03:10,258][WARN ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][G] Consistent ID is not set, it is recommended to set consistent ID for production clusters (use IgniteConfiguration.setConsistentId property) [21:03:10] : [Step 4/5] [2021-11-19 21:03:10,259][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][GridInternalTaskUnusedWalSegmentsTest2] [21:03:10] : [Step 4/5] [21:03:10] : [Step 4/5] >>> __________ ________________ [21:03:10] : [Step 4/5] >>> / _/ ___/ |/ / _/_ __/ __/ [21:03:10] : [Step 4/5] >>> _/ // (7 7 // / / / / _/ [21:03:10] : [Step 4/5] >>> /___/\___/_/|_/___/ /_/ /___/ [21:03:10] : [Step 4/5] >>> [21:03:10] : [Step 4/5] >>> ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:03:10] : [Step 4/5] >>> 2021 Copyright(C) Apache Software Foundation [21:03:10] : [Step 4/5] >>> [21:03:10] : [Step 4/5] >>> Ignite documentation: http://ignite.apache.org [21:03:10] : [Step 4/5] [21:03:10] : [Step 4/5] [2021-11-19 21:03:10,260][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][GridInternalTaskUnusedWalSegmentsTest2] Config URL: n/a [21:03:10] : [Step 4/5] [2021-11-19 21:03:10,261][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][GridInternalTaskUnusedWalSegmentsTest2] IgniteConfiguration [igniteInstanceName=util.GridInternalTaskUnusedWalSegmentsTest2, pubPoolSize=24, svcPoolSize=24, callbackPoolSize=24, stripedPoolSize=24, sysPoolSize=24, mgmtPoolSize=4, dataStreamerPoolSize=24, utilityCachePoolSize=24, utilityCacheKeepAliveTime=60000, p2pPoolSize=2, qryPoolSize=24, buildIdxPoolSize=4, igniteHome=/opt/buildagent/work/7bc1c54bc719b67c, igniteWorkDir=/opt/buildagent/work/7bc1c54bc719b67c/work, mbeanSrv=com.sun.jmx.mbeanserver.JmxMBeanServer@6fe85038, nodeId=d2cfc867-15f3-4259-8cff-46a016a00002, marsh=BinaryMarshaller [], marshLocJobs=false, daemon=false, p2pEnabled=true, netTimeout=10000, netCompressionLevel=1, sndRetryDelay=1000, sndRetryCnt=3, metricsHistSize=10000, metricsUpdateFreq=1000, metricsExpTime=9223372036854775807, discoSpi=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=0, ackTimeout=0, marsh=null, reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], segPlc=STOP, segResolveAttempts=2, waitForSegOnStart=true, allResolversPassReq=true, segChkFreq=10000, commSpi=TcpCommunicationSpi [connectGate=org.apache.ignite.spi.communication.tcp.internal.ConnectGateway@426f56b5, ctxInitLatch=java.util.concurrent.CountDownLatch@680114c5[Count = 1], stopping=false, clientPool=null, nioSrvWrapper=null, stateProvider=null], evtSpi=MemoryEventStorageSpi [expireAgeMs=9223372036854775807, expireCnt=10000, filter=null], colSpi=NoopCollisionSpi [], deploySpi=LocalDeploymentSpi [], indexingSpi=org.apache.ignite.spi.indexing.noop.NoopIndexingSpi@31520cec, addrRslvr=null, encryptionSpi=org.apache.ignite.spi.encryption.noop.NoopEncryptionSpi@6a5b2d6a, tracingSpi=org.apache.ignite.spi.tracing.NoopTracingSpi@3e5ac147, clientMode=false, rebalanceThreadPoolSize=4, rebalanceTimeout=10000, rebalanceBatchesPrefetchCnt=3, rebalanceThrottle=0, rebalanceBatchSize=524288, txCfg=TransactionConfiguration [txSerEnabled=false, dfltIsolation=REPEATABLE_READ, dfltConcurrency=PESSIMISTIC, dfltTxTimeout=0, txTimeoutOnPartitionMapExchange=0, deadlockTimeout=10000, pessimisticTxLogSize=0, pessimisticTxLogLinger=10000, tmLookupClsName=null, txManagerFactory=null, useJtaSync=false], cacheSanityCheckEnabled=true, discoStartupDelay=60000, deployMode=SHARED, p2pMissedCacheSize=100, locHost=127.0.0.1, timeSrvPortBase=31100, timeSrvPortRange=100, failureDetectionTimeout=10000, sysWorkerBlockedTimeout=null, clientFailureDetectionTimeout=10000, metricsLogFreq=0, connectorCfg=null, odbcCfg=null, warmupClos=null, atomicCfg=AtomicConfiguration [seqReserveSize=1000, cacheMode=PARTITIONED, backups=1, aff=null, grpName=null], classLdr=null, sslCtxFactory=null, platformCfg=null, binaryCfg=null, memCfg=null, pstCfg=null, dsCfg=DataStorageConfiguration [sysRegionInitSize=41943040, sysRegionMaxSize=104857600, pageSize=4096, concLvl=0, dfltDataRegConf=DataRegionConfiguration [name=default, maxSize=104857600, initSize=268435456, swapPath=null, pageEvictionMode=DISABLED, pageReplacementMode=CLOCK, evictionThreshold=0.9, emptyPagesPoolSize=100, metricsEnabled=false, metricsSubIntervalCount=5, metricsRateTimeInterval=60000, persistenceEnabled=true, checkpointPageBufSize=0, lazyMemoryAllocation=true, warmUpCfg=null], dataRegions=null, storagePath=null, checkpointFreq=180000, lockWaitTime=10000, checkpointThreads=4, checkpointWriteOrder=SEQUENTIAL, walHistSize=2147483647, maxWalArchiveSize=1073741824, walSegments=10, walSegmentSize=1048576, walPath=db/wal, walArchivePath=db/wal/archive, cdcWalPath=db/wal/cdc, cdcEnabled=false, metricsEnabled=false, walMode=LOG_ONLY, walTlbSize=131072, walBuffSize=0, walFlushFreq=2000, walFsyncDelay=1000, walRecordIterBuffSize=67108864, alwaysWriteFullPages=false, fileIOFactory=org.apache.ignite.internal.processors.cache.persistence.file.AsyncFileIOFactory@fe85c98, metricsSubIntervalCnt=5, metricsRateTimeInterval=60000, walAutoArchiveAfterInactivity=-1, walForceArchiveTimeout=-1, writeThrottlingEnabled=false, walCompactionEnabled=false, walCompactionLevel=1, checkpointReadLockTimeout=null, walPageCompression=DISABLED, walPageCompressionLevel=null, dfltWarmUpCfg=null, encCfg=org.apache.ignite.configuration.EncryptionConfiguration@17659495, defragmentationThreadPoolSize=4, minWalArchiveSize=-1], snapshotPath=snapshots, activeOnStart=true, activeOnStartPropSetFlag=false, autoActivation=true, autoActivationPropSetFlag=false, clusterStateOnStart=null, sqlConnCfg=null, cliConnCfg=ClientConnectorConfiguration [host=null, port=10800, portRange=100, sockSndBufSize=0, sockRcvBufSize=0, tcpNoDelay=true, maxOpenCursorsPerConn=128, threadPoolSize=24, selectorCnt=12, idleTimeout=0, handshakeTimeout=10000, jdbcEnabled=true, odbcEnabled=true, thinCliEnabled=true, sslEnabled=false, useIgniteSslCtxFactory=true, sslClientAuth=false, sslCtxFactory=null, thinCliCfg=ThinClientConfiguration [maxActiveTxPerConn=100, maxActiveComputeTasksPerConn=0]], mvccVacuumThreadCnt=2, mvccVacuumFreq=5000, authEnabled=false, failureHnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]], commFailureRslvr=null, sqlCfg=SqlConfiguration [longQryWarnTimeout=3000, dfltQryTimeout=0, sqlQryHistSize=1000, validationEnabled=false], asyncContinuationExecutor=null] [21:03:10] : [Step 4/5] [2021-11-19 21:03:10,271][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][GridInternalTaskUnusedWalSegmentsTest2] Daemon mode: off [21:03:10] : [Step 4/5] [2021-11-19 21:03:10,271][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][GridInternalTaskUnusedWalSegmentsTest2] OS: Linux 4.15.0-151-generic amd64 [21:03:10] : [Step 4/5] [2021-11-19 21:03:10,272][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][GridInternalTaskUnusedWalSegmentsTest2] OS user: teamcity [21:03:10] : [Step 4/5] [2021-11-19 21:03:10,272][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][GridInternalTaskUnusedWalSegmentsTest2] PID: 16724 [21:03:10] : [Step 4/5] [2021-11-19 21:03:10,272][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][GridInternalTaskUnusedWalSegmentsTest2] Language runtime: Java Platform API Specification ver. 1.8 [21:03:10] : [Step 4/5] [2021-11-19 21:03:10,273][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][GridInternalTaskUnusedWalSegmentsTest2] VM information: Java(TM) SE Runtime Environment 1.8.0_261-b12 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 25.261-b12 [21:03:10] : [Step 4/5] [2021-11-19 21:03:10,273][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][GridInternalTaskUnusedWalSegmentsTest2] VM total memory: 1.9GB [21:03:10] : [Step 4/5] [2021-11-19 21:03:10,274][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][GridInternalTaskUnusedWalSegmentsTest2] Remote Management [restart: off, REST: off, JMX (remote: off)] [21:03:10] : [Step 4/5] [2021-11-19 21:03:10,274][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][GridInternalTaskUnusedWalSegmentsTest2] Logger: GridTestLog4jLogger [quiet=false, config=null] [21:03:10] : [Step 4/5] [2021-11-19 21:03:10,275][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][GridInternalTaskUnusedWalSegmentsTest2] IGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c [21:03:10] : [Step 4/5] [2021-11-19 21:03:10,275][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][GridInternalTaskUnusedWalSegmentsTest2] VM arguments: [-DIGNITE_DUMP_THREADS_ON_FAILURE=false, -DMono=/usr/bin/mono-sgen, -DMono4.0_x64=/usr/lib/mono/4.0, -DMono4.5_x64=/usr/lib/mono/4.5, -DMonoVersion=6.12.0.90, -DSKIP_BUILD=false, -Dagent.home.dir=/opt/buildagent, -Dagent.name=aitc-lin02_03, -Dagent.ownPort=9090, -Dagent.work.dir=/opt/buildagent/work, -Dbuild.number=95, -Dbuild.vcs.number=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.1=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.GitHubApacheIgnite=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dclassworlds.conf=/opt/buildagent/temp/buildTmp/teamcity.m2.conf, -Dcom.jetbrains.maven.watcher.report.file=/opt/buildagent/temp/buildTmp/maven-build-info.xml, -Djava.io.tmpdir=/opt/buildagent/temp/buildTmp, -Dmaven.home=/opt/buildagent/tools/maven3_6, -Dmaven.multiModuleProjectDirectory=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.agent.cpuBenchmark=457, -Dteamcity.agent.dotnet.agent_url=http://localhost:9090/RPC2, -Dteamcity.agent.dotnet.build_id=6278078, -Dteamcity.auth.password=*******, -Dteamcity.auth.userId=TeamCityBuildId=6278078, -Dteamcity.build.changedFiles.file=/opt/buildagent/temp/buildTmp/changedFiles6342607772318147725.txt, -Dteamcity.build.checkoutDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.build.id=6278078, -Dteamcity.build.properties.file=/opt/buildagent/temp/buildTmp/teamcity.build5164517880467851002.properties, -Dteamcity.build.tempDir=/opt/buildagent/temp/buildTmp, -Dteamcity.build.workingDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.buildConfName=Basic 3, -Dteamcity.buildType.id=IgniteTests24Java8_Basic3, -Dteamcity.configuration.properties.file=/opt/buildagent/temp/buildTmp/teamcity.config5591980786735343870.properties, -Dteamcity.maven.userSettings.path=/opt/buildagent/temp/buildTmp/maven_settings_585072866407032347.xml, -Dteamcity.maven.watcher.home=/opt/buildagent/plugins/mavenPlugin/maven-watcher-jdk16, -Dteamcity.projectName=Ignite Tests 2.x (JDK 8/11), -Dteamcity.runner.properties.file=/opt/buildagent/temp/buildTmp/teamcity.runner9098465561618137420.properties, -Dteamcity.tests.recentlyFailedTests.file=/opt/buildagent/temp/buildTmp/testsToRunFirst3891775683130404069.txt, -Dteamcity.version=2021.2 (build 99542), -ea, -Xms2g, -Xmx2g, -XX:+HeapDumpOnOutOfMemoryError, -DIGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_TEST_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_UPDATE_NOTIFIER=false, -DIGNITE_NO_DISCO_ORDER=true, -DIGNITE_PERFORMANCE_SUGGESTIONS_DISABLED=true, -Djava.net.preferIPv4Stack=true, -DTEST_SCALE_FACTOR=1.0, -DIGNITE_TEST_PROP_LOG4J_FILE=log4j-tc-test.xml, -DIGNITE_QUIET=false, -DIGNITE_MARSHAL_BUFFERS_RECHECK=1000, -Dmaven.repo.local=/opt/buildagent/.m2/repository] [21:03:10] : [Step 4/5] [2021-11-19 21:03:10,280][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][GridInternalTaskUnusedWalSegmentsTest2] System cache's DataRegion size is configured to 40 MB. Use DataStorageConfiguration.systemRegionInitialSize property to change the setting. [21:03:10] : [Step 4/5] [2021-11-19 21:03:10,281][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][GridInternalTaskUnusedWalSegmentsTest2] Configured caches [in 'sysMemPlc' dataRegion: ['ignite-sys-cache'], in 'default' dataRegion: ['default']] [21:03:10]W: [org.apache.ignite:ignite-core] [2021-11-19 21:03:10,281][WARN ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][GridInternalTaskUnusedWalSegmentsTest2] Peer class loading is enabled (disable it in production for performance and deployment consistency reasons) [21:03:10] : [Step 4/5] [2021-11-19 21:03:10,281][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][GridInternalTaskUnusedWalSegmentsTest2] 3-rd party licenses can be found at: /opt/buildagent/work/7bc1c54bc719b67c/libs/licenses [21:03:10] : [Step 4/5] [2021-11-19 21:03:10,286][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][IgnitePluginProcessor] Configured plugins: [21:03:10] : [Step 4/5] [2021-11-19 21:03:10,286][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][IgnitePluginProcessor] ^-- StanByClusterTestProvider 1.0 [21:03:10] : [Step 4/5] [2021-11-19 21:03:10,286][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][IgnitePluginProcessor] ^-- null [21:03:10] : [Step 4/5] [2021-11-19 21:03:10,287][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][IgnitePluginProcessor] [21:03:10] : [Step 4/5] [2021-11-19 21:03:10,287][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][IgnitePluginProcessor] ^-- PageMemory tracker plugin 1.0 [21:03:10] : [Step 4/5] [2021-11-19 21:03:10,287][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][IgnitePluginProcessor] ^-- null [21:03:10] : [Step 4/5] [2021-11-19 21:03:10,287][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][IgnitePluginProcessor] [21:03:10] : [Step 4/5] [2021-11-19 21:03:10,288][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][IgnitePluginProcessor] ^-- TestDistibutedConfigurationPlugin 1.0 [21:03:10] : [Step 4/5] [2021-11-19 21:03:10,288][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][IgnitePluginProcessor] ^-- null [21:03:10] : [Step 4/5] [2021-11-19 21:03:10,288][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][IgnitePluginProcessor] [21:03:10] : [Step 4/5] [2021-11-19 21:03:10,288][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][IgnitePluginProcessor] ^-- NodeValidationPluginProvider 1.0 [21:03:10] : [Step 4/5] [2021-11-19 21:03:10,289][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][IgnitePluginProcessor] ^-- null [21:03:10] : [Step 4/5] [2021-11-19 21:03:10,289][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][IgnitePluginProcessor] [21:03:10] : [Step 4/5] [2021-11-19 21:03:10,289][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][FailureProcessor] Configured failure handler: [hnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]]] [21:03:10] : [Step 4/5] [2021-11-19 21:03:10,305][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][TcpCommunicationSpi] Successfully bound communication NIO server to TCP port [port=45092, locHost=/127.0.0.1, selectorsCnt=12, selectorSpins=0, pairedConn=false] [21:03:10]W: [org.apache.ignite:ignite-core] [2021-11-19 21:03:10,305][WARN ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][TcpCommunicationSpi] Message queue limit is set to 0 which may lead to potential OOMEs when running cache operations in FULL_ASYNC or PRIMARY_SYNC modes due to message queues growth on sender and receiver sides. [21:03:10] : [Step 4/5] [2021-11-19 21:03:10,311][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][GridCollisionManager] Collision resolution is disabled (all jobs will be activated upon arrival). [21:03:10] : [Step 4/5] [2021-11-19 21:03:10,311][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][GridInternalTaskUnusedWalSegmentsTest2] Security status [authentication=off, sandbox=off, tls/ssl=off] [21:03:10] : [Step 4/5] [2021-11-19 21:03:10,313][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][TestTcpDiscoverySpi] Successfully bound to TCP port [port=47502, localHost=localhost/127.0.0.1, locNodeId=d2cfc867-15f3-4259-8cff-46a016a00002] [21:03:10]W: [org.apache.ignite:ignite-core] [2021-11-19 21:03:10,314][WARN ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][PdsFoldersResolver] Failed to acquire file lock. Will try again in 1s [nodeId=d2cfc867-15f3-4259-8cff-46a016a00002, holder=[e5c7f7dd-47b7-4ab6-9149-6791d3600000][], path=/opt/buildagent/work/7bc1c54bc719b67c/work/db/node00-87f16126-5f72-4dfe-a561-76ce966f5d95/lock] [21:03:11] : [Step 4/5] [2021-11-19 21:03:11,314][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][PdsFoldersResolver] Unable to acquire lock to file [/opt/buildagent/work/7bc1c54bc719b67c/work/db/node00-87f16126-5f72-4dfe-a561-76ce966f5d95], reason: Failed to acquire file lock [holder=[e5c7f7dd-47b7-4ab6-9149-6791d3600000][], time=1 sec, path=/opt/buildagent/work/7bc1c54bc719b67c/work/db/node00-87f16126-5f72-4dfe-a561-76ce966f5d95/lock] [21:03:11]W: [org.apache.ignite:ignite-core] [2021-11-19 21:03:11,315][WARN ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][PdsFoldersResolver] Failed to acquire file lock. Will try again in 1s [nodeId=d2cfc867-15f3-4259-8cff-46a016a00002, holder=[a6e2d1b8-e889-42a6-b138-d6edb8d00001][], path=/opt/buildagent/work/7bc1c54bc719b67c/work/db/node01-e7427b46-5e04-4060-9e7a-4a56d318815a/lock] [21:03:12] : [Step 4/5] [2021-11-19 21:03:12,316][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][PdsFoldersResolver] Unable to acquire lock to file [/opt/buildagent/work/7bc1c54bc719b67c/work/db/node01-e7427b46-5e04-4060-9e7a-4a56d318815a], reason: Failed to acquire file lock [holder=[a6e2d1b8-e889-42a6-b138-d6edb8d00001][], time=1 sec, path=/opt/buildagent/work/7bc1c54bc719b67c/work/db/node01-e7427b46-5e04-4060-9e7a-4a56d318815a/lock] [21:03:12] : [Step 4/5] [2021-11-19 21:03:12,319][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][PdsFoldersResolver] Successfully created new persistent storage folder [/opt/buildagent/work/7bc1c54bc719b67c/work/db/node02-ce69043b-23cc-44c7-b1cf-65562a5661fd] [21:03:12] : [Step 4/5] [2021-11-19 21:03:12,320][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][PdsFoldersResolver] Consistent ID used for local node is [ce69043b-23cc-44c7-b1cf-65562a5661fd] according to persistence data storage folders [21:03:12] : [Step 4/5] [2021-11-19 21:03:12,320][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][MaintenanceProcessor] Resolved store directory for node persistent data: /opt/buildagent/work/7bc1c54bc719b67c/work/db/node02-ce69043b-23cc-44c7-b1cf-65562a5661fd [21:03:12] : [Step 4/5] [2021-11-19 21:03:12,322][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][CacheObjectBinaryProcessorImpl] Resolved directory for serialized binary metadata: /opt/buildagent/work/7bc1c54bc719b67c/work/db/binary_meta/node02-ce69043b-23cc-44c7-b1cf-65562a5661fd [21:03:12] : [Step 4/5] [2021-11-19 21:03:12,329][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/node02-ce69043b-23cc-44c7-b1cf-65562a5661fd [21:03:12] : [Step 4/5] [2021-11-19 21:03:12,330][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][FileWriteAheadLogManager] Resolved write ahead log work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/node02-ce69043b-23cc-44c7-b1cf-65562a5661fd [21:03:12] : [Step 4/5] [2021-11-19 21:03:12,330][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][FileWriteAheadLogManager] Resolved write ahead log archive directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/node02-ce69043b-23cc-44c7-b1cf-65562a5661fd [21:03:12] : [Step 4/5] [2021-11-19 21:03:12,339][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/node02-ce69043b-23cc-44c7-b1cf-65562a5661fd/0000000000000000.wal [21:03:12] : [Step 4/5] [2021-11-19 21:03:12,340][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][FileHandleManagerImpl] Initialized write-ahead log manager [mode=LOG_ONLY] [21:03:12] : [Step 4/5] [2021-11-19 21:03:12,348][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][GridCacheDatabaseSharedManager] Configured data regions initialized successfully [total=5] [21:03:12] : [Step 4/5] [2021-11-19 21:03:12,349][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][IgniteSnapshotManager] Resolved snapshot work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/snapshots [21:03:12] : [Step 4/5] [2021-11-19 21:03:12,350][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][IgniteSnapshotManager] Resolved temp directory for snapshot creation: /opt/buildagent/work/7bc1c54bc719b67c/work/db/node02-ce69043b-23cc-44c7-b1cf-65562a5661fd/snp [21:03:12] : [Step 4/5] [2021-11-19 21:03:12,353][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][ClientListenerProcessor] Client connector processor has started on TCP port 10802 [21:03:12] : [Step 4/5] [2021-11-19 21:03:12,356][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][GridInternalTaskUnusedWalSegmentsTest2] Non-loopback local IPs: 172.17.0.4 [21:03:12] : [Step 4/5] [2021-11-19 21:03:12,356][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][GridInternalTaskUnusedWalSegmentsTest2] Enabled local MACs: 0242AC110004 [21:03:12] : [Step 4/5] [2021-11-19 21:03:12,357][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:03:12] : [Step 4/5] [2021-11-19 21:03:12,358][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:03:12] : [Step 4/5] [2021-11-19 21:03:12,359][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:03:12] : [Step 4/5] [2021-11-19 21:03:12,361][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][GridCacheDatabaseSharedManager] Applying lost metastore updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:03:12] : [Step 4/5] [2021-11-19 21:03:12,362][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=0 ms] [21:03:12] : [Step 4/5] [2021-11-19 21:03:12,363][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][GridCacheProcessor] Restoring partition state for local groups. [21:03:12] : [Step 4/5] [2021-11-19 21:03:12,363][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=0, partitionsProcessed=0, time=0ms] [21:03:12] : [Step 4/5] [2021-11-19 21:03:12,364][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][GridEncryptionManager] Encryption keys loaded from metastore. [grps=, masterKeyName=null] [21:03:12] : [Step 4/5] [2021-11-19 21:03:12,367][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][ClusterProcessor] Cluster ID and tag has been read from metastorage: null [21:03:12] : [Step 4/5] [2021-11-19 21:03:12,367][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][IgniteClusterImpl] Shutdown policy was updated [oldVal=null, newVal=null] [21:03:12] : [Step 4/5] [2021-11-19 21:03:12,368][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][GridCacheDatabaseSharedManager] Checkpoint frequency deviation changed [oldVal=null, newVal=null] [21:03:12] : [Step 4/5] [2021-11-19 21:03:12,377][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][FilePageStoreManager] Cleanup cache stores [total=1, left=0, cleanFiles=false] [21:03:12] : [Step 4/5] [2021-11-19 21:03:12,382][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:03:12] : [Step 4/5] [2021-11-19 21:03:12,383][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:03:12] : [Step 4/5] [2021-11-19 21:03:12,385][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:03:12] : [Step 4/5] [2021-11-19 21:03:12,386][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][GridCacheDatabaseSharedManager] Data Regions Started: 5 [21:03:12] : [Step 4/5] [2021-11-19 21:03:12,387][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][GridCacheDatabaseSharedManager] ^-- sysMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:03:12] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:03:12] : [Step 4/5] ^-- default region [type=default, persistence=true, lazyAlloc=true, [21:03:12] : [Step 4/5] ... initCfg=100MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB, allocTotal=0MB] [21:03:12] : [Step 4/5] ^-- metastoreMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:03:12] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:03:12] : [Step 4/5] ^-- TxLog region [type=internal, persistence=true, lazyAlloc=false, [21:03:12] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:03:12] : [Step 4/5] ^-- volatileDsMemPlc region [type=user, persistence=false, lazyAlloc=true, [21:03:12] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB] [21:03:12] : [Step 4/5] ^-- Ignite persistence [used=0MB] [21:03:12] : [Step 4/5] [21:03:12] : [Step 4/5] [2021-11-19 21:03:12,388][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][GridCacheDatabaseSharedManager] Starting binary memory restore for: [1544803905, -2100569601] [21:03:12] : [Step 4/5] [2021-11-19 21:03:12,403][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:03:12] : [Step 4/5] [2021-11-19 21:03:12,404][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:03:12] : [Step 4/5] [2021-11-19 21:03:12,407][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/node02-ce69043b-23cc-44c7-b1cf-65562a5661fd/0000000000000000.wal, offset=0, ver=2] [21:03:12] : [Step 4/5] [2021-11-19 21:03:12,410][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:03:12] : [Step 4/5] [2021-11-19 21:03:12,415][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][GridCacheProcessor] Started cache in recovery mode [name=default, id=1544803905, dataRegionName=default, mode=PARTITIONED, atomicity=ATOMIC, backups=0, mvcc=false] [21:03:12] : [Step 4/5] [2021-11-19 21:03:12,420][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][GridCacheProcessor] Started cache in recovery mode [name=ignite-sys-cache, id=-2100569601, dataRegionName=sysMemPlc, mode=REPLICATED, atomicity=TRANSACTIONAL, backups=2147483647, mvcc=false] [21:03:12] : [Step 4/5] [2021-11-19 21:03:12,422][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][GridCacheDatabaseSharedManager] Binary recovery performed in 34 ms. [21:03:12] : [Step 4/5] [2021-11-19 21:03:12,422][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:03:12] : [Step 4/5] [2021-11-19 21:03:12,423][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][GridCacheDatabaseSharedManager] Applying lost cache updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:03:12] : [Step 4/5] [2021-11-19 21:03:12,427][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=0 ms] [21:03:12] : [Step 4/5] [2021-11-19 21:03:12,427][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][GridCacheProcessor] Restoring partition state for local groups. [21:03:12] : [Step 4/5] [2021-11-19 21:03:12,436][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=2, partitionsProcessed=132, time=10ms] [21:03:12] : [Step 4/5] [2021-11-19 21:03:12,446][INFO ][tcp-disco-srvr-[:47500]-#217%util.GridInternalTaskUnusedWalSegmentsTest0%-#4540%util.GridInternalTaskUnusedWalSegmentsTest0%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=38567] [21:03:12] : [Step 4/5] [2021-11-19 21:03:12,447][INFO ][tcp-disco-srvr-[:47500]-#217%util.GridInternalTaskUnusedWalSegmentsTest0%-#4540%util.GridInternalTaskUnusedWalSegmentsTest0%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=38567] [21:03:12] : [Step 4/5] [2021-11-19 21:03:12,448][INFO ][tcp-disco-sock-reader-[]-#232%util.GridInternalTaskUnusedWalSegmentsTest0%-#4785%util.GridInternalTaskUnusedWalSegmentsTest0%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:38567, rmtPort=38567] [21:03:12] : [Step 4/5] [2021-11-19 21:03:12,449][INFO ][tcp-disco-sock-reader-[d2cfc867 127.0.0.1:38567]-#232%util.GridInternalTaskUnusedWalSegmentsTest0%-#4785%util.GridInternalTaskUnusedWalSegmentsTest0%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=d2cfc867-15f3-4259-8cff-46a016a00002, rmtAddr=/127.0.0.1:38567] [21:03:12] : [Step 4/5] [2021-11-19 21:03:12,452][INFO ][tcp-disco-srvr-[:47502]-#231%util.GridInternalTaskUnusedWalSegmentsTest2%-#4784%util.GridInternalTaskUnusedWalSegmentsTest2%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=47491] [21:03:12] : [Step 4/5] [2021-11-19 21:03:12,452][INFO ][tcp-disco-srvr-[:47502]-#231%util.GridInternalTaskUnusedWalSegmentsTest2%-#4784%util.GridInternalTaskUnusedWalSegmentsTest2%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=47491] [21:03:12] : [Step 4/5] [2021-11-19 21:03:12,453][INFO ][tcp-disco-sock-reader-[]-#233%util.GridInternalTaskUnusedWalSegmentsTest2%-#4786%util.GridInternalTaskUnusedWalSegmentsTest2%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:47491, rmtPort=47491] [21:03:12] : [Step 4/5] [2021-11-19 21:03:12,453][INFO ][tcp-disco-sock-reader-[]-#233%util.GridInternalTaskUnusedWalSegmentsTest2%-#4786%util.GridInternalTaskUnusedWalSegmentsTest2%][TestTcpDiscoverySpi] Received ping request from the remote node [rmtNodeId=e5c7f7dd-47b7-4ab6-9149-6791d3600000, rmtAddr=/127.0.0.1:47491, rmtPort=47491] [21:03:12] : [Step 4/5] [2021-11-19 21:03:12,455][INFO ][tcp-disco-sock-reader-[]-#233%util.GridInternalTaskUnusedWalSegmentsTest2%-#4786%util.GridInternalTaskUnusedWalSegmentsTest2%][TestTcpDiscoverySpi] Finished writing ping response [rmtNodeId=e5c7f7dd-47b7-4ab6-9149-6791d3600000, rmtAddr=/127.0.0.1:47491, rmtPort=47491] [21:03:12] : [Step 4/5] [2021-11-19 21:03:12,455][INFO ][tcp-disco-sock-reader-[d2cfc867 127.0.0.1:38567]-#232%util.GridInternalTaskUnusedWalSegmentsTest0%-#4785%util.GridInternalTaskUnusedWalSegmentsTest0%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:38567, rmtPort=38567, rmtNodeId=d2cfc867-15f3-4259-8cff-46a016a00002] [21:03:12] : [Step 4/5] [2021-11-19 21:03:12,455][INFO ][tcp-disco-sock-reader-[]-#233%util.GridInternalTaskUnusedWalSegmentsTest2%-#4786%util.GridInternalTaskUnusedWalSegmentsTest2%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:47491, rmtPort=47491, rmtNodeId=null] [21:03:12] : [Step 4/5] [2021-11-19 21:03:12,457][INFO ][tcp-disco-msg-worker-[a6e2d1b8 127.0.0.1:47501 crd]-#216%util.GridInternalTaskUnusedWalSegmentsTest0%-#4539%util.GridInternalTaskUnusedWalSegmentsTest0%][GridEncryptionManager] Joining node doesn't have stored group keys [node=d2cfc867-15f3-4259-8cff-46a016a00002] [21:03:12] : [Step 4/5] [2021-11-19 21:03:12,471][INFO ][tcp-disco-msg-worker-[e5c7f7dd 127.0.0.1:47500]-#221%util.GridInternalTaskUnusedWalSegmentsTest1%-#4659%util.GridInternalTaskUnusedWalSegmentsTest1%][TestTcpDiscoverySpi] New next node [newNext=TcpDiscoveryNode [id=d2cfc867-15f3-4259-8cff-46a016a00002, consistentId=ce69043b-23cc-44c7-b1cf-65562a5661fd, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47502], discPort=47502, order=0, intOrder=3, lastExchangeTime=1637344992459, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false]] [21:03:12] : [Step 4/5] [2021-11-19 21:03:12,472][INFO ][tcp-disco-sock-reader-[a6e2d1b8 127.0.0.1:60179]-#226%util.GridInternalTaskUnusedWalSegmentsTest0%-#4664%util.GridInternalTaskUnusedWalSegmentsTest0%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:60179, rmtPort=60179, rmtNodeId=a6e2d1b8-e889-42a6-b138-d6edb8d00001] [21:03:12] : [Step 4/5] [2021-11-19 21:03:12,472][INFO ][tcp-disco-srvr-[:47502]-#231%util.GridInternalTaskUnusedWalSegmentsTest2%-#4784%util.GridInternalTaskUnusedWalSegmentsTest2%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=58289] [21:03:12] : [Step 4/5] [2021-11-19 21:03:12,473][INFO ][tcp-disco-srvr-[:47502]-#231%util.GridInternalTaskUnusedWalSegmentsTest2%-#4784%util.GridInternalTaskUnusedWalSegmentsTest2%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=58289] [21:03:12] : [Step 4/5] [2021-11-19 21:03:12,474][INFO ][tcp-disco-sock-reader-[]-#234%util.GridInternalTaskUnusedWalSegmentsTest2%-#4787%util.GridInternalTaskUnusedWalSegmentsTest2%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:58289, rmtPort=58289] [21:03:12] : [Step 4/5] [2021-11-19 21:03:12,475][INFO ][tcp-disco-sock-reader-[a6e2d1b8 127.0.0.1:58289]-#234%util.GridInternalTaskUnusedWalSegmentsTest2%-#4787%util.GridInternalTaskUnusedWalSegmentsTest2%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=a6e2d1b8-e889-42a6-b138-d6edb8d00001, rmtAddr=/127.0.0.1:58289] [21:03:12] : [Step 4/5] [2021-11-19 21:03:12,478][INFO ][tcp-disco-msg-worker-[]-#230%util.GridInternalTaskUnusedWalSegmentsTest2%-#4783%util.GridInternalTaskUnusedWalSegmentsTest2%][TestTcpDiscoverySpi] New next node [newNext=TcpDiscoveryNode [id=e5c7f7dd-47b7-4ab6-9149-6791d3600000, consistentId=87f16126-5f72-4dfe-a561-76ce966f5d95, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637344992469, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false]] [21:03:12] : [Step 4/5] [2021-11-19 21:03:12,479][INFO ][tcp-disco-srvr-[:47500]-#217%util.GridInternalTaskUnusedWalSegmentsTest0%-#4540%util.GridInternalTaskUnusedWalSegmentsTest0%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=54437] [21:03:12] : [Step 4/5] [2021-11-19 21:03:12,480][INFO ][tcp-disco-srvr-[:47500]-#217%util.GridInternalTaskUnusedWalSegmentsTest0%-#4540%util.GridInternalTaskUnusedWalSegmentsTest0%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=54437] [21:03:12] : [Step 4/5] [2021-11-19 21:03:12,481][INFO ][tcp-disco-sock-reader-[]-#235%util.GridInternalTaskUnusedWalSegmentsTest0%-#4788%util.GridInternalTaskUnusedWalSegmentsTest0%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:54437, rmtPort=54437] [21:03:12] : [Step 4/5] [2021-11-19 21:03:12,482][INFO ][tcp-disco-sock-reader-[d2cfc867 127.0.0.1:54437]-#235%util.GridInternalTaskUnusedWalSegmentsTest0%-#4788%util.GridInternalTaskUnusedWalSegmentsTest0%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=d2cfc867-15f3-4259-8cff-46a016a00002, rmtAddr=/127.0.0.1:54437] [21:03:12] : [Step 4/5] [2021-11-19 21:03:12,484][INFO ][disco-event-worker-#4542%util.GridInternalTaskUnusedWalSegmentsTest0%][GridDiscoveryManager] Added new node to topology: TcpDiscoveryNode [id=d2cfc867-15f3-4259-8cff-46a016a00002, consistentId=ce69043b-23cc-44c7-b1cf-65562a5661fd, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47502], discPort=47502, order=3, intOrder=3, lastExchangeTime=1637344992449, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false] [21:03:12] : [Step 4/5] [2021-11-19 21:03:12,485][INFO ][disco-event-worker-#4666%util.GridInternalTaskUnusedWalSegmentsTest1%][GridDiscoveryManager] Added new node to topology: TcpDiscoveryNode [id=d2cfc867-15f3-4259-8cff-46a016a00002, consistentId=ce69043b-23cc-44c7-b1cf-65562a5661fd, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47502], discPort=47502, order=3, intOrder=3, lastExchangeTime=1637344992459, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false] [21:03:12] : [Step 4/5] [2021-11-19 21:03:12,487][INFO ][disco-event-worker-#4666%util.GridInternalTaskUnusedWalSegmentsTest1%][GridDiscoveryManager] Topology snapshot [ver=3, locNode=a6e2d1b8, servers=3, clients=0, state=INACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=e5c7f7dd-47b7-4ab6-9149-6791d3600000, consistentId=87f16126-5f72-4dfe-a561-76ce966f5d95, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=a6e2d1b8-e889-42a6-b138-d6edb8d00001, consistentId=e7427b46-5e04-4060-9e7a-4a56d318815a, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=d2cfc867-15f3-4259-8cff-46a016a00002, consistentId=ce69043b-23cc-44c7-b1cf-65562a5661fd, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:03:12] : [Step 4/5] [2021-11-19 21:03:12,486][INFO ][disco-event-worker-#4542%util.GridInternalTaskUnusedWalSegmentsTest0%][GridDiscoveryManager] Topology snapshot [ver=3, locNode=e5c7f7dd, servers=3, clients=0, state=INACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=e5c7f7dd-47b7-4ab6-9149-6791d3600000, consistentId=87f16126-5f72-4dfe-a561-76ce966f5d95, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=a6e2d1b8-e889-42a6-b138-d6edb8d00001, consistentId=e7427b46-5e04-4060-9e7a-4a56d318815a, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=d2cfc867-15f3-4259-8cff-46a016a00002, consistentId=ce69043b-23cc-44c7-b1cf-65562a5661fd, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:03:12] : [Step 4/5] [2021-11-19 21:03:12,488][INFO ][tcp-disco-msg-worker-[e5c7f7dd 127.0.0.1:47500]-#230%util.GridInternalTaskUnusedWalSegmentsTest2%-#4783%util.GridInternalTaskUnusedWalSegmentsTest2%][ClusterProcessor] infallible_faraday [21:03:12] : [Step 4/5] [2021-11-19 21:03:12,491][INFO ][tcp-disco-msg-worker-[e5c7f7dd 127.0.0.1:47500]-#230%util.GridInternalTaskUnusedWalSegmentsTest2%-#4783%util.GridInternalTaskUnusedWalSegmentsTest2%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustEnabled' was changed from 'null' to 'false' [21:03:12] : [Step 4/5] [2021-11-19 21:03:12,491][INFO ][tcp-disco-msg-worker-[e5c7f7dd 127.0.0.1:47500]-#230%util.GridInternalTaskUnusedWalSegmentsTest2%-#4783%util.GridInternalTaskUnusedWalSegmentsTest2%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustTimeout' was changed from 'null' to '300000' [21:03:12] : [Step 4/5] [2021-11-19 21:03:12,491][INFO ][tcp-disco-msg-worker-[e5c7f7dd 127.0.0.1:47500]-#230%util.GridInternalTaskUnusedWalSegmentsTest2%-#4783%util.GridInternalTaskUnusedWalSegmentsTest2%][IgniteTxManager] Transactions parameter 'longOperationsDumpTimeout' was changed from 'null' to '60000' [21:03:12] : [Step 4/5] [2021-11-19 21:03:12,492][INFO ][tcp-disco-msg-worker-[e5c7f7dd 127.0.0.1:47500]-#230%util.GridInternalTaskUnusedWalSegmentsTest2%-#4783%util.GridInternalTaskUnusedWalSegmentsTest2%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpThreshold' was changed from 'null' to '0' [21:03:12] : [Step 4/5] [2021-11-19 21:03:12,492][INFO ][tcp-disco-msg-worker-[e5c7f7dd 127.0.0.1:47500]-#230%util.GridInternalTaskUnusedWalSegmentsTest2%-#4783%util.GridInternalTaskUnusedWalSegmentsTest2%][IgniteTxManager] Transactions parameter 'transactionTimeDumpSamplesCoefficient' was changed from 'null' to '0.0' [21:03:12] : [Step 4/5] [2021-11-19 21:03:12,493][INFO ][tcp-disco-msg-worker-[e5c7f7dd 127.0.0.1:47500]-#230%util.GridInternalTaskUnusedWalSegmentsTest2%-#4783%util.GridInternalTaskUnusedWalSegmentsTest2%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpSamplesPerSecondLimit' was changed from 'null' to '5' [21:03:12] : [Step 4/5] [2021-11-19 21:03:12,493][INFO ][tcp-disco-msg-worker-[e5c7f7dd 127.0.0.1:47500]-#230%util.GridInternalTaskUnusedWalSegmentsTest2%-#4783%util.GridInternalTaskUnusedWalSegmentsTest2%][IgniteTxManager] Transactions parameter 'collisionsDumpInterval' was changed from 'null' to '1000' [21:03:12] : [Step 4/5] [2021-11-19 21:03:12,494][INFO ][tcp-disco-msg-worker-[e5c7f7dd 127.0.0.1:47500]-#230%util.GridInternalTaskUnusedWalSegmentsTest2%-#4783%util.GridInternalTaskUnusedWalSegmentsTest2%][IgniteTxManager] Transactions parameter 'txOwnerDumpRequestsAllowed' was changed from 'null' to 'true' [21:03:12] : [Step 4/5] [2021-11-19 21:03:12,494][INFO ][tcp-disco-msg-worker-[e5c7f7dd 127.0.0.1:47500]-#230%util.GridInternalTaskUnusedWalSegmentsTest2%-#4783%util.GridInternalTaskUnusedWalSegmentsTest2%][GridCacheDatabaseSharedManager] Historical rebalance WAL threshold changed [property=historical.rebalance.threshold, oldVal=null, newVal=500] [21:03:12] : [Step 4/5] [2021-11-19 21:03:12,495][INFO ][disco-notifier-worker-#4782%util.GridInternalTaskUnusedWalSegmentsTest2%][MvccProcessorImpl] Assigned mvcc coordinator [crd=MvccCoordinator [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], nodeId=e5c7f7dd-47b7-4ab6-9149-6791d3600000, ver=1637344988753, local=false, initialized=false]] [21:03:12] : [Step 4/5] [2021-11-19 21:03:12,497][INFO ][sys-#4773%util.GridInternalTaskUnusedWalSegmentsTest2%][ClusterProcessor] Writing cluster ID and tag to metastorage on ready for write ClusterIdAndTag [id=3d49fd3a-53f0-4d1a-a0f4-1e83e06bb38e, tag=infallible_faraday] [21:03:12] : [Step 4/5] [2021-11-19 21:03:12,515][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][GridInternalTaskUnusedWalSegmentsTest2] To start Console Management & Monitoring run ignitevisorcmd.{sh|bat} [21:03:12] : [Step 4/5] [2021-11-19 21:03:12,515][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][GridInternalTaskUnusedWalSegmentsTest2] [21:03:12] : [Step 4/5] [21:03:12] : [Step 4/5] >>> +-------------------------------------------+ [21:03:12] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:03:12] : [Step 4/5] >>> +-------------------------------------------+ [21:03:12] : [Step 4/5] >>> OS name: Linux 4.15.0-151-generic amd64 [21:03:12] : [Step 4/5] >>> CPU(s): 24 [21:03:12] : [Step 4/5] >>> Heap: 2.0GB [21:03:12] : [Step 4/5] >>> VM name: 16724@c4dfe9a430b2 [21:03:12] : [Step 4/5] >>> Ignite instance name: util.GridInternalTaskUnusedWalSegmentsTest2 [21:03:12] : [Step 4/5] >>> Local node [ID=D2CFC867-15F3-4259-8CFF-46A016A00002, order=3, clientMode=false] [21:03:12] : [Step 4/5] >>> Local node addresses: [127.0.0.1] [21:03:12] : [Step 4/5] >>> Local ports: TCP:10802 TCP:45092 TCP:47502 [21:03:12] : [Step 4/5] [21:03:12] : [Step 4/5] [2021-11-19 21:03:12,516][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][GridInternalTaskUnusedWalSegmentsTest2] >>> Ignite cluster is in INACTIVE state (limited functionality available). Use control.(sh|bat) script or IgniteCluster.state(ClusterState.ACTIVE) to change the state. [21:03:12] : [Step 4/5] [2021-11-19 21:03:12,517][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][GridDiscoveryManager] Topology snapshot [ver=3, locNode=d2cfc867, servers=3, clients=0, state=INACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=e5c7f7dd-47b7-4ab6-9149-6791d3600000, consistentId=87f16126-5f72-4dfe-a561-76ce966f5d95, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=a6e2d1b8-e889-42a6-b138-d6edb8d00001, consistentId=e7427b46-5e04-4060-9e7a-4a56d318815a, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=d2cfc867-15f3-4259-8cff-46a016a00002, consistentId=ce69043b-23cc-44c7-b1cf-65562a5661fd, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:03:12] : [Step 4/5] [2021-11-19 21:03:12,518][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][G] Node started : [stage="Configure system pool" (0 ms),stage="Start managers" (2063 ms),stage="Configure binary metadata" (3 ms),stage="Start processors" (29 ms),stage="Start 'StanByClusterTestProvider' plugin" (0 ms),stage="Start 'PageMemory tracker plugin' plugin" (0 ms),stage="Start 'TestDistibutedConfigurationPlugin' plugin" (0 ms),stage="Start 'NodeValidationPluginProvider' plugin" (0 ms),stage="Init metastore" (22 ms),stage="Init and start regions" (10 ms),stage="Restore binary memory" (33 ms),stage="Restore logical state" (14 ms),stage="Finish recovery" (3 ms),stage="Join topology" (55 ms),stage="Await transition" (2 ms),stage="Await exchange" (19 ms),stage="Total time" (2253 ms)] [21:03:12] : [Step 4/5] [2021-11-19 21:03:12,519][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][root] Node started with the following configuration [id=d2cfc867-15f3-4259-8cff-46a016a00002, marshaller=BinaryMarshaller [], discovery=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=5000, ackTimeout=5000, marsh=JdkMarshaller [clsFilter=org.apache.ignite.marshaller.MarshallerUtils$1@1d2d211e], reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], binaryCfg=null, lateAff=true] [21:03:12]W: [org.apache.ignite:ignite-core] [2021-11-19 21:03:12,525][WARN ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][G] Ignite work directory is not provided, automatically resolved to: /opt/buildagent/work/7bc1c54bc719b67c/work [21:03:12]W: [org.apache.ignite:ignite-core] [2021-11-19 21:03:12,525][WARN ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][G] Consistent ID is not set, it is recommended to set consistent ID for production clusters (use IgniteConfiguration.setConsistentId property) [21:03:12] : [Step 4/5] [2021-11-19 21:03:12,526][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][GridInternalTaskUnusedWalSegmentsTest3] [21:03:12] : [Step 4/5] [21:03:12] : [Step 4/5] >>> __________ ________________ [21:03:12] : [Step 4/5] >>> / _/ ___/ |/ / _/_ __/ __/ [21:03:12] : [Step 4/5] >>> _/ // (7 7 // / / / / _/ [21:03:12] : [Step 4/5] >>> /___/\___/_/|_/___/ /_/ /___/ [21:03:12] : [Step 4/5] >>> [21:03:12] : [Step 4/5] >>> ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:03:12] : [Step 4/5] >>> 2021 Copyright(C) Apache Software Foundation [21:03:12] : [Step 4/5] >>> [21:03:12] : [Step 4/5] >>> Ignite documentation: http://ignite.apache.org [21:03:12] : [Step 4/5] [21:03:12] : [Step 4/5] [2021-11-19 21:03:12,527][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][GridInternalTaskUnusedWalSegmentsTest3] Config URL: n/a [21:03:12] : [Step 4/5] [2021-11-19 21:03:12,527][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][GridInternalTaskUnusedWalSegmentsTest3] IgniteConfiguration [igniteInstanceName=util.GridInternalTaskUnusedWalSegmentsTest3, pubPoolSize=24, svcPoolSize=24, callbackPoolSize=24, stripedPoolSize=24, sysPoolSize=24, mgmtPoolSize=4, dataStreamerPoolSize=24, utilityCachePoolSize=24, utilityCacheKeepAliveTime=60000, p2pPoolSize=2, qryPoolSize=24, buildIdxPoolSize=4, igniteHome=/opt/buildagent/work/7bc1c54bc719b67c, igniteWorkDir=/opt/buildagent/work/7bc1c54bc719b67c/work, mbeanSrv=com.sun.jmx.mbeanserver.JmxMBeanServer@6fe85038, nodeId=80d945d2-7ddb-4d94-a653-44c315400003, marsh=BinaryMarshaller [], marshLocJobs=false, daemon=false, p2pEnabled=true, netTimeout=10000, netCompressionLevel=1, sndRetryDelay=1000, sndRetryCnt=3, metricsHistSize=10000, metricsUpdateFreq=1000, metricsExpTime=9223372036854775807, discoSpi=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=0, ackTimeout=0, marsh=null, reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], segPlc=STOP, segResolveAttempts=2, waitForSegOnStart=true, allResolversPassReq=true, segChkFreq=10000, commSpi=TcpCommunicationSpi [connectGate=org.apache.ignite.spi.communication.tcp.internal.ConnectGateway@4fe2d68f, ctxInitLatch=java.util.concurrent.CountDownLatch@14d3ebbc[Count = 1], stopping=false, clientPool=null, nioSrvWrapper=null, stateProvider=null], evtSpi=MemoryEventStorageSpi [expireAgeMs=9223372036854775807, expireCnt=10000, filter=null], colSpi=NoopCollisionSpi [], deploySpi=LocalDeploymentSpi [], indexingSpi=org.apache.ignite.spi.indexing.noop.NoopIndexingSpi@64e0f033, addrRslvr=null, encryptionSpi=org.apache.ignite.spi.encryption.noop.NoopEncryptionSpi@34005683, tracingSpi=org.apache.ignite.spi.tracing.NoopTracingSpi@56bca8a1, clientMode=false, rebalanceThreadPoolSize=4, rebalanceTimeout=10000, rebalanceBatchesPrefetchCnt=3, rebalanceThrottle=0, rebalanceBatchSize=524288, txCfg=TransactionConfiguration [txSerEnabled=false, dfltIsolation=REPEATABLE_READ, dfltConcurrency=PESSIMISTIC, dfltTxTimeout=0, txTimeoutOnPartitionMapExchange=0, deadlockTimeout=10000, pessimisticTxLogSize=0, pessimisticTxLogLinger=10000, tmLookupClsName=null, txManagerFactory=null, useJtaSync=false], cacheSanityCheckEnabled=true, discoStartupDelay=60000, deployMode=SHARED, p2pMissedCacheSize=100, locHost=127.0.0.1, timeSrvPortBase=31100, timeSrvPortRange=100, failureDetectionTimeout=10000, sysWorkerBlockedTimeout=null, clientFailureDetectionTimeout=10000, metricsLogFreq=0, connectorCfg=null, odbcCfg=null, warmupClos=null, atomicCfg=AtomicConfiguration [seqReserveSize=1000, cacheMode=PARTITIONED, backups=1, aff=null, grpName=null], classLdr=null, sslCtxFactory=null, platformCfg=null, binaryCfg=null, memCfg=null, pstCfg=null, dsCfg=DataStorageConfiguration [sysRegionInitSize=41943040, sysRegionMaxSize=104857600, pageSize=4096, concLvl=0, dfltDataRegConf=DataRegionConfiguration [name=default, maxSize=104857600, initSize=268435456, swapPath=null, pageEvictionMode=DISABLED, pageReplacementMode=CLOCK, evictionThreshold=0.9, emptyPagesPoolSize=100, metricsEnabled=false, metricsSubIntervalCount=5, metricsRateTimeInterval=60000, persistenceEnabled=true, checkpointPageBufSize=0, lazyMemoryAllocation=true, warmUpCfg=null], dataRegions=null, storagePath=null, checkpointFreq=180000, lockWaitTime=10000, checkpointThreads=4, checkpointWriteOrder=SEQUENTIAL, walHistSize=2147483647, maxWalArchiveSize=1073741824, walSegments=10, walSegmentSize=1048576, walPath=db/wal, walArchivePath=db/wal/archive, cdcWalPath=db/wal/cdc, cdcEnabled=false, metricsEnabled=false, walMode=LOG_ONLY, walTlbSize=131072, walBuffSize=0, walFlushFreq=2000, walFsyncDelay=1000, walRecordIterBuffSize=67108864, alwaysWriteFullPages=false, fileIOFactory=org.apache.ignite.internal.processors.cache.persistence.file.AsyncFileIOFactory@32cc582e, metricsSubIntervalCnt=5, metricsRateTimeInterval=60000, walAutoArchiveAfterInactivity=-1, walForceArchiveTimeout=-1, writeThrottlingEnabled=false, walCompactionEnabled=false, walCompactionLevel=1, checkpointReadLockTimeout=null, walPageCompression=DISABLED, walPageCompressionLevel=null, dfltWarmUpCfg=null, encCfg=org.apache.ignite.configuration.EncryptionConfiguration@66991d8f, defragmentationThreadPoolSize=4, minWalArchiveSize=-1], snapshotPath=snapshots, activeOnStart=true, activeOnStartPropSetFlag=false, autoActivation=true, autoActivationPropSetFlag=false, clusterStateOnStart=null, sqlConnCfg=null, cliConnCfg=ClientConnectorConfiguration [host=null, port=10800, portRange=100, sockSndBufSize=0, sockRcvBufSize=0, tcpNoDelay=true, maxOpenCursorsPerConn=128, threadPoolSize=24, selectorCnt=12, idleTimeout=0, handshakeTimeout=10000, jdbcEnabled=true, odbcEnabled=true, thinCliEnabled=true, sslEnabled=false, useIgniteSslCtxFactory=true, sslClientAuth=false, sslCtxFactory=null, thinCliCfg=ThinClientConfiguration [maxActiveTxPerConn=100, maxActiveComputeTasksPerConn=0]], mvccVacuumThreadCnt=2, mvccVacuumFreq=5000, authEnabled=false, failureHnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]], commFailureRslvr=null, sqlCfg=SqlConfiguration [longQryWarnTimeout=3000, dfltQryTimeout=0, sqlQryHistSize=1000, validationEnabled=false], asyncContinuationExecutor=null] [21:03:12] : [Step 4/5] [2021-11-19 21:03:12,535][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][GridInternalTaskUnusedWalSegmentsTest3] Daemon mode: off [21:03:12] : [Step 4/5] [2021-11-19 21:03:12,535][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][GridInternalTaskUnusedWalSegmentsTest3] OS: Linux 4.15.0-151-generic amd64 [21:03:12] : [Step 4/5] [2021-11-19 21:03:12,536][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][GridInternalTaskUnusedWalSegmentsTest3] OS user: teamcity [21:03:12] : [Step 4/5] [2021-11-19 21:03:12,536][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][GridInternalTaskUnusedWalSegmentsTest3] PID: 16724 [21:03:12] : [Step 4/5] [2021-11-19 21:03:12,536][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][GridInternalTaskUnusedWalSegmentsTest3] Language runtime: Java Platform API Specification ver. 1.8 [21:03:12] : [Step 4/5] [2021-11-19 21:03:12,537][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][GridInternalTaskUnusedWalSegmentsTest3] VM information: Java(TM) SE Runtime Environment 1.8.0_261-b12 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 25.261-b12 [21:03:12] : [Step 4/5] [2021-11-19 21:03:12,537][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][GridInternalTaskUnusedWalSegmentsTest3] VM total memory: 1.9GB [21:03:12] : [Step 4/5] [2021-11-19 21:03:12,537][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][GridInternalTaskUnusedWalSegmentsTest3] Remote Management [restart: off, REST: off, JMX (remote: off)] [21:03:12] : [Step 4/5] [2021-11-19 21:03:12,537][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][GridInternalTaskUnusedWalSegmentsTest3] Logger: GridTestLog4jLogger [quiet=false, config=null] [21:03:12] : [Step 4/5] [2021-11-19 21:03:12,538][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][GridInternalTaskUnusedWalSegmentsTest3] IGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c [21:03:12] : [Step 4/5] [2021-11-19 21:03:12,538][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][GridInternalTaskUnusedWalSegmentsTest3] VM arguments: [-DIGNITE_DUMP_THREADS_ON_FAILURE=false, -DMono=/usr/bin/mono-sgen, -DMono4.0_x64=/usr/lib/mono/4.0, -DMono4.5_x64=/usr/lib/mono/4.5, -DMonoVersion=6.12.0.90, -DSKIP_BUILD=false, -Dagent.home.dir=/opt/buildagent, -Dagent.name=aitc-lin02_03, -Dagent.ownPort=9090, -Dagent.work.dir=/opt/buildagent/work, -Dbuild.number=95, -Dbuild.vcs.number=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.1=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.GitHubApacheIgnite=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dclassworlds.conf=/opt/buildagent/temp/buildTmp/teamcity.m2.conf, -Dcom.jetbrains.maven.watcher.report.file=/opt/buildagent/temp/buildTmp/maven-build-info.xml, -Djava.io.tmpdir=/opt/buildagent/temp/buildTmp, -Dmaven.home=/opt/buildagent/tools/maven3_6, -Dmaven.multiModuleProjectDirectory=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.agent.cpuBenchmark=457, -Dteamcity.agent.dotnet.agent_url=http://localhost:9090/RPC2, -Dteamcity.agent.dotnet.build_id=6278078, -Dteamcity.auth.password=*******, -Dteamcity.auth.userId=TeamCityBuildId=6278078, -Dteamcity.build.changedFiles.file=/opt/buildagent/temp/buildTmp/changedFiles6342607772318147725.txt, -Dteamcity.build.checkoutDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.build.id=6278078, -Dteamcity.build.properties.file=/opt/buildagent/temp/buildTmp/teamcity.build5164517880467851002.properties, -Dteamcity.build.tempDir=/opt/buildagent/temp/buildTmp, -Dteamcity.build.workingDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.buildConfName=Basic 3, -Dteamcity.buildType.id=IgniteTests24Java8_Basic3, -Dteamcity.configuration.properties.file=/opt/buildagent/temp/buildTmp/teamcity.config5591980786735343870.properties, -Dteamcity.maven.userSettings.path=/opt/buildagent/temp/buildTmp/maven_settings_585072866407032347.xml, -Dteamcity.maven.watcher.home=/opt/buildagent/plugins/mavenPlugin/maven-watcher-jdk16, -Dteamcity.projectName=Ignite Tests 2.x (JDK 8/11), -Dteamcity.runner.properties.file=/opt/buildagent/temp/buildTmp/teamcity.runner9098465561618137420.properties, -Dteamcity.tests.recentlyFailedTests.file=/opt/buildagent/temp/buildTmp/testsToRunFirst3891775683130404069.txt, -Dteamcity.version=2021.2 (build 99542), -ea, -Xms2g, -Xmx2g, -XX:+HeapDumpOnOutOfMemoryError, -DIGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_TEST_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_UPDATE_NOTIFIER=false, -DIGNITE_NO_DISCO_ORDER=true, -DIGNITE_PERFORMANCE_SUGGESTIONS_DISABLED=true, -Djava.net.preferIPv4Stack=true, -DTEST_SCALE_FACTOR=1.0, -DIGNITE_TEST_PROP_LOG4J_FILE=log4j-tc-test.xml, -DIGNITE_QUIET=false, -DIGNITE_MARSHAL_BUFFERS_RECHECK=1000, -Dmaven.repo.local=/opt/buildagent/.m2/repository] [21:03:12] : [Step 4/5] [2021-11-19 21:03:12,542][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][GridInternalTaskUnusedWalSegmentsTest3] System cache's DataRegion size is configured to 40 MB. Use DataStorageConfiguration.systemRegionInitialSize property to change the setting. [21:03:12] : [Step 4/5] [2021-11-19 21:03:12,543][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][GridInternalTaskUnusedWalSegmentsTest3] Configured caches [in 'sysMemPlc' dataRegion: ['ignite-sys-cache'], in 'default' dataRegion: ['default']] [21:03:12]W: [org.apache.ignite:ignite-core] [2021-11-19 21:03:12,543][WARN ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][GridInternalTaskUnusedWalSegmentsTest3] Peer class loading is enabled (disable it in production for performance and deployment consistency reasons) [21:03:12] : [Step 4/5] [2021-11-19 21:03:12,544][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][GridInternalTaskUnusedWalSegmentsTest3] 3-rd party licenses can be found at: /opt/buildagent/work/7bc1c54bc719b67c/libs/licenses [21:03:12] : [Step 4/5] [2021-11-19 21:03:12,548][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][IgnitePluginProcessor] Configured plugins: [21:03:12] : [Step 4/5] [2021-11-19 21:03:12,548][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][IgnitePluginProcessor] ^-- StanByClusterTestProvider 1.0 [21:03:12] : [Step 4/5] [2021-11-19 21:03:12,548][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][IgnitePluginProcessor] ^-- null [21:03:12] : [Step 4/5] [2021-11-19 21:03:12,548][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][IgnitePluginProcessor] [21:03:12] : [Step 4/5] [2021-11-19 21:03:12,549][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][IgnitePluginProcessor] ^-- PageMemory tracker plugin 1.0 [21:03:12] : [Step 4/5] [2021-11-19 21:03:12,549][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][IgnitePluginProcessor] ^-- null [21:03:12] : [Step 4/5] [2021-11-19 21:03:12,549][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][IgnitePluginProcessor] [21:03:12] : [Step 4/5] [2021-11-19 21:03:12,549][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][IgnitePluginProcessor] ^-- TestDistibutedConfigurationPlugin 1.0 [21:03:12] : [Step 4/5] [2021-11-19 21:03:12,550][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][IgnitePluginProcessor] ^-- null [21:03:12] : [Step 4/5] [2021-11-19 21:03:12,550][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][IgnitePluginProcessor] [21:03:12] : [Step 4/5] [2021-11-19 21:03:12,550][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][IgnitePluginProcessor] ^-- NodeValidationPluginProvider 1.0 [21:03:12] : [Step 4/5] [2021-11-19 21:03:12,550][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][IgnitePluginProcessor] ^-- null [21:03:12] : [Step 4/5] [2021-11-19 21:03:12,550][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][IgnitePluginProcessor] [21:03:12] : [Step 4/5] [2021-11-19 21:03:12,551][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][FailureProcessor] Configured failure handler: [hnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]]] [21:03:12] : [Step 4/5] [2021-11-19 21:03:12,572][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][TcpCommunicationSpi] Successfully bound communication NIO server to TCP port [port=45093, locHost=/127.0.0.1, selectorsCnt=12, selectorSpins=0, pairedConn=false] [21:03:12]W: [org.apache.ignite:ignite-core] [2021-11-19 21:03:12,572][WARN ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][TcpCommunicationSpi] Message queue limit is set to 0 which may lead to potential OOMEs when running cache operations in FULL_ASYNC or PRIMARY_SYNC modes due to message queues growth on sender and receiver sides. [21:03:12] : [Step 4/5] [2021-11-19 21:03:12,585][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][GridCollisionManager] Collision resolution is disabled (all jobs will be activated upon arrival). [21:03:12] : [Step 4/5] [2021-11-19 21:03:12,585][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][GridInternalTaskUnusedWalSegmentsTest3] Security status [authentication=off, sandbox=off, tls/ssl=off] [21:03:12] : [Step 4/5] [2021-11-19 21:03:12,587][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][TestTcpDiscoverySpi] Successfully bound to TCP port [port=47503, localHost=localhost/127.0.0.1, locNodeId=80d945d2-7ddb-4d94-a653-44c315400003] [21:03:12]W: [org.apache.ignite:ignite-core] [2021-11-19 21:03:12,589][WARN ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][PdsFoldersResolver] Failed to acquire file lock. Will try again in 1s [nodeId=80d945d2-7ddb-4d94-a653-44c315400003, holder=[e5c7f7dd-47b7-4ab6-9149-6791d3600000][], path=/opt/buildagent/work/7bc1c54bc719b67c/work/db/node00-87f16126-5f72-4dfe-a561-76ce966f5d95/lock] [21:03:13] : [Step 4/5] [2021-11-19 21:03:13,589][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][PdsFoldersResolver] Unable to acquire lock to file [/opt/buildagent/work/7bc1c54bc719b67c/work/db/node00-87f16126-5f72-4dfe-a561-76ce966f5d95], reason: Failed to acquire file lock [holder=[e5c7f7dd-47b7-4ab6-9149-6791d3600000][], time=1 sec, path=/opt/buildagent/work/7bc1c54bc719b67c/work/db/node00-87f16126-5f72-4dfe-a561-76ce966f5d95/lock] [21:03:13]W: [org.apache.ignite:ignite-core] [2021-11-19 21:03:13,590][WARN ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][PdsFoldersResolver] Failed to acquire file lock. Will try again in 1s [nodeId=80d945d2-7ddb-4d94-a653-44c315400003, holder=[a6e2d1b8-e889-42a6-b138-d6edb8d00001][], path=/opt/buildagent/work/7bc1c54bc719b67c/work/db/node01-e7427b46-5e04-4060-9e7a-4a56d318815a/lock] [21:03:14] : [Step 4/5] [2021-11-19 21:03:14,591][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][PdsFoldersResolver] Unable to acquire lock to file [/opt/buildagent/work/7bc1c54bc719b67c/work/db/node01-e7427b46-5e04-4060-9e7a-4a56d318815a], reason: Failed to acquire file lock [holder=[a6e2d1b8-e889-42a6-b138-d6edb8d00001][], time=1 sec, path=/opt/buildagent/work/7bc1c54bc719b67c/work/db/node01-e7427b46-5e04-4060-9e7a-4a56d318815a/lock] [21:03:14]W: [org.apache.ignite:ignite-core] [2021-11-19 21:03:14,592][WARN ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][PdsFoldersResolver] Failed to acquire file lock. Will try again in 1s [nodeId=80d945d2-7ddb-4d94-a653-44c315400003, holder=[d2cfc867-15f3-4259-8cff-46a016a00002][], path=/opt/buildagent/work/7bc1c54bc719b67c/work/db/node02-ce69043b-23cc-44c7-b1cf-65562a5661fd/lock] [21:03:15] : [Step 4/5] [2021-11-19 21:03:15,593][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][PdsFoldersResolver] Unable to acquire lock to file [/opt/buildagent/work/7bc1c54bc719b67c/work/db/node02-ce69043b-23cc-44c7-b1cf-65562a5661fd], reason: Failed to acquire file lock [holder=[d2cfc867-15f3-4259-8cff-46a016a00002][], time=1 sec, path=/opt/buildagent/work/7bc1c54bc719b67c/work/db/node02-ce69043b-23cc-44c7-b1cf-65562a5661fd/lock] [21:03:15] : [Step 4/5] [2021-11-19 21:03:15,596][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][PdsFoldersResolver] Successfully created new persistent storage folder [/opt/buildagent/work/7bc1c54bc719b67c/work/db/node03-c72c5b3e-7e34-4453-ac0f-88bc1481a377] [21:03:15] : [Step 4/5] [2021-11-19 21:03:15,596][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][PdsFoldersResolver] Consistent ID used for local node is [c72c5b3e-7e34-4453-ac0f-88bc1481a377] according to persistence data storage folders [21:03:15] : [Step 4/5] [2021-11-19 21:03:15,597][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][MaintenanceProcessor] Resolved store directory for node persistent data: /opt/buildagent/work/7bc1c54bc719b67c/work/db/node03-c72c5b3e-7e34-4453-ac0f-88bc1481a377 [21:03:15] : [Step 4/5] [2021-11-19 21:03:15,598][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][CacheObjectBinaryProcessorImpl] Resolved directory for serialized binary metadata: /opt/buildagent/work/7bc1c54bc719b67c/work/db/binary_meta/node03-c72c5b3e-7e34-4453-ac0f-88bc1481a377 [21:03:15] : [Step 4/5] [2021-11-19 21:03:15,603][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/node03-c72c5b3e-7e34-4453-ac0f-88bc1481a377 [21:03:15] : [Step 4/5] [2021-11-19 21:03:15,603][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][FileWriteAheadLogManager] Resolved write ahead log work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/node03-c72c5b3e-7e34-4453-ac0f-88bc1481a377 [21:03:15] : [Step 4/5] [2021-11-19 21:03:15,604][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][FileWriteAheadLogManager] Resolved write ahead log archive directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/node03-c72c5b3e-7e34-4453-ac0f-88bc1481a377 [21:03:15] : [Step 4/5] [2021-11-19 21:03:15,612][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/node03-c72c5b3e-7e34-4453-ac0f-88bc1481a377/0000000000000000.wal [21:03:15] : [Step 4/5] [2021-11-19 21:03:15,612][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][FileHandleManagerImpl] Initialized write-ahead log manager [mode=LOG_ONLY] [21:03:15] : [Step 4/5] [2021-11-19 21:03:15,617][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][GridCacheDatabaseSharedManager] Configured data regions initialized successfully [total=5] [21:03:15] : [Step 4/5] [2021-11-19 21:03:15,618][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][IgniteSnapshotManager] Resolved snapshot work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/snapshots [21:03:15] : [Step 4/5] [2021-11-19 21:03:15,618][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][IgniteSnapshotManager] Resolved temp directory for snapshot creation: /opt/buildagent/work/7bc1c54bc719b67c/work/db/node03-c72c5b3e-7e34-4453-ac0f-88bc1481a377/snp [21:03:15] : [Step 4/5] [2021-11-19 21:03:15,621][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][ClientListenerProcessor] Client connector processor has started on TCP port 10803 [21:03:15] : [Step 4/5] [2021-11-19 21:03:15,624][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][GridInternalTaskUnusedWalSegmentsTest3] Non-loopback local IPs: 172.17.0.4 [21:03:15] : [Step 4/5] [2021-11-19 21:03:15,624][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][GridInternalTaskUnusedWalSegmentsTest3] Enabled local MACs: 0242AC110004 [21:03:15] : [Step 4/5] [2021-11-19 21:03:15,625][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:03:15] : [Step 4/5] [2021-11-19 21:03:15,626][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:03:15] : [Step 4/5] [2021-11-19 21:03:15,627][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:03:15] : [Step 4/5] [2021-11-19 21:03:15,629][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][GridCacheDatabaseSharedManager] Applying lost metastore updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:03:15] : [Step 4/5] [2021-11-19 21:03:15,629][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=0 ms] [21:03:15] : [Step 4/5] [2021-11-19 21:03:15,630][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][GridCacheProcessor] Restoring partition state for local groups. [21:03:15] : [Step 4/5] [2021-11-19 21:03:15,630][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=0, partitionsProcessed=0, time=0ms] [21:03:15] : [Step 4/5] [2021-11-19 21:03:15,630][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][GridEncryptionManager] Encryption keys loaded from metastore. [grps=, masterKeyName=null] [21:03:15] : [Step 4/5] [2021-11-19 21:03:15,632][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][ClusterProcessor] Cluster ID and tag has been read from metastorage: null [21:03:15] : [Step 4/5] [2021-11-19 21:03:15,632][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][IgniteClusterImpl] Shutdown policy was updated [oldVal=null, newVal=null] [21:03:15] : [Step 4/5] [2021-11-19 21:03:15,632][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][GridCacheDatabaseSharedManager] Checkpoint frequency deviation changed [oldVal=null, newVal=null] [21:03:15] : [Step 4/5] [2021-11-19 21:03:15,642][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][FilePageStoreManager] Cleanup cache stores [total=1, left=0, cleanFiles=false] [21:03:15] : [Step 4/5] [2021-11-19 21:03:15,645][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:03:15] : [Step 4/5] [2021-11-19 21:03:15,646][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:03:15] : [Step 4/5] [2021-11-19 21:03:15,647][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:03:15] : [Step 4/5] [2021-11-19 21:03:15,648][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][GridCacheDatabaseSharedManager] Data Regions Started: 5 [21:03:15] : [Step 4/5] [2021-11-19 21:03:15,648][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][GridCacheDatabaseSharedManager] ^-- sysMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:03:15] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:03:15] : [Step 4/5] ^-- default region [type=default, persistence=true, lazyAlloc=true, [21:03:15] : [Step 4/5] ... initCfg=100MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB, allocTotal=0MB] [21:03:15] : [Step 4/5] ^-- metastoreMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:03:15] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:03:15] : [Step 4/5] ^-- TxLog region [type=internal, persistence=true, lazyAlloc=false, [21:03:15] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:03:15] : [Step 4/5] ^-- volatileDsMemPlc region [type=user, persistence=false, lazyAlloc=true, [21:03:15] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB] [21:03:15] : [Step 4/5] ^-- Ignite persistence [used=0MB] [21:03:15] : [Step 4/5] [21:03:15] : [Step 4/5] [2021-11-19 21:03:15,649][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][GridCacheDatabaseSharedManager] Starting binary memory restore for: [1544803905, -2100569601] [21:03:15] : [Step 4/5] [2021-11-19 21:03:15,659][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:03:15] : [Step 4/5] [2021-11-19 21:03:15,659][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:03:15] : [Step 4/5] [2021-11-19 21:03:15,662][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/node03-c72c5b3e-7e34-4453-ac0f-88bc1481a377/0000000000000000.wal, offset=0, ver=2] [21:03:15] : [Step 4/5] [2021-11-19 21:03:15,666][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:03:15] : [Step 4/5] [2021-11-19 21:03:15,670][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][GridCacheProcessor] Started cache in recovery mode [name=default, id=1544803905, dataRegionName=default, mode=PARTITIONED, atomicity=ATOMIC, backups=0, mvcc=false] [21:03:15] : [Step 4/5] [2021-11-19 21:03:15,673][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][GridCacheProcessor] Started cache in recovery mode [name=ignite-sys-cache, id=-2100569601, dataRegionName=sysMemPlc, mode=REPLICATED, atomicity=TRANSACTIONAL, backups=2147483647, mvcc=false] [21:03:15] : [Step 4/5] [2021-11-19 21:03:15,674][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][GridCacheDatabaseSharedManager] Binary recovery performed in 25 ms. [21:03:15] : [Step 4/5] [2021-11-19 21:03:15,674][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:03:15] : [Step 4/5] [2021-11-19 21:03:15,675][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][GridCacheDatabaseSharedManager] Applying lost cache updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:03:15] : [Step 4/5] [2021-11-19 21:03:15,677][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=10 ms] [21:03:15] : [Step 4/5] [2021-11-19 21:03:15,678][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][GridCacheProcessor] Restoring partition state for local groups. [21:03:15] : [Step 4/5] [2021-11-19 21:03:15,688][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=2, partitionsProcessed=132, time=10ms] [21:03:15] : [Step 4/5] [2021-11-19 21:03:15,711][INFO ][tcp-disco-srvr-[:47500]-#217%util.GridInternalTaskUnusedWalSegmentsTest0%-#4540%util.GridInternalTaskUnusedWalSegmentsTest0%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=48897] [21:03:15] : [Step 4/5] [2021-11-19 21:03:15,712][INFO ][tcp-disco-srvr-[:47500]-#217%util.GridInternalTaskUnusedWalSegmentsTest0%-#4540%util.GridInternalTaskUnusedWalSegmentsTest0%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=48897] [21:03:15] : [Step 4/5] [2021-11-19 21:03:15,712][INFO ][tcp-disco-sock-reader-[]-#241%util.GridInternalTaskUnusedWalSegmentsTest0%-#4909%util.GridInternalTaskUnusedWalSegmentsTest0%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:48897, rmtPort=48897] [21:03:15] : [Step 4/5] [2021-11-19 21:03:15,713][INFO ][tcp-disco-sock-reader-[80d945d2 127.0.0.1:48897]-#241%util.GridInternalTaskUnusedWalSegmentsTest0%-#4909%util.GridInternalTaskUnusedWalSegmentsTest0%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=80d945d2-7ddb-4d94-a653-44c315400003, rmtAddr=/127.0.0.1:48897] [21:03:15] : [Step 4/5] [2021-11-19 21:03:15,716][INFO ][tcp-disco-srvr-[:47503]-#240%util.GridInternalTaskUnusedWalSegmentsTest3%-#4908%util.GridInternalTaskUnusedWalSegmentsTest3%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=55083] [21:03:15] : [Step 4/5] [2021-11-19 21:03:15,716][INFO ][tcp-disco-srvr-[:47503]-#240%util.GridInternalTaskUnusedWalSegmentsTest3%-#4908%util.GridInternalTaskUnusedWalSegmentsTest3%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=55083] [21:03:15] : [Step 4/5] [2021-11-19 21:03:15,720][INFO ][tcp-disco-sock-reader-[]-#242%util.GridInternalTaskUnusedWalSegmentsTest3%-#4910%util.GridInternalTaskUnusedWalSegmentsTest3%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:55083, rmtPort=55083] [21:03:15] : [Step 4/5] [2021-11-19 21:03:15,721][INFO ][tcp-disco-sock-reader-[]-#242%util.GridInternalTaskUnusedWalSegmentsTest3%-#4910%util.GridInternalTaskUnusedWalSegmentsTest3%][TestTcpDiscoverySpi] Received ping request from the remote node [rmtNodeId=e5c7f7dd-47b7-4ab6-9149-6791d3600000, rmtAddr=/127.0.0.1:55083, rmtPort=55083] [21:03:15] : [Step 4/5] [2021-11-19 21:03:15,722][INFO ][tcp-disco-sock-reader-[]-#242%util.GridInternalTaskUnusedWalSegmentsTest3%-#4910%util.GridInternalTaskUnusedWalSegmentsTest3%][TestTcpDiscoverySpi] Finished writing ping response [rmtNodeId=e5c7f7dd-47b7-4ab6-9149-6791d3600000, rmtAddr=/127.0.0.1:55083, rmtPort=55083] [21:03:15] : [Step 4/5] [2021-11-19 21:03:15,722][INFO ][tcp-disco-sock-reader-[80d945d2 127.0.0.1:48897]-#241%util.GridInternalTaskUnusedWalSegmentsTest0%-#4909%util.GridInternalTaskUnusedWalSegmentsTest0%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:48897, rmtPort=48897, rmtNodeId=80d945d2-7ddb-4d94-a653-44c315400003] [21:03:15] : [Step 4/5] [2021-11-19 21:03:15,723][INFO ][tcp-disco-sock-reader-[]-#242%util.GridInternalTaskUnusedWalSegmentsTest3%-#4910%util.GridInternalTaskUnusedWalSegmentsTest3%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:55083, rmtPort=55083, rmtNodeId=null] [21:03:15] : [Step 4/5] [2021-11-19 21:03:15,724][INFO ][tcp-disco-msg-worker-[a6e2d1b8 127.0.0.1:47501 crd]-#216%util.GridInternalTaskUnusedWalSegmentsTest0%-#4539%util.GridInternalTaskUnusedWalSegmentsTest0%][GridEncryptionManager] Joining node doesn't have stored group keys [node=80d945d2-7ddb-4d94-a653-44c315400003] [21:03:15] : [Step 4/5] [2021-11-19 21:03:15,741][INFO ][tcp-disco-msg-worker-[e5c7f7dd 127.0.0.1:47500]-#230%util.GridInternalTaskUnusedWalSegmentsTest2%-#4783%util.GridInternalTaskUnusedWalSegmentsTest2%][TestTcpDiscoverySpi] New next node [newNext=TcpDiscoveryNode [id=80d945d2-7ddb-4d94-a653-44c315400003, consistentId=c72c5b3e-7e34-4453-ac0f-88bc1481a377, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47503], discPort=47503, order=0, intOrder=4, lastExchangeTime=1637344995727, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false]] [21:03:15] : [Step 4/5] [2021-11-19 21:03:15,742][INFO ][tcp-disco-srvr-[:47503]-#240%util.GridInternalTaskUnusedWalSegmentsTest3%-#4908%util.GridInternalTaskUnusedWalSegmentsTest3%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=37925] [21:03:15] : [Step 4/5] [2021-11-19 21:03:15,742][INFO ][tcp-disco-sock-reader-[d2cfc867 127.0.0.1:54437]-#235%util.GridInternalTaskUnusedWalSegmentsTest0%-#4788%util.GridInternalTaskUnusedWalSegmentsTest0%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:54437, rmtPort=54437, rmtNodeId=d2cfc867-15f3-4259-8cff-46a016a00002] [21:03:15] : [Step 4/5] [2021-11-19 21:03:15,743][INFO ][tcp-disco-srvr-[:47503]-#240%util.GridInternalTaskUnusedWalSegmentsTest3%-#4908%util.GridInternalTaskUnusedWalSegmentsTest3%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=37925] [21:03:15] : [Step 4/5] [2021-11-19 21:03:15,744][INFO ][tcp-disco-sock-reader-[]-#243%util.GridInternalTaskUnusedWalSegmentsTest3%-#4911%util.GridInternalTaskUnusedWalSegmentsTest3%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:37925, rmtPort=37925] [21:03:15] : [Step 4/5] [2021-11-19 21:03:15,745][INFO ][tcp-disco-sock-reader-[d2cfc867 127.0.0.1:37925]-#243%util.GridInternalTaskUnusedWalSegmentsTest3%-#4911%util.GridInternalTaskUnusedWalSegmentsTest3%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=d2cfc867-15f3-4259-8cff-46a016a00002, rmtAddr=/127.0.0.1:37925] [21:03:15] : [Step 4/5] [2021-11-19 21:03:15,749][INFO ][tcp-disco-msg-worker-[]-#239%util.GridInternalTaskUnusedWalSegmentsTest3%-#4907%util.GridInternalTaskUnusedWalSegmentsTest3%][TestTcpDiscoverySpi] New next node [newNext=TcpDiscoveryNode [id=e5c7f7dd-47b7-4ab6-9149-6791d3600000, consistentId=87f16126-5f72-4dfe-a561-76ce966f5d95, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637344995737, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false]] [21:03:15] : [Step 4/5] [2021-11-19 21:03:15,750][INFO ][tcp-disco-srvr-[:47500]-#217%util.GridInternalTaskUnusedWalSegmentsTest0%-#4540%util.GridInternalTaskUnusedWalSegmentsTest0%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=57243] [21:03:15] : [Step 4/5] [2021-11-19 21:03:15,751][INFO ][tcp-disco-srvr-[:47500]-#217%util.GridInternalTaskUnusedWalSegmentsTest0%-#4540%util.GridInternalTaskUnusedWalSegmentsTest0%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=57243] [21:03:15] : [Step 4/5] [2021-11-19 21:03:15,751][INFO ][tcp-disco-sock-reader-[]-#244%util.GridInternalTaskUnusedWalSegmentsTest0%-#4912%util.GridInternalTaskUnusedWalSegmentsTest0%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:57243, rmtPort=57243] [21:03:15] : [Step 4/5] [2021-11-19 21:03:15,752][INFO ][tcp-disco-sock-reader-[80d945d2 127.0.0.1:57243]-#244%util.GridInternalTaskUnusedWalSegmentsTest0%-#4912%util.GridInternalTaskUnusedWalSegmentsTest0%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=80d945d2-7ddb-4d94-a653-44c315400003, rmtAddr=/127.0.0.1:57243] [21:03:15] : [Step 4/5] [2021-11-19 21:03:15,755][INFO ][disco-event-worker-#4542%util.GridInternalTaskUnusedWalSegmentsTest0%][GridDiscoveryManager] Added new node to topology: TcpDiscoveryNode [id=80d945d2-7ddb-4d94-a653-44c315400003, consistentId=c72c5b3e-7e34-4453-ac0f-88bc1481a377, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47503], discPort=47503, order=4, intOrder=4, lastExchangeTime=1637344995707, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false] [21:03:15] : [Step 4/5] [2021-11-19 21:03:15,756][INFO ][disco-event-worker-#4790%util.GridInternalTaskUnusedWalSegmentsTest2%][GridDiscoveryManager] Added new node to topology: TcpDiscoveryNode [id=80d945d2-7ddb-4d94-a653-44c315400003, consistentId=c72c5b3e-7e34-4453-ac0f-88bc1481a377, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47503], discPort=47503, order=4, intOrder=4, lastExchangeTime=1637344995727, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false] [21:03:15] : [Step 4/5] [2021-11-19 21:03:15,756][INFO ][disco-event-worker-#4666%util.GridInternalTaskUnusedWalSegmentsTest1%][GridDiscoveryManager] Added new node to topology: TcpDiscoveryNode [id=80d945d2-7ddb-4d94-a653-44c315400003, consistentId=c72c5b3e-7e34-4453-ac0f-88bc1481a377, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47503], discPort=47503, order=4, intOrder=4, lastExchangeTime=1637344995727, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false] [21:03:15] : [Step 4/5] [2021-11-19 21:03:15,757][INFO ][disco-event-worker-#4790%util.GridInternalTaskUnusedWalSegmentsTest2%][GridDiscoveryManager] Topology snapshot [ver=4, locNode=d2cfc867, servers=4, clients=0, state=INACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=e5c7f7dd-47b7-4ab6-9149-6791d3600000, consistentId=87f16126-5f72-4dfe-a561-76ce966f5d95, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=a6e2d1b8-e889-42a6-b138-d6edb8d00001, consistentId=e7427b46-5e04-4060-9e7a-4a56d318815a, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=d2cfc867-15f3-4259-8cff-46a016a00002, consistentId=ce69043b-23cc-44c7-b1cf-65562a5661fd, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=80d945d2-7ddb-4d94-a653-44c315400003, consistentId=c72c5b3e-7e34-4453-ac0f-88bc1481a377, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:03:15] : [Step 4/5] [2021-11-19 21:03:15,757][INFO ][disco-event-worker-#4542%util.GridInternalTaskUnusedWalSegmentsTest0%][GridDiscoveryManager] Topology snapshot [ver=4, locNode=e5c7f7dd, servers=4, clients=0, state=INACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=e5c7f7dd-47b7-4ab6-9149-6791d3600000, consistentId=87f16126-5f72-4dfe-a561-76ce966f5d95, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=a6e2d1b8-e889-42a6-b138-d6edb8d00001, consistentId=e7427b46-5e04-4060-9e7a-4a56d318815a, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=d2cfc867-15f3-4259-8cff-46a016a00002, consistentId=ce69043b-23cc-44c7-b1cf-65562a5661fd, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=80d945d2-7ddb-4d94-a653-44c315400003, consistentId=c72c5b3e-7e34-4453-ac0f-88bc1481a377, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:03:15] : [Step 4/5] [2021-11-19 21:03:15,760][INFO ][tcp-disco-msg-worker-[e5c7f7dd 127.0.0.1:47500]-#239%util.GridInternalTaskUnusedWalSegmentsTest3%-#4907%util.GridInternalTaskUnusedWalSegmentsTest3%][ClusterProcessor] infallible_faraday [21:03:15] : [Step 4/5] [2021-11-19 21:03:15,758][INFO ][disco-event-worker-#4666%util.GridInternalTaskUnusedWalSegmentsTest1%][GridDiscoveryManager] Topology snapshot [ver=4, locNode=a6e2d1b8, servers=4, clients=0, state=INACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=e5c7f7dd-47b7-4ab6-9149-6791d3600000, consistentId=87f16126-5f72-4dfe-a561-76ce966f5d95, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=a6e2d1b8-e889-42a6-b138-d6edb8d00001, consistentId=e7427b46-5e04-4060-9e7a-4a56d318815a, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=d2cfc867-15f3-4259-8cff-46a016a00002, consistentId=ce69043b-23cc-44c7-b1cf-65562a5661fd, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=80d945d2-7ddb-4d94-a653-44c315400003, consistentId=c72c5b3e-7e34-4453-ac0f-88bc1481a377, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:03:15] : [Step 4/5] [2021-11-19 21:03:15,761][INFO ][tcp-disco-msg-worker-[e5c7f7dd 127.0.0.1:47500]-#239%util.GridInternalTaskUnusedWalSegmentsTest3%-#4907%util.GridInternalTaskUnusedWalSegmentsTest3%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustEnabled' was changed from 'null' to 'false' [21:03:15] : [Step 4/5] [2021-11-19 21:03:15,763][INFO ][tcp-disco-msg-worker-[e5c7f7dd 127.0.0.1:47500]-#239%util.GridInternalTaskUnusedWalSegmentsTest3%-#4907%util.GridInternalTaskUnusedWalSegmentsTest3%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustTimeout' was changed from 'null' to '300000' [21:03:15] : [Step 4/5] [2021-11-19 21:03:15,764][INFO ][tcp-disco-msg-worker-[e5c7f7dd 127.0.0.1:47500]-#239%util.GridInternalTaskUnusedWalSegmentsTest3%-#4907%util.GridInternalTaskUnusedWalSegmentsTest3%][IgniteTxManager] Transactions parameter 'longOperationsDumpTimeout' was changed from 'null' to '60000' [21:03:15] : [Step 4/5] [2021-11-19 21:03:15,764][INFO ][tcp-disco-msg-worker-[e5c7f7dd 127.0.0.1:47500]-#239%util.GridInternalTaskUnusedWalSegmentsTest3%-#4907%util.GridInternalTaskUnusedWalSegmentsTest3%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpThreshold' was changed from 'null' to '0' [21:03:15] : [Step 4/5] [2021-11-19 21:03:15,765][INFO ][tcp-disco-msg-worker-[e5c7f7dd 127.0.0.1:47500]-#239%util.GridInternalTaskUnusedWalSegmentsTest3%-#4907%util.GridInternalTaskUnusedWalSegmentsTest3%][IgniteTxManager] Transactions parameter 'transactionTimeDumpSamplesCoefficient' was changed from 'null' to '0.0' [21:03:15] : [Step 4/5] [2021-11-19 21:03:15,765][INFO ][tcp-disco-msg-worker-[e5c7f7dd 127.0.0.1:47500]-#239%util.GridInternalTaskUnusedWalSegmentsTest3%-#4907%util.GridInternalTaskUnusedWalSegmentsTest3%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpSamplesPerSecondLimit' was changed from 'null' to '5' [21:03:15] : [Step 4/5] [2021-11-19 21:03:15,766][INFO ][tcp-disco-msg-worker-[e5c7f7dd 127.0.0.1:47500]-#239%util.GridInternalTaskUnusedWalSegmentsTest3%-#4907%util.GridInternalTaskUnusedWalSegmentsTest3%][IgniteTxManager] Transactions parameter 'collisionsDumpInterval' was changed from 'null' to '1000' [21:03:15] : [Step 4/5] [2021-11-19 21:03:15,766][INFO ][tcp-disco-msg-worker-[e5c7f7dd 127.0.0.1:47500]-#239%util.GridInternalTaskUnusedWalSegmentsTest3%-#4907%util.GridInternalTaskUnusedWalSegmentsTest3%][IgniteTxManager] Transactions parameter 'txOwnerDumpRequestsAllowed' was changed from 'null' to 'true' [21:03:15] : [Step 4/5] [2021-11-19 21:03:15,767][INFO ][tcp-disco-msg-worker-[e5c7f7dd 127.0.0.1:47500]-#239%util.GridInternalTaskUnusedWalSegmentsTest3%-#4907%util.GridInternalTaskUnusedWalSegmentsTest3%][GridCacheDatabaseSharedManager] Historical rebalance WAL threshold changed [property=historical.rebalance.threshold, oldVal=null, newVal=500] [21:03:15] : [Step 4/5] [2021-11-19 21:03:15,768][INFO ][disco-notifier-worker-#4906%util.GridInternalTaskUnusedWalSegmentsTest3%][MvccProcessorImpl] Assigned mvcc coordinator [crd=MvccCoordinator [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], nodeId=e5c7f7dd-47b7-4ab6-9149-6791d3600000, ver=1637344988753, local=false, initialized=false]] [21:03:15] : [Step 4/5] [2021-11-19 21:03:15,770][INFO ][sys-#4884%util.GridInternalTaskUnusedWalSegmentsTest3%][ClusterProcessor] Writing cluster ID and tag to metastorage on ready for write ClusterIdAndTag [id=3d49fd3a-53f0-4d1a-a0f4-1e83e06bb38e, tag=infallible_faraday] [21:03:15] : [Step 4/5] [2021-11-19 21:03:15,794][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][GridInternalTaskUnusedWalSegmentsTest3] To start Console Management & Monitoring run ignitevisorcmd.{sh|bat} [21:03:15] : [Step 4/5] [2021-11-19 21:03:15,794][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][GridInternalTaskUnusedWalSegmentsTest3] [21:03:15] : [Step 4/5] [21:03:15] : [Step 4/5] >>> +-------------------------------------------+ [21:03:15] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:03:15] : [Step 4/5] >>> +-------------------------------------------+ [21:03:15] : [Step 4/5] >>> OS name: Linux 4.15.0-151-generic amd64 [21:03:15] : [Step 4/5] >>> CPU(s): 24 [21:03:15] : [Step 4/5] >>> Heap: 2.0GB [21:03:15] : [Step 4/5] >>> VM name: 16724@c4dfe9a430b2 [21:03:15] : [Step 4/5] >>> Ignite instance name: util.GridInternalTaskUnusedWalSegmentsTest3 [21:03:15] : [Step 4/5] >>> Local node [ID=80D945D2-7DDB-4D94-A653-44C315400003, order=4, clientMode=false] [21:03:15] : [Step 4/5] >>> Local node addresses: [127.0.0.1] [21:03:15] : [Step 4/5] >>> Local ports: TCP:10803 TCP:45093 TCP:47503 [21:03:15] : [Step 4/5] [21:03:15] : [Step 4/5] [2021-11-19 21:03:15,795][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][GridInternalTaskUnusedWalSegmentsTest3] >>> Ignite cluster is in INACTIVE state (limited functionality available). Use control.(sh|bat) script or IgniteCluster.state(ClusterState.ACTIVE) to change the state. [21:03:15] : [Step 4/5] [2021-11-19 21:03:15,796][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][GridDiscoveryManager] Topology snapshot [ver=4, locNode=80d945d2, servers=4, clients=0, state=INACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=e5c7f7dd-47b7-4ab6-9149-6791d3600000, consistentId=87f16126-5f72-4dfe-a561-76ce966f5d95, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=a6e2d1b8-e889-42a6-b138-d6edb8d00001, consistentId=e7427b46-5e04-4060-9e7a-4a56d318815a, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=d2cfc867-15f3-4259-8cff-46a016a00002, consistentId=ce69043b-23cc-44c7-b1cf-65562a5661fd, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=80d945d2-7ddb-4d94-a653-44c315400003, consistentId=c72c5b3e-7e34-4453-ac0f-88bc1481a377, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:03:15] : [Step 4/5] [2021-11-19 21:03:15,798][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][G] Node started : [stage="Configure system pool" (0 ms),stage="Start managers" (3071 ms),stage="Configure binary metadata" (2 ms),stage="Start processors" (22 ms),stage="Start 'StanByClusterTestProvider' plugin" (0 ms),stage="Start 'PageMemory tracker plugin' plugin" (0 ms),stage="Start 'TestDistibutedConfigurationPlugin' plugin" (0 ms),stage="Start 'NodeValidationPluginProvider' plugin" (0 ms),stage="Init metastore" (19 ms),stage="Init and start regions" (7 ms),stage="Restore binary memory" (24 ms),stage="Restore logical state" (13 ms),stage="Finish recovery" (19 ms),stage="Join topology" (61 ms),stage="Await transition" (3 ms),stage="Await exchange" (26 ms),stage="Total time" (3267 ms)] [21:03:15] : [Step 4/5] [2021-11-19 21:03:15,799][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][root] Node started with the following configuration [id=80d945d2-7ddb-4d94-a653-44c315400003, marshaller=BinaryMarshaller [], discovery=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=5000, ackTimeout=5000, marsh=JdkMarshaller [clsFilter=org.apache.ignite.marshaller.MarshallerUtils$1@49523aae], reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], binaryCfg=null, lateAff=true] [21:03:15] : [Step 4/5] [2021-11-19 21:03:15,802][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][GridClusterStateProcessor] Sending activate cluster request with BaselineTopology BaselineTopology [id=0, branchingHash=1468297386, branchingType='New BaselineTopology', baselineNodes=[c72c5b3e-7e34-4453-ac0f-88bc1481a377, ce69043b-23cc-44c7-b1cf-65562a5661fd, 87f16126-5f72-4dfe-a561-76ce966f5d95, e7427b46-5e04-4060-9e7a-4a56d318815a]] [21:03:15] : [Step 4/5] [2021-11-19 21:03:15,804][INFO ][disco-notifier-worker-#4538%util.GridInternalTaskUnusedWalSegmentsTest0%][GridClusterStateProcessor] Received activate cluster request with BaselineTopology[id=0] initiator node ID: e5c7f7dd-47b7-4ab6-9149-6791d3600000 [21:03:15] : [Step 4/5] [2021-11-19 21:03:15,804][INFO ][disco-notifier-worker-#4538%util.GridInternalTaskUnusedWalSegmentsTest0%][GridClusterStateProcessor] Started state transition: activate cluster [21:03:15] : [Step 4/5] [2021-11-19 21:03:15,805][INFO ][exchange-worker-#4543%util.GridInternalTaskUnusedWalSegmentsTest0%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], crd=true, evt=DISCOVERY_CUSTOM_EVT, evtNode=e5c7f7dd-47b7-4ab6-9149-6791d3600000, customEvt=ChangeGlobalStateMessage [id=cd01d593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqId=110f05bb-be4e-4eea-8ddd-a3dd9f3c5006, initiatingNodeId=e5c7f7dd-47b7-4ab6-9149-6791d3600000, state=ACTIVE, baselineTopology=BaselineTopology [id=0, branchingHash=1468297386, branchingType='New BaselineTopology', baselineNodes=[c72c5b3e-7e34-4453-ac0f-88bc1481a377, ce69043b-23cc-44c7-b1cf-65562a5661fd, 87f16126-5f72-4dfe-a561-76ce966f5d95, e7427b46-5e04-4060-9e7a-4a56d318815a]], forceChangeBaselineTopology=false, timestamp=1637344995802, forceDeactivation=true], allowMerge=false, exchangeFreeSwitch=false] [21:03:15] : [Step 4/5] [2021-11-19 21:03:15,806][INFO ][disco-notifier-worker-#4658%util.GridInternalTaskUnusedWalSegmentsTest1%][GridClusterStateProcessor] Received activate cluster request with BaselineTopology[id=0] initiator node ID: e5c7f7dd-47b7-4ab6-9149-6791d3600000 [21:03:15] : [Step 4/5] [2021-11-19 21:03:15,806][INFO ][exchange-worker-#4543%util.GridInternalTaskUnusedWalSegmentsTest0%][GridDhtPartitionsExchangeFuture] Start activation process [nodeId=e5c7f7dd-47b7-4ab6-9149-6791d3600000, client=false, topVer=AffinityTopologyVersion [topVer=4, minorTopVer=1]]. New state: ACTIVE [21:03:15] : [Step 4/5] [2021-11-19 21:03:15,807][INFO ][disco-notifier-worker-#4658%util.GridInternalTaskUnusedWalSegmentsTest1%][GridClusterStateProcessor] Started state transition: activate cluster [21:03:15] : [Step 4/5] [2021-11-19 21:03:15,808][INFO ][disco-notifier-worker-#4782%util.GridInternalTaskUnusedWalSegmentsTest2%][GridClusterStateProcessor] Received activate cluster request with BaselineTopology[id=0] initiator node ID: e5c7f7dd-47b7-4ab6-9149-6791d3600000 [21:03:15] : [Step 4/5] [2021-11-19 21:03:15,808][INFO ][exchange-worker-#4667%util.GridInternalTaskUnusedWalSegmentsTest1%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], crd=false, evt=DISCOVERY_CUSTOM_EVT, evtNode=e5c7f7dd-47b7-4ab6-9149-6791d3600000, customEvt=ChangeGlobalStateMessage [id=cd01d593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqId=110f05bb-be4e-4eea-8ddd-a3dd9f3c5006, initiatingNodeId=e5c7f7dd-47b7-4ab6-9149-6791d3600000, state=ACTIVE, baselineTopology=BaselineTopology [id=0, branchingHash=1468297386, branchingType='New BaselineTopology', baselineNodes=[c72c5b3e-7e34-4453-ac0f-88bc1481a377, ce69043b-23cc-44c7-b1cf-65562a5661fd, 87f16126-5f72-4dfe-a561-76ce966f5d95, e7427b46-5e04-4060-9e7a-4a56d318815a]], forceChangeBaselineTopology=false, timestamp=1637344995802, forceDeactivation=true], allowMerge=false, exchangeFreeSwitch=false] [21:03:15] : [Step 4/5] [2021-11-19 21:03:15,810][INFO ][exchange-worker-#4667%util.GridInternalTaskUnusedWalSegmentsTest1%][GridDhtPartitionsExchangeFuture] Start activation process [nodeId=a6e2d1b8-e889-42a6-b138-d6edb8d00001, client=false, topVer=AffinityTopologyVersion [topVer=4, minorTopVer=1]]. New state: ACTIVE [21:03:15] : [Step 4/5] [2021-11-19 21:03:15,808][INFO ][exchange-worker-#4543%util.GridInternalTaskUnusedWalSegmentsTest0%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/node00-87f16126-5f72-4dfe-a561-76ce966f5d95 [21:03:15] : [Step 4/5] [2021-11-19 21:03:15,811][INFO ][exchange-worker-#4667%util.GridInternalTaskUnusedWalSegmentsTest1%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/node01-e7427b46-5e04-4060-9e7a-4a56d318815a [21:03:15] : [Step 4/5] [2021-11-19 21:03:15,810][INFO ][disco-notifier-worker-#4906%util.GridInternalTaskUnusedWalSegmentsTest3%][GridClusterStateProcessor] Received activate cluster request with BaselineTopology[id=0] initiator node ID: e5c7f7dd-47b7-4ab6-9149-6791d3600000 [21:03:15] : [Step 4/5] [2021-11-19 21:03:15,813][INFO ][disco-notifier-worker-#4906%util.GridInternalTaskUnusedWalSegmentsTest3%][GridClusterStateProcessor] Started state transition: activate cluster [21:03:15] : [Step 4/5] [2021-11-19 21:03:15,808][INFO ][disco-notifier-worker-#4782%util.GridInternalTaskUnusedWalSegmentsTest2%][GridClusterStateProcessor] Started state transition: activate cluster [21:03:15] : [Step 4/5] [2021-11-19 21:03:15,818][INFO ][exchange-worker-#4543%util.GridInternalTaskUnusedWalSegmentsTest0%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/node00-87f16126-5f72-4dfe-a561-76ce966f5d95/0000000000000000.wal, offset=13186, ver=2] [21:03:15] : [Step 4/5] [2021-11-19 21:03:15,818][INFO ][exchange-worker-#4915%util.GridInternalTaskUnusedWalSegmentsTest3%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], crd=false, evt=DISCOVERY_CUSTOM_EVT, evtNode=e5c7f7dd-47b7-4ab6-9149-6791d3600000, customEvt=ChangeGlobalStateMessage [id=cd01d593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqId=110f05bb-be4e-4eea-8ddd-a3dd9f3c5006, initiatingNodeId=e5c7f7dd-47b7-4ab6-9149-6791d3600000, state=ACTIVE, baselineTopology=BaselineTopology [id=0, branchingHash=1468297386, branchingType='New BaselineTopology', baselineNodes=[c72c5b3e-7e34-4453-ac0f-88bc1481a377, ce69043b-23cc-44c7-b1cf-65562a5661fd, 87f16126-5f72-4dfe-a561-76ce966f5d95, e7427b46-5e04-4060-9e7a-4a56d318815a]], forceChangeBaselineTopology=false, timestamp=1637344995802, forceDeactivation=true], allowMerge=false, exchangeFreeSwitch=false] [21:03:15] : [Step 4/5] [2021-11-19 21:03:15,818][INFO ][exchange-worker-#4791%util.GridInternalTaskUnusedWalSegmentsTest2%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], crd=false, evt=DISCOVERY_CUSTOM_EVT, evtNode=e5c7f7dd-47b7-4ab6-9149-6791d3600000, customEvt=ChangeGlobalStateMessage [id=cd01d593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqId=110f05bb-be4e-4eea-8ddd-a3dd9f3c5006, initiatingNodeId=e5c7f7dd-47b7-4ab6-9149-6791d3600000, state=ACTIVE, baselineTopology=BaselineTopology [id=0, branchingHash=1468297386, branchingType='New BaselineTopology', baselineNodes=[c72c5b3e-7e34-4453-ac0f-88bc1481a377, ce69043b-23cc-44c7-b1cf-65562a5661fd, 87f16126-5f72-4dfe-a561-76ce966f5d95, e7427b46-5e04-4060-9e7a-4a56d318815a]], forceChangeBaselineTopology=false, timestamp=1637344995802, forceDeactivation=true], allowMerge=false, exchangeFreeSwitch=false] [21:03:15] : [Step 4/5] [2021-11-19 21:03:15,821][INFO ][exchange-worker-#4543%util.GridInternalTaskUnusedWalSegmentsTest0%][GridClusterStateProcessor] Writing BaselineTopology[id=0] [21:03:15] : [Step 4/5] [2021-11-19 21:03:15,819][INFO ][exchange-worker-#4915%util.GridInternalTaskUnusedWalSegmentsTest3%][GridDhtPartitionsExchangeFuture] Start activation process [nodeId=80d945d2-7ddb-4d94-a653-44c315400003, client=false, topVer=AffinityTopologyVersion [topVer=4, minorTopVer=1]]. New state: ACTIVE [21:03:15] : [Step 4/5] [2021-11-19 21:03:15,822][INFO ][exchange-worker-#4791%util.GridInternalTaskUnusedWalSegmentsTest2%][GridDhtPartitionsExchangeFuture] Start activation process [nodeId=d2cfc867-15f3-4259-8cff-46a016a00002, client=false, topVer=AffinityTopologyVersion [topVer=4, minorTopVer=1]]. New state: ACTIVE [21:03:15] : [Step 4/5] [2021-11-19 21:03:15,824][INFO ][exchange-worker-#4791%util.GridInternalTaskUnusedWalSegmentsTest2%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/node02-ce69043b-23cc-44c7-b1cf-65562a5661fd [21:03:15] : [Step 4/5] [2021-11-19 21:03:15,823][INFO ][exchange-worker-#4915%util.GridInternalTaskUnusedWalSegmentsTest3%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/node03-c72c5b3e-7e34-4453-ac0f-88bc1481a377 [21:03:15] : [Step 4/5] [2021-11-19 21:03:15,826][INFO ][exchange-worker-#4667%util.GridInternalTaskUnusedWalSegmentsTest1%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/node01-e7427b46-5e04-4060-9e7a-4a56d318815a/0000000000000000.wal, offset=13186, ver=2] [21:03:15] : [Step 4/5] [2021-11-19 21:03:15,837][INFO ][exchange-worker-#4543%util.GridInternalTaskUnusedWalSegmentsTest0%][GridCacheDatabaseSharedManager] Finish recovery performed in 26 ms. [21:03:15] : [Step 4/5] [2021-11-19 21:03:15,833][INFO ][exchange-worker-#4791%util.GridInternalTaskUnusedWalSegmentsTest2%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/node02-ce69043b-23cc-44c7-b1cf-65562a5661fd/0000000000000000.wal, offset=13186, ver=2] [21:03:15] : [Step 4/5] [2021-11-19 21:03:15,842][INFO ][exchange-worker-#4667%util.GridInternalTaskUnusedWalSegmentsTest1%][GridClusterStateProcessor] Writing BaselineTopology[id=0] [21:03:15] : [Step 4/5] [2021-11-19 21:03:15,847][INFO ][exchange-worker-#4543%util.GridInternalTaskUnusedWalSegmentsTest0%][msg] Components activation performed in 39 ms. [21:03:15] : [Step 4/5] [2021-11-19 21:03:15,847][INFO ][exchange-worker-#4791%util.GridInternalTaskUnusedWalSegmentsTest2%][GridClusterStateProcessor] Writing BaselineTopology[id=0] [21:03:15] : [Step 4/5] [2021-11-19 21:03:15,847][INFO ][exchange-worker-#4915%util.GridInternalTaskUnusedWalSegmentsTest3%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/node03-c72c5b3e-7e34-4453-ac0f-88bc1481a377/0000000000000000.wal, offset=13186, ver=2] [21:03:15] : [Step 4/5] [2021-11-19 21:03:15,848][INFO ][exchange-worker-#4667%util.GridInternalTaskUnusedWalSegmentsTest1%][GridCacheDatabaseSharedManager] Finish recovery performed in 35 ms. [21:03:15] : [Step 4/5] [2021-11-19 21:03:15,850][INFO ][exchange-worker-#4915%util.GridInternalTaskUnusedWalSegmentsTest3%][GridClusterStateProcessor] Writing BaselineTopology[id=0] [21:03:15] : [Step 4/5] [2021-11-19 21:03:15,850][INFO ][sys-#4521%util.GridInternalTaskUnusedWalSegmentsTest0%][GridCacheProcessor] Finished recovery for cache [cache=default, grp=default, startVer=AffinityTopologyVersion [topVer=4, minorTopVer=1]] [21:03:15] : [Step 4/5] [2021-11-19 21:03:15,850][INFO ][exchange-worker-#4543%util.GridInternalTaskUnusedWalSegmentsTest0%][GridCacheProcessor] Finished recovery for cache [cache=ignite-sys-cache, grp=ignite-sys-cache, startVer=AffinityTopologyVersion [topVer=4, minorTopVer=1]] [21:03:15] : [Step 4/5] [2021-11-19 21:03:15,851][INFO ][exchange-worker-#4667%util.GridInternalTaskUnusedWalSegmentsTest1%][msg] Components activation performed in 40 ms. [21:03:15] : [Step 4/5] [2021-11-19 21:03:15,854][INFO ][exchange-worker-#4667%util.GridInternalTaskUnusedWalSegmentsTest1%][GridCacheProcessor] Finished recovery for cache [cache=ignite-sys-cache, grp=ignite-sys-cache, startVer=AffinityTopologyVersion [topVer=4, minorTopVer=1]] [21:03:15] : [Step 4/5] [2021-11-19 21:03:15,856][INFO ][exchange-worker-#4791%util.GridInternalTaskUnusedWalSegmentsTest2%][GridCacheDatabaseSharedManager] Finish recovery performed in 30 ms. [21:03:15] : [Step 4/5] [2021-11-19 21:03:15,854][INFO ][sys-#4640%util.GridInternalTaskUnusedWalSegmentsTest1%][GridCacheProcessor] Finished recovery for cache [cache=default, grp=default, startVer=AffinityTopologyVersion [topVer=4, minorTopVer=1]] [21:03:15] : [Step 4/5] [2021-11-19 21:03:15,854][INFO ][exchange-worker-#4543%util.GridInternalTaskUnusedWalSegmentsTest0%][GridDhtPartitionsExchangeFuture] Successfully activated caches [nodeId=e5c7f7dd-47b7-4ab6-9149-6791d3600000, client=false, topVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], newState=ACTIVE] [21:03:15] : [Step 4/5] [2021-11-19 21:03:15,870][INFO ][exchange-worker-#4791%util.GridInternalTaskUnusedWalSegmentsTest2%][msg] Components activation performed in 46 ms. [21:03:15] : [Step 4/5] [2021-11-19 21:03:15,870][INFO ][exchange-worker-#4915%util.GridInternalTaskUnusedWalSegmentsTest3%][GridCacheDatabaseSharedManager] Finish recovery performed in 43 ms. [21:03:15] : [Step 4/5] [2021-11-19 21:03:15,870][INFO ][exchange-worker-#4543%util.GridInternalTaskUnusedWalSegmentsTest0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:03:15] : [Step 4/5] [2021-11-19 21:03:15,871][INFO ][exchange-worker-#4667%util.GridInternalTaskUnusedWalSegmentsTest1%][GridDhtPartitionsExchangeFuture] Successfully activated caches [nodeId=a6e2d1b8-e889-42a6-b138-d6edb8d00001, client=false, topVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], newState=ACTIVE] [21:03:15] : [Step 4/5] [2021-11-19 21:03:15,871][INFO ][sys-#4774%util.GridInternalTaskUnusedWalSegmentsTest2%][GridCacheProcessor] Finished recovery for cache [cache=default, grp=default, startVer=AffinityTopologyVersion [topVer=4, minorTopVer=1]] [21:03:15] : [Step 4/5] [2021-11-19 21:03:15,871][INFO ][exchange-worker-#4791%util.GridInternalTaskUnusedWalSegmentsTest2%][GridCacheProcessor] Finished recovery for cache [cache=ignite-sys-cache, grp=ignite-sys-cache, startVer=AffinityTopologyVersion [topVer=4, minorTopVer=1]] [21:03:15] : [Step 4/5] [2021-11-19 21:03:15,872][INFO ][exchange-worker-#4667%util.GridInternalTaskUnusedWalSegmentsTest1%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:03:15] : [Step 4/5] [2021-11-19 21:03:15,874][INFO ][exchange-worker-#4915%util.GridInternalTaskUnusedWalSegmentsTest3%][msg] Components activation performed in 51 ms. [21:03:15] : [Step 4/5] [2021-11-19 21:03:15,875][INFO ][exchange-worker-#4791%util.GridInternalTaskUnusedWalSegmentsTest2%][GridDhtPartitionsExchangeFuture] Successfully activated caches [nodeId=d2cfc867-15f3-4259-8cff-46a016a00002, client=false, topVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], newState=ACTIVE] [21:03:15] : [Step 4/5] [2021-11-19 21:03:15,876][INFO ][exchange-worker-#4915%util.GridInternalTaskUnusedWalSegmentsTest3%][GridCacheProcessor] Finished recovery for cache [cache=default, grp=default, startVer=AffinityTopologyVersion [topVer=4, minorTopVer=1]] [21:03:15] : [Step 4/5] [2021-11-19 21:03:15,876][INFO ][sys-#4883%util.GridInternalTaskUnusedWalSegmentsTest3%][GridCacheProcessor] Finished recovery for cache [cache=ignite-sys-cache, grp=ignite-sys-cache, startVer=AffinityTopologyVersion [topVer=4, minorTopVer=1]] [21:03:15] : [Step 4/5] [2021-11-19 21:03:15,877][INFO ][exchange-worker-#4791%util.GridInternalTaskUnusedWalSegmentsTest2%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:03:15] : [Step 4/5] [2021-11-19 21:03:15,877][INFO ][exchange-worker-#4915%util.GridInternalTaskUnusedWalSegmentsTest3%][GridDhtPartitionsExchangeFuture] Successfully activated caches [nodeId=80d945d2-7ddb-4d94-a653-44c315400003, client=false, topVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], newState=ACTIVE] [21:03:15] : [Step 4/5] [2021-11-19 21:03:15,879][INFO ][exchange-worker-#4915%util.GridInternalTaskUnusedWalSegmentsTest3%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:03:15] : [Step 4/5] [2021-11-19 21:03:15,902][INFO ][exchange-worker-#4543%util.GridInternalTaskUnusedWalSegmentsTest0%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], crd=true] [21:03:15] : [Step 4/5] [2021-11-19 21:03:15,914][INFO ][db-checkpoint-thread-#4934%util.GridInternalTaskUnusedWalSegmentsTest0%][Checkpointer] Checkpoint started [checkpointId=6b3c53ba-937e-4679-be36-075990d7d7dd, startPtr=WALPointer [idx=0, fileOff=132490, len=2159], checkpointBeforeLockTime=6ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=1ms, checkpointLockHoldTime=7ms, walCpRecordFsyncDuration=6ms, writeCheckpointEntryDuration=5ms, splitAndSortCpPagesDuration=1ms, pages=28, reason='node started'] [21:03:15] : [Step 4/5] [2021-11-19 21:03:15,917][INFO ][grid-nio-worker-tcp-comm-0-#4480%TcpCommunicationSpi%][TcpCommunicationSpi] Accepted incoming communication connection [locAddr=/127.0.0.1:45090, rmtAddr=/127.0.0.1:35040] [21:03:15] : [Step 4/5] [2021-11-19 21:03:15,917][INFO ][grid-nio-worker-tcp-comm-1-#4481%TcpCommunicationSpi%][TcpCommunicationSpi] Accepted incoming communication connection [locAddr=/127.0.0.1:45090, rmtAddr=/127.0.0.1:35042] [21:03:15] : [Step 4/5] [2021-11-19 21:03:15,918][INFO ][grid-nio-worker-tcp-comm-2-#4482%TcpCommunicationSpi%][TcpCommunicationSpi] Accepted incoming communication connection [locAddr=/127.0.0.1:45090, rmtAddr=/127.0.0.1:35044] [21:03:15] : [Step 4/5] [2021-11-19 21:03:15,922][INFO ][grid-nio-worker-tcp-comm-0-#4724%TcpCommunicationSpi%][TcpCommunicationSpi] Established outgoing communication connection [locAddr=/127.0.0.1:35040, rmtAddr=/127.0.0.1:45090] [21:03:15] : [Step 4/5] [2021-11-19 21:03:15,922][INFO ][exchange-worker-#4791%util.GridInternalTaskUnusedWalSegmentsTest2%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], crd=false] [21:03:15] : [Step 4/5] [2021-11-19 21:03:15,924][INFO ][grid-nio-worker-tcp-comm-0-#4848%TcpCommunicationSpi%][TcpCommunicationSpi] Established outgoing communication connection [locAddr=/127.0.0.1:35044, rmtAddr=/127.0.0.1:45090] [21:03:15] : [Step 4/5] [2021-11-19 21:03:15,927][INFO ][sys-#4530%util.GridInternalTaskUnusedWalSegmentsTest0%][GridDhtPartitionsExchangeFuture] Coordinator received single message [ver=AffinityTopologyVersion [topVer=4, minorTopVer=1], node=d2cfc867-15f3-4259-8cff-46a016a00002, remainingNodes=2, allReceived=false] [21:03:15] : [Step 4/5] [2021-11-19 21:03:15,925][INFO ][grid-nio-worker-tcp-comm-0-#4600%TcpCommunicationSpi%][TcpCommunicationSpi] Established outgoing communication connection [locAddr=/127.0.0.1:35042, rmtAddr=/127.0.0.1:45090] [21:03:15] : [Step 4/5] [2021-11-19 21:03:15,934][INFO ][db-checkpoint-thread-#4937%util.GridInternalTaskUnusedWalSegmentsTest2%][Checkpointer] Checkpoint started [checkpointId=43a3a281-2c0b-4b49-8f4b-47f4335dc870, startPtr=WALPointer [idx=0, fileOff=132034, len=2045], checkpointBeforeLockTime=15ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=2ms, walCpRecordFsyncDuration=4ms, writeCheckpointEntryDuration=21ms, splitAndSortCpPagesDuration=0ms, pages=28, reason='node started'] [21:03:15] : [Step 4/5] [2021-11-19 21:03:15,934][INFO ][exchange-worker-#4915%util.GridInternalTaskUnusedWalSegmentsTest3%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], crd=false] [21:03:15] : [Step 4/5] [2021-11-19 21:03:15,935][INFO ][exchange-worker-#4667%util.GridInternalTaskUnusedWalSegmentsTest1%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], crd=false] [21:03:15] : [Step 4/5] [2021-11-19 21:03:15,935][INFO ][sys-#4531%util.GridInternalTaskUnusedWalSegmentsTest0%][GridDhtPartitionsExchangeFuture] Coordinator received single message [ver=AffinityTopologyVersion [topVer=4, minorTopVer=1], node=80d945d2-7ddb-4d94-a653-44c315400003, remainingNodes=1, allReceived=false] [21:03:15] : [Step 4/5] [2021-11-19 21:03:15,937][INFO ][sys-#4532%util.GridInternalTaskUnusedWalSegmentsTest0%][GridDhtPartitionsExchangeFuture] Coordinator received single message [ver=AffinityTopologyVersion [topVer=4, minorTopVer=1], node=a6e2d1b8-e889-42a6-b138-d6edb8d00001, allReceived=true] [21:03:15] : [Step 4/5] [2021-11-19 21:03:15,937][INFO ][sys-#4532%util.GridInternalTaskUnusedWalSegmentsTest0%][GridDhtPartitionsExchangeFuture] finishExchangeOnCoordinator [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=1]] [21:03:15] : [Step 4/5] [2021-11-19 21:03:15,947][INFO ][sys-#4532%util.GridInternalTaskUnusedWalSegmentsTest0%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], err=null, rebalanced=true, wasRebalanced=false] [21:03:15] : [Step 4/5] [2021-11-19 21:03:15,952][INFO ][sys-#4779%util.GridInternalTaskUnusedWalSegmentsTest2%][GridDhtPartitionsExchangeFuture] Received full message, will finish exchange [node=e5c7f7dd-47b7-4ab6-9149-6791d3600000, resVer=AffinityTopologyVersion [topVer=4, minorTopVer=1]] [21:03:15] : [Step 4/5] [2021-11-19 21:03:15,951][INFO ][disco-notifier-worker-#4906%util.GridInternalTaskUnusedWalSegmentsTest3%][GridClusterStateProcessor] Received state change finish message: ACTIVE [21:03:15] : [Step 4/5] [2021-11-19 21:03:15,950][INFO ][sys-#4896%util.GridInternalTaskUnusedWalSegmentsTest3%][GridDhtPartitionsExchangeFuture] Received full message, will finish exchange [node=e5c7f7dd-47b7-4ab6-9149-6791d3600000, resVer=AffinityTopologyVersion [topVer=4, minorTopVer=1]] [21:03:15] : [Step 4/5] [2021-11-19 21:03:15,949][INFO ][sys-#4653%util.GridInternalTaskUnusedWalSegmentsTest1%][GridDhtPartitionsExchangeFuture] Received full message, will finish exchange [node=e5c7f7dd-47b7-4ab6-9149-6791d3600000, resVer=AffinityTopologyVersion [topVer=4, minorTopVer=1]] [21:03:15] : [Step 4/5] [2021-11-19 21:03:15,959][INFO ][sys-#4758%util.GridInternalTaskUnusedWalSegmentsTest2%][GridCachePartitionExchangeManager] Delay process full message without exchange id (there is exchange in progress) [nodeId=e5c7f7dd-47b7-4ab6-9149-6791d3600000] [21:03:15] : [Step 4/5] [2021-11-19 21:03:15,948][INFO ][disco-notifier-worker-#4782%util.GridInternalTaskUnusedWalSegmentsTest2%][GridClusterStateProcessor] Received state change finish message: ACTIVE [21:03:15] : [Step 4/5] [2021-11-19 21:03:15,965][INFO ][disco-notifier-worker-#4782%util.GridInternalTaskUnusedWalSegmentsTest2%][GridClusterStateProcessor] Cluster state was changed from INACTIVE to ACTIVE [21:03:15] : [Step 4/5] [2021-11-19 21:03:15,947][INFO ][disco-notifier-worker-#4658%util.GridInternalTaskUnusedWalSegmentsTest1%][GridClusterStateProcessor] Received state change finish message: ACTIVE [21:03:15] : [Step 4/5] [2021-11-19 21:03:15,947][INFO ][disco-notifier-worker-#4538%util.GridInternalTaskUnusedWalSegmentsTest0%][GridClusterStateProcessor] Received state change finish message: ACTIVE [21:03:15] : [Step 4/5] [2021-11-19 21:03:15,966][INFO ][disco-notifier-worker-#4658%util.GridInternalTaskUnusedWalSegmentsTest1%][GridClusterStateProcessor] Cluster state was changed from INACTIVE to ACTIVE [21:03:15] : [Step 4/5] [2021-11-19 21:03:15,965][INFO ][sys-#4653%util.GridInternalTaskUnusedWalSegmentsTest1%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], err=null, rebalanced=true, wasRebalanced=false] [21:03:15] : [Step 4/5] [2021-11-19 21:03:15,963][INFO ][sys-#4638%util.GridInternalTaskUnusedWalSegmentsTest1%][GridCachePartitionExchangeManager] Delay process full message without exchange id (there is exchange in progress) [nodeId=e5c7f7dd-47b7-4ab6-9149-6791d3600000] [21:03:15] : [Step 4/5] [2021-11-19 21:03:15,963][INFO ][sys-#4896%util.GridInternalTaskUnusedWalSegmentsTest3%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], err=null, rebalanced=true, wasRebalanced=false] [21:03:15] : [Step 4/5] [2021-11-19 21:03:15,960][INFO ][sys-#4902%util.GridInternalTaskUnusedWalSegmentsTest3%][GridCachePartitionExchangeManager] Delay process full message without exchange id (there is exchange in progress) [nodeId=e5c7f7dd-47b7-4ab6-9149-6791d3600000] [21:03:15] : [Step 4/5] [2021-11-19 21:03:15,974][INFO ][sys-#4653%util.GridInternalTaskUnusedWalSegmentsTest1%][GridCacheProcessor] Finish proxy initialization, cacheName=default, localNodeId=a6e2d1b8-e889-42a6-b138-d6edb8d00001 [21:03:15] : [Step 4/5] [2021-11-19 21:03:15,960][INFO ][sys-#4532%util.GridInternalTaskUnusedWalSegmentsTest0%][GridCacheProcessor] Finish proxy initialization, cacheName=default, localNodeId=e5c7f7dd-47b7-4ab6-9149-6791d3600000 [21:03:15] : [Step 4/5] [2021-11-19 21:03:15,959][INFO ][sys-#4779%util.GridInternalTaskUnusedWalSegmentsTest2%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], err=null, rebalanced=true, wasRebalanced=false] [21:03:15] : [Step 4/5] [2021-11-19 21:03:15,958][INFO ][disco-notifier-worker-#4906%util.GridInternalTaskUnusedWalSegmentsTest3%][GridClusterStateProcessor] Cluster state was changed from INACTIVE to ACTIVE [21:03:15] : [Step 4/5] [2021-11-19 21:03:15,957][INFO ][db-checkpoint-thread-#4942%util.GridInternalTaskUnusedWalSegmentsTest3%][Checkpointer] Checkpoint started [checkpointId=d5f15c9c-3ce2-499b-9397-b7a06388426a, startPtr=WALPointer [idx=0, fileOff=132414, len=2140], checkpointBeforeLockTime=13ms, checkpointLockWait=1ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=3ms, walCpRecordFsyncDuration=20ms, writeCheckpointEntryDuration=24ms, splitAndSortCpPagesDuration=0ms, pages=28, reason='node started'] [21:03:15] : [Step 4/5] [2021-11-19 21:03:15,956][INFO ][db-checkpoint-thread-#4941%util.GridInternalTaskUnusedWalSegmentsTest1%][Checkpointer] Checkpoint started [checkpointId=e6445b1c-a8df-40d5-99c0-96bca5faf80b, startPtr=WALPointer [idx=0, fileOff=132414, len=2140], checkpointBeforeLockTime=12ms, checkpointLockWait=1ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=4ms, walCpRecordFsyncDuration=19ms, writeCheckpointEntryDuration=22ms, splitAndSortCpPagesDuration=0ms, pages=28, reason='node started'] [21:03:15] : [Step 4/5] [2021-11-19 21:03:15,984][INFO ][sys-#4779%util.GridInternalTaskUnusedWalSegmentsTest2%][GridCacheProcessor] Finish proxy initialization, cacheName=default, localNodeId=d2cfc867-15f3-4259-8cff-46a016a00002 [21:03:15] : [Step 4/5] [2021-11-19 21:03:15,982][INFO ][db-checkpoint-thread-#4934%util.GridInternalTaskUnusedWalSegmentsTest0%][Checkpointer] Checkpoint finished [cpId=6b3c53ba-937e-4679-be36-075990d7d7dd, pages=28, markPos=WALPointer [idx=0, fileOff=132490, len=2159], walSegmentsCovered=[], markDuration=22ms, pagesWrite=18ms, fsync=48ms, total=94ms] [21:03:15] : [Step 4/5] [2021-11-19 21:03:15,976][INFO ][sys-#4532%util.GridInternalTaskUnusedWalSegmentsTest0%][GridCacheProcessor] Finish proxy initialization, cacheName=ignite-sys-cache, localNodeId=e5c7f7dd-47b7-4ab6-9149-6791d3600000 [21:03:15] : [Step 4/5] [2021-11-19 21:03:15,975][INFO ][sys-#4653%util.GridInternalTaskUnusedWalSegmentsTest1%][GridCacheProcessor] Finish proxy initialization, cacheName=ignite-sys-cache, localNodeId=a6e2d1b8-e889-42a6-b138-d6edb8d00001 [21:03:15] : [Step 4/5] [2021-11-19 21:03:15,987][INFO ][sys-#4532%util.GridInternalTaskUnusedWalSegmentsTest0%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=e5c7f7dd-47b7-4ab6-9149-6791d3600000, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=e5c7f7dd-47b7-4ab6-9149-6791d3600000, consistentId=87f16126-5f72-4dfe-a561-76ce966f5d95, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637344995952, loc=true, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=4, minorTopVer=1]] [21:03:15] : [Step 4/5] [2021-11-19 21:03:15,975][INFO ][sys-#4896%util.GridInternalTaskUnusedWalSegmentsTest3%][GridCacheProcessor] Finish proxy initialization, cacheName=default, localNodeId=80d945d2-7ddb-4d94-a653-44c315400003 [21:03:15] : [Step 4/5] [2021-11-19 21:03:15,966][INFO ][disco-notifier-worker-#4538%util.GridInternalTaskUnusedWalSegmentsTest0%][GridClusterStateProcessor] Cluster state was changed from INACTIVE to ACTIVE [21:03:15] : [Step 4/5] [2021-11-19 21:03:15,991][INFO ][sys-#4896%util.GridInternalTaskUnusedWalSegmentsTest3%][GridCacheProcessor] Finish proxy initialization, cacheName=ignite-sys-cache, localNodeId=80d945d2-7ddb-4d94-a653-44c315400003 [21:03:15] : [Step 4/5] [2021-11-19 21:03:15,990][INFO ][sys-#4532%util.GridInternalTaskUnusedWalSegmentsTest0%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (1 ms), stage="Update caches registry" (41 ms), stage="Start caches" (4 ms), stage="Affinity initialization on cache group start" (1 ms), stage="Determine exchange type" (14 ms), stage="Preloading notification" (1 ms), stage="Wait partitions release [latch=exchange]" (1 ms), stage="Restore partition states" (0 ms), stage="After states restored callback" (30 ms), stage="WAL history reservation" (0 ms), stage="Waiting for all single messages" (35 ms), stage="Affinity recalculation (crd)" (0 ms), stage="Collect update counters and create affinity messages" (0 ms), stage="Assign partitions states" (0 ms), stage="Validate partitions states" (0 ms), stage="Ideal affinity diff calculation (enforced)" (0 ms), stage="Apply update counters" (0 ms), stage="Full message preparing" (6 ms), stage="Full message sending" (0 ms), stage="State finish message sending" (0 ms), stage="Detect lost partitions" (11 ms), stage="Exchange done" (31 ms), stage="Total time" (176 ms), Discovery lag=9 ms, Latest started node id=d2cfc867-15f3-4259-8cff-46a016a00002] [21:03:15] : [Step 4/5] [2021-11-19 21:03:15,990][INFO ][sys-#4653%util.GridInternalTaskUnusedWalSegmentsTest1%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=a6e2d1b8-e889-42a6-b138-d6edb8d00001, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=e5c7f7dd-47b7-4ab6-9149-6791d3600000, consistentId=87f16126-5f72-4dfe-a561-76ce966f5d95, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637344990199, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=4, minorTopVer=1]] [21:03:15] : [Step 4/5] [2021-11-19 21:03:15,990][INFO ][exchange-worker-#4667%util.GridInternalTaskUnusedWalSegmentsTest1%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=4, minorTopVer=1], force=false, evt=DISCOVERY_CUSTOM_EVT, node=e5c7f7dd-47b7-4ab6-9149-6791d3600000] [21:03:15] : [Step 4/5] [2021-11-19 21:03:15,990][INFO ][db-checkpoint-thread-#4937%util.GridInternalTaskUnusedWalSegmentsTest2%][Checkpointer] Checkpoint finished [cpId=43a3a281-2c0b-4b49-8f4b-47f4335dc870, pages=28, markPos=WALPointer [idx=0, fileOff=132034, len=2045], walSegmentsCovered=[], markDuration=28ms, pagesWrite=21ms, fsync=34ms, total=98ms] [21:03:15] : [Step 4/5] [2021-11-19 21:03:15,989][INFO ][sys-#4645%util.GridInternalTaskUnusedWalSegmentsTest1%][DistributedBaselineConfiguration] Baseline auto-adjust is 'disabled' with timeout='300000' ms [21:03:15] : [Step 4/5] [2021-11-19 21:03:15,988][INFO ][exchange-worker-#4543%util.GridInternalTaskUnusedWalSegmentsTest0%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=4, minorTopVer=1], force=false, evt=DISCOVERY_CUSTOM_EVT, node=e5c7f7dd-47b7-4ab6-9149-6791d3600000] [21:03:15] : [Step 4/5] [2021-11-19 21:03:15,987][INFO ][sys-#4531%util.GridInternalTaskUnusedWalSegmentsTest0%][DistributedBaselineConfiguration] Baseline auto-adjust is 'disabled' with timeout='300000' ms [21:03:15] : [Step 4/5] [2021-11-19 21:03:15,986][INFO ][sys-#4779%util.GridInternalTaskUnusedWalSegmentsTest2%][GridCacheProcessor] Finish proxy initialization, cacheName=ignite-sys-cache, localNodeId=d2cfc867-15f3-4259-8cff-46a016a00002 [21:03:16] : [Step 4/5] [2021-11-19 21:03:15,998][INFO ][sys-#4531%util.GridInternalTaskUnusedWalSegmentsTest0%][GridClusterStateProcessor] Successfully performed final activation steps [nodeId=e5c7f7dd-47b7-4ab6-9149-6791d3600000, client=false, topVer=AffinityTopologyVersion [topVer=4, minorTopVer=1]] [21:03:16] : [Step 4/5] [2021-11-19 21:03:15,997][INFO ][sys-#4645%util.GridInternalTaskUnusedWalSegmentsTest1%][GridClusterStateProcessor] Successfully performed final activation steps [nodeId=a6e2d1b8-e889-42a6-b138-d6edb8d00001, client=false, topVer=AffinityTopologyVersion [topVer=4, minorTopVer=1]] [21:03:16] : [Step 4/5] [2021-11-19 21:03:16,001][INFO ][sys-#4779%util.GridInternalTaskUnusedWalSegmentsTest2%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=d2cfc867-15f3-4259-8cff-46a016a00002, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=e5c7f7dd-47b7-4ab6-9149-6791d3600000, consistentId=87f16126-5f72-4dfe-a561-76ce966f5d95, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637344992469, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=4, minorTopVer=1]] [21:03:16] : [Step 4/5] [2021-11-19 21:03:15,996][INFO ][sys-#4653%util.GridInternalTaskUnusedWalSegmentsTest1%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (1 ms), stage="Update caches registry" (43 ms), stage="Start caches" (13 ms), stage="Affinity initialization on cache group start" (3 ms), stage="Determine exchange type" (1 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (2 ms), stage="Restore partition states" (0 ms), stage="After states restored callback" (39 ms), stage="WAL history reservation" (0 ms), stage="Waiting for Full message" (34 ms), stage="Affinity recalculation" (11 ms), stage="Full map updating" (5 ms), stage="Detect lost partitions" (7 ms), stage="Exchange done" (23 ms), stage="Total time" (182 ms)] [21:03:16] : [Step 4/5] [2021-11-19 21:03:15,994][INFO ][sys-#4532%util.GridInternalTaskUnusedWalSegmentsTest0%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], stage="Affinity initialization on cache group start [grp=ignite-sys-cache]" (1 ms) (parent=Affinity initialization on cache group start), stage="Affinity initialization on cache group start [grp=default]" (1 ms) (parent=Affinity initialization on cache group start), stage="Affinity centralized initialization (crd) [grp=default, crd=true]" (13 ms) (parent=Determine exchange type), stage="Affinity centralized initialization (crd) [grp=ignite-sys-cache, crd=true]" (0 ms) (parent=Determine exchange type), stage="Restore partition states [grp=ignite-sys-cache]" (0 ms) (parent=Restore partition states), stage="Restore partition states [grp=default]" (0 ms) (parent=Restore partition states), stage="Affinity recalculation (partitions availability) [grp=ignite-sys-cache]" (0 ms) (parent=Ideal affinity diff calculation (enforced)), stage="Affinity recalculation (partitions availability) [grp=default]" (0 ms) (parent=Ideal affinity diff calculation (enforced))] [21:03:16] : [Step 4/5] [2021-11-19 21:03:15,993][INFO ][sys-#4896%util.GridInternalTaskUnusedWalSegmentsTest3%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=80d945d2-7ddb-4d94-a653-44c315400003, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=e5c7f7dd-47b7-4ab6-9149-6791d3600000, consistentId=87f16126-5f72-4dfe-a561-76ce966f5d95, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637344995737, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=4, minorTopVer=1]] [21:03:16] : [Step 4/5] [2021-11-19 21:03:15,993][INFO ][exchange-worker-#4915%util.GridInternalTaskUnusedWalSegmentsTest3%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=4, minorTopVer=1], force=false, evt=DISCOVERY_CUSTOM_EVT, node=e5c7f7dd-47b7-4ab6-9149-6791d3600000] [21:03:16] : [Step 4/5] [2021-11-19 21:03:15,993][INFO ][sys-#4905%util.GridInternalTaskUnusedWalSegmentsTest3%][DistributedBaselineConfiguration] Baseline auto-adjust is 'disabled' with timeout='300000' ms [21:03:16] : [Step 4/5] [2021-11-19 21:03:16,008][INFO ][sys-#4896%util.GridInternalTaskUnusedWalSegmentsTest3%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], stage="Waiting in exchange queue" (3 ms), stage="Exchange parameters initialization" (1 ms), stage="Update caches registry" (55 ms), stage="Start caches" (1 ms), stage="Affinity initialization on cache group start" (0 ms), stage="Determine exchange type" (1 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (8 ms), stage="Restore partition states" (0 ms), stage="After states restored callback" (27 ms), stage="WAL history reservation" (0 ms), stage="Waiting for Full message" (36 ms), stage="Affinity recalculation" (8 ms), stage="Full map updating" (4 ms), stage="Detect lost partitions" (11 ms), stage="Exchange done" (33 ms), stage="Total time" (188 ms)] [21:03:16] : [Step 4/5] [2021-11-19 21:03:16,005][INFO ][sys-#4653%util.GridInternalTaskUnusedWalSegmentsTest1%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], stage="Affinity initialization on cache group start [grp=ignite-sys-cache]" (3 ms) (parent=Affinity initialization on cache group start), stage="Affinity initialization on cache group start [grp=default]" (3 ms) (parent=Affinity initialization on cache group start), stage="Affinity centralized initialization (crd) [grp=ignite-sys-cache, crd=false]" (1 ms) (parent=Determine exchange type), stage="Affinity centralized initialization (crd) [grp=default, crd=false]" (1 ms) (parent=Determine exchange type), stage="Restore partition states [grp=ignite-sys-cache]" (0 ms) (parent=Restore partition states), stage="Restore partition states [grp=default]" (0 ms) (parent=Restore partition states), stage="Affinity applying from full message [grp=default]" (9 ms) (parent=Affinity recalculation), stage="Affinity applying from full message [grp=ignite-sys-cache]" (1 ms) (parent=Affinity recalculation)] [21:03:16] : [Step 4/5] [2021-11-19 21:03:16,003][INFO ][sys-#4779%util.GridInternalTaskUnusedWalSegmentsTest2%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], stage="Waiting in exchange queue" (1 ms), stage="Exchange parameters initialization" (6 ms), stage="Update caches registry" (48 ms), stage="Start caches" (1 ms), stage="Affinity initialization on cache group start" (2 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (2 ms), stage="Restore partition states" (0 ms), stage="After states restored callback" (31 ms), stage="WAL history reservation" (0 ms), stage="Waiting for Full message" (42 ms), stage="Affinity recalculation" (5 ms), stage="Full map updating" (1 ms), stage="Detect lost partitions" (24 ms), stage="Exchange done" (19 ms), stage="Total time" (182 ms)] [21:03:16] : [Step 4/5] [2021-11-19 21:03:16,001][INFO ][exchange-worker-#4791%util.GridInternalTaskUnusedWalSegmentsTest2%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=4, minorTopVer=1], force=false, evt=DISCOVERY_CUSTOM_EVT, node=e5c7f7dd-47b7-4ab6-9149-6791d3600000] [21:03:16] : [Step 4/5] [2021-11-19 21:03:16,000][INFO ][sys-#4765%util.GridInternalTaskUnusedWalSegmentsTest2%][DistributedBaselineConfiguration] Baseline auto-adjust is 'disabled' with timeout='300000' ms [21:03:16] : [Step 4/5] [2021-11-19 21:03:16,018][INFO ][sys-#4779%util.GridInternalTaskUnusedWalSegmentsTest2%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], stage="Affinity initialization on cache group start [grp=ignite-sys-cache]" (2 ms) (parent=Affinity initialization on cache group start), stage="Affinity initialization on cache group start [grp=default]" (1 ms) (parent=Affinity initialization on cache group start), stage="Affinity centralized initialization (crd) [grp=ignite-sys-cache, crd=false]" (0 ms) (parent=Determine exchange type), stage="Affinity centralized initialization (crd) [grp=default, crd=false]" (0 ms) (parent=Determine exchange type), stage="Restore partition states [grp=ignite-sys-cache]" (0 ms) (parent=Restore partition states), stage="Restore partition states [grp=default]" (0 ms) (parent=Restore partition states), stage="Affinity applying from full message [grp=ignite-sys-cache]" (5 ms) (parent=Affinity recalculation), stage="Affinity applying from full message [grp=default]" (5 ms) (parent=Affinity recalculation)] [21:03:16] : [Step 4/5] [2021-11-19 21:03:16,014][INFO ][sys-#4896%util.GridInternalTaskUnusedWalSegmentsTest3%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], stage="Affinity initialization on cache group start [grp=ignite-sys-cache]" (0 ms) (parent=Affinity initialization on cache group start), stage="Affinity initialization on cache group start [grp=default]" (0 ms) (parent=Affinity initialization on cache group start), stage="Affinity centralized initialization (crd) [grp=ignite-sys-cache, crd=false]" (1 ms) (parent=Determine exchange type), stage="Affinity centralized initialization (crd) [grp=default, crd=false]" (1 ms) (parent=Determine exchange type), stage="Restore partition states [grp=ignite-sys-cache]" (0 ms) (parent=Restore partition states), stage="Restore partition states [grp=default]" (0 ms) (parent=Restore partition states), stage="Affinity applying from full message [grp=ignite-sys-cache]" (8 ms) (parent=Affinity recalculation), stage="Affinity applying from full message [grp=default]" (7 ms) (parent=Affinity recalculation)] [21:03:16] : [Step 4/5] [2021-11-19 21:03:16,009][INFO ][sys-#4905%util.GridInternalTaskUnusedWalSegmentsTest3%][GridClusterStateProcessor] Successfully performed final activation steps [nodeId=80d945d2-7ddb-4d94-a653-44c315400003, client=false, topVer=AffinityTopologyVersion [topVer=4, minorTopVer=1]] [21:03:16] : [Step 4/5] [2021-11-19 21:03:16,019][INFO ][sys-#4765%util.GridInternalTaskUnusedWalSegmentsTest2%][GridClusterStateProcessor] Successfully performed final activation steps [nodeId=d2cfc867-15f3-4259-8cff-46a016a00002, client=false, topVer=AffinityTopologyVersion [topVer=4, minorTopVer=1]] [21:03:16] : [Step 4/5] [2021-11-19 21:03:16,024][INFO ][db-checkpoint-thread-#4941%util.GridInternalTaskUnusedWalSegmentsTest1%][Checkpointer] Checkpoint finished [cpId=e6445b1c-a8df-40d5-99c0-96bca5faf80b, pages=28, markPos=WALPointer [idx=0, fileOff=132414, len=2140], walSegmentsCovered=[], markDuration=75ms, pagesWrite=4ms, fsync=35ms, total=127ms] [21:03:16] : [Step 4/5] [2021-11-19 21:03:16,025][INFO ][db-checkpoint-thread-#4942%util.GridInternalTaskUnusedWalSegmentsTest3%][Checkpointer] Checkpoint finished [cpId=d5f15c9c-3ce2-499b-9397-b7a06388426a, pages=28, markPos=WALPointer [idx=0, fileOff=132414, len=2140], walSegmentsCovered=[], markDuration=74ms, pagesWrite=5ms, fsync=36ms, total=129ms] [21:03:16]W: [org.apache.ignite:ignite-core] [2021-11-19 21:03:16,051][WARN ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][DataStreamerImpl] Data streamer will not overwrite existing cache entries for better performance (to change, set allowOverwrite to true) [21:03:16] : [Step 4/5] [2021-11-19 21:03:16,184][INFO ][wal-file-archiver%util.GridInternalTaskUnusedWalSegmentsTest0-#4918%util.GridInternalTaskUnusedWalSegmentsTest0%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=0, segIdx=0, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/node00-87f16126-5f72-4dfe-a561-76ce966f5d95/0000000000000000.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/node00-87f16126-5f72-4dfe-a561-76ce966f5d95/0000000000000000.wal] [21:03:16] : [Step 4/5] [2021-11-19 21:03:16,189][INFO ][wal-file-archiver%util.GridInternalTaskUnusedWalSegmentsTest1-#4921%util.GridInternalTaskUnusedWalSegmentsTest1%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=0, segIdx=0, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/node01-e7427b46-5e04-4060-9e7a-4a56d318815a/0000000000000000.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/node01-e7427b46-5e04-4060-9e7a-4a56d318815a/0000000000000000.wal] [21:03:16] : [Step 4/5] [2021-11-19 21:03:16,209][INFO ][wal-file-archiver%util.GridInternalTaskUnusedWalSegmentsTest3-#4928%util.GridInternalTaskUnusedWalSegmentsTest3%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=0, segIdx=0, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/node03-c72c5b3e-7e34-4453-ac0f-88bc1481a377/0000000000000000.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/node03-c72c5b3e-7e34-4453-ac0f-88bc1481a377/0000000000000000.wal] [21:03:16] : [Step 4/5] [2021-11-19 21:03:16,210][INFO ][wal-file-archiver%util.GridInternalTaskUnusedWalSegmentsTest1-#4921%util.GridInternalTaskUnusedWalSegmentsTest1%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/node01-e7427b46-5e04-4060-9e7a-4a56d318815a/0000000000000000.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/node01-e7427b46-5e04-4060-9e7a-4a56d318815a/0000000000000000.wal] [21:03:16] : [Step 4/5] [2021-11-19 21:03:16,210][INFO ][wal-file-archiver%util.GridInternalTaskUnusedWalSegmentsTest0-#4918%util.GridInternalTaskUnusedWalSegmentsTest0%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/node00-87f16126-5f72-4dfe-a561-76ce966f5d95/0000000000000000.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/node00-87f16126-5f72-4dfe-a561-76ce966f5d95/0000000000000000.wal] [21:03:16] : [Step 4/5] [2021-11-19 21:03:16,211][INFO ][wal-file-archiver%util.GridInternalTaskUnusedWalSegmentsTest2-#4924%util.GridInternalTaskUnusedWalSegmentsTest2%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=0, segIdx=0, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/node02-ce69043b-23cc-44c7-b1cf-65562a5661fd/0000000000000000.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/node02-ce69043b-23cc-44c7-b1cf-65562a5661fd/0000000000000000.wal] [21:03:16] : [Step 4/5] [2021-11-19 21:03:16,227][INFO ][wal-file-archiver%util.GridInternalTaskUnusedWalSegmentsTest3-#4928%util.GridInternalTaskUnusedWalSegmentsTest3%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/node03-c72c5b3e-7e34-4453-ac0f-88bc1481a377/0000000000000000.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/node03-c72c5b3e-7e34-4453-ac0f-88bc1481a377/0000000000000000.wal] [21:03:16] : [Step 4/5] [2021-11-19 21:03:16,230][INFO ][wal-file-archiver%util.GridInternalTaskUnusedWalSegmentsTest2-#4924%util.GridInternalTaskUnusedWalSegmentsTest2%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/node02-ce69043b-23cc-44c7-b1cf-65562a5661fd/0000000000000000.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/node02-ce69043b-23cc-44c7-b1cf-65562a5661fd/0000000000000000.wal] [21:03:16] : [Step 4/5] [2021-11-19 21:03:16,252][INFO ][wal-file-archiver%util.GridInternalTaskUnusedWalSegmentsTest0-#4918%util.GridInternalTaskUnusedWalSegmentsTest0%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=1, segIdx=1, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/node00-87f16126-5f72-4dfe-a561-76ce966f5d95/0000000000000001.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/node00-87f16126-5f72-4dfe-a561-76ce966f5d95/0000000000000001.wal] [21:03:16] : [Step 4/5] [2021-11-19 21:03:16,253][INFO ][wal-file-archiver%util.GridInternalTaskUnusedWalSegmentsTest1-#4921%util.GridInternalTaskUnusedWalSegmentsTest1%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=1, segIdx=1, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/node01-e7427b46-5e04-4060-9e7a-4a56d318815a/0000000000000001.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/node01-e7427b46-5e04-4060-9e7a-4a56d318815a/0000000000000001.wal] [21:03:16] : [Step 4/5] [2021-11-19 21:03:16,268][INFO ][wal-file-archiver%util.GridInternalTaskUnusedWalSegmentsTest0-#4918%util.GridInternalTaskUnusedWalSegmentsTest0%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/node00-87f16126-5f72-4dfe-a561-76ce966f5d95/0000000000000001.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/node00-87f16126-5f72-4dfe-a561-76ce966f5d95/0000000000000001.wal] [21:03:16] : [Step 4/5] [2021-11-19 21:03:16,269][INFO ][wal-file-archiver%util.GridInternalTaskUnusedWalSegmentsTest1-#4921%util.GridInternalTaskUnusedWalSegmentsTest1%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/node01-e7427b46-5e04-4060-9e7a-4a56d318815a/0000000000000001.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/node01-e7427b46-5e04-4060-9e7a-4a56d318815a/0000000000000001.wal] [21:03:16] : [Step 4/5] [2021-11-19 21:03:16,294][INFO ][wal-file-archiver%util.GridInternalTaskUnusedWalSegmentsTest0-#4918%util.GridInternalTaskUnusedWalSegmentsTest0%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=2, segIdx=2, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/node00-87f16126-5f72-4dfe-a561-76ce966f5d95/0000000000000002.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/node00-87f16126-5f72-4dfe-a561-76ce966f5d95/0000000000000002.wal] [21:03:16] : [Step 4/5] [2021-11-19 21:03:16,294][INFO ][wal-file-archiver%util.GridInternalTaskUnusedWalSegmentsTest1-#4921%util.GridInternalTaskUnusedWalSegmentsTest1%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=2, segIdx=2, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/node01-e7427b46-5e04-4060-9e7a-4a56d318815a/0000000000000002.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/node01-e7427b46-5e04-4060-9e7a-4a56d318815a/0000000000000002.wal] [21:03:16] : [Step 4/5] [2021-11-19 21:03:16,312][INFO ][wal-file-archiver%util.GridInternalTaskUnusedWalSegmentsTest1-#4921%util.GridInternalTaskUnusedWalSegmentsTest1%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/node01-e7427b46-5e04-4060-9e7a-4a56d318815a/0000000000000002.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/node01-e7427b46-5e04-4060-9e7a-4a56d318815a/0000000000000002.wal] [21:03:16] : [Step 4/5] [2021-11-19 21:03:16,312][INFO ][wal-file-archiver%util.GridInternalTaskUnusedWalSegmentsTest0-#4918%util.GridInternalTaskUnusedWalSegmentsTest0%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/node00-87f16126-5f72-4dfe-a561-76ce966f5d95/0000000000000002.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/node00-87f16126-5f72-4dfe-a561-76ce966f5d95/0000000000000002.wal] [21:03:16] : [Step 4/5] [2021-11-19 21:03:16,352][INFO ][wal-file-archiver%util.GridInternalTaskUnusedWalSegmentsTest1-#4921%util.GridInternalTaskUnusedWalSegmentsTest1%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=3, segIdx=3, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/node01-e7427b46-5e04-4060-9e7a-4a56d318815a/0000000000000003.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/node01-e7427b46-5e04-4060-9e7a-4a56d318815a/0000000000000003.wal] [21:03:16] : [Step 4/5] [2021-11-19 21:03:16,316][INFO ][wal-file-archiver%util.GridInternalTaskUnusedWalSegmentsTest2-#4924%util.GridInternalTaskUnusedWalSegmentsTest2%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=1, segIdx=1, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/node02-ce69043b-23cc-44c7-b1cf-65562a5661fd/0000000000000001.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/node02-ce69043b-23cc-44c7-b1cf-65562a5661fd/0000000000000001.wal] [21:03:16] : [Step 4/5] [2021-11-19 21:03:16,353][INFO ][wal-file-archiver%util.GridInternalTaskUnusedWalSegmentsTest3-#4928%util.GridInternalTaskUnusedWalSegmentsTest3%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=1, segIdx=1, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/node03-c72c5b3e-7e34-4453-ac0f-88bc1481a377/0000000000000001.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/node03-c72c5b3e-7e34-4453-ac0f-88bc1481a377/0000000000000001.wal] [21:03:16] : [Step 4/5] [2021-11-19 21:03:16,372][INFO ][wal-file-archiver%util.GridInternalTaskUnusedWalSegmentsTest2-#4924%util.GridInternalTaskUnusedWalSegmentsTest2%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/node02-ce69043b-23cc-44c7-b1cf-65562a5661fd/0000000000000001.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/node02-ce69043b-23cc-44c7-b1cf-65562a5661fd/0000000000000001.wal] [21:03:16] : [Step 4/5] [2021-11-19 21:03:16,372][INFO ][wal-file-archiver%util.GridInternalTaskUnusedWalSegmentsTest1-#4921%util.GridInternalTaskUnusedWalSegmentsTest1%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/node01-e7427b46-5e04-4060-9e7a-4a56d318815a/0000000000000003.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/node01-e7427b46-5e04-4060-9e7a-4a56d318815a/0000000000000003.wal] [21:03:16] : [Step 4/5] [2021-11-19 21:03:16,384][INFO ][wal-file-archiver%util.GridInternalTaskUnusedWalSegmentsTest3-#4928%util.GridInternalTaskUnusedWalSegmentsTest3%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/node03-c72c5b3e-7e34-4453-ac0f-88bc1481a377/0000000000000001.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/node03-c72c5b3e-7e34-4453-ac0f-88bc1481a377/0000000000000001.wal] [21:03:16] : [Step 4/5] [2021-11-19 21:03:16,380][INFO ][wal-file-archiver%util.GridInternalTaskUnusedWalSegmentsTest0-#4918%util.GridInternalTaskUnusedWalSegmentsTest0%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=3, segIdx=3, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/node00-87f16126-5f72-4dfe-a561-76ce966f5d95/0000000000000003.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/node00-87f16126-5f72-4dfe-a561-76ce966f5d95/0000000000000003.wal] [21:03:16] : [Step 4/5] [2021-11-19 21:03:16,401][INFO ][wal-file-archiver%util.GridInternalTaskUnusedWalSegmentsTest0-#4918%util.GridInternalTaskUnusedWalSegmentsTest0%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/node00-87f16126-5f72-4dfe-a561-76ce966f5d95/0000000000000003.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/node00-87f16126-5f72-4dfe-a561-76ce966f5d95/0000000000000003.wal] [21:03:16] : [Step 4/5] [2021-11-19 21:03:16,405][INFO ][wal-file-archiver%util.GridInternalTaskUnusedWalSegmentsTest3-#4928%util.GridInternalTaskUnusedWalSegmentsTest3%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=2, segIdx=2, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/node03-c72c5b3e-7e34-4453-ac0f-88bc1481a377/0000000000000002.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/node03-c72c5b3e-7e34-4453-ac0f-88bc1481a377/0000000000000002.wal] [21:03:16] : [Step 4/5] [2021-11-19 21:03:16,429][INFO ][wal-file-archiver%util.GridInternalTaskUnusedWalSegmentsTest3-#4928%util.GridInternalTaskUnusedWalSegmentsTest3%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/node03-c72c5b3e-7e34-4453-ac0f-88bc1481a377/0000000000000002.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/node03-c72c5b3e-7e34-4453-ac0f-88bc1481a377/0000000000000002.wal] [21:03:16] : [Step 4/5] [2021-11-19 21:03:16,432][INFO ][wal-file-archiver%util.GridInternalTaskUnusedWalSegmentsTest3-#4928%util.GridInternalTaskUnusedWalSegmentsTest3%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=3, segIdx=3, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/node03-c72c5b3e-7e34-4453-ac0f-88bc1481a377/0000000000000003.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/node03-c72c5b3e-7e34-4453-ac0f-88bc1481a377/0000000000000003.wal] [21:03:16] : [Step 4/5] [2021-11-19 21:03:16,449][INFO ][wal-file-archiver%util.GridInternalTaskUnusedWalSegmentsTest1-#4921%util.GridInternalTaskUnusedWalSegmentsTest1%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=4, segIdx=4, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/node01-e7427b46-5e04-4060-9e7a-4a56d318815a/0000000000000004.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/node01-e7427b46-5e04-4060-9e7a-4a56d318815a/0000000000000004.wal] [21:03:16] : [Step 4/5] [2021-11-19 21:03:16,459][INFO ][wal-file-archiver%util.GridInternalTaskUnusedWalSegmentsTest1-#4921%util.GridInternalTaskUnusedWalSegmentsTest1%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/node01-e7427b46-5e04-4060-9e7a-4a56d318815a/0000000000000004.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/node01-e7427b46-5e04-4060-9e7a-4a56d318815a/0000000000000004.wal] [21:03:16] : [Step 4/5] [2021-11-19 21:03:16,432][INFO ][wal-file-archiver%util.GridInternalTaskUnusedWalSegmentsTest0-#4918%util.GridInternalTaskUnusedWalSegmentsTest0%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=4, segIdx=4, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/node00-87f16126-5f72-4dfe-a561-76ce966f5d95/0000000000000004.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/node00-87f16126-5f72-4dfe-a561-76ce966f5d95/0000000000000004.wal] [21:03:16] : [Step 4/5] [2021-11-19 21:03:16,484][INFO ][wal-file-archiver%util.GridInternalTaskUnusedWalSegmentsTest3-#4928%util.GridInternalTaskUnusedWalSegmentsTest3%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/node03-c72c5b3e-7e34-4453-ac0f-88bc1481a377/0000000000000003.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/node03-c72c5b3e-7e34-4453-ac0f-88bc1481a377/0000000000000003.wal] [21:03:16] : [Step 4/5] [2021-11-19 21:03:16,493][INFO ][wal-file-archiver%util.GridInternalTaskUnusedWalSegmentsTest3-#4928%util.GridInternalTaskUnusedWalSegmentsTest3%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=4, segIdx=4, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/node03-c72c5b3e-7e34-4453-ac0f-88bc1481a377/0000000000000004.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/node03-c72c5b3e-7e34-4453-ac0f-88bc1481a377/0000000000000004.wal] [21:03:16] : [Step 4/5] [2021-11-19 21:03:16,497][INFO ][wal-file-archiver%util.GridInternalTaskUnusedWalSegmentsTest0-#4918%util.GridInternalTaskUnusedWalSegmentsTest0%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/node00-87f16126-5f72-4dfe-a561-76ce966f5d95/0000000000000004.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/node00-87f16126-5f72-4dfe-a561-76ce966f5d95/0000000000000004.wal] [21:03:16] : [Step 4/5] [2021-11-19 21:03:16,498][INFO ][wal-file-archiver%util.GridInternalTaskUnusedWalSegmentsTest0-#4918%util.GridInternalTaskUnusedWalSegmentsTest0%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=5, segIdx=5, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/node00-87f16126-5f72-4dfe-a561-76ce966f5d95/0000000000000005.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/node00-87f16126-5f72-4dfe-a561-76ce966f5d95/0000000000000005.wal] [21:03:16] : [Step 4/5] [2021-11-19 21:03:16,526][INFO ][wal-file-archiver%util.GridInternalTaskUnusedWalSegmentsTest1-#4921%util.GridInternalTaskUnusedWalSegmentsTest1%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=5, segIdx=5, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/node01-e7427b46-5e04-4060-9e7a-4a56d318815a/0000000000000005.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/node01-e7427b46-5e04-4060-9e7a-4a56d318815a/0000000000000005.wal] [21:03:16] : [Step 4/5] [2021-11-19 21:03:16,527][INFO ][wal-file-archiver%util.GridInternalTaskUnusedWalSegmentsTest0-#4918%util.GridInternalTaskUnusedWalSegmentsTest0%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/node00-87f16126-5f72-4dfe-a561-76ce966f5d95/0000000000000005.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/node00-87f16126-5f72-4dfe-a561-76ce966f5d95/0000000000000005.wal] [21:03:16] : [Step 4/5] [2021-11-19 21:03:16,527][INFO ][wal-file-archiver%util.GridInternalTaskUnusedWalSegmentsTest3-#4928%util.GridInternalTaskUnusedWalSegmentsTest3%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/node03-c72c5b3e-7e34-4453-ac0f-88bc1481a377/0000000000000004.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/node03-c72c5b3e-7e34-4453-ac0f-88bc1481a377/0000000000000004.wal] [21:03:16] : [Step 4/5] [2021-11-19 21:03:16,529][INFO ][wal-file-archiver%util.GridInternalTaskUnusedWalSegmentsTest3-#4928%util.GridInternalTaskUnusedWalSegmentsTest3%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=5, segIdx=5, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/node03-c72c5b3e-7e34-4453-ac0f-88bc1481a377/0000000000000005.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/node03-c72c5b3e-7e34-4453-ac0f-88bc1481a377/0000000000000005.wal] [21:03:16] : [Step 4/5] [2021-11-19 21:03:16,540][INFO ][wal-file-archiver%util.GridInternalTaskUnusedWalSegmentsTest1-#4921%util.GridInternalTaskUnusedWalSegmentsTest1%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/node01-e7427b46-5e04-4060-9e7a-4a56d318815a/0000000000000005.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/node01-e7427b46-5e04-4060-9e7a-4a56d318815a/0000000000000005.wal] [21:03:16] : [Step 4/5] [2021-11-19 21:03:16,541][INFO ][wal-file-archiver%util.GridInternalTaskUnusedWalSegmentsTest3-#4928%util.GridInternalTaskUnusedWalSegmentsTest3%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/node03-c72c5b3e-7e34-4453-ac0f-88bc1481a377/0000000000000005.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/node03-c72c5b3e-7e34-4453-ac0f-88bc1481a377/0000000000000005.wal] [21:03:16] : [Step 4/5] [2021-11-19 21:03:16,552][INFO ][wal-file-archiver%util.GridInternalTaskUnusedWalSegmentsTest0-#4918%util.GridInternalTaskUnusedWalSegmentsTest0%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=6, segIdx=6, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/node00-87f16126-5f72-4dfe-a561-76ce966f5d95/0000000000000006.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/node00-87f16126-5f72-4dfe-a561-76ce966f5d95/0000000000000006.wal] [21:03:16] : [Step 4/5] [2021-11-19 21:03:16,561][INFO ][wal-file-archiver%util.GridInternalTaskUnusedWalSegmentsTest0-#4918%util.GridInternalTaskUnusedWalSegmentsTest0%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/node00-87f16126-5f72-4dfe-a561-76ce966f5d95/0000000000000006.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/node00-87f16126-5f72-4dfe-a561-76ce966f5d95/0000000000000006.wal] [21:03:16] : [Step 4/5] [2021-11-19 21:03:16,574][INFO ][db-checkpoint-thread-#4942%util.GridInternalTaskUnusedWalSegmentsTest3%][Checkpointer] Checkpoint started [checkpointId=c6950702-37ff-4f34-82c5-9b48f12ad936, startPtr=WALPointer [idx=6, fileOff=436426, len=2124], checkpointBeforeLockTime=3ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=2ms, walCpRecordFsyncDuration=4ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=2ms, pages=1023, reason='test'] [21:03:16] : [Step 4/5] [2021-11-19 21:03:16,694][INFO ][db-checkpoint-thread-#4942%util.GridInternalTaskUnusedWalSegmentsTest3%][Checkpointer] Checkpoint finished [cpId=c6950702-37ff-4f34-82c5-9b48f12ad936, pages=1023, markPos=WALPointer [idx=6, fileOff=436426, len=2124], walSegmentsCovered=[0 - 5], markDuration=10ms, pagesWrite=24ms, fsync=94ms, total=131ms] [21:03:16] : [Step 4/5] [2021-11-19 21:03:16,707][INFO ][db-checkpoint-thread-#4937%util.GridInternalTaskUnusedWalSegmentsTest2%][Checkpointer] Checkpoint started [checkpointId=36b15808-4162-4fa4-a2f5-ecb8e6e6da79, startPtr=WALPointer [idx=2, fileOff=971703, len=2029], checkpointBeforeLockTime=2ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=2ms, walCpRecordFsyncDuration=7ms, writeCheckpointEntryDuration=2ms, splitAndSortCpPagesDuration=1ms, pages=458, reason='test'] [21:03:16] : [Step 4/5] [2021-11-19 21:03:16,761][INFO ][db-checkpoint-thread-#4937%util.GridInternalTaskUnusedWalSegmentsTest2%][Checkpointer] Checkpoint finished [cpId=36b15808-4162-4fa4-a2f5-ecb8e6e6da79, pages=458, markPos=WALPointer [idx=2, fileOff=971703, len=2029], walSegmentsCovered=[0 - 1], markDuration=13ms, pagesWrite=10ms, fsync=42ms, total=67ms] [21:03:16] : [Step 4/5] [2021-11-19 21:03:16,773][INFO ][db-checkpoint-thread-#4941%util.GridInternalTaskUnusedWalSegmentsTest1%][Checkpointer] Checkpoint started [checkpointId=c344bf93-abb8-46ac-8c42-2055e641c522, startPtr=WALPointer [idx=6, fileOff=441369, len=2124], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=1ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=7ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=2ms, pages=1027, reason='test'] [21:03:16] : [Step 4/5] [2021-11-19 21:03:16,892][INFO ][db-checkpoint-thread-#4941%util.GridInternalTaskUnusedWalSegmentsTest1%][Checkpointer] Checkpoint finished [cpId=c344bf93-abb8-46ac-8c42-2055e641c522, pages=1027, markPos=WALPointer [idx=6, fileOff=441369, len=2124], walSegmentsCovered=[0 - 5], markDuration=12ms, pagesWrite=26ms, fsync=92ms, total=131ms] [21:03:16] : [Step 4/5] [2021-11-19 21:03:16,903][INFO ][db-checkpoint-thread-#4934%util.GridInternalTaskUnusedWalSegmentsTest0%][Checkpointer] Checkpoint started [checkpointId=e1a33635-9ec9-431d-b637-164fe51040a3, startPtr=WALPointer [idx=7, fileOff=126485, len=2143], checkpointBeforeLockTime=2ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=1ms, checkpointLockHoldTime=2ms, walCpRecordFsyncDuration=4ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=2ms, pages=1140, reason='test'] [21:03:17] : [Step 4/5] [2021-11-19 21:03:17,038][INFO ][db-checkpoint-thread-#4934%util.GridInternalTaskUnusedWalSegmentsTest0%][Checkpointer] Checkpoint finished [cpId=e1a33635-9ec9-431d-b637-164fe51040a3, pages=1140, markPos=WALPointer [idx=7, fileOff=126485, len=2143], walSegmentsCovered=[0 - 6], markDuration=10ms, pagesWrite=32ms, fsync=102ms, total=146ms] [21:03:17] : [Step 4/5] [2021-11-19 21:03:17,065][INFO ][db-checkpoint-thread-#4942%util.GridInternalTaskUnusedWalSegmentsTest3%][Checkpointer] Skipping checkpoint (no pages were modified) [checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=1ms, checkpointLockHoldTime=1ms, reason='test'] [21:03:17] : [Step 4/5] [2021-11-19 21:03:17,068][INFO ][db-checkpoint-thread-#4937%util.GridInternalTaskUnusedWalSegmentsTest2%][Checkpointer] Skipping checkpoint (no pages were modified) [checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=1ms, checkpointLockHoldTime=2ms, reason='test'] [21:03:17] : [Step 4/5] [2021-11-19 21:03:17,077][INFO ][db-checkpoint-thread-#4941%util.GridInternalTaskUnusedWalSegmentsTest1%][Checkpointer] Skipping checkpoint (no pages were modified) [checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=7ms, reason='test'] [21:03:17] : [Step 4/5] [2021-11-19 21:03:17,082][INFO ][db-checkpoint-thread-#4934%util.GridInternalTaskUnusedWalSegmentsTest0%][Checkpointer] Skipping checkpoint (no pages were modified) [checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=3ms, reason='test'] [21:03:17] : [Step 4/5] [2021-11-19 21:03:17,155][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][root] >>> Stopping grid [name=util.GridInternalTaskUnusedWalSegmentsTest3, id=80d945d2-7ddb-4d94-a653-44c315400003] [21:03:17] : [Step 4/5] [2021-11-19 21:03:17,162][INFO ][db-checkpoint-thread-#4942%util.GridInternalTaskUnusedWalSegmentsTest3%][Checkpointer] Skipping checkpoint (no pages were modified) [checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=1ms, checkpointLockHoldTime=1ms, reason='timeout'] [21:03:17] : [Step 4/5] [2021-11-19 21:03:17,170][INFO ][disco-event-worker-#4542%util.GridInternalTaskUnusedWalSegmentsTest0%][GridDiscoveryManager] Node left topology: TcpDiscoveryNode [id=80d945d2-7ddb-4d94-a653-44c315400003, consistentId=c72c5b3e-7e34-4453-ac0f-88bc1481a377, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47503], discPort=47503, order=4, intOrder=4, lastExchangeTime=1637344995707, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false] [21:03:17] : [Step 4/5] [2021-11-19 21:03:17,171][INFO ][tcp-disco-sock-reader-[d2cfc867 127.0.0.1:37925]-#243%util.GridInternalTaskUnusedWalSegmentsTest3%-#4911%util.GridInternalTaskUnusedWalSegmentsTest3%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:37925, rmtPort=37925, rmtNodeId=d2cfc867-15f3-4259-8cff-46a016a00002] [21:03:17] : [Step 4/5] [2021-11-19 21:03:17,171][INFO ][disco-event-worker-#4790%util.GridInternalTaskUnusedWalSegmentsTest2%][GridDiscoveryManager] Node left topology: TcpDiscoveryNode [id=80d945d2-7ddb-4d94-a653-44c315400003, consistentId=c72c5b3e-7e34-4453-ac0f-88bc1481a377, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47503], discPort=47503, order=4, intOrder=4, lastExchangeTime=1637344995727, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false] [21:03:17] : [Step 4/5] [2021-11-19 21:03:17,170][INFO ][tcp-disco-msg-worker-[80d945d2 127.0.0.1:47503]-#230%util.GridInternalTaskUnusedWalSegmentsTest2%-#4783%util.GridInternalTaskUnusedWalSegmentsTest2%][TestTcpDiscoverySpi] New next node [newNext=TcpDiscoveryNode [id=e5c7f7dd-47b7-4ab6-9149-6791d3600000, consistentId=87f16126-5f72-4dfe-a561-76ce966f5d95, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637344992469, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false]] [21:03:17] : [Step 4/5] [2021-11-19 21:03:17,170][INFO ][disco-event-worker-#4666%util.GridInternalTaskUnusedWalSegmentsTest1%][GridDiscoveryManager] Node left topology: TcpDiscoveryNode [id=80d945d2-7ddb-4d94-a653-44c315400003, consistentId=c72c5b3e-7e34-4453-ac0f-88bc1481a377, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47503], discPort=47503, order=4, intOrder=4, lastExchangeTime=1637344995727, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false] [21:03:17] : [Step 4/5] [2021-11-19 21:03:17,174][INFO ][tcp-disco-srvr-[:47500]-#217%util.GridInternalTaskUnusedWalSegmentsTest0%-#4540%util.GridInternalTaskUnusedWalSegmentsTest0%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=36151] [21:03:17] : [Step 4/5] [2021-11-19 21:03:17,173][INFO ][disco-event-worker-#4790%util.GridInternalTaskUnusedWalSegmentsTest2%][GridDiscoveryManager] Topology snapshot [ver=5, locNode=d2cfc867, servers=3, clients=0, state=ACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=e5c7f7dd-47b7-4ab6-9149-6791d3600000, consistentId=87f16126-5f72-4dfe-a561-76ce966f5d95, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=a6e2d1b8-e889-42a6-b138-d6edb8d00001, consistentId=e7427b46-5e04-4060-9e7a-4a56d318815a, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=d2cfc867-15f3-4259-8cff-46a016a00002, consistentId=ce69043b-23cc-44c7-b1cf-65562a5661fd, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:03:17] : [Step 4/5] [2021-11-19 21:03:17,173][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][GridCacheProcessor] Stopped cache [cacheName=default] [21:03:17] : [Step 4/5] [2021-11-19 21:03:17,172][INFO ][disco-event-worker-#4542%util.GridInternalTaskUnusedWalSegmentsTest0%][GridDiscoveryManager] Topology snapshot [ver=5, locNode=e5c7f7dd, servers=3, clients=0, state=ACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=e5c7f7dd-47b7-4ab6-9149-6791d3600000, consistentId=87f16126-5f72-4dfe-a561-76ce966f5d95, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=a6e2d1b8-e889-42a6-b138-d6edb8d00001, consistentId=e7427b46-5e04-4060-9e7a-4a56d318815a, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=d2cfc867-15f3-4259-8cff-46a016a00002, consistentId=ce69043b-23cc-44c7-b1cf-65562a5661fd, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:03:17] : [Step 4/5] [2021-11-19 21:03:17,178][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][GridCacheProcessor] Stopped cache [cacheName=ignite-sys-cache] [21:03:17] : [Step 4/5] [2021-11-19 21:03:17,177][INFO ][disco-event-worker-#4790%util.GridInternalTaskUnusedWalSegmentsTest2%][GridDiscoveryManager] ^-- Baseline [id=0, size=4, online=3, offline=1] [21:03:17] : [Step 4/5] [2021-11-19 21:03:17,176][INFO ][tcp-disco-srvr-[:47500]-#217%util.GridInternalTaskUnusedWalSegmentsTest0%-#4540%util.GridInternalTaskUnusedWalSegmentsTest0%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=36151] [21:03:17] : [Step 4/5] [2021-11-19 21:03:17,175][INFO ][disco-event-worker-#4666%util.GridInternalTaskUnusedWalSegmentsTest1%][GridDiscoveryManager] Topology snapshot [ver=5, locNode=a6e2d1b8, servers=3, clients=0, state=ACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=e5c7f7dd-47b7-4ab6-9149-6791d3600000, consistentId=87f16126-5f72-4dfe-a561-76ce966f5d95, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=a6e2d1b8-e889-42a6-b138-d6edb8d00001, consistentId=e7427b46-5e04-4060-9e7a-4a56d318815a, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=d2cfc867-15f3-4259-8cff-46a016a00002, consistentId=ce69043b-23cc-44c7-b1cf-65562a5661fd, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:03:17] : [Step 4/5] [2021-11-19 21:03:17,181][INFO ][exchange-worker-#4791%util.GridInternalTaskUnusedWalSegmentsTest2%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], crd=false, evt=NODE_LEFT, evtNode=80d945d2-7ddb-4d94-a653-44c315400003, customEvt=null, allowMerge=false, exchangeFreeSwitch=true] [21:03:17] : [Step 4/5] [2021-11-19 21:03:17,181][INFO ][tcp-disco-sock-reader-[]-#246%util.GridInternalTaskUnusedWalSegmentsTest0%-#4983%util.GridInternalTaskUnusedWalSegmentsTest0%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:36151, rmtPort=36151] [21:03:17] : [Step 4/5] [2021-11-19 21:03:17,179][INFO ][disco-event-worker-#4542%util.GridInternalTaskUnusedWalSegmentsTest0%][GridDiscoveryManager] ^-- Baseline [id=0, size=4, online=3, offline=1] [21:03:17] : [Step 4/5] [2021-11-19 21:03:17,183][INFO ][exchange-worker-#4791%util.GridInternalTaskUnusedWalSegmentsTest2%][GridAffinityAssignmentCache] Local node affinity assignment distribution is not ideal [cache=default, expectedPrimary=10.67, actualPrimary=4, expectedBackups=0.00, actualBackups=0, warningThreshold=50.00%] [21:03:17] : [Step 4/5] [2021-11-19 21:03:17,182][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][FilePageStoreManager] Cleanup cache stores [total=4, left=0, cleanFiles=false] [21:03:17] : [Step 4/5] [2021-11-19 21:03:17,182][INFO ][disco-event-worker-#4666%util.GridInternalTaskUnusedWalSegmentsTest1%][GridDiscoveryManager] ^-- Baseline [id=0, size=4, online=3, offline=1] [21:03:17] : [Step 4/5] [2021-11-19 21:03:17,184][INFO ][exchange-worker-#4791%util.GridInternalTaskUnusedWalSegmentsTest2%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:03:17] : [Step 4/5] [2021-11-19 21:03:17,184][INFO ][tcp-disco-sock-reader-[d2cfc867 127.0.0.1:36151]-#246%util.GridInternalTaskUnusedWalSegmentsTest0%-#4983%util.GridInternalTaskUnusedWalSegmentsTest0%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=d2cfc867-15f3-4259-8cff-46a016a00002, rmtAddr=/127.0.0.1:36151] [21:03:17]W: [org.apache.ignite:ignite-core] [2021-11-19 21:03:17,183][WARN ][grid-nio-worker-tcp-comm-2-#4482%TcpCommunicationSpi%][TcpCommunicationSpi] Failed to shutdown socket [21:03:17]W: [org.apache.ignite:ignite-core] java.nio.channels.ClosedChannelException [21:03:17]W: [org.apache.ignite:ignite-core] at sun.nio.ch.SocketChannelImpl.shutdownOutput(SocketChannelImpl.java:795) [21:03:17]W: [org.apache.ignite:ignite-core] at sun.nio.ch.SocketAdaptor.shutdownOutput(SocketAdaptor.java:407) [21:03:17]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.close(IgniteUtils.java:4247) [21:03:17]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.closeKey(GridNioServer.java:2784) [21:03:17]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.close(GridNioServer.java:2835) [21:03:17]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.close(GridNioServer.java:2794) [21:03:17]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.bodyInternal(GridNioServer.java:2157) [21:03:17]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.body(GridNioServer.java:1910) [21:03:17]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:125) [21:03:17]W: [org.apache.ignite:ignite-core] at java.lang.Thread.run(Thread.java:748) [21:03:17] : [Step 4/5] [2021-11-19 21:03:17,188][INFO ][exchange-worker-#4791%util.GridInternalTaskUnusedWalSegmentsTest2%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], err=null, rebalanced=true, wasRebalanced=true] [21:03:17] : [Step 4/5] [2021-11-19 21:03:17,188][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][GridDeploymentLocalStore] Removed undeployed class: GridDeployment [ts=1637344995942, depMode=SHARED, clsLdr=IsolatedClassLoader{roleName='test'}, clsLdrId=9f01d593d71-80d945d2-7ddb-4d94-a653-44c315400003, userVer=0, loc=true, sampleClsName=org.apache.ignite.internal.processors.cache.distributed.dht.preloader.IgniteDhtPartitionCountersMap2, pendingUndeploy=false, undeployed=true, usage=0] [21:03:17] : [Step 4/5] [2021-11-19 21:03:17,188][INFO ][exchange-worker-#4667%util.GridInternalTaskUnusedWalSegmentsTest1%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], crd=false, evt=NODE_LEFT, evtNode=80d945d2-7ddb-4d94-a653-44c315400003, customEvt=null, allowMerge=false, exchangeFreeSwitch=true] [21:03:17]W: [org.apache.ignite:ignite-core] [2021-11-19 21:03:17,190][WARN ][sys-#4769%util.GridInternalTaskUnusedWalSegmentsTest2%][GridDhtPartitionTopologyImpl] Detected lost partitions [grp=default, parts=[0-1, 3, 16, 19, 23, 27-28, 30], topVer=AffinityTopologyVersion [topVer=5, minorTopVer=0]] [21:03:17] : [Step 4/5] [2021-11-19 21:03:17,185][INFO ][exchange-worker-#4543%util.GridInternalTaskUnusedWalSegmentsTest0%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], crd=true, evt=NODE_LEFT, evtNode=80d945d2-7ddb-4d94-a653-44c315400003, customEvt=null, allowMerge=false, exchangeFreeSwitch=true] [21:03:17] : [Step 4/5] [2021-11-19 21:03:17,192][INFO ][exchange-worker-#4667%util.GridInternalTaskUnusedWalSegmentsTest1%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:03:17] : [Step 4/5] [2021-11-19 21:03:17,195][INFO ][exchange-worker-#4543%util.GridInternalTaskUnusedWalSegmentsTest0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:03:17] : [Step 4/5] [2021-11-19 21:03:17,194][INFO ][exchange-worker-#4791%util.GridInternalTaskUnusedWalSegmentsTest2%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=d2cfc867-15f3-4259-8cff-46a016a00002, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], evt=NODE_LEFT, evtNode=TcpDiscoveryNode [id=80d945d2-7ddb-4d94-a653-44c315400003, consistentId=c72c5b3e-7e34-4453-ac0f-88bc1481a377, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47503], discPort=47503, order=4, intOrder=4, lastExchangeTime=1637344995727, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=5, minorTopVer=0]] [21:03:17] : [Step 4/5] [2021-11-19 21:03:17,197][INFO ][exchange-worker-#4543%util.GridInternalTaskUnusedWalSegmentsTest0%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], err=null, rebalanced=true, wasRebalanced=true] [21:03:17] : [Step 4/5] [2021-11-19 21:03:17,196][INFO ][exchange-worker-#4667%util.GridInternalTaskUnusedWalSegmentsTest1%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], err=null, rebalanced=true, wasRebalanced=true] [21:03:17] : [Step 4/5] [2021-11-19 21:03:17,200][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][GridInternalTaskUnusedWalSegmentsTest3] [21:03:17] : [Step 4/5] [21:03:17] : [Step 4/5] >>> +------------------------------------------------------+ [21:03:17] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV stopped OK [21:03:17] : [Step 4/5] >>> +------------------------------------------------------+ [21:03:17] : [Step 4/5] >>> Ignite instance name: util.GridInternalTaskUnusedWalSegmentsTest3 [21:03:17] : [Step 4/5] >>> Grid uptime: 00:00:01.410 [21:03:17] : [Step 4/5] [21:03:17] : [Step 4/5] [21:03:17] : [Step 4/5] [2021-11-19 21:03:17,199][INFO ][exchange-worker-#4791%util.GridInternalTaskUnusedWalSegmentsTest2%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (1 ms), stage="Determine exchange type" (1 ms), stage="Preloading notification" (0 ms), stage="After states restored callback" (3 ms), stage="WAL history reservation" (0 ms), stage="Finalize update counters" (0 ms), stage="Detect lost partitions" (4 ms), stage="Exchange done" (6 ms), stage="Total time" (15 ms)] [21:03:17] : [Step 4/5] [2021-11-19 21:03:17,201][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][root] >>> Stopping grid [name=util.GridInternalTaskUnusedWalSegmentsTest2, id=d2cfc867-15f3-4259-8cff-46a016a00002] [21:03:17] : [Step 4/5] [2021-11-19 21:03:17,202][INFO ][exchange-worker-#4791%util.GridInternalTaskUnusedWalSegmentsTest2%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], stage="Affinity initialization (exchange-free switch on fully-rebalanced topology) [grp=default]" (1 ms) (parent=Determine exchange type), stage="Affinity initialization (exchange-free switch on fully-rebalanced topology) [grp=ignite-sys-cache]" (0 ms) (parent=Determine exchange type)] [21:03:17]W: [org.apache.ignite:ignite-core] [2021-11-19 21:03:17,203][WARN ][sys-#4656%util.GridInternalTaskUnusedWalSegmentsTest1%][GridDhtPartitionTopologyImpl] Detected lost partitions [grp=default, parts=[0-1, 3, 16, 19, 23, 27-28, 30], topVer=AffinityTopologyVersion [topVer=5, minorTopVer=0]] [21:03:17]W: [org.apache.ignite:ignite-core] [2021-11-19 21:03:17,203][WARN ][exchange-worker-#4543%util.GridInternalTaskUnusedWalSegmentsTest0%][GridDhtPartitionTopologyImpl] Detected lost partitions [grp=default, parts=[0-1, 3, 16, 19, 23, 27-28, 30], topVer=AffinityTopologyVersion [topVer=5, minorTopVer=0]] [21:03:17] : [Step 4/5] [2021-11-19 21:03:17,204][INFO ][exchange-worker-#4667%util.GridInternalTaskUnusedWalSegmentsTest1%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=a6e2d1b8-e889-42a6-b138-d6edb8d00001, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], evt=NODE_LEFT, evtNode=TcpDiscoveryNode [id=80d945d2-7ddb-4d94-a653-44c315400003, consistentId=c72c5b3e-7e34-4453-ac0f-88bc1481a377, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47503], discPort=47503, order=4, intOrder=4, lastExchangeTime=1637344995727, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=5, minorTopVer=0]] [21:03:17] : [Step 4/5] [2021-11-19 21:03:17,203][INFO ][exchange-worker-#4791%util.GridInternalTaskUnusedWalSegmentsTest2%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], crd=false] [21:03:17] : [Step 4/5] [2021-11-19 21:03:17,206][INFO ][exchange-worker-#4667%util.GridInternalTaskUnusedWalSegmentsTest1%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (3 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="After states restored callback" (3 ms), stage="WAL history reservation" (0 ms), stage="Finalize update counters" (0 ms), stage="Detect lost partitions" (8 ms), stage="Exchange done" (1 ms), stage="Total time" (15 ms)] [21:03:17] : [Step 4/5] [2021-11-19 21:03:17,205][INFO ][exchange-worker-#4543%util.GridInternalTaskUnusedWalSegmentsTest0%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=e5c7f7dd-47b7-4ab6-9149-6791d3600000, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], evt=NODE_LEFT, evtNode=TcpDiscoveryNode [id=80d945d2-7ddb-4d94-a653-44c315400003, consistentId=c72c5b3e-7e34-4453-ac0f-88bc1481a377, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47503], discPort=47503, order=4, intOrder=4, lastExchangeTime=1637344995707, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=5, minorTopVer=0]] [21:03:17] : [Step 4/5] [2021-11-19 21:03:17,209][INFO ][exchange-worker-#4543%util.GridInternalTaskUnusedWalSegmentsTest0%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (7 ms), stage="Determine exchange type" (2 ms), stage="Preloading notification" (0 ms), stage="After states restored callback" (1 ms), stage="WAL history reservation" (0 ms), stage="Finalize update counters" (0 ms), stage="Detect lost partitions" (8 ms), stage="Exchange done" (4 ms), stage="Total time" (22 ms)] [21:03:17] : [Step 4/5] [2021-11-19 21:03:17,210][INFO ][exchange-worker-#4543%util.GridInternalTaskUnusedWalSegmentsTest0%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], stage="Affinity initialization (exchange-free switch on fully-rebalanced topology) [grp=ignite-sys-cache]" (2 ms) (parent=Determine exchange type), stage="Affinity initialization (exchange-free switch on fully-rebalanced topology) [grp=default]" (0 ms) (parent=Determine exchange type)] [21:03:17] : [Step 4/5] [2021-11-19 21:03:17,207][INFO ][exchange-worker-#4667%util.GridInternalTaskUnusedWalSegmentsTest1%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], stage="Affinity initialization (exchange-free switch on fully-rebalanced topology) [grp=ignite-sys-cache]" (0 ms) (parent=Determine exchange type), stage="Affinity initialization (exchange-free switch on fully-rebalanced topology) [grp=default]" (0 ms) (parent=Determine exchange type)] [21:03:17] : [Step 4/5] [2021-11-19 21:03:17,206][INFO ][exchange-worker-#4791%util.GridInternalTaskUnusedWalSegmentsTest2%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=5, minorTopVer=0], force=false, evt=NODE_LEFT, node=80d945d2-7ddb-4d94-a653-44c315400003] [21:03:17] : [Step 4/5] [2021-11-19 21:03:17,212][INFO ][exchange-worker-#4667%util.GridInternalTaskUnusedWalSegmentsTest1%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], crd=false] [21:03:17] : [Step 4/5] [2021-11-19 21:03:17,211][INFO ][exchange-worker-#4543%util.GridInternalTaskUnusedWalSegmentsTest0%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], crd=true] [21:03:17] : [Step 4/5] [2021-11-19 21:03:17,217][INFO ][exchange-worker-#4667%util.GridInternalTaskUnusedWalSegmentsTest1%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=5, minorTopVer=0], force=false, evt=NODE_LEFT, node=80d945d2-7ddb-4d94-a653-44c315400003] [21:03:17] : [Step 4/5] [2021-11-19 21:03:17,217][INFO ][exchange-worker-#4543%util.GridInternalTaskUnusedWalSegmentsTest0%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=5, minorTopVer=0], force=false, evt=NODE_LEFT, node=80d945d2-7ddb-4d94-a653-44c315400003] [21:03:17] : [Step 4/5] [2021-11-19 21:03:17,219][INFO ][db-checkpoint-thread-#4937%util.GridInternalTaskUnusedWalSegmentsTest2%][Checkpointer] Skipping checkpoint (no pages were modified) [checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=1ms, checkpointLockHoldTime=2ms, reason='timeout'] [21:03:17] : [Step 4/5] [2021-11-19 21:03:17,229][INFO ][disco-event-worker-#4542%util.GridInternalTaskUnusedWalSegmentsTest0%][GridDiscoveryManager] Node left topology: TcpDiscoveryNode [id=d2cfc867-15f3-4259-8cff-46a016a00002, consistentId=ce69043b-23cc-44c7-b1cf-65562a5661fd, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47502], discPort=47502, order=3, intOrder=3, lastExchangeTime=1637344992449, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false] [21:03:17] : [Step 4/5] [2021-11-19 21:03:17,230][INFO ][disco-event-worker-#4666%util.GridInternalTaskUnusedWalSegmentsTest1%][GridDiscoveryManager] Node left topology: TcpDiscoveryNode [id=d2cfc867-15f3-4259-8cff-46a016a00002, consistentId=ce69043b-23cc-44c7-b1cf-65562a5661fd, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47502], discPort=47502, order=3, intOrder=3, lastExchangeTime=1637344992459, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false] [21:03:17] : [Step 4/5] [2021-11-19 21:03:17,229][INFO ][tcp-disco-msg-worker-[d2cfc867 127.0.0.1:47502]-#221%util.GridInternalTaskUnusedWalSegmentsTest1%-#4659%util.GridInternalTaskUnusedWalSegmentsTest1%][TestTcpDiscoverySpi] New next node [newNext=TcpDiscoveryNode [id=e5c7f7dd-47b7-4ab6-9149-6791d3600000, consistentId=87f16126-5f72-4dfe-a561-76ce966f5d95, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637344990199, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false]] [21:03:17] : [Step 4/5] [2021-11-19 21:03:17,232][INFO ][disco-event-worker-#4666%util.GridInternalTaskUnusedWalSegmentsTest1%][GridDiscoveryManager] Topology snapshot [ver=6, locNode=a6e2d1b8, servers=2, clients=0, state=ACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=e5c7f7dd-47b7-4ab6-9149-6791d3600000, consistentId=87f16126-5f72-4dfe-a561-76ce966f5d95, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=a6e2d1b8-e889-42a6-b138-d6edb8d00001, consistentId=e7427b46-5e04-4060-9e7a-4a56d318815a, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:03:17] : [Step 4/5] [2021-11-19 21:03:17,231][INFO ][disco-event-worker-#4542%util.GridInternalTaskUnusedWalSegmentsTest0%][GridDiscoveryManager] Topology snapshot [ver=6, locNode=e5c7f7dd, servers=2, clients=0, state=ACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=e5c7f7dd-47b7-4ab6-9149-6791d3600000, consistentId=87f16126-5f72-4dfe-a561-76ce966f5d95, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=a6e2d1b8-e889-42a6-b138-d6edb8d00001, consistentId=e7427b46-5e04-4060-9e7a-4a56d318815a, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:03:17] : [Step 4/5] [2021-11-19 21:03:17,230][INFO ][tcp-disco-sock-reader-[a6e2d1b8 127.0.0.1:58289]-#234%util.GridInternalTaskUnusedWalSegmentsTest2%-#4787%util.GridInternalTaskUnusedWalSegmentsTest2%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:58289, rmtPort=58289, rmtNodeId=a6e2d1b8-e889-42a6-b138-d6edb8d00001] [21:03:17] : [Step 4/5] [2021-11-19 21:03:17,235][INFO ][disco-event-worker-#4542%util.GridInternalTaskUnusedWalSegmentsTest0%][GridDiscoveryManager] ^-- Baseline [id=0, size=4, online=2, offline=2] [21:03:17] : [Step 4/5] [2021-11-19 21:03:17,234][INFO ][disco-event-worker-#4666%util.GridInternalTaskUnusedWalSegmentsTest1%][GridDiscoveryManager] ^-- Baseline [id=0, size=4, online=2, offline=2] [21:03:17] : [Step 4/5] [2021-11-19 21:03:17,234][INFO ][tcp-disco-srvr-[:47500]-#217%util.GridInternalTaskUnusedWalSegmentsTest0%-#4540%util.GridInternalTaskUnusedWalSegmentsTest0%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=33263] [21:03:17] : [Step 4/5] [2021-11-19 21:03:17,237][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][GridCacheProcessor] Stopped cache [cacheName=default] [21:03:17] : [Step 4/5] [2021-11-19 21:03:17,238][INFO ][tcp-disco-srvr-[:47500]-#217%util.GridInternalTaskUnusedWalSegmentsTest0%-#4540%util.GridInternalTaskUnusedWalSegmentsTest0%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=33263] [21:03:17] : [Step 4/5] [2021-11-19 21:03:17,238][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][GridCacheProcessor] Stopped cache [cacheName=ignite-sys-cache] [21:03:17] : [Step 4/5] [2021-11-19 21:03:17,238][INFO ][exchange-worker-#4543%util.GridInternalTaskUnusedWalSegmentsTest0%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=6, minorTopVer=0], crd=true, evt=NODE_LEFT, evtNode=d2cfc867-15f3-4259-8cff-46a016a00002, customEvt=null, allowMerge=false, exchangeFreeSwitch=true] [21:03:17] : [Step 4/5] [2021-11-19 21:03:17,239][INFO ][exchange-worker-#4667%util.GridInternalTaskUnusedWalSegmentsTest1%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=6, minorTopVer=0], crd=false, evt=NODE_LEFT, evtNode=d2cfc867-15f3-4259-8cff-46a016a00002, customEvt=null, allowMerge=false, exchangeFreeSwitch=true] [21:03:17] : [Step 4/5] [2021-11-19 21:03:17,240][INFO ][exchange-worker-#4543%util.GridInternalTaskUnusedWalSegmentsTest0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=6, minorTopVer=0], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:03:17] : [Step 4/5] [2021-11-19 21:03:17,240][INFO ][tcp-disco-sock-reader-[]-#247%util.GridInternalTaskUnusedWalSegmentsTest0%-#4990%util.GridInternalTaskUnusedWalSegmentsTest0%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:33263, rmtPort=33263] [21:03:17] : [Step 4/5] [2021-11-19 21:03:17,241][INFO ][exchange-worker-#4667%util.GridInternalTaskUnusedWalSegmentsTest1%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=6, minorTopVer=0], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:03:17] : [Step 4/5] [2021-11-19 21:03:17,241][INFO ][exchange-worker-#4543%util.GridInternalTaskUnusedWalSegmentsTest0%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=6, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=6, minorTopVer=0], err=null, rebalanced=true, wasRebalanced=true] [21:03:17]W: [org.apache.ignite:ignite-core] [2021-11-19 21:03:17,243][WARN ][sys-#4530%util.GridInternalTaskUnusedWalSegmentsTest0%][GridDhtPartitionTopologyImpl] Detected lost partitions [grp=default, parts=[7, 10-11, 22], topVer=AffinityTopologyVersion [topVer=6, minorTopVer=0]] [21:03:17] : [Step 4/5] [2021-11-19 21:03:17,242][INFO ][tcp-disco-sock-reader-[a6e2d1b8 127.0.0.1:33263]-#247%util.GridInternalTaskUnusedWalSegmentsTest0%-#4990%util.GridInternalTaskUnusedWalSegmentsTest0%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=a6e2d1b8-e889-42a6-b138-d6edb8d00001, rmtAddr=/127.0.0.1:33263] [21:03:17] : [Step 4/5] [2021-11-19 21:03:17,243][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][FilePageStoreManager] Cleanup cache stores [total=4, left=0, cleanFiles=false] [21:03:17] : [Step 4/5] [2021-11-19 21:03:17,243][INFO ][exchange-worker-#4667%util.GridInternalTaskUnusedWalSegmentsTest1%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=6, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=6, minorTopVer=0], err=null, rebalanced=true, wasRebalanced=true] [21:03:17] : [Step 4/5] [2021-11-19 21:03:17,247][INFO ][exchange-worker-#4543%util.GridInternalTaskUnusedWalSegmentsTest0%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=e5c7f7dd-47b7-4ab6-9149-6791d3600000, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=6, minorTopVer=0], evt=NODE_LEFT, evtNode=TcpDiscoveryNode [id=d2cfc867-15f3-4259-8cff-46a016a00002, consistentId=ce69043b-23cc-44c7-b1cf-65562a5661fd, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47502], discPort=47502, order=3, intOrder=3, lastExchangeTime=1637344992449, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=6, minorTopVer=0]] [21:03:17]W: [org.apache.ignite:ignite-core] [2021-11-19 21:03:17,248][WARN ][sys-#4641%util.GridInternalTaskUnusedWalSegmentsTest1%][GridDhtPartitionTopologyImpl] Detected lost partitions [grp=default, parts=[7, 10-11, 22], topVer=AffinityTopologyVersion [topVer=6, minorTopVer=0]] [21:03:17] : [Step 4/5] [2021-11-19 21:03:17,248][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][GridDeploymentLocalStore] Removed undeployed class: GridDeployment [ts=1637344995942, depMode=SHARED, clsLdr=IsolatedClassLoader{roleName='test'}, clsLdrId=7f01d593d71-d2cfc867-15f3-4259-8cff-46a016a00002, userVer=0, loc=true, sampleClsName=org.apache.ignite.internal.processors.cache.distributed.dht.preloader.IgniteDhtPartitionsToReloadMap, pendingUndeploy=false, undeployed=true, usage=0] [21:03:17] : [Step 4/5] [2021-11-19 21:03:17,250][INFO ][exchange-worker-#4667%util.GridInternalTaskUnusedWalSegmentsTest1%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=a6e2d1b8-e889-42a6-b138-d6edb8d00001, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=6, minorTopVer=0], evt=NODE_LEFT, evtNode=TcpDiscoveryNode [id=d2cfc867-15f3-4259-8cff-46a016a00002, consistentId=ce69043b-23cc-44c7-b1cf-65562a5661fd, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47502], discPort=47502, order=3, intOrder=3, lastExchangeTime=1637344992459, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=6, minorTopVer=0]] [21:03:17] : [Step 4/5] [2021-11-19 21:03:17,252][INFO ][exchange-worker-#4667%util.GridInternalTaskUnusedWalSegmentsTest1%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=6, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=6, minorTopVer=0], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (1 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="After states restored callback" (1 ms), stage="WAL history reservation" (0 ms), stage="Finalize update counters" (0 ms), stage="Detect lost partitions" (7 ms), stage="Exchange done" (2 ms), stage="Total time" (11 ms)] [21:03:17] : [Step 4/5] [2021-11-19 21:03:17,249][INFO ][exchange-worker-#4543%util.GridInternalTaskUnusedWalSegmentsTest0%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=6, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=6, minorTopVer=0], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (1 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="After states restored callback" (0 ms), stage="WAL history reservation" (0 ms), stage="Finalize update counters" (0 ms), stage="Detect lost partitions" (2 ms), stage="Exchange done" (6 ms), stage="Total time" (9 ms)] [21:03:17] : [Step 4/5] [2021-11-19 21:03:17,257][INFO ][exchange-worker-#4667%util.GridInternalTaskUnusedWalSegmentsTest1%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=6, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=6, minorTopVer=0], stage="Affinity initialization (exchange-free switch on fully-rebalanced topology) [grp=ignite-sys-cache]" (0 ms) (parent=Determine exchange type), stage="Affinity initialization (exchange-free switch on fully-rebalanced topology) [grp=default]" (0 ms) (parent=Determine exchange type)] [21:03:17] : [Step 4/5] [2021-11-19 21:03:17,258][INFO ][exchange-worker-#4543%util.GridInternalTaskUnusedWalSegmentsTest0%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=6, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=6, minorTopVer=0], stage="Affinity initialization (exchange-free switch on fully-rebalanced topology) [grp=ignite-sys-cache]" (0 ms) (parent=Determine exchange type), stage="Affinity initialization (exchange-free switch on fully-rebalanced topology) [grp=default]" (0 ms) (parent=Determine exchange type)] [21:03:17] : [Step 4/5] [2021-11-19 21:03:17,259][INFO ][exchange-worker-#4667%util.GridInternalTaskUnusedWalSegmentsTest1%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=6, minorTopVer=0], crd=false] [21:03:17] : [Step 4/5] [2021-11-19 21:03:17,260][INFO ][exchange-worker-#4543%util.GridInternalTaskUnusedWalSegmentsTest0%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=6, minorTopVer=0], crd=true] [21:03:17] : [Step 4/5] [2021-11-19 21:03:17,261][INFO ][exchange-worker-#4667%util.GridInternalTaskUnusedWalSegmentsTest1%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=6, minorTopVer=0], force=false, evt=NODE_LEFT, node=d2cfc867-15f3-4259-8cff-46a016a00002] [21:03:17] : [Step 4/5] [2021-11-19 21:03:17,262][INFO ][exchange-worker-#4543%util.GridInternalTaskUnusedWalSegmentsTest0%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=6, minorTopVer=0], force=false, evt=NODE_LEFT, node=d2cfc867-15f3-4259-8cff-46a016a00002] [21:03:17] : [Step 4/5] [2021-11-19 21:03:17,263][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][GridInternalTaskUnusedWalSegmentsTest2] [21:03:17] : [Step 4/5] [21:03:17] : [Step 4/5] >>> +------------------------------------------------------+ [21:03:17] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV stopped OK [21:03:17] : [Step 4/5] >>> +------------------------------------------------------+ [21:03:17] : [Step 4/5] >>> Ignite instance name: util.GridInternalTaskUnusedWalSegmentsTest2 [21:03:17] : [Step 4/5] >>> Grid uptime: 00:00:04.749 [21:03:17] : [Step 4/5] [21:03:17] : [Step 4/5] [21:03:17] : [Step 4/5] [2021-11-19 21:03:17,264][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][root] >>> Stopping grid [name=util.GridInternalTaskUnusedWalSegmentsTest1, id=a6e2d1b8-e889-42a6-b138-d6edb8d00001] [21:03:17] : [Step 4/5] [2021-11-19 21:03:17,277][INFO ][tcp-disco-sock-reader-[e5c7f7dd 127.0.0.1:57623]-#225%util.GridInternalTaskUnusedWalSegmentsTest1%-#4663%util.GridInternalTaskUnusedWalSegmentsTest1%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:57623, rmtPort=57623, rmtNodeId=e5c7f7dd-47b7-4ab6-9149-6791d3600000] [21:03:17] : [Step 4/5] [2021-11-19 21:03:17,278][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][GridCacheProcessor] Stopped cache [cacheName=default] [21:03:17] : [Step 4/5] [2021-11-19 21:03:17,278][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][GridCacheProcessor] Stopped cache [cacheName=ignite-sys-cache] [21:03:17] : [Step 4/5] [2021-11-19 21:03:17,279][INFO ][disco-event-worker-#4542%util.GridInternalTaskUnusedWalSegmentsTest0%][GridDiscoveryManager] Node left topology: TcpDiscoveryNode [id=a6e2d1b8-e889-42a6-b138-d6edb8d00001, consistentId=e7427b46-5e04-4060-9e7a-4a56d318815a, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637344990169, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false] [21:03:17] : [Step 4/5] [2021-11-19 21:03:17,280][INFO ][disco-event-worker-#4542%util.GridInternalTaskUnusedWalSegmentsTest0%][GridDiscoveryManager] Topology snapshot [ver=7, locNode=e5c7f7dd, servers=1, clients=0, state=ACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=e5c7f7dd-47b7-4ab6-9149-6791d3600000, consistentId=87f16126-5f72-4dfe-a561-76ce966f5d95, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:03:17] : [Step 4/5] [2021-11-19 21:03:17,281][INFO ][disco-event-worker-#4542%util.GridInternalTaskUnusedWalSegmentsTest0%][GridDiscoveryManager] ^-- Baseline [id=0, size=4, online=1, offline=3] [21:03:17] : [Step 4/5] [2021-11-19 21:03:17,281][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][FilePageStoreManager] Cleanup cache stores [total=4, left=0, cleanFiles=false] [21:03:17] : [Step 4/5] [2021-11-19 21:03:17,283][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][GridDeploymentLocalStore] Removed undeployed class: GridDeployment [ts=1637344995942, depMode=SHARED, clsLdr=IsolatedClassLoader{roleName='test'}, clsLdrId=8f01d593d71-a6e2d1b8-e889-42a6-b138-d6edb8d00001, userVer=0, loc=true, sampleClsName=org.apache.ignite.internal.processors.cache.distributed.dht.preloader.IgniteDhtPartitionHistorySuppliersMap, pendingUndeploy=false, undeployed=true, usage=0] [21:03:17] : [Step 4/5] [2021-11-19 21:03:17,284][INFO ][exchange-worker-#4543%util.GridInternalTaskUnusedWalSegmentsTest0%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=7, minorTopVer=0], crd=true, evt=NODE_LEFT, evtNode=a6e2d1b8-e889-42a6-b138-d6edb8d00001, customEvt=null, allowMerge=false, exchangeFreeSwitch=true] [21:03:17] : [Step 4/5] [2021-11-19 21:03:17,285][INFO ][exchange-worker-#4543%util.GridInternalTaskUnusedWalSegmentsTest0%][GridAffinityAssignmentCache] Local node affinity assignment distribution is not ideal [cache=default, expectedPrimary=32.00, actualPrimary=10, expectedBackups=0.00, actualBackups=0, warningThreshold=50.00%] [21:03:17] : [Step 4/5] [2021-11-19 21:03:17,287][INFO ][exchange-worker-#4543%util.GridInternalTaskUnusedWalSegmentsTest0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=7, minorTopVer=0], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:03:17] : [Step 4/5] [2021-11-19 21:03:17,288][INFO ][exchange-worker-#4543%util.GridInternalTaskUnusedWalSegmentsTest0%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=7, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=7, minorTopVer=0], err=null, rebalanced=true, wasRebalanced=true] [21:03:17] : [Step 4/5] [2021-11-19 21:03:17,295][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][GridInternalTaskUnusedWalSegmentsTest1] [21:03:17] : [Step 4/5] [21:03:17] : [Step 4/5] >>> +------------------------------------------------------+ [21:03:17] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV stopped OK [21:03:17]W: [org.apache.ignite:ignite-core] [2021-11-19 21:03:17,295][WARN ][exchange-worker-#4543%util.GridInternalTaskUnusedWalSegmentsTest0%][GridDhtPartitionTopologyImpl] Detected lost partitions [grp=default, parts=[5-6, 8, 12, 14, 20, 25-26, 31], topVer=AffinityTopologyVersion [topVer=7, minorTopVer=0]] [21:03:17] : [Step 4/5] >>> +------------------------------------------------------+ [21:03:17] : [Step 4/5] >>> Ignite instance name: util.GridInternalTaskUnusedWalSegmentsTest1 [21:03:17] : [Step 4/5] >>> Grid uptime: 00:00:07.051 [21:03:17] : [Step 4/5] [21:03:17] : [Step 4/5] [21:03:17] : [Step 4/5] [2021-11-19 21:03:17,296][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][root] >>> Stopping grid [name=util.GridInternalTaskUnusedWalSegmentsTest0, id=e5c7f7dd-47b7-4ab6-9149-6791d3600000] [21:03:17] : [Step 4/5] [2021-11-19 21:03:17,297][INFO ][exchange-worker-#4543%util.GridInternalTaskUnusedWalSegmentsTest0%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=e5c7f7dd-47b7-4ab6-9149-6791d3600000, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=7, minorTopVer=0], evt=NODE_LEFT, evtNode=TcpDiscoveryNode [id=a6e2d1b8-e889-42a6-b138-d6edb8d00001, consistentId=e7427b46-5e04-4060-9e7a-4a56d318815a, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637344990169, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=7, minorTopVer=0]] [21:03:17] : [Step 4/5] [2021-11-19 21:03:17,299][INFO ][exchange-worker-#4543%util.GridInternalTaskUnusedWalSegmentsTest0%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=7, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=7, minorTopVer=0], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (0 ms), stage="Determine exchange type" (1 ms), stage="Preloading notification" (0 ms), stage="After states restored callback" (0 ms), stage="WAL history reservation" (0 ms), stage="Finalize update counters" (0 ms), stage="Detect lost partitions" (9 ms), stage="Exchange done" (2 ms), stage="Total time" (12 ms)] [21:03:17] : [Step 4/5] [2021-11-19 21:03:17,300][INFO ][exchange-worker-#4543%util.GridInternalTaskUnusedWalSegmentsTest0%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=7, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=7, minorTopVer=0], stage="Affinity initialization (exchange-free switch on fully-rebalanced topology) [grp=default]" (1 ms) (parent=Determine exchange type), stage="Affinity initialization (exchange-free switch on fully-rebalanced topology) [grp=ignite-sys-cache]" (0 ms) (parent=Determine exchange type)] [21:03:17] : [Step 4/5] [2021-11-19 21:03:17,302][INFO ][exchange-worker-#4543%util.GridInternalTaskUnusedWalSegmentsTest0%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=7, minorTopVer=0], crd=true] [21:03:17] : [Step 4/5] [2021-11-19 21:03:17,302][INFO ][exchange-worker-#4543%util.GridInternalTaskUnusedWalSegmentsTest0%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=7, minorTopVer=0], force=false, evt=NODE_LEFT, node=a6e2d1b8-e889-42a6-b138-d6edb8d00001] [21:03:17]W: [org.apache.ignite:ignite-core] [2021-11-19 21:03:17,311][WARN ][tcp-disco-sock-reader-[80d945d2 127.0.0.1:57243]-#244%util.GridInternalTaskUnusedWalSegmentsTest0%-#4912%util.GridInternalTaskUnusedWalSegmentsTest0%][TestTcpDiscoverySpi] Failed to shutdown socket [21:03:17]W: [org.apache.ignite:ignite-core] java.net.SocketException: Socket is closed [21:03:17]W: [org.apache.ignite:ignite-core] at java.net.Socket.shutdownOutput(Socket.java:1568) [21:03:17]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.close(IgniteUtils.java:4247) [21:03:17]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.discovery.tcp.ServerImpl$SocketReader.body(ServerImpl.java:7370) [21:03:17]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.IgniteSpiThread.run(IgniteSpiThread.java:58) [21:03:17] : [Step 4/5] [2021-11-19 21:03:17,312][INFO ][tcp-disco-sock-reader-[a6e2d1b8 127.0.0.1:33263]-#247%util.GridInternalTaskUnusedWalSegmentsTest0%-#4990%util.GridInternalTaskUnusedWalSegmentsTest0%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:33263, rmtPort=33263, rmtNodeId=a6e2d1b8-e889-42a6-b138-d6edb8d00001] [21:03:17] : [Step 4/5] [2021-11-19 21:03:17,311][INFO ][tcp-disco-sock-reader-[d2cfc867 127.0.0.1:36151]-#246%util.GridInternalTaskUnusedWalSegmentsTest0%-#4983%util.GridInternalTaskUnusedWalSegmentsTest0%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:36151, rmtPort=36151, rmtNodeId=d2cfc867-15f3-4259-8cff-46a016a00002] [21:03:17] : [Step 4/5] [2021-11-19 21:03:17,313][INFO ][tcp-disco-sock-reader-[80d945d2 127.0.0.1:57243]-#244%util.GridInternalTaskUnusedWalSegmentsTest0%-#4912%util.GridInternalTaskUnusedWalSegmentsTest0%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:57243, rmtPort=57243, rmtNodeId=80d945d2-7ddb-4d94-a653-44c315400003] [21:03:17] : [Step 4/5] [2021-11-19 21:03:17,315][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][GridCacheProcessor] Stopped cache [cacheName=default] [21:03:17] : [Step 4/5] [2021-11-19 21:03:17,316][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][GridCacheProcessor] Stopped cache [cacheName=ignite-sys-cache] [21:03:17] : [Step 4/5] [2021-11-19 21:03:17,318][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][FilePageStoreManager] Cleanup cache stores [total=4, left=0, cleanFiles=false] [21:03:17] : [Step 4/5] [2021-11-19 21:03:17,320][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][GridDeploymentLocalStore] Removed undeployed class: GridDeployment [ts=1637344995922, depMode=SHARED, clsLdr=IsolatedClassLoader{roleName='test'}, clsLdrId=2f01d593d71-e5c7f7dd-47b7-4ab6-9149-6791d3600000, userVer=0, loc=true, sampleClsName=org.apache.ignite.internal.processors.cache.distributed.dht.preloader.GridDhtPartitionMap, pendingUndeploy=false, undeployed=true, usage=0] [21:03:17] : [Step 4/5] [2021-11-19 21:03:17,337][INFO ][test-runner-#4425%util.GridInternalTaskUnusedWalSegmentsTest%][GridInternalTaskUnusedWalSegmentsTest0] [21:03:17] : [Step 4/5] [21:03:17] : [Step 4/5] >>> +------------------------------------------------------+ [21:03:17] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV stopped OK [21:03:17] : [Step 4/5] >>> +------------------------------------------------------+ [21:03:17] : [Step 4/5] >>> Ignite instance name: util.GridInternalTaskUnusedWalSegmentsTest0 [21:03:17] : [Step 4/5] >>> Grid uptime: 00:00:08.472 [21:03:17] : [Step 4/5] [21:03:17] : [Step 4/5] [21:03:17] : [Step 4/5] [21:03:17] >>> Stopping test: GridInternalTaskUnusedWalSegmentsTest#testCorrectnessOfDeletionTaskSegments in 8968 ms <<< [21:03:17] : [Step 4/5] [2021-11-19 21:03:17,338][INFO ][main][root] >>> Stopping test: GridInternalTaskUnusedWalSegmentsTest#testCorrectnessOfDeletionTaskSegments in 8968 ms <<< [21:03:17] : [Step 4/5] [21:03:17] >>> Heap: 575 MB used / 1956 MB commited / 1956 MB max <<< [21:03:17] : [Step 4/5] [2021-11-19 21:03:17,339][INFO ][main][root] >>> Heap: 575 MB used / 1956 MB commited / 1956 MB max <<< [21:03:17] : [Step 4/5] [21:03:17] >>> Non-Heap: 124 MB used / 134 MB commited / 0 MB max <<< [21:03:17] : [Step 4/5] [2021-11-19 21:03:17,339][INFO ][main][root] >>> Non-Heap: 124 MB used / 134 MB commited / 0 MB max <<< [21:03:17] : [Step 4/5] [21:03:17] >>> Stopping test class: GridInternalTaskUnusedWalSegmentsTest <<< [21:03:17] : [Step 4/5] [2021-11-19 21:03:17,372][INFO ][main][root] >>> Stopping test class: GridInternalTaskUnusedWalSegmentsTest <<< [21:03:17] : [Step 4/5] [21:03:17] >>> Starting test class: GridNodeMetricsLogPdsSelfTest <<< [21:03:17] : [Step 4/5] [2021-11-19 21:03:17,373][INFO ][main][root] >>> Starting test class: GridNodeMetricsLogPdsSelfTest <<< [21:03:17] : [Step 4/5] Running org.apache.ignite.internal.GridNodeMetricsLogPdsSelfTest [21:03:17]i: [Step 4/5] ##teamcity[importData type='surefire' path='/opt/buildagent/temp/buildTmp/ignite-tools-junit-reports1777670380320881607/test-org.apache.ignite.testsuites.IgniteBasicWithPersistenceTestSuite1637344988366.xml'] [21:03:17] : [Step 4/5] Importing data from '/opt/buildagent/temp/buildTmp/ignite-tools-junit-reports1777670380320881607/test-org.apache.ignite.testsuites.IgniteBasicWithPersistenceTestSuite1637344988366.xml' (279 B) with 'surefire' processor [21:03:17] : [Step 4/5] [21:03:17] >>> Starting test: GridNodeMetricsLogPdsSelfTest#testNodeMetricsLog <<< [21:03:17] : [Step 4/5] [2021-11-19 21:03:17,386][INFO ][main][root] >>> Starting test: GridNodeMetricsLogPdsSelfTest#testNodeMetricsLog <<< [21:03:17] : [Step 4/5] [21:03:17] >>> Heap: 578 MB used / 1956 MB commited / 1956 MB max <<< [21:03:17] : [Step 4/5] [2021-11-19 21:03:17,387][INFO ][main][root] >>> Heap: 578 MB used / 1956 MB commited / 1956 MB max <<< [21:03:17] : [Step 4/5] [21:03:17] >>> Non-Heap: 124 MB used / 134 MB commited / 0 MB max <<< [21:03:17] : [Step 4/5] [2021-11-19 21:03:17,387][INFO ][main][root] >>> Non-Heap: 124 MB used / 134 MB commited / 0 MB max <<< [21:03:17] : [Step 4/5] [2021-11-19 21:03:17,402][INFO ][main][root] [GridStringLogger echo] Ignite work directory is not provided, automatically resolved to: /opt/buildagent/work/7bc1c54bc719b67c/work [21:03:17] : [Step 4/5] [2021-11-19 21:03:17,403][INFO ][main][root] [GridStringLogger echo] Consistent ID is not set, it is recommended to set consistent ID for production clusters (use IgniteConfiguration.setConsistentId property) [21:03:17] : [Step 4/5] [2021-11-19 21:03:17,405][INFO ][main][root] [GridStringLogger echo] [21:03:17] : [Step 4/5] [21:03:17] : [Step 4/5] >>> __________ ________________ [21:03:17] : [Step 4/5] >>> / _/ ___/ |/ / _/_ __/ __/ [21:03:17] : [Step 4/5] >>> _/ // (7 7 // / / / / _/ [21:03:17] : [Step 4/5] >>> /___/\___/_/|_/___/ /_/ /___/ [21:03:17] : [Step 4/5] >>> [21:03:17] : [Step 4/5] >>> ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:03:17] : [Step 4/5] >>> 2021 Copyright(C) Apache Software Foundation [21:03:17] : [Step 4/5] >>> [21:03:17] : [Step 4/5] >>> Ignite documentation: http://ignite.apache.org [21:03:17] : [Step 4/5] [21:03:17] : [Step 4/5] [2021-11-19 21:03:17,406][INFO ][main][root] [GridStringLogger echo] Config URL: n/a [21:03:17] : [Step 4/5] [2021-11-19 21:03:17,407][INFO ][main][root] [GridStringLogger echo] IgniteConfiguration [igniteInstanceName=internal.GridNodeMetricsLogPdsSelfTest0, pubPoolSize=24, svcPoolSize=24, callbackPoolSize=24, stripedPoolSize=24, sysPoolSize=24, mgmtPoolSize=4, dataStreamerPoolSize=24, utilityCachePoolSize=24, utilityCacheKeepAliveTime=60000, p2pPoolSize=2, qryPoolSize=24, buildIdxPoolSize=4, igniteHome=/opt/buildagent/work/7bc1c54bc719b67c, igniteWorkDir=/opt/buildagent/work/7bc1c54bc719b67c/work, mbeanSrv=com.sun.jmx.mbeanserver.JmxMBeanServer@6fe85038, nodeId=5a320cff-6ba1-49d0-81a3-7e0c09e00000, marsh=BinaryMarshaller [], marshLocJobs=false, daemon=false, p2pEnabled=true, netTimeout=10000, netCompressionLevel=1, sndRetryDelay=1000, sndRetryCnt=3, metricsHistSize=10000, metricsUpdateFreq=1000, metricsExpTime=9223372036854775807, discoSpi=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=0, ackTimeout=0, marsh=null, reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], segPlc=STOP, segResolveAttempts=2, waitForSegOnStart=true, allResolversPassReq=true, segChkFreq=10000, commSpi=TcpCommunicationSpi [connectGate=org.apache.ignite.spi.communication.tcp.internal.ConnectGateway@795f5d51, ctxInitLatch=java.util.concurrent.CountDownLatch@34aeacd1[Count = 1], stopping=false, clientPool=null, nioSrvWrapper=null, stateProvider=null], evtSpi=MemoryEventStorageSpi [expireAgeMs=9223372036854775807, expireCnt=10000, filter=null], colSpi=NoopCollisionSpi [], deploySpi=LocalDeploymentSpi [], indexingSpi=org.apache.ignite.spi.indexing.noop.NoopIndexingSpi@2274160, addrRslvr=null, encryptionSpi=org.apache.ignite.spi.encryption.noop.NoopEncryptionSpi@65383667, tracingSpi=org.apache.ignite.spi.tracing.NoopTracingSpi@63cd2cd2, clientMode=false, rebalanceThreadPoolSize=4, rebalanceTimeout=10000, rebalanceBatchesPrefetchCnt=3, rebalanceThrottle=0, rebalanceBatchSize=524288, txCfg=TransactionConfiguration [txSerEnabled=false, dfltIsolation=REPEATABLE_READ, dfltConcurrency=PESSIMISTIC, dfltTxTimeout=0, txTimeoutOnPartitionMapExchange=0, deadlockTimeout=10000, pessimisticTxLogSize=0, pessimisticTxLogLinger=10000, tmLookupClsName=null, txManagerFactory=null, useJtaSync=false], cacheSanityCheckEnabled=true, discoStartupDelay=60000, deployMode=SHARED, p2pMissedCacheSize=100, locHost=127.0.0.1, timeSrvPortBase=31100, timeSrvPortRange=100, failureDetectionTimeout=10000, sysWorkerBlockedTimeout=null, clientFailureDetectionTimeout=10000, metricsLogFreq=1000, connectorCfg=null, odbcCfg=null, warmupClos=null, atomicCfg=AtomicConfiguration [seqReserveSize=1000, cacheMode=PARTITIONED, backups=1, aff=null, grpName=null], classLdr=null, sslCtxFactory=null, platformCfg=null, binaryCfg=null, memCfg=null, pstCfg=null, dsCfg=DataStorageConfiguration [sysRegionInitSize=41943040, sysRegionMaxSize=104857600, pageSize=0, concLvl=0, dfltDataRegConf=DataRegionConfiguration [name=default, maxSize=31457280, initSize=268435456, swapPath=null, pageEvictionMode=DISABLED, pageReplacementMode=CLOCK, evictionThreshold=0.9, emptyPagesPoolSize=100, metricsEnabled=false, metricsSubIntervalCount=5, metricsRateTimeInterval=60000, persistenceEnabled=true, checkpointPageBufSize=0, lazyMemoryAllocation=true, warmUpCfg=null], dataRegions=DataRegionConfiguration[] [DataRegionConfiguration [name=userTransientDataRegion, maxSize=20971520, initSize=268435456, swapPath=null, pageEvictionMode=DISABLED, pageReplacementMode=CLOCK, evictionThreshold=0.9, emptyPagesPoolSize=100, metricsEnabled=false, metricsSubIntervalCount=5, metricsRateTimeInterval=60000, persistenceEnabled=false, checkpointPageBufSize=0, lazyMemoryAllocation=true, warmUpCfg=null]], storagePath=null, checkpointFreq=180000, lockWaitTime=10000, checkpointThreads=4, checkpointWriteOrder=SEQUENTIAL, walHistSize=20, maxWalArchiveSize=1073741824, walSegments=10, walSegmentSize=67108864, walPath=db/wal, walArchivePath=db/wal/archive, cdcWalPath=db/wal/cdc, cdcEnabled=false, metricsEnabled=false, walMode=LOG_ONLY, walTlbSize=131072, walBuffSize=0, walFlushFreq=2000, walFsyncDelay=1000, walRecordIterBuffSize=67108864, alwaysWriteFullPages=false, fileIOFactory=org.apache.ignite.internal.processors.cache.persistence.file.AsyncFileIOFactory@3c79088e, metricsSubIntervalCnt=5, metricsRateTimeInterval=60000, walAutoArchiveAfterInactivity=-1, walForceArchiveTimeout=-1, writeThrottlingEnabled=false, walCompactionEnabled=false, walCompactionLevel=1, checkpointReadLockTimeout=null, walPageCompression=DISABLED, walPageCompressionLevel=null, dfltWarmUpCfg=null, encCfg=org.apache.ignite.configuration.EncryptionConfiguration@4a37191a, defragmentationThreadPoolSize=4, minWalArchiveSize=-1], snapshotPath=snapshots, activeOnStart=true, activeOnStartPropSetFlag=false, autoActivation=true, autoActivationPropSetFlag=false, clusterStateOnStart=null, sqlConnCfg=null, cliConnCfg=ClientConnectorConfiguration [host=null, port=10800, portRange=100, sockSndBufSize=0, sockRcvBufSize=0, tcpNoDelay=true, maxOpenCursorsPerConn=128, threadPoolSize=24, selectorCnt=12, idleTimeout=0, handshakeTimeout=10000, jdbcEnabled=true, odbcEnabled=true, thinCliEnabled=true, sslEnabled=false, useIgniteSslCtxFactory=true, sslClientAuth=false, sslCtxFactory=null, thinCliCfg=ThinClientConfiguration [maxActiveTxPerConn=100, maxActiveComputeTasksPerConn=0]], mvccVacuumThreadCnt=2, mvccVacuumFreq=5000, authEnabled=false, failureHnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]], commFailureRslvr=null, sqlCfg=SqlConfiguration [longQryWarnTimeout=3000, dfltQryTimeout=0, sqlQryHistSize=1000, validationEnabled=false], asyncContinuationExecutor=null] [21:03:17] : [Step 4/5] [2021-11-19 21:03:17,418][INFO ][main][root] [GridStringLogger echo] Daemon mode: off [21:03:17] : [Step 4/5] [2021-11-19 21:03:17,418][INFO ][main][root] [GridStringLogger echo] OS: Linux 4.15.0-151-generic amd64 [21:03:17] : [Step 4/5] [2021-11-19 21:03:17,418][INFO ][main][root] [GridStringLogger echo] OS user: teamcity [21:03:17] : [Step 4/5] [2021-11-19 21:03:17,418][INFO ][main][root] [GridStringLogger echo] PID: 16724 [21:03:17] : [Step 4/5] [2021-11-19 21:03:17,419][INFO ][main][root] [GridStringLogger echo] Language runtime: Java Platform API Specification ver. 1.8 [21:03:17] : [Step 4/5] [2021-11-19 21:03:17,419][INFO ][main][root] [GridStringLogger echo] VM information: Java(TM) SE Runtime Environment 1.8.0_261-b12 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 25.261-b12 [21:03:17] : [Step 4/5] [2021-11-19 21:03:17,419][INFO ][main][root] [GridStringLogger echo] VM total memory: 1.9GB [21:03:17] : [Step 4/5] [2021-11-19 21:03:17,419][INFO ][main][root] [GridStringLogger echo] Remote Management [restart: off, REST: off, JMX (remote: off)] [21:03:17] : [Step 4/5] [2021-11-19 21:03:17,420][INFO ][main][root] [GridStringLogger echo] Logger: Ignite work directory is not provided, automatically resolved to: /opt/buildagent/work/7bc1c54bc719b67c/work [21:03:17] : [Step 4/5] Consistent ID is not set, it is recommended to set consistent ID for production clusters (use IgniteConfiguration.setConsistentId property) [21:03:17] : [Step 4/5] [21:03:17] : [Step 4/5] [21:03:17] : [Step 4/5] >>> __________ ________________ [21:03:17] : [Step 4/5] >>> / _/ ___/ |/ / _/_ __/ __/ [21:03:17] : [Step 4/5] >>> _/ // (7 7 // / / / / _/ [21:03:17] : [Step 4/5] >>> /___/\___/_/|_/___/ /_/ /___/ [21:03:17] : [Step 4/5] >>> [21:03:17] : [Step 4/5] >>> ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:03:17] : [Step 4/5] >>> 2021 Copyright(C) Apache Software Foundation [21:03:17] : [Step 4/5] >>> [21:03:17] : [Step 4/5] >>> Ignite documentation: http://ignite.apache.org [21:03:17] : [Step 4/5] [21:03:17] : [Step 4/5] Config URL: n/a [21:03:17] : [Step 4/5] IgniteConfiguration [igniteInstanceName=internal.GridNodeMetricsLogPdsSelfTest0, pubPoolSize=24, svcPoolSize=24, callbackPoolSize=24, stripedPoolSize=24, sysPoolSize=24, mgmtPoolSize=4, dataStreamerPoolSize=24, utilityCachePoolSize=24, utilityCacheKeepAliveTime=60000, p2pPoolSize=2, qryPoolSize=24, buildIdxPoolSize=4, igniteHome=/opt/buildagent/work/7bc1c54bc719b67c, igniteWorkDir=/opt/buildagent/work/7bc1c54bc719b67c/work, mbeanSrv=com.sun.jmx.mbeanserver.JmxMBeanServer@6fe85038, nodeId=5a320cff-6ba1-49d0-81a3-7e0c09e00000, marsh=BinaryMarshaller [], marshLocJobs=false, daemon=false, p2pEnabled=true, netTimeout=10000, netCompressionLevel=1, sndRetryDelay=1000, sndRetryCnt=3, metricsHistSize=10000, metricsUpdateFreq=1000, metricsExpTime=9223372036854775807, discoSpi=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=0, ackTimeout=0, marsh=null, reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], segPlc=STOP, segResolveAttempts=2, waitForSegOnStart=true, allResolversPassReq=true, segChkFreq=10000, commSpi=TcpCommunicationSpi [connectGate=org.apache.ignite.spi.communication.tcp.internal.ConnectGateway@795f5d51, ctxInitLatch=java.util.concurrent.CountDownLatch@34aeacd1[Count = 1], stopping=false, clientPool=null, nioSrvWrapper=null, stateProvider=null], evtSpi=MemoryEventStorageSpi [expireAgeMs=9223372036854775807, expireCnt=10000, filter=null], colSpi=NoopCollisionSpi [], deploySpi=LocalDeploymentSpi [], indexingSpi=org.apache.ignite.spi.indexing.noop.NoopIndexingSpi@2274160, addrRslvr=null, encryptionSpi=org.apache.ignite.spi.encryption.noop.NoopEncryptionSpi@65383667, tracingSpi=org.apache.ignite.spi.tracing.NoopTracingSpi@63cd2cd2, clientMode=false, rebalanceThreadPoolSize=4, rebalanceTimeout=10000, rebalanceBatchesPrefetchCnt=3, rebalanceThrottle=0, rebalanceBatchSize=524288, txCfg=TransactionConfiguration [txSerEnabled=false, dfltIsolation=REPEATABLE_READ, dfltConcurrency=PESSIMISTIC, dfltTxTimeout=0, txTimeoutOnPartitionMapExchange=0, deadlockTimeout=10000, pessimisticTxLogSize=0, pessimisticTxLogLinger=10000, tmLookupClsName=null, txManagerFactory=null, useJtaSync=false], cacheSanityCheckEnabled=true, discoStartupDelay=60000, deployMode=SHARED, p2pMissedCacheSize=100, locHost=127.0.0.1, timeSrvPortBase=31100, timeSrvPortRange=100, failureDetectionTimeout=10000, sysWorkerBlockedTimeout=null, clientFailureDetectionTimeout=10000, metricsLogFreq=1000, connectorCfg=null, odbcCfg=null, warmupClos=null, atomicCfg=AtomicConfiguration [seqReserveSize=1000, cacheMode=PARTITIONED, backups=1, aff=null, grpName=null], classLdr=null, sslCtxFactory=null, platformCfg=null, binaryCfg=null, memCfg=null, pstCfg=null, dsCfg=DataStorageConfiguration [sysRegionInitSize=41943040, sysRegionMaxSize=104857600, pageSize=0, concLvl=0, dfltDataRegConf=DataRegionConfiguration [name=default, maxSize=31457280, initSize=268435456, swapPath=null, pageEvictionMode=DISABLED, pageReplacementMode=CLOCK, evictionThreshold=0.9, emptyPagesPoolSize=100, metricsEnabled=false, metricsSubIntervalCount=5, metricsRateTimeInterval=60000, persistenceEnabled=true, checkpointPageBufSize=0, lazyMemoryAllocation=true, warmUpCfg=null], dataRegions=DataRegionConfiguration[] [DataRegionConfiguration [name=userTransientDataRegion, maxSize=20971520, initSize=268435456, swapPath=null, pageEvictionMode=DISABLED, pageReplacementMode=CLOCK, evictionThreshold=0.9, emptyPagesPoolSize=100, metricsEnabled=false, metricsSubIntervalCount=5, metricsRateTimeInterval=60000, persistenceEnabled=false, checkpointPageBufSize=0, lazyMemoryAllocation=true, warmUpCfg=null]], storagePath=null, checkpointFreq=180000, lockWaitTime=10000, checkpointThreads=4, checkpointWriteOrder=SEQUENTIAL, walHistSize=20, maxWalArchiveSize=1073741824, walSegments=10, walSegmentSize=67108864, walPath=db/wal, walArchivePath=db/wal/archive, cdcWalPath=db/wal/cdc, cdcEnabled=false, metricsEnabled=false, walMode=LOG_ONLY, walTlbSize=131072, walBuffSize=0, walFlushFreq=2000, walFsyncDelay=1000, walRecordIterBuffSize=67108864, alwaysWriteFullPages=false, fileIOFactory=org.apache.ignite.internal.processors.cache.persistence.file.AsyncFileIOFactory@3c79088e, metricsSubIntervalCnt=5, metricsRateTimeInterval=60000, walAutoArchiveAfterInactivity=-1, walForceArchiveTimeout=-1, writeThrottlingEnabled=false, walCompactionEnabled=false, walCompactionLevel=1, checkpointReadLockTimeout=null, walPageCompression=DISABLED, walPageCompressionLevel=null, dfltWarmUpCfg=null, encCfg=org.apache.ignite.configuration.EncryptionConfiguration@4a37191a, defragmentationThreadPoolSize=4, minWalArchiveSize=-1], snapshotPath=snapshots, activeOnStart=true, activeOnStartPropSetFlag=false, autoActivation=true, autoActivationPropSetFlag=false, clusterStateOnStart=null, sqlConnCfg=null, cliConnCfg=ClientConnectorConfiguration [host=null, port=10800, portRange=100, sockSndBufSize=0, sockRcvBufSize=0, tcpNoDelay=true, maxOpenCursorsPerConn=128, threadPoolSize=24, selectorCnt=12, idleTimeout=0, handshakeTimeout=10000, jdbcEnabled=true, odbcEnabled=true, thinCliEnabled=true, sslEnabled=false, useIgniteSslCtxFactory=true, sslClientAuth=false, sslCtxFactory=null, thinCliCfg=ThinClientConfiguration [maxActiveTxPerConn=100, maxActiveComputeTasksPerConn=0]], mvccVacuumThreadCnt=2, mvccVacuumFreq=5000, authEnabled=false, failureHnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]], commFailureRslvr=null, sqlCfg=SqlConfiguration [longQryWarnTimeout=3000, dfltQryTimeout=0, sqlQryHistSize=1000, validationEnabled=false], asyncContinuationExecutor=null] [21:03:17] : [Step 4/5] Daemon mode: off [21:03:17] : [Step 4/5] OS: Linux 4.15.0-151-generic amd64 [21:03:17] : [Step 4/5] OS user: teamcity [21:03:17] : [Step 4/5] PID: 16724 [21:03:17] : [Step 4/5] Language runtime: Java Platform API Specification ver. 1.8 [21:03:17] : [Step 4/5] VM information: Java(TM) SE Runtime Environment 1.8.0_261-b12 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 25.261-b12 [21:03:17] : [Step 4/5] VM total memory: 1.9GB [21:03:17] : [Step 4/5] Remote Management [restart: off, REST: off, JMX (remote: off)] [21:03:17] : [Step 4/5] [21:03:17] : [Step 4/5] [2021-11-19 21:03:17,431][INFO ][main][root] [GridStringLogger echo] IGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c [21:03:17] : [Step 4/5] [2021-11-19 21:03:17,431][INFO ][main][root] [GridStringLogger echo] VM arguments: [-DIGNITE_DUMP_THREADS_ON_FAILURE=false, -DMono=/usr/bin/mono-sgen, -DMono4.0_x64=/usr/lib/mono/4.0, -DMono4.5_x64=/usr/lib/mono/4.5, -DMonoVersion=6.12.0.90, -DSKIP_BUILD=false, -Dagent.home.dir=/opt/buildagent, -Dagent.name=aitc-lin02_03, -Dagent.ownPort=9090, -Dagent.work.dir=/opt/buildagent/work, -Dbuild.number=95, -Dbuild.vcs.number=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.1=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.GitHubApacheIgnite=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dclassworlds.conf=/opt/buildagent/temp/buildTmp/teamcity.m2.conf, -Dcom.jetbrains.maven.watcher.report.file=/opt/buildagent/temp/buildTmp/maven-build-info.xml, -Djava.io.tmpdir=/opt/buildagent/temp/buildTmp, -Dmaven.home=/opt/buildagent/tools/maven3_6, -Dmaven.multiModuleProjectDirectory=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.agent.cpuBenchmark=457, -Dteamcity.agent.dotnet.agent_url=http://localhost:9090/RPC2, -Dteamcity.agent.dotnet.build_id=6278078, -Dteamcity.auth.password=*******, -Dteamcity.auth.userId=TeamCityBuildId=6278078, -Dteamcity.build.changedFiles.file=/opt/buildagent/temp/buildTmp/changedFiles6342607772318147725.txt, -Dteamcity.build.checkoutDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.build.id=6278078, -Dteamcity.build.properties.file=/opt/buildagent/temp/buildTmp/teamcity.build5164517880467851002.properties, -Dteamcity.build.tempDir=/opt/buildagent/temp/buildTmp, -Dteamcity.build.workingDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.buildConfName=Basic 3, -Dteamcity.buildType.id=IgniteTests24Java8_Basic3, -Dteamcity.configuration.properties.file=/opt/buildagent/temp/buildTmp/teamcity.config5591980786735343870.properties, -Dteamcity.maven.userSettings.path=/opt/buildagent/temp/buildTmp/maven_settings_585072866407032347.xml, -Dteamcity.maven.watcher.home=/opt/buildagent/plugins/mavenPlugin/maven-watcher-jdk16, -Dteamcity.projectName=Ignite Tests 2.x (JDK 8/11), -Dteamcity.runner.properties.file=/opt/buildagent/temp/buildTmp/teamcity.runner9098465561618137420.properties, -Dteamcity.tests.recentlyFailedTests.file=/opt/buildagent/temp/buildTmp/testsToRunFirst3891775683130404069.txt, -Dteamcity.version=2021.2 (build 99542), -ea, -Xms2g, -Xmx2g, -XX:+HeapDumpOnOutOfMemoryError, -DIGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_TEST_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_UPDATE_NOTIFIER=false, -DIGNITE_NO_DISCO_ORDER=true, -DIGNITE_PERFORMANCE_SUGGESTIONS_DISABLED=true, -Djava.net.preferIPv4Stack=true, -DTEST_SCALE_FACTOR=1.0, -DIGNITE_TEST_PROP_LOG4J_FILE=log4j-tc-test.xml, -DIGNITE_QUIET=false, -DIGNITE_MARSHAL_BUFFERS_RECHECK=1000, -Dmaven.repo.local=/opt/buildagent/.m2/repository] [21:03:17] : [Step 4/5] [2021-11-19 21:03:17,436][INFO ][main][root] [GridStringLogger echo] System cache's DataRegion size is configured to 40 MB. Use DataStorageConfiguration.systemRegionInitialSize property to change the setting. [21:03:17] : [Step 4/5] [2021-11-19 21:03:17,436][INFO ][main][root] [GridStringLogger echo] Configured caches [in 'sysMemPlc' dataRegion: ['ignite-sys-cache']] [21:03:17] : [Step 4/5] [2021-11-19 21:03:17,437][INFO ][main][root] [GridStringLogger echo] Peer class loading is enabled (disable it in production for performance and deployment consistency reasons) [21:03:17] : [Step 4/5] [2021-11-19 21:03:17,437][INFO ][main][root] [GridStringLogger echo] 3-rd party licenses can be found at: /opt/buildagent/work/7bc1c54bc719b67c/libs/licenses [21:03:17] : [Step 4/5] [2021-11-19 21:03:17,441][INFO ][main][root] [GridStringLogger echo] Configured plugins: [21:03:17] : [Step 4/5] [2021-11-19 21:03:17,442][INFO ][main][root] [GridStringLogger echo] ^-- StanByClusterTestProvider 1.0 [21:03:17] : [Step 4/5] [2021-11-19 21:03:17,442][INFO ][main][root] [GridStringLogger echo] ^-- null [21:03:17] : [Step 4/5] [2021-11-19 21:03:17,442][INFO ][main][root] [GridStringLogger echo] [21:03:17] : [Step 4/5] [2021-11-19 21:03:17,442][INFO ][main][root] [GridStringLogger echo] ^-- PageMemory tracker plugin 1.0 [21:03:17] : [Step 4/5] [2021-11-19 21:03:17,442][INFO ][main][root] [GridStringLogger echo] ^-- null [21:03:17] : [Step 4/5] [2021-11-19 21:03:17,443][INFO ][main][root] [GridStringLogger echo] [21:03:17] : [Step 4/5] [2021-11-19 21:03:17,443][INFO ][main][root] [GridStringLogger echo] ^-- TestDistibutedConfigurationPlugin 1.0 [21:03:17] : [Step 4/5] [2021-11-19 21:03:17,443][INFO ][main][root] [GridStringLogger echo] ^-- null [21:03:17] : [Step 4/5] [2021-11-19 21:03:17,443][INFO ][main][root] [GridStringLogger echo] [21:03:17] : [Step 4/5] [2021-11-19 21:03:17,443][INFO ][main][root] [GridStringLogger echo] ^-- NodeValidationPluginProvider 1.0 [21:03:17] : [Step 4/5] [2021-11-19 21:03:17,444][INFO ][main][root] [GridStringLogger echo] ^-- null [21:03:17] : [Step 4/5] [2021-11-19 21:03:17,444][INFO ][main][root] [GridStringLogger echo] [21:03:17] : [Step 4/5] [2021-11-19 21:03:17,444][INFO ][main][root] [GridStringLogger echo] Configured failure handler: [hnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]]] [21:03:17] : [Step 4/5] [2021-11-19 21:03:17,472][INFO ][main][root] [GridStringLogger echo] Successfully bound communication NIO server to TCP port [port=45100, locHost=/127.0.0.1, selectorsCnt=12, selectorSpins=0, pairedConn=false] [21:03:17] : [Step 4/5] [2021-11-19 21:03:17,472][INFO ][main][root] [GridStringLogger echo] Message queue limit is set to 0 which may lead to potential OOMEs when running cache operations in FULL_ASYNC or PRIMARY_SYNC modes due to message queues growth on sender and receiver sides. [21:03:17] : [Step 4/5] [2021-11-19 21:03:17,482][INFO ][main][root] [GridStringLogger echo] Collision resolution is disabled (all jobs will be activated upon arrival). [21:03:17] : [Step 4/5] [2021-11-19 21:03:17,482][INFO ][main][root] [GridStringLogger echo] Security status [authentication=off, sandbox=off, tls/ssl=off] [21:03:17] : [Step 4/5] [2021-11-19 21:03:17,483][INFO ][main][root] [GridStringLogger echo] Successfully bound to TCP port [port=47500, localHost=localhost/127.0.0.1, locNodeId=5a320cff-6ba1-49d0-81a3-7e0c09e00000] [21:03:17] : [Step 4/5] [2021-11-19 21:03:17,494][INFO ][main][root] [GridStringLogger echo] Successfully created new persistent storage folder [/opt/buildagent/work/7bc1c54bc719b67c/work/db/node00-2fadaaf7-63e4-4de5-9a38-471957431855] [21:03:17] : [Step 4/5] [2021-11-19 21:03:17,495][INFO ][main][root] [GridStringLogger echo] Consistent ID used for local node is [2fadaaf7-63e4-4de5-9a38-471957431855] according to persistence data storage folders [21:03:17] : [Step 4/5] [2021-11-19 21:03:17,495][INFO ][main][root] [GridStringLogger echo] Resolved store directory for node persistent data: /opt/buildagent/work/7bc1c54bc719b67c/work/db/node00-2fadaaf7-63e4-4de5-9a38-471957431855 [21:03:17] : [Step 4/5] [2021-11-19 21:03:17,497][INFO ][main][root] [GridStringLogger echo] Resolved directory for serialized binary metadata: /opt/buildagent/work/7bc1c54bc719b67c/work/db/binary_meta/node00-2fadaaf7-63e4-4de5-9a38-471957431855 [21:03:17] : [Step 4/5] [2021-11-19 21:03:17,505][INFO ][main][root] [GridStringLogger echo] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/node00-2fadaaf7-63e4-4de5-9a38-471957431855 [21:03:17] : [Step 4/5] [2021-11-19 21:03:17,506][INFO ][main][root] [GridStringLogger echo] Resolved write ahead log work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/node00-2fadaaf7-63e4-4de5-9a38-471957431855 [21:03:17] : [Step 4/5] [2021-11-19 21:03:17,507][INFO ][main][root] [GridStringLogger echo] Resolved write ahead log archive directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/node00-2fadaaf7-63e4-4de5-9a38-471957431855 [21:03:17] : [Step 4/5] Surefire report watcher [21:03:17] : [Surefire report watcher] Watching paths: [21:03:17] : [Surefire report watcher] /opt/buildagent/temp/buildTmp/ignite-tools-junit-reports1777670380320881607/test-org.apache.ignite.testsuites.IgniteBasicWithPersistenceTestSuite1637344988366.xml [21:03:17]i: [Step 4/5] org.apache.ignite.testsuites.IgniteBasicWithPersistenceTestSuite [21:03:17]i: [org.apache.ignite.testsuites.IgniteBasicWithPersistenceTestSuite] org.apache.ignite.util.GridInternalTaskUnusedWalSegmentsTest.testCorrectnessOfDeletionTaskSegments [21:03:17] : [Step 4/5] [2021-11-19 21:03:17,876][INFO ][main][root] [GridStringLogger echo] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/node00-2fadaaf7-63e4-4de5-9a38-471957431855/0000000000000000.wal [21:03:17] : [Step 4/5] [2021-11-19 21:03:17,876][INFO ][main][root] [GridStringLogger echo] Initialized write-ahead log manager [mode=LOG_ONLY] [21:03:17] : [Step 4/5] [2021-11-19 21:03:17,877][INFO ][main][root] [GridStringLogger echo] DataRegion maxSize=21.0 MB is smaller than defaultInitialSize=268.4 MB, setting initialSize to 21.0 MB [21:03:17] : [Step 4/5] [2021-11-19 21:03:17,877][INFO ][main][root] [GridStringLogger echo] DataRegion maxSize=31.5 MB is smaller than defaultInitialSize=268.4 MB, setting initialSize to 31.5 MB [21:03:17] : [Step 4/5] [2021-11-19 21:03:17,882][INFO ][main][root] [GridStringLogger echo] Configured data regions initialized successfully [total=6] [21:03:17] : [Step 4/5] [2021-11-19 21:03:17,883][INFO ][main][root] [GridStringLogger echo] Resolved snapshot work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/snapshots [21:03:17] : [Step 4/5] [2021-11-19 21:03:17,883][INFO ][main][root] [GridStringLogger echo] Resolved temp directory for snapshot creation: /opt/buildagent/work/7bc1c54bc719b67c/work/db/node00-2fadaaf7-63e4-4de5-9a38-471957431855/snp [21:03:17] : [Step 4/5] [2021-11-19 21:03:17,887][INFO ][main][root] [GridStringLogger echo] Client connector processor has started on TCP port 10800 [21:03:17] : [Step 4/5] [2021-11-19 21:03:17,893][INFO ][main][root] [GridStringLogger echo] Non-loopback local IPs: 172.17.0.4 [21:03:17] : [Step 4/5] [2021-11-19 21:03:17,893][INFO ][main][root] [GridStringLogger echo] Enabled local MACs: 0242AC110004 [21:03:17] : [Step 4/5] [2021-11-19 21:03:17,896][INFO ][main][root] [GridStringLogger echo] Read checkpoint status [startMarker=null, endMarker=null] [21:03:17] : [Step 4/5] [2021-11-19 21:03:17,897][INFO ][main][root] [GridStringLogger echo] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:03:17] : [Step 4/5] [2021-11-19 21:03:17,897][INFO ][main][root] [GridStringLogger echo] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:03:17] : [Step 4/5] [2021-11-19 21:03:17,899][INFO ][main][root] [GridStringLogger echo] Applying lost metastore updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:03:17] : [Step 4/5] [2021-11-19 21:03:17,900][INFO ][main][root] [GridStringLogger echo] Finished applying WAL changes [updatesApplied=0, time=0 ms] [21:03:17] : [Step 4/5] [2021-11-19 21:03:17,900][INFO ][main][root] [GridStringLogger echo] Restoring partition state for local groups. [21:03:17] : [Step 4/5] [2021-11-19 21:03:17,900][INFO ][main][root] [GridStringLogger echo] Finished restoring partition state for local groups [groupsProcessed=0, partitionsProcessed=0, time=0ms] [21:03:17] : [Step 4/5] [2021-11-19 21:03:17,901][INFO ][main][root] [GridStringLogger echo] Encryption keys loaded from metastore. [grps=, masterKeyName=null] [21:03:17] : [Step 4/5] [2021-11-19 21:03:17,906][INFO ][main][root] [GridStringLogger echo] Cluster ID and tag has been read from metastorage: null [21:03:17] : [Step 4/5] [2021-11-19 21:03:17,906][INFO ][main][root] [GridStringLogger echo] Shutdown policy was updated [oldVal=null, newVal=null] [21:03:17] : [Step 4/5] [2021-11-19 21:03:17,906][INFO ][main][root] [GridStringLogger echo] Checkpoint frequency deviation changed [oldVal=null, newVal=null] [21:03:17] : [Step 4/5] [2021-11-19 21:03:17,916][INFO ][main][root] [GridStringLogger echo] Cleanup cache stores [total=1, left=0, cleanFiles=false] [21:03:17] : [Step 4/5] [2021-11-19 21:03:17,919][INFO ][main][root] [GridStringLogger echo] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:03:17] : [Step 4/5] [2021-11-19 21:03:17,919][INFO ][main][root] [GridStringLogger echo] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:03:17] : [Step 4/5] [2021-11-19 21:03:17,920][INFO ][main][root] [GridStringLogger echo] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:03:17] : [Step 4/5] [2021-11-19 21:03:17,921][INFO ][main][root] [GridStringLogger echo] Data Regions Started: 6 [21:03:17] : [Step 4/5] [2021-11-19 21:03:17,921][INFO ][main][root] [GridStringLogger echo] ^-- sysMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:03:17] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:03:17] : [Step 4/5] ^-- default region [type=default, persistence=true, lazyAlloc=true, [21:03:17] : [Step 4/5] ... initCfg=30MB, maxCfg=30MB, usedRam=0MB, freeRam=100%, allocRam=0MB, allocTotal=0MB] [21:03:17] : [Step 4/5] ^-- metastoreMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:03:17] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:03:17] : [Step 4/5] ^-- TxLog region [type=internal, persistence=true, lazyAlloc=false, [21:03:17] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:03:17] : [Step 4/5] ^-- volatileDsMemPlc region [type=user, persistence=false, lazyAlloc=true, [21:03:17] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB] [21:03:17] : [Step 4/5] ^-- userTransientDataRegion region [type=user, persistence=false, lazyAlloc=true, [21:03:17] : [Step 4/5] ... initCfg=20MB, maxCfg=20MB, usedRam=0MB, freeRam=100%, allocRam=0MB] [21:03:17] : [Step 4/5] ^-- Ignite persistence [used=0MB] [21:03:17] : [Step 4/5] [21:03:17] : [Step 4/5] [2021-11-19 21:03:17,922][INFO ][main][root] [GridStringLogger echo] Starting binary memory restore for: [-2100569601] [21:03:17] : [Step 4/5] [2021-11-19 21:03:17,932][INFO ][main][root] [GridStringLogger echo] Read checkpoint status [startMarker=null, endMarker=null] [21:03:17] : [Step 4/5] [2021-11-19 21:03:17,932][INFO ][main][root] [GridStringLogger echo] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:03:17] : [Step 4/5] [2021-11-19 21:03:17,936][INFO ][main][root] [GridStringLogger echo] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/node00-2fadaaf7-63e4-4de5-9a38-471957431855/0000000000000000.wal, offset=0, ver=2] [21:03:17] : [Step 4/5] [2021-11-19 21:03:17,939][INFO ][main][root] [GridStringLogger echo] Started cache in recovery mode [name=ignite-sys-cache, id=-2100569601, dataRegionName=sysMemPlc, mode=REPLICATED, atomicity=TRANSACTIONAL, backups=2147483647, mvcc=false] [21:03:17] : [Step 4/5] [2021-11-19 21:03:17,940][INFO ][main][root] [GridStringLogger echo] Binary recovery performed in 18 ms. [21:03:17] : [Step 4/5] [2021-11-19 21:03:17,941][INFO ][main][root] [GridStringLogger echo] Read checkpoint status [startMarker=null, endMarker=null] [21:03:17] : [Step 4/5] [2021-11-19 21:03:17,941][INFO ][main][root] [GridStringLogger echo] Applying lost cache updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:03:18] : [Step 4/5] [2021-11-19 21:03:18,003][INFO ][main][root] [GridStringLogger echo] Finished applying WAL changes [updatesApplied=0, time=60 ms] [21:03:18] : [Step 4/5] [2021-11-19 21:03:18,004][INFO ][main][root] [GridStringLogger echo] Restoring partition state for local groups. [21:03:18] : [Step 4/5] [2021-11-19 21:03:18,016][INFO ][main][root] [GridStringLogger echo] Finished restoring partition state for local groups [groupsProcessed=1, partitionsProcessed=100, time=10ms] [21:03:18] : [Step 4/5] [2021-11-19 21:03:18,315][INFO ][disco-notifier-worker-#5108%internal.GridNodeMetricsLogPdsSelfTest0%][root] [GridStringLogger echo] Assigned mvcc coordinator [crd=MvccCoordinator [topVer=AffinityTopologyVersion [topVer=1, minorTopVer=0], nodeId=5a320cff-6ba1-49d0-81a3-7e0c09e00000, ver=1637344998310, local=true, initialized=false]] [21:03:18] : [Step 4/5] [2021-11-19 21:03:18,318][INFO ][sys-#5090%internal.GridNodeMetricsLogPdsSelfTest0%][root] [GridStringLogger echo] Writing cluster ID and tag to metastorage on ready for write ClusterIdAndTag [id=c2c4b664-065f-44c4-9c8b-5982a73ca684, tag=youthful_chatelet] [21:03:18] : [Step 4/5] [2021-11-19 21:03:18,323][INFO ][disco-notifier-worker-#5108%internal.GridNodeMetricsLogPdsSelfTest0%][root] [GridStringLogger echo] youthful_chatelet [21:03:18] : [Step 4/5] [2021-11-19 21:03:18,324][INFO ][disco-notifier-worker-#5108%internal.GridNodeMetricsLogPdsSelfTest0%][root] [GridStringLogger echo] Baseline parameter 'baselineAutoAdjustEnabled' was changed from 'null' to 'false' [21:03:18] : [Step 4/5] [2021-11-19 21:03:18,325][INFO ][disco-notifier-worker-#5108%internal.GridNodeMetricsLogPdsSelfTest0%][root] [GridStringLogger echo] Baseline parameter 'baselineAutoAdjustTimeout' was changed from 'null' to '300000' [21:03:18] : [Step 4/5] [2021-11-19 21:03:18,326][INFO ][disco-notifier-worker-#5108%internal.GridNodeMetricsLogPdsSelfTest0%][root] [GridStringLogger echo] Transactions parameter 'longOperationsDumpTimeout' was changed from 'null' to '60000' [21:03:18] : [Step 4/5] [2021-11-19 21:03:18,327][INFO ][disco-notifier-worker-#5108%internal.GridNodeMetricsLogPdsSelfTest0%][root] [GridStringLogger echo] Transactions parameter 'longTransactionTimeDumpThreshold' was changed from 'null' to '0' [21:03:18] : [Step 4/5] [2021-11-19 21:03:18,327][INFO ][disco-notifier-worker-#5108%internal.GridNodeMetricsLogPdsSelfTest0%][root] [GridStringLogger echo] Transactions parameter 'transactionTimeDumpSamplesCoefficient' was changed from 'null' to '0.0' [21:03:18] : [Step 4/5] [2021-11-19 21:03:18,328][INFO ][disco-notifier-worker-#5108%internal.GridNodeMetricsLogPdsSelfTest0%][root] [GridStringLogger echo] Transactions parameter 'longTransactionTimeDumpSamplesPerSecondLimit' was changed from 'null' to '5' [21:03:18] : [Step 4/5] [2021-11-19 21:03:18,329][INFO ][disco-notifier-worker-#5108%internal.GridNodeMetricsLogPdsSelfTest0%][root] [GridStringLogger echo] Transactions parameter 'collisionsDumpInterval' was changed from 'null' to '1000' [21:03:18] : [Step 4/5] [2021-11-19 21:03:18,330][INFO ][disco-notifier-worker-#5108%internal.GridNodeMetricsLogPdsSelfTest0%][root] [GridStringLogger echo] Transactions parameter 'txOwnerDumpRequestsAllowed' was changed from 'null' to 'true' [21:03:18] : [Step 4/5] [2021-11-19 21:03:18,331][INFO ][disco-notifier-worker-#5108%internal.GridNodeMetricsLogPdsSelfTest0%][root] [GridStringLogger echo] Historical rebalance WAL threshold changed [property=historical.rebalance.threshold, oldVal=null, newVal=500] [21:03:18] : [Step 4/5] [2021-11-19 21:03:18,340][INFO ][main][root] [GridStringLogger echo] To start Console Management & Monitoring run ignitevisorcmd.{sh|bat} [21:03:18] : [Step 4/5] [2021-11-19 21:03:18,340][INFO ][main][root] [GridStringLogger echo] [21:03:18] : [Step 4/5] [21:03:18] : [Step 4/5] >>> +-------------------------------------------+ [21:03:18] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:03:18] : [Step 4/5] >>> +-------------------------------------------+ [21:03:18] : [Step 4/5] >>> OS name: Linux 4.15.0-151-generic amd64 [21:03:18] : [Step 4/5] >>> CPU(s): 24 [21:03:18] : [Step 4/5] >>> Heap: 2.0GB [21:03:18] : [Step 4/5] >>> VM name: 16724@c4dfe9a430b2 [21:03:18] : [Step 4/5] >>> Ignite instance name: internal.GridNodeMetricsLogPdsSelfTest0 [21:03:18] : [Step 4/5] >>> Local node [ID=5A320CFF-6BA1-49D0-81A3-7E0C09E00000, order=1, clientMode=false] [21:03:18] : [Step 4/5] >>> Local node addresses: [127.0.0.1] [21:03:18] : [Step 4/5] >>> Local ports: TCP:10800 TCP:45100 TCP:47500 [21:03:18] : [Step 4/5] [21:03:18] : [Step 4/5] [2021-11-19 21:03:18,341][INFO ][main][root] [GridStringLogger echo] >>> Ignite cluster is in INACTIVE state (limited functionality available). Use control.(sh|bat) script or IgniteCluster.state(ClusterState.ACTIVE) to change the state. [21:03:18] : [Step 4/5] [2021-11-19 21:03:18,342][INFO ][main][root] [GridStringLogger echo] Topology snapshot [ver=1, locNode=5a320cff, servers=1, clients=0, state=INACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=5a320cff-6ba1-49d0-81a3-7e0c09e00000, consistentId=2fadaaf7-63e4-4de5-9a38-471957431855, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:03:18] : [Step 4/5] [2021-11-19 21:03:18,342][INFO ][main][root] [GridStringLogger echo] Node started : [stage="Configure system pool" (0 ms),stage="Start managers" (92 ms),stage="Configure binary metadata" (4 ms),stage="Start processors" (390 ms),stage="Start 'StanByClusterTestProvider' plugin" (0 ms),stage="Start 'PageMemory tracker plugin' plugin" (0 ms),stage="Start 'TestDistibutedConfigurationPlugin' plugin" (0 ms),stage="Start 'NodeValidationPluginProvider' plugin" (0 ms),stage="Init metastore" (24 ms),stage="Init and start regions" (5 ms),stage="Restore binary memory" (18 ms),stage="Restore logical state" (75 ms),stage="Finish recovery" (285 ms),stage="Join topology" (12 ms),stage="Await transition" (4 ms),stage="Await exchange" (22 ms),stage="Total time" (931 ms)] [21:03:18] : [Step 4/5] [2021-11-19 21:03:18,344][INFO ][main][root] Node started with the following configuration [id=5a320cff-6ba1-49d0-81a3-7e0c09e00000, marshaller=BinaryMarshaller [], discovery=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=5000, ackTimeout=5000, marsh=JdkMarshaller [clsFilter=org.apache.ignite.marshaller.MarshallerUtils$1@2d55e826], reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], binaryCfg=null, lateAff=true] [21:03:18] : [Step 4/5] [2021-11-19 21:03:18,350][INFO ][main][root] [GridStringLogger echo] Ignite work directory is not provided, automatically resolved to: /opt/buildagent/work/7bc1c54bc719b67c/work [21:03:18] : [Step 4/5] [2021-11-19 21:03:18,351][INFO ][main][root] [GridStringLogger echo] Consistent ID is not set, it is recommended to set consistent ID for production clusters (use IgniteConfiguration.setConsistentId property) [21:03:18] : [Step 4/5] [2021-11-19 21:03:18,352][INFO ][main][root] [GridStringLogger echo] [21:03:18] : [Step 4/5] [21:03:18] : [Step 4/5] >>> __________ ________________ [21:03:18] : [Step 4/5] >>> / _/ ___/ |/ / _/_ __/ __/ [21:03:18] : [Step 4/5] >>> _/ // (7 7 // / / / / _/ [21:03:18] : [Step 4/5] >>> /___/\___/_/|_/___/ /_/ /___/ [21:03:18] : [Step 4/5] >>> [21:03:18] : [Step 4/5] >>> ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:03:18] : [Step 4/5] >>> 2021 Copyright(C) Apache Software Foundation [21:03:18] : [Step 4/5] >>> [21:03:18] : [Step 4/5] >>> Ignite documentation: http://ignite.apache.org [21:03:18] : [Step 4/5] [21:03:18] : [Step 4/5] [2021-11-19 21:03:18,353][INFO ][main][root] [GridStringLogger echo] Config URL: n/a [21:03:18] : [Step 4/5] [2021-11-19 21:03:18,353][INFO ][main][root] [GridStringLogger echo] IgniteConfiguration [igniteInstanceName=internal.GridNodeMetricsLogPdsSelfTest1, pubPoolSize=24, svcPoolSize=24, callbackPoolSize=24, stripedPoolSize=24, sysPoolSize=24, mgmtPoolSize=4, dataStreamerPoolSize=24, utilityCachePoolSize=24, utilityCacheKeepAliveTime=60000, p2pPoolSize=2, qryPoolSize=24, buildIdxPoolSize=4, igniteHome=/opt/buildagent/work/7bc1c54bc719b67c, igniteWorkDir=/opt/buildagent/work/7bc1c54bc719b67c/work, mbeanSrv=com.sun.jmx.mbeanserver.JmxMBeanServer@6fe85038, nodeId=26a828be-527b-42db-a842-bea7dc000001, marsh=BinaryMarshaller [], marshLocJobs=false, daemon=false, p2pEnabled=true, netTimeout=10000, netCompressionLevel=1, sndRetryDelay=1000, sndRetryCnt=3, metricsHistSize=10000, metricsUpdateFreq=1000, metricsExpTime=9223372036854775807, discoSpi=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=0, ackTimeout=0, marsh=null, reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], segPlc=STOP, segResolveAttempts=2, waitForSegOnStart=true, allResolversPassReq=true, segChkFreq=10000, commSpi=TcpCommunicationSpi [connectGate=org.apache.ignite.spi.communication.tcp.internal.ConnectGateway@4fdca00a, ctxInitLatch=java.util.concurrent.CountDownLatch@513b52af[Count = 1], stopping=false, clientPool=null, nioSrvWrapper=null, stateProvider=null], evtSpi=MemoryEventStorageSpi [expireAgeMs=9223372036854775807, expireCnt=10000, filter=null], colSpi=NoopCollisionSpi [], deploySpi=LocalDeploymentSpi [], indexingSpi=org.apache.ignite.spi.indexing.noop.NoopIndexingSpi@1a3e8e24, addrRslvr=null, encryptionSpi=org.apache.ignite.spi.encryption.noop.NoopEncryptionSpi@4ed4a7e4, tracingSpi=org.apache.ignite.spi.tracing.NoopTracingSpi@1c7350b0, clientMode=false, rebalanceThreadPoolSize=4, rebalanceTimeout=10000, rebalanceBatchesPrefetchCnt=3, rebalanceThrottle=0, rebalanceBatchSize=524288, txCfg=TransactionConfiguration [txSerEnabled=false, dfltIsolation=REPEATABLE_READ, dfltConcurrency=PESSIMISTIC, dfltTxTimeout=0, txTimeoutOnPartitionMapExchange=0, deadlockTimeout=10000, pessimisticTxLogSize=0, pessimisticTxLogLinger=10000, tmLookupClsName=null, txManagerFactory=null, useJtaSync=false], cacheSanityCheckEnabled=true, discoStartupDelay=60000, deployMode=SHARED, p2pMissedCacheSize=100, locHost=127.0.0.1, timeSrvPortBase=31100, timeSrvPortRange=100, failureDetectionTimeout=10000, sysWorkerBlockedTimeout=null, clientFailureDetectionTimeout=10000, metricsLogFreq=1000, connectorCfg=null, odbcCfg=null, warmupClos=null, atomicCfg=AtomicConfiguration [seqReserveSize=1000, cacheMode=PARTITIONED, backups=1, aff=null, grpName=null], classLdr=null, sslCtxFactory=null, platformCfg=null, binaryCfg=null, memCfg=null, pstCfg=null, dsCfg=DataStorageConfiguration [sysRegionInitSize=41943040, sysRegionMaxSize=104857600, pageSize=0, concLvl=0, dfltDataRegConf=DataRegionConfiguration [name=default, maxSize=31457280, initSize=268435456, swapPath=null, pageEvictionMode=DISABLED, pageReplacementMode=CLOCK, evictionThreshold=0.9, emptyPagesPoolSize=100, metricsEnabled=false, metricsSubIntervalCount=5, metricsRateTimeInterval=60000, persistenceEnabled=true, checkpointPageBufSize=0, lazyMemoryAllocation=true, warmUpCfg=null], dataRegions=DataRegionConfiguration[] [DataRegionConfiguration [name=userTransientDataRegion, maxSize=20971520, initSize=268435456, swapPath=null, pageEvictionMode=DISABLED, pageReplacementMode=CLOCK, evictionThreshold=0.9, emptyPagesPoolSize=100, metricsEnabled=false, metricsSubIntervalCount=5, metricsRateTimeInterval=60000, persistenceEnabled=false, checkpointPageBufSize=0, lazyMemoryAllocation=true, warmUpCfg=null]], storagePath=null, checkpointFreq=180000, lockWaitTime=10000, checkpointThreads=4, checkpointWriteOrder=SEQUENTIAL, walHistSize=20, maxWalArchiveSize=1073741824, walSegments=10, walSegmentSize=67108864, walPath=db/wal, walArchivePath=db/wal/archive, cdcWalPath=db/wal/cdc, cdcEnabled=false, metricsEnabled=false, walMode=LOG_ONLY, walTlbSize=131072, walBuffSize=0, walFlushFreq=2000, walFsyncDelay=1000, walRecordIterBuffSize=67108864, alwaysWriteFullPages=false, fileIOFactory=org.apache.ignite.internal.processors.cache.persistence.file.AsyncFileIOFactory@75e09567, metricsSubIntervalCnt=5, metricsRateTimeInterval=60000, walAutoArchiveAfterInactivity=-1, walForceArchiveTimeout=-1, writeThrottlingEnabled=false, walCompactionEnabled=false, walCompactionLevel=1, checkpointReadLockTimeout=null, walPageCompression=DISABLED, walPageCompressionLevel=null, dfltWarmUpCfg=null, encCfg=org.apache.ignite.configuration.EncryptionConfiguration@2a334bac, defragmentationThreadPoolSize=4, minWalArchiveSize=-1], snapshotPath=snapshots, activeOnStart=true, activeOnStartPropSetFlag=false, autoActivation=true, autoActivationPropSetFlag=false, clusterStateOnStart=null, sqlConnCfg=null, cliConnCfg=ClientConnectorConfiguration [host=null, port=10800, portRange=100, sockSndBufSize=0, sockRcvBufSize=0, tcpNoDelay=true, maxOpenCursorsPerConn=128, threadPoolSize=24, selectorCnt=12, idleTimeout=0, handshakeTimeout=10000, jdbcEnabled=true, odbcEnabled=true, thinCliEnabled=true, sslEnabled=false, useIgniteSslCtxFactory=true, sslClientAuth=false, sslCtxFactory=null, thinCliCfg=ThinClientConfiguration [maxActiveTxPerConn=100, maxActiveComputeTasksPerConn=0]], mvccVacuumThreadCnt=2, mvccVacuumFreq=5000, authEnabled=false, failureHnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]], commFailureRslvr=null, sqlCfg=SqlConfiguration [longQryWarnTimeout=3000, dfltQryTimeout=0, sqlQryHistSize=1000, validationEnabled=false], asyncContinuationExecutor=null] [21:03:18] : [Step 4/5] [2021-11-19 21:03:18,363][INFO ][main][root] [GridStringLogger echo] Daemon mode: off [21:03:18] : [Step 4/5] [2021-11-19 21:03:18,363][INFO ][main][root] [GridStringLogger echo] OS: Linux 4.15.0-151-generic amd64 [21:03:18] : [Step 4/5] [2021-11-19 21:03:18,363][INFO ][main][root] [GridStringLogger echo] OS user: teamcity [21:03:18] : [Step 4/5] [2021-11-19 21:03:18,364][INFO ][main][root] [GridStringLogger echo] PID: 16724 [21:03:18] : [Step 4/5] [2021-11-19 21:03:18,364][INFO ][main][root] [GridStringLogger echo] Language runtime: Java Platform API Specification ver. 1.8 [21:03:18] : [Step 4/5] [2021-11-19 21:03:18,364][INFO ][main][root] [GridStringLogger echo] VM information: Java(TM) SE Runtime Environment 1.8.0_261-b12 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 25.261-b12 [21:03:18] : [Step 4/5] [2021-11-19 21:03:18,365][INFO ][main][root] [GridStringLogger echo] VM total memory: 1.9GB [21:03:18] : [Step 4/5] [2021-11-19 21:03:18,365][INFO ][main][root] [GridStringLogger echo] Remote Management [restart: off, REST: off, JMX (remote: off)] [21:03:18] : [Step 4/5] [2021-11-19 21:03:18,365][INFO ][main][root] [GridStringLogger echo] Logger: Ignite work directory is not provided, automatically resolved to: /opt/buildagent/work/7bc1c54bc719b67c/work [21:03:18] : [Step 4/5] Consistent ID is not set, it is recommended to set consistent ID for production clusters (use IgniteConfiguration.setConsistentId property) [21:03:18] : [Step 4/5] [21:03:18] : [Step 4/5] [21:03:18] : [Step 4/5] >>> __________ ________________ [21:03:18] : [Step 4/5] >>> / _/ ___/ |/ / _/_ __/ __/ [21:03:18] : [Step 4/5] >>> _/ // (7 7 // / / / / _/ [21:03:18] : [Step 4/5] >>> /___/\___/_/|_/___/ /_/ /___/ [21:03:18] : [Step 4/5] >>> [21:03:18] : [Step 4/5] >>> ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:03:18] : [Step 4/5] >>> 2021 Copyright(C) Apache Software Foundation [21:03:18] : [Step 4/5] >>> [21:03:18] : [Step 4/5] >>> Ignite documentation: http://ignite.apache.org [21:03:18] : [Step 4/5] [21:03:18] : [Step 4/5] Config URL: n/a [21:03:18] : [Step 4/5] IgniteConfiguration [igniteInstanceName=internal.GridNodeMetricsLogPdsSelfTest0, pubPoolSize=24, svcPoolSize=24, callbackPoolSize=24, stripedPoolSize=24, sysPoolSize=24, mgmtPoolSize=4, dataStreamerPoolSize=24, utilityCachePoolSize=24, utilityCacheKeepAliveTime=60000, p2pPoolSize=2, qryPoolSize=24, buildIdxPoolSize=4, igniteHome=/opt/buildagent/work/7bc1c54bc719b67c, igniteWorkDir=/opt/buildagent/work/7bc1c54bc719b67c/work, mbeanSrv=com.sun.jmx.mbeanserver.JmxMBeanServer@6fe85038, nodeId=5a320cff-6ba1-49d0-81a3-7e0c09e00000, marsh=BinaryMarshaller [], marshLocJobs=false, daemon=false, p2pEnabled=true, netTimeout=10000, netCompressionLevel=1, sndRetryDelay=1000, sndRetryCnt=3, metricsHistSize=10000, metricsUpdateFreq=1000, metricsExpTime=9223372036854775807, discoSpi=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=0, ackTimeout=0, marsh=null, reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], segPlc=STOP, segResolveAttempts=2, waitForSegOnStart=true, allResolversPassReq=true, segChkFreq=10000, commSpi=TcpCommunicationSpi [connectGate=org.apache.ignite.spi.communication.tcp.internal.ConnectGateway@795f5d51, ctxInitLatch=java.util.concurrent.CountDownLatch@34aeacd1[Count = 1], stopping=false, clientPool=null, nioSrvWrapper=null, stateProvider=null], evtSpi=MemoryEventStorageSpi [expireAgeMs=9223372036854775807, expireCnt=10000, filter=null], colSpi=NoopCollisionSpi [], deploySpi=LocalDeploymentSpi [], indexingSpi=org.apache.ignite.spi.indexing.noop.NoopIndexingSpi@2274160, addrRslvr=null, encryptionSpi=org.apache.ignite.spi.encryption.noop.NoopEncryptionSpi@65383667, tracingSpi=org.apache.ignite.spi.tracing.NoopTracingSpi@63cd2cd2, clientMode=false, rebalanceThreadPoolSize=4, rebalanceTimeout=10000, rebalanceBatchesPrefetchCnt=3, rebalanceThrottle=0, rebalanceBatchSize=524288, txCfg=TransactionConfiguration [txSerEnabled=false, dfltIsolation=REPEATABLE_READ, dfltConcurrency=PESSIMISTIC, dfltTxTimeout=0, txTimeoutOnPartitionMapExchange=0, deadlockTimeout=10000, pessimisticTxLogSize=0, pessimisticTxLogLinger=10000, tmLookupClsName=null, txManagerFactory=null, useJtaSync=false], cacheSanityCheckEnabled=true, discoStartupDelay=60000, deployMode=SHARED, p2pMissedCacheSize=100, locHost=127.0.0.1, timeSrvPortBase=31100, timeSrvPortRange=100, failureDetectionTimeout=10000, sysWorkerBlockedTimeout=null, clientFailureDetectionTimeout=10000, metricsLogFreq=1000, connectorCfg=null, odbcCfg=null, warmupClos=null, atomicCfg=AtomicConfiguration [seqReserveSize=1000, cacheMode=PARTITIONED, backups=1, aff=null, grpName=null], classLdr=null, sslCtxFactory=null, platformCfg=null, binaryCfg=null, memCfg=null, pstCfg=null, dsCfg=DataStorageConfiguration [sysRegionInitSize=41943040, sysRegionMaxSize=104857600, pageSize=0, concLvl=0, dfltDataRegConf=DataRegionConfiguration [name=default, maxSize=31457280, initSize=268435456, swapPath=null, pageEvictionMode=DISABLED, pageReplacementMode=CLOCK, evictionThreshold=0.9, emptyPagesPoolSize=100, metricsEnabled=false, metricsSubIntervalCount=5, metricsRateTimeInterval=60000, persistenceEnabled=true, checkpointPageBufSize=0, lazyMemoryAllocation=true, warmUpCfg=null], dataRegions=DataRegionConfiguration[] [DataRegionConfiguration [name=userTransientDataRegion, maxSize=20971520, initSize=268435456, swapPath=null, pageEvictionMode=DISABLED, pageReplacementMode=CLOCK, evictionThreshold=0.9, emptyPagesPoolSize=100, metricsEnabled=false, metricsSubIntervalCount=5, metricsRateTimeInterval=60000, persistenceEnabled=false, checkpointPageBufSize=0, lazyMemoryAllocation=true, warmUpCfg=null]], storagePath=null, checkpointFreq=180000, lockWaitTime=10000, checkpointThreads=4, checkpointWriteOrder=SEQUENTIAL, walHistSize=20, maxWalArchiveSize=1073741824, walSegments=10, walSegmentSize=67108864, walPath=db/wal, walArchivePath=db/wal/archive, cdcWalPath=db/wal/cdc, cdcEnabled=false, metricsEnabled=false, walMode=LOG_ONLY, walTlbSize=131072, walBuffSize=0, walFlushFreq=2000, walFsyncDelay=1000, walRecordIterBuffSize=67108864, alwaysWriteFullPages=false, fileIOFactory=org.apache.ignite.internal.processors.cache.persistence.file.AsyncFileIOFactory@3c79088e, metricsSubIntervalCnt=5, metricsRateTimeInterval=60000, walAutoArchiveAfterInactivity=-1, walForceArchiveTimeout=-1, writeThrottlingEnabled=false, walCompactionEnabled=false, walCompactionLevel=1, checkpointReadLockTimeout=null, walPageCompression=DISABLED, walPageCompressionLevel=null, dfltWarmUpCfg=null, encCfg=org.apache.ignite.configuration.EncryptionConfiguration@4a37191a, defragmentationThreadPoolSize=4, minWalArchiveSize=-1], snapshotPath=snapshots, activeOnStart=true, activeOnStartPropSetFlag=false, autoActivation=true, autoActivationPropSetFlag=false, clusterStateOnStart=null, sqlConnCfg=null, cliConnCfg=ClientConnectorConfiguration [host=null, port=10800, portRange=100, sockSndBufSize=0, sockRcvBufSize=0, tcpNoDelay=true, maxOpenCursorsPerConn=128, threadPoolSize=24, selectorCnt=12, idleTimeout=0, handshakeTimeout=10000, jdbcEnabled=true, odbcEnabled=true, thinCliEnabled=true, sslEnabled=false, useIgniteSslCtxFactory=true, sslClientAuth=false, sslCtxFactory=null, thinCliCfg=ThinClientConfiguration [maxActiveTxPerConn=100, maxActiveComputeTasksPerConn=0]], mvccVacuumThreadCnt=2, mvccVacuumFreq=5000, authEnabled=false, failureHnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]], commFailureRslvr=null, sqlCfg=SqlConfiguration [longQryWarnTimeout=3000, dfltQryTimeout=0, sqlQryHistSize=1000, validationEnabled=false], asyncContinuationExecutor=null] [21:03:18] : [Step 4/5] Daemon mode: off [21:03:18] : [Step 4/5] OS: Linux 4.15.0-151-generic amd64 [21:03:18] : [Step 4/5] OS user: teamcity [21:03:18] : [Step 4/5] PID: 16724 [21:03:18] : [Step 4/5] Language runtime: Java Platform API Specification ver. 1.8 [21:03:18] : [Step 4/5] VM information: Java(TM) SE Runtime Environment 1.8.0_261-b12 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 25.261-b12 [21:03:18] : [Step 4/5] VM total memory: 1.9GB [21:03:18] : [Step 4/5] Remote Management [restart: off, REST: off, JMX (remote: off)] [21:03:18] : [Step 4/5] Logger: Ignite work directory is not provided, automatically resolved to: /opt/buildagent/work/7bc1c54bc719b67c/work [21:03:18] : [Step 4/5] Consistent ID is not set, it is recommended to set consistent ID for production clusters (use IgniteConfiguration.setConsistentId property) [21:03:18] : [Step 4/5] [21:03:18] : [Step 4/5] [21:03:18] : [Step 4/5] >>> __________ ________________ [21:03:18] : [Step 4/5] >>> / _/ ___/ |/ / _/_ __/ __/ [21:03:18] : [Step 4/5] >>> _/ // (7 7 // / / / / _/ [21:03:18] : [Step 4/5] >>> /___/\___/_/|_/___/ /_/ /___/ [21:03:18] : [Step 4/5] >>> [21:03:18] : [Step 4/5] >>> ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:03:18] : [Step 4/5] >>> 2021 Copyright(C) Apache Software Foundation [21:03:18] : [Step 4/5] >>> [21:03:18] : [Step 4/5] >>> Ignite documentation: http://ignite.apache.org [21:03:18] : [Step 4/5] [21:03:18] : [Step 4/5] Config URL: n/a [21:03:18] : [Step 4/5] IgniteConfiguration [igniteInstanceName=internal.GridNodeMetricsLogPdsSelfTest0, pubPoolSize=24, svcPoolSize=24, callbackPoolSize=24, stripedPoolSize=24, sysPoolSize=24, mgmtPoolSize=4, dataStreamerPoolSize=24, utilityCachePoolSize=24, utilityCacheKeepAliveTime=60000, p2pPoolSize=2, qryPoolSize=24, buildIdxPoolSize=4, igniteHome=/opt/buildagent/work/7bc1c54bc719b67c, igniteWorkDir=/opt/buildagent/work/7bc1c54bc719b67c/work, mbeanSrv=com.sun.jmx.mbeanserver.JmxMBeanServer@6fe85038, nodeId=5a320cff-6ba1-49d0-81a3-7e0c09e00000, marsh=BinaryMarshaller [], marshLocJobs=false, daemon=false, p2pEnabled=true, netTimeout=10000, netCompressionLevel=1, sndRetryDelay=1000, sndRetryCnt=3, metricsHistSize=10000, metricsUpdateFreq=1000, metricsExpTime=9223372036854775807, discoSpi=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=0, ackTimeout=0, marsh=null, reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], segPlc=STOP, segResolveAttempts=2, waitForSegOnStart=true, allResolversPassReq=true, segChkFreq=10000, commSpi=TcpCommunicationSpi [connectGate=org.apache.ignite.spi.communication.tcp.internal.ConnectGateway@795f5d51, ctxInitLatch=java.util.concurrent.CountDownLatch@34aeacd1[Count = 1], stopping=false, clientPool=null, nioSrvWrapper=null, stateProvider=null], evtSpi=MemoryEventStorageSpi [expireAgeMs=9223372036854775807, expireCnt=10000, filter=null], colSpi=NoopCollisionSpi [], deploySpi=LocalDeploymentSpi [], indexingSpi=org.apache.ignite.spi.indexing.noop.NoopIndexingSpi@2274160, addrRslvr=null, encryptionSpi=org.apache.ignite.spi.encryption.noop.NoopEncryptionSpi@65383667, tracingSpi=org.apache.ignite.spi.tracing.NoopTracingSpi@63cd2cd2, clientMode=false, rebalanceThreadPoolSize=4, rebalanceTimeout=10000, rebalanceBatchesPrefetchCnt=3, rebalanceThrottle=0, rebalanceBatchSize=524288, txCfg=TransactionConfiguration [txSerEnabled=false, dfltIsolation=REPEATABLE_READ, dfltConcurrency=PESSIMISTIC, dfltTxTimeout=0, txTimeoutOnPartitionMapExchange=0, deadlockTimeout=10000, pessimisticTxLogSize=0, pessimisticTxLogLinger=10000, tmLookupClsName=null, txManagerFactory=null, useJtaSync=false], cacheSanityCheckEnabled=true, discoStartupDelay=60000, deployMode=SHARED, p2pMissedCacheSize=100, locHost=127.0.0.1, timeSrvPortBase=31100, timeSrvPortRange=100, failureDetectionTimeout=10000, sysWorkerBlockedTimeout=null, clientFailureDetectionTimeout=10000, metricsLogFreq=1000, connectorCfg=null, odbcCfg=null, warmupClos=null, atomicCfg=AtomicConfiguration [seqReserveSize=1000, cacheMode=PARTITIONED, backups=1, aff=null, grpName=null], classLdr=null, sslCtxFactory=null, platformCfg=null, binaryCfg=null, memCfg=null, pstCfg=null, dsCfg=DataStorageConfiguration [sysRegionInitSize=41943040, sysRegionMaxSize=104857600, pageSize=0, concLvl=0, dfltDataRegConf=DataRegionConfiguration [name=default, maxSize=31457280, initSize=268435456, swapPath=null, pageEvictionMode=DISABLED, pageReplacementMode=CLOCK, evictionThreshold=0.9, emptyPagesPoolSize=100, metricsEnabled=false, metricsSubIntervalCount=5, metricsRateTimeInterval=60000, persistenceEnabled=true, checkpointPageBufSize=0, lazyMemoryAllocation=true, warmUpCfg=null], dataRegions=DataRegionConfiguration[] [DataRegionConfiguration [name=userTransientDataRegion, maxSize=20971520, initSize=268435456, swapPath=null, pageEvictionMode=DISABLED, pageReplacementMode=CLOCK, evictionThreshold=0.9, emptyPagesPoolSize=100, metricsEnabled=false, metricsSubIntervalCount=5, metricsRateTimeInterval=60000, persistenceEnabled=false, checkpointPageBufSize=0, lazyMemoryAllocation=true, warmUpCfg=null]], storagePath=null, checkpointFreq=180000, lockWaitTime=10000, checkpointThreads=4, checkpointWriteOrder=SEQUENTIAL, walHistSize=20, maxWalArchiveSize=1073741824, walSegments=10, walSegmentSize=67108864, walPath=db/wal, walArchivePath=db/wal/archive, cdcWalPath=db/wal/cdc, cdcEnabled=false, metricsEnabled=false, walMode=LOG_ONLY, walTlbSize=131072, walBuffSize=0, walFlushFreq=2000, walFsyncDelay=1000, walRecordIterBuffSize=67108864, alwaysWriteFullPages=false, fileIOFactory=org.apache.ignite.internal.processors.cache.persistence.file.AsyncFileIOFactory@3c79088e, metricsSubIntervalCnt=5, metricsRateTimeInterval=60000, walAutoArchiveAfterInactivity=-1, walForceArchiveTimeout=-1, writeThrottlingEnabled=false, walCompactionEnabled=false, walCompactionLevel=1, checkpointReadLockTimeout=null, walPageCompression=DISABLED, walPageCompressionLevel=null, dfltWarmUpCfg=null, encCfg=org.apache.ignite.configuration.EncryptionConfiguration@4a37191a, defragmentationThreadPoolSize=4, minWalArchiveSize=-1], snapshotPath=snapshots, activeOnStart=true, activeOnStartPropSetFlag=false, autoActivation=true, autoActivationPropSetFlag=false, clusterStateOnStart=null, sqlConnCfg=null, cliConnCfg=ClientConnectorConfiguration [host=null, port=10800, portRange=100, sockSndBufSize=0, sockRcvBufSize=0, tcpNoDelay=true, maxOpenCursorsPerConn=128, threadPoolSize=24, selectorCnt=12, idleTimeout=0, handshakeTimeout=10000, jdbcEnabled=true, odbcEnabled=true, thinCliEnabled=true, sslEnabled=false, useIgniteSslCtxFactory=true, sslClientAuth=false, sslCtxFactory=null, thinCliCfg=ThinClientConfiguration [maxActiveTxPerConn=100, maxActiveComputeTasksPerConn=0]], mvccVacuumThreadCnt=2, mvccVacuumFreq=5000, authEnabled=false, failureHnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]], commFailureRslvr=null, sqlCfg=SqlConfiguration [longQryWarnTimeout=3000, dfltQryTimeout=0, sqlQryHistSize=1000, validationEnabled=false], asyncContinuationExecutor=null] [21:03:18] : [Step 4/5] Daemon mode: off [21:03:18] : [Step 4/5] OS: Linux 4.15.0-151-generic amd64 [21:03:18] : [Step 4/5] OS user: teamcity [21:03:18] : [Step 4/5] PID: 16724 [21:03:18] : [Step 4/5] Language runtime: Java Platform API Specification ver. 1.8 [21:03:18] : [Step 4/5] VM information: Java(TM) SE Runtime Environment 1.8.0_261-b12 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 25.261-b12 [21:03:18] : [Step 4/5] VM total memory: 1.9GB [21:03:18] : [Step 4/5] Remote Management [restart: off, REST: off, JMX (remote: off)] [21:03:18] : [Step 4/5] [21:03:18] : [Step 4/5] IGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c [21:03:18] : [Step 4/5] VM arguments: [-DIGNITE_DUMP_THREADS_ON_FAILURE=false, -DMono=/usr/bin/mono-sgen, -DMono4.0_x64=/usr/lib/mono/4.0, -DMono4.5_x64=/usr/lib/mono/4.5, -DMonoVersion=6.12.0.90, -DSKIP_BUILD=false, -Dagent.home.dir=/opt/buildagent, -Dagent.name=aitc-lin02_03, -Dagent.ownPort=9090, -Dagent.work.dir=/opt/buildagent/work, -Dbuild.number=95, -Dbuild.vcs.number=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.1=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.GitHubApacheIgnite=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dclassworlds.conf=/opt/buildagent/temp/buildTmp/teamcity.m2.conf, -Dcom.jetbrains.maven.watcher.report.file=/opt/buildagent/temp/buildTmp/maven-build-info.xml, -Djava.io.tmpdir=/opt/buildagent/temp/buildTmp, -Dmaven.home=/opt/buildagent/tools/maven3_6, -Dmaven.multiModuleProjectDirectory=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.agent.cpuBenchmark=457, -Dteamcity.agent.dotnet.agent_url=http://localhost:9090/RPC2, -Dteamcity.agent.dotnet.build_id=6278078, -Dteamcity.auth.password=*******, -Dteamcity.auth.userId=TeamCityBuildId=6278078, -Dteamcity.build.changedFiles.file=/opt/buildagent/temp/buildTmp/changedFiles6342607772318147725.txt, -Dteamcity.build.checkoutDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.build.id=6278078, -Dteamcity.build.properties.file=/opt/buildagent/temp/buildTmp/teamcity.build5164517880467851002.properties, -Dteamcity.build.tempDir=/opt/buildagent/temp/buildTmp, -Dteamcity.build.workingDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.buildConfName=Basic 3, -Dteamcity.buildType.id=IgniteTests24Java8_Basic3, -Dteamcity.configuration.properties.file=/opt/buildagent/temp/buildTmp/teamcity.config5591980786735343870.properties, -Dteamcity.maven.userSettings.path=/opt/buildagent/temp/buildTmp/maven_settings_585072866407032347.xml, -Dteamcity.maven.watcher.home=/opt/buildagent/plugins/mavenPlugin/maven-watcher-jdk16, -Dteamcity.projectName=Ignite Tests 2.x (JDK 8/11), -Dteamcity.runner.properties.file=/opt/buildagent/temp/buildTmp/teamcity.runner9098465561618137420.properties, -Dteamcity.tests.recentlyFailedTests.file=/opt/buildagent/temp/buildTmp/testsToRunFirst3891775683130404069.txt, -Dteamcity.version=2021.2 (build 99542), -ea, -Xms2g, -Xmx2g, -XX:+HeapDumpOnOutOfMemoryError, -DIGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_TEST_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_UPDATE_NOTIFIER=false, -DIGNITE_NO_DISCO_ORDER=true, -DIGNITE_PERFORMANCE_SUGGESTIONS_DISABLED=true, -Djava.net.preferIPv4Stack=true, -DTEST_SCALE_FACTOR=1.0, -DIGNITE_TEST_PROP_LOG4J_FILE=log4j-tc-test.xml, -DIGNITE_QUIET=false, -DIGNITE_MARSHAL_BUFFERS_RECHECK=1000, -Dmaven.repo.local=/opt/buildagent/.m2/repository] [21:03:18] : [Step 4/5] System cache's DataRegion size is configured to 40 MB. Use DataStorageConfiguration.systemRegionInitialSize property to change the setting. [21:03:18] : [Step 4/5] Configured caches [in 'sysMemPlc' dataRegion: ['ignite-sys-cache']] [21:03:18] : [Step 4/5] Peer class loading is enabled (disable it in production for performance and deployment consistency reasons) [21:03:18] : [Step 4/5] 3-rd party licenses can be found at: /opt/buildagent/work/7bc1c54bc719b67c/libs/licenses [21:03:18] : [Step 4/5] Configured plugins: [21:03:18] : [Step 4/5] ^-- StanByClusterTestProvider 1.0 [21:03:18] : [Step 4/5] ^-- null [21:03:18] : [Step 4/5] [21:03:18] : [Step 4/5] ^-- PageMemory tracker plugin 1.0 [21:03:18] : [Step 4/5] ^-- null [21:03:18] : [Step 4/5] [21:03:18] : [Step 4/5] ^-- TestDistibutedConfigurationPlugin 1.0 [21:03:18] : [Step 4/5] ^-- null [21:03:18] : [Step 4/5] [21:03:18] : [Step 4/5] ^-- NodeValidationPluginProvider 1.0 [21:03:18] : [Step 4/5] ^-- null [21:03:18] : [Step 4/5] [21:03:18] : [Step 4/5] Configured failure handler: [hnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]]] [21:03:18] : [Step 4/5] Successfully bound communication NIO server to TCP port [port=45100, locHost=/127.0.0.1, selectorsCnt=12, selectorSpins=0, pairedConn=false] [21:03:18] : [Step 4/5] Message queue limit is set to 0 which may lead to potential OOMEs when running cache operations in FULL_ASYNC or PRIMARY_SYNC modes due to message queues growth on sender and receiver sides. [21:03:18] : [Step 4/5] Collision resolution is disabled (all jobs will be activated upon arrival). [21:03:18] : [Step 4/5] Security status [authentication=off, sandbox=off, tls/ssl=off] [21:03:18] : [Step 4/5] Successfully bound to TCP port [port=47500, localHost=localhost/127.0.0.1, locNodeId=5a320cff-6ba1-49d0-81a3-7e0c09e00000] [21:03:18] : [Step 4/5] Successfully created new persistent storage folder [/opt/buildagent/work/7bc1c54bc719b67c/work/db/node00-2fadaaf7-63e4-4de5-9a38-471957431855] [21:03:18] : [Step 4/5] Consistent ID used for local node is [2fadaaf7-63e4-4de5-9a38-471957431855] according to persistence data storage folders [21:03:18] : [Step 4/5] Resolved store directory for node persistent data: /opt/buildagent/work/7bc1c54bc719b67c/work/db/node00-2fadaaf7-63e4-4de5-9a38-471957431855 [21:03:18] : [Step 4/5] Resolved directory for serialized binary metadata: /opt/buildagent/work/7bc1c54bc719b67c/work/db/binary_meta/node00-2fadaaf7-63e4-4de5-9a38-471957431855 [21:03:18] : [Step 4/5] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/node00-2fadaaf7-63e4-4de5-9a38-471957431855 [21:03:18] : [Step 4/5] Resolved write ahead log work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/node00-2fadaaf7-63e4-4de5-9a38-471957431855 [21:03:18] : [Step 4/5] Resolved write ahead log archive directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/node00-2fadaaf7-63e4-4de5-9a38-471957431855 [21:03:18] : [Step 4/5] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/node00-2fadaaf7-63e4-4de5-9a38-471957431855/0000000000000000.wal [21:03:18] : [Step 4/5] Initialized write-ahead log manager [mode=LOG_ONLY] [21:03:18] : [Step 4/5] DataRegion maxSize=21.0 MB is smaller than defaultInitialSize=268.4 MB, setting initialSize to 21.0 MB [21:03:18] : [Step 4/5] DataRegion maxSize=31.5 MB is smaller than defaultInitialSize=268.4 MB, setting initialSize to 31.5 MB [21:03:18] : [Step 4/5] Configured data regions initialized successfully [total=6] [21:03:18] : [Step 4/5] Resolved snapshot work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/snapshots [21:03:18] : [Step 4/5] Resolved temp directory for snapshot creation: /opt/buildagent/work/7bc1c54bc719b67c/work/db/node00-2fadaaf7-63e4-4de5-9a38-471957431855/snp [21:03:18] : [Step 4/5] Client connector processor has started on TCP port 10800 [21:03:18] : [Step 4/5] Non-loopback local IPs: 172.17.0.4 [21:03:18] : [Step 4/5] Enabled local MACs: 0242AC110004 [21:03:18] : [Step 4/5] Read checkpoint status [startMarker=null, endMarker=null] [21:03:18] : [Step 4/5] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:03:18] : [Step 4/5] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:03:18] : [Step 4/5] Applying lost metastore updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:03:18] : [Step 4/5] Finished applying WAL changes [updatesApplied=0, time=0 ms] [21:03:18] : [Step 4/5] Restoring partition state for local groups. [21:03:18] : [Step 4/5] Finished restoring partition state for local groups [groupsProcessed=0, partitionsProcessed=0, time=0ms] [21:03:18] : [Step 4/5] Encryption keys loaded from metastore. [grps=, masterKeyName=null] [21:03:18] : [Step 4/5] Cluster ID and tag has been read from metastorage: null [21:03:18] : [Step 4/5] Shutdown policy was updated [oldVal=null, newVal=null] [21:03:18] : [Step 4/5] Checkpoint frequency deviation changed [oldVal=null, newVal=null] [21:03:18] : [Step 4/5] Cleanup cache stores [total=1, left=0, cleanFiles=false] [21:03:18] : [Step 4/5] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:03:18] : [Step 4/5] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:03:18] : [Step 4/5] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:03:18] : [Step 4/5] Data Regions Started: 6 [21:03:18] : [Step 4/5] ^-- sysMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:03:18] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:03:18] : [Step 4/5] ^-- default region [type=default, persistence=true, lazyAlloc=true, [21:03:18] : [Step 4/5] ... initCfg=30MB, maxCfg=30MB, usedRam=0MB, freeRam=100%, allocRam=0MB, allocTotal=0MB] [21:03:18] : [Step 4/5] ^-- metastoreMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:03:18] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:03:18] : [Step 4/5] ^-- TxLog region [type=internal, persistence=true, lazyAlloc=false, [21:03:18] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:03:18] : [Step 4/5] ^-- volatileDsMemPlc region [type=user, persistence=false, lazyAlloc=true, [21:03:18] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB] [21:03:18] : [Step 4/5] ^-- userTransientDataRegion region [type=user, persistence=false, lazyAlloc=true, [21:03:18] : [Step 4/5] ... initCfg=20MB, maxCfg=20MB, usedRam=0MB, freeRam=100%, allocRam=0MB] [21:03:18] : [Step 4/5] ^-- Ignite persistence [used=0MB] [21:03:18] : [Step 4/5] [21:03:18] : [Step 4/5] Starting binary memory restore for: [-2100569601] [21:03:18] : [Step 4/5] Read checkpoint status [startMarker=null, endMarker=null] [21:03:18] : [Step 4/5] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:03:18] : [Step 4/5] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/node00-2fadaaf7-63e4-4de5-9a38-471957431855/0000000000000000.wal, offset=0, ver=2] [21:03:18] : [Step 4/5] Started cache in recovery mode [name=ignite-sys-cache, id=-2100569601, dataRegionName=sysMemPlc, mode=REPLICATED, atomicity=TRANSACTIONAL, backups=2147483647, mvcc=false] [21:03:18] : [Step 4/5] Binary recovery performed in 18 ms. [21:03:18] : [Step 4/5] Read checkpoint status [startMarker=null, endMarker=null] [21:03:18] : [Step 4/5] Applying lost cache updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:03:18] : [Step 4/5] Finished applying WAL changes [updatesApplied=0, time=60 ms] [21:03:18] : [Step 4/5] Restoring partition state for local groups. [21:03:18] : [Step 4/5] Finished restoring partition state for local groups [groupsProcessed=1, partitionsProcessed=100, time=10ms] [21:03:18] : [Step 4/5] Assigned mvcc coordinator [crd=MvccCoordinator [topVer=AffinityTopologyVersion [topVer=1, minorTopVer=0], nodeId=5a320cff-6ba1-49d0-81a3-7e0c09e00000, ver=1637344998310, local=true, initialized=false]] [21:03:18] : [Step 4/5] Writing cluster ID and tag to metastorage on ready for write ClusterIdAndTag [id=c2c4b664-065f-44c4-9c8b-5982a73ca684, tag=youthful_chatelet] [21:03:18] : [Step 4/5] youthful_chatelet [21:03:18] : [Step 4/5] Baseline parameter 'baselineAutoAdjustEnabled' was changed from 'null' to 'false' [21:03:18] : [Step 4/5] Baseline parameter 'baselineAutoAdjustTimeout' was changed from 'null' to '300000' [21:03:18] : [Step 4/5] Transactions parameter 'longOperationsDumpTimeout' was changed from 'null' to '60000' [21:03:18] : [Step 4/5] Transactions parameter 'longTransactionTimeDumpThreshold' was changed from 'null' to '0' [21:03:18] : [Step 4/5] Transactions parameter 'transactionTimeDumpSamplesCoefficient' was changed from 'null' to '0.0' [21:03:18] : [Step 4/5] Transactions parameter 'longTransactionTimeDumpSamplesPerSecondLimit' was changed from 'null' to '5' [21:03:18] : [Step 4/5] Transactions parameter 'collisionsDumpInterval' was changed from 'null' to '1000' [21:03:18] : [Step 4/5] Transactions parameter 'txOwnerDumpRequestsAllowed' was changed from 'null' to 'true' [21:03:18] : [Step 4/5] Historical rebalance WAL threshold changed [property=historical.rebalance.threshold, oldVal=null, newVal=500] [21:03:18] : [Step 4/5] To start Console Management & Monitoring run ignitevisorcmd.{sh|bat} [21:03:18] : [Step 4/5] [21:03:18] : [Step 4/5] [21:03:18] : [Step 4/5] >>> +-------------------------------------------+ [21:03:18] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:03:18] : [Step 4/5] >>> +-------------------------------------------+ [21:03:18] : [Step 4/5] >>> OS name: Linux 4.15.0-151-generic amd64 [21:03:18] : [Step 4/5] >>> CPU(s): 24 [21:03:18] : [Step 4/5] >>> Heap: 2.0GB [21:03:18] : [Step 4/5] >>> VM name: 16724@c4dfe9a430b2 [21:03:18] : [Step 4/5] >>> Ignite instance name: internal.GridNodeMetricsLogPdsSelfTest0 [21:03:18] : [Step 4/5] >>> Local node [ID=5A320CFF-6BA1-49D0-81A3-7E0C09E00000, order=1, clientMode=false] [21:03:18] : [Step 4/5] >>> Local node addresses: [127.0.0.1] [21:03:18] : [Step 4/5] >>> Local ports: TCP:10800 TCP:45100 TCP:47500 [21:03:18] : [Step 4/5] [21:03:18] : [Step 4/5] >>> Ignite cluster is in INACTIVE state (limited functionality available). Use control.(sh|bat) script or IgniteCluster.state(ClusterState.ACTIVE) to change the state. [21:03:18] : [Step 4/5] Topology snapshot [ver=1, locNode=5a320cff, servers=1, clients=0, state=INACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=5a320cff-6ba1-49d0-81a3-7e0c09e00000, consistentId=2fadaaf7-63e4-4de5-9a38-471957431855, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:03:18] : [Step 4/5] Node started : [stage="Configure system pool" (0 ms),stage="Start managers" (92 ms),stage="Configure binary metadata" (4 ms),stage="Start processors" (390 ms),stage="Start 'StanByClusterTestProvider' plugin" (0 ms),stage="Start 'PageMemory tracker plugin' plugin" (0 ms),stage="Start 'TestDistibutedConfigurationPlugin' plugin" (0 ms),stage="Start 'NodeValidationPluginProvider' plugin" (0 ms),stage="Init metastore" (24 ms),stage="Init and start regions" (5 ms),stage="Restore binary memory" (18 ms),stage="Restore logical state" (75 ms),stage="Finish recovery" (285 ms),stage="Join topology" (12 ms),stage="Await transition" (4 ms),stage="Await exchange" (22 ms),stage="Total time" (931 ms)] [21:03:18] : [Step 4/5] Ignite work directory is not provided, automatically resolved to: /opt/buildagent/work/7bc1c54bc719b67c/work [21:03:18] : [Step 4/5] Consistent ID is not set, it is recommended to set consistent ID for production clusters (use IgniteConfiguration.setConsistentId property) [21:03:18] : [Step 4/5] [21:03:18] : [Step 4/5] [21:03:18] : [Step 4/5] >>> __________ ________________ [21:03:18] : [Step 4/5] >>> / _/ ___/ |/ / _/_ __/ __/ [21:03:18] : [Step 4/5] >>> _/ // (7 7 // / / / / _/ [21:03:18] : [Step 4/5] >>> /___/\___/_/|_/___/ /_/ /___/ [21:03:18] : [Step 4/5] >>> [21:03:18] : [Step 4/5] >>> ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:03:18] : [Step 4/5] >>> 2021 Copyright(C) Apache Software Foundation [21:03:18] : [Step 4/5] >>> [21:03:18] : [Step 4/5] >>> Ignite documentation: http://ignite.apache.org [21:03:18] : [Step 4/5] [21:03:18] : [Step 4/5] Config URL: n/a [21:03:18] : [Step 4/5] IgniteConfiguration [igniteInstanceName=internal.GridNodeMetricsLogPdsSelfTest1, pubPoolSize=24, svcPoolSize=24, callbackPoolSize=24, stripedPoolSize=24, sysPoolSize=24, mgmtPoolSize=4, dataStreamerPoolSize=24, utilityCachePoolSize=24, utilityCacheKeepAliveTime=60000, p2pPoolSize=2, qryPoolSize=24, buildIdxPoolSize=4, igniteHome=/opt/buildagent/work/7bc1c54bc719b67c, igniteWorkDir=/opt/buildagent/work/7bc1c54bc719b67c/work, mbeanSrv=com.sun.jmx.mbeanserver.JmxMBeanServer@6fe85038, nodeId=26a828be-527b-42db-a842-bea7dc000001, marsh=BinaryMarshaller [], marshLocJobs=false, daemon=false, p2pEnabled=true, netTimeout=10000, netCompressionLevel=1, sndRetryDelay=1000, sndRetryCnt=3, metricsHistSize=10000, metricsUpdateFreq=1000, metricsExpTime=9223372036854775807, discoSpi=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=0, ackTimeout=0, marsh=null, reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], segPlc=STOP, segResolveAttempts=2, waitForSegOnStart=true, allResolversPassReq=true, segChkFreq=10000, commSpi=TcpCommunicationSpi [connectGate=org.apache.ignite.spi.communication.tcp.internal.ConnectGateway@4fdca00a, ctxInitLatch=java.util.concurrent.CountDownLatch@513b52af[Count = 1], stopping=false, clientPool=null, nioSrvWrapper=null, stateProvider=null], evtSpi=MemoryEventStorageSpi [expireAgeMs=9223372036854775807, expireCnt=10000, filter=null], colSpi=NoopCollisionSpi [], deploySpi=LocalDeploymentSpi [], indexingSpi=org.apache.ignite.spi.indexing.noop.NoopIndexingSpi@1a3e8e24, addrRslvr=null, encryptionSpi=org.apache.ignite.spi.encryption.noop.NoopEncryptionSpi@4ed4a7e4, tracingSpi=org.apache.ignite.spi.tracing.NoopTracingSpi@1c7350b0, clientMode=false, rebalanceThreadPoolSize=4, rebalanceTimeout=10000, rebalanceBatchesPrefetchCnt=3, rebalanceThrottle=0, rebalanceBatchSize=524288, txCfg=TransactionConfiguration [txSerEnabled=false, dfltIsolation=REPEATABLE_READ, dfltConcurrency=PESSIMISTIC, dfltTxTimeout=0, txTimeoutOnPartitionMapExchange=0, deadlockTimeout=10000, pessimisticTxLogSize=0, pessimisticTxLogLinger=10000, tmLookupClsName=null, txManagerFactory=null, useJtaSync=false], cacheSanityCheckEnabled=true, discoStartupDelay=60000, deployMode=SHARED, p2pMissedCacheSize=100, locHost=127.0.0.1, timeSrvPortBase=31100, timeSrvPortRange=100, failureDetectionTimeout=10000, sysWorkerBlockedTimeout=null, clientFailureDetectionTimeout=10000, metricsLogFreq=1000, connectorCfg=null, odbcCfg=null, warmupClos=null, atomicCfg=AtomicConfiguration [seqReserveSize=1000, cacheMode=PARTITIONED, backups=1, aff=null, grpName=null], classLdr=null, sslCtxFactory=null, platformCfg=null, binaryCfg=null, memCfg=null, pstCfg=null, dsCfg=DataStorageConfiguration [sysRegionInitSize=41943040, sysRegionMaxSize=104857600, pageSize=0, concLvl=0, dfltDataRegConf=DataRegionConfiguration [name=default, maxSize=31457280, initSize=268435456, swapPath=null, pageEvictionMode=DISABLED, pageReplacementMode=CLOCK, evictionThreshold=0.9, emptyPagesPoolSize=100, metricsEnabled=false, metricsSubIntervalCount=5, metricsRateTimeInterval=60000, persistenceEnabled=true, checkpointPageBufSize=0, lazyMemoryAllocation=true, warmUpCfg=null], dataRegions=DataRegionConfiguration[] [DataRegionConfiguration [name=userTransientDataRegion, maxSize=20971520, initSize=268435456, swapPath=null, pageEvictionMode=DISABLED, pageReplacementMode=CLOCK, evictionThreshold=0.9, emptyPagesPoolSize=100, metricsEnabled=false, metricsSubIntervalCount=5, metricsRateTimeInterval=60000, persistenceEnabled=false, checkpointPageBufSize=0, lazyMemoryAllocation=true, warmUpCfg=null]], storagePath=null, checkpointFreq=180000, lockWaitTime=10000, checkpointThreads=4, checkpointWriteOrder=SEQUENTIAL, walHistSize=20, maxWalArchiveSize=1073741824, walSegments=10, walSegmentSize=67108864, walPath=db/wal, walArchivePath=db/wal/archive, cdcWalPath=db/wal/cdc, cdcEnabled=false, metricsEnabled=false, walMode=LOG_ONLY, walTlbSize=131072, walBuffSize=0, walFlushFreq=2000, walFsyncDelay=1000, walRecordIterBuffSize=67108864, alwaysWriteFullPages=false, fileIOFactory=org.apache.ignite.internal.processors.cache.persistence.file.AsyncFileIOFactory@75e09567, metricsSubIntervalCnt=5, metricsRateTimeInterval=60000, walAutoArchiveAfterInactivity=-1, walForceArchiveTimeout=-1, writeThrottlingEnabled=false, walCompactionEnabled=false, walCompactionLevel=1, checkpointReadLockTimeout=null, walPageCompression=DISABLED, walPageCompressionLevel=null, dfltWarmUpCfg=null, encCfg=org.apache.ignite.configuration.EncryptionConfiguration@2a334bac, defragmentationThreadPoolSize=4, minWalArchiveSize=-1], snapshotPath=snapshots, activeOnStart=true, activeOnStartPropSetFlag=false, autoActivation=true, autoActivationPropSetFlag=false, clusterStateOnStart=null, sqlConnCfg=null, cliConnCfg=ClientConnectorConfiguration [host=null, port=10800, portRange=100, sockSndBufSize=0, sockRcvBufSize=0, tcpNoDelay=true, maxOpenCursorsPerConn=128, threadPoolSize=24, selectorCnt=12, idleTimeout=0, handshakeTimeout=10000, jdbcEnabled=true, odbcEnabled=true, thinCliEnabled=true, sslEnabled=false, useIgniteSslCtxFactory=true, sslClientAuth=false, sslCtxFactory=null, thinCliCfg=ThinClientConfiguration [maxActiveTxPerConn=100, maxActiveComputeTasksPerConn=0]], mvccVacuumThreadCnt=2, mvccVacuumFreq=5000, authEnabled=false, failureHnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]], commFailureRslvr=null, sqlCfg=SqlConfiguration [longQryWarnTimeout=3000, dfltQryTimeout=0, sqlQryHistSize=1000, validationEnabled=false], asyncContinuationExecutor=null] [21:03:18] : [Step 4/5] Daemon mode: off [21:03:18] : [Step 4/5] OS: Linux 4.15.0-151-generic amd64 [21:03:18] : [Step 4/5] OS user: teamcity [21:03:18] : [Step 4/5] PID: 16724 [21:03:18] : [Step 4/5] Language runtime: Java Platform API Specification ver. 1.8 [21:03:18] : [Step 4/5] VM information: Java(TM) SE Runtime Environment 1.8.0_261-b12 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 25.261-b12 [21:03:18] : [Step 4/5] VM total memory: 1.9GB [21:03:18] : [Step 4/5] Remote Management [restart: off, REST: off, JMX (remote: off)] [21:03:18] : [Step 4/5] [21:03:18] : [Step 4/5] [2021-11-19 21:03:18,408][INFO ][main][root] [GridStringLogger echo] IGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c [21:03:18] : [Step 4/5] [2021-11-19 21:03:18,408][INFO ][main][root] [GridStringLogger echo] VM arguments: [-DIGNITE_DUMP_THREADS_ON_FAILURE=false, -DMono=/usr/bin/mono-sgen, -DMono4.0_x64=/usr/lib/mono/4.0, -DMono4.5_x64=/usr/lib/mono/4.5, -DMonoVersion=6.12.0.90, -DSKIP_BUILD=false, -Dagent.home.dir=/opt/buildagent, -Dagent.name=aitc-lin02_03, -Dagent.ownPort=9090, -Dagent.work.dir=/opt/buildagent/work, -Dbuild.number=95, -Dbuild.vcs.number=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.1=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.GitHubApacheIgnite=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dclassworlds.conf=/opt/buildagent/temp/buildTmp/teamcity.m2.conf, -Dcom.jetbrains.maven.watcher.report.file=/opt/buildagent/temp/buildTmp/maven-build-info.xml, -Djava.io.tmpdir=/opt/buildagent/temp/buildTmp, -Dmaven.home=/opt/buildagent/tools/maven3_6, -Dmaven.multiModuleProjectDirectory=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.agent.cpuBenchmark=457, -Dteamcity.agent.dotnet.agent_url=http://localhost:9090/RPC2, -Dteamcity.agent.dotnet.build_id=6278078, -Dteamcity.auth.password=*******, -Dteamcity.auth.userId=TeamCityBuildId=6278078, -Dteamcity.build.changedFiles.file=/opt/buildagent/temp/buildTmp/changedFiles6342607772318147725.txt, -Dteamcity.build.checkoutDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.build.id=6278078, -Dteamcity.build.properties.file=/opt/buildagent/temp/buildTmp/teamcity.build5164517880467851002.properties, -Dteamcity.build.tempDir=/opt/buildagent/temp/buildTmp, -Dteamcity.build.workingDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.buildConfName=Basic 3, -Dteamcity.buildType.id=IgniteTests24Java8_Basic3, -Dteamcity.configuration.properties.file=/opt/buildagent/temp/buildTmp/teamcity.config5591980786735343870.properties, -Dteamcity.maven.userSettings.path=/opt/buildagent/temp/buildTmp/maven_settings_585072866407032347.xml, -Dteamcity.maven.watcher.home=/opt/buildagent/plugins/mavenPlugin/maven-watcher-jdk16, -Dteamcity.projectName=Ignite Tests 2.x (JDK 8/11), -Dteamcity.runner.properties.file=/opt/buildagent/temp/buildTmp/teamcity.runner9098465561618137420.properties, -Dteamcity.tests.recentlyFailedTests.file=/opt/buildagent/temp/buildTmp/testsToRunFirst3891775683130404069.txt, -Dteamcity.version=2021.2 (build 99542), -ea, -Xms2g, -Xmx2g, -XX:+HeapDumpOnOutOfMemoryError, -DIGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_TEST_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_UPDATE_NOTIFIER=false, -DIGNITE_NO_DISCO_ORDER=true, -DIGNITE_PERFORMANCE_SUGGESTIONS_DISABLED=true, -Djava.net.preferIPv4Stack=true, -DTEST_SCALE_FACTOR=1.0, -DIGNITE_TEST_PROP_LOG4J_FILE=log4j-tc-test.xml, -DIGNITE_QUIET=false, -DIGNITE_MARSHAL_BUFFERS_RECHECK=1000, -Dmaven.repo.local=/opt/buildagent/.m2/repository] [21:03:18] : [Step 4/5] [2021-11-19 21:03:18,412][INFO ][main][root] [GridStringLogger echo] System cache's DataRegion size is configured to 40 MB. Use DataStorageConfiguration.systemRegionInitialSize property to change the setting. [21:03:18] : [Step 4/5] [2021-11-19 21:03:18,413][INFO ][main][root] [GridStringLogger echo] Configured caches [in 'sysMemPlc' dataRegion: ['ignite-sys-cache']] [21:03:18] : [Step 4/5] [2021-11-19 21:03:18,413][INFO ][main][root] [GridStringLogger echo] Peer class loading is enabled (disable it in production for performance and deployment consistency reasons) [21:03:18] : [Step 4/5] [2021-11-19 21:03:18,413][INFO ][main][root] [GridStringLogger echo] 3-rd party licenses can be found at: /opt/buildagent/work/7bc1c54bc719b67c/libs/licenses [21:03:18] : [Step 4/5] [2021-11-19 21:03:18,416][INFO ][main][root] [GridStringLogger echo] Configured plugins: [21:03:18] : [Step 4/5] [2021-11-19 21:03:18,416][INFO ][main][root] [GridStringLogger echo] ^-- StanByClusterTestProvider 1.0 [21:03:18] : [Step 4/5] [2021-11-19 21:03:18,417][INFO ][main][root] [GridStringLogger echo] ^-- null [21:03:18] : [Step 4/5] [2021-11-19 21:03:18,417][INFO ][main][root] [GridStringLogger echo] [21:03:18] : [Step 4/5] [2021-11-19 21:03:18,417][INFO ][main][root] [GridStringLogger echo] ^-- PageMemory tracker plugin 1.0 [21:03:18] : [Step 4/5] [2021-11-19 21:03:18,417][INFO ][main][root] [GridStringLogger echo] ^-- null [21:03:18] : [Step 4/5] [2021-11-19 21:03:18,417][INFO ][main][root] [GridStringLogger echo] [21:03:18] : [Step 4/5] [2021-11-19 21:03:18,417][INFO ][main][root] [GridStringLogger echo] ^-- TestDistibutedConfigurationPlugin 1.0 [21:03:18] : [Step 4/5] [2021-11-19 21:03:18,417][INFO ][main][root] [GridStringLogger echo] ^-- null [21:03:18] : [Step 4/5] [2021-11-19 21:03:18,417][INFO ][main][root] [GridStringLogger echo] [21:03:18] : [Step 4/5] [2021-11-19 21:03:18,418][INFO ][main][root] [GridStringLogger echo] ^-- NodeValidationPluginProvider 1.0 [21:03:18] : [Step 4/5] [2021-11-19 21:03:18,418][INFO ][main][root] [GridStringLogger echo] ^-- null [21:03:18] : [Step 4/5] [2021-11-19 21:03:18,418][INFO ][main][root] [GridStringLogger echo] [21:03:18] : [Step 4/5] [2021-11-19 21:03:18,418][INFO ][main][root] [GridStringLogger echo] Configured failure handler: [hnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]]] [21:03:18] : [Step 4/5] [2021-11-19 21:03:18,439][INFO ][main][root] [GridStringLogger echo] Successfully bound communication NIO server to TCP port [port=45101, locHost=/127.0.0.1, selectorsCnt=12, selectorSpins=0, pairedConn=false] [21:03:18] : [Step 4/5] [2021-11-19 21:03:18,439][INFO ][main][root] [GridStringLogger echo] Message queue limit is set to 0 which may lead to potential OOMEs when running cache operations in FULL_ASYNC or PRIMARY_SYNC modes due to message queues growth on sender and receiver sides. [21:03:18] : [Step 4/5] [2021-11-19 21:03:18,458][INFO ][main][root] [GridStringLogger echo] Collision resolution is disabled (all jobs will be activated upon arrival). [21:03:18] : [Step 4/5] [2021-11-19 21:03:18,458][INFO ][main][root] [GridStringLogger echo] Security status [authentication=off, sandbox=off, tls/ssl=off] [21:03:18] : [Step 4/5] [2021-11-19 21:03:18,460][INFO ][main][root] [GridStringLogger echo] Successfully bound to TCP port [port=47501, localHost=localhost/127.0.0.1, locNodeId=26a828be-527b-42db-a842-bea7dc000001] [21:03:18] : [Step 4/5] [2021-11-19 21:03:18,460][INFO ][main][root] [GridStringLogger echo] Failed to acquire file lock. Will try again in 1s [nodeId=26a828be-527b-42db-a842-bea7dc000001, holder=[5a320cff-6ba1-49d0-81a3-7e0c09e00000][], path=/opt/buildagent/work/7bc1c54bc719b67c/work/db/node00-2fadaaf7-63e4-4de5-9a38-471957431855/lock] [21:03:19] : [Step 4/5] [2021-11-19 21:03:19,350][INFO ][grid-timeout-worker-#5050%internal.GridNodeMetricsLogPdsSelfTest0%][root] [GridStringLogger echo] [21:03:19] : [Step 4/5] Metrics for local node (to disable set 'metricsLogFrequency' to 0) [21:03:19] : [Step 4/5] ^-- Node [id=5a320cff, name=internal.GridNodeMetricsLogPdsSelfTest0, uptime=00:00:01.019] [21:03:19] : [Step 4/5] ^-- Cluster [hosts=1, CPUs=24, servers=1, clients=0, topVer=1, minorTopVer=0] [21:03:19] : [Step 4/5] ^-- Network [addrs=[127.0.0.1], localHost=127.0.0.1, discoPort=47500, commPort=45100] [21:03:19] : [Step 4/5] ^-- CPU [CPUs=24, curLoad=0%, avgLoad=0%, GC=0%] [21:03:19] : [Step 4/5] ^-- Heap [used=589MB, free=69.89%, comm=1956MB] [21:03:19] : [Step 4/5] ^-- Off-heap memory [used=0MB, free=99.99%, allocated=199MB] [21:03:19] : [Step 4/5] ^-- Page memory [pages=9] [21:03:19] : [Step 4/5] ^-- sysMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:03:19] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=99.98%, allocRam=99MB, allocTotal=0MB] [21:03:19] : [Step 4/5] ^-- default region [type=default, persistence=true, lazyAlloc=true, [21:03:19] : [Step 4/5] ... initCfg=30MB, maxCfg=30MB, usedRam=0MB, freeRam=100%, allocRam=0MB, allocTotal=0MB] [21:03:19] : [Step 4/5] ^-- metastoreMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:03:19] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=99.98%, allocRam=0MB, allocTotal=0MB] [21:03:19] : [Step 4/5] ^-- TxLog region [type=internal, persistence=true, lazyAlloc=false, [21:03:19] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:03:19] : [Step 4/5] ^-- volatileDsMemPlc region [type=user, persistence=false, lazyAlloc=true, [21:03:19] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB] [21:03:19] : [Step 4/5] ^-- userTransientDataRegion region [type=user, persistence=false, lazyAlloc=true, [21:03:19] : [Step 4/5] ... initCfg=20MB, maxCfg=20MB, usedRam=0MB, freeRam=100%, allocRam=0MB] [21:03:19] : [Step 4/5] ^-- Ignite persistence [used=0MB] [21:03:19] : [Step 4/5] ^-- Outbound messages queue [size=0] [21:03:19] : [Step 4/5] ^-- Public thread pool [active=0, idle=5, qSize=0] [21:03:19] : [Step 4/5] ^-- System thread pool [active=0, idle=24, qSize=0] [21:03:19] : [Step 4/5] ^-- Striped thread pool [active=0, idle=24, qSize=0] [21:03:19] : [Step 4/5] ^-- Custom executor 0 [active=0, idle=0, qSize=0] [21:03:19] : [Step 4/5] ^-- Custom executor 1 [active=0, idle=0, qSize=0] [21:03:19] : [Step 4/5] [2021-11-19 21:03:19,461][INFO ][main][root] [GridStringLogger echo] Unable to acquire lock to file [/opt/buildagent/work/7bc1c54bc719b67c/work/db/node00-2fadaaf7-63e4-4de5-9a38-471957431855], reason: Failed to acquire file lock [holder=[5a320cff-6ba1-49d0-81a3-7e0c09e00000][], time=1 sec, path=/opt/buildagent/work/7bc1c54bc719b67c/work/db/node00-2fadaaf7-63e4-4de5-9a38-471957431855/lock] [21:03:19] : [Step 4/5] [2021-11-19 21:03:19,463][INFO ][main][root] [GridStringLogger echo] Successfully created new persistent storage folder [/opt/buildagent/work/7bc1c54bc719b67c/work/db/node01-ac5bdf96-4851-4c10-a439-6cfce448cd9e] [21:03:19] : [Step 4/5] [2021-11-19 21:03:19,464][INFO ][main][root] [GridStringLogger echo] Consistent ID used for local node is [ac5bdf96-4851-4c10-a439-6cfce448cd9e] according to persistence data storage folders [21:03:19] : [Step 4/5] [2021-11-19 21:03:19,464][INFO ][main][root] [GridStringLogger echo] Resolved store directory for node persistent data: /opt/buildagent/work/7bc1c54bc719b67c/work/db/node01-ac5bdf96-4851-4c10-a439-6cfce448cd9e [21:03:19] : [Step 4/5] [2021-11-19 21:03:19,466][INFO ][main][root] [GridStringLogger echo] Resolved directory for serialized binary metadata: /opt/buildagent/work/7bc1c54bc719b67c/work/db/binary_meta/node01-ac5bdf96-4851-4c10-a439-6cfce448cd9e [21:03:19] : [Step 4/5] [2021-11-19 21:03:19,472][INFO ][main][root] [GridStringLogger echo] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/node01-ac5bdf96-4851-4c10-a439-6cfce448cd9e [21:03:19] : [Step 4/5] [2021-11-19 21:03:19,473][INFO ][main][root] [GridStringLogger echo] Resolved write ahead log work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/node01-ac5bdf96-4851-4c10-a439-6cfce448cd9e [21:03:19] : [Step 4/5] [2021-11-19 21:03:19,473][INFO ][main][root] [GridStringLogger echo] Resolved write ahead log archive directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/node01-ac5bdf96-4851-4c10-a439-6cfce448cd9e [21:03:19] : [Step 4/5] [2021-11-19 21:03:19,894][INFO ][main][root] [GridStringLogger echo] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/node01-ac5bdf96-4851-4c10-a439-6cfce448cd9e/0000000000000000.wal [21:03:19] : [Step 4/5] [2021-11-19 21:03:19,895][INFO ][main][root] [GridStringLogger echo] Initialized write-ahead log manager [mode=LOG_ONLY] [21:03:19] : [Step 4/5] [2021-11-19 21:03:19,901][INFO ][main][root] [GridStringLogger echo] Configured data regions initialized successfully [total=6] [21:03:19] : [Step 4/5] [2021-11-19 21:03:19,902][INFO ][main][root] [GridStringLogger echo] Resolved snapshot work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/snapshots [21:03:19] : [Step 4/5] [2021-11-19 21:03:19,903][INFO ][main][root] [GridStringLogger echo] Resolved temp directory for snapshot creation: /opt/buildagent/work/7bc1c54bc719b67c/work/db/node01-ac5bdf96-4851-4c10-a439-6cfce448cd9e/snp [21:03:19] : [Step 4/5] [2021-11-19 21:03:19,906][INFO ][main][root] [GridStringLogger echo] Client connector processor has started on TCP port 10801 [21:03:19] : [Step 4/5] [2021-11-19 21:03:19,908][INFO ][main][root] [GridStringLogger echo] Non-loopback local IPs: 172.17.0.4 [21:03:19] : [Step 4/5] [2021-11-19 21:03:19,909][INFO ][main][root] [GridStringLogger echo] Enabled local MACs: 0242AC110004 [21:03:19] : [Step 4/5] [2021-11-19 21:03:19,909][INFO ][main][root] [GridStringLogger echo] Read checkpoint status [startMarker=null, endMarker=null] [21:03:19] : [Step 4/5] [2021-11-19 21:03:19,913][INFO ][main][root] [GridStringLogger echo] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:03:19] : [Step 4/5] [2021-11-19 21:03:19,913][INFO ][main][root] [GridStringLogger echo] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:03:19] : [Step 4/5] [2021-11-19 21:03:19,915][INFO ][main][root] [GridStringLogger echo] Applying lost metastore updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:03:19] : [Step 4/5] [2021-11-19 21:03:19,916][INFO ][main][root] [GridStringLogger echo] Finished applying WAL changes [updatesApplied=0, time=0 ms] [21:03:19] : [Step 4/5] [2021-11-19 21:03:19,916][INFO ][main][root] [GridStringLogger echo] Restoring partition state for local groups. [21:03:19] : [Step 4/5] [2021-11-19 21:03:19,916][INFO ][main][root] [GridStringLogger echo] Finished restoring partition state for local groups [groupsProcessed=0, partitionsProcessed=0, time=0ms] [21:03:19] : [Step 4/5] [2021-11-19 21:03:19,917][INFO ][main][root] [GridStringLogger echo] Encryption keys loaded from metastore. [grps=, masterKeyName=null] [21:03:19] : [Step 4/5] [2021-11-19 21:03:19,918][INFO ][main][root] [GridStringLogger echo] Cluster ID and tag has been read from metastorage: null [21:03:19] : [Step 4/5] [2021-11-19 21:03:19,918][INFO ][main][root] [GridStringLogger echo] Shutdown policy was updated [oldVal=null, newVal=null] [21:03:19] : [Step 4/5] [2021-11-19 21:03:19,918][INFO ][main][root] [GridStringLogger echo] Checkpoint frequency deviation changed [oldVal=null, newVal=null] [21:03:19] : [Step 4/5] [2021-11-19 21:03:19,928][INFO ][main][root] [GridStringLogger echo] Cleanup cache stores [total=1, left=0, cleanFiles=false] [21:03:19] : [Step 4/5] [2021-11-19 21:03:19,933][INFO ][main][root] [GridStringLogger echo] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:03:19] : [Step 4/5] [2021-11-19 21:03:19,934][INFO ][main][root] [GridStringLogger echo] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:03:19] : [Step 4/5] [2021-11-19 21:03:19,938][INFO ][main][root] [GridStringLogger echo] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:03:19] : [Step 4/5] [2021-11-19 21:03:19,938][INFO ][main][root] [GridStringLogger echo] Data Regions Started: 6 [21:03:19] : [Step 4/5] [2021-11-19 21:03:19,939][INFO ][main][root] [GridStringLogger echo] ^-- sysMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:03:19] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:03:19] : [Step 4/5] ^-- default region [type=default, persistence=true, lazyAlloc=true, [21:03:19] : [Step 4/5] ... initCfg=30MB, maxCfg=30MB, usedRam=0MB, freeRam=100%, allocRam=0MB, allocTotal=0MB] [21:03:19] : [Step 4/5] ^-- metastoreMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:03:19] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:03:19] : [Step 4/5] ^-- TxLog region [type=internal, persistence=true, lazyAlloc=false, [21:03:19] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:03:19] : [Step 4/5] ^-- volatileDsMemPlc region [type=user, persistence=false, lazyAlloc=true, [21:03:19] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB] [21:03:19] : [Step 4/5] ^-- userTransientDataRegion region [type=user, persistence=false, lazyAlloc=true, [21:03:19] : [Step 4/5] ... initCfg=20MB, maxCfg=20MB, usedRam=0MB, freeRam=100%, allocRam=0MB] [21:03:19] : [Step 4/5] ^-- Ignite persistence [used=0MB] [21:03:19] : [Step 4/5] [21:03:19] : [Step 4/5] [2021-11-19 21:03:19,940][INFO ][main][root] [GridStringLogger echo] Starting binary memory restore for: [-2100569601] [21:03:19] : [Step 4/5] [2021-11-19 21:03:19,950][INFO ][main][root] [GridStringLogger echo] Read checkpoint status [startMarker=null, endMarker=null] [21:03:19] : [Step 4/5] [2021-11-19 21:03:19,951][INFO ][main][root] [GridStringLogger echo] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:03:19] : [Step 4/5] [2021-11-19 21:03:19,953][INFO ][main][root] [GridStringLogger echo] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/node01-ac5bdf96-4851-4c10-a439-6cfce448cd9e/0000000000000000.wal, offset=0, ver=2] [21:03:19] : [Step 4/5] [2021-11-19 21:03:19,955][INFO ][main][root] [GridStringLogger echo] Started cache in recovery mode [name=ignite-sys-cache, id=-2100569601, dataRegionName=sysMemPlc, mode=REPLICATED, atomicity=TRANSACTIONAL, backups=2147483647, mvcc=false] [21:03:19] : [Step 4/5] [2021-11-19 21:03:19,956][INFO ][main][root] [GridStringLogger echo] Binary recovery performed in 16 ms. [21:03:19] : [Step 4/5] [2021-11-19 21:03:19,957][INFO ][main][root] [GridStringLogger echo] Read checkpoint status [startMarker=null, endMarker=null] [21:03:19] : [Step 4/5] [2021-11-19 21:03:19,957][INFO ][main][root] [GridStringLogger echo] Applying lost cache updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:03:20] : [Step 4/5] [2021-11-19 21:03:20,007][INFO ][main][root] [GridStringLogger echo] Finished applying WAL changes [updatesApplied=0, time=50 ms] [21:03:20] : [Step 4/5] [2021-11-19 21:03:20,007][INFO ][main][root] [GridStringLogger echo] Restoring partition state for local groups. [21:03:20] : [Step 4/5] [2021-11-19 21:03:20,011][INFO ][main][root] [GridStringLogger echo] Finished restoring partition state for local groups [groupsProcessed=1, partitionsProcessed=100, time=0ms] [21:03:20] : [Step 4/5] [2021-11-19 21:03:20,308][INFO ][tcp-disco-srvr-[:47500]-#251%internal.GridNodeMetricsLogPdsSelfTest0%-#5110%internal.GridNodeMetricsLogPdsSelfTest0%][root] [GridStringLogger echo] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=42939] [21:03:20] : [Step 4/5] [2021-11-19 21:03:20,308][INFO ][tcp-disco-srvr-[:47500]-#251%internal.GridNodeMetricsLogPdsSelfTest0%-#5110%internal.GridNodeMetricsLogPdsSelfTest0%][root] [GridStringLogger echo] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=42939] [21:03:20] : [Step 4/5] [2021-11-19 21:03:20,309][INFO ][tcp-disco-sock-reader-[]-#257%internal.GridNodeMetricsLogPdsSelfTest0%-#5230%internal.GridNodeMetricsLogPdsSelfTest0%][root] [GridStringLogger echo] Started serving remote node connection [rmtAddr=/127.0.0.1:42939, rmtPort=42939] [21:03:20] : [Step 4/5] [2021-11-19 21:03:20,310][INFO ][tcp-disco-sock-reader-[26a828be 127.0.0.1:42939]-#257%internal.GridNodeMetricsLogPdsSelfTest0%-#5230%internal.GridNodeMetricsLogPdsSelfTest0%][root] [GridStringLogger echo] Initialized connection with remote server node [nodeId=26a828be-527b-42db-a842-bea7dc000001, rmtAddr=/127.0.0.1:42939] [21:03:20] : [Step 4/5] [2021-11-19 21:03:20,318][INFO ][tcp-disco-srvr-[:47501]-#256%internal.GridNodeMetricsLogPdsSelfTest1%-#5229%internal.GridNodeMetricsLogPdsSelfTest1%][root] [GridStringLogger echo] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=35413] [21:03:20] : [Step 4/5] [2021-11-19 21:03:20,318][INFO ][tcp-disco-srvr-[:47501]-#256%internal.GridNodeMetricsLogPdsSelfTest1%-#5229%internal.GridNodeMetricsLogPdsSelfTest1%][root] [GridStringLogger echo] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=35413] [21:03:20] : [Step 4/5] [2021-11-19 21:03:20,319][INFO ][tcp-disco-sock-reader-[]-#258%internal.GridNodeMetricsLogPdsSelfTest1%-#5231%internal.GridNodeMetricsLogPdsSelfTest1%][root] [GridStringLogger echo] Started serving remote node connection [rmtAddr=/127.0.0.1:35413, rmtPort=35413] [21:03:20] : [Step 4/5] [2021-11-19 21:03:20,319][INFO ][tcp-disco-sock-reader-[]-#258%internal.GridNodeMetricsLogPdsSelfTest1%-#5231%internal.GridNodeMetricsLogPdsSelfTest1%][root] [GridStringLogger echo] Received ping request from the remote node [rmtNodeId=5a320cff-6ba1-49d0-81a3-7e0c09e00000, rmtAddr=/127.0.0.1:35413, rmtPort=35413] [21:03:20] : [Step 4/5] [2021-11-19 21:03:20,321][INFO ][tcp-disco-sock-reader-[]-#258%internal.GridNodeMetricsLogPdsSelfTest1%-#5231%internal.GridNodeMetricsLogPdsSelfTest1%][root] [GridStringLogger echo] Finished writing ping response [rmtNodeId=5a320cff-6ba1-49d0-81a3-7e0c09e00000, rmtAddr=/127.0.0.1:35413, rmtPort=35413] [21:03:20] : [Step 4/5] [2021-11-19 21:03:20,321][INFO ][tcp-disco-sock-reader-[26a828be 127.0.0.1:42939]-#257%internal.GridNodeMetricsLogPdsSelfTest0%-#5230%internal.GridNodeMetricsLogPdsSelfTest0%][root] [GridStringLogger echo] Finished serving remote node connection [rmtAddr=/127.0.0.1:42939, rmtPort=42939, rmtNodeId=26a828be-527b-42db-a842-bea7dc000001] [21:03:20] : [Step 4/5] [2021-11-19 21:03:20,322][INFO ][tcp-disco-sock-reader-[]-#258%internal.GridNodeMetricsLogPdsSelfTest1%-#5231%internal.GridNodeMetricsLogPdsSelfTest1%][root] [GridStringLogger echo] Failed to shutdown socket [21:03:20] : [Step 4/5] [2021-11-19 21:03:20,324][INFO ][tcp-disco-sock-reader-[]-#258%internal.GridNodeMetricsLogPdsSelfTest1%-#5231%internal.GridNodeMetricsLogPdsSelfTest1%][root] [GridStringLogger echo] java.net.SocketException: Socket output is already shutdown [21:03:20] : [Step 4/5] at java.net.Socket.shutdownOutput(Socket.java:1572) [21:03:20] : [Step 4/5] at org.apache.ignite.internal.util.IgniteUtils.close(IgniteUtils.java:4247) [21:03:20] : [Step 4/5] at org.apache.ignite.spi.discovery.tcp.ServerImpl$SocketReader.body(ServerImpl.java:7370) [21:03:20] : [Step 4/5] at org.apache.ignite.spi.IgniteSpiThread.run(IgniteSpiThread.java:58) [21:03:20] : [Step 4/5] [21:03:20] : [Step 4/5] [2021-11-19 21:03:20,324][INFO ][tcp-disco-msg-worker-[crd]-#250%internal.GridNodeMetricsLogPdsSelfTest0%-#5109%internal.GridNodeMetricsLogPdsSelfTest0%][root] [GridStringLogger echo] Joining node doesn't have stored group keys [node=26a828be-527b-42db-a842-bea7dc000001] [21:03:20] : [Step 4/5] [2021-11-19 21:03:20,325][INFO ][tcp-disco-sock-reader-[]-#258%internal.GridNodeMetricsLogPdsSelfTest1%-#5231%internal.GridNodeMetricsLogPdsSelfTest1%][root] [GridStringLogger echo] Finished serving remote node connection [rmtAddr=/127.0.0.1:35413, rmtPort=35413, rmtNodeId=null] [21:03:20] : [Step 4/5] [2021-11-19 21:03:20,335][INFO ][tcp-disco-msg-worker-[crd]-#250%internal.GridNodeMetricsLogPdsSelfTest0%-#5109%internal.GridNodeMetricsLogPdsSelfTest0%][root] [GridStringLogger echo] New next node [newNext=TcpDiscoveryNode [id=26a828be-527b-42db-a842-bea7dc000001, consistentId=ac5bdf96-4851-4c10-a439-6cfce448cd9e, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=0, intOrder=2, lastExchangeTime=1637345000316, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false]] [21:03:20] : [Step 4/5] [2021-11-19 21:03:20,337][INFO ][tcp-disco-srvr-[:47501]-#256%internal.GridNodeMetricsLogPdsSelfTest1%-#5229%internal.GridNodeMetricsLogPdsSelfTest1%][root] [GridStringLogger echo] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=37927] [21:03:20] : [Step 4/5] [2021-11-19 21:03:20,337][INFO ][tcp-disco-srvr-[:47501]-#256%internal.GridNodeMetricsLogPdsSelfTest1%-#5229%internal.GridNodeMetricsLogPdsSelfTest1%][root] [GridStringLogger echo] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=37927] [21:03:20] : [Step 4/5] [2021-11-19 21:03:20,338][INFO ][tcp-disco-sock-reader-[]-#259%internal.GridNodeMetricsLogPdsSelfTest1%-#5232%internal.GridNodeMetricsLogPdsSelfTest1%][root] [GridStringLogger echo] Started serving remote node connection [rmtAddr=/127.0.0.1:37927, rmtPort=37927] [21:03:20] : [Step 4/5] [2021-11-19 21:03:20,339][INFO ][tcp-disco-sock-reader-[5a320cff 127.0.0.1:37927]-#259%internal.GridNodeMetricsLogPdsSelfTest1%-#5232%internal.GridNodeMetricsLogPdsSelfTest1%][root] [GridStringLogger echo] Initialized connection with remote server node [nodeId=5a320cff-6ba1-49d0-81a3-7e0c09e00000, rmtAddr=/127.0.0.1:37927] [21:03:20] : [Step 4/5] [2021-11-19 21:03:20,344][INFO ][tcp-disco-msg-worker-[]-#255%internal.GridNodeMetricsLogPdsSelfTest1%-#5228%internal.GridNodeMetricsLogPdsSelfTest1%][root] [GridStringLogger echo] New next node [newNext=TcpDiscoveryNode [id=5a320cff-6ba1-49d0-81a3-7e0c09e00000, consistentId=2fadaaf7-63e4-4de5-9a38-471957431855, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345000336, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false]] [21:03:20] : [Step 4/5] [2021-11-19 21:03:20,345][INFO ][tcp-disco-srvr-[:47500]-#251%internal.GridNodeMetricsLogPdsSelfTest0%-#5110%internal.GridNodeMetricsLogPdsSelfTest0%][root] [GridStringLogger echo] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=50455] [21:03:20] : [Step 4/5] [2021-11-19 21:03:20,346][INFO ][tcp-disco-srvr-[:47500]-#251%internal.GridNodeMetricsLogPdsSelfTest0%-#5110%internal.GridNodeMetricsLogPdsSelfTest0%][root] [GridStringLogger echo] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=50455] [21:03:20] : [Step 4/5] [2021-11-19 21:03:20,347][INFO ][tcp-disco-sock-reader-[]-#260%internal.GridNodeMetricsLogPdsSelfTest0%-#5233%internal.GridNodeMetricsLogPdsSelfTest0%][root] [GridStringLogger echo] Started serving remote node connection [rmtAddr=/127.0.0.1:50455, rmtPort=50455] [21:03:20] : [Step 4/5] [2021-11-19 21:03:20,349][INFO ][tcp-disco-sock-reader-[26a828be 127.0.0.1:50455]-#260%internal.GridNodeMetricsLogPdsSelfTest0%-#5233%internal.GridNodeMetricsLogPdsSelfTest0%][root] [GridStringLogger echo] Initialized connection with remote server node [nodeId=26a828be-527b-42db-a842-bea7dc000001, rmtAddr=/127.0.0.1:50455] [21:03:20] : [Step 4/5] [2021-11-19 21:03:20,352][INFO ][disco-event-worker-#5112%internal.GridNodeMetricsLogPdsSelfTest0%][root] [GridStringLogger echo] Added new node to topology: TcpDiscoveryNode [id=26a828be-527b-42db-a842-bea7dc000001, consistentId=ac5bdf96-4851-4c10-a439-6cfce448cd9e, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637345000316, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false] [21:03:20] : [Step 4/5] [2021-11-19 21:03:20,354][INFO ][disco-event-worker-#5112%internal.GridNodeMetricsLogPdsSelfTest0%][root] [GridStringLogger echo] Topology snapshot [ver=2, locNode=5a320cff, servers=2, clients=0, state=INACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=5a320cff-6ba1-49d0-81a3-7e0c09e00000, consistentId=2fadaaf7-63e4-4de5-9a38-471957431855, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=26a828be-527b-42db-a842-bea7dc000001, consistentId=ac5bdf96-4851-4c10-a439-6cfce448cd9e, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:03:20] : [Step 4/5] [2021-11-19 21:03:20,357][INFO ][tcp-disco-msg-worker-[5a320cff 127.0.0.1:47500]-#255%internal.GridNodeMetricsLogPdsSelfTest1%-#5228%internal.GridNodeMetricsLogPdsSelfTest1%][root] [GridStringLogger echo] youthful_chatelet [21:03:20] : [Step 4/5] [2021-11-19 21:03:20,357][INFO ][tcp-disco-msg-worker-[5a320cff 127.0.0.1:47500]-#255%internal.GridNodeMetricsLogPdsSelfTest1%-#5228%internal.GridNodeMetricsLogPdsSelfTest1%][root] [GridStringLogger echo] Baseline parameter 'baselineAutoAdjustEnabled' was changed from 'null' to 'false' [21:03:20] : [Step 4/5] [2021-11-19 21:03:20,358][INFO ][tcp-disco-msg-worker-[5a320cff 127.0.0.1:47500]-#255%internal.GridNodeMetricsLogPdsSelfTest1%-#5228%internal.GridNodeMetricsLogPdsSelfTest1%][root] [GridStringLogger echo] Baseline parameter 'baselineAutoAdjustTimeout' was changed from 'null' to '300000' [21:03:20] : [Step 4/5] [2021-11-19 21:03:20,358][INFO ][tcp-disco-msg-worker-[5a320cff 127.0.0.1:47500]-#255%internal.GridNodeMetricsLogPdsSelfTest1%-#5228%internal.GridNodeMetricsLogPdsSelfTest1%][root] [GridStringLogger echo] Transactions parameter 'longOperationsDumpTimeout' was changed from 'null' to '60000' [21:03:20] : [Step 4/5] [2021-11-19 21:03:20,359][INFO ][tcp-disco-msg-worker-[5a320cff 127.0.0.1:47500]-#255%internal.GridNodeMetricsLogPdsSelfTest1%-#5228%internal.GridNodeMetricsLogPdsSelfTest1%][root] [GridStringLogger echo] Transactions parameter 'longTransactionTimeDumpThreshold' was changed from 'null' to '0' [21:03:20] : [Step 4/5] [2021-11-19 21:03:20,360][INFO ][grid-timeout-worker-#5050%internal.GridNodeMetricsLogPdsSelfTest0%][root] [GridStringLogger echo] [21:03:20] : [Step 4/5] Metrics for local node (to disable set 'metricsLogFrequency' to 0) [21:03:20] : [Step 4/5] ^-- Node [id=5a320cff, name=internal.GridNodeMetricsLogPdsSelfTest0, uptime=00:00:02.027] [21:03:20] : [Step 4/5] ^-- Cluster [hosts=1, CPUs=24, servers=2, clients=0, topVer=2, minorTopVer=0] [21:03:20] : [Step 4/5] ^-- Network [addrs=[127.0.0.1], localHost=127.0.0.1, discoPort=47500, commPort=45100] [21:03:20] : [Step 4/5] ^-- CPU [CPUs=24, curLoad=0%, avgLoad=0%, GC=0%] [21:03:20] : [Step 4/5] ^-- Heap [used=589MB, free=69.89%, comm=1956MB] [21:03:20] : [Step 4/5] ^-- Off-heap memory [used=0MB, free=99.99%, allocated=199MB] [21:03:20] : [Step 4/5] ^-- Page memory [pages=9] [21:03:20] : [Step 4/5] ^-- sysMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:03:20] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=99.98%, allocRam=99MB, allocTotal=0MB] [21:03:20] : [Step 4/5] ^-- default region [type=default, persistence=true, lazyAlloc=true, [21:03:20] : [Step 4/5] ... initCfg=30MB, maxCfg=30MB, usedRam=0MB, freeRam=100%, allocRam=0MB, allocTotal=0MB] [21:03:20] : [Step 4/5] ^-- metastoreMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:03:20] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=99.98%, allocRam=0MB, allocTotal=0MB] [21:03:20] : [Step 4/5] ^-- TxLog region [type=internal, persistence=true, lazyAlloc=false, [21:03:20] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:03:20] : [Step 4/5] ^-- volatileDsMemPlc region [type=user, persistence=false, lazyAlloc=true, [21:03:20] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB] [21:03:20] : [Step 4/5] ^-- userTransientDataRegion region [type=user, persistence=false, lazyAlloc=true, [21:03:20] : [Step 4/5] ... initCfg=20MB, maxCfg=20MB, usedRam=0MB, freeRam=100%, allocRam=0MB] [21:03:20] : [Step 4/5] ^-- Ignite persistence [used=0MB] [21:03:20] : [Step 4/5] ^-- Outbound messages queue [size=0] [21:03:20] : [Step 4/5] ^-- Public thread pool [active=0, idle=5, qSize=0] [21:03:20] : [Step 4/5] ^-- System thread pool [active=0, idle=24, qSize=0] [21:03:20] : [Step 4/5] ^-- Striped thread pool [active=0, idle=24, qSize=0] [21:03:20] : [Step 4/5] ^-- Custom executor 0 [active=0, idle=0, qSize=0] [21:03:20] : [Step 4/5] ^-- Custom executor 1 [active=0, idle=0, qSize=0] [21:03:20] : [Step 4/5] [2021-11-19 21:03:20,363][INFO ][tcp-disco-msg-worker-[5a320cff 127.0.0.1:47500]-#255%internal.GridNodeMetricsLogPdsSelfTest1%-#5228%internal.GridNodeMetricsLogPdsSelfTest1%][root] [GridStringLogger echo] Transactions parameter 'transactionTimeDumpSamplesCoefficient' was changed from 'null' to '0.0' [21:03:20] : [Step 4/5] [2021-11-19 21:03:20,364][INFO ][tcp-disco-msg-worker-[5a320cff 127.0.0.1:47500]-#255%internal.GridNodeMetricsLogPdsSelfTest1%-#5228%internal.GridNodeMetricsLogPdsSelfTest1%][root] [GridStringLogger echo] Transactions parameter 'longTransactionTimeDumpSamplesPerSecondLimit' was changed from 'null' to '5' [21:03:20] : [Step 4/5] [2021-11-19 21:03:20,364][INFO ][tcp-disco-msg-worker-[5a320cff 127.0.0.1:47500]-#255%internal.GridNodeMetricsLogPdsSelfTest1%-#5228%internal.GridNodeMetricsLogPdsSelfTest1%][root] [GridStringLogger echo] Transactions parameter 'collisionsDumpInterval' was changed from 'null' to '1000' [21:03:20] : [Step 4/5] [2021-11-19 21:03:20,365][INFO ][tcp-disco-msg-worker-[5a320cff 127.0.0.1:47500]-#255%internal.GridNodeMetricsLogPdsSelfTest1%-#5228%internal.GridNodeMetricsLogPdsSelfTest1%][root] [GridStringLogger echo] Transactions parameter 'txOwnerDumpRequestsAllowed' was changed from 'null' to 'true' [21:03:20] : [Step 4/5] [2021-11-19 21:03:20,366][INFO ][tcp-disco-msg-worker-[5a320cff 127.0.0.1:47500]-#255%internal.GridNodeMetricsLogPdsSelfTest1%-#5228%internal.GridNodeMetricsLogPdsSelfTest1%][root] [GridStringLogger echo] Historical rebalance WAL threshold changed [property=historical.rebalance.threshold, oldVal=null, newVal=500] [21:03:20] : [Step 4/5] [2021-11-19 21:03:20,367][INFO ][disco-notifier-worker-#5227%internal.GridNodeMetricsLogPdsSelfTest1%][root] [GridStringLogger echo] Assigned mvcc coordinator [crd=MvccCoordinator [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=0], nodeId=5a320cff-6ba1-49d0-81a3-7e0c09e00000, ver=1637344998310, local=false, initialized=false]] [21:03:20] : [Step 4/5] [2021-11-19 21:03:20,381][INFO ][sys-#5226%internal.GridNodeMetricsLogPdsSelfTest1%][root] [GridStringLogger echo] Writing cluster ID and tag to metastorage on ready for write ClusterIdAndTag [id=c2c4b664-065f-44c4-9c8b-5982a73ca684, tag=youthful_chatelet] [21:03:20] : [Step 4/5] [2021-11-19 21:03:20,404][INFO ][main][root] [GridStringLogger echo] To start Console Management & Monitoring run ignitevisorcmd.{sh|bat} [21:03:20] : [Step 4/5] [2021-11-19 21:03:20,404][INFO ][main][root] [GridStringLogger echo] [21:03:20] : [Step 4/5] [21:03:20] : [Step 4/5] >>> +-------------------------------------------+ [21:03:20] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:03:20] : [Step 4/5] >>> +-------------------------------------------+ [21:03:20] : [Step 4/5] >>> OS name: Linux 4.15.0-151-generic amd64 [21:03:20] : [Step 4/5] >>> CPU(s): 24 [21:03:20] : [Step 4/5] >>> Heap: 2.0GB [21:03:20] : [Step 4/5] >>> VM name: 16724@c4dfe9a430b2 [21:03:20] : [Step 4/5] >>> Ignite instance name: internal.GridNodeMetricsLogPdsSelfTest1 [21:03:20] : [Step 4/5] >>> Local node [ID=26A828BE-527B-42DB-A842-BEA7DC000001, order=2, clientMode=false] [21:03:20] : [Step 4/5] >>> Local node addresses: [127.0.0.1] [21:03:20] : [Step 4/5] >>> Local ports: TCP:10801 TCP:45101 TCP:47501 [21:03:20] : [Step 4/5] [21:03:20] : [Step 4/5] [2021-11-19 21:03:20,405][INFO ][main][root] [GridStringLogger echo] >>> Ignite cluster is in INACTIVE state (limited functionality available). Use control.(sh|bat) script or IgniteCluster.state(ClusterState.ACTIVE) to change the state. [21:03:20] : [Step 4/5] [2021-11-19 21:03:20,406][INFO ][main][root] [GridStringLogger echo] Topology snapshot [ver=2, locNode=26a828be, servers=2, clients=0, state=INACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=5a320cff-6ba1-49d0-81a3-7e0c09e00000, consistentId=2fadaaf7-63e4-4de5-9a38-471957431855, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=26a828be-527b-42db-a842-bea7dc000001, consistentId=ac5bdf96-4851-4c10-a439-6cfce448cd9e, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:03:20] : [Step 4/5] [2021-11-19 21:03:20,407][INFO ][main][root] [GridStringLogger echo] Node started : [stage="Configure system pool" (0 ms),stage="Start managers" (1113 ms),stage="Configure binary metadata" (3 ms),stage="Start processors" (438 ms),stage="Start 'StanByClusterTestProvider' plugin" (0 ms),stage="Start 'PageMemory tracker plugin' plugin" (0 ms),stage="Start 'TestDistibutedConfigurationPlugin' plugin" (0 ms),stage="Start 'NodeValidationPluginProvider' plugin" (0 ms),stage="Init metastore" (19 ms),stage="Init and start regions" (12 ms),stage="Restore binary memory" (16 ms),stage="Restore logical state" (55 ms),stage="Finish recovery" (290 ms),stage="Join topology" (64 ms),stage="Await transition" (15 ms),stage="Await exchange" (24 ms),stage="Total time" (2049 ms)] [21:03:20] : [Step 4/5] [2021-11-19 21:03:20,409][INFO ][main][root] Node started with the following configuration [id=26a828be-527b-42db-a842-bea7dc000001, marshaller=BinaryMarshaller [], discovery=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=5000, ackTimeout=5000, marsh=JdkMarshaller [clsFilter=org.apache.ignite.marshaller.MarshallerUtils$1@7d979d34], reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], binaryCfg=null, lateAff=true] [21:03:20] : [Step 4/5] [2021-11-19 21:03:20,411][INFO ][main][root] [GridStringLogger echo] Sending activate cluster request with BaselineTopology BaselineTopology [id=0, branchingHash=-3662812350, branchingType='New BaselineTopology', baselineNodes=[2fadaaf7-63e4-4de5-9a38-471957431855, ac5bdf96-4851-4c10-a439-6cfce448cd9e]] [21:03:20] : [Step 4/5] [2021-11-19 21:03:20,417][INFO ][disco-notifier-worker-#5108%internal.GridNodeMetricsLogPdsSelfTest0%][root] [GridStringLogger echo] Received activate cluster request with BaselineTopology[id=0] initiator node ID: 5a320cff-6ba1-49d0-81a3-7e0c09e00000 [21:03:20] : [Step 4/5] [2021-11-19 21:03:20,418][INFO ][disco-notifier-worker-#5108%internal.GridNodeMetricsLogPdsSelfTest0%][root] [GridStringLogger echo] Started state transition: activate cluster [21:03:20] : [Step 4/5] [2021-11-19 21:03:20,419][INFO ][exchange-worker-#5113%internal.GridNodeMetricsLogPdsSelfTest0%][root] [GridStringLogger echo] Started exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], crd=true, evt=DISCOVERY_CUSTOM_EVT, evtNode=5a320cff-6ba1-49d0-81a3-7e0c09e00000, customEvt=ChangeGlobalStateMessage [id=e321d593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqId=d2c58069-4fe8-4003-9d47-b903e0570a4a, initiatingNodeId=5a320cff-6ba1-49d0-81a3-7e0c09e00000, state=ACTIVE, baselineTopology=BaselineTopology [id=0, branchingHash=-3662812350, branchingType='New BaselineTopology', baselineNodes=[2fadaaf7-63e4-4de5-9a38-471957431855, ac5bdf96-4851-4c10-a439-6cfce448cd9e]], forceChangeBaselineTopology=false, timestamp=1637345000411, forceDeactivation=true], allowMerge=false, exchangeFreeSwitch=false] [21:03:20] : [Step 4/5] [2021-11-19 21:03:20,420][INFO ][exchange-worker-#5113%internal.GridNodeMetricsLogPdsSelfTest0%][root] [GridStringLogger echo] Start activation process [nodeId=5a320cff-6ba1-49d0-81a3-7e0c09e00000, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]]. New state: ACTIVE [21:03:20] : [Step 4/5] [2021-11-19 21:03:20,421][INFO ][exchange-worker-#5113%internal.GridNodeMetricsLogPdsSelfTest0%][root] [GridStringLogger echo] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/node00-2fadaaf7-63e4-4de5-9a38-471957431855 [21:03:20] : [Step 4/5] [2021-11-19 21:03:20,422][INFO ][disco-notifier-worker-#5227%internal.GridNodeMetricsLogPdsSelfTest1%][root] [GridStringLogger echo] Received activate cluster request with BaselineTopology[id=0] initiator node ID: 5a320cff-6ba1-49d0-81a3-7e0c09e00000 [21:03:20] : [Step 4/5] [2021-11-19 21:03:20,423][INFO ][disco-notifier-worker-#5227%internal.GridNodeMetricsLogPdsSelfTest1%][root] [GridStringLogger echo] Started state transition: activate cluster [21:03:20] : [Step 4/5] [2021-11-19 21:03:20,423][INFO ][exchange-worker-#5113%internal.GridNodeMetricsLogPdsSelfTest0%][root] [GridStringLogger echo] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/node00-2fadaaf7-63e4-4de5-9a38-471957431855/0000000000000000.wal, offset=8795, ver=2] [21:03:20] : [Step 4/5] [2021-11-19 21:03:20,424][INFO ][exchange-worker-#5236%internal.GridNodeMetricsLogPdsSelfTest1%][root] [GridStringLogger echo] Started exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], crd=false, evt=DISCOVERY_CUSTOM_EVT, evtNode=5a320cff-6ba1-49d0-81a3-7e0c09e00000, customEvt=ChangeGlobalStateMessage [id=e321d593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqId=d2c58069-4fe8-4003-9d47-b903e0570a4a, initiatingNodeId=5a320cff-6ba1-49d0-81a3-7e0c09e00000, state=ACTIVE, baselineTopology=BaselineTopology [id=0, branchingHash=-3662812350, branchingType='New BaselineTopology', baselineNodes=[2fadaaf7-63e4-4de5-9a38-471957431855, ac5bdf96-4851-4c10-a439-6cfce448cd9e]], forceChangeBaselineTopology=false, timestamp=1637345000411, forceDeactivation=true], allowMerge=false, exchangeFreeSwitch=false] [21:03:20] : [Step 4/5] [2021-11-19 21:03:20,427][INFO ][exchange-worker-#5236%internal.GridNodeMetricsLogPdsSelfTest1%][root] [GridStringLogger echo] Start activation process [nodeId=26a828be-527b-42db-a842-bea7dc000001, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]]. New state: ACTIVE [21:03:20] : [Step 4/5] [2021-11-19 21:03:20,428][INFO ][exchange-worker-#5236%internal.GridNodeMetricsLogPdsSelfTest1%][root] [GridStringLogger echo] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/node01-ac5bdf96-4851-4c10-a439-6cfce448cd9e [21:03:20] : [Step 4/5] [2021-11-19 21:03:20,428][INFO ][exchange-worker-#5113%internal.GridNodeMetricsLogPdsSelfTest0%][root] [GridStringLogger echo] Writing BaselineTopology[id=0] [21:03:20] : [Step 4/5] [2021-11-19 21:03:20,433][INFO ][exchange-worker-#5113%internal.GridNodeMetricsLogPdsSelfTest0%][root] [GridStringLogger echo] Finish recovery performed in 12 ms. [21:03:20] : [Step 4/5] [2021-11-19 21:03:20,437][INFO ][exchange-worker-#5113%internal.GridNodeMetricsLogPdsSelfTest0%][root] [GridStringLogger echo] Components activation performed in 16 ms. [21:03:20] : [Step 4/5] [2021-11-19 21:03:20,438][INFO ][exchange-worker-#5236%internal.GridNodeMetricsLogPdsSelfTest1%][root] [GridStringLogger echo] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/node01-ac5bdf96-4851-4c10-a439-6cfce448cd9e/0000000000000000.wal, offset=8795, ver=2] [21:03:20] : [Step 4/5] [2021-11-19 21:03:20,442][INFO ][exchange-worker-#5236%internal.GridNodeMetricsLogPdsSelfTest1%][root] [GridStringLogger echo] Writing BaselineTopology[id=0] [21:03:20] : [Step 4/5] [2021-11-19 21:03:20,445][INFO ][exchange-worker-#5236%internal.GridNodeMetricsLogPdsSelfTest1%][root] [GridStringLogger echo] Finish recovery performed in 16 ms. [21:03:20] : [Step 4/5] [2021-11-19 21:03:20,446][INFO ][exchange-worker-#5113%internal.GridNodeMetricsLogPdsSelfTest0%][root] [GridStringLogger echo] Finished recovery for cache [cache=ignite-sys-cache, grp=ignite-sys-cache, startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:03:20] : [Step 4/5] [2021-11-19 21:03:20,461][INFO ][exchange-worker-#5113%internal.GridNodeMetricsLogPdsSelfTest0%][root] [GridStringLogger echo] Successfully activated caches [nodeId=5a320cff-6ba1-49d0-81a3-7e0c09e00000, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], newState=ACTIVE] [21:03:20] : [Step 4/5] [2021-11-19 21:03:20,461][INFO ][exchange-worker-#5236%internal.GridNodeMetricsLogPdsSelfTest1%][root] [GridStringLogger echo] Components activation performed in 29 ms. [21:03:20] : [Step 4/5] [2021-11-19 21:03:20,462][INFO ][exchange-worker-#5236%internal.GridNodeMetricsLogPdsSelfTest1%][root] [GridStringLogger echo] Finished recovery for cache [cache=ignite-sys-cache, grp=ignite-sys-cache, startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:03:20] : [Step 4/5] [2021-11-19 21:03:20,463][INFO ][exchange-worker-#5236%internal.GridNodeMetricsLogPdsSelfTest1%][root] [GridStringLogger echo] Successfully activated caches [nodeId=26a828be-527b-42db-a842-bea7dc000001, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], newState=ACTIVE] [21:03:20] : [Step 4/5] [2021-11-19 21:03:20,464][INFO ][exchange-worker-#5236%internal.GridNodeMetricsLogPdsSelfTest1%][root] [GridStringLogger echo] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:03:20] : [Step 4/5] [2021-11-19 21:03:20,468][INFO ][exchange-worker-#5113%internal.GridNodeMetricsLogPdsSelfTest0%][root] [GridStringLogger echo] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:03:20] : [Step 4/5] [2021-11-19 21:03:20,490][INFO ][exchange-worker-#5113%internal.GridNodeMetricsLogPdsSelfTest0%][root] [GridStringLogger echo] Finished exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], crd=true] [21:03:20] : [Step 4/5] [2021-11-19 21:03:20,494][INFO ][db-checkpoint-thread-#5248%internal.GridNodeMetricsLogPdsSelfTest1%][root] [GridStringLogger echo] Checkpoint started [checkpointId=dfb83ff0-c7fb-4c40-b3f7-04a0e8c74ce1, startPtr=WALPointer [idx=0, fileOff=87365, len=1963], checkpointBeforeLockTime=3ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=2ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=1ms, pages=18, reason='node started'] [21:03:20] : [Step 4/5] [2021-11-19 21:03:20,494][INFO ][grid-nio-worker-tcp-comm-0-#5051%TcpCommunicationSpi%][root] [GridStringLogger echo] Accepted incoming communication connection [locAddr=/127.0.0.1:45100, rmtAddr=/127.0.0.1:40690] [21:03:20] : [Step 4/5] [2021-11-19 21:03:20,498][INFO ][db-checkpoint-thread-#5247%internal.GridNodeMetricsLogPdsSelfTest0%][root] [GridStringLogger echo] Checkpoint started [checkpointId=86f99b9b-e719-4d14-bc34-636b4bd8c7e2, startPtr=WALPointer [idx=0, fileOff=87365, len=1963], checkpointBeforeLockTime=10ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=2ms, writeCheckpointEntryDuration=4ms, splitAndSortCpPagesDuration=0ms, pages=18, reason='node started'] [21:03:20] : [Step 4/5] [2021-11-19 21:03:20,498][INFO ][grid-nio-worker-tcp-comm-0-#5170%TcpCommunicationSpi%][root] [GridStringLogger echo] Established outgoing communication connection [locAddr=/127.0.0.1:40690, rmtAddr=/127.0.0.1:45100] [21:03:20] : [Step 4/5] [2021-11-19 21:03:20,500][INFO ][exchange-worker-#5236%internal.GridNodeMetricsLogPdsSelfTest1%][root] [GridStringLogger echo] Finished exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], crd=false] [21:03:20] : [Step 4/5] [2021-11-19 21:03:20,503][INFO ][sys-#5088%internal.GridNodeMetricsLogPdsSelfTest0%][root] [GridStringLogger echo] Coordinator received single message [ver=AffinityTopologyVersion [topVer=2, minorTopVer=1], node=26a828be-527b-42db-a842-bea7dc000001, allReceived=true] [21:03:20] : [Step 4/5] [2021-11-19 21:03:20,503][INFO ][sys-#5088%internal.GridNodeMetricsLogPdsSelfTest0%][root] [GridStringLogger echo] finishExchangeOnCoordinator [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:03:20] : [Step 4/5] [2021-11-19 21:03:20,512][INFO ][sys-#5088%internal.GridNodeMetricsLogPdsSelfTest0%][root] [GridStringLogger echo] Finish exchange future [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], err=null, rebalanced=true, wasRebalanced=false] [21:03:20] : [Step 4/5] [2021-11-19 21:03:20,521][INFO ][disco-notifier-worker-#5108%internal.GridNodeMetricsLogPdsSelfTest0%][root] [GridStringLogger echo] Received state change finish message: ACTIVE [21:03:20] : [Step 4/5] [2021-11-19 21:03:20,537][INFO ][sys-#5211%internal.GridNodeMetricsLogPdsSelfTest1%][root] [GridStringLogger echo] Received full message, will finish exchange [node=5a320cff-6ba1-49d0-81a3-7e0c09e00000, resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:03:20] : [Step 4/5] [2021-11-19 21:03:20,537][INFO ][sys-#5216%internal.GridNodeMetricsLogPdsSelfTest1%][root] [GridStringLogger echo] Delay process full message without exchange id (there is exchange in progress) [nodeId=5a320cff-6ba1-49d0-81a3-7e0c09e00000] [21:03:20] : [Step 4/5] [2021-11-19 21:03:20,538][INFO ][disco-notifier-worker-#5108%internal.GridNodeMetricsLogPdsSelfTest0%][root] [GridStringLogger echo] Cluster state was changed from INACTIVE to ACTIVE [21:03:20] : [Step 4/5] [2021-11-19 21:03:20,538][INFO ][disco-notifier-worker-#5227%internal.GridNodeMetricsLogPdsSelfTest1%][root] [GridStringLogger echo] Received state change finish message: ACTIVE [21:03:20] : [Step 4/5] [2021-11-19 21:03:20,539][INFO ][disco-notifier-worker-#5227%internal.GridNodeMetricsLogPdsSelfTest1%][root] [GridStringLogger echo] Cluster state was changed from INACTIVE to ACTIVE [21:03:20] : [Step 4/5] [2021-11-19 21:03:20,540][INFO ][db-checkpoint-thread-#5247%internal.GridNodeMetricsLogPdsSelfTest0%][root] [GridStringLogger echo] Checkpoint finished [cpId=86f99b9b-e719-4d14-bc34-636b4bd8c7e2, pages=18, markPos=WALPointer [idx=0, fileOff=87365, len=1963], walSegmentsCovered=[], markDuration=8ms, pagesWrite=3ms, fsync=37ms, total=58ms] [21:03:20] : [Step 4/5] [2021-11-19 21:03:20,541][INFO ][db-checkpoint-thread-#5248%internal.GridNodeMetricsLogPdsSelfTest1%][root] [GridStringLogger echo] Checkpoint finished [cpId=dfb83ff0-c7fb-4c40-b3f7-04a0e8c74ce1, pages=18, markPos=WALPointer [idx=0, fileOff=87365, len=1963], walSegmentsCovered=[], markDuration=4ms, pagesWrite=7ms, fsync=37ms, total=51ms] [21:03:20] : [Step 4/5] [2021-11-19 21:03:20,542][INFO ][sys-#5088%internal.GridNodeMetricsLogPdsSelfTest0%][root] [GridStringLogger echo] Finish proxy initialization, cacheName=ignite-sys-cache, localNodeId=5a320cff-6ba1-49d0-81a3-7e0c09e00000 [21:03:20] : [Step 4/5] [2021-11-19 21:03:20,542][INFO ][sys-#5211%internal.GridNodeMetricsLogPdsSelfTest1%][root] [GridStringLogger echo] Finish exchange future [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], err=null, rebalanced=true, wasRebalanced=false] [21:03:20] : [Step 4/5] [2021-11-19 21:03:20,543][INFO ][exchange-worker-#5113%internal.GridNodeMetricsLogPdsSelfTest0%][root] [GridStringLogger echo] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=2, minorTopVer=1], force=false, evt=DISCOVERY_CUSTOM_EVT, node=5a320cff-6ba1-49d0-81a3-7e0c09e00000] [21:03:20] : [Step 4/5] [2021-11-19 21:03:20,549][INFO ][sys-#5088%internal.GridNodeMetricsLogPdsSelfTest0%][root] [GridStringLogger echo] Completed partition exchange [localNode=5a320cff-6ba1-49d0-81a3-7e0c09e00000, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=5a320cff-6ba1-49d0-81a3-7e0c09e00000, consistentId=2fadaaf7-63e4-4de5-9a38-471957431855, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345000519, loc=true, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:03:20] : [Step 4/5] [2021-11-19 21:03:20,551][INFO ][sys-#5088%internal.GridNodeMetricsLogPdsSelfTest0%][root] [GridStringLogger echo] Exchange timings [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (1 ms), stage="Update caches registry" (18 ms), stage="Start caches" (21 ms), stage="Affinity initialization on cache group start" (0 ms), stage="Determine exchange type" (7 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Restore partition states" (0 ms), stage="After states restored callback" (21 ms), stage="WAL history reservation" (0 ms), stage="Waiting for all single messages" (13 ms), stage="Affinity recalculation (crd)" (0 ms), stage="Collect update counters and create affinity messages" (0 ms), stage="Assign partitions states" (1 ms), stage="Validate partitions states" (0 ms), stage="Ideal affinity diff calculation (enforced)" (0 ms), stage="Apply update counters" (0 ms), stage="Full message preparing" (5 ms), stage="Full message sending" (0 ms), stage="State finish message sending" (1 ms), stage="Detect lost partitions" (11 ms), stage="Exchange done" (26 ms), stage="Total time" (125 ms), Discovery lag=5 ms, Latest started node id=26a828be-527b-42db-a842-bea7dc000001] [21:03:20] : [Step 4/5] [2021-11-19 21:03:20,553][INFO ][sys-#5105%internal.GridNodeMetricsLogPdsSelfTest0%][root] [GridStringLogger echo] Baseline auto-adjust is 'disabled' with timeout='300000' ms [21:03:20] : [Step 4/5] [2021-11-19 21:03:20,553][INFO ][sys-#5088%internal.GridNodeMetricsLogPdsSelfTest0%][root] [GridStringLogger echo] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], stage="Affinity initialization on cache group start [grp=ignite-sys-cache]" (0 ms) (parent=Affinity initialization on cache group start), stage="Affinity centralized initialization (crd) [grp=ignite-sys-cache, crd=true]" (0 ms) (parent=Determine exchange type), stage="Restore partition states [grp=ignite-sys-cache]" (0 ms) (parent=Restore partition states), stage="Affinity recalculation (partitions availability) [grp=ignite-sys-cache]" (0 ms) (parent=Ideal affinity diff calculation (enforced))] [21:03:20] : [Step 4/5] [2021-11-19 21:03:20,554][INFO ][sys-#5211%internal.GridNodeMetricsLogPdsSelfTest1%][root] [GridStringLogger echo] Finish proxy initialization, cacheName=ignite-sys-cache, localNodeId=26a828be-527b-42db-a842-bea7dc000001 [21:03:20] : [Step 4/5] [2021-11-19 21:03:20,555][INFO ][sys-#5105%internal.GridNodeMetricsLogPdsSelfTest0%][root] [GridStringLogger echo] Successfully performed final activation steps [nodeId=5a320cff-6ba1-49d0-81a3-7e0c09e00000, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:03:20] : [Step 4/5] [2021-11-19 21:03:20,561][INFO ][sys-#5221%internal.GridNodeMetricsLogPdsSelfTest1%][root] [GridStringLogger echo] Baseline auto-adjust is 'disabled' with timeout='300000' ms [21:03:20] : [Step 4/5] [2021-11-19 21:03:20,561][INFO ][sys-#5221%internal.GridNodeMetricsLogPdsSelfTest1%][root] [GridStringLogger echo] Successfully performed final activation steps [nodeId=26a828be-527b-42db-a842-bea7dc000001, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:03:20] : [Step 4/5] [2021-11-19 21:03:20,561][INFO ][sys-#5211%internal.GridNodeMetricsLogPdsSelfTest1%][root] [GridStringLogger echo] Completed partition exchange [localNode=26a828be-527b-42db-a842-bea7dc000001, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=5a320cff-6ba1-49d0-81a3-7e0c09e00000, consistentId=2fadaaf7-63e4-4de5-9a38-471957431855, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345000336, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:03:20] : [Step 4/5] [2021-11-19 21:03:20,563][INFO ][sys-#5211%internal.GridNodeMetricsLogPdsSelfTest1%][root] [GridStringLogger echo] Exchange timings [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (3 ms), stage="Update caches registry" (34 ms), stage="Start caches" (0 ms), stage="Affinity initialization on cache group start" (0 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Restore partition states" (0 ms), stage="After states restored callback" (25 ms), stage="WAL history reservation" (0 ms), stage="Waiting for Full message" (23 ms), stage="Affinity recalculation" (24 ms), stage="Full map updating" (1 ms), stage="Detect lost partitions" (6 ms), stage="Exchange done" (17 ms), stage="Total time" (133 ms)] [21:03:20] : [Step 4/5] [2021-11-19 21:03:20,565][INFO ][exchange-worker-#5236%internal.GridNodeMetricsLogPdsSelfTest1%][root] [GridStringLogger echo] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=2, minorTopVer=1], force=false, evt=DISCOVERY_CUSTOM_EVT, node=5a320cff-6ba1-49d0-81a3-7e0c09e00000] [21:03:20] : [Step 4/5] [2021-11-19 21:03:20,565][INFO ][sys-#5211%internal.GridNodeMetricsLogPdsSelfTest1%][root] [GridStringLogger echo] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], stage="Affinity initialization on cache group start [grp=ignite-sys-cache]" (0 ms) (parent=Affinity initialization on cache group start), stage="Affinity centralized initialization (crd) [grp=ignite-sys-cache, crd=false]" (0 ms) (parent=Determine exchange type), stage="Restore partition states [grp=ignite-sys-cache]" (0 ms) (parent=Restore partition states), stage="Affinity applying from full message [grp=ignite-sys-cache]" (24 ms) (parent=Affinity recalculation)] [21:03:20] : [Step 4/5] [2021-11-19 21:03:20,566][INFO ][exchange-worker-#5113%internal.GridNodeMetricsLogPdsSelfTest0%][root] [GridStringLogger echo] Started exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], crd=true, evt=DISCOVERY_CUSTOM_EVT, evtNode=5a320cff-6ba1-49d0-81a3-7e0c09e00000, customEvt=DynamicCacheChangeBatch [id=2621d593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqs=ArrayList [DynamicCacheChangeRequest [cacheName=TestCache1, hasCfg=true, nodeId=5a320cff-6ba1-49d0-81a3-7e0c09e00000, clientStartOnly=false, stop=false, destroy=false, disabledAfterStart=false]], exchangeActions=ExchangeActions [startCaches=[TestCache1], stopCaches=null, startGrps=[TestCache1], stopGrps=[], resetParts=null, stateChangeRequest=null], startCaches=false], allowMerge=false, exchangeFreeSwitch=false] [21:03:20] : [Step 4/5] [2021-11-19 21:03:20,568][INFO ][exchange-worker-#5236%internal.GridNodeMetricsLogPdsSelfTest1%][root] [GridStringLogger echo] Started exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], crd=false, evt=DISCOVERY_CUSTOM_EVT, evtNode=5a320cff-6ba1-49d0-81a3-7e0c09e00000, customEvt=DynamicCacheChangeBatch [id=2621d593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqs=ArrayList [DynamicCacheChangeRequest [cacheName=TestCache1, hasCfg=true, nodeId=5a320cff-6ba1-49d0-81a3-7e0c09e00000, clientStartOnly=false, stop=false, destroy=false, disabledAfterStart=false]], exchangeActions=ExchangeActions [startCaches=[TestCache1], stopCaches=null, startGrps=[TestCache1], stopGrps=[], resetParts=null, stateChangeRequest=null], startCaches=false], allowMerge=false, exchangeFreeSwitch=false] [21:03:20] : [Step 4/5] [2021-11-19 21:03:20,571][INFO ][exchange-worker-#5113%internal.GridNodeMetricsLogPdsSelfTest0%][root] [GridStringLogger echo] Started page memory [memoryAllocated=30.0 MiB, pages=7440, tableSize=592.7 KiB, replacementSize=960 B, checkpointBuffer=30.0 MiB] [21:03:20] : [Step 4/5] [2021-11-19 21:03:20,571][INFO ][exchange-worker-#5236%internal.GridNodeMetricsLogPdsSelfTest1%][root] [GridStringLogger echo] Started page memory [memoryAllocated=30.0 MiB, pages=7440, tableSize=592.7 KiB, replacementSize=960 B, checkpointBuffer=30.0 MiB] [21:03:20] : [Step 4/5] [2021-11-19 21:03:20,670][INFO ][exchange-worker-#5236%internal.GridNodeMetricsLogPdsSelfTest1%][root] [GridStringLogger echo] Started cache [name=TestCache1, id=-1049814975, dataRegionName=default, mode=PARTITIONED, atomicity=ATOMIC, backups=0, mvcc=false] [21:03:20] : [Step 4/5] [2021-11-19 21:03:20,674][INFO ][exchange-worker-#5236%internal.GridNodeMetricsLogPdsSelfTest1%][root] [GridStringLogger echo] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], waitTime=0ms, futInfo=NA, mode=DISTRIBUTED] [21:03:20] : [Step 4/5] [2021-11-19 21:03:20,678][INFO ][exchange-worker-#5113%internal.GridNodeMetricsLogPdsSelfTest0%][root] [GridStringLogger echo] Started cache [name=TestCache1, id=-1049814975, dataRegionName=default, mode=PARTITIONED, atomicity=ATOMIC, backups=0, mvcc=false] [21:03:20] : [Step 4/5] [2021-11-19 21:03:20,683][INFO ][exchange-worker-#5113%internal.GridNodeMetricsLogPdsSelfTest0%][root] [GridStringLogger echo] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], waitTime=0ms, futInfo=NA, mode=DISTRIBUTED] [21:03:20] : [Step 4/5] [2021-11-19 21:03:20,685][INFO ][exchange-worker-#5113%internal.GridNodeMetricsLogPdsSelfTest0%][root] [GridStringLogger echo] Finished waiting for partitions release latch: ServerLatch [permits=0, pendingAcks=HashSet [], super=CompletableLatch [id=CompletableLatchUid [id=exchange, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2]]]] [21:03:20] : [Step 4/5] [2021-11-19 21:03:20,686][INFO ][exchange-worker-#5236%internal.GridNodeMetricsLogPdsSelfTest1%][root] [GridStringLogger echo] Finished waiting for partitions release latch: ClientLatch [coordinator=TcpDiscoveryNode [id=5a320cff-6ba1-49d0-81a3-7e0c09e00000, consistentId=2fadaaf7-63e4-4de5-9a38-471957431855, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345000336, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], ackSent=true, super=CompletableLatch [id=CompletableLatchUid [id=exchange, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2]]]] [21:03:20] : [Step 4/5] [2021-11-19 21:03:20,687][INFO ][exchange-worker-#5113%internal.GridNodeMetricsLogPdsSelfTest0%][root] [GridStringLogger echo] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:03:20] : [Step 4/5] [2021-11-19 21:03:20,688][INFO ][exchange-worker-#5236%internal.GridNodeMetricsLogPdsSelfTest1%][root] [GridStringLogger echo] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:03:20] : [Step 4/5] [2021-11-19 21:03:20,752][INFO ][exchange-worker-#5113%internal.GridNodeMetricsLogPdsSelfTest0%][root] [GridStringLogger echo] Finished exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], crd=true] [21:03:20] : [Step 4/5] [2021-11-19 21:03:20,753][INFO ][exchange-worker-#5236%internal.GridNodeMetricsLogPdsSelfTest1%][root] [GridStringLogger echo] Finished exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], crd=false] [21:03:20] : [Step 4/5] [2021-11-19 21:03:20,753][INFO ][sys-#5091%internal.GridNodeMetricsLogPdsSelfTest0%][root] [GridStringLogger echo] Coordinator received single message [ver=AffinityTopologyVersion [topVer=2, minorTopVer=2], node=26a828be-527b-42db-a842-bea7dc000001, allReceived=true] [21:03:20] : [Step 4/5] [2021-11-19 21:03:20,754][INFO ][sys-#5091%internal.GridNodeMetricsLogPdsSelfTest0%][root] [GridStringLogger echo] finishExchangeOnCoordinator [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2]] [21:03:20] : [Step 4/5] [2021-11-19 21:03:20,761][INFO ][sys-#5091%internal.GridNodeMetricsLogPdsSelfTest0%][root] [GridStringLogger echo] Finish exchange future [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], err=null, rebalanced=true, wasRebalanced=true] [21:03:20] : [Step 4/5] [2021-11-19 21:03:20,762][INFO ][sys-#5208%internal.GridNodeMetricsLogPdsSelfTest1%][root] [GridStringLogger echo] Received full message, will finish exchange [node=5a320cff-6ba1-49d0-81a3-7e0c09e00000, resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2]] [21:03:20] : [Step 4/5] [2021-11-19 21:03:20,763][INFO ][sys-#5091%internal.GridNodeMetricsLogPdsSelfTest0%][root] [GridStringLogger echo] Finish proxy initialization, cacheName=TestCache1, localNodeId=5a320cff-6ba1-49d0-81a3-7e0c09e00000 [21:03:20] : [Step 4/5] [2021-11-19 21:03:20,766][INFO ][sys-#5091%internal.GridNodeMetricsLogPdsSelfTest0%][root] [GridStringLogger echo] Completed partition exchange [localNode=5a320cff-6ba1-49d0-81a3-7e0c09e00000, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=5a320cff-6ba1-49d0-81a3-7e0c09e00000, consistentId=2fadaaf7-63e4-4de5-9a38-471957431855, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345000567, loc=true, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2]] [21:03:20] : [Step 4/5] [2021-11-19 21:03:20,767][INFO ][sys-#5208%internal.GridNodeMetricsLogPdsSelfTest1%][root] [GridStringLogger echo] Finish exchange future [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], err=null, rebalanced=true, wasRebalanced=true] [21:03:20] : [Step 4/5] [2021-11-19 21:03:20,768][INFO ][exchange-worker-#5113%internal.GridNodeMetricsLogPdsSelfTest0%][root] [GridStringLogger echo] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=2, minorTopVer=2], force=false, evt=DISCOVERY_CUSTOM_EVT, node=5a320cff-6ba1-49d0-81a3-7e0c09e00000] [21:03:20] : [Step 4/5] [2021-11-19 21:03:20,769][INFO ][sys-#5091%internal.GridNodeMetricsLogPdsSelfTest0%][root] [GridStringLogger echo] Exchange timings [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (2 ms), stage="Update caches registry" (1 ms), stage="Start caches" (109 ms), stage="Affinity initialization on cache group start" (4 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (1 ms), stage="Wait partitions release latch [latch=exchange]" (1 ms), stage="Wait partitions release [latch=exchange]" (1 ms), stage="Restore partition states" (21 ms), stage="After states restored callback" (41 ms), stage="WAL history reservation" (1 ms), stage="Waiting for all single messages" (2 ms), stage="Affinity recalculation (crd)" (0 ms), stage="Collect update counters and create affinity messages" (0 ms), stage="Assign partitions states" (3 ms), stage="Validate partitions states" (0 ms), stage="Apply update counters" (0 ms), stage="Full message preparing" (2 ms), stage="Full message sending" (0 ms), stage="Exchange done" (6 ms), stage="Total time" (195 ms), Discovery lag=2 ms, Latest started node id=26a828be-527b-42db-a842-bea7dc000001] [21:03:20] : [Step 4/5] [2021-11-19 21:03:20,771][INFO ][sys-#5208%internal.GridNodeMetricsLogPdsSelfTest1%][root] [GridStringLogger echo] Finish proxy initialization, cacheName=TestCache1, localNodeId=26a828be-527b-42db-a842-bea7dc000001 [21:03:20] : [Step 4/5] [2021-11-19 21:03:20,771][INFO ][exchange-worker-#5113%internal.GridNodeMetricsLogPdsSelfTest0%][root] [GridStringLogger echo] Started exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=3], crd=true, evt=DISCOVERY_CUSTOM_EVT, evtNode=26a828be-527b-42db-a842-bea7dc000001, customEvt=DynamicCacheChangeBatch [id=2721d593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqs=ArrayList [DynamicCacheChangeRequest [cacheName=TestCache2, hasCfg=true, nodeId=26a828be-527b-42db-a842-bea7dc000001, clientStartOnly=false, stop=false, destroy=false, disabledAfterStart=false]], exchangeActions=ExchangeActions [startCaches=[TestCache2], stopCaches=null, startGrps=[TestCache2], stopGrps=[], resetParts=null, stateChangeRequest=null], startCaches=false], allowMerge=false, exchangeFreeSwitch=false] [21:03:20] : [Step 4/5] [2021-11-19 21:03:20,773][INFO ][exchange-worker-#5236%internal.GridNodeMetricsLogPdsSelfTest1%][root] [GridStringLogger echo] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=2, minorTopVer=2], force=false, evt=DISCOVERY_CUSTOM_EVT, node=5a320cff-6ba1-49d0-81a3-7e0c09e00000] [21:03:20] : [Step 4/5] [2021-11-19 21:03:20,773][INFO ][sys-#5208%internal.GridNodeMetricsLogPdsSelfTest1%][root] [GridStringLogger echo] Completed partition exchange [localNode=26a828be-527b-42db-a842-bea7dc000001, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=5a320cff-6ba1-49d0-81a3-7e0c09e00000, consistentId=2fadaaf7-63e4-4de5-9a38-471957431855, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345000336, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2]] [21:03:20] : [Step 4/5] [2021-11-19 21:03:20,775][INFO ][sys-#5091%internal.GridNodeMetricsLogPdsSelfTest0%][root] [GridStringLogger echo] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], stage="Affinity initialization on cache group start [grp=TestCache1]" (3 ms) (parent=Affinity initialization on cache group start), stage="Restore partition states [grp=TestCache1]" (21 ms) (parent=Restore partition states), stage="Restore partition states [grp=ignite-sys-cache]" (0 ms) (parent=Restore partition states)] [21:03:20] : [Step 4/5] [2021-11-19 21:03:20,776][INFO ][exchange-worker-#5113%internal.GridNodeMetricsLogPdsSelfTest0%][root] [GridStringLogger echo] Started cache [name=TestCache2, id=-1049814974, dataRegionName=userTransientDataRegion, mode=PARTITIONED, atomicity=ATOMIC, backups=0, mvcc=false] [21:03:20] : [Step 4/5] [2021-11-19 21:03:20,777][INFO ][exchange-worker-#5236%internal.GridNodeMetricsLogPdsSelfTest1%][root] [GridStringLogger echo] Started exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=3], crd=false, evt=DISCOVERY_CUSTOM_EVT, evtNode=26a828be-527b-42db-a842-bea7dc000001, customEvt=DynamicCacheChangeBatch [id=2721d593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqs=ArrayList [DynamicCacheChangeRequest [cacheName=TestCache2, hasCfg=true, nodeId=26a828be-527b-42db-a842-bea7dc000001, clientStartOnly=false, stop=false, destroy=false, disabledAfterStart=false]], exchangeActions=ExchangeActions [startCaches=[TestCache2], stopCaches=null, startGrps=[TestCache2], stopGrps=[], resetParts=null, stateChangeRequest=null], startCaches=false], allowMerge=false, exchangeFreeSwitch=false] [21:03:20] : [Step 4/5] [2021-11-19 21:03:20,778][INFO ][sys-#5208%internal.GridNodeMetricsLogPdsSelfTest1%][root] [GridStringLogger echo] Exchange timings [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (2 ms), stage="Update caches registry" (0 ms), stage="Start caches" (100 ms), stage="Affinity initialization on cache group start" (2 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Wait partitions release latch [latch=exchange]" (12 ms), stage="Wait partitions release [latch=exchange]" (1 ms), stage="Restore partition states" (23 ms), stage="After states restored callback" (38 ms), stage="WAL history reservation" (1 ms), stage="Waiting for Full message" (11 ms), stage="Affinity recalculation" (0 ms), stage="Full map updating" (3 ms), stage="Exchange done" (8 ms), stage="Total time" (201 ms)] [21:03:20] : [Step 4/5] [2021-11-19 21:03:20,780][INFO ][exchange-worker-#5113%internal.GridNodeMetricsLogPdsSelfTest0%][root] [GridStringLogger echo] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=3], waitTime=0ms, futInfo=NA, mode=DISTRIBUTED] [21:03:20] : [Step 4/5] [2021-11-19 21:03:20,781][INFO ][sys-#5208%internal.GridNodeMetricsLogPdsSelfTest1%][root] [GridStringLogger echo] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], stage="Affinity initialization on cache group start [grp=TestCache1]" (2 ms) (parent=Affinity initialization on cache group start), stage="Restore partition states [grp=TestCache1]" (23 ms) (parent=Restore partition states), stage="Restore partition states [grp=ignite-sys-cache]" (0 ms) (parent=Restore partition states)] [21:03:20] : [Step 4/5] [2021-11-19 21:03:20,782][INFO ][exchange-worker-#5236%internal.GridNodeMetricsLogPdsSelfTest1%][root] [GridStringLogger echo] Started cache [name=TestCache2, id=-1049814974, dataRegionName=userTransientDataRegion, mode=PARTITIONED, atomicity=ATOMIC, backups=0, mvcc=false] [21:03:20] : [Step 4/5] [2021-11-19 21:03:20,786][INFO ][exchange-worker-#5236%internal.GridNodeMetricsLogPdsSelfTest1%][root] [GridStringLogger echo] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=3], waitTime=0ms, futInfo=NA, mode=DISTRIBUTED] [21:03:20] : [Step 4/5] [2021-11-19 21:03:20,787][INFO ][exchange-worker-#5113%internal.GridNodeMetricsLogPdsSelfTest0%][root] [GridStringLogger echo] Finished waiting for partitions release latch: ServerLatch [permits=0, pendingAcks=HashSet [], super=CompletableLatch [id=CompletableLatchUid [id=exchange, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=3]]]] [21:03:20] : [Step 4/5] [2021-11-19 21:03:20,788][INFO ][exchange-worker-#5113%internal.GridNodeMetricsLogPdsSelfTest0%][root] [GridStringLogger echo] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=3], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:03:20] : [Step 4/5] [2021-11-19 21:03:20,788][INFO ][exchange-worker-#5236%internal.GridNodeMetricsLogPdsSelfTest1%][root] [GridStringLogger echo] Finished waiting for partitions release latch: ClientLatch [coordinator=TcpDiscoveryNode [id=5a320cff-6ba1-49d0-81a3-7e0c09e00000, consistentId=2fadaaf7-63e4-4de5-9a38-471957431855, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345000336, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], ackSent=true, super=CompletableLatch [id=CompletableLatchUid [id=exchange, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=3]]]] [21:03:20] : [Step 4/5] [2021-11-19 21:03:20,790][INFO ][exchange-worker-#5236%internal.GridNodeMetricsLogPdsSelfTest1%][root] [GridStringLogger echo] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=3], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:03:20] : [Step 4/5] [2021-11-19 21:03:20,837][INFO ][exchange-worker-#5236%internal.GridNodeMetricsLogPdsSelfTest1%][root] [GridStringLogger echo] Finished exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=3], crd=false] [21:03:20] : [Step 4/5] [2021-11-19 21:03:20,845][INFO ][exchange-worker-#5113%internal.GridNodeMetricsLogPdsSelfTest0%][root] [GridStringLogger echo] Coordinator received single message [ver=AffinityTopologyVersion [topVer=2, minorTopVer=3], node=26a828be-527b-42db-a842-bea7dc000001, allReceived=true] [21:03:20] : [Step 4/5] [2021-11-19 21:03:20,846][INFO ][exchange-worker-#5113%internal.GridNodeMetricsLogPdsSelfTest0%][root] [GridStringLogger echo] finishExchangeOnCoordinator [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=3], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=3]] [21:03:20] : [Step 4/5] [2021-11-19 21:03:20,857][INFO ][exchange-worker-#5113%internal.GridNodeMetricsLogPdsSelfTest0%][root] [GridStringLogger echo] Finish exchange future [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=3], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=3], err=null, rebalanced=true, wasRebalanced=true] [21:03:20] : [Step 4/5] [2021-11-19 21:03:20,860][INFO ][sys-#5220%internal.GridNodeMetricsLogPdsSelfTest1%][root] [GridStringLogger echo] Received full message, will finish exchange [node=5a320cff-6ba1-49d0-81a3-7e0c09e00000, resVer=AffinityTopologyVersion [topVer=2, minorTopVer=3]] [21:03:20] : [Step 4/5] [2021-11-19 21:03:20,861][INFO ][exchange-worker-#5113%internal.GridNodeMetricsLogPdsSelfTest0%][root] [GridStringLogger echo] Finish proxy initialization, cacheName=TestCache2, localNodeId=5a320cff-6ba1-49d0-81a3-7e0c09e00000 [21:03:20] : [Step 4/5] [2021-11-19 21:03:20,861][INFO ][exchange-worker-#5113%internal.GridNodeMetricsLogPdsSelfTest0%][root] [GridStringLogger echo] Completed partition exchange [localNode=5a320cff-6ba1-49d0-81a3-7e0c09e00000, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=3], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=26a828be-527b-42db-a842-bea7dc000001, consistentId=ac5bdf96-4851-4c10-a439-6cfce448cd9e, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637345000316, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=2, minorTopVer=3]] [21:03:20] : [Step 4/5] [2021-11-19 21:03:20,865][INFO ][sys-#5220%internal.GridNodeMetricsLogPdsSelfTest1%][root] [GridStringLogger echo] Finish exchange future [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=3], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=3], err=null, rebalanced=true, wasRebalanced=true] [21:03:20] : [Step 4/5] [2021-11-19 21:03:20,866][INFO ][exchange-worker-#5113%internal.GridNodeMetricsLogPdsSelfTest0%][root] [GridStringLogger echo] Exchange timings [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=3], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=3], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (4 ms), stage="Update caches registry" (0 ms), stage="Start caches" (3 ms), stage="Affinity initialization on cache group start" (2 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Wait partitions release latch [latch=exchange]" (6 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Restore partition states" (0 ms), stage="After states restored callback" (56 ms), stage="WAL history reservation" (0 ms), stage="Waiting for all single messages" (0 ms), stage="Affinity recalculation (crd)" (0 ms), stage="Collect update counters and create affinity messages" (0 ms), stage="Assign partitions states" (2 ms), stage="Validate partitions states" (0 ms), stage="Apply update counters" (0 ms), stage="Full message preparing" (6 ms), stage="Full message sending" (0 ms), stage="Exchange done" (8 ms), stage="Total time" (87 ms), Discovery lag=3 ms, Latest started node id=26a828be-527b-42db-a842-bea7dc000001] [21:03:20] : [Step 4/5] [2021-11-19 21:03:20,868][INFO ][sys-#5220%internal.GridNodeMetricsLogPdsSelfTest1%][root] [GridStringLogger echo] Finish proxy initialization, cacheName=TestCache2, localNodeId=26a828be-527b-42db-a842-bea7dc000001 [21:03:20] : [Step 4/5] [2021-11-19 21:03:20,869][INFO ][exchange-worker-#5113%internal.GridNodeMetricsLogPdsSelfTest0%][root] [GridStringLogger echo] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=3], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=3], stage="Affinity initialization on cache group start [grp=TestCache2]" (2 ms) (parent=Affinity initialization on cache group start), stage="Restore partition states [grp=ignite-sys-cache]" (0 ms) (parent=Restore partition states), stage="Restore partition states [grp=TestCache2]" (0 ms) (parent=Restore partition states), stage="Restore partition states [grp=TestCache1]" (0 ms) (parent=Restore partition states)] [21:03:20] : [Step 4/5] [2021-11-19 21:03:20,870][INFO ][sys-#5220%internal.GridNodeMetricsLogPdsSelfTest1%][root] [GridStringLogger echo] Completed partition exchange [localNode=26a828be-527b-42db-a842-bea7dc000001, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=3], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=26a828be-527b-42db-a842-bea7dc000001, consistentId=ac5bdf96-4851-4c10-a439-6cfce448cd9e, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637345000767, loc=true, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=2, minorTopVer=3]] [21:03:20] : [Step 4/5] [2021-11-19 21:03:20,872][INFO ][exchange-worker-#5236%internal.GridNodeMetricsLogPdsSelfTest1%][root] [GridStringLogger echo] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=2, minorTopVer=3], force=false, evt=DISCOVERY_CUSTOM_EVT, node=26a828be-527b-42db-a842-bea7dc000001] [21:03:20] : [Step 4/5] [2021-11-19 21:03:20,873][INFO ][exchange-worker-#5113%internal.GridNodeMetricsLogPdsSelfTest0%][root] [GridStringLogger echo] Finished exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=3], crd=true] [21:03:20] : [Step 4/5] [2021-11-19 21:03:20,875][INFO ][sys-#5220%internal.GridNodeMetricsLogPdsSelfTest1%][root] [GridStringLogger echo] Exchange timings [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=3], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=3], stage="Waiting in exchange queue" (4 ms), stage="Exchange parameters initialization" (3 ms), stage="Update caches registry" (0 ms), stage="Start caches" (3 ms), stage="Affinity initialization on cache group start" (2 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Wait partitions release latch [latch=exchange]" (3 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Restore partition states" (0 ms), stage="After states restored callback" (43 ms), stage="WAL history reservation" (0 ms), stage="Waiting for Full message" (25 ms), stage="Affinity recalculation" (0 ms), stage="Full map updating" (3 ms), stage="Exchange done" (7 ms), stage="Total time" (93 ms)] [21:03:20] : [Step 4/5] [2021-11-19 21:03:20,877][INFO ][exchange-worker-#5113%internal.GridNodeMetricsLogPdsSelfTest0%][root] [GridStringLogger echo] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=2, minorTopVer=3], force=false, evt=DISCOVERY_CUSTOM_EVT, node=26a828be-527b-42db-a842-bea7dc000001] [21:03:20] : [Step 4/5] [2021-11-19 21:03:20,877][INFO ][sys-#5220%internal.GridNodeMetricsLogPdsSelfTest1%][root] [GridStringLogger echo] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=3], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=3], stage="Affinity initialization on cache group start [grp=TestCache2]" (2 ms) (parent=Affinity initialization on cache group start), stage="Restore partition states [grp=ignite-sys-cache]" (0 ms) (parent=Restore partition states), stage="Restore partition states [grp=TestCache2]" (0 ms) (parent=Restore partition states), stage="Restore partition states [grp=TestCache1]" (0 ms) (parent=Restore partition states)] [21:03:21] : [Step 4/5] [2021-11-19 21:03:21,365][INFO ][grid-timeout-worker-#5050%internal.GridNodeMetricsLogPdsSelfTest0%][root] [GridStringLogger echo] [21:03:21] : [Step 4/5] Metrics for local node (to disable set 'metricsLogFrequency' to 0) [21:03:21] : [Step 4/5] ^-- Node [id=5a320cff, name=internal.GridNodeMetricsLogPdsSelfTest0, uptime=00:00:03.029] [21:03:21] : [Step 4/5] ^-- Cluster [hosts=1, CPUs=24, servers=2, clients=0, topVer=2, minorTopVer=3] [21:03:21] : [Step 4/5] ^-- Network [addrs=[127.0.0.1], localHost=127.0.0.1, discoPort=47500, commPort=45100] [21:03:21] : [Step 4/5] ^-- CPU [CPUs=24, curLoad=0%, avgLoad=0%, GC=0%] [21:03:21] : [Step 4/5] ^-- Heap [used=690MB, free=64.69%, comm=1956MB] [21:03:21] : [Step 4/5] ^-- Off-heap memory [used=4MB, free=99.08%, allocated=249MB] [21:03:21] : [Step 4/5] ^-- Page memory [pages=1053] [21:03:21] : [Step 4/5] ^-- sysMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:03:21] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=99.98%, allocRam=99MB, allocTotal=0MB] [21:03:21] : [Step 4/5] ^-- default region [type=default, persistence=true, lazyAlloc=true, [21:03:21] : [Step 4/5] ... initCfg=30MB, maxCfg=30MB, usedRam=0MB, freeRam=99.93%, allocRam=30MB, allocTotal=0MB] [21:03:21] : [Step 4/5] ^-- metastoreMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:03:21] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=99.95%, allocRam=0MB, allocTotal=0MB] [21:03:21] : [Step 4/5] ^-- TxLog region [type=internal, persistence=true, lazyAlloc=false, [21:03:21] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:03:21] : [Step 4/5] ^-- volatileDsMemPlc region [type=user, persistence=false, lazyAlloc=true, [21:03:21] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB] [21:03:21] : [Step 4/5] ^-- userTransientDataRegion region [type=user, persistence=false, lazyAlloc=true, [21:03:21] : [Step 4/5] ... initCfg=20MB, maxCfg=20MB, usedRam=4MB, freeRam=79.76%, allocRam=20MB] [21:03:21] : [Step 4/5] ^-- Ignite persistence [used=0MB] [21:03:21] : [Step 4/5] ^-- Outbound messages queue [size=0] [21:03:21] : [Step 4/5] ^-- Public thread pool [active=0, idle=5, qSize=0] [21:03:21] : [Step 4/5] ^-- System thread pool [active=0, idle=24, qSize=0] [21:03:21] : [Step 4/5] ^-- Striped thread pool [active=0, idle=24, qSize=0] [21:03:21] : [Step 4/5] ^-- Custom executor 0 [active=0, idle=0, qSize=0] [21:03:21] : [Step 4/5] ^-- Custom executor 1 [active=0, idle=0, qSize=0] [21:03:21] : [Step 4/5] [2021-11-19 21:03:21,417][INFO ][grid-timeout-worker-#5169%internal.GridNodeMetricsLogPdsSelfTest1%][root] [GridStringLogger echo] [21:03:21] : [Step 4/5] Metrics for local node (to disable set 'metricsLogFrequency' to 0) [21:03:21] : [Step 4/5] ^-- Node [id=26a828be, name=internal.GridNodeMetricsLogPdsSelfTest1, uptime=00:00:01.007] [21:03:21] : [Step 4/5] ^-- Cluster [hosts=1, CPUs=24, servers=2, clients=0, topVer=2, minorTopVer=3] [21:03:21] : [Step 4/5] ^-- Network [addrs=[127.0.0.1], localHost=127.0.0.1, discoPort=47501, commPort=45101] [21:03:21] : [Step 4/5] ^-- CPU [CPUs=24, curLoad=0%, avgLoad=0%, GC=0%] [21:03:21] : [Step 4/5] ^-- Heap [used=617MB, free=68.45%, comm=1956MB] [21:03:21] : [Step 4/5] ^-- Off-heap memory [used=4MB, free=99.08%, allocated=249MB] [21:03:21] : [Step 4/5] ^-- Page memory [pages=1056] [21:03:21] : [Step 4/5] ^-- sysMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:03:21] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=99.98%, allocRam=99MB, allocTotal=0MB] [21:03:21] : [Step 4/5] ^-- default region [type=default, persistence=true, lazyAlloc=true, [21:03:21] : [Step 4/5] ... initCfg=30MB, maxCfg=30MB, usedRam=0MB, freeRam=99.82%, allocRam=30MB, allocTotal=0MB] [21:03:21] : [Step 4/5] ^-- metastoreMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:03:21] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=99.95%, allocRam=0MB, allocTotal=0MB] [21:03:21] : [Step 4/5] ^-- TxLog region [type=internal, persistence=true, lazyAlloc=false, [21:03:21] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:03:21] : [Step 4/5] ^-- volatileDsMemPlc region [type=user, persistence=false, lazyAlloc=true, [21:03:21] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB] [21:03:21] : [Step 4/5] ^-- userTransientDataRegion region [type=user, persistence=false, lazyAlloc=true, [21:03:21] : [Step 4/5] ... initCfg=20MB, maxCfg=20MB, usedRam=4MB, freeRam=79.88%, allocRam=20MB] [21:03:21] : [Step 4/5] ^-- Ignite persistence [used=0MB] [21:03:21] : [Step 4/5] ^-- Outbound messages queue [size=0] [21:03:21] : [Step 4/5] ^-- Public thread pool [active=0, idle=5, qSize=0] [21:03:21] : [Step 4/5] ^-- System thread pool [active=0, idle=24, qSize=0] [21:03:21] : [Step 4/5] ^-- Striped thread pool [active=0, idle=24, qSize=0] [21:03:21] : [Step 4/5] ^-- Custom executor 0 [active=0, idle=0, qSize=0] [21:03:21] : [Step 4/5] ^-- Custom executor 1 [active=0, idle=0, qSize=0] [21:03:21] : [Step 4/5] [2021-11-19 21:03:21,421][INFO ][grid-timeout-worker-#5169%internal.GridNodeMetricsLogPdsSelfTest1%][root] [GridStringLogger echo] FreeList [name=userTransientDataRegion##FreeList, buckets=256, dataPages=1, reusePages=0] [21:03:22] : [Step 4/5] [2021-11-19 21:03:22,379][INFO ][grid-timeout-worker-#5050%internal.GridNodeMetricsLogPdsSelfTest0%][root] [GridStringLogger echo] [21:03:22] : [Step 4/5] Metrics for local node (to disable set 'metricsLogFrequency' to 0) [21:03:22] : [Step 4/5] ^-- Node [id=5a320cff, name=internal.GridNodeMetricsLogPdsSelfTest0, uptime=00:00:04.048] [21:03:22] : [Step 4/5] ^-- Cluster [hosts=1, CPUs=24, servers=2, clients=0, topVer=2, minorTopVer=3] [21:03:22] : [Step 4/5] ^-- Network [addrs=[127.0.0.1], localHost=127.0.0.1, discoPort=47500, commPort=45100] [21:03:22] : [Step 4/5] ^-- CPU [CPUs=24, curLoad=0%, avgLoad=0%, GC=0%] [21:03:22] : [Step 4/5] ^-- Heap [used=690MB, free=64.69%, comm=1956MB] [21:03:22] : [Step 4/5] ^-- Off-heap memory [used=4MB, free=99.08%, allocated=249MB] [21:03:22] : [Step 4/5] ^-- Page memory [pages=1053] [21:03:22] : [Step 4/5] ^-- sysMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:03:22] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=99.98%, allocRam=99MB, allocTotal=0MB] [21:03:22] : [Step 4/5] ^-- default region [type=default, persistence=true, lazyAlloc=true, [21:03:22] : [Step 4/5] ... initCfg=30MB, maxCfg=30MB, usedRam=0MB, freeRam=99.93%, allocRam=30MB, allocTotal=0MB] [21:03:22] : [Step 4/5] ^-- metastoreMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:03:22] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=99.95%, allocRam=0MB, allocTotal=0MB] [21:03:22] : [Step 4/5] ^-- TxLog region [type=internal, persistence=true, lazyAlloc=false, [21:03:22] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:03:22] : [Step 4/5] ^-- volatileDsMemPlc region [type=user, persistence=false, lazyAlloc=true, [21:03:22] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB] [21:03:22] : [Step 4/5] ^-- userTransientDataRegion region [type=user, persistence=false, lazyAlloc=true, [21:03:22] : [Step 4/5] ... initCfg=20MB, maxCfg=20MB, usedRam=4MB, freeRam=79.76%, allocRam=20MB] [21:03:22] : [Step 4/5] ^-- Ignite persistence [used=0MB] [21:03:22] : [Step 4/5] ^-- Outbound messages queue [size=0] [21:03:22] : [Step 4/5] ^-- Public thread pool [active=0, idle=5, qSize=0] [21:03:22] : [Step 4/5] ^-- System thread pool [active=0, idle=24, qSize=0] [21:03:22] : [Step 4/5] ^-- Striped thread pool [active=0, idle=24, qSize=0] [21:03:22] : [Step 4/5] ^-- Custom executor 0 [active=0, idle=0, qSize=0] [21:03:22] : [Step 4/5] ^-- Custom executor 1 [active=0, idle=0, qSize=0] [21:03:22] : [Step 4/5] [2021-11-19 21:03:22,439][INFO ][grid-timeout-worker-#5169%internal.GridNodeMetricsLogPdsSelfTest1%][root] [GridStringLogger echo] [21:03:22] : [Step 4/5] Metrics for local node (to disable set 'metricsLogFrequency' to 0) [21:03:22] : [Step 4/5] ^-- Node [id=26a828be, name=internal.GridNodeMetricsLogPdsSelfTest1, uptime=00:00:02.025] [21:03:22] : [Step 4/5] ^-- Cluster [hosts=1, CPUs=24, servers=2, clients=0, topVer=2, minorTopVer=3] [21:03:22] : [Step 4/5] ^-- Network [addrs=[127.0.0.1], localHost=127.0.0.1, discoPort=47501, commPort=45101] [21:03:22] : [Step 4/5] ^-- CPU [CPUs=24, curLoad=0%, avgLoad=0%, GC=0%] [21:03:22] : [Step 4/5] ^-- Heap [used=617MB, free=68.45%, comm=1956MB] [21:03:22] : [Step 4/5] ^-- Off-heap memory [used=4MB, free=99.08%, allocated=249MB] [21:03:22] : [Step 4/5] ^-- Page memory [pages=1056] [21:03:22] : [Step 4/5] ^-- sysMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:03:22] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=99.98%, allocRam=99MB, allocTotal=0MB] [21:03:22] : [Step 4/5] ^-- default region [type=default, persistence=true, lazyAlloc=true, [21:03:22] : [Step 4/5] ... initCfg=30MB, maxCfg=30MB, usedRam=0MB, freeRam=99.82%, allocRam=30MB, allocTotal=0MB] [21:03:22] : [Step 4/5] ^-- metastoreMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:03:22] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=99.95%, allocRam=0MB, allocTotal=0MB] [21:03:22] : [Step 4/5] ^-- TxLog region [type=internal, persistence=true, lazyAlloc=false, [21:03:22] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:03:22] : [Step 4/5] ^-- volatileDsMemPlc region [type=user, persistence=false, lazyAlloc=true, [21:03:22] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB] [21:03:22] : [Step 4/5] ^-- userTransientDataRegion region [type=user, persistence=false, lazyAlloc=true, [21:03:22] : [Step 4/5] ... initCfg=20MB, maxCfg=20MB, usedRam=4MB, freeRam=79.88%, allocRam=20MB] [21:03:22] : [Step 4/5] ^-- Ignite persistence [used=0MB] [21:03:22] : [Step 4/5] ^-- Outbound messages queue [size=0] [21:03:22] : [Step 4/5] ^-- Public thread pool [active=0, idle=5, qSize=0] [21:03:22] : [Step 4/5] ^-- System thread pool [active=0, idle=24, qSize=0] [21:03:22] : [Step 4/5] ^-- Striped thread pool [active=0, idle=24, qSize=0] [21:03:22] : [Step 4/5] ^-- Custom executor 0 [active=0, idle=0, qSize=0] [21:03:22] : [Step 4/5] ^-- Custom executor 1 [active=0, idle=0, qSize=0] [21:03:22] : [Step 4/5] [2021-11-19 21:03:22,442][INFO ][grid-timeout-worker-#5169%internal.GridNodeMetricsLogPdsSelfTest1%][root] [GridStringLogger echo] FreeList [name=userTransientDataRegion##FreeList, buckets=256, dataPages=1, reusePages=0] [21:03:23] : [Step 4/5] [2021-11-19 21:03:23,388][INFO ][grid-timeout-worker-#5050%internal.GridNodeMetricsLogPdsSelfTest0%][root] [GridStringLogger echo] [21:03:23] : [Step 4/5] Metrics for local node (to disable set 'metricsLogFrequency' to 0) [21:03:23] : [Step 4/5] ^-- Node [id=5a320cff, name=internal.GridNodeMetricsLogPdsSelfTest0, uptime=00:00:05.058] [21:03:23] : [Step 4/5] ^-- Cluster [hosts=1, CPUs=24, servers=2, clients=0, topVer=2, minorTopVer=3] [21:03:23] : [Step 4/5] ^-- Network [addrs=[127.0.0.1], localHost=127.0.0.1, discoPort=47500, commPort=45100] [21:03:23] : [Step 4/5] ^-- CPU [CPUs=24, curLoad=0%, avgLoad=0%, GC=0%] [21:03:23] : [Step 4/5] ^-- Heap [used=690MB, free=64.69%, comm=1956MB] [21:03:23] : [Step 4/5] ^-- Off-heap memory [used=4MB, free=99.08%, allocated=249MB] [21:03:23] : [Step 4/5] ^-- Page memory [pages=1053] [21:03:23] : [Step 4/5] ^-- sysMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:03:23] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=99.98%, allocRam=99MB, allocTotal=0MB] [21:03:23] : [Step 4/5] ^-- default region [type=default, persistence=true, lazyAlloc=true, [21:03:23] : [Step 4/5] ... initCfg=30MB, maxCfg=30MB, usedRam=0MB, freeRam=99.93%, allocRam=30MB, allocTotal=0MB] [21:03:23] : [Step 4/5] ^-- metastoreMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:03:23] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=99.95%, allocRam=0MB, allocTotal=0MB] [21:03:23] : [Step 4/5] ^-- TxLog region [type=internal, persistence=true, lazyAlloc=false, [21:03:23] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:03:23] : [Step 4/5] ^-- volatileDsMemPlc region [type=user, persistence=false, lazyAlloc=true, [21:03:23] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB] [21:03:23] : [Step 4/5] ^-- userTransientDataRegion region [type=user, persistence=false, lazyAlloc=true, [21:03:23] : [Step 4/5] ... initCfg=20MB, maxCfg=20MB, usedRam=4MB, freeRam=79.76%, allocRam=20MB] [21:03:23] : [Step 4/5] ^-- Ignite persistence [used=0MB] [21:03:23] : [Step 4/5] ^-- Outbound messages queue [size=0] [21:03:23] : [Step 4/5] ^-- Public thread pool [active=0, idle=5, qSize=0] [21:03:23] : [Step 4/5] ^-- System thread pool [active=0, idle=24, qSize=0] [21:03:23] : [Step 4/5] ^-- Striped thread pool [active=0, idle=24, qSize=0] [21:03:23] : [Step 4/5] ^-- Custom executor 0 [active=0, idle=0, qSize=0] [21:03:23] : [Step 4/5] ^-- Custom executor 1 [active=0, idle=0, qSize=0] [21:03:23] : [Step 4/5] [2021-11-19 21:03:23,439][INFO ][grid-timeout-worker-#5169%internal.GridNodeMetricsLogPdsSelfTest1%][root] [GridStringLogger echo] [21:03:23] : [Step 4/5] Metrics for local node (to disable set 'metricsLogFrequency' to 0) [21:03:23] : [Step 4/5] ^-- Node [id=26a828be, name=internal.GridNodeMetricsLogPdsSelfTest1, uptime=00:00:03.035] [21:03:23] : [Step 4/5] ^-- Cluster [hosts=1, CPUs=24, servers=2, clients=0, topVer=2, minorTopVer=3] [21:03:23] : [Step 4/5] ^-- Network [addrs=[127.0.0.1], localHost=127.0.0.1, discoPort=47501, commPort=45101] [21:03:23] : [Step 4/5] ^-- CPU [CPUs=24, curLoad=0%, avgLoad=0%, GC=0%] [21:03:23] : [Step 4/5] ^-- Heap [used=692MB, free=64.58%, comm=1956MB] [21:03:23] : [Step 4/5] ^-- Off-heap memory [used=4MB, free=99.08%, allocated=249MB] [21:03:23] : [Step 4/5] ^-- Page memory [pages=1056] [21:03:23] : [Step 4/5] ^-- sysMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:03:23] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=99.98%, allocRam=99MB, allocTotal=0MB] [21:03:23] : [Step 4/5] ^-- default region [type=default, persistence=true, lazyAlloc=true, [21:03:23] : [Step 4/5] ... initCfg=30MB, maxCfg=30MB, usedRam=0MB, freeRam=99.82%, allocRam=30MB, allocTotal=0MB] [21:03:23] : [Step 4/5] ^-- metastoreMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:03:23] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=99.95%, allocRam=0MB, allocTotal=0MB] [21:03:23] : [Step 4/5] ^-- TxLog region [type=internal, persistence=true, lazyAlloc=false, [21:03:23] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:03:23] : [Step 4/5] ^-- volatileDsMemPlc region [type=user, persistence=false, lazyAlloc=true, [21:03:23] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB] [21:03:23] : [Step 4/5] ^-- userTransientDataRegion region [type=user, persistence=false, lazyAlloc=true, [21:03:23] : [Step 4/5] ... initCfg=20MB, maxCfg=20MB, usedRam=4MB, freeRam=79.88%, allocRam=20MB] [21:03:23] : [Step 4/5] ^-- Ignite persistence [used=0MB] [21:03:23] : [Step 4/5] ^-- Outbound messages queue [size=0] [21:03:23] : [Step 4/5] ^-- Public thread pool [active=0, idle=5, qSize=0] [21:03:23] : [Step 4/5] ^-- System thread pool [active=0, idle=24, qSize=0] [21:03:23] : [Step 4/5] ^-- Striped thread pool [active=0, idle=24, qSize=0] [21:03:23] : [Step 4/5] ^-- Custom executor 0 [active=0, idle=0, qSize=0] [21:03:23] : [Step 4/5] ^-- Custom executor 1 [active=0, idle=0, qSize=0] [21:03:23] : [Step 4/5] [2021-11-19 21:03:23,444][INFO ][grid-timeout-worker-#5169%internal.GridNodeMetricsLogPdsSelfTest1%][root] [GridStringLogger echo] FreeList [name=userTransientDataRegion##FreeList, buckets=256, dataPages=1, reusePages=0] [21:03:24] : [Step 4/5] [2021-11-19 21:03:24,397][INFO ][grid-timeout-worker-#5050%internal.GridNodeMetricsLogPdsSelfTest0%][root] [GridStringLogger echo] [21:03:24] : [Step 4/5] Metrics for local node (to disable set 'metricsLogFrequency' to 0) [21:03:24] : [Step 4/5] ^-- Node [id=5a320cff, name=internal.GridNodeMetricsLogPdsSelfTest0, uptime=00:00:06.066] [21:03:24] : [Step 4/5] ^-- Cluster [hosts=1, CPUs=24, servers=2, clients=0, topVer=2, minorTopVer=3] [21:03:24] : [Step 4/5] ^-- Network [addrs=[127.0.0.1], localHost=127.0.0.1, discoPort=47500, commPort=45100] [21:03:24] : [Step 4/5] ^-- CPU [CPUs=24, curLoad=1.73%, avgLoad=0.43%, GC=0%] [21:03:24] : [Step 4/5] ^-- Heap [used=693MB, free=64.56%, comm=1956MB] [21:03:24] : [Step 4/5] ^-- Off-heap memory [used=4MB, free=99.08%, allocated=249MB] [21:03:24] : [Step 4/5] ^-- Page memory [pages=1053] [21:03:24] : [Step 4/5] ^-- sysMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:03:24] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=99.98%, allocRam=99MB, allocTotal=0MB] [21:03:24] : [Step 4/5] ^-- default region [type=default, persistence=true, lazyAlloc=true, [21:03:24] : [Step 4/5] ... initCfg=30MB, maxCfg=30MB, usedRam=0MB, freeRam=99.93%, allocRam=30MB, allocTotal=0MB] [21:03:24] : [Step 4/5] ^-- metastoreMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:03:24] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=99.95%, allocRam=0MB, allocTotal=0MB] [21:03:24] : [Step 4/5] ^-- TxLog region [type=internal, persistence=true, lazyAlloc=false, [21:03:24] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:03:24] : [Step 4/5] ^-- volatileDsMemPlc region [type=user, persistence=false, lazyAlloc=true, [21:03:24] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB] [21:03:24] : [Step 4/5] ^-- userTransientDataRegion region [type=user, persistence=false, lazyAlloc=true, [21:03:24] : [Step 4/5] ... initCfg=20MB, maxCfg=20MB, usedRam=4MB, freeRam=79.76%, allocRam=20MB] [21:03:24] : [Step 4/5] ^-- Ignite persistence [used=0MB] [21:03:24] : [Step 4/5] ^-- Outbound messages queue [size=0] [21:03:24] : [Step 4/5] ^-- Public thread pool [active=0, idle=5, qSize=0] [21:03:24] : [Step 4/5] ^-- System thread pool [active=0, idle=24, qSize=0] [21:03:24] : [Step 4/5] ^-- Striped thread pool [active=0, idle=24, qSize=0] [21:03:24] : [Step 4/5] ^-- Custom executor 0 [active=0, idle=0, qSize=0] [21:03:24] : [Step 4/5] ^-- Custom executor 1 [active=0, idle=0, qSize=0] [21:03:24] : [Step 4/5] [2021-11-19 21:03:24,448][INFO ][grid-timeout-worker-#5169%internal.GridNodeMetricsLogPdsSelfTest1%][root] [GridStringLogger echo] [21:03:24] : [Step 4/5] Metrics for local node (to disable set 'metricsLogFrequency' to 0) [21:03:24] : [Step 4/5] ^-- Node [id=26a828be, name=internal.GridNodeMetricsLogPdsSelfTest1, uptime=00:00:04.043] [21:03:24] : [Step 4/5] ^-- Cluster [hosts=1, CPUs=24, servers=2, clients=0, topVer=2, minorTopVer=3] [21:03:24] : [Step 4/5] ^-- Network [addrs=[127.0.0.1], localHost=127.0.0.1, discoPort=47501, commPort=45101] [21:03:24] : [Step 4/5] ^-- CPU [CPUs=24, curLoad=0%, avgLoad=0%, GC=0%] [21:03:24] : [Step 4/5] ^-- Heap [used=692MB, free=64.58%, comm=1956MB] [21:03:24] : [Step 4/5] ^-- Off-heap memory [used=4MB, free=99.08%, allocated=249MB] [21:03:24] : [Step 4/5] ^-- Page memory [pages=1056] [21:03:24] : [Step 4/5] ^-- sysMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:03:24] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=99.98%, allocRam=99MB, allocTotal=0MB] [21:03:24] : [Step 4/5] ^-- default region [type=default, persistence=true, lazyAlloc=true, [21:03:24] : [Step 4/5] ... initCfg=30MB, maxCfg=30MB, usedRam=0MB, freeRam=99.82%, allocRam=30MB, allocTotal=0MB] [21:03:24] : [Step 4/5] ^-- metastoreMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:03:24] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=99.95%, allocRam=0MB, allocTotal=0MB] [21:03:24] : [Step 4/5] ^-- TxLog region [type=internal, persistence=true, lazyAlloc=false, [21:03:24] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:03:24] : [Step 4/5] ^-- volatileDsMemPlc region [type=user, persistence=false, lazyAlloc=true, [21:03:24] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB] [21:03:24] : [Step 4/5] ^-- userTransientDataRegion region [type=user, persistence=false, lazyAlloc=true, [21:03:24] : [Step 4/5] ... initCfg=20MB, maxCfg=20MB, usedRam=4MB, freeRam=79.88%, allocRam=20MB] [21:03:24] : [Step 4/5] ^-- Ignite persistence [used=0MB] [21:03:24] : [Step 4/5] ^-- Outbound messages queue [size=0] [21:03:24] : [Step 4/5] ^-- Public thread pool [active=0, idle=5, qSize=0] [21:03:24] : [Step 4/5] ^-- System thread pool [active=0, idle=24, qSize=0] [21:03:24] : [Step 4/5] ^-- Striped thread pool [active=0, idle=24, qSize=0] [21:03:24] : [Step 4/5] ^-- Custom executor 0 [active=0, idle=0, qSize=0] [21:03:24] : [Step 4/5] ^-- Custom executor 1 [active=0, idle=0, qSize=0] [21:03:24] : [Step 4/5] [2021-11-19 21:03:24,452][INFO ][grid-timeout-worker-#5169%internal.GridNodeMetricsLogPdsSelfTest1%][root] [GridStringLogger echo] FreeList [name=userTransientDataRegion##FreeList, buckets=256, dataPages=1, reusePages=0] [21:03:25] : [Step 4/5] [2021-11-19 21:03:25,404][INFO ][grid-timeout-worker-#5050%internal.GridNodeMetricsLogPdsSelfTest0%][root] [GridStringLogger echo] [21:03:25] : [Step 4/5] Metrics for local node (to disable set 'metricsLogFrequency' to 0) [21:03:25] : [Step 4/5] ^-- Node [id=5a320cff, name=internal.GridNodeMetricsLogPdsSelfTest0, uptime=00:00:07.074] [21:03:25] : [Step 4/5] ^-- Cluster [hosts=1, CPUs=24, servers=2, clients=0, topVer=2, minorTopVer=3] [21:03:25] : [Step 4/5] ^-- Network [addrs=[127.0.0.1], localHost=127.0.0.1, discoPort=47500, commPort=45100] [21:03:25] : [Step 4/5] ^-- CPU [CPUs=24, curLoad=1.73%, avgLoad=0.43%, GC=0%] [21:03:25] : [Step 4/5] ^-- Heap [used=693MB, free=64.56%, comm=1956MB] [21:03:25] : [Step 4/5] ^-- Off-heap memory [used=4MB, free=99.08%, allocated=249MB] [21:03:25] : [Step 4/5] ^-- Page memory [pages=1053] [21:03:25] : [Step 4/5] ^-- sysMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:03:25] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=99.98%, allocRam=99MB, allocTotal=0MB] [21:03:25] : [Step 4/5] ^-- default region [type=default, persistence=true, lazyAlloc=true, [21:03:25] : [Step 4/5] ... initCfg=30MB, maxCfg=30MB, usedRam=0MB, freeRam=99.93%, allocRam=30MB, allocTotal=0MB] [21:03:25] : [Step 4/5] ^-- metastoreMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:03:25] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=99.95%, allocRam=0MB, allocTotal=0MB] [21:03:25] : [Step 4/5] ^-- TxLog region [type=internal, persistence=true, lazyAlloc=false, [21:03:25] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:03:25] : [Step 4/5] ^-- volatileDsMemPlc region [type=user, persistence=false, lazyAlloc=true, [21:03:25] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB] [21:03:25] : [Step 4/5] ^-- userTransientDataRegion region [type=user, persistence=false, lazyAlloc=true, [21:03:25] : [Step 4/5] ... initCfg=20MB, maxCfg=20MB, usedRam=4MB, freeRam=79.76%, allocRam=20MB] [21:03:25] : [Step 4/5] ^-- Ignite persistence [used=0MB] [21:03:25] : [Step 4/5] ^-- Outbound messages queue [size=0] [21:03:25] : [Step 4/5] ^-- Public thread pool [active=0, idle=5, qSize=0] [21:03:25] : [Step 4/5] ^-- System thread pool [active=0, idle=24, qSize=0] [21:03:25] : [Step 4/5] ^-- Striped thread pool [active=0, idle=24, qSize=0] [21:03:25] : [Step 4/5] ^-- Custom executor 0 [active=0, idle=0, qSize=0] [21:03:25] : [Step 4/5] ^-- Custom executor 1 [active=0, idle=0, qSize=0] [21:03:25] : [Step 4/5] [2021-11-19 21:03:25,456][INFO ][grid-timeout-worker-#5169%internal.GridNodeMetricsLogPdsSelfTest1%][root] [GridStringLogger echo] [21:03:25] : [Step 4/5] Metrics for local node (to disable set 'metricsLogFrequency' to 0) [21:03:25] : [Step 4/5] ^-- Node [id=26a828be, name=internal.GridNodeMetricsLogPdsSelfTest1, uptime=00:00:05.051] [21:03:25] : [Step 4/5] ^-- Cluster [hosts=1, CPUs=24, servers=2, clients=0, topVer=2, minorTopVer=3] [21:03:25] : [Step 4/5] ^-- Network [addrs=[127.0.0.1], localHost=127.0.0.1, discoPort=47501, commPort=45101] [21:03:25] : [Step 4/5] ^-- CPU [CPUs=24, curLoad=0%, avgLoad=0%, GC=0%] [21:03:25] : [Step 4/5] ^-- Heap [used=692MB, free=64.58%, comm=1956MB] [21:03:25] : [Step 4/5] ^-- Off-heap memory [used=4MB, free=99.08%, allocated=249MB] [21:03:25] : [Step 4/5] ^-- Page memory [pages=1056] [21:03:25] : [Step 4/5] ^-- sysMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:03:25] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=99.98%, allocRam=99MB, allocTotal=0MB] [21:03:25] : [Step 4/5] ^-- default region [type=default, persistence=true, lazyAlloc=true, [21:03:25] : [Step 4/5] ... initCfg=30MB, maxCfg=30MB, usedRam=0MB, freeRam=99.82%, allocRam=30MB, allocTotal=0MB] [21:03:25] : [Step 4/5] ^-- metastoreMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:03:25] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=99.95%, allocRam=0MB, allocTotal=0MB] [21:03:25] : [Step 4/5] ^-- TxLog region [type=internal, persistence=true, lazyAlloc=false, [21:03:25] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:03:25] : [Step 4/5] ^-- volatileDsMemPlc region [type=user, persistence=false, lazyAlloc=true, [21:03:25] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB] [21:03:25] : [Step 4/5] ^-- userTransientDataRegion region [type=user, persistence=false, lazyAlloc=true, [21:03:25] : [Step 4/5] ... initCfg=20MB, maxCfg=20MB, usedRam=4MB, freeRam=79.88%, allocRam=20MB] [21:03:25] : [Step 4/5] ^-- Ignite persistence [used=0MB] [21:03:25] : [Step 4/5] ^-- Outbound messages queue [size=0] [21:03:25] : [Step 4/5] ^-- Public thread pool [active=0, idle=5, qSize=0] [21:03:25] : [Step 4/5] ^-- System thread pool [active=0, idle=24, qSize=0] [21:03:25] : [Step 4/5] ^-- Striped thread pool [active=0, idle=24, qSize=0] [21:03:25] : [Step 4/5] ^-- Custom executor 0 [active=0, idle=0, qSize=0] [21:03:25] : [Step 4/5] ^-- Custom executor 1 [active=0, idle=0, qSize=0] [21:03:25] : [Step 4/5] [2021-11-19 21:03:25,459][INFO ][grid-timeout-worker-#5169%internal.GridNodeMetricsLogPdsSelfTest1%][root] [GridStringLogger echo] FreeList [name=userTransientDataRegion##FreeList, buckets=256, dataPages=1, reusePages=0] [21:03:26] : [Step 4/5] [2021-11-19 21:03:26,414][INFO ][grid-timeout-worker-#5050%internal.GridNodeMetricsLogPdsSelfTest0%][root] [GridStringLogger echo] [21:03:26] : [Step 4/5] Metrics for local node (to disable set 'metricsLogFrequency' to 0) [21:03:26] : [Step 4/5] ^-- Node [id=5a320cff, name=internal.GridNodeMetricsLogPdsSelfTest0, uptime=00:00:08.082] [21:03:26] : [Step 4/5] ^-- Cluster [hosts=1, CPUs=24, servers=2, clients=0, topVer=2, minorTopVer=3] [21:03:26] : [Step 4/5] ^-- Network [addrs=[127.0.0.1], localHost=127.0.0.1, discoPort=47500, commPort=45100] [21:03:26] : [Step 4/5] ^-- CPU [CPUs=24, curLoad=1.73%, avgLoad=0.69%, GC=0%] [21:03:26] : [Step 4/5] ^-- Heap [used=693MB, free=64.56%, comm=1956MB] [21:03:26] : [Step 4/5] ^-- Off-heap memory [used=4MB, free=99.08%, allocated=249MB] [21:03:26] : [Step 4/5] ^-- Page memory [pages=1053] [21:03:26] : [Step 4/5] ^-- sysMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:03:26] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=99.98%, allocRam=99MB, allocTotal=0MB] [21:03:26] : [Step 4/5] ^-- default region [type=default, persistence=true, lazyAlloc=true, [21:03:26] : [Step 4/5] ... initCfg=30MB, maxCfg=30MB, usedRam=0MB, freeRam=99.93%, allocRam=30MB, allocTotal=0MB] [21:03:26] : [Step 4/5] ^-- metastoreMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:03:26] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=99.95%, allocRam=0MB, allocTotal=0MB] [21:03:26] : [Step 4/5] ^-- TxLog region [type=internal, persistence=true, lazyAlloc=false, [21:03:26] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:03:26] : [Step 4/5] ^-- volatileDsMemPlc region [type=user, persistence=false, lazyAlloc=true, [21:03:26] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB] [21:03:26] : [Step 4/5] ^-- userTransientDataRegion region [type=user, persistence=false, lazyAlloc=true, [21:03:26] : [Step 4/5] ... initCfg=20MB, maxCfg=20MB, usedRam=4MB, freeRam=79.76%, allocRam=20MB] [21:03:26] : [Step 4/5] ^-- Ignite persistence [used=0MB] [21:03:26] : [Step 4/5] ^-- Outbound messages queue [size=0] [21:03:26] : [Step 4/5] ^-- Public thread pool [active=0, idle=5, qSize=0] [21:03:26] : [Step 4/5] ^-- System thread pool [active=0, idle=24, qSize=0] [21:03:26] : [Step 4/5] ^-- Striped thread pool [active=0, idle=24, qSize=0] [21:03:26] : [Step 4/5] ^-- Custom executor 0 [active=0, idle=0, qSize=0] [21:03:26] : [Step 4/5] ^-- Custom executor 1 [active=0, idle=0, qSize=0] [21:03:26] : [Step 4/5] [2021-11-19 21:03:26,466][INFO ][grid-timeout-worker-#5169%internal.GridNodeMetricsLogPdsSelfTest1%][root] [GridStringLogger echo] [21:03:26] : [Step 4/5] Metrics for local node (to disable set 'metricsLogFrequency' to 0) [21:03:26] : [Step 4/5] ^-- Node [id=26a828be, name=internal.GridNodeMetricsLogPdsSelfTest1, uptime=00:00:06.060] [21:03:26] : [Step 4/5] ^-- Cluster [hosts=1, CPUs=24, servers=2, clients=0, topVer=2, minorTopVer=3] [21:03:26] : [Step 4/5] ^-- Network [addrs=[127.0.0.1], localHost=127.0.0.1, discoPort=47501, commPort=45101] [21:03:26] : [Step 4/5] ^-- CPU [CPUs=24, curLoad=1.13%, avgLoad=0%, GC=0%] [21:03:26] : [Step 4/5] ^-- Heap [used=695MB, free=64.45%, comm=1956MB] [21:03:26] : [Step 4/5] ^-- Off-heap memory [used=4MB, free=99.08%, allocated=249MB] [21:03:26] : [Step 4/5] ^-- Page memory [pages=1056] [21:03:26] : [Step 4/5] ^-- sysMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:03:26] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=99.98%, allocRam=99MB, allocTotal=0MB] [21:03:26] : [Step 4/5] ^-- default region [type=default, persistence=true, lazyAlloc=true, [21:03:26] : [Step 4/5] ... initCfg=30MB, maxCfg=30MB, usedRam=0MB, freeRam=99.82%, allocRam=30MB, allocTotal=0MB] [21:03:26] : [Step 4/5] ^-- metastoreMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:03:26] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=99.95%, allocRam=0MB, allocTotal=0MB] [21:03:26] : [Step 4/5] ^-- TxLog region [type=internal, persistence=true, lazyAlloc=false, [21:03:26] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:03:26] : [Step 4/5] ^-- volatileDsMemPlc region [type=user, persistence=false, lazyAlloc=true, [21:03:26] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB] [21:03:26] : [Step 4/5] ^-- userTransientDataRegion region [type=user, persistence=false, lazyAlloc=true, [21:03:26] : [Step 4/5] ... initCfg=20MB, maxCfg=20MB, usedRam=4MB, freeRam=79.88%, allocRam=20MB] [21:03:26] : [Step 4/5] ^-- Ignite persistence [used=0MB] [21:03:26] : [Step 4/5] ^-- Outbound messages queue [size=0] [21:03:26] : [Step 4/5] ^-- Public thread pool [active=0, idle=5, qSize=0] [21:03:26] : [Step 4/5] ^-- System thread pool [active=0, idle=24, qSize=0] [21:03:26] : [Step 4/5] ^-- Striped thread pool [active=0, idle=24, qSize=0] [21:03:26] : [Step 4/5] ^-- Custom executor 0 [active=0, idle=0, qSize=0] [21:03:26] : [Step 4/5] ^-- Custom executor 1 [active=0, idle=0, qSize=0] [21:03:26] : [Step 4/5] [2021-11-19 21:03:26,470][INFO ][grid-timeout-worker-#5169%internal.GridNodeMetricsLogPdsSelfTest1%][root] [GridStringLogger echo] FreeList [name=userTransientDataRegion##FreeList, buckets=256, dataPages=1, reusePages=0] [21:03:27] : [Step 4/5] [2021-11-19 21:03:27,422][INFO ][grid-timeout-worker-#5050%internal.GridNodeMetricsLogPdsSelfTest0%][root] [GridStringLogger echo] [21:03:27] : [Step 4/5] Metrics for local node (to disable set 'metricsLogFrequency' to 0) [21:03:27] : [Step 4/5] ^-- Node [id=5a320cff, name=internal.GridNodeMetricsLogPdsSelfTest0, uptime=00:00:09.091] [21:03:27] : [Step 4/5] ^-- Cluster [hosts=1, CPUs=24, servers=2, clients=0, topVer=2, minorTopVer=3] [21:03:27] : [Step 4/5] ^-- Network [addrs=[127.0.0.1], localHost=127.0.0.1, discoPort=47500, commPort=45100] [21:03:27] : [Step 4/5] ^-- CPU [CPUs=24, curLoad=0.6%, avgLoad=0.69%, GC=0%] [21:03:27] : [Step 4/5] ^-- Heap [used=696MB, free=64.42%, comm=1956MB] [21:03:27] : [Step 4/5] ^-- Off-heap memory [used=4MB, free=99.08%, allocated=249MB] [21:03:27] : [Step 4/5] ^-- Page memory [pages=1053] [21:03:27] : [Step 4/5] ^-- sysMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:03:27] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=99.98%, allocRam=99MB, allocTotal=0MB] [21:03:27] : [Step 4/5] ^-- default region [type=default, persistence=true, lazyAlloc=true, [21:03:27] : [Step 4/5] ... initCfg=30MB, maxCfg=30MB, usedRam=0MB, freeRam=99.93%, allocRam=30MB, allocTotal=0MB] [21:03:27] : [Step 4/5] ^-- metastoreMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:03:27] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=99.95%, allocRam=0MB, allocTotal=0MB] [21:03:27] : [Step 4/5] ^-- TxLog region [type=internal, persistence=true, lazyAlloc=false, [21:03:27] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:03:27] : [Step 4/5] ^-- volatileDsMemPlc region [type=user, persistence=false, lazyAlloc=true, [21:03:27] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB] [21:03:27] : [Step 4/5] ^-- userTransientDataRegion region [type=user, persistence=false, lazyAlloc=true, [21:03:27] : [Step 4/5] ... initCfg=20MB, maxCfg=20MB, usedRam=4MB, freeRam=79.76%, allocRam=20MB] [21:03:27] : [Step 4/5] ^-- Ignite persistence [used=0MB] [21:03:27] : [Step 4/5] ^-- Outbound messages queue [size=0] [21:03:27] : [Step 4/5] ^-- Public thread pool [active=0, idle=5, qSize=0] [21:03:27] : [Step 4/5] ^-- System thread pool [active=0, idle=24, qSize=0] [21:03:27] : [Step 4/5] ^-- Striped thread pool [active=0, idle=24, qSize=0] [21:03:27] : [Step 4/5] ^-- Custom executor 0 [active=0, idle=0, qSize=0] [21:03:27] : [Step 4/5] ^-- Custom executor 1 [active=0, idle=0, qSize=0] [21:03:27] : [Step 4/5] [2021-11-19 21:03:27,473][INFO ][grid-timeout-worker-#5169%internal.GridNodeMetricsLogPdsSelfTest1%][root] [GridStringLogger echo] [21:03:27] : [Step 4/5] Metrics for local node (to disable set 'metricsLogFrequency' to 0) [21:03:27] : [Step 4/5] ^-- Node [id=26a828be, name=internal.GridNodeMetricsLogPdsSelfTest1, uptime=00:00:07.069] [21:03:27] : [Step 4/5] ^-- Cluster [hosts=1, CPUs=24, servers=2, clients=0, topVer=2, minorTopVer=3] [21:03:27] : [Step 4/5] ^-- Network [addrs=[127.0.0.1], localHost=127.0.0.1, discoPort=47501, commPort=45101] [21:03:27] : [Step 4/5] ^-- CPU [CPUs=24, curLoad=1.13%, avgLoad=0%, GC=0%] [21:03:27] : [Step 4/5] ^-- Heap [used=695MB, free=64.45%, comm=1956MB] [21:03:27] : [Step 4/5] ^-- Off-heap memory [used=4MB, free=99.08%, allocated=249MB] [21:03:27] : [Step 4/5] ^-- Page memory [pages=1056] [21:03:27] : [Step 4/5] ^-- sysMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:03:27] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=99.98%, allocRam=99MB, allocTotal=0MB] [21:03:27] : [Step 4/5] ^-- default region [type=default, persistence=true, lazyAlloc=true, [21:03:27] : [Step 4/5] ... initCfg=30MB, maxCfg=30MB, usedRam=0MB, freeRam=99.82%, allocRam=30MB, allocTotal=0MB] [21:03:27] : [Step 4/5] ^-- metastoreMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:03:27] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=99.95%, allocRam=0MB, allocTotal=0MB] [21:03:27] : [Step 4/5] ^-- TxLog region [type=internal, persistence=true, lazyAlloc=false, [21:03:27] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:03:27] : [Step 4/5] ^-- volatileDsMemPlc region [type=user, persistence=false, lazyAlloc=true, [21:03:27] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB] [21:03:27] : [Step 4/5] ^-- userTransientDataRegion region [type=user, persistence=false, lazyAlloc=true, [21:03:27] : [Step 4/5] ... initCfg=20MB, maxCfg=20MB, usedRam=4MB, freeRam=79.88%, allocRam=20MB] [21:03:27] : [Step 4/5] ^-- Ignite persistence [used=0MB] [21:03:27] : [Step 4/5] ^-- Outbound messages queue [size=0] [21:03:27] : [Step 4/5] ^-- Public thread pool [active=0, idle=5, qSize=0] [21:03:27] : [Step 4/5] ^-- System thread pool [active=0, idle=24, qSize=0] [21:03:27] : [Step 4/5] ^-- Striped thread pool [active=0, idle=24, qSize=0] [21:03:27] : [Step 4/5] ^-- Custom executor 0 [active=0, idle=0, qSize=0] [21:03:27] : [Step 4/5] ^-- Custom executor 1 [active=0, idle=0, qSize=0] [21:03:27] : [Step 4/5] [2021-11-19 21:03:27,477][INFO ][grid-timeout-worker-#5169%internal.GridNodeMetricsLogPdsSelfTest1%][root] [GridStringLogger echo] FreeList [name=userTransientDataRegion##FreeList, buckets=256, dataPages=1, reusePages=0] [21:03:28] : [Step 4/5] [2021-11-19 21:03:28,430][INFO ][grid-timeout-worker-#5050%internal.GridNodeMetricsLogPdsSelfTest0%][root] [GridStringLogger echo] [21:03:28] : [Step 4/5] Metrics for local node (to disable set 'metricsLogFrequency' to 0) [21:03:28] : [Step 4/5] ^-- Node [id=5a320cff, name=internal.GridNodeMetricsLogPdsSelfTest0, uptime=00:00:10.099] [21:03:28] : [Step 4/5] ^-- Cluster [hosts=1, CPUs=24, servers=2, clients=0, topVer=2, minorTopVer=3] [21:03:28] : [Step 4/5] ^-- Network [addrs=[127.0.0.1], localHost=127.0.0.1, discoPort=47500, commPort=45100] [21:03:28] : [Step 4/5] ^-- CPU [CPUs=24, curLoad=0.6%, avgLoad=0.68%, GC=0%] [21:03:28] : [Step 4/5] ^-- Heap [used=696MB, free=64.42%, comm=1956MB] [21:03:28] : [Step 4/5] ^-- Off-heap memory [used=4MB, free=99.08%, allocated=249MB] [21:03:28] : [Step 4/5] ^-- Page memory [pages=1053] [21:03:28] : [Step 4/5] ^-- sysMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:03:28] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=99.98%, allocRam=99MB, allocTotal=0MB] [21:03:28] : [Step 4/5] ^-- default region [type=default, persistence=true, lazyAlloc=true, [21:03:28] : [Step 4/5] ... initCfg=30MB, maxCfg=30MB, usedRam=0MB, freeRam=99.93%, allocRam=30MB, allocTotal=0MB] [21:03:28] : [Step 4/5] ^-- metastoreMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:03:28] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=99.95%, allocRam=0MB, allocTotal=0MB] [21:03:28] : [Step 4/5] ^-- TxLog region [type=internal, persistence=true, lazyAlloc=false, [21:03:28] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:03:28] : [Step 4/5] ^-- volatileDsMemPlc region [type=user, persistence=false, lazyAlloc=true, [21:03:28] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB] [21:03:28] : [Step 4/5] ^-- userTransientDataRegion region [type=user, persistence=false, lazyAlloc=true, [21:03:28] : [Step 4/5] ... initCfg=20MB, maxCfg=20MB, usedRam=4MB, freeRam=79.76%, allocRam=20MB] [21:03:28] : [Step 4/5] ^-- Ignite persistence [used=0MB] [21:03:28] : [Step 4/5] ^-- Outbound messages queue [size=0] [21:03:28] : [Step 4/5] ^-- Public thread pool [active=0, idle=5, qSize=0] [21:03:28] : [Step 4/5] ^-- System thread pool [active=0, idle=24, qSize=0] [21:03:28] : [Step 4/5] ^-- Striped thread pool [active=0, idle=24, qSize=0] [21:03:28] : [Step 4/5] ^-- Custom executor 0 [active=0, idle=0, qSize=0] [21:03:28] : [Step 4/5] ^-- Custom executor 1 [active=0, idle=0, qSize=0] [21:03:28] : [Step 4/5] [2021-11-19 21:03:28,481][INFO ][grid-timeout-worker-#5169%internal.GridNodeMetricsLogPdsSelfTest1%][root] [GridStringLogger echo] [21:03:28] : [Step 4/5] Metrics for local node (to disable set 'metricsLogFrequency' to 0) [21:03:28] : [Step 4/5] ^-- Node [id=26a828be, name=internal.GridNodeMetricsLogPdsSelfTest1, uptime=00:00:08.077] [21:03:28] : [Step 4/5] ^-- Cluster [hosts=1, CPUs=24, servers=2, clients=0, topVer=2, minorTopVer=3] [21:03:28] : [Step 4/5] ^-- Network [addrs=[127.0.0.1], localHost=127.0.0.1, discoPort=47501, commPort=45101] [21:03:28] : [Step 4/5] ^-- CPU [CPUs=24, curLoad=1.13%, avgLoad=0.23%, GC=0%] [21:03:28] : [Step 4/5] ^-- Heap [used=695MB, free=64.45%, comm=1956MB] [21:03:28] : [Step 4/5] ^-- Off-heap memory [used=4MB, free=99.08%, allocated=249MB] [21:03:28] : [Step 4/5] ^-- Page memory [pages=1056] [21:03:28] : [Step 4/5] ^-- sysMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:03:28] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=99.98%, allocRam=99MB, allocTotal=0MB] [21:03:28] : [Step 4/5] ^-- default region [type=default, persistence=true, lazyAlloc=true, [21:03:28] : [Step 4/5] ... initCfg=30MB, maxCfg=30MB, usedRam=0MB, freeRam=99.82%, allocRam=30MB, allocTotal=0MB] [21:03:28] : [Step 4/5] ^-- metastoreMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:03:28] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=99.95%, allocRam=0MB, allocTotal=0MB] [21:03:28] : [Step 4/5] ^-- TxLog region [type=internal, persistence=true, lazyAlloc=false, [21:03:28] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:03:28] : [Step 4/5] ^-- volatileDsMemPlc region [type=user, persistence=false, lazyAlloc=true, [21:03:28] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB] [21:03:28] : [Step 4/5] ^-- userTransientDataRegion region [type=user, persistence=false, lazyAlloc=true, [21:03:28] : [Step 4/5] ... initCfg=20MB, maxCfg=20MB, usedRam=4MB, freeRam=79.88%, allocRam=20MB] [21:03:28] : [Step 4/5] ^-- Ignite persistence [used=0MB] [21:03:28] : [Step 4/5] ^-- Outbound messages queue [size=0] [21:03:28] : [Step 4/5] ^-- Public thread pool [active=0, idle=5, qSize=0] [21:03:28] : [Step 4/5] ^-- System thread pool [active=0, idle=24, qSize=0] [21:03:28] : [Step 4/5] ^-- Striped thread pool [active=0, idle=24, qSize=0] [21:03:28] : [Step 4/5] ^-- Custom executor 0 [active=0, idle=0, qSize=0] [21:03:28] : [Step 4/5] ^-- Custom executor 1 [active=0, idle=0, qSize=0] [21:03:28] : [Step 4/5] [2021-11-19 21:03:28,485][INFO ][grid-timeout-worker-#5169%internal.GridNodeMetricsLogPdsSelfTest1%][root] [GridStringLogger echo] FreeList [name=userTransientDataRegion##FreeList, buckets=256, dataPages=1, reusePages=0] [21:03:29] : [Step 4/5] [2021-11-19 21:03:29,440][INFO ][grid-timeout-worker-#5050%internal.GridNodeMetricsLogPdsSelfTest0%][root] [GridStringLogger echo] [21:03:29] : [Step 4/5] Metrics for local node (to disable set 'metricsLogFrequency' to 0) [21:03:29] : [Step 4/5] ^-- Node [id=5a320cff, name=internal.GridNodeMetricsLogPdsSelfTest0, uptime=00:00:11.108] [21:03:29] : [Step 4/5] ^-- Cluster [hosts=1, CPUs=24, servers=2, clients=0, topVer=2, minorTopVer=3] [21:03:29] : [Step 4/5] ^-- Network [addrs=[127.0.0.1], localHost=127.0.0.1, discoPort=47500, commPort=45100] [21:03:29] : [Step 4/5] ^-- CPU [CPUs=24, curLoad=0.6%, avgLoad=0.68%, GC=0%] [21:03:29] : [Step 4/5] ^-- Heap [used=696MB, free=64.42%, comm=1956MB] [21:03:29] : [Step 4/5] ^-- Off-heap memory [used=4MB, free=99.08%, allocated=249MB] [21:03:29] : [Step 4/5] ^-- Page memory [pages=1053] [21:03:29] : [Step 4/5] ^-- sysMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:03:29] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=99.98%, allocRam=99MB, allocTotal=0MB] [21:03:29] : [Step 4/5] ^-- default region [type=default, persistence=true, lazyAlloc=true, [21:03:29] : [Step 4/5] ... initCfg=30MB, maxCfg=30MB, usedRam=0MB, freeRam=99.93%, allocRam=30MB, allocTotal=0MB] [21:03:29] : [Step 4/5] ^-- metastoreMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:03:29] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=99.95%, allocRam=0MB, allocTotal=0MB] [21:03:29] : [Step 4/5] ^-- TxLog region [type=internal, persistence=true, lazyAlloc=false, [21:03:29] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:03:29] : [Step 4/5] ^-- volatileDsMemPlc region [type=user, persistence=false, lazyAlloc=true, [21:03:29] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB] [21:03:29] : [Step 4/5] ^-- userTransientDataRegion region [type=user, persistence=false, lazyAlloc=true, [21:03:29] : [Step 4/5] ... initCfg=20MB, maxCfg=20MB, usedRam=4MB, freeRam=79.76%, allocRam=20MB] [21:03:29] : [Step 4/5] ^-- Ignite persistence [used=0MB] [21:03:29] : [Step 4/5] ^-- Outbound messages queue [size=0] [21:03:29] : [Step 4/5] ^-- Public thread pool [active=0, idle=5, qSize=0] [21:03:29] : [Step 4/5] ^-- System thread pool [active=0, idle=24, qSize=0] [21:03:29] : [Step 4/5] ^-- Striped thread pool [active=0, idle=24, qSize=0] [21:03:29] : [Step 4/5] ^-- Custom executor 0 [active=0, idle=0, qSize=0] [21:03:29] : [Step 4/5] ^-- Custom executor 1 [active=0, idle=0, qSize=0] [21:03:29] : [Step 4/5] [2021-11-19 21:03:29,489][INFO ][grid-timeout-worker-#5169%internal.GridNodeMetricsLogPdsSelfTest1%][root] [GridStringLogger echo] [21:03:29] : [Step 4/5] Metrics for local node (to disable set 'metricsLogFrequency' to 0) [21:03:29] : [Step 4/5] ^-- Node [id=26a828be, name=internal.GridNodeMetricsLogPdsSelfTest1, uptime=00:00:09.086] [21:03:29] : [Step 4/5] ^-- Cluster [hosts=1, CPUs=24, servers=2, clients=0, topVer=2, minorTopVer=3] [21:03:29] : [Step 4/5] ^-- Network [addrs=[127.0.0.1], localHost=127.0.0.1, discoPort=47501, commPort=45101] [21:03:29] : [Step 4/5] ^-- CPU [CPUs=24, curLoad=0.17%, avgLoad=0.23%, GC=0%] [21:03:29] : [Step 4/5] ^-- Heap [used=697MB, free=64.35%, comm=1956MB] [21:03:29] : [Step 4/5] ^-- Off-heap memory [used=4MB, free=99.08%, allocated=249MB] [21:03:29] : [Step 4/5] ^-- Page memory [pages=1056] [21:03:29] : [Step 4/5] ^-- sysMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:03:29] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=99.98%, allocRam=99MB, allocTotal=0MB] [21:03:29] : [Step 4/5] ^-- default region [type=default, persistence=true, lazyAlloc=true, [21:03:29] : [Step 4/5] ... initCfg=30MB, maxCfg=30MB, usedRam=0MB, freeRam=99.82%, allocRam=30MB, allocTotal=0MB] [21:03:29] : [Step 4/5] ^-- metastoreMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:03:29] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=99.95%, allocRam=0MB, allocTotal=0MB] [21:03:29] : [Step 4/5] ^-- TxLog region [type=internal, persistence=true, lazyAlloc=false, [21:03:29] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:03:29] : [Step 4/5] ^-- volatileDsMemPlc region [type=user, persistence=false, lazyAlloc=true, [21:03:29] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB] [21:03:29] : [Step 4/5] ^-- userTransientDataRegion region [type=user, persistence=false, lazyAlloc=true, [21:03:29] : [Step 4/5] ... initCfg=20MB, maxCfg=20MB, usedRam=4MB, freeRam=79.88%, allocRam=20MB] [21:03:29] : [Step 4/5] ^-- Ignite persistence [used=0MB] [21:03:29] : [Step 4/5] ^-- Outbound messages queue [size=0] [21:03:29] : [Step 4/5] ^-- Public thread pool [active=0, idle=5, qSize=0] [21:03:29] : [Step 4/5] ^-- System thread pool [active=0, idle=24, qSize=0] [21:03:29] : [Step 4/5] ^-- Striped thread pool [active=0, idle=24, qSize=0] [21:03:29] : [Step 4/5] ^-- Custom executor 0 [active=0, idle=0, qSize=0] [21:03:29] : [Step 4/5] ^-- Custom executor 1 [active=0, idle=0, qSize=0] [21:03:29] : [Step 4/5] [2021-11-19 21:03:29,493][INFO ][grid-timeout-worker-#5169%internal.GridNodeMetricsLogPdsSelfTest1%][root] [GridStringLogger echo] FreeList [name=userTransientDataRegion##FreeList, buckets=256, dataPages=1, reusePages=0] [21:03:30] : [Step 4/5] [2021-11-19 21:03:30,439][INFO ][grid-timeout-worker-#5050%internal.GridNodeMetricsLogPdsSelfTest0%][root] [GridStringLogger echo] [21:03:30] : [Step 4/5] Metrics for local node (to disable set 'metricsLogFrequency' to 0) [21:03:30] : [Step 4/5] ^-- Node [id=5a320cff, name=internal.GridNodeMetricsLogPdsSelfTest0, uptime=00:00:12.108] [21:03:30] : [Step 4/5] ^-- Cluster [hosts=1, CPUs=24, servers=2, clients=0, topVer=2, minorTopVer=3] [21:03:30] : [Step 4/5] ^-- Network [addrs=[127.0.0.1], localHost=127.0.0.1, discoPort=47500, commPort=45100] [21:03:30] : [Step 4/5] ^-- CPU [CPUs=24, curLoad=0.13%, avgLoad=0.6%, GC=0%] [21:03:30] : [Step 4/5] ^-- Heap [used=698MB, free=64.31%, comm=1956MB] [21:03:30] : [Step 4/5] ^-- Off-heap memory [used=4MB, free=99.08%, allocated=249MB] [21:03:30] : [Step 4/5] ^-- Page memory [pages=1053] [21:03:30] : [Step 4/5] ^-- sysMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:03:30] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=99.98%, allocRam=99MB, allocTotal=0MB] [21:03:30] : [Step 4/5] ^-- default region [type=default, persistence=true, lazyAlloc=true, [21:03:30] : [Step 4/5] ... initCfg=30MB, maxCfg=30MB, usedRam=0MB, freeRam=99.93%, allocRam=30MB, allocTotal=0MB] [21:03:30] : [Step 4/5] ^-- metastoreMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:03:30] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=99.95%, allocRam=0MB, allocTotal=0MB] [21:03:30] : [Step 4/5] ^-- TxLog region [type=internal, persistence=true, lazyAlloc=false, [21:03:30] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:03:30] : [Step 4/5] ^-- volatileDsMemPlc region [type=user, persistence=false, lazyAlloc=true, [21:03:30] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB] [21:03:30] : [Step 4/5] ^-- userTransientDataRegion region [type=user, persistence=false, lazyAlloc=true, [21:03:30] : [Step 4/5] ... initCfg=20MB, maxCfg=20MB, usedRam=4MB, freeRam=79.76%, allocRam=20MB] [21:03:30] : [Step 4/5] ^-- Ignite persistence [used=0MB] [21:03:30] : [Step 4/5] ^-- Outbound messages queue [size=0] [21:03:30] : [Step 4/5] ^-- Public thread pool [active=0, idle=5, qSize=0] [21:03:30] : [Step 4/5] ^-- System thread pool [active=0, idle=24, qSize=0] [21:03:30] : [Step 4/5] ^-- Striped thread pool [active=0, idle=24, qSize=0] [21:03:30] : [Step 4/5] ^-- Custom executor 0 [active=0, idle=0, qSize=0] [21:03:30] : [Step 4/5] ^-- Custom executor 1 [active=0, idle=0, qSize=0] [21:03:30] : [Step 4/5] [2021-11-19 21:03:30,499][INFO ][grid-timeout-worker-#5169%internal.GridNodeMetricsLogPdsSelfTest1%][root] [GridStringLogger echo] [21:03:30] : [Step 4/5] Metrics for local node (to disable set 'metricsLogFrequency' to 0) [21:03:30] : [Step 4/5] ^-- Node [id=26a828be, name=internal.GridNodeMetricsLogPdsSelfTest1, uptime=00:00:10.095] [21:03:30] : [Step 4/5] ^-- Cluster [hosts=1, CPUs=24, servers=2, clients=0, topVer=2, minorTopVer=3] [21:03:30] : [Step 4/5] ^-- Network [addrs=[127.0.0.1], localHost=127.0.0.1, discoPort=47501, commPort=45101] [21:03:30] : [Step 4/5] ^-- CPU [CPUs=24, curLoad=0.17%, avgLoad=0.22%, GC=0%] [21:03:30] : [Step 4/5] ^-- Heap [used=697MB, free=64.35%, comm=1956MB] [21:03:30] : [Step 4/5] ^-- Off-heap memory [used=4MB, free=99.08%, allocated=249MB] [21:03:30] : [Step 4/5] ^-- Page memory [pages=1056] [21:03:30] : [Step 4/5] ^-- sysMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:03:30] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=99.98%, allocRam=99MB, allocTotal=0MB] [21:03:30] : [Step 4/5] ^-- default region [type=default, persistence=true, lazyAlloc=true, [21:03:30] : [Step 4/5] ... initCfg=30MB, maxCfg=30MB, usedRam=0MB, freeRam=99.82%, allocRam=30MB, allocTotal=0MB] [21:03:30] : [Step 4/5] ^-- metastoreMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:03:30] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=99.95%, allocRam=0MB, allocTotal=0MB] [21:03:30] : [Step 4/5] ^-- TxLog region [type=internal, persistence=true, lazyAlloc=false, [21:03:30] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:03:30] : [Step 4/5] ^-- volatileDsMemPlc region [type=user, persistence=false, lazyAlloc=true, [21:03:30] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB] [21:03:30] : [Step 4/5] ^-- userTransientDataRegion region [type=user, persistence=false, lazyAlloc=true, [21:03:30] : [Step 4/5] ... initCfg=20MB, maxCfg=20MB, usedRam=4MB, freeRam=79.88%, allocRam=20MB] [21:03:30] : [Step 4/5] ^-- Ignite persistence [used=0MB] [21:03:30] : [Step 4/5] ^-- Outbound messages queue [size=0] [21:03:30] : [Step 4/5] ^-- Public thread pool [active=0, idle=5, qSize=0] [21:03:30] : [Step 4/5] ^-- System thread pool [active=0, idle=24, qSize=0] [21:03:30] : [Step 4/5] ^-- Striped thread pool [active=0, idle=24, qSize=0] [21:03:30] : [Step 4/5] ^-- Custom executor 0 [active=0, idle=0, qSize=0] [21:03:30] : [Step 4/5] ^-- Custom executor 1 [active=0, idle=0, qSize=0] [21:03:30] : [Step 4/5] [2021-11-19 21:03:30,503][INFO ][grid-timeout-worker-#5169%internal.GridNodeMetricsLogPdsSelfTest1%][root] [GridStringLogger echo] FreeList [name=userTransientDataRegion##FreeList, buckets=256, dataPages=1, reusePages=0] [21:03:31] : [Step 4/5] [2021-11-19 21:03:31,447][INFO ][grid-timeout-worker-#5050%internal.GridNodeMetricsLogPdsSelfTest0%][root] [GridStringLogger echo] [21:03:31] : [Step 4/5] Metrics for local node (to disable set 'metricsLogFrequency' to 0) [21:03:31] : [Step 4/5] ^-- Node [id=5a320cff, name=internal.GridNodeMetricsLogPdsSelfTest0, uptime=00:00:13.116] [21:03:31] : [Step 4/5] ^-- Cluster [hosts=1, CPUs=24, servers=2, clients=0, topVer=2, minorTopVer=3] [21:03:31] : [Step 4/5] ^-- Network [addrs=[127.0.0.1], localHost=127.0.0.1, discoPort=47500, commPort=45100] [21:03:31] : [Step 4/5] ^-- CPU [CPUs=24, curLoad=0.13%, avgLoad=0.54%, GC=0%] [21:03:31] : [Step 4/5] ^-- Heap [used=698MB, free=64.31%, comm=1956MB] [21:03:31] : [Step 4/5] ^-- Off-heap memory [used=4MB, free=99.08%, allocated=249MB] [21:03:31] : [Step 4/5] ^-- Page memory [pages=1053] [21:03:31] : [Step 4/5] ^-- sysMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:03:31] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=99.98%, allocRam=99MB, allocTotal=0MB] [21:03:31] : [Step 4/5] ^-- default region [type=default, persistence=true, lazyAlloc=true, [21:03:31] : [Step 4/5] ... initCfg=30MB, maxCfg=30MB, usedRam=0MB, freeRam=99.93%, allocRam=30MB, allocTotal=0MB] [21:03:31] : [Step 4/5] ^-- metastoreMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:03:31] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=99.95%, allocRam=0MB, allocTotal=0MB] [21:03:31] : [Step 4/5] ^-- TxLog region [type=internal, persistence=true, lazyAlloc=false, [21:03:31] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:03:31] : [Step 4/5] ^-- volatileDsMemPlc region [type=user, persistence=false, lazyAlloc=true, [21:03:31] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB] [21:03:31] : [Step 4/5] ^-- userTransientDataRegion region [type=user, persistence=false, lazyAlloc=true, [21:03:31] : [Step 4/5] ... initCfg=20MB, maxCfg=20MB, usedRam=4MB, freeRam=79.76%, allocRam=20MB] [21:03:31] : [Step 4/5] ^-- Ignite persistence [used=0MB] [21:03:31] : [Step 4/5] ^-- Outbound messages queue [size=0] [21:03:31] : [Step 4/5] ^-- Public thread pool [active=0, idle=5, qSize=0] [21:03:31] : [Step 4/5] ^-- System thread pool [active=0, idle=24, qSize=0] [21:03:31] : [Step 4/5] ^-- Striped thread pool [active=0, idle=24, qSize=0] [21:03:31] : [Step 4/5] ^-- Custom executor 0 [active=0, idle=0, qSize=0] [21:03:31] : [Step 4/5] ^-- Custom executor 1 [active=0, idle=0, qSize=0] [21:03:31] : [Step 4/5] [2021-11-19 21:03:31,507][INFO ][grid-timeout-worker-#5169%internal.GridNodeMetricsLogPdsSelfTest1%][root] [GridStringLogger echo] [21:03:31] : [Step 4/5] Metrics for local node (to disable set 'metricsLogFrequency' to 0) [21:03:31] : [Step 4/5] ^-- Node [id=26a828be, name=internal.GridNodeMetricsLogPdsSelfTest1, uptime=00:00:11.104] [21:03:31] : [Step 4/5] ^-- Cluster [hosts=1, CPUs=24, servers=2, clients=0, topVer=2, minorTopVer=3] [21:03:31] : [Step 4/5] ^-- Network [addrs=[127.0.0.1], localHost=127.0.0.1, discoPort=47501, commPort=45101] [21:03:31] : [Step 4/5] ^-- CPU [CPUs=24, curLoad=0.17%, avgLoad=0.21%, GC=0%] [21:03:31] : [Step 4/5] ^-- Heap [used=697MB, free=64.35%, comm=1956MB] [21:03:31] : [Step 4/5] ^-- Off-heap memory [used=4MB, free=99.08%, allocated=249MB] [21:03:31] : [Step 4/5] ^-- Page memory [pages=1056] [21:03:31] : [Step 4/5] ^-- sysMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:03:31] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=99.98%, allocRam=99MB, allocTotal=0MB] [21:03:31] : [Step 4/5] ^-- default region [type=default, persistence=true, lazyAlloc=true, [21:03:31] : [Step 4/5] ... initCfg=30MB, maxCfg=30MB, usedRam=0MB, freeRam=99.82%, allocRam=30MB, allocTotal=0MB] [21:03:31] : [Step 4/5] ^-- metastoreMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:03:31] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=99.95%, allocRam=0MB, allocTotal=0MB] [21:03:31] : [Step 4/5] ^-- TxLog region [type=internal, persistence=true, lazyAlloc=false, [21:03:31] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:03:31] : [Step 4/5] ^-- volatileDsMemPlc region [type=user, persistence=false, lazyAlloc=true, [21:03:31] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB] [21:03:31] : [Step 4/5] ^-- userTransientDataRegion region [type=user, persistence=false, lazyAlloc=true, [21:03:31] : [Step 4/5] ... initCfg=20MB, maxCfg=20MB, usedRam=4MB, freeRam=79.88%, allocRam=20MB] [21:03:31] : [Step 4/5] ^-- Ignite persistence [used=0MB] [21:03:31] : [Step 4/5] ^-- Outbound messages queue [size=0] [21:03:31] : [Step 4/5] ^-- Public thread pool [active=0, idle=5, qSize=0] [21:03:31] : [Step 4/5] ^-- System thread pool [active=0, idle=24, qSize=0] [21:03:31] : [Step 4/5] ^-- Striped thread pool [active=0, idle=24, qSize=0] [21:03:31] : [Step 4/5] ^-- Custom executor 0 [active=0, idle=0, qSize=0] [21:03:31] : [Step 4/5] ^-- Custom executor 1 [active=0, idle=0, qSize=0] [21:03:31] : [Step 4/5] [2021-11-19 21:03:31,511][INFO ][grid-timeout-worker-#5169%internal.GridNodeMetricsLogPdsSelfTest1%][root] [GridStringLogger echo] FreeList [name=userTransientDataRegion##FreeList, buckets=256, dataPages=1, reusePages=0] [21:03:32] : [Step 4/5] [2021-11-19 21:03:32,456][INFO ][grid-timeout-worker-#5050%internal.GridNodeMetricsLogPdsSelfTest0%][root] [GridStringLogger echo] [21:03:32] : [Step 4/5] Metrics for local node (to disable set 'metricsLogFrequency' to 0) [21:03:32] : [Step 4/5] ^-- Node [id=5a320cff, name=internal.GridNodeMetricsLogPdsSelfTest0, uptime=00:00:14.125] [21:03:32] : [Step 4/5] ^-- Cluster [hosts=1, CPUs=24, servers=2, clients=0, topVer=2, minorTopVer=3] [21:03:32] : [Step 4/5] ^-- Network [addrs=[127.0.0.1], localHost=127.0.0.1, discoPort=47500, commPort=45100] [21:03:32] : [Step 4/5] ^-- CPU [CPUs=24, curLoad=0.13%, avgLoad=0.54%, GC=0%] [21:03:32] : [Step 4/5] ^-- Heap [used=698MB, free=64.31%, comm=1956MB] [21:03:32] : [Step 4/5] ^-- Off-heap memory [used=4MB, free=99.08%, allocated=249MB] [21:03:32] : [Step 4/5] ^-- Page memory [pages=1053] [21:03:32] : [Step 4/5] ^-- sysMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:03:32] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=99.98%, allocRam=99MB, allocTotal=0MB] [21:03:32] : [Step 4/5] ^-- default region [type=default, persistence=true, lazyAlloc=true, [21:03:32] : [Step 4/5] ... initCfg=30MB, maxCfg=30MB, usedRam=0MB, freeRam=99.93%, allocRam=30MB, allocTotal=0MB] [21:03:32] : [Step 4/5] ^-- metastoreMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:03:32] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=99.95%, allocRam=0MB, allocTotal=0MB] [21:03:32] : [Step 4/5] ^-- TxLog region [type=internal, persistence=true, lazyAlloc=false, [21:03:32] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:03:32] : [Step 4/5] ^-- volatileDsMemPlc region [type=user, persistence=false, lazyAlloc=true, [21:03:32] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB] [21:03:32] : [Step 4/5] ^-- userTransientDataRegion region [type=user, persistence=false, lazyAlloc=true, [21:03:32] : [Step 4/5] ... initCfg=20MB, maxCfg=20MB, usedRam=4MB, freeRam=79.76%, allocRam=20MB] [21:03:32] : [Step 4/5] ^-- Ignite persistence [used=0MB] [21:03:32] : [Step 4/5] ^-- Outbound messages queue [size=0] [21:03:32] : [Step 4/5] ^-- Public thread pool [active=0, idle=5, qSize=0] [21:03:32] : [Step 4/5] ^-- System thread pool [active=0, idle=24, qSize=0] [21:03:32] : [Step 4/5] ^-- Striped thread pool [active=0, idle=24, qSize=0] [21:03:32] : [Step 4/5] ^-- Custom executor 0 [active=0, idle=0, qSize=0] [21:03:32] : [Step 4/5] ^-- Custom executor 1 [active=0, idle=0, qSize=0] [21:03:32] : [Step 4/5] [2021-11-19 21:03:32,516][INFO ][grid-timeout-worker-#5169%internal.GridNodeMetricsLogPdsSelfTest1%][root] [GridStringLogger echo] [21:03:32] : [Step 4/5] Metrics for local node (to disable set 'metricsLogFrequency' to 0) [21:03:32] : [Step 4/5] ^-- Node [id=26a828be, name=internal.GridNodeMetricsLogPdsSelfTest1, uptime=00:00:12.112] [21:03:32] : [Step 4/5] ^-- Cluster [hosts=1, CPUs=24, servers=2, clients=0, topVer=2, minorTopVer=3] [21:03:32] : [Step 4/5] ^-- Network [addrs=[127.0.0.1], localHost=127.0.0.1, discoPort=47501, commPort=45101] [21:03:32] : [Step 4/5] ^-- CPU [CPUs=24, curLoad=2.3%, avgLoad=0.21%, GC=0%] [21:03:32] : [Step 4/5] ^-- Heap [used=700MB, free=64.21%, comm=1956MB] [21:03:32] : [Step 4/5] ^-- Off-heap memory [used=4MB, free=99.08%, allocated=249MB] [21:03:32] : [Step 4/5] ^-- Page memory [pages=1056] [21:03:32] : [Step 4/5] ^-- sysMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:03:32] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=99.98%, allocRam=99MB, allocTotal=0MB] [21:03:32] : [Step 4/5] ^-- default region [type=default, persistence=true, lazyAlloc=true, [21:03:32] : [Step 4/5] ... initCfg=30MB, maxCfg=30MB, usedRam=0MB, freeRam=99.82%, allocRam=30MB, allocTotal=0MB] [21:03:32] : [Step 4/5] ^-- metastoreMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:03:32] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=99.95%, allocRam=0MB, allocTotal=0MB] [21:03:32] : [Step 4/5] ^-- TxLog region [type=internal, persistence=true, lazyAlloc=false, [21:03:32] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:03:32] : [Step 4/5] ^-- volatileDsMemPlc region [type=user, persistence=false, lazyAlloc=true, [21:03:32] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB] [21:03:32] : [Step 4/5] ^-- userTransientDataRegion region [type=user, persistence=false, lazyAlloc=true, [21:03:32] : [Step 4/5] ... initCfg=20MB, maxCfg=20MB, usedRam=4MB, freeRam=79.88%, allocRam=20MB] [21:03:32] : [Step 4/5] ^-- Ignite persistence [used=0MB] [21:03:32] : [Step 4/5] ^-- Outbound messages queue [size=0] [21:03:32] : [Step 4/5] ^-- Public thread pool [active=0, idle=5, qSize=0] [21:03:32] : [Step 4/5] ^-- System thread pool [active=0, idle=24, qSize=0] [21:03:32] : [Step 4/5] ^-- Striped thread pool [active=0, idle=24, qSize=0] [21:03:32] : [Step 4/5] ^-- Custom executor 0 [active=0, idle=0, qSize=0] [21:03:32] : [Step 4/5] ^-- Custom executor 1 [active=0, idle=0, qSize=0] [21:03:32] : [Step 4/5] [2021-11-19 21:03:32,520][INFO ][grid-timeout-worker-#5169%internal.GridNodeMetricsLogPdsSelfTest1%][root] [GridStringLogger echo] FreeList [name=userTransientDataRegion##FreeList, buckets=256, dataPages=1, reusePages=0] [21:03:33] : [Step 4/5] [2021-11-19 21:03:33,465][INFO ][grid-timeout-worker-#5050%internal.GridNodeMetricsLogPdsSelfTest0%][root] [GridStringLogger echo] [21:03:33] : [Step 4/5] Metrics for local node (to disable set 'metricsLogFrequency' to 0) [21:03:33] : [Step 4/5] ^-- Node [id=5a320cff, name=internal.GridNodeMetricsLogPdsSelfTest0, uptime=00:00:15.134] [21:03:33] : [Step 4/5] ^-- Cluster [hosts=1, CPUs=24, servers=2, clients=0, topVer=2, minorTopVer=3] [21:03:33] : [Step 4/5] ^-- Network [addrs=[127.0.0.1], localHost=127.0.0.1, discoPort=47500, commPort=45100] [21:03:33] : [Step 4/5] ^-- CPU [CPUs=24, curLoad=3.6%, avgLoad=0.88%, GC=0%] [21:03:33] : [Step 4/5] ^-- Heap [used=700MB, free=64.18%, comm=1956MB] [21:03:33] : [Step 4/5] ^-- Off-heap memory [used=4MB, free=99.08%, allocated=249MB] [21:03:33] : [Step 4/5] ^-- Page memory [pages=1053] [21:03:33] : [Step 4/5] ^-- sysMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:03:33] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=99.98%, allocRam=99MB, allocTotal=0MB] [21:03:33] : [Step 4/5] ^-- default region [type=default, persistence=true, lazyAlloc=true, [21:03:33] : [Step 4/5] ... initCfg=30MB, maxCfg=30MB, usedRam=0MB, freeRam=99.93%, allocRam=30MB, allocTotal=0MB] [21:03:33] : [Step 4/5] ^-- metastoreMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:03:33] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=99.95%, allocRam=0MB, allocTotal=0MB] [21:03:33] : [Step 4/5] ^-- TxLog region [type=internal, persistence=true, lazyAlloc=false, [21:03:33] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:03:33] : [Step 4/5] ^-- volatileDsMemPlc region [type=user, persistence=false, lazyAlloc=true, [21:03:33] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB] [21:03:33] : [Step 4/5] ^-- userTransientDataRegion region [type=user, persistence=false, lazyAlloc=true, [21:03:33] : [Step 4/5] ... initCfg=20MB, maxCfg=20MB, usedRam=4MB, freeRam=79.76%, allocRam=20MB] [21:03:33] : [Step 4/5] ^-- Ignite persistence [used=0MB] [21:03:33] : [Step 4/5] ^-- Outbound messages queue [size=0] [21:03:33] : [Step 4/5] ^-- Public thread pool [active=0, idle=5, qSize=0] [21:03:33] : [Step 4/5] ^-- System thread pool [active=0, idle=24, qSize=0] [21:03:33] : [Step 4/5] ^-- Striped thread pool [active=0, idle=24, qSize=0] [21:03:33] : [Step 4/5] ^-- Custom executor 0 [active=0, idle=0, qSize=0] [21:03:33] : [Step 4/5] ^-- Custom executor 1 [active=0, idle=0, qSize=0] [21:03:33] : [Step 4/5] [2021-11-19 21:03:33,525][INFO ][grid-timeout-worker-#5169%internal.GridNodeMetricsLogPdsSelfTest1%][root] [GridStringLogger echo] [21:03:33] : [Step 4/5] Metrics for local node (to disable set 'metricsLogFrequency' to 0) [21:03:33] : [Step 4/5] ^-- Node [id=26a828be, name=internal.GridNodeMetricsLogPdsSelfTest1, uptime=00:00:13.121] [21:03:33] : [Step 4/5] ^-- Cluster [hosts=1, CPUs=24, servers=2, clients=0, topVer=2, minorTopVer=3] [21:03:33] : [Step 4/5] ^-- Network [addrs=[127.0.0.1], localHost=127.0.0.1, discoPort=47501, commPort=45101] [21:03:33] : [Step 4/5] ^-- CPU [CPUs=24, curLoad=2.3%, avgLoad=0.47%, GC=0%] [21:03:33] : [Step 4/5] ^-- Heap [used=700MB, free=64.21%, comm=1956MB] [21:03:33] : [Step 4/5] ^-- Off-heap memory [used=4MB, free=99.08%, allocated=249MB] [21:03:33] : [Step 4/5] ^-- Page memory [pages=1056] [21:03:33] : [Step 4/5] ^-- sysMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:03:33] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=99.98%, allocRam=99MB, allocTotal=0MB] [21:03:33] : [Step 4/5] ^-- default region [type=default, persistence=true, lazyAlloc=true, [21:03:33] : [Step 4/5] ... initCfg=30MB, maxCfg=30MB, usedRam=0MB, freeRam=99.82%, allocRam=30MB, allocTotal=0MB] [21:03:33] : [Step 4/5] ^-- metastoreMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:03:33] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=99.95%, allocRam=0MB, allocTotal=0MB] [21:03:33] : [Step 4/5] ^-- TxLog region [type=internal, persistence=true, lazyAlloc=false, [21:03:33] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:03:33] : [Step 4/5] ^-- volatileDsMemPlc region [type=user, persistence=false, lazyAlloc=true, [21:03:33] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB] [21:03:33] : [Step 4/5] ^-- userTransientDataRegion region [type=user, persistence=false, lazyAlloc=true, [21:03:33] : [Step 4/5] ... initCfg=20MB, maxCfg=20MB, usedRam=4MB, freeRam=79.88%, allocRam=20MB] [21:03:33] : [Step 4/5] ^-- Ignite persistence [used=0MB] [21:03:33] : [Step 4/5] ^-- Outbound messages queue [size=0] [21:03:33] : [Step 4/5] ^-- Public thread pool [active=0, idle=5, qSize=0] [21:03:33] : [Step 4/5] ^-- System thread pool [active=0, idle=24, qSize=0] [21:03:33] : [Step 4/5] ^-- Striped thread pool [active=0, idle=24, qSize=0] [21:03:33] : [Step 4/5] ^-- Custom executor 0 [active=0, idle=0, qSize=0] [21:03:33] : [Step 4/5] ^-- Custom executor 1 [active=0, idle=0, qSize=0] [21:03:33] : [Step 4/5] [2021-11-19 21:03:33,528][INFO ][grid-timeout-worker-#5169%internal.GridNodeMetricsLogPdsSelfTest1%][root] [GridStringLogger echo] FreeList [name=userTransientDataRegion##FreeList, buckets=256, dataPages=1, reusePages=0] [21:03:34] : [Step 4/5] [2021-11-19 21:03:34,473][INFO ][grid-timeout-worker-#5050%internal.GridNodeMetricsLogPdsSelfTest0%][root] [GridStringLogger echo] [21:03:34] : [Step 4/5] Metrics for local node (to disable set 'metricsLogFrequency' to 0) [21:03:34] : [Step 4/5] ^-- Node [id=5a320cff, name=internal.GridNodeMetricsLogPdsSelfTest0, uptime=00:00:16.142] [21:03:34] : [Step 4/5] ^-- Cluster [hosts=1, CPUs=24, servers=2, clients=0, topVer=2, minorTopVer=3] [21:03:34] : [Step 4/5] ^-- Network [addrs=[127.0.0.1], localHost=127.0.0.1, discoPort=47500, commPort=45100] [21:03:34] : [Step 4/5] ^-- CPU [CPUs=24, curLoad=3.6%, avgLoad=1.15%, GC=0%] [21:03:34] : [Step 4/5] ^-- Heap [used=700MB, free=64.18%, comm=1956MB] [21:03:34] : [Step 4/5] ^-- Off-heap memory [used=4MB, free=99.08%, allocated=249MB] [21:03:34] : [Step 4/5] ^-- Page memory [pages=1053] [21:03:34] : [Step 4/5] ^-- sysMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:03:34] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=99.98%, allocRam=99MB, allocTotal=0MB] [21:03:34] : [Step 4/5] ^-- default region [type=default, persistence=true, lazyAlloc=true, [21:03:34] : [Step 4/5] ... initCfg=30MB, maxCfg=30MB, usedRam=0MB, freeRam=99.93%, allocRam=30MB, allocTotal=0MB] [21:03:34] : [Step 4/5] ^-- metastoreMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:03:34] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=99.95%, allocRam=0MB, allocTotal=0MB] [21:03:34] : [Step 4/5] ^-- TxLog region [type=internal, persistence=true, lazyAlloc=false, [21:03:34] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:03:34] : [Step 4/5] ^-- volatileDsMemPlc region [type=user, persistence=false, lazyAlloc=true, [21:03:34] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB] [21:03:34] : [Step 4/5] ^-- userTransientDataRegion region [type=user, persistence=false, lazyAlloc=true, [21:03:34] : [Step 4/5] ... initCfg=20MB, maxCfg=20MB, usedRam=4MB, freeRam=79.76%, allocRam=20MB] [21:03:34] : [Step 4/5] ^-- Ignite persistence [used=0MB] [21:03:34] : [Step 4/5] ^-- Outbound messages queue [size=0] [21:03:34] : [Step 4/5] ^-- Public thread pool [active=0, idle=5, qSize=0] [21:03:34] : [Step 4/5] ^-- System thread pool [active=0, idle=24, qSize=0] [21:03:34] : [Step 4/5] ^-- Striped thread pool [active=0, idle=24, qSize=0] [21:03:34] : [Step 4/5] ^-- Custom executor 0 [active=0, idle=0, qSize=0] [21:03:34] : [Step 4/5] ^-- Custom executor 1 [active=0, idle=0, qSize=0] [21:03:34] : [Step 4/5] [2021-11-19 21:03:34,534][INFO ][grid-timeout-worker-#5169%internal.GridNodeMetricsLogPdsSelfTest1%][root] [GridStringLogger echo] [21:03:34] : [Step 4/5] Metrics for local node (to disable set 'metricsLogFrequency' to 0) [21:03:34] : [Step 4/5] ^-- Node [id=26a828be, name=internal.GridNodeMetricsLogPdsSelfTest1, uptime=00:00:14.129] [21:03:34] : [Step 4/5] ^-- Cluster [hosts=1, CPUs=24, servers=2, clients=0, topVer=2, minorTopVer=3] [21:03:34] : [Step 4/5] ^-- Network [addrs=[127.0.0.1], localHost=127.0.0.1, discoPort=47501, commPort=45101] [21:03:34] : [Step 4/5] ^-- CPU [CPUs=24, curLoad=2.3%, avgLoad=0.67%, GC=0%] [21:03:34] : [Step 4/5] ^-- Heap [used=700MB, free=64.21%, comm=1956MB] [21:03:34] : [Step 4/5] ^-- Off-heap memory [used=4MB, free=99.08%, allocated=249MB] [21:03:34] : [Step 4/5] ^-- Page memory [pages=1056] [21:03:34] : [Step 4/5] ^-- sysMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:03:34] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=99.98%, allocRam=99MB, allocTotal=0MB] [21:03:34] : [Step 4/5] ^-- default region [type=default, persistence=true, lazyAlloc=true, [21:03:34] : [Step 4/5] ... initCfg=30MB, maxCfg=30MB, usedRam=0MB, freeRam=99.82%, allocRam=30MB, allocTotal=0MB] [21:03:34] : [Step 4/5] ^-- metastoreMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:03:34] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=99.95%, allocRam=0MB, allocTotal=0MB] [21:03:34] : [Step 4/5] ^-- TxLog region [type=internal, persistence=true, lazyAlloc=false, [21:03:34] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:03:34] : [Step 4/5] ^-- volatileDsMemPlc region [type=user, persistence=false, lazyAlloc=true, [21:03:34] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB] [21:03:34] : [Step 4/5] ^-- userTransientDataRegion region [type=user, persistence=false, lazyAlloc=true, [21:03:34] : [Step 4/5] ... initCfg=20MB, maxCfg=20MB, usedRam=4MB, freeRam=79.88%, allocRam=20MB] [21:03:34] : [Step 4/5] ^-- Ignite persistence [used=0MB] [21:03:34] : [Step 4/5] ^-- Outbound messages queue [size=0] [21:03:34] : [Step 4/5] ^-- Public thread pool [active=0, idle=5, qSize=0] [21:03:34] : [Step 4/5] ^-- System thread pool [active=0, idle=24, qSize=0] [21:03:34] : [Step 4/5] ^-- Striped thread pool [active=0, idle=24, qSize=0] [21:03:34] : [Step 4/5] ^-- Custom executor 0 [active=0, idle=0, qSize=0] [21:03:34] : [Step 4/5] ^-- Custom executor 1 [active=0, idle=0, qSize=0] [21:03:34] : [Step 4/5] [2021-11-19 21:03:34,538][INFO ][grid-timeout-worker-#5169%internal.GridNodeMetricsLogPdsSelfTest1%][root] [GridStringLogger echo] FreeList [name=userTransientDataRegion##FreeList, buckets=256, dataPages=1, reusePages=0] [21:03:35] : [Step 4/5] [2021-11-19 21:03:35,483][INFO ][grid-timeout-worker-#5050%internal.GridNodeMetricsLogPdsSelfTest0%][root] [GridStringLogger echo] [21:03:35] : [Step 4/5] Metrics for local node (to disable set 'metricsLogFrequency' to 0) [21:03:35] : [Step 4/5] ^-- Node [id=5a320cff, name=internal.GridNodeMetricsLogPdsSelfTest0, uptime=00:00:17.151] [21:03:35] : [Step 4/5] ^-- Cluster [hosts=1, CPUs=24, servers=2, clients=0, topVer=2, minorTopVer=3] [21:03:35] : [Step 4/5] ^-- Network [addrs=[127.0.0.1], localHost=127.0.0.1, discoPort=47500, commPort=45100] [21:03:35] : [Step 4/5] ^-- CPU [CPUs=24, curLoad=3.6%, avgLoad=1.15%, GC=0%] [21:03:35] : [Step 4/5] ^-- Heap [used=700MB, free=64.18%, comm=1956MB] [21:03:35] : [Step 4/5] ^-- Off-heap memory [used=4MB, free=99.08%, allocated=249MB] [21:03:35] : [Step 4/5] ^-- Page memory [pages=1053] [21:03:35] : [Step 4/5] ^-- sysMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:03:35] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=99.98%, allocRam=99MB, allocTotal=0MB] [21:03:35] : [Step 4/5] ^-- default region [type=default, persistence=true, lazyAlloc=true, [21:03:35] : [Step 4/5] ... initCfg=30MB, maxCfg=30MB, usedRam=0MB, freeRam=99.93%, allocRam=30MB, allocTotal=0MB] [21:03:35] : [Step 4/5] ^-- metastoreMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:03:35] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=99.95%, allocRam=0MB, allocTotal=0MB] [21:03:35] : [Step 4/5] ^-- TxLog region [type=internal, persistence=true, lazyAlloc=false, [21:03:35] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:03:35] : [Step 4/5] ^-- volatileDsMemPlc region [type=user, persistence=false, lazyAlloc=true, [21:03:35] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB] [21:03:35] : [Step 4/5] ^-- userTransientDataRegion region [type=user, persistence=false, lazyAlloc=true, [21:03:35] : [Step 4/5] ... initCfg=20MB, maxCfg=20MB, usedRam=4MB, freeRam=79.76%, allocRam=20MB] [21:03:35] : [Step 4/5] ^-- Ignite persistence [used=0MB] [21:03:35] : [Step 4/5] ^-- Outbound messages queue [size=0] [21:03:35] : [Step 4/5] ^-- Public thread pool [active=0, idle=5, qSize=0] [21:03:35] : [Step 4/5] ^-- System thread pool [active=0, idle=24, qSize=0] [21:03:35] : [Step 4/5] ^-- Striped thread pool [active=0, idle=24, qSize=0] [21:03:35] : [Step 4/5] ^-- Custom executor 0 [active=0, idle=0, qSize=0] [21:03:35] : [Step 4/5] ^-- Custom executor 1 [active=0, idle=0, qSize=0] [21:03:35] : [Step 4/5] [2021-11-19 21:03:35,542][INFO ][grid-timeout-worker-#5169%internal.GridNodeMetricsLogPdsSelfTest1%][root] [GridStringLogger echo] [21:03:35] : [Step 4/5] Metrics for local node (to disable set 'metricsLogFrequency' to 0) [21:03:35] : [Step 4/5] ^-- Node [id=26a828be, name=internal.GridNodeMetricsLogPdsSelfTest1, uptime=00:00:15.138] [21:03:35] : [Step 4/5] ^-- Cluster [hosts=1, CPUs=24, servers=2, clients=0, topVer=2, minorTopVer=3] [21:03:35] : [Step 4/5] ^-- Network [addrs=[127.0.0.1], localHost=127.0.0.1, discoPort=47501, commPort=45101] [21:03:35] : [Step 4/5] ^-- CPU [CPUs=24, curLoad=4.3%, avgLoad=0.67%, GC=0%] [21:03:35] : [Step 4/5] ^-- Heap [used=702MB, free=64.1%, comm=1956MB] [21:03:35] : [Step 4/5] ^-- Off-heap memory [used=4MB, free=99.08%, allocated=249MB] [21:03:35] : [Step 4/5] ^-- Page memory [pages=1056] [21:03:35] : [Step 4/5] ^-- sysMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:03:35] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=99.98%, allocRam=99MB, allocTotal=0MB] [21:03:35] : [Step 4/5] ^-- default region [type=default, persistence=true, lazyAlloc=true, [21:03:35] : [Step 4/5] ... initCfg=30MB, maxCfg=30MB, usedRam=0MB, freeRam=99.82%, allocRam=30MB, allocTotal=0MB] [21:03:35] : [Step 4/5] ^-- metastoreMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:03:35] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=99.95%, allocRam=0MB, allocTotal=0MB] [21:03:35] : [Step 4/5] ^-- TxLog region [type=internal, persistence=true, lazyAlloc=false, [21:03:35] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:03:35] : [Step 4/5] ^-- volatileDsMemPlc region [type=user, persistence=false, lazyAlloc=true, [21:03:35] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB] [21:03:35] : [Step 4/5] ^-- userTransientDataRegion region [type=user, persistence=false, lazyAlloc=true, [21:03:35] : [Step 4/5] ... initCfg=20MB, maxCfg=20MB, usedRam=4MB, freeRam=79.88%, allocRam=20MB] [21:03:35] : [Step 4/5] ^-- Ignite persistence [used=0MB] [21:03:35] : [Step 4/5] ^-- Outbound messages queue [size=0] [21:03:35] : [Step 4/5] ^-- Public thread pool [active=0, idle=5, qSize=0] [21:03:35] : [Step 4/5] ^-- System thread pool [active=0, idle=24, qSize=0] [21:03:35] : [Step 4/5] ^-- Striped thread pool [active=0, idle=24, qSize=0] [21:03:35] : [Step 4/5] ^-- Custom executor 0 [active=0, idle=0, qSize=0] [21:03:35] : [Step 4/5] ^-- Custom executor 1 [active=0, idle=0, qSize=0] [21:03:35] : [Step 4/5] [2021-11-19 21:03:35,545][INFO ][grid-timeout-worker-#5169%internal.GridNodeMetricsLogPdsSelfTest1%][root] [GridStringLogger echo] FreeList [name=userTransientDataRegion##FreeList, buckets=256, dataPages=1, reusePages=0] [21:03:36] : [Step 4/5] [2021-11-19 21:03:36,490][INFO ][grid-timeout-worker-#5050%internal.GridNodeMetricsLogPdsSelfTest0%][root] [GridStringLogger echo] [21:03:36] : [Step 4/5] Metrics for local node (to disable set 'metricsLogFrequency' to 0) [21:03:36] : [Step 4/5] ^-- Node [id=5a320cff, name=internal.GridNodeMetricsLogPdsSelfTest0, uptime=00:00:18.160] [21:03:36] : [Step 4/5] ^-- Cluster [hosts=1, CPUs=24, servers=2, clients=0, topVer=2, minorTopVer=3] [21:03:36] : [Step 4/5] ^-- Network [addrs=[127.0.0.1], localHost=127.0.0.1, discoPort=47500, commPort=45100] [21:03:36] : [Step 4/5] ^-- CPU [CPUs=24, curLoad=4.33%, avgLoad=1.44%, GC=0%] [21:03:36] : [Step 4/5] ^-- Heap [used=703MB, free=64.06%, comm=1956MB] [21:03:36] : [Step 4/5] ^-- Off-heap memory [used=4MB, free=99.08%, allocated=249MB] [21:03:36] : [Step 4/5] ^-- Page memory [pages=1053] [21:03:36] : [Step 4/5] ^-- sysMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:03:36] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=99.98%, allocRam=99MB, allocTotal=0MB] [21:03:36] : [Step 4/5] ^-- default region [type=default, persistence=true, lazyAlloc=true, [21:03:36] : [Step 4/5] ... initCfg=30MB, maxCfg=30MB, usedRam=0MB, freeRam=99.93%, allocRam=30MB, allocTotal=0MB] [21:03:36] : [Step 4/5] ^-- metastoreMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:03:36] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=99.95%, allocRam=0MB, allocTotal=0MB] [21:03:36] : [Step 4/5] ^-- TxLog region [type=internal, persistence=true, lazyAlloc=false, [21:03:36] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:03:36] : [Step 4/5] ^-- volatileDsMemPlc region [type=user, persistence=false, lazyAlloc=true, [21:03:36] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB] [21:03:36] : [Step 4/5] ^-- userTransientDataRegion region [type=user, persistence=false, lazyAlloc=true, [21:03:36] : [Step 4/5] ... initCfg=20MB, maxCfg=20MB, usedRam=4MB, freeRam=79.76%, allocRam=20MB] [21:03:36] : [Step 4/5] ^-- Ignite persistence [used=0MB] [21:03:36] : [Step 4/5] ^-- Outbound messages queue [size=0] [21:03:36] : [Step 4/5] ^-- Public thread pool [active=0, idle=5, qSize=0] [21:03:36] : [Step 4/5] ^-- System thread pool [active=0, idle=24, qSize=0] [21:03:36] : [Step 4/5] ^-- Striped thread pool [active=0, idle=24, qSize=0] [21:03:36] : [Step 4/5] ^-- Custom executor 0 [active=0, idle=0, qSize=0] [21:03:36] : [Step 4/5] ^-- Custom executor 1 [active=0, idle=0, qSize=0] [21:03:36] : [Step 4/5] [2021-11-19 21:03:36,551][INFO ][grid-timeout-worker-#5169%internal.GridNodeMetricsLogPdsSelfTest1%][root] [GridStringLogger echo] [21:03:36] : [Step 4/5] Metrics for local node (to disable set 'metricsLogFrequency' to 0) [21:03:36] : [Step 4/5] ^-- Node [id=26a828be, name=internal.GridNodeMetricsLogPdsSelfTest1, uptime=00:00:16.147] [21:03:36] : [Step 4/5] ^-- Cluster [hosts=1, CPUs=24, servers=2, clients=0, topVer=2, minorTopVer=3] [21:03:36] : [Step 4/5] ^-- Network [addrs=[127.0.0.1], localHost=127.0.0.1, discoPort=47501, commPort=45101] [21:03:36] : [Step 4/5] ^-- CPU [CPUs=24, curLoad=4.3%, avgLoad=1.04%, GC=0%] [21:03:36] : [Step 4/5] ^-- Heap [used=702MB, free=64.1%, comm=1956MB] [21:03:36] : [Step 4/5] ^-- Off-heap memory [used=4MB, free=99.08%, allocated=249MB] [21:03:36] : [Step 4/5] ^-- Page memory [pages=1056] [21:03:36] : [Step 4/5] ^-- sysMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:03:36] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=99.98%, allocRam=99MB, allocTotal=0MB] [21:03:36] : [Step 4/5] ^-- default region [type=default, persistence=true, lazyAlloc=true, [21:03:36] : [Step 4/5] ... initCfg=30MB, maxCfg=30MB, usedRam=0MB, freeRam=99.82%, allocRam=30MB, allocTotal=0MB] [21:03:36] : [Step 4/5] ^-- metastoreMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:03:36] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=99.95%, allocRam=0MB, allocTotal=0MB] [21:03:36] : [Step 4/5] ^-- TxLog region [type=internal, persistence=true, lazyAlloc=false, [21:03:36] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:03:36] : [Step 4/5] ^-- volatileDsMemPlc region [type=user, persistence=false, lazyAlloc=true, [21:03:36] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB] [21:03:36] : [Step 4/5] ^-- userTransientDataRegion region [type=user, persistence=false, lazyAlloc=true, [21:03:36] : [Step 4/5] ... initCfg=20MB, maxCfg=20MB, usedRam=4MB, freeRam=79.88%, allocRam=20MB] [21:03:36] : [Step 4/5] ^-- Ignite persistence [used=0MB] [21:03:36] : [Step 4/5] ^-- Outbound messages queue [size=0] [21:03:36] : [Step 4/5] ^-- Public thread pool [active=0, idle=5, qSize=0] [21:03:36] : [Step 4/5] ^-- System thread pool [active=0, idle=24, qSize=0] [21:03:36] : [Step 4/5] ^-- Striped thread pool [active=0, idle=24, qSize=0] [21:03:36] : [Step 4/5] ^-- Custom executor 0 [active=0, idle=0, qSize=0] [21:03:36] : [Step 4/5] ^-- Custom executor 1 [active=0, idle=0, qSize=0] [21:03:36] : [Step 4/5] [2021-11-19 21:03:36,553][INFO ][grid-timeout-worker-#5169%internal.GridNodeMetricsLogPdsSelfTest1%][root] [GridStringLogger echo] FreeList [name=userTransientDataRegion##FreeList, buckets=256, dataPages=1, reusePages=0] [21:03:36] : [Step 4/5] [21:03:36] >>> Stopping test: GridNodeMetricsLogPdsSelfTest#testNodeMetricsLog in 16166 ms <<< [21:03:36] : [Step 4/5] [2021-11-19 21:03:36,727][INFO ][main][root] >>> Stopping test: GridNodeMetricsLogPdsSelfTest#testNodeMetricsLog in 16166 ms <<< [21:03:36] : [Step 4/5] [21:03:36] >>> Heap: 704 MB used / 1956 MB commited / 1956 MB max <<< [21:03:36] : [Step 4/5] [2021-11-19 21:03:36,727][INFO ][main][root] >>> Heap: 704 MB used / 1956 MB commited / 1956 MB max <<< [21:03:36] : [Step 4/5] [21:03:36] >>> Non-Heap: 125 MB used / 135 MB commited / 0 MB max <<< [21:03:36] : [Step 4/5] [2021-11-19 21:03:36,727][INFO ][main][root] >>> Non-Heap: 125 MB used / 135 MB commited / 0 MB max <<< [21:03:36] : [Step 4/5] [2021-11-19 21:03:36,727][INFO ][main][root] >>> Stopping grid [name=internal.GridNodeMetricsLogPdsSelfTest0, id=5a320cff-6ba1-49d0-81a3-7e0c09e00000] [21:03:36] : [Step 4/5] [2021-11-19 21:03:36,749][INFO ][db-checkpoint-thread-#5247%internal.GridNodeMetricsLogPdsSelfTest0%][root] [GridStringLogger echo] Checkpoint started [checkpointId=650e9b91-ecd2-47a8-8716-dd24fe43b54f, startPtr=WALPointer [idx=0, fileOff=132783, len=11719], checkpointBeforeLockTime=2ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=1ms, checkpointLockHoldTime=3ms, walCpRecordFsyncDuration=1ms, writeCheckpointEntryDuration=3ms, splitAndSortCpPagesDuration=0ms, pages=5, reason='timeout'] [21:03:36] : [Step 4/5] [2021-11-19 21:03:36,761][INFO ][tcp-disco-sock-reader-[26a828be 127.0.0.1:50455]-#260%internal.GridNodeMetricsLogPdsSelfTest0%-#5233%internal.GridNodeMetricsLogPdsSelfTest0%][root] [GridStringLogger echo] Finished serving remote node connection [rmtAddr=/127.0.0.1:50455, rmtPort=50455, rmtNodeId=26a828be-527b-42db-a842-bea7dc000001] [21:03:36] : [Step 4/5] [2021-11-19 21:03:36,762][INFO ][disco-event-worker-#5235%internal.GridNodeMetricsLogPdsSelfTest1%][root] [GridStringLogger echo] Node left topology: TcpDiscoveryNode [id=5a320cff-6ba1-49d0-81a3-7e0c09e00000, consistentId=2fadaaf7-63e4-4de5-9a38-471957431855, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345000336, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false] [21:03:36] : [Step 4/5] [2021-11-19 21:03:36,765][INFO ][main][root] [GridStringLogger echo] Stopped cache [cacheName=ignite-sys-cache] [21:03:36] : [Step 4/5] [2021-11-19 21:03:36,768][INFO ][main][root] [GridStringLogger echo] Stopped cache [cacheName=TestCache1] [21:03:36] : [Step 4/5] [2021-11-19 21:03:36,768][INFO ][disco-event-worker-#5235%internal.GridNodeMetricsLogPdsSelfTest1%][root] [GridStringLogger echo] Topology snapshot [ver=3, locNode=26a828be, servers=1, clients=0, state=ACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=26a828be-527b-42db-a842-bea7dc000001, consistentId=ac5bdf96-4851-4c10-a439-6cfce448cd9e, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:03:36] : [Step 4/5] [2021-11-19 21:03:36,772][INFO ][main][root] [GridStringLogger echo] Stopped cache [cacheName=TestCache2] [21:03:36] : [Step 4/5] [2021-11-19 21:03:36,772][INFO ][disco-event-worker-#5235%internal.GridNodeMetricsLogPdsSelfTest1%][root] [GridStringLogger echo] Coordinator changed [prev=TcpDiscoveryNode [id=5a320cff-6ba1-49d0-81a3-7e0c09e00000, consistentId=2fadaaf7-63e4-4de5-9a38-471957431855, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345000336, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], cur=TcpDiscoveryNode [id=26a828be-527b-42db-a842-bea7dc000001, consistentId=ac5bdf96-4851-4c10-a439-6cfce448cd9e, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637345016761, loc=true, ver=2.13.0#20211119-sha1:00000000, isClient=false]] [21:03:36] : [Step 4/5] [2021-11-19 21:03:36,774][INFO ][disco-event-worker-#5235%internal.GridNodeMetricsLogPdsSelfTest1%][root] [GridStringLogger echo] ^-- Baseline [id=0, size=2, online=1, offline=1] [21:03:36] : [Step 4/5] [2021-11-19 21:03:36,775][INFO ][disco-event-worker-#5235%internal.GridNodeMetricsLogPdsSelfTest1%][root] [GridStringLogger echo] Assigned mvcc coordinator [crd=MvccCoordinator [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], nodeId=26a828be-527b-42db-a842-bea7dc000001, ver=1637344998311, local=true, initialized=false]] [21:03:36] : [Step 4/5] [2021-11-19 21:03:36,775][INFO ][grid-nio-worker-tcp-comm-0-#5170%TcpCommunicationSpi%][root] [GridStringLogger echo] Failed to shutdown socket [21:03:36] : [Step 4/5] [2021-11-19 21:03:36,776][INFO ][grid-nio-worker-tcp-comm-0-#5170%TcpCommunicationSpi%][root] [GridStringLogger echo] java.nio.channels.ClosedChannelException [21:03:36] : [Step 4/5] at sun.nio.ch.SocketChannelImpl.shutdownOutput(SocketChannelImpl.java:795) [21:03:36] : [Step 4/5] at sun.nio.ch.SocketAdaptor.shutdownOutput(SocketAdaptor.java:407) [21:03:36] : [Step 4/5] at org.apache.ignite.internal.util.IgniteUtils.close(IgniteUtils.java:4247) [21:03:36] : [Step 4/5] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.closeKey(GridNioServer.java:2784) [21:03:36] : [Step 4/5] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.close(GridNioServer.java:2835) [21:03:36] : [Step 4/5] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.close(GridNioServer.java:2794) [21:03:36] : [Step 4/5] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.bodyInternal(GridNioServer.java:2157) [21:03:36] : [Step 4/5] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.body(GridNioServer.java:1910) [21:03:36] : [Step 4/5] at org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:125) [21:03:36] : [Step 4/5] at java.lang.Thread.run(Thread.java:748) [21:03:36] : [Step 4/5] [21:03:36] : [Step 4/5] [2021-11-19 21:03:36,778][INFO ][exchange-worker-#5236%internal.GridNodeMetricsLogPdsSelfTest1%][root] [GridStringLogger echo] Started exchange init [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], crd=true, evt=NODE_LEFT, evtNode=5a320cff-6ba1-49d0-81a3-7e0c09e00000, customEvt=null, allowMerge=false, exchangeFreeSwitch=true] [21:03:36] : [Step 4/5] [2021-11-19 21:03:36,778][INFO ][sys-#5226%internal.GridNodeMetricsLogPdsSelfTest1%][root] [GridStringLogger echo] Become new coordinator 26a828be-527b-42db-a842-bea7dc000001 [21:03:36] : [Step 4/5] [2021-11-19 21:03:36,781][INFO ][exchange-worker-#5236%internal.GridNodeMetricsLogPdsSelfTest1%][root] [GridStringLogger echo] Local node affinity assignment distribution is not ideal [cache=TestCache1, expectedPrimary=1024.00, actualPrimary=510, expectedBackups=0.00, actualBackups=0, warningThreshold=50.00%] [21:03:36] : [Step 4/5] [2021-11-19 21:03:36,781][INFO ][sys-#5226%internal.GridNodeMetricsLogPdsSelfTest1%][root] [GridStringLogger echo] Local node affinity assignment distribution is not ideal [cache=TestCache2, expectedPrimary=1024.00, actualPrimary=510, expectedBackups=0.00, actualBackups=0, warningThreshold=50.00%] [21:03:36] : [Step 4/5] [2021-11-19 21:03:36,782][INFO ][exchange-worker-#5236%internal.GridNodeMetricsLogPdsSelfTest1%][root] [GridStringLogger echo] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:03:36] : [Step 4/5] [2021-11-19 21:03:36,790][INFO ][main][root] [GridStringLogger echo] Cleanup cache stores [total=4, left=0, cleanFiles=false] [21:03:36] : [Step 4/5] [2021-11-19 21:03:36,799][INFO ][main][root] [GridStringLogger echo] Removed undeployed class: GridDeployment [ts=1637345000499, depMode=SHARED, clsLdr=IsolatedClassLoader{roleName='test'}, clsLdrId=a421d593d71-5a320cff-6ba1-49d0-81a3-7e0c09e00000, userVer=0, loc=true, sampleClsName=org.apache.ignite.internal.processors.cache.distributed.dht.preloader.GridDhtPartitionMap, pendingUndeploy=false, undeployed=true, usage=0] [21:03:36] : [Step 4/5] [2021-11-19 21:03:36,801][INFO ][exchange-worker-#5236%internal.GridNodeMetricsLogPdsSelfTest1%][root] [GridStringLogger echo] Finish exchange future [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], err=null, rebalanced=true, wasRebalanced=true] [21:03:36] : [Step 4/5] [2021-11-19 21:03:36,978][INFO ][main][root] [GridStringLogger echo] [21:03:36] : [Step 4/5] [21:03:36] : [Step 4/5] >>> +------------------------------------------------------+ [21:03:36] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV stopped OK [21:03:36] : [Step 4/5] >>> +------------------------------------------------------+ [21:03:36] : [Step 4/5] >>> Ignite instance name: internal.GridNodeMetricsLogPdsSelfTest0 [21:03:36] : [Step 4/5] >>> Grid uptime: 00:00:18.649 [21:03:36] : [Step 4/5] [21:03:36] : [Step 4/5] [21:03:36] : [Step 4/5] [2021-11-19 21:03:36,979][INFO ][sys-#5221%internal.GridNodeMetricsLogPdsSelfTest1%][root] [GridStringLogger echo] Detected lost partitions [grp=TestCache1, parts=[0, 3-4, 6, 10, 13, 16-17, 21, 24, 26, 28, 30, 33-34, 38, 45, 47-49, 51-52, 57, 59, 61-62, 65, 70, 75-79, 82, 85-86, 91-92, 95-96, 98, 103, 107-109, 111, 116, 121-122, 125-127, 129, 132-133, 135-136, 138, 140, 142, 144-145, 150, 153, 156, 159, 161-162, 165-167, 170-171, 175-176, 178-180, 182, 186-187, 189, 191-193, 195-198, 200, 210-212, 215, 217-218, 221-222, 224-226, 228-229, 234-235, 238-239, 241, 243-246, 248, 250, 253-254, 257-259, 261, 263-264, 271, 274-275, 278-279, 282-283, 285, 287, 289, 291, 294-296, 306-309, 312-314, 316-321, 324, 327, 333-336, 340, 342, 344, 351, 353, 355, 357, 360, 362-365, 368, 372-373, 377-378, 382-384, 386, 389, 392-393, 396-399, 403, 408-409, 411-412, 419, 423-424, 427, 430, 432-433, 436-438, 440-441, 443-444, 447, 449-452, 454-455, 458-462, 465, 468, 470, 472-474, 477-478, 482-483, 485-487, 491-494, 496, 498, 500, 502-503, 507-509, 512-513, 516, 520-526, 529-531, 538-539, 541, 543, 545-546, 549, 552-554, 556, 558-560, 562, 564-565, 567-569, 571-572, 574-575, 579-580, 582-583, 585, 587-589, 593-594, 597, 600, 604, 608-609, 611-615, 618-620, 622, 624, 627-629, 632-634, 636-641, 644-646, 649-651, 653, 655-656, 658, 660-662, 665, 670, 672-673, 675, 679-680, 682, 685-687, 692, 695, 697-699, 701, 703, 705-706, 709, 711-715, 721, 724-727, 729, 731-732, 736-740, 742, 745, 749, 751, 753-754, 756, 760, 762, 765, 767, 769, 771-774, 776, 778, 783-786, 788, 790, 793, 795-800, 802, 804-805, 807, 809, 816-817, 819, 822-825, 829-830, 832-833, 835-836, 838, 840, 842-844, 850-852, 854, 856-857, 860, 863-864, 868-872, 874-877, 884-886, 890-891, 895-896, 899, 901-902, 906-908, 911-912, 919, 921-923, 926-928, 932, 934, 937, 939-945, 949-950, 952, 954, 958-962, 966-969, 971, 973-975, 977, 979-983, 985-987, 991, 994-997, 999-1004, 1010-1013, 1015, 1019-1021], topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0]] [21:03:36] : [Step 4/5] [2021-11-19 21:03:36,979][INFO ][main][root] >>> Stopping grid [name=internal.GridNodeMetricsLogPdsSelfTest1, id=26a828be-527b-42db-a842-bea7dc000001] [21:03:36] : [Step 4/5] [2021-11-19 21:03:36,983][INFO ][exchange-worker-#5236%internal.GridNodeMetricsLogPdsSelfTest1%][root] [GridStringLogger echo] Detected lost partitions [grp=TestCache2, parts=[0, 3-4, 6, 10, 13, 16-17, 21, 24, 26, 28, 30, 33-34, 38, 45, 47-49, 51-52, 57, 59, 61-62, 65, 70, 75-79, 82, 85-86, 91-92, 95-96, 98, 103, 107-109, 111, 116, 121-122, 125-127, 129, 132-133, 135-136, 138, 140, 142, 144-145, 150, 153, 156, 159, 161-162, 165-167, 170-171, 175-176, 178-180, 182, 186-187, 189, 191-193, 195-198, 200, 210-212, 215, 217-218, 221-222, 224-226, 228-229, 234-235, 238-239, 241, 243-246, 248, 250, 253-254, 257-259, 261, 263-264, 271, 274-275, 278-279, 282-283, 285, 287, 289, 291, 294-296, 306-309, 312-314, 316-321, 324, 327, 333-336, 340, 342, 344, 351, 353, 355, 357, 360, 362-365, 368, 372-373, 377-378, 382-384, 386, 389, 392-393, 396-399, 403, 408-409, 411-412, 419, 423-424, 427, 430, 432-433, 436-438, 440-441, 443-444, 447, 449-452, 454-455, 458-462, 465, 468, 470, 472-474, 477-478, 482-483, 485-487, 491-494, 496, 498, 500, 502-503, 507-509, 512-513, 516, 520-526, 529-531, 538-539, 541, 543, 545-546, 549, 552-554, 556, 558-560, 562, 564-565, 567-569, 571-572, 574-575, 579-580, 582-583, 585, 587-589, 593-594, 597, 600, 604, 608-609, 611-615, 618-620, 622, 624, 627-629, 632-634, 636-641, 644-646, 649-651, 653, 655-656, 658, 660-662, 665, 670, 672-673, 675, 679-680, 682, 685-687, 692, 695, 697-699, 701, 703, 705-706, 709, 711-715, 721, 724-727, 729, 731-732, 736-740, 742, 745, 749, 751, 753-754, 756, 760, 762, 765, 767, 769, 771-774, 776, 778, 783-786, 788, 790, 793, 795-800, 802, 804-805, 807, 809, 816-817, 819, 822-825, 829-830, 832-833, 835-836, 838, 840, 842-844, 850-852, 854, 856-857, 860, 863-864, 868-872, 874-877, 884-886, 890-891, 895-896, 899, 901-902, 906-908, 911-912, 919, 921-923, 926-928, 932, 934, 937, 939-945, 949-950, 952, 954, 958-962, 966-969, 971, 973-975, 977, 979-983, 985-987, 991, 994-997, 999-1004, 1010-1013, 1015, 1019-1021], topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0]] [21:03:36] : [Step 4/5] [2021-11-19 21:03:36,989][INFO ][exchange-worker-#5236%internal.GridNodeMetricsLogPdsSelfTest1%][root] [GridStringLogger echo] Completed partition exchange [localNode=26a828be-527b-42db-a842-bea7dc000001, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], evt=NODE_LEFT, evtNode=TcpDiscoveryNode [id=5a320cff-6ba1-49d0-81a3-7e0c09e00000, consistentId=2fadaaf7-63e4-4de5-9a38-471957431855, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345000336, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0]] [21:03:36] : [Step 4/5] [2021-11-19 21:03:36,991][INFO ][exchange-worker-#5236%internal.GridNodeMetricsLogPdsSelfTest1%][root] [GridStringLogger echo] Exchange timings [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (0 ms), stage="Determine exchange type" (3 ms), stage="Preloading notification" (0 ms), stage="After states restored callback" (0 ms), stage="WAL history reservation" (1 ms), stage="Finalize update counters" (1 ms), stage="Detect lost partitions" (201 ms), stage="Exchange done" (3 ms), stage="Total time" (209 ms)] [21:03:36] : [Step 4/5] [2021-11-19 21:03:36,992][INFO ][exchange-worker-#5236%internal.GridNodeMetricsLogPdsSelfTest1%][root] [GridStringLogger echo] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], stage="Affinity initialization (exchange-free switch on fully-rebalanced topology) [grp=TestCache2]" (3 ms) (parent=Determine exchange type), stage="Affinity initialization (exchange-free switch on fully-rebalanced topology) [grp=TestCache1]" (2 ms) (parent=Determine exchange type), stage="Affinity initialization (exchange-free switch on fully-rebalanced topology) [grp=ignite-sys-cache]" (1 ms) (parent=Determine exchange type)] [21:03:36] : [Step 4/5] [2021-11-19 21:03:36,994][INFO ][exchange-worker-#5236%internal.GridNodeMetricsLogPdsSelfTest1%][root] [GridStringLogger echo] Finished exchange init [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], crd=true] [21:03:37] : [Step 4/5] [2021-11-19 21:03:36,998][INFO ][exchange-worker-#5236%internal.GridNodeMetricsLogPdsSelfTest1%][root] [GridStringLogger echo] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=3, minorTopVer=0], force=false, evt=NODE_LEFT, node=5a320cff-6ba1-49d0-81a3-7e0c09e00000] [21:03:37] : [Step 4/5] [2021-11-19 21:03:37,028][INFO ][db-checkpoint-thread-#5248%internal.GridNodeMetricsLogPdsSelfTest1%][root] [GridStringLogger echo] Checkpoint started [checkpointId=d65dd2ca-a3a3-4f11-8acc-e830261f38bb, startPtr=WALPointer [idx=0, fileOff=141747, len=11643], checkpointBeforeLockTime=3ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=1ms, checkpointLockHoldTime=3ms, walCpRecordFsyncDuration=0ms, writeCheckpointEntryDuration=2ms, splitAndSortCpPagesDuration=0ms, pages=15, reason='timeout'] [21:03:37] : [Step 4/5] [2021-11-19 21:03:37,034][INFO ][tcp-disco-sock-reader-[5a320cff 127.0.0.1:37927]-#259%internal.GridNodeMetricsLogPdsSelfTest1%-#5232%internal.GridNodeMetricsLogPdsSelfTest1%][root] [GridStringLogger echo] Failed to shutdown socket [21:03:37] : [Step 4/5] [2021-11-19 21:03:37,035][INFO ][tcp-disco-sock-reader-[5a320cff 127.0.0.1:37927]-#259%internal.GridNodeMetricsLogPdsSelfTest1%-#5232%internal.GridNodeMetricsLogPdsSelfTest1%][root] [GridStringLogger echo] java.net.SocketException: Socket is closed [21:03:37] : [Step 4/5] at java.net.Socket.shutdownOutput(Socket.java:1568) [21:03:37] : [Step 4/5] at org.apache.ignite.internal.util.IgniteUtils.close(IgniteUtils.java:4247) [21:03:37] : [Step 4/5] at org.apache.ignite.spi.discovery.tcp.ServerImpl$SocketReader.body(ServerImpl.java:7370) [21:03:37] : [Step 4/5] at org.apache.ignite.spi.IgniteSpiThread.run(IgniteSpiThread.java:58) [21:03:37] : [Step 4/5] [21:03:37] : [Step 4/5] [2021-11-19 21:03:37,035][INFO ][tcp-disco-sock-reader-[5a320cff 127.0.0.1:37927]-#259%internal.GridNodeMetricsLogPdsSelfTest1%-#5232%internal.GridNodeMetricsLogPdsSelfTest1%][root] [GridStringLogger echo] Finished serving remote node connection [rmtAddr=/127.0.0.1:37927, rmtPort=37927, rmtNodeId=5a320cff-6ba1-49d0-81a3-7e0c09e00000] [21:03:37] : [Step 4/5] [2021-11-19 21:03:37,037][INFO ][main][root] [GridStringLogger echo] Stopped cache [cacheName=ignite-sys-cache] [21:03:37] : [Step 4/5] [2021-11-19 21:03:37,038][INFO ][main][root] [GridStringLogger echo] Stopped cache [cacheName=TestCache1] [21:03:37] : [Step 4/5] [2021-11-19 21:03:37,039][INFO ][main][root] [GridStringLogger echo] Stopped cache [cacheName=TestCache2] [21:03:37] : [Step 4/5] [2021-11-19 21:03:37,059][INFO ][main][root] [GridStringLogger echo] Cleanup cache stores [total=4, left=0, cleanFiles=false] [21:03:37] : [Step 4/5] [2021-11-19 21:03:37,061][INFO ][main][root] [GridStringLogger echo] Removed undeployed class: GridDeployment [ts=1637345000509, depMode=SHARED, clsLdr=IsolatedClassLoader{roleName='test'}, clsLdrId=c421d593d71-26a828be-527b-42db-a842-bea7dc000001, userVer=0, loc=true, sampleClsName=org.apache.ignite.internal.processors.cache.distributed.dht.preloader.GridDhtPartitionFullMap, pendingUndeploy=false, undeployed=true, usage=0] [21:03:37] : [Step 4/5] [2021-11-19 21:03:37,111][INFO ][main][root] [GridStringLogger echo] [21:03:37] : [Step 4/5] [21:03:37] : [Step 4/5] >>> +------------------------------------------------------+ [21:03:37] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV stopped OK [21:03:37] : [Step 4/5] >>> +------------------------------------------------------+ [21:03:37] : [Step 4/5] >>> Ignite instance name: internal.GridNodeMetricsLogPdsSelfTest1 [21:03:37] : [Step 4/5] >>> Grid uptime: 00:00:16.700 [21:03:37] : [Step 4/5] [21:03:37] : [Step 4/5] [21:03:37] : [Step 4/5] [21:03:37] >>> Stopping test class: GridNodeMetricsLogPdsSelfTest <<< [21:03:37] : [Step 4/5] [2021-11-19 21:03:37,420][INFO ][main][root] >>> Stopping test class: GridNodeMetricsLogPdsSelfTest <<< [21:03:37] : [Step 4/5] [21:03:37] >>> Starting test class: EncryptedCacheBigEntryTest <<< [21:03:37] : [Step 4/5] [2021-11-19 21:03:37,421][INFO ][main][root] >>> Starting test class: EncryptedCacheBigEntryTest <<< [21:03:37] : [Step 4/5] Running org.apache.ignite.internal.encryption.EncryptedCacheBigEntryTest [21:03:37]i: [Step 4/5] ##teamcity[importData type='surefire' path='/opt/buildagent/temp/buildTmp/ignite-tools-junit-reports1777670380320881607/test-org.apache.ignite.testsuites.IgniteBasicWithPersistenceTestSuite1637344997385.xml'] [21:03:37] : [Step 4/5] Importing data from '/opt/buildagent/temp/buildTmp/ignite-tools-junit-reports1777670380320881607/test-org.apache.ignite.testsuites.IgniteBasicWithPersistenceTestSuite1637344997385.xml' (256 B) with 'surefire' processor [21:03:37] : [Step 4/5] [21:03:37] >>> Starting test: EncryptedCacheBigEntryTest#testCreateEncryptedCacheWithBigEntry <<< [21:03:37] : [Step 4/5] [2021-11-19 21:03:37,433][INFO ][main][root] >>> Starting test: EncryptedCacheBigEntryTest#testCreateEncryptedCacheWithBigEntry <<< [21:03:37] : [Step 4/5] [21:03:37] >>> Heap: 218 MB used / 1916 MB commited / 1916 MB max <<< [21:03:37] : [Step 4/5] [2021-11-19 21:03:37,433][INFO ][main][root] >>> Heap: 218 MB used / 1916 MB commited / 1916 MB max <<< [21:03:37] : [Step 4/5] [21:03:37] >>> Non-Heap: 125 MB used / 135 MB commited / 0 MB max <<< [21:03:37] : [Step 4/5] [2021-11-19 21:03:37,434][INFO ][main][root] >>> Non-Heap: 125 MB used / 135 MB commited / 0 MB max <<< [21:03:37]W: [org.apache.ignite:ignite-core] [2021-11-19 21:03:37,454][WARN ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][G] Ignite work directory is not provided, automatically resolved to: /opt/buildagent/work/7bc1c54bc719b67c/work [21:03:37] : [Step 4/5] [2021-11-19 21:03:37,456][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][IgniteKernal%grid-0] [21:03:37] : [Step 4/5] [21:03:37] : [Step 4/5] >>> __________ ________________ [21:03:37] : [Step 4/5] >>> / _/ ___/ |/ / _/_ __/ __/ [21:03:37] : [Step 4/5] >>> _/ // (7 7 // / / / / _/ [21:03:37] : [Step 4/5] >>> /___/\___/_/|_/___/ /_/ /___/ [21:03:37] : [Step 4/5] >>> [21:03:37] : [Step 4/5] >>> ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:03:37] : [Step 4/5] >>> 2021 Copyright(C) Apache Software Foundation [21:03:37] : [Step 4/5] >>> [21:03:37] : [Step 4/5] >>> Ignite documentation: http://ignite.apache.org [21:03:37] : [Step 4/5] [21:03:37] : [Step 4/5] [2021-11-19 21:03:37,458][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][IgniteKernal%grid-0] Config URL: n/a [21:03:37] : [Step 4/5] [2021-11-19 21:03:37,458][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][IgniteKernal%grid-0] IgniteConfiguration [igniteInstanceName=grid-0, pubPoolSize=24, svcPoolSize=24, callbackPoolSize=24, stripedPoolSize=24, sysPoolSize=24, mgmtPoolSize=4, dataStreamerPoolSize=24, utilityCachePoolSize=24, utilityCacheKeepAliveTime=60000, p2pPoolSize=2, qryPoolSize=24, buildIdxPoolSize=4, igniteHome=/opt/buildagent/work/7bc1c54bc719b67c, igniteWorkDir=/opt/buildagent/work/7bc1c54bc719b67c/work, mbeanSrv=com.sun.jmx.mbeanserver.JmxMBeanServer@6fe85038, nodeId=000ecd75-0e73-41b1-ac22-55619cd1c000, marsh=BinaryMarshaller [], marshLocJobs=false, daemon=false, p2pEnabled=true, netTimeout=10000, netCompressionLevel=1, sndRetryDelay=1000, sndRetryCnt=3, metricsHistSize=10000, metricsUpdateFreq=1000, metricsExpTime=9223372036854775807, discoSpi=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=0, ackTimeout=0, marsh=null, reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], segPlc=STOP, segResolveAttempts=2, waitForSegOnStart=true, allResolversPassReq=true, segChkFreq=10000, commSpi=TcpCommunicationSpi [connectGate=org.apache.ignite.spi.communication.tcp.internal.ConnectGateway@60da8534, ctxInitLatch=java.util.concurrent.CountDownLatch@2fcb2779[Count = 1], stopping=false, clientPool=null, nioSrvWrapper=null, stateProvider=null], evtSpi=MemoryEventStorageSpi [expireAgeMs=9223372036854775807, expireCnt=10000, filter=null], colSpi=NoopCollisionSpi [], deploySpi=LocalDeploymentSpi [], indexingSpi=org.apache.ignite.spi.indexing.noop.NoopIndexingSpi@76d76182, addrRslvr=null, encryptionSpi=org.apache.ignite.spi.encryption.keystore.KeystoreEncryptionSpi@41b44a5, tracingSpi=org.apache.ignite.spi.tracing.NoopTracingSpi@5f8f0fd, clientMode=false, rebalanceThreadPoolSize=4, rebalanceTimeout=10000, rebalanceBatchesPrefetchCnt=3, rebalanceThrottle=0, rebalanceBatchSize=524288, txCfg=TransactionConfiguration [txSerEnabled=false, dfltIsolation=REPEATABLE_READ, dfltConcurrency=PESSIMISTIC, dfltTxTimeout=0, txTimeoutOnPartitionMapExchange=0, deadlockTimeout=10000, pessimisticTxLogSize=0, pessimisticTxLogLinger=10000, tmLookupClsName=null, txManagerFactory=null, useJtaSync=false], cacheSanityCheckEnabled=true, discoStartupDelay=60000, deployMode=SHARED, p2pMissedCacheSize=100, locHost=127.0.0.1, timeSrvPortBase=31100, timeSrvPortRange=100, failureDetectionTimeout=10000, sysWorkerBlockedTimeout=null, clientFailureDetectionTimeout=10000, metricsLogFreq=0, connectorCfg=null, odbcCfg=null, warmupClos=null, atomicCfg=AtomicConfiguration [seqReserveSize=1000, cacheMode=PARTITIONED, backups=1, aff=null, grpName=null], classLdr=null, sslCtxFactory=null, platformCfg=null, binaryCfg=null, memCfg=null, pstCfg=null, dsCfg=DataStorageConfiguration [sysRegionInitSize=41943040, sysRegionMaxSize=104857600, pageSize=4096, concLvl=0, dfltDataRegConf=DataRegionConfiguration [name=default, maxSize=10485760, initSize=268435456, swapPath=null, pageEvictionMode=DISABLED, pageReplacementMode=CLOCK, evictionThreshold=0.9, emptyPagesPoolSize=100, metricsEnabled=false, metricsSubIntervalCount=5, metricsRateTimeInterval=60000, persistenceEnabled=true, checkpointPageBufSize=0, lazyMemoryAllocation=true, warmUpCfg=null], dataRegions=null, storagePath=null, checkpointFreq=180000, lockWaitTime=10000, checkpointThreads=4, checkpointWriteOrder=SEQUENTIAL, walHistSize=20, maxWalArchiveSize=1073741824, walSegments=10, walSegmentSize=67108864, walPath=db/wal, walArchivePath=db/wal/archive, cdcWalPath=db/wal/cdc, cdcEnabled=false, metricsEnabled=false, walMode=FSYNC, walTlbSize=131072, walBuffSize=0, walFlushFreq=2000, walFsyncDelay=1000, walRecordIterBuffSize=67108864, alwaysWriteFullPages=false, fileIOFactory=org.apache.ignite.internal.processors.cache.persistence.file.AsyncFileIOFactory@e989177, metricsSubIntervalCnt=5, metricsRateTimeInterval=60000, walAutoArchiveAfterInactivity=-1, walForceArchiveTimeout=-1, writeThrottlingEnabled=false, walCompactionEnabled=false, walCompactionLevel=1, checkpointReadLockTimeout=null, walPageCompression=DISABLED, walPageCompressionLevel=null, dfltWarmUpCfg=null, encCfg=org.apache.ignite.configuration.EncryptionConfiguration@2c304b, defragmentationThreadPoolSize=4, minWalArchiveSize=-1], snapshotPath=snapshots, activeOnStart=true, activeOnStartPropSetFlag=false, autoActivation=true, autoActivationPropSetFlag=false, clusterStateOnStart=null, sqlConnCfg=null, cliConnCfg=ClientConnectorConfiguration [host=null, port=10800, portRange=100, sockSndBufSize=0, sockRcvBufSize=0, tcpNoDelay=true, maxOpenCursorsPerConn=128, threadPoolSize=24, selectorCnt=12, idleTimeout=0, handshakeTimeout=10000, jdbcEnabled=true, odbcEnabled=true, thinCliEnabled=true, sslEnabled=false, useIgniteSslCtxFactory=true, sslClientAuth=false, sslCtxFactory=null, thinCliCfg=ThinClientConfiguration [maxActiveTxPerConn=100, maxActiveComputeTasksPerConn=0]], mvccVacuumThreadCnt=2, mvccVacuumFreq=5000, authEnabled=false, failureHnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]], commFailureRslvr=null, sqlCfg=SqlConfiguration [longQryWarnTimeout=3000, dfltQryTimeout=0, sqlQryHistSize=1000, validationEnabled=false], asyncContinuationExecutor=null] [21:03:37] : [Step 4/5] [2021-11-19 21:03:37,465][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][IgniteKernal%grid-0] Daemon mode: off [21:03:37] : [Step 4/5] [2021-11-19 21:03:37,465][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][IgniteKernal%grid-0] OS: Linux 4.15.0-151-generic amd64 [21:03:37] : [Step 4/5] [2021-11-19 21:03:37,466][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][IgniteKernal%grid-0] OS user: teamcity [21:03:37] : [Step 4/5] [2021-11-19 21:03:37,466][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][IgniteKernal%grid-0] PID: 16724 [21:03:37] : [Step 4/5] [2021-11-19 21:03:37,466][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][IgniteKernal%grid-0] Language runtime: Java Platform API Specification ver. 1.8 [21:03:37] : [Step 4/5] [2021-11-19 21:03:37,466][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][IgniteKernal%grid-0] VM information: Java(TM) SE Runtime Environment 1.8.0_261-b12 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 25.261-b12 [21:03:37] : [Step 4/5] [2021-11-19 21:03:37,467][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][IgniteKernal%grid-0] VM total memory: 1.9GB [21:03:37] : [Step 4/5] [2021-11-19 21:03:37,467][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][IgniteKernal%grid-0] Remote Management [restart: off, REST: off, JMX (remote: off)] [21:03:37] : [Step 4/5] [2021-11-19 21:03:37,467][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][IgniteKernal%grid-0] Logger: GridTestLog4jLogger [quiet=false, config=null] [21:03:37] : [Step 4/5] [2021-11-19 21:03:37,467][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][IgniteKernal%grid-0] IGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c [21:03:37] : [Step 4/5] [2021-11-19 21:03:37,468][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][IgniteKernal%grid-0] VM arguments: [-DIGNITE_DUMP_THREADS_ON_FAILURE=false, -DMono=/usr/bin/mono-sgen, -DMono4.0_x64=/usr/lib/mono/4.0, -DMono4.5_x64=/usr/lib/mono/4.5, -DMonoVersion=6.12.0.90, -DSKIP_BUILD=false, -Dagent.home.dir=/opt/buildagent, -Dagent.name=aitc-lin02_03, -Dagent.ownPort=9090, -Dagent.work.dir=/opt/buildagent/work, -Dbuild.number=95, -Dbuild.vcs.number=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.1=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.GitHubApacheIgnite=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dclassworlds.conf=/opt/buildagent/temp/buildTmp/teamcity.m2.conf, -Dcom.jetbrains.maven.watcher.report.file=/opt/buildagent/temp/buildTmp/maven-build-info.xml, -Djava.io.tmpdir=/opt/buildagent/temp/buildTmp, -Dmaven.home=/opt/buildagent/tools/maven3_6, -Dmaven.multiModuleProjectDirectory=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.agent.cpuBenchmark=457, -Dteamcity.agent.dotnet.agent_url=http://localhost:9090/RPC2, -Dteamcity.agent.dotnet.build_id=6278078, -Dteamcity.auth.password=*******, -Dteamcity.auth.userId=TeamCityBuildId=6278078, -Dteamcity.build.changedFiles.file=/opt/buildagent/temp/buildTmp/changedFiles6342607772318147725.txt, -Dteamcity.build.checkoutDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.build.id=6278078, -Dteamcity.build.properties.file=/opt/buildagent/temp/buildTmp/teamcity.build5164517880467851002.properties, -Dteamcity.build.tempDir=/opt/buildagent/temp/buildTmp, -Dteamcity.build.workingDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.buildConfName=Basic 3, -Dteamcity.buildType.id=IgniteTests24Java8_Basic3, -Dteamcity.configuration.properties.file=/opt/buildagent/temp/buildTmp/teamcity.config5591980786735343870.properties, -Dteamcity.maven.userSettings.path=/opt/buildagent/temp/buildTmp/maven_settings_585072866407032347.xml, -Dteamcity.maven.watcher.home=/opt/buildagent/plugins/mavenPlugin/maven-watcher-jdk16, -Dteamcity.projectName=Ignite Tests 2.x (JDK 8/11), -Dteamcity.runner.properties.file=/opt/buildagent/temp/buildTmp/teamcity.runner9098465561618137420.properties, -Dteamcity.tests.recentlyFailedTests.file=/opt/buildagent/temp/buildTmp/testsToRunFirst3891775683130404069.txt, -Dteamcity.version=2021.2 (build 99542), -ea, -Xms2g, -Xmx2g, -XX:+HeapDumpOnOutOfMemoryError, -DIGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_TEST_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_UPDATE_NOTIFIER=false, -DIGNITE_NO_DISCO_ORDER=true, -DIGNITE_PERFORMANCE_SUGGESTIONS_DISABLED=true, -Djava.net.preferIPv4Stack=true, -DTEST_SCALE_FACTOR=1.0, -DIGNITE_TEST_PROP_LOG4J_FILE=log4j-tc-test.xml, -DIGNITE_QUIET=false, -DIGNITE_MARSHAL_BUFFERS_RECHECK=1000, -Dmaven.repo.local=/opt/buildagent/.m2/repository] [21:03:37] : [Step 4/5] [2021-11-19 21:03:37,471][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][IgniteKernal%grid-0] System cache's DataRegion size is configured to 40 MB. Use DataStorageConfiguration.systemRegionInitialSize property to change the setting. [21:03:37] : [Step 4/5] [2021-11-19 21:03:37,472][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][IgniteKernal%grid-0] Configured caches [in 'sysMemPlc' dataRegion: ['ignite-sys-cache']] [21:03:37]W: [org.apache.ignite:ignite-core] [2021-11-19 21:03:37,472][WARN ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][IgniteKernal%grid-0] Peer class loading is enabled (disable it in production for performance and deployment consistency reasons) [21:03:37] : [Step 4/5] [2021-11-19 21:03:37,472][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][IgniteKernal%grid-0] 3-rd party licenses can be found at: /opt/buildagent/work/7bc1c54bc719b67c/libs/licenses [21:03:37] : [Step 4/5] [2021-11-19 21:03:37,476][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][IgnitePluginProcessor] Configured plugins: [21:03:37] : [Step 4/5] [2021-11-19 21:03:37,476][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][IgnitePluginProcessor] ^-- StanByClusterTestProvider 1.0 [21:03:37] : [Step 4/5] [2021-11-19 21:03:37,477][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][IgnitePluginProcessor] ^-- null [21:03:37] : [Step 4/5] [2021-11-19 21:03:37,477][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][IgnitePluginProcessor] [21:03:37] : [Step 4/5] [2021-11-19 21:03:37,477][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][IgnitePluginProcessor] ^-- PageMemory tracker plugin 1.0 [21:03:37] : [Step 4/5] [2021-11-19 21:03:37,477][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][IgnitePluginProcessor] ^-- null [21:03:37] : [Step 4/5] [2021-11-19 21:03:37,477][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][IgnitePluginProcessor] [21:03:37] : [Step 4/5] [2021-11-19 21:03:37,477][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][IgnitePluginProcessor] ^-- TestDistibutedConfigurationPlugin 1.0 [21:03:37] : [Step 4/5] [2021-11-19 21:03:37,478][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][IgnitePluginProcessor] ^-- null [21:03:37] : [Step 4/5] [2021-11-19 21:03:37,478][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][IgnitePluginProcessor] [21:03:37] : [Step 4/5] [2021-11-19 21:03:37,478][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][IgnitePluginProcessor] ^-- NodeValidationPluginProvider 1.0 [21:03:37] : [Step 4/5] [2021-11-19 21:03:37,478][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][IgnitePluginProcessor] ^-- null [21:03:37] : [Step 4/5] [2021-11-19 21:03:37,478][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][IgnitePluginProcessor] [21:03:37] : [Step 4/5] [2021-11-19 21:03:37,479][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][FailureProcessor] Configured failure handler: [hnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]]] [21:03:37]W: [org.apache.ignite:ignite-core] [2021-11-19 21:03:37,509][WARN ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][TcpCommunicationSpi] Message queue limit is set to 0 which may lead to potential OOMEs when running cache operations in FULL_ASYNC or PRIMARY_SYNC modes due to message queues growth on sender and receiver sides. [21:03:37] : [Step 4/5] [2021-11-19 21:03:37,509][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][TcpCommunicationSpi] Successfully bound communication NIO server to TCP port [port=45110, locHost=/127.0.0.1, selectorsCnt=12, selectorSpins=0, pairedConn=false] [21:03:37] : [Step 4/5] [2021-11-19 21:03:37,513][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][GridCollisionManager] Collision resolution is disabled (all jobs will be activated upon arrival). [21:03:37] : [Step 4/5] [2021-11-19 21:03:37,513][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][IgniteKernal%grid-0] Security status [authentication=off, sandbox=off, tls/ssl=off] [21:03:37] : [Step 4/5] Surefire report watcher [21:03:37] : [Surefire report watcher] Watching paths: [21:03:37] : [Surefire report watcher] /opt/buildagent/temp/buildTmp/ignite-tools-junit-reports1777670380320881607/test-org.apache.ignite.testsuites.IgniteBasicWithPersistenceTestSuite1637344997385.xml [21:03:37]i: [Step 4/5] org.apache.ignite.testsuites.IgniteBasicWithPersistenceTestSuite [21:03:37]i: [org.apache.ignite.testsuites.IgniteBasicWithPersistenceTestSuite] org.apache.ignite.internal.GridNodeMetricsLogPdsSelfTest.testNodeMetricsLog [21:03:37] : [Step 4/5] [2021-11-19 21:03:37,883][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:03:38] : [Step 4/5] [2021-11-19 21:03:38,004][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][MaintenanceProcessor] Resolved store directory for node persistent data: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0 [21:03:38] : [Step 4/5] [2021-11-19 21:03:38,007][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][CacheObjectBinaryProcessorImpl] Resolved directory for serialized binary metadata: /opt/buildagent/work/7bc1c54bc719b67c/work/db/binary_meta/grid_0 [21:03:38] : [Step 4/5] [2021-11-19 21:03:38,017][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0 [21:03:38] : [Step 4/5] [2021-11-19 21:03:38,018][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][FileWriteAheadLogManager] Resolved write ahead log work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0 [21:03:38] : [Step 4/5] [2021-11-19 21:03:38,019][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][FileWriteAheadLogManager] Resolved write ahead log archive directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0 [21:03:38] : [Step 4/5] [2021-11-19 21:03:38,415][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000000.wal [21:03:38]W: [org.apache.ignite:ignite-core] [2021-11-19 21:03:38,422][WARN ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][GridCacheDatabaseSharedManager] DataRegion maxSize=10.5 MB is smaller than defaultInitialSize=268.4 MB, setting initialSize to 10.5 MB [21:03:38] : [Step 4/5] [2021-11-19 21:03:38,429][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][GridCacheDatabaseSharedManager] Configured data regions initialized successfully [total=5] [21:03:38] : [Step 4/5] [2021-11-19 21:03:38,431][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][IgniteSnapshotManager] Resolved snapshot work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/snapshots [21:03:38] : [Step 4/5] [2021-11-19 21:03:38,432][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][IgniteSnapshotManager] Resolved temp directory for snapshot creation: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0/snp [21:03:38] : [Step 4/5] [2021-11-19 21:03:38,435][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][ClientListenerProcessor] Client connector processor has started on TCP port 10800 [21:03:38] : [Step 4/5] [2021-11-19 21:03:38,444][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][IgniteKernal%grid-0] Non-loopback local IPs: 172.17.0.4 [21:03:38] : [Step 4/5] [2021-11-19 21:03:38,444][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][IgniteKernal%grid-0] Enabled local MACs: 0242AC110004 [21:03:38] : [Step 4/5] [2021-11-19 21:03:38,447][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:03:38] : [Step 4/5] [2021-11-19 21:03:38,449][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:03:38] : [Step 4/5] [2021-11-19 21:03:38,450][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:03:38] : [Step 4/5] [2021-11-19 21:03:38,452][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][GridCacheDatabaseSharedManager] Applying lost metastore updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:03:38] : [Step 4/5] [2021-11-19 21:03:38,456][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=0 ms] [21:03:38] : [Step 4/5] [2021-11-19 21:03:38,456][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][GridCacheProcessor] Restoring partition state for local groups. [21:03:38] : [Step 4/5] [2021-11-19 21:03:38,457][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=0, partitionsProcessed=0, time=0ms] [21:03:38] : [Step 4/5] [2021-11-19 21:03:38,457][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][GridEncryptionManager] Encryption keys loaded from metastore. [grps=, masterKeyName=ignite.master.key] [21:03:38] : [Step 4/5] [2021-11-19 21:03:38,463][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][ClusterProcessor] Cluster ID and tag has been read from metastorage: null [21:03:38] : [Step 4/5] [2021-11-19 21:03:38,464][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][IgniteClusterImpl] Shutdown policy was updated [oldVal=null, newVal=null] [21:03:38] : [Step 4/5] [2021-11-19 21:03:38,464][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][GridCacheDatabaseSharedManager] Checkpoint frequency deviation changed [oldVal=null, newVal=null] [21:03:38] : [Step 4/5] [2021-11-19 21:03:38,474][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][FilePageStoreManager] Cleanup cache stores [total=1, left=0, cleanFiles=false] [21:03:38] : [Step 4/5] [2021-11-19 21:03:38,479][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:03:38] : [Step 4/5] [2021-11-19 21:03:38,481][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:03:38] : [Step 4/5] [2021-11-19 21:03:38,482][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:03:38] : [Step 4/5] [2021-11-19 21:03:38,483][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][GridCacheDatabaseSharedManager] Data Regions Started: 5 [21:03:38] : [Step 4/5] [2021-11-19 21:03:38,484][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][GridCacheDatabaseSharedManager] ^-- sysMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:03:38] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:03:38] : [Step 4/5] ^-- default region [type=default, persistence=true, lazyAlloc=true, [21:03:38] : [Step 4/5] ... initCfg=10MB, maxCfg=10MB, usedRam=0MB, freeRam=100%, allocRam=0MB, allocTotal=0MB] [21:03:38] : [Step 4/5] ^-- metastoreMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:03:38] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:03:38] : [Step 4/5] ^-- TxLog region [type=internal, persistence=true, lazyAlloc=false, [21:03:38] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:03:38] : [Step 4/5] ^-- volatileDsMemPlc region [type=user, persistence=false, lazyAlloc=true, [21:03:38] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB] [21:03:38] : [Step 4/5] ^-- Ignite persistence [used=0MB] [21:03:38] : [Step 4/5] [21:03:38] : [Step 4/5] [2021-11-19 21:03:38,486][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][GridCacheDatabaseSharedManager] Starting binary memory restore for: [-2100569601] [21:03:38] : [Step 4/5] [2021-11-19 21:03:38,497][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:03:38] : [Step 4/5] [2021-11-19 21:03:38,497][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:03:38] : [Step 4/5] [2021-11-19 21:03:38,502][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000000.wal, offset=0, ver=2] [21:03:38] : [Step 4/5] [2021-11-19 21:03:38,513][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][GridCacheProcessor] Started cache in recovery mode [name=ignite-sys-cache, id=-2100569601, dataRegionName=sysMemPlc, mode=REPLICATED, atomicity=TRANSACTIONAL, backups=2147483647, mvcc=false] [21:03:38] : [Step 4/5] [2021-11-19 21:03:38,515][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][GridCacheDatabaseSharedManager] Binary recovery performed in 30 ms. [21:03:38] : [Step 4/5] [2021-11-19 21:03:38,515][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:03:38] : [Step 4/5] [2021-11-19 21:03:38,515][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][GridCacheDatabaseSharedManager] Applying lost cache updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:03:38] : [Step 4/5] [2021-11-19 21:03:38,598][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=81 ms] [21:03:38] : [Step 4/5] [2021-11-19 21:03:38,598][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][GridCacheProcessor] Restoring partition state for local groups. [21:03:38] : [Step 4/5] [2021-11-19 21:03:38,607][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=1, partitionsProcessed=100, time=10ms] [21:03:38] : [Step 4/5] [2021-11-19 21:03:38,876][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][TestTcpDiscoverySpi] Successfully bound to TCP port [port=47500, localHost=localhost/127.0.0.1, locNodeId=000ecd75-0e73-41b1-ac22-55619cd1c000] [21:03:38] : [Step 4/5] [2021-11-19 21:03:38,889][INFO ][disco-notifier-worker-#5382%grid-0%][MvccProcessorImpl] Assigned mvcc coordinator [crd=MvccCoordinator [topVer=AffinityTopologyVersion [topVer=1, minorTopVer=0], nodeId=000ecd75-0e73-41b1-ac22-55619cd1c000, ver=1637345018886, local=true, initialized=false]] [21:03:38] : [Step 4/5] [2021-11-19 21:03:38,890][INFO ][sys-#5363%grid-0%][ClusterProcessor] Writing cluster ID and tag to metastorage on ready for write ClusterIdAndTag [id=b9c91f63-9430-4140-a4ff-30fa045d474b, tag=blissful_shaw] [21:03:38] : [Step 4/5] [2021-11-19 21:03:38,895][INFO ][disco-notifier-worker-#5382%grid-0%][ClusterProcessor] blissful_shaw [21:03:38] : [Step 4/5] [2021-11-19 21:03:38,896][INFO ][disco-notifier-worker-#5382%grid-0%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustEnabled' was changed from 'null' to 'false' [21:03:38] : [Step 4/5] [2021-11-19 21:03:38,898][INFO ][disco-notifier-worker-#5382%grid-0%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustTimeout' was changed from 'null' to '300000' [21:03:38] : [Step 4/5] [2021-11-19 21:03:38,898][INFO ][disco-notifier-worker-#5382%grid-0%][IgniteTxManager] Transactions parameter 'longOperationsDumpTimeout' was changed from 'null' to '60000' [21:03:38] : [Step 4/5] [2021-11-19 21:03:38,899][INFO ][disco-notifier-worker-#5382%grid-0%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpThreshold' was changed from 'null' to '0' [21:03:38] : [Step 4/5] [2021-11-19 21:03:38,899][INFO ][disco-notifier-worker-#5382%grid-0%][IgniteTxManager] Transactions parameter 'transactionTimeDumpSamplesCoefficient' was changed from 'null' to '0.0' [21:03:38] : [Step 4/5] [2021-11-19 21:03:38,900][INFO ][disco-notifier-worker-#5382%grid-0%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpSamplesPerSecondLimit' was changed from 'null' to '5' [21:03:38] : [Step 4/5] [2021-11-19 21:03:38,901][INFO ][disco-notifier-worker-#5382%grid-0%][IgniteTxManager] Transactions parameter 'collisionsDumpInterval' was changed from 'null' to '1000' [21:03:38] : [Step 4/5] [2021-11-19 21:03:38,902][INFO ][disco-notifier-worker-#5382%grid-0%][IgniteTxManager] Transactions parameter 'txOwnerDumpRequestsAllowed' was changed from 'null' to 'true' [21:03:38] : [Step 4/5] [2021-11-19 21:03:38,902][INFO ][disco-notifier-worker-#5382%grid-0%][GridCacheDatabaseSharedManager] Historical rebalance WAL threshold changed [property=historical.rebalance.threshold, oldVal=null, newVal=500] [21:03:38] : [Step 4/5] [2021-11-19 21:03:38,921][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][IgniteKernal%grid-0] To start Console Management & Monitoring run ignitevisorcmd.{sh|bat} [21:03:38] : [Step 4/5] [2021-11-19 21:03:38,921][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][IgniteKernal%grid-0] [21:03:38] : [Step 4/5] [21:03:38] : [Step 4/5] >>> +-------------------------------------------+ [21:03:38] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:03:38] : [Step 4/5] >>> +-------------------------------------------+ [21:03:38] : [Step 4/5] >>> OS name: Linux 4.15.0-151-generic amd64 [21:03:38] : [Step 4/5] >>> CPU(s): 24 [21:03:38] : [Step 4/5] >>> Heap: 2.0GB [21:03:38] : [Step 4/5] >>> VM name: 16724@c4dfe9a430b2 [21:03:38] : [Step 4/5] >>> Ignite instance name: grid-0 [21:03:38] : [Step 4/5] >>> Local node [ID=000ECD75-0E73-41B1-AC22-55619CD1C000, order=1, clientMode=false] [21:03:38] : [Step 4/5] >>> Local node addresses: [127.0.0.1] [21:03:38] : [Step 4/5] >>> Local ports: TCP:10800 TCP:45110 TCP:47500 [21:03:38] : [Step 4/5] [21:03:38] : [Step 4/5] [2021-11-19 21:03:38,922][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][IgniteKernal%grid-0] >>> Ignite cluster is in INACTIVE state (limited functionality available). Use control.(sh|bat) script or IgniteCluster.state(ClusterState.ACTIVE) to change the state. [21:03:38] : [Step 4/5] [2021-11-19 21:03:38,923][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][GridDiscoveryManager] Topology snapshot [ver=1, locNode=000ecd75, servers=1, clients=0, state=INACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=000ecd75-0e73-41b1-ac22-55619cd1c000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:03:38] : [Step 4/5] [2021-11-19 21:03:38,923][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][G] Node started : [stage="Configure system pool" (0 ms),stage="Start managers" (550 ms),stage="Configure binary metadata" (3 ms),stage="Start processors" (433 ms),stage="Start 'StanByClusterTestProvider' plugin" (0 ms),stage="Start 'PageMemory tracker plugin' plugin" (0 ms),stage="Start 'TestDistibutedConfigurationPlugin' plugin" (0 ms),stage="Start 'NodeValidationPluginProvider' plugin" (0 ms),stage="Init metastore" (31 ms),stage="Init and start regions" (10 ms),stage="Restore binary memory" (29 ms),stage="Restore logical state" (92 ms),stage="Finish recovery" (266 ms),stage="Join topology" (16 ms),stage="Await transition" (2 ms),stage="Await exchange" (30 ms),stage="Total time" (1462 ms)] [21:03:38] : [Step 4/5] [2021-11-19 21:03:38,925][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][root] Node started with the following configuration [id=000ecd75-0e73-41b1-ac22-55619cd1c000, marshaller=BinaryMarshaller [], discovery=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=5000, ackTimeout=5000, marsh=JdkMarshaller [clsFilter=org.apache.ignite.marshaller.MarshallerUtils$1@6d6b88a8], reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], binaryCfg=null, lateAff=true] [21:03:38]W: [org.apache.ignite:ignite-core] [2021-11-19 21:03:38,930][WARN ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][G] Ignite work directory is not provided, automatically resolved to: /opt/buildagent/work/7bc1c54bc719b67c/work [21:03:38] : [Step 4/5] [2021-11-19 21:03:38,931][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][IgniteKernal%grid-1] [21:03:38] : [Step 4/5] [21:03:38] : [Step 4/5] >>> __________ ________________ [21:03:38] : [Step 4/5] >>> / _/ ___/ |/ / _/_ __/ __/ [21:03:38] : [Step 4/5] >>> _/ // (7 7 // / / / / _/ [21:03:38] : [Step 4/5] >>> /___/\___/_/|_/___/ /_/ /___/ [21:03:38] : [Step 4/5] >>> [21:03:38] : [Step 4/5] >>> ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:03:38] : [Step 4/5] >>> 2021 Copyright(C) Apache Software Foundation [21:03:38] : [Step 4/5] >>> [21:03:38] : [Step 4/5] >>> Ignite documentation: http://ignite.apache.org [21:03:38] : [Step 4/5] [21:03:38] : [Step 4/5] [2021-11-19 21:03:38,931][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][IgniteKernal%grid-1] Config URL: n/a [21:03:38] : [Step 4/5] [2021-11-19 21:03:38,932][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][IgniteKernal%grid-1] IgniteConfiguration [igniteInstanceName=grid-1, pubPoolSize=24, svcPoolSize=24, callbackPoolSize=24, stripedPoolSize=24, sysPoolSize=24, mgmtPoolSize=4, dataStreamerPoolSize=24, utilityCachePoolSize=24, utilityCacheKeepAliveTime=60000, p2pPoolSize=2, qryPoolSize=24, buildIdxPoolSize=4, igniteHome=/opt/buildagent/work/7bc1c54bc719b67c, igniteWorkDir=/opt/buildagent/work/7bc1c54bc719b67c/work, mbeanSrv=com.sun.jmx.mbeanserver.JmxMBeanServer@6fe85038, nodeId=10074c6f-9ade-4088-94a6-968028069001, marsh=BinaryMarshaller [], marshLocJobs=false, daemon=false, p2pEnabled=true, netTimeout=10000, netCompressionLevel=1, sndRetryDelay=1000, sndRetryCnt=3, metricsHistSize=10000, metricsUpdateFreq=1000, metricsExpTime=9223372036854775807, discoSpi=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=0, ackTimeout=0, marsh=null, reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], segPlc=STOP, segResolveAttempts=2, waitForSegOnStart=true, allResolversPassReq=true, segChkFreq=10000, commSpi=TcpCommunicationSpi [connectGate=org.apache.ignite.spi.communication.tcp.internal.ConnectGateway@879acdc, ctxInitLatch=java.util.concurrent.CountDownLatch@604e103e[Count = 1], stopping=false, clientPool=null, nioSrvWrapper=null, stateProvider=null], evtSpi=MemoryEventStorageSpi [expireAgeMs=9223372036854775807, expireCnt=10000, filter=null], colSpi=NoopCollisionSpi [], deploySpi=LocalDeploymentSpi [], indexingSpi=org.apache.ignite.spi.indexing.noop.NoopIndexingSpi@1f35e2cc, addrRslvr=null, encryptionSpi=org.apache.ignite.spi.encryption.keystore.KeystoreEncryptionSpi@7810d83b, tracingSpi=org.apache.ignite.spi.tracing.NoopTracingSpi@365f184e, clientMode=false, rebalanceThreadPoolSize=4, rebalanceTimeout=10000, rebalanceBatchesPrefetchCnt=3, rebalanceThrottle=0, rebalanceBatchSize=524288, txCfg=TransactionConfiguration [txSerEnabled=false, dfltIsolation=REPEATABLE_READ, dfltConcurrency=PESSIMISTIC, dfltTxTimeout=0, txTimeoutOnPartitionMapExchange=0, deadlockTimeout=10000, pessimisticTxLogSize=0, pessimisticTxLogLinger=10000, tmLookupClsName=null, txManagerFactory=null, useJtaSync=false], cacheSanityCheckEnabled=true, discoStartupDelay=60000, deployMode=SHARED, p2pMissedCacheSize=100, locHost=127.0.0.1, timeSrvPortBase=31100, timeSrvPortRange=100, failureDetectionTimeout=10000, sysWorkerBlockedTimeout=null, clientFailureDetectionTimeout=10000, metricsLogFreq=0, connectorCfg=null, odbcCfg=null, warmupClos=null, atomicCfg=AtomicConfiguration [seqReserveSize=1000, cacheMode=PARTITIONED, backups=1, aff=null, grpName=null], classLdr=null, sslCtxFactory=null, platformCfg=null, binaryCfg=null, memCfg=null, pstCfg=null, dsCfg=DataStorageConfiguration [sysRegionInitSize=41943040, sysRegionMaxSize=104857600, pageSize=4096, concLvl=0, dfltDataRegConf=DataRegionConfiguration [name=default, maxSize=10485760, initSize=268435456, swapPath=null, pageEvictionMode=DISABLED, pageReplacementMode=CLOCK, evictionThreshold=0.9, emptyPagesPoolSize=100, metricsEnabled=false, metricsSubIntervalCount=5, metricsRateTimeInterval=60000, persistenceEnabled=true, checkpointPageBufSize=0, lazyMemoryAllocation=true, warmUpCfg=null], dataRegions=null, storagePath=null, checkpointFreq=180000, lockWaitTime=10000, checkpointThreads=4, checkpointWriteOrder=SEQUENTIAL, walHistSize=20, maxWalArchiveSize=1073741824, walSegments=10, walSegmentSize=67108864, walPath=db/wal, walArchivePath=db/wal/archive, cdcWalPath=db/wal/cdc, cdcEnabled=false, metricsEnabled=false, walMode=FSYNC, walTlbSize=131072, walBuffSize=0, walFlushFreq=2000, walFsyncDelay=1000, walRecordIterBuffSize=67108864, alwaysWriteFullPages=false, fileIOFactory=org.apache.ignite.internal.processors.cache.persistence.file.AsyncFileIOFactory@5d9eab75, metricsSubIntervalCnt=5, metricsRateTimeInterval=60000, walAutoArchiveAfterInactivity=-1, walForceArchiveTimeout=-1, writeThrottlingEnabled=false, walCompactionEnabled=false, walCompactionLevel=1, checkpointReadLockTimeout=null, walPageCompression=DISABLED, walPageCompressionLevel=null, dfltWarmUpCfg=null, encCfg=org.apache.ignite.configuration.EncryptionConfiguration@13352d97, defragmentationThreadPoolSize=4, minWalArchiveSize=-1], snapshotPath=snapshots, activeOnStart=true, activeOnStartPropSetFlag=false, autoActivation=true, autoActivationPropSetFlag=false, clusterStateOnStart=null, sqlConnCfg=null, cliConnCfg=ClientConnectorConfiguration [host=null, port=10800, portRange=100, sockSndBufSize=0, sockRcvBufSize=0, tcpNoDelay=true, maxOpenCursorsPerConn=128, threadPoolSize=24, selectorCnt=12, idleTimeout=0, handshakeTimeout=10000, jdbcEnabled=true, odbcEnabled=true, thinCliEnabled=true, sslEnabled=false, useIgniteSslCtxFactory=true, sslClientAuth=false, sslCtxFactory=null, thinCliCfg=ThinClientConfiguration [maxActiveTxPerConn=100, maxActiveComputeTasksPerConn=0]], mvccVacuumThreadCnt=2, mvccVacuumFreq=5000, authEnabled=false, failureHnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]], commFailureRslvr=null, sqlCfg=SqlConfiguration [longQryWarnTimeout=3000, dfltQryTimeout=0, sqlQryHistSize=1000, validationEnabled=false], asyncContinuationExecutor=null] [21:03:38] : [Step 4/5] [2021-11-19 21:03:38,940][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][IgniteKernal%grid-1] Daemon mode: off [21:03:38] : [Step 4/5] [2021-11-19 21:03:38,940][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][IgniteKernal%grid-1] OS: Linux 4.15.0-151-generic amd64 [21:03:38] : [Step 4/5] [2021-11-19 21:03:38,941][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][IgniteKernal%grid-1] OS user: teamcity [21:03:38] : [Step 4/5] [2021-11-19 21:03:38,941][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][IgniteKernal%grid-1] PID: 16724 [21:03:38] : [Step 4/5] [2021-11-19 21:03:38,941][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][IgniteKernal%grid-1] Language runtime: Java Platform API Specification ver. 1.8 [21:03:38] : [Step 4/5] [2021-11-19 21:03:38,941][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][IgniteKernal%grid-1] VM information: Java(TM) SE Runtime Environment 1.8.0_261-b12 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 25.261-b12 [21:03:38] : [Step 4/5] [2021-11-19 21:03:38,942][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][IgniteKernal%grid-1] VM total memory: 1.9GB [21:03:38] : [Step 4/5] [2021-11-19 21:03:38,942][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][IgniteKernal%grid-1] Remote Management [restart: off, REST: off, JMX (remote: off)] [21:03:38] : [Step 4/5] [2021-11-19 21:03:38,942][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][IgniteKernal%grid-1] Logger: GridTestLog4jLogger [quiet=false, config=null] [21:03:38] : [Step 4/5] [2021-11-19 21:03:38,943][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][IgniteKernal%grid-1] IGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c [21:03:38] : [Step 4/5] [2021-11-19 21:03:38,943][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][IgniteKernal%grid-1] VM arguments: [-DIGNITE_DUMP_THREADS_ON_FAILURE=false, -DMono=/usr/bin/mono-sgen, -DMono4.0_x64=/usr/lib/mono/4.0, -DMono4.5_x64=/usr/lib/mono/4.5, -DMonoVersion=6.12.0.90, -DSKIP_BUILD=false, -Dagent.home.dir=/opt/buildagent, -Dagent.name=aitc-lin02_03, -Dagent.ownPort=9090, -Dagent.work.dir=/opt/buildagent/work, -Dbuild.number=95, -Dbuild.vcs.number=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.1=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.GitHubApacheIgnite=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dclassworlds.conf=/opt/buildagent/temp/buildTmp/teamcity.m2.conf, -Dcom.jetbrains.maven.watcher.report.file=/opt/buildagent/temp/buildTmp/maven-build-info.xml, -Djava.io.tmpdir=/opt/buildagent/temp/buildTmp, -Dmaven.home=/opt/buildagent/tools/maven3_6, -Dmaven.multiModuleProjectDirectory=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.agent.cpuBenchmark=457, -Dteamcity.agent.dotnet.agent_url=http://localhost:9090/RPC2, -Dteamcity.agent.dotnet.build_id=6278078, -Dteamcity.auth.password=*******, -Dteamcity.auth.userId=TeamCityBuildId=6278078, -Dteamcity.build.changedFiles.file=/opt/buildagent/temp/buildTmp/changedFiles6342607772318147725.txt, -Dteamcity.build.checkoutDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.build.id=6278078, -Dteamcity.build.properties.file=/opt/buildagent/temp/buildTmp/teamcity.build5164517880467851002.properties, -Dteamcity.build.tempDir=/opt/buildagent/temp/buildTmp, -Dteamcity.build.workingDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.buildConfName=Basic 3, -Dteamcity.buildType.id=IgniteTests24Java8_Basic3, -Dteamcity.configuration.properties.file=/opt/buildagent/temp/buildTmp/teamcity.config5591980786735343870.properties, -Dteamcity.maven.userSettings.path=/opt/buildagent/temp/buildTmp/maven_settings_585072866407032347.xml, -Dteamcity.maven.watcher.home=/opt/buildagent/plugins/mavenPlugin/maven-watcher-jdk16, -Dteamcity.projectName=Ignite Tests 2.x (JDK 8/11), -Dteamcity.runner.properties.file=/opt/buildagent/temp/buildTmp/teamcity.runner9098465561618137420.properties, -Dteamcity.tests.recentlyFailedTests.file=/opt/buildagent/temp/buildTmp/testsToRunFirst3891775683130404069.txt, -Dteamcity.version=2021.2 (build 99542), -ea, -Xms2g, -Xmx2g, -XX:+HeapDumpOnOutOfMemoryError, -DIGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_TEST_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_UPDATE_NOTIFIER=false, -DIGNITE_NO_DISCO_ORDER=true, -DIGNITE_PERFORMANCE_SUGGESTIONS_DISABLED=true, -Djava.net.preferIPv4Stack=true, -DTEST_SCALE_FACTOR=1.0, -DIGNITE_TEST_PROP_LOG4J_FILE=log4j-tc-test.xml, -DIGNITE_QUIET=false, -DIGNITE_MARSHAL_BUFFERS_RECHECK=1000, -Dmaven.repo.local=/opt/buildagent/.m2/repository] [21:03:38] : [Step 4/5] [2021-11-19 21:03:38,948][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][IgniteKernal%grid-1] System cache's DataRegion size is configured to 40 MB. Use DataStorageConfiguration.systemRegionInitialSize property to change the setting. [21:03:38] : [Step 4/5] [2021-11-19 21:03:38,948][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][IgniteKernal%grid-1] Configured caches [in 'sysMemPlc' dataRegion: ['ignite-sys-cache']] [21:03:38]W: [org.apache.ignite:ignite-core] [2021-11-19 21:03:38,948][WARN ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][IgniteKernal%grid-1] Peer class loading is enabled (disable it in production for performance and deployment consistency reasons) [21:03:38] : [Step 4/5] [2021-11-19 21:03:38,949][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][IgniteKernal%grid-1] 3-rd party licenses can be found at: /opt/buildagent/work/7bc1c54bc719b67c/libs/licenses [21:03:38] : [Step 4/5] [2021-11-19 21:03:38,954][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][IgnitePluginProcessor] Configured plugins: [21:03:38] : [Step 4/5] [2021-11-19 21:03:38,955][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][IgnitePluginProcessor] ^-- StanByClusterTestProvider 1.0 [21:03:38] : [Step 4/5] [2021-11-19 21:03:38,955][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][IgnitePluginProcessor] ^-- null [21:03:38] : [Step 4/5] [2021-11-19 21:03:38,955][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][IgnitePluginProcessor] [21:03:38] : [Step 4/5] [2021-11-19 21:03:38,955][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][IgnitePluginProcessor] ^-- PageMemory tracker plugin 1.0 [21:03:38] : [Step 4/5] [2021-11-19 21:03:38,955][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][IgnitePluginProcessor] ^-- null [21:03:38] : [Step 4/5] [2021-11-19 21:03:38,956][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][IgnitePluginProcessor] [21:03:38] : [Step 4/5] [2021-11-19 21:03:38,956][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][IgnitePluginProcessor] ^-- TestDistibutedConfigurationPlugin 1.0 [21:03:38] : [Step 4/5] [2021-11-19 21:03:38,956][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][IgnitePluginProcessor] ^-- null [21:03:38] : [Step 4/5] [2021-11-19 21:03:38,956][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][IgnitePluginProcessor] [21:03:38] : [Step 4/5] [2021-11-19 21:03:38,957][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][IgnitePluginProcessor] ^-- NodeValidationPluginProvider 1.0 [21:03:38] : [Step 4/5] [2021-11-19 21:03:38,957][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][IgnitePluginProcessor] ^-- null [21:03:38] : [Step 4/5] [2021-11-19 21:03:38,957][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][IgnitePluginProcessor] [21:03:38] : [Step 4/5] [2021-11-19 21:03:38,957][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][FailureProcessor] Configured failure handler: [hnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]]] [21:03:39] : [Step 4/5] [2021-11-19 21:03:39,001][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][TcpCommunicationSpi] Successfully bound communication NIO server to TCP port [port=45111, locHost=/127.0.0.1, selectorsCnt=12, selectorSpins=0, pairedConn=false] [21:03:39]W: [org.apache.ignite:ignite-core] [2021-11-19 21:03:39,001][WARN ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][TcpCommunicationSpi] Message queue limit is set to 0 which may lead to potential OOMEs when running cache operations in FULL_ASYNC or PRIMARY_SYNC modes due to message queues growth on sender and receiver sides. [21:03:39] : [Step 4/5] [2021-11-19 21:03:39,016][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][GridCollisionManager] Collision resolution is disabled (all jobs will be activated upon arrival). [21:03:39] : [Step 4/5] [2021-11-19 21:03:39,016][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][IgniteKernal%grid-1] Security status [authentication=off, sandbox=off, tls/ssl=off] [21:03:39] : [Step 4/5] [2021-11-19 21:03:39,080][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:03:39] : [Step 4/5] [2021-11-19 21:03:39,166][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][MaintenanceProcessor] Resolved store directory for node persistent data: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1 [21:03:39] : [Step 4/5] [2021-11-19 21:03:39,167][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][CacheObjectBinaryProcessorImpl] Resolved directory for serialized binary metadata: /opt/buildagent/work/7bc1c54bc719b67c/work/db/binary_meta/grid_1 [21:03:39] : [Step 4/5] [2021-11-19 21:03:39,173][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1 [21:03:39] : [Step 4/5] [2021-11-19 21:03:39,173][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][FileWriteAheadLogManager] Resolved write ahead log work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1 [21:03:39] : [Step 4/5] [2021-11-19 21:03:39,174][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][FileWriteAheadLogManager] Resolved write ahead log archive directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1 [21:03:39] : [Step 4/5] [2021-11-19 21:03:39,527][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000000.wal [21:03:39] : [Step 4/5] [2021-11-19 21:03:39,533][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][GridCacheDatabaseSharedManager] Configured data regions initialized successfully [total=5] [21:03:39] : [Step 4/5] [2021-11-19 21:03:39,534][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][IgniteSnapshotManager] Resolved snapshot work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/snapshots [21:03:39] : [Step 4/5] [2021-11-19 21:03:39,535][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][IgniteSnapshotManager] Resolved temp directory for snapshot creation: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1/snp [21:03:39] : [Step 4/5] [2021-11-19 21:03:39,537][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][ClientListenerProcessor] Client connector processor has started on TCP port 10801 [21:03:39] : [Step 4/5] [2021-11-19 21:03:39,539][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][IgniteKernal%grid-1] Non-loopback local IPs: 172.17.0.4 [21:03:39] : [Step 4/5] [2021-11-19 21:03:39,540][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][IgniteKernal%grid-1] Enabled local MACs: 0242AC110004 [21:03:39] : [Step 4/5] [2021-11-19 21:03:39,540][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:03:39] : [Step 4/5] [2021-11-19 21:03:39,541][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:03:39] : [Step 4/5] [2021-11-19 21:03:39,542][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:03:39] : [Step 4/5] [2021-11-19 21:03:39,544][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][GridCacheDatabaseSharedManager] Applying lost metastore updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:03:39] : [Step 4/5] [2021-11-19 21:03:39,545][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=0 ms] [21:03:39] : [Step 4/5] [2021-11-19 21:03:39,545][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][GridCacheProcessor] Restoring partition state for local groups. [21:03:39] : [Step 4/5] [2021-11-19 21:03:39,545][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=0, partitionsProcessed=0, time=0ms] [21:03:39] : [Step 4/5] [2021-11-19 21:03:39,545][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][GridEncryptionManager] Encryption keys loaded from metastore. [grps=, masterKeyName=ignite.master.key] [21:03:39] : [Step 4/5] [2021-11-19 21:03:39,547][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][ClusterProcessor] Cluster ID and tag has been read from metastorage: null [21:03:39] : [Step 4/5] [2021-11-19 21:03:39,547][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][IgniteClusterImpl] Shutdown policy was updated [oldVal=null, newVal=null] [21:03:39] : [Step 4/5] [2021-11-19 21:03:39,547][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][GridCacheDatabaseSharedManager] Checkpoint frequency deviation changed [oldVal=null, newVal=null] [21:03:39] : [Step 4/5] [2021-11-19 21:03:39,557][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][FilePageStoreManager] Cleanup cache stores [total=1, left=0, cleanFiles=false] [21:03:39] : [Step 4/5] [2021-11-19 21:03:39,559][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:03:39] : [Step 4/5] [2021-11-19 21:03:39,560][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:03:39] : [Step 4/5] [2021-11-19 21:03:39,561][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:03:39] : [Step 4/5] [2021-11-19 21:03:39,561][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][GridCacheDatabaseSharedManager] Data Regions Started: 5 [21:03:39] : [Step 4/5] [2021-11-19 21:03:39,561][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][GridCacheDatabaseSharedManager] ^-- sysMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:03:39] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:03:39] : [Step 4/5] ^-- default region [type=default, persistence=true, lazyAlloc=true, [21:03:39] : [Step 4/5] ... initCfg=10MB, maxCfg=10MB, usedRam=0MB, freeRam=100%, allocRam=0MB, allocTotal=0MB] [21:03:39] : [Step 4/5] ^-- metastoreMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:03:39] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:03:39] : [Step 4/5] ^-- TxLog region [type=internal, persistence=true, lazyAlloc=false, [21:03:39] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:03:39] : [Step 4/5] ^-- volatileDsMemPlc region [type=user, persistence=false, lazyAlloc=true, [21:03:39] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB] [21:03:39] : [Step 4/5] ^-- Ignite persistence [used=0MB] [21:03:39] : [Step 4/5] [21:03:39] : [Step 4/5] [2021-11-19 21:03:39,563][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][GridCacheDatabaseSharedManager] Starting binary memory restore for: [-2100569601] [21:03:39] : [Step 4/5] [2021-11-19 21:03:39,570][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:03:39] : [Step 4/5] [2021-11-19 21:03:39,570][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:03:39] : [Step 4/5] [2021-11-19 21:03:39,572][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000000.wal, offset=0, ver=2] [21:03:39] : [Step 4/5] [2021-11-19 21:03:39,575][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][GridCacheProcessor] Started cache in recovery mode [name=ignite-sys-cache, id=-2100569601, dataRegionName=sysMemPlc, mode=REPLICATED, atomicity=TRANSACTIONAL, backups=2147483647, mvcc=false] [21:03:39] : [Step 4/5] [2021-11-19 21:03:39,576][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][GridCacheDatabaseSharedManager] Binary recovery performed in 13 ms. [21:03:39] : [Step 4/5] [2021-11-19 21:03:39,576][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:03:39] : [Step 4/5] [2021-11-19 21:03:39,576][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][GridCacheDatabaseSharedManager] Applying lost cache updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:03:39] : [Step 4/5] [2021-11-19 21:03:39,655][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=80 ms] [21:03:39] : [Step 4/5] [2021-11-19 21:03:39,656][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][GridCacheProcessor] Restoring partition state for local groups. [21:03:39] : [Step 4/5] [2021-11-19 21:03:39,667][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=1, partitionsProcessed=100, time=10ms] [21:03:39] : [Step 4/5] [2021-11-19 21:03:39,975][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][TestTcpDiscoverySpi] Successfully bound to TCP port [port=47501, localHost=localhost/127.0.0.1, locNodeId=10074c6f-9ade-4088-94a6-968028069001] [21:03:39] : [Step 4/5] [2021-11-19 21:03:39,980][INFO ][tcp-disco-srvr-[:47500]-#265%grid-0%-#5384%grid-0%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=55779] [21:03:39] : [Step 4/5] [2021-11-19 21:03:39,980][INFO ][tcp-disco-srvr-[:47500]-#265%grid-0%-#5384%grid-0%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=55779] [21:03:39] : [Step 4/5] [2021-11-19 21:03:39,983][INFO ][tcp-disco-sock-reader-[]-#271%grid-0%-#5503%grid-0%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:55779, rmtPort=55779] [21:03:39] : [Step 4/5] [2021-11-19 21:03:39,985][INFO ][tcp-disco-sock-reader-[10074c6f 127.0.0.1:55779]-#271%grid-0%-#5503%grid-0%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=10074c6f-9ade-4088-94a6-968028069001, rmtAddr=/127.0.0.1:55779] [21:03:39] : [Step 4/5] [2021-11-19 21:03:39,992][INFO ][tcp-disco-srvr-[:47501]-#270%grid-1%-#5502%grid-1%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=42599] [21:03:39] : [Step 4/5] [2021-11-19 21:03:39,993][INFO ][tcp-disco-srvr-[:47501]-#270%grid-1%-#5502%grid-1%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=42599] [21:03:39] : [Step 4/5] [2021-11-19 21:03:39,993][INFO ][tcp-disco-sock-reader-[]-#272%grid-1%-#5504%grid-1%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:42599, rmtPort=42599] [21:03:39] : [Step 4/5] [2021-11-19 21:03:39,994][INFO ][tcp-disco-sock-reader-[]-#272%grid-1%-#5504%grid-1%][TestTcpDiscoverySpi] Received ping request from the remote node [rmtNodeId=000ecd75-0e73-41b1-ac22-55619cd1c000, rmtAddr=/127.0.0.1:42599, rmtPort=42599] [21:03:39] : [Step 4/5] [2021-11-19 21:03:39,996][INFO ][tcp-disco-sock-reader-[]-#272%grid-1%-#5504%grid-1%][TestTcpDiscoverySpi] Finished writing ping response [rmtNodeId=000ecd75-0e73-41b1-ac22-55619cd1c000, rmtAddr=/127.0.0.1:42599, rmtPort=42599] [21:03:39] : [Step 4/5] [2021-11-19 21:03:39,996][INFO ][tcp-disco-sock-reader-[10074c6f 127.0.0.1:55779]-#271%grid-0%-#5503%grid-0%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:55779, rmtPort=55779, rmtNodeId=10074c6f-9ade-4088-94a6-968028069001] [21:03:39]W: [org.apache.ignite:ignite-core] [2021-11-19 21:03:39,996][WARN ][tcp-disco-sock-reader-[]-#272%grid-1%-#5504%grid-1%][TestTcpDiscoverySpi] Failed to shutdown socket [21:03:39]W: [org.apache.ignite:ignite-core] java.net.SocketException: Socket output is already shutdown [21:03:39]W: [org.apache.ignite:ignite-core] at java.net.Socket.shutdownOutput(Socket.java:1572) [21:03:39]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.close(IgniteUtils.java:4247) [21:03:40]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.discovery.tcp.ServerImpl$SocketReader.body(ServerImpl.java:7370) [21:03:40] : [Step 4/5] [2021-11-19 21:03:39,999][INFO ][tcp-disco-sock-reader-[]-#272%grid-1%-#5504%grid-1%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:42599, rmtPort=42599, rmtNodeId=null] [21:03:40]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.IgniteSpiThread.run(IgniteSpiThread.java:58) [21:03:40] : [Step 4/5] [2021-11-19 21:03:40,001][INFO ][tcp-disco-msg-worker-[crd]-#264%grid-0%-#5383%grid-0%][GridEncryptionManager] Joining node doesn't have stored group keys [node=10074c6f-9ade-4088-94a6-968028069001] [21:03:40] : [Step 4/5] [2021-11-19 21:03:40,011][INFO ][tcp-disco-msg-worker-[crd]-#264%grid-0%-#5383%grid-0%][TestTcpDiscoverySpi] New next node [newNext=TcpDiscoveryNode [id=10074c6f-9ade-4088-94a6-968028069001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=0, intOrder=2, lastExchangeTime=1637345019988, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false]] [21:03:40] : [Step 4/5] [2021-11-19 21:03:40,013][INFO ][tcp-disco-srvr-[:47501]-#270%grid-1%-#5502%grid-1%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=57999] [21:03:40] : [Step 4/5] [2021-11-19 21:03:40,014][INFO ][tcp-disco-srvr-[:47501]-#270%grid-1%-#5502%grid-1%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=57999] [21:03:40] : [Step 4/5] [2021-11-19 21:03:40,016][INFO ][tcp-disco-sock-reader-[]-#273%grid-1%-#5505%grid-1%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:57999, rmtPort=57999] [21:03:40] : [Step 4/5] [2021-11-19 21:03:40,018][INFO ][tcp-disco-sock-reader-[000ecd75 127.0.0.1:57999]-#273%grid-1%-#5505%grid-1%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=000ecd75-0e73-41b1-ac22-55619cd1c000, rmtAddr=/127.0.0.1:57999] [21:03:40] : [Step 4/5] [2021-11-19 21:03:40,022][INFO ][tcp-disco-msg-worker-[]-#269%grid-1%-#5501%grid-1%][TestTcpDiscoverySpi] New next node [newNext=TcpDiscoveryNode [id=000ecd75-0e73-41b1-ac22-55619cd1c000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345020018, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false]] [21:03:40] : [Step 4/5] [2021-11-19 21:03:40,024][INFO ][tcp-disco-srvr-[:47500]-#265%grid-0%-#5384%grid-0%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=39491] [21:03:40] : [Step 4/5] [2021-11-19 21:03:40,024][INFO ][tcp-disco-srvr-[:47500]-#265%grid-0%-#5384%grid-0%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=39491] [21:03:40] : [Step 4/5] [2021-11-19 21:03:40,024][INFO ][tcp-disco-sock-reader-[]-#274%grid-0%-#5506%grid-0%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:39491, rmtPort=39491] [21:03:40] : [Step 4/5] [2021-11-19 21:03:40,026][INFO ][tcp-disco-sock-reader-[10074c6f 127.0.0.1:39491]-#274%grid-0%-#5506%grid-0%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=10074c6f-9ade-4088-94a6-968028069001, rmtAddr=/127.0.0.1:39491] [21:03:40] : [Step 4/5] [2021-11-19 21:03:40,029][INFO ][disco-event-worker-#5386%grid-0%][GridDiscoveryManager] Added new node to topology: TcpDiscoveryNode [id=10074c6f-9ade-4088-94a6-968028069001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637345019988, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false] [21:03:40] : [Step 4/5] [2021-11-19 21:03:40,030][INFO ][disco-event-worker-#5386%grid-0%][GridDiscoveryManager] Topology snapshot [ver=2, locNode=000ecd75, servers=2, clients=0, state=INACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=000ecd75-0e73-41b1-ac22-55619cd1c000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=10074c6f-9ade-4088-94a6-968028069001, consistentId=grid-1, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:03:40] : [Step 4/5] [2021-11-19 21:03:40,033][INFO ][tcp-disco-msg-worker-[000ecd75 127.0.0.1:47500]-#269%grid-1%-#5501%grid-1%][ClusterProcessor] blissful_shaw [21:03:40] : [Step 4/5] [2021-11-19 21:03:40,034][INFO ][tcp-disco-msg-worker-[000ecd75 127.0.0.1:47500]-#269%grid-1%-#5501%grid-1%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustEnabled' was changed from 'null' to 'false' [21:03:40] : [Step 4/5] [2021-11-19 21:03:40,034][INFO ][tcp-disco-msg-worker-[000ecd75 127.0.0.1:47500]-#269%grid-1%-#5501%grid-1%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustTimeout' was changed from 'null' to '300000' [21:03:40] : [Step 4/5] [2021-11-19 21:03:40,035][INFO ][tcp-disco-msg-worker-[000ecd75 127.0.0.1:47500]-#269%grid-1%-#5501%grid-1%][IgniteTxManager] Transactions parameter 'longOperationsDumpTimeout' was changed from 'null' to '60000' [21:03:40] : [Step 4/5] [2021-11-19 21:03:40,035][INFO ][tcp-disco-msg-worker-[000ecd75 127.0.0.1:47500]-#269%grid-1%-#5501%grid-1%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpThreshold' was changed from 'null' to '0' [21:03:40] : [Step 4/5] [2021-11-19 21:03:40,036][INFO ][tcp-disco-msg-worker-[000ecd75 127.0.0.1:47500]-#269%grid-1%-#5501%grid-1%][IgniteTxManager] Transactions parameter 'transactionTimeDumpSamplesCoefficient' was changed from 'null' to '0.0' [21:03:40] : [Step 4/5] [2021-11-19 21:03:40,036][INFO ][tcp-disco-msg-worker-[000ecd75 127.0.0.1:47500]-#269%grid-1%-#5501%grid-1%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpSamplesPerSecondLimit' was changed from 'null' to '5' [21:03:40] : [Step 4/5] [2021-11-19 21:03:40,037][INFO ][tcp-disco-msg-worker-[000ecd75 127.0.0.1:47500]-#269%grid-1%-#5501%grid-1%][IgniteTxManager] Transactions parameter 'collisionsDumpInterval' was changed from 'null' to '1000' [21:03:40] : [Step 4/5] [2021-11-19 21:03:40,037][INFO ][tcp-disco-msg-worker-[000ecd75 127.0.0.1:47500]-#269%grid-1%-#5501%grid-1%][IgniteTxManager] Transactions parameter 'txOwnerDumpRequestsAllowed' was changed from 'null' to 'true' [21:03:40] : [Step 4/5] [2021-11-19 21:03:40,038][INFO ][tcp-disco-msg-worker-[000ecd75 127.0.0.1:47500]-#269%grid-1%-#5501%grid-1%][GridCacheDatabaseSharedManager] Historical rebalance WAL threshold changed [property=historical.rebalance.threshold, oldVal=null, newVal=500] [21:03:40] : [Step 4/5] [2021-11-19 21:03:40,039][INFO ][disco-notifier-worker-#5500%grid-1%][MvccProcessorImpl] Assigned mvcc coordinator [crd=MvccCoordinator [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=0], nodeId=000ecd75-0e73-41b1-ac22-55619cd1c000, ver=1637345018886, local=false, initialized=false]] [21:03:40] : [Step 4/5] [2021-11-19 21:03:40,041][INFO ][sys-#5491%grid-1%][ClusterProcessor] Writing cluster ID and tag to metastorage on ready for write ClusterIdAndTag [id=b9c91f63-9430-4140-a4ff-30fa045d474b, tag=blissful_shaw] [21:03:40] : [Step 4/5] [2021-11-19 21:03:40,066][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][IgniteKernal%grid-1] To start Console Management & Monitoring run ignitevisorcmd.{sh|bat} [21:03:40] : [Step 4/5] [2021-11-19 21:03:40,066][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][IgniteKernal%grid-1] [21:03:40] : [Step 4/5] [21:03:40] : [Step 4/5] >>> +-------------------------------------------+ [21:03:40] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:03:40] : [Step 4/5] >>> +-------------------------------------------+ [21:03:40] : [Step 4/5] >>> OS name: Linux 4.15.0-151-generic amd64 [21:03:40] : [Step 4/5] >>> CPU(s): 24 [21:03:40] : [Step 4/5] >>> Heap: 2.0GB [21:03:40] : [Step 4/5] >>> VM name: 16724@c4dfe9a430b2 [21:03:40] : [Step 4/5] >>> Ignite instance name: grid-1 [21:03:40] : [Step 4/5] >>> Local node [ID=10074C6F-9ADE-4088-94A6-968028069001, order=2, clientMode=false] [21:03:40] : [Step 4/5] >>> Local node addresses: [127.0.0.1] [21:03:40] : [Step 4/5] >>> Local ports: TCP:10801 TCP:45111 TCP:47501 [21:03:40] : [Step 4/5] [21:03:40] : [Step 4/5] [2021-11-19 21:03:40,067][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][IgniteKernal%grid-1] >>> Ignite cluster is in INACTIVE state (limited functionality available). Use control.(sh|bat) script or IgniteCluster.state(ClusterState.ACTIVE) to change the state. [21:03:40] : [Step 4/5] [2021-11-19 21:03:40,068][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][GridDiscoveryManager] Topology snapshot [ver=2, locNode=10074c6f, servers=2, clients=0, state=INACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=000ecd75-0e73-41b1-ac22-55619cd1c000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=10074c6f-9ade-4088-94a6-968028069001, consistentId=grid-1, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:03:40] : [Step 4/5] [2021-11-19 21:03:40,069][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][G] Node started : [stage="Configure system pool" (0 ms),stage="Start managers" (236 ms),stage="Configure binary metadata" (2 ms),stage="Start processors" (369 ms),stage="Start 'StanByClusterTestProvider' plugin" (0 ms),stage="Start 'PageMemory tracker plugin' plugin" (0 ms),stage="Start 'TestDistibutedConfigurationPlugin' plugin" (0 ms),stage="Start 'NodeValidationPluginProvider' plugin" (0 ms),stage="Init metastore" (17 ms),stage="Init and start regions" (5 ms),stage="Restore binary memory" (13 ms),stage="Restore logical state" (91 ms),stage="Finish recovery" (306 ms),stage="Join topology" (64 ms),stage="Await transition" (2 ms),stage="Await exchange" (26 ms),stage="Total time" (1131 ms)] [21:03:40] : [Step 4/5] [2021-11-19 21:03:40,070][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][root] Node started with the following configuration [id=10074c6f-9ade-4088-94a6-968028069001, marshaller=BinaryMarshaller [], discovery=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=5000, ackTimeout=5000, marsh=JdkMarshaller [clsFilter=org.apache.ignite.marshaller.MarshallerUtils$1@7c1edf6c], reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], binaryCfg=null, lateAff=true] [21:03:40] : [Step 4/5] [2021-11-19 21:03:40,072][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][GridClusterStateProcessor] Sending activate cluster request with BaselineTopology BaselineTopology [id=0, branchingHash=-2475315501, branchingType='New BaselineTopology', baselineNodes=[grid-1, grid-0]] [21:03:40] : [Step 4/5] [2021-11-19 21:03:40,077][INFO ][disco-notifier-worker-#5382%grid-0%][GridClusterStateProcessor] Received activate cluster request with BaselineTopology[id=0] initiator node ID: 000ecd75-0e73-41b1-ac22-55619cd1c000 [21:03:40] : [Step 4/5] [2021-11-19 21:03:40,077][INFO ][disco-notifier-worker-#5382%grid-0%][GridClusterStateProcessor] Started state transition: activate cluster [21:03:40] : [Step 4/5] [2021-11-19 21:03:40,078][INFO ][exchange-worker-#5387%grid-0%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], crd=true, evt=DISCOVERY_CUSTOM_EVT, evtNode=000ecd75-0e73-41b1-ac22-55619cd1c000, customEvt=ChangeGlobalStateMessage [id=1741d593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqId=7e5c9191-f66c-4f12-bf30-1b99f9dfe684, initiatingNodeId=000ecd75-0e73-41b1-ac22-55619cd1c000, state=ACTIVE, baselineTopology=BaselineTopology [id=0, branchingHash=-2475315501, branchingType='New BaselineTopology', baselineNodes=[grid-1, grid-0]], forceChangeBaselineTopology=false, timestamp=1637345020072, forceDeactivation=true], allowMerge=false, exchangeFreeSwitch=false] [21:03:40] : [Step 4/5] [2021-11-19 21:03:40,079][INFO ][disco-notifier-worker-#5500%grid-1%][GridClusterStateProcessor] Received activate cluster request with BaselineTopology[id=0] initiator node ID: 000ecd75-0e73-41b1-ac22-55619cd1c000 [21:03:40] : [Step 4/5] [2021-11-19 21:03:40,079][INFO ][exchange-worker-#5387%grid-0%][GridDhtPartitionsExchangeFuture] Start activation process [nodeId=000ecd75-0e73-41b1-ac22-55619cd1c000, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]]. New state: ACTIVE [21:03:40] : [Step 4/5] [2021-11-19 21:03:40,080][INFO ][disco-notifier-worker-#5500%grid-1%][GridClusterStateProcessor] Started state transition: activate cluster [21:03:40] : [Step 4/5] [2021-11-19 21:03:40,080][INFO ][exchange-worker-#5387%grid-0%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0 [21:03:40] : [Step 4/5] [2021-11-19 21:03:40,081][INFO ][exchange-worker-#5509%grid-1%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], crd=false, evt=DISCOVERY_CUSTOM_EVT, evtNode=000ecd75-0e73-41b1-ac22-55619cd1c000, customEvt=ChangeGlobalStateMessage [id=1741d593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqId=7e5c9191-f66c-4f12-bf30-1b99f9dfe684, initiatingNodeId=000ecd75-0e73-41b1-ac22-55619cd1c000, state=ACTIVE, baselineTopology=BaselineTopology [id=0, branchingHash=-2475315501, branchingType='New BaselineTopology', baselineNodes=[grid-1, grid-0]], forceChangeBaselineTopology=false, timestamp=1637345020072, forceDeactivation=true], allowMerge=false, exchangeFreeSwitch=false] [21:03:40] : [Step 4/5] [2021-11-19 21:03:40,083][INFO ][exchange-worker-#5509%grid-1%][GridDhtPartitionsExchangeFuture] Start activation process [nodeId=10074c6f-9ade-4088-94a6-968028069001, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]]. New state: ACTIVE [21:03:40] : [Step 4/5] [2021-11-19 21:03:40,083][INFO ][exchange-worker-#5387%grid-0%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000000.wal, offset=8713, ver=2] [21:03:40] : [Step 4/5] [2021-11-19 21:03:40,083][INFO ][exchange-worker-#5509%grid-1%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1 [21:03:40] : [Step 4/5] [2021-11-19 21:03:40,084][INFO ][exchange-worker-#5387%grid-0%][GridClusterStateProcessor] Writing BaselineTopology[id=0] [21:03:40] : [Step 4/5] [2021-11-19 21:03:40,087][INFO ][exchange-worker-#5509%grid-1%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000000.wal, offset=8713, ver=2] [21:03:40] : [Step 4/5] [2021-11-19 21:03:40,091][INFO ][exchange-worker-#5509%grid-1%][GridClusterStateProcessor] Writing BaselineTopology[id=0] [21:03:40] : [Step 4/5] [2021-11-19 21:03:40,091][INFO ][exchange-worker-#5387%grid-0%][GridCacheDatabaseSharedManager] Finish recovery performed in 10 ms. [21:03:40] : [Step 4/5] [2021-11-19 21:03:40,093][INFO ][exchange-worker-#5387%grid-0%][msg] Components activation performed in 13 ms. [21:03:40] : [Step 4/5] [2021-11-19 21:03:40,096][INFO ][exchange-worker-#5387%grid-0%][GridCacheProcessor] Finished recovery for cache [cache=ignite-sys-cache, grp=ignite-sys-cache, startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:03:40] : [Step 4/5] [2021-11-19 21:03:40,100][INFO ][exchange-worker-#5509%grid-1%][GridCacheDatabaseSharedManager] Finish recovery performed in 15 ms. [21:03:40] : [Step 4/5] [2021-11-19 21:03:40,102][INFO ][exchange-worker-#5509%grid-1%][msg] Components activation performed in 19 ms. [21:03:40] : [Step 4/5] [2021-11-19 21:03:40,103][INFO ][exchange-worker-#5387%grid-0%][GridDhtPartitionsExchangeFuture] Successfully activated caches [nodeId=000ecd75-0e73-41b1-ac22-55619cd1c000, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], newState=ACTIVE] [21:03:40] : [Step 4/5] [2021-11-19 21:03:40,104][INFO ][exchange-worker-#5509%grid-1%][GridCacheProcessor] Finished recovery for cache [cache=ignite-sys-cache, grp=ignite-sys-cache, startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:03:40] : [Step 4/5] [2021-11-19 21:03:40,104][INFO ][exchange-worker-#5387%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:03:40] : [Step 4/5] [2021-11-19 21:03:40,104][INFO ][exchange-worker-#5509%grid-1%][GridDhtPartitionsExchangeFuture] Successfully activated caches [nodeId=10074c6f-9ade-4088-94a6-968028069001, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], newState=ACTIVE] [21:03:40] : [Step 4/5] [2021-11-19 21:03:40,106][INFO ][exchange-worker-#5509%grid-1%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:03:40] : [Step 4/5] [2021-11-19 21:03:40,135][INFO ][exchange-worker-#5387%grid-0%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], crd=true] [21:03:40] : [Step 4/5] [2021-11-19 21:03:40,138][INFO ][db-checkpoint-thread-#5523%grid-1%][Checkpointer] Checkpoint started [checkpointId=2c613066-14b8-4e57-8c27-36d7de04d729, startPtr=WALPointer [idx=0, fileOff=87147, len=1963], checkpointBeforeLockTime=2ms, checkpointLockWait=1ms, checkpointListenersExecuteTime=4ms, checkpointLockHoldTime=4ms, walCpRecordFsyncDuration=2ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=0ms, pages=19, reason='node started'] [21:03:40] : [Step 4/5] [2021-11-19 21:03:40,139][INFO ][grid-nio-worker-tcp-comm-0-#5326%TcpCommunicationSpi%][TcpCommunicationSpi] Accepted incoming communication connection [locAddr=/127.0.0.1:45110, rmtAddr=/127.0.0.1:47864] [21:03:40] : [Step 4/5] [2021-11-19 21:03:40,138][INFO ][db-checkpoint-thread-#5518%grid-0%][Checkpointer] Checkpoint started [checkpointId=4ef9a209-7ad1-4037-a425-e94430a1b66c, startPtr=WALPointer [idx=0, fileOff=86983, len=1963], checkpointBeforeLockTime=5ms, checkpointLockWait=2ms, checkpointListenersExecuteTime=1ms, checkpointLockHoldTime=3ms, walCpRecordFsyncDuration=1ms, writeCheckpointEntryDuration=3ms, splitAndSortCpPagesDuration=0ms, pages=19, reason='node started'] [21:03:40] : [Step 4/5] [2021-11-19 21:03:40,144][INFO ][grid-nio-worker-tcp-comm-0-#5444%TcpCommunicationSpi%][TcpCommunicationSpi] Established outgoing communication connection [locAddr=/127.0.0.1:47864, rmtAddr=/127.0.0.1:45110] [21:03:40] : [Step 4/5] [2021-11-19 21:03:40,148][INFO ][exchange-worker-#5509%grid-1%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], crd=false] [21:03:40] : [Step 4/5] [2021-11-19 21:03:40,152][INFO ][sys-#5365%grid-0%][GridDhtPartitionsExchangeFuture] Coordinator received single message [ver=AffinityTopologyVersion [topVer=2, minorTopVer=1], node=10074c6f-9ade-4088-94a6-968028069001, allReceived=true] [21:03:40] : [Step 4/5] [2021-11-19 21:03:40,152][INFO ][sys-#5365%grid-0%][GridDhtPartitionsExchangeFuture] finishExchangeOnCoordinator [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:03:40] : [Step 4/5] [2021-11-19 21:03:40,164][INFO ][sys-#5365%grid-0%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], err=null, rebalanced=true, wasRebalanced=false] [21:03:40] : [Step 4/5] [2021-11-19 21:03:40,164][INFO ][disco-notifier-worker-#5382%grid-0%][GridClusterStateProcessor] Received state change finish message: ACTIVE [21:03:40] : [Step 4/5] [2021-11-19 21:03:40,168][INFO ][sys-#5498%grid-1%][GridCachePartitionExchangeManager] Delay process full message without exchange id (there is exchange in progress) [nodeId=000ecd75-0e73-41b1-ac22-55619cd1c000] [21:03:40] : [Step 4/5] [2021-11-19 21:03:40,169][INFO ][sys-#5365%grid-0%][GridCacheProcessor] Finish proxy initialization, cacheName=ignite-sys-cache, localNodeId=000ecd75-0e73-41b1-ac22-55619cd1c000 [21:03:40] : [Step 4/5] [2021-11-19 21:03:40,168][INFO ][disco-notifier-worker-#5500%grid-1%][GridClusterStateProcessor] Received state change finish message: ACTIVE [21:03:40] : [Step 4/5] [2021-11-19 21:03:40,171][INFO ][sys-#5378%grid-0%][DistributedBaselineConfiguration] Baseline auto-adjust is 'disabled' with timeout='300000' ms [21:03:40] : [Step 4/5] [2021-11-19 21:03:40,171][INFO ][db-checkpoint-thread-#5518%grid-0%][Checkpointer] Checkpoint finished [cpId=4ef9a209-7ad1-4037-a425-e94430a1b66c, pages=19, markPos=WALPointer [idx=0, fileOff=86983, len=1963], walSegmentsCovered=[], markDuration=10ms, pagesWrite=6ms, fsync=24ms, total=47ms] [21:03:40] : [Step 4/5] [2021-11-19 21:03:40,170][INFO ][disco-notifier-worker-#5382%grid-0%][GridClusterStateProcessor] Cluster state was changed from INACTIVE to ACTIVE [21:03:40] : [Step 4/5] [2021-11-19 21:03:40,173][INFO ][sys-#5483%grid-1%][GridDhtPartitionsExchangeFuture] Received full message, will finish exchange [node=000ecd75-0e73-41b1-ac22-55619cd1c000, resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:03:40] : [Step 4/5] [2021-11-19 21:03:40,172][INFO ][exchange-worker-#5387%grid-0%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=2, minorTopVer=1], force=false, evt=DISCOVERY_CUSTOM_EVT, node=000ecd75-0e73-41b1-ac22-55619cd1c000] [21:03:40] : [Step 4/5] [2021-11-19 21:03:40,172][INFO ][sys-#5378%grid-0%][GridClusterStateProcessor] Successfully performed final activation steps [nodeId=000ecd75-0e73-41b1-ac22-55619cd1c000, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:03:40] : [Step 4/5] [2021-11-19 21:03:40,171][INFO ][sys-#5365%grid-0%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=000ecd75-0e73-41b1-ac22-55619cd1c000, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=000ecd75-0e73-41b1-ac22-55619cd1c000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345020162, loc=true, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:03:40] : [Step 4/5] [2021-11-19 21:03:40,171][INFO ][disco-notifier-worker-#5500%grid-1%][GridClusterStateProcessor] Cluster state was changed from INACTIVE to ACTIVE [21:03:40] : [Step 4/5] [2021-11-19 21:03:40,177][INFO ][sys-#5365%grid-0%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (1 ms), stage="Update caches registry" (14 ms), stage="Start caches" (3 ms), stage="Affinity initialization on cache group start" (5 ms), stage="Determine exchange type" (1 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Restore partition states" (0 ms), stage="After states restored callback" (29 ms), stage="WAL history reservation" (0 ms), stage="Waiting for all single messages" (17 ms), stage="Affinity recalculation (crd)" (0 ms), stage="Collect update counters and create affinity messages" (0 ms), stage="Assign partitions states" (1 ms), stage="Validate partitions states" (0 ms), stage="Ideal affinity diff calculation (enforced)" (1 ms), stage="Apply update counters" (0 ms), stage="Full message preparing" (6 ms), stage="Full message sending" (0 ms), stage="State finish message sending" (0 ms), stage="Detect lost partitions" (4 ms), stage="Exchange done" (8 ms), stage="Total time" (90 ms), Discovery lag=3 ms, Latest started node id=10074c6f-9ade-4088-94a6-968028069001] [21:03:40] : [Step 4/5] [2021-11-19 21:03:40,175][INFO ][sys-#5483%grid-1%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], err=null, rebalanced=true, wasRebalanced=false] [21:03:40] : [Step 4/5] [2021-11-19 21:03:40,175][INFO ][db-checkpoint-thread-#5523%grid-1%][Checkpointer] Checkpoint finished [cpId=2c613066-14b8-4e57-8c27-36d7de04d729, pages=19, markPos=WALPointer [idx=0, fileOff=87147, len=1963], walSegmentsCovered=[], markDuration=8ms, pagesWrite=9ms, fsync=26ms, total=46ms] [21:03:40] : [Step 4/5] [2021-11-19 21:03:40,180][INFO ][sys-#5365%grid-0%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], stage="Affinity initialization on cache group start [grp=ignite-sys-cache]" (5 ms) (parent=Affinity initialization on cache group start), stage="Affinity centralized initialization (crd) [grp=ignite-sys-cache, crd=true]" (0 ms) (parent=Determine exchange type), stage="Restore partition states [grp=ignite-sys-cache]" (0 ms) (parent=Restore partition states), stage="Affinity recalculation (partitions availability) [grp=ignite-sys-cache]" (0 ms) (parent=Ideal affinity diff calculation (enforced))] [21:03:40] : [Step 4/5] [2021-11-19 21:03:40,183][INFO ][sys-#5483%grid-1%][GridCacheProcessor] Finish proxy initialization, cacheName=ignite-sys-cache, localNodeId=10074c6f-9ade-4088-94a6-968028069001 [21:03:40] : [Step 4/5] [2021-11-19 21:03:40,184][INFO ][sys-#5485%grid-1%][DistributedBaselineConfiguration] Baseline auto-adjust is 'disabled' with timeout='300000' ms [21:03:40] : [Step 4/5] [2021-11-19 21:03:40,185][INFO ][sys-#5485%grid-1%][GridClusterStateProcessor] Successfully performed final activation steps [nodeId=10074c6f-9ade-4088-94a6-968028069001, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:03:40] : [Step 4/5] [2021-11-19 21:03:40,185][INFO ][sys-#5483%grid-1%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=10074c6f-9ade-4088-94a6-968028069001, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=000ecd75-0e73-41b1-ac22-55619cd1c000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345020018, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:03:40] : [Step 4/5] [2021-11-19 21:03:40,185][INFO ][exchange-worker-#5509%grid-1%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=2, minorTopVer=1], force=false, evt=DISCOVERY_CUSTOM_EVT, node=000ecd75-0e73-41b1-ac22-55619cd1c000] [21:03:40] : [Step 4/5] [2021-11-19 21:03:40,190][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][root] awaitPartitionMapExchange finished [21:03:40] : [Step 4/5] [2021-11-19 21:03:40,187][INFO ][sys-#5483%grid-1%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (1 ms), stage="Update caches registry" (20 ms), stage="Start caches" (0 ms), stage="Affinity initialization on cache group start" (0 ms), stage="Determine exchange type" (1 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Restore partition states" (0 ms), stage="After states restored callback" (28 ms), stage="WAL history reservation" (0 ms), stage="Waiting for Full message" (38 ms), stage="Affinity recalculation" (1 ms), stage="Full map updating" (0 ms), stage="Detect lost partitions" (6 ms), stage="Exchange done" (4 ms), stage="Total time" (99 ms)] [21:03:40] : [Step 4/5] [2021-11-19 21:03:40,194][INFO ][sys-#5483%grid-1%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], stage="Affinity initialization on cache group start [grp=ignite-sys-cache]" (0 ms) (parent=Affinity initialization on cache group start), stage="Affinity centralized initialization (crd) [grp=ignite-sys-cache, crd=false]" (1 ms) (parent=Determine exchange type), stage="Restore partition states [grp=ignite-sys-cache]" (0 ms) (parent=Restore partition states), stage="Affinity applying from full message [grp=ignite-sys-cache]" (1 ms) (parent=Affinity recalculation)] [21:03:40] : [Step 4/5] [2021-11-19 21:03:40,570][INFO ][exchange-worker-#5509%grid-1%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], crd=false, evt=DISCOVERY_CUSTOM_EVT, evtNode=000ecd75-0e73-41b1-ac22-55619cd1c000, customEvt=DynamicCacheChangeBatch [id=5941d593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqs=ArrayList [DynamicCacheChangeRequest [cacheName=encrypted, hasCfg=true, nodeId=000ecd75-0e73-41b1-ac22-55619cd1c000, clientStartOnly=false, stop=false, destroy=false, disabledAfterStart=false]], exchangeActions=ExchangeActions [startCaches=[encrypted], stopCaches=null, startGrps=[encrypted], stopGrps=[], resetParts=null, stateChangeRequest=null], startCaches=false], allowMerge=false, exchangeFreeSwitch=false] [21:03:40] : [Step 4/5] [2021-11-19 21:03:40,570][INFO ][exchange-worker-#5387%grid-0%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], crd=true, evt=DISCOVERY_CUSTOM_EVT, evtNode=000ecd75-0e73-41b1-ac22-55619cd1c000, customEvt=DynamicCacheChangeBatch [id=5941d593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqs=ArrayList [DynamicCacheChangeRequest [cacheName=encrypted, hasCfg=true, nodeId=000ecd75-0e73-41b1-ac22-55619cd1c000, clientStartOnly=false, stop=false, destroy=false, disabledAfterStart=false]], exchangeActions=ExchangeActions [startCaches=[encrypted], stopCaches=null, startGrps=[encrypted], stopGrps=[], resetParts=null, stateChangeRequest=null], startCaches=false], allowMerge=false, exchangeFreeSwitch=false] [21:03:40] : [Step 4/5] [2021-11-19 21:03:40,573][INFO ][exchange-worker-#5509%grid-1%][PageMemoryImpl] Started page memory [memoryAllocated=24.0 MiB, pages=5952, tableSize=474.2 KiB, replacementSize=768 B, checkpointBuffer=10.0 MiB] [21:03:40] : [Step 4/5] [2021-11-19 21:03:40,574][INFO ][exchange-worker-#5387%grid-0%][PageMemoryImpl] Started page memory [memoryAllocated=24.0 MiB, pages=5952, tableSize=474.2 KiB, replacementSize=768 B, checkpointBuffer=10.0 MiB] [21:03:40] : [Step 4/5] [2021-11-19 21:03:40,670][INFO ][exchange-worker-#5387%grid-0%][GridCacheProcessor] Started cache [name=encrypted, id=1613773252, dataRegionName=default, mode=PARTITIONED, atomicity=ATOMIC, backups=0, mvcc=false] [21:03:40]W: [org.apache.ignite:ignite-core] [2021-11-19 21:03:40,674][WARN ][exchange-worker-#5387%grid-0%][CacheAffinitySharedManager] Cache group 'encrypted' brings high overhead for its metainformation in data region 'default'. Metainformation required for its partitions (502 partitions, 4096 bytes per partition, 1 MBs total) will consume more than 15% of data region memory (10 MBs). It may lead to critical errors on the node and cluster instability. Please reduce number of partitions, add more memory to the data region or add more server nodes for this cache group. [21:03:40] : [Step 4/5] [2021-11-19 21:03:40,675][INFO ][exchange-worker-#5387%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], waitTime=0ms, futInfo=NA, mode=DISTRIBUTED] [21:03:40] : [Step 4/5] [2021-11-19 21:03:40,698][INFO ][exchange-worker-#5509%grid-1%][GridCacheProcessor] Started cache [name=encrypted, id=1613773252, dataRegionName=default, mode=PARTITIONED, atomicity=ATOMIC, backups=0, mvcc=false] [21:03:40]W: [org.apache.ignite:ignite-core] [2021-11-19 21:03:40,701][WARN ][exchange-worker-#5509%grid-1%][CacheAffinitySharedManager] Cache group 'encrypted' brings high overhead for its metainformation in data region 'default'. Metainformation required for its partitions (522 partitions, 4096 bytes per partition, 2 MBs total) will consume more than 15% of data region memory (10 MBs). It may lead to critical errors on the node and cluster instability. Please reduce number of partitions, add more memory to the data region or add more server nodes for this cache group. [21:03:40] : [Step 4/5] [2021-11-19 21:03:40,703][INFO ][exchange-worker-#5509%grid-1%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], waitTime=0ms, futInfo=NA, mode=DISTRIBUTED] [21:03:40] : [Step 4/5] [2021-11-19 21:03:40,704][INFO ][exchange-worker-#5387%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partitions release latch: ServerLatch [permits=0, pendingAcks=HashSet [], super=CompletableLatch [id=CompletableLatchUid [id=exchange, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2]]]] [21:03:40] : [Step 4/5] [2021-11-19 21:03:40,704][INFO ][exchange-worker-#5387%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:03:40] : [Step 4/5] [2021-11-19 21:03:40,705][INFO ][exchange-worker-#5509%grid-1%][GridDhtPartitionsExchangeFuture] Finished waiting for partitions release latch: ClientLatch [coordinator=TcpDiscoveryNode [id=000ecd75-0e73-41b1-ac22-55619cd1c000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345020018, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], ackSent=true, super=CompletableLatch [id=CompletableLatchUid [id=exchange, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2]]]] [21:03:40] : [Step 4/5] [2021-11-19 21:03:40,706][INFO ][exchange-worker-#5509%grid-1%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:03:40] : [Step 4/5] [2021-11-19 21:03:40,756][INFO ][exchange-worker-#5509%grid-1%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], crd=false] [21:03:40] : [Step 4/5] [2021-11-19 21:03:40,759][INFO ][exchange-worker-#5387%grid-0%][GridDhtPartitionsExchangeFuture] Coordinator received single message [ver=AffinityTopologyVersion [topVer=2, minorTopVer=2], node=10074c6f-9ade-4088-94a6-968028069001, allReceived=true] [21:03:40] : [Step 4/5] [2021-11-19 21:03:40,760][INFO ][exchange-worker-#5387%grid-0%][GridDhtPartitionsExchangeFuture] finishExchangeOnCoordinator [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2]] [21:03:40] : [Step 4/5] [2021-11-19 21:03:40,767][INFO ][exchange-worker-#5387%grid-0%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], err=null, rebalanced=true, wasRebalanced=true] [21:03:40] : [Step 4/5] [2021-11-19 21:03:40,768][INFO ][sys-#5494%grid-1%][GridDhtPartitionsExchangeFuture] Received full message, will finish exchange [node=000ecd75-0e73-41b1-ac22-55619cd1c000, resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2]] [21:03:40] : [Step 4/5] [2021-11-19 21:03:40,769][INFO ][exchange-worker-#5387%grid-0%][GridCacheProcessor] Finish proxy initialization, cacheName=encrypted, localNodeId=000ecd75-0e73-41b1-ac22-55619cd1c000 [21:03:40] : [Step 4/5] [2021-11-19 21:03:40,769][INFO ][exchange-worker-#5387%grid-0%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=000ecd75-0e73-41b1-ac22-55619cd1c000, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=000ecd75-0e73-41b1-ac22-55619cd1c000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345020744, loc=true, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2]] [21:03:40] : [Step 4/5] [2021-11-19 21:03:40,771][INFO ][sys-#5494%grid-1%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], err=null, rebalanced=true, wasRebalanced=true] [21:03:40] : [Step 4/5] [2021-11-19 21:03:40,772][INFO ][exchange-worker-#5387%grid-0%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (2 ms), stage="Update caches registry" (0 ms), stage="Start caches" (97 ms), stage="Affinity initialization on cache group start" (4 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Wait partitions release latch [latch=exchange]" (28 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Restore partition states" (18 ms), stage="After states restored callback" (35 ms), stage="WAL history reservation" (0 ms), stage="Waiting for all single messages" (0 ms), stage="Affinity recalculation (crd)" (0 ms), stage="Collect update counters and create affinity messages" (0 ms), stage="Assign partitions states" (3 ms), stage="Validate partitions states" (0 ms), stage="Apply update counters" (0 ms), stage="Full message preparing" (2 ms), stage="Full message sending" (0 ms), stage="Exchange done" (4 ms), stage="Total time" (193 ms)] [21:03:40] : [Step 4/5] [2021-11-19 21:03:40,774][INFO ][sys-#5494%grid-1%][GridCacheProcessor] Finish proxy initialization, cacheName=encrypted, localNodeId=10074c6f-9ade-4088-94a6-968028069001 [21:03:40] : [Step 4/5] [2021-11-19 21:03:40,775][INFO ][exchange-worker-#5387%grid-0%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], stage="Affinity initialization on cache group start [grp=encrypted]" (2 ms) (parent=Affinity initialization on cache group start), stage="Restore partition states [grp=encrypted]" (18 ms) (parent=Restore partition states), stage="Restore partition states [grp=ignite-sys-cache]" (0 ms) (parent=Restore partition states)] [21:03:40] : [Step 4/5] [2021-11-19 21:03:40,776][INFO ][exchange-worker-#5509%grid-1%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=2, minorTopVer=2], force=false, evt=DISCOVERY_CUSTOM_EVT, node=000ecd75-0e73-41b1-ac22-55619cd1c000] [21:03:40] : [Step 4/5] [2021-11-19 21:03:40,775][INFO ][sys-#5494%grid-1%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=10074c6f-9ade-4088-94a6-968028069001, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=000ecd75-0e73-41b1-ac22-55619cd1c000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345020018, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2]] [21:03:40] : [Step 4/5] [2021-11-19 21:03:40,776][INFO ][exchange-worker-#5387%grid-0%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], crd=true] [21:03:40] : [Step 4/5] [2021-11-19 21:03:40,778][INFO ][sys-#5494%grid-1%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (1 ms), stage="Update caches registry" (0 ms), stage="Start caches" (126 ms), stage="Affinity initialization on cache group start" (3 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Wait partitions release latch [latch=exchange]" (2 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Restore partition states" (16 ms), stage="After states restored callback" (31 ms), stage="WAL history reservation" (0 ms), stage="Waiting for Full message" (13 ms), stage="Affinity recalculation" (0 ms), stage="Full map updating" (2 ms), stage="Exchange done" (6 ms), stage="Total time" (200 ms)] [21:03:40] : [Step 4/5] [2021-11-19 21:03:40,779][INFO ][exchange-worker-#5387%grid-0%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=2, minorTopVer=2], force=false, evt=DISCOVERY_CUSTOM_EVT, node=000ecd75-0e73-41b1-ac22-55619cd1c000] [21:03:40] : [Step 4/5] [2021-11-19 21:03:40,781][INFO ][sys-#5494%grid-1%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], stage="Affinity initialization on cache group start [grp=encrypted]" (1 ms) (parent=Affinity initialization on cache group start), stage="Restore partition states [grp=encrypted]" (16 ms) (parent=Restore partition states), stage="Restore partition states [grp=ignite-sys-cache]" (0 ms) (parent=Restore partition states)] [21:03:41] : [Step 4/5] [2021-11-19 21:03:41,277][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][root] >>> Stopping grid [name=grid-1, id=10074c6f-9ade-4088-94a6-968028069001] [21:03:41] : [Step 4/5] [2021-11-19 21:03:41,511][INFO ][db-checkpoint-thread-#5523%grid-1%][Checkpointer] Checkpoint started [checkpointId=2980b722-2142-421f-a9e1-4558676204d1, startPtr=WALPointer [idx=0, fileOff=197369, len=11871], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=131ms, writeCheckpointEntryDuration=96ms, splitAndSortCpPagesDuration=0ms, pages=10, reason='timeout'] [21:03:41] : [Step 4/5] [2021-11-19 21:03:41,519][INFO ][tcp-disco-sock-reader-[000ecd75 127.0.0.1:57999]-#273%grid-1%-#5505%grid-1%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:57999, rmtPort=57999, rmtNodeId=000ecd75-0e73-41b1-ac22-55619cd1c000] [21:03:41] : [Step 4/5] [2021-11-19 21:03:41,520][INFO ][disco-event-worker-#5386%grid-0%][GridDiscoveryManager] Node left topology: TcpDiscoveryNode [id=10074c6f-9ade-4088-94a6-968028069001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637345019988, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false] [21:03:41] : [Step 4/5] [2021-11-19 21:03:41,520][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][GridCacheProcessor] Stopped cache [cacheName=ignite-sys-cache] [21:03:41] : [Step 4/5] [2021-11-19 21:03:41,521][INFO ][disco-event-worker-#5386%grid-0%][GridDiscoveryManager] Topology snapshot [ver=3, locNode=000ecd75, servers=1, clients=0, state=ACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=000ecd75-0e73-41b1-ac22-55619cd1c000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:03:41] : [Step 4/5] [2021-11-19 21:03:41,522][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][GridCacheProcessor] Stopped cache [cacheName=encrypted] [21:03:41] : [Step 4/5] [2021-11-19 21:03:41,523][INFO ][disco-event-worker-#5386%grid-0%][GridDiscoveryManager] ^-- Baseline [id=0, size=2, online=1, offline=1] [21:03:41]W: [org.apache.ignite:ignite-core] [2021-11-19 21:03:41,524][WARN ][grid-nio-worker-tcp-comm-0-#5326%TcpCommunicationSpi%][TcpCommunicationSpi] Failed to shutdown socket [21:03:41]W: [org.apache.ignite:ignite-core] java.nio.channels.ClosedChannelException [21:03:41]W: [org.apache.ignite:ignite-core] at sun.nio.ch.SocketChannelImpl.shutdownOutput(SocketChannelImpl.java:795) [21:03:41]W: [org.apache.ignite:ignite-core] at sun.nio.ch.SocketAdaptor.shutdownOutput(SocketAdaptor.java:407) [21:03:41]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.close(IgniteUtils.java:4247) [21:03:41]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.closeKey(GridNioServer.java:2784) [21:03:41]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.close(GridNioServer.java:2835) [21:03:41]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.close(GridNioServer.java:2794) [21:03:41]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.bodyInternal(GridNioServer.java:2157) [21:03:41]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.body(GridNioServer.java:1910) [21:03:41]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:125) [21:03:41]W: [org.apache.ignite:ignite-core] at java.lang.Thread.run(Thread.java:748) [21:03:41] : [Step 4/5] [2021-11-19 21:03:41,525][INFO ][exchange-worker-#5387%grid-0%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], crd=true, evt=NODE_LEFT, evtNode=10074c6f-9ade-4088-94a6-968028069001, customEvt=null, allowMerge=false, exchangeFreeSwitch=true] [21:03:41] : [Step 4/5] [2021-11-19 21:03:41,528][INFO ][exchange-worker-#5387%grid-0%][GridAffinityAssignmentCache] Local node affinity assignment distribution is not ideal [cache=encrypted, expectedPrimary=1024.00, actualPrimary=502, expectedBackups=0.00, actualBackups=0, warningThreshold=50.00%] [21:03:41] : [Step 4/5] [2021-11-19 21:03:41,529][INFO ][exchange-worker-#5387%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:03:41] : [Step 4/5] [2021-11-19 21:03:41,531][INFO ][exchange-worker-#5387%grid-0%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], err=null, rebalanced=true, wasRebalanced=true] [21:03:41]W: [org.apache.ignite:ignite-core] [2021-11-19 21:03:41,534][WARN ][exchange-worker-#5387%grid-0%][GridDhtPartitionTopologyImpl] Detected lost partitions [grp=encrypted, parts=[0, 2, 4, 6-7, 10-11, 14, 17, 21, 24-30, 32, 37, 40, 44, 47-52, 54, 57, 59, 62-64, 67-68, 74-75, 78, 81, 87-88, 91, 97, 99, 101-102, 104-107, 113-114, 116, 118, 120, 122, 124, 135-136, 138, 140-145, 147, 149-152, 154-156, 159-160, 162-164, 169, 172, 175-177, 180, 184-187, 190-191, 194, 196-202, 204-205, 209-210, 212, 214, 216, 219-224, 226, 229-232, 237, 239, 241, 243-245, 247, 249-251, 255, 257, 261, 265, 269, 272-273, 276-277, 281-282, 285, 287, 289-291, 293-297, 299, 301-304, 306, 308-309, 311-312, 315-317, 319, 322, 325-326, 328-330, 336, 339, 341, 344-346, 350, 352-354, 357-361, 363, 366-367, 371-373, 376-380, 383, 385, 387-388, 390, 392, 395-397, 400, 402, 405, 408-411, 416, 420, 422, 424-425, 429, 433, 435-438, 440-441, 445-446, 450, 452-453, 455-456, 458, 460, 462-463, 465-468, 470, 474-475, 480, 488, 490-492, 495, 497, 499-512, 516, 525, 527-531, 535, 537-538, 541-542, 545-546, 548-552, 554-555, 558, 562-564, 567-569, 572, 574, 579-580, 582-585, 587, 590-591, 594, 596, 600, 602, 604, 607-614, 617-620, 623-624, 627-629, 632-633, 636, 638, 640-642, 645-646, 648-649, 657-662, 664-665, 668-672, 677-678, 682-684, 686, 689, 692-693, 695-697, 699, 706-707, 709-710, 712-714, 716-717, 719-721, 723-728, 730-732, 734-735, 739, 742, 746, 749-750, 752, 754, 756, 762, 768-770, 772-775, 778, 780, 783-787, 789-791, 793, 796, 798-801, 803, 806, 809-812, 814, 816-817, 819, 822-825, 827-829, 832-833, 836-837, 839-840, 846, 848-851, 853-854, 857-858, 860, 863-864, 866, 868-871, 873-875, 877-878, 884, 888-889, 896-897, 900, 905-907, 914-915, 917, 919-920, 923-925, 931-933, 936, 940, 942, 944-945, 948, 950-951, 954, 956-958, 962, 965-970, 972, 975-976, 978-980, 983, 985, 988, 990, 993-994, 997-998, 1000, 1003-1004, 1007, 1009, 1014, 1016, 1018-1019], topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0]] [21:03:41] : [Step 4/5] [2021-11-19 21:03:41,538][INFO ][exchange-worker-#5387%grid-0%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=000ecd75-0e73-41b1-ac22-55619cd1c000, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], evt=NODE_LEFT, evtNode=TcpDiscoveryNode [id=10074c6f-9ade-4088-94a6-968028069001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637345019988, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0]] [21:03:41] : [Step 4/5] [2021-11-19 21:03:41,539][INFO ][exchange-worker-#5387%grid-0%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (1 ms), stage="Determine exchange type" (1 ms), stage="Preloading notification" (0 ms), stage="After states restored callback" (0 ms), stage="WAL history reservation" (0 ms), stage="Finalize update counters" (0 ms), stage="Detect lost partitions" (6 ms), stage="Exchange done" (2 ms), stage="Total time" (10 ms)] [21:03:41] : [Step 4/5] [2021-11-19 21:03:41,540][INFO ][exchange-worker-#5387%grid-0%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], stage="Affinity initialization (exchange-free switch on fully-rebalanced topology) [grp=encrypted]" (1 ms) (parent=Determine exchange type), stage="Affinity initialization (exchange-free switch on fully-rebalanced topology) [grp=ignite-sys-cache]" (0 ms) (parent=Determine exchange type)] [21:03:41] : [Step 4/5] [2021-11-19 21:03:41,542][INFO ][exchange-worker-#5387%grid-0%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], crd=true] [21:03:41] : [Step 4/5] [2021-11-19 21:03:41,543][INFO ][exchange-worker-#5387%grid-0%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=3, minorTopVer=0], force=false, evt=NODE_LEFT, node=10074c6f-9ade-4088-94a6-968028069001] [21:03:42] : [Step 4/5] [2021-11-19 21:03:42,222][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][FilePageStoreManager] Cleanup cache stores [total=4, left=0, cleanFiles=false] [21:03:42] : [Step 4/5] [2021-11-19 21:03:42,225][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][GridDeploymentLocalStore] Removed undeployed class: GridDeployment [ts=1637345020162, depMode=SHARED, clsLdr=IsolatedClassLoader{roleName='test'}, clsLdrId=f741d593d71-10074c6f-9ade-4088-94a6-968028069001, userVer=0, loc=true, sampleClsName=org.apache.ignite.internal.processors.cache.distributed.dht.preloader.GridDhtPartitionFullMap, pendingUndeploy=false, undeployed=true, usage=0] [21:03:42] : [Step 4/5] [2021-11-19 21:03:42,241][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][IgniteKernal%grid-1] [21:03:42] : [Step 4/5] [21:03:42] : [Step 4/5] >>> +------------------------------------------------------+ [21:03:42] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV stopped OK [21:03:42] : [Step 4/5] >>> +------------------------------------------------------+ [21:03:42] : [Step 4/5] >>> Ignite instance name: grid-1 [21:03:42] : [Step 4/5] >>> Grid uptime: 00:00:02.181 [21:03:42] : [Step 4/5] [21:03:42] : [Step 4/5] [21:03:42] : [Step 4/5] [2021-11-19 21:03:42,242][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][root] >>> Stopping grid [name=grid-0, id=000ecd75-0e73-41b1-ac22-55619cd1c000] [21:03:42] : [Step 4/5] [2021-11-19 21:03:42,255][INFO ][db-checkpoint-thread-#5518%grid-0%][Checkpointer] Checkpoint started [checkpointId=8d5e1fe4-b212-4800-bf67-1c00f9d623c0, startPtr=WALPointer [idx=0, fileOff=228995, len=11491], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=1ms, checkpointLockHoldTime=2ms, walCpRecordFsyncDuration=2ms, writeCheckpointEntryDuration=2ms, splitAndSortCpPagesDuration=0ms, pages=23, reason='timeout'] [21:03:42]W: [org.apache.ignite:ignite-core] [2021-11-19 21:03:42,262][WARN ][tcp-disco-sock-reader-[10074c6f 127.0.0.1:39491]-#274%grid-0%-#5506%grid-0%][TestTcpDiscoverySpi] Failed to shutdown socket [21:03:42]W: [org.apache.ignite:ignite-core] java.net.SocketException: Socket is closed [21:03:42]W: [org.apache.ignite:ignite-core] at java.net.Socket.shutdownOutput(Socket.java:1568) [21:03:42]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.close(IgniteUtils.java:4247) [21:03:42]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.discovery.tcp.ServerImpl$SocketReader.body(ServerImpl.java:7370) [21:03:42] : [Step 4/5] [2021-11-19 21:03:42,263][INFO ][tcp-disco-sock-reader-[10074c6f 127.0.0.1:39491]-#274%grid-0%-#5506%grid-0%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:39491, rmtPort=39491, rmtNodeId=10074c6f-9ade-4088-94a6-968028069001] [21:03:42]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.IgniteSpiThread.run(IgniteSpiThread.java:58) [21:03:42] : [Step 4/5] [2021-11-19 21:03:42,265][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][GridCacheProcessor] Stopped cache [cacheName=ignite-sys-cache] [21:03:42] : [Step 4/5] [2021-11-19 21:03:42,266][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][GridCacheProcessor] Stopped cache [cacheName=encrypted] [21:03:42] : [Step 4/5] [2021-11-19 21:03:42,632][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][FilePageStoreManager] Cleanup cache stores [total=4, left=0, cleanFiles=false] [21:03:42] : [Step 4/5] [2021-11-19 21:03:42,635][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][GridDeploymentLocalStore] Removed undeployed class: GridDeployment [ts=1637345020141, depMode=SHARED, clsLdr=IsolatedClassLoader{roleName='test'}, clsLdrId=d741d593d71-000ecd75-0e73-41b1-ac22-55619cd1c000, userVer=0, loc=true, sampleClsName=org.apache.ignite.internal.processors.cache.distributed.dht.preloader.GridDhtPartitionMap, pendingUndeploy=false, undeployed=true, usage=0] [21:03:42] : [Step 4/5] [2021-11-19 21:03:42,642][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][IgniteKernal%grid-0] [21:03:42] : [Step 4/5] [21:03:42] : [Step 4/5] >>> +------------------------------------------------------+ [21:03:42] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV stopped OK [21:03:42] : [Step 4/5] >>> +------------------------------------------------------+ [21:03:42] : [Step 4/5] >>> Ignite instance name: grid-0 [21:03:42] : [Step 4/5] >>> Grid uptime: 00:00:03.716 [21:03:42] : [Step 4/5] [21:03:42] : [Step 4/5] [21:03:42]W: [org.apache.ignite:ignite-core] [2021-11-19 21:03:42,649][WARN ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][G] Ignite work directory is not provided, automatically resolved to: /opt/buildagent/work/7bc1c54bc719b67c/work [21:03:42] : [Step 4/5] [2021-11-19 21:03:42,650][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][IgniteKernal%grid-0] [21:03:42] : [Step 4/5] [21:03:42] : [Step 4/5] >>> __________ ________________ [21:03:42] : [Step 4/5] >>> / _/ ___/ |/ / _/_ __/ __/ [21:03:42] : [Step 4/5] >>> _/ // (7 7 // / / / / _/ [21:03:42] : [Step 4/5] >>> /___/\___/_/|_/___/ /_/ /___/ [21:03:42] : [Step 4/5] >>> [21:03:42] : [Step 4/5] >>> ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:03:42] : [Step 4/5] >>> 2021 Copyright(C) Apache Software Foundation [21:03:42] : [Step 4/5] >>> [21:03:42] : [Step 4/5] >>> Ignite documentation: http://ignite.apache.org [21:03:42] : [Step 4/5] [21:03:42] : [Step 4/5] [2021-11-19 21:03:42,651][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][IgniteKernal%grid-0] Config URL: n/a [21:03:42] : [Step 4/5] [2021-11-19 21:03:42,652][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][IgniteKernal%grid-0] IgniteConfiguration [igniteInstanceName=grid-0, pubPoolSize=24, svcPoolSize=24, callbackPoolSize=24, stripedPoolSize=24, sysPoolSize=24, mgmtPoolSize=4, dataStreamerPoolSize=24, utilityCachePoolSize=24, utilityCacheKeepAliveTime=60000, p2pPoolSize=2, qryPoolSize=24, buildIdxPoolSize=4, igniteHome=/opt/buildagent/work/7bc1c54bc719b67c, igniteWorkDir=/opt/buildagent/work/7bc1c54bc719b67c/work, mbeanSrv=com.sun.jmx.mbeanserver.JmxMBeanServer@6fe85038, nodeId=00bde6fb-2506-4264-b60f-8d474f74e000, marsh=BinaryMarshaller [], marshLocJobs=false, daemon=false, p2pEnabled=true, netTimeout=10000, netCompressionLevel=1, sndRetryDelay=1000, sndRetryCnt=3, metricsHistSize=10000, metricsUpdateFreq=1000, metricsExpTime=9223372036854775807, discoSpi=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=0, ackTimeout=0, marsh=null, reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], segPlc=STOP, segResolveAttempts=2, waitForSegOnStart=true, allResolversPassReq=true, segChkFreq=10000, commSpi=TcpCommunicationSpi [connectGate=org.apache.ignite.spi.communication.tcp.internal.ConnectGateway@12d273fb, ctxInitLatch=java.util.concurrent.CountDownLatch@5aeef4a6[Count = 1], stopping=false, clientPool=null, nioSrvWrapper=null, stateProvider=null], evtSpi=MemoryEventStorageSpi [expireAgeMs=9223372036854775807, expireCnt=10000, filter=null], colSpi=NoopCollisionSpi [], deploySpi=LocalDeploymentSpi [], indexingSpi=org.apache.ignite.spi.indexing.noop.NoopIndexingSpi@34af0001, addrRslvr=null, encryptionSpi=org.apache.ignite.spi.encryption.keystore.KeystoreEncryptionSpi@7ce50a3d, tracingSpi=org.apache.ignite.spi.tracing.NoopTracingSpi@4f1be102, clientMode=false, rebalanceThreadPoolSize=4, rebalanceTimeout=10000, rebalanceBatchesPrefetchCnt=3, rebalanceThrottle=0, rebalanceBatchSize=524288, txCfg=TransactionConfiguration [txSerEnabled=false, dfltIsolation=REPEATABLE_READ, dfltConcurrency=PESSIMISTIC, dfltTxTimeout=0, txTimeoutOnPartitionMapExchange=0, deadlockTimeout=10000, pessimisticTxLogSize=0, pessimisticTxLogLinger=10000, tmLookupClsName=null, txManagerFactory=null, useJtaSync=false], cacheSanityCheckEnabled=true, discoStartupDelay=60000, deployMode=SHARED, p2pMissedCacheSize=100, locHost=127.0.0.1, timeSrvPortBase=31100, timeSrvPortRange=100, failureDetectionTimeout=10000, sysWorkerBlockedTimeout=null, clientFailureDetectionTimeout=10000, metricsLogFreq=0, connectorCfg=null, odbcCfg=null, warmupClos=null, atomicCfg=AtomicConfiguration [seqReserveSize=1000, cacheMode=PARTITIONED, backups=1, aff=null, grpName=null], classLdr=null, sslCtxFactory=null, platformCfg=null, binaryCfg=null, memCfg=null, pstCfg=null, dsCfg=DataStorageConfiguration [sysRegionInitSize=41943040, sysRegionMaxSize=104857600, pageSize=4096, concLvl=0, dfltDataRegConf=DataRegionConfiguration [name=default, maxSize=10485760, initSize=268435456, swapPath=null, pageEvictionMode=DISABLED, pageReplacementMode=CLOCK, evictionThreshold=0.9, emptyPagesPoolSize=100, metricsEnabled=false, metricsSubIntervalCount=5, metricsRateTimeInterval=60000, persistenceEnabled=true, checkpointPageBufSize=0, lazyMemoryAllocation=true, warmUpCfg=null], dataRegions=null, storagePath=null, checkpointFreq=180000, lockWaitTime=10000, checkpointThreads=4, checkpointWriteOrder=SEQUENTIAL, walHistSize=20, maxWalArchiveSize=1073741824, walSegments=10, walSegmentSize=67108864, walPath=db/wal, walArchivePath=db/wal/archive, cdcWalPath=db/wal/cdc, cdcEnabled=false, metricsEnabled=false, walMode=FSYNC, walTlbSize=131072, walBuffSize=0, walFlushFreq=2000, walFsyncDelay=1000, walRecordIterBuffSize=67108864, alwaysWriteFullPages=false, fileIOFactory=org.apache.ignite.internal.processors.cache.persistence.file.AsyncFileIOFactory@721b06d2, metricsSubIntervalCnt=5, metricsRateTimeInterval=60000, walAutoArchiveAfterInactivity=-1, walForceArchiveTimeout=-1, writeThrottlingEnabled=false, walCompactionEnabled=false, walCompactionLevel=1, checkpointReadLockTimeout=null, walPageCompression=DISABLED, walPageCompressionLevel=null, dfltWarmUpCfg=null, encCfg=org.apache.ignite.configuration.EncryptionConfiguration@4c6c5496, defragmentationThreadPoolSize=4, minWalArchiveSize=-1], snapshotPath=snapshots, activeOnStart=true, activeOnStartPropSetFlag=false, autoActivation=true, autoActivationPropSetFlag=false, clusterStateOnStart=null, sqlConnCfg=null, cliConnCfg=ClientConnectorConfiguration [host=null, port=10800, portRange=100, sockSndBufSize=0, sockRcvBufSize=0, tcpNoDelay=true, maxOpenCursorsPerConn=128, threadPoolSize=24, selectorCnt=12, idleTimeout=0, handshakeTimeout=10000, jdbcEnabled=true, odbcEnabled=true, thinCliEnabled=true, sslEnabled=false, useIgniteSslCtxFactory=true, sslClientAuth=false, sslCtxFactory=null, thinCliCfg=ThinClientConfiguration [maxActiveTxPerConn=100, maxActiveComputeTasksPerConn=0]], mvccVacuumThreadCnt=2, mvccVacuumFreq=5000, authEnabled=false, failureHnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]], commFailureRslvr=null, sqlCfg=SqlConfiguration [longQryWarnTimeout=3000, dfltQryTimeout=0, sqlQryHistSize=1000, validationEnabled=false], asyncContinuationExecutor=null] [21:03:42] : [Step 4/5] [2021-11-19 21:03:42,659][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][IgniteKernal%grid-0] Daemon mode: off [21:03:42] : [Step 4/5] [2021-11-19 21:03:42,659][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][IgniteKernal%grid-0] OS: Linux 4.15.0-151-generic amd64 [21:03:42] : [Step 4/5] [2021-11-19 21:03:42,659][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][IgniteKernal%grid-0] OS user: teamcity [21:03:42] : [Step 4/5] [2021-11-19 21:03:42,660][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][IgniteKernal%grid-0] PID: 16724 [21:03:42] : [Step 4/5] [2021-11-19 21:03:42,660][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][IgniteKernal%grid-0] Language runtime: Java Platform API Specification ver. 1.8 [21:03:42] : [Step 4/5] [2021-11-19 21:03:42,660][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][IgniteKernal%grid-0] VM information: Java(TM) SE Runtime Environment 1.8.0_261-b12 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 25.261-b12 [21:03:42] : [Step 4/5] [2021-11-19 21:03:42,661][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][IgniteKernal%grid-0] VM total memory: 1.9GB [21:03:42] : [Step 4/5] [2021-11-19 21:03:42,661][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][IgniteKernal%grid-0] Remote Management [restart: off, REST: off, JMX (remote: off)] [21:03:42] : [Step 4/5] [2021-11-19 21:03:42,661][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][IgniteKernal%grid-0] Logger: GridTestLog4jLogger [quiet=false, config=null] [21:03:42] : [Step 4/5] [2021-11-19 21:03:42,662][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][IgniteKernal%grid-0] IGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c [21:03:42] : [Step 4/5] [2021-11-19 21:03:42,662][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][IgniteKernal%grid-0] VM arguments: [-DIGNITE_DUMP_THREADS_ON_FAILURE=false, -DMono=/usr/bin/mono-sgen, -DMono4.0_x64=/usr/lib/mono/4.0, -DMono4.5_x64=/usr/lib/mono/4.5, -DMonoVersion=6.12.0.90, -DSKIP_BUILD=false, -Dagent.home.dir=/opt/buildagent, -Dagent.name=aitc-lin02_03, -Dagent.ownPort=9090, -Dagent.work.dir=/opt/buildagent/work, -Dbuild.number=95, -Dbuild.vcs.number=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.1=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.GitHubApacheIgnite=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dclassworlds.conf=/opt/buildagent/temp/buildTmp/teamcity.m2.conf, -Dcom.jetbrains.maven.watcher.report.file=/opt/buildagent/temp/buildTmp/maven-build-info.xml, -Djava.io.tmpdir=/opt/buildagent/temp/buildTmp, -Dmaven.home=/opt/buildagent/tools/maven3_6, -Dmaven.multiModuleProjectDirectory=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.agent.cpuBenchmark=457, -Dteamcity.agent.dotnet.agent_url=http://localhost:9090/RPC2, -Dteamcity.agent.dotnet.build_id=6278078, -Dteamcity.auth.password=*******, -Dteamcity.auth.userId=TeamCityBuildId=6278078, -Dteamcity.build.changedFiles.file=/opt/buildagent/temp/buildTmp/changedFiles6342607772318147725.txt, -Dteamcity.build.checkoutDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.build.id=6278078, -Dteamcity.build.properties.file=/opt/buildagent/temp/buildTmp/teamcity.build5164517880467851002.properties, -Dteamcity.build.tempDir=/opt/buildagent/temp/buildTmp, -Dteamcity.build.workingDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.buildConfName=Basic 3, -Dteamcity.buildType.id=IgniteTests24Java8_Basic3, -Dteamcity.configuration.properties.file=/opt/buildagent/temp/buildTmp/teamcity.config5591980786735343870.properties, -Dteamcity.maven.userSettings.path=/opt/buildagent/temp/buildTmp/maven_settings_585072866407032347.xml, -Dteamcity.maven.watcher.home=/opt/buildagent/plugins/mavenPlugin/maven-watcher-jdk16, -Dteamcity.projectName=Ignite Tests 2.x (JDK 8/11), -Dteamcity.runner.properties.file=/opt/buildagent/temp/buildTmp/teamcity.runner9098465561618137420.properties, -Dteamcity.tests.recentlyFailedTests.file=/opt/buildagent/temp/buildTmp/testsToRunFirst3891775683130404069.txt, -Dteamcity.version=2021.2 (build 99542), -ea, -Xms2g, -Xmx2g, -XX:+HeapDumpOnOutOfMemoryError, -DIGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_TEST_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_UPDATE_NOTIFIER=false, -DIGNITE_NO_DISCO_ORDER=true, -DIGNITE_PERFORMANCE_SUGGESTIONS_DISABLED=true, -Djava.net.preferIPv4Stack=true, -DTEST_SCALE_FACTOR=1.0, -DIGNITE_TEST_PROP_LOG4J_FILE=log4j-tc-test.xml, -DIGNITE_QUIET=false, -DIGNITE_MARSHAL_BUFFERS_RECHECK=1000, -Dmaven.repo.local=/opt/buildagent/.m2/repository] [21:03:42] : [Step 4/5] [2021-11-19 21:03:42,665][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][IgniteKernal%grid-0] System cache's DataRegion size is configured to 40 MB. Use DataStorageConfiguration.systemRegionInitialSize property to change the setting. [21:03:42] : [Step 4/5] [2021-11-19 21:03:42,666][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][IgniteKernal%grid-0] Configured caches [in 'sysMemPlc' dataRegion: ['ignite-sys-cache']] [21:03:42]W: [org.apache.ignite:ignite-core] [2021-11-19 21:03:42,666][WARN ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][IgniteKernal%grid-0] Peer class loading is enabled (disable it in production for performance and deployment consistency reasons) [21:03:42] : [Step 4/5] [2021-11-19 21:03:42,666][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][IgniteKernal%grid-0] 3-rd party licenses can be found at: /opt/buildagent/work/7bc1c54bc719b67c/libs/licenses [21:03:42] : [Step 4/5] [2021-11-19 21:03:42,673][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][IgnitePluginProcessor] Configured plugins: [21:03:42] : [Step 4/5] [2021-11-19 21:03:42,673][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][IgnitePluginProcessor] ^-- StanByClusterTestProvider 1.0 [21:03:42] : [Step 4/5] [2021-11-19 21:03:42,674][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][IgnitePluginProcessor] ^-- null [21:03:42] : [Step 4/5] [2021-11-19 21:03:42,674][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][IgnitePluginProcessor] [21:03:42] : [Step 4/5] [2021-11-19 21:03:42,674][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][IgnitePluginProcessor] ^-- PageMemory tracker plugin 1.0 [21:03:42] : [Step 4/5] [2021-11-19 21:03:42,674][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][IgnitePluginProcessor] ^-- null [21:03:42] : [Step 4/5] [2021-11-19 21:03:42,674][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][IgnitePluginProcessor] [21:03:42] : [Step 4/5] [2021-11-19 21:03:42,675][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][IgnitePluginProcessor] ^-- TestDistibutedConfigurationPlugin 1.0 [21:03:42] : [Step 4/5] [2021-11-19 21:03:42,675][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][IgnitePluginProcessor] ^-- null [21:03:42] : [Step 4/5] [2021-11-19 21:03:42,675][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][IgnitePluginProcessor] [21:03:42] : [Step 4/5] [2021-11-19 21:03:42,675][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][IgnitePluginProcessor] ^-- NodeValidationPluginProvider 1.0 [21:03:42] : [Step 4/5] [2021-11-19 21:03:42,675][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][IgnitePluginProcessor] ^-- null [21:03:42] : [Step 4/5] [2021-11-19 21:03:42,676][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][IgnitePluginProcessor] [21:03:42] : [Step 4/5] [2021-11-19 21:03:42,676][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][FailureProcessor] Configured failure handler: [hnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]]] [21:03:42] : [Step 4/5] [2021-11-19 21:03:42,702][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][TcpCommunicationSpi] Successfully bound communication NIO server to TCP port [port=45110, locHost=/127.0.0.1, selectorsCnt=12, selectorSpins=0, pairedConn=false] [21:03:42]W: [org.apache.ignite:ignite-core] [2021-11-19 21:03:42,703][WARN ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][TcpCommunicationSpi] Message queue limit is set to 0 which may lead to potential OOMEs when running cache operations in FULL_ASYNC or PRIMARY_SYNC modes due to message queues growth on sender and receiver sides. [21:03:42] : [Step 4/5] [2021-11-19 21:03:42,707][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][GridCollisionManager] Collision resolution is disabled (all jobs will be activated upon arrival). [21:03:42] : [Step 4/5] [2021-11-19 21:03:42,707][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][IgniteKernal%grid-0] Security status [authentication=off, sandbox=off, tls/ssl=off] [21:03:42] : [Step 4/5] [2021-11-19 21:03:42,775][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:03:42] : [Step 4/5] [2021-11-19 21:03:42,886][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][MaintenanceProcessor] Resolved store directory for node persistent data: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0 [21:03:42] : [Step 4/5] [2021-11-19 21:03:42,888][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][CacheObjectBinaryProcessorImpl] Resolved directory for serialized binary metadata: /opt/buildagent/work/7bc1c54bc719b67c/work/db/binary_meta/grid_0 [21:03:42] : [Step 4/5] [2021-11-19 21:03:42,895][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0 [21:03:42] : [Step 4/5] [2021-11-19 21:03:42,896][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][FileWriteAheadLogManager] Resolved write ahead log work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0 [21:03:42] : [Step 4/5] [2021-11-19 21:03:42,896][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][FileWriteAheadLogManager] Resolved write ahead log archive directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0 [21:03:42] : [Step 4/5] [2021-11-19 21:03:42,898][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000005.wal [21:03:42] : [Step 4/5] [2021-11-19 21:03:42,899][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000004.wal [21:03:42] : [Step 4/5] [2021-11-19 21:03:42,900][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000003.wal [21:03:42] : [Step 4/5] [2021-11-19 21:03:42,900][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000002.wal [21:03:42] : [Step 4/5] [2021-11-19 21:03:42,901][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000001.wal [21:03:42] : [Step 4/5] [2021-11-19 21:03:42,908][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][GridCacheDatabaseSharedManager] Configured data regions initialized successfully [total=5] [21:03:42] : [Step 4/5] [2021-11-19 21:03:42,910][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][IgniteSnapshotManager] Resolved snapshot work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/snapshots [21:03:42] : [Step 4/5] [2021-11-19 21:03:42,911][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][IgniteSnapshotManager] Resolved temp directory for snapshot creation: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0/snp [21:03:42] : [Step 4/5] [2021-11-19 21:03:42,914][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][ClientListenerProcessor] Client connector processor has started on TCP port 10800 [21:03:42] : [Step 4/5] [2021-11-19 21:03:42,922][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][IgniteKernal%grid-0] Non-loopback local IPs: 172.17.0.4 [21:03:42] : [Step 4/5] [2021-11-19 21:03:42,922][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][IgniteKernal%grid-0] Enabled local MACs: 0242AC110004 [21:03:42] : [Step 4/5] [2021-11-19 21:03:42,925][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=/opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0/cp/1637345022248-8d5e1fe4-b212-4800-bf67-1c00f9d623c0-START.bin, endMarker=/opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0/cp/1637345020124-4ef9a209-7ad1-4037-a425-e94430a1b66c-END.bin] [21:03:42] : [Step 4/5] [2021-11-19 21:03:42,927][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:03:42] : [Step 4/5] [2021-11-19 21:03:42,927][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=86983, len=1963], lastMarked=WALPointer [idx=0, fileOff=228995, len=11491], lastCheckpointId=8d5e1fe4-b212-4800-bf67-1c00f9d623c0] [21:03:43] : [Step 4/5] [2021-11-19 21:03:43,086][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][GridCacheDatabaseSharedManager] Found last checkpoint marker [cpId=8d5e1fe4-b212-4800-bf67-1c00f9d623c0, pos=WALPointer [idx=0, fileOff=228995, len=11491]] [21:03:43] : [Step 4/5] [2021-11-19 21:03:43,093][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][GridCacheDatabaseSharedManager] Applying lost metastore updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=228995, len=11491], lastCheckpointId=8d5e1fe4-b212-4800-bf67-1c00f9d623c0] [21:03:43] : [Step 4/5] [2021-11-19 21:03:43,156][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=61 ms] [21:03:43] : [Step 4/5] [2021-11-19 21:03:43,156][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][GridCacheProcessor] Restoring partition state for local groups. [21:03:43] : [Step 4/5] [2021-11-19 21:03:43,157][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=0, partitionsProcessed=0, time=0ms] [21:03:43] : [Step 4/5] [2021-11-19 21:03:43,314][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][GridClusterStateProcessor] Restoring history for BaselineTopology[id=0] [21:03:43] : [Step 4/5] [2021-11-19 21:03:43,326][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][ClusterProcessor] Cluster ID and tag has been read from metastorage: ClusterIdAndTag [id=b9c91f63-9430-4140-a4ff-30fa045d474b, tag=blissful_shaw] [21:03:43] : [Step 4/5] [2021-11-19 21:03:43,327][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][IgniteClusterImpl] Shutdown policy was updated [oldVal=null, newVal=null] [21:03:43] : [Step 4/5] [2021-11-19 21:03:43,328][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustEnabled' was changed from 'null' to 'false' [21:03:43] : [Step 4/5] [2021-11-19 21:03:43,328][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustTimeout' was changed from 'null' to '300000' [21:03:43] : [Step 4/5] [2021-11-19 21:03:43,329][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][IgniteTxManager] Transactions parameter 'txOwnerDumpRequestsAllowed' was changed from 'null' to 'true' [21:03:43] : [Step 4/5] [2021-11-19 21:03:43,329][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][IgniteTxManager] Transactions parameter 'longOperationsDumpTimeout' was changed from 'null' to '60000' [21:03:43] : [Step 4/5] [2021-11-19 21:03:43,330][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpThreshold' was changed from 'null' to '0' [21:03:43] : [Step 4/5] [2021-11-19 21:03:43,331][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][IgniteTxManager] Transactions parameter 'transactionTimeDumpSamplesCoefficient' was changed from 'null' to '0.0' [21:03:43] : [Step 4/5] [2021-11-19 21:03:43,331][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpSamplesPerSecondLimit' was changed from 'null' to '5' [21:03:43] : [Step 4/5] [2021-11-19 21:03:43,332][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][IgniteTxManager] Transactions parameter 'collisionsDumpInterval' was changed from 'null' to '1000' [21:03:43] : [Step 4/5] [2021-11-19 21:03:43,332][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][GridCacheDatabaseSharedManager] Historical rebalance WAL threshold changed [property=historical.rebalance.threshold, oldVal=null, newVal=500] [21:03:43] : [Step 4/5] [2021-11-19 21:03:43,333][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][GridCacheDatabaseSharedManager] Checkpoint frequency deviation changed [oldVal=null, newVal=null] [21:03:43] : [Step 4/5] [2021-11-19 21:03:43,334][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][FilePageStoreManager] Cleanup cache stores [total=1, left=0, cleanFiles=false] [21:03:43] : [Step 4/5] [2021-11-19 21:03:43,338][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:03:43] : [Step 4/5] [2021-11-19 21:03:43,339][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:03:43] : [Step 4/5] [2021-11-19 21:03:43,340][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:03:43] : [Step 4/5] [2021-11-19 21:03:43,341][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][GridCacheDatabaseSharedManager] Data Regions Started: 5 [21:03:43] : [Step 4/5] [2021-11-19 21:03:43,342][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][GridCacheDatabaseSharedManager] ^-- sysMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:03:43] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:03:43] : [Step 4/5] ^-- default region [type=default, persistence=true, lazyAlloc=true, [21:03:43] : [Step 4/5] ... initCfg=10MB, maxCfg=10MB, usedRam=0MB, freeRam=100%, allocRam=0MB, allocTotal=0MB] [21:03:43] : [Step 4/5] ^-- metastoreMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:03:43] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:03:43] : [Step 4/5] ^-- TxLog region [type=internal, persistence=true, lazyAlloc=false, [21:03:43] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:03:43] : [Step 4/5] ^-- volatileDsMemPlc region [type=user, persistence=false, lazyAlloc=true, [21:03:43] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB] [21:03:43] : [Step 4/5] ^-- Ignite persistence [used=0MB] [21:03:43] : [Step 4/5] [21:03:43] : [Step 4/5] [2021-11-19 21:03:43,344][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][GridCacheDatabaseSharedManager] Starting binary memory restore for: [-2100569601, 1613773252] [21:03:43] : [Step 4/5] [2021-11-19 21:03:43,405][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=/opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0/cp/1637345022248-8d5e1fe4-b212-4800-bf67-1c00f9d623c0-START.bin, endMarker=/opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0/cp/1637345020124-4ef9a209-7ad1-4037-a425-e94430a1b66c-END.bin] [21:03:43] : [Step 4/5] [2021-11-19 21:03:43,405][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=86983, len=1963], lastMarked=WALPointer [idx=0, fileOff=228995, len=11491], lastCheckpointId=8d5e1fe4-b212-4800-bf67-1c00f9d623c0] [21:03:43] : [Step 4/5] [2021-11-19 21:03:43,476][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][PageMemoryImpl] Started page memory [memoryAllocated=24.0 MiB, pages=5952, tableSize=474.2 KiB, replacementSize=768 B, checkpointBuffer=10.0 MiB] [21:03:43]W: [org.apache.ignite:ignite-core] [2021-11-19 21:03:43,475][WARN ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][GridCacheDatabaseSharedManager] Ignite node stopped in the middle of checkpoint. Will restore memory state and finish checkpoint on node start. [21:03:43] : [Step 4/5] [2021-11-19 21:03:43,603][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][GridCacheDatabaseSharedManager] Found last checkpoint marker [cpId=8d5e1fe4-b212-4800-bf67-1c00f9d623c0, pos=WALPointer [idx=0, fileOff=228995, len=11491]] [21:03:43] : [Step 4/5] [2021-11-19 21:03:43,609][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][GridCacheDatabaseSharedManager] Finished applying memory changes [changesApplied=51, time=131 ms] [21:03:43] : [Step 4/5] [2021-11-19 21:03:43,639][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][CheckpointWorkflow] Checkpoint finished [cpId=8d5e1fe4-b212-4800-bf67-1c00f9d623c0, pages=23, markPos=WALPointer [idx=0, fileOff=228995, len=11491], pagesWrite=3ms, fsync=10ms, total=13ms] [21:03:43] : [Step 4/5] [2021-11-19 21:03:43,641][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][GridCacheDatabaseSharedManager] Binary memory state restored at node startup [restoredPtr=WALPointer [idx=0, fileOff=240486, len=0]] [21:03:43] : [Step 4/5] [2021-11-19 21:03:43,642][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000000.wal, offset=240486, ver=2] [21:03:43] : [Step 4/5] [2021-11-19 21:03:43,647][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][GridCacheProcessor] Started cache in recovery mode [name=ignite-sys-cache, id=-2100569601, dataRegionName=sysMemPlc, mode=REPLICATED, atomicity=TRANSACTIONAL, backups=2147483647, mvcc=false] [21:03:43] : [Step 4/5] [2021-11-19 21:03:43,650][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][GridCacheProcessor] Started cache in recovery mode [name=encrypted, id=1613773252, dataRegionName=default, mode=PARTITIONED, atomicity=ATOMIC, backups=0, mvcc=false] [21:03:43] : [Step 4/5] [2021-11-19 21:03:43,651][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][GridCacheDatabaseSharedManager] Binary recovery performed in 307 ms. [21:03:43] : [Step 4/5] [2021-11-19 21:03:43,652][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=/opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0/cp/1637345022248-8d5e1fe4-b212-4800-bf67-1c00f9d623c0-START.bin, endMarker=/opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0/cp/1637345022248-8d5e1fe4-b212-4800-bf67-1c00f9d623c0-END.bin] [21:03:43] : [Step 4/5] [2021-11-19 21:03:43,653][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][GridCacheDatabaseSharedManager] Applying lost cache updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=228995, len=11491], lastCheckpointId=8d5e1fe4-b212-4800-bf67-1c00f9d623c0] [21:03:43] : [Step 4/5] [2021-11-19 21:03:43,729][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=71 ms] [21:03:43] : [Step 4/5] [2021-11-19 21:03:43,730][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][GridCacheProcessor] Restoring partition state for local groups. [21:03:43] : [Step 4/5] [2021-11-19 21:03:43,793][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=2, partitionsProcessed=1124, time=61ms] [21:03:44] : [Step 4/5] [2021-11-19 21:03:44,053][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][TestTcpDiscoverySpi] Successfully bound to TCP port [port=47500, localHost=localhost/127.0.0.1, locNodeId=00bde6fb-2506-4264-b60f-8d474f74e000] [21:03:44] : [Step 4/5] [2021-11-19 21:03:44,056][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][GridEncryptionManager] Sending stored group keys to coordinator [grps=1613773252] [21:03:44] : [Step 4/5] [2021-11-19 21:03:44,066][INFO ][disco-notifier-worker-#5652%grid-0%][MvccProcessorImpl] Assigned mvcc coordinator [crd=MvccCoordinator [topVer=AffinityTopologyVersion [topVer=1, minorTopVer=0], nodeId=00bde6fb-2506-4264-b60f-8d474f74e000, ver=1637345024058, local=true, initialized=false]] [21:03:44] : [Step 4/5] [2021-11-19 21:03:44,068][INFO ][sys-#5650%grid-0%][ClusterProcessor] Writing cluster ID and tag to metastorage on ready for write ClusterIdAndTag [id=b9c91f63-9430-4140-a4ff-30fa045d474b, tag=blissful_shaw] [21:03:44] : [Step 4/5] [2021-11-19 21:03:44,081][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][IgniteKernal%grid-0] To start Console Management & Monitoring run ignitevisorcmd.{sh|bat} [21:03:44] : [Step 4/5] [2021-11-19 21:03:44,082][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][IgniteKernal%grid-0] [21:03:44] : [Step 4/5] [21:03:44] : [Step 4/5] >>> +-------------------------------------------+ [21:03:44] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:03:44] : [Step 4/5] >>> +-------------------------------------------+ [21:03:44] : [Step 4/5] >>> OS name: Linux 4.15.0-151-generic amd64 [21:03:44] : [Step 4/5] >>> CPU(s): 24 [21:03:44] : [Step 4/5] >>> Heap: 2.0GB [21:03:44] : [Step 4/5] >>> VM name: 16724@c4dfe9a430b2 [21:03:44] : [Step 4/5] >>> Ignite instance name: grid-0 [21:03:44] : [Step 4/5] >>> Local node [ID=00BDE6FB-2506-4264-B60F-8D474F74E000, order=1, clientMode=false] [21:03:44] : [Step 4/5] >>> Local node addresses: [127.0.0.1] [21:03:44] : [Step 4/5] >>> Local ports: TCP:10800 TCP:45110 TCP:47500 [21:03:44] : [Step 4/5] [21:03:44] : [Step 4/5] [2021-11-19 21:03:44,083][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][IgniteKernal%grid-0] >>> Ignite cluster is in INACTIVE state (limited functionality available). Use control.(sh|bat) script or IgniteCluster.state(ClusterState.ACTIVE) to change the state. [21:03:44] : [Step 4/5] [2021-11-19 21:03:44,083][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][GridDiscoveryManager] Topology snapshot [ver=1, locNode=00bde6fb, servers=1, clients=0, state=INACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=00bde6fb-2506-4264-b60f-8d474f74e000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:03:44] : [Step 4/5] [2021-11-19 21:03:44,084][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][GridDiscoveryManager] ^-- Baseline [id=0, size=2, online=1, offline=1] [21:03:44] : [Step 4/5] [2021-11-19 21:03:44,084][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][GridDiscoveryManager] ^-- 1 nodes left for auto-activation [grid-1] [21:03:44] : [Step 4/5] [2021-11-19 21:03:44,085][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][G] Node started : [stage="Configure system pool" (0 ms),stage="Start managers" (237 ms),stage="Configure binary metadata" (3 ms),stage="Start processors" (30 ms),stage="Start 'StanByClusterTestProvider' plugin" (0 ms),stage="Start 'PageMemory tracker plugin' plugin" (0 ms),stage="Start 'TestDistibutedConfigurationPlugin' plugin" (0 ms),stage="Start 'NodeValidationPluginProvider' plugin" (0 ms),stage="Init metastore" (413 ms),stage="Init and start regions" (9 ms),stage="Restore binary memory" (307 ms),stage="Restore logical state" (142 ms),stage="Finish recovery" (258 ms),stage="Join topology" (14 ms),stage="Await transition" (2 ms),stage="Await exchange" (15 ms),stage="Total time" (1430 ms)] [21:03:44] : [Step 4/5] [2021-11-19 21:03:44,086][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][root] Node started with the following configuration [id=00bde6fb-2506-4264-b60f-8d474f74e000, marshaller=BinaryMarshaller [], discovery=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=5000, ackTimeout=5000, marsh=JdkMarshaller [clsFilter=org.apache.ignite.marshaller.MarshallerUtils$1@189cae2c], reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], binaryCfg=null, lateAff=true] [21:03:44]W: [org.apache.ignite:ignite-core] [2021-11-19 21:03:44,094][WARN ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][G] Ignite work directory is not provided, automatically resolved to: /opt/buildagent/work/7bc1c54bc719b67c/work [21:03:44] : [Step 4/5] [2021-11-19 21:03:44,096][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][IgniteKernal%grid-1] [21:03:44] : [Step 4/5] [21:03:44] : [Step 4/5] >>> __________ ________________ [21:03:44] : [Step 4/5] >>> / _/ ___/ |/ / _/_ __/ __/ [21:03:44] : [Step 4/5] >>> _/ // (7 7 // / / / / _/ [21:03:44] : [Step 4/5] >>> /___/\___/_/|_/___/ /_/ /___/ [21:03:44] : [Step 4/5] >>> [21:03:44] : [Step 4/5] >>> ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:03:44] : [Step 4/5] >>> 2021 Copyright(C) Apache Software Foundation [21:03:44] : [Step 4/5] >>> [21:03:44] : [Step 4/5] >>> Ignite documentation: http://ignite.apache.org [21:03:44] : [Step 4/5] [21:03:44] : [Step 4/5] [2021-11-19 21:03:44,096][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][IgniteKernal%grid-1] Config URL: n/a [21:03:44] : [Step 4/5] [2021-11-19 21:03:44,097][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][IgniteKernal%grid-1] IgniteConfiguration [igniteInstanceName=grid-1, pubPoolSize=24, svcPoolSize=24, callbackPoolSize=24, stripedPoolSize=24, sysPoolSize=24, mgmtPoolSize=4, dataStreamerPoolSize=24, utilityCachePoolSize=24, utilityCacheKeepAliveTime=60000, p2pPoolSize=2, qryPoolSize=24, buildIdxPoolSize=4, igniteHome=/opt/buildagent/work/7bc1c54bc719b67c, igniteWorkDir=/opt/buildagent/work/7bc1c54bc719b67c/work, mbeanSrv=com.sun.jmx.mbeanserver.JmxMBeanServer@6fe85038, nodeId=1087862b-8b5c-4256-8ece-aaea73502001, marsh=BinaryMarshaller [], marshLocJobs=false, daemon=false, p2pEnabled=true, netTimeout=10000, netCompressionLevel=1, sndRetryDelay=1000, sndRetryCnt=3, metricsHistSize=10000, metricsUpdateFreq=1000, metricsExpTime=9223372036854775807, discoSpi=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=0, ackTimeout=0, marsh=null, reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], segPlc=STOP, segResolveAttempts=2, waitForSegOnStart=true, allResolversPassReq=true, segChkFreq=10000, commSpi=TcpCommunicationSpi [connectGate=org.apache.ignite.spi.communication.tcp.internal.ConnectGateway@33f4de6d, ctxInitLatch=java.util.concurrent.CountDownLatch@68b79e01[Count = 1], stopping=false, clientPool=null, nioSrvWrapper=null, stateProvider=null], evtSpi=MemoryEventStorageSpi [expireAgeMs=9223372036854775807, expireCnt=10000, filter=null], colSpi=NoopCollisionSpi [], deploySpi=LocalDeploymentSpi [], indexingSpi=org.apache.ignite.spi.indexing.noop.NoopIndexingSpi@25d6af49, addrRslvr=null, encryptionSpi=org.apache.ignite.spi.encryption.keystore.KeystoreEncryptionSpi@7287ffd4, tracingSpi=org.apache.ignite.spi.tracing.NoopTracingSpi@2867ae56, clientMode=false, rebalanceThreadPoolSize=4, rebalanceTimeout=10000, rebalanceBatchesPrefetchCnt=3, rebalanceThrottle=0, rebalanceBatchSize=524288, txCfg=TransactionConfiguration [txSerEnabled=false, dfltIsolation=REPEATABLE_READ, dfltConcurrency=PESSIMISTIC, dfltTxTimeout=0, txTimeoutOnPartitionMapExchange=0, deadlockTimeout=10000, pessimisticTxLogSize=0, pessimisticTxLogLinger=10000, tmLookupClsName=null, txManagerFactory=null, useJtaSync=false], cacheSanityCheckEnabled=true, discoStartupDelay=60000, deployMode=SHARED, p2pMissedCacheSize=100, locHost=127.0.0.1, timeSrvPortBase=31100, timeSrvPortRange=100, failureDetectionTimeout=10000, sysWorkerBlockedTimeout=null, clientFailureDetectionTimeout=10000, metricsLogFreq=0, connectorCfg=null, odbcCfg=null, warmupClos=null, atomicCfg=AtomicConfiguration [seqReserveSize=1000, cacheMode=PARTITIONED, backups=1, aff=null, grpName=null], classLdr=null, sslCtxFactory=null, platformCfg=null, binaryCfg=null, memCfg=null, pstCfg=null, dsCfg=DataStorageConfiguration [sysRegionInitSize=41943040, sysRegionMaxSize=104857600, pageSize=4096, concLvl=0, dfltDataRegConf=DataRegionConfiguration [name=default, maxSize=10485760, initSize=268435456, swapPath=null, pageEvictionMode=DISABLED, pageReplacementMode=CLOCK, evictionThreshold=0.9, emptyPagesPoolSize=100, metricsEnabled=false, metricsSubIntervalCount=5, metricsRateTimeInterval=60000, persistenceEnabled=true, checkpointPageBufSize=0, lazyMemoryAllocation=true, warmUpCfg=null], dataRegions=null, storagePath=null, checkpointFreq=180000, lockWaitTime=10000, checkpointThreads=4, checkpointWriteOrder=SEQUENTIAL, walHistSize=20, maxWalArchiveSize=1073741824, walSegments=10, walSegmentSize=67108864, walPath=db/wal, walArchivePath=db/wal/archive, cdcWalPath=db/wal/cdc, cdcEnabled=false, metricsEnabled=false, walMode=FSYNC, walTlbSize=131072, walBuffSize=0, walFlushFreq=2000, walFsyncDelay=1000, walRecordIterBuffSize=67108864, alwaysWriteFullPages=false, fileIOFactory=org.apache.ignite.internal.processors.cache.persistence.file.AsyncFileIOFactory@5d466d49, metricsSubIntervalCnt=5, metricsRateTimeInterval=60000, walAutoArchiveAfterInactivity=-1, walForceArchiveTimeout=-1, writeThrottlingEnabled=false, walCompactionEnabled=false, walCompactionLevel=1, checkpointReadLockTimeout=null, walPageCompression=DISABLED, walPageCompressionLevel=null, dfltWarmUpCfg=null, encCfg=org.apache.ignite.configuration.EncryptionConfiguration@5df65e01, defragmentationThreadPoolSize=4, minWalArchiveSize=-1], snapshotPath=snapshots, activeOnStart=true, activeOnStartPropSetFlag=false, autoActivation=true, autoActivationPropSetFlag=false, clusterStateOnStart=null, sqlConnCfg=null, cliConnCfg=ClientConnectorConfiguration [host=null, port=10800, portRange=100, sockSndBufSize=0, sockRcvBufSize=0, tcpNoDelay=true, maxOpenCursorsPerConn=128, threadPoolSize=24, selectorCnt=12, idleTimeout=0, handshakeTimeout=10000, jdbcEnabled=true, odbcEnabled=true, thinCliEnabled=true, sslEnabled=false, useIgniteSslCtxFactory=true, sslClientAuth=false, sslCtxFactory=null, thinCliCfg=ThinClientConfiguration [maxActiveTxPerConn=100, maxActiveComputeTasksPerConn=0]], mvccVacuumThreadCnt=2, mvccVacuumFreq=5000, authEnabled=false, failureHnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]], commFailureRslvr=null, sqlCfg=SqlConfiguration [longQryWarnTimeout=3000, dfltQryTimeout=0, sqlQryHistSize=1000, validationEnabled=false], asyncContinuationExecutor=null] [21:03:44] : [Step 4/5] [2021-11-19 21:03:44,109][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][IgniteKernal%grid-1] Daemon mode: off [21:03:44] : [Step 4/5] [2021-11-19 21:03:44,109][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][IgniteKernal%grid-1] OS: Linux 4.15.0-151-generic amd64 [21:03:44] : [Step 4/5] [2021-11-19 21:03:44,109][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][IgniteKernal%grid-1] OS user: teamcity [21:03:44] : [Step 4/5] [2021-11-19 21:03:44,110][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][IgniteKernal%grid-1] PID: 16724 [21:03:44] : [Step 4/5] [2021-11-19 21:03:44,110][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][IgniteKernal%grid-1] Language runtime: Java Platform API Specification ver. 1.8 [21:03:44] : [Step 4/5] [2021-11-19 21:03:44,111][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][IgniteKernal%grid-1] VM information: Java(TM) SE Runtime Environment 1.8.0_261-b12 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 25.261-b12 [21:03:44] : [Step 4/5] [2021-11-19 21:03:44,111][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][IgniteKernal%grid-1] VM total memory: 1.9GB [21:03:44] : [Step 4/5] [2021-11-19 21:03:44,111][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][IgniteKernal%grid-1] Remote Management [restart: off, REST: off, JMX (remote: off)] [21:03:44] : [Step 4/5] [2021-11-19 21:03:44,112][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][IgniteKernal%grid-1] Logger: GridTestLog4jLogger [quiet=false, config=null] [21:03:44] : [Step 4/5] [2021-11-19 21:03:44,112][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][IgniteKernal%grid-1] IGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c [21:03:44] : [Step 4/5] [2021-11-19 21:03:44,113][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][IgniteKernal%grid-1] VM arguments: [-DIGNITE_DUMP_THREADS_ON_FAILURE=false, -DMono=/usr/bin/mono-sgen, -DMono4.0_x64=/usr/lib/mono/4.0, -DMono4.5_x64=/usr/lib/mono/4.5, -DMonoVersion=6.12.0.90, -DSKIP_BUILD=false, -Dagent.home.dir=/opt/buildagent, -Dagent.name=aitc-lin02_03, -Dagent.ownPort=9090, -Dagent.work.dir=/opt/buildagent/work, -Dbuild.number=95, -Dbuild.vcs.number=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.1=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.GitHubApacheIgnite=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dclassworlds.conf=/opt/buildagent/temp/buildTmp/teamcity.m2.conf, -Dcom.jetbrains.maven.watcher.report.file=/opt/buildagent/temp/buildTmp/maven-build-info.xml, -Djava.io.tmpdir=/opt/buildagent/temp/buildTmp, -Dmaven.home=/opt/buildagent/tools/maven3_6, -Dmaven.multiModuleProjectDirectory=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.agent.cpuBenchmark=457, -Dteamcity.agent.dotnet.agent_url=http://localhost:9090/RPC2, -Dteamcity.agent.dotnet.build_id=6278078, -Dteamcity.auth.password=*******, -Dteamcity.auth.userId=TeamCityBuildId=6278078, -Dteamcity.build.changedFiles.file=/opt/buildagent/temp/buildTmp/changedFiles6342607772318147725.txt, -Dteamcity.build.checkoutDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.build.id=6278078, -Dteamcity.build.properties.file=/opt/buildagent/temp/buildTmp/teamcity.build5164517880467851002.properties, -Dteamcity.build.tempDir=/opt/buildagent/temp/buildTmp, -Dteamcity.build.workingDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.buildConfName=Basic 3, -Dteamcity.buildType.id=IgniteTests24Java8_Basic3, -Dteamcity.configuration.properties.file=/opt/buildagent/temp/buildTmp/teamcity.config5591980786735343870.properties, -Dteamcity.maven.userSettings.path=/opt/buildagent/temp/buildTmp/maven_settings_585072866407032347.xml, -Dteamcity.maven.watcher.home=/opt/buildagent/plugins/mavenPlugin/maven-watcher-jdk16, -Dteamcity.projectName=Ignite Tests 2.x (JDK 8/11), -Dteamcity.runner.properties.file=/opt/buildagent/temp/buildTmp/teamcity.runner9098465561618137420.properties, -Dteamcity.tests.recentlyFailedTests.file=/opt/buildagent/temp/buildTmp/testsToRunFirst3891775683130404069.txt, -Dteamcity.version=2021.2 (build 99542), -ea, -Xms2g, -Xmx2g, -XX:+HeapDumpOnOutOfMemoryError, -DIGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_TEST_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_UPDATE_NOTIFIER=false, -DIGNITE_NO_DISCO_ORDER=true, -DIGNITE_PERFORMANCE_SUGGESTIONS_DISABLED=true, -Djava.net.preferIPv4Stack=true, -DTEST_SCALE_FACTOR=1.0, -DIGNITE_TEST_PROP_LOG4J_FILE=log4j-tc-test.xml, -DIGNITE_QUIET=false, -DIGNITE_MARSHAL_BUFFERS_RECHECK=1000, -Dmaven.repo.local=/opt/buildagent/.m2/repository] [21:03:44] : [Step 4/5] [2021-11-19 21:03:44,119][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][IgniteKernal%grid-1] System cache's DataRegion size is configured to 40 MB. Use DataStorageConfiguration.systemRegionInitialSize property to change the setting. [21:03:44] : [Step 4/5] [2021-11-19 21:03:44,120][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][IgniteKernal%grid-1] Configured caches [in 'sysMemPlc' dataRegion: ['ignite-sys-cache']] [21:03:44]W: [org.apache.ignite:ignite-core] [2021-11-19 21:03:44,120][WARN ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][IgniteKernal%grid-1] Peer class loading is enabled (disable it in production for performance and deployment consistency reasons) [21:03:44] : [Step 4/5] [2021-11-19 21:03:44,121][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][IgniteKernal%grid-1] 3-rd party licenses can be found at: /opt/buildagent/work/7bc1c54bc719b67c/libs/licenses [21:03:44] : [Step 4/5] [2021-11-19 21:03:44,127][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][IgnitePluginProcessor] Configured plugins: [21:03:44] : [Step 4/5] [2021-11-19 21:03:44,127][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][IgnitePluginProcessor] ^-- StanByClusterTestProvider 1.0 [21:03:44] : [Step 4/5] [2021-11-19 21:03:44,127][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][IgnitePluginProcessor] ^-- null [21:03:44] : [Step 4/5] [2021-11-19 21:03:44,128][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][IgnitePluginProcessor] [21:03:44] : [Step 4/5] [2021-11-19 21:03:44,128][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][IgnitePluginProcessor] ^-- PageMemory tracker plugin 1.0 [21:03:44] : [Step 4/5] [2021-11-19 21:03:44,128][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][IgnitePluginProcessor] ^-- null [21:03:44] : [Step 4/5] [2021-11-19 21:03:44,129][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][IgnitePluginProcessor] [21:03:44] : [Step 4/5] [2021-11-19 21:03:44,129][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][IgnitePluginProcessor] ^-- TestDistibutedConfigurationPlugin 1.0 [21:03:44] : [Step 4/5] [2021-11-19 21:03:44,129][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][IgnitePluginProcessor] ^-- null [21:03:44] : [Step 4/5] [2021-11-19 21:03:44,129][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][IgnitePluginProcessor] [21:03:44] : [Step 4/5] [2021-11-19 21:03:44,130][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][IgnitePluginProcessor] ^-- NodeValidationPluginProvider 1.0 [21:03:44] : [Step 4/5] [2021-11-19 21:03:44,130][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][IgnitePluginProcessor] ^-- null [21:03:44] : [Step 4/5] [2021-11-19 21:03:44,130][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][IgnitePluginProcessor] [21:03:44] : [Step 4/5] [2021-11-19 21:03:44,131][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][FailureProcessor] Configured failure handler: [hnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]]] [21:03:44] : [Step 4/5] [2021-11-19 21:03:44,150][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][TcpCommunicationSpi] Successfully bound communication NIO server to TCP port [port=45111, locHost=/127.0.0.1, selectorsCnt=12, selectorSpins=0, pairedConn=false] [21:03:44]W: [org.apache.ignite:ignite-core] [2021-11-19 21:03:44,150][WARN ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][TcpCommunicationSpi] Message queue limit is set to 0 which may lead to potential OOMEs when running cache operations in FULL_ASYNC or PRIMARY_SYNC modes due to message queues growth on sender and receiver sides. [21:03:44] : [Step 4/5] [2021-11-19 21:03:44,158][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][GridCollisionManager] Collision resolution is disabled (all jobs will be activated upon arrival). [21:03:44] : [Step 4/5] [2021-11-19 21:03:44,159][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][IgniteKernal%grid-1] Security status [authentication=off, sandbox=off, tls/ssl=off] [21:03:44] : [Step 4/5] [2021-11-19 21:03:44,227][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:03:44] : [Step 4/5] [2021-11-19 21:03:44,326][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][MaintenanceProcessor] Resolved store directory for node persistent data: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1 [21:03:44] : [Step 4/5] [2021-11-19 21:03:44,328][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][CacheObjectBinaryProcessorImpl] Resolved directory for serialized binary metadata: /opt/buildagent/work/7bc1c54bc719b67c/work/db/binary_meta/grid_1 [21:03:44] : [Step 4/5] [2021-11-19 21:03:44,345][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1 [21:03:44] : [Step 4/5] [2021-11-19 21:03:44,346][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][FileWriteAheadLogManager] Resolved write ahead log work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1 [21:03:44] : [Step 4/5] [2021-11-19 21:03:44,346][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][FileWriteAheadLogManager] Resolved write ahead log archive directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1 [21:03:44] : [Step 4/5] [2021-11-19 21:03:44,348][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000004.wal [21:03:44] : [Step 4/5] [2021-11-19 21:03:44,349][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000003.wal [21:03:44] : [Step 4/5] [2021-11-19 21:03:44,349][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000002.wal [21:03:44] : [Step 4/5] [2021-11-19 21:03:44,350][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000001.wal [21:03:44] : [Step 4/5] [2021-11-19 21:03:44,357][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][GridCacheDatabaseSharedManager] Configured data regions initialized successfully [total=5] [21:03:44] : [Step 4/5] [2021-11-19 21:03:44,358][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][IgniteSnapshotManager] Resolved snapshot work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/snapshots [21:03:44] : [Step 4/5] [2021-11-19 21:03:44,359][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][IgniteSnapshotManager] Resolved temp directory for snapshot creation: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1/snp [21:03:44] : [Step 4/5] [2021-11-19 21:03:44,362][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][ClientListenerProcessor] Client connector processor has started on TCP port 10801 [21:03:44] : [Step 4/5] [2021-11-19 21:03:44,365][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][IgniteKernal%grid-1] Non-loopback local IPs: 172.17.0.4 [21:03:44] : [Step 4/5] [2021-11-19 21:03:44,365][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][IgniteKernal%grid-1] Enabled local MACs: 0242AC110004 [21:03:44] : [Step 4/5] [2021-11-19 21:03:44,367][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=/opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1/cp/1637345021282-2980b722-2142-421f-a9e1-4558676204d1-START.bin, endMarker=/opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1/cp/1637345020128-2c613066-14b8-4e57-8c27-36d7de04d729-END.bin] [21:03:44] : [Step 4/5] [2021-11-19 21:03:44,368][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:03:44] : [Step 4/5] [2021-11-19 21:03:44,369][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=87147, len=1963], lastMarked=WALPointer [idx=0, fileOff=197369, len=11871], lastCheckpointId=2980b722-2142-421f-a9e1-4558676204d1] [21:03:44] : [Step 4/5] [2021-11-19 21:03:44,512][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][GridCacheDatabaseSharedManager] Found last checkpoint marker [cpId=2980b722-2142-421f-a9e1-4558676204d1, pos=WALPointer [idx=0, fileOff=197369, len=11871]] [21:03:44] : [Step 4/5] [2021-11-19 21:03:44,522][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][GridCacheDatabaseSharedManager] Applying lost metastore updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=197369, len=11871], lastCheckpointId=2980b722-2142-421f-a9e1-4558676204d1] [21:03:44] : [Step 4/5] [2021-11-19 21:03:44,596][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=70 ms] [21:03:44] : [Step 4/5] [2021-11-19 21:03:44,597][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][GridCacheProcessor] Restoring partition state for local groups. [21:03:44] : [Step 4/5] [2021-11-19 21:03:44,597][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=0, partitionsProcessed=0, time=0ms] [21:03:44] : [Step 4/5] [2021-11-19 21:03:44,727][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][GridClusterStateProcessor] Restoring history for BaselineTopology[id=0] [21:03:44] : [Step 4/5] [2021-11-19 21:03:44,731][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][ClusterProcessor] Cluster ID and tag has been read from metastorage: ClusterIdAndTag [id=b9c91f63-9430-4140-a4ff-30fa045d474b, tag=blissful_shaw] [21:03:44] : [Step 4/5] [2021-11-19 21:03:44,732][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][IgniteClusterImpl] Shutdown policy was updated [oldVal=null, newVal=null] [21:03:44] : [Step 4/5] [2021-11-19 21:03:44,732][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustEnabled' was changed from 'null' to 'false' [21:03:44] : [Step 4/5] [2021-11-19 21:03:44,733][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustTimeout' was changed from 'null' to '300000' [21:03:44] : [Step 4/5] [2021-11-19 21:03:44,733][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][IgniteTxManager] Transactions parameter 'txOwnerDumpRequestsAllowed' was changed from 'null' to 'true' [21:03:44] : [Step 4/5] [2021-11-19 21:03:44,734][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][IgniteTxManager] Transactions parameter 'longOperationsDumpTimeout' was changed from 'null' to '60000' [21:03:44] : [Step 4/5] [2021-11-19 21:03:44,734][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpThreshold' was changed from 'null' to '0' [21:03:44] : [Step 4/5] [2021-11-19 21:03:44,735][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][IgniteTxManager] Transactions parameter 'transactionTimeDumpSamplesCoefficient' was changed from 'null' to '0.0' [21:03:44] : [Step 4/5] [2021-11-19 21:03:44,735][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpSamplesPerSecondLimit' was changed from 'null' to '5' [21:03:44] : [Step 4/5] [2021-11-19 21:03:44,735][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][IgniteTxManager] Transactions parameter 'collisionsDumpInterval' was changed from 'null' to '1000' [21:03:44] : [Step 4/5] [2021-11-19 21:03:44,736][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][GridCacheDatabaseSharedManager] Historical rebalance WAL threshold changed [property=historical.rebalance.threshold, oldVal=null, newVal=500] [21:03:44] : [Step 4/5] [2021-11-19 21:03:44,736][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][GridCacheDatabaseSharedManager] Checkpoint frequency deviation changed [oldVal=null, newVal=null] [21:03:44] : [Step 4/5] [2021-11-19 21:03:44,737][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][FilePageStoreManager] Cleanup cache stores [total=1, left=0, cleanFiles=false] [21:03:44] : [Step 4/5] [2021-11-19 21:03:44,739][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:03:44] : [Step 4/5] [2021-11-19 21:03:44,740][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:03:44] : [Step 4/5] [2021-11-19 21:03:44,742][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:03:44] : [Step 4/5] [2021-11-19 21:03:44,742][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][GridCacheDatabaseSharedManager] Data Regions Started: 5 [21:03:44] : [Step 4/5] [2021-11-19 21:03:44,743][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][GridCacheDatabaseSharedManager] ^-- sysMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:03:44] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:03:44] : [Step 4/5] ^-- default region [type=default, persistence=true, lazyAlloc=true, [21:03:44] : [Step 4/5] ... initCfg=10MB, maxCfg=10MB, usedRam=0MB, freeRam=100%, allocRam=0MB, allocTotal=0MB] [21:03:44] : [Step 4/5] ^-- metastoreMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:03:44] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:03:44] : [Step 4/5] ^-- TxLog region [type=internal, persistence=true, lazyAlloc=false, [21:03:44] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:03:44] : [Step 4/5] ^-- volatileDsMemPlc region [type=user, persistence=false, lazyAlloc=true, [21:03:44] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB] [21:03:44] : [Step 4/5] ^-- Ignite persistence [used=0MB] [21:03:44] : [Step 4/5] [21:03:44] : [Step 4/5] [2021-11-19 21:03:44,744][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][GridCacheDatabaseSharedManager] Starting binary memory restore for: [-2100569601, 1613773252] [21:03:44] : [Step 4/5] [2021-11-19 21:03:44,819][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=/opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1/cp/1637345021282-2980b722-2142-421f-a9e1-4558676204d1-START.bin, endMarker=/opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1/cp/1637345020128-2c613066-14b8-4e57-8c27-36d7de04d729-END.bin] [21:03:44] : [Step 4/5] [2021-11-19 21:03:44,820][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=87147, len=1963], lastMarked=WALPointer [idx=0, fileOff=197369, len=11871], lastCheckpointId=2980b722-2142-421f-a9e1-4558676204d1] [21:03:44]W: [org.apache.ignite:ignite-core] [2021-11-19 21:03:44,873][WARN ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][GridCacheDatabaseSharedManager] Ignite node stopped in the middle of checkpoint. Will restore memory state and finish checkpoint on node start. [21:03:44] : [Step 4/5] [2021-11-19 21:03:44,874][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][PageMemoryImpl] Started page memory [memoryAllocated=24.0 MiB, pages=5952, tableSize=474.2 KiB, replacementSize=768 B, checkpointBuffer=10.0 MiB] [21:03:44] : [Step 4/5] [2021-11-19 21:03:44,949][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][GridCacheDatabaseSharedManager] Found last checkpoint marker [cpId=2980b722-2142-421f-a9e1-4558676204d1, pos=WALPointer [idx=0, fileOff=197369, len=11871]] [21:03:44] : [Step 4/5] [2021-11-19 21:03:44,954][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][GridCacheDatabaseSharedManager] Finished applying memory changes [changesApplied=27, time=81 ms] [21:03:44] : [Step 4/5] [2021-11-19 21:03:44,974][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][CheckpointWorkflow] Checkpoint finished [cpId=2980b722-2142-421f-a9e1-4558676204d1, pages=10, markPos=WALPointer [idx=0, fileOff=197369, len=11871], pagesWrite=-5ms, fsync=10ms, total=5ms] [21:03:44] : [Step 4/5] [2021-11-19 21:03:44,975][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][GridCacheDatabaseSharedManager] Binary memory state restored at node startup [restoredPtr=WALPointer [idx=0, fileOff=209240, len=0]] [21:03:44] : [Step 4/5] [2021-11-19 21:03:44,977][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000000.wal, offset=209240, ver=2] [21:03:44] : [Step 4/5] [2021-11-19 21:03:44,979][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][GridCacheProcessor] Started cache in recovery mode [name=ignite-sys-cache, id=-2100569601, dataRegionName=sysMemPlc, mode=REPLICATED, atomicity=TRANSACTIONAL, backups=2147483647, mvcc=false] [21:03:44] : [Step 4/5] [2021-11-19 21:03:44,984][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][GridCacheProcessor] Started cache in recovery mode [name=encrypted, id=1613773252, dataRegionName=default, mode=PARTITIONED, atomicity=ATOMIC, backups=0, mvcc=false] [21:03:44] : [Step 4/5] [2021-11-19 21:03:44,985][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][GridCacheDatabaseSharedManager] Binary recovery performed in 241 ms. [21:03:44] : [Step 4/5] [2021-11-19 21:03:44,986][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=/opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1/cp/1637345021282-2980b722-2142-421f-a9e1-4558676204d1-START.bin, endMarker=/opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1/cp/1637345021282-2980b722-2142-421f-a9e1-4558676204d1-END.bin] [21:03:44] : [Step 4/5] [2021-11-19 21:03:44,986][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][GridCacheDatabaseSharedManager] Applying lost cache updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=197369, len=11871], lastCheckpointId=2980b722-2142-421f-a9e1-4558676204d1] [21:03:45] : [Step 4/5] [2021-11-19 21:03:45,051][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=71 ms] [21:03:45] : [Step 4/5] [2021-11-19 21:03:45,051][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][GridCacheProcessor] Restoring partition state for local groups. [21:03:45] : [Step 4/5] [2021-11-19 21:03:45,113][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=2, partitionsProcessed=1124, time=61ms] [21:03:45] : [Step 4/5] [2021-11-19 21:03:45,385][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][TestTcpDiscoverySpi] Successfully bound to TCP port [port=47501, localHost=localhost/127.0.0.1, locNodeId=1087862b-8b5c-4256-8ece-aaea73502001] [21:03:45] : [Step 4/5] [2021-11-19 21:03:45,388][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][GridEncryptionManager] Sending stored group keys to coordinator [grps=1613773252] [21:03:45] : [Step 4/5] [2021-11-19 21:03:45,393][INFO ][tcp-disco-srvr-[:47500]-#279%grid-0%-#5654%grid-0%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=34889] [21:03:45] : [Step 4/5] [2021-11-19 21:03:45,393][INFO ][tcp-disco-srvr-[:47500]-#279%grid-0%-#5654%grid-0%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=34889] [21:03:45] : [Step 4/5] [2021-11-19 21:03:45,394][INFO ][tcp-disco-sock-reader-[]-#285%grid-0%-#5774%grid-0%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:34889, rmtPort=34889] [21:03:45] : [Step 4/5] [2021-11-19 21:03:45,397][INFO ][tcp-disco-sock-reader-[1087862b 127.0.0.1:34889]-#285%grid-0%-#5774%grid-0%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=1087862b-8b5c-4256-8ece-aaea73502001, rmtAddr=/127.0.0.1:34889] [21:03:45] : [Step 4/5] [2021-11-19 21:03:45,402][INFO ][tcp-disco-srvr-[:47501]-#284%grid-1%-#5773%grid-1%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=46693] [21:03:45] : [Step 4/5] [2021-11-19 21:03:45,403][INFO ][tcp-disco-srvr-[:47501]-#284%grid-1%-#5773%grid-1%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=46693] [21:03:45] : [Step 4/5] [2021-11-19 21:03:45,403][INFO ][tcp-disco-sock-reader-[]-#286%grid-1%-#5775%grid-1%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:46693, rmtPort=46693] [21:03:45] : [Step 4/5] [2021-11-19 21:03:45,404][INFO ][tcp-disco-sock-reader-[]-#286%grid-1%-#5775%grid-1%][TestTcpDiscoverySpi] Received ping request from the remote node [rmtNodeId=00bde6fb-2506-4264-b60f-8d474f74e000, rmtAddr=/127.0.0.1:46693, rmtPort=46693] [21:03:45] : [Step 4/5] [2021-11-19 21:03:45,406][INFO ][tcp-disco-sock-reader-[]-#286%grid-1%-#5775%grid-1%][TestTcpDiscoverySpi] Finished writing ping response [rmtNodeId=00bde6fb-2506-4264-b60f-8d474f74e000, rmtAddr=/127.0.0.1:46693, rmtPort=46693] [21:03:45] : [Step 4/5] [2021-11-19 21:03:45,406][INFO ][tcp-disco-sock-reader-[]-#286%grid-1%-#5775%grid-1%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:46693, rmtPort=46693, rmtNodeId=null] [21:03:45] : [Step 4/5] [2021-11-19 21:03:45,406][INFO ][tcp-disco-sock-reader-[1087862b 127.0.0.1:34889]-#285%grid-0%-#5774%grid-0%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:34889, rmtPort=34889, rmtNodeId=1087862b-8b5c-4256-8ece-aaea73502001] [21:03:45] : [Step 4/5] [2021-11-19 21:03:45,431][INFO ][tcp-disco-msg-worker-[crd]-#278%grid-0%-#5653%grid-0%][TestTcpDiscoverySpi] New next node [newNext=TcpDiscoveryNode [id=1087862b-8b5c-4256-8ece-aaea73502001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=0, intOrder=2, lastExchangeTime=1637345025393, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false]] [21:03:45] : [Step 4/5] [2021-11-19 21:03:45,432][INFO ][tcp-disco-srvr-[:47501]-#284%grid-1%-#5773%grid-1%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=56513] [21:03:45] : [Step 4/5] [2021-11-19 21:03:45,433][INFO ][tcp-disco-srvr-[:47501]-#284%grid-1%-#5773%grid-1%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=56513] [21:03:45] : [Step 4/5] [2021-11-19 21:03:45,434][INFO ][tcp-disco-sock-reader-[]-#287%grid-1%-#5776%grid-1%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:56513, rmtPort=56513] [21:03:45] : [Step 4/5] [2021-11-19 21:03:45,435][INFO ][tcp-disco-sock-reader-[00bde6fb 127.0.0.1:56513]-#287%grid-1%-#5776%grid-1%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=00bde6fb-2506-4264-b60f-8d474f74e000, rmtAddr=/127.0.0.1:56513] [21:03:45] : [Step 4/5] [2021-11-19 21:03:45,440][INFO ][tcp-disco-msg-worker-[]-#283%grid-1%-#5772%grid-1%][TestTcpDiscoverySpi] New next node [newNext=TcpDiscoveryNode [id=00bde6fb-2506-4264-b60f-8d474f74e000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345025434, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false]] [21:03:45] : [Step 4/5] [2021-11-19 21:03:45,441][INFO ][tcp-disco-srvr-[:47500]-#279%grid-0%-#5654%grid-0%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=39333] [21:03:45] : [Step 4/5] [2021-11-19 21:03:45,442][INFO ][tcp-disco-srvr-[:47500]-#279%grid-0%-#5654%grid-0%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=39333] [21:03:45] : [Step 4/5] [2021-11-19 21:03:45,443][INFO ][tcp-disco-sock-reader-[]-#288%grid-0%-#5777%grid-0%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:39333, rmtPort=39333] [21:03:45] : [Step 4/5] [2021-11-19 21:03:45,444][INFO ][tcp-disco-sock-reader-[1087862b 127.0.0.1:39333]-#288%grid-0%-#5777%grid-0%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=1087862b-8b5c-4256-8ece-aaea73502001, rmtAddr=/127.0.0.1:39333] [21:03:45] : [Step 4/5] [2021-11-19 21:03:45,448][INFO ][disco-event-worker-#5656%grid-0%][GridDiscoveryManager] Added new node to topology: TcpDiscoveryNode [id=1087862b-8b5c-4256-8ece-aaea73502001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637345025393, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false] [21:03:45] : [Step 4/5] [2021-11-19 21:03:45,449][INFO ][disco-event-worker-#5656%grid-0%][GridDiscoveryManager] Topology snapshot [ver=2, locNode=00bde6fb, servers=2, clients=0, state=INACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=00bde6fb-2506-4264-b60f-8d474f74e000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=1087862b-8b5c-4256-8ece-aaea73502001, consistentId=grid-1, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:03:45] : [Step 4/5] [2021-11-19 21:03:45,450][INFO ][disco-event-worker-#5656%grid-0%][GridDiscoveryManager] ^-- Baseline [id=0, size=2, online=2, offline=0] [21:03:45] : [Step 4/5] [2021-11-19 21:03:45,451][INFO ][disco-event-worker-#5656%grid-0%][GridDiscoveryManager] ^-- All baseline nodes are online, will start auto-activation [21:03:45] : [Step 4/5] [2021-11-19 21:03:45,455][INFO ][tcp-disco-msg-worker-[00bde6fb 127.0.0.1:47500]-#283%grid-1%-#5772%grid-1%][GridEncryptionManager] Skip group key received from coordinator. Already exists. [grp=1613773252, keyId=0] [21:03:45] : [Step 4/5] [2021-11-19 21:03:45,457][INFO ][disco-notifier-worker-#5771%grid-1%][MvccProcessorImpl] Assigned mvcc coordinator [crd=MvccCoordinator [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=0], nodeId=00bde6fb-2506-4264-b60f-8d474f74e000, ver=1637345024058, local=false, initialized=false]] [21:03:45] : [Step 4/5] [2021-11-19 21:03:45,458][INFO ][disco-notifier-worker-#5771%grid-1%][GridClusterStateProcessor] Sending activate cluster request with BaselineTopology BaselineTopology [id=0, branchingHash=-2475315501, branchingType='Cluster activation', baselineNodes=[grid-1, grid-0]] [21:03:45] : [Step 4/5] [2021-11-19 21:03:45,462][INFO ][sys-#5765%grid-1%][ClusterProcessor] Writing cluster ID and tag to metastorage on ready for write ClusterIdAndTag [id=b9c91f63-9430-4140-a4ff-30fa045d474b, tag=blissful_shaw] [21:03:45] : [Step 4/5] [2021-11-19 21:03:45,465][INFO ][disco-notifier-worker-#5652%grid-0%][GridClusterStateProcessor] Received activate cluster request with BaselineTopology[id=0] initiator node ID: 1087862b-8b5c-4256-8ece-aaea73502001 [21:03:45] : [Step 4/5] [2021-11-19 21:03:45,465][INFO ][disco-notifier-worker-#5652%grid-0%][GridClusterStateProcessor] Started state transition: activate cluster [21:03:45] : [Step 4/5] [2021-11-19 21:03:45,466][INFO ][exchange-worker-#5657%grid-0%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], crd=true, evt=DISCOVERY_CUSTOM_EVT, evtNode=1087862b-8b5c-4256-8ece-aaea73502001, customEvt=ChangeGlobalStateMessage [id=2151d593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqId=74ccf407-e9f8-433a-bddb-a85461a83aa9, initiatingNodeId=1087862b-8b5c-4256-8ece-aaea73502001, state=ACTIVE, baselineTopology=BaselineTopology [id=0, branchingHash=-2475315501, branchingType='Cluster activation', baselineNodes=[grid-1, grid-0]], forceChangeBaselineTopology=false, timestamp=1637345025458, forceDeactivation=true], allowMerge=false, exchangeFreeSwitch=false] [21:03:45] : [Step 4/5] [2021-11-19 21:03:45,467][INFO ][disco-notifier-worker-#5771%grid-1%][GridClusterStateProcessor] Received activate cluster request with BaselineTopology[id=0] initiator node ID: 1087862b-8b5c-4256-8ece-aaea73502001 [21:03:45] : [Step 4/5] [2021-11-19 21:03:45,467][INFO ][exchange-worker-#5657%grid-0%][GridDhtPartitionsExchangeFuture] Start activation process [nodeId=00bde6fb-2506-4264-b60f-8d474f74e000, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]]. New state: ACTIVE [21:03:45] : [Step 4/5] [2021-11-19 21:03:45,468][INFO ][disco-notifier-worker-#5771%grid-1%][GridClusterStateProcessor] Started state transition: activate cluster [21:03:45] : [Step 4/5] [2021-11-19 21:03:45,468][INFO ][exchange-worker-#5657%grid-0%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0 [21:03:45] : [Step 4/5] [2021-11-19 21:03:45,471][INFO ][exchange-worker-#5657%grid-0%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000000.wal, offset=240486, ver=2] [21:03:45] : [Step 4/5] [2021-11-19 21:03:45,475][INFO ][exchange-worker-#5657%grid-0%][GridClusterStateProcessor] Writing BaselineTopology[id=0] [21:03:45] : [Step 4/5] [2021-11-19 21:03:45,479][INFO ][exchange-worker-#5782%grid-1%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], crd=false, evt=DISCOVERY_CUSTOM_EVT, evtNode=1087862b-8b5c-4256-8ece-aaea73502001, customEvt=ChangeGlobalStateMessage [id=2151d593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqId=74ccf407-e9f8-433a-bddb-a85461a83aa9, initiatingNodeId=1087862b-8b5c-4256-8ece-aaea73502001, state=ACTIVE, baselineTopology=BaselineTopology [id=0, branchingHash=-2475315501, branchingType='Cluster activation', baselineNodes=[grid-1, grid-0]], forceChangeBaselineTopology=false, timestamp=1637345025458, forceDeactivation=true], allowMerge=false, exchangeFreeSwitch=false] [21:03:45] : [Step 4/5] [2021-11-19 21:03:45,480][INFO ][exchange-worker-#5782%grid-1%][GridDhtPartitionsExchangeFuture] Start activation process [nodeId=1087862b-8b5c-4256-8ece-aaea73502001, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]]. New state: ACTIVE [21:03:45] : [Step 4/5] [2021-11-19 21:03:45,481][INFO ][exchange-worker-#5782%grid-1%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1 [21:03:45] : [Step 4/5] [2021-11-19 21:03:45,493][INFO ][exchange-worker-#5657%grid-0%][GridCacheDatabaseSharedManager] Finish recovery performed in 24 ms. [21:03:45] : [Step 4/5] [2021-11-19 21:03:45,493][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][IgniteKernal%grid-1] To start Console Management & Monitoring run ignitevisorcmd.{sh|bat} [21:03:45] : [Step 4/5] [2021-11-19 21:03:45,494][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][IgniteKernal%grid-1] [21:03:45] : [Step 4/5] [21:03:45] : [Step 4/5] >>> +-------------------------------------------+ [21:03:45] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:03:45] : [Step 4/5] >>> +-------------------------------------------+ [21:03:45] : [Step 4/5] >>> OS name: Linux 4.15.0-151-generic amd64 [21:03:45] : [Step 4/5] >>> CPU(s): 24 [21:03:45] : [Step 4/5] >>> Heap: 2.0GB [21:03:45] : [Step 4/5] >>> VM name: 16724@c4dfe9a430b2 [21:03:45] : [Step 4/5] >>> Ignite instance name: grid-1 [21:03:45] : [Step 4/5] >>> Local node [ID=1087862B-8B5C-4256-8ECE-AAEA73502001, order=2, clientMode=false] [21:03:45] : [Step 4/5] >>> Local node addresses: [127.0.0.1] [21:03:45] : [Step 4/5] >>> Local ports: TCP:10801 TCP:45111 TCP:47501 [21:03:45] : [Step 4/5] [21:03:45] : [Step 4/5] [2021-11-19 21:03:45,495][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][GridDiscoveryManager] Topology snapshot [ver=2, locNode=1087862b, servers=2, clients=0, state=INACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=00bde6fb-2506-4264-b60f-8d474f74e000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=1087862b-8b5c-4256-8ece-aaea73502001, consistentId=grid-1, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:03:45] : [Step 4/5] [2021-11-19 21:03:45,495][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][GridDiscoveryManager] ^-- Baseline [id=0, size=2, online=2, offline=0] [21:03:45] : [Step 4/5] [2021-11-19 21:03:45,496][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][GridDiscoveryManager] ^-- All baseline nodes are online, will start auto-activation [21:03:45] : [Step 4/5] [2021-11-19 21:03:45,497][INFO ][exchange-worker-#5657%grid-0%][msg] Components activation performed in 29 ms. [21:03:45] : [Step 4/5] [2021-11-19 21:03:45,498][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][G] Node started : [stage="Configure system pool" (0 ms),stage="Start managers" (232 ms),stage="Configure binary metadata" (7 ms),stage="Start processors" (30 ms),stage="Start 'StanByClusterTestProvider' plugin" (0 ms),stage="Start 'PageMemory tracker plugin' plugin" (0 ms),stage="Start 'TestDistibutedConfigurationPlugin' plugin" (0 ms),stage="Start 'NodeValidationPluginProvider' plugin" (0 ms),stage="Init metastore" (372 ms),stage="Init and start regions" (6 ms),stage="Restore binary memory" (241 ms),stage="Restore logical state" (127 ms),stage="Finish recovery" (270 ms),stage="Join topology" (73 ms),stage="Await transition" (5 ms),stage="Await exchange" (35 ms),stage="Total time" (1398 ms)] [21:03:45] : [Step 4/5] [2021-11-19 21:03:45,499][INFO ][sys-#5646%grid-0%][GridCacheProcessor] Finished recovery for cache [cache=ignite-sys-cache, grp=ignite-sys-cache, startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:03:45] : [Step 4/5] [2021-11-19 21:03:45,499][INFO ][exchange-worker-#5657%grid-0%][GridCacheProcessor] Finished recovery for cache [cache=encrypted, grp=encrypted, startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:03:45] : [Step 4/5] [2021-11-19 21:03:45,498][INFO ][exchange-worker-#5782%grid-1%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000000.wal, offset=209240, ver=2] [21:03:45] : [Step 4/5] [2021-11-19 21:03:45,499][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][root] Node started with the following configuration [id=1087862b-8b5c-4256-8ece-aaea73502001, marshaller=BinaryMarshaller [], discovery=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=5000, ackTimeout=5000, marsh=JdkMarshaller [clsFilter=org.apache.ignite.marshaller.MarshallerUtils$1@138e65a0], reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], binaryCfg=null, lateAff=true] [21:03:45] : [Step 4/5] [2021-11-19 21:03:45,503][INFO ][exchange-worker-#5782%grid-1%][GridClusterStateProcessor] Writing BaselineTopology[id=0] [21:03:45] : [Step 4/5] [2021-11-19 21:03:45,504][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][GridClusterStateProcessor] Sending activate cluster request with BaselineTopology BaselineTopology [id=0, branchingHash=-2475315501, branchingType='Cluster activation', baselineNodes=[grid-1, grid-0]] [21:03:45]W: [org.apache.ignite:ignite-core] [2021-11-19 21:03:45,504][WARN ][sys-#5637%grid-0%][CacheAffinitySharedManager] Cache group 'encrypted' brings high overhead for its metainformation in data region 'default'. Metainformation required for its partitions (502 partitions, 4096 bytes per partition, 1 MBs total) will consume more than 15% of data region memory (10 MBs). It may lead to critical errors on the node and cluster instability. Please reduce number of partitions, add more memory to the data region or add more server nodes for this cache group. [21:03:45] : [Step 4/5] [2021-11-19 21:03:45,506][INFO ][exchange-worker-#5657%grid-0%][GridDhtPartitionsExchangeFuture] Successfully activated caches [nodeId=00bde6fb-2506-4264-b60f-8d474f74e000, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], newState=ACTIVE] [21:03:45]W: [org.apache.ignite:ignite-core] [2021-11-19 21:03:45,507][WARN ][exchange-worker-#5657%grid-0%][CacheAffinitySharedManager] Cache group 'encrypted' brings high overhead for its metainformation in data region 'default'. Metainformation required for its partitions (502 partitions, 4096 bytes per partition, 1 MBs total) will consume more than 15% of data region memory (10 MBs). It may lead to critical errors on the node and cluster instability. Please reduce number of partitions, add more memory to the data region or add more server nodes for this cache group. [21:03:45] : [Step 4/5] [2021-11-19 21:03:45,508][INFO ][exchange-worker-#5657%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:03:45] : [Step 4/5] [2021-11-19 21:03:45,506][INFO ][disco-notifier-worker-#5652%grid-0%][GridClusterStateProcessor] Received activate cluster request with BaselineTopology[id=0] initiator node ID: 00bde6fb-2506-4264-b60f-8d474f74e000 [21:03:45] : [Step 4/5] [2021-11-19 21:03:45,507][INFO ][disco-notifier-worker-#5771%grid-1%][GridClusterStateProcessor] Received activate cluster request with BaselineTopology[id=0] initiator node ID: 00bde6fb-2506-4264-b60f-8d474f74e000 [21:03:45] : [Step 4/5] [2021-11-19 21:03:45,516][INFO ][exchange-worker-#5782%grid-1%][GridCacheDatabaseSharedManager] Finish recovery performed in 34 ms. [21:03:45] : [Step 4/5] [2021-11-19 21:03:45,520][INFO ][exchange-worker-#5782%grid-1%][msg] Components activation performed in 39 ms. [21:03:45] : [Step 4/5] [2021-11-19 21:03:45,522][INFO ][sys-#5763%grid-1%][GridCacheProcessor] Finished recovery for cache [cache=ignite-sys-cache, grp=ignite-sys-cache, startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:03:45] : [Step 4/5] [2021-11-19 21:03:45,523][INFO ][exchange-worker-#5782%grid-1%][GridCacheProcessor] Finished recovery for cache [cache=encrypted, grp=encrypted, startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:03:45]W: [org.apache.ignite:ignite-core] [2021-11-19 21:03:45,526][WARN ][exchange-worker-#5782%grid-1%][CacheAffinitySharedManager] Cache group 'encrypted' brings high overhead for its metainformation in data region 'default'. Metainformation required for its partitions (522 partitions, 4096 bytes per partition, 2 MBs total) will consume more than 15% of data region memory (10 MBs). It may lead to critical errors on the node and cluster instability. Please reduce number of partitions, add more memory to the data region or add more server nodes for this cache group. [21:03:45] : [Step 4/5] [2021-11-19 21:03:45,527][INFO ][exchange-worker-#5782%grid-1%][GridDhtPartitionsExchangeFuture] Successfully activated caches [nodeId=1087862b-8b5c-4256-8ece-aaea73502001, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], newState=ACTIVE] [21:03:45]W: [org.apache.ignite:ignite-core] [2021-11-19 21:03:45,528][WARN ][exchange-worker-#5782%grid-1%][CacheAffinitySharedManager] Cache group 'encrypted' brings high overhead for its metainformation in data region 'default'. Metainformation required for its partitions (522 partitions, 4096 bytes per partition, 2 MBs total) will consume more than 15% of data region memory (10 MBs). It may lead to critical errors on the node and cluster instability. Please reduce number of partitions, add more memory to the data region or add more server nodes for this cache group. [21:03:45] : [Step 4/5] [2021-11-19 21:03:45,530][INFO ][exchange-worker-#5782%grid-1%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:03:45] : [Step 4/5] [2021-11-19 21:03:45,548][INFO ][db-checkpoint-thread-#5794%grid-1%][Checkpointer] Checkpoint started [checkpointId=3bf4bae3-fce8-4c51-bf9c-0c9906dee2fd, startPtr=WALPointer [idx=0, fileOff=292364, len=11887], checkpointBeforeLockTime=7ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=1ms, writeCheckpointEntryDuration=4ms, splitAndSortCpPagesDuration=1ms, pages=15, reason='node started'] [21:03:45] : [Step 4/5] [2021-11-19 21:03:45,549][INFO ][grid-nio-worker-tcp-comm-0-#5595%TcpCommunicationSpi%][TcpCommunicationSpi] Accepted incoming communication connection [locAddr=/127.0.0.1:45110, rmtAddr=/127.0.0.1:48036] [21:03:45] : [Step 4/5] [2021-11-19 21:03:45,555][INFO ][grid-nio-worker-tcp-comm-0-#5714%TcpCommunicationSpi%][TcpCommunicationSpi] Established outgoing communication connection [locAddr=/127.0.0.1:48036, rmtAddr=/127.0.0.1:45110] [21:03:45] : [Step 4/5] [2021-11-19 21:03:45,556][INFO ][exchange-worker-#5782%grid-1%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], crd=false] [21:03:45] : [Step 4/5] [2021-11-19 21:03:45,565][INFO ][exchange-worker-#5657%grid-0%][GridDhtPartitionsExchangeFuture] Coordinator received single message [ver=AffinityTopologyVersion [topVer=2, minorTopVer=1], node=1087862b-8b5c-4256-8ece-aaea73502001, allReceived=true] [21:03:45] : [Step 4/5] [2021-11-19 21:03:45,565][INFO ][exchange-worker-#5657%grid-0%][GridDhtPartitionsExchangeFuture] finishExchangeOnCoordinator [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:03:45] : [Step 4/5] [2021-11-19 21:03:45,568][INFO ][db-checkpoint-thread-#5794%grid-1%][Checkpointer] Checkpoint finished [cpId=3bf4bae3-fce8-4c51-bf9c-0c9906dee2fd, pages=15, markPos=WALPointer [idx=0, fileOff=292364, len=11887], walSegmentsCovered=[], markDuration=9ms, pagesWrite=15ms, fsync=3ms, total=34ms] [21:03:45] : [Step 4/5] [2021-11-19 21:03:45,576][INFO ][db-checkpoint-thread-#5788%grid-0%][Checkpointer] Checkpoint started [checkpointId=483b94ed-7928-44e2-9f62-41105da4a984, startPtr=WALPointer [idx=0, fileOff=327769, len=11507], checkpointBeforeLockTime=27ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=9ms, checkpointLockHoldTime=25ms, walCpRecordFsyncDuration=2ms, writeCheckpointEntryDuration=10ms, splitAndSortCpPagesDuration=0ms, pages=16, reason='node started'] [21:03:45] : [Step 4/5] [2021-11-19 21:03:45,586][INFO ][exchange-worker-#5657%grid-0%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], err=null, rebalanced=true, wasRebalanced=false] [21:03:45] : [Step 4/5] [2021-11-19 21:03:45,588][INFO ][sys-#5747%grid-1%][GridDhtPartitionsExchangeFuture] Received full message, will finish exchange [node=00bde6fb-2506-4264-b60f-8d474f74e000, resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:03:45] : [Step 4/5] [2021-11-19 21:03:45,586][INFO ][disco-notifier-worker-#5652%grid-0%][GridClusterStateProcessor] Received state change finish message: ACTIVE [21:03:45] : [Step 4/5] [2021-11-19 21:03:45,589][INFO ][disco-notifier-worker-#5771%grid-1%][GridClusterStateProcessor] Received state change finish message: ACTIVE [21:03:45] : [Step 4/5] [2021-11-19 21:03:45,592][INFO ][disco-notifier-worker-#5771%grid-1%][GridClusterStateProcessor] Cluster state was changed from INACTIVE to ACTIVE [21:03:45] : [Step 4/5] [2021-11-19 21:03:45,592][INFO ][disco-notifier-worker-#5652%grid-0%][GridClusterStateProcessor] Cluster state was changed from INACTIVE to ACTIVE [21:03:45] : [Step 4/5] [2021-11-19 21:03:45,596][INFO ][sys-#5747%grid-1%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], err=null, rebalanced=true, wasRebalanced=false] [21:03:45] : [Step 4/5] [2021-11-19 21:03:45,597][INFO ][sys-#5759%grid-1%][GridCachePartitionExchangeManager] Delay process full message without exchange id (there is exchange in progress) [nodeId=00bde6fb-2506-4264-b60f-8d474f74e000] [21:03:45] : [Step 4/5] [2021-11-19 21:03:45,597][INFO ][db-checkpoint-thread-#5788%grid-0%][Checkpointer] Checkpoint finished [cpId=483b94ed-7928-44e2-9f62-41105da4a984, pages=16, markPos=WALPointer [idx=0, fileOff=327769, len=11507], walSegmentsCovered=[], markDuration=38ms, pagesWrite=5ms, fsync=15ms, total=85ms] [21:03:45] : [Step 4/5] [2021-11-19 21:03:45,601][INFO ][exchange-worker-#5657%grid-0%][GridCacheProcessor] Finish proxy initialization, cacheName=ignite-sys-cache, localNodeId=00bde6fb-2506-4264-b60f-8d474f74e000 [21:03:45] : [Step 4/5] [2021-11-19 21:03:45,601][INFO ][exchange-worker-#5657%grid-0%][GridCacheProcessor] Finish proxy initialization, cacheName=encrypted, localNodeId=00bde6fb-2506-4264-b60f-8d474f74e000 [21:03:45] : [Step 4/5] [2021-11-19 21:03:45,602][INFO ][sys-#5630%grid-0%][DistributedBaselineConfiguration] Baseline auto-adjust is 'disabled' with timeout='300000' ms [21:03:45] : [Step 4/5] [2021-11-19 21:03:45,602][INFO ][sys-#5630%grid-0%][GridClusterStateProcessor] Successfully performed final activation steps [nodeId=00bde6fb-2506-4264-b60f-8d474f74e000, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:03:45] : [Step 4/5] [2021-11-19 21:03:45,602][INFO ][exchange-worker-#5657%grid-0%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=00bde6fb-2506-4264-b60f-8d474f74e000, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=1087862b-8b5c-4256-8ece-aaea73502001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637345025393, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:03:45] : [Step 4/5] [2021-11-19 21:03:45,607][INFO ][sys-#5747%grid-1%][GridCacheProcessor] Finish proxy initialization, cacheName=ignite-sys-cache, localNodeId=1087862b-8b5c-4256-8ece-aaea73502001 [21:03:45] : [Step 4/5] [2021-11-19 21:03:45,607][INFO ][exchange-worker-#5657%grid-0%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (1 ms), stage="Update caches registry" (31 ms), stage="Start caches" (1 ms), stage="Affinity initialization on cache group start" (5 ms), stage="Determine exchange type" (2 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Restore partition states" (0 ms), stage="After states restored callback" (55 ms), stage="WAL history reservation" (0 ms), stage="Waiting for all single messages" (0 ms), stage="Affinity recalculation (crd)" (0 ms), stage="Collect update counters and create affinity messages" (0 ms), stage="Assign partitions states" (4 ms), stage="Validate partitions states" (0 ms), stage="Ideal affinity diff calculation (enforced)" (4 ms), stage="Apply update counters" (2 ms), stage="Full message preparing" (6 ms), stage="Full message sending" (0 ms), stage="State finish message sending" (1 ms), stage="Detect lost partitions" (10 ms), stage="Exchange done" (9 ms), stage="Total time" (131 ms), Discovery lag=3 ms, Latest started node id=1087862b-8b5c-4256-8ece-aaea73502001] [21:03:45] : [Step 4/5] [2021-11-19 21:03:45,607][INFO ][sys-#5747%grid-1%][GridCacheProcessor] Finish proxy initialization, cacheName=encrypted, localNodeId=1087862b-8b5c-4256-8ece-aaea73502001 [21:03:45] : [Step 4/5] [2021-11-19 21:03:45,609][INFO ][exchange-worker-#5657%grid-0%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], stage="Affinity initialization on cache group start [grp=encrypted]" (3 ms) (parent=Affinity initialization on cache group start), stage="Affinity initialization on cache group start [grp=ignite-sys-cache]" (1 ms) (parent=Affinity initialization on cache group start), stage="Affinity centralized initialization (crd) [grp=ignite-sys-cache, crd=true]" (0 ms) (parent=Determine exchange type), stage="Affinity centralized initialization (crd) [grp=encrypted, crd=true]" (0 ms) (parent=Determine exchange type), stage="Restore partition states [grp=ignite-sys-cache]" (0 ms) (parent=Restore partition states), stage="Restore partition states [grp=encrypted]" (0 ms) (parent=Restore partition states), stage="Affinity recalculation (partitions availability) [grp=encrypted]" (4 ms) (parent=Ideal affinity diff calculation (enforced)), stage="Affinity recalculation (partitions availability) [grp=ignite-sys-cache]" (0 ms) (parent=Ideal affinity diff calculation (enforced))] [21:03:45] : [Step 4/5] [2021-11-19 21:03:45,611][INFO ][sys-#5760%grid-1%][DistributedBaselineConfiguration] Baseline auto-adjust is 'disabled' with timeout='300000' ms [21:03:45] : [Step 4/5] [2021-11-19 21:03:45,613][INFO ][sys-#5747%grid-1%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=1087862b-8b5c-4256-8ece-aaea73502001, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=1087862b-8b5c-4256-8ece-aaea73502001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637345025586, loc=true, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:03:45] : [Step 4/5] [2021-11-19 21:03:45,615][INFO ][sys-#5747%grid-1%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], stage="Waiting in exchange queue" (9 ms), stage="Exchange parameters initialization" (1 ms), stage="Update caches registry" (40 ms), stage="Start caches" (2 ms), stage="Affinity initialization on cache group start" (3 ms), stage="Determine exchange type" (2 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Restore partition states" (0 ms), stage="After states restored callback" (11 ms), stage="WAL history reservation" (0 ms), stage="Waiting for Full message" (45 ms), stage="Affinity recalculation" (3 ms), stage="Full map updating" (4 ms), stage="Detect lost partitions" (6 ms), stage="Exchange done" (11 ms), stage="Total time" (137 ms)] [21:03:45] : [Step 4/5] [2021-11-19 21:03:45,613][INFO ][exchange-worker-#5657%grid-0%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], crd=true] [21:03:45] : [Step 4/5] [2021-11-19 21:03:45,617][INFO ][sys-#5747%grid-1%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], stage="Affinity initialization on cache group start [grp=encrypted]" (2 ms) (parent=Affinity initialization on cache group start), stage="Affinity initialization on cache group start [grp=ignite-sys-cache]" (0 ms) (parent=Affinity initialization on cache group start), stage="Affinity centralized initialization (crd) [grp=ignite-sys-cache, crd=false]" (0 ms) (parent=Determine exchange type), stage="Affinity centralized initialization (crd) [grp=encrypted, crd=false]" (0 ms) (parent=Determine exchange type), stage="Restore partition states [grp=ignite-sys-cache]" (0 ms) (parent=Restore partition states), stage="Restore partition states [grp=encrypted]" (0 ms) (parent=Restore partition states), stage="Affinity applying from full message [grp=ignite-sys-cache]" (3 ms) (parent=Affinity recalculation), stage="Affinity applying from full message [grp=encrypted]" (3 ms) (parent=Affinity recalculation)] [21:03:45] : [Step 4/5] [2021-11-19 21:03:45,614][INFO ][exchange-worker-#5782%grid-1%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=2, minorTopVer=1], force=false, evt=DISCOVERY_CUSTOM_EVT, node=1087862b-8b5c-4256-8ece-aaea73502001] [21:03:45] : [Step 4/5] [2021-11-19 21:03:45,613][INFO ][sys-#5760%grid-1%][GridClusterStateProcessor] Successfully performed final activation steps [nodeId=1087862b-8b5c-4256-8ece-aaea73502001, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:03:45] : [Step 4/5] [2021-11-19 21:03:45,618][INFO ][exchange-worker-#5657%grid-0%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=2, minorTopVer=1], force=false, evt=DISCOVERY_CUSTOM_EVT, node=1087862b-8b5c-4256-8ece-aaea73502001] [21:03:45] : [Step 4/5] [2021-11-19 21:03:45,626][INFO ][test-runner-#5271%encryption.EncryptedCacheBigEntryTest%][root] awaitPartitionMapExchange finished [21:03:45] : [Step 4/5] [21:03:45] >>> Stopping test: EncryptedCacheBigEntryTest#testCreateEncryptedCacheWithBigEntry in 8194 ms <<< [21:03:45] : [Step 4/5] [2021-11-19 21:03:45,628][INFO ][main][root] >>> Stopping test: EncryptedCacheBigEntryTest#testCreateEncryptedCacheWithBigEntry in 8194 ms <<< [21:03:45] : [Step 4/5] [21:03:45] >>> Heap: 460 MB used / 1916 MB commited / 1916 MB max <<< [21:03:45] : [Step 4/5] [2021-11-19 21:03:45,629][INFO ][main][root] >>> Heap: 460 MB used / 1916 MB commited / 1916 MB max <<< [21:03:45] : [Step 4/5] [21:03:45] >>> Non-Heap: 129 MB used / 139 MB commited / 0 MB max <<< [21:03:45] : [Step 4/5] [2021-11-19 21:03:45,629][INFO ][main][root] >>> Non-Heap: 129 MB used / 139 MB commited / 0 MB max <<< [21:03:45] : [Step 4/5] [2021-11-19 21:03:45,629][INFO ][main][root] >>> Stopping grid [name=grid-1, id=1087862b-8b5c-4256-8ece-aaea73502001] [21:03:45] : [Step 4/5] [2021-11-19 21:03:45,645][INFO ][db-checkpoint-thread-#5794%grid-1%][Checkpointer] Skipping checkpoint (no pages were modified) [checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=1ms, checkpointLockHoldTime=2ms, reason='timeout'] [21:03:45] : [Step 4/5] [2021-11-19 21:03:45,648][INFO ][db-checkpoint-thread-#5794%grid-1%][Checkpointer] Skipping checkpoint (no pages were modified) [checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=1ms, reason='timeout'] [21:03:45] : [Step 4/5] [2021-11-19 21:03:45,664][INFO ][tcp-disco-sock-reader-[00bde6fb 127.0.0.1:56513]-#287%grid-1%-#5776%grid-1%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:56513, rmtPort=56513, rmtNodeId=00bde6fb-2506-4264-b60f-8d474f74e000] [21:03:45] : [Step 4/5] [2021-11-19 21:03:45,664][INFO ][disco-event-worker-#5656%grid-0%][GridDiscoveryManager] Node left topology: TcpDiscoveryNode [id=1087862b-8b5c-4256-8ece-aaea73502001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637345025393, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false] [21:03:45] : [Step 4/5] [2021-11-19 21:03:45,666][INFO ][main][GridCacheProcessor] Stopped cache [cacheName=encrypted] [21:03:45] : [Step 4/5] [2021-11-19 21:03:45,667][INFO ][main][GridCacheProcessor] Stopped cache [cacheName=ignite-sys-cache] [21:03:45] : [Step 4/5] [2021-11-19 21:03:45,667][INFO ][disco-event-worker-#5656%grid-0%][GridDiscoveryManager] Topology snapshot [ver=3, locNode=00bde6fb, servers=1, clients=0, state=ACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=00bde6fb-2506-4264-b60f-8d474f74e000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:03:45] : [Step 4/5] [2021-11-19 21:03:45,668][INFO ][disco-event-worker-#5656%grid-0%][GridDiscoveryManager] ^-- Baseline [id=0, size=2, online=1, offline=1] [21:03:45] : [Step 4/5] [2021-11-19 21:03:45,671][INFO ][exchange-worker-#5657%grid-0%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], crd=true, evt=NODE_LEFT, evtNode=1087862b-8b5c-4256-8ece-aaea73502001, customEvt=null, allowMerge=false, exchangeFreeSwitch=true] [21:03:45] : [Step 4/5] [2021-11-19 21:03:45,673][INFO ][sys-#5651%grid-0%][GridAffinityAssignmentCache] Local node affinity assignment distribution is not ideal [cache=encrypted, expectedPrimary=1024.00, actualPrimary=502, expectedBackups=0.00, actualBackups=0, warningThreshold=50.00%] [21:03:45] : [Step 4/5] [2021-11-19 21:03:45,674][INFO ][exchange-worker-#5657%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:03:45] : [Step 4/5] [2021-11-19 21:03:45,679][INFO ][exchange-worker-#5657%grid-0%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], err=null, rebalanced=true, wasRebalanced=true] [21:03:45]W: [org.apache.ignite:ignite-core] [2021-11-19 21:03:45,684][WARN ][sys-#5647%grid-0%][GridDhtPartitionTopologyImpl] Detected lost partitions [grp=encrypted, parts=[0, 2, 4, 6-7, 10-11, 14, 17, 21, 24-30, 32, 37, 40, 44, 47-52, 54, 57, 59, 62-64, 67-68, 74-75, 78, 81, 87-88, 91, 97, 99, 101-102, 104-107, 113-114, 116, 118, 120, 122, 124, 135-136, 138, 140-145, 147, 149-152, 154-156, 159-160, 162-164, 169, 172, 175-177, 180, 184-187, 190-191, 194, 196-202, 204-205, 209-210, 212, 214, 216, 219-224, 226, 229-232, 237, 239, 241, 243-245, 247, 249-251, 255, 257, 261, 265, 269, 272-273, 276-277, 281-282, 285, 287, 289-291, 293-297, 299, 301-304, 306, 308-309, 311-312, 315-317, 319, 322, 325-326, 328-330, 336, 339, 341, 344-346, 350, 352-354, 357-361, 363, 366-367, 371-373, 376-380, 383, 385, 387-388, 390, 392, 395-397, 400, 402, 405, 408-411, 416, 420, 422, 424-425, 429, 433, 435-438, 440-441, 445-446, 450, 452-453, 455-456, 458, 460, 462-463, 465-468, 470, 474-475, 480, 488, 490-492, 495, 497, 499-512, 516, 525, 527-531, 535, 537-538, 541-542, 545-546, 548-552, 554-555, 558, 562-564, 567-569, 572, 574, 579-580, 582-585, 587, 590-591, 594, 596, 600, 602, 604, 607-614, 617-620, 623-624, 627-629, 632-633, 636, 638, 640-642, 645-646, 648-649, 657-662, 664-665, 668-672, 677-678, 682-684, 686, 689, 692-693, 695-697, 699, 706-707, 709-710, 712-714, 716-717, 719-721, 723-728, 730-732, 734-735, 739, 742, 746, 749-750, 752, 754, 756, 762, 768-770, 772-775, 778, 780, 783-787, 789-791, 793, 796, 798-801, 803, 806, 809-812, 814, 816-817, 819, 822-825, 827-829, 832-833, 836-837, 839-840, 846, 848-851, 853-854, 857-858, 860, 863-864, 866, 868-871, 873-875, 877-878, 884, 888-889, 896-897, 900, 905-907, 914-915, 917, 919-920, 923-925, 931-933, 936, 940, 942, 944-945, 948, 950-951, 954, 956-958, 962, 965-970, 972, 975-976, 978-980, 983, 985, 988, 990, 993-994, 997-998, 1000, 1003-1004, 1007, 1009, 1014, 1016, 1018-1019], topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0]] [21:03:45] : [Step 4/5] [2021-11-19 21:03:45,691][INFO ][exchange-worker-#5657%grid-0%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=00bde6fb-2506-4264-b60f-8d474f74e000, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], evt=NODE_LEFT, evtNode=TcpDiscoveryNode [id=1087862b-8b5c-4256-8ece-aaea73502001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637345025393, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0]] [21:03:45] : [Step 4/5] [2021-11-19 21:03:45,693][INFO ][exchange-worker-#5657%grid-0%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (0 ms), stage="Determine exchange type" (2 ms), stage="Preloading notification" (0 ms), stage="After states restored callback" (0 ms), stage="WAL history reservation" (0 ms), stage="Finalize update counters" (2 ms), stage="Detect lost partitions" (10 ms), stage="Exchange done" (4 ms), stage="Total time" (18 ms)] [21:03:45] : [Step 4/5] [2021-11-19 21:03:45,694][INFO ][exchange-worker-#5657%grid-0%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], stage="Affinity initialization (exchange-free switch on fully-rebalanced topology) [grp=encrypted]" (2 ms) (parent=Determine exchange type), stage="Affinity initialization (exchange-free switch on fully-rebalanced topology) [grp=ignite-sys-cache]" (0 ms) (parent=Determine exchange type)] [21:03:45] : [Step 4/5] [2021-11-19 21:03:45,696][INFO ][exchange-worker-#5657%grid-0%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], crd=true] [21:03:45] : [Step 4/5] [2021-11-19 21:03:45,698][INFO ][exchange-worker-#5657%grid-0%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=3, minorTopVer=0], force=false, evt=NODE_LEFT, node=1087862b-8b5c-4256-8ece-aaea73502001] [21:03:46] : [Step 4/5] [2021-11-19 21:03:46,247][INFO ][main][FilePageStoreManager] Cleanup cache stores [total=4, left=0, cleanFiles=false] [21:03:46] : [Step 4/5] [2021-11-19 21:03:46,253][INFO ][main][GridDeploymentLocalStore] Removed undeployed class: GridDeployment [ts=1637345025576, depMode=SHARED, clsLdr=IsolatedClassLoader{roleName='test'}, clsLdrId=e451d593d71-1087862b-8b5c-4256-8ece-aaea73502001, userVer=0, loc=true, sampleClsName=org.apache.ignite.internal.processors.cache.distributed.dht.preloader.IgniteDhtPartitionHistorySuppliersMap, pendingUndeploy=false, undeployed=true, usage=0] [21:03:46] : [Step 4/5] [2021-11-19 21:03:46,280][INFO ][main][IgniteKernal%grid-1] [21:03:46] : [Step 4/5] [21:03:46] : [Step 4/5] >>> +------------------------------------------------------+ [21:03:46] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV stopped OK [21:03:46] : [Step 4/5] >>> +------------------------------------------------------+ [21:03:46] : [Step 4/5] >>> Ignite instance name: grid-1 [21:03:46] : [Step 4/5] >>> Grid uptime: 00:00:00.789 [21:03:46] : [Step 4/5] [21:03:46] : [Step 4/5] [21:03:46] : [Step 4/5] [2021-11-19 21:03:46,282][INFO ][main][root] >>> Stopping grid [name=grid-0, id=00bde6fb-2506-4264-b60f-8d474f74e000] [21:03:46] : [Step 4/5] [2021-11-19 21:03:46,303][INFO ][db-checkpoint-thread-#5788%grid-0%][Checkpointer] Skipping checkpoint (no pages were modified) [checkpointBeforeLockTime=4ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=2ms, checkpointLockHoldTime=3ms, reason='timeout'] [21:03:46] : [Step 4/5] [2021-11-19 21:03:46,318][INFO ][tcp-disco-sock-reader-[1087862b 127.0.0.1:39333]-#288%grid-0%-#5777%grid-0%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:39333, rmtPort=39333, rmtNodeId=1087862b-8b5c-4256-8ece-aaea73502001] [21:03:46] : [Step 4/5] [2021-11-19 21:03:46,321][INFO ][main][GridCacheProcessor] Stopped cache [cacheName=encrypted] [21:03:46] : [Step 4/5] [2021-11-19 21:03:46,321][INFO ][main][GridCacheProcessor] Stopped cache [cacheName=ignite-sys-cache] [21:03:46] : [Step 4/5] [2021-11-19 21:03:46,704][INFO ][main][FilePageStoreManager] Cleanup cache stores [total=4, left=0, cleanFiles=false] [21:03:46] : [Step 4/5] [2021-11-19 21:03:46,711][INFO ][main][GridDeploymentLocalStore] Removed undeployed class: GridDeployment [ts=1637345025556, depMode=SHARED, clsLdr=IsolatedClassLoader{roleName='test'}, clsLdrId=c451d593d71-00bde6fb-2506-4264-b60f-8d474f74e000, userVer=0, loc=true, sampleClsName=org.apache.ignite.internal.processors.cache.distributed.dht.preloader.GridDhtPartitionMap, pendingUndeploy=false, undeployed=true, usage=0] [21:03:46] : [Step 4/5] [2021-11-19 21:03:46,726][INFO ][main][IgniteKernal%grid-0] [21:03:46] : [Step 4/5] [21:03:46] : [Step 4/5] >>> +------------------------------------------------------+ [21:03:46] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV stopped OK [21:03:46] : [Step 4/5] >>> +------------------------------------------------------+ [21:03:46] : [Step 4/5] >>> Ignite instance name: grid-0 [21:03:46] : [Step 4/5] >>> Grid uptime: 00:00:02.642 [21:03:46] : [Step 4/5] [21:03:46] : [Step 4/5] [21:03:46] : [Step 4/5] [21:03:46] >>> Stopping test class: EncryptedCacheBigEntryTest <<< [21:03:46] : [Step 4/5] [2021-11-19 21:03:46,949][INFO ][main][root] >>> Stopping test class: EncryptedCacheBigEntryTest <<< [21:03:46] : [Step 4/5] [21:03:46] >>> Starting test class: EncryptedCacheCreateTest <<< [21:03:46] : [Step 4/5] [2021-11-19 21:03:46,950][INFO ][main][root] >>> Starting test class: EncryptedCacheCreateTest <<< [21:03:46] : [Step 4/5] Running org.apache.ignite.internal.encryption.EncryptedCacheCreateTest [21:03:46]i: [Step 4/5] ##teamcity[importData type='surefire' path='/opt/buildagent/temp/buildTmp/ignite-tools-junit-reports1777670380320881607/test-org.apache.ignite.testsuites.IgniteBasicWithPersistenceTestSuite1637345017431.xml'] [21:03:46] : [Step 4/5] Importing data from '/opt/buildagent/temp/buildTmp/ignite-tools-junit-reports1777670380320881607/test-org.apache.ignite.testsuites.IgniteBasicWithPersistenceTestSuite1637345017431.xml' (282 B) with 'surefire' processor [21:03:46] : [Step 4/5] [21:03:46] >>> Starting test: EncryptedCacheCreateTest#testPersistedContentEncrypted <<< [21:03:46] : [Step 4/5] [2021-11-19 21:03:46,965][INFO ][main][root] >>> Starting test: EncryptedCacheCreateTest#testPersistedContentEncrypted <<< [21:03:46] : [Step 4/5] [21:03:46] >>> Heap: 467 MB used / 1916 MB commited / 1916 MB max <<< [21:03:46] : [Step 4/5] [2021-11-19 21:03:46,965][INFO ][main][root] >>> Heap: 467 MB used / 1916 MB commited / 1916 MB max <<< [21:03:46] : [Step 4/5] [21:03:46] >>> Non-Heap: 130 MB used / 139 MB commited / 0 MB max <<< [21:03:46] : [Step 4/5] [2021-11-19 21:03:46,966][INFO ][main][root] >>> Non-Heap: 130 MB used / 139 MB commited / 0 MB max <<< [21:03:46]W: [org.apache.ignite:ignite-core] [2021-11-19 21:03:46,976][WARN ][main][G] Ignite work directory is not provided, automatically resolved to: /opt/buildagent/work/7bc1c54bc719b67c/work [21:03:46] : [Step 4/5] [2021-11-19 21:03:46,978][INFO ][main][EncryptedCacheCreateTest0] [21:03:46] : [Step 4/5] [21:03:46] : [Step 4/5] >>> __________ ________________ [21:03:46] : [Step 4/5] >>> / _/ ___/ |/ / _/_ __/ __/ [21:03:46] : [Step 4/5] >>> _/ // (7 7 // / / / / _/ [21:03:46] : [Step 4/5] >>> /___/\___/_/|_/___/ /_/ /___/ [21:03:46] : [Step 4/5] >>> [21:03:46] : [Step 4/5] >>> ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:03:46] : [Step 4/5] >>> 2021 Copyright(C) Apache Software Foundation [21:03:46] : [Step 4/5] >>> [21:03:46] : [Step 4/5] >>> Ignite documentation: http://ignite.apache.org [21:03:46] : [Step 4/5] [21:03:46] : [Step 4/5] [2021-11-19 21:03:46,978][INFO ][main][EncryptedCacheCreateTest0] Config URL: n/a [21:03:46] : [Step 4/5] [2021-11-19 21:03:46,979][INFO ][main][EncryptedCacheCreateTest0] IgniteConfiguration [igniteInstanceName=encryption.EncryptedCacheCreateTest0, pubPoolSize=24, svcPoolSize=24, callbackPoolSize=24, stripedPoolSize=24, sysPoolSize=24, mgmtPoolSize=4, dataStreamerPoolSize=24, utilityCachePoolSize=24, utilityCacheKeepAliveTime=60000, p2pPoolSize=2, qryPoolSize=24, buildIdxPoolSize=4, igniteHome=/opt/buildagent/work/7bc1c54bc719b67c, igniteWorkDir=/opt/buildagent/work/7bc1c54bc719b67c/work, mbeanSrv=com.sun.jmx.mbeanserver.JmxMBeanServer@6fe85038, nodeId=332f4457-a30f-4f84-b266-78c71e300000, marsh=BinaryMarshaller [], marshLocJobs=false, daemon=false, p2pEnabled=true, netTimeout=10000, netCompressionLevel=1, sndRetryDelay=1000, sndRetryCnt=3, metricsHistSize=10000, metricsUpdateFreq=1000, metricsExpTime=9223372036854775807, discoSpi=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=0, ackTimeout=0, marsh=null, reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], segPlc=STOP, segResolveAttempts=2, waitForSegOnStart=true, allResolversPassReq=true, segChkFreq=10000, commSpi=TcpCommunicationSpi [connectGate=org.apache.ignite.spi.communication.tcp.internal.ConnectGateway@34c70b5e, ctxInitLatch=java.util.concurrent.CountDownLatch@4f2d995e[Count = 1], stopping=false, clientPool=null, nioSrvWrapper=null, stateProvider=null], evtSpi=MemoryEventStorageSpi [expireAgeMs=9223372036854775807, expireCnt=10000, filter=null], colSpi=NoopCollisionSpi [], deploySpi=LocalDeploymentSpi [], indexingSpi=org.apache.ignite.spi.indexing.noop.NoopIndexingSpi@4ecd00b5, addrRslvr=null, encryptionSpi=org.apache.ignite.spi.encryption.keystore.KeystoreEncryptionSpi@10947c4e, tracingSpi=org.apache.ignite.spi.tracing.NoopTracingSpi@3667faa8, clientMode=false, rebalanceThreadPoolSize=4, rebalanceTimeout=10000, rebalanceBatchesPrefetchCnt=3, rebalanceThrottle=0, rebalanceBatchSize=524288, txCfg=TransactionConfiguration [txSerEnabled=false, dfltIsolation=REPEATABLE_READ, dfltConcurrency=PESSIMISTIC, dfltTxTimeout=0, txTimeoutOnPartitionMapExchange=0, deadlockTimeout=10000, pessimisticTxLogSize=0, pessimisticTxLogLinger=10000, tmLookupClsName=null, txManagerFactory=null, useJtaSync=false], cacheSanityCheckEnabled=true, discoStartupDelay=60000, deployMode=SHARED, p2pMissedCacheSize=100, locHost=127.0.0.1, timeSrvPortBase=31100, timeSrvPortRange=100, failureDetectionTimeout=10000, sysWorkerBlockedTimeout=null, clientFailureDetectionTimeout=10000, metricsLogFreq=0, connectorCfg=null, odbcCfg=null, warmupClos=null, atomicCfg=AtomicConfiguration [seqReserveSize=1000, cacheMode=PARTITIONED, backups=1, aff=null, grpName=null], classLdr=null, sslCtxFactory=null, platformCfg=null, binaryCfg=null, memCfg=null, pstCfg=null, dsCfg=DataStorageConfiguration [sysRegionInitSize=41943040, sysRegionMaxSize=104857600, pageSize=4096, concLvl=0, dfltDataRegConf=DataRegionConfiguration [name=default, maxSize=10485760, initSize=268435456, swapPath=null, pageEvictionMode=DISABLED, pageReplacementMode=CLOCK, evictionThreshold=0.9, emptyPagesPoolSize=100, metricsEnabled=false, metricsSubIntervalCount=5, metricsRateTimeInterval=60000, persistenceEnabled=true, checkpointPageBufSize=0, lazyMemoryAllocation=true, warmUpCfg=null], dataRegions=DataRegionConfiguration[] [DataRegionConfiguration [name=no-persistence-region, maxSize=10485760, initSize=268435456, swapPath=null, pageEvictionMode=DISABLED, pageReplacementMode=CLOCK, evictionThreshold=0.9, emptyPagesPoolSize=100, metricsEnabled=false, metricsSubIntervalCount=5, metricsRateTimeInterval=60000, persistenceEnabled=false, checkpointPageBufSize=0, lazyMemoryAllocation=true, warmUpCfg=null]], storagePath=null, checkpointFreq=180000, lockWaitTime=10000, checkpointThreads=4, checkpointWriteOrder=SEQUENTIAL, walHistSize=20, maxWalArchiveSize=1073741824, walSegments=10, walSegmentSize=67108864, walPath=db/wal, walArchivePath=db/wal/archive, cdcWalPath=db/wal/cdc, cdcEnabled=false, metricsEnabled=false, walMode=FSYNC, walTlbSize=131072, walBuffSize=0, walFlushFreq=2000, walFsyncDelay=1000, walRecordIterBuffSize=67108864, alwaysWriteFullPages=false, fileIOFactory=org.apache.ignite.internal.processors.cache.persistence.file.AsyncFileIOFactory@5cbd94b2, metricsSubIntervalCnt=5, metricsRateTimeInterval=60000, walAutoArchiveAfterInactivity=-1, walForceArchiveTimeout=-1, writeThrottlingEnabled=false, walCompactionEnabled=false, walCompactionLevel=1, checkpointReadLockTimeout=null, walPageCompression=DISABLED, walPageCompressionLevel=null, dfltWarmUpCfg=null, encCfg=org.apache.ignite.configuration.EncryptionConfiguration@6824b913, defragmentationThreadPoolSize=4, minWalArchiveSize=-1], snapshotPath=snapshots, activeOnStart=true, activeOnStartPropSetFlag=false, autoActivation=true, autoActivationPropSetFlag=false, clusterStateOnStart=null, sqlConnCfg=null, cliConnCfg=ClientConnectorConfiguration [host=null, port=10800, portRange=100, sockSndBufSize=0, sockRcvBufSize=0, tcpNoDelay=true, maxOpenCursorsPerConn=128, threadPoolSize=24, selectorCnt=12, idleTimeout=0, handshakeTimeout=10000, jdbcEnabled=true, odbcEnabled=true, thinCliEnabled=true, sslEnabled=false, useIgniteSslCtxFactory=true, sslClientAuth=false, sslCtxFactory=null, thinCliCfg=ThinClientConfiguration [maxActiveTxPerConn=100, maxActiveComputeTasksPerConn=0]], mvccVacuumThreadCnt=2, mvccVacuumFreq=5000, authEnabled=false, failureHnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]], commFailureRslvr=null, sqlCfg=SqlConfiguration [longQryWarnTimeout=3000, dfltQryTimeout=0, sqlQryHistSize=1000, validationEnabled=false], asyncContinuationExecutor=null] [21:03:46] : [Step 4/5] [2021-11-19 21:03:46,986][INFO ][main][EncryptedCacheCreateTest0] Daemon mode: off [21:03:46] : [Step 4/5] [2021-11-19 21:03:46,987][INFO ][main][EncryptedCacheCreateTest0] OS: Linux 4.15.0-151-generic amd64 [21:03:46] : [Step 4/5] [2021-11-19 21:03:46,987][INFO ][main][EncryptedCacheCreateTest0] OS user: teamcity [21:03:46] : [Step 4/5] [2021-11-19 21:03:46,987][INFO ][main][EncryptedCacheCreateTest0] PID: 16724 [21:03:46] : [Step 4/5] [2021-11-19 21:03:46,988][INFO ][main][EncryptedCacheCreateTest0] Language runtime: Java Platform API Specification ver. 1.8 [21:03:46] : [Step 4/5] [2021-11-19 21:03:46,988][INFO ][main][EncryptedCacheCreateTest0] VM information: Java(TM) SE Runtime Environment 1.8.0_261-b12 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 25.261-b12 [21:03:46] : [Step 4/5] [2021-11-19 21:03:46,988][INFO ][main][EncryptedCacheCreateTest0] VM total memory: 1.9GB [21:03:46] : [Step 4/5] [2021-11-19 21:03:46,988][INFO ][main][EncryptedCacheCreateTest0] Remote Management [restart: off, REST: off, JMX (remote: off)] [21:03:46] : [Step 4/5] [2021-11-19 21:03:46,988][INFO ][main][EncryptedCacheCreateTest0] Logger: GridTestLog4jLogger [quiet=false, config=null] [21:03:46] : [Step 4/5] [2021-11-19 21:03:46,989][INFO ][main][EncryptedCacheCreateTest0] IGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c [21:03:46] : [Step 4/5] [2021-11-19 21:03:46,989][INFO ][main][EncryptedCacheCreateTest0] VM arguments: [-DIGNITE_DUMP_THREADS_ON_FAILURE=false, -DMono=/usr/bin/mono-sgen, -DMono4.0_x64=/usr/lib/mono/4.0, -DMono4.5_x64=/usr/lib/mono/4.5, -DMonoVersion=6.12.0.90, -DSKIP_BUILD=false, -Dagent.home.dir=/opt/buildagent, -Dagent.name=aitc-lin02_03, -Dagent.ownPort=9090, -Dagent.work.dir=/opt/buildagent/work, -Dbuild.number=95, -Dbuild.vcs.number=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.1=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.GitHubApacheIgnite=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dclassworlds.conf=/opt/buildagent/temp/buildTmp/teamcity.m2.conf, -Dcom.jetbrains.maven.watcher.report.file=/opt/buildagent/temp/buildTmp/maven-build-info.xml, -Djava.io.tmpdir=/opt/buildagent/temp/buildTmp, -Dmaven.home=/opt/buildagent/tools/maven3_6, -Dmaven.multiModuleProjectDirectory=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.agent.cpuBenchmark=457, -Dteamcity.agent.dotnet.agent_url=http://localhost:9090/RPC2, -Dteamcity.agent.dotnet.build_id=6278078, -Dteamcity.auth.password=*******, -Dteamcity.auth.userId=TeamCityBuildId=6278078, -Dteamcity.build.changedFiles.file=/opt/buildagent/temp/buildTmp/changedFiles6342607772318147725.txt, -Dteamcity.build.checkoutDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.build.id=6278078, -Dteamcity.build.properties.file=/opt/buildagent/temp/buildTmp/teamcity.build5164517880467851002.properties, -Dteamcity.build.tempDir=/opt/buildagent/temp/buildTmp, -Dteamcity.build.workingDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.buildConfName=Basic 3, -Dteamcity.buildType.id=IgniteTests24Java8_Basic3, -Dteamcity.configuration.properties.file=/opt/buildagent/temp/buildTmp/teamcity.config5591980786735343870.properties, -Dteamcity.maven.userSettings.path=/opt/buildagent/temp/buildTmp/maven_settings_585072866407032347.xml, -Dteamcity.maven.watcher.home=/opt/buildagent/plugins/mavenPlugin/maven-watcher-jdk16, -Dteamcity.projectName=Ignite Tests 2.x (JDK 8/11), -Dteamcity.runner.properties.file=/opt/buildagent/temp/buildTmp/teamcity.runner9098465561618137420.properties, -Dteamcity.tests.recentlyFailedTests.file=/opt/buildagent/temp/buildTmp/testsToRunFirst3891775683130404069.txt, -Dteamcity.version=2021.2 (build 99542), -ea, -Xms2g, -Xmx2g, -XX:+HeapDumpOnOutOfMemoryError, -DIGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_TEST_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_UPDATE_NOTIFIER=false, -DIGNITE_NO_DISCO_ORDER=true, -DIGNITE_PERFORMANCE_SUGGESTIONS_DISABLED=true, -Djava.net.preferIPv4Stack=true, -DTEST_SCALE_FACTOR=1.0, -DIGNITE_TEST_PROP_LOG4J_FILE=log4j-tc-test.xml, -DIGNITE_QUIET=false, -DIGNITE_MARSHAL_BUFFERS_RECHECK=1000, -Dmaven.repo.local=/opt/buildagent/.m2/repository] [21:03:46] : [Step 4/5] [2021-11-19 21:03:46,993][INFO ][main][EncryptedCacheCreateTest0] System cache's DataRegion size is configured to 40 MB. Use DataStorageConfiguration.systemRegionInitialSize property to change the setting. [21:03:46] : [Step 4/5] [2021-11-19 21:03:46,993][INFO ][main][EncryptedCacheCreateTest0] Configured caches [in 'sysMemPlc' dataRegion: ['ignite-sys-cache']] [21:03:46]W: [org.apache.ignite:ignite-core] [2021-11-19 21:03:46,994][WARN ][main][EncryptedCacheCreateTest0] Peer class loading is enabled (disable it in production for performance and deployment consistency reasons) [21:03:46] : [Step 4/5] [2021-11-19 21:03:46,994][INFO ][main][EncryptedCacheCreateTest0] 3-rd party licenses can be found at: /opt/buildagent/work/7bc1c54bc719b67c/libs/licenses [21:03:47] : [Step 4/5] [2021-11-19 21:03:47,001][INFO ][main][IgnitePluginProcessor] Configured plugins: [21:03:47] : [Step 4/5] [2021-11-19 21:03:47,001][INFO ][main][IgnitePluginProcessor] ^-- StanByClusterTestProvider 1.0 [21:03:47] : [Step 4/5] [2021-11-19 21:03:47,001][INFO ][main][IgnitePluginProcessor] ^-- null [21:03:47] : [Step 4/5] [2021-11-19 21:03:47,001][INFO ][main][IgnitePluginProcessor] [21:03:47] : [Step 4/5] [2021-11-19 21:03:47,001][INFO ][main][IgnitePluginProcessor] ^-- PageMemory tracker plugin 1.0 [21:03:47] : [Step 4/5] [2021-11-19 21:03:47,001][INFO ][main][IgnitePluginProcessor] ^-- null [21:03:47] : [Step 4/5] [2021-11-19 21:03:47,001][INFO ][main][IgnitePluginProcessor] [21:03:47] : [Step 4/5] [2021-11-19 21:03:47,002][INFO ][main][IgnitePluginProcessor] ^-- TestDistibutedConfigurationPlugin 1.0 [21:03:47] : [Step 4/5] [2021-11-19 21:03:47,002][INFO ][main][IgnitePluginProcessor] ^-- null [21:03:47] : [Step 4/5] [2021-11-19 21:03:47,002][INFO ][main][IgnitePluginProcessor] [21:03:47] : [Step 4/5] [2021-11-19 21:03:47,002][INFO ][main][IgnitePluginProcessor] ^-- NodeValidationPluginProvider 1.0 [21:03:47] : [Step 4/5] [2021-11-19 21:03:47,002][INFO ][main][IgnitePluginProcessor] ^-- null [21:03:47] : [Step 4/5] [2021-11-19 21:03:47,002][INFO ][main][IgnitePluginProcessor] [21:03:47] : [Step 4/5] [2021-11-19 21:03:47,002][INFO ][main][FailureProcessor] Configured failure handler: [hnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]]] [21:03:47] : [Step 4/5] [2021-11-19 21:03:47,038][INFO ][main][TcpCommunicationSpi] Successfully bound communication NIO server to TCP port [port=45120, locHost=/127.0.0.1, selectorsCnt=12, selectorSpins=0, pairedConn=false] [21:03:47]W: [org.apache.ignite:ignite-core] [2021-11-19 21:03:47,038][WARN ][main][TcpCommunicationSpi] Message queue limit is set to 0 which may lead to potential OOMEs when running cache operations in FULL_ASYNC or PRIMARY_SYNC modes due to message queues growth on sender and receiver sides. [21:03:47] : [Step 4/5] [2021-11-19 21:03:47,043][INFO ][main][GridCollisionManager] Collision resolution is disabled (all jobs will be activated upon arrival). [21:03:47] : [Step 4/5] [2021-11-19 21:03:47,043][INFO ][main][EncryptedCacheCreateTest0] Security status [authentication=off, sandbox=off, tls/ssl=off] [21:03:47] : [Step 4/5] [2021-11-19 21:03:47,100][INFO ][main][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:03:47] : [Step 4/5] [2021-11-19 21:03:47,211][INFO ][main][MaintenanceProcessor] Resolved store directory for node persistent data: /opt/buildagent/work/7bc1c54bc719b67c/work/db/encryption_EncryptedCacheCreateTest0 [21:03:47] : [Step 4/5] [2021-11-19 21:03:47,213][INFO ][main][CacheObjectBinaryProcessorImpl] Resolved directory for serialized binary metadata: /opt/buildagent/work/7bc1c54bc719b67c/work/db/binary_meta/encryption_EncryptedCacheCreateTest0 [21:03:47] : [Step 4/5] [2021-11-19 21:03:47,220][INFO ][main][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/encryption_EncryptedCacheCreateTest0 [21:03:47] : [Step 4/5] [2021-11-19 21:03:47,220][INFO ][main][FileWriteAheadLogManager] Resolved write ahead log work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/encryption_EncryptedCacheCreateTest0 [21:03:47] : [Step 4/5] [2021-11-19 21:03:47,221][INFO ][main][FileWriteAheadLogManager] Resolved write ahead log archive directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/encryption_EncryptedCacheCreateTest0 [21:03:47] : [Step 4/5] Surefire report watcher [21:03:47] : [Surefire report watcher] Watching paths: [21:03:47] : [Surefire report watcher] /opt/buildagent/temp/buildTmp/ignite-tools-junit-reports1777670380320881607/test-org.apache.ignite.testsuites.IgniteBasicWithPersistenceTestSuite1637345017431.xml [21:03:47]i: [Step 4/5] org.apache.ignite.testsuites.IgniteBasicWithPersistenceTestSuite [21:03:47]i: [org.apache.ignite.testsuites.IgniteBasicWithPersistenceTestSuite] org.apache.ignite.internal.encryption.EncryptedCacheBigEntryTest.testCreateEncryptedCacheWithBigEntry [21:03:47] : [Step 4/5] [2021-11-19 21:03:47,639][INFO ][main][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/encryption_EncryptedCacheCreateTest0/0000000000000000.wal [21:03:47]W: [org.apache.ignite:ignite-core] [2021-11-19 21:03:47,640][WARN ][main][GridCacheDatabaseSharedManager] DataRegion maxSize=10.5 MB is smaller than defaultInitialSize=268.4 MB, setting initialSize to 10.5 MB [21:03:47] : [Step 4/5] [2021-11-19 21:03:47,644][INFO ][main][GridCacheDatabaseSharedManager] Configured data regions initialized successfully [total=6] [21:03:47] : [Step 4/5] [2021-11-19 21:03:47,647][INFO ][main][IgniteSnapshotManager] Resolved snapshot work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/snapshots [21:03:47] : [Step 4/5] [2021-11-19 21:03:47,647][INFO ][main][IgniteSnapshotManager] Resolved temp directory for snapshot creation: /opt/buildagent/work/7bc1c54bc719b67c/work/db/encryption_EncryptedCacheCreateTest0/snp [21:03:47] : [Step 4/5] [2021-11-19 21:03:47,650][INFO ][main][ClientListenerProcessor] Client connector processor has started on TCP port 10800 [21:03:47] : [Step 4/5] [2021-11-19 21:03:47,656][INFO ][main][EncryptedCacheCreateTest0] Non-loopback local IPs: 172.17.0.4 [21:03:47] : [Step 4/5] [2021-11-19 21:03:47,656][INFO ][main][EncryptedCacheCreateTest0] Enabled local MACs: 0242AC110004 [21:03:47] : [Step 4/5] [2021-11-19 21:03:47,658][INFO ][main][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:03:47] : [Step 4/5] [2021-11-19 21:03:47,659][INFO ][main][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:03:47] : [Step 4/5] [2021-11-19 21:03:47,659][INFO ][main][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:03:47] : [Step 4/5] [2021-11-19 21:03:47,662][INFO ][main][GridCacheDatabaseSharedManager] Applying lost metastore updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:03:47] : [Step 4/5] [2021-11-19 21:03:47,662][INFO ][main][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=0 ms] [21:03:47] : [Step 4/5] [2021-11-19 21:03:47,663][INFO ][main][GridCacheProcessor] Restoring partition state for local groups. [21:03:47] : [Step 4/5] [2021-11-19 21:03:47,663][INFO ][main][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=0, partitionsProcessed=0, time=0ms] [21:03:47] : [Step 4/5] [2021-11-19 21:03:47,663][INFO ][main][GridEncryptionManager] Encryption keys loaded from metastore. [grps=, masterKeyName=ignite.master.key] [21:03:47] : [Step 4/5] [2021-11-19 21:03:47,668][INFO ][main][ClusterProcessor] Cluster ID and tag has been read from metastorage: null [21:03:47] : [Step 4/5] [2021-11-19 21:03:47,668][INFO ][main][IgniteClusterImpl] Shutdown policy was updated [oldVal=null, newVal=null] [21:03:47] : [Step 4/5] [2021-11-19 21:03:47,669][INFO ][main][GridCacheDatabaseSharedManager] Checkpoint frequency deviation changed [oldVal=null, newVal=null] [21:03:47] : [Step 4/5] [2021-11-19 21:03:47,678][INFO ][main][FilePageStoreManager] Cleanup cache stores [total=1, left=0, cleanFiles=false] [21:03:47] : [Step 4/5] [2021-11-19 21:03:47,680][INFO ][main][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:03:47] : [Step 4/5] [2021-11-19 21:03:47,681][INFO ][main][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:03:47] : [Step 4/5] [2021-11-19 21:03:47,682][INFO ][main][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:03:47] : [Step 4/5] [2021-11-19 21:03:47,683][INFO ][main][GridCacheDatabaseSharedManager] Data Regions Started: 6 [21:03:47] : [Step 4/5] [2021-11-19 21:03:47,683][INFO ][main][GridCacheDatabaseSharedManager] ^-- sysMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:03:47] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:03:47] : [Step 4/5] ^-- no-persistence-region region [type=user, persistence=false, lazyAlloc=true, [21:03:47] : [Step 4/5] ... initCfg=10MB, maxCfg=10MB, usedRam=0MB, freeRam=100%, allocRam=0MB] [21:03:47] : [Step 4/5] ^-- default region [type=default, persistence=true, lazyAlloc=true, [21:03:47] : [Step 4/5] ... initCfg=10MB, maxCfg=10MB, usedRam=0MB, freeRam=100%, allocRam=0MB, allocTotal=0MB] [21:03:47] : [Step 4/5] ^-- metastoreMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:03:47] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:03:47] : [Step 4/5] ^-- TxLog region [type=internal, persistence=true, lazyAlloc=false, [21:03:47] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:03:47] : [Step 4/5] ^-- volatileDsMemPlc region [type=user, persistence=false, lazyAlloc=true, [21:03:47] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB] [21:03:47] : [Step 4/5] ^-- Ignite persistence [used=0MB] [21:03:47] : [Step 4/5] [21:03:47] : [Step 4/5] [2021-11-19 21:03:47,685][INFO ][main][GridCacheDatabaseSharedManager] Starting binary memory restore for: [-2100569601] [21:03:47] : [Step 4/5] [2021-11-19 21:03:47,698][INFO ][main][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:03:47] : [Step 4/5] [2021-11-19 21:03:47,698][INFO ][main][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:03:47] : [Step 4/5] [2021-11-19 21:03:47,700][INFO ][main][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/encryption_EncryptedCacheCreateTest0/0000000000000000.wal, offset=0, ver=2] [21:03:47] : [Step 4/5] [2021-11-19 21:03:47,704][INFO ][main][GridCacheProcessor] Started cache in recovery mode [name=ignite-sys-cache, id=-2100569601, dataRegionName=sysMemPlc, mode=REPLICATED, atomicity=TRANSACTIONAL, backups=2147483647, mvcc=false] [21:03:47] : [Step 4/5] [2021-11-19 21:03:47,705][INFO ][main][GridCacheDatabaseSharedManager] Binary recovery performed in 20 ms. [21:03:47] : [Step 4/5] [2021-11-19 21:03:47,705][INFO ][main][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:03:47] : [Step 4/5] [2021-11-19 21:03:47,705][INFO ][main][GridCacheDatabaseSharedManager] Applying lost cache updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:03:47] : [Step 4/5] [2021-11-19 21:03:47,766][INFO ][main][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=60 ms] [21:03:47] : [Step 4/5] [2021-11-19 21:03:47,767][INFO ][main][GridCacheProcessor] Restoring partition state for local groups. [21:03:47] : [Step 4/5] [2021-11-19 21:03:47,774][INFO ][main][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=1, partitionsProcessed=100, time=10ms] [21:03:48] : [Step 4/5] [2021-11-19 21:03:48,109][INFO ][main][TestTcpDiscoverySpi] Successfully bound to TCP port [port=47500, localHost=localhost/127.0.0.1, locNodeId=332f4457-a30f-4f84-b266-78c71e300000] [21:03:48] : [Step 4/5] [2021-11-19 21:03:48,120][INFO ][disco-notifier-worker-#5920%encryption.EncryptedCacheCreateTest0%][MvccProcessorImpl] Assigned mvcc coordinator [crd=MvccCoordinator [topVer=AffinityTopologyVersion [topVer=1, minorTopVer=0], nodeId=332f4457-a30f-4f84-b266-78c71e300000, ver=1637345028115, local=true, initialized=false]] [21:03:48] : [Step 4/5] [2021-11-19 21:03:48,122][INFO ][sys-#5919%encryption.EncryptedCacheCreateTest0%][ClusterProcessor] Writing cluster ID and tag to metastorage on ready for write ClusterIdAndTag [id=e9d5dba5-52d6-4577-8410-fc5586055479, tag=nervous_pasteur] [21:03:48] : [Step 4/5] [2021-11-19 21:03:48,128][INFO ][disco-notifier-worker-#5920%encryption.EncryptedCacheCreateTest0%][ClusterProcessor] nervous_pasteur [21:03:48] : [Step 4/5] [2021-11-19 21:03:48,129][INFO ][disco-notifier-worker-#5920%encryption.EncryptedCacheCreateTest0%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustEnabled' was changed from 'null' to 'false' [21:03:48] : [Step 4/5] [2021-11-19 21:03:48,131][INFO ][disco-notifier-worker-#5920%encryption.EncryptedCacheCreateTest0%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustTimeout' was changed from 'null' to '300000' [21:03:48] : [Step 4/5] [2021-11-19 21:03:48,131][INFO ][disco-notifier-worker-#5920%encryption.EncryptedCacheCreateTest0%][IgniteTxManager] Transactions parameter 'longOperationsDumpTimeout' was changed from 'null' to '60000' [21:03:48] : [Step 4/5] [2021-11-19 21:03:48,132][INFO ][disco-notifier-worker-#5920%encryption.EncryptedCacheCreateTest0%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpThreshold' was changed from 'null' to '0' [21:03:48] : [Step 4/5] [2021-11-19 21:03:48,135][INFO ][disco-notifier-worker-#5920%encryption.EncryptedCacheCreateTest0%][IgniteTxManager] Transactions parameter 'transactionTimeDumpSamplesCoefficient' was changed from 'null' to '0.0' [21:03:48] : [Step 4/5] [2021-11-19 21:03:48,137][INFO ][disco-notifier-worker-#5920%encryption.EncryptedCacheCreateTest0%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpSamplesPerSecondLimit' was changed from 'null' to '5' [21:03:48] : [Step 4/5] [2021-11-19 21:03:48,139][INFO ][disco-notifier-worker-#5920%encryption.EncryptedCacheCreateTest0%][IgniteTxManager] Transactions parameter 'collisionsDumpInterval' was changed from 'null' to '1000' [21:03:48] : [Step 4/5] [2021-11-19 21:03:48,145][INFO ][disco-notifier-worker-#5920%encryption.EncryptedCacheCreateTest0%][IgniteTxManager] Transactions parameter 'txOwnerDumpRequestsAllowed' was changed from 'null' to 'true' [21:03:48] : [Step 4/5] [2021-11-19 21:03:48,148][INFO ][disco-notifier-worker-#5920%encryption.EncryptedCacheCreateTest0%][GridCacheDatabaseSharedManager] Historical rebalance WAL threshold changed [property=historical.rebalance.threshold, oldVal=null, newVal=500] [21:03:48] : [Step 4/5] [2021-11-19 21:03:48,149][INFO ][main][EncryptedCacheCreateTest0] To start Console Management & Monitoring run ignitevisorcmd.{sh|bat} [21:03:48] : [Step 4/5] [2021-11-19 21:03:48,150][INFO ][main][EncryptedCacheCreateTest0] [21:03:48] : [Step 4/5] [21:03:48] : [Step 4/5] >>> +-------------------------------------------+ [21:03:48] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:03:48] : [Step 4/5] >>> +-------------------------------------------+ [21:03:48] : [Step 4/5] >>> OS name: Linux 4.15.0-151-generic amd64 [21:03:48] : [Step 4/5] >>> CPU(s): 24 [21:03:48] : [Step 4/5] >>> Heap: 2.0GB [21:03:48] : [Step 4/5] >>> VM name: 16724@c4dfe9a430b2 [21:03:48] : [Step 4/5] >>> Ignite instance name: encryption.EncryptedCacheCreateTest0 [21:03:48] : [Step 4/5] >>> Local node [ID=332F4457-A30F-4F84-B266-78C71E300000, order=1, clientMode=false] [21:03:48] : [Step 4/5] >>> Local node addresses: [127.0.0.1] [21:03:48] : [Step 4/5] >>> Local ports: TCP:10800 TCP:45120 TCP:47500 [21:03:48] : [Step 4/5] [21:03:48] : [Step 4/5] [2021-11-19 21:03:48,151][INFO ][main][EncryptedCacheCreateTest0] >>> Ignite cluster is in INACTIVE state (limited functionality available). Use control.(sh|bat) script or IgniteCluster.state(ClusterState.ACTIVE) to change the state. [21:03:48] : [Step 4/5] [2021-11-19 21:03:48,152][INFO ][main][GridDiscoveryManager] Topology snapshot [ver=1, locNode=332f4457, servers=1, clients=0, state=INACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=332f4457-a30f-4f84-b266-78c71e300000, consistentId=encryption.EncryptedCacheCreateTest0, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:03:48] : [Step 4/5] [2021-11-19 21:03:48,152][INFO ][main][G] Node started : [stage="Configure system pool" (0 ms),stage="Start managers" (235 ms),stage="Configure binary metadata" (4 ms),stage="Start processors" (438 ms),stage="Start 'StanByClusterTestProvider' plugin" (0 ms),stage="Start 'PageMemory tracker plugin' plugin" (0 ms),stage="Start 'TestDistibutedConfigurationPlugin' plugin" (0 ms),stage="Start 'NodeValidationPluginProvider' plugin" (0 ms),stage="Init metastore" (22 ms),stage="Init and start regions" (7 ms),stage="Restore binary memory" (19 ms),stage="Restore logical state" (69 ms),stage="Finish recovery" (333 ms),stage="Join topology" (11 ms),stage="Await transition" (3 ms),stage="Await exchange" (29 ms),stage="Total time" (1170 ms)] [21:03:48] : [Step 4/5] [2021-11-19 21:03:48,154][INFO ][main][root] Node started with the following configuration [id=332f4457-a30f-4f84-b266-78c71e300000, marshaller=BinaryMarshaller [], discovery=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=5000, ackTimeout=5000, marsh=JdkMarshaller [clsFilter=org.apache.ignite.marshaller.MarshallerUtils$1@78422efb], reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], binaryCfg=null, lateAff=true] [21:03:48]W: [org.apache.ignite:ignite-core] [2021-11-19 21:03:48,164][WARN ][main][G] Ignite work directory is not provided, automatically resolved to: /opt/buildagent/work/7bc1c54bc719b67c/work [21:03:48] : [Step 4/5] [2021-11-19 21:03:48,165][INFO ][main][EncryptedCacheCreateTest1] [21:03:48] : [Step 4/5] [21:03:48] : [Step 4/5] >>> __________ ________________ [21:03:48] : [Step 4/5] >>> / _/ ___/ |/ / _/_ __/ __/ [21:03:48] : [Step 4/5] >>> _/ // (7 7 // / / / / _/ [21:03:48] : [Step 4/5] >>> /___/\___/_/|_/___/ /_/ /___/ [21:03:48] : [Step 4/5] >>> [21:03:48] : [Step 4/5] >>> ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:03:48] : [Step 4/5] >>> 2021 Copyright(C) Apache Software Foundation [21:03:48] : [Step 4/5] >>> [21:03:48] : [Step 4/5] >>> Ignite documentation: http://ignite.apache.org [21:03:48] : [Step 4/5] [21:03:48] : [Step 4/5] [2021-11-19 21:03:48,166][INFO ][main][EncryptedCacheCreateTest1] Config URL: n/a [21:03:48] : [Step 4/5] [2021-11-19 21:03:48,166][INFO ][main][EncryptedCacheCreateTest1] IgniteConfiguration [igniteInstanceName=encryption.EncryptedCacheCreateTest1, pubPoolSize=24, svcPoolSize=24, callbackPoolSize=24, stripedPoolSize=24, sysPoolSize=24, mgmtPoolSize=4, dataStreamerPoolSize=24, utilityCachePoolSize=24, utilityCacheKeepAliveTime=60000, p2pPoolSize=2, qryPoolSize=24, buildIdxPoolSize=4, igniteHome=/opt/buildagent/work/7bc1c54bc719b67c, igniteWorkDir=/opt/buildagent/work/7bc1c54bc719b67c/work, mbeanSrv=com.sun.jmx.mbeanserver.JmxMBeanServer@6fe85038, nodeId=71f225f9-326e-4c95-a94c-24dd0fc00001, marsh=BinaryMarshaller [], marshLocJobs=false, daemon=false, p2pEnabled=true, netTimeout=10000, netCompressionLevel=1, sndRetryDelay=1000, sndRetryCnt=3, metricsHistSize=10000, metricsUpdateFreq=1000, metricsExpTime=9223372036854775807, discoSpi=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=0, ackTimeout=0, marsh=null, reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], segPlc=STOP, segResolveAttempts=2, waitForSegOnStart=true, allResolversPassReq=true, segChkFreq=10000, commSpi=TcpCommunicationSpi [connectGate=org.apache.ignite.spi.communication.tcp.internal.ConnectGateway@7235f92b, ctxInitLatch=java.util.concurrent.CountDownLatch@7885776b[Count = 1], stopping=false, clientPool=null, nioSrvWrapper=null, stateProvider=null], evtSpi=MemoryEventStorageSpi [expireAgeMs=9223372036854775807, expireCnt=10000, filter=null], colSpi=NoopCollisionSpi [], deploySpi=LocalDeploymentSpi [], indexingSpi=org.apache.ignite.spi.indexing.noop.NoopIndexingSpi@3a3ed300, addrRslvr=null, encryptionSpi=org.apache.ignite.spi.encryption.keystore.KeystoreEncryptionSpi@1984212d, tracingSpi=org.apache.ignite.spi.tracing.NoopTracingSpi@39f5b723, clientMode=false, rebalanceThreadPoolSize=4, rebalanceTimeout=10000, rebalanceBatchesPrefetchCnt=3, rebalanceThrottle=0, rebalanceBatchSize=524288, txCfg=TransactionConfiguration [txSerEnabled=false, dfltIsolation=REPEATABLE_READ, dfltConcurrency=PESSIMISTIC, dfltTxTimeout=0, txTimeoutOnPartitionMapExchange=0, deadlockTimeout=10000, pessimisticTxLogSize=0, pessimisticTxLogLinger=10000, tmLookupClsName=null, txManagerFactory=null, useJtaSync=false], cacheSanityCheckEnabled=true, discoStartupDelay=60000, deployMode=SHARED, p2pMissedCacheSize=100, locHost=127.0.0.1, timeSrvPortBase=31100, timeSrvPortRange=100, failureDetectionTimeout=10000, sysWorkerBlockedTimeout=null, clientFailureDetectionTimeout=10000, metricsLogFreq=0, connectorCfg=null, odbcCfg=null, warmupClos=null, atomicCfg=AtomicConfiguration [seqReserveSize=1000, cacheMode=PARTITIONED, backups=1, aff=null, grpName=null], classLdr=null, sslCtxFactory=null, platformCfg=null, binaryCfg=null, memCfg=null, pstCfg=null, dsCfg=DataStorageConfiguration [sysRegionInitSize=41943040, sysRegionMaxSize=104857600, pageSize=4096, concLvl=0, dfltDataRegConf=DataRegionConfiguration [name=default, maxSize=10485760, initSize=268435456, swapPath=null, pageEvictionMode=DISABLED, pageReplacementMode=CLOCK, evictionThreshold=0.9, emptyPagesPoolSize=100, metricsEnabled=false, metricsSubIntervalCount=5, metricsRateTimeInterval=60000, persistenceEnabled=true, checkpointPageBufSize=0, lazyMemoryAllocation=true, warmUpCfg=null], dataRegions=DataRegionConfiguration[] [DataRegionConfiguration [name=no-persistence-region, maxSize=10485760, initSize=268435456, swapPath=null, pageEvictionMode=DISABLED, pageReplacementMode=CLOCK, evictionThreshold=0.9, emptyPagesPoolSize=100, metricsEnabled=false, metricsSubIntervalCount=5, metricsRateTimeInterval=60000, persistenceEnabled=false, checkpointPageBufSize=0, lazyMemoryAllocation=true, warmUpCfg=null]], storagePath=null, checkpointFreq=180000, lockWaitTime=10000, checkpointThreads=4, checkpointWriteOrder=SEQUENTIAL, walHistSize=20, maxWalArchiveSize=1073741824, walSegments=10, walSegmentSize=67108864, walPath=db/wal, walArchivePath=db/wal/archive, cdcWalPath=db/wal/cdc, cdcEnabled=false, metricsEnabled=false, walMode=FSYNC, walTlbSize=131072, walBuffSize=0, walFlushFreq=2000, walFsyncDelay=1000, walRecordIterBuffSize=67108864, alwaysWriteFullPages=false, fileIOFactory=org.apache.ignite.internal.processors.cache.persistence.file.AsyncFileIOFactory@46dcbeab, metricsSubIntervalCnt=5, metricsRateTimeInterval=60000, walAutoArchiveAfterInactivity=-1, walForceArchiveTimeout=-1, writeThrottlingEnabled=false, walCompactionEnabled=false, walCompactionLevel=1, checkpointReadLockTimeout=null, walPageCompression=DISABLED, walPageCompressionLevel=null, dfltWarmUpCfg=null, encCfg=org.apache.ignite.configuration.EncryptionConfiguration@36e43829, defragmentationThreadPoolSize=4, minWalArchiveSize=-1], snapshotPath=snapshots, activeOnStart=true, activeOnStartPropSetFlag=false, autoActivation=true, autoActivationPropSetFlag=false, clusterStateOnStart=null, sqlConnCfg=null, cliConnCfg=ClientConnectorConfiguration [host=null, port=10800, portRange=100, sockSndBufSize=0, sockRcvBufSize=0, tcpNoDelay=true, maxOpenCursorsPerConn=128, threadPoolSize=24, selectorCnt=12, idleTimeout=0, handshakeTimeout=10000, jdbcEnabled=true, odbcEnabled=true, thinCliEnabled=true, sslEnabled=false, useIgniteSslCtxFactory=true, sslClientAuth=false, sslCtxFactory=null, thinCliCfg=ThinClientConfiguration [maxActiveTxPerConn=100, maxActiveComputeTasksPerConn=0]], mvccVacuumThreadCnt=2, mvccVacuumFreq=5000, authEnabled=false, failureHnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]], commFailureRslvr=null, sqlCfg=SqlConfiguration [longQryWarnTimeout=3000, dfltQryTimeout=0, sqlQryHistSize=1000, validationEnabled=false], asyncContinuationExecutor=null] [21:03:48] : [Step 4/5] [2021-11-19 21:03:48,175][INFO ][main][EncryptedCacheCreateTest1] Daemon mode: off [21:03:48] : [Step 4/5] [2021-11-19 21:03:48,175][INFO ][main][EncryptedCacheCreateTest1] OS: Linux 4.15.0-151-generic amd64 [21:03:48] : [Step 4/5] [2021-11-19 21:03:48,175][INFO ][main][EncryptedCacheCreateTest1] OS user: teamcity [21:03:48] : [Step 4/5] [2021-11-19 21:03:48,176][INFO ][main][EncryptedCacheCreateTest1] PID: 16724 [21:03:48] : [Step 4/5] [2021-11-19 21:03:48,176][INFO ][main][EncryptedCacheCreateTest1] Language runtime: Java Platform API Specification ver. 1.8 [21:03:48] : [Step 4/5] [2021-11-19 21:03:48,176][INFO ][main][EncryptedCacheCreateTest1] VM information: Java(TM) SE Runtime Environment 1.8.0_261-b12 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 25.261-b12 [21:03:48] : [Step 4/5] [2021-11-19 21:03:48,177][INFO ][main][EncryptedCacheCreateTest1] VM total memory: 1.9GB [21:03:48] : [Step 4/5] [2021-11-19 21:03:48,177][INFO ][main][EncryptedCacheCreateTest1] Remote Management [restart: off, REST: off, JMX (remote: off)] [21:03:48] : [Step 4/5] [2021-11-19 21:03:48,177][INFO ][main][EncryptedCacheCreateTest1] Logger: GridTestLog4jLogger [quiet=false, config=null] [21:03:48] : [Step 4/5] [2021-11-19 21:03:48,177][INFO ][main][EncryptedCacheCreateTest1] IGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c [21:03:48] : [Step 4/5] [2021-11-19 21:03:48,177][INFO ][main][EncryptedCacheCreateTest1] VM arguments: [-DIGNITE_DUMP_THREADS_ON_FAILURE=false, -DMono=/usr/bin/mono-sgen, -DMono4.0_x64=/usr/lib/mono/4.0, -DMono4.5_x64=/usr/lib/mono/4.5, -DMonoVersion=6.12.0.90, -DSKIP_BUILD=false, -Dagent.home.dir=/opt/buildagent, -Dagent.name=aitc-lin02_03, -Dagent.ownPort=9090, -Dagent.work.dir=/opt/buildagent/work, -Dbuild.number=95, -Dbuild.vcs.number=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.1=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.GitHubApacheIgnite=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dclassworlds.conf=/opt/buildagent/temp/buildTmp/teamcity.m2.conf, -Dcom.jetbrains.maven.watcher.report.file=/opt/buildagent/temp/buildTmp/maven-build-info.xml, -Djava.io.tmpdir=/opt/buildagent/temp/buildTmp, -Dmaven.home=/opt/buildagent/tools/maven3_6, -Dmaven.multiModuleProjectDirectory=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.agent.cpuBenchmark=457, -Dteamcity.agent.dotnet.agent_url=http://localhost:9090/RPC2, -Dteamcity.agent.dotnet.build_id=6278078, -Dteamcity.auth.password=*******, -Dteamcity.auth.userId=TeamCityBuildId=6278078, -Dteamcity.build.changedFiles.file=/opt/buildagent/temp/buildTmp/changedFiles6342607772318147725.txt, -Dteamcity.build.checkoutDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.build.id=6278078, -Dteamcity.build.properties.file=/opt/buildagent/temp/buildTmp/teamcity.build5164517880467851002.properties, -Dteamcity.build.tempDir=/opt/buildagent/temp/buildTmp, -Dteamcity.build.workingDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.buildConfName=Basic 3, -Dteamcity.buildType.id=IgniteTests24Java8_Basic3, -Dteamcity.configuration.properties.file=/opt/buildagent/temp/buildTmp/teamcity.config5591980786735343870.properties, -Dteamcity.maven.userSettings.path=/opt/buildagent/temp/buildTmp/maven_settings_585072866407032347.xml, -Dteamcity.maven.watcher.home=/opt/buildagent/plugins/mavenPlugin/maven-watcher-jdk16, -Dteamcity.projectName=Ignite Tests 2.x (JDK 8/11), -Dteamcity.runner.properties.file=/opt/buildagent/temp/buildTmp/teamcity.runner9098465561618137420.properties, -Dteamcity.tests.recentlyFailedTests.file=/opt/buildagent/temp/buildTmp/testsToRunFirst3891775683130404069.txt, -Dteamcity.version=2021.2 (build 99542), -ea, -Xms2g, -Xmx2g, -XX:+HeapDumpOnOutOfMemoryError, -DIGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_TEST_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_UPDATE_NOTIFIER=false, -DIGNITE_NO_DISCO_ORDER=true, -DIGNITE_PERFORMANCE_SUGGESTIONS_DISABLED=true, -Djava.net.preferIPv4Stack=true, -DTEST_SCALE_FACTOR=1.0, -DIGNITE_TEST_PROP_LOG4J_FILE=log4j-tc-test.xml, -DIGNITE_QUIET=false, -DIGNITE_MARSHAL_BUFFERS_RECHECK=1000, -Dmaven.repo.local=/opt/buildagent/.m2/repository] [21:03:48] : [Step 4/5] [2021-11-19 21:03:48,182][INFO ][main][EncryptedCacheCreateTest1] System cache's DataRegion size is configured to 40 MB. Use DataStorageConfiguration.systemRegionInitialSize property to change the setting. [21:03:48] : [Step 4/5] [2021-11-19 21:03:48,182][INFO ][main][EncryptedCacheCreateTest1] Configured caches [in 'sysMemPlc' dataRegion: ['ignite-sys-cache']] [21:03:48]W: [org.apache.ignite:ignite-core] [2021-11-19 21:03:48,183][WARN ][main][EncryptedCacheCreateTest1] Peer class loading is enabled (disable it in production for performance and deployment consistency reasons) [21:03:48] : [Step 4/5] [2021-11-19 21:03:48,183][INFO ][main][EncryptedCacheCreateTest1] 3-rd party licenses can be found at: /opt/buildagent/work/7bc1c54bc719b67c/libs/licenses [21:03:48] : [Step 4/5] [2021-11-19 21:03:48,189][INFO ][main][IgnitePluginProcessor] Configured plugins: [21:03:48] : [Step 4/5] [2021-11-19 21:03:48,189][INFO ][main][IgnitePluginProcessor] ^-- StanByClusterTestProvider 1.0 [21:03:48] : [Step 4/5] [2021-11-19 21:03:48,189][INFO ][main][IgnitePluginProcessor] ^-- null [21:03:48] : [Step 4/5] [2021-11-19 21:03:48,190][INFO ][main][IgnitePluginProcessor] [21:03:48] : [Step 4/5] [2021-11-19 21:03:48,190][INFO ][main][IgnitePluginProcessor] ^-- PageMemory tracker plugin 1.0 [21:03:48] : [Step 4/5] [2021-11-19 21:03:48,190][INFO ][main][IgnitePluginProcessor] ^-- null [21:03:48] : [Step 4/5] [2021-11-19 21:03:48,191][INFO ][main][IgnitePluginProcessor] [21:03:48] : [Step 4/5] [2021-11-19 21:03:48,191][INFO ][main][IgnitePluginProcessor] ^-- TestDistibutedConfigurationPlugin 1.0 [21:03:48] : [Step 4/5] [2021-11-19 21:03:48,191][INFO ][main][IgnitePluginProcessor] ^-- null [21:03:48] : [Step 4/5] [2021-11-19 21:03:48,191][INFO ][main][IgnitePluginProcessor] [21:03:48] : [Step 4/5] [2021-11-19 21:03:48,191][INFO ][main][IgnitePluginProcessor] ^-- NodeValidationPluginProvider 1.0 [21:03:48] : [Step 4/5] [2021-11-19 21:03:48,192][INFO ][main][IgnitePluginProcessor] ^-- null [21:03:48] : [Step 4/5] [2021-11-19 21:03:48,192][INFO ][main][IgnitePluginProcessor] [21:03:48] : [Step 4/5] [2021-11-19 21:03:48,192][INFO ][main][FailureProcessor] Configured failure handler: [hnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]]] [21:03:48]W: [org.apache.ignite:ignite-core] [2021-11-19 21:03:48,227][WARN ][main][TcpCommunicationSpi] Message queue limit is set to 0 which may lead to potential OOMEs when running cache operations in FULL_ASYNC or PRIMARY_SYNC modes due to message queues growth on sender and receiver sides. [21:03:48] : [Step 4/5] [2021-11-19 21:03:48,227][INFO ][main][TcpCommunicationSpi] Successfully bound communication NIO server to TCP port [port=45121, locHost=/127.0.0.1, selectorsCnt=12, selectorSpins=0, pairedConn=false] [21:03:48] : [Step 4/5] [2021-11-19 21:03:48,236][INFO ][main][GridCollisionManager] Collision resolution is disabled (all jobs will be activated upon arrival). [21:03:48] : [Step 4/5] [2021-11-19 21:03:48,236][INFO ][main][EncryptedCacheCreateTest1] Security status [authentication=off, sandbox=off, tls/ssl=off] [21:03:48] : [Step 4/5] [2021-11-19 21:03:48,298][INFO ][main][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:03:48] : [Step 4/5] [2021-11-19 21:03:48,401][INFO ][main][MaintenanceProcessor] Resolved store directory for node persistent data: /opt/buildagent/work/7bc1c54bc719b67c/work/db/encryption_EncryptedCacheCreateTest1 [21:03:48] : [Step 4/5] [2021-11-19 21:03:48,403][INFO ][main][CacheObjectBinaryProcessorImpl] Resolved directory for serialized binary metadata: /opt/buildagent/work/7bc1c54bc719b67c/work/db/binary_meta/encryption_EncryptedCacheCreateTest1 [21:03:48] : [Step 4/5] [2021-11-19 21:03:48,412][INFO ][main][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/encryption_EncryptedCacheCreateTest1 [21:03:48] : [Step 4/5] [2021-11-19 21:03:48,412][INFO ][main][FileWriteAheadLogManager] Resolved write ahead log work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/encryption_EncryptedCacheCreateTest1 [21:03:48] : [Step 4/5] [2021-11-19 21:03:48,413][INFO ][main][FileWriteAheadLogManager] Resolved write ahead log archive directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/encryption_EncryptedCacheCreateTest1 [21:03:48] : [Step 4/5] [2021-11-19 21:03:48,817][INFO ][main][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/encryption_EncryptedCacheCreateTest1/0000000000000000.wal [21:03:48] : [Step 4/5] [2021-11-19 21:03:48,822][INFO ][main][GridCacheDatabaseSharedManager] Configured data regions initialized successfully [total=6] [21:03:48] : [Step 4/5] [2021-11-19 21:03:48,824][INFO ][main][IgniteSnapshotManager] Resolved snapshot work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/snapshots [21:03:48] : [Step 4/5] [2021-11-19 21:03:48,825][INFO ][main][IgniteSnapshotManager] Resolved temp directory for snapshot creation: /opt/buildagent/work/7bc1c54bc719b67c/work/db/encryption_EncryptedCacheCreateTest1/snp [21:03:48] : [Step 4/5] [2021-11-19 21:03:48,827][INFO ][main][ClientListenerProcessor] Client connector processor has started on TCP port 10801 [21:03:48] : [Step 4/5] [2021-11-19 21:03:48,830][INFO ][main][EncryptedCacheCreateTest1] Non-loopback local IPs: 172.17.0.4 [21:03:48] : [Step 4/5] [2021-11-19 21:03:48,830][INFO ][main][EncryptedCacheCreateTest1] Enabled local MACs: 0242AC110004 [21:03:48] : [Step 4/5] [2021-11-19 21:03:48,831][INFO ][main][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:03:48] : [Step 4/5] [2021-11-19 21:03:48,831][INFO ][main][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:03:48] : [Step 4/5] [2021-11-19 21:03:48,832][INFO ][main][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:03:48] : [Step 4/5] [2021-11-19 21:03:48,834][INFO ][main][GridCacheDatabaseSharedManager] Applying lost metastore updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:03:48] : [Step 4/5] [2021-11-19 21:03:48,835][INFO ][main][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=0 ms] [21:03:48] : [Step 4/5] [2021-11-19 21:03:48,835][INFO ][main][GridCacheProcessor] Restoring partition state for local groups. [21:03:48] : [Step 4/5] [2021-11-19 21:03:48,835][INFO ][main][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=0, partitionsProcessed=0, time=0ms] [21:03:48] : [Step 4/5] [2021-11-19 21:03:48,836][INFO ][main][GridEncryptionManager] Encryption keys loaded from metastore. [grps=, masterKeyName=ignite.master.key] [21:03:48] : [Step 4/5] [2021-11-19 21:03:48,837][INFO ][main][ClusterProcessor] Cluster ID and tag has been read from metastorage: null [21:03:48] : [Step 4/5] [2021-11-19 21:03:48,838][INFO ][main][IgniteClusterImpl] Shutdown policy was updated [oldVal=null, newVal=null] [21:03:48] : [Step 4/5] [2021-11-19 21:03:48,838][INFO ][main][GridCacheDatabaseSharedManager] Checkpoint frequency deviation changed [oldVal=null, newVal=null] [21:03:48] : [Step 4/5] [2021-11-19 21:03:48,848][INFO ][main][FilePageStoreManager] Cleanup cache stores [total=1, left=0, cleanFiles=false] [21:03:48] : [Step 4/5] [2021-11-19 21:03:48,851][INFO ][main][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:03:48] : [Step 4/5] [2021-11-19 21:03:48,853][INFO ][main][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:03:48] : [Step 4/5] [2021-11-19 21:03:48,854][INFO ][main][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:03:48] : [Step 4/5] [2021-11-19 21:03:48,854][INFO ][main][GridCacheDatabaseSharedManager] Data Regions Started: 6 [21:03:48] : [Step 4/5] [2021-11-19 21:03:48,855][INFO ][main][GridCacheDatabaseSharedManager] ^-- sysMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:03:48] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:03:48] : [Step 4/5] ^-- no-persistence-region region [type=user, persistence=false, lazyAlloc=true, [21:03:48] : [Step 4/5] ... initCfg=10MB, maxCfg=10MB, usedRam=0MB, freeRam=100%, allocRam=0MB] [21:03:48] : [Step 4/5] ^-- default region [type=default, persistence=true, lazyAlloc=true, [21:03:48] : [Step 4/5] ... initCfg=10MB, maxCfg=10MB, usedRam=0MB, freeRam=100%, allocRam=0MB, allocTotal=0MB] [21:03:48] : [Step 4/5] ^-- metastoreMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:03:48] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:03:48] : [Step 4/5] ^-- TxLog region [type=internal, persistence=true, lazyAlloc=false, [21:03:48] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:03:48] : [Step 4/5] ^-- volatileDsMemPlc region [type=user, persistence=false, lazyAlloc=true, [21:03:48] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB] [21:03:48] : [Step 4/5] ^-- Ignite persistence [used=0MB] [21:03:48] : [Step 4/5] [21:03:48] : [Step 4/5] [2021-11-19 21:03:48,857][INFO ][main][GridCacheDatabaseSharedManager] Starting binary memory restore for: [-2100569601] [21:03:48] : [Step 4/5] [2021-11-19 21:03:48,875][INFO ][main][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:03:48] : [Step 4/5] [2021-11-19 21:03:48,875][INFO ][main][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:03:48] : [Step 4/5] [2021-11-19 21:03:48,877][INFO ][main][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/encryption_EncryptedCacheCreateTest1/0000000000000000.wal, offset=0, ver=2] [21:03:48] : [Step 4/5] [2021-11-19 21:03:48,882][INFO ][main][GridCacheProcessor] Started cache in recovery mode [name=ignite-sys-cache, id=-2100569601, dataRegionName=sysMemPlc, mode=REPLICATED, atomicity=TRANSACTIONAL, backups=2147483647, mvcc=false] [21:03:48] : [Step 4/5] [2021-11-19 21:03:48,883][INFO ][main][GridCacheDatabaseSharedManager] Binary recovery performed in 26 ms. [21:03:48] : [Step 4/5] [2021-11-19 21:03:48,884][INFO ][main][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:03:48] : [Step 4/5] [2021-11-19 21:03:48,884][INFO ][main][GridCacheDatabaseSharedManager] Applying lost cache updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:03:48] : [Step 4/5] [2021-11-19 21:03:48,950][INFO ][main][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=61 ms] [21:03:48] : [Step 4/5] [2021-11-19 21:03:48,950][INFO ][main][GridCacheProcessor] Restoring partition state for local groups. [21:03:48] : [Step 4/5] [2021-11-19 21:03:48,962][INFO ][main][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=1, partitionsProcessed=100, time=10ms] [21:03:49] : [Step 4/5] [2021-11-19 21:03:49,305][INFO ][main][TestTcpDiscoverySpi] Successfully bound to TCP port [port=47501, localHost=localhost/127.0.0.1, locNodeId=71f225f9-326e-4c95-a94c-24dd0fc00001] [21:03:49] : [Step 4/5] [2021-11-19 21:03:49,309][INFO ][tcp-disco-srvr-[:47500]-#293%encryption.EncryptedCacheCreateTest0%-#5922%encryption.EncryptedCacheCreateTest0%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=39033] [21:03:49] : [Step 4/5] [2021-11-19 21:03:49,309][INFO ][tcp-disco-srvr-[:47500]-#293%encryption.EncryptedCacheCreateTest0%-#5922%encryption.EncryptedCacheCreateTest0%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=39033] [21:03:49] : [Step 4/5] [2021-11-19 21:03:49,310][INFO ][tcp-disco-sock-reader-[]-#299%encryption.EncryptedCacheCreateTest0%-#6041%encryption.EncryptedCacheCreateTest0%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:39033, rmtPort=39033] [21:03:49] : [Step 4/5] [2021-11-19 21:03:49,314][INFO ][tcp-disco-sock-reader-[71f225f9 127.0.0.1:39033]-#299%encryption.EncryptedCacheCreateTest0%-#6041%encryption.EncryptedCacheCreateTest0%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=71f225f9-326e-4c95-a94c-24dd0fc00001, rmtAddr=/127.0.0.1:39033] [21:03:49] : [Step 4/5] [2021-11-19 21:03:49,325][INFO ][tcp-disco-srvr-[:47501]-#298%encryption.EncryptedCacheCreateTest1%-#6040%encryption.EncryptedCacheCreateTest1%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=54785] [21:03:49] : [Step 4/5] [2021-11-19 21:03:49,325][INFO ][tcp-disco-srvr-[:47501]-#298%encryption.EncryptedCacheCreateTest1%-#6040%encryption.EncryptedCacheCreateTest1%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=54785] [21:03:49] : [Step 4/5] [2021-11-19 21:03:49,326][INFO ][tcp-disco-sock-reader-[]-#300%encryption.EncryptedCacheCreateTest1%-#6042%encryption.EncryptedCacheCreateTest1%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:54785, rmtPort=54785] [21:03:49] : [Step 4/5] [2021-11-19 21:03:49,327][INFO ][tcp-disco-sock-reader-[]-#300%encryption.EncryptedCacheCreateTest1%-#6042%encryption.EncryptedCacheCreateTest1%][TestTcpDiscoverySpi] Received ping request from the remote node [rmtNodeId=332f4457-a30f-4f84-b266-78c71e300000, rmtAddr=/127.0.0.1:54785, rmtPort=54785] [21:03:49] : [Step 4/5] [2021-11-19 21:03:49,329][INFO ][tcp-disco-sock-reader-[]-#300%encryption.EncryptedCacheCreateTest1%-#6042%encryption.EncryptedCacheCreateTest1%][TestTcpDiscoverySpi] Finished writing ping response [rmtNodeId=332f4457-a30f-4f84-b266-78c71e300000, rmtAddr=/127.0.0.1:54785, rmtPort=54785] [21:03:49]W: [org.apache.ignite:ignite-core] [2021-11-19 21:03:49,329][WARN ][tcp-disco-sock-reader-[]-#300%encryption.EncryptedCacheCreateTest1%-#6042%encryption.EncryptedCacheCreateTest1%][TestTcpDiscoverySpi] Failed to shutdown socket [21:03:49]W: [org.apache.ignite:ignite-core] java.net.SocketException: Socket output is already shutdown [21:03:49]W: [org.apache.ignite:ignite-core] at java.net.Socket.shutdownOutput(Socket.java:1572) [21:03:49]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.close(IgniteUtils.java:4247) [21:03:49]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.discovery.tcp.ServerImpl$SocketReader.body(ServerImpl.java:7370) [21:03:49]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.IgniteSpiThread.run(IgniteSpiThread.java:58) [21:03:49] : [Step 4/5] [2021-11-19 21:03:49,329][INFO ][tcp-disco-sock-reader-[71f225f9 127.0.0.1:39033]-#299%encryption.EncryptedCacheCreateTest0%-#6041%encryption.EncryptedCacheCreateTest0%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:39033, rmtPort=39033, rmtNodeId=71f225f9-326e-4c95-a94c-24dd0fc00001] [21:03:49] : [Step 4/5] [2021-11-19 21:03:49,332][INFO ][tcp-disco-sock-reader-[]-#300%encryption.EncryptedCacheCreateTest1%-#6042%encryption.EncryptedCacheCreateTest1%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:54785, rmtPort=54785, rmtNodeId=null] [21:03:49] : [Step 4/5] [2021-11-19 21:03:49,334][INFO ][tcp-disco-msg-worker-[crd]-#292%encryption.EncryptedCacheCreateTest0%-#5921%encryption.EncryptedCacheCreateTest0%][GridEncryptionManager] Joining node doesn't have stored group keys [node=71f225f9-326e-4c95-a94c-24dd0fc00001] [21:03:49] : [Step 4/5] [2021-11-19 21:03:49,348][INFO ][tcp-disco-msg-worker-[crd]-#292%encryption.EncryptedCacheCreateTest0%-#5921%encryption.EncryptedCacheCreateTest0%][TestTcpDiscoverySpi] New next node [newNext=TcpDiscoveryNode [id=71f225f9-326e-4c95-a94c-24dd0fc00001, consistentId=encryption.EncryptedCacheCreateTest1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=0, intOrder=2, lastExchangeTime=1637345029316, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false]] [21:03:49] : [Step 4/5] [2021-11-19 21:03:49,350][INFO ][tcp-disco-srvr-[:47501]-#298%encryption.EncryptedCacheCreateTest1%-#6040%encryption.EncryptedCacheCreateTest1%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=47987] [21:03:49] : [Step 4/5] [2021-11-19 21:03:49,350][INFO ][tcp-disco-srvr-[:47501]-#298%encryption.EncryptedCacheCreateTest1%-#6040%encryption.EncryptedCacheCreateTest1%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=47987] [21:03:49] : [Step 4/5] [2021-11-19 21:03:49,351][INFO ][tcp-disco-sock-reader-[]-#301%encryption.EncryptedCacheCreateTest1%-#6043%encryption.EncryptedCacheCreateTest1%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:47987, rmtPort=47987] [21:03:49] : [Step 4/5] [2021-11-19 21:03:49,352][INFO ][tcp-disco-sock-reader-[332f4457 127.0.0.1:47987]-#301%encryption.EncryptedCacheCreateTest1%-#6043%encryption.EncryptedCacheCreateTest1%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=332f4457-a30f-4f84-b266-78c71e300000, rmtAddr=/127.0.0.1:47987] [21:03:49] : [Step 4/5] [2021-11-19 21:03:49,356][INFO ][tcp-disco-msg-worker-[]-#297%encryption.EncryptedCacheCreateTest1%-#6039%encryption.EncryptedCacheCreateTest1%][TestTcpDiscoverySpi] New next node [newNext=TcpDiscoveryNode [id=332f4457-a30f-4f84-b266-78c71e300000, consistentId=encryption.EncryptedCacheCreateTest0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345029346, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false]] [21:03:49] : [Step 4/5] [2021-11-19 21:03:49,357][INFO ][tcp-disco-srvr-[:47500]-#293%encryption.EncryptedCacheCreateTest0%-#5922%encryption.EncryptedCacheCreateTest0%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=44511] [21:03:49] : [Step 4/5] [2021-11-19 21:03:49,358][INFO ][tcp-disco-srvr-[:47500]-#293%encryption.EncryptedCacheCreateTest0%-#5922%encryption.EncryptedCacheCreateTest0%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=44511] [21:03:49] : [Step 4/5] [2021-11-19 21:03:49,358][INFO ][tcp-disco-sock-reader-[]-#302%encryption.EncryptedCacheCreateTest0%-#6044%encryption.EncryptedCacheCreateTest0%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:44511, rmtPort=44511] [21:03:49] : [Step 4/5] [2021-11-19 21:03:49,360][INFO ][tcp-disco-sock-reader-[71f225f9 127.0.0.1:44511]-#302%encryption.EncryptedCacheCreateTest0%-#6044%encryption.EncryptedCacheCreateTest0%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=71f225f9-326e-4c95-a94c-24dd0fc00001, rmtAddr=/127.0.0.1:44511] [21:03:49] : [Step 4/5] [2021-11-19 21:03:49,362][INFO ][disco-event-worker-#5924%encryption.EncryptedCacheCreateTest0%][GridDiscoveryManager] Added new node to topology: TcpDiscoveryNode [id=71f225f9-326e-4c95-a94c-24dd0fc00001, consistentId=encryption.EncryptedCacheCreateTest1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637345029316, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false] [21:03:49] : [Step 4/5] [2021-11-19 21:03:49,363][INFO ][disco-event-worker-#5924%encryption.EncryptedCacheCreateTest0%][GridDiscoveryManager] Topology snapshot [ver=2, locNode=332f4457, servers=2, clients=0, state=INACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=332f4457-a30f-4f84-b266-78c71e300000, consistentId=encryption.EncryptedCacheCreateTest0, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=71f225f9-326e-4c95-a94c-24dd0fc00001, consistentId=encryption.EncryptedCacheCreateTest1, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:03:49] : [Step 4/5] [2021-11-19 21:03:49,366][INFO ][tcp-disco-msg-worker-[332f4457 127.0.0.1:47500]-#297%encryption.EncryptedCacheCreateTest1%-#6039%encryption.EncryptedCacheCreateTest1%][ClusterProcessor] nervous_pasteur [21:03:49] : [Step 4/5] [2021-11-19 21:03:49,366][INFO ][tcp-disco-msg-worker-[332f4457 127.0.0.1:47500]-#297%encryption.EncryptedCacheCreateTest1%-#6039%encryption.EncryptedCacheCreateTest1%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustEnabled' was changed from 'null' to 'false' [21:03:49] : [Step 4/5] [2021-11-19 21:03:49,366][INFO ][tcp-disco-msg-worker-[332f4457 127.0.0.1:47500]-#297%encryption.EncryptedCacheCreateTest1%-#6039%encryption.EncryptedCacheCreateTest1%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustTimeout' was changed from 'null' to '300000' [21:03:49] : [Step 4/5] [2021-11-19 21:03:49,367][INFO ][tcp-disco-msg-worker-[332f4457 127.0.0.1:47500]-#297%encryption.EncryptedCacheCreateTest1%-#6039%encryption.EncryptedCacheCreateTest1%][IgniteTxManager] Transactions parameter 'longOperationsDumpTimeout' was changed from 'null' to '60000' [21:03:49] : [Step 4/5] [2021-11-19 21:03:49,367][INFO ][tcp-disco-msg-worker-[332f4457 127.0.0.1:47500]-#297%encryption.EncryptedCacheCreateTest1%-#6039%encryption.EncryptedCacheCreateTest1%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpThreshold' was changed from 'null' to '0' [21:03:49] : [Step 4/5] [2021-11-19 21:03:49,368][INFO ][tcp-disco-msg-worker-[332f4457 127.0.0.1:47500]-#297%encryption.EncryptedCacheCreateTest1%-#6039%encryption.EncryptedCacheCreateTest1%][IgniteTxManager] Transactions parameter 'transactionTimeDumpSamplesCoefficient' was changed from 'null' to '0.0' [21:03:49] : [Step 4/5] [2021-11-19 21:03:49,368][INFO ][tcp-disco-msg-worker-[332f4457 127.0.0.1:47500]-#297%encryption.EncryptedCacheCreateTest1%-#6039%encryption.EncryptedCacheCreateTest1%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpSamplesPerSecondLimit' was changed from 'null' to '5' [21:03:49] : [Step 4/5] [2021-11-19 21:03:49,368][INFO ][tcp-disco-msg-worker-[332f4457 127.0.0.1:47500]-#297%encryption.EncryptedCacheCreateTest1%-#6039%encryption.EncryptedCacheCreateTest1%][IgniteTxManager] Transactions parameter 'collisionsDumpInterval' was changed from 'null' to '1000' [21:03:49] : [Step 4/5] [2021-11-19 21:03:49,369][INFO ][tcp-disco-msg-worker-[332f4457 127.0.0.1:47500]-#297%encryption.EncryptedCacheCreateTest1%-#6039%encryption.EncryptedCacheCreateTest1%][IgniteTxManager] Transactions parameter 'txOwnerDumpRequestsAllowed' was changed from 'null' to 'true' [21:03:49] : [Step 4/5] [2021-11-19 21:03:49,369][INFO ][tcp-disco-msg-worker-[332f4457 127.0.0.1:47500]-#297%encryption.EncryptedCacheCreateTest1%-#6039%encryption.EncryptedCacheCreateTest1%][GridCacheDatabaseSharedManager] Historical rebalance WAL threshold changed [property=historical.rebalance.threshold, oldVal=null, newVal=500] [21:03:49] : [Step 4/5] [2021-11-19 21:03:49,371][INFO ][disco-notifier-worker-#6038%encryption.EncryptedCacheCreateTest1%][MvccProcessorImpl] Assigned mvcc coordinator [crd=MvccCoordinator [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=0], nodeId=332f4457-a30f-4f84-b266-78c71e300000, ver=1637345028115, local=false, initialized=false]] [21:03:49] : [Step 4/5] [2021-11-19 21:03:49,373][INFO ][sys-#6037%encryption.EncryptedCacheCreateTest1%][ClusterProcessor] Writing cluster ID and tag to metastorage on ready for write ClusterIdAndTag [id=e9d5dba5-52d6-4577-8410-fc5586055479, tag=nervous_pasteur] [21:03:49] : [Step 4/5] [2021-11-19 21:03:49,388][INFO ][main][EncryptedCacheCreateTest1] To start Console Management & Monitoring run ignitevisorcmd.{sh|bat} [21:03:49] : [Step 4/5] [2021-11-19 21:03:49,389][INFO ][main][EncryptedCacheCreateTest1] [21:03:49] : [Step 4/5] [21:03:49] : [Step 4/5] >>> +-------------------------------------------+ [21:03:49] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:03:49] : [Step 4/5] >>> +-------------------------------------------+ [21:03:49] : [Step 4/5] >>> OS name: Linux 4.15.0-151-generic amd64 [21:03:49] : [Step 4/5] >>> CPU(s): 24 [21:03:49] : [Step 4/5] >>> Heap: 2.0GB [21:03:49] : [Step 4/5] >>> VM name: 16724@c4dfe9a430b2 [21:03:49] : [Step 4/5] >>> Ignite instance name: encryption.EncryptedCacheCreateTest1 [21:03:49] : [Step 4/5] >>> Local node [ID=71F225F9-326E-4C95-A94C-24DD0FC00001, order=2, clientMode=false] [21:03:49] : [Step 4/5] >>> Local node addresses: [127.0.0.1] [21:03:49] : [Step 4/5] >>> Local ports: TCP:10801 TCP:45121 TCP:47501 [21:03:49] : [Step 4/5] [21:03:49] : [Step 4/5] [2021-11-19 21:03:49,389][INFO ][main][EncryptedCacheCreateTest1] >>> Ignite cluster is in INACTIVE state (limited functionality available). Use control.(sh|bat) script or IgniteCluster.state(ClusterState.ACTIVE) to change the state. [21:03:49] : [Step 4/5] [2021-11-19 21:03:49,390][INFO ][main][GridDiscoveryManager] Topology snapshot [ver=2, locNode=71f225f9, servers=2, clients=0, state=INACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=332f4457-a30f-4f84-b266-78c71e300000, consistentId=encryption.EncryptedCacheCreateTest0, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=71f225f9-326e-4c95-a94c-24dd0fc00001, consistentId=encryption.EncryptedCacheCreateTest1, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:03:49] : [Step 4/5] [2021-11-19 21:03:49,391][INFO ][main][G] Node started : [stage="Configure system pool" (0 ms),stage="Start managers" (238 ms),stage="Configure binary metadata" (4 ms),stage="Start processors" (421 ms),stage="Start 'StanByClusterTestProvider' plugin" (0 ms),stage="Start 'PageMemory tracker plugin' plugin" (0 ms),stage="Start 'TestDistibutedConfigurationPlugin' plugin" (0 ms),stage="Start 'NodeValidationPluginProvider' plugin" (0 ms),stage="Init metastore" (18 ms),stage="Init and start regions" (9 ms),stage="Restore binary memory" (26 ms),stage="Restore logical state" (79 ms),stage="Finish recovery" (338 ms),stage="Join topology" (70 ms),stage="Await transition" (2 ms),stage="Await exchange" (16 ms),stage="Total time" (1221 ms)] [21:03:49] : [Step 4/5] [2021-11-19 21:03:49,392][INFO ][main][root] Node started with the following configuration [id=71f225f9-326e-4c95-a94c-24dd0fc00001, marshaller=BinaryMarshaller [], discovery=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=5000, ackTimeout=5000, marsh=JdkMarshaller [clsFilter=org.apache.ignite.marshaller.MarshallerUtils$1@7df28f1], reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], binaryCfg=null, lateAff=true] [21:03:49] : [Step 4/5] [2021-11-19 21:03:49,393][INFO ][main][GridClusterStateProcessor] Sending activate cluster request with BaselineTopology BaselineTopology [id=0, branchingHash=-3724515085, branchingType='New BaselineTopology', baselineNodes=[encryption.EncryptedCacheCreateTest0, encryption.EncryptedCacheCreateTest1]] [21:03:49] : [Step 4/5] [2021-11-19 21:03:49,398][INFO ][disco-notifier-worker-#5920%encryption.EncryptedCacheCreateTest0%][GridClusterStateProcessor] Received activate cluster request with BaselineTopology[id=0] initiator node ID: 332f4457-a30f-4f84-b266-78c71e300000 [21:03:49] : [Step 4/5] [2021-11-19 21:03:49,399][INFO ][disco-notifier-worker-#5920%encryption.EncryptedCacheCreateTest0%][GridClusterStateProcessor] Started state transition: activate cluster [21:03:49] : [Step 4/5] [2021-11-19 21:03:49,400][INFO ][exchange-worker-#5925%encryption.EncryptedCacheCreateTest0%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], crd=true, evt=DISCOVERY_CUSTOM_EVT, evtNode=332f4457-a30f-4f84-b266-78c71e300000, customEvt=ChangeGlobalStateMessage [id=a161d593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqId=81af2fa7-3439-4c08-b6d6-b91469a9bce9, initiatingNodeId=332f4457-a30f-4f84-b266-78c71e300000, state=ACTIVE, baselineTopology=BaselineTopology [id=0, branchingHash=-3724515085, branchingType='New BaselineTopology', baselineNodes=[encryption.EncryptedCacheCreateTest0, encryption.EncryptedCacheCreateTest1]], forceChangeBaselineTopology=false, timestamp=1637345029393, forceDeactivation=true], allowMerge=false, exchangeFreeSwitch=false] [21:03:49] : [Step 4/5] [2021-11-19 21:03:49,400][INFO ][disco-notifier-worker-#6038%encryption.EncryptedCacheCreateTest1%][GridClusterStateProcessor] Received activate cluster request with BaselineTopology[id=0] initiator node ID: 332f4457-a30f-4f84-b266-78c71e300000 [21:03:49] : [Step 4/5] [2021-11-19 21:03:49,402][INFO ][exchange-worker-#5925%encryption.EncryptedCacheCreateTest0%][GridDhtPartitionsExchangeFuture] Start activation process [nodeId=332f4457-a30f-4f84-b266-78c71e300000, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]]. New state: ACTIVE [21:03:49] : [Step 4/5] [2021-11-19 21:03:49,402][INFO ][disco-notifier-worker-#6038%encryption.EncryptedCacheCreateTest1%][GridClusterStateProcessor] Started state transition: activate cluster [21:03:49] : [Step 4/5] [2021-11-19 21:03:49,403][INFO ][exchange-worker-#5925%encryption.EncryptedCacheCreateTest0%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/encryption_EncryptedCacheCreateTest0 [21:03:49] : [Step 4/5] [2021-11-19 21:03:49,404][INFO ][exchange-worker-#6047%encryption.EncryptedCacheCreateTest1%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], crd=false, evt=DISCOVERY_CUSTOM_EVT, evtNode=332f4457-a30f-4f84-b266-78c71e300000, customEvt=ChangeGlobalStateMessage [id=a161d593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqId=81af2fa7-3439-4c08-b6d6-b91469a9bce9, initiatingNodeId=332f4457-a30f-4f84-b266-78c71e300000, state=ACTIVE, baselineTopology=BaselineTopology [id=0, branchingHash=-3724515085, branchingType='New BaselineTopology', baselineNodes=[encryption.EncryptedCacheCreateTest0, encryption.EncryptedCacheCreateTest1]], forceChangeBaselineTopology=false, timestamp=1637345029393, forceDeactivation=true], allowMerge=false, exchangeFreeSwitch=false] [21:03:49] : [Step 4/5] [2021-11-19 21:03:49,406][INFO ][exchange-worker-#6047%encryption.EncryptedCacheCreateTest1%][GridDhtPartitionsExchangeFuture] Start activation process [nodeId=71f225f9-326e-4c95-a94c-24dd0fc00001, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]]. New state: ACTIVE [21:03:49] : [Step 4/5] [2021-11-19 21:03:49,406][INFO ][exchange-worker-#5925%encryption.EncryptedCacheCreateTest0%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/encryption_EncryptedCacheCreateTest0/0000000000000000.wal, offset=8713, ver=2] [21:03:49] : [Step 4/5] [2021-11-19 21:03:49,407][INFO ][exchange-worker-#6047%encryption.EncryptedCacheCreateTest1%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/encryption_EncryptedCacheCreateTest1 [21:03:49] : [Step 4/5] [2021-11-19 21:03:49,409][INFO ][exchange-worker-#5925%encryption.EncryptedCacheCreateTest0%][GridClusterStateProcessor] Writing BaselineTopology[id=0] [21:03:49] : [Step 4/5] [2021-11-19 21:03:49,412][INFO ][exchange-worker-#6047%encryption.EncryptedCacheCreateTest1%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/encryption_EncryptedCacheCreateTest1/0000000000000000.wal, offset=8713, ver=2] [21:03:49] : [Step 4/5] [2021-11-19 21:03:49,415][INFO ][exchange-worker-#6047%encryption.EncryptedCacheCreateTest1%][GridClusterStateProcessor] Writing BaselineTopology[id=0] [21:03:49] : [Step 4/5] [2021-11-19 21:03:49,416][INFO ][exchange-worker-#5925%encryption.EncryptedCacheCreateTest0%][GridCacheDatabaseSharedManager] Finish recovery performed in 12 ms. [21:03:49] : [Step 4/5] [2021-11-19 21:03:49,419][INFO ][exchange-worker-#5925%encryption.EncryptedCacheCreateTest0%][msg] Components activation performed in 16 ms. [21:03:49] : [Step 4/5] [2021-11-19 21:03:49,421][INFO ][exchange-worker-#5925%encryption.EncryptedCacheCreateTest0%][GridCacheProcessor] Finished recovery for cache [cache=ignite-sys-cache, grp=ignite-sys-cache, startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:03:49] : [Step 4/5] [2021-11-19 21:03:49,422][INFO ][exchange-worker-#6047%encryption.EncryptedCacheCreateTest1%][GridCacheDatabaseSharedManager] Finish recovery performed in 13 ms. [21:03:49] : [Step 4/5] [2021-11-19 21:03:49,422][INFO ][exchange-worker-#5925%encryption.EncryptedCacheCreateTest0%][GridDhtPartitionsExchangeFuture] Successfully activated caches [nodeId=332f4457-a30f-4f84-b266-78c71e300000, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], newState=ACTIVE] [21:03:49] : [Step 4/5] [2021-11-19 21:03:49,423][INFO ][exchange-worker-#6047%encryption.EncryptedCacheCreateTest1%][msg] Components activation performed in 16 ms. [21:03:49] : [Step 4/5] [2021-11-19 21:03:49,424][INFO ][exchange-worker-#5925%encryption.EncryptedCacheCreateTest0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:03:49] : [Step 4/5] [2021-11-19 21:03:49,425][INFO ][exchange-worker-#6047%encryption.EncryptedCacheCreateTest1%][GridCacheProcessor] Finished recovery for cache [cache=ignite-sys-cache, grp=ignite-sys-cache, startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:03:49] : [Step 4/5] [2021-11-19 21:03:49,426][INFO ][exchange-worker-#6047%encryption.EncryptedCacheCreateTest1%][GridDhtPartitionsExchangeFuture] Successfully activated caches [nodeId=71f225f9-326e-4c95-a94c-24dd0fc00001, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], newState=ACTIVE] [21:03:49] : [Step 4/5] [2021-11-19 21:03:49,427][INFO ][exchange-worker-#6047%encryption.EncryptedCacheCreateTest1%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:03:49] : [Step 4/5] [2021-11-19 21:03:49,455][INFO ][exchange-worker-#5925%encryption.EncryptedCacheCreateTest0%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], crd=true] [21:03:49] : [Step 4/5] [2021-11-19 21:03:49,456][INFO ][grid-nio-worker-tcp-comm-0-#5864%TcpCommunicationSpi%][TcpCommunicationSpi] Accepted incoming communication connection [locAddr=/127.0.0.1:45120, rmtAddr=/127.0.0.1:50464] [21:03:49] : [Step 4/5] [2021-11-19 21:03:49,456][INFO ][db-checkpoint-thread-#6057%encryption.EncryptedCacheCreateTest1%][Checkpointer] Checkpoint started [checkpointId=3fa7f38f-d734-4f99-b713-3b7139eba762, startPtr=WALPointer [idx=0, fileOff=81434, len=1963], checkpointBeforeLockTime=8ms, checkpointLockWait=5ms, checkpointListenersExecuteTime=1ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=1ms, writeCheckpointEntryDuration=2ms, splitAndSortCpPagesDuration=1ms, pages=17, reason='node started'] [21:03:49] : [Step 4/5] [2021-11-19 21:03:49,458][INFO ][grid-nio-worker-tcp-comm-0-#5982%TcpCommunicationSpi%][TcpCommunicationSpi] Established outgoing communication connection [locAddr=/127.0.0.1:50464, rmtAddr=/127.0.0.1:45120] [21:03:49] : [Step 4/5] [2021-11-19 21:03:49,458][INFO ][exchange-worker-#6047%encryption.EncryptedCacheCreateTest1%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], crd=false] [21:03:49] : [Step 4/5] [2021-11-19 21:03:49,459][INFO ][db-checkpoint-thread-#6056%encryption.EncryptedCacheCreateTest0%][Checkpointer] Checkpoint started [checkpointId=4a6ffa94-318f-4c46-9357-f9f79a2af536, startPtr=WALPointer [idx=0, fileOff=85102, len=1963], checkpointBeforeLockTime=10ms, checkpointLockWait=8ms, checkpointListenersExecuteTime=1ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=0ms, writeCheckpointEntryDuration=4ms, splitAndSortCpPagesDuration=0ms, pages=17, reason='node started'] [21:03:49] : [Step 4/5] [2021-11-19 21:03:49,461][INFO ][sys-#5902%encryption.EncryptedCacheCreateTest0%][GridDhtPartitionsExchangeFuture] Coordinator received single message [ver=AffinityTopologyVersion [topVer=2, minorTopVer=1], node=71f225f9-326e-4c95-a94c-24dd0fc00001, allReceived=true] [21:03:49] : [Step 4/5] [2021-11-19 21:03:49,461][INFO ][sys-#5902%encryption.EncryptedCacheCreateTest0%][GridDhtPartitionsExchangeFuture] finishExchangeOnCoordinator [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:03:49] : [Step 4/5] [2021-11-19 21:03:49,470][INFO ][sys-#5902%encryption.EncryptedCacheCreateTest0%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], err=null, rebalanced=true, wasRebalanced=false] [21:03:49] : [Step 4/5] [2021-11-19 21:03:49,478][INFO ][disco-notifier-worker-#5920%encryption.EncryptedCacheCreateTest0%][GridClusterStateProcessor] Received state change finish message: ACTIVE [21:03:49] : [Step 4/5] [2021-11-19 21:03:49,478][INFO ][disco-notifier-worker-#5920%encryption.EncryptedCacheCreateTest0%][GridClusterStateProcessor] Cluster state was changed from INACTIVE to ACTIVE [21:03:49] : [Step 4/5] [2021-11-19 21:03:49,479][INFO ][disco-notifier-worker-#6038%encryption.EncryptedCacheCreateTest1%][GridClusterStateProcessor] Received state change finish message: ACTIVE [21:03:49] : [Step 4/5] [2021-11-19 21:03:49,479][INFO ][disco-notifier-worker-#6038%encryption.EncryptedCacheCreateTest1%][GridClusterStateProcessor] Cluster state was changed from INACTIVE to ACTIVE [21:03:49] : [Step 4/5] [2021-11-19 21:03:49,485][INFO ][sys-#6022%encryption.EncryptedCacheCreateTest1%][GridDhtPartitionsExchangeFuture] Received full message, will finish exchange [node=332f4457-a30f-4f84-b266-78c71e300000, resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:03:49] : [Step 4/5] [2021-11-19 21:03:49,486][INFO ][sys-#6021%encryption.EncryptedCacheCreateTest1%][GridCachePartitionExchangeManager] Delay process full message without exchange id (there is exchange in progress) [nodeId=332f4457-a30f-4f84-b266-78c71e300000] [21:03:49] : [Step 4/5] [2021-11-19 21:03:49,486][INFO ][db-checkpoint-thread-#6057%encryption.EncryptedCacheCreateTest1%][Checkpointer] Checkpoint finished [cpId=3fa7f38f-d734-4f99-b713-3b7139eba762, pages=17, markPos=WALPointer [idx=0, fileOff=81434, len=1963], walSegmentsCovered=[], markDuration=6ms, pagesWrite=3ms, fsync=26ms, total=48ms] [21:03:49] : [Step 4/5] [2021-11-19 21:03:49,488][INFO ][sys-#5902%encryption.EncryptedCacheCreateTest0%][GridCacheProcessor] Finish proxy initialization, cacheName=ignite-sys-cache, localNodeId=332f4457-a30f-4f84-b266-78c71e300000 [21:03:49] : [Step 4/5] [2021-11-19 21:03:49,489][INFO ][sys-#6022%encryption.EncryptedCacheCreateTest1%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], err=null, rebalanced=true, wasRebalanced=false] [21:03:49] : [Step 4/5] [2021-11-19 21:03:49,490][INFO ][sys-#5902%encryption.EncryptedCacheCreateTest0%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=332f4457-a30f-4f84-b266-78c71e300000, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=332f4457-a30f-4f84-b266-78c71e300000, consistentId=encryption.EncryptedCacheCreateTest0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345029478, loc=true, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:03:49] : [Step 4/5] [2021-11-19 21:03:49,490][INFO ][exchange-worker-#5925%encryption.EncryptedCacheCreateTest0%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=2, minorTopVer=1], force=false, evt=DISCOVERY_CUSTOM_EVT, node=332f4457-a30f-4f84-b266-78c71e300000] [21:03:49] : [Step 4/5] [2021-11-19 21:03:49,489][INFO ][sys-#5915%encryption.EncryptedCacheCreateTest0%][DistributedBaselineConfiguration] Baseline auto-adjust is 'disabled' with timeout='300000' ms [21:03:49] : [Step 4/5] [2021-11-19 21:03:49,494][INFO ][sys-#5902%encryption.EncryptedCacheCreateTest0%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (2 ms), stage="Update caches registry" (18 ms), stage="Start caches" (0 ms), stage="Affinity initialization on cache group start" (0 ms), stage="Determine exchange type" (2 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Restore partition states" (0 ms), stage="After states restored callback" (29 ms), stage="WAL history reservation" (0 ms), stage="Waiting for all single messages" (6 ms), stage="Affinity recalculation (crd)" (0 ms), stage="Collect update counters and create affinity messages" (0 ms), stage="Assign partitions states" (0 ms), stage="Validate partitions states" (0 ms), stage="Ideal affinity diff calculation (enforced)" (0 ms), stage="Apply update counters" (0 ms), stage="Full message preparing" (5 ms), stage="Full message sending" (0 ms), stage="State finish message sending" (1 ms), stage="Detect lost partitions" (16 ms), stage="Exchange done" (6 ms), stage="Total time" (85 ms), Discovery lag=4 ms, Latest started node id=71f225f9-326e-4c95-a94c-24dd0fc00001] [21:03:49] : [Step 4/5] [2021-11-19 21:03:49,492][INFO ][db-checkpoint-thread-#6056%encryption.EncryptedCacheCreateTest0%][Checkpointer] Checkpoint finished [cpId=4a6ffa94-318f-4c46-9357-f9f79a2af536, pages=17, markPos=WALPointer [idx=0, fileOff=85102, len=1963], walSegmentsCovered=[], markDuration=7ms, pagesWrite=7ms, fsync=24ms, total=56ms] [21:03:49] : [Step 4/5] [2021-11-19 21:03:49,498][INFO ][sys-#5902%encryption.EncryptedCacheCreateTest0%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], stage="Affinity initialization on cache group start [grp=ignite-sys-cache]" (0 ms) (parent=Affinity initialization on cache group start), stage="Affinity centralized initialization (crd) [grp=ignite-sys-cache, crd=true]" (2 ms) (parent=Determine exchange type), stage="Restore partition states [grp=ignite-sys-cache]" (0 ms) (parent=Restore partition states), stage="Affinity recalculation (partitions availability) [grp=ignite-sys-cache]" (0 ms) (parent=Ideal affinity diff calculation (enforced))] [21:03:49] : [Step 4/5] [2021-11-19 21:03:49,495][INFO ][sys-#6022%encryption.EncryptedCacheCreateTest1%][GridCacheProcessor] Finish proxy initialization, cacheName=ignite-sys-cache, localNodeId=71f225f9-326e-4c95-a94c-24dd0fc00001 [21:03:49] : [Step 4/5] [2021-11-19 21:03:49,494][INFO ][sys-#5915%encryption.EncryptedCacheCreateTest0%][GridClusterStateProcessor] Successfully performed final activation steps [nodeId=332f4457-a30f-4f84-b266-78c71e300000, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:03:49] : [Step 4/5] [2021-11-19 21:03:49,501][INFO ][sys-#6033%encryption.EncryptedCacheCreateTest1%][DistributedBaselineConfiguration] Baseline auto-adjust is 'disabled' with timeout='300000' ms [21:03:49] : [Step 4/5] [2021-11-19 21:03:49,502][INFO ][sys-#6022%encryption.EncryptedCacheCreateTest1%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=71f225f9-326e-4c95-a94c-24dd0fc00001, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=332f4457-a30f-4f84-b266-78c71e300000, consistentId=encryption.EncryptedCacheCreateTest0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345029346, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:03:49] : [Step 4/5] [2021-11-19 21:03:49,502][INFO ][exchange-worker-#6047%encryption.EncryptedCacheCreateTest1%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=2, minorTopVer=1], force=false, evt=DISCOVERY_CUSTOM_EVT, node=332f4457-a30f-4f84-b266-78c71e300000] [21:03:49] : [Step 4/5] [2021-11-19 21:03:49,504][INFO ][sys-#6022%encryption.EncryptedCacheCreateTest1%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (2 ms), stage="Update caches registry" (18 ms), stage="Start caches" (0 ms), stage="Affinity initialization on cache group start" (0 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Restore partition states" (0 ms), stage="After states restored callback" (24 ms), stage="WAL history reservation" (0 ms), stage="Waiting for Full message" (33 ms), stage="Affinity recalculation" (0 ms), stage="Full map updating" (2 ms), stage="Detect lost partitions" (4 ms), stage="Exchange done" (9 ms), stage="Total time" (92 ms)] [21:03:49] : [Step 4/5] [2021-11-19 21:03:49,504][INFO ][main][root] awaitPartitionMapExchange finished [21:03:49] : [Step 4/5] [2021-11-19 21:03:49,502][INFO ][sys-#6033%encryption.EncryptedCacheCreateTest1%][GridClusterStateProcessor] Successfully performed final activation steps [nodeId=71f225f9-326e-4c95-a94c-24dd0fc00001, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:03:49] : [Step 4/5] [2021-11-19 21:03:49,505][INFO ][sys-#6022%encryption.EncryptedCacheCreateTest1%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], stage="Affinity initialization on cache group start [grp=ignite-sys-cache]" (0 ms) (parent=Affinity initialization on cache group start), stage="Affinity centralized initialization (crd) [grp=ignite-sys-cache, crd=false]" (0 ms) (parent=Determine exchange type), stage="Restore partition states [grp=ignite-sys-cache]" (0 ms) (parent=Restore partition states), stage="Affinity applying from full message [grp=ignite-sys-cache]" (0 ms) (parent=Affinity recalculation)] [21:03:49] : [Step 4/5] [2021-11-19 21:03:49,518][INFO ][exchange-worker-#5925%encryption.EncryptedCacheCreateTest0%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], crd=true, evt=DISCOVERY_CUSTOM_EVT, evtNode=332f4457-a30f-4f84-b266-78c71e300000, customEvt=DynamicCacheChangeBatch [id=e361d593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqs=ArrayList [DynamicCacheChangeRequest [cacheName=encrypted, hasCfg=true, nodeId=332f4457-a30f-4f84-b266-78c71e300000, clientStartOnly=false, stop=false, destroy=false, disabledAfterStart=false]], exchangeActions=ExchangeActions [startCaches=[encrypted], stopCaches=null, startGrps=[encrypted], stopGrps=[], resetParts=null, stateChangeRequest=null], startCaches=false], allowMerge=false, exchangeFreeSwitch=false] [21:03:49] : [Step 4/5] [2021-11-19 21:03:49,518][INFO ][exchange-worker-#6047%encryption.EncryptedCacheCreateTest1%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], crd=false, evt=DISCOVERY_CUSTOM_EVT, evtNode=332f4457-a30f-4f84-b266-78c71e300000, customEvt=DynamicCacheChangeBatch [id=e361d593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqs=ArrayList [DynamicCacheChangeRequest [cacheName=encrypted, hasCfg=true, nodeId=332f4457-a30f-4f84-b266-78c71e300000, clientStartOnly=false, stop=false, destroy=false, disabledAfterStart=false]], exchangeActions=ExchangeActions [startCaches=[encrypted], stopCaches=null, startGrps=[encrypted], stopGrps=[], resetParts=null, stateChangeRequest=null], startCaches=false], allowMerge=false, exchangeFreeSwitch=false] [21:03:49] : [Step 4/5] [2021-11-19 21:03:49,520][INFO ][exchange-worker-#5925%encryption.EncryptedCacheCreateTest0%][PageMemoryImpl] Started page memory [memoryAllocated=24.0 MiB, pages=5952, tableSize=474.2 KiB, replacementSize=768 B, checkpointBuffer=10.0 MiB] [21:03:49] : [Step 4/5] [2021-11-19 21:03:49,521][INFO ][exchange-worker-#6047%encryption.EncryptedCacheCreateTest1%][PageMemoryImpl] Started page memory [memoryAllocated=24.0 MiB, pages=5952, tableSize=474.2 KiB, replacementSize=768 B, checkpointBuffer=10.0 MiB] [21:03:49] : [Step 4/5] [2021-11-19 21:03:49,604][INFO ][exchange-worker-#5925%encryption.EncryptedCacheCreateTest0%][GridCacheProcessor] Started cache [name=encrypted, id=1613773252, dataRegionName=default, mode=PARTITIONED, atomicity=ATOMIC, backups=0, mvcc=false] [21:03:49]W: [org.apache.ignite:ignite-core] [2021-11-19 21:03:49,607][WARN ][exchange-worker-#5925%encryption.EncryptedCacheCreateTest0%][CacheAffinitySharedManager] Cache group 'encrypted' brings high overhead for its metainformation in data region 'default'. Metainformation required for its partitions (486 partitions, 4096 bytes per partition, 1 MBs total) will consume more than 15% of data region memory (10 MBs). It may lead to critical errors on the node and cluster instability. Please reduce number of partitions, add more memory to the data region or add more server nodes for this cache group. [21:03:49] : [Step 4/5] [2021-11-19 21:03:49,609][INFO ][exchange-worker-#5925%encryption.EncryptedCacheCreateTest0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], waitTime=0ms, futInfo=NA, mode=DISTRIBUTED] [21:03:49] : [Step 4/5] [2021-11-19 21:03:49,617][INFO ][exchange-worker-#6047%encryption.EncryptedCacheCreateTest1%][GridCacheProcessor] Started cache [name=encrypted, id=1613773252, dataRegionName=default, mode=PARTITIONED, atomicity=ATOMIC, backups=0, mvcc=false] [21:03:49]W: [org.apache.ignite:ignite-core] [2021-11-19 21:03:49,621][WARN ][exchange-worker-#6047%encryption.EncryptedCacheCreateTest1%][CacheAffinitySharedManager] Cache group 'encrypted' brings high overhead for its metainformation in data region 'default'. Metainformation required for its partitions (538 partitions, 4096 bytes per partition, 2 MBs total) will consume more than 15% of data region memory (10 MBs). It may lead to critical errors on the node and cluster instability. Please reduce number of partitions, add more memory to the data region or add more server nodes for this cache group. [21:03:49] : [Step 4/5] [2021-11-19 21:03:49,622][INFO ][exchange-worker-#6047%encryption.EncryptedCacheCreateTest1%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], waitTime=0ms, futInfo=NA, mode=DISTRIBUTED] [21:03:49] : [Step 4/5] [2021-11-19 21:03:49,624][INFO ][exchange-worker-#5925%encryption.EncryptedCacheCreateTest0%][GridDhtPartitionsExchangeFuture] Finished waiting for partitions release latch: ServerLatch [permits=0, pendingAcks=HashSet [], super=CompletableLatch [id=CompletableLatchUid [id=exchange, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2]]]] [21:03:49] : [Step 4/5] [2021-11-19 21:03:49,624][INFO ][exchange-worker-#6047%encryption.EncryptedCacheCreateTest1%][GridDhtPartitionsExchangeFuture] Finished waiting for partitions release latch: ClientLatch [coordinator=TcpDiscoveryNode [id=332f4457-a30f-4f84-b266-78c71e300000, consistentId=encryption.EncryptedCacheCreateTest0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345029346, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], ackSent=true, super=CompletableLatch [id=CompletableLatchUid [id=exchange, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2]]]] [21:03:49] : [Step 4/5] [2021-11-19 21:03:49,625][INFO ][exchange-worker-#5925%encryption.EncryptedCacheCreateTest0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:03:49] : [Step 4/5] [2021-11-19 21:03:49,625][INFO ][exchange-worker-#6047%encryption.EncryptedCacheCreateTest1%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:03:49] : [Step 4/5] [2021-11-19 21:03:49,676][INFO ][exchange-worker-#5925%encryption.EncryptedCacheCreateTest0%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], crd=true] [21:03:49] : [Step 4/5] [2021-11-19 21:03:49,684][INFO ][exchange-worker-#6047%encryption.EncryptedCacheCreateTest1%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], crd=false] [21:03:49] : [Step 4/5] [2021-11-19 21:03:49,686][INFO ][sys-#5898%encryption.EncryptedCacheCreateTest0%][GridDhtPartitionsExchangeFuture] Coordinator received single message [ver=AffinityTopologyVersion [topVer=2, minorTopVer=2], node=71f225f9-326e-4c95-a94c-24dd0fc00001, allReceived=true] [21:03:49] : [Step 4/5] [2021-11-19 21:03:49,686][INFO ][sys-#5898%encryption.EncryptedCacheCreateTest0%][GridDhtPartitionsExchangeFuture] finishExchangeOnCoordinator [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2]] [21:03:49] : [Step 4/5] [2021-11-19 21:03:49,696][INFO ][sys-#5898%encryption.EncryptedCacheCreateTest0%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], err=null, rebalanced=true, wasRebalanced=true] [21:03:49] : [Step 4/5] [2021-11-19 21:03:49,697][INFO ][sys-#6024%encryption.EncryptedCacheCreateTest1%][GridDhtPartitionsExchangeFuture] Received full message, will finish exchange [node=332f4457-a30f-4f84-b266-78c71e300000, resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2]] [21:03:49] : [Step 4/5] [2021-11-19 21:03:49,698][INFO ][sys-#5898%encryption.EncryptedCacheCreateTest0%][GridCacheProcessor] Finish proxy initialization, cacheName=encrypted, localNodeId=332f4457-a30f-4f84-b266-78c71e300000 [21:03:49] : [Step 4/5] [2021-11-19 21:03:49,699][INFO ][sys-#5898%encryption.EncryptedCacheCreateTest0%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=332f4457-a30f-4f84-b266-78c71e300000, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=332f4457-a30f-4f84-b266-78c71e300000, consistentId=encryption.EncryptedCacheCreateTest0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345029508, loc=true, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2]] [21:03:49] : [Step 4/5] [2021-11-19 21:03:49,699][INFO ][sys-#6024%encryption.EncryptedCacheCreateTest1%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], err=null, rebalanced=true, wasRebalanced=true] [21:03:49] : [Step 4/5] [2021-11-19 21:03:49,700][INFO ][sys-#5898%encryption.EncryptedCacheCreateTest0%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (1 ms), stage="Update caches registry" (0 ms), stage="Start caches" (85 ms), stage="Affinity initialization on cache group start" (3 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Wait partitions release latch [latch=exchange]" (15 ms), stage="Wait partitions release [latch=exchange]" (1 ms), stage="Restore partition states" (11 ms), stage="After states restored callback" (37 ms), stage="WAL history reservation" (0 ms), stage="Waiting for all single messages" (10 ms), stage="Affinity recalculation (crd)" (0 ms), stage="Collect update counters and create affinity messages" (0 ms), stage="Assign partitions states" (4 ms), stage="Validate partitions states" (0 ms), stage="Apply update counters" (0 ms), stage="Full message preparing" (3 ms), stage="Full message sending" (0 ms), stage="Exchange done" (4 ms), stage="Total time" (174 ms), Discovery lag=1 ms, Latest started node id=71f225f9-326e-4c95-a94c-24dd0fc00001] [21:03:49] : [Step 4/5] [2021-11-19 21:03:49,702][INFO ][sys-#6024%encryption.EncryptedCacheCreateTest1%][GridCacheProcessor] Finish proxy initialization, cacheName=encrypted, localNodeId=71f225f9-326e-4c95-a94c-24dd0fc00001 [21:03:49] : [Step 4/5] [2021-11-19 21:03:49,701][INFO ][exchange-worker-#5925%encryption.EncryptedCacheCreateTest0%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=2, minorTopVer=2], force=false, evt=DISCOVERY_CUSTOM_EVT, node=332f4457-a30f-4f84-b266-78c71e300000] [21:03:49] : [Step 4/5] [2021-11-19 21:03:49,704][INFO ][sys-#6024%encryption.EncryptedCacheCreateTest1%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=71f225f9-326e-4c95-a94c-24dd0fc00001, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=332f4457-a30f-4f84-b266-78c71e300000, consistentId=encryption.EncryptedCacheCreateTest0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345029346, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2]] [21:03:49] : [Step 4/5] [2021-11-19 21:03:49,703][INFO ][sys-#5898%encryption.EncryptedCacheCreateTest0%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], stage="Affinity initialization on cache group start [grp=encrypted]" (1 ms) (parent=Affinity initialization on cache group start), stage="Restore partition states [grp=encrypted]" (11 ms) (parent=Restore partition states), stage="Restore partition states [grp=ignite-sys-cache]" (0 ms) (parent=Restore partition states)] [21:03:49] : [Step 4/5] [2021-11-19 21:03:49,706][INFO ][sys-#6024%encryption.EncryptedCacheCreateTest1%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (2 ms), stage="Update caches registry" (0 ms), stage="Start caches" (97 ms), stage="Affinity initialization on cache group start" (4 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Wait partitions release latch [latch=exchange]" (2 ms), stage="Wait partitions release [latch=exchange]" (1 ms), stage="Restore partition states" (11 ms), stage="After states restored callback" (43 ms), stage="WAL history reservation" (0 ms), stage="Waiting for Full message" (14 ms), stage="Affinity recalculation" (0 ms), stage="Full map updating" (1 ms), stage="Exchange done" (6 ms), stage="Total time" (181 ms)] [21:03:49] : [Step 4/5] [2021-11-19 21:03:49,709][INFO ][sys-#6024%encryption.EncryptedCacheCreateTest1%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], stage="Affinity initialization on cache group start [grp=encrypted]" (2 ms) (parent=Affinity initialization on cache group start), stage="Restore partition states [grp=encrypted]" (11 ms) (parent=Restore partition states), stage="Restore partition states [grp=ignite-sys-cache]" (0 ms) (parent=Restore partition states)] [21:03:49] : [Step 4/5] [2021-11-19 21:03:49,705][INFO ][exchange-worker-#6047%encryption.EncryptedCacheCreateTest1%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=2, minorTopVer=2], force=false, evt=DISCOVERY_CUSTOM_EVT, node=332f4457-a30f-4f84-b266-78c71e300000] [21:03:49] : [Step 4/5] [2021-11-19 21:03:49,704][INFO ][exchange-worker-#5925%encryption.EncryptedCacheCreateTest0%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=3], crd=true, evt=DISCOVERY_CUSTOM_EVT, evtNode=332f4457-a30f-4f84-b266-78c71e300000, customEvt=DynamicCacheChangeBatch [id=e461d593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqs=ArrayList [DynamicCacheChangeRequest [cacheName=plain-cache, hasCfg=true, nodeId=332f4457-a30f-4f84-b266-78c71e300000, clientStartOnly=false, stop=false, destroy=false, disabledAfterStart=false]], exchangeActions=ExchangeActions [startCaches=[plain-cache], stopCaches=null, startGrps=[plain-cache], stopGrps=[], resetParts=null, stateChangeRequest=null], startCaches=false], allowMerge=false, exchangeFreeSwitch=false] [21:03:49] : [Step 4/5] [2021-11-19 21:03:49,712][INFO ][exchange-worker-#6047%encryption.EncryptedCacheCreateTest1%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=3], crd=false, evt=DISCOVERY_CUSTOM_EVT, evtNode=332f4457-a30f-4f84-b266-78c71e300000, customEvt=DynamicCacheChangeBatch [id=e461d593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqs=ArrayList [DynamicCacheChangeRequest [cacheName=plain-cache, hasCfg=true, nodeId=332f4457-a30f-4f84-b266-78c71e300000, clientStartOnly=false, stop=false, destroy=false, disabledAfterStart=false]], exchangeActions=ExchangeActions [startCaches=[plain-cache], stopCaches=null, startGrps=[plain-cache], stopGrps=[], resetParts=null, stateChangeRequest=null], startCaches=false], allowMerge=false, exchangeFreeSwitch=false] [21:03:49] : [Step 4/5] [2021-11-19 21:03:49,804][INFO ][exchange-worker-#6047%encryption.EncryptedCacheCreateTest1%][GridCacheProcessor] Started cache [name=plain-cache, id=162241983, dataRegionName=default, mode=PARTITIONED, atomicity=ATOMIC, backups=0, mvcc=false] [21:03:49]W: [org.apache.ignite:ignite-core] [2021-11-19 21:03:49,806][WARN ][exchange-worker-#6047%encryption.EncryptedCacheCreateTest1%][CacheAffinitySharedManager] Cache group 'plain-cache' brings high overhead for its metainformation in data region 'default'. Metainformation required for its partitions (538 partitions, 4096 bytes per partition, 2 MBs total) will consume more than 15% of data region memory (10 MBs). It may lead to critical errors on the node and cluster instability. Please reduce number of partitions, add more memory to the data region or add more server nodes for this cache group. [21:03:49] : [Step 4/5] [2021-11-19 21:03:49,809][INFO ][exchange-worker-#6047%encryption.EncryptedCacheCreateTest1%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=3], waitTime=0ms, futInfo=NA, mode=DISTRIBUTED] [21:03:49] : [Step 4/5] [2021-11-19 21:03:49,815][INFO ][exchange-worker-#5925%encryption.EncryptedCacheCreateTest0%][GridCacheProcessor] Started cache [name=plain-cache, id=162241983, dataRegionName=default, mode=PARTITIONED, atomicity=ATOMIC, backups=0, mvcc=false] [21:03:49]W: [org.apache.ignite:ignite-core] [2021-11-19 21:03:49,818][WARN ][exchange-worker-#5925%encryption.EncryptedCacheCreateTest0%][CacheAffinitySharedManager] Cache group 'plain-cache' brings high overhead for its metainformation in data region 'default'. Metainformation required for its partitions (486 partitions, 4096 bytes per partition, 1 MBs total) will consume more than 15% of data region memory (10 MBs). It may lead to critical errors on the node and cluster instability. Please reduce number of partitions, add more memory to the data region or add more server nodes for this cache group. [21:03:49] : [Step 4/5] [2021-11-19 21:03:49,820][INFO ][exchange-worker-#5925%encryption.EncryptedCacheCreateTest0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=3], waitTime=0ms, futInfo=NA, mode=DISTRIBUTED] [21:03:49] : [Step 4/5] [2021-11-19 21:03:49,820][INFO ][exchange-worker-#5925%encryption.EncryptedCacheCreateTest0%][GridDhtPartitionsExchangeFuture] Finished waiting for partitions release latch: ServerLatch [permits=0, pendingAcks=HashSet [], super=CompletableLatch [id=CompletableLatchUid [id=exchange, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=3]]]] [21:03:49] : [Step 4/5] [2021-11-19 21:03:49,821][INFO ][exchange-worker-#5925%encryption.EncryptedCacheCreateTest0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=3], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:03:49] : [Step 4/5] [2021-11-19 21:03:49,822][INFO ][exchange-worker-#6047%encryption.EncryptedCacheCreateTest1%][GridDhtPartitionsExchangeFuture] Finished waiting for partitions release latch: ClientLatch [coordinator=TcpDiscoveryNode [id=332f4457-a30f-4f84-b266-78c71e300000, consistentId=encryption.EncryptedCacheCreateTest0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345029346, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], ackSent=true, super=CompletableLatch [id=CompletableLatchUid [id=exchange, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=3]]]] [21:03:49] : [Step 4/5] [2021-11-19 21:03:49,823][INFO ][exchange-worker-#6047%encryption.EncryptedCacheCreateTest1%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=3], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:03:49] : [Step 4/5] [2021-11-19 21:03:49,879][INFO ][exchange-worker-#5925%encryption.EncryptedCacheCreateTest0%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=3], crd=true] [21:03:49] : [Step 4/5] [2021-11-19 21:03:49,903][INFO ][exchange-worker-#6047%encryption.EncryptedCacheCreateTest1%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=3], crd=false] [21:03:49] : [Step 4/5] [2021-11-19 21:03:49,905][INFO ][sys-#5896%encryption.EncryptedCacheCreateTest0%][GridDhtPartitionsExchangeFuture] Coordinator received single message [ver=AffinityTopologyVersion [topVer=2, minorTopVer=3], node=71f225f9-326e-4c95-a94c-24dd0fc00001, allReceived=true] [21:03:49] : [Step 4/5] [2021-11-19 21:03:49,905][INFO ][sys-#5896%encryption.EncryptedCacheCreateTest0%][GridDhtPartitionsExchangeFuture] finishExchangeOnCoordinator [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=3], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=3]] [21:03:49] : [Step 4/5] [2021-11-19 21:03:49,918][INFO ][sys-#5896%encryption.EncryptedCacheCreateTest0%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=3], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=3], err=null, rebalanced=true, wasRebalanced=true] [21:03:49] : [Step 4/5] [2021-11-19 21:03:49,921][INFO ][sys-#6034%encryption.EncryptedCacheCreateTest1%][GridDhtPartitionsExchangeFuture] Received full message, will finish exchange [node=332f4457-a30f-4f84-b266-78c71e300000, resVer=AffinityTopologyVersion [topVer=2, minorTopVer=3]] [21:03:49] : [Step 4/5] [2021-11-19 21:03:49,925][INFO ][sys-#5896%encryption.EncryptedCacheCreateTest0%][GridCacheProcessor] Finish proxy initialization, cacheName=plain-cache, localNodeId=332f4457-a30f-4f84-b266-78c71e300000 [21:03:49] : [Step 4/5] [2021-11-19 21:03:49,925][INFO ][sys-#6034%encryption.EncryptedCacheCreateTest1%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=3], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=3], err=null, rebalanced=true, wasRebalanced=true] [21:03:49] : [Step 4/5] [2021-11-19 21:03:49,929][INFO ][sys-#6034%encryption.EncryptedCacheCreateTest1%][GridCacheProcessor] Finish proxy initialization, cacheName=plain-cache, localNodeId=71f225f9-326e-4c95-a94c-24dd0fc00001 [21:03:49] : [Step 4/5] [2021-11-19 21:03:49,929][INFO ][sys-#6034%encryption.EncryptedCacheCreateTest1%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=71f225f9-326e-4c95-a94c-24dd0fc00001, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=3], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=332f4457-a30f-4f84-b266-78c71e300000, consistentId=encryption.EncryptedCacheCreateTest0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345029346, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=2, minorTopVer=3]] [21:03:49] : [Step 4/5] [2021-11-19 21:03:49,930][INFO ][sys-#6034%encryption.EncryptedCacheCreateTest1%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=3], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=3], stage="Waiting in exchange queue" (9 ms), stage="Exchange parameters initialization" (2 ms), stage="Update caches registry" (0 ms), stage="Start caches" (89 ms), stage="Affinity initialization on cache group start" (2 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (1 ms), stage="Wait partitions release latch [latch=exchange]" (13 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Restore partition states" (19 ms), stage="After states restored callback" (56 ms), stage="WAL history reservation" (0 ms), stage="Waiting for Full message" (20 ms), stage="Affinity recalculation" (0 ms), stage="Full map updating" (3 ms), stage="Exchange done" (4 ms), stage="Total time" (218 ms)] [21:03:49] : [Step 4/5] [2021-11-19 21:03:49,931][INFO ][exchange-worker-#6047%encryption.EncryptedCacheCreateTest1%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=2, minorTopVer=3], force=false, evt=DISCOVERY_CUSTOM_EVT, node=332f4457-a30f-4f84-b266-78c71e300000] [21:03:49] : [Step 4/5] [2021-11-19 21:03:49,933][INFO ][sys-#5896%encryption.EncryptedCacheCreateTest0%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=332f4457-a30f-4f84-b266-78c71e300000, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=3], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=332f4457-a30f-4f84-b266-78c71e300000, consistentId=encryption.EncryptedCacheCreateTest0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345029702, loc=true, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=2, minorTopVer=3]] [21:03:49] : [Step 4/5] [2021-11-19 21:03:49,932][INFO ][sys-#6034%encryption.EncryptedCacheCreateTest1%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=3], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=3], stage="Affinity initialization on cache group start [grp=plain-cache]" (1 ms) (parent=Affinity initialization on cache group start), stage="Restore partition states [grp=plain-cache]" (19 ms) (parent=Restore partition states), stage="Restore partition states [grp=ignite-sys-cache]" (0 ms) (parent=Restore partition states), stage="Restore partition states [grp=encrypted]" (0 ms) (parent=Restore partition states)] [21:03:49] : [Step 4/5] [2021-11-19 21:03:49,934][INFO ][exchange-worker-#5925%encryption.EncryptedCacheCreateTest0%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=2, minorTopVer=3], force=false, evt=DISCOVERY_CUSTOM_EVT, node=332f4457-a30f-4f84-b266-78c71e300000] [21:03:49] : [Step 4/5] [2021-11-19 21:03:49,934][INFO ][sys-#5896%encryption.EncryptedCacheCreateTest0%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=3], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=3], stage="Waiting in exchange queue" (3 ms), stage="Exchange parameters initialization" (8 ms), stage="Update caches registry" (0 ms), stage="Start caches" (101 ms), stage="Affinity initialization on cache group start" (3 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Wait partitions release latch [latch=exchange]" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Restore partition states" (17 ms), stage="After states restored callback" (39 ms), stage="WAL history reservation" (0 ms), stage="Waiting for all single messages" (25 ms), stage="Affinity recalculation (crd)" (0 ms), stage="Collect update counters and create affinity messages" (0 ms), stage="Assign partitions states" (5 ms), stage="Validate partitions states" (1 ms), stage="Apply update counters" (0 ms), stage="Full message preparing" (3 ms), stage="Full message sending" (0 ms), stage="Exchange done" (15 ms), stage="Total time" (220 ms), Discovery lag=1 ms, Latest started node id=71f225f9-326e-4c95-a94c-24dd0fc00001] [21:03:49] : [Step 4/5] [2021-11-19 21:03:49,938][INFO ][sys-#5896%encryption.EncryptedCacheCreateTest0%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=3], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=3], stage="Affinity initialization on cache group start [grp=plain-cache]" (2 ms) (parent=Affinity initialization on cache group start), stage="Restore partition states [grp=plain-cache]" (17 ms) (parent=Restore partition states), stage="Restore partition states [grp=ignite-sys-cache]" (0 ms) (parent=Restore partition states), stage="Restore partition states [grp=encrypted]" (0 ms) (parent=Restore partition states)] [21:03:50] : [Step 4/5] [2021-11-19 21:03:50,140][INFO ][test-runner-#6075%encryption.EncryptedCacheCreateTest%][root] >>> Stopping grid [name=encryption.EncryptedCacheCreateTest0, id=332f4457-a30f-4f84-b266-78c71e300000] [21:03:50] : [Step 4/5] [2021-11-19 21:03:50,184][INFO ][db-checkpoint-thread-#6056%encryption.EncryptedCacheCreateTest0%][Checkpointer] Checkpoint started [checkpointId=bde75671-4f15-4556-b017-9f8abd0de124, startPtr=WALPointer [idx=0, fileOff=229153, len=20427], checkpointBeforeLockTime=3ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=3ms, checkpointLockHoldTime=21ms, walCpRecordFsyncDuration=2ms, writeCheckpointEntryDuration=2ms, splitAndSortCpPagesDuration=0ms, pages=15, reason='timeout'] [21:03:50] : [Step 4/5] [2021-11-19 21:03:50,231][INFO ][db-checkpoint-thread-#6056%encryption.EncryptedCacheCreateTest0%][Checkpointer] Checkpoint finished [cpId=bde75671-4f15-4556-b017-9f8abd0de124, pages=15, markPos=WALPointer [idx=0, fileOff=229153, len=20427], walSegmentsCovered=[], markDuration=26ms, pagesWrite=1ms, fsync=45ms, total=75ms] [21:03:50] : [Step 4/5] [2021-11-19 21:03:50,242][INFO ][db-checkpoint-thread-#6056%encryption.EncryptedCacheCreateTest0%][Checkpointer] Skipping checkpoint (no pages were modified) [checkpointBeforeLockTime=5ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=5ms, checkpointLockHoldTime=6ms, reason='timeout'] [21:03:50] : [Step 4/5] [2021-11-19 21:03:50,258][INFO ][tcp-disco-sock-reader-[71f225f9 127.0.0.1:44511]-#302%encryption.EncryptedCacheCreateTest0%-#6044%encryption.EncryptedCacheCreateTest0%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:44511, rmtPort=44511, rmtNodeId=71f225f9-326e-4c95-a94c-24dd0fc00001] [21:03:50] : [Step 4/5] [2021-11-19 21:03:50,258][INFO ][disco-event-worker-#6046%encryption.EncryptedCacheCreateTest1%][GridDiscoveryManager] Node left topology: TcpDiscoveryNode [id=332f4457-a30f-4f84-b266-78c71e300000, consistentId=encryption.EncryptedCacheCreateTest0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345029346, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false] [21:03:50] : [Step 4/5] [2021-11-19 21:03:50,262][INFO ][disco-event-worker-#6046%encryption.EncryptedCacheCreateTest1%][GridDiscoveryManager] Topology snapshot [ver=3, locNode=71f225f9, servers=1, clients=0, state=ACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=71f225f9-326e-4c95-a94c-24dd0fc00001, consistentId=encryption.EncryptedCacheCreateTest1, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:03:50] : [Step 4/5] [2021-11-19 21:03:50,262][INFO ][test-runner-#6075%encryption.EncryptedCacheCreateTest%][GridCacheProcessor] Stopped cache [cacheName=ignite-sys-cache] [21:03:50]W: [org.apache.ignite:ignite-core] [2021-11-19 21:03:50,267][WARN ][grid-nio-worker-tcp-comm-0-#5982%TcpCommunicationSpi%][TcpCommunicationSpi] Failed to shutdown socket [21:03:50]W: [org.apache.ignite:ignite-core] java.nio.channels.ClosedChannelException [21:03:50]W: [org.apache.ignite:ignite-core] at sun.nio.ch.SocketChannelImpl.shutdownOutput(SocketChannelImpl.java:795) [21:03:50]W: [org.apache.ignite:ignite-core] at sun.nio.ch.SocketAdaptor.shutdownOutput(SocketAdaptor.java:407) [21:03:50]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.close(IgniteUtils.java:4247) [21:03:50]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.closeKey(GridNioServer.java:2784) [21:03:50] : [Step 4/5] [2021-11-19 21:03:50,263][INFO ][disco-event-worker-#6046%encryption.EncryptedCacheCreateTest1%][GridDiscoveryManager] Coordinator changed [prev=TcpDiscoveryNode [id=332f4457-a30f-4f84-b266-78c71e300000, consistentId=encryption.EncryptedCacheCreateTest0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345029346, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], cur=TcpDiscoveryNode [id=71f225f9-326e-4c95-a94c-24dd0fc00001, consistentId=encryption.EncryptedCacheCreateTest1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637345030252, loc=true, ver=2.13.0#20211119-sha1:00000000, isClient=false]] [21:03:50]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.close(GridNioServer.java:2835) [21:03:50] : [Step 4/5] [2021-11-19 21:03:50,265][INFO ][disco-event-worker-#6046%encryption.EncryptedCacheCreateTest1%][GridDiscoveryManager] ^-- Baseline [id=0, size=2, online=1, offline=1] [21:03:50] : [Step 4/5] [2021-11-19 21:03:50,264][INFO ][test-runner-#6075%encryption.EncryptedCacheCreateTest%][GridCacheProcessor] Stopped cache [cacheName=encrypted] [21:03:50]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.close(GridNioServer.java:2794) [21:03:50] : [Step 4/5] [2021-11-19 21:03:50,267][INFO ][disco-event-worker-#6046%encryption.EncryptedCacheCreateTest1%][MvccProcessorImpl] Assigned mvcc coordinator [crd=MvccCoordinator [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], nodeId=71f225f9-326e-4c95-a94c-24dd0fc00001, ver=1637345028116, local=true, initialized=false]] [21:03:50] : [Step 4/5] [2021-11-19 21:03:50,269][INFO ][sys-#6025%encryption.EncryptedCacheCreateTest1%][ExchangeLatchManager] Become new coordinator 71f225f9-326e-4c95-a94c-24dd0fc00001 [21:03:50]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.bodyInternal(GridNioServer.java:2157) [21:03:50]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.body(GridNioServer.java:1910) [21:03:50]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:125) [21:03:50]W: [org.apache.ignite:ignite-core] at java.lang.Thread.run(Thread.java:748) [21:03:50] : [Step 4/5] [2021-11-19 21:03:50,277][INFO ][test-runner-#6075%encryption.EncryptedCacheCreateTest%][GridCacheProcessor] Stopped cache [cacheName=plain-cache] [21:03:50] : [Step 4/5] [2021-11-19 21:03:50,284][INFO ][exchange-worker-#6047%encryption.EncryptedCacheCreateTest1%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], crd=true, evt=NODE_LEFT, evtNode=332f4457-a30f-4f84-b266-78c71e300000, customEvt=null, allowMerge=false, exchangeFreeSwitch=true] [21:03:50] : [Step 4/5] [2021-11-19 21:03:50,286][INFO ][exchange-worker-#6047%encryption.EncryptedCacheCreateTest1%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:03:50] : [Step 4/5] [2021-11-19 21:03:50,291][INFO ][exchange-worker-#6047%encryption.EncryptedCacheCreateTest1%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], err=null, rebalanced=true, wasRebalanced=true] [21:03:50]W: [org.apache.ignite:ignite-core] [2021-11-19 21:03:50,295][WARN ][exchange-worker-#6047%encryption.EncryptedCacheCreateTest1%][GridDhtPartitionTopologyImpl] Detected lost partitions [grp=encrypted, parts=[0, 2, 4-5, 8, 13-14, 22, 24-25, 27-28, 30, 32, 35, 38, 40, 44, 46-48, 50, 52, 58, 61, 65, 68, 71, 74-77, 80-81, 83-85, 88, 90-91, 95-97, 105-106, 108-111, 114, 118-119, 122-123, 127-129, 134-140, 142, 144, 146, 149, 151-155, 158-161, 164-166, 169-171, 173-175, 177, 179, 182, 186, 189, 191, 193-196, 201, 203, 206-207, 209-211, 213-214, 219, 222, 224-225, 227-228, 233, 235, 238, 240, 245-247, 249-250, 253, 255-256, 258, 260-261, 264-266, 268-269, 274-277, 279-280, 282-284, 286-287, 289-292, 296, 298, 301-302, 304, 306-307, 309, 311-312, 314-315, 318, 320, 326, 328-329, 334, 337-339, 344, 346-349, 351, 357, 360-361, 363, 368, 370, 374, 378, 382, 384-385, 387-391, 393, 397-400, 402, 404, 408-409, 411, 415, 419, 422, 424-426, 428-430, 434, 445-446, 448, 450, 453-457, 460, 462-463, 467, 473, 475-476, 479-480, 486, 488-494, 496-498, 500, 505, 507-510, 515, 518-519, 521-522, 524, 526-528, 531, 533-535, 537-539, 542-545, 547, 549, 557, 559, 561, 565-568, 570-571, 574, 579, 582, 587, 589, 593, 595-597, 599-602, 604, 607, 611-615, 617-618, 622-623, 625, 627, 630-632, 638, 641-642, 648-650, 653, 655, 657-658, 661, 670, 672-673, 677-680, 684-685, 694, 696-697, 700-704, 706, 708-710, 714, 717, 719-720, 725, 729, 731, 733, 737-739, 741, 745-747, 751, 753-755, 758, 762-763, 767-768, 770, 774, 776-777, 782, 784-790, 793, 796-798, 800-802, 806-808, 811, 814, 818-821, 823-824, 829-831, 833, 835, 838-840, 843, 845, 848-851, 854, 861-862, 866, 868, 870-872, 876-878, 881, 886, 890, 893-895, 897-898, 901, 904-905, 908-910, 912-913, 915-917, 920-921, 923, 925-927, 929, 932, 935-937, 939, 942, 944-945, 948-951, 954, 962-963, 967, 969-971, 973-976, 979-980, 982-983, 985, 988, 992, 996, 998, 1004-1006, 1008-1013, 1015, 1017, 1021-1022], topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0]] [21:03:50]W: [org.apache.ignite:ignite-core] [2021-11-19 21:03:50,295][WARN ][sys-#6030%encryption.EncryptedCacheCreateTest1%][GridDhtPartitionTopologyImpl] Detected lost partitions [grp=plain-cache, parts=[0, 2, 4-5, 8, 13-14, 22, 24-25, 27-28, 30, 32, 35, 38, 40, 44, 46-48, 50, 52, 58, 61, 65, 68, 71, 74-77, 80-81, 83-85, 88, 90-91, 95-97, 105-106, 108-111, 114, 118-119, 122-123, 127-129, 134-140, 142, 144, 146, 149, 151-155, 158-161, 164-166, 169-171, 173-175, 177, 179, 182, 186, 189, 191, 193-196, 201, 203, 206-207, 209-211, 213-214, 219, 222, 224-225, 227-228, 233, 235, 238, 240, 245-247, 249-250, 253, 255-256, 258, 260-261, 264-266, 268-269, 274-277, 279-280, 282-284, 286-287, 289-292, 296, 298, 301-302, 304, 306-307, 309, 311-312, 314-315, 318, 320, 326, 328-329, 334, 337-339, 344, 346-349, 351, 357, 360-361, 363, 368, 370, 374, 378, 382, 384-385, 387-391, 393, 397-400, 402, 404, 408-409, 411, 415, 419, 422, 424-426, 428-430, 434, 445-446, 448, 450, 453-457, 460, 462-463, 467, 473, 475-476, 479-480, 486, 488-494, 496-498, 500, 505, 507-510, 515, 518-519, 521-522, 524, 526-528, 531, 533-535, 537-539, 542-545, 547, 549, 557, 559, 561, 565-568, 570-571, 574, 579, 582, 587, 589, 593, 595-597, 599-602, 604, 607, 611-615, 617-618, 622-623, 625, 627, 630-632, 638, 641-642, 648-650, 653, 655, 657-658, 661, 670, 672-673, 677-680, 684-685, 694, 696-697, 700-704, 706, 708-710, 714, 717, 719-720, 725, 729, 731, 733, 737-739, 741, 745-747, 751, 753-755, 758, 762-763, 767-768, 770, 774, 776-777, 782, 784-790, 793, 796-798, 800-802, 806-808, 811, 814, 818-821, 823-824, 829-831, 833, 835, 838-840, 843, 845, 848-851, 854, 861-862, 866, 868, 870-872, 876-878, 881, 886, 890, 893-895, 897-898, 901, 904-905, 908-910, 912-913, 915-917, 920-921, 923, 925-927, 929, 932, 935-937, 939, 942, 944-945, 948-951, 954, 962-963, 967, 969-971, 973-976, 979-980, 982-983, 985, 988, 992, 996, 998, 1004-1006, 1008-1013, 1015, 1017, 1021-1022], topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0]] [21:03:50] : [Step 4/5] [2021-11-19 21:03:50,304][INFO ][exchange-worker-#6047%encryption.EncryptedCacheCreateTest1%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=71f225f9-326e-4c95-a94c-24dd0fc00001, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], evt=NODE_LEFT, evtNode=TcpDiscoveryNode [id=332f4457-a30f-4f84-b266-78c71e300000, consistentId=encryption.EncryptedCacheCreateTest0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345029346, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0]] [21:03:50] : [Step 4/5] [2021-11-19 21:03:50,306][INFO ][exchange-worker-#6047%encryption.EncryptedCacheCreateTest1%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], stage="Waiting in exchange queue" (2 ms), stage="Exchange parameters initialization" (12 ms), stage="Determine exchange type" (1 ms), stage="Preloading notification" (0 ms), stage="After states restored callback" (1 ms), stage="WAL history reservation" (1 ms), stage="Finalize update counters" (1 ms), stage="Detect lost partitions" (12 ms), stage="Exchange done" (3 ms), stage="Total time" (33 ms)] [21:03:50] : [Step 4/5] [2021-11-19 21:03:50,307][INFO ][exchange-worker-#6047%encryption.EncryptedCacheCreateTest1%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], stage="Affinity initialization (exchange-free switch on fully-rebalanced topology) [grp=plain-cache]" (0 ms) (parent=Determine exchange type), stage="Affinity initialization (exchange-free switch on fully-rebalanced topology) [grp=ignite-sys-cache]" (0 ms) (parent=Determine exchange type), stage="Affinity initialization (exchange-free switch on fully-rebalanced topology) [grp=encrypted]" (0 ms) (parent=Determine exchange type)] [21:03:50] : [Step 4/5] [2021-11-19 21:03:50,309][INFO ][exchange-worker-#6047%encryption.EncryptedCacheCreateTest1%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], crd=true] [21:03:50] : [Step 4/5] [2021-11-19 21:03:50,311][INFO ][exchange-worker-#6047%encryption.EncryptedCacheCreateTest1%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=3, minorTopVer=0], force=false, evt=NODE_LEFT, node=332f4457-a30f-4f84-b266-78c71e300000] [21:03:50] : [Step 4/5] [2021-11-19 21:03:50,946][INFO ][test-runner-#6075%encryption.EncryptedCacheCreateTest%][FilePageStoreManager] Cleanup cache stores [total=5, left=0, cleanFiles=false] [21:03:50] : [Step 4/5] [2021-11-19 21:03:50,948][INFO ][test-runner-#6075%encryption.EncryptedCacheCreateTest%][GridDeploymentLocalStore] Removed undeployed class: GridDeployment [ts=1637345029457, depMode=SHARED, clsLdr=IsolatedClassLoader{roleName='test'}, clsLdrId=6261d593d71-332f4457-a30f-4f84-b266-78c71e300000, userVer=0, loc=true, sampleClsName=org.apache.ignite.internal.processors.cache.distributed.dht.preloader.GridDhtPartitionMap, pendingUndeploy=false, undeployed=true, usage=0] [21:03:50] : [Step 4/5] [2021-11-19 21:03:50,958][INFO ][test-runner-#6075%encryption.EncryptedCacheCreateTest%][EncryptedCacheCreateTest0] [21:03:50] : [Step 4/5] [21:03:50] : [Step 4/5] >>> +------------------------------------------------------+ [21:03:50] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV stopped OK [21:03:50] : [Step 4/5] >>> +------------------------------------------------------+ [21:03:50] : [Step 4/5] >>> Ignite instance name: encryption.EncryptedCacheCreateTest0 [21:03:50] : [Step 4/5] >>> Grid uptime: 00:00:02.810 [21:03:50] : [Step 4/5] [21:03:50] : [Step 4/5] [21:03:50] : [Step 4/5] [2021-11-19 21:03:50,960][INFO ][test-runner-#6075%encryption.EncryptedCacheCreateTest%][root] >>> Stopping grid [name=encryption.EncryptedCacheCreateTest1, id=71f225f9-326e-4c95-a94c-24dd0fc00001] [21:03:50] : [Step 4/5] [2021-11-19 21:03:50,978][INFO ][db-checkpoint-thread-#6057%encryption.EncryptedCacheCreateTest1%][Checkpointer] Checkpoint started [checkpointId=02937649-339d-4369-a8eb-965b78bd9e89, startPtr=WALPointer [idx=0, fileOff=264456, len=22403], checkpointBeforeLockTime=2ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=1ms, checkpointLockHoldTime=3ms, walCpRecordFsyncDuration=2ms, writeCheckpointEntryDuration=2ms, splitAndSortCpPagesDuration=0ms, pages=35, reason='timeout'] [21:03:51] : [Step 4/5] [2021-11-19 21:03:51,029][INFO ][db-checkpoint-thread-#6057%encryption.EncryptedCacheCreateTest1%][Checkpointer] Checkpoint finished [cpId=02937649-339d-4369-a8eb-965b78bd9e89, pages=35, markPos=WALPointer [idx=0, fileOff=264456, len=22403], walSegmentsCovered=[], markDuration=8ms, pagesWrite=1ms, fsync=49ms, total=60ms] [21:03:51] : [Step 4/5] [2021-11-19 21:03:51,033][INFO ][db-checkpoint-thread-#6057%encryption.EncryptedCacheCreateTest1%][Checkpointer] Skipping checkpoint (no pages were modified) [checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=1ms, checkpointLockHoldTime=2ms, reason='timeout'] [21:03:51]W: [org.apache.ignite:ignite-core] [2021-11-19 21:03:51,039][WARN ][tcp-disco-sock-reader-[332f4457 127.0.0.1:47987]-#301%encryption.EncryptedCacheCreateTest1%-#6043%encryption.EncryptedCacheCreateTest1%][TestTcpDiscoverySpi] Failed to shutdown socket [21:03:51]W: [org.apache.ignite:ignite-core] java.net.SocketException: Socket is closed [21:03:51]W: [org.apache.ignite:ignite-core] at java.net.Socket.shutdownOutput(Socket.java:1568) [21:03:51]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.close(IgniteUtils.java:4247) [21:03:51]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.discovery.tcp.ServerImpl$SocketReader.body(ServerImpl.java:7370) [21:03:51]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.IgniteSpiThread.run(IgniteSpiThread.java:58) [21:03:51] : [Step 4/5] [2021-11-19 21:03:51,040][INFO ][tcp-disco-sock-reader-[332f4457 127.0.0.1:47987]-#301%encryption.EncryptedCacheCreateTest1%-#6043%encryption.EncryptedCacheCreateTest1%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:47987, rmtPort=47987, rmtNodeId=332f4457-a30f-4f84-b266-78c71e300000] [21:03:51] : [Step 4/5] [2021-11-19 21:03:51,041][INFO ][test-runner-#6075%encryption.EncryptedCacheCreateTest%][GridCacheProcessor] Stopped cache [cacheName=ignite-sys-cache] [21:03:51] : [Step 4/5] [2021-11-19 21:03:51,042][INFO ][test-runner-#6075%encryption.EncryptedCacheCreateTest%][GridCacheProcessor] Stopped cache [cacheName=encrypted] [21:03:51] : [Step 4/5] [2021-11-19 21:03:51,043][INFO ][test-runner-#6075%encryption.EncryptedCacheCreateTest%][GridCacheProcessor] Stopped cache [cacheName=plain-cache] [21:03:51] : [Step 4/5] [2021-11-19 21:03:51,377][INFO ][test-runner-#6075%encryption.EncryptedCacheCreateTest%][FilePageStoreManager] Cleanup cache stores [total=5, left=0, cleanFiles=false] [21:03:51] : [Step 4/5] [2021-11-19 21:03:51,379][INFO ][test-runner-#6075%encryption.EncryptedCacheCreateTest%][GridDeploymentLocalStore] Removed undeployed class: GridDeployment [ts=1637345029468, depMode=SHARED, clsLdr=IsolatedClassLoader{roleName='test'}, clsLdrId=9261d593d71-71f225f9-326e-4c95-a94c-24dd0fc00001, userVer=0, loc=true, sampleClsName=org.apache.ignite.internal.processors.cache.distributed.dht.preloader.GridDhtPartitionFullMap, pendingUndeploy=false, undeployed=true, usage=0] [21:03:51] : [Step 4/5] [2021-11-19 21:03:51,386][INFO ][test-runner-#6075%encryption.EncryptedCacheCreateTest%][EncryptedCacheCreateTest1] [21:03:51] : [Step 4/5] [21:03:51] : [Step 4/5] >>> +------------------------------------------------------+ [21:03:51] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV stopped OK [21:03:51] : [Step 4/5] >>> +------------------------------------------------------+ [21:03:51] : [Step 4/5] >>> Ignite instance name: encryption.EncryptedCacheCreateTest1 [21:03:51] : [Step 4/5] >>> Grid uptime: 00:00:01.992 [21:03:51] : [Step 4/5] [21:03:51] : [Step 4/5] [21:03:54] : [Step 4/5] [21:03:54] >>> Stopping test: EncryptedCacheCreateTest#testPersistedContentEncrypted in 5202 ms <<< [21:03:54] : [Step 4/5] [2021-11-19 21:03:54,707][INFO ][main][root] >>> Stopping test: EncryptedCacheCreateTest#testPersistedContentEncrypted in 5202 ms <<< [21:03:54] : [Step 4/5] [21:03:54] >>> Heap: 302 MB used / 1937 MB commited / 1937 MB max <<< [21:03:54] : [Step 4/5] [2021-11-19 21:03:54,708][INFO ][main][root] >>> Heap: 302 MB used / 1937 MB commited / 1937 MB max <<< [21:03:54] : [Step 4/5] [21:03:54] >>> Non-Heap: 130 MB used / 140 MB commited / 0 MB max <<< [21:03:54] : [Step 4/5] [2021-11-19 21:03:54,709][INFO ][main][root] >>> Non-Heap: 130 MB used / 140 MB commited / 0 MB max <<< [21:03:54] : [Step 4/5] [21:03:54] >>> Starting test: EncryptedCacheCreateTest#testCreateEncryptedNotPersistedCacheFail <<< [21:03:54] : [Step 4/5] [2021-11-19 21:03:54,829][INFO ][main][root] >>> Starting test: EncryptedCacheCreateTest#testCreateEncryptedNotPersistedCacheFail <<< [21:03:54] : [Step 4/5] [21:03:54] >>> Heap: 302 MB used / 1937 MB commited / 1937 MB max <<< [21:03:54] : [Step 4/5] [2021-11-19 21:03:54,829][INFO ][main][root] >>> Heap: 302 MB used / 1937 MB commited / 1937 MB max <<< [21:03:54] : [Step 4/5] [21:03:54] >>> Non-Heap: 130 MB used / 140 MB commited / 0 MB max <<< [21:03:54] : [Step 4/5] [2021-11-19 21:03:54,829][INFO ][main][root] >>> Non-Heap: 130 MB used / 140 MB commited / 0 MB max <<< [21:03:54]W: [org.apache.ignite:ignite-core] [2021-11-19 21:03:54,838][WARN ][main][G] Ignite work directory is not provided, automatically resolved to: /opt/buildagent/work/7bc1c54bc719b67c/work [21:03:54] : [Step 4/5] [2021-11-19 21:03:54,842][INFO ][main][EncryptedCacheCreateTest0] [21:03:54] : [Step 4/5] [21:03:54] : [Step 4/5] >>> __________ ________________ [21:03:54] : [Step 4/5] >>> / _/ ___/ |/ / _/_ __/ __/ [21:03:54] : [Step 4/5] >>> _/ // (7 7 // / / / / _/ [21:03:54] : [Step 4/5] >>> /___/\___/_/|_/___/ /_/ /___/ [21:03:54] : [Step 4/5] >>> [21:03:54] : [Step 4/5] >>> ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:03:54] : [Step 4/5] >>> 2021 Copyright(C) Apache Software Foundation [21:03:54] : [Step 4/5] >>> [21:03:54] : [Step 4/5] >>> Ignite documentation: http://ignite.apache.org [21:03:54] : [Step 4/5] [21:03:54] : [Step 4/5] [2021-11-19 21:03:54,842][INFO ][main][EncryptedCacheCreateTest0] Config URL: n/a [21:03:54] : [Step 4/5] [2021-11-19 21:03:54,843][INFO ][main][EncryptedCacheCreateTest0] IgniteConfiguration [igniteInstanceName=encryption.EncryptedCacheCreateTest0, pubPoolSize=24, svcPoolSize=24, callbackPoolSize=24, stripedPoolSize=24, sysPoolSize=24, mgmtPoolSize=4, dataStreamerPoolSize=24, utilityCachePoolSize=24, utilityCacheKeepAliveTime=60000, p2pPoolSize=2, qryPoolSize=24, buildIdxPoolSize=4, igniteHome=/opt/buildagent/work/7bc1c54bc719b67c, igniteWorkDir=/opt/buildagent/work/7bc1c54bc719b67c/work, mbeanSrv=com.sun.jmx.mbeanserver.JmxMBeanServer@6fe85038, nodeId=a07b3bd7-4671-4232-953f-e4042f500000, marsh=BinaryMarshaller [], marshLocJobs=false, daemon=false, p2pEnabled=true, netTimeout=10000, netCompressionLevel=1, sndRetryDelay=1000, sndRetryCnt=3, metricsHistSize=10000, metricsUpdateFreq=1000, metricsExpTime=9223372036854775807, discoSpi=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=0, ackTimeout=0, marsh=null, reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], segPlc=STOP, segResolveAttempts=2, waitForSegOnStart=true, allResolversPassReq=true, segChkFreq=10000, commSpi=TcpCommunicationSpi [connectGate=org.apache.ignite.spi.communication.tcp.internal.ConnectGateway@76cf841, ctxInitLatch=java.util.concurrent.CountDownLatch@297c9a9b[Count = 1], stopping=false, clientPool=null, nioSrvWrapper=null, stateProvider=null], evtSpi=MemoryEventStorageSpi [expireAgeMs=9223372036854775807, expireCnt=10000, filter=null], colSpi=NoopCollisionSpi [], deploySpi=LocalDeploymentSpi [], indexingSpi=org.apache.ignite.spi.indexing.noop.NoopIndexingSpi@2bc7db89, addrRslvr=null, encryptionSpi=org.apache.ignite.spi.encryption.keystore.KeystoreEncryptionSpi@479ac2cb, tracingSpi=org.apache.ignite.spi.tracing.NoopTracingSpi@220c9a63, clientMode=false, rebalanceThreadPoolSize=4, rebalanceTimeout=10000, rebalanceBatchesPrefetchCnt=3, rebalanceThrottle=0, rebalanceBatchSize=524288, txCfg=TransactionConfiguration [txSerEnabled=false, dfltIsolation=REPEATABLE_READ, dfltConcurrency=PESSIMISTIC, dfltTxTimeout=0, txTimeoutOnPartitionMapExchange=0, deadlockTimeout=10000, pessimisticTxLogSize=0, pessimisticTxLogLinger=10000, tmLookupClsName=null, txManagerFactory=null, useJtaSync=false], cacheSanityCheckEnabled=true, discoStartupDelay=60000, deployMode=SHARED, p2pMissedCacheSize=100, locHost=127.0.0.1, timeSrvPortBase=31100, timeSrvPortRange=100, failureDetectionTimeout=10000, sysWorkerBlockedTimeout=null, clientFailureDetectionTimeout=10000, metricsLogFreq=0, connectorCfg=null, odbcCfg=null, warmupClos=null, atomicCfg=AtomicConfiguration [seqReserveSize=1000, cacheMode=PARTITIONED, backups=1, aff=null, grpName=null], classLdr=null, sslCtxFactory=null, platformCfg=null, binaryCfg=null, memCfg=null, pstCfg=null, dsCfg=DataStorageConfiguration [sysRegionInitSize=41943040, sysRegionMaxSize=104857600, pageSize=4096, concLvl=0, dfltDataRegConf=DataRegionConfiguration [name=default, maxSize=10485760, initSize=268435456, swapPath=null, pageEvictionMode=DISABLED, pageReplacementMode=CLOCK, evictionThreshold=0.9, emptyPagesPoolSize=100, metricsEnabled=false, metricsSubIntervalCount=5, metricsRateTimeInterval=60000, persistenceEnabled=true, checkpointPageBufSize=0, lazyMemoryAllocation=true, warmUpCfg=null], dataRegions=DataRegionConfiguration[] [DataRegionConfiguration [name=no-persistence-region, maxSize=10485760, initSize=268435456, swapPath=null, pageEvictionMode=DISABLED, pageReplacementMode=CLOCK, evictionThreshold=0.9, emptyPagesPoolSize=100, metricsEnabled=false, metricsSubIntervalCount=5, metricsRateTimeInterval=60000, persistenceEnabled=false, checkpointPageBufSize=0, lazyMemoryAllocation=true, warmUpCfg=null]], storagePath=null, checkpointFreq=180000, lockWaitTime=10000, checkpointThreads=4, checkpointWriteOrder=SEQUENTIAL, walHistSize=20, maxWalArchiveSize=1073741824, walSegments=10, walSegmentSize=67108864, walPath=db/wal, walArchivePath=db/wal/archive, cdcWalPath=db/wal/cdc, cdcEnabled=false, metricsEnabled=false, walMode=FSYNC, walTlbSize=131072, walBuffSize=0, walFlushFreq=2000, walFsyncDelay=1000, walRecordIterBuffSize=67108864, alwaysWriteFullPages=false, fileIOFactory=org.apache.ignite.internal.processors.cache.persistence.file.AsyncFileIOFactory@54b2fc58, metricsSubIntervalCnt=5, metricsRateTimeInterval=60000, walAutoArchiveAfterInactivity=-1, walForceArchiveTimeout=-1, writeThrottlingEnabled=false, walCompactionEnabled=false, walCompactionLevel=1, checkpointReadLockTimeout=null, walPageCompression=DISABLED, walPageCompressionLevel=null, dfltWarmUpCfg=null, encCfg=org.apache.ignite.configuration.EncryptionConfiguration@daf22f0, defragmentationThreadPoolSize=4, minWalArchiveSize=-1], snapshotPath=snapshots, activeOnStart=true, activeOnStartPropSetFlag=false, autoActivation=true, autoActivationPropSetFlag=false, clusterStateOnStart=null, sqlConnCfg=null, cliConnCfg=ClientConnectorConfiguration [host=null, port=10800, portRange=100, sockSndBufSize=0, sockRcvBufSize=0, tcpNoDelay=true, maxOpenCursorsPerConn=128, threadPoolSize=24, selectorCnt=12, idleTimeout=0, handshakeTimeout=10000, jdbcEnabled=true, odbcEnabled=true, thinCliEnabled=true, sslEnabled=false, useIgniteSslCtxFactory=true, sslClientAuth=false, sslCtxFactory=null, thinCliCfg=ThinClientConfiguration [maxActiveTxPerConn=100, maxActiveComputeTasksPerConn=0]], mvccVacuumThreadCnt=2, mvccVacuumFreq=5000, authEnabled=false, failureHnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]], commFailureRslvr=null, sqlCfg=SqlConfiguration [longQryWarnTimeout=3000, dfltQryTimeout=0, sqlQryHistSize=1000, validationEnabled=false], asyncContinuationExecutor=null] [21:03:54] : [Step 4/5] [2021-11-19 21:03:54,853][INFO ][main][EncryptedCacheCreateTest0] Daemon mode: off [21:03:54] : [Step 4/5] [2021-11-19 21:03:54,853][INFO ][main][EncryptedCacheCreateTest0] OS: Linux 4.15.0-151-generic amd64 [21:03:54] : [Step 4/5] [2021-11-19 21:03:54,853][INFO ][main][EncryptedCacheCreateTest0] OS user: teamcity [21:03:54] : [Step 4/5] [2021-11-19 21:03:54,854][INFO ][main][EncryptedCacheCreateTest0] PID: 16724 [21:03:54] : [Step 4/5] [2021-11-19 21:03:54,854][INFO ][main][EncryptedCacheCreateTest0] Language runtime: Java Platform API Specification ver. 1.8 [21:03:54] : [Step 4/5] [2021-11-19 21:03:54,855][INFO ][main][EncryptedCacheCreateTest0] VM information: Java(TM) SE Runtime Environment 1.8.0_261-b12 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 25.261-b12 [21:03:54] : [Step 4/5] [2021-11-19 21:03:54,855][INFO ][main][EncryptedCacheCreateTest0] VM total memory: 1.9GB [21:03:54] : [Step 4/5] [2021-11-19 21:03:54,855][INFO ][main][EncryptedCacheCreateTest0] Remote Management [restart: off, REST: off, JMX (remote: off)] [21:03:54] : [Step 4/5] [2021-11-19 21:03:54,856][INFO ][main][EncryptedCacheCreateTest0] Logger: GridTestLog4jLogger [quiet=false, config=null] [21:03:54] : [Step 4/5] [2021-11-19 21:03:54,856][INFO ][main][EncryptedCacheCreateTest0] IGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c [21:03:54] : [Step 4/5] [2021-11-19 21:03:54,856][INFO ][main][EncryptedCacheCreateTest0] VM arguments: [-DIGNITE_DUMP_THREADS_ON_FAILURE=false, -DMono=/usr/bin/mono-sgen, -DMono4.0_x64=/usr/lib/mono/4.0, -DMono4.5_x64=/usr/lib/mono/4.5, -DMonoVersion=6.12.0.90, -DSKIP_BUILD=false, -Dagent.home.dir=/opt/buildagent, -Dagent.name=aitc-lin02_03, -Dagent.ownPort=9090, -Dagent.work.dir=/opt/buildagent/work, -Dbuild.number=95, -Dbuild.vcs.number=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.1=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.GitHubApacheIgnite=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dclassworlds.conf=/opt/buildagent/temp/buildTmp/teamcity.m2.conf, -Dcom.jetbrains.maven.watcher.report.file=/opt/buildagent/temp/buildTmp/maven-build-info.xml, -Djava.io.tmpdir=/opt/buildagent/temp/buildTmp, -Dmaven.home=/opt/buildagent/tools/maven3_6, -Dmaven.multiModuleProjectDirectory=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.agent.cpuBenchmark=457, -Dteamcity.agent.dotnet.agent_url=http://localhost:9090/RPC2, -Dteamcity.agent.dotnet.build_id=6278078, -Dteamcity.auth.password=*******, -Dteamcity.auth.userId=TeamCityBuildId=6278078, -Dteamcity.build.changedFiles.file=/opt/buildagent/temp/buildTmp/changedFiles6342607772318147725.txt, -Dteamcity.build.checkoutDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.build.id=6278078, -Dteamcity.build.properties.file=/opt/buildagent/temp/buildTmp/teamcity.build5164517880467851002.properties, -Dteamcity.build.tempDir=/opt/buildagent/temp/buildTmp, -Dteamcity.build.workingDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.buildConfName=Basic 3, -Dteamcity.buildType.id=IgniteTests24Java8_Basic3, -Dteamcity.configuration.properties.file=/opt/buildagent/temp/buildTmp/teamcity.config5591980786735343870.properties, -Dteamcity.maven.userSettings.path=/opt/buildagent/temp/buildTmp/maven_settings_585072866407032347.xml, -Dteamcity.maven.watcher.home=/opt/buildagent/plugins/mavenPlugin/maven-watcher-jdk16, -Dteamcity.projectName=Ignite Tests 2.x (JDK 8/11), -Dteamcity.runner.properties.file=/opt/buildagent/temp/buildTmp/teamcity.runner9098465561618137420.properties, -Dteamcity.tests.recentlyFailedTests.file=/opt/buildagent/temp/buildTmp/testsToRunFirst3891775683130404069.txt, -Dteamcity.version=2021.2 (build 99542), -ea, -Xms2g, -Xmx2g, -XX:+HeapDumpOnOutOfMemoryError, -DIGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_TEST_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_UPDATE_NOTIFIER=false, -DIGNITE_NO_DISCO_ORDER=true, -DIGNITE_PERFORMANCE_SUGGESTIONS_DISABLED=true, -Djava.net.preferIPv4Stack=true, -DTEST_SCALE_FACTOR=1.0, -DIGNITE_TEST_PROP_LOG4J_FILE=log4j-tc-test.xml, -DIGNITE_QUIET=false, -DIGNITE_MARSHAL_BUFFERS_RECHECK=1000, -Dmaven.repo.local=/opt/buildagent/.m2/repository] [21:03:54] : [Step 4/5] [2021-11-19 21:03:54,861][INFO ][main][EncryptedCacheCreateTest0] System cache's DataRegion size is configured to 40 MB. Use DataStorageConfiguration.systemRegionInitialSize property to change the setting. [21:03:54] : [Step 4/5] [2021-11-19 21:03:54,862][INFO ][main][EncryptedCacheCreateTest0] Configured caches [in 'sysMemPlc' dataRegion: ['ignite-sys-cache']] [21:03:54]W: [org.apache.ignite:ignite-core] [2021-11-19 21:03:54,862][WARN ][main][EncryptedCacheCreateTest0] Peer class loading is enabled (disable it in production for performance and deployment consistency reasons) [21:03:54] : [Step 4/5] [2021-11-19 21:03:54,862][INFO ][main][EncryptedCacheCreateTest0] 3-rd party licenses can be found at: /opt/buildagent/work/7bc1c54bc719b67c/libs/licenses [21:03:54] : [Step 4/5] [2021-11-19 21:03:54,868][INFO ][main][IgnitePluginProcessor] Configured plugins: [21:03:54] : [Step 4/5] [2021-11-19 21:03:54,868][INFO ][main][IgnitePluginProcessor] ^-- StanByClusterTestProvider 1.0 [21:03:54] : [Step 4/5] [2021-11-19 21:03:54,868][INFO ][main][IgnitePluginProcessor] ^-- null [21:03:54] : [Step 4/5] [2021-11-19 21:03:54,868][INFO ][main][IgnitePluginProcessor] [21:03:54] : [Step 4/5] [2021-11-19 21:03:54,868][INFO ][main][IgnitePluginProcessor] ^-- PageMemory tracker plugin 1.0 [21:03:54] : [Step 4/5] [2021-11-19 21:03:54,868][INFO ][main][IgnitePluginProcessor] ^-- null [21:03:54] : [Step 4/5] [2021-11-19 21:03:54,868][INFO ][main][IgnitePluginProcessor] [21:03:54] : [Step 4/5] [2021-11-19 21:03:54,869][INFO ][main][IgnitePluginProcessor] ^-- TestDistibutedConfigurationPlugin 1.0 [21:03:54] : [Step 4/5] [2021-11-19 21:03:54,869][INFO ][main][IgnitePluginProcessor] ^-- null [21:03:54] : [Step 4/5] [2021-11-19 21:03:54,869][INFO ][main][IgnitePluginProcessor] [21:03:54] : [Step 4/5] [2021-11-19 21:03:54,869][INFO ][main][IgnitePluginProcessor] ^-- NodeValidationPluginProvider 1.0 [21:03:54] : [Step 4/5] [2021-11-19 21:03:54,869][INFO ][main][IgnitePluginProcessor] ^-- null [21:03:54] : [Step 4/5] [2021-11-19 21:03:54,869][INFO ][main][IgnitePluginProcessor] [21:03:54] : [Step 4/5] [2021-11-19 21:03:54,870][INFO ][main][FailureProcessor] Configured failure handler: [hnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]]] [21:03:54] : [Step 4/5] [2021-11-19 21:03:54,889][INFO ][main][TcpCommunicationSpi] Successfully bound communication NIO server to TCP port [port=45120, locHost=/127.0.0.1, selectorsCnt=12, selectorSpins=0, pairedConn=false] [21:03:54]W: [org.apache.ignite:ignite-core] [2021-11-19 21:03:54,890][WARN ][main][TcpCommunicationSpi] Message queue limit is set to 0 which may lead to potential OOMEs when running cache operations in FULL_ASYNC or PRIMARY_SYNC modes due to message queues growth on sender and receiver sides. [21:03:54] : [Step 4/5] [2021-11-19 21:03:54,899][INFO ][main][GridCollisionManager] Collision resolution is disabled (all jobs will be activated upon arrival). [21:03:54] : [Step 4/5] [2021-11-19 21:03:54,899][INFO ][main][EncryptedCacheCreateTest0] Security status [authentication=off, sandbox=off, tls/ssl=off] [21:03:54] : [Step 4/5] [2021-11-19 21:03:54,966][INFO ][main][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:03:55] : [Step 4/5] [2021-11-19 21:03:55,065][INFO ][main][MaintenanceProcessor] Resolved store directory for node persistent data: /opt/buildagent/work/7bc1c54bc719b67c/work/db/encryption_EncryptedCacheCreateTest0 [21:03:55] : [Step 4/5] [2021-11-19 21:03:55,067][INFO ][main][CacheObjectBinaryProcessorImpl] Resolved directory for serialized binary metadata: /opt/buildagent/work/7bc1c54bc719b67c/work/db/binary_meta/encryption_EncryptedCacheCreateTest0 [21:03:55] : [Step 4/5] [2021-11-19 21:03:55,081][INFO ][main][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/encryption_EncryptedCacheCreateTest0 [21:03:55] : [Step 4/5] [2021-11-19 21:03:55,082][INFO ][main][FileWriteAheadLogManager] Resolved write ahead log work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/encryption_EncryptedCacheCreateTest0 [21:03:55] : [Step 4/5] [2021-11-19 21:03:55,082][INFO ][main][FileWriteAheadLogManager] Resolved write ahead log archive directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/encryption_EncryptedCacheCreateTest0 [21:03:55] : [Step 4/5] [2021-11-19 21:03:55,512][INFO ][main][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/encryption_EncryptedCacheCreateTest0/0000000000000000.wal [21:03:55]W: [org.apache.ignite:ignite-core] [2021-11-19 21:03:55,513][WARN ][main][GridCacheDatabaseSharedManager] DataRegion maxSize=10.5 MB is smaller than defaultInitialSize=268.4 MB, setting initialSize to 10.5 MB [21:03:55] : [Step 4/5] [2021-11-19 21:03:55,518][INFO ][main][GridCacheDatabaseSharedManager] Configured data regions initialized successfully [total=6] [21:03:55] : [Step 4/5] [2021-11-19 21:03:55,520][INFO ][main][IgniteSnapshotManager] Resolved snapshot work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/snapshots [21:03:55] : [Step 4/5] [2021-11-19 21:03:55,520][INFO ][main][IgniteSnapshotManager] Resolved temp directory for snapshot creation: /opt/buildagent/work/7bc1c54bc719b67c/work/db/encryption_EncryptedCacheCreateTest0/snp [21:03:55] : [Step 4/5] [2021-11-19 21:03:55,524][INFO ][main][ClientListenerProcessor] Client connector processor has started on TCP port 10800 [21:03:55] : [Step 4/5] [2021-11-19 21:03:55,531][INFO ][main][EncryptedCacheCreateTest0] Non-loopback local IPs: 172.17.0.4 [21:03:55] : [Step 4/5] [2021-11-19 21:03:55,532][INFO ][main][EncryptedCacheCreateTest0] Enabled local MACs: 0242AC110004 [21:03:55] : [Step 4/5] [2021-11-19 21:03:55,534][INFO ][main][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:03:55] : [Step 4/5] [2021-11-19 21:03:55,536][INFO ][main][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:03:55] : [Step 4/5] [2021-11-19 21:03:55,536][INFO ][main][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:03:55] : [Step 4/5] [2021-11-19 21:03:55,539][INFO ][main][GridCacheDatabaseSharedManager] Applying lost metastore updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:03:55] : [Step 4/5] [2021-11-19 21:03:55,540][INFO ][main][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=0 ms] [21:03:55] : [Step 4/5] [2021-11-19 21:03:55,540][INFO ][main][GridCacheProcessor] Restoring partition state for local groups. [21:03:55] : [Step 4/5] [2021-11-19 21:03:55,540][INFO ][main][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=0, partitionsProcessed=0, time=0ms] [21:03:55] : [Step 4/5] [2021-11-19 21:03:55,541][INFO ][main][GridEncryptionManager] Encryption keys loaded from metastore. [grps=, masterKeyName=ignite.master.key] [21:03:55] : [Step 4/5] [2021-11-19 21:03:55,549][INFO ][main][ClusterProcessor] Cluster ID and tag has been read from metastorage: null [21:03:55] : [Step 4/5] [2021-11-19 21:03:55,549][INFO ][main][IgniteClusterImpl] Shutdown policy was updated [oldVal=null, newVal=null] [21:03:55] : [Step 4/5] [2021-11-19 21:03:55,550][INFO ][main][GridCacheDatabaseSharedManager] Checkpoint frequency deviation changed [oldVal=null, newVal=null] [21:03:55] : [Step 4/5] [2021-11-19 21:03:55,560][INFO ][main][FilePageStoreManager] Cleanup cache stores [total=1, left=0, cleanFiles=false] [21:03:55] : [Step 4/5] [2021-11-19 21:03:55,563][INFO ][main][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:03:55] : [Step 4/5] [2021-11-19 21:03:55,563][INFO ][main][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:03:55] : [Step 4/5] [2021-11-19 21:03:55,564][INFO ][main][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:03:55] : [Step 4/5] [2021-11-19 21:03:55,565][INFO ][main][GridCacheDatabaseSharedManager] Data Regions Started: 6 [21:03:55] : [Step 4/5] [2021-11-19 21:03:55,565][INFO ][main][GridCacheDatabaseSharedManager] ^-- sysMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:03:55] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:03:55] : [Step 4/5] ^-- no-persistence-region region [type=user, persistence=false, lazyAlloc=true, [21:03:55] : [Step 4/5] ... initCfg=10MB, maxCfg=10MB, usedRam=0MB, freeRam=100%, allocRam=0MB] [21:03:55] : [Step 4/5] ^-- default region [type=default, persistence=true, lazyAlloc=true, [21:03:55] : [Step 4/5] ... initCfg=10MB, maxCfg=10MB, usedRam=0MB, freeRam=100%, allocRam=0MB, allocTotal=0MB] [21:03:55] : [Step 4/5] ^-- metastoreMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:03:55] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:03:55] : [Step 4/5] ^-- TxLog region [type=internal, persistence=true, lazyAlloc=false, [21:03:55] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:03:55] : [Step 4/5] ^-- volatileDsMemPlc region [type=user, persistence=false, lazyAlloc=true, [21:03:55] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB] [21:03:55] : [Step 4/5] ^-- Ignite persistence [used=0MB] [21:03:55] : [Step 4/5] [21:03:55] : [Step 4/5] [2021-11-19 21:03:55,567][INFO ][main][GridCacheDatabaseSharedManager] Starting binary memory restore for: [-2100569601] [21:03:55] : [Step 4/5] [2021-11-19 21:03:55,576][INFO ][main][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:03:55] : [Step 4/5] [2021-11-19 21:03:55,576][INFO ][main][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:03:55] : [Step 4/5] [2021-11-19 21:03:55,578][INFO ][main][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/encryption_EncryptedCacheCreateTest0/0000000000000000.wal, offset=0, ver=2] [21:03:55] : [Step 4/5] [2021-11-19 21:03:55,583][INFO ][main][GridCacheProcessor] Started cache in recovery mode [name=ignite-sys-cache, id=-2100569601, dataRegionName=sysMemPlc, mode=REPLICATED, atomicity=TRANSACTIONAL, backups=2147483647, mvcc=false] [21:03:55] : [Step 4/5] [2021-11-19 21:03:55,584][INFO ][main][GridCacheDatabaseSharedManager] Binary recovery performed in 17 ms. [21:03:55] : [Step 4/5] [2021-11-19 21:03:55,584][INFO ][main][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:03:55] : [Step 4/5] [2021-11-19 21:03:55,584][INFO ][main][GridCacheDatabaseSharedManager] Applying lost cache updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:03:55] : [Step 4/5] [2021-11-19 21:03:55,660][INFO ][main][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=71 ms] [21:03:55] : [Step 4/5] [2021-11-19 21:03:55,660][INFO ][main][GridCacheProcessor] Restoring partition state for local groups. [21:03:55] : [Step 4/5] [2021-11-19 21:03:55,667][INFO ][main][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=1, partitionsProcessed=100, time=10ms] [21:03:55] : [Step 4/5] [2021-11-19 21:03:55,996][INFO ][main][TestTcpDiscoverySpi] Successfully bound to TCP port [port=47500, localHost=localhost/127.0.0.1, locNodeId=a07b3bd7-4671-4232-953f-e4042f500000] [21:03:56] : [Step 4/5] [2021-11-19 21:03:56,009][INFO ][disco-notifier-worker-#6190%encryption.EncryptedCacheCreateTest0%][MvccProcessorImpl] Assigned mvcc coordinator [crd=MvccCoordinator [topVer=AffinityTopologyVersion [topVer=1, minorTopVer=0], nodeId=a07b3bd7-4671-4232-953f-e4042f500000, ver=1637345035999, local=true, initialized=false]] [21:03:56] : [Step 4/5] [2021-11-19 21:03:56,014][INFO ][sys-#6175%encryption.EncryptedCacheCreateTest0%][ClusterProcessor] Writing cluster ID and tag to metastorage on ready for write ClusterIdAndTag [id=ab933df3-d5f2-4640-a48f-7423b3f6ef7f, tag=lucid_sinoussi] [21:03:56] : [Step 4/5] [2021-11-19 21:03:56,020][INFO ][disco-notifier-worker-#6190%encryption.EncryptedCacheCreateTest0%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustEnabled' was changed from 'null' to 'false' [21:03:56] : [Step 4/5] [2021-11-19 21:03:56,022][INFO ][disco-notifier-worker-#6190%encryption.EncryptedCacheCreateTest0%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustTimeout' was changed from 'null' to '300000' [21:03:56] : [Step 4/5] [2021-11-19 21:03:56,023][INFO ][disco-notifier-worker-#6190%encryption.EncryptedCacheCreateTest0%][IgniteTxManager] Transactions parameter 'longOperationsDumpTimeout' was changed from 'null' to '60000' [21:03:56] : [Step 4/5] [2021-11-19 21:03:56,024][INFO ][disco-notifier-worker-#6190%encryption.EncryptedCacheCreateTest0%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpThreshold' was changed from 'null' to '0' [21:03:56] : [Step 4/5] [2021-11-19 21:03:56,025][INFO ][disco-notifier-worker-#6190%encryption.EncryptedCacheCreateTest0%][ClusterProcessor] lucid_sinoussi [21:03:56] : [Step 4/5] [2021-11-19 21:03:56,026][INFO ][disco-notifier-worker-#6190%encryption.EncryptedCacheCreateTest0%][IgniteTxManager] Transactions parameter 'transactionTimeDumpSamplesCoefficient' was changed from 'null' to '0.0' [21:03:56] : [Step 4/5] [2021-11-19 21:03:56,026][INFO ][disco-notifier-worker-#6190%encryption.EncryptedCacheCreateTest0%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpSamplesPerSecondLimit' was changed from 'null' to '5' [21:03:56] : [Step 4/5] [2021-11-19 21:03:56,027][INFO ][disco-notifier-worker-#6190%encryption.EncryptedCacheCreateTest0%][IgniteTxManager] Transactions parameter 'collisionsDumpInterval' was changed from 'null' to '1000' [21:03:56] : [Step 4/5] [2021-11-19 21:03:56,027][INFO ][disco-notifier-worker-#6190%encryption.EncryptedCacheCreateTest0%][IgniteTxManager] Transactions parameter 'txOwnerDumpRequestsAllowed' was changed from 'null' to 'true' [21:03:56] : [Step 4/5] [2021-11-19 21:03:56,028][INFO ][disco-notifier-worker-#6190%encryption.EncryptedCacheCreateTest0%][GridCacheDatabaseSharedManager] Historical rebalance WAL threshold changed [property=historical.rebalance.threshold, oldVal=null, newVal=500] [21:03:56] : [Step 4/5] [2021-11-19 21:03:56,044][INFO ][main][EncryptedCacheCreateTest0] To start Console Management & Monitoring run ignitevisorcmd.{sh|bat} [21:03:56] : [Step 4/5] [2021-11-19 21:03:56,045][INFO ][main][EncryptedCacheCreateTest0] [21:03:56] : [Step 4/5] [21:03:56] : [Step 4/5] >>> +-------------------------------------------+ [21:03:56] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:03:56] : [Step 4/5] >>> +-------------------------------------------+ [21:03:56] : [Step 4/5] >>> OS name: Linux 4.15.0-151-generic amd64 [21:03:56] : [Step 4/5] >>> CPU(s): 24 [21:03:56] : [Step 4/5] >>> Heap: 2.0GB [21:03:56] : [Step 4/5] >>> VM name: 16724@c4dfe9a430b2 [21:03:56] : [Step 4/5] >>> Ignite instance name: encryption.EncryptedCacheCreateTest0 [21:03:56] : [Step 4/5] >>> Local node [ID=A07B3BD7-4671-4232-953F-E4042F500000, order=1, clientMode=false] [21:03:56] : [Step 4/5] >>> Local node addresses: [127.0.0.1] [21:03:56] : [Step 4/5] >>> Local ports: TCP:10800 TCP:45120 TCP:47500 [21:03:56] : [Step 4/5] [21:03:56] : [Step 4/5] [2021-11-19 21:03:56,046][INFO ][main][EncryptedCacheCreateTest0] >>> Ignite cluster is in INACTIVE state (limited functionality available). Use control.(sh|bat) script or IgniteCluster.state(ClusterState.ACTIVE) to change the state. [21:03:56] : [Step 4/5] [2021-11-19 21:03:56,046][INFO ][main][GridDiscoveryManager] Topology snapshot [ver=1, locNode=a07b3bd7, servers=1, clients=0, state=INACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=a07b3bd7-4671-4232-953f-e4042f500000, consistentId=encryption.EncryptedCacheCreateTest0, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:03:56] : [Step 4/5] [2021-11-19 21:03:56,047][INFO ][main][G] Node started : [stage="Configure system pool" (1 ms),stage="Start managers" (226 ms),stage="Configure binary metadata" (4 ms),stage="Start processors" (460 ms),stage="Start 'StanByClusterTestProvider' plugin" (0 ms),stage="Start 'PageMemory tracker plugin' plugin" (0 ms),stage="Start 'TestDistibutedConfigurationPlugin' plugin" (0 ms),stage="Start 'NodeValidationPluginProvider' plugin" (0 ms),stage="Init metastore" (29 ms),stage="Init and start regions" (6 ms),stage="Restore binary memory" (17 ms),stage="Restore logical state" (83 ms),stage="Finish recovery" (327 ms),stage="Join topology" (14 ms),stage="Await transition" (7 ms),stage="Await exchange" (30 ms),stage="Total time" (1204 ms)] [21:03:56] : [Step 4/5] [2021-11-19 21:03:56,049][INFO ][main][root] Node started with the following configuration [id=a07b3bd7-4671-4232-953f-e4042f500000, marshaller=BinaryMarshaller [], discovery=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=5000, ackTimeout=5000, marsh=JdkMarshaller [clsFilter=org.apache.ignite.marshaller.MarshallerUtils$1@4f379769], reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], binaryCfg=null, lateAff=true] [21:03:56]W: [org.apache.ignite:ignite-core] [2021-11-19 21:03:56,059][WARN ][main][G] Ignite work directory is not provided, automatically resolved to: /opt/buildagent/work/7bc1c54bc719b67c/work [21:03:56] : [Step 4/5] [2021-11-19 21:03:56,061][INFO ][main][EncryptedCacheCreateTest1] [21:03:56] : [Step 4/5] [21:03:56] : [Step 4/5] >>> __________ ________________ [21:03:56] : [Step 4/5] >>> / _/ ___/ |/ / _/_ __/ __/ [21:03:56] : [Step 4/5] >>> _/ // (7 7 // / / / / _/ [21:03:56] : [Step 4/5] >>> /___/\___/_/|_/___/ /_/ /___/ [21:03:56] : [Step 4/5] >>> [21:03:56] : [Step 4/5] >>> ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:03:56] : [Step 4/5] >>> 2021 Copyright(C) Apache Software Foundation [21:03:56] : [Step 4/5] >>> [21:03:56] : [Step 4/5] >>> Ignite documentation: http://ignite.apache.org [21:03:56] : [Step 4/5] [21:03:56] : [Step 4/5] [2021-11-19 21:03:56,062][INFO ][main][EncryptedCacheCreateTest1] Config URL: n/a [21:03:56] : [Step 4/5] [2021-11-19 21:03:56,063][INFO ][main][EncryptedCacheCreateTest1] IgniteConfiguration [igniteInstanceName=encryption.EncryptedCacheCreateTest1, pubPoolSize=24, svcPoolSize=24, callbackPoolSize=24, stripedPoolSize=24, sysPoolSize=24, mgmtPoolSize=4, dataStreamerPoolSize=24, utilityCachePoolSize=24, utilityCacheKeepAliveTime=60000, p2pPoolSize=2, qryPoolSize=24, buildIdxPoolSize=4, igniteHome=/opt/buildagent/work/7bc1c54bc719b67c, igniteWorkDir=/opt/buildagent/work/7bc1c54bc719b67c/work, mbeanSrv=com.sun.jmx.mbeanserver.JmxMBeanServer@6fe85038, nodeId=1b4fc279-8bef-4622-8c34-5256a4800001, marsh=BinaryMarshaller [], marshLocJobs=false, daemon=false, p2pEnabled=true, netTimeout=10000, netCompressionLevel=1, sndRetryDelay=1000, sndRetryCnt=3, metricsHistSize=10000, metricsUpdateFreq=1000, metricsExpTime=9223372036854775807, discoSpi=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=0, ackTimeout=0, marsh=null, reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], segPlc=STOP, segResolveAttempts=2, waitForSegOnStart=true, allResolversPassReq=true, segChkFreq=10000, commSpi=TcpCommunicationSpi [connectGate=org.apache.ignite.spi.communication.tcp.internal.ConnectGateway@1235151c, ctxInitLatch=java.util.concurrent.CountDownLatch@5a1f778[Count = 1], stopping=false, clientPool=null, nioSrvWrapper=null, stateProvider=null], evtSpi=MemoryEventStorageSpi [expireAgeMs=9223372036854775807, expireCnt=10000, filter=null], colSpi=NoopCollisionSpi [], deploySpi=LocalDeploymentSpi [], indexingSpi=org.apache.ignite.spi.indexing.noop.NoopIndexingSpi@67770b37, addrRslvr=null, encryptionSpi=org.apache.ignite.spi.encryption.keystore.KeystoreEncryptionSpi@72906e, tracingSpi=org.apache.ignite.spi.tracing.NoopTracingSpi@5529ff44, clientMode=false, rebalanceThreadPoolSize=4, rebalanceTimeout=10000, rebalanceBatchesPrefetchCnt=3, rebalanceThrottle=0, rebalanceBatchSize=524288, txCfg=TransactionConfiguration [txSerEnabled=false, dfltIsolation=REPEATABLE_READ, dfltConcurrency=PESSIMISTIC, dfltTxTimeout=0, txTimeoutOnPartitionMapExchange=0, deadlockTimeout=10000, pessimisticTxLogSize=0, pessimisticTxLogLinger=10000, tmLookupClsName=null, txManagerFactory=null, useJtaSync=false], cacheSanityCheckEnabled=true, discoStartupDelay=60000, deployMode=SHARED, p2pMissedCacheSize=100, locHost=127.0.0.1, timeSrvPortBase=31100, timeSrvPortRange=100, failureDetectionTimeout=10000, sysWorkerBlockedTimeout=null, clientFailureDetectionTimeout=10000, metricsLogFreq=0, connectorCfg=null, odbcCfg=null, warmupClos=null, atomicCfg=AtomicConfiguration [seqReserveSize=1000, cacheMode=PARTITIONED, backups=1, aff=null, grpName=null], classLdr=null, sslCtxFactory=null, platformCfg=null, binaryCfg=null, memCfg=null, pstCfg=null, dsCfg=DataStorageConfiguration [sysRegionInitSize=41943040, sysRegionMaxSize=104857600, pageSize=4096, concLvl=0, dfltDataRegConf=DataRegionConfiguration [name=default, maxSize=10485760, initSize=268435456, swapPath=null, pageEvictionMode=DISABLED, pageReplacementMode=CLOCK, evictionThreshold=0.9, emptyPagesPoolSize=100, metricsEnabled=false, metricsSubIntervalCount=5, metricsRateTimeInterval=60000, persistenceEnabled=true, checkpointPageBufSize=0, lazyMemoryAllocation=true, warmUpCfg=null], dataRegions=DataRegionConfiguration[] [DataRegionConfiguration [name=no-persistence-region, maxSize=10485760, initSize=268435456, swapPath=null, pageEvictionMode=DISABLED, pageReplacementMode=CLOCK, evictionThreshold=0.9, emptyPagesPoolSize=100, metricsEnabled=false, metricsSubIntervalCount=5, metricsRateTimeInterval=60000, persistenceEnabled=false, checkpointPageBufSize=0, lazyMemoryAllocation=true, warmUpCfg=null]], storagePath=null, checkpointFreq=180000, lockWaitTime=10000, checkpointThreads=4, checkpointWriteOrder=SEQUENTIAL, walHistSize=20, maxWalArchiveSize=1073741824, walSegments=10, walSegmentSize=67108864, walPath=db/wal, walArchivePath=db/wal/archive, cdcWalPath=db/wal/cdc, cdcEnabled=false, metricsEnabled=false, walMode=FSYNC, walTlbSize=131072, walBuffSize=0, walFlushFreq=2000, walFsyncDelay=1000, walRecordIterBuffSize=67108864, alwaysWriteFullPages=false, fileIOFactory=org.apache.ignite.internal.processors.cache.persistence.file.AsyncFileIOFactory@3a479fda, metricsSubIntervalCnt=5, metricsRateTimeInterval=60000, walAutoArchiveAfterInactivity=-1, walForceArchiveTimeout=-1, writeThrottlingEnabled=false, walCompactionEnabled=false, walCompactionLevel=1, checkpointReadLockTimeout=null, walPageCompression=DISABLED, walPageCompressionLevel=null, dfltWarmUpCfg=null, encCfg=org.apache.ignite.configuration.EncryptionConfiguration@8a6631b, defragmentationThreadPoolSize=4, minWalArchiveSize=-1], snapshotPath=snapshots, activeOnStart=true, activeOnStartPropSetFlag=false, autoActivation=true, autoActivationPropSetFlag=false, clusterStateOnStart=null, sqlConnCfg=null, cliConnCfg=ClientConnectorConfiguration [host=null, port=10800, portRange=100, sockSndBufSize=0, sockRcvBufSize=0, tcpNoDelay=true, maxOpenCursorsPerConn=128, threadPoolSize=24, selectorCnt=12, idleTimeout=0, handshakeTimeout=10000, jdbcEnabled=true, odbcEnabled=true, thinCliEnabled=true, sslEnabled=false, useIgniteSslCtxFactory=true, sslClientAuth=false, sslCtxFactory=null, thinCliCfg=ThinClientConfiguration [maxActiveTxPerConn=100, maxActiveComputeTasksPerConn=0]], mvccVacuumThreadCnt=2, mvccVacuumFreq=5000, authEnabled=false, failureHnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]], commFailureRslvr=null, sqlCfg=SqlConfiguration [longQryWarnTimeout=3000, dfltQryTimeout=0, sqlQryHistSize=1000, validationEnabled=false], asyncContinuationExecutor=null] [21:03:56] : [Step 4/5] [2021-11-19 21:03:56,072][INFO ][main][EncryptedCacheCreateTest1] Daemon mode: off [21:03:56] : [Step 4/5] [2021-11-19 21:03:56,072][INFO ][main][EncryptedCacheCreateTest1] OS: Linux 4.15.0-151-generic amd64 [21:03:56] : [Step 4/5] [2021-11-19 21:03:56,073][INFO ][main][EncryptedCacheCreateTest1] OS user: teamcity [21:03:56] : [Step 4/5] [2021-11-19 21:03:56,073][INFO ][main][EncryptedCacheCreateTest1] PID: 16724 [21:03:56] : [Step 4/5] [2021-11-19 21:03:56,073][INFO ][main][EncryptedCacheCreateTest1] Language runtime: Java Platform API Specification ver. 1.8 [21:03:56] : [Step 4/5] [2021-11-19 21:03:56,074][INFO ][main][EncryptedCacheCreateTest1] VM information: Java(TM) SE Runtime Environment 1.8.0_261-b12 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 25.261-b12 [21:03:56] : [Step 4/5] [2021-11-19 21:03:56,074][INFO ][main][EncryptedCacheCreateTest1] VM total memory: 1.9GB [21:03:56] : [Step 4/5] [2021-11-19 21:03:56,074][INFO ][main][EncryptedCacheCreateTest1] Remote Management [restart: off, REST: off, JMX (remote: off)] [21:03:56] : [Step 4/5] [2021-11-19 21:03:56,074][INFO ][main][EncryptedCacheCreateTest1] Logger: GridTestLog4jLogger [quiet=false, config=null] [21:03:56] : [Step 4/5] [2021-11-19 21:03:56,074][INFO ][main][EncryptedCacheCreateTest1] IGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c [21:03:56] : [Step 4/5] [2021-11-19 21:03:56,075][INFO ][main][EncryptedCacheCreateTest1] VM arguments: [-DIGNITE_DUMP_THREADS_ON_FAILURE=false, -DMono=/usr/bin/mono-sgen, -DMono4.0_x64=/usr/lib/mono/4.0, -DMono4.5_x64=/usr/lib/mono/4.5, -DMonoVersion=6.12.0.90, -DSKIP_BUILD=false, -Dagent.home.dir=/opt/buildagent, -Dagent.name=aitc-lin02_03, -Dagent.ownPort=9090, -Dagent.work.dir=/opt/buildagent/work, -Dbuild.number=95, -Dbuild.vcs.number=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.1=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.GitHubApacheIgnite=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dclassworlds.conf=/opt/buildagent/temp/buildTmp/teamcity.m2.conf, -Dcom.jetbrains.maven.watcher.report.file=/opt/buildagent/temp/buildTmp/maven-build-info.xml, -Djava.io.tmpdir=/opt/buildagent/temp/buildTmp, -Dmaven.home=/opt/buildagent/tools/maven3_6, -Dmaven.multiModuleProjectDirectory=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.agent.cpuBenchmark=457, -Dteamcity.agent.dotnet.agent_url=http://localhost:9090/RPC2, -Dteamcity.agent.dotnet.build_id=6278078, -Dteamcity.auth.password=*******, -Dteamcity.auth.userId=TeamCityBuildId=6278078, -Dteamcity.build.changedFiles.file=/opt/buildagent/temp/buildTmp/changedFiles6342607772318147725.txt, -Dteamcity.build.checkoutDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.build.id=6278078, -Dteamcity.build.properties.file=/opt/buildagent/temp/buildTmp/teamcity.build5164517880467851002.properties, -Dteamcity.build.tempDir=/opt/buildagent/temp/buildTmp, -Dteamcity.build.workingDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.buildConfName=Basic 3, -Dteamcity.buildType.id=IgniteTests24Java8_Basic3, -Dteamcity.configuration.properties.file=/opt/buildagent/temp/buildTmp/teamcity.config5591980786735343870.properties, -Dteamcity.maven.userSettings.path=/opt/buildagent/temp/buildTmp/maven_settings_585072866407032347.xml, -Dteamcity.maven.watcher.home=/opt/buildagent/plugins/mavenPlugin/maven-watcher-jdk16, -Dteamcity.projectName=Ignite Tests 2.x (JDK 8/11), -Dteamcity.runner.properties.file=/opt/buildagent/temp/buildTmp/teamcity.runner9098465561618137420.properties, -Dteamcity.tests.recentlyFailedTests.file=/opt/buildagent/temp/buildTmp/testsToRunFirst3891775683130404069.txt, -Dteamcity.version=2021.2 (build 99542), -ea, -Xms2g, -Xmx2g, -XX:+HeapDumpOnOutOfMemoryError, -DIGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_TEST_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_UPDATE_NOTIFIER=false, -DIGNITE_NO_DISCO_ORDER=true, -DIGNITE_PERFORMANCE_SUGGESTIONS_DISABLED=true, -Djava.net.preferIPv4Stack=true, -DTEST_SCALE_FACTOR=1.0, -DIGNITE_TEST_PROP_LOG4J_FILE=log4j-tc-test.xml, -DIGNITE_QUIET=false, -DIGNITE_MARSHAL_BUFFERS_RECHECK=1000, -Dmaven.repo.local=/opt/buildagent/.m2/repository] [21:03:56] : [Step 4/5] [2021-11-19 21:03:56,079][INFO ][main][EncryptedCacheCreateTest1] System cache's DataRegion size is configured to 40 MB. Use DataStorageConfiguration.systemRegionInitialSize property to change the setting. [21:03:56] : [Step 4/5] [2021-11-19 21:03:56,079][INFO ][main][EncryptedCacheCreateTest1] Configured caches [in 'sysMemPlc' dataRegion: ['ignite-sys-cache']] [21:03:56]W: [org.apache.ignite:ignite-core] [2021-11-19 21:03:56,079][WARN ][main][EncryptedCacheCreateTest1] Peer class loading is enabled (disable it in production for performance and deployment consistency reasons) [21:03:56] : [Step 4/5] [2021-11-19 21:03:56,079][INFO ][main][EncryptedCacheCreateTest1] 3-rd party licenses can be found at: /opt/buildagent/work/7bc1c54bc719b67c/libs/licenses [21:03:56] : [Step 4/5] [2021-11-19 21:03:56,086][INFO ][main][IgnitePluginProcessor] Configured plugins: [21:03:56] : [Step 4/5] [2021-11-19 21:03:56,086][INFO ][main][IgnitePluginProcessor] ^-- StanByClusterTestProvider 1.0 [21:03:56] : [Step 4/5] [2021-11-19 21:03:56,086][INFO ][main][IgnitePluginProcessor] ^-- null [21:03:56] : [Step 4/5] [2021-11-19 21:03:56,086][INFO ][main][IgnitePluginProcessor] [21:03:56] : [Step 4/5] [2021-11-19 21:03:56,087][INFO ][main][IgnitePluginProcessor] ^-- PageMemory tracker plugin 1.0 [21:03:56] : [Step 4/5] [2021-11-19 21:03:56,087][INFO ][main][IgnitePluginProcessor] ^-- null [21:03:56] : [Step 4/5] [2021-11-19 21:03:56,087][INFO ][main][IgnitePluginProcessor] [21:03:56] : [Step 4/5] [2021-11-19 21:03:56,087][INFO ][main][IgnitePluginProcessor] ^-- TestDistibutedConfigurationPlugin 1.0 [21:03:56] : [Step 4/5] [2021-11-19 21:03:56,087][INFO ][main][IgnitePluginProcessor] ^-- null [21:03:56] : [Step 4/5] [2021-11-19 21:03:56,087][INFO ][main][IgnitePluginProcessor] [21:03:56] : [Step 4/5] [2021-11-19 21:03:56,087][INFO ][main][IgnitePluginProcessor] ^-- NodeValidationPluginProvider 1.0 [21:03:56] : [Step 4/5] [2021-11-19 21:03:56,088][INFO ][main][IgnitePluginProcessor] ^-- null [21:03:56] : [Step 4/5] [2021-11-19 21:03:56,088][INFO ][main][IgnitePluginProcessor] [21:03:56] : [Step 4/5] [2021-11-19 21:03:56,088][INFO ][main][FailureProcessor] Configured failure handler: [hnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]]] [21:03:56]W: [org.apache.ignite:ignite-core] [2021-11-19 21:03:56,144][WARN ][main][TcpCommunicationSpi] Message queue limit is set to 0 which may lead to potential OOMEs when running cache operations in FULL_ASYNC or PRIMARY_SYNC modes due to message queues growth on sender and receiver sides. [21:03:56] : [Step 4/5] [2021-11-19 21:03:56,144][INFO ][main][TcpCommunicationSpi] Successfully bound communication NIO server to TCP port [port=45121, locHost=/127.0.0.1, selectorsCnt=12, selectorSpins=0, pairedConn=false] [21:03:56] : [Step 4/5] [2021-11-19 21:03:56,150][INFO ][main][GridCollisionManager] Collision resolution is disabled (all jobs will be activated upon arrival). [21:03:56] : [Step 4/5] [2021-11-19 21:03:56,150][INFO ][main][EncryptedCacheCreateTest1] Security status [authentication=off, sandbox=off, tls/ssl=off] [21:03:56] : [Step 4/5] [2021-11-19 21:03:56,227][INFO ][main][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:03:56] : [Step 4/5] [2021-11-19 21:03:56,326][INFO ][main][MaintenanceProcessor] Resolved store directory for node persistent data: /opt/buildagent/work/7bc1c54bc719b67c/work/db/encryption_EncryptedCacheCreateTest1 [21:03:56] : [Step 4/5] [2021-11-19 21:03:56,327][INFO ][main][CacheObjectBinaryProcessorImpl] Resolved directory for serialized binary metadata: /opt/buildagent/work/7bc1c54bc719b67c/work/db/binary_meta/encryption_EncryptedCacheCreateTest1 [21:03:56] : [Step 4/5] [2021-11-19 21:03:56,332][INFO ][main][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/encryption_EncryptedCacheCreateTest1 [21:03:56] : [Step 4/5] [2021-11-19 21:03:56,332][INFO ][main][FileWriteAheadLogManager] Resolved write ahead log work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/encryption_EncryptedCacheCreateTest1 [21:03:56] : [Step 4/5] [2021-11-19 21:03:56,333][INFO ][main][FileWriteAheadLogManager] Resolved write ahead log archive directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/encryption_EncryptedCacheCreateTest1 [21:03:56] : [Step 4/5] [2021-11-19 21:03:56,740][INFO ][main][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/encryption_EncryptedCacheCreateTest1/0000000000000000.wal [21:03:56] : [Step 4/5] [2021-11-19 21:03:56,746][INFO ][main][GridCacheDatabaseSharedManager] Configured data regions initialized successfully [total=6] [21:03:56] : [Step 4/5] [2021-11-19 21:03:56,748][INFO ][main][IgniteSnapshotManager] Resolved snapshot work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/snapshots [21:03:56] : [Step 4/5] [2021-11-19 21:03:56,749][INFO ][main][IgniteSnapshotManager] Resolved temp directory for snapshot creation: /opt/buildagent/work/7bc1c54bc719b67c/work/db/encryption_EncryptedCacheCreateTest1/snp [21:03:56] : [Step 4/5] [2021-11-19 21:03:56,752][INFO ][main][ClientListenerProcessor] Client connector processor has started on TCP port 10801 [21:03:56] : [Step 4/5] [2021-11-19 21:03:56,755][INFO ][main][EncryptedCacheCreateTest1] Non-loopback local IPs: 172.17.0.4 [21:03:56] : [Step 4/5] [2021-11-19 21:03:56,755][INFO ][main][EncryptedCacheCreateTest1] Enabled local MACs: 0242AC110004 [21:03:56] : [Step 4/5] [2021-11-19 21:03:56,756][INFO ][main][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:03:56] : [Step 4/5] [2021-11-19 21:03:56,757][INFO ][main][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:03:56] : [Step 4/5] [2021-11-19 21:03:56,758][INFO ][main][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:03:56] : [Step 4/5] [2021-11-19 21:03:56,760][INFO ][main][GridCacheDatabaseSharedManager] Applying lost metastore updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:03:56] : [Step 4/5] [2021-11-19 21:03:56,761][INFO ][main][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=10 ms] [21:03:56] : [Step 4/5] [2021-11-19 21:03:56,761][INFO ][main][GridCacheProcessor] Restoring partition state for local groups. [21:03:56] : [Step 4/5] [2021-11-19 21:03:56,762][INFO ][main][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=0, partitionsProcessed=0, time=0ms] [21:03:56] : [Step 4/5] [2021-11-19 21:03:56,762][INFO ][main][GridEncryptionManager] Encryption keys loaded from metastore. [grps=, masterKeyName=ignite.master.key] [21:03:56] : [Step 4/5] [2021-11-19 21:03:56,764][INFO ][main][ClusterProcessor] Cluster ID and tag has been read from metastorage: null [21:03:56] : [Step 4/5] [2021-11-19 21:03:56,764][INFO ][main][IgniteClusterImpl] Shutdown policy was updated [oldVal=null, newVal=null] [21:03:56] : [Step 4/5] [2021-11-19 21:03:56,764][INFO ][main][GridCacheDatabaseSharedManager] Checkpoint frequency deviation changed [oldVal=null, newVal=null] [21:03:56] : [Step 4/5] [2021-11-19 21:03:56,774][INFO ][main][FilePageStoreManager] Cleanup cache stores [total=1, left=0, cleanFiles=false] [21:03:56] : [Step 4/5] [2021-11-19 21:03:56,777][INFO ][main][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:03:56] : [Step 4/5] [2021-11-19 21:03:56,778][INFO ][main][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:03:56] : [Step 4/5] [2021-11-19 21:03:56,779][INFO ][main][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:03:56] : [Step 4/5] [2021-11-19 21:03:56,780][INFO ][main][GridCacheDatabaseSharedManager] Data Regions Started: 6 [21:03:56] : [Step 4/5] [2021-11-19 21:03:56,780][INFO ][main][GridCacheDatabaseSharedManager] ^-- sysMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:03:56] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:03:56] : [Step 4/5] ^-- no-persistence-region region [type=user, persistence=false, lazyAlloc=true, [21:03:56] : [Step 4/5] ... initCfg=10MB, maxCfg=10MB, usedRam=0MB, freeRam=100%, allocRam=0MB] [21:03:56] : [Step 4/5] ^-- default region [type=default, persistence=true, lazyAlloc=true, [21:03:56] : [Step 4/5] ... initCfg=10MB, maxCfg=10MB, usedRam=0MB, freeRam=100%, allocRam=0MB, allocTotal=0MB] [21:03:56] : [Step 4/5] ^-- metastoreMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:03:56] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:03:56] : [Step 4/5] ^-- TxLog region [type=internal, persistence=true, lazyAlloc=false, [21:03:56] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:03:56] : [Step 4/5] ^-- volatileDsMemPlc region [type=user, persistence=false, lazyAlloc=true, [21:03:56] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB] [21:03:56] : [Step 4/5] ^-- Ignite persistence [used=0MB] [21:03:56] : [Step 4/5] [21:03:56] : [Step 4/5] [2021-11-19 21:03:56,782][INFO ][main][GridCacheDatabaseSharedManager] Starting binary memory restore for: [-2100569601] [21:03:56] : [Step 4/5] [2021-11-19 21:03:56,795][INFO ][main][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:03:56] : [Step 4/5] [2021-11-19 21:03:56,795][INFO ][main][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:03:56] : [Step 4/5] [2021-11-19 21:03:56,798][INFO ][main][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/encryption_EncryptedCacheCreateTest1/0000000000000000.wal, offset=0, ver=2] [21:03:56] : [Step 4/5] [2021-11-19 21:03:56,803][INFO ][main][GridCacheProcessor] Started cache in recovery mode [name=ignite-sys-cache, id=-2100569601, dataRegionName=sysMemPlc, mode=REPLICATED, atomicity=TRANSACTIONAL, backups=2147483647, mvcc=false] [21:03:56] : [Step 4/5] [2021-11-19 21:03:56,804][INFO ][main][GridCacheDatabaseSharedManager] Binary recovery performed in 22 ms. [21:03:56] : [Step 4/5] [2021-11-19 21:03:56,805][INFO ][main][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:03:56] : [Step 4/5] [2021-11-19 21:03:56,805][INFO ][main][GridCacheDatabaseSharedManager] Applying lost cache updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:03:56] : [Step 4/5] [2021-11-19 21:03:56,874][INFO ][main][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=70 ms] [21:03:56] : [Step 4/5] [2021-11-19 21:03:56,874][INFO ][main][GridCacheProcessor] Restoring partition state for local groups. [21:03:56] : [Step 4/5] [2021-11-19 21:03:56,886][INFO ][main][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=1, partitionsProcessed=100, time=10ms] [21:03:57] : [Step 4/5] [2021-11-19 21:03:57,245][INFO ][main][TestTcpDiscoverySpi] Successfully bound to TCP port [port=47501, localHost=localhost/127.0.0.1, locNodeId=1b4fc279-8bef-4622-8c34-5256a4800001] [21:03:57] : [Step 4/5] [2021-11-19 21:03:57,250][INFO ][tcp-disco-srvr-[:47500]-#307%encryption.EncryptedCacheCreateTest0%-#6192%encryption.EncryptedCacheCreateTest0%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=51159] [21:03:57] : [Step 4/5] [2021-11-19 21:03:57,251][INFO ][tcp-disco-srvr-[:47500]-#307%encryption.EncryptedCacheCreateTest0%-#6192%encryption.EncryptedCacheCreateTest0%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=51159] [21:03:57] : [Step 4/5] [2021-11-19 21:03:57,252][INFO ][tcp-disco-sock-reader-[]-#313%encryption.EncryptedCacheCreateTest0%-#6311%encryption.EncryptedCacheCreateTest0%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:51159, rmtPort=51159] [21:03:57] : [Step 4/5] [2021-11-19 21:03:57,255][INFO ][tcp-disco-sock-reader-[1b4fc279 127.0.0.1:51159]-#313%encryption.EncryptedCacheCreateTest0%-#6311%encryption.EncryptedCacheCreateTest0%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=1b4fc279-8bef-4622-8c34-5256a4800001, rmtAddr=/127.0.0.1:51159] [21:03:57] : [Step 4/5] [2021-11-19 21:03:57,262][INFO ][tcp-disco-srvr-[:47501]-#312%encryption.EncryptedCacheCreateTest1%-#6310%encryption.EncryptedCacheCreateTest1%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=55025] [21:03:57] : [Step 4/5] [2021-11-19 21:03:57,263][INFO ][tcp-disco-srvr-[:47501]-#312%encryption.EncryptedCacheCreateTest1%-#6310%encryption.EncryptedCacheCreateTest1%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=55025] [21:03:57] : [Step 4/5] [2021-11-19 21:03:57,263][INFO ][tcp-disco-sock-reader-[]-#314%encryption.EncryptedCacheCreateTest1%-#6312%encryption.EncryptedCacheCreateTest1%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:55025, rmtPort=55025] [21:03:57] : [Step 4/5] [2021-11-19 21:03:57,264][INFO ][tcp-disco-sock-reader-[]-#314%encryption.EncryptedCacheCreateTest1%-#6312%encryption.EncryptedCacheCreateTest1%][TestTcpDiscoverySpi] Received ping request from the remote node [rmtNodeId=a07b3bd7-4671-4232-953f-e4042f500000, rmtAddr=/127.0.0.1:55025, rmtPort=55025] [21:03:57] : [Step 4/5] [2021-11-19 21:03:57,267][INFO ][tcp-disco-sock-reader-[]-#314%encryption.EncryptedCacheCreateTest1%-#6312%encryption.EncryptedCacheCreateTest1%][TestTcpDiscoverySpi] Finished writing ping response [rmtNodeId=a07b3bd7-4671-4232-953f-e4042f500000, rmtAddr=/127.0.0.1:55025, rmtPort=55025] [21:03:57]W: [org.apache.ignite:ignite-core] [2021-11-19 21:03:57,267][WARN ][tcp-disco-sock-reader-[]-#314%encryption.EncryptedCacheCreateTest1%-#6312%encryption.EncryptedCacheCreateTest1%][TestTcpDiscoverySpi] Failed to shutdown socket [21:03:57]W: [org.apache.ignite:ignite-core] java.net.SocketException: Socket output is already shutdown [21:03:57]W: [org.apache.ignite:ignite-core] at java.net.Socket.shutdownOutput(Socket.java:1572) [21:03:57]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.close(IgniteUtils.java:4247) [21:03:57] : [Step 4/5] [2021-11-19 21:03:57,278][INFO ][tcp-disco-sock-reader-[]-#314%encryption.EncryptedCacheCreateTest1%-#6312%encryption.EncryptedCacheCreateTest1%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:55025, rmtPort=55025, rmtNodeId=null] [21:03:57]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.discovery.tcp.ServerImpl$SocketReader.body(ServerImpl.java:7370) [21:03:57]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.IgniteSpiThread.run(IgniteSpiThread.java:58) [21:03:57] : [Step 4/5] [2021-11-19 21:03:57,268][INFO ][tcp-disco-sock-reader-[1b4fc279 127.0.0.1:51159]-#313%encryption.EncryptedCacheCreateTest0%-#6311%encryption.EncryptedCacheCreateTest0%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:51159, rmtPort=51159, rmtNodeId=1b4fc279-8bef-4622-8c34-5256a4800001] [21:03:57] : [Step 4/5] [2021-11-19 21:03:57,281][INFO ][tcp-disco-msg-worker-[crd]-#306%encryption.EncryptedCacheCreateTest0%-#6191%encryption.EncryptedCacheCreateTest0%][GridEncryptionManager] Joining node doesn't have stored group keys [node=1b4fc279-8bef-4622-8c34-5256a4800001] [21:03:57] : [Step 4/5] [2021-11-19 21:03:57,294][INFO ][tcp-disco-msg-worker-[crd]-#306%encryption.EncryptedCacheCreateTest0%-#6191%encryption.EncryptedCacheCreateTest0%][TestTcpDiscoverySpi] New next node [newNext=TcpDiscoveryNode [id=1b4fc279-8bef-4622-8c34-5256a4800001, consistentId=encryption.EncryptedCacheCreateTest1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=0, intOrder=2, lastExchangeTime=1637345037256, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false]] [21:03:57] : [Step 4/5] [2021-11-19 21:03:57,296][INFO ][tcp-disco-srvr-[:47501]-#312%encryption.EncryptedCacheCreateTest1%-#6310%encryption.EncryptedCacheCreateTest1%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=41957] [21:03:57] : [Step 4/5] [2021-11-19 21:03:57,296][INFO ][tcp-disco-srvr-[:47501]-#312%encryption.EncryptedCacheCreateTest1%-#6310%encryption.EncryptedCacheCreateTest1%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=41957] [21:03:57] : [Step 4/5] [2021-11-19 21:03:57,297][INFO ][tcp-disco-sock-reader-[]-#315%encryption.EncryptedCacheCreateTest1%-#6313%encryption.EncryptedCacheCreateTest1%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:41957, rmtPort=41957] [21:03:57] : [Step 4/5] [2021-11-19 21:03:57,299][INFO ][tcp-disco-sock-reader-[a07b3bd7 127.0.0.1:41957]-#315%encryption.EncryptedCacheCreateTest1%-#6313%encryption.EncryptedCacheCreateTest1%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=a07b3bd7-4671-4232-953f-e4042f500000, rmtAddr=/127.0.0.1:41957] [21:03:57] : [Step 4/5] [2021-11-19 21:03:57,303][INFO ][tcp-disco-msg-worker-[]-#311%encryption.EncryptedCacheCreateTest1%-#6309%encryption.EncryptedCacheCreateTest1%][TestTcpDiscoverySpi] New next node [newNext=TcpDiscoveryNode [id=a07b3bd7-4671-4232-953f-e4042f500000, consistentId=encryption.EncryptedCacheCreateTest0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345037298, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false]] [21:03:57] : [Step 4/5] [2021-11-19 21:03:57,304][INFO ][tcp-disco-srvr-[:47500]-#307%encryption.EncryptedCacheCreateTest0%-#6192%encryption.EncryptedCacheCreateTest0%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=54329] [21:03:57] : [Step 4/5] [2021-11-19 21:03:57,305][INFO ][tcp-disco-srvr-[:47500]-#307%encryption.EncryptedCacheCreateTest0%-#6192%encryption.EncryptedCacheCreateTest0%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=54329] [21:03:57] : [Step 4/5] [2021-11-19 21:03:57,306][INFO ][tcp-disco-sock-reader-[]-#316%encryption.EncryptedCacheCreateTest0%-#6314%encryption.EncryptedCacheCreateTest0%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:54329, rmtPort=54329] [21:03:57] : [Step 4/5] [2021-11-19 21:03:57,307][INFO ][tcp-disco-sock-reader-[1b4fc279 127.0.0.1:54329]-#316%encryption.EncryptedCacheCreateTest0%-#6314%encryption.EncryptedCacheCreateTest0%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=1b4fc279-8bef-4622-8c34-5256a4800001, rmtAddr=/127.0.0.1:54329] [21:03:57] : [Step 4/5] [2021-11-19 21:03:57,309][INFO ][disco-event-worker-#6194%encryption.EncryptedCacheCreateTest0%][GridDiscoveryManager] Added new node to topology: TcpDiscoveryNode [id=1b4fc279-8bef-4622-8c34-5256a4800001, consistentId=encryption.EncryptedCacheCreateTest1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637345037256, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false] [21:03:57] : [Step 4/5] [2021-11-19 21:03:57,310][INFO ][disco-event-worker-#6194%encryption.EncryptedCacheCreateTest0%][GridDiscoveryManager] Topology snapshot [ver=2, locNode=a07b3bd7, servers=2, clients=0, state=INACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=a07b3bd7-4671-4232-953f-e4042f500000, consistentId=encryption.EncryptedCacheCreateTest0, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=1b4fc279-8bef-4622-8c34-5256a4800001, consistentId=encryption.EncryptedCacheCreateTest1, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:03:57] : [Step 4/5] [2021-11-19 21:03:57,312][INFO ][tcp-disco-msg-worker-[a07b3bd7 127.0.0.1:47500]-#311%encryption.EncryptedCacheCreateTest1%-#6309%encryption.EncryptedCacheCreateTest1%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustEnabled' was changed from 'null' to 'false' [21:03:57] : [Step 4/5] [2021-11-19 21:03:57,313][INFO ][tcp-disco-msg-worker-[a07b3bd7 127.0.0.1:47500]-#311%encryption.EncryptedCacheCreateTest1%-#6309%encryption.EncryptedCacheCreateTest1%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustTimeout' was changed from 'null' to '300000' [21:03:57] : [Step 4/5] [2021-11-19 21:03:57,313][INFO ][tcp-disco-msg-worker-[a07b3bd7 127.0.0.1:47500]-#311%encryption.EncryptedCacheCreateTest1%-#6309%encryption.EncryptedCacheCreateTest1%][IgniteTxManager] Transactions parameter 'longOperationsDumpTimeout' was changed from 'null' to '60000' [21:03:57] : [Step 4/5] [2021-11-19 21:03:57,314][INFO ][tcp-disco-msg-worker-[a07b3bd7 127.0.0.1:47500]-#311%encryption.EncryptedCacheCreateTest1%-#6309%encryption.EncryptedCacheCreateTest1%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpThreshold' was changed from 'null' to '0' [21:03:57] : [Step 4/5] [2021-11-19 21:03:57,314][INFO ][tcp-disco-msg-worker-[a07b3bd7 127.0.0.1:47500]-#311%encryption.EncryptedCacheCreateTest1%-#6309%encryption.EncryptedCacheCreateTest1%][ClusterProcessor] lucid_sinoussi [21:03:57] : [Step 4/5] [2021-11-19 21:03:57,314][INFO ][tcp-disco-msg-worker-[a07b3bd7 127.0.0.1:47500]-#311%encryption.EncryptedCacheCreateTest1%-#6309%encryption.EncryptedCacheCreateTest1%][IgniteTxManager] Transactions parameter 'transactionTimeDumpSamplesCoefficient' was changed from 'null' to '0.0' [21:03:57] : [Step 4/5] [2021-11-19 21:03:57,315][INFO ][tcp-disco-msg-worker-[a07b3bd7 127.0.0.1:47500]-#311%encryption.EncryptedCacheCreateTest1%-#6309%encryption.EncryptedCacheCreateTest1%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpSamplesPerSecondLimit' was changed from 'null' to '5' [21:03:57] : [Step 4/5] [2021-11-19 21:03:57,315][INFO ][tcp-disco-msg-worker-[a07b3bd7 127.0.0.1:47500]-#311%encryption.EncryptedCacheCreateTest1%-#6309%encryption.EncryptedCacheCreateTest1%][IgniteTxManager] Transactions parameter 'collisionsDumpInterval' was changed from 'null' to '1000' [21:03:57] : [Step 4/5] [2021-11-19 21:03:57,316][INFO ][tcp-disco-msg-worker-[a07b3bd7 127.0.0.1:47500]-#311%encryption.EncryptedCacheCreateTest1%-#6309%encryption.EncryptedCacheCreateTest1%][IgniteTxManager] Transactions parameter 'txOwnerDumpRequestsAllowed' was changed from 'null' to 'true' [21:03:57] : [Step 4/5] [2021-11-19 21:03:57,316][INFO ][tcp-disco-msg-worker-[a07b3bd7 127.0.0.1:47500]-#311%encryption.EncryptedCacheCreateTest1%-#6309%encryption.EncryptedCacheCreateTest1%][GridCacheDatabaseSharedManager] Historical rebalance WAL threshold changed [property=historical.rebalance.threshold, oldVal=null, newVal=500] [21:03:57] : [Step 4/5] [2021-11-19 21:03:57,317][INFO ][disco-notifier-worker-#6308%encryption.EncryptedCacheCreateTest1%][MvccProcessorImpl] Assigned mvcc coordinator [crd=MvccCoordinator [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=0], nodeId=a07b3bd7-4671-4232-953f-e4042f500000, ver=1637345035999, local=false, initialized=false]] [21:03:57] : [Step 4/5] [2021-11-19 21:03:57,318][INFO ][sys-#6307%encryption.EncryptedCacheCreateTest1%][ClusterProcessor] Writing cluster ID and tag to metastorage on ready for write ClusterIdAndTag [id=ab933df3-d5f2-4640-a48f-7423b3f6ef7f, tag=lucid_sinoussi] [21:03:57] : [Step 4/5] [2021-11-19 21:03:57,339][INFO ][main][EncryptedCacheCreateTest1] To start Console Management & Monitoring run ignitevisorcmd.{sh|bat} [21:03:57] : [Step 4/5] [2021-11-19 21:03:57,340][INFO ][main][EncryptedCacheCreateTest1] [21:03:57] : [Step 4/5] [21:03:57] : [Step 4/5] >>> +-------------------------------------------+ [21:03:57] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:03:57] : [Step 4/5] >>> +-------------------------------------------+ [21:03:57] : [Step 4/5] >>> OS name: Linux 4.15.0-151-generic amd64 [21:03:57] : [Step 4/5] >>> CPU(s): 24 [21:03:57] : [Step 4/5] >>> Heap: 2.0GB [21:03:57] : [Step 4/5] >>> VM name: 16724@c4dfe9a430b2 [21:03:57] : [Step 4/5] >>> Ignite instance name: encryption.EncryptedCacheCreateTest1 [21:03:57] : [Step 4/5] >>> Local node [ID=1B4FC279-8BEF-4622-8C34-5256A4800001, order=2, clientMode=false] [21:03:57] : [Step 4/5] >>> Local node addresses: [127.0.0.1] [21:03:57] : [Step 4/5] >>> Local ports: TCP:10801 TCP:45121 TCP:47501 [21:03:57] : [Step 4/5] [21:03:57] : [Step 4/5] [2021-11-19 21:03:57,341][INFO ][main][EncryptedCacheCreateTest1] >>> Ignite cluster is in INACTIVE state (limited functionality available). Use control.(sh|bat) script or IgniteCluster.state(ClusterState.ACTIVE) to change the state. [21:03:57] : [Step 4/5] [2021-11-19 21:03:57,342][INFO ][main][GridDiscoveryManager] Topology snapshot [ver=2, locNode=1b4fc279, servers=2, clients=0, state=INACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=a07b3bd7-4671-4232-953f-e4042f500000, consistentId=encryption.EncryptedCacheCreateTest0, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=1b4fc279-8bef-4622-8c34-5256a4800001, consistentId=encryption.EncryptedCacheCreateTest1, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:03:57] : [Step 4/5] [2021-11-19 21:03:57,343][INFO ][main][G] Node started : [stage="Configure system pool" (0 ms),stage="Start managers" (267 ms),stage="Configure binary metadata" (2 ms),stage="Start processors" (425 ms),stage="Start 'StanByClusterTestProvider' plugin" (0 ms),stage="Start 'PageMemory tracker plugin' plugin" (0 ms),stage="Start 'TestDistibutedConfigurationPlugin' plugin" (0 ms),stage="Start 'NodeValidationPluginProvider' plugin" (0 ms),stage="Init metastore" (19 ms),stage="Init and start regions" (8 ms),stage="Restore binary memory" (22 ms),stage="Restore logical state" (81 ms),stage="Finish recovery" (351 ms),stage="Join topology" (78 ms),stage="Await transition" (2 ms),stage="Await exchange" (22 ms),stage="Total time" (1277 ms)] [21:03:57] : [Step 4/5] [2021-11-19 21:03:57,344][INFO ][main][root] Node started with the following configuration [id=1b4fc279-8bef-4622-8c34-5256a4800001, marshaller=BinaryMarshaller [], discovery=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=5000, ackTimeout=5000, marsh=JdkMarshaller [clsFilter=org.apache.ignite.marshaller.MarshallerUtils$1@5d318e91], reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], binaryCfg=null, lateAff=true] [21:03:57] : [Step 4/5] [2021-11-19 21:03:57,346][INFO ][main][GridClusterStateProcessor] Sending activate cluster request with BaselineTopology BaselineTopology [id=0, branchingHash=-3724515085, branchingType='New BaselineTopology', baselineNodes=[encryption.EncryptedCacheCreateTest0, encryption.EncryptedCacheCreateTest1]] [21:03:57] : [Step 4/5] [2021-11-19 21:03:57,353][INFO ][disco-notifier-worker-#6190%encryption.EncryptedCacheCreateTest0%][GridClusterStateProcessor] Received activate cluster request with BaselineTopology[id=0] initiator node ID: a07b3bd7-4671-4232-953f-e4042f500000 [21:03:57] : [Step 4/5] [2021-11-19 21:03:57,354][INFO ][disco-notifier-worker-#6190%encryption.EncryptedCacheCreateTest0%][GridClusterStateProcessor] Started state transition: activate cluster [21:03:57] : [Step 4/5] [2021-11-19 21:03:57,354][INFO ][exchange-worker-#6195%encryption.EncryptedCacheCreateTest0%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], crd=true, evt=DISCOVERY_CUSTOM_EVT, evtNode=a07b3bd7-4671-4232-953f-e4042f500000, customEvt=ChangeGlobalStateMessage [id=2271d593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqId=305ebc7a-d286-4370-be7e-9e18795fbc87, initiatingNodeId=a07b3bd7-4671-4232-953f-e4042f500000, state=ACTIVE, baselineTopology=BaselineTopology [id=0, branchingHash=-3724515085, branchingType='New BaselineTopology', baselineNodes=[encryption.EncryptedCacheCreateTest0, encryption.EncryptedCacheCreateTest1]], forceChangeBaselineTopology=false, timestamp=1637345037346, forceDeactivation=true], allowMerge=false, exchangeFreeSwitch=false] [21:03:57] : [Step 4/5] [2021-11-19 21:03:57,355][INFO ][disco-notifier-worker-#6308%encryption.EncryptedCacheCreateTest1%][GridClusterStateProcessor] Received activate cluster request with BaselineTopology[id=0] initiator node ID: a07b3bd7-4671-4232-953f-e4042f500000 [21:03:57] : [Step 4/5] [2021-11-19 21:03:57,356][INFO ][exchange-worker-#6195%encryption.EncryptedCacheCreateTest0%][GridDhtPartitionsExchangeFuture] Start activation process [nodeId=a07b3bd7-4671-4232-953f-e4042f500000, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]]. New state: ACTIVE [21:03:57] : [Step 4/5] [2021-11-19 21:03:57,356][INFO ][disco-notifier-worker-#6308%encryption.EncryptedCacheCreateTest1%][GridClusterStateProcessor] Started state transition: activate cluster [21:03:57] : [Step 4/5] [2021-11-19 21:03:57,357][INFO ][exchange-worker-#6195%encryption.EncryptedCacheCreateTest0%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/encryption_EncryptedCacheCreateTest0 [21:03:57] : [Step 4/5] [2021-11-19 21:03:57,357][INFO ][exchange-worker-#6317%encryption.EncryptedCacheCreateTest1%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], crd=false, evt=DISCOVERY_CUSTOM_EVT, evtNode=a07b3bd7-4671-4232-953f-e4042f500000, customEvt=ChangeGlobalStateMessage [id=2271d593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqId=305ebc7a-d286-4370-be7e-9e18795fbc87, initiatingNodeId=a07b3bd7-4671-4232-953f-e4042f500000, state=ACTIVE, baselineTopology=BaselineTopology [id=0, branchingHash=-3724515085, branchingType='New BaselineTopology', baselineNodes=[encryption.EncryptedCacheCreateTest0, encryption.EncryptedCacheCreateTest1]], forceChangeBaselineTopology=false, timestamp=1637345037346, forceDeactivation=true], allowMerge=false, exchangeFreeSwitch=false] [21:03:57] : [Step 4/5] [2021-11-19 21:03:57,359][INFO ][exchange-worker-#6195%encryption.EncryptedCacheCreateTest0%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/encryption_EncryptedCacheCreateTest0/0000000000000000.wal, offset=8713, ver=2] [21:03:57] : [Step 4/5] [2021-11-19 21:03:57,360][INFO ][exchange-worker-#6317%encryption.EncryptedCacheCreateTest1%][GridDhtPartitionsExchangeFuture] Start activation process [nodeId=1b4fc279-8bef-4622-8c34-5256a4800001, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]]. New state: ACTIVE [21:03:57] : [Step 4/5] [2021-11-19 21:03:57,361][INFO ][exchange-worker-#6195%encryption.EncryptedCacheCreateTest0%][GridClusterStateProcessor] Writing BaselineTopology[id=0] [21:03:57] : [Step 4/5] [2021-11-19 21:03:57,361][INFO ][exchange-worker-#6317%encryption.EncryptedCacheCreateTest1%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/encryption_EncryptedCacheCreateTest1 [21:03:57] : [Step 4/5] [2021-11-19 21:03:57,364][INFO ][exchange-worker-#6317%encryption.EncryptedCacheCreateTest1%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/encryption_EncryptedCacheCreateTest1/0000000000000000.wal, offset=8713, ver=2] [21:03:57] : [Step 4/5] [2021-11-19 21:03:57,366][INFO ][exchange-worker-#6317%encryption.EncryptedCacheCreateTest1%][GridClusterStateProcessor] Writing BaselineTopology[id=0] [21:03:57] : [Step 4/5] [2021-11-19 21:03:57,368][INFO ][exchange-worker-#6195%encryption.EncryptedCacheCreateTest0%][GridCacheDatabaseSharedManager] Finish recovery performed in 10 ms. [21:03:57] : [Step 4/5] [2021-11-19 21:03:57,370][INFO ][exchange-worker-#6195%encryption.EncryptedCacheCreateTest0%][msg] Components activation performed in 13 ms. [21:03:57] : [Step 4/5] [2021-11-19 21:03:57,370][INFO ][exchange-worker-#6317%encryption.EncryptedCacheCreateTest1%][GridCacheDatabaseSharedManager] Finish recovery performed in 8 ms. [21:03:57] : [Step 4/5] [2021-11-19 21:03:57,371][INFO ][exchange-worker-#6317%encryption.EncryptedCacheCreateTest1%][msg] Components activation performed in 10 ms. [21:03:57] : [Step 4/5] [2021-11-19 21:03:57,373][INFO ][exchange-worker-#6317%encryption.EncryptedCacheCreateTest1%][GridCacheProcessor] Finished recovery for cache [cache=ignite-sys-cache, grp=ignite-sys-cache, startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:03:57] : [Step 4/5] [2021-11-19 21:03:57,373][INFO ][exchange-worker-#6195%encryption.EncryptedCacheCreateTest0%][GridCacheProcessor] Finished recovery for cache [cache=ignite-sys-cache, grp=ignite-sys-cache, startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:03:57] : [Step 4/5] [2021-11-19 21:03:57,374][INFO ][exchange-worker-#6317%encryption.EncryptedCacheCreateTest1%][GridDhtPartitionsExchangeFuture] Successfully activated caches [nodeId=1b4fc279-8bef-4622-8c34-5256a4800001, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], newState=ACTIVE] [21:03:57] : [Step 4/5] [2021-11-19 21:03:57,374][INFO ][exchange-worker-#6195%encryption.EncryptedCacheCreateTest0%][GridDhtPartitionsExchangeFuture] Successfully activated caches [nodeId=a07b3bd7-4671-4232-953f-e4042f500000, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], newState=ACTIVE] [21:03:57] : [Step 4/5] [2021-11-19 21:03:57,375][INFO ][exchange-worker-#6195%encryption.EncryptedCacheCreateTest0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:03:57] : [Step 4/5] [2021-11-19 21:03:57,375][INFO ][exchange-worker-#6317%encryption.EncryptedCacheCreateTest1%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:03:57] : [Step 4/5] [2021-11-19 21:03:57,401][INFO ][exchange-worker-#6195%encryption.EncryptedCacheCreateTest0%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], crd=true] [21:03:57] : [Step 4/5] [2021-11-19 21:03:57,405][INFO ][grid-nio-worker-tcp-comm-0-#6134%TcpCommunicationSpi%][TcpCommunicationSpi] Accepted incoming communication connection [locAddr=/127.0.0.1:45120, rmtAddr=/127.0.0.1:50672] [21:03:57] : [Step 4/5] [2021-11-19 21:03:57,406][INFO ][db-checkpoint-thread-#6327%encryption.EncryptedCacheCreateTest1%][Checkpointer] Checkpoint started [checkpointId=fc145201-8580-4c7f-8182-6cbb521d7936, startPtr=WALPointer [idx=0, fileOff=87145, len=1963], checkpointBeforeLockTime=16ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=2ms, writeCheckpointEntryDuration=2ms, splitAndSortCpPagesDuration=1ms, pages=18, reason='node started'] [21:03:57] : [Step 4/5] [2021-11-19 21:03:57,408][INFO ][grid-nio-worker-tcp-comm-0-#6252%TcpCommunicationSpi%][TcpCommunicationSpi] Established outgoing communication connection [locAddr=/127.0.0.1:50672, rmtAddr=/127.0.0.1:45120] [21:03:57] : [Step 4/5] [2021-11-19 21:03:57,408][INFO ][exchange-worker-#6317%encryption.EncryptedCacheCreateTest1%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], crd=false] [21:03:57] : [Step 4/5] [2021-11-19 21:03:57,414][INFO ][sys-#6179%encryption.EncryptedCacheCreateTest0%][GridDhtPartitionsExchangeFuture] Coordinator received single message [ver=AffinityTopologyVersion [topVer=2, minorTopVer=1], node=1b4fc279-8bef-4622-8c34-5256a4800001, allReceived=true] [21:03:57] : [Step 4/5] [2021-11-19 21:03:57,414][INFO ][sys-#6179%encryption.EncryptedCacheCreateTest0%][GridDhtPartitionsExchangeFuture] finishExchangeOnCoordinator [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:03:57] : [Step 4/5] [2021-11-19 21:03:57,423][INFO ][db-checkpoint-thread-#6326%encryption.EncryptedCacheCreateTest0%][Checkpointer] Checkpoint started [checkpointId=c5d137e2-55e5-41c9-8ed6-be03bcaa3aae, startPtr=WALPointer [idx=0, fileOff=87145, len=1963], checkpointBeforeLockTime=17ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=13ms, writeCheckpointEntryDuration=8ms, splitAndSortCpPagesDuration=1ms, pages=18, reason='node started'] [21:03:57] : [Step 4/5] [2021-11-19 21:03:57,424][INFO ][sys-#6179%encryption.EncryptedCacheCreateTest0%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], err=null, rebalanced=true, wasRebalanced=false] [21:03:57] : [Step 4/5] [2021-11-19 21:03:57,423][INFO ][disco-notifier-worker-#6190%encryption.EncryptedCacheCreateTest0%][GridClusterStateProcessor] Received state change finish message: ACTIVE [21:03:57] : [Step 4/5] [2021-11-19 21:03:57,425][INFO ][disco-notifier-worker-#6190%encryption.EncryptedCacheCreateTest0%][GridClusterStateProcessor] Cluster state was changed from INACTIVE to ACTIVE [21:03:57] : [Step 4/5] [2021-11-19 21:03:57,430][INFO ][disco-notifier-worker-#6308%encryption.EncryptedCacheCreateTest1%][GridClusterStateProcessor] Received state change finish message: ACTIVE [21:03:57] : [Step 4/5] [2021-11-19 21:03:57,430][INFO ][sys-#6292%encryption.EncryptedCacheCreateTest1%][GridDhtPartitionsExchangeFuture] Received full message, will finish exchange [node=a07b3bd7-4671-4232-953f-e4042f500000, resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:03:57] : [Step 4/5] [2021-11-19 21:03:57,430][INFO ][disco-notifier-worker-#6308%encryption.EncryptedCacheCreateTest1%][GridClusterStateProcessor] Cluster state was changed from INACTIVE to ACTIVE [21:03:57] : [Step 4/5] [2021-11-19 21:03:57,432][INFO ][db-checkpoint-thread-#6327%encryption.EncryptedCacheCreateTest1%][Checkpointer] Checkpoint finished [cpId=fc145201-8580-4c7f-8182-6cbb521d7936, pages=18, markPos=WALPointer [idx=0, fileOff=87145, len=1963], walSegmentsCovered=[], markDuration=8ms, pagesWrite=4ms, fsync=20ms, total=48ms] [21:03:57] : [Step 4/5] [2021-11-19 21:03:57,432][INFO ][sys-#6298%encryption.EncryptedCacheCreateTest1%][GridCachePartitionExchangeManager] Delay process full message without exchange id (there is exchange in progress) [nodeId=a07b3bd7-4671-4232-953f-e4042f500000] [21:03:57] : [Step 4/5] [2021-11-19 21:03:57,434][INFO ][sys-#6179%encryption.EncryptedCacheCreateTest0%][GridCacheProcessor] Finish proxy initialization, cacheName=ignite-sys-cache, localNodeId=a07b3bd7-4671-4232-953f-e4042f500000 [21:03:57] : [Step 4/5] [2021-11-19 21:03:57,433][INFO ][sys-#6292%encryption.EncryptedCacheCreateTest1%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], err=null, rebalanced=true, wasRebalanced=false] [21:03:57] : [Step 4/5] [2021-11-19 21:03:57,435][INFO ][sys-#6169%encryption.EncryptedCacheCreateTest0%][DistributedBaselineConfiguration] Baseline auto-adjust is 'disabled' with timeout='300000' ms [21:03:57] : [Step 4/5] [2021-11-19 21:03:57,439][INFO ][sys-#6169%encryption.EncryptedCacheCreateTest0%][GridClusterStateProcessor] Successfully performed final activation steps [nodeId=a07b3bd7-4671-4232-953f-e4042f500000, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:03:57] : [Step 4/5] [2021-11-19 21:03:57,438][INFO ][exchange-worker-#6195%encryption.EncryptedCacheCreateTest0%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=2, minorTopVer=1], force=false, evt=DISCOVERY_CUSTOM_EVT, node=a07b3bd7-4671-4232-953f-e4042f500000] [21:03:57] : [Step 4/5] [2021-11-19 21:03:57,436][INFO ][sys-#6179%encryption.EncryptedCacheCreateTest0%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=a07b3bd7-4671-4232-953f-e4042f500000, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=a07b3bd7-4671-4232-953f-e4042f500000, consistentId=encryption.EncryptedCacheCreateTest0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345037432, loc=true, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:03:57] : [Step 4/5] [2021-11-19 21:03:57,439][INFO ][sys-#6292%encryption.EncryptedCacheCreateTest1%][GridCacheProcessor] Finish proxy initialization, cacheName=ignite-sys-cache, localNodeId=1b4fc279-8bef-4622-8c34-5256a4800001 [21:03:57] : [Step 4/5] [2021-11-19 21:03:57,442][INFO ][sys-#6179%encryption.EncryptedCacheCreateTest0%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (1 ms), stage="Update caches registry" (16 ms), stage="Start caches" (1 ms), stage="Affinity initialization on cache group start" (0 ms), stage="Determine exchange type" (1 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Restore partition states" (0 ms), stage="After states restored callback" (24 ms), stage="WAL history reservation" (0 ms), stage="Waiting for all single messages" (13 ms), stage="Affinity recalculation (crd)" (0 ms), stage="Collect update counters and create affinity messages" (0 ms), stage="Assign partitions states" (0 ms), stage="Validate partitions states" (0 ms), stage="Ideal affinity diff calculation (enforced)" (0 ms), stage="Apply update counters" (0 ms), stage="Full message preparing" (5 ms), stage="Full message sending" (0 ms), stage="State finish message sending" (1 ms), stage="Detect lost partitions" (8 ms), stage="Exchange done" (9 ms), stage="Total time" (79 ms), Discovery lag=3 ms, Latest started node id=1b4fc279-8bef-4622-8c34-5256a4800001] [21:03:57] : [Step 4/5] [2021-11-19 21:03:57,446][INFO ][main][root] awaitPartitionMapExchange finished [21:03:57] : [Step 4/5] [2021-11-19 21:03:57,445][INFO ][sys-#6292%encryption.EncryptedCacheCreateTest1%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=1b4fc279-8bef-4622-8c34-5256a4800001, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=a07b3bd7-4671-4232-953f-e4042f500000, consistentId=encryption.EncryptedCacheCreateTest0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345037298, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:03:57] : [Step 4/5] [2021-11-19 21:03:57,445][INFO ][exchange-worker-#6317%encryption.EncryptedCacheCreateTest1%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=2, minorTopVer=1], force=false, evt=DISCOVERY_CUSTOM_EVT, node=a07b3bd7-4671-4232-953f-e4042f500000] [21:03:57] : [Step 4/5] [2021-11-19 21:03:57,443][INFO ][sys-#6302%encryption.EncryptedCacheCreateTest1%][DistributedBaselineConfiguration] Baseline auto-adjust is 'disabled' with timeout='300000' ms [21:03:57] : [Step 4/5] [2021-11-19 21:03:57,449][INFO ][sys-#6292%encryption.EncryptedCacheCreateTest1%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (2 ms), stage="Update caches registry" (12 ms), stage="Start caches" (0 ms), stage="Affinity initialization on cache group start" (0 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (2 ms), stage="Restore partition states" (0 ms), stage="After states restored callback" (24 ms), stage="WAL history reservation" (0 ms), stage="Waiting for Full message" (28 ms), stage="Affinity recalculation" (1 ms), stage="Full map updating" (1 ms), stage="Detect lost partitions" (4 ms), stage="Exchange done" (11 ms), stage="Total time" (85 ms)] [21:03:57] : [Step 4/5] [2021-11-19 21:03:57,447][INFO ][sys-#6179%encryption.EncryptedCacheCreateTest0%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], stage="Affinity initialization on cache group start [grp=ignite-sys-cache]" (0 ms) (parent=Affinity initialization on cache group start), stage="Affinity centralized initialization (crd) [grp=ignite-sys-cache, crd=true]" (0 ms) (parent=Determine exchange type), stage="Restore partition states [grp=ignite-sys-cache]" (0 ms) (parent=Restore partition states), stage="Affinity recalculation (partitions availability) [grp=ignite-sys-cache]" (0 ms) (parent=Ideal affinity diff calculation (enforced))] [21:03:57] : [Step 4/5] [2021-11-19 21:03:57,451][INFO ][sys-#6292%encryption.EncryptedCacheCreateTest1%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], stage="Affinity initialization on cache group start [grp=ignite-sys-cache]" (0 ms) (parent=Affinity initialization on cache group start), stage="Affinity centralized initialization (crd) [grp=ignite-sys-cache, crd=false]" (0 ms) (parent=Determine exchange type), stage="Restore partition states [grp=ignite-sys-cache]" (0 ms) (parent=Restore partition states), stage="Affinity applying from full message [grp=ignite-sys-cache]" (0 ms) (parent=Affinity recalculation)] [21:03:57] : [Step 4/5] [2021-11-19 21:03:57,450][INFO ][sys-#6302%encryption.EncryptedCacheCreateTest1%][GridClusterStateProcessor] Successfully performed final activation steps [nodeId=1b4fc279-8bef-4622-8c34-5256a4800001, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:03:57] : [Step 4/5] [2021-11-19 21:03:57,458][INFO ][db-checkpoint-thread-#6326%encryption.EncryptedCacheCreateTest0%][Checkpointer] Checkpoint finished [cpId=c5d137e2-55e5-41c9-8ed6-be03bcaa3aae, pages=18, markPos=WALPointer [idx=0, fileOff=87145, len=1963], walSegmentsCovered=[], markDuration=24ms, pagesWrite=10ms, fsync=24ms, total=75ms] [21:03:57] : [Step 4/5] [2021-11-19 21:03:57,466][INFO ][exchange-worker-#6317%encryption.EncryptedCacheCreateTest1%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], crd=false, evt=DISCOVERY_CUSTOM_EVT, evtNode=a07b3bd7-4671-4232-953f-e4042f500000, customEvt=DynamicCacheChangeBatch [id=6471d593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqs=ArrayList [DynamicCacheChangeRequest [cacheName=no-persistence-region, hasCfg=true, nodeId=a07b3bd7-4671-4232-953f-e4042f500000, clientStartOnly=false, stop=false, destroy=false, disabledAfterStart=false]], exchangeActions=ExchangeActions [startCaches=[no-persistence-region], stopCaches=null, startGrps=[no-persistence-region], stopGrps=[], resetParts=null, stateChangeRequest=null], startCaches=false], allowMerge=false, exchangeFreeSwitch=false] [21:03:57]W: [org.apache.ignite:ignite-core] [2021-11-19 21:03:57,470][WARN ][exchange-worker-#6317%encryption.EncryptedCacheCreateTest1%][GridCacheProcessor] Cache can not be started : cache=no-persistence-region [21:03:57] : [Step 4/5] [2021-11-19 21:03:57,471][INFO ][exchange-worker-#6195%encryption.EncryptedCacheCreateTest0%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], crd=true, evt=DISCOVERY_CUSTOM_EVT, evtNode=a07b3bd7-4671-4232-953f-e4042f500000, customEvt=DynamicCacheChangeBatch [id=6471d593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqs=ArrayList [DynamicCacheChangeRequest [cacheName=no-persistence-region, hasCfg=true, nodeId=a07b3bd7-4671-4232-953f-e4042f500000, clientStartOnly=false, stop=false, destroy=false, disabledAfterStart=false]], exchangeActions=ExchangeActions [startCaches=[no-persistence-region], stopCaches=null, startGrps=[no-persistence-region], stopGrps=[], resetParts=null, stateChangeRequest=null], startCaches=false], allowMerge=false, exchangeFreeSwitch=false] [21:03:57]W: [org.apache.ignite:ignite-core] [2021-11-19 21:03:57,472][ERROR][exchange-worker-#6317%encryption.EncryptedCacheCreateTest1%][GridDhtPartitionsExchangeFuture] Failed to initialize cache(s) (will try to rollback) [exchId=GridDhtPartitionExchangeId [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], discoEvt=DiscoveryCustomEvent [customMsg=DynamicCacheChangeBatch [id=6471d593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqs=ArrayList [DynamicCacheChangeRequest [cacheName=no-persistence-region, hasCfg=true, nodeId=a07b3bd7-4671-4232-953f-e4042f500000, clientStartOnly=false, stop=false, destroy=false, disabledAfterStart=false]], exchangeActions=ExchangeActions [startCaches=[no-persistence-region], stopCaches=null, startGrps=[no-persistence-region], stopGrps=[], resetParts=null, stateChangeRequest=null], startCaches=false], affTopVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], super=DiscoveryEvent [evtNode=TcpDiscoveryNode [id=a07b3bd7-4671-4232-953f-e4042f500000, consistentId=encryption.EncryptedCacheCreateTest0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345037298, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], topVer=2, msgTemplate=null, span=o.a.i.i.processors.tracing.NoopSpan@61742ff0, nodeId8=1b4fc279, msg=null, type=DISCOVERY_CUSTOM_EVT, tstamp=1637345037463]], nodeId=a07b3bd7, evt=DISCOVERY_CUSTOM_EVT], caches=[o.a.i.i.processors.cache.ExchangeActions$CacheGroupActionData@3f588945]] [21:03:57]W: [org.apache.ignite:ignite-core] class org.apache.ignite.IgniteCheckedException: Using encryption is not allowed for not persistent cache [cacheName=no-persistence-region, groupName=null, cacheType=USER] [21:03:57]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.ValidationOnNodeJoinUtils.validate(ValidationOnNodeJoinUtils.java:442) [21:03:57]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.GridCacheProcessor.createCacheContext(GridCacheProcessor.java:1260) [21:03:57]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.GridCacheProcessor.prepareCacheContext(GridCacheProcessor.java:2058) [21:03:57]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.GridCacheProcessor.prepareCacheStart(GridCacheProcessor.java:1989) [21:03:57]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.GridCacheProcessor.lambda$prepareStartCaches$55a0e703$1(GridCacheProcessor.java:1864) [21:03:57]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.GridCacheProcessor.lambda$prepareStartCachesIfPossible$16(GridCacheProcessor.java:1834) [21:03:57]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.GridCacheProcessor.prepareStartCaches(GridCacheProcessor.java:1861) [21:03:57]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.GridCacheProcessor.prepareStartCachesIfPossible(GridCacheProcessor.java:1832) [21:03:57]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.CacheAffinitySharedManager.processCacheStartRequests(CacheAffinitySharedManager.java:999) [21:03:57]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.CacheAffinitySharedManager.onCacheChangeRequest(CacheAffinitySharedManager.java:885) [21:03:57]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.distributed.dht.preloader.GridDhtPartitionsExchangeFuture.onCacheChangeRequest(GridDhtPartitionsExchangeFuture.java:1462) [21:03:57]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.distributed.dht.preloader.GridDhtPartitionsExchangeFuture.init(GridDhtPartitionsExchangeFuture.java:960) [21:03:57]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.GridCachePartitionExchangeManager$ExchangeWorker.body0(GridCachePartitionExchangeManager.java:3370) [21:03:57]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.GridCachePartitionExchangeManager$ExchangeWorker.body(GridCachePartitionExchangeManager.java:3197) [21:03:57]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:125) [21:03:57]W: [org.apache.ignite:ignite-core] at java.lang.Thread.run(Thread.java:748) [21:03:57]W: [org.apache.ignite:ignite-core] [2021-11-19 21:03:57,475][WARN ][exchange-worker-#6195%encryption.EncryptedCacheCreateTest0%][GridCacheProcessor] Cache can not be started : cache=no-persistence-region [21:03:57]W: [org.apache.ignite:ignite-core] [2021-11-19 21:03:57,483][ERROR][exchange-worker-#6195%encryption.EncryptedCacheCreateTest0%][GridDhtPartitionsExchangeFuture] Failed to initialize cache(s) (will try to rollback) [exchId=GridDhtPartitionExchangeId [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], discoEvt=DiscoveryCustomEvent [customMsg=DynamicCacheChangeBatch [id=6471d593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqs=ArrayList [DynamicCacheChangeRequest [cacheName=no-persistence-region, hasCfg=true, nodeId=a07b3bd7-4671-4232-953f-e4042f500000, clientStartOnly=false, stop=false, destroy=false, disabledAfterStart=false]], exchangeActions=ExchangeActions [startCaches=[no-persistence-region], stopCaches=null, startGrps=[no-persistence-region], stopGrps=[], resetParts=null, stateChangeRequest=null], startCaches=false], affTopVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], super=DiscoveryEvent [evtNode=TcpDiscoveryNode [id=a07b3bd7-4671-4232-953f-e4042f500000, consistentId=encryption.EncryptedCacheCreateTest0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345037452, loc=true, ver=2.13.0#20211119-sha1:00000000, isClient=false], topVer=2, msgTemplate=null, span=o.a.i.i.processors.tracing.NoopSpan@61742ff0, nodeId8=a07b3bd7, msg=null, type=DISCOVERY_CUSTOM_EVT, tstamp=1637345037463]], nodeId=a07b3bd7, evt=DISCOVERY_CUSTOM_EVT], caches=[o.a.i.i.processors.cache.ExchangeActions$CacheGroupActionData@685fa276]] [21:03:57]W: [org.apache.ignite:ignite-core] class org.apache.ignite.IgniteCheckedException: Using encryption is not allowed for not persistent cache [cacheName=no-persistence-region, groupName=null, cacheType=USER] [21:03:57]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.ValidationOnNodeJoinUtils.validate(ValidationOnNodeJoinUtils.java:442) [21:03:57]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.GridCacheProcessor.createCacheContext(GridCacheProcessor.java:1260) [21:03:57]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.GridCacheProcessor.prepareCacheContext(GridCacheProcessor.java:2058) [21:03:57]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.GridCacheProcessor.prepareCacheStart(GridCacheProcessor.java:1989) [21:03:57]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.GridCacheProcessor.lambda$prepareStartCaches$55a0e703$1(GridCacheProcessor.java:1864) [21:03:57]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.GridCacheProcessor.lambda$prepareStartCachesIfPossible$16(GridCacheProcessor.java:1834) [21:03:57]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.GridCacheProcessor.prepareStartCaches(GridCacheProcessor.java:1861) [21:03:57]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.GridCacheProcessor.prepareStartCachesIfPossible(GridCacheProcessor.java:1832) [21:03:57]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.CacheAffinitySharedManager.processCacheStartRequests(CacheAffinitySharedManager.java:999) [21:03:57]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.CacheAffinitySharedManager.onCacheChangeRequest(CacheAffinitySharedManager.java:885) [21:03:57]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.distributed.dht.preloader.GridDhtPartitionsExchangeFuture.onCacheChangeRequest(GridDhtPartitionsExchangeFuture.java:1462) [21:03:57]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.distributed.dht.preloader.GridDhtPartitionsExchangeFuture.init(GridDhtPartitionsExchangeFuture.java:960) [21:03:57]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.GridCachePartitionExchangeManager$ExchangeWorker.body0(GridCachePartitionExchangeManager.java:3370) [21:03:57]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.GridCachePartitionExchangeManager$ExchangeWorker.body(GridCachePartitionExchangeManager.java:3197) [21:03:57]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:125) [21:03:57]W: [org.apache.ignite:ignite-core] at java.lang.Thread.run(Thread.java:748) [21:03:57] : [Step 4/5] [2021-11-19 21:03:57,487][INFO ][exchange-worker-#6317%encryption.EncryptedCacheCreateTest1%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], waitTime=0ms, futInfo=NA, mode=DISTRIBUTED] [21:03:57] : [Step 4/5] [2021-11-19 21:03:57,491][INFO ][exchange-worker-#6195%encryption.EncryptedCacheCreateTest0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], waitTime=0ms, futInfo=NA, mode=DISTRIBUTED] [21:03:57] : [Step 4/5] [2021-11-19 21:03:57,492][INFO ][exchange-worker-#6195%encryption.EncryptedCacheCreateTest0%][GridDhtPartitionsExchangeFuture] Finished waiting for partitions release latch: ServerLatch [permits=0, pendingAcks=HashSet [], super=CompletableLatch [id=CompletableLatchUid [id=exchange, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2]]]] [21:03:57] : [Step 4/5] [2021-11-19 21:03:57,492][INFO ][exchange-worker-#6317%encryption.EncryptedCacheCreateTest1%][GridDhtPartitionsExchangeFuture] Finished waiting for partitions release latch: ClientLatch [coordinator=TcpDiscoveryNode [id=a07b3bd7-4671-4232-953f-e4042f500000, consistentId=encryption.EncryptedCacheCreateTest0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345037298, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], ackSent=true, super=CompletableLatch [id=CompletableLatchUid [id=exchange, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2]]]] [21:03:57] : [Step 4/5] [2021-11-19 21:03:57,492][INFO ][exchange-worker-#6195%encryption.EncryptedCacheCreateTest0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:03:57] : [Step 4/5] [2021-11-19 21:03:57,494][INFO ][exchange-worker-#6317%encryption.EncryptedCacheCreateTest1%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:03:57] : [Step 4/5] [2021-11-19 21:03:57,494][INFO ][exchange-worker-#6195%encryption.EncryptedCacheCreateTest0%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], crd=true] [21:03:57] : [Step 4/5] [2021-11-19 21:03:57,496][INFO ][exchange-worker-#6317%encryption.EncryptedCacheCreateTest1%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], crd=false] [21:03:57] : [Step 4/5] [2021-11-19 21:03:57,497][INFO ][sys-#6174%encryption.EncryptedCacheCreateTest0%][GridDeploymentLocalStore] Class locally deployed: class org.apache.ignite.IgniteCheckedException [21:03:57] : [Step 4/5] [2021-11-19 21:03:57,497][INFO ][sys-#6174%encryption.EncryptedCacheCreateTest0%][GridDeploymentLocalStore] Class locally deployed: class [Ljava.lang.StackTraceElement; [21:03:57] : [Step 4/5] [2021-11-19 21:03:57,498][INFO ][sys-#6174%encryption.EncryptedCacheCreateTest0%][GridDhtPartitionsExchangeFuture] Coordinator received single message [ver=AffinityTopologyVersion [topVer=2, minorTopVer=2], node=1b4fc279-8bef-4622-8c34-5256a4800001, allReceived=true] [21:03:58] : [Step 4/5] [2021-11-19 21:03:58,137][INFO ][db-checkpoint-thread-#6326%encryption.EncryptedCacheCreateTest0%][Checkpointer] Checkpoint started [checkpointId=d87f9603-cf3f-4083-b797-d81372bd5a25, startPtr=WALPointer [idx=0, fileOff=106358, len=1947], checkpointBeforeLockTime=2ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=274ms, writeCheckpointEntryDuration=350ms, splitAndSortCpPagesDuration=0ms, pages=5, reason='caches stop'] [21:03:58] : [Step 4/5] [2021-11-19 21:03:58,137][INFO ][db-checkpoint-thread-#6327%encryption.EncryptedCacheCreateTest1%][Checkpointer] Checkpoint started [checkpointId=a30511da-a264-46be-b2b3-0cc9861d199f, startPtr=WALPointer [idx=0, fileOff=106358, len=1947], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=1ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=275ms, writeCheckpointEntryDuration=350ms, splitAndSortCpPagesDuration=1ms, pages=5, reason='caches stop'] [21:03:58] : [Step 4/5] [2021-11-19 21:03:58,148][INFO ][db-checkpoint-thread-#6326%encryption.EncryptedCacheCreateTest0%][Checkpointer] Checkpoint finished [cpId=d87f9603-cf3f-4083-b797-d81372bd5a25, pages=5, markPos=WALPointer [idx=0, fileOff=106358, len=1947], walSegmentsCovered=[], markDuration=626ms, pagesWrite=0ms, fsync=10ms, total=638ms] [21:03:58] : [Step 4/5] [2021-11-19 21:03:58,148][INFO ][sys-#6189%encryption.EncryptedCacheCreateTest0%][GridCacheProcessor] Can not finish proxy initialization because proxy does not exist, cacheName=no-persistence-region, localNodeId=a07b3bd7-4671-4232-953f-e4042f500000 [21:03:58] : [Step 4/5] [2021-11-19 21:03:58,156][INFO ][db-checkpoint-thread-#6327%encryption.EncryptedCacheCreateTest1%][Checkpointer] Checkpoint finished [cpId=a30511da-a264-46be-b2b3-0cc9861d199f, pages=5, markPos=WALPointer [idx=0, fileOff=106358, len=1947], walSegmentsCovered=[], markDuration=629ms, pagesWrite=0ms, fsync=17ms, total=646ms] [21:03:58] : [Step 4/5] [2021-11-19 21:03:58,156][INFO ][sys-#6289%encryption.EncryptedCacheCreateTest1%][GridCacheProcessor] Can not finish proxy initialization because proxy does not exist, cacheName=no-persistence-region, localNodeId=1b4fc279-8bef-4622-8c34-5256a4800001 [21:03:58] : [Step 4/5] [21:03:58] >>> Stopping test: En[20cry21-11-19 21:03:5pt8,157][INFO ][sys-#6189%encryption.EncryptedCacheCreateTeedCacheCreatst0%][eTesGridDhtPartitionsExchanget#tFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=estCreate2, mEncrinoryptedNoToptPVer=2], resVer=ersistedCacheFail in 710 ms <<< [21:03:58] : [Step 4/5] AffinityTopologyVersion [topVer=2, minorTopVer=2], err=null, rebalanced=false, wasRebalanced=true] [21:03:58] : [Step 4/5] [2021-11-19 21:03:58,160][INFO ][main][root] >>> Stopping test: EncryptedCacheCreateTest#testCreateEncryptedNotPersistedCacheFail in 710 ms <<< [21:03:58] : [Step 4/5] [2021-11-19 21:03:58,159][INFO ][sys-[21:03:58] >>> Heap: #628407 MB used / 1937 MB com9%miteden / 1937 MB max <<< [21:03:58] : [Step 4/5] cryption.EncryptedCacheCreateTest1%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], err=null, rebalanced=false, wasRebalanced=true] [21:03:58] : [Step 4/5] [2021-11-19 21:03:58,162][INFO ][sys-#6189%encryption.EncryptedCacheCreateTest0%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=a07b3bd7-4671-4232-953f-e4042f500000, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=a07b3bd7-4671-4232-953f-e4042f500000, consistentId=encryption.EncryptedCacheCreateTest0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345038031, loc=true, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=false, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2]] [21:03:58] : [Step 4/5] [2021-11-19 21:03:58,162][INFO ][main][root] >>> Heap: 407 MB used / 1937 MB commited / 1937 MB max <<< [21:03:58] : [Step 4/5] [2021-11-19 21:03:58,162][INFO ][e[21:xcha03:5ng8] >>> Noe-n-Heaworkerp: -#6195%encryp13tion.Encryp1 MBtedCa usecheCreatd / 1eTest0%41 M][GridCacheB coPartitionExchammited / 0 MB ngeManager] max Sk<<< [21:03:58] : [Step 4/5] ipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=2, minorTopVer=2], force=false, evt=DISCOVERY_CUSTOM_EVT, node=a07b3bd7-4671-4232-953f-e4042f500000] [21:03:58] : [Step 4/5] [2021-11-19 21:03:58,166][INFO ][main][root] >>> Non-Heap: 131 MB used / 141 MB commited / 0 MB max <<< [21:03:58] : [Step 4/5] [2021-11-19 21:03:58,165][INFO ][sys-#6189%encryption.EncryptedCacheCreateTest0%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], stage="Waiting in exchange queue" (5 ms), stage="Exchange parameters initialization" (1 ms), stage="Update caches registry" (0 ms), stage="Determine exchange type" (17 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Wait partitions release latch [latch=exchange]" (0 ms), stage="Wait partitions release [latch=exchange]" (1 ms), stage="Restore partition states" (0 ms), stage="After states restored callback" (0 ms), stage="WAL history reservation" (0 ms), stage="Waiting for all single messages" (3 ms), stage="Exchange done" (666 ms), stage="Total time" (693 ms)] [21:03:58] : [Step 4/5] [2021-11-19 21:03:58,163][INFO ][exchange-worker-#6317%encryption.EncryptedCacheCreateTest1%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=2, minorTopVer=2], force=false, evt=DISCOVERY_CUSTOM_EVT, node=a07b3bd7-4671-4232-953f-e4042f500000] [21:03:58] : [Step 4/5] [2021-11-19 21:03:58,163][INFO ][sys-#6289%encryption.EncryptedCacheCreateTest1%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=1b4fc279-8bef-4622-8c34-5256a4800001, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=a07b3bd7-4671-4232-953f-e4042f500000, consistentId=encryption.EncryptedCacheCreateTest0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345037298, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=false, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2]] [21:03:58] : [Step 4/5] [2021-11-19 21:03:58,169][INFO ][sys-#6189%encryption.EncryptedCacheCreateTest0%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], stage="Restore partition states [grp=no-persistence-region]" (0 ms) (parent=Restore partition states), stage="Restore partition states [grp=ignite-sys-cache]" (0 ms) (parent=Restore partition states)] [21:03:58] : [Step 4/5] [2021-11-19 21:03:58,166][INFO ][main][root] >>> Stopping grid [name=encryption.EncryptedCacheCreateTest0, id=a07b3bd7-4671-4232-953f-e4042f500000] [21:03:58] : [Step 4/5] [2021-11-19 21:03:58,171][INFO ][sys-#6289%encryption.EncryptedCacheCreateTest1%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (1 ms), stage="Update caches registry" (0 ms), stage="Determine exchange type" (18 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (4 ms), stage="Wait partitions release latch [latch=exchange]" (2 ms), stage="Wait partitions release [latch=exchange]" (1 ms), stage="Restore partition states" (0 ms), stage="After states restored callback" (0 ms), stage="WAL history reservation" (0 ms), stage="Exchange done" (675 ms), stage="Total time" (701 ms)] [21:03:58] : [Step 4/5] [2021-11-19 21:03:58,175][INFO ][sys-#6289%encryption.EncryptedCacheCreateTest1%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], stage="Restore partition states [grp=no-persistence-region]" (0 ms) (parent=Restore partition states), stage="Restore partition states [grp=ignite-sys-cache]" (0 ms) (parent=Restore partition states)] [21:03:58] : [Step 4/5] [2021-11-19 21:03:58,182][INFO ][db-checkpoint-thread-#6326%encryption.EncryptedCacheCreateTest0%][Checkpointer] Skipping checkpoint (no pages were modified) [checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, reason='timeout'] [21:03:58] : [Step 4/5] [2021-11-19 21:03:58,198][INFO ][tcp-disco-sock-reader-[1b4fc279 127.0.0.1:54329]-#316%encryption.EncryptedCacheCreateTest0%-#6314%encryption.EncryptedCacheCreateTest0%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:54329, rmtPort=54329, rmtNodeId=1b4fc279-8bef-4622-8c34-5256a4800001] [21:03:58] : [Step 4/5] [2021-11-19 21:03:58,199][INFO ][disco-event-worker-#6316%encryption.EncryptedCacheCreateTest1%][GridDiscoveryManager] Node left topology: TcpDiscoveryNode [id=a07b3bd7-4671-4232-953f-e4042f500000, consistentId=encryption.EncryptedCacheCreateTest0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345037298, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false] [21:03:58] : [Step 4/5] [2021-11-19 21:03:58,201][INFO ][main][GridCacheProcessor] Stopped cache [cacheName=ignite-sys-cache] [21:03:58] : [Step 4/5] [2021-11-19 21:03:58,201][INFO ][disco-event-worker-#6316%encryption.EncryptedCacheCreateTest1%][GridDiscoveryManager] Topology snapshot [ver=3, locNode=1b4fc279, servers=1, clients=0, state=ACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=1b4fc279-8bef-4622-8c34-5256a4800001, consistentId=encryption.EncryptedCacheCreateTest1, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:03:58] : [Step 4/5] [2021-11-19 21:03:58,202][INFO ][disco-event-worker-#6316%encryption.EncryptedCacheCreateTest1%][GridDiscoveryManager] Coordinator changed [prev=TcpDiscoveryNode [id=a07b3bd7-4671-4232-953f-e4042f500000, consistentId=encryption.EncryptedCacheCreateTest0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345037298, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], cur=TcpDiscoveryNode [id=1b4fc279-8bef-4622-8c34-5256a4800001, consistentId=encryption.EncryptedCacheCreateTest1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637345038193, loc=true, ver=2.13.0#20211119-sha1:00000000, isClient=false]] [21:03:58] : [Step 4/5] [2021-11-19 21:03:58,203][INFO ][disco-event-worker-#6316%encryption.EncryptedCacheCreateTest1%][GridDiscoveryManager] ^-- Baseline [id=0, size=2, online=1, offline=1] [21:03:58] : [Step 4/5] [2021-11-19 21:03:58,204][INFO ][disco-event-worker-#6316%encryption.EncryptedCacheCreateTest1%][MvccProcessorImpl] Assigned mvcc coordinator [crd=MvccCoordinator [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], nodeId=1b4fc279-8bef-4622-8c34-5256a4800001, ver=1637345036000, local=true, initialized=false]] [21:03:58]W: [org.apache.ignite:ignite-core] [2021-11-19 21:03:58,204][WARN ][grid-nio-worker-tcp-comm-0-#6252%TcpCommunicationSpi%][TcpCommunicationSpi] Failed to shutdown socket [21:03:58]W: [org.apache.ignite:ignite-core] java.nio.channels.ClosedChannelException [21:03:58]W: [org.apache.ignite:ignite-core] at sun.nio.ch.SocketChannelImpl.shutdownOutput(SocketChannelImpl.java:795) [21:03:58]W: [org.apache.ignite:ignite-core] at sun.nio.ch.SocketAdaptor.shutdownOutput(SocketAdaptor.java:407) [21:03:58]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.close(IgniteUtils.java:4247) [21:03:58]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.closeKey(GridNioServer.java:2784) [21:03:58]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.close(GridNioServer.java:2835) [21:03:58]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.close(GridNioServer.java:2794) [21:03:58]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.bodyInternal(GridNioServer.java:2157) [21:03:58]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.body(GridNioServer.java:1910) [21:03:58]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:125) [21:03:58]W: [org.apache.ignite:ignite-core] at java.lang.Thread.run(Thread.java:748) [21:03:58] : [Step 4/5] [2021-11-19 21:03:58,206][INFO ][exchange-worker-#6317%encryption.EncryptedCacheCreateTest1%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], crd=true, evt=NODE_LEFT, evtNode=a07b3bd7-4671-4232-953f-e4042f500000, customEvt=null, allowMerge=true, exchangeFreeSwitch=false] [21:03:58] : [Step 4/5] [2021-11-19 21:03:58,208][INFO ][sys-#6307%encryption.EncryptedCacheCreateTest1%][ExchangeLatchManager] Become new coordinator 1b4fc279-8bef-4622-8c34-5256a4800001 [21:03:58] : [Step 4/5] [2021-11-19 21:03:58,209][INFO ][exchange-worker-#6317%encryption.EncryptedCacheCreateTest1%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], waitTime=0ms, futInfo=NA, mode=DISTRIBUTED] [21:03:58] : [Step 4/5] [2021-11-19 21:03:58,210][INFO ][exchange-worker-#6317%encryption.EncryptedCacheCreateTest1%][GridDhtPartitionsExchangeFuture] Finished waiting for partitions release latch: ServerLatch [permits=0, pendingAcks=HashSet [], super=CompletableLatch [id=CompletableLatchUid [id=exchange, topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0]]]] [21:03:58] : [Step 4/5] [2021-11-19 21:03:58,211][INFO ][exchange-worker-#6317%encryption.EncryptedCacheCreateTest1%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:03:58] : [Step 4/5] [2021-11-19 21:03:58,212][INFO ][exchange-worker-#6317%encryption.EncryptedCacheCreateTest1%][GridDhtPartitionsExchangeFuture] Coordinator received all messages, try merge [ver=AffinityTopologyVersion [topVer=3, minorTopVer=0]] [21:03:58] : [Step 4/5] [2021-11-19 21:03:58,212][INFO ][exchange-worker-#6317%encryption.EncryptedCacheCreateTest1%][GridDhtPartitionsExchangeFuture] finishExchangeOnCoordinator [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=0]] [21:03:58] : [Step 4/5] [2021-11-19 21:03:58,217][INFO ][exchange-worker-#6317%encryption.EncryptedCacheCreateTest1%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], err=null, rebalanced=true, wasRebalanced=false] [21:03:58] : [Step 4/5] [2021-11-19 21:03:58,219][INFO ][exchange-worker-#6317%encryption.EncryptedCacheCreateTest1%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=1b4fc279-8bef-4622-8c34-5256a4800001, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], evt=NODE_LEFT, evtNode=TcpDiscoveryNode [id=a07b3bd7-4671-4232-953f-e4042f500000, consistentId=encryption.EncryptedCacheCreateTest0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345037298, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0]] [21:03:58] : [Step 4/5] [2021-11-19 21:03:58,221][INFO ][exchange-worker-#6317%encryption.EncryptedCacheCreateTest1%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (2 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (1 ms), stage="Wait partitions release latch [latch=exchange]" (1 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="After states restored callback" (0 ms), stage="WAL history reservation" (0 ms), stage="Finalize update counters" (0 ms), stage="Waiting for all single messages" (0 ms), stage="Exchanges merge" (0 ms), stage="Affinity recalculation (crd)" (1 ms), stage="Collect update counters and create affinity messages" (0 ms), stage="Assign partitions states" (0 ms), stage="Validate partitions states" (0 ms), stage="Apply update counters" (0 ms), stage="Full message preparing" (2 ms), stage="Full message sending" (0 ms), stage="Detect lost partitions" (1 ms), stage="Exchange done" (2 ms), stage="Total time" (10 ms)] [21:03:58] : [Step 4/5] [2021-11-19 21:03:58,223][INFO ][exchange-worker-#6317%encryption.EncryptedCacheCreateTest1%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], stage="Affinity recalculation (partitions availability) [grp=ignite-sys-cache]" (0 ms) (parent=Affinity recalculation (crd)), stage="Affinity initialization (enforced) [grp=ignite-sys-cache]" (0 ms) (parent=Affinity recalculation (crd))] [21:03:58] : [Step 4/5] [2021-11-19 21:03:58,224][INFO ][exchange-worker-#6317%encryption.EncryptedCacheCreateTest1%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], crd=true] [21:03:58] : [Step 4/5] [2021-11-19 21:03:58,224][INFO ][exchange-worker-#6317%encryption.EncryptedCacheCreateTest1%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=3, minorTopVer=0], force=false, evt=NODE_LEFT, node=a07b3bd7-4671-4232-953f-e4042f500000] [21:03:58] : [Step 4/5] [2021-11-19 21:03:58,934][INFO ][main][FilePageStoreManager] Cleanup cache stores [total=3, left=0, cleanFiles=false] [21:03:58] : [Step 4/5] [2021-11-19 21:03:58,941][INFO ][main][GridDeploymentLocalStore] Removed undeployed class: GridDeployment [ts=1637345037411, depMode=SHARED, clsLdr=IsolatedClassLoader{roleName='test'}, clsLdrId=e271d593d71-a07b3bd7-4671-4232-953f-e4042f500000, userVer=0, loc=true, sampleClsName=org.apache.ignite.internal.processors.cache.distributed.dht.preloader.GridDhtPartitionMap, pendingUndeploy=false, undeployed=true, usage=0] [21:03:58] : [Step 4/5] [2021-11-19 21:03:58,958][INFO ][main][EncryptedCacheCreateTest0] [21:03:58] : [Step 4/5] [21:03:58] : [Step 4/5] >>> +------------------------------------------------------+ [21:03:58] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV stopped OK [21:03:58] : [Step 4/5] >>> +------------------------------------------------------+ [21:03:58] : [Step 4/5] >>> Ignite instance name: encryption.EncryptedCacheCreateTest0 [21:03:58] : [Step 4/5] >>> Grid uptime: 00:00:02.913 [21:03:58] : [Step 4/5] [21:03:58] : [Step 4/5] [21:03:58] : [Step 4/5] [2021-11-19 21:03:58,959][INFO ][main][root] >>> Stopping grid [name=encryption.EncryptedCacheCreateTest1, id=1b4fc279-8bef-4622-8c34-5256a4800001] [21:03:58] : [Step 4/5] [2021-11-19 21:03:58,965][INFO ][db-checkpoint-thread-#6327%encryption.EncryptedCacheCreateTest1%][Checkpointer] Skipping checkpoint (no pages were modified) [checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=1ms, checkpointLockHoldTime=1ms, reason='timeout'] [21:03:58]W: [org.apache.ignite:ignite-core] [2021-11-19 21:03:58,970][WARN ][tcp-disco-sock-reader-[a07b3bd7 127.0.0.1:41957]-#315%encryption.EncryptedCacheCreateTest1%-#6313%encryption.EncryptedCacheCreateTest1%][TestTcpDiscoverySpi] Failed to shutdown socket [21:03:58]W: [org.apache.ignite:ignite-core] java.net.SocketException: Socket is closed [21:03:58]W: [org.apache.ignite:ignite-core] at java.net.Socket.shutdownOutput(Socket.java:1568) [21:03:58]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.close(IgniteUtils.java:4247) [21:03:58]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.discovery.tcp.ServerImpl$SocketReader.body(ServerImpl.java:7370) [21:03:58]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.IgniteSpiThread.run(IgniteSpiThread.java:58) [21:03:58] : [Step 4/5] [2021-11-19 21:03:58,972][INFO ][tcp-disco-sock-reader-[a07b3bd7 127.0.0.1:41957]-#315%encryption.EncryptedCacheCreateTest1%-#6313%encryption.EncryptedCacheCreateTest1%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:41957, rmtPort=41957, rmtNodeId=a07b3bd7-4671-4232-953f-e4042f500000] [21:03:58] : [Step 4/5] [2021-11-19 21:03:58,975][INFO ][main][GridCacheProcessor] Stopped cache [cacheName=ignite-sys-cache] [21:03:59] : [Step 4/5] [2021-11-19 21:03:59,354][INFO ][main][FilePageStoreManager] Cleanup cache stores [total=3, left=0, cleanFiles=false] [21:03:59] : [Step 4/5] [2021-11-19 21:03:59,356][INFO ][main][GridDeploymentLocalStore] Removed undeployed class: GridDeployment [ts=1637345037422, depMode=SHARED, clsLdr=IsolatedClassLoader{roleName='test'}, clsLdrId=0371d593d71-1b4fc279-8bef-4622-8c34-5256a4800001, userVer=0, loc=true, sampleClsName=org.apache.ignite.internal.processors.cache.distributed.dht.preloader.GridDhtPartitionFullMap, pendingUndeploy=false, undeployed=true, usage=0] [21:03:59] : [Step 4/5] [2021-11-19 21:03:59,363][INFO ][main][EncryptedCacheCreateTest1] [21:03:59] : [Step 4/5] [21:03:59] : [Step 4/5] >>> +------------------------------------------------------+ [21:03:59] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV stopped OK [21:03:59] : [Step 4/5] >>> +------------------------------------------------------+ [21:03:59] : [Step 4/5] >>> Ignite instance name: encryption.EncryptedCacheCreateTest1 [21:03:59] : [Step 4/5] >>> Grid uptime: 00:00:02.016 [21:03:59] : [Step 4/5] [21:03:59] : [Step 4/5] [21:03:59] : [Step 4/5] [21:03:59] >>> Starting test: EncryptedCacheCreateTest#testCreateEncryptedCache <<< [21:03:59] : [Step 4/5] [2021-11-19 21:03:59,489][INFO ][main][root] >>> Starting test: EncryptedCacheCreateTest#testCreateEncryptedCache <<< [21:03:59] : [Step 4/5] [21:03:59] >>> Heap: 411 MB used / 1937 MB commited / 1937 MB max <<< [21:03:59] : [Step 4/5] [2021-11-19 21:03:59,489][INFO ][main][root] >>> Heap: 411 MB used / 1937 MB commited / 1937 MB max <<< [21:03:59] : [Step 4/5] [21:03:59] >>> Non-Heap: 131 MB used / 141 MB commited / 0 MB max <<< [21:03:59] : [Step 4/5] [2021-11-19 21:03:59,489][INFO ][main][root] >>> Non-Heap: 131 MB used / 141 MB commited / 0 MB max <<< [21:03:59]W: [org.apache.ignite:ignite-core] [2021-11-19 21:03:59,495][WARN ][main][G] Ignite work directory is not provided, automatically resolved to: /opt/buildagent/work/7bc1c54bc719b67c/work [21:03:59] : [Step 4/5] [2021-11-19 21:03:59,496][INFO ][main][EncryptedCacheCreateTest0] [21:03:59] : [Step 4/5] [21:03:59] : [Step 4/5] >>> __________ ________________ [21:03:59] : [Step 4/5] >>> / _/ ___/ |/ / _/_ __/ __/ [21:03:59] : [Step 4/5] >>> _/ // (7 7 // / / / / _/ [21:03:59] : [Step 4/5] >>> /___/\___/_/|_/___/ /_/ /___/ [21:03:59] : [Step 4/5] >>> [21:03:59] : [Step 4/5] >>> ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:03:59] : [Step 4/5] >>> 2021 Copyright(C) Apache Software Foundation [21:03:59] : [Step 4/5] >>> [21:03:59] : [Step 4/5] >>> Ignite documentation: http://ignite.apache.org [21:03:59] : [Step 4/5] [21:03:59] : [Step 4/5] [2021-11-19 21:03:59,497][INFO ][main][EncryptedCacheCreateTest0] Config URL: n/a [21:03:59] : [Step 4/5] [2021-11-19 21:03:59,497][INFO ][main][EncryptedCacheCreateTest0] IgniteConfiguration [igniteInstanceName=encryption.EncryptedCacheCreateTest0, pubPoolSize=24, svcPoolSize=24, callbackPoolSize=24, stripedPoolSize=24, sysPoolSize=24, mgmtPoolSize=4, dataStreamerPoolSize=24, utilityCachePoolSize=24, utilityCacheKeepAliveTime=60000, p2pPoolSize=2, qryPoolSize=24, buildIdxPoolSize=4, igniteHome=/opt/buildagent/work/7bc1c54bc719b67c, igniteWorkDir=/opt/buildagent/work/7bc1c54bc719b67c/work, mbeanSrv=com.sun.jmx.mbeanserver.JmxMBeanServer@6fe85038, nodeId=d6d21d86-5751-4ef1-a3f0-af3b1c800000, marsh=BinaryMarshaller [], marshLocJobs=false, daemon=false, p2pEnabled=true, netTimeout=10000, netCompressionLevel=1, sndRetryDelay=1000, sndRetryCnt=3, metricsHistSize=10000, metricsUpdateFreq=1000, metricsExpTime=9223372036854775807, discoSpi=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=0, ackTimeout=0, marsh=null, reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], segPlc=STOP, segResolveAttempts=2, waitForSegOnStart=true, allResolversPassReq=true, segChkFreq=10000, commSpi=TcpCommunicationSpi [connectGate=org.apache.ignite.spi.communication.tcp.internal.ConnectGateway@262a1fad, ctxInitLatch=java.util.concurrent.CountDownLatch@6be6931f[Count = 1], stopping=false, clientPool=null, nioSrvWrapper=null, stateProvider=null], evtSpi=MemoryEventStorageSpi [expireAgeMs=9223372036854775807, expireCnt=10000, filter=null], colSpi=NoopCollisionSpi [], deploySpi=LocalDeploymentSpi [], indexingSpi=org.apache.ignite.spi.indexing.noop.NoopIndexingSpi@51da32e5, addrRslvr=null, encryptionSpi=org.apache.ignite.spi.encryption.keystore.KeystoreEncryptionSpi@33d60b7e, tracingSpi=org.apache.ignite.spi.tracing.NoopTracingSpi@1fecfaea, clientMode=false, rebalanceThreadPoolSize=4, rebalanceTimeout=10000, rebalanceBatchesPrefetchCnt=3, rebalanceThrottle=0, rebalanceBatchSize=524288, txCfg=TransactionConfiguration [txSerEnabled=false, dfltIsolation=REPEATABLE_READ, dfltConcurrency=PESSIMISTIC, dfltTxTimeout=0, txTimeoutOnPartitionMapExchange=0, deadlockTimeout=10000, pessimisticTxLogSize=0, pessimisticTxLogLinger=10000, tmLookupClsName=null, txManagerFactory=null, useJtaSync=false], cacheSanityCheckEnabled=true, discoStartupDelay=60000, deployMode=SHARED, p2pMissedCacheSize=100, locHost=127.0.0.1, timeSrvPortBase=31100, timeSrvPortRange=100, failureDetectionTimeout=10000, sysWorkerBlockedTimeout=null, clientFailureDetectionTimeout=10000, metricsLogFreq=0, connectorCfg=null, odbcCfg=null, warmupClos=null, atomicCfg=AtomicConfiguration [seqReserveSize=1000, cacheMode=PARTITIONED, backups=1, aff=null, grpName=null], classLdr=null, sslCtxFactory=null, platformCfg=null, binaryCfg=null, memCfg=null, pstCfg=null, dsCfg=DataStorageConfiguration [sysRegionInitSize=41943040, sysRegionMaxSize=104857600, pageSize=4096, concLvl=0, dfltDataRegConf=DataRegionConfiguration [name=default, maxSize=10485760, initSize=268435456, swapPath=null, pageEvictionMode=DISABLED, pageReplacementMode=CLOCK, evictionThreshold=0.9, emptyPagesPoolSize=100, metricsEnabled=false, metricsSubIntervalCount=5, metricsRateTimeInterval=60000, persistenceEnabled=true, checkpointPageBufSize=0, lazyMemoryAllocation=true, warmUpCfg=null], dataRegions=DataRegionConfiguration[] [DataRegionConfiguration [name=no-persistence-region, maxSize=10485760, initSize=268435456, swapPath=null, pageEvictionMode=DISABLED, pageReplacementMode=CLOCK, evictionThreshold=0.9, emptyPagesPoolSize=100, metricsEnabled=false, metricsSubIntervalCount=5, metricsRateTimeInterval=60000, persistenceEnabled=false, checkpointPageBufSize=0, lazyMemoryAllocation=true, warmUpCfg=null]], storagePath=null, checkpointFreq=180000, lockWaitTime=10000, checkpointThreads=4, checkpointWriteOrder=SEQUENTIAL, walHistSize=20, maxWalArchiveSize=1073741824, walSegments=10, walSegmentSize=67108864, walPath=db/wal, walArchivePath=db/wal/archive, cdcWalPath=db/wal/cdc, cdcEnabled=false, metricsEnabled=false, walMode=FSYNC, walTlbSize=131072, walBuffSize=0, walFlushFreq=2000, walFsyncDelay=1000, walRecordIterBuffSize=67108864, alwaysWriteFullPages=false, fileIOFactory=org.apache.ignite.internal.processors.cache.persistence.file.AsyncFileIOFactory@2db6d68d, metricsSubIntervalCnt=5, metricsRateTimeInterval=60000, walAutoArchiveAfterInactivity=-1, walForceArchiveTimeout=-1, writeThrottlingEnabled=false, walCompactionEnabled=false, walCompactionLevel=1, checkpointReadLockTimeout=null, walPageCompression=DISABLED, walPageCompressionLevel=null, dfltWarmUpCfg=null, encCfg=org.apache.ignite.configuration.EncryptionConfiguration@6518fdfd, defragmentationThreadPoolSize=4, minWalArchiveSize=-1], snapshotPath=snapshots, activeOnStart=true, activeOnStartPropSetFlag=false, autoActivation=true, autoActivationPropSetFlag=false, clusterStateOnStart=null, sqlConnCfg=null, cliConnCfg=ClientConnectorConfiguration [host=null, port=10800, portRange=100, sockSndBufSize=0, sockRcvBufSize=0, tcpNoDelay=true, maxOpenCursorsPerConn=128, threadPoolSize=24, selectorCnt=12, idleTimeout=0, handshakeTimeout=10000, jdbcEnabled=true, odbcEnabled=true, thinCliEnabled=true, sslEnabled=false, useIgniteSslCtxFactory=true, sslClientAuth=false, sslCtxFactory=null, thinCliCfg=ThinClientConfiguration [maxActiveTxPerConn=100, maxActiveComputeTasksPerConn=0]], mvccVacuumThreadCnt=2, mvccVacuumFreq=5000, authEnabled=false, failureHnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]], commFailureRslvr=null, sqlCfg=SqlConfiguration [longQryWarnTimeout=3000, dfltQryTimeout=0, sqlQryHistSize=1000, validationEnabled=false], asyncContinuationExecutor=null] [21:03:59] : [Step 4/5] [2021-11-19 21:03:59,505][INFO ][main][EncryptedCacheCreateTest0] Daemon mode: off [21:03:59] : [Step 4/5] [2021-11-19 21:03:59,505][INFO ][main][EncryptedCacheCreateTest0] OS: Linux 4.15.0-151-generic amd64 [21:03:59] : [Step 4/5] [2021-11-19 21:03:59,505][INFO ][main][EncryptedCacheCreateTest0] OS user: teamcity [21:03:59] : [Step 4/5] [2021-11-19 21:03:59,505][INFO ][main][EncryptedCacheCreateTest0] PID: 16724 [21:03:59] : [Step 4/5] [2021-11-19 21:03:59,506][INFO ][main][EncryptedCacheCreateTest0] Language runtime: Java Platform API Specification ver. 1.8 [21:03:59] : [Step 4/5] [2021-11-19 21:03:59,506][INFO ][main][EncryptedCacheCreateTest0] VM information: Java(TM) SE Runtime Environment 1.8.0_261-b12 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 25.261-b12 [21:03:59] : [Step 4/5] [2021-11-19 21:03:59,506][INFO ][main][EncryptedCacheCreateTest0] VM total memory: 1.9GB [21:03:59] : [Step 4/5] [2021-11-19 21:03:59,506][INFO ][main][EncryptedCacheCreateTest0] Remote Management [restart: off, REST: off, JMX (remote: off)] [21:03:59] : [Step 4/5] [2021-11-19 21:03:59,506][INFO ][main][EncryptedCacheCreateTest0] Logger: GridTestLog4jLogger [quiet=false, config=null] [21:03:59] : [Step 4/5] [2021-11-19 21:03:59,507][INFO ][main][EncryptedCacheCreateTest0] IGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c [21:03:59] : [Step 4/5] [2021-11-19 21:03:59,507][INFO ][main][EncryptedCacheCreateTest0] VM arguments: [-DIGNITE_DUMP_THREADS_ON_FAILURE=false, -DMono=/usr/bin/mono-sgen, -DMono4.0_x64=/usr/lib/mono/4.0, -DMono4.5_x64=/usr/lib/mono/4.5, -DMonoVersion=6.12.0.90, -DSKIP_BUILD=false, -Dagent.home.dir=/opt/buildagent, -Dagent.name=aitc-lin02_03, -Dagent.ownPort=9090, -Dagent.work.dir=/opt/buildagent/work, -Dbuild.number=95, -Dbuild.vcs.number=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.1=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.GitHubApacheIgnite=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dclassworlds.conf=/opt/buildagent/temp/buildTmp/teamcity.m2.conf, -Dcom.jetbrains.maven.watcher.report.file=/opt/buildagent/temp/buildTmp/maven-build-info.xml, -Djava.io.tmpdir=/opt/buildagent/temp/buildTmp, -Dmaven.home=/opt/buildagent/tools/maven3_6, -Dmaven.multiModuleProjectDirectory=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.agent.cpuBenchmark=457, -Dteamcity.agent.dotnet.agent_url=http://localhost:9090/RPC2, -Dteamcity.agent.dotnet.build_id=6278078, -Dteamcity.auth.password=*******, -Dteamcity.auth.userId=TeamCityBuildId=6278078, -Dteamcity.build.changedFiles.file=/opt/buildagent/temp/buildTmp/changedFiles6342607772318147725.txt, -Dteamcity.build.checkoutDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.build.id=6278078, -Dteamcity.build.properties.file=/opt/buildagent/temp/buildTmp/teamcity.build5164517880467851002.properties, -Dteamcity.build.tempDir=/opt/buildagent/temp/buildTmp, -Dteamcity.build.workingDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.buildConfName=Basic 3, -Dteamcity.buildType.id=IgniteTests24Java8_Basic3, -Dteamcity.configuration.properties.file=/opt/buildagent/temp/buildTmp/teamcity.config5591980786735343870.properties, -Dteamcity.maven.userSettings.path=/opt/buildagent/temp/buildTmp/maven_settings_585072866407032347.xml, -Dteamcity.maven.watcher.home=/opt/buildagent/plugins/mavenPlugin/maven-watcher-jdk16, -Dteamcity.projectName=Ignite Tests 2.x (JDK 8/11), -Dteamcity.runner.properties.file=/opt/buildagent/temp/buildTmp/teamcity.runner9098465561618137420.properties, -Dteamcity.tests.recentlyFailedTests.file=/opt/buildagent/temp/buildTmp/testsToRunFirst3891775683130404069.txt, -Dteamcity.version=2021.2 (build 99542), -ea, -Xms2g, -Xmx2g, -XX:+HeapDumpOnOutOfMemoryError, -DIGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_TEST_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_UPDATE_NOTIFIER=false, -DIGNITE_NO_DISCO_ORDER=true, -DIGNITE_PERFORMANCE_SUGGESTIONS_DISABLED=true, -Djava.net.preferIPv4Stack=true, -DTEST_SCALE_FACTOR=1.0, -DIGNITE_TEST_PROP_LOG4J_FILE=log4j-tc-test.xml, -DIGNITE_QUIET=false, -DIGNITE_MARSHAL_BUFFERS_RECHECK=1000, -Dmaven.repo.local=/opt/buildagent/.m2/repository] [21:03:59] : [Step 4/5] [2021-11-19 21:03:59,510][INFO ][main][EncryptedCacheCreateTest0] System cache's DataRegion size is configured to 40 MB. Use DataStorageConfiguration.systemRegionInitialSize property to change the setting. [21:03:59] : [Step 4/5] [2021-11-19 21:03:59,511][INFO ][main][EncryptedCacheCreateTest0] Configured caches [in 'sysMemPlc' dataRegion: ['ignite-sys-cache']] [21:03:59]W: [org.apache.ignite:ignite-core] [2021-11-19 21:03:59,511][WARN ][main][EncryptedCacheCreateTest0] Peer class loading is enabled (disable it in production for performance and deployment consistency reasons) [21:03:59] : [Step 4/5] [2021-11-19 21:03:59,511][INFO ][main][EncryptedCacheCreateTest0] 3-rd party licenses can be found at: /opt/buildagent/work/7bc1c54bc719b67c/libs/licenses [21:03:59] : [Step 4/5] [2021-11-19 21:03:59,515][INFO ][main][IgnitePluginProcessor] Configured plugins: [21:03:59] : [Step 4/5] [2021-11-19 21:03:59,515][INFO ][main][IgnitePluginProcessor] ^-- StanByClusterTestProvider 1.0 [21:03:59] : [Step 4/5] [2021-11-19 21:03:59,515][INFO ][main][IgnitePluginProcessor] ^-- null [21:03:59] : [Step 4/5] [2021-11-19 21:03:59,515][INFO ][main][IgnitePluginProcessor] [21:03:59] : [Step 4/5] [2021-11-19 21:03:59,515][INFO ][main][IgnitePluginProcessor] ^-- PageMemory tracker plugin 1.0 [21:03:59] : [Step 4/5] [2021-11-19 21:03:59,515][INFO ][main][IgnitePluginProcessor] ^-- null [21:03:59] : [Step 4/5] [2021-11-19 21:03:59,515][INFO ][main][IgnitePluginProcessor] [21:03:59] : [Step 4/5] [2021-11-19 21:03:59,516][INFO ][main][IgnitePluginProcessor] ^-- TestDistibutedConfigurationPlugin 1.0 [21:03:59] : [Step 4/5] [2021-11-19 21:03:59,516][INFO ][main][IgnitePluginProcessor] ^-- null [21:03:59] : [Step 4/5] [2021-11-19 21:03:59,516][INFO ][main][IgnitePluginProcessor] [21:03:59] : [Step 4/5] [2021-11-19 21:03:59,516][INFO ][main][IgnitePluginProcessor] ^-- NodeValidationPluginProvider 1.0 [21:03:59] : [Step 4/5] [2021-11-19 21:03:59,516][INFO ][main][IgnitePluginProcessor] ^-- null [21:03:59] : [Step 4/5] [2021-11-19 21:03:59,516][INFO ][main][IgnitePluginProcessor] [21:03:59] : [Step 4/5] [2021-11-19 21:03:59,517][INFO ][main][FailureProcessor] Configured failure handler: [hnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]]] [21:03:59] : [Step 4/5] [2021-11-19 21:03:59,533][INFO ][main][TcpCommunicationSpi] Successfully bound communication NIO server to TCP port [port=45120, locHost=/127.0.0.1, selectorsCnt=12, selectorSpins=0, pairedConn=false] [21:03:59]W: [org.apache.ignite:ignite-core] [2021-11-19 21:03:59,534][WARN ][main][TcpCommunicationSpi] Message queue limit is set to 0 which may lead to potential OOMEs when running cache operations in FULL_ASYNC or PRIMARY_SYNC modes due to message queues growth on sender and receiver sides. [21:03:59] : [Step 4/5] [2021-11-19 21:03:59,538][INFO ][main][GridCollisionManager] Collision resolution is disabled (all jobs will be activated upon arrival). [21:03:59] : [Step 4/5] [2021-11-19 21:03:59,538][INFO ][main][EncryptedCacheCreateTest0] Security status [authentication=off, sandbox=off, tls/ssl=off] [21:03:59] : [Step 4/5] [2021-11-19 21:03:59,600][INFO ][main][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:03:59] : [Step 4/5] [2021-11-19 21:03:59,693][INFO ][main][MaintenanceProcessor] Resolved store directory for node persistent data: /opt/buildagent/work/7bc1c54bc719b67c/work/db/encryption_EncryptedCacheCreateTest0 [21:03:59] : [Step 4/5] [2021-11-19 21:03:59,694][INFO ][main][CacheObjectBinaryProcessorImpl] Resolved directory for serialized binary metadata: /opt/buildagent/work/7bc1c54bc719b67c/work/db/binary_meta/encryption_EncryptedCacheCreateTest0 [21:03:59] : [Step 4/5] [2021-11-19 21:03:59,699][INFO ][main][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/encryption_EncryptedCacheCreateTest0 [21:03:59] : [Step 4/5] [2021-11-19 21:03:59,699][INFO ][main][FileWriteAheadLogManager] Resolved write ahead log work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/encryption_EncryptedCacheCreateTest0 [21:03:59] : [Step 4/5] [2021-11-19 21:03:59,699][INFO ][main][FileWriteAheadLogManager] Resolved write ahead log archive directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/encryption_EncryptedCacheCreateTest0 [21:04:00]W: [org.apache.ignite:ignite-core] [2021-11-19 21:04:00,132][WARN ][main][GridCacheDatabaseSharedManager] DataRegion maxSize=10.5 MB is smaller than defaultInitialSize=268.4 MB, setting initialSize to 10.5 MB [21:04:00] : [Step 4/5] [2021-11-19 21:04:00,131][INFO ][main][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/encryption_EncryptedCacheCreateTest0/0000000000000000.wal [21:04:00] : [Step 4/5] [2021-11-19 21:04:00,136][INFO ][main][GridCacheDatabaseSharedManager] Configured data regions initialized successfully [total=6] [21:04:00] : [Step 4/5] [2021-11-19 21:04:00,138][INFO ][main][IgniteSnapshotManager] Resolved snapshot work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/snapshots [21:04:00] : [Step 4/5] [2021-11-19 21:04:00,139][INFO ][main][IgniteSnapshotManager] Resolved temp directory for snapshot creation: /opt/buildagent/work/7bc1c54bc719b67c/work/db/encryption_EncryptedCacheCreateTest0/snp [21:04:00] : [Step 4/5] [2021-11-19 21:04:00,142][INFO ][main][ClientListenerProcessor] Client connector processor has started on TCP port 10800 [21:04:00] : [Step 4/5] [2021-11-19 21:04:00,149][INFO ][main][EncryptedCacheCreateTest0] Non-loopback local IPs: 172.17.0.4 [21:04:00] : [Step 4/5] [2021-11-19 21:04:00,149][INFO ][main][EncryptedCacheCreateTest0] Enabled local MACs: 0242AC110004 [21:04:00] : [Step 4/5] [2021-11-19 21:04:00,151][INFO ][main][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:04:00] : [Step 4/5] [2021-11-19 21:04:00,152][INFO ][main][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:04:00] : [Step 4/5] [2021-11-19 21:04:00,152][INFO ][main][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:04:00] : [Step 4/5] [2021-11-19 21:04:00,156][INFO ][main][GridCacheDatabaseSharedManager] Applying lost metastore updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:04:00] : [Step 4/5] [2021-11-19 21:04:00,157][INFO ][main][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=0 ms] [21:04:00] : [Step 4/5] [2021-11-19 21:04:00,157][INFO ][main][GridCacheProcessor] Restoring partition state for local groups. [21:04:00] : [Step 4/5] [2021-11-19 21:04:00,157][INFO ][main][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=0, partitionsProcessed=0, time=0ms] [21:04:00] : [Step 4/5] [2021-11-19 21:04:00,158][INFO ][main][GridEncryptionManager] Encryption keys loaded from metastore. [grps=, masterKeyName=ignite.master.key] [21:04:00] : [Step 4/5] [2021-11-19 21:04:00,165][INFO ][main][ClusterProcessor] Cluster ID and tag has been read from metastorage: null [21:04:00] : [Step 4/5] [2021-11-19 21:04:00,166][INFO ][main][IgniteClusterImpl] Shutdown policy was updated [oldVal=null, newVal=null] [21:04:00] : [Step 4/5] [2021-11-19 21:04:00,166][INFO ][main][GridCacheDatabaseSharedManager] Checkpoint frequency deviation changed [oldVal=null, newVal=null] [21:04:00] : [Step 4/5] [2021-11-19 21:04:00,176][INFO ][main][FilePageStoreManager] Cleanup cache stores [total=1, left=0, cleanFiles=false] [21:04:00] : [Step 4/5] [2021-11-19 21:04:00,179][INFO ][main][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:04:00] : [Step 4/5] [2021-11-19 21:04:00,180][INFO ][main][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:04:00] : [Step 4/5] [2021-11-19 21:04:00,181][INFO ][main][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:04:00] : [Step 4/5] [2021-11-19 21:04:00,181][INFO ][main][GridCacheDatabaseSharedManager] Data Regions Started: 6 [21:04:00] : [Step 4/5] [2021-11-19 21:04:00,182][INFO ][main][GridCacheDatabaseSharedManager] ^-- sysMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:04:00] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:04:00] : [Step 4/5] ^-- no-persistence-region region [type=user, persistence=false, lazyAlloc=true, [21:04:00] : [Step 4/5] ... initCfg=10MB, maxCfg=10MB, usedRam=0MB, freeRam=100%, allocRam=0MB] [21:04:00] : [Step 4/5] ^-- default region [type=default, persistence=true, lazyAlloc=true, [21:04:00] : [Step 4/5] ... initCfg=10MB, maxCfg=10MB, usedRam=0MB, freeRam=100%, allocRam=0MB, allocTotal=0MB] [21:04:00] : [Step 4/5] ^-- metastoreMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:04:00] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:04:00] : [Step 4/5] ^-- TxLog region [type=internal, persistence=true, lazyAlloc=false, [21:04:00] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:04:00] : [Step 4/5] ^-- volatileDsMemPlc region [type=user, persistence=false, lazyAlloc=true, [21:04:00] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB] [21:04:00] : [Step 4/5] ^-- Ignite persistence [used=0MB] [21:04:00] : [Step 4/5] [21:04:00] : [Step 4/5] [2021-11-19 21:04:00,183][INFO ][main][GridCacheDatabaseSharedManager] Starting binary memory restore for: [-2100569601] [21:04:00] : [Step 4/5] [2021-11-19 21:04:00,193][INFO ][main][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:04:00] : [Step 4/5] [2021-11-19 21:04:00,193][INFO ][main][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:04:00] : [Step 4/5] [2021-11-19 21:04:00,194][INFO ][main][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/encryption_EncryptedCacheCreateTest0/0000000000000000.wal, offset=0, ver=2] [21:04:00] : [Step 4/5] [2021-11-19 21:04:00,199][INFO ][main][GridCacheProcessor] Started cache in recovery mode [name=ignite-sys-cache, id=-2100569601, dataRegionName=sysMemPlc, mode=REPLICATED, atomicity=TRANSACTIONAL, backups=2147483647, mvcc=false] [21:04:00] : [Step 4/5] [2021-11-19 21:04:00,199][INFO ][main][GridCacheDatabaseSharedManager] Binary recovery performed in 16 ms. [21:04:00] : [Step 4/5] [2021-11-19 21:04:00,200][INFO ][main][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:04:00] : [Step 4/5] [2021-11-19 21:04:00,200][INFO ][main][GridCacheDatabaseSharedManager] Applying lost cache updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:04:00] : [Step 4/5] [2021-11-19 21:04:00,269][INFO ][main][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=71 ms] [21:04:00] : [Step 4/5] [2021-11-19 21:04:00,269][INFO ][main][GridCacheProcessor] Restoring partition state for local groups. [21:04:00] : [Step 4/5] [2021-11-19 21:04:00,280][INFO ][main][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=1, partitionsProcessed=100, time=10ms] [21:04:00] : [Step 4/5] [2021-11-19 21:04:00,616][INFO ][main][TestTcpDiscoverySpi] Successfully bound to TCP port [port=47500, localHost=localhost/127.0.0.1, locNodeId=d6d21d86-5751-4ef1-a3f0-af3b1c800000] [21:04:00] : [Step 4/5] [2021-11-19 21:04:00,629][INFO ][disco-notifier-worker-#6458%encryption.EncryptedCacheCreateTest0%][MvccProcessorImpl] Assigned mvcc coordinator [crd=MvccCoordinator [topVer=AffinityTopologyVersion [topVer=1, minorTopVer=0], nodeId=d6d21d86-5751-4ef1-a3f0-af3b1c800000, ver=1637345040629, local=true, initialized=false]] [21:04:00] : [Step 4/5] [2021-11-19 21:04:00,630][INFO ][sys-#6436%encryption.EncryptedCacheCreateTest0%][ClusterProcessor] Writing cluster ID and tag to metastorage on ready for write ClusterIdAndTag [id=22da8655-9291-4929-b637-a44418ad1f87, tag=strange_noyce] [21:04:00] : [Step 4/5] [2021-11-19 21:04:00,634][INFO ][disco-notifier-worker-#6458%encryption.EncryptedCacheCreateTest0%][ClusterProcessor] strange_noyce [21:04:00] : [Step 4/5] [2021-11-19 21:04:00,635][INFO ][disco-notifier-worker-#6458%encryption.EncryptedCacheCreateTest0%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustEnabled' was changed from 'null' to 'false' [21:04:00] : [Step 4/5] [2021-11-19 21:04:00,636][INFO ][disco-notifier-worker-#6458%encryption.EncryptedCacheCreateTest0%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustTimeout' was changed from 'null' to '300000' [21:04:00] : [Step 4/5] [2021-11-19 21:04:00,637][INFO ][disco-notifier-worker-#6458%encryption.EncryptedCacheCreateTest0%][IgniteTxManager] Transactions parameter 'longOperationsDumpTimeout' was changed from 'null' to '60000' [21:04:00] : [Step 4/5] [2021-11-19 21:04:00,637][INFO ][disco-notifier-worker-#6458%encryption.EncryptedCacheCreateTest0%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpThreshold' was changed from 'null' to '0' [21:04:00] : [Step 4/5] [2021-11-19 21:04:00,638][INFO ][disco-notifier-worker-#6458%encryption.EncryptedCacheCreateTest0%][IgniteTxManager] Transactions parameter 'transactionTimeDumpSamplesCoefficient' was changed from 'null' to '0.0' [21:04:00] : [Step 4/5] [2021-11-19 21:04:00,638][INFO ][disco-notifier-worker-#6458%encryption.EncryptedCacheCreateTest0%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpSamplesPerSecondLimit' was changed from 'null' to '5' [21:04:00] : [Step 4/5] [2021-11-19 21:04:00,639][INFO ][disco-notifier-worker-#6458%encryption.EncryptedCacheCreateTest0%][IgniteTxManager] Transactions parameter 'collisionsDumpInterval' was changed from 'null' to '1000' [21:04:00] : [Step 4/5] [2021-11-19 21:04:00,639][INFO ][disco-notifier-worker-#6458%encryption.EncryptedCacheCreateTest0%][IgniteTxManager] Transactions parameter 'txOwnerDumpRequestsAllowed' was changed from 'null' to 'true' [21:04:00] : [Step 4/5] [2021-11-19 21:04:00,640][INFO ][disco-notifier-worker-#6458%encryption.EncryptedCacheCreateTest0%][GridCacheDatabaseSharedManager] Historical rebalance WAL threshold changed [property=historical.rebalance.threshold, oldVal=null, newVal=500] [21:04:00] : [Step 4/5] [2021-11-19 21:04:00,653][INFO ][main][EncryptedCacheCreateTest0] To start Console Management & Monitoring run ignitevisorcmd.{sh|bat} [21:04:00] : [Step 4/5] [2021-11-19 21:04:00,654][INFO ][main][EncryptedCacheCreateTest0] [21:04:00] : [Step 4/5] [21:04:00] : [Step 4/5] >>> +-------------------------------------------+ [21:04:00] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:04:00] : [Step 4/5] >>> +-------------------------------------------+ [21:04:00] : [Step 4/5] >>> OS name: Linux 4.15.0-151-generic amd64 [21:04:00] : [Step 4/5] >>> CPU(s): 24 [21:04:00] : [Step 4/5] >>> Heap: 2.0GB [21:04:00] : [Step 4/5] >>> VM name: 16724@c4dfe9a430b2 [21:04:00] : [Step 4/5] >>> Ignite instance name: encryption.EncryptedCacheCreateTest0 [21:04:00] : [Step 4/5] >>> Local node [ID=D6D21D86-5751-4EF1-A3F0-AF3B1C800000, order=1, clientMode=false] [21:04:00] : [Step 4/5] >>> Local node addresses: [127.0.0.1] [21:04:00] : [Step 4/5] >>> Local ports: TCP:10800 TCP:45120 TCP:47500 [21:04:00] : [Step 4/5] [21:04:00] : [Step 4/5] [2021-11-19 21:04:00,655][INFO ][main][EncryptedCacheCreateTest0] >>> Ignite cluster is in INACTIVE state (limited functionality available). Use control.(sh|bat) script or IgniteCluster.state(ClusterState.ACTIVE) to change the state. [21:04:00] : [Step 4/5] [2021-11-19 21:04:00,655][INFO ][main][GridDiscoveryManager] Topology snapshot [ver=1, locNode=d6d21d86, servers=1, clients=0, state=INACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=d6d21d86-5751-4ef1-a3f0-af3b1c800000, consistentId=encryption.EncryptedCacheCreateTest0, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:04:00] : [Step 4/5] [2021-11-19 21:04:00,656][INFO ][main][G] Node started : [stage="Configure system pool" (0 ms),stage="Start managers" (198 ms),stage="Configure binary metadata" (2 ms),stage="Start processors" (452 ms),stage="Start 'StanByClusterTestProvider' plugin" (0 ms),stage="Start 'PageMemory tracker plugin' plugin" (0 ms),stage="Start 'TestDistibutedConfigurationPlugin' plugin" (0 ms),stage="Start 'NodeValidationPluginProvider' plugin" (0 ms),stage="Init metastore" (27 ms),stage="Init and start regions" (6 ms),stage="Restore binary memory" (16 ms),stage="Restore logical state" (80 ms),stage="Finish recovery" (334 ms),stage="Join topology" (14 ms),stage="Await transition" (2 ms),stage="Await exchange" (24 ms),stage="Total time" (1155 ms)] [21:04:00] : [Step 4/5] [2021-11-19 21:04:00,657][INFO ][main][root] Node started with the following configuration [id=d6d21d86-5751-4ef1-a3f0-af3b1c800000, marshaller=BinaryMarshaller [], discovery=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=5000, ackTimeout=5000, marsh=JdkMarshaller [clsFilter=org.apache.ignite.marshaller.MarshallerUtils$1@7fbd3e75], reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], binaryCfg=null, lateAff=true] [21:04:00]W: [org.apache.ignite:ignite-core] [2021-11-19 21:04:00,662][WARN ][main][G] Ignite work directory is not provided, automatically resolved to: /opt/buildagent/work/7bc1c54bc719b67c/work [21:04:00] : [Step 4/5] [2021-11-19 21:04:00,663][INFO ][main][EncryptedCacheCreateTest1] [21:04:00] : [Step 4/5] [21:04:00] : [Step 4/5] >>> __________ ________________ [21:04:00] : [Step 4/5] >>> / _/ ___/ |/ / _/_ __/ __/ [21:04:00] : [Step 4/5] >>> _/ // (7 7 // / / / / _/ [21:04:00] : [Step 4/5] >>> /___/\___/_/|_/___/ /_/ /___/ [21:04:00] : [Step 4/5] >>> [21:04:00] : [Step 4/5] >>> ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:04:00] : [Step 4/5] >>> 2021 Copyright(C) Apache Software Foundation [21:04:00] : [Step 4/5] >>> [21:04:00] : [Step 4/5] >>> Ignite documentation: http://ignite.apache.org [21:04:00] : [Step 4/5] [21:04:00] : [Step 4/5] [2021-11-19 21:04:00,664][INFO ][main][EncryptedCacheCreateTest1] Config URL: n/a [21:04:00] : [Step 4/5] [2021-11-19 21:04:00,664][INFO ][main][EncryptedCacheCreateTest1] IgniteConfiguration [igniteInstanceName=encryption.EncryptedCacheCreateTest1, pubPoolSize=24, svcPoolSize=24, callbackPoolSize=24, stripedPoolSize=24, sysPoolSize=24, mgmtPoolSize=4, dataStreamerPoolSize=24, utilityCachePoolSize=24, utilityCacheKeepAliveTime=60000, p2pPoolSize=2, qryPoolSize=24, buildIdxPoolSize=4, igniteHome=/opt/buildagent/work/7bc1c54bc719b67c, igniteWorkDir=/opt/buildagent/work/7bc1c54bc719b67c/work, mbeanSrv=com.sun.jmx.mbeanserver.JmxMBeanServer@6fe85038, nodeId=472daf0f-5502-4c71-9b54-a6c6d7800001, marsh=BinaryMarshaller [], marshLocJobs=false, daemon=false, p2pEnabled=true, netTimeout=10000, netCompressionLevel=1, sndRetryDelay=1000, sndRetryCnt=3, metricsHistSize=10000, metricsUpdateFreq=1000, metricsExpTime=9223372036854775807, discoSpi=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=0, ackTimeout=0, marsh=null, reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], segPlc=STOP, segResolveAttempts=2, waitForSegOnStart=true, allResolversPassReq=true, segChkFreq=10000, commSpi=TcpCommunicationSpi [connectGate=org.apache.ignite.spi.communication.tcp.internal.ConnectGateway@7bee8621, ctxInitLatch=java.util.concurrent.CountDownLatch@4e0cc334[Count = 1], stopping=false, clientPool=null, nioSrvWrapper=null, stateProvider=null], evtSpi=MemoryEventStorageSpi [expireAgeMs=9223372036854775807, expireCnt=10000, filter=null], colSpi=NoopCollisionSpi [], deploySpi=LocalDeploymentSpi [], indexingSpi=org.apache.ignite.spi.indexing.noop.NoopIndexingSpi@6f9ab79d, addrRslvr=null, encryptionSpi=org.apache.ignite.spi.encryption.keystore.KeystoreEncryptionSpi@64ae105d, tracingSpi=org.apache.ignite.spi.tracing.NoopTracingSpi@10a18e3e, clientMode=false, rebalanceThreadPoolSize=4, rebalanceTimeout=10000, rebalanceBatchesPrefetchCnt=3, rebalanceThrottle=0, rebalanceBatchSize=524288, txCfg=TransactionConfiguration [txSerEnabled=false, dfltIsolation=REPEATABLE_READ, dfltConcurrency=PESSIMISTIC, dfltTxTimeout=0, txTimeoutOnPartitionMapExchange=0, deadlockTimeout=10000, pessimisticTxLogSize=0, pessimisticTxLogLinger=10000, tmLookupClsName=null, txManagerFactory=null, useJtaSync=false], cacheSanityCheckEnabled=true, discoStartupDelay=60000, deployMode=SHARED, p2pMissedCacheSize=100, locHost=127.0.0.1, timeSrvPortBase=31100, timeSrvPortRange=100, failureDetectionTimeout=10000, sysWorkerBlockedTimeout=null, clientFailureDetectionTimeout=10000, metricsLogFreq=0, connectorCfg=null, odbcCfg=null, warmupClos=null, atomicCfg=AtomicConfiguration [seqReserveSize=1000, cacheMode=PARTITIONED, backups=1, aff=null, grpName=null], classLdr=null, sslCtxFactory=null, platformCfg=null, binaryCfg=null, memCfg=null, pstCfg=null, dsCfg=DataStorageConfiguration [sysRegionInitSize=41943040, sysRegionMaxSize=104857600, pageSize=4096, concLvl=0, dfltDataRegConf=DataRegionConfiguration [name=default, maxSize=10485760, initSize=268435456, swapPath=null, pageEvictionMode=DISABLED, pageReplacementMode=CLOCK, evictionThreshold=0.9, emptyPagesPoolSize=100, metricsEnabled=false, metricsSubIntervalCount=5, metricsRateTimeInterval=60000, persistenceEnabled=true, checkpointPageBufSize=0, lazyMemoryAllocation=true, warmUpCfg=null], dataRegions=DataRegionConfiguration[] [DataRegionConfiguration [name=no-persistence-region, maxSize=10485760, initSize=268435456, swapPath=null, pageEvictionMode=DISABLED, pageReplacementMode=CLOCK, evictionThreshold=0.9, emptyPagesPoolSize=100, metricsEnabled=false, metricsSubIntervalCount=5, metricsRateTimeInterval=60000, persistenceEnabled=false, checkpointPageBufSize=0, lazyMemoryAllocation=true, warmUpCfg=null]], storagePath=null, checkpointFreq=180000, lockWaitTime=10000, checkpointThreads=4, checkpointWriteOrder=SEQUENTIAL, walHistSize=20, maxWalArchiveSize=1073741824, walSegments=10, walSegmentSize=67108864, walPath=db/wal, walArchivePath=db/wal/archive, cdcWalPath=db/wal/cdc, cdcEnabled=false, metricsEnabled=false, walMode=FSYNC, walTlbSize=131072, walBuffSize=0, walFlushFreq=2000, walFsyncDelay=1000, walRecordIterBuffSize=67108864, alwaysWriteFullPages=false, fileIOFactory=org.apache.ignite.internal.processors.cache.persistence.file.AsyncFileIOFactory@2b80e5a9, metricsSubIntervalCnt=5, metricsRateTimeInterval=60000, walAutoArchiveAfterInactivity=-1, walForceArchiveTimeout=-1, writeThrottlingEnabled=false, walCompactionEnabled=false, walCompactionLevel=1, checkpointReadLockTimeout=null, walPageCompression=DISABLED, walPageCompressionLevel=null, dfltWarmUpCfg=null, encCfg=org.apache.ignite.configuration.EncryptionConfiguration@4cc01c7f, defragmentationThreadPoolSize=4, minWalArchiveSize=-1], snapshotPath=snapshots, activeOnStart=true, activeOnStartPropSetFlag=false, autoActivation=true, autoActivationPropSetFlag=false, clusterStateOnStart=null, sqlConnCfg=null, cliConnCfg=ClientConnectorConfiguration [host=null, port=10800, portRange=100, sockSndBufSize=0, sockRcvBufSize=0, tcpNoDelay=true, maxOpenCursorsPerConn=128, threadPoolSize=24, selectorCnt=12, idleTimeout=0, handshakeTimeout=10000, jdbcEnabled=true, odbcEnabled=true, thinCliEnabled=true, sslEnabled=false, useIgniteSslCtxFactory=true, sslClientAuth=false, sslCtxFactory=null, thinCliCfg=ThinClientConfiguration [maxActiveTxPerConn=100, maxActiveComputeTasksPerConn=0]], mvccVacuumThreadCnt=2, mvccVacuumFreq=5000, authEnabled=false, failureHnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]], commFailureRslvr=null, sqlCfg=SqlConfiguration [longQryWarnTimeout=3000, dfltQryTimeout=0, sqlQryHistSize=1000, validationEnabled=false], asyncContinuationExecutor=null] [21:04:00] : [Step 4/5] [2021-11-19 21:04:00,672][INFO ][main][EncryptedCacheCreateTest1] Daemon mode: off [21:04:00] : [Step 4/5] [2021-11-19 21:04:00,672][INFO ][main][EncryptedCacheCreateTest1] OS: Linux 4.15.0-151-generic amd64 [21:04:00] : [Step 4/5] [2021-11-19 21:04:00,672][INFO ][main][EncryptedCacheCreateTest1] OS user: teamcity [21:04:00] : [Step 4/5] [2021-11-19 21:04:00,672][INFO ][main][EncryptedCacheCreateTest1] PID: 16724 [21:04:00] : [Step 4/5] [2021-11-19 21:04:00,672][INFO ][main][EncryptedCacheCreateTest1] Language runtime: Java Platform API Specification ver. 1.8 [21:04:00] : [Step 4/5] [2021-11-19 21:04:00,673][INFO ][main][EncryptedCacheCreateTest1] VM information: Java(TM) SE Runtime Environment 1.8.0_261-b12 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 25.261-b12 [21:04:00] : [Step 4/5] [2021-11-19 21:04:00,673][INFO ][main][EncryptedCacheCreateTest1] VM total memory: 1.9GB [21:04:00] : [Step 4/5] [2021-11-19 21:04:00,673][INFO ][main][EncryptedCacheCreateTest1] Remote Management [restart: off, REST: off, JMX (remote: off)] [21:04:00] : [Step 4/5] [2021-11-19 21:04:00,673][INFO ][main][EncryptedCacheCreateTest1] Logger: GridTestLog4jLogger [quiet=false, config=null] [21:04:00] : [Step 4/5] [2021-11-19 21:04:00,673][INFO ][main][EncryptedCacheCreateTest1] IGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c [21:04:00] : [Step 4/5] [2021-11-19 21:04:00,674][INFO ][main][EncryptedCacheCreateTest1] VM arguments: [-DIGNITE_DUMP_THREADS_ON_FAILURE=false, -DMono=/usr/bin/mono-sgen, -DMono4.0_x64=/usr/lib/mono/4.0, -DMono4.5_x64=/usr/lib/mono/4.5, -DMonoVersion=6.12.0.90, -DSKIP_BUILD=false, -Dagent.home.dir=/opt/buildagent, -Dagent.name=aitc-lin02_03, -Dagent.ownPort=9090, -Dagent.work.dir=/opt/buildagent/work, -Dbuild.number=95, -Dbuild.vcs.number=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.1=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.GitHubApacheIgnite=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dclassworlds.conf=/opt/buildagent/temp/buildTmp/teamcity.m2.conf, -Dcom.jetbrains.maven.watcher.report.file=/opt/buildagent/temp/buildTmp/maven-build-info.xml, -Djava.io.tmpdir=/opt/buildagent/temp/buildTmp, -Dmaven.home=/opt/buildagent/tools/maven3_6, -Dmaven.multiModuleProjectDirectory=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.agent.cpuBenchmark=457, -Dteamcity.agent.dotnet.agent_url=http://localhost:9090/RPC2, -Dteamcity.agent.dotnet.build_id=6278078, -Dteamcity.auth.password=*******, -Dteamcity.auth.userId=TeamCityBuildId=6278078, -Dteamcity.build.changedFiles.file=/opt/buildagent/temp/buildTmp/changedFiles6342607772318147725.txt, -Dteamcity.build.checkoutDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.build.id=6278078, -Dteamcity.build.properties.file=/opt/buildagent/temp/buildTmp/teamcity.build5164517880467851002.properties, -Dteamcity.build.tempDir=/opt/buildagent/temp/buildTmp, -Dteamcity.build.workingDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.buildConfName=Basic 3, -Dteamcity.buildType.id=IgniteTests24Java8_Basic3, -Dteamcity.configuration.properties.file=/opt/buildagent/temp/buildTmp/teamcity.config5591980786735343870.properties, -Dteamcity.maven.userSettings.path=/opt/buildagent/temp/buildTmp/maven_settings_585072866407032347.xml, -Dteamcity.maven.watcher.home=/opt/buildagent/plugins/mavenPlugin/maven-watcher-jdk16, -Dteamcity.projectName=Ignite Tests 2.x (JDK 8/11), -Dteamcity.runner.properties.file=/opt/buildagent/temp/buildTmp/teamcity.runner9098465561618137420.properties, -Dteamcity.tests.recentlyFailedTests.file=/opt/buildagent/temp/buildTmp/testsToRunFirst3891775683130404069.txt, -Dteamcity.version=2021.2 (build 99542), -ea, -Xms2g, -Xmx2g, -XX:+HeapDumpOnOutOfMemoryError, -DIGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_TEST_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_UPDATE_NOTIFIER=false, -DIGNITE_NO_DISCO_ORDER=true, -DIGNITE_PERFORMANCE_SUGGESTIONS_DISABLED=true, -Djava.net.preferIPv4Stack=true, -DTEST_SCALE_FACTOR=1.0, -DIGNITE_TEST_PROP_LOG4J_FILE=log4j-tc-test.xml, -DIGNITE_QUIET=false, -DIGNITE_MARSHAL_BUFFERS_RECHECK=1000, -Dmaven.repo.local=/opt/buildagent/.m2/repository] [21:04:00] : [Step 4/5] [2021-11-19 21:04:00,678][INFO ][main][EncryptedCacheCreateTest1] System cache's DataRegion size is configured to 40 MB. Use DataStorageConfiguration.systemRegionInitialSize property to change the setting. [21:04:00] : [Step 4/5] [2021-11-19 21:04:00,678][INFO ][main][EncryptedCacheCreateTest1] Configured caches [in 'sysMemPlc' dataRegion: ['ignite-sys-cache']] [21:04:00]W: [org.apache.ignite:ignite-core] [2021-11-19 21:04:00,679][WARN ][main][EncryptedCacheCreateTest1] Peer class loading is enabled (disable it in production for performance and deployment consistency reasons) [21:04:00] : [Step 4/5] [2021-11-19 21:04:00,679][INFO ][main][EncryptedCacheCreateTest1] 3-rd party licenses can be found at: /opt/buildagent/work/7bc1c54bc719b67c/libs/licenses [21:04:00] : [Step 4/5] [2021-11-19 21:04:00,683][INFO ][main][IgnitePluginProcessor] Configured plugins: [21:04:00] : [Step 4/5] [2021-11-19 21:04:00,683][INFO ][main][IgnitePluginProcessor] ^-- StanByClusterTestProvider 1.0 [21:04:00] : [Step 4/5] [2021-11-19 21:04:00,683][INFO ][main][IgnitePluginProcessor] ^-- null [21:04:00] : [Step 4/5] [2021-11-19 21:04:00,683][INFO ][main][IgnitePluginProcessor] [21:04:00] : [Step 4/5] [2021-11-19 21:04:00,684][INFO ][main][IgnitePluginProcessor] ^-- PageMemory tracker plugin 1.0 [21:04:00] : [Step 4/5] [2021-11-19 21:04:00,684][INFO ][main][IgnitePluginProcessor] ^-- null [21:04:00] : [Step 4/5] [2021-11-19 21:04:00,684][INFO ][main][IgnitePluginProcessor] [21:04:00] : [Step 4/5] [2021-11-19 21:04:00,684][INFO ][main][IgnitePluginProcessor] ^-- TestDistibutedConfigurationPlugin 1.0 [21:04:00] : [Step 4/5] [2021-11-19 21:04:00,684][INFO ][main][IgnitePluginProcessor] ^-- null [21:04:00] : [Step 4/5] [2021-11-19 21:04:00,684][INFO ][main][IgnitePluginProcessor] [21:04:00] : [Step 4/5] [2021-11-19 21:04:00,684][INFO ][main][IgnitePluginProcessor] ^-- NodeValidationPluginProvider 1.0 [21:04:00] : [Step 4/5] [2021-11-19 21:04:00,684][INFO ][main][IgnitePluginProcessor] ^-- null [21:04:00] : [Step 4/5] [2021-11-19 21:04:00,684][INFO ][main][IgnitePluginProcessor] [21:04:00] : [Step 4/5] [2021-11-19 21:04:00,685][INFO ][main][FailureProcessor] Configured failure handler: [hnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]]] [21:04:00] : [Step 4/5] [2021-11-19 21:04:00,694][INFO ][main][TcpCommunicationSpi] Successfully bound communication NIO server to TCP port [port=45121, locHost=/127.0.0.1, selectorsCnt=12, selectorSpins=0, pairedConn=false] [21:04:00]W: [org.apache.ignite:ignite-core] [2021-11-19 21:04:00,695][WARN ][main][TcpCommunicationSpi] Message queue limit is set to 0 which may lead to potential OOMEs when running cache operations in FULL_ASYNC or PRIMARY_SYNC modes due to message queues growth on sender and receiver sides. [21:04:00] : [Step 4/5] [2021-11-19 21:04:00,700][INFO ][main][GridCollisionManager] Collision resolution is disabled (all jobs will be activated upon arrival). [21:04:00] : [Step 4/5] [2021-11-19 21:04:00,700][INFO ][main][EncryptedCacheCreateTest1] Security status [authentication=off, sandbox=off, tls/ssl=off] [21:04:00] : [Step 4/5] [2021-11-19 21:04:00,769][INFO ][main][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:04:00] : [Step 4/5] [2021-11-19 21:04:00,855][INFO ][main][MaintenanceProcessor] Resolved store directory for node persistent data: /opt/buildagent/work/7bc1c54bc719b67c/work/db/encryption_EncryptedCacheCreateTest1 [21:04:00] : [Step 4/5] [2021-11-19 21:04:00,856][INFO ][main][CacheObjectBinaryProcessorImpl] Resolved directory for serialized binary metadata: /opt/buildagent/work/7bc1c54bc719b67c/work/db/binary_meta/encryption_EncryptedCacheCreateTest1 [21:04:00] : [Step 4/5] [2021-11-19 21:04:00,861][INFO ][main][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/encryption_EncryptedCacheCreateTest1 [21:04:00] : [Step 4/5] [2021-11-19 21:04:00,862][INFO ][main][FileWriteAheadLogManager] Resolved write ahead log work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/encryption_EncryptedCacheCreateTest1 [21:04:00] : [Step 4/5] [2021-11-19 21:04:00,862][INFO ][main][FileWriteAheadLogManager] Resolved write ahead log archive directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/encryption_EncryptedCacheCreateTest1 [21:04:01] : [Step 4/5] [2021-11-19 21:04:01,272][INFO ][main][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/encryption_EncryptedCacheCreateTest1/0000000000000000.wal [21:04:01] : [Step 4/5] [2021-11-19 21:04:01,277][INFO ][main][GridCacheDatabaseSharedManager] Configured data regions initialized successfully [total=6] [21:04:01] : [Step 4/5] [2021-11-19 21:04:01,280][INFO ][main][IgniteSnapshotManager] Resolved snapshot work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/snapshots [21:04:01] : [Step 4/5] [2021-11-19 21:04:01,280][INFO ][main][IgniteSnapshotManager] Resolved temp directory for snapshot creation: /opt/buildagent/work/7bc1c54bc719b67c/work/db/encryption_EncryptedCacheCreateTest1/snp [21:04:01] : [Step 4/5] [2021-11-19 21:04:01,283][INFO ][main][ClientListenerProcessor] Client connector processor has started on TCP port 10801 [21:04:01] : [Step 4/5] [2021-11-19 21:04:01,286][INFO ][main][EncryptedCacheCreateTest1] Non-loopback local IPs: 172.17.0.4 [21:04:01] : [Step 4/5] [2021-11-19 21:04:01,286][INFO ][main][EncryptedCacheCreateTest1] Enabled local MACs: 0242AC110004 [21:04:01] : [Step 4/5] [2021-11-19 21:04:01,286][INFO ][main][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:04:01] : [Step 4/5] [2021-11-19 21:04:01,287][INFO ][main][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:04:01] : [Step 4/5] [2021-11-19 21:04:01,288][INFO ][main][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:04:01] : [Step 4/5] [2021-11-19 21:04:01,293][INFO ][main][GridCacheDatabaseSharedManager] Applying lost metastore updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:04:01] : [Step 4/5] [2021-11-19 21:04:01,294][INFO ][main][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=10 ms] [21:04:01] : [Step 4/5] [2021-11-19 21:04:01,294][INFO ][main][GridCacheProcessor] Restoring partition state for local groups. [21:04:01] : [Step 4/5] [2021-11-19 21:04:01,294][INFO ][main][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=0, partitionsProcessed=0, time=0ms] [21:04:01] : [Step 4/5] [2021-11-19 21:04:01,295][INFO ][main][GridEncryptionManager] Encryption keys loaded from metastore. [grps=, masterKeyName=ignite.master.key] [21:04:01] : [Step 4/5] [2021-11-19 21:04:01,296][INFO ][main][ClusterProcessor] Cluster ID and tag has been read from metastorage: null [21:04:01] : [Step 4/5] [2021-11-19 21:04:01,296][INFO ][main][IgniteClusterImpl] Shutdown policy was updated [oldVal=null, newVal=null] [21:04:01] : [Step 4/5] [2021-11-19 21:04:01,296][INFO ][main][GridCacheDatabaseSharedManager] Checkpoint frequency deviation changed [oldVal=null, newVal=null] [21:04:01] : [Step 4/5] [2021-11-19 21:04:01,306][INFO ][main][FilePageStoreManager] Cleanup cache stores [total=1, left=0, cleanFiles=false] [21:04:01] : [Step 4/5] [2021-11-19 21:04:01,308][INFO ][main][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:04:01] : [Step 4/5] [2021-11-19 21:04:01,309][INFO ][main][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:04:01] : [Step 4/5] [2021-11-19 21:04:01,310][INFO ][main][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:04:01] : [Step 4/5] [2021-11-19 21:04:01,310][INFO ][main][GridCacheDatabaseSharedManager] Data Regions Started: 6 [21:04:01] : [Step 4/5] [2021-11-19 21:04:01,311][INFO ][main][GridCacheDatabaseSharedManager] ^-- sysMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:04:01] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:04:01] : [Step 4/5] ^-- no-persistence-region region [type=user, persistence=false, lazyAlloc=true, [21:04:01] : [Step 4/5] ... initCfg=10MB, maxCfg=10MB, usedRam=0MB, freeRam=100%, allocRam=0MB] [21:04:01] : [Step 4/5] ^-- default region [type=default, persistence=true, lazyAlloc=true, [21:04:01] : [Step 4/5] ... initCfg=10MB, maxCfg=10MB, usedRam=0MB, freeRam=100%, allocRam=0MB, allocTotal=0MB] [21:04:01] : [Step 4/5] ^-- metastoreMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:04:01] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:04:01] : [Step 4/5] ^-- TxLog region [type=internal, persistence=true, lazyAlloc=false, [21:04:01] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:04:01] : [Step 4/5] ^-- volatileDsMemPlc region [type=user, persistence=false, lazyAlloc=true, [21:04:01] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB] [21:04:01] : [Step 4/5] ^-- Ignite persistence [used=0MB] [21:04:01] : [Step 4/5] [21:04:01] : [Step 4/5] [2021-11-19 21:04:01,313][INFO ][main][GridCacheDatabaseSharedManager] Starting binary memory restore for: [-2100569601] [21:04:01] : [Step 4/5] [2021-11-19 21:04:01,324][INFO ][main][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:04:01] : [Step 4/5] [2021-11-19 21:04:01,325][INFO ][main][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:04:01] : [Step 4/5] [2021-11-19 21:04:01,326][INFO ][main][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/encryption_EncryptedCacheCreateTest1/0000000000000000.wal, offset=0, ver=2] [21:04:01] : [Step 4/5] [2021-11-19 21:04:01,332][INFO ][main][GridCacheProcessor] Started cache in recovery mode [name=ignite-sys-cache, id=-2100569601, dataRegionName=sysMemPlc, mode=REPLICATED, atomicity=TRANSACTIONAL, backups=2147483647, mvcc=false] [21:04:01] : [Step 4/5] [2021-11-19 21:04:01,335][INFO ][main][GridCacheDatabaseSharedManager] Binary recovery performed in 22 ms. [21:04:01] : [Step 4/5] [2021-11-19 21:04:01,335][INFO ][main][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:04:01] : [Step 4/5] [2021-11-19 21:04:01,335][INFO ][main][GridCacheDatabaseSharedManager] Applying lost cache updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:04:01] : [Step 4/5] [2021-11-19 21:04:01,408][INFO ][main][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=70 ms] [21:04:01] : [Step 4/5] [2021-11-19 21:04:01,408][INFO ][main][GridCacheProcessor] Restoring partition state for local groups. [21:04:01] : [Step 4/5] [2021-11-19 21:04:01,426][INFO ][main][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=1, partitionsProcessed=100, time=20ms] [21:04:01] : [Step 4/5] [2021-11-19 21:04:01,702][INFO ][main][TestTcpDiscoverySpi] Successfully bound to TCP port [port=47501, localHost=localhost/127.0.0.1, locNodeId=472daf0f-5502-4c71-9b54-a6c6d7800001] [21:04:01] : [Step 4/5] [2021-11-19 21:04:01,705][INFO ][tcp-disco-srvr-[:47500]-#321%encryption.EncryptedCacheCreateTest0%-#6460%encryption.EncryptedCacheCreateTest0%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=35343] [21:04:01] : [Step 4/5] [2021-11-19 21:04:01,705][INFO ][tcp-disco-srvr-[:47500]-#321%encryption.EncryptedCacheCreateTest0%-#6460%encryption.EncryptedCacheCreateTest0%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=35343] [21:04:01] : [Step 4/5] [2021-11-19 21:04:01,706][INFO ][tcp-disco-sock-reader-[]-#327%encryption.EncryptedCacheCreateTest0%-#6579%encryption.EncryptedCacheCreateTest0%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:35343, rmtPort=35343] [21:04:01] : [Step 4/5] [2021-11-19 21:04:01,708][INFO ][tcp-disco-sock-reader-[472daf0f 127.0.0.1:35343]-#327%encryption.EncryptedCacheCreateTest0%-#6579%encryption.EncryptedCacheCreateTest0%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=472daf0f-5502-4c71-9b54-a6c6d7800001, rmtAddr=/127.0.0.1:35343] [21:04:01] : [Step 4/5] [2021-11-19 21:04:01,715][INFO ][tcp-disco-srvr-[:47501]-#326%encryption.EncryptedCacheCreateTest1%-#6578%encryption.EncryptedCacheCreateTest1%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=38205] [21:04:01] : [Step 4/5] [2021-11-19 21:04:01,715][INFO ][tcp-disco-srvr-[:47501]-#326%encryption.EncryptedCacheCreateTest1%-#6578%encryption.EncryptedCacheCreateTest1%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=38205] [21:04:01] : [Step 4/5] [2021-11-19 21:04:01,716][INFO ][tcp-disco-sock-reader-[]-#328%encryption.EncryptedCacheCreateTest1%-#6580%encryption.EncryptedCacheCreateTest1%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:38205, rmtPort=38205] [21:04:01] : [Step 4/5] [2021-11-19 21:04:01,717][INFO ][tcp-disco-sock-reader-[]-#328%encryption.EncryptedCacheCreateTest1%-#6580%encryption.EncryptedCacheCreateTest1%][TestTcpDiscoverySpi] Received ping request from the remote node [rmtNodeId=d6d21d86-5751-4ef1-a3f0-af3b1c800000, rmtAddr=/127.0.0.1:38205, rmtPort=38205] [21:04:01] : [Step 4/5] [2021-11-19 21:04:01,718][INFO ][tcp-disco-sock-reader-[]-#328%encryption.EncryptedCacheCreateTest1%-#6580%encryption.EncryptedCacheCreateTest1%][TestTcpDiscoverySpi] Finished writing ping response [rmtNodeId=d6d21d86-5751-4ef1-a3f0-af3b1c800000, rmtAddr=/127.0.0.1:38205, rmtPort=38205] [21:04:01] : [Step 4/5] [2021-11-19 21:04:01,718][INFO ][tcp-disco-sock-reader-[472daf0f 127.0.0.1:35343]-#327%encryption.EncryptedCacheCreateTest0%-#6579%encryption.EncryptedCacheCreateTest0%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:35343, rmtPort=35343, rmtNodeId=472daf0f-5502-4c71-9b54-a6c6d7800001] [21:04:01]W: [org.apache.ignite:ignite-core] [2021-11-19 21:04:01,718][WARN ][tcp-disco-sock-reader-[]-#328%encryption.EncryptedCacheCreateTest1%-#6580%encryption.EncryptedCacheCreateTest1%][TestTcpDiscoverySpi] Failed to shutdown socket [21:04:01]W: [org.apache.ignite:ignite-core] java.net.SocketException: Socket output is already shutdown [21:04:01]W: [org.apache.ignite:ignite-core] at java.net.Socket.shutdownOutput(Socket.java:1572) [21:04:01]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.close(IgniteUtils.java:4247) [21:04:01]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.discovery.tcp.ServerImpl$SocketReader.body(ServerImpl.java:7370) [21:04:01] : [Step 4/5] [2021-11-19 21:04:01,722][INFO ][tcp-disco-sock-reader-[]-#328%encryption.EncryptedCacheCreateTest1%-#6580%encryption.EncryptedCacheCreateTest1%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:38205, rmtPort=38205, rmtNodeId=null] [21:04:01]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.IgniteSpiThread.run(IgniteSpiThread.java:58) [21:04:01] : [Step 4/5] [2021-11-19 21:04:01,723][INFO ][tcp-disco-msg-worker-[crd]-#320%encryption.EncryptedCacheCreateTest0%-#6459%encryption.EncryptedCacheCreateTest0%][GridEncryptionManager] Joining node doesn't have stored group keys [node=472daf0f-5502-4c71-9b54-a6c6d7800001] [21:04:01] : [Step 4/5] [2021-11-19 21:04:01,731][INFO ][tcp-disco-msg-worker-[crd]-#320%encryption.EncryptedCacheCreateTest0%-#6459%encryption.EncryptedCacheCreateTest0%][TestTcpDiscoverySpi] New next node [newNext=TcpDiscoveryNode [id=472daf0f-5502-4c71-9b54-a6c6d7800001, consistentId=encryption.EncryptedCacheCreateTest1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=0, intOrder=2, lastExchangeTime=1637345041707, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false]] [21:04:01] : [Step 4/5] [2021-11-19 21:04:01,732][INFO ][tcp-disco-srvr-[:47501]-#326%encryption.EncryptedCacheCreateTest1%-#6578%encryption.EncryptedCacheCreateTest1%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=56377] [21:04:01] : [Step 4/5] [2021-11-19 21:04:01,732][INFO ][tcp-disco-srvr-[:47501]-#326%encryption.EncryptedCacheCreateTest1%-#6578%encryption.EncryptedCacheCreateTest1%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=56377] [21:04:01] : [Step 4/5] [2021-11-19 21:04:01,733][INFO ][tcp-disco-sock-reader-[]-#329%encryption.EncryptedCacheCreateTest1%-#6581%encryption.EncryptedCacheCreateTest1%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:56377, rmtPort=56377] [21:04:01] : [Step 4/5] [2021-11-19 21:04:01,734][INFO ][tcp-disco-sock-reader-[d6d21d86 127.0.0.1:56377]-#329%encryption.EncryptedCacheCreateTest1%-#6581%encryption.EncryptedCacheCreateTest1%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=d6d21d86-5751-4ef1-a3f0-af3b1c800000, rmtAddr=/127.0.0.1:56377] [21:04:01] : [Step 4/5] [2021-11-19 21:04:01,739][INFO ][tcp-disco-msg-worker-[]-#325%encryption.EncryptedCacheCreateTest1%-#6577%encryption.EncryptedCacheCreateTest1%][TestTcpDiscoverySpi] New next node [newNext=TcpDiscoveryNode [id=d6d21d86-5751-4ef1-a3f0-af3b1c800000, consistentId=encryption.EncryptedCacheCreateTest0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345041727, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false]] [21:04:01] : [Step 4/5] [2021-11-19 21:04:01,740][INFO ][tcp-disco-srvr-[:47500]-#321%encryption.EncryptedCacheCreateTest0%-#6460%encryption.EncryptedCacheCreateTest0%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=52053] [21:04:01] : [Step 4/5] [2021-11-19 21:04:01,741][INFO ][tcp-disco-srvr-[:47500]-#321%encryption.EncryptedCacheCreateTest0%-#6460%encryption.EncryptedCacheCreateTest0%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=52053] [21:04:01] : [Step 4/5] [2021-11-19 21:04:01,741][INFO ][tcp-disco-sock-reader-[]-#330%encryption.EncryptedCacheCreateTest0%-#6582%encryption.EncryptedCacheCreateTest0%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:52053, rmtPort=52053] [21:04:01] : [Step 4/5] [2021-11-19 21:04:01,743][INFO ][tcp-disco-sock-reader-[472daf0f 127.0.0.1:52053]-#330%encryption.EncryptedCacheCreateTest0%-#6582%encryption.EncryptedCacheCreateTest0%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=472daf0f-5502-4c71-9b54-a6c6d7800001, rmtAddr=/127.0.0.1:52053] [21:04:01] : [Step 4/5] [2021-11-19 21:04:01,746][INFO ][disco-event-worker-#6462%encryption.EncryptedCacheCreateTest0%][GridDiscoveryManager] Added new node to topology: TcpDiscoveryNode [id=472daf0f-5502-4c71-9b54-a6c6d7800001, consistentId=encryption.EncryptedCacheCreateTest1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637345041707, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false] [21:04:01] : [Step 4/5] [2021-11-19 21:04:01,747][INFO ][disco-event-worker-#6462%encryption.EncryptedCacheCreateTest0%][GridDiscoveryManager] Topology snapshot [ver=2, locNode=d6d21d86, servers=2, clients=0, state=INACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=d6d21d86-5751-4ef1-a3f0-af3b1c800000, consistentId=encryption.EncryptedCacheCreateTest0, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=472daf0f-5502-4c71-9b54-a6c6d7800001, consistentId=encryption.EncryptedCacheCreateTest1, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:04:01] : [Step 4/5] [2021-11-19 21:04:01,750][INFO ][tcp-disco-msg-worker-[d6d21d86 127.0.0.1:47500]-#325%encryption.EncryptedCacheCreateTest1%-#6577%encryption.EncryptedCacheCreateTest1%][ClusterProcessor] strange_noyce [21:04:01] : [Step 4/5] [2021-11-19 21:04:01,750][INFO ][tcp-disco-msg-worker-[d6d21d86 127.0.0.1:47500]-#325%encryption.EncryptedCacheCreateTest1%-#6577%encryption.EncryptedCacheCreateTest1%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustEnabled' was changed from 'null' to 'false' [21:04:01] : [Step 4/5] [2021-11-19 21:04:01,750][INFO ][tcp-disco-msg-worker-[d6d21d86 127.0.0.1:47500]-#325%encryption.EncryptedCacheCreateTest1%-#6577%encryption.EncryptedCacheCreateTest1%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustTimeout' was changed from 'null' to '300000' [21:04:01] : [Step 4/5] [2021-11-19 21:04:01,751][INFO ][tcp-disco-msg-worker-[d6d21d86 127.0.0.1:47500]-#325%encryption.EncryptedCacheCreateTest1%-#6577%encryption.EncryptedCacheCreateTest1%][IgniteTxManager] Transactions parameter 'longOperationsDumpTimeout' was changed from 'null' to '60000' [21:04:01] : [Step 4/5] [2021-11-19 21:04:01,751][INFO ][tcp-disco-msg-worker-[d6d21d86 127.0.0.1:47500]-#325%encryption.EncryptedCacheCreateTest1%-#6577%encryption.EncryptedCacheCreateTest1%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpThreshold' was changed from 'null' to '0' [21:04:01] : [Step 4/5] [2021-11-19 21:04:01,752][INFO ][tcp-disco-msg-worker-[d6d21d86 127.0.0.1:47500]-#325%encryption.EncryptedCacheCreateTest1%-#6577%encryption.EncryptedCacheCreateTest1%][IgniteTxManager] Transactions parameter 'transactionTimeDumpSamplesCoefficient' was changed from 'null' to '0.0' [21:04:01] : [Step 4/5] [2021-11-19 21:04:01,752][INFO ][tcp-disco-msg-worker-[d6d21d86 127.0.0.1:47500]-#325%encryption.EncryptedCacheCreateTest1%-#6577%encryption.EncryptedCacheCreateTest1%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpSamplesPerSecondLimit' was changed from 'null' to '5' [21:04:01] : [Step 4/5] [2021-11-19 21:04:01,753][INFO ][tcp-disco-msg-worker-[d6d21d86 127.0.0.1:47500]-#325%encryption.EncryptedCacheCreateTest1%-#6577%encryption.EncryptedCacheCreateTest1%][IgniteTxManager] Transactions parameter 'collisionsDumpInterval' was changed from 'null' to '1000' [21:04:01] : [Step 4/5] [2021-11-19 21:04:01,753][INFO ][tcp-disco-msg-worker-[d6d21d86 127.0.0.1:47500]-#325%encryption.EncryptedCacheCreateTest1%-#6577%encryption.EncryptedCacheCreateTest1%][IgniteTxManager] Transactions parameter 'txOwnerDumpRequestsAllowed' was changed from 'null' to 'true' [21:04:01] : [Step 4/5] [2021-11-19 21:04:01,753][INFO ][tcp-disco-msg-worker-[d6d21d86 127.0.0.1:47500]-#325%encryption.EncryptedCacheCreateTest1%-#6577%encryption.EncryptedCacheCreateTest1%][GridCacheDatabaseSharedManager] Historical rebalance WAL threshold changed [property=historical.rebalance.threshold, oldVal=null, newVal=500] [21:04:01] : [Step 4/5] [2021-11-19 21:04:01,754][INFO ][disco-notifier-worker-#6576%encryption.EncryptedCacheCreateTest1%][MvccProcessorImpl] Assigned mvcc coordinator [crd=MvccCoordinator [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=0], nodeId=d6d21d86-5751-4ef1-a3f0-af3b1c800000, ver=1637345040629, local=false, initialized=false]] [21:04:01] : [Step 4/5] [2021-11-19 21:04:01,758][INFO ][sys-#6574%encryption.EncryptedCacheCreateTest1%][ClusterProcessor] Writing cluster ID and tag to metastorage on ready for write ClusterIdAndTag [id=22da8655-9291-4929-b637-a44418ad1f87, tag=strange_noyce] [21:04:01] : [Step 4/5] [2021-11-19 21:04:01,778][INFO ][main][EncryptedCacheCreateTest1] To start Console Management & Monitoring run ignitevisorcmd.{sh|bat} [21:04:01] : [Step 4/5] [2021-11-19 21:04:01,779][INFO ][main][EncryptedCacheCreateTest1] [21:04:01] : [Step 4/5] [21:04:01] : [Step 4/5] >>> +-------------------------------------------+ [21:04:01] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:04:01] : [Step 4/5] >>> +-------------------------------------------+ [21:04:01] : [Step 4/5] >>> OS name: Linux 4.15.0-151-generic amd64 [21:04:01] : [Step 4/5] >>> CPU(s): 24 [21:04:01] : [Step 4/5] >>> Heap: 2.0GB [21:04:01] : [Step 4/5] >>> VM name: 16724@c4dfe9a430b2 [21:04:01] : [Step 4/5] >>> Ignite instance name: encryption.EncryptedCacheCreateTest1 [21:04:01] : [Step 4/5] >>> Local node [ID=472DAF0F-5502-4C71-9B54-A6C6D7800001, order=2, clientMode=false] [21:04:01] : [Step 4/5] >>> Local node addresses: [127.0.0.1] [21:04:01] : [Step 4/5] >>> Local ports: TCP:10801 TCP:45121 TCP:47501 [21:04:01] : [Step 4/5] [21:04:01] : [Step 4/5] [2021-11-19 21:04:01,780][INFO ][main][EncryptedCacheCreateTest1] >>> Ignite cluster is in INACTIVE state (limited functionality available). Use control.(sh|bat) script or IgniteCluster.state(ClusterState.ACTIVE) to change the state. [21:04:01] : [Step 4/5] [2021-11-19 21:04:01,780][INFO ][main][GridDiscoveryManager] Topology snapshot [ver=2, locNode=472daf0f, servers=2, clients=0, state=INACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=d6d21d86-5751-4ef1-a3f0-af3b1c800000, consistentId=encryption.EncryptedCacheCreateTest0, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=472daf0f-5502-4c71-9b54-a6c6d7800001, consistentId=encryption.EncryptedCacheCreateTest1, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:04:01] : [Step 4/5] [2021-11-19 21:04:01,781][INFO ][main][G] Node started : [stage="Configure system pool" (0 ms),stage="Start managers" (193 ms),stage="Configure binary metadata" (2 ms),stage="Start processors" (426 ms),stage="Start 'StanByClusterTestProvider' plugin" (0 ms),stage="Start 'PageMemory tracker plugin' plugin" (0 ms),stage="Start 'TestDistibutedConfigurationPlugin' plugin" (0 ms),stage="Start 'NodeValidationPluginProvider' plugin" (0 ms),stage="Init metastore" (20 ms),stage="Init and start regions" (6 ms),stage="Restore binary memory" (22 ms),stage="Restore logical state" (90 ms),stage="Finish recovery" (274 ms),stage="Join topology" (54 ms),stage="Await transition" (5 ms),stage="Await exchange" (21 ms),stage="Total time" (1113 ms)] [21:04:01] : [Step 4/5] [2021-11-19 21:04:01,782][INFO ][main][root] Node started with the following configuration [id=472daf0f-5502-4c71-9b54-a6c6d7800001, marshaller=BinaryMarshaller [], discovery=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=5000, ackTimeout=5000, marsh=JdkMarshaller [clsFilter=org.apache.ignite.marshaller.MarshallerUtils$1@46c10083], reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], binaryCfg=null, lateAff=true] [21:04:01] : [Step 4/5] [2021-11-19 21:04:01,784][INFO ][main][GridClusterStateProcessor] Sending activate cluster request with BaselineTopology BaselineTopology [id=0, branchingHash=-3724515085, branchingType='New BaselineTopology', baselineNodes=[encryption.EncryptedCacheCreateTest0, encryption.EncryptedCacheCreateTest1]] [21:04:01] : [Step 4/5] [2021-11-19 21:04:01,789][INFO ][disco-notifier-worker-#6458%encryption.EncryptedCacheCreateTest0%][GridClusterStateProcessor] Received activate cluster request with BaselineTopology[id=0] initiator node ID: d6d21d86-5751-4ef1-a3f0-af3b1c800000 [21:04:01] : [Step 4/5] [2021-11-19 21:04:01,789][INFO ][disco-notifier-worker-#6458%encryption.EncryptedCacheCreateTest0%][GridClusterStateProcessor] Started state transition: activate cluster [21:04:01] : [Step 4/5] [2021-11-19 21:04:01,790][INFO ][exchange-worker-#6463%encryption.EncryptedCacheCreateTest0%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], crd=true, evt=DISCOVERY_CUSTOM_EVT, evtNode=d6d21d86-5751-4ef1-a3f0-af3b1c800000, customEvt=ChangeGlobalStateMessage [id=b281d593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqId=b2493d6e-1c6f-4cc7-aec6-a3aaba091af3, initiatingNodeId=d6d21d86-5751-4ef1-a3f0-af3b1c800000, state=ACTIVE, baselineTopology=BaselineTopology [id=0, branchingHash=-3724515085, branchingType='New BaselineTopology', baselineNodes=[encryption.EncryptedCacheCreateTest0, encryption.EncryptedCacheCreateTest1]], forceChangeBaselineTopology=false, timestamp=1637345041784, forceDeactivation=true], allowMerge=false, exchangeFreeSwitch=false] [21:04:01] : [Step 4/5] [2021-11-19 21:04:01,791][INFO ][exchange-worker-#6463%encryption.EncryptedCacheCreateTest0%][GridDhtPartitionsExchangeFuture] Start activation process [nodeId=d6d21d86-5751-4ef1-a3f0-af3b1c800000, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]]. New state: ACTIVE [21:04:01] : [Step 4/5] [2021-11-19 21:04:01,791][INFO ][disco-notifier-worker-#6576%encryption.EncryptedCacheCreateTest1%][GridClusterStateProcessor] Received activate cluster request with BaselineTopology[id=0] initiator node ID: d6d21d86-5751-4ef1-a3f0-af3b1c800000 [21:04:01] : [Step 4/5] [2021-11-19 21:04:01,792][INFO ][exchange-worker-#6463%encryption.EncryptedCacheCreateTest0%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/encryption_EncryptedCacheCreateTest0 [21:04:01] : [Step 4/5] [2021-11-19 21:04:01,792][INFO ][disco-notifier-worker-#6576%encryption.EncryptedCacheCreateTest1%][GridClusterStateProcessor] Started state transition: activate cluster [21:04:01] : [Step 4/5] [2021-11-19 21:04:01,794][INFO ][exchange-worker-#6585%encryption.EncryptedCacheCreateTest1%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], crd=false, evt=DISCOVERY_CUSTOM_EVT, evtNode=d6d21d86-5751-4ef1-a3f0-af3b1c800000, customEvt=ChangeGlobalStateMessage [id=b281d593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqId=b2493d6e-1c6f-4cc7-aec6-a3aaba091af3, initiatingNodeId=d6d21d86-5751-4ef1-a3f0-af3b1c800000, state=ACTIVE, baselineTopology=BaselineTopology [id=0, branchingHash=-3724515085, branchingType='New BaselineTopology', baselineNodes=[encryption.EncryptedCacheCreateTest0, encryption.EncryptedCacheCreateTest1]], forceChangeBaselineTopology=false, timestamp=1637345041784, forceDeactivation=true], allowMerge=false, exchangeFreeSwitch=false] [21:04:01] : [Step 4/5] [2021-11-19 21:04:01,796][INFO ][exchange-worker-#6463%encryption.EncryptedCacheCreateTest0%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/encryption_EncryptedCacheCreateTest0/0000000000000000.wal, offset=8713, ver=2] [21:04:01] : [Step 4/5] [2021-11-19 21:04:01,798][INFO ][exchange-worker-#6585%encryption.EncryptedCacheCreateTest1%][GridDhtPartitionsExchangeFuture] Start activation process [nodeId=472daf0f-5502-4c71-9b54-a6c6d7800001, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]]. New state: ACTIVE [21:04:01] : [Step 4/5] [2021-11-19 21:04:01,799][INFO ][exchange-worker-#6463%encryption.EncryptedCacheCreateTest0%][GridClusterStateProcessor] Writing BaselineTopology[id=0] [21:04:01] : [Step 4/5] [2021-11-19 21:04:01,799][INFO ][exchange-worker-#6585%encryption.EncryptedCacheCreateTest1%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/encryption_EncryptedCacheCreateTest1 [21:04:01] : [Step 4/5] [2021-11-19 21:04:01,803][INFO ][exchange-worker-#6585%encryption.EncryptedCacheCreateTest1%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/encryption_EncryptedCacheCreateTest1/0000000000000000.wal, offset=8713, ver=2] [21:04:01] : [Step 4/5] [2021-11-19 21:04:01,805][INFO ][exchange-worker-#6463%encryption.EncryptedCacheCreateTest0%][GridCacheDatabaseSharedManager] Finish recovery performed in 12 ms. [21:04:01] : [Step 4/5] [2021-11-19 21:04:01,805][INFO ][exchange-worker-#6585%encryption.EncryptedCacheCreateTest1%][GridClusterStateProcessor] Writing BaselineTopology[id=0] [21:04:01] : [Step 4/5] [2021-11-19 21:04:01,807][INFO ][exchange-worker-#6463%encryption.EncryptedCacheCreateTest0%][msg] Components activation performed in 15 ms. [21:04:01] : [Step 4/5] [2021-11-19 21:04:01,810][INFO ][exchange-worker-#6463%encryption.EncryptedCacheCreateTest0%][GridCacheProcessor] Finished recovery for cache [cache=ignite-sys-cache, grp=ignite-sys-cache, startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:04:01] : [Step 4/5] [2021-11-19 21:04:01,810][INFO ][exchange-worker-#6463%encryption.EncryptedCacheCreateTest0%][GridDhtPartitionsExchangeFuture] Successfully activated caches [nodeId=d6d21d86-5751-4ef1-a3f0-af3b1c800000, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], newState=ACTIVE] [21:04:01] : [Step 4/5] [2021-11-19 21:04:01,811][INFO ][exchange-worker-#6463%encryption.EncryptedCacheCreateTest0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:04:01] : [Step 4/5] [2021-11-19 21:04:01,818][INFO ][exchange-worker-#6585%encryption.EncryptedCacheCreateTest1%][GridCacheDatabaseSharedManager] Finish recovery performed in 17 ms. [21:04:01] : [Step 4/5] [2021-11-19 21:04:01,818][INFO ][exchange-worker-#6585%encryption.EncryptedCacheCreateTest1%][msg] Components activation performed in 19 ms. [21:04:01] : [Step 4/5] [2021-11-19 21:04:01,820][INFO ][exchange-worker-#6585%encryption.EncryptedCacheCreateTest1%][GridCacheProcessor] Finished recovery for cache [cache=ignite-sys-cache, grp=ignite-sys-cache, startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:04:01] : [Step 4/5] [2021-11-19 21:04:01,821][INFO ][exchange-worker-#6585%encryption.EncryptedCacheCreateTest1%][GridDhtPartitionsExchangeFuture] Successfully activated caches [nodeId=472daf0f-5502-4c71-9b54-a6c6d7800001, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], newState=ACTIVE] [21:04:01] : [Step 4/5] [2021-11-19 21:04:01,822][INFO ][exchange-worker-#6585%encryption.EncryptedCacheCreateTest1%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:04:01] : [Step 4/5] [2021-11-19 21:04:01,846][INFO ][exchange-worker-#6463%encryption.EncryptedCacheCreateTest0%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], crd=true] [21:04:01] : [Step 4/5] [2021-11-19 21:04:01,855][INFO ][grid-nio-worker-tcp-comm-0-#6402%TcpCommunicationSpi%][TcpCommunicationSpi] Accepted incoming communication connection [locAddr=/127.0.0.1:45120, rmtAddr=/127.0.0.1:50770] [21:04:01] : [Step 4/5] [2021-11-19 21:04:01,856][INFO ][db-checkpoint-thread-#6594%encryption.EncryptedCacheCreateTest0%][Checkpointer] Checkpoint started [checkpointId=3e044312-4eea-40fe-838f-e3e5854546a2, startPtr=WALPointer [idx=0, fileOff=87014, len=1963], checkpointBeforeLockTime=17ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=2ms, checkpointLockHoldTime=2ms, walCpRecordFsyncDuration=6ms, writeCheckpointEntryDuration=4ms, splitAndSortCpPagesDuration=0ms, pages=17, reason='node started'] [21:04:01] : [Step 4/5] [2021-11-19 21:04:01,857][INFO ][grid-nio-worker-tcp-comm-0-#6520%TcpCommunicationSpi%][TcpCommunicationSpi] Established outgoing communication connection [locAddr=/127.0.0.1:50770, rmtAddr=/127.0.0.1:45120] [21:04:01] : [Step 4/5] [2021-11-19 21:04:01,858][INFO ][db-checkpoint-thread-#6598%encryption.EncryptedCacheCreateTest1%][Checkpointer] Checkpoint started [checkpointId=645f1593-ebf6-482a-866e-ffabd632a9e4, startPtr=WALPointer [idx=0, fileOff=87014, len=1963], checkpointBeforeLockTime=12ms, checkpointLockWait=3ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=3ms, writeCheckpointEntryDuration=3ms, splitAndSortCpPagesDuration=0ms, pages=17, reason='node started'] [21:04:01] : [Step 4/5] [2021-11-19 21:04:01,858][INFO ][exchange-worker-#6585%encryption.EncryptedCacheCreateTest1%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], crd=false] [21:04:01] : [Step 4/5] [2021-11-19 21:04:01,861][INFO ][sys-#6437%encryption.EncryptedCacheCreateTest0%][GridDhtPartitionsExchangeFuture] Coordinator received single message [ver=AffinityTopologyVersion [topVer=2, minorTopVer=1], node=472daf0f-5502-4c71-9b54-a6c6d7800001, allReceived=true] [21:04:01] : [Step 4/5] [2021-11-19 21:04:01,861][INFO ][sys-#6437%encryption.EncryptedCacheCreateTest0%][GridDhtPartitionsExchangeFuture] finishExchangeOnCoordinator [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:04:01] : [Step 4/5] [2021-11-19 21:04:01,869][INFO ][sys-#6437%encryption.EncryptedCacheCreateTest0%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], err=null, rebalanced=true, wasRebalanced=false] [21:04:01] : [Step 4/5] [2021-11-19 21:04:01,869][INFO ][disco-notifier-worker-#6458%encryption.EncryptedCacheCreateTest0%][GridClusterStateProcessor] Received state change finish message: ACTIVE [21:04:01] : [Step 4/5] [2021-11-19 21:04:01,873][INFO ][disco-notifier-worker-#6458%encryption.EncryptedCacheCreateTest0%][GridClusterStateProcessor] Cluster state was changed from INACTIVE to ACTIVE [21:04:01] : [Step 4/5] [2021-11-19 21:04:01,873][INFO ][disco-notifier-worker-#6576%encryption.EncryptedCacheCreateTest1%][GridClusterStateProcessor] Received state change finish message: ACTIVE [21:04:01] : [Step 4/5] [2021-11-19 21:04:01,877][INFO ][sys-#6437%encryption.EncryptedCacheCreateTest0%][GridCacheProcessor] Finish proxy initialization, cacheName=ignite-sys-cache, localNodeId=d6d21d86-5751-4ef1-a3f0-af3b1c800000 [21:04:01] : [Step 4/5] [2021-11-19 21:04:01,877][INFO ][disco-notifier-worker-#6576%encryption.EncryptedCacheCreateTest1%][GridClusterStateProcessor] Cluster state was changed from INACTIVE to ACTIVE [21:04:01] : [Step 4/5] [2021-11-19 21:04:01,878][INFO ][sys-#6560%encryption.EncryptedCacheCreateTest1%][GridCachePartitionExchangeManager] Delay process full message without exchange id (there is exchange in progress) [nodeId=d6d21d86-5751-4ef1-a3f0-af3b1c800000] [21:04:01] : [Step 4/5] [2021-11-19 21:04:01,882][INFO ][sys-#6555%encryption.EncryptedCacheCreateTest1%][GridDhtPartitionsExchangeFuture] Received full message, will finish exchange [node=d6d21d86-5751-4ef1-a3f0-af3b1c800000, resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:04:01] : [Step 4/5] [2021-11-19 21:04:01,883][INFO ][sys-#6453%encryption.EncryptedCacheCreateTest0%][DistributedBaselineConfiguration] Baseline auto-adjust is 'disabled' with timeout='300000' ms [21:04:01] : [Step 4/5] [2021-11-19 21:04:01,884][INFO ][sys-#6453%encryption.EncryptedCacheCreateTest0%][GridClusterStateProcessor] Successfully performed final activation steps [nodeId=d6d21d86-5751-4ef1-a3f0-af3b1c800000, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:04:01] : [Step 4/5] [2021-11-19 21:04:01,886][INFO ][sys-#6555%encryption.EncryptedCacheCreateTest1%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], err=null, rebalanced=true, wasRebalanced=false] [21:04:01] : [Step 4/5] [2021-11-19 21:04:01,884][INFO ][db-checkpoint-thread-#6598%encryption.EncryptedCacheCreateTest1%][Checkpointer] Checkpoint finished [cpId=645f1593-ebf6-482a-866e-ffabd632a9e4, pages=17, markPos=WALPointer [idx=0, fileOff=87014, len=1963], walSegmentsCovered=[], markDuration=7ms, pagesWrite=3ms, fsync=21ms, total=46ms] [21:04:01] : [Step 4/5] [2021-11-19 21:04:01,884][INFO ][db-checkpoint-thread-#6594%encryption.EncryptedCacheCreateTest0%][Checkpointer] Checkpoint finished [cpId=3e044312-4eea-40fe-838f-e3e5854546a2, pages=17, markPos=WALPointer [idx=0, fileOff=87014, len=1963], walSegmentsCovered=[], markDuration=14ms, pagesWrite=5ms, fsync=20ms, total=56ms] [21:04:01] : [Step 4/5] [2021-11-19 21:04:01,883][INFO ][exchange-worker-#6463%encryption.EncryptedCacheCreateTest0%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=2, minorTopVer=1], force=false, evt=DISCOVERY_CUSTOM_EVT, node=d6d21d86-5751-4ef1-a3f0-af3b1c800000] [21:04:01] : [Step 4/5] [2021-11-19 21:04:01,883][INFO ][sys-#6437%encryption.EncryptedCacheCreateTest0%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=d6d21d86-5751-4ef1-a3f0-af3b1c800000, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=d6d21d86-5751-4ef1-a3f0-af3b1c800000, consistentId=encryption.EncryptedCacheCreateTest0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345041872, loc=true, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:04:01] : [Step 4/5] [2021-11-19 21:04:01,891][INFO ][sys-#6555%encryption.EncryptedCacheCreateTest1%][GridCacheProcessor] Finish proxy initialization, cacheName=ignite-sys-cache, localNodeId=472daf0f-5502-4c71-9b54-a6c6d7800001 [21:04:01] : [Step 4/5] [2021-11-19 21:04:01,892][INFO ][sys-#6437%encryption.EncryptedCacheCreateTest0%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (1 ms), stage="Update caches registry" (17 ms), stage="Start caches" (1 ms), stage="Affinity initialization on cache group start" (0 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Restore partition states" (0 ms), stage="After states restored callback" (34 ms), stage="WAL history reservation" (0 ms), stage="Waiting for all single messages" (15 ms), stage="Affinity recalculation (crd)" (0 ms), stage="Collect update counters and create affinity messages" (0 ms), stage="Assign partitions states" (1 ms), stage="Validate partitions states" (0 ms), stage="Ideal affinity diff calculation (enforced)" (0 ms), stage="Apply update counters" (0 ms), stage="Full message preparing" (3 ms), stage="Full message sending" (0 ms), stage="State finish message sending" (1 ms), stage="Detect lost partitions" (7 ms), stage="Exchange done" (16 ms), stage="Total time" (96 ms), Discovery lag=4 ms, Latest started node id=472daf0f-5502-4c71-9b54-a6c6d7800001] [21:04:01] : [Step 4/5] [2021-11-19 21:04:01,896][INFO ][main][root] awaitPartitionMapExchange finished [21:04:01] : [Step 4/5] [2021-11-19 21:04:01,895][INFO ][sys-#6555%encryption.EncryptedCacheCreateTest1%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=472daf0f-5502-4c71-9b54-a6c6d7800001, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=d6d21d86-5751-4ef1-a3f0-af3b1c800000, consistentId=encryption.EncryptedCacheCreateTest0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345041727, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:04:01] : [Step 4/5] [2021-11-19 21:04:01,895][INFO ][exchange-worker-#6585%encryption.EncryptedCacheCreateTest1%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=2, minorTopVer=1], force=false, evt=DISCOVERY_CUSTOM_EVT, node=d6d21d86-5751-4ef1-a3f0-af3b1c800000] [21:04:01] : [Step 4/5] [2021-11-19 21:04:01,894][INFO ][sys-#6565%encryption.EncryptedCacheCreateTest1%][DistributedBaselineConfiguration] Baseline auto-adjust is 'disabled' with timeout='300000' ms [21:04:01] : [Step 4/5] [2021-11-19 21:04:01,898][INFO ][sys-#6555%encryption.EncryptedCacheCreateTest1%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (3 ms), stage="Update caches registry" (21 ms), stage="Start caches" (0 ms), stage="Affinity initialization on cache group start" (0 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Restore partition states" (0 ms), stage="After states restored callback" (30 ms), stage="WAL history reservation" (0 ms), stage="Waiting for Full message" (29 ms), stage="Affinity recalculation" (2 ms), stage="Full map updating" (1 ms), stage="Detect lost partitions" (4 ms), stage="Exchange done" (8 ms), stage="Total time" (98 ms)] [21:04:01] : [Step 4/5] [2021-11-19 21:04:01,897][INFO ][sys-#6437%encryption.EncryptedCacheCreateTest0%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], stage="Affinity initialization on cache group start [grp=ignite-sys-cache]" (0 ms) (parent=Affinity initialization on cache group start), stage="Affinity centralized initialization (crd) [grp=ignite-sys-cache, crd=true]" (0 ms) (parent=Determine exchange type), stage="Restore partition states [grp=ignite-sys-cache]" (0 ms) (parent=Restore partition states), stage="Affinity recalculation (partitions availability) [grp=ignite-sys-cache]" (0 ms) (parent=Ideal affinity diff calculation (enforced))] [21:04:01] : [Step 4/5] [2021-11-19 21:04:01,901][INFO ][sys-#6555%encryption.EncryptedCacheCreateTest1%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], stage="Affinity initialization on cache group start [grp=ignite-sys-cache]" (0 ms) (parent=Affinity initialization on cache group start), stage="Affinity centralized initialization (crd) [grp=ignite-sys-cache, crd=false]" (0 ms) (parent=Determine exchange type), stage="Restore partition states [grp=ignite-sys-cache]" (0 ms) (parent=Restore partition states), stage="Affinity applying from full message [grp=ignite-sys-cache]" (2 ms) (parent=Affinity recalculation)] [21:04:01] : [Step 4/5] [2021-11-19 21:04:01,899][INFO ][sys-#6565%encryption.EncryptedCacheCreateTest1%][GridClusterStateProcessor] Successfully performed final activation steps [nodeId=472daf0f-5502-4c71-9b54-a6c6d7800001, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:04:01] : [Step 4/5] [2021-11-19 21:04:01,907][INFO ][exchange-worker-#6463%encryption.EncryptedCacheCreateTest0%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], crd=true, evt=DISCOVERY_CUSTOM_EVT, evtNode=d6d21d86-5751-4ef1-a3f0-af3b1c800000, customEvt=DynamicCacheChangeBatch [id=f481d593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqs=ArrayList [DynamicCacheChangeRequest [cacheName=encrypted, hasCfg=true, nodeId=d6d21d86-5751-4ef1-a3f0-af3b1c800000, clientStartOnly=false, stop=false, destroy=false, disabledAfterStart=false]], exchangeActions=ExchangeActions [startCaches=[encrypted], stopCaches=null, startGrps=[encrypted], stopGrps=[], resetParts=null, stateChangeRequest=null], startCaches=false], allowMerge=false, exchangeFreeSwitch=false] [21:04:01] : [Step 4/5] [2021-11-19 21:04:01,911][INFO ][exchange-worker-#6585%encryption.EncryptedCacheCreateTest1%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], crd=false, evt=DISCOVERY_CUSTOM_EVT, evtNode=d6d21d86-5751-4ef1-a3f0-af3b1c800000, customEvt=DynamicCacheChangeBatch [id=f481d593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqs=ArrayList [DynamicCacheChangeRequest [cacheName=encrypted, hasCfg=true, nodeId=d6d21d86-5751-4ef1-a3f0-af3b1c800000, clientStartOnly=false, stop=false, destroy=false, disabledAfterStart=false]], exchangeActions=ExchangeActions [startCaches=[encrypted], stopCaches=null, startGrps=[encrypted], stopGrps=[], resetParts=null, stateChangeRequest=null], startCaches=false], allowMerge=false, exchangeFreeSwitch=false] [21:04:01] : [Step 4/5] [2021-11-19 21:04:01,914][INFO ][exchange-worker-#6585%encryption.EncryptedCacheCreateTest1%][PageMemoryImpl] Started page memory [memoryAllocated=24.0 MiB, pages=5952, tableSize=474.2 KiB, replacementSize=768 B, checkpointBuffer=10.0 MiB] [21:04:01] : [Step 4/5] [2021-11-19 21:04:01,917][INFO ][exchange-worker-#6463%encryption.EncryptedCacheCreateTest0%][PageMemoryImpl] Started page memory [memoryAllocated=24.0 MiB, pages=5952, tableSize=474.2 KiB, replacementSize=768 B, checkpointBuffer=10.0 MiB] [21:04:01] : [Step 4/5] [2021-11-19 21:04:01,995][INFO ][exchange-worker-#6463%encryption.EncryptedCacheCreateTest0%][GridCacheProcessor] Started cache [name=encrypted, id=1613773252, dataRegionName=default, mode=PARTITIONED, atomicity=ATOMIC, backups=0, mvcc=false] [21:04:01] : [Step 4/5] [2021-11-19 21:04:01,995][INFO ][exchange-worker-#6585%encryption.EncryptedCacheCreateTest1%][GridCacheProcessor] Started cache [name=encrypted, id=1613773252, dataRegionName=default, mode=PARTITIONED, atomicity=ATOMIC, backups=0, mvcc=false] [21:04:01]W: [org.apache.ignite:ignite-core] [2021-11-19 21:04:01,997][WARN ][exchange-worker-#6463%encryption.EncryptedCacheCreateTest0%][CacheAffinitySharedManager] Cache group 'encrypted' brings high overhead for its metainformation in data region 'default'. Metainformation required for its partitions (486 partitions, 4096 bytes per partition, 1 MBs total) will consume more than 15% of data region memory (10 MBs). It may lead to critical errors on the node and cluster instability. Please reduce number of partitions, add more memory to the data region or add more server nodes for this cache group. [21:04:01]W: [org.apache.ignite:ignite-core] [2021-11-19 21:04:01,997][WARN ][exchange-worker-#6585%encryption.EncryptedCacheCreateTest1%][CacheAffinitySharedManager] Cache group 'encrypted' brings high overhead for its metainformation in data region 'default'. Metainformation required for its partitions (538 partitions, 4096 bytes per partition, 2 MBs total) will consume more than 15% of data region memory (10 MBs). It may lead to critical errors on the node and cluster instability. Please reduce number of partitions, add more memory to the data region or add more server nodes for this cache group. [21:04:02] : [Step 4/5] [2021-11-19 21:04:01,998][INFO ][exchange-worker-#6463%encryption.EncryptedCacheCreateTest0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], waitTime=0ms, futInfo=NA, mode=DISTRIBUTED] [21:04:02] : [Step 4/5] [2021-11-19 21:04:01,999][INFO ][exchange-worker-#6585%encryption.EncryptedCacheCreateTest1%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], waitTime=0ms, futInfo=NA, mode=DISTRIBUTED] [21:04:02] : [Step 4/5] [2021-11-19 21:04:02,001][INFO ][exchange-worker-#6463%encryption.EncryptedCacheCreateTest0%][GridDhtPartitionsExchangeFuture] Finished waiting for partitions release latch: ServerLatch [permits=0, pendingAcks=HashSet [], super=CompletableLatch [id=CompletableLatchUid [id=exchange, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2]]]] [21:04:02] : [Step 4/5] [2021-11-19 21:04:02,001][INFO ][exchange-worker-#6585%encryption.EncryptedCacheCreateTest1%][GridDhtPartitionsExchangeFuture] Finished waiting for partitions release latch: ClientLatch [coordinator=TcpDiscoveryNode [id=d6d21d86-5751-4ef1-a3f0-af3b1c800000, consistentId=encryption.EncryptedCacheCreateTest0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345041727, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], ackSent=true, super=CompletableLatch [id=CompletableLatchUid [id=exchange, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2]]]] [21:04:02] : [Step 4/5] [2021-11-19 21:04:02,001][INFO ][exchange-worker-#6463%encryption.EncryptedCacheCreateTest0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:04:02] : [Step 4/5] [2021-11-19 21:04:02,002][INFO ][exchange-worker-#6585%encryption.EncryptedCacheCreateTest1%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:04:02] : [Step 4/5] [2021-11-19 21:04:02,041][INFO ][exchange-worker-#6463%encryption.EncryptedCacheCreateTest0%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], crd=true] [21:04:02] : [Step 4/5] [2021-11-19 21:04:02,045][INFO ][exchange-worker-#6585%encryption.EncryptedCacheCreateTest1%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], crd=false] [21:04:02] : [Step 4/5] [2021-11-19 21:04:02,046][INFO ][sys-#6440%encryption.EncryptedCacheCreateTest0%][GridDhtPartitionsExchangeFuture] Coordinator received single message [ver=AffinityTopologyVersion [topVer=2, minorTopVer=2], node=472daf0f-5502-4c71-9b54-a6c6d7800001, allReceived=true] [21:04:02] : [Step 4/5] [2021-11-19 21:04:02,046][INFO ][sys-#6440%encryption.EncryptedCacheCreateTest0%][GridDhtPartitionsExchangeFuture] finishExchangeOnCoordinator [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2]] [21:04:02] : [Step 4/5] [2021-11-19 21:04:02,057][INFO ][sys-#6440%encryption.EncryptedCacheCreateTest0%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], err=null, rebalanced=true, wasRebalanced=true] [21:04:02] : [Step 4/5] [2021-11-19 21:04:02,058][INFO ][sys-#6573%encryption.EncryptedCacheCreateTest1%][GridDhtPartitionsExchangeFuture] Received full message, will finish exchange [node=d6d21d86-5751-4ef1-a3f0-af3b1c800000, resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2]] [21:04:02] : [Step 4/5] [2021-11-19 21:04:02,059][INFO ][sys-#6440%encryption.EncryptedCacheCreateTest0%][GridCacheProcessor] Finish proxy initialization, cacheName=encrypted, localNodeId=d6d21d86-5751-4ef1-a3f0-af3b1c800000 [21:04:02] : [Step 4/5] [2021-11-19 21:04:02,059][INFO ][sys-#6440%encryption.EncryptedCacheCreateTest0%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=d6d21d86-5751-4ef1-a3f0-af3b1c800000, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=d6d21d86-5751-4ef1-a3f0-af3b1c800000, consistentId=encryption.EncryptedCacheCreateTest0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500][21:04:02] >>> Stopp, discPort=47500, oing test: EncryptedCacheCreateTest#testCreateEncryptedCache in 1rder=1, intOrder=1, lastExchan63 ms <<< [21:04:02] : [Step 4/5] geTime=1637345041903, loc=true, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2]] [21:04:02] : [Step 4/5] [2021-11-19 21:04:02,061][INFO ][main][root] >>> Stopping test: EncryptedCacheCreateTest#testCreateEncryptedCache in 163 ms <<< [21:04:02] : [Step 4/5] [21:04:02] >>> Heap: 537 MB used / 1937 MB commited / 1937 MB max <<< [21:04:02] : [Step 4/5] [2021-11-19 21:04:02,062][INFO ][main][root] >>> Heap: 537 MB used / 1937 MB commited / 1937 MB max <<< [21:04:02] : [Step 4/5] [21:04:02] >>> No[2n-Heap: 13021-111 MB used / 1-142 MB com9 mited / 0 MB max <<< [21:04:02] : [Step 4/5] 21:04:02,060][INFO ][exchange-worker-#6463%encryption.EncryptedCacheCreateTest0%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=2, minorTopVer=2], force=false, evt=DISCOVERY_CUSTOM_EVT, node=d6d21d86-5751-4ef1-a3f0-af3b1c800000] [21:04:02] : [Step 4/5] [2021-11-19 21:04:02,060][INFO ][sys-#6573%encryption.EncryptedCacheCreateTest1%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], err=null, rebalanced=true, wasRebalanced=true] [21:04:02] : [Step 4/5] [2021-11-19 21:04:02,062][INFO ][main][root] >>> Non-Heap: 131 MB used / 142 MB commited / 0 MB max <<< [21:04:02] : [Step 4/5] [2021-11-19 21:04:02,061][INFO ][sys-#6440%encryption.EncryptedCacheCreateTest0%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (1 ms), stage="Update caches registry" (7 ms), stage="Start caches" (78 ms), stage="Affinity initialization on cache group start" (2 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (1 ms), stage="Wait partitions release latch [latch=exchange]" (1 ms), stage="Wait partitions release [latch=exchange]" (1 ms), stage="Restore partition states" (13 ms), stage="After states restored callback" (23 ms), stage="WAL history reservation" (0 ms), stage="Waiting for all single messages" (5 ms), stage="Affinity recalculation (crd)" (0 ms), stage="Collect update counters and create affinity messages" (0 ms), stage="Assign partitions states" (3 ms), stage="Validate partitions states" (0 ms), stage="Apply update counters" (0 ms), stage="Full message preparing" (5 ms), stage="Full message sending" (0 ms), stage="Exchange done" (4 ms), stage="Total time" (144 ms), Discovery lag=2 ms, Latest started node id=472daf0f-5502-4c71-9b54-a6c6d7800001] [21:04:02] : [Step 4/5] [2021-11-19 21:04:02,066][INFO ][sys-#6573%encryption.EncryptedCacheCreateTest1%][GridCacheProcessor] Finish proxy initialization, cacheName=encrypted, localNodeId=472daf0f-5502-4c71-9b54-a6c6d7800001 [21:04:02] : [Step 4/5] [2021-11-19 21:04:02,065][INFO ][main][root] >>> Stopping grid [name=encryption.EncryptedCacheCreateTest0, id=d6d21d86-5751-4ef1-a3f0-af3b1c800000] [21:04:02] : [Step 4/5] [2021-11-19 21:04:02,068][INFO ][sys-#6573%encryption.EncryptedCacheCreateTest1%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=472daf0f-5502-4c71-9b54-a6c6d7800001, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=d6d21d86-5751-4ef1-a3f0-af3b1c800000, consistentId=encryption.EncryptedCacheCreateTest0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345041727, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2]] [21:04:02] : [Step 4/5] [2021-11-19 21:04:02,068][INFO ][sys-#6440%encryption.EncryptedCacheCreateTest0%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], stage="Affinity initialization on cache group start [grp=encrypted]" (1 ms) (parent=Affinity initialization on cache group start), stage="Restore partition states [grp=encrypted]" (13 ms) (parent=Restore partition states), stage="Restore partition states [grp=ignite-sys-cache]" (0 ms) (parent=Restore partition states)] [21:04:02] : [Step 4/5] [2021-11-19 21:04:02,071][INFO ][sys-#6573%encryption.EncryptedCacheCreateTest1%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], stage="Waiting in exchange queue" (1 ms), stage="Exchange parameters initialization" (1 ms), stage="Update caches registry" (0 ms), stage="Start caches" (82 ms), stage="Affinity initialization on cache group start" (3 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Wait partitions release latch [latch=exchange]" (1 ms), stage="Wait partitions release [latch=exchange]" (1 ms), stage="Restore partition states" (12 ms), stage="After states restored callback" (28 ms), stage="WAL history reservation" (0 ms), stage="Waiting for Full message" (14 ms), stage="Affinity recalculation" (0 ms), stage="Full map updating" (1 ms), stage="Exchange done" (10 ms), stage="Total time" (154 ms)] [21:04:02] : [Step 4/5] [2021-11-19 21:04:02,079][INFO ][sys-#6573%encryption.EncryptedCacheCreateTest1%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], stage="Affinity initialization on cache group start [grp=encrypted]" (1 ms) (parent=Affinity initialization on cache group start), stage="Restore partition states [grp=encrypted]" (11 ms) (parent=Restore partition states), stage="Restore partition states [grp=ignite-sys-cache]" (0 ms) (parent=Restore partition states)] [21:04:02] : [Step 4/5] [2021-11-19 21:04:02,069][INFO ][exchange-worker-#6585%encryption.EncryptedCacheCreateTest1%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=2, minorTopVer=2], force=false, evt=DISCOVERY_CUSTOM_EVT, node=d6d21d86-5751-4ef1-a3f0-af3b1c800000] [21:04:02] : [Step 4/5] [2021-11-19 21:04:02,489][INFO ][db-checkpoint-thread-#6594%encryption.EncryptedCacheCreateTest0%][Checkpointer] Checkpoint started [checkpointId=a52c8e2f-4c7f-408c-aa9a-3ba31d8b7c17, startPtr=WALPointer [idx=0, fileOff=187603, len=11187], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=136ms, writeCheckpointEntryDuration=277ms, splitAndSortCpPagesDuration=0ms, pages=10, reason='timeout'] [21:04:02] : [Step 4/5] [2021-11-19 21:04:02,505][INFO ][tcp-disco-sock-reader-[472daf0f 127.0.0.1:52053]-#330%encryption.EncryptedCacheCreateTest0%-#6582%encryption.EncryptedCacheCreateTest0%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:52053, rmtPort=52053, rmtNodeId=472daf0f-5502-4c71-9b54-a6c6d7800001] [21:04:02] : [Step 4/5] [2021-11-19 21:04:02,506][INFO ][disco-event-worker-#6584%encryption.EncryptedCacheCreateTest1%][GridDiscoveryManager] Node left topology: TcpDiscoveryNode [id=d6d21d86-5751-4ef1-a3f0-af3b1c800000, consistentId=encryption.EncryptedCacheCreateTest0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345041727, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false] [21:04:02] : [Step 4/5] [2021-11-19 21:04:02,509][INFO ][main][GridCacheProcessor] Stopped cache [cacheName=ignite-sys-cache] [21:04:02] : [Step 4/5] [2021-11-19 21:04:02,510][INFO ][main][GridCacheProcessor] Stopped cache [cacheName=encrypted] [21:04:02] : [Step 4/5] [2021-11-19 21:04:02,510][INFO ][disco-event-worker-#6584%encryption.EncryptedCacheCreateTest1%][GridDiscoveryManager] Topology snapshot [ver=3, locNode=472daf0f, servers=1, clients=0, state=ACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=472daf0f-5502-4c71-9b54-a6c6d7800001, consistentId=encryption.EncryptedCacheCreateTest1, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:04:02] : [Step 4/5] [2021-11-19 21:04:02,511][INFO ][disco-event-worker-#6584%encryption.EncryptedCacheCreateTest1%][GridDiscoveryManager] Coordinator changed [prev=TcpDiscoveryNode [id=d6d21d86-5751-4ef1-a3f0-af3b1c800000, consistentId=encryption.EncryptedCacheCreateTest0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345041727, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], cur=TcpDiscoveryNode [id=472daf0f-5502-4c71-9b54-a6c6d7800001, consistentId=encryption.EncryptedCacheCreateTest1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637345042502, loc=true, ver=2.13.0#20211119-sha1:00000000, isClient=false]] [21:04:02] : [Step 4/5] [2021-11-19 21:04:02,513][INFO ][disco-event-worker-#6584%encryption.EncryptedCacheCreateTest1%][GridDiscoveryManager] ^-- Baseline [id=0, size=2, online=1, offline=1] [21:04:02] : [Step 4/5] [2021-11-19 21:04:02,514][INFO ][disco-event-worker-#6584%encryption.EncryptedCacheCreateTest1%][MvccProcessorImpl] Assigned mvcc coordinator [crd=MvccCoordinator [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], nodeId=472daf0f-5502-4c71-9b54-a6c6d7800001, ver=1637345040630, local=true, initialized=false]] [21:04:02]W: [org.apache.ignite:ignite-core] [2021-11-19 21:04:02,514][WARN ][grid-nio-worker-tcp-comm-0-#6520%TcpCommunicationSpi%][TcpCommunicationSpi] Failed to shutdown socket [21:04:02]W: [org.apache.ignite:ignite-core] java.nio.channels.ClosedChannelException [21:04:02]W: [org.apache.ignite:ignite-core] at sun.nio.ch.SocketChannelImpl.shutdownOutput(SocketChannelImpl.java:795) [21:04:02]W: [org.apache.ignite:ignite-core] at sun.nio.ch.SocketAdaptor.shutdownOutput(SocketAdaptor.java:407) [21:04:02]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.close(IgniteUtils.java:4247) [21:04:02]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.closeKey(GridNioServer.java:2784) [21:04:02]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.close(GridNioServer.java:2835) [21:04:02]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.close(GridNioServer.java:2794) [21:04:02]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.bodyInternal(GridNioServer.java:2157) [21:04:02]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.body(GridNioServer.java:1910) [21:04:02]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:125) [21:04:02]W: [org.apache.ignite:ignite-core] at java.lang.Thread.run(Thread.java:748) [21:04:02] : [Step 4/5] [2021-11-19 21:04:02,516][INFO ][exchange-worker-#6585%encryption.EncryptedCacheCreateTest1%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], crd=true, evt=NODE_LEFT, evtNode=d6d21d86-5751-4ef1-a3f0-af3b1c800000, customEvt=null, allowMerge=false, exchangeFreeSwitch=true] [21:04:02] : [Step 4/5] [2021-11-19 21:04:02,516][INFO ][sys-#6556%encryption.EncryptedCacheCreateTest1%][ExchangeLatchManager] Become new coordinator 472daf0f-5502-4c71-9b54-a6c6d7800001 [21:04:02] : [Step 4/5] [2021-11-19 21:04:02,518][INFO ][exchange-worker-#6585%encryption.EncryptedCacheCreateTest1%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:04:02] : [Step 4/5] [2021-11-19 21:04:02,522][INFO ][exchange-worker-#6585%encryption.EncryptedCacheCreateTest1%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], err=null, rebalanced=true, wasRebalanced=true] [21:04:02]W: [org.apache.ignite:ignite-core] [2021-11-19 21:04:02,524][WARN ][sys-#6555%encryption.EncryptedCacheCreateTest1%][GridDhtPartitionTopologyImpl] Detected lost partitions [grp=encrypted, parts=[0, 2, 4-5, 8, 13-14, 22, 24-25, 27-28, 30, 32, 35, 38, 40, 44, 46-48, 50, 52, 58, 61, 65, 68, 71, 74-77, 80-81, 83-85, 88, 90-91, 95-97, 105-106, 108-111, 114, 118-119, 122-123, 127-129, 134-140, 142, 144, 146, 149, 151-155, 158-161, 164-166, 169-171, 173-175, 177, 179, 182, 186, 189, 191, 193-196, 201, 203, 206-207, 209-211, 213-214, 219, 222, 224-225, 227-228, 233, 235, 238, 240, 245-247, 249-250, 253, 255-256, 258, 260-261, 264-266, 268-269, 274-277, 279-280, 282-284, 286-287, 289-292, 296, 298, 301-302, 304, 306-307, 309, 311-312, 314-315, 318, 320, 326, 328-329, 334, 337-339, 344, 346-349, 351, 357, 360-361, 363, 368, 370, 374, 378, 382, 384-385, 387-391, 393, 397-400, 402, 404, 408-409, 411, 415, 419, 422, 424-426, 428-430, 434, 445-446, 448, 450, 453-457, 460, 462-463, 467, 473, 475-476, 479-480, 486, 488-494, 496-498, 500, 505, 507-510, 515, 518-519, 521-522, 524, 526-528, 531, 533-535, 537-539, 542-545, 547, 549, 557, 559, 561, 565-568, 570-571, 574, 579, 582, 587, 589, 593, 595-597, 599-602, 604, 607, 611-615, 617-618, 622-623, 625, 627, 630-632, 638, 641-642, 648-650, 653, 655, 657-658, 661, 670, 672-673, 677-680, 684-685, 694, 696-697, 700-704, 706, 708-710, 714, 717, 719-720, 725, 729, 731, 733, 737-739, 741, 745-747, 751, 753-755, 758, 762-763, 767-768, 770, 774, 776-777, 782, 784-790, 793, 796-798, 800-802, 806-808, 811, 814, 818-821, 823-824, 829-831, 833, 835, 838-840, 843, 845, 848-851, 854, 861-862, 866, 868, 870-872, 876-878, 881, 886, 890, 893-895, 897-898, 901, 904-905, 908-910, 912-913, 915-917, 920-921, 923, 925-927, 929, 932, 935-937, 939, 942, 944-945, 948-951, 954, 962-963, 967, 969-971, 973-976, 979-980, 982-983, 985, 988, 992, 996, 998, 1004-1006, 1008-1013, 1015, 1017, 1021-1022], topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0]] [21:04:02] : [Step 4/5] [2021-11-19 21:04:02,530][INFO ][exchange-worker-#6585%encryption.EncryptedCacheCreateTest1%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=472daf0f-5502-4c71-9b54-a6c6d7800001, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], evt=NODE_LEFT, evtNode=TcpDiscoveryNode [id=d6d21d86-5751-4ef1-a3f0-af3b1c800000, consistentId=encryption.EncryptedCacheCreateTest0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345041727, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0]] [21:04:02] : [Step 4/5] [2021-11-19 21:04:02,531][INFO ][exchange-worker-#6585%encryption.EncryptedCacheCreateTest1%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (1 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="After states restored callback" (0 ms), stage="WAL history reservation" (0 ms), stage="Finalize update counters" (0 ms), stage="Detect lost partitions" (7 ms), stage="Exchange done" (2 ms), stage="Total time" (10 ms)] [21:04:02] : [Step 4/5] [2021-11-19 21:04:02,532][INFO ][exchange-worker-#6585%encryption.EncryptedCacheCreateTest1%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], stage="Affinity initialization (exchange-free switch on fully-rebalanced topology) [grp=ignite-sys-cache]" (0 ms) (parent=Determine exchange type), stage="Affinity initialization (exchange-free switch on fully-rebalanced topology) [grp=encrypted]" (0 ms) (parent=Determine exchange type)] [21:04:02] : [Step 4/5] [2021-11-19 21:04:02,533][INFO ][exchange-worker-#6585%encryption.EncryptedCacheCreateTest1%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], crd=true] [21:04:02] : [Step 4/5] [2021-11-19 21:04:02,535][INFO ][exchange-worker-#6585%encryption.EncryptedCacheCreateTest1%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=3, minorTopVer=0], force=false, evt=NODE_LEFT, node=d6d21d86-5751-4ef1-a3f0-af3b1c800000] [21:04:03] : [Step 4/5] [2021-11-19 21:04:03,175][INFO ][main][FilePageStoreManager] Cleanup cache stores [total=4, left=0, cleanFiles=false] [21:04:03] : [Step 4/5] [2021-11-19 21:04:03,177][INFO ][main][GridDeploymentLocalStore] Removed undeployed class: GridDeployment [ts=1637345041850, depMode=SHARED, clsLdr=IsolatedClassLoader{roleName='test'}, clsLdrId=7381d593d71-d6d21d86-5751-4ef1-a3f0-af3b1c800000, userVer=0, loc=true, sampleClsName=org.apache.ignite.internal.processors.cache.distributed.dht.preloader.GridDhtPartitionMap, pendingUndeploy=false, undeployed=true, usage=0] [21:04:03] : [Step 4/5] [2021-11-19 21:04:03,189][INFO ][main][EncryptedCacheCreateTest0] [21:04:03] : [Step 4/5] [21:04:03] : [Step 4/5] >>> +------------------------------------------------------+ [21:04:03] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV stopped OK [21:04:03] : [Step 4/5] >>> +------------------------------------------------------+ [21:04:03] : [Step 4/5] >>> Ignite instance name: encryption.EncryptedCacheCreateTest0 [21:04:03] : [Step 4/5] >>> Grid uptime: 00:00:02.535 [21:04:03] : [Step 4/5] [21:04:03] : [Step 4/5] [21:04:03] : [Step 4/5] [2021-11-19 21:04:03,190][INFO ][main][root] >>> Stopping grid [name=encryption.EncryptedCacheCreateTest1, id=472daf0f-5502-4c71-9b54-a6c6d7800001] [21:04:03] : [Step 4/5] [2021-11-19 21:04:03,203][INFO ][db-checkpoint-thread-#6598%encryption.EncryptedCacheCreateTest1%][Checkpointer] Checkpoint started [checkpointId=b10da0a8-38f1-4689-be0a-77b85065d50f, startPtr=WALPointer [idx=0, fileOff=195854, len=12175], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=1ms, checkpointLockHoldTime=2ms, walCpRecordFsyncDuration=4ms, writeCheckpointEntryDuration=2ms, splitAndSortCpPagesDuration=0ms, pages=10, reason='timeout'] [21:04:03]W: [org.apache.ignite:ignite-core] [2021-11-19 21:04:03,213][WARN ][tcp-disco-sock-reader-[d6d21d86 127.0.0.1:56377]-#329%encryption.EncryptedCacheCreateTest1%-#6581%encryption.EncryptedCacheCreateTest1%][TestTcpDiscoverySpi] Failed to shutdown socket [21:04:03]W: [org.apache.ignite:ignite-core] java.net.SocketException: Socket is closed [21:04:03]W: [org.apache.ignite:ignite-core] at java.net.Socket.shutdownOutput(Socket.java:1568) [21:04:03]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.close(IgniteUtils.java:4247) [21:04:03]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.discovery.tcp.ServerImpl$SocketReader.body(ServerImpl.java:7370) [21:04:03]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.IgniteSpiThread.run(IgniteSpiThread.java:58) [21:04:03] : [Step 4/5] [2021-11-19 21:04:03,215][INFO ][tcp-disco-sock-reader-[d6d21d86 127.0.0.1:56377]-#329%encryption.EncryptedCacheCreateTest1%-#6581%encryption.EncryptedCacheCreateTest1%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:56377, rmtPort=56377, rmtNodeId=d6d21d86-5751-4ef1-a3f0-af3b1c800000] [21:04:03] : [Step 4/5] [2021-11-19 21:04:03,217][INFO ][main][GridCacheProcessor] Stopped cache [cacheName=ignite-sys-cache] [21:04:03] : [Step 4/5] [2021-11-19 21:04:03,218][INFO ][main][GridCacheProcessor] Stopped cache [cacheName=encrypted] [21:04:03] : [Step 4/5] [2021-11-19 21:04:03,554][INFO ][main][FilePageStoreManager] Cleanup cache stores [total=4, left=0, cleanFiles=false] [21:04:03] : [Step 4/5] [2021-11-19 21:04:03,556][INFO ][main][GridDeploymentLocalStore] Removed undeployed class: GridDeployment [ts=1637345041860, depMode=SHARED, clsLdr=IsolatedClassLoader{roleName='test'}, clsLdrId=9381d593d71-472daf0f-5502-4c71-9b54-a6c6d7800001, userVer=0, loc=true, sampleClsName=org.apache.ignite.internal.processors.cache.distributed.dht.preloader.IgniteDhtPartitionCountersMap2, pendingUndeploy=false, undeployed=true, usage=0] [21:04:03] : [Step 4/5] [2021-11-19 21:04:03,563][INFO ][main][EncryptedCacheCreateTest1] [21:04:03] : [Step 4/5] [21:04:03] : [Step 4/5] >>> +------------------------------------------------------+ [21:04:03] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV stopped OK [21:04:03] : [Step 4/5] >>> +------------------------------------------------------+ [21:04:03] : [Step 4/5] >>> Ignite instance name: encryption.EncryptedCacheCreateTest1 [21:04:03] : [Step 4/5] >>> Grid uptime: 00:00:01.788 [21:04:03] : [Step 4/5] [21:04:03] : [Step 4/5] [21:04:03] : [Step 4/5] [21:04:03] >>> Stopping test class: EncryptedCacheCreateTest <<< [21:04:03] : [Step 4/5] [2021-11-19 21:04:03,695][INFO ][main][root] >>> Stopping test class: EncryptedCacheCreateTest <<< [21:04:03] : [Step 4/5] [21:04:03] >>> Starting test class: EncryptedCacheDestroyTest <<< [21:04:03] : [Step 4/5] [2021-11-19 21:04:03,695][INFO ][main][root] >>> Starting test class: EncryptedCacheDestroyTest <<< [21:04:03] : [Step 4/5] Running org.apache.ignite.internal.encryption.EncryptedCacheDestroyTest [21:04:03]i: [Step 4/5] ##teamcity[importData type='surefire' path='/opt/buildagent/temp/buildTmp/ignite-tools-junit-reports1777670380320881607/test-org.apache.ignite.testsuites.IgniteBasicWithPersistenceTestSuite1637345026964.xml'] [21:04:03] : [Step 4/5] Importing data from '/opt/buildagent/temp/buildTmp/ignite-tools-junit-reports1777670380320881607/test-org.apache.ignite.testsuites.IgniteBasicWithPersistenceTestSuite1637345026964.xml' (563 B) with 'surefire' processor [21:04:03] : [Step 4/5] [21:04:03] >>> Starting test: EncryptedCacheDestroyTest#testEncryptedCacheFromGroupDestroy <<< [21:04:03] : [Step 4/5] [2021-11-19 21:04:03,704][INFO ][main][root] >>> Starting test: EncryptedCacheDestroyTest#testEncryptedCacheFromGroupDestroy <<< [21:04:03] : [Step 4/5] [21:04:03] >>> Heap: 546 MB used / 1937 MB commited / 1937 MB max <<< [21:04:03] : [Step 4/5] [2021-11-19 21:04:03,705][INFO ][main][root] >>> Heap: 546 MB used / 1937 MB commited / 1937 MB max <<< [21:04:03] : [Step 4/5] [21:04:03] >>> Non-Heap: 132 MB used / 142 MB commited / 0 MB max <<< [21:04:03] : [Step 4/5] [2021-11-19 21:04:03,705][INFO ][main][root] >>> Non-Heap: 132 MB used / 142 MB commited / 0 MB max <<< [21:04:03]W: [org.apache.ignite:ignite-core] [2021-11-19 21:04:03,714][WARN ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][G] Ignite work directory is not provided, automatically resolved to: /opt/buildagent/work/7bc1c54bc719b67c/work [21:04:03] : [Step 4/5] [2021-11-19 21:04:03,717][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][IgniteKernal%grid-0] [21:04:03] : [Step 4/5] [21:04:03] : [Step 4/5] >>> __________ ________________ [21:04:03] : [Step 4/5] >>> / _/ ___/ |/ / _/_ __/ __/ [21:04:03] : [Step 4/5] >>> _/ // (7 7 // / / / / _/ [21:04:03] : [Step 4/5] >>> /___/\___/_/|_/___/ /_/ /___/ [21:04:03] : [Step 4/5] >>> [21:04:03] : [Step 4/5] >>> ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:04:03] : [Step 4/5] >>> 2021 Copyright(C) Apache Software Foundation [21:04:03] : [Step 4/5] >>> [21:04:03] : [Step 4/5] >>> Ignite documentation: http://ignite.apache.org [21:04:03] : [Step 4/5] [21:04:03] : [Step 4/5] [2021-11-19 21:04:03,718][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][IgniteKernal%grid-0] Config URL: n/a [21:04:03] : [Step 4/5] [2021-11-19 21:04:03,719][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][IgniteKernal%grid-0] IgniteConfiguration [igniteInstanceName=grid-0, pubPoolSize=24, svcPoolSize=24, callbackPoolSize=24, stripedPoolSize=24, sysPoolSize=24, mgmtPoolSize=4, dataStreamerPoolSize=24, utilityCachePoolSize=24, utilityCacheKeepAliveTime=60000, p2pPoolSize=2, qryPoolSize=24, buildIdxPoolSize=4, igniteHome=/opt/buildagent/work/7bc1c54bc719b67c, igniteWorkDir=/opt/buildagent/work/7bc1c54bc719b67c/work, mbeanSrv=com.sun.jmx.mbeanserver.JmxMBeanServer@6fe85038, nodeId=00ed1cf3-ba65-46ff-8221-046bb54a6000, marsh=BinaryMarshaller [], marshLocJobs=false, daemon=false, p2pEnabled=true, netTimeout=10000, netCompressionLevel=1, sndRetryDelay=1000, sndRetryCnt=3, metricsHistSize=10000, metricsUpdateFreq=1000, metricsExpTime=9223372036854775807, discoSpi=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=0, ackTimeout=0, marsh=null, reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], segPlc=STOP, segResolveAttempts=2, waitForSegOnStart=true, allResolversPassReq=true, segChkFreq=10000, commSpi=TcpCommunicationSpi [connectGate=org.apache.ignite.spi.communication.tcp.internal.ConnectGateway@c8ea08, ctxInitLatch=java.util.concurrent.CountDownLatch@64008ebd[Count = 1], stopping=false, clientPool=null, nioSrvWrapper=null, stateProvider=null], evtSpi=MemoryEventStorageSpi [expireAgeMs=9223372036854775807, expireCnt=10000, filter=null], colSpi=NoopCollisionSpi [], deploySpi=LocalDeploymentSpi [], indexingSpi=org.apache.ignite.spi.indexing.noop.NoopIndexingSpi@49806e91, addrRslvr=null, encryptionSpi=org.apache.ignite.spi.encryption.keystore.KeystoreEncryptionSpi@320e5d33, tracingSpi=org.apache.ignite.spi.tracing.NoopTracingSpi@e40663e, clientMode=false, rebalanceThreadPoolSize=4, rebalanceTimeout=10000, rebalanceBatchesPrefetchCnt=3, rebalanceThrottle=0, rebalanceBatchSize=524288, txCfg=TransactionConfiguration [txSerEnabled=false, dfltIsolation=REPEATABLE_READ, dfltConcurrency=PESSIMISTIC, dfltTxTimeout=0, txTimeoutOnPartitionMapExchange=0, deadlockTimeout=10000, pessimisticTxLogSize=0, pessimisticTxLogLinger=10000, tmLookupClsName=null, txManagerFactory=null, useJtaSync=false], cacheSanityCheckEnabled=true, discoStartupDelay=60000, deployMode=SHARED, p2pMissedCacheSize=100, locHost=127.0.0.1, timeSrvPortBase=31100, timeSrvPortRange=100, failureDetectionTimeout=10000, sysWorkerBlockedTimeout=null, clientFailureDetectionTimeout=10000, metricsLogFreq=0, connectorCfg=null, odbcCfg=null, warmupClos=null, atomicCfg=AtomicConfiguration [seqReserveSize=1000, cacheMode=PARTITIONED, backups=1, aff=null, grpName=null], classLdr=null, sslCtxFactory=null, platformCfg=null, binaryCfg=null, memCfg=null, pstCfg=null, dsCfg=DataStorageConfiguration [sysRegionInitSize=41943040, sysRegionMaxSize=104857600, pageSize=4096, concLvl=0, dfltDataRegConf=DataRegionConfiguration [name=default, maxSize=10485760, initSize=268435456, swapPath=null, pageEvictionMode=DISABLED, pageReplacementMode=CLOCK, evictionThreshold=0.9, emptyPagesPoolSize=100, metricsEnabled=false, metricsSubIntervalCount=5, metricsRateTimeInterval=60000, persistenceEnabled=true, checkpointPageBufSize=0, lazyMemoryAllocation=true, warmUpCfg=null], dataRegions=null, storagePath=null, checkpointFreq=180000, lockWaitTime=10000, checkpointThreads=4, checkpointWriteOrder=SEQUENTIAL, walHistSize=20, maxWalArchiveSize=1073741824, walSegments=10, walSegmentSize=67108864, walPath=db/wal, walArchivePath=db/wal/archive, cdcWalPath=db/wal/cdc, cdcEnabled=false, metricsEnabled=false, walMode=FSYNC, walTlbSize=131072, walBuffSize=0, walFlushFreq=2000, walFsyncDelay=1000, walRecordIterBuffSize=67108864, alwaysWriteFullPages=false, fileIOFactory=org.apache.ignite.internal.processors.cache.persistence.file.AsyncFileIOFactory@5e8fe424, metricsSubIntervalCnt=5, metricsRateTimeInterval=60000, walAutoArchiveAfterInactivity=-1, walForceArchiveTimeout=-1, writeThrottlingEnabled=false, walCompactionEnabled=false, walCompactionLevel=1, checkpointReadLockTimeout=null, walPageCompression=DISABLED, walPageCompressionLevel=null, dfltWarmUpCfg=null, encCfg=org.apache.ignite.configuration.EncryptionConfiguration@5bc72df3, defragmentationThreadPoolSize=4, minWalArchiveSize=-1], snapshotPath=snapshots, activeOnStart=true, activeOnStartPropSetFlag=false, autoActivation=true, autoActivationPropSetFlag=false, clusterStateOnStart=null, sqlConnCfg=null, cliConnCfg=ClientConnectorConfiguration [host=null, port=10800, portRange=100, sockSndBufSize=0, sockRcvBufSize=0, tcpNoDelay=true, maxOpenCursorsPerConn=128, threadPoolSize=24, selectorCnt=12, idleTimeout=0, handshakeTimeout=10000, jdbcEnabled=true, odbcEnabled=true, thinCliEnabled=true, sslEnabled=false, useIgniteSslCtxFactory=true, sslClientAuth=false, sslCtxFactory=null, thinCliCfg=ThinClientConfiguration [maxActiveTxPerConn=100, maxActiveComputeTasksPerConn=0]], mvccVacuumThreadCnt=2, mvccVacuumFreq=5000, authEnabled=false, failureHnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]], commFailureRslvr=null, sqlCfg=SqlConfiguration [longQryWarnTimeout=3000, dfltQryTimeout=0, sqlQryHistSize=1000, validationEnabled=false], asyncContinuationExecutor=null] [21:04:03] : [Step 4/5] [2021-11-19 21:04:03,727][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][IgniteKernal%grid-0] Daemon mode: off [21:04:03] : [Step 4/5] [2021-11-19 21:04:03,727][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][IgniteKernal%grid-0] OS: Linux 4.15.0-151-generic amd64 [21:04:03] : [Step 4/5] [2021-11-19 21:04:03,727][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][IgniteKernal%grid-0] OS user: teamcity [21:04:03] : [Step 4/5] [2021-11-19 21:04:03,727][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][IgniteKernal%grid-0] PID: 16724 [21:04:03] : [Step 4/5] [2021-11-19 21:04:03,728][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][IgniteKernal%grid-0] Language runtime: Java Platform API Specification ver. 1.8 [21:04:03] : [Step 4/5] [2021-11-19 21:04:03,728][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][IgniteKernal%grid-0] VM information: Java(TM) SE Runtime Environment 1.8.0_261-b12 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 25.261-b12 [21:04:03] : [Step 4/5] [2021-11-19 21:04:03,728][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][IgniteKernal%grid-0] VM total memory: 1.9GB [21:04:03] : [Step 4/5] [2021-11-19 21:04:03,728][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][IgniteKernal%grid-0] Remote Management [restart: off, REST: off, JMX (remote: off)] [21:04:03] : [Step 4/5] [2021-11-19 21:04:03,729][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][IgniteKernal%grid-0] Logger: GridTestLog4jLogger [quiet=false, config=null] [21:04:03] : [Step 4/5] [2021-11-19 21:04:03,729][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][IgniteKernal%grid-0] IGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c [21:04:03] : [Step 4/5] [2021-11-19 21:04:03,729][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][IgniteKernal%grid-0] VM arguments: [-DIGNITE_DUMP_THREADS_ON_FAILURE=false, -DMono=/usr/bin/mono-sgen, -DMono4.0_x64=/usr/lib/mono/4.0, -DMono4.5_x64=/usr/lib/mono/4.5, -DMonoVersion=6.12.0.90, -DSKIP_BUILD=false, -Dagent.home.dir=/opt/buildagent, -Dagent.name=aitc-lin02_03, -Dagent.ownPort=9090, -Dagent.work.dir=/opt/buildagent/work, -Dbuild.number=95, -Dbuild.vcs.number=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.1=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.GitHubApacheIgnite=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dclassworlds.conf=/opt/buildagent/temp/buildTmp/teamcity.m2.conf, -Dcom.jetbrains.maven.watcher.report.file=/opt/buildagent/temp/buildTmp/maven-build-info.xml, -Djava.io.tmpdir=/opt/buildagent/temp/buildTmp, -Dmaven.home=/opt/buildagent/tools/maven3_6, -Dmaven.multiModuleProjectDirectory=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.agent.cpuBenchmark=457, -Dteamcity.agent.dotnet.agent_url=http://localhost:9090/RPC2, -Dteamcity.agent.dotnet.build_id=6278078, -Dteamcity.auth.password=*******, -Dteamcity.auth.userId=TeamCityBuildId=6278078, -Dteamcity.build.changedFiles.file=/opt/buildagent/temp/buildTmp/changedFiles6342607772318147725.txt, -Dteamcity.build.checkoutDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.build.id=6278078, -Dteamcity.build.properties.file=/opt/buildagent/temp/buildTmp/teamcity.build5164517880467851002.properties, -Dteamcity.build.tempDir=/opt/buildagent/temp/buildTmp, -Dteamcity.build.workingDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.buildConfName=Basic 3, -Dteamcity.buildType.id=IgniteTests24Java8_Basic3, -Dteamcity.configuration.properties.file=/opt/buildagent/temp/buildTmp/teamcity.config5591980786735343870.properties, -Dteamcity.maven.userSettings.path=/opt/buildagent/temp/buildTmp/maven_settings_585072866407032347.xml, -Dteamcity.maven.watcher.home=/opt/buildagent/plugins/mavenPlugin/maven-watcher-jdk16, -Dteamcity.projectName=Ignite Tests 2.x (JDK 8/11), -Dteamcity.runner.properties.file=/opt/buildagent/temp/buildTmp/teamcity.runner9098465561618137420.properties, -Dteamcity.tests.recentlyFailedTests.file=/opt/buildagent/temp/buildTmp/testsToRunFirst3891775683130404069.txt, -Dteamcity.version=2021.2 (build 99542), -ea, -Xms2g, -Xmx2g, -XX:+HeapDumpOnOutOfMemoryError, -DIGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_TEST_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_UPDATE_NOTIFIER=false, -DIGNITE_NO_DISCO_ORDER=true, -DIGNITE_PERFORMANCE_SUGGESTIONS_DISABLED=true, -Djava.net.preferIPv4Stack=true, -DTEST_SCALE_FACTOR=1.0, -DIGNITE_TEST_PROP_LOG4J_FILE=log4j-tc-test.xml, -DIGNITE_QUIET=false, -DIGNITE_MARSHAL_BUFFERS_RECHECK=1000, -Dmaven.repo.local=/opt/buildagent/.m2/repository] [21:04:03] : [Step 4/5] [2021-11-19 21:04:03,733][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][IgniteKernal%grid-0] System cache's DataRegion size is configured to 40 MB. Use DataStorageConfiguration.systemRegionInitialSize property to change the setting. [21:04:03] : [Step 4/5] [2021-11-19 21:04:03,733][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][IgniteKernal%grid-0] Configured caches [in 'sysMemPlc' dataRegion: ['ignite-sys-cache']] [21:04:03] : [Step 4/5] [2021-11-19 21:04:03,733][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][IgniteKernal%grid-0] 3-rd party licenses can be found at: /opt/buildagent/work/7bc1c54bc719b67c/libs/licenses [21:04:03]W: [org.apache.ignite:ignite-core] [2021-11-19 21:04:03,733][WARN ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][IgniteKernal%grid-0] Peer class loading is enabled (disable it in production for performance and deployment consistency reasons) [21:04:03] : [Step 4/5] [2021-11-19 21:04:03,738][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][IgnitePluginProcessor] Configured plugins: [21:04:03] : [Step 4/5] [2021-11-19 21:04:03,738][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][IgnitePluginProcessor] ^-- StanByClusterTestProvider 1.0 [21:04:03] : [Step 4/5] [2021-11-19 21:04:03,739][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][IgnitePluginProcessor] ^-- null [21:04:03] : [Step 4/5] [2021-11-19 21:04:03,739][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][IgnitePluginProcessor] [21:04:03] : [Step 4/5] [2021-11-19 21:04:03,739][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][IgnitePluginProcessor] ^-- PageMemory tracker plugin 1.0 [21:04:03] : [Step 4/5] [2021-11-19 21:04:03,739][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][IgnitePluginProcessor] ^-- null [21:04:03] : [Step 4/5] [2021-11-19 21:04:03,740][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][IgnitePluginProcessor] [21:04:03] : [Step 4/5] [2021-11-19 21:04:03,740][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][IgnitePluginProcessor] ^-- TestDistibutedConfigurationPlugin 1.0 [21:04:03] : [Step 4/5] [2021-11-19 21:04:03,740][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][IgnitePluginProcessor] ^-- null [21:04:03] : [Step 4/5] [2021-11-19 21:04:03,741][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][IgnitePluginProcessor] [21:04:03] : [Step 4/5] [2021-11-19 21:04:03,741][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][IgnitePluginProcessor] ^-- NodeValidationPluginProvider 1.0 [21:04:03] : [Step 4/5] [2021-11-19 21:04:03,741][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][IgnitePluginProcessor] ^-- null [21:04:03] : [Step 4/5] [2021-11-19 21:04:03,741][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][IgnitePluginProcessor] [21:04:03] : [Step 4/5] [2021-11-19 21:04:03,742][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][FailureProcessor] Configured failure handler: [hnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]]] [21:04:03] : [Step 4/5] [2021-11-19 21:04:03,751][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][TcpCommunicationSpi] Successfully bound communication NIO server to TCP port [port=45130, locHost=/127.0.0.1, selectorsCnt=12, selectorSpins=0, pairedConn=false] [21:04:03]W: [org.apache.ignite:ignite-core] [2021-11-19 21:04:03,752][WARN ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][TcpCommunicationSpi] Message queue limit is set to 0 which may lead to potential OOMEs when running cache operations in FULL_ASYNC or PRIMARY_SYNC modes due to message queues growth on sender and receiver sides. [21:04:03] : [Step 4/5] [2021-11-19 21:04:03,756][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][GridCollisionManager] Collision resolution is disabled (all jobs will be activated upon arrival). [21:04:03] : [Step 4/5] [2021-11-19 21:04:03,756][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][IgniteKernal%grid-0] Security status [authentication=off, sandbox=off, tls/ssl=off] [21:04:03] : [Step 4/5] Surefire report watcher [21:04:03] : [Surefire report watcher] Watching paths: [21:04:03] : [Surefire report watcher] /opt/buildagent/temp/buildTmp/ignite-tools-junit-reports1777670380320881607/test-org.apache.ignite.testsuites.IgniteBasicWithPersistenceTestSuite1637345026964.xml [21:04:03]i: [Step 4/5] org.apache.ignite.testsuites.IgniteBasicWithPersistenceTestSuite [21:04:03]i: [org.apache.ignite.testsuites.IgniteBasicWithPersistenceTestSuite] org.apache.ignite.internal.encryption.EncryptedCacheCreateTest.testPersistedContentEncrypted [21:04:03]i: [org.apache.ignite.testsuites.IgniteBasicWithPersistenceTestSuite] org.apache.ignite.internal.encryption.EncryptedCacheCreateTest.testCreateEncryptedNotPersistedCacheFail [21:04:03]i: [org.apache.ignite.testsuites.IgniteBasicWithPersistenceTestSuite] org.apache.ignite.internal.encryption.EncryptedCacheCreateTest.testCreateEncryptedCache [21:04:03] : [Step 4/5] [2021-11-19 21:04:03,811][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:04:03] : [Step 4/5] [2021-11-19 21:04:03,897][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][MaintenanceProcessor] Resolved store directory for node persistent data: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0 [21:04:03] : [Step 4/5] [2021-11-19 21:04:03,899][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][CacheObjectBinaryProcessorImpl] Resolved directory for serialized binary metadata: /opt/buildagent/work/7bc1c54bc719b67c/work/db/binary_meta/grid_0 [21:04:03] : [Step 4/5] [2021-11-19 21:04:03,902][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0 [21:04:03] : [Step 4/5] [2021-11-19 21:04:03,903][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][FileWriteAheadLogManager] Resolved write ahead log work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0 [21:04:03] : [Step 4/5] [2021-11-19 21:04:03,903][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][FileWriteAheadLogManager] Resolved write ahead log archive directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0 [21:04:04] : [Step 4/5] [2021-11-19 21:04:04,273][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000000.wal [21:04:04]W: [org.apache.ignite:ignite-core] [2021-11-19 21:04:04,274][WARN ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][GridCacheDatabaseSharedManager] DataRegion maxSize=10.5 MB is smaller than defaultInitialSize=268.4 MB, setting initialSize to 10.5 MB [21:04:04] : [Step 4/5] [2021-11-19 21:04:04,282][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][GridCacheDatabaseSharedManager] Configured data regions initialized successfully [total=5] [21:04:04] : [Step 4/5] [2021-11-19 21:04:04,284][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][IgniteSnapshotManager] Resolved snapshot work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/snapshots [21:04:04] : [Step 4/5] [2021-11-19 21:04:04,284][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][IgniteSnapshotManager] Resolved temp directory for snapshot creation: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0/snp [21:04:04] : [Step 4/5] [2021-11-19 21:04:04,288][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][ClientListenerProcessor] Client connector processor has started on TCP port 10800 [21:04:04] : [Step 4/5] [2021-11-19 21:04:04,295][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][IgniteKernal%grid-0] Non-loopback local IPs: 172.17.0.4 [21:04:04] : [Step 4/5] [2021-11-19 21:04:04,295][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][IgniteKernal%grid-0] Enabled local MACs: 0242AC110004 [21:04:04] : [Step 4/5] [2021-11-19 21:04:04,297][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:04:04] : [Step 4/5] [2021-11-19 21:04:04,298][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:04:04] : [Step 4/5] [2021-11-19 21:04:04,299][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:04:04] : [Step 4/5] [2021-11-19 21:04:04,301][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][GridCacheDatabaseSharedManager] Applying lost metastore updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:04:04] : [Step 4/5] [2021-11-19 21:04:04,302][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=0 ms] [21:04:04] : [Step 4/5] [2021-11-19 21:04:04,302][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][GridCacheProcessor] Restoring partition state for local groups. [21:04:04] : [Step 4/5] [2021-11-19 21:04:04,302][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=0, partitionsProcessed=0, time=0ms] [21:04:04] : [Step 4/5] [2021-11-19 21:04:04,303][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][GridEncryptionManager] Encryption keys loaded from metastore. [grps=, masterKeyName=ignite.master.key] [21:04:04] : [Step 4/5] [2021-11-19 21:04:04,309][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][ClusterProcessor] Cluster ID and tag has been read from metastorage: null [21:04:04] : [Step 4/5] [2021-11-19 21:04:04,309][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][IgniteClusterImpl] Shutdown policy was updated [oldVal=null, newVal=null] [21:04:04] : [Step 4/5] [2021-11-19 21:04:04,310][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][GridCacheDatabaseSharedManager] Checkpoint frequency deviation changed [oldVal=null, newVal=null] [21:04:04] : [Step 4/5] [2021-11-19 21:04:04,319][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][FilePageStoreManager] Cleanup cache stores [total=1, left=0, cleanFiles=false] [21:04:04] : [Step 4/5] [2021-11-19 21:04:04,323][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:04:04] : [Step 4/5] [2021-11-19 21:04:04,324][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:04:04] : [Step 4/5] [2021-11-19 21:04:04,326][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:04:04] : [Step 4/5] [2021-11-19 21:04:04,326][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][GridCacheDatabaseSharedManager] Data Regions Started: 5 [21:04:04] : [Step 4/5] [2021-11-19 21:04:04,327][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][GridCacheDatabaseSharedManager] ^-- sysMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:04:04] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:04:04] : [Step 4/5] ^-- default region [type=default, persistence=true, lazyAlloc=true, [21:04:04] : [Step 4/5] ... initCfg=10MB, maxCfg=10MB, usedRam=0MB, freeRam=100%, allocRam=0MB, allocTotal=0MB] [21:04:04] : [Step 4/5] ^-- metastoreMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:04:04] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:04:04] : [Step 4/5] ^-- TxLog region [type=internal, persistence=true, lazyAlloc=false, [21:04:04] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:04:04] : [Step 4/5] ^-- volatileDsMemPlc region [type=user, persistence=false, lazyAlloc=true, [21:04:04] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB] [21:04:04] : [Step 4/5] ^-- Ignite persistence [used=0MB] [21:04:04] : [Step 4/5] [21:04:04] : [Step 4/5] [2021-11-19 21:04:04,329][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][GridCacheDatabaseSharedManager] Starting binary memory restore for: [-2100569601] [21:04:04] : [Step 4/5] [2021-11-19 21:04:04,339][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:04:04] : [Step 4/5] [2021-11-19 21:04:04,339][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:04:04] : [Step 4/5] [2021-11-19 21:04:04,342][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000000.wal, offset=0, ver=2] [21:04:04] : [Step 4/5] [2021-11-19 21:04:04,346][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][GridCacheProcessor] Started cache in recovery mode [name=ignite-sys-cache, id=-2100569601, dataRegionName=sysMemPlc, mode=REPLICATED, atomicity=TRANSACTIONAL, backups=2147483647, mvcc=false] [21:04:04] : [Step 4/5] [2021-11-19 21:04:04,347][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][GridCacheDatabaseSharedManager] Binary recovery performed in 18 ms. [21:04:04] : [Step 4/5] [2021-11-19 21:04:04,347][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:04:04] : [Step 4/5] [2021-11-19 21:04:04,347][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][GridCacheDatabaseSharedManager] Applying lost cache updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:04:04] : [Step 4/5] [2021-11-19 21:04:04,431][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=81 ms] [21:04:04] : [Step 4/5] [2021-11-19 21:04:04,431][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][GridCacheProcessor] Restoring partition state for local groups. [21:04:04] : [Step 4/5] [2021-11-19 21:04:04,455][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=1, partitionsProcessed=100, time=20ms] [21:04:04] : [Step 4/5] [2021-11-19 21:04:04,732][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][TestTcpDiscoverySpi] Successfully bound to TCP port [port=47500, localHost=localhost/127.0.0.1, locNodeId=00ed1cf3-ba65-46ff-8221-046bb54a6000] [21:04:04] : [Step 4/5] [2021-11-19 21:04:04,744][INFO ][disco-notifier-worker-#6729%grid-0%][MvccProcessorImpl] Assigned mvcc coordinator [crd=MvccCoordinator [topVer=AffinityTopologyVersion [topVer=1, minorTopVer=0], nodeId=00ed1cf3-ba65-46ff-8221-046bb54a6000, ver=1637345044739, local=true, initialized=false]] [21:04:04] : [Step 4/5] [2021-11-19 21:04:04,745][INFO ][sys-#6728%grid-0%][ClusterProcessor] Writing cluster ID and tag to metastorage on ready for write ClusterIdAndTag [id=e59705b4-217a-49b7-8688-11f7b94dd438, tag=pensive_kilby] [21:04:04] : [Step 4/5] [2021-11-19 21:04:04,748][INFO ][disco-notifier-worker-#6729%grid-0%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustEnabled' was changed from 'null' to 'false' [21:04:04] : [Step 4/5] [2021-11-19 21:04:04,750][INFO ][disco-notifier-worker-#6729%grid-0%][ClusterProcessor] pensive_kilby [21:04:04] : [Step 4/5] [2021-11-19 21:04:04,751][INFO ][disco-notifier-worker-#6729%grid-0%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustTimeout' was changed from 'null' to '300000' [21:04:04] : [Step 4/5] [2021-11-19 21:04:04,751][INFO ][disco-notifier-worker-#6729%grid-0%][IgniteTxManager] Transactions parameter 'longOperationsDumpTimeout' was changed from 'null' to '60000' [21:04:04] : [Step 4/5] [2021-11-19 21:04:04,752][INFO ][disco-notifier-worker-#6729%grid-0%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpThreshold' was changed from 'null' to '0' [21:04:04] : [Step 4/5] [2021-11-19 21:04:04,753][INFO ][disco-notifier-worker-#6729%grid-0%][IgniteTxManager] Transactions parameter 'transactionTimeDumpSamplesCoefficient' was changed from 'null' to '0.0' [21:04:04] : [Step 4/5] [2021-11-19 21:04:04,753][INFO ][disco-notifier-worker-#6729%grid-0%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpSamplesPerSecondLimit' was changed from 'null' to '5' [21:04:04] : [Step 4/5] [2021-11-19 21:04:04,754][INFO ][disco-notifier-worker-#6729%grid-0%][IgniteTxManager] Transactions parameter 'collisionsDumpInterval' was changed from 'null' to '1000' [21:04:04] : [Step 4/5] [2021-11-19 21:04:04,755][INFO ][disco-notifier-worker-#6729%grid-0%][IgniteTxManager] Transactions parameter 'txOwnerDumpRequestsAllowed' was changed from 'null' to 'true' [21:04:04] : [Step 4/5] [2021-11-19 21:04:04,755][INFO ][disco-notifier-worker-#6729%grid-0%][GridCacheDatabaseSharedManager] Historical rebalance WAL threshold changed [property=historical.rebalance.threshold, oldVal=null, newVal=500] [21:04:04] : [Step 4/5] [2021-11-19 21:04:04,759][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][IgniteKernal%grid-0] To start Console Management & Monitoring run ignitevisorcmd.{sh|bat} [21:04:04] : [Step 4/5] [2021-11-19 21:04:04,759][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][IgniteKernal%grid-0] [21:04:04] : [Step 4/5] [21:04:04] : [Step 4/5] >>> +-------------------------------------------+ [21:04:04] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:04:04] : [Step 4/5] >>> +-------------------------------------------+ [21:04:04] : [Step 4/5] >>> OS name: Linux 4.15.0-151-generic amd64 [21:04:04] : [Step 4/5] >>> CPU(s): 24 [21:04:04] : [Step 4/5] >>> Heap: 2.0GB [21:04:04] : [Step 4/5] >>> VM name: 16724@c4dfe9a430b2 [21:04:04] : [Step 4/5] >>> Ignite instance name: grid-0 [21:04:04] : [Step 4/5] >>> Local node [ID=00ED1CF3-BA65-46FF-8221-046BB54A6000, order=1, clientMode=false] [21:04:04] : [Step 4/5] >>> Local node addresses: [127.0.0.1] [21:04:04] : [Step 4/5] >>> Local ports: TCP:10800 TCP:45130 TCP:47500 [21:04:04] : [Step 4/5] [21:04:04] : [Step 4/5] [2021-11-19 21:04:04,760][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][IgniteKernal%grid-0] >>> Ignite cluster is in INACTIVE state (limited functionality available). Use control.(sh|bat) script or IgniteCluster.state(ClusterState.ACTIVE) to change the state. [21:04:04] : [Step 4/5] [2021-11-19 21:04:04,761][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][GridDiscoveryManager] Topology snapshot [ver=1, locNode=00ed1cf3, servers=1, clients=0, state=INACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=00ed1cf3-ba65-46ff-8221-046bb54a6000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:04:04] : [Step 4/5] [2021-11-19 21:04:04,762][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][G] Node started : [stage="Configure system pool" (0 ms),stage="Start managers" (182 ms),stage="Configure binary metadata" (1 ms),stage="Start processors" (393 ms),stage="Start 'StanByClusterTestProvider' plugin" (0 ms),stage="Start 'PageMemory tracker plugin' plugin" (0 ms),stage="Start 'TestDistibutedConfigurationPlugin' plugin" (0 ms),stage="Start 'NodeValidationPluginProvider' plugin" (0 ms),stage="Init metastore" (25 ms),stage="Init and start regions" (9 ms),stage="Restore binary memory" (18 ms),stage="Restore logical state" (108 ms),stage="Finish recovery" (275 ms),stage="Join topology" (12 ms),stage="Await transition" (1 ms),stage="Await exchange" (16 ms),stage="Total time" (1040 ms)] [21:04:04] : [Step 4/5] [2021-11-19 21:04:04,763][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][root] Node started with the following configuration [id=00ed1cf3-ba65-46ff-8221-046bb54a6000, marshaller=BinaryMarshaller [], discovery=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=5000, ackTimeout=5000, marsh=JdkMarshaller [clsFilter=org.apache.ignite.marshaller.MarshallerUtils$1@5ae0db98], reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], binaryCfg=null, lateAff=true] [21:04:04]W: [org.apache.ignite:ignite-core] [2021-11-19 21:04:04,769][WARN ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][G] Ignite work directory is not provided, automatically resolved to: /opt/buildagent/work/7bc1c54bc719b67c/work [21:04:04] : [Step 4/5] [2021-11-19 21:04:04,771][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][IgniteKernal%grid-1] [21:04:04] : [Step 4/5] [21:04:04] : [Step 4/5] >>> __________ ________________ [21:04:04] : [Step 4/5] >>> / _/ ___/ |/ / _/_ __/ __/ [21:04:04] : [Step 4/5] >>> _/ // (7 7 // / / / / _/ [21:04:04] : [Step 4/5] >>> /___/\___/_/|_/___/ /_/ /___/ [21:04:04] : [Step 4/5] >>> [21:04:04] : [Step 4/5] >>> ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:04:04] : [Step 4/5] >>> 2021 Copyright(C) Apache Software Foundation [21:04:04] : [Step 4/5] >>> [21:04:04] : [Step 4/5] >>> Ignite documentation: http://ignite.apache.org [21:04:04] : [Step 4/5] [21:04:04] : [Step 4/5] [2021-11-19 21:04:04,772][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][IgniteKernal%grid-1] Config URL: n/a [21:04:04] : [Step 4/5] [2021-11-19 21:04:04,772][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][IgniteKernal%grid-1] IgniteConfiguration [igniteInstanceName=grid-1, pubPoolSize=24, svcPoolSize=24, callbackPoolSize=24, stripedPoolSize=24, sysPoolSize=24, mgmtPoolSize=4, dataStreamerPoolSize=24, utilityCachePoolSize=24, utilityCacheKeepAliveTime=60000, p2pPoolSize=2, qryPoolSize=24, buildIdxPoolSize=4, igniteHome=/opt/buildagent/work/7bc1c54bc719b67c, igniteWorkDir=/opt/buildagent/work/7bc1c54bc719b67c/work, mbeanSrv=com.sun.jmx.mbeanserver.JmxMBeanServer@6fe85038, nodeId=1004a77b-058d-4a31-997a-ec25d357f001, marsh=BinaryMarshaller [], marshLocJobs=false, daemon=false, p2pEnabled=true, netTimeout=10000, netCompressionLevel=1, sndRetryDelay=1000, sndRetryCnt=3, metricsHistSize=10000, metricsUpdateFreq=1000, metricsExpTime=9223372036854775807, discoSpi=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=0, ackTimeout=0, marsh=null, reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], segPlc=STOP, segResolveAttempts=2, waitForSegOnStart=true, allResolversPassReq=true, segChkFreq=10000, commSpi=TcpCommunicationSpi [connectGate=org.apache.ignite.spi.communication.tcp.internal.ConnectGateway@5c64bba9, ctxInitLatch=java.util.concurrent.CountDownLatch@2cdacc50[Count = 1], stopping=false, clientPool=null, nioSrvWrapper=null, stateProvider=null], evtSpi=MemoryEventStorageSpi [expireAgeMs=9223372036854775807, expireCnt=10000, filter=null], colSpi=NoopCollisionSpi [], deploySpi=LocalDeploymentSpi [], indexingSpi=org.apache.ignite.spi.indexing.noop.NoopIndexingSpi@3a65d88a, addrRslvr=null, encryptionSpi=org.apache.ignite.spi.encryption.keystore.KeystoreEncryptionSpi@4f6d2610, tracingSpi=org.apache.ignite.spi.tracing.NoopTracingSpi@4d474e40, clientMode=false, rebalanceThreadPoolSize=4, rebalanceTimeout=10000, rebalanceBatchesPrefetchCnt=3, rebalanceThrottle=0, rebalanceBatchSize=524288, txCfg=TransactionConfiguration [txSerEnabled=false, dfltIsolation=REPEATABLE_READ, dfltConcurrency=PESSIMISTIC, dfltTxTimeout=0, txTimeoutOnPartitionMapExchange=0, deadlockTimeout=10000, pessimisticTxLogSize=0, pessimisticTxLogLinger=10000, tmLookupClsName=null, txManagerFactory=null, useJtaSync=false], cacheSanityCheckEnabled=true, discoStartupDelay=60000, deployMode=SHARED, p2pMissedCacheSize=100, locHost=127.0.0.1, timeSrvPortBase=31100, timeSrvPortRange=100, failureDetectionTimeout=10000, sysWorkerBlockedTimeout=null, clientFailureDetectionTimeout=10000, metricsLogFreq=0, connectorCfg=null, odbcCfg=null, warmupClos=null, atomicCfg=AtomicConfiguration [seqReserveSize=1000, cacheMode=PARTITIONED, backups=1, aff=null, grpName=null], classLdr=null, sslCtxFactory=null, platformCfg=null, binaryCfg=null, memCfg=null, pstCfg=null, dsCfg=DataStorageConfiguration [sysRegionInitSize=41943040, sysRegionMaxSize=104857600, pageSize=4096, concLvl=0, dfltDataRegConf=DataRegionConfiguration [name=default, maxSize=10485760, initSize=268435456, swapPath=null, pageEvictionMode=DISABLED, pageReplacementMode=CLOCK, evictionThreshold=0.9, emptyPagesPoolSize=100, metricsEnabled=false, metricsSubIntervalCount=5, metricsRateTimeInterval=60000, persistenceEnabled=true, checkpointPageBufSize=0, lazyMemoryAllocation=true, warmUpCfg=null], dataRegions=null, storagePath=null, checkpointFreq=180000, lockWaitTime=10000, checkpointThreads=4, checkpointWriteOrder=SEQUENTIAL, walHistSize=20, maxWalArchiveSize=1073741824, walSegments=10, walSegmentSize=67108864, walPath=db/wal, walArchivePath=db/wal/archive, cdcWalPath=db/wal/cdc, cdcEnabled=false, metricsEnabled=false, walMode=FSYNC, walTlbSize=131072, walBuffSize=0, walFlushFreq=2000, walFsyncDelay=1000, walRecordIterBuffSize=67108864, alwaysWriteFullPages=false, fileIOFactory=org.apache.ignite.internal.processors.cache.persistence.file.AsyncFileIOFactory@57aea7e6, metricsSubIntervalCnt=5, metricsRateTimeInterval=60000, walAutoArchiveAfterInactivity=-1, walForceArchiveTimeout=-1, writeThrottlingEnabled=false, walCompactionEnabled=false, walCompactionLevel=1, checkpointReadLockTimeout=null, walPageCompression=DISABLED, walPageCompressionLevel=null, dfltWarmUpCfg=null, encCfg=org.apache.ignite.configuration.EncryptionConfiguration@283d6a84, defragmentationThreadPoolSize=4, minWalArchiveSize=-1], snapshotPath=snapshots, activeOnStart=true, activeOnStartPropSetFlag=false, autoActivation=true, autoActivationPropSetFlag=false, clusterStateOnStart=null, sqlConnCfg=null, cliConnCfg=ClientConnectorConfiguration [host=null, port=10800, portRange=100, sockSndBufSize=0, sockRcvBufSize=0, tcpNoDelay=true, maxOpenCursorsPerConn=128, threadPoolSize=24, selectorCnt=12, idleTimeout=0, handshakeTimeout=10000, jdbcEnabled=true, odbcEnabled=true, thinCliEnabled=true, sslEnabled=false, useIgniteSslCtxFactory=true, sslClientAuth=false, sslCtxFactory=null, thinCliCfg=ThinClientConfiguration [maxActiveTxPerConn=100, maxActiveComputeTasksPerConn=0]], mvccVacuumThreadCnt=2, mvccVacuumFreq=5000, authEnabled=false, failureHnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]], commFailureRslvr=null, sqlCfg=SqlConfiguration [longQryWarnTimeout=3000, dfltQryTimeout=0, sqlQryHistSize=1000, validationEnabled=false], asyncContinuationExecutor=null] [21:04:04] : [Step 4/5] [2021-11-19 21:04:04,780][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][IgniteKernal%grid-1] Daemon mode: off [21:04:04] : [Step 4/5] [2021-11-19 21:04:04,780][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][IgniteKernal%grid-1] OS: Linux 4.15.0-151-generic amd64 [21:04:04] : [Step 4/5] [2021-11-19 21:04:04,780][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][IgniteKernal%grid-1] OS user: teamcity [21:04:04] : [Step 4/5] [2021-11-19 21:04:04,781][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][IgniteKernal%grid-1] PID: 16724 [21:04:04] : [Step 4/5] [2021-11-19 21:04:04,781][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][IgniteKernal%grid-1] Language runtime: Java Platform API Specification ver. 1.8 [21:04:04] : [Step 4/5] [2021-11-19 21:04:04,781][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][IgniteKernal%grid-1] VM information: Java(TM) SE Runtime Environment 1.8.0_261-b12 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 25.261-b12 [21:04:04] : [Step 4/5] [2021-11-19 21:04:04,781][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][IgniteKernal%grid-1] VM total memory: 1.9GB [21:04:04] : [Step 4/5] [2021-11-19 21:04:04,782][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][IgniteKernal%grid-1] Remote Management [restart: off, REST: off, JMX (remote: off)] [21:04:04] : [Step 4/5] [2021-11-19 21:04:04,782][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][IgniteKernal%grid-1] Logger: GridTestLog4jLogger [quiet=false, config=null] [21:04:04] : [Step 4/5] [2021-11-19 21:04:04,782][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][IgniteKernal%grid-1] IGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c [21:04:04] : [Step 4/5] [2021-11-19 21:04:04,782][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][IgniteKernal%grid-1] VM arguments: [-DIGNITE_DUMP_THREADS_ON_FAILURE=false, -DMono=/usr/bin/mono-sgen, -DMono4.0_x64=/usr/lib/mono/4.0, -DMono4.5_x64=/usr/lib/mono/4.5, -DMonoVersion=6.12.0.90, -DSKIP_BUILD=false, -Dagent.home.dir=/opt/buildagent, -Dagent.name=aitc-lin02_03, -Dagent.ownPort=9090, -Dagent.work.dir=/opt/buildagent/work, -Dbuild.number=95, -Dbuild.vcs.number=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.1=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.GitHubApacheIgnite=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dclassworlds.conf=/opt/buildagent/temp/buildTmp/teamcity.m2.conf, -Dcom.jetbrains.maven.watcher.report.file=/opt/buildagent/temp/buildTmp/maven-build-info.xml, -Djava.io.tmpdir=/opt/buildagent/temp/buildTmp, -Dmaven.home=/opt/buildagent/tools/maven3_6, -Dmaven.multiModuleProjectDirectory=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.agent.cpuBenchmark=457, -Dteamcity.agent.dotnet.agent_url=http://localhost:9090/RPC2, -Dteamcity.agent.dotnet.build_id=6278078, -Dteamcity.auth.password=*******, -Dteamcity.auth.userId=TeamCityBuildId=6278078, -Dteamcity.build.changedFiles.file=/opt/buildagent/temp/buildTmp/changedFiles6342607772318147725.txt, -Dteamcity.build.checkoutDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.build.id=6278078, -Dteamcity.build.properties.file=/opt/buildagent/temp/buildTmp/teamcity.build5164517880467851002.properties, -Dteamcity.build.tempDir=/opt/buildagent/temp/buildTmp, -Dteamcity.build.workingDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.buildConfName=Basic 3, -Dteamcity.buildType.id=IgniteTests24Java8_Basic3, -Dteamcity.configuration.properties.file=/opt/buildagent/temp/buildTmp/teamcity.config5591980786735343870.properties, -Dteamcity.maven.userSettings.path=/opt/buildagent/temp/buildTmp/maven_settings_585072866407032347.xml, -Dteamcity.maven.watcher.home=/opt/buildagent/plugins/mavenPlugin/maven-watcher-jdk16, -Dteamcity.projectName=Ignite Tests 2.x (JDK 8/11), -Dteamcity.runner.properties.file=/opt/buildagent/temp/buildTmp/teamcity.runner9098465561618137420.properties, -Dteamcity.tests.recentlyFailedTests.file=/opt/buildagent/temp/buildTmp/testsToRunFirst3891775683130404069.txt, -Dteamcity.version=2021.2 (build 99542), -ea, -Xms2g, -Xmx2g, -XX:+HeapDumpOnOutOfMemoryError, -DIGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_TEST_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_UPDATE_NOTIFIER=false, -DIGNITE_NO_DISCO_ORDER=true, -DIGNITE_PERFORMANCE_SUGGESTIONS_DISABLED=true, -Djava.net.preferIPv4Stack=true, -DTEST_SCALE_FACTOR=1.0, -DIGNITE_TEST_PROP_LOG4J_FILE=log4j-tc-test.xml, -DIGNITE_QUIET=false, -DIGNITE_MARSHAL_BUFFERS_RECHECK=1000, -Dmaven.repo.local=/opt/buildagent/.m2/repository] [21:04:04] : [Step 4/5] [2021-11-19 21:04:04,786][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][IgniteKernal%grid-1] System cache's DataRegion size is configured to 40 MB. Use DataStorageConfiguration.systemRegionInitialSize property to change the setting. [21:04:04] : [Step 4/5] [2021-11-19 21:04:04,786][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][IgniteKernal%grid-1] Configured caches [in 'sysMemPlc' dataRegion: ['ignite-sys-cache']] [21:04:04]W: [org.apache.ignite:ignite-core] [2021-11-19 21:04:04,787][WARN ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][IgniteKernal%grid-1] Peer class loading is enabled (disable it in production for performance and deployment consistency reasons) [21:04:04] : [Step 4/5] [2021-11-19 21:04:04,787][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][IgniteKernal%grid-1] 3-rd party licenses can be found at: /opt/buildagent/work/7bc1c54bc719b67c/libs/licenses [21:04:04] : [Step 4/5] [2021-11-19 21:04:04,791][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][IgnitePluginProcessor] Configured plugins: [21:04:04] : [Step 4/5] [2021-11-19 21:04:04,791][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][IgnitePluginProcessor] ^-- StanByClusterTestProvider 1.0 [21:04:04] : [Step 4/5] [2021-11-19 21:04:04,792][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][IgnitePluginProcessor] ^-- null [21:04:04] : [Step 4/5] [2021-11-19 21:04:04,792][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][IgnitePluginProcessor] [21:04:04] : [Step 4/5] [2021-11-19 21:04:04,792][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][IgnitePluginProcessor] ^-- PageMemory tracker plugin 1.0 [21:04:04] : [Step 4/5] [2021-11-19 21:04:04,792][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][IgnitePluginProcessor] ^-- null [21:04:04] : [Step 4/5] [2021-11-19 21:04:04,793][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][IgnitePluginProcessor] [21:04:04] : [Step 4/5] [2021-11-19 21:04:04,793][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][IgnitePluginProcessor] ^-- TestDistibutedConfigurationPlugin 1.0 [21:04:04] : [Step 4/5] [2021-11-19 21:04:04,793][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][IgnitePluginProcessor] ^-- null [21:04:04] : [Step 4/5] [2021-11-19 21:04:04,793][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][IgnitePluginProcessor] [21:04:04] : [Step 4/5] [2021-11-19 21:04:04,794][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][IgnitePluginProcessor] ^-- NodeValidationPluginProvider 1.0 [21:04:04] : [Step 4/5] [2021-11-19 21:04:04,794][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][IgnitePluginProcessor] ^-- null [21:04:04] : [Step 4/5] [2021-11-19 21:04:04,794][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][IgnitePluginProcessor] [21:04:04] : [Step 4/5] [2021-11-19 21:04:04,795][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][FailureProcessor] Configured failure handler: [hnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]]] [21:04:04]W: [org.apache.ignite:ignite-core] [2021-11-19 21:04:04,808][WARN ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][TcpCommunicationSpi] Message queue limit is set to 0 which may lead to potential OOMEs when running cache operations in FULL_ASYNC or PRIMARY_SYNC modes due to message queues growth on sender and receiver sides. [21:04:04] : [Step 4/5] [2021-11-19 21:04:04,808][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][TcpCommunicationSpi] Successfully bound communication NIO server to TCP port [port=45131, locHost=/127.0.0.1, selectorsCnt=12, selectorSpins=0, pairedConn=false] [21:04:04] : [Step 4/5] [2021-11-19 21:04:04,812][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][GridCollisionManager] Collision resolution is disabled (all jobs will be activated upon arrival). [21:04:04] : [Step 4/5] [2021-11-19 21:04:04,813][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][IgniteKernal%grid-1] Security status [authentication=off, sandbox=off, tls/ssl=off] [21:04:04] : [Step 4/5] [2021-11-19 21:04:04,867][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:04:04] : [Step 4/5] [2021-11-19 21:04:04,952][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][MaintenanceProcessor] Resolved store directory for node persistent data: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1 [21:04:04] : [Step 4/5] [2021-11-19 21:04:04,953][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][CacheObjectBinaryProcessorImpl] Resolved directory for serialized binary metadata: /opt/buildagent/work/7bc1c54bc719b67c/work/db/binary_meta/grid_1 [21:04:04] : [Step 4/5] [2021-11-19 21:04:04,957][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1 [21:04:04] : [Step 4/5] [2021-11-19 21:04:04,957][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][FileWriteAheadLogManager] Resolved write ahead log work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1 [21:04:04] : [Step 4/5] [2021-11-19 21:04:04,958][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][FileWriteAheadLogManager] Resolved write ahead log archive directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1 [21:04:05] : [Step 4/5] [2021-11-19 21:04:05,328][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000000.wal [21:04:05] : [Step 4/5] [2021-11-19 21:04:05,336][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][GridCacheDatabaseSharedManager] Configured data regions initialized successfully [total=5] [21:04:05] : [Step 4/5] [2021-11-19 21:04:05,338][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][IgniteSnapshotManager] Resolved snapshot work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/snapshots [21:04:05] : [Step 4/5] [2021-11-19 21:04:05,339][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][IgniteSnapshotManager] Resolved temp directory for snapshot creation: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1/snp [21:04:05] : [Step 4/5] [2021-11-19 21:04:05,342][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][ClientListenerProcessor] Client connector processor has started on TCP port 10801 [21:04:05] : [Step 4/5] [2021-11-19 21:04:05,345][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][IgniteKernal%grid-1] Non-loopback local IPs: 172.17.0.4 [21:04:05] : [Step 4/5] [2021-11-19 21:04:05,345][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][IgniteKernal%grid-1] Enabled local MACs: 0242AC110004 [21:04:05] : [Step 4/5] [2021-11-19 21:04:05,346][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:04:05] : [Step 4/5] [2021-11-19 21:04:05,348][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:04:05] : [Step 4/5] [2021-11-19 21:04:05,348][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:04:05] : [Step 4/5] [2021-11-19 21:04:05,351][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][GridCacheDatabaseSharedManager] Applying lost metastore updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:04:05] : [Step 4/5] [2021-11-19 21:04:05,352][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=0 ms] [21:04:05] : [Step 4/5] [2021-11-19 21:04:05,352][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][GridCacheProcessor] Restoring partition state for local groups. [21:04:05] : [Step 4/5] [2021-11-19 21:04:05,352][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=0, partitionsProcessed=0, time=0ms] [21:04:05] : [Step 4/5] [2021-11-19 21:04:05,353][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][GridEncryptionManager] Encryption keys loaded from metastore. [grps=, masterKeyName=ignite.master.key] [21:04:05] : [Step 4/5] [2021-11-19 21:04:05,354][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][ClusterProcessor] Cluster ID and tag has been read from metastorage: null [21:04:05] : [Step 4/5] [2021-11-19 21:04:05,355][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][IgniteClusterImpl] Shutdown policy was updated [oldVal=null, newVal=null] [21:04:05] : [Step 4/5] [2021-11-19 21:04:05,355][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][GridCacheDatabaseSharedManager] Checkpoint frequency deviation changed [oldVal=null, newVal=null] [21:04:05] : [Step 4/5] [2021-11-19 21:04:05,365][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][FilePageStoreManager] Cleanup cache stores [total=1, left=0, cleanFiles=false] [21:04:05] : [Step 4/5] [2021-11-19 21:04:05,368][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:04:05] : [Step 4/5] [2021-11-19 21:04:05,368][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:04:05] : [Step 4/5] [2021-11-19 21:04:05,370][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:04:05] : [Step 4/5] [2021-11-19 21:04:05,370][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][GridCacheDatabaseSharedManager] Data Regions Started: 5 [21:04:05] : [Step 4/5] [2021-11-19 21:04:05,371][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][GridCacheDatabaseSharedManager] ^-- sysMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:04:05] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:04:05] : [Step 4/5] ^-- default region [type=default, persistence=true, lazyAlloc=true, [21:04:05] : [Step 4/5] ... initCfg=10MB, maxCfg=10MB, usedRam=0MB, freeRam=100%, allocRam=0MB, allocTotal=0MB] [21:04:05] : [Step 4/5] ^-- metastoreMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:04:05] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:04:05] : [Step 4/5] ^-- TxLog region [type=internal, persistence=true, lazyAlloc=false, [21:04:05] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:04:05] : [Step 4/5] ^-- volatileDsMemPlc region [type=user, persistence=false, lazyAlloc=true, [21:04:05] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB] [21:04:05] : [Step 4/5] ^-- Ignite persistence [used=0MB] [21:04:05] : [Step 4/5] [21:04:05] : [Step 4/5] [2021-11-19 21:04:05,372][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][GridCacheDatabaseSharedManager] Starting binary memory restore for: [-2100569601] [21:04:05] : [Step 4/5] [2021-11-19 21:04:05,380][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:04:05] : [Step 4/5] [2021-11-19 21:04:05,380][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:04:05] : [Step 4/5] [2021-11-19 21:04:05,381][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000000.wal, offset=0, ver=2] [21:04:05] : [Step 4/5] [2021-11-19 21:04:05,386][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][GridCacheProcessor] Started cache in recovery mode [name=ignite-sys-cache, id=-2100569601, dataRegionName=sysMemPlc, mode=REPLICATED, atomicity=TRANSACTIONAL, backups=2147483647, mvcc=false] [21:04:05] : [Step 4/5] [2021-11-19 21:04:05,387][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][GridCacheDatabaseSharedManager] Binary recovery performed in 15 ms. [21:04:05] : [Step 4/5] [2021-11-19 21:04:05,387][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:04:05] : [Step 4/5] [2021-11-19 21:04:05,388][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][GridCacheDatabaseSharedManager] Applying lost cache updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:04:05] : [Step 4/5] [2021-11-19 21:04:05,461][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=70 ms] [21:04:05] : [Step 4/5] [2021-11-19 21:04:05,462][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][GridCacheProcessor] Restoring partition state for local groups. [21:04:05] : [Step 4/5] [2021-11-19 21:04:05,467][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=1, partitionsProcessed=100, time=10ms] [21:04:05] : [Step 4/5] [2021-11-19 21:04:05,761][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][TestTcpDiscoverySpi] Successfully bound to TCP port [port=47501, localHost=localhost/127.0.0.1, locNodeId=1004a77b-058d-4a31-997a-ec25d357f001] [21:04:05] : [Step 4/5] [2021-11-19 21:04:05,764][INFO ][tcp-disco-srvr-[:47500]-#335%grid-0%-#6731%grid-0%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=46555] [21:04:05] : [Step 4/5] [2021-11-19 21:04:05,764][INFO ][tcp-disco-srvr-[:47500]-#335%grid-0%-#6731%grid-0%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=46555] [21:04:05] : [Step 4/5] [2021-11-19 21:04:05,765][INFO ][tcp-disco-sock-reader-[]-#341%grid-0%-#6850%grid-0%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:46555, rmtPort=46555] [21:04:05] : [Step 4/5] [2021-11-19 21:04:05,767][INFO ][tcp-disco-sock-reader-[1004a77b 127.0.0.1:46555]-#341%grid-0%-#6850%grid-0%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=1004a77b-058d-4a31-997a-ec25d357f001, rmtAddr=/127.0.0.1:46555] [21:04:05] : [Step 4/5] [2021-11-19 21:04:05,773][INFO ][tcp-disco-srvr-[:47501]-#340%grid-1%-#6849%grid-1%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=43481] [21:04:05] : [Step 4/5] [2021-11-19 21:04:05,773][INFO ][tcp-disco-srvr-[:47501]-#340%grid-1%-#6849%grid-1%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=43481] [21:04:05] : [Step 4/5] [2021-11-19 21:04:05,774][INFO ][tcp-disco-sock-reader-[]-#342%grid-1%-#6851%grid-1%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:43481, rmtPort=43481] [21:04:05] : [Step 4/5] [2021-11-19 21:04:05,774][INFO ][tcp-disco-sock-reader-[]-#342%grid-1%-#6851%grid-1%][TestTcpDiscoverySpi] Received ping request from the remote node [rmtNodeId=00ed1cf3-ba65-46ff-8221-046bb54a6000, rmtAddr=/127.0.0.1:43481, rmtPort=43481] [21:04:05] : [Step 4/5] [2021-11-19 21:04:05,776][INFO ][tcp-disco-sock-reader-[]-#342%grid-1%-#6851%grid-1%][TestTcpDiscoverySpi] Finished writing ping response [rmtNodeId=00ed1cf3-ba65-46ff-8221-046bb54a6000, rmtAddr=/127.0.0.1:43481, rmtPort=43481] [21:04:05]W: [org.apache.ignite:ignite-core] [2021-11-19 21:04:05,777][WARN ][tcp-disco-sock-reader-[]-#342%grid-1%-#6851%grid-1%][TestTcpDiscoverySpi] Failed to shutdown socket [21:04:05] : [Step 4/5] [2021-11-19 21:04:05,779][INFO ][tcp-disco-sock-reader-[]-#342%grid-1%-#6851%grid-1%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:43481, rmtPort=43481, rmtNodeId=null] [21:04:05]W: [org.apache.ignite:ignite-core] java.net.SocketException: Socket output is already shutdown [21:04:05]W: [org.apache.ignite:ignite-core] at java.net.Socket.shutdownOutput(Socket.java:1572) [21:04:05]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.close(IgniteUtils.java:4247) [21:04:05]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.discovery.tcp.ServerImpl$SocketReader.body(ServerImpl.java:7370) [21:04:05]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.IgniteSpiThread.run(IgniteSpiThread.java:58) [21:04:05] : [Step 4/5] [2021-11-19 21:04:05,777][INFO ][tcp-disco-sock-reader-[1004a77b 127.0.0.1:46555]-#341%grid-0%-#6850%grid-0%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:46555, rmtPort=46555, rmtNodeId=1004a77b-058d-4a31-997a-ec25d357f001] [21:04:05] : [Step 4/5] [2021-11-19 21:04:05,782][INFO ][tcp-disco-msg-worker-[crd]-#334%grid-0%-#6730%grid-0%][GridEncryptionManager] Joining node doesn't have stored group keys [node=1004a77b-058d-4a31-997a-ec25d357f001] [21:04:05] : [Step 4/5] [2021-11-19 21:04:05,793][INFO ][tcp-disco-msg-worker-[crd]-#334%grid-0%-#6730%grid-0%][TestTcpDiscoverySpi] New next node [newNext=TcpDiscoveryNode [id=1004a77b-058d-4a31-997a-ec25d357f001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=0, intOrder=2, lastExchangeTime=1637345045767, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false]] [21:04:05] : [Step 4/5] [2021-11-19 21:04:05,794][INFO ][tcp-disco-srvr-[:47501]-#340%grid-1%-#6849%grid-1%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=53749] [21:04:05] : [Step 4/5] [2021-11-19 21:04:05,794][INFO ][tcp-disco-srvr-[:47501]-#340%grid-1%-#6849%grid-1%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=53749] [21:04:05] : [Step 4/5] [2021-11-19 21:04:05,795][INFO ][tcp-disco-sock-reader-[]-#343%grid-1%-#6852%grid-1%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:53749, rmtPort=53749] [21:04:05] : [Step 4/5] [2021-11-19 21:04:05,878][INFO ][tcp-disco-sock-reader-[00ed1cf3 127.0.0.1:53749]-#343%grid-1%-#6852%grid-1%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=00ed1cf3-ba65-46ff-8221-046bb54a6000, rmtAddr=/127.0.0.1:53749] [21:04:05] : [Step 4/5] [2021-11-19 21:04:05,886][INFO ][tcp-disco-msg-worker-[]-#339%grid-1%-#6848%grid-1%][TestTcpDiscoverySpi] New next node [newNext=TcpDiscoveryNode [id=00ed1cf3-ba65-46ff-8221-046bb54a6000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345045885, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false]] [21:04:05] : [Step 4/5] [2021-11-19 21:04:05,887][INFO ][tcp-disco-srvr-[:47500]-#335%grid-0%-#6731%grid-0%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=46513] [21:04:05] : [Step 4/5] [2021-11-19 21:04:05,887][INFO ][tcp-disco-srvr-[:47500]-#335%grid-0%-#6731%grid-0%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=46513] [21:04:05] : [Step 4/5] [2021-11-19 21:04:05,888][INFO ][tcp-disco-sock-reader-[]-#344%grid-0%-#6853%grid-0%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:46513, rmtPort=46513] [21:04:05] : [Step 4/5] [2021-11-19 21:04:05,889][INFO ][tcp-disco-sock-reader-[1004a77b 127.0.0.1:46513]-#344%grid-0%-#6853%grid-0%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=1004a77b-058d-4a31-997a-ec25d357f001, rmtAddr=/127.0.0.1:46513] [21:04:05] : [Step 4/5] [2021-11-19 21:04:05,891][INFO ][disco-event-worker-#6733%grid-0%][GridDiscoveryManager] Added new node to topology: TcpDiscoveryNode [id=1004a77b-058d-4a31-997a-ec25d357f001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637345045767, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false] [21:04:05] : [Step 4/5] [2021-11-19 21:04:05,893][INFO ][disco-event-worker-#6733%grid-0%][GridDiscoveryManager] Topology snapshot [ver=2, locNode=00ed1cf3, servers=2, clients=0, state=INACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=00ed1cf3-ba65-46ff-8221-046bb54a6000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=1004a77b-058d-4a31-997a-ec25d357f001, consistentId=grid-1, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:04:05] : [Step 4/5] [2021-11-19 21:04:05,894][INFO ][tcp-disco-msg-worker-[00ed1cf3 127.0.0.1:47500]-#339%grid-1%-#6848%grid-1%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustEnabled' was changed from 'null' to 'false' [21:04:05] : [Step 4/5] [2021-11-19 21:04:05,895][INFO ][tcp-disco-msg-worker-[00ed1cf3 127.0.0.1:47500]-#339%grid-1%-#6848%grid-1%][ClusterProcessor] pensive_kilby [21:04:05] : [Step 4/5] [2021-11-19 21:04:05,895][INFO ][tcp-disco-msg-worker-[00ed1cf3 127.0.0.1:47500]-#339%grid-1%-#6848%grid-1%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustTimeout' was changed from 'null' to '300000' [21:04:05] : [Step 4/5] [2021-11-19 21:04:05,895][INFO ][tcp-disco-msg-worker-[00ed1cf3 127.0.0.1:47500]-#339%grid-1%-#6848%grid-1%][IgniteTxManager] Transactions parameter 'longOperationsDumpTimeout' was changed from 'null' to '60000' [21:04:05] : [Step 4/5] [2021-11-19 21:04:05,896][INFO ][tcp-disco-msg-worker-[00ed1cf3 127.0.0.1:47500]-#339%grid-1%-#6848%grid-1%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpThreshold' was changed from 'null' to '0' [21:04:05] : [Step 4/5] [2021-11-19 21:04:05,896][INFO ][tcp-disco-msg-worker-[00ed1cf3 127.0.0.1:47500]-#339%grid-1%-#6848%grid-1%][IgniteTxManager] Transactions parameter 'transactionTimeDumpSamplesCoefficient' was changed from 'null' to '0.0' [21:04:05] : [Step 4/5] [2021-11-19 21:04:05,896][INFO ][tcp-disco-msg-worker-[00ed1cf3 127.0.0.1:47500]-#339%grid-1%-#6848%grid-1%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpSamplesPerSecondLimit' was changed from 'null' to '5' [21:04:05] : [Step 4/5] [2021-11-19 21:04:05,897][INFO ][tcp-disco-msg-worker-[00ed1cf3 127.0.0.1:47500]-#339%grid-1%-#6848%grid-1%][IgniteTxManager] Transactions parameter 'collisionsDumpInterval' was changed from 'null' to '1000' [21:04:05] : [Step 4/5] [2021-11-19 21:04:05,897][INFO ][tcp-disco-msg-worker-[00ed1cf3 127.0.0.1:47500]-#339%grid-1%-#6848%grid-1%][IgniteTxManager] Transactions parameter 'txOwnerDumpRequestsAllowed' was changed from 'null' to 'true' [21:04:05] : [Step 4/5] [2021-11-19 21:04:05,897][INFO ][tcp-disco-msg-worker-[00ed1cf3 127.0.0.1:47500]-#339%grid-1%-#6848%grid-1%][GridCacheDatabaseSharedManager] Historical rebalance WAL threshold changed [property=historical.rebalance.threshold, oldVal=null, newVal=500] [21:04:05] : [Step 4/5] [2021-11-19 21:04:05,898][INFO ][disco-notifier-worker-#6847%grid-1%][MvccProcessorImpl] Assigned mvcc coordinator [crd=MvccCoordinator [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=0], nodeId=00ed1cf3-ba65-46ff-8221-046bb54a6000, ver=1637345044739, local=false, initialized=false]] [21:04:05] : [Step 4/5] [2021-11-19 21:04:05,900][INFO ][sys-#6826%grid-1%][ClusterProcessor] Writing cluster ID and tag to metastorage on ready for write ClusterIdAndTag [id=e59705b4-217a-49b7-8688-11f7b94dd438, tag=pensive_kilby] [21:04:05] : [Step 4/5] [2021-11-19 21:04:05,915][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][IgniteKernal%grid-1] To start Console Management & Monitoring run ignitevisorcmd.{sh|bat} [21:04:05] : [Step 4/5] [2021-11-19 21:04:05,915][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][IgniteKernal%grid-1] [21:04:05] : [Step 4/5] [21:04:05] : [Step 4/5] >>> +-------------------------------------------+ [21:04:05] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:04:05] : [Step 4/5] >>> +-------------------------------------------+ [21:04:05] : [Step 4/5] >>> OS name: Linux 4.15.0-151-generic amd64 [21:04:05] : [Step 4/5] >>> CPU(s): 24 [21:04:05] : [Step 4/5] >>> Heap: 2.0GB [21:04:05] : [Step 4/5] >>> VM name: 16724@c4dfe9a430b2 [21:04:05] : [Step 4/5] >>> Ignite instance name: grid-1 [21:04:05] : [Step 4/5] >>> Local node [ID=1004A77B-058D-4A31-997A-EC25D357F001, order=2, clientMode=false] [21:04:05] : [Step 4/5] >>> Local node addresses: [127.0.0.1] [21:04:05] : [Step 4/5] >>> Local ports: TCP:10801 TCP:45131 TCP:47501 [21:04:05] : [Step 4/5] [21:04:05] : [Step 4/5] [2021-11-19 21:04:05,916][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][IgniteKernal%grid-1] >>> Ignite cluster is in INACTIVE state (limited functionality available). Use control.(sh|bat) script or IgniteCluster.state(ClusterState.ACTIVE) to change the state. [21:04:05] : [Step 4/5] [2021-11-19 21:04:05,917][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][GridDiscoveryManager] Topology snapshot [ver=2, locNode=1004a77b, servers=2, clients=0, state=INACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=00ed1cf3-ba65-46ff-8221-046bb54a6000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=1004a77b-058d-4a31-997a-ec25d357f001, consistentId=grid-1, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:04:05] : [Step 4/5] [2021-11-19 21:04:05,918][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][G] Node started : [stage="Configure system pool" (0 ms),stage="Start managers" (183 ms),stage="Configure binary metadata" (2 ms),stage="Start processors" (389 ms),stage="Start 'StanByClusterTestProvider' plugin" (0 ms),stage="Start 'PageMemory tracker plugin' plugin" (0 ms),stage="Start 'TestDistibutedConfigurationPlugin' plugin" (0 ms),stage="Start 'NodeValidationPluginProvider' plugin" (0 ms),stage="Init metastore" (20 ms),stage="Init and start regions" (6 ms),stage="Restore binary memory" (15 ms),stage="Restore logical state" (80 ms),stage="Finish recovery" (291 ms),stage="Join topology" (138 ms),stage="Await transition" (2 ms),stage="Await exchange" (17 ms),stage="Total time" (1143 ms)] [21:04:05] : [Step 4/5] [2021-11-19 21:04:05,919][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][root] Node started with the following configuration [id=1004a77b-058d-4a31-997a-ec25d357f001, marshaller=BinaryMarshaller [], discovery=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=5000, ackTimeout=5000, marsh=JdkMarshaller [clsFilter=org.apache.ignite.marshaller.MarshallerUtils$1@6c7c5d06], reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], binaryCfg=null, lateAff=true] [21:04:05] : [Step 4/5] [2021-11-19 21:04:05,921][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][GridClusterStateProcessor] Sending activate cluster request with BaselineTopology BaselineTopology [id=0, branchingHash=-2475315501, branchingType='New BaselineTopology', baselineNodes=[grid-1, grid-0]] [21:04:05] : [Step 4/5] [2021-11-19 21:04:05,926][INFO ][disco-notifier-worker-#6729%grid-0%][GridClusterStateProcessor] Received activate cluster request with BaselineTopology[id=0] initiator node ID: 00ed1cf3-ba65-46ff-8221-046bb54a6000 [21:04:05] : [Step 4/5] [2021-11-19 21:04:05,926][INFO ][disco-notifier-worker-#6729%grid-0%][GridClusterStateProcessor] Started state transition: activate cluster [21:04:05] : [Step 4/5] [2021-11-19 21:04:05,927][INFO ][exchange-worker-#6734%grid-0%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], crd=true, evt=DISCOVERY_CUSTOM_EVT, evtNode=00ed1cf3-ba65-46ff-8221-046bb54a6000, customEvt=ChangeGlobalStateMessage [id=c191d593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqId=6a422855-6a1c-4ab8-a1d7-7072b3267bfa, initiatingNodeId=00ed1cf3-ba65-46ff-8221-046bb54a6000, state=ACTIVE, baselineTopology=BaselineTopology [id=0, branchingHash=-2475315501, branchingType='New BaselineTopology', baselineNodes=[grid-1, grid-0]], forceChangeBaselineTopology=false, timestamp=1637345045921, forceDeactivation=true], allowMerge=false, exchangeFreeSwitch=false] [21:04:05] : [Step 4/5] [2021-11-19 21:04:05,927][INFO ][disco-notifier-worker-#6847%grid-1%][GridClusterStateProcessor] Received activate cluster request with BaselineTopology[id=0] initiator node ID: 00ed1cf3-ba65-46ff-8221-046bb54a6000 [21:04:05] : [Step 4/5] [2021-11-19 21:04:05,928][INFO ][exchange-worker-#6734%grid-0%][GridDhtPartitionsExchangeFuture] Start activation process [nodeId=00ed1cf3-ba65-46ff-8221-046bb54a6000, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]]. New state: ACTIVE [21:04:05] : [Step 4/5] [2021-11-19 21:04:05,929][INFO ][disco-notifier-worker-#6847%grid-1%][GridClusterStateProcessor] Started state transition: activate cluster [21:04:05] : [Step 4/5] [2021-11-19 21:04:05,930][INFO ][exchange-worker-#6734%grid-0%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0 [21:04:05] : [Step 4/5] [2021-11-19 21:04:05,930][INFO ][exchange-worker-#6856%grid-1%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], crd=false, evt=DISCOVERY_CUSTOM_EVT, evtNode=00ed1cf3-ba65-46ff-8221-046bb54a6000, customEvt=ChangeGlobalStateMessage [id=c191d593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqId=6a422855-6a1c-4ab8-a1d7-7072b3267bfa, initiatingNodeId=00ed1cf3-ba65-46ff-8221-046bb54a6000, state=ACTIVE, baselineTopology=BaselineTopology [id=0, branchingHash=-2475315501, branchingType='New BaselineTopology', baselineNodes=[grid-1, grid-0]], forceChangeBaselineTopology=false, timestamp=1637345045921, forceDeactivation=true], allowMerge=false, exchangeFreeSwitch=false] [21:04:05] : [Step 4/5] [2021-11-19 21:04:05,932][INFO ][exchange-worker-#6734%grid-0%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000000.wal, offset=8713, ver=2] [21:04:05] : [Step 4/5] [2021-11-19 21:04:05,932][INFO ][exchange-worker-#6856%grid-1%][GridDhtPartitionsExchangeFuture] Start activation process [nodeId=1004a77b-058d-4a31-997a-ec25d357f001, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]]. New state: ACTIVE [21:04:05] : [Step 4/5] [2021-11-19 21:04:05,933][INFO ][exchange-worker-#6734%grid-0%][GridClusterStateProcessor] Writing BaselineTopology[id=0] [21:04:05] : [Step 4/5] [2021-11-19 21:04:05,933][INFO ][exchange-worker-#6856%grid-1%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1 [21:04:05] : [Step 4/5] [2021-11-19 21:04:05,938][INFO ][exchange-worker-#6856%grid-1%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000000.wal, offset=8713, ver=2] [21:04:05] : [Step 4/5] [2021-11-19 21:04:05,939][INFO ][exchange-worker-#6734%grid-0%][GridCacheDatabaseSharedManager] Finish recovery performed in 9 ms. [21:04:05] : [Step 4/5] [2021-11-19 21:04:05,939][INFO ][exchange-worker-#6856%grid-1%][GridClusterStateProcessor] Writing BaselineTopology[id=0] [21:04:05] : [Step 4/5] [2021-11-19 21:04:05,942][INFO ][exchange-worker-#6734%grid-0%][msg] Components activation performed in 13 ms. [21:04:05] : [Step 4/5] [2021-11-19 21:04:05,943][INFO ][exchange-worker-#6734%grid-0%][GridCacheProcessor] Finished recovery for cache [cache=ignite-sys-cache, grp=ignite-sys-cache, startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:04:05] : [Step 4/5] [2021-11-19 21:04:05,944][INFO ][exchange-worker-#6734%grid-0%][GridDhtPartitionsExchangeFuture] Successfully activated caches [nodeId=00ed1cf3-ba65-46ff-8221-046bb54a6000, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], newState=ACTIVE] [21:04:05] : [Step 4/5] [2021-11-19 21:04:05,944][INFO ][exchange-worker-#6856%grid-1%][GridCacheDatabaseSharedManager] Finish recovery performed in 10 ms. [21:04:05] : [Step 4/5] [2021-11-19 21:04:05,946][INFO ][exchange-worker-#6734%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:04:05] : [Step 4/5] [2021-11-19 21:04:05,946][INFO ][exchange-worker-#6856%grid-1%][msg] Components activation performed in 13 ms. [21:04:05] : [Step 4/5] [2021-11-19 21:04:05,947][INFO ][exchange-worker-#6856%grid-1%][GridCacheProcessor] Finished recovery for cache [cache=ignite-sys-cache, grp=ignite-sys-cache, startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:04:05] : [Step 4/5] [2021-11-19 21:04:05,948][INFO ][exchange-worker-#6856%grid-1%][GridDhtPartitionsExchangeFuture] Successfully activated caches [nodeId=1004a77b-058d-4a31-997a-ec25d357f001, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], newState=ACTIVE] [21:04:05] : [Step 4/5] [2021-11-19 21:04:05,949][INFO ][exchange-worker-#6856%grid-1%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:04:05] : [Step 4/5] [2021-11-19 21:04:05,959][INFO ][exchange-worker-#6734%grid-0%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], crd=true] [21:04:05] : [Step 4/5] [2021-11-19 21:04:05,961][INFO ][db-checkpoint-thread-#6865%grid-0%][Checkpointer] Checkpoint started [checkpointId=61da69ae-fe55-4e13-89e7-e37fad42b5b9, startPtr=WALPointer [idx=0, fileOff=78660, len=1963], checkpointBeforeLockTime=1ms, checkpointLockWait=3ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=1ms, writeCheckpointEntryDuration=2ms, splitAndSortCpPagesDuration=0ms, pages=17, reason='node started'] [21:04:05] : [Step 4/5] [2021-11-19 21:04:05,976][INFO ][grid-nio-worker-tcp-comm-0-#6673%TcpCommunicationSpi%][TcpCommunicationSpi] Accepted incoming communication connection [locAddr=/127.0.0.1:45130, rmtAddr=/127.0.0.1:34854] [21:04:05] : [Step 4/5] [2021-11-19 21:04:05,980][INFO ][grid-nio-worker-tcp-comm-0-#6791%TcpCommunicationSpi%][TcpCommunicationSpi] Established outgoing communication connection [locAddr=/127.0.0.1:34854, rmtAddr=/127.0.0.1:45130] [21:04:05] : [Step 4/5] [2021-11-19 21:04:05,981][INFO ][exchange-worker-#6856%grid-1%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], crd=false] [21:04:05] : [Step 4/5] [2021-11-19 21:04:05,983][INFO ][sys-#6711%grid-0%][GridDhtPartitionsExchangeFuture] Coordinator received single message [ver=AffinityTopologyVersion [topVer=2, minorTopVer=1], node=1004a77b-058d-4a31-997a-ec25d357f001, allReceived=true] [21:04:05] : [Step 4/5] [2021-11-19 21:04:05,983][INFO ][sys-#6711%grid-0%][GridDhtPartitionsExchangeFuture] finishExchangeOnCoordinator [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:04:05] : [Step 4/5] [2021-11-19 21:04:05,987][INFO ][db-checkpoint-thread-#6865%grid-0%][Checkpointer] Checkpoint finished [cpId=61da69ae-fe55-4e13-89e7-e37fad42b5b9, pages=17, markPos=WALPointer [idx=0, fileOff=78660, len=1963], walSegmentsCovered=[], markDuration=4ms, pagesWrite=1ms, fsync=24ms, total=33ms] [21:04:05] : [Step 4/5] [2021-11-19 21:04:05,987][INFO ][db-checkpoint-thread-#6870%grid-1%][Checkpointer] Checkpoint started [checkpointId=19be06fe-104f-4441-8f50-f7069258fb4f, startPtr=WALPointer [idx=0, fileOff=82998, len=1963], checkpointBeforeLockTime=3ms, checkpointLockWait=8ms, checkpointListenersExecuteTime=1ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=10ms, writeCheckpointEntryDuration=7ms, splitAndSortCpPagesDuration=0ms, pages=18, reason='node started'] [21:04:05] : [Step 4/5] [2021-11-19 21:04:05,988][INFO ][disco-notifier-worker-#6729%grid-0%][GridClusterStateProcessor] Received state change finish message: ACTIVE [21:04:05] : [Step 4/5] [2021-11-19 21:04:05,988][INFO ][sys-#6711%grid-0%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], err=null, rebalanced=true, wasRebalanced=false] [21:04:05] : [Step 4/5] [2021-11-19 21:04:05,989][INFO ][disco-notifier-worker-#6847%grid-1%][GridClusterStateProcessor] Received state change finish message: ACTIVE [21:04:05] : [Step 4/5] [2021-11-19 21:04:05,991][INFO ][disco-notifier-worker-#6847%grid-1%][GridClusterStateProcessor] Cluster state was changed from INACTIVE to ACTIVE [21:04:05] : [Step 4/5] [2021-11-19 21:04:05,989][INFO ][disco-notifier-worker-#6729%grid-0%][GridClusterStateProcessor] Cluster state was changed from INACTIVE to ACTIVE [21:04:05] : [Step 4/5] [2021-11-19 21:04:05,989][INFO ][sys-#6827%grid-1%][GridDhtPartitionsExchangeFuture] Received full message, will finish exchange [node=00ed1cf3-ba65-46ff-8221-046bb54a6000, resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:04:05] : [Step 4/5] [2021-11-19 21:04:05,993][INFO ][sys-#6711%grid-0%][GridCacheProcessor] Finish proxy initialization, cacheName=ignite-sys-cache, localNodeId=00ed1cf3-ba65-46ff-8221-046bb54a6000 [21:04:05] : [Step 4/5] [2021-11-19 21:04:05,993][INFO ][sys-#6837%grid-1%][GridCachePartitionExchangeManager] Delay process full message without exchange id (there is exchange in progress) [nodeId=00ed1cf3-ba65-46ff-8221-046bb54a6000] [21:04:05] : [Step 4/5] [2021-11-19 21:04:05,994][INFO ][sys-#6827%grid-1%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], err=null, rebalanced=true, wasRebalanced=false] [21:04:05] : [Step 4/5] [2021-11-19 21:04:05,994][INFO ][sys-#6724%grid-0%][DistributedBaselineConfiguration] Baseline auto-adjust is 'disabled' with timeout='300000' ms [21:04:06] : [Step 4/5] [2021-11-19 21:04:05,994][INFO ][sys-#6711%grid-0%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=00ed1cf3-ba65-46ff-8221-046bb54a6000, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=00ed1cf3-ba65-46ff-8221-046bb54a6000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345045990, loc=true, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:04:06] : [Step 4/5] [2021-11-19 21:04:05,994][INFO ][exchange-worker-#6734%grid-0%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=2, minorTopVer=1], force=false, evt=DISCOVERY_CUSTOM_EVT, node=00ed1cf3-ba65-46ff-8221-046bb54a6000] [21:04:06] : [Step 4/5] [2021-11-19 21:04:06,001][INFO ][sys-#6711%grid-0%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (1 ms), stage="Update caches registry" (14 ms), stage="Start caches" (0 ms), stage="Affinity initialization on cache group start" (0 ms), stage="Determine exchange type" (1 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Restore partition states" (0 ms), stage="After states restored callback" (11 ms), stage="WAL history reservation" (0 ms), stage="Waiting for all single messages" (24 ms), stage="Affinity recalculation (crd)" (0 ms), stage="Collect update counters and create affinity messages" (0 ms), stage="Assign partitions states" (0 ms), stage="Validate partitions states" (0 ms), stage="Ideal affinity diff calculation (enforced)" (0 ms), stage="Apply update counters" (0 ms), stage="Full message preparing" (2 ms), stage="Full message sending" (0 ms), stage="State finish message sending" (0 ms), stage="Detect lost partitions" (3 ms), stage="Exchange done" (9 ms), stage="Total time" (65 ms), Discovery lag=3 ms, Latest started node id=1004a77b-058d-4a31-997a-ec25d357f001] [21:04:06] : [Step 4/5] [2021-11-19 21:04:06,001][INFO ][sys-#6827%grid-1%][GridCacheProcessor] Finish proxy initialization, cacheName=ignite-sys-cache, localNodeId=1004a77b-058d-4a31-997a-ec25d357f001 [21:04:06] : [Step 4/5] [2021-11-19 21:04:05,999][INFO ][sys-#6724%grid-0%][GridClusterStateProcessor] Successfully performed final activation steps [nodeId=00ed1cf3-ba65-46ff-8221-046bb54a6000, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:04:06] : [Step 4/5] [2021-11-19 21:04:06,006][INFO ][sys-#6824%grid-1%][DistributedBaselineConfiguration] Baseline auto-adjust is 'disabled' with timeout='300000' ms [21:04:06] : [Step 4/5] [2021-11-19 21:04:06,005][INFO ][sys-#6711%grid-0%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], stage="Affinity initialization on cache group start [grp=ignite-sys-cache]" (0 ms) (parent=Affinity initialization on cache group start), stage="Affinity centralized initialization (crd) [grp=ignite-sys-cache, crd=true]" (1 ms) (parent=Determine exchange type), stage="Restore partition states [grp=ignite-sys-cache]" (0 ms) (parent=Restore partition states), stage="Affinity recalculation (partitions availability) [grp=ignite-sys-cache]" (0 ms) (parent=Ideal affinity diff calculation (enforced))] [21:04:06] : [Step 4/5] [2021-11-19 21:04:06,007][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][root] awaitPartitionMapExchange finished [21:04:06] : [Step 4/5] [2021-11-19 21:04:06,007][INFO ][sys-#6824%grid-1%][GridClusterStateProcessor] Successfully performed final activation steps [nodeId=1004a77b-058d-4a31-997a-ec25d357f001, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:04:06] : [Step 4/5] [2021-11-19 21:04:06,006][INFO ][sys-#6827%grid-1%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=1004a77b-058d-4a31-997a-ec25d357f001, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=00ed1cf3-ba65-46ff-8221-046bb54a6000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345045885, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:04:06] : [Step 4/5] [2021-11-19 21:04:06,006][INFO ][exchange-worker-#6856%grid-1%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=2, minorTopVer=1], force=false, evt=DISCOVERY_CUSTOM_EVT, node=00ed1cf3-ba65-46ff-8221-046bb54a6000] [21:04:06] : [Step 4/5] [2021-11-19 21:04:06,010][INFO ][sys-#6827%grid-1%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (1 ms), stage="Update caches registry" (14 ms), stage="Start caches" (0 ms), stage="Affinity initialization on cache group start" (0 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Restore partition states" (0 ms), stage="After states restored callback" (21 ms), stage="WAL history reservation" (0 ms), stage="Waiting for Full message" (18 ms), stage="Affinity recalculation" (2 ms), stage="Full map updating" (1 ms), stage="Detect lost partitions" (5 ms), stage="Exchange done" (10 ms), stage="Total time" (72 ms)] [21:04:06] : [Step 4/5] [2021-11-19 21:04:06,012][INFO ][sys-#6827%grid-1%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], stage="Affinity initialization on cache group start [grp=ignite-sys-cache]" (0 ms) (parent=Affinity initialization on cache group start), stage="Affinity centralized initialization (crd) [grp=ignite-sys-cache, crd=false]" (0 ms) (parent=Determine exchange type), stage="Restore partition states [grp=ignite-sys-cache]" (0 ms) (parent=Restore partition states), stage="Affinity applying from full message [grp=ignite-sys-cache]" (2 ms) (parent=Affinity recalculation)] [21:04:06] : [Step 4/5] [2021-11-19 21:04:06,013][INFO ][db-checkpoint-thread-#6870%grid-1%][Checkpointer] Checkpoint finished [cpId=19be06fe-104f-4441-8f50-f7069258fb4f, pages=18, markPos=WALPointer [idx=0, fileOff=82998, len=1963], walSegmentsCovered=[], markDuration=19ms, pagesWrite=5ms, fsync=20ms, total=55ms] [21:04:06] : [Step 4/5] [2021-11-19 21:04:06,023][INFO ][exchange-worker-#6856%grid-1%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], crd=false, evt=DISCOVERY_CUSTOM_EVT, evtNode=00ed1cf3-ba65-46ff-8221-046bb54a6000, customEvt=DynamicCacheChangeBatch [id=0491d593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqs=ArrayList [DynamicCacheChangeRequest [cacheName=encrypted2, hasCfg=true, nodeId=00ed1cf3-ba65-46ff-8221-046bb54a6000, clientStartOnly=false, stop=false, destroy=false, disabledAfterStart=false]], exchangeActions=ExchangeActions [startCaches=[encrypted2], stopCaches=null, startGrps=[group1], stopGrps=[], resetParts=null, stateChangeRequest=null], startCaches=false], allowMerge=false, exchangeFreeSwitch=false] [21:04:06] : [Step 4/5] [2021-11-19 21:04:06,023][INFO ][exchange-worker-#6734%grid-0%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], crd=true, evt=DISCOVERY_CUSTOM_EVT, evtNode=00ed1cf3-ba65-46ff-8221-046bb54a6000, customEvt=DynamicCacheChangeBatch [id=0491d593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqs=ArrayList [DynamicCacheChangeRequest [cacheName=encrypted2, hasCfg=true, nodeId=00ed1cf3-ba65-46ff-8221-046bb54a6000, clientStartOnly=false, stop=false, destroy=false, disabledAfterStart=false]], exchangeActions=ExchangeActions [startCaches=[encrypted2], stopCaches=null, startGrps=[group1], stopGrps=[], resetParts=null, stateChangeRequest=null], startCaches=false], allowMerge=false, exchangeFreeSwitch=false] [21:04:06] : [Step 4/5] [2021-11-19 21:04:06,034][INFO ][exchange-worker-#6856%grid-1%][PageMemoryImpl] Started page memory [memoryAllocated=24.0 MiB, pages=5952, tableSize=474.2 KiB, replacementSize=768 B, checkpointBuffer=10.0 MiB] [21:04:06] : [Step 4/5] [2021-11-19 21:04:06,034][INFO ][exchange-worker-#6734%grid-0%][PageMemoryImpl] Started page memory [memoryAllocated=24.0 MiB, pages=5952, tableSize=474.2 KiB, replacementSize=768 B, checkpointBuffer=10.0 MiB] [21:04:06] : [Step 4/5] [2021-11-19 21:04:06,104][INFO ][exchange-worker-#6734%grid-0%][GridCacheProcessor] Started cache [name=encrypted2, id=-1512636690, group=group1, dataRegionName=default, mode=PARTITIONED, atomicity=ATOMIC, backups=0, mvcc=false] [21:04:06] : [Step 4/5] [2021-11-19 21:04:06,107][INFO ][exchange-worker-#6734%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], waitTime=0ms, futInfo=NA, mode=DISTRIBUTED] [21:04:06]W: [org.apache.ignite:ignite-core] [2021-11-19 21:04:06,106][WARN ][exchange-worker-#6734%grid-0%][CacheAffinitySharedManager] Cache group 'group1' brings high overhead for its metainformation in data region 'default'. Metainformation required for its partitions (502 partitions, 4096 bytes per partition, 1 MBs total) will consume more than 15% of data region memory (10 MBs). It may lead to critical errors on the node and cluster instability. Please reduce number of partitions, add more memory to the data region or add more server nodes for this cache group. [21:04:06] : [Step 4/5] [2021-11-19 21:04:06,127][INFO ][exchange-worker-#6856%grid-1%][GridCacheProcessor] Started cache [name=encrypted2, id=-1512636690, group=group1, dataRegionName=default, mode=PARTITIONED, atomicity=ATOMIC, backups=0, mvcc=false] [21:04:06]W: [org.apache.ignite:ignite-core] [2021-11-19 21:04:06,128][WARN ][exchange-worker-#6856%grid-1%][CacheAffinitySharedManager] Cache group 'group1' brings high overhead for its metainformation in data region 'default'. Metainformation required for its partitions (522 partitions, 4096 bytes per partition, 2 MBs total) will consume more than 15% of data region memory (10 MBs). It may lead to critical errors on the node and cluster instability. Please reduce number of partitions, add more memory to the data region or add more server nodes for this cache group. [21:04:06] : [Step 4/5] [2021-11-19 21:04:06,129][INFO ][exchange-worker-#6856%grid-1%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], waitTime=0ms, futInfo=NA, mode=DISTRIBUTED] [21:04:06] : [Step 4/5] [2021-11-19 21:04:06,130][INFO ][exchange-worker-#6734%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partitions release latch: ServerLatch [permits=0, pendingAcks=HashSet [], super=CompletableLatch [id=CompletableLatchUid [id=exchange, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2]]]] [21:04:06] : [Step 4/5] [2021-11-19 21:04:06,131][INFO ][exchange-worker-#6856%grid-1%][GridDhtPartitionsExchangeFuture] Finished waiting for partitions release latch: ClientLatch [coordinator=TcpDiscoveryNode [id=00ed1cf3-ba65-46ff-8221-046bb54a6000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345045885, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], ackSent=true, super=CompletableLatch [id=CompletableLatchUid [id=exchange, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2]]]] [21:04:06] : [Step 4/5] [2021-11-19 21:04:06,131][INFO ][exchange-worker-#6734%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:04:06] : [Step 4/5] [2021-11-19 21:04:06,132][INFO ][exchange-worker-#6856%grid-1%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:04:06] : [Step 4/5] [2021-11-19 21:04:06,149][INFO ][exchange-worker-#6734%grid-0%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], crd=true] [21:04:06] : [Step 4/5] [2021-11-19 21:04:06,156][INFO ][exchange-worker-#6856%grid-1%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], crd=false] [21:04:06] : [Step 4/5] [2021-11-19 21:04:06,157][INFO ][sys-#6709%grid-0%][GridDhtPartitionsExchangeFuture] Coordinator received single message [ver=AffinityTopologyVersion [topVer=2, minorTopVer=2], node=1004a77b-058d-4a31-997a-ec25d357f001, allReceived=true] [21:04:06] : [Step 4/5] [2021-11-19 21:04:06,157][INFO ][sys-#6709%grid-0%][GridDhtPartitionsExchangeFuture] finishExchangeOnCoordinator [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2]] [21:04:06] : [Step 4/5] [2021-11-19 21:04:06,165][INFO ][sys-#6709%grid-0%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], err=null, rebalanced=true, wasRebalanced=true] [21:04:06] : [Step 4/5] [2021-11-19 21:04:06,166][INFO ][sys-#6828%grid-1%][GridDhtPartitionsExchangeFuture] Received full message, will finish exchange [node=00ed1cf3-ba65-46ff-8221-046bb54a6000, resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2]] [21:04:06] : [Step 4/5] [2021-11-19 21:04:06,166][INFO ][sys-#6709%grid-0%][GridCacheProcessor] Finish proxy initialization, cacheName=encrypted2, localNodeId=00ed1cf3-ba65-46ff-8221-046bb54a6000 [21:04:06] : [Step 4/5] [2021-11-19 21:04:06,170][INFO ][sys-#6709%grid-0%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=00ed1cf3-ba65-46ff-8221-046bb54a6000, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=00ed1cf3-ba65-46ff-8221-046bb54a6000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345046011, loc=true, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2]] [21:04:06] : [Step 4/5] [2021-11-19 21:04:06,171][INFO ][sys-#6828%grid-1%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], err=null, rebalanced=true, wasRebalanced=true] [21:04:06] : [Step 4/5] [2021-11-19 21:04:06,171][INFO ][exchange-worker-#6734%grid-0%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=2, minorTopVer=2], force=false, evt=DISCOVERY_CUSTOM_EVT, node=00ed1cf3-ba65-46ff-8221-046bb54a6000] [21:04:06] : [Step 4/5] [2021-11-19 21:04:06,172][INFO ][sys-#6828%grid-1%][GridCacheProcessor] Finish proxy initialization, cacheName=encrypted2, localNodeId=1004a77b-058d-4a31-997a-ec25d357f001 [21:04:06] : [Step 4/5] [2021-11-19 21:04:06,171][INFO ][sys-#6709%grid-0%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (2 ms), stage="Update caches registry" (0 ms), stage="Start caches" (78 ms), stage="Affinity initialization on cache group start" (1 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Wait partitions release latch [latch=exchange]" (23 ms), stage="Wait partitions release [latch=exchange]" (1 ms), stage="Restore partition states" (10 ms), stage="After states restored callback" (6 ms), stage="WAL history reservation" (0 ms), stage="Waiting for all single messages" (7 ms), stage="Affinity recalculation (crd)" (0 ms), stage="Collect update counters and create affinity messages" (0 ms), stage="Assign partitions states" (3 ms), stage="Validate partitions states" (0 ms), stage="Apply update counters" (0 ms), stage="Full message preparing" (2 ms), stage="Full message sending" (0 ms), stage="Exchange done" (6 ms), stage="Total time" (139 ms)] [21:04:06] : [Step 4/5] [2021-11-19 21:04:06,173][INFO ][exchange-worker-#6856%grid-1%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=2, minorTopVer=2], force=false, evt=DISCOVERY_CUSTOM_EVT, node=00ed1cf3-ba65-46ff-8221-046bb54a6000] [21:04:06] : [Step 4/5] [2021-11-19 21:04:06,173][INFO ][sys-#6828%grid-1%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=1004a77b-058d-4a31-997a-ec25d357f001, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=00ed1cf3-ba65-46ff-8221-046bb54a6000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345045885, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2]] [21:04:06] : [Step 4/5] [2021-11-19 21:04:06,174][INFO ][sys-#6709%grid-0%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], stage="Affinity initialization on cache group start [grp=group1]" (1 ms) (parent=Affinity initialization on cache group start), stage="Restore partition states [grp=group1]" (10 ms) (parent=Restore partition states), stage="Restore partition states [grp=ignite-sys-cache]" (0 ms) (parent=Restore partition states)] [21:04:06] : [Step 4/5] [2021-11-19 21:04:06,177][INFO ][sys-#6828%grid-1%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (1 ms), stage="Update caches registry" (0 ms), stage="Start caches" (102 ms), stage="Affinity initialization on cache group start" (1 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Wait partitions release latch [latch=exchange]" (1 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Restore partition states" (16 ms), stage="After states restored callback" (4 ms), stage="WAL history reservation" (0 ms), stage="Waiting for Full message" (11 ms), stage="Affinity recalculation" (0 ms), stage="Full map updating" (4 ms), stage="Exchange done" (5 ms), stage="Total time" (145 ms)] [21:04:06] : [Step 4/5] [2021-11-19 21:04:06,181][INFO ][sys-#6828%grid-1%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], stage="Affinity initialization on cache group start [grp=group1]" (1 ms) (parent=Affinity initialization on cache group start), stage="Restore partition states [grp=group1]" (16 ms) (parent=Restore partition states), stage="Restore partition states [grp=ignite-sys-cache]" (0 ms) (parent=Restore partition states)] [21:04:09] : [Step 4/5] [2021-11-19 21:04:09,983][INFO ][exchange-worker-#6734%grid-0%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=3], crd=true, evt=DISCOVERY_CUSTOM_EVT, evtNode=00ed1cf3-ba65-46ff-8221-046bb54a6000, customEvt=DynamicCacheChangeBatch [id=c2a1d593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqs=ArrayList [DynamicCacheChangeRequest [cacheName=encrypted, hasCfg=true, nodeId=00ed1cf3-ba65-46ff-8221-046bb54a6000, clientStartOnly=false, stop=false, destroy=false, disabledAfterStart=false]], exchangeActions=ExchangeActions [startCaches=[encrypted], stopCaches=null, startGrps=[], stopGrps=[], resetParts=null, stateChangeRequest=null], startCaches=false], allowMerge=false, exchangeFreeSwitch=false] [21:04:09] : [Step 4/5] [2021-11-19 21:04:09,984][INFO ][exchange-worker-#6856%grid-1%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=3], crd=false, evt=DISCOVERY_CUSTOM_EVT, evtNode=00ed1cf3-ba65-46ff-8221-046bb54a6000, customEvt=DynamicCacheChangeBatch [id=c2a1d593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqs=ArrayList [DynamicCacheChangeRequest [cacheName=encrypted, hasCfg=true, nodeId=00ed1cf3-ba65-46ff-8221-046bb54a6000, clientStartOnly=false, stop=false, destroy=false, disabledAfterStart=false]], exchangeActions=ExchangeActions [startCaches=[encrypted], stopCaches=null, startGrps=[], stopGrps=[], resetParts=null, stateChangeRequest=null], startCaches=false], allowMerge=false, exchangeFreeSwitch=false] [21:04:09] : [Step 4/5] [2021-11-19 21:04:09,987][INFO ][exchange-worker-#6734%grid-0%][GridCacheProcessor] Started cache [name=encrypted, id=1613773252, group=group1, dataRegionName=default, mode=PARTITIONED, atomicity=ATOMIC, backups=0, mvcc=false] [21:04:09]W: [org.apache.ignite:ignite-core] [2021-11-19 21:04:09,988][WARN ][exchange-worker-#6734%grid-0%][CacheAffinitySharedManager] Cache group 'group1' brings high overhead for its metainformation in data region 'default'. Metainformation required for its partitions (502 partitions, 4096 bytes per partition, 1 MBs total) will consume more than 15% of data region memory (10 MBs). It may lead to critical errors on the node and cluster instability. Please reduce number of partitions, add more memory to the data region or add more server nodes for this cache group. [21:04:09] : [Step 4/5] [2021-11-19 21:04:09,988][INFO ][exchange-worker-#6856%grid-1%][GridCacheProcessor] Started cache [name=encrypted, id=1613773252, group=group1, dataRegionName=default, mode=PARTITIONED, atomicity=ATOMIC, backups=0, mvcc=false] [21:04:09] : [Step 4/5] [2021-11-19 21:04:09,989][INFO ][exchange-worker-#6734%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=3], waitTime=0ms, futInfo=NA, mode=DISTRIBUTED] [21:04:09]W: [org.apache.ignite:ignite-core] [2021-11-19 21:04:09,990][WARN ][exchange-worker-#6856%grid-1%][CacheAffinitySharedManager] Cache group 'group1' brings high overhead for its metainformation in data region 'default'. Metainformation required for its partitions (522 partitions, 4096 bytes per partition, 2 MBs total) will consume more than 15% of data region memory (10 MBs). It may lead to critical errors on the node and cluster instability. Please reduce number of partitions, add more memory to the data region or add more server nodes for this cache group. [21:04:09] : [Step 4/5] [2021-11-19 21:04:09,991][INFO ][exchange-worker-#6856%grid-1%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=3], waitTime=0ms, futInfo=NA, mode=DISTRIBUTED] [21:04:09] : [Step 4/5] [2021-11-19 21:04:09,992][INFO ][exchange-worker-#6734%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partitions release latch: ServerLatch [permits=0, pendingAcks=HashSet [], super=CompletableLatch [id=CompletableLatchUid [id=exchange, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=3]]]] [21:04:09] : [Step 4/5] [2021-11-19 21:04:09,993][INFO ][exchange-worker-#6856%grid-1%][GridDhtPartitionsExchangeFuture] Finished waiting for partitions release latch: ClientLatch [coordinator=TcpDiscoveryNode [id=00ed1cf3-ba65-46ff-8221-046bb54a6000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345045885, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], ackSent=true, super=CompletableLatch [id=CompletableLatchUid [id=exchange, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=3]]]] [21:04:09] : [Step 4/5] [2021-11-19 21:04:09,993][INFO ][exchange-worker-#6734%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=3], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:04:09] : [Step 4/5] [2021-11-19 21:04:09,994][INFO ][exchange-worker-#6856%grid-1%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=3], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:04:09] : [Step 4/5] [2021-11-19 21:04:09,997][INFO ][exchange-worker-#6734%grid-0%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=3], crd=true] [21:04:10] : [Step 4/5] [2021-11-19 21:04:09,999][INFO ][exchange-worker-#6856%grid-1%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=3], crd=false] [21:04:10] : [Step 4/5] [2021-11-19 21:04:10,000][INFO ][sys-#6711%grid-0%][GridDhtPartitionsExchangeFuture] Coordinator received single message [ver=AffinityTopologyVersion [topVer=2, minorTopVer=3], node=1004a77b-058d-4a31-997a-ec25d357f001, allReceived=true] [21:04:10] : [Step 4/5] [2021-11-19 21:04:10,001][INFO ][sys-#6711%grid-0%][GridDhtPartitionsExchangeFuture] finishExchangeOnCoordinator [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=3], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=3]] [21:04:10] : [Step 4/5] [2021-11-19 21:04:10,007][INFO ][sys-#6711%grid-0%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=3], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=3], err=null, rebalanced=true, wasRebalanced=true] [21:04:10] : [Step 4/5] [2021-11-19 21:04:10,009][INFO ][sys-#6711%grid-0%][GridCacheProcessor] Finish proxy initialization, cacheName=encrypted, localNodeId=00ed1cf3-ba65-46ff-8221-046bb54a6000 [21:04:10] : [Step 4/5] [2021-11-19 21:04:10,009][INFO ][sys-#6711%grid-0%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=00ed1cf3-ba65-46ff-8221-046bb54a6000, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=3], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=00ed1cf3-ba65-46ff-8221-046bb54a6000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345049984, loc=true, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=2, minorTopVer=3]] [21:04:10] : [Step 4/5] [2021-11-19 21:04:10,010][INFO ][exchange-worker-#6734%grid-0%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=2, minorTopVer=3], force=false, evt=DISCOVERY_CUSTOM_EVT, node=00ed1cf3-ba65-46ff-8221-046bb54a6000] [21:04:10] : [Step 4/5] [2021-11-19 21:04:10,009][INFO ][sys-#6840%grid-1%][GridDhtPartitionsExchangeFuture] Received full message, will finish exchange [node=00ed1cf3-ba65-46ff-8221-046bb54a6000, resVer=AffinityTopologyVersion [topVer=2, minorTopVer=3]] [21:04:10] : [Step 4/5] [2021-11-19 21:04:10,010][INFO ][sys-#6711%grid-0%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=3], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=3], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (1 ms), stage="Update caches registry" (0 ms), stage="Start caches" (2 ms), stage="Affinity initialization on cache group start" (1 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Wait partitions release latch [latch=exchange]" (2 ms), stage="Wait partitions release [latch=exchange]" (1 ms), stage="After states restored callback" (1 ms), stage="WAL history reservation" (0 ms), stage="Waiting for all single messages" (3 ms), stage="Affinity recalculation (crd)" (0 ms), stage="Collect update counters and create affinity messages" (0 ms), stage="Assign partitions states" (2 ms), stage="Validate partitions states" (0 ms), stage="Apply update counters" (0 ms), stage="Full message preparing" (2 ms), stage="Full message sending" (0 ms), stage="Exchange done" (3 ms), stage="Total time" (18 ms), Discovery lag=1 ms, Latest started node id=1004a77b-058d-4a31-997a-ec25d357f001] [21:04:10] : [Step 4/5] [2021-11-19 21:04:10,015][INFO ][sys-#6840%grid-1%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=3], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=3], err=null, rebalanced=true, wasRebalanced=true] [21:04:10] : [Step 4/5] [2021-11-19 21:04:10,016][INFO ][sys-#6711%grid-0%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=3], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=3], stage="Affinity initialization on cache group start [grp=group1]" (0 ms) (parent=Affinity initialization on cache group start)] [21:04:10] : [Step 4/5] [2021-11-19 21:04:10,017][INFO ][sys-#6840%grid-1%][GridCacheProcessor] Finish proxy initialization, cacheName=encrypted, localNodeId=1004a77b-058d-4a31-997a-ec25d357f001 [21:04:10] : [Step 4/5] [2021-11-19 21:04:10,017][INFO ][sys-#6840%grid-1%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=1004a77b-058d-4a31-997a-ec25d357f001, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=3], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=00ed1cf3-ba65-46ff-8221-046bb54a6000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345045885, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=2, minorTopVer=3]] [21:04:10] : [Step 4/5] [2021-11-19 21:04:10,018][INFO ][exchange-worker-#6856%grid-1%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=2, minorTopVer=3], force=false, evt=DISCOVERY_CUSTOM_EVT, node=00ed1cf3-ba65-46ff-8221-046bb54a6000] [21:04:10] : [Step 4/5] [2021-11-19 21:04:10,019][INFO ][sys-#6840%grid-1%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=3], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=3], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (2 ms), stage="Update caches registry" (0 ms), stage="Start caches" (3 ms), stage="Affinity initialization on cache group start" (1 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Wait partitions release latch [latch=exchange]" (2 ms), stage="Wait partitions release [latch=exchange]" (1 ms), stage="After states restored callback" (1 ms), stage="WAL history reservation" (0 ms), stage="Waiting for Full message" (12 ms), stage="Affinity recalculation" (2 ms), stage="Full map updating" (3 ms), stage="Exchange done" (4 ms), stage="Total time" (31 ms)] [21:04:10] : [Step 4/5] [2021-11-19 21:04:10,022][INFO ][sys-#6840%grid-1%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=3], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=3], stage="Affinity initialization on cache group start [grp=group1]" (0 ms) (parent=Affinity initialization on cache group start)] [21:04:11] : [Step 4/5] [2021-11-19 21:04:11,396][INFO ][exchange-worker-#6734%grid-0%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=4], crd=true, evt=DISCOVERY_CUSTOM_EVT, evtNode=00ed1cf3-ba65-46ff-8221-046bb54a6000, customEvt=DynamicCacheChangeBatch [id=77b1d593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqs=ArrayList [DynamicCacheChangeRequest [cacheName=encrypted, hasCfg=false, nodeId=00ed1cf3-ba65-46ff-8221-046bb54a6000, clientStartOnly=false, stop=true, destroy=true, disabledAfterStart=false]], exchangeActions=ExchangeActions [startCaches=null, stopCaches=[encrypted], startGrps=[], stopGrps=[], resetParts=null, stateChangeRequest=null], startCaches=false], allowMerge=false, exchangeFreeSwitch=false] [21:04:11] : [Step 4/5] [2021-11-19 21:04:11,396][INFO ][exchange-worker-#6856%grid-1%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=4], crd=false, evt=DISCOVERY_CUSTOM_EVT, evtNode=00ed1cf3-ba65-46ff-8221-046bb54a6000, customEvt=DynamicCacheChangeBatch [id=77b1d593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqs=ArrayList [DynamicCacheChangeRequest [cacheName=encrypted, hasCfg=false, nodeId=00ed1cf3-ba65-46ff-8221-046bb54a6000, clientStartOnly=false, stop=true, destroy=true, disabledAfterStart=false]], exchangeActions=ExchangeActions [startCaches=null, stopCaches=[encrypted], startGrps=[], stopGrps=[], resetParts=null, stateChangeRequest=null], startCaches=false], allowMerge=false, exchangeFreeSwitch=false] [21:04:11] : [Step 4/5] [2021-11-19 21:04:11,398][INFO ][exchange-worker-#6734%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=4], waitTime=0ms, futInfo=NA, mode=DISTRIBUTED] [21:04:11] : [Step 4/5] [2021-11-19 21:04:11,399][INFO ][exchange-worker-#6856%grid-1%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=4], waitTime=0ms, futInfo=NA, mode=DISTRIBUTED] [21:04:11] : [Step 4/5] [2021-11-19 21:04:11,400][INFO ][exchange-worker-#6734%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partitions release latch: ServerLatch [permits=0, pendingAcks=HashSet [], super=CompletableLatch [id=CompletableLatchUid [id=exchange, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=4]]]] [21:04:11] : [Step 4/5] [2021-11-19 21:04:11,401][INFO ][exchange-worker-#6856%grid-1%][GridDhtPartitionsExchangeFuture] Finished waiting for partitions release latch: ClientLatch [coordinator=TcpDiscoveryNode [id=00ed1cf3-ba65-46ff-8221-046bb54a6000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345045885, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], ackSent=true, super=CompletableLatch [id=CompletableLatchUid [id=exchange, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=4]]]] [21:04:11] : [Step 4/5] [2021-11-19 21:04:11,401][INFO ][exchange-worker-#6734%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=4], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:04:11] : [Step 4/5] [2021-11-19 21:04:11,402][INFO ][exchange-worker-#6856%grid-1%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=4], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:04:11] : [Step 4/5] [2021-11-19 21:04:11,403][INFO ][exchange-worker-#6734%grid-0%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=4], crd=true] [21:04:11] : [Step 4/5] [2021-11-19 21:04:11,405][INFO ][exchange-worker-#6856%grid-1%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=4], crd=false] [21:04:11] : [Step 4/5] [2021-11-19 21:04:11,407][INFO ][sys-#6717%grid-0%][GridDhtPartitionsExchangeFuture] Coordinator received single message [ver=AffinityTopologyVersion [topVer=2, minorTopVer=4], node=1004a77b-058d-4a31-997a-ec25d357f001, allReceived=true] [21:04:11] : [Step 4/5] [2021-11-19 21:04:11,407][INFO ][sys-#6717%grid-0%][GridDhtPartitionsExchangeFuture] finishExchangeOnCoordinator [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=4], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=4]] [21:04:11] : [Step 4/5] [2021-11-19 21:04:11,415][INFO ][sys-#6717%grid-0%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=4], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=4], err=null, rebalanced=true, wasRebalanced=true] [21:04:11] : [Step 4/5] [2021-11-19 21:04:11,416][INFO ][sys-#6833%grid-1%][GridDhtPartitionsExchangeFuture] Received full message, will finish exchange [node=00ed1cf3-ba65-46ff-8221-046bb54a6000, resVer=AffinityTopologyVersion [topVer=2, minorTopVer=4]] [21:04:11] : [Step 4/5] [2021-11-19 21:04:11,420][INFO ][sys-#6833%grid-1%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=4], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=4], err=null, rebalanced=true, wasRebalanced=true] [21:04:11] : [Step 4/5] [2021-11-19 21:04:11,443][INFO ][db-checkpoint-thread-#6870%grid-1%][Checkpointer] Checkpoint started [checkpointId=17526fe5-bd09-4306-966f-88d519f54dbb, startPtr=WALPointer [idx=0, fileOff=834893, len=11871], checkpointBeforeLockTime=7ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=2ms, checkpointLockHoldTime=7ms, walCpRecordFsyncDuration=4ms, writeCheckpointEntryDuration=2ms, splitAndSortCpPagesDuration=2ms, pages=496, reason='caches stop'] [21:04:11] : [Step 4/5] [2021-11-19 21:04:11,443][INFO ][db-checkpoint-thread-#6865%grid-0%][Checkpointer] Checkpoint started [checkpointId=bf962dc8-2bb0-423a-98c3-c737a659642a, startPtr=WALPointer [idx=0, fileOff=1000207, len=11491], checkpointBeforeLockTime=13ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=3ms, checkpointLockHoldTime=4ms, walCpRecordFsyncDuration=7ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=2ms, pages=628, reason='caches stop'] [21:04:11] : [Step 4/5] [2021-11-19 21:04:11,869][INFO ][db-checkpoint-thread-#6870%grid-1%][Checkpointer] Checkpoint finished [cpId=17526fe5-bd09-4306-966f-88d519f54dbb, pages=496, markPos=WALPointer [idx=0, fileOff=834893, len=11871], walSegmentsCovered=[], markDuration=15ms, pagesWrite=27ms, fsync=399ms, total=448ms] [21:04:11] : [Step 4/5] [2021-11-19 21:04:11,905][INFO ][sys-#6833%grid-1%][GridCacheProcessor] Stopped cache [cacheName=encrypted, group=group1] [21:04:11] : [Step 4/5] [2021-11-19 21:04:11,906][INFO ][sys-#6833%grid-1%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=1004a77b-058d-4a31-997a-ec25d357f001, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=4], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=00ed1cf3-ba65-46ff-8221-046bb54a6000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345045885, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=2, minorTopVer=4]] [21:04:11] : [Step 4/5] [2021-11-19 21:04:11,907][INFO ][exchange-worker-#6856%grid-1%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=2, minorTopVer=4], force=false, evt=DISCOVERY_CUSTOM_EVT, node=00ed1cf3-ba65-46ff-8221-046bb54a6000] [21:04:11] : [Step 4/5] [2021-11-19 21:04:11,907][INFO ][sys-#6833%grid-1%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=4], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=4], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (2 ms), stage="Update caches registry" (0 ms), stage="Start caches" (0 ms), stage="Affinity initialization on cache group start" (0 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Wait partitions release latch [latch=exchange]" (2 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="After states restored callback" (0 ms), stage="WAL history reservation" (0 ms), stage="Waiting for Full message" (12 ms), stage="Affinity recalculation" (0 ms), stage="Full map updating" (2 ms), stage="Exchange done" (487 ms), stage="Total time" (505 ms)] [21:04:11] : [Step 4/5] [2021-11-19 21:04:11,909][INFO ][sys-#6833%grid-1%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=4], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=4]] [21:04:11] : [Step 4/5] [2021-11-19 21:04:11,980][INFO ][db-checkpoint-thread-#6865%grid-0%][Checkpointer] Checkpoint finished [cpId=bf962dc8-2bb0-423a-98c3-c737a659642a, pages=628, markPos=WALPointer [idx=0, fileOff=1000207, len=11491], walSegmentsCovered=[], markDuration=15ms, pagesWrite=32ms, fsync=504ms, total=564ms] [21:04:12] : [Step 4/5] [2021-11-19 21:04:12,014][INFO ][sys-#6717%grid-0%][GridCacheProcessor] Stopped cache [cacheName=encrypted, group=group1] [21:04:12] : [Step 4/5] [2021-11-19 21:04:12,015][INFO ][sys-#6717%grid-0%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=00ed1cf3-ba65-46ff-8221-046bb54a6000, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=4], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=00ed1cf3-ba65-46ff-8221-046bb54a6000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345051995, loc=true, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=2, minorTopVer=4]] [21:04:12] : [Step 4/5] [2021-11-19 21:04:12,015][INFO ][exchange-worker-#6734%grid-0%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=2, minorTopVer=4], force=false, evt=DISCOVERY_CUSTOM_EVT, node=00ed1cf3-ba65-46ff-8221-046bb54a6000] [21:04:12] : [Step 4/5] [2021-11-19 21:04:12,016][INFO ][sys-#6717%grid-0%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=4], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=4], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (1 ms), stage="Update caches registry" (0 ms), stage="Start caches" (0 ms), stage="Affinity initialization on cache group start" (0 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (1 ms), stage="Wait partitions release latch [latch=exchange]" (1 ms), stage="Wait partitions release [latch=exchange]" (1 ms), stage="After states restored callback" (0 ms), stage="WAL history reservation" (0 ms), stage="Waiting for all single messages" (3 ms), stage="Affinity recalculation (crd)" (0 ms), stage="Collect update counters and create affinity messages" (0 ms), stage="Assign partitions states" (2 ms), stage="Validate partitions states" (0 ms), stage="Apply update counters" (0 ms), stage="Full message preparing" (3 ms), stage="Full message sending" (0 ms), stage="Exchange done" (600 ms), stage="Total time" (612 ms), Discovery lag=1 ms, Latest started node id=1004a77b-058d-4a31-997a-ec25d357f001] [21:04:12] : [Step 4/5] [2021-11-19 21:04:12,018][INFO ][sys-#6717%grid-0%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=4], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=4]] [21:04:12] : [Step 4/5] [2021-11-19 21:04:12,027][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][root] awaitPartitionMapExchange finished [21:04:12] : [Step 4/5] [2021-11-19 21:04:12,027][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][root] >>> Stopping grid [name=grid-1, id=1004a77b-058d-4a31-997a-ec25d357f001] [21:04:12] : [Step 4/5] [2021-11-19 21:04:12,053][INFO ][db-checkpoint-thread-#6870%grid-1%][Checkpointer] Checkpoint started [checkpointId=450ac813-503d-4a5f-9fdb-9f42f1b19e39, startPtr=WALPointer [idx=0, fileOff=1955168, len=11871], checkpointBeforeLockTime=8ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=1ms, checkpointLockHoldTime=2ms, walCpRecordFsyncDuration=9ms, writeCheckpointEntryDuration=2ms, splitAndSortCpPagesDuration=1ms, pages=308, reason='timeout'] [21:04:12] : [Step 4/5] [2021-11-19 21:04:12,058][INFO ][tcp-disco-sock-reader-[00ed1cf3 127.0.0.1:53749]-#343%grid-1%-#6852%grid-1%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:53749, rmtPort=53749, rmtNodeId=00ed1cf3-ba65-46ff-8221-046bb54a6000] [21:04:12] : [Step 4/5] [2021-11-19 21:04:12,059][INFO ][disco-event-worker-#6733%grid-0%][GridDiscoveryManager] Node left topology: TcpDiscoveryNode [id=1004a77b-058d-4a31-997a-ec25d357f001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637345045767, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false] [21:04:12] : [Step 4/5] [2021-11-19 21:04:12,061][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][GridCacheProcessor] Stopped cache [cacheName=ignite-sys-cache] [21:04:12] : [Step 4/5] [2021-11-19 21:04:12,062][INFO ][disco-event-worker-#6733%grid-0%][GridDiscoveryManager] Topology snapshot [ver=3, locNode=00ed1cf3, servers=1, clients=0, state=ACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=00ed1cf3-ba65-46ff-8221-046bb54a6000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:04:12] : [Step 4/5] [2021-11-19 21:04:12,063][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][GridCacheProcessor] Stopped cache [cacheName=encrypted2, group=group1] [21:04:12] : [Step 4/5] [2021-11-19 21:04:12,063][INFO ][disco-event-worker-#6733%grid-0%][GridDiscoveryManager] ^-- Baseline [id=0, size=2, online=1, offline=1] [21:04:12]W: [org.apache.ignite:ignite-core] [2021-11-19 21:04:12,064][WARN ][grid-nio-worker-tcp-comm-0-#6673%TcpCommunicationSpi%][TcpCommunicationSpi] Failed to shutdown socket [21:04:12]W: [org.apache.ignite:ignite-core] java.nio.channels.ClosedChannelException [21:04:12]W: [org.apache.ignite:ignite-core] at sun.nio.ch.SocketChannelImpl.shutdownOutput(SocketChannelImpl.java:795) [21:04:12]W: [org.apache.ignite:ignite-core] at sun.nio.ch.SocketAdaptor.shutdownOutput(SocketAdaptor.java:407) [21:04:12]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.close(IgniteUtils.java:4247) [21:04:12]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.closeKey(GridNioServer.java:2784) [21:04:12] : [Step 4/5] [2021-11-19 21:04:12,065][INFO ][exchange-worker-#6734%grid-0%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], crd=true, evt=NODE_LEFT, evtNode=1004a77b-058d-4a31-997a-ec25d357f001, customEvt=null, allowMerge=false, exchangeFreeSwitch=true] [21:04:12]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.close(GridNioServer.java:2835) [21:04:12]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.close(GridNioServer.java:2794) [21:04:12]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.bodyInternal(GridNioServer.java:2157) [21:04:12]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.body(GridNioServer.java:1910) [21:04:12]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:125) [21:04:12]W: [org.apache.ignite:ignite-core] at java.lang.Thread.run(Thread.java:748) [21:04:12] : [Step 4/5] [2021-11-19 21:04:12,067][INFO ][exchange-worker-#6734%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:04:12] : [Step 4/5] [2021-11-19 21:04:12,069][INFO ][exchange-worker-#6734%grid-0%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], err=null, rebalanced=true, wasRebalanced=true] [21:04:12] : [Step 4/5] [2021-11-19 21:04:12,070][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][FilePageStoreManager] Cleanup cache stores [total=4, left=0, cleanFiles=false] [21:04:12] : [Step 4/5] [2021-11-19 21:04:12,074][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][GridDeploymentLocalStore] Removed undeployed class: GridDeployment [ts=1637345045980, depMode=SHARED, clsLdr=IsolatedClassLoader{roleName='test'}, clsLdrId=a291d593d71-1004a77b-058d-4a31-997a-ec25d357f001, userVer=0, loc=true, sampleClsName=org.apache.ignite.internal.processors.cache.distributed.dht.preloader.IgniteDhtPartitionsToReloadMap, pendingUndeploy=false, undeployed=true, usage=0] [21:04:12]W: [org.apache.ignite:ignite-core] [2021-11-19 21:04:12,075][WARN ][sys-#6711%grid-0%][GridDhtPartitionTopologyImpl] Detected lost partitions [grp=group1, parts=[0, 2, 4, 6-7, 10-11, 14, 17, 21, 24-30, 32, 37, 40, 44, 47-52, 54, 57, 59, 62-64, 67-68, 74-75, 78, 81, 87-88, 91, 97, 99, 101-102, 104-107, 113-114, 116, 118, 120, 122, 124, 135-136, 138, 140-145, 147, 149-152, 154-156, 159-160, 162-164, 169, 172, 175-177, 180, 184-187, 190-191, 194, 196-202, 204-205, 209-210, 212, 214, 216, 219-224, 226, 229-232, 237, 239, 241, 243-245, 247, 249-251, 255, 257, 261, 265, 269, 272-273, 276-277, 281-282, 285, 287, 289-291, 293-297, 299, 301-304, 306, 308-309, 311-312, 315-317, 319, 322, 325-326, 328-330, 336, 339, 341, 344-346, 350, 352-354, 357-361, 363, 366-367, 371-373, 376-380, 383, 385, 387-388, 390, 392, 395-397, 400, 402, 405, 408-411, 416, 420, 422, 424-425, 429, 433, 435-438, 440-441, 445-446, 450, 452-453, 455-456, 458, 460, 462-463, 465-468, 470, 474-475, 480, 488, 490-492, 495, 497, 499-512, 516, 525, 527-531, 535, 537-538, 541-542, 545-546, 548-552, 554-555, 558, 562-564, 567-569, 572, 574, 579-580, 582-585, 587, 590-591, 594, 596, 600, 602, 604, 607-614, 617-620, 623-624, 627-629, 632-633, 636, 638, 640-642, 645-646, 648-649, 657-662, 664-665, 668-672, 677-678, 682-684, 686, 689, 692-693, 695-697, 699, 706-707, 709-710, 712-714, 716-717, 719-721, 723-728, 730-732, 734-735, 739, 742, 746, 749-750, 752, 754, 756, 762, 768-770, 772-775, 778, 780, 783-787, 789-791, 793, 796, 798-801, 803, 806, 809-812, 814, 816-817, 819, 822-825, 827-829, 832-833, 836-837, 839-840, 846, 848-851, 853-854, 857-858, 860, 863-864, 866, 868-871, 873-875, 877-878, 884, 888-889, 896-897, 900, 905-907, 914-915, 917, 919-920, 923-925, 931-933, 936, 940, 942, 944-945, 948, 950-951, 954, 956-958, 962, 965-970, 972, 975-976, 978-980, 983, 985, 988, 990, 993-994, 997-998, 1000, 1003-1004, 1007, 1009, 1014, 1016, 1018-1019], topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0]] [21:04:12] : [Step 4/5] [2021-11-19 21:04:12,081][INFO ][exchange-worker-#6734%grid-0%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=00ed1cf3-ba65-46ff-8221-046bb54a6000, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], evt=NODE_LEFT, evtNode=TcpDiscoveryNode [id=1004a77b-058d-4a31-997a-ec25d357f001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637345045767, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0]] [21:04:12] : [Step 4/5] [2021-11-19 21:04:12,082][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][IgniteKernal%grid-1] [21:04:12] : [Step 4/5] [21:04:12] : [Step 4/5] >>> +------------------------------------------------------+ [21:04:12] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV stopped OK [21:04:12] : [Step 4/5] >>> +------------------------------------------------------+ [21:04:12] : [Step 4/5] >>> Ignite instance name: grid-1 [21:04:12] : [Step 4/5] >>> Grid uptime: 00:00:06.172 [21:04:12] : [Step 4/5] [21:04:12] : [Step 4/5] [21:04:12] : [Step 4/5] [2021-11-19 21:04:12,083][INFO ][exchange-worker-#6734%grid-0%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (0 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="After states restored callback" (0 ms), stage="WAL history reservation" (0 ms), stage="Finalize update counters" (0 ms), stage="Detect lost partitions" (11 ms), stage="Exchange done" (2 ms), stage="Total time" (13 ms)] [21:04:12] : [Step 4/5] [2021-11-19 21:04:12,083][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][root] >>> Stopping grid [name=grid-0, id=00ed1cf3-ba65-46ff-8221-046bb54a6000] [21:04:12] : [Step 4/5] [2021-11-19 21:04:12,084][INFO ][exchange-worker-#6734%grid-0%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], stage="Affinity initialization (exchange-free switch on fully-rebalanced topology) [grp=ignite-sys-cache]" (0 ms) (parent=Determine exchange type), stage="Affinity initialization (exchange-free switch on fully-rebalanced topology) [grp=group1]" (0 ms) (parent=Determine exchange type)] [21:04:12] : [Step 4/5] [2021-11-19 21:04:12,086][INFO ][exchange-worker-#6734%grid-0%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], crd=true] [21:04:12] : [Step 4/5] [2021-11-19 21:04:12,087][INFO ][exchange-worker-#6734%grid-0%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=3, minorTopVer=0], force=false, evt=NODE_LEFT, node=1004a77b-058d-4a31-997a-ec25d357f001] [21:04:12] : [Step 4/5] [2021-11-19 21:04:12,113][INFO ][db-checkpoint-thread-#6865%grid-0%][Checkpointer] Checkpoint started [checkpointId=35c43ba7-d090-4bdb-b07d-896a2481a78f, startPtr=WALPointer [idx=0, fileOff=2422429, len=11491], checkpointBeforeLockTime=10ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=1ms, checkpointLockHoldTime=5ms, walCpRecordFsyncDuration=8ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=0ms, pages=392, reason='timeout'] [21:04:12]W: [org.apache.ignite:ignite-core] [2021-11-19 21:04:12,118][WARN ][tcp-disco-sock-reader-[1004a77b 127.0.0.1:46513]-#344%grid-0%-#6853%grid-0%][TestTcpDiscoverySpi] Failed to shutdown socket [21:04:12]W: [org.apache.ignite:ignite-core] java.net.SocketException: Socket is closed [21:04:12]W: [org.apache.ignite:ignite-core] at java.net.Socket.shutdownOutput(Socket.java:1568) [21:04:12]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.close(IgniteUtils.java:4247) [21:04:12]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.discovery.tcp.ServerImpl$SocketReader.body(ServerImpl.java:7370) [21:04:12]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.IgniteSpiThread.run(IgniteSpiThread.java:58) [21:04:12] : [Step 4/5] [2021-11-19 21:04:12,119][INFO ][tcp-disco-sock-reader-[1004a77b 127.0.0.1:46513]-#344%grid-0%-#6853%grid-0%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:46513, rmtPort=46513, rmtNodeId=1004a77b-058d-4a31-997a-ec25d357f001] [21:04:12] : [Step 4/5] [2021-11-19 21:04:12,120][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][GridCacheProcessor] Stopped cache [cacheName=ignite-sys-cache] [21:04:12] : [Step 4/5] [2021-11-19 21:04:12,122][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][GridCacheProcessor] Stopped cache [cacheName=encrypted2, group=group1] [21:04:12] : [Step 4/5] [2021-11-19 21:04:12,131][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][FilePageStoreManager] Cleanup cache stores [total=4, left=0, cleanFiles=false] [21:04:12] : [Step 4/5] [2021-11-19 21:04:12,132][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][GridDeploymentLocalStore] Removed undeployed class: GridDeployment [ts=1637345045980, depMode=SHARED, clsLdr=IsolatedClassLoader{roleName='test'}, clsLdrId=8291d593d71-00ed1cf3-ba65-46ff-8221-046bb54a6000, userVer=0, loc=true, sampleClsName=org.apache.ignite.internal.processors.cache.distributed.dht.preloader.GridDhtPartitionMap, pendingUndeploy=false, undeployed=true, usage=0] [21:04:12] : [Step 4/5] [2021-11-19 21:04:12,139][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][IgniteKernal%grid-0] [21:04:12] : [Step 4/5] [21:04:12] : [Step 4/5] >>> +------------------------------------------------------+ [21:04:12] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV stopped OK [21:04:12] : [Step 4/5] >>> +------------------------------------------------------+ [21:04:12] : [Step 4/5] >>> Ignite instance name: grid-0 [21:04:12] : [Step 4/5] >>> Grid uptime: 00:00:07.379 [21:04:12] : [Step 4/5] [21:04:12] : [Step 4/5] [21:04:12]W: [org.apache.ignite:ignite-core] [2021-11-19 21:04:12,144][WARN ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][G] Ignite work directory is not provided, automatically resolved to: /opt/buildagent/work/7bc1c54bc719b67c/work [21:04:12] : [Step 4/5] [2021-11-19 21:04:12,145][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][IgniteKernal%grid-0] [21:04:12] : [Step 4/5] [21:04:12] : [Step 4/5] >>> __________ ________________ [21:04:12] : [Step 4/5] >>> / _/ ___/ |/ / _/_ __/ __/ [21:04:12] : [Step 4/5] >>> _/ // (7 7 // / / / / _/ [21:04:12] : [Step 4/5] >>> /___/\___/_/|_/___/ /_/ /___/ [21:04:12] : [Step 4/5] >>> [21:04:12] : [Step 4/5] >>> ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:04:12] : [Step 4/5] >>> 2021 Copyright(C) Apache Software Foundation [21:04:12] : [Step 4/5] >>> [21:04:12] : [Step 4/5] >>> Ignite documentation: http://ignite.apache.org [21:04:12] : [Step 4/5] [21:04:12] : [Step 4/5] [2021-11-19 21:04:12,146][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][IgniteKernal%grid-0] Config URL: n/a [21:04:12] : [Step 4/5] [2021-11-19 21:04:12,146][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][IgniteKernal%grid-0] IgniteConfiguration [igniteInstanceName=grid-0, pubPoolSize=24, svcPoolSize=24, callbackPoolSize=24, stripedPoolSize=24, sysPoolSize=24, mgmtPoolSize=4, dataStreamerPoolSize=24, utilityCachePoolSize=24, utilityCacheKeepAliveTime=60000, p2pPoolSize=2, qryPoolSize=24, buildIdxPoolSize=4, igniteHome=/opt/buildagent/work/7bc1c54bc719b67c, igniteWorkDir=/opt/buildagent/work/7bc1c54bc719b67c/work, mbeanSrv=com.sun.jmx.mbeanserver.JmxMBeanServer@6fe85038, nodeId=00a846de-a112-4c0f-aaa0-2732afb68000, marsh=BinaryMarshaller [], marshLocJobs=false, daemon=false, p2pEnabled=true, netTimeout=10000, netCompressionLevel=1, sndRetryDelay=1000, sndRetryCnt=3, metricsHistSize=10000, metricsUpdateFreq=1000, metricsExpTime=9223372036854775807, discoSpi=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=0, ackTimeout=0, marsh=null, reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], segPlc=STOP, segResolveAttempts=2, waitForSegOnStart=true, allResolversPassReq=true, segChkFreq=10000, commSpi=TcpCommunicationSpi [connectGate=org.apache.ignite.spi.communication.tcp.internal.ConnectGateway@51c48c6b, ctxInitLatch=java.util.concurrent.CountDownLatch@1a4703a5[Count = 1], stopping=false, clientPool=null, nioSrvWrapper=null, stateProvider=null], evtSpi=MemoryEventStorageSpi [expireAgeMs=9223372036854775807, expireCnt=10000, filter=null], colSpi=NoopCollisionSpi [], deploySpi=LocalDeploymentSpi [], indexingSpi=org.apache.ignite.spi.indexing.noop.NoopIndexingSpi@64d22971, addrRslvr=null, encryptionSpi=org.apache.ignite.spi.encryption.keystore.KeystoreEncryptionSpi@52c5833, tracingSpi=org.apache.ignite.spi.tracing.NoopTracingSpi@77096a99, clientMode=false, rebalanceThreadPoolSize=4, rebalanceTimeout=10000, rebalanceBatchesPrefetchCnt=3, rebalanceThrottle=0, rebalanceBatchSize=524288, txCfg=TransactionConfiguration [txSerEnabled=false, dfltIsolation=REPEATABLE_READ, dfltConcurrency=PESSIMISTIC, dfltTxTimeout=0, txTimeoutOnPartitionMapExchange=0, deadlockTimeout=10000, pessimisticTxLogSize=0, pessimisticTxLogLinger=10000, tmLookupClsName=null, txManagerFactory=null, useJtaSync=false], cacheSanityCheckEnabled=true, discoStartupDelay=60000, deployMode=SHARED, p2pMissedCacheSize=100, locHost=127.0.0.1, timeSrvPortBase=31100, timeSrvPortRange=100, failureDetectionTimeout=10000, sysWorkerBlockedTimeout=null, clientFailureDetectionTimeout=10000, metricsLogFreq=0, connectorCfg=null, odbcCfg=null, warmupClos=null, atomicCfg=AtomicConfiguration [seqReserveSize=1000, cacheMode=PARTITIONED, backups=1, aff=null, grpName=null], classLdr=null, sslCtxFactory=null, platformCfg=null, binaryCfg=null, memCfg=null, pstCfg=null, dsCfg=DataStorageConfiguration [sysRegionInitSize=41943040, sysRegionMaxSize=104857600, pageSize=4096, concLvl=0, dfltDataRegConf=DataRegionConfiguration [name=default, maxSize=10485760, initSize=268435456, swapPath=null, pageEvictionMode=DISABLED, pageReplacementMode=CLOCK, evictionThreshold=0.9, emptyPagesPoolSize=100, metricsEnabled=false, metricsSubIntervalCount=5, metricsRateTimeInterval=60000, persistenceEnabled=true, checkpointPageBufSize=0, lazyMemoryAllocation=true, warmUpCfg=null], dataRegions=null, storagePath=null, checkpointFreq=180000, lockWaitTime=10000, checkpointThreads=4, checkpointWriteOrder=SEQUENTIAL, walHistSize=20, maxWalArchiveSize=1073741824, walSegments=10, walSegmentSize=67108864, walPath=db/wal, walArchivePath=db/wal/archive, cdcWalPath=db/wal/cdc, cdcEnabled=false, metricsEnabled=false, walMode=FSYNC, walTlbSize=131072, walBuffSize=0, walFlushFreq=2000, walFsyncDelay=1000, walRecordIterBuffSize=67108864, alwaysWriteFullPages=false, fileIOFactory=org.apache.ignite.internal.processors.cache.persistence.file.AsyncFileIOFactory@2aedbf09, metricsSubIntervalCnt=5, metricsRateTimeInterval=60000, walAutoArchiveAfterInactivity=-1, walForceArchiveTimeout=-1, writeThrottlingEnabled=false, walCompactionEnabled=false, walCompactionLevel=1, checkpointReadLockTimeout=null, walPageCompression=DISABLED, walPageCompressionLevel=null, dfltWarmUpCfg=null, encCfg=org.apache.ignite.configuration.EncryptionConfiguration@6a36ecc4, defragmentationThreadPoolSize=4, minWalArchiveSize=-1], snapshotPath=snapshots, activeOnStart=true, activeOnStartPropSetFlag=false, autoActivation=true, autoActivationPropSetFlag=false, clusterStateOnStart=null, sqlConnCfg=null, cliConnCfg=ClientConnectorConfiguration [host=null, port=10800, portRange=100, sockSndBufSize=0, sockRcvBufSize=0, tcpNoDelay=true, maxOpenCursorsPerConn=128, threadPoolSize=24, selectorCnt=12, idleTimeout=0, handshakeTimeout=10000, jdbcEnabled=true, odbcEnabled=true, thinCliEnabled=true, sslEnabled=false, useIgniteSslCtxFactory=true, sslClientAuth=false, sslCtxFactory=null, thinCliCfg=ThinClientConfiguration [maxActiveTxPerConn=100, maxActiveComputeTasksPerConn=0]], mvccVacuumThreadCnt=2, mvccVacuumFreq=5000, authEnabled=false, failureHnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]], commFailureRslvr=null, sqlCfg=SqlConfiguration [longQryWarnTimeout=3000, dfltQryTimeout=0, sqlQryHistSize=1000, validationEnabled=false], asyncContinuationExecutor=null] [21:04:12] : [Step 4/5] [2021-11-19 21:04:12,156][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][IgniteKernal%grid-0] Daemon mode: off [21:04:12] : [Step 4/5] [2021-11-19 21:04:12,156][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][IgniteKernal%grid-0] OS: Linux 4.15.0-151-generic amd64 [21:04:12] : [Step 4/5] [2021-11-19 21:04:12,157][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][IgniteKernal%grid-0] OS user: teamcity [21:04:12] : [Step 4/5] [2021-11-19 21:04:12,157][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][IgniteKernal%grid-0] PID: 16724 [21:04:12] : [Step 4/5] [2021-11-19 21:04:12,157][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][IgniteKernal%grid-0] Language runtime: Java Platform API Specification ver. 1.8 [21:04:12] : [Step 4/5] [2021-11-19 21:04:12,158][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][IgniteKernal%grid-0] VM information: Java(TM) SE Runtime Environment 1.8.0_261-b12 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 25.261-b12 [21:04:12] : [Step 4/5] [2021-11-19 21:04:12,158][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][IgniteKernal%grid-0] VM total memory: 1.9GB [21:04:12] : [Step 4/5] [2021-11-19 21:04:12,158][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][IgniteKernal%grid-0] Remote Management [restart: off, REST: off, JMX (remote: off)] [21:04:12] : [Step 4/5] [2021-11-19 21:04:12,159][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][IgniteKernal%grid-0] Logger: GridTestLog4jLogger [quiet=false, config=null] [21:04:12] : [Step 4/5] [2021-11-19 21:04:12,159][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][IgniteKernal%grid-0] IGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c [21:04:12] : [Step 4/5] [2021-11-19 21:04:12,159][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][IgniteKernal%grid-0] VM arguments: [-DIGNITE_DUMP_THREADS_ON_FAILURE=false, -DMono=/usr/bin/mono-sgen, -DMono4.0_x64=/usr/lib/mono/4.0, -DMono4.5_x64=/usr/lib/mono/4.5, -DMonoVersion=6.12.0.90, -DSKIP_BUILD=false, -Dagent.home.dir=/opt/buildagent, -Dagent.name=aitc-lin02_03, -Dagent.ownPort=9090, -Dagent.work.dir=/opt/buildagent/work, -Dbuild.number=95, -Dbuild.vcs.number=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.1=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.GitHubApacheIgnite=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dclassworlds.conf=/opt/buildagent/temp/buildTmp/teamcity.m2.conf, -Dcom.jetbrains.maven.watcher.report.file=/opt/buildagent/temp/buildTmp/maven-build-info.xml, -Djava.io.tmpdir=/opt/buildagent/temp/buildTmp, -Dmaven.home=/opt/buildagent/tools/maven3_6, -Dmaven.multiModuleProjectDirectory=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.agent.cpuBenchmark=457, -Dteamcity.agent.dotnet.agent_url=http://localhost:9090/RPC2, -Dteamcity.agent.dotnet.build_id=6278078, -Dteamcity.auth.password=*******, -Dteamcity.auth.userId=TeamCityBuildId=6278078, -Dteamcity.build.changedFiles.file=/opt/buildagent/temp/buildTmp/changedFiles6342607772318147725.txt, -Dteamcity.build.checkoutDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.build.id=6278078, -Dteamcity.build.properties.file=/opt/buildagent/temp/buildTmp/teamcity.build5164517880467851002.properties, -Dteamcity.build.tempDir=/opt/buildagent/temp/buildTmp, -Dteamcity.build.workingDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.buildConfName=Basic 3, -Dteamcity.buildType.id=IgniteTests24Java8_Basic3, -Dteamcity.configuration.properties.file=/opt/buildagent/temp/buildTmp/teamcity.config5591980786735343870.properties, -Dteamcity.maven.userSettings.path=/opt/buildagent/temp/buildTmp/maven_settings_585072866407032347.xml, -Dteamcity.maven.watcher.home=/opt/buildagent/plugins/mavenPlugin/maven-watcher-jdk16, -Dteamcity.projectName=Ignite Tests 2.x (JDK 8/11), -Dteamcity.runner.properties.file=/opt/buildagent/temp/buildTmp/teamcity.runner9098465561618137420.properties, -Dteamcity.tests.recentlyFailedTests.file=/opt/buildagent/temp/buildTmp/testsToRunFirst3891775683130404069.txt, -Dteamcity.version=2021.2 (build 99542), -ea, -Xms2g, -Xmx2g, -XX:+HeapDumpOnOutOfMemoryError, -DIGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_TEST_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_UPDATE_NOTIFIER=false, -DIGNITE_NO_DISCO_ORDER=true, -DIGNITE_PERFORMANCE_SUGGESTIONS_DISABLED=true, -Djava.net.preferIPv4Stack=true, -DTEST_SCALE_FACTOR=1.0, -DIGNITE_TEST_PROP_LOG4J_FILE=log4j-tc-test.xml, -DIGNITE_QUIET=false, -DIGNITE_MARSHAL_BUFFERS_RECHECK=1000, -Dmaven.repo.local=/opt/buildagent/.m2/repository] [21:04:12] : [Step 4/5] [2021-11-19 21:04:12,164][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][IgniteKernal%grid-0] System cache's DataRegion size is configured to 40 MB. Use DataStorageConfiguration.systemRegionInitialSize property to change the setting. [21:04:12] : [Step 4/5] [2021-11-19 21:04:12,165][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][IgniteKernal%grid-0] Configured caches [in 'sysMemPlc' dataRegion: ['ignite-sys-cache']] [21:04:12]W: [org.apache.ignite:ignite-core] [2021-11-19 21:04:12,165][WARN ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][IgniteKernal%grid-0] Peer class loading is enabled (disable it in production for performance and deployment consistency reasons) [21:04:12] : [Step 4/5] [2021-11-19 21:04:12,166][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][IgniteKernal%grid-0] 3-rd party licenses can be found at: /opt/buildagent/work/7bc1c54bc719b67c/libs/licenses [21:04:12] : [Step 4/5] [2021-11-19 21:04:12,170][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][IgnitePluginProcessor] Configured plugins: [21:04:12] : [Step 4/5] [2021-11-19 21:04:12,170][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][IgnitePluginProcessor] ^-- StanByClusterTestProvider 1.0 [21:04:12] : [Step 4/5] [2021-11-19 21:04:12,170][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][IgnitePluginProcessor] ^-- null [21:04:12] : [Step 4/5] [2021-11-19 21:04:12,171][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][IgnitePluginProcessor] [21:04:12] : [Step 4/5] [2021-11-19 21:04:12,171][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][IgnitePluginProcessor] ^-- PageMemory tracker plugin 1.0 [21:04:12] : [Step 4/5] [2021-11-19 21:04:12,171][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][IgnitePluginProcessor] ^-- null [21:04:12] : [Step 4/5] [2021-11-19 21:04:12,171][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][IgnitePluginProcessor] [21:04:12] : [Step 4/5] [2021-11-19 21:04:12,171][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][IgnitePluginProcessor] ^-- TestDistibutedConfigurationPlugin 1.0 [21:04:12] : [Step 4/5] [2021-11-19 21:04:12,172][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][IgnitePluginProcessor] ^-- null [21:04:12] : [Step 4/5] [2021-11-19 21:04:12,172][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][IgnitePluginProcessor] [21:04:12] : [Step 4/5] [2021-11-19 21:04:12,172][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][IgnitePluginProcessor] ^-- NodeValidationPluginProvider 1.0 [21:04:12] : [Step 4/5] [2021-11-19 21:04:12,172][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][IgnitePluginProcessor] ^-- null [21:04:12] : [Step 4/5] [2021-11-19 21:04:12,172][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][IgnitePluginProcessor] [21:04:12] : [Step 4/5] [2021-11-19 21:04:12,173][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][FailureProcessor] Configured failure handler: [hnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]]] [21:04:12] : [Step 4/5] [2021-11-19 21:04:12,202][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][TcpCommunicationSpi] Successfully bound communication NIO server to TCP port [port=45130, locHost=/127.0.0.1, selectorsCnt=12, selectorSpins=0, pairedConn=false] [21:04:12]W: [org.apache.ignite:ignite-core] [2021-11-19 21:04:12,203][WARN ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][TcpCommunicationSpi] Message queue limit is set to 0 which may lead to potential OOMEs when running cache operations in FULL_ASYNC or PRIMARY_SYNC modes due to message queues growth on sender and receiver sides. [21:04:12] : [Step 4/5] [2021-11-19 21:04:12,220][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][GridCollisionManager] Collision resolution is disabled (all jobs will be activated upon arrival). [21:04:12] : [Step 4/5] [2021-11-19 21:04:12,220][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][IgniteKernal%grid-0] Security status [authentication=off, sandbox=off, tls/ssl=off] [21:04:12] : [Step 4/5] [2021-11-19 21:04:12,279][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:04:12] : [Step 4/5] [2021-11-19 21:04:12,365][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][MaintenanceProcessor] Resolved store directory for node persistent data: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0 [21:04:12] : [Step 4/5] [2021-11-19 21:04:12,366][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][CacheObjectBinaryProcessorImpl] Resolved directory for serialized binary metadata: /opt/buildagent/work/7bc1c54bc719b67c/work/db/binary_meta/grid_0 [21:04:12] : [Step 4/5] [2021-11-19 21:04:12,370][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0 [21:04:12] : [Step 4/5] [2021-11-19 21:04:12,371][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][FileWriteAheadLogManager] Resolved write ahead log work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0 [21:04:12] : [Step 4/5] [2021-11-19 21:04:12,372][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][FileWriteAheadLogManager] Resolved write ahead log archive directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0 [21:04:12] : [Step 4/5] [2021-11-19 21:04:12,374][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000005.wal [21:04:12] : [Step 4/5] [2021-11-19 21:04:12,374][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000006.wal [21:04:12] : [Step 4/5] [2021-11-19 21:04:12,375][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000008.wal [21:04:12] : [Step 4/5] [2021-11-19 21:04:12,375][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000004.wal [21:04:12] : [Step 4/5] [2021-11-19 21:04:12,376][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000003.wal [21:04:12] : [Step 4/5] [2021-11-19 21:04:12,376][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000002.wal [21:04:12] : [Step 4/5] [2021-11-19 21:04:12,377][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000007.wal [21:04:12] : [Step 4/5] [2021-11-19 21:04:12,377][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000001.wal [21:04:12] : [Step 4/5] [2021-11-19 21:04:12,378][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000009.wal [21:04:12] : [Step 4/5] [2021-11-19 21:04:12,386][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][GridCacheDatabaseSharedManager] Configured data regions initialized successfully [total=5] [21:04:12] : [Step 4/5] [2021-11-19 21:04:12,387][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][IgniteSnapshotManager] Resolved snapshot work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/snapshots [21:04:12] : [Step 4/5] [2021-11-19 21:04:12,388][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][IgniteSnapshotManager] Resolved temp directory for snapshot creation: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0/snp [21:04:12] : [Step 4/5] [2021-11-19 21:04:12,390][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][ClientListenerProcessor] Client connector processor has started on TCP port 10800 [21:04:12] : [Step 4/5] [2021-11-19 21:04:12,395][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][IgniteKernal%grid-0] Non-loopback local IPs: 172.17.0.4 [21:04:12] : [Step 4/5] [2021-11-19 21:04:12,395][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][IgniteKernal%grid-0] Enabled local MACs: 0242AC110004 [21:04:12] : [Step 4/5] [2021-11-19 21:04:12,398][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=/opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0/cp/1637345052089-35c43ba7-d090-4bdb-b07d-896a2481a78f-START.bin, endMarker=/opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0/cp/1637345051416-bf962dc8-2bb0-423a-98c3-c737a659642a-END.bin] [21:04:12] : [Step 4/5] [2021-11-19 21:04:12,399][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:04:12] : [Step 4/5] [2021-11-19 21:04:12,399][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=1000207, len=11491], lastMarked=WALPointer [idx=0, fileOff=2422429, len=11491], lastCheckpointId=35c43ba7-d090-4bdb-b07d-896a2481a78f] [21:04:12] : [Step 4/5] [2021-11-19 21:04:12,512][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][GridCacheDatabaseSharedManager] Found last checkpoint marker [cpId=35c43ba7-d090-4bdb-b07d-896a2481a78f, pos=WALPointer [idx=0, fileOff=2422429, len=11491]] [21:04:12] : [Step 4/5] [2021-11-19 21:04:12,520][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][GridCacheDatabaseSharedManager] Applying lost metastore updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=2422429, len=11491], lastCheckpointId=35c43ba7-d090-4bdb-b07d-896a2481a78f] [21:04:12] : [Step 4/5] [2021-11-19 21:04:12,572][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=61 ms] [21:04:12] : [Step 4/5] [2021-11-19 21:04:12,573][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][GridCacheProcessor] Restoring partition state for local groups. [21:04:12] : [Step 4/5] [2021-11-19 21:04:12,573][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=0, partitionsProcessed=0, time=0ms] [21:04:12] : [Step 4/5] [2021-11-19 21:04:12,762][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][GridClusterStateProcessor] Restoring history for BaselineTopology[id=0] [21:04:12] : [Step 4/5] [2021-11-19 21:04:12,771][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][ClusterProcessor] Cluster ID and tag has been read from metastorage: ClusterIdAndTag [id=e59705b4-217a-49b7-8688-11f7b94dd438, tag=pensive_kilby] [21:04:12] : [Step 4/5] [2021-11-19 21:04:12,771][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][IgniteClusterImpl] Shutdown policy was updated [oldVal=null, newVal=null] [21:04:12] : [Step 4/5] [2021-11-19 21:04:12,772][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustEnabled' was changed from 'null' to 'false' [21:04:12] : [Step 4/5] [2021-11-19 21:04:12,772][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustTimeout' was changed from 'null' to '300000' [21:04:12] : [Step 4/5] [2021-11-19 21:04:12,772][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][IgniteTxManager] Transactions parameter 'txOwnerDumpRequestsAllowed' was changed from 'null' to 'true' [21:04:12] : [Step 4/5] [2021-11-19 21:04:12,772][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][IgniteTxManager] Transactions parameter 'longOperationsDumpTimeout' was changed from 'null' to '60000' [21:04:12] : [Step 4/5] [2021-11-19 21:04:12,773][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpThreshold' was changed from 'null' to '0' [21:04:12] : [Step 4/5] [2021-11-19 21:04:12,773][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][IgniteTxManager] Transactions parameter 'transactionTimeDumpSamplesCoefficient' was changed from 'null' to '0.0' [21:04:12] : [Step 4/5] [2021-11-19 21:04:12,774][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpSamplesPerSecondLimit' was changed from 'null' to '5' [21:04:12] : [Step 4/5] [2021-11-19 21:04:12,774][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][IgniteTxManager] Transactions parameter 'collisionsDumpInterval' was changed from 'null' to '1000' [21:04:12] : [Step 4/5] [2021-11-19 21:04:12,774][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][GridCacheDatabaseSharedManager] Historical rebalance WAL threshold changed [property=historical.rebalance.threshold, oldVal=null, newVal=500] [21:04:12] : [Step 4/5] [2021-11-19 21:04:12,775][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][GridCacheDatabaseSharedManager] Checkpoint frequency deviation changed [oldVal=null, newVal=null] [21:04:12] : [Step 4/5] [2021-11-19 21:04:12,775][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][FilePageStoreManager] Cleanup cache stores [total=1, left=0, cleanFiles=false] [21:04:12] : [Step 4/5] [2021-11-19 21:04:12,778][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:04:12] : [Step 4/5] [2021-11-19 21:04:12,779][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:04:12] : [Step 4/5] [2021-11-19 21:04:12,780][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:04:12] : [Step 4/5] [2021-11-19 21:04:12,780][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][GridCacheDatabaseSharedManager] Data Regions Started: 5 [21:04:12] : [Step 4/5] [2021-11-19 21:04:12,781][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][GridCacheDatabaseSharedManager] ^-- sysMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:04:12] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:04:12] : [Step 4/5] ^-- default region [type=default, persistence=true, lazyAlloc=true, [21:04:12] : [Step 4/5] ... initCfg=10MB, maxCfg=10MB, usedRam=0MB, freeRam=100%, allocRam=0MB, allocTotal=0MB] [21:04:12] : [Step 4/5] ^-- metastoreMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:04:12] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:04:12] : [Step 4/5] ^-- TxLog region [type=internal, persistence=true, lazyAlloc=false, [21:04:12] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:04:12] : [Step 4/5] ^-- volatileDsMemPlc region [type=user, persistence=false, lazyAlloc=true, [21:04:12] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB] [21:04:12] : [Step 4/5] ^-- Ignite persistence [used=0MB] [21:04:12] : [Step 4/5] [21:04:12] : [Step 4/5] [2021-11-19 21:04:12,782][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][GridCacheDatabaseSharedManager] Starting binary memory restore for: [-2100569601, -1237460590] [21:04:12] : [Step 4/5] [2021-11-19 21:04:12,854][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=/opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0/cp/1637345052089-35c43ba7-d090-4bdb-b07d-896a2481a78f-START.bin, endMarker=/opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0/cp/1637345051416-bf962dc8-2bb0-423a-98c3-c737a659642a-END.bin] [21:04:12] : [Step 4/5] [2021-11-19 21:04:12,855][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=1000207, len=11491], lastMarked=WALPointer [idx=0, fileOff=2422429, len=11491], lastCheckpointId=35c43ba7-d090-4bdb-b07d-896a2481a78f] [21:04:12]W: [org.apache.ignite:ignite-core] [2021-11-19 21:04:12,905][WARN ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][GridCacheDatabaseSharedManager] Ignite node stopped in the middle of checkpoint. Will restore memory state and finish checkpoint on node start. [21:04:12] : [Step 4/5] [2021-11-19 21:04:12,906][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][PageMemoryImpl] Started page memory [memoryAllocated=24.0 MiB, pages=5952, tableSize=474.2 KiB, replacementSize=768 B, checkpointBuffer=10.0 MiB] [21:04:12] : [Step 4/5] [2021-11-19 21:04:12,993][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][GridCacheDatabaseSharedManager] Found last checkpoint marker [cpId=35c43ba7-d090-4bdb-b07d-896a2481a78f, pos=WALPointer [idx=0, fileOff=2422429, len=11491]] [21:04:12] : [Step 4/5] [2021-11-19 21:04:12,997][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][GridCacheDatabaseSharedManager] Finished applying memory changes [changesApplied=504, time=91 ms] [21:04:13] : [Step 4/5] [2021-11-19 21:04:13,483][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][CheckpointWorkflow] Checkpoint finished [cpId=35c43ba7-d090-4bdb-b07d-896a2481a78f, pages=392, markPos=WALPointer [idx=0, fileOff=2422429, len=11491], pagesWrite=2ms, fsync=464ms, total=466ms] [21:04:13] : [Step 4/5] [2021-11-19 21:04:13,484][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][GridCacheDatabaseSharedManager] Binary memory state restored at node startup [restoredPtr=WALPointer [idx=0, fileOff=2433920, len=0]] [21:04:13] : [Step 4/5] [2021-11-19 21:04:13,486][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000000.wal, offset=2433920, ver=2] [21:04:13] : [Step 4/5] [2021-11-19 21:04:13,491][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][GridCacheProcessor] Started cache in recovery mode [name=ignite-sys-cache, id=-2100569601, dataRegionName=sysMemPlc, mode=REPLICATED, atomicity=TRANSACTIONAL, backups=2147483647, mvcc=false] [21:04:13] : [Step 4/5] [2021-11-19 21:04:13,495][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][GridCacheProcessor] Started cache in recovery mode [name=encrypted2, id=-1512636690, group=group1, dataRegionName=default, mode=PARTITIONED, atomicity=ATOMIC, backups=0, mvcc=false] [21:04:13] : [Step 4/5] [2021-11-19 21:04:13,497][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][GridCacheDatabaseSharedManager] Binary recovery performed in 715 ms. [21:04:13] : [Step 4/5] [2021-11-19 21:04:13,498][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=/opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0/cp/1637345052089-35c43ba7-d090-4bdb-b07d-896a2481a78f-START.bin, endMarker=/opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0/cp/1637345052089-35c43ba7-d090-4bdb-b07d-896a2481a78f-END.bin] [21:04:13] : [Step 4/5] [2021-11-19 21:04:13,498][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][GridCacheDatabaseSharedManager] Applying lost cache updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=2422429, len=11491], lastCheckpointId=35c43ba7-d090-4bdb-b07d-896a2481a78f] [21:04:13] : [Step 4/5] [2021-11-19 21:04:13,557][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=63 ms] [21:04:13] : [Step 4/5] [2021-11-19 21:04:13,557][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][GridCacheProcessor] Restoring partition state for local groups. [21:04:13] : [Step 4/5] [2021-11-19 21:04:13,585][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=2, partitionsProcessed=1124, time=20ms] [21:04:13] : [Step 4/5] [2021-11-19 21:04:13,590][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][TestTcpDiscoverySpi] Successfully bound to TCP port [port=47500, localHost=localhost/127.0.0.1, locNodeId=00a846de-a112-4c0f-aaa0-2732afb68000] [21:04:13] : [Step 4/5] [2021-11-19 21:04:13,592][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][GridEncryptionManager] Sending stored group keys to coordinator [grps=-1237460590] [21:04:13] : [Step 4/5] [2021-11-19 21:04:13,601][INFO ][disco-notifier-worker-#7001%grid-0%][MvccProcessorImpl] Assigned mvcc coordinator [crd=MvccCoordinator [topVer=AffinityTopologyVersion [topVer=1, minorTopVer=0], nodeId=00a846de-a112-4c0f-aaa0-2732afb68000, ver=1637345053599, local=true, initialized=false]] [21:04:13] : [Step 4/5] [2021-11-19 21:04:13,602][INFO ][sys-#6989%grid-0%][ClusterProcessor] Writing cluster ID and tag to metastorage on ready for write ClusterIdAndTag [id=e59705b4-217a-49b7-8688-11f7b94dd438, tag=pensive_kilby] [21:04:13] : [Step 4/5] [2021-11-19 21:04:13,619][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][IgniteKernal%grid-0] To start Console Management & Monitoring run ignitevisorcmd.{sh|bat} [21:04:13] : [Step 4/5] [2021-11-19 21:04:13,620][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][IgniteKernal%grid-0] [21:04:13] : [Step 4/5] [21:04:13] : [Step 4/5] >>> +-------------------------------------------+ [21:04:13] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:04:13] : [Step 4/5] >>> +-------------------------------------------+ [21:04:13] : [Step 4/5] >>> OS name: Linux 4.15.0-151-generic amd64 [21:04:13] : [Step 4/5] >>> CPU(s): 24 [21:04:13] : [Step 4/5] >>> Heap: 2.0GB [21:04:13] : [Step 4/5] >>> VM name: 16724@c4dfe9a430b2 [21:04:13] : [Step 4/5] >>> Ignite instance name: grid-0 [21:04:13] : [Step 4/5] >>> Local node [ID=00A846DE-A112-4C0F-AAA0-2732AFB68000, order=1, clientMode=false] [21:04:13] : [Step 4/5] >>> Local node addresses: [127.0.0.1] [21:04:13] : [Step 4/5] >>> Local ports: TCP:10800 TCP:45130 TCP:47500 [21:04:13] : [Step 4/5] [21:04:13] : [Step 4/5] [2021-11-19 21:04:13,620][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][IgniteKernal%grid-0] >>> Ignite cluster is in INACTIVE state (limited functionality available). Use control.(sh|bat) script or IgniteCluster.state(ClusterState.ACTIVE) to change the state. [21:04:13] : [Step 4/5] [2021-11-19 21:04:13,621][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][GridDiscoveryManager] Topology snapshot [ver=1, locNode=00a846de, servers=1, clients=0, state=INACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=00a846de-a112-4c0f-aaa0-2732afb68000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:04:13] : [Step 4/5] [2021-11-19 21:04:13,622][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][GridDiscoveryManager] ^-- Baseline [id=0, size=2, online=1, offline=1] [21:04:13] : [Step 4/5] [2021-11-19 21:04:13,622][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][GridDiscoveryManager] ^-- 1 nodes left for auto-activation [grid-1] [21:04:13] : [Step 4/5] [2021-11-19 21:04:13,622][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][G] Node started : [stage="Configure system pool" (0 ms),stage="Start managers" (221 ms),stage="Configure binary metadata" (1 ms),stage="Start processors" (26 ms),stage="Start 'StanByClusterTestProvider' plugin" (0 ms),stage="Start 'PageMemory tracker plugin' plugin" (0 ms),stage="Start 'TestDistibutedConfigurationPlugin' plugin" (0 ms),stage="Start 'NodeValidationPluginProvider' plugin" (0 ms),stage="Init metastore" (381 ms),stage="Init and start regions" (6 ms),stage="Restore binary memory" (715 ms),stage="Restore logical state" (88 ms),stage="Finish recovery" (2 ms),stage="Join topology" (13 ms),stage="Await transition" (2 ms),stage="Await exchange" (17 ms),stage="Total time" (1472 ms)] [21:04:13] : [Step 4/5] [2021-11-19 21:04:13,623][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][root] Node started with the following configuration [id=00a846de-a112-4c0f-aaa0-2732afb68000, marshaller=BinaryMarshaller [], discovery=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=5000, ackTimeout=5000, marsh=JdkMarshaller [clsFilter=org.apache.ignite.marshaller.MarshallerUtils$1@2237def0], reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], binaryCfg=null, lateAff=true] [21:04:13]W: [org.apache.ignite:ignite-core] [2021-11-19 21:04:13,629][WARN ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][G] Ignite work directory is not provided, automatically resolved to: /opt/buildagent/work/7bc1c54bc719b67c/work [21:04:13] : [Step 4/5] [2021-11-19 21:04:13,630][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][IgniteKernal%grid-1] [21:04:13] : [Step 4/5] [21:04:13] : [Step 4/5] >>> __________ ________________ [21:04:13] : [Step 4/5] >>> / _/ ___/ |/ / _/_ __/ __/ [21:04:13] : [Step 4/5] >>> _/ // (7 7 // / / / / _/ [21:04:13] : [Step 4/5] >>> /___/\___/_/|_/___/ /_/ /___/ [21:04:13] : [Step 4/5] >>> [21:04:13] : [Step 4/5] >>> ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:04:13] : [Step 4/5] >>> 2021 Copyright(C) Apache Software Foundation [21:04:13] : [Step 4/5] >>> [21:04:13] : [Step 4/5] >>> Ignite documentation: http://ignite.apache.org [21:04:13] : [Step 4/5] [21:04:13] : [Step 4/5] [2021-11-19 21:04:13,630][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][IgniteKernal%grid-1] Config URL: n/a [21:04:13] : [Step 4/5] [2021-11-19 21:04:13,631][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][IgniteKernal%grid-1] IgniteConfiguration [igniteInstanceName=grid-1, pubPoolSize=24, svcPoolSize=24, callbackPoolSize=24, stripedPoolSize=24, sysPoolSize=24, mgmtPoolSize=4, dataStreamerPoolSize=24, utilityCachePoolSize=24, utilityCacheKeepAliveTime=60000, p2pPoolSize=2, qryPoolSize=24, buildIdxPoolSize=4, igniteHome=/opt/buildagent/work/7bc1c54bc719b67c, igniteWorkDir=/opt/buildagent/work/7bc1c54bc719b67c/work, mbeanSrv=com.sun.jmx.mbeanserver.JmxMBeanServer@6fe85038, nodeId=10b7df72-13e6-4409-9a62-0a02c743f001, marsh=BinaryMarshaller [], marshLocJobs=false, daemon=false, p2pEnabled=true, netTimeout=10000, netCompressionLevel=1, sndRetryDelay=1000, sndRetryCnt=3, metricsHistSize=10000, metricsUpdateFreq=1000, metricsExpTime=9223372036854775807, discoSpi=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=0, ackTimeout=0, marsh=null, reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], segPlc=STOP, segResolveAttempts=2, waitForSegOnStart=true, allResolversPassReq=true, segChkFreq=10000, commSpi=TcpCommunicationSpi [connectGate=org.apache.ignite.spi.communication.tcp.internal.ConnectGateway@7ad260ac, ctxInitLatch=java.util.concurrent.CountDownLatch@2b84837f[Count = 1], stopping=false, clientPool=null, nioSrvWrapper=null, stateProvider=null], evtSpi=MemoryEventStorageSpi [expireAgeMs=9223372036854775807, expireCnt=10000, filter=null], colSpi=NoopCollisionSpi [], deploySpi=LocalDeploymentSpi [], indexingSpi=org.apache.ignite.spi.indexing.noop.NoopIndexingSpi@437778, addrRslvr=null, encryptionSpi=org.apache.ignite.spi.encryption.keystore.KeystoreEncryptionSpi@47dd677d, tracingSpi=org.apache.ignite.spi.tracing.NoopTracingSpi@4bf3ac10, clientMode=false, rebalanceThreadPoolSize=4, rebalanceTimeout=10000, rebalanceBatchesPrefetchCnt=3, rebalanceThrottle=0, rebalanceBatchSize=524288, txCfg=TransactionConfiguration [txSerEnabled=false, dfltIsolation=REPEATABLE_READ, dfltConcurrency=PESSIMISTIC, dfltTxTimeout=0, txTimeoutOnPartitionMapExchange=0, deadlockTimeout=10000, pessimisticTxLogSize=0, pessimisticTxLogLinger=10000, tmLookupClsName=null, txManagerFactory=null, useJtaSync=false], cacheSanityCheckEnabled=true, discoStartupDelay=60000, deployMode=SHARED, p2pMissedCacheSize=100, locHost=127.0.0.1, timeSrvPortBase=31100, timeSrvPortRange=100, failureDetectionTimeout=10000, sysWorkerBlockedTimeout=null, clientFailureDetectionTimeout=10000, metricsLogFreq=0, connectorCfg=null, odbcCfg=null, warmupClos=null, atomicCfg=AtomicConfiguration [seqReserveSize=1000, cacheMode=PARTITIONED, backups=1, aff=null, grpName=null], classLdr=null, sslCtxFactory=null, platformCfg=null, binaryCfg=null, memCfg=null, pstCfg=null, dsCfg=DataStorageConfiguration [sysRegionInitSize=41943040, sysRegionMaxSize=104857600, pageSize=4096, concLvl=0, dfltDataRegConf=DataRegionConfiguration [name=default, maxSize=10485760, initSize=268435456, swapPath=null, pageEvictionMode=DISABLED, pageReplacementMode=CLOCK, evictionThreshold=0.9, emptyPagesPoolSize=100, metricsEnabled=false, metricsSubIntervalCount=5, metricsRateTimeInterval=60000, persistenceEnabled=true, checkpointPageBufSize=0, lazyMemoryAllocation=true, warmUpCfg=null], dataRegions=null, storagePath=null, checkpointFreq=180000, lockWaitTime=10000, checkpointThreads=4, checkpointWriteOrder=SEQUENTIAL, walHistSize=20, maxWalArchiveSize=1073741824, walSegments=10, walSegmentSize=67108864, walPath=db/wal, walArchivePath=db/wal/archive, cdcWalPath=db/wal/cdc, cdcEnabled=false, metricsEnabled=false, walMode=FSYNC, walTlbSize=131072, walBuffSize=0, walFlushFreq=2000, walFsyncDelay=1000, walRecordIterBuffSize=67108864, alwaysWriteFullPages=false, fileIOFactory=org.apache.ignite.internal.processors.cache.persistence.file.AsyncFileIOFactory@20358aee, metricsSubIntervalCnt=5, metricsRateTimeInterval=60000, walAutoArchiveAfterInactivity=-1, walForceArchiveTimeout=-1, writeThrottlingEnabled=false, walCompactionEnabled=false, walCompactionLevel=1, checkpointReadLockTimeout=null, walPageCompression=DISABLED, walPageCompressionLevel=null, dfltWarmUpCfg=null, encCfg=org.apache.ignite.configuration.EncryptionConfiguration@432718d9, defragmentationThreadPoolSize=4, minWalArchiveSize=-1], snapshotPath=snapshots, activeOnStart=true, activeOnStartPropSetFlag=false, autoActivation=true, autoActivationPropSetFlag=false, clusterStateOnStart=null, sqlConnCfg=null, cliConnCfg=ClientConnectorConfiguration [host=null, port=10800, portRange=100, sockSndBufSize=0, sockRcvBufSize=0, tcpNoDelay=true, maxOpenCursorsPerConn=128, threadPoolSize=24, selectorCnt=12, idleTimeout=0, handshakeTimeout=10000, jdbcEnabled=true, odbcEnabled=true, thinCliEnabled=true, sslEnabled=false, useIgniteSslCtxFactory=true, sslClientAuth=false, sslCtxFactory=null, thinCliCfg=ThinClientConfiguration [maxActiveTxPerConn=100, maxActiveComputeTasksPerConn=0]], mvccVacuumThreadCnt=2, mvccVacuumFreq=5000, authEnabled=false, failureHnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]], commFailureRslvr=null, sqlCfg=SqlConfiguration [longQryWarnTimeout=3000, dfltQryTimeout=0, sqlQryHistSize=1000, validationEnabled=false], asyncContinuationExecutor=null] [21:04:13] : [Step 4/5] [2021-11-19 21:04:13,638][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][IgniteKernal%grid-1] Daemon mode: off [21:04:13] : [Step 4/5] [2021-11-19 21:04:13,638][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][IgniteKernal%grid-1] OS: Linux 4.15.0-151-generic amd64 [21:04:13] : [Step 4/5] [2021-11-19 21:04:13,638][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][IgniteKernal%grid-1] OS user: teamcity [21:04:13] : [Step 4/5] [2021-11-19 21:04:13,638][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][IgniteKernal%grid-1] PID: 16724 [21:04:13] : [Step 4/5] [2021-11-19 21:04:13,638][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][IgniteKernal%grid-1] Language runtime: Java Platform API Specification ver. 1.8 [21:04:13] : [Step 4/5] [2021-11-19 21:04:13,639][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][IgniteKernal%grid-1] VM information: Java(TM) SE Runtime Environment 1.8.0_261-b12 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 25.261-b12 [21:04:13] : [Step 4/5] [2021-11-19 21:04:13,639][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][IgniteKernal%grid-1] VM total memory: 1.9GB [21:04:13] : [Step 4/5] [2021-11-19 21:04:13,639][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][IgniteKernal%grid-1] Remote Management [restart: off, REST: off, JMX (remote: off)] [21:04:13] : [Step 4/5] [2021-11-19 21:04:13,639][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][IgniteKernal%grid-1] Logger: GridTestLog4jLogger [quiet=false, config=null] [21:04:13] : [Step 4/5] [2021-11-19 21:04:13,640][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][IgniteKernal%grid-1] IGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c [21:04:13] : [Step 4/5] [2021-11-19 21:04:13,640][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][IgniteKernal%grid-1] VM arguments: [-DIGNITE_DUMP_THREADS_ON_FAILURE=false, -DMono=/usr/bin/mono-sgen, -DMono4.0_x64=/usr/lib/mono/4.0, -DMono4.5_x64=/usr/lib/mono/4.5, -DMonoVersion=6.12.0.90, -DSKIP_BUILD=false, -Dagent.home.dir=/opt/buildagent, -Dagent.name=aitc-lin02_03, -Dagent.ownPort=9090, -Dagent.work.dir=/opt/buildagent/work, -Dbuild.number=95, -Dbuild.vcs.number=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.1=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.GitHubApacheIgnite=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dclassworlds.conf=/opt/buildagent/temp/buildTmp/teamcity.m2.conf, -Dcom.jetbrains.maven.watcher.report.file=/opt/buildagent/temp/buildTmp/maven-build-info.xml, -Djava.io.tmpdir=/opt/buildagent/temp/buildTmp, -Dmaven.home=/opt/buildagent/tools/maven3_6, -Dmaven.multiModuleProjectDirectory=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.agent.cpuBenchmark=457, -Dteamcity.agent.dotnet.agent_url=http://localhost:9090/RPC2, -Dteamcity.agent.dotnet.build_id=6278078, -Dteamcity.auth.password=*******, -Dteamcity.auth.userId=TeamCityBuildId=6278078, -Dteamcity.build.changedFiles.file=/opt/buildagent/temp/buildTmp/changedFiles6342607772318147725.txt, -Dteamcity.build.checkoutDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.build.id=6278078, -Dteamcity.build.properties.file=/opt/buildagent/temp/buildTmp/teamcity.build5164517880467851002.properties, -Dteamcity.build.tempDir=/opt/buildagent/temp/buildTmp, -Dteamcity.build.workingDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.buildConfName=Basic 3, -Dteamcity.buildType.id=IgniteTests24Java8_Basic3, -Dteamcity.configuration.properties.file=/opt/buildagent/temp/buildTmp/teamcity.config5591980786735343870.properties, -Dteamcity.maven.userSettings.path=/opt/buildagent/temp/buildTmp/maven_settings_585072866407032347.xml, -Dteamcity.maven.watcher.home=/opt/buildagent/plugins/mavenPlugin/maven-watcher-jdk16, -Dteamcity.projectName=Ignite Tests 2.x (JDK 8/11), -Dteamcity.runner.properties.file=/opt/buildagent/temp/buildTmp/teamcity.runner9098465561618137420.properties, -Dteamcity.tests.recentlyFailedTests.file=/opt/buildagent/temp/buildTmp/testsToRunFirst3891775683130404069.txt, -Dteamcity.version=2021.2 (build 99542), -ea, -Xms2g, -Xmx2g, -XX:+HeapDumpOnOutOfMemoryError, -DIGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_TEST_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_UPDATE_NOTIFIER=false, -DIGNITE_NO_DISCO_ORDER=true, -DIGNITE_PERFORMANCE_SUGGESTIONS_DISABLED=true, -Djava.net.preferIPv4Stack=true, -DTEST_SCALE_FACTOR=1.0, -DIGNITE_TEST_PROP_LOG4J_FILE=log4j-tc-test.xml, -DIGNITE_QUIET=false, -DIGNITE_MARSHAL_BUFFERS_RECHECK=1000, -Dmaven.repo.local=/opt/buildagent/.m2/repository] [21:04:13] : [Step 4/5] [2021-11-19 21:04:13,645][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][IgniteKernal%grid-1] System cache's DataRegion size is configured to 40 MB. Use DataStorageConfiguration.systemRegionInitialSize property to change the setting. [21:04:13] : [Step 4/5] [2021-11-19 21:04:13,645][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][IgniteKernal%grid-1] Configured caches [in 'sysMemPlc' dataRegion: ['ignite-sys-cache']] [21:04:13]W: [org.apache.ignite:ignite-core] [2021-11-19 21:04:13,646][WARN ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][IgniteKernal%grid-1] Peer class loading is enabled (disable it in production for performance and deployment consistency reasons) [21:04:13] : [Step 4/5] [2021-11-19 21:04:13,646][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][IgniteKernal%grid-1] 3-rd party licenses can be found at: /opt/buildagent/work/7bc1c54bc719b67c/libs/licenses [21:04:13] : [Step 4/5] [2021-11-19 21:04:13,651][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][IgnitePluginProcessor] Configured plugins: [21:04:13] : [Step 4/5] [2021-11-19 21:04:13,652][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][IgnitePluginProcessor] ^-- StanByClusterTestProvider 1.0 [21:04:13] : [Step 4/5] [2021-11-19 21:04:13,652][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][IgnitePluginProcessor] ^-- null [21:04:13] : [Step 4/5] [2021-11-19 21:04:13,652][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][IgnitePluginProcessor] [21:04:13] : [Step 4/5] [2021-11-19 21:04:13,652][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][IgnitePluginProcessor] ^-- PageMemory tracker plugin 1.0 [21:04:13] : [Step 4/5] [2021-11-19 21:04:13,652][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][IgnitePluginProcessor] ^-- null [21:04:13] : [Step 4/5] [2021-11-19 21:04:13,652][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][IgnitePluginProcessor] [21:04:13] : [Step 4/5] [2021-11-19 21:04:13,653][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][IgnitePluginProcessor] ^-- TestDistibutedConfigurationPlugin 1.0 [21:04:13] : [Step 4/5] [2021-11-19 21:04:13,653][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][IgnitePluginProcessor] ^-- null [21:04:13] : [Step 4/5] [2021-11-19 21:04:13,653][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][IgnitePluginProcessor] [21:04:13] : [Step 4/5] [2021-11-19 21:04:13,653][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][IgnitePluginProcessor] ^-- NodeValidationPluginProvider 1.0 [21:04:13] : [Step 4/5] [2021-11-19 21:04:13,653][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][IgnitePluginProcessor] ^-- null [21:04:13] : [Step 4/5] [2021-11-19 21:04:13,654][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][IgnitePluginProcessor] [21:04:13] : [Step 4/5] [2021-11-19 21:04:13,654][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][FailureProcessor] Configured failure handler: [hnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]]] [21:04:13] : [Step 4/5] [2021-11-19 21:04:13,684][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][TcpCommunicationSpi] Successfully bound communication NIO server to TCP port [port=45131, locHost=/127.0.0.1, selectorsCnt=12, selectorSpins=0, pairedConn=false] [21:04:13]W: [org.apache.ignite:ignite-core] [2021-11-19 21:04:13,685][WARN ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][TcpCommunicationSpi] Message queue limit is set to 0 which may lead to potential OOMEs when running cache operations in FULL_ASYNC or PRIMARY_SYNC modes due to message queues growth on sender and receiver sides. [21:04:13] : [Step 4/5] [2021-11-19 21:04:13,692][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][GridCollisionManager] Collision resolution is disabled (all jobs will be activated upon arrival). [21:04:13] : [Step 4/5] [2021-11-19 21:04:13,692][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][IgniteKernal%grid-1] Security status [authentication=off, sandbox=off, tls/ssl=off] [21:04:13] : [Step 4/5] [2021-11-19 21:04:13,767][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:04:13] : [Step 4/5] [2021-11-19 21:04:13,861][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][MaintenanceProcessor] Resolved store directory for node persistent data: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1 [21:04:13] : [Step 4/5] [2021-11-19 21:04:13,863][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][CacheObjectBinaryProcessorImpl] Resolved directory for serialized binary metadata: /opt/buildagent/work/7bc1c54bc719b67c/work/db/binary_meta/grid_1 [21:04:13] : [Step 4/5] [2021-11-19 21:04:13,867][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1 [21:04:13] : [Step 4/5] [2021-11-19 21:04:13,868][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][FileWriteAheadLogManager] Resolved write ahead log work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1 [21:04:13] : [Step 4/5] [2021-11-19 21:04:13,868][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][FileWriteAheadLogManager] Resolved write ahead log archive directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1 [21:04:13] : [Step 4/5] [2021-11-19 21:04:13,870][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000005.wal [21:04:13] : [Step 4/5] [2021-11-19 21:04:13,870][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000006.wal [21:04:13] : [Step 4/5] [2021-11-19 21:04:13,871][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000008.wal [21:04:13] : [Step 4/5] [2021-11-19 21:04:13,871][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000004.wal [21:04:13] : [Step 4/5] [2021-11-19 21:04:13,872][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000003.wal [21:04:13] : [Step 4/5] [2021-11-19 21:04:13,872][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000002.wal [21:04:13] : [Step 4/5] [2021-11-19 21:04:13,873][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000007.wal [21:04:13] : [Step 4/5] [2021-11-19 21:04:13,873][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000001.wal [21:04:13] : [Step 4/5] [2021-11-19 21:04:13,874][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000009.wal [21:04:13] : [Step 4/5] [2021-11-19 21:04:13,878][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][GridCacheDatabaseSharedManager] Configured data regions initialized successfully [total=5] [21:04:13] : [Step 4/5] [2021-11-19 21:04:13,879][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][IgniteSnapshotManager] Resolved snapshot work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/snapshots [21:04:13] : [Step 4/5] [2021-11-19 21:04:13,880][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][IgniteSnapshotManager] Resolved temp directory for snapshot creation: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1/snp [21:04:13] : [Step 4/5] [2021-11-19 21:04:13,882][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][ClientListenerProcessor] Client connector processor has started on TCP port 10801 [21:04:13] : [Step 4/5] [2021-11-19 21:04:13,885][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][IgniteKernal%grid-1] Non-loopback local IPs: 172.17.0.4 [21:04:13] : [Step 4/5] [2021-11-19 21:04:13,885][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][IgniteKernal%grid-1] Enabled local MACs: 0242AC110004 [21:04:13] : [Step 4/5] [2021-11-19 21:04:13,886][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=/opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1/cp/1637345052031-450ac813-503d-4a5f-9fdb-9f42f1b19e39-START.bin, endMarker=/opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1/cp/1637345051421-17526fe5-bd09-4306-966f-88d519f54dbb-END.bin] [21:04:13] : [Step 4/5] [2021-11-19 21:04:13,887][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:04:13] : [Step 4/5] [2021-11-19 21:04:13,888][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=834893, len=11871], lastMarked=WALPointer [idx=0, fileOff=1955168, len=11871], lastCheckpointId=450ac813-503d-4a5f-9fdb-9f42f1b19e39] [21:04:14] : [Step 4/5] [2021-11-19 21:04:14,006][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][GridCacheDatabaseSharedManager] Found last checkpoint marker [cpId=450ac813-503d-4a5f-9fdb-9f42f1b19e39, pos=WALPointer [idx=0, fileOff=1955168, len=11871]] [21:04:14] : [Step 4/5] [2021-11-19 21:04:14,016][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][GridCacheDatabaseSharedManager] Applying lost metastore updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=1955168, len=11871], lastCheckpointId=450ac813-503d-4a5f-9fdb-9f42f1b19e39] [21:04:14] : [Step 4/5] [2021-11-19 21:04:14,072][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=51 ms] [21:04:14] : [Step 4/5] [2021-11-19 21:04:14,072][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][GridCacheProcessor] Restoring partition state for local groups. [21:04:14] : [Step 4/5] [2021-11-19 21:04:14,072][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=0, partitionsProcessed=0, time=0ms] [21:04:14] : [Step 4/5] [2021-11-19 21:04:14,218][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][GridClusterStateProcessor] Restoring history for BaselineTopology[id=0] [21:04:14] : [Step 4/5] [2021-11-19 21:04:14,221][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][ClusterProcessor] Cluster ID and tag has been read from metastorage: ClusterIdAndTag [id=e59705b4-217a-49b7-8688-11f7b94dd438, tag=pensive_kilby] [21:04:14] : [Step 4/5] [2021-11-19 21:04:14,221][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][IgniteClusterImpl] Shutdown policy was updated [oldVal=null, newVal=null] [21:04:14] : [Step 4/5] [2021-11-19 21:04:14,221][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustEnabled' was changed from 'null' to 'false' [21:04:14] : [Step 4/5] [2021-11-19 21:04:14,222][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustTimeout' was changed from 'null' to '300000' [21:04:14] : [Step 4/5] [2021-11-19 21:04:14,222][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][IgniteTxManager] Transactions parameter 'txOwnerDumpRequestsAllowed' was changed from 'null' to 'true' [21:04:14] : [Step 4/5] [2021-11-19 21:04:14,222][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][IgniteTxManager] Transactions parameter 'longOperationsDumpTimeout' was changed from 'null' to '60000' [21:04:14] : [Step 4/5] [2021-11-19 21:04:14,223][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpThreshold' was changed from 'null' to '0' [21:04:14] : [Step 4/5] [2021-11-19 21:04:14,223][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][IgniteTxManager] Transactions parameter 'transactionTimeDumpSamplesCoefficient' was changed from 'null' to '0.0' [21:04:14] : [Step 4/5] [2021-11-19 21:04:14,223][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpSamplesPerSecondLimit' was changed from 'null' to '5' [21:04:14] : [Step 4/5] [2021-11-19 21:04:14,224][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][IgniteTxManager] Transactions parameter 'collisionsDumpInterval' was changed from 'null' to '1000' [21:04:14] : [Step 4/5] [2021-11-19 21:04:14,224][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][GridCacheDatabaseSharedManager] Historical rebalance WAL threshold changed [property=historical.rebalance.threshold, oldVal=null, newVal=500] [21:04:14] : [Step 4/5] [2021-11-19 21:04:14,224][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][GridCacheDatabaseSharedManager] Checkpoint frequency deviation changed [oldVal=null, newVal=null] [21:04:14] : [Step 4/5] [2021-11-19 21:04:14,225][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][FilePageStoreManager] Cleanup cache stores [total=1, left=0, cleanFiles=false] [21:04:14] : [Step 4/5] [2021-11-19 21:04:14,228][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:04:14] : [Step 4/5] [2021-11-19 21:04:14,229][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:04:14] : [Step 4/5] [2021-11-19 21:04:14,234][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:04:14] : [Step 4/5] [2021-11-19 21:04:14,234][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][GridCacheDatabaseSharedManager] Data Regions Started: 5 [21:04:14] : [Step 4/5] [2021-11-19 21:04:14,235][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][GridCacheDatabaseSharedManager] ^-- sysMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:04:14] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:04:14] : [Step 4/5] ^-- default region [type=default, persistence=true, lazyAlloc=true, [21:04:14] : [Step 4/5] ... initCfg=10MB, maxCfg=10MB, usedRam=0MB, freeRam=100%, allocRam=0MB, allocTotal=0MB] [21:04:14] : [Step 4/5] ^-- metastoreMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:04:14] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:04:14] : [Step 4/5] ^-- TxLog region [type=internal, persistence=true, lazyAlloc=false, [21:04:14] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:04:14] : [Step 4/5] ^-- volatileDsMemPlc region [type=user, persistence=false, lazyAlloc=true, [21:04:14] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB] [21:04:14] : [Step 4/5] ^-- Ignite persistence [used=0MB] [21:04:14] : [Step 4/5] [21:04:14] : [Step 4/5] [2021-11-19 21:04:14,236][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][GridCacheDatabaseSharedManager] Starting binary memory restore for: [-2100569601, -1237460590] [21:04:14] : [Step 4/5] [2021-11-19 21:04:14,296][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=/opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1/cp/1637345052031-450ac813-503d-4a5f-9fdb-9f42f1b19e39-START.bin, endMarker=/opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1/cp/1637345051421-17526fe5-bd09-4306-966f-88d519f54dbb-END.bin] [21:04:14] : [Step 4/5] [2021-11-19 21:04:14,296][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=834893, len=11871], lastMarked=WALPointer [idx=0, fileOff=1955168, len=11871], lastCheckpointId=450ac813-503d-4a5f-9fdb-9f42f1b19e39] [21:04:14]W: [org.apache.ignite:ignite-core] [2021-11-19 21:04:14,343][WARN ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][GridCacheDatabaseSharedManager] Ignite node stopped in the middle of checkpoint. Will restore memory state and finish checkpoint on node start. [21:04:14] : [Step 4/5] [2021-11-19 21:04:14,344][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][PageMemoryImpl] Started page memory [memoryAllocated=24.0 MiB, pages=5952, tableSize=474.2 KiB, replacementSize=768 B, checkpointBuffer=10.0 MiB] [21:04:14] : [Step 4/5] [2021-11-19 21:04:14,414][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][GridCacheDatabaseSharedManager] Found last checkpoint marker [cpId=450ac813-503d-4a5f-9fdb-9f42f1b19e39, pos=WALPointer [idx=0, fileOff=1955168, len=11871]] [21:04:14] : [Step 4/5] [2021-11-19 21:04:14,418][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][GridCacheDatabaseSharedManager] Finished applying memory changes [changesApplied=396, time=80 ms] [21:04:14] : [Step 4/5] [2021-11-19 21:04:14,801][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][CheckpointWorkflow] Checkpoint finished [cpId=450ac813-503d-4a5f-9fdb-9f42f1b19e39, pages=308, markPos=WALPointer [idx=0, fileOff=1955168, len=11871], pagesWrite=-2ms, fsync=374ms, total=372ms] [21:04:14] : [Step 4/5] [2021-11-19 21:04:14,802][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][GridCacheDatabaseSharedManager] Binary memory state restored at node startup [restoredPtr=WALPointer [idx=0, fileOff=1967039, len=0]] [21:04:14] : [Step 4/5] [2021-11-19 21:04:14,804][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000000.wal, offset=1967039, ver=2] [21:04:14] : [Step 4/5] [2021-11-19 21:04:14,806][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][GridCacheProcessor] Started cache in recovery mode [name=ignite-sys-cache, id=-2100569601, dataRegionName=sysMemPlc, mode=REPLICATED, atomicity=TRANSACTIONAL, backups=2147483647, mvcc=false] [21:04:14] : [Step 4/5] [2021-11-19 21:04:14,809][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][GridCacheProcessor] Started cache in recovery mode [name=encrypted2, id=-1512636690, group=group1, dataRegionName=default, mode=PARTITIONED, atomicity=ATOMIC, backups=0, mvcc=false] [21:04:14] : [Step 4/5] [2021-11-19 21:04:14,809][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][GridCacheDatabaseSharedManager] Binary recovery performed in 573 ms. [21:04:14] : [Step 4/5] [2021-11-19 21:04:14,810][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=/opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1/cp/1637345052031-450ac813-503d-4a5f-9fdb-9f42f1b19e39-START.bin, endMarker=/opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1/cp/1637345052031-450ac813-503d-4a5f-9fdb-9f42f1b19e39-END.bin] [21:04:14] : [Step 4/5] [2021-11-19 21:04:14,811][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][GridCacheDatabaseSharedManager] Applying lost cache updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=1955168, len=11871], lastCheckpointId=450ac813-503d-4a5f-9fdb-9f42f1b19e39] [21:04:14] : [Step 4/5] [2021-11-19 21:04:14,864][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=51 ms] [21:04:14] : [Step 4/5] [2021-11-19 21:04:14,864][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][GridCacheProcessor] Restoring partition state for local groups. [21:04:14] : [Step 4/5] [2021-11-19 21:04:14,905][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=2, partitionsProcessed=1124, time=40ms] [21:04:14] : [Step 4/5] [2021-11-19 21:04:14,908][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][TestTcpDiscoverySpi] Successfully bound to TCP port [port=47501, localHost=localhost/127.0.0.1, locNodeId=10b7df72-13e6-4409-9a62-0a02c743f001] [21:04:14] : [Step 4/5] [2021-11-19 21:04:14,913][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][GridEncryptionManager] Sending stored group keys to coordinator [grps=-1237460590] [21:04:14] : [Step 4/5] [2021-11-19 21:04:14,917][INFO ][tcp-disco-srvr-[:47500]-#349%grid-0%-#7003%grid-0%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=52535] [21:04:14] : [Step 4/5] [2021-11-19 21:04:14,918][INFO ][tcp-disco-srvr-[:47500]-#349%grid-0%-#7003%grid-0%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=52535] [21:04:14] : [Step 4/5] [2021-11-19 21:04:14,920][INFO ][tcp-disco-sock-reader-[]-#355%grid-0%-#7123%grid-0%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:52535, rmtPort=52535] [21:04:14] : [Step 4/5] [2021-11-19 21:04:14,922][INFO ][tcp-disco-sock-reader-[10b7df72 127.0.0.1:52535]-#355%grid-0%-#7123%grid-0%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=10b7df72-13e6-4409-9a62-0a02c743f001, rmtAddr=/127.0.0.1:52535] [21:04:14] : [Step 4/5] [2021-11-19 21:04:14,928][INFO ][tcp-disco-srvr-[:47501]-#354%grid-1%-#7122%grid-1%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=44191] [21:04:14] : [Step 4/5] [2021-11-19 21:04:14,928][INFO ][tcp-disco-srvr-[:47501]-#354%grid-1%-#7122%grid-1%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=44191] [21:04:14] : [Step 4/5] [2021-11-19 21:04:14,929][INFO ][tcp-disco-sock-reader-[]-#356%grid-1%-#7124%grid-1%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:44191, rmtPort=44191] [21:04:14] : [Step 4/5] [2021-11-19 21:04:14,929][INFO ][tcp-disco-sock-reader-[]-#356%grid-1%-#7124%grid-1%][TestTcpDiscoverySpi] Received ping request from the remote node [rmtNodeId=00a846de-a112-4c0f-aaa0-2732afb68000, rmtAddr=/127.0.0.1:44191, rmtPort=44191] [21:04:14] : [Step 4/5] [2021-11-19 21:04:14,931][INFO ][tcp-disco-sock-reader-[]-#356%grid-1%-#7124%grid-1%][TestTcpDiscoverySpi] Finished writing ping response [rmtNodeId=00a846de-a112-4c0f-aaa0-2732afb68000, rmtAddr=/127.0.0.1:44191, rmtPort=44191] [21:04:14] : [Step 4/5] [2021-11-19 21:04:14,931][INFO ][tcp-disco-sock-reader-[10b7df72 127.0.0.1:52535]-#355%grid-0%-#7123%grid-0%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:52535, rmtPort=52535, rmtNodeId=10b7df72-13e6-4409-9a62-0a02c743f001] [21:04:14] : [Step 4/5] [2021-11-19 21:04:14,931][INFO ][tcp-disco-sock-reader-[]-#356%grid-1%-#7124%grid-1%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:44191, rmtPort=44191, rmtNodeId=null] [21:04:14] : [Step 4/5] [2021-11-19 21:04:14,948][INFO ][tcp-disco-msg-worker-[crd]-#348%grid-0%-#7002%grid-0%][TestTcpDiscoverySpi] New next node [newNext=TcpDiscoveryNode [id=10b7df72-13e6-4409-9a62-0a02c743f001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=0, intOrder=2, lastExchangeTime=1637345054921, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false]] [21:04:14] : [Step 4/5] [2021-11-19 21:04:14,949][INFO ][tcp-disco-srvr-[:47501]-#354%grid-1%-#7122%grid-1%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=38593] [21:04:14] : [Step 4/5] [2021-11-19 21:04:14,949][INFO ][tcp-disco-srvr-[:47501]-#354%grid-1%-#7122%grid-1%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=38593] [21:04:14] : [Step 4/5] [2021-11-19 21:04:14,950][INFO ][tcp-disco-sock-reader-[]-#357%grid-1%-#7125%grid-1%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:38593, rmtPort=38593] [21:04:14] : [Step 4/5] [2021-11-19 21:04:14,951][INFO ][tcp-disco-sock-reader-[00a846de 127.0.0.1:38593]-#357%grid-1%-#7125%grid-1%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=00a846de-a112-4c0f-aaa0-2732afb68000, rmtAddr=/127.0.0.1:38593] [21:04:14] : [Step 4/5] [2021-11-19 21:04:14,954][INFO ][tcp-disco-msg-worker-[]-#353%grid-1%-#7121%grid-1%][TestTcpDiscoverySpi] New next node [newNext=TcpDiscoveryNode [id=00a846de-a112-4c0f-aaa0-2732afb68000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345054952, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false]] [21:04:14] : [Step 4/5] [2021-11-19 21:04:14,955][INFO ][tcp-disco-srvr-[:47500]-#349%grid-0%-#7003%grid-0%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=60427] [21:04:14] : [Step 4/5] [2021-11-19 21:04:14,956][INFO ][tcp-disco-srvr-[:47500]-#349%grid-0%-#7003%grid-0%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=60427] [21:04:14] : [Step 4/5] [2021-11-19 21:04:14,956][INFO ][tcp-disco-sock-reader-[]-#358%grid-0%-#7126%grid-0%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:60427, rmtPort=60427] [21:04:14] : [Step 4/5] [2021-11-19 21:04:14,957][INFO ][tcp-disco-sock-reader-[10b7df72 127.0.0.1:60427]-#358%grid-0%-#7126%grid-0%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=10b7df72-13e6-4409-9a62-0a02c743f001, rmtAddr=/127.0.0.1:60427] [21:04:14] : [Step 4/5] [2021-11-19 21:04:14,960][INFO ][disco-event-worker-#7005%grid-0%][GridDiscoveryManager] Added new node to topology: TcpDiscoveryNode [id=10b7df72-13e6-4409-9a62-0a02c743f001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637345054921, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false] [21:04:14] : [Step 4/5] [2021-11-19 21:04:14,961][INFO ][disco-event-worker-#7005%grid-0%][GridDiscoveryManager] Topology snapshot [ver=2, locNode=00a846de, servers=2, clients=0, state=INACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=00a846de-a112-4c0f-aaa0-2732afb68000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=10b7df72-13e6-4409-9a62-0a02c743f001, consistentId=grid-1, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:04:14] : [Step 4/5] [2021-11-19 21:04:14,962][INFO ][disco-event-worker-#7005%grid-0%][GridDiscoveryManager] ^-- Baseline [id=0, size=2, online=2, offline=0] [21:04:14] : [Step 4/5] [2021-11-19 21:04:14,962][INFO ][disco-event-worker-#7005%grid-0%][GridDiscoveryManager] ^-- All baseline nodes are online, will start auto-activation [21:04:14] : [Step 4/5] [2021-11-19 21:04:14,967][INFO ][tcp-disco-msg-worker-[00a846de 127.0.0.1:47500]-#353%grid-1%-#7121%grid-1%][GridEncryptionManager] Skip group key received from coordinator. Already exists. [grp=-1237460590, keyId=0] [21:04:14] : [Step 4/5] [2021-11-19 21:04:14,968][INFO ][disco-notifier-worker-#7120%grid-1%][MvccProcessorImpl] Assigned mvcc coordinator [crd=MvccCoordinator [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=0], nodeId=00a846de-a112-4c0f-aaa0-2732afb68000, ver=1637345053599, local=false, initialized=false]] [21:04:14] : [Step 4/5] [2021-11-19 21:04:14,970][INFO ][disco-notifier-worker-#7120%grid-1%][GridClusterStateProcessor] Sending activate cluster request with BaselineTopology BaselineTopology [id=0, branchingHash=-2475315501, branchingType='Cluster activation', baselineNodes=[grid-1, grid-0]] [21:04:14] : [Step 4/5] [2021-11-19 21:04:14,973][INFO ][sys-#7107%grid-1%][ClusterProcessor] Writing cluster ID and tag to metastorage on ready for write ClusterIdAndTag [id=e59705b4-217a-49b7-8688-11f7b94dd438, tag=pensive_kilby] [21:04:14] : [Step 4/5] [2021-11-19 21:04:14,976][INFO ][disco-notifier-worker-#7001%grid-0%][GridClusterStateProcessor] Received activate cluster request with BaselineTopology[id=0] initiator node ID: 10b7df72-13e6-4409-9a62-0a02c743f001 [21:04:14] : [Step 4/5] [2021-11-19 21:04:14,976][INFO ][disco-notifier-worker-#7001%grid-0%][GridClusterStateProcessor] Started state transition: activate cluster [21:04:14] : [Step 4/5] [2021-11-19 21:04:14,977][INFO ][exchange-worker-#7006%grid-0%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], crd=true, evt=DISCOVERY_CUSTOM_EVT, evtNode=10b7df72-13e6-4409-9a62-0a02c743f001, customEvt=ChangeGlobalStateMessage [id=efd1d593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqId=628bcf78-e9be-4008-9f67-675c548d69fb, initiatingNodeId=10b7df72-13e6-4409-9a62-0a02c743f001, state=ACTIVE, baselineTopology=BaselineTopology [id=0, branchingHash=-2475315501, branchingType='Cluster activation', baselineNodes=[grid-1, grid-0]], forceChangeBaselineTopology=false, timestamp=1637345054970, forceDeactivation=true], allowMerge=false, exchangeFreeSwitch=false] [21:04:14] : [Step 4/5] [2021-11-19 21:04:14,977][INFO ][disco-notifier-worker-#7120%grid-1%][GridClusterStateProcessor] Received activate cluster request with BaselineTopology[id=0] initiator node ID: 10b7df72-13e6-4409-9a62-0a02c743f001 [21:04:14] : [Step 4/5] [2021-11-19 21:04:14,978][INFO ][exchange-worker-#7006%grid-0%][GridDhtPartitionsExchangeFuture] Start activation process [nodeId=00a846de-a112-4c0f-aaa0-2732afb68000, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]]. New state: ACTIVE [21:04:14] : [Step 4/5] [2021-11-19 21:04:14,979][INFO ][disco-notifier-worker-#7120%grid-1%][GridClusterStateProcessor] Started state transition: activate cluster [21:04:14] : [Step 4/5] [2021-11-19 21:04:14,979][INFO ][exchange-worker-#7006%grid-0%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0 [21:04:14] : [Step 4/5] [2021-11-19 21:04:14,984][INFO ][exchange-worker-#7006%grid-0%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000000.wal, offset=2433920, ver=2] [21:04:14] : [Step 4/5] [2021-11-19 21:04:14,988][INFO ][exchange-worker-#7006%grid-0%][GridClusterStateProcessor] Writing BaselineTopology[id=0] [21:04:14] : [Step 4/5] [2021-11-19 21:04:14,992][INFO ][exchange-worker-#7006%grid-0%][GridCacheDatabaseSharedManager] Finish recovery performed in 11 ms. [21:04:14] : [Step 4/5] [2021-11-19 21:04:14,992][INFO ][exchange-worker-#7131%grid-1%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], crd=false, evt=DISCOVERY_CUSTOM_EVT, evtNode=10b7df72-13e6-4409-9a62-0a02c743f001, customEvt=ChangeGlobalStateMessage [id=efd1d593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqId=628bcf78-e9be-4008-9f67-675c548d69fb, initiatingNodeId=10b7df72-13e6-4409-9a62-0a02c743f001, state=ACTIVE, baselineTopology=BaselineTopology [id=0, branchingHash=-2475315501, branchingType='Cluster activation', baselineNodes=[grid-1, grid-0]], forceChangeBaselineTopology=false, timestamp=1637345054970, forceDeactivation=true], allowMerge=false, exchangeFreeSwitch=false] [21:04:14] : [Step 4/5] [2021-11-19 21:04:14,994][INFO ][exchange-worker-#7131%grid-1%][GridDhtPartitionsExchangeFuture] Start activation process [nodeId=10b7df72-13e6-4409-9a62-0a02c743f001, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]]. New state: ACTIVE [21:04:14] : [Step 4/5] [2021-11-19 21:04:14,994][INFO ][exchange-worker-#7131%grid-1%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1 [21:04:14] : [Step 4/5] [2021-11-19 21:04:14,995][INFO ][exchange-worker-#7006%grid-0%][msg] Components activation performed in 16 ms. [21:04:14] : [Step 4/5] [2021-11-19 21:04:14,997][INFO ][sys-#7000%grid-0%][GridCacheProcessor] Finished recovery for cache [cache=ignite-sys-cache, grp=ignite-sys-cache, startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:04:14] : [Step 4/5] [2021-11-19 21:04:14,997][INFO ][exchange-worker-#7006%grid-0%][GridCacheProcessor] Finished recovery for cache [cache=encrypted2, grp=group1, startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:04:15] : [Step 4/5] [2021-11-19 21:04:15,000][INFO ][exchange-worker-#7006%grid-0%][GridDhtPartitionsExchangeFuture] Successfully activated caches [nodeId=00a846de-a112-4c0f-aaa0-2732afb68000, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], newState=ACTIVE] [21:04:15]W: [org.apache.ignite:ignite-core] [2021-11-19 21:04:14,999][WARN ][exchange-worker-#7006%grid-0%][CacheAffinitySharedManager] Cache group 'group1' brings high overhead for its metainformation in data region 'default'. Metainformation required for its partitions (502 partitions, 4096 bytes per partition, 1 MBs total) will consume more than 15% of data region memory (10 MBs). It may lead to critical errors on the node and cluster instability. Please reduce number of partitions, add more memory to the data region or add more server nodes for this cache group. [21:04:15]W: [org.apache.ignite:ignite-core] [2021-11-19 21:04:15,001][WARN ][sys-#6982%grid-0%][CacheAffinitySharedManager] Cache group 'group1' brings high overhead for its metainformation in data region 'default'. Metainformation required for its partitions (502 partitions, 4096 bytes per partition, 1 MBs total) will consume more than 15% of data region memory (10 MBs). It may lead to critical errors on the node and cluster instability. Please reduce number of partitions, add more memory to the data region or add more server nodes for this cache group. [21:04:15] : [Step 4/5] [2021-11-19 21:04:15,002][INFO ][exchange-worker-#7006%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:04:15] : [Step 4/5] [2021-11-19 21:04:15,003][INFO ][exchange-worker-#7131%grid-1%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000000.wal, offset=1967039, ver=2] [21:04:15] : [Step 4/5] [2021-11-19 21:04:15,004][INFO ][exchange-worker-#7131%grid-1%][GridClusterStateProcessor] Writing BaselineTopology[id=0] [21:04:15] : [Step 4/5] [2021-11-19 21:04:15,005][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][IgniteKernal%grid-1] To start Console Management & Monitoring run ignitevisorcmd.{sh|bat} [21:04:15] : [Step 4/5] [2021-11-19 21:04:15,005][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][IgniteKernal%grid-1] [21:04:15] : [Step 4/5] [21:04:15] : [Step 4/5] >>> +-------------------------------------------+ [21:04:15] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:04:15] : [Step 4/5] >>> +-------------------------------------------+ [21:04:15] : [Step 4/5] >>> OS name: Linux 4.15.0-151-generic amd64 [21:04:15] : [Step 4/5] >>> CPU(s): 24 [21:04:15] : [Step 4/5] >>> Heap: 2.0GB [21:04:15] : [Step 4/5] >>> VM name: 16724@c4dfe9a430b2 [21:04:15] : [Step 4/5] >>> Ignite instance name: grid-1 [21:04:15] : [Step 4/5] >>> Local node [ID=10B7DF72-13E6-4409-9A62-0A02C743F001, order=2, clientMode=false] [21:04:15] : [Step 4/5] >>> Local node addresses: [127.0.0.1] [21:04:15] : [Step 4/5] >>> Local ports: TCP:10801 TCP:45131 TCP:47501 [21:04:15] : [Step 4/5] [21:04:15] : [Step 4/5] [2021-11-19 21:04:15,006][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][GridDiscoveryManager] Topology snapshot [ver=2, locNode=10b7df72, servers=2, clients=0, state=INACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=00a846de-a112-4c0f-aaa0-2732afb68000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=10b7df72-13e6-4409-9a62-0a02c743f001, consistentId=grid-1, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:04:15] : [Step 4/5] [2021-11-19 21:04:15,007][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][GridDiscoveryManager] ^-- Baseline [id=0, size=2, online=2, offline=0] [21:04:15] : [Step 4/5] [2021-11-19 21:04:15,007][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][GridDiscoveryManager] ^-- All baseline nodes are online, will start auto-activation [21:04:15] : [Step 4/5] [2021-11-19 21:04:15,007][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][G] Node started : [stage="Configure system pool" (0 ms),stage="Start managers" (233 ms),stage="Configure binary metadata" (2 ms),stage="Start processors" (19 ms),stage="Start 'StanByClusterTestProvider' plugin" (0 ms),stage="Start 'PageMemory tracker plugin' plugin" (0 ms),stage="Start 'TestDistibutedConfigurationPlugin' plugin" (0 ms),stage="Start 'NodeValidationPluginProvider' plugin" (0 ms),stage="Init metastore" (340 ms),stage="Init and start regions" (10 ms),stage="Restore binary memory" (573 ms),stage="Restore logical state" (95 ms),stage="Finish recovery" (1 ms),stage="Join topology" (61 ms),stage="Await transition" (6 ms),stage="Await exchange" (32 ms),stage="Total time" (1372 ms)] [21:04:15] : [Step 4/5] [2021-11-19 21:04:15,007][INFO ][exchange-worker-#7131%grid-1%][GridCacheDatabaseSharedManager] Finish recovery performed in 11 ms. [21:04:15] : [Step 4/5] [2021-11-19 21:04:15,009][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][root] Node started with the following configuration [id=10b7df72-13e6-4409-9a62-0a02c743f001, marshaller=BinaryMarshaller [], discovery=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=5000, ackTimeout=5000, marsh=JdkMarshaller [clsFilter=org.apache.ignite.marshaller.MarshallerUtils$1@31d9abde], reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], binaryCfg=null, lateAff=true] [21:04:15] : [Step 4/5] [2021-11-19 21:04:15,010][INFO ][exchange-worker-#7131%grid-1%][msg] Components activation performed in 16 ms. [21:04:15] : [Step 4/5] [2021-11-19 21:04:15,011][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][GridClusterStateProcessor] Sending activate cluster request with BaselineTopology BaselineTopology [id=0, branchingHash=-2475315501, branchingType='Cluster activation', baselineNodes=[grid-1, grid-0]] [21:04:15] : [Step 4/5] [2021-11-19 21:04:15,013][INFO ][exchange-worker-#7131%grid-1%][GridCacheProcessor] Finished recovery for cache [cache=ignite-sys-cache, grp=ignite-sys-cache, startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:04:15] : [Step 4/5] [2021-11-19 21:04:15,013][INFO ][disco-notifier-worker-#7001%grid-0%][GridClusterStateProcessor] Received activate cluster request with BaselineTopology[id=0] initiator node ID: 00a846de-a112-4c0f-aaa0-2732afb68000 [21:04:15] : [Step 4/5] [2021-11-19 21:04:15,013][INFO ][exchange-worker-#7006%grid-0%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], crd=true] [21:04:15] : [Step 4/5] [2021-11-19 21:04:15,013][INFO ][sys-#7098%grid-1%][GridCacheProcessor] Finished recovery for cache [cache=encrypted2, grp=group1, startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:04:15] : [Step 4/5] [2021-11-19 21:04:15,015][INFO ][disco-notifier-worker-#7120%grid-1%][GridClusterStateProcessor] Received activate cluster request with BaselineTopology[id=0] initiator node ID: 00a846de-a112-4c0f-aaa0-2732afb68000 [21:04:15]W: [org.apache.ignite:ignite-core] [2021-11-19 21:04:15,017][WARN ][sys-#7097%grid-1%][CacheAffinitySharedManager] Cache group 'group1' brings high overhead for its metainformation in data region 'default'. Metainformation required for its partitions (522 partitions, 4096 bytes per partition, 2 MBs total) will consume more than 15% of data region memory (10 MBs). It may lead to critical errors on the node and cluster instability. Please reduce number of partitions, add more memory to the data region or add more server nodes for this cache group. [21:04:15] : [Step 4/5] [2021-11-19 21:04:15,018][INFO ][exchange-worker-#7131%grid-1%][GridDhtPartitionsExchangeFuture] Successfully activated caches [nodeId=10b7df72-13e6-4409-9a62-0a02c743f001, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], newState=ACTIVE] [21:04:15] : [Step 4/5] [2021-11-19 21:04:15,019][INFO ][db-checkpoint-thread-#7136%grid-0%][Checkpointer] Checkpoint started [checkpointId=048b8026-e3e7-4fe0-a80a-7570f76f5f3e, startPtr=WALPointer [idx=0, fileOff=2749948, len=11507], checkpointBeforeLockTime=6ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=2ms, checkpointLockHoldTime=3ms, walCpRecordFsyncDuration=4ms, writeCheckpointEntryDuration=2ms, splitAndSortCpPagesDuration=0ms, pages=71, reason='node started'] [21:04:15]W: [org.apache.ignite:ignite-core] [2021-11-19 21:04:15,019][WARN ][exchange-worker-#7131%grid-1%][CacheAffinitySharedManager] Cache group 'group1' brings high overhead for its metainformation in data region 'default'. Metainformation required for its partitions (522 partitions, 4096 bytes per partition, 2 MBs total) will consume more than 15% of data region memory (10 MBs). It may lead to critical errors on the node and cluster instability. Please reduce number of partitions, add more memory to the data region or add more server nodes for this cache group. [21:04:15] : [Step 4/5] [2021-11-19 21:04:15,021][INFO ][exchange-worker-#7131%grid-1%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:04:15] : [Step 4/5] [2021-11-19 21:04:15,041][INFO ][grid-nio-worker-tcp-comm-0-#6944%TcpCommunicationSpi%][TcpCommunicationSpi] Accepted incoming communication connection [locAddr=/127.0.0.1:45130, rmtAddr=/127.0.0.1:35102] [21:04:15] : [Step 4/5] [2021-11-19 21:04:15,043][INFO ][grid-nio-worker-tcp-comm-0-#7063%TcpCommunicationSpi%][TcpCommunicationSpi] Established outgoing communication connection [locAddr=/127.0.0.1:35102, rmtAddr=/127.0.0.1:45130] [21:04:15] : [Step 4/5] [2021-11-19 21:04:15,043][INFO ][exchange-worker-#7131%grid-1%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], crd=false] [21:04:15] : [Step 4/5] [2021-11-19 21:04:15,046][INFO ][sys-#6980%grid-0%][GridDhtPartitionsExchangeFuture] Coordinator received single message [ver=AffinityTopologyVersion [topVer=2, minorTopVer=1], node=10b7df72-13e6-4409-9a62-0a02c743f001, allReceived=true] [21:04:15] : [Step 4/5] [2021-11-19 21:04:15,046][INFO ][sys-#6980%grid-0%][GridDhtPartitionsExchangeFuture] finishExchangeOnCoordinator [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:04:15] : [Step 4/5] [2021-11-19 21:04:15,052][INFO ][db-checkpoint-thread-#7136%grid-0%][Checkpointer] Checkpoint finished [cpId=048b8026-e3e7-4fe0-a80a-7570f76f5f3e, pages=71, markPos=WALPointer [idx=0, fileOff=2749948, len=11507], walSegmentsCovered=[], markDuration=10ms, pagesWrite=6ms, fsync=25ms, total=47ms] [21:04:15] : [Step 4/5] [2021-11-19 21:04:15,059][INFO ][db-checkpoint-thread-#7145%grid-1%][Checkpointer] Checkpoint started [checkpointId=e86ae4f2-358d-4f53-9292-e12e87e9ca06, startPtr=WALPointer [idx=0, fileOff=2233159, len=11887], checkpointBeforeLockTime=10ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=1ms, checkpointLockHoldTime=4ms, walCpRecordFsyncDuration=12ms, writeCheckpointEntryDuration=10ms, splitAndSortCpPagesDuration=0ms, pages=59, reason='node started'] [21:04:15] : [Step 4/5] [2021-11-19 21:04:15,060][INFO ][sys-#6980%grid-0%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], err=null, rebalanced=true, wasRebalanced=false] [21:04:15] : [Step 4/5] [2021-11-19 21:04:15,060][INFO ][disco-notifier-worker-#7001%grid-0%][GridClusterStateProcessor] Received state change finish message: ACTIVE [21:04:15] : [Step 4/5] [2021-11-19 21:04:15,061][INFO ][disco-notifier-worker-#7120%grid-1%][GridClusterStateProcessor] Received state change finish message: ACTIVE [21:04:15] : [Step 4/5] [2021-11-19 21:04:15,064][INFO ][sys-#7105%grid-1%][GridDhtPartitionsExchangeFuture] Received full message, will finish exchange [node=00a846de-a112-4c0f-aaa0-2732afb68000, resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:04:15] : [Step 4/5] [2021-11-19 21:04:15,061][INFO ][disco-notifier-worker-#7001%grid-0%][GridClusterStateProcessor] Cluster state was changed from INACTIVE to ACTIVE [21:04:15] : [Step 4/5] [2021-11-19 21:04:15,064][INFO ][disco-notifier-worker-#7120%grid-1%][GridClusterStateProcessor] Cluster state was changed from INACTIVE to ACTIVE [21:04:15] : [Step 4/5] [2021-11-19 21:04:15,069][INFO ][sys-#7105%grid-1%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], err=null, rebalanced=true, wasRebalanced=false] [21:04:15] : [Step 4/5] [2021-11-19 21:04:15,069][INFO ][sys-#7102%grid-1%][GridCachePartitionExchangeManager] Delay process full message without exchange id (there is exchange in progress) [nodeId=00a846de-a112-4c0f-aaa0-2732afb68000] [21:04:15] : [Step 4/5] [2021-11-19 21:04:15,072][INFO ][sys-#6980%grid-0%][GridCacheProcessor] Finish proxy initialization, cacheName=ignite-sys-cache, localNodeId=00a846de-a112-4c0f-aaa0-2732afb68000 [21:04:15] : [Step 4/5] [2021-11-19 21:04:15,072][INFO ][sys-#6980%grid-0%][GridCacheProcessor] Finish proxy initialization, cacheName=encrypted2, localNodeId=00a846de-a112-4c0f-aaa0-2732afb68000 [21:04:15] : [Step 4/5] [2021-11-19 21:04:15,074][INFO ][sys-#6980%grid-0%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=00a846de-a112-4c0f-aaa0-2732afb68000, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=10b7df72-13e6-4409-9a62-0a02c743f001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637345054921, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:04:15] : [Step 4/5] [2021-11-19 21:04:15,074][INFO ][exchange-worker-#7006%grid-0%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=2, minorTopVer=1], force=false, evt=DISCOVERY_CUSTOM_EVT, node=10b7df72-13e6-4409-9a62-0a02c743f001] [21:04:15] : [Step 4/5] [2021-11-19 21:04:15,074][INFO ][sys-#7105%grid-1%][GridCacheProcessor] Finish proxy initialization, cacheName=ignite-sys-cache, localNodeId=10b7df72-13e6-4409-9a62-0a02c743f001 [21:04:15] : [Step 4/5] [2021-11-19 21:04:15,074][INFO ][sys-#6986%grid-0%][DistributedBaselineConfiguration] Baseline auto-adjust is 'disabled' with timeout='300000' ms [21:04:15] : [Step 4/5] [2021-11-19 21:04:15,076][INFO ][sys-#6986%grid-0%][GridClusterStateProcessor] Successfully performed final activation steps [nodeId=00a846de-a112-4c0f-aaa0-2732afb68000, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:04:15] : [Step 4/5] [2021-11-19 21:04:15,076][INFO ][sys-#7105%grid-1%][GridCacheProcessor] Finish proxy initialization, cacheName=encrypted2, localNodeId=10b7df72-13e6-4409-9a62-0a02c743f001 [21:04:15] : [Step 4/5] [2021-11-19 21:04:15,075][INFO ][sys-#6980%grid-0%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (1 ms), stage="Update caches registry" (17 ms), stage="Start caches" (1 ms), stage="Affinity initialization on cache group start" (2 ms), stage="Determine exchange type" (1 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Restore partition states" (0 ms), stage="After states restored callback" (10 ms), stage="WAL history reservation" (0 ms), stage="Waiting for all single messages" (33 ms), stage="Affinity recalculation (crd)" (0 ms), stage="Collect update counters and create affinity messages" (0 ms), stage="Assign partitions states" (3 ms), stage="Validate partitions states" (1 ms), stage="Ideal affinity diff calculation (enforced)" (3 ms), stage="Apply update counters" (0 ms), stage="Full message preparing" (3 ms), stage="Full message sending" (0 ms), stage="State finish message sending" (0 ms), stage="Detect lost partitions" (8 ms), stage="Exchange done" (6 ms), stage="Total time" (89 ms), Discovery lag=3 ms, Latest started node id=10b7df72-13e6-4409-9a62-0a02c743f001] [21:04:15] : [Step 4/5] [2021-11-19 21:04:15,079][INFO ][sys-#7105%grid-1%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=10b7df72-13e6-4409-9a62-0a02c743f001, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=10b7df72-13e6-4409-9a62-0a02c743f001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637345055065, loc=true, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:04:15] : [Step 4/5] [2021-11-19 21:04:15,078][INFO ][sys-#7115%grid-1%][DistributedBaselineConfiguration] Baseline auto-adjust is 'disabled' with timeout='300000' ms [21:04:15] : [Step 4/5] [2021-11-19 21:04:15,081][INFO ][sys-#7115%grid-1%][GridClusterStateProcessor] Successfully performed final activation steps [nodeId=10b7df72-13e6-4409-9a62-0a02c743f001, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:04:15] : [Step 4/5] [2021-11-19 21:04:15,081][INFO ][sys-#7105%grid-1%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], stage="Waiting in exchange queue" (12 ms), stage="Exchange parameters initialization" (1 ms), stage="Update caches registry" (18 ms), stage="Start caches" (3 ms), stage="Affinity initialization on cache group start" (3 ms), stage="Determine exchange type" (2 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Restore partition states" (0 ms), stage="After states restored callback" (15 ms), stage="WAL history reservation" (0 ms), stage="Waiting for Full message" (25 ms), stage="Affinity recalculation" (2 ms), stage="Full map updating" (2 ms), stage="Detect lost partitions" (4 ms), stage="Exchange done" (8 ms), stage="Total time" (95 ms)] [21:04:15] : [Step 4/5] [2021-11-19 21:04:15,080][INFO ][exchange-worker-#7131%grid-1%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=2, minorTopVer=1], force=false, evt=DISCOVERY_CUSTOM_EVT, node=10b7df72-13e6-4409-9a62-0a02c743f001] [21:04:15] : [Step 4/5] [2021-11-19 21:04:15,080][INFO ][sys-#6980%grid-0%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], stage="Affinity initialization on cache group start [grp=group1]" (1 ms) (parent=Affinity initialization on cache group start), stage="Affinity initialization on cache group start [grp=ignite-sys-cache]" (0 ms) (parent=Affinity initialization on cache group start), stage="Affinity centralized initialization (crd) [grp=ignite-sys-cache, crd=true]" (0 ms) (parent=Determine exchange type), stage="Affinity centralized initialization (crd) [grp=group1, crd=true]" (0 ms) (parent=Determine exchange type), stage="Restore partition states [grp=ignite-sys-cache]" (0 ms) (parent=Restore partition states), stage="Restore partition states [grp=group1]" (0 ms) (parent=Restore partition states), stage="Affinity recalculation (partitions availability) [grp=group1]" (3 ms) (parent=Ideal affinity diff calculation (enforced)), stage="Affinity recalculation (partitions availability) [grp=ignite-sys-cache]" (0 ms) (parent=Ideal affinity diff calculation (enforced))] [21:04:15] : [Step 4/5] [2021-11-19 21:04:15,083][INFO ][sys-#7105%grid-1%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], stage="Affinity initialization on cache group start [grp=group1]" (1 ms) (parent=Affinity initialization on cache group start), stage="Affinity initialization on cache group start [grp=ignite-sys-cache]" (0 ms) (parent=Affinity initialization on cache group start), stage="Affinity centralized initialization (crd) [grp=ignite-sys-cache, crd=false]" (0 ms) (parent=Determine exchange type), stage="Affinity centralized initialization (crd) [grp=group1, crd=false]" (0 ms) (parent=Determine exchange type), stage="Restore partition states [grp=ignite-sys-cache]" (0 ms) (parent=Restore partition states), stage="Restore partition states [grp=group1]" (0 ms) (parent=Restore partition states), stage="Affinity applying from full message [grp=group1]" (2 ms) (parent=Affinity recalculation), stage="Affinity applying from full message [grp=ignite-sys-cache]" (1 ms) (parent=Affinity recalculation)] [21:04:15] : [Step 4/5] [2021-11-19 21:04:15,085][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][root] awaitPartitionMapExchange finished [21:04:15] : [Step 4/5] [2021-11-19 21:04:15,089][INFO ][db-checkpoint-thread-#7145%grid-1%][Checkpointer] Checkpoint finished [cpId=e86ae4f2-358d-4f53-9292-e12e87e9ca06, pages=59, markPos=WALPointer [idx=0, fileOff=2233159, len=11887], walSegmentsCovered=[], markDuration=27ms, pagesWrite=7ms, fsync=22ms, total=66ms] [21:04:15] : [Step 4/5] [2021-11-19 21:04:15,093][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][root] awaitPartitionMapExchange finished [21:04:15] : [Step 4/5] [2021-11-19 21:04:15,095][INFO ][exchange-worker-#7006%grid-0%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], crd=true, evt=DISCOVERY_CUSTOM_EVT, evtNode=00a846de-a112-4c0f-aaa0-2732afb68000, customEvt=DynamicCacheChangeBatch [id=d4e1d593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqs=ArrayList [DynamicCacheChangeRequest [cacheName=encrypted2, hasCfg=false, nodeId=00a846de-a112-4c0f-aaa0-2732afb68000, clientStartOnly=false, stop=true, destroy=false, disabledAfterStart=false]], exchangeActions=ExchangeActions [startCaches=null, stopCaches=[encrypted2], startGrps=[], stopGrps=[group1, destroy=true], resetParts=null, stateChangeRequest=null], startCaches=false], allowMerge=false, exchangeFreeSwitch=false] [21:04:15] : [Step 4/5] [2021-11-19 21:04:15,096][INFO ][exchange-worker-#7131%grid-1%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], crd=false, evt=DISCOVERY_CUSTOM_EVT, evtNode=00a846de-a112-4c0f-aaa0-2732afb68000, customEvt=DynamicCacheChangeBatch [id=d4e1d593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqs=ArrayList [DynamicCacheChangeRequest [cacheName=encrypted2, hasCfg=false, nodeId=00a846de-a112-4c0f-aaa0-2732afb68000, clientStartOnly=false, stop=true, destroy=false, disabledAfterStart=false]], exchangeActions=ExchangeActions [startCaches=null, stopCaches=[encrypted2], startGrps=[], stopGrps=[group1, destroy=true], resetParts=null, stateChangeRequest=null], startCaches=false], allowMerge=false, exchangeFreeSwitch=false] [21:04:15] : [Step 4/5] [2021-11-19 21:04:15,097][INFO ][exchange-worker-#7006%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], waitTime=0ms, futInfo=NA, mode=DISTRIBUTED] [21:04:15] : [Step 4/5] [2021-11-19 21:04:15,098][INFO ][exchange-worker-#7131%grid-1%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], waitTime=0ms, futInfo=NA, mode=DISTRIBUTED] [21:04:15] : [Step 4/5] [2021-11-19 21:04:15,099][INFO ][exchange-worker-#7006%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partitions release latch: ServerLatch [permits=0, pendingAcks=HashSet [], super=CompletableLatch [id=CompletableLatchUid [id=exchange, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2]]]] [21:04:15] : [Step 4/5] [2021-11-19 21:04:15,099][INFO ][exchange-worker-#7006%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:04:15] : [Step 4/5] [2021-11-19 21:04:15,102][INFO ][exchange-worker-#7131%grid-1%][GridDhtPartitionsExchangeFuture] Finished waiting for partitions release latch: ClientLatch [coordinator=TcpDiscoveryNode [id=00a846de-a112-4c0f-aaa0-2732afb68000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345054952, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], ackSent=true, super=CompletableLatch [id=CompletableLatchUid [id=exchange, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2]]]] [21:04:15] : [Step 4/5] [2021-11-19 21:04:15,103][INFO ][exchange-worker-#7006%grid-0%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], crd=true] [21:04:15] : [Step 4/5] [2021-11-19 21:04:15,103][INFO ][exchange-worker-#7131%grid-1%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:04:15] : [Step 4/5] [2021-11-19 21:04:15,105][INFO ][exchange-worker-#7131%grid-1%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], crd=false] [21:04:15] : [Step 4/5] [2021-11-19 21:04:15,106][INFO ][sys-#6979%grid-0%][GridDhtPartitionsExchangeFuture] Coordinator received single message [ver=AffinityTopologyVersion [topVer=2, minorTopVer=2], node=10b7df72-13e6-4409-9a62-0a02c743f001, allReceived=true] [21:04:15] : [Step 4/5] [2021-11-19 21:04:15,106][INFO ][sys-#6979%grid-0%][GridDhtPartitionsExchangeFuture] finishExchangeOnCoordinator [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2]] [21:04:15] : [Step 4/5] [2021-11-19 21:04:15,110][INFO ][sys-#6979%grid-0%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], err=null, rebalanced=true, wasRebalanced=true] [21:04:15] : [Step 4/5] [2021-11-19 21:04:15,110][INFO ][sys-#7100%grid-1%][GridDhtPartitionsExchangeFuture] Received full message, will finish exchange [node=00a846de-a112-4c0f-aaa0-2732afb68000, resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2]] [21:04:15] : [Step 4/5] [2021-11-19 21:04:15,112][INFO ][sys-#7100%grid-1%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], err=null, rebalanced=true, wasRebalanced=true] [21:04:15] : [Step 4/5] [2021-11-19 21:04:15,113][INFO ][db-checkpoint-thread-#7136%grid-0%][Checkpointer] Skipping checkpoint (no pages were modified) [checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=1ms, checkpointLockHoldTime=2ms, reason='caches stop'] [21:04:15] : [Step 4/5] [2021-11-19 21:04:15,115][INFO ][sys-#6979%grid-0%][GridCacheProcessor] Stopped cache [cacheName=encrypted2, group=group1] [21:04:15] : [Step 4/5] [2021-11-19 21:04:15,118][INFO ][sys-#7100%grid-1%][GridCacheProcessor] Stopped cache [cacheName=encrypted2, group=group1] [21:04:15] : [Step 4/5] [2021-11-19 21:04:15,142][INFO ][sys-#7100%grid-1%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=10b7df72-13e6-4409-9a62-0a02c743f001, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=00a846de-a112-4c0f-aaa0-2732afb68000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345054952, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2]] [21:04:15] : [Step 4/5] [2021-11-19 21:04:15,142][INFO ][exchange-worker-#7131%grid-1%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=2, minorTopVer=2], force=false, evt=DISCOVERY_CUSTOM_EVT, node=00a846de-a112-4c0f-aaa0-2732afb68000] [21:04:15] : [Step 4/5] [2021-11-19 21:04:15,143][INFO ][exchange-worker-#7006%grid-0%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=2, minorTopVer=2], force=false, evt=DISCOVERY_CUSTOM_EVT, node=00a846de-a112-4c0f-aaa0-2732afb68000] [21:04:15] : [Step 4/5] [2021-11-19 21:04:15,143][INFO ][sys-#6979%grid-0%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=00a846de-a112-4c0f-aaa0-2732afb68000, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=00a846de-a112-4c0f-aaa0-2732afb68000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345055095, loc=true, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2]] [21:04:15] : [Step 4/5] [2021-11-19 21:04:15,143][INFO ][sys-#7100%grid-1%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (1 ms), stage="Update caches registry" (0 ms), stage="Start caches" (0 ms), stage="Affinity initialization on cache group start" (0 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Wait partitions release latch [latch=exchange]" (5 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="After states restored callback" (0 ms), stage="WAL history reservation" (0 ms), stage="Waiting for Full message" (6 ms), stage="Affinity recalculation" (0 ms), stage="Full map updating" (0 ms), stage="Exchange done" (31 ms), stage="Total time" (43 ms)] [21:04:15] : [Step 4/5] [2021-11-19 21:04:15,147][INFO ][sys-#7100%grid-1%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2]] [21:04:15] : [Step 4/5] [2021-11-19 21:04:15,146][INFO ][sys-#6979%grid-0%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (1 ms), stage="Update caches registry" (0 ms), stage="Start caches" (0 ms), stage="Affinity initialization on cache group start" (0 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (1 ms), stage="Wait partitions release latch [latch=exchange]" (1 ms), stage="Wait partitions release [latch=exchange]" (3 ms), stage="After states restored callback" (0 ms), stage="WAL history reservation" (0 ms), stage="Waiting for all single messages" (2 ms), stage="Affinity recalculation (crd)" (0 ms), stage="Collect update counters and create affinity messages" (0 ms), stage="Assign partitions states" (0 ms), stage="Validate partitions states" (0 ms), stage="Apply update counters" (0 ms), stage="Full message preparing" (2 ms), stage="Full message sending" (0 ms), stage="Exchange done" (35 ms), stage="Total time" (45 ms)] [21:04:15] : [Step 4/5] [2021-11-19 21:04:15,150][INFO ][sys-#6979%grid-0%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2]] [21:04:15] : [Step 4/5] [2021-11-19 21:04:15,144][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][root] awaitPartitionMapExchange finished [21:04:15] : [Step 4/5] [2021-11-19 21:04:15,151][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][root] >>> Stopping grid [name=grid-1, id=10b7df72-13e6-4409-9a62-0a02c743f001] [21:04:15] : [Step 4/5] [2021-11-19 21:04:15,158][INFO ][db-checkpoint-thread-#7145%grid-1%][Checkpointer] Checkpoint started [checkpointId=720296c3-c145-4a33-8ab1-a00e94040e8d, startPtr=WALPointer [idx=0, fileOff=2270007, len=1947], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=1ms, writeCheckpointEntryDuration=2ms, splitAndSortCpPagesDuration=0ms, pages=6, reason='timeout'] [21:04:15] : [Step 4/5] [2021-11-19 21:04:15,165][INFO ][tcp-disco-sock-reader-[00a846de 127.0.0.1:38593]-#357%grid-1%-#7125%grid-1%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:38593, rmtPort=38593, rmtNodeId=00a846de-a112-4c0f-aaa0-2732afb68000] [21:04:15] : [Step 4/5] [2021-11-19 21:04:15,166][INFO ][disco-event-worker-#7005%grid-0%][GridDiscoveryManager] Node left topology: TcpDiscoveryNode [id=10b7df72-13e6-4409-9a62-0a02c743f001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637345054921, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false] [21:04:15] : [Step 4/5] [2021-11-19 21:04:15,167][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][GridCacheProcessor] Stopped cache [cacheName=ignite-sys-cache] [21:04:15] : [Step 4/5] [2021-11-19 21:04:15,167][INFO ][disco-event-worker-#7005%grid-0%][GridDiscoveryManager] Topology snapshot [ver=3, locNode=00a846de, servers=1, clients=0, state=ACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=00a846de-a112-4c0f-aaa0-2732afb68000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:04:15] : [Step 4/5] [2021-11-19 21:04:15,168][INFO ][disco-event-worker-#7005%grid-0%][GridDiscoveryManager] ^-- Baseline [id=0, size=2, online=1, offline=1] [21:04:15] : [Step 4/5] [2021-11-19 21:04:15,169][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][FilePageStoreManager] Cleanup cache stores [total=3, left=0, cleanFiles=false] [21:04:15] : [Step 4/5] [2021-11-19 21:04:15,170][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][GridDeploymentLocalStore] Removed undeployed class: GridDeployment [ts=1637345055054, depMode=SHARED, clsLdr=IsolatedClassLoader{roleName='test'}, clsLdrId=b3e1d593d71-10b7df72-13e6-4409-9a62-0a02c743f001, userVer=0, loc=true, sampleClsName=org.apache.ignite.internal.processors.cache.distributed.dht.preloader.IgniteDhtPartitionsToReloadMap, pendingUndeploy=false, undeployed=true, usage=0] [21:04:15] : [Step 4/5] [2021-11-19 21:04:15,170][INFO ][exchange-worker-#7006%grid-0%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], crd=true, evt=NODE_LEFT, evtNode=10b7df72-13e6-4409-9a62-0a02c743f001, customEvt=null, allowMerge=false, exchangeFreeSwitch=true] [21:04:15] : [Step 4/5] [2021-11-19 21:04:15,172][INFO ][exchange-worker-#7006%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:04:15] : [Step 4/5] [2021-11-19 21:04:15,173][INFO ][exchange-worker-#7006%grid-0%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], err=null, rebalanced=true, wasRebalanced=true] [21:04:15] : [Step 4/5] [2021-11-19 21:04:15,178][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][IgniteKernal%grid-1] [21:04:15] : [Step 4/5] [21:04:15] : [Step 4/5] >>> +------------------------------------------------------+ [21:04:15] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV stopped OK [21:04:15] : [Step 4/5] >>> +------------------------------------------------------+ [21:04:15] : [Step 4/5] >>> Ignite instance name: grid-1 [21:04:15] : [Step 4/5] >>> Grid uptime: 00:00:00.172 [21:04:15] : [Step 4/5] [21:04:15] : [Step 4/5] [21:04:15] : [Step 4/5] [2021-11-19 21:04:15,178][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][root] >>> Stopping grid [name=grid-0, id=00a846de-a112-4c0f-aaa0-2732afb68000] [21:04:15] : [Step 4/5] [2021-11-19 21:04:15,181][INFO ][exchange-worker-#7006%grid-0%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=00a846de-a112-4c0f-aaa0-2732afb68000, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], evt=NODE_LEFT, evtNode=TcpDiscoveryNode [id=10b7df72-13e6-4409-9a62-0a02c743f001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637345054921, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0]] [21:04:15] : [Step 4/5] [2021-11-19 21:04:15,182][INFO ][exchange-worker-#7006%grid-0%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (1 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="After states restored callback" (0 ms), stage="WAL history reservation" (0 ms), stage="Finalize update counters" (0 ms), stage="Detect lost partitions" (6 ms), stage="Exchange done" (2 ms), stage="Total time" (9 ms)] [21:04:15] : [Step 4/5] [2021-11-19 21:04:15,183][INFO ][exchange-worker-#7006%grid-0%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], stage="Affinity initialization (exchange-free switch on fully-rebalanced topology) [grp=ignite-sys-cache]" (0 ms) (parent=Determine exchange type)] [21:04:15] : [Step 4/5] [2021-11-19 21:04:15,183][INFO ][exchange-worker-#7006%grid-0%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], crd=true] [21:04:15] : [Step 4/5] [2021-11-19 21:04:15,184][INFO ][exchange-worker-#7006%grid-0%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=3, minorTopVer=0], force=false, evt=NODE_LEFT, node=10b7df72-13e6-4409-9a62-0a02c743f001] [21:04:15] : [Step 4/5] [2021-11-19 21:04:15,188][INFO ][db-checkpoint-thread-#7136%grid-0%][Checkpointer] Checkpoint started [checkpointId=f2233a81-5942-409f-bb5f-3b293fe1a197, startPtr=WALPointer [idx=0, fileOff=2786451, len=1947], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=0ms, writeCheckpointEntryDuration=2ms, splitAndSortCpPagesDuration=0ms, pages=6, reason='timeout'] [21:04:15] : [Step 4/5] [2021-11-19 21:04:15,194][INFO ][tcp-disco-sock-reader-[10b7df72 127.0.0.1:60427]-#358%grid-0%-#7126%grid-0%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:60427, rmtPort=60427, rmtNodeId=10b7df72-13e6-4409-9a62-0a02c743f001] [21:04:15] : [Step 4/5] [2021-11-19 21:04:15,196][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][GridCacheProcessor] Stopped cache [cacheName=ignite-sys-cache] [21:04:15] : [Step 4/5] [2021-11-19 21:04:15,198][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][FilePageStoreManager] Cleanup cache stores [total=3, left=0, cleanFiles=false] [21:04:15] : [Step 4/5] [2021-11-19 21:04:15,199][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][GridDeploymentLocalStore] Removed undeployed class: GridDeployment [ts=1637345055044, depMode=SHARED, clsLdr=IsolatedClassLoader{roleName='test'}, clsLdrId=83e1d593d71-00a846de-a112-4c0f-aaa0-2732afb68000, userVer=0, loc=true, sampleClsName=org.apache.ignite.internal.processors.cache.distributed.dht.preloader.GridDhtPartitionMap, pendingUndeploy=false, undeployed=true, usage=0] [21:04:15] : [Step 4/5] [2021-11-19 21:04:15,207][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][IgniteKernal%grid-0] [21:04:15] : [Step 4/5] [21:04:15] : [Step 4/5] >>> +------------------------------------------------------+ [21:04:15] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV stopped OK [21:04:15] : [Step 4/5] >>> +------------------------------------------------------+ [21:04:15] : [Step 4/5] >>> Ignite instance name: grid-0 [21:04:15] : [Step 4/5] >>> Grid uptime: 00:00:01.588 [21:04:15] : [Step 4/5] [21:04:15] : [Step 4/5] [21:04:15]W: [org.apache.ignite:ignite-core] [2021-11-19 21:04:15,213][WARN ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][G] Ignite work directory is not provided, automatically resolved to: /opt/buildagent/work/7bc1c54bc719b67c/work [21:04:15] : [Step 4/5] [2021-11-19 21:04:15,214][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][IgniteKernal%grid-0] [21:04:15] : [Step 4/5] [21:04:15] : [Step 4/5] >>> __________ ________________ [21:04:15] : [Step 4/5] >>> / _/ ___/ |/ / _/_ __/ __/ [21:04:15] : [Step 4/5] >>> _/ // (7 7 // / / / / _/ [21:04:15] : [Step 4/5] >>> /___/\___/_/|_/___/ /_/ /___/ [21:04:15] : [Step 4/5] >>> [21:04:15] : [Step 4/5] >>> ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:04:15] : [Step 4/5] >>> 2021 Copyright(C) Apache Software Foundation [21:04:15] : [Step 4/5] >>> [21:04:15] : [Step 4/5] >>> Ignite documentation: http://ignite.apache.org [21:04:15] : [Step 4/5] [21:04:15] : [Step 4/5] [2021-11-19 21:04:15,214][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][IgniteKernal%grid-0] Config URL: n/a [21:04:15] : [Step 4/5] [2021-11-19 21:04:15,215][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][IgniteKernal%grid-0] IgniteConfiguration [igniteInstanceName=grid-0, pubPoolSize=24, svcPoolSize=24, callbackPoolSize=24, stripedPoolSize=24, sysPoolSize=24, mgmtPoolSize=4, dataStreamerPoolSize=24, utilityCachePoolSize=24, utilityCacheKeepAliveTime=60000, p2pPoolSize=2, qryPoolSize=24, buildIdxPoolSize=4, igniteHome=/opt/buildagent/work/7bc1c54bc719b67c, igniteWorkDir=/opt/buildagent/work/7bc1c54bc719b67c/work, mbeanSrv=com.sun.jmx.mbeanserver.JmxMBeanServer@6fe85038, nodeId=00a375fc-dfaf-425c-b19f-ad48d81d8000, marsh=BinaryMarshaller [], marshLocJobs=false, daemon=false, p2pEnabled=true, netTimeout=10000, netCompressionLevel=1, sndRetryDelay=1000, sndRetryCnt=3, metricsHistSize=10000, metricsUpdateFreq=1000, metricsExpTime=9223372036854775807, discoSpi=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=0, ackTimeout=0, marsh=null, reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], segPlc=STOP, segResolveAttempts=2, waitForSegOnStart=true, allResolversPassReq=true, segChkFreq=10000, commSpi=TcpCommunicationSpi [connectGate=org.apache.ignite.spi.communication.tcp.internal.ConnectGateway@6f13e550, ctxInitLatch=java.util.concurrent.CountDownLatch@c7f582d[Count = 1], stopping=false, clientPool=null, nioSrvWrapper=null, stateProvider=null], evtSpi=MemoryEventStorageSpi [expireAgeMs=9223372036854775807, expireCnt=10000, filter=null], colSpi=NoopCollisionSpi [], deploySpi=LocalDeploymentSpi [], indexingSpi=org.apache.ignite.spi.indexing.noop.NoopIndexingSpi@2506463e, addrRslvr=null, encryptionSpi=org.apache.ignite.spi.encryption.keystore.KeystoreEncryptionSpi@52c39927, tracingSpi=org.apache.ignite.spi.tracing.NoopTracingSpi@4d8bb602, clientMode=false, rebalanceThreadPoolSize=4, rebalanceTimeout=10000, rebalanceBatchesPrefetchCnt=3, rebalanceThrottle=0, rebalanceBatchSize=524288, txCfg=TransactionConfiguration [txSerEnabled=false, dfltIsolation=REPEATABLE_READ, dfltConcurrency=PESSIMISTIC, dfltTxTimeout=0, txTimeoutOnPartitionMapExchange=0, deadlockTimeout=10000, pessimisticTxLogSize=0, pessimisticTxLogLinger=10000, tmLookupClsName=null, txManagerFactory=null, useJtaSync=false], cacheSanityCheckEnabled=true, discoStartupDelay=60000, deployMode=SHARED, p2pMissedCacheSize=100, locHost=127.0.0.1, timeSrvPortBase=31100, timeSrvPortRange=100, failureDetectionTimeout=10000, sysWorkerBlockedTimeout=null, clientFailureDetectionTimeout=10000, metricsLogFreq=0, connectorCfg=null, odbcCfg=null, warmupClos=null, atomicCfg=AtomicConfiguration [seqReserveSize=1000, cacheMode=PARTITIONED, backups=1, aff=null, grpName=null], classLdr=null, sslCtxFactory=null, platformCfg=null, binaryCfg=null, memCfg=null, pstCfg=null, dsCfg=DataStorageConfiguration [sysRegionInitSize=41943040, sysRegionMaxSize=104857600, pageSize=4096, concLvl=0, dfltDataRegConf=DataRegionConfiguration [name=default, maxSize=10485760, initSize=268435456, swapPath=null, pageEvictionMode=DISABLED, pageReplacementMode=CLOCK, evictionThreshold=0.9, emptyPagesPoolSize=100, metricsEnabled=false, metricsSubIntervalCount=5, metricsRateTimeInterval=60000, persistenceEnabled=true, checkpointPageBufSize=0, lazyMemoryAllocation=true, warmUpCfg=null], dataRegions=null, storagePath=null, checkpointFreq=180000, lockWaitTime=10000, checkpointThreads=4, checkpointWriteOrder=SEQUENTIAL, walHistSize=20, maxWalArchiveSize=1073741824, walSegments=10, walSegmentSize=67108864, walPath=db/wal, walArchivePath=db/wal/archive, cdcWalPath=db/wal/cdc, cdcEnabled=false, metricsEnabled=false, walMode=FSYNC, walTlbSize=131072, walBuffSize=0, walFlushFreq=2000, walFsyncDelay=1000, walRecordIterBuffSize=67108864, alwaysWriteFullPages=false, fileIOFactory=org.apache.ignite.internal.processors.cache.persistence.file.AsyncFileIOFactory@31b7bc40, metricsSubIntervalCnt=5, metricsRateTimeInterval=60000, walAutoArchiveAfterInactivity=-1, walForceArchiveTimeout=-1, writeThrottlingEnabled=false, walCompactionEnabled=false, walCompactionLevel=1, checkpointReadLockTimeout=null, walPageCompression=DISABLED, walPageCompressionLevel=null, dfltWarmUpCfg=null, encCfg=org.apache.ignite.configuration.EncryptionConfiguration@7e51f91b, defragmentationThreadPoolSize=4, minWalArchiveSize=-1], snapshotPath=snapshots, activeOnStart=true, activeOnStartPropSetFlag=false, autoActivation=true, autoActivationPropSetFlag=false, clusterStateOnStart=null, sqlConnCfg=null, cliConnCfg=ClientConnectorConfiguration [host=null, port=10800, portRange=100, sockSndBufSize=0, sockRcvBufSize=0, tcpNoDelay=true, maxOpenCursorsPerConn=128, threadPoolSize=24, selectorCnt=12, idleTimeout=0, handshakeTimeout=10000, jdbcEnabled=true, odbcEnabled=true, thinCliEnabled=true, sslEnabled=false, useIgniteSslCtxFactory=true, sslClientAuth=false, sslCtxFactory=null, thinCliCfg=ThinClientConfiguration [maxActiveTxPerConn=100, maxActiveComputeTasksPerConn=0]], mvccVacuumThreadCnt=2, mvccVacuumFreq=5000, authEnabled=false, failureHnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]], commFailureRslvr=null, sqlCfg=SqlConfiguration [longQryWarnTimeout=3000, dfltQryTimeout=0, sqlQryHistSize=1000, validationEnabled=false], asyncContinuationExecutor=null] [21:04:15] : [Step 4/5] [2021-11-19 21:04:15,222][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][IgniteKernal%grid-0] Daemon mode: off [21:04:15] : [Step 4/5] [2021-11-19 21:04:15,223][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][IgniteKernal%grid-0] OS: Linux 4.15.0-151-generic amd64 [21:04:15] : [Step 4/5] [2021-11-19 21:04:15,223][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][IgniteKernal%grid-0] OS user: teamcity [21:04:15] : [Step 4/5] [2021-11-19 21:04:15,223][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][IgniteKernal%grid-0] PID: 16724 [21:04:15] : [Step 4/5] [2021-11-19 21:04:15,223][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][IgniteKernal%grid-0] Language runtime: Java Platform API Specification ver. 1.8 [21:04:15] : [Step 4/5] [2021-11-19 21:04:15,224][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][IgniteKernal%grid-0] VM information: Java(TM) SE Runtime Environment 1.8.0_261-b12 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 25.261-b12 [21:04:15] : [Step 4/5] [2021-11-19 21:04:15,224][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][IgniteKernal%grid-0] VM total memory: 1.9GB [21:04:15] : [Step 4/5] [2021-11-19 21:04:15,224][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][IgniteKernal%grid-0] Remote Management [restart: off, REST: off, JMX (remote: off)] [21:04:15] : [Step 4/5] [2021-11-19 21:04:15,225][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][IgniteKernal%grid-0] Logger: GridTestLog4jLogger [quiet=false, config=null] [21:04:15] : [Step 4/5] [2021-11-19 21:04:15,225][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][IgniteKernal%grid-0] IGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c [21:04:15] : [Step 4/5] [2021-11-19 21:04:15,225][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][IgniteKernal%grid-0] VM arguments: [-DIGNITE_DUMP_THREADS_ON_FAILURE=false, -DMono=/usr/bin/mono-sgen, -DMono4.0_x64=/usr/lib/mono/4.0, -DMono4.5_x64=/usr/lib/mono/4.5, -DMonoVersion=6.12.0.90, -DSKIP_BUILD=false, -Dagent.home.dir=/opt/buildagent, -Dagent.name=aitc-lin02_03, -Dagent.ownPort=9090, -Dagent.work.dir=/opt/buildagent/work, -Dbuild.number=95, -Dbuild.vcs.number=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.1=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.GitHubApacheIgnite=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dclassworlds.conf=/opt/buildagent/temp/buildTmp/teamcity.m2.conf, -Dcom.jetbrains.maven.watcher.report.file=/opt/buildagent/temp/buildTmp/maven-build-info.xml, -Djava.io.tmpdir=/opt/buildagent/temp/buildTmp, -Dmaven.home=/opt/buildagent/tools/maven3_6, -Dmaven.multiModuleProjectDirectory=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.agent.cpuBenchmark=457, -Dteamcity.agent.dotnet.agent_url=http://localhost:9090/RPC2, -Dteamcity.agent.dotnet.build_id=6278078, -Dteamcity.auth.password=*******, -Dteamcity.auth.userId=TeamCityBuildId=6278078, -Dteamcity.build.changedFiles.file=/opt/buildagent/temp/buildTmp/changedFiles6342607772318147725.txt, -Dteamcity.build.checkoutDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.build.id=6278078, -Dteamcity.build.properties.file=/opt/buildagent/temp/buildTmp/teamcity.build5164517880467851002.properties, -Dteamcity.build.tempDir=/opt/buildagent/temp/buildTmp, -Dteamcity.build.workingDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.buildConfName=Basic 3, -Dteamcity.buildType.id=IgniteTests24Java8_Basic3, -Dteamcity.configuration.properties.file=/opt/buildagent/temp/buildTmp/teamcity.config5591980786735343870.properties, -Dteamcity.maven.userSettings.path=/opt/buildagent/temp/buildTmp/maven_settings_585072866407032347.xml, -Dteamcity.maven.watcher.home=/opt/buildagent/plugins/mavenPlugin/maven-watcher-jdk16, -Dteamcity.projectName=Ignite Tests 2.x (JDK 8/11), -Dteamcity.runner.properties.file=/opt/buildagent/temp/buildTmp/teamcity.runner9098465561618137420.properties, -Dteamcity.tests.recentlyFailedTests.file=/opt/buildagent/temp/buildTmp/testsToRunFirst3891775683130404069.txt, -Dteamcity.version=2021.2 (build 99542), -ea, -Xms2g, -Xmx2g, -XX:+HeapDumpOnOutOfMemoryError, -DIGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_TEST_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_UPDATE_NOTIFIER=false, -DIGNITE_NO_DISCO_ORDER=true, -DIGNITE_PERFORMANCE_SUGGESTIONS_DISABLED=true, -Djava.net.preferIPv4Stack=true, -DTEST_SCALE_FACTOR=1.0, -DIGNITE_TEST_PROP_LOG4J_FILE=log4j-tc-test.xml, -DIGNITE_QUIET=false, -DIGNITE_MARSHAL_BUFFERS_RECHECK=1000, -Dmaven.repo.local=/opt/buildagent/.m2/repository] [21:04:15] : [Step 4/5] [2021-11-19 21:04:15,229][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][IgniteKernal%grid-0] System cache's DataRegion size is configured to 40 MB. Use DataStorageConfiguration.systemRegionInitialSize property to change the setting. [21:04:15] : [Step 4/5] [2021-11-19 21:04:15,230][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][IgniteKernal%grid-0] Configured caches [in 'sysMemPlc' dataRegion: ['ignite-sys-cache']] [21:04:15]W: [org.apache.ignite:ignite-core] [2021-11-19 21:04:15,230][WARN ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][IgniteKernal%grid-0] Peer class loading is enabled (disable it in production for performance and deployment consistency reasons) [21:04:15] : [Step 4/5] [2021-11-19 21:04:15,230][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][IgniteKernal%grid-0] 3-rd party licenses can be found at: /opt/buildagent/work/7bc1c54bc719b67c/libs/licenses [21:04:15] : [Step 4/5] [2021-11-19 21:04:15,234][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][IgnitePluginProcessor] Configured plugins: [21:04:15] : [Step 4/5] [2021-11-19 21:04:15,234][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][IgnitePluginProcessor] ^-- StanByClusterTestProvider 1.0 [21:04:15] : [Step 4/5] [2021-11-19 21:04:15,234][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][IgnitePluginProcessor] ^-- null [21:04:15] : [Step 4/5] [2021-11-19 21:04:15,234][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][IgnitePluginProcessor] [21:04:15] : [Step 4/5] [2021-11-19 21:04:15,234][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][IgnitePluginProcessor] ^-- PageMemory tracker plugin 1.0 [21:04:15] : [Step 4/5] [2021-11-19 21:04:15,235][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][IgnitePluginProcessor] ^-- null [21:04:15] : [Step 4/5] [2021-11-19 21:04:15,235][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][IgnitePluginProcessor] [21:04:15] : [Step 4/5] [2021-11-19 21:04:15,235][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][IgnitePluginProcessor] ^-- TestDistibutedConfigurationPlugin 1.0 [21:04:15] : [Step 4/5] [2021-11-19 21:04:15,235][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][IgnitePluginProcessor] ^-- null [21:04:15] : [Step 4/5] [2021-11-19 21:04:15,235][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][IgnitePluginProcessor] [21:04:15] : [Step 4/5] [2021-11-19 21:04:15,235][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][IgnitePluginProcessor] ^-- NodeValidationPluginProvider 1.0 [21:04:15] : [Step 4/5] [2021-11-19 21:04:15,236][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][IgnitePluginProcessor] ^-- null [21:04:15] : [Step 4/5] [2021-11-19 21:04:15,236][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][IgnitePluginProcessor] [21:04:15] : [Step 4/5] [2021-11-19 21:04:15,236][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][FailureProcessor] Configured failure handler: [hnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]]] [21:04:15] : [Step 4/5] [2021-11-19 21:04:15,256][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][TcpCommunicationSpi] Successfully bound communication NIO server to TCP port [port=45130, locHost=/127.0.0.1, selectorsCnt=12, selectorSpins=0, pairedConn=false] [21:04:15]W: [org.apache.ignite:ignite-core] [2021-11-19 21:04:15,257][WARN ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][TcpCommunicationSpi] Message queue limit is set to 0 which may lead to potential OOMEs when running cache operations in FULL_ASYNC or PRIMARY_SYNC modes due to message queues growth on sender and receiver sides. [21:04:15] : [Step 4/5] [2021-11-19 21:04:15,265][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][GridCollisionManager] Collision resolution is disabled (all jobs will be activated upon arrival). [21:04:15] : [Step 4/5] [2021-11-19 21:04:15,266][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][IgniteKernal%grid-0] Security status [authentication=off, sandbox=off, tls/ssl=off] [21:04:15] : [Step 4/5] [2021-11-19 21:04:15,332][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:04:15] : [Step 4/5] [2021-11-19 21:04:15,419][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][MaintenanceProcessor] Resolved store directory for node persistent data: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0 [21:04:15] : [Step 4/5] [2021-11-19 21:04:15,420][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][CacheObjectBinaryProcessorImpl] Resolved directory for serialized binary metadata: /opt/buildagent/work/7bc1c54bc719b67c/work/db/binary_meta/grid_0 [21:04:15] : [Step 4/5] [2021-11-19 21:04:15,425][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0 [21:04:15] : [Step 4/5] [2021-11-19 21:04:15,426][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][FileWriteAheadLogManager] Resolved write ahead log work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0 [21:04:15] : [Step 4/5] [2021-11-19 21:04:15,426][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][FileWriteAheadLogManager] Resolved write ahead log archive directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0 [21:04:15] : [Step 4/5] [2021-11-19 21:04:15,428][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000005.wal [21:04:15] : [Step 4/5] [2021-11-19 21:04:15,428][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000006.wal [21:04:15] : [Step 4/5] [2021-11-19 21:04:15,429][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000008.wal [21:04:15] : [Step 4/5] [2021-11-19 21:04:15,429][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000004.wal [21:04:15] : [Step 4/5] [2021-11-19 21:04:15,429][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000003.wal [21:04:15] : [Step 4/5] [2021-11-19 21:04:15,430][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000002.wal [21:04:15] : [Step 4/5] [2021-11-19 21:04:15,430][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000007.wal [21:04:15] : [Step 4/5] [2021-11-19 21:04:15,431][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000001.wal [21:04:15] : [Step 4/5] [2021-11-19 21:04:15,431][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000009.wal [21:04:15] : [Step 4/5] [2021-11-19 21:04:15,435][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][GridCacheDatabaseSharedManager] Configured data regions initialized successfully [total=5] [21:04:15] : [Step 4/5] [2021-11-19 21:04:15,437][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][IgniteSnapshotManager] Resolved snapshot work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/snapshots [21:04:15] : [Step 4/5] [2021-11-19 21:04:15,437][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][IgniteSnapshotManager] Resolved temp directory for snapshot creation: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0/snp [21:04:15] : [Step 4/5] [2021-11-19 21:04:15,440][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][ClientListenerProcessor] Client connector processor has started on TCP port 10800 [21:04:15] : [Step 4/5] [2021-11-19 21:04:15,445][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][IgniteKernal%grid-0] Non-loopback local IPs: 172.17.0.4 [21:04:15] : [Step 4/5] [2021-11-19 21:04:15,445][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][IgniteKernal%grid-0] Enabled local MACs: 0242AC110004 [21:04:15] : [Step 4/5] [2021-11-19 21:04:15,448][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=/opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0/cp/1637345055185-f2233a81-5942-409f-bb5f-3b293fe1a197-START.bin, endMarker=/opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0/cp/1637345055004-048b8026-e3e7-4fe0-a80a-7570f76f5f3e-END.bin] [21:04:15] : [Step 4/5] [2021-11-19 21:04:15,449][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:04:15] : [Step 4/5] [2021-11-19 21:04:15,449][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=2749948, len=11507], lastMarked=WALPointer [idx=0, fileOff=2786451, len=1947], lastCheckpointId=f2233a81-5942-409f-bb5f-3b293fe1a197] [21:04:15] : [Step 4/5] [2021-11-19 21:04:15,554][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][GridCacheDatabaseSharedManager] Found last checkpoint marker [cpId=f2233a81-5942-409f-bb5f-3b293fe1a197, pos=WALPointer [idx=0, fileOff=2786451, len=1947]] [21:04:15] : [Step 4/5] [2021-11-19 21:04:15,560][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][GridCacheDatabaseSharedManager] Applying lost metastore updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=2786451, len=1947], lastCheckpointId=f2233a81-5942-409f-bb5f-3b293fe1a197] [21:04:15] : [Step 4/5] [2021-11-19 21:04:15,621][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=61 ms] [21:04:15] : [Step 4/5] [2021-11-19 21:04:15,621][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][GridCacheProcessor] Restoring partition state for local groups. [21:04:15] : [Step 4/5] [2021-11-19 21:04:15,621][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=0, partitionsProcessed=0, time=0ms] [21:04:15] : [Step 4/5] [2021-11-19 21:04:15,868][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][GridEncryptionManager] Encryption keys loaded from metastore. [grps=, masterKeyName=ignite.master.key] [21:04:15] : [Step 4/5] [2021-11-19 21:04:15,875][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][GridClusterStateProcessor] Restoring history for BaselineTopology[id=0] [21:04:15] : [Step 4/5] [2021-11-19 21:04:15,882][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][ClusterProcessor] Cluster ID and tag has been read from metastorage: ClusterIdAndTag [id=e59705b4-217a-49b7-8688-11f7b94dd438, tag=pensive_kilby] [21:04:15] : [Step 4/5] [2021-11-19 21:04:15,883][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][IgniteClusterImpl] Shutdown policy was updated [oldVal=null, newVal=null] [21:04:15] : [Step 4/5] [2021-11-19 21:04:15,884][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustEnabled' was changed from 'null' to 'false' [21:04:15] : [Step 4/5] [2021-11-19 21:04:15,884][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustTimeout' was changed from 'null' to '300000' [21:04:15] : [Step 4/5] [2021-11-19 21:04:15,884][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][IgniteTxManager] Transactions parameter 'txOwnerDumpRequestsAllowed' was changed from 'null' to 'true' [21:04:15] : [Step 4/5] [2021-11-19 21:04:15,885][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][IgniteTxManager] Transactions parameter 'longOperationsDumpTimeout' was changed from 'null' to '60000' [21:04:15] : [Step 4/5] [2021-11-19 21:04:15,885][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpThreshold' was changed from 'null' to '0' [21:04:15] : [Step 4/5] [2021-11-19 21:04:15,886][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][IgniteTxManager] Transactions parameter 'transactionTimeDumpSamplesCoefficient' was changed from 'null' to '0.0' [21:04:15] : [Step 4/5] [2021-11-19 21:04:15,887][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpSamplesPerSecondLimit' was changed from 'null' to '5' [21:04:15] : [Step 4/5] [2021-11-19 21:04:15,887][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][IgniteTxManager] Transactions parameter 'collisionsDumpInterval' was changed from 'null' to '1000' [21:04:15] : [Step 4/5] [2021-11-19 21:04:15,888][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][GridCacheDatabaseSharedManager] Historical rebalance WAL threshold changed [property=historical.rebalance.threshold, oldVal=null, newVal=500] [21:04:15] : [Step 4/5] [2021-11-19 21:04:15,888][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][GridCacheDatabaseSharedManager] Checkpoint frequency deviation changed [oldVal=null, newVal=null] [21:04:15] : [Step 4/5] [2021-11-19 21:04:15,889][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][FilePageStoreManager] Cleanup cache stores [total=1, left=0, cleanFiles=false] [21:04:15] : [Step 4/5] [2021-11-19 21:04:15,891][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:04:15] : [Step 4/5] [2021-11-19 21:04:15,892][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:04:15] : [Step 4/5] [2021-11-19 21:04:15,893][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:04:15] : [Step 4/5] [2021-11-19 21:04:15,894][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][GridCacheDatabaseSharedManager] Data Regions Started: 5 [21:04:15] : [Step 4/5] [2021-11-19 21:04:15,894][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][GridCacheDatabaseSharedManager] ^-- sysMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:04:15] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:04:15] : [Step 4/5] ^-- default region [type=default, persistence=true, lazyAlloc=true, [21:04:15] : [Step 4/5] ... initCfg=10MB, maxCfg=10MB, usedRam=0MB, freeRam=100%, allocRam=0MB, allocTotal=0MB] [21:04:15] : [Step 4/5] ^-- metastoreMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:04:15] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:04:15] : [Step 4/5] ^-- TxLog region [type=internal, persistence=true, lazyAlloc=false, [21:04:15] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:04:15] : [Step 4/5] ^-- volatileDsMemPlc region [type=user, persistence=false, lazyAlloc=true, [21:04:15] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB] [21:04:15] : [Step 4/5] ^-- Ignite persistence [used=0MB] [21:04:15] : [Step 4/5] [21:04:15] : [Step 4/5] [2021-11-19 21:04:15,895][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][GridCacheDatabaseSharedManager] Starting binary memory restore for: [-2100569601] [21:04:15] : [Step 4/5] [2021-11-19 21:04:15,902][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=/opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0/cp/1637345055185-f2233a81-5942-409f-bb5f-3b293fe1a197-START.bin, endMarker=/opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0/cp/1637345055004-048b8026-e3e7-4fe0-a80a-7570f76f5f3e-END.bin] [21:04:15] : [Step 4/5] [2021-11-19 21:04:15,903][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=2749948, len=11507], lastMarked=WALPointer [idx=0, fileOff=2786451, len=1947], lastCheckpointId=f2233a81-5942-409f-bb5f-3b293fe1a197] [21:04:15]W: [org.apache.ignite:ignite-core] [2021-11-19 21:04:15,955][WARN ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][GridCacheDatabaseSharedManager] Ignite node stopped in the middle of checkpoint. Will restore memory state and finish checkpoint on node start. [21:04:16] : [Step 4/5] [2021-11-19 21:04:16,004][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][GridCacheDatabaseSharedManager] Found last checkpoint marker [cpId=f2233a81-5942-409f-bb5f-3b293fe1a197, pos=WALPointer [idx=0, fileOff=2786451, len=1947]] [21:04:16] : [Step 4/5] [2021-11-19 21:04:16,009][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][GridCacheDatabaseSharedManager] Finished applying memory changes [changesApplied=9, time=50 ms] [21:04:16] : [Step 4/5] [2021-11-19 21:04:16,011][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][CheckpointWorkflow] Checkpoint finished [cpId=f2233a81-5942-409f-bb5f-3b293fe1a197, pages=6, markPos=WALPointer [idx=0, fileOff=2786451, len=1947], pagesWrite=-6ms, fsync=0ms, total=-6ms] [21:04:16] : [Step 4/5] [2021-11-19 21:04:16,012][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][GridCacheDatabaseSharedManager] Binary memory state restored at node startup [restoredPtr=WALPointer [idx=0, fileOff=2788398, len=0]] [21:04:16] : [Step 4/5] [2021-11-19 21:04:16,013][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000000.wal, offset=2788398, ver=2] [21:04:16] : [Step 4/5] [2021-11-19 21:04:16,015][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][GridCacheProcessor] Started cache in recovery mode [name=ignite-sys-cache, id=-2100569601, dataRegionName=sysMemPlc, mode=REPLICATED, atomicity=TRANSACTIONAL, backups=2147483647, mvcc=false] [21:04:16] : [Step 4/5] [2021-11-19 21:04:16,016][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][GridCacheDatabaseSharedManager] Binary recovery performed in 121 ms. [21:04:16] : [Step 4/5] [2021-11-19 21:04:16,017][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=/opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0/cp/1637345055185-f2233a81-5942-409f-bb5f-3b293fe1a197-START.bin, endMarker=/opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0/cp/1637345055185-f2233a81-5942-409f-bb5f-3b293fe1a197-END.bin] [21:04:16] : [Step 4/5] [2021-11-19 21:04:16,018][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][GridCacheDatabaseSharedManager] Applying lost cache updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=2786451, len=1947], lastCheckpointId=f2233a81-5942-409f-bb5f-3b293fe1a197] [21:04:16] : [Step 4/5] [2021-11-19 21:04:16,075][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=60 ms] [21:04:16] : [Step 4/5] [2021-11-19 21:04:16,075][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][GridCacheProcessor] Restoring partition state for local groups. [21:04:16] : [Step 4/5] [2021-11-19 21:04:16,090][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=1, partitionsProcessed=100, time=10ms] [21:04:16] : [Step 4/5] [2021-11-19 21:04:16,092][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][TestTcpDiscoverySpi] Successfully bound to TCP port [port=47500, localHost=localhost/127.0.0.1, locNodeId=00a375fc-dfaf-425c-b19f-ad48d81d8000] [21:04:16] : [Step 4/5] [2021-11-19 21:04:16,100][INFO ][disco-notifier-worker-#7271%grid-0%][MvccProcessorImpl] Assigned mvcc coordinator [crd=MvccCoordinator [topVer=AffinityTopologyVersion [topVer=1, minorTopVer=0], nodeId=00a375fc-dfaf-425c-b19f-ad48d81d8000, ver=1637345056095, local=true, initialized=false]] [21:04:16] : [Step 4/5] [2021-11-19 21:04:16,102][INFO ][sys-#7256%grid-0%][ClusterProcessor] Writing cluster ID and tag to metastorage on ready for write ClusterIdAndTag [id=e59705b4-217a-49b7-8688-11f7b94dd438, tag=pensive_kilby] [21:04:16] : [Step 4/5] [2021-11-19 21:04:16,114][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][IgniteKernal%grid-0] To start Console Management & Monitoring run ignitevisorcmd.{sh|bat} [21:04:16] : [Step 4/5] [2021-11-19 21:04:16,114][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][IgniteKernal%grid-0] [21:04:16] : [Step 4/5] [21:04:16] : [Step 4/5] >>> +-------------------------------------------+ [21:04:16] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:04:16] : [Step 4/5] >>> +-------------------------------------------+ [21:04:16] : [Step 4/5] >>> OS name: Linux 4.15.0-151-generic amd64 [21:04:16] : [Step 4/5] >>> CPU(s): 24 [21:04:16] : [Step 4/5] >>> Heap: 2.0GB [21:04:16] : [Step 4/5] >>> VM name: 16724@c4dfe9a430b2 [21:04:16] : [Step 4/5] >>> Ignite instance name: grid-0 [21:04:16] : [Step 4/5] >>> Local node [ID=00A375FC-DFAF-425C-B19F-AD48D81D8000, order=1, clientMode=false] [21:04:16] : [Step 4/5] >>> Local node addresses: [127.0.0.1] [21:04:16] : [Step 4/5] >>> Local ports: TCP:10800 TCP:45130 TCP:47500 [21:04:16] : [Step 4/5] [21:04:16] : [Step 4/5] [2021-11-19 21:04:16,115][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][IgniteKernal%grid-0] >>> Ignite cluster is in INACTIVE state (limited functionality available). Use control.(sh|bat) script or IgniteCluster.state(ClusterState.ACTIVE) to change the state. [21:04:16] : [Step 4/5] [2021-11-19 21:04:16,116][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][GridDiscoveryManager] Topology snapshot [ver=1, locNode=00a375fc, servers=1, clients=0, state=INACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=00a375fc-dfaf-425c-b19f-ad48d81d8000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:04:16] : [Step 4/5] [2021-11-19 21:04:16,116][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][GridDiscoveryManager] ^-- Baseline [id=0, size=2, online=1, offline=1] [21:04:16] : [Step 4/5] [2021-11-19 21:04:16,117][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][GridDiscoveryManager] ^-- 1 nodes left for auto-activation [grid-1] [21:04:16] : [Step 4/5] [2021-11-19 21:04:16,117][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][G] Node started : [stage="Configure system pool" (0 ms),stage="Start managers" (206 ms),stage="Configure binary metadata" (1 ms),stage="Start processors" (22 ms),stage="Start 'StanByClusterTestProvider' plugin" (0 ms),stage="Start 'PageMemory tracker plugin' plugin" (0 ms),stage="Start 'TestDistibutedConfigurationPlugin' plugin" (0 ms),stage="Start 'NodeValidationPluginProvider' plugin" (0 ms),stage="Init metastore" (444 ms),stage="Init and start regions" (6 ms),stage="Restore binary memory" (121 ms),stage="Restore logical state" (74 ms),stage="Finish recovery" (0 ms),stage="Join topology" (8 ms),stage="Await transition" (2 ms),stage="Await exchange" (14 ms),stage="Total time" (898 ms)] [21:04:16] : [Step 4/5] [2021-11-19 21:04:16,119][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][root] Node started with the following configuration [id=00a375fc-dfaf-425c-b19f-ad48d81d8000, marshaller=BinaryMarshaller [], discovery=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=5000, ackTimeout=5000, marsh=JdkMarshaller [clsFilter=org.apache.ignite.marshaller.MarshallerUtils$1@25cffe24], reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], binaryCfg=null, lateAff=true] [21:04:16]W: [org.apache.ignite:ignite-core] [2021-11-19 21:04:16,124][WARN ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][G] Ignite work directory is not provided, automatically resolved to: /opt/buildagent/work/7bc1c54bc719b67c/work [21:04:16] : [Step 4/5] [2021-11-19 21:04:16,125][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][IgniteKernal%grid-1] [21:04:16] : [Step 4/5] [21:04:16] : [Step 4/5] >>> __________ ________________ [21:04:16] : [Step 4/5] >>> / _/ ___/ |/ / _/_ __/ __/ [21:04:16] : [Step 4/5] >>> _/ // (7 7 // / / / / _/ [21:04:16] : [Step 4/5] >>> /___/\___/_/|_/___/ /_/ /___/ [21:04:16] : [Step 4/5] >>> [21:04:16] : [Step 4/5] >>> ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:04:16] : [Step 4/5] >>> 2021 Copyright(C) Apache Software Foundation [21:04:16] : [Step 4/5] >>> [21:04:16] : [Step 4/5] >>> Ignite documentation: http://ignite.apache.org [21:04:16] : [Step 4/5] [21:04:16] : [Step 4/5] [2021-11-19 21:04:16,125][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][IgniteKernal%grid-1] Config URL: n/a [21:04:16] : [Step 4/5] [2021-11-19 21:04:16,126][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][IgniteKernal%grid-1] IgniteConfiguration [igniteInstanceName=grid-1, pubPoolSize=24, svcPoolSize=24, callbackPoolSize=24, stripedPoolSize=24, sysPoolSize=24, mgmtPoolSize=4, dataStreamerPoolSize=24, utilityCachePoolSize=24, utilityCacheKeepAliveTime=60000, p2pPoolSize=2, qryPoolSize=24, buildIdxPoolSize=4, igniteHome=/opt/buildagent/work/7bc1c54bc719b67c, igniteWorkDir=/opt/buildagent/work/7bc1c54bc719b67c/work, mbeanSrv=com.sun.jmx.mbeanserver.JmxMBeanServer@6fe85038, nodeId=109ef74e-f74a-45d0-ac50-da790e82b001, marsh=BinaryMarshaller [], marshLocJobs=false, daemon=false, p2pEnabled=true, netTimeout=10000, netCompressionLevel=1, sndRetryDelay=1000, sndRetryCnt=3, metricsHistSize=10000, metricsUpdateFreq=1000, metricsExpTime=9223372036854775807, discoSpi=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=0, ackTimeout=0, marsh=null, reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], segPlc=STOP, segResolveAttempts=2, waitForSegOnStart=true, allResolversPassReq=true, segChkFreq=10000, commSpi=TcpCommunicationSpi [connectGate=org.apache.ignite.spi.communication.tcp.internal.ConnectGateway@207c7a4d, ctxInitLatch=java.util.concurrent.CountDownLatch@3b66ece1[Count = 1], stopping=false, clientPool=null, nioSrvWrapper=null, stateProvider=null], evtSpi=MemoryEventStorageSpi [expireAgeMs=9223372036854775807, expireCnt=10000, filter=null], colSpi=NoopCollisionSpi [], deploySpi=LocalDeploymentSpi [], indexingSpi=org.apache.ignite.spi.indexing.noop.NoopIndexingSpi@45e30f81, addrRslvr=null, encryptionSpi=org.apache.ignite.spi.encryption.keystore.KeystoreEncryptionSpi@7a3c2ec0, tracingSpi=org.apache.ignite.spi.tracing.NoopTracingSpi@6a5aa94f, clientMode=false, rebalanceThreadPoolSize=4, rebalanceTimeout=10000, rebalanceBatchesPrefetchCnt=3, rebalanceThrottle=0, rebalanceBatchSize=524288, txCfg=TransactionConfiguration [txSerEnabled=false, dfltIsolation=REPEATABLE_READ, dfltConcurrency=PESSIMISTIC, dfltTxTimeout=0, txTimeoutOnPartitionMapExchange=0, deadlockTimeout=10000, pessimisticTxLogSize=0, pessimisticTxLogLinger=10000, tmLookupClsName=null, txManagerFactory=null, useJtaSync=false], cacheSanityCheckEnabled=true, discoStartupDelay=60000, deployMode=SHARED, p2pMissedCacheSize=100, locHost=127.0.0.1, timeSrvPortBase=31100, timeSrvPortRange=100, failureDetectionTimeout=10000, sysWorkerBlockedTimeout=null, clientFailureDetectionTimeout=10000, metricsLogFreq=0, connectorCfg=null, odbcCfg=null, warmupClos=null, atomicCfg=AtomicConfiguration [seqReserveSize=1000, cacheMode=PARTITIONED, backups=1, aff=null, grpName=null], classLdr=null, sslCtxFactory=null, platformCfg=null, binaryCfg=null, memCfg=null, pstCfg=null, dsCfg=DataStorageConfiguration [sysRegionInitSize=41943040, sysRegionMaxSize=104857600, pageSize=4096, concLvl=0, dfltDataRegConf=DataRegionConfiguration [name=default, maxSize=10485760, initSize=268435456, swapPath=null, pageEvictionMode=DISABLED, pageReplacementMode=CLOCK, evictionThreshold=0.9, emptyPagesPoolSize=100, metricsEnabled=false, metricsSubIntervalCount=5, metricsRateTimeInterval=60000, persistenceEnabled=true, checkpointPageBufSize=0, lazyMemoryAllocation=true, warmUpCfg=null], dataRegions=null, storagePath=null, checkpointFreq=180000, lockWaitTime=10000, checkpointThreads=4, checkpointWriteOrder=SEQUENTIAL, walHistSize=20, maxWalArchiveSize=1073741824, walSegments=10, walSegmentSize=67108864, walPath=db/wal, walArchivePath=db/wal/archive, cdcWalPath=db/wal/cdc, cdcEnabled=false, metricsEnabled=false, walMode=FSYNC, walTlbSize=131072, walBuffSize=0, walFlushFreq=2000, walFsyncDelay=1000, walRecordIterBuffSize=67108864, alwaysWriteFullPages=false, fileIOFactory=org.apache.ignite.internal.processors.cache.persistence.file.AsyncFileIOFactory@565c5c26, metricsSubIntervalCnt=5, metricsRateTimeInterval=60000, walAutoArchiveAfterInactivity=-1, walForceArchiveTimeout=-1, writeThrottlingEnabled=false, walCompactionEnabled=false, walCompactionLevel=1, checkpointReadLockTimeout=null, walPageCompression=DISABLED, walPageCompressionLevel=null, dfltWarmUpCfg=null, encCfg=org.apache.ignite.configuration.EncryptionConfiguration@25c0b1ed, defragmentationThreadPoolSize=4, minWalArchiveSize=-1], snapshotPath=snapshots, activeOnStart=true, activeOnStartPropSetFlag=false, autoActivation=true, autoActivationPropSetFlag=false, clusterStateOnStart=null, sqlConnCfg=null, cliConnCfg=ClientConnectorConfiguration [host=null, port=10800, portRange=100, sockSndBufSize=0, sockRcvBufSize=0, tcpNoDelay=true, maxOpenCursorsPerConn=128, threadPoolSize=24, selectorCnt=12, idleTimeout=0, handshakeTimeout=10000, jdbcEnabled=true, odbcEnabled=true, thinCliEnabled=true, sslEnabled=false, useIgniteSslCtxFactory=true, sslClientAuth=false, sslCtxFactory=null, thinCliCfg=ThinClientConfiguration [maxActiveTxPerConn=100, maxActiveComputeTasksPerConn=0]], mvccVacuumThreadCnt=2, mvccVacuumFreq=5000, authEnabled=false, failureHnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]], commFailureRslvr=null, sqlCfg=SqlConfiguration [longQryWarnTimeout=3000, dfltQryTimeout=0, sqlQryHistSize=1000, validationEnabled=false], asyncContinuationExecutor=null] [21:04:16] : [Step 4/5] [2021-11-19 21:04:16,135][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][IgniteKernal%grid-1] Daemon mode: off [21:04:16] : [Step 4/5] [2021-11-19 21:04:16,135][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][IgniteKernal%grid-1] OS: Linux 4.15.0-151-generic amd64 [21:04:16] : [Step 4/5] [2021-11-19 21:04:16,135][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][IgniteKernal%grid-1] OS user: teamcity [21:04:16] : [Step 4/5] [2021-11-19 21:04:16,135][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][IgniteKernal%grid-1] PID: 16724 [21:04:16] : [Step 4/5] [2021-11-19 21:04:16,135][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][IgniteKernal%grid-1] Language runtime: Java Platform API Specification ver. 1.8 [21:04:16] : [Step 4/5] [2021-11-19 21:04:16,136][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][IgniteKernal%grid-1] VM information: Java(TM) SE Runtime Environment 1.8.0_261-b12 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 25.261-b12 [21:04:16] : [Step 4/5] [2021-11-19 21:04:16,136][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][IgniteKernal%grid-1] VM total memory: 1.9GB [21:04:16] : [Step 4/5] [2021-11-19 21:04:16,137][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][IgniteKernal%grid-1] Remote Management [restart: off, REST: off, JMX (remote: off)] [21:04:16] : [Step 4/5] [2021-11-19 21:04:16,137][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][IgniteKernal%grid-1] Logger: GridTestLog4jLogger [quiet=false, config=null] [21:04:16] : [Step 4/5] [2021-11-19 21:04:16,137][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][IgniteKernal%grid-1] IGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c [21:04:16] : [Step 4/5] [2021-11-19 21:04:16,137][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][IgniteKernal%grid-1] VM arguments: [-DIGNITE_DUMP_THREADS_ON_FAILURE=false, -DMono=/usr/bin/mono-sgen, -DMono4.0_x64=/usr/lib/mono/4.0, -DMono4.5_x64=/usr/lib/mono/4.5, -DMonoVersion=6.12.0.90, -DSKIP_BUILD=false, -Dagent.home.dir=/opt/buildagent, -Dagent.name=aitc-lin02_03, -Dagent.ownPort=9090, -Dagent.work.dir=/opt/buildagent/work, -Dbuild.number=95, -Dbuild.vcs.number=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.1=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.GitHubApacheIgnite=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dclassworlds.conf=/opt/buildagent/temp/buildTmp/teamcity.m2.conf, -Dcom.jetbrains.maven.watcher.report.file=/opt/buildagent/temp/buildTmp/maven-build-info.xml, -Djava.io.tmpdir=/opt/buildagent/temp/buildTmp, -Dmaven.home=/opt/buildagent/tools/maven3_6, -Dmaven.multiModuleProjectDirectory=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.agent.cpuBenchmark=457, -Dteamcity.agent.dotnet.agent_url=http://localhost:9090/RPC2, -Dteamcity.agent.dotnet.build_id=6278078, -Dteamcity.auth.password=*******, -Dteamcity.auth.userId=TeamCityBuildId=6278078, -Dteamcity.build.changedFiles.file=/opt/buildagent/temp/buildTmp/changedFiles6342607772318147725.txt, -Dteamcity.build.checkoutDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.build.id=6278078, -Dteamcity.build.properties.file=/opt/buildagent/temp/buildTmp/teamcity.build5164517880467851002.properties, -Dteamcity.build.tempDir=/opt/buildagent/temp/buildTmp, -Dteamcity.build.workingDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.buildConfName=Basic 3, -Dteamcity.buildType.id=IgniteTests24Java8_Basic3, -Dteamcity.configuration.properties.file=/opt/buildagent/temp/buildTmp/teamcity.config5591980786735343870.properties, -Dteamcity.maven.userSettings.path=/opt/buildagent/temp/buildTmp/maven_settings_585072866407032347.xml, -Dteamcity.maven.watcher.home=/opt/buildagent/plugins/mavenPlugin/maven-watcher-jdk16, -Dteamcity.projectName=Ignite Tests 2.x (JDK 8/11), -Dteamcity.runner.properties.file=/opt/buildagent/temp/buildTmp/teamcity.runner9098465561618137420.properties, -Dteamcity.tests.recentlyFailedTests.file=/opt/buildagent/temp/buildTmp/testsToRunFirst3891775683130404069.txt, -Dteamcity.version=2021.2 (build 99542), -ea, -Xms2g, -Xmx2g, -XX:+HeapDumpOnOutOfMemoryError, -DIGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_TEST_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_UPDATE_NOTIFIER=false, -DIGNITE_NO_DISCO_ORDER=true, -DIGNITE_PERFORMANCE_SUGGESTIONS_DISABLED=true, -Djava.net.preferIPv4Stack=true, -DTEST_SCALE_FACTOR=1.0, -DIGNITE_TEST_PROP_LOG4J_FILE=log4j-tc-test.xml, -DIGNITE_QUIET=false, -DIGNITE_MARSHAL_BUFFERS_RECHECK=1000, -Dmaven.repo.local=/opt/buildagent/.m2/repository] [21:04:16] : [Step 4/5] [2021-11-19 21:04:16,141][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][IgniteKernal%grid-1] System cache's DataRegion size is configured to 40 MB. Use DataStorageConfiguration.systemRegionInitialSize property to change the setting. [21:04:16] : [Step 4/5] [2021-11-19 21:04:16,141][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][IgniteKernal%grid-1] Configured caches [in 'sysMemPlc' dataRegion: ['ignite-sys-cache']] [21:04:16]W: [org.apache.ignite:ignite-core] [2021-11-19 21:04:16,142][WARN ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][IgniteKernal%grid-1] Peer class loading is enabled (disable it in production for performance and deployment consistency reasons) [21:04:16] : [Step 4/5] [2021-11-19 21:04:16,142][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][IgniteKernal%grid-1] 3-rd party licenses can be found at: /opt/buildagent/work/7bc1c54bc719b67c/libs/licenses [21:04:16] : [Step 4/5] [2021-11-19 21:04:16,146][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][IgnitePluginProcessor] Configured plugins: [21:04:16] : [Step 4/5] [2021-11-19 21:04:16,146][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][IgnitePluginProcessor] ^-- StanByClusterTestProvider 1.0 [21:04:16] : [Step 4/5] [2021-11-19 21:04:16,146][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][IgnitePluginProcessor] ^-- null [21:04:16] : [Step 4/5] [2021-11-19 21:04:16,146][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][IgnitePluginProcessor] [21:04:16] : [Step 4/5] [2021-11-19 21:04:16,146][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][IgnitePluginProcessor] ^-- PageMemory tracker plugin 1.0 [21:04:16] : [Step 4/5] [2021-11-19 21:04:16,146][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][IgnitePluginProcessor] ^-- null [21:04:16] : [Step 4/5] [2021-11-19 21:04:16,147][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][IgnitePluginProcessor] [21:04:16] : [Step 4/5] [2021-11-19 21:04:16,147][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][IgnitePluginProcessor] ^-- TestDistibutedConfigurationPlugin 1.0 [21:04:16] : [Step 4/5] [2021-11-19 21:04:16,147][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][IgnitePluginProcessor] ^-- null [21:04:16] : [Step 4/5] [2021-11-19 21:04:16,147][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][IgnitePluginProcessor] [21:04:16] : [Step 4/5] [2021-11-19 21:04:16,147][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][IgnitePluginProcessor] ^-- NodeValidationPluginProvider 1.0 [21:04:16] : [Step 4/5] [2021-11-19 21:04:16,147][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][IgnitePluginProcessor] ^-- null [21:04:16] : [Step 4/5] [2021-11-19 21:04:16,148][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][IgnitePluginProcessor] [21:04:16] : [Step 4/5] [2021-11-19 21:04:16,148][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][FailureProcessor] Configured failure handler: [hnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]]] [21:04:16] : [Step 4/5] [2021-11-19 21:04:16,166][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][TcpCommunicationSpi] Successfully bound communication NIO server to TCP port [port=45131, locHost=/127.0.0.1, selectorsCnt=12, selectorSpins=0, pairedConn=false] [21:04:16]W: [org.apache.ignite:ignite-core] [2021-11-19 21:04:16,167][WARN ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][TcpCommunicationSpi] Message queue limit is set to 0 which may lead to potential OOMEs when running cache operations in FULL_ASYNC or PRIMARY_SYNC modes due to message queues growth on sender and receiver sides. [21:04:16] : [Step 4/5] [2021-11-19 21:04:16,175][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][GridCollisionManager] Collision resolution is disabled (all jobs will be activated upon arrival). [21:04:16] : [Step 4/5] [2021-11-19 21:04:16,175][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][IgniteKernal%grid-1] Security status [authentication=off, sandbox=off, tls/ssl=off] [21:04:16] : [Step 4/5] [2021-11-19 21:04:16,234][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:04:16] : [Step 4/5] [2021-11-19 21:04:16,316][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][MaintenanceProcessor] Resolved store directory for node persistent data: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1 [21:04:16] : [Step 4/5] [2021-11-19 21:04:16,317][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][CacheObjectBinaryProcessorImpl] Resolved directory for serialized binary metadata: /opt/buildagent/work/7bc1c54bc719b67c/work/db/binary_meta/grid_1 [21:04:16] : [Step 4/5] [2021-11-19 21:04:16,321][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1 [21:04:16] : [Step 4/5] [2021-11-19 21:04:16,322][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][FileWriteAheadLogManager] Resolved write ahead log work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1 [21:04:16] : [Step 4/5] [2021-11-19 21:04:16,322][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][FileWriteAheadLogManager] Resolved write ahead log archive directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1 [21:04:16] : [Step 4/5] [2021-11-19 21:04:16,323][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000005.wal [21:04:16] : [Step 4/5] [2021-11-19 21:04:16,324][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000006.wal [21:04:16] : [Step 4/5] [2021-11-19 21:04:16,324][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000008.wal [21:04:16] : [Step 4/5] [2021-11-19 21:04:16,325][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000004.wal [21:04:16] : [Step 4/5] [2021-11-19 21:04:16,325][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000003.wal [21:04:16] : [Step 4/5] [2021-11-19 21:04:16,326][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000002.wal [21:04:16] : [Step 4/5] [2021-11-19 21:04:16,326][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000007.wal [21:04:16] : [Step 4/5] [2021-11-19 21:04:16,326][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000001.wal [21:04:16] : [Step 4/5] [2021-11-19 21:04:16,327][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000009.wal [21:04:16] : [Step 4/5] [2021-11-19 21:04:16,331][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][GridCacheDatabaseSharedManager] Configured data regions initialized successfully [total=5] [21:04:16] : [Step 4/5] [2021-11-19 21:04:16,332][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][IgniteSnapshotManager] Resolved snapshot work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/snapshots [21:04:16] : [Step 4/5] [2021-11-19 21:04:16,332][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][IgniteSnapshotManager] Resolved temp directory for snapshot creation: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1/snp [21:04:16] : [Step 4/5] [2021-11-19 21:04:16,335][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][ClientListenerProcessor] Client connector processor has started on TCP port 10801 [21:04:16] : [Step 4/5] [2021-11-19 21:04:16,336][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][IgniteKernal%grid-1] Non-loopback local IPs: 172.17.0.4 [21:04:16] : [Step 4/5] [2021-11-19 21:04:16,337][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][IgniteKernal%grid-1] Enabled local MACs: 0242AC110004 [21:04:16] : [Step 4/5] [2021-11-19 21:04:16,338][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=/opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1/cp/1637345055154-720296c3-c145-4a33-8ab1-a00e94040e8d-START.bin, endMarker=/opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1/cp/1637345055023-e86ae4f2-358d-4f53-9292-e12e87e9ca06-END.bin] [21:04:16] : [Step 4/5] [2021-11-19 21:04:16,339][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:04:16] : [Step 4/5] [2021-11-19 21:04:16,339][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=2233159, len=11887], lastMarked=WALPointer [idx=0, fileOff=2270007, len=1947], lastCheckpointId=720296c3-c145-4a33-8ab1-a00e94040e8d] [21:04:16] : [Step 4/5] [2021-11-19 21:04:16,454][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][GridCacheDatabaseSharedManager] Found last checkpoint marker [cpId=720296c3-c145-4a33-8ab1-a00e94040e8d, pos=WALPointer [idx=0, fileOff=2270007, len=1947]] [21:04:16] : [Step 4/5] [2021-11-19 21:04:16,460][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][GridCacheDatabaseSharedManager] Applying lost metastore updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=2270007, len=1947], lastCheckpointId=720296c3-c145-4a33-8ab1-a00e94040e8d] [21:04:16] : [Step 4/5] [2021-11-19 21:04:16,507][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=41 ms] [21:04:16] : [Step 4/5] [2021-11-19 21:04:16,508][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][GridCacheProcessor] Restoring partition state for local groups. [21:04:16] : [Step 4/5] [2021-11-19 21:04:16,508][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=0, partitionsProcessed=0, time=0ms] [21:04:16] : [Step 4/5] [2021-11-19 21:04:16,771][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][GridEncryptionManager] Encryption keys loaded from metastore. [grps=, masterKeyName=ignite.master.key] [21:04:16] : [Step 4/5] [2021-11-19 21:04:16,772][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][GridClusterStateProcessor] Restoring history for BaselineTopology[id=0] [21:04:16] : [Step 4/5] [2021-11-19 21:04:16,774][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][ClusterProcessor] Cluster ID and tag has been read from metastorage: ClusterIdAndTag [id=e59705b4-217a-49b7-8688-11f7b94dd438, tag=pensive_kilby] [21:04:16] : [Step 4/5] [2021-11-19 21:04:16,775][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][IgniteClusterImpl] Shutdown policy was updated [oldVal=null, newVal=null] [21:04:16] : [Step 4/5] [2021-11-19 21:04:16,775][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustEnabled' was changed from 'null' to 'false' [21:04:16] : [Step 4/5] [2021-11-19 21:04:16,775][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustTimeout' was changed from 'null' to '300000' [21:04:16] : [Step 4/5] [2021-11-19 21:04:16,776][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][IgniteTxManager] Transactions parameter 'txOwnerDumpRequestsAllowed' was changed from 'null' to 'true' [21:04:16] : [Step 4/5] [2021-11-19 21:04:16,776][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][IgniteTxManager] Transactions parameter 'longOperationsDumpTimeout' was changed from 'null' to '60000' [21:04:16] : [Step 4/5] [2021-11-19 21:04:16,776][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpThreshold' was changed from 'null' to '0' [21:04:16] : [Step 4/5] [2021-11-19 21:04:16,777][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][IgniteTxManager] Transactions parameter 'transactionTimeDumpSamplesCoefficient' was changed from 'null' to '0.0' [21:04:16] : [Step 4/5] [2021-11-19 21:04:16,777][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpSamplesPerSecondLimit' was changed from 'null' to '5' [21:04:16] : [Step 4/5] [2021-11-19 21:04:16,777][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][IgniteTxManager] Transactions parameter 'collisionsDumpInterval' was changed from 'null' to '1000' [21:04:16] : [Step 4/5] [2021-11-19 21:04:16,778][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][GridCacheDatabaseSharedManager] Historical rebalance WAL threshold changed [property=historical.rebalance.threshold, oldVal=null, newVal=500] [21:04:16] : [Step 4/5] [2021-11-19 21:04:16,778][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][GridCacheDatabaseSharedManager] Checkpoint frequency deviation changed [oldVal=null, newVal=null] [21:04:16] : [Step 4/5] [2021-11-19 21:04:16,778][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][FilePageStoreManager] Cleanup cache stores [total=1, left=0, cleanFiles=false] [21:04:16] : [Step 4/5] [2021-11-19 21:04:16,780][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:04:16] : [Step 4/5] [2021-11-19 21:04:16,781][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:04:16] : [Step 4/5] [2021-11-19 21:04:16,782][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:04:16] : [Step 4/5] [2021-11-19 21:04:16,782][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][GridCacheDatabaseSharedManager] Data Regions Started: 5 [21:04:16] : [Step 4/5] [2021-11-19 21:04:16,782][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][GridCacheDatabaseSharedManager] ^-- sysMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:04:16] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:04:16] : [Step 4/5] ^-- default region [type=default, persistence=true, lazyAlloc=true, [21:04:16] : [Step 4/5] ... initCfg=10MB, maxCfg=10MB, usedRam=0MB, freeRam=100%, allocRam=0MB, allocTotal=0MB] [21:04:16] : [Step 4/5] ^-- metastoreMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:04:16] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:04:16] : [Step 4/5] ^-- TxLog region [type=internal, persistence=true, lazyAlloc=false, [21:04:16] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:04:16] : [Step 4/5] ^-- volatileDsMemPlc region [type=user, persistence=false, lazyAlloc=true, [21:04:16] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB] [21:04:16] : [Step 4/5] ^-- Ignite persistence [used=0MB] [21:04:16] : [Step 4/5] [21:04:16] : [Step 4/5] [2021-11-19 21:04:16,783][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][GridCacheDatabaseSharedManager] Starting binary memory restore for: [-2100569601] [21:04:16] : [Step 4/5] [2021-11-19 21:04:16,789][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=/opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1/cp/1637345055154-720296c3-c145-4a33-8ab1-a00e94040e8d-START.bin, endMarker=/opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1/cp/1637345055023-e86ae4f2-358d-4f53-9292-e12e87e9ca06-END.bin] [21:04:16] : [Step 4/5] [2021-11-19 21:04:16,790][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=2233159, len=11887], lastMarked=WALPointer [idx=0, fileOff=2270007, len=1947], lastCheckpointId=720296c3-c145-4a33-8ab1-a00e94040e8d] [21:04:16]W: [org.apache.ignite:ignite-core] [2021-11-19 21:04:16,836][WARN ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][GridCacheDatabaseSharedManager] Ignite node stopped in the middle of checkpoint. Will restore memory state and finish checkpoint on node start. [21:04:16] : [Step 4/5] [2021-11-19 21:04:16,883][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][GridCacheDatabaseSharedManager] Found last checkpoint marker [cpId=720296c3-c145-4a33-8ab1-a00e94040e8d, pos=WALPointer [idx=0, fileOff=2270007, len=1947]] [21:04:16] : [Step 4/5] [2021-11-19 21:04:16,888][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][GridCacheDatabaseSharedManager] Finished applying memory changes [changesApplied=9, time=51 ms] [21:04:16] : [Step 4/5] [2021-11-19 21:04:16,891][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][CheckpointWorkflow] Checkpoint finished [cpId=720296c3-c145-4a33-8ab1-a00e94040e8d, pages=6, markPos=WALPointer [idx=0, fileOff=2270007, len=1947], pagesWrite=-5ms, fsync=0ms, total=-5ms] [21:04:16] : [Step 4/5] [2021-11-19 21:04:16,891][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][GridCacheDatabaseSharedManager] Binary memory state restored at node startup [restoredPtr=WALPointer [idx=0, fileOff=2271954, len=0]] [21:04:16] : [Step 4/5] [2021-11-19 21:04:16,892][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000000.wal, offset=2271954, ver=2] [21:04:16] : [Step 4/5] [2021-11-19 21:04:16,895][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][GridCacheProcessor] Started cache in recovery mode [name=ignite-sys-cache, id=-2100569601, dataRegionName=sysMemPlc, mode=REPLICATED, atomicity=TRANSACTIONAL, backups=2147483647, mvcc=false] [21:04:16] : [Step 4/5] [2021-11-19 21:04:16,896][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][GridCacheDatabaseSharedManager] Binary recovery performed in 113 ms. [21:04:16] : [Step 4/5] [2021-11-19 21:04:16,896][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=/opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1/cp/1637345055154-720296c3-c145-4a33-8ab1-a00e94040e8d-START.bin, endMarker=/opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1/cp/1637345055154-720296c3-c145-4a33-8ab1-a00e94040e8d-END.bin] [21:04:16] : [Step 4/5] [2021-11-19 21:04:16,897][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][GridCacheDatabaseSharedManager] Applying lost cache updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=2270007, len=1947], lastCheckpointId=720296c3-c145-4a33-8ab1-a00e94040e8d] [21:04:16] : [Step 4/5] [2021-11-19 21:04:16,947][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=51 ms] [21:04:16] : [Step 4/5] [2021-11-19 21:04:16,948][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][GridCacheProcessor] Restoring partition state for local groups. [21:04:16] : [Step 4/5] [2021-11-19 21:04:16,960][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=1, partitionsProcessed=100, time=10ms] [21:04:16] : [Step 4/5] [2021-11-19 21:04:16,962][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][TestTcpDiscoverySpi] Successfully bound to TCP port [port=47501, localHost=localhost/127.0.0.1, locNodeId=109ef74e-f74a-45d0-ac50-da790e82b001] [21:04:16] : [Step 4/5] [2021-11-19 21:04:16,967][INFO ][tcp-disco-srvr-[:47500]-#363%grid-0%-#7273%grid-0%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=52205] [21:04:16] : [Step 4/5] [2021-11-19 21:04:16,967][INFO ][tcp-disco-srvr-[:47500]-#363%grid-0%-#7273%grid-0%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=52205] [21:04:16] : [Step 4/5] [2021-11-19 21:04:16,968][INFO ][tcp-disco-sock-reader-[]-#369%grid-0%-#7392%grid-0%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:52205, rmtPort=52205] [21:04:16] : [Step 4/5] [2021-11-19 21:04:16,969][INFO ][tcp-disco-sock-reader-[109ef74e 127.0.0.1:52205]-#369%grid-0%-#7392%grid-0%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=109ef74e-f74a-45d0-ac50-da790e82b001, rmtAddr=/127.0.0.1:52205] [21:04:16] : [Step 4/5] [2021-11-19 21:04:16,974][INFO ][tcp-disco-srvr-[:47501]-#368%grid-1%-#7391%grid-1%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=55919] [21:04:16] : [Step 4/5] [2021-11-19 21:04:16,975][INFO ][tcp-disco-srvr-[:47501]-#368%grid-1%-#7391%grid-1%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=55919] [21:04:16] : [Step 4/5] [2021-11-19 21:04:16,975][INFO ][tcp-disco-sock-reader-[]-#370%grid-1%-#7393%grid-1%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:55919, rmtPort=55919] [21:04:16] : [Step 4/5] [2021-11-19 21:04:16,976][INFO ][tcp-disco-sock-reader-[]-#370%grid-1%-#7393%grid-1%][TestTcpDiscoverySpi] Received ping request from the remote node [rmtNodeId=00a375fc-dfaf-425c-b19f-ad48d81d8000, rmtAddr=/127.0.0.1:55919, rmtPort=55919] [21:04:16] : [Step 4/5] [2021-11-19 21:04:16,977][INFO ][tcp-disco-sock-reader-[]-#370%grid-1%-#7393%grid-1%][TestTcpDiscoverySpi] Finished writing ping response [rmtNodeId=00a375fc-dfaf-425c-b19f-ad48d81d8000, rmtAddr=/127.0.0.1:55919, rmtPort=55919] [21:04:16] : [Step 4/5] [2021-11-19 21:04:16,977][INFO ][tcp-disco-sock-reader-[]-#370%grid-1%-#7393%grid-1%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:55919, rmtPort=55919, rmtNodeId=null] [21:04:16] : [Step 4/5] [2021-11-19 21:04:16,977][INFO ][tcp-disco-sock-reader-[109ef74e 127.0.0.1:52205]-#369%grid-0%-#7392%grid-0%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:52205, rmtPort=52205, rmtNodeId=109ef74e-f74a-45d0-ac50-da790e82b001] [21:04:16] : [Step 4/5] [2021-11-19 21:04:16,980][INFO ][tcp-disco-msg-worker-[crd]-#362%grid-0%-#7272%grid-0%][GridEncryptionManager] Joining node doesn't have stored group keys [node=109ef74e-f74a-45d0-ac50-da790e82b001] [21:04:16] : [Step 4/5] [2021-11-19 21:04:16,993][INFO ][tcp-disco-msg-worker-[crd]-#362%grid-0%-#7272%grid-0%][TestTcpDiscoverySpi] New next node [newNext=TcpDiscoveryNode [id=109ef74e-f74a-45d0-ac50-da790e82b001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=0, intOrder=2, lastExchangeTime=1637345056964, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false]] [21:04:16] : [Step 4/5] [2021-11-19 21:04:16,994][INFO ][tcp-disco-srvr-[:47501]-#368%grid-1%-#7391%grid-1%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=58913] [21:04:16] : [Step 4/5] [2021-11-19 21:04:16,994][INFO ][tcp-disco-srvr-[:47501]-#368%grid-1%-#7391%grid-1%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=58913] [21:04:16] : [Step 4/5] [2021-11-19 21:04:16,995][INFO ][tcp-disco-sock-reader-[]-#371%grid-1%-#7394%grid-1%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:58913, rmtPort=58913] [21:04:16] : [Step 4/5] [2021-11-19 21:04:16,996][INFO ][tcp-disco-sock-reader-[00a375fc 127.0.0.1:58913]-#371%grid-1%-#7394%grid-1%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=00a375fc-dfaf-425c-b19f-ad48d81d8000, rmtAddr=/127.0.0.1:58913] [21:04:17] : [Step 4/5] [2021-11-19 21:04:16,999][INFO ][tcp-disco-msg-worker-[]-#367%grid-1%-#7390%grid-1%][TestTcpDiscoverySpi] New next node [newNext=TcpDiscoveryNode [id=00a375fc-dfaf-425c-b19f-ad48d81d8000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345056994, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false]] [21:04:17] : [Step 4/5] [2021-11-19 21:04:17,000][INFO ][tcp-disco-srvr-[:47500]-#363%grid-0%-#7273%grid-0%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=38151] [21:04:17] : [Step 4/5] [2021-11-19 21:04:17,001][INFO ][tcp-disco-srvr-[:47500]-#363%grid-0%-#7273%grid-0%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=38151] [21:04:17] : [Step 4/5] [2021-11-19 21:04:17,002][INFO ][tcp-disco-sock-reader-[]-#372%grid-0%-#7395%grid-0%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:38151, rmtPort=38151] [21:04:17] : [Step 4/5] [2021-11-19 21:04:17,002][INFO ][tcp-disco-sock-reader-[109ef74e 127.0.0.1:38151]-#372%grid-0%-#7395%grid-0%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=109ef74e-f74a-45d0-ac50-da790e82b001, rmtAddr=/127.0.0.1:38151] [21:04:17] : [Step 4/5] [2021-11-19 21:04:17,005][INFO ][disco-event-worker-#7275%grid-0%][GridDiscoveryManager] Added new node to topology: TcpDiscoveryNode [id=109ef74e-f74a-45d0-ac50-da790e82b001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637345056964, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false] [21:04:17] : [Step 4/5] [2021-11-19 21:04:17,006][INFO ][disco-event-worker-#7275%grid-0%][GridDiscoveryManager] Topology snapshot [ver=2, locNode=00a375fc, servers=2, clients=0, state=INACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=00a375fc-dfaf-425c-b19f-ad48d81d8000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=109ef74e-f74a-45d0-ac50-da790e82b001, consistentId=grid-1, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:04:17] : [Step 4/5] [2021-11-19 21:04:17,006][INFO ][disco-event-worker-#7275%grid-0%][GridDiscoveryManager] ^-- Baseline [id=0, size=2, online=2, offline=0] [21:04:17] : [Step 4/5] [2021-11-19 21:04:17,007][INFO ][disco-event-worker-#7275%grid-0%][GridDiscoveryManager] ^-- All baseline nodes are online, will start auto-activation [21:04:17] : [Step 4/5] [2021-11-19 21:04:17,010][INFO ][disco-notifier-worker-#7389%grid-1%][MvccProcessorImpl] Assigned mvcc coordinator [crd=MvccCoordinator [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=0], nodeId=00a375fc-dfaf-425c-b19f-ad48d81d8000, ver=1637345056095, local=false, initialized=false]] [21:04:17] : [Step 4/5] [2021-11-19 21:04:17,011][INFO ][disco-notifier-worker-#7389%grid-1%][GridClusterStateProcessor] Sending activate cluster request with BaselineTopology BaselineTopology [id=0, branchingHash=-2475315501, branchingType='Cluster activation', baselineNodes=[grid-1, grid-0]] [21:04:17] : [Step 4/5] [2021-11-19 21:04:17,014][INFO ][sys-#7367%grid-1%][ClusterProcessor] Writing cluster ID and tag to metastorage on ready for write ClusterIdAndTag [id=e59705b4-217a-49b7-8688-11f7b94dd438, tag=pensive_kilby] [21:04:17] : [Step 4/5] [2021-11-19 21:04:17,016][INFO ][disco-notifier-worker-#7271%grid-0%][GridClusterStateProcessor] Received activate cluster request with BaselineTopology[id=0] initiator node ID: 109ef74e-f74a-45d0-ac50-da790e82b001 [21:04:17] : [Step 4/5] [2021-11-19 21:04:17,016][INFO ][disco-notifier-worker-#7271%grid-0%][GridClusterStateProcessor] Started state transition: activate cluster [21:04:17] : [Step 4/5] [2021-11-19 21:04:17,017][INFO ][exchange-worker-#7276%grid-0%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], crd=true, evt=DISCOVERY_CUSTOM_EVT, evtNode=109ef74e-f74a-45d0-ac50-da790e82b001, customEvt=ChangeGlobalStateMessage [id=7ae1d593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqId=863ddb89-15a6-488f-92d3-30f53e04602d, initiatingNodeId=109ef74e-f74a-45d0-ac50-da790e82b001, state=ACTIVE, baselineTopology=BaselineTopology [id=0, branchingHash=-2475315501, branchingType='Cluster activation', baselineNodes=[grid-1, grid-0]], forceChangeBaselineTopology=false, timestamp=1637345057011, forceDeactivation=true], allowMerge=false, exchangeFreeSwitch=false] [21:04:17] : [Step 4/5] [2021-11-19 21:04:17,017][INFO ][disco-notifier-worker-#7389%grid-1%][GridClusterStateProcessor] Received activate cluster request with BaselineTopology[id=0] initiator node ID: 109ef74e-f74a-45d0-ac50-da790e82b001 [21:04:17] : [Step 4/5] [2021-11-19 21:04:17,018][INFO ][exchange-worker-#7276%grid-0%][GridDhtPartitionsExchangeFuture] Start activation process [nodeId=00a375fc-dfaf-425c-b19f-ad48d81d8000, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]]. New state: ACTIVE [21:04:17] : [Step 4/5] [2021-11-19 21:04:17,018][INFO ][disco-notifier-worker-#7389%grid-1%][GridClusterStateProcessor] Started state transition: activate cluster [21:04:17] : [Step 4/5] [2021-11-19 21:04:17,019][INFO ][exchange-worker-#7276%grid-0%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0 [21:04:17] : [Step 4/5] [2021-11-19 21:04:17,021][INFO ][exchange-worker-#7276%grid-0%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000000.wal, offset=2788398, ver=2] [21:04:17] : [Step 4/5] [2021-11-19 21:04:17,022][INFO ][exchange-worker-#7276%grid-0%][GridClusterStateProcessor] Writing BaselineTopology[id=0] [21:04:17] : [Step 4/5] [2021-11-19 21:04:17,026][INFO ][exchange-worker-#7276%grid-0%][GridCacheDatabaseSharedManager] Finish recovery performed in 6 ms. [21:04:17] : [Step 4/5] [2021-11-19 21:04:17,027][INFO ][exchange-worker-#7276%grid-0%][msg] Components activation performed in 8 ms. [21:04:17] : [Step 4/5] [2021-11-19 21:04:17,027][INFO ][exchange-worker-#7401%grid-1%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], crd=false, evt=DISCOVERY_CUSTOM_EVT, evtNode=109ef74e-f74a-45d0-ac50-da790e82b001, customEvt=ChangeGlobalStateMessage [id=7ae1d593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqId=863ddb89-15a6-488f-92d3-30f53e04602d, initiatingNodeId=109ef74e-f74a-45d0-ac50-da790e82b001, state=ACTIVE, baselineTopology=BaselineTopology [id=0, branchingHash=-2475315501, branchingType='Cluster activation', baselineNodes=[grid-1, grid-0]], forceChangeBaselineTopology=false, timestamp=1637345057011, forceDeactivation=true], allowMerge=false, exchangeFreeSwitch=false] [21:04:17] : [Step 4/5] [2021-11-19 21:04:17,027][INFO ][exchange-worker-#7276%grid-0%][GridCacheProcessor] Finished recovery for cache [cache=ignite-sys-cache, grp=ignite-sys-cache, startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:04:17] : [Step 4/5] [2021-11-19 21:04:17,029][INFO ][exchange-worker-#7401%grid-1%][GridDhtPartitionsExchangeFuture] Start activation process [nodeId=109ef74e-f74a-45d0-ac50-da790e82b001, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]]. New state: ACTIVE [21:04:17] : [Step 4/5] [2021-11-19 21:04:17,030][INFO ][exchange-worker-#7276%grid-0%][GridDhtPartitionsExchangeFuture] Successfully activated caches [nodeId=00a375fc-dfaf-425c-b19f-ad48d81d8000, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], newState=ACTIVE] [21:04:17] : [Step 4/5] [2021-11-19 21:04:17,031][INFO ][exchange-worker-#7276%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:04:17] : [Step 4/5] [2021-11-19 21:04:17,031][INFO ][exchange-worker-#7401%grid-1%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1 [21:04:17] : [Step 4/5] [2021-11-19 21:04:17,034][INFO ][exchange-worker-#7401%grid-1%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000000.wal, offset=2271954, ver=2] [21:04:17] : [Step 4/5] [2021-11-19 21:04:17,034][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][IgniteKernal%grid-1] To start Console Management & Monitoring run ignitevisorcmd.{sh|bat} [21:04:17] : [Step 4/5] [2021-11-19 21:04:17,035][INFO ][exchange-worker-#7401%grid-1%][GridClusterStateProcessor] Writing BaselineTopology[id=0] [21:04:17] : [Step 4/5] [2021-11-19 21:04:17,036][INFO ][exchange-worker-#7276%grid-0%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], crd=true] [21:04:17] : [Step 4/5] [2021-11-19 21:04:17,036][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][IgniteKernal%grid-1] [21:04:17] : [Step 4/5] [21:04:17] : [Step 4/5] >>> +-------------------------------------------+ [21:04:17] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:04:17] : [Step 4/5] >>> +-------------------------------------------+ [21:04:17] : [Step 4/5] >>> OS name: Linux 4.15.0-151-generic amd64 [21:04:17] : [Step 4/5] >>> CPU(s): 24 [21:04:17] : [Step 4/5] >>> Heap: 2.0GB [21:04:17] : [Step 4/5] >>> VM name: 16724@c4dfe9a430b2 [21:04:17] : [Step 4/5] >>> Ignite instance name: grid-1 [21:04:17] : [Step 4/5] >>> Local node [ID=109EF74E-F74A-45D0-AC50-DA790E82B001, order=2, clientMode=false] [21:04:17] : [Step 4/5] >>> Local node addresses: [127.0.0.1] [21:04:17] : [Step 4/5] >>> Local ports: TCP:10801 TCP:45131 TCP:47501 [21:04:17] : [Step 4/5] [21:04:17] : [Step 4/5] [2021-11-19 21:04:17,038][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][GridDiscoveryManager] Topology snapshot [ver=2, locNode=109ef74e, servers=2, clients=0, state=INACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=00a375fc-dfaf-425c-b19f-ad48d81d8000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=109ef74e-f74a-45d0-ac50-da790e82b001, consistentId=grid-1, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:04:17] : [Step 4/5] [2021-11-19 21:04:17,038][INFO ][db-checkpoint-thread-#7403%grid-0%][Checkpointer] Checkpoint started [checkpointId=e9b1f8ce-32e3-4ba9-9f31-a2fbddb48904, startPtr=WALPointer [idx=0, fileOff=2889458, len=1963], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=1ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=1ms, writeCheckpointEntryDuration=2ms, splitAndSortCpPagesDuration=0ms, pages=18, reason='node started'] [21:04:17] : [Step 4/5] [2021-11-19 21:04:17,038][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][GridDiscoveryManager] ^-- Baseline [id=0, size=2, online=2, offline=0] [21:04:17] : [Step 4/5] [2021-11-19 21:04:17,040][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][GridDiscoveryManager] ^-- All baseline nodes are online, will start auto-activation [21:04:17] : [Step 4/5] [2021-11-19 21:04:17,040][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][G] Node started : [stage="Configure system pool" (0 ms),stage="Start managers" (192 ms),stage="Configure binary metadata" (1 ms),stage="Start processors" (17 ms),stage="Start 'StanByClusterTestProvider' plugin" (0 ms),stage="Start 'PageMemory tracker plugin' plugin" (0 ms),stage="Start 'TestDistibutedConfigurationPlugin' plugin" (0 ms),stage="Start 'NodeValidationPluginProvider' plugin" (0 ms),stage="Init metastore" (442 ms),stage="Init and start regions" (4 ms),stage="Restore binary memory" (112 ms),stage="Restore logical state" (64 ms),stage="Finish recovery" (0 ms),stage="Join topology" (48 ms),stage="Await transition" (4 ms),stage="Await exchange" (25 ms),stage="Total time" (909 ms)] [21:04:17] : [Step 4/5] [2021-11-19 21:04:17,042][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][root] Node started with the following configuration [id=109ef74e-f74a-45d0-ac50-da790e82b001, marshaller=BinaryMarshaller [], discovery=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=5000, ackTimeout=5000, marsh=JdkMarshaller [clsFilter=org.apache.ignite.marshaller.MarshallerUtils$1@1c9206cb], reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], binaryCfg=null, lateAff=true] [21:04:17] : [Step 4/5] [2021-11-19 21:04:17,044][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][GridClusterStateProcessor] Sending activate cluster request with BaselineTopology BaselineTopology [id=0, branchingHash=-2475315501, branchingType='Cluster activation', baselineNodes=[grid-1, grid-0]] [21:04:17] : [Step 4/5] [2021-11-19 21:04:17,045][INFO ][disco-notifier-worker-#7271%grid-0%][GridClusterStateProcessor] Received activate cluster request with BaselineTopology[id=0] initiator node ID: 00a375fc-dfaf-425c-b19f-ad48d81d8000 [21:04:17] : [Step 4/5] [2021-11-19 21:04:17,046][INFO ][disco-notifier-worker-#7389%grid-1%][GridClusterStateProcessor] Received activate cluster request with BaselineTopology[id=0] initiator node ID: 00a375fc-dfaf-425c-b19f-ad48d81d8000 [21:04:17] : [Step 4/5] [2021-11-19 21:04:17,047][INFO ][exchange-worker-#7401%grid-1%][GridCacheDatabaseSharedManager] Finish recovery performed in 15 ms. [21:04:17] : [Step 4/5] [2021-11-19 21:04:17,048][INFO ][exchange-worker-#7401%grid-1%][msg] Components activation performed in 18 ms. [21:04:17] : [Step 4/5] [2021-11-19 21:04:17,049][INFO ][exchange-worker-#7401%grid-1%][GridCacheProcessor] Finished recovery for cache [cache=ignite-sys-cache, grp=ignite-sys-cache, startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:04:17] : [Step 4/5] [2021-11-19 21:04:17,050][INFO ][exchange-worker-#7401%grid-1%][GridDhtPartitionsExchangeFuture] Successfully activated caches [nodeId=109ef74e-f74a-45d0-ac50-da790e82b001, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], newState=ACTIVE] [21:04:17] : [Step 4/5] [2021-11-19 21:04:17,051][INFO ][exchange-worker-#7401%grid-1%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:04:17] : [Step 4/5] [2021-11-19 21:04:17,056][INFO ][db-checkpoint-thread-#7403%grid-0%][Checkpointer] Checkpoint finished [cpId=e9b1f8ce-32e3-4ba9-9f31-a2fbddb48904, pages=18, markPos=WALPointer [idx=0, fileOff=2889458, len=1963], walSegmentsCovered=[], markDuration=5ms, pagesWrite=1ms, fsync=16ms, total=23ms] [21:04:17] : [Step 4/5] [2021-11-19 21:04:17,056][INFO ][grid-nio-worker-tcp-comm-0-#7215%TcpCommunicationSpi%][TcpCommunicationSpi] Accepted incoming communication connection [locAddr=/127.0.0.1:45130, rmtAddr=/127.0.0.1:35146] [21:04:17] : [Step 4/5] [2021-11-19 21:04:17,058][INFO ][grid-nio-worker-tcp-comm-0-#7333%TcpCommunicationSpi%][TcpCommunicationSpi] Established outgoing communication connection [locAddr=/127.0.0.1:35146, rmtAddr=/127.0.0.1:45130] [21:04:17] : [Step 4/5] [2021-11-19 21:04:17,059][INFO ][exchange-worker-#7401%grid-1%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], crd=false] [21:04:17] : [Step 4/5] [2021-11-19 21:04:17,061][INFO ][sys-#7264%grid-0%][GridDhtPartitionsExchangeFuture] Coordinator received single message [ver=AffinityTopologyVersion [topVer=2, minorTopVer=1], node=109ef74e-f74a-45d0-ac50-da790e82b001, allReceived=true] [21:04:17] : [Step 4/5] [2021-11-19 21:04:17,061][INFO ][sys-#7264%grid-0%][GridDhtPartitionsExchangeFuture] finishExchangeOnCoordinator [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:04:17] : [Step 4/5] [2021-11-19 21:04:17,064][INFO ][db-checkpoint-thread-#7416%grid-1%][Checkpointer] Checkpoint started [checkpointId=8cf6f12d-4532-45d1-b3d9-3dc02d34977d, startPtr=WALPointer [idx=0, fileOff=2373014, len=1963], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=2ms, writeCheckpointEntryDuration=9ms, splitAndSortCpPagesDuration=0ms, pages=18, reason='node started'] [21:04:17] : [Step 4/5] [2021-11-19 21:04:17,067][INFO ][sys-#7264%grid-0%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], err=null, rebalanced=true, wasRebalanced=false] [21:04:17] : [Step 4/5] [2021-11-19 21:04:17,069][INFO ][disco-notifier-worker-#7271%grid-0%][GridClusterStateProcessor] Received state change finish message: ACTIVE [21:04:17] : [Step 4/5] [2021-11-19 21:04:17,069][INFO ][sys-#7372%grid-1%][GridDhtPartitionsExchangeFuture] Received full message, will finish exchange [node=00a375fc-dfaf-425c-b19f-ad48d81d8000, resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:04:17] : [Step 4/5] [2021-11-19 21:04:17,069][INFO ][disco-notifier-worker-#7389%grid-1%][GridClusterStateProcessor] Received state change finish message: ACTIVE [21:04:17] : [Step 4/5] [2021-11-19 21:04:17,069][INFO ][disco-notifier-worker-#7271%grid-0%][GridClusterStateProcessor] Cluster state was changed from INACTIVE to ACTIVE [21:04:17] : [Step 4/5] [2021-11-19 21:04:17,071][INFO ][disco-notifier-worker-#7389%grid-1%][GridClusterStateProcessor] Cluster state was changed from INACTIVE to ACTIVE [21:04:17] : [Step 4/5] [2021-11-19 21:04:17,070][INFO ][sys-#7264%grid-0%][GridCacheProcessor] Finish proxy initialization, cacheName=ignite-sys-cache, localNodeId=00a375fc-dfaf-425c-b19f-ad48d81d8000 [21:04:17] : [Step 4/5] [2021-11-19 21:04:17,070][INFO ][sys-#7377%grid-1%][GridCachePartitionExchangeManager] Delay process full message without exchange id (there is exchange in progress) [nodeId=00a375fc-dfaf-425c-b19f-ad48d81d8000] [21:04:17] : [Step 4/5] [2021-11-19 21:04:17,072][INFO ][exchange-worker-#7276%grid-0%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=2, minorTopVer=1], force=false, evt=DISCOVERY_CUSTOM_EVT, node=109ef74e-f74a-45d0-ac50-da790e82b001] [21:04:17] : [Step 4/5] [2021-11-19 21:04:17,072][INFO ][sys-#7264%grid-0%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=00a375fc-dfaf-425c-b19f-ad48d81d8000, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=109ef74e-f74a-45d0-ac50-da790e82b001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637345056964, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:04:17] : [Step 4/5] [2021-11-19 21:04:17,072][INFO ][sys-#7270%grid-0%][DistributedBaselineConfiguration] Baseline auto-adjust is 'disabled' with timeout='300000' ms [21:04:17] : [Step 4/5] [2021-11-19 21:04:17,071][INFO ][sys-#7372%grid-1%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], err=null, rebalanced=true, wasRebalanced=false] [21:04:17] : [Step 4/5] [2021-11-19 21:04:17,074][INFO ][sys-#7270%grid-0%][GridClusterStateProcessor] Successfully performed final activation steps [nodeId=00a375fc-dfaf-425c-b19f-ad48d81d8000, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:04:17] : [Step 4/5] [2021-11-19 21:04:17,073][INFO ][sys-#7264%grid-0%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (1 ms), stage="Update caches registry" (9 ms), stage="Start caches" (2 ms), stage="Affinity initialization on cache group start" (0 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Restore partition states" (0 ms), stage="After states restored callback" (4 ms), stage="WAL history reservation" (0 ms), stage="Waiting for all single messages" (25 ms), stage="Affinity recalculation (crd)" (0 ms), stage="Collect update counters and create affinity messages" (0 ms), stage="Assign partitions states" (0 ms), stage="Validate partitions states" (0 ms), stage="Ideal affinity diff calculation (enforced)" (0 ms), stage="Apply update counters" (0 ms), stage="Full message preparing" (2 ms), stage="Full message sending" (0 ms), stage="State finish message sending" (0 ms), stage="Detect lost partitions" (2 ms), stage="Exchange done" (3 ms), stage="Total time" (48 ms), Discovery lag=2 ms, Latest started node id=109ef74e-f74a-45d0-ac50-da790e82b001] [21:04:17] : [Step 4/5] [2021-11-19 21:04:17,076][INFO ][sys-#7372%grid-1%][GridCacheProcessor] Finish proxy initialization, cacheName=ignite-sys-cache, localNodeId=109ef74e-f74a-45d0-ac50-da790e82b001 [21:04:17] : [Step 4/5] [2021-11-19 21:04:17,078][INFO ][sys-#7264%grid-0%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], stage="Affinity initialization on cache group start [grp=ignite-sys-cache]" (0 ms) (parent=Affinity initialization on cache group start), stage="Affinity centralized initialization (crd) [grp=ignite-sys-cache, crd=true]" (0 ms) (parent=Determine exchange type), stage="Restore partition states [grp=ignite-sys-cache]" (0 ms) (parent=Restore partition states), stage="Affinity recalculation (partitions availability) [grp=ignite-sys-cache]" (0 ms) (parent=Ideal affinity diff calculation (enforced))] [21:04:17] : [Step 4/5] [2021-11-19 21:04:17,080][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][root] awaitPartitionMapExchange finished [21:04:17] : [Step 4/5] [2021-11-19 21:04:17,079][INFO ][exchange-worker-#7401%grid-1%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=2, minorTopVer=1], force=false, evt=DISCOVERY_CUSTOM_EVT, node=109ef74e-f74a-45d0-ac50-da790e82b001] [21:04:17] : [Step 4/5] [2021-11-19 21:04:17,079][INFO ][sys-#7372%grid-1%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=109ef74e-f74a-45d0-ac50-da790e82b001, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=109ef74e-f74a-45d0-ac50-da790e82b001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637345057066, loc=true, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:04:17] : [Step 4/5] [2021-11-19 21:04:17,079][INFO ][sys-#7381%grid-1%][DistributedBaselineConfiguration] Baseline auto-adjust is 'disabled' with timeout='300000' ms [21:04:17] : [Step 4/5] [2021-11-19 21:04:17,083][INFO ][sys-#7372%grid-1%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], stage="Waiting in exchange queue" (8 ms), stage="Exchange parameters initialization" (2 ms), stage="Update caches registry" (19 ms), stage="Start caches" (0 ms), stage="Affinity initialization on cache group start" (0 ms), stage="Determine exchange type" (1 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Restore partition states" (0 ms), stage="After states restored callback" (1 ms), stage="WAL history reservation" (0 ms), stage="Waiting for Full message" (15 ms), stage="Affinity recalculation" (0 ms), stage="Full map updating" (1 ms), stage="Detect lost partitions" (4 ms), stage="Exchange done" (7 ms), stage="Total time" (58 ms)] [21:04:17] : [Step 4/5] [2021-11-19 21:04:17,082][INFO ][db-checkpoint-thread-#7416%grid-1%][Checkpointer] Checkpoint finished [cpId=8cf6f12d-4532-45d1-b3d9-3dc02d34977d, pages=18, markPos=WALPointer [idx=0, fileOff=2373014, len=1963], walSegmentsCovered=[], markDuration=13ms, pagesWrite=3ms, fsync=13ms, total=30ms] [21:04:17] : [Step 4/5] [2021-11-19 21:04:17,082][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][root] awaitPartitionMapExchange finished [21:04:17] : [Step 4/5] [2021-11-19 21:04:17,084][INFO ][sys-#7372%grid-1%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], stage="Affinity initialization on cache group start [grp=ignite-sys-cache]" (0 ms) (parent=Affinity initialization on cache group start), stage="Affinity centralized initialization (crd) [grp=ignite-sys-cache, crd=false]" (1 ms) (parent=Determine exchange type), stage="Restore partition states [grp=ignite-sys-cache]" (0 ms) (parent=Restore partition states), stage="Affinity applying from full message [grp=ignite-sys-cache]" (0 ms) (parent=Affinity recalculation)] [21:04:17] : [Step 4/5] [2021-11-19 21:04:17,083][INFO ][sys-#7381%grid-1%][GridClusterStateProcessor] Successfully performed final activation steps [nodeId=109ef74e-f74a-45d0-ac50-da790e82b001, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:04:17] : [Step 4/5] [2021-11-19 21:04:17,087][INFO ][test-runner-#6618%encryption.EncryptedCacheDestroyTest%][root] awaitPartitionMapExchange finished [21:04:17] : [Step 4/5] [21:04:17] >>> Stopping test: EncryptedCacheDestroyTest#testEncryptedCacheFromGroupDestroy in 13382 ms <<< [21:04:17] : [Step 4/5] [2021-11-19 21:04:17,088][INFO ][main][root] >>> Stopping test: EncryptedCacheDestroyTest#testEncryptedCacheFromGroupDestroy in 13382 ms <<< [21:04:17] : [Step 4/5] [21:04:17] >>> Heap: 566 MB used / 1937 MB commited / 1937 MB max <<< [21:04:17] : [Step 4/5] [2021-11-19 21:04:17,088][INFO ][main][root] >>> Heap: 566 MB used / 1937 MB commited / 1937 MB max <<< [21:04:17] : [Step 4/5] [21:04:17] >>> Non-Heap: 136 MB used / 147 MB commited / 0 MB max <<< [21:04:17] : [Step 4/5] [2021-11-19 21:04:17,088][INFO ][main][root] >>> Non-Heap: 136 MB used / 147 MB commited / 0 MB max <<< [21:04:17] : [Step 4/5] [2021-11-19 21:04:17,089][INFO ][main][root] >>> Stopping grid [name=grid-1, id=109ef74e-f74a-45d0-ac50-da790e82b001] [21:04:17] : [Step 4/5] [2021-11-19 21:04:17,099][INFO ][db-checkpoint-thread-#7416%grid-1%][Checkpointer] Skipping checkpoint (no pages were modified) [checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=1ms, reason='timeout'] [21:04:17] : [Step 4/5] [2021-11-19 21:04:17,104][INFO ][tcp-disco-sock-reader-[00a375fc 127.0.0.1:58913]-#371%grid-1%-#7394%grid-1%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:58913, rmtPort=58913, rmtNodeId=00a375fc-dfaf-425c-b19f-ad48d81d8000] [21:04:17] : [Step 4/5] [2021-11-19 21:04:17,105][INFO ][disco-event-worker-#7275%grid-0%][GridDiscoveryManager] Node left topology: TcpDiscoveryNode [id=109ef74e-f74a-45d0-ac50-da790e82b001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637345056964, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false] [21:04:17] : [Step 4/5] [2021-11-19 21:04:17,106][INFO ][main][GridCacheProcessor] Stopped cache [cacheName=ignite-sys-cache] [21:04:17] : [Step 4/5] [2021-11-19 21:04:17,107][INFO ][disco-event-worker-#7275%grid-0%][GridDiscoveryManager] Topology snapshot [ver=3, locNode=00a375fc, servers=1, clients=0, state=ACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=00a375fc-dfaf-425c-b19f-ad48d81d8000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:04:17] : [Step 4/5] [2021-11-19 21:04:17,109][INFO ][disco-event-worker-#7275%grid-0%][GridDiscoveryManager] ^-- Baseline [id=0, size=2, online=1, offline=1] [21:04:17] : [Step 4/5] [2021-11-19 21:04:17,109][INFO ][main][FilePageStoreManager] Cleanup cache stores [total=3, left=0, cleanFiles=false] [21:04:17] : [Step 4/5] [2021-11-19 21:04:17,111][INFO ][main][GridDeploymentLocalStore] Removed undeployed class: GridDeployment [ts=1637345057066, depMode=SHARED, clsLdr=IsolatedClassLoader{roleName='test'}, clsLdrId=3ee1d593d71-109ef74e-f74a-45d0-ac50-da790e82b001, userVer=0, loc=true, sampleClsName=org.apache.ignite.internal.processors.cache.distributed.dht.preloader.IgniteDhtPartitionsToReloadMap, pendingUndeploy=false, undeployed=true, usage=0] [21:04:17] : [Step 4/5] [2021-11-19 21:04:17,112][INFO ][exchange-worker-#7276%grid-0%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], crd=true, evt=NODE_LEFT, evtNode=109ef74e-f74a-45d0-ac50-da790e82b001, customEvt=null, allowMerge=false, exchangeFreeSwitch=true] [21:04:17] : [Step 4/5] [2021-11-19 21:04:17,113][INFO ][exchange-worker-#7276%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:04:17] : [Step 4/5] [2021-11-19 21:04:17,115][INFO ][exchange-worker-#7276%grid-0%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], err=null, rebalanced=true, wasRebalanced=true] [21:04:17] : [Step 4/5] [2021-11-19 21:04:17,121][INFO ][main][IgniteKernal%grid-1] [21:04:17] : [Step 4/5] [21:04:17] : [Step 4/5] >>> +------------------------------------------------------+ [21:04:17] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV stopped OK [21:04:17] : [Step 4/5] >>> +------------------------------------------------------+ [21:04:17] : [Step 4/5] >>> Ignite instance name: grid-1 [21:04:17] : [Step 4/5] >>> Grid uptime: 00:00:00.092 [21:04:17] : [Step 4/5] [21:04:17] : [Step 4/5] [21:04:17] : [Step 4/5] [2021-11-19 21:04:17,122][INFO ][main][root] >>> Stopping grid [name=grid-0, id=00a375fc-dfaf-425c-b19f-ad48d81d8000] [21:04:17] : [Step 4/5] [2021-11-19 21:04:17,125][INFO ][exchange-worker-#7276%grid-0%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=00a375fc-dfaf-425c-b19f-ad48d81d8000, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], evt=NODE_LEFT, evtNode=TcpDiscoveryNode [id=109ef74e-f74a-45d0-ac50-da790e82b001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637345056964, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0]] [21:04:17] : [Step 4/5] [2021-11-19 21:04:17,126][INFO ][exchange-worker-#7276%grid-0%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (1 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="After states restored callback" (1 ms), stage="WAL history reservation" (0 ms), stage="Finalize update counters" (0 ms), stage="Detect lost partitions" (9 ms), stage="Exchange done" (1 ms), stage="Total time" (12 ms)] [21:04:17] : [Step 4/5] [2021-11-19 21:04:17,127][INFO ][exchange-worker-#7276%grid-0%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], stage="Affinity initialization (exchange-free switch on fully-rebalanced topology) [grp=ignite-sys-cache]" (0 ms) (parent=Determine exchange type)] [21:04:17] : [Step 4/5] [2021-11-19 21:04:17,127][INFO ][exchange-worker-#7276%grid-0%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], crd=true] [21:04:17] : [Step 4/5] [2021-11-19 21:04:17,128][INFO ][exchange-worker-#7276%grid-0%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=3, minorTopVer=0], force=false, evt=NODE_LEFT, node=109ef74e-f74a-45d0-ac50-da790e82b001] [21:04:17] : [Step 4/5] [2021-11-19 21:04:17,129][INFO ][db-checkpoint-thread-#7403%grid-0%][Checkpointer] Skipping checkpoint (no pages were modified) [checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, reason='timeout'] [21:04:17] : [Step 4/5] [2021-11-19 21:04:17,133][INFO ][tcp-disco-sock-reader-[109ef74e 127.0.0.1:38151]-#372%grid-0%-#7395%grid-0%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:38151, rmtPort=38151, rmtNodeId=109ef74e-f74a-45d0-ac50-da790e82b001] [21:04:17] : [Step 4/5] [2021-11-19 21:04:17,134][INFO ][main][GridCacheProcessor] Stopped cache [cacheName=ignite-sys-cache] [21:04:17] : [Step 4/5] [2021-11-19 21:04:17,137][INFO ][main][FilePageStoreManager] Cleanup cache stores [total=3, left=0, cleanFiles=false] [21:04:17] : [Step 4/5] [2021-11-19 21:04:17,139][INFO ][main][GridDeploymentLocalStore] Removed undeployed class: GridDeployment [ts=1637345057055, depMode=SHARED, clsLdr=IsolatedClassLoader{roleName='test'}, clsLdrId=1ee1d593d71-00a375fc-dfaf-425c-b19f-ad48d81d8000, userVer=0, loc=true, sampleClsName=org.apache.ignite.internal.processors.cache.distributed.dht.preloader.GridDhtPartitionMap, pendingUndeploy=false, undeployed=true, usage=0] [21:04:17] : [Step 4/5] [2021-11-19 21:04:17,145][INFO ][main][IgniteKernal%grid-0] [21:04:17] : [Step 4/5] [21:04:17] : [Step 4/5] >>> +------------------------------------------------------+ [21:04:17] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV stopped OK [21:04:17] : [Step 4/5] >>> +------------------------------------------------------+ [21:04:17] : [Step 4/5] >>> Ignite instance name: grid-0 [21:04:17] : [Step 4/5] >>> Grid uptime: 00:00:01.033 [21:04:17] : [Step 4/5] [21:04:17] : [Step 4/5] [21:04:17] : [Step 4/5] [21:04:17] >>> Starting test: EncryptedCacheDestroyTest#testEncryptedCacheDestroy <<< [21:04:17] : [Step 4/5] [2021-11-19 21:04:17,428][INFO ][main][root] >>> Starting test: EncryptedCacheDestroyTest#testEncryptedCacheDestroy <<< [21:04:17] : [Step 4/5] [21:04:17] >>> Heap: 568 MB used / 1937 MB commited / 1937 MB max <<< [21:04:17] : [Step 4/5] [2021-11-19 21:04:17,428][INFO ][main][root] >>> Heap: 568 MB used / 1937 MB commited / 1937 MB max <<< [21:04:17] : [Step 4/5] [21:04:17] >>> Non-Heap: 136 MB used / 147 MB commited / 0 MB max <<< [21:04:17] : [Step 4/5] [2021-11-19 21:04:17,429][INFO ][main][root] >>> Non-Heap: 136 MB used / 147 MB commited / 0 MB max <<< [21:04:17]W: [org.apache.ignite:ignite-core] [2021-11-19 21:04:17,435][WARN ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][G] Ignite work directory is not provided, automatically resolved to: /opt/buildagent/work/7bc1c54bc719b67c/work [21:04:17] : [Step 4/5] [2021-11-19 21:04:17,437][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][IgniteKernal%grid-0] [21:04:17] : [Step 4/5] [21:04:17] : [Step 4/5] >>> __________ ________________ [21:04:17] : [Step 4/5] >>> / _/ ___/ |/ / _/_ __/ __/ [21:04:17] : [Step 4/5] >>> _/ // (7 7 // / / / / _/ [21:04:17] : [Step 4/5] >>> /___/\___/_/|_/___/ /_/ /___/ [21:04:17] : [Step 4/5] >>> [21:04:17] : [Step 4/5] >>> ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:04:17] : [Step 4/5] >>> 2021 Copyright(C) Apache Software Foundation [21:04:17] : [Step 4/5] >>> [21:04:17] : [Step 4/5] >>> Ignite documentation: http://ignite.apache.org [21:04:17] : [Step 4/5] [21:04:17] : [Step 4/5] [2021-11-19 21:04:17,438][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][IgniteKernal%grid-0] Config URL: n/a [21:04:17] : [Step 4/5] [2021-11-19 21:04:17,439][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][IgniteKernal%grid-0] IgniteConfiguration [igniteInstanceName=grid-0, pubPoolSize=24, svcPoolSize=24, callbackPoolSize=24, stripedPoolSize=24, sysPoolSize=24, mgmtPoolSize=4, dataStreamerPoolSize=24, utilityCachePoolSize=24, utilityCacheKeepAliveTime=60000, p2pPoolSize=2, qryPoolSize=24, buildIdxPoolSize=4, igniteHome=/opt/buildagent/work/7bc1c54bc719b67c, igniteWorkDir=/opt/buildagent/work/7bc1c54bc719b67c/work, mbeanSrv=com.sun.jmx.mbeanserver.JmxMBeanServer@6fe85038, nodeId=00370ae8-77ec-467f-a29b-93cb84238000, marsh=BinaryMarshaller [], marshLocJobs=false, daemon=false, p2pEnabled=true, netTimeout=10000, netCompressionLevel=1, sndRetryDelay=1000, sndRetryCnt=3, metricsHistSize=10000, metricsUpdateFreq=1000, metricsExpTime=9223372036854775807, discoSpi=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=0, ackTimeout=0, marsh=null, reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], segPlc=STOP, segResolveAttempts=2, waitForSegOnStart=true, allResolversPassReq=true, segChkFreq=10000, commSpi=TcpCommunicationSpi [connectGate=org.apache.ignite.spi.communication.tcp.internal.ConnectGateway@22d3a0cf, ctxInitLatch=java.util.concurrent.CountDownLatch@78361526[Count = 1], stopping=false, clientPool=null, nioSrvWrapper=null, stateProvider=null], evtSpi=MemoryEventStorageSpi [expireAgeMs=9223372036854775807, expireCnt=10000, filter=null], colSpi=NoopCollisionSpi [], deploySpi=LocalDeploymentSpi [], indexingSpi=org.apache.ignite.spi.indexing.noop.NoopIndexingSpi@b809e4a, addrRslvr=null, encryptionSpi=org.apache.ignite.spi.encryption.keystore.KeystoreEncryptionSpi@57dc0022, tracingSpi=org.apache.ignite.spi.tracing.NoopTracingSpi@428164cc, clientMode=false, rebalanceThreadPoolSize=4, rebalanceTimeout=10000, rebalanceBatchesPrefetchCnt=3, rebalanceThrottle=0, rebalanceBatchSize=524288, txCfg=TransactionConfiguration [txSerEnabled=false, dfltIsolation=REPEATABLE_READ, dfltConcurrency=PESSIMISTIC, dfltTxTimeout=0, txTimeoutOnPartitionMapExchange=0, deadlockTimeout=10000, pessimisticTxLogSize=0, pessimisticTxLogLinger=10000, tmLookupClsName=null, txManagerFactory=null, useJtaSync=false], cacheSanityCheckEnabled=true, discoStartupDelay=60000, deployMode=SHARED, p2pMissedCacheSize=100, locHost=127.0.0.1, timeSrvPortBase=31100, timeSrvPortRange=100, failureDetectionTimeout=10000, sysWorkerBlockedTimeout=null, clientFailureDetectionTimeout=10000, metricsLogFreq=0, connectorCfg=null, odbcCfg=null, warmupClos=null, atomicCfg=AtomicConfiguration [seqReserveSize=1000, cacheMode=PARTITIONED, backups=1, aff=null, grpName=null], classLdr=null, sslCtxFactory=null, platformCfg=null, binaryCfg=null, memCfg=null, pstCfg=null, dsCfg=DataStorageConfiguration [sysRegionInitSize=41943040, sysRegionMaxSize=104857600, pageSize=4096, concLvl=0, dfltDataRegConf=DataRegionConfiguration [name=default, maxSize=10485760, initSize=268435456, swapPath=null, pageEvictionMode=DISABLED, pageReplacementMode=CLOCK, evictionThreshold=0.9, emptyPagesPoolSize=100, metricsEnabled=false, metricsSubIntervalCount=5, metricsRateTimeInterval=60000, persistenceEnabled=true, checkpointPageBufSize=0, lazyMemoryAllocation=true, warmUpCfg=null], dataRegions=null, storagePath=null, checkpointFreq=180000, lockWaitTime=10000, checkpointThreads=4, checkpointWriteOrder=SEQUENTIAL, walHistSize=20, maxWalArchiveSize=1073741824, walSegments=10, walSegmentSize=67108864, walPath=db/wal, walArchivePath=db/wal/archive, cdcWalPath=db/wal/cdc, cdcEnabled=false, metricsEnabled=false, walMode=FSYNC, walTlbSize=131072, walBuffSize=0, walFlushFreq=2000, walFsyncDelay=1000, walRecordIterBuffSize=67108864, alwaysWriteFullPages=false, fileIOFactory=org.apache.ignite.internal.processors.cache.persistence.file.AsyncFileIOFactory@7f8ff210, metricsSubIntervalCnt=5, metricsRateTimeInterval=60000, walAutoArchiveAfterInactivity=-1, walForceArchiveTimeout=-1, writeThrottlingEnabled=false, walCompactionEnabled=false, walCompactionLevel=1, checkpointReadLockTimeout=null, walPageCompression=DISABLED, walPageCompressionLevel=null, dfltWarmUpCfg=null, encCfg=org.apache.ignite.configuration.EncryptionConfiguration@173b94d5, defragmentationThreadPoolSize=4, minWalArchiveSize=-1], snapshotPath=snapshots, activeOnStart=true, activeOnStartPropSetFlag=false, autoActivation=true, autoActivationPropSetFlag=false, clusterStateOnStart=null, sqlConnCfg=null, cliConnCfg=ClientConnectorConfiguration [host=null, port=10800, portRange=100, sockSndBufSize=0, sockRcvBufSize=0, tcpNoDelay=true, maxOpenCursorsPerConn=128, threadPoolSize=24, selectorCnt=12, idleTimeout=0, handshakeTimeout=10000, jdbcEnabled=true, odbcEnabled=true, thinCliEnabled=true, sslEnabled=false, useIgniteSslCtxFactory=true, sslClientAuth=false, sslCtxFactory=null, thinCliCfg=ThinClientConfiguration [maxActiveTxPerConn=100, maxActiveComputeTasksPerConn=0]], mvccVacuumThreadCnt=2, mvccVacuumFreq=5000, authEnabled=false, failureHnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]], commFailureRslvr=null, sqlCfg=SqlConfiguration [longQryWarnTimeout=3000, dfltQryTimeout=0, sqlQryHistSize=1000, validationEnabled=false], asyncContinuationExecutor=null] [21:04:17] : [Step 4/5] [2021-11-19 21:04:17,447][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][IgniteKernal%grid-0] Daemon mode: off [21:04:17] : [Step 4/5] [2021-11-19 21:04:17,447][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][IgniteKernal%grid-0] OS: Linux 4.15.0-151-generic amd64 [21:04:17] : [Step 4/5] [2021-11-19 21:04:17,447][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][IgniteKernal%grid-0] OS user: teamcity [21:04:17] : [Step 4/5] [2021-11-19 21:04:17,448][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][IgniteKernal%grid-0] PID: 16724 [21:04:17] : [Step 4/5] [2021-11-19 21:04:17,448][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][IgniteKernal%grid-0] Language runtime: Java Platform API Specification ver. 1.8 [21:04:17] : [Step 4/5] [2021-11-19 21:04:17,449][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][IgniteKernal%grid-0] VM information: Java(TM) SE Runtime Environment 1.8.0_261-b12 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 25.261-b12 [21:04:17] : [Step 4/5] [2021-11-19 21:04:17,449][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][IgniteKernal%grid-0] VM total memory: 1.9GB [21:04:17] : [Step 4/5] [2021-11-19 21:04:17,449][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][IgniteKernal%grid-0] Remote Management [restart: off, REST: off, JMX (remote: off)] [21:04:17] : [Step 4/5] [2021-11-19 21:04:17,449][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][IgniteKernal%grid-0] Logger: GridTestLog4jLogger [quiet=false, config=null] [21:04:17] : [Step 4/5] [2021-11-19 21:04:17,450][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][IgniteKernal%grid-0] IGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c [21:04:17] : [Step 4/5] [2021-11-19 21:04:17,450][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][IgniteKernal%grid-0] VM arguments: [-DIGNITE_DUMP_THREADS_ON_FAILURE=false, -DMono=/usr/bin/mono-sgen, -DMono4.0_x64=/usr/lib/mono/4.0, -DMono4.5_x64=/usr/lib/mono/4.5, -DMonoVersion=6.12.0.90, -DSKIP_BUILD=false, -Dagent.home.dir=/opt/buildagent, -Dagent.name=aitc-lin02_03, -Dagent.ownPort=9090, -Dagent.work.dir=/opt/buildagent/work, -Dbuild.number=95, -Dbuild.vcs.number=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.1=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.GitHubApacheIgnite=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dclassworlds.conf=/opt/buildagent/temp/buildTmp/teamcity.m2.conf, -Dcom.jetbrains.maven.watcher.report.file=/opt/buildagent/temp/buildTmp/maven-build-info.xml, -Djava.io.tmpdir=/opt/buildagent/temp/buildTmp, -Dmaven.home=/opt/buildagent/tools/maven3_6, -Dmaven.multiModuleProjectDirectory=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.agent.cpuBenchmark=457, -Dteamcity.agent.dotnet.agent_url=http://localhost:9090/RPC2, -Dteamcity.agent.dotnet.build_id=6278078, -Dteamcity.auth.password=*******, -Dteamcity.auth.userId=TeamCityBuildId=6278078, -Dteamcity.build.changedFiles.file=/opt/buildagent/temp/buildTmp/changedFiles6342607772318147725.txt, -Dteamcity.build.checkoutDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.build.id=6278078, -Dteamcity.build.properties.file=/opt/buildagent/temp/buildTmp/teamcity.build5164517880467851002.properties, -Dteamcity.build.tempDir=/opt/buildagent/temp/buildTmp, -Dteamcity.build.workingDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.buildConfName=Basic 3, -Dteamcity.buildType.id=IgniteTests24Java8_Basic3, -Dteamcity.configuration.properties.file=/opt/buildagent/temp/buildTmp/teamcity.config5591980786735343870.properties, -Dteamcity.maven.userSettings.path=/opt/buildagent/temp/buildTmp/maven_settings_585072866407032347.xml, -Dteamcity.maven.watcher.home=/opt/buildagent/plugins/mavenPlugin/maven-watcher-jdk16, -Dteamcity.projectName=Ignite Tests 2.x (JDK 8/11), -Dteamcity.runner.properties.file=/opt/buildagent/temp/buildTmp/teamcity.runner9098465561618137420.properties, -Dteamcity.tests.recentlyFailedTests.file=/opt/buildagent/temp/buildTmp/testsToRunFirst3891775683130404069.txt, -Dteamcity.version=2021.2 (build 99542), -ea, -Xms2g, -Xmx2g, -XX:+HeapDumpOnOutOfMemoryError, -DIGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_TEST_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_UPDATE_NOTIFIER=false, -DIGNITE_NO_DISCO_ORDER=true, -DIGNITE_PERFORMANCE_SUGGESTIONS_DISABLED=true, -Djava.net.preferIPv4Stack=true, -DTEST_SCALE_FACTOR=1.0, -DIGNITE_TEST_PROP_LOG4J_FILE=log4j-tc-test.xml, -DIGNITE_QUIET=false, -DIGNITE_MARSHAL_BUFFERS_RECHECK=1000, -Dmaven.repo.local=/opt/buildagent/.m2/repository] [21:04:17] : [Step 4/5] [2021-11-19 21:04:17,454][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][IgniteKernal%grid-0] System cache's DataRegion size is configured to 40 MB. Use DataStorageConfiguration.systemRegionInitialSize property to change the setting. [21:04:17] : [Step 4/5] [2021-11-19 21:04:17,455][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][IgniteKernal%grid-0] Configured caches [in 'sysMemPlc' dataRegion: ['ignite-sys-cache']] [21:04:17]W: [org.apache.ignite:ignite-core] [2021-11-19 21:04:17,455][WARN ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][IgniteKernal%grid-0] Peer class loading is enabled (disable it in production for performance and deployment consistency reasons) [21:04:17] : [Step 4/5] [2021-11-19 21:04:17,455][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][IgniteKernal%grid-0] 3-rd party licenses can be found at: /opt/buildagent/work/7bc1c54bc719b67c/libs/licenses [21:04:17] : [Step 4/5] [2021-11-19 21:04:17,459][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][IgnitePluginProcessor] Configured plugins: [21:04:17] : [Step 4/5] [2021-11-19 21:04:17,459][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][IgnitePluginProcessor] ^-- StanByClusterTestProvider 1.0 [21:04:17] : [Step 4/5] [2021-11-19 21:04:17,460][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][IgnitePluginProcessor] ^-- null [21:04:17] : [Step 4/5] [2021-11-19 21:04:17,460][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][IgnitePluginProcessor] [21:04:17] : [Step 4/5] [2021-11-19 21:04:17,460][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][IgnitePluginProcessor] ^-- PageMemory tracker plugin 1.0 [21:04:17] : [Step 4/5] [2021-11-19 21:04:17,460][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][IgnitePluginProcessor] ^-- null [21:04:17] : [Step 4/5] [2021-11-19 21:04:17,461][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][IgnitePluginProcessor] [21:04:17] : [Step 4/5] [2021-11-19 21:04:17,461][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][IgnitePluginProcessor] ^-- TestDistibutedConfigurationPlugin 1.0 [21:04:17] : [Step 4/5] [2021-11-19 21:04:17,461][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][IgnitePluginProcessor] ^-- null [21:04:17] : [Step 4/5] [2021-11-19 21:04:17,461][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][IgnitePluginProcessor] [21:04:17] : [Step 4/5] [2021-11-19 21:04:17,461][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][IgnitePluginProcessor] ^-- NodeValidationPluginProvider 1.0 [21:04:17] : [Step 4/5] [2021-11-19 21:04:17,462][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][IgnitePluginProcessor] ^-- null [21:04:17] : [Step 4/5] [2021-11-19 21:04:17,462][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][IgnitePluginProcessor] [21:04:17] : [Step 4/5] [2021-11-19 21:04:17,462][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][FailureProcessor] Configured failure handler: [hnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]]] [21:04:17] : [Step 4/5] [2021-11-19 21:04:17,474][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][TcpCommunicationSpi] Successfully bound communication NIO server to TCP port [port=45130, locHost=/127.0.0.1, selectorsCnt=12, selectorSpins=0, pairedConn=false] [21:04:17]W: [org.apache.ignite:ignite-core] [2021-11-19 21:04:17,475][WARN ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][TcpCommunicationSpi] Message queue limit is set to 0 which may lead to potential OOMEs when running cache operations in FULL_ASYNC or PRIMARY_SYNC modes due to message queues growth on sender and receiver sides. [21:04:17] : [Step 4/5] [2021-11-19 21:04:17,494][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][GridCollisionManager] Collision resolution is disabled (all jobs will be activated upon arrival). [21:04:17] : [Step 4/5] [2021-11-19 21:04:17,494][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][IgniteKernal%grid-0] Security status [authentication=off, sandbox=off, tls/ssl=off] [21:04:17] : [Step 4/5] [2021-11-19 21:04:17,555][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:04:17] : [Step 4/5] [2021-11-19 21:04:17,638][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][MaintenanceProcessor] Resolved store directory for node persistent data: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0 [21:04:17] : [Step 4/5] [2021-11-19 21:04:17,639][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][CacheObjectBinaryProcessorImpl] Resolved directory for serialized binary metadata: /opt/buildagent/work/7bc1c54bc719b67c/work/db/binary_meta/grid_0 [21:04:17] : [Step 4/5] [2021-11-19 21:04:17,643][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0 [21:04:17] : [Step 4/5] [2021-11-19 21:04:17,644][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][FileWriteAheadLogManager] Resolved write ahead log work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0 [21:04:17] : [Step 4/5] [2021-11-19 21:04:17,644][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][FileWriteAheadLogManager] Resolved write ahead log archive directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0 [21:04:18]W: [org.apache.ignite:ignite-core] [2021-11-19 21:04:18,029][WARN ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][GridCacheDatabaseSharedManager] DataRegion maxSize=10.5 MB is smaller than defaultInitialSize=268.4 MB, setting initialSize to 10.5 MB [21:04:18] : [Step 4/5] [2021-11-19 21:04:18,028][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000000.wal [21:04:18] : [Step 4/5] [2021-11-19 21:04:18,034][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][GridCacheDatabaseSharedManager] Configured data regions initialized successfully [total=5] [21:04:18] : [Step 4/5] [2021-11-19 21:04:18,036][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][IgniteSnapshotManager] Resolved snapshot work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/snapshots [21:04:18] : [Step 4/5] [2021-11-19 21:04:18,037][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][IgniteSnapshotManager] Resolved temp directory for snapshot creation: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0/snp [21:04:18] : [Step 4/5] [2021-11-19 21:04:18,039][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][ClientListenerProcessor] Client connector processor has started on TCP port 10800 [21:04:18] : [Step 4/5] [2021-11-19 21:04:18,044][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][IgniteKernal%grid-0] Non-loopback local IPs: 172.17.0.4 [21:04:18] : [Step 4/5] [2021-11-19 21:04:18,045][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][IgniteKernal%grid-0] Enabled local MACs: 0242AC110004 [21:04:18] : [Step 4/5] [2021-11-19 21:04:18,046][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:04:18] : [Step 4/5] [2021-11-19 21:04:18,047][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:04:18] : [Step 4/5] [2021-11-19 21:04:18,048][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:04:18] : [Step 4/5] [2021-11-19 21:04:18,049][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][GridCacheDatabaseSharedManager] Applying lost metastore updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:04:18] : [Step 4/5] [2021-11-19 21:04:18,050][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=0 ms] [21:04:18] : [Step 4/5] [2021-11-19 21:04:18,051][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][GridCacheProcessor] Restoring partition state for local groups. [21:04:18] : [Step 4/5] [2021-11-19 21:04:18,051][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=0, partitionsProcessed=0, time=0ms] [21:04:18] : [Step 4/5] [2021-11-19 21:04:18,051][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][GridEncryptionManager] Encryption keys loaded from metastore. [grps=, masterKeyName=ignite.master.key] [21:04:18] : [Step 4/5] [2021-11-19 21:04:18,056][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][ClusterProcessor] Cluster ID and tag has been read from metastorage: null [21:04:18] : [Step 4/5] [2021-11-19 21:04:18,056][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][IgniteClusterImpl] Shutdown policy was updated [oldVal=null, newVal=null] [21:04:18] : [Step 4/5] [2021-11-19 21:04:18,056][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][GridCacheDatabaseSharedManager] Checkpoint frequency deviation changed [oldVal=null, newVal=null] [21:04:18] : [Step 4/5] [2021-11-19 21:04:18,066][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][FilePageStoreManager] Cleanup cache stores [total=1, left=0, cleanFiles=false] [21:04:18] : [Step 4/5] [2021-11-19 21:04:18,068][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:04:18] : [Step 4/5] [2021-11-19 21:04:18,069][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:04:18] : [Step 4/5] [2021-11-19 21:04:18,069][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:04:18] : [Step 4/5] [2021-11-19 21:04:18,070][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][GridCacheDatabaseSharedManager] Data Regions Started: 5 [21:04:18] : [Step 4/5] [2021-11-19 21:04:18,070][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][GridCacheDatabaseSharedManager] ^-- sysMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:04:18] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:04:18] : [Step 4/5] ^-- default region [type=default, persistence=true, lazyAlloc=true, [21:04:18] : [Step 4/5] ... initCfg=10MB, maxCfg=10MB, usedRam=0MB, freeRam=100%, allocRam=0MB, allocTotal=0MB] [21:04:18] : [Step 4/5] ^-- metastoreMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:04:18] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:04:18] : [Step 4/5] ^-- TxLog region [type=internal, persistence=true, lazyAlloc=false, [21:04:18] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:04:18] : [Step 4/5] ^-- volatileDsMemPlc region [type=user, persistence=false, lazyAlloc=true, [21:04:18] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB] [21:04:18] : [Step 4/5] ^-- Ignite persistence [used=0MB] [21:04:18] : [Step 4/5] [21:04:18] : [Step 4/5] [2021-11-19 21:04:18,072][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][GridCacheDatabaseSharedManager] Starting binary memory restore for: [-2100569601] [21:04:18] : [Step 4/5] [2021-11-19 21:04:18,079][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:04:18] : [Step 4/5] [2021-11-19 21:04:18,079][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:04:18] : [Step 4/5] [2021-11-19 21:04:18,080][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000000.wal, offset=0, ver=2] [21:04:18] : [Step 4/5] [2021-11-19 21:04:18,084][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][GridCacheProcessor] Started cache in recovery mode [name=ignite-sys-cache, id=-2100569601, dataRegionName=sysMemPlc, mode=REPLICATED, atomicity=TRANSACTIONAL, backups=2147483647, mvcc=false] [21:04:18] : [Step 4/5] [2021-11-19 21:04:18,085][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][GridCacheDatabaseSharedManager] Binary recovery performed in 13 ms. [21:04:18] : [Step 4/5] [2021-11-19 21:04:18,085][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:04:18] : [Step 4/5] [2021-11-19 21:04:18,085][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][GridCacheDatabaseSharedManager] Applying lost cache updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:04:18] : [Step 4/5] [2021-11-19 21:04:18,143][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=51 ms] [21:04:18] : [Step 4/5] [2021-11-19 21:04:18,143][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][GridCacheProcessor] Restoring partition state for local groups. [21:04:18] : [Step 4/5] [2021-11-19 21:04:18,148][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=1, partitionsProcessed=100, time=0ms] [21:04:18] : [Step 4/5] [2021-11-19 21:04:18,452][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][TestTcpDiscoverySpi] Successfully bound to TCP port [port=47500, localHost=localhost/127.0.0.1, locNodeId=00370ae8-77ec-467f-a29b-93cb84238000] [21:04:18] : [Step 4/5] [2021-11-19 21:04:18,463][INFO ][disco-notifier-worker-#7539%grid-0%][MvccProcessorImpl] Assigned mvcc coordinator [crd=MvccCoordinator [topVer=AffinityTopologyVersion [topVer=1, minorTopVer=0], nodeId=00370ae8-77ec-467f-a29b-93cb84238000, ver=1637345058456, local=true, initialized=false]] [21:04:18] : [Step 4/5] [2021-11-19 21:04:18,464][INFO ][sys-#7528%grid-0%][ClusterProcessor] Writing cluster ID and tag to metastorage on ready for write ClusterIdAndTag [id=ee6fb329-7b0a-43cc-8e0d-0768a6b4d7c6, tag=dazzling_burnell] [21:04:18] : [Step 4/5] [2021-11-19 21:04:18,469][INFO ][disco-notifier-worker-#7539%grid-0%][ClusterProcessor] dazzling_burnell [21:04:18] : [Step 4/5] [2021-11-19 21:04:18,471][INFO ][disco-notifier-worker-#7539%grid-0%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustEnabled' was changed from 'null' to 'false' [21:04:18] : [Step 4/5] [2021-11-19 21:04:18,472][INFO ][disco-notifier-worker-#7539%grid-0%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustTimeout' was changed from 'null' to '300000' [21:04:18] : [Step 4/5] [2021-11-19 21:04:18,472][INFO ][disco-notifier-worker-#7539%grid-0%][IgniteTxManager] Transactions parameter 'longOperationsDumpTimeout' was changed from 'null' to '60000' [21:04:18] : [Step 4/5] [2021-11-19 21:04:18,473][INFO ][disco-notifier-worker-#7539%grid-0%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpThreshold' was changed from 'null' to '0' [21:04:18] : [Step 4/5] [2021-11-19 21:04:18,474][INFO ][disco-notifier-worker-#7539%grid-0%][IgniteTxManager] Transactions parameter 'transactionTimeDumpSamplesCoefficient' was changed from 'null' to '0.0' [21:04:18] : [Step 4/5] [2021-11-19 21:04:18,474][INFO ][disco-notifier-worker-#7539%grid-0%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpSamplesPerSecondLimit' was changed from 'null' to '5' [21:04:18] : [Step 4/5] [2021-11-19 21:04:18,475][INFO ][disco-notifier-worker-#7539%grid-0%][IgniteTxManager] Transactions parameter 'collisionsDumpInterval' was changed from 'null' to '1000' [21:04:18] : [Step 4/5] [2021-11-19 21:04:18,476][INFO ][disco-notifier-worker-#7539%grid-0%][IgniteTxManager] Transactions parameter 'txOwnerDumpRequestsAllowed' was changed from 'null' to 'true' [21:04:18] : [Step 4/5] [2021-11-19 21:04:18,477][INFO ][disco-notifier-worker-#7539%grid-0%][GridCacheDatabaseSharedManager] Historical rebalance WAL threshold changed [property=historical.rebalance.threshold, oldVal=null, newVal=500] [21:04:18] : [Step 4/5] [2021-11-19 21:04:18,479][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][IgniteKernal%grid-0] To start Console Management & Monitoring run ignitevisorcmd.{sh|bat} [21:04:18] : [Step 4/5] [2021-11-19 21:04:18,480][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][IgniteKernal%grid-0] [21:04:18] : [Step 4/5] [21:04:18] : [Step 4/5] >>> +-------------------------------------------+ [21:04:18] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:04:18] : [Step 4/5] >>> +-------------------------------------------+ [21:04:18] : [Step 4/5] >>> OS name: Linux 4.15.0-151-generic amd64 [21:04:18] : [Step 4/5] >>> CPU(s): 24 [21:04:18] : [Step 4/5] >>> Heap: 2.0GB [21:04:18] : [Step 4/5] >>> VM name: 16724@c4dfe9a430b2 [21:04:18] : [Step 4/5] >>> Ignite instance name: grid-0 [21:04:18] : [Step 4/5] >>> Local node [ID=00370AE8-77EC-467F-A29B-93CB84238000, order=1, clientMode=false] [21:04:18] : [Step 4/5] >>> Local node addresses: [127.0.0.1] [21:04:18] : [Step 4/5] >>> Local ports: TCP:10800 TCP:45130 TCP:47500 [21:04:18] : [Step 4/5] [21:04:18] : [Step 4/5] [2021-11-19 21:04:18,481][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][IgniteKernal%grid-0] >>> Ignite cluster is in INACTIVE state (limited functionality available). Use control.(sh|bat) script or IgniteCluster.state(ClusterState.ACTIVE) to change the state. [21:04:18] : [Step 4/5] [2021-11-19 21:04:18,482][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][GridDiscoveryManager] Topology snapshot [ver=1, locNode=00370ae8, servers=1, clients=0, state=INACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=00370ae8-77ec-467f-a29b-93cb84238000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:04:18] : [Step 4/5] [2021-11-19 21:04:18,482][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][G] Node started : [stage="Configure system pool" (0 ms),stage="Start managers" (202 ms),stage="Configure binary metadata" (2 ms),stage="Start processors" (403 ms),stage="Start 'StanByClusterTestProvider' plugin" (0 ms),stage="Start 'PageMemory tracker plugin' plugin" (0 ms),stage="Start 'TestDistibutedConfigurationPlugin' plugin" (0 ms),stage="Start 'NodeValidationPluginProvider' plugin" (0 ms),stage="Init metastore" (22 ms),stage="Init and start regions" (5 ms),stage="Restore binary memory" (13 ms),stage="Restore logical state" (63 ms),stage="Finish recovery" (303 ms),stage="Join topology" (13 ms),stage="Await transition" (1 ms),stage="Await exchange" (15 ms),stage="Total time" (1042 ms)] [21:04:18] : [Step 4/5] [2021-11-19 21:04:18,484][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][root] Node started with the following configuration [id=00370ae8-77ec-467f-a29b-93cb84238000, marshaller=BinaryMarshaller [], discovery=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=5000, ackTimeout=5000, marsh=JdkMarshaller [clsFilter=org.apache.ignite.marshaller.MarshallerUtils$1@c3b77ef], reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], binaryCfg=null, lateAff=true] [21:04:18]W: [org.apache.ignite:ignite-core] [2021-11-19 21:04:18,489][WARN ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][G] Ignite work directory is not provided, automatically resolved to: /opt/buildagent/work/7bc1c54bc719b67c/work [21:04:18] : [Step 4/5] [2021-11-19 21:04:18,489][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][IgniteKernal%grid-1] [21:04:18] : [Step 4/5] [21:04:18] : [Step 4/5] >>> __________ ________________ [21:04:18] : [Step 4/5] >>> / _/ ___/ |/ / _/_ __/ __/ [21:04:18] : [Step 4/5] >>> _/ // (7 7 // / / / / _/ [21:04:18] : [Step 4/5] >>> /___/\___/_/|_/___/ /_/ /___/ [21:04:18] : [Step 4/5] >>> [21:04:18] : [Step 4/5] >>> ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:04:18] : [Step 4/5] >>> 2021 Copyright(C) Apache Software Foundation [21:04:18] : [Step 4/5] >>> [21:04:18] : [Step 4/5] >>> Ignite documentation: http://ignite.apache.org [21:04:18] : [Step 4/5] [21:04:18] : [Step 4/5] [2021-11-19 21:04:18,490][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][IgniteKernal%grid-1] Config URL: n/a [21:04:18] : [Step 4/5] [2021-11-19 21:04:18,490][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][IgniteKernal%grid-1] IgniteConfiguration [igniteInstanceName=grid-1, pubPoolSize=24, svcPoolSize=24, callbackPoolSize=24, stripedPoolSize=24, sysPoolSize=24, mgmtPoolSize=4, dataStreamerPoolSize=24, utilityCachePoolSize=24, utilityCacheKeepAliveTime=60000, p2pPoolSize=2, qryPoolSize=24, buildIdxPoolSize=4, igniteHome=/opt/buildagent/work/7bc1c54bc719b67c, igniteWorkDir=/opt/buildagent/work/7bc1c54bc719b67c/work, mbeanSrv=com.sun.jmx.mbeanserver.JmxMBeanServer@6fe85038, nodeId=101a7b49-c550-49f3-a11c-bda9ab704001, marsh=BinaryMarshaller [], marshLocJobs=false, daemon=false, p2pEnabled=true, netTimeout=10000, netCompressionLevel=1, sndRetryDelay=1000, sndRetryCnt=3, metricsHistSize=10000, metricsUpdateFreq=1000, metricsExpTime=9223372036854775807, discoSpi=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=0, ackTimeout=0, marsh=null, reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], segPlc=STOP, segResolveAttempts=2, waitForSegOnStart=true, allResolversPassReq=true, segChkFreq=10000, commSpi=TcpCommunicationSpi [connectGate=org.apache.ignite.spi.communication.tcp.internal.ConnectGateway@30ec794a, ctxInitLatch=java.util.concurrent.CountDownLatch@4090bc33[Count = 1], stopping=false, clientPool=null, nioSrvWrapper=null, stateProvider=null], evtSpi=MemoryEventStorageSpi [expireAgeMs=9223372036854775807, expireCnt=10000, filter=null], colSpi=NoopCollisionSpi [], deploySpi=LocalDeploymentSpi [], indexingSpi=org.apache.ignite.spi.indexing.noop.NoopIndexingSpi@6eda2080, addrRslvr=null, encryptionSpi=org.apache.ignite.spi.encryption.keystore.KeystoreEncryptionSpi@7b03356f, tracingSpi=org.apache.ignite.spi.tracing.NoopTracingSpi@583f9535, clientMode=false, rebalanceThreadPoolSize=4, rebalanceTimeout=10000, rebalanceBatchesPrefetchCnt=3, rebalanceThrottle=0, rebalanceBatchSize=524288, txCfg=TransactionConfiguration [txSerEnabled=false, dfltIsolation=REPEATABLE_READ, dfltConcurrency=PESSIMISTIC, dfltTxTimeout=0, txTimeoutOnPartitionMapExchange=0, deadlockTimeout=10000, pessimisticTxLogSize=0, pessimisticTxLogLinger=10000, tmLookupClsName=null, txManagerFactory=null, useJtaSync=false], cacheSanityCheckEnabled=true, discoStartupDelay=60000, deployMode=SHARED, p2pMissedCacheSize=100, locHost=127.0.0.1, timeSrvPortBase=31100, timeSrvPortRange=100, failureDetectionTimeout=10000, sysWorkerBlockedTimeout=null, clientFailureDetectionTimeout=10000, metricsLogFreq=0, connectorCfg=null, odbcCfg=null, warmupClos=null, atomicCfg=AtomicConfiguration [seqReserveSize=1000, cacheMode=PARTITIONED, backups=1, aff=null, grpName=null], classLdr=null, sslCtxFactory=null, platformCfg=null, binaryCfg=null, memCfg=null, pstCfg=null, dsCfg=DataStorageConfiguration [sysRegionInitSize=41943040, sysRegionMaxSize=104857600, pageSize=4096, concLvl=0, dfltDataRegConf=DataRegionConfiguration [name=default, maxSize=10485760, initSize=268435456, swapPath=null, pageEvictionMode=DISABLED, pageReplacementMode=CLOCK, evictionThreshold=0.9, emptyPagesPoolSize=100, metricsEnabled=false, metricsSubIntervalCount=5, metricsRateTimeInterval=60000, persistenceEnabled=true, checkpointPageBufSize=0, lazyMemoryAllocation=true, warmUpCfg=null], dataRegions=null, storagePath=null, checkpointFreq=180000, lockWaitTime=10000, checkpointThreads=4, checkpointWriteOrder=SEQUENTIAL, walHistSize=20, maxWalArchiveSize=1073741824, walSegments=10, walSegmentSize=67108864, walPath=db/wal, walArchivePath=db/wal/archive, cdcWalPath=db/wal/cdc, cdcEnabled=false, metricsEnabled=false, walMode=FSYNC, walTlbSize=131072, walBuffSize=0, walFlushFreq=2000, walFsyncDelay=1000, walRecordIterBuffSize=67108864, alwaysWriteFullPages=false, fileIOFactory=org.apache.ignite.internal.processors.cache.persistence.file.AsyncFileIOFactory@3e3d0c6e, metricsSubIntervalCnt=5, metricsRateTimeInterval=60000, walAutoArchiveAfterInactivity=-1, walForceArchiveTimeout=-1, writeThrottlingEnabled=false, walCompactionEnabled=false, walCompactionLevel=1, checkpointReadLockTimeout=null, walPageCompression=DISABLED, walPageCompressionLevel=null, dfltWarmUpCfg=null, encCfg=org.apache.ignite.configuration.EncryptionConfiguration@78b56e28, defragmentationThreadPoolSize=4, minWalArchiveSize=-1], snapshotPath=snapshots, activeOnStart=true, activeOnStartPropSetFlag=false, autoActivation=true, autoActivationPropSetFlag=false, clusterStateOnStart=null, sqlConnCfg=null, cliConnCfg=ClientConnectorConfiguration [host=null, port=10800, portRange=100, sockSndBufSize=0, sockRcvBufSize=0, tcpNoDelay=true, maxOpenCursorsPerConn=128, threadPoolSize=24, selectorCnt=12, idleTimeout=0, handshakeTimeout=10000, jdbcEnabled=true, odbcEnabled=true, thinCliEnabled=true, sslEnabled=false, useIgniteSslCtxFactory=true, sslClientAuth=false, sslCtxFactory=null, thinCliCfg=ThinClientConfiguration [maxActiveTxPerConn=100, maxActiveComputeTasksPerConn=0]], mvccVacuumThreadCnt=2, mvccVacuumFreq=5000, authEnabled=false, failureHnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]], commFailureRslvr=null, sqlCfg=SqlConfiguration [longQryWarnTimeout=3000, dfltQryTimeout=0, sqlQryHistSize=1000, validationEnabled=false], asyncContinuationExecutor=null] [21:04:18] : [Step 4/5] [2021-11-19 21:04:18,499][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][IgniteKernal%grid-1] Daemon mode: off [21:04:18] : [Step 4/5] [2021-11-19 21:04:18,499][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][IgniteKernal%grid-1] OS: Linux 4.15.0-151-generic amd64 [21:04:18] : [Step 4/5] [2021-11-19 21:04:18,499][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][IgniteKernal%grid-1] OS user: teamcity [21:04:18] : [Step 4/5] [2021-11-19 21:04:18,499][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][IgniteKernal%grid-1] PID: 16724 [21:04:18] : [Step 4/5] [2021-11-19 21:04:18,500][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][IgniteKernal%grid-1] Language runtime: Java Platform API Specification ver. 1.8 [21:04:18] : [Step 4/5] [2021-11-19 21:04:18,500][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][IgniteKernal%grid-1] VM information: Java(TM) SE Runtime Environment 1.8.0_261-b12 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 25.261-b12 [21:04:18] : [Step 4/5] [2021-11-19 21:04:18,500][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][IgniteKernal%grid-1] VM total memory: 1.9GB [21:04:18] : [Step 4/5] [2021-11-19 21:04:18,501][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][IgniteKernal%grid-1] Remote Management [restart: off, REST: off, JMX (remote: off)] [21:04:18] : [Step 4/5] [2021-11-19 21:04:18,501][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][IgniteKernal%grid-1] Logger: GridTestLog4jLogger [quiet=false, config=null] [21:04:18] : [Step 4/5] [2021-11-19 21:04:18,501][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][IgniteKernal%grid-1] IGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c [21:04:18] : [Step 4/5] [2021-11-19 21:04:18,501][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][IgniteKernal%grid-1] VM arguments: [-DIGNITE_DUMP_THREADS_ON_FAILURE=false, -DMono=/usr/bin/mono-sgen, -DMono4.0_x64=/usr/lib/mono/4.0, -DMono4.5_x64=/usr/lib/mono/4.5, -DMonoVersion=6.12.0.90, -DSKIP_BUILD=false, -Dagent.home.dir=/opt/buildagent, -Dagent.name=aitc-lin02_03, -Dagent.ownPort=9090, -Dagent.work.dir=/opt/buildagent/work, -Dbuild.number=95, -Dbuild.vcs.number=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.1=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.GitHubApacheIgnite=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dclassworlds.conf=/opt/buildagent/temp/buildTmp/teamcity.m2.conf, -Dcom.jetbrains.maven.watcher.report.file=/opt/buildagent/temp/buildTmp/maven-build-info.xml, -Djava.io.tmpdir=/opt/buildagent/temp/buildTmp, -Dmaven.home=/opt/buildagent/tools/maven3_6, -Dmaven.multiModuleProjectDirectory=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.agent.cpuBenchmark=457, -Dteamcity.agent.dotnet.agent_url=http://localhost:9090/RPC2, -Dteamcity.agent.dotnet.build_id=6278078, -Dteamcity.auth.password=*******, -Dteamcity.auth.userId=TeamCityBuildId=6278078, -Dteamcity.build.changedFiles.file=/opt/buildagent/temp/buildTmp/changedFiles6342607772318147725.txt, -Dteamcity.build.checkoutDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.build.id=6278078, -Dteamcity.build.properties.file=/opt/buildagent/temp/buildTmp/teamcity.build5164517880467851002.properties, -Dteamcity.build.tempDir=/opt/buildagent/temp/buildTmp, -Dteamcity.build.workingDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.buildConfName=Basic 3, -Dteamcity.buildType.id=IgniteTests24Java8_Basic3, -Dteamcity.configuration.properties.file=/opt/buildagent/temp/buildTmp/teamcity.config5591980786735343870.properties, -Dteamcity.maven.userSettings.path=/opt/buildagent/temp/buildTmp/maven_settings_585072866407032347.xml, -Dteamcity.maven.watcher.home=/opt/buildagent/plugins/mavenPlugin/maven-watcher-jdk16, -Dteamcity.projectName=Ignite Tests 2.x (JDK 8/11), -Dteamcity.runner.properties.file=/opt/buildagent/temp/buildTmp/teamcity.runner9098465561618137420.properties, -Dteamcity.tests.recentlyFailedTests.file=/opt/buildagent/temp/buildTmp/testsToRunFirst3891775683130404069.txt, -Dteamcity.version=2021.2 (build 99542), -ea, -Xms2g, -Xmx2g, -XX:+HeapDumpOnOutOfMemoryError, -DIGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_TEST_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_UPDATE_NOTIFIER=false, -DIGNITE_NO_DISCO_ORDER=true, -DIGNITE_PERFORMANCE_SUGGESTIONS_DISABLED=true, -Djava.net.preferIPv4Stack=true, -DTEST_SCALE_FACTOR=1.0, -DIGNITE_TEST_PROP_LOG4J_FILE=log4j-tc-test.xml, -DIGNITE_QUIET=false, -DIGNITE_MARSHAL_BUFFERS_RECHECK=1000, -Dmaven.repo.local=/opt/buildagent/.m2/repository] [21:04:18] : [Step 4/5] [2021-11-19 21:04:18,505][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][IgniteKernal%grid-1] System cache's DataRegion size is configured to 40 MB. Use DataStorageConfiguration.systemRegionInitialSize property to change the setting. [21:04:18] : [Step 4/5] [2021-11-19 21:04:18,505][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][IgniteKernal%grid-1] Configured caches [in 'sysMemPlc' dataRegion: ['ignite-sys-cache']] [21:04:18]W: [org.apache.ignite:ignite-core] [2021-11-19 21:04:18,505][WARN ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][IgniteKernal%grid-1] Peer class loading is enabled (disable it in production for performance and deployment consistency reasons) [21:04:18] : [Step 4/5] [2021-11-19 21:04:18,506][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][IgniteKernal%grid-1] 3-rd party licenses can be found at: /opt/buildagent/work/7bc1c54bc719b67c/libs/licenses [21:04:18] : [Step 4/5] [2021-11-19 21:04:18,509][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][IgnitePluginProcessor] Configured plugins: [21:04:18] : [Step 4/5] [2021-11-19 21:04:18,509][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][IgnitePluginProcessor] ^-- StanByClusterTestProvider 1.0 [21:04:18] : [Step 4/5] [2021-11-19 21:04:18,509][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][IgnitePluginProcessor] ^-- null [21:04:18] : [Step 4/5] [2021-11-19 21:04:18,509][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][IgnitePluginProcessor] [21:04:18] : [Step 4/5] [2021-11-19 21:04:18,510][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][IgnitePluginProcessor] ^-- PageMemory tracker plugin 1.0 [21:04:18] : [Step 4/5] [2021-11-19 21:04:18,510][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][IgnitePluginProcessor] ^-- null [21:04:18] : [Step 4/5] [2021-11-19 21:04:18,510][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][IgnitePluginProcessor] [21:04:18] : [Step 4/5] [2021-11-19 21:04:18,510][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][IgnitePluginProcessor] ^-- TestDistibutedConfigurationPlugin 1.0 [21:04:18] : [Step 4/5] [2021-11-19 21:04:18,510][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][IgnitePluginProcessor] ^-- null [21:04:18] : [Step 4/5] [2021-11-19 21:04:18,511][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][IgnitePluginProcessor] [21:04:18] : [Step 4/5] [2021-11-19 21:04:18,511][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][IgnitePluginProcessor] ^-- NodeValidationPluginProvider 1.0 [21:04:18] : [Step 4/5] [2021-11-19 21:04:18,511][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][IgnitePluginProcessor] ^-- null [21:04:18] : [Step 4/5] [2021-11-19 21:04:18,511][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][IgnitePluginProcessor] [21:04:18] : [Step 4/5] [2021-11-19 21:04:18,511][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][FailureProcessor] Configured failure handler: [hnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]]] [21:04:18]W: [org.apache.ignite:ignite-core] [2021-11-19 21:04:18,526][WARN ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][TcpCommunicationSpi] Message queue limit is set to 0 which may lead to potential OOMEs when running cache operations in FULL_ASYNC or PRIMARY_SYNC modes due to message queues growth on sender and receiver sides. [21:04:18] : [Step 4/5] [2021-11-19 21:04:18,526][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][TcpCommunicationSpi] Successfully bound communication NIO server to TCP port [port=45131, locHost=/127.0.0.1, selectorsCnt=12, selectorSpins=0, pairedConn=false] [21:04:18] : [Step 4/5] [2021-11-19 21:04:18,531][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][GridCollisionManager] Collision resolution is disabled (all jobs will be activated upon arrival). [21:04:18] : [Step 4/5] [2021-11-19 21:04:18,531][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][IgniteKernal%grid-1] Security status [authentication=off, sandbox=off, tls/ssl=off] [21:04:18] : [Step 4/5] [2021-11-19 21:04:18,587][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:04:18] : [Step 4/5] [2021-11-19 21:04:18,672][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][MaintenanceProcessor] Resolved store directory for node persistent data: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1 [21:04:18] : [Step 4/5] [2021-11-19 21:04:18,674][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][CacheObjectBinaryProcessorImpl] Resolved directory for serialized binary metadata: /opt/buildagent/work/7bc1c54bc719b67c/work/db/binary_meta/grid_1 [21:04:18] : [Step 4/5] [2021-11-19 21:04:18,678][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1 [21:04:18] : [Step 4/5] [2021-11-19 21:04:18,678][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][FileWriteAheadLogManager] Resolved write ahead log work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1 [21:04:18] : [Step 4/5] [2021-11-19 21:04:18,679][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][FileWriteAheadLogManager] Resolved write ahead log archive directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1 [21:04:19] : [Step 4/5] [2021-11-19 21:04:19,033][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000000.wal [21:04:19] : [Step 4/5] [2021-11-19 21:04:19,039][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][GridCacheDatabaseSharedManager] Configured data regions initialized successfully [total=5] [21:04:19] : [Step 4/5] [2021-11-19 21:04:19,041][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][IgniteSnapshotManager] Resolved snapshot work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/snapshots [21:04:19] : [Step 4/5] [2021-11-19 21:04:19,042][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][IgniteSnapshotManager] Resolved temp directory for snapshot creation: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1/snp [21:04:19] : [Step 4/5] [2021-11-19 21:04:19,044][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][ClientListenerProcessor] Client connector processor has started on TCP port 10801 [21:04:19] : [Step 4/5] [2021-11-19 21:04:19,046][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][IgniteKernal%grid-1] Non-loopback local IPs: 172.17.0.4 [21:04:19] : [Step 4/5] [2021-11-19 21:04:19,047][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][IgniteKernal%grid-1] Enabled local MACs: 0242AC110004 [21:04:19] : [Step 4/5] [2021-11-19 21:04:19,047][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:04:19] : [Step 4/5] [2021-11-19 21:04:19,048][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:04:19] : [Step 4/5] [2021-11-19 21:04:19,048][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:04:19] : [Step 4/5] [2021-11-19 21:04:19,050][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][GridCacheDatabaseSharedManager] Applying lost metastore updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:04:19] : [Step 4/5] [2021-11-19 21:04:19,051][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=10 ms] [21:04:19] : [Step 4/5] [2021-11-19 21:04:19,051][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][GridCacheProcessor] Restoring partition state for local groups. [21:04:19] : [Step 4/5] [2021-11-19 21:04:19,051][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=0, partitionsProcessed=0, time=0ms] [21:04:19] : [Step 4/5] [2021-11-19 21:04:19,052][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][GridEncryptionManager] Encryption keys loaded from metastore. [grps=, masterKeyName=ignite.master.key] [21:04:19] : [Step 4/5] [2021-11-19 21:04:19,053][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][ClusterProcessor] Cluster ID and tag has been read from metastorage: null [21:04:19] : [Step 4/5] [2021-11-19 21:04:19,053][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][IgniteClusterImpl] Shutdown policy was updated [oldVal=null, newVal=null] [21:04:19] : [Step 4/5] [2021-11-19 21:04:19,054][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][GridCacheDatabaseSharedManager] Checkpoint frequency deviation changed [oldVal=null, newVal=null] [21:04:19] : [Step 4/5] [2021-11-19 21:04:19,063][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][FilePageStoreManager] Cleanup cache stores [total=1, left=0, cleanFiles=false] [21:04:19] : [Step 4/5] [2021-11-19 21:04:19,065][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:04:19] : [Step 4/5] [2021-11-19 21:04:19,065][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:04:19] : [Step 4/5] [2021-11-19 21:04:19,066][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:04:19] : [Step 4/5] [2021-11-19 21:04:19,067][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][GridCacheDatabaseSharedManager] Data Regions Started: 5 [21:04:19] : [Step 4/5] [2021-11-19 21:04:19,067][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][GridCacheDatabaseSharedManager] ^-- sysMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:04:19] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:04:19] : [Step 4/5] ^-- default region [type=default, persistence=true, lazyAlloc=true, [21:04:19] : [Step 4/5] ... initCfg=10MB, maxCfg=10MB, usedRam=0MB, freeRam=100%, allocRam=0MB, allocTotal=0MB] [21:04:19] : [Step 4/5] ^-- metastoreMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:04:19] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:04:19] : [Step 4/5] ^-- TxLog region [type=internal, persistence=true, lazyAlloc=false, [21:04:19] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:04:19] : [Step 4/5] ^-- volatileDsMemPlc region [type=user, persistence=false, lazyAlloc=true, [21:04:19] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB] [21:04:19] : [Step 4/5] ^-- Ignite persistence [used=0MB] [21:04:19] : [Step 4/5] [21:04:19] : [Step 4/5] [2021-11-19 21:04:19,068][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][GridCacheDatabaseSharedManager] Starting binary memory restore for: [-2100569601] [21:04:19] : [Step 4/5] [2021-11-19 21:04:19,074][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:04:19] : [Step 4/5] [2021-11-19 21:04:19,075][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:04:19] : [Step 4/5] [2021-11-19 21:04:19,076][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000000.wal, offset=0, ver=2] [21:04:19] : [Step 4/5] [2021-11-19 21:04:19,080][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][GridCacheProcessor] Started cache in recovery mode [name=ignite-sys-cache, id=-2100569601, dataRegionName=sysMemPlc, mode=REPLICATED, atomicity=TRANSACTIONAL, backups=2147483647, mvcc=false] [21:04:19] : [Step 4/5] [2021-11-19 21:04:19,081][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][GridCacheDatabaseSharedManager] Binary recovery performed in 13 ms. [21:04:19] : [Step 4/5] [2021-11-19 21:04:19,081][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:04:19] : [Step 4/5] [2021-11-19 21:04:19,081][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][GridCacheDatabaseSharedManager] Applying lost cache updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:04:19] : [Step 4/5] [2021-11-19 21:04:19,152][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=71 ms] [21:04:19] : [Step 4/5] [2021-11-19 21:04:19,152][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][GridCacheProcessor] Restoring partition state for local groups. [21:04:19] : [Step 4/5] [2021-11-19 21:04:19,158][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=1, partitionsProcessed=100, time=0ms] [21:04:19] : [Step 4/5] [2021-11-19 21:04:19,459][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][TestTcpDiscoverySpi] Successfully bound to TCP port [port=47501, localHost=localhost/127.0.0.1, locNodeId=101a7b49-c550-49f3-a11c-bda9ab704001] [21:04:19] : [Step 4/5] [2021-11-19 21:04:19,462][INFO ][tcp-disco-srvr-[:47500]-#377%grid-0%-#7541%grid-0%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=51661] [21:04:19] : [Step 4/5] [2021-11-19 21:04:19,463][INFO ][tcp-disco-srvr-[:47500]-#377%grid-0%-#7541%grid-0%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=51661] [21:04:19] : [Step 4/5] [2021-11-19 21:04:19,463][INFO ][tcp-disco-sock-reader-[]-#383%grid-0%-#7660%grid-0%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:51661, rmtPort=51661] [21:04:19] : [Step 4/5] [2021-11-19 21:04:19,465][INFO ][tcp-disco-sock-reader-[101a7b49 127.0.0.1:51661]-#383%grid-0%-#7660%grid-0%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=101a7b49-c550-49f3-a11c-bda9ab704001, rmtAddr=/127.0.0.1:51661] [21:04:19] : [Step 4/5] [2021-11-19 21:04:19,470][INFO ][tcp-disco-srvr-[:47501]-#382%grid-1%-#7659%grid-1%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=51999] [21:04:19] : [Step 4/5] [2021-11-19 21:04:19,470][INFO ][tcp-disco-srvr-[:47501]-#382%grid-1%-#7659%grid-1%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=51999] [21:04:19] : [Step 4/5] [2021-11-19 21:04:19,471][INFO ][tcp-disco-sock-reader-[]-#384%grid-1%-#7661%grid-1%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:51999, rmtPort=51999] [21:04:19] : [Step 4/5] [2021-11-19 21:04:19,471][INFO ][tcp-disco-sock-reader-[]-#384%grid-1%-#7661%grid-1%][TestTcpDiscoverySpi] Received ping request from the remote node [rmtNodeId=00370ae8-77ec-467f-a29b-93cb84238000, rmtAddr=/127.0.0.1:51999, rmtPort=51999] [21:04:19] : [Step 4/5] [2021-11-19 21:04:19,472][INFO ][tcp-disco-sock-reader-[]-#384%grid-1%-#7661%grid-1%][TestTcpDiscoverySpi] Finished writing ping response [rmtNodeId=00370ae8-77ec-467f-a29b-93cb84238000, rmtAddr=/127.0.0.1:51999, rmtPort=51999] [21:04:19]W: [org.apache.ignite:ignite-core] [2021-11-19 21:04:19,473][WARN ][tcp-disco-sock-reader-[]-#384%grid-1%-#7661%grid-1%][TestTcpDiscoverySpi] Failed to shutdown socket [21:04:19]W: [org.apache.ignite:ignite-core] java.net.SocketException: Socket output is already shutdown [21:04:19]W: [org.apache.ignite:ignite-core] at java.net.Socket.shutdownOutput(Socket.java:1572) [21:04:19]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.close(IgniteUtils.java:4247) [21:04:19]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.discovery.tcp.ServerImpl$SocketReader.body(ServerImpl.java:7370) [21:04:19]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.IgniteSpiThread.run(IgniteSpiThread.java:58) [21:04:19] : [Step 4/5] [2021-11-19 21:04:19,473][INFO ][tcp-disco-sock-reader-[101a7b49 127.0.0.1:51661]-#383%grid-0%-#7660%grid-0%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:51661, rmtPort=51661, rmtNodeId=101a7b49-c550-49f3-a11c-bda9ab704001] [21:04:19] : [Step 4/5] [2021-11-19 21:04:19,474][INFO ][tcp-disco-sock-reader-[]-#384%grid-1%-#7661%grid-1%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:51999, rmtPort=51999, rmtNodeId=null] [21:04:19] : [Step 4/5] [2021-11-19 21:04:19,476][INFO ][tcp-disco-msg-worker-[crd]-#376%grid-0%-#7540%grid-0%][GridEncryptionManager] Joining node doesn't have stored group keys [node=101a7b49-c550-49f3-a11c-bda9ab704001] [21:04:19] : [Step 4/5] [2021-11-19 21:04:19,484][INFO ][tcp-disco-msg-worker-[crd]-#376%grid-0%-#7540%grid-0%][TestTcpDiscoverySpi] New next node [newNext=TcpDiscoveryNode [id=101a7b49-c550-49f3-a11c-bda9ab704001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=0, intOrder=2, lastExchangeTime=1637345059465, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false]] [21:04:19] : [Step 4/5] [2021-11-19 21:04:19,485][INFO ][tcp-disco-srvr-[:47501]-#382%grid-1%-#7659%grid-1%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=35653] [21:04:19] : [Step 4/5] [2021-11-19 21:04:19,486][INFO ][tcp-disco-srvr-[:47501]-#382%grid-1%-#7659%grid-1%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=35653] [21:04:19] : [Step 4/5] [2021-11-19 21:04:19,486][INFO ][tcp-disco-sock-reader-[]-#385%grid-1%-#7662%grid-1%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:35653, rmtPort=35653] [21:04:19] : [Step 4/5] [2021-11-19 21:04:19,487][INFO ][tcp-disco-sock-reader-[00370ae8 127.0.0.1:35653]-#385%grid-1%-#7662%grid-1%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=00370ae8-77ec-467f-a29b-93cb84238000, rmtAddr=/127.0.0.1:35653] [21:04:19] : [Step 4/5] [2021-11-19 21:04:19,491][INFO ][tcp-disco-msg-worker-[]-#381%grid-1%-#7658%grid-1%][TestTcpDiscoverySpi] New next node [newNext=TcpDiscoveryNode [id=00370ae8-77ec-467f-a29b-93cb84238000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345059485, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false]] [21:04:19] : [Step 4/5] [2021-11-19 21:04:19,492][INFO ][tcp-disco-srvr-[:47500]-#377%grid-0%-#7541%grid-0%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=47149] [21:04:19] : [Step 4/5] [2021-11-19 21:04:19,492][INFO ][tcp-disco-srvr-[:47500]-#377%grid-0%-#7541%grid-0%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=47149] [21:04:19] : [Step 4/5] [2021-11-19 21:04:19,492][INFO ][tcp-disco-sock-reader-[]-#386%grid-0%-#7663%grid-0%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:47149, rmtPort=47149] [21:04:19] : [Step 4/5] [2021-11-19 21:04:19,493][INFO ][tcp-disco-sock-reader-[101a7b49 127.0.0.1:47149]-#386%grid-0%-#7663%grid-0%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=101a7b49-c550-49f3-a11c-bda9ab704001, rmtAddr=/127.0.0.1:47149] [21:04:19] : [Step 4/5] [2021-11-19 21:04:19,495][INFO ][disco-event-worker-#7543%grid-0%][GridDiscoveryManager] Added new node to topology: TcpDiscoveryNode [id=101a7b49-c550-49f3-a11c-bda9ab704001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637345059465, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false] [21:04:19] : [Step 4/5] [2021-11-19 21:04:19,496][INFO ][disco-event-worker-#7543%grid-0%][GridDiscoveryManager] Topology snapshot [ver=2, locNode=00370ae8, servers=2, clients=0, state=INACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=00370ae8-77ec-467f-a29b-93cb84238000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=101a7b49-c550-49f3-a11c-bda9ab704001, consistentId=grid-1, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:04:19] : [Step 4/5] [2021-11-19 21:04:19,498][INFO ][tcp-disco-msg-worker-[00370ae8 127.0.0.1:47500]-#381%grid-1%-#7658%grid-1%][ClusterProcessor] dazzling_burnell [21:04:19] : [Step 4/5] [2021-11-19 21:04:19,499][INFO ][tcp-disco-msg-worker-[00370ae8 127.0.0.1:47500]-#381%grid-1%-#7658%grid-1%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustEnabled' was changed from 'null' to 'false' [21:04:19] : [Step 4/5] [2021-11-19 21:04:19,499][INFO ][tcp-disco-msg-worker-[00370ae8 127.0.0.1:47500]-#381%grid-1%-#7658%grid-1%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustTimeout' was changed from 'null' to '300000' [21:04:19] : [Step 4/5] [2021-11-19 21:04:19,499][INFO ][tcp-disco-msg-worker-[00370ae8 127.0.0.1:47500]-#381%grid-1%-#7658%grid-1%][IgniteTxManager] Transactions parameter 'longOperationsDumpTimeout' was changed from 'null' to '60000' [21:04:19] : [Step 4/5] [2021-11-19 21:04:19,500][INFO ][tcp-disco-msg-worker-[00370ae8 127.0.0.1:47500]-#381%grid-1%-#7658%grid-1%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpThreshold' was changed from 'null' to '0' [21:04:19] : [Step 4/5] [2021-11-19 21:04:19,500][INFO ][tcp-disco-msg-worker-[00370ae8 127.0.0.1:47500]-#381%grid-1%-#7658%grid-1%][IgniteTxManager] Transactions parameter 'transactionTimeDumpSamplesCoefficient' was changed from 'null' to '0.0' [21:04:19] : [Step 4/5] [2021-11-19 21:04:19,500][INFO ][tcp-disco-msg-worker-[00370ae8 127.0.0.1:47500]-#381%grid-1%-#7658%grid-1%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpSamplesPerSecondLimit' was changed from 'null' to '5' [21:04:19] : [Step 4/5] [2021-11-19 21:04:19,501][INFO ][tcp-disco-msg-worker-[00370ae8 127.0.0.1:47500]-#381%grid-1%-#7658%grid-1%][IgniteTxManager] Transactions parameter 'collisionsDumpInterval' was changed from 'null' to '1000' [21:04:19] : [Step 4/5] [2021-11-19 21:04:19,501][INFO ][tcp-disco-msg-worker-[00370ae8 127.0.0.1:47500]-#381%grid-1%-#7658%grid-1%][IgniteTxManager] Transactions parameter 'txOwnerDumpRequestsAllowed' was changed from 'null' to 'true' [21:04:19] : [Step 4/5] [2021-11-19 21:04:19,501][INFO ][tcp-disco-msg-worker-[00370ae8 127.0.0.1:47500]-#381%grid-1%-#7658%grid-1%][GridCacheDatabaseSharedManager] Historical rebalance WAL threshold changed [property=historical.rebalance.threshold, oldVal=null, newVal=500] [21:04:19] : [Step 4/5] [2021-11-19 21:04:19,502][INFO ][disco-notifier-worker-#7657%grid-1%][MvccProcessorImpl] Assigned mvcc coordinator [crd=MvccCoordinator [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=0], nodeId=00370ae8-77ec-467f-a29b-93cb84238000, ver=1637345058456, local=false, initialized=false]] [21:04:19] : [Step 4/5] [2021-11-19 21:04:19,503][INFO ][sys-#7642%grid-1%][ClusterProcessor] Writing cluster ID and tag to metastorage on ready for write ClusterIdAndTag [id=ee6fb329-7b0a-43cc-8e0d-0768a6b4d7c6, tag=dazzling_burnell] [21:04:19] : [Step 4/5] [2021-11-19 21:04:19,515][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][IgniteKernal%grid-1] To start Console Management & Monitoring run ignitevisorcmd.{sh|bat} [21:04:19] : [Step 4/5] [2021-11-19 21:04:19,516][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][IgniteKernal%grid-1] [21:04:19] : [Step 4/5] [21:04:19] : [Step 4/5] >>> +-------------------------------------------+ [21:04:19] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:04:19] : [Step 4/5] >>> +-------------------------------------------+ [21:04:19] : [Step 4/5] >>> OS name: Linux 4.15.0-151-generic amd64 [21:04:19] : [Step 4/5] >>> CPU(s): 24 [21:04:19] : [Step 4/5] >>> Heap: 2.0GB [21:04:19] : [Step 4/5] >>> VM name: 16724@c4dfe9a430b2 [21:04:19] : [Step 4/5] >>> Ignite instance name: grid-1 [21:04:19] : [Step 4/5] >>> Local node [ID=101A7B49-C550-49F3-A11C-BDA9AB704001, order=2, clientMode=false] [21:04:19] : [Step 4/5] >>> Local node addresses: [127.0.0.1] [21:04:19] : [Step 4/5] >>> Local ports: TCP:10801 TCP:45131 TCP:47501 [21:04:19] : [Step 4/5] [21:04:19] : [Step 4/5] [2021-11-19 21:04:19,517][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][IgniteKernal%grid-1] >>> Ignite cluster is in INACTIVE state (limited functionality available). Use control.(sh|bat) script or IgniteCluster.state(ClusterState.ACTIVE) to change the state. [21:04:19] : [Step 4/5] [2021-11-19 21:04:19,517][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][GridDiscoveryManager] Topology snapshot [ver=2, locNode=101a7b49, servers=2, clients=0, state=INACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=00370ae8-77ec-467f-a29b-93cb84238000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=101a7b49-c550-49f3-a11c-bda9ab704001, consistentId=grid-1, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:04:19] : [Step 4/5] [2021-11-19 21:04:19,518][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][G] Node started : [stage="Configure system pool" (0 ms),stage="Start managers" (184 ms),stage="Configure binary metadata" (2 ms),stage="Start processors" (370 ms),stage="Start 'StanByClusterTestProvider' plugin" (0 ms),stage="Start 'PageMemory tracker plugin' plugin" (0 ms),stage="Start 'TestDistibutedConfigurationPlugin' plugin" (0 ms),stage="Start 'NodeValidationPluginProvider' plugin" (0 ms),stage="Init metastore" (17 ms),stage="Init and start regions" (4 ms),stage="Restore binary memory" (12 ms),stage="Restore logical state" (77 ms),stage="Finish recovery" (299 ms),stage="Join topology" (44 ms),stage="Await transition" (2 ms),stage="Await exchange" (12 ms),stage="Total time" (1023 ms)] [21:04:19] : [Step 4/5] [2021-11-19 21:04:19,519][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][root] Node started with the following configuration [id=101a7b49-c550-49f3-a11c-bda9ab704001, marshaller=BinaryMarshaller [], discovery=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=5000, ackTimeout=5000, marsh=JdkMarshaller [clsFilter=org.apache.ignite.marshaller.MarshallerUtils$1@16708450], reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], binaryCfg=null, lateAff=true] [21:04:19] : [Step 4/5] [2021-11-19 21:04:19,520][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][GridClusterStateProcessor] Sending activate cluster request with BaselineTopology BaselineTopology [id=0, branchingHash=-2475315501, branchingType='New BaselineTopology', baselineNodes=[grid-1, grid-0]] [21:04:19] : [Step 4/5] [2021-11-19 21:04:19,525][INFO ][disco-notifier-worker-#7539%grid-0%][GridClusterStateProcessor] Received activate cluster request with BaselineTopology[id=0] initiator node ID: 00370ae8-77ec-467f-a29b-93cb84238000 [21:04:19] : [Step 4/5] [2021-11-19 21:04:19,525][INFO ][disco-notifier-worker-#7539%grid-0%][GridClusterStateProcessor] Started state transition: activate cluster [21:04:19] : [Step 4/5] [2021-11-19 21:04:19,526][INFO ][exchange-worker-#7544%grid-0%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], crd=true, evt=DISCOVERY_CUSTOM_EVT, evtNode=00370ae8-77ec-467f-a29b-93cb84238000, customEvt=ChangeGlobalStateMessage [id=eaf1d593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqId=7d020e7d-7387-4c6d-9767-5b9d4161d522, initiatingNodeId=00370ae8-77ec-467f-a29b-93cb84238000, state=ACTIVE, baselineTopology=BaselineTopology [id=0, branchingHash=-2475315501, branchingType='New BaselineTopology', baselineNodes=[grid-1, grid-0]], forceChangeBaselineTopology=false, timestamp=1637345059520, forceDeactivation=true], allowMerge=false, exchangeFreeSwitch=false] [21:04:19] : [Step 4/5] [2021-11-19 21:04:19,526][INFO ][disco-notifier-worker-#7657%grid-1%][GridClusterStateProcessor] Received activate cluster request with BaselineTopology[id=0] initiator node ID: 00370ae8-77ec-467f-a29b-93cb84238000 [21:04:19] : [Step 4/5] [2021-11-19 21:04:19,527][INFO ][exchange-worker-#7544%grid-0%][GridDhtPartitionsExchangeFuture] Start activation process [nodeId=00370ae8-77ec-467f-a29b-93cb84238000, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]]. New state: ACTIVE [21:04:19] : [Step 4/5] [2021-11-19 21:04:19,527][INFO ][disco-notifier-worker-#7657%grid-1%][GridClusterStateProcessor] Started state transition: activate cluster [21:04:19] : [Step 4/5] [2021-11-19 21:04:19,528][INFO ][exchange-worker-#7544%grid-0%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0 [21:04:19] : [Step 4/5] [2021-11-19 21:04:19,528][INFO ][exchange-worker-#7666%grid-1%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], crd=false, evt=DISCOVERY_CUSTOM_EVT, evtNode=00370ae8-77ec-467f-a29b-93cb84238000, customEvt=ChangeGlobalStateMessage [id=eaf1d593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqId=7d020e7d-7387-4c6d-9767-5b9d4161d522, initiatingNodeId=00370ae8-77ec-467f-a29b-93cb84238000, state=ACTIVE, baselineTopology=BaselineTopology [id=0, branchingHash=-2475315501, branchingType='New BaselineTopology', baselineNodes=[grid-1, grid-0]], forceChangeBaselineTopology=false, timestamp=1637345059520, forceDeactivation=true], allowMerge=false, exchangeFreeSwitch=false] [21:04:19] : [Step 4/5] [2021-11-19 21:04:19,531][INFO ][exchange-worker-#7544%grid-0%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000000.wal, offset=8713, ver=2] [21:04:19] : [Step 4/5] [2021-11-19 21:04:19,531][INFO ][exchange-worker-#7666%grid-1%][GridDhtPartitionsExchangeFuture] Start activation process [nodeId=101a7b49-c550-49f3-a11c-bda9ab704001, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]]. New state: ACTIVE [21:04:19] : [Step 4/5] [2021-11-19 21:04:19,532][INFO ][exchange-worker-#7666%grid-1%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1 [21:04:19] : [Step 4/5] [2021-11-19 21:04:19,532][INFO ][exchange-worker-#7544%grid-0%][GridClusterStateProcessor] Writing BaselineTopology[id=0] [21:04:19] : [Step 4/5] [2021-11-19 21:04:19,537][INFO ][exchange-worker-#7666%grid-1%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000000.wal, offset=8713, ver=2] [21:04:19] : [Step 4/5] [2021-11-19 21:04:19,539][INFO ][exchange-worker-#7666%grid-1%][GridClusterStateProcessor] Writing BaselineTopology[id=0] [21:04:19] : [Step 4/5] [2021-11-19 21:04:19,541][INFO ][exchange-worker-#7544%grid-0%][GridCacheDatabaseSharedManager] Finish recovery performed in 12 ms. [21:04:19] : [Step 4/5] [2021-11-19 21:04:19,542][INFO ][exchange-worker-#7544%grid-0%][msg] Components activation performed in 14 ms. [21:04:19] : [Step 4/5] [2021-11-19 21:04:19,543][INFO ][exchange-worker-#7544%grid-0%][GridCacheProcessor] Finished recovery for cache [cache=ignite-sys-cache, grp=ignite-sys-cache, startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:04:19] : [Step 4/5] [2021-11-19 21:04:19,543][INFO ][exchange-worker-#7666%grid-1%][GridCacheDatabaseSharedManager] Finish recovery performed in 10 ms. [21:04:19] : [Step 4/5] [2021-11-19 21:04:19,545][INFO ][exchange-worker-#7666%grid-1%][msg] Components activation performed in 13 ms. [21:04:19] : [Step 4/5] [2021-11-19 21:04:19,546][INFO ][exchange-worker-#7666%grid-1%][GridCacheProcessor] Finished recovery for cache [cache=ignite-sys-cache, grp=ignite-sys-cache, startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:04:19] : [Step 4/5] [2021-11-19 21:04:19,546][INFO ][exchange-worker-#7666%grid-1%][GridDhtPartitionsExchangeFuture] Successfully activated caches [nodeId=101a7b49-c550-49f3-a11c-bda9ab704001, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], newState=ACTIVE] [21:04:19] : [Step 4/5] [2021-11-19 21:04:19,547][INFO ][exchange-worker-#7666%grid-1%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:04:19] : [Step 4/5] [2021-11-19 21:04:19,545][INFO ][exchange-worker-#7544%grid-0%][GridDhtPartitionsExchangeFuture] Successfully activated caches [nodeId=00370ae8-77ec-467f-a29b-93cb84238000, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], newState=ACTIVE] [21:04:19] : [Step 4/5] [2021-11-19 21:04:19,553][INFO ][exchange-worker-#7544%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:04:19] : [Step 4/5] [2021-11-19 21:04:19,568][INFO ][exchange-worker-#7544%grid-0%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], crd=true] [21:04:19] : [Step 4/5] [2021-11-19 21:04:19,571][INFO ][grid-nio-worker-tcp-comm-0-#7483%TcpCommunicationSpi%][TcpCommunicationSpi] Accepted incoming communication connection [locAddr=/127.0.0.1:45130, rmtAddr=/127.0.0.1:35210] [21:04:19] : [Step 4/5] [2021-11-19 21:04:19,572][INFO ][db-checkpoint-thread-#7677%grid-1%][Checkpointer] Checkpoint started [checkpointId=0bfac4b9-4b58-4f73-8414-8c34b9abfc09, startPtr=WALPointer [idx=0, fileOff=86349, len=1963], checkpointBeforeLockTime=2ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=2ms, writeCheckpointEntryDuration=2ms, splitAndSortCpPagesDuration=0ms, pages=18, reason='node started'] [21:04:19] : [Step 4/5] [2021-11-19 21:04:19,574][INFO ][grid-nio-worker-tcp-comm-0-#7601%TcpCommunicationSpi%][TcpCommunicationSpi] Established outgoing communication connection [locAddr=/127.0.0.1:35210, rmtAddr=/127.0.0.1:45130] [21:04:19] : [Step 4/5] [2021-11-19 21:04:19,574][INFO ][exchange-worker-#7666%grid-1%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], crd=false] [21:04:19] : [Step 4/5] [2021-11-19 21:04:19,577][INFO ][sys-#7532%grid-0%][GridDhtPartitionsExchangeFuture] Coordinator received single message [ver=AffinityTopologyVersion [topVer=2, minorTopVer=1], node=101a7b49-c550-49f3-a11c-bda9ab704001, allReceived=true] [21:04:19] : [Step 4/5] [2021-11-19 21:04:19,578][INFO ][sys-#7532%grid-0%][GridDhtPartitionsExchangeFuture] finishExchangeOnCoordinator [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:04:19] : [Step 4/5] [2021-11-19 21:04:19,580][INFO ][db-checkpoint-thread-#7675%grid-0%][Checkpointer] Checkpoint started [checkpointId=1b7d1441-0997-4326-9ff4-0c431016a2d6, startPtr=WALPointer [idx=0, fileOff=86349, len=1963], checkpointBeforeLockTime=8ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=2ms, writeCheckpointEntryDuration=10ms, splitAndSortCpPagesDuration=0ms, pages=18, reason='node started'] [21:04:19] : [Step 4/5] [2021-11-19 21:04:19,600][INFO ][sys-#7532%grid-0%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], err=null, rebalanced=true, wasRebalanced=false] [21:04:19] : [Step 4/5] [2021-11-19 21:04:19,600][INFO ][disco-notifier-worker-#7539%grid-0%][GridClusterStateProcessor] Received state change finish message: ACTIVE [21:04:19] : [Step 4/5] [2021-11-19 21:04:19,601][INFO ][disco-notifier-worker-#7657%grid-1%][GridClusterStateProcessor] Received state change finish message: ACTIVE [21:04:19] : [Step 4/5] [2021-11-19 21:04:19,603][INFO ][disco-notifier-worker-#7657%grid-1%][GridClusterStateProcessor] Cluster state was changed from INACTIVE to ACTIVE [21:04:19] : [Step 4/5] [2021-11-19 21:04:19,601][INFO ][sys-#7646%grid-1%][GridDhtPartitionsExchangeFuture] Received full message, will finish exchange [node=00370ae8-77ec-467f-a29b-93cb84238000, resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:04:19] : [Step 4/5] [2021-11-19 21:04:19,605][INFO ][sys-#7635%grid-1%][GridCachePartitionExchangeManager] Delay process full message without exchange id (there is exchange in progress) [nodeId=00370ae8-77ec-467f-a29b-93cb84238000] [21:04:19] : [Step 4/5] [2021-11-19 21:04:19,604][INFO ][sys-#7532%grid-0%][GridCacheProcessor] Finish proxy initialization, cacheName=ignite-sys-cache, localNodeId=00370ae8-77ec-467f-a29b-93cb84238000 [21:04:19] : [Step 4/5] [2021-11-19 21:04:19,603][INFO ][disco-notifier-worker-#7539%grid-0%][GridClusterStateProcessor] Cluster state was changed from INACTIVE to ACTIVE [21:04:19] : [Step 4/5] [2021-11-19 21:04:19,606][INFO ][sys-#7525%grid-0%][DistributedBaselineConfiguration] Baseline auto-adjust is 'disabled' with timeout='300000' ms [21:04:19] : [Step 4/5] [2021-11-19 21:04:19,605][INFO ][sys-#7646%grid-1%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], err=null, rebalanced=true, wasRebalanced=false] [21:04:19] : [Step 4/5] [2021-11-19 21:04:19,606][INFO ][sys-#7525%grid-0%][GridClusterStateProcessor] Successfully performed final activation steps [nodeId=00370ae8-77ec-467f-a29b-93cb84238000, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:04:19] : [Step 4/5] [2021-11-19 21:04:19,606][INFO ][sys-#7532%grid-0%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=00370ae8-77ec-467f-a29b-93cb84238000, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=00370ae8-77ec-467f-a29b-93cb84238000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345059602, loc=true, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:04:19] : [Step 4/5] [2021-11-19 21:04:19,606][INFO ][exchange-worker-#7544%grid-0%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=2, minorTopVer=1], force=false, evt=DISCOVERY_CUSTOM_EVT, node=00370ae8-77ec-467f-a29b-93cb84238000] [21:04:19] : [Step 4/5] [2021-11-19 21:04:19,611][INFO ][sys-#7532%grid-0%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (1 ms), stage="Update caches registry" (15 ms), stage="Start caches" (0 ms), stage="Affinity initialization on cache group start" (1 ms), stage="Determine exchange type" (7 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Restore partition states" (0 ms), stage="After states restored callback" (15 ms), stage="WAL history reservation" (0 ms), stage="Waiting for all single messages" (9 ms), stage="Affinity recalculation (crd)" (0 ms), stage="Collect update counters and create affinity messages" (0 ms), stage="Assign partitions states" (1 ms), stage="Validate partitions states" (0 ms), stage="Ideal affinity diff calculation (enforced)" (0 ms), stage="Apply update counters" (0 ms), stage="Full message preparing" (17 ms), stage="Full message sending" (0 ms), stage="State finish message sending" (1 ms), stage="Detect lost partitions" (3 ms), stage="Exchange done" (7 ms), stage="Total time" (77 ms), Discovery lag=3 ms, Latest started node id=101a7b49-c550-49f3-a11c-bda9ab704001] [21:04:19] : [Step 4/5] [2021-11-19 21:04:19,611][INFO ][db-checkpoint-thread-#7677%grid-1%][Checkpointer] Checkpoint finished [cpId=0bfac4b9-4b58-4f73-8414-8c34b9abfc09, pages=18, markPos=WALPointer [idx=0, fileOff=86349, len=1963], walSegmentsCovered=[], markDuration=5ms, pagesWrite=19ms, fsync=19ms, total=45ms] [21:04:19] : [Step 4/5] [2021-11-19 21:04:19,610][INFO ][sys-#7646%grid-1%][GridCacheProcessor] Finish proxy initialization, cacheName=ignite-sys-cache, localNodeId=101a7b49-c550-49f3-a11c-bda9ab704001 [21:04:19] : [Step 4/5] [2021-11-19 21:04:19,614][INFO ][sys-#7532%grid-0%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], stage="Affinity initialization on cache group start [grp=ignite-sys-cache]" (1 ms) (parent=Affinity initialization on cache group start), stage="Affinity centralized initialization (crd) [grp=ignite-sys-cache, crd=true]" (7 ms) (parent=Determine exchange type), stage="Restore partition states [grp=ignite-sys-cache]" (0 ms) (parent=Restore partition states), stage="Affinity recalculation (partitions availability) [grp=ignite-sys-cache]" (0 ms) (parent=Ideal affinity diff calculation (enforced))] [21:04:19] : [Step 4/5] [2021-11-19 21:04:19,619][INFO ][sys-#7646%grid-1%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=101a7b49-c550-49f3-a11c-bda9ab704001, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=00370ae8-77ec-467f-a29b-93cb84238000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345059485, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:04:19] : [Step 4/5] [2021-11-19 21:04:19,618][INFO ][exchange-worker-#7666%grid-1%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=2, minorTopVer=1], force=false, evt=DISCOVERY_CUSTOM_EVT, node=00370ae8-77ec-467f-a29b-93cb84238000] [21:04:19] : [Step 4/5] [2021-11-19 21:04:19,618][INFO ][sys-#7653%grid-1%][DistributedBaselineConfiguration] Baseline auto-adjust is 'disabled' with timeout='300000' ms [21:04:19] : [Step 4/5] [2021-11-19 21:04:19,620][INFO ][sys-#7646%grid-1%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (2 ms), stage="Update caches registry" (14 ms), stage="Start caches" (0 ms), stage="Affinity initialization on cache group start" (0 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Restore partition states" (0 ms), stage="After states restored callback" (20 ms), stage="WAL history reservation" (0 ms), stage="Waiting for Full message" (32 ms), stage="Affinity recalculation" (3 ms), stage="Full map updating" (0 ms), stage="Detect lost partitions" (3 ms), stage="Exchange done" (11 ms), stage="Total time" (85 ms)] [21:04:19] : [Step 4/5] [2021-11-19 21:04:19,619][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][root] awaitPartitionMapExchange finished [21:04:19] : [Step 4/5] [2021-11-19 21:04:19,619][INFO ][db-checkpoint-thread-#7675%grid-0%][Checkpointer] Checkpoint finished [cpId=1b7d1441-0997-4326-9ff4-0c431016a2d6, pages=18, markPos=WALPointer [idx=0, fileOff=86349, len=1963], walSegmentsCovered=[], markDuration=13ms, pagesWrite=18ms, fsync=20ms, total=59ms] [21:04:19] : [Step 4/5] [2021-11-19 21:04:19,623][INFO ][sys-#7646%grid-1%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], stage="Affinity initialization on cache group start [grp=ignite-sys-cache]" (0 ms) (parent=Affinity initialization on cache group start), stage="Affinity centralized initialization (crd) [grp=ignite-sys-cache, crd=false]" (0 ms) (parent=Determine exchange type), stage="Restore partition states [grp=ignite-sys-cache]" (0 ms) (parent=Restore partition states), stage="Affinity applying from full message [grp=ignite-sys-cache]" (3 ms) (parent=Affinity recalculation)] [21:04:19] : [Step 4/5] [2021-11-19 21:04:19,621][INFO ][sys-#7653%grid-1%][GridClusterStateProcessor] Successfully performed final activation steps [nodeId=101a7b49-c550-49f3-a11c-bda9ab704001, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:04:19] : [Step 4/5] [2021-11-19 21:04:19,629][INFO ][exchange-worker-#7544%grid-0%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], crd=true, evt=DISCOVERY_CUSTOM_EVT, evtNode=00370ae8-77ec-467f-a29b-93cb84238000, customEvt=DynamicCacheChangeBatch [id=2df1d593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqs=ArrayList [DynamicCacheChangeRequest [cacheName=encrypted, hasCfg=true, nodeId=00370ae8-77ec-467f-a29b-93cb84238000, clientStartOnly=false, stop=false, destroy=false, disabledAfterStart=false]], exchangeActions=ExchangeActions [startCaches=[encrypted], stopCaches=null, startGrps=[encrypted], stopGrps=[], resetParts=null, stateChangeRequest=null], startCaches=false], allowMerge=false, exchangeFreeSwitch=false] [21:04:19] : [Step 4/5] [2021-11-19 21:04:19,630][INFO ][exchange-worker-#7666%grid-1%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], crd=false, evt=DISCOVERY_CUSTOM_EVT, evtNode=00370ae8-77ec-467f-a29b-93cb84238000, customEvt=DynamicCacheChangeBatch [id=2df1d593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqs=ArrayList [DynamicCacheChangeRequest [cacheName=encrypted, hasCfg=true, nodeId=00370ae8-77ec-467f-a29b-93cb84238000, clientStartOnly=false, stop=false, destroy=false, disabledAfterStart=false]], exchangeActions=ExchangeActions [startCaches=[encrypted], stopCaches=null, startGrps=[encrypted], stopGrps=[], resetParts=null, stateChangeRequest=null], startCaches=false], allowMerge=false, exchangeFreeSwitch=false] [21:04:19] : [Step 4/5] [2021-11-19 21:04:19,632][INFO ][exchange-worker-#7544%grid-0%][PageMemoryImpl] Started page memory [memoryAllocated=24.0 MiB, pages=5952, tableSize=474.2 KiB, replacementSize=768 B, checkpointBuffer=10.0 MiB] [21:04:19] : [Step 4/5] [2021-11-19 21:04:19,633][INFO ][exchange-worker-#7666%grid-1%][PageMemoryImpl] Started page memory [memoryAllocated=24.0 MiB, pages=5952, tableSize=474.2 KiB, replacementSize=768 B, checkpointBuffer=10.0 MiB] [21:04:19] : [Step 4/5] [2021-11-19 21:04:19,709][INFO ][exchange-worker-#7666%grid-1%][GridCacheProcessor] Started cache [name=encrypted, id=1613773252, dataRegionName=default, mode=PARTITIONED, atomicity=ATOMIC, backups=0, mvcc=false] [21:04:19] : [Step 4/5] [2021-11-19 21:04:19,806][INFO ][exchange-worker-#7544%grid-0%][GridCacheProcessor] Started cache [name=encrypted, id=1613773252, dataRegionName=default, mode=PARTITIONED, atomicity=ATOMIC, backups=0, mvcc=false] [21:04:19]W: [org.apache.ignite:ignite-core] [2021-11-19 21:04:19,806][WARN ][exchange-worker-#7666%grid-1%][CacheAffinitySharedManager] Cache group 'encrypted' brings high overhead for its metainformation in data region 'default'. Metainformation required for its partitions (522 partitions, 4096 bytes per partition, 2 MBs total) will consume more than 15% of data region memory (10 MBs). It may lead to critical errors on the node and cluster instability. Please reduce number of partitions, add more memory to the data region or add more server nodes for this cache group. [21:04:19]W: [org.apache.ignite:ignite-core] [2021-11-19 21:04:19,814][WARN ][exchange-worker-#7544%grid-0%][CacheAffinitySharedManager] Cache group 'encrypted' brings high overhead for its metainformation in data region 'default'. Metainformation required for its partitions (502 partitions, 4096 bytes per partition, 1 MBs total) will consume more than 15% of data region memory (10 MBs). It may lead to critical errors on the node and cluster instability. Please reduce number of partitions, add more memory to the data region or add more server nodes for this cache group. [21:04:19] : [Step 4/5] [2021-11-19 21:04:19,814][INFO ][exchange-worker-#7666%grid-1%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], waitTime=0ms, futInfo=NA, mode=DISTRIBUTED] [21:04:19] : [Step 4/5] [2021-11-19 21:04:19,815][INFO ][exchange-worker-#7544%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], waitTime=0ms, futInfo=NA, mode=DISTRIBUTED] [21:04:19] : [Step 4/5] [2021-11-19 21:04:19,816][INFO ][exchange-worker-#7544%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partitions release latch: ServerLatch [permits=0, pendingAcks=HashSet [], super=CompletableLatch [id=CompletableLatchUid [id=exchange, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2]]]] [21:04:19] : [Step 4/5] [2021-11-19 21:04:19,816][INFO ][exchange-worker-#7544%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:04:19] : [Step 4/5] [2021-11-19 21:04:19,816][INFO ][exchange-worker-#7666%grid-1%][GridDhtPartitionsExchangeFuture] Finished waiting for partitions release latch: ClientLatch [coordinator=TcpDiscoveryNode [id=00370ae8-77ec-467f-a29b-93cb84238000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345059485, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], ackSent=true, super=CompletableLatch [id=CompletableLatchUid [id=exchange, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2]]]] [21:04:19] : [Step 4/5] [2021-11-19 21:04:19,818][INFO ][exchange-worker-#7666%grid-1%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:04:19] : [Step 4/5] [2021-11-19 21:04:19,850][INFO ][exchange-worker-#7544%grid-0%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], crd=true] [21:04:19] : [Step 4/5] [2021-11-19 21:04:19,852][INFO ][exchange-worker-#7666%grid-1%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], crd=false] [21:04:19] : [Step 4/5] [2021-11-19 21:04:19,853][INFO ][sys-#7529%grid-0%][GridDhtPartitionsExchangeFuture] Coordinator received single message [ver=AffinityTopologyVersion [topVer=2, minorTopVer=2], node=101a7b49-c550-49f3-a11c-bda9ab704001, allReceived=true] [21:04:19] : [Step 4/5] [2021-11-19 21:04:19,853][INFO ][sys-#7529%grid-0%][GridDhtPartitionsExchangeFuture] finishExchangeOnCoordinator [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2]] [21:04:19] : [Step 4/5] [2021-11-19 21:04:19,861][INFO ][sys-#7529%grid-0%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], err=null, rebalanced=true, wasRebalanced=true] [21:04:19] : [Step 4/5] [2021-11-19 21:04:19,862][INFO ][sys-#7638%grid-1%][GridDhtPartitionsExchangeFuture] Received full message, will finish exchange [node=00370ae8-77ec-467f-a29b-93cb84238000, resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2]] [21:04:19] : [Step 4/5] [2021-11-19 21:04:19,862][INFO ][sys-#7529%grid-0%][GridCacheProcessor] Finish proxy initialization, cacheName=encrypted, localNodeId=00370ae8-77ec-467f-a29b-93cb84238000 [21:04:19] : [Step 4/5] [2021-11-19 21:04:19,864][INFO ][sys-#7529%grid-0%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=00370ae8-77ec-467f-a29b-93cb84238000, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=00370ae8-77ec-467f-a29b-93cb84238000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345059622, loc=true, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2]] [21:04:19] : [Step 4/5] [2021-11-19 21:04:19,865][INFO ][sys-#7638%grid-1%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], err=null, rebalanced=true, wasRebalanced=true] [21:04:19] : [Step 4/5] [2021-11-19 21:04:19,865][INFO ][sys-#7529%grid-0%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (1 ms), stage="Update caches registry" (0 ms), stage="Start caches" (176 ms), stage="Affinity initialization on cache group start" (7 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Wait partitions release latch [latch=exchange]" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Restore partition states" (10 ms), stage="After states restored callback" (22 ms), stage="WAL history reservation" (0 ms), stage="Waiting for all single messages" (3 ms), stage="Affinity recalculation (crd)" (0 ms), stage="Collect update counters and create affinity messages" (0 ms), stage="Assign partitions states" (3 ms), stage="Validate partitions states" (0 ms), stage="Apply update counters" (0 ms), stage="Full message preparing" (2 ms), stage="Full message sending" (0 ms), stage="Exchange done" (4 ms), stage="Total time" (228 ms), Discovery lag=1 ms, Latest started node id=101a7b49-c550-49f3-a11c-bda9ab704001] [21:04:19] : [Step 4/5] [2021-11-19 21:04:19,865][INFO ][exchange-worker-#7544%grid-0%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=2, minorTopVer=2], force=false, evt=DISCOVERY_CUSTOM_EVT, node=00370ae8-77ec-467f-a29b-93cb84238000] [21:04:19] : [Step 4/5] [2021-11-19 21:04:19,868][INFO ][sys-#7529%grid-0%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], stage="Affinity initialization on cache group start [grp=encrypted]" (5 ms) (parent=Affinity initialization on cache group start), stage="Restore partition states [grp=encrypted]" (10 ms) (parent=Restore partition states), stage="Restore partition states [grp=ignite-sys-cache]" (0 ms) (parent=Restore partition states)] [21:04:19] : [Step 4/5] [2021-11-19 21:04:19,867][INFO ][sys-#7638%grid-1%][GridCacheProcessor] Finish proxy initialization, cacheName=encrypted, localNodeId=101a7b49-c550-49f3-a11c-bda9ab704001 [21:04:19] : [Step 4/5] [2021-11-19 21:04:19,870][INFO ][sys-#7638%grid-1%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=101a7b49-c550-49f3-a11c-bda9ab704001, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=00370ae8-77ec-467f-a29b-93cb84238000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345059485, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2]] [21:04:19] : [Step 4/5] [2021-11-19 21:04:19,870][INFO ][exchange-worker-#7666%grid-1%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=2, minorTopVer=2], force=false, evt=DISCOVERY_CUSTOM_EVT, node=00370ae8-77ec-467f-a29b-93cb84238000] [21:04:19] : [Step 4/5] [2021-11-19 21:04:19,871][INFO ][sys-#7638%grid-1%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (2 ms), stage="Update caches registry" (0 ms), stage="Start caches" (76 ms), stage="Affinity initialization on cache group start" (103 ms), stage="Determine exchange type" (1 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (1 ms), stage="Wait partitions release latch [latch=exchange]" (2 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Restore partition states" (9 ms), stage="After states restored callback" (23 ms), stage="WAL history reservation" (0 ms), stage="Waiting for Full message" (10 ms), stage="Affinity recalculation" (0 ms), stage="Full map updating" (2 ms), stage="Exchange done" (5 ms), stage="Total time" (234 ms)] [21:04:19] : [Step 4/5] [2021-11-19 21:04:19,873][INFO ][sys-#7638%grid-1%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], stage="Affinity initialization on cache group start [grp=encrypted]" (96 ms) (parent=Affinity initialization on cache group start), stage="Restore partition states [grp=encrypted]" (9 ms) (parent=Restore partition states), stage="Restore partition states [grp=ignite-sys-cache]" (0 ms) (parent=Restore partition states)] [21:04:21] : [Step 4/5] [2021-11-19 21:04:21,097][INFO ][exchange-worker-#7544%grid-0%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=3], crd=true, evt=DISCOVERY_CUSTOM_EVT, evtNode=00370ae8-77ec-467f-a29b-93cb84238000, customEvt=DynamicCacheChangeBatch [id=d112d593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqs=ArrayList [DynamicCacheChangeRequest [cacheName=encrypted, hasCfg=false, nodeId=00370ae8-77ec-467f-a29b-93cb84238000, clientStartOnly=false, stop=true, destroy=false, disabledAfterStart=false]], exchangeActions=ExchangeActions [startCaches=null, stopCaches=[encrypted], startGrps=[], stopGrps=[encrypted, destroy=true], resetParts=null, stateChangeRequest=null], startCaches=false], allowMerge=false, exchangeFreeSwitch=false] [21:04:21] : [Step 4/5] [2021-11-19 21:04:21,097][INFO ][exchange-worker-#7666%grid-1%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=3], crd=false, evt=DISCOVERY_CUSTOM_EVT, evtNode=00370ae8-77ec-467f-a29b-93cb84238000, customEvt=DynamicCacheChangeBatch [id=d112d593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqs=ArrayList [DynamicCacheChangeRequest [cacheName=encrypted, hasCfg=false, nodeId=00370ae8-77ec-467f-a29b-93cb84238000, clientStartOnly=false, stop=true, destroy=false, disabledAfterStart=false]], exchangeActions=ExchangeActions [startCaches=null, stopCaches=[encrypted], startGrps=[], stopGrps=[encrypted, destroy=true], resetParts=null, stateChangeRequest=null], startCaches=false], allowMerge=false, exchangeFreeSwitch=false] [21:04:21] : [Step 4/5] [2021-11-19 21:04:21,099][INFO ][exchange-worker-#7544%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=3], waitTime=0ms, futInfo=NA, mode=DISTRIBUTED] [21:04:21] : [Step 4/5] [2021-11-19 21:04:21,100][INFO ][exchange-worker-#7666%grid-1%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=3], waitTime=0ms, futInfo=NA, mode=DISTRIBUTED] [21:04:21] : [Step 4/5] [2021-11-19 21:04:21,101][INFO ][exchange-worker-#7544%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partitions release latch: ServerLatch [permits=0, pendingAcks=HashSet [], super=CompletableLatch [id=CompletableLatchUid [id=exchange, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=3]]]] [21:04:21] : [Step 4/5] [2021-11-19 21:04:21,101][INFO ][exchange-worker-#7666%grid-1%][GridDhtPartitionsExchangeFuture] Finished waiting for partitions release latch: ClientLatch [coordinator=TcpDiscoveryNode [id=00370ae8-77ec-467f-a29b-93cb84238000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345059485, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], ackSent=true, super=CompletableLatch [id=CompletableLatchUid [id=exchange, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=3]]]] [21:04:21] : [Step 4/5] [2021-11-19 21:04:21,101][INFO ][exchange-worker-#7544%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=3], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:04:21] : [Step 4/5] [2021-11-19 21:04:21,102][INFO ][exchange-worker-#7666%grid-1%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=3], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:04:21] : [Step 4/5] [2021-11-19 21:04:21,103][INFO ][exchange-worker-#7544%grid-0%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=3], crd=true] [21:04:21] : [Step 4/5] [2021-11-19 21:04:21,104][INFO ][exchange-worker-#7666%grid-1%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=3], crd=false] [21:04:21] : [Step 4/5] [2021-11-19 21:04:21,104][INFO ][sys-#7517%grid-0%][GridDhtPartitionsExchangeFuture] Coordinator received single message [ver=AffinityTopologyVersion [topVer=2, minorTopVer=3], node=101a7b49-c550-49f3-a11c-bda9ab704001, allReceived=true] [21:04:21] : [Step 4/5] [2021-11-19 21:04:21,105][INFO ][sys-#7517%grid-0%][GridDhtPartitionsExchangeFuture] finishExchangeOnCoordinator [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=3], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=3]] [21:04:21] : [Step 4/5] [2021-11-19 21:04:21,108][INFO ][sys-#7517%grid-0%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=3], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=3], err=null, rebalanced=true, wasRebalanced=true] [21:04:21] : [Step 4/5] [2021-11-19 21:04:21,110][INFO ][sys-#7656%grid-1%][GridDhtPartitionsExchangeFuture] Received full message, will finish exchange [node=00370ae8-77ec-467f-a29b-93cb84238000, resVer=AffinityTopologyVersion [topVer=2, minorTopVer=3]] [21:04:21] : [Step 4/5] [2021-11-19 21:04:21,110][INFO ][sys-#7656%grid-1%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=3], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=3], err=null, rebalanced=true, wasRebalanced=true] [21:04:21] : [Step 4/5] [2021-11-19 21:04:21,114][INFO ][sys-#7646%grid-1%][GridCachePartitionExchangeManager] Delay process full message without exchange id (there is exchange in progress) [nodeId=00370ae8-77ec-467f-a29b-93cb84238000] [21:04:21] : [Step 4/5] [2021-11-19 21:04:21,596][INFO ][db-checkpoint-thread-#7675%grid-0%][Checkpointer] Checkpoint started [checkpointId=8d74e252-e887-4d01-9f0a-fcac59df064c, startPtr=WALPointer [idx=0, fileOff=742802, len=11491], checkpointBeforeLockTime=5ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=1ms, checkpointLockHoldTime=5ms, walCpRecordFsyncDuration=150ms, writeCheckpointEntryDuration=326ms, splitAndSortCpPagesDuration=1ms, pages=570, reason='caches stop'] [21:04:21] : [Step 4/5] [2021-11-19 21:04:21,596][INFO ][db-checkpoint-thread-#7677%grid-1%][Checkpointer] Checkpoint started [checkpointId=01007dba-004c-41cf-a8bb-db42c1195a43, startPtr=WALPointer [idx=0, fileOff=627390, len=11871], checkpointBeforeLockTime=4ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=1ms, checkpointLockHoldTime=2ms, walCpRecordFsyncDuration=152ms, writeCheckpointEntryDuration=326ms, splitAndSortCpPagesDuration=1ms, pages=450, reason='caches stop'] [21:04:23] : [Step 4/5] [2021-11-19 21:04:23,713][INFO ][db-checkpoint-thread-#7677%grid-1%][Checkpointer] Checkpoint finished [cpId=01007dba-004c-41cf-a8bb-db42c1195a43, pages=450, markPos=WALPointer [idx=0, fileOff=627390, len=11871], walSegmentsCovered=[], markDuration=483ms, pagesWrite=28ms, fsync=2087ms, total=2602ms] [21:04:23] : [Step 4/5] [2021-11-19 21:04:23,716][INFO ][sys-#7656%grid-1%][GridCacheProcessor] Stopped cache [cacheName=encrypted] [21:04:23] : [Step 4/5] [2021-11-19 21:04:23,739][INFO ][sys-#7656%grid-1%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=101a7b49-c550-49f3-a11c-bda9ab704001, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=3], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=00370ae8-77ec-467f-a29b-93cb84238000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345059485, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=2, minorTopVer=3]] [21:04:23] : [Step 4/5] [2021-11-19 21:04:23,740][INFO ][exchange-worker-#7666%grid-1%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=2, minorTopVer=3], force=false, evt=DISCOVERY_CUSTOM_EVT, node=00370ae8-77ec-467f-a29b-93cb84238000] [21:04:23] : [Step 4/5] [2021-11-19 21:04:23,741][INFO ][sys-#7656%grid-1%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=3], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=3], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (2 ms), stage="Update caches registry" (0 ms), stage="Start caches" (0 ms), stage="Affinity initialization on cache group start" (0 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Wait partitions release latch [latch=exchange]" (1 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="After states restored callback" (0 ms), stage="WAL history reservation" (0 ms), stage="Waiting for Full message" (6 ms), stage="Affinity recalculation" (0 ms), stage="Full map updating" (0 ms), stage="Exchange done" (2630 ms), stage="Total time" (2639 ms)] [21:04:23] : [Step 4/5] [2021-11-19 21:04:23,743][INFO ][sys-#7656%grid-1%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=3], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=3]] [21:04:24] : [Step 4/5] [2021-11-19 21:04:24,406][INFO ][db-checkpoint-thread-#7675%grid-0%][Checkpointer] Checkpoint finished [cpId=8d74e252-e887-4d01-9f0a-fcac59df064c, pages=570, markPos=WALPointer [idx=0, fileOff=742802, len=11491], walSegmentsCovered=[], markDuration=483ms, pagesWrite=39ms, fsync=2770ms, total=3297ms] [21:04:24] : [Step 4/5] [2021-11-19 21:04:24,408][INFO ][sys-#7517%grid-0%][GridCacheProcessor] Stopped cache [cacheName=encrypted] [21:04:24] : [Step 4/5] [2021-11-19 21:04:24,430][INFO ][sys-#7517%grid-0%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=00370ae8-77ec-467f-a29b-93cb84238000, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=3], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=00370ae8-77ec-467f-a29b-93cb84238000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345063994, loc=true, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=2, minorTopVer=3]] [21:04:24] : [Step 4/5] [2021-11-19 21:04:24,430][INFO ][exchange-worker-#7544%grid-0%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=2, minorTopVer=3], force=false, evt=DISCOVERY_CUSTOM_EVT, node=00370ae8-77ec-467f-a29b-93cb84238000] [21:04:24] : [Step 4/5] [2021-11-19 21:04:24,431][INFO ][sys-#7517%grid-0%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=3], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=3], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (1 ms), stage="Update caches registry" (0 ms), stage="Start caches" (0 ms), stage="Affinity initialization on cache group start" (0 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (1 ms), stage="Wait partitions release latch [latch=exchange]" (1 ms), stage="Wait partitions release [latch=exchange]" (1 ms), stage="After states restored callback" (0 ms), stage="WAL history reservation" (0 ms), stage="Waiting for all single messages" (1 ms), stage="Affinity recalculation (crd)" (0 ms), stage="Collect update counters and create affinity messages" (0 ms), stage="Assign partitions states" (0 ms), stage="Validate partitions states" (0 ms), stage="Apply update counters" (0 ms), stage="Full message preparing" (2 ms), stage="Full message sending" (0 ms), stage="Exchange done" (3322 ms), stage="Total time" (3329 ms)] [21:04:24] : [Step 4/5] [2021-11-19 21:04:24,433][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][root] awaitPartitionMapExchange finished [21:04:24] : [Step 4/5] [2021-11-19 21:04:24,433][INFO ][sys-#7517%grid-0%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=3], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=3]] [21:04:24] : [Step 4/5] [2021-11-19 21:04:24,433][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][root] >>> Stopping grid [name=grid-1, id=101a7b49-c550-49f3-a11c-bda9ab704001] [21:04:24] : [Step 4/5] [2021-11-19 21:04:24,448][INFO ][db-checkpoint-thread-#7677%grid-1%][Checkpointer] Checkpoint started [checkpointId=04abb774-fb8c-430f-8ecc-ae81671e6936, startPtr=WALPointer [idx=0, fileOff=660006, len=1947], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=1ms, writeCheckpointEntryDuration=2ms, splitAndSortCpPagesDuration=0ms, pages=5, reason='timeout'] [21:04:24] : [Step 4/5] [2021-11-19 21:04:24,458][INFO ][tcp-disco-sock-reader-[00370ae8 127.0.0.1:35653]-#385%grid-1%-#7662%grid-1%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:35653, rmtPort=35653, rmtNodeId=00370ae8-77ec-467f-a29b-93cb84238000] [21:04:24] : [Step 4/5] [2021-11-19 21:04:24,459][INFO ][disco-event-worker-#7543%grid-0%][GridDiscoveryManager] Node left topology: TcpDiscoveryNode [id=101a7b49-c550-49f3-a11c-bda9ab704001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637345059465, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false] [21:04:24] : [Step 4/5] [2021-11-19 21:04:24,462][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][GridCacheProcessor] Stopped cache [cacheName=ignite-sys-cache] [21:04:24] : [Step 4/5] [2021-11-19 21:04:24,462][INFO ][disco-event-worker-#7543%grid-0%][GridDiscoveryManager] Topology snapshot [ver=3, locNode=00370ae8, servers=1, clients=0, state=ACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=00370ae8-77ec-467f-a29b-93cb84238000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:04:24] : [Step 4/5] [2021-11-19 21:04:24,463][INFO ][disco-event-worker-#7543%grid-0%][GridDiscoveryManager] ^-- Baseline [id=0, size=2, online=1, offline=1] [21:04:24]W: [org.apache.ignite:ignite-core] [2021-11-19 21:04:24,464][WARN ][grid-nio-worker-tcp-comm-0-#7483%TcpCommunicationSpi%][TcpCommunicationSpi] Failed to shutdown socket [21:04:24]W: [org.apache.ignite:ignite-core] java.nio.channels.ClosedChannelException [21:04:24]W: [org.apache.ignite:ignite-core] at sun.nio.ch.SocketChannelImpl.shutdownOutput(SocketChannelImpl.java:795) [21:04:24]W: [org.apache.ignite:ignite-core] at sun.nio.ch.SocketAdaptor.shutdownOutput(SocketAdaptor.java:407) [21:04:24]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.close(IgniteUtils.java:4247) [21:04:24]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.closeKey(GridNioServer.java:2784) [21:04:24]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.close(GridNioServer.java:2835) [21:04:24]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.close(GridNioServer.java:2794) [21:04:24]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.bodyInternal(GridNioServer.java:2157) [21:04:24]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.body(GridNioServer.java:1910) [21:04:24]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:125) [21:04:24]W: [org.apache.ignite:ignite-core] at java.lang.Thread.run(Thread.java:748) [21:04:24] : [Step 4/5] [2021-11-19 21:04:24,465][INFO ][exchange-worker-#7544%grid-0%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], crd=true, evt=NODE_LEFT, evtNode=101a7b49-c550-49f3-a11c-bda9ab704001, customEvt=null, allowMerge=false, exchangeFreeSwitch=true] [21:04:24] : [Step 4/5] [2021-11-19 21:04:24,468][INFO ][exchange-worker-#7544%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:04:24] : [Step 4/5] [2021-11-19 21:04:24,469][INFO ][exchange-worker-#7544%grid-0%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], err=null, rebalanced=true, wasRebalanced=true] [21:04:24] : [Step 4/5] [2021-11-19 21:04:24,471][INFO ][exchange-worker-#7544%grid-0%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=00370ae8-77ec-467f-a29b-93cb84238000, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], evt=NODE_LEFT, evtNode=TcpDiscoveryNode [id=101a7b49-c550-49f3-a11c-bda9ab704001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637345059465, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0]] [21:04:24] : [Step 4/5] [2021-11-19 21:04:24,472][INFO ][exchange-worker-#7544%grid-0%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (2 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="After states restored callback" (0 ms), stage="WAL history reservation" (0 ms), stage="Finalize update counters" (0 ms), stage="Detect lost partitions" (2 ms), stage="Exchange done" (1 ms), stage="Total time" (5 ms)] [21:04:24] : [Step 4/5] [2021-11-19 21:04:24,474][INFO ][exchange-worker-#7544%grid-0%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], stage="Affinity initialization (exchange-free switch on fully-rebalanced topology) [grp=ignite-sys-cache]" (0 ms) (parent=Determine exchange type)] [21:04:24] : [Step 4/5] [2021-11-19 21:04:24,475][INFO ][exchange-worker-#7544%grid-0%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], crd=true] [21:04:24] : [Step 4/5] [2021-11-19 21:04:24,475][INFO ][exchange-worker-#7544%grid-0%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=3, minorTopVer=0], force=false, evt=NODE_LEFT, node=101a7b49-c550-49f3-a11c-bda9ab704001] [21:04:25] : [Step 4/5] [2021-11-19 21:04:25,110][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][FilePageStoreManager] Cleanup cache stores [total=3, left=0, cleanFiles=false] [21:04:25] : [Step 4/5] [2021-11-19 21:04:25,113][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][GridDeploymentLocalStore] Removed undeployed class: GridDeployment [ts=1637345059592, depMode=SHARED, clsLdr=IsolatedClassLoader{roleName='test'}, clsLdrId=cbf1d593d71-101a7b49-c550-49f3-a11c-bda9ab704001, userVer=0, loc=true, sampleClsName=org.apache.ignite.internal.processors.cache.distributed.dht.preloader.IgniteDhtPartitionCountersMap2, pendingUndeploy=false, undeployed=true, usage=0] [21:04:25] : [Step 4/5] [2021-11-19 21:04:25,124][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][IgniteKernal%grid-1] [21:04:25] : [Step 4/5] [21:04:25] : [Step 4/5] >>> +------------------------------------------------------+ [21:04:25] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV stopped OK [21:04:25] : [Step 4/5] >>> +------------------------------------------------------+ [21:04:25] : [Step 4/5] >>> Ignite instance name: grid-1 [21:04:25] : [Step 4/5] >>> Grid uptime: 00:00:05.609 [21:04:25] : [Step 4/5] [21:04:25] : [Step 4/5] [21:04:25] : [Step 4/5] [2021-11-19 21:04:25,124][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][root] >>> Stopping grid [name=grid-0, id=00370ae8-77ec-467f-a29b-93cb84238000] [21:04:25] : [Step 4/5] [2021-11-19 21:04:25,130][INFO ][db-checkpoint-thread-#7675%grid-0%][Checkpointer] Checkpoint started [checkpointId=8121f8db-b2c1-450e-b219-081e1f82b0cc, startPtr=WALPointer [idx=0, fileOff=775073, len=1947], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=1ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=0ms, pages=5, reason='timeout'] [21:04:25]W: [org.apache.ignite:ignite-core] [2021-11-19 21:04:25,135][WARN ][tcp-disco-sock-reader-[101a7b49 127.0.0.1:47149]-#386%grid-0%-#7663%grid-0%][TestTcpDiscoverySpi] Failed to shutdown socket [21:04:25]W: [org.apache.ignite:ignite-core] java.net.SocketException: Socket is closed [21:04:25]W: [org.apache.ignite:ignite-core] at java.net.Socket.shutdownOutput(Socket.java:1568) [21:04:25]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.close(IgniteUtils.java:4247) [21:04:25]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.discovery.tcp.ServerImpl$SocketReader.body(ServerImpl.java:7370) [21:04:25] : [Step 4/5] [2021-11-19 21:04:25,136][INFO ][tcp-disco-sock-reader-[101a7b49 127.0.0.1:47149]-#386%grid-0%-#7663%grid-0%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:47149, rmtPort=47149, rmtNodeId=101a7b49-c550-49f3-a11c-bda9ab704001] [21:04:25]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.IgniteSpiThread.run(IgniteSpiThread.java:58) [21:04:25] : [Step 4/5] [2021-11-19 21:04:25,138][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][GridCacheProcessor] Stopped cache [cacheName=ignite-sys-cache] [21:04:25] : [Step 4/5] [2021-11-19 21:04:25,140][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][FilePageStoreManager] Cleanup cache stores [total=3, left=0, cleanFiles=false] [21:04:25] : [Step 4/5] [2021-11-19 21:04:25,141][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][GridDeploymentLocalStore] Removed undeployed class: GridDeployment [ts=1637345059568, depMode=SHARED, clsLdr=IsolatedClassLoader{roleName='test'}, clsLdrId=abf1d593d71-00370ae8-77ec-467f-a29b-93cb84238000, userVer=0, loc=true, sampleClsName=org.apache.ignite.internal.processors.cache.distributed.dht.preloader.GridDhtPartitionMap, pendingUndeploy=false, undeployed=true, usage=0] [21:04:25] : [Step 4/5] [2021-11-19 21:04:25,149][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][IgniteKernal%grid-0] [21:04:25] : [Step 4/5] [21:04:25] : [Step 4/5] >>> +------------------------------------------------------+ [21:04:25] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV stopped OK [21:04:25] : [Step 4/5] >>> +------------------------------------------------------+ [21:04:25] : [Step 4/5] >>> Ignite instance name: grid-0 [21:04:25] : [Step 4/5] >>> Grid uptime: 00:00:06.669 [21:04:25] : [Step 4/5] [21:04:25] : [Step 4/5] [21:04:25]W: [org.apache.ignite:ignite-core] [2021-11-19 21:04:25,154][WARN ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][G] Ignite work directory is not provided, automatically resolved to: /opt/buildagent/work/7bc1c54bc719b67c/work [21:04:25] : [Step 4/5] [2021-11-19 21:04:25,156][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][IgniteKernal%grid-0] [21:04:25] : [Step 4/5] [21:04:25] : [Step 4/5] >>> __________ ________________ [21:04:25] : [Step 4/5] >>> / _/ ___/ |/ / _/_ __/ __/ [21:04:25] : [Step 4/5] >>> _/ // (7 7 // / / / / _/ [21:04:25] : [Step 4/5] >>> /___/\___/_/|_/___/ /_/ /___/ [21:04:25] : [Step 4/5] >>> [21:04:25] : [Step 4/5] >>> ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:04:25] : [Step 4/5] >>> 2021 Copyright(C) Apache Software Foundation [21:04:25] : [Step 4/5] >>> [21:04:25] : [Step 4/5] >>> Ignite documentation: http://ignite.apache.org [21:04:25] : [Step 4/5] [21:04:25] : [Step 4/5] [2021-11-19 21:04:25,156][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][IgniteKernal%grid-0] Config URL: n/a [21:04:25] : [Step 4/5] [2021-11-19 21:04:25,157][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][IgniteKernal%grid-0] IgniteConfiguration [igniteInstanceName=grid-0, pubPoolSize=24, svcPoolSize=24, callbackPoolSize=24, stripedPoolSize=24, sysPoolSize=24, mgmtPoolSize=4, dataStreamerPoolSize=24, utilityCachePoolSize=24, utilityCacheKeepAliveTime=60000, p2pPoolSize=2, qryPoolSize=24, buildIdxPoolSize=4, igniteHome=/opt/buildagent/work/7bc1c54bc719b67c, igniteWorkDir=/opt/buildagent/work/7bc1c54bc719b67c/work, mbeanSrv=com.sun.jmx.mbeanserver.JmxMBeanServer@6fe85038, nodeId=006d8b80-bb9a-4285-83ea-4efb58686000, marsh=BinaryMarshaller [], marshLocJobs=false, daemon=false, p2pEnabled=true, netTimeout=10000, netCompressionLevel=1, sndRetryDelay=1000, sndRetryCnt=3, metricsHistSize=10000, metricsUpdateFreq=1000, metricsExpTime=9223372036854775807, discoSpi=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=0, ackTimeout=0, marsh=null, reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], segPlc=STOP, segResolveAttempts=2, waitForSegOnStart=true, allResolversPassReq=true, segChkFreq=10000, commSpi=TcpCommunicationSpi [connectGate=org.apache.ignite.spi.communication.tcp.internal.ConnectGateway@62840a7c, ctxInitLatch=java.util.concurrent.CountDownLatch@26391216[Count = 1], stopping=false, clientPool=null, nioSrvWrapper=null, stateProvider=null], evtSpi=MemoryEventStorageSpi [expireAgeMs=9223372036854775807, expireCnt=10000, filter=null], colSpi=NoopCollisionSpi [], deploySpi=LocalDeploymentSpi [], indexingSpi=org.apache.ignite.spi.indexing.noop.NoopIndexingSpi@321a589e, addrRslvr=null, encryptionSpi=org.apache.ignite.spi.encryption.keystore.KeystoreEncryptionSpi@3bc9f93f, tracingSpi=org.apache.ignite.spi.tracing.NoopTracingSpi@66eb973e, clientMode=false, rebalanceThreadPoolSize=4, rebalanceTimeout=10000, rebalanceBatchesPrefetchCnt=3, rebalanceThrottle=0, rebalanceBatchSize=524288, txCfg=TransactionConfiguration [txSerEnabled=false, dfltIsolation=REPEATABLE_READ, dfltConcurrency=PESSIMISTIC, dfltTxTimeout=0, txTimeoutOnPartitionMapExchange=0, deadlockTimeout=10000, pessimisticTxLogSize=0, pessimisticTxLogLinger=10000, tmLookupClsName=null, txManagerFactory=null, useJtaSync=false], cacheSanityCheckEnabled=true, discoStartupDelay=60000, deployMode=SHARED, p2pMissedCacheSize=100, locHost=127.0.0.1, timeSrvPortBase=31100, timeSrvPortRange=100, failureDetectionTimeout=10000, sysWorkerBlockedTimeout=null, clientFailureDetectionTimeout=10000, metricsLogFreq=0, connectorCfg=null, odbcCfg=null, warmupClos=null, atomicCfg=AtomicConfiguration [seqReserveSize=1000, cacheMode=PARTITIONED, backups=1, aff=null, grpName=null], classLdr=null, sslCtxFactory=null, platformCfg=null, binaryCfg=null, memCfg=null, pstCfg=null, dsCfg=DataStorageConfiguration [sysRegionInitSize=41943040, sysRegionMaxSize=104857600, pageSize=4096, concLvl=0, dfltDataRegConf=DataRegionConfiguration [name=default, maxSize=10485760, initSize=268435456, swapPath=null, pageEvictionMode=DISABLED, pageReplacementMode=CLOCK, evictionThreshold=0.9, emptyPagesPoolSize=100, metricsEnabled=false, metricsSubIntervalCount=5, metricsRateTimeInterval=60000, persistenceEnabled=true, checkpointPageBufSize=0, lazyMemoryAllocation=true, warmUpCfg=null], dataRegions=null, storagePath=null, checkpointFreq=180000, lockWaitTime=10000, checkpointThreads=4, checkpointWriteOrder=SEQUENTIAL, walHistSize=20, maxWalArchiveSize=1073741824, walSegments=10, walSegmentSize=67108864, walPath=db/wal, walArchivePath=db/wal/archive, cdcWalPath=db/wal/cdc, cdcEnabled=false, metricsEnabled=false, walMode=FSYNC, walTlbSize=131072, walBuffSize=0, walFlushFreq=2000, walFsyncDelay=1000, walRecordIterBuffSize=67108864, alwaysWriteFullPages=false, fileIOFactory=org.apache.ignite.internal.processors.cache.persistence.file.AsyncFileIOFactory@50595b5b, metricsSubIntervalCnt=5, metricsRateTimeInterval=60000, walAutoArchiveAfterInactivity=-1, walForceArchiveTimeout=-1, writeThrottlingEnabled=false, walCompactionEnabled=false, walCompactionLevel=1, checkpointReadLockTimeout=null, walPageCompression=DISABLED, walPageCompressionLevel=null, dfltWarmUpCfg=null, encCfg=org.apache.ignite.configuration.EncryptionConfiguration@165635a8, defragmentationThreadPoolSize=4, minWalArchiveSize=-1], snapshotPath=snapshots, activeOnStart=true, activeOnStartPropSetFlag=false, autoActivation=true, autoActivationPropSetFlag=false, clusterStateOnStart=null, sqlConnCfg=null, cliConnCfg=ClientConnectorConfiguration [host=null, port=10800, portRange=100, sockSndBufSize=0, sockRcvBufSize=0, tcpNoDelay=true, maxOpenCursorsPerConn=128, threadPoolSize=24, selectorCnt=12, idleTimeout=0, handshakeTimeout=10000, jdbcEnabled=true, odbcEnabled=true, thinCliEnabled=true, sslEnabled=false, useIgniteSslCtxFactory=true, sslClientAuth=false, sslCtxFactory=null, thinCliCfg=ThinClientConfiguration [maxActiveTxPerConn=100, maxActiveComputeTasksPerConn=0]], mvccVacuumThreadCnt=2, mvccVacuumFreq=5000, authEnabled=false, failureHnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]], commFailureRslvr=null, sqlCfg=SqlConfiguration [longQryWarnTimeout=3000, dfltQryTimeout=0, sqlQryHistSize=1000, validationEnabled=false], asyncContinuationExecutor=null] [21:04:25] : [Step 4/5] [2021-11-19 21:04:25,165][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][IgniteKernal%grid-0] Daemon mode: off [21:04:25] : [Step 4/5] [2021-11-19 21:04:25,165][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][IgniteKernal%grid-0] OS: Linux 4.15.0-151-generic amd64 [21:04:25] : [Step 4/5] [2021-11-19 21:04:25,165][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][IgniteKernal%grid-0] OS user: teamcity [21:04:25] : [Step 4/5] [2021-11-19 21:04:25,165][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][IgniteKernal%grid-0] PID: 16724 [21:04:25] : [Step 4/5] [2021-11-19 21:04:25,166][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][IgniteKernal%grid-0] Language runtime: Java Platform API Specification ver. 1.8 [21:04:25] : [Step 4/5] [2021-11-19 21:04:25,166][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][IgniteKernal%grid-0] VM information: Java(TM) SE Runtime Environment 1.8.0_261-b12 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 25.261-b12 [21:04:25] : [Step 4/5] [2021-11-19 21:04:25,166][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][IgniteKernal%grid-0] VM total memory: 1.9GB [21:04:25] : [Step 4/5] [2021-11-19 21:04:25,166][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][IgniteKernal%grid-0] Remote Management [restart: off, REST: off, JMX (remote: off)] [21:04:25] : [Step 4/5] [2021-11-19 21:04:25,167][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][IgniteKernal%grid-0] Logger: GridTestLog4jLogger [quiet=false, config=null] [21:04:25] : [Step 4/5] [2021-11-19 21:04:25,167][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][IgniteKernal%grid-0] IGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c [21:04:25] : [Step 4/5] [2021-11-19 21:04:25,167][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][IgniteKernal%grid-0] VM arguments: [-DIGNITE_DUMP_THREADS_ON_FAILURE=false, -DMono=/usr/bin/mono-sgen, -DMono4.0_x64=/usr/lib/mono/4.0, -DMono4.5_x64=/usr/lib/mono/4.5, -DMonoVersion=6.12.0.90, -DSKIP_BUILD=false, -Dagent.home.dir=/opt/buildagent, -Dagent.name=aitc-lin02_03, -Dagent.ownPort=9090, -Dagent.work.dir=/opt/buildagent/work, -Dbuild.number=95, -Dbuild.vcs.number=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.1=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.GitHubApacheIgnite=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dclassworlds.conf=/opt/buildagent/temp/buildTmp/teamcity.m2.conf, -Dcom.jetbrains.maven.watcher.report.file=/opt/buildagent/temp/buildTmp/maven-build-info.xml, -Djava.io.tmpdir=/opt/buildagent/temp/buildTmp, -Dmaven.home=/opt/buildagent/tools/maven3_6, -Dmaven.multiModuleProjectDirectory=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.agent.cpuBenchmark=457, -Dteamcity.agent.dotnet.agent_url=http://localhost:9090/RPC2, -Dteamcity.agent.dotnet.build_id=6278078, -Dteamcity.auth.password=*******, -Dteamcity.auth.userId=TeamCityBuildId=6278078, -Dteamcity.build.changedFiles.file=/opt/buildagent/temp/buildTmp/changedFiles6342607772318147725.txt, -Dteamcity.build.checkoutDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.build.id=6278078, -Dteamcity.build.properties.file=/opt/buildagent/temp/buildTmp/teamcity.build5164517880467851002.properties, -Dteamcity.build.tempDir=/opt/buildagent/temp/buildTmp, -Dteamcity.build.workingDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.buildConfName=Basic 3, -Dteamcity.buildType.id=IgniteTests24Java8_Basic3, -Dteamcity.configuration.properties.file=/opt/buildagent/temp/buildTmp/teamcity.config5591980786735343870.properties, -Dteamcity.maven.userSettings.path=/opt/buildagent/temp/buildTmp/maven_settings_585072866407032347.xml, -Dteamcity.maven.watcher.home=/opt/buildagent/plugins/mavenPlugin/maven-watcher-jdk16, -Dteamcity.projectName=Ignite Tests 2.x (JDK 8/11), -Dteamcity.runner.properties.file=/opt/buildagent/temp/buildTmp/teamcity.runner9098465561618137420.properties, -Dteamcity.tests.recentlyFailedTests.file=/opt/buildagent/temp/buildTmp/testsToRunFirst3891775683130404069.txt, -Dteamcity.version=2021.2 (build 99542), -ea, -Xms2g, -Xmx2g, -XX:+HeapDumpOnOutOfMemoryError, -DIGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_TEST_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_UPDATE_NOTIFIER=false, -DIGNITE_NO_DISCO_ORDER=true, -DIGNITE_PERFORMANCE_SUGGESTIONS_DISABLED=true, -Djava.net.preferIPv4Stack=true, -DTEST_SCALE_FACTOR=1.0, -DIGNITE_TEST_PROP_LOG4J_FILE=log4j-tc-test.xml, -DIGNITE_QUIET=false, -DIGNITE_MARSHAL_BUFFERS_RECHECK=1000, -Dmaven.repo.local=/opt/buildagent/.m2/repository] [21:04:25] : [Step 4/5] [2021-11-19 21:04:25,171][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][IgniteKernal%grid-0] System cache's DataRegion size is configured to 40 MB. Use DataStorageConfiguration.systemRegionInitialSize property to change the setting. [21:04:25] : [Step 4/5] [2021-11-19 21:04:25,172][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][IgniteKernal%grid-0] Configured caches [in 'sysMemPlc' dataRegion: ['ignite-sys-cache']] [21:04:25]W: [org.apache.ignite:ignite-core] [2021-11-19 21:04:25,172][WARN ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][IgniteKernal%grid-0] Peer class loading is enabled (disable it in production for performance and deployment consistency reasons) [21:04:25] : [Step 4/5] [2021-11-19 21:04:25,172][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][IgniteKernal%grid-0] 3-rd party licenses can be found at: /opt/buildagent/work/7bc1c54bc719b67c/libs/licenses [21:04:25] : [Step 4/5] [2021-11-19 21:04:25,176][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][IgnitePluginProcessor] Configured plugins: [21:04:25] : [Step 4/5] [2021-11-19 21:04:25,177][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][IgnitePluginProcessor] ^-- StanByClusterTestProvider 1.0 [21:04:25] : [Step 4/5] [2021-11-19 21:04:25,177][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][IgnitePluginProcessor] ^-- null [21:04:25] : [Step 4/5] [2021-11-19 21:04:25,177][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][IgnitePluginProcessor] [21:04:25] : [Step 4/5] [2021-11-19 21:04:25,177][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][IgnitePluginProcessor] ^-- PageMemory tracker plugin 1.0 [21:04:25] : [Step 4/5] [2021-11-19 21:04:25,177][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][IgnitePluginProcessor] ^-- null [21:04:25] : [Step 4/5] [2021-11-19 21:04:25,177][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][IgnitePluginProcessor] [21:04:25] : [Step 4/5] [2021-11-19 21:04:25,178][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][IgnitePluginProcessor] ^-- TestDistibutedConfigurationPlugin 1.0 [21:04:25] : [Step 4/5] [2021-11-19 21:04:25,178][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][IgnitePluginProcessor] ^-- null [21:04:25] : [Step 4/5] [2021-11-19 21:04:25,178][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][IgnitePluginProcessor] [21:04:25] : [Step 4/5] [2021-11-19 21:04:25,178][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][IgnitePluginProcessor] ^-- NodeValidationPluginProvider 1.0 [21:04:25] : [Step 4/5] [2021-11-19 21:04:25,178][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][IgnitePluginProcessor] ^-- null [21:04:25] : [Step 4/5] [2021-11-19 21:04:25,179][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][IgnitePluginProcessor] [21:04:25] : [Step 4/5] [2021-11-19 21:04:25,179][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][FailureProcessor] Configured failure handler: [hnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]]] [21:04:25] : [Step 4/5] [2021-11-19 21:04:25,193][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][TcpCommunicationSpi] Successfully bound communication NIO server to TCP port [port=45130, locHost=/127.0.0.1, selectorsCnt=12, selectorSpins=0, pairedConn=false] [21:04:25]W: [org.apache.ignite:ignite-core] [2021-11-19 21:04:25,194][WARN ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][TcpCommunicationSpi] Message queue limit is set to 0 which may lead to potential OOMEs when running cache operations in FULL_ASYNC or PRIMARY_SYNC modes due to message queues growth on sender and receiver sides. [21:04:25] : [Step 4/5] [2021-11-19 21:04:25,214][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][GridCollisionManager] Collision resolution is disabled (all jobs will be activated upon arrival). [21:04:25] : [Step 4/5] [2021-11-19 21:04:25,214][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][IgniteKernal%grid-0] Security status [authentication=off, sandbox=off, tls/ssl=off] [21:04:25] : [Step 4/5] [2021-11-19 21:04:25,274][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:04:25] : [Step 4/5] [2021-11-19 21:04:25,358][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][MaintenanceProcessor] Resolved store directory for node persistent data: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0 [21:04:25] : [Step 4/5] [2021-11-19 21:04:25,359][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][CacheObjectBinaryProcessorImpl] Resolved directory for serialized binary metadata: /opt/buildagent/work/7bc1c54bc719b67c/work/db/binary_meta/grid_0 [21:04:25] : [Step 4/5] [2021-11-19 21:04:25,363][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0 [21:04:25] : [Step 4/5] [2021-11-19 21:04:25,364][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][FileWriteAheadLogManager] Resolved write ahead log work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0 [21:04:25] : [Step 4/5] [2021-11-19 21:04:25,364][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][FileWriteAheadLogManager] Resolved write ahead log archive directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0 [21:04:25] : [Step 4/5] [2021-11-19 21:04:25,365][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000005.wal [21:04:25] : [Step 4/5] [2021-11-19 21:04:25,366][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000006.wal [21:04:25] : [Step 4/5] [2021-11-19 21:04:25,366][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000008.wal [21:04:25] : [Step 4/5] [2021-11-19 21:04:25,367][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000004.wal [21:04:25] : [Step 4/5] [2021-11-19 21:04:25,367][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000003.wal [21:04:25] : [Step 4/5] [2021-11-19 21:04:25,368][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000002.wal [21:04:25] : [Step 4/5] [2021-11-19 21:04:25,368][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000007.wal [21:04:25] : [Step 4/5] [2021-11-19 21:04:25,369][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000001.wal [21:04:25] : [Step 4/5] [2021-11-19 21:04:25,369][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000009.wal [21:04:25] : [Step 4/5] [2021-11-19 21:04:25,374][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][GridCacheDatabaseSharedManager] Configured data regions initialized successfully [total=5] [21:04:25] : [Step 4/5] [2021-11-19 21:04:25,375][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][IgniteSnapshotManager] Resolved snapshot work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/snapshots [21:04:25] : [Step 4/5] [2021-11-19 21:04:25,376][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][IgniteSnapshotManager] Resolved temp directory for snapshot creation: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0/snp [21:04:25] : [Step 4/5] [2021-11-19 21:04:25,379][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][ClientListenerProcessor] Client connector processor has started on TCP port 10800 [21:04:25] : [Step 4/5] [2021-11-19 21:04:25,386][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][IgniteKernal%grid-0] Non-loopback local IPs: 172.17.0.4 [21:04:25] : [Step 4/5] [2021-11-19 21:04:25,387][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][IgniteKernal%grid-0] Enabled local MACs: 0242AC110004 [21:04:25] : [Step 4/5] [2021-11-19 21:04:25,390][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=/opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0/cp/1637345065127-8121f8db-b2c1-450e-b219-081e1f82b0cc-START.bin, endMarker=/opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0/cp/1637345061109-8d74e252-e887-4d01-9f0a-fcac59df064c-END.bin] [21:04:25] : [Step 4/5] [2021-11-19 21:04:25,391][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:04:25] : [Step 4/5] [2021-11-19 21:04:25,391][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=742802, len=11491], lastMarked=WALPointer [idx=0, fileOff=775073, len=1947], lastCheckpointId=8121f8db-b2c1-450e-b219-081e1f82b0cc] [21:04:25] : [Step 4/5] [2021-11-19 21:04:25,495][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][GridCacheDatabaseSharedManager] Found last checkpoint marker [cpId=8121f8db-b2c1-450e-b219-081e1f82b0cc, pos=WALPointer [idx=0, fileOff=775073, len=1947]] [21:04:25] : [Step 4/5] [2021-11-19 21:04:25,502][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][GridCacheDatabaseSharedManager] Applying lost metastore updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=775073, len=1947], lastCheckpointId=8121f8db-b2c1-450e-b219-081e1f82b0cc] [21:04:25] : [Step 4/5] [2021-11-19 21:04:25,560][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=61 ms] [21:04:25] : [Step 4/5] [2021-11-19 21:04:25,561][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][GridCacheProcessor] Restoring partition state for local groups. [21:04:25] : [Step 4/5] [2021-11-19 21:04:25,561][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=0, partitionsProcessed=0, time=0ms] [21:04:25] : [Step 4/5] [2021-11-19 21:04:25,730][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][GridEncryptionManager] Encryption keys loaded from metastore. [grps=, masterKeyName=ignite.master.key] [21:04:25] : [Step 4/5] [2021-11-19 21:04:25,741][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][GridClusterStateProcessor] Restoring history for BaselineTopology[id=0] [21:04:25] : [Step 4/5] [2021-11-19 21:04:25,751][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][ClusterProcessor] Cluster ID and tag has been read from metastorage: ClusterIdAndTag [id=ee6fb329-7b0a-43cc-8e0d-0768a6b4d7c6, tag=dazzling_burnell] [21:04:25] : [Step 4/5] [2021-11-19 21:04:25,752][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][IgniteClusterImpl] Shutdown policy was updated [oldVal=null, newVal=null] [21:04:25] : [Step 4/5] [2021-11-19 21:04:25,752][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustEnabled' was changed from 'null' to 'false' [21:04:25] : [Step 4/5] [2021-11-19 21:04:25,753][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustTimeout' was changed from 'null' to '300000' [21:04:25] : [Step 4/5] [2021-11-19 21:04:25,753][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][IgniteTxManager] Transactions parameter 'txOwnerDumpRequestsAllowed' was changed from 'null' to 'true' [21:04:25] : [Step 4/5] [2021-11-19 21:04:25,754][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][IgniteTxManager] Transactions parameter 'longOperationsDumpTimeout' was changed from 'null' to '60000' [21:04:25] : [Step 4/5] [2021-11-19 21:04:25,754][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpThreshold' was changed from 'null' to '0' [21:04:25] : [Step 4/5] [2021-11-19 21:04:25,755][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][IgniteTxManager] Transactions parameter 'transactionTimeDumpSamplesCoefficient' was changed from 'null' to '0.0' [21:04:25] : [Step 4/5] [2021-11-19 21:04:25,756][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpSamplesPerSecondLimit' was changed from 'null' to '5' [21:04:25] : [Step 4/5] [2021-11-19 21:04:25,756][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][IgniteTxManager] Transactions parameter 'collisionsDumpInterval' was changed from 'null' to '1000' [21:04:25] : [Step 4/5] [2021-11-19 21:04:25,756][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][GridCacheDatabaseSharedManager] Historical rebalance WAL threshold changed [property=historical.rebalance.threshold, oldVal=null, newVal=500] [21:04:25] : [Step 4/5] [2021-11-19 21:04:25,757][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][GridCacheDatabaseSharedManager] Checkpoint frequency deviation changed [oldVal=null, newVal=null] [21:04:25] : [Step 4/5] [2021-11-19 21:04:25,758][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][FilePageStoreManager] Cleanup cache stores [total=1, left=0, cleanFiles=false] [21:04:25] : [Step 4/5] [2021-11-19 21:04:25,761][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:04:25] : [Step 4/5] [2021-11-19 21:04:25,762][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:04:25] : [Step 4/5] [2021-11-19 21:04:25,763][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:04:25] : [Step 4/5] [2021-11-19 21:04:25,764][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][GridCacheDatabaseSharedManager] Data Regions Started: 5 [21:04:25] : [Step 4/5] [2021-11-19 21:04:25,765][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][GridCacheDatabaseSharedManager] ^-- sysMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:04:25] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:04:25] : [Step 4/5] ^-- default region [type=default, persistence=true, lazyAlloc=true, [21:04:25] : [Step 4/5] ... initCfg=10MB, maxCfg=10MB, usedRam=0MB, freeRam=100%, allocRam=0MB, allocTotal=0MB] [21:04:25] : [Step 4/5] ^-- metastoreMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:04:25] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:04:25] : [Step 4/5] ^-- TxLog region [type=internal, persistence=true, lazyAlloc=false, [21:04:25] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:04:25] : [Step 4/5] ^-- volatileDsMemPlc region [type=user, persistence=false, lazyAlloc=true, [21:04:25] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB] [21:04:25] : [Step 4/5] ^-- Ignite persistence [used=0MB] [21:04:25] : [Step 4/5] [21:04:25] : [Step 4/5] [2021-11-19 21:04:25,767][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][GridCacheDatabaseSharedManager] Starting binary memory restore for: [-2100569601] [21:04:25] : [Step 4/5] [2021-11-19 21:04:25,787][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=/opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0/cp/1637345065127-8121f8db-b2c1-450e-b219-081e1f82b0cc-START.bin, endMarker=/opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0/cp/1637345061109-8d74e252-e887-4d01-9f0a-fcac59df064c-END.bin] [21:04:25] : [Step 4/5] [2021-11-19 21:04:25,788][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=742802, len=11491], lastMarked=WALPointer [idx=0, fileOff=775073, len=1947], lastCheckpointId=8121f8db-b2c1-450e-b219-081e1f82b0cc] [21:04:25]W: [org.apache.ignite:ignite-core] [2021-11-19 21:04:25,838][WARN ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][GridCacheDatabaseSharedManager] Ignite node stopped in the middle of checkpoint. Will restore memory state and finish checkpoint on node start. [21:04:25] : [Step 4/5] [2021-11-19 21:04:25,885][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][GridCacheDatabaseSharedManager] Found last checkpoint marker [cpId=8121f8db-b2c1-450e-b219-081e1f82b0cc, pos=WALPointer [idx=0, fileOff=775073, len=1947]] [21:04:25] : [Step 4/5] [2021-11-19 21:04:25,889][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][GridCacheDatabaseSharedManager] Finished applying memory changes [changesApplied=6, time=50 ms] [21:04:25] : [Step 4/5] [2021-11-19 21:04:25,892][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][CheckpointWorkflow] Checkpoint finished [cpId=8121f8db-b2c1-450e-b219-081e1f82b0cc, pages=5, markPos=WALPointer [idx=0, fileOff=775073, len=1947], pagesWrite=-7ms, fsync=0ms, total=-7ms] [21:04:25] : [Step 4/5] [2021-11-19 21:04:25,892][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][GridCacheDatabaseSharedManager] Binary memory state restored at node startup [restoredPtr=WALPointer [idx=0, fileOff=777020, len=0]] [21:04:25] : [Step 4/5] [2021-11-19 21:04:25,893][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000000.wal, offset=777020, ver=2] [21:04:25] : [Step 4/5] [2021-11-19 21:04:25,896][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][GridCacheProcessor] Started cache in recovery mode [name=ignite-sys-cache, id=-2100569601, dataRegionName=sysMemPlc, mode=REPLICATED, atomicity=TRANSACTIONAL, backups=2147483647, mvcc=false] [21:04:25] : [Step 4/5] [2021-11-19 21:04:25,897][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][GridCacheDatabaseSharedManager] Binary recovery performed in 130 ms. [21:04:25] : [Step 4/5] [2021-11-19 21:04:25,897][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=/opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0/cp/1637345065127-8121f8db-b2c1-450e-b219-081e1f82b0cc-START.bin, endMarker=/opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0/cp/1637345065127-8121f8db-b2c1-450e-b219-081e1f82b0cc-END.bin] [21:04:25] : [Step 4/5] [2021-11-19 21:04:25,898][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][GridCacheDatabaseSharedManager] Applying lost cache updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=775073, len=1947], lastCheckpointId=8121f8db-b2c1-450e-b219-081e1f82b0cc] [21:04:25] : [Step 4/5] [2021-11-19 21:04:25,948][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=51 ms] [21:04:25] : [Step 4/5] [2021-11-19 21:04:25,948][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][GridCacheProcessor] Restoring partition state for local groups. [21:04:25] : [Step 4/5] [2021-11-19 21:04:25,959][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=1, partitionsProcessed=100, time=10ms] [21:04:25] : [Step 4/5] [2021-11-19 21:04:25,962][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][TestTcpDiscoverySpi] Successfully bound to TCP port [port=47500, localHost=localhost/127.0.0.1, locNodeId=006d8b80-bb9a-4285-83ea-4efb58686000] [21:04:25] : [Step 4/5] [2021-11-19 21:04:25,970][INFO ][disco-notifier-worker-#7812%grid-0%][MvccProcessorImpl] Assigned mvcc coordinator [crd=MvccCoordinator [topVer=AffinityTopologyVersion [topVer=1, minorTopVer=0], nodeId=006d8b80-bb9a-4285-83ea-4efb58686000, ver=1637345065964, local=true, initialized=false]] [21:04:25] : [Step 4/5] [2021-11-19 21:04:25,971][INFO ][sys-#7798%grid-0%][ClusterProcessor] Writing cluster ID and tag to metastorage on ready for write ClusterIdAndTag [id=ee6fb329-7b0a-43cc-8e0d-0768a6b4d7c6, tag=dazzling_burnell] [21:04:25] : [Step 4/5] [2021-11-19 21:04:25,987][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][IgniteKernal%grid-0] To start Console Management & Monitoring run ignitevisorcmd.{sh|bat} [21:04:25] : [Step 4/5] [2021-11-19 21:04:25,987][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][IgniteKernal%grid-0] [21:04:25] : [Step 4/5] [21:04:25] : [Step 4/5] >>> +-------------------------------------------+ [21:04:25] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:04:25] : [Step 4/5] >>> +-------------------------------------------+ [21:04:25] : [Step 4/5] >>> OS name: Linux 4.15.0-151-generic amd64 [21:04:25] : [Step 4/5] >>> CPU(s): 24 [21:04:25] : [Step 4/5] >>> Heap: 2.0GB [21:04:25] : [Step 4/5] >>> VM name: 16724@c4dfe9a430b2 [21:04:25] : [Step 4/5] >>> Ignite instance name: grid-0 [21:04:25] : [Step 4/5] >>> Local node [ID=006D8B80-BB9A-4285-83EA-4EFB58686000, order=1, clientMode=false] [21:04:25] : [Step 4/5] >>> Local node addresses: [127.0.0.1] [21:04:25] : [Step 4/5] >>> Local ports: TCP:10800 TCP:45130 TCP:47500 [21:04:25] : [Step 4/5] [21:04:25] : [Step 4/5] [2021-11-19 21:04:25,988][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][IgniteKernal%grid-0] >>> Ignite cluster is in INACTIVE state (limited functionality available). Use control.(sh|bat) script or IgniteCluster.state(ClusterState.ACTIVE) to change the state. [21:04:25] : [Step 4/5] [2021-11-19 21:04:25,989][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][GridDiscoveryManager] Topology snapshot [ver=1, locNode=006d8b80, servers=1, clients=0, state=INACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=006d8b80-bb9a-4285-83ea-4efb58686000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:04:25] : [Step 4/5] [2021-11-19 21:04:25,989][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][GridDiscoveryManager] ^-- Baseline [id=0, size=2, online=1, offline=1] [21:04:25] : [Step 4/5] [2021-11-19 21:04:25,990][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][GridDiscoveryManager] ^-- 1 nodes left for auto-activation [grid-1] [21:04:25] : [Step 4/5] [2021-11-19 21:04:25,990][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][G] Node started : [stage="Configure system pool" (0 ms),stage="Start managers" (203 ms),stage="Configure binary metadata" (2 ms),stage="Start processors" (24 ms),stage="Start 'StanByClusterTestProvider' plugin" (0 ms),stage="Start 'PageMemory tracker plugin' plugin" (0 ms),stage="Start 'TestDistibutedConfigurationPlugin' plugin" (0 ms),stage="Start 'NodeValidationPluginProvider' plugin" (0 ms),stage="Init metastore" (372 ms),stage="Init and start regions" (8 ms),stage="Restore binary memory" (130 ms),stage="Restore logical state" (62 ms),stage="Finish recovery" (1 ms),stage="Join topology" (9 ms),stage="Await transition" (2 ms),stage="Await exchange" (17 ms),stage="Total time" (830 ms)] [21:04:25] : [Step 4/5] [2021-11-19 21:04:25,991][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][root] Node started with the following configuration [id=006d8b80-bb9a-4285-83ea-4efb58686000, marshaller=BinaryMarshaller [], discovery=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=5000, ackTimeout=5000, marsh=JdkMarshaller [clsFilter=org.apache.ignite.marshaller.MarshallerUtils$1@734e5fcc], reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], binaryCfg=null, lateAff=true] [21:04:25]W: [org.apache.ignite:ignite-core] [2021-11-19 21:04:25,996][WARN ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][G] Ignite work directory is not provided, automatically resolved to: /opt/buildagent/work/7bc1c54bc719b67c/work [21:04:25] : [Step 4/5] [2021-11-19 21:04:25,997][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][IgniteKernal%grid-1] [21:04:25] : [Step 4/5] [21:04:25] : [Step 4/5] >>> __________ ________________ [21:04:25] : [Step 4/5] >>> / _/ ___/ |/ / _/_ __/ __/ [21:04:25] : [Step 4/5] >>> _/ // (7 7 // / / / / _/ [21:04:25] : [Step 4/5] >>> /___/\___/_/|_/___/ /_/ /___/ [21:04:25] : [Step 4/5] >>> [21:04:25] : [Step 4/5] >>> ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:04:25] : [Step 4/5] >>> 2021 Copyright(C) Apache Software Foundation [21:04:25] : [Step 4/5] >>> [21:04:25] : [Step 4/5] >>> Ignite documentation: http://ignite.apache.org [21:04:25] : [Step 4/5] [21:04:25] : [Step 4/5] [2021-11-19 21:04:25,997][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][IgniteKernal%grid-1] Config URL: n/a [21:04:26] : [Step 4/5] [2021-11-19 21:04:25,998][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][IgniteKernal%grid-1] IgniteConfiguration [igniteInstanceName=grid-1, pubPoolSize=24, svcPoolSize=24, callbackPoolSize=24, stripedPoolSize=24, sysPoolSize=24, mgmtPoolSize=4, dataStreamerPoolSize=24, utilityCachePoolSize=24, utilityCacheKeepAliveTime=60000, p2pPoolSize=2, qryPoolSize=24, buildIdxPoolSize=4, igniteHome=/opt/buildagent/work/7bc1c54bc719b67c, igniteWorkDir=/opt/buildagent/work/7bc1c54bc719b67c/work, mbeanSrv=com.sun.jmx.mbeanserver.JmxMBeanServer@6fe85038, nodeId=10efe27d-c048-4848-a965-0bc4cda5b001, marsh=BinaryMarshaller [], marshLocJobs=false, daemon=false, p2pEnabled=true, netTimeout=10000, netCompressionLevel=1, sndRetryDelay=1000, sndRetryCnt=3, metricsHistSize=10000, metricsUpdateFreq=1000, metricsExpTime=9223372036854775807, discoSpi=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=0, ackTimeout=0, marsh=null, reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], segPlc=STOP, segResolveAttempts=2, waitForSegOnStart=true, allResolversPassReq=true, segChkFreq=10000, commSpi=TcpCommunicationSpi [connectGate=org.apache.ignite.spi.communication.tcp.internal.ConnectGateway@10ec288f, ctxInitLatch=java.util.concurrent.CountDownLatch@36079952[Count = 1], stopping=false, clientPool=null, nioSrvWrapper=null, stateProvider=null], evtSpi=MemoryEventStorageSpi [expireAgeMs=9223372036854775807, expireCnt=10000, filter=null], colSpi=NoopCollisionSpi [], deploySpi=LocalDeploymentSpi [], indexingSpi=org.apache.ignite.spi.indexing.noop.NoopIndexingSpi@16df0991, addrRslvr=null, encryptionSpi=org.apache.ignite.spi.encryption.keystore.KeystoreEncryptionSpi@4e3b9c52, tracingSpi=org.apache.ignite.spi.tracing.NoopTracingSpi@2a4746f0, clientMode=false, rebalanceThreadPoolSize=4, rebalanceTimeout=10000, rebalanceBatchesPrefetchCnt=3, rebalanceThrottle=0, rebalanceBatchSize=524288, txCfg=TransactionConfiguration [txSerEnabled=false, dfltIsolation=REPEATABLE_READ, dfltConcurrency=PESSIMISTIC, dfltTxTimeout=0, txTimeoutOnPartitionMapExchange=0, deadlockTimeout=10000, pessimisticTxLogSize=0, pessimisticTxLogLinger=10000, tmLookupClsName=null, txManagerFactory=null, useJtaSync=false], cacheSanityCheckEnabled=true, discoStartupDelay=60000, deployMode=SHARED, p2pMissedCacheSize=100, locHost=127.0.0.1, timeSrvPortBase=31100, timeSrvPortRange=100, failureDetectionTimeout=10000, sysWorkerBlockedTimeout=null, clientFailureDetectionTimeout=10000, metricsLogFreq=0, connectorCfg=null, odbcCfg=null, warmupClos=null, atomicCfg=AtomicConfiguration [seqReserveSize=1000, cacheMode=PARTITIONED, backups=1, aff=null, grpName=null], classLdr=null, sslCtxFactory=null, platformCfg=null, binaryCfg=null, memCfg=null, pstCfg=null, dsCfg=DataStorageConfiguration [sysRegionInitSize=41943040, sysRegionMaxSize=104857600, pageSize=4096, concLvl=0, dfltDataRegConf=DataRegionConfiguration [name=default, maxSize=10485760, initSize=268435456, swapPath=null, pageEvictionMode=DISABLED, pageReplacementMode=CLOCK, evictionThreshold=0.9, emptyPagesPoolSize=100, metricsEnabled=false, metricsSubIntervalCount=5, metricsRateTimeInterval=60000, persistenceEnabled=true, checkpointPageBufSize=0, lazyMemoryAllocation=true, warmUpCfg=null], dataRegions=null, storagePath=null, checkpointFreq=180000, lockWaitTime=10000, checkpointThreads=4, checkpointWriteOrder=SEQUENTIAL, walHistSize=20, maxWalArchiveSize=1073741824, walSegments=10, walSegmentSize=67108864, walPath=db/wal, walArchivePath=db/wal/archive, cdcWalPath=db/wal/cdc, cdcEnabled=false, metricsEnabled=false, walMode=FSYNC, walTlbSize=131072, walBuffSize=0, walFlushFreq=2000, walFsyncDelay=1000, walRecordIterBuffSize=67108864, alwaysWriteFullPages=false, fileIOFactory=org.apache.ignite.internal.processors.cache.persistence.file.AsyncFileIOFactory@19d31666, metricsSubIntervalCnt=5, metricsRateTimeInterval=60000, walAutoArchiveAfterInactivity=-1, walForceArchiveTimeout=-1, writeThrottlingEnabled=false, walCompactionEnabled=false, walCompactionLevel=1, checkpointReadLockTimeout=null, walPageCompression=DISABLED, walPageCompressionLevel=null, dfltWarmUpCfg=null, encCfg=org.apache.ignite.configuration.EncryptionConfiguration@ff22086, defragmentationThreadPoolSize=4, minWalArchiveSize=-1], snapshotPath=snapshots, activeOnStart=true, activeOnStartPropSetFlag=false, autoActivation=true, autoActivationPropSetFlag=false, clusterStateOnStart=null, sqlConnCfg=null, cliConnCfg=ClientConnectorConfiguration [host=null, port=10800, portRange=100, sockSndBufSize=0, sockRcvBufSize=0, tcpNoDelay=true, maxOpenCursorsPerConn=128, threadPoolSize=24, selectorCnt=12, idleTimeout=0, handshakeTimeout=10000, jdbcEnabled=true, odbcEnabled=true, thinCliEnabled=true, sslEnabled=false, useIgniteSslCtxFactory=true, sslClientAuth=false, sslCtxFactory=null, thinCliCfg=ThinClientConfiguration [maxActiveTxPerConn=100, maxActiveComputeTasksPerConn=0]], mvccVacuumThreadCnt=2, mvccVacuumFreq=5000, authEnabled=false, failureHnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]], commFailureRslvr=null, sqlCfg=SqlConfiguration [longQryWarnTimeout=3000, dfltQryTimeout=0, sqlQryHistSize=1000, validationEnabled=false], asyncContinuationExecutor=null] [21:04:26] : [Step 4/5] [2021-11-19 21:04:26,005][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][IgniteKernal%grid-1] Daemon mode: off [21:04:26] : [Step 4/5] [2021-11-19 21:04:26,005][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][IgniteKernal%grid-1] OS: Linux 4.15.0-151-generic amd64 [21:04:26] : [Step 4/5] [2021-11-19 21:04:26,005][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][IgniteKernal%grid-1] OS user: teamcity [21:04:26] : [Step 4/5] [2021-11-19 21:04:26,005][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][IgniteKernal%grid-1] PID: 16724 [21:04:26] : [Step 4/5] [2021-11-19 21:04:26,006][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][IgniteKernal%grid-1] Language runtime: Java Platform API Specification ver. 1.8 [21:04:26] : [Step 4/5] [2021-11-19 21:04:26,006][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][IgniteKernal%grid-1] VM information: Java(TM) SE Runtime Environment 1.8.0_261-b12 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 25.261-b12 [21:04:26] : [Step 4/5] [2021-11-19 21:04:26,006][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][IgniteKernal%grid-1] VM total memory: 1.9GB [21:04:26] : [Step 4/5] [2021-11-19 21:04:26,006][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][IgniteKernal%grid-1] Remote Management [restart: off, REST: off, JMX (remote: off)] [21:04:26] : [Step 4/5] [2021-11-19 21:04:26,007][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][IgniteKernal%grid-1] Logger: GridTestLog4jLogger [quiet=false, config=null] [21:04:26] : [Step 4/5] [2021-11-19 21:04:26,007][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][IgniteKernal%grid-1] IGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c [21:04:26] : [Step 4/5] [2021-11-19 21:04:26,007][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][IgniteKernal%grid-1] VM arguments: [-DIGNITE_DUMP_THREADS_ON_FAILURE=false, -DMono=/usr/bin/mono-sgen, -DMono4.0_x64=/usr/lib/mono/4.0, -DMono4.5_x64=/usr/lib/mono/4.5, -DMonoVersion=6.12.0.90, -DSKIP_BUILD=false, -Dagent.home.dir=/opt/buildagent, -Dagent.name=aitc-lin02_03, -Dagent.ownPort=9090, -Dagent.work.dir=/opt/buildagent/work, -Dbuild.number=95, -Dbuild.vcs.number=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.1=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.GitHubApacheIgnite=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dclassworlds.conf=/opt/buildagent/temp/buildTmp/teamcity.m2.conf, -Dcom.jetbrains.maven.watcher.report.file=/opt/buildagent/temp/buildTmp/maven-build-info.xml, -Djava.io.tmpdir=/opt/buildagent/temp/buildTmp, -Dmaven.home=/opt/buildagent/tools/maven3_6, -Dmaven.multiModuleProjectDirectory=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.agent.cpuBenchmark=457, -Dteamcity.agent.dotnet.agent_url=http://localhost:9090/RPC2, -Dteamcity.agent.dotnet.build_id=6278078, -Dteamcity.auth.password=*******, -Dteamcity.auth.userId=TeamCityBuildId=6278078, -Dteamcity.build.changedFiles.file=/opt/buildagent/temp/buildTmp/changedFiles6342607772318147725.txt, -Dteamcity.build.checkoutDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.build.id=6278078, -Dteamcity.build.properties.file=/opt/buildagent/temp/buildTmp/teamcity.build5164517880467851002.properties, -Dteamcity.build.tempDir=/opt/buildagent/temp/buildTmp, -Dteamcity.build.workingDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.buildConfName=Basic 3, -Dteamcity.buildType.id=IgniteTests24Java8_Basic3, -Dteamcity.configuration.properties.file=/opt/buildagent/temp/buildTmp/teamcity.config5591980786735343870.properties, -Dteamcity.maven.userSettings.path=/opt/buildagent/temp/buildTmp/maven_settings_585072866407032347.xml, -Dteamcity.maven.watcher.home=/opt/buildagent/plugins/mavenPlugin/maven-watcher-jdk16, -Dteamcity.projectName=Ignite Tests 2.x (JDK 8/11), -Dteamcity.runner.properties.file=/opt/buildagent/temp/buildTmp/teamcity.runner9098465561618137420.properties, -Dteamcity.tests.recentlyFailedTests.file=/opt/buildagent/temp/buildTmp/testsToRunFirst3891775683130404069.txt, -Dteamcity.version=2021.2 (build 99542), -ea, -Xms2g, -Xmx2g, -XX:+HeapDumpOnOutOfMemoryError, -DIGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_TEST_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_UPDATE_NOTIFIER=false, -DIGNITE_NO_DISCO_ORDER=true, -DIGNITE_PERFORMANCE_SUGGESTIONS_DISABLED=true, -Djava.net.preferIPv4Stack=true, -DTEST_SCALE_FACTOR=1.0, -DIGNITE_TEST_PROP_LOG4J_FILE=log4j-tc-test.xml, -DIGNITE_QUIET=false, -DIGNITE_MARSHAL_BUFFERS_RECHECK=1000, -Dmaven.repo.local=/opt/buildagent/.m2/repository] [21:04:26] : [Step 4/5] [2021-11-19 21:04:26,011][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][IgniteKernal%grid-1] System cache's DataRegion size is configured to 40 MB. Use DataStorageConfiguration.systemRegionInitialSize property to change the setting. [21:04:26] : [Step 4/5] [2021-11-19 21:04:26,011][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][IgniteKernal%grid-1] Configured caches [in 'sysMemPlc' dataRegion: ['ignite-sys-cache']] [21:04:26]W: [org.apache.ignite:ignite-core] [2021-11-19 21:04:26,011][WARN ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][IgniteKernal%grid-1] Peer class loading is enabled (disable it in production for performance and deployment consistency reasons) [21:04:26] : [Step 4/5] [2021-11-19 21:04:26,012][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][IgniteKernal%grid-1] 3-rd party licenses can be found at: /opt/buildagent/work/7bc1c54bc719b67c/libs/licenses [21:04:26] : [Step 4/5] [2021-11-19 21:04:26,016][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][IgnitePluginProcessor] Configured plugins: [21:04:26] : [Step 4/5] [2021-11-19 21:04:26,016][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][IgnitePluginProcessor] ^-- StanByClusterTestProvider 1.0 [21:04:26] : [Step 4/5] [2021-11-19 21:04:26,016][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][IgnitePluginProcessor] ^-- null [21:04:26] : [Step 4/5] [2021-11-19 21:04:26,016][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][IgnitePluginProcessor] [21:04:26] : [Step 4/5] [2021-11-19 21:04:26,016][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][IgnitePluginProcessor] ^-- PageMemory tracker plugin 1.0 [21:04:26] : [Step 4/5] [2021-11-19 21:04:26,017][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][IgnitePluginProcessor] ^-- null [21:04:26] : [Step 4/5] [2021-11-19 21:04:26,017][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][IgnitePluginProcessor] [21:04:26] : [Step 4/5] [2021-11-19 21:04:26,017][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][IgnitePluginProcessor] ^-- TestDistibutedConfigurationPlugin 1.0 [21:04:26] : [Step 4/5] [2021-11-19 21:04:26,017][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][IgnitePluginProcessor] ^-- null [21:04:26] : [Step 4/5] [2021-11-19 21:04:26,017][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][IgnitePluginProcessor] [21:04:26] : [Step 4/5] [2021-11-19 21:04:26,017][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][IgnitePluginProcessor] ^-- NodeValidationPluginProvider 1.0 [21:04:26] : [Step 4/5] [2021-11-19 21:04:26,018][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][IgnitePluginProcessor] ^-- null [21:04:26] : [Step 4/5] [2021-11-19 21:04:26,018][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][IgnitePluginProcessor] [21:04:26] : [Step 4/5] [2021-11-19 21:04:26,018][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][FailureProcessor] Configured failure handler: [hnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]]] [21:04:26] : [Step 4/5] [2021-11-19 21:04:26,034][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][TcpCommunicationSpi] Successfully bound communication NIO server to TCP port [port=45131, locHost=/127.0.0.1, selectorsCnt=12, selectorSpins=0, pairedConn=false] [21:04:26]W: [org.apache.ignite:ignite-core] [2021-11-19 21:04:26,034][WARN ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][TcpCommunicationSpi] Message queue limit is set to 0 which may lead to potential OOMEs when running cache operations in FULL_ASYNC or PRIMARY_SYNC modes due to message queues growth on sender and receiver sides. [21:04:26] : [Step 4/5] [2021-11-19 21:04:26,040][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][GridCollisionManager] Collision resolution is disabled (all jobs will be activated upon arrival). [21:04:26] : [Step 4/5] [2021-11-19 21:04:26,040][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][IgniteKernal%grid-1] Security status [authentication=off, sandbox=off, tls/ssl=off] [21:04:26] : [Step 4/5] [2021-11-19 21:04:26,096][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:04:26] : [Step 4/5] [2021-11-19 21:04:26,187][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][MaintenanceProcessor] Resolved store directory for node persistent data: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1 [21:04:26] : [Step 4/5] [2021-11-19 21:04:26,188][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][CacheObjectBinaryProcessorImpl] Resolved directory for serialized binary metadata: /opt/buildagent/work/7bc1c54bc719b67c/work/db/binary_meta/grid_1 [21:04:26] : [Step 4/5] [2021-11-19 21:04:26,192][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1 [21:04:26] : [Step 4/5] [2021-11-19 21:04:26,193][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][FileWriteAheadLogManager] Resolved write ahead log work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1 [21:04:26] : [Step 4/5] [2021-11-19 21:04:26,194][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][FileWriteAheadLogManager] Resolved write ahead log archive directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1 [21:04:26] : [Step 4/5] [2021-11-19 21:04:26,196][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000005.wal [21:04:26] : [Step 4/5] [2021-11-19 21:04:26,196][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000006.wal [21:04:26] : [Step 4/5] [2021-11-19 21:04:26,197][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000008.wal [21:04:26] : [Step 4/5] [2021-11-19 21:04:26,197][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000004.wal [21:04:26] : [Step 4/5] [2021-11-19 21:04:26,198][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000003.wal [21:04:26] : [Step 4/5] [2021-11-19 21:04:26,198][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000002.wal [21:04:26] : [Step 4/5] [2021-11-19 21:04:26,199][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000007.wal [21:04:26] : [Step 4/5] [2021-11-19 21:04:26,199][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000001.wal [21:04:26] : [Step 4/5] [2021-11-19 21:04:26,200][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000009.wal [21:04:26] : [Step 4/5] [2021-11-19 21:04:26,206][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][GridCacheDatabaseSharedManager] Configured data regions initialized successfully [total=5] [21:04:26] : [Step 4/5] [2021-11-19 21:04:26,207][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][IgniteSnapshotManager] Resolved snapshot work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/snapshots [21:04:26] : [Step 4/5] [2021-11-19 21:04:26,207][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][IgniteSnapshotManager] Resolved temp directory for snapshot creation: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1/snp [21:04:26] : [Step 4/5] [2021-11-19 21:04:26,211][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][ClientListenerProcessor] Client connector processor has started on TCP port 10801 [21:04:26] : [Step 4/5] [2021-11-19 21:04:26,213][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][IgniteKernal%grid-1] Non-loopback local IPs: 172.17.0.4 [21:04:26] : [Step 4/5] [2021-11-19 21:04:26,214][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][IgniteKernal%grid-1] Enabled local MACs: 0242AC110004 [21:04:26] : [Step 4/5] [2021-11-19 21:04:26,215][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=/opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1/cp/1637345064444-04abb774-fb8c-430f-8ecc-ae81671e6936-START.bin, endMarker=/opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1/cp/1637345061111-01007dba-004c-41cf-a8bb-db42c1195a43-END.bin] [21:04:26] : [Step 4/5] [2021-11-19 21:04:26,216][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:04:26] : [Step 4/5] [2021-11-19 21:04:26,216][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=627390, len=11871], lastMarked=WALPointer [idx=0, fileOff=660006, len=1947], lastCheckpointId=04abb774-fb8c-430f-8ecc-ae81671e6936] [21:04:26] : [Step 4/5] [2021-11-19 21:04:26,336][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][GridCacheDatabaseSharedManager] Found last checkpoint marker [cpId=04abb774-fb8c-430f-8ecc-ae81671e6936, pos=WALPointer [idx=0, fileOff=660006, len=1947]] [21:04:26] : [Step 4/5] [2021-11-19 21:04:26,342][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][GridCacheDatabaseSharedManager] Applying lost metastore updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=660006, len=1947], lastCheckpointId=04abb774-fb8c-430f-8ecc-ae81671e6936] [21:04:26] : [Step 4/5] [2021-11-19 21:04:26,412][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=71 ms] [21:04:26] : [Step 4/5] [2021-11-19 21:04:26,412][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][GridCacheProcessor] Restoring partition state for local groups. [21:04:26] : [Step 4/5] [2021-11-19 21:04:26,412][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=0, partitionsProcessed=0, time=0ms] [21:04:26] : [Step 4/5] [2021-11-19 21:04:26,587][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][GridEncryptionManager] Encryption keys loaded from metastore. [grps=, masterKeyName=ignite.master.key] [21:04:26] : [Step 4/5] [2021-11-19 21:04:26,588][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][GridClusterStateProcessor] Restoring history for BaselineTopology[id=0] [21:04:26] : [Step 4/5] [2021-11-19 21:04:26,591][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][ClusterProcessor] Cluster ID and tag has been read from metastorage: ClusterIdAndTag [id=ee6fb329-7b0a-43cc-8e0d-0768a6b4d7c6, tag=dazzling_burnell] [21:04:26] : [Step 4/5] [2021-11-19 21:04:26,591][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][IgniteClusterImpl] Shutdown policy was updated [oldVal=null, newVal=null] [21:04:26] : [Step 4/5] [2021-11-19 21:04:26,591][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustEnabled' was changed from 'null' to 'false' [21:04:26] : [Step 4/5] [2021-11-19 21:04:26,592][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustTimeout' was changed from 'null' to '300000' [21:04:26] : [Step 4/5] [2021-11-19 21:04:26,592][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][IgniteTxManager] Transactions parameter 'txOwnerDumpRequestsAllowed' was changed from 'null' to 'true' [21:04:26] : [Step 4/5] [2021-11-19 21:04:26,592][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][IgniteTxManager] Transactions parameter 'longOperationsDumpTimeout' was changed from 'null' to '60000' [21:04:26] : [Step 4/5] [2021-11-19 21:04:26,593][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpThreshold' was changed from 'null' to '0' [21:04:26] : [Step 4/5] [2021-11-19 21:04:26,593][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][IgniteTxManager] Transactions parameter 'transactionTimeDumpSamplesCoefficient' was changed from 'null' to '0.0' [21:04:26] : [Step 4/5] [2021-11-19 21:04:26,593][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpSamplesPerSecondLimit' was changed from 'null' to '5' [21:04:26] : [Step 4/5] [2021-11-19 21:04:26,594][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][IgniteTxManager] Transactions parameter 'collisionsDumpInterval' was changed from 'null' to '1000' [21:04:26] : [Step 4/5] [2021-11-19 21:04:26,594][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][GridCacheDatabaseSharedManager] Historical rebalance WAL threshold changed [property=historical.rebalance.threshold, oldVal=null, newVal=500] [21:04:26] : [Step 4/5] [2021-11-19 21:04:26,595][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][GridCacheDatabaseSharedManager] Checkpoint frequency deviation changed [oldVal=null, newVal=null] [21:04:26] : [Step 4/5] [2021-11-19 21:04:26,595][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][FilePageStoreManager] Cleanup cache stores [total=1, left=0, cleanFiles=false] [21:04:26] : [Step 4/5] [2021-11-19 21:04:26,598][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:04:26] : [Step 4/5] [2021-11-19 21:04:26,599][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:04:26] : [Step 4/5] [2021-11-19 21:04:26,600][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:04:26] : [Step 4/5] [2021-11-19 21:04:26,601][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][GridCacheDatabaseSharedManager] Data Regions Started: 5 [21:04:26] : [Step 4/5] [2021-11-19 21:04:26,602][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][GridCacheDatabaseSharedManager] ^-- sysMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:04:26] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:04:26] : [Step 4/5] ^-- default region [type=default, persistence=true, lazyAlloc=true, [21:04:26] : [Step 4/5] ... initCfg=10MB, maxCfg=10MB, usedRam=0MB, freeRam=100%, allocRam=0MB, allocTotal=0MB] [21:04:26] : [Step 4/5] ^-- metastoreMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:04:26] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:04:26] : [Step 4/5] ^-- TxLog region [type=internal, persistence=true, lazyAlloc=false, [21:04:26] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:04:26] : [Step 4/5] ^-- volatileDsMemPlc region [type=user, persistence=false, lazyAlloc=true, [21:04:26] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB] [21:04:26] : [Step 4/5] ^-- Ignite persistence [used=0MB] [21:04:26] : [Step 4/5] [21:04:26] : [Step 4/5] [2021-11-19 21:04:26,603][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][GridCacheDatabaseSharedManager] Starting binary memory restore for: [-2100569601] [21:04:26] : [Step 4/5] [2021-11-19 21:04:26,612][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=/opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1/cp/1637345064444-04abb774-fb8c-430f-8ecc-ae81671e6936-START.bin, endMarker=/opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1/cp/1637345061111-01007dba-004c-41cf-a8bb-db42c1195a43-END.bin] [21:04:26] : [Step 4/5] [2021-11-19 21:04:26,612][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=627390, len=11871], lastMarked=WALPointer [idx=0, fileOff=660006, len=1947], lastCheckpointId=04abb774-fb8c-430f-8ecc-ae81671e6936] [21:04:26]W: [org.apache.ignite:ignite-core] [2021-11-19 21:04:26,669][WARN ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][GridCacheDatabaseSharedManager] Ignite node stopped in the middle of checkpoint. Will restore memory state and finish checkpoint on node start. [21:04:26] : [Step 4/5] [2021-11-19 21:04:26,724][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][GridCacheDatabaseSharedManager] Found last checkpoint marker [cpId=04abb774-fb8c-430f-8ecc-ae81671e6936, pos=WALPointer [idx=0, fileOff=660006, len=1947]] [21:04:26] : [Step 4/5] [2021-11-19 21:04:26,728][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][GridCacheDatabaseSharedManager] Finished applying memory changes [changesApplied=6, time=50 ms] [21:04:26] : [Step 4/5] [2021-11-19 21:04:26,731][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][CheckpointWorkflow] Checkpoint finished [cpId=04abb774-fb8c-430f-8ecc-ae81671e6936, pages=5, markPos=WALPointer [idx=0, fileOff=660006, len=1947], pagesWrite=2ms, fsync=0ms, total=2ms] [21:04:26] : [Step 4/5] [2021-11-19 21:04:26,732][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][GridCacheDatabaseSharedManager] Binary memory state restored at node startup [restoredPtr=WALPointer [idx=0, fileOff=661953, len=0]] [21:04:26] : [Step 4/5] [2021-11-19 21:04:26,733][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000000.wal, offset=661953, ver=2] [21:04:26] : [Step 4/5] [2021-11-19 21:04:26,737][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][GridCacheProcessor] Started cache in recovery mode [name=ignite-sys-cache, id=-2100569601, dataRegionName=sysMemPlc, mode=REPLICATED, atomicity=TRANSACTIONAL, backups=2147483647, mvcc=false] [21:04:26] : [Step 4/5] [2021-11-19 21:04:26,737][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][GridCacheDatabaseSharedManager] Binary recovery performed in 134 ms. [21:04:26] : [Step 4/5] [2021-11-19 21:04:26,738][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=/opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1/cp/1637345064444-04abb774-fb8c-430f-8ecc-ae81671e6936-START.bin, endMarker=/opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1/cp/1637345064444-04abb774-fb8c-430f-8ecc-ae81671e6936-END.bin] [21:04:26] : [Step 4/5] [2021-11-19 21:04:26,739][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][GridCacheDatabaseSharedManager] Applying lost cache updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=660006, len=1947], lastCheckpointId=04abb774-fb8c-430f-8ecc-ae81671e6936] [21:04:26] : [Step 4/5] [2021-11-19 21:04:26,799][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=60 ms] [21:04:26] : [Step 4/5] [2021-11-19 21:04:26,799][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][GridCacheProcessor] Restoring partition state for local groups. [21:04:26] : [Step 4/5] [2021-11-19 21:04:26,813][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=1, partitionsProcessed=100, time=20ms] [21:04:26] : [Step 4/5] [2021-11-19 21:04:26,816][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][TestTcpDiscoverySpi] Successfully bound to TCP port [port=47501, localHost=localhost/127.0.0.1, locNodeId=10efe27d-c048-4848-a965-0bc4cda5b001] [21:04:26] : [Step 4/5] [2021-11-19 21:04:26,820][INFO ][tcp-disco-srvr-[:47500]-#391%grid-0%-#7814%grid-0%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=58729] [21:04:26] : [Step 4/5] [2021-11-19 21:04:26,821][INFO ][tcp-disco-srvr-[:47500]-#391%grid-0%-#7814%grid-0%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=58729] [21:04:26] : [Step 4/5] [2021-11-19 21:04:26,821][INFO ][tcp-disco-sock-reader-[]-#397%grid-0%-#7933%grid-0%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:58729, rmtPort=58729] [21:04:26] : [Step 4/5] [2021-11-19 21:04:26,823][INFO ][tcp-disco-sock-reader-[10efe27d 127.0.0.1:58729]-#397%grid-0%-#7933%grid-0%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=10efe27d-c048-4848-a965-0bc4cda5b001, rmtAddr=/127.0.0.1:58729] [21:04:26] : [Step 4/5] [2021-11-19 21:04:26,829][INFO ][tcp-disco-srvr-[:47501]-#396%grid-1%-#7932%grid-1%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=39525] [21:04:26] : [Step 4/5] [2021-11-19 21:04:26,829][INFO ][tcp-disco-srvr-[:47501]-#396%grid-1%-#7932%grid-1%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=39525] [21:04:26] : [Step 4/5] [2021-11-19 21:04:26,830][INFO ][tcp-disco-sock-reader-[]-#398%grid-1%-#7934%grid-1%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:39525, rmtPort=39525] [21:04:26] : [Step 4/5] [2021-11-19 21:04:26,830][INFO ][tcp-disco-sock-reader-[]-#398%grid-1%-#7934%grid-1%][TestTcpDiscoverySpi] Received ping request from the remote node [rmtNodeId=006d8b80-bb9a-4285-83ea-4efb58686000, rmtAddr=/127.0.0.1:39525, rmtPort=39525] [21:04:26] : [Step 4/5] [2021-11-19 21:04:26,832][INFO ][tcp-disco-sock-reader-[]-#398%grid-1%-#7934%grid-1%][TestTcpDiscoverySpi] Finished writing ping response [rmtNodeId=006d8b80-bb9a-4285-83ea-4efb58686000, rmtAddr=/127.0.0.1:39525, rmtPort=39525] [21:04:26] : [Step 4/5] [2021-11-19 21:04:26,833][INFO ][tcp-disco-sock-reader-[10efe27d 127.0.0.1:58729]-#397%grid-0%-#7933%grid-0%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:58729, rmtPort=58729, rmtNodeId=10efe27d-c048-4848-a965-0bc4cda5b001] [21:04:26] : [Step 4/5] [2021-11-19 21:04:26,833][INFO ][tcp-disco-sock-reader-[]-#398%grid-1%-#7934%grid-1%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:39525, rmtPort=39525, rmtNodeId=null] [21:04:26] : [Step 4/5] [2021-11-19 21:04:26,836][INFO ][tcp-disco-msg-worker-[crd]-#390%grid-0%-#7813%grid-0%][GridEncryptionManager] Joining node doesn't have stored group keys [node=10efe27d-c048-4848-a965-0bc4cda5b001] [21:04:26] : [Step 4/5] [2021-11-19 21:04:26,847][INFO ][tcp-disco-msg-worker-[crd]-#390%grid-0%-#7813%grid-0%][TestTcpDiscoverySpi] New next node [newNext=TcpDiscoveryNode [id=10efe27d-c048-4848-a965-0bc4cda5b001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=0, intOrder=2, lastExchangeTime=1637345066820, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false]] [21:04:26] : [Step 4/5] [2021-11-19 21:04:26,848][INFO ][tcp-disco-srvr-[:47501]-#396%grid-1%-#7932%grid-1%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=37219] [21:04:26] : [Step 4/5] [2021-11-19 21:04:26,848][INFO ][tcp-disco-srvr-[:47501]-#396%grid-1%-#7932%grid-1%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=37219] [21:04:26] : [Step 4/5] [2021-11-19 21:04:26,849][INFO ][tcp-disco-sock-reader-[]-#399%grid-1%-#7935%grid-1%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:37219, rmtPort=37219] [21:04:26] : [Step 4/5] [2021-11-19 21:04:26,850][INFO ][tcp-disco-sock-reader-[006d8b80 127.0.0.1:37219]-#399%grid-1%-#7935%grid-1%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=006d8b80-bb9a-4285-83ea-4efb58686000, rmtAddr=/127.0.0.1:37219] [21:04:26] : [Step 4/5] [2021-11-19 21:04:26,854][INFO ][tcp-disco-msg-worker-[]-#395%grid-1%-#7931%grid-1%][TestTcpDiscoverySpi] New next node [newNext=TcpDiscoveryNode [id=006d8b80-bb9a-4285-83ea-4efb58686000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345066851, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false]] [21:04:26] : [Step 4/5] [2021-11-19 21:04:26,855][INFO ][tcp-disco-srvr-[:47500]-#391%grid-0%-#7814%grid-0%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=43553] [21:04:26] : [Step 4/5] [2021-11-19 21:04:26,855][INFO ][tcp-disco-srvr-[:47500]-#391%grid-0%-#7814%grid-0%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=43553] [21:04:26] : [Step 4/5] [2021-11-19 21:04:26,856][INFO ][tcp-disco-sock-reader-[]-#400%grid-0%-#7936%grid-0%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:43553, rmtPort=43553] [21:04:26] : [Step 4/5] [2021-11-19 21:04:26,857][INFO ][tcp-disco-sock-reader-[10efe27d 127.0.0.1:43553]-#400%grid-0%-#7936%grid-0%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=10efe27d-c048-4848-a965-0bc4cda5b001, rmtAddr=/127.0.0.1:43553] [21:04:26] : [Step 4/5] [2021-11-19 21:04:26,860][INFO ][disco-event-worker-#7816%grid-0%][GridDiscoveryManager] Added new node to topology: TcpDiscoveryNode [id=10efe27d-c048-4848-a965-0bc4cda5b001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637345066820, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false] [21:04:26] : [Step 4/5] [2021-11-19 21:04:26,861][INFO ][disco-event-worker-#7816%grid-0%][GridDiscoveryManager] Topology snapshot [ver=2, locNode=006d8b80, servers=2, clients=0, state=INACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=006d8b80-bb9a-4285-83ea-4efb58686000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=10efe27d-c048-4848-a965-0bc4cda5b001, consistentId=grid-1, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:04:26] : [Step 4/5] [2021-11-19 21:04:26,862][INFO ][disco-event-worker-#7816%grid-0%][GridDiscoveryManager] ^-- Baseline [id=0, size=2, online=2, offline=0] [21:04:26] : [Step 4/5] [2021-11-19 21:04:26,862][INFO ][disco-event-worker-#7816%grid-0%][GridDiscoveryManager] ^-- All baseline nodes are online, will start auto-activation [21:04:26] : [Step 4/5] [2021-11-19 21:04:26,866][INFO ][disco-notifier-worker-#7930%grid-1%][MvccProcessorImpl] Assigned mvcc coordinator [crd=MvccCoordinator [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=0], nodeId=006d8b80-bb9a-4285-83ea-4efb58686000, ver=1637345065964, local=false, initialized=false]] [21:04:26] : [Step 4/5] [2021-11-19 21:04:26,867][INFO ][disco-notifier-worker-#7930%grid-1%][GridClusterStateProcessor] Sending activate cluster request with BaselineTopology BaselineTopology [id=0, branchingHash=-2475315501, branchingType='Cluster activation', baselineNodes=[grid-1, grid-0]] [21:04:26] : [Step 4/5] [2021-11-19 21:04:26,870][INFO ][sys-#7919%grid-1%][ClusterProcessor] Writing cluster ID and tag to metastorage on ready for write ClusterIdAndTag [id=ee6fb329-7b0a-43cc-8e0d-0768a6b4d7c6, tag=dazzling_burnell] [21:04:26] : [Step 4/5] [2021-11-19 21:04:26,871][INFO ][disco-notifier-worker-#7812%grid-0%][GridClusterStateProcessor] Received activate cluster request with BaselineTopology[id=0] initiator node ID: 10efe27d-c048-4848-a965-0bc4cda5b001 [21:04:26] : [Step 4/5] [2021-11-19 21:04:26,872][INFO ][disco-notifier-worker-#7812%grid-0%][GridClusterStateProcessor] Started state transition: activate cluster [21:04:26] : [Step 4/5] [2021-11-19 21:04:26,873][INFO ][disco-notifier-worker-#7930%grid-1%][GridClusterStateProcessor] Received activate cluster request with BaselineTopology[id=0] initiator node ID: 10efe27d-c048-4848-a965-0bc4cda5b001 [21:04:26] : [Step 4/5] [2021-11-19 21:04:26,873][INFO ][exchange-worker-#7817%grid-0%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], crd=true, evt=DISCOVERY_CUSTOM_EVT, evtNode=10efe27d-c048-4848-a965-0bc4cda5b001, customEvt=ChangeGlobalStateMessage [id=2b12d593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqId=38271cae-7053-4556-81fe-29a01999397e, initiatingNodeId=10efe27d-c048-4848-a965-0bc4cda5b001, state=ACTIVE, baselineTopology=BaselineTopology [id=0, branchingHash=-2475315501, branchingType='Cluster activation', baselineNodes=[grid-1, grid-0]], forceChangeBaselineTopology=false, timestamp=1637345066867, forceDeactivation=true], allowMerge=false, exchangeFreeSwitch=false] [21:04:26] : [Step 4/5] [2021-11-19 21:04:26,873][INFO ][disco-notifier-worker-#7930%grid-1%][GridClusterStateProcessor] Started state transition: activate cluster [21:04:26] : [Step 4/5] [2021-11-19 21:04:26,874][INFO ][exchange-worker-#7817%grid-0%][GridDhtPartitionsExchangeFuture] Start activation process [nodeId=006d8b80-bb9a-4285-83ea-4efb58686000, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]]. New state: ACTIVE [21:04:26] : [Step 4/5] [2021-11-19 21:04:26,875][INFO ][exchange-worker-#7817%grid-0%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0 [21:04:26] : [Step 4/5] [2021-11-19 21:04:26,877][INFO ][exchange-worker-#7817%grid-0%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000000.wal, offset=777020, ver=2] [21:04:26] : [Step 4/5] [2021-11-19 21:04:26,878][INFO ][exchange-worker-#7817%grid-0%][GridClusterStateProcessor] Writing BaselineTopology[id=0] [21:04:26] : [Step 4/5] [2021-11-19 21:04:26,881][INFO ][exchange-worker-#7817%grid-0%][GridCacheDatabaseSharedManager] Finish recovery performed in 6 ms. [21:04:26] : [Step 4/5] [2021-11-19 21:04:26,882][INFO ][exchange-worker-#7817%grid-0%][msg] Components activation performed in 7 ms. [21:04:26] : [Step 4/5] [2021-11-19 21:04:26,883][INFO ][exchange-worker-#7817%grid-0%][GridCacheProcessor] Finished recovery for cache [cache=ignite-sys-cache, grp=ignite-sys-cache, startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:04:26] : [Step 4/5] [2021-11-19 21:04:26,884][INFO ][exchange-worker-#7817%grid-0%][GridDhtPartitionsExchangeFuture] Successfully activated caches [nodeId=006d8b80-bb9a-4285-83ea-4efb58686000, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], newState=ACTIVE] [21:04:26] : [Step 4/5] [2021-11-19 21:04:26,884][INFO ][exchange-worker-#7817%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:04:26] : [Step 4/5] [2021-11-19 21:04:26,885][INFO ][exchange-worker-#7942%grid-1%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], crd=false, evt=DISCOVERY_CUSTOM_EVT, evtNode=10efe27d-c048-4848-a965-0bc4cda5b001, customEvt=ChangeGlobalStateMessage [id=2b12d593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqId=38271cae-7053-4556-81fe-29a01999397e, initiatingNodeId=10efe27d-c048-4848-a965-0bc4cda5b001, state=ACTIVE, baselineTopology=BaselineTopology [id=0, branchingHash=-2475315501, branchingType='Cluster activation', baselineNodes=[grid-1, grid-0]], forceChangeBaselineTopology=false, timestamp=1637345066867, forceDeactivation=true], allowMerge=false, exchangeFreeSwitch=false] [21:04:26] : [Step 4/5] [2021-11-19 21:04:26,886][INFO ][exchange-worker-#7942%grid-1%][GridDhtPartitionsExchangeFuture] Start activation process [nodeId=10efe27d-c048-4848-a965-0bc4cda5b001, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]]. New state: ACTIVE [21:04:26] : [Step 4/5] [2021-11-19 21:04:26,886][INFO ][exchange-worker-#7942%grid-1%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1 [21:04:26] : [Step 4/5] [2021-11-19 21:04:26,890][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][IgniteKernal%grid-1] To start Console Management & Monitoring run ignitevisorcmd.{sh|bat} [21:04:26] : [Step 4/5] [2021-11-19 21:04:26,891][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][IgniteKernal%grid-1] [21:04:26] : [Step 4/5] [21:04:26] : [Step 4/5] >>> +-------------------------------------------+ [21:04:26] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:04:26] : [Step 4/5] >>> +-------------------------------------------+ [21:04:26] : [Step 4/5] >>> OS name: Linux 4.15.0-151-generic amd64 [21:04:26] : [Step 4/5] >>> CPU(s): 24 [21:04:26] : [Step 4/5] >>> Heap: 2.0GB [21:04:26] : [Step 4/5] >>> VM name: 16724@c4dfe9a430b2 [21:04:26] : [Step 4/5] >>> Ignite instance name: grid-1 [21:04:26] : [Step 4/5] >>> Local node [ID=10EFE27D-C048-4848-A965-0BC4CDA5B001, order=2, clientMode=false] [21:04:26] : [Step 4/5] >>> Local node addresses: [127.0.0.1] [21:04:26] : [Step 4/5] >>> Local ports: TCP:10801 TCP:45131 TCP:47501 [21:04:26] : [Step 4/5] [21:04:26] : [Step 4/5] [2021-11-19 21:04:26,892][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][GridDiscoveryManager] Topology snapshot [ver=2, locNode=10efe27d, servers=2, clients=0, state=INACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=006d8b80-bb9a-4285-83ea-4efb58686000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=10efe27d-c048-4848-a965-0bc4cda5b001, consistentId=grid-1, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:04:26] : [Step 4/5] [2021-11-19 21:04:26,893][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][GridDiscoveryManager] ^-- Baseline [id=0, size=2, online=2, offline=0] [21:04:26] : [Step 4/5] [2021-11-19 21:04:26,893][INFO ][exchange-worker-#7942%grid-1%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000000.wal, offset=661953, ver=2] [21:04:26] : [Step 4/5] [2021-11-19 21:04:26,894][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][GridDiscoveryManager] ^-- All baseline nodes are online, will start auto-activation [21:04:26] : [Step 4/5] [2021-11-19 21:04:26,895][INFO ][exchange-worker-#7942%grid-1%][GridClusterStateProcessor] Writing BaselineTopology[id=0] [21:04:26] : [Step 4/5] [2021-11-19 21:04:26,895][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][G] Node started : [stage="Configure system pool" (0 ms),stage="Start managers" (191 ms),stage="Configure binary metadata" (1 ms),stage="Start processors" (22 ms),stage="Start 'StanByClusterTestProvider' plugin" (0 ms),stage="Start 'PageMemory tracker plugin' plugin" (0 ms),stage="Start 'TestDistibutedConfigurationPlugin' plugin" (0 ms),stage="Start 'NodeValidationPluginProvider' plugin" (0 ms),stage="Init metastore" (383 ms),stage="Init and start regions" (7 ms),stage="Restore binary memory" (134 ms),stage="Restore logical state" (75 ms),stage="Finish recovery" (0 ms),stage="Join topology" (51 ms),stage="Await transition" (5 ms),stage="Await exchange" (24 ms),stage="Total time" (893 ms)] [21:04:26] : [Step 4/5] [2021-11-19 21:04:26,896][INFO ][exchange-worker-#7817%grid-0%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], crd=true] [21:04:26] : [Step 4/5] [2021-11-19 21:04:26,898][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][root] Node started with the following configuration [id=10efe27d-c048-4848-a965-0bc4cda5b001, marshaller=BinaryMarshaller [], discovery=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=5000, ackTimeout=5000, marsh=JdkMarshaller [clsFilter=org.apache.ignite.marshaller.MarshallerUtils$1@78c0027a], reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], binaryCfg=null, lateAff=true] [21:04:26] : [Step 4/5] [2021-11-19 21:04:26,899][INFO ][db-checkpoint-thread-#7944%grid-0%][Checkpointer] Checkpoint started [checkpointId=808f4c84-74f5-41a0-9938-1e06c87f542e, startPtr=WALPointer [idx=0, fileOff=860144, len=1963], checkpointBeforeLockTime=2ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=1ms, writeCheckpointEntryDuration=2ms, splitAndSortCpPagesDuration=0ms, pages=15, reason='node started'] [21:04:26] : [Step 4/5] [2021-11-19 21:04:26,900][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][GridClusterStateProcessor] Sending activate cluster request with BaselineTopology BaselineTopology [id=0, branchingHash=-2475315501, branchingType='Cluster activation', baselineNodes=[grid-1, grid-0]] [21:04:26] : [Step 4/5] [2021-11-19 21:04:26,902][INFO ][disco-notifier-worker-#7812%grid-0%][GridClusterStateProcessor] Received activate cluster request with BaselineTopology[id=0] initiator node ID: 006d8b80-bb9a-4285-83ea-4efb58686000 [21:04:26] : [Step 4/5] [2021-11-19 21:04:26,903][INFO ][disco-notifier-worker-#7930%grid-1%][GridClusterStateProcessor] Received activate cluster request with BaselineTopology[id=0] initiator node ID: 006d8b80-bb9a-4285-83ea-4efb58686000 [21:04:26] : [Step 4/5] [2021-11-19 21:04:26,907][INFO ][exchange-worker-#7942%grid-1%][GridCacheDatabaseSharedManager] Finish recovery performed in 17 ms. [21:04:26] : [Step 4/5] [2021-11-19 21:04:26,909][INFO ][exchange-worker-#7942%grid-1%][msg] Components activation performed in 23 ms. [21:04:26] : [Step 4/5] [2021-11-19 21:04:26,910][INFO ][exchange-worker-#7942%grid-1%][GridCacheProcessor] Finished recovery for cache [cache=ignite-sys-cache, grp=ignite-sys-cache, startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:04:26] : [Step 4/5] [2021-11-19 21:04:26,910][INFO ][exchange-worker-#7942%grid-1%][GridDhtPartitionsExchangeFuture] Successfully activated caches [nodeId=10efe27d-c048-4848-a965-0bc4cda5b001, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], newState=ACTIVE] [21:04:26] : [Step 4/5] [2021-11-19 21:04:26,911][INFO ][exchange-worker-#7942%grid-1%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:04:26] : [Step 4/5] [2021-11-19 21:04:26,915][INFO ][grid-nio-worker-tcp-comm-0-#7756%TcpCommunicationSpi%][TcpCommunicationSpi] Accepted incoming communication connection [locAddr=/127.0.0.1:45130, rmtAddr=/127.0.0.1:35392] [21:04:26] : [Step 4/5] [2021-11-19 21:04:26,916][INFO ][db-checkpoint-thread-#7944%grid-0%][Checkpointer] Checkpoint finished [cpId=808f4c84-74f5-41a0-9938-1e06c87f542e, pages=15, markPos=WALPointer [idx=0, fileOff=860144, len=1963], walSegmentsCovered=[], markDuration=5ms, pagesWrite=3ms, fsync=13ms, total=23ms] [21:04:26] : [Step 4/5] [2021-11-19 21:04:26,917][INFO ][grid-nio-worker-tcp-comm-0-#7874%TcpCommunicationSpi%][TcpCommunicationSpi] Established outgoing communication connection [locAddr=/127.0.0.1:35392, rmtAddr=/127.0.0.1:45130] [21:04:26] : [Step 4/5] [2021-11-19 21:04:26,918][INFO ][exchange-worker-#7942%grid-1%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], crd=false] [21:04:26] : [Step 4/5] [2021-11-19 21:04:26,919][INFO ][sys-#7805%grid-0%][GridDhtPartitionsExchangeFuture] Coordinator received single message [ver=AffinityTopologyVersion [topVer=2, minorTopVer=1], node=10efe27d-c048-4848-a965-0bc4cda5b001, allReceived=true] [21:04:26] : [Step 4/5] [2021-11-19 21:04:26,920][INFO ][sys-#7805%grid-0%][GridDhtPartitionsExchangeFuture] finishExchangeOnCoordinator [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:04:26] : [Step 4/5] [2021-11-19 21:04:26,924][INFO ][db-checkpoint-thread-#7957%grid-1%][Checkpointer] Checkpoint started [checkpointId=d2465fcf-14e5-42ea-92fa-2177e027c155, startPtr=WALPointer [idx=0, fileOff=745077, len=1963], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=1ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=2ms, writeCheckpointEntryDuration=9ms, splitAndSortCpPagesDuration=0ms, pages=15, reason='node started'] [21:04:26] : [Step 4/5] [2021-11-19 21:04:26,925][INFO ][disco-notifier-worker-#7812%grid-0%][GridClusterStateProcessor] Received state change finish message: ACTIVE [21:04:26] : [Step 4/5] [2021-11-19 21:04:26,925][INFO ][disco-notifier-worker-#7812%grid-0%][GridClusterStateProcessor] Cluster state was changed from INACTIVE to ACTIVE [21:04:26] : [Step 4/5] [2021-11-19 21:04:26,925][INFO ][sys-#7805%grid-0%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], err=null, rebalanced=true, wasRebalanced=false] [21:04:26] : [Step 4/5] [2021-11-19 21:04:26,926][INFO ][disco-notifier-worker-#7930%grid-1%][GridClusterStateProcessor] Received state change finish message: ACTIVE [21:04:26] : [Step 4/5] [2021-11-19 21:04:26,926][INFO ][sys-#7922%grid-1%][GridDhtPartitionsExchangeFuture] Received full message, will finish exchange [node=006d8b80-bb9a-4285-83ea-4efb58686000, resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:04:26] : [Step 4/5] [2021-11-19 21:04:26,928][INFO ][disco-notifier-worker-#7930%grid-1%][GridClusterStateProcessor] Cluster state was changed from INACTIVE to ACTIVE [21:04:26] : [Step 4/5] [2021-11-19 21:04:26,929][INFO ][sys-#7906%grid-1%][GridCachePartitionExchangeManager] Delay process full message without exchange id (there is exchange in progress) [nodeId=006d8b80-bb9a-4285-83ea-4efb58686000] [21:04:26] : [Step 4/5] [2021-11-19 21:04:26,929][INFO ][sys-#7922%grid-1%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], err=null, rebalanced=true, wasRebalanced=false] [21:04:26] : [Step 4/5] [2021-11-19 21:04:26,929][INFO ][sys-#7805%grid-0%][GridCacheProcessor] Finish proxy initialization, cacheName=ignite-sys-cache, localNodeId=006d8b80-bb9a-4285-83ea-4efb58686000 [21:04:26] : [Step 4/5] [2021-11-19 21:04:26,931][INFO ][sys-#7810%grid-0%][DistributedBaselineConfiguration] Baseline auto-adjust is 'disabled' with timeout='300000' ms [21:04:26] : [Step 4/5] [2021-11-19 21:04:26,932][INFO ][sys-#7805%grid-0%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=006d8b80-bb9a-4285-83ea-4efb58686000, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=10efe27d-c048-4848-a965-0bc4cda5b001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637345066820, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:04:26] : [Step 4/5] [2021-11-19 21:04:26,931][INFO ][exchange-worker-#7817%grid-0%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=2, minorTopVer=1], force=false, evt=DISCOVERY_CUSTOM_EVT, node=10efe27d-c048-4848-a965-0bc4cda5b001] [21:04:26] : [Step 4/5] [2021-11-19 21:04:26,931][INFO ][sys-#7922%grid-1%][GridCacheProcessor] Finish proxy initialization, cacheName=ignite-sys-cache, localNodeId=10efe27d-c048-4848-a965-0bc4cda5b001 [21:04:26] : [Step 4/5] [2021-11-19 21:04:26,933][INFO ][sys-#7805%grid-0%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (1 ms), stage="Update caches registry" (8 ms), stage="Start caches" (0 ms), stage="Affinity initialization on cache group start" (0 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Restore partition states" (0 ms), stage="After states restored callback" (10 ms), stage="WAL history reservation" (0 ms), stage="Waiting for all single messages" (24 ms), stage="Affinity recalculation (crd)" (0 ms), stage="Collect update counters and create affinity messages" (0 ms), stage="Assign partitions states" (0 ms), stage="Validate partitions states" (0 ms), stage="Ideal affinity diff calculation (enforced)" (0 ms), stage="Apply update counters" (0 ms), stage="Full message preparing" (2 ms), stage="Full message sending" (0 ms), stage="State finish message sending" (0 ms), stage="Detect lost partitions" (3 ms), stage="Exchange done" (4 ms), stage="Total time" (52 ms), Discovery lag=2 ms, Latest started node id=10efe27d-c048-4848-a965-0bc4cda5b001] [21:04:26] : [Step 4/5] [2021-11-19 21:04:26,932][INFO ][sys-#7810%grid-0%][GridClusterStateProcessor] Successfully performed final activation steps [nodeId=006d8b80-bb9a-4285-83ea-4efb58686000, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:04:26] : [Step 4/5] [2021-11-19 21:04:26,936][INFO ][sys-#7805%grid-0%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], stage="Affinity initialization on cache group start [grp=ignite-sys-cache]" (0 ms) (parent=Affinity initialization on cache group start), stage="Affinity centralized initialization (crd) [grp=ignite-sys-cache, crd=true]" (0 ms) (parent=Determine exchange type), stage="Restore partition states [grp=ignite-sys-cache]" (0 ms) (parent=Restore partition states), stage="Affinity recalculation (partitions availability) [grp=ignite-sys-cache]" (0 ms) (parent=Ideal affinity diff calculation (enforced))] [21:04:26] : [Step 4/5] [2021-11-19 21:04:26,935][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][root] awaitPartitionMapExchange finished [21:04:26] : [Step 4/5] [2021-11-19 21:04:26,934][INFO ][sys-#7922%grid-1%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=10efe27d-c048-4848-a965-0bc4cda5b001, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=10efe27d-c048-4848-a965-0bc4cda5b001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637345066921, loc=true, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:04:26] : [Step 4/5] [2021-11-19 21:04:26,938][INFO ][sys-#7922%grid-1%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], stage="Waiting in exchange queue" (9 ms), stage="Exchange parameters initialization" (1 ms), stage="Update caches registry" (23 ms), stage="Start caches" (0 ms), stage="Affinity initialization on cache group start" (0 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Restore partition states" (0 ms), stage="After states restored callback" (1 ms), stage="WAL history reservation" (0 ms), stage="Waiting for Full message" (13 ms), stage="Affinity recalculation" (1 ms), stage="Full map updating" (1 ms), stage="Detect lost partitions" (1 ms), stage="Exchange done" (7 ms), stage="Total time" (57 ms)] [21:04:26] : [Step 4/5] [2021-11-19 21:04:26,934][INFO ][exchange-worker-#7942%grid-1%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=2, minorTopVer=1], force=false, evt=DISCOVERY_CUSTOM_EVT, node=10efe27d-c048-4848-a965-0bc4cda5b001] [21:04:26] : [Step 4/5] [2021-11-19 21:04:26,934][INFO ][sys-#7911%grid-1%][DistributedBaselineConfiguration] Baseline auto-adjust is 'disabled' with timeout='300000' ms [21:04:26] : [Step 4/5] [2021-11-19 21:04:26,940][INFO ][sys-#7911%grid-1%][GridClusterStateProcessor] Successfully performed final activation steps [nodeId=10efe27d-c048-4848-a965-0bc4cda5b001, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:04:26] : [Step 4/5] [2021-11-19 21:04:26,940][INFO ][sys-#7922%grid-1%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], stage="Affinity initialization on cache group start [grp=ignite-sys-cache]" (0 ms) (parent=Affinity initialization on cache group start), stage="Affinity centralized initialization (crd) [grp=ignite-sys-cache, crd=false]" (0 ms) (parent=Determine exchange type), stage="Restore partition states [grp=ignite-sys-cache]" (0 ms) (parent=Restore partition states), stage="Affinity applying from full message [grp=ignite-sys-cache]" (1 ms) (parent=Affinity recalculation)] [21:04:26] : [Step 4/5] [2021-11-19 21:04:26,938][INFO ][test-runner-#7428%encryption.EncryptedCacheDestroyTest%][root] awaitPartitionMapExchange finished [21:04:26] : [Step 4/5] [2021-11-19 21:04:26,941][INFO ][db-checkpoint-thread-#7957%grid-1%][Checkpointer] Checkpoint f[21inished [cpId=d2465fcf-14e5-42ea-92fa-2177e027c:04:26] >>> Stopping test: EncryptedCacheDestroyTest#testEncryptedCacheDestroy in 9513 ms <<< [21:04:26] : [Step 4/5] 155, pages=15, markPos=WALPointer [idx=0, fileOff=745077, len=1963], walSegmentsCovered=[], markDuration=13ms, pagesWrite=2ms, fsync=14ms, total=29ms] [21:04:26] : [Step 4/5] [2021-11-19 21:04:26,942][INFO ][main][root] >>> Stopping test: EncryptedCacheDestroyTest#testEncryptedCacheDestroy in 9513 ms <<< [21:04:26] : [Step 4/5] [21:04:26] >>> Heap: 349 MB used / 1941 MB commited / 1941 MB max <<< [21:04:26] : [Step 4/5] [2021-11-19 21:04:26,943][INFO ][main][root] >>> Heap: 349 MB used / 1941 MB commited / 1941 MB max <<< [21:04:26] : [Step 4/5] [21:04:26] >>> Non-Heap: 137 MB used / 148 MB commited / 0 MB max <<< [21:04:26] : [Step 4/5] [2021-11-19 21:04:26,943][INFO ][main][root] >>> Non-Heap: 137 MB used / 148 MB commited / 0 MB max <<< [21:04:26] : [Step 4/5] [2021-11-19 21:04:26,944][INFO ][main][root] >>> Stopping grid [name=grid-1, id=10efe27d-c048-4848-a965-0bc4cda5b001] [21:04:26] : [Step 4/5] [2021-11-19 21:04:26,948][INFO ][db-checkpoint-thread-#7957%grid-1%][Checkpointer] Skipping checkpoint (no pages were modified) [checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, reason='timeout'] [21:04:26] : [Step 4/5] [2021-11-19 21:04:26,953][INFO ][tcp-disco-sock-reader-[006d8b80 127.0.0.1:37219]-#399%grid-1%-#7935%grid-1%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:37219, rmtPort=37219, rmtNodeId=006d8b80-bb9a-4285-83ea-4efb58686000] [21:04:26] : [Step 4/5] [2021-11-19 21:04:26,954][INFO ][disco-event-worker-#7816%grid-0%][GridDiscoveryManager] Node left topology: TcpDiscoveryNode [id=10efe27d-c048-4848-a965-0bc4cda5b001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637345066820, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false] [21:04:26] : [Step 4/5] [2021-11-19 21:04:26,955][INFO ][main][GridCacheProcessor] Stopped cache [cacheName=ignite-sys-cache] [21:04:26] : [Step 4/5] [2021-11-19 21:04:26,955][INFO ][disco-event-worker-#7816%grid-0%][GridDiscoveryManager] Topology snapshot [ver=3, locNode=006d8b80, servers=1, clients=0, state=ACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=006d8b80-bb9a-4285-83ea-4efb58686000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:04:26] : [Step 4/5] [2021-11-19 21:04:26,957][INFO ][disco-event-worker-#7816%grid-0%][GridDiscoveryManager] ^-- Baseline [id=0, size=2, online=1, offline=1] [21:04:26] : [Step 4/5] [2021-11-19 21:04:26,957][INFO ][main][FilePageStoreManager] Cleanup cache stores [total=3, left=0, cleanFiles=false] [21:04:26] : [Step 4/5] [2021-11-19 21:04:26,959][INFO ][main][GridDeploymentLocalStore] Removed undeployed class: GridDeployment [ts=1637345066921, depMode=SHARED, clsLdr=IsolatedClassLoader{roleName='test'}, clsLdrId=ee12d593d71-10efe27d-c048-4848-a965-0bc4cda5b001, userVer=0, loc=true, sampleClsName=org.apache.ignite.internal.processors.cache.distributed.dht.preloader.IgniteDhtPartitionCountersMap2, pendingUndeploy=false, undeployed=true, usage=0] [21:04:26] : [Step 4/5] [2021-11-19 21:04:26,960][INFO ][exchange-worker-#7817%grid-0%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], crd=true, evt=NODE_LEFT, evtNode=10efe27d-c048-4848-a965-0bc4cda5b001, customEvt=null, allowMerge=false, exchangeFreeSwitch=true] [21:04:26] : [Step 4/5] [2021-11-19 21:04:26,962][INFO ][exchange-worker-#7817%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:04:26] : [Step 4/5] [2021-11-19 21:04:26,963][INFO ][exchange-worker-#7817%grid-0%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], err=null, rebalanced=true, wasRebalanced=true] [21:04:26] : [Step 4/5] [2021-11-19 21:04:26,965][INFO ][main][IgniteKernal%grid-1] [21:04:26] : [Step 4/5] [21:04:26] : [Step 4/5] >>> +------------------------------------------------------+ [21:04:26] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV stopped OK [21:04:26] : [Step 4/5] >>> +------------------------------------------------------+ [21:04:26] : [Step 4/5] >>> Ignite instance name: grid-1 [21:04:26] : [Step 4/5] >>> Grid uptime: 00:00:00.081 [21:04:26] : [Step 4/5] [21:04:26] : [Step 4/5] [21:04:26] : [Step 4/5] [2021-11-19 21:04:26,966][INFO ][main][root] >>> Stopping grid [name=grid-0, id=006d8b80-bb9a-4285-83ea-4efb58686000] [21:04:26] : [Step 4/5] [2021-11-19 21:04:26,969][INFO ][exchange-worker-#7817%grid-0%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=006d8b80-bb9a-4285-83ea-4efb58686000, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], evt=NODE_LEFT, evtNode=TcpDiscoveryNode [id=10efe27d-c048-4848-a965-0bc4cda5b001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637345066820, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0]] [21:04:26] : [Step 4/5] [2021-11-19 21:04:26,970][INFO ][exchange-worker-#7817%grid-0%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (1 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="After states restored callback" (0 ms), stage="WAL history reservation" (0 ms), stage="Finalize update counters" (0 ms), stage="Detect lost partitions" (6 ms), stage="Exchange done" (1 ms), stage="Total time" (8 ms)] [21:04:26] : [Step 4/5] [2021-11-19 21:04:26,971][INFO ][exchange-worker-#7817%grid-0%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], stage="Affinity initialization (exchange-free switch on fully-rebalanced topology) [grp=ignite-sys-cache]" (0 ms) (parent=Determine exchange type)] [21:04:26] : [Step 4/5] [2021-11-19 21:04:26,971][INFO ][exchange-worker-#7817%grid-0%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], crd=true] [21:04:26] : [Step 4/5] [2021-11-19 21:04:26,972][INFO ][exchange-worker-#7817%grid-0%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=3, minorTopVer=0], force=false, evt=NODE_LEFT, node=10efe27d-c048-4848-a965-0bc4cda5b001] [21:04:26] : [Step 4/5] [2021-11-19 21:04:26,974][INFO ][db-checkpoint-thread-#7944%grid-0%][Checkpointer] Skipping checkpoint (no pages were modified) [checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=1ms, checkpointLockHoldTime=1ms, reason='timeout'] [21:04:26] : [Step 4/5] [2021-11-19 21:04:26,977][INFO ][tcp-disco-sock-reader-[10efe27d 127.0.0.1:43553]-#400%grid-0%-#7936%grid-0%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:43553, rmtPort=43553, rmtNodeId=10efe27d-c048-4848-a965-0bc4cda5b001] [21:04:26] : [Step 4/5] [2021-11-19 21:04:26,979][INFO ][main][GridCacheProcessor] Stopped cache [cacheName=ignite-sys-cache] [21:04:26] : [Step 4/5] [2021-11-19 21:04:26,983][INFO ][main][FilePageStoreManager] Cleanup cache stores [total=3, left=0, cleanFiles=false] [21:04:26] : [Step 4/5] [2021-11-19 21:04:26,985][INFO ][main][GridDeploymentLocalStore] Removed undeployed class: GridDeployment [ts=1637345066911, depMode=SHARED, clsLdr=IsolatedClassLoader{roleName='test'}, clsLdrId=ce12d593d71-006d8b80-bb9a-4285-83ea-4efb58686000, userVer=0, loc=true, sampleClsName=org.apache.ignite.internal.processors.cache.distributed.dht.preloader.GridDhtPartitionMap, pendingUndeploy=false, undeployed=true, usage=0] [21:04:26] : [Step 4/5] [2021-11-19 21:04:26,995][INFO ][main][IgniteKernal%grid-0] [21:04:26] : [Step 4/5] [21:04:26] : [Step 4/5] >>> +------------------------------------------------------+ [21:04:26] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV stopped OK [21:04:26] : [Step 4/5] >>> +------------------------------------------------------+ [21:04:26] : [Step 4/5] >>> Ignite instance name: grid-0 [21:04:26] : [Step 4/5] >>> Grid uptime: 00:00:01.010 [21:04:26] : [Step 4/5] [21:04:26] : [Step 4/5] [21:04:27] : [Step 4/5] [21:04:27] >>> Stopping test class: EncryptedCacheDestroyTest <<< [21:04:27] : [Step 4/5] [2021-11-19 21:04:27,252][INFO ][main][root] >>> Stopping test class: EncryptedCacheDestroyTest <<< [21:04:27] : [Step 4/5] [21:04:27] >>> Starting test class: EncryptedCacheGroupCreateTest <<< [21:04:27] : [Step 4/5] [2021-11-19 21:04:27,252][INFO ][main][root] >>> Starting test class: EncryptedCacheGroupCreateTest <<< [21:04:27]W: [org.apache.ignite:ignite-core] [2021-11-19 21:04:27,269][WARN ][main][G] Ignite work directory is not provided, automatically resolved to: /opt/buildagent/work/7bc1c54bc719b67c/work [21:04:27] : [Step 4/5] [2021-11-19 21:04:27,270][INFO ][main][EncryptedCacheGroupCreateTest0] [21:04:27] : [Step 4/5] [21:04:27] : [Step 4/5] >>> __________ ________________ [21:04:27] : [Step 4/5] >>> / _/ ___/ |/ / _/_ __/ __/ [21:04:27] : [Step 4/5] >>> _/ // (7 7 // / / / / _/ [21:04:27] : [Step 4/5] >>> /___/\___/_/|_/___/ /_/ /___/ [21:04:27] : [Step 4/5] >>> [21:04:27] : [Step 4/5] >>> ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:04:27] : [Step 4/5] >>> 2021 Copyright(C) Apache Software Foundation [21:04:27] : [Step 4/5] >>> [21:04:27] : [Step 4/5] >>> Ignite documentation: http://ignite.apache.org [21:04:27] : [Step 4/5] [21:04:27] : [Step 4/5] [2021-11-19 21:04:27,271][INFO ][main][EncryptedCacheGroupCreateTest0] Config URL: n/a [21:04:27] : [Step 4/5] [2021-11-19 21:04:27,271][INFO ][main][EncryptedCacheGroupCreateTest0] IgniteConfiguration [igniteInstanceName=encryption.EncryptedCacheGroupCreateTest0, pubPoolSize=24, svcPoolSize=24, callbackPoolSize=24, stripedPoolSize=24, sysPoolSize=24, mgmtPoolSize=4, dataStreamerPoolSize=24, utilityCachePoolSize=24, utilityCacheKeepAliveTime=60000, p2pPoolSize=2, qryPoolSize=24, buildIdxPoolSize=4, igniteHome=/opt/buildagent/work/7bc1c54bc719b67c, igniteWorkDir=/opt/buildagent/work/7bc1c54bc719b67c/work, mbeanSrv=com.sun.jmx.mbeanserver.JmxMBeanServer@6fe85038, nodeId=832cfe93-7cf8-4ee5-9a59-6dc363c00000, marsh=BinaryMarshaller [], marshLocJobs=false, daemon=false, p2pEnabled=true, netTimeout=10000, netCompressionLevel=1, sndRetryDelay=1000, sndRetryCnt=3, metricsHistSize=10000, metricsUpdateFreq=1000, metricsExpTime=9223372036854775807, discoSpi=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=0, ackTimeout=0, marsh=null, reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], segPlc=STOP, segResolveAttempts=2, waitForSegOnStart=true, allResolversPassReq=true, segChkFreq=10000, commSpi=TcpCommunicationSpi [connectGate=org.apache.ignite.spi.communication.tcp.internal.ConnectGateway@715fa8c5, ctxInitLatch=java.util.concurrent.CountDownLatch@644a3add[Count = 1], stopping=false, clientPool=null, nioSrvWrapper=null, stateProvider=null], evtSpi=MemoryEventStorageSpi [expireAgeMs=9223372036854775807, expireCnt=10000, filter=null], colSpi=NoopCollisionSpi [], deploySpi=LocalDeploymentSpi [], indexingSpi=org.apache.ignite.spi.indexing.noop.NoopIndexingSpi@7fd99443, addrRslvr=null, encryptionSpi=org.apache.ignite.spi.encryption.keystore.KeystoreEncryptionSpi@622d7e4, tracingSpi=org.apache.ignite.spi.tracing.NoopTracingSpi@6a3fbcb1, clientMode=false, rebalanceThreadPoolSize=4, rebalanceTimeout=10000, rebalanceBatchesPrefetchCnt=3, rebalanceThrottle=0, rebalanceBatchSize=524288, txCfg=TransactionConfiguration [txSerEnabled=false, dfltIsolation=REPEATABLE_READ, dfltConcurrency=PESSIMISTIC, dfltTxTimeout=0, txTimeoutOnPartitionMapExchange=0, deadlockTimeout=10000, pessimisticTxLogSize=0, pessimisticTxLogLinger=10000, tmLookupClsName=null, txManagerFactory=null, useJtaSync=false], cacheSanityCheckEnabled=true, discoStartupDelay=60000, deployMode=SHARED, p2pMissedCacheSize=100, locHost=127.0.0.1, timeSrvPortBase=31100, timeSrvPortRange=100, failureDetectionTimeout=10000, sysWorkerBlockedTimeout=null, clientFailureDetectionTimeout=10000, metricsLogFreq=0, connectorCfg=null, odbcCfg=null, warmupClos=null, atomicCfg=AtomicConfiguration [seqReserveSize=1000, cacheMode=PARTITIONED, backups=1, aff=null, grpName=null], classLdr=null, sslCtxFactory=null, platformCfg=null, binaryCfg=null, memCfg=null, pstCfg=null, dsCfg=DataStorageConfiguration [sysRegionInitSize=41943040, sysRegionMaxSize=104857600, pageSize=4096, concLvl=0, dfltDataRegConf=DataRegionConfiguration [name=default, maxSize=10485760, initSize=268435456, swapPath=null, pageEvictionMode=DISABLED, pageReplacementMode=CLOCK, evictionThreshold=0.9, emptyPagesPoolSize=100, metricsEnabled=false, metricsSubIntervalCount=5, metricsRateTimeInterval=60000, persistenceEnabled=true, checkpointPageBufSize=0, lazyMemoryAllocation=true, warmUpCfg=null], dataRegions=null, storagePath=null, checkpointFreq=180000, lockWaitTime=10000, checkpointThreads=4, checkpointWriteOrder=SEQUENTIAL, walHistSize=20, maxWalArchiveSize=1073741824, walSegments=10, walSegmentSize=67108864, walPath=db/wal, walArchivePath=db/wal/archive, cdcWalPath=db/wal/cdc, cdcEnabled=false, metricsEnabled=false, walMode=FSYNC, walTlbSize=131072, walBuffSize=0, walFlushFreq=2000, walFsyncDelay=1000, walRecordIterBuffSize=67108864, alwaysWriteFullPages=false, fileIOFactory=org.apache.ignite.internal.processors.cache.persistence.file.AsyncFileIOFactory@1310fcb0, metricsSubIntervalCnt=5, metricsRateTimeInterval=60000, walAutoArchiveAfterInactivity=-1, walForceArchiveTimeout=-1, writeThrottlingEnabled=false, walCompactionEnabled=false, walCompactionLevel=1, checkpointReadLockTimeout=null, walPageCompression=DISABLED, walPageCompressionLevel=null, dfltWarmUpCfg=null, encCfg=org.apache.ignite.configuration.EncryptionConfiguration@1ef31f71, defragmentationThreadPoolSize=4, minWalArchiveSize=-1], snapshotPath=snapshots, activeOnStart=true, activeOnStartPropSetFlag=false, autoActivation=true, autoActivationPropSetFlag=false, clusterStateOnStart=null, sqlConnCfg=null, cliConnCfg=ClientConnectorConfiguration [host=null, port=10800, portRange=100, sockSndBufSize=0, sockRcvBufSize=0, tcpNoDelay=true, maxOpenCursorsPerConn=128, threadPoolSize=24, selectorCnt=12, idleTimeout=0, handshakeTimeout=10000, jdbcEnabled=true, odbcEnabled=true, thinCliEnabled=true, sslEnabled=false, useIgniteSslCtxFactory=true, sslClientAuth=false, sslCtxFactory=null, thinCliCfg=ThinClientConfiguration [maxActiveTxPerConn=100, maxActiveComputeTasksPerConn=0]], mvccVacuumThreadCnt=2, mvccVacuumFreq=5000, authEnabled=false, failureHnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]], commFailureRslvr=null, sqlCfg=SqlConfiguration [longQryWarnTimeout=3000, dfltQryTimeout=0, sqlQryHistSize=1000, validationEnabled=false], asyncContinuationExecutor=null] [21:04:27] : [Step 4/5] [2021-11-19 21:04:27,278][INFO ][main][EncryptedCacheGroupCreateTest0] Daemon mode: off [21:04:27] : [Step 4/5] [2021-11-19 21:04:27,279][INFO ][main][EncryptedCacheGroupCreateTest0] OS: Linux 4.15.0-151-generic amd64 [21:04:27] : [Step 4/5] [2021-11-19 21:04:27,279][INFO ][main][EncryptedCacheGroupCreateTest0] OS user: teamcity [21:04:27] : [Step 4/5] [2021-11-19 21:04:27,279][INFO ][main][EncryptedCacheGroupCreateTest0] PID: 16724 [21:04:27] : [Step 4/5] [2021-11-19 21:04:27,279][INFO ][main][EncryptedCacheGroupCreateTest0] Language runtime: Java Platform API Specification ver. 1.8 [21:04:27] : [Step 4/5] [2021-11-19 21:04:27,279][INFO ][main][EncryptedCacheGroupCreateTest0] VM information: Java(TM) SE Runtime Environment 1.8.0_261-b12 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 25.261-b12 [21:04:27] : [Step 4/5] [2021-11-19 21:04:27,280][INFO ][main][EncryptedCacheGroupCreateTest0] VM total memory: 1.9GB [21:04:27] : [Step 4/5] [2021-11-19 21:04:27,280][INFO ][main][EncryptedCacheGroupCreateTest0] Remote Management [restart: off, REST: off, JMX (remote: off)] [21:04:27] : [Step 4/5] [2021-11-19 21:04:27,280][INFO ][main][EncryptedCacheGroupCreateTest0] Logger: GridTestLog4jLogger [quiet=false, config=null] [21:04:27] : [Step 4/5] [2021-11-19 21:04:27,280][INFO ][main][EncryptedCacheGroupCreateTest0] IGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c [21:04:27] : [Step 4/5] [2021-11-19 21:04:27,280][INFO ][main][EncryptedCacheGroupCreateTest0] VM arguments: [-DIGNITE_DUMP_THREADS_ON_FAILURE=false, -DMono=/usr/bin/mono-sgen, -DMono4.0_x64=/usr/lib/mono/4.0, -DMono4.5_x64=/usr/lib/mono/4.5, -DMonoVersion=6.12.0.90, -DSKIP_BUILD=false, -Dagent.home.dir=/opt/buildagent, -Dagent.name=aitc-lin02_03, -Dagent.ownPort=9090, -Dagent.work.dir=/opt/buildagent/work, -Dbuild.number=95, -Dbuild.vcs.number=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.1=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.GitHubApacheIgnite=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dclassworlds.conf=/opt/buildagent/temp/buildTmp/teamcity.m2.conf, -Dcom.jetbrains.maven.watcher.report.file=/opt/buildagent/temp/buildTmp/maven-build-info.xml, -Djava.io.tmpdir=/opt/buildagent/temp/buildTmp, -Dmaven.home=/opt/buildagent/tools/maven3_6, -Dmaven.multiModuleProjectDirectory=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.agent.cpuBenchmark=457, -Dteamcity.agent.dotnet.agent_url=http://localhost:9090/RPC2, -Dteamcity.agent.dotnet.build_id=6278078, -Dteamcity.auth.password=*******, -Dteamcity.auth.userId=TeamCityBuildId=6278078, -Dteamcity.build.changedFiles.file=/opt/buildagent/temp/buildTmp/changedFiles6342607772318147725.txt, -Dteamcity.build.checkoutDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.build.id=6278078, -Dteamcity.build.properties.file=/opt/buildagent/temp/buildTmp/teamcity.build5164517880467851002.properties, -Dteamcity.build.tempDir=/opt/buildagent/temp/buildTmp, -Dteamcity.build.workingDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.buildConfName=Basic 3, -Dteamcity.buildType.id=IgniteTests24Java8_Basic3, -Dteamcity.configuration.properties.file=/opt/buildagent/temp/buildTmp/teamcity.config5591980786735343870.properties, -Dteamcity.maven.userSettings.path=/opt/buildagent/temp/buildTmp/maven_settings_585072866407032347.xml, -Dteamcity.maven.watcher.home=/opt/buildagent/plugins/mavenPlugin/maven-watcher-jdk16, -Dteamcity.projectName=Ignite Tests 2.x (JDK 8/11), -Dteamcity.runner.properties.file=/opt/buildagent/temp/buildTmp/teamcity.runner9098465561618137420.properties, -Dteamcity.tests.recentlyFailedTests.file=/opt/buildagent/temp/buildTmp/testsToRunFirst3891775683130404069.txt, -Dteamcity.version=2021.2 (build 99542), -ea, -Xms2g, -Xmx2g, -XX:+HeapDumpOnOutOfMemoryError, -DIGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_TEST_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_UPDATE_NOTIFIER=false, -DIGNITE_NO_DISCO_ORDER=true, -DIGNITE_PERFORMANCE_SUGGESTIONS_DISABLED=true, -Djava.net.preferIPv4Stack=true, -DTEST_SCALE_FACTOR=1.0, -DIGNITE_TEST_PROP_LOG4J_FILE=log4j-tc-test.xml, -DIGNITE_QUIET=false, -DIGNITE_MARSHAL_BUFFERS_RECHECK=1000, -Dmaven.repo.local=/opt/buildagent/.m2/repository] [21:04:27] : [Step 4/5] [2021-11-19 21:04:27,284][INFO ][main][EncryptedCacheGroupCreateTest0] System cache's DataRegion size is configured to 40 MB. Use DataStorageConfiguration.systemRegionInitialSize property to change the setting. [21:04:27] : [Step 4/5] [2021-11-19 21:04:27,284][INFO ][main][EncryptedCacheGroupCreateTest0] Configured caches [in 'sysMemPlc' dataRegion: ['ignite-sys-cache']] [21:04:27]W: [org.apache.ignite:ignite-core] [2021-11-19 21:04:27,285][WARN ][main][EncryptedCacheGroupCreateTest0] Peer class loading is enabled (disable it in production for performance and deployment consistency reasons) [21:04:27] : [Step 4/5] [2021-11-19 21:04:27,285][INFO ][main][EncryptedCacheGroupCreateTest0] 3-rd party licenses can be found at: /opt/buildagent/work/7bc1c54bc719b67c/libs/licenses [21:04:27] : [Step 4/5] [2021-11-19 21:04:27,288][INFO ][main][IgnitePluginProcessor] Configured plugins: [21:04:27] : [Step 4/5] [2021-11-19 21:04:27,288][INFO ][main][IgnitePluginProcessor] ^-- StanByClusterTestProvider 1.0 [21:04:27] : [Step 4/5] [2021-11-19 21:04:27,289][INFO ][main][IgnitePluginProcessor] ^-- null [21:04:27] : [Step 4/5] [2021-11-19 21:04:27,289][INFO ][main][IgnitePluginProcessor] [21:04:27] : [Step 4/5] [2021-11-19 21:04:27,289][INFO ][main][IgnitePluginProcessor] ^-- PageMemory tracker plugin 1.0 [21:04:27] : [Step 4/5] [2021-11-19 21:04:27,289][INFO ][main][IgnitePluginProcessor] ^-- null [21:04:27] : [Step 4/5] [2021-11-19 21:04:27,289][INFO ][main][IgnitePluginProcessor] [21:04:27] : [Step 4/5] [2021-11-19 21:04:27,289][INFO ][main][IgnitePluginProcessor] ^-- TestDistibutedConfigurationPlugin 1.0 [21:04:27] : [Step 4/5] [2021-11-19 21:04:27,289][INFO ][main][IgnitePluginProcessor] ^-- null [21:04:27] : [Step 4/5] [2021-11-19 21:04:27,289][INFO ][main][IgnitePluginProcessor] [21:04:27] : [Step 4/5] [2021-11-19 21:04:27,289][INFO ][main][IgnitePluginProcessor] ^-- NodeValidationPluginProvider 1.0 [21:04:27] : [Step 4/5] [2021-11-19 21:04:27,290][INFO ][main][IgnitePluginProcessor] ^-- null [21:04:27] : [Step 4/5] [2021-11-19 21:04:27,290][INFO ][main][IgnitePluginProcessor] [21:04:27] : [Step 4/5] [2021-11-19 21:04:27,290][INFO ][main][FailureProcessor] Configured failure handler: [hnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]]] [21:04:27] : [Step 4/5] [2021-11-19 21:04:27,300][INFO ][main][TcpCommunicationSpi] Successfully bound communication NIO server to TCP port [port=45140, locHost=/127.0.0.1, selectorsCnt=12, selectorSpins=0, pairedConn=false] [21:04:27]W: [org.apache.ignite:ignite-core] [2021-11-19 21:04:27,301][WARN ][main][TcpCommunicationSpi] Message queue limit is set to 0 which may lead to potential OOMEs when running cache operations in FULL_ASYNC or PRIMARY_SYNC modes due to message queues growth on sender and receiver sides. [21:04:27] : [Step 4/5] [2021-11-19 21:04:27,305][INFO ][main][GridCollisionManager] Collision resolution is disabled (all jobs will be activated upon arrival). [21:04:27] : [Step 4/5] [2021-11-19 21:04:27,305][INFO ][main][EncryptedCacheGroupCreateTest0] Security status [authentication=off, sandbox=off, tls/ssl=off] [21:04:27] : [Step 4/5] [2021-11-19 21:04:27,362][INFO ][main][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:04:27] : [Step 4/5] [2021-11-19 21:04:27,445][INFO ][main][MaintenanceProcessor] Resolved store directory for node persistent data: /opt/buildagent/work/7bc1c54bc719b67c/work/db/encryption_EncryptedCacheGroupCreateTest0 [21:04:27] : [Step 4/5] [2021-11-19 21:04:27,446][INFO ][main][CacheObjectBinaryProcessorImpl] Resolved directory for serialized binary metadata: /opt/buildagent/work/7bc1c54bc719b67c/work/db/binary_meta/encryption_EncryptedCacheGroupCreateTest0 [21:04:27] : [Step 4/5] [2021-11-19 21:04:27,450][INFO ][main][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/encryption_EncryptedCacheGroupCreateTest0 [21:04:27] : [Step 4/5] [2021-11-19 21:04:27,451][INFO ][main][FileWriteAheadLogManager] Resolved write ahead log work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/encryption_EncryptedCacheGroupCreateTest0 [21:04:27] : [Step 4/5] [2021-11-19 21:04:27,451][INFO ][main][FileWriteAheadLogManager] Resolved write ahead log archive directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/encryption_EncryptedCacheGroupCreateTest0 [21:04:27] : [Step 4/5] [2021-11-19 21:04:27,806][INFO ][main][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/encryption_EncryptedCacheGroupCreateTest0/0000000000000000.wal [21:04:27] : [Step 4/5] [2021-11-19 21:04:27,813][INFO ][main][GridCacheDatabaseSharedManager] Configured data regions initialized successfully [total=5] [21:04:27] : [Step 4/5] [2021-11-19 21:04:27,815][INFO ][main][IgniteSnapshotManager] Resolved snapshot work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/snapshots [21:04:27] : [Step 4/5] [2021-11-19 21:04:27,815][INFO ][main][IgniteSnapshotManager] Resolved temp directory for snapshot creation: /opt/buildagent/work/7bc1c54bc719b67c/work/db/encryption_EncryptedCacheGroupCreateTest0/snp [21:04:27] : [Step 4/5] [2021-11-19 21:04:27,818][INFO ][main][ClientListenerProcessor] Client connector processor has started on TCP port 10800 [21:04:27] : [Step 4/5] [2021-11-19 21:04:27,825][INFO ][main][EncryptedCacheGroupCreateTest0] Non-loopback local IPs: 172.17.0.4 [21:04:27] : [Step 4/5] [2021-11-19 21:04:27,825][INFO ][main][EncryptedCacheGroupCreateTest0] Enabled local MACs: 0242AC110004 [21:04:27] : [Step 4/5] [2021-11-19 21:04:27,828][INFO ][main][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:04:27] : [Step 4/5] [2021-11-19 21:04:27,829][INFO ][main][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:04:27] : [Step 4/5] [2021-11-19 21:04:27,829][INFO ][main][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:04:27] : [Step 4/5] [2021-11-19 21:04:27,831][INFO ][main][GridCacheDatabaseSharedManager] Applying lost metastore updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:04:27] : [Step 4/5] [2021-11-19 21:04:27,832][INFO ][main][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=0 ms] [21:04:27] : [Step 4/5] [2021-11-19 21:04:27,832][INFO ][main][GridCacheProcessor] Restoring partition state for local groups. [21:04:27] : [Step 4/5] [2021-11-19 21:04:27,832][INFO ][main][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=0, partitionsProcessed=0, time=0ms] [21:04:27] : [Step 4/5] [2021-11-19 21:04:27,833][INFO ][main][GridEncryptionManager] Encryption keys loaded from metastore. [grps=, masterKeyName=ignite.master.key] [21:04:27] : [Step 4/5] [2021-11-19 21:04:27,838][INFO ][main][ClusterProcessor] Cluster ID and tag has been read from metastorage: null [21:04:27] : [Step 4/5] [2021-11-19 21:04:27,838][INFO ][main][IgniteClusterImpl] Shutdown policy was updated [oldVal=null, newVal=null] [21:04:27] : [Step 4/5] [2021-11-19 21:04:27,839][INFO ][main][GridCacheDatabaseSharedManager] Checkpoint frequency deviation changed [oldVal=null, newVal=null] [21:04:27] : [Step 4/5] [2021-11-19 21:04:27,848][INFO ][main][FilePageStoreManager] Cleanup cache stores [total=1, left=0, cleanFiles=false] [21:04:27] : [Step 4/5] [2021-11-19 21:04:27,851][INFO ][main][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:04:27] : [Step 4/5] [2021-11-19 21:04:27,852][INFO ][main][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:04:27] : [Step 4/5] [2021-11-19 21:04:27,853][INFO ][main][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:04:27] : [Step 4/5] [2021-11-19 21:04:27,854][INFO ][main][GridCacheDatabaseSharedManager] Data Regions Started: 5 [21:04:27] : [Step 4/5] [2021-11-19 21:04:27,854][INFO ][main][GridCacheDatabaseSharedManager] ^-- sysMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:04:27] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:04:27] : [Step 4/5] ^-- default region [type=default, persistence=true, lazyAlloc=true, [21:04:27] : [Step 4/5] ... initCfg=10MB, maxCfg=10MB, usedRam=0MB, freeRam=100%, allocRam=0MB, allocTotal=0MB] [21:04:27] : [Step 4/5] ^-- metastoreMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:04:27] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:04:27] : [Step 4/5] ^-- TxLog region [type=internal, persistence=true, lazyAlloc=false, [21:04:27] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:04:27] : [Step 4/5] ^-- volatileDsMemPlc region [type=user, persistence=false, lazyAlloc=true, [21:04:27] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB] [21:04:27] : [Step 4/5] ^-- Ignite persistence [used=0MB] [21:04:27] : [Step 4/5] [21:04:27] : [Step 4/5] [2021-11-19 21:04:27,856][INFO ][main][GridCacheDatabaseSharedManager] Starting binary memory restore for: [-2100569601] [21:04:27] : [Step 4/5] [2021-11-19 21:04:27,867][INFO ][main][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:04:27] : [Step 4/5] [2021-11-19 21:04:27,867][INFO ][main][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:04:27] : [Step 4/5] [2021-11-19 21:04:27,868][INFO ][main][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/encryption_EncryptedCacheGroupCreateTest0/0000000000000000.wal, offset=0, ver=2] [21:04:27] : [Step 4/5] [2021-11-19 21:04:27,872][INFO ][main][GridCacheProcessor] Started cache in recovery mode [name=ignite-sys-cache, id=-2100569601, dataRegionName=sysMemPlc, mode=REPLICATED, atomicity=TRANSACTIONAL, backups=2147483647, mvcc=false] [21:04:27] : [Step 4/5] [2021-11-19 21:04:27,873][INFO ][main][GridCacheDatabaseSharedManager] Binary recovery performed in 17 ms. [21:04:27] : [Step 4/5] [2021-11-19 21:04:27,873][INFO ][main][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:04:27] : [Step 4/5] [2021-11-19 21:04:27,873][INFO ][main][GridCacheDatabaseSharedManager] Applying lost cache updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:04:27] : [Step 4/5] [2021-11-19 21:04:27,945][INFO ][main][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=71 ms] [21:04:27] : [Step 4/5] [2021-11-19 21:04:27,945][INFO ][main][GridCacheProcessor] Restoring partition state for local groups. [21:04:27] : [Step 4/5] [2021-11-19 21:04:27,951][INFO ][main][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=1, partitionsProcessed=100, time=0ms] [21:04:28] : [Step 4/5] [2021-11-19 21:04:28,280][INFO ][main][TestTcpDiscoverySpi] Successfully bound to TCP port [port=47500, localHost=localhost/127.0.0.1, locNodeId=832cfe93-7cf8-4ee5-9a59-6dc363c00000] [21:04:28] : [Step 4/5] [2021-11-19 21:04:28,293][INFO ][disco-notifier-worker-#8079%encryption.EncryptedCacheGroupCreateTest0%][MvccProcessorImpl] Assigned mvcc coordinator [crd=MvccCoordinator [topVer=AffinityTopologyVersion [topVer=1, minorTopVer=0], nodeId=832cfe93-7cf8-4ee5-9a59-6dc363c00000, ver=1637345068286, local=true, initialized=false]] [21:04:28] : [Step 4/5] [2021-11-19 21:04:28,295][INFO ][sys-#8065%encryption.EncryptedCacheGroupCreateTest0%][ClusterProcessor] Writing cluster ID and tag to metastorage on ready for write ClusterIdAndTag [id=43313c43-76e1-41b9-91fe-b736c85ff371, tag=festive_volhard] [21:04:28] : [Step 4/5] [2021-11-19 21:04:28,298][INFO ][disco-notifier-worker-#8079%encryption.EncryptedCacheGroupCreateTest0%][ClusterProcessor] festive_volhard [21:04:28] : [Step 4/5] [2021-11-19 21:04:28,299][INFO ][disco-notifier-worker-#8079%encryption.EncryptedCacheGroupCreateTest0%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustEnabled' was changed from 'null' to 'false' [21:04:28] : [Step 4/5] [2021-11-19 21:04:28,300][INFO ][disco-notifier-worker-#8079%encryption.EncryptedCacheGroupCreateTest0%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustTimeout' was changed from 'null' to '300000' [21:04:28] : [Step 4/5] [2021-11-19 21:04:28,301][INFO ][disco-notifier-worker-#8079%encryption.EncryptedCacheGroupCreateTest0%][IgniteTxManager] Transactions parameter 'longOperationsDumpTimeout' was changed from 'null' to '60000' [21:04:28] : [Step 4/5] [2021-11-19 21:04:28,301][INFO ][disco-notifier-worker-#8079%encryption.EncryptedCacheGroupCreateTest0%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpThreshold' was changed from 'null' to '0' [21:04:28] : [Step 4/5] [2021-11-19 21:04:28,302][INFO ][disco-notifier-worker-#8079%encryption.EncryptedCacheGroupCreateTest0%][IgniteTxManager] Transactions parameter 'transactionTimeDumpSamplesCoefficient' was changed from 'null' to '0.0' [21:04:28] : [Step 4/5] [2021-11-19 21:04:28,302][INFO ][disco-notifier-worker-#8079%encryption.EncryptedCacheGroupCreateTest0%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpSamplesPerSecondLimit' was changed from 'null' to '5' [21:04:28] : [Step 4/5] [2021-11-19 21:04:28,303][INFO ][disco-notifier-worker-#8079%encryption.EncryptedCacheGroupCreateTest0%][IgniteTxManager] Transactions parameter 'collisionsDumpInterval' was changed from 'null' to '1000' [21:04:28] : [Step 4/5] [2021-11-19 21:04:28,303][INFO ][disco-notifier-worker-#8079%encryption.EncryptedCacheGroupCreateTest0%][IgniteTxManager] Transactions parameter 'txOwnerDumpRequestsAllowed' was changed from 'null' to 'true' [21:04:28] : [Step 4/5] [2021-11-19 21:04:28,304][INFO ][disco-notifier-worker-#8079%encryption.EncryptedCacheGroupCreateTest0%][GridCacheDatabaseSharedManager] Historical rebalance WAL threshold changed [property=historical.rebalance.threshold, oldVal=null, newVal=500] [21:04:28] : [Step 4/5] [2021-11-19 21:04:28,315][INFO ][main][EncryptedCacheGroupCreateTest0] To start Console Management & Monitoring run ignitevisorcmd.{sh|bat} [21:04:28] : [Step 4/5] [2021-11-19 21:04:28,316][INFO ][main][EncryptedCacheGroupCreateTest0] [21:04:28] : [Step 4/5] [21:04:28] : [Step 4/5] >>> +-------------------------------------------+ [21:04:28] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:04:28] : [Step 4/5] >>> +-------------------------------------------+ [21:04:28] : [Step 4/5] >>> OS name: Linux 4.15.0-151-generic amd64 [21:04:28] : [Step 4/5] >>> CPU(s): 24 [21:04:28] : [Step 4/5] >>> Heap: 2.0GB [21:04:28] : [Step 4/5] >>> VM name: 16724@c4dfe9a430b2 [21:04:28] : [Step 4/5] >>> Ignite instance name: encryption.EncryptedCacheGroupCreateTest0 [21:04:28] : [Step 4/5] >>> Local node [ID=832CFE93-7CF8-4EE5-9A59-6DC363C00000, order=1, clientMode=false] [21:04:28] : [Step 4/5] >>> Local node addresses: [127.0.0.1] [21:04:28] : [Step 4/5] >>> Local ports: TCP:10800 TCP:45140 TCP:47500 [21:04:28] : [Step 4/5] [21:04:28] : [Step 4/5] [2021-11-19 21:04:28,317][INFO ][main][EncryptedCacheGroupCreateTest0] >>> Ignite cluster is in INACTIVE state (limited functionality available). Use control.(sh|bat) script or IgniteCluster.state(ClusterState.ACTIVE) to change the state. [21:04:28] : [Step 4/5] [2021-11-19 21:04:28,318][INFO ][main][GridDiscoveryManager] Topology snapshot [ver=1, locNode=832cfe93, servers=1, clients=0, state=INACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=832cfe93-7cf8-4ee5-9a59-6dc363c00000, consistentId=encryption.EncryptedCacheGroupCreateTest0, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:04:28] : [Step 4/5] [2021-11-19 21:04:28,319][INFO ][main][G] Node started : [stage="Configure system pool" (0 ms),stage="Start managers" (175 ms),stage="Configure binary metadata" (2 ms),stage="Start processors" (376 ms),stage="Start 'StanByClusterTestProvider' plugin" (0 ms),stage="Start 'PageMemory tracker plugin' plugin" (0 ms),stage="Start 'TestDistibutedConfigurationPlugin' plugin" (0 ms),stage="Start 'NodeValidationPluginProvider' plugin" (0 ms),stage="Init metastore" (23 ms),stage="Init and start regions" (7 ms),stage="Restore binary memory" (17 ms),stage="Restore logical state" (78 ms),stage="Finish recovery" (327 ms),stage="Join topology" (14 ms),stage="Await transition" (3 ms),stage="Await exchange" (22 ms),stage="Total time" (1044 ms)] [21:04:28] : [Step 4/5] [2021-11-19 21:04:28,320][INFO ][main][root] Node started with the following configuration [id=832cfe93-7cf8-4ee5-9a59-6dc363c00000, marshaller=BinaryMarshaller [], discovery=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=5000, ackTimeout=5000, marsh=JdkMarshaller [clsFilter=org.apache.ignite.marshaller.MarshallerUtils$1@4f081b5d], reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], binaryCfg=null, lateAff=true] [21:04:28]W: [org.apache.ignite:ignite-core] [2021-11-19 21:04:28,327][WARN ][main][G] Ignite work directory is not provided, automatically resolved to: /opt/buildagent/work/7bc1c54bc719b67c/work [21:04:28] : [Step 4/5] [2021-11-19 21:04:28,328][INFO ][main][EncryptedCacheGroupCreateTest1] [21:04:28] : [Step 4/5] [21:04:28] : [Step 4/5] >>> __________ ________________ [21:04:28] : [Step 4/5] >>> / _/ ___/ |/ / _/_ __/ __/ [21:04:28] : [Step 4/5] >>> _/ // (7 7 // / / / / _/ [21:04:28] : [Step 4/5] >>> /___/\___/_/|_/___/ /_/ /___/ [21:04:28] : [Step 4/5] >>> [21:04:28] : [Step 4/5] >>> ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:04:28] : [Step 4/5] >>> 2021 Copyright(C) Apache Software Foundation [21:04:28] : [Step 4/5] >>> [21:04:28] : [Step 4/5] >>> Ignite documentation: http://ignite.apache.org [21:04:28] : [Step 4/5] [21:04:28] : [Step 4/5] [2021-11-19 21:04:28,329][INFO ][main][EncryptedCacheGroupCreateTest1] Config URL: n/a [21:04:28] : [Step 4/5] [2021-11-19 21:04:28,329][INFO ][main][EncryptedCacheGroupCreateTest1] IgniteConfiguration [igniteInstanceName=encryption.EncryptedCacheGroupCreateTest1, pubPoolSize=24, svcPoolSize=24, callbackPoolSize=24, stripedPoolSize=24, sysPoolSize=24, mgmtPoolSize=4, dataStreamerPoolSize=24, utilityCachePoolSize=24, utilityCacheKeepAliveTime=60000, p2pPoolSize=2, qryPoolSize=24, buildIdxPoolSize=4, igniteHome=/opt/buildagent/work/7bc1c54bc719b67c, igniteWorkDir=/opt/buildagent/work/7bc1c54bc719b67c/work, mbeanSrv=com.sun.jmx.mbeanserver.JmxMBeanServer@6fe85038, nodeId=0822ac7e-0bd1-4e7c-91c1-49875bd00001, marsh=BinaryMarshaller [], marshLocJobs=false, daemon=false, p2pEnabled=true, netTimeout=10000, netCompressionLevel=1, sndRetryDelay=1000, sndRetryCnt=3, metricsHistSize=10000, metricsUpdateFreq=1000, metricsExpTime=9223372036854775807, discoSpi=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=0, ackTimeout=0, marsh=null, reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], segPlc=STOP, segResolveAttempts=2, waitForSegOnStart=true, allResolversPassReq=true, segChkFreq=10000, commSpi=TcpCommunicationSpi [connectGate=org.apache.ignite.spi.communication.tcp.internal.ConnectGateway@19827608, ctxInitLatch=java.util.concurrent.CountDownLatch@cc9ef8d[Count = 1], stopping=false, clientPool=null, nioSrvWrapper=null, stateProvider=null], evtSpi=MemoryEventStorageSpi [expireAgeMs=9223372036854775807, expireCnt=10000, filter=null], colSpi=NoopCollisionSpi [], deploySpi=LocalDeploymentSpi [], indexingSpi=org.apache.ignite.spi.indexing.noop.NoopIndexingSpi@450f0235, addrRslvr=null, encryptionSpi=org.apache.ignite.spi.encryption.keystore.KeystoreEncryptionSpi@78c262ba, tracingSpi=org.apache.ignite.spi.tracing.NoopTracingSpi@7d2c9361, clientMode=false, rebalanceThreadPoolSize=4, rebalanceTimeout=10000, rebalanceBatchesPrefetchCnt=3, rebalanceThrottle=0, rebalanceBatchSize=524288, txCfg=TransactionConfiguration [txSerEnabled=false, dfltIsolation=REPEATABLE_READ, dfltConcurrency=PESSIMISTIC, dfltTxTimeout=0, txTimeoutOnPartitionMapExchange=0, deadlockTimeout=10000, pessimisticTxLogSize=0, pessimisticTxLogLinger=10000, tmLookupClsName=null, txManagerFactory=null, useJtaSync=false], cacheSanityCheckEnabled=true, discoStartupDelay=60000, deployMode=SHARED, p2pMissedCacheSize=100, locHost=127.0.0.1, timeSrvPortBase=31100, timeSrvPortRange=100, failureDetectionTimeout=10000, sysWorkerBlockedTimeout=null, clientFailureDetectionTimeout=10000, metricsLogFreq=0, connectorCfg=null, odbcCfg=null, warmupClos=null, atomicCfg=AtomicConfiguration [seqReserveSize=1000, cacheMode=PARTITIONED, backups=1, aff=null, grpName=null], classLdr=null, sslCtxFactory=null, platformCfg=null, binaryCfg=null, memCfg=null, pstCfg=null, dsCfg=DataStorageConfiguration [sysRegionInitSize=41943040, sysRegionMaxSize=104857600, pageSize=4096, concLvl=0, dfltDataRegConf=DataRegionConfiguration [name=default, maxSize=10485760, initSize=268435456, swapPath=null, pageEvictionMode=DISABLED, pageReplacementMode=CLOCK, evictionThreshold=0.9, emptyPagesPoolSize=100, metricsEnabled=false, metricsSubIntervalCount=5, metricsRateTimeInterval=60000, persistenceEnabled=true, checkpointPageBufSize=0, lazyMemoryAllocation=true, warmUpCfg=null], dataRegions=null, storagePath=null, checkpointFreq=180000, lockWaitTime=10000, checkpointThreads=4, checkpointWriteOrder=SEQUENTIAL, walHistSize=20, maxWalArchiveSize=1073741824, walSegments=10, walSegmentSize=67108864, walPath=db/wal, walArchivePath=db/wal/archive, cdcWalPath=db/wal/cdc, cdcEnabled=false, metricsEnabled=false, walMode=FSYNC, walTlbSize=131072, walBuffSize=0, walFlushFreq=2000, walFsyncDelay=1000, walRecordIterBuffSize=67108864, alwaysWriteFullPages=false, fileIOFactory=org.apache.ignite.internal.processors.cache.persistence.file.AsyncFileIOFactory@296edc75, metricsSubIntervalCnt=5, metricsRateTimeInterval=60000, walAutoArchiveAfterInactivity=-1, walForceArchiveTimeout=-1, writeThrottlingEnabled=false, walCompactionEnabled=false, walCompactionLevel=1, checkpointReadLockTimeout=null, walPageCompression=DISABLED, walPageCompressionLevel=null, dfltWarmUpCfg=null, encCfg=org.apache.ignite.configuration.EncryptionConfiguration@357c9bd9, defragmentationThreadPoolSize=4, minWalArchiveSize=-1], snapshotPath=snapshots, activeOnStart=true, activeOnStartPropSetFlag=false, autoActivation=true, autoActivationPropSetFlag=false, clusterStateOnStart=null, sqlConnCfg=null, cliConnCfg=ClientConnectorConfiguration [host=null, port=10800, portRange=100, sockSndBufSize=0, sockRcvBufSize=0, tcpNoDelay=true, maxOpenCursorsPerConn=128, threadPoolSize=24, selectorCnt=12, idleTimeout=0, handshakeTimeout=10000, jdbcEnabled=true, odbcEnabled=true, thinCliEnabled=true, sslEnabled=false, useIgniteSslCtxFactory=true, sslClientAuth=false, sslCtxFactory=null, thinCliCfg=ThinClientConfiguration [maxActiveTxPerConn=100, maxActiveComputeTasksPerConn=0]], mvccVacuumThreadCnt=2, mvccVacuumFreq=5000, authEnabled=false, failureHnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]], commFailureRslvr=null, sqlCfg=SqlConfiguration [longQryWarnTimeout=3000, dfltQryTimeout=0, sqlQryHistSize=1000, validationEnabled=false], asyncContinuationExecutor=null] [21:04:28] : [Step 4/5] [2021-11-19 21:04:28,338][INFO ][main][EncryptedCacheGroupCreateTest1] Daemon mode: off [21:04:28] : [Step 4/5] [2021-11-19 21:04:28,338][INFO ][main][EncryptedCacheGroupCreateTest1] OS: Linux 4.15.0-151-generic amd64 [21:04:28] : [Step 4/5] [2021-11-19 21:04:28,338][INFO ][main][EncryptedCacheGroupCreateTest1] OS user: teamcity [21:04:28] : [Step 4/5] [2021-11-19 21:04:28,338][INFO ][main][EncryptedCacheGroupCreateTest1] PID: 16724 [21:04:28] : [Step 4/5] [2021-11-19 21:04:28,339][INFO ][main][EncryptedCacheGroupCreateTest1] Language runtime: Java Platform API Specification ver. 1.8 [21:04:28] : [Step 4/5] [2021-11-19 21:04:28,339][INFO ][main][EncryptedCacheGroupCreateTest1] VM information: Java(TM) SE Runtime Environment 1.8.0_261-b12 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 25.261-b12 [21:04:28] : [Step 4/5] [2021-11-19 21:04:28,339][INFO ][main][EncryptedCacheGroupCreateTest1] VM total memory: 1.9GB [21:04:28] : [Step 4/5] [2021-11-19 21:04:28,339][INFO ][main][EncryptedCacheGroupCreateTest1] Remote Management [restart: off, REST: off, JMX (remote: off)] [21:04:28] : [Step 4/5] [2021-11-19 21:04:28,340][INFO ][main][EncryptedCacheGroupCreateTest1] Logger: GridTestLog4jLogger [quiet=false, config=null] [21:04:28] : [Step 4/5] [2021-11-19 21:04:28,340][INFO ][main][EncryptedCacheGroupCreateTest1] IGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c [21:04:28] : [Step 4/5] [2021-11-19 21:04:28,340][INFO ][main][EncryptedCacheGroupCreateTest1] VM arguments: [-DIGNITE_DUMP_THREADS_ON_FAILURE=false, -DMono=/usr/bin/mono-sgen, -DMono4.0_x64=/usr/lib/mono/4.0, -DMono4.5_x64=/usr/lib/mono/4.5, -DMonoVersion=6.12.0.90, -DSKIP_BUILD=false, -Dagent.home.dir=/opt/buildagent, -Dagent.name=aitc-lin02_03, -Dagent.ownPort=9090, -Dagent.work.dir=/opt/buildagent/work, -Dbuild.number=95, -Dbuild.vcs.number=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.1=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.GitHubApacheIgnite=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dclassworlds.conf=/opt/buildagent/temp/buildTmp/teamcity.m2.conf, -Dcom.jetbrains.maven.watcher.report.file=/opt/buildagent/temp/buildTmp/maven-build-info.xml, -Djava.io.tmpdir=/opt/buildagent/temp/buildTmp, -Dmaven.home=/opt/buildagent/tools/maven3_6, -Dmaven.multiModuleProjectDirectory=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.agent.cpuBenchmark=457, -Dteamcity.agent.dotnet.agent_url=http://localhost:9090/RPC2, -Dteamcity.agent.dotnet.build_id=6278078, -Dteamcity.auth.password=*******, -Dteamcity.auth.userId=TeamCityBuildId=6278078, -Dteamcity.build.changedFiles.file=/opt/buildagent/temp/buildTmp/changedFiles6342607772318147725.txt, -Dteamcity.build.checkoutDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.build.id=6278078, -Dteamcity.build.properties.file=/opt/buildagent/temp/buildTmp/teamcity.build5164517880467851002.properties, -Dteamcity.build.tempDir=/opt/buildagent/temp/buildTmp, -Dteamcity.build.workingDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.buildConfName=Basic 3, -Dteamcity.buildType.id=IgniteTests24Java8_Basic3, -Dteamcity.configuration.properties.file=/opt/buildagent/temp/buildTmp/teamcity.config5591980786735343870.properties, -Dteamcity.maven.userSettings.path=/opt/buildagent/temp/buildTmp/maven_settings_585072866407032347.xml, -Dteamcity.maven.watcher.home=/opt/buildagent/plugins/mavenPlugin/maven-watcher-jdk16, -Dteamcity.projectName=Ignite Tests 2.x (JDK 8/11), -Dteamcity.runner.properties.file=/opt/buildagent/temp/buildTmp/teamcity.runner9098465561618137420.properties, -Dteamcity.tests.recentlyFailedTests.file=/opt/buildagent/temp/buildTmp/testsToRunFirst3891775683130404069.txt, -Dteamcity.version=2021.2 (build 99542), -ea, -Xms2g, -Xmx2g, -XX:+HeapDumpOnOutOfMemoryError, -DIGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_TEST_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_UPDATE_NOTIFIER=false, -DIGNITE_NO_DISCO_ORDER=true, -DIGNITE_PERFORMANCE_SUGGESTIONS_DISABLED=true, -Djava.net.preferIPv4Stack=true, -DTEST_SCALE_FACTOR=1.0, -DIGNITE_TEST_PROP_LOG4J_FILE=log4j-tc-test.xml, -DIGNITE_QUIET=false, -DIGNITE_MARSHAL_BUFFERS_RECHECK=1000, -Dmaven.repo.local=/opt/buildagent/.m2/repository] [21:04:28] : [Step 4/5] [2021-11-19 21:04:28,345][INFO ][main][EncryptedCacheGroupCreateTest1] System cache's DataRegion size is configured to 40 MB. Use DataStorageConfiguration.systemRegionInitialSize property to change the setting. [21:04:28] : [Step 4/5] [2021-11-19 21:04:28,345][INFO ][main][EncryptedCacheGroupCreateTest1] Configured caches [in 'sysMemPlc' dataRegion: ['ignite-sys-cache']] [21:04:28]W: [org.apache.ignite:ignite-core] [2021-11-19 21:04:28,346][WARN ][main][EncryptedCacheGroupCreateTest1] Peer class loading is enabled (disable it in production for performance and deployment consistency reasons) [21:04:28] : [Step 4/5] [2021-11-19 21:04:28,346][INFO ][main][EncryptedCacheGroupCreateTest1] 3-rd party licenses can be found at: /opt/buildagent/work/7bc1c54bc719b67c/libs/licenses [21:04:28] : [Step 4/5] [2021-11-19 21:04:28,350][INFO ][main][IgnitePluginProcessor] Configured plugins: [21:04:28] : [Step 4/5] [2021-11-19 21:04:28,350][INFO ][main][IgnitePluginProcessor] ^-- StanByClusterTestProvider 1.0 [21:04:28] : [Step 4/5] [2021-11-19 21:04:28,350][INFO ][main][IgnitePluginProcessor] ^-- null [21:04:28] : [Step 4/5] [2021-11-19 21:04:28,350][INFO ][main][IgnitePluginProcessor] [21:04:28] : [Step 4/5] [2021-11-19 21:04:28,350][INFO ][main][IgnitePluginProcessor] ^-- PageMemory tracker plugin 1.0 [21:04:28] : [Step 4/5] [2021-11-19 21:04:28,351][INFO ][main][IgnitePluginProcessor] ^-- null [21:04:28] : [Step 4/5] [2021-11-19 21:04:28,351][INFO ][main][IgnitePluginProcessor] [21:04:28] : [Step 4/5] [2021-11-19 21:04:28,351][INFO ][main][IgnitePluginProcessor] ^-- TestDistibutedConfigurationPlugin 1.0 [21:04:28] : [Step 4/5] [2021-11-19 21:04:28,351][INFO ][main][IgnitePluginProcessor] ^-- null [21:04:28] : [Step 4/5] [2021-11-19 21:04:28,351][INFO ][main][IgnitePluginProcessor] [21:04:28] : [Step 4/5] [2021-11-19 21:04:28,351][INFO ][main][IgnitePluginProcessor] ^-- NodeValidationPluginProvider 1.0 [21:04:28] : [Step 4/5] [2021-11-19 21:04:28,351][INFO ][main][IgnitePluginProcessor] ^-- null [21:04:28] : [Step 4/5] [2021-11-19 21:04:28,352][INFO ][main][IgnitePluginProcessor] [21:04:28] : [Step 4/5] [2021-11-19 21:04:28,352][INFO ][main][FailureProcessor] Configured failure handler: [hnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]]] [21:04:28] : [Step 4/5] [2021-11-19 21:04:28,397][INFO ][main][TcpCommunicationSpi] Successfully bound communication NIO server to TCP port [port=45141, locHost=/127.0.0.1, selectorsCnt=12, selectorSpins=0, pairedConn=false] [21:04:28]W: [org.apache.ignite:ignite-core] [2021-11-19 21:04:28,397][WARN ][main][TcpCommunicationSpi] Message queue limit is set to 0 which may lead to potential OOMEs when running cache operations in FULL_ASYNC or PRIMARY_SYNC modes due to message queues growth on sender and receiver sides. [21:04:28] : [Step 4/5] [2021-11-19 21:04:28,407][INFO ][main][GridCollisionManager] Collision resolution is disabled (all jobs will be activated upon arrival). [21:04:28] : [Step 4/5] [2021-11-19 21:04:28,408][INFO ][main][EncryptedCacheGroupCreateTest1] Security status [authentication=off, sandbox=off, tls/ssl=off] [21:04:28] : [Step 4/5] [2021-11-19 21:04:28,485][INFO ][main][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:04:28] : [Step 4/5] [2021-11-19 21:04:28,577][INFO ][main][MaintenanceProcessor] Resolved store directory for node persistent data: /opt/buildagent/work/7bc1c54bc719b67c/work/db/encryption_EncryptedCacheGroupCreateTest1 [21:04:28] : [Step 4/5] [2021-11-19 21:04:28,578][INFO ][main][CacheObjectBinaryProcessorImpl] Resolved directory for serialized binary metadata: /opt/buildagent/work/7bc1c54bc719b67c/work/db/binary_meta/encryption_EncryptedCacheGroupCreateTest1 [21:04:28] : [Step 4/5] [2021-11-19 21:04:28,583][INFO ][main][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/encryption_EncryptedCacheGroupCreateTest1 [21:04:28] : [Step 4/5] [2021-11-19 21:04:28,583][INFO ][main][FileWriteAheadLogManager] Resolved write ahead log work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/encryption_EncryptedCacheGroupCreateTest1 [21:04:28] : [Step 4/5] [2021-11-19 21:04:28,584][INFO ][main][FileWriteAheadLogManager] Resolved write ahead log archive directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/encryption_EncryptedCacheGroupCreateTest1 [21:04:28] : [Step 4/5] [2021-11-19 21:04:28,939][INFO ][main][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/encryption_EncryptedCacheGroupCreateTest1/0000000000000000.wal [21:04:28] : [Step 4/5] [2021-11-19 21:04:28,943][INFO ][main][GridCacheDatabaseSharedManager] Configured data regions initialized successfully [total=5] [21:04:28] : [Step 4/5] [2021-11-19 21:04:28,947][INFO ][main][IgniteSnapshotManager] Resolved snapshot work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/snapshots [21:04:28] : [Step 4/5] [2021-11-19 21:04:28,947][INFO ][main][IgniteSnapshotManager] Resolved temp directory for snapshot creation: /opt/buildagent/work/7bc1c54bc719b67c/work/db/encryption_EncryptedCacheGroupCreateTest1/snp [21:04:28] : [Step 4/5] [2021-11-19 21:04:28,950][INFO ][main][ClientListenerProcessor] Client connector processor has started on TCP port 10801 [21:04:28] : [Step 4/5] [2021-11-19 21:04:28,952][INFO ][main][EncryptedCacheGroupCreateTest1] Non-loopback local IPs: 172.17.0.4 [21:04:28] : [Step 4/5] [2021-11-19 21:04:28,952][INFO ][main][EncryptedCacheGroupCreateTest1] Enabled local MACs: 0242AC110004 [21:04:28] : [Step 4/5] [2021-11-19 21:04:28,953][INFO ][main][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:04:28] : [Step 4/5] [2021-11-19 21:04:28,955][INFO ][main][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:04:28] : [Step 4/5] [2021-11-19 21:04:28,955][INFO ][main][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:04:28] : [Step 4/5] [2021-11-19 21:04:28,957][INFO ][main][GridCacheDatabaseSharedManager] Applying lost metastore updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:04:28] : [Step 4/5] [2021-11-19 21:04:28,957][INFO ][main][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=0 ms] [21:04:28] : [Step 4/5] [2021-11-19 21:04:28,958][INFO ][main][GridCacheProcessor] Restoring partition state for local groups. [21:04:28] : [Step 4/5] [2021-11-19 21:04:28,958][INFO ][main][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=0, partitionsProcessed=0, time=0ms] [21:04:28] : [Step 4/5] [2021-11-19 21:04:28,958][INFO ][main][GridEncryptionManager] Encryption keys loaded from metastore. [grps=, masterKeyName=ignite.master.key] [21:04:28] : [Step 4/5] [2021-11-19 21:04:28,959][INFO ][main][ClusterProcessor] Cluster ID and tag has been read from metastorage: null [21:04:28] : [Step 4/5] [2021-11-19 21:04:28,959][INFO ][main][IgniteClusterImpl] Shutdown policy was updated [oldVal=null, newVal=null] [21:04:28] : [Step 4/5] [2021-11-19 21:04:28,960][INFO ][main][GridCacheDatabaseSharedManager] Checkpoint frequency deviation changed [oldVal=null, newVal=null] [21:04:28] : [Step 4/5] [2021-11-19 21:04:28,969][INFO ][main][FilePageStoreManager] Cleanup cache stores [total=1, left=0, cleanFiles=false] [21:04:28] : [Step 4/5] [2021-11-19 21:04:28,972][INFO ][main][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:04:28] : [Step 4/5] [2021-11-19 21:04:28,973][INFO ][main][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:04:28] : [Step 4/5] [2021-11-19 21:04:28,974][INFO ][main][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:04:28] : [Step 4/5] [2021-11-19 21:04:28,974][INFO ][main][GridCacheDatabaseSharedManager] Data Regions Started: 5 [21:04:28] : [Step 4/5] [2021-11-19 21:04:28,975][INFO ][main][GridCacheDatabaseSharedManager] ^-- sysMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:04:28] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:04:28] : [Step 4/5] ^-- default region [type=default, persistence=true, lazyAlloc=true, [21:04:28] : [Step 4/5] ... initCfg=10MB, maxCfg=10MB, usedRam=0MB, freeRam=100%, allocRam=0MB, allocTotal=0MB] [21:04:28] : [Step 4/5] ^-- metastoreMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:04:28] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:04:28] : [Step 4/5] ^-- TxLog region [type=internal, persistence=true, lazyAlloc=false, [21:04:28] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:04:28] : [Step 4/5] ^-- volatileDsMemPlc region [type=user, persistence=false, lazyAlloc=true, [21:04:28] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB] [21:04:28] : [Step 4/5] ^-- Ignite persistence [used=0MB] [21:04:28] : [Step 4/5] [21:04:28] : [Step 4/5] [2021-11-19 21:04:28,976][INFO ][main][GridCacheDatabaseSharedManager] Starting binary memory restore for: [-2100569601] [21:04:28] : [Step 4/5] [2021-11-19 21:04:28,985][INFO ][main][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:04:28] : [Step 4/5] [2021-11-19 21:04:28,986][INFO ][main][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:04:28] : [Step 4/5] [2021-11-19 21:04:28,987][INFO ][main][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/encryption_EncryptedCacheGroupCreateTest1/0000000000000000.wal, offset=0, ver=2] [21:04:28] : [Step 4/5] [2021-11-19 21:04:28,992][INFO ][main][GridCacheProcessor] Started cache in recovery mode [name=ignite-sys-cache, id=-2100569601, dataRegionName=sysMemPlc, mode=REPLICATED, atomicity=TRANSACTIONAL, backups=2147483647, mvcc=false] [21:04:28] : [Step 4/5] [2021-11-19 21:04:28,993][INFO ][main][GridCacheDatabaseSharedManager] Binary recovery performed in 17 ms. [21:04:28] : [Step 4/5] [2021-11-19 21:04:28,993][INFO ][main][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:04:28] : [Step 4/5] [2021-11-19 21:04:28,994][INFO ][main][GridCacheDatabaseSharedManager] Applying lost cache updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:04:29] : [Step 4/5] [2021-11-19 21:04:29,066][INFO ][main][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=71 ms] [21:04:29] : [Step 4/5] [2021-11-19 21:04:29,066][INFO ][main][GridCacheProcessor] Restoring partition state for local groups. [21:04:29] : [Step 4/5] [2021-11-19 21:04:29,074][INFO ][main][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=1, partitionsProcessed=100, time=10ms] [21:04:29] : [Step 4/5] [2021-11-19 21:04:29,363][INFO ][main][TestTcpDiscoverySpi] Successfully bound to TCP port [port=47501, localHost=localhost/127.0.0.1, locNodeId=0822ac7e-0bd1-4e7c-91c1-49875bd00001] [21:04:29] : [Step 4/5] [2021-11-19 21:04:29,366][INFO ][tcp-disco-srvr-[:47500]-#405%encryption.EncryptedCacheGroupCreateTest0%-#8081%encryption.EncryptedCacheGroupCreateTest0%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=40885] [21:04:29] : [Step 4/5] [2021-11-19 21:04:29,367][INFO ][tcp-disco-srvr-[:47500]-#405%encryption.EncryptedCacheGroupCreateTest0%-#8081%encryption.EncryptedCacheGroupCreateTest0%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=40885] [21:04:29] : [Step 4/5] [2021-11-19 21:04:29,368][INFO ][tcp-disco-sock-reader-[]-#411%encryption.EncryptedCacheGroupCreateTest0%-#8200%encryption.EncryptedCacheGroupCreateTest0%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:40885, rmtPort=40885] [21:04:29] : [Step 4/5] [2021-11-19 21:04:29,370][INFO ][tcp-disco-sock-reader-[0822ac7e 127.0.0.1:40885]-#411%encryption.EncryptedCacheGroupCreateTest0%-#8200%encryption.EncryptedCacheGroupCreateTest0%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=0822ac7e-0bd1-4e7c-91c1-49875bd00001, rmtAddr=/127.0.0.1:40885] [21:04:29] : [Step 4/5] [2021-11-19 21:04:29,377][INFO ][tcp-disco-srvr-[:47501]-#410%encryption.EncryptedCacheGroupCreateTest1%-#8199%encryption.EncryptedCacheGroupCreateTest1%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=34411] [21:04:29] : [Step 4/5] [2021-11-19 21:04:29,378][INFO ][tcp-disco-srvr-[:47501]-#410%encryption.EncryptedCacheGroupCreateTest1%-#8199%encryption.EncryptedCacheGroupCreateTest1%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=34411] [21:04:29] : [Step 4/5] [2021-11-19 21:04:29,379][INFO ][tcp-disco-sock-reader-[]-#412%encryption.EncryptedCacheGroupCreateTest1%-#8201%encryption.EncryptedCacheGroupCreateTest1%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:34411, rmtPort=34411] [21:04:29] : [Step 4/5] [2021-11-19 21:04:29,380][INFO ][tcp-disco-sock-reader-[]-#412%encryption.EncryptedCacheGroupCreateTest1%-#8201%encryption.EncryptedCacheGroupCreateTest1%][TestTcpDiscoverySpi] Received ping request from the remote node [rmtNodeId=832cfe93-7cf8-4ee5-9a59-6dc363c00000, rmtAddr=/127.0.0.1:34411, rmtPort=34411] [21:04:29] : [Step 4/5] [2021-11-19 21:04:29,382][INFO ][tcp-disco-sock-reader-[]-#412%encryption.EncryptedCacheGroupCreateTest1%-#8201%encryption.EncryptedCacheGroupCreateTest1%][TestTcpDiscoverySpi] Finished writing ping response [rmtNodeId=832cfe93-7cf8-4ee5-9a59-6dc363c00000, rmtAddr=/127.0.0.1:34411, rmtPort=34411] [21:04:29] : [Step 4/5] [2021-11-19 21:04:29,382][INFO ][tcp-disco-sock-reader-[0822ac7e 127.0.0.1:40885]-#411%encryption.EncryptedCacheGroupCreateTest0%-#8200%encryption.EncryptedCacheGroupCreateTest0%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:40885, rmtPort=40885, rmtNodeId=0822ac7e-0bd1-4e7c-91c1-49875bd00001] [21:04:29] : [Step 4/5] [2021-11-19 21:04:29,382][INFO ][tcp-disco-sock-reader-[]-#412%encryption.EncryptedCacheGroupCreateTest1%-#8201%encryption.EncryptedCacheGroupCreateTest1%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:34411, rmtPort=34411, rmtNodeId=null] [21:04:29] : [Step 4/5] [2021-11-19 21:04:29,386][INFO ][tcp-disco-msg-worker-[crd]-#404%encryption.EncryptedCacheGroupCreateTest0%-#8080%encryption.EncryptedCacheGroupCreateTest0%][GridEncryptionManager] Joining node doesn't have stored group keys [node=0822ac7e-0bd1-4e7c-91c1-49875bd00001] [21:04:29] : [Step 4/5] [2021-11-19 21:04:29,396][INFO ][tcp-disco-msg-worker-[crd]-#404%encryption.EncryptedCacheGroupCreateTest0%-#8080%encryption.EncryptedCacheGroupCreateTest0%][TestTcpDiscoverySpi] New next node [newNext=TcpDiscoveryNode [id=0822ac7e-0bd1-4e7c-91c1-49875bd00001, consistentId=encryption.EncryptedCacheGroupCreateTest1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=0, intOrder=2, lastExchangeTime=1637345069376, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false]] [21:04:29] : [Step 4/5] [2021-11-19 21:04:29,397][INFO ][tcp-disco-srvr-[:47501]-#410%encryption.EncryptedCacheGroupCreateTest1%-#8199%encryption.EncryptedCacheGroupCreateTest1%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=35947] [21:04:29] : [Step 4/5] [2021-11-19 21:04:29,397][INFO ][tcp-disco-srvr-[:47501]-#410%encryption.EncryptedCacheGroupCreateTest1%-#8199%encryption.EncryptedCacheGroupCreateTest1%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=35947] [21:04:29] : [Step 4/5] [2021-11-19 21:04:29,398][INFO ][tcp-disco-sock-reader-[]-#413%encryption.EncryptedCacheGroupCreateTest1%-#8202%encryption.EncryptedCacheGroupCreateTest1%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:35947, rmtPort=35947] [21:04:29] : [Step 4/5] [2021-11-19 21:04:29,400][INFO ][tcp-disco-sock-reader-[832cfe93 127.0.0.1:35947]-#413%encryption.EncryptedCacheGroupCreateTest1%-#8202%encryption.EncryptedCacheGroupCreateTest1%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=832cfe93-7cf8-4ee5-9a59-6dc363c00000, rmtAddr=/127.0.0.1:35947] [21:04:29] : [Step 4/5] [2021-11-19 21:04:29,405][INFO ][tcp-disco-msg-worker-[]-#409%encryption.EncryptedCacheGroupCreateTest1%-#8198%encryption.EncryptedCacheGroupCreateTest1%][TestTcpDiscoverySpi] New next node [newNext=TcpDiscoveryNode [id=832cfe93-7cf8-4ee5-9a59-6dc363c00000, consistentId=encryption.EncryptedCacheGroupCreateTest0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345069396, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false]] [21:04:29] : [Step 4/5] [2021-11-19 21:04:29,407][INFO ][tcp-disco-srvr-[:47500]-#405%encryption.EncryptedCacheGroupCreateTest0%-#8081%encryption.EncryptedCacheGroupCreateTest0%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=54727] [21:04:29] : [Step 4/5] [2021-11-19 21:04:29,407][INFO ][tcp-disco-srvr-[:47500]-#405%encryption.EncryptedCacheGroupCreateTest0%-#8081%encryption.EncryptedCacheGroupCreateTest0%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=54727] [21:04:29] : [Step 4/5] [2021-11-19 21:04:29,408][INFO ][tcp-disco-sock-reader-[]-#414%encryption.EncryptedCacheGroupCreateTest0%-#8203%encryption.EncryptedCacheGroupCreateTest0%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:54727, rmtPort=54727] [21:04:29] : [Step 4/5] [2021-11-19 21:04:29,410][INFO ][tcp-disco-sock-reader-[0822ac7e 127.0.0.1:54727]-#414%encryption.EncryptedCacheGroupCreateTest0%-#8203%encryption.EncryptedCacheGroupCreateTest0%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=0822ac7e-0bd1-4e7c-91c1-49875bd00001, rmtAddr=/127.0.0.1:54727] [21:04:29] : [Step 4/5] [2021-11-19 21:04:29,413][INFO ][disco-event-worker-#8083%encryption.EncryptedCacheGroupCreateTest0%][GridDiscoveryManager] Added new node to topology: TcpDiscoveryNode [id=0822ac7e-0bd1-4e7c-91c1-49875bd00001, consistentId=encryption.EncryptedCacheGroupCreateTest1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637345069376, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false] [21:04:29] : [Step 4/5] [2021-11-19 21:04:29,414][INFO ][disco-event-worker-#8083%encryption.EncryptedCacheGroupCreateTest0%][GridDiscoveryManager] Topology snapshot [ver=2, locNode=832cfe93, servers=2, clients=0, state=INACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=832cfe93-7cf8-4ee5-9a59-6dc363c00000, consistentId=encryption.EncryptedCacheGroupCreateTest0, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=0822ac7e-0bd1-4e7c-91c1-49875bd00001, consistentId=encryption.EncryptedCacheGroupCreateTest1, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:04:29] : [Step 4/5] [2021-11-19 21:04:29,418][INFO ][tcp-disco-msg-worker-[832cfe93 127.0.0.1:47500]-#409%encryption.EncryptedCacheGroupCreateTest1%-#8198%encryption.EncryptedCacheGroupCreateTest1%][ClusterProcessor] festive_volhard [21:04:29] : [Step 4/5] [2021-11-19 21:04:29,418][INFO ][tcp-disco-msg-worker-[832cfe93 127.0.0.1:47500]-#409%encryption.EncryptedCacheGroupCreateTest1%-#8198%encryption.EncryptedCacheGroupCreateTest1%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustEnabled' was changed from 'null' to 'false' [21:04:29] : [Step 4/5] [2021-11-19 21:04:29,419][INFO ][tcp-disco-msg-worker-[832cfe93 127.0.0.1:47500]-#409%encryption.EncryptedCacheGroupCreateTest1%-#8198%encryption.EncryptedCacheGroupCreateTest1%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustTimeout' was changed from 'null' to '300000' [21:04:29] : [Step 4/5] [2021-11-19 21:04:29,419][INFO ][tcp-disco-msg-worker-[832cfe93 127.0.0.1:47500]-#409%encryption.EncryptedCacheGroupCreateTest1%-#8198%encryption.EncryptedCacheGroupCreateTest1%][IgniteTxManager] Transactions parameter 'longOperationsDumpTimeout' was changed from 'null' to '60000' [21:04:29] : [Step 4/5] [2021-11-19 21:04:29,420][INFO ][tcp-disco-msg-worker-[832cfe93 127.0.0.1:47500]-#409%encryption.EncryptedCacheGroupCreateTest1%-#8198%encryption.EncryptedCacheGroupCreateTest1%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpThreshold' was changed from 'null' to '0' [21:04:29] : [Step 4/5] [2021-11-19 21:04:29,420][INFO ][tcp-disco-msg-worker-[832cfe93 127.0.0.1:47500]-#409%encryption.EncryptedCacheGroupCreateTest1%-#8198%encryption.EncryptedCacheGroupCreateTest1%][IgniteTxManager] Transactions parameter 'transactionTimeDumpSamplesCoefficient' was changed from 'null' to '0.0' [21:04:29] : [Step 4/5] [2021-11-19 21:04:29,421][INFO ][tcp-disco-msg-worker-[832cfe93 127.0.0.1:47500]-#409%encryption.EncryptedCacheGroupCreateTest1%-#8198%encryption.EncryptedCacheGroupCreateTest1%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpSamplesPerSecondLimit' was changed from 'null' to '5' [21:04:29] : [Step 4/5] [2021-11-19 21:04:29,421][INFO ][tcp-disco-msg-worker-[832cfe93 127.0.0.1:47500]-#409%encryption.EncryptedCacheGroupCreateTest1%-#8198%encryption.EncryptedCacheGroupCreateTest1%][IgniteTxManager] Transactions parameter 'collisionsDumpInterval' was changed from 'null' to '1000' [21:04:29] : [Step 4/5] [2021-11-19 21:04:29,422][INFO ][tcp-disco-msg-worker-[832cfe93 127.0.0.1:47500]-#409%encryption.EncryptedCacheGroupCreateTest1%-#8198%encryption.EncryptedCacheGroupCreateTest1%][IgniteTxManager] Transactions parameter 'txOwnerDumpRequestsAllowed' was changed from 'null' to 'true' [21:04:29] : [Step 4/5] [2021-11-19 21:04:29,422][INFO ][tcp-disco-msg-worker-[832cfe93 127.0.0.1:47500]-#409%encryption.EncryptedCacheGroupCreateTest1%-#8198%encryption.EncryptedCacheGroupCreateTest1%][GridCacheDatabaseSharedManager] Historical rebalance WAL threshold changed [property=historical.rebalance.threshold, oldVal=null, newVal=500] [21:04:29] : [Step 4/5] [2021-11-19 21:04:29,424][INFO ][disco-notifier-worker-#8197%encryption.EncryptedCacheGroupCreateTest1%][MvccProcessorImpl] Assigned mvcc coordinator [crd=MvccCoordinator [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=0], nodeId=832cfe93-7cf8-4ee5-9a59-6dc363c00000, ver=1637345068286, local=false, initialized=false]] [21:04:29] : [Step 4/5] [2021-11-19 21:04:29,425][INFO ][sys-#8188%encryption.EncryptedCacheGroupCreateTest1%][ClusterProcessor] Writing cluster ID and tag to metastorage on ready for write ClusterIdAndTag [id=43313c43-76e1-41b9-91fe-b736c85ff371, tag=festive_volhard] [21:04:29] : [Step 4/5] [2021-11-19 21:04:29,466][INFO ][main][EncryptedCacheGroupCreateTest1] To start Console Management & Monitoring run ignitevisorcmd.{sh|bat} [21:04:29] : [Step 4/5] [2021-11-19 21:04:29,467][INFO ][main][EncryptedCacheGroupCreateTest1] [21:04:29] : [Step 4/5] [21:04:29] : [Step 4/5] >>> +-------------------------------------------+ [21:04:29] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:04:29] : [Step 4/5] >>> +-------------------------------------------+ [21:04:29] : [Step 4/5] >>> OS name: Linux 4.15.0-151-generic amd64 [21:04:29] : [Step 4/5] >>> CPU(s): 24 [21:04:29] : [Step 4/5] >>> Heap: 2.0GB [21:04:29] : [Step 4/5] >>> VM name: 16724@c4dfe9a430b2 [21:04:29] : [Step 4/5] >>> Ignite instance name: encryption.EncryptedCacheGroupCreateTest1 [21:04:29] : [Step 4/5] >>> Local node [ID=0822AC7E-0BD1-4E7C-91C1-49875BD00001, order=2, clientMode=false] [21:04:29] : [Step 4/5] >>> Local node addresses: [127.0.0.1] [21:04:29] : [Step 4/5] >>> Local ports: TCP:10801 TCP:45141 TCP:47501 [21:04:29] : [Step 4/5] [21:04:29] : [Step 4/5] [2021-11-19 21:04:29,469][INFO ][main][EncryptedCacheGroupCreateTest1] >>> Ignite cluster is in INACTIVE state (limited functionality available). Use control.(sh|bat) script or IgniteCluster.state(ClusterState.ACTIVE) to change the state. [21:04:29] : [Step 4/5] [2021-11-19 21:04:29,470][INFO ][main][GridDiscoveryManager] Topology snapshot [ver=2, locNode=0822ac7e, servers=2, clients=0, state=INACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=832cfe93-7cf8-4ee5-9a59-6dc363c00000, consistentId=encryption.EncryptedCacheGroupCreateTest0, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=0822ac7e-0bd1-4e7c-91c1-49875bd00001, consistentId=encryption.EncryptedCacheGroupCreateTest1, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:04:29] : [Step 4/5] [2021-11-19 21:04:29,471][INFO ][main][G] Node started : [stage="Configure system pool" (0 ms),stage="Start managers" (250 ms),stage="Configure binary metadata" (2 ms),stage="Start processors" (371 ms),stage="Start 'StanByClusterTestProvider' plugin" (0 ms),stage="Start 'PageMemory tracker plugin' plugin" (0 ms),stage="Start 'TestDistibutedConfigurationPlugin' plugin" (0 ms),stage="Start 'NodeValidationPluginProvider' plugin" (0 ms),stage="Init metastore" (17 ms),stage="Init and start regions" (6 ms),stage="Restore binary memory" (17 ms),stage="Restore logical state" (81 ms),stage="Finish recovery" (286 ms),stage="Join topology" (62 ms),stage="Await transition" (3 ms),stage="Await exchange" (44 ms),stage="Total time" (1139 ms)] [21:04:29] : [Step 4/5] [2021-11-19 21:04:29,473][INFO ][main][root] Node started with the following configuration [id=0822ac7e-0bd1-4e7c-91c1-49875bd00001, marshaller=BinaryMarshaller [], discovery=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=5000, ackTimeout=5000, marsh=JdkMarshaller [clsFilter=org.apache.ignite.marshaller.MarshallerUtils$1@1511d157], reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], binaryCfg=null, lateAff=true] [21:04:29] : [Step 4/5] [2021-11-19 21:04:29,476][INFO ][main][GridClusterStateProcessor] Sending activate cluster request with BaselineTopology BaselineTopology [id=0, branchingHash=3272674521, branchingType='New BaselineTopology', baselineNodes=[encryption.EncryptedCacheGroupCreateTest0, encryption.EncryptedCacheGroupCreateTest1]] [21:04:29] : [Step 4/5] [2021-11-19 21:04:29,484][INFO ][disco-notifier-worker-#8079%encryption.EncryptedCacheGroupCreateTest0%][GridClusterStateProcessor] Received activate cluster request with BaselineTopology[id=0] initiator node ID: 832cfe93-7cf8-4ee5-9a59-6dc363c00000 [21:04:29] : [Step 4/5] [2021-11-19 21:04:29,485][INFO ][disco-notifier-worker-#8079%encryption.EncryptedCacheGroupCreateTest0%][GridClusterStateProcessor] Started state transition: activate cluster [21:04:29] : [Step 4/5] [2021-11-19 21:04:29,486][INFO ][exchange-worker-#8084%encryption.EncryptedCacheGroupCreateTest0%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], crd=true, evt=DISCOVERY_CUSTOM_EVT, evtNode=832cfe93-7cf8-4ee5-9a59-6dc363c00000, customEvt=ChangeGlobalStateMessage [id=9b22d593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqId=a236ff18-dee7-4bd1-8d71-1ac47a07868a, initiatingNodeId=832cfe93-7cf8-4ee5-9a59-6dc363c00000, state=ACTIVE, baselineTopology=BaselineTopology [id=0, branchingHash=3272674521, branchingType='New BaselineTopology', baselineNodes=[encryption.EncryptedCacheGroupCreateTest0, encryption.EncryptedCacheGroupCreateTest1]], forceChangeBaselineTopology=false, timestamp=1637345069475, forceDeactivation=true], allowMerge=false, exchangeFreeSwitch=false] [21:04:29] : [Step 4/5] [2021-11-19 21:04:29,487][INFO ][exchange-worker-#8084%encryption.EncryptedCacheGroupCreateTest0%][GridDhtPartitionsExchangeFuture] Start activation process [nodeId=832cfe93-7cf8-4ee5-9a59-6dc363c00000, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]]. New state: ACTIVE [21:04:29] : [Step 4/5] [2021-11-19 21:04:29,488][INFO ][exchange-worker-#8084%encryption.EncryptedCacheGroupCreateTest0%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/encryption_EncryptedCacheGroupCreateTest0 [21:04:29] : [Step 4/5] [2021-11-19 21:04:29,492][INFO ][disco-notifier-worker-#8197%encryption.EncryptedCacheGroupCreateTest1%][GridClusterStateProcessor] Received activate cluster request with BaselineTopology[id=0] initiator node ID: 832cfe93-7cf8-4ee5-9a59-6dc363c00000 [21:04:29] : [Step 4/5] [2021-11-19 21:04:29,492][INFO ][exchange-worker-#8084%encryption.EncryptedCacheGroupCreateTest0%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/encryption_EncryptedCacheGroupCreateTest0/0000000000000000.wal, offset=8713, ver=2] [21:04:29] : [Step 4/5] [2021-11-19 21:04:29,492][INFO ][disco-notifier-worker-#8197%encryption.EncryptedCacheGroupCreateTest1%][GridClusterStateProcessor] Started state transition: activate cluster [21:04:29] : [Step 4/5] [2021-11-19 21:04:29,497][INFO ][exchange-worker-#8084%encryption.EncryptedCacheGroupCreateTest0%][GridClusterStateProcessor] Writing BaselineTopology[id=0] [21:04:29] : [Step 4/5] [2021-11-19 21:04:29,498][INFO ][exchange-worker-#8206%encryption.EncryptedCacheGroupCreateTest1%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], crd=false, evt=DISCOVERY_CUSTOM_EVT, evtNode=832cfe93-7cf8-4ee5-9a59-6dc363c00000, customEvt=ChangeGlobalStateMessage [id=9b22d593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqId=a236ff18-dee7-4bd1-8d71-1ac47a07868a, initiatingNodeId=832cfe93-7cf8-4ee5-9a59-6dc363c00000, state=ACTIVE, baselineTopology=BaselineTopology [id=0, branchingHash=3272674521, branchingType='New BaselineTopology', baselineNodes=[encryption.EncryptedCacheGroupCreateTest0, encryption.EncryptedCacheGroupCreateTest1]], forceChangeBaselineTopology=false, timestamp=1637345069475, forceDeactivation=true], allowMerge=false, exchangeFreeSwitch=false] [21:04:29] : [Step 4/5] [2021-11-19 21:04:29,500][INFO ][exchange-worker-#8206%encryption.EncryptedCacheGroupCreateTest1%][GridDhtPartitionsExchangeFuture] Start activation process [nodeId=0822ac7e-0bd1-4e7c-91c1-49875bd00001, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]]. New state: ACTIVE [21:04:29] : [Step 4/5] [2021-11-19 21:04:29,501][INFO ][exchange-worker-#8084%encryption.EncryptedCacheGroupCreateTest0%][GridCacheDatabaseSharedManager] Finish recovery performed in 13 ms. [21:04:29] : [Step 4/5] [2021-11-19 21:04:29,501][INFO ][exchange-worker-#8206%encryption.EncryptedCacheGroupCreateTest1%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/encryption_EncryptedCacheGroupCreateTest1 [21:04:29] : [Step 4/5] [2021-11-19 21:04:29,502][INFO ][exchange-worker-#8084%encryption.EncryptedCacheGroupCreateTest0%][msg] Components activation performed in 15 ms. [21:04:29] : [Step 4/5] [2021-11-19 21:04:29,504][INFO ][exchange-worker-#8084%encryption.EncryptedCacheGroupCreateTest0%][GridCacheProcessor] Finished recovery for cache [cache=ignite-sys-cache, grp=ignite-sys-cache, startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:04:29] : [Step 4/5] [2021-11-19 21:04:29,505][INFO ][exchange-worker-#8084%encryption.EncryptedCacheGroupCreateTest0%][GridDhtPartitionsExchangeFuture] Successfully activated caches [nodeId=832cfe93-7cf8-4ee5-9a59-6dc363c00000, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], newState=ACTIVE] [21:04:29] : [Step 4/5] [2021-11-19 21:04:29,506][INFO ][exchange-worker-#8084%encryption.EncryptedCacheGroupCreateTest0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:04:29] : [Step 4/5] [2021-11-19 21:04:29,509][INFO ][exchange-worker-#8206%encryption.EncryptedCacheGroupCreateTest1%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/encryption_EncryptedCacheGroupCreateTest1/0000000000000000.wal, offset=8713, ver=2] [21:04:29] : [Step 4/5] [2021-11-19 21:04:29,512][INFO ][exchange-worker-#8206%encryption.EncryptedCacheGroupCreateTest1%][GridClusterStateProcessor] Writing BaselineTopology[id=0] [21:04:29] : [Step 4/5] [2021-11-19 21:04:29,520][INFO ][exchange-worker-#8206%encryption.EncryptedCacheGroupCreateTest1%][GridCacheDatabaseSharedManager] Finish recovery performed in 17 ms. [21:04:29] : [Step 4/5] [2021-11-19 21:04:29,541][INFO ][exchange-worker-#8206%encryption.EncryptedCacheGroupCreateTest1%][msg] Components activation performed in 40 ms. [21:04:29] : [Step 4/5] [2021-11-19 21:04:29,542][INFO ][exchange-worker-#8206%encryption.EncryptedCacheGroupCreateTest1%][GridCacheProcessor] Finished recovery for cache [cache=ignite-sys-cache, grp=ignite-sys-cache, startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:04:29] : [Step 4/5] [2021-11-19 21:04:29,543][INFO ][exchange-worker-#8206%encryption.EncryptedCacheGroupCreateTest1%][GridDhtPartitionsExchangeFuture] Successfully activated caches [nodeId=0822ac7e-0bd1-4e7c-91c1-49875bd00001, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], newState=ACTIVE] [21:04:29] : [Step 4/5] [2021-11-19 21:04:29,544][INFO ][exchange-worker-#8206%encryption.EncryptedCacheGroupCreateTest1%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:04:29] : [Step 4/5] [2021-11-19 21:04:29,547][INFO ][exchange-worker-#8084%encryption.EncryptedCacheGroupCreateTest0%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], crd=true] [21:04:29] : [Step 4/5] [2021-11-19 21:04:29,549][INFO ][db-checkpoint-thread-#8215%encryption.EncryptedCacheGroupCreateTest0%][Checkpointer] Checkpoint started [checkpointId=282b9977-4d7d-428a-bc0f-1c97db60c2a4, startPtr=WALPointer [idx=0, fileOff=86485, len=1963], checkpointBeforeLockTime=5ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=1ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=0ms, pages=18, reason='node started'] [21:04:29] : [Step 4/5] [2021-11-19 21:04:29,576][INFO ][grid-nio-worker-tcp-comm-0-#8023%TcpCommunicationSpi%][TcpCommunicationSpi] Accepted incoming communication connection [locAddr=/127.0.0.1:45140, rmtAddr=/127.0.0.1:57166] [21:04:29] : [Step 4/5] [2021-11-19 21:04:29,578][INFO ][grid-nio-worker-tcp-comm-0-#8141%TcpCommunicationSpi%][TcpCommunicationSpi] Established outgoing communication connection [locAddr=/127.0.0.1:57166, rmtAddr=/127.0.0.1:45140] [21:04:29] : [Step 4/5] [2021-11-19 21:04:29,579][INFO ][exchange-worker-#8206%encryption.EncryptedCacheGroupCreateTest1%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], crd=false] [21:04:29] : [Step 4/5] [2021-11-19 21:04:29,581][INFO ][sys-#8056%encryption.EncryptedCacheGroupCreateTest0%][GridDhtPartitionsExchangeFuture] Coordinator received single message [ver=AffinityTopologyVersion [topVer=2, minorTopVer=1], node=0822ac7e-0bd1-4e7c-91c1-49875bd00001, allReceived=true] [21:04:29] : [Step 4/5] [2021-11-19 21:04:29,581][INFO ][sys-#8056%encryption.EncryptedCacheGroupCreateTest0%][GridDhtPartitionsExchangeFuture] finishExchangeOnCoordinator [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:04:29] : [Step 4/5] [2021-11-19 21:04:29,588][INFO ][db-checkpoint-thread-#8215%encryption.EncryptedCacheGroupCreateTest0%][Checkpointer] Checkpoint finished [cpId=282b9977-4d7d-428a-bc0f-1c97db60c2a4, pages=18, markPos=WALPointer [idx=0, fileOff=86485, len=1963], walSegmentsCovered=[], markDuration=3ms, pagesWrite=19ms, fsync=19ms, total=46ms] [21:04:29] : [Step 4/5] [2021-11-19 21:04:29,588][INFO ][db-checkpoint-thread-#8221%encryption.EncryptedCacheGroupCreateTest1%][Checkpointer] Checkpoint started [checkpointId=dc86d431-dd21-4993-b9cb-978fe9c21d78, startPtr=WALPointer [idx=0, fileOff=86485, len=1963], checkpointBeforeLockTime=16ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=5ms, writeCheckpointEntryDuration=9ms, splitAndSortCpPagesDuration=0ms, pages=18, reason='node started'] [21:04:29] : [Step 4/5] [2021-11-19 21:04:29,590][INFO ][sys-#8190%encryption.EncryptedCacheGroupCreateTest1%][GridDhtPartitionsExchangeFuture] Received full message, will finish exchange [node=832cfe93-7cf8-4ee5-9a59-6dc363c00000, resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:04:29] : [Step 4/5] [2021-11-19 21:04:29,589][INFO ][disco-notifier-worker-#8079%encryption.EncryptedCacheGroupCreateTest0%][GridClusterStateProcessor] Received state change finish message: ACTIVE [21:04:29] : [Step 4/5] [2021-11-19 21:04:29,590][INFO ][sys-#8056%encryption.EncryptedCacheGroupCreateTest0%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], err=null, rebalanced=true, wasRebalanced=false] [21:04:29] : [Step 4/5] [2021-11-19 21:04:29,591][INFO ][disco-notifier-worker-#8197%encryption.EncryptedCacheGroupCreateTest1%][GridClusterStateProcessor] Received state change finish message: ACTIVE [21:04:29] : [Step 4/5] [2021-11-19 21:04:29,591][INFO ][sys-#8190%encryption.EncryptedCacheGroupCreateTest1%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], err=null, rebalanced=true, wasRebalanced=false] [21:04:29] : [Step 4/5] [2021-11-19 21:04:29,591][INFO ][disco-notifier-worker-#8079%encryption.EncryptedCacheGroupCreateTest0%][GridClusterStateProcessor] Cluster state was changed from INACTIVE to ACTIVE [21:04:29] : [Step 4/5] [2021-11-19 21:04:29,597][INFO ][sys-#8190%encryption.EncryptedCacheGroupCreateTest1%][GridCacheProcessor] Finish proxy initialization, cacheName=ignite-sys-cache, localNodeId=0822ac7e-0bd1-4e7c-91c1-49875bd00001 [21:04:29] : [Step 4/5] [2021-11-19 21:04:29,596][INFO ][sys-#8178%encryption.EncryptedCacheGroupCreateTest1%][GridCachePartitionExchangeManager] Delay process full message without exchange id (there is exchange in progress) [nodeId=832cfe93-7cf8-4ee5-9a59-6dc363c00000] [21:04:29] : [Step 4/5] [2021-11-19 21:04:29,592][INFO ][disco-notifier-worker-#8197%encryption.EncryptedCacheGroupCreateTest1%][GridClusterStateProcessor] Cluster state was changed from INACTIVE to ACTIVE [21:04:29] : [Step 4/5] [2021-11-19 21:04:29,600][INFO ][sys-#8056%encryption.EncryptedCacheGroupCreateTest0%][GridCacheProcessor] Finish proxy initialization, cacheName=ignite-sys-cache, localNodeId=832cfe93-7cf8-4ee5-9a59-6dc363c00000 [21:04:29] : [Step 4/5] [2021-11-19 21:04:29,600][INFO ][sys-#8190%encryption.EncryptedCacheGroupCreateTest1%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=0822ac7e-0bd1-4e7c-91c1-49875bd00001, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=832cfe93-7cf8-4ee5-9a59-6dc363c00000, consistentId=encryption.EncryptedCacheGroupCreateTest0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345069396, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:04:29] : [Step 4/5] [2021-11-19 21:04:29,600][INFO ][exchange-worker-#8206%encryption.EncryptedCacheGroupCreateTest1%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=2, minorTopVer=1], force=false, evt=DISCOVERY_CUSTOM_EVT, node=832cfe93-7cf8-4ee5-9a59-6dc363c00000] [21:04:29] : [Step 4/5] [2021-11-19 21:04:29,599][INFO ][sys-#8182%encryption.EncryptedCacheGroupCreateTest1%][DistributedBaselineConfiguration] Baseline auto-adjust is 'disabled' with timeout='300000' ms [21:04:29] : [Step 4/5] [2021-11-19 21:04:29,602][INFO ][main][root] awaitPartitionMapExchange finished [21:04:29] : [Step 4/5] [2021-11-19 21:04:29,602][INFO ][sys-#8190%encryption.EncryptedCacheGroupCreateTest1%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (2 ms), stage="Update caches registry" (41 ms), stage="Start caches" (0 ms), stage="Affinity initialization on cache group start" (0 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Restore partition states" (0 ms), stage="After states restored callback" (28 ms), stage="WAL history reservation" (0 ms), stage="Waiting for Full message" (17 ms), stage="Affinity recalculation" (0 ms), stage="Full map updating" (0 ms), stage="Detect lost partitions" (5 ms), stage="Exchange done" (5 ms), stage="Total time" (98 ms)] [21:04:29] : [Step 4/5] [2021-11-19 21:04:29,601][INFO ][exchange-worker-#8084%encryption.EncryptedCacheGroupCreateTest0%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=2, minorTopVer=1], force=false, evt=DISCOVERY_CUSTOM_EVT, node=832cfe93-7cf8-4ee5-9a59-6dc363c00000] [21:04:29] : [Step 4/5] [2021-11-19 21:04:29,601][INFO ][sys-#8056%encryption.EncryptedCacheGroupCreateTest0%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=832cfe93-7cf8-4ee5-9a59-6dc363c00000, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=832cfe93-7cf8-4ee5-9a59-6dc363c00000, consistentId=encryption.EncryptedCacheGroupCreateTest0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345069588, loc=true, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:04:29] : [Step 4/5] [2021-11-19 21:04:29,601][INFO ][sys-#8058%encryption.EncryptedCacheGroupCreateTest0%][DistributedBaselineConfiguration] Baseline auto-adjust is 'disabled' with timeout='300000' ms [21:04:29] : [Step 4/5] [2021-11-19 21:04:29,606][INFO ][sys-#8056%encryption.EncryptedCacheGroupCreateTest0%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (1 ms), stage="Update caches registry" (17 ms), stage="Start caches" (0 ms), stage="Affinity initialization on cache group start" (0 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Restore partition states" (0 ms), stage="After states restored callback" (40 ms), stage="WAL history reservation" (0 ms), stage="Waiting for all single messages" (34 ms), stage="Affinity recalculation (crd)" (0 ms), stage="Collect update counters and create affinity messages" (0 ms), stage="Assign partitions states" (1 ms), stage="Validate partitions states" (0 ms), stage="Ideal affinity diff calculation (enforced)" (0 ms), stage="Apply update counters" (0 ms), stage="Full message preparing" (3 ms), stage="Full message sending" (0 ms), stage="State finish message sending" (2 ms), stage="Detect lost partitions" (7 ms), stage="Exchange done" (8 ms), stage="Total time" (113 ms), Discovery lag=13 ms, Latest started node id=0822ac7e-0bd1-4e7c-91c1-49875bd00001] [21:04:29] : [Step 4/5] [2021-11-19 21:04:29,604][INFO ][sys-#8190%encryption.EncryptedCacheGroupCreateTest1%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], stage="Affinity initialization on cache group start [grp=ignite-sys-cache]" (0 ms) (parent=Affinity initialization on cache group start), stage="Affinity centralized initialization (crd) [grp=ignite-sys-cache, crd=false]" (0 ms) (parent=Determine exchange type), stage="Restore partition states [grp=ignite-sys-cache]" (0 ms) (parent=Restore partition states), stage="Affinity applying from full message [grp=ignite-sys-cache]" (0 ms) (parent=Affinity recalculation)] [21:04:29] : [Step 4/5] [2021-11-19 21:04:29,603][INFO ][sys-#8182%encryption.EncryptedCacheGroupCreateTest1%][GridClusterStateProcessor] Successfully performed fina [21:04:29] : [Step 4/5] Running org.apache.ignite.internal.encryption.EncryptedCacheGroupCreateTest [21:04:29] : [Step 4/5] l activation steps [nodeId=0822ac7e-0bd1-4e7c-91c1-49875bd00001, cl [21:04:29]i: [Step 4/5] ##teamcity[importData type='surefire' path='/opt/buildagent/temp/buildTmp/ignite-tools-junit-reports1777670380320881607/test-org.apache.ignite.testsuites.IgniteBasicWithPersistenceTestSuite1637345043703.xml'] [21:04:29] : [Step 4/5] Importing data from '/opt/buildagent/temp/buildTmp/ignite-tools-junit-reports1777670380320881607/test-org.apache.ignite.testsuites.IgniteBasicWithPersistenceTestSuite1637345043703.xml' (418 B) with 'surefire' processor [21:04:29] : [Step 4/5] ient=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:04:29] : [Step 4/5] [2021-11-19 21:04:29,609][INFO ][sys-#8056%encryption.EncryptedCacheGroupCreateTest0%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], stage="Affinity initialization on cache group start [grp=ignite-sys-cache]" (0 ms) (parent=Affinity initialization on cache group start), stage="Affinity centralized initialization (crd) [grp=ignite-sys-cache, crd=true]" (0 ms) (parent=Determine exchange type), stage="Restore partition states [grp=ignite-sys-cache]" (0 ms) (parent=Restore partition states), stage="Affinity recalculation (partitions availability) [grp=ignite-sys-cache]" (0 ms) (parent=Ideal affinity diff cal[21:04:29] >>> Starting test: EncryptedCacheGroupculation (enforced))] [21:04:29] : [Step 4/5] CreateTest#testCreateNot[202En1-c11ryp-19 21:04:29,607][INFO ][sys-#8058%encryption.EncryptedCacheGroupCreateTest0%][GridClusterStateProcessor] Successfully performed final activation steps [nodeId=832cfe93-7cf8-4ee5-9a59-6dc363c00000, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:04:29] : [Step 4/5] tedCacheInEncryptedGroupFails <<< [21:04:29] : [Step 4/5] [2021-11-19 21:04:29,613][INFO ][main][root] >>> Starting test: EncryptedCacheGroupCreateTest#testCreateNotEncryptedCacheInEncryptedGroupFails <<< [21:04:29] : [Step 4/5] [21:04:29] >>> Heap: 439 MB used / 1941 MB commited / 1941 MB max <<< [21:04:29] : [Step 4/5] [2021-11-19 21:04:29,614][INFO ][main][root] >>> Heap: 439 MB used / 1941 MB commited / 1941 MB max <<< [21:04:29] : [Step 4/5] [21:04:29] >>> Non-Heap: 137 MB used / 149 MB commited / 0 MB max <<< [21:04:29] : [Step 4/5] [2021-11-19 21:04:29,614][INFO ][main][root] >>> Non-Heap: 137 MB used / 149 MB commited / 0 MB max <<< [21:04:29] : [Step 4/5] [2021-11-19 21:04:29,617][INFO ][db-checkpoint-thread-#8221%encryption.EncryptedCacheGroupCreateTest1%][Checkpointer] Checkpoint finished [cpId=dc86d431-dd21-4993-b9cb-978fe9c21d78, pages=18, markPos=WALPointer [idx=0, fileOff=86485, len=1963], walSegmentsCovered=[], markDuration=18ms, pagesWrite=8ms, fsync=19ms, total=61ms] [21:04:29] : [Step 4/5] [2021-11-19 21:04:29,699][INFO ][exchange-worker-#8206%encryption.EncryptedCacheGroupCreateTest1%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], crd=false, evt=DISCOVERY_CUSTOM_EVT, evtNode=832cfe93-7cf8-4ee5-9a59-6dc363c00000, customEvt=DynamicCacheChangeBatch [id=dd22d593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqs=ArrayList [DynamicCacheChangeRequest [cacheName=encrypted3, hasCfg=true, nodeId=832cfe93-7cf8-4ee5-9a59-6dc363c00000, clientStartOnly=false, stop=false, destroy=false, disabledAfterStart=false]], exchangeActions=ExchangeActions [startCaches=[encrypted3], stopCaches=null, startGrps=[encrypted-group3], stopGrps=[], resetParts=null, stateChangeRequest=null], startCaches=false], allowMerge=false, exchangeFreeSwitch=false] [21:04:29] : [Step 4/5] [2021-11-19 21:04:29,701][INFO ][exchange-worker-#8206%encryption.EncryptedCacheGroupCreateTest1%][PageMemoryImpl] Started page memory [memoryAllocated=24.0 MiB, pages=5952, tableSize=474.2 KiB, replacementSize=768 B, checkpointBuffer=10.0 MiB] [21:04:29] : [Step 4/5] [2021-11-19 21:04:29,781][INFO ][exchange-worker-#8206%encryption.EncryptedCacheGroupCreateTest1%][GridCacheProcessor] Started cache [name=encrypted3, id=-1512636689, group=encrypted-group3, dataRegionName=default, mode=PARTITIONED, atomicity=ATOMIC, backups=0, mvcc=false] [21:04:29]W: [org.apache.ignite:ignite-core] [2021-11-19 21:04:29,784][WARN ][exchange-worker-#8206%encryption.EncryptedCacheGroupCreateTest1%][CacheAffinitySharedManager] Cache group 'encrypted-group3' brings high overhead for its metainformation in data region 'default'. Metainformation required for its partitions (505 partitions, 4096 bytes per partition, 1 MBs total) will consume more than 15% of data region memory (10 MBs). It may lead to critical errors on the node and cluster instability. Please reduce number of partitions, add more memory to the data region or add more server nodes for this cache group. [21:04:29] : [Step 4/5] [2021-11-19 21:04:29,787][INFO ][exchange-worker-#8206%encryption.EncryptedCacheGroupCreateTest1%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], waitTime=0ms, futInfo=NA, mode=DISTRIBUTED] [21:04:29] : [Step 4/5] [2021-11-19 21:04:29,810][INFO ][exchange-worker-#8084%encryption.EncryptedCacheGroupCreateTest0%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], crd=true, evt=DISCOVERY_CUSTOM_EVT, evtNode=832cfe93-7cf8-4ee5-9a59-6dc363c00000, customEvt=DynamicCacheChangeBatch [id=dd22d593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqs=ArrayList [DynamicCacheChangeRequest [cacheName=encrypted3, hasCfg=true, nodeId=832cfe93-7cf8-4ee5-9a59-6dc363c00000, clientStartOnly=false, stop=false, destroy=false, disabledAfterStart=false]], exchangeActions=ExchangeActions [startCaches=[encrypted3], stopCaches=null, startGrps=[encrypted-group3], stopGrps=[], resetParts=null, stateChangeRequest=null], startCaches=false], allowMerge=false, exchangeFreeSwitch=false] [21:04:29] : [Step 4/5] [2021-11-19 21:04:29,812][INFO ][exchange-worker-#8084%encryption.EncryptedCacheGroupCreateTest0%][PageMemoryImpl] Started page memory [memoryAllocated=24.0 MiB, pages=5952, tableSize=474.2 KiB, replacementSize=768 B, checkpointBuffer=10.0 MiB] [21:04:29] : [Step 4/5] Surefire report watcher [21:04:29] : [Surefire report watcher] Watching paths: [21:04:29] : [Surefire report watcher] /opt/buildagent/temp/buildTmp/ignite-tools-junit-reports1777670380320881607/test-org.apache.ignite.testsuites.IgniteBasicWithPersistenceTestSuite1637345043703.xml [21:04:29]i: [Step 4/5] org.apache.ignite.testsuites.IgniteBasicWithPersistenceTestSuite [21:04:29]i: [org.apache.ignite.testsuites.IgniteBasicWithPersistenceTestSuite] org.apache.ignite.internal.encryption.EncryptedCacheDestroyTest.testEncryptedCacheFromGroupDestroy [21:04:29]i: [org.apache.ignite.testsuites.IgniteBasicWithPersistenceTestSuite] org.apache.ignite.internal.encryption.EncryptedCacheDestroyTest.testEncryptedCacheDestroy [21:04:29] : [Step 4/5] [2021-11-19 21:04:29,884][INFO ][exchange-worker-#8084%encryption.EncryptedCacheGroupCreateTest0%][GridCacheProcessor] Started cache [name=encrypted3, id=-1512636689, group=encrypted-group3, dataRegionName=default, mode=PARTITIONED, atomicity=ATOMIC, backups=0, mvcc=false] [21:04:29]W: [org.apache.ignite:ignite-core] [2021-11-19 21:04:29,886][WARN ][exchange-worker-#8084%encryption.EncryptedCacheGroupCreateTest0%][CacheAffinitySharedManager] Cache group 'encrypted-group3' brings high overhead for its metainformation in data region 'default'. Metainformation required for its partitions (519 partitions, 4096 bytes per partition, 2 MBs total) will consume more than 15% of data region memory (10 MBs). It may lead to critical errors on the node and cluster instability. Please reduce number of partitions, add more memory to the data region or add more server nodes for this cache group. [21:04:29] : [Step 4/5] [2021-11-19 21:04:29,887][INFO ][exchange-worker-#8084%encryption.EncryptedCacheGroupCreateTest0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], waitTime=0ms, futInfo=NA, mode=DISTRIBUTED] [21:04:29] : [Step 4/5] [2021-11-19 21:04:29,888][INFO ][exchange-worker-#8084%encryption.EncryptedCacheGroupCreateTest0%][GridDhtPartitionsExchangeFuture] Finished waiting for partitions release latch: ServerLatch [permits=0, pendingAcks=HashSet [], super=CompletableLatch [id=CompletableLatchUid [id=exchange, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2]]]] [21:04:29] : [Step 4/5] [2021-11-19 21:04:29,889][INFO ][exchange-worker-#8206%encryption.EncryptedCacheGroupCreateTest1%][GridDhtPartitionsExchangeFuture] Finished waiting for partitions release latch: ClientLatch [coordinator=TcpDiscoveryNode [id=832cfe93-7cf8-4ee5-9a59-6dc363c00000, consistentId=encryption.EncryptedCacheGroupCreateTest0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345069396, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], ackSent=true, super=CompletableLatch [id=CompletableLatchUid [id=exchange, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2]]]] [21:04:29] : [Step 4/5] [2021-11-19 21:04:29,889][INFO ][exchange-worker-#8084%encryption.EncryptedCacheGroupCreateTest0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:04:29] : [Step 4/5] [2021-11-19 21:04:29,890][INFO ][exchange-worker-#8206%encryption.EncryptedCacheGroupCreateTest1%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:04:29] : [Step 4/5] [2021-11-19 21:04:29,906][INFO ][exchange-worker-#8084%encryption.EncryptedCacheGroupCreateTest0%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], crd=true] [21:04:29] : [Step 4/5] [2021-11-19 21:04:29,907][INFO ][exchange-worker-#8206%encryption.EncryptedCacheGroupCreateTest1%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], crd=false] [21:04:29] : [Step 4/5] [2021-11-19 21:04:29,908][INFO ][sys-#8062%encryption.EncryptedCacheGroupCreateTest0%][GridDhtPartitionsExchangeFuture] Coordinator received single message [ver=AffinityTopologyVersion [topVer=2, minorTopVer=2], node=0822ac7e-0bd1-4e7c-91c1-49875bd00001, allReceived=true] [21:04:29] : [Step 4/5] [2021-11-19 21:04:29,908][INFO ][sys-#8062%encryption.EncryptedCacheGroupCreateTest0%][GridDhtPartitionsExchangeFuture] finishExchangeOnCoordinator [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2]] [21:04:29] : [Step 4/5] [2021-11-19 21:04:29,916][INFO ][sys-#8062%encryption.EncryptedCacheGroupCreateTest0%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], err=null, rebalanced=true, wasRebalanced=true] [21:04:29] : [Step 4/5] [2021-11-19 21:04:29,918][INFO ][sys-#8062%encryption.EncryptedCacheGroupCreateTest0%][GridCacheProcessor] Finish proxy initialization, cacheName=encrypted3, localNodeId=832cfe93-7cf8-4ee5-9a59-6dc363c00000 [21:04:29] : [Step 4/5] [2021-11-19 21:04:29,918][INFO ][sys-#8187%encryption.EncryptedCacheGroupCreateTest1%][GridDhtPartitionsExchangeFuture] Received full message, will finish exchange [node=832cfe93-7cf8-4ee5-9a59-6dc363c00000, resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2]] [21:04:29] : [Step 4/5] [2021-11-19 21:04:29,919][INFO ][sys-#8062%encryption.EncryptedCacheGroupCreateTest0%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=832cfe93-7cf8-4ee5-9a59-6dc363c00000, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=832cfe93-7cf8-4ee5-9a59-6dc363c00000, consistentId=encryption.EncryptedCacheGroupCreateTest0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345069619, loc=true, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [top[2Ver1:=204:, minorTopVer=2]] [21:04:29] : [Step 4/5] 29] >>> Stopping test: EncryptedCacheGroupCreateTest#testCreateNotEncryptedCacheIn[2021-11-1Encrypted9 21:0Grou4:29,pFai922]ls in 30[INFO ][sys-#87 ms <<< [21:04:29] : [Step 4/5] 187%encryption.EncryptedCacheGroupCreateTest1%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], err=null, rebalanced=true, wasRebalanced=true] [21:04:29] : [Step 4/5] [2021-11-19 21:04:29,919][INFO ][exchange-worker-#8084%encryption.EncryptedCacheGroupCreateTest0%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=2, minorTopVer=2], force=false, evt=DISCOVERY_CUSTOM_EVT, node=832cfe93-7cf8-4ee5-9a59-6dc363c00000] [21:04:29] : [Step 4/5] [2021-11-19 21:04:29,923][INFO ][main][root] >>> Stopping test: EncryptedCacheGroupCreateTest#testCreateNotEncryptedCacheInEncryptedGroupFails in 307 ms <<< [21:04:29] : [Step 4/5] [2[2021-11-19 21:04:29,922][INFO ][sys-#8062%encryption.EncryptedCacheGroupCreateTest0%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, mino1:04:29] >>> HeaprTopVer=2], : 4stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (1 ms), stage="Update caches registry" (0 ms), stage="S65tart MB used / 1941 M caches" (73 ms), stage="Affinity initialization on cB cachomme gited / 1941 MB max <<< [21:04:29] : [Step 4/5] roup start" (2 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Wait partitions release latch [latch=exchange]" (0 ms), stage="Wait partitions release [latch=exchange]" (1 ms), stage="Restore partition states" (12 ms), stage="After states restored callback" (2 ms), stage="WAL history reservation" (0 ms), stage="Waiting for all single messages" (2 ms), stage="Affinity recalculation (crd)" (0 ms), stage="Collect update counters and create affinity messages" (0 ms), stage="Assign partitions states" (3 ms), stage="Validate partitions states" (0 ms), stage="Apply update counters" (0 ms), stage="Full message preparing" (2 ms), stage="Full message sending" (0 ms), stage="Exchange done" (5 ms), stage="Total time" (103 ms), Discovery lag=112 ms, Latest started node id=832cfe93-7cf8-4ee5-9a59-6dc363c00000] [21:04:29] : [Step 4/5] [2021-11-19 21:04:29,926][INFO ][main][root] >>> Heap: 465 MB used / 1941 MB commited / 1941 MB max <<< [21:04:29] : [Step 4/5] [21:04:29] [2021-11-19 21:>>> Non-Heap: 137 MB used / 149 MB commited / 0 MB max <<< [21:04:29] : [Step 4/5] 04:29,924][INFO ][sys-#8187%encryption.EncryptedCacheGroupCreateTest1%][GridCacheProcessor] Finish proxy initialization, cacheName=encrypted3, localNodeId=0822ac7e-0bd1-4e7c-91c1-49875bd00001 [21:04:29] : [Step 4/5] [2021-11-19 21:04:29,928][INFO ][main][root] >>> Non-Heap: 137 MB used / 149 MB commited / 0 MB max <<< [21:04:29] : [Step 4/5] [2021-11-19 21:04:29,927][INFO ][sys-#8062%encryption.EncryptedCacheGroupCreateTest0%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], stage="Affinity initialization on cache group start [grp=encrypted-group3]" (1 ms) (parent=Affinity initialization on cache group start), stage="Restore partition states [grp=encrypted-group3]" (12 ms) (parent=Restore partition states), stage="Restore partition states [grp=ignite-sys-cache]" (0 ms) (parent=Restore partition states)] [21:04:29] : [Step 4/5] [2021-11-19 21:04:29,929][INFO ][exchange-worker-#8206%encryption.EncryptedCacheGroupCreateTest1%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=2, minorTopVer=2], force=false, evt=DISCOVERY_CUSTOM_EVT, node=832cfe93-7cf8-4ee5-9a59-6dc363c00000] [21:04:29] : [Step 4/5] [2021-11-19 21:04:29,928][INFO ][sys-#8187%encryption.EncryptedCacheGroupCreateTest1%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=0822ac7e-0bd1-4e7c-91c1-49875bd00001, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], evt=DI[21:SC04:29] >>> Starting test: EncryptedCacheGroupCreateTest#testCreateEncryptedCacheGroup <<< [21:04:29] : [Step 4/5] OVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=832cfe93-7cf8-4ee5-9a59-6dc363c00000, consistentId=encryption.EncryptedCacheGroupCreateTest0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345069396, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2]] [21:04:29] : [Step 4/5] [2021-11-19 21:04:29,936][INFO ][main][root] >>> Starting test: EncryptedCacheGroupCreateTest#testCreateEncryptedCacheGroup <<< [21:04:29] : [Step 4/5] [21:04:29] >>> Heap: 465 MB used / 1941 M[2021B commit-1ed / 1941 MB m1-19 21:04:29,ax <<< [21:04:29] : [Step 4/5] 938][INFO ][sys-#8187%encryption.EncryptedCacheGroupCreateTest1%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (1 ms), stage="Update caches registry" (0 ms), stage="Start caches" (81 ms), stage="Affinity initialization on cache group start" (4 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Wait partitions release latch [latch=exchange]" (102 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Restore partition states" (12 ms), stage="After states restored callback" (2 ms), stage="WAL history reservation" (0 ms), stage="Waiting for Full message" (12 ms), stage="Affinity recalculation" (0 ms), stage="Full map updating" (2 ms), stage="Exchange done" (15 ms), stage="Total time" (231 ms)] [21:04:29] : [Step 4/5] [2021-11-19 21:04:29,938][INFO ][main][root] >>> Heap: 465 MB used / 1941 MB commited / 1941 MB max <<< [21:04:29] : [Step 4/5] [2[21021-11-19 21:0:04:4:29] >>> Non-Heap: 137 MB used / 149 MB commited / 029,941][IN MFOB max <<< [21:04:29] : [Step 4/5] ][sys-#8187%encryption.EncryptedCacheGroupCreateTest1%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], stage="Affinity initialization on cache group start [grp=encrypted-group3]" (2 ms) (parent=Affinity initialization on cache group start), stage="Restore partition states [grp=encrypted-group3]" (12 ms) (parent=Restore partition states), stage="Restore partition states [grp=ignite-sys-cache]" (0 ms) (parent=Restore partition states)] [21:04:29] : [Step 4/5] [2021-11-19 21:04:29,941][INFO ][main][root] >>> Non-Heap: 137 MB used / 149 MB commited / 0 MB max <<< [21:04:30] : [Step 4/5] [2021-11-19 21:04:30,086][INFO ][exchange-worker-#8206%encryption.EncryptedCacheGroupCreateTest1%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=3], crd=false, evt=DISCOVERY_CUSTOM_EVT, evtNode=832cfe93-7cf8-4ee5-9a59-6dc363c00000, customEvt=DynamicCacheChangeBatch [id=ee22d593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqs=ArrayList [DynamicCacheChangeRequest [cacheName=encrypted, hasCfg=true, nodeId=832cfe93-7cf8-4ee5-9a59-6dc363c00000, clientStartOnly=false, stop=false, destroy=false, disabledAfterStart=false]], exchangeActions=ExchangeActions [startCaches=[encrypted], stopCaches=null, startGrps=[encrypted-group], stopGrps=[], resetParts=null, stateChangeRequest=null], startCaches=false], allowMerge=false, exchangeFreeSwitch=false] [21:04:30] : [Step 4/5] [2021-11-19 21:04:30,086][INFO ][exchange-worker-#8084%encryption.EncryptedCacheGroupCreateTest0%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=3], crd=true, evt=DISCOVERY_CUSTOM_EVT, evtNode=832cfe93-7cf8-4ee5-9a59-6dc363c00000, customEvt=DynamicCacheChangeBatch [id=ee22d593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqs=ArrayList [DynamicCacheChangeRequest [cacheName=encrypted, hasCfg=true, nodeId=832cfe93-7cf8-4ee5-9a59-6dc363c00000, clientStartOnly=false, stop=false, destroy=false, disabledAfterStart=false]], exchangeActions=ExchangeActions [startCaches=[encrypted], stopCaches=null, startGrps=[encrypted-group], stopGrps=[], resetParts=null, stateChangeRequest=null], startCaches=false], allowMerge=false, exchangeFreeSwitch=false] [21:04:30]W: [org.apache.ignite:ignite-core] [2021-11-19 21:04:30,188][WARN ][exchange-worker-#8084%encryption.EncryptedCacheGroupCreateTest0%][CacheAffinitySharedManager] Cache group 'encrypted-group' brings high overhead for its metainformation in data region 'default'. Metainformation required for its partitions (519 partitions, 4096 bytes per partition, 2 MBs total) will consume more than 15% of data region memory (10 MBs). It may lead to critical errors on the node and cluster instability. Please reduce number of partitions, add more memory to the data region or add more server nodes for this cache group. [21:04:30] : [Step 4/5] [2021-11-19 21:04:30,185][INFO ][exchange-worker-#8084%encryption.EncryptedCacheGroupCreateTest0%][GridCacheProcessor] Started cache [name=encrypted, id=1613773252, group=encrypted-group, dataRegionName=default, mode=PARTITIONED, atomicity=ATOMIC, backups=0, mvcc=false] [21:04:30] : [Step 4/5] [2021-11-19 21:04:30,190][INFO ][exchange-worker-#8084%encryption.EncryptedCacheGroupCreateTest0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=3], waitTime=0ms, futInfo=NA, mode=DISTRIBUTED] [21:04:30] : [Step 4/5] [2021-11-19 21:04:30,194][INFO ][exchange-worker-#8206%encryption.EncryptedCacheGroupCreateTest1%][GridCacheProcessor] Started cache [name=encrypted, id=1613773252, group=encrypted-group, dataRegionName=default, mode=PARTITIONED, atomicity=ATOMIC, backups=0, mvcc=false] [21:04:30]W: [org.apache.ignite:ignite-core] [2021-11-19 21:04:30,197][WARN ][exchange-worker-#8206%encryption.EncryptedCacheGroupCreateTest1%][CacheAffinitySharedManager] Cache group 'encrypted-group' brings high overhead for its metainformation in data region 'default'. Metainformation required for its partitions (505 partitions, 4096 bytes per partition, 1 MBs total) will consume more than 15% of data region memory (10 MBs). It may lead to critical errors on the node and cluster instability. Please reduce number of partitions, add more memory to the data region or add more server nodes for this cache group. [21:04:30] : [Step 4/5] [2021-11-19 21:04:30,201][INFO ][exchange-worker-#8206%encryption.EncryptedCacheGroupCreateTest1%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=3], waitTime=0ms, futInfo=NA, mode=DISTRIBUTED] [21:04:30] : [Step 4/5] [2021-11-19 21:04:30,202][INFO ][exchange-worker-#8084%encryption.EncryptedCacheGroupCreateTest0%][GridDhtPartitionsExchangeFuture] Finished waiting for partitions release latch: ServerLatch [permits=0, pendingAcks=HashSet [], super=CompletableLatch [id=CompletableLatchUid [id=exchange, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=3]]]] [21:04:30] : [Step 4/5] [2021-11-19 21:04:30,203][INFO ][exchange-worker-#8206%encryption.EncryptedCacheGroupCreateTest1%][GridDhtPartitionsExchangeFuture] Finished waiting for partitions release latch: ClientLatch [coordinator=TcpDiscoveryNode [id=832cfe93-7cf8-4ee5-9a59-6dc363c00000, consistentId=encryption.EncryptedCacheGroupCreateTest0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345069396, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], ackSent=true, super=CompletableLatch [id=CompletableLatchUid [id=exchange, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=3]]]] [21:04:30] : [Step 4/5] [2021-11-19 21:04:30,203][INFO ][exchange-worker-#8084%encryption.EncryptedCacheGroupCreateTest0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=3], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:04:30] : [Step 4/5] [2021-11-19 21:04:30,205][INFO ][exchange-worker-#8206%encryption.EncryptedCacheGroupCreateTest1%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=3], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:04:30] : [Step 4/5] [2021-11-19 21:04:30,230][INFO ][exchange-worker-#8084%encryption.EncryptedCacheGroupCreateTest0%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=3], crd=true] [21:04:30] : [Step 4/5] [2021-11-19 21:04:30,235][INFO ][exchange-worker-#8206%encryption.EncryptedCacheGroupCreateTest1%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=3], crd=false] [21:04:30] : [Step 4/5] [2021-11-19 21:04:30,236][INFO ][sys-#8059%encryption.EncryptedCacheGroupCreateTest0%][GridDhtPartitionsExchangeFuture] Coordinator received single message [ver=AffinityTopologyVersion [topVer=2, minorTopVer=3], node=0822ac7e-0bd1-4e7c-91c1-49875bd00001, allReceived=true] [21:04:30] : [Step 4/5] [2021-11-19 21:04:30,237][INFO ][sys-#8059%encryption.EncryptedCacheGroupCreateTest0%][GridDhtPartitionsExchangeFuture] finishExchangeOnCoordinator [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=3], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=3]] [21:04:30] : [Step 4/5] [2021-11-19 21:04:30,251][INFO ][sys-#8059%encryption.EncryptedCacheGroupCreateTest0%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=3], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=3], err=null, rebalanced=true, wasRebalanced=true] [21:04:30] : [Step 4/5] [2021-11-19 21:04:30,254][INFO ][sys-#8174%encryption.EncryptedCacheGroupCreateTest1%][GridDhtPartitionsExchangeFuture] Received full message, will finish exchange [node=832cfe93-7cf8-4ee5-9a59-6dc363c00000, resVer=AffinityTopologyVersion [topVer=2, minorTopVer=3]] [21:04:30] : [Step 4/5] [2021-11-19 21:04:30,255][INFO ][sys-#8059%encryption.EncryptedCacheGroupCreateTest0%][GridCacheProcessor] Finish proxy initialization, cacheName=encrypted, localNodeId=832cfe93-7cf8-4ee5-9a59-6dc363c00000 [21:04:30] : [Step 4/5] [2021-11-19 21:04:30,256][INFO ][sys-#8059%encryption.EncryptedCacheGroupCreateTest0%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=832cfe93-7cf8-4ee5-9a59-6dc363c00000, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=3], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=832cfe93-7cf8-4ee5-9a59-6dc363c00000, consistentId=encryption.EncryptedCacheGroupCreateTest0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345069942, loc=true, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=2, minorTopVer=3]] [21:04:30] : [Step 4/5] [2021-11-19 21:04:30,262][INFO ][exchange-worker-#8084%encryption.EncryptedCacheGroupCreateTest0%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=2, minorTopVer=3], force=false, evt=DISCOVERY_CUSTOM_EVT, node=832cfe93-7cf8-4ee5-9a59-6dc363c00000] [21:04:30] : [Step 4/5] [2021-11-19 21:04:30,263][INFO ][sys-#8059%encryption.EncryptedCacheGroupCreateTest0%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=3], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=3], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (2 ms), stage="Update caches registry" (0 ms), stage="Start caches" (97 ms), stage="Affinity initialization on cache group start" (3 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (1 ms), stage="Wait partitions release latch [latch=exchange]" (12 ms), stage="Wait partitions release [latch=exchange]" (2 ms), stage="Restore partition states" (20 ms), stage="After states restored callback" (4 ms), stage="WAL history reservation" (0 ms), stage="Waiting for all single messages" (7 ms), stage="Affinity recalculation (crd)" (0 ms), stage="Collect update counters and create affinity messages" (0 ms), stage="Assign partitions states" (5 ms), stage="Validate partitions states" (0 ms), stage="Apply update counters" (0 ms), stage="Full message preparing" (6 ms), stage="Full message sending" (0 ms), stage="Exchange done" (11 ms), stage="Total time" (170 ms)] [21:04:30] : [Step 4/5] [2021-11-19 21:04:30,269][INFO ][exchange-worker-#8084%encryption.EncryptedCacheGroupCreateTest0%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=4], crd=true, evt=DISCOVERY_CUSTOM_EVT, evtNode=832cfe93-7cf8-4ee5-9a59-6dc363c00000, customEvt=DynamicCacheChangeBatch [id=ef22d593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqs=ArrayList [DynamicCacheChangeRequest [cacheName=encrypted2, hasCfg=true, nodeId=832cfe93-7cf8-4ee5-9a59-6dc363c00000, clientStartOnly=false, stop=false, destroy=false, disabledAfterStart=false]], exchangeActions=ExchangeActions [startCaches=[encrypted2], stopCaches=null, startGrps=[], stopGrps=[], resetParts=null, stateChangeRequest=null], startCaches=false], allowMerge=false, exchangeFreeSwitch=false] [21:04:30] : [Step 4/5] [2021-11-19 21:04:30,267][INFO ][sys-#8174%encryption.EncryptedCacheGroupCreateTest1%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=3], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=3], err=null, rebalanced=true, wasRebalanced=true] [21:04:30] : [Step 4/5] [2021-11-19 21:04:30,274][INFO ][sys-#8174%encryption.EncryptedCacheGroupCreateTest1%][GridCacheProcessor] Finish proxy initialization, cacheName=encrypted, localNodeId=0822ac7e-0bd1-4e7c-91c1-49875bd00001 [21:04:30] : [Step 4/5] [2021-11-19 21:04:30,274][INFO ][sys-#8174%encryption.EncryptedCacheGroupCreateTest1%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=0822ac7e-0bd1-4e7c-91c1-49875bd00001, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=3], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=832cfe93-7cf8-4ee5-9a59-6dc363c00000, consistentId=encryption.EncryptedCacheGroupCreateTest0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345069396, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=2, minorTopVer=3]] [21:04:30] : [Step 4/5] [2021-11-19 21:04:30,275][INFO ][exchange-worker-#8206%encryption.EncryptedCacheGroupCreateTest1%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=2, minorTopVer=3], force=false, evt=DISCOVERY_CUSTOM_EVT, node=832cfe93-7cf8-4ee5-9a59-6dc363c00000] [21:04:30] : [Step 4/5] [2021-11-19 21:04:30,270][INFO ][sys-#8059%encryption.EncryptedCacheGroupCreateTest0%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=3], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=3], stage="Affinity initialization on cache group start [grp=encrypted-group]" (1 ms) (parent=Affinity initialization on cache group start), stage="Restore partition states [grp=encrypted-group]" (20 ms) (parent=Restore partition states), stage="Restore partition states [grp=ignite-sys-cache]" (0 ms) (parent=Restore partition states), stage="Restore partition states [grp=encrypted-group3]" (0 ms) (parent=Restore partition states)] [21:04:30] : [Step 4/5] [2021-11-19 21:04:30,276][INFO ][exchange-worker-#8206%encryption.EncryptedCacheGroupCreateTest1%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=4], crd=false, evt=DISCOVERY_CUSTOM_EVT, evtNode=832cfe93-7cf8-4ee5-9a59-6dc363c00000, customEvt=DynamicCacheChangeBatch [id=ef22d593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqs=ArrayList [DynamicCacheChangeRequest [cacheName=encrypted2, hasCfg=true, nodeId=832cfe93-7cf8-4ee5-9a59-6dc363c00000, clientStartOnly=false, stop=false, destroy=false, disabledAfterStart=false]], exchangeActions=ExchangeActions [startCaches=[encrypted2], stopCaches=null, startGrps=[], stopGrps=[], resetParts=null, stateChangeRequest=null], startCaches=false], allowMerge=false, exchangeFreeSwitch=false] [21:04:30] : [Step 4/5] [2021-11-19 21:04:30,275][INFO ][sys-#8174%encryption.EncryptedCacheGroupCreateTest1%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=3], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=3], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (1 ms), stage="Update caches registry" (0 ms), stage="Start caches" (107 ms), stage="Affinity initialization on cache group start" (5 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Wait partitions release latch [latch=exchange]" (3 ms), stage="Wait partitions release [latch=exchange]" (4 ms), stage="Restore partition states" (19 ms), stage="After states restored callback" (3 ms), stage="WAL history reservation" (0 ms), stage="Waiting for Full message" (22 ms), stage="Affinity recalculation" (0 ms), stage="Full map updating" (11 ms), stage="Exchange done" (8 ms), stage="Total time" (183 ms)] [21:04:30] : [Step 4/5] [2021-11-19 21:04:30,275][INFO ][exchange-worker-#8084%encryption.EncryptedCacheGroupCreateTest0%][GridCacheProcessor] Started cache [name=encrypted2, id=-1512636690, group=encrypted-group, dataRegionName=default, mode=PARTITIONED, atomicity=ATOMIC, backups=0, mvcc=false] [21:04:30] : [Step 4/5] [2021-11-19 21:04:30,282][INFO ][sys-#8174%encryption.EncryptedCacheGroupCreateTest1%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=3], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=3], stage="Affinity initialization on cache group start [grp=encrypted-group]" (1 ms) (parent=Affinity initialization on cache group start), stage="Restore partition states [grp=encrypted-group]" (19 ms) (parent=Restore partition states), stage="Restore partition states [grp=ignite-sys-cache]" (0 ms) (parent=Restore partition states), stage="Restore partition states [grp=encrypted-group3]" (0 ms) (parent=Restore partition states)] [21:04:30] : [Step 4/5] [2021-11-19 21:04:30,283][INFO ][exchange-worker-#8206%encryption.EncryptedCacheGroupCreateTest1%][GridCacheProcessor] Started cache [name=encrypted2, id=-1512636690, group=encrypted-group, dataRegionName=default, mode=PARTITIONED, atomicity=ATOMIC, backups=0, mvcc=false] [21:04:30]W: [org.apache.ignite:ignite-core] [2021-11-19 21:04:30,283][WARN ][exchange-worker-#8084%encryption.EncryptedCacheGroupCreateTest0%][CacheAffinitySharedManager] Cache group 'encrypted-group' brings high overhead for its metainformation in data region 'default'. Metainformation required for its partitions (519 partitions, 4096 bytes per partition, 2 MBs total) will consume more than 15% of data region memory (10 MBs). It may lead to critical errors on the node and cluster instability. Please reduce number of partitions, add more memory to the data region or add more server nodes for this cache group. [21:04:30] : [Step 4/5] [2021-11-19 21:04:30,286][INFO ][exchange-worker-#8084%encryption.EncryptedCacheGroupCreateTest0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=4], waitTime=0ms, futInfo=NA, mode=DISTRIBUTED] [21:04:30] : [Step 4/5] [2021-11-19 21:04:30,289][INFO ][exchange-worker-#8206%encryption.EncryptedCacheGroupCreateTest1%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=4], waitTime=0ms, futInfo=NA, mode=DISTRIBUTED] [21:04:30]W: [org.apache.ignite:ignite-core] [2021-11-19 21:04:30,285][WARN ][exchange-worker-#8206%encryption.EncryptedCacheGroupCreateTest1%][CacheAffinitySharedManager] Cache group 'encrypted-group' brings high overhead for its metainformation in data region 'default'. Metainformation required for its partitions (505 partitions, 4096 bytes per partition, 1 MBs total) will consume more than 15% of data region memory (10 MBs). It may lead to critical errors on the node and cluster instability. Please reduce number of partitions, add more memory to the data region or add more server nodes for this cache group. [21:04:30] : [Step 4/5] [2021-11-19 21:04:30,291][INFO ][exchange-worker-#8084%encryption.EncryptedCacheGroupCreateTest0%][GridDhtPartitionsExchangeFuture] Finished waiting for partitions release latch: ServerLatch [permits=0, pendingAcks=HashSet [], super=CompletableLatch [id=CompletableLatchUid [id=exchange, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=4]]]] [21:04:30] : [Step 4/5] [2021-11-19 21:04:30,291][INFO ][exchange-worker-#8206%encryption.EncryptedCacheGroupCreateTest1%][GridDhtPartitionsExchangeFuture] Finished waiting for partitions release latch: ClientLatch [coordinator=TcpDiscoveryNode [id=832cfe93-7cf8-4ee5-9a59-6dc363c00000, consistentId=encryption.EncryptedCacheGroupCreateTest0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345069396, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], ackSent=true, super=CompletableLatch [id=CompletableLatchUid [id=exchange, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=4]]]] [21:04:30] : [Step 4/5] [2021-11-19 21:04:30,291][INFO ][exchange-worker-#8084%encryption.EncryptedCacheGroupCreateTest0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=4], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:04:30] : [Step 4/5] [2021-11-19 21:04:30,292][INFO ][exchange-worker-#8206%encryption.EncryptedCacheGroupCreateTest1%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=4], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:04:30] : [Step 4/5] [2021-11-19 21:04:30,295][INFO ][exchange-worker-#8084%encryption.EncryptedCacheGroupCreateTest0%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=4], crd=true] [21:04:30] : [Step 4/5] [2021-11-19 21:04:30,298][INFO ][exchange-worker-#8206%encryption.EncryptedCacheGroupCreateTest1%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=4], crd=false] [21:04:30] : [Step 4/5] [2021-11-19 21:04:30,301][INFO ][sys-#8057%encryption.EncryptedCacheGroupCreateTest0%][GridDhtPartitionsExchangeFuture] Coordinator received single message [ver=AffinityTopologyVersion [topVer=2, minorTopVer=4], node=0822ac7e-0bd1-4e7c-91c1-49875bd00001, allReceived=true] [21:04:30] : [Step 4/5] [2021-11-19 21:04:30,302][INFO ][sys-#8057%encryption.EncryptedCacheGroupCreateTest0%][GridDhtPartitionsExchangeFuture] finishExchangeOnCoordinator [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=4], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=4]] [21:04:30] : [Step 4/5] [2021-11-19 21:04:30,322][INFO ][sys-#8057%encryption.EncryptedCacheGroupCreateTest0%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=4], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=4], err=null, rebalanced=true, wasRebalanced=true] [21:04:30] : [Step 4/5] [2021-11-19 21:04:30,323][INFO ][sys-#8180%encryption.EncryptedCacheGroupCreateTest1%][GridDhtPartitionsExchangeFuture] Received full message, will finish exchange [node=832cfe93-7cf8-4ee5-9a59-6dc363c00000, resVer=AffinityTopologyVersion [topVer=2, minorTopVer=4]] [21:04:30] : [Step 4/5] [2021-11-19 21:04:30,324][INFO ][sys-#8057%encryption.EncryptedCacheGroupCreateTest0%][GridCacheProcessor] Finish proxy initialization, cacheName=encrypted2, localNodeId=832cfe93-7cf8-4ee5-9a59-6dc363c00000 [21:04:30] : [Step 4/5] [21:04:30] >>> Stopping test: EncryptedCacheGroupCreateTest#testCreateEncryptedCacheGroup in 382 ms <<< [21:04:30] : [Step 4/5] [2021-11-19 21:04:30,325][INFO ][sys-#8057%encryption.EncryptedCacheGroupCreateTest0%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=832cfe93-7cf8-4ee5-9a59-6dc363c00000, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=4], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=832cfe93-7cf8-4ee5-9a59-6dc363c00000, consistentId=encryption.EncryptedCacheGroupCreateTest0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345070322, loc=true, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=2, minorTopVer=4]] [21:04:30] : [Step 4/5] [2021-11-19 21:04:30,331][INFO ][sys-#8057%encryption.EncryptedCacheGroupCreateTest0%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=4], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=4], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (2 ms), stage="Update caches registry" (0 ms), stage="Start caches" (10 ms), stage="Affinity initialization on cache group start" (2 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (3 ms), stage="Wait partitions release latch [latch=exchange]" (1 ms), stage="Wait partitions release [latch=exchange]" (1 ms), stage="After states restored callback" (1 ms), stage="WAL history reservation" (0 ms), stage="Waiting for all single messages" (7 ms), stage="Affinity recalculation (crd)" (0 ms), stage="Collect update counters and create affinity messages" (0 ms), stage="Assign partitions states" (3 ms), stage="Validate partitions states" (1 ms), stage="Apply update counters" (1 ms), stage="Full message preparing" (12 ms), stage="Full message sending" (0 ms), stage="Exchange done" (9 ms), stage="Total time" (53 ms), Discovery lag=5 ms, Latest started node id=832cfe93-7cf8-4ee5-9a59-6dc363c00000] [21:04:30] : [Step 4/5] [2021-11-19 21:04:30,330][INFO ][exchange-worker-#8084%encryption.EncryptedCacheGroupCreateTest0%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=2, minorTopVer=4], force=false, evt=DISCOVERY_CUSTOM_EVT, node=832cfe93-7cf8-4ee5-9a59-6dc363c00000] [21:04:30] : [Step 4/5] [2021-11-19 21:04:30,329][INFO ][sys-#8180%encryption.EncryptedCacheGroupCreateTest1%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=4], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=4], err=null, rebalanced=true, wasRebalanced=true] [21:04:30] : [Step 4/5] [2021-11-19 21:04:30,329][INFO ][main][root] >>> Stopping test: EncryptedCacheGroupCreateTest#testCreateEncryptedCacheGroup in 382 ms <<< [21:04:30] : [Step 4/5] [21:04:30] >>> Heap: 498 MB used / 1941 MB commited / 1941 MB max <<< [21:04:30] : [Step 4/5] [2021-11-19 21:04:30,336][INFO ][main][root] >>> Heap: 498 MB used / 1941 MB commited / 1941 MB max <<< [21:04:30] : [Step 4/5] [21:04:30] >>> Non-Heap: 138 MB used / 149 MB commited / 0 MB max <<< [21:04:30] : [Step 4/5] [2021-11-19 21:04:30,337][INFO ][main][root] >>> Non-Heap: 138 MB used / 149 MB commited / 0 MB max <<< [21:04:30] : [Step 4/5] [[21:04:2021-11-1930 21:04:30,3] >>> Stopping test class: En37][INFO ]cryptedCacheGroupCreateTest <<< [21:04:30] : [Step 4/5] [sys-#8180%encryption.EncryptedCacheGroupCreateTest1%][GridCacheProcessor] Finish proxy initialization, cacheName=encrypted2, localNodeId=0822ac7e-0bd1-4e7c-91c1-49875bd00001 [21:04:30] : [Step 4/5] [2021-11-19 21:04:30,340][INFO ][sys-#8180%encryption.EncryptedCacheGroupCreateTest1%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=0822ac7e-0bd1-4e7c-91c1-49875bd00001, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=4], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=832cfe93-7cf8-4ee5-9a59-6dc363c00000, consistentId=encryption.EncryptedCacheGroupCreateTest0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345069396, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=2, minorTopVer=4]] [21:04:30] : [Step 4/5] [2021-11-19 21:04:30,342][INFO ][sys-#8180%encryption.EncryptedCacheGroupCreateTest1%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=4], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=4], stage="Waiting in exchange queue" (12 ms), stage="Exchange parameters initialization" (3 ms), stage="Update caches registry" (0 ms), stage="Start caches" (4 ms), stage="Affinity initialization on cache group start" (4 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (1 ms), stage="Wait partitions release latch [latch=exchange]" (2 ms), stage="Wait partitions release [latch=exchange]" (1 ms), stage="After states restored callback" (1 ms), stage="WAL history reservation" (0 ms), stage="Waiting for Full message" (27 ms), stage="Affinity recalculation" (0 ms), stage="Full map updating" (5 ms), stage="Exchange done" (12 ms), stage="Total time" (72 ms)] [21:04:30] : [Step 4/5] [2021-11-19 21:04:30,344][INFO ][sys-#8180%encryption.EncryptedCacheGroupCreateTest1%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=4], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=4], stage="Affinity initialization on cache group start [grp=encrypted-group]" (0 ms) (parent=Affinity initialization on cache group start)] [21:04:30] : [Step 4/5] [2021-11-19 21:04:30,334][INFO ][sys-#8057%encryption.EncryptedCacheGroupCreateTest0%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=4], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=4], stage="Affinity initialization on cache group start [grp=encrypted-group]" (0 ms) (parent=Affinity initialization on cache group start)] [21:04:30] : [Step 4/5] [2021-11-19 21:04:30,341][INFO ][exchange-worker-#8206%encryption.EncryptedCacheGroupCreateTest1%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=2, minorTopVer=4], force=false, evt=DISCOVERY_CUSTOM_EVT, node=832cfe93-7cf8-4ee5-9a59-6dc363c00000] [21:04:30] : [Step 4/5] [2021-11-19 21:04:30,339][INFO ][main][root] >>> Stopping test class: EncryptedCacheGroupCreateTest <<< [21:04:30] : [Step 4/5] [2021-11-19 21:04:30,347][INFO ][main][root] >>> Stopping grid [name=encryption.EncryptedCacheGroupCreateTest0, id=832cfe93-7cf8-4ee5-9a59-6dc363c00000] [21:04:30] : [Step 4/5] [2021-11-19 21:04:30,911][INFO ][db-checkpoint-thread-#8215%encryption.EncryptedCacheGroupCreateTest0%][Checkpointer] Checkpoint started [checkpointId=211df9e0-47e7-492d-adb4-f25e5b0e6361, startPtr=WALPointer [idx=0, fileOff=280369, len=21681], checkpointBeforeLockTime=2ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=1ms, checkpointLockHoldTime=2ms, walCpRecordFsyncDuration=417ms, writeCheckpointEntryDuration=135ms, splitAndSortCpPagesDuration=0ms, pages=17, reason='timeout'] [21:04:30]W: [org.apache.ignite:ignite-core] [2021-11-19 21:04:30,920][WARN ][tcp-disco-sock-reader-[0822ac7e 127.0.0.1:54727]-#414%encryption.EncryptedCacheGroupCreateTest0%-#8203%encryption.EncryptedCacheGroupCreateTest0%][TestTcpDiscoverySpi] Failed to shutdown socket [21:04:30]W: [org.apache.ignite:ignite-core] java.net.SocketException: Socket output is already shutdown [21:04:30]W: [org.apache.ignite:ignite-core] at java.net.Socket.shutdownOutput(Socket.java:1572) [21:04:30]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.close(IgniteUtils.java:4247) [21:04:30]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.discovery.tcp.ServerImpl$SocketReader.body(ServerImpl.java:7370) [21:04:30]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.IgniteSpiThread.run(IgniteSpiThread.java:58) [21:04:30] : [Step 4/5] [2021-11-19 21:04:30,922][INFO ][disco-event-worker-#8205%encryption.EncryptedCacheGroupCreateTest1%][GridDiscoveryManager] Node left topology: TcpDiscoveryNode [id=832cfe93-7cf8-4ee5-9a59-6dc363c00000, consistentId=encryption.EncryptedCacheGroupCreateTest0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345069396, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false] [21:04:30] : [Step 4/5] [2021-11-19 21:04:30,924][INFO ][tcp-disco-sock-reader-[0822ac7e 127.0.0.1:54727]-#414%encryption.EncryptedCacheGroupCreateTest0%-#8203%encryption.EncryptedCacheGroupCreateTest0%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:54727, rmtPort=54727, rmtNodeId=0822ac7e-0bd1-4e7c-91c1-49875bd00001] [21:04:30] : [Step 4/5] [2021-11-19 21:04:30,926][INFO ][disco-event-worker-#8205%encryption.EncryptedCacheGroupCreateTest1%][GridDiscoveryManager] Topology snapshot [ver=3, locNode=0822ac7e, servers=1, clients=0, state=ACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=0822ac7e-0bd1-4e7c-91c1-49875bd00001, consistentId=encryption.EncryptedCacheGroupCreateTest1, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:04:30] : [Step 4/5] [2021-11-19 21:04:30,929][INFO ][main][GridCacheProcessor] Stopped cache [cacheName=ignite-sys-cache] [21:04:30] : [Step 4/5] [2021-11-19 21:04:30,929][INFO ][disco-event-worker-#8205%encryption.EncryptedCacheGroupCreateTest1%][GridDiscoveryManager] Coordinator changed [prev=TcpDiscoveryNode [id=832cfe93-7cf8-4ee5-9a59-6dc363c00000, consistentId=encryption.EncryptedCacheGroupCreateTest0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345069396, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], cur=TcpDiscoveryNode [id=0822ac7e-0bd1-4e7c-91c1-49875bd00001, consistentId=encryption.EncryptedCacheGroupCreateTest1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637345070917, loc=true, ver=2.13.0#20211119-sha1:00000000, isClient=false]] [21:04:30] : [Step 4/5] [2021-11-19 21:04:30,930][INFO ][main][GridCacheProcessor] Stopped cache [cacheName=encrypted, group=encrypted-group] [21:04:30] : [Step 4/5] [2021-11-19 21:04:30,932][INFO ][disco-event-worker-#8205%encryption.EncryptedCacheGroupCreateTest1%][GridDiscoveryManager] ^-- Baseline [id=0, size=2, online=1, offline=1] [21:04:30] : [Step 4/5] [2021-11-19 21:04:30,933][INFO ][disco-event-worker-#8205%encryption.EncryptedCacheGroupCreateTest1%][MvccProcessorImpl] Assigned mvcc coordinator [crd=MvccCoordinator [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], nodeId=0822ac7e-0bd1-4e7c-91c1-49875bd00001, ver=1637345068287, local=true, initialized=false]] [21:04:30] : [Step 4/5] [2021-11-19 21:04:30,933][INFO ][main][GridCacheProcessor] Stopped cache [cacheName=encrypted2, group=encrypted-group] [21:04:30]W: [org.apache.ignite:ignite-core] [2021-11-19 21:04:30,933][WARN ][grid-nio-worker-tcp-comm-0-#8141%TcpCommunicationSpi%][TcpCommunicationSpi] Failed to shutdown socket [21:04:30]W: [org.apache.ignite:ignite-core] java.nio.channels.ClosedChannelException [21:04:30]W: [org.apache.ignite:ignite-core] at sun.nio.ch.SocketChannelImpl.shutdownOutput(SocketChannelImpl.java:795) [21:04:30]W: [org.apache.ignite:ignite-core] at sun.nio.ch.SocketAdaptor.shutdownOutput(SocketAdaptor.java:407) [21:04:30]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.close(IgniteUtils.java:4247) [21:04:30]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.closeKey(GridNioServer.java:2784) [21:04:30]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.close(GridNioServer.java:2835) [21:04:30]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.close(GridNioServer.java:2794) [21:04:30]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.bodyInternal(GridNioServer.java:2157) [21:04:30]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.body(GridNioServer.java:1910) [21:04:30]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:125) [21:04:30]W: [org.apache.ignite:ignite-core] at java.lang.Thread.run(Thread.java:748) [21:04:30] : [Step 4/5] [2021-11-19 21:04:30,938][INFO ][exchange-worker-#8206%encryption.EncryptedCacheGroupCreateTest1%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], crd=true, evt=NODE_LEFT, evtNode=832cfe93-7cf8-4ee5-9a59-6dc363c00000, customEvt=null, allowMerge=false, exchangeFreeSwitch=true] [21:04:30] : [Step 4/5] [2021-11-19 21:04:30,938][INFO ][sys-#8179%encryption.EncryptedCacheGroupCreateTest1%][ExchangeLatchManager] Become new coordinator 0822ac7e-0bd1-4e7c-91c1-49875bd00001 [21:04:30] : [Step 4/5] [2021-11-19 21:04:30,941][INFO ][exchange-worker-#8206%encryption.EncryptedCacheGroupCreateTest1%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:04:30] : [Step 4/5] [2021-11-19 21:04:30,938][INFO ][main][GridCacheProcessor] Stopped cache [cacheName=encrypted3, group=encrypted-group3] [21:04:30] : [Step 4/5] [2021-11-19 21:04:30,946][INFO ][exchange-worker-#8206%encryption.EncryptedCacheGroupCreateTest1%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], err=null, rebalanced=true, wasRebalanced=true] [21:04:30]W: [org.apache.ignite:ignite-core] [2021-11-19 21:04:30,950][WARN ][sys-#8173%encryption.EncryptedCacheGroupCreateTest1%][GridDhtPartitionTopologyImpl] Detected lost partitions [grp=encrypted-group3, parts=[3, 7, 9, 14, 17-18, 20-23, 28-31, 33-34, 36, 39, 44, 46, 48-49, 53, 56, 61-65, 68, 70-72, 75-79, 82-83, 85-86, 88, 90, 93, 96-97, 99, 102, 107-108, 110-114, 116, 120, 122, 124-125, 127, 129-130, 132, 134, 138, 141, 143, 145, 147, 157, 160-165, 167, 169, 171, 176-177, 179, 182, 184-189, 191, 193-194, 199, 201-203, 209, 211-213, 216-223, 226-227, 230, 232-235, 239-241, 244-245, 249, 251-252, 254, 256-258, 261-265, 267, 272-273, 276-277, 282, 285, 289-292, 297, 302, 304-306, 310, 313-316, 318, 320-325, 327, 329-331, 333-335, 337, 340, 342, 344-345, 347-349, 356, 360-362, 364, 366, 369-370, 372, 376-380, 382, 384, 386, 388-389, 392, 395-396, 399-400, 402-403, 408-411, 413-414, 416-417, 421-431, 438-439, 442-445, 449-450, 452-453, 458-459, 461-464, 466, 469-476, 478-484, 487, 489, 493, 497-499, 501, 505-507, 511-514, 518, 520-522, 525-527, 532-533, 535-538, 540-542, 544, 551-553, 555-556, 558, 562-568, 572, 575-577, 579, 582-583, 585-588, 591-594, 596-597, 599, 603-605, 607-609, 612, 616-617, 619-621, 627, 630-631, 635, 637-639, 641-642, 644-646, 648-649, 652, 655, 658, 664-665, 667-668, 670-672, 674, 677, 681-682, 684, 686, 688-689, 691, 699, 701, 703, 705-706, 712-713, 718, 721, 723-728, 730-731, 734, 738, 741-744, 751-753, 755, 757-760, 762-763, 765, 767, 769-772, 776, 778, 780, 784-786, 788, 791-792, 794, 801-802, 805-806, 811-812, 814, 820-821, 824-827, 829, 832-837, 841, 844-848, 851, 853, 855, 859-863, 865, 869-870, 873, 875-876, 882, 885-887, 890, 893-896, 901, 903, 909, 916, 918-919, 921-923, 927-931, 934-935, 937, 939-941, 943, 945, 947-949, 952, 955-958, 960-962, 966, 972, 975-976, 979-981, 988, 990-992, 994, 996-1000, 1002, 1004, 1006-1007, 1011, 1015-1017, 1020-1021], topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0]] [21:04:30]W: [org.apache.ignite:ignite-core] [2021-11-19 21:04:30,950][WARN ][exchange-worker-#8206%encryption.EncryptedCacheGroupCreateTest1%][GridDhtPartitionTopologyImpl] Detected lost partitions [grp=encrypted-group, parts=[3, 7, 9, 14, 17-18, 20-23, 28-31, 33-34, 36, 39, 44, 46, 48-49, 53, 56, 61-65, 68, 70-72, 75-79, 82-83, 85-86, 88, 90, 93, 96-97, 99, 102, 107-108, 110-114, 116, 120, 122, 124-125, 127, 129-130, 132, 134, 138, 141, 143, 145, 147, 157, 160-165, 167, 169, 171, 176-177, 179, 182, 184-189, 191, 193-194, 199, 201-203, 209, 211-213, 216-223, 226-227, 230, 232-235, 239-241, 244-245, 249, 251-252, 254, 256-258, 261-265, 267, 272-273, 276-277, 282, 285, 289-292, 297, 302, 304-306, 310, 313-316, 318, 320-325, 327, 329-331, 333-335, 337, 340, 342, 344-345, 347-349, 356, 360-362, 364, 366, 369-370, 372, 376-380, 382, 384, 386, 388-389, 392, 395-396, 399-400, 402-403, 408-411, 413-414, 416-417, 421-431, 438-439, 442-445, 449-450, 452-453, 458-459, 461-464, 466, 469-476, 478-484, 487, 489, 493, 497-499, 501, 505-507, 511-514, 518, 520-522, 525-527, 532-533, 535-538, 540-542, 544, 551-553, 555-556, 558, 562-568, 572, 575-577, 579, 582-583, 585-588, 591-594, 596-597, 599, 603-605, 607-609, 612, 616-617, 619-621, 627, 630-631, 635, 637-639, 641-642, 644-646, 648-649, 652, 655, 658, 664-665, 667-668, 670-672, 674, 677, 681-682, 684, 686, 688-689, 691, 699, 701, 703, 705-706, 712-713, 718, 721, 723-728, 730-731, 734, 738, 741-744, 751-753, 755, 757-760, 762-763, 765, 767, 769-772, 776, 778, 780, 784-786, 788, 791-792, 794, 801-802, 805-806, 811-812, 814, 820-821, 824-827, 829, 832-837, 841, 844-848, 851, 853, 855, 859-863, 865, 869-870, 873, 875-876, 882, 885-887, 890, 893-896, 901, 903, 909, 916, 918-919, 921-923, 927-931, 934-935, 937, 939-941, 943, 945, 947-949, 952, 955-958, 960-962, 966, 972, 975-976, 979-981, 988, 990-992, 994, 996-1000, 1002, 1004, 1006-1007, 1011, 1015-1017, 1020-1021], topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0]] [21:04:30] : [Step 4/5] [2021-11-19 21:04:30,959][INFO ][exchange-worker-#8206%encryption.EncryptedCacheGroupCreateTest1%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=0822ac7e-0bd1-4e7c-91c1-49875bd00001, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], evt=NODE_LEFT, evtNode=TcpDiscoveryNode [id=832cfe93-7cf8-4ee5-9a59-6dc363c00000, consistentId=encryption.EncryptedCacheGroupCreateTest0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345069396, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0]] [21:04:30] : [Step 4/5] [2021-11-19 21:04:30,960][INFO ][exchange-worker-#8206%encryption.EncryptedCacheGroupCreateTest1%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (2 ms), stage="Determine exchange type" (1 ms), stage="Preloading notification" (0 ms), stage="After states restored callback" (0 ms), stage="WAL history reservation" (0 ms), stage="Finalize update counters" (1 ms), stage="Detect lost partitions" (12 ms), stage="Exchange done" (2 ms), stage="Total time" (18 ms)] [21:04:30] : [Step 4/5] [2021-11-19 21:04:30,962][INFO ][exchange-worker-#8206%encryption.EncryptedCacheGroupCreateTest1%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], stage="Affinity initialization (exchange-free switch on fully-rebalanced topology) [grp=encrypted-group3]" (1 ms) (parent=Determine exchange type), stage="Affinity initialization (exchange-free switch on fully-rebalanced topology) [grp=ignite-sys-cache]" (0 ms) (parent=Determine exchange type), stage="Affinity initialization (exchange-free switch on fully-rebalanced topology) [grp=encrypted-group]" (0 ms) (parent=Determine exchange type)] [21:04:30] : [Step 4/5] [2021-11-19 21:04:30,963][INFO ][exchange-worker-#8206%encryption.EncryptedCacheGroupCreateTest1%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], crd=true] [21:04:30] : [Step 4/5] [2021-11-19 21:04:30,965][INFO ][exchange-worker-#8206%encryption.EncryptedCacheGroupCreateTest1%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=3, minorTopVer=0], force=false, evt=NODE_LEFT, node=832cfe93-7cf8-4ee5-9a59-6dc363c00000] [21:04:31] : [Step 4/5] [2021-11-19 21:04:31,630][INFO ][main][FilePageStoreManager] Cleanup cache stores [total=5, left=0, cleanFiles=false] [21:04:31] : [Step 4/5] [2021-11-19 21:04:31,633][INFO ][main][GridDeploymentLocalStore] Removed undeployed class: GridDeployment [ts=1637345069578, depMode=SHARED, clsLdr=IsolatedClassLoader{roleName='test'}, clsLdrId=5c22d593d71-832cfe93-7cf8-4ee5-9a59-6dc363c00000, userVer=0, loc=true, sampleClsName=org.apache.ignite.internal.processors.cache.distributed.dht.preloader.GridDhtPartitionMap, pendingUndeploy=false, undeployed=true, usage=0] [21:04:31] : [Step 4/5] [2021-11-19 21:04:31,643][INFO ][main][EncryptedCacheGroupCreateTest0] [21:04:31] : [Step 4/5] [21:04:31] : [Step 4/5] >>> +------------------------------------------------------+ [21:04:31] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV stopped OK [21:04:31] : [Step 4/5] >>> +------------------------------------------------------+ [21:04:31] : [Step 4/5] >>> Ignite instance name: encryption.EncryptedCacheGroupCreateTest0 [21:04:31] : [Step 4/5] >>> Grid uptime: 00:00:03.332 [21:04:31] : [Step 4/5] [21:04:31] : [Step 4/5] [21:04:31] : [Step 4/5] [2021-11-19 21:04:31,644][INFO ][main][root] >>> Stopping grid [name=encryption.EncryptedCacheGroupCreateTest1, id=0822ac7e-0bd1-4e7c-91c1-49875bd00001] [21:04:31] : [Step 4/5] [2021-11-19 21:04:31,660][INFO ][db-checkpoint-thread-#8221%encryption.EncryptedCacheGroupCreateTest1%][Checkpointer] Checkpoint started [checkpointId=efca0a01-e1e2-4570-b467-34c93a5fa5ee, startPtr=WALPointer [idx=0, fileOff=275980, len=21149], checkpointBeforeLockTime=2ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=5ms, writeCheckpointEntryDuration=2ms, splitAndSortCpPagesDuration=0ms, pages=17, reason='timeout'] [21:04:31]W: [org.apache.ignite:ignite-core] [2021-11-19 21:04:31,665][WARN ][tcp-disco-sock-reader-[832cfe93 127.0.0.1:35947]-#413%encryption.EncryptedCacheGroupCreateTest1%-#8202%encryption.EncryptedCacheGroupCreateTest1%][TestTcpDiscoverySpi] Failed to shutdown socket [21:04:31]W: [org.apache.ignite:ignite-core] java.net.SocketException: Socket is closed [21:04:31]W: [org.apache.ignite:ignite-core] at java.net.Socket.shutdownOutput(Socket.java:1568) [21:04:31]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.close(IgniteUtils.java:4247) [21:04:31]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.discovery.tcp.ServerImpl$SocketReader.body(ServerImpl.java:7370) [21:04:31]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.IgniteSpiThread.run(IgniteSpiThread.java:58) [21:04:31] : [Step 4/5] [2021-11-19 21:04:31,666][INFO ][tcp-disco-sock-reader-[832cfe93 127.0.0.1:35947]-#413%encryption.EncryptedCacheGroupCreateTest1%-#8202%encryption.EncryptedCacheGroupCreateTest1%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:35947, rmtPort=35947, rmtNodeId=832cfe93-7cf8-4ee5-9a59-6dc363c00000] [21:04:31] : [Step 4/5] [2021-11-19 21:04:31,667][INFO ][main][GridCacheProcessor] Stopped cache [cacheName=ignite-sys-cache] [21:04:31] : [Step 4/5] [2021-11-19 21:04:31,668][INFO ][main][GridCacheProcessor] Stopped cache [cacheName=encrypted, group=encrypted-group] [21:04:31] : [Step 4/5] [2021-11-19 21:04:31,669][INFO ][main][GridCacheProcessor] Stopped cache [cacheName=encrypted2, group=encrypted-group] [21:04:31] : [Step 4/5] [2021-11-19 21:04:31,670][INFO ][main][GridCacheProcessor] Stopped cache [cacheName=encrypted3, group=encrypted-group3] [21:04:32] : [Step 4/5] [2021-11-19 21:04:32,015][INFO ][main][FilePageStoreManager] Cleanup cache stores [total=5, left=0, cleanFiles=false] [21:04:32] : [Step 4/5] [2021-11-19 21:04:32,017][INFO ][main][GridDeploymentLocalStore] Removed undeployed class: GridDeployment [ts=1637345069588, depMode=SHARED, clsLdr=IsolatedClassLoader{roleName='test'}, clsLdrId=7c22d593d71-0822ac7e-0bd1-4e7c-91c1-49875bd00001, userVer=0, loc=true, sampleClsName=org.apache.ignite.internal.processors.cache.distributed.dht.preloader.IgniteDhtPartitionHistorySuppliersMap, pendingUndeploy=false, undeployed=true, usage=0] [21:04:32] : [Step 4/5] [2021-11-19 21:04:32,025][INFO ][main][EncryptedCacheGroupCreateTest1] [21:04:32] : [Step 4/5] [21:04:32] : [Step 4/5] >>> +------------------------------------------------------+ [21:04:32] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV stopped OK [21:04:32] : [Step 4/5] >>> +------------------------------------------------------+ [21:04:32] : [Step 4/5] >>> Ignite instance name: encryption.EncryptedCacheGroupCreateTest1 [21:04:32] : [Step 4/5] >>> Grid uptime: 00:00:02.564 [21:04:32] : [Step 4/5] [21:04:32] : [Step 4/5] [21:04:32] : [Step 4/5] [21:04:32] >>> Starting test class: EncryptedCacheNodeJoinTest <<< [21:04:32] : [Step 4/5] [2021-11-19 21:04:32,182][INFO ][main][root] >>> Starting test class: EncryptedCacheNodeJoinTest <<< [21:04:32] : [Step 4/5] Running org.apache.ignite.internal.encryption.EncryptedCacheNodeJoinTest [21:04:32]i: [Step 4/5] ##teamcity[importData type='surefire' path='/opt/buildagent/temp/buildTmp/ignite-tools-junit-reports1777670380320881607/test-org.apache.ignite.testsuites.IgniteBasicWithPersistenceTestSuite1637345069611.xml'] [21:04:32] : [Step 4/5] Importing data from '/opt/buildagent/temp/buildTmp/ignite-tools-junit-reports1777670380320881607/test-org.apache.ignite.testsuites.IgniteBasicWithPersistenceTestSuite1637345069611.xml' (444 B) with 'surefire' processor [21:04:32] : [Step 4/5] [21:04:32] >>> Starting test: EncryptedCacheNodeJoinTest#testServerNodeJoinActiveClusterWithNewStaticCacheConfig <<< [21:04:32] : [Step 4/5] [2021-11-19 21:04:32,192][INFO ][main][root] >>> Starting test: EncryptedCacheNodeJoinTest#testServerNodeJoinActiveClusterWithNewStaticCacheConfig <<< [21:04:32] : [Step 4/5] [21:04:32] >>> Heap: 509 MB used / 1941 MB commited / 1941 MB max <<< [21:04:32] : [Step 4/5] [2021-11-19 21:04:32,193][INFO ][main][root] >>> Heap: 509 MB used / 1941 MB commited / 1941 MB max <<< [21:04:32] : [Step 4/5] [21:04:32] >>> Non-Heap: 138 MB used / 149 MB commited / 0 MB max <<< [21:04:32] : [Step 4/5] [2021-11-19 21:04:32,193][INFO ][main][root] >>> Non-Heap: 138 MB used / 149 MB commited / 0 MB max <<< [21:04:32]W: [org.apache.ignite:ignite-core] [2021-11-19 21:04:32,203][WARN ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][G] Ignite work directory is not provided, automatically resolved to: /opt/buildagent/work/7bc1c54bc719b67c/work [21:04:32] : [Step 4/5] [2021-11-19 21:04:32,205][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] [21:04:32] : [Step 4/5] [21:04:32] : [Step 4/5] >>> __________ ________________ [21:04:32] : [Step 4/5] >>> / _/ ___/ |/ / _/_ __/ __/ [21:04:32] : [Step 4/5] >>> _/ // (7 7 // / / / / _/ [21:04:32] : [Step 4/5] >>> /___/\___/_/|_/___/ /_/ /___/ [21:04:32] : [Step 4/5] >>> [21:04:32] : [Step 4/5] >>> ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:04:32] : [Step 4/5] >>> 2021 Copyright(C) Apache Software Foundation [21:04:32] : [Step 4/5] >>> [21:04:32] : [Step 4/5] >>> Ignite documentation: http://ignite.apache.org [21:04:32] : [Step 4/5] [21:04:32] : [Step 4/5] [2021-11-19 21:04:32,206][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] Config URL: n/a [21:04:32] : [Step 4/5] [2021-11-19 21:04:32,207][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] IgniteConfiguration [igniteInstanceName=grid-0, pubPoolSize=24, svcPoolSize=24, callbackPoolSize=24, stripedPoolSize=24, sysPoolSize=24, mgmtPoolSize=4, dataStreamerPoolSize=24, utilityCachePoolSize=24, utilityCacheKeepAliveTime=60000, p2pPoolSize=2, qryPoolSize=24, buildIdxPoolSize=4, igniteHome=/opt/buildagent/work/7bc1c54bc719b67c, igniteWorkDir=/opt/buildagent/work/7bc1c54bc719b67c/work, mbeanSrv=com.sun.jmx.mbeanserver.JmxMBeanServer@6fe85038, nodeId=00e0e9f0-ad4e-4057-8861-d6fd939f1000, marsh=BinaryMarshaller [], marshLocJobs=false, daemon=false, p2pEnabled=true, netTimeout=10000, netCompressionLevel=1, sndRetryDelay=1000, sndRetryCnt=3, metricsHistSize=10000, metricsUpdateFreq=1000, metricsExpTime=9223372036854775807, discoSpi=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=0, ackTimeout=0, marsh=null, reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], segPlc=STOP, segResolveAttempts=2, waitForSegOnStart=true, allResolversPassReq=true, segChkFreq=10000, commSpi=TcpCommunicationSpi [connectGate=org.apache.ignite.spi.communication.tcp.internal.ConnectGateway@159291b9, ctxInitLatch=java.util.concurrent.CountDownLatch@219aaf45[Count = 1], stopping=false, clientPool=null, nioSrvWrapper=null, stateProvider=null], evtSpi=MemoryEventStorageSpi [expireAgeMs=9223372036854775807, expireCnt=10000, filter=null], colSpi=NoopCollisionSpi [], deploySpi=LocalDeploymentSpi [], indexingSpi=org.apache.ignite.spi.indexing.noop.NoopIndexingSpi@63edd37a, addrRslvr=null, encryptionSpi=org.apache.ignite.spi.encryption.keystore.KeystoreEncryptionSpi@30c7877c, tracingSpi=org.apache.ignite.spi.tracing.NoopTracingSpi@191a5f35, clientMode=false, rebalanceThreadPoolSize=4, rebalanceTimeout=10000, rebalanceBatchesPrefetchCnt=3, rebalanceThrottle=0, rebalanceBatchSize=524288, txCfg=TransactionConfiguration [txSerEnabled=false, dfltIsolation=REPEATABLE_READ, dfltConcurrency=PESSIMISTIC, dfltTxTimeout=0, txTimeoutOnPartitionMapExchange=0, deadlockTimeout=10000, pessimisticTxLogSize=0, pessimisticTxLogLinger=10000, tmLookupClsName=null, txManagerFactory=null, useJtaSync=false], cacheSanityCheckEnabled=true, discoStartupDelay=60000, deployMode=SHARED, p2pMissedCacheSize=100, locHost=127.0.0.1, timeSrvPortBase=31100, timeSrvPortRange=100, failureDetectionTimeout=10000, sysWorkerBlockedTimeout=null, clientFailureDetectionTimeout=10000, metricsLogFreq=0, connectorCfg=null, odbcCfg=null, warmupClos=null, atomicCfg=AtomicConfiguration [seqReserveSize=1000, cacheMode=PARTITIONED, backups=1, aff=null, grpName=null], classLdr=null, sslCtxFactory=null, platformCfg=null, binaryCfg=null, memCfg=null, pstCfg=null, dsCfg=DataStorageConfiguration [sysRegionInitSize=41943040, sysRegionMaxSize=104857600, pageSize=4096, concLvl=0, dfltDataRegConf=DataRegionConfiguration [name=default, maxSize=10485760, initSize=268435456, swapPath=null, pageEvictionMode=DISABLED, pageReplacementMode=CLOCK, evictionThreshold=0.9, emptyPagesPoolSize=100, metricsEnabled=false, metricsSubIntervalCount=5, metricsRateTimeInterval=60000, persistenceEnabled=true, checkpointPageBufSize=0, lazyMemoryAllocation=true, warmUpCfg=null], dataRegions=null, storagePath=null, checkpointFreq=180000, lockWaitTime=10000, checkpointThreads=4, checkpointWriteOrder=SEQUENTIAL, walHistSize=20, maxWalArchiveSize=1073741824, walSegments=10, walSegmentSize=67108864, walPath=db/wal, walArchivePath=db/wal/archive, cdcWalPath=db/wal/cdc, cdcEnabled=false, metricsEnabled=false, walMode=FSYNC, walTlbSize=131072, walBuffSize=0, walFlushFreq=2000, walFsyncDelay=1000, walRecordIterBuffSize=67108864, alwaysWriteFullPages=false, fileIOFactory=org.apache.ignite.internal.processors.cache.persistence.file.AsyncFileIOFactory@1e989e47, metricsSubIntervalCnt=5, metricsRateTimeInterval=60000, walAutoArchiveAfterInactivity=-1, walForceArchiveTimeout=-1, writeThrottlingEnabled=false, walCompactionEnabled=false, walCompactionLevel=1, checkpointReadLockTimeout=null, walPageCompression=DISABLED, walPageCompressionLevel=null, dfltWarmUpCfg=null, encCfg=org.apache.ignite.configuration.EncryptionConfiguration@54aa1f7e, defragmentationThreadPoolSize=4, minWalArchiveSize=-1], snapshotPath=snapshots, activeOnStart=true, activeOnStartPropSetFlag=false, autoActivation=true, autoActivationPropSetFlag=false, clusterStateOnStart=null, sqlConnCfg=null, cliConnCfg=ClientConnectorConfiguration [host=null, port=10800, portRange=100, sockSndBufSize=0, sockRcvBufSize=0, tcpNoDelay=true, maxOpenCursorsPerConn=128, threadPoolSize=24, selectorCnt=12, idleTimeout=0, handshakeTimeout=10000, jdbcEnabled=true, odbcEnabled=true, thinCliEnabled=true, sslEnabled=false, useIgniteSslCtxFactory=true, sslClientAuth=false, sslCtxFactory=null, thinCliCfg=ThinClientConfiguration [maxActiveTxPerConn=100, maxActiveComputeTasksPerConn=0]], mvccVacuumThreadCnt=2, mvccVacuumFreq=5000, authEnabled=false, failureHnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]], commFailureRslvr=null, sqlCfg=SqlConfiguration [longQryWarnTimeout=3000, dfltQryTimeout=0, sqlQryHistSize=1000, validationEnabled=false], asyncContinuationExecutor=null] [21:04:32] : [Step 4/5] [2021-11-19 21:04:32,217][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] Daemon mode: off [21:04:32] : [Step 4/5] [2021-11-19 21:04:32,218][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] OS: Linux 4.15.0-151-generic amd64 [21:04:32] : [Step 4/5] [2021-11-19 21:04:32,218][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] OS user: teamcity [21:04:32] : [Step 4/5] [2021-11-19 21:04:32,218][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] PID: 16724 [21:04:32] : [Step 4/5] [2021-11-19 21:04:32,219][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] Language runtime: Java Platform API Specification ver. 1.8 [21:04:32] : [Step 4/5] [2021-11-19 21:04:32,219][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] VM information: Java(TM) SE Runtime Environment 1.8.0_261-b12 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 25.261-b12 [21:04:32] : [Step 4/5] [2021-11-19 21:04:32,220][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] VM total memory: 1.9GB [21:04:32] : [Step 4/5] [2021-11-19 21:04:32,220][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] Remote Management [restart: off, REST: off, JMX (remote: off)] [21:04:32] : [Step 4/5] [2021-11-19 21:04:32,220][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] Logger: GridTestLog4jLogger [quiet=false, config=null] [21:04:32] : [Step 4/5] [2021-11-19 21:04:32,221][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] IGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c [21:04:32] : [Step 4/5] [2021-11-19 21:04:32,221][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] VM arguments: [-DIGNITE_DUMP_THREADS_ON_FAILURE=false, -DMono=/usr/bin/mono-sgen, -DMono4.0_x64=/usr/lib/mono/4.0, -DMono4.5_x64=/usr/lib/mono/4.5, -DMonoVersion=6.12.0.90, -DSKIP_BUILD=false, -Dagent.home.dir=/opt/buildagent, -Dagent.name=aitc-lin02_03, -Dagent.ownPort=9090, -Dagent.work.dir=/opt/buildagent/work, -Dbuild.number=95, -Dbuild.vcs.number=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.1=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.GitHubApacheIgnite=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dclassworlds.conf=/opt/buildagent/temp/buildTmp/teamcity.m2.conf, -Dcom.jetbrains.maven.watcher.report.file=/opt/buildagent/temp/buildTmp/maven-build-info.xml, -Djava.io.tmpdir=/opt/buildagent/temp/buildTmp, -Dmaven.home=/opt/buildagent/tools/maven3_6, -Dmaven.multiModuleProjectDirectory=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.agent.cpuBenchmark=457, -Dteamcity.agent.dotnet.agent_url=http://localhost:9090/RPC2, -Dteamcity.agent.dotnet.build_id=6278078, -Dteamcity.auth.password=*******, -Dteamcity.auth.userId=TeamCityBuildId=6278078, -Dteamcity.build.changedFiles.file=/opt/buildagent/temp/buildTmp/changedFiles6342607772318147725.txt, -Dteamcity.build.checkoutDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.build.id=6278078, -Dteamcity.build.properties.file=/opt/buildagent/temp/buildTmp/teamcity.build5164517880467851002.properties, -Dteamcity.build.tempDir=/opt/buildagent/temp/buildTmp, -Dteamcity.build.workingDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.buildConfName=Basic 3, -Dteamcity.buildType.id=IgniteTests24Java8_Basic3, -Dteamcity.configuration.properties.file=/opt/buildagent/temp/buildTmp/teamcity.config5591980786735343870.properties, -Dteamcity.maven.userSettings.path=/opt/buildagent/temp/buildTmp/maven_settings_585072866407032347.xml, -Dteamcity.maven.watcher.home=/opt/buildagent/plugins/mavenPlugin/maven-watcher-jdk16, -Dteamcity.projectName=Ignite Tests 2.x (JDK 8/11), -Dteamcity.runner.properties.file=/opt/buildagent/temp/buildTmp/teamcity.runner9098465561618137420.properties, -Dteamcity.tests.recentlyFailedTests.file=/opt/buildagent/temp/buildTmp/testsToRunFirst3891775683130404069.txt, -Dteamcity.version=2021.2 (build 99542), -ea, -Xms2g, -Xmx2g, -XX:+HeapDumpOnOutOfMemoryError, -DIGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_TEST_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_UPDATE_NOTIFIER=false, -DIGNITE_NO_DISCO_ORDER=true, -DIGNITE_PERFORMANCE_SUGGESTIONS_DISABLED=true, -Djava.net.preferIPv4Stack=true, -DTEST_SCALE_FACTOR=1.0, -DIGNITE_TEST_PROP_LOG4J_FILE=log4j-tc-test.xml, -DIGNITE_QUIET=false, -DIGNITE_MARSHAL_BUFFERS_RECHECK=1000, -Dmaven.repo.local=/opt/buildagent/.m2/repository] [21:04:32] : [Step 4/5] [2021-11-19 21:04:32,227][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] System cache's DataRegion size is configured to 40 MB. Use DataStorageConfiguration.systemRegionInitialSize property to change the setting. [21:04:32] : [Step 4/5] [2021-11-19 21:04:32,227][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] Configured caches [in 'sysMemPlc' dataRegion: ['ignite-sys-cache']] [21:04:32]W: [org.apache.ignite:ignite-core] [2021-11-19 21:04:32,227][WARN ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] Peer class loading is enabled (disable it in production for performance and deployment consistency reasons) [21:04:32] : [Step 4/5] [2021-11-19 21:04:32,228][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] 3-rd party licenses can be found at: /opt/buildagent/work/7bc1c54bc719b67c/libs/licenses [21:04:32] : [Step 4/5] [2021-11-19 21:04:32,233][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] Configured plugins: [21:04:32] : [Step 4/5] [2021-11-19 21:04:32,233][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- StanByClusterTestProvider 1.0 [21:04:32] : [Step 4/5] [2021-11-19 21:04:32,233][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- null [21:04:32] : [Step 4/5] [2021-11-19 21:04:32,233][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] [21:04:32] : [Step 4/5] [2021-11-19 21:04:32,234][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- PageMemory tracker plugin 1.0 [21:04:32] : [Step 4/5] [2021-11-19 21:04:32,234][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- null [21:04:32] : [Step 4/5] [2021-11-19 21:04:32,234][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] [21:04:32] : [Step 4/5] [2021-11-19 21:04:32,234][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- TestDistibutedConfigurationPlugin 1.0 [21:04:32] : [Step 4/5] [2021-11-19 21:04:32,235][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- null [21:04:32] : [Step 4/5] [2021-11-19 21:04:32,235][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] [21:04:32] : [Step 4/5] [2021-11-19 21:04:32,235][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- NodeValidationPluginProvider 1.0 [21:04:32] : [Step 4/5] [2021-11-19 21:04:32,235][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- null [21:04:32] : [Step 4/5] [2021-11-19 21:04:32,235][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] [21:04:32] : [Step 4/5] [2021-11-19 21:04:32,236][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][FailureProcessor] Configured failure handler: [hnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]]] [21:04:32] : [Step 4/5] [2021-11-19 21:04:32,262][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][TcpCommunicationSpi] Successfully bound communication NIO server to TCP port [port=45150, locHost=/127.0.0.1, selectorsCnt=12, selectorSpins=0, pairedConn=false] [21:04:32]W: [org.apache.ignite:ignite-core] [2021-11-19 21:04:32,263][WARN ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][TcpCommunicationSpi] Message queue limit is set to 0 which may lead to potential OOMEs when running cache operations in FULL_ASYNC or PRIMARY_SYNC modes due to message queues growth on sender and receiver sides. [21:04:32] : [Step 4/5] [2021-11-19 21:04:32,268][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][GridCollisionManager] Collision resolution is disabled (all jobs will be activated upon arrival). [21:04:32] : [Step 4/5] [2021-11-19 21:04:32,268][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] Security status [authentication=off, sandbox=off, tls/ssl=off] [21:04:32] : [Step 4/5] Surefire report watcher [21:04:32] : [Surefire report watcher] Watching paths: [21:04:32] : [Surefire report watcher] /opt/buildagent/temp/buildTmp/ignite-tools-junit-reports1777670380320881607/test-org.apache.ignite.testsuites.IgniteBasicWithPersistenceTestSuite1637345069611.xml [21:04:32]i: [Step 4/5] org.apache.ignite.testsuites.IgniteBasicWithPersistenceTestSuite [21:04:32]i: [org.apache.ignite.testsuites.IgniteBasicWithPersistenceTestSuite] org.apache.ignite.internal.encryption.EncryptedCacheGroupCreateTest.testCreateNotEncryptedCacheInEncryptedGroupFails [21:04:32]i: [org.apache.ignite.testsuites.IgniteBasicWithPersistenceTestSuite] org.apache.ignite.internal.encryption.EncryptedCacheGroupCreateTest.testCreateEncryptedCacheGroup [21:04:32] : [Step 4/5] [2021-11-19 21:04:32,327][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:04:32] : [Step 4/5] [2021-11-19 21:04:32,421][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][MaintenanceProcessor] Resolved store directory for node persistent data: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0 [21:04:32] : [Step 4/5] [2021-11-19 21:04:32,423][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][CacheObjectBinaryProcessorImpl] Resolved directory for serialized binary metadata: /opt/buildagent/work/7bc1c54bc719b67c/work/db/binary_meta/grid_0 [21:04:32] : [Step 4/5] [2021-11-19 21:04:32,430][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0 [21:04:32] : [Step 4/5] [2021-11-19 21:04:32,431][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][FileWriteAheadLogManager] Resolved write ahead log work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0 [21:04:32] : [Step 4/5] [2021-11-19 21:04:32,431][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][FileWriteAheadLogManager] Resolved write ahead log archive directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0 [21:04:32] : [Step 4/5] [2021-11-19 21:04:32,842][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000000.wal [21:04:32]W: [org.apache.ignite:ignite-core] [2021-11-19 21:04:32,843][WARN ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] DataRegion maxSize=10.5 MB is smaller than defaultInitialSize=268.4 MB, setting initialSize to 10.5 MB [21:04:32] : [Step 4/5] [2021-11-19 21:04:32,849][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Configured data regions initialized successfully [total=5] [21:04:32] : [Step 4/5] [2021-11-19 21:04:32,851][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][IgniteSnapshotManager] Resolved snapshot work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/snapshots [21:04:32] : [Step 4/5] [2021-11-19 21:04:32,852][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][IgniteSnapshotManager] Resolved temp directory for snapshot creation: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0/snp [21:04:32] : [Step 4/5] [2021-11-19 21:04:32,855][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][ClientListenerProcessor] Client connector processor has started on TCP port 10800 [21:04:32] : [Step 4/5] [2021-11-19 21:04:32,863][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] Non-loopback local IPs: 172.17.0.4 [21:04:32] : [Step 4/5] [2021-11-19 21:04:32,864][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] Enabled local MACs: 0242AC110004 [21:04:32] : [Step 4/5] [2021-11-19 21:04:32,867][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:04:32] : [Step 4/5] [2021-11-19 21:04:32,870][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:04:32] : [Step 4/5] [2021-11-19 21:04:32,870][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:04:32] : [Step 4/5] [2021-11-19 21:04:32,873][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Applying lost metastore updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:04:32] : [Step 4/5] [2021-11-19 21:04:32,874][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=0 ms] [21:04:32] : [Step 4/5] [2021-11-19 21:04:32,875][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][GridCacheProcessor] Restoring partition state for local groups. [21:04:32] : [Step 4/5] [2021-11-19 21:04:32,875][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=0, partitionsProcessed=0, time=0ms] [21:04:32] : [Step 4/5] [2021-11-19 21:04:32,877][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][GridEncryptionManager] Encryption keys loaded from metastore. [grps=, masterKeyName=ignite.master.key] [21:04:32] : [Step 4/5] [2021-11-19 21:04:32,885][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][ClusterProcessor] Cluster ID and tag has been read from metastorage: null [21:04:32] : [Step 4/5] [2021-11-19 21:04:32,885][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][IgniteClusterImpl] Shutdown policy was updated [oldVal=null, newVal=null] [21:04:32] : [Step 4/5] [2021-11-19 21:04:32,886][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Checkpoint frequency deviation changed [oldVal=null, newVal=null] [21:04:32] : [Step 4/5] [2021-11-19 21:04:32,896][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][FilePageStoreManager] Cleanup cache stores [total=1, left=0, cleanFiles=false] [21:04:32] : [Step 4/5] [2021-11-19 21:04:32,899][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:04:32] : [Step 4/5] [2021-11-19 21:04:32,900][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:04:32] : [Step 4/5] [2021-11-19 21:04:32,902][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:04:32] : [Step 4/5] [2021-11-19 21:04:32,903][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Data Regions Started: 5 [21:04:32] : [Step 4/5] [2021-11-19 21:04:32,903][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] ^-- sysMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:04:32] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:04:32] : [Step 4/5] ^-- default region [type=default, persistence=true, lazyAlloc=true, [21:04:32] : [Step 4/5] ... initCfg=10MB, maxCfg=10MB, usedRam=0MB, freeRam=100%, allocRam=0MB, allocTotal=0MB] [21:04:32] : [Step 4/5] ^-- metastoreMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:04:32] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:04:32] : [Step 4/5] ^-- TxLog region [type=internal, persistence=true, lazyAlloc=false, [21:04:32] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:04:32] : [Step 4/5] ^-- volatileDsMemPlc region [type=user, persistence=false, lazyAlloc=true, [21:04:32] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB] [21:04:32] : [Step 4/5] ^-- Ignite persistence [used=0MB] [21:04:32] : [Step 4/5] [21:04:32] : [Step 4/5] [2021-11-19 21:04:32,906][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Starting binary memory restore for: [-2100569601] [21:04:32] : [Step 4/5] [2021-11-19 21:04:32,915][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:04:32] : [Step 4/5] [2021-11-19 21:04:32,915][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:04:32] : [Step 4/5] [2021-11-19 21:04:32,917][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000000.wal, offset=0, ver=2] [21:04:32] : [Step 4/5] [2021-11-19 21:04:32,923][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][GridCacheProcessor] Started cache in recovery mode [name=ignite-sys-cache, id=-2100569601, dataRegionName=sysMemPlc, mode=REPLICATED, atomicity=TRANSACTIONAL, backups=2147483647, mvcc=false] [21:04:32] : [Step 4/5] [2021-11-19 21:04:32,924][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Binary recovery performed in 18 ms. [21:04:32] : [Step 4/5] [2021-11-19 21:04:32,924][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:04:32] : [Step 4/5] [2021-11-19 21:04:32,925][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Applying lost cache updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:04:33] : [Step 4/5] [2021-11-19 21:04:33,036][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=102 ms] [21:04:33] : [Step 4/5] [2021-11-19 21:04:33,036][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][GridCacheProcessor] Restoring partition state for local groups. [21:04:33] : [Step 4/5] [2021-11-19 21:04:33,053][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=1, partitionsProcessed=100, time=22ms] [21:04:33] : [Step 4/5] [2021-11-19 21:04:33,337][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][TestTcpDiscoverySpi] Successfully bound to TCP port [port=47500, localHost=localhost/127.0.0.1, locNodeId=00e0e9f0-ad4e-4057-8861-d6fd939f1000] [21:04:33] : [Step 4/5] [2021-11-19 21:04:33,348][INFO ][disco-notifier-worker-#8351%grid-0%][MvccProcessorImpl] Assigned mvcc coordinator [crd=MvccCoordinator [topVer=AffinityTopologyVersion [topVer=1, minorTopVer=0], nodeId=00e0e9f0-ad4e-4057-8861-d6fd939f1000, ver=1637345073343, local=true, initialized=false]] [21:04:33] : [Step 4/5] [2021-11-19 21:04:33,350][INFO ][sys-#8331%grid-0%][ClusterProcessor] Writing cluster ID and tag to metastorage on ready for write ClusterIdAndTag [id=ff84c0df-a536-4bab-9124-dba409ba3604, tag=stoic_poitras] [21:04:33] : [Step 4/5] [2021-11-19 21:04:33,355][INFO ][disco-notifier-worker-#8351%grid-0%][ClusterProcessor] stoic_poitras [21:04:33] : [Step 4/5] [2021-11-19 21:04:33,357][INFO ][disco-notifier-worker-#8351%grid-0%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustEnabled' was changed from 'null' to 'false' [21:04:33] : [Step 4/5] [2021-11-19 21:04:33,359][INFO ][disco-notifier-worker-#8351%grid-0%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustTimeout' was changed from 'null' to '300000' [21:04:33] : [Step 4/5] [2021-11-19 21:04:33,360][INFO ][disco-notifier-worker-#8351%grid-0%][IgniteTxManager] Transactions parameter 'longOperationsDumpTimeout' was changed from 'null' to '60000' [21:04:33] : [Step 4/5] [2021-11-19 21:04:33,360][INFO ][disco-notifier-worker-#8351%grid-0%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpThreshold' was changed from 'null' to '0' [21:04:33] : [Step 4/5] [2021-11-19 21:04:33,361][INFO ][disco-notifier-worker-#8351%grid-0%][IgniteTxManager] Transactions parameter 'transactionTimeDumpSamplesCoefficient' was changed from 'null' to '0.0' [21:04:33] : [Step 4/5] [2021-11-19 21:04:33,362][INFO ][disco-notifier-worker-#8351%grid-0%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpSamplesPerSecondLimit' was changed from 'null' to '5' [21:04:33] : [Step 4/5] [2021-11-19 21:04:33,366][INFO ][disco-notifier-worker-#8351%grid-0%][IgniteTxManager] Transactions parameter 'collisionsDumpInterval' was changed from 'null' to '1000' [21:04:33] : [Step 4/5] [2021-11-19 21:04:33,366][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] To start Console Management & Monitoring run ignitevisorcmd.{sh|bat} [21:04:33] : [Step 4/5] [2021-11-19 21:04:33,367][INFO ][disco-notifier-worker-#8351%grid-0%][IgniteTxManager] Transactions parameter 'txOwnerDumpRequestsAllowed' was changed from 'null' to 'true' [21:04:33] : [Step 4/5] [2021-11-19 21:04:33,367][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] [21:04:33] : [Step 4/5] [21:04:33] : [Step 4/5] >>> +-------------------------------------------+ [21:04:33] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:04:33] : [Step 4/5] >>> +-------------------------------------------+ [21:04:33] : [Step 4/5] >>> OS name: Linux 4.15.0-151-generic amd64 [21:04:33] : [Step 4/5] >>> CPU(s): 24 [21:04:33] : [Step 4/5] >>> Heap: 2.0GB [21:04:33] : [Step 4/5] >>> VM name: 16724@c4dfe9a430b2 [21:04:33] : [Step 4/5] >>> Ignite instance name: grid-0 [21:04:33] : [Step 4/5] >>> Local node [ID=00E0E9F0-AD4E-4057-8861-D6FD939F1000, order=1, clientMode=false] [21:04:33] : [Step 4/5] >>> Local node addresses: [127.0.0.1] [21:04:33] : [Step 4/5] >>> Local ports: TCP:10800 TCP:45150 TCP:47500 [21:04:33] : [Step 4/5] [21:04:33] : [Step 4/5] [2021-11-19 21:04:33,367][INFO ][disco-notifier-worker-#8351%grid-0%][GridCacheDatabaseSharedManager] Historical rebalance WAL threshold changed [property=historical.rebalance.threshold, oldVal=null, newVal=500] [21:04:33] : [Step 4/5] [2021-11-19 21:04:33,368][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] >>> Ignite cluster is in INACTIVE state (limited functionality available). Use control.(sh|bat) script or IgniteCluster.state(ClusterState.ACTIVE) to change the state. [21:04:33] : [Step 4/5] [2021-11-19 21:04:33,369][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][GridDiscoveryManager] Topology snapshot [ver=1, locNode=00e0e9f0, servers=1, clients=0, state=INACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=00e0e9f0-ad4e-4057-8861-d6fd939f1000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:04:33] : [Step 4/5] [2021-11-19 21:04:33,370][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][G] Node started : [stage="Configure system pool" (0 ms),stage="Start managers" (217 ms),stage="Configure binary metadata" (3 ms),stage="Start processors" (436 ms),stage="Start 'StanByClusterTestProvider' plugin" (0 ms),stage="Start 'PageMemory tracker plugin' plugin" (0 ms),stage="Start 'TestDistibutedConfigurationPlugin' plugin" (0 ms),stage="Start 'NodeValidationPluginProvider' plugin" (0 ms),stage="Init metastore" (33 ms),stage="Init and start regions" (9 ms),stage="Restore binary memory" (18 ms),stage="Restore logical state" (129 ms),stage="Finish recovery" (281 ms),stage="Join topology" (13 ms),stage="Await transition" (2 ms),stage="Await exchange" (18 ms),stage="Total time" (1159 ms)] [21:04:33] : [Step 4/5] [2021-11-19 21:04:33,371][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][root] Node started with the following configuration [id=00e0e9f0-ad4e-4057-8861-d6fd939f1000, marshaller=BinaryMarshaller [], discovery=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=5000, ackTimeout=5000, marsh=JdkMarshaller [clsFilter=org.apache.ignite.marshaller.MarshallerUtils$1@e7593f4], reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], binaryCfg=null, lateAff=true] [21:04:33]W: [org.apache.ignite:ignite-core] [2021-11-19 21:04:33,377][WARN ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][G] Ignite work directory is not provided, automatically resolved to: /opt/buildagent/work/7bc1c54bc719b67c/work [21:04:33] : [Step 4/5] [2021-11-19 21:04:33,379][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-6] [21:04:33] : [Step 4/5] [21:04:33] : [Step 4/5] >>> __________ ________________ [21:04:33] : [Step 4/5] >>> / _/ ___/ |/ / _/_ __/ __/ [21:04:33] : [Step 4/5] >>> _/ // (7 7 // / / / / _/ [21:04:33] : [Step 4/5] >>> /___/\___/_/|_/___/ /_/ /___/ [21:04:33] : [Step 4/5] >>> [21:04:33] : [Step 4/5] >>> ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:04:33] : [Step 4/5] >>> 2021 Copyright(C) Apache Software Foundation [21:04:33] : [Step 4/5] >>> [21:04:33] : [Step 4/5] >>> Ignite documentation: http://ignite.apache.org [21:04:33] : [Step 4/5] [21:04:33] : [Step 4/5] [2021-11-19 21:04:33,379][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-6] Config URL: n/a [21:04:33] : [Step 4/5] [2021-11-19 21:04:33,380][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-6] IgniteConfiguration [igniteInstanceName=grid-6, pubPoolSize=24, svcPoolSize=24, callbackPoolSize=24, stripedPoolSize=24, sysPoolSize=24, mgmtPoolSize=4, dataStreamerPoolSize=24, utilityCachePoolSize=24, utilityCacheKeepAliveTime=60000, p2pPoolSize=2, qryPoolSize=24, buildIdxPoolSize=4, igniteHome=/opt/buildagent/work/7bc1c54bc719b67c, igniteWorkDir=/opt/buildagent/work/7bc1c54bc719b67c/work, mbeanSrv=com.sun.jmx.mbeanserver.JmxMBeanServer@6fe85038, nodeId=60dac6e8-23c9-4d3f-a60f-788efce74006, marsh=BinaryMarshaller [], marshLocJobs=false, daemon=false, p2pEnabled=true, netTimeout=10000, netCompressionLevel=1, sndRetryDelay=1000, sndRetryCnt=3, metricsHistSize=10000, metricsUpdateFreq=1000, metricsExpTime=9223372036854775807, discoSpi=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=0, ackTimeout=0, marsh=null, reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], segPlc=STOP, segResolveAttempts=2, waitForSegOnStart=true, allResolversPassReq=true, segChkFreq=10000, commSpi=TcpCommunicationSpi [connectGate=org.apache.ignite.spi.communication.tcp.internal.ConnectGateway@4a20599a, ctxInitLatch=java.util.concurrent.CountDownLatch@47178e87[Count = 1], stopping=false, clientPool=null, nioSrvWrapper=null, stateProvider=null], evtSpi=MemoryEventStorageSpi [expireAgeMs=9223372036854775807, expireCnt=10000, filter=null], colSpi=NoopCollisionSpi [], deploySpi=LocalDeploymentSpi [], indexingSpi=org.apache.ignite.spi.indexing.noop.NoopIndexingSpi@6d4338a2, addrRslvr=null, encryptionSpi=org.apache.ignite.spi.encryption.keystore.KeystoreEncryptionSpi@515c8e41, tracingSpi=org.apache.ignite.spi.tracing.NoopTracingSpi@738d56df, clientMode=false, rebalanceThreadPoolSize=4, rebalanceTimeout=10000, rebalanceBatchesPrefetchCnt=3, rebalanceThrottle=0, rebalanceBatchSize=524288, txCfg=TransactionConfiguration [txSerEnabled=false, dfltIsolation=REPEATABLE_READ, dfltConcurrency=PESSIMISTIC, dfltTxTimeout=0, txTimeoutOnPartitionMapExchange=0, deadlockTimeout=10000, pessimisticTxLogSize=0, pessimisticTxLogLinger=10000, tmLookupClsName=null, txManagerFactory=null, useJtaSync=false], cacheSanityCheckEnabled=true, discoStartupDelay=60000, deployMode=SHARED, p2pMissedCacheSize=100, locHost=127.0.0.1, timeSrvPortBase=31100, timeSrvPortRange=100, failureDetectionTimeout=10000, sysWorkerBlockedTimeout=null, clientFailureDetectionTimeout=10000, metricsLogFreq=0, connectorCfg=null, odbcCfg=null, warmupClos=null, atomicCfg=AtomicConfiguration [seqReserveSize=1000, cacheMode=PARTITIONED, backups=1, aff=null, grpName=null], classLdr=null, sslCtxFactory=null, platformCfg=null, binaryCfg=null, memCfg=null, pstCfg=null, dsCfg=DataStorageConfiguration [sysRegionInitSize=41943040, sysRegionMaxSize=104857600, pageSize=4096, concLvl=0, dfltDataRegConf=DataRegionConfiguration [name=default, maxSize=10485760, initSize=268435456, swapPath=null, pageEvictionMode=DISABLED, pageReplacementMode=CLOCK, evictionThreshold=0.9, emptyPagesPoolSize=100, metricsEnabled=false, metricsSubIntervalCount=5, metricsRateTimeInterval=60000, persistenceEnabled=true, checkpointPageBufSize=0, lazyMemoryAllocation=true, warmUpCfg=null], dataRegions=null, storagePath=null, checkpointFreq=180000, lockWaitTime=10000, checkpointThreads=4, checkpointWriteOrder=SEQUENTIAL, walHistSize=20, maxWalArchiveSize=1073741824, walSegments=10, walSegmentSize=67108864, walPath=db/wal, walArchivePath=db/wal/archive, cdcWalPath=db/wal/cdc, cdcEnabled=false, metricsEnabled=false, walMode=FSYNC, walTlbSize=131072, walBuffSize=0, walFlushFreq=2000, walFsyncDelay=1000, walRecordIterBuffSize=67108864, alwaysWriteFullPages=false, fileIOFactory=org.apache.ignite.internal.processors.cache.persistence.file.AsyncFileIOFactory@1e921127, metricsSubIntervalCnt=5, metricsRateTimeInterval=60000, walAutoArchiveAfterInactivity=-1, walForceArchiveTimeout=-1, writeThrottlingEnabled=false, walCompactionEnabled=false, walCompactionLevel=1, checkpointReadLockTimeout=null, walPageCompression=DISABLED, walPageCompressionLevel=null, dfltWarmUpCfg=null, encCfg=org.apache.ignite.configuration.EncryptionConfiguration@e0c88eb, defragmentationThreadPoolSize=4, minWalArchiveSize=-1], snapshotPath=snapshots, activeOnStart=true, activeOnStartPropSetFlag=false, autoActivation=true, autoActivationPropSetFlag=false, clusterStateOnStart=null, sqlConnCfg=null, cliConnCfg=ClientConnectorConfiguration [host=null, port=10800, portRange=100, sockSndBufSize=0, sockRcvBufSize=0, tcpNoDelay=true, maxOpenCursorsPerConn=128, threadPoolSize=24, selectorCnt=12, idleTimeout=0, handshakeTimeout=10000, jdbcEnabled=true, odbcEnabled=true, thinCliEnabled=true, sslEnabled=false, useIgniteSslCtxFactory=true, sslClientAuth=false, sslCtxFactory=null, thinCliCfg=ThinClientConfiguration [maxActiveTxPerConn=100, maxActiveComputeTasksPerConn=0]], mvccVacuumThreadCnt=2, mvccVacuumFreq=5000, authEnabled=false, failureHnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]], commFailureRslvr=null, sqlCfg=SqlConfiguration [longQryWarnTimeout=3000, dfltQryTimeout=0, sqlQryHistSize=1000, validationEnabled=false], asyncContinuationExecutor=null] [21:04:33] : [Step 4/5] [2021-11-19 21:04:33,391][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-6] Daemon mode: off [21:04:33] : [Step 4/5] [2021-11-19 21:04:33,392][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-6] OS: Linux 4.15.0-151-generic amd64 [21:04:33] : [Step 4/5] [2021-11-19 21:04:33,392][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-6] OS user: teamcity [21:04:33] : [Step 4/5] [2021-11-19 21:04:33,392][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-6] PID: 16724 [21:04:33] : [Step 4/5] [2021-11-19 21:04:33,393][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-6] Language runtime: Java Platform API Specification ver. 1.8 [21:04:33] : [Step 4/5] [2021-11-19 21:04:33,393][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-6] VM information: Java(TM) SE Runtime Environment 1.8.0_261-b12 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 25.261-b12 [21:04:33] : [Step 4/5] [2021-11-19 21:04:33,394][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-6] VM total memory: 1.9GB [21:04:33] : [Step 4/5] [2021-11-19 21:04:33,394][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-6] Remote Management [restart: off, REST: off, JMX (remote: off)] [21:04:33] : [Step 4/5] [2021-11-19 21:04:33,394][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-6] Logger: GridTestLog4jLogger [quiet=false, config=null] [21:04:33] : [Step 4/5] [2021-11-19 21:04:33,395][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-6] IGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c [21:04:33] : [Step 4/5] [2021-11-19 21:04:33,395][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-6] VM arguments: [-DIGNITE_DUMP_THREADS_ON_FAILURE=false, -DMono=/usr/bin/mono-sgen, -DMono4.0_x64=/usr/lib/mono/4.0, -DMono4.5_x64=/usr/lib/mono/4.5, -DMonoVersion=6.12.0.90, -DSKIP_BUILD=false, -Dagent.home.dir=/opt/buildagent, -Dagent.name=aitc-lin02_03, -Dagent.ownPort=9090, -Dagent.work.dir=/opt/buildagent/work, -Dbuild.number=95, -Dbuild.vcs.number=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.1=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.GitHubApacheIgnite=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dclassworlds.conf=/opt/buildagent/temp/buildTmp/teamcity.m2.conf, -Dcom.jetbrains.maven.watcher.report.file=/opt/buildagent/temp/buildTmp/maven-build-info.xml, -Djava.io.tmpdir=/opt/buildagent/temp/buildTmp, -Dmaven.home=/opt/buildagent/tools/maven3_6, -Dmaven.multiModuleProjectDirectory=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.agent.cpuBenchmark=457, -Dteamcity.agent.dotnet.agent_url=http://localhost:9090/RPC2, -Dteamcity.agent.dotnet.build_id=6278078, -Dteamcity.auth.password=*******, -Dteamcity.auth.userId=TeamCityBuildId=6278078, -Dteamcity.build.changedFiles.file=/opt/buildagent/temp/buildTmp/changedFiles6342607772318147725.txt, -Dteamcity.build.checkoutDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.build.id=6278078, -Dteamcity.build.properties.file=/opt/buildagent/temp/buildTmp/teamcity.build5164517880467851002.properties, -Dteamcity.build.tempDir=/opt/buildagent/temp/buildTmp, -Dteamcity.build.workingDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.buildConfName=Basic 3, -Dteamcity.buildType.id=IgniteTests24Java8_Basic3, -Dteamcity.configuration.properties.file=/opt/buildagent/temp/buildTmp/teamcity.config5591980786735343870.properties, -Dteamcity.maven.userSettings.path=/opt/buildagent/temp/buildTmp/maven_settings_585072866407032347.xml, -Dteamcity.maven.watcher.home=/opt/buildagent/plugins/mavenPlugin/maven-watcher-jdk16, -Dteamcity.projectName=Ignite Tests 2.x (JDK 8/11), -Dteamcity.runner.properties.file=/opt/buildagent/temp/buildTmp/teamcity.runner9098465561618137420.properties, -Dteamcity.tests.recentlyFailedTests.file=/opt/buildagent/temp/buildTmp/testsToRunFirst3891775683130404069.txt, -Dteamcity.version=2021.2 (build 99542), -ea, -Xms2g, -Xmx2g, -XX:+HeapDumpOnOutOfMemoryError, -DIGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_TEST_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_UPDATE_NOTIFIER=false, -DIGNITE_NO_DISCO_ORDER=true, -DIGNITE_PERFORMANCE_SUGGESTIONS_DISABLED=true, -Djava.net.preferIPv4Stack=true, -DTEST_SCALE_FACTOR=1.0, -DIGNITE_TEST_PROP_LOG4J_FILE=log4j-tc-test.xml, -DIGNITE_QUIET=false, -DIGNITE_MARSHAL_BUFFERS_RECHECK=1000, -Dmaven.repo.local=/opt/buildagent/.m2/repository] [21:04:33] : [Step 4/5] [2021-11-19 21:04:33,401][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-6] System cache's DataRegion size is configured to 40 MB. Use DataStorageConfiguration.systemRegionInitialSize property to change the setting. [21:04:33]W: [org.apache.ignite:ignite-core] [2021-11-19 21:04:33,402][WARN ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-6] Peer class loading is enabled (disable it in production for performance and deployment consistency reasons) [21:04:33] : [Step 4/5] [2021-11-19 21:04:33,402][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-6] Configured caches [in 'sysMemPlc' dataRegion: ['ignite-sys-cache']] [21:04:33] : [Step 4/5] [2021-11-19 21:04:33,402][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-6] 3-rd party licenses can be found at: /opt/buildagent/work/7bc1c54bc719b67c/libs/licenses [21:04:33] : [Step 4/5] [2021-11-19 21:04:33,408][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] Configured plugins: [21:04:33] : [Step 4/5] [2021-11-19 21:04:33,408][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- StanByClusterTestProvider 1.0 [21:04:33] : [Step 4/5] [2021-11-19 21:04:33,409][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- null [21:04:33] : [Step 4/5] [2021-11-19 21:04:33,409][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] [21:04:33] : [Step 4/5] [2021-11-19 21:04:33,409][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- PageMemory tracker plugin 1.0 [21:04:33] : [Step 4/5] [2021-11-19 21:04:33,409][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- null [21:04:33] : [Step 4/5] [2021-11-19 21:04:33,410][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] [21:04:33] : [Step 4/5] [2021-11-19 21:04:33,410][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- TestDistibutedConfigurationPlugin 1.0 [21:04:33] : [Step 4/5] [2021-11-19 21:04:33,410][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- null [21:04:33] : [Step 4/5] [2021-11-19 21:04:33,411][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] [21:04:33] : [Step 4/5] [2021-11-19 21:04:33,411][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- NodeValidationPluginProvider 1.0 [21:04:33] : [Step 4/5] [2021-11-19 21:04:33,411][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- null [21:04:33] : [Step 4/5] [2021-11-19 21:04:33,412][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] [21:04:33] : [Step 4/5] [2021-11-19 21:04:33,412][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][FailureProcessor] Configured failure handler: [hnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]]] [21:04:33] : [Step 4/5] [2021-11-19 21:04:33,426][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][TcpCommunicationSpi] Successfully bound communication NIO server to TCP port [port=45151, locHost=/127.0.0.1, selectorsCnt=12, selectorSpins=0, pairedConn=false] [21:04:33]W: [org.apache.ignite:ignite-core] [2021-11-19 21:04:33,427][WARN ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][TcpCommunicationSpi] Message queue limit is set to 0 which may lead to potential OOMEs when running cache operations in FULL_ASYNC or PRIMARY_SYNC modes due to message queues growth on sender and receiver sides. [21:04:33] : [Step 4/5] [2021-11-19 21:04:33,432][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][GridCollisionManager] Collision resolution is disabled (all jobs will be activated upon arrival). [21:04:33] : [Step 4/5] [2021-11-19 21:04:33,433][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-6] Security status [authentication=off, sandbox=off, tls/ssl=off] [21:04:33] : [Step 4/5] [2021-11-19 21:04:33,500][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:04:33] : [Step 4/5] [2021-11-19 21:04:33,599][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][MaintenanceProcessor] Resolved store directory for node persistent data: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_6 [21:04:33] : [Step 4/5] [2021-11-19 21:04:33,601][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][CacheObjectBinaryProcessorImpl] Resolved directory for serialized binary metadata: /opt/buildagent/work/7bc1c54bc719b67c/work/db/binary_meta/grid_6 [21:04:33] : [Step 4/5] [2021-11-19 21:04:33,607][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_6 [21:04:33] : [Step 4/5] [2021-11-19 21:04:33,607][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][FileWriteAheadLogManager] Resolved write ahead log work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_6 [21:04:33] : [Step 4/5] [2021-11-19 21:04:33,608][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][FileWriteAheadLogManager] Resolved write ahead log archive directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_6 [21:04:33] : [Step 4/5] [2021-11-19 21:04:33,999][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_6/0000000000000000.wal [21:04:34] : [Step 4/5] [2021-11-19 21:04:34,005][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Configured data regions initialized successfully [total=5] [21:04:34] : [Step 4/5] [2021-11-19 21:04:34,007][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][IgniteSnapshotManager] Resolved snapshot work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/snapshots [21:04:34] : [Step 4/5] [2021-11-19 21:04:34,008][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][IgniteSnapshotManager] Resolved temp directory for snapshot creation: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_6/snp [21:04:34] : [Step 4/5] [2021-11-19 21:04:34,011][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][ClientListenerProcessor] Client connector processor has started on TCP port 10801 [21:04:34] : [Step 4/5] [2021-11-19 21:04:34,014][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-6] Non-loopback local IPs: 172.17.0.4 [21:04:34] : [Step 4/5] [2021-11-19 21:04:34,014][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-6] Enabled local MACs: 0242AC110004 [21:04:34] : [Step 4/5] [2021-11-19 21:04:34,015][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:04:34] : [Step 4/5] [2021-11-19 21:04:34,017][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:04:34] : [Step 4/5] [2021-11-19 21:04:34,018][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:04:34] : [Step 4/5] [2021-11-19 21:04:34,020][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Applying lost metastore updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:04:34] : [Step 4/5] [2021-11-19 21:04:34,021][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=0 ms] [21:04:34] : [Step 4/5] [2021-11-19 21:04:34,021][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][GridCacheProcessor] Restoring partition state for local groups. [21:04:34] : [Step 4/5] [2021-11-19 21:04:34,021][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=0, partitionsProcessed=0, time=0ms] [21:04:34] : [Step 4/5] [2021-11-19 21:04:34,022][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][GridEncryptionManager] Encryption keys loaded from metastore. [grps=, masterKeyName=ignite.master.key] [21:04:34] : [Step 4/5] [2021-11-19 21:04:34,023][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][ClusterProcessor] Cluster ID and tag has been read from metastorage: null [21:04:34] : [Step 4/5] [2021-11-19 21:04:34,024][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][IgniteClusterImpl] Shutdown policy was updated [oldVal=null, newVal=null] [21:04:34] : [Step 4/5] [2021-11-19 21:04:34,024][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Checkpoint frequency deviation changed [oldVal=null, newVal=null] [21:04:34] : [Step 4/5] [2021-11-19 21:04:34,034][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][FilePageStoreManager] Cleanup cache stores [total=1, left=0, cleanFiles=false] [21:04:34] : [Step 4/5] [2021-11-19 21:04:34,037][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:04:34] : [Step 4/5] [2021-11-19 21:04:34,038][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:04:34] : [Step 4/5] [2021-11-19 21:04:34,040][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:04:34] : [Step 4/5] [2021-11-19 21:04:34,041][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Data Regions Started: 5 [21:04:34] : [Step 4/5] [2021-11-19 21:04:34,041][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] ^-- sysMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:04:34] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:04:34] : [Step 4/5] ^-- default region [type=default, persistence=true, lazyAlloc=true, [21:04:34] : [Step 4/5] ... initCfg=10MB, maxCfg=10MB, usedRam=0MB, freeRam=100%, allocRam=0MB, allocTotal=0MB] [21:04:34] : [Step 4/5] ^-- metastoreMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:04:34] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:04:34] : [Step 4/5] ^-- TxLog region [type=internal, persistence=true, lazyAlloc=false, [21:04:34] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:04:34] : [Step 4/5] ^-- volatileDsMemPlc region [type=user, persistence=false, lazyAlloc=true, [21:04:34] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB] [21:04:34] : [Step 4/5] ^-- Ignite persistence [used=0MB] [21:04:34] : [Step 4/5] [21:04:34] : [Step 4/5] [2021-11-19 21:04:34,043][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Starting binary memory restore for: [-2100569601] [21:04:34] : [Step 4/5] [2021-11-19 21:04:34,051][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:04:34] : [Step 4/5] [2021-11-19 21:04:34,052][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:04:34] : [Step 4/5] [2021-11-19 21:04:34,054][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_6/0000000000000000.wal, offset=0, ver=2] [21:04:34] : [Step 4/5] [2021-11-19 21:04:34,059][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][GridCacheProcessor] Started cache in recovery mode [name=ignite-sys-cache, id=-2100569601, dataRegionName=sysMemPlc, mode=REPLICATED, atomicity=TRANSACTIONAL, backups=2147483647, mvcc=false] [21:04:34] : [Step 4/5] [2021-11-19 21:04:34,060][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Binary recovery performed in 17 ms. [21:04:34] : [Step 4/5] [2021-11-19 21:04:34,061][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:04:34] : [Step 4/5] [2021-11-19 21:04:34,061][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Applying lost cache updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:04:34] : [Step 4/5] [2021-11-19 21:04:34,143][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=81 ms] [21:04:34] : [Step 4/5] [2021-11-19 21:04:34,143][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][GridCacheProcessor] Restoring partition state for local groups. [21:04:34] : [Step 4/5] [2021-11-19 21:04:34,151][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=1, partitionsProcessed=100, time=10ms] [21:04:34] : [Step 4/5] [2021-11-19 21:04:34,517][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][TestTcpDiscoverySpi] Successfully bound to TCP port [port=47501, localHost=localhost/127.0.0.1, locNodeId=60dac6e8-23c9-4d3f-a60f-788efce74006] [21:04:34] : [Step 4/5] [2021-11-19 21:04:34,521][INFO ][tcp-disco-srvr-[:47500]-#419%grid-0%-#8353%grid-0%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=40143] [21:04:34] : [Step 4/5] [2021-11-19 21:04:34,521][INFO ][tcp-disco-srvr-[:47500]-#419%grid-0%-#8353%grid-0%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=40143] [21:04:34] : [Step 4/5] [2021-11-19 21:04:34,522][INFO ][tcp-disco-sock-reader-[]-#425%grid-0%-#8472%grid-0%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:40143, rmtPort=40143] [21:04:34] : [Step 4/5] [2021-11-19 21:04:34,525][INFO ][tcp-disco-sock-reader-[60dac6e8 127.0.0.1:40143]-#425%grid-0%-#8472%grid-0%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=60dac6e8-23c9-4d3f-a60f-788efce74006, rmtAddr=/127.0.0.1:40143] [21:04:34] : [Step 4/5] [2021-11-19 21:04:34,532][INFO ][tcp-disco-srvr-[:47501]-#424%grid-6%-#8471%grid-6%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=33525] [21:04:34] : [Step 4/5] [2021-11-19 21:04:34,533][INFO ][tcp-disco-srvr-[:47501]-#424%grid-6%-#8471%grid-6%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=33525] [21:04:34] : [Step 4/5] [2021-11-19 21:04:34,536][INFO ][tcp-disco-sock-reader-[]-#426%grid-6%-#8473%grid-6%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:33525, rmtPort=33525] [21:04:34] : [Step 4/5] [2021-11-19 21:04:34,537][INFO ][tcp-disco-sock-reader-[]-#426%grid-6%-#8473%grid-6%][TestTcpDiscoverySpi] Received ping request from the remote node [rmtNodeId=00e0e9f0-ad4e-4057-8861-d6fd939f1000, rmtAddr=/127.0.0.1:33525, rmtPort=33525] [21:04:34] : [Step 4/5] [2021-11-19 21:04:34,539][INFO ][tcp-disco-sock-reader-[]-#426%grid-6%-#8473%grid-6%][TestTcpDiscoverySpi] Finished writing ping response [rmtNodeId=00e0e9f0-ad4e-4057-8861-d6fd939f1000, rmtAddr=/127.0.0.1:33525, rmtPort=33525] [21:04:34]W: [org.apache.ignite:ignite-core] [2021-11-19 21:04:34,540][WARN ][tcp-disco-sock-reader-[]-#426%grid-6%-#8473%grid-6%][TestTcpDiscoverySpi] Failed to shutdown socket [21:04:34]W: [org.apache.ignite:ignite-core] java.net.SocketException: Socket output is already shutdown [21:04:34]W: [org.apache.ignite:ignite-core] at java.net.Socket.shutdownOutput(Socket.java:1572) [21:04:34]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.close(IgniteUtils.java:4247) [21:04:34]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.discovery.tcp.ServerImpl$SocketReader.body(ServerImpl.java:7370) [21:04:34]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.IgniteSpiThread.run(IgniteSpiThread.java:58) [21:04:34] : [Step 4/5] [2021-11-19 21:04:34,540][INFO ][tcp-disco-sock-reader-[60dac6e8 127.0.0.1:40143]-#425%grid-0%-#8472%grid-0%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:40143, rmtPort=40143, rmtNodeId=60dac6e8-23c9-4d3f-a60f-788efce74006] [21:04:34] : [Step 4/5] [2021-11-19 21:04:34,541][INFO ][tcp-disco-sock-reader-[]-#426%grid-6%-#8473%grid-6%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:33525, rmtPort=33525, rmtNodeId=null] [21:04:34] : [Step 4/5] [2021-11-19 21:04:34,544][INFO ][tcp-disco-msg-worker-[crd]-#418%grid-0%-#8352%grid-0%][GridEncryptionManager] Joining node doesn't have stored group keys [node=60dac6e8-23c9-4d3f-a60f-788efce74006] [21:04:34] : [Step 4/5] [2021-11-19 21:04:34,557][INFO ][tcp-disco-msg-worker-[crd]-#418%grid-0%-#8352%grid-0%][TestTcpDiscoverySpi] New next node [newNext=TcpDiscoveryNode [id=60dac6e8-23c9-4d3f-a60f-788efce74006, consistentId=grid-6, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=0, intOrder=2, lastExchangeTime=1637345074525, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false]] [21:04:34] : [Step 4/5] [2021-11-19 21:04:34,559][INFO ][tcp-disco-srvr-[:47501]-#424%grid-6%-#8471%grid-6%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=37243] [21:04:34] : [Step 4/5] [2021-11-19 21:04:34,559][INFO ][tcp-disco-srvr-[:47501]-#424%grid-6%-#8471%grid-6%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=37243] [21:04:34] : [Step 4/5] [2021-11-19 21:04:34,560][INFO ][tcp-disco-sock-reader-[]-#427%grid-6%-#8474%grid-6%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:37243, rmtPort=37243] [21:04:34] : [Step 4/5] [2021-11-19 21:04:34,561][INFO ][tcp-disco-sock-reader-[00e0e9f0 127.0.0.1:37243]-#427%grid-6%-#8474%grid-6%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=00e0e9f0-ad4e-4057-8861-d6fd939f1000, rmtAddr=/127.0.0.1:37243] [21:04:34] : [Step 4/5] [2021-11-19 21:04:34,566][INFO ][tcp-disco-msg-worker-[]-#423%grid-6%-#8470%grid-6%][TestTcpDiscoverySpi] New next node [newNext=TcpDiscoveryNode [id=00e0e9f0-ad4e-4057-8861-d6fd939f1000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345074555, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false]] [21:04:34] : [Step 4/5] [2021-11-19 21:04:34,568][INFO ][tcp-disco-srvr-[:47500]-#419%grid-0%-#8353%grid-0%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=52555] [21:04:34] : [Step 4/5] [2021-11-19 21:04:34,568][INFO ][tcp-disco-srvr-[:47500]-#419%grid-0%-#8353%grid-0%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=52555] [21:04:34] : [Step 4/5] [2021-11-19 21:04:34,569][INFO ][tcp-disco-sock-reader-[]-#428%grid-0%-#8475%grid-0%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:52555, rmtPort=52555] [21:04:34] : [Step 4/5] [2021-11-19 21:04:34,570][INFO ][tcp-disco-sock-reader-[60dac6e8 127.0.0.1:52555]-#428%grid-0%-#8475%grid-0%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=60dac6e8-23c9-4d3f-a60f-788efce74006, rmtAddr=/127.0.0.1:52555] [21:04:34] : [Step 4/5] [2021-11-19 21:04:34,574][INFO ][disco-event-worker-#8355%grid-0%][GridDiscoveryManager] Added new node to topology: TcpDiscoveryNode [id=60dac6e8-23c9-4d3f-a60f-788efce74006, consistentId=grid-6, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637345074525, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false] [21:04:34] : [Step 4/5] [2021-11-19 21:04:34,575][INFO ][disco-event-worker-#8355%grid-0%][GridDiscoveryManager] Topology snapshot [ver=2, locNode=00e0e9f0, servers=2, clients=0, state=INACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=00e0e9f0-ad4e-4057-8861-d6fd939f1000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=60dac6e8-23c9-4d3f-a60f-788efce74006, consistentId=grid-6, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:04:34] : [Step 4/5] [2021-11-19 21:04:34,580][INFO ][tcp-disco-msg-worker-[00e0e9f0 127.0.0.1:47500]-#423%grid-6%-#8470%grid-6%][ClusterProcessor] stoic_poitras [21:04:34] : [Step 4/5] [2021-11-19 21:04:34,580][INFO ][tcp-disco-msg-worker-[00e0e9f0 127.0.0.1:47500]-#423%grid-6%-#8470%grid-6%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustEnabled' was changed from 'null' to 'false' [21:04:34] : [Step 4/5] [2021-11-19 21:04:34,581][INFO ][tcp-disco-msg-worker-[00e0e9f0 127.0.0.1:47500]-#423%grid-6%-#8470%grid-6%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustTimeout' was changed from 'null' to '300000' [21:04:34] : [Step 4/5] [2021-11-19 21:04:34,581][INFO ][tcp-disco-msg-worker-[00e0e9f0 127.0.0.1:47500]-#423%grid-6%-#8470%grid-6%][IgniteTxManager] Transactions parameter 'longOperationsDumpTimeout' was changed from 'null' to '60000' [21:04:34] : [Step 4/5] [2021-11-19 21:04:34,582][INFO ][tcp-disco-msg-worker-[00e0e9f0 127.0.0.1:47500]-#423%grid-6%-#8470%grid-6%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpThreshold' was changed from 'null' to '0' [21:04:34] : [Step 4/5] [2021-11-19 21:04:34,582][INFO ][tcp-disco-msg-worker-[00e0e9f0 127.0.0.1:47500]-#423%grid-6%-#8470%grid-6%][IgniteTxManager] Transactions parameter 'transactionTimeDumpSamplesCoefficient' was changed from 'null' to '0.0' [21:04:34] : [Step 4/5] [2021-11-19 21:04:34,583][INFO ][tcp-disco-msg-worker-[00e0e9f0 127.0.0.1:47500]-#423%grid-6%-#8470%grid-6%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpSamplesPerSecondLimit' was changed from 'null' to '5' [21:04:34] : [Step 4/5] [2021-11-19 21:04:34,583][INFO ][tcp-disco-msg-worker-[00e0e9f0 127.0.0.1:47500]-#423%grid-6%-#8470%grid-6%][IgniteTxManager] Transactions parameter 'collisionsDumpInterval' was changed from 'null' to '1000' [21:04:34] : [Step 4/5] [2021-11-19 21:04:34,584][INFO ][tcp-disco-msg-worker-[00e0e9f0 127.0.0.1:47500]-#423%grid-6%-#8470%grid-6%][IgniteTxManager] Transactions parameter 'txOwnerDumpRequestsAllowed' was changed from 'null' to 'true' [21:04:34] : [Step 4/5] [2021-11-19 21:04:34,584][INFO ][tcp-disco-msg-worker-[00e0e9f0 127.0.0.1:47500]-#423%grid-6%-#8470%grid-6%][GridCacheDatabaseSharedManager] Historical rebalance WAL threshold changed [property=historical.rebalance.threshold, oldVal=null, newVal=500] [21:04:34] : [Step 4/5] [2021-11-19 21:04:34,585][INFO ][disco-notifier-worker-#8469%grid-6%][MvccProcessorImpl] Assigned mvcc coordinator [crd=MvccCoordinator [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=0], nodeId=00e0e9f0-ad4e-4057-8861-d6fd939f1000, ver=1637345073343, local=false, initialized=false]] [21:04:34] : [Step 4/5] [2021-11-19 21:04:34,586][INFO ][sys-#8467%grid-6%][ClusterProcessor] Writing cluster ID and tag to metastorage on ready for write ClusterIdAndTag [id=ff84c0df-a536-4bab-9124-dba409ba3604, tag=stoic_poitras] [21:04:34] : [Step 4/5] [2021-11-19 21:04:34,619][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-6] To start Console Management & Monitoring run ignitevisorcmd.{sh|bat} [21:04:34] : [Step 4/5] [2021-11-19 21:04:34,619][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-6] [21:04:34] : [Step 4/5] [21:04:34] : [Step 4/5] >>> +-------------------------------------------+ [21:04:34] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:04:34] : [Step 4/5] >>> +-------------------------------------------+ [21:04:34] : [Step 4/5] >>> OS name: Linux 4.15.0-151-generic amd64 [21:04:34] : [Step 4/5] >>> CPU(s): 24 [21:04:34] : [Step 4/5] >>> Heap: 2.0GB [21:04:34] : [Step 4/5] >>> VM name: 16724@c4dfe9a430b2 [21:04:34] : [Step 4/5] >>> Ignite instance name: grid-6 [21:04:34] : [Step 4/5] >>> Local node [ID=60DAC6E8-23C9-4D3F-A60F-788EFCE74006, order=2, clientMode=false] [21:04:34] : [Step 4/5] >>> Local node addresses: [127.0.0.1] [21:04:34] : [Step 4/5] >>> Local ports: TCP:10801 TCP:45151 TCP:47501 [21:04:34] : [Step 4/5] [21:04:34] : [Step 4/5] [2021-11-19 21:04:34,621][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-6] >>> Ignite cluster is in INACTIVE state (limited functionality available). Use control.(sh|bat) script or IgniteCluster.state(ClusterState.ACTIVE) to change the state. [21:04:34] : [Step 4/5] [2021-11-19 21:04:34,621][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][GridDiscoveryManager] Topology snapshot [ver=2, locNode=60dac6e8, servers=2, clients=0, state=INACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=00e0e9f0-ad4e-4057-8861-d6fd939f1000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=60dac6e8-23c9-4d3f-a60f-788efce74006, consistentId=grid-6, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:04:34] : [Step 4/5] [2021-11-19 21:04:34,622][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][G] Node started : [stage="Configure system pool" (0 ms),stage="Start managers" (222 ms),stage="Configure binary metadata" (3 ms),stage="Start processors" (409 ms),stage="Start 'StanByClusterTestProvider' plugin" (0 ms),stage="Start 'PageMemory tracker plugin' plugin" (0 ms),stage="Start 'TestDistibutedConfigurationPlugin' plugin" (0 ms),stage="Start 'NodeValidationPluginProvider' plugin" (0 ms),stage="Init metastore" (20 ms),stage="Init and start regions" (8 ms),stage="Restore binary memory" (17 ms),stage="Restore logical state" (90 ms),stage="Finish recovery" (364 ms),stage="Join topology" (71 ms),stage="Await transition" (2 ms),stage="Await exchange" (32 ms),stage="Total time" (1238 ms)] [21:04:34] : [Step 4/5] [2021-11-19 21:04:34,624][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][root] Node started with the following configuration [id=60dac6e8-23c9-4d3f-a60f-788efce74006, marshaller=BinaryMarshaller [], discovery=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=5000, ackTimeout=5000, marsh=JdkMarshaller [clsFilter=org.apache.ignite.marshaller.MarshallerUtils$1@de290b0], reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], binaryCfg=null, lateAff=true] [21:04:34]W: [org.apache.ignite:ignite-core] [2021-11-19 21:04:34,631][WARN ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][G] Ignite work directory is not provided, automatically resolved to: /opt/buildagent/work/7bc1c54bc719b67c/work [21:04:34] : [Step 4/5] [2021-11-19 21:04:34,633][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%client1] [21:04:34] : [Step 4/5] [21:04:34] : [Step 4/5] >>> __________ ________________ [21:04:34] : [Step 4/5] >>> / _/ ___/ |/ / _/_ __/ __/ [21:04:34] : [Step 4/5] >>> _/ // (7 7 // / / / / _/ [21:04:34] : [Step 4/5] >>> /___/\___/_/|_/___/ /_/ /___/ [21:04:34] : [Step 4/5] >>> [21:04:34] : [Step 4/5] >>> ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:04:34] : [Step 4/5] >>> 2021 Copyright(C) Apache Software Foundation [21:04:34] : [Step 4/5] >>> [21:04:34] : [Step 4/5] >>> Ignite documentation: http://ignite.apache.org [21:04:34] : [Step 4/5] [21:04:34] : [Step 4/5] [2021-11-19 21:04:34,634][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%client1] Config URL: n/a [21:04:34] : [Step 4/5] [2021-11-19 21:04:34,635][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%client1] IgniteConfiguration [igniteInstanceName=client1, pubPoolSize=24, svcPoolSize=24, callbackPoolSize=24, stripedPoolSize=24, sysPoolSize=24, mgmtPoolSize=4, dataStreamerPoolSize=24, utilityCachePoolSize=24, utilityCacheKeepAliveTime=60000, p2pPoolSize=2, qryPoolSize=24, buildIdxPoolSize=4, igniteHome=/opt/buildagent/work/7bc1c54bc719b67c, igniteWorkDir=/opt/buildagent/work/7bc1c54bc719b67c/work, mbeanSrv=com.sun.jmx.mbeanserver.JmxMBeanServer@6fe85038, nodeId=10e1382f-5a0e-4692-ad18-c30bec6d4001, marsh=BinaryMarshaller [], marshLocJobs=false, daemon=false, p2pEnabled=true, netTimeout=10000, netCompressionLevel=1, sndRetryDelay=1000, sndRetryCnt=3, metricsHistSize=10000, metricsUpdateFreq=1000, metricsExpTime=9223372036854775807, discoSpi=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=0, ackTimeout=0, marsh=null, reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], segPlc=STOP, segResolveAttempts=2, waitForSegOnStart=true, allResolversPassReq=true, segChkFreq=10000, commSpi=TcpCommunicationSpi [connectGate=org.apache.ignite.spi.communication.tcp.internal.ConnectGateway@4545157c, ctxInitLatch=java.util.concurrent.CountDownLatch@3e680051[Count = 1], stopping=false, clientPool=null, nioSrvWrapper=null, stateProvider=null], evtSpi=MemoryEventStorageSpi [expireAgeMs=9223372036854775807, expireCnt=10000, filter=null], colSpi=NoopCollisionSpi [], deploySpi=LocalDeploymentSpi [], indexingSpi=org.apache.ignite.spi.indexing.noop.NoopIndexingSpi@1cc9d486, addrRslvr=null, encryptionSpi=org.apache.ignite.spi.encryption.noop.NoopEncryptionSpi@55273014, tracingSpi=org.apache.ignite.spi.tracing.NoopTracingSpi@2b84f7c6, clientMode=true, rebalanceThreadPoolSize=4, rebalanceTimeout=10000, rebalanceBatchesPrefetchCnt=3, rebalanceThrottle=0, rebalanceBatchSize=524288, txCfg=TransactionConfiguration [txSerEnabled=false, dfltIsolation=REPEATABLE_READ, dfltConcurrency=PESSIMISTIC, dfltTxTimeout=0, txTimeoutOnPartitionMapExchange=0, deadlockTimeout=10000, pessimisticTxLogSize=0, pessimisticTxLogLinger=10000, tmLookupClsName=null, txManagerFactory=null, useJtaSync=false], cacheSanityCheckEnabled=true, discoStartupDelay=60000, deployMode=SHARED, p2pMissedCacheSize=100, locHost=127.0.0.1, timeSrvPortBase=31100, timeSrvPortRange=100, failureDetectionTimeout=10000, sysWorkerBlockedTimeout=null, clientFailureDetectionTimeout=10000, metricsLogFreq=0, connectorCfg=null, odbcCfg=null, warmupClos=null, atomicCfg=AtomicConfiguration [seqReserveSize=1000, cacheMode=PARTITIONED, backups=1, aff=null, grpName=null], classLdr=null, sslCtxFactory=null, platformCfg=null, binaryCfg=null, memCfg=null, pstCfg=null, dsCfg=DataStorageConfiguration [sysRegionInitSize=41943040, sysRegionMaxSize=104857600, pageSize=4096, concLvl=0, dfltDataRegConf=DataRegionConfiguration [name=default, maxSize=10485760, initSize=268435456, swapPath=null, pageEvictionMode=DISABLED, pageReplacementMode=CLOCK, evictionThreshold=0.9, emptyPagesPoolSize=100, metricsEnabled=false, metricsSubIntervalCount=5, metricsRateTimeInterval=60000, persistenceEnabled=true, checkpointPageBufSize=0, lazyMemoryAllocation=true, warmUpCfg=null], dataRegions=null, storagePath=null, checkpointFreq=180000, lockWaitTime=10000, checkpointThreads=4, checkpointWriteOrder=SEQUENTIAL, walHistSize=20, maxWalArchiveSize=1073741824, walSegments=10, walSegmentSize=67108864, walPath=db/wal, walArchivePath=db/wal/archive, cdcWalPath=db/wal/cdc, cdcEnabled=false, metricsEnabled=false, walMode=FSYNC, walTlbSize=131072, walBuffSize=0, walFlushFreq=2000, walFsyncDelay=1000, walRecordIterBuffSize=67108864, alwaysWriteFullPages=false, fileIOFactory=org.apache.ignite.internal.processors.cache.persistence.file.AsyncFileIOFactory@146894dd, metricsSubIntervalCnt=5, metricsRateTimeInterval=60000, walAutoArchiveAfterInactivity=-1, walForceArchiveTimeout=-1, writeThrottlingEnabled=false, walCompactionEnabled=false, walCompactionLevel=1, checkpointReadLockTimeout=null, walPageCompression=DISABLED, walPageCompressionLevel=null, dfltWarmUpCfg=null, encCfg=org.apache.ignite.configuration.EncryptionConfiguration@7c12319, defragmentationThreadPoolSize=4, minWalArchiveSize=-1], snapshotPath=snapshots, activeOnStart=true, activeOnStartPropSetFlag=false, autoActivation=true, autoActivationPropSetFlag=false, clusterStateOnStart=null, sqlConnCfg=null, cliConnCfg=ClientConnectorConfiguration [host=null, port=10800, portRange=100, sockSndBufSize=0, sockRcvBufSize=0, tcpNoDelay=true, maxOpenCursorsPerConn=128, threadPoolSize=24, selectorCnt=12, idleTimeout=0, handshakeTimeout=10000, jdbcEnabled=true, odbcEnabled=true, thinCliEnabled=true, sslEnabled=false, useIgniteSslCtxFactory=true, sslClientAuth=false, sslCtxFactory=null, thinCliCfg=ThinClientConfiguration [maxActiveTxPerConn=100, maxActiveComputeTasksPerConn=0]], mvccVacuumThreadCnt=2, mvccVacuumFreq=5000, authEnabled=false, failureHnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]], commFailureRslvr=null, sqlCfg=SqlConfiguration [longQryWarnTimeout=3000, dfltQryTimeout=0, sqlQryHistSize=1000, validationEnabled=false], asyncContinuationExecutor=null] [21:04:34] : [Step 4/5] [2021-11-19 21:04:34,647][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%client1] Daemon mode: off [21:04:34] : [Step 4/5] [2021-11-19 21:04:34,647][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%client1] OS: Linux 4.15.0-151-generic amd64 [21:04:34] : [Step 4/5] [2021-11-19 21:04:34,647][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%client1] OS user: teamcity [21:04:34] : [Step 4/5] [2021-11-19 21:04:34,648][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%client1] PID: 16724 [21:04:34] : [Step 4/5] [2021-11-19 21:04:34,648][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%client1] Language runtime: Java Platform API Specification ver. 1.8 [21:04:34] : [Step 4/5] [2021-11-19 21:04:34,648][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%client1] VM information: Java(TM) SE Runtime Environment 1.8.0_261-b12 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 25.261-b12 [21:04:34] : [Step 4/5] [2021-11-19 21:04:34,649][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%client1] VM total memory: 1.9GB [21:04:34] : [Step 4/5] [2021-11-19 21:04:34,649][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%client1] Remote Management [restart: off, REST: off, JMX (remote: off)] [21:04:34] : [Step 4/5] [2021-11-19 21:04:34,650][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%client1] Logger: GridTestLog4jLogger [quiet=false, config=null] [21:04:34] : [Step 4/5] [2021-11-19 21:04:34,650][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%client1] IGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c [21:04:34] : [Step 4/5] [2021-11-19 21:04:34,651][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%client1] VM arguments: [-DIGNITE_DUMP_THREADS_ON_FAILURE=false, -DMono=/usr/bin/mono-sgen, -DMono4.0_x64=/usr/lib/mono/4.0, -DMono4.5_x64=/usr/lib/mono/4.5, -DMonoVersion=6.12.0.90, -DSKIP_BUILD=false, -Dagent.home.dir=/opt/buildagent, -Dagent.name=aitc-lin02_03, -Dagent.ownPort=9090, -Dagent.work.dir=/opt/buildagent/work, -Dbuild.number=95, -Dbuild.vcs.number=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.1=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.GitHubApacheIgnite=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dclassworlds.conf=/opt/buildagent/temp/buildTmp/teamcity.m2.conf, -Dcom.jetbrains.maven.watcher.report.file=/opt/buildagent/temp/buildTmp/maven-build-info.xml, -Djava.io.tmpdir=/opt/buildagent/temp/buildTmp, -Dmaven.home=/opt/buildagent/tools/maven3_6, -Dmaven.multiModuleProjectDirectory=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.agent.cpuBenchmark=457, -Dteamcity.agent.dotnet.agent_url=http://localhost:9090/RPC2, -Dteamcity.agent.dotnet.build_id=6278078, -Dteamcity.auth.password=*******, -Dteamcity.auth.userId=TeamCityBuildId=6278078, -Dteamcity.build.changedFiles.file=/opt/buildagent/temp/buildTmp/changedFiles6342607772318147725.txt, -Dteamcity.build.checkoutDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.build.id=6278078, -Dteamcity.build.properties.file=/opt/buildagent/temp/buildTmp/teamcity.build5164517880467851002.properties, -Dteamcity.build.tempDir=/opt/buildagent/temp/buildTmp, -Dteamcity.build.workingDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.buildConfName=Basic 3, -Dteamcity.buildType.id=IgniteTests24Java8_Basic3, -Dteamcity.configuration.properties.file=/opt/buildagent/temp/buildTmp/teamcity.config5591980786735343870.properties, -Dteamcity.maven.userSettings.path=/opt/buildagent/temp/buildTmp/maven_settings_585072866407032347.xml, -Dteamcity.maven.watcher.home=/opt/buildagent/plugins/mavenPlugin/maven-watcher-jdk16, -Dteamcity.projectName=Ignite Tests 2.x (JDK 8/11), -Dteamcity.runner.properties.file=/opt/buildagent/temp/buildTmp/teamcity.runner9098465561618137420.properties, -Dteamcity.tests.recentlyFailedTests.file=/opt/buildagent/temp/buildTmp/testsToRunFirst3891775683130404069.txt, -Dteamcity.version=2021.2 (build 99542), -ea, -Xms2g, -Xmx2g, -XX:+HeapDumpOnOutOfMemoryError, -DIGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_TEST_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_UPDATE_NOTIFIER=false, -DIGNITE_NO_DISCO_ORDER=true, -DIGNITE_PERFORMANCE_SUGGESTIONS_DISABLED=true, -Djava.net.preferIPv4Stack=true, -DTEST_SCALE_FACTOR=1.0, -DIGNITE_TEST_PROP_LOG4J_FILE=log4j-tc-test.xml, -DIGNITE_QUIET=false, -DIGNITE_MARSHAL_BUFFERS_RECHECK=1000, -Dmaven.repo.local=/opt/buildagent/.m2/repository] [21:04:34] : [Step 4/5] [2021-11-19 21:04:34,656][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%client1] System cache's DataRegion size is configured to 40 MB. Use DataStorageConfiguration.systemRegionInitialSize property to change the setting. [21:04:34] : [Step 4/5] [2021-11-19 21:04:34,656][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%client1] Configured caches [in 'sysMemPlc' dataRegion: ['ignite-sys-cache']] [21:04:34]W: [org.apache.ignite:ignite-core] [2021-11-19 21:04:34,657][WARN ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%client1] Peer class loading is enabled (disable it in production for performance and deployment consistency reasons) [21:04:34] : [Step 4/5] [2021-11-19 21:04:34,657][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%client1] 3-rd party licenses can be found at: /opt/buildagent/work/7bc1c54bc719b67c/libs/licenses [21:04:34] : [Step 4/5] [2021-11-19 21:04:34,662][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] Configured plugins: [21:04:34] : [Step 4/5] [2021-11-19 21:04:34,662][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- StanByClusterTestProvider 1.0 [21:04:34] : [Step 4/5] [2021-11-19 21:04:34,662][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- null [21:04:34] : [Step 4/5] [2021-11-19 21:04:34,662][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] [21:04:34] : [Step 4/5] [2021-11-19 21:04:34,663][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- PageMemory tracker plugin 1.0 [21:04:34] : [Step 4/5] [2021-11-19 21:04:34,663][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- null [21:04:34] : [Step 4/5] [2021-11-19 21:04:34,663][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] [21:04:34] : [Step 4/5] [2021-11-19 21:04:34,663][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- TestDistibutedConfigurationPlugin 1.0 [21:04:34] : [Step 4/5] [2021-11-19 21:04:34,663][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- null [21:04:34] : [Step 4/5] [2021-11-19 21:04:34,664][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] [21:04:34] : [Step 4/5] [2021-11-19 21:04:34,664][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- NodeValidationPluginProvider 1.0 [21:04:34] : [Step 4/5] [2021-11-19 21:04:34,664][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- null [21:04:34] : [Step 4/5] [2021-11-19 21:04:34,665][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] [21:04:34] : [Step 4/5] [2021-11-19 21:04:34,665][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][FailureProcessor] Configured failure handler: [hnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]]] [21:04:34]W: [org.apache.ignite:ignite-core] [2021-11-19 21:04:34,693][WARN ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][TcpCommunicationSpi] Message queue limit is set to 0 which may lead to potential OOMEs when running cache operations in FULL_ASYNC or PRIMARY_SYNC modes due to message queues growth on sender and receiver sides. [21:04:34] : [Step 4/5] [2021-11-19 21:04:34,693][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][TcpCommunicationSpi] Successfully bound communication NIO server to TCP port [port=45152, locHost=/127.0.0.1, selectorsCnt=12, selectorSpins=0, pairedConn=false] [21:04:34] : [Step 4/5] [2021-11-19 21:04:34,703][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][GridCollisionManager] Collision resolution is disabled (all jobs will be activated upon arrival). [21:04:34] : [Step 4/5] [2021-11-19 21:04:34,703][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%client1] Security status [authentication=off, sandbox=off, tls/ssl=off] [21:04:34]W: [org.apache.ignite:ignite-core] [2021-11-19 21:04:34,709][WARN ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][GridCacheProcessor] Persistent Store is not supported on client nodes (Persistent Store's configuration will be ignored). [21:04:34] : [Step 4/5] [2021-11-19 21:04:34,714][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][IgniteCacheDatabaseSharedManager] Configured data regions initialized successfully [total=4] [21:04:34] : [Step 4/5] [2021-11-19 21:04:34,719][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][ClientListenerProcessor] Client connector processor has started on TCP port 10802 [21:04:34] : [Step 4/5] [2021-11-19 21:04:34,724][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%client1] Non-loopback local IPs: 172.17.0.4 [21:04:34] : [Step 4/5] [2021-11-19 21:04:34,725][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%client1] Enabled local MACs: 0242AC110004 [21:04:34] : [Step 4/5] [2021-11-19 21:04:34,725][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][ClusterProcessor] Cluster ID and tag has been read from metastorage: null [21:04:34] : [Step 4/5] [2021-11-19 21:04:34,726][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][IgniteClusterImpl] Shutdown policy was updated [oldVal=null, newVal=null] [21:04:34] : [Step 4/5] [2021-11-19 21:04:34,737][INFO ][tcp-disco-srvr-[:47501]-#424%grid-6%-#8471%grid-6%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=55949] [21:04:34] : [Step 4/5] [2021-11-19 21:04:34,737][INFO ][tcp-disco-srvr-[:47501]-#424%grid-6%-#8471%grid-6%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=55949] [21:04:34] : [Step 4/5] [2021-11-19 21:04:34,740][INFO ][tcp-disco-sock-reader-[]-#435%grid-6%-#8569%grid-6%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:55949, rmtPort=55949] [21:04:34] : [Step 4/5] [2021-11-19 21:04:34,741][INFO ][tcp-disco-sock-reader-[10e1382f 127.0.0.1:55949 client]-#435%grid-6%-#8569%grid-6%][TestTcpDiscoverySpi] Initialized connection with remote client node [nodeId=10e1382f-5a0e-4692-ad18-c30bec6d4001, rmtAddr=/127.0.0.1:55949] [21:04:34] : [Step 4/5] [2021-11-19 21:04:34,771][INFO ][disco-event-worker-#8355%grid-0%][GridDiscoveryManager] Added new node to topology: TcpDiscoveryNode [id=10e1382f-5a0e-4692-ad18-c30bec6d4001, consistentId=client1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:0], discPort=0, order=3, intOrder=3, lastExchangeTime=1637345074740, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=true] [21:04:34] : [Step 4/5] [2021-11-19 21:04:34,772][INFO ][disco-event-worker-#8355%grid-0%][GridDiscoveryManager] Topology snapshot [ver=3, locNode=00e0e9f0, servers=2, clients=1, state=INACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=00e0e9f0-ad4e-4057-8861-d6fd939f1000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=60dac6e8-23c9-4d3f-a60f-788efce74006, consistentId=grid-6, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=10e1382f-5a0e-4692-ad18-c30bec6d4001, consistentId=client1, isClient=true, ver=2.13.0#20211119-sha1:00000000]]] [21:04:34] : [Step 4/5] [2021-11-19 21:04:34,774][INFO ][disco-event-worker-#8477%grid-6%][GridDiscoveryManager] Added new node to topology: TcpDiscoveryNode [id=10e1382f-5a0e-4692-ad18-c30bec6d4001, consistentId=client1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:0], discPort=0, order=3, intOrder=3, lastExchangeTime=1637345074760, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=true] [21:04:34] : [Step 4/5] [2021-11-19 21:04:34,775][INFO ][tcp-client-disco-msg-worker-#434%client1%-#8567%client1%][TestTcpDiscoverySpi] Router node: TcpDiscoveryNode [id=60dac6e8-23c9-4d3f-a60f-788efce74006, consistentId=grid-6, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637345074760, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false] [21:04:34] : [Step 4/5] [2021-11-19 21:04:34,775][INFO ][disco-event-worker-#8477%grid-6%][GridDiscoveryManager] Topology snapshot [ver=3, locNode=60dac6e8, servers=2, clients=1, state=INACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=00e0e9f0-ad4e-4057-8861-d6fd939f1000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=60dac6e8-23c9-4d3f-a60f-788efce74006, consistentId=grid-6, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=10e1382f-5a0e-4692-ad18-c30bec6d4001, consistentId=client1, isClient=true, ver=2.13.0#20211119-sha1:00000000]]] [21:04:34] : [Step 4/5] [2021-11-19 21:04:34,779][INFO ][tcp-client-disco-msg-worker-#434%client1%-#8567%client1%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustEnabled' was changed from 'null' to 'false' [21:04:34] : [Step 4/5] [2021-11-19 21:04:34,780][INFO ][tcp-client-disco-msg-worker-#434%client1%-#8567%client1%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustTimeout' was changed from 'null' to '300000' [21:04:34] : [Step 4/5] [2021-11-19 21:04:34,781][INFO ][tcp-client-disco-msg-worker-#434%client1%-#8567%client1%][IgniteTxManager] Transactions parameter 'collisionsDumpInterval' was changed from 'null' to '1000' [21:04:34] : [Step 4/5] [2021-11-19 21:04:34,781][INFO ][tcp-client-disco-msg-worker-#434%client1%-#8567%client1%][IgniteTxManager] Transactions parameter 'longOperationsDumpTimeout' was changed from 'null' to '60000' [21:04:34] : [Step 4/5] [2021-11-19 21:04:34,781][INFO ][tcp-client-disco-msg-worker-#434%client1%-#8567%client1%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpSamplesPerSecondLimit' was changed from 'null' to '5' [21:04:34] : [Step 4/5] [2021-11-19 21:04:34,782][INFO ][tcp-client-disco-msg-worker-#434%client1%-#8567%client1%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpThreshold' was changed from 'null' to '0' [21:04:34] : [Step 4/5] [2021-11-19 21:04:34,782][INFO ][tcp-client-disco-msg-worker-#434%client1%-#8567%client1%][IgniteTxManager] Transactions parameter 'transactionTimeDumpSamplesCoefficient' was changed from 'null' to '0.0' [21:04:34] : [Step 4/5] [2021-11-19 21:04:34,783][INFO ][tcp-client-disco-msg-worker-#434%client1%-#8567%client1%][IgniteTxManager] Transactions parameter 'txOwnerDumpRequestsAllowed' was changed from 'null' to 'true' [21:04:34] : [Step 4/5] [2021-11-19 21:04:34,783][INFO ][tcp-client-disco-msg-worker-#434%client1%-#8567%client1%][ClusterProcessor] stoic_poitras [21:04:34] : [Step 4/5] [2021-11-19 21:04:34,784][INFO ][disco-notifier-worker-#8564%client1%][MvccProcessorImpl] Assigned mvcc coordinator [crd=MvccCoordinator [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], nodeId=00e0e9f0-ad4e-4057-8861-d6fd939f1000, ver=1637345073343, local=false, initialized=false]] [21:04:34] : [Step 4/5] [2021-11-19 21:04:34,786][INFO ][sys-#8571%client1%][ClusterProcessor] Writing cluster ID and tag to metastorage on ready for write ClusterIdAndTag [id=ff84c0df-a536-4bab-9124-dba409ba3604, tag=stoic_poitras] [21:04:34] : [Step 4/5] [2021-11-19 21:04:34,810][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%client1] To start Console Management & Monitoring run ignitevisorcmd.{sh|bat} [21:04:34] : [Step 4/5] [2021-11-19 21:04:34,811][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%client1] [21:04:34] : [Step 4/5] [21:04:34] : [Step 4/5] >>> +-------------------------------------------+ [21:04:34] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:04:34] : [Step 4/5] >>> +-------------------------------------------+ [21:04:34] : [Step 4/5] >>> OS name: Linux 4.15.0-151-generic amd64 [21:04:34] : [Step 4/5] >>> CPU(s): 24 [21:04:34] : [Step 4/5] >>> Heap: 2.0GB [21:04:34] : [Step 4/5] >>> VM name: 16724@c4dfe9a430b2 [21:04:34] : [Step 4/5] >>> Ignite instance name: client1 [21:04:34] : [Step 4/5] >>> Local node [ID=10E1382F-5A0E-4692-AD18-C30BEC6D4001, order=3, clientMode=true] [21:04:34] : [Step 4/5] >>> Local node addresses: [127.0.0.1] [21:04:34] : [Step 4/5] >>> Local ports: TCP:10802 TCP:45152 [21:04:34] : [Step 4/5] [21:04:34] : [Step 4/5] [2021-11-19 21:04:34,812][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%client1] >>> Ignite cluster is in INACTIVE state (limited functionality available). Use control.(sh|bat) script or IgniteCluster.state(ClusterState.ACTIVE) to change the state. [21:04:34] : [Step 4/5] [2021-11-19 21:04:34,813][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][GridDiscoveryManager] Topology snapshot [ver=3, locNode=10e1382f, servers=2, clients=1, state=INACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=10e1382f-5a0e-4692-ad18-c30bec6d4001, consistentId=client1, isClient=true, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=00e0e9f0-ad4e-4057-8861-d6fd939f1000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=60dac6e8-23c9-4d3f-a60f-788efce74006, consistentId=grid-6, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:04:34] : [Step 4/5] [2021-11-19 21:04:34,814][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][G] Node started : [stage="Configure system pool" (0 ms),stage="Start managers" (73 ms),stage="Configure binary metadata" (2 ms),stage="Start processors" (15 ms),stage="Start 'StanByClusterTestProvider' plugin" (0 ms),stage="Start 'PageMemory tracker plugin' plugin" (0 ms),stage="Start 'TestDistibutedConfigurationPlugin' plugin" (0 ms),stage="Start 'NodeValidationPluginProvider' plugin" (0 ms),stage="Init metastore" (2 ms),stage="Finish recovery" (0 ms),stage="Join topology" (60 ms),stage="Await transition" (2 ms),stage="Await exchange" (24 ms),stage="Total time" (178 ms)] [21:04:34] : [Step 4/5] [2021-11-19 21:04:34,815][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][root] Node started with the following configuration [id=10e1382f-5a0e-4692-ad18-c30bec6d4001, marshaller=BinaryMarshaller [], discovery=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=5000, ackTimeout=5000, marsh=JdkMarshaller [clsFilter=org.apache.ignite.marshaller.MarshallerUtils$1@1752d44f], reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], binaryCfg=null, lateAff=true] [21:04:34] : [Step 4/5] [2021-11-19 21:04:34,817][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][GridClusterStateProcessor] Sending activate cluster request with BaselineTopology BaselineTopology [id=0, branchingHash=-2475315496, branchingType='New BaselineTopology', baselineNodes=[grid-0, grid-6]] [21:04:34] : [Step 4/5] [2021-11-19 21:04:34,820][INFO ][disco-notifier-worker-#8351%grid-0%][GridClusterStateProcessor] Received activate cluster request with BaselineTopology[id=0] initiator node ID: 00e0e9f0-ad4e-4057-8861-d6fd939f1000 [21:04:34] : [Step 4/5] [2021-11-19 21:04:34,820][INFO ][disco-notifier-worker-#8351%grid-0%][GridClusterStateProcessor] Started state transition: activate cluster [21:04:34] : [Step 4/5] [2021-11-19 21:04:34,821][INFO ][exchange-worker-#8356%grid-0%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], crd=true, evt=DISCOVERY_CUSTOM_EVT, evtNode=00e0e9f0-ad4e-4057-8861-d6fd939f1000, customEvt=ChangeGlobalStateMessage [id=4242d593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqId=6e05e118-e721-40df-9bea-0d7402f43dad, initiatingNodeId=00e0e9f0-ad4e-4057-8861-d6fd939f1000, state=ACTIVE, baselineTopology=BaselineTopology [id=0, branchingHash=-2475315496, branchingType='New BaselineTopology', baselineNodes=[grid-0, grid-6]], forceChangeBaselineTopology=false, timestamp=1637345074817, forceDeactivation=true], allowMerge=false, exchangeFreeSwitch=false] [21:04:34] : [Step 4/5] [2021-11-19 21:04:34,822][INFO ][disco-notifier-worker-#8469%grid-6%][GridClusterStateProcessor] Received activate cluster request with BaselineTopology[id=0] initiator node ID: 00e0e9f0-ad4e-4057-8861-d6fd939f1000 [21:04:34] : [Step 4/5] [2021-11-19 21:04:34,822][INFO ][exchange-worker-#8356%grid-0%][GridDhtPartitionsExchangeFuture] Start activation process [nodeId=00e0e9f0-ad4e-4057-8861-d6fd939f1000, client=false, topVer=AffinityTopologyVersion [topVer=3, minorTopVer=1]]. New state: ACTIVE [21:04:34] : [Step 4/5] [2021-11-19 21:04:34,823][INFO ][disco-notifier-worker-#8469%grid-6%][GridClusterStateProcessor] Started state transition: activate cluster [21:04:34] : [Step 4/5] [2021-11-19 21:04:34,823][INFO ][exchange-worker-#8356%grid-0%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0 [21:04:34] : [Step 4/5] [2021-11-19 21:04:34,823][INFO ][disco-notifier-worker-#8564%client1%][GridClusterStateProcessor] Received activate cluster request with BaselineTopology[id=0] initiator node ID: 00e0e9f0-ad4e-4057-8861-d6fd939f1000 [21:04:34] : [Step 4/5] [2021-11-19 21:04:34,824][INFO ][exchange-worker-#8478%grid-6%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], crd=false, evt=DISCOVERY_CUSTOM_EVT, evtNode=00e0e9f0-ad4e-4057-8861-d6fd939f1000, customEvt=ChangeGlobalStateMessage [id=4242d593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqId=6e05e118-e721-40df-9bea-0d7402f43dad, initiatingNodeId=00e0e9f0-ad4e-4057-8861-d6fd939f1000, state=ACTIVE, baselineTopology=BaselineTopology [id=0, branchingHash=-2475315496, branchingType='New BaselineTopology', baselineNodes=[grid-0, grid-6]], forceChangeBaselineTopology=false, timestamp=1637345074817, forceDeactivation=true], allowMerge=false, exchangeFreeSwitch=false] [21:04:34] : [Step 4/5] [2021-11-19 21:04:34,828][INFO ][disco-notifier-worker-#8564%client1%][GridClusterStateProcessor] Started state transition: activate cluster [21:04:34] : [Step 4/5] [2021-11-19 21:04:34,829][INFO ][exchange-worker-#8478%grid-6%][GridDhtPartitionsExchangeFuture] Start activation process [nodeId=60dac6e8-23c9-4d3f-a60f-788efce74006, client=false, topVer=AffinityTopologyVersion [topVer=3, minorTopVer=1]]. New state: ACTIVE [21:04:34] : [Step 4/5] [2021-11-19 21:04:34,830][INFO ][exchange-worker-#8478%grid-6%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_6 [21:04:34] : [Step 4/5] [2021-11-19 21:04:34,833][INFO ][exchange-worker-#8573%client1%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], crd=false, evt=DISCOVERY_CUSTOM_EVT, evtNode=00e0e9f0-ad4e-4057-8861-d6fd939f1000, customEvt=ChangeGlobalStateMessage [id=4242d593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqId=6e05e118-e721-40df-9bea-0d7402f43dad, initiatingNodeId=00e0e9f0-ad4e-4057-8861-d6fd939f1000, state=ACTIVE, baselineTopology=BaselineTopology [id=0, branchingHash=-2475315496, branchingType='New BaselineTopology', baselineNodes=[grid-0, grid-6]], forceChangeBaselineTopology=false, timestamp=1637345074817, forceDeactivation=true], allowMerge=false, exchangeFreeSwitch=false] [21:04:34] : [Step 4/5] [2021-11-19 21:04:34,833][INFO ][exchange-worker-#8356%grid-0%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000000.wal, offset=8713, ver=2] [21:04:34] : [Step 4/5] [2021-11-19 21:04:34,835][INFO ][exchange-worker-#8573%client1%][GridDhtPartitionsExchangeFuture] Start activation process [nodeId=10e1382f-5a0e-4692-ad18-c30bec6d4001, client=true, topVer=AffinityTopologyVersion [topVer=3, minorTopVer=1]]. New state: ACTIVE [21:04:34] : [Step 4/5] [2021-11-19 21:04:34,836][INFO ][exchange-worker-#8573%client1%][IgniteCacheDatabaseSharedManager] Data Regions Started: 4 [21:04:34] : [Step 4/5] [2021-11-19 21:04:34,837][INFO ][exchange-worker-#8573%client1%][IgniteCacheDatabaseSharedManager] ^-- sysMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:04:34] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB, allocTotal=0MB] [21:04:34] : [Step 4/5] ^-- default region [type=default, persistence=true, lazyAlloc=true, [21:04:34] : [Step 4/5] ... initCfg=10MB, maxCfg=10MB, usedRam=0MB, freeRam=100%, allocRam=0MB, allocTotal=0MB] [21:04:34] : [Step 4/5] ^-- TxLog region [type=internal, persistence=true, lazyAlloc=false, [21:04:34] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB, allocTotal=0MB] [21:04:34] : [Step 4/5] ^-- volatileDsMemPlc region [type=user, persistence=false, lazyAlloc=true, [21:04:34] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB] [21:04:34] : [Step 4/5] ^-- Ignite persistence [used=0MB] [21:04:34] : [Step 4/5] [21:04:34] : [Step 4/5] [2021-11-19 21:04:34,838][INFO ][exchange-worker-#8573%client1%][msg] Components activation performed in 3 ms. [21:04:34] : [Step 4/5] [2021-11-19 21:04:34,840][INFO ][exchange-worker-#8573%client1%][GridCacheProcessor] Started cache [name=ignite-sys-cache, id=-2100569601, dataRegionName=sysMemPlc, mode=REPLICATED, atomicity=TRANSACTIONAL, backups=2147483647, mvcc=false] [21:04:34] : [Step 4/5] [2021-11-19 21:04:34,841][INFO ][exchange-worker-#8356%grid-0%][GridClusterStateProcessor] Writing BaselineTopology[id=0] [21:04:34] : [Step 4/5] [2021-11-19 21:04:34,842][INFO ][exchange-worker-#8478%grid-6%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_6/0000000000000000.wal, offset=8713, ver=2] [21:04:34] : [Step 4/5] [2021-11-19 21:04:34,844][INFO ][exchange-worker-#8573%client1%][GridDhtPartitionsExchangeFuture] Successfully activated caches [nodeId=10e1382f-5a0e-4692-ad18-c30bec6d4001, client=true, topVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], newState=ACTIVE] [21:04:34] : [Step 4/5] [2021-11-19 21:04:34,846][INFO ][exchange-worker-#8478%grid-6%][GridClusterStateProcessor] Writing BaselineTopology[id=0] [21:04:34] : [Step 4/5] [2021-11-19 21:04:34,847][INFO ][grid-nio-worker-tcp-comm-0-#8295%TcpCommunicationSpi%][TcpCommunicationSpi] Accepted incoming communication connection [locAddr=/127.0.0.1:45150, rmtAddr=/127.0.0.1:59286] [21:04:34] : [Step 4/5] [2021-11-19 21:04:34,863][INFO ][exchange-worker-#8356%grid-0%][GridCacheDatabaseSharedManager] Finish recovery performed in 39 ms. [21:04:34] : [Step 4/5] [2021-11-19 21:04:34,869][INFO ][exchange-worker-#8356%grid-0%][msg] Components activation performed in 46 ms. [21:04:34] : [Step 4/5] [2021-11-19 21:04:34,870][INFO ][exchange-worker-#8356%grid-0%][GridCacheProcessor] Finished recovery for cache [cache=ignite-sys-cache, grp=ignite-sys-cache, startVer=AffinityTopologyVersion [topVer=3, minorTopVer=1]] [21:04:34] : [Step 4/5] [2021-11-19 21:04:34,871][INFO ][exchange-worker-#8478%grid-6%][GridCacheDatabaseSharedManager] Finish recovery performed in 40 ms. [21:04:34] : [Step 4/5] [2021-11-19 21:04:34,871][INFO ][exchange-worker-#8356%grid-0%][GridDhtPartitionsExchangeFuture] Successfully activated caches [nodeId=00e0e9f0-ad4e-4057-8861-d6fd939f1000, client=false, topVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], newState=ACTIVE] [21:04:34] : [Step 4/5] [2021-11-19 21:04:34,872][INFO ][exchange-worker-#8356%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:04:34] : [Step 4/5] [2021-11-19 21:04:34,882][INFO ][exchange-worker-#8478%grid-6%][msg] Components activation performed in 52 ms. [21:04:34] : [Step 4/5] [2021-11-19 21:04:34,882][INFO ][grid-nio-worker-tcp-comm-0-#8535%TcpCommunicationSpi%][TcpCommunicationSpi] Established outgoing communication connection [locAddr=/127.0.0.1:59286, rmtAddr=/127.0.0.1:45150] [21:04:34] : [Step 4/5] [2021-11-19 21:04:34,883][INFO ][exchange-worker-#8573%client1%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], crd=false] [21:04:34] : [Step 4/5] [2021-11-19 21:04:34,883][INFO ][exchange-worker-#8478%grid-6%][GridCacheProcessor] Finished recovery for cache [cache=ignite-sys-cache, grp=ignite-sys-cache, startVer=AffinityTopologyVersion [topVer=3, minorTopVer=1]] [21:04:34] : [Step 4/5] [2021-11-19 21:04:34,886][INFO ][exchange-worker-#8478%grid-6%][GridDhtPartitionsExchangeFuture] Successfully activated caches [nodeId=60dac6e8-23c9-4d3f-a60f-788efce74006, client=false, topVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], newState=ACTIVE] [21:04:34] : [Step 4/5] [2021-11-19 21:04:34,886][INFO ][exchange-worker-#8478%grid-6%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:04:34] : [Step 4/5] [2021-11-19 21:04:34,900][INFO ][exchange-worker-#8356%grid-0%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], crd=true] [21:04:34] : [Step 4/5] [2021-11-19 21:04:34,903][INFO ][db-checkpoint-thread-#8585%grid-0%][Checkpointer] Checkpoint started [checkpointId=eb6d53c2-606b-4292-8240-f2ee0043b8e0, startPtr=WALPointer [idx=0, fileOff=90638, len=1963], checkpointBeforeLockTime=14ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=1ms, writeCheckpointEntryDuration=2ms, splitAndSortCpPagesDuration=0ms, pages=20, reason='node started'] [21:04:34] : [Step 4/5] [2021-11-19 21:04:34,915][INFO ][db-checkpoint-thread-#8589%grid-6%][Checkpointer] Checkpoint started [checkpointId=3c4230b6-573e-4394-96cf-2214c068910d, startPtr=WALPointer [idx=0, fileOff=84417, len=1963], checkpointBeforeLockTime=15ms, checkpointLockWait=3ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=1ms, writeCheckpointEntryDuration=2ms, splitAndSortCpPagesDuration=0ms, pages=18, reason='node started'] [21:04:34] : [Step 4/5] [2021-11-19 21:04:34,926][INFO ][grid-nio-worker-tcp-comm-1-#8296%TcpCommunicationSpi%][TcpCommunicationSpi] Accepted incoming communication connection [locAddr=/127.0.0.1:45150, rmtAddr=/127.0.0.1:59288] [21:04:34] : [Step 4/5] [2021-11-19 21:04:34,935][INFO ][grid-nio-worker-tcp-comm-0-#8413%TcpCommunicationSpi%][TcpCommunicationSpi] Established outgoing communication connection [locAddr=/127.0.0.1:59288, rmtAddr=/127.0.0.1:45150] [21:04:34] : [Step 4/5] [2021-11-19 21:04:34,936][INFO ][exchange-worker-#8478%grid-6%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], crd=false] [21:04:34] : [Step 4/5] [2021-11-19 21:04:34,937][INFO ][sys-#8336%grid-0%][GridDhtPartitionsExchangeFuture] Coordinator received single message [ver=AffinityTopologyVersion [topVer=3, minorTopVer=1], node=60dac6e8-23c9-4d3f-a60f-788efce74006, allReceived=true] [21:04:34] : [Step 4/5] [2021-11-19 21:04:34,938][INFO ][sys-#8336%grid-0%][GridDhtPartitionsExchangeFuture] finishExchangeOnCoordinator [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=1]] [21:04:34] : [Step 4/5] [2021-11-19 21:04:34,952][INFO ][db-checkpoint-thread-#8585%grid-0%][Checkpointer] Checkpoint finished [cpId=eb6d53c2-606b-4292-8240-f2ee0043b8e0, pages=20, markPos=WALPointer [idx=0, fileOff=90638, len=1963], walSegmentsCovered=[], markDuration=5ms, pagesWrite=29ms, fsync=19ms, total=67ms] [21:04:34] : [Step 4/5] [2021-11-19 21:04:34,952][INFO ][db-checkpoint-thread-#8589%grid-6%][Checkpointer] Checkpoint finished [cpId=3c4230b6-573e-4394-96cf-2214c068910d, pages=18, markPos=WALPointer [idx=0, fileOff=84417, len=1963], walSegmentsCovered=[], markDuration=5ms, pagesWrite=17ms, fsync=19ms, total=59ms] [21:04:34] : [Step 4/5] [2021-11-19 21:04:34,954][INFO ][sys-#8336%grid-0%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], err=null, rebalanced=true, wasRebalanced=false] [21:04:34] : [Step 4/5] [2021-11-19 21:04:34,954][INFO ][disco-notifier-worker-#8351%grid-0%][GridClusterStateProcessor] Received state change finish message: ACTIVE [21:04:34] : [Step 4/5] [2021-11-19 21:04:34,957][INFO ][disco-notifier-worker-#8351%grid-0%][GridClusterStateProcessor] Cluster state was changed from INACTIVE to ACTIVE [21:04:34] : [Step 4/5] [2021-11-19 21:04:34,957][INFO ][sys-#8451%grid-6%][GridDhtPartitionsExchangeFuture] Received full message, will finish exchange [node=00e0e9f0-ad4e-4057-8861-d6fd939f1000, resVer=AffinityTopologyVersion [topVer=3, minorTopVer=1]] [21:04:34] : [Step 4/5] [2021-11-19 21:04:34,957][INFO ][disco-notifier-worker-#8564%client1%][GridClusterStateProcessor] Received state change finish message: ACTIVE [21:04:34] : [Step 4/5] [2021-11-19 21:04:34,957][INFO ][disco-notifier-worker-#8469%grid-6%][GridClusterStateProcessor] Received state change finish message: ACTIVE [21:04:34] : [Step 4/5] [2021-11-19 21:04:34,958][INFO ][disco-notifier-worker-#8564%client1%][GridClusterStateProcessor] Cluster state was changed from INACTIVE to ACTIVE [21:04:34] : [Step 4/5] [2021-11-19 21:04:34,959][INFO ][sys-#8451%grid-6%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], err=null, rebalanced=true, wasRebalanced=false] [21:04:34] : [Step 4/5] [2021-11-19 21:04:34,959][INFO ][disco-notifier-worker-#8469%grid-6%][GridClusterStateProcessor] Cluster state was changed from INACTIVE to ACTIVE [21:04:34] : [Step 4/5] [2021-11-19 21:04:34,963][INFO ][sys-#8458%grid-6%][GridCachePartitionExchangeManager] Delay process full message without exchange id (there is exchange in progress) [nodeId=00e0e9f0-ad4e-4057-8861-d6fd939f1000] [21:04:34] : [Step 4/5] [2021-11-19 21:04:34,967][INFO ][sys-#8451%grid-6%][GridCacheProcessor] Finish proxy initialization, cacheName=ignite-sys-cache, localNodeId=60dac6e8-23c9-4d3f-a60f-788efce74006 [21:04:34] : [Step 4/5] [2021-11-19 21:04:34,967][INFO ][sys-#8336%grid-0%][GridCacheProcessor] Finish proxy initialization, cacheName=ignite-sys-cache, localNodeId=00e0e9f0-ad4e-4057-8861-d6fd939f1000 [21:04:34] : [Step 4/5] [2021-11-19 21:04:34,970][INFO ][sys-#8460%grid-6%][DistributedBaselineConfiguration] Baseline auto-adjust is 'disabled' with timeout='300000' ms [21:04:34] : [Step 4/5] [2021-11-19 21:04:34,970][INFO ][sys-#8451%grid-6%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=60dac6e8-23c9-4d3f-a60f-788efce74006, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=00e0e9f0-ad4e-4057-8861-d6fd939f1000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345074555, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=3, minorTopVer=1]] [21:04:34] : [Step 4/5] [2021-11-19 21:04:34,970][INFO ][exchange-worker-#8478%grid-6%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=3, minorTopVer=1], force=false, evt=DISCOVERY_CUSTOM_EVT, node=00e0e9f0-ad4e-4057-8861-d6fd939f1000] [21:04:34] : [Step 4/5] [2021-11-19 21:04:34,971][INFO ][sys-#8336%grid-0%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=00e0e9f0-ad4e-4057-8861-d6fd939f1000, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=00e0e9f0-ad4e-4057-8861-d6fd939f1000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345074953, loc=true, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=3, minorTopVer=1]] [21:04:34] : [Step 4/5] [2021-11-19 21:04:34,971][INFO ][exchange-worker-#8356%grid-0%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=3, minorTopVer=1], force=false, evt=DISCOVERY_CUSTOM_EVT, node=00e0e9f0-ad4e-4057-8861-d6fd939f1000] [21:04:34] : [Step 4/5] [2021-11-19 21:04:34,971][INFO ][sys-#8332%grid-0%][DistributedBaselineConfiguration] Baseline auto-adjust is 'disabled' with timeout='300000' ms [21:04:34] : [Step 4/5] [2021-11-19 21:04:34,970][INFO ][sys-#8460%grid-6%][GridClusterStateProcessor] Successfully performed final activation steps [nodeId=60dac6e8-23c9-4d3f-a60f-788efce74006, client=false, topVer=AffinityTopologyVersion [topVer=3, minorTopVer=1]] [21:04:34] : [Step 4/5] [2021-11-19 21:04:34,970][INFO ][sys-#8604%client1%][GridCachePartitionExchangeManager] Delay process full message without exchange id (there is exchange in progress) [nodeId=00e0e9f0-ad4e-4057-8861-d6fd939f1000] [21:04:34] : [Step 4/5] [2021-11-19 21:04:34,977][INFO ][sys-#8606%client1%][GridDhtPartitionsExchangeFuture] Received full message, will finish exchange [node=00e0e9f0-ad4e-4057-8861-d6fd939f1000, resVer=AffinityTopologyVersion [topVer=3, minorTopVer=1]] [21:04:34] : [Step 4/5] [2021-11-19 21:04:34,974][INFO ][sys-#8332%grid-0%][GridClusterStateProcessor] Successfully performed final activation steps [nodeId=00e0e9f0-ad4e-4057-8861-d6fd939f1000, client=false, topVer=AffinityTopologyVersion [topVer=3, minorTopVer=1]] [21:04:34] : [Step 4/5] [2021-11-19 21:04:34,973][INFO ][sys-#8336%grid-0%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (1 ms), stage="Update caches registry" (47 ms), stage="Start caches" (0 ms), stage="Affinity initialization on cache group start" (0 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Restore partition states" (0 ms), stage="After states restored callback" (27 ms), stage="WAL history reservation" (0 ms), stage="Waiting for all single messages" (38 ms), stage="Affinity recalculation (crd)" (0 ms), stage="Collect update counters and create affinity messages" (0 ms), stage="Assign partitions states" (1 ms), stage="Validate partitions states" (0 ms), stage="Ideal affinity diff calculation (enforced)" (0 ms), stage="Apply update counters" (0 ms), stage="Full message preparing" (11 ms), stage="Full message sending" (0 ms), stage="State finish message sending" (0 ms), stage="Detect lost partitions" (8 ms), stage="Exchange done" (10 ms), stage="Total time" (143 ms), Discovery lag=3 ms, Latest started node id=60dac6e8-23c9-4d3f-a60f-788efce74006] [21:04:34] : [Step 4/5] [2021-11-19 21:04:34,972][INFO ][sys-#8451%grid-6%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (5 ms), stage="Update caches registry" (53 ms), stage="Start caches" (2 ms), stage="Affinity initialization on cache group start" (0 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Restore partition states" (0 ms), stage="After states restored callback" (24 ms), stage="WAL history reservation" (0 ms), stage="Waiting for Full message" (44 ms), stage="Affinity recalculation" (1 ms), stage="Full map updating" (0 ms), stage="Detect lost partitions" (3 ms), stage="Exchange done" (9 ms), stage="Total time" (141 ms)] [21:04:34] : [Step 4/5] [2021-11-19 21:04:34,982][INFO ][sys-#8336%grid-0%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], stage="Affinity initialization on cache group start [grp=ignite-sys-cache]" (0 ms) (parent=Affinity initialization on cache group start), stage="Affinity centralized initialization (crd) [grp=ignite-sys-cache, crd=true]" (0 ms) (parent=Determine exchange type), stage="Restore partition states [grp=ignite-sys-cache]" (0 ms) (parent=Restore partition states), stage="Affinity recalculation (partitions availability) [grp=ignite-sys-cache]" (0 ms) (parent=Ideal affinity diff calculation (enforced))] [21:04:34] : [Step 4/5] [2021-11-19 21:04:34,979][INFO ][sys-#8606%client1%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], err=null, rebalanced=true, wasRebalanced=false] [21:04:34] : [Step 4/5] [2021-11-19 21:04:34,984][INFO ][sys-#8451%grid-6%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], stage="Affinity initialization on cache group start [grp=ignite-sys-cache]" (0 ms) (parent=Affinity initialization on cache group start), stage="Affinity centralized initialization (crd) [grp=ignite-sys-cache, crd=false]" (0 ms) (parent=Determine exchange type), stage="Restore partition states [grp=ignite-sys-cache]" (0 ms) (parent=Restore partition states), stage="Affinity applying from full message [grp=ignite-sys-cache]" (1 ms) (parent=Affinity recalculation)] [21:04:34] : [Step 4/5] [2021-11-19 21:04:34,988][INFO ][sys-#8606%client1%][GridCacheProcessor] Finish proxy initialization, cacheName=ignite-sys-cache, localNodeId=10e1382f-5a0e-4692-ad18-c30bec6d4001 [21:04:34] : [Step 4/5] [2021-11-19 21:04:34,989][INFO ][sys-#8614%client1%][DistributedBaselineConfiguration] Baseline auto-adjust is 'disabled' with timeout='300000' ms [21:04:34] : [Step 4/5] [2021-11-19 21:04:34,990][INFO ][sys-#8614%client1%][GridClusterStateProcessor] Successfully performed final activation steps [nodeId=10e1382f-5a0e-4692-ad18-c30bec6d4001, client=true, topVer=AffinityTopologyVersion [topVer=3, minorTopVer=1]] [21:04:34] : [Step 4/5] [2021-11-19 21:04:34,992][INFO ][exchange-worker-#8573%client1%][GridCachePartitionExchangeManager] AffinityTopologyVersion [topVer=3, minorTopVer=1], evt=DISCOVERY_CUSTOM_EVT, evtNode=00e0e9f0-ad4e-4057-8861-d6fd939f1000, client=true] [21:04:34] : [Step 4/5] [2021-11-19 21:04:34,993][INFO ][sys-#8606%client1%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=10e1382f-5a0e-4692-ad18-c30bec6d4001, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=00e0e9f0-ad4e-4057-8861-d6fd939f1000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345074760, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=3, minorTopVer=1]] [21:04:34] : [Step 4/5] [2021-11-19 21:04:34,995][INFO ][sys-#8606%client1%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], stage="Waiting in exchange queue" (1 ms), stage="Exchange parameters initialization" (1 ms), stage="Update caches registry" (3 ms), stage="Start caches" (3 ms), stage="Affinity initialization on cache group start" (1 ms), stage="Determine exchange type" (1 ms), stage="Waiting for Full message" (132 ms), stage="Affinity recalculation" (1 ms), stage="Full map updating" (0 ms), stage="Detect lost partitions" (8 ms), stage="Exchange done" (7 ms), stage="Total time" (158 ms)] [21:04:34] : [Step 4/5] [2021-11-19 21:04:34,997][INFO ][sys-#8606%client1%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], stage="Affinity initialization on cache group start [grp=ignite-sys-cache]" (1 ms) (parent=Affinity initialization on cache group start), stage="Affinity centralized initialization (crd) [grp=ignite-sys-cache, crd=false]" (0 ms) (parent=Determine exchange type), stage="Affinity applying from full message [grp=ignite-sys-cache]" (1 ms) (parent=Affinity recalculation)] [21:04:35]W: [org.apache.ignite:ignite-core] [2021-11-19 21:04:34,999][WARN ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][G] Ignite work directory is not provided, automatically resolved to: /opt/buildagent/work/7bc1c54bc719b67c/work [21:04:35] : [Step 4/5] [2021-11-19 21:04:35,000][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-7] [21:04:35] : [Step 4/5] [21:04:35] : [Step 4/5] >>> __________ ________________ [21:04:35] : [Step 4/5] >>> / _/ ___/ |/ / _/_ __/ __/ [21:04:35] : [Step 4/5] >>> _/ // (7 7 // / / / / _/ [21:04:35] : [Step 4/5] >>> /___/\___/_/|_/___/ /_/ /___/ [21:04:35] : [Step 4/5] >>> [21:04:35] : [Step 4/5] >>> ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:04:35] : [Step 4/5] >>> 2021 Copyright(C) Apache Software Foundation [21:04:35] : [Step 4/5] >>> [21:04:35] : [Step 4/5] >>> Ignite documentation: http://ignite.apache.org [21:04:35] : [Step 4/5] [21:04:35] : [Step 4/5] [2021-11-19 21:04:35,001][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-7] Config URL: n/a [21:04:35] : [Step 4/5] [2021-11-19 21:04:35,002][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-7] IgniteConfiguration [igniteInstanceName=grid-7, pubPoolSize=24, svcPoolSize=24, callbackPoolSize=24, stripedPoolSize=24, sysPoolSize=24, mgmtPoolSize=4, dataStreamerPoolSize=24, utilityCachePoolSize=24, utilityCacheKeepAliveTime=60000, p2pPoolSize=2, qryPoolSize=24, buildIdxPoolSize=4, igniteHome=/opt/buildagent/work/7bc1c54bc719b67c, igniteWorkDir=/opt/buildagent/work/7bc1c54bc719b67c/work, mbeanSrv=com.sun.jmx.mbeanserver.JmxMBeanServer@6fe85038, nodeId=70ed39fc-3b18-49f7-94cf-a6d33dc4a007, marsh=BinaryMarshaller [], marshLocJobs=false, daemon=false, p2pEnabled=true, netTimeout=10000, netCompressionLevel=1, sndRetryDelay=1000, sndRetryCnt=3, metricsHistSize=10000, metricsUpdateFreq=1000, metricsExpTime=9223372036854775807, discoSpi=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=0, ackTimeout=0, marsh=null, reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], segPlc=STOP, segResolveAttempts=2, waitForSegOnStart=true, allResolversPassReq=true, segChkFreq=10000, commSpi=TcpCommunicationSpi [connectGate=org.apache.ignite.spi.communication.tcp.internal.ConnectGateway@5ad5e6ff, ctxInitLatch=java.util.concurrent.CountDownLatch@2d24c194[Count = 1], stopping=false, clientPool=null, nioSrvWrapper=null, stateProvider=null], evtSpi=MemoryEventStorageSpi [expireAgeMs=9223372036854775807, expireCnt=10000, filter=null], colSpi=NoopCollisionSpi [], deploySpi=LocalDeploymentSpi [], indexingSpi=org.apache.ignite.spi.indexing.noop.NoopIndexingSpi@710738df, addrRslvr=null, encryptionSpi=org.apache.ignite.spi.encryption.keystore.KeystoreEncryptionSpi@232b7bfe, tracingSpi=org.apache.ignite.spi.tracing.NoopTracingSpi@30901ca9, clientMode=false, rebalanceThreadPoolSize=4, rebalanceTimeout=10000, rebalanceBatchesPrefetchCnt=3, rebalanceThrottle=0, rebalanceBatchSize=524288, txCfg=TransactionConfiguration [txSerEnabled=false, dfltIsolation=REPEATABLE_READ, dfltConcurrency=PESSIMISTIC, dfltTxTimeout=0, txTimeoutOnPartitionMapExchange=0, deadlockTimeout=10000, pessimisticTxLogSize=0, pessimisticTxLogLinger=10000, tmLookupClsName=null, txManagerFactory=null, useJtaSync=false], cacheSanityCheckEnabled=true, discoStartupDelay=60000, deployMode=SHARED, p2pMissedCacheSize=100, locHost=127.0.0.1, timeSrvPortBase=31100, timeSrvPortRange=100, failureDetectionTimeout=10000, sysWorkerBlockedTimeout=null, clientFailureDetectionTimeout=10000, metricsLogFreq=0, connectorCfg=null, odbcCfg=null, warmupClos=null, atomicCfg=AtomicConfiguration [seqReserveSize=1000, cacheMode=PARTITIONED, backups=1, aff=null, grpName=null], classLdr=null, sslCtxFactory=null, platformCfg=null, binaryCfg=null, memCfg=null, pstCfg=null, dsCfg=DataStorageConfiguration [sysRegionInitSize=41943040, sysRegionMaxSize=104857600, pageSize=4096, concLvl=0, dfltDataRegConf=DataRegionConfiguration [name=default, maxSize=10485760, initSize=268435456, swapPath=null, pageEvictionMode=DISABLED, pageReplacementMode=CLOCK, evictionThreshold=0.9, emptyPagesPoolSize=100, metricsEnabled=false, metricsSubIntervalCount=5, metricsRateTimeInterval=60000, persistenceEnabled=true, checkpointPageBufSize=0, lazyMemoryAllocation=true, warmUpCfg=null], dataRegions=null, storagePath=null, checkpointFreq=180000, lockWaitTime=10000, checkpointThreads=4, checkpointWriteOrder=SEQUENTIAL, walHistSize=20, maxWalArchiveSize=1073741824, walSegments=10, walSegmentSize=67108864, walPath=db/wal, walArchivePath=db/wal/archive, cdcWalPath=db/wal/cdc, cdcEnabled=false, metricsEnabled=false, walMode=FSYNC, walTlbSize=131072, walBuffSize=0, walFlushFreq=2000, walFsyncDelay=1000, walRecordIterBuffSize=67108864, alwaysWriteFullPages=false, fileIOFactory=org.apache.ignite.internal.processors.cache.persistence.file.AsyncFileIOFactory@6d081aff, metricsSubIntervalCnt=5, metricsRateTimeInterval=60000, walAutoArchiveAfterInactivity=-1, walForceArchiveTimeout=-1, writeThrottlingEnabled=false, walCompactionEnabled=false, walCompactionLevel=1, checkpointReadLockTimeout=null, walPageCompression=DISABLED, walPageCompressionLevel=null, dfltWarmUpCfg=null, encCfg=org.apache.ignite.configuration.EncryptionConfiguration@703cd0ce, defragmentationThreadPoolSize=4, minWalArchiveSize=-1], snapshotPath=snapshots, activeOnStart=true, activeOnStartPropSetFlag=false, autoActivation=true, autoActivationPropSetFlag=false, clusterStateOnStart=null, sqlConnCfg=null, cliConnCfg=ClientConnectorConfiguration [host=null, port=10800, portRange=100, sockSndBufSize=0, sockRcvBufSize=0, tcpNoDelay=true, maxOpenCursorsPerConn=128, threadPoolSize=24, selectorCnt=12, idleTimeout=0, handshakeTimeout=10000, jdbcEnabled=true, odbcEnabled=true, thinCliEnabled=true, sslEnabled=false, useIgniteSslCtxFactory=true, sslClientAuth=false, sslCtxFactory=null, thinCliCfg=ThinClientConfiguration [maxActiveTxPerConn=100, maxActiveComputeTasksPerConn=0]], mvccVacuumThreadCnt=2, mvccVacuumFreq=5000, authEnabled=false, failureHnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]], commFailureRslvr=null, sqlCfg=SqlConfiguration [longQryWarnTimeout=3000, dfltQryTimeout=0, sqlQryHistSize=1000, validationEnabled=false], asyncContinuationExecutor=null] [21:04:35] : [Step 4/5] [2021-11-19 21:04:35,013][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-7] Daemon mode: off [21:04:35] : [Step 4/5] [2021-11-19 21:04:35,013][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-7] OS: Linux 4.15.0-151-generic amd64 [21:04:35] : [Step 4/5] [2021-11-19 21:04:35,013][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-7] OS user: teamcity [21:04:35] : [Step 4/5] [2021-11-19 21:04:35,014][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-7] PID: 16724 [21:04:35] : [Step 4/5] [2021-11-19 21:04:35,014][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-7] Language runtime: Java Platform API Specification ver. 1.8 [21:04:35] : [Step 4/5] [2021-11-19 21:04:35,014][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-7] VM information: Java(TM) SE Runtime Environment 1.8.0_261-b12 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 25.261-b12 [21:04:35] : [Step 4/5] [2021-11-19 21:04:35,015][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-7] VM total memory: 1.9GB [21:04:35] : [Step 4/5] [2021-11-19 21:04:35,015][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-7] Remote Management [restart: off, REST: off, JMX (remote: off)] [21:04:35] : [Step 4/5] [2021-11-19 21:04:35,015][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-7] Logger: GridTestLog4jLogger [quiet=false, config=null] [21:04:35] : [Step 4/5] [2021-11-19 21:04:35,016][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-7] IGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c [21:04:35] : [Step 4/5] [2021-11-19 21:04:35,016][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-7] VM arguments: [-DIGNITE_DUMP_THREADS_ON_FAILURE=false, -DMono=/usr/bin/mono-sgen, -DMono4.0_x64=/usr/lib/mono/4.0, -DMono4.5_x64=/usr/lib/mono/4.5, -DMonoVersion=6.12.0.90, -DSKIP_BUILD=false, -Dagent.home.dir=/opt/buildagent, -Dagent.name=aitc-lin02_03, -Dagent.ownPort=9090, -Dagent.work.dir=/opt/buildagent/work, -Dbuild.number=95, -Dbuild.vcs.number=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.1=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.GitHubApacheIgnite=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dclassworlds.conf=/opt/buildagent/temp/buildTmp/teamcity.m2.conf, -Dcom.jetbrains.maven.watcher.report.file=/opt/buildagent/temp/buildTmp/maven-build-info.xml, -Djava.io.tmpdir=/opt/buildagent/temp/buildTmp, -Dmaven.home=/opt/buildagent/tools/maven3_6, -Dmaven.multiModuleProjectDirectory=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.agent.cpuBenchmark=457, -Dteamcity.agent.dotnet.agent_url=http://localhost:9090/RPC2, -Dteamcity.agent.dotnet.build_id=6278078, -Dteamcity.auth.password=*******, -Dteamcity.auth.userId=TeamCityBuildId=6278078, -Dteamcity.build.changedFiles.file=/opt/buildagent/temp/buildTmp/changedFiles6342607772318147725.txt, -Dteamcity.build.checkoutDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.build.id=6278078, -Dteamcity.build.properties.file=/opt/buildagent/temp/buildTmp/teamcity.build5164517880467851002.properties, -Dteamcity.build.tempDir=/opt/buildagent/temp/buildTmp, -Dteamcity.build.workingDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.buildConfName=Basic 3, -Dteamcity.buildType.id=IgniteTests24Java8_Basic3, -Dteamcity.configuration.properties.file=/opt/buildagent/temp/buildTmp/teamcity.config5591980786735343870.properties, -Dteamcity.maven.userSettings.path=/opt/buildagent/temp/buildTmp/maven_settings_585072866407032347.xml, -Dteamcity.maven.watcher.home=/opt/buildagent/plugins/mavenPlugin/maven-watcher-jdk16, -Dteamcity.projectName=Ignite Tests 2.x (JDK 8/11), -Dteamcity.runner.properties.file=/opt/buildagent/temp/buildTmp/teamcity.runner9098465561618137420.properties, -Dteamcity.tests.recentlyFailedTests.file=/opt/buildagent/temp/buildTmp/testsToRunFirst3891775683130404069.txt, -Dteamcity.version=2021.2 (build 99542), -ea, -Xms2g, -Xmx2g, -XX:+HeapDumpOnOutOfMemoryError, -DIGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_TEST_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_UPDATE_NOTIFIER=false, -DIGNITE_NO_DISCO_ORDER=true, -DIGNITE_PERFORMANCE_SUGGESTIONS_DISABLED=true, -Djava.net.preferIPv4Stack=true, -DTEST_SCALE_FACTOR=1.0, -DIGNITE_TEST_PROP_LOG4J_FILE=log4j-tc-test.xml, -DIGNITE_QUIET=false, -DIGNITE_MARSHAL_BUFFERS_RECHECK=1000, -Dmaven.repo.local=/opt/buildagent/.m2/repository] [21:04:35] : [Step 4/5] [2021-11-19 21:04:35,021][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-7] System cache's DataRegion size is configured to 40 MB. Use DataStorageConfiguration.systemRegionInitialSize property to change the setting. [21:04:35] : [Step 4/5] [2021-11-19 21:04:35,022][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-7] Configured caches [in 'sysMemPlc' dataRegion: ['ignite-sys-cache'], in 'default' dataRegion: ['encrypted']] [21:04:35] : [Step 4/5] [2021-11-19 21:04:35,022][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-7] 3-rd party licenses can be found at: /opt/buildagent/work/7bc1c54bc719b67c/libs/licenses [21:04:35]W: [org.apache.ignite:ignite-core] [2021-11-19 21:04:35,022][WARN ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-7] Peer class loading is enabled (disable it in production for performance and deployment consistency reasons) [21:04:35] : [Step 4/5] [2021-11-19 21:04:35,028][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] Configured plugins: [21:04:35] : [Step 4/5] [2021-11-19 21:04:35,029][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- StanByClusterTestProvider 1.0 [21:04:35] : [Step 4/5] [2021-11-19 21:04:35,029][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- null [21:04:35] : [Step 4/5] [2021-11-19 21:04:35,029][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] [21:04:35] : [Step 4/5] [2021-11-19 21:04:35,029][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- PageMemory tracker plugin 1.0 [21:04:35] : [Step 4/5] [2021-11-19 21:04:35,030][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- null [21:04:35] : [Step 4/5] [2021-11-19 21:04:35,030][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] [21:04:35] : [Step 4/5] [2021-11-19 21:04:35,030][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- TestDistibutedConfigurationPlugin 1.0 [21:04:35] : [Step 4/5] [2021-11-19 21:04:35,030][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- null [21:04:35] : [Step 4/5] [2021-11-19 21:04:35,031][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] [21:04:35] : [Step 4/5] [2021-11-19 21:04:35,031][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- NodeValidationPluginProvider 1.0 [21:04:35] : [Step 4/5] [2021-11-19 21:04:35,031][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- null [21:04:35] : [Step 4/5] [2021-11-19 21:04:35,031][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] [21:04:35] : [Step 4/5] [2021-11-19 21:04:35,031][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][FailureProcessor] Configured failure handler: [hnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]]] [21:04:35] : [Step 4/5] [2021-11-19 21:04:35,088][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][TcpCommunicationSpi] Successfully bound communication NIO server to TCP port [port=45153, locHost=/127.0.0.1, selectorsCnt=12, selectorSpins=0, pairedConn=false] [21:04:35]W: [org.apache.ignite:ignite-core] [2021-11-19 21:04:35,089][WARN ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][TcpCommunicationSpi] Message queue limit is set to 0 which may lead to potential OOMEs when running cache operations in FULL_ASYNC or PRIMARY_SYNC modes due to message queues growth on sender and receiver sides. [21:04:35] : [Step 4/5] [2021-11-19 21:04:35,110][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][GridCollisionManager] Collision resolution is disabled (all jobs will be activated upon arrival). [21:04:35] : [Step 4/5] [2021-11-19 21:04:35,110][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-7] Security status [authentication=off, sandbox=off, tls/ssl=off] [21:04:35] : [Step 4/5] [2021-11-19 21:04:35,172][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:04:35] : [Step 4/5] [2021-11-19 21:04:35,264][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][MaintenanceProcessor] Resolved store directory for node persistent data: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_7 [21:04:35] : [Step 4/5] [2021-11-19 21:04:35,266][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][CacheObjectBinaryProcessorImpl] Resolved directory for serialized binary metadata: /opt/buildagent/work/7bc1c54bc719b67c/work/db/binary_meta/grid_7 [21:04:35] : [Step 4/5] [2021-11-19 21:04:35,271][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_7 [21:04:35] : [Step 4/5] [2021-11-19 21:04:35,272][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][FileWriteAheadLogManager] Resolved write ahead log work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_7 [21:04:35] : [Step 4/5] [2021-11-19 21:04:35,273][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][FileWriteAheadLogManager] Resolved write ahead log archive directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_7 [21:04:35] : [Step 4/5] [2021-11-19 21:04:35,849][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_7/0000000000000000.wal [21:04:35] : [Step 4/5] [2021-11-19 21:04:35,854][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Configured data regions initialized successfully [total=5] [21:04:35] : [Step 4/5] [2021-11-19 21:04:35,856][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][IgniteSnapshotManager] Resolved snapshot work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/snapshots [21:04:35] : [Step 4/5] [2021-11-19 21:04:35,857][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][IgniteSnapshotManager] Resolved temp directory for snapshot creation: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_7/snp [21:04:35] : [Step 4/5] [2021-11-19 21:04:35,861][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][ClientListenerProcessor] Client connector processor has started on TCP port 10803 [21:04:35] : [Step 4/5] [2021-11-19 21:04:35,864][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-7] Non-loopback local IPs: 172.17.0.4 [21:04:35] : [Step 4/5] [2021-11-19 21:04:35,864][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-7] Enabled local MACs: 0242AC110004 [21:04:35] : [Step 4/5] [2021-11-19 21:04:35,865][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:04:35] : [Step 4/5] [2021-11-19 21:04:35,867][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:04:35] : [Step 4/5] [2021-11-19 21:04:35,868][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:04:35] : [Step 4/5] [2021-11-19 21:04:35,870][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Applying lost metastore updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:04:35] : [Step 4/5] [2021-11-19 21:04:35,872][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=0 ms] [21:04:35] : [Step 4/5] [2021-11-19 21:04:35,872][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][GridCacheProcessor] Restoring partition state for local groups. [21:04:35] : [Step 4/5] [2021-11-19 21:04:35,872][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=0, partitionsProcessed=0, time=0ms] [21:04:35] : [Step 4/5] [2021-11-19 21:04:35,873][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][GridEncryptionManager] Encryption keys loaded from metastore. [grps=, masterKeyName=ignite.master.key] [21:04:35] : [Step 4/5] [2021-11-19 21:04:35,877][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][ClusterProcessor] Cluster ID and tag has been read from metastorage: null [21:04:35] : [Step 4/5] [2021-11-19 21:04:35,877][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][IgniteClusterImpl] Shutdown policy was updated [oldVal=null, newVal=null] [21:04:35] : [Step 4/5] [2021-11-19 21:04:35,878][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Checkpoint frequency deviation changed [oldVal=null, newVal=null] [21:04:35] : [Step 4/5] [2021-11-19 21:04:35,888][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][FilePageStoreManager] Cleanup cache stores [total=1, left=0, cleanFiles=false] [21:04:35] : [Step 4/5] [2021-11-19 21:04:35,892][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:04:35] : [Step 4/5] [2021-11-19 21:04:35,893][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:04:35] : [Step 4/5] [2021-11-19 21:04:35,895][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:04:35] : [Step 4/5] [2021-11-19 21:04:35,896][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Data Regions Started: 5 [21:04:35] : [Step 4/5] [2021-11-19 21:04:35,897][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] ^-- sysMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:04:35] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:04:35] : [Step 4/5] ^-- default region [type=default, persistence=true, lazyAlloc=true, [21:04:35] : [Step 4/5] ... initCfg=10MB, maxCfg=10MB, usedRam=0MB, freeRam=100%, allocRam=0MB, allocTotal=0MB] [21:04:35] : [Step 4/5] ^-- metastoreMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:04:35] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:04:35] : [Step 4/5] ^-- TxLog region [type=internal, persistence=true, lazyAlloc=false, [21:04:35] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:04:35] : [Step 4/5] ^-- volatileDsMemPlc region [type=user, persistence=false, lazyAlloc=true, [21:04:35] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB] [21:04:35] : [Step 4/5] ^-- Ignite persistence [used=0MB] [21:04:35] : [Step 4/5] [21:04:35] : [Step 4/5] [2021-11-19 21:04:35,899][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Starting binary memory restore for: [-2100569601, 1613773252] [21:04:36] : [Step 4/5] [2021-11-19 21:04:36,000][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:04:36] : [Step 4/5] [2021-11-19 21:04:36,000][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:04:36] : [Step 4/5] [2021-11-19 21:04:36,004][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_7/0000000000000000.wal, offset=0, ver=2] [21:04:36] : [Step 4/5] [2021-11-19 21:04:36,479][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][GridCacheProcessor] Started cache in recovery mode [name=ignite-sys-cache, id=-2100569601, dataRegionName=sysMemPlc, mode=REPLICATED, atomicity=TRANSACTIONAL, backups=2147483647, mvcc=false] [21:04:36] : [Step 4/5] [2021-11-19 21:04:36,480][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][PageMemoryImpl] Started page memory [memoryAllocated=24.0 MiB, pages=5952, tableSize=474.2 KiB, replacementSize=768 B, checkpointBuffer=10.0 MiB] [21:04:36] : [Step 4/5] [2021-11-19 21:04:36,564][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][GridCacheProcessor] Started cache in recovery mode [name=encrypted, id=1613773252, dataRegionName=default, mode=PARTITIONED, atomicity=TRANSACTIONAL, backups=0, mvcc=false] [21:04:36] : [Step 4/5] [2021-11-19 21:04:36,565][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Binary recovery performed in 667 ms. [21:04:36] : [Step 4/5] [2021-11-19 21:04:36,565][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:04:36] : [Step 4/5] [2021-11-19 21:04:36,565][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Applying lost cache updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:04:36] : [Step 4/5] [2021-11-19 21:04:36,615][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=51 ms] [21:04:36] : [Step 4/5] [2021-11-19 21:04:36,615][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][GridCacheProcessor] Restoring partition state for local groups. [21:04:36] : [Step 4/5] [2021-11-19 21:04:36,630][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=2, partitionsProcessed=1124, time=10ms] [21:04:36] : [Step 4/5] [2021-11-19 21:04:36,822][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][TestTcpDiscoverySpi] Successfully bound to TCP port [port=47502, localHost=localhost/127.0.0.1, locNodeId=70ed39fc-3b18-49f7-94cf-a6d33dc4a007] [21:04:36] : [Step 4/5] [2021-11-19 21:04:36,827][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][GridEncryptionManager] Sending new group keys to coordinator [grps=1613773252] [21:04:36] : [Step 4/5] [2021-11-19 21:04:36,831][INFO ][tcp-disco-srvr-[:47501]-#424%grid-6%-#8471%grid-6%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=49983] [21:04:36] : [Step 4/5] [2021-11-19 21:04:36,831][INFO ][tcp-disco-srvr-[:47501]-#424%grid-6%-#8471%grid-6%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=49983] [21:04:36] : [Step 4/5] [2021-11-19 21:04:36,832][INFO ][tcp-disco-sock-reader-[]-#441%grid-6%-#8732%grid-6%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:49983, rmtPort=49983] [21:04:36] : [Step 4/5] [2021-11-19 21:04:36,834][INFO ][tcp-disco-sock-reader-[70ed39fc 127.0.0.1:49983]-#441%grid-6%-#8732%grid-6%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=70ed39fc-3b18-49f7-94cf-a6d33dc4a007, rmtAddr=/127.0.0.1:49983] [21:04:36] : [Step 4/5] [2021-11-19 21:04:36,836][INFO ][tcp-disco-srvr-[:47502]-#440%grid-7%-#8731%grid-7%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=43587] [21:04:36] : [Step 4/5] [2021-11-19 21:04:36,837][INFO ][tcp-disco-srvr-[:47502]-#440%grid-7%-#8731%grid-7%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=43587] [21:04:36] : [Step 4/5] [2021-11-19 21:04:36,838][INFO ][tcp-disco-sock-reader-[]-#442%grid-7%-#8733%grid-7%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:43587, rmtPort=43587] [21:04:36] : [Step 4/5] [2021-11-19 21:04:36,839][INFO ][tcp-disco-sock-reader-[]-#442%grid-7%-#8733%grid-7%][TestTcpDiscoverySpi] Received ping request from the remote node [rmtNodeId=60dac6e8-23c9-4d3f-a60f-788efce74006, rmtAddr=/127.0.0.1:43587, rmtPort=43587] [21:04:36] : [Step 4/5] [2021-11-19 21:04:36,840][INFO ][tcp-disco-sock-reader-[]-#442%grid-7%-#8733%grid-7%][TestTcpDiscoverySpi] Finished writing ping response [rmtNodeId=60dac6e8-23c9-4d3f-a60f-788efce74006, rmtAddr=/127.0.0.1:43587, rmtPort=43587] [21:04:36] : [Step 4/5] [2021-11-19 21:04:36,841][INFO ][tcp-disco-sock-reader-[70ed39fc 127.0.0.1:49983]-#441%grid-6%-#8732%grid-6%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:49983, rmtPort=49983, rmtNodeId=70ed39fc-3b18-49f7-94cf-a6d33dc4a007] [21:04:36] : [Step 4/5] [2021-11-19 21:04:36,841][INFO ][tcp-disco-sock-reader-[]-#442%grid-7%-#8733%grid-7%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:43587, rmtPort=43587, rmtNodeId=null] [21:04:36] : [Step 4/5] [2021-11-19 21:04:36,845][INFO ][tcp-disco-msg-worker-[60dac6e8 127.0.0.1:47501 crd]-#418%grid-0%-#8352%grid-0%][GridEncryptionManager] Joining node doesn't have stored group keys [node=70ed39fc-3b18-49f7-94cf-a6d33dc4a007] [21:04:36] : [Step 4/5] [2021-11-19 21:04:36,850][INFO ][tcp-disco-msg-worker-[60dac6e8 127.0.0.1:47501 crd]-#418%grid-0%-#8352%grid-0%][GridEncryptionManager] Store group key received from joining node [node=70ed39fc-3b18-49f7-94cf-a6d33dc4a007, grp=1613773252] [21:04:36] : [Step 4/5] [2021-11-19 21:04:36,884][INFO ][tcp-disco-msg-worker-[00e0e9f0 127.0.0.1:47500]-#423%grid-6%-#8470%grid-6%][GridEncryptionManager] Store group key received from joining node [node=70ed39fc-3b18-49f7-94cf-a6d33dc4a007, grp=1613773252] [21:04:36] : [Step 4/5] [2021-11-19 21:04:36,887][INFO ][tcp-disco-msg-worker-[00e0e9f0 127.0.0.1:47500]-#423%grid-6%-#8470%grid-6%][TestTcpDiscoverySpi] New next node [newNext=TcpDiscoveryNode [id=70ed39fc-3b18-49f7-94cf-a6d33dc4a007, consistentId=grid-7, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47502], discPort=47502, order=0, intOrder=4, lastExchangeTime=1637345076876, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false]] [21:04:36] : [Step 4/5] [2021-11-19 21:04:36,889][INFO ][tcp-disco-sock-reader-[60dac6e8 127.0.0.1:52555]-#428%grid-0%-#8475%grid-0%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:52555, rmtPort=52555, rmtNodeId=60dac6e8-23c9-4d3f-a60f-788efce74006] [21:04:36] : [Step 4/5] [2021-11-19 21:04:36,889][INFO ][tcp-disco-srvr-[:47502]-#440%grid-7%-#8731%grid-7%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=46511] [21:04:36] : [Step 4/5] [2021-11-19 21:04:36,890][INFO ][tcp-disco-srvr-[:47502]-#440%grid-7%-#8731%grid-7%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=46511] [21:04:36] : [Step 4/5] [2021-11-19 21:04:36,891][INFO ][tcp-disco-sock-reader-[]-#443%grid-7%-#8734%grid-7%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:46511, rmtPort=46511] [21:04:36] : [Step 4/5] [2021-11-19 21:04:36,893][INFO ][tcp-disco-sock-reader-[60dac6e8 127.0.0.1:46511]-#443%grid-7%-#8734%grid-7%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=60dac6e8-23c9-4d3f-a60f-788efce74006, rmtAddr=/127.0.0.1:46511] [21:04:36] : [Step 4/5] [2021-11-19 21:04:36,898][INFO ][tcp-disco-msg-worker-[]-#439%grid-7%-#8730%grid-7%][TestTcpDiscoverySpi] New next node [newNext=TcpDiscoveryNode [id=00e0e9f0-ad4e-4057-8861-d6fd939f1000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345076886, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false]] [21:04:36] : [Step 4/5] [2021-11-19 21:04:36,900][INFO ][tcp-disco-srvr-[:47500]-#419%grid-0%-#8353%grid-0%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=45917] [21:04:36] : [Step 4/5] [2021-11-19 21:04:36,900][INFO ][tcp-disco-srvr-[:47500]-#419%grid-0%-#8353%grid-0%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=45917] [21:04:36] : [Step 4/5] [2021-11-19 21:04:36,901][INFO ][tcp-disco-sock-reader-[]-#444%grid-0%-#8735%grid-0%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:45917, rmtPort=45917] [21:04:36] : [Step 4/5] [2021-11-19 21:04:36,903][INFO ][tcp-disco-sock-reader-[70ed39fc 127.0.0.1:45917]-#444%grid-0%-#8735%grid-0%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=70ed39fc-3b18-49f7-94cf-a6d33dc4a007, rmtAddr=/127.0.0.1:45917] [21:04:36] : [Step 4/5] [2021-11-19 21:04:36,908][INFO ][disco-event-worker-#8355%grid-0%][GridDiscoveryManager] Added new node to topology: TcpDiscoveryNode [id=70ed39fc-3b18-49f7-94cf-a6d33dc4a007, consistentId=grid-7, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47502], discPort=47502, order=4, intOrder=4, lastExchangeTime=1637345076836, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false] [21:04:36] : [Step 4/5] [2021-11-19 21:04:36,908][INFO ][disco-event-worker-#8477%grid-6%][GridDiscoveryManager] Added new node to topology: TcpDiscoveryNode [id=70ed39fc-3b18-49f7-94cf-a6d33dc4a007, consistentId=grid-7, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47502], discPort=47502, order=4, intOrder=4, lastExchangeTime=1637345076876, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false] [21:04:36] : [Step 4/5] [2021-11-19 21:04:36,908][INFO ][tcp-client-disco-msg-worker-#434%client1%-#8567%client1%][TestTcpDiscoverySpi] Router node: TcpDiscoveryNode [id=60dac6e8-23c9-4d3f-a60f-788efce74006, consistentId=grid-6, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637345074760, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false] [21:04:36] : [Step 4/5] [2021-11-19 21:04:36,909][INFO ][disco-event-worker-#8477%grid-6%][GridDiscoveryManager] Topology snapshot [ver=4, locNode=60dac6e8, servers=3, clients=1, state=ACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=00e0e9f0-ad4e-4057-8861-d6fd939f1000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=60dac6e8-23c9-4d3f-a60f-788efce74006, consistentId=grid-6, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=10e1382f-5a0e-4692-ad18-c30bec6d4001, consistentId=client1, isClient=true, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=70ed39fc-3b18-49f7-94cf-a6d33dc4a007, consistentId=grid-7, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:04:36] : [Step 4/5] [2021-11-19 21:04:36,911][INFO ][disco-event-worker-#8477%grid-6%][GridDiscoveryManager] ^-- Baseline [id=0, size=2, online=2, offline=0] [21:04:36] : [Step 4/5] [2021-11-19 21:04:36,909][INFO ][disco-event-worker-#8355%grid-0%][GridDiscoveryManager] Topology snapshot [ver=4, locNode=00e0e9f0, servers=3, clients=1, state=ACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=00e0e9f0-ad4e-4057-8861-d6fd939f1000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=60dac6e8-23c9-4d3f-a60f-788efce74006, consistentId=grid-6, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=10e1382f-5a0e-4692-ad18-c30bec6d4001, consistentId=client1, isClient=true, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=70ed39fc-3b18-49f7-94cf-a6d33dc4a007, consistentId=grid-7, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:04:36] : [Step 4/5] [2021-11-19 21:04:36,912][INFO ][exchange-worker-#8478%grid-6%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], crd=false, evt=NODE_JOINED, evtNode=70ed39fc-3b18-49f7-94cf-a6d33dc4a007, customEvt=null, allowMerge=false, exchangeFreeSwitch=false] [21:04:36] : [Step 4/5] [2021-11-19 21:04:36,912][INFO ][tcp-disco-msg-worker-[00e0e9f0 127.0.0.1:47500]-#439%grid-7%-#8730%grid-7%][GridEncryptionManager] Store group key received from coordinator [grp=1613773252, keyId=0] [21:04:36] : [Step 4/5] [2021-11-19 21:04:36,910][INFO ][disco-event-worker-#8572%client1%][GridDiscoveryManager] Added new node to topology: TcpDiscoveryNode [id=70ed39fc-3b18-49f7-94cf-a6d33dc4a007, consistentId=grid-7, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47502], discPort=47502, order=4, intOrder=4, lastExchangeTime=1637345076886, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false] [21:04:36] : [Step 4/5] [2021-11-19 21:04:36,914][INFO ][exchange-worker-#8478%grid-6%][PageMemoryImpl] Started page memory [memoryAllocated=24.0 MiB, pages=5952, tableSize=474.2 KiB, replacementSize=768 B, checkpointBuffer=10.0 MiB] [21:04:36] : [Step 4/5] [2021-11-19 21:04:36,912][INFO ][disco-event-worker-#8355%grid-0%][GridDiscoveryManager] ^-- Baseline [id=0, size=2, online=2, offline=0] [21:04:36] : [Step 4/5] [2021-11-19 21:04:36,915][INFO ][disco-event-worker-#8572%client1%][GridDiscoveryManager] Topology snapshot [ver=4, locNode=10e1382f, servers=3, clients=1, state=ACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=10e1382f-5a0e-4692-ad18-c30bec6d4001, consistentId=client1, isClient=true, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=00e0e9f0-ad4e-4057-8861-d6fd939f1000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=60dac6e8-23c9-4d3f-a60f-788efce74006, consistentId=grid-6, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=70ed39fc-3b18-49f7-94cf-a6d33dc4a007, consistentId=grid-7, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:04:36] : [Step 4/5] [2021-11-19 21:04:36,914][INFO ][tcp-disco-msg-worker-[00e0e9f0 127.0.0.1:47500]-#439%grid-7%-#8730%grid-7%][ClusterProcessor] stoic_poitras [21:04:36] : [Step 4/5] [2021-11-19 21:04:36,916][INFO ][disco-event-worker-#8572%client1%][GridDiscoveryManager] ^-- Baseline [id=0, size=2, online=2, offline=0] [21:04:36] : [Step 4/5] [2021-11-19 21:04:36,915][INFO ][exchange-worker-#8356%grid-0%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], crd=true, evt=NODE_JOINED, evtNode=70ed39fc-3b18-49f7-94cf-a6d33dc4a007, customEvt=null, allowMerge=false, exchangeFreeSwitch=false] [21:04:36] : [Step 4/5] [2021-11-19 21:04:36,917][INFO ][exchange-worker-#8573%client1%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], crd=false, evt=NODE_JOINED, evtNode=70ed39fc-3b18-49f7-94cf-a6d33dc4a007, customEvt=null, allowMerge=false, exchangeFreeSwitch=false] [21:04:36] : [Step 4/5] [2021-11-19 21:04:36,916][INFO ][tcp-disco-msg-worker-[00e0e9f0 127.0.0.1:47500]-#439%grid-7%-#8730%grid-7%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustEnabled' was changed from 'null' to 'false' [21:04:36] : [Step 4/5] [2021-11-19 21:04:36,918][INFO ][tcp-disco-msg-worker-[00e0e9f0 127.0.0.1:47500]-#439%grid-7%-#8730%grid-7%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustTimeout' was changed from 'null' to '300000' [21:04:36] : [Step 4/5] [2021-11-19 21:04:36,918][INFO ][exchange-worker-#8356%grid-0%][PageMemoryImpl] Started page memory [memoryAllocated=24.0 MiB, pages=5952, tableSize=474.2 KiB, replacementSize=768 B, checkpointBuffer=10.0 MiB] [21:04:36] : [Step 4/5] [2021-11-19 21:04:36,918][INFO ][tcp-disco-msg-worker-[00e0e9f0 127.0.0.1:47500]-#439%grid-7%-#8730%grid-7%][IgniteTxManager] Transactions parameter 'longOperationsDumpTimeout' was changed from 'null' to '60000' [21:04:36] : [Step 4/5] [2021-11-19 21:04:36,919][INFO ][tcp-disco-msg-worker-[00e0e9f0 127.0.0.1:47500]-#439%grid-7%-#8730%grid-7%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpThreshold' was changed from 'null' to '0' [21:04:36] : [Step 4/5] [2021-11-19 21:04:36,919][INFO ][tcp-disco-msg-worker-[00e0e9f0 127.0.0.1:47500]-#439%grid-7%-#8730%grid-7%][IgniteTxManager] Transactions parameter 'transactionTimeDumpSamplesCoefficient' was changed from 'null' to '0.0' [21:04:36] : [Step 4/5] [2021-11-19 21:04:36,920][INFO ][tcp-disco-msg-worker-[00e0e9f0 127.0.0.1:47500]-#439%grid-7%-#8730%grid-7%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpSamplesPerSecondLimit' was changed from 'null' to '5' [21:04:36] : [Step 4/5] [2021-11-19 21:04:36,920][INFO ][tcp-disco-msg-worker-[00e0e9f0 127.0.0.1:47500]-#439%grid-7%-#8730%grid-7%][IgniteTxManager] Transactions parameter 'collisionsDumpInterval' was changed from 'null' to '1000' [21:04:36] : [Step 4/5] [2021-11-19 21:04:36,921][INFO ][tcp-disco-msg-worker-[00e0e9f0 127.0.0.1:47500]-#439%grid-7%-#8730%grid-7%][IgniteTxManager] Transactions parameter 'txOwnerDumpRequestsAllowed' was changed from 'null' to 'true' [21:04:36] : [Step 4/5] [2021-11-19 21:04:36,921][INFO ][tcp-disco-msg-worker-[00e0e9f0 127.0.0.1:47500]-#439%grid-7%-#8730%grid-7%][GridCacheDatabaseSharedManager] Historical rebalance WAL threshold changed [property=historical.rebalance.threshold, oldVal=null, newVal=500] [21:04:36] : [Step 4/5] [2021-11-19 21:04:36,921][INFO ][exchange-worker-#8573%client1%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], crd=false] [21:04:36] : [Step 4/5] [2021-11-19 21:04:36,922][INFO ][disco-notifier-worker-#8729%grid-7%][MvccProcessorImpl] Assigned mvcc coordinator [crd=MvccCoordinator [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], nodeId=00e0e9f0-ad4e-4057-8861-d6fd939f1000, ver=1637345073343, local=false, initialized=false]] [21:04:36] : [Step 4/5] [2021-11-19 21:04:36,923][INFO ][disco-notifier-worker-#8729%grid-7%][GridClusterStateProcessor] Local node is not included in Baseline Topology and will not be used for data storage. Use control.(sh|bat) script or IgniteCluster interface to include the node to Baseline Topology. [21:04:36] : [Step 4/5] [2021-11-19 21:04:36,925][INFO ][sys-#8721%grid-7%][ClusterProcessor] Writing cluster ID and tag to metastorage on ready for write ClusterIdAndTag [id=ff84c0df-a536-4bab-9124-dba409ba3604, tag=stoic_poitras] [21:04:37] : [Step 4/5] [2021-11-19 21:04:37,067][INFO ][exchange-worker-#8742%grid-7%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], crd=false, evt=NODE_JOINED, evtNode=70ed39fc-3b18-49f7-94cf-a6d33dc4a007, customEvt=null, allowMerge=false, exchangeFreeSwitch=false] [21:04:37] : [Step 4/5] [2021-11-19 21:04:37,070][INFO ][exchange-worker-#8742%grid-7%][GridCacheProcessor] Stopped cache [cacheName=encrypted] [21:04:37] : [Step 4/5] [2021-11-19 21:04:37,071][INFO ][exchange-worker-#8742%grid-7%][GridCacheProcessor] Stopped cache [cacheName=ignite-sys-cache] [21:04:37] : [Step 4/5] [2021-11-19 21:04:37,071][INFO ][exchange-worker-#8742%grid-7%][GridCacheDatabaseSharedManager] Page memory sysMemPlc for CacheGroupDescriptor [grpId=-2100569601, grpName=null, startTopVer=null, rcvdFrom=00e0e9f0-ad4e-4057-8861-d6fd939f1000, deploymentId=a232d593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, caches=SingletonMap {ignite-sys-cache=-2100569601}, rcvdFromVer=null, persistenceEnabled=true, walEnabled=true, cacheCfgEnrichment=CacheConfigurationEnrichment [fieldClassNames=HashMap {storeFactory=null, storeSesLsnrs=null, evictFilter=null, interceptor=null, evictPlcFactory=null}], cacheCfgEnriched=false, cacheName=ignite-sys-cache] has invalidated. [21:04:37] : [Step 4/5] [2021-11-19 21:04:37,073][INFO ][exchange-worker-#8742%grid-7%][GridCacheDatabaseSharedManager] Page memory default for CacheGroupDescriptor [grpId=1613773252, grpName=null, startTopVer=null, rcvdFrom=70ed39fc-3b18-49f7-94cf-a6d33dc4a007, deploymentId=b642d593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, caches=SingletonMap {encrypted=1613773252}, rcvdFromVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], persistenceEnabled=true, walEnabled=true, cacheCfgEnrichment=CacheConfigurationEnrichment [fieldClassNames=HashMap {storeFactory=null, storeSesLsnrs=null, evictFilter=null, interceptor=null, evictPlcFactory=null}], cacheCfgEnriched=false, cacheName=encrypted] has invalidated. [21:04:37] : [Step 4/5] [2021-11-19 21:04:37,089][INFO ][exchange-worker-#8742%grid-7%][FilePageStoreManager] Cache stores cleanup started asynchronously [21:04:37] : [Step 4/5] [2021-11-19 21:04:37,089][INFO ][exchange-worker-#8742%grid-7%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_7 [21:04:37] : [Step 4/5] [2021-11-19 21:04:37,133][INFO ][exchange-worker-#8356%grid-0%][GridCacheProcessor] Started cache [name=encrypted, id=1613773252, dataRegionName=default, mode=PARTITIONED, atomicity=TRANSACTIONAL, backups=0, mvcc=false] [21:04:37] : [Step 4/5] [2021-11-19 21:04:37,137][INFO ][exchange-worker-#8356%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], waitTime=0ms, futInfo=NA, mode=DISTRIBUTED] [21:04:37] : [Step 4/5] [2021-11-19 21:04:37,147][INFO ][exchange-worker-#8478%grid-6%][GridCacheProcessor] Started cache [name=encrypted, id=1613773252, dataRegionName=default, mode=PARTITIONED, atomicity=TRANSACTIONAL, backups=0, mvcc=false] [21:04:37] : [Step 4/5] [2021-11-19 21:04:37,150][INFO ][exchange-worker-#8478%grid-6%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], waitTime=0ms, futInfo=NA, mode=DISTRIBUTED] [21:04:37] : [Step 4/5] [2021-11-19 21:04:37,150][INFO ][exchange-worker-#8356%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partitions release latch: ServerLatch [permits=0, pendingAcks=HashSet [], super=CompletableLatch [id=CompletableLatchUid [id=exchange, topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0]]]] [21:04:37] : [Step 4/5] [2021-11-19 21:04:37,151][INFO ][exchange-worker-#8478%grid-6%][GridDhtPartitionsExchangeFuture] Finished waiting for partitions release latch: ClientLatch [coordinator=TcpDiscoveryNode [id=00e0e9f0-ad4e-4057-8861-d6fd939f1000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345074555, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], ackSent=true, super=CompletableLatch [id=CompletableLatchUid [id=exchange, topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0]]]] [21:04:37] : [Step 4/5] [2021-11-19 21:04:37,151][INFO ][exchange-worker-#8356%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:04:37] : [Step 4/5] [2021-11-19 21:04:37,152][INFO ][exchange-worker-#8478%grid-6%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:04:37] : [Step 4/5] [2021-11-19 21:04:37,204][INFO ][exchange-worker-#8356%grid-0%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], crd=true] [21:04:37] : [Step 4/5] [2021-11-19 21:04:37,214][INFO ][exchange-worker-#8478%grid-6%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], crd=false] [21:04:37] : [Step 4/5] [2021-11-19 21:04:37,215][INFO ][sys-#8337%grid-0%][GridDhtPartitionsExchangeFuture] Coordinator received single message [ver=AffinityTopologyVersion [topVer=4, minorTopVer=0], node=60dac6e8-23c9-4d3f-a60f-788efce74006, remainingNodes=1, allReceived=false] [21:04:37] : [Step 4/5] [2021-11-19 21:04:37,520][INFO ][async-file-store-cleanup-task-1-#8743%grid-7%][FilePageStoreManager] Cleanup cache stores [total=3, left=1, cleanFiles=true] [21:04:37] : [Step 4/5] [2021-11-19 21:04:37,522][INFO ][exchange-worker-#8742%grid-7%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_7/0000000000000000.wal, offset=13104, ver=2] [21:04:37] : [Step 4/5] [2021-11-19 21:04:37,528][INFO ][exchange-worker-#8742%grid-7%][GridClusterStateProcessor] Writing BaselineTopology[id=0] [21:04:37] : [Step 4/5] [2021-11-19 21:04:37,531][INFO ][exchange-worker-#8742%grid-7%][GridCacheDatabaseSharedManager] Finish recovery performed in 441 ms. [21:04:37] : [Step 4/5] [2021-11-19 21:04:37,533][INFO ][exchange-worker-#8742%grid-7%][msg] Components activation performed in 444 ms. [21:04:37] : [Step 4/5] [2021-11-19 21:04:37,636][INFO ][exchange-worker-#8742%grid-7%][GridCacheProcessor] Started cache [name=ignite-sys-cache, id=-2100569601, dataRegionName=sysMemPlc, mode=REPLICATED, atomicity=TRANSACTIONAL, backups=2147483647, mvcc=false] [21:04:37] : [Step 4/5] [2021-11-19 21:04:37,636][INFO ][sys-#8710%grid-7%][GridCacheProcessor] Started cache [name=encrypted, id=1613773252, dataRegionName=default, mode=PARTITIONED, atomicity=TRANSACTIONAL, backups=0, mvcc=false] [21:04:37] : [Step 4/5] [2021-11-19 21:04:37,637][INFO ][exchange-worker-#8742%grid-7%][GridCacheProcessor] Starting caches on local join performed in 102 ms. [21:04:37] : [Step 4/5] [2021-11-19 21:04:37,639][INFO ][exchange-worker-#8742%grid-7%][GridAffinityAssignmentCache] Local node affinity assignment distribution is not ideal [cache=encrypted, expectedPrimary=512.00, actualPrimary=0, expectedBackups=0.00, actualBackups=0, warningThreshold=50.00%] [21:04:37] : [Step 4/5] [2021-11-19 21:04:37,640][INFO ][exchange-worker-#8742%grid-7%][GridDhtPartitionsExchangeFuture] Skipped waiting for partitions release future (local node is joining) [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0]] [21:04:37] : [Step 4/5] [2021-11-19 21:04:37,663][INFO ][grid-nio-worker-tcp-comm-2-#8297%TcpCommunicationSpi%][TcpCommunicationSpi] Accepted incoming communication connection [locAddr=/127.0.0.1:45150, rmtAddr=/127.0.0.1:59340] [21:04:37] : [Step 4/5] [2021-11-19 21:04:37,666][INFO ][grid-nio-worker-tcp-comm-0-#8670%TcpCommunicationSpi%][TcpCommunicationSpi] Established outgoing communication connection [locAddr=/127.0.0.1:59340, rmtAddr=/127.0.0.1:45150] [21:04:37] : [Step 4/5] [2021-11-19 21:04:37,666][INFO ][exchange-worker-#8742%grid-7%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], crd=false] [21:04:37] : [Step 4/5] [2021-11-19 21:04:37,667][INFO ][sys-#8339%grid-0%][GridDhtPartitionsExchangeFuture] Coordinator received single message [ver=AffinityTopologyVersion [topVer=4, minorTopVer=0], node=70ed39fc-3b18-49f7-94cf-a6d33dc4a007, allReceived=true] [21:04:37] : [Step 4/5] [2021-11-19 21:04:37,667][INFO ][sys-#8339%grid-0%][GridDhtPartitionsExchangeFuture] finishExchangeOnCoordinator [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=0]] [21:04:37] : [Step 4/5] [2021-11-19 21:04:37,676][INFO ][sys-#8339%grid-0%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], err=null, rebalanced=true, wasRebalanced=true] [21:04:37] : [Step 4/5] [2021-11-19 21:04:37,677][INFO ][sys-#8447%grid-6%][GridDhtPartitionsExchangeFuture] Received full message, will finish exchange [node=00e0e9f0-ad4e-4057-8861-d6fd939f1000, resVer=AffinityTopologyVersion [topVer=4, minorTopVer=0]] [21:04:37] : [Step 4/5] [2021-11-19 21:04:37,677][INFO ][sys-#8720%grid-7%][GridDhtPartitionsExchangeFuture] Received full message, will finish exchange [node=00e0e9f0-ad4e-4057-8861-d6fd939f1000, resVer=AffinityTopologyVersion [topVer=4, minorTopVer=0]] [21:04:37] : [Step 4/5] [2021-11-19 21:04:37,680][INFO ][sys-#8447%grid-6%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], err=null, rebalanced=true, wasRebalanced=true] [21:04:37] : [Step 4/5] [2021-11-19 21:04:37,681][INFO ][sys-#8339%grid-0%][GridCacheProcessor] Finish proxy initialization, cacheName=encrypted, localNodeId=00e0e9f0-ad4e-4057-8861-d6fd939f1000 [21:04:37] : [Step 4/5] [2021-11-19 21:04:37,681][INFO ][sys-#8339%grid-0%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=00e0e9f0-ad4e-4057-8861-d6fd939f1000, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], evt=NODE_JOINED, evtNode=TcpDiscoveryNode [id=70ed39fc-3b18-49f7-94cf-a6d33dc4a007, consistentId=grid-7, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47502], discPort=47502, order=4, intOrder=4, lastExchangeTime=1637345076836, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0]] [21:04:37] : [Step 4/5] [2021-11-19 21:04:37,682][INFO ][sys-#8447%grid-6%][GridCacheProcessor] Finish proxy initialization, cacheName=encrypted, localNodeId=60dac6e8-23c9-4d3f-a60f-788efce74006 [21:04:37] : [Step 4/5] [2021-11-19 21:04:37,682][INFO ][exchange-worker-#8356%grid-0%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=4, minorTopVer=0], force=false, evt=NODE_JOINED, node=70ed39fc-3b18-49f7-94cf-a6d33dc4a007] [21:04:37] : [Step 4/5] [2021-11-19 21:04:37,681][INFO ][sys-#8720%grid-7%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], err=null, rebalanced=true, wasRebalanced=false] [21:04:37] : [Step 4/5] [2021-11-19 21:04:37,683][INFO ][exchange-worker-#8478%grid-6%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=4, minorTopVer=0], force=false, evt=NODE_JOINED, node=70ed39fc-3b18-49f7-94cf-a6d33dc4a007] [21:04:37] : [Step 4/5] [2021-11-19 21:04:37,683][INFO ][sys-#8447%grid-6%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=60dac6e8-23c9-4d3f-a60f-788efce74006, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], evt=NODE_JOINED, evtNode=TcpDiscoveryNode [id=70ed39fc-3b18-49f7-94cf-a6d33dc4a007, consistentId=grid-7, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47502], discPort=47502, order=4, intOrder=4, lastExchangeTime=1637345076876, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0]] [21:04:37] : [Step 4/5] [2021-11-19 21:04:37,682][INFO ][sys-#8339%grid-0%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (2 ms), stage="Determine exchange type" (219 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Wait partitions release latch [latch=exchange]" (13 ms), stage="Wait partitions release [latch=exchange]" (1 ms), stage="After states restored callback" (51 ms), stage="WAL history reservation" (0 ms), stage="Waiting for all single messages" (463 ms), stage="Affinity recalculation (crd)" (0 ms), stage="Collect update counters and create affinity messages" (0 ms), stage="Assign partitions states" (4 ms), stage="Validate partitions states" (0 ms), stage="Apply update counters" (0 ms), stage="Full message preparing" (2 ms), stage="Full message sending" (0 ms), stage="Exchange done" (6 ms), stage="Total time" (761 ms), Discovery lag=12 ms, Latest started node id=70ed39fc-3b18-49f7-94cf-a6d33dc4a007] [21:04:37] : [Step 4/5] [2021-11-19 21:04:37,687][INFO ][sys-#8447%grid-6%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (1 ms), stage="Determine exchange type" (236 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Wait partitions release latch [latch=exchange]" (1 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="After states restored callback" (58 ms), stage="WAL history reservation" (1 ms), stage="Waiting for Full message" (463 ms), stage="Affinity recalculation" (0 ms), stage="Full map updating" (2 ms), stage="Exchange done" (6 ms), stage="Total time" (768 ms)] [21:04:37] : [Step 4/5] [2021-11-19 21:04:37,689][INFO ][sys-#8447%grid-6%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], stage="Affinity initialization (new cache) [grp=encrypted, crd=false]" (236 ms) (parent=Determine exchange type), stage="Affinity initialization (node join) [grp=ignite-sys-cache, crd=false]" (0 ms) (parent=Determine exchange type)] [21:04:37] : [Step 4/5] [2021-11-19 21:04:37,687][INFO ][sys-#8720%grid-7%][GridCacheProcessor] Finish proxy initialization, cacheName=ignite-sys-cache, localNodeId=70ed39fc-3b18-49f7-94cf-a6d33dc4a007 [21:04:37] : [Step 4/5] [2021-11-19 21:04:37,686][INFO ][sys-#8756%client1%][GridDhtPartitionsExchangeFuture] Received full message, will finish exchange [node=00e0e9f0-ad4e-4057-8861-d6fd939f1000, resVer=AffinityTopologyVersion [topVer=4, minorTopVer=0]] [21:04:37] : [Step 4/5] [2021-11-19 21:04:37,690][INFO ][sys-#8720%grid-7%][GridCacheProcessor] Finish proxy initialization, cacheName=encrypted, localNodeId=70ed39fc-3b18-49f7-94cf-a6d33dc4a007 [21:04:37] : [Step 4/5] [2021-11-19 21:04:37,688][INFO ][sys-#8339%grid-0%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], stage="Affinity initialization (new cache) [grp=encrypted, crd=true]" (218 ms) (parent=Determine exchange type), stage="Affinity initialization (node join) [grp=ignite-sys-cache, crd=true]" (0 ms) (parent=Determine exchange type)] [21:04:37] : [Step 4/5] [2021-11-19 21:04:37,692][INFO ][exchange-worker-#8742%grid-7%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=4, minorTopVer=0], force=false, evt=NODE_JOINED, node=70ed39fc-3b18-49f7-94cf-a6d33dc4a007] [21:04:37] : [Step 4/5] [2021-11-19 21:04:37,691][INFO ][sys-#8720%grid-7%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=70ed39fc-3b18-49f7-94cf-a6d33dc4a007, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], evt=NODE_JOINED, evtNode=TcpDiscoveryNode [id=70ed39fc-3b18-49f7-94cf-a6d33dc4a007, consistentId=grid-7, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47502], discPort=47502, order=4, intOrder=4, lastExchangeTime=1637345077380, loc=true, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0]] [21:04:37] : [Step 4/5] [2021-11-19 21:04:37,693][INFO ][sys-#8720%grid-7%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], stage="Waiting in exchange queue" (144 ms), stage="Exchange parameters initialization" (0 ms), stage="Baseline change callback" (21 ms), stage="Components activation" (444 ms), stage="Determine exchange type" (106 ms), stage="Preloading notification" (0 ms), stage="Restore partition states" (14 ms), stage="After states restored callback" (5 ms), stage="WAL history reservation" (0 ms), stage="Waiting for Full message" (17 ms), stage="Affinity recalculation" (3 ms), stage="Full map updating" (0 ms), stage="Exchange done" (11 ms), stage="Total time" (765 ms)] [21:04:37] : [Step 4/5] [2021-11-19 21:04:37,694][INFO ][sys-#8720%grid-7%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], stage="Affinity fetch" (106 ms) (parent=Determine exchange type), stage="Restore partition states [grp=encrypted]" (14 ms) (parent=Restore partition states), stage="Restore partition states [grp=ignite-sys-cache]" (2 ms) (parent=Restore partition states), stage="Affinity initialization (local join) [grp=ignite-sys-cache]" (3 ms) (parent=Affinity recalculation), stage="Affinity initialization (local join) [grp=encrypted]" (3 ms) (parent=Affinity recalculation)] [21:04:37] : [Step 4/5] [2021-11-19 21:04:37,706][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-7] To start Console Management & Monitoring run ignitevisorcmd.{sh|bat} [21:04:37] : [Step 4/5] [2021-11-19 21:04:37,707][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-7] [21:04:37] : [Step 4/5] [21:04:37] : [Step 4/5] >>> +-------------------------------------------+ [21:04:37] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:04:37] : [Step 4/5] >>> +-------------------------------------------+ [21:04:37] : [Step 4/5] >>> OS name: Linux 4.15.0-151-generic amd64 [21:04:37] : [Step 4/5] >>> CPU(s): 24 [21:04:37] : [Step 4/5] >>> Heap: 2.0GB [21:04:37] : [Step 4/5] >>> VM name: 16724@c4dfe9a430b2 [21:04:37] : [Step 4/5] >>> Ignite instance name: grid-7 [21:04:37] : [Step 4/5] >>> Local node [ID=70ED39FC-3B18-49F7-94CF-A6D33DC4A007, order=4, clientMode=false] [21:04:37] : [Step 4/5] >>> Local node addresses: [127.0.0.1] [21:04:37] : [Step 4/5] >>> Local ports: TCP:10803 TCP:45153 TCP:47502 [21:04:37] : [Step 4/5] [21:04:37] : [Step 4/5] [2021-11-19 21:04:37,707][INFO ][sys-#8756%client1%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], err=null, rebalanced=true, wasRebalanced=true] [21:04:37] : [Step 4/5] [2021-11-19 21:04:37,708][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][GridDiscoveryManager] Topology snapshot [ver=4, locNode=70ed39fc, servers=3, clients=1, state=ACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=00e0e9f0-ad4e-4057-8861-d6fd939f1000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=60dac6e8-23c9-4d3f-a60f-788efce74006, consistentId=grid-6, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=10e1382f-5a0e-4692-ad18-c30bec6d4001, consistentId=client1, isClient=true, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=70ed39fc-3b18-49f7-94cf-a6d33dc4a007, consistentId=grid-7, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:04:37] : [Step 4/5] [2021-11-19 21:04:37,710][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][GridDiscoveryManager] ^-- Baseline [id=0, size=2, online=2, offline=0] [21:04:37] : [Step 4/5] [2021-11-19 21:04:37,708][INFO ][exchange-worker-#8573%client1%][GridCachePartitionExchangeManager] AffinityTopologyVersion [topVer=4, minorTopVer=0], evt=NODE_JOINED, evtNode=70ed39fc-3b18-49f7-94cf-a6d33dc4a007, client=true] [21:04:37] : [Step 4/5] [2021-11-19 21:04:37,708][INFO ][sys-#8756%client1%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=10e1382f-5a0e-4692-ad18-c30bec6d4001, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], evt=NODE_JOINED, evtNode=TcpDiscoveryNode [id=70ed39fc-3b18-49f7-94cf-a6d33dc4a007, consistentId=grid-7, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47502], discPort=47502, order=4, intOrder=4, lastExchangeTime=1637345076886, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0]] [21:04:37] : [Step 4/5] [2021-11-19 21:04:37,711][INFO ][sys-#8756%client1%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (0 ms), stage="Determine exchange type" (3 ms), stage="Waiting for Full message" (764 ms), stage="Affinity recalculation" (4 ms), stage="Full map updating" (16 ms), stage="Exchange done" (4 ms), stage="Total time" (791 ms)] [21:04:37] : [Step 4/5] [2021-11-19 21:04:37,712][INFO ][sys-#8756%client1%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], stage="Affinity initialization (node join) [grp=ignite-sys-cache, crd=false]" (3 ms) (parent=Determine exchange type), stage="Affinity initialization (new cache) [grp=encrypted, crd=false]" (2 ms) (parent=Determine exchange type)] [21:04:37] : [Step 4/5] [2021-11-19 21:04:37,710][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][G] Node started : [stage="Configure system pool" (0 ms),stage="Start managers" (265 ms),stage="Configure binary metadata" (2 ms),stage="Start processors" (595 ms),stage="Start 'StanByClusterTestProvider' plugin" (0 ms),stage="Start 'PageMemory tracker plugin' plugin" (0 ms),stage="Start 'TestDistibutedConfigurationPlugin' plugin" (0 ms),stage="Start 'NodeValidationPluginProvider' plugin" (0 ms),stage="Init metastore" (24 ms),stage="Init and start regions" (10 ms),stage="Restore binary memory" (666 ms),stage="Restore logical state" (64 ms),stage="Finish recovery" (190 ms),stage="Join topology" (101 ms),stage="Await transition" (114 ms),stage="Await exchange" (672 ms),stage="Total time" (2703 ms)] [21:04:37] : [Step 4/5] [2021-11-19 21:04:37,714][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][root] Node started with the following configuration [id=70ed39fc-3b18-49f7-94cf-a6d33dc4a007, marshaller=BinaryMarshaller [], discovery=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=5000, ackTimeout=5000, marsh=JdkMarshaller [clsFilter=org.apache.ignite.marshaller.MarshallerUtils$1@d56a8c1], reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], binaryCfg=null, lateAff=true] [21:04:37] : [Step 4/5] [2021-11-19 21:04:37,733][INFO ][test-runner-#8240%encryption.EncryptedCacheNodeJoinTest%][root] awaitPartitionMapExchange finished [21:04:38] : [Step 4/5] [2021-11-19 21:04:38,442][INFO ][db-checkpoint-thread-#8750%grid-7%][Checkpointer] Checkpoint started [checkpointId=01824610-3549-49fa-b54f-dfd4d8ad1bea, startPtr=WALPointer [idx=0, fileOff=93424, len=69], checkpointBeforeLockTime=2ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=1ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=511ms, writeCheckpointEntryDuration=272ms, splitAndSortCpPagesDuration=0ms, pages=23, reason='node started'] [21:04:38] : [Step 4/5] [2021-11-19 21:04:38,474][INFO ][grid-nio-worker-tcp-comm-1-#8414%TcpCommunicationSpi%][TcpCommunicationSpi] Accepted incoming communication connection [locAddr=/127.0.0.1:45151, rmtAddr=/127.0.0.1:60814] [21:04:38] : [Step 4/5] [2021-11-19 21:04:38,480][INFO ][grid-nio-worker-tcp-comm-1-#8671%TcpCommunicationSpi%][TcpCommunicationSpi] Established outgoing communication connection [locAddr=/127.0.0.1:60814, rmtAddr=/127.0.0.1:45151] [21:04:38] : [Step 4/5] [2021-11-19 21:04:38,525][INFO ][db-checkpoint-thread-#8750%grid-7%][Checkpointer] Checkpoint finished [cpId=01824610-3549-49fa-b54f-dfd4d8ad1bea, pages=23, markPos=WALPointer [idx=0, fileOff=93424, len=69], walSegmentsCovered=[], markDuration=785ms, pagesWrite=9ms, fsync=73ms, total=869ms] [21:04:43] : [Step 4/5] [2021-11-19 21:04:43,545][INFO ][exchange-worker-#8573%client1%][GridCacheProcessor] Started cache [name=encrypted, id=1613773252, dataRegionName=default, mode=PARTITIONED, atomicity=TRANSACTIONAL, backups=0, mvcc=false] [21:04:43] : [Step 4/5] [2021-11-19 21:04:43,558][INFO ][exchange-worker-#8573%client1%][GridCacheProcessor] Finish proxy initialization, cacheName=encrypted, localNodeId=10e1382f-5a0e-4692-ad18-c30bec6d4001 [21:04:43] : [Step 4/5] [2021-11-19 21:04:43,574][INFO ][grid-nio-worker-tcp-comm-2-#8672%TcpCommunicationSpi%][TcpCommunicationSpi] Accepted incoming communication connection [locAddr=/127.0.0.1:45153, rmtAddr=/127.0.0.1:43188] [21:04:43] : [Step 4/5] [2021-11-19 21:04:43,578][INFO ][grid-nio-worker-tcp-comm-1-#8536%TcpCommunicationSpi%][TcpCommunicationSpi] Established outgoing communication connection [locAddr=/127.0.0.1:43188, rmtAddr=/127.0.0.1:45153] [21:04:43] : [Step 4/5] [2021-11-19 21:04:43,579][INFO ][grid-nio-worker-tcp-comm-2-#8415%TcpCommunicationSpi%][TcpCommunicationSpi] Accepted incoming communication connection [locAddr=/127.0.0.1:45151, rmtAddr=/127.0.0.1:60890] [21:04:43] : [Step 4/5] [2021-11-19 21:04:43,581][INFO ][grid-nio-worker-tcp-comm-2-#8537%TcpCommunicationSpi%][TcpCommunicationSpi] Established outgoing communication connection [locAddr=/127.0.0.1:60890, rmtAddr=/127.0.0.1:45151] [21:04:43] : [Step 4/5] [21:04:43] >>> Stopping test: EncryptedCacheNodeJoinTest#testServerNodeJoinActiveClusterWithNewStaticCacheConfig in 11498 ms <<< [21:04:43] : [Step 4/5] [2021-11-19 21:04:43,691][INFO ][main][root] >>> Stopping test: EncryptedCacheNodeJoinTest#testServerNodeJoinActiveClusterWithNewStaticCacheConfig in 11498 ms <<< [21:04:43] : [Step 4/5] [21:04:43] >>> Heap: 300 MB used / 1912 MB commited / 1912 MB max <<< [21:04:43] : [Step 4/5] [2021-11-19 21:04:43,692][INFO ][main][root] >>> Heap: 300 MB used / 1912 MB commited / 1912 MB max <<< [21:04:43] : [Step 4/5] [21:04:43] >>> Non-Heap: 141 MB used / 153 MB commited / 0 MB max <<< [21:04:43] : [Step 4/5] [2021-11-19 21:04:43,692][INFO ][main][root] >>> Non-Heap: 141 MB used / 153 MB commited / 0 MB max <<< [21:04:43] : [Step 4/5] [2021-11-19 21:04:43,692][INFO ][main][root] >>> Stopping grid [name=client1, id=10e1382f-5a0e-4692-ad18-c30bec6d4001] [21:04:43] : [Step 4/5] [2021-11-19 21:04:43,704][INFO ][disco-event-worker-#8355%grid-0%][GridDiscoveryManager] Node left topology: TcpDiscoveryNode [id=10e1382f-5a0e-4692-ad18-c30bec6d4001, consistentId=client1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:0], discPort=0, order=3, intOrder=3, lastExchangeTime=1637345074740, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=true] [21:04:43] : [Step 4/5] [2021-11-19 21:04:43,706][INFO ][disco-event-worker-#8741%grid-7%][GridDiscoveryManager] Node left topology: TcpDiscoveryNode [id=10e1382f-5a0e-4692-ad18-c30bec6d4001, consistentId=client1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:0], discPort=0, order=3, intOrder=3, lastExchangeTime=1637345076886, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=true] [21:04:43] : [Step 4/5] [2021-11-19 21:04:43,706][INFO ][tcp-disco-sock-reader-[10e1382f 127.0.0.1:55949 client]-#435%grid-6%-#8569%grid-6%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:55949, rmtPort=55949, rmtNodeId=10e1382f-5a0e-4692-ad18-c30bec6d4001] [21:04:43] : [Step 4/5] [2021-11-19 21:04:43,704][INFO ][disco-event-worker-#8477%grid-6%][GridDiscoveryManager] Node left topology: TcpDiscoveryNode [id=10e1382f-5a0e-4692-ad18-c30bec6d4001, consistentId=client1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:0], discPort=0, order=3, intOrder=3, lastExchangeTime=1637345074760, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=true] [21:04:43] : [Step 4/5] [2021-11-19 21:04:43,714][INFO ][disco-event-worker-#8741%grid-7%][GridDiscoveryManager] Topology snapshot [ver=5, locNode=70ed39fc, servers=3, clients=0, state=ACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=00e0e9f0-ad4e-4057-8861-d6fd939f1000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=60dac6e8-23c9-4d3f-a60f-788efce74006, consistentId=grid-6, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=70ed39fc-3b18-49f7-94cf-a6d33dc4a007, consistentId=grid-7, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:04:43] : [Step 4/5] [2021-11-19 21:04:43,713][INFO ][disco-event-worker-#8355%grid-0%][GridDiscoveryManager] Topology snapshot [ver=5, locNode=00e0e9f0, servers=3, clients=0, state=ACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=00e0e9f0-ad4e-4057-8861-d6fd939f1000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=60dac6e8-23c9-4d3f-a60f-788efce74006, consistentId=grid-6, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=70ed39fc-3b18-49f7-94cf-a6d33dc4a007, consistentId=grid-7, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:04:43] : [Step 4/5] [2021-11-19 21:04:43,713][INFO ][main][GridCacheProcessor] Stopped cache [cacheName=ignite-sys-cache] [21:04:43] : [Step 4/5] [2021-11-19 21:04:43,717][INFO ][disco-event-worker-#8355%grid-0%][GridDiscoveryManager] ^-- Baseline [id=0, size=2, online=2, offline=0] [21:04:43] : [Step 4/5] [2021-11-19 21:04:43,716][INFO ][disco-event-worker-#8741%grid-7%][GridDiscoveryManager] ^-- Baseline [id=0, size=2, online=2, offline=0] [21:04:43] : [Step 4/5] [2021-11-19 21:04:43,715][INFO ][disco-event-worker-#8477%grid-6%][GridDiscoveryManager] Topology snapshot [ver=5, locNode=60dac6e8, servers=3, clients=0, state=ACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=00e0e9f0-ad4e-4057-8861-d6fd939f1000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=60dac6e8-23c9-4d3f-a60f-788efce74006, consistentId=grid-6, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=70ed39fc-3b18-49f7-94cf-a6d33dc4a007, consistentId=grid-7, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:04:43]W: [org.apache.ignite:ignite-core] [2021-11-19 21:04:43,719][WARN ][grid-nio-worker-tcp-comm-0-#8535%TcpCommunicationSpi%][TcpCommunicationSpi] Failed to shutdown socket [21:04:43]W: [org.apache.ignite:ignite-core] java.nio.channels.ClosedChannelException [21:04:43]W: [org.apache.ignite:ignite-core] at sun.nio.ch.SocketChannelImpl.shutdownOutput(SocketChannelImpl.java:795) [21:04:43]W: [org.apache.ignite:ignite-core] at sun.nio.ch.SocketAdaptor.shutdownOutput(SocketAdaptor.java:407) [21:04:43]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.close(IgniteUtils.java:4247) [21:04:43]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.closeKey(GridNioServer.java:2784) [21:04:43]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.close(GridNioServer.java:2835) [21:04:43]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.close(GridNioServer.java:2794) [21:04:43]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$DirectNioClientWorker.processRead(GridNioServer.java:1357) [21:04:43]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.processSelectedKeysOptimized(GridNioServer.java:2508) [21:04:43]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.bodyInternal(GridNioServer.java:2273) [21:04:43]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.body(GridNioServer.java:1910) [21:04:43]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:125) [21:04:43]W: [org.apache.ignite:ignite-core] at java.lang.Thread.run(Thread.java:748) [21:04:43] : [Step 4/5] [2021-11-19 21:04:43,718][INFO ][main][GridCacheProcessor] Stopped cache [cacheName=encrypted] [21:04:43] : [Step 4/5] [2021-11-19 21:04:43,720][INFO ][disco-event-worker-#8477%grid-6%][GridDiscoveryManager] ^-- Baseline [id=0, size=2, online=2, offline=0] [21:04:43] : [Step 4/5] [2021-11-19 21:04:43,728][INFO ][main][GridDeploymentLocalStore] Removed undeployed class: GridDeployment [ts=1637345074963, depMode=SHARED, clsLdr=IsolatedClassLoader{roleName='test'}, clsLdrId=3442d593d71-10e1382f-5a0e-4692-ad18-c30bec6d4001, userVer=0, loc=true, sampleClsName=org.apache.ignite.internal.processors.cache.distributed.dht.preloader.GridDhtPartitionFullMap, pendingUndeploy=false, undeployed=true, usage=0] [21:04:43] : [Step 4/5] [2021-11-19 21:04:43,729][INFO ][exchange-worker-#8478%grid-6%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], crd=false, evt=NODE_LEFT, evtNode=10e1382f-5a0e-4692-ad18-c30bec6d4001, customEvt=null, allowMerge=true, exchangeFreeSwitch=false] [21:04:43] : [Step 4/5] [2021-11-19 21:04:43,729][INFO ][exchange-worker-#8356%grid-0%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], crd=true, evt=NODE_LEFT, evtNode=10e1382f-5a0e-4692-ad18-c30bec6d4001, customEvt=null, allowMerge=true, exchangeFreeSwitch=false] [21:04:43] : [Step 4/5] [2021-11-19 21:04:43,729][INFO ][exchange-worker-#8742%grid-7%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], crd=false, evt=NODE_LEFT, evtNode=10e1382f-5a0e-4692-ad18-c30bec6d4001, customEvt=null, allowMerge=true, exchangeFreeSwitch=false] [21:04:43] : [Step 4/5] [2021-11-19 21:04:43,732][INFO ][exchange-worker-#8356%grid-0%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], err=null, rebalanced=true, wasRebalanced=true] [21:04:43] : [Step 4/5] [2021-11-19 21:04:43,732][INFO ][exchange-worker-#8478%grid-6%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], err=null, rebalanced=true, wasRebalanced=true] [21:04:43] : [Step 4/5] [2021-11-19 21:04:43,735][INFO ][exchange-worker-#8742%grid-7%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], err=null, rebalanced=true, wasRebalanced=true] [21:04:43] : [Step 4/5] [2021-11-19 21:04:43,737][INFO ][exchange-worker-#8356%grid-0%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=00e0e9f0-ad4e-4057-8861-d6fd939f1000, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], evt=NODE_LEFT, evtNode=TcpDiscoveryNode [id=10e1382f-5a0e-4692-ad18-c30bec6d4001, consistentId=client1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:0], discPort=0, order=3, intOrder=3, lastExchangeTime=1637345074740, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=true], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=5, minorTopVer=0]] [21:04:43] : [Step 4/5] [2021-11-19 21:04:43,737][INFO ][exchange-worker-#8742%grid-7%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=70ed39fc-3b18-49f7-94cf-a6d33dc4a007, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], evt=NODE_LEFT, evtNode=TcpDiscoveryNode [id=10e1382f-5a0e-4692-ad18-c30bec6d4001, consistentId=client1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:0], discPort=0, order=3, intOrder=3, lastExchangeTime=1637345076886, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=true], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=5, minorTopVer=0]] [21:04:43] : [Step 4/5] [2021-11-19 21:04:43,737][INFO ][exchange-worker-#8478%grid-6%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=60dac6e8-23c9-4d3f-a60f-788efce74006, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], evt=NODE_LEFT, evtNode=TcpDiscoveryNode [id=10e1382f-5a0e-4692-ad18-c30bec6d4001, consistentId=client1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:0], discPort=0, order=3, intOrder=3, lastExchangeTime=1637345074760, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=true], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=5, minorTopVer=0]] [21:04:43] : [Step 4/5] [2021-11-19 21:04:43,740][INFO ][exchange-worker-#8742%grid-7%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (4 ms), stage="Determine exchange type" (1 ms), stage="Exchange done" (5 ms), stage="Total time" (10 ms)] [21:04:43] : [Step 4/5] [2021-11-19 21:04:43,739][INFO ][exchange-worker-#8356%grid-0%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (3 ms), stage="Determine exchange type" (0 ms), stage="Exchange done" (6 ms), stage="Total time" (9 ms)] [21:04:43] : [Step 4/5] [2021-11-19 21:04:43,741][INFO ][exchange-worker-#8478%grid-6%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (2 ms), stage="Determine exchange type" (0 ms), stage="Exchange done" (8 ms), stage="Total time" (10 ms)] [21:04:43] : [Step 4/5] [2021-11-19 21:04:43,742][INFO ][exchange-worker-#8356%grid-0%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=5, minorTopVer=0]] [21:04:43] : [Step 4/5] [2021-11-19 21:04:43,742][INFO ][exchange-worker-#8742%grid-7%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=5, minorTopVer=0]] [21:04:43] : [Step 4/5] [2021-11-19 21:04:43,744][INFO ][exchange-worker-#8356%grid-0%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], crd=true] [21:04:43] : [Step 4/5] [2021-11-19 21:04:43,744][INFO ][exchange-worker-#8478%grid-6%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=5, minorTopVer=0]] [21:04:43] : [Step 4/5] [2021-11-19 21:04:43,745][INFO ][exchange-worker-#8356%grid-0%][GridCachePartitionExchangeManager] AffinityTopologyVersion [topVer=5, minorTopVer=0], evt=NODE_LEFT, evtNode=10e1382f-5a0e-4692-ad18-c30bec6d4001, client=false] [21:04:43] : [Step 4/5] [2021-11-19 21:04:43,745][INFO ][exchange-worker-#8742%grid-7%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], crd=false] [21:04:43] : [Step 4/5] [2021-11-19 21:04:43,745][INFO ][exchange-worker-#8478%grid-6%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], crd=false] [21:04:43] : [Step 4/5] [2021-11-19 21:04:43,746][INFO ][exchange-worker-#8742%grid-7%][GridCachePartitionExchangeManager] AffinityTopologyVersion [topVer=5, minorTopVer=0], evt=NODE_LEFT, evtNode=10e1382f-5a0e-4692-ad18-c30bec6d4001, client=false] [21:04:43] : [Step 4/5] [2021-11-19 21:04:43,746][INFO ][exchange-worker-#8478%grid-6%][GridCachePartitionExchangeManager] AffinityTopologyVersion [topVer=5, minorTopVer=0], evt=NODE_LEFT, evtNode=10e1382f-5a0e-4692-ad18-c30bec6d4001, client=false] [21:04:43] : [Step 4/5] [2021-11-19 21:04:43,748][INFO ][main][IgniteKernal%client1] [21:04:43] : [Step 4/5] [21:04:43] : [Step 4/5] >>> +------------------------------------------------------+ [21:04:43] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV stopped OK [21:04:43] : [Step 4/5] >>> +------------------------------------------------------+ [21:04:43] : [Step 4/5] >>> Ignite instance name: client1 [21:04:43] : [Step 4/5] >>> Grid uptime: 00:00:08.941 [21:04:43] : [Step 4/5] [21:04:43] : [Step 4/5] [21:04:43] : [Step 4/5] [2021-11-19 21:04:43,750][INFO ][main][root] >>> Stopping grid [name=grid-0, id=00e0e9f0-ad4e-4057-8861-d6fd939f1000] [21:04:44] : [Step 4/5] [2021-11-19 21:04:44,091][INFO ][db-checkpoint-thread-#8585%grid-0%][Checkpointer] Checkpoint started [checkpointId=6491ba9b-528d-46f0-8ef1-72f184469c54, startPtr=WALPointer [idx=0, fileOff=452137, len=11928], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=1ms, checkpointLockHoldTime=2ms, walCpRecordFsyncDuration=159ms, writeCheckpointEntryDuration=172ms, splitAndSortCpPagesDuration=0ms, pages=424, reason='timeout'] [21:04:44] : [Step 4/5] [2021-11-19 21:04:44,102][INFO ][tcp-disco-msg-worker-[00e0e9f0 127.0.0.1:47500]-#439%grid-7%-#8730%grid-7%][TestTcpDiscoverySpi] New next node [newNext=TcpDiscoveryNode [id=60dac6e8-23c9-4d3f-a60f-788efce74006, consistentId=grid-6, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637345076886, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false]] [21:04:44] : [Step 4/5] [2021-11-19 21:04:44,102][INFO ][tcp-disco-sock-reader-[70ed39fc 127.0.0.1:45917]-#444%grid-0%-#8735%grid-0%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:45917, rmtPort=45917, rmtNodeId=70ed39fc-3b18-49f7-94cf-a6d33dc4a007] [21:04:44] : [Step 4/5] [2021-11-19 21:04:44,107][INFO ][tcp-disco-srvr-[:47501]-#424%grid-6%-#8471%grid-6%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=48627] [21:04:44] : [Step 4/5] [2021-11-19 21:04:44,107][INFO ][disco-event-worker-#8477%grid-6%][GridDiscoveryManager] Node left topology: TcpDiscoveryNode [id=00e0e9f0-ad4e-4057-8861-d6fd939f1000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345074555, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false] [21:04:44] : [Step 4/5] [2021-11-19 21:04:44,107][INFO ][disco-event-worker-#8741%grid-7%][GridDiscoveryManager] Node left topology: TcpDiscoveryNode [id=00e0e9f0-ad4e-4057-8861-d6fd939f1000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345076886, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false] [21:04:44] : [Step 4/5] [2021-11-19 21:04:44,111][INFO ][disco-event-worker-#8477%grid-6%][GridDiscoveryManager] Topology snapshot [ver=6, locNode=60dac6e8, servers=2, clients=0, state=ACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=60dac6e8-23c9-4d3f-a60f-788efce74006, consistentId=grid-6, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=70ed39fc-3b18-49f7-94cf-a6d33dc4a007, consistentId=grid-7, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:04:44] : [Step 4/5] [2021-11-19 21:04:44,110][INFO ][main][GridCacheProcessor] Stopped cache [cacheName=ignite-sys-cache] [21:04:44] : [Step 4/5] [2021-11-19 21:04:44,107][INFO ][tcp-disco-srvr-[:47501]-#424%grid-6%-#8471%grid-6%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=48627] [21:04:44] : [Step 4/5] [2021-11-19 21:04:44,115][INFO ][main][GridCacheProcessor] Stopped cache [cacheName=encrypted] [21:04:44] : [Step 4/5] [2021-11-19 21:04:44,112][INFO ][disco-event-worker-#8477%grid-6%][GridDiscoveryManager] Coordinator changed [prev=TcpDiscoveryNode [id=00e0e9f0-ad4e-4057-8861-d6fd939f1000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345074555, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], cur=TcpDiscoveryNode [id=60dac6e8-23c9-4d3f-a60f-788efce74006, consistentId=grid-6, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637345084096, loc=true, ver=2.13.0#20211119-sha1:00000000, isClient=false]] [21:04:44] : [Step 4/5] [2021-11-19 21:04:44,111][INFO ][disco-event-worker-#8741%grid-7%][GridDiscoveryManager] Topology snapshot [ver=6, locNode=70ed39fc, servers=2, clients=0, state=ACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=60dac6e8-23c9-4d3f-a60f-788efce74006, consistentId=grid-6, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=70ed39fc-3b18-49f7-94cf-a6d33dc4a007, consistentId=grid-7, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:04:44] : [Step 4/5] [2021-11-19 21:04:44,120][INFO ][disco-event-worker-#8477%grid-6%][GridDiscoveryManager] ^-- Baseline [id=0, size=2, online=1, offline=1] [21:04:44] : [Step 4/5] [2021-11-19 21:04:44,115][INFO ][tcp-disco-sock-reader-[]-#446%grid-6%-#8788%grid-6%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:48627, rmtPort=48627] [21:04:44] : [Step 4/5] [2021-11-19 21:04:44,121][INFO ][disco-event-worker-#8477%grid-6%][MvccProcessorImpl] Assigned mvcc coordinator [crd=MvccCoordinator [topVer=AffinityTopologyVersion [topVer=6, minorTopVer=0], nodeId=60dac6e8-23c9-4d3f-a60f-788efce74006, ver=1637345073344, local=true, initialized=false]] [21:04:44] : [Step 4/5] [2021-11-19 21:04:44,121][INFO ][disco-event-worker-#8741%grid-7%][GridDiscoveryManager] Coordinator changed [prev=TcpDiscoveryNode [id=00e0e9f0-ad4e-4057-8861-d6fd939f1000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345076886, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], cur=TcpDiscoveryNode [id=60dac6e8-23c9-4d3f-a60f-788efce74006, consistentId=grid-6, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637345076886, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false]] [21:04:44] : [Step 4/5] [2021-11-19 21:04:44,123][INFO ][tcp-disco-sock-reader-[70ed39fc 127.0.0.1:48627]-#446%grid-6%-#8788%grid-6%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=70ed39fc-3b18-49f7-94cf-a6d33dc4a007, rmtAddr=/127.0.0.1:48627] [21:04:44] : [Step 4/5] [2021-11-19 21:04:44,124][INFO ][exchange-worker-#8478%grid-6%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=6, minorTopVer=0], crd=true, evt=NODE_LEFT, evtNode=00e0e9f0-ad4e-4057-8861-d6fd939f1000, customEvt=null, allowMerge=false, exchangeFreeSwitch=true] [21:04:44] : [Step 4/5] [2021-11-19 21:04:44,123][INFO ][disco-event-worker-#8741%grid-7%][GridDiscoveryManager] ^-- Baseline [id=0, size=2, online=1, offline=1] [21:04:44] : [Step 4/5] [2021-11-19 21:04:44,124][INFO ][sys-#8461%grid-6%][ExchangeLatchManager] Become new coordinator 60dac6e8-23c9-4d3f-a60f-788efce74006 [21:04:44] : [Step 4/5] [2021-11-19 21:04:44,125][INFO ][disco-event-worker-#8741%grid-7%][MvccProcessorImpl] Assigned mvcc coordinator [crd=MvccCoordinator [topVer=AffinityTopologyVersion [topVer=6, minorTopVer=0], nodeId=60dac6e8-23c9-4d3f-a60f-788efce74006, ver=1637345073344, local=false, initialized=false]] [21:04:44] : [Step 4/5] [2021-11-19 21:04:44,125][INFO ][sys-#8451%grid-6%][GridAffinityAssignmentCache] Local node affinity assignment distribution is not ideal [cache=encrypted, expectedPrimary=1024.00, actualPrimary=499, expectedBackups=0.00, actualBackups=0, warningThreshold=50.00%] [21:04:44] : [Step 4/5] [2021-11-19 21:04:44,126][INFO ][exchange-worker-#8478%grid-6%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=6, minorTopVer=0], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:04:44] : [Step 4/5] [2021-11-19 21:04:44,128][INFO ][exchange-worker-#8742%grid-7%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=6, minorTopVer=0], crd=false, evt=NODE_LEFT, evtNode=00e0e9f0-ad4e-4057-8861-d6fd939f1000, customEvt=null, allowMerge=false, exchangeFreeSwitch=true] [21:04:44] : [Step 4/5] [2021-11-19 21:04:44,138][INFO ][exchange-worker-#8478%grid-6%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=6, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=6, minorTopVer=0], err=null, rebalanced=true, wasRebalanced=true] [21:04:44] : [Step 4/5] [2021-11-19 21:04:44,138][INFO ][sys-#8728%grid-7%][GridAffinityAssignmentCache] Local node affinity assignment distribution is not ideal [cache=encrypted, expectedPrimary=1024.00, actualPrimary=0, expectedBackups=0.00, actualBackups=0, warningThreshold=50.00%] [21:04:44] : [Step 4/5] [2021-11-19 21:04:44,139][INFO ][exchange-worker-#8742%grid-7%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=6, minorTopVer=0], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:04:44] : [Step 4/5] [2021-11-19 21:04:44,141][INFO ][exchange-worker-#8742%grid-7%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=6, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=6, minorTopVer=0], err=null, rebalanced=true, wasRebalanced=true] [21:04:44]W: [org.apache.ignite:ignite-core] [2021-11-19 21:04:44,140][WARN ][exchange-worker-#8478%grid-6%][GridDhtPartitionTopologyImpl] Detected lost partitions [grp=encrypted, parts=[0-2, 4-8, 12-13, 17-18, 20, 24, 27, 31, 35-38, 41-43, 45-46, 48, 51, 53, 55, 57-58, 61, 63, 65, 70-73, 77, 80, 82-83, 88-89, 93, 95, 100, 103, 108-115, 119, 123-131, 133, 136-137, 142, 148, 152-153, 157-161, 163, 167-170, 178-184, 186, 188-190, 192-195, 200-201, 203-204, 207, 212, 215-218, 223, 225-228, 230, 232-234, 236, 238, 244, 246-247, 250-255, 257-260, 262-265, 267-268, 270, 274-275, 278, 281-282, 286, 288, 293, 296, 298, 300-301, 305, 307, 309, 313-315, 321, 323-324, 329, 331-338, 342-344, 347, 349-352, 354, 356, 362-364, 368-371, 375-376, 379-384, 389, 391, 393-395, 398-400, 403-404, 406-407, 409, 411-415, 417-418, 423, 427-432, 434, 436, 439, 444, 446-448, 451, 453, 457-460, 462, 464, 466, 469, 471-479, 481-484, 486-487, 489, 491, 493-494, 496, 498, 501, 504, 508, 511, 514, 517, 519-523, 526-528, 533-534, 536-537, 539-540, 542-545, 548, 550, 553-557, 560-561, 565-567, 570-571, 574, 576-578, 580, 582-583, 586, 590, 592-593, 595, 597-599, 601, 606, 610, 616-617, 620-626, 630-632, 634-635, 638, 641, 643, 645, 648-650, 653-655, 662-663, 666-667, 674-678, 680-681, 685, 687-691, 696-697, 699-702, 708, 710-711, 714-715, 718-720, 724, 726, 729, 731, 734, 736, 740-741, 743-744, 747-748, 753-757, 759, 761, 765-767, 769, 771-772, 774, 777, 779-781, 788, 791, 794-795, 797, 802, 804, 806-807, 810, 812, 814-816, 818-819, 821, 826-827, 830-831, 834-835, 837-838, 840-847, 852-853, 855-856, 859, 861-862, 864, 868-869, 873-877, 881-883, 885, 887-895, 897-898, 900-903, 907, 910-913, 916, 918-919, 921-924, 927, 929-930, 934-935, 938, 940, 943, 946, 949, 953, 955-966, 971, 974, 980, 982, 989, 991-992, 997-1000, 1002, 1006, 1008-1010, 1012, 1014-1015, 1017, 1019-1020, 1023], topVer=AffinityTopologyVersion [topVer=6, minorTopVer=0]] [21:04:44] : [Step 4/5] [2021-11-19 21:04:44,147][INFO ][exchange-worker-#8478%grid-6%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=60dac6e8-23c9-4d3f-a60f-788efce74006, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=6, minorTopVer=0], evt=NODE_LEFT, evtNode=TcpDiscoveryNode [id=00e0e9f0-ad4e-4057-8861-d6fd939f1000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345074555, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=6, minorTopVer=0]] [21:04:44] : [Step 4/5] [2021-11-19 21:04:44,153][INFO ][exchange-worker-#8478%grid-6%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=6, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=6, minorTopVer=0], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (0 ms), stage="Determine exchange type" (1 ms), stage="Preloading notification" (0 ms), stage="After states restored callback" (0 ms), stage="WAL history reservation" (0 ms), stage="Finalize update counters" (0 ms), stage="Detect lost partitions" (15 ms), stage="Exchange done" (9 ms), stage="Total time" (25 ms)] [21:04:44] : [Step 4/5] [2021-11-19 21:04:44,154][INFO ][exchange-worker-#8478%grid-6%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=6, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=6, minorTopVer=0], stage="Affinity initialization (exchange-free switch on fully-rebalanced topology) [grp=encrypted]" (1 ms) (parent=Determine exchange type), stage="Affinity initialization (exchange-free switch on fully-rebalanced topology) [grp=ignite-sys-cache]" (0 ms) (parent=Determine exchange type)] [21:04:44]W: [org.apache.ignite:ignite-core] [2021-11-19 21:04:44,147][WARN ][exchange-worker-#8742%grid-7%][GridDhtPartitionTopologyImpl] Detected lost partitions [grp=encrypted, parts=[0-2, 4-8, 12-13, 17-18, 20, 24, 27, 31, 35-38, 41-43, 45-46, 48, 51, 53, 55, 57-58, 61, 63, 65, 70-73, 77, 80, 82-83, 88-89, 93, 95, 100, 103, 108-115, 119, 123-131, 133, 136-137, 142, 148, 152-153, 157-161, 163, 167-170, 178-184, 186, 188-190, 192-195, 200-201, 203-204, 207, 212, 215-218, 223, 225-228, 230, 232-234, 236, 238, 244, 246-247, 250-255, 257-260, 262-265, 267-268, 270, 274-275, 278, 281-282, 286, 288, 293, 296, 298, 300-301, 305, 307, 309, 313-315, 321, 323-324, 329, 331-338, 342-344, 347, 349-352, 354, 356, 362-364, 368-371, 375-376, 379-384, 389, 391, 393-395, 398-400, 403-404, 406-407, 409, 411-415, 417-418, 423, 427-432, 434, 436, 439, 444, 446-448, 451, 453, 457-460, 462, 464, 466, 469, 471-479, 481-484, 486-487, 489, 491, 493-494, 496, 498, 501, 504, 508, 511, 514, 517, 519-523, 526-528, 533-534, 536-537, 539-540, 542-545, 548, 550, 553-557, 560-561, 565-567, 570-571, 574, 576-578, 580, 582-583, 586, 590, 592-593, 595, 597-599, 601, 606, 610, 616-617, 620-626, 630-632, 634-635, 638, 641, 643, 645, 648-650, 653-655, 662-663, 666-667, 674-678, 680-681, 685, 687-691, 696-697, 699-702, 708, 710-711, 714-715, 718-720, 724, 726, 729, 731, 734, 736, 740-741, 743-744, 747-748, 753-757, 759, 761, 765-767, 769, 771-772, 774, 777, 779-781, 788, 791, 794-795, 797, 802, 804, 806-807, 810, 812, 814-816, 818-819, 821, 826-827, 830-831, 834-835, 837-838, 840-847, 852-853, 855-856, 859, 861-862, 864, 868-869, 873-877, 881-883, 885, 887-895, 897-898, 900-903, 907, 910-913, 916, 918-919, 921-924, 927, 929-930, 934-935, 938, 940, 943, 946, 949, 953, 955-966, 971, 974, 980, 982, 989, 991-992, 997-1000, 1002, 1006, 1008-1010, 1012, 1014-1015, 1017, 1019-1020, 1023], topVer=AffinityTopologyVersion [topVer=6, minorTopVer=0]] [21:04:44] : [Step 4/5] [2021-11-19 21:04:44,152][INFO ][exchange-worker-#8742%grid-7%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=70ed39fc-3b18-49f7-94cf-a6d33dc4a007, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=6, minorTopVer=0], evt=NODE_LEFT, evtNode=TcpDiscoveryNode [id=00e0e9f0-ad4e-4057-8861-d6fd939f1000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345076886, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=6, minorTopVer=0]] [21:04:44] : [Step 4/5] [2021-11-19 21:04:44,155][INFO ][exchange-worker-#8478%grid-6%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=6, minorTopVer=0], crd=true] [21:04:44] : [Step 4/5] [2021-11-19 21:04:44,156][INFO ][exchange-worker-#8742%grid-7%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=6, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=6, minorTopVer=0], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (0 ms), stage="Determine exchange type" (10 ms), stage="Preloading notification" (0 ms), stage="After states restored callback" (0 ms), stage="WAL history reservation" (0 ms), stage="Finalize update counters" (0 ms), stage="Detect lost partitions" (11 ms), stage="Exchange done" (4 ms), stage="Total time" (25 ms)] [21:04:44] : [Step 4/5] [2021-11-19 21:04:44,158][INFO ][exchange-worker-#8478%grid-6%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=6, minorTopVer=0], force=false, evt=NODE_LEFT, node=00e0e9f0-ad4e-4057-8861-d6fd939f1000] [21:04:44] : [Step 4/5] [2021-11-19 21:04:44,158][INFO ][exchange-worker-#8742%grid-7%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=6, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=6, minorTopVer=0], stage="Affinity initialization (exchange-free switch on fully-rebalanced topology) [grp=encrypted]" (10 ms) (parent=Determine exchange type), stage="Affinity initialization (exchange-free switch on fully-rebalanced topology) [grp=ignite-sys-cache]" (0 ms) (parent=Determine exchange type)] [21:04:44] : [Step 4/5] [2021-11-19 21:04:44,159][INFO ][exchange-worker-#8742%grid-7%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=6, minorTopVer=0], crd=false] [21:04:44] : [Step 4/5] [2021-11-19 21:04:44,161][INFO ][exchange-worker-#8742%grid-7%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=6, minorTopVer=0], force=false, evt=NODE_LEFT, node=00e0e9f0-ad4e-4057-8861-d6fd939f1000] [21:04:44] : [Step 4/5] [2021-11-19 21:04:44,819][INFO ][main][FilePageStoreManager] Cleanup cache stores [total=4, left=0, cleanFiles=false] [21:04:44] : [Step 4/5] [2021-11-19 21:04:44,823][INFO ][main][GridDeploymentLocalStore] Removed undeployed class: GridDeployment [ts=1637345074932, depMode=SHARED, clsLdr=IsolatedClassLoader{roleName='test'}, clsLdrId=2342d593d71-00e0e9f0-ad4e-4057-8861-d6fd939f1000, userVer=0, loc=true, sampleClsName=org.apache.ignite.internal.processors.cache.distributed.dht.preloader.GridDhtPartitionMap, pendingUndeploy=false, undeployed=true, usage=0] [21:04:44] : [Step 4/5] [2021-11-19 21:04:44,840][INFO ][main][IgniteKernal%grid-0] [21:04:44] : [Step 4/5] [21:04:44] : [Step 4/5] >>> +------------------------------------------------------+ [21:04:44] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV stopped OK [21:04:44] : [Step 4/5] >>> +------------------------------------------------------+ [21:04:44] : [Step 4/5] >>> Ignite instance name: grid-0 [21:04:44] : [Step 4/5] >>> Grid uptime: 00:00:11.472 [21:04:44] : [Step 4/5] [21:04:44] : [Step 4/5] [21:04:44] : [Step 4/5] [2021-11-19 21:04:44,841][INFO ][main][root] >>> Stopping grid [name=grid-6, id=60dac6e8-23c9-4d3f-a60f-788efce74006] [21:04:44] : [Step 4/5] [2021-11-19 21:04:44,858][INFO ][db-checkpoint-thread-#8589%grid-6%][Checkpointer] Checkpoint started [checkpointId=f7281b16-0922-4778-93c2-983ec20dd0a9, startPtr=WALPointer [idx=0, fileOff=488282, len=11434], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=1ms, checkpointLockHoldTime=2ms, walCpRecordFsyncDuration=1ms, writeCheckpointEntryDuration=2ms, splitAndSortCpPagesDuration=1ms, pages=496, reason='timeout'] [21:04:44] : [Step 4/5] [2021-11-19 21:04:44,869][INFO ][tcp-disco-sock-reader-[70ed39fc 127.0.0.1:48627]-#446%grid-6%-#8788%grid-6%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:48627, rmtPort=48627, rmtNodeId=70ed39fc-3b18-49f7-94cf-a6d33dc4a007] [21:04:44]W: [org.apache.ignite:ignite-core] [2021-11-19 21:04:44,871][WARN ][tcp-disco-sock-reader-[00e0e9f0 127.0.0.1:37243]-#427%grid-6%-#8474%grid-6%][TestTcpDiscoverySpi] Failed to shutdown socket [21:04:44]W: [org.apache.ignite:ignite-core] java.net.SocketException: Socket is closed [21:04:44]W: [org.apache.ignite:ignite-core] at java.net.Socket.shutdownOutput(Socket.java:1568) [21:04:44]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.close(IgniteUtils.java:4247) [21:04:44] : [Step 4/5] [2021-11-19 21:04:44,873][INFO ][tcp-disco-sock-reader-[00e0e9f0 127.0.0.1:37243]-#427%grid-6%-#8474%grid-6%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:37243, rmtPort=37243, rmtNodeId=00e0e9f0-ad4e-4057-8861-d6fd939f1000] [21:04:44]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.discovery.tcp.ServerImpl$SocketReader.body(ServerImpl.java:7370) [21:04:44]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.IgniteSpiThread.run(IgniteSpiThread.java:58) [21:04:44] : [Step 4/5] [2021-11-19 21:04:44,877][INFO ][disco-event-worker-#8741%grid-7%][GridDiscoveryManager] Node left topology: TcpDiscoveryNode [id=60dac6e8-23c9-4d3f-a60f-788efce74006, consistentId=grid-6, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637345076886, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false] [21:04:44] : [Step 4/5] [2021-11-19 21:04:44,877][INFO ][main][GridCacheProcessor] Stopped cache [cacheName=ignite-sys-cache] [21:04:44] : [Step 4/5] [2021-11-19 21:04:44,879][INFO ][main][GridCacheProcessor] Stopped cache [cacheName=encrypted] [21:04:44] : [Step 4/5] [2021-11-19 21:04:44,879][INFO ][disco-event-worker-#8741%grid-7%][GridDiscoveryManager] Topology snapshot [ver=7, locNode=70ed39fc, servers=1, clients=0, state=ACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=70ed39fc-3b18-49f7-94cf-a6d33dc4a007, consistentId=grid-7, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:04:44] : [Step 4/5] [2021-11-19 21:04:44,880][INFO ][disco-event-worker-#8741%grid-7%][GridDiscoveryManager] Coordinator changed [prev=TcpDiscoveryNode [id=60dac6e8-23c9-4d3f-a60f-788efce74006, consistentId=grid-6, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637345076886, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], cur=TcpDiscoveryNode [id=70ed39fc-3b18-49f7-94cf-a6d33dc4a007, consistentId=grid-7, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47502], discPort=47502, order=4, intOrder=4, lastExchangeTime=1637345084865, loc=true, ver=2.13.0#20211119-sha1:00000000, isClient=false]] [21:04:44] : [Step 4/5] [2021-11-19 21:04:44,882][INFO ][disco-event-worker-#8741%grid-7%][GridDiscoveryManager] ^-- Baseline [id=0, size=2, online=0, offline=2] [21:04:44] : [Step 4/5] [2021-11-19 21:04:44,883][INFO ][disco-event-worker-#8741%grid-7%][MvccProcessorImpl] Assigned mvcc coordinator [crd=MvccCoordinator [topVer=AffinityTopologyVersion [topVer=7, minorTopVer=0], nodeId=70ed39fc-3b18-49f7-94cf-a6d33dc4a007, ver=1637345073346, local=true, initialized=false]] [21:04:44] : [Step 4/5] [2021-11-19 21:04:44,885][INFO ][exchange-worker-#8742%grid-7%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=7, minorTopVer=0], crd=true, evt=NODE_LEFT, evtNode=60dac6e8-23c9-4d3f-a60f-788efce74006, customEvt=null, allowMerge=false, exchangeFreeSwitch=true] [21:04:44] : [Step 4/5] [2021-11-19 21:04:44,885][INFO ][sys-#8714%grid-7%][ExchangeLatchManager] Become new coordinator 70ed39fc-3b18-49f7-94cf-a6d33dc4a007 [21:04:44]W: [org.apache.ignite:ignite-core] [2021-11-19 21:04:44,886][WARN ][exchange-worker-#8742%grid-7%][ExchangeDiscoveryEvents] All server nodes for the following caches have left the cluster: 'ignite-sys-cache', 'encrypted' [21:04:44]W: [org.apache.ignite:ignite-core] [2021-11-19 21:04:44,887][WARN ][exchange-worker-#8742%grid-7%][ExchangeDiscoveryEvents] Must have server nodes for caches to operate. [21:04:44] : [Step 4/5] [2021-11-19 21:04:44,887][INFO ][exchange-worker-#8742%grid-7%][GridAffinityAssignmentCache] Local node affinity assignment distribution is not ideal [cache=encrypted, expectedPrimary=Infinity, actualPrimary=0, expectedBackups=NaN, actualBackups=0, warningThreshold=50.00%] [21:04:44] : [Step 4/5] [2021-11-19 21:04:44,892][INFO ][exchange-worker-#8742%grid-7%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=7, minorTopVer=0], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:04:44] : [Step 4/5] [2021-11-19 21:04:44,900][INFO ][exchange-worker-#8742%grid-7%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=7, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=7, minorTopVer=0], err=null, rebalanced=true, wasRebalanced=true] [21:04:44]W: [org.apache.ignite:ignite-core] [2021-11-19 21:04:44,901][WARN ][sys-#8726%grid-7%][GridDhtPartitionTopologyImpl] Detected lost partitions [grp=ignite-sys-cache, parts=[0-99], topVer=AffinityTopologyVersion [topVer=7, minorTopVer=0]] [21:04:44]W: [org.apache.ignite:ignite-core] [2021-11-19 21:04:44,902][WARN ][exchange-worker-#8742%grid-7%][GridDhtPartitionTopologyImpl] Detected lost partitions [grp=encrypted, parts=[3, 9-11, 14-16, 19, 21-23, 25-26, 28-30, 32-34, 39-40, 44, 47, 49-50, 52, 54, 56, 59-60, 62, 64, 66-69, 74-76, 78-79, 81, 84-87, 90-92, 94, 96-99, 101-102, 104-107, 116-118, 120-122, 132, 134-135, 138-141, 143-147, 149-151, 154-156, 162, 164-166, 171-177, 185, 187, 191, 196-199, 202, 205-206, 208-211, 213-214, 219-222, 224, 229, 231, 235, 237, 239-243, 245, 248-249, 256, 261, 266, 269, 271-273, 276-277, 279-280, 283-285, 287, 289-292, 294-295, 297, 299, 302-304, 306, 308, 310-312, 316-320, 322, 325-328, 330, 339-341, 345-346, 348, 353, 355, 357-361, 365-367, 372-374, 377-378, 385-388, 390, 392, 396-397, 401-402, 405, 408, 410, 416, 419-422, 424-426, 433, 435, 437-438, 440-443, 445, 449-450, 452, 454-456, 461, 463, 465, 467-468, 470, 480, 485, 488, 490, 492, 495, 497, 499-500, 502-503, 505-507, 509-510, 512-513, 515-516, 518, 524-525, 529-532, 535, 538, 541, 546-547, 549, 551-552, 558-559, 562-564, 568-569, 572-573, 575, 579, 581, 584-585, 587-589, 591, 594, 596, 600, 602-605, 607-609, 611-615, 618-619, 627-629, 633, 636-637, 639-640, 642, 644, 646-647, 651-652, 656-661, 664-665, 668-673, 679, 682-684, 686, 692-695, 698, 703-707, 709, 712-713, 716-717, 721-723, 725, 727-728, 730, 732-733, 735, 737-739, 742, 745-746, 749-752, 758, 760, 762-764, 768, 770, 773, 775-776, 778, 782-787, 789-790, 792-793, 796, 798-801, 803, 805, 808-809, 811, 813, 817, 820, 822-825, 828-829, 832-833, 836, 839, 848-851, 854, 857-858, 860, 863, 865-867, 870-872, 878-880, 884, 886, 896, 899, 904-906, 908-909, 914-915, 917, 920, 925-926, 928, 931-933, 936-937, 939, 941-942, 944-945, 947-948, 950-952, 954, 967-970, 972-973, 975-979, 981, 983-988, 990, 993-996, 1001, 1003-1005, 1007, 1011, 1013, 1016, 1018, 1021-1022], topVer=AffinityTopologyVersion [topVer=7, minorTopVer=0]] [21:04:44] : [Step 4/5] [2021-11-19 21:04:44,905][INFO ][exchange-worker-#8742%grid-7%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=70ed39fc-3b18-49f7-94cf-a6d33dc4a007, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=7, minorTopVer=0], evt=NODE_LEFT, evtNode=TcpDiscoveryNode [id=60dac6e8-23c9-4d3f-a60f-788efce74006, consistentId=grid-6, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637345076886, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=7, minorTopVer=0]] [21:04:44] : [Step 4/5] [2021-11-19 21:04:44,906][INFO ][exchange-worker-#8742%grid-7%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=7, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=7, minorTopVer=0], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (0 ms), stage="Determine exchange type" (6 ms), stage="Preloading notification" (0 ms), stage="After states restored callback" (5 ms), stage="WAL history reservation" (0 ms), stage="Finalize update counters" (0 ms), stage="Detect lost partitions" (5 ms), stage="Exchange done" (1 ms), stage="Total time" (17 ms)] [21:04:44] : [Step 4/5] [2021-11-19 21:04:44,908][INFO ][exchange-worker-#8742%grid-7%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=7, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=7, minorTopVer=0], stage="Affinity initialization (exchange-free switch on fully-rebalanced topology) [grp=ignite-sys-cache]" (6 ms) (parent=Determine exchange type), stage="Affinity initialization (exchange-free switch on fully-rebalanced topology) [grp=encrypted]" (5 ms) (parent=Determine exchange type)] [21:04:44] : [Step 4/5] [2021-11-19 21:04:44,909][INFO ][exchange-worker-#8742%grid-7%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=7, minorTopVer=0], crd=true] [21:04:44] : [Step 4/5] [2021-11-19 21:04:44,910][INFO ][exchange-worker-#8742%grid-7%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=7, minorTopVer=0], force=false, evt=NODE_LEFT, node=60dac6e8-23c9-4d3f-a60f-788efce74006] [21:04:45] : [Step 4/5] [2021-11-19 21:04:45,352][INFO ][main][FilePageStoreManager] Cleanup cache stores [total=4, left=0, cleanFiles=false] [21:04:45] : [Step 4/5] [2021-11-19 21:04:45,355][INFO ][main][GridDeploymentLocalStore] Removed undeployed class: GridDeployment [ts=1637345074953, depMode=SHARED, clsLdr=IsolatedClassLoader{roleName='test'}, clsLdrId=4342d593d71-60dac6e8-23c9-4d3f-a60f-788efce74006, userVer=0, loc=true, sampleClsName=org.apache.ignite.internal.processors.cache.distributed.dht.preloader.GridDhtPartitionFullMap, pendingUndeploy=false, undeployed=true, usage=0] [21:04:45] : [Step 4/5] [2021-11-19 21:04:45,367][INFO ][main][IgniteKernal%grid-6] [21:04:45] : [Step 4/5] [21:04:45] : [Step 4/5] >>> +------------------------------------------------------+ [21:04:45] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV stopped OK [21:04:45] : [Step 4/5] >>> +------------------------------------------------------+ [21:04:45] : [Step 4/5] >>> Ignite instance name: grid-6 [21:04:45] : [Step 4/5] >>> Grid uptime: 00:00:10.741 [21:04:45] : [Step 4/5] [21:04:45] : [Step 4/5] [21:04:45] : [Step 4/5] [2021-11-19 21:04:45,369][INFO ][main][root] >>> Stopping grid [name=grid-7, id=70ed39fc-3b18-49f7-94cf-a6d33dc4a007] [21:04:45] : [Step 4/5] [2021-11-19 21:04:45,377][INFO ][db-checkpoint-thread-#8750%grid-7%][Checkpointer] Skipping checkpoint (no pages were modified) [checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=1ms, reason='timeout'] [21:04:45] : [Step 4/5] [2021-11-19 21:04:45,383][INFO ][tcp-disco-sock-reader-[60dac6e8 127.0.0.1:46511]-#443%grid-7%-#8734%grid-7%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:46511, rmtPort=46511, rmtNodeId=60dac6e8-23c9-4d3f-a60f-788efce74006] [21:04:45] : [Step 4/5] [2021-11-19 21:04:45,386][INFO ][main][GridCacheProcessor] Stopped cache [cacheName=encrypted] [21:04:45] : [Step 4/5] [2021-11-19 21:04:45,394][INFO ][main][GridCacheProcessor] Stopped cache [cacheName=ignite-sys-cache] [21:04:45] : [Step 4/5] [2021-11-19 21:04:45,397][INFO ][main][FilePageStoreManager] Cleanup cache stores [total=4, left=0, cleanFiles=false] [21:04:45] : [Step 4/5] [2021-11-19 21:04:45,400][INFO ][main][GridDeploymentLocalStore] Removed undeployed class: GridDeployment [ts=1637345077676, depMode=SHARED, clsLdr=IsolatedClassLoader{roleName='test'}, clsLdrId=a152d593d71-70ed39fc-3b18-49f7-94cf-a6d33dc4a007, userVer=0, loc=true, sampleClsName=org.apache.ignite.internal.processors.cache.distributed.dht.preloader.IgniteDhtPartitionHistorySuppliersMap, pendingUndeploy=false, undeployed=true, usage=0] [21:04:45] : [Step 4/5] [2021-11-19 21:04:45,425][INFO ][main][IgniteKernal%grid-7] [21:04:45] : [Step 4/5] [21:04:45] : [Step 4/5] >>> +------------------------------------------------------+ [21:04:45] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV stopped OK [21:04:45] : [Step 4/5] >>> +------------------------------------------------------+ [21:04:45] : [Step 4/5] >>> Ignite instance name: grid-7 [21:04:45] : [Step 4/5] >>> Grid uptime: 00:00:07.720 [21:04:45] : [Step 4/5] [21:04:45] : [Step 4/5] [21:04:45] : [Step 4/5] [21:04:45] >>> Starting test: EncryptedCacheNodeJoinTest#testClientNodeJoinActiveClusterWithNewStaticCacheConfig <<< [21:04:45] : [Step 4/5] [2021-11-19 21:04:45,893][INFO ][main][root] >>> Starting test: EncryptedCacheNodeJoinTest#testClientNodeJoinActiveClusterWithNewStaticCacheConfig <<< [21:04:45] : [Step 4/5] [21:04:45] >>> Heap: 320 MB used / 1912 MB commited / 1912 MB max <<< [21:04:45] : [Step 4/5] [2021-11-19 21:04:45,894][INFO ][main][root] >>> Heap: 320 MB used / 1912 MB commited / 1912 MB max <<< [21:04:45] : [Step 4/5] [21:04:45] >>> Non-Heap: 139 MB used / 154 MB commited / 0 MB max <<< [21:04:45] : [Step 4/5] [2021-11-19 21:04:45,894][INFO ][main][root] >>> Non-Heap: 139 MB used / 154 MB commited / 0 MB max <<< [21:04:45]W: [org.apache.ignite:ignite-core] [2021-11-19 21:04:45,900][WARN ][test-runner-#8795%encryption.EncryptedCacheNodeJoinTest%][G] Ignite work directory is not provided, automatically resolved to: /opt/buildagent/work/7bc1c54bc719b67c/work [21:04:45] : [Step 4/5] [2021-11-19 21:04:45,902][INFO ][test-runner-#8795%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] [21:04:45] : [Step 4/5] [21:04:45] : [Step 4/5] >>> __________ ________________ [21:04:45] : [Step 4/5] >>> / _/ ___/ |/ / _/_ __/ __/ [21:04:45] : [Step 4/5] >>> _/ // (7 7 // / / / / _/ [21:04:45] : [Step 4/5] >>> /___/\___/_/|_/___/ /_/ /___/ [21:04:45] : [Step 4/5] >>> [21:04:45] : [Step 4/5] >>> ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:04:45] : [Step 4/5] >>> 2021 Copyright(C) Apache Software Foundation [21:04:45] : [Step 4/5] >>> [21:04:45] : [Step 4/5] >>> Ignite documentation: http://ignite.apache.org [21:04:45] : [Step 4/5] [21:04:45] : [Step 4/5] [2021-11-19 21:04:45,903][INFO ][test-runner-#8795%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] Config URL: n/a [21:04:45] : [Step 4/5] [2021-11-19 21:04:45,903][INFO ][test-runner-#8795%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] IgniteConfiguration [igniteInstanceName=grid-0, pubPoolSize=24, svcPoolSize=24, callbackPoolSize=24, stripedPoolSize=24, sysPoolSize=24, mgmtPoolSize=4, dataStreamerPoolSize=24, utilityCachePoolSize=24, utilityCacheKeepAliveTime=60000, p2pPoolSize=2, qryPoolSize=24, buildIdxPoolSize=4, igniteHome=/opt/buildagent/work/7bc1c54bc719b67c, igniteWorkDir=/opt/buildagent/work/7bc1c54bc719b67c/work, mbeanSrv=com.sun.jmx.mbeanserver.JmxMBeanServer@6fe85038, nodeId=002ddf6e-3774-4bb8-9600-3815e7487000, marsh=BinaryMarshaller [], marshLocJobs=false, daemon=false, p2pEnabled=true, netTimeout=10000, netCompressionLevel=1, sndRetryDelay=1000, sndRetryCnt=3, metricsHistSize=10000, metricsUpdateFreq=1000, metricsExpTime=9223372036854775807, discoSpi=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=0, ackTimeout=0, marsh=null, reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], segPlc=STOP, segResolveAttempts=2, waitForSegOnStart=true, allResolversPassReq=true, segChkFreq=10000, commSpi=TcpCommunicationSpi [connectGate=org.apache.ignite.spi.communication.tcp.internal.ConnectGateway@25f7b1a3, ctxInitLatch=java.util.concurrent.CountDownLatch@96e1eb8[Count = 1], stopping=false, clientPool=null, nioSrvWrapper=null, stateProvider=null], evtSpi=MemoryEventStorageSpi [expireAgeMs=9223372036854775807, expireCnt=10000, filter=null], colSpi=NoopCollisionSpi [], deploySpi=LocalDeploymentSpi [], indexingSpi=org.apache.ignite.spi.indexing.noop.NoopIndexingSpi@3e14baf3, addrRslvr=null, encryptionSpi=org.apache.ignite.spi.encryption.keystore.KeystoreEncryptionSpi@5bf20eb2, tracingSpi=org.apache.ignite.spi.tracing.NoopTracingSpi@25e45ae8, clientMode=false, rebalanceThreadPoolSize=4, rebalanceTimeout=10000, rebalanceBatchesPrefetchCnt=3, rebalanceThrottle=0, rebalanceBatchSize=524288, txCfg=TransactionConfiguration [txSerEnabled=false, dfltIsolation=REPEATABLE_READ, dfltConcurrency=PESSIMISTIC, dfltTxTimeout=0, txTimeoutOnPartitionMapExchange=0, deadlockTimeout=10000, pessimisticTxLogSize=0, pessimisticTxLogLinger=10000, tmLookupClsName=null, txManagerFactory=null, useJtaSync=false], cacheSanityCheckEnabled=true, discoStartupDelay=60000, deployMode=SHARED, p2pMissedCacheSize=100, locHost=127.0.0.1, timeSrvPortBase=31100, timeSrvPortRange=100, failureDetectionTimeout=10000, sysWorkerBlockedTimeout=null, clientFailureDetectionTimeout=10000, metricsLogFreq=0, connectorCfg=null, odbcCfg=null, warmupClos=null, atomicCfg=AtomicConfiguration [seqReserveSize=1000, cacheMode=PARTITIONED, backups=1, aff=null, grpName=null], classLdr=null, sslCtxFactory=null, platformCfg=null, binaryCfg=null, memCfg=null, pstCfg=null, dsCfg=DataStorageConfiguration [sysRegionInitSize=41943040, sysRegionMaxSize=104857600, pageSize=4096, concLvl=0, dfltDataRegConf=DataRegionConfiguration [name=default, maxSize=10485760, initSize=268435456, swapPath=null, pageEvictionMode=DISABLED, pageReplacementMode=CLOCK, evictionThreshold=0.9, emptyPagesPoolSize=100, metricsEnabled=false, metricsSubIntervalCount=5, metricsRateTimeInterval=60000, persistenceEnabled=true, checkpointPageBufSize=0, lazyMemoryAllocation=true, warmUpCfg=null], dataRegions=null, storagePath=null, checkpointFreq=180000, lockWaitTime=10000, checkpointThreads=4, checkpointWriteOrder=SEQUENTIAL, walHistSize=20, maxWalArchiveSize=1073741824, walSegments=10, walSegmentSize=67108864, walPath=db/wal, walArchivePath=db/wal/archive, cdcWalPath=db/wal/cdc, cdcEnabled=false, metricsEnabled=false, walMode=FSYNC, walTlbSize=131072, walBuffSize=0, walFlushFreq=2000, walFsyncDelay=1000, walRecordIterBuffSize=67108864, alwaysWriteFullPages=false, fileIOFactory=org.apache.ignite.internal.processors.cache.persistence.file.AsyncFileIOFactory@31bc5cad, metricsSubIntervalCnt=5, metricsRateTimeInterval=60000, walAutoArchiveAfterInactivity=-1, walForceArchiveTimeout=-1, writeThrottlingEnabled=false, walCompactionEnabled=false, walCompactionLevel=1, checkpointReadLockTimeout=null, walPageCompression=DISABLED, walPageCompressionLevel=null, dfltWarmUpCfg=null, encCfg=org.apache.ignite.configuration.EncryptionConfiguration@787e4741, defragmentationThreadPoolSize=4, minWalArchiveSize=-1], snapshotPath=snapshots, activeOnStart=true, activeOnStartPropSetFlag=false, autoActivation=true, autoActivationPropSetFlag=false, clusterStateOnStart=null, sqlConnCfg=null, cliConnCfg=ClientConnectorConfiguration [host=null, port=10800, portRange=100, sockSndBufSize=0, sockRcvBufSize=0, tcpNoDelay=true, maxOpenCursorsPerConn=128, threadPoolSize=24, selectorCnt=12, idleTimeout=0, handshakeTimeout=10000, jdbcEnabled=true, odbcEnabled=true, thinCliEnabled=true, sslEnabled=false, useIgniteSslCtxFactory=true, sslClientAuth=false, sslCtxFactory=null, thinCliCfg=ThinClientConfiguration [maxActiveTxPerConn=100, maxActiveComputeTasksPerConn=0]], mvccVacuumThreadCnt=2, mvccVacuumFreq=5000, authEnabled=false, failureHnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]], commFailureRslvr=null, sqlCfg=SqlConfiguration [longQryWarnTimeout=3000, dfltQryTimeout=0, sqlQryHistSize=1000, validationEnabled=false], asyncContinuationExecutor=null] [21:04:45] : [Step 4/5] [2021-11-19 21:04:45,912][INFO ][test-runner-#8795%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] Daemon mode: off [21:04:45] : [Step 4/5] [2021-11-19 21:04:45,912][INFO ][test-runner-#8795%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] OS: Linux 4.15.0-151-generic amd64 [21:04:45] : [Step 4/5] [2021-11-19 21:04:45,912][INFO ][test-runner-#8795%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] OS user: teamcity [21:04:45] : [Step 4/5] [2021-11-19 21:04:45,913][INFO ][test-runner-#8795%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] PID: 16724 [21:04:45] : [Step 4/5] [2021-11-19 21:04:45,913][INFO ][test-runner-#8795%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] Language runtime: Java Platform API Specification ver. 1.8 [21:04:45] : [Step 4/5] [2021-11-19 21:04:45,914][INFO ][test-runner-#8795%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] VM information: Java(TM) SE Runtime Environment 1.8.0_261-b12 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 25.261-b12 [21:04:45] : [Step 4/5] [2021-11-19 21:04:45,914][INFO ][test-runner-#8795%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] VM total memory: 1.9GB [21:04:45] : [Step 4/5] [2021-11-19 21:04:45,914][INFO ][test-runner-#8795%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] Remote Management [restart: off, REST: off, JMX (remote: off)] [21:04:45] : [Step 4/5] [2021-11-19 21:04:45,915][INFO ][test-runner-#8795%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] Logger: GridTestLog4jLogger [quiet=false, config=null] [21:04:45] : [Step 4/5] [2021-11-19 21:04:45,915][INFO ][test-runner-#8795%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] IGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c [21:04:45] : [Step 4/5] [2021-11-19 21:04:45,915][INFO ][test-runner-#8795%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] VM arguments: [-DIGNITE_DUMP_THREADS_ON_FAILURE=false, -DMono=/usr/bin/mono-sgen, -DMono4.0_x64=/usr/lib/mono/4.0, -DMono4.5_x64=/usr/lib/mono/4.5, -DMonoVersion=6.12.0.90, -DSKIP_BUILD=false, -Dagent.home.dir=/opt/buildagent, -Dagent.name=aitc-lin02_03, -Dagent.ownPort=9090, -Dagent.work.dir=/opt/buildagent/work, -Dbuild.number=95, -Dbuild.vcs.number=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.1=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.GitHubApacheIgnite=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dclassworlds.conf=/opt/buildagent/temp/buildTmp/teamcity.m2.conf, -Dcom.jetbrains.maven.watcher.report.file=/opt/buildagent/temp/buildTmp/maven-build-info.xml, -Djava.io.tmpdir=/opt/buildagent/temp/buildTmp, -Dmaven.home=/opt/buildagent/tools/maven3_6, -Dmaven.multiModuleProjectDirectory=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.agent.cpuBenchmark=457, -Dteamcity.agent.dotnet.agent_url=http://localhost:9090/RPC2, -Dteamcity.agent.dotnet.build_id=6278078, -Dteamcity.auth.password=*******, -Dteamcity.auth.userId=TeamCityBuildId=6278078, -Dteamcity.build.changedFiles.file=/opt/buildagent/temp/buildTmp/changedFiles6342607772318147725.txt, -Dteamcity.build.checkoutDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.build.id=6278078, -Dteamcity.build.properties.file=/opt/buildagent/temp/buildTmp/teamcity.build5164517880467851002.properties, -Dteamcity.build.tempDir=/opt/buildagent/temp/buildTmp, -Dteamcity.build.workingDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.buildConfName=Basic 3, -Dteamcity.buildType.id=IgniteTests24Java8_Basic3, -Dteamcity.configuration.properties.file=/opt/buildagent/temp/buildTmp/teamcity.config5591980786735343870.properties, -Dteamcity.maven.userSettings.path=/opt/buildagent/temp/buildTmp/maven_settings_585072866407032347.xml, -Dteamcity.maven.watcher.home=/opt/buildagent/plugins/mavenPlugin/maven-watcher-jdk16, -Dteamcity.projectName=Ignite Tests 2.x (JDK 8/11), -Dteamcity.runner.properties.file=/opt/buildagent/temp/buildTmp/teamcity.runner9098465561618137420.properties, -Dteamcity.tests.recentlyFailedTests.file=/opt/buildagent/temp/buildTmp/testsToRunFirst3891775683130404069.txt, -Dteamcity.version=2021.2 (build 99542), -ea, -Xms2g, -Xmx2g, -XX:+HeapDumpOnOutOfMemoryError, -DIGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_TEST_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_UPDATE_NOTIFIER=false, -DIGNITE_NO_DISCO_ORDER=true, -DIGNITE_PERFORMANCE_SUGGESTIONS_DISABLED=true, -Djava.net.preferIPv4Stack=true, -DTEST_SCALE_FACTOR=1.0, -DIGNITE_TEST_PROP_LOG4J_FILE=log4j-tc-test.xml, -DIGNITE_QUIET=false, -DIGNITE_MARSHAL_BUFFERS_RECHECK=1000, -Dmaven.repo.local=/opt/buildagent/.m2/repository] [21:04:45] : [Step 4/5] [2021-11-19 21:04:45,920][INFO ][test-runner-#8795%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] System cache's DataRegion size is configured to 40 MB. Use DataStorageConfiguration.systemRegionInitialSize property to change the setting. [21:04:45] : [Step 4/5] [2021-11-19 21:04:45,920][INFO ][test-runner-#8795%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] Configured caches [in 'sysMemPlc' dataRegion: ['ignite-sys-cache']] [21:04:45]W: [org.apache.ignite:ignite-core] [2021-11-19 21:04:45,921][WARN ][test-runner-#8795%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] Peer class loading is enabled (disable it in production for performance and deployment consistency reasons) [21:04:45] : [Step 4/5] [2021-11-19 21:04:45,921][INFO ][test-runner-#8795%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] 3-rd party licenses can be found at: /opt/buildagent/work/7bc1c54bc719b67c/libs/licenses [21:04:45] : [Step 4/5] [2021-11-19 21:04:45,926][INFO ][test-runner-#8795%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] Configured plugins: [21:04:45] : [Step 4/5] [2021-11-19 21:04:45,927][INFO ][test-runner-#8795%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- StanByClusterTestProvider 1.0 [21:04:45] : [Step 4/5] [2021-11-19 21:04:45,927][INFO ][test-runner-#8795%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- null [21:04:45] : [Step 4/5] [2021-11-19 21:04:45,927][INFO ][test-runner-#8795%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] [21:04:45] : [Step 4/5] [2021-11-19 21:04:45,927][INFO ][test-runner-#8795%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- PageMemory tracker plugin 1.0 [21:04:45] : [Step 4/5] [2021-11-19 21:04:45,927][INFO ][test-runner-#8795%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- null [21:04:45] : [Step 4/5] [2021-11-19 21:04:45,928][INFO ][test-runner-#8795%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] [21:04:45] : [Step 4/5] [2021-11-19 21:04:45,928][INFO ][test-runner-#8795%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- TestDistibutedConfigurationPlugin 1.0 [21:04:45] : [Step 4/5] [2021-11-19 21:04:45,928][INFO ][test-runner-#8795%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- null [21:04:45] : [Step 4/5] [2021-11-19 21:04:45,928][INFO ][test-runner-#8795%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] [21:04:45] : [Step 4/5] [2021-11-19 21:04:45,929][INFO ][test-runner-#8795%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- NodeValidationPluginProvider 1.0 [21:04:45] : [Step 4/5] [2021-11-19 21:04:45,929][INFO ][test-runner-#8795%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- null [21:04:45] : [Step 4/5] [2021-11-19 21:04:45,929][INFO ][test-runner-#8795%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] [21:04:45] : [Step 4/5] [2021-11-19 21:04:45,929][INFO ][test-runner-#8795%encryption.EncryptedCacheNodeJoinTest%][FailureProcessor] Configured failure handler: [hnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]]] [21:04:45] : [Step 4/5] [2021-11-19 21:04:45,951][INFO ][test-runner-#8795%encryption.EncryptedCacheNodeJoinTest%][TcpCommunicationSpi] Successfully bound communication NIO server to TCP port [port=45150, locHost=/127.0.0.1, selectorsCnt=12, selectorSpins=0, pairedConn=false] [21:04:45]W: [org.apache.ignite:ignite-core] [2021-11-19 21:04:45,951][WARN ][test-runner-#8795%encryption.EncryptedCacheNodeJoinTest%][TcpCommunicationSpi] Message queue limit is set to 0 which may lead to potential OOMEs when running cache operations in FULL_ASYNC or PRIMARY_SYNC modes due to message queues growth on sender and receiver sides. [21:04:45] : [Step 4/5] [2021-11-19 21:04:45,957][INFO ][test-runner-#8795%encryption.EncryptedCacheNodeJoinTest%][GridCollisionManager] Collision resolution is disabled (all jobs will be activated upon arrival). [21:04:45] : [Step 4/5] [2021-11-19 21:04:45,957][INFO ][test-runner-#8795%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] Security status [authentication=off, sandbox=off, tls/ssl=off] [21:04:46] : [Step 4/5] [2021-11-19 21:04:46,019][INFO ][test-runner-#8795%encryption.EncryptedCacheNodeJoinTest%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:04:46] : [Step 4/5] [2021-11-19 21:04:46,112][INFO ][test-runner-#8795%encryption.EncryptedCacheNodeJoinTest%][MaintenanceProcessor] Resolved store directory for node persistent data: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0 [21:04:46] : [Step 4/5] [2021-11-19 21:04:46,114][INFO ][test-runner-#8795%encryption.EncryptedCacheNodeJoinTest%][CacheObjectBinaryProcessorImpl] Resolved directory for serialized binary metadata: /opt/buildagent/work/7bc1c54bc719b67c/work/db/binary_meta/grid_0 [21:04:46] : [Step 4/5] [2021-11-19 21:04:46,120][INFO ][test-runner-#8795%encryption.EncryptedCacheNodeJoinTest%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0 [21:04:46] : [Step 4/5] [2021-11-19 21:04:46,121][INFO ][test-runner-#8795%encryption.EncryptedCacheNodeJoinTest%][FileWriteAheadLogManager] Resolved write ahead log work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0 [21:04:46] : [Step 4/5] [2021-11-19 21:04:46,121][INFO ][test-runner-#8795%encryption.EncryptedCacheNodeJoinTest%][FileWriteAheadLogManager] Resolved write ahead log archive directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0 [21:04:46] : [Step 4/5] [2021-11-19 21:04:46,507][INFO ][test-runner-#8795%encryption.EncryptedCacheNodeJoinTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000000.wal [21:04:46]W: [org.apache.ignite:ignite-core] [2021-11-19 21:04:46,508][WARN ][test-runner-#8795%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] DataRegion maxSize=10.5 MB is smaller than defaultInitialSize=268.4 MB, setting initialSize to 10.5 MB [21:04:46] : [Step 4/5] [2021-11-19 21:04:46,514][INFO ][test-runner-#8795%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Configured data regions initialized successfully [total=5] [21:04:46] : [Step 4/5] [2021-11-19 21:04:46,516][INFO ][test-runner-#8795%encryption.EncryptedCacheNodeJoinTest%][IgniteSnapshotManager] Resolved snapshot work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/snapshots [21:04:46] : [Step 4/5] [2021-11-19 21:04:46,517][INFO ][test-runner-#8795%encryption.EncryptedCacheNodeJoinTest%][IgniteSnapshotManager] Resolved temp directory for snapshot creation: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0/snp [21:04:46] : [Step 4/5] [2021-11-19 21:04:46,520][INFO ][test-runner-#8795%encryption.EncryptedCacheNodeJoinTest%][ClientListenerProcessor] Client connector processor has started on TCP port 10800 [21:04:46] : [Step 4/5] [2021-11-19 21:04:46,527][INFO ][test-runner-#8795%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] Non-loopback local IPs: 172.17.0.4 [21:04:46] : [Step 4/5] [2021-11-19 21:04:46,527][INFO ][test-runner-#8795%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] Enabled local MACs: 0242AC110004 [21:04:46] : [Step 4/5] [2021-11-19 21:04:46,530][INFO ][test-runner-#8795%encryption.EncryptedCacheNodeJoinTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:04:46] : [Step 4/5] [2021-11-19 21:04:46,530][INFO ][test-runner-#8795%encryption.EncryptedCacheNodeJoinTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:04:46] : [Step 4/5] [2021-11-19 21:04:46,531][INFO ][test-runner-#8795%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:04:46] : [Step 4/5] [2021-11-19 21:04:46,533][INFO ][test-runner-#8795%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Applying lost metastore updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:04:46] : [Step 4/5] [2021-11-19 21:04:46,535][INFO ][test-runner-#8795%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=0 ms] [21:04:46] : [Step 4/5] [2021-11-19 21:04:46,535][INFO ][test-runner-#8795%encryption.EncryptedCacheNodeJoinTest%][GridCacheProcessor] Restoring partition state for local groups. [21:04:46] : [Step 4/5] [2021-11-19 21:04:46,536][INFO ][test-runner-#8795%encryption.EncryptedCacheNodeJoinTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=0, partitionsProcessed=0, time=0ms] [21:04:46] : [Step 4/5] [2021-11-19 21:04:46,536][INFO ][test-runner-#8795%encryption.EncryptedCacheNodeJoinTest%][GridEncryptionManager] Encryption keys loaded from metastore. [grps=, masterKeyName=ignite.master.key] [21:04:46] : [Step 4/5] [2021-11-19 21:04:46,542][INFO ][test-runner-#8795%encryption.EncryptedCacheNodeJoinTest%][ClusterProcessor] Cluster ID and tag has been read from metastorage: null [21:04:46] : [Step 4/5] [2021-11-19 21:04:46,543][INFO ][test-runner-#8795%encryption.EncryptedCacheNodeJoinTest%][IgniteClusterImpl] Shutdown policy was updated [oldVal=null, newVal=null] [21:04:46] : [Step 4/5] [2021-11-19 21:04:46,543][INFO ][test-runner-#8795%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Checkpoint frequency deviation changed [oldVal=null, newVal=null] [21:04:46] : [Step 4/5] [2021-11-19 21:04:46,553][INFO ][test-runner-#8795%encryption.EncryptedCacheNodeJoinTest%][FilePageStoreManager] Cleanup cache stores [total=1, left=0, cleanFiles=false] [21:04:46] : [Step 4/5] [2021-11-19 21:04:46,556][INFO ][test-runner-#8795%encryption.EncryptedCacheNodeJoinTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:04:46] : [Step 4/5] [2021-11-19 21:04:46,557][INFO ][test-runner-#8795%encryption.EncryptedCacheNodeJoinTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:04:46] : [Step 4/5] [2021-11-19 21:04:46,558][INFO ][test-runner-#8795%encryption.EncryptedCacheNodeJoinTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:04:46] : [Step 4/5] [2021-11-19 21:04:46,558][INFO ][test-runner-#8795%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Data Regions Started: 5 [21:04:46] : [Step 4/5] [2021-11-19 21:04:46,559][INFO ][test-runner-#8795%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] ^-- sysMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:04:46] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:04:46] : [Step 4/5] ^-- default region [type=default, persistence=true, lazyAlloc=true, [21:04:46] : [Step 4/5] ... initCfg=10MB, maxCfg=10MB, usedRam=0MB, freeRam=100%, allocRam=0MB, allocTotal=0MB] [21:04:46] : [Step 4/5] ^-- metastoreMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:04:46] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:04:46] : [Step 4/5] ^-- TxLog region [type=internal, persistence=true, lazyAlloc=false, [21:04:46] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:04:46] : [Step 4/5] ^-- volatileDsMemPlc region [type=user, persistence=false, lazyAlloc=true, [21:04:46] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB] [21:04:46] : [Step 4/5] ^-- Ignite persistence [used=0MB] [21:04:46] : [Step 4/5] [21:04:46] : [Step 4/5] [2021-11-19 21:04:46,561][INFO ][test-runner-#8795%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Starting binary memory restore for: [-2100569601] [21:04:46] : [Step 4/5] [2021-11-19 21:04:46,573][INFO ][test-runner-#8795%encryption.EncryptedCacheNodeJoinTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:04:46] : [Step 4/5] [2021-11-19 21:04:46,574][INFO ][test-runner-#8795%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:04:46] : [Step 4/5] [2021-11-19 21:04:46,576][INFO ][test-runner-#8795%encryption.EncryptedCacheNodeJoinTest%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000000.wal, offset=0, ver=2] [21:04:46] : [Step 4/5] [2021-11-19 21:04:46,579][INFO ][test-runner-#8795%encryption.EncryptedCacheNodeJoinTest%][GridCacheProcessor] Started cache in recovery mode [name=ignite-sys-cache, id=-2100569601, dataRegionName=sysMemPlc, mode=REPLICATED, atomicity=TRANSACTIONAL, backups=2147483647, mvcc=false] [21:04:46] : [Step 4/5] [2021-11-19 21:04:46,580][INFO ][test-runner-#8795%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Binary recovery performed in 19 ms. [21:04:46] : [Step 4/5] [2021-11-19 21:04:46,580][INFO ][test-runner-#8795%encryption.EncryptedCacheNodeJoinTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:04:46] : [Step 4/5] [2021-11-19 21:04:46,581][INFO ][test-runner-#8795%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Applying lost cache updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:04:46] : [Step 4/5] [2021-11-19 21:04:46,664][INFO ][test-runner-#8795%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=83 ms] [21:04:46] : [Step 4/5] [2021-11-19 21:04:46,664][INFO ][test-runner-#8795%encryption.EncryptedCacheNodeJoinTest%][GridCacheProcessor] Restoring partition state for local groups. [21:04:46] : [Step 4/5] [2021-11-19 21:04:46,685][INFO ][test-runner-#8795%encryption.EncryptedCacheNodeJoinTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=1, partitionsProcessed=100, time=21ms] [21:04:46] : [Step 4/5] [2021-11-19 21:04:46,993][INFO ][test-runner-#8795%encryption.EncryptedCacheNodeJoinTest%][TestTcpDiscoverySpi] Successfully bound to TCP port [port=47500, localHost=localhost/127.0.0.1, locNodeId=002ddf6e-3774-4bb8-9600-3815e7487000] [21:04:47] : [Step 4/5] [2021-11-19 21:04:47,010][INFO ][disco-notifier-worker-#8906%grid-0%][MvccProcessorImpl] Assigned mvcc coordinator [crd=MvccCoordinator [topVer=AffinityTopologyVersion [topVer=1, minorTopVer=0], nodeId=002ddf6e-3774-4bb8-9600-3815e7487000, ver=1637345087009, local=true, initialized=false]] [21:04:47] : [Step 4/5] [2021-11-19 21:04:47,011][INFO ][sys-#8882%grid-0%][ClusterProcessor] Writing cluster ID and tag to metastorage on ready for write ClusterIdAndTag [id=3d4a92fe-50b4-4bab-9c86-714622d816b3, tag=kind_mcclintock] [21:04:47] : [Step 4/5] [2021-11-19 21:04:47,020][INFO ][disco-notifier-worker-#8906%grid-0%][ClusterProcessor] kind_mcclintock [21:04:47] : [Step 4/5] [2021-11-19 21:04:47,022][INFO ][disco-notifier-worker-#8906%grid-0%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustEnabled' was changed from 'null' to 'false' [21:04:47] : [Step 4/5] [2021-11-19 21:04:47,023][INFO ][disco-notifier-worker-#8906%grid-0%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustTimeout' was changed from 'null' to '300000' [21:04:47] : [Step 4/5] [2021-11-19 21:04:47,024][INFO ][disco-notifier-worker-#8906%grid-0%][IgniteTxManager] Transactions parameter 'longOperationsDumpTimeout' was changed from 'null' to '60000' [21:04:47] : [Step 4/5] [2021-11-19 21:04:47,024][INFO ][disco-notifier-worker-#8906%grid-0%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpThreshold' was changed from 'null' to '0' [21:04:47] : [Step 4/5] [2021-11-19 21:04:47,025][INFO ][disco-notifier-worker-#8906%grid-0%][IgniteTxManager] Transactions parameter 'transactionTimeDumpSamplesCoefficient' was changed from 'null' to '0.0' [21:04:47] : [Step 4/5] [2021-11-19 21:04:47,026][INFO ][disco-notifier-worker-#8906%grid-0%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpSamplesPerSecondLimit' was changed from 'null' to '5' [21:04:47] : [Step 4/5] [2021-11-19 21:04:47,026][INFO ][disco-notifier-worker-#8906%grid-0%][IgniteTxManager] Transactions parameter 'collisionsDumpInterval' was changed from 'null' to '1000' [21:04:47] : [Step 4/5] [2021-11-19 21:04:47,027][INFO ][disco-notifier-worker-#8906%grid-0%][IgniteTxManager] Transactions parameter 'txOwnerDumpRequestsAllowed' was changed from 'null' to 'true' [21:04:47] : [Step 4/5] [2021-11-19 21:04:47,028][INFO ][disco-notifier-worker-#8906%grid-0%][GridCacheDatabaseSharedManager] Historical rebalance WAL threshold changed [property=historical.rebalance.threshold, oldVal=null, newVal=500] [21:04:47] : [Step 4/5] [2021-11-19 21:04:47,045][INFO ][test-runner-#8795%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] To start Console Management & Monitoring run ignitevisorcmd.{sh|bat} [21:04:47] : [Step 4/5] [2021-11-19 21:04:47,046][INFO ][test-runner-#8795%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] [21:04:47] : [Step 4/5] [21:04:47] : [Step 4/5] >>> +-------------------------------------------+ [21:04:47] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:04:47] : [Step 4/5] >>> +-------------------------------------------+ [21:04:47] : [Step 4/5] >>> OS name: Linux 4.15.0-151-generic amd64 [21:04:47] : [Step 4/5] >>> CPU(s): 24 [21:04:47] : [Step 4/5] >>> Heap: 2.0GB [21:04:47] : [Step 4/5] >>> VM name: 16724@c4dfe9a430b2 [21:04:47] : [Step 4/5] >>> Ignite instance name: grid-0 [21:04:47] : [Step 4/5] >>> Local node [ID=002DDF6E-3774-4BB8-9600-3815E7487000, order=1, clientMode=false] [21:04:47] : [Step 4/5] >>> Local node addresses: [127.0.0.1] [21:04:47] : [Step 4/5] >>> Local ports: TCP:10800 TCP:45150 TCP:47500 [21:04:47] : [Step 4/5] [21:04:47] : [Step 4/5] [2021-11-19 21:04:47,047][INFO ][test-runner-#8795%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] >>> Ignite cluster is in INACTIVE state (limited functionality available). Use control.(sh|bat) script or IgniteCluster.state(ClusterState.ACTIVE) to change the state. [21:04:47] : [Step 4/5] [2021-11-19 21:04:47,049][INFO ][test-runner-#8795%encryption.EncryptedCacheNodeJoinTest%][GridDiscoveryManager] Topology snapshot [ver=1, locNode=002ddf6e, servers=1, clients=0, state=INACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=002ddf6e-3774-4bb8-9600-3815e7487000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:04:47] : [Step 4/5] [2021-11-19 21:04:47,050][INFO ][test-runner-#8795%encryption.EncryptedCacheNodeJoinTest%][G] Node started : [stage="Configure system pool" (0 ms),stage="Start managers" (212 ms),stage="Configure binary metadata" (3 ms),stage="Start processors" (408 ms),stage="Start 'StanByClusterTestProvider' plugin" (0 ms),stage="Start 'PageMemory tracker plugin' plugin" (0 ms),stage="Start 'TestDistibutedConfigurationPlugin' plugin" (0 ms),stage="Start 'NodeValidationPluginProvider' plugin" (0 ms),stage="Init metastore" (27 ms),stage="Init and start regions" (7 ms),stage="Restore binary memory" (19 ms),stage="Restore logical state" (105 ms),stage="Finish recovery" (304 ms),stage="Join topology" (25 ms),stage="Await transition" (2 ms),stage="Await exchange" (31 ms),stage="Total time" (1143 ms)] [21:04:47] : [Step 4/5] [2021-11-19 21:04:47,051][INFO ][test-runner-#8795%encryption.EncryptedCacheNodeJoinTest%][root] Node started with the following configuration [id=002ddf6e-3774-4bb8-9600-3815e7487000, marshaller=BinaryMarshaller [], discovery=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=5000, ackTimeout=5000, marsh=JdkMarshaller [clsFilter=org.apache.ignite.marshaller.MarshallerUtils$1@202f30e7], reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], binaryCfg=null, lateAff=true] [21:04:47]W: [org.apache.ignite:ignite-core] [2021-11-19 21:04:47,058][WARN ][test-runner-#8795%encryption.EncryptedCacheNodeJoinTest%][G] Ignite work directory is not provided, automatically resolved to: /opt/buildagent/work/7bc1c54bc719b67c/work [21:04:47] : [Step 4/5] [2021-11-19 21:04:47,060][INFO ][test-runner-#8795%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-6] [21:04:47] : [Step 4/5] [21:04:47] : [Step 4/5] >>> __________ ________________ [21:04:47] : [Step 4/5] >>> / _/ ___/ |/ / _/_ __/ __/ [21:04:47] : [Step 4/5] >>> _/ // (7 7 // / / / / _/ [21:04:47] : [Step 4/5] >>> /___/\___/_/|_/___/ /_/ /___/ [21:04:47] : [Step 4/5] >>> [21:04:47] : [Step 4/5] >>> ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:04:47] : [Step 4/5] >>> 2021 Copyright(C) Apache Software Foundation [21:04:47] : [Step 4/5] >>> [21:04:47] : [Step 4/5] >>> Ignite documentation: http://ignite.apache.org [21:04:47] : [Step 4/5] [21:04:47] : [Step 4/5] [2021-11-19 21:04:47,061][INFO ][test-runner-#8795%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-6] Config URL: n/a [21:04:47] : [Step 4/5] [2021-11-19 21:04:47,062][INFO ][test-runner-#8795%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-6] IgniteConfiguration [igniteInstanceName=grid-6, pubPoolSize=24, svcPoolSize=24, callbackPoolSize=24, stripedPoolSize=24, sysPoolSize=24, mgmtPoolSize=4, dataStreamerPoolSize=24, utilityCachePoolSize=24, utilityCacheKeepAliveTime=60000, p2pPoolSize=2, qryPoolSize=24, buildIdxPoolSize=4, igniteHome=/opt/buildagent/work/7bc1c54bc719b67c, igniteWorkDir=/opt/buildagent/work/7bc1c54bc719b67c/work, mbeanSrv=com.sun.jmx.mbeanserver.JmxMBeanServer@6fe85038, nodeId=60f14a89-74b5-490a-9959-d77f98a1a006, marsh=BinaryMarshaller [], marshLocJobs=false, daemon=false, p2pEnabled=true, netTimeout=10000, netCompressionLevel=1, sndRetryDelay=1000, sndRetryCnt=3, metricsHistSize=10000, metricsUpdateFreq=1000, metricsExpTime=9223372036854775807, discoSpi=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=0, ackTimeout=0, marsh=null, reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], segPlc=STOP, segResolveAttempts=2, waitForSegOnStart=true, allResolversPassReq=true, segChkFreq=10000, commSpi=TcpCommunicationSpi [connectGate=org.apache.ignite.spi.communication.tcp.internal.ConnectGateway@366a936c, ctxInitLatch=java.util.concurrent.CountDownLatch@21a0a607[Count = 1], stopping=false, clientPool=null, nioSrvWrapper=null, stateProvider=null], evtSpi=MemoryEventStorageSpi [expireAgeMs=9223372036854775807, expireCnt=10000, filter=null], colSpi=NoopCollisionSpi [], deploySpi=LocalDeploymentSpi [], indexingSpi=org.apache.ignite.spi.indexing.noop.NoopIndexingSpi@2d1db6e9, addrRslvr=null, encryptionSpi=org.apache.ignite.spi.encryption.keystore.KeystoreEncryptionSpi@61d9d21b, tracingSpi=org.apache.ignite.spi.tracing.NoopTracingSpi@5f680f43, clientMode=false, rebalanceThreadPoolSize=4, rebalanceTimeout=10000, rebalanceBatchesPrefetchCnt=3, rebalanceThrottle=0, rebalanceBatchSize=524288, txCfg=TransactionConfiguration [txSerEnabled=false, dfltIsolation=REPEATABLE_READ, dfltConcurrency=PESSIMISTIC, dfltTxTimeout=0, txTimeoutOnPartitionMapExchange=0, deadlockTimeout=10000, pessimisticTxLogSize=0, pessimisticTxLogLinger=10000, tmLookupClsName=null, txManagerFactory=null, useJtaSync=false], cacheSanityCheckEnabled=true, discoStartupDelay=60000, deployMode=SHARED, p2pMissedCacheSize=100, locHost=127.0.0.1, timeSrvPortBase=31100, timeSrvPortRange=100, failureDetectionTimeout=10000, sysWorkerBlockedTimeout=null, clientFailureDetectionTimeout=10000, metricsLogFreq=0, connectorCfg=null, odbcCfg=null, warmupClos=null, atomicCfg=AtomicConfiguration [seqReserveSize=1000, cacheMode=PARTITIONED, backups=1, aff=null, grpName=null], classLdr=null, sslCtxFactory=null, platformCfg=null, binaryCfg=null, memCfg=null, pstCfg=null, dsCfg=DataStorageConfiguration [sysRegionInitSize=41943040, sysRegionMaxSize=104857600, pageSize=4096, concLvl=0, dfltDataRegConf=DataRegionConfiguration [name=default, maxSize=10485760, initSize=268435456, swapPath=null, pageEvictionMode=DISABLED, pageReplacementMode=CLOCK, evictionThreshold=0.9, emptyPagesPoolSize=100, metricsEnabled=false, metricsSubIntervalCount=5, metricsRateTimeInterval=60000, persistenceEnabled=true, checkpointPageBufSize=0, lazyMemoryAllocation=true, warmUpCfg=null], dataRegions=null, storagePath=null, checkpointFreq=180000, lockWaitTime=10000, checkpointThreads=4, checkpointWriteOrder=SEQUENTIAL, walHistSize=20, maxWalArchiveSize=1073741824, walSegments=10, walSegmentSize=67108864, walPath=db/wal, walArchivePath=db/wal/archive, cdcWalPath=db/wal/cdc, cdcEnabled=false, metricsEnabled=false, walMode=FSYNC, walTlbSize=131072, walBuffSize=0, walFlushFreq=2000, walFsyncDelay=1000, walRecordIterBuffSize=67108864, alwaysWriteFullPages=false, fileIOFactory=org.apache.ignite.internal.processors.cache.persistence.file.AsyncFileIOFactory@16ee6a56, metricsSubIntervalCnt=5, metricsRateTimeInterval=60000, walAutoArchiveAfterInactivity=-1, walForceArchiveTimeout=-1, writeThrottlingEnabled=false, walCompactionEnabled=false, walCompactionLevel=1, checkpointReadLockTimeout=null, walPageCompression=DISABLED, walPageCompressionLevel=null, dfltWarmUpCfg=null, encCfg=org.apache.ignite.configuration.EncryptionConfiguration@e292d3c, defragmentationThreadPoolSize=4, minWalArchiveSize=-1], snapshotPath=snapshots, activeOnStart=true, activeOnStartPropSetFlag=false, autoActivation=true, autoActivationPropSetFlag=false, clusterStateOnStart=null, sqlConnCfg=null, cliConnCfg=ClientConnectorConfiguration [host=null, port=10800, portRange=100, sockSndBufSize=0, sockRcvBufSize=0, tcpNoDelay=true, maxOpenCursorsPerConn=128, threadPoolSize=24, selectorCnt=12, idleTimeout=0, handshakeTimeout=10000, jdbcEnabled=true, odbcEnabled=true, thinCliEnabled=true, sslEnabled=false, useIgniteSslCtxFactory=true, sslClientAuth=false, sslCtxFactory=null, thinCliCfg=ThinClientConfiguration [maxActiveTxPerConn=100, maxActiveComputeTasksPerConn=0]], mvccVacuumThreadCnt=2, mvccVacuumFreq=5000, authEnabled=false, failureHnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]], commFailureRslvr=null, sqlCfg=SqlConfiguration [longQryWarnTimeout=3000, dfltQryTimeout=0, sqlQryHistSize=1000, validationEnabled=false], asyncContinuationExecutor=null] [21:04:47] : [Step 4/5] [2021-11-19 21:04:47,072][INFO ][test-runner-#8795%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-6] Daemon mode: off [21:04:47] : [Step 4/5] [2021-11-19 21:04:47,073][INFO ][test-runner-#8795%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-6] OS: Linux 4.15.0-151-generic amd64 [21:04:47] : [Step 4/5] [2021-11-19 21:04:47,073][INFO ][test-runner-#8795%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-6] OS user: teamcity [21:04:47] : [Step 4/5] [2021-11-19 21:04:47,073][INFO ][test-runner-#8795%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-6] PID: 16724 [21:04:47] : [Step 4/5] [2021-11-19 21:04:47,074][INFO ][test-runner-#8795%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-6] Language runtime: Java Platform API Specification ver. 1.8 [21:04:47] : [Step 4/5] [2021-11-19 21:04:47,074][INFO ][test-runner-#8795%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-6] VM information: Java(TM) SE Runtime Environment 1.8.0_261-b12 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 25.261-b12 [21:04:47] : [Step 4/5] [2021-11-19 21:04:47,075][INFO ][test-runner-#8795%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-6] VM total memory: 1.9GB [21:04:47] : [Step 4/5] [2021-11-19 21:04:47,075][INFO ][test-runner-#8795%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-6] Remote Management [restart: off, REST: off, JMX (remote: off)] [21:04:47] : [Step 4/5] [2021-11-19 21:04:47,075][INFO ][test-runner-#8795%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-6] Logger: GridTestLog4jLogger [quiet=false, config=null] [21:04:47] : [Step 4/5] [2021-11-19 21:04:47,076][INFO ][test-runner-#8795%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-6] IGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c [21:04:47] : [Step 4/5] [2021-11-19 21:04:47,076][INFO ][test-runner-#8795%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-6] VM arguments: [-DIGNITE_DUMP_THREADS_ON_FAILURE=false, -DMono=/usr/bin/mono-sgen, -DMono4.0_x64=/usr/lib/mono/4.0, -DMono4.5_x64=/usr/lib/mono/4.5, -DMonoVersion=6.12.0.90, -DSKIP_BUILD=false, -Dagent.home.dir=/opt/buildagent, -Dagent.name=aitc-lin02_03, -Dagent.ownPort=9090, -Dagent.work.dir=/opt/buildagent/work, -Dbuild.number=95, -Dbuild.vcs.number=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.1=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.GitHubApacheIgnite=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dclassworlds.conf=/opt/buildagent/temp/buildTmp/teamcity.m2.conf, -Dcom.jetbrains.maven.watcher.report.file=/opt/buildagent/temp/buildTmp/maven-build-info.xml, -Djava.io.tmpdir=/opt/buildagent/temp/buildTmp, -Dmaven.home=/opt/buildagent/tools/maven3_6, -Dmaven.multiModuleProjectDirectory=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.agent.cpuBenchmark=457, -Dteamcity.agent.dotnet.agent_url=http://localhost:9090/RPC2, -Dteamcity.agent.dotnet.build_id=6278078, -Dteamcity.auth.password=*******, -Dteamcity.auth.userId=TeamCityBuildId=6278078, -Dteamcity.build.changedFiles.file=/opt/buildagent/temp/buildTmp/changedFiles6342607772318147725.txt, -Dteamcity.build.checkoutDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.build.id=6278078, -Dteamcity.build.properties.file=/opt/buildagent/temp/buildTmp/teamcity.build5164517880467851002.properties, -Dteamcity.build.tempDir=/opt/buildagent/temp/buildTmp, -Dteamcity.build.workingDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.buildConfName=Basic 3, -Dteamcity.buildType.id=IgniteTests24Java8_Basic3, -Dteamcity.configuration.properties.file=/opt/buildagent/temp/buildTmp/teamcity.config5591980786735343870.properties, -Dteamcity.maven.userSettings.path=/opt/buildagent/temp/buildTmp/maven_settings_585072866407032347.xml, -Dteamcity.maven.watcher.home=/opt/buildagent/plugins/mavenPlugin/maven-watcher-jdk16, -Dteamcity.projectName=Ignite Tests 2.x (JDK 8/11), -Dteamcity.runner.properties.file=/opt/buildagent/temp/buildTmp/teamcity.runner9098465561618137420.properties, -Dteamcity.tests.recentlyFailedTests.file=/opt/buildagent/temp/buildTmp/testsToRunFirst3891775683130404069.txt, -Dteamcity.version=2021.2 (build 99542), -ea, -Xms2g, -Xmx2g, -XX:+HeapDumpOnOutOfMemoryError, -DIGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_TEST_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_UPDATE_NOTIFIER=false, -DIGNITE_NO_DISCO_ORDER=true, -DIGNITE_PERFORMANCE_SUGGESTIONS_DISABLED=true, -Djava.net.preferIPv4Stack=true, -DTEST_SCALE_FACTOR=1.0, -DIGNITE_TEST_PROP_LOG4J_FILE=log4j-tc-test.xml, -DIGNITE_QUIET=false, -DIGNITE_MARSHAL_BUFFERS_RECHECK=1000, -Dmaven.repo.local=/opt/buildagent/.m2/repository] [21:04:47] : [Step 4/5] [2021-11-19 21:04:47,082][INFO ][test-runner-#8795%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-6] System cache's DataRegion size is configured to 40 MB. Use DataStorageConfiguration.systemRegionInitialSize property to change the setting. [21:04:47] : [Step 4/5] [2021-11-19 21:04:47,082][INFO ][test-runner-#8795%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-6] Configured caches [in 'sysMemPlc' dataRegion: ['ignite-sys-cache']] [21:04:47]W: [org.apache.ignite:ignite-core] [2021-11-19 21:04:47,082][WARN ][test-runner-#8795%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-6] Peer class loading is enabled (disable it in production for performance and deployment consistency reasons) [21:04:47] : [Step 4/5] [2021-11-19 21:04:47,083][INFO ][test-runner-#8795%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-6] 3-rd party licenses can be found at: /opt/buildagent/work/7bc1c54bc719b67c/libs/licenses [21:04:47] : [Step 4/5] [2021-11-19 21:04:47,088][INFO ][test-runner-#8795%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] Configured plugins: [21:04:47] : [Step 4/5] [2021-11-19 21:04:47,089][INFO ][test-runner-#8795%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- StanByClusterTestProvider 1.0 [21:04:47] : [Step 4/5] [2021-11-19 21:04:47,089][INFO ][test-runner-#8795%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- null [21:04:47] : [Step 4/5] [2021-11-19 21:04:47,089][INFO ][test-runner-#8795%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] [21:04:47] : [Step 4/5] [2021-11-19 21:04:47,089][INFO ][test-runner-#8795%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- PageMemory tracker plugin 1.0 [21:04:47] : [Step 4/5] [2021-11-19 21:04:47,090][INFO ][test-runner-#8795%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- null [21:04:47] : [Step 4/5] [2021-11-19 21:04:47,090][INFO ][test-runner-#8795%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] [21:04:47] : [Step 4/5] [2021-11-19 21:04:47,090][INFO ][test-runner-#8795%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- TestDistibutedConfigurationPlugin 1.0 [21:04:47] : [Step 4/5] [2021-11-19 21:04:47,090][INFO ][test-runner-#8795%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- null [21:04:47] : [Step 4/5] [2021-11-19 21:04:47,091][INFO ][test-runner-#8795%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] [21:04:47] : [Step 4/5] [2021-11-19 21:04:47,091][INFO ][test-runner-#8795%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- NodeValidationPluginProvider 1.0 [21:04:47] : [Step 4/5] [2021-11-19 21:04:47,091][INFO ][test-runner-#8795%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- null [21:04:47] : [Step 4/5] [2021-11-19 21:04:47,092][INFO ][test-runner-#8795%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] [21:04:47] : [Step 4/5] [2021-11-19 21:04:47,092][INFO ][test-runner-#8795%encryption.EncryptedCacheNodeJoinTest%][FailureProcessor] Configured failure handler: [hnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]]] [21:04:47] : [Step 4/5] [2021-11-19 21:04:47,141][INFO ][test-runner-#8795%encryption.EncryptedCacheNodeJoinTest%][TcpCommunicationSpi] Successfully bound communication NIO server to TCP port [port=45151, locHost=/127.0.0.1, selectorsCnt=12, selectorSpins=0, pairedConn=false] [21:04:47]W: [org.apache.ignite:ignite-core] [2021-11-19 21:04:47,141][WARN ][test-runner-#8795%encryption.EncryptedCacheNodeJoinTest%][TcpCommunicationSpi] Message queue limit is set to 0 which may lead to potential OOMEs when running cache operations in FULL_ASYNC or PRIMARY_SYNC modes due to message queues growth on sender and receiver sides. [21:04:47] : [Step 4/5] [2021-11-19 21:04:47,148][INFO ][test-runner-#8795%encryption.EncryptedCacheNodeJoinTest%][GridCollisionManager] Collision resolution is disabled (all jobs will be activated upon arrival). [21:04:47] : [Step 4/5] [2021-11-19 21:04:47,149][INFO ][test-runner-#8795%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-6] Security status [authentication=off, sandbox=off, tls/ssl=off] [21:04:47] : [Step 4/5] [2021-11-19 21:04:47,217][INFO ][test-runner-#8795%encryption.EncryptedCacheNodeJoinTest%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:04:47] : [Step 4/5] [2021-11-19 21:04:47,313][INFO ][test-runner-#8795%encryption.EncryptedCacheNodeJoinTest%][MaintenanceProcessor] Resolved store directory for node persistent data: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_6 [21:04:47] : [Step 4/5] [2021-11-19 21:04:47,315][INFO ][test-runner-#8795%encryption.EncryptedCacheNodeJoinTest%][CacheObjectBinaryProcessorImpl] Resolved directory for serialized binary metadata: /opt/buildagent/work/7bc1c54bc719b67c/work/db/binary_meta/grid_6 [21:04:47] : [Step 4/5] [2021-11-19 21:04:47,320][INFO ][test-runner-#8795%encryption.EncryptedCacheNodeJoinTest%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_6 [21:04:47] : [Step 4/5] [2021-11-19 21:04:47,321][INFO ][test-runner-#8795%encryption.EncryptedCacheNodeJoinTest%][FileWriteAheadLogManager] Resolved write ahead log work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_6 [21:04:47] : [Step 4/5] [2021-11-19 21:04:47,321][INFO ][test-runner-#8795%encryption.EncryptedCacheNodeJoinTest%][FileWriteAheadLogManager] Resolved write ahead log archive directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_6 [21:04:47] : [Step 4/5] [2021-11-19 21:04:47,738][INFO ][test-runner-#8795%encryption.EncryptedCacheNodeJoinTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_6/0000000000000000.wal [21:04:47] : [Step 4/5] [2021-11-19 21:04:47,745][INFO ][test-runner-#8795%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Configured data regions initialized successfully [total=5] [21:04:47] : [Step 4/5] [2021-11-19 21:04:47,747][INFO ][test-runner-#8795%encryption.EncryptedCacheNodeJoinTest%][IgniteSnapshotManager] Resolved snapshot work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/snapshots [21:04:47] : [Step 4/5] [2021-11-19 21:04:47,747][INFO ][test-runner-#8795%encryption.EncryptedCacheNodeJoinTest%][IgniteSnapshotManager] Resolved temp directory for snapshot creation: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_6/snp [21:04:47] : [Step 4/5] [2021-11-19 21:04:47,750][INFO ][test-runner-#8795%encryption.EncryptedCacheNodeJoinTest%][ClientListenerProcessor] Client connector processor has started on TCP port 10801 [21:04:47] : [Step 4/5] [2021-11-19 21:04:47,753][INFO ][test-runner-#8795%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-6] Non-loopback local IPs: 172.17.0.4 [21:04:47] : [Step 4/5] [2021-11-19 21:04:47,754][INFO ][test-runner-#8795%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-6] Enabled local MACs: 0242AC110004 [21:04:47] : [Step 4/5] [2021-11-19 21:04:47,755][INFO ][test-runner-#8795%encryption.EncryptedCacheNodeJoinTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:04:47] : [Step 4/5] [2021-11-19 21:04:47,756][INFO ][test-runner-#8795%encryption.EncryptedCacheNodeJoinTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:04:47] : [Step 4/5] [2021-11-19 21:04:47,756][INFO ][test-runner-#8795%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:04:47] : [Step 4/5] [2021-11-19 21:04:47,759][INFO ][test-runner-#8795%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Applying lost metastore updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:04:47] : [Step 4/5] [2021-11-19 21:04:47,760][INFO ][test-runner-#8795%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=0 ms] [21:04:47] : [Step 4/5] [2021-11-19 21:04:47,760][INFO ][test-runner-#8795%encryption.EncryptedCacheNodeJoinTest%][GridCacheProcessor] Restoring partition state for local groups. [21:04:47] : [Step 4/5] [2021-11-19 21:04:47,761][INFO ][test-runner-#8795%encryption.EncryptedCacheNodeJoinTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=0, partitionsProcessed=0, time=0ms] [21:04:47] : [Step 4/5] [2021-11-19 21:04:47,761][INFO ][test-runner-#8795%encryption.EncryptedCacheNodeJoinTest%][GridEncryptionManager] Encryption keys loaded from metastore. [grps=, masterKeyName=ignite.master.key] [21:04:47] : [Step 4/5] [2021-11-19 21:04:47,763][INFO ][test-runner-#8795%encryption.EncryptedCacheNodeJoinTest%][ClusterProcessor] Cluster ID and tag has been read from metastorage: null [21:04:47] : [Step 4/5] [2021-11-19 21:04:47,763][INFO ][test-runner-#8795%encryption.EncryptedCacheNodeJoinTest%][IgniteClusterImpl] Shutdown policy was updated [oldVal=null, newVal=null] [21:04:47] : [Step 4/5] [2021-11-19 21:04:47,764][INFO ][test-runner-#8795%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Checkpoint frequency deviation changed [oldVal=null, newVal=null] [21:04:47] : [Step 4/5] [2021-11-19 21:04:47,773][INFO ][test-runner-#8795%encryption.EncryptedCacheNodeJoinTest%][FilePageStoreManager] Cleanup cache stores [total=1, left=0, cleanFiles=false] [21:04:47] : [Step 4/5] [2021-11-19 21:04:47,776][INFO ][test-runner-#8795%encryption.EncryptedCacheNodeJoinTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:04:47] : [Step 4/5] [2021-11-19 21:04:47,777][INFO ][test-runner-#8795%encryption.EncryptedCacheNodeJoinTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:04:47] : [Step 4/5] [2021-11-19 21:04:47,779][INFO ][test-runner-#8795%encryption.EncryptedCacheNodeJoinTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:04:47] : [Step 4/5] [2021-11-19 21:04:47,779][INFO ][test-runner-#8795%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Data Regions Started: 5 [21:04:47] : [Step 4/5] [2021-11-19 21:04:47,780][INFO ][test-runner-#8795%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] ^-- sysMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:04:47] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:04:47] : [Step 4/5] ^-- default region [type=default, persistence=true, lazyAlloc=true, [21:04:47] : [Step 4/5] ... initCfg=10MB, maxCfg=10MB, usedRam=0MB, freeRam=100%, allocRam=0MB, allocTotal=0MB] [21:04:47] : [Step 4/5] ^-- metastoreMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:04:47] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:04:47] : [Step 4/5] ^-- TxLog region [type=internal, persistence=true, lazyAlloc=false, [21:04:47] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:04:47] : [Step 4/5] ^-- volatileDsMemPlc region [type=user, persistence=false, lazyAlloc=true, [21:04:47] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB] [21:04:47] : [Step 4/5] ^-- Ignite persistence [used=0MB] [21:04:47] : [Step 4/5] [21:04:47] : [Step 4/5] [2021-11-19 21:04:47,781][INFO ][test-runner-#8795%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Starting binary memory restore for: [-2100569601] [21:04:47] : [Step 4/5] [2021-11-19 21:04:47,793][INFO ][test-runner-#8795%encryption.EncryptedCacheNodeJoinTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:04:47] : [Step 4/5] [2021-11-19 21:04:47,794][INFO ][test-runner-#8795%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:04:47] : [Step 4/5] [2021-11-19 21:04:47,795][INFO ][test-runner-#8795%encryption.EncryptedCacheNodeJoinTest%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_6/0000000000000000.wal, offset=0, ver=2] [21:04:47] : [Step 4/5] [2021-11-19 21:04:47,800][INFO ][test-runner-#8795%encryption.EncryptedCacheNodeJoinTest%][GridCacheProcessor] Started cache in recovery mode [name=ignite-sys-cache, id=-2100569601, dataRegionName=sysMemPlc, mode=REPLICATED, atomicity=TRANSACTIONAL, backups=2147483647, mvcc=false] [21:04:47] : [Step 4/5] [2021-11-19 21:04:47,801][INFO ][test-runner-#8795%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Binary recovery performed in 20 ms. [21:04:47] : [Step 4/5] [2021-11-19 21:04:47,801][INFO ][test-runner-#8795%encryption.EncryptedCacheNodeJoinTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:04:47] : [Step 4/5] [2021-11-19 21:04:47,802][INFO ][test-runner-#8795%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Applying lost cache updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:04:47] : [Step 4/5] [2021-11-19 21:04:47,884][INFO ][test-runner-#8795%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=81 ms] [21:04:47] : [Step 4/5] [2021-11-19 21:04:47,884][INFO ][test-runner-#8795%encryption.EncryptedCacheNodeJoinTest%][GridCacheProcessor] Restoring partition state for local groups. [21:04:47] : [Step 4/5] [2021-11-19 21:04:47,910][INFO ][test-runner-#8795%encryption.EncryptedCacheNodeJoinTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=1, partitionsProcessed=100, time=31ms] [21:04:48] : [Step 4/5] [2021-11-19 21:04:48,227][INFO ][test-runner-#8795%encryption.EncryptedCacheNodeJoinTest%][TestTcpDiscoverySpi] Successfully bound to TCP port [port=47501, localHost=localhost/127.0.0.1, locNodeId=60f14a89-74b5-490a-9959-d77f98a1a006] [21:04:48] : [Step 4/5] [2021-11-19 21:04:48,233][INFO ][tcp-disco-srvr-[:47500]-#450%grid-0%-#8908%grid-0%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=46545] [21:04:48] : [Step 4/5] [2021-11-19 21:04:48,233][INFO ][tcp-disco-srvr-[:47500]-#450%grid-0%-#8908%grid-0%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=46545] [21:04:48] : [Step 4/5] [2021-11-19 21:04:48,234][INFO ][tcp-disco-sock-reader-[]-#456%grid-0%-#9027%grid-0%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:46545, rmtPort=46545] [21:04:48] : [Step 4/5] [2021-11-19 21:04:48,235][INFO ][tcp-disco-sock-reader-[60f14a89 127.0.0.1:46545]-#456%grid-0%-#9027%grid-0%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=60f14a89-74b5-490a-9959-d77f98a1a006, rmtAddr=/127.0.0.1:46545] [21:04:48] : [Step 4/5] [2021-11-19 21:04:48,241][INFO ][tcp-disco-srvr-[:47501]-#455%grid-6%-#9026%grid-6%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=56677] [21:04:48] : [Step 4/5] [2021-11-19 21:04:48,242][INFO ][tcp-disco-srvr-[:47501]-#455%grid-6%-#9026%grid-6%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=56677] [21:04:48] : [Step 4/5] [2021-11-19 21:04:48,242][INFO ][tcp-disco-sock-reader-[]-#457%grid-6%-#9028%grid-6%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:56677, rmtPort=56677] [21:04:48] : [Step 4/5] [2021-11-19 21:04:48,243][INFO ][tcp-disco-sock-reader-[]-#457%grid-6%-#9028%grid-6%][TestTcpDiscoverySpi] Received ping request from the remote node [rmtNodeId=002ddf6e-3774-4bb8-9600-3815e7487000, rmtAddr=/127.0.0.1:56677, rmtPort=56677] [21:04:48] : [Step 4/5] [2021-11-19 21:04:48,244][INFO ][tcp-disco-sock-reader-[]-#457%grid-6%-#9028%grid-6%][TestTcpDiscoverySpi] Finished writing ping response [rmtNodeId=002ddf6e-3774-4bb8-9600-3815e7487000, rmtAddr=/127.0.0.1:56677, rmtPort=56677] [21:04:48] : [Step 4/5] [2021-11-19 21:04:48,244][INFO ][tcp-disco-sock-reader-[60f14a89 127.0.0.1:46545]-#456%grid-0%-#9027%grid-0%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:46545, rmtPort=46545, rmtNodeId=60f14a89-74b5-490a-9959-d77f98a1a006] [21:04:48]W: [org.apache.ignite:ignite-core] [2021-11-19 21:04:48,244][WARN ][tcp-disco-sock-reader-[]-#457%grid-6%-#9028%grid-6%][TestTcpDiscoverySpi] Failed to shutdown socket [21:04:48]W: [org.apache.ignite:ignite-core] java.net.SocketException: Socket output is already shutdown [21:04:48]W: [org.apache.ignite:ignite-core] at java.net.Socket.shutdownOutput(Socket.java:1572) [21:04:48] : [Step 4/5] [2021-11-19 21:04:48,247][INFO ][tcp-disco-sock-reader-[]-#457%grid-6%-#9028%grid-6%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:56677, rmtPort=56677, rmtNodeId=null] [21:04:48]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.close(IgniteUtils.java:4247) [21:04:48]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.discovery.tcp.ServerImpl$SocketReader.body(ServerImpl.java:7370) [21:04:48]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.IgniteSpiThread.run(IgniteSpiThread.java:58) [21:04:48] : [Step 4/5] [2021-11-19 21:04:48,248][INFO ][tcp-disco-msg-worker-[crd]-#449%grid-0%-#8907%grid-0%][GridEncryptionManager] Joining node doesn't have stored group keys [node=60f14a89-74b5-490a-9959-d77f98a1a006] [21:04:48] : [Step 4/5] [2021-11-19 21:04:48,256][INFO ][tcp-disco-msg-worker-[crd]-#449%grid-0%-#8907%grid-0%][TestTcpDiscoverySpi] New next node [newNext=TcpDiscoveryNode [id=60f14a89-74b5-490a-9959-d77f98a1a006, consistentId=grid-6, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=0, intOrder=2, lastExchangeTime=1637345088233, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false]] [21:04:48] : [Step 4/5] [2021-11-19 21:04:48,257][INFO ][tcp-disco-srvr-[:47501]-#455%grid-6%-#9026%grid-6%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=34493] [21:04:48] : [Step 4/5] [2021-11-19 21:04:48,258][INFO ][tcp-disco-srvr-[:47501]-#455%grid-6%-#9026%grid-6%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=34493] [21:04:48] : [Step 4/5] [2021-11-19 21:04:48,258][INFO ][tcp-disco-sock-reader-[]-#458%grid-6%-#9029%grid-6%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:34493, rmtPort=34493] [21:04:48] : [Step 4/5] [2021-11-19 21:04:48,259][INFO ][tcp-disco-sock-reader-[002ddf6e 127.0.0.1:34493]-#458%grid-6%-#9029%grid-6%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=002ddf6e-3774-4bb8-9600-3815e7487000, rmtAddr=/127.0.0.1:34493] [21:04:48] : [Step 4/5] [2021-11-19 21:04:48,262][INFO ][tcp-disco-msg-worker-[]-#454%grid-6%-#9025%grid-6%][TestTcpDiscoverySpi] New next node [newNext=TcpDiscoveryNode [id=002ddf6e-3774-4bb8-9600-3815e7487000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345088253, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false]] [21:04:48] : [Step 4/5] [2021-11-19 21:04:48,263][INFO ][tcp-disco-srvr-[:47500]-#450%grid-0%-#8908%grid-0%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=49505] [21:04:48] : [Step 4/5] [2021-11-19 21:04:48,264][INFO ][tcp-disco-srvr-[:47500]-#450%grid-0%-#8908%grid-0%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=49505] [21:04:48] : [Step 4/5] [2021-11-19 21:04:48,265][INFO ][tcp-disco-sock-reader-[]-#459%grid-0%-#9030%grid-0%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:49505, rmtPort=49505] [21:04:48] : [Step 4/5] [2021-11-19 21:04:48,266][INFO ][tcp-disco-sock-reader-[60f14a89 127.0.0.1:49505]-#459%grid-0%-#9030%grid-0%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=60f14a89-74b5-490a-9959-d77f98a1a006, rmtAddr=/127.0.0.1:49505] [21:04:48] : [Step 4/5] [2021-11-19 21:04:48,268][INFO ][disco-event-worker-#8910%grid-0%][GridDiscoveryManager] Added new node to topology: TcpDiscoveryNode [id=60f14a89-74b5-490a-9959-d77f98a1a006, consistentId=grid-6, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637345088233, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false] [21:04:48] : [Step 4/5] [2021-11-19 21:04:48,269][INFO ][disco-event-worker-#8910%grid-0%][GridDiscoveryManager] Topology snapshot [ver=2, locNode=002ddf6e, servers=2, clients=0, state=INACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=002ddf6e-3774-4bb8-9600-3815e7487000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=60f14a89-74b5-490a-9959-d77f98a1a006, consistentId=grid-6, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:04:48] : [Step 4/5] [2021-11-19 21:04:48,271][INFO ][tcp-disco-msg-worker-[002ddf6e 127.0.0.1:47500]-#454%grid-6%-#9025%grid-6%][ClusterProcessor] kind_mcclintock [21:04:48] : [Step 4/5] [2021-11-19 21:04:48,272][INFO ][tcp-disco-msg-worker-[002ddf6e 127.0.0.1:47500]-#454%grid-6%-#9025%grid-6%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustEnabled' was changed from 'null' to 'false' [21:04:48] : [Step 4/5] [2021-11-19 21:04:48,272][INFO ][tcp-disco-msg-worker-[002ddf6e 127.0.0.1:47500]-#454%grid-6%-#9025%grid-6%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustTimeout' was changed from 'null' to '300000' [21:04:48] : [Step 4/5] [2021-11-19 21:04:48,272][INFO ][tcp-disco-msg-worker-[002ddf6e 127.0.0.1:47500]-#454%grid-6%-#9025%grid-6%][IgniteTxManager] Transactions parameter 'longOperationsDumpTimeout' was changed from 'null' to '60000' [21:04:48] : [Step 4/5] [2021-11-19 21:04:48,273][INFO ][tcp-disco-msg-worker-[002ddf6e 127.0.0.1:47500]-#454%grid-6%-#9025%grid-6%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpThreshold' was changed from 'null' to '0' [21:04:48] : [Step 4/5] [2021-11-19 21:04:48,273][INFO ][tcp-disco-msg-worker-[002ddf6e 127.0.0.1:47500]-#454%grid-6%-#9025%grid-6%][IgniteTxManager] Transactions parameter 'transactionTimeDumpSamplesCoefficient' was changed from 'null' to '0.0' [21:04:48] : [Step 4/5] [2021-11-19 21:04:48,274][INFO ][tcp-disco-msg-worker-[002ddf6e 127.0.0.1:47500]-#454%grid-6%-#9025%grid-6%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpSamplesPerSecondLimit' was changed from 'null' to '5' [21:04:48] : [Step 4/5] [2021-11-19 21:04:48,274][INFO ][tcp-disco-msg-worker-[002ddf6e 127.0.0.1:47500]-#454%grid-6%-#9025%grid-6%][IgniteTxManager] Transactions parameter 'collisionsDumpInterval' was changed from 'null' to '1000' [21:04:48] : [Step 4/5] [2021-11-19 21:04:48,275][INFO ][tcp-disco-msg-worker-[002ddf6e 127.0.0.1:47500]-#454%grid-6%-#9025%grid-6%][IgniteTxManager] Transactions parameter 'txOwnerDumpRequestsAllowed' was changed from 'null' to 'true' [21:04:48] : [Step 4/5] [2021-11-19 21:04:48,275][INFO ][tcp-disco-msg-worker-[002ddf6e 127.0.0.1:47500]-#454%grid-6%-#9025%grid-6%][GridCacheDatabaseSharedManager] Historical rebalance WAL threshold changed [property=historical.rebalance.threshold, oldVal=null, newVal=500] [21:04:48] : [Step 4/5] [2021-11-19 21:04:48,276][INFO ][disco-notifier-worker-#9024%grid-6%][MvccProcessorImpl] Assigned mvcc coordinator [crd=MvccCoordinator [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=0], nodeId=002ddf6e-3774-4bb8-9600-3815e7487000, ver=1637345087009, local=false, initialized=false]] [21:04:48] : [Step 4/5] [2021-11-19 21:04:48,278][INFO ][sys-#9022%grid-6%][ClusterProcessor] Writing cluster ID and tag to metastorage on ready for write ClusterIdAndTag [id=3d4a92fe-50b4-4bab-9c86-714622d816b3, tag=kind_mcclintock] [21:04:48] : [Step 4/5] [2021-11-19 21:04:48,321][INFO ][test-runner-#8795%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-6] To start Console Management & Monitoring run ignitevisorcmd.{sh|bat} [21:04:48] : [Step 4/5] [2021-11-19 21:04:48,321][INFO ][test-runner-#8795%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-6] [21:04:48] : [Step 4/5] [21:04:48] : [Step 4/5] >>> +-------------------------------------------+ [21:04:48] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:04:48] : [Step 4/5] >>> +-------------------------------------------+ [21:04:48] : [Step 4/5] >>> OS name: Linux 4.15.0-151-generic amd64 [21:04:48] : [Step 4/5] >>> CPU(s): 24 [21:04:48] : [Step 4/5] >>> Heap: 2.0GB [21:04:48] : [Step 4/5] >>> VM name: 16724@c4dfe9a430b2 [21:04:48] : [Step 4/5] >>> Ignite instance name: grid-6 [21:04:48] : [Step 4/5] >>> Local node [ID=60F14A89-74B5-490A-9959-D77F98A1A006, order=2, clientMode=false] [21:04:48] : [Step 4/5] >>> Local node addresses: [127.0.0.1] [21:04:48] : [Step 4/5] >>> Local ports: TCP:10801 TCP:45151 TCP:47501 [21:04:48] : [Step 4/5] [21:04:48] : [Step 4/5] [2021-11-19 21:04:48,323][INFO ][test-runner-#8795%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-6] >>> Ignite cluster is in INACTIVE state (limited functionality available). Use control.(sh|bat) script or IgniteCluster.state(ClusterState.ACTIVE) to change the state. [21:04:48] : [Step 4/5] [2021-11-19 21:04:48,323][INFO ][test-runner-#8795%encryption.EncryptedCacheNodeJoinTest%][GridDiscoveryManager] Topology snapshot [ver=2, locNode=60f14a89, servers=2, clients=0, state=INACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=002ddf6e-3774-4bb8-9600-3815e7487000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=60f14a89-74b5-490a-9959-d77f98a1a006, consistentId=grid-6, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:04:48] : [Step 4/5] [2021-11-19 21:04:48,324][INFO ][test-runner-#8795%encryption.EncryptedCacheNodeJoinTest%][G] Node started : [stage="Configure system pool" (0 ms),stage="Start managers" (255 ms),stage="Configure binary metadata" (3 ms),stage="Start processors" (435 ms),stage="Start 'StanByClusterTestProvider' plugin" (0 ms),stage="Start 'PageMemory tracker plugin' plugin" (0 ms),stage="Start 'TestDistibutedConfigurationPlugin' plugin" (0 ms),stage="Start 'NodeValidationPluginProvider' plugin" (0 ms),stage="Init metastore" (20 ms),stage="Init and start regions" (7 ms),stage="Restore binary memory" (19 ms),stage="Restore logical state" (109 ms),stage="Finish recovery" (315 ms),stage="Join topology" (50 ms),stage="Await transition" (2 ms),stage="Await exchange" (45 ms),stage="Total time" (1260 ms)] [21:04:48] : [Step 4/5] [2021-11-19 21:04:48,326][INFO ][test-runner-#8795%encryption.EncryptedCacheNodeJoinTest%][root] Node started with the following configuration [id=60f14a89-74b5-490a-9959-d77f98a1a006, marshaller=BinaryMarshaller [], discovery=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=5000, ackTimeout=5000, marsh=JdkMarshaller [clsFilter=org.apache.ignite.marshaller.MarshallerUtils$1@1b504233], reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], binaryCfg=null, lateAff=true] [21:04:48]W: [org.apache.ignite:ignite-core] [2021-11-19 21:04:48,331][WARN ][test-runner-#8795%encryption.EncryptedCacheNodeJoinTest%][G] Ignite work directory is not provided, automatically resolved to: /opt/buildagent/work/7bc1c54bc719b67c/work [21:04:48] : [Step 4/5] [2021-11-19 21:04:48,336][INFO ][test-runner-#8795%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%client1] [21:04:48] : [Step 4/5] [21:04:48] : [Step 4/5] >>> __________ ________________ [21:04:48] : [Step 4/5] >>> / _/ ___/ |/ / _/_ __/ __/ [21:04:48] : [Step 4/5] >>> _/ // (7 7 // / / / / _/ [21:04:48] : [Step 4/5] >>> /___/\___/_/|_/___/ /_/ /___/ [21:04:48] : [Step 4/5] >>> [21:04:48] : [Step 4/5] >>> ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:04:48] : [Step 4/5] >>> 2021 Copyright(C) Apache Software Foundation [21:04:48] : [Step 4/5] >>> [21:04:48] : [Step 4/5] >>> Ignite documentation: http://ignite.apache.org [21:04:48] : [Step 4/5] [21:04:48] : [Step 4/5] [2021-11-19 21:04:48,337][INFO ][test-runner-#8795%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%client1] Config URL: n/a [21:04:48] : [Step 4/5] [2021-11-19 21:04:48,337][INFO ][test-runner-#8795%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%client1] IgniteConfiguration [igniteInstanceName=client1, pubPoolSize=24, svcPoolSize=24, callbackPoolSize=24, stripedPoolSize=24, sysPoolSize=24, mgmtPoolSize=4, dataStreamerPoolSize=24, utilityCachePoolSize=24, utilityCacheKeepAliveTime=60000, p2pPoolSize=2, qryPoolSize=24, buildIdxPoolSize=4, igniteHome=/opt/buildagent/work/7bc1c54bc719b67c, igniteWorkDir=/opt/buildagent/work/7bc1c54bc719b67c/work, mbeanSrv=com.sun.jmx.mbeanserver.JmxMBeanServer@6fe85038, nodeId=10229b7e-8c8b-484a-a25e-0ae6708fa001, marsh=BinaryMarshaller [], marshLocJobs=false, daemon=false, p2pEnabled=true, netTimeout=10000, netCompressionLevel=1, sndRetryDelay=1000, sndRetryCnt=3, metricsHistSize=10000, metricsUpdateFreq=1000, metricsExpTime=9223372036854775807, discoSpi=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=0, ackTimeout=0, marsh=null, reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], segPlc=STOP, segResolveAttempts=2, waitForSegOnStart=true, allResolversPassReq=true, segChkFreq=10000, commSpi=TcpCommunicationSpi [connectGate=org.apache.ignite.spi.communication.tcp.internal.ConnectGateway@5eb9c7b4, ctxInitLatch=java.util.concurrent.CountDownLatch@1009ebb7[Count = 1], stopping=false, clientPool=null, nioSrvWrapper=null, stateProvider=null], evtSpi=MemoryEventStorageSpi [expireAgeMs=9223372036854775807, expireCnt=10000, filter=null], colSpi=NoopCollisionSpi [], deploySpi=LocalDeploymentSpi [], indexingSpi=org.apache.ignite.spi.indexing.noop.NoopIndexingSpi@3bff0e5f, addrRslvr=null, encryptionSpi=org.apache.ignite.spi.encryption.noop.NoopEncryptionSpi@518e9c70, tracingSpi=org.apache.ignite.spi.tracing.NoopTracingSpi@22de1d83, clientMode=true, rebalanceThreadPoolSize=4, rebalanceTimeout=10000, rebalanceBatchesPrefetchCnt=3, rebalanceThrottle=0, rebalanceBatchSize=524288, txCfg=TransactionConfiguration [txSerEnabled=false, dfltIsolation=REPEATABLE_READ, dfltConcurrency=PESSIMISTIC, dfltTxTimeout=0, txTimeoutOnPartitionMapExchange=0, deadlockTimeout=10000, pessimisticTxLogSize=0, pessimisticTxLogLinger=10000, tmLookupClsName=null, txManagerFactory=null, useJtaSync=false], cacheSanityCheckEnabled=true, discoStartupDelay=60000, deployMode=SHARED, p2pMissedCacheSize=100, locHost=127.0.0.1, timeSrvPortBase=31100, timeSrvPortRange=100, failureDetectionTimeout=10000, sysWorkerBlockedTimeout=null, clientFailureDetectionTimeout=10000, metricsLogFreq=0, connectorCfg=null, odbcCfg=null, warmupClos=null, atomicCfg=AtomicConfiguration [seqReserveSize=1000, cacheMode=PARTITIONED, backups=1, aff=null, grpName=null], classLdr=null, sslCtxFactory=null, platformCfg=null, binaryCfg=null, memCfg=null, pstCfg=null, dsCfg=DataStorageConfiguration [sysRegionInitSize=41943040, sysRegionMaxSize=104857600, pageSize=4096, concLvl=0, dfltDataRegConf=DataRegionConfiguration [name=default, maxSize=10485760, initSize=268435456, swapPath=null, pageEvictionMode=DISABLED, pageReplacementMode=CLOCK, evictionThreshold=0.9, emptyPagesPoolSize=100, metricsEnabled=false, metricsSubIntervalCount=5, metricsRateTimeInterval=60000, persistenceEnabled=true, checkpointPageBufSize=0, lazyMemoryAllocation=true, warmUpCfg=null], dataRegions=null, storagePath=null, checkpointFreq=180000, lockWaitTime=10000, checkpointThreads=4, checkpointWriteOrder=SEQUENTIAL, walHistSize=20, maxWalArchiveSize=1073741824, walSegments=10, walSegmentSize=67108864, walPath=db/wal, walArchivePath=db/wal/archive, cdcWalPath=db/wal/cdc, cdcEnabled=false, metricsEnabled=false, walMode=FSYNC, walTlbSize=131072, walBuffSize=0, walFlushFreq=2000, walFsyncDelay=1000, walRecordIterBuffSize=67108864, alwaysWriteFullPages=false, fileIOFactory=org.apache.ignite.internal.processors.cache.persistence.file.AsyncFileIOFactory@6975d06d, metricsSubIntervalCnt=5, metricsRateTimeInterval=60000, walAutoArchiveAfterInactivity=-1, walForceArchiveTimeout=-1, writeThrottlingEnabled=false, walCompactionEnabled=false, walCompactionLevel=1, checkpointReadLockTimeout=null, walPageCompression=DISABLED, walPageCompressionLevel=null, dfltWarmUpCfg=null, encCfg=org.apache.ignite.configuration.EncryptionConfiguration@316bd76d, defragmentationThreadPoolSize=4, minWalArchiveSize=-1], snapshotPath=snapshots, activeOnStart=true, activeOnStartPropSetFlag=false, autoActivation=true, autoActivationPropSetFlag=false, clusterStateOnStart=null, sqlConnCfg=null, cliConnCfg=ClientConnectorConfiguration [host=null, port=10800, portRange=100, sockSndBufSize=0, sockRcvBufSize=0, tcpNoDelay=true, maxOpenCursorsPerConn=128, threadPoolSize=24, selectorCnt=12, idleTimeout=0, handshakeTimeout=10000, jdbcEnabled=true, odbcEnabled=true, thinCliEnabled=true, sslEnabled=false, useIgniteSslCtxFactory=true, sslClientAuth=false, sslCtxFactory=null, thinCliCfg=ThinClientConfiguration [maxActiveTxPerConn=100, maxActiveComputeTasksPerConn=0]], mvccVacuumThreadCnt=2, mvccVacuumFreq=5000, authEnabled=false, failureHnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]], commFailureRslvr=null, sqlCfg=SqlConfiguration [longQryWarnTimeout=3000, dfltQryTimeout=0, sqlQryHistSize=1000, validationEnabled=false], asyncContinuationExecutor=null] [21:04:48] : [Step 4/5] [2021-11-19 21:04:48,347][INFO ][test-runner-#8795%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%client1] Daemon mode: off [21:04:48] : [Step 4/5] [2021-11-19 21:04:48,348][INFO ][test-runner-#8795%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%client1] OS: Linux 4.15.0-151-generic amd64 [21:04:48] : [Step 4/5] [2021-11-19 21:04:48,348][INFO ][test-runner-#8795%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%client1] OS user: teamcity [21:04:48] : [Step 4/5] [2021-11-19 21:04:48,348][INFO ][test-runner-#8795%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%client1] PID: 16724 [21:04:48] : [Step 4/5] [2021-11-19 21:04:48,349][INFO ][test-runner-#8795%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%client1] Language runtime: Java Platform API Specification ver. 1.8 [21:04:48] : [Step 4/5] [2021-11-19 21:04:48,349][INFO ][test-runner-#8795%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%client1] VM information: Java(TM) SE Runtime Environment 1.8.0_261-b12 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 25.261-b12 [21:04:48] : [Step 4/5] [2021-11-19 21:04:48,349][INFO ][test-runner-#8795%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%client1] VM total memory: 1.9GB [21:04:48] : [Step 4/5] [2021-11-19 21:04:48,350][INFO ][test-runner-#8795%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%client1] Remote Management [restart: off, REST: off, JMX (remote: off)] [21:04:48] : [Step 4/5] [2021-11-19 21:04:48,350][INFO ][test-runner-#8795%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%client1] Logger: GridTestLog4jLogger [quiet=false, config=null] [21:04:48] : [Step 4/5] [2021-11-19 21:04:48,350][INFO ][test-runner-#8795%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%client1] IGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c [21:04:48] : [Step 4/5] [2021-11-19 21:04:48,351][INFO ][test-runner-#8795%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%client1] VM arguments: [-DIGNITE_DUMP_THREADS_ON_FAILURE=false, -DMono=/usr/bin/mono-sgen, -DMono4.0_x64=/usr/lib/mono/4.0, -DMono4.5_x64=/usr/lib/mono/4.5, -DMonoVersion=6.12.0.90, -DSKIP_BUILD=false, -Dagent.home.dir=/opt/buildagent, -Dagent.name=aitc-lin02_03, -Dagent.ownPort=9090, -Dagent.work.dir=/opt/buildagent/work, -Dbuild.number=95, -Dbuild.vcs.number=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.1=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.GitHubApacheIgnite=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dclassworlds.conf=/opt/buildagent/temp/buildTmp/teamcity.m2.conf, -Dcom.jetbrains.maven.watcher.report.file=/opt/buildagent/temp/buildTmp/maven-build-info.xml, -Djava.io.tmpdir=/opt/buildagent/temp/buildTmp, -Dmaven.home=/opt/buildagent/tools/maven3_6, -Dmaven.multiModuleProjectDirectory=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.agent.cpuBenchmark=457, -Dteamcity.agent.dotnet.agent_url=http://localhost:9090/RPC2, -Dteamcity.agent.dotnet.build_id=6278078, -Dteamcity.auth.password=*******, -Dteamcity.auth.userId=TeamCityBuildId=6278078, -Dteamcity.build.changedFiles.file=/opt/buildagent/temp/buildTmp/changedFiles6342607772318147725.txt, -Dteamcity.build.checkoutDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.build.id=6278078, -Dteamcity.build.properties.file=/opt/buildagent/temp/buildTmp/teamcity.build5164517880467851002.properties, -Dteamcity.build.tempDir=/opt/buildagent/temp/buildTmp, -Dteamcity.build.workingDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.buildConfName=Basic 3, -Dteamcity.buildType.id=IgniteTests24Java8_Basic3, -Dteamcity.configuration.properties.file=/opt/buildagent/temp/buildTmp/teamcity.config5591980786735343870.properties, -Dteamcity.maven.userSettings.path=/opt/buildagent/temp/buildTmp/maven_settings_585072866407032347.xml, -Dteamcity.maven.watcher.home=/opt/buildagent/plugins/mavenPlugin/maven-watcher-jdk16, -Dteamcity.projectName=Ignite Tests 2.x (JDK 8/11), -Dteamcity.runner.properties.file=/opt/buildagent/temp/buildTmp/teamcity.runner9098465561618137420.properties, -Dteamcity.tests.recentlyFailedTests.file=/opt/buildagent/temp/buildTmp/testsToRunFirst3891775683130404069.txt, -Dteamcity.version=2021.2 (build 99542), -ea, -Xms2g, -Xmx2g, -XX:+HeapDumpOnOutOfMemoryError, -DIGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_TEST_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_UPDATE_NOTIFIER=false, -DIGNITE_NO_DISCO_ORDER=true, -DIGNITE_PERFORMANCE_SUGGESTIONS_DISABLED=true, -Djava.net.preferIPv4Stack=true, -DTEST_SCALE_FACTOR=1.0, -DIGNITE_TEST_PROP_LOG4J_FILE=log4j-tc-test.xml, -DIGNITE_QUIET=false, -DIGNITE_MARSHAL_BUFFERS_RECHECK=1000, -Dmaven.repo.local=/opt/buildagent/.m2/repository] [21:04:48] : [Step 4/5] [2021-11-19 21:04:48,356][INFO ][test-runner-#8795%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%client1] System cache's DataRegion size is configured to 40 MB. Use DataStorageConfiguration.systemRegionInitialSize property to change the setting. [21:04:48] : [Step 4/5] [2021-11-19 21:04:48,356][INFO ][test-runner-#8795%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%client1] Configured caches [in 'sysMemPlc' dataRegion: ['ignite-sys-cache']] [21:04:48] : [Step 4/5] [2021-11-19 21:04:48,357][INFO ][test-runner-#8795%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%client1] 3-rd party licenses can be found at: /opt/buildagent/work/7bc1c54bc719b67c/libs/licenses [21:04:48]W: [org.apache.ignite:ignite-core] [2021-11-19 21:04:48,356][WARN ][test-runner-#8795%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%client1] Peer class loading is enabled (disable it in production for performance and deployment consistency reasons) [21:04:48] : [Step 4/5] [2021-11-19 21:04:48,361][INFO ][test-runner-#8795%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] Configured plugins: [21:04:48] : [Step 4/5] [2021-11-19 21:04:48,362][INFO ][test-runner-#8795%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- StanByClusterTestProvider 1.0 [21:04:48] : [Step 4/5] [2021-11-19 21:04:48,362][INFO ][test-runner-#8795%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- null [21:04:48] : [Step 4/5] [2021-11-19 21:04:48,362][INFO ][test-runner-#8795%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] [21:04:48] : [Step 4/5] [2021-11-19 21:04:48,362][INFO ][test-runner-#8795%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- PageMemory tracker plugin 1.0 [21:04:48] : [Step 4/5] [2021-11-19 21:04:48,363][INFO ][test-runner-#8795%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- null [21:04:48] : [Step 4/5] [2021-11-19 21:04:48,363][INFO ][test-runner-#8795%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] [21:04:48] : [Step 4/5] [2021-11-19 21:04:48,363][INFO ][test-runner-#8795%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- TestDistibutedConfigurationPlugin 1.0 [21:04:48] : [Step 4/5] [2021-11-19 21:04:48,363][INFO ][test-runner-#8795%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- null [21:04:48] : [Step 4/5] [2021-11-19 21:04:48,364][INFO ][test-runner-#8795%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] [21:04:48] : [Step 4/5] [2021-11-19 21:04:48,364][INFO ][test-runner-#8795%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- NodeValidationPluginProvider 1.0 [21:04:48] : [Step 4/5] [2021-11-19 21:04:48,364][INFO ][test-runner-#8795%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- null [21:04:48] : [Step 4/5] [2021-11-19 21:04:48,364][INFO ][test-runner-#8795%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] [21:04:48] : [Step 4/5] [2021-11-19 21:04:48,365][INFO ][test-runner-#8795%encryption.EncryptedCacheNodeJoinTest%][FailureProcessor] Configured failure handler: [hnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]]] [21:04:48] : [Step 4/5] [2021-11-19 21:04:48,422][INFO ][test-runner-#8795%encryption.EncryptedCacheNodeJoinTest%][TcpCommunicationSpi] Successfully bound communication NIO server to TCP port [port=45152, locHost=/127.0.0.1, selectorsCnt=12, selectorSpins=0, pairedConn=false] [21:04:48]W: [org.apache.ignite:ignite-core] [2021-11-19 21:04:48,423][WARN ][test-runner-#8795%encryption.EncryptedCacheNodeJoinTest%][TcpCommunicationSpi] Message queue limit is set to 0 which may lead to potential OOMEs when running cache operations in FULL_ASYNC or PRIMARY_SYNC modes due to message queues growth on sender and receiver sides. [21:04:48] : [Step 4/5] [2021-11-19 21:04:48,431][INFO ][test-runner-#8795%encryption.EncryptedCacheNodeJoinTest%][GridCollisionManager] Collision resolution is disabled (all jobs will be activated upon arrival). [21:04:48] : [Step 4/5] [2021-11-19 21:04:48,432][INFO ][test-runner-#8795%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%client1] Security status [authentication=off, sandbox=off, tls/ssl=off] [21:04:48]W: [org.apache.ignite:ignite-core] [2021-11-19 21:04:48,437][WARN ][test-runner-#8795%encryption.EncryptedCacheNodeJoinTest%][GridCacheProcessor] Persistent Store is not supported on client nodes (Persistent Store's configuration will be ignored). [21:04:48] : [Step 4/5] [2021-11-19 21:04:48,441][INFO ][test-runner-#8795%encryption.EncryptedCacheNodeJoinTest%][IgniteCacheDatabaseSharedManager] Configured data regions initialized successfully [total=4] [21:04:48] : [Step 4/5] [2021-11-19 21:04:48,446][INFO ][test-runner-#8795%encryption.EncryptedCacheNodeJoinTest%][ClientListenerProcessor] Client connector processor has started on TCP port 10802 [21:04:48] : [Step 4/5] [2021-11-19 21:04:48,450][INFO ][test-runner-#8795%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%client1] Non-loopback local IPs: 172.17.0.4 [21:04:48] : [Step 4/5] [2021-11-19 21:04:48,450][INFO ][test-runner-#8795%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%client1] Enabled local MACs: 0242AC110004 [21:04:48] : [Step 4/5] [2021-11-19 21:04:48,451][INFO ][test-runner-#8795%encryption.EncryptedCacheNodeJoinTest%][ClusterProcessor] Cluster ID and tag has been read from metastorage: null [21:04:48] : [Step 4/5] [2021-11-19 21:04:48,451][INFO ][test-runner-#8795%encryption.EncryptedCacheNodeJoinTest%][IgniteClusterImpl] Shutdown policy was updated [oldVal=null, newVal=null] [21:04:48] : [Step 4/5] [2021-11-19 21:04:48,455][INFO ][tcp-disco-srvr-[:47501]-#455%grid-6%-#9026%grid-6%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=39177] [21:04:48] : [Step 4/5] [2021-11-19 21:04:48,456][INFO ][tcp-disco-srvr-[:47501]-#455%grid-6%-#9026%grid-6%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=39177] [21:04:48] : [Step 4/5] [2021-11-19 21:04:48,456][INFO ][tcp-disco-sock-reader-[]-#466%grid-6%-#9124%grid-6%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:39177, rmtPort=39177] [21:04:48] : [Step 4/5] [2021-11-19 21:04:48,457][INFO ][tcp-disco-sock-reader-[10229b7e 127.0.0.1:39177 client]-#466%grid-6%-#9124%grid-6%][TestTcpDiscoverySpi] Initialized connection with remote client node [nodeId=10229b7e-8c8b-484a-a25e-0ae6708fa001, rmtAddr=/127.0.0.1:39177] [21:04:48] : [Step 4/5] [2021-11-19 21:04:48,479][INFO ][disco-event-worker-#8910%grid-0%][GridDiscoveryManager] Added new node to topology: TcpDiscoveryNode [id=10229b7e-8c8b-484a-a25e-0ae6708fa001, consistentId=client1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:0], discPort=0, order=3, intOrder=3, lastExchangeTime=1637345088455, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=true] [21:04:48] : [Step 4/5] [2021-11-19 21:04:48,480][INFO ][disco-event-worker-#8910%grid-0%][GridDiscoveryManager] Topology snapshot [ver=3, locNode=002ddf6e, servers=2, clients=1, state=INACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=002ddf6e-3774-4bb8-9600-3815e7487000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=60f14a89-74b5-490a-9959-d77f98a1a006, consistentId=grid-6, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=10229b7e-8c8b-484a-a25e-0ae6708fa001, consistentId=client1, isClient=true, ver=2.13.0#20211119-sha1:00000000]]] [21:04:48] : [Step 4/5] [2021-11-19 21:04:48,487][INFO ][disco-event-worker-#9032%grid-6%][GridDiscoveryManager] Added new node to topology: TcpDiscoveryNode [id=10229b7e-8c8b-484a-a25e-0ae6708fa001, consistentId=client1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:0], discPort=0, order=3, intOrder=3, lastExchangeTime=1637345088465, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=true] [21:04:48] : [Step 4/5] [2021-11-19 21:04:48,488][INFO ][disco-event-worker-#9032%grid-6%][GridDiscoveryManager] Topology snapshot [ver=3, locNode=60f14a89, servers=2, clients=1, state=INACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=002ddf6e-3774-4bb8-9600-3815e7487000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=60f14a89-74b5-490a-9959-d77f98a1a006, consistentId=grid-6, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=10229b7e-8c8b-484a-a25e-0ae6708fa001, consistentId=client1, isClient=true, ver=2.13.0#20211119-sha1:00000000]]] [21:04:48] : [Step 4/5] [2021-11-19 21:04:48,488][INFO ][tcp-client-disco-msg-worker-#465%client1%-#9122%client1%][TestTcpDiscoverySpi] Router node: TcpDiscoveryNode [id=60f14a89-74b5-490a-9959-d77f98a1a006, consistentId=grid-6, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637345088475, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false] [21:04:48] : [Step 4/5] [2021-11-19 21:04:48,494][INFO ][tcp-client-disco-msg-worker-#465%client1%-#9122%client1%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustEnabled' was changed from 'null' to 'false' [21:04:48] : [Step 4/5] [2021-11-19 21:04:48,494][INFO ][tcp-client-disco-msg-worker-#465%client1%-#9122%client1%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustTimeout' was changed from 'null' to '300000' [21:04:48] : [Step 4/5] [2021-11-19 21:04:48,495][INFO ][tcp-client-disco-msg-worker-#465%client1%-#9122%client1%][IgniteTxManager] Transactions parameter 'collisionsDumpInterval' was changed from 'null' to '1000' [21:04:48] : [Step 4/5] [2021-11-19 21:04:48,495][INFO ][tcp-client-disco-msg-worker-#465%client1%-#9122%client1%][IgniteTxManager] Transactions parameter 'longOperationsDumpTimeout' was changed from 'null' to '60000' [21:04:48] : [Step 4/5] [2021-11-19 21:04:48,496][INFO ][tcp-client-disco-msg-worker-#465%client1%-#9122%client1%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpSamplesPerSecondLimit' was changed from 'null' to '5' [21:04:48] : [Step 4/5] [2021-11-19 21:04:48,496][INFO ][tcp-client-disco-msg-worker-#465%client1%-#9122%client1%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpThreshold' was changed from 'null' to '0' [21:04:48] : [Step 4/5] [2021-11-19 21:04:48,496][INFO ][tcp-client-disco-msg-worker-#465%client1%-#9122%client1%][IgniteTxManager] Transactions parameter 'transactionTimeDumpSamplesCoefficient' was changed from 'null' to '0.0' [21:04:48] : [Step 4/5] [2021-11-19 21:04:48,497][INFO ][tcp-client-disco-msg-worker-#465%client1%-#9122%client1%][IgniteTxManager] Transactions parameter 'txOwnerDumpRequestsAllowed' was changed from 'null' to 'true' [21:04:48] : [Step 4/5] [2021-11-19 21:04:48,497][INFO ][tcp-client-disco-msg-worker-#465%client1%-#9122%client1%][ClusterProcessor] kind_mcclintock [21:04:48] : [Step 4/5] [2021-11-19 21:04:48,498][INFO ][disco-notifier-worker-#9119%client1%][MvccProcessorImpl] Assigned mvcc coordinator [crd=MvccCoordinator [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], nodeId=002ddf6e-3774-4bb8-9600-3815e7487000, ver=1637345087009, local=false, initialized=false]] [21:04:48] : [Step 4/5] [2021-11-19 21:04:48,508][INFO ][sys-#9126%client1%][ClusterProcessor] Writing cluster ID and tag to metastorage on ready for write ClusterIdAndTag [id=3d4a92fe-50b4-4bab-9c86-714622d816b3, tag=kind_mcclintock] [21:04:48] : [Step 4/5] [2021-11-19 21:04:48,592][INFO ][test-runner-#8795%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%client1] To start Console Management & Monitoring run ignitevisorcmd.{sh|bat} [21:04:48] : [Step 4/5] [2021-11-19 21:04:48,593][INFO ][test-runner-#8795%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%client1] [21:04:48] : [Step 4/5] [21:04:48] : [Step 4/5] >>> +-------------------------------------------+ [21:04:48] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:04:48] : [Step 4/5] >>> +-------------------------------------------+ [21:04:48] : [Step 4/5] >>> OS name: Linux 4.15.0-151-generic amd64 [21:04:48] : [Step 4/5] >>> CPU(s): 24 [21:04:48] : [Step 4/5] >>> Heap: 2.0GB [21:04:48] : [Step 4/5] >>> VM name: 16724@c4dfe9a430b2 [21:04:48] : [Step 4/5] >>> Ignite instance name: client1 [21:04:48] : [Step 4/5] >>> Local node [ID=10229B7E-8C8B-484A-A25E-0AE6708FA001, order=3, clientMode=true] [21:04:48] : [Step 4/5] >>> Local node addresses: [127.0.0.1] [21:04:48] : [Step 4/5] >>> Local ports: TCP:10802 TCP:45152 [21:04:48] : [Step 4/5] [21:04:48] : [Step 4/5] [2021-11-19 21:04:48,594][INFO ][test-runner-#8795%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%client1] >>> Ignite cluster is in INACTIVE state (limited functionality available). Use control.(sh|bat) script or IgniteCluster.state(ClusterState.ACTIVE) to change the state. [21:04:48] : [Step 4/5] [2021-11-19 21:04:48,595][INFO ][test-runner-#8795%encryption.EncryptedCacheNodeJoinTest%][GridDiscoveryManager] Topology snapshot [ver=3, locNode=10229b7e, servers=2, clients=1, state=INACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=10229b7e-8c8b-484a-a25e-0ae6708fa001, consistentId=client1, isClient=true, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=002ddf6e-3774-4bb8-9600-3815e7487000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=60f14a89-74b5-490a-9959-d77f98a1a006, consistentId=grid-6, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:04:48] : [Step 4/5] [2021-11-19 21:04:48,596][INFO ][test-runner-#8795%encryption.EncryptedCacheNodeJoinTest%][G] Node started : [stage="Configure system pool" (0 ms),stage="Start managers" (101 ms),stage="Configure binary metadata" (2 ms),stage="Start processors" (13 ms),stage="Start 'StanByClusterTestProvider' plugin" (0 ms),stage="Start 'PageMemory tracker plugin' plugin" (0 ms),stage="Start 'TestDistibutedConfigurationPlugin' plugin" (0 ms),stage="Start 'NodeValidationPluginProvider' plugin" (0 ms),stage="Init metastore" (2 ms),stage="Finish recovery" (0 ms),stage="Join topology" (56 ms),stage="Await transition" (3 ms),stage="Await exchange" (85 ms),stage="Total time" (262 ms)] [21:04:48] : [Step 4/5] [2021-11-19 21:04:48,597][INFO ][test-runner-#8795%encryption.EncryptedCacheNodeJoinTest%][root] Node started with the following configuration [id=10229b7e-8c8b-484a-a25e-0ae6708fa001, marshaller=BinaryMarshaller [], discovery=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=5000, ackTimeout=5000, marsh=JdkMarshaller [clsFilter=org.apache.ignite.marshaller.MarshallerUtils$1@1a489a78], reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], binaryCfg=null, lateAff=true] [21:04:48] : [Step 4/5] [2021-11-19 21:04:48,599][INFO ][test-runner-#8795%encryption.EncryptedCacheNodeJoinTest%][GridClusterStateProcessor] Sending activate cluster request with BaselineTopology BaselineTopology [id=0, branchingHash=-2475315496, branchingType='New BaselineTopology', baselineNodes=[grid-0, grid-6]] [21:04:48] : [Step 4/5] [2021-11-19 21:04:48,602][INFO ][disco-notifier-worker-#8906%grid-0%][GridClusterStateProcessor] Received activate cluster request with BaselineTopology[id=0] initiator node ID: 002ddf6e-3774-4bb8-9600-3815e7487000 [21:04:48] : [Step 4/5] [2021-11-19 21:04:48,603][INFO ][disco-notifier-worker-#8906%grid-0%][GridClusterStateProcessor] Started state transition: activate cluster [21:04:48] : [Step 4/5] [2021-11-19 21:04:48,604][INFO ][exchange-worker-#8911%grid-0%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], crd=true, evt=DISCOVERY_CUSTOM_EVT, evtNode=002ddf6e-3774-4bb8-9600-3815e7487000, customEvt=ChangeGlobalStateMessage [id=47b2d593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqId=63352834-981e-4878-b319-b94f17f622c0, initiatingNodeId=002ddf6e-3774-4bb8-9600-3815e7487000, state=ACTIVE, baselineTopology=BaselineTopology [id=0, branchingHash=-2475315496, branchingType='New BaselineTopology', baselineNodes=[grid-0, grid-6]], forceChangeBaselineTopology=false, timestamp=1637345088599, forceDeactivation=true], allowMerge=false, exchangeFreeSwitch=false] [21:04:48] : [Step 4/5] [2021-11-19 21:04:48,604][INFO ][disco-notifier-worker-#9024%grid-6%][GridClusterStateProcessor] Received activate cluster request with BaselineTopology[id=0] initiator node ID: 002ddf6e-3774-4bb8-9600-3815e7487000 [21:04:48] : [Step 4/5] [2021-11-19 21:04:48,605][INFO ][exchange-worker-#8911%grid-0%][GridDhtPartitionsExchangeFuture] Start activation process [nodeId=002ddf6e-3774-4bb8-9600-3815e7487000, client=false, topVer=AffinityTopologyVersion [topVer=3, minorTopVer=1]]. New state: ACTIVE [21:04:48] : [Step 4/5] [2021-11-19 21:04:48,605][INFO ][disco-notifier-worker-#9024%grid-6%][GridClusterStateProcessor] Started state transition: activate cluster [21:04:48] : [Step 4/5] [2021-11-19 21:04:48,606][INFO ][exchange-worker-#8911%grid-0%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0 [21:04:48] : [Step 4/5] [2021-11-19 21:04:48,606][INFO ][disco-notifier-worker-#9119%client1%][GridClusterStateProcessor] Received activate cluster request with BaselineTopology[id=0] initiator node ID: 002ddf6e-3774-4bb8-9600-3815e7487000 [21:04:48] : [Step 4/5] [2021-11-19 21:04:48,607][INFO ][exchange-worker-#9033%grid-6%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], crd=false, evt=DISCOVERY_CUSTOM_EVT, evtNode=002ddf6e-3774-4bb8-9600-3815e7487000, customEvt=ChangeGlobalStateMessage [id=47b2d593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqId=63352834-981e-4878-b319-b94f17f622c0, initiatingNodeId=002ddf6e-3774-4bb8-9600-3815e7487000, state=ACTIVE, baselineTopology=BaselineTopology [id=0, branchingHash=-2475315496, branchingType='New BaselineTopology', baselineNodes=[grid-0, grid-6]], forceChangeBaselineTopology=false, timestamp=1637345088599, forceDeactivation=true], allowMerge=false, exchangeFreeSwitch=false] [21:04:48] : [Step 4/5] [2021-11-19 21:04:48,607][INFO ][disco-notifier-worker-#9119%client1%][GridClusterStateProcessor] Started state transition: activate cluster [21:04:48] : [Step 4/5] [2021-11-19 21:04:48,609][INFO ][exchange-worker-#9033%grid-6%][GridDhtPartitionsExchangeFuture] Start activation process [nodeId=60f14a89-74b5-490a-9959-d77f98a1a006, client=false, topVer=AffinityTopologyVersion [topVer=3, minorTopVer=1]]. New state: ACTIVE [21:04:48] : [Step 4/5] [2021-11-19 21:04:48,610][INFO ][exchange-worker-#9033%grid-6%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_6 [21:04:48] : [Step 4/5] [2021-11-19 21:04:48,614][INFO ][exchange-worker-#8911%grid-0%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000000.wal, offset=8713, ver=2] [21:04:48] : [Step 4/5] [2021-11-19 21:04:48,615][INFO ][exchange-worker-#9128%client1%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], crd=false, evt=DISCOVERY_CUSTOM_EVT, evtNode=002ddf6e-3774-4bb8-9600-3815e7487000, customEvt=ChangeGlobalStateMessage [id=47b2d593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqId=63352834-981e-4878-b319-b94f17f622c0, initiatingNodeId=002ddf6e-3774-4bb8-9600-3815e7487000, state=ACTIVE, baselineTopology=BaselineTopology [id=0, branchingHash=-2475315496, branchingType='New BaselineTopology', baselineNodes=[grid-0, grid-6]], forceChangeBaselineTopology=false, timestamp=1637345088599, forceDeactivation=true], allowMerge=false, exchangeFreeSwitch=false] [21:04:48] : [Step 4/5] [2021-11-19 21:04:48,617][INFO ][exchange-worker-#9128%client1%][GridDhtPartitionsExchangeFuture] Start activation process [nodeId=10229b7e-8c8b-484a-a25e-0ae6708fa001, client=true, topVer=AffinityTopologyVersion [topVer=3, minorTopVer=1]]. New state: ACTIVE [21:04:48] : [Step 4/5] [2021-11-19 21:04:48,618][INFO ][exchange-worker-#8911%grid-0%][GridClusterStateProcessor] Writing BaselineTopology[id=0] [21:04:48] : [Step 4/5] [2021-11-19 21:04:48,619][INFO ][exchange-worker-#9128%client1%][IgniteCacheDatabaseSharedManager] Data Regions Started: 4 [21:04:48] : [Step 4/5] [2021-11-19 21:04:48,619][INFO ][exchange-worker-#9128%client1%][IgniteCacheDatabaseSharedManager] ^-- sysMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:04:48] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB, allocTotal=0MB] [21:04:48] : [Step 4/5] ^-- default region [type=default, persistence=true, lazyAlloc=true, [21:04:48] : [Step 4/5] ... initCfg=10MB, maxCfg=10MB, usedRam=0MB, freeRam=100%, allocRam=0MB, allocTotal=0MB] [21:04:48] : [Step 4/5] ^-- TxLog region [type=internal, persistence=true, lazyAlloc=false, [21:04:48] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB, allocTotal=0MB] [21:04:48] : [Step 4/5] ^-- volatileDsMemPlc region [type=user, persistence=false, lazyAlloc=true, [21:04:48] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB] [21:04:48] : [Step 4/5] ^-- Ignite persistence [used=0MB] [21:04:48] : [Step 4/5] [21:04:48] : [Step 4/5] [2021-11-19 21:04:48,621][INFO ][exchange-worker-#9128%client1%][msg] Components activation performed in 3 ms. [21:04:48] : [Step 4/5] [2021-11-19 21:04:48,623][INFO ][exchange-worker-#9128%client1%][GridCacheProcessor] Started cache [name=ignite-sys-cache, id=-2100569601, dataRegionName=sysMemPlc, mode=REPLICATED, atomicity=TRANSACTIONAL, backups=2147483647, mvcc=false] [21:04:48] : [Step 4/5] [2021-11-19 21:04:48,637][INFO ][exchange-worker-#9033%grid-6%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_6/0000000000000000.wal, offset=8713, ver=2] [21:04:48] : [Step 4/5] [2021-11-19 21:04:48,643][INFO ][exchange-worker-#9128%client1%][GridDhtPartitionsExchangeFuture] Successfully activated caches [nodeId=10229b7e-8c8b-484a-a25e-0ae6708fa001, client=true, topVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], newState=ACTIVE] [21:04:48] : [Step 4/5] [2021-11-19 21:04:48,643][INFO ][exchange-worker-#9033%grid-6%][GridClusterStateProcessor] Writing BaselineTopology[id=0] [21:04:48] : [Step 4/5] [2021-11-19 21:04:48,643][INFO ][exchange-worker-#8911%grid-0%][GridCacheDatabaseSharedManager] Finish recovery performed in 36 ms. [21:04:48] : [Step 4/5] [2021-11-19 21:04:48,652][INFO ][exchange-worker-#8911%grid-0%][msg] Components activation performed in 46 ms. [21:04:48] : [Step 4/5] [2021-11-19 21:04:48,653][INFO ][exchange-worker-#8911%grid-0%][GridCacheProcessor] Finished recovery for cache [cache=ignite-sys-cache, grp=ignite-sys-cache, startVer=AffinityTopologyVersion [topVer=3, minorTopVer=1]] [21:04:48] : [Step 4/5] [2021-11-19 21:04:48,653][INFO ][grid-nio-worker-tcp-comm-0-#8850%TcpCommunicationSpi%][TcpCommunicationSpi] Accepted incoming communication connection [locAddr=/127.0.0.1:45150, rmtAddr=/127.0.0.1:59494] [21:04:48] : [Step 4/5] [2021-11-19 21:04:48,654][INFO ][exchange-worker-#8911%grid-0%][GridDhtPartitionsExchangeFuture] Successfully activated caches [nodeId=002ddf6e-3774-4bb8-9600-3815e7487000, client=false, topVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], newState=ACTIVE] [21:04:48] : [Step 4/5] [2021-11-19 21:04:48,655][INFO ][exchange-worker-#8911%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:04:48] : [Step 4/5] [2021-11-19 21:04:48,656][INFO ][exchange-worker-#9033%grid-6%][GridCacheDatabaseSharedManager] Finish recovery performed in 45 ms. [21:04:48] : [Step 4/5] [2021-11-19 21:04:48,658][INFO ][exchange-worker-#9033%grid-6%][msg] Components activation performed in 48 ms. [21:04:48] : [Step 4/5] [2021-11-19 21:04:48,659][INFO ][grid-nio-worker-tcp-comm-0-#9090%TcpCommunicationSpi%][TcpCommunicationSpi] Established outgoing communication connection [locAddr=/127.0.0.1:59494, rmtAddr=/127.0.0.1:45150] [21:04:48] : [Step 4/5] [2021-11-19 21:04:48,659][INFO ][exchange-worker-#9033%grid-6%][GridCacheProcessor] Finished recovery for cache [cache=ignite-sys-cache, grp=ignite-sys-cache, startVer=AffinityTopologyVersion [topVer=3, minorTopVer=1]] [21:04:48] : [Step 4/5] [2021-11-19 21:04:48,660][INFO ][exchange-worker-#9128%client1%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], crd=false] [21:04:48] : [Step 4/5] [2021-11-19 21:04:48,662][INFO ][exchange-worker-#9033%grid-6%][GridDhtPartitionsExchangeFuture] Successfully activated caches [nodeId=60f14a89-74b5-490a-9959-d77f98a1a006, client=false, topVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], newState=ACTIVE] [21:04:48] : [Step 4/5] [2021-11-19 21:04:48,663][INFO ][exchange-worker-#9033%grid-6%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:04:48] : [Step 4/5] [2021-11-19 21:04:48,673][INFO ][exchange-worker-#8911%grid-0%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], crd=true] [21:04:48] : [Step 4/5] [2021-11-19 21:04:48,676][INFO ][db-checkpoint-thread-#9140%grid-0%][Checkpointer] Checkpoint started [checkpointId=ccdeab13-d60c-4a4a-b40e-3f5fa8d91bac, startPtr=WALPointer [idx=0, fileOff=70922, len=1963], checkpointBeforeLockTime=1ms, checkpointLockWait=3ms, checkpointListenersExecuteTime=2ms, checkpointLockHoldTime=2ms, walCpRecordFsyncDuration=1ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=1ms, pages=16, reason='node started'] [21:04:48] : [Step 4/5] [2021-11-19 21:04:48,689][INFO ][grid-nio-worker-tcp-comm-1-#8851%TcpCommunicationSpi%][TcpCommunicationSpi] Accepted incoming communication connection [locAddr=/127.0.0.1:45150, rmtAddr=/127.0.0.1:59498] [21:04:48] : [Step 4/5] [2021-11-19 21:04:48,693][INFO ][grid-nio-worker-tcp-comm-0-#8968%TcpCommunicationSpi%][TcpCommunicationSpi] Established outgoing communication connection [locAddr=/127.0.0.1:59498, rmtAddr=/127.0.0.1:45150] [21:04:48] : [Step 4/5] [2021-11-19 21:04:48,694][INFO ][exchange-worker-#9033%grid-6%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], crd=false] [21:04:48] : [Step 4/5] [2021-11-19 21:04:48,696][INFO ][sys-#8887%grid-0%][GridDhtPartitionsExchangeFuture] Coordinator received single message [ver=AffinityTopologyVersion [topVer=3, minorTopVer=1], node=60f14a89-74b5-490a-9959-d77f98a1a006, allReceived=true] [21:04:48] : [Step 4/5] [2021-11-19 21:04:48,696][INFO ][sys-#8887%grid-0%][GridDhtPartitionsExchangeFuture] finishExchangeOnCoordinator [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=1]] [21:04:48] : [Step 4/5] [2021-11-19 21:04:48,705][INFO ][sys-#8887%grid-0%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], err=null, rebalanced=true, wasRebalanced=false] [21:04:48] : [Step 4/5] [2021-11-19 21:04:48,705][INFO ][disco-notifier-worker-#8906%grid-0%][GridClusterStateProcessor] Received state change finish message: ACTIVE [21:04:48] : [Step 4/5] [2021-11-19 21:04:48,706][INFO ][disco-notifier-worker-#8906%grid-0%][GridClusterStateProcessor] Cluster state was changed from INACTIVE to ACTIVE [21:04:48] : [Step 4/5] [2021-11-19 21:04:48,706][INFO ][disco-notifier-worker-#9024%grid-6%][GridClusterStateProcessor] Received state change finish message: ACTIVE [21:04:48] : [Step 4/5] [2021-11-19 21:04:48,708][INFO ][disco-notifier-worker-#9024%grid-6%][GridClusterStateProcessor] Cluster state was changed from INACTIVE to ACTIVE [21:04:48] : [Step 4/5] [2021-11-19 21:04:48,708][INFO ][disco-notifier-worker-#9119%client1%][GridClusterStateProcessor] Received state change finish message: ACTIVE [21:04:48] : [Step 4/5] [2021-11-19 21:04:48,709][INFO ][disco-notifier-worker-#9119%client1%][GridClusterStateProcessor] Cluster state was changed from INACTIVE to ACTIVE [21:04:48] : [Step 4/5] [2021-11-19 21:04:48,706][INFO ][db-checkpoint-thread-#9145%grid-6%][Checkpointer] Checkpoint started [checkpointId=672159d2-95fe-4a40-91bb-e12078caae45, startPtr=WALPointer [idx=0, fileOff=83006, len=1963], checkpointBeforeLockTime=6ms, checkpointLockWait=8ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=8ms, writeCheckpointEntryDuration=12ms, splitAndSortCpPagesDuration=0ms, pages=18, reason='node started'] [21:04:48] : [Step 4/5] [2021-11-19 21:04:48,717][INFO ][sys-#9008%grid-6%][GridCachePartitionExchangeManager] Delay process full message without exchange id (there is exchange in progress) [nodeId=002ddf6e-3774-4bb8-9600-3815e7487000] [21:04:48] : [Step 4/5] [2021-11-19 21:04:48,711][INFO ][sys-#8887%grid-0%][GridCacheProcessor] Finish proxy initialization, cacheName=ignite-sys-cache, localNodeId=002ddf6e-3774-4bb8-9600-3815e7487000 [21:04:48] : [Step 4/5] [2021-11-19 21:04:48,708][INFO ][db-checkpoint-thread-#9140%grid-0%][Checkpointer] Checkpoint finished [cpId=ccdeab13-d60c-4a4a-b40e-3f5fa8d91bac, pages=16, markPos=WALPointer [idx=0, fileOff=70922, len=1963], walSegmentsCovered=[], markDuration=6ms, pagesWrite=7ms, fsync=24ms, total=41ms] [21:04:48] : [Step 4/5] [2021-11-19 21:04:48,708][INFO ][sys-#9003%grid-6%][GridDhtPartitionsExchangeFuture] Received full message, will finish exchange [node=002ddf6e-3774-4bb8-9600-3815e7487000, resVer=AffinityTopologyVersion [topVer=3, minorTopVer=1]] [21:04:48] : [Step 4/5] [2021-11-19 21:04:48,719][INFO ][sys-#8887%grid-0%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=002ddf6e-3774-4bb8-9600-3815e7487000, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=002ddf6e-3774-4bb8-9600-3815e7487000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345088704, loc=true, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=3, minorTopVer=1]] [21:04:48] : [Step 4/5] [2021-11-19 21:04:48,719][INFO ][exchange-worker-#8911%grid-0%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=3, minorTopVer=1], force=false, evt=DISCOVERY_CUSTOM_EVT, node=002ddf6e-3774-4bb8-9600-3815e7487000] [21:04:48] : [Step 4/5] [2021-11-19 21:04:48,719][INFO ][sys-#8902%grid-0%][DistributedBaselineConfiguration] Baseline auto-adjust is 'disabled' with timeout='300000' ms [21:04:48] : [Step 4/5] [2021-11-19 21:04:48,718][INFO ][sys-#9155%client1%][GridCachePartitionExchangeManager] Delay process full message without exchange id (there is exchange in progress) [nodeId=002ddf6e-3774-4bb8-9600-3815e7487000] [21:04:48] : [Step 4/5] [2021-11-19 21:04:48,721][INFO ][sys-#8902%grid-0%][GridClusterStateProcessor] Successfully performed final activation steps [nodeId=002ddf6e-3774-4bb8-9600-3815e7487000, client=false, topVer=AffinityTopologyVersion [topVer=3, minorTopVer=1]] [21:04:48] : [Step 4/5] [2021-11-19 21:04:48,721][INFO ][sys-#8887%grid-0%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (1 ms), stage="Update caches registry" (47 ms), stage="Start caches" (0 ms), stage="Affinity initialization on cache group start" (0 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Restore partition states" (0 ms), stage="After states restored callback" (17 ms), stage="WAL history reservation" (0 ms), stage="Waiting for all single messages" (22 ms), stage="Affinity recalculation (crd)" (0 ms), stage="Collect update counters and create affinity messages" (0 ms), stage="Assign partitions states" (1 ms), stage="Validate partitions states" (0 ms), stage="Ideal affinity diff calculation (enforced)" (0 ms), stage="Apply update counters" (0 ms), stage="Full message preparing" (4 ms), stage="Full message sending" (0 ms), stage="State finish message sending" (1 ms), stage="Detect lost partitions" (3 ms), stage="Exchange done" (11 ms), stage="Total time" (107 ms), Discovery lag=3 ms, Latest started node id=60f14a89-74b5-490a-9959-d77f98a1a006] [21:04:48] : [Step 4/5] [2021-11-19 21:04:48,725][INFO ][sys-#8887%grid-0%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], stage="Affinity initialization on cache group start [grp=ignite-sys-cache]" (0 ms) (parent=Affinity initialization on cache group start), stage="Affinity centralized initialization (crd) [grp=ignite-sys-cache, crd=true]" (0 ms) (parent=Determine exchange type), stage="Restore partition states [grp=ignite-sys-cache]" (0 ms) (parent=Restore partition states), stage="Affinity recalculation (partitions availability) [grp=ignite-sys-cache]" (0 ms) (parent=Ideal affinity diff calculation (enforced))] [21:04:48] : [Step 4/5] [2021-11-19 21:04:48,720][INFO ][sys-#9003%grid-6%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], err=null, rebalanced=true, wasRebalanced=false] [21:04:48] : [Step 4/5] [2021-11-19 21:04:48,738][INFO ][sys-#9161%client1%][GridDhtPartitionsExchangeFuture] Received full message, will finish exchange [node=002ddf6e-3774-4bb8-9600-3815e7487000, resVer=AffinityTopologyVersion [topVer=3, minorTopVer=1]] [21:04:48] : [Step 4/5] [2021-11-19 21:04:48,740][INFO ][sys-#9003%grid-6%][GridCacheProcessor] Finish proxy initialization, cacheName=ignite-sys-cache, localNodeId=60f14a89-74b5-490a-9959-d77f98a1a006 [21:04:48] : [Step 4/5] [2021-11-19 21:04:48,741][INFO ][sys-#9013%grid-6%][DistributedBaselineConfiguration] Baseline auto-adjust is 'disabled' with timeout='300000' ms [21:04:48] : [Step 4/5] [2021-11-19 21:04:48,741][INFO ][sys-#9013%grid-6%][GridClusterStateProcessor] Successfully performed final activation steps [nodeId=60f14a89-74b5-490a-9959-d77f98a1a006, client=false, topVer=AffinityTopologyVersion [topVer=3, minorTopVer=1]] [21:04:48] : [Step 4/5] [2021-11-19 21:04:48,742][INFO ][db-checkpoint-thread-#9145%grid-6%][Checkpointer] Checkpoint finished [cpId=672159d2-95fe-4a40-91bb-e12078caae45, pages=18, markPos=WALPointer [idx=0, fileOff=83006, len=1963], walSegmentsCovered=[], markDuration=32ms, pagesWrite=7ms, fsync=18ms, total=71ms] [21:04:48] : [Step 4/5] [2021-11-19 21:04:48,746][INFO ][exchange-worker-#9033%grid-6%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=3, minorTopVer=1], force=false, evt=DISCOVERY_CUSTOM_EVT, node=002ddf6e-3774-4bb8-9600-3815e7487000] [21:04:48] : [Step 4/5] [2021-11-19 21:04:48,746][INFO ][sys-#9003%grid-6%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=60f14a89-74b5-490a-9959-d77f98a1a006, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=002ddf6e-3774-4bb8-9600-3815e7487000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345088253, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=3, minorTopVer=1]] [21:04:48] : [Step 4/5] [2021-11-19 21:04:48,748][INFO ][sys-#9003%grid-6%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (2 ms), stage="Update caches registry" (50 ms), stage="Start caches" (0 ms), stage="Affinity initialization on cache group start" (2 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Restore partition states" (0 ms), stage="After states restored callback" (22 ms), stage="WAL history reservation" (0 ms), stage="Waiting for Full message" (21 ms), stage="Affinity recalculation" (11 ms), stage="Full map updating" (0 ms), stage="Detect lost partitions" (17 ms), stage="Exchange done" (9 ms), stage="Total time" (134 ms)] [21:04:48] : [Step 4/5] [2021-11-19 21:04:48,748][INFO ][sys-#9161%client1%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], err=null, rebalanced=true, wasRebalanced=false] [21:04:48] : [Step 4/5] [2021-11-19 21:04:48,750][INFO ][sys-#9003%grid-6%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], stage="Affinity initialization on cache group start [grp=ignite-sys-cache]" (2 ms) (parent=Affinity initialization on cache group start), stage="Affinity centralized initialization (crd) [grp=ignite-sys-cache, crd=false]" (0 ms) (parent=Determine exchange type), stage="Restore partition states [grp=ignite-sys-cache]" (0 ms) (parent=Restore partition states), stage="Affinity applying from full message [grp=ignite-sys-cache]" (11 ms) (parent=Affinity recalculation)] [21:04:48] : [Step 4/5] [2021-11-19 21:04:48,753][INFO ][sys-#9161%client1%][GridCacheProcessor] Finish proxy initialization, cacheName=ignite-sys-cache, localNodeId=10229b7e-8c8b-484a-a25e-0ae6708fa001 [21:04:48] : [Step 4/5] [2021-11-19 21:04:48,759][INFO ][exchange-worker-#9128%client1%][GridCachePartitionExchangeManager] AffinityTopologyVersion [topVer=3, minorTopVer=1], evt=DISCOVERY_CUSTOM_EVT, evtNode=002ddf6e-3774-4bb8-9600-3815e7487000, client=true] [21:04:48] : [Step 4/5] [2021-11-19 21:04:48,760][INFO ][sys-#9161%client1%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=10229b7e-8c8b-484a-a25e-0ae6708fa001, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=002ddf6e-3774-4bb8-9600-3815e7487000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345088475, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=3, minorTopVer=1]] [21:04:48] : [Step 4/5] [2021-11-19 21:04:48,760][INFO ][sys-#9169%client1%][DistributedBaselineConfiguration] Baseline auto-adjust is 'disabled' with timeout='300000' ms [21:04:48] : [Step 4/5] [2021-11-19 21:04:48,761][INFO ][sys-#9161%client1%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], stage="Waiting in exchange queue" (4 ms), stage="Exchange parameters initialization" (3 ms), stage="Update caches registry" (4 ms), stage="Start caches" (1 ms), stage="Affinity initialization on cache group start" (19 ms), stage="Determine exchange type" (9 ms), stage="Waiting for Full message" (85 ms), stage="Affinity recalculation" (8 ms), stage="Full map updating" (2 ms), stage="Detect lost partitions" (4 ms), stage="Exchange done" (8 ms), stage="Total time" (147 ms)] [21:04:48] : [Step 4/5] [2021-11-19 21:04:48,761][INFO ][sys-#9169%client1%][GridClusterStateProcessor] Successfully performed final activation steps [nodeId=10229b7e-8c8b-484a-a25e-0ae6708fa001, client=true, topVer=AffinityTopologyVersion [topVer=3, minorTopVer=1]] [21:04:48] : [Step 4/5] [2021-11-19 21:04:48,763][INFO ][sys-#9161%client1%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], stage="Affinity initialization on cache group start [grp=ignite-sys-cache]" (19 ms) (parent=Affinity initialization on cache group start), stage="Affinity centralized initialization (crd) [grp=ignite-sys-cache, crd=false]" (9 ms) (parent=Determine exchange type), stage="Affinity applying from full message [grp=ignite-sys-cache]" (8 ms) (parent=Affinity recalculation)] [21:04:48]W: [org.apache.ignite:ignite-core] [2021-11-19 21:04:48,772][WARN ][test-runner-#8795%encryption.EncryptedCacheNodeJoinTest%][G] Ignite work directory is not provided, automatically resolved to: /opt/buildagent/work/7bc1c54bc719b67c/work [21:04:48] : [Step 4/5] [2021-11-19 21:04:48,774][INFO ][test-runner-#8795%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%client] [21:04:48] : [Step 4/5] [21:04:48] : [Step 4/5] >>> __________ ________________ [21:04:48] : [Step 4/5] >>> / _/ ___/ |/ / _/_ __/ __/ [21:04:48] : [Step 4/5] >>> _/ // (7 7 // / / / / _/ [21:04:48] : [Step 4/5] >>> /___/\___/_/|_/___/ /_/ /___/ [21:04:48] : [Step 4/5] >>> [21:04:48] : [Step 4/5] >>> ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:04:48] : [Step 4/5] >>> 2021 Copyright(C) Apache Software Foundation [21:04:48] : [Step 4/5] >>> [21:04:48] : [Step 4/5] >>> Ignite documentation: http://ignite.apache.org [21:04:48] : [Step 4/5] [21:04:48] : [Step 4/5] [2021-11-19 21:04:48,775][INFO ][test-runner-#8795%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%client] Config URL: n/a [21:04:48] : [Step 4/5] [2021-11-19 21:04:48,775][INFO ][test-runner-#8795%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%client] IgniteConfiguration [igniteInstanceName=client, pubPoolSize=24, svcPoolSize=24, callbackPoolSize=24, stripedPoolSize=24, sysPoolSize=24, mgmtPoolSize=4, dataStreamerPoolSize=24, utilityCachePoolSize=24, utilityCacheKeepAliveTime=60000, p2pPoolSize=2, qryPoolSize=24, buildIdxPoolSize=4, igniteHome=/opt/buildagent/work/7bc1c54bc719b67c, igniteWorkDir=/opt/buildagent/work/7bc1c54bc719b67c/work, mbeanSrv=com.sun.jmx.mbeanserver.JmxMBeanServer@6fe85038, nodeId=ee112b36-72a3-4605-bcc6-5e57ce2b3710, marsh=BinaryMarshaller [], marshLocJobs=false, daemon=false, p2pEnabled=true, netTimeout=10000, netCompressionLevel=1, sndRetryDelay=1000, sndRetryCnt=3, metricsHistSize=10000, metricsUpdateFreq=1000, metricsExpTime=9223372036854775807, discoSpi=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=0, ackTimeout=0, marsh=null, reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], segPlc=STOP, segResolveAttempts=2, waitForSegOnStart=true, allResolversPassReq=true, segChkFreq=10000, commSpi=TcpCommunicationSpi [connectGate=org.apache.ignite.spi.communication.tcp.internal.ConnectGateway@bf1533b, ctxInitLatch=java.util.concurrent.CountDownLatch@2d4ddbf4[Count = 1], stopping=false, clientPool=null, nioSrvWrapper=null, stateProvider=null], evtSpi=MemoryEventStorageSpi [expireAgeMs=9223372036854775807, expireCnt=10000, filter=null], colSpi=NoopCollisionSpi [], deploySpi=LocalDeploymentSpi [], indexingSpi=org.apache.ignite.spi.indexing.noop.NoopIndexingSpi@6465c7f6, addrRslvr=null, encryptionSpi=org.apache.ignite.spi.encryption.noop.NoopEncryptionSpi@6c024245, tracingSpi=org.apache.ignite.spi.tracing.NoopTracingSpi@24f8804c, clientMode=true, rebalanceThreadPoolSize=4, rebalanceTimeout=10000, rebalanceBatchesPrefetchCnt=3, rebalanceThrottle=0, rebalanceBatchSize=524288, txCfg=TransactionConfiguration [txSerEnabled=false, dfltIsolation=REPEATABLE_READ, dfltConcurrency=PESSIMISTIC, dfltTxTimeout=0, txTimeoutOnPartitionMapExchange=0, deadlockTimeout=10000, pessimisticTxLogSize=0, pessimisticTxLogLinger=10000, tmLookupClsName=null, txManagerFactory=null, useJtaSync=false], cacheSanityCheckEnabled=true, discoStartupDelay=60000, deployMode=SHARED, p2pMissedCacheSize=100, locHost=127.0.0.1, timeSrvPortBase=31100, timeSrvPortRange=100, failureDetectionTimeout=10000, sysWorkerBlockedTimeout=null, clientFailureDetectionTimeout=10000, metricsLogFreq=0, connectorCfg=null, odbcCfg=null, warmupClos=null, atomicCfg=AtomicConfiguration [seqReserveSize=1000, cacheMode=PARTITIONED, backups=1, aff=null, grpName=null], classLdr=null, sslCtxFactory=null, platformCfg=null, binaryCfg=null, memCfg=null, pstCfg=null, dsCfg=DataStorageConfiguration [sysRegionInitSize=41943040, sysRegionMaxSize=104857600, pageSize=4096, concLvl=0, dfltDataRegConf=DataRegionConfiguration [name=default, maxSize=10485760, initSize=268435456, swapPath=null, pageEvictionMode=DISABLED, pageReplacementMode=CLOCK, evictionThreshold=0.9, emptyPagesPoolSize=100, metricsEnabled=false, metricsSubIntervalCount=5, metricsRateTimeInterval=60000, persistenceEnabled=true, checkpointPageBufSize=0, lazyMemoryAllocation=true, warmUpCfg=null], dataRegions=null, storagePath=null, checkpointFreq=180000, lockWaitTime=10000, checkpointThreads=4, checkpointWriteOrder=SEQUENTIAL, walHistSize=20, maxWalArchiveSize=1073741824, walSegments=10, walSegmentSize=67108864, walPath=db/wal, walArchivePath=db/wal/archive, cdcWalPath=db/wal/cdc, cdcEnabled=false, metricsEnabled=false, walMode=FSYNC, walTlbSize=131072, walBuffSize=0, walFlushFreq=2000, walFsyncDelay=1000, walRecordIterBuffSize=67108864, alwaysWriteFullPages=false, fileIOFactory=org.apache.ignite.internal.processors.cache.persistence.file.AsyncFileIOFactory@28ddd5a1, metricsSubIntervalCnt=5, metricsRateTimeInterval=60000, walAutoArchiveAfterInactivity=-1, walForceArchiveTimeout=-1, writeThrottlingEnabled=false, walCompactionEnabled=false, walCompactionLevel=1, checkpointReadLockTimeout=null, walPageCompression=DISABLED, walPageCompressionLevel=null, dfltWarmUpCfg=null, encCfg=org.apache.ignite.configuration.EncryptionConfiguration@d86ded8, defragmentationThreadPoolSize=4, minWalArchiveSize=-1], snapshotPath=snapshots, activeOnStart=true, activeOnStartPropSetFlag=false, autoActivation=true, autoActivationPropSetFlag=false, clusterStateOnStart=null, sqlConnCfg=null, cliConnCfg=ClientConnectorConfiguration [host=null, port=10800, portRange=100, sockSndBufSize=0, sockRcvBufSize=0, tcpNoDelay=true, maxOpenCursorsPerConn=128, threadPoolSize=24, selectorCnt=12, idleTimeout=0, handshakeTimeout=10000, jdbcEnabled=true, odbcEnabled=true, thinCliEnabled=true, sslEnabled=false, useIgniteSslCtxFactory=true, sslClientAuth=false, sslCtxFactory=null, thinCliCfg=ThinClientConfiguration [maxActiveTxPerConn=100, maxActiveComputeTasksPerConn=0]], mvccVacuumThreadCnt=2, mvccVacuumFreq=5000, authEnabled=false, failureHnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]], commFailureRslvr=null, sqlCfg=SqlConfiguration [longQryWarnTimeout=3000, dfltQryTimeout=0, sqlQryHistSize=1000, validationEnabled=false], asyncContinuationExecutor=null] [21:04:48] : [Step 4/5] [2021-11-19 21:04:48,785][INFO ][test-runner-#8795%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%client] Daemon mode: off [21:04:48] : [Step 4/5] [2021-11-19 21:04:48,786][INFO ][test-runner-#8795%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%client] OS: Linux 4.15.0-151-generic amd64 [21:04:48] : [Step 4/5] [2021-11-19 21:04:48,786][INFO ][test-runner-#8795%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%client] OS user: teamcity [21:04:48] : [Step 4/5] [2021-11-19 21:04:48,786][INFO ][test-runner-#8795%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%client] PID: 16724 [21:04:48] : [Step 4/5] [2021-11-19 21:04:48,787][INFO ][test-runner-#8795%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%client] Language runtime: Java Platform API Specification ver. 1.8 [21:04:48] : [Step 4/5] [2021-11-19 21:04:48,787][INFO ][test-runner-#8795%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%client] VM information: Java(TM) SE Runtime Environment 1.8.0_261-b12 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 25.261-b12 [21:04:48] : [Step 4/5] [2021-11-19 21:04:48,788][INFO ][test-runner-#8795%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%client] VM total memory: 1.9GB [21:04:48] : [Step 4/5] [2021-11-19 21:04:48,788][INFO ][test-runner-#8795%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%client] Remote Management [restart: off, REST: off, JMX (remote: off)] [21:04:48] : [Step 4/5] [2021-11-19 21:04:48,788][INFO ][test-runner-#8795%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%client] Logger: GridTestLog4jLogger [quiet=false, config=null] [21:04:48] : [Step 4/5] [2021-11-19 21:04:48,788][INFO ][test-runner-#8795%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%client] IGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c [21:04:48] : [Step 4/5] [2021-11-19 21:04:48,789][INFO ][test-runner-#8795%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%client] VM arguments: [-DIGNITE_DUMP_THREADS_ON_FAILURE=false, -DMono=/usr/bin/mono-sgen, -DMono4.0_x64=/usr/lib/mono/4.0, -DMono4.5_x64=/usr/lib/mono/4.5, -DMonoVersion=6.12.0.90, -DSKIP_BUILD=false, -Dagent.home.dir=/opt/buildagent, -Dagent.name=aitc-lin02_03, -Dagent.ownPort=9090, -Dagent.work.dir=/opt/buildagent/work, -Dbuild.number=95, -Dbuild.vcs.number=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.1=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.GitHubApacheIgnite=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dclassworlds.conf=/opt/buildagent/temp/buildTmp/teamcity.m2.conf, -Dcom.jetbrains.maven.watcher.report.file=/opt/buildagent/temp/buildTmp/maven-build-info.xml, -Djava.io.tmpdir=/opt/buildagent/temp/buildTmp, -Dmaven.home=/opt/buildagent/tools/maven3_6, -Dmaven.multiModuleProjectDirectory=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.agent.cpuBenchmark=457, -Dteamcity.agent.dotnet.agent_url=http://localhost:9090/RPC2, -Dteamcity.agent.dotnet.build_id=6278078, -Dteamcity.auth.password=*******, -Dteamcity.auth.userId=TeamCityBuildId=6278078, -Dteamcity.build.changedFiles.file=/opt/buildagent/temp/buildTmp/changedFiles6342607772318147725.txt, -Dteamcity.build.checkoutDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.build.id=6278078, -Dteamcity.build.properties.file=/opt/buildagent/temp/buildTmp/teamcity.build5164517880467851002.properties, -Dteamcity.build.tempDir=/opt/buildagent/temp/buildTmp, -Dteamcity.build.workingDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.buildConfName=Basic 3, -Dteamcity.buildType.id=IgniteTests24Java8_Basic3, -Dteamcity.configuration.properties.file=/opt/buildagent/temp/buildTmp/teamcity.config5591980786735343870.properties, -Dteamcity.maven.userSettings.path=/opt/buildagent/temp/buildTmp/maven_settings_585072866407032347.xml, -Dteamcity.maven.watcher.home=/opt/buildagent/plugins/mavenPlugin/maven-watcher-jdk16, -Dteamcity.projectName=Ignite Tests 2.x (JDK 8/11), -Dteamcity.runner.properties.file=/opt/buildagent/temp/buildTmp/teamcity.runner9098465561618137420.properties, -Dteamcity.tests.recentlyFailedTests.file=/opt/buildagent/temp/buildTmp/testsToRunFirst3891775683130404069.txt, -Dteamcity.version=2021.2 (build 99542), -ea, -Xms2g, -Xmx2g, -XX:+HeapDumpOnOutOfMemoryError, -DIGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_TEST_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_UPDATE_NOTIFIER=false, -DIGNITE_NO_DISCO_ORDER=true, -DIGNITE_PERFORMANCE_SUGGESTIONS_DISABLED=true, -Djava.net.preferIPv4Stack=true, -DTEST_SCALE_FACTOR=1.0, -DIGNITE_TEST_PROP_LOG4J_FILE=log4j-tc-test.xml, -DIGNITE_QUIET=false, -DIGNITE_MARSHAL_BUFFERS_RECHECK=1000, -Dmaven.repo.local=/opt/buildagent/.m2/repository] [21:04:48] : [Step 4/5] [2021-11-19 21:04:48,794][INFO ][test-runner-#8795%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%client] System cache's DataRegion size is configured to 40 MB. Use DataStorageConfiguration.systemRegionInitialSize property to change the setting. [21:04:48] : [Step 4/5] [2021-11-19 21:04:48,794][INFO ][test-runner-#8795%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%client] Configured caches [in 'sysMemPlc' dataRegion: ['ignite-sys-cache'], in 'default' dataRegion: ['encrypted']] [21:04:48]W: [org.apache.ignite:ignite-core] [2021-11-19 21:04:48,795][WARN ][test-runner-#8795%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%client] Peer class loading is enabled (disable it in production for performance and deployment consistency reasons) [21:04:48] : [Step 4/5] [2021-11-19 21:04:48,795][INFO ][test-runner-#8795%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%client] 3-rd party licenses can be found at: /opt/buildagent/work/7bc1c54bc719b67c/libs/licenses [21:04:48] : [Step 4/5] [2021-11-19 21:04:48,801][INFO ][test-runner-#8795%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] Configured plugins: [21:04:48] : [Step 4/5] [2021-11-19 21:04:48,802][INFO ][test-runner-#8795%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- StanByClusterTestProvider 1.0 [21:04:48] : [Step 4/5] [2021-11-19 21:04:48,802][INFO ][test-runner-#8795%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- null [21:04:48] : [Step 4/5] [2021-11-19 21:04:48,802][INFO ][test-runner-#8795%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] [21:04:48] : [Step 4/5] [2021-11-19 21:04:48,802][INFO ][test-runner-#8795%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- PageMemory tracker plugin 1.0 [21:04:48] : [Step 4/5] [2021-11-19 21:04:48,803][INFO ][test-runner-#8795%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- null [21:04:48] : [Step 4/5] [2021-11-19 21:04:48,803][INFO ][test-runner-#8795%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] [21:04:48] : [Step 4/5] [2021-11-19 21:04:48,803][INFO ][test-runner-#8795%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- TestDistibutedConfigurationPlugin 1.0 [21:04:48] : [Step 4/5] [2021-11-19 21:04:48,803][INFO ][test-runner-#8795%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- null [21:04:48] : [Step 4/5] [2021-11-19 21:04:48,804][INFO ][test-runner-#8795%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] [21:04:48] : [Step 4/5] [2021-11-19 21:04:48,804][INFO ][test-runner-#8795%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- NodeValidationPluginProvider 1.0 [21:04:48] : [Step 4/5] [2021-11-19 21:04:48,804][INFO ][test-runner-#8795%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- null [21:04:48] : [Step 4/5] [2021-11-19 21:04:48,804][INFO ][test-runner-#8795%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] [21:04:48] : [Step 4/5] [2021-11-19 21:04:48,805][INFO ][test-runner-#8795%encryption.EncryptedCacheNodeJoinTest%][FailureProcessor] Configured failure handler: [hnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]]] [21:04:48] : [Step 4/5] [2021-11-19 21:04:48,820][INFO ][test-runner-#8795%encryption.EncryptedCacheNodeJoinTest%][TcpCommunicationSpi] Successfully bound communication NIO server to TCP port [port=45153, locHost=/127.0.0.1, selectorsCnt=12, selectorSpins=0, pairedConn=false] [21:04:48]W: [org.apache.ignite:ignite-core] [2021-11-19 21:04:48,820][WARN ][test-runner-#8795%encryption.EncryptedCacheNodeJoinTest%][TcpCommunicationSpi] Message queue limit is set to 0 which may lead to potential OOMEs when running cache operations in FULL_ASYNC or PRIMARY_SYNC modes due to message queues growth on sender and receiver sides. [21:04:48] : [Step 4/5] [2021-11-19 21:04:48,827][INFO ][test-runner-#8795%encryption.EncryptedCacheNodeJoinTest%][GridCollisionManager] Collision resolution is disabled (all jobs will be activated upon arrival). [21:04:48] : [Step 4/5] [2021-11-19 21:04:48,827][INFO ][test-runner-#8795%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%client] Security status [authentication=off, sandbox=off, tls/ssl=off] [21:04:48]W: [org.apache.ignite:ignite-core] [2021-11-19 21:04:48,833][WARN ][test-runner-#8795%encryption.EncryptedCacheNodeJoinTest%][GridCacheProcessor] Persistent Store is not supported on client nodes (Persistent Store's configuration will be ignored). [21:04:48] : [Step 4/5] [2021-11-19 21:04:48,838][INFO ][test-runner-#8795%encryption.EncryptedCacheNodeJoinTest%][IgniteCacheDatabaseSharedManager] Configured data regions initialized successfully [total=4] [21:04:48] : [Step 4/5] [2021-11-19 21:04:48,844][INFO ][test-runner-#8795%encryption.EncryptedCacheNodeJoinTest%][ClientListenerProcessor] Client connector processor has started on TCP port 10803 [21:04:48] : [Step 4/5] [2021-11-19 21:04:48,848][INFO ][test-runner-#8795%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%client] Non-loopback local IPs: 172.17.0.4 [21:04:48] : [Step 4/5] [2021-11-19 21:04:48,848][INFO ][test-runner-#8795%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%client] Enabled local MACs: 0242AC110004 [21:04:48] : [Step 4/5] [2021-11-19 21:04:48,849][INFO ][test-runner-#8795%encryption.EncryptedCacheNodeJoinTest%][ClusterProcessor] Cluster ID and tag has been read from metastorage: null [21:04:48] : [Step 4/5] [2021-11-19 21:04:48,850][INFO ][test-runner-#8795%encryption.EncryptedCacheNodeJoinTest%][IgniteClusterImpl] Shutdown policy was updated [oldVal=null, newVal=null] [21:04:48] : [Step 4/5] [2021-11-19 21:04:48,855][INFO ][tcp-disco-srvr-[:47500]-#450%grid-0%-#8908%grid-0%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=44071] [21:04:48] : [Step 4/5] [2021-11-19 21:04:48,855][INFO ][tcp-disco-srvr-[:47500]-#450%grid-0%-#8908%grid-0%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=44071] [21:04:48] : [Step 4/5] [2021-11-19 21:04:48,856][INFO ][tcp-disco-sock-reader-[]-#473%grid-0%-#9259%grid-0%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:44071, rmtPort=44071] [21:04:48] : [Step 4/5] [2021-11-19 21:04:48,857][INFO ][tcp-disco-sock-reader-[ee112b36 127.0.0.1:44071 client]-#473%grid-0%-#9259%grid-0%][TestTcpDiscoverySpi] Initialized connection with remote client node [nodeId=ee112b36-72a3-4605-bcc6-5e57ce2b3710, rmtAddr=/127.0.0.1:44071] [21:04:48]W: [org.apache.ignite:ignite-core] [2021-11-19 21:04:48,875][WARN ][disco-pool-#9261%grid-0%][TestTcpDiscoverySpi] Joining node has encrypted caches which are not presented on the cluster, encrypted caches configured on client node cannot be started when such node joins the cluster, these caches can be started manually (dynamically) after node joined[caches=encrypted] [21:04:48] : [Step 4/5] [2021-11-19 21:04:48,879][INFO ][tcp-disco-sock-reader-[ee112b36 127.0.0.1:44071 client]-#473%grid-0%-#9259%grid-0%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:44071, rmtPort=44071, rmtNodeId=ee112b36-72a3-4605-bcc6-5e57ce2b3710] [21:04:48]W: [org.apache.ignite:ignite-core] [2021-11-19 21:04:48,882][ERROR][test-runner-#8795%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%client] Failed to start manager: GridManagerAdapter [enabled=true, name=o.a.i.i.managers.discovery.GridDiscoveryManager] [21:04:48]W: [org.apache.ignite:ignite-core] class org.apache.ignite.IgniteCheckedException: Failed to start SPI: TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=5000, ackTimeout=5000, marsh=JdkMarshaller [clsFilter=org.apache.ignite.marshaller.MarshallerUtils$1@68c4cebf], reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false] [21:04:48]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.managers.GridManagerAdapter.startSpi(GridManagerAdapter.java:281) [21:04:48]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.managers.discovery.GridDiscoveryManager.start(GridDiscoveryManager.java:1091) [21:04:48]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.IgniteKernal.startManager(IgniteKernal.java:1953) [21:04:48]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.IgniteKernal.start(IgniteKernal.java:1300) [21:04:48]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.IgnitionEx$IgniteNamedInstance.start0(IgnitionEx.java:1798) [21:04:48]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.IgnitionEx$IgniteNamedInstance.start(IgnitionEx.java:1720) [21:04:48]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.IgnitionEx.start0(IgnitionEx.java:1159) [21:04:48]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.IgnitionEx.start(IgnitionEx.java:629) [21:04:48]W: [org.apache.ignite:ignite-core] at org.apache.ignite.testframework.junits.GridAbstractTest.startGrid(GridAbstractTest.java:1252) [21:04:48]W: [org.apache.ignite:ignite-core] at org.apache.ignite.testframework.junits.GridAbstractTest.startGrid(GridAbstractTest.java:1169) [21:04:48]W: [org.apache.ignite:ignite-core] at org.apache.ignite.testframework.junits.GridAbstractTest.startClientGrid(GridAbstractTest.java:1107) [21:04:48]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.encryption.EncryptedCacheNodeJoinTest.lambda$checkNodeJoinWithStaticCacheConfig$3(EncryptedCacheNodeJoinTest.java:290) [21:04:48]W: [org.apache.ignite:ignite-core] at org.apache.ignite.testframework.GridTestUtils.assertThrowsAnyCause(GridTestUtils.java:545) [21:04:48]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.encryption.EncryptedCacheNodeJoinTest.checkNodeJoinWithStaticCacheConfig(EncryptedCacheNodeJoinTest.java:290) [21:04:48]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.encryption.EncryptedCacheNodeJoinTest.testClientNodeJoinActiveClusterWithNewStaticCacheConfig(EncryptedCacheNodeJoinTest.java:227) [21:04:48]W: [org.apache.ignite:ignite-core] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) [21:04:48]W: [org.apache.ignite:ignite-core] at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) [21:04:48]W: [org.apache.ignite:ignite-core] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [21:04:48]W: [org.apache.ignite:ignite-core] at java.lang.reflect.Method.invoke(Method.java:498) [21:04:48]W: [org.apache.ignite:ignite-core] at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50) [21:04:48]W: [org.apache.ignite:ignite-core] at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) [21:04:48]W: [org.apache.ignite:ignite-core] at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47) [21:04:48]W: [org.apache.ignite:ignite-core] at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) [21:04:48]W: [org.apache.ignite:ignite-core] at org.apache.ignite.testframework.junits.GridAbstractTest$7.run(GridAbstractTest.java:2432) [21:04:48]W: [org.apache.ignite:ignite-core] at java.lang.Thread.run(Thread.java:748) [21:04:48]W: [org.apache.ignite:ignite-core] Caused by: class org.apache.ignite.spi.IgniteSpiException: Joining node has encrypted caches which are not presented on the cluster, encrypted caches configured on client node cannot be started when such node joins the cluster, these caches can be started manually (dynamically) after node joined[caches=encrypted] [21:04:48]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.discovery.tcp.TcpDiscoverySpi.checkFailedError(TcpDiscoverySpi.java:2108) [21:04:48]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.discovery.tcp.ClientImpl$MessageWorker.body(ClientImpl.java:1996) [21:04:48]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:125) [21:04:48]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.discovery.tcp.ClientImpl$1.body(ClientImpl.java:317) [21:04:48]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.IgniteSpiThread.run(IgniteSpiThread.java:58) [21:04:48]W: [org.apache.ignite:ignite-core] [2021-11-19 21:04:48,893][ERROR][test-runner-#8795%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%client] Got exception while starting (will rollback startup routine). [21:04:48]W: [org.apache.ignite:ignite-core] class org.apache.ignite.IgniteCheckedException: Failed to start manager: GridManagerAdapter [enabled=true, name=org.apache.ignite.internal.managers.discovery.GridDiscoveryManager] [21:04:48]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.IgniteKernal.startManager(IgniteKernal.java:1958) [21:04:48]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.IgniteKernal.start(IgniteKernal.java:1300) [21:04:48]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.IgnitionEx$IgniteNamedInstance.start0(IgnitionEx.java:1798) [21:04:48]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.IgnitionEx$IgniteNamedInstance.start(IgnitionEx.java:1720) [21:04:48]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.IgnitionEx.start0(IgnitionEx.java:1159) [21:04:48]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.IgnitionEx.start(IgnitionEx.java:629) [21:04:48]W: [org.apache.ignite:ignite-core] at org.apache.ignite.testframework.junits.GridAbstractTest.startGrid(GridAbstractTest.java:1252) [21:04:48]W: [org.apache.ignite:ignite-core] at org.apache.ignite.testframework.junits.GridAbstractTest.startGrid(GridAbstractTest.java:1169) [21:04:48]W: [org.apache.ignite:ignite-core] at org.apache.ignite.testframework.junits.GridAbstractTest.startClientGrid(GridAbstractTest.java:1107) [21:04:48]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.encryption.EncryptedCacheNodeJoinTest.lambda$checkNodeJoinWithStaticCacheConfig$3(EncryptedCacheNodeJoinTest.java:290) [21:04:48]W: [org.apache.ignite:ignite-core] at org.apache.ignite.testframework.GridTestUtils.assertThrowsAnyCause(GridTestUtils.java:545) [21:04:48]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.encryption.EncryptedCacheNodeJoinTest.checkNodeJoinWithStaticCacheConfig(EncryptedCacheNodeJoinTest.java:290) [21:04:48]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.encryption.EncryptedCacheNodeJoinTest.testClientNodeJoinActiveClusterWithNewStaticCacheConfig(EncryptedCacheNodeJoinTest.java:227) [21:04:48]W: [org.apache.ignite:ignite-core] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) [21:04:48]W: [org.apache.ignite:ignite-core] at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) [21:04:48]W: [org.apache.ignite:ignite-core] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [21:04:48]W: [org.apache.ignite:ignite-core] at java.lang.reflect.Method.invoke(Method.java:498) [21:04:48]W: [org.apache.ignite:ignite-core] at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50) [21:04:48]W: [org.apache.ignite:ignite-core] at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) [21:04:48]W: [org.apache.ignite:ignite-core] at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47) [21:04:48]W: [org.apache.ignite:ignite-core] at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) [21:04:48]W: [org.apache.ignite:ignite-core] at org.apache.ignite.testframework.junits.GridAbstractTest$7.run(GridAbstractTest.java:2432) [21:04:48]W: [org.apache.ignite:ignite-core] at java.lang.Thread.run(Thread.java:748) [21:04:48]W: [org.apache.ignite:ignite-core] Caused by: class org.apache.ignite.IgniteCheckedException: Failed to start SPI: TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=5000, ackTimeout=5000, marsh=JdkMarshaller [clsFilter=org.apache.ignite.marshaller.MarshallerUtils$1@68c4cebf], reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false] [21:04:48]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.managers.GridManagerAdapter.startSpi(GridManagerAdapter.java:281) [21:04:48]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.managers.discovery.GridDiscoveryManager.start(GridDiscoveryManager.java:1091) [21:04:48]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.IgniteKernal.startManager(IgniteKernal.java:1953) [21:04:48]W: [org.apache.ignite:ignite-core] ... 22 more [21:04:48]W: [org.apache.ignite:ignite-core] Caused by: class org.apache.ignite.spi.IgniteSpiException: Joining node has encrypted caches which are not presented on the cluster, encrypted caches configured on client node cannot be started when such node joins the cluster, these caches can be started manually (dynamically) after node joined[caches=encrypted] [21:04:48]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.discovery.tcp.TcpDiscoverySpi.checkFailedError(TcpDiscoverySpi.java:2108) [21:04:48]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.discovery.tcp.ClientImpl$MessageWorker.body(ClientImpl.java:1996) [21:04:48]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:125) [21:04:48]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.discovery.tcp.ClientImpl$1.body(ClientImpl.java:317) [21:04:48]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.IgniteSpiThread.run(IgniteSpiThread.java:58) [21:04:48] : [Step 4/5] [2021-11-19 21:04:48,922][INFO ][test-runner-#8795%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%client] [21:04:48] : [Step 4/5] [21:04:48] : [Step 4/5] >>> +------------------------------------------------------+ [21:04:48] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV stopped OK [21:04:48] : [Step 4/5] >>> +------------------------------------------------------+ [21:04:48] : [Step 4/5] >>> Ignite instance name: client [21:04:48] : [Step 4/5] >>> Grid uptime: 00:00:00.147 [21:04:48] : [Step 4/5] [21:04:48] : [Step 4/5] [21:04:48] : [Step 4/5] [2021-11-19 21:04:48,923][INFO ][test-runner-#8795%encryption.EncryptedCacheNodeJoinTest%][root] Caught expected exception: Joining node has encrypted caches which are not presented on the cluster, encrypted caches configured on client node cannot be started when such node joins the cluster, these caches can be started manually (dynamically) after node joined[caches=encrypted] [21:04:48] : [Step 4/5] [21:04:48] >>> Stopping test: EncryptedCacheNodeJoinTest#testClientNodeJoinActiveClusterWithNewStaticCacheConfig in 3030 ms <<< [21:04:48] : [Step 4/5] [2021-11-19 21:04:48,924][INFO ][main][root] >>> Stopping test: EncryptedCacheNodeJoinTest#testClientNodeJoinActiveClusterWithNewStaticCacheConfig in 3030 ms <<< [21:04:48] : [Step 4/5] [21:04:48] >>> Heap: 445 MB used / 1912 MB commited / 1912 MB max <<< [21:04:48] : [Step 4/5] [2021-11-19 21:04:48,925][INFO ][main][root] >>> Heap: 445 MB used / 1912 MB commited / 1912 MB max <<< [21:04:48] : [Step 4/5] [21:04:48] >>> Non-Heap: 140 MB used / 154 MB commited / 0 MB max <<< [21:04:48] : [Step 4/5] [2021-11-19 21:04:48,925][INFO ][main][root] >>> Non-Heap: 140 MB used / 154 MB commited / 0 MB max <<< [21:04:48] : [Step 4/5] [2021-11-19 21:04:48,925][INFO ][main][root] >>> Stopping grid [name=client1, id=10229b7e-8c8b-484a-a25e-0ae6708fa001] [21:04:48] : [Step 4/5] [2021-11-19 21:04:48,939][INFO ][disco-event-worker-#8910%grid-0%][GridDiscoveryManager] Node left topology: TcpDiscoveryNode [id=10229b7e-8c8b-484a-a25e-0ae6708fa001, consistentId=client1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:0], discPort=0, order=3, intOrder=3, lastExchangeTime=1637345088455, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=true] [21:04:48] : [Step 4/5] [2021-11-19 21:04:48,949][INFO ][tcp-disco-sock-reader-[10229b7e 127.0.0.1:39177 client]-#466%grid-6%-#9124%grid-6%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:39177, rmtPort=39177, rmtNodeId=10229b7e-8c8b-484a-a25e-0ae6708fa001] [21:04:48] : [Step 4/5] [2021-11-19 21:04:48,939][INFO ][disco-event-worker-#9032%grid-6%][GridDiscoveryManager] Node left topology: TcpDiscoveryNode [id=10229b7e-8c8b-484a-a25e-0ae6708fa001, consistentId=client1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:0], discPort=0, order=3, intOrder=3, lastExchangeTime=1637345088465, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=true] [21:04:48] : [Step 4/5] [2021-11-19 21:04:48,953][INFO ][disco-event-worker-#8910%grid-0%][GridDiscoveryManager] Topology snapshot [ver=4, locNode=002ddf6e, servers=2, clients=0, state=ACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=002ddf6e-3774-4bb8-9600-3815e7487000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=60f14a89-74b5-490a-9959-d77f98a1a006, consistentId=grid-6, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:04:48] : [Step 4/5] [2021-11-19 21:04:48,954][INFO ][disco-event-worker-#9032%grid-6%][GridDiscoveryManager] Topology snapshot [ver=4, locNode=60f14a89, servers=2, clients=0, state=ACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=002ddf6e-3774-4bb8-9600-3815e7487000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=60f14a89-74b5-490a-9959-d77f98a1a006, consistentId=grid-6, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:04:48] : [Step 4/5] [2021-11-19 21:04:48,956][INFO ][disco-event-worker-#9032%grid-6%][GridDiscoveryManager] ^-- Baseline [id=0, size=2, online=2, offline=0] [21:04:48] : [Step 4/5] [2021-11-19 21:04:48,955][INFO ][disco-event-worker-#8910%grid-0%][GridDiscoveryManager] ^-- Baseline [id=0, size=2, online=2, offline=0] [21:04:48]W: [org.apache.ignite:ignite-core] [2021-11-19 21:04:48,957][WARN ][grid-nio-worker-tcp-comm-0-#8850%TcpCommunicationSpi%][TcpCommunicationSpi] Failed to shutdown socket [21:04:48]W: [org.apache.ignite:ignite-core] java.nio.channels.ClosedChannelException [21:04:48]W: [org.apache.ignite:ignite-core] at sun.nio.ch.SocketChannelImpl.shutdownOutput(SocketChannelImpl.java:795) [21:04:48]W: [org.apache.ignite:ignite-core] at sun.nio.ch.SocketAdaptor.shutdownOutput(SocketAdaptor.java:407) [21:04:48]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.close(IgniteUtils.java:4247) [21:04:48]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.closeKey(GridNioServer.java:2784) [21:04:48]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.close(GridNioServer.java:2835) [21:04:48]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.close(GridNioServer.java:2794) [21:04:48]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.bodyInternal(GridNioServer.java:2157) [21:04:48]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.body(GridNioServer.java:1910) [21:04:48]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:125) [21:04:48]W: [org.apache.ignite:ignite-core] at java.lang.Thread.run(Thread.java:748) [21:04:48] : [Step 4/5] [2021-11-19 21:04:48,958][INFO ][exchange-worker-#8911%grid-0%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], crd=true, evt=NODE_LEFT, evtNode=10229b7e-8c8b-484a-a25e-0ae6708fa001, customEvt=null, allowMerge=true, exchangeFreeSwitch=false] [21:04:48] : [Step 4/5] [2021-11-19 21:04:48,958][INFO ][exchange-worker-#9033%grid-6%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], crd=false, evt=NODE_LEFT, evtNode=10229b7e-8c8b-484a-a25e-0ae6708fa001, customEvt=null, allowMerge=true, exchangeFreeSwitch=false] [21:04:48] : [Step 4/5] [2021-11-19 21:04:48,962][INFO ][main][GridCacheProcessor] Stopped cache [cacheName=ignite-sys-cache] [21:04:48] : [Step 4/5] [2021-11-19 21:04:48,963][INFO ][exchange-worker-#9033%grid-6%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], err=null, rebalanced=true, wasRebalanced=true] [21:04:48] : [Step 4/5] [2021-11-19 21:04:48,967][INFO ][exchange-worker-#9033%grid-6%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=60f14a89-74b5-490a-9959-d77f98a1a006, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], evt=NODE_LEFT, evtNode=TcpDiscoveryNode [id=10229b7e-8c8b-484a-a25e-0ae6708fa001, consistentId=client1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:0], discPort=0, order=3, intOrder=3, lastExchangeTime=1637345088465, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=true], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0]] [21:04:48] : [Step 4/5] [2021-11-19 21:04:48,969][INFO ][exchange-worker-#9033%grid-6%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (5 ms), stage="Determine exchange type" (0 ms), stage="Exchange done" (5 ms), stage="Total time" (10 ms)] [21:04:48] : [Step 4/5] [2021-11-19 21:04:48,970][INFO ][exchange-worker-#9033%grid-6%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=0]] [21:04:48] : [Step 4/5] [2021-11-19 21:04:48,970][INFO ][exchange-worker-#9033%grid-6%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], crd=false] [21:04:48] : [Step 4/5] [2021-11-19 21:04:48,970][INFO ][exchange-worker-#9033%grid-6%][GridCachePartitionExchangeManager] AffinityTopologyVersion [topVer=4, minorTopVer=0], evt=NODE_LEFT, evtNode=10229b7e-8c8b-484a-a25e-0ae6708fa001, client=false] [21:04:48] : [Step 4/5] [2021-11-19 21:04:48,968][INFO ][main][GridDeploymentLocalStore] Removed undeployed class: GridDeployment [ts=1637345088704, depMode=SHARED, clsLdr=IsolatedClassLoader{roleName='test'}, clsLdrId=29b2d593d71-10229b7e-8c8b-484a-a25e-0ae6708fa001, userVer=0, loc=true, sampleClsName=org.apache.ignite.internal.processors.cache.distributed.dht.preloader.GridDhtPartitionFullMap, pendingUndeploy=false, undeployed=true, usage=0] [21:04:48] : [Step 4/5] [2021-11-19 21:04:48,968][INFO ][exchange-worker-#8911%grid-0%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], err=null, rebalanced=true, wasRebalanced=true] [21:04:48] : [Step 4/5] [2021-11-19 21:04:48,974][INFO ][exchange-worker-#8911%grid-0%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=002ddf6e-3774-4bb8-9600-3815e7487000, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], evt=NODE_LEFT, evtNode=TcpDiscoveryNode [id=10229b7e-8c8b-484a-a25e-0ae6708fa001, consistentId=client1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:0], discPort=0, order=3, intOrder=3, lastExchangeTime=1637345088455, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=true], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0]] [21:04:48] : [Step 4/5] [2021-11-19 21:04:48,975][INFO ][exchange-worker-#8911%grid-0%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (4 ms), stage="Determine exchange type" (5 ms), stage="Exchange done" (7 ms), stage="Total time" (16 ms)] [21:04:48] : [Step 4/5] [2021-11-19 21:04:48,976][INFO ][exchange-worker-#8911%grid-0%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=0]] [21:04:48] : [Step 4/5] [2021-11-19 21:04:48,976][INFO ][exchange-worker-#8911%grid-0%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], crd=true] [21:04:48] : [Step 4/5] [2021-11-19 21:04:48,979][INFO ][exchange-worker-#8911%grid-0%][GridCachePartitionExchangeManager] AffinityTopologyVersion [topVer=4, minorTopVer=0], evt=NODE_LEFT, evtNode=10229b7e-8c8b-484a-a25e-0ae6708fa001, client=false] [21:04:48] : [Step 4/5] [2021-11-19 21:04:48,991][INFO ][main][IgniteKernal%client1] [21:04:48] : [Step 4/5] [21:04:48] : [Step 4/5] >>> +------------------------------------------------------+ [21:04:48] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV stopped OK [21:04:48] : [Step 4/5] >>> +------------------------------------------------------+ [21:04:48] : [Step 4/5] >>> Ignite instance name: client1 [21:04:48] : [Step 4/5] >>> Grid uptime: 00:00:00.403 [21:04:48] : [Step 4/5] [21:04:48] : [Step 4/5] [21:04:48] : [Step 4/5] [2021-11-19 21:04:48,992][INFO ][main][root] >>> Stopping grid [name=grid-0, id=002ddf6e-3774-4bb8-9600-3815e7487000] [21:04:49] : [Step 4/5] [2021-11-19 21:04:49,334][INFO ][db-checkpoint-thread-#9140%grid-0%][Checkpointer] Checkpoint started [checkpointId=e6aec606-d3b1-469f-8151-3a284faf5ddb, startPtr=WALPointer [idx=0, fileOff=104460, len=1947], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=1ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=255ms, writeCheckpointEntryDuration=74ms, splitAndSortCpPagesDuration=1ms, pages=7, reason='timeout'] [21:04:49] : [Step 4/5] [2021-11-19 21:04:49,342][INFO ][tcp-disco-sock-reader-[60f14a89 127.0.0.1:49505]-#459%grid-0%-#9030%grid-0%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:49505, rmtPort=49505, rmtNodeId=60f14a89-74b5-490a-9959-d77f98a1a006] [21:04:49] : [Step 4/5] [2021-11-19 21:04:49,347][INFO ][disco-event-worker-#9032%grid-6%][GridDiscoveryManager] Node left topology: TcpDiscoveryNode [id=002ddf6e-3774-4bb8-9600-3815e7487000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345088253, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false] [21:04:49] : [Step 4/5] [2021-11-19 21:04:49,350][INFO ][disco-event-worker-#9032%grid-6%][GridDiscoveryManager] Topology snapshot [ver=5, locNode=60f14a89, servers=1, clients=0, state=ACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=60f14a89-74b5-490a-9959-d77f98a1a006, consistentId=grid-6, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:04:49] : [Step 4/5] [2021-11-19 21:04:49,350][INFO ][main][GridCacheProcessor] Stopped cache [cacheName=ignite-sys-cache] [21:04:49] : [Step 4/5] [2021-11-19 21:04:49,351][INFO ][disco-event-worker-#9032%grid-6%][GridDiscoveryManager] Coordinator changed [prev=TcpDiscoveryNode [id=002ddf6e-3774-4bb8-9600-3815e7487000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345088253, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], cur=TcpDiscoveryNode [id=60f14a89-74b5-490a-9959-d77f98a1a006, consistentId=grid-6, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637345089335, loc=true, ver=2.13.0#20211119-sha1:00000000, isClient=false]] [21:04:49] : [Step 4/5] [2021-11-19 21:04:49,354][INFO ][disco-event-worker-#9032%grid-6%][GridDiscoveryManager] ^-- Baseline [id=0, size=2, online=1, offline=1] [21:04:49] : [Step 4/5] [2021-11-19 21:04:49,354][INFO ][disco-event-worker-#9032%grid-6%][MvccProcessorImpl] Assigned mvcc coordinator [crd=MvccCoordinator [topVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], nodeId=60f14a89-74b5-490a-9959-d77f98a1a006, ver=1637345087010, local=true, initialized=false]] [21:04:49] : [Step 4/5] [2021-11-19 21:04:49,356][INFO ][sys-#9023%grid-6%][ExchangeLatchManager] Become new coordinator 60f14a89-74b5-490a-9959-d77f98a1a006 [21:04:49] : [Step 4/5] [2021-11-19 21:04:49,357][INFO ][exchange-worker-#9033%grid-6%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], crd=true, evt=NODE_LEFT, evtNode=002ddf6e-3774-4bb8-9600-3815e7487000, customEvt=null, allowMerge=false, exchangeFreeSwitch=true] [21:04:49] : [Step 4/5] [2021-11-19 21:04:49,358][INFO ][exchange-worker-#9033%grid-6%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:04:49] : [Step 4/5] [2021-11-19 21:04:49,359][INFO ][exchange-worker-#9033%grid-6%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], err=null, rebalanced=true, wasRebalanced=true] [21:04:49] : [Step 4/5] [2021-11-19 21:04:49,360][INFO ][exchange-worker-#9033%grid-6%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=60f14a89-74b5-490a-9959-d77f98a1a006, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], evt=NODE_LEFT, evtNode=TcpDiscoveryNode [id=002ddf6e-3774-4bb8-9600-3815e7487000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345088253, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=5, minorTopVer=0]] [21:04:49] : [Step 4/5] [2021-11-19 21:04:49,362][INFO ][exchange-worker-#9033%grid-6%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (0 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="After states restored callback" (0 ms), stage="WAL history reservation" (0 ms), stage="Finalize update counters" (0 ms), stage="Detect lost partitions" (1 ms), stage="Exchange done" (1 ms), stage="Total time" (2 ms)] [21:04:49] : [Step 4/5] [2021-11-19 21:04:49,363][INFO ][exchange-worker-#9033%grid-6%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], stage="Affinity initialization (exchange-free switch on fully-rebalanced topology) [grp=ignite-sys-cache]" (0 ms) (parent=Determine exchange type)] [21:04:49] : [Step 4/5] [2021-11-19 21:04:49,364][INFO ][exchange-worker-#9033%grid-6%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], crd=true] [21:04:49] : [Step 4/5] [2021-11-19 21:04:49,364][INFO ][exchange-worker-#9033%grid-6%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=5, minorTopVer=0], force=false, evt=NODE_LEFT, node=002ddf6e-3774-4bb8-9600-3815e7487000] [21:04:50] : [Step 4/5] [2021-11-19 21:04:50,048][INFO ][main][FilePageStoreManager] Cleanup cache stores [total=3, left=0, cleanFiles=false] [21:04:50] : [Step 4/5] [2021-11-19 21:04:50,051][INFO ][main][GridDeploymentLocalStore] Removed undeployed class: GridDeployment [ts=1637345088694, depMode=SHARED, clsLdr=IsolatedClassLoader{roleName='test'}, clsLdrId=28b2d593d71-002ddf6e-3774-4bb8-9600-3815e7487000, userVer=0, loc=true, sampleClsName=org.apache.ignite.internal.processors.cache.distributed.dht.preloader.GridDhtPartitionMap, pendingUndeploy=false, undeployed=true, usage=0] [21:04:50] : [Step 4/5] [2021-11-19 21:04:50,070][INFO ][main][IgniteKernal%grid-0] [21:04:50] : [Step 4/5] [21:04:50] : [Step 4/5] >>> +------------------------------------------------------+ [21:04:50] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV stopped OK [21:04:50] : [Step 4/5] >>> +------------------------------------------------------+ [21:04:50] : [Step 4/5] >>> Ignite instance name: grid-0 [21:04:50] : [Step 4/5] >>> Grid uptime: 00:00:03.029 [21:04:50] : [Step 4/5] [21:04:50] : [Step 4/5] [21:04:50] : [Step 4/5] [2021-11-19 21:04:50,071][INFO ][main][root] >>> Stopping grid [name=grid-6, id=60f14a89-74b5-490a-9959-d77f98a1a006] [21:04:50] : [Step 4/5] [2021-11-19 21:04:50,081][INFO ][db-checkpoint-thread-#9145%grid-6%][Checkpointer] Checkpoint started [checkpointId=789b3077-5d12-43d9-8a1c-1f55b6390d97, startPtr=WALPointer [idx=0, fileOff=112910, len=1947], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=1ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=0ms, pages=7, reason='timeout'] [21:04:50]W: [org.apache.ignite:ignite-core] [2021-11-19 21:04:50,087][WARN ][tcp-disco-sock-reader-[002ddf6e 127.0.0.1:34493]-#458%grid-6%-#9029%grid-6%][TestTcpDiscoverySpi] Failed to shutdown socket [21:04:50]W: [org.apache.ignite:ignite-core] java.net.SocketException: Socket is closed [21:04:50]W: [org.apache.ignite:ignite-core] at java.net.Socket.shutdownOutput(Socket.java:1568) [21:04:50]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.close(IgniteUtils.java:4247) [21:04:50]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.discovery.tcp.ServerImpl$SocketReader.body(ServerImpl.java:7370) [21:04:50]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.IgniteSpiThread.run(IgniteSpiThread.java:58) [21:04:50] : [Step 4/5] [2021-11-19 21:04:50,088][INFO ][tcp-disco-sock-reader-[002ddf6e 127.0.0.1:34493]-#458%grid-6%-#9029%grid-6%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:34493, rmtPort=34493, rmtNodeId=002ddf6e-3774-4bb8-9600-3815e7487000] [21:04:50] : [Step 4/5] [2021-11-19 21:04:50,091][INFO ][main][GridCacheProcessor] Stopped cache [cacheName=ignite-sys-cache] [21:04:50] : [Step 4/5] [2021-11-19 21:04:50,453][INFO ][main][FilePageStoreManager] Cleanup cache stores [total=3, left=0, cleanFiles=false] [21:04:50] : [Step 4/5] [2021-11-19 21:04:50,456][INFO ][main][GridDeploymentLocalStore] Removed undeployed class: GridDeployment [ts=1637345088704, depMode=SHARED, clsLdr=IsolatedClassLoader{roleName='test'}, clsLdrId=48b2d593d71-60f14a89-74b5-490a-9959-d77f98a1a006, userVer=0, loc=true, sampleClsName=org.apache.ignite.internal.processors.cache.distributed.dht.preloader.GridDhtPartitionFullMap, pendingUndeploy=false, undeployed=true, usage=0] [21:04:50] : [Step 4/5] [2021-11-19 21:04:50,466][INFO ][main][IgniteKernal%grid-6] [21:04:50] : [Step 4/5] [21:04:50] : [Step 4/5] >>> +------------------------------------------------------+ [21:04:50] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV stopped OK [21:04:50] : [Step 4/5] >>> +------------------------------------------------------+ [21:04:50] : [Step 4/5] >>> Ignite instance name: grid-6 [21:04:50] : [Step 4/5] >>> Grid uptime: 00:00:02.148 [21:04:50] : [Step 4/5] [21:04:50] : [Step 4/5] [21:04:50] : [Step 4/5] [21:04:50] >>> Starting test: EncryptedCacheNodeJoinTest#testClientNodeJoinInactiveClusterWithNewStaticCacheConfig <<< [21:04:50] : [Step 4/5] [2021-11-19 21:04:50,630][INFO ][main][root] >>> Starting test: EncryptedCacheNodeJoinTest#testClientNodeJoinInactiveClusterWithNewStaticCacheConfig <<< [21:04:50] : [Step 4/5] [21:04:50] >>> Heap: 451 MB used / 1912 MB commited / 1912 MB max <<< [21:04:50] : [Step 4/5] [2021-11-19 21:04:50,630][INFO ][main][root] >>> Heap: 451 MB used / 1912 MB commited / 1912 MB max <<< [21:04:50] : [Step 4/5] [21:04:50] >>> Non-Heap: 139 MB used / 154 MB commited / 0 MB max <<< [21:04:50] : [Step 4/5] [2021-11-19 21:04:50,631][INFO ][main][root] >>> Non-Heap: 139 MB used / 154 MB commited / 0 MB max <<< [21:04:50]W: [org.apache.ignite:ignite-core] [2021-11-19 21:04:50,637][WARN ][test-runner-#9268%encryption.EncryptedCacheNodeJoinTest%][G] Ignite work directory is not provided, automatically resolved to: /opt/buildagent/work/7bc1c54bc719b67c/work [21:04:50] : [Step 4/5] [2021-11-19 21:04:50,640][INFO ][test-runner-#9268%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] [21:04:50] : [Step 4/5] [21:04:50] : [Step 4/5] >>> __________ ________________ [21:04:50] : [Step 4/5] >>> / _/ ___/ |/ / _/_ __/ __/ [21:04:50] : [Step 4/5] >>> _/ // (7 7 // / / / / _/ [21:04:50] : [Step 4/5] >>> /___/\___/_/|_/___/ /_/ /___/ [21:04:50] : [Step 4/5] >>> [21:04:50] : [Step 4/5] >>> ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:04:50] : [Step 4/5] >>> 2021 Copyright(C) Apache Software Foundation [21:04:50] : [Step 4/5] >>> [21:04:50] : [Step 4/5] >>> Ignite documentation: http://ignite.apache.org [21:04:50] : [Step 4/5] [21:04:50] : [Step 4/5] [2021-11-19 21:04:50,642][INFO ][test-runner-#9268%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] Config URL: n/a [21:04:50] : [Step 4/5] [2021-11-19 21:04:50,642][INFO ][test-runner-#9268%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] IgniteConfiguration [igniteInstanceName=grid-0, pubPoolSize=24, svcPoolSize=24, callbackPoolSize=24, stripedPoolSize=24, sysPoolSize=24, mgmtPoolSize=4, dataStreamerPoolSize=24, utilityCachePoolSize=24, utilityCacheKeepAliveTime=60000, p2pPoolSize=2, qryPoolSize=24, buildIdxPoolSize=4, igniteHome=/opt/buildagent/work/7bc1c54bc719b67c, igniteWorkDir=/opt/buildagent/work/7bc1c54bc719b67c/work, mbeanSrv=com.sun.jmx.mbeanserver.JmxMBeanServer@6fe85038, nodeId=0045258f-23c5-47bd-8d53-d47031e11000, marsh=BinaryMarshaller [], marshLocJobs=false, daemon=false, p2pEnabled=true, netTimeout=10000, netCompressionLevel=1, sndRetryDelay=1000, sndRetryCnt=3, metricsHistSize=10000, metricsUpdateFreq=1000, metricsExpTime=9223372036854775807, discoSpi=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=0, ackTimeout=0, marsh=null, reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], segPlc=STOP, segResolveAttempts=2, waitForSegOnStart=true, allResolversPassReq=true, segChkFreq=10000, commSpi=TcpCommunicationSpi [connectGate=org.apache.ignite.spi.communication.tcp.internal.ConnectGateway@10af921d, ctxInitLatch=java.util.concurrent.CountDownLatch@1c9a725a[Count = 1], stopping=false, clientPool=null, nioSrvWrapper=null, stateProvider=null], evtSpi=MemoryEventStorageSpi [expireAgeMs=9223372036854775807, expireCnt=10000, filter=null], colSpi=NoopCollisionSpi [], deploySpi=LocalDeploymentSpi [], indexingSpi=org.apache.ignite.spi.indexing.noop.NoopIndexingSpi@722ba3c5, addrRslvr=null, encryptionSpi=org.apache.ignite.spi.encryption.keystore.KeystoreEncryptionSpi@591eaa4b, tracingSpi=org.apache.ignite.spi.tracing.NoopTracingSpi@72844179, clientMode=false, rebalanceThreadPoolSize=4, rebalanceTimeout=10000, rebalanceBatchesPrefetchCnt=3, rebalanceThrottle=0, rebalanceBatchSize=524288, txCfg=TransactionConfiguration [txSerEnabled=false, dfltIsolation=REPEATABLE_READ, dfltConcurrency=PESSIMISTIC, dfltTxTimeout=0, txTimeoutOnPartitionMapExchange=0, deadlockTimeout=10000, pessimisticTxLogSize=0, pessimisticTxLogLinger=10000, tmLookupClsName=null, txManagerFactory=null, useJtaSync=false], cacheSanityCheckEnabled=true, discoStartupDelay=60000, deployMode=SHARED, p2pMissedCacheSize=100, locHost=127.0.0.1, timeSrvPortBase=31100, timeSrvPortRange=100, failureDetectionTimeout=10000, sysWorkerBlockedTimeout=null, clientFailureDetectionTimeout=10000, metricsLogFreq=0, connectorCfg=null, odbcCfg=null, warmupClos=null, atomicCfg=AtomicConfiguration [seqReserveSize=1000, cacheMode=PARTITIONED, backups=1, aff=null, grpName=null], classLdr=null, sslCtxFactory=null, platformCfg=null, binaryCfg=null, memCfg=null, pstCfg=null, dsCfg=DataStorageConfiguration [sysRegionInitSize=41943040, sysRegionMaxSize=104857600, pageSize=4096, concLvl=0, dfltDataRegConf=DataRegionConfiguration [name=default, maxSize=10485760, initSize=268435456, swapPath=null, pageEvictionMode=DISABLED, pageReplacementMode=CLOCK, evictionThreshold=0.9, emptyPagesPoolSize=100, metricsEnabled=false, metricsSubIntervalCount=5, metricsRateTimeInterval=60000, persistenceEnabled=true, checkpointPageBufSize=0, lazyMemoryAllocation=true, warmUpCfg=null], dataRegions=null, storagePath=null, checkpointFreq=180000, lockWaitTime=10000, checkpointThreads=4, checkpointWriteOrder=SEQUENTIAL, walHistSize=20, maxWalArchiveSize=1073741824, walSegments=10, walSegmentSize=67108864, walPath=db/wal, walArchivePath=db/wal/archive, cdcWalPath=db/wal/cdc, cdcEnabled=false, metricsEnabled=false, walMode=FSYNC, walTlbSize=131072, walBuffSize=0, walFlushFreq=2000, walFsyncDelay=1000, walRecordIterBuffSize=67108864, alwaysWriteFullPages=false, fileIOFactory=org.apache.ignite.internal.processors.cache.persistence.file.AsyncFileIOFactory@74f199f0, metricsSubIntervalCnt=5, metricsRateTimeInterval=60000, walAutoArchiveAfterInactivity=-1, walForceArchiveTimeout=-1, writeThrottlingEnabled=false, walCompactionEnabled=false, walCompactionLevel=1, checkpointReadLockTimeout=null, walPageCompression=DISABLED, walPageCompressionLevel=null, dfltWarmUpCfg=null, encCfg=org.apache.ignite.configuration.EncryptionConfiguration@2e35f6d5, defragmentationThreadPoolSize=4, minWalArchiveSize=-1], snapshotPath=snapshots, activeOnStart=true, activeOnStartPropSetFlag=false, autoActivation=true, autoActivationPropSetFlag=false, clusterStateOnStart=null, sqlConnCfg=null, cliConnCfg=ClientConnectorConfiguration [host=null, port=10800, portRange=100, sockSndBufSize=0, sockRcvBufSize=0, tcpNoDelay=true, maxOpenCursorsPerConn=128, threadPoolSize=24, selectorCnt=12, idleTimeout=0, handshakeTimeout=10000, jdbcEnabled=true, odbcEnabled=true, thinCliEnabled=true, sslEnabled=false, useIgniteSslCtxFactory=true, sslClientAuth=false, sslCtxFactory=null, thinCliCfg=ThinClientConfiguration [maxActiveTxPerConn=100, maxActiveComputeTasksPerConn=0]], mvccVacuumThreadCnt=2, mvccVacuumFreq=5000, authEnabled=false, failureHnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]], commFailureRslvr=null, sqlCfg=SqlConfiguration [longQryWarnTimeout=3000, dfltQryTimeout=0, sqlQryHistSize=1000, validationEnabled=false], asyncContinuationExecutor=null] [21:04:50] : [Step 4/5] [2021-11-19 21:04:50,656][INFO ][test-runner-#9268%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] Daemon mode: off [21:04:50] : [Step 4/5] [2021-11-19 21:04:50,656][INFO ][test-runner-#9268%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] OS: Linux 4.15.0-151-generic amd64 [21:04:50] : [Step 4/5] [2021-11-19 21:04:50,656][INFO ][test-runner-#9268%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] OS user: teamcity [21:04:50] : [Step 4/5] [2021-11-19 21:04:50,657][INFO ][test-runner-#9268%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] PID: 16724 [21:04:50] : [Step 4/5] [2021-11-19 21:04:50,657][INFO ][test-runner-#9268%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] Language runtime: Java Platform API Specification ver. 1.8 [21:04:50] : [Step 4/5] [2021-11-19 21:04:50,658][INFO ][test-runner-#9268%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] VM information: Java(TM) SE Runtime Environment 1.8.0_261-b12 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 25.261-b12 [21:04:50] : [Step 4/5] [2021-11-19 21:04:50,658][INFO ][test-runner-#9268%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] VM total memory: 1.9GB [21:04:50] : [Step 4/5] [2021-11-19 21:04:50,659][INFO ][test-runner-#9268%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] Remote Management [restart: off, REST: off, JMX (remote: off)] [21:04:50] : [Step 4/5] [2021-11-19 21:04:50,659][INFO ][test-runner-#9268%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] Logger: GridTestLog4jLogger [quiet=false, config=null] [21:04:50] : [Step 4/5] [2021-11-19 21:04:50,659][INFO ][test-runner-#9268%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] IGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c [21:04:50] : [Step 4/5] [2021-11-19 21:04:50,660][INFO ][test-runner-#9268%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] VM arguments: [-DIGNITE_DUMP_THREADS_ON_FAILURE=false, -DMono=/usr/bin/mono-sgen, -DMono4.0_x64=/usr/lib/mono/4.0, -DMono4.5_x64=/usr/lib/mono/4.5, -DMonoVersion=6.12.0.90, -DSKIP_BUILD=false, -Dagent.home.dir=/opt/buildagent, -Dagent.name=aitc-lin02_03, -Dagent.ownPort=9090, -Dagent.work.dir=/opt/buildagent/work, -Dbuild.number=95, -Dbuild.vcs.number=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.1=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.GitHubApacheIgnite=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dclassworlds.conf=/opt/buildagent/temp/buildTmp/teamcity.m2.conf, -Dcom.jetbrains.maven.watcher.report.file=/opt/buildagent/temp/buildTmp/maven-build-info.xml, -Djava.io.tmpdir=/opt/buildagent/temp/buildTmp, -Dmaven.home=/opt/buildagent/tools/maven3_6, -Dmaven.multiModuleProjectDirectory=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.agent.cpuBenchmark=457, -Dteamcity.agent.dotnet.agent_url=http://localhost:9090/RPC2, -Dteamcity.agent.dotnet.build_id=6278078, -Dteamcity.auth.password=*******, -Dteamcity.auth.userId=TeamCityBuildId=6278078, -Dteamcity.build.changedFiles.file=/opt/buildagent/temp/buildTmp/changedFiles6342607772318147725.txt, -Dteamcity.build.checkoutDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.build.id=6278078, -Dteamcity.build.properties.file=/opt/buildagent/temp/buildTmp/teamcity.build5164517880467851002.properties, -Dteamcity.build.tempDir=/opt/buildagent/temp/buildTmp, -Dteamcity.build.workingDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.buildConfName=Basic 3, -Dteamcity.buildType.id=IgniteTests24Java8_Basic3, -Dteamcity.configuration.properties.file=/opt/buildagent/temp/buildTmp/teamcity.config5591980786735343870.properties, -Dteamcity.maven.userSettings.path=/opt/buildagent/temp/buildTmp/maven_settings_585072866407032347.xml, -Dteamcity.maven.watcher.home=/opt/buildagent/plugins/mavenPlugin/maven-watcher-jdk16, -Dteamcity.projectName=Ignite Tests 2.x (JDK 8/11), -Dteamcity.runner.properties.file=/opt/buildagent/temp/buildTmp/teamcity.runner9098465561618137420.properties, -Dteamcity.tests.recentlyFailedTests.file=/opt/buildagent/temp/buildTmp/testsToRunFirst3891775683130404069.txt, -Dteamcity.version=2021.2 (build 99542), -ea, -Xms2g, -Xmx2g, -XX:+HeapDumpOnOutOfMemoryError, -DIGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_TEST_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_UPDATE_NOTIFIER=false, -DIGNITE_NO_DISCO_ORDER=true, -DIGNITE_PERFORMANCE_SUGGESTIONS_DISABLED=true, -Djava.net.preferIPv4Stack=true, -DTEST_SCALE_FACTOR=1.0, -DIGNITE_TEST_PROP_LOG4J_FILE=log4j-tc-test.xml, -DIGNITE_QUIET=false, -DIGNITE_MARSHAL_BUFFERS_RECHECK=1000, -Dmaven.repo.local=/opt/buildagent/.m2/repository] [21:04:50] : [Step 4/5] [2021-11-19 21:04:50,666][INFO ][test-runner-#9268%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] System cache's DataRegion size is configured to 40 MB. Use DataStorageConfiguration.systemRegionInitialSize property to change the setting. [21:04:50] : [Step 4/5] [2021-11-19 21:04:50,666][INFO ][test-runner-#9268%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] Configured caches [in 'sysMemPlc' dataRegion: ['ignite-sys-cache']] [21:04:50]W: [org.apache.ignite:ignite-core] [2021-11-19 21:04:50,667][WARN ][test-runner-#9268%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] Peer class loading is enabled (disable it in production for performance and deployment consistency reasons) [21:04:50] : [Step 4/5] [2021-11-19 21:04:50,667][INFO ][test-runner-#9268%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] 3-rd party licenses can be found at: /opt/buildagent/work/7bc1c54bc719b67c/libs/licenses [21:04:50] : [Step 4/5] [2021-11-19 21:04:50,672][INFO ][test-runner-#9268%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] Configured plugins: [21:04:50] : [Step 4/5] [2021-11-19 21:04:50,673][INFO ][test-runner-#9268%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- StanByClusterTestProvider 1.0 [21:04:50] : [Step 4/5] [2021-11-19 21:04:50,673][INFO ][test-runner-#9268%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- null [21:04:50] : [Step 4/5] [2021-11-19 21:04:50,673][INFO ][test-runner-#9268%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] [21:04:50] : [Step 4/5] [2021-11-19 21:04:50,673][INFO ][test-runner-#9268%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- PageMemory tracker plugin 1.0 [21:04:50] : [Step 4/5] [2021-11-19 21:04:50,674][INFO ][test-runner-#9268%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- null [21:04:50] : [Step 4/5] [2021-11-19 21:04:50,674][INFO ][test-runner-#9268%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] [21:04:50] : [Step 4/5] [2021-11-19 21:04:50,674][INFO ][test-runner-#9268%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- TestDistibutedConfigurationPlugin 1.0 [21:04:50] : [Step 4/5] [2021-11-19 21:04:50,674][INFO ][test-runner-#9268%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- null [21:04:50] : [Step 4/5] [2021-11-19 21:04:50,675][INFO ][test-runner-#9268%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] [21:04:50] : [Step 4/5] [2021-11-19 21:04:50,675][INFO ][test-runner-#9268%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- NodeValidationPluginProvider 1.0 [21:04:50] : [Step 4/5] [2021-11-19 21:04:50,675][INFO ][test-runner-#9268%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- null [21:04:50] : [Step 4/5] [2021-11-19 21:04:50,676][INFO ][test-runner-#9268%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] [21:04:50] : [Step 4/5] [2021-11-19 21:04:50,676][INFO ][test-runner-#9268%encryption.EncryptedCacheNodeJoinTest%][FailureProcessor] Configured failure handler: [hnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]]] [21:04:50] : [Step 4/5] [2021-11-19 21:04:50,714][INFO ][test-runner-#9268%encryption.EncryptedCacheNodeJoinTest%][TcpCommunicationSpi] Successfully bound communication NIO server to TCP port [port=45150, locHost=/127.0.0.1, selectorsCnt=12, selectorSpins=0, pairedConn=false] [21:04:50]W: [org.apache.ignite:ignite-core] [2021-11-19 21:04:50,715][WARN ][test-runner-#9268%encryption.EncryptedCacheNodeJoinTest%][TcpCommunicationSpi] Message queue limit is set to 0 which may lead to potential OOMEs when running cache operations in FULL_ASYNC or PRIMARY_SYNC modes due to message queues growth on sender and receiver sides. [21:04:50] : [Step 4/5] [2021-11-19 21:04:50,734][INFO ][test-runner-#9268%encryption.EncryptedCacheNodeJoinTest%][GridCollisionManager] Collision resolution is disabled (all jobs will be activated upon arrival). [21:04:50] : [Step 4/5] [2021-11-19 21:04:50,734][INFO ][test-runner-#9268%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] Security status [authentication=off, sandbox=off, tls/ssl=off] [21:04:50] : [Step 4/5] [2021-11-19 21:04:50,803][INFO ][test-runner-#9268%encryption.EncryptedCacheNodeJoinTest%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:04:50] : [Step 4/5] [2021-11-19 21:04:50,894][INFO ][test-runner-#9268%encryption.EncryptedCacheNodeJoinTest%][MaintenanceProcessor] Resolved store directory for node persistent data: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0 [21:04:50] : [Step 4/5] [2021-11-19 21:04:50,896][INFO ][test-runner-#9268%encryption.EncryptedCacheNodeJoinTest%][CacheObjectBinaryProcessorImpl] Resolved directory for serialized binary metadata: /opt/buildagent/work/7bc1c54bc719b67c/work/db/binary_meta/grid_0 [21:04:50] : [Step 4/5] [2021-11-19 21:04:50,905][INFO ][test-runner-#9268%encryption.EncryptedCacheNodeJoinTest%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0 [21:04:50] : [Step 4/5] [2021-11-19 21:04:50,906][INFO ][test-runner-#9268%encryption.EncryptedCacheNodeJoinTest%][FileWriteAheadLogManager] Resolved write ahead log work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0 [21:04:50] : [Step 4/5] [2021-11-19 21:04:50,907][INFO ][test-runner-#9268%encryption.EncryptedCacheNodeJoinTest%][FileWriteAheadLogManager] Resolved write ahead log archive directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0 [21:04:51] : [Step 4/5] [2021-11-19 21:04:51,301][INFO ][test-runner-#9268%encryption.EncryptedCacheNodeJoinTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000000.wal [21:04:51]W: [org.apache.ignite:ignite-core] [2021-11-19 21:04:51,302][WARN ][test-runner-#9268%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] DataRegion maxSize=10.5 MB is smaller than defaultInitialSize=268.4 MB, setting initialSize to 10.5 MB [21:04:51] : [Step 4/5] [2021-11-19 21:04:51,309][INFO ][test-runner-#9268%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Configured data regions initialized successfully [total=5] [21:04:51] : [Step 4/5] [2021-11-19 21:04:51,318][INFO ][test-runner-#9268%encryption.EncryptedCacheNodeJoinTest%][IgniteSnapshotManager] Resolved snapshot work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/snapshots [21:04:51] : [Step 4/5] [2021-11-19 21:04:51,319][INFO ][test-runner-#9268%encryption.EncryptedCacheNodeJoinTest%][IgniteSnapshotManager] Resolved temp directory for snapshot creation: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0/snp [21:04:51] : [Step 4/5] [2021-11-19 21:04:51,322][INFO ][test-runner-#9268%encryption.EncryptedCacheNodeJoinTest%][ClientListenerProcessor] Client connector processor has started on TCP port 10800 [21:04:51] : [Step 4/5] [2021-11-19 21:04:51,330][INFO ][test-runner-#9268%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] Non-loopback local IPs: 172.17.0.4 [21:04:51] : [Step 4/5] [2021-11-19 21:04:51,330][INFO ][test-runner-#9268%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] Enabled local MACs: 0242AC110004 [21:04:51] : [Step 4/5] [2021-11-19 21:04:51,334][INFO ][test-runner-#9268%encryption.EncryptedCacheNodeJoinTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:04:51] : [Step 4/5] [2021-11-19 21:04:51,336][INFO ][test-runner-#9268%encryption.EncryptedCacheNodeJoinTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:04:51] : [Step 4/5] [2021-11-19 21:04:51,336][INFO ][test-runner-#9268%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:04:51] : [Step 4/5] [2021-11-19 21:04:51,340][INFO ][test-runner-#9268%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Applying lost metastore updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:04:51] : [Step 4/5] [2021-11-19 21:04:51,341][INFO ][test-runner-#9268%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=0 ms] [21:04:51] : [Step 4/5] [2021-11-19 21:04:51,341][INFO ][test-runner-#9268%encryption.EncryptedCacheNodeJoinTest%][GridCacheProcessor] Restoring partition state for local groups. [21:04:51] : [Step 4/5] [2021-11-19 21:04:51,342][INFO ][test-runner-#9268%encryption.EncryptedCacheNodeJoinTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=0, partitionsProcessed=0, time=0ms] [21:04:51] : [Step 4/5] [2021-11-19 21:04:51,342][INFO ][test-runner-#9268%encryption.EncryptedCacheNodeJoinTest%][GridEncryptionManager] Encryption keys loaded from metastore. [grps=, masterKeyName=ignite.master.key] [21:04:51] : [Step 4/5] [2021-11-19 21:04:51,347][INFO ][test-runner-#9268%encryption.EncryptedCacheNodeJoinTest%][ClusterProcessor] Cluster ID and tag has been read from metastorage: null [21:04:51] : [Step 4/5] [2021-11-19 21:04:51,348][INFO ][test-runner-#9268%encryption.EncryptedCacheNodeJoinTest%][IgniteClusterImpl] Shutdown policy was updated [oldVal=null, newVal=null] [21:04:51] : [Step 4/5] [2021-11-19 21:04:51,348][INFO ][test-runner-#9268%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Checkpoint frequency deviation changed [oldVal=null, newVal=null] [21:04:51] : [Step 4/5] [2021-11-19 21:04:51,360][INFO ][test-runner-#9268%encryption.EncryptedCacheNodeJoinTest%][FilePageStoreManager] Cleanup cache stores [total=1, left=0, cleanFiles=false] [21:04:51] : [Step 4/5] [2021-11-19 21:04:51,363][INFO ][test-runner-#9268%encryption.EncryptedCacheNodeJoinTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:04:51] : [Step 4/5] [2021-11-19 21:04:51,364][INFO ][test-runner-#9268%encryption.EncryptedCacheNodeJoinTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:04:51] : [Step 4/5] [2021-11-19 21:04:51,366][INFO ][test-runner-#9268%encryption.EncryptedCacheNodeJoinTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:04:51] : [Step 4/5] [2021-11-19 21:04:51,366][INFO ][test-runner-#9268%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Data Regions Started: 5 [21:04:51] : [Step 4/5] [2021-11-19 21:04:51,367][INFO ][test-runner-#9268%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] ^-- sysMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:04:51] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:04:51] : [Step 4/5] ^-- default region [type=default, persistence=true, lazyAlloc=true, [21:04:51] : [Step 4/5] ... initCfg=10MB, maxCfg=10MB, usedRam=0MB, freeRam=100%, allocRam=0MB, allocTotal=0MB] [21:04:51] : [Step 4/5] ^-- metastoreMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:04:51] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:04:51] : [Step 4/5] ^-- TxLog region [type=internal, persistence=true, lazyAlloc=false, [21:04:51] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:04:51] : [Step 4/5] ^-- volatileDsMemPlc region [type=user, persistence=false, lazyAlloc=true, [21:04:51] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB] [21:04:51] : [Step 4/5] ^-- Ignite persistence [used=0MB] [21:04:51] : [Step 4/5] [21:04:51] : [Step 4/5] [2021-11-19 21:04:51,369][INFO ][test-runner-#9268%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Starting binary memory restore for: [-2100569601] [21:04:51] : [Step 4/5] [2021-11-19 21:04:51,378][INFO ][test-runner-#9268%encryption.EncryptedCacheNodeJoinTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:04:51] : [Step 4/5] [2021-11-19 21:04:51,378][INFO ][test-runner-#9268%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:04:51] : [Step 4/5] [2021-11-19 21:04:51,380][INFO ][test-runner-#9268%encryption.EncryptedCacheNodeJoinTest%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000000.wal, offset=0, ver=2] [21:04:51] : [Step 4/5] [2021-11-19 21:04:51,388][INFO ][test-runner-#9268%encryption.EncryptedCacheNodeJoinTest%][GridCacheProcessor] Started cache in recovery mode [name=ignite-sys-cache, id=-2100569601, dataRegionName=sysMemPlc, mode=REPLICATED, atomicity=TRANSACTIONAL, backups=2147483647, mvcc=false] [21:04:51] : [Step 4/5] [2021-11-19 21:04:51,390][INFO ][test-runner-#9268%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Binary recovery performed in 21 ms. [21:04:51] : [Step 4/5] [2021-11-19 21:04:51,390][INFO ][test-runner-#9268%encryption.EncryptedCacheNodeJoinTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:04:51] : [Step 4/5] [2021-11-19 21:04:51,390][INFO ][test-runner-#9268%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Applying lost cache updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:04:51] : [Step 4/5] [2021-11-19 21:04:51,474][INFO ][test-runner-#9268%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=82 ms] [21:04:51] : [Step 4/5] [2021-11-19 21:04:51,474][INFO ][test-runner-#9268%encryption.EncryptedCacheNodeJoinTest%][GridCacheProcessor] Restoring partition state for local groups. [21:04:51] : [Step 4/5] [2021-11-19 21:04:51,500][INFO ][test-runner-#9268%encryption.EncryptedCacheNodeJoinTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=1, partitionsProcessed=100, time=31ms] [21:04:51] : [Step 4/5] [2021-11-19 21:04:51,801][INFO ][test-runner-#9268%encryption.EncryptedCacheNodeJoinTest%][TestTcpDiscoverySpi] Successfully bound to TCP port [port=47500, localHost=localhost/127.0.0.1, locNodeId=0045258f-23c5-47bd-8d53-d47031e11000] [21:04:51] : [Step 4/5] [2021-11-19 21:04:51,814][INFO ][disco-notifier-worker-#9379%grid-0%][MvccProcessorImpl] Assigned mvcc coordinator [crd=MvccCoordinator [topVer=AffinityTopologyVersion [topVer=1, minorTopVer=0], nodeId=0045258f-23c5-47bd-8d53-d47031e11000, ver=1637345091812, local=true, initialized=false]] [21:04:51] : [Step 4/5] [2021-11-19 21:04:51,816][INFO ][sys-#9359%grid-0%][ClusterProcessor] Writing cluster ID and tag to metastorage on ready for write ClusterIdAndTag [id=69b6f745-810c-481b-8f4b-79b2ffef1fc6, tag=confident_euler] [21:04:51] : [Step 4/5] [2021-11-19 21:04:51,822][INFO ][disco-notifier-worker-#9379%grid-0%][ClusterProcessor] confident_euler [21:04:51] : [Step 4/5] [2021-11-19 21:04:51,823][INFO ][disco-notifier-worker-#9379%grid-0%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustEnabled' was changed from 'null' to 'false' [21:04:51] : [Step 4/5] [2021-11-19 21:04:51,825][INFO ][disco-notifier-worker-#9379%grid-0%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustTimeout' was changed from 'null' to '300000' [21:04:51] : [Step 4/5] [2021-11-19 21:04:51,826][INFO ][disco-notifier-worker-#9379%grid-0%][IgniteTxManager] Transactions parameter 'longOperationsDumpTimeout' was changed from 'null' to '60000' [21:04:51] : [Step 4/5] [2021-11-19 21:04:51,827][INFO ][disco-notifier-worker-#9379%grid-0%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpThreshold' was changed from 'null' to '0' [21:04:51] : [Step 4/5] [2021-11-19 21:04:51,828][INFO ][disco-notifier-worker-#9379%grid-0%][IgniteTxManager] Transactions parameter 'transactionTimeDumpSamplesCoefficient' was changed from 'null' to '0.0' [21:04:51] : [Step 4/5] [2021-11-19 21:04:51,829][INFO ][disco-notifier-worker-#9379%grid-0%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpSamplesPerSecondLimit' was changed from 'null' to '5' [21:04:51] : [Step 4/5] [2021-11-19 21:04:51,830][INFO ][disco-notifier-worker-#9379%grid-0%][IgniteTxManager] Transactions parameter 'collisionsDumpInterval' was changed from 'null' to '1000' [21:04:51] : [Step 4/5] [2021-11-19 21:04:51,830][INFO ][disco-notifier-worker-#9379%grid-0%][IgniteTxManager] Transactions parameter 'txOwnerDumpRequestsAllowed' was changed from 'null' to 'true' [21:04:51] : [Step 4/5] [2021-11-19 21:04:51,832][INFO ][disco-notifier-worker-#9379%grid-0%][GridCacheDatabaseSharedManager] Historical rebalance WAL threshold changed [property=historical.rebalance.threshold, oldVal=null, newVal=500] [21:04:51] : [Step 4/5] [2021-11-19 21:04:51,863][INFO ][test-runner-#9268%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] To start Console Management & Monitoring run ignitevisorcmd.{sh|bat} [21:04:51] : [Step 4/5] [2021-11-19 21:04:51,864][INFO ][test-runner-#9268%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] [21:04:51] : [Step 4/5] [21:04:51] : [Step 4/5] >>> +-------------------------------------------+ [21:04:51] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:04:51] : [Step 4/5] >>> +-------------------------------------------+ [21:04:51] : [Step 4/5] >>> OS name: Linux 4.15.0-151-generic amd64 [21:04:51] : [Step 4/5] >>> CPU(s): 24 [21:04:51] : [Step 4/5] >>> Heap: 2.0GB [21:04:51] : [Step 4/5] >>> VM name: 16724@c4dfe9a430b2 [21:04:51] : [Step 4/5] >>> Ignite instance name: grid-0 [21:04:51] : [Step 4/5] >>> Local node [ID=0045258F-23C5-47BD-8D53-D47031E11000, order=1, clientMode=false] [21:04:51] : [Step 4/5] >>> Local node addresses: [127.0.0.1] [21:04:51] : [Step 4/5] >>> Local ports: TCP:10800 TCP:45150 TCP:47500 [21:04:51] : [Step 4/5] [21:04:51] : [Step 4/5] [2021-11-19 21:04:51,865][INFO ][test-runner-#9268%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] >>> Ignite cluster is in INACTIVE state (limited functionality available). Use control.(sh|bat) script or IgniteCluster.state(ClusterState.ACTIVE) to change the state. [21:04:51] : [Step 4/5] [2021-11-19 21:04:51,865][INFO ][test-runner-#9268%encryption.EncryptedCacheNodeJoinTest%][GridDiscoveryManager] Topology snapshot [ver=1, locNode=0045258f, servers=1, clients=0, state=INACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=0045258f-23c5-47bd-8d53-d47031e11000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:04:51] : [Step 4/5] [2021-11-19 21:04:51,866][INFO ][test-runner-#9268%encryption.EncryptedCacheNodeJoinTest%][G] Node started : [stage="Configure system pool" (0 ms),stage="Start managers" (255 ms),stage="Configure binary metadata" (7 ms),stage="Start processors" (426 ms),stage="Start 'StanByClusterTestProvider' plugin" (0 ms),stage="Start 'PageMemory tracker plugin' plugin" (0 ms),stage="Start 'TestDistibutedConfigurationPlugin' plugin" (0 ms),stage="Start 'NodeValidationPluginProvider' plugin" (0 ms),stage="Init metastore" (31 ms),stage="Init and start regions" (7 ms),stage="Restore binary memory" (21 ms),stage="Restore logical state" (110 ms),stage="Finish recovery" (297 ms),stage="Join topology" (19 ms),stage="Await transition" (2 ms),stage="Await exchange" (45 ms),stage="Total time" (1220 ms)] [21:04:51] : [Step 4/5] [2021-11-19 21:04:51,867][INFO ][test-runner-#9268%encryption.EncryptedCacheNodeJoinTest%][root] Node started with the following configuration [id=0045258f-23c5-47bd-8d53-d47031e11000, marshaller=BinaryMarshaller [], discovery=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=5000, ackTimeout=5000, marsh=JdkMarshaller [clsFilter=org.apache.ignite.marshaller.MarshallerUtils$1@25223d5c], reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], binaryCfg=null, lateAff=true] [21:04:51]W: [org.apache.ignite:ignite-core] [2021-11-19 21:04:51,874][WARN ][test-runner-#9268%encryption.EncryptedCacheNodeJoinTest%][G] Ignite work directory is not provided, automatically resolved to: /opt/buildagent/work/7bc1c54bc719b67c/work [21:04:51] : [Step 4/5] [2021-11-19 21:04:51,876][INFO ][test-runner-#9268%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-6] [21:04:51] : [Step 4/5] [21:04:51] : [Step 4/5] >>> __________ ________________ [21:04:51] : [Step 4/5] >>> / _/ ___/ |/ / _/_ __/ __/ [21:04:51] : [Step 4/5] >>> _/ // (7 7 // / / / / _/ [21:04:51] : [Step 4/5] >>> /___/\___/_/|_/___/ /_/ /___/ [21:04:51] : [Step 4/5] >>> [21:04:51] : [Step 4/5] >>> ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:04:51] : [Step 4/5] >>> 2021 Copyright(C) Apache Software Foundation [21:04:51] : [Step 4/5] >>> [21:04:51] : [Step 4/5] >>> Ignite documentation: http://ignite.apache.org [21:04:51] : [Step 4/5] [21:04:51] : [Step 4/5] [2021-11-19 21:04:51,877][INFO ][test-runner-#9268%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-6] Config URL: n/a [21:04:51] : [Step 4/5] [2021-11-19 21:04:51,877][INFO ][test-runner-#9268%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-6] IgniteConfiguration [igniteInstanceName=grid-6, pubPoolSize=24, svcPoolSize=24, callbackPoolSize=24, stripedPoolSize=24, sysPoolSize=24, mgmtPoolSize=4, dataStreamerPoolSize=24, utilityCachePoolSize=24, utilityCacheKeepAliveTime=60000, p2pPoolSize=2, qryPoolSize=24, buildIdxPoolSize=4, igniteHome=/opt/buildagent/work/7bc1c54bc719b67c, igniteWorkDir=/opt/buildagent/work/7bc1c54bc719b67c/work, mbeanSrv=com.sun.jmx.mbeanserver.JmxMBeanServer@6fe85038, nodeId=603e647b-590d-4fc1-ab37-4d1d82d4f006, marsh=BinaryMarshaller [], marshLocJobs=false, daemon=false, p2pEnabled=true, netTimeout=10000, netCompressionLevel=1, sndRetryDelay=1000, sndRetryCnt=3, metricsHistSize=10000, metricsUpdateFreq=1000, metricsExpTime=9223372036854775807, discoSpi=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=0, ackTimeout=0, marsh=null, reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], segPlc=STOP, segResolveAttempts=2, waitForSegOnStart=true, allResolversPassReq=true, segChkFreq=10000, commSpi=TcpCommunicationSpi [connectGate=org.apache.ignite.spi.communication.tcp.internal.ConnectGateway@36d5f622, ctxInitLatch=java.util.concurrent.CountDownLatch@2314a0f1[Count = 1], stopping=false, clientPool=null, nioSrvWrapper=null, stateProvider=null], evtSpi=MemoryEventStorageSpi [expireAgeMs=9223372036854775807, expireCnt=10000, filter=null], colSpi=NoopCollisionSpi [], deploySpi=LocalDeploymentSpi [], indexingSpi=org.apache.ignite.spi.indexing.noop.NoopIndexingSpi@7b365ef, addrRslvr=null, encryptionSpi=org.apache.ignite.spi.encryption.keystore.KeystoreEncryptionSpi@509b10a7, tracingSpi=org.apache.ignite.spi.tracing.NoopTracingSpi@16f888de, clientMode=false, rebalanceThreadPoolSize=4, rebalanceTimeout=10000, rebalanceBatchesPrefetchCnt=3, rebalanceThrottle=0, rebalanceBatchSize=524288, txCfg=TransactionConfiguration [txSerEnabled=false, dfltIsolation=REPEATABLE_READ, dfltConcurrency=PESSIMISTIC, dfltTxTimeout=0, txTimeoutOnPartitionMapExchange=0, deadlockTimeout=10000, pessimisticTxLogSize=0, pessimisticTxLogLinger=10000, tmLookupClsName=null, txManagerFactory=null, useJtaSync=false], cacheSanityCheckEnabled=true, discoStartupDelay=60000, deployMode=SHARED, p2pMissedCacheSize=100, locHost=127.0.0.1, timeSrvPortBase=31100, timeSrvPortRange=100, failureDetectionTimeout=10000, sysWorkerBlockedTimeout=null, clientFailureDetectionTimeout=10000, metricsLogFreq=0, connectorCfg=null, odbcCfg=null, warmupClos=null, atomicCfg=AtomicConfiguration [seqReserveSize=1000, cacheMode=PARTITIONED, backups=1, aff=null, grpName=null], classLdr=null, sslCtxFactory=null, platformCfg=null, binaryCfg=null, memCfg=null, pstCfg=null, dsCfg=DataStorageConfiguration [sysRegionInitSize=41943040, sysRegionMaxSize=104857600, pageSize=4096, concLvl=0, dfltDataRegConf=DataRegionConfiguration [name=default, maxSize=10485760, initSize=268435456, swapPath=null, pageEvictionMode=DISABLED, pageReplacementMode=CLOCK, evictionThreshold=0.9, emptyPagesPoolSize=100, metricsEnabled=false, metricsSubIntervalCount=5, metricsRateTimeInterval=60000, persistenceEnabled=true, checkpointPageBufSize=0, lazyMemoryAllocation=true, warmUpCfg=null], dataRegions=null, storagePath=null, checkpointFreq=180000, lockWaitTime=10000, checkpointThreads=4, checkpointWriteOrder=SEQUENTIAL, walHistSize=20, maxWalArchiveSize=1073741824, walSegments=10, walSegmentSize=67108864, walPath=db/wal, walArchivePath=db/wal/archive, cdcWalPath=db/wal/cdc, cdcEnabled=false, metricsEnabled=false, walMode=FSYNC, walTlbSize=131072, walBuffSize=0, walFlushFreq=2000, walFsyncDelay=1000, walRecordIterBuffSize=67108864, alwaysWriteFullPages=false, fileIOFactory=org.apache.ignite.internal.processors.cache.persistence.file.AsyncFileIOFactory@1383dfbf, metricsSubIntervalCnt=5, metricsRateTimeInterval=60000, walAutoArchiveAfterInactivity=-1, walForceArchiveTimeout=-1, writeThrottlingEnabled=false, walCompactionEnabled=false, walCompactionLevel=1, checkpointReadLockTimeout=null, walPageCompression=DISABLED, walPageCompressionLevel=null, dfltWarmUpCfg=null, encCfg=org.apache.ignite.configuration.EncryptionConfiguration@4f894536, defragmentationThreadPoolSize=4, minWalArchiveSize=-1], snapshotPath=snapshots, activeOnStart=true, activeOnStartPropSetFlag=false, autoActivation=true, autoActivationPropSetFlag=false, clusterStateOnStart=null, sqlConnCfg=null, cliConnCfg=ClientConnectorConfiguration [host=null, port=10800, portRange=100, sockSndBufSize=0, sockRcvBufSize=0, tcpNoDelay=true, maxOpenCursorsPerConn=128, threadPoolSize=24, selectorCnt=12, idleTimeout=0, handshakeTimeout=10000, jdbcEnabled=true, odbcEnabled=true, thinCliEnabled=true, sslEnabled=false, useIgniteSslCtxFactory=true, sslClientAuth=false, sslCtxFactory=null, thinCliCfg=ThinClientConfiguration [maxActiveTxPerConn=100, maxActiveComputeTasksPerConn=0]], mvccVacuumThreadCnt=2, mvccVacuumFreq=5000, authEnabled=false, failureHnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]], commFailureRslvr=null, sqlCfg=SqlConfiguration [longQryWarnTimeout=3000, dfltQryTimeout=0, sqlQryHistSize=1000, validationEnabled=false], asyncContinuationExecutor=null] [21:04:51] : [Step 4/5] [2021-11-19 21:04:51,887][INFO ][test-runner-#9268%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-6] Daemon mode: off [21:04:51] : [Step 4/5] [2021-11-19 21:04:51,887][INFO ][test-runner-#9268%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-6] OS: Linux 4.15.0-151-generic amd64 [21:04:51] : [Step 4/5] [2021-11-19 21:04:51,887][INFO ][test-runner-#9268%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-6] OS user: teamcity [21:04:51] : [Step 4/5] [2021-11-19 21:04:51,888][INFO ][test-runner-#9268%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-6] PID: 16724 [21:04:51] : [Step 4/5] [2021-11-19 21:04:51,888][INFO ][test-runner-#9268%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-6] Language runtime: Java Platform API Specification ver. 1.8 [21:04:51] : [Step 4/5] [2021-11-19 21:04:51,889][INFO ][test-runner-#9268%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-6] VM information: Java(TM) SE Runtime Environment 1.8.0_261-b12 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 25.261-b12 [21:04:51] : [Step 4/5] [2021-11-19 21:04:51,889][INFO ][test-runner-#9268%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-6] VM total memory: 1.9GB [21:04:51] : [Step 4/5] [2021-11-19 21:04:51,890][INFO ][test-runner-#9268%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-6] Remote Management [restart: off, REST: off, JMX (remote: off)] [21:04:51] : [Step 4/5] [2021-11-19 21:04:51,890][INFO ][test-runner-#9268%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-6] Logger: GridTestLog4jLogger [quiet=false, config=null] [21:04:51] : [Step 4/5] [2021-11-19 21:04:51,890][INFO ][test-runner-#9268%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-6] IGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c [21:04:51] : [Step 4/5] [2021-11-19 21:04:51,891][INFO ][test-runner-#9268%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-6] VM arguments: [-DIGNITE_DUMP_THREADS_ON_FAILURE=false, -DMono=/usr/bin/mono-sgen, -DMono4.0_x64=/usr/lib/mono/4.0, -DMono4.5_x64=/usr/lib/mono/4.5, -DMonoVersion=6.12.0.90, -DSKIP_BUILD=false, -Dagent.home.dir=/opt/buildagent, -Dagent.name=aitc-lin02_03, -Dagent.ownPort=9090, -Dagent.work.dir=/opt/buildagent/work, -Dbuild.number=95, -Dbuild.vcs.number=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.1=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.GitHubApacheIgnite=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dclassworlds.conf=/opt/buildagent/temp/buildTmp/teamcity.m2.conf, -Dcom.jetbrains.maven.watcher.report.file=/opt/buildagent/temp/buildTmp/maven-build-info.xml, -Djava.io.tmpdir=/opt/buildagent/temp/buildTmp, -Dmaven.home=/opt/buildagent/tools/maven3_6, -Dmaven.multiModuleProjectDirectory=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.agent.cpuBenchmark=457, -Dteamcity.agent.dotnet.agent_url=http://localhost:9090/RPC2, -Dteamcity.agent.dotnet.build_id=6278078, -Dteamcity.auth.password=*******, -Dteamcity.auth.userId=TeamCityBuildId=6278078, -Dteamcity.build.changedFiles.file=/opt/buildagent/temp/buildTmp/changedFiles6342607772318147725.txt, -Dteamcity.build.checkoutDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.build.id=6278078, -Dteamcity.build.properties.file=/opt/buildagent/temp/buildTmp/teamcity.build5164517880467851002.properties, -Dteamcity.build.tempDir=/opt/buildagent/temp/buildTmp, -Dteamcity.build.workingDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.buildConfName=Basic 3, -Dteamcity.buildType.id=IgniteTests24Java8_Basic3, -Dteamcity.configuration.properties.file=/opt/buildagent/temp/buildTmp/teamcity.config5591980786735343870.properties, -Dteamcity.maven.userSettings.path=/opt/buildagent/temp/buildTmp/maven_settings_585072866407032347.xml, -Dteamcity.maven.watcher.home=/opt/buildagent/plugins/mavenPlugin/maven-watcher-jdk16, -Dteamcity.projectName=Ignite Tests 2.x (JDK 8/11), -Dteamcity.runner.properties.file=/opt/buildagent/temp/buildTmp/teamcity.runner9098465561618137420.properties, -Dteamcity.tests.recentlyFailedTests.file=/opt/buildagent/temp/buildTmp/testsToRunFirst3891775683130404069.txt, -Dteamcity.version=2021.2 (build 99542), -ea, -Xms2g, -Xmx2g, -XX:+HeapDumpOnOutOfMemoryError, -DIGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_TEST_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_UPDATE_NOTIFIER=false, -DIGNITE_NO_DISCO_ORDER=true, -DIGNITE_PERFORMANCE_SUGGESTIONS_DISABLED=true, -Djava.net.preferIPv4Stack=true, -DTEST_SCALE_FACTOR=1.0, -DIGNITE_TEST_PROP_LOG4J_FILE=log4j-tc-test.xml, -DIGNITE_QUIET=false, -DIGNITE_MARSHAL_BUFFERS_RECHECK=1000, -Dmaven.repo.local=/opt/buildagent/.m2/repository] [21:04:51] : [Step 4/5] [2021-11-19 21:04:51,898][INFO ][test-runner-#9268%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-6] System cache's DataRegion size is configured to 40 MB. Use DataStorageConfiguration.systemRegionInitialSize property to change the setting. [21:04:51] : [Step 4/5] [2021-11-19 21:04:51,898][INFO ][test-runner-#9268%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-6] Configured caches [in 'sysMemPlc' dataRegion: ['ignite-sys-cache']] [21:04:51] : [Step 4/5] [2021-11-19 21:04:51,899][INFO ][test-runner-#9268%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-6] 3-rd party licenses can be found at: /opt/buildagent/work/7bc1c54bc719b67c/libs/licenses [21:04:51]W: [org.apache.ignite:ignite-core] [2021-11-19 21:04:51,899][WARN ][test-runner-#9268%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-6] Peer class loading is enabled (disable it in production for performance and deployment consistency reasons) [21:04:51] : [Step 4/5] [2021-11-19 21:04:51,906][INFO ][test-runner-#9268%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] Configured plugins: [21:04:51] : [Step 4/5] [2021-11-19 21:04:51,906][INFO ][test-runner-#9268%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- StanByClusterTestProvider 1.0 [21:04:51] : [Step 4/5] [2021-11-19 21:04:51,906][INFO ][test-runner-#9268%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- null [21:04:51] : [Step 4/5] [2021-11-19 21:04:51,907][INFO ][test-runner-#9268%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] [21:04:51] : [Step 4/5] [2021-11-19 21:04:51,907][INFO ][test-runner-#9268%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- PageMemory tracker plugin 1.0 [21:04:51] : [Step 4/5] [2021-11-19 21:04:51,907][INFO ][test-runner-#9268%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- null [21:04:51] : [Step 4/5] [2021-11-19 21:04:51,908][INFO ][test-runner-#9268%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] [21:04:51] : [Step 4/5] [2021-11-19 21:04:51,908][INFO ][test-runner-#9268%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- TestDistibutedConfigurationPlugin 1.0 [21:04:51] : [Step 4/5] [2021-11-19 21:04:51,908][INFO ][test-runner-#9268%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- null [21:04:51] : [Step 4/5] [2021-11-19 21:04:51,909][INFO ][test-runner-#9268%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] [21:04:51] : [Step 4/5] [2021-11-19 21:04:51,909][INFO ][test-runner-#9268%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- NodeValidationPluginProvider 1.0 [21:04:51] : [Step 4/5] [2021-11-19 21:04:51,909][INFO ][test-runner-#9268%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- null [21:04:51] : [Step 4/5] [2021-11-19 21:04:51,910][INFO ][test-runner-#9268%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] [21:04:51] : [Step 4/5] [2021-11-19 21:04:51,910][INFO ][test-runner-#9268%encryption.EncryptedCacheNodeJoinTest%][FailureProcessor] Configured failure handler: [hnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]]] [21:04:51] : [Step 4/5] [2021-11-19 21:04:51,939][INFO ][test-runner-#9268%encryption.EncryptedCacheNodeJoinTest%][TcpCommunicationSpi] Successfully bound communication NIO server to TCP port [port=45151, locHost=/127.0.0.1, selectorsCnt=12, selectorSpins=0, pairedConn=false] [21:04:51]W: [org.apache.ignite:ignite-core] [2021-11-19 21:04:51,940][WARN ][test-runner-#9268%encryption.EncryptedCacheNodeJoinTest%][TcpCommunicationSpi] Message queue limit is set to 0 which may lead to potential OOMEs when running cache operations in FULL_ASYNC or PRIMARY_SYNC modes due to message queues growth on sender and receiver sides. [21:04:51] : [Step 4/5] [2021-11-19 21:04:51,954][INFO ][test-runner-#9268%encryption.EncryptedCacheNodeJoinTest%][GridCollisionManager] Collision resolution is disabled (all jobs will be activated upon arrival). [21:04:51] : [Step 4/5] [2021-11-19 21:04:51,955][INFO ][test-runner-#9268%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-6] Security status [authentication=off, sandbox=off, tls/ssl=off] [21:04:52] : [Step 4/5] [2021-11-19 21:04:52,040][INFO ][test-runner-#9268%encryption.EncryptedCacheNodeJoinTest%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:04:52] : [Step 4/5] [2021-11-19 21:04:52,155][INFO ][test-runner-#9268%encryption.EncryptedCacheNodeJoinTest%][MaintenanceProcessor] Resolved store directory for node persistent data: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_6 [21:04:52] : [Step 4/5] [2021-11-19 21:04:52,157][INFO ][test-runner-#9268%encryption.EncryptedCacheNodeJoinTest%][CacheObjectBinaryProcessorImpl] Resolved directory for serialized binary metadata: /opt/buildagent/work/7bc1c54bc719b67c/work/db/binary_meta/grid_6 [21:04:52] : [Step 4/5] [2021-11-19 21:04:52,163][INFO ][test-runner-#9268%encryption.EncryptedCacheNodeJoinTest%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_6 [21:04:52] : [Step 4/5] [2021-11-19 21:04:52,164][INFO ][test-runner-#9268%encryption.EncryptedCacheNodeJoinTest%][FileWriteAheadLogManager] Resolved write ahead log work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_6 [21:04:52] : [Step 4/5] [2021-11-19 21:04:52,165][INFO ][test-runner-#9268%encryption.EncryptedCacheNodeJoinTest%][FileWriteAheadLogManager] Resolved write ahead log archive directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_6 [21:04:52] : [Step 4/5] [2021-11-19 21:04:52,576][INFO ][test-runner-#9268%encryption.EncryptedCacheNodeJoinTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_6/0000000000000000.wal [21:04:52] : [Step 4/5] [2021-11-19 21:04:52,583][INFO ][test-runner-#9268%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Configured data regions initialized successfully [total=5] [21:04:52] : [Step 4/5] [2021-11-19 21:04:52,596][INFO ][test-runner-#9268%encryption.EncryptedCacheNodeJoinTest%][IgniteSnapshotManager] Resolved snapshot work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/snapshots [21:04:52] : [Step 4/5] [2021-11-19 21:04:52,596][INFO ][test-runner-#9268%encryption.EncryptedCacheNodeJoinTest%][IgniteSnapshotManager] Resolved temp directory for snapshot creation: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_6/snp [21:04:52] : [Step 4/5] [2021-11-19 21:04:52,600][INFO ][test-runner-#9268%encryption.EncryptedCacheNodeJoinTest%][ClientListenerProcessor] Client connector processor has started on TCP port 10801 [21:04:52] : [Step 4/5] [2021-11-19 21:04:52,602][INFO ][test-runner-#9268%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-6] Non-loopback local IPs: 172.17.0.4 [21:04:52] : [Step 4/5] [2021-11-19 21:04:52,603][INFO ][test-runner-#9268%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-6] Enabled local MACs: 0242AC110004 [21:04:52] : [Step 4/5] [2021-11-19 21:04:52,604][INFO ][test-runner-#9268%encryption.EncryptedCacheNodeJoinTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:04:52] : [Step 4/5] [2021-11-19 21:04:52,605][INFO ][test-runner-#9268%encryption.EncryptedCacheNodeJoinTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:04:52] : [Step 4/5] [2021-11-19 21:04:52,606][INFO ][test-runner-#9268%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:04:52] : [Step 4/5] [2021-11-19 21:04:52,609][INFO ][test-runner-#9268%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Applying lost metastore updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:04:52] : [Step 4/5] [2021-11-19 21:04:52,610][INFO ][test-runner-#9268%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=0 ms] [21:04:52] : [Step 4/5] [2021-11-19 21:04:52,610][INFO ][test-runner-#9268%encryption.EncryptedCacheNodeJoinTest%][GridCacheProcessor] Restoring partition state for local groups. [21:04:52] : [Step 4/5] [2021-11-19 21:04:52,611][INFO ][test-runner-#9268%encryption.EncryptedCacheNodeJoinTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=0, partitionsProcessed=0, time=0ms] [21:04:52] : [Step 4/5] [2021-11-19 21:04:52,611][INFO ][test-runner-#9268%encryption.EncryptedCacheNodeJoinTest%][GridEncryptionManager] Encryption keys loaded from metastore. [grps=, masterKeyName=ignite.master.key] [21:04:52] : [Step 4/5] [2021-11-19 21:04:52,613][INFO ][test-runner-#9268%encryption.EncryptedCacheNodeJoinTest%][ClusterProcessor] Cluster ID and tag has been read from metastorage: null [21:04:52] : [Step 4/5] [2021-11-19 21:04:52,614][INFO ][test-runner-#9268%encryption.EncryptedCacheNodeJoinTest%][IgniteClusterImpl] Shutdown policy was updated [oldVal=null, newVal=null] [21:04:52] : [Step 4/5] [2021-11-19 21:04:52,614][INFO ][test-runner-#9268%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Checkpoint frequency deviation changed [oldVal=null, newVal=null] [21:04:52] : [Step 4/5] [2021-11-19 21:04:52,630][INFO ][test-runner-#9268%encryption.EncryptedCacheNodeJoinTest%][FilePageStoreManager] Cleanup cache stores [total=1, left=0, cleanFiles=false] [21:04:52] : [Step 4/5] [2021-11-19 21:04:52,633][INFO ][test-runner-#9268%encryption.EncryptedCacheNodeJoinTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:04:52] : [Step 4/5] [2021-11-19 21:04:52,634][INFO ][test-runner-#9268%encryption.EncryptedCacheNodeJoinTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:04:52] : [Step 4/5] [2021-11-19 21:04:52,636][INFO ][test-runner-#9268%encryption.EncryptedCacheNodeJoinTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:04:52] : [Step 4/5] [2021-11-19 21:04:52,637][INFO ][test-runner-#9268%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Data Regions Started: 5 [21:04:52] : [Step 4/5] [2021-11-19 21:04:52,637][INFO ][test-runner-#9268%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] ^-- sysMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:04:52] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:04:52] : [Step 4/5] ^-- default region [type=default, persistence=true, lazyAlloc=true, [21:04:52] : [Step 4/5] ... initCfg=10MB, maxCfg=10MB, usedRam=0MB, freeRam=100%, allocRam=0MB, allocTotal=0MB] [21:04:52] : [Step 4/5] ^-- metastoreMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:04:52] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:04:52] : [Step 4/5] ^-- TxLog region [type=internal, persistence=true, lazyAlloc=false, [21:04:52] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:04:52] : [Step 4/5] ^-- volatileDsMemPlc region [type=user, persistence=false, lazyAlloc=true, [21:04:52] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB] [21:04:52] : [Step 4/5] ^-- Ignite persistence [used=0MB] [21:04:52] : [Step 4/5] [21:04:52] : [Step 4/5] [2021-11-19 21:04:52,639][INFO ][test-runner-#9268%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Starting binary memory restore for: [-2100569601] [21:04:52] : [Step 4/5] [2021-11-19 21:04:52,651][INFO ][test-runner-#9268%encryption.EncryptedCacheNodeJoinTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:04:52] : [Step 4/5] [2021-11-19 21:04:52,651][INFO ][test-runner-#9268%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:04:52] : [Step 4/5] [2021-11-19 21:04:52,654][INFO ][test-runner-#9268%encryption.EncryptedCacheNodeJoinTest%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_6/0000000000000000.wal, offset=0, ver=2] [21:04:52] : [Step 4/5] [2021-11-19 21:04:52,668][INFO ][test-runner-#9268%encryption.EncryptedCacheNodeJoinTest%][GridCacheProcessor] Started cache in recovery mode [name=ignite-sys-cache, id=-2100569601, dataRegionName=sysMemPlc, mode=REPLICATED, atomicity=TRANSACTIONAL, backups=2147483647, mvcc=false] [21:04:52] : [Step 4/5] [2021-11-19 21:04:52,671][INFO ][test-runner-#9268%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Binary recovery performed in 32 ms. [21:04:52] : [Step 4/5] [2021-11-19 21:04:52,671][INFO ][test-runner-#9268%encryption.EncryptedCacheNodeJoinTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:04:52] : [Step 4/5] [2021-11-19 21:04:52,672][INFO ][test-runner-#9268%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Applying lost cache updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:04:52] : [Step 4/5] [2021-11-19 21:04:52,761][INFO ][test-runner-#9268%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=91 ms] [21:04:52] : [Step 4/5] [2021-11-19 21:04:52,761][INFO ][test-runner-#9268%encryption.EncryptedCacheNodeJoinTest%][GridCacheProcessor] Restoring partition state for local groups. [21:04:52] : [Step 4/5] [2021-11-19 21:04:52,790][INFO ][test-runner-#9268%encryption.EncryptedCacheNodeJoinTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=1, partitionsProcessed=100, time=30ms] [21:04:53] : [Step 4/5] [2021-11-19 21:04:53,123][INFO ][test-runner-#9268%encryption.EncryptedCacheNodeJoinTest%][TestTcpDiscoverySpi] Successfully bound to TCP port [port=47501, localHost=localhost/127.0.0.1, locNodeId=603e647b-590d-4fc1-ab37-4d1d82d4f006] [21:04:53] : [Step 4/5] [2021-11-19 21:04:53,128][INFO ][tcp-disco-srvr-[:47500]-#478%grid-0%-#9381%grid-0%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=33559] [21:04:53] : [Step 4/5] [2021-11-19 21:04:53,128][INFO ][tcp-disco-srvr-[:47500]-#478%grid-0%-#9381%grid-0%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=33559] [21:04:53] : [Step 4/5] [2021-11-19 21:04:53,129][INFO ][tcp-disco-sock-reader-[]-#484%grid-0%-#9500%grid-0%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:33559, rmtPort=33559] [21:04:53] : [Step 4/5] [2021-11-19 21:04:53,131][INFO ][tcp-disco-sock-reader-[603e647b 127.0.0.1:33559]-#484%grid-0%-#9500%grid-0%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=603e647b-590d-4fc1-ab37-4d1d82d4f006, rmtAddr=/127.0.0.1:33559] [21:04:53] : [Step 4/5] [2021-11-19 21:04:53,137][INFO ][tcp-disco-srvr-[:47501]-#483%grid-6%-#9499%grid-6%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=58073] [21:04:53] : [Step 4/5] [2021-11-19 21:04:53,138][INFO ][tcp-disco-srvr-[:47501]-#483%grid-6%-#9499%grid-6%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=58073] [21:04:53] : [Step 4/5] [2021-11-19 21:04:53,144][INFO ][tcp-disco-sock-reader-[]-#485%grid-6%-#9501%grid-6%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:58073, rmtPort=58073] [21:04:53] : [Step 4/5] [2021-11-19 21:04:53,145][INFO ][tcp-disco-sock-reader-[]-#485%grid-6%-#9501%grid-6%][TestTcpDiscoverySpi] Received ping request from the remote node [rmtNodeId=0045258f-23c5-47bd-8d53-d47031e11000, rmtAddr=/127.0.0.1:58073, rmtPort=58073] [21:04:53] : [Step 4/5] [2021-11-19 21:04:53,147][INFO ][tcp-disco-sock-reader-[]-#485%grid-6%-#9501%grid-6%][TestTcpDiscoverySpi] Finished writing ping response [rmtNodeId=0045258f-23c5-47bd-8d53-d47031e11000, rmtAddr=/127.0.0.1:58073, rmtPort=58073] [21:04:53]W: [org.apache.ignite:ignite-core] [2021-11-19 21:04:53,148][WARN ][tcp-disco-sock-reader-[]-#485%grid-6%-#9501%grid-6%][TestTcpDiscoverySpi] Failed to shutdown socket [21:04:53]W: [org.apache.ignite:ignite-core] java.net.SocketException: Socket output is already shutdown [21:04:53]W: [org.apache.ignite:ignite-core] at java.net.Socket.shutdownOutput(Socket.java:1572) [21:04:53]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.close(IgniteUtils.java:4247) [21:04:53]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.discovery.tcp.ServerImpl$SocketReader.body(ServerImpl.java:7370) [21:04:53]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.IgniteSpiThread.run(IgniteSpiThread.java:58) [21:04:53] : [Step 4/5] [2021-11-19 21:04:53,153][INFO ][tcp-disco-sock-reader-[]-#485%grid-6%-#9501%grid-6%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:58073, rmtPort=58073, rmtNodeId=null] [21:04:53] : [Step 4/5] [2021-11-19 21:04:53,152][INFO ][tcp-disco-msg-worker-[crd]-#477%grid-0%-#9380%grid-0%][GridEncryptionManager] Joining node doesn't have stored group keys [node=603e647b-590d-4fc1-ab37-4d1d82d4f006] [21:04:53] : [Step 4/5] [2021-11-19 21:04:53,149][INFO ][tcp-disco-sock-reader-[603e647b 127.0.0.1:33559]-#484%grid-0%-#9500%grid-0%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:33559, rmtPort=33559, rmtNodeId=603e647b-590d-4fc1-ab37-4d1d82d4f006] [21:04:53] : [Step 4/5] [2021-11-19 21:04:53,176][INFO ][tcp-disco-msg-worker-[crd]-#477%grid-0%-#9380%grid-0%][TestTcpDiscoverySpi] New next node [newNext=TcpDiscoveryNode [id=603e647b-590d-4fc1-ab37-4d1d82d4f006, consistentId=grid-6, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=0, intOrder=2, lastExchangeTime=1637345093131, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false]] [21:04:53] : [Step 4/5] [2021-11-19 21:04:53,177][INFO ][tcp-disco-srvr-[:47501]-#483%grid-6%-#9499%grid-6%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=58875] [21:04:53] : [Step 4/5] [2021-11-19 21:04:53,177][INFO ][tcp-disco-srvr-[:47501]-#483%grid-6%-#9499%grid-6%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=58875] [21:04:53] : [Step 4/5] [2021-11-19 21:04:53,178][INFO ][tcp-disco-sock-reader-[]-#486%grid-6%-#9502%grid-6%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:58875, rmtPort=58875] [21:04:53] : [Step 4/5] [2021-11-19 21:04:53,180][INFO ][tcp-disco-sock-reader-[0045258f 127.0.0.1:58875]-#486%grid-6%-#9502%grid-6%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=0045258f-23c5-47bd-8d53-d47031e11000, rmtAddr=/127.0.0.1:58875] [21:04:53] : [Step 4/5] [2021-11-19 21:04:53,185][INFO ][tcp-disco-msg-worker-[]-#482%grid-6%-#9498%grid-6%][TestTcpDiscoverySpi] New next node [newNext=TcpDiscoveryNode [id=0045258f-23c5-47bd-8d53-d47031e11000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345093182, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false]] [21:04:53] : [Step 4/5] [2021-11-19 21:04:53,187][INFO ][tcp-disco-srvr-[:47500]-#478%grid-0%-#9381%grid-0%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=35083] [21:04:53] : [Step 4/5] [2021-11-19 21:04:53,187][INFO ][tcp-disco-srvr-[:47500]-#478%grid-0%-#9381%grid-0%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=35083] [21:04:53] : [Step 4/5] [2021-11-19 21:04:53,188][INFO ][tcp-disco-sock-reader-[]-#487%grid-0%-#9503%grid-0%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:35083, rmtPort=35083] [21:04:53] : [Step 4/5] [2021-11-19 21:04:53,189][INFO ][tcp-disco-sock-reader-[603e647b 127.0.0.1:35083]-#487%grid-0%-#9503%grid-0%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=603e647b-590d-4fc1-ab37-4d1d82d4f006, rmtAddr=/127.0.0.1:35083] [21:04:53] : [Step 4/5] [2021-11-19 21:04:53,196][INFO ][disco-event-worker-#9383%grid-0%][GridDiscoveryManager] Added new node to topology: TcpDiscoveryNode [id=603e647b-590d-4fc1-ab37-4d1d82d4f006, consistentId=grid-6, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637345093131, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false] [21:04:53] : [Step 4/5] [2021-11-19 21:04:53,198][INFO ][disco-event-worker-#9383%grid-0%][GridDiscoveryManager] Topology snapshot [ver=2, locNode=0045258f, servers=2, clients=0, state=INACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=0045258f-23c5-47bd-8d53-d47031e11000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=603e647b-590d-4fc1-ab37-4d1d82d4f006, consistentId=grid-6, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:04:53] : [Step 4/5] [2021-11-19 21:04:53,199][INFO ][tcp-disco-msg-worker-[0045258f 127.0.0.1:47500]-#482%grid-6%-#9498%grid-6%][ClusterProcessor] confident_euler [21:04:53] : [Step 4/5] [2021-11-19 21:04:53,199][INFO ][tcp-disco-msg-worker-[0045258f 127.0.0.1:47500]-#482%grid-6%-#9498%grid-6%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustEnabled' was changed from 'null' to 'false' [21:04:53] : [Step 4/5] [2021-11-19 21:04:53,200][INFO ][tcp-disco-msg-worker-[0045258f 127.0.0.1:47500]-#482%grid-6%-#9498%grid-6%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustTimeout' was changed from 'null' to '300000' [21:04:53] : [Step 4/5] [2021-11-19 21:04:53,200][INFO ][tcp-disco-msg-worker-[0045258f 127.0.0.1:47500]-#482%grid-6%-#9498%grid-6%][IgniteTxManager] Transactions parameter 'longOperationsDumpTimeout' was changed from 'null' to '60000' [21:04:53] : [Step 4/5] [2021-11-19 21:04:53,200][INFO ][tcp-disco-msg-worker-[0045258f 127.0.0.1:47500]-#482%grid-6%-#9498%grid-6%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpThreshold' was changed from 'null' to '0' [21:04:53] : [Step 4/5] [2021-11-19 21:04:53,201][INFO ][tcp-disco-msg-worker-[0045258f 127.0.0.1:47500]-#482%grid-6%-#9498%grid-6%][IgniteTxManager] Transactions parameter 'transactionTimeDumpSamplesCoefficient' was changed from 'null' to '0.0' [21:04:53] : [Step 4/5] [2021-11-19 21:04:53,201][INFO ][tcp-disco-msg-worker-[0045258f 127.0.0.1:47500]-#482%grid-6%-#9498%grid-6%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpSamplesPerSecondLimit' was changed from 'null' to '5' [21:04:53] : [Step 4/5] [2021-11-19 21:04:53,202][INFO ][tcp-disco-msg-worker-[0045258f 127.0.0.1:47500]-#482%grid-6%-#9498%grid-6%][IgniteTxManager] Transactions parameter 'collisionsDumpInterval' was changed from 'null' to '1000' [21:04:53] : [Step 4/5] [2021-11-19 21:04:53,202][INFO ][tcp-disco-msg-worker-[0045258f 127.0.0.1:47500]-#482%grid-6%-#9498%grid-6%][IgniteTxManager] Transactions parameter 'txOwnerDumpRequestsAllowed' was changed from 'null' to 'true' [21:04:53] : [Step 4/5] [2021-11-19 21:04:53,202][INFO ][tcp-disco-msg-worker-[0045258f 127.0.0.1:47500]-#482%grid-6%-#9498%grid-6%][GridCacheDatabaseSharedManager] Historical rebalance WAL threshold changed [property=historical.rebalance.threshold, oldVal=null, newVal=500] [21:04:53] : [Step 4/5] [2021-11-19 21:04:53,203][INFO ][disco-notifier-worker-#9497%grid-6%][MvccProcessorImpl] Assigned mvcc coordinator [crd=MvccCoordinator [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=0], nodeId=0045258f-23c5-47bd-8d53-d47031e11000, ver=1637345091812, local=false, initialized=false]] [21:04:53] : [Step 4/5] [2021-11-19 21:04:53,206][INFO ][sys-#9477%grid-6%][ClusterProcessor] Writing cluster ID and tag to metastorage on ready for write ClusterIdAndTag [id=69b6f745-810c-481b-8f4b-79b2ffef1fc6, tag=confident_euler] [21:04:53] : [Step 4/5] [2021-11-19 21:04:53,238][INFO ][test-runner-#9268%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-6] To start Console Management & Monitoring run ignitevisorcmd.{sh|bat} [21:04:53] : [Step 4/5] [2021-11-19 21:04:53,239][INFO ][test-runner-#9268%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-6] [21:04:53] : [Step 4/5] [21:04:53] : [Step 4/5] >>> +-------------------------------------------+ [21:04:53] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:04:53] : [Step 4/5] >>> +-------------------------------------------+ [21:04:53] : [Step 4/5] >>> OS name: Linux 4.15.0-151-generic amd64 [21:04:53] : [Step 4/5] >>> CPU(s): 24 [21:04:53] : [Step 4/5] >>> Heap: 2.0GB [21:04:53] : [Step 4/5] >>> VM name: 16724@c4dfe9a430b2 [21:04:53] : [Step 4/5] >>> Ignite instance name: grid-6 [21:04:53] : [Step 4/5] >>> Local node [ID=603E647B-590D-4FC1-AB37-4D1D82D4F006, order=2, clientMode=false] [21:04:53] : [Step 4/5] >>> Local node addresses: [127.0.0.1] [21:04:53] : [Step 4/5] >>> Local ports: TCP:10801 TCP:45151 TCP:47501 [21:04:53] : [Step 4/5] [21:04:53] : [Step 4/5] [2021-11-19 21:04:53,240][INFO ][test-runner-#9268%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-6] >>> Ignite cluster is in INACTIVE state (limited functionality available). Use control.(sh|bat) script or IgniteCluster.state(ClusterState.ACTIVE) to change the state. [21:04:53] : [Step 4/5] [2021-11-19 21:04:53,241][INFO ][test-runner-#9268%encryption.EncryptedCacheNodeJoinTest%][GridDiscoveryManager] Topology snapshot [ver=2, locNode=603e647b, servers=2, clients=0, state=INACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=0045258f-23c5-47bd-8d53-d47031e11000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=603e647b-590d-4fc1-ab37-4d1d82d4f006, consistentId=grid-6, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:04:53] : [Step 4/5] [2021-11-19 21:04:53,242][INFO ][test-runner-#9268%encryption.EncryptedCacheNodeJoinTest%][G] Node started : [stage="Configure system pool" (0 ms),stage="Start managers" (282 ms),stage="Configure binary metadata" (3 ms),stage="Start processors" (442 ms),stage="Start 'StanByClusterTestProvider' plugin" (0 ms),stage="Start 'PageMemory tracker plugin' plugin" (0 ms),stage="Start 'TestDistibutedConfigurationPlugin' plugin" (0 ms),stage="Start 'NodeValidationPluginProvider' plugin" (0 ms),stage="Init metastore" (28 ms),stage="Init and start regions" (8 ms),stage="Restore binary memory" (32 ms),stage="Restore logical state" (118 ms),stage="Finish recovery" (331 ms),stage="Join topology" (81 ms),stage="Await transition" (3 ms),stage="Await exchange" (34 ms),stage="Total time" (1362 ms)] [21:04:53] : [Step 4/5] [2021-11-19 21:04:53,244][INFO ][test-runner-#9268%encryption.EncryptedCacheNodeJoinTest%][root] Node started with the following configuration [id=603e647b-590d-4fc1-ab37-4d1d82d4f006, marshaller=BinaryMarshaller [], discovery=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=5000, ackTimeout=5000, marsh=JdkMarshaller [clsFilter=org.apache.ignite.marshaller.MarshallerUtils$1@23bbf9e7], reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], binaryCfg=null, lateAff=true] [21:04:53]W: [org.apache.ignite:ignite-core] [2021-11-19 21:04:53,251][WARN ][test-runner-#9268%encryption.EncryptedCacheNodeJoinTest%][G] Ignite work directory is not provided, automatically resolved to: /opt/buildagent/work/7bc1c54bc719b67c/work [21:04:53] : [Step 4/5] [2021-11-19 21:04:53,253][INFO ][test-runner-#9268%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%client1] [21:04:53] : [Step 4/5] [21:04:53] : [Step 4/5] >>> __________ ________________ [21:04:53] : [Step 4/5] >>> / _/ ___/ |/ / _/_ __/ __/ [21:04:53] : [Step 4/5] >>> _/ // (7 7 // / / / / _/ [21:04:53] : [Step 4/5] >>> /___/\___/_/|_/___/ /_/ /___/ [21:04:53] : [Step 4/5] >>> [21:04:53] : [Step 4/5] >>> ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:04:53] : [Step 4/5] >>> 2021 Copyright(C) Apache Software Foundation [21:04:53] : [Step 4/5] >>> [21:04:53] : [Step 4/5] >>> Ignite documentation: http://ignite.apache.org [21:04:53] : [Step 4/5] [21:04:53] : [Step 4/5] [2021-11-19 21:04:53,253][INFO ][test-runner-#9268%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%client1] Config URL: n/a [21:04:53] : [Step 4/5] [2021-11-19 21:04:53,254][INFO ][test-runner-#9268%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%client1] IgniteConfiguration [igniteInstanceName=client1, pubPoolSize=24, svcPoolSize=24, callbackPoolSize=24, stripedPoolSize=24, sysPoolSize=24, mgmtPoolSize=4, dataStreamerPoolSize=24, utilityCachePoolSize=24, utilityCacheKeepAliveTime=60000, p2pPoolSize=2, qryPoolSize=24, buildIdxPoolSize=4, igniteHome=/opt/buildagent/work/7bc1c54bc719b67c, igniteWorkDir=/opt/buildagent/work/7bc1c54bc719b67c/work, mbeanSrv=com.sun.jmx.mbeanserver.JmxMBeanServer@6fe85038, nodeId=10241b20-c4cf-432c-a7cb-5d127f447001, marsh=BinaryMarshaller [], marshLocJobs=false, daemon=false, p2pEnabled=true, netTimeout=10000, netCompressionLevel=1, sndRetryDelay=1000, sndRetryCnt=3, metricsHistSize=10000, metricsUpdateFreq=1000, metricsExpTime=9223372036854775807, discoSpi=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=0, ackTimeout=0, marsh=null, reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], segPlc=STOP, segResolveAttempts=2, waitForSegOnStart=true, allResolversPassReq=true, segChkFreq=10000, commSpi=TcpCommunicationSpi [connectGate=org.apache.ignite.spi.communication.tcp.internal.ConnectGateway@4834b55, ctxInitLatch=java.util.concurrent.CountDownLatch@447884a1[Count = 1], stopping=false, clientPool=null, nioSrvWrapper=null, stateProvider=null], evtSpi=MemoryEventStorageSpi [expireAgeMs=9223372036854775807, expireCnt=10000, filter=null], colSpi=NoopCollisionSpi [], deploySpi=LocalDeploymentSpi [], indexingSpi=org.apache.ignite.spi.indexing.noop.NoopIndexingSpi@4c564d18, addrRslvr=null, encryptionSpi=org.apache.ignite.spi.encryption.noop.NoopEncryptionSpi@1e9b28fe, tracingSpi=org.apache.ignite.spi.tracing.NoopTracingSpi@294a200b, clientMode=true, rebalanceThreadPoolSize=4, rebalanceTimeout=10000, rebalanceBatchesPrefetchCnt=3, rebalanceThrottle=0, rebalanceBatchSize=524288, txCfg=TransactionConfiguration [txSerEnabled=false, dfltIsolation=REPEATABLE_READ, dfltConcurrency=PESSIMISTIC, dfltTxTimeout=0, txTimeoutOnPartitionMapExchange=0, deadlockTimeout=10000, pessimisticTxLogSize=0, pessimisticTxLogLinger=10000, tmLookupClsName=null, txManagerFactory=null, useJtaSync=false], cacheSanityCheckEnabled=true, discoStartupDelay=60000, deployMode=SHARED, p2pMissedCacheSize=100, locHost=127.0.0.1, timeSrvPortBase=31100, timeSrvPortRange=100, failureDetectionTimeout=10000, sysWorkerBlockedTimeout=null, clientFailureDetectionTimeout=10000, metricsLogFreq=0, connectorCfg=null, odbcCfg=null, warmupClos=null, atomicCfg=AtomicConfiguration [seqReserveSize=1000, cacheMode=PARTITIONED, backups=1, aff=null, grpName=null], classLdr=null, sslCtxFactory=null, platformCfg=null, binaryCfg=null, memCfg=null, pstCfg=null, dsCfg=DataStorageConfiguration [sysRegionInitSize=41943040, sysRegionMaxSize=104857600, pageSize=4096, concLvl=0, dfltDataRegConf=DataRegionConfiguration [name=default, maxSize=10485760, initSize=268435456, swapPath=null, pageEvictionMode=DISABLED, pageReplacementMode=CLOCK, evictionThreshold=0.9, emptyPagesPoolSize=100, metricsEnabled=false, metricsSubIntervalCount=5, metricsRateTimeInterval=60000, persistenceEnabled=true, checkpointPageBufSize=0, lazyMemoryAllocation=true, warmUpCfg=null], dataRegions=null, storagePath=null, checkpointFreq=180000, lockWaitTime=10000, checkpointThreads=4, checkpointWriteOrder=SEQUENTIAL, walHistSize=20, maxWalArchiveSize=1073741824, walSegments=10, walSegmentSize=67108864, walPath=db/wal, walArchivePath=db/wal/archive, cdcWalPath=db/wal/cdc, cdcEnabled=false, metricsEnabled=false, walMode=FSYNC, walTlbSize=131072, walBuffSize=0, walFlushFreq=2000, walFsyncDelay=1000, walRecordIterBuffSize=67108864, alwaysWriteFullPages=false, fileIOFactory=org.apache.ignite.internal.processors.cache.persistence.file.AsyncFileIOFactory@3f62ad14, metricsSubIntervalCnt=5, metricsRateTimeInterval=60000, walAutoArchiveAfterInactivity=-1, walForceArchiveTimeout=-1, writeThrottlingEnabled=false, walCompactionEnabled=false, walCompactionLevel=1, checkpointReadLockTimeout=null, walPageCompression=DISABLED, walPageCompressionLevel=null, dfltWarmUpCfg=null, encCfg=org.apache.ignite.configuration.EncryptionConfiguration@6a430a83, defragmentationThreadPoolSize=4, minWalArchiveSize=-1], snapshotPath=snapshots, activeOnStart=true, activeOnStartPropSetFlag=false, autoActivation=true, autoActivationPropSetFlag=false, clusterStateOnStart=null, sqlConnCfg=null, cliConnCfg=ClientConnectorConfiguration [host=null, port=10800, portRange=100, sockSndBufSize=0, sockRcvBufSize=0, tcpNoDelay=true, maxOpenCursorsPerConn=128, threadPoolSize=24, selectorCnt=12, idleTimeout=0, handshakeTimeout=10000, jdbcEnabled=true, odbcEnabled=true, thinCliEnabled=true, sslEnabled=false, useIgniteSslCtxFactory=true, sslClientAuth=false, sslCtxFactory=null, thinCliCfg=ThinClientConfiguration [maxActiveTxPerConn=100, maxActiveComputeTasksPerConn=0]], mvccVacuumThreadCnt=2, mvccVacuumFreq=5000, authEnabled=false, failureHnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]], commFailureRslvr=null, sqlCfg=SqlConfiguration [longQryWarnTimeout=3000, dfltQryTimeout=0, sqlQryHistSize=1000, validationEnabled=false], asyncContinuationExecutor=null] [21:04:53] : [Step 4/5] [2021-11-19 21:04:53,265][INFO ][test-runner-#9268%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%client1] Daemon mode: off [21:04:53] : [Step 4/5] [2021-11-19 21:04:53,265][INFO ][test-runner-#9268%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%client1] OS: Linux 4.15.0-151-generic amd64 [21:04:53] : [Step 4/5] [2021-11-19 21:04:53,265][INFO ][test-runner-#9268%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%client1] OS user: teamcity [21:04:53] : [Step 4/5] [2021-11-19 21:04:53,266][INFO ][test-runner-#9268%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%client1] PID: 16724 [21:04:53] : [Step 4/5] [2021-11-19 21:04:53,266][INFO ][test-runner-#9268%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%client1] Language runtime: Java Platform API Specification ver. 1.8 [21:04:53] : [Step 4/5] [2021-11-19 21:04:53,267][INFO ][test-runner-#9268%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%client1] VM information: Java(TM) SE Runtime Environment 1.8.0_261-b12 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 25.261-b12 [21:04:53] : [Step 4/5] [2021-11-19 21:04:53,267][INFO ][test-runner-#9268%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%client1] VM total memory: 1.9GB [21:04:53] : [Step 4/5] [2021-11-19 21:04:53,267][INFO ][test-runner-#9268%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%client1] Remote Management [restart: off, REST: off, JMX (remote: off)] [21:04:53] : [Step 4/5] [2021-11-19 21:04:53,268][INFO ][test-runner-#9268%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%client1] Logger: GridTestLog4jLogger [quiet=false, config=null] [21:04:53] : [Step 4/5] [2021-11-19 21:04:53,268][INFO ][test-runner-#9268%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%client1] IGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c [21:04:53] : [Step 4/5] [2021-11-19 21:04:53,269][INFO ][test-runner-#9268%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%client1] VM arguments: [-DIGNITE_DUMP_THREADS_ON_FAILURE=false, -DMono=/usr/bin/mono-sgen, -DMono4.0_x64=/usr/lib/mono/4.0, -DMono4.5_x64=/usr/lib/mono/4.5, -DMonoVersion=6.12.0.90, -DSKIP_BUILD=false, -Dagent.home.dir=/opt/buildagent, -Dagent.name=aitc-lin02_03, -Dagent.ownPort=9090, -Dagent.work.dir=/opt/buildagent/work, -Dbuild.number=95, -Dbuild.vcs.number=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.1=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.GitHubApacheIgnite=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dclassworlds.conf=/opt/buildagent/temp/buildTmp/teamcity.m2.conf, -Dcom.jetbrains.maven.watcher.report.file=/opt/buildagent/temp/buildTmp/maven-build-info.xml, -Djava.io.tmpdir=/opt/buildagent/temp/buildTmp, -Dmaven.home=/opt/buildagent/tools/maven3_6, -Dmaven.multiModuleProjectDirectory=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.agent.cpuBenchmark=457, -Dteamcity.agent.dotnet.agent_url=http://localhost:9090/RPC2, -Dteamcity.agent.dotnet.build_id=6278078, -Dteamcity.auth.password=*******, -Dteamcity.auth.userId=TeamCityBuildId=6278078, -Dteamcity.build.changedFiles.file=/opt/buildagent/temp/buildTmp/changedFiles6342607772318147725.txt, -Dteamcity.build.checkoutDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.build.id=6278078, -Dteamcity.build.properties.file=/opt/buildagent/temp/buildTmp/teamcity.build5164517880467851002.properties, -Dteamcity.build.tempDir=/opt/buildagent/temp/buildTmp, -Dteamcity.build.workingDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.buildConfName=Basic 3, -Dteamcity.buildType.id=IgniteTests24Java8_Basic3, -Dteamcity.configuration.properties.file=/opt/buildagent/temp/buildTmp/teamcity.config5591980786735343870.properties, -Dteamcity.maven.userSettings.path=/opt/buildagent/temp/buildTmp/maven_settings_585072866407032347.xml, -Dteamcity.maven.watcher.home=/opt/buildagent/plugins/mavenPlugin/maven-watcher-jdk16, -Dteamcity.projectName=Ignite Tests 2.x (JDK 8/11), -Dteamcity.runner.properties.file=/opt/buildagent/temp/buildTmp/teamcity.runner9098465561618137420.properties, -Dteamcity.tests.recentlyFailedTests.file=/opt/buildagent/temp/buildTmp/testsToRunFirst3891775683130404069.txt, -Dteamcity.version=2021.2 (build 99542), -ea, -Xms2g, -Xmx2g, -XX:+HeapDumpOnOutOfMemoryError, -DIGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_TEST_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_UPDATE_NOTIFIER=false, -DIGNITE_NO_DISCO_ORDER=true, -DIGNITE_PERFORMANCE_SUGGESTIONS_DISABLED=true, -Djava.net.preferIPv4Stack=true, -DTEST_SCALE_FACTOR=1.0, -DIGNITE_TEST_PROP_LOG4J_FILE=log4j-tc-test.xml, -DIGNITE_QUIET=false, -DIGNITE_MARSHAL_BUFFERS_RECHECK=1000, -Dmaven.repo.local=/opt/buildagent/.m2/repository] [21:04:53] : [Step 4/5] [2021-11-19 21:04:53,274][INFO ][test-runner-#9268%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%client1] System cache's DataRegion size is configured to 40 MB. Use DataStorageConfiguration.systemRegionInitialSize property to change the setting. [21:04:53] : [Step 4/5] [2021-11-19 21:04:53,275][INFO ][test-runner-#9268%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%client1] Configured caches [in 'sysMemPlc' dataRegion: ['ignite-sys-cache']] [21:04:53]W: [org.apache.ignite:ignite-core] [2021-11-19 21:04:53,275][WARN ][test-runner-#9268%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%client1] Peer class loading is enabled (disable it in production for performance and deployment consistency reasons) [21:04:53] : [Step 4/5] [2021-11-19 21:04:53,276][INFO ][test-runner-#9268%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%client1] 3-rd party licenses can be found at: /opt/buildagent/work/7bc1c54bc719b67c/libs/licenses [21:04:53] : [Step 4/5] [2021-11-19 21:04:53,282][INFO ][test-runner-#9268%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] Configured plugins: [21:04:53] : [Step 4/5] [2021-11-19 21:04:53,282][INFO ][test-runner-#9268%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- StanByClusterTestProvider 1.0 [21:04:53] : [Step 4/5] [2021-11-19 21:04:53,283][INFO ][test-runner-#9268%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- null [21:04:53] : [Step 4/5] [2021-11-19 21:04:53,283][INFO ][test-runner-#9268%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] [21:04:53] : [Step 4/5] [2021-11-19 21:04:53,283][INFO ][test-runner-#9268%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- PageMemory tracker plugin 1.0 [21:04:53] : [Step 4/5] [2021-11-19 21:04:53,284][INFO ][test-runner-#9268%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- null [21:04:53] : [Step 4/5] [2021-11-19 21:04:53,284][INFO ][test-runner-#9268%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] [21:04:53] : [Step 4/5] [2021-11-19 21:04:53,284][INFO ][test-runner-#9268%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- TestDistibutedConfigurationPlugin 1.0 [21:04:53] : [Step 4/5] [2021-11-19 21:04:53,285][INFO ][test-runner-#9268%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- null [21:04:53] : [Step 4/5] [2021-11-19 21:04:53,285][INFO ][test-runner-#9268%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] [21:04:53] : [Step 4/5] [2021-11-19 21:04:53,285][INFO ][test-runner-#9268%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- NodeValidationPluginProvider 1.0 [21:04:53] : [Step 4/5] [2021-11-19 21:04:53,285][INFO ][test-runner-#9268%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- null [21:04:53] : [Step 4/5] [2021-11-19 21:04:53,286][INFO ][test-runner-#9268%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] [21:04:53] : [Step 4/5] [2021-11-19 21:04:53,286][INFO ][test-runner-#9268%encryption.EncryptedCacheNodeJoinTest%][FailureProcessor] Configured failure handler: [hnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]]] [21:04:53] : [Step 4/5] [2021-11-19 21:04:53,403][INFO ][test-runner-#9268%encryption.EncryptedCacheNodeJoinTest%][TcpCommunicationSpi] Successfully bound communication NIO server to TCP port [port=45152, locHost=/127.0.0.1, selectorsCnt=12, selectorSpins=0, pairedConn=false] [21:04:53]W: [org.apache.ignite:ignite-core] [2021-11-19 21:04:53,404][WARN ][test-runner-#9268%encryption.EncryptedCacheNodeJoinTest%][TcpCommunicationSpi] Message queue limit is set to 0 which may lead to potential OOMEs when running cache operations in FULL_ASYNC or PRIMARY_SYNC modes due to message queues growth on sender and receiver sides. [21:04:53] : [Step 4/5] [2021-11-19 21:04:53,413][INFO ][test-runner-#9268%encryption.EncryptedCacheNodeJoinTest%][GridCollisionManager] Collision resolution is disabled (all jobs will be activated upon arrival). [21:04:53] : [Step 4/5] [2021-11-19 21:04:53,414][INFO ][test-runner-#9268%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%client1] Security status [authentication=off, sandbox=off, tls/ssl=off] [21:04:53]W: [org.apache.ignite:ignite-core] [2021-11-19 21:04:53,420][WARN ][test-runner-#9268%encryption.EncryptedCacheNodeJoinTest%][GridCacheProcessor] Persistent Store is not supported on client nodes (Persistent Store's configuration will be ignored). [21:04:53] : [Step 4/5] [2021-11-19 21:04:53,424][INFO ][test-runner-#9268%encryption.EncryptedCacheNodeJoinTest%][IgniteCacheDatabaseSharedManager] Configured data regions initialized successfully [total=4] [21:04:53] : [Step 4/5] [2021-11-19 21:04:53,429][INFO ][test-runner-#9268%encryption.EncryptedCacheNodeJoinTest%][ClientListenerProcessor] Client connector processor has started on TCP port 10802 [21:04:53] : [Step 4/5] [2021-11-19 21:04:53,433][INFO ][test-runner-#9268%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%client1] Non-loopback local IPs: 172.17.0.4 [21:04:53] : [Step 4/5] [2021-11-19 21:04:53,433][INFO ][test-runner-#9268%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%client1] Enabled local MACs: 0242AC110004 [21:04:53] : [Step 4/5] [2021-11-19 21:04:53,434][INFO ][test-runner-#9268%encryption.EncryptedCacheNodeJoinTest%][ClusterProcessor] Cluster ID and tag has been read from metastorage: null [21:04:53] : [Step 4/5] [2021-11-19 21:04:53,434][INFO ][test-runner-#9268%encryption.EncryptedCacheNodeJoinTest%][IgniteClusterImpl] Shutdown policy was updated [oldVal=null, newVal=null] [21:04:53] : [Step 4/5] [2021-11-19 21:04:53,441][INFO ][tcp-disco-srvr-[:47500]-#478%grid-0%-#9381%grid-0%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=58997] [21:04:53] : [Step 4/5] [2021-11-19 21:04:53,442][INFO ][tcp-disco-srvr-[:47500]-#478%grid-0%-#9381%grid-0%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=58997] [21:04:53] : [Step 4/5] [2021-11-19 21:04:53,442][INFO ][tcp-disco-sock-reader-[]-#494%grid-0%-#9597%grid-0%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:58997, rmtPort=58997] [21:04:53] : [Step 4/5] [2021-11-19 21:04:53,444][INFO ][tcp-disco-sock-reader-[10241b20 127.0.0.1:58997 client]-#494%grid-0%-#9597%grid-0%][TestTcpDiscoverySpi] Initialized connection with remote client node [nodeId=10241b20-c4cf-432c-a7cb-5d127f447001, rmtAddr=/127.0.0.1:58997] [21:04:53] : [Step 4/5] [2021-11-19 21:04:53,475][INFO ][disco-event-worker-#9383%grid-0%][GridDiscoveryManager] Added new node to topology: TcpDiscoveryNode [id=10241b20-c4cf-432c-a7cb-5d127f447001, consistentId=client1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:0], discPort=0, order=3, intOrder=3, lastExchangeTime=1637345093448, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=true] [21:04:53] : [Step 4/5] [2021-11-19 21:04:53,479][INFO ][disco-event-worker-#9383%grid-0%][GridDiscoveryManager] Topology snapshot [ver=3, locNode=0045258f, servers=2, clients=1, state=INACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=0045258f-23c5-47bd-8d53-d47031e11000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=603e647b-590d-4fc1-ab37-4d1d82d4f006, consistentId=grid-6, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=10241b20-c4cf-432c-a7cb-5d127f447001, consistentId=client1, isClient=true, ver=2.13.0#20211119-sha1:00000000]]] [21:04:53] : [Step 4/5] [2021-11-19 21:04:53,492][INFO ][disco-event-worker-#9505%grid-6%][GridDiscoveryManager] Added new node to topology: TcpDiscoveryNode [id=10241b20-c4cf-432c-a7cb-5d127f447001, consistentId=client1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:0], discPort=0, order=3, intOrder=3, lastExchangeTime=1637345093458, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=true] [21:04:53] : [Step 4/5] [2021-11-19 21:04:53,493][INFO ][disco-event-worker-#9505%grid-6%][GridDiscoveryManager] Topology snapshot [ver=3, locNode=603e647b, servers=2, clients=1, state=INACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=0045258f-23c5-47bd-8d53-d47031e11000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=603e647b-590d-4fc1-ab37-4d1d82d4f006, consistentId=grid-6, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=10241b20-c4cf-432c-a7cb-5d127f447001, consistentId=client1, isClient=true, ver=2.13.0#20211119-sha1:00000000]]] [21:04:53] : [Step 4/5] [2021-11-19 21:04:53,493][INFO ][tcp-client-disco-msg-worker-#493%client1%-#9595%client1%][TestTcpDiscoverySpi] Router node: TcpDiscoveryNode [id=0045258f-23c5-47bd-8d53-d47031e11000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345093479, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false] [21:04:53] : [Step 4/5] [2021-11-19 21:04:53,499][INFO ][tcp-client-disco-msg-worker-#493%client1%-#9595%client1%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustEnabled' was changed from 'null' to 'false' [21:04:53] : [Step 4/5] [2021-11-19 21:04:53,500][INFO ][tcp-client-disco-msg-worker-#493%client1%-#9595%client1%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustTimeout' was changed from 'null' to '300000' [21:04:53] : [Step 4/5] [2021-11-19 21:04:53,500][INFO ][tcp-client-disco-msg-worker-#493%client1%-#9595%client1%][IgniteTxManager] Transactions parameter 'collisionsDumpInterval' was changed from 'null' to '1000' [21:04:53] : [Step 4/5] [2021-11-19 21:04:53,501][INFO ][tcp-client-disco-msg-worker-#493%client1%-#9595%client1%][IgniteTxManager] Transactions parameter 'longOperationsDumpTimeout' was changed from 'null' to '60000' [21:04:53] : [Step 4/5] [2021-11-19 21:04:53,501][INFO ][tcp-client-disco-msg-worker-#493%client1%-#9595%client1%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpSamplesPerSecondLimit' was changed from 'null' to '5' [21:04:53] : [Step 4/5] [2021-11-19 21:04:53,502][INFO ][tcp-client-disco-msg-worker-#493%client1%-#9595%client1%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpThreshold' was changed from 'null' to '0' [21:04:53] : [Step 4/5] [2021-11-19 21:04:53,502][INFO ][tcp-client-disco-msg-worker-#493%client1%-#9595%client1%][IgniteTxManager] Transactions parameter 'transactionTimeDumpSamplesCoefficient' was changed from 'null' to '0.0' [21:04:53] : [Step 4/5] [2021-11-19 21:04:53,503][INFO ][tcp-client-disco-msg-worker-#493%client1%-#9595%client1%][IgniteTxManager] Transactions parameter 'txOwnerDumpRequestsAllowed' was changed from 'null' to 'true' [21:04:53] : [Step 4/5] [2021-11-19 21:04:53,503][INFO ][tcp-client-disco-msg-worker-#493%client1%-#9595%client1%][ClusterProcessor] confident_euler [21:04:53] : [Step 4/5] [2021-11-19 21:04:53,505][INFO ][disco-notifier-worker-#9592%client1%][MvccProcessorImpl] Assigned mvcc coordinator [crd=MvccCoordinator [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], nodeId=0045258f-23c5-47bd-8d53-d47031e11000, ver=1637345091812, local=false, initialized=false]] [21:04:53] : [Step 4/5] [2021-11-19 21:04:53,508][INFO ][sys-#9599%client1%][ClusterProcessor] Writing cluster ID and tag to metastorage on ready for write ClusterIdAndTag [id=69b6f745-810c-481b-8f4b-79b2ffef1fc6, tag=confident_euler] [21:04:53] : [Step 4/5] [2021-11-19 21:04:53,577][INFO ][test-runner-#9268%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%client1] To start Console Management & Monitoring run ignitevisorcmd.{sh|bat} [21:04:53] : [Step 4/5] [2021-11-19 21:04:53,578][INFO ][test-runner-#9268%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%client1] [21:04:53] : [Step 4/5] [21:04:53] : [Step 4/5] >>> +-------------------------------------------+ [21:04:53] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:04:53] : [Step 4/5] >>> +-------------------------------------------+ [21:04:53] : [Step 4/5] >>> OS name: Linux 4.15.0-151-generic amd64 [21:04:53] : [Step 4/5] >>> CPU(s): 24 [21:04:53] : [Step 4/5] >>> Heap: 2.0GB [21:04:53] : [Step 4/5] >>> VM name: 16724@c4dfe9a430b2 [21:04:53] : [Step 4/5] >>> Ignite instance name: client1 [21:04:53] : [Step 4/5] >>> Local node [ID=10241B20-C4CF-432C-A7CB-5D127F447001, order=3, clientMode=true] [21:04:53] : [Step 4/5] >>> Local node addresses: [127.0.0.1] [21:04:53] : [Step 4/5] >>> Local ports: TCP:10802 TCP:45152 [21:04:53] : [Step 4/5] [21:04:53] : [Step 4/5] [2021-11-19 21:04:53,579][INFO ][test-runner-#9268%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%client1] >>> Ignite cluster is in INACTIVE state (limited functionality available). Use control.(sh|bat) script or IgniteCluster.state(ClusterState.ACTIVE) to change the state. [21:04:53] : [Step 4/5] [2021-11-19 21:04:53,582][INFO ][test-runner-#9268%encryption.EncryptedCacheNodeJoinTest%][GridDiscoveryManager] Topology snapshot [ver=3, locNode=10241b20, servers=2, clients=1, state=INACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=10241b20-c4cf-432c-a7cb-5d127f447001, consistentId=client1, isClient=true, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=0045258f-23c5-47bd-8d53-d47031e11000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=603e647b-590d-4fc1-ab37-4d1d82d4f006, consistentId=grid-6, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:04:53] : [Step 4/5] [2021-11-19 21:04:53,583][INFO ][test-runner-#9268%encryption.EncryptedCacheNodeJoinTest%][G] Node started : [stage="Configure system pool" (0 ms),stage="Start managers" (163 ms),stage="Configure binary metadata" (2 ms),stage="Start processors" (13 ms),stage="Start 'StanByClusterTestProvider' plugin" (0 ms),stage="Start 'PageMemory tracker plugin' plugin" (0 ms),stage="Start 'TestDistibutedConfigurationPlugin' plugin" (0 ms),stage="Start 'NodeValidationPluginProvider' plugin" (0 ms),stage="Init metastore" (2 ms),stage="Finish recovery" (0 ms),stage="Join topology" (79 ms),stage="Await transition" (2 ms),stage="Await exchange" (66 ms),stage="Total time" (327 ms)] [21:04:53] : [Step 4/5] [2021-11-19 21:04:53,585][INFO ][test-runner-#9268%encryption.EncryptedCacheNodeJoinTest%][root] Node started with the following configuration [id=10241b20-c4cf-432c-a7cb-5d127f447001, marshaller=BinaryMarshaller [], discovery=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=5000, ackTimeout=5000, marsh=JdkMarshaller [clsFilter=org.apache.ignite.marshaller.MarshallerUtils$1@3bc8a8b0], reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], binaryCfg=null, lateAff=true] [21:04:53]W: [org.apache.ignite:ignite-core] [2021-11-19 21:04:53,609][WARN ][test-runner-#9268%encryption.EncryptedCacheNodeJoinTest%][G] Ignite work directory is not provided, automatically resolved to: /opt/buildagent/work/7bc1c54bc719b67c/work [21:04:53] : [Step 4/5] [2021-11-19 21:04:53,610][INFO ][test-runner-#9268%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%client] [21:04:53] : [Step 4/5] [21:04:53] : [Step 4/5] >>> __________ ________________ [21:04:53] : [Step 4/5] >>> / _/ ___/ |/ / _/_ __/ __/ [21:04:53] : [Step 4/5] >>> _/ // (7 7 // / / / / _/ [21:04:53] : [Step 4/5] >>> /___/\___/_/|_/___/ /_/ /___/ [21:04:53] : [Step 4/5] >>> [21:04:53] : [Step 4/5] >>> ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:04:53] : [Step 4/5] >>> 2021 Copyright(C) Apache Software Foundation [21:04:53] : [Step 4/5] >>> [21:04:53] : [Step 4/5] >>> Ignite documentation: http://ignite.apache.org [21:04:53] : [Step 4/5] [21:04:53] : [Step 4/5] [2021-11-19 21:04:53,612][INFO ][test-runner-#9268%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%client] Config URL: n/a [21:04:53] : [Step 4/5] [2021-11-19 21:04:53,613][INFO ][test-runner-#9268%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%client] IgniteConfiguration [igniteInstanceName=client, pubPoolSize=24, svcPoolSize=24, callbackPoolSize=24, stripedPoolSize=24, sysPoolSize=24, mgmtPoolSize=4, dataStreamerPoolSize=24, utilityCachePoolSize=24, utilityCacheKeepAliveTime=60000, p2pPoolSize=2, qryPoolSize=24, buildIdxPoolSize=4, igniteHome=/opt/buildagent/work/7bc1c54bc719b67c, igniteWorkDir=/opt/buildagent/work/7bc1c54bc719b67c/work, mbeanSrv=com.sun.jmx.mbeanserver.JmxMBeanServer@6fe85038, nodeId=591e3c31-10e8-4826-9caa-6725016d3f7e, marsh=BinaryMarshaller [], marshLocJobs=false, daemon=false, p2pEnabled=true, netTimeout=10000, netCompressionLevel=1, sndRetryDelay=1000, sndRetryCnt=3, metricsHistSize=10000, metricsUpdateFreq=1000, metricsExpTime=9223372036854775807, discoSpi=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=0, ackTimeout=0, marsh=null, reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], segPlc=STOP, segResolveAttempts=2, waitForSegOnStart=true, allResolversPassReq=true, segChkFreq=10000, commSpi=TcpCommunicationSpi [connectGate=org.apache.ignite.spi.communication.tcp.internal.ConnectGateway@6156055b, ctxInitLatch=java.util.concurrent.CountDownLatch@41e9d0c4[Count = 1], stopping=false, clientPool=null, nioSrvWrapper=null, stateProvider=null], evtSpi=MemoryEventStorageSpi [expireAgeMs=9223372036854775807, expireCnt=10000, filter=null], colSpi=NoopCollisionSpi [], deploySpi=LocalDeploymentSpi [], indexingSpi=org.apache.ignite.spi.indexing.noop.NoopIndexingSpi@5f5ee749, addrRslvr=null, encryptionSpi=org.apache.ignite.spi.encryption.noop.NoopEncryptionSpi@403f91f7, tracingSpi=org.apache.ignite.spi.tracing.NoopTracingSpi@5f2db70d, clientMode=true, rebalanceThreadPoolSize=4, rebalanceTimeout=10000, rebalanceBatchesPrefetchCnt=3, rebalanceThrottle=0, rebalanceBatchSize=524288, txCfg=TransactionConfiguration [txSerEnabled=false, dfltIsolation=REPEATABLE_READ, dfltConcurrency=PESSIMISTIC, dfltTxTimeout=0, txTimeoutOnPartitionMapExchange=0, deadlockTimeout=10000, pessimisticTxLogSize=0, pessimisticTxLogLinger=10000, tmLookupClsName=null, txManagerFactory=null, useJtaSync=false], cacheSanityCheckEnabled=true, discoStartupDelay=60000, deployMode=SHARED, p2pMissedCacheSize=100, locHost=127.0.0.1, timeSrvPortBase=31100, timeSrvPortRange=100, failureDetectionTimeout=10000, sysWorkerBlockedTimeout=null, clientFailureDetectionTimeout=10000, metricsLogFreq=0, connectorCfg=null, odbcCfg=null, warmupClos=null, atomicCfg=AtomicConfiguration [seqReserveSize=1000, cacheMode=PARTITIONED, backups=1, aff=null, grpName=null], classLdr=null, sslCtxFactory=null, platformCfg=null, binaryCfg=null, memCfg=null, pstCfg=null, dsCfg=DataStorageConfiguration [sysRegionInitSize=41943040, sysRegionMaxSize=104857600, pageSize=4096, concLvl=0, dfltDataRegConf=DataRegionConfiguration [name=default, maxSize=10485760, initSize=268435456, swapPath=null, pageEvictionMode=DISABLED, pageReplacementMode=CLOCK, evictionThreshold=0.9, emptyPagesPoolSize=100, metricsEnabled=false, metricsSubIntervalCount=5, metricsRateTimeInterval=60000, persistenceEnabled=true, checkpointPageBufSize=0, lazyMemoryAllocation=true, warmUpCfg=null], dataRegions=null, storagePath=null, checkpointFreq=180000, lockWaitTime=10000, checkpointThreads=4, checkpointWriteOrder=SEQUENTIAL, walHistSize=20, maxWalArchiveSize=1073741824, walSegments=10, walSegmentSize=67108864, walPath=db/wal, walArchivePath=db/wal/archive, cdcWalPath=db/wal/cdc, cdcEnabled=false, metricsEnabled=false, walMode=FSYNC, walTlbSize=131072, walBuffSize=0, walFlushFreq=2000, walFsyncDelay=1000, walRecordIterBuffSize=67108864, alwaysWriteFullPages=false, fileIOFactory=org.apache.ignite.internal.processors.cache.persistence.file.AsyncFileIOFactory@67d12d33, metricsSubIntervalCnt=5, metricsRateTimeInterval=60000, walAutoArchiveAfterInactivity=-1, walForceArchiveTimeout=-1, writeThrottlingEnabled=false, walCompactionEnabled=false, walCompactionLevel=1, checkpointReadLockTimeout=null, walPageCompression=DISABLED, walPageCompressionLevel=null, dfltWarmUpCfg=null, encCfg=org.apache.ignite.configuration.EncryptionConfiguration@1c74b4dd, defragmentationThreadPoolSize=4, minWalArchiveSize=-1], snapshotPath=snapshots, activeOnStart=true, activeOnStartPropSetFlag=false, autoActivation=true, autoActivationPropSetFlag=false, clusterStateOnStart=null, sqlConnCfg=null, cliConnCfg=ClientConnectorConfiguration [host=null, port=10800, portRange=100, sockSndBufSize=0, sockRcvBufSize=0, tcpNoDelay=true, maxOpenCursorsPerConn=128, threadPoolSize=24, selectorCnt=12, idleTimeout=0, handshakeTimeout=10000, jdbcEnabled=true, odbcEnabled=true, thinCliEnabled=true, sslEnabled=false, useIgniteSslCtxFactory=true, sslClientAuth=false, sslCtxFactory=null, thinCliCfg=ThinClientConfiguration [maxActiveTxPerConn=100, maxActiveComputeTasksPerConn=0]], mvccVacuumThreadCnt=2, mvccVacuumFreq=5000, authEnabled=false, failureHnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]], commFailureRslvr=null, sqlCfg=SqlConfiguration [longQryWarnTimeout=3000, dfltQryTimeout=0, sqlQryHistSize=1000, validationEnabled=false], asyncContinuationExecutor=null] [21:04:53] : [Step 4/5] [2021-11-19 21:04:53,637][INFO ][test-runner-#9268%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%client] Daemon mode: off [21:04:53] : [Step 4/5] [2021-11-19 21:04:53,637][INFO ][test-runner-#9268%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%client] OS: Linux 4.15.0-151-generic amd64 [21:04:53] : [Step 4/5] [2021-11-19 21:04:53,638][INFO ][test-runner-#9268%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%client] OS user: teamcity [21:04:53] : [Step 4/5] [2021-11-19 21:04:53,638][INFO ][test-runner-#9268%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%client] PID: 16724 [21:04:53] : [Step 4/5] [2021-11-19 21:04:53,639][INFO ][test-runner-#9268%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%client] Language runtime: Java Platform API Specification ver. 1.8 [21:04:53] : [Step 4/5] [2021-11-19 21:04:53,639][INFO ][test-runner-#9268%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%client] VM information: Java(TM) SE Runtime Environment 1.8.0_261-b12 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 25.261-b12 [21:04:53] : [Step 4/5] [2021-11-19 21:04:53,639][INFO ][test-runner-#9268%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%client] VM total memory: 1.9GB [21:04:53] : [Step 4/5] [2021-11-19 21:04:53,640][INFO ][test-runner-#9268%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%client] Remote Management [restart: off, REST: off, JMX (remote: off)] [21:04:53] : [Step 4/5] [2021-11-19 21:04:53,642][INFO ][test-runner-#9268%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%client] Logger: GridTestLog4jLogger [quiet=false, config=null] [21:04:53] : [Step 4/5] [2021-11-19 21:04:53,642][INFO ][test-runner-#9268%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%client] IGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c [21:04:53] : [Step 4/5] [2021-11-19 21:04:53,642][INFO ][test-runner-#9268%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%client] VM arguments: [-DIGNITE_DUMP_THREADS_ON_FAILURE=false, -DMono=/usr/bin/mono-sgen, -DMono4.0_x64=/usr/lib/mono/4.0, -DMono4.5_x64=/usr/lib/mono/4.5, -DMonoVersion=6.12.0.90, -DSKIP_BUILD=false, -Dagent.home.dir=/opt/buildagent, -Dagent.name=aitc-lin02_03, -Dagent.ownPort=9090, -Dagent.work.dir=/opt/buildagent/work, -Dbuild.number=95, -Dbuild.vcs.number=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.1=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.GitHubApacheIgnite=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dclassworlds.conf=/opt/buildagent/temp/buildTmp/teamcity.m2.conf, -Dcom.jetbrains.maven.watcher.report.file=/opt/buildagent/temp/buildTmp/maven-build-info.xml, -Djava.io.tmpdir=/opt/buildagent/temp/buildTmp, -Dmaven.home=/opt/buildagent/tools/maven3_6, -Dmaven.multiModuleProjectDirectory=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.agent.cpuBenchmark=457, -Dteamcity.agent.dotnet.agent_url=http://localhost:9090/RPC2, -Dteamcity.agent.dotnet.build_id=6278078, -Dteamcity.auth.password=*******, -Dteamcity.auth.userId=TeamCityBuildId=6278078, -Dteamcity.build.changedFiles.file=/opt/buildagent/temp/buildTmp/changedFiles6342607772318147725.txt, -Dteamcity.build.checkoutDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.build.id=6278078, -Dteamcity.build.properties.file=/opt/buildagent/temp/buildTmp/teamcity.build5164517880467851002.properties, -Dteamcity.build.tempDir=/opt/buildagent/temp/buildTmp, -Dteamcity.build.workingDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.buildConfName=Basic 3, -Dteamcity.buildType.id=IgniteTests24Java8_Basic3, -Dteamcity.configuration.properties.file=/opt/buildagent/temp/buildTmp/teamcity.config5591980786735343870.properties, -Dteamcity.maven.userSettings.path=/opt/buildagent/temp/buildTmp/maven_settings_585072866407032347.xml, -Dteamcity.maven.watcher.home=/opt/buildagent/plugins/mavenPlugin/maven-watcher-jdk16, -Dteamcity.projectName=Ignite Tests 2.x (JDK 8/11), -Dteamcity.runner.properties.file=/opt/buildagent/temp/buildTmp/teamcity.runner9098465561618137420.properties, -Dteamcity.tests.recentlyFailedTests.file=/opt/buildagent/temp/buildTmp/testsToRunFirst3891775683130404069.txt, -Dteamcity.version=2021.2 (build 99542), -ea, -Xms2g, -Xmx2g, -XX:+HeapDumpOnOutOfMemoryError, -DIGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_TEST_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_UPDATE_NOTIFIER=false, -DIGNITE_NO_DISCO_ORDER=true, -DIGNITE_PERFORMANCE_SUGGESTIONS_DISABLED=true, -Djava.net.preferIPv4Stack=true, -DTEST_SCALE_FACTOR=1.0, -DIGNITE_TEST_PROP_LOG4J_FILE=log4j-tc-test.xml, -DIGNITE_QUIET=false, -DIGNITE_MARSHAL_BUFFERS_RECHECK=1000, -Dmaven.repo.local=/opt/buildagent/.m2/repository] [21:04:53] : [Step 4/5] [2021-11-19 21:04:53,648][INFO ][test-runner-#9268%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%client] System cache's DataRegion size is configured to 40 MB. Use DataStorageConfiguration.systemRegionInitialSize property to change the setting. [21:04:53] : [Step 4/5] [2021-11-19 21:04:53,649][INFO ][test-runner-#9268%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%client] Configured caches [in 'sysMemPlc' dataRegion: ['ignite-sys-cache'], in 'default' dataRegion: ['encrypted']] [21:04:53]W: [org.apache.ignite:ignite-core] [2021-11-19 21:04:53,650][WARN ][test-runner-#9268%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%client] Peer class loading is enabled (disable it in production for performance and deployment consistency reasons) [21:04:53] : [Step 4/5] [2021-11-19 21:04:53,650][INFO ][test-runner-#9268%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%client] 3-rd party licenses can be found at: /opt/buildagent/work/7bc1c54bc719b67c/libs/licenses [21:04:53] : [Step 4/5] [2021-11-19 21:04:53,658][INFO ][test-runner-#9268%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] Configured plugins: [21:04:53] : [Step 4/5] [2021-11-19 21:04:53,658][INFO ][test-runner-#9268%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- StanByClusterTestProvider 1.0 [21:04:53] : [Step 4/5] [2021-11-19 21:04:53,658][INFO ][test-runner-#9268%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- null [21:04:53] : [Step 4/5] [2021-11-19 21:04:53,659][INFO ][test-runner-#9268%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] [21:04:53] : [Step 4/5] [2021-11-19 21:04:53,659][INFO ][test-runner-#9268%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- PageMemory tracker plugin 1.0 [21:04:53] : [Step 4/5] [2021-11-19 21:04:53,659][INFO ][test-runner-#9268%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- null [21:04:53] : [Step 4/5] [2021-11-19 21:04:53,659][INFO ][test-runner-#9268%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] [21:04:53] : [Step 4/5] [2021-11-19 21:04:53,660][INFO ][test-runner-#9268%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- TestDistibutedConfigurationPlugin 1.0 [21:04:53] : [Step 4/5] [2021-11-19 21:04:53,660][INFO ][test-runner-#9268%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- null [21:04:53] : [Step 4/5] [2021-11-19 21:04:53,660][INFO ][test-runner-#9268%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] [21:04:53] : [Step 4/5] [2021-11-19 21:04:53,661][INFO ][test-runner-#9268%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- NodeValidationPluginProvider 1.0 [21:04:53] : [Step 4/5] [2021-11-19 21:04:53,661][INFO ][test-runner-#9268%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- null [21:04:53] : [Step 4/5] [2021-11-19 21:04:53,661][INFO ][test-runner-#9268%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] [21:04:53] : [Step 4/5] [2021-11-19 21:04:53,662][INFO ][test-runner-#9268%encryption.EncryptedCacheNodeJoinTest%][FailureProcessor] Configured failure handler: [hnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]]] [21:04:53] : [Step 4/5] [2021-11-19 21:04:53,725][INFO ][test-runner-#9268%encryption.EncryptedCacheNodeJoinTest%][TcpCommunicationSpi] Successfully bound communication NIO server to TCP port [port=45153, locHost=/127.0.0.1, selectorsCnt=12, selectorSpins=0, pairedConn=false] [21:04:53]W: [org.apache.ignite:ignite-core] [2021-11-19 21:04:53,725][WARN ][test-runner-#9268%encryption.EncryptedCacheNodeJoinTest%][TcpCommunicationSpi] Message queue limit is set to 0 which may lead to potential OOMEs when running cache operations in FULL_ASYNC or PRIMARY_SYNC modes due to message queues growth on sender and receiver sides. [21:04:53] : [Step 4/5] [2021-11-19 21:04:53,754][INFO ][test-runner-#9268%encryption.EncryptedCacheNodeJoinTest%][GridCollisionManager] Collision resolution is disabled (all jobs will be activated upon arrival). [21:04:53] : [Step 4/5] [2021-11-19 21:04:53,755][INFO ][test-runner-#9268%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%client] Security status [authentication=off, sandbox=off, tls/ssl=off] [21:04:53]W: [org.apache.ignite:ignite-core] [2021-11-19 21:04:53,761][WARN ][test-runner-#9268%encryption.EncryptedCacheNodeJoinTest%][GridCacheProcessor] Persistent Store is not supported on client nodes (Persistent Store's configuration will be ignored). [21:04:53] : [Step 4/5] [2021-11-19 21:04:53,770][INFO ][test-runner-#9268%encryption.EncryptedCacheNodeJoinTest%][IgniteCacheDatabaseSharedManager] Configured data regions initialized successfully [total=4] [21:04:53] : [Step 4/5] [2021-11-19 21:04:53,791][INFO ][test-runner-#9268%encryption.EncryptedCacheNodeJoinTest%][ClientListenerProcessor] Client connector processor has started on TCP port 10803 [21:04:53] : [Step 4/5] [2021-11-19 21:04:53,801][INFO ][test-runner-#9268%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%client] Non-loopback local IPs: 172.17.0.4 [21:04:53] : [Step 4/5] [2021-11-19 21:04:53,801][INFO ][test-runner-#9268%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%client] Enabled local MACs: 0242AC110004 [21:04:53] : [Step 4/5] [2021-11-19 21:04:53,802][INFO ][test-runner-#9268%encryption.EncryptedCacheNodeJoinTest%][ClusterProcessor] Cluster ID and tag has been read from metastorage: null [21:04:53] : [Step 4/5] [2021-11-19 21:04:53,802][INFO ][test-runner-#9268%encryption.EncryptedCacheNodeJoinTest%][IgniteClusterImpl] Shutdown policy was updated [oldVal=null, newVal=null] [21:04:53] : [Step 4/5] [2021-11-19 21:04:53,810][INFO ][tcp-disco-srvr-[:47501]-#483%grid-6%-#9499%grid-6%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=34395] [21:04:53] : [Step 4/5] [2021-11-19 21:04:53,810][INFO ][tcp-disco-srvr-[:47501]-#483%grid-6%-#9499%grid-6%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=34395] [21:04:53] : [Step 4/5] [2021-11-19 21:04:53,811][INFO ][tcp-disco-sock-reader-[]-#501%grid-6%-#9692%grid-6%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:34395, rmtPort=34395] [21:04:53] : [Step 4/5] [2021-11-19 21:04:53,812][INFO ][tcp-disco-sock-reader-[591e3c31 127.0.0.1:34395 client]-#501%grid-6%-#9692%grid-6%][TestTcpDiscoverySpi] Initialized connection with remote client node [nodeId=591e3c31-10e8-4826-9caa-6725016d3f7e, rmtAddr=/127.0.0.1:34395] [21:04:53] : [Step 4/5] [2021-11-19 21:04:53,853][INFO ][tcp-disco-srvr-[:47501]-#483%grid-6%-#9499%grid-6%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=57421] [21:04:53] : [Step 4/5] [2021-11-19 21:04:53,854][INFO ][tcp-disco-srvr-[:47501]-#483%grid-6%-#9499%grid-6%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=57421] [21:04:53] : [Step 4/5] [2021-11-19 21:04:53,855][INFO ][tcp-disco-sock-reader-[]-#503%grid-6%-#9695%grid-6%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:57421, rmtPort=57421] [21:04:53] : [Step 4/5] [2021-11-19 21:04:53,856][INFO ][tcp-disco-sock-reader-[]-#503%grid-6%-#9695%grid-6%][TestTcpDiscoverySpi] Received ping request from the remote node [rmtNodeId=0045258f-23c5-47bd-8d53-d47031e11000, rmtAddr=/127.0.0.1:57421, rmtPort=57421] [21:04:53] : [Step 4/5] [2021-11-19 21:04:53,863][INFO ][tcp-disco-sock-reader-[]-#503%grid-6%-#9695%grid-6%][TestTcpDiscoverySpi] Finished writing ping response [rmtNodeId=0045258f-23c5-47bd-8d53-d47031e11000, rmtAddr=/127.0.0.1:57421, rmtPort=57421] [21:04:53]W: [org.apache.ignite:ignite-core] [2021-11-19 21:04:53,863][WARN ][disco-pool-#9694%grid-0%][TestTcpDiscoverySpi] Joining node has encrypted caches which are not presented on the cluster, encrypted caches configured on client node cannot be started when such node joins the cluster, these caches can be started manually (dynamically) after node joined[caches=encrypted] [21:04:53] : [Step 4/5] [2021-11-19 21:04:53,863][INFO ][tcp-disco-sock-reader-[]-#503%grid-6%-#9695%grid-6%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:57421, rmtPort=57421, rmtNodeId=null] [21:04:53] : [Step 4/5] [2021-11-19 21:04:53,865][INFO ][tcp-disco-srvr-[:47501]-#483%grid-6%-#9499%grid-6%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=41249] [21:04:53] : [Step 4/5] [2021-11-19 21:04:53,865][INFO ][tcp-disco-srvr-[:47501]-#483%grid-6%-#9499%grid-6%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=41249] [21:04:53] : [Step 4/5] [2021-11-19 21:04:53,866][INFO ][tcp-disco-sock-reader-[]-#504%grid-6%-#9696%grid-6%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:41249, rmtPort=41249] [21:04:53] : [Step 4/5] [2021-11-19 21:04:53,869][INFO ][tcp-disco-sock-reader-[0045258f 127.0.0.1:41249]-#504%grid-6%-#9696%grid-6%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=0045258f-23c5-47bd-8d53-d47031e11000, rmtAddr=/127.0.0.1:41249] [21:04:53] : [Step 4/5] [2021-11-19 21:04:53,872][INFO ][tcp-disco-sock-reader-[0045258f 127.0.0.1:41249]-#504%grid-6%-#9696%grid-6%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:41249, rmtPort=41249, rmtNodeId=0045258f-23c5-47bd-8d53-d47031e11000] [21:04:53]W: [org.apache.ignite:ignite-core] [2021-11-19 21:04:53,876][ERROR][test-runner-#9268%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%client] Failed to start manager: GridManagerAdapter [enabled=true, name=o.a.i.i.managers.discovery.GridDiscoveryManager] [21:04:53]W: [org.apache.ignite:ignite-core] class org.apache.ignite.IgniteCheckedException: Failed to start SPI: TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=5000, ackTimeout=5000, marsh=JdkMarshaller [clsFilter=org.apache.ignite.marshaller.MarshallerUtils$1@760344d3], reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false] [21:04:53]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.managers.GridManagerAdapter.startSpi(GridManagerAdapter.java:281) [21:04:53]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.managers.discovery.GridDiscoveryManager.start(GridDiscoveryManager.java:1091) [21:04:53]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.IgniteKernal.startManager(IgniteKernal.java:1953) [21:04:53]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.IgniteKernal.start(IgniteKernal.java:1300) [21:04:53]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.IgnitionEx$IgniteNamedInstance.start0(IgnitionEx.java:1798) [21:04:53]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.IgnitionEx$IgniteNamedInstance.start(IgnitionEx.java:1720) [21:04:53]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.IgnitionEx.start0(IgnitionEx.java:1159) [21:04:53]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.IgnitionEx.start(IgnitionEx.java:629) [21:04:53]W: [org.apache.ignite:ignite-core] at org.apache.ignite.testframework.junits.GridAbstractTest.startGrid(GridAbstractTest.java:1252) [21:04:53]W: [org.apache.ignite:ignite-core] at org.apache.ignite.testframework.junits.GridAbstractTest.startGrid(GridAbstractTest.java:1169) [21:04:53]W: [org.apache.ignite:ignite-core] at org.apache.ignite.testframework.junits.GridAbstractTest.startClientGrid(GridAbstractTest.java:1107) [21:04:53]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.encryption.EncryptedCacheNodeJoinTest.lambda$checkNodeJoinWithStaticCacheConfig$3(EncryptedCacheNodeJoinTest.java:290) [21:04:53]W: [org.apache.ignite:ignite-core] at org.apache.ignite.testframework.GridTestUtils.assertThrowsAnyCause(GridTestUtils.java:545) [21:04:53]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.encryption.EncryptedCacheNodeJoinTest.checkNodeJoinWithStaticCacheConfig(EncryptedCacheNodeJoinTest.java:290) [21:04:53]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.encryption.EncryptedCacheNodeJoinTest.testClientNodeJoinInactiveClusterWithNewStaticCacheConfig(EncryptedCacheNodeJoinTest.java:239) [21:04:53]W: [org.apache.ignite:ignite-core] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) [21:04:53]W: [org.apache.ignite:ignite-core] at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) [21:04:53]W: [org.apache.ignite:ignite-core] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [21:04:53]W: [org.apache.ignite:ignite-core] at java.lang.reflect.Method.invoke(Method.java:498) [21:04:53]W: [org.apache.ignite:ignite-core] at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50) [21:04:53]W: [org.apache.ignite:ignite-core] at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) [21:04:53]W: [org.apache.ignite:ignite-core] at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47) [21:04:53]W: [org.apache.ignite:ignite-core] at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) [21:04:53]W: [org.apache.ignite:ignite-core] at org.apache.ignite.testframework.junits.GridAbstractTest$7.run(GridAbstractTest.java:2432) [21:04:53]W: [org.apache.ignite:ignite-core] at java.lang.Thread.run(Thread.java:748) [21:04:53]W: [org.apache.ignite:ignite-core] Caused by: class org.apache.ignite.spi.IgniteSpiException: Joining node has encrypted caches which are not presented on the cluster, encrypted caches configured on client node cannot be started when such node joins the cluster, these caches can be started manually (dynamically) after node joined[caches=encrypted] [21:04:53]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.discovery.tcp.TcpDiscoverySpi.checkFailedError(TcpDiscoverySpi.java:2108) [21:04:53]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.discovery.tcp.ClientImpl$MessageWorker.body(ClientImpl.java:1996) [21:04:53]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:125) [21:04:53]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.discovery.tcp.ClientImpl$1.body(ClientImpl.java:317) [21:04:53]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.IgniteSpiThread.run(IgniteSpiThread.java:58) [21:04:53]W: [org.apache.ignite:ignite-core] [2021-11-19 21:04:53,884][ERROR][test-runner-#9268%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%client] Got exception while starting (will rollback startup routine). [21:04:53]W: [org.apache.ignite:ignite-core] class org.apache.ignite.IgniteCheckedException: Failed to start manager: GridManagerAdapter [enabled=true, name=org.apache.ignite.internal.managers.discovery.GridDiscoveryManager] [21:04:53]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.IgniteKernal.startManager(IgniteKernal.java:1958) [21:04:53]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.IgniteKernal.start(IgniteKernal.java:1300) [21:04:53]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.IgnitionEx$IgniteNamedInstance.start0(IgnitionEx.java:1798) [21:04:53]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.IgnitionEx$IgniteNamedInstance.start(IgnitionEx.java:1720) [21:04:53]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.IgnitionEx.start0(IgnitionEx.java:1159) [21:04:53]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.IgnitionEx.start(IgnitionEx.java:629) [21:04:53]W: [org.apache.ignite:ignite-core] at org.apache.ignite.testframework.junits.GridAbstractTest.startGrid(GridAbstractTest.java:1252) [21:04:53]W: [org.apache.ignite:ignite-core] at org.apache.ignite.testframework.junits.GridAbstractTest.startGrid(GridAbstractTest.java:1169) [21:04:53]W: [org.apache.ignite:ignite-core] at org.apache.ignite.testframework.junits.GridAbstractTest.startClientGrid(GridAbstractTest.java:1107) [21:04:53]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.encryption.EncryptedCacheNodeJoinTest.lambda$checkNodeJoinWithStaticCacheConfig$3(EncryptedCacheNodeJoinTest.java:290) [21:04:53]W: [org.apache.ignite:ignite-core] at org.apache.ignite.testframework.GridTestUtils.assertThrowsAnyCause(GridTestUtils.java:545) [21:04:53]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.encryption.EncryptedCacheNodeJoinTest.checkNodeJoinWithStaticCacheConfig(EncryptedCacheNodeJoinTest.java:290) [21:04:53]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.encryption.EncryptedCacheNodeJoinTest.testClientNodeJoinInactiveClusterWithNewStaticCacheConfig(EncryptedCacheNodeJoinTest.java:239) [21:04:53]W: [org.apache.ignite:ignite-core] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) [21:04:53]W: [org.apache.ignite:ignite-core] at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) [21:04:53]W: [org.apache.ignite:ignite-core] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [21:04:53]W: [org.apache.ignite:ignite-core] at java.lang.reflect.Method.invoke(Method.java:498) [21:04:53]W: [org.apache.ignite:ignite-core] at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50) [21:04:53]W: [org.apache.ignite:ignite-core] at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) [21:04:53]W: [org.apache.ignite:ignite-core] at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47) [21:04:53]W: [org.apache.ignite:ignite-core] at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) [21:04:53]W: [org.apache.ignite:ignite-core] at org.apache.ignite.testframework.junits.GridAbstractTest$7.run(GridAbstractTest.java:2432) [21:04:53]W: [org.apache.ignite:ignite-core] at java.lang.Thread.run(Thread.java:748) [21:04:53]W: [org.apache.ignite:ignite-core] Caused by: class org.apache.ignite.IgniteCheckedException: Failed to start SPI: TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=5000, ackTimeout=5000, marsh=JdkMarshaller [clsFilter=org.apache.ignite.marshaller.MarshallerUtils$1@760344d3], reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false] [21:04:53]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.managers.GridManagerAdapter.startSpi(GridManagerAdapter.java:281) [21:04:53]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.managers.discovery.GridDiscoveryManager.start(GridDiscoveryManager.java:1091) [21:04:53]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.IgniteKernal.startManager(IgniteKernal.java:1953) [21:04:53]W: [org.apache.ignite:ignite-core] ... 22 more [21:04:53]W: [org.apache.ignite:ignite-core] Caused by: class org.apache.ignite.spi.IgniteSpiException: Joining node has encrypted caches which are not presented on the cluster, encrypted caches configured on client node cannot be started when such node joins the cluster, these caches can be started manually (dynamically) after node joined[caches=encrypted] [21:04:53]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.discovery.tcp.TcpDiscoverySpi.checkFailedError(TcpDiscoverySpi.java:2108) [21:04:53]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.discovery.tcp.ClientImpl$MessageWorker.body(ClientImpl.java:1996) [21:04:53]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:125) [21:04:53]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.discovery.tcp.ClientImpl$1.body(ClientImpl.java:317) [21:04:53]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.IgniteSpiThread.run(IgniteSpiThread.java:58) [21:04:53]W: [org.apache.ignite:ignite-core] [2021-11-19 21:04:53,891][WARN ][tcp-disco-sock-reader-[591e3c31 127.0.0.1:34395 client]-#501%grid-6%-#9692%grid-6%][TestTcpDiscoverySpi] Failed to shutdown socket [21:04:53]W: [org.apache.ignite:ignite-core] java.net.SocketException: Socket input is already shutdown [21:04:53] : [Step 4/5] [2021-11-19 21:04:53,896][INFO ][tcp-disco-sock-reader-[591e3c31 127.0.0.1:34395 client]-#501%grid-6%-#9692%grid-6%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:34395, rmtPort=34395, rmtNodeId=591e3c31-10e8-4826-9caa-6725016d3f7e] [21:04:53]W: [org.apache.ignite:ignite-core] at java.net.Socket.shutdownInput(Socket.java:1542) [21:04:53]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.close(IgniteUtils.java:4248) [21:04:53]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.discovery.tcp.ServerImpl$SocketReader.body(ServerImpl.java:7370) [21:04:53]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.IgniteSpiThread.run(IgniteSpiThread.java:58) [21:04:53] : [Step 4/5] [2021-11-19 21:04:53,911][INFO ][test-runner-#9268%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%client] [21:04:53] : [Step 4/5] [21:04:53] : [Step 4/5] >>> +------------------------------------------------------+ [21:04:53] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV stopped OK [21:04:53] : [Step 4/5] >>> +------------------------------------------------------+ [21:04:53] : [Step 4/5] >>> Ignite instance name: client [21:04:53] : [Step 4/5] >>> Grid uptime: 00:00:00.304 [21:04:53] : [Step 4/5] [21:04:53] : [Step 4/5] [21:04:53] : [Step 4/5] [2021-11-19 21:04:53,912][INFO ][test-runner-#9268%encryption.EncryptedCacheNodeJoinTest%][root] Caught expected exception: Joining node has encrypted caches which are not presented on the cluster, encrypted caches configured on client node cannot be started when such node joins the cluster, these caches can be started manually (dynamically) after node joined[caches=encrypted] [21:04:53] : [Step 4/5] [21:04:53] >>> Stopping test: EncryptedCacheNodeJoinTest#testClientNodeJoinInactiveClusterWithNewStaticCacheConfig in 3282 ms <<< [21:04:53] : [Step 4/5] [2021-11-19 21:04:53,914][INFO ][main][root] >>> Stopping test: EncryptedCacheNodeJoinTest#testClientNodeJoinInactiveClusterWithNewStaticCacheConfig in 3282 ms <<< [21:04:53] : [Step 4/5] [21:04:53] >>> Heap: 575 MB used / 1912 MB commited / 1912 MB max <<< [21:04:53] : [Step 4/5] [2021-11-19 21:04:53,914][INFO ][main][root] >>> Heap: 575 MB used / 1912 MB commited / 1912 MB max <<< [21:04:53] : [Step 4/5] [21:04:53] >>> Non-Heap: 140 MB used / 155 MB commited / 0 MB max <<< [21:04:53] : [Step 4/5] [2021-11-19 21:04:53,915][INFO ][main][root] >>> Non-Heap: 140 MB used / 155 MB commited / 0 MB max <<< [21:04:53] : [Step 4/5] [2021-11-19 21:04:53,915][INFO ][main][root] >>> Stopping grid [name=client1, id=10241b20-c4cf-432c-a7cb-5d127f447001] [21:04:53] : [Step 4/5] [2021-11-19 21:04:53,926][INFO ][disco-event-worker-#9383%grid-0%][GridDiscoveryManager] Node left topology: TcpDiscoveryNode [id=10241b20-c4cf-432c-a7cb-5d127f447001, consistentId=client1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:0], discPort=0, order=3, intOrder=3, lastExchangeTime=1637345093448, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=true] [21:04:53] : [Step 4/5] [2021-11-19 21:04:53,929][INFO ][disco-event-worker-#9505%grid-6%][GridDiscoveryManager] Node left topology: TcpDiscoveryNode [id=10241b20-c4cf-432c-a7cb-5d127f447001, consistentId=client1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:0], discPort=0, order=3, intOrder=3, lastExchangeTime=1637345093458, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=true] [21:04:53] : [Step 4/5] [2021-11-19 21:04:53,929][INFO ][tcp-disco-sock-reader-[10241b20 127.0.0.1:58997 client]-#494%grid-0%-#9597%grid-0%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:58997, rmtPort=58997, rmtNodeId=10241b20-c4cf-432c-a7cb-5d127f447001] [21:04:53] : [Step 4/5] [2021-11-19 21:04:53,932][INFO ][disco-event-worker-#9505%grid-6%][GridDiscoveryManager] Topology snapshot [ver=4, locNode=603e647b, servers=2, clients=0, state=INACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=0045258f-23c5-47bd-8d53-d47031e11000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=603e647b-590d-4fc1-ab37-4d1d82d4f006, consistentId=grid-6, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:04:53] : [Step 4/5] [2021-11-19 21:04:53,931][INFO ][disco-event-worker-#9383%grid-0%][GridDiscoveryManager] Topology snapshot [ver=4, locNode=0045258f, servers=2, clients=0, state=INACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=0045258f-23c5-47bd-8d53-d47031e11000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=603e647b-590d-4fc1-ab37-4d1d82d4f006, consistentId=grid-6, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:04:53] : [Step 4/5] [2021-11-19 21:04:53,957][INFO ][main][IgniteKernal%client1] [21:04:53] : [Step 4/5] [21:04:53] : [Step 4/5] >>> +------------------------------------------------------+ [21:04:53] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV stopped OK [21:04:53] : [Step 4/5] >>> +------------------------------------------------------+ [21:04:53] : [Step 4/5] >>> Ignite instance name: client1 [21:04:53] : [Step 4/5] >>> Grid uptime: 00:00:00.378 [21:04:53] : [Step 4/5] [21:04:53] : [Step 4/5] [21:04:53] : [Step 4/5] [2021-11-19 21:04:53,958][INFO ][main][root] >>> Stopping grid [name=grid-0, id=0045258f-23c5-47bd-8d53-d47031e11000] [21:04:53] : [Step 4/5] [2021-11-19 21:04:53,968][INFO ][tcp-disco-sock-reader-[603e647b 127.0.0.1:35083]-#487%grid-0%-#9503%grid-0%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:35083, rmtPort=35083, rmtNodeId=603e647b-590d-4fc1-ab37-4d1d82d4f006] [21:04:53] : [Step 4/5] [2021-11-19 21:04:53,970][INFO ][disco-event-worker-#9505%grid-6%][GridDiscoveryManager] Node left topology: TcpDiscoveryNode [id=0045258f-23c5-47bd-8d53-d47031e11000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345093182, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false] [21:04:53] : [Step 4/5] [2021-11-19 21:04:53,971][INFO ][main][GridCacheProcessor] Stopped cache [cacheName=ignite-sys-cache] [21:04:53] : [Step 4/5] [2021-11-19 21:04:53,973][INFO ][disco-event-worker-#9505%grid-6%][GridDiscoveryManager] Topology snapshot [ver=5, locNode=603e647b, servers=1, clients=0, state=INACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=603e647b-590d-4fc1-ab37-4d1d82d4f006, consistentId=grid-6, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:04:53] : [Step 4/5] [2021-11-19 21:04:53,975][INFO ][disco-event-worker-#9505%grid-6%][GridDiscoveryManager] Coordinator changed [prev=TcpDiscoveryNode [id=0045258f-23c5-47bd-8d53-d47031e11000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345093182, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], cur=TcpDiscoveryNode [id=603e647b-590d-4fc1-ab37-4d1d82d4f006, consistentId=grid-6, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637345093960, loc=true, ver=2.13.0#20211119-sha1:00000000, isClient=false]] [21:04:53] : [Step 4/5] [2021-11-19 21:04:53,976][INFO ][disco-event-worker-#9505%grid-6%][MvccProcessorImpl] Assigned mvcc coordinator [crd=MvccCoordinator [topVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], nodeId=603e647b-590d-4fc1-ab37-4d1d82d4f006, ver=1637345091813, local=true, initialized=false]] [21:04:53] : [Step 4/5] [2021-11-19 21:04:53,977][INFO ][main][FilePageStoreManager] Cleanup cache stores [total=3, left=0, cleanFiles=false] [21:04:53] : [Step 4/5] [2021-11-19 21:04:53,979][INFO ][sys-#9480%grid-6%][ExchangeLatchManager] Become new coordinator 603e647b-590d-4fc1-ab37-4d1d82d4f006 [21:04:54] : [Step 4/5] [2021-11-19 21:04:54,000][INFO ][main][IgniteKernal%grid-0] [21:04:54] : [Step 4/5] [21:04:54] : [Step 4/5] >>> +------------------------------------------------------+ [21:04:54] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV stopped OK [21:04:54] : [Step 4/5] >>> +------------------------------------------------------+ [21:04:54] : [Step 4/5] >>> Ignite instance name: grid-0 [21:04:54] : [Step 4/5] >>> Grid uptime: 00:00:02.129 [21:04:54] : [Step 4/5] [21:04:54] : [Step 4/5] [21:04:54] : [Step 4/5] [2021-11-19 21:04:54,001][INFO ][main][root] >>> Stopping grid [name=grid-6, id=603e647b-590d-4fc1-ab37-4d1d82d4f006] [21:04:54]W: [org.apache.ignite:ignite-core] [2021-11-19 21:04:54,009][WARN ][tcp-disco-sock-reader-[0045258f 127.0.0.1:58875]-#486%grid-6%-#9502%grid-6%][TestTcpDiscoverySpi] Failed to shutdown socket [21:04:54]W: [org.apache.ignite:ignite-core] java.net.SocketException: Socket is closed [21:04:54]W: [org.apache.ignite:ignite-core] at java.net.Socket.shutdownOutput(Socket.java:1568) [21:04:54]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.close(IgniteUtils.java:4247) [21:04:54]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.discovery.tcp.ServerImpl$SocketReader.body(ServerImpl.java:7370) [21:04:54]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.IgniteSpiThread.run(IgniteSpiThread.java:58) [21:04:54] : [Step 4/5] [2021-11-19 21:04:54,010][INFO ][tcp-disco-sock-reader-[0045258f 127.0.0.1:58875]-#486%grid-6%-#9502%grid-6%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:58875, rmtPort=58875, rmtNodeId=0045258f-23c5-47bd-8d53-d47031e11000] [21:04:54] : [Step 4/5] [2021-11-19 21:04:54,012][INFO ][main][GridCacheProcessor] Stopped cache [cacheName=ignite-sys-cache] [21:04:54] : [Step 4/5] [2021-11-19 21:04:54,020][INFO ][main][FilePageStoreManager] Cleanup cache stores [total=3, left=0, cleanFiles=false] [21:04:54] : [Step 4/5] [2021-11-19 21:04:54,030][INFO ][main][IgniteKernal%grid-6] [21:04:54] : [Step 4/5] [21:04:54] : [Step 4/5] >>> +------------------------------------------------------+ [21:04:54] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV stopped OK [21:04:54] : [Step 4/5] >>> +------------------------------------------------------+ [21:04:54] : [Step 4/5] >>> Ignite instance name: grid-6 [21:04:54] : [Step 4/5] >>> Grid uptime: 00:00:00.786 [21:04:54] : [Step 4/5] [21:04:54] : [Step 4/5] [21:04:54] : [Step 4/5] [21:04:54] >>> Starting test: EncryptedCacheNodeJoinTest#testClientNodeJoin <<< [21:04:54] : [Step 4/5] [2021-11-19 21:04:54,087][INFO ][main][root] >>> Starting test: EncryptedCacheNodeJoinTest#testClientNodeJoin <<< [21:04:54] : [Step 4/5] [21:04:54] >>> Heap: 579 MB used / 1912 MB commited / 1912 MB max <<< [21:04:54] : [Step 4/5] [2021-11-19 21:04:54,087][INFO ][main][root] >>> Heap: 579 MB used / 1912 MB commited / 1912 MB max <<< [21:04:54] : [Step 4/5] [21:04:54] >>> Non-Heap: 140 MB used / 155 MB commited / 0 MB max <<< [21:04:54] : [Step 4/5] [2021-11-19 21:04:54,088][INFO ][main][root] >>> Non-Heap: 140 MB used / 155 MB commited / 0 MB max <<< [21:04:54]W: [org.apache.ignite:ignite-core] [2021-11-19 21:04:54,093][WARN ][test-runner-#9703%encryption.EncryptedCacheNodeJoinTest%][G] Ignite work directory is not provided, automatically resolved to: /opt/buildagent/work/7bc1c54bc719b67c/work [21:04:54] : [Step 4/5] [2021-11-19 21:04:54,095][INFO ][test-runner-#9703%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] [21:04:54] : [Step 4/5] [21:04:54] : [Step 4/5] >>> __________ ________________ [21:04:54] : [Step 4/5] >>> / _/ ___/ |/ / _/_ __/ __/ [21:04:54] : [Step 4/5] >>> _/ // (7 7 // / / / / _/ [21:04:54] : [Step 4/5] >>> /___/\___/_/|_/___/ /_/ /___/ [21:04:54] : [Step 4/5] >>> [21:04:54] : [Step 4/5] >>> ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:04:54] : [Step 4/5] >>> 2021 Copyright(C) Apache Software Foundation [21:04:54] : [Step 4/5] >>> [21:04:54] : [Step 4/5] >>> Ignite documentation: http://ignite.apache.org [21:04:54] : [Step 4/5] [21:04:54] : [Step 4/5] [2021-11-19 21:04:54,096][INFO ][test-runner-#9703%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] Config URL: n/a [21:04:54] : [Step 4/5] [2021-11-19 21:04:54,097][INFO ][test-runner-#9703%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] IgniteConfiguration [igniteInstanceName=grid-0, pubPoolSize=24, svcPoolSize=24, callbackPoolSize=24, stripedPoolSize=24, sysPoolSize=24, mgmtPoolSize=4, dataStreamerPoolSize=24, utilityCachePoolSize=24, utilityCacheKeepAliveTime=60000, p2pPoolSize=2, qryPoolSize=24, buildIdxPoolSize=4, igniteHome=/opt/buildagent/work/7bc1c54bc719b67c, igniteWorkDir=/opt/buildagent/work/7bc1c54bc719b67c/work, mbeanSrv=com.sun.jmx.mbeanserver.JmxMBeanServer@6fe85038, nodeId=00e326d4-0c21-42d9-93eb-188856bb0000, marsh=BinaryMarshaller [], marshLocJobs=false, daemon=false, p2pEnabled=true, netTimeout=10000, netCompressionLevel=1, sndRetryDelay=1000, sndRetryCnt=3, metricsHistSize=10000, metricsUpdateFreq=1000, metricsExpTime=9223372036854775807, discoSpi=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=0, ackTimeout=0, marsh=null, reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], segPlc=STOP, segResolveAttempts=2, waitForSegOnStart=true, allResolversPassReq=true, segChkFreq=10000, commSpi=TcpCommunicationSpi [connectGate=org.apache.ignite.spi.communication.tcp.internal.ConnectGateway@104b1ea1, ctxInitLatch=java.util.concurrent.CountDownLatch@46ba37e1[Count = 1], stopping=false, clientPool=null, nioSrvWrapper=null, stateProvider=null], evtSpi=MemoryEventStorageSpi [expireAgeMs=9223372036854775807, expireCnt=10000, filter=null], colSpi=NoopCollisionSpi [], deploySpi=LocalDeploymentSpi [], indexingSpi=org.apache.ignite.spi.indexing.noop.NoopIndexingSpi@7100b6e7, addrRslvr=null, encryptionSpi=org.apache.ignite.spi.encryption.keystore.KeystoreEncryptionSpi@5b534300, tracingSpi=org.apache.ignite.spi.tracing.NoopTracingSpi@54546dd7, clientMode=false, rebalanceThreadPoolSize=4, rebalanceTimeout=10000, rebalanceBatchesPrefetchCnt=3, rebalanceThrottle=0, rebalanceBatchSize=524288, txCfg=TransactionConfiguration [txSerEnabled=false, dfltIsolation=REPEATABLE_READ, dfltConcurrency=PESSIMISTIC, dfltTxTimeout=0, txTimeoutOnPartitionMapExchange=0, deadlockTimeout=10000, pessimisticTxLogSize=0, pessimisticTxLogLinger=10000, tmLookupClsName=null, txManagerFactory=null, useJtaSync=false], cacheSanityCheckEnabled=true, discoStartupDelay=60000, deployMode=SHARED, p2pMissedCacheSize=100, locHost=127.0.0.1, timeSrvPortBase=31100, timeSrvPortRange=100, failureDetectionTimeout=10000, sysWorkerBlockedTimeout=null, clientFailureDetectionTimeout=10000, metricsLogFreq=0, connectorCfg=null, odbcCfg=null, warmupClos=null, atomicCfg=AtomicConfiguration [seqReserveSize=1000, cacheMode=PARTITIONED, backups=1, aff=null, grpName=null], classLdr=null, sslCtxFactory=null, platformCfg=null, binaryCfg=null, memCfg=null, pstCfg=null, dsCfg=DataStorageConfiguration [sysRegionInitSize=41943040, sysRegionMaxSize=104857600, pageSize=4096, concLvl=0, dfltDataRegConf=DataRegionConfiguration [name=default, maxSize=10485760, initSize=268435456, swapPath=null, pageEvictionMode=DISABLED, pageReplacementMode=CLOCK, evictionThreshold=0.9, emptyPagesPoolSize=100, metricsEnabled=false, metricsSubIntervalCount=5, metricsRateTimeInterval=60000, persistenceEnabled=true, checkpointPageBufSize=0, lazyMemoryAllocation=true, warmUpCfg=null], dataRegions=null, storagePath=null, checkpointFreq=180000, lockWaitTime=10000, checkpointThreads=4, checkpointWriteOrder=SEQUENTIAL, walHistSize=20, maxWalArchiveSize=1073741824, walSegments=10, walSegmentSize=67108864, walPath=db/wal, walArchivePath=db/wal/archive, cdcWalPath=db/wal/cdc, cdcEnabled=false, metricsEnabled=false, walMode=FSYNC, walTlbSize=131072, walBuffSize=0, walFlushFreq=2000, walFsyncDelay=1000, walRecordIterBuffSize=67108864, alwaysWriteFullPages=false, fileIOFactory=org.apache.ignite.internal.processors.cache.persistence.file.AsyncFileIOFactory@4e672437, metricsSubIntervalCnt=5, metricsRateTimeInterval=60000, walAutoArchiveAfterInactivity=-1, walForceArchiveTimeout=-1, writeThrottlingEnabled=false, walCompactionEnabled=false, walCompactionLevel=1, checkpointReadLockTimeout=null, walPageCompression=DISABLED, walPageCompressionLevel=null, dfltWarmUpCfg=null, encCfg=org.apache.ignite.configuration.EncryptionConfiguration@11ca2faa, defragmentationThreadPoolSize=4, minWalArchiveSize=-1], snapshotPath=snapshots, activeOnStart=true, activeOnStartPropSetFlag=false, autoActivation=true, autoActivationPropSetFlag=false, clusterStateOnStart=null, sqlConnCfg=null, cliConnCfg=ClientConnectorConfiguration [host=null, port=10800, portRange=100, sockSndBufSize=0, sockRcvBufSize=0, tcpNoDelay=true, maxOpenCursorsPerConn=128, threadPoolSize=24, selectorCnt=12, idleTimeout=0, handshakeTimeout=10000, jdbcEnabled=true, odbcEnabled=true, thinCliEnabled=true, sslEnabled=false, useIgniteSslCtxFactory=true, sslClientAuth=false, sslCtxFactory=null, thinCliCfg=ThinClientConfiguration [maxActiveTxPerConn=100, maxActiveComputeTasksPerConn=0]], mvccVacuumThreadCnt=2, mvccVacuumFreq=5000, authEnabled=false, failureHnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]], commFailureRslvr=null, sqlCfg=SqlConfiguration [longQryWarnTimeout=3000, dfltQryTimeout=0, sqlQryHistSize=1000, validationEnabled=false], asyncContinuationExecutor=null] [21:04:54] : [Step 4/5] [2021-11-19 21:04:54,107][INFO ][test-runner-#9703%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] Daemon mode: off [21:04:54] : [Step 4/5] [2021-11-19 21:04:54,107][INFO ][test-runner-#9703%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] OS: Linux 4.15.0-151-generic amd64 [21:04:54] : [Step 4/5] [2021-11-19 21:04:54,108][INFO ][test-runner-#9703%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] OS user: teamcity [21:04:54] : [Step 4/5] [2021-11-19 21:04:54,108][INFO ][test-runner-#9703%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] PID: 16724 [21:04:54] : [Step 4/5] [2021-11-19 21:04:54,108][INFO ][test-runner-#9703%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] Language runtime: Java Platform API Specification ver. 1.8 [21:04:54] : [Step 4/5] [2021-11-19 21:04:54,109][INFO ][test-runner-#9703%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] VM information: Java(TM) SE Runtime Environment 1.8.0_261-b12 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 25.261-b12 [21:04:54] : [Step 4/5] [2021-11-19 21:04:54,109][INFO ][test-runner-#9703%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] VM total memory: 1.9GB [21:04:54] : [Step 4/5] [2021-11-19 21:04:54,109][INFO ][test-runner-#9703%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] Remote Management [restart: off, REST: off, JMX (remote: off)] [21:04:54] : [Step 4/5] [2021-11-19 21:04:54,110][INFO ][test-runner-#9703%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] Logger: GridTestLog4jLogger [quiet=false, config=null] [21:04:54] : [Step 4/5] [2021-11-19 21:04:54,110][INFO ][test-runner-#9703%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] IGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c [21:04:54] : [Step 4/5] [2021-11-19 21:04:54,110][INFO ][test-runner-#9703%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] VM arguments: [-DIGNITE_DUMP_THREADS_ON_FAILURE=false, -DMono=/usr/bin/mono-sgen, -DMono4.0_x64=/usr/lib/mono/4.0, -DMono4.5_x64=/usr/lib/mono/4.5, -DMonoVersion=6.12.0.90, -DSKIP_BUILD=false, -Dagent.home.dir=/opt/buildagent, -Dagent.name=aitc-lin02_03, -Dagent.ownPort=9090, -Dagent.work.dir=/opt/buildagent/work, -Dbuild.number=95, -Dbuild.vcs.number=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.1=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.GitHubApacheIgnite=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dclassworlds.conf=/opt/buildagent/temp/buildTmp/teamcity.m2.conf, -Dcom.jetbrains.maven.watcher.report.file=/opt/buildagent/temp/buildTmp/maven-build-info.xml, -Djava.io.tmpdir=/opt/buildagent/temp/buildTmp, -Dmaven.home=/opt/buildagent/tools/maven3_6, -Dmaven.multiModuleProjectDirectory=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.agent.cpuBenchmark=457, -Dteamcity.agent.dotnet.agent_url=http://localhost:9090/RPC2, -Dteamcity.agent.dotnet.build_id=6278078, -Dteamcity.auth.password=*******, -Dteamcity.auth.userId=TeamCityBuildId=6278078, -Dteamcity.build.changedFiles.file=/opt/buildagent/temp/buildTmp/changedFiles6342607772318147725.txt, -Dteamcity.build.checkoutDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.build.id=6278078, -Dteamcity.build.properties.file=/opt/buildagent/temp/buildTmp/teamcity.build5164517880467851002.properties, -Dteamcity.build.tempDir=/opt/buildagent/temp/buildTmp, -Dteamcity.build.workingDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.buildConfName=Basic 3, -Dteamcity.buildType.id=IgniteTests24Java8_Basic3, -Dteamcity.configuration.properties.file=/opt/buildagent/temp/buildTmp/teamcity.config5591980786735343870.properties, -Dteamcity.maven.userSettings.path=/opt/buildagent/temp/buildTmp/maven_settings_585072866407032347.xml, -Dteamcity.maven.watcher.home=/opt/buildagent/plugins/mavenPlugin/maven-watcher-jdk16, -Dteamcity.projectName=Ignite Tests 2.x (JDK 8/11), -Dteamcity.runner.properties.file=/opt/buildagent/temp/buildTmp/teamcity.runner9098465561618137420.properties, -Dteamcity.tests.recentlyFailedTests.file=/opt/buildagent/temp/buildTmp/testsToRunFirst3891775683130404069.txt, -Dteamcity.version=2021.2 (build 99542), -ea, -Xms2g, -Xmx2g, -XX:+HeapDumpOnOutOfMemoryError, -DIGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_TEST_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_UPDATE_NOTIFIER=false, -DIGNITE_NO_DISCO_ORDER=true, -DIGNITE_PERFORMANCE_SUGGESTIONS_DISABLED=true, -Djava.net.preferIPv4Stack=true, -DTEST_SCALE_FACTOR=1.0, -DIGNITE_TEST_PROP_LOG4J_FILE=log4j-tc-test.xml, -DIGNITE_QUIET=false, -DIGNITE_MARSHAL_BUFFERS_RECHECK=1000, -Dmaven.repo.local=/opt/buildagent/.m2/repository] [21:04:54] : [Step 4/5] [2021-11-19 21:04:54,115][INFO ][test-runner-#9703%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] System cache's DataRegion size is configured to 40 MB. Use DataStorageConfiguration.systemRegionInitialSize property to change the setting. [21:04:54] : [Step 4/5] [2021-11-19 21:04:54,116][INFO ][test-runner-#9703%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] Configured caches [in 'sysMemPlc' dataRegion: ['ignite-sys-cache']] [21:04:54]W: [org.apache.ignite:ignite-core] [2021-11-19 21:04:54,116][WARN ][test-runner-#9703%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] Peer class loading is enabled (disable it in production for performance and deployment consistency reasons) [21:04:54] : [Step 4/5] [2021-11-19 21:04:54,116][INFO ][test-runner-#9703%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] 3-rd party licenses can be found at: /opt/buildagent/work/7bc1c54bc719b67c/libs/licenses [21:04:54] : [Step 4/5] [2021-11-19 21:04:54,120][INFO ][test-runner-#9703%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] Configured plugins: [21:04:54] : [Step 4/5] [2021-11-19 21:04:54,120][INFO ][test-runner-#9703%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- StanByClusterTestProvider 1.0 [21:04:54] : [Step 4/5] [2021-11-19 21:04:54,121][INFO ][test-runner-#9703%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- null [21:04:54] : [Step 4/5] [2021-11-19 21:04:54,121][INFO ][test-runner-#9703%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] [21:04:54] : [Step 4/5] [2021-11-19 21:04:54,121][INFO ][test-runner-#9703%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- PageMemory tracker plugin 1.0 [21:04:54] : [Step 4/5] [2021-11-19 21:04:54,121][INFO ][test-runner-#9703%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- null [21:04:54] : [Step 4/5] [2021-11-19 21:04:54,122][INFO ][test-runner-#9703%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] [21:04:54] : [Step 4/5] [2021-11-19 21:04:54,122][INFO ][test-runner-#9703%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- TestDistibutedConfigurationPlugin 1.0 [21:04:54] : [Step 4/5] [2021-11-19 21:04:54,122][INFO ][test-runner-#9703%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- null [21:04:54] : [Step 4/5] [2021-11-19 21:04:54,122][INFO ][test-runner-#9703%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] [21:04:54] : [Step 4/5] [2021-11-19 21:04:54,123][INFO ][test-runner-#9703%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- NodeValidationPluginProvider 1.0 [21:04:54] : [Step 4/5] [2021-11-19 21:04:54,123][INFO ][test-runner-#9703%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- null [21:04:54] : [Step 4/5] [2021-11-19 21:04:54,123][INFO ][test-runner-#9703%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] [21:04:54] : [Step 4/5] [2021-11-19 21:04:54,124][INFO ][test-runner-#9703%encryption.EncryptedCacheNodeJoinTest%][FailureProcessor] Configured failure handler: [hnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]]] [21:04:54]W: [org.apache.ignite:ignite-core] [2021-11-19 21:04:54,133][WARN ][test-runner-#9703%encryption.EncryptedCacheNodeJoinTest%][TcpCommunicationSpi] Message queue limit is set to 0 which may lead to potential OOMEs when running cache operations in FULL_ASYNC or PRIMARY_SYNC modes due to message queues growth on sender and receiver sides. [21:04:54] : [Step 4/5] [2021-11-19 21:04:54,132][INFO ][test-runner-#9703%encryption.EncryptedCacheNodeJoinTest%][TcpCommunicationSpi] Successfully bound communication NIO server to TCP port [port=45150, locHost=/127.0.0.1, selectorsCnt=12, selectorSpins=0, pairedConn=false] [21:04:54] : [Step 4/5] [2021-11-19 21:04:54,136][INFO ][test-runner-#9703%encryption.EncryptedCacheNodeJoinTest%][GridCollisionManager] Collision resolution is disabled (all jobs will be activated upon arrival). [21:04:54] : [Step 4/5] [2021-11-19 21:04:54,137][INFO ][test-runner-#9703%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] Security status [authentication=off, sandbox=off, tls/ssl=off] [21:04:54] : [Step 4/5] [2021-11-19 21:04:54,194][INFO ][test-runner-#9703%encryption.EncryptedCacheNodeJoinTest%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:04:54] : [Step 4/5] [2021-11-19 21:04:54,278][INFO ][test-runner-#9703%encryption.EncryptedCacheNodeJoinTest%][MaintenanceProcessor] Resolved store directory for node persistent data: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0 [21:04:54] : [Step 4/5] [2021-11-19 21:04:54,279][INFO ][test-runner-#9703%encryption.EncryptedCacheNodeJoinTest%][CacheObjectBinaryProcessorImpl] Resolved directory for serialized binary metadata: /opt/buildagent/work/7bc1c54bc719b67c/work/db/binary_meta/grid_0 [21:04:54] : [Step 4/5] [2021-11-19 21:04:54,284][INFO ][test-runner-#9703%encryption.EncryptedCacheNodeJoinTest%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0 [21:04:54] : [Step 4/5] [2021-11-19 21:04:54,285][INFO ][test-runner-#9703%encryption.EncryptedCacheNodeJoinTest%][FileWriteAheadLogManager] Resolved write ahead log work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0 [21:04:54] : [Step 4/5] [2021-11-19 21:04:54,285][INFO ][test-runner-#9703%encryption.EncryptedCacheNodeJoinTest%][FileWriteAheadLogManager] Resolved write ahead log archive directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0 [21:04:54] : [Step 4/5] [2021-11-19 21:04:54,646][INFO ][test-runner-#9703%encryption.EncryptedCacheNodeJoinTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000000.wal [21:04:54]W: [org.apache.ignite:ignite-core] [2021-11-19 21:04:54,647][WARN ][test-runner-#9703%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] DataRegion maxSize=10.5 MB is smaller than defaultInitialSize=268.4 MB, setting initialSize to 10.5 MB [21:04:54] : [Step 4/5] [2021-11-19 21:04:54,651][INFO ][test-runner-#9703%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Configured data regions initialized successfully [total=5] [21:04:54] : [Step 4/5] [2021-11-19 21:04:54,655][INFO ][test-runner-#9703%encryption.EncryptedCacheNodeJoinTest%][IgniteSnapshotManager] Resolved snapshot work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/snapshots [21:04:54] : [Step 4/5] [2021-11-19 21:04:54,655][INFO ][test-runner-#9703%encryption.EncryptedCacheNodeJoinTest%][IgniteSnapshotManager] Resolved temp directory for snapshot creation: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0/snp [21:04:54] : [Step 4/5] [2021-11-19 21:04:54,657][INFO ][test-runner-#9703%encryption.EncryptedCacheNodeJoinTest%][ClientListenerProcessor] Client connector processor has started on TCP port 10800 [21:04:54] : [Step 4/5] [2021-11-19 21:04:54,659][INFO ][test-runner-#9703%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] Non-loopback local IPs: 172.17.0.4 [21:04:54] : [Step 4/5] [2021-11-19 21:04:54,659][INFO ][test-runner-#9703%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] Enabled local MACs: 0242AC110004 [21:04:54] : [Step 4/5] [2021-11-19 21:04:54,660][INFO ][test-runner-#9703%encryption.EncryptedCacheNodeJoinTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:04:54] : [Step 4/5] [2021-11-19 21:04:54,661][INFO ][test-runner-#9703%encryption.EncryptedCacheNodeJoinTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:04:54] : [Step 4/5] [2021-11-19 21:04:54,662][INFO ][test-runner-#9703%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:04:54] : [Step 4/5] [2021-11-19 21:04:54,664][INFO ][test-runner-#9703%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Applying lost metastore updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:04:54] : [Step 4/5] [2021-11-19 21:04:54,665][INFO ][test-runner-#9703%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=0 ms] [21:04:54] : [Step 4/5] [2021-11-19 21:04:54,665][INFO ][test-runner-#9703%encryption.EncryptedCacheNodeJoinTest%][GridCacheProcessor] Restoring partition state for local groups. [21:04:54] : [Step 4/5] [2021-11-19 21:04:54,666][INFO ][test-runner-#9703%encryption.EncryptedCacheNodeJoinTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=0, partitionsProcessed=0, time=0ms] [21:04:54] : [Step 4/5] [2021-11-19 21:04:54,666][INFO ][test-runner-#9703%encryption.EncryptedCacheNodeJoinTest%][GridEncryptionManager] Encryption keys loaded from metastore. [grps=, masterKeyName=ignite.master.key] [21:04:54] : [Step 4/5] [2021-11-19 21:04:54,668][INFO ][test-runner-#9703%encryption.EncryptedCacheNodeJoinTest%][ClusterProcessor] Cluster ID and tag has been read from metastorage: null [21:04:54] : [Step 4/5] [2021-11-19 21:04:54,669][INFO ][test-runner-#9703%encryption.EncryptedCacheNodeJoinTest%][IgniteClusterImpl] Shutdown policy was updated [oldVal=null, newVal=null] [21:04:54] : [Step 4/5] [2021-11-19 21:04:54,669][INFO ][test-runner-#9703%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Checkpoint frequency deviation changed [oldVal=null, newVal=null] [21:04:54] : [Step 4/5] [2021-11-19 21:04:54,680][INFO ][test-runner-#9703%encryption.EncryptedCacheNodeJoinTest%][FilePageStoreManager] Cleanup cache stores [total=1, left=0, cleanFiles=false] [21:04:54] : [Step 4/5] [2021-11-19 21:04:54,682][INFO ][test-runner-#9703%encryption.EncryptedCacheNodeJoinTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:04:54] : [Step 4/5] [2021-11-19 21:04:54,683][INFO ][test-runner-#9703%encryption.EncryptedCacheNodeJoinTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:04:54] : [Step 4/5] [2021-11-19 21:04:54,684][INFO ][test-runner-#9703%encryption.EncryptedCacheNodeJoinTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:04:54] : [Step 4/5] [2021-11-19 21:04:54,685][INFO ][test-runner-#9703%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Data Regions Started: 5 [21:04:54] : [Step 4/5] [2021-11-19 21:04:54,685][INFO ][test-runner-#9703%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] ^-- sysMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:04:54] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:04:54] : [Step 4/5] ^-- default region [type=default, persistence=true, lazyAlloc=true, [21:04:54] : [Step 4/5] ... initCfg=10MB, maxCfg=10MB, usedRam=0MB, freeRam=100%, allocRam=0MB, allocTotal=0MB] [21:04:54] : [Step 4/5] ^-- metastoreMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:04:54] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:04:54] : [Step 4/5] ^-- TxLog region [type=internal, persistence=true, lazyAlloc=false, [21:04:54] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:04:54] : [Step 4/5] ^-- volatileDsMemPlc region [type=user, persistence=false, lazyAlloc=true, [21:04:54] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB] [21:04:54] : [Step 4/5] ^-- Ignite persistence [used=0MB] [21:04:54] : [Step 4/5] [21:04:54] : [Step 4/5] [2021-11-19 21:04:54,687][INFO ][test-runner-#9703%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Starting binary memory restore for: [-2100569601] [21:04:54] : [Step 4/5] [2021-11-19 21:04:54,693][INFO ][test-runner-#9703%encryption.EncryptedCacheNodeJoinTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:04:54] : [Step 4/5] [2021-11-19 21:04:54,694][INFO ][test-runner-#9703%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:04:54] : [Step 4/5] [2021-11-19 21:04:54,695][INFO ][test-runner-#9703%encryption.EncryptedCacheNodeJoinTest%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000000.wal, offset=0, ver=2] [21:04:54] : [Step 4/5] [2021-11-19 21:04:54,707][INFO ][test-runner-#9703%encryption.EncryptedCacheNodeJoinTest%][GridCacheProcessor] Started cache in recovery mode [name=ignite-sys-cache, id=-2100569601, dataRegionName=sysMemPlc, mode=REPLICATED, atomicity=TRANSACTIONAL, backups=2147483647, mvcc=false] [21:04:54] : [Step 4/5] [2021-11-19 21:04:54,708][INFO ][test-runner-#9703%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Binary recovery performed in 21 ms. [21:04:54] : [Step 4/5] [2021-11-19 21:04:54,708][INFO ][test-runner-#9703%encryption.EncryptedCacheNodeJoinTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:04:54] : [Step 4/5] [2021-11-19 21:04:54,708][INFO ][test-runner-#9703%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Applying lost cache updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:04:54] : [Step 4/5] [2021-11-19 21:04:54,781][INFO ][test-runner-#9703%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=70 ms] [21:04:54] : [Step 4/5] [2021-11-19 21:04:54,781][INFO ][test-runner-#9703%encryption.EncryptedCacheNodeJoinTest%][GridCacheProcessor] Restoring partition state for local groups. [21:04:54] : [Step 4/5] [2021-11-19 21:04:54,788][INFO ][test-runner-#9703%encryption.EncryptedCacheNodeJoinTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=1, partitionsProcessed=100, time=0ms] [21:04:55] : [Step 4/5] [2021-11-19 21:04:55,095][INFO ][test-runner-#9703%encryption.EncryptedCacheNodeJoinTest%][TestTcpDiscoverySpi] Successfully bound to TCP port [port=47500, localHost=localhost/127.0.0.1, locNodeId=00e326d4-0c21-42d9-93eb-188856bb0000] [21:04:55] : [Step 4/5] [2021-11-19 21:04:55,099][INFO ][disco-notifier-worker-#9814%grid-0%][MvccProcessorImpl] Assigned mvcc coordinator [crd=MvccCoordinator [topVer=AffinityTopologyVersion [topVer=1, minorTopVer=0], nodeId=00e326d4-0c21-42d9-93eb-188856bb0000, ver=1637345095092, local=true, initialized=false]] [21:04:55] : [Step 4/5] [2021-11-19 21:04:55,100][INFO ][sys-#9790%grid-0%][ClusterProcessor] Writing cluster ID and tag to metastorage on ready for write ClusterIdAndTag [id=ac4111d9-98be-49e7-9f31-36e08b4997ca, tag=dreamy_ptolemy] [21:04:55] : [Step 4/5] [2021-11-19 21:04:55,101][INFO ][disco-notifier-worker-#9814%grid-0%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustEnabled' was changed from 'null' to 'false' [21:04:55] : [Step 4/5] [2021-11-19 21:04:55,102][INFO ][disco-notifier-worker-#9814%grid-0%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustTimeout' was changed from 'null' to '300000' [21:04:55] : [Step 4/5] [2021-11-19 21:04:55,103][INFO ][disco-notifier-worker-#9814%grid-0%][IgniteTxManager] Transactions parameter 'longOperationsDumpTimeout' was changed from 'null' to '60000' [21:04:55] : [Step 4/5] [2021-11-19 21:04:55,103][INFO ][disco-notifier-worker-#9814%grid-0%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpThreshold' was changed from 'null' to '0' [21:04:55] : [Step 4/5] [2021-11-19 21:04:55,104][INFO ][disco-notifier-worker-#9814%grid-0%][ClusterProcessor] dreamy_ptolemy [21:04:55] : [Step 4/5] [2021-11-19 21:04:55,104][INFO ][disco-notifier-worker-#9814%grid-0%][IgniteTxManager] Transactions parameter 'transactionTimeDumpSamplesCoefficient' was changed from 'null' to '0.0' [21:04:55] : [Step 4/5] [2021-11-19 21:04:55,105][INFO ][disco-notifier-worker-#9814%grid-0%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpSamplesPerSecondLimit' was changed from 'null' to '5' [21:04:55] : [Step 4/5] [2021-11-19 21:04:55,105][INFO ][disco-notifier-worker-#9814%grid-0%][IgniteTxManager] Transactions parameter 'collisionsDumpInterval' was changed from 'null' to '1000' [21:04:55] : [Step 4/5] [2021-11-19 21:04:55,106][INFO ][disco-notifier-worker-#9814%grid-0%][IgniteTxManager] Transactions parameter 'txOwnerDumpRequestsAllowed' was changed from 'null' to 'true' [21:04:55] : [Step 4/5] [2021-11-19 21:04:55,106][INFO ][disco-notifier-worker-#9814%grid-0%][GridCacheDatabaseSharedManager] Historical rebalance WAL threshold changed [property=historical.rebalance.threshold, oldVal=null, newVal=500] [21:04:55] : [Step 4/5] [2021-11-19 21:04:55,129][INFO ][test-runner-#9703%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] To start Console Management & Monitoring run ignitevisorcmd.{sh|bat} [21:04:55] : [Step 4/5] [2021-11-19 21:04:55,129][INFO ][test-runner-#9703%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] [21:04:55] : [Step 4/5] [21:04:55] : [Step 4/5] >>> +-------------------------------------------+ [21:04:55] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:04:55] : [Step 4/5] >>> +-------------------------------------------+ [21:04:55] : [Step 4/5] >>> OS name: Linux 4.15.0-151-generic amd64 [21:04:55] : [Step 4/5] >>> CPU(s): 24 [21:04:55] : [Step 4/5] >>> Heap: 2.0GB [21:04:55] : [Step 4/5] >>> VM name: 16724@c4dfe9a430b2 [21:04:55] : [Step 4/5] >>> Ignite instance name: grid-0 [21:04:55] : [Step 4/5] >>> Local node [ID=00E326D4-0C21-42D9-93EB-188856BB0000, order=1, clientMode=false] [21:04:55] : [Step 4/5] >>> Local node addresses: [127.0.0.1] [21:04:55] : [Step 4/5] >>> Local ports: TCP:10800 TCP:45150 TCP:47500 [21:04:55] : [Step 4/5] [21:04:55] : [Step 4/5] [2021-11-19 21:04:55,130][INFO ][test-runner-#9703%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] >>> Ignite cluster is in INACTIVE state (limited functionality available). Use control.(sh|bat) script or IgniteCluster.state(ClusterState.ACTIVE) to change the state. [21:04:55] : [Step 4/5] [2021-11-19 21:04:55,131][INFO ][test-runner-#9703%encryption.EncryptedCacheNodeJoinTest%][GridDiscoveryManager] Topology snapshot [ver=1, locNode=00e326d4, servers=1, clients=0, state=INACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=00e326d4-0c21-42d9-93eb-188856bb0000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:04:55] : [Step 4/5] [2021-11-19 21:04:55,131][INFO ][test-runner-#9703%encryption.EncryptedCacheNodeJoinTest%][G] Node started : [stage="Configure system pool" (0 ms),stage="Start managers" (184 ms),stage="Configure binary metadata" (2 ms),stage="Start processors" (377 ms),stage="Start 'StanByClusterTestProvider' plugin" (0 ms),stage="Start 'PageMemory tracker plugin' plugin" (0 ms),stage="Start 'TestDistibutedConfigurationPlugin' plugin" (0 ms),stage="Start 'NodeValidationPluginProvider' plugin" (0 ms),stage="Init metastore" (21 ms),stage="Init and start regions" (6 ms),stage="Restore binary memory" (21 ms),stage="Restore logical state" (80 ms),stage="Finish recovery" (304 ms),stage="Join topology" (5 ms),stage="Await transition" (2 ms),stage="Await exchange" (29 ms),stage="Total time" (1031 ms)] [21:04:55] : [Step 4/5] [2021-11-19 21:04:55,132][INFO ][test-runner-#9703%encryption.EncryptedCacheNodeJoinTest%][root] Node started with the following configuration [id=00e326d4-0c21-42d9-93eb-188856bb0000, marshaller=BinaryMarshaller [], discovery=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=5000, ackTimeout=5000, marsh=JdkMarshaller [clsFilter=org.apache.ignite.marshaller.MarshallerUtils$1@10cc7d8e], reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], binaryCfg=null, lateAff=true] [21:04:55]W: [org.apache.ignite:ignite-core] [2021-11-19 21:04:55,137][WARN ][test-runner-#9703%encryption.EncryptedCacheNodeJoinTest%][G] Ignite work directory is not provided, automatically resolved to: /opt/buildagent/work/7bc1c54bc719b67c/work [21:04:55] : [Step 4/5] [2021-11-19 21:04:55,138][INFO ][test-runner-#9703%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-3] [21:04:55] : [Step 4/5] [21:04:55] : [Step 4/5] >>> __________ ________________ [21:04:55] : [Step 4/5] >>> / _/ ___/ |/ / _/_ __/ __/ [21:04:55] : [Step 4/5] >>> _/ // (7 7 // / / / / _/ [21:04:55] : [Step 4/5] >>> /___/\___/_/|_/___/ /_/ /___/ [21:04:55] : [Step 4/5] >>> [21:04:55] : [Step 4/5] >>> ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:04:55] : [Step 4/5] >>> 2021 Copyright(C) Apache Software Foundation [21:04:55] : [Step 4/5] >>> [21:04:55] : [Step 4/5] >>> Ignite documentation: http://ignite.apache.org [21:04:55] : [Step 4/5] [21:04:55] : [Step 4/5] [2021-11-19 21:04:55,139][INFO ][test-runner-#9703%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-3] Config URL: n/a [21:04:55] : [Step 4/5] [2021-11-19 21:04:55,139][INFO ][test-runner-#9703%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-3] IgniteConfiguration [igniteInstanceName=grid-3, pubPoolSize=24, svcPoolSize=24, callbackPoolSize=24, stripedPoolSize=24, sysPoolSize=24, mgmtPoolSize=4, dataStreamerPoolSize=24, utilityCachePoolSize=24, utilityCacheKeepAliveTime=60000, p2pPoolSize=2, qryPoolSize=24, buildIdxPoolSize=4, igniteHome=/opt/buildagent/work/7bc1c54bc719b67c, igniteWorkDir=/opt/buildagent/work/7bc1c54bc719b67c/work, mbeanSrv=com.sun.jmx.mbeanserver.JmxMBeanServer@6fe85038, nodeId=30fb8db0-e121-45b9-b689-f4f0f4589003, marsh=BinaryMarshaller [], marshLocJobs=false, daemon=false, p2pEnabled=true, netTimeout=10000, netCompressionLevel=1, sndRetryDelay=1000, sndRetryCnt=3, metricsHistSize=10000, metricsUpdateFreq=1000, metricsExpTime=9223372036854775807, discoSpi=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=0, ackTimeout=0, marsh=null, reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], segPlc=STOP, segResolveAttempts=2, waitForSegOnStart=true, allResolversPassReq=true, segChkFreq=10000, commSpi=TcpCommunicationSpi [connectGate=org.apache.ignite.spi.communication.tcp.internal.ConnectGateway@1af2ddd6, ctxInitLatch=java.util.concurrent.CountDownLatch@6c2e07f[Count = 1], stopping=false, clientPool=null, nioSrvWrapper=null, stateProvider=null], evtSpi=MemoryEventStorageSpi [expireAgeMs=9223372036854775807, expireCnt=10000, filter=null], colSpi=NoopCollisionSpi [], deploySpi=LocalDeploymentSpi [], indexingSpi=org.apache.ignite.spi.indexing.noop.NoopIndexingSpi@2439e73, addrRslvr=null, encryptionSpi=org.apache.ignite.spi.encryption.keystore.KeystoreEncryptionSpi@7ca3242, tracingSpi=org.apache.ignite.spi.tracing.NoopTracingSpi@1f6c749, clientMode=false, rebalanceThreadPoolSize=4, rebalanceTimeout=10000, rebalanceBatchesPrefetchCnt=3, rebalanceThrottle=0, rebalanceBatchSize=524288, txCfg=TransactionConfiguration [txSerEnabled=false, dfltIsolation=REPEATABLE_READ, dfltConcurrency=PESSIMISTIC, dfltTxTimeout=0, txTimeoutOnPartitionMapExchange=0, deadlockTimeout=10000, pessimisticTxLogSize=0, pessimisticTxLogLinger=10000, tmLookupClsName=null, txManagerFactory=null, useJtaSync=false], cacheSanityCheckEnabled=true, discoStartupDelay=60000, deployMode=SHARED, p2pMissedCacheSize=100, locHost=127.0.0.1, timeSrvPortBase=31100, timeSrvPortRange=100, failureDetectionTimeout=10000, sysWorkerBlockedTimeout=null, clientFailureDetectionTimeout=10000, metricsLogFreq=0, connectorCfg=null, odbcCfg=null, warmupClos=null, atomicCfg=AtomicConfiguration [seqReserveSize=1000, cacheMode=PARTITIONED, backups=1, aff=null, grpName=null], classLdr=null, sslCtxFactory=null, platformCfg=null, binaryCfg=null, memCfg=null, pstCfg=null, dsCfg=DataStorageConfiguration [sysRegionInitSize=41943040, sysRegionMaxSize=104857600, pageSize=4096, concLvl=0, dfltDataRegConf=DataRegionConfiguration [name=default, maxSize=10485760, initSize=268435456, swapPath=null, pageEvictionMode=DISABLED, pageReplacementMode=CLOCK, evictionThreshold=0.9, emptyPagesPoolSize=100, metricsEnabled=false, metricsSubIntervalCount=5, metricsRateTimeInterval=60000, persistenceEnabled=true, checkpointPageBufSize=0, lazyMemoryAllocation=true, warmUpCfg=null], dataRegions=null, storagePath=null, checkpointFreq=180000, lockWaitTime=10000, checkpointThreads=4, checkpointWriteOrder=SEQUENTIAL, walHistSize=20, maxWalArchiveSize=1073741824, walSegments=10, walSegmentSize=67108864, walPath=db/wal, walArchivePath=db/wal/archive, cdcWalPath=db/wal/cdc, cdcEnabled=false, metricsEnabled=false, walMode=FSYNC, walTlbSize=131072, walBuffSize=0, walFlushFreq=2000, walFsyncDelay=1000, walRecordIterBuffSize=67108864, alwaysWriteFullPages=false, fileIOFactory=org.apache.ignite.internal.processors.cache.persistence.file.AsyncFileIOFactory@66d2ee15, metricsSubIntervalCnt=5, metricsRateTimeInterval=60000, walAutoArchiveAfterInactivity=-1, walForceArchiveTimeout=-1, writeThrottlingEnabled=false, walCompactionEnabled=false, walCompactionLevel=1, checkpointReadLockTimeout=null, walPageCompression=DISABLED, walPageCompressionLevel=null, dfltWarmUpCfg=null, encCfg=org.apache.ignite.configuration.EncryptionConfiguration@712a635f, defragmentationThreadPoolSize=4, minWalArchiveSize=-1], snapshotPath=snapshots, activeOnStart=true, activeOnStartPropSetFlag=false, autoActivation=true, autoActivationPropSetFlag=false, clusterStateOnStart=null, sqlConnCfg=null, cliConnCfg=ClientConnectorConfiguration [host=null, port=10800, portRange=100, sockSndBufSize=0, sockRcvBufSize=0, tcpNoDelay=true, maxOpenCursorsPerConn=128, threadPoolSize=24, selectorCnt=12, idleTimeout=0, handshakeTimeout=10000, jdbcEnabled=true, odbcEnabled=true, thinCliEnabled=true, sslEnabled=false, useIgniteSslCtxFactory=true, sslClientAuth=false, sslCtxFactory=null, thinCliCfg=ThinClientConfiguration [maxActiveTxPerConn=100, maxActiveComputeTasksPerConn=0]], mvccVacuumThreadCnt=2, mvccVacuumFreq=5000, authEnabled=false, failureHnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]], commFailureRslvr=null, sqlCfg=SqlConfiguration [longQryWarnTimeout=3000, dfltQryTimeout=0, sqlQryHistSize=1000, validationEnabled=false], asyncContinuationExecutor=null] [21:04:55] : [Step 4/5] [2021-11-19 21:04:55,150][INFO ][test-runner-#9703%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-3] Daemon mode: off [21:04:55] : [Step 4/5] [2021-11-19 21:04:55,150][INFO ][test-runner-#9703%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-3] OS: Linux 4.15.0-151-generic amd64 [21:04:55] : [Step 4/5] [2021-11-19 21:04:55,150][INFO ][test-runner-#9703%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-3] OS user: teamcity [21:04:55] : [Step 4/5] [2021-11-19 21:04:55,151][INFO ][test-runner-#9703%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-3] PID: 16724 [21:04:55] : [Step 4/5] [2021-11-19 21:04:55,151][INFO ][test-runner-#9703%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-3] Language runtime: Java Platform API Specification ver. 1.8 [21:04:55] : [Step 4/5] [2021-11-19 21:04:55,152][INFO ][test-runner-#9703%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-3] VM information: Java(TM) SE Runtime Environment 1.8.0_261-b12 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 25.261-b12 [21:04:55] : [Step 4/5] [2021-11-19 21:04:55,152][INFO ][test-runner-#9703%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-3] VM total memory: 1.9GB [21:04:55] : [Step 4/5] [2021-11-19 21:04:55,152][INFO ][test-runner-#9703%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-3] Remote Management [restart: off, REST: off, JMX (remote: off)] [21:04:55] : [Step 4/5] [2021-11-19 21:04:55,153][INFO ][test-runner-#9703%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-3] Logger: GridTestLog4jLogger [quiet=false, config=null] [21:04:55] : [Step 4/5] [2021-11-19 21:04:55,153][INFO ][test-runner-#9703%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-3] IGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c [21:04:55] : [Step 4/5] [2021-11-19 21:04:55,154][INFO ][test-runner-#9703%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-3] VM arguments: [-DIGNITE_DUMP_THREADS_ON_FAILURE=false, -DMono=/usr/bin/mono-sgen, -DMono4.0_x64=/usr/lib/mono/4.0, -DMono4.5_x64=/usr/lib/mono/4.5, -DMonoVersion=6.12.0.90, -DSKIP_BUILD=false, -Dagent.home.dir=/opt/buildagent, -Dagent.name=aitc-lin02_03, -Dagent.ownPort=9090, -Dagent.work.dir=/opt/buildagent/work, -Dbuild.number=95, -Dbuild.vcs.number=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.1=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.GitHubApacheIgnite=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dclassworlds.conf=/opt/buildagent/temp/buildTmp/teamcity.m2.conf, -Dcom.jetbrains.maven.watcher.report.file=/opt/buildagent/temp/buildTmp/maven-build-info.xml, -Djava.io.tmpdir=/opt/buildagent/temp/buildTmp, -Dmaven.home=/opt/buildagent/tools/maven3_6, -Dmaven.multiModuleProjectDirectory=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.agent.cpuBenchmark=457, -Dteamcity.agent.dotnet.agent_url=http://localhost:9090/RPC2, -Dteamcity.agent.dotnet.build_id=6278078, -Dteamcity.auth.password=*******, -Dteamcity.auth.userId=TeamCityBuildId=6278078, -Dteamcity.build.changedFiles.file=/opt/buildagent/temp/buildTmp/changedFiles6342607772318147725.txt, -Dteamcity.build.checkoutDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.build.id=6278078, -Dteamcity.build.properties.file=/opt/buildagent/temp/buildTmp/teamcity.build5164517880467851002.properties, -Dteamcity.build.tempDir=/opt/buildagent/temp/buildTmp, -Dteamcity.build.workingDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.buildConfName=Basic 3, -Dteamcity.buildType.id=IgniteTests24Java8_Basic3, -Dteamcity.configuration.properties.file=/opt/buildagent/temp/buildTmp/teamcity.config5591980786735343870.properties, -Dteamcity.maven.userSettings.path=/opt/buildagent/temp/buildTmp/maven_settings_585072866407032347.xml, -Dteamcity.maven.watcher.home=/opt/buildagent/plugins/mavenPlugin/maven-watcher-jdk16, -Dteamcity.projectName=Ignite Tests 2.x (JDK 8/11), -Dteamcity.runner.properties.file=/opt/buildagent/temp/buildTmp/teamcity.runner9098465561618137420.properties, -Dteamcity.tests.recentlyFailedTests.file=/opt/buildagent/temp/buildTmp/testsToRunFirst3891775683130404069.txt, -Dteamcity.version=2021.2 (build 99542), -ea, -Xms2g, -Xmx2g, -XX:+HeapDumpOnOutOfMemoryError, -DIGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_TEST_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_UPDATE_NOTIFIER=false, -DIGNITE_NO_DISCO_ORDER=true, -DIGNITE_PERFORMANCE_SUGGESTIONS_DISABLED=true, -Djava.net.preferIPv4Stack=true, -DTEST_SCALE_FACTOR=1.0, -DIGNITE_TEST_PROP_LOG4J_FILE=log4j-tc-test.xml, -DIGNITE_QUIET=false, -DIGNITE_MARSHAL_BUFFERS_RECHECK=1000, -Dmaven.repo.local=/opt/buildagent/.m2/repository] [21:04:55] : [Step 4/5] [2021-11-19 21:04:55,159][INFO ][test-runner-#9703%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-3] System cache's DataRegion size is configured to 40 MB. Use DataStorageConfiguration.systemRegionInitialSize property to change the setting. [21:04:55]W: [org.apache.ignite:ignite-core] [2021-11-19 21:04:55,160][WARN ][test-runner-#9703%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-3] Peer class loading is enabled (disable it in production for performance and deployment consistency reasons) [21:04:55] : [Step 4/5] [2021-11-19 21:04:55,160][INFO ][test-runner-#9703%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-3] Configured caches [in 'sysMemPlc' dataRegion: ['ignite-sys-cache']] [21:04:55] : [Step 4/5] [2021-11-19 21:04:55,161][INFO ][test-runner-#9703%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-3] 3-rd party licenses can be found at: /opt/buildagent/work/7bc1c54bc719b67c/libs/licenses [21:04:55] : [Step 4/5] [2021-11-19 21:04:55,167][INFO ][test-runner-#9703%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] Configured plugins: [21:04:55] : [Step 4/5] [2021-11-19 21:04:55,167][INFO ][test-runner-#9703%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- StanByClusterTestProvider 1.0 [21:04:55] : [Step 4/5] [2021-11-19 21:04:55,168][INFO ][test-runner-#9703%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- null [21:04:55] : [Step 4/5] [2021-11-19 21:04:55,168][INFO ][test-runner-#9703%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] [21:04:55] : [Step 4/5] [2021-11-19 21:04:55,168][INFO ][test-runner-#9703%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- PageMemory tracker plugin 1.0 [21:04:55] : [Step 4/5] [2021-11-19 21:04:55,169][INFO ][test-runner-#9703%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- null [21:04:55] : [Step 4/5] [2021-11-19 21:04:55,169][INFO ][test-runner-#9703%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] [21:04:55] : [Step 4/5] [2021-11-19 21:04:55,169][INFO ][test-runner-#9703%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- TestDistibutedConfigurationPlugin 1.0 [21:04:55] : [Step 4/5] [2021-11-19 21:04:55,169][INFO ][test-runner-#9703%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- null [21:04:55] : [Step 4/5] [2021-11-19 21:04:55,170][INFO ][test-runner-#9703%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] [21:04:55] : [Step 4/5] [2021-11-19 21:04:55,170][INFO ][test-runner-#9703%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- NodeValidationPluginProvider 1.0 [21:04:55] : [Step 4/5] [2021-11-19 21:04:55,170][INFO ][test-runner-#9703%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- null [21:04:55] : [Step 4/5] [2021-11-19 21:04:55,171][INFO ][test-runner-#9703%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] [21:04:55] : [Step 4/5] [2021-11-19 21:04:55,171][INFO ][test-runner-#9703%encryption.EncryptedCacheNodeJoinTest%][FailureProcessor] Configured failure handler: [hnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]]] [21:04:55] : [Step 4/5] [2021-11-19 21:04:55,199][INFO ][test-runner-#9703%encryption.EncryptedCacheNodeJoinTest%][TcpCommunicationSpi] Successfully bound communication NIO server to TCP port [port=45151, locHost=/127.0.0.1, selectorsCnt=12, selectorSpins=0, pairedConn=false] [21:04:55]W: [org.apache.ignite:ignite-core] [2021-11-19 21:04:55,199][WARN ][test-runner-#9703%encryption.EncryptedCacheNodeJoinTest%][TcpCommunicationSpi] Message queue limit is set to 0 which may lead to potential OOMEs when running cache operations in FULL_ASYNC or PRIMARY_SYNC modes due to message queues growth on sender and receiver sides. [21:04:55] : [Step 4/5] [2021-11-19 21:04:55,204][INFO ][test-runner-#9703%encryption.EncryptedCacheNodeJoinTest%][GridCollisionManager] Collision resolution is disabled (all jobs will be activated upon arrival). [21:04:55] : [Step 4/5] [2021-11-19 21:04:55,204][INFO ][test-runner-#9703%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-3] Security status [authentication=off, sandbox=off, tls/ssl=off] [21:04:55] : [Step 4/5] [2021-11-19 21:04:55,266][INFO ][test-runner-#9703%encryption.EncryptedCacheNodeJoinTest%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:04:55] : [Step 4/5] [2021-11-19 21:04:55,352][INFO ][test-runner-#9703%encryption.EncryptedCacheNodeJoinTest%][MaintenanceProcessor] Resolved store directory for node persistent data: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_3 [21:04:55] : [Step 4/5] [2021-11-19 21:04:55,353][INFO ][test-runner-#9703%encryption.EncryptedCacheNodeJoinTest%][CacheObjectBinaryProcessorImpl] Resolved directory for serialized binary metadata: /opt/buildagent/work/7bc1c54bc719b67c/work/db/binary_meta/grid_3 [21:04:55] : [Step 4/5] [2021-11-19 21:04:55,358][INFO ][test-runner-#9703%encryption.EncryptedCacheNodeJoinTest%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_3 [21:04:55] : [Step 4/5] [2021-11-19 21:04:55,358][INFO ][test-runner-#9703%encryption.EncryptedCacheNodeJoinTest%][FileWriteAheadLogManager] Resolved write ahead log work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_3 [21:04:55] : [Step 4/5] [2021-11-19 21:04:55,359][INFO ][test-runner-#9703%encryption.EncryptedCacheNodeJoinTest%][FileWriteAheadLogManager] Resolved write ahead log archive directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_3 [21:04:55] : [Step 4/5] [2021-11-19 21:04:55,824][INFO ][test-runner-#9703%encryption.EncryptedCacheNodeJoinTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_3/0000000000000000.wal [21:04:55] : [Step 4/5] [2021-11-19 21:04:55,829][INFO ][test-runner-#9703%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Configured data regions initialized successfully [total=5] [21:04:55] : [Step 4/5] [2021-11-19 21:04:55,833][INFO ][test-runner-#9703%encryption.EncryptedCacheNodeJoinTest%][IgniteSnapshotManager] Resolved snapshot work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/snapshots [21:04:55] : [Step 4/5] [2021-11-19 21:04:55,833][INFO ][test-runner-#9703%encryption.EncryptedCacheNodeJoinTest%][IgniteSnapshotManager] Resolved temp directory for snapshot creation: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_3/snp [21:04:55] : [Step 4/5] [2021-11-19 21:04:55,837][INFO ][test-runner-#9703%encryption.EncryptedCacheNodeJoinTest%][ClientListenerProcessor] Client connector processor has started on TCP port 10801 [21:04:55] : [Step 4/5] [2021-11-19 21:04:55,840][INFO ][test-runner-#9703%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-3] Non-loopback local IPs: 172.17.0.4 [21:04:55] : [Step 4/5] [2021-11-19 21:04:55,840][INFO ][test-runner-#9703%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-3] Enabled local MACs: 0242AC110004 [21:04:55] : [Step 4/5] [2021-11-19 21:04:55,841][INFO ][test-runner-#9703%encryption.EncryptedCacheNodeJoinTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:04:55] : [Step 4/5] [2021-11-19 21:04:55,843][INFO ][test-runner-#9703%encryption.EncryptedCacheNodeJoinTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:04:55] : [Step 4/5] [2021-11-19 21:04:55,844][INFO ][test-runner-#9703%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:04:55] : [Step 4/5] [2021-11-19 21:04:55,846][INFO ][test-runner-#9703%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Applying lost metastore updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:04:55] : [Step 4/5] [2021-11-19 21:04:55,847][INFO ][test-runner-#9703%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=0 ms] [21:04:55] : [Step 4/5] [2021-11-19 21:04:55,848][INFO ][test-runner-#9703%encryption.EncryptedCacheNodeJoinTest%][GridCacheProcessor] Restoring partition state for local groups. [21:04:55] : [Step 4/5] [2021-11-19 21:04:55,848][INFO ][test-runner-#9703%encryption.EncryptedCacheNodeJoinTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=0, partitionsProcessed=0, time=0ms] [21:04:55] : [Step 4/5] [2021-11-19 21:04:55,848][INFO ][test-runner-#9703%encryption.EncryptedCacheNodeJoinTest%][GridEncryptionManager] Encryption keys loaded from metastore. [grps=, masterKeyName=ignite.master.key] [21:04:55] : [Step 4/5] [2021-11-19 21:04:55,850][INFO ][test-runner-#9703%encryption.EncryptedCacheNodeJoinTest%][ClusterProcessor] Cluster ID and tag has been read from metastorage: null [21:04:55] : [Step 4/5] [2021-11-19 21:04:55,850][INFO ][test-runner-#9703%encryption.EncryptedCacheNodeJoinTest%][IgniteClusterImpl] Shutdown policy was updated [oldVal=null, newVal=null] [21:04:55] : [Step 4/5] [2021-11-19 21:04:55,850][INFO ][test-runner-#9703%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Checkpoint frequency deviation changed [oldVal=null, newVal=null] [21:04:55] : [Step 4/5] [2021-11-19 21:04:55,866][INFO ][test-runner-#9703%encryption.EncryptedCacheNodeJoinTest%][FilePageStoreManager] Cleanup cache stores [total=1, left=0, cleanFiles=false] [21:04:55] : [Step 4/5] [2021-11-19 21:04:55,869][INFO ][test-runner-#9703%encryption.EncryptedCacheNodeJoinTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:04:55] : [Step 4/5] [2021-11-19 21:04:55,869][INFO ][test-runner-#9703%encryption.EncryptedCacheNodeJoinTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:04:55] : [Step 4/5] [2021-11-19 21:04:55,871][INFO ][test-runner-#9703%encryption.EncryptedCacheNodeJoinTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:04:55] : [Step 4/5] [2021-11-19 21:04:55,871][INFO ][test-runner-#9703%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Data Regions Started: 5 [21:04:55] : [Step 4/5] [2021-11-19 21:04:55,871][INFO ][test-runner-#9703%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] ^-- sysMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:04:55] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:04:55] : [Step 4/5] ^-- default region [type=default, persistence=true, lazyAlloc=true, [21:04:55] : [Step 4/5] ... initCfg=10MB, maxCfg=10MB, usedRam=0MB, freeRam=100%, allocRam=0MB, allocTotal=0MB] [21:04:55] : [Step 4/5] ^-- metastoreMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:04:55] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:04:55] : [Step 4/5] ^-- TxLog region [type=internal, persistence=true, lazyAlloc=false, [21:04:55] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:04:55] : [Step 4/5] ^-- volatileDsMemPlc region [type=user, persistence=false, lazyAlloc=true, [21:04:55] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB] [21:04:55] : [Step 4/5] ^-- Ignite persistence [used=0MB] [21:04:55] : [Step 4/5] [21:04:55] : [Step 4/5] [2021-11-19 21:04:55,873][INFO ][test-runner-#9703%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Starting binary memory restore for: [-2100569601] [21:04:55] : [Step 4/5] [2021-11-19 21:04:55,880][INFO ][test-runner-#9703%encryption.EncryptedCacheNodeJoinTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:04:55] : [Step 4/5] [2021-11-19 21:04:55,880][INFO ][test-runner-#9703%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:04:55] : [Step 4/5] [2021-11-19 21:04:55,881][INFO ][test-runner-#9703%encryption.EncryptedCacheNodeJoinTest%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_3/0000000000000000.wal, offset=0, ver=2] [21:04:55] : [Step 4/5] [2021-11-19 21:04:55,893][INFO ][test-runner-#9703%encryption.EncryptedCacheNodeJoinTest%][GridCacheProcessor] Started cache in recovery mode [name=ignite-sys-cache, id=-2100569601, dataRegionName=sysMemPlc, mode=REPLICATED, atomicity=TRANSACTIONAL, backups=2147483647, mvcc=false] [21:04:55] : [Step 4/5] [2021-11-19 21:04:55,894][INFO ][test-runner-#9703%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Binary recovery performed in 21 ms. [21:04:55] : [Step 4/5] [2021-11-19 21:04:55,894][INFO ][test-runner-#9703%encryption.EncryptedCacheNodeJoinTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:04:55] : [Step 4/5] [2021-11-19 21:04:55,894][INFO ][test-runner-#9703%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Applying lost cache updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:04:55] : [Step 4/5] [2021-11-19 21:04:55,975][INFO ][test-runner-#9703%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=80 ms] [21:04:55] : [Step 4/5] [2021-11-19 21:04:55,975][INFO ][test-runner-#9703%encryption.EncryptedCacheNodeJoinTest%][GridCacheProcessor] Restoring partition state for local groups. [21:04:55] : [Step 4/5] [2021-11-19 21:04:55,982][INFO ][test-runner-#9703%encryption.EncryptedCacheNodeJoinTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=1, partitionsProcessed=100, time=11ms] [21:04:56] : [Step 4/5] [2021-11-19 21:04:56,372][INFO ][test-runner-#9703%encryption.EncryptedCacheNodeJoinTest%][TestTcpDiscoverySpi] Successfully bound to TCP port [port=47501, localHost=localhost/127.0.0.1, locNodeId=30fb8db0-e121-45b9-b689-f4f0f4589003] [21:04:56] : [Step 4/5] [2021-11-19 21:04:56,376][INFO ][tcp-disco-srvr-[:47500]-#508%grid-0%-#9816%grid-0%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=41809] [21:04:56] : [Step 4/5] [2021-11-19 21:04:56,376][INFO ][tcp-disco-srvr-[:47500]-#508%grid-0%-#9816%grid-0%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=41809] [21:04:56] : [Step 4/5] [2021-11-19 21:04:56,377][INFO ][tcp-disco-sock-reader-[]-#514%grid-0%-#9935%grid-0%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:41809, rmtPort=41809] [21:04:56] : [Step 4/5] [2021-11-19 21:04:56,378][INFO ][tcp-disco-sock-reader-[30fb8db0 127.0.0.1:41809]-#514%grid-0%-#9935%grid-0%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=30fb8db0-e121-45b9-b689-f4f0f4589003, rmtAddr=/127.0.0.1:41809] [21:04:56] : [Step 4/5] [2021-11-19 21:04:56,381][INFO ][tcp-disco-srvr-[:47501]-#513%grid-3%-#9934%grid-3%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=56687] [21:04:56] : [Step 4/5] [2021-11-19 21:04:56,382][INFO ][tcp-disco-srvr-[:47501]-#513%grid-3%-#9934%grid-3%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=56687] [21:04:56] : [Step 4/5] [2021-11-19 21:04:56,382][INFO ][tcp-disco-sock-reader-[]-#515%grid-3%-#9936%grid-3%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:56687, rmtPort=56687] [21:04:56] : [Step 4/5] [2021-11-19 21:04:56,383][INFO ][tcp-disco-sock-reader-[]-#515%grid-3%-#9936%grid-3%][TestTcpDiscoverySpi] Received ping request from the remote node [rmtNodeId=00e326d4-0c21-42d9-93eb-188856bb0000, rmtAddr=/127.0.0.1:56687, rmtPort=56687] [21:04:56] : [Step 4/5] [2021-11-19 21:04:56,384][INFO ][tcp-disco-sock-reader-[]-#515%grid-3%-#9936%grid-3%][TestTcpDiscoverySpi] Finished writing ping response [rmtNodeId=00e326d4-0c21-42d9-93eb-188856bb0000, rmtAddr=/127.0.0.1:56687, rmtPort=56687] [21:04:56]W: [org.apache.ignite:ignite-core] [2021-11-19 21:04:56,384][WARN ][tcp-disco-sock-reader-[]-#515%grid-3%-#9936%grid-3%][TestTcpDiscoverySpi] Failed to shutdown socket [21:04:56]W: [org.apache.ignite:ignite-core] java.net.SocketException: Socket output is already shutdown [21:04:56]W: [org.apache.ignite:ignite-core] at java.net.Socket.shutdownOutput(Socket.java:1572) [21:04:56]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.close(IgniteUtils.java:4247) [21:04:56]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.discovery.tcp.ServerImpl$SocketReader.body(ServerImpl.java:7370) [21:04:56]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.IgniteSpiThread.run(IgniteSpiThread.java:58) [21:04:56] : [Step 4/5] [2021-11-19 21:04:56,386][INFO ][tcp-disco-sock-reader-[]-#515%grid-3%-#9936%grid-3%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:56687, rmtPort=56687, rmtNodeId=null] [21:04:56] : [Step 4/5] [2021-11-19 21:04:56,384][INFO ][tcp-disco-sock-reader-[30fb8db0 127.0.0.1:41809]-#514%grid-0%-#9935%grid-0%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:41809, rmtPort=41809, rmtNodeId=30fb8db0-e121-45b9-b689-f4f0f4589003] [21:04:56] : [Step 4/5] [2021-11-19 21:04:56,388][INFO ][tcp-disco-msg-worker-[crd]-#507%grid-0%-#9815%grid-0%][GridEncryptionManager] Joining node doesn't have stored group keys [node=30fb8db0-e121-45b9-b689-f4f0f4589003] [21:04:56] : [Step 4/5] [2021-11-19 21:04:56,395][INFO ][tcp-disco-msg-worker-[crd]-#507%grid-0%-#9815%grid-0%][TestTcpDiscoverySpi] New next node [newNext=TcpDiscoveryNode [id=30fb8db0-e121-45b9-b689-f4f0f4589003, consistentId=grid-3, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=0, intOrder=2, lastExchangeTime=1637345096372, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false]] [21:04:56] : [Step 4/5] [2021-11-19 21:04:56,396][INFO ][tcp-disco-srvr-[:47501]-#513%grid-3%-#9934%grid-3%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=56625] [21:04:56] : [Step 4/5] [2021-11-19 21:04:56,397][INFO ][tcp-disco-srvr-[:47501]-#513%grid-3%-#9934%grid-3%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=56625] [21:04:56] : [Step 4/5] [2021-11-19 21:04:56,397][INFO ][tcp-disco-sock-reader-[]-#516%grid-3%-#9937%grid-3%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:56625, rmtPort=56625] [21:04:56] : [Step 4/5] [2021-11-19 21:04:56,399][INFO ][tcp-disco-sock-reader-[00e326d4 127.0.0.1:56625]-#516%grid-3%-#9937%grid-3%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=00e326d4-0c21-42d9-93eb-188856bb0000, rmtAddr=/127.0.0.1:56625] [21:04:56] : [Step 4/5] [2021-11-19 21:04:56,405][INFO ][tcp-disco-msg-worker-[]-#512%grid-3%-#9933%grid-3%][TestTcpDiscoverySpi] New next node [newNext=TcpDiscoveryNode [id=00e326d4-0c21-42d9-93eb-188856bb0000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345096392, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false]] [21:04:56] : [Step 4/5] [2021-11-19 21:04:56,407][INFO ][tcp-disco-srvr-[:47500]-#508%grid-0%-#9816%grid-0%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=35901] [21:04:56] : [Step 4/5] [2021-11-19 21:04:56,407][INFO ][tcp-disco-srvr-[:47500]-#508%grid-0%-#9816%grid-0%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=35901] [21:04:56] : [Step 4/5] [2021-11-19 21:04:56,407][INFO ][tcp-disco-sock-reader-[]-#517%grid-0%-#9938%grid-0%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:35901, rmtPort=35901] [21:04:56] : [Step 4/5] [2021-11-19 21:04:56,409][INFO ][tcp-disco-sock-reader-[30fb8db0 127.0.0.1:35901]-#517%grid-0%-#9938%grid-0%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=30fb8db0-e121-45b9-b689-f4f0f4589003, rmtAddr=/127.0.0.1:35901] [21:04:56] : [Step 4/5] [2021-11-19 21:04:56,411][INFO ][disco-event-worker-#9818%grid-0%][GridDiscoveryManager] Added new node to topology: TcpDiscoveryNode [id=30fb8db0-e121-45b9-b689-f4f0f4589003, consistentId=grid-3, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637345096372, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false] [21:04:56] : [Step 4/5] [2021-11-19 21:04:56,412][INFO ][disco-event-worker-#9818%grid-0%][GridDiscoveryManager] Topology snapshot [ver=2, locNode=00e326d4, servers=2, clients=0, state=INACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=00e326d4-0c21-42d9-93eb-188856bb0000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=30fb8db0-e121-45b9-b689-f4f0f4589003, consistentId=grid-3, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:04:56] : [Step 4/5] [2021-11-19 21:04:56,414][INFO ][tcp-disco-msg-worker-[00e326d4 127.0.0.1:47500]-#512%grid-3%-#9933%grid-3%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustEnabled' was changed from 'null' to 'false' [21:04:56] : [Step 4/5] [2021-11-19 21:04:56,415][INFO ][tcp-disco-msg-worker-[00e326d4 127.0.0.1:47500]-#512%grid-3%-#9933%grid-3%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustTimeout' was changed from 'null' to '300000' [21:04:56] : [Step 4/5] [2021-11-19 21:04:56,416][INFO ][tcp-disco-msg-worker-[00e326d4 127.0.0.1:47500]-#512%grid-3%-#9933%grid-3%][IgniteTxManager] Transactions parameter 'longOperationsDumpTimeout' was changed from 'null' to '60000' [21:04:56] : [Step 4/5] [2021-11-19 21:04:56,416][INFO ][tcp-disco-msg-worker-[00e326d4 127.0.0.1:47500]-#512%grid-3%-#9933%grid-3%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpThreshold' was changed from 'null' to '0' [21:04:56] : [Step 4/5] [2021-11-19 21:04:56,416][INFO ][tcp-disco-msg-worker-[00e326d4 127.0.0.1:47500]-#512%grid-3%-#9933%grid-3%][ClusterProcessor] dreamy_ptolemy [21:04:56] : [Step 4/5] [2021-11-19 21:04:56,417][INFO ][tcp-disco-msg-worker-[00e326d4 127.0.0.1:47500]-#512%grid-3%-#9933%grid-3%][IgniteTxManager] Transactions parameter 'transactionTimeDumpSamplesCoefficient' was changed from 'null' to '0.0' [21:04:56] : [Step 4/5] [2021-11-19 21:04:56,417][INFO ][tcp-disco-msg-worker-[00e326d4 127.0.0.1:47500]-#512%grid-3%-#9933%grid-3%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpSamplesPerSecondLimit' was changed from 'null' to '5' [21:04:56] : [Step 4/5] [2021-11-19 21:04:56,417][INFO ][tcp-disco-msg-worker-[00e326d4 127.0.0.1:47500]-#512%grid-3%-#9933%grid-3%][IgniteTxManager] Transactions parameter 'collisionsDumpInterval' was changed from 'null' to '1000' [21:04:56] : [Step 4/5] [2021-11-19 21:04:56,418][INFO ][tcp-disco-msg-worker-[00e326d4 127.0.0.1:47500]-#512%grid-3%-#9933%grid-3%][IgniteTxManager] Transactions parameter 'txOwnerDumpRequestsAllowed' was changed from 'null' to 'true' [21:04:56] : [Step 4/5] [2021-11-19 21:04:56,418][INFO ][tcp-disco-msg-worker-[00e326d4 127.0.0.1:47500]-#512%grid-3%-#9933%grid-3%][GridCacheDatabaseSharedManager] Historical rebalance WAL threshold changed [property=historical.rebalance.threshold, oldVal=null, newVal=500] [21:04:56] : [Step 4/5] [2021-11-19 21:04:56,419][INFO ][disco-notifier-worker-#9932%grid-3%][MvccProcessorImpl] Assigned mvcc coordinator [crd=MvccCoordinator [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=0], nodeId=00e326d4-0c21-42d9-93eb-188856bb0000, ver=1637345095092, local=false, initialized=false]] [21:04:56] : [Step 4/5] [2021-11-19 21:04:56,420][INFO ][sys-#9915%grid-3%][ClusterProcessor] Writing cluster ID and tag to metastorage on ready for write ClusterIdAndTag [id=ac4111d9-98be-49e7-9f31-36e08b4997ca, tag=dreamy_ptolemy] [21:04:56] : [Step 4/5] [2021-11-19 21:04:56,433][INFO ][test-runner-#9703%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-3] To start Console Management & Monitoring run ignitevisorcmd.{sh|bat} [21:04:56] : [Step 4/5] [2021-11-19 21:04:56,434][INFO ][test-runner-#9703%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-3] [21:04:56] : [Step 4/5] [21:04:56] : [Step 4/5] >>> +-------------------------------------------+ [21:04:56] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:04:56] : [Step 4/5] >>> +-------------------------------------------+ [21:04:56] : [Step 4/5] >>> OS name: Linux 4.15.0-151-generic amd64 [21:04:56] : [Step 4/5] >>> CPU(s): 24 [21:04:56] : [Step 4/5] >>> Heap: 2.0GB [21:04:56] : [Step 4/5] >>> VM name: 16724@c4dfe9a430b2 [21:04:56] : [Step 4/5] >>> Ignite instance name: grid-3 [21:04:56] : [Step 4/5] >>> Local node [ID=30FB8DB0-E121-45B9-B689-F4F0F4589003, order=2, clientMode=false] [21:04:56] : [Step 4/5] >>> Local node addresses: [127.0.0.1] [21:04:56] : [Step 4/5] >>> Local ports: TCP:10801 TCP:45151 TCP:47501 [21:04:56] : [Step 4/5] [21:04:56] : [Step 4/5] [2021-11-19 21:04:56,435][INFO ][test-runner-#9703%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-3] >>> Ignite cluster is in INACTIVE state (limited functionality available). Use control.(sh|bat) script or IgniteCluster.state(ClusterState.ACTIVE) to change the state. [21:04:56] : [Step 4/5] [2021-11-19 21:04:56,435][INFO ][test-runner-#9703%encryption.EncryptedCacheNodeJoinTest%][GridDiscoveryManager] Topology snapshot [ver=2, locNode=30fb8db0, servers=2, clients=0, state=INACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=00e326d4-0c21-42d9-93eb-188856bb0000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=30fb8db0-e121-45b9-b689-f4f0f4589003, consistentId=grid-3, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:04:56] : [Step 4/5] [2021-11-19 21:04:56,436][INFO ][test-runner-#9703%encryption.EncryptedCacheNodeJoinTest%][G] Node started : [stage="Configure system pool" (0 ms),stage="Start managers" (215 ms),stage="Configure binary metadata" (2 ms),stage="Start processors" (484 ms),stage="Start 'StanByClusterTestProvider' plugin" (0 ms),stage="Start 'PageMemory tracker plugin' plugin" (0 ms),stage="Start 'TestDistibutedConfigurationPlugin' plugin" (0 ms),stage="Start 'NodeValidationPluginProvider' plugin" (0 ms),stage="Init metastore" (26 ms),stage="Init and start regions" (6 ms),stage="Restore binary memory" (20 ms),stage="Restore logical state" (88 ms),stage="Finish recovery" (388 ms),stage="Join topology" (48 ms),stage="Await transition" (2 ms),stage="Await exchange" (14 ms),stage="Total time" (1293 ms)] [21:04:56] : [Step 4/5] [2021-11-19 21:04:56,437][INFO ][test-runner-#9703%encryption.EncryptedCacheNodeJoinTest%][root] Node started with the following configuration [id=30fb8db0-e121-45b9-b689-f4f0f4589003, marshaller=BinaryMarshaller [], discovery=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=5000, ackTimeout=5000, marsh=JdkMarshaller [clsFilter=org.apache.ignite.marshaller.MarshallerUtils$1@578a02f8], reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], binaryCfg=null, lateAff=true] [21:04:56] : [Step 4/5] [2021-11-19 21:04:56,438][INFO ][test-runner-#9703%encryption.EncryptedCacheNodeJoinTest%][GridClusterStateProcessor] Sending activate cluster request with BaselineTopology BaselineTopology [id=0, branchingHash=-2475315499, branchingType='New BaselineTopology', baselineNodes=[grid-0, grid-3]] [21:04:56] : [Step 4/5] [2021-11-19 21:04:56,442][INFO ][disco-notifier-worker-#9814%grid-0%][GridClusterStateProcessor] Received activate cluster request with BaselineTopology[id=0] initiator node ID: 30fb8db0-e121-45b9-b689-f4f0f4589003 [21:04:56] : [Step 4/5] [2021-11-19 21:04:56,443][INFO ][disco-notifier-worker-#9814%grid-0%][GridClusterStateProcessor] Started state transition: activate cluster [21:04:56] : [Step 4/5] [2021-11-19 21:04:56,443][INFO ][disco-notifier-worker-#9932%grid-3%][GridClusterStateProcessor] Received activate cluster request with BaselineTopology[id=0] initiator node ID: 30fb8db0-e121-45b9-b689-f4f0f4589003 [21:04:56] : [Step 4/5] [2021-11-19 21:04:56,443][INFO ][exchange-worker-#9819%grid-0%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], crd=true, evt=DISCOVERY_CUSTOM_EVT, evtNode=30fb8db0-e121-45b9-b689-f4f0f4589003, customEvt=ChangeGlobalStateMessage [id=fbd2d593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqId=8e394791-2a37-42c7-b966-f84e771b07cf, initiatingNodeId=30fb8db0-e121-45b9-b689-f4f0f4589003, state=ACTIVE, baselineTopology=BaselineTopology [id=0, branchingHash=-2475315499, branchingType='New BaselineTopology', baselineNodes=[grid-0, grid-3]], forceChangeBaselineTopology=false, timestamp=1637345096438, forceDeactivation=true], allowMerge=false, exchangeFreeSwitch=false] [21:04:56] : [Step 4/5] [2021-11-19 21:04:56,444][INFO ][disco-notifier-worker-#9932%grid-3%][GridClusterStateProcessor] Started state transition: activate cluster [21:04:56] : [Step 4/5] [2021-11-19 21:04:56,445][INFO ][exchange-worker-#9819%grid-0%][GridDhtPartitionsExchangeFuture] Start activation process [nodeId=00e326d4-0c21-42d9-93eb-188856bb0000, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]]. New state: ACTIVE [21:04:56] : [Step 4/5] [2021-11-19 21:04:56,445][INFO ][exchange-worker-#9941%grid-3%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], crd=false, evt=DISCOVERY_CUSTOM_EVT, evtNode=30fb8db0-e121-45b9-b689-f4f0f4589003, customEvt=ChangeGlobalStateMessage [id=fbd2d593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqId=8e394791-2a37-42c7-b966-f84e771b07cf, initiatingNodeId=30fb8db0-e121-45b9-b689-f4f0f4589003, state=ACTIVE, baselineTopology=BaselineTopology [id=0, branchingHash=-2475315499, branchingType='New BaselineTopology', baselineNodes=[grid-0, grid-3]], forceChangeBaselineTopology=false, timestamp=1637345096438, forceDeactivation=true], allowMerge=false, exchangeFreeSwitch=false] [21:04:56] : [Step 4/5] [2021-11-19 21:04:56,446][INFO ][exchange-worker-#9941%grid-3%][GridDhtPartitionsExchangeFuture] Start activation process [nodeId=30fb8db0-e121-45b9-b689-f4f0f4589003, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]]. New state: ACTIVE [21:04:56] : [Step 4/5] [2021-11-19 21:04:56,447][INFO ][exchange-worker-#9941%grid-3%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_3 [21:04:56] : [Step 4/5] [2021-11-19 21:04:56,445][INFO ][exchange-worker-#9819%grid-0%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0 [21:04:56] : [Step 4/5] [2021-11-19 21:04:56,449][INFO ][exchange-worker-#9941%grid-3%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_3/0000000000000000.wal, offset=8713, ver=2] [21:04:56] : [Step 4/5] [2021-11-19 21:04:56,453][INFO ][exchange-worker-#9941%grid-3%][GridClusterStateProcessor] Writing BaselineTopology[id=0] [21:04:56] : [Step 4/5] [2021-11-19 21:04:56,453][INFO ][exchange-worker-#9819%grid-0%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000000.wal, offset=8713, ver=2] [21:04:56] : [Step 4/5] [2021-11-19 21:04:56,456][INFO ][exchange-worker-#9819%grid-0%][GridClusterStateProcessor] Writing BaselineTopology[id=0] [21:04:56] : [Step 4/5] [2021-11-19 21:04:56,459][INFO ][exchange-worker-#9941%grid-3%][GridCacheDatabaseSharedManager] Finish recovery performed in 12 ms. [21:04:56] : [Step 4/5] [2021-11-19 21:04:56,460][INFO ][exchange-worker-#9941%grid-3%][msg] Components activation performed in 13 ms. [21:04:56] : [Step 4/5] [2021-11-19 21:04:56,461][INFO ][exchange-worker-#9819%grid-0%][GridCacheDatabaseSharedManager] Finish recovery performed in 13 ms. [21:04:56] : [Step 4/5] [2021-11-19 21:04:56,461][INFO ][exchange-worker-#9941%grid-3%][GridCacheProcessor] Finished recovery for cache [cache=ignite-sys-cache, grp=ignite-sys-cache, startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:04:56] : [Step 4/5] [2021-11-19 21:04:56,462][INFO ][exchange-worker-#9819%grid-0%][msg] Components activation performed in 17 ms. [21:04:56] : [Step 4/5] [2021-11-19 21:04:56,465][INFO ][exchange-worker-#9941%grid-3%][GridDhtPartitionsExchangeFuture] Successfully activated caches [nodeId=30fb8db0-e121-45b9-b689-f4f0f4589003, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], newState=ACTIVE] [21:04:56] : [Step 4/5] [2021-11-19 21:04:56,465][INFO ][exchange-worker-#9819%grid-0%][GridCacheProcessor] Finished recovery for cache [cache=ignite-sys-cache, grp=ignite-sys-cache, startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:04:56] : [Step 4/5] [2021-11-19 21:04:56,466][INFO ][exchange-worker-#9941%grid-3%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:04:56] : [Step 4/5] [2021-11-19 21:04:56,466][INFO ][exchange-worker-#9819%grid-0%][GridDhtPartitionsExchangeFuture] Successfully activated caches [nodeId=00e326d4-0c21-42d9-93eb-188856bb0000, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], newState=ACTIVE] [21:04:56] : [Step 4/5] [2021-11-19 21:04:56,467][INFO ][exchange-worker-#9819%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:04:56] : [Step 4/5] [2021-11-19 21:04:56,493][INFO ][grid-nio-worker-tcp-comm-0-#9758%TcpCommunicationSpi%][TcpCommunicationSpi] Accepted incoming communication connection [locAddr=/127.0.0.1:45150, rmtAddr=/127.0.0.1:59594] [21:04:56] : [Step 4/5] [2021-11-19 21:04:56,493][INFO ][exchange-worker-#9819%grid-0%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], crd=true] [21:04:56] : [Step 4/5] [2021-11-19 21:04:56,494][INFO ][db-checkpoint-thread-#9950%grid-3%][Checkpointer] Checkpoint started [checkpointId=c201f3d3-e0f5-47eb-b5b7-2a3b8acab975, startPtr=WALPointer [idx=0, fileOff=86309, len=1963], checkpointBeforeLockTime=15ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=2ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=1ms, pages=18, reason='node started'] [21:04:56] : [Step 4/5] [2021-11-19 21:04:56,496][INFO ][grid-nio-worker-tcp-comm-0-#9876%TcpCommunicationSpi%][TcpCommunicationSpi] Established outgoing communication connection [locAddr=/127.0.0.1:59594, rmtAddr=/127.0.0.1:45150] [21:04:56] : [Step 4/5] [2021-11-19 21:04:56,497][INFO ][exchange-worker-#9941%grid-3%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], crd=false] [21:04:56] : [Step 4/5] [2021-11-19 21:04:56,501][INFO ][sys-#9798%grid-0%][GridDhtPartitionsExchangeFuture] Coordinator received single message [ver=AffinityTopologyVersion [topVer=2, minorTopVer=1], node=30fb8db0-e121-45b9-b689-f4f0f4589003, allReceived=true] [21:04:56] : [Step 4/5] [2021-11-19 21:04:56,501][INFO ][sys-#9798%grid-0%][GridDhtPartitionsExchangeFuture] finishExchangeOnCoordinator [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:04:56] : [Step 4/5] [2021-11-19 21:04:56,503][INFO ][db-checkpoint-thread-#9951%grid-0%][Checkpointer] Checkpoint started [checkpointId=d329a286-6163-4bbb-82ec-615f73dae86f, startPtr=WALPointer [idx=0, fileOff=90647, len=1963], checkpointBeforeLockTime=7ms, checkpointLockWait=2ms, checkpointListenersExecuteTime=1ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=9ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=0ms, pages=19, reason='node started'] [21:04:56] : [Step 4/5] [2021-11-19 21:04:56,527][INFO ][sys-#9798%grid-0%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], err=null, rebalanced=true, wasRebalanced=false] [21:04:56] : [Step 4/5] [2021-11-19 21:04:56,531][INFO ][disco-notifier-worker-#9814%grid-0%][GridClusterStateProcessor] Received state change finish message: ACTIVE [21:04:56] : [Step 4/5] [2021-11-19 21:04:56,531][INFO ][sys-#9920%grid-3%][GridDhtPartitionsExchangeFuture] Received full message, will finish exchange [node=00e326d4-0c21-42d9-93eb-188856bb0000, resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:04:56] : [Step 4/5] [2021-11-19 21:04:56,532][INFO ][disco-notifier-worker-#9932%grid-3%][GridClusterStateProcessor] Received state change finish message: ACTIVE [21:04:56] : [Step 4/5] [2021-11-19 21:04:56,532][INFO ][disco-notifier-worker-#9932%grid-3%][GridClusterStateProcessor] Cluster state was changed from INACTIVE to ACTIVE [21:04:56] : [Step 4/5] [2021-11-19 21:04:56,531][INFO ][disco-notifier-worker-#9814%grid-0%][GridClusterStateProcessor] Cluster state was changed from INACTIVE to ACTIVE [21:04:56] : [Step 4/5] [2021-11-19 21:04:56,533][INFO ][sys-#9920%grid-3%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], err=null, rebalanced=true, wasRebalanced=false] [21:04:56] : [Step 4/5] [2021-11-19 21:04:56,533][INFO ][sys-#9925%grid-3%][GridCachePartitionExchangeManager] Delay process full message without exchange id (there is exchange in progress) [nodeId=00e326d4-0c21-42d9-93eb-188856bb0000] [21:04:56] : [Step 4/5] [2021-11-19 21:04:56,536][INFO ][db-checkpoint-thread-#9950%grid-3%][Checkpointer] Checkpoint finished [cpId=c201f3d3-e0f5-47eb-b5b7-2a3b8acab975, pages=18, markPos=WALPointer [idx=0, fileOff=86309, len=1963], walSegmentsCovered=[], markDuration=6ms, pagesWrite=20ms, fsync=20ms, total=61ms] [21:04:56] : [Step 4/5] [2021-11-19 21:04:56,539][INFO ][sys-#9920%grid-3%][GridCacheProcessor] Finish proxy initialization, cacheName=ignite-sys-cache, localNodeId=30fb8db0-e121-45b9-b689-f4f0f4589003 [21:04:56] : [Step 4/5] [2021-11-19 21:04:56,539][INFO ][sys-#9798%grid-0%][GridCacheProcessor] Finish proxy initialization, cacheName=ignite-sys-cache, localNodeId=00e326d4-0c21-42d9-93eb-188856bb0000 [21:04:56] : [Step 4/5] [2021-11-19 21:04:56,541][INFO ][sys-#9928%grid-3%][DistributedBaselineConfiguration] Baseline auto-adjust is 'disabled' with timeout='300000' ms [21:04:56] : [Step 4/5] [2021-11-19 21:04:56,542][INFO ][sys-#9810%grid-0%][DistributedBaselineConfiguration] Baseline auto-adjust is 'disabled' with timeout='300000' ms [21:04:56] : [Step 4/5] [2021-11-19 21:04:56,543][INFO ][exchange-worker-#9941%grid-3%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=2, minorTopVer=1], force=false, evt=DISCOVERY_CUSTOM_EVT, node=30fb8db0-e121-45b9-b689-f4f0f4589003] [21:04:56] : [Step 4/5] [2021-11-19 21:04:56,542][INFO ][exchange-worker-#9819%grid-0%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=2, minorTopVer=1], force=false, evt=DISCOVERY_CUSTOM_EVT, node=30fb8db0-e121-45b9-b689-f4f0f4589003] [21:04:56]W: [org.apache.ignite:ignite-core] [2021-11-19 21:04:56,548][WARN ][test-runner-#9703%encryption.EncryptedCacheNodeJoinTest%][G] Ignite work directory is not provided, automatically resolved to: /opt/buildagent/work/7bc1c54bc719b67c/work [21:04:56] : [Step 4/5] [2021-11-19 21:04:56,543][INFO ][sys-#9920%grid-3%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=30fb8db0-e121-45b9-b689-f4f0f4589003, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=30fb8db0-e121-45b9-b689-f4f0f4589003, consistentId=grid-3, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637345096526, loc=true, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:04:56] : [Step 4/5] [2021-11-19 21:04:56,543][INFO ][sys-#9928%grid-3%][GridClusterStateProcessor] Successfully performed final activation steps [nodeId=30fb8db0-e121-45b9-b689-f4f0f4589003, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:04:56] : [Step 4/5] [2021-11-19 21:04:56,543][INFO ][sys-#9810%grid-0%][GridClusterStateProcessor] Successfully performed final activation steps [nodeId=00e326d4-0c21-42d9-93eb-188856bb0000, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:04:56] : [Step 4/5] [2021-11-19 21:04:56,545][INFO ][sys-#9920%grid-3%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (1 ms), stage="Update caches registry" (14 ms), stage="Start caches" (3 ms), stage="Affinity initialization on cache group start" (0 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Restore partition states" (0 ms), stage="After states restored callback" (23 ms), stage="WAL history reservation" (0 ms), stage="Waiting for Full message" (40 ms), stage="Affinity recalculation" (1 ms), stage="Full map updating" (0 ms), stage="Detect lost partitions" (5 ms), stage="Exchange done" (7 ms), stage="Total time" (94 ms)] [21:04:56] : [Step 4/5] [2021-11-19 21:04:56,548][INFO ][sys-#9920%grid-3%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], stage="Affinity initialization on cache group start [grp=ignite-sys-cache]" (0 ms) (parent=Affinity initialization on cache group start), stage="Affinity centralized initialization (crd) [grp=ignite-sys-cache, crd=false]" (0 ms) (parent=Determine exchange type), stage="Restore partition states [grp=ignite-sys-cache]" (0 ms) (parent=Restore partition states), stage="Affinity applying from full message [grp=ignite-sys-cache]" (1 ms) (parent=Affinity recalculation)] [21:04:56] : [Step 4/5] [2021-11-19 21:04:56,551][INFO ][sys-#9798%grid-0%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=00e326d4-0c21-42d9-93eb-188856bb0000, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=30fb8db0-e121-45b9-b689-f4f0f4589003, consistentId=grid-3, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637345096372, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:04:56] : [Step 4/5] [2021-11-19 21:04:56,552][INFO ][sys-#9798%grid-0%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (1 ms), stage="Update caches registry" (20 ms), stage="Start caches" (0 ms), stage="Affinity initialization on cache group start" (0 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Restore partition states" (0 ms), stage="After states restored callback" (25 ms), stage="WAL history reservation" (0 ms), stage="Waiting for all single messages" (8 ms), stage="Affinity recalculation (crd)" (0 ms), stage="Collect update counters and create affinity messages" (0 ms), stage="Assign partitions states" (1 ms), stage="Validate partitions states" (0 ms), stage="Ideal affinity diff calculation (enforced)" (0 ms), stage="Apply update counters" (0 ms), stage="Full message preparing" (21 ms), stage="Full message sending" (0 ms), stage="State finish message sending" (1 ms), stage="Detect lost partitions" (6 ms), stage="Exchange done" (18 ms), stage="Total time" (101 ms), Discovery lag=2 ms, Latest started node id=30fb8db0-e121-45b9-b689-f4f0f4589003] [21:04:56] : [Step 4/5] [2021-11-19 21:04:56,552][INFO ][db-checkpoint-thread-#9951%grid-0%][Checkpointer] Checkpoint finished [cpId=d329a286-6163-4bbb-82ec-615f73dae86f, pages=19, markPos=WALPointer [idx=0, fileOff=90647, len=1963], walSegmentsCovered=[], markDuration=12ms, pagesWrite=23ms, fsync=25ms, total=69ms] [21:04:56] : [Step 4/5] [2021-11-19 21:04:56,555][INFO ][test-runner-#9703%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%client] [21:04:56] : [Step 4/5] [21:04:56] : [Step 4/5] >>> __________ ________________ [21:04:56] : [Step 4/5] >>> / _/ ___/ |/ / _/_ __/ __/ [21:04:56] : [Step 4/5] >>> _/ // (7 7 // / / / / _/ [21:04:56] : [Step 4/5] >>> /___/\___/_/|_/___/ /_/ /___/ [21:04:56] : [Step 4/5] >>> [21:04:56] : [Step 4/5] >>> ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:04:56] : [Step 4/5] >>> 2021 Copyright(C) Apache Software Foundation [21:04:56] : [Step 4/5] >>> [21:04:56] : [Step 4/5] >>> Ignite documentation: http://ignite.apache.org [21:04:56] : [Step 4/5] [21:04:56] : [Step 4/5] [2021-11-19 21:04:56,556][INFO ][test-runner-#9703%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%client] Config URL: n/a [21:04:56] : [Step 4/5] [2021-11-19 21:04:56,556][INFO ][test-runner-#9703%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%client] IgniteConfiguration [igniteInstanceName=client, pubPoolSize=24, svcPoolSize=24, callbackPoolSize=24, stripedPoolSize=24, sysPoolSize=24, mgmtPoolSize=4, dataStreamerPoolSize=24, utilityCachePoolSize=24, utilityCacheKeepAliveTime=60000, p2pPoolSize=2, qryPoolSize=24, buildIdxPoolSize=4, igniteHome=/opt/buildagent/work/7bc1c54bc719b67c, igniteWorkDir=/opt/buildagent/work/7bc1c54bc719b67c/work, mbeanSrv=com.sun.jmx.mbeanserver.JmxMBeanServer@6fe85038, nodeId=dfc3b2ee-e472-4af4-9379-66f665026249, marsh=BinaryMarshaller [], marshLocJobs=false, daemon=false, p2pEnabled=true, netTimeout=10000, netCompressionLevel=1, sndRetryDelay=1000, sndRetryCnt=3, metricsHistSize=10000, metricsUpdateFreq=1000, metricsExpTime=9223372036854775807, discoSpi=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=0, ackTimeout=0, marsh=null, reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], segPlc=STOP, segResolveAttempts=2, waitForSegOnStart=true, allResolversPassReq=true, segChkFreq=10000, commSpi=TcpCommunicationSpi [connectGate=org.apache.ignite.spi.communication.tcp.internal.ConnectGateway@5d6c489a, ctxInitLatch=java.util.concurrent.CountDownLatch@1e8c3062[Count = 1], stopping=false, clientPool=null, nioSrvWrapper=null, stateProvider=null], evtSpi=MemoryEventStorageSpi [expireAgeMs=9223372036854775807, expireCnt=10000, filter=null], colSpi=NoopCollisionSpi [], deploySpi=LocalDeploymentSpi [], indexingSpi=org.apache.ignite.spi.indexing.noop.NoopIndexingSpi@d9d4a66, addrRslvr=null, encryptionSpi=org.apache.ignite.spi.encryption.noop.NoopEncryptionSpi@47dba334, tracingSpi=org.apache.ignite.spi.tracing.NoopTracingSpi@5cac3579, clientMode=true, rebalanceThreadPoolSize=4, rebalanceTimeout=10000, rebalanceBatchesPrefetchCnt=3, rebalanceThrottle=0, rebalanceBatchSize=524288, txCfg=TransactionConfiguration [txSerEnabled=false, dfltIsolation=REPEATABLE_READ, dfltConcurrency=PESSIMISTIC, dfltTxTimeout=0, txTimeoutOnPartitionMapExchange=0, deadlockTimeout=10000, pessimisticTxLogSize=0, pessimisticTxLogLinger=10000, tmLookupClsName=null, txManagerFactory=null, useJtaSync=false], cacheSanityCheckEnabled=true, discoStartupDelay=60000, deployMode=SHARED, p2pMissedCacheSize=100, locHost=127.0.0.1, timeSrvPortBase=31100, timeSrvPortRange=100, failureDetectionTimeout=10000, sysWorkerBlockedTimeout=null, clientFailureDetectionTimeout=10000, metricsLogFreq=0, connectorCfg=null, odbcCfg=null, warmupClos=null, atomicCfg=AtomicConfiguration [seqReserveSize=1000, cacheMode=PARTITIONED, backups=1, aff=null, grpName=null], classLdr=null, sslCtxFactory=null, platformCfg=null, binaryCfg=null, memCfg=null, pstCfg=null, dsCfg=DataStorageConfiguration [sysRegionInitSize=41943040, sysRegionMaxSize=104857600, pageSize=4096, concLvl=0, dfltDataRegConf=DataRegionConfiguration [name=default, maxSize=10485760, initSize=268435456, swapPath=null, pageEvictionMode=DISABLED, pageReplacementMode=CLOCK, evictionThreshold=0.9, emptyPagesPoolSize=100, metricsEnabled=false, metricsSubIntervalCount=5, metricsRateTimeInterval=60000, persistenceEnabled=true, checkpointPageBufSize=0, lazyMemoryAllocation=true, warmUpCfg=null], dataRegions=null, storagePath=null, checkpointFreq=180000, lockWaitTime=10000, checkpointThreads=4, checkpointWriteOrder=SEQUENTIAL, walHistSize=20, maxWalArchiveSize=1073741824, walSegments=10, walSegmentSize=67108864, walPath=db/wal, walArchivePath=db/wal/archive, cdcWalPath=db/wal/cdc, cdcEnabled=false, metricsEnabled=false, walMode=FSYNC, walTlbSize=131072, walBuffSize=0, walFlushFreq=2000, walFsyncDelay=1000, walRecordIterBuffSize=67108864, alwaysWriteFullPages=false, fileIOFactory=org.apache.ignite.internal.processors.cache.persistence.file.AsyncFileIOFactory@1e1521d, metricsSubIntervalCnt=5, metricsRateTimeInterval=60000, walAutoArchiveAfterInactivity=-1, walForceArchiveTimeout=-1, writeThrottlingEnabled=false, walCompactionEnabled=false, walCompactionLevel=1, checkpointReadLockTimeout=null, walPageCompression=DISABLED, walPageCompressionLevel=null, dfltWarmUpCfg=null, encCfg=org.apache.ignite.configuration.EncryptionConfiguration@4592da6c, defragmentationThreadPoolSize=4, minWalArchiveSize=-1], snapshotPath=snapshots, activeOnStart=true, activeOnStartPropSetFlag=false, autoActivation=true, autoActivationPropSetFlag=false, clusterStateOnStart=null, sqlConnCfg=null, cliConnCfg=ClientConnectorConfiguration [host=null, port=10800, portRange=100, sockSndBufSize=0, sockRcvBufSize=0, tcpNoDelay=true, maxOpenCursorsPerConn=128, threadPoolSize=24, selectorCnt=12, idleTimeout=0, handshakeTimeout=10000, jdbcEnabled=true, odbcEnabled=true, thinCliEnabled=true, sslEnabled=false, useIgniteSslCtxFactory=true, sslClientAuth=false, sslCtxFactory=null, thinCliCfg=ThinClientConfiguration [maxActiveTxPerConn=100, maxActiveComputeTasksPerConn=0]], mvccVacuumThreadCnt=2, mvccVacuumFreq=5000, authEnabled=false, failureHnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]], commFailureRslvr=null, sqlCfg=SqlConfiguration [longQryWarnTimeout=3000, dfltQryTimeout=0, sqlQryHistSize=1000, validationEnabled=false], asyncContinuationExecutor=null] [21:04:56] : [Step 4/5] [2021-11-19 21:04:56,554][INFO ][sys-#9798%grid-0%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], stage="Affinity initialization on cache group start [grp=ignite-sys-cache]" (0 ms) (parent=Affinity initialization on cache group start), stage="Affinity centralized initialization (crd) [grp=ignite-sys-cache, crd=true]" (0 ms) (parent=Determine exchange type), stage="Restore partition states [grp=ignite-sys-cache]" (0 ms) (parent=Restore partition states), stage="Affinity recalculation (partitions availability) [grp=ignite-sys-cache]" (0 ms) (parent=Ideal affinity diff calculation (enforced))] [21:04:56] : [Step 4/5] [2021-11-19 21:04:56,566][INFO ][test-runner-#9703%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%client] Daemon mode: off [21:04:56] : [Step 4/5] [2021-11-19 21:04:56,568][INFO ][test-runner-#9703%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%client] OS: Linux 4.15.0-151-generic amd64 [21:04:56] : [Step 4/5] [2021-11-19 21:04:56,568][INFO ][test-runner-#9703%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%client] OS user: teamcity [21:04:56] : [Step 4/5] [2021-11-19 21:04:56,569][INFO ][test-runner-#9703%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%client] PID: 16724 [21:04:56] : [Step 4/5] [2021-11-19 21:04:56,569][INFO ][test-runner-#9703%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%client] Language runtime: Java Platform API Specification ver. 1.8 [21:04:56] : [Step 4/5] [2021-11-19 21:04:56,569][INFO ][test-runner-#9703%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%client] VM information: Java(TM) SE Runtime Environment 1.8.0_261-b12 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 25.261-b12 [21:04:56] : [Step 4/5] [2021-11-19 21:04:56,570][INFO ][test-runner-#9703%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%client] VM total memory: 1.9GB [21:04:56] : [Step 4/5] [2021-11-19 21:04:56,570][INFO ][test-runner-#9703%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%client] Remote Management [restart: off, REST: off, JMX (remote: off)] [21:04:56] : [Step 4/5] [2021-11-19 21:04:56,570][INFO ][test-runner-#9703%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%client] Logger: GridTestLog4jLogger [quiet=false, config=null] [21:04:56] : [Step 4/5] [2021-11-19 21:04:56,571][INFO ][test-runner-#9703%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%client] IGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c [21:04:56] : [Step 4/5] [2021-11-19 21:04:56,571][INFO ][test-runner-#9703%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%client] VM arguments: [-DIGNITE_DUMP_THREADS_ON_FAILURE=false, -DMono=/usr/bin/mono-sgen, -DMono4.0_x64=/usr/lib/mono/4.0, -DMono4.5_x64=/usr/lib/mono/4.5, -DMonoVersion=6.12.0.90, -DSKIP_BUILD=false, -Dagent.home.dir=/opt/buildagent, -Dagent.name=aitc-lin02_03, -Dagent.ownPort=9090, -Dagent.work.dir=/opt/buildagent/work, -Dbuild.number=95, -Dbuild.vcs.number=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.1=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.GitHubApacheIgnite=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dclassworlds.conf=/opt/buildagent/temp/buildTmp/teamcity.m2.conf, -Dcom.jetbrains.maven.watcher.report.file=/opt/buildagent/temp/buildTmp/maven-build-info.xml, -Djava.io.tmpdir=/opt/buildagent/temp/buildTmp, -Dmaven.home=/opt/buildagent/tools/maven3_6, -Dmaven.multiModuleProjectDirectory=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.agent.cpuBenchmark=457, -Dteamcity.agent.dotnet.agent_url=http://localhost:9090/RPC2, -Dteamcity.agent.dotnet.build_id=6278078, -Dteamcity.auth.password=*******, -Dteamcity.auth.userId=TeamCityBuildId=6278078, -Dteamcity.build.changedFiles.file=/opt/buildagent/temp/buildTmp/changedFiles6342607772318147725.txt, -Dteamcity.build.checkoutDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.build.id=6278078, -Dteamcity.build.properties.file=/opt/buildagent/temp/buildTmp/teamcity.build5164517880467851002.properties, -Dteamcity.build.tempDir=/opt/buildagent/temp/buildTmp, -Dteamcity.build.workingDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.buildConfName=Basic 3, -Dteamcity.buildType.id=IgniteTests24Java8_Basic3, -Dteamcity.configuration.properties.file=/opt/buildagent/temp/buildTmp/teamcity.config5591980786735343870.properties, -Dteamcity.maven.userSettings.path=/opt/buildagent/temp/buildTmp/maven_settings_585072866407032347.xml, -Dteamcity.maven.watcher.home=/opt/buildagent/plugins/mavenPlugin/maven-watcher-jdk16, -Dteamcity.projectName=Ignite Tests 2.x (JDK 8/11), -Dteamcity.runner.properties.file=/opt/buildagent/temp/buildTmp/teamcity.runner9098465561618137420.properties, -Dteamcity.tests.recentlyFailedTests.file=/opt/buildagent/temp/buildTmp/testsToRunFirst3891775683130404069.txt, -Dteamcity.version=2021.2 (build 99542), -ea, -Xms2g, -Xmx2g, -XX:+HeapDumpOnOutOfMemoryError, -DIGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_TEST_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_UPDATE_NOTIFIER=false, -DIGNITE_NO_DISCO_ORDER=true, -DIGNITE_PERFORMANCE_SUGGESTIONS_DISABLED=true, -Djava.net.preferIPv4Stack=true, -DTEST_SCALE_FACTOR=1.0, -DIGNITE_TEST_PROP_LOG4J_FILE=log4j-tc-test.xml, -DIGNITE_QUIET=false, -DIGNITE_MARSHAL_BUFFERS_RECHECK=1000, -Dmaven.repo.local=/opt/buildagent/.m2/repository] [21:04:56] : [Step 4/5] [2021-11-19 21:04:56,576][INFO ][test-runner-#9703%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%client] System cache's DataRegion size is configured to 40 MB. Use DataStorageConfiguration.systemRegionInitialSize property to change the setting. [21:04:56] : [Step 4/5] [2021-11-19 21:04:56,577][INFO ][test-runner-#9703%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%client] Configured caches [in 'sysMemPlc' dataRegion: ['ignite-sys-cache']] [21:04:56]W: [org.apache.ignite:ignite-core] [2021-11-19 21:04:56,577][WARN ][test-runner-#9703%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%client] Peer class loading is enabled (disable it in production for performance and deployment consistency reasons) [21:04:56] : [Step 4/5] [2021-11-19 21:04:56,578][INFO ][test-runner-#9703%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%client] 3-rd party licenses can be found at: /opt/buildagent/work/7bc1c54bc719b67c/libs/licenses [21:04:56] : [Step 4/5] [2021-11-19 21:04:56,584][INFO ][test-runner-#9703%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] Configured plugins: [21:04:56] : [Step 4/5] [2021-11-19 21:04:56,584][INFO ][test-runner-#9703%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- StanByClusterTestProvider 1.0 [21:04:56] : [Step 4/5] [2021-11-19 21:04:56,584][INFO ][test-runner-#9703%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- null [21:04:56] : [Step 4/5] [2021-11-19 21:04:56,585][INFO ][test-runner-#9703%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] [21:04:56] : [Step 4/5] [2021-11-19 21:04:56,585][INFO ][test-runner-#9703%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- PageMemory tracker plugin 1.0 [21:04:56] : [Step 4/5] [2021-11-19 21:04:56,585][INFO ][test-runner-#9703%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- null [21:04:56] : [Step 4/5] [2021-11-19 21:04:56,585][INFO ][test-runner-#9703%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] [21:04:56] : [Step 4/5] [2021-11-19 21:04:56,585][INFO ][test-runner-#9703%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- TestDistibutedConfigurationPlugin 1.0 [21:04:56] : [Step 4/5] [2021-11-19 21:04:56,586][INFO ][test-runner-#9703%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- null [21:04:56] : [Step 4/5] [2021-11-19 21:04:56,586][INFO ][test-runner-#9703%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] [21:04:56] : [Step 4/5] [2021-11-19 21:04:56,586][INFO ][test-runner-#9703%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- NodeValidationPluginProvider 1.0 [21:04:56] : [Step 4/5] [2021-11-19 21:04:56,586][INFO ][test-runner-#9703%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- null [21:04:56] : [Step 4/5] [2021-11-19 21:04:56,586][INFO ][test-runner-#9703%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] [21:04:56] : [Step 4/5] [2021-11-19 21:04:56,587][INFO ][test-runner-#9703%encryption.EncryptedCacheNodeJoinTest%][FailureProcessor] Configured failure handler: [hnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]]] [21:04:56] : [Step 4/5] [2021-11-19 21:04:56,629][INFO ][test-runner-#9703%encryption.EncryptedCacheNodeJoinTest%][TcpCommunicationSpi] Successfully bound communication NIO server to TCP port [port=45152, locHost=/127.0.0.1, selectorsCnt=12, selectorSpins=0, pairedConn=false] [21:04:56]W: [org.apache.ignite:ignite-core] [2021-11-19 21:04:56,630][WARN ][test-runner-#9703%encryption.EncryptedCacheNodeJoinTest%][TcpCommunicationSpi] Message queue limit is set to 0 which may lead to potential OOMEs when running cache operations in FULL_ASYNC or PRIMARY_SYNC modes due to message queues growth on sender and receiver sides. [21:04:56] : [Step 4/5] [2021-11-19 21:04:56,648][INFO ][test-runner-#9703%encryption.EncryptedCacheNodeJoinTest%][GridCollisionManager] Collision resolution is disabled (all jobs will be activated upon arrival). [21:04:56] : [Step 4/5] [2021-11-19 21:04:56,648][INFO ][test-runner-#9703%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%client] Security status [authentication=off, sandbox=off, tls/ssl=off] [21:04:56]W: [org.apache.ignite:ignite-core] [2021-11-19 21:04:56,654][WARN ][test-runner-#9703%encryption.EncryptedCacheNodeJoinTest%][GridCacheProcessor] Persistent Store is not supported on client nodes (Persistent Store's configuration will be ignored). [21:04:56] : [Step 4/5] [2021-11-19 21:04:56,662][INFO ][test-runner-#9703%encryption.EncryptedCacheNodeJoinTest%][IgniteCacheDatabaseSharedManager] Configured data regions initialized successfully [total=4] [21:04:56] : [Step 4/5] [2021-11-19 21:04:56,666][INFO ][test-runner-#9703%encryption.EncryptedCacheNodeJoinTest%][ClientListenerProcessor] Client connector processor has started on TCP port 10802 [21:04:56] : [Step 4/5] [2021-11-19 21:04:56,671][INFO ][test-runner-#9703%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%client] Non-loopback local IPs: 172.17.0.4 [21:04:56] : [Step 4/5] [2021-11-19 21:04:56,671][INFO ][test-runner-#9703%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%client] Enabled local MACs: 0242AC110004 [21:04:56] : [Step 4/5] [2021-11-19 21:04:56,672][INFO ][test-runner-#9703%encryption.EncryptedCacheNodeJoinTest%][ClusterProcessor] Cluster ID and tag has been read from metastorage: null [21:04:56] : [Step 4/5] [2021-11-19 21:04:56,672][INFO ][test-runner-#9703%encryption.EncryptedCacheNodeJoinTest%][IgniteClusterImpl] Shutdown policy was updated [oldVal=null, newVal=null] [21:04:56] : [Step 4/5] [2021-11-19 21:04:56,676][INFO ][tcp-disco-srvr-[:47501]-#513%grid-3%-#9934%grid-3%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=38011] [21:04:56] : [Step 4/5] [2021-11-19 21:04:56,676][INFO ][tcp-disco-srvr-[:47501]-#513%grid-3%-#9934%grid-3%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=38011] [21:04:56] : [Step 4/5] [2021-11-19 21:04:56,677][INFO ][tcp-disco-sock-reader-[]-#524%grid-3%-#10057%grid-3%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:38011, rmtPort=38011] [21:04:56] : [Step 4/5] [2021-11-19 21:04:56,679][INFO ][tcp-disco-sock-reader-[dfc3b2ee 127.0.0.1:38011 client]-#524%grid-3%-#10057%grid-3%][TestTcpDiscoverySpi] Initialized connection with remote client node [nodeId=dfc3b2ee-e472-4af4-9379-66f665026249, rmtAddr=/127.0.0.1:38011] [21:04:56] : [Step 4/5] [2021-11-19 21:04:56,696][INFO ][disco-event-worker-#9818%grid-0%][GridDiscoveryManager] Added new node to topology: TcpDiscoveryNode [id=dfc3b2ee-e472-4af4-9379-66f665026249, consistentId=client, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:0], discPort=0, order=3, intOrder=3, lastExchangeTime=1637345096677, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=true] [21:04:56] : [Step 4/5] [2021-11-19 21:04:56,697][INFO ][disco-event-worker-#9940%grid-3%][GridDiscoveryManager] Added new node to topology: TcpDiscoveryNode [id=dfc3b2ee-e472-4af4-9379-66f665026249, consistentId=client, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:0], discPort=0, order=3, intOrder=3, lastExchangeTime=1637345096687, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=true] [21:04:56] : [Step 4/5] [2021-11-19 21:04:56,698][INFO ][disco-event-worker-#9818%grid-0%][GridDiscoveryManager] Topology snapshot [ver=3, locNode=00e326d4, servers=2, clients=1, state=ACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=00e326d4-0c21-42d9-93eb-188856bb0000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=30fb8db0-e121-45b9-b689-f4f0f4589003, consistentId=grid-3, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=dfc3b2ee-e472-4af4-9379-66f665026249, consistentId=client, isClient=true, ver=2.13.0#20211119-sha1:00000000]]] [21:04:56] : [Step 4/5] [2021-11-19 21:04:56,700][INFO ][tcp-client-disco-msg-worker-#523%client%-#10055%client%][TestTcpDiscoverySpi] Router node: TcpDiscoveryNode [id=30fb8db0-e121-45b9-b689-f4f0f4589003, consistentId=grid-3, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637345096697, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false] [21:04:56] : [Step 4/5] [2021-11-19 21:04:56,699][INFO ][disco-event-worker-#9940%grid-3%][GridDiscoveryManager] Topology snapshot [ver=3, locNode=30fb8db0, servers=2, clients=1, state=ACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=00e326d4-0c21-42d9-93eb-188856bb0000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=30fb8db0-e121-45b9-b689-f4f0f4589003, consistentId=grid-3, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=dfc3b2ee-e472-4af4-9379-66f665026249, consistentId=client, isClient=true, ver=2.13.0#20211119-sha1:00000000]]] [21:04:56] : [Step 4/5] [2021-11-19 21:04:56,700][INFO ][disco-event-worker-#9818%grid-0%][GridDiscoveryManager] ^-- Baseline [id=0, size=2, online=2, offline=0] [21:04:56] : [Step 4/5] [2021-11-19 21:04:56,702][INFO ][disco-event-worker-#9940%grid-3%][GridDiscoveryManager] ^-- Baseline [id=0, size=2, online=2, offline=0] [21:04:56] : [Step 4/5] [2021-11-19 21:04:56,702][INFO ][exchange-worker-#9819%grid-0%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], crd=true, evt=NODE_JOINED, evtNode=dfc3b2ee-e472-4af4-9379-66f665026249, customEvt=null, allowMerge=true, exchangeFreeSwitch=false] [21:04:56] : [Step 4/5] [2021-11-19 21:04:56,703][INFO ][exchange-worker-#9941%grid-3%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], crd=false, evt=NODE_JOINED, evtNode=dfc3b2ee-e472-4af4-9379-66f665026249, customEvt=null, allowMerge=true, exchangeFreeSwitch=false] [21:04:56] : [Step 4/5] [2021-11-19 21:04:56,704][INFO ][exchange-worker-#9819%grid-0%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], err=null, rebalanced=true, wasRebalanced=true] [21:04:56] : [Step 4/5] [2021-11-19 21:04:56,704][INFO ][exchange-worker-#9941%grid-3%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], err=null, rebalanced=true, wasRebalanced=true] [21:04:56] : [Step 4/5] [2021-11-19 21:04:56,705][INFO ][exchange-worker-#9819%grid-0%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=00e326d4-0c21-42d9-93eb-188856bb0000, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], evt=NODE_JOINED, evtNode=TcpDiscoveryNode [id=dfc3b2ee-e472-4af4-9379-66f665026249, consistentId=client, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:0], discPort=0, order=3, intOrder=3, lastExchangeTime=1637345096677, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=true], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0]] [21:04:56] : [Step 4/5] [2021-11-19 21:04:56,705][INFO ][exchange-worker-#9941%grid-3%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=30fb8db0-e121-45b9-b689-f4f0f4589003, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], evt=NODE_JOINED, evtNode=TcpDiscoveryNode [id=dfc3b2ee-e472-4af4-9379-66f665026249, consistentId=client, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:0], discPort=0, order=3, intOrder=3, lastExchangeTime=1637345096687, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=true], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0]] [21:04:56] : [Step 4/5] [2021-11-19 21:04:56,705][INFO ][tcp-client-disco-msg-worker-#523%client%-#10055%client%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustEnabled' was changed from 'null' to 'false' [21:04:56] : [Step 4/5] [2021-11-19 21:04:56,708][INFO ][exchange-worker-#9941%grid-3%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (0 ms), stage="Determine exchange type" (0 ms), stage="Exchange done" (3 ms), stage="Total time" (3 ms)] [21:04:56] : [Step 4/5] [2021-11-19 21:04:56,706][INFO ][exchange-worker-#9819%grid-0%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (0 ms), stage="Determine exchange type" (0 ms), stage="Exchange done" (2 ms), stage="Total time" (2 ms)] [21:04:56] : [Step 4/5] [2021-11-19 21:04:56,709][INFO ][exchange-worker-#9941%grid-3%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=0]] [21:04:56] : [Step 4/5] [2021-11-19 21:04:56,708][INFO ][tcp-client-disco-msg-worker-#523%client%-#10055%client%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustTimeout' was changed from 'null' to '300000' [21:04:56] : [Step 4/5] [2021-11-19 21:04:56,710][INFO ][exchange-worker-#9941%grid-3%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], crd=false] [21:04:56] : [Step 4/5] [2021-11-19 21:04:56,710][INFO ][exchange-worker-#9819%grid-0%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=0]] [21:04:56] : [Step 4/5] [2021-11-19 21:04:56,711][INFO ][exchange-worker-#9941%grid-3%][GridCachePartitionExchangeManager] AffinityTopologyVersion [topVer=3, minorTopVer=0], evt=NODE_JOINED, evtNode=dfc3b2ee-e472-4af4-9379-66f665026249, client=false] [21:04:56] : [Step 4/5] [2021-11-19 21:04:56,710][INFO ][tcp-client-disco-msg-worker-#523%client%-#10055%client%][IgniteTxManager] Transactions parameter 'collisionsDumpInterval' was changed from 'null' to '1000' [21:04:56] : [Step 4/5] [2021-11-19 21:04:56,711][INFO ][exchange-worker-#9819%grid-0%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], crd=true] [21:04:56] : [Step 4/5] [2021-11-19 21:04:56,712][INFO ][tcp-client-disco-msg-worker-#523%client%-#10055%client%][IgniteTxManager] Transactions parameter 'longOperationsDumpTimeout' was changed from 'null' to '60000' [21:04:56] : [Step 4/5] [2021-11-19 21:04:56,712][INFO ][exchange-worker-#9819%grid-0%][GridCachePartitionExchangeManager] AffinityTopologyVersion [topVer=3, minorTopVer=0], evt=NODE_JOINED, evtNode=dfc3b2ee-e472-4af4-9379-66f665026249, client=false] [21:04:56] : [Step 4/5] [2021-11-19 21:04:56,713][INFO ][tcp-client-disco-msg-worker-#523%client%-#10055%client%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpSamplesPerSecondLimit' was changed from 'null' to '5' [21:04:56] : [Step 4/5] [2021-11-19 21:04:56,714][INFO ][tcp-client-disco-msg-worker-#523%client%-#10055%client%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpThreshold' was changed from 'null' to '0' [21:04:56] : [Step 4/5] [2021-11-19 21:04:56,714][INFO ][tcp-client-disco-msg-worker-#523%client%-#10055%client%][IgniteTxManager] Transactions parameter 'transactionTimeDumpSamplesCoefficient' was changed from 'null' to '0.0' [21:04:56] : [Step 4/5] [2021-11-19 21:04:56,715][INFO ][tcp-client-disco-msg-worker-#523%client%-#10055%client%][IgniteTxManager] Transactions parameter 'txOwnerDumpRequestsAllowed' was changed from 'null' to 'true' [21:04:56] : [Step 4/5] [2021-11-19 21:04:56,715][INFO ][tcp-client-disco-msg-worker-#523%client%-#10055%client%][ClusterProcessor] dreamy_ptolemy [21:04:56] : [Step 4/5] [2021-11-19 21:04:56,716][INFO ][disco-notifier-worker-#10052%client%][MvccProcessorImpl] Assigned mvcc coordinator [crd=MvccCoordinator [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], nodeId=00e326d4-0c21-42d9-93eb-188856bb0000, ver=1637345095092, local=false, initialized=false]] [21:04:56] : [Step 4/5] [2021-11-19 21:04:56,718][INFO ][sys-#10059%client%][ClusterProcessor] Writing cluster ID and tag to metastorage on ready for write ClusterIdAndTag [id=ac4111d9-98be-49e7-9f31-36e08b4997ca, tag=dreamy_ptolemy] [21:04:56] : [Step 4/5] [2021-11-19 21:04:56,738][INFO ][exchange-worker-#10061%client%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], crd=false, evt=NODE_JOINED, evtNode=dfc3b2ee-e472-4af4-9379-66f665026249, customEvt=null, allowMerge=true, exchangeFreeSwitch=false] [21:04:56] : [Step 4/5] [2021-11-19 21:04:56,740][INFO ][exchange-worker-#10061%client%][IgniteCacheDatabaseSharedManager] Data Regions Started: 4 [21:04:56] : [Step 4/5] [2021-11-19 21:04:56,740][INFO ][exchange-worker-#10061%client%][IgniteCacheDatabaseSharedManager] ^-- sysMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:04:56] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB, allocTotal=0MB] [21:04:56] : [Step 4/5] ^-- default region [type=default, persistence=true, lazyAlloc=true, [21:04:56] : [Step 4/5] ... initCfg=10MB, maxCfg=10MB, usedRam=0MB, freeRam=100%, allocRam=0MB, allocTotal=0MB] [21:04:56] : [Step 4/5] ^-- TxLog region [type=internal, persistence=true, lazyAlloc=false, [21:04:56] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB, allocTotal=0MB] [21:04:56] : [Step 4/5] ^-- volatileDsMemPlc region [type=user, persistence=false, lazyAlloc=true, [21:04:56] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB] [21:04:56] : [Step 4/5] ^-- Ignite persistence [used=0MB] [21:04:56] : [Step 4/5] [21:04:56] : [Step 4/5] [2021-11-19 21:04:56,741][INFO ][exchange-worker-#10061%client%][msg] Components activation performed in 2 ms. [21:04:56] : [Step 4/5] [2021-11-19 21:04:56,743][INFO ][exchange-worker-#10061%client%][GridCacheProcessor] Started cache [name=ignite-sys-cache, id=-2100569601, dataRegionName=sysMemPlc, mode=REPLICATED, atomicity=TRANSACTIONAL, backups=2147483647, mvcc=false] [21:04:56] : [Step 4/5] [2021-11-19 21:04:56,744][INFO ][exchange-worker-#10061%client%][GridCacheProcessor] Starting caches on local join performed in 0 ms. [21:04:56] : [Step 4/5] [2021-11-19 21:04:56,748][INFO ][grid-nio-worker-tcp-comm-1-#9759%TcpCommunicationSpi%][TcpCommunicationSpi] Accepted incoming communication connection [locAddr=/127.0.0.1:45150, rmtAddr=/127.0.0.1:59604] [21:04:56] : [Step 4/5] [2021-11-19 21:04:56,753][INFO ][grid-nio-worker-tcp-comm-0-#10023%TcpCommunicationSpi%][TcpCommunicationSpi] Established outgoing communication connection [locAddr=/127.0.0.1:59604, rmtAddr=/127.0.0.1:45150] [21:04:56] : [Step 4/5] [2021-11-19 21:04:56,754][INFO ][exchange-worker-#10061%client%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], crd=false] [21:04:56] : [Step 4/5] [2021-11-19 21:04:56,761][INFO ][sys-#9813%grid-0%][GridCachePartitionExchangeManager] Fast replied to single message [exchId=GridDhtPartitionExchangeId [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], discoEvt=null, nodeId=dfc3b2ee, evt=NODE_JOINED], nodeId=dfc3b2ee-e472-4af4-9379-66f665026249] [21:04:56] : [Step 4/5] [2021-11-19 21:04:56,776][INFO ][sys-#10064%client%][GridDhtPartitionsExchangeFuture] Received full message, will finish exchange [node=00e326d4-0c21-42d9-93eb-188856bb0000, resVer=AffinityTopologyVersion [topVer=3, minorTopVer=0]] [21:04:56] : [Step 4/5] [2021-11-19 21:04:56,780][INFO ][sys-#10064%client%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], err=null, rebalanced=true, wasRebalanced=false] [21:04:56] : [Step 4/5] [2021-11-19 21:04:56,781][INFO ][sys-#10064%client%][GridCacheProcessor] Finish proxy initialization, cacheName=ignite-sys-cache, localNodeId=dfc3b2ee-e472-4af4-9379-66f665026249 [21:04:56] : [Step 4/5] [2021-11-19 21:04:56,781][INFO ][exchange-worker-#10061%client%][GridCachePartitionExchangeManager] AffinityTopologyVersion [topVer=3, minorTopVer=0], evt=NODE_JOINED, evtNode=dfc3b2ee-e472-4af4-9379-66f665026249, client=true] [21:04:56] : [Step 4/5] [2021-11-19 21:04:56,781][INFO ][sys-#10064%client%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=dfc3b2ee-e472-4af4-9379-66f665026249, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], evt=NODE_JOINED, evtNode=TcpDiscoveryNode [id=dfc3b2ee-e472-4af4-9379-66f665026249, consistentId=client, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:0], discPort=0, order=3, intOrder=0, lastExchangeTime=1637345096667, loc=true, ver=2.13.0#20211119-sha1:00000000, isClient=true], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0]] [21:04:56] : [Step 4/5] [2021-11-19 21:04:56,783][INFO ][sys-#10064%client%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], stage="Waiting in exchange queue" (21 ms), stage="Exchange parameters initialization" (0 ms), stage="Components activation" (2 ms), stage="Determine exchange type" (5 ms), stage="Waiting for Full message" (28 ms), stage="Affinity recalculation" (2 ms), stage="Full map updating" (1 ms), stage="Exchange done" (3 ms), stage="Total time" (62 ms)] [21:04:56] : [Step 4/5] [2021-11-19 21:04:56,784][INFO ][sys-#10064%client%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], stage="Affinity initialization (local join) [grp=ignite-sys-cache]" (2 ms) (parent=Affinity recalculation)] [21:04:56] : [Step 4/5] [2021-11-19 21:04:56,798][INFO ][test-runner-#9703%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%client] To start Console Management & Monitoring run ignitevisorcmd.{sh|bat} [21:04:56] : [Step 4/5] [2021-11-19 21:04:56,799][INFO ][test-runner-#9703%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%client] [21:04:56] : [Step 4/5] [21:04:56] : [Step 4/5] >>> +-------------------------------------------+ [21:04:56] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:04:56] : [Step 4/5] >>> +-------------------------------------------+ [21:04:56] : [Step 4/5] >>> OS name: Linux 4.15.0-151-generic amd64 [21:04:56] : [Step 4/5] >>> CPU(s): 24 [21:04:56] : [Step 4/5] >>> Heap: 2.0GB [21:04:56] : [Step 4/5] >>> VM name: 16724@c4dfe9a430b2 [21:04:56] : [Step 4/5] >>> Ignite instance name: client [21:04:56] : [Step 4/5] >>> Local node [ID=DFC3B2EE-E472-4AF4-9379-66F665026249, order=3, clientMode=true] [21:04:56] : [Step 4/5] >>> Local node addresses: [127.0.0.1] [21:04:56] : [Step 4/5] >>> Local ports: TCP:10802 TCP:45152 [21:04:56] : [Step 4/5] [21:04:56] : [Step 4/5] [2021-11-19 21:04:56,801][INFO ][test-runner-#9703%encryption.EncryptedCacheNodeJoinTest%][GridDiscoveryManager] Topology snapshot [ver=3, locNode=dfc3b2ee, servers=2, clients=1, state=ACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=dfc3b2ee-e472-4af4-9379-66f665026249, consistentId=client, isClient=true, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=00e326d4-0c21-42d9-93eb-188856bb0000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=30fb8db0-e121-45b9-b689-f4f0f4589003, consistentId=grid-3, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:04:56] : [Step 4/5] [2021-11-19 21:04:56,802][INFO ][test-runner-#9703%encryption.EncryptedCacheNodeJoinTest%][GridDiscoveryManager] ^-- Baseline [id=0, size=2, online=2, offline=0] [21:04:56] : [Step 4/5] [2021-11-19 21:04:56,802][INFO ][test-runner-#9703%encryption.EncryptedCacheNodeJoinTest%][G] Node started : [stage="Configure system pool" (0 ms),stage="Start managers" (100 ms),stage="Configure binary metadata" (2 ms),stage="Start processors" (18 ms),stage="Start 'StanByClusterTestProvider' plugin" (0 ms),stage="Start 'PageMemory tracker plugin' plugin" (0 ms),stage="Start 'TestDistibutedConfigurationPlugin' plugin" (0 ms),stage="Start 'NodeValidationPluginProvider' plugin" (0 ms),stage="Init metastore" (2 ms),stage="Finish recovery" (0 ms),stage="Join topology" (47 ms),stage="Await transition" (2 ms),stage="Await exchange" (79 ms),stage="Total time" (250 ms)] [21:04:56] : [Step 4/5] [2021-11-19 21:04:56,804][INFO ][test-runner-#9703%encryption.EncryptedCacheNodeJoinTest%][root] Node started with the following configuration [id=dfc3b2ee-e472-4af4-9379-66f665026249, marshaller=BinaryMarshaller [], discovery=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=5000, ackTimeout=5000, marsh=JdkMarshaller [clsFilter=org.apache.ignite.marshaller.MarshallerUtils$1@7457df0a], reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], binaryCfg=null, lateAff=true] [21:04:56] : [Step 4/5] [2021-11-19 21:04:56,808][INFO ][grid-nio-worker-tcp-comm-1-#9877%TcpCommunicationSpi%][TcpCommunicationSpi] Accepted incoming communication connection [locAddr=/127.0.0.1:45151, rmtAddr=/127.0.0.1:32836] [21:04:56] : [Step 4/5] [2021-11-19 21:04:56,817][INFO ][grid-nio-worker-tcp-comm-1-#10024%TcpCommunicationSpi%][TcpCommunicationSpi] Established outgoing communication connection [locAddr=/127.0.0.1:32836, rmtAddr=/127.0.0.1:45151] [21:04:56] : [Step 4/5] [2021-11-19 21:04:56,833][INFO ][exchange-worker-#10061%client%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], crd=false, evt=DISCOVERY_CUSTOM_EVT, evtNode=dfc3b2ee-e472-4af4-9379-66f665026249, customEvt=DynamicCacheChangeBatch [id=43e2d593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqs=ArrayList [DynamicCacheChangeRequest [cacheName=encrypted, hasCfg=true, nodeId=dfc3b2ee-e472-4af4-9379-66f665026249, clientStartOnly=false, stop=false, destroy=false, disabledAfterStart=false]], exchangeActions=ExchangeActions [startCaches=[encrypted], stopCaches=null, startGrps=[encrypted], stopGrps=[], resetParts=null, stateChangeRequest=null], startCaches=false], allowMerge=false, exchangeFreeSwitch=false] [21:04:56] : [Step 4/5] [2021-11-19 21:04:56,839][INFO ][exchange-worker-#10061%client%][GridCacheProcessor] Started cache [name=encrypted, id=1613773252, dataRegionName=default, mode=PARTITIONED, atomicity=ATOMIC, backups=0, mvcc=false] [21:04:56] : [Step 4/5] [2021-11-19 21:04:56,847][INFO ][exchange-worker-#10061%client%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], crd=false] [21:04:57] : [Step 4/5] [2021-11-19 21:04:57,534][INFO ][exchange-worker-#9819%grid-0%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], crd=true, evt=DISCOVERY_CUSTOM_EVT, evtNode=dfc3b2ee-e472-4af4-9379-66f665026249, customEvt=DynamicCacheChangeBatch [id=43e2d593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqs=ArrayList [DynamicCacheChangeRequest [cacheName=encrypted, hasCfg=true, nodeId=dfc3b2ee-e472-4af4-9379-66f665026249, clientStartOnly=false, stop=false, destroy=false, disabledAfterStart=false]], exchangeActions=ExchangeActions [startCaches=[encrypted], stopCaches=null, startGrps=[encrypted], stopGrps=[], resetParts=null, stateChangeRequest=null], startCaches=false], allowMerge=false, exchangeFreeSwitch=false] [21:04:57] : [Step 4/5] [2021-11-19 21:04:57,535][INFO ][exchange-worker-#9941%grid-3%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], crd=false, evt=DISCOVERY_CUSTOM_EVT, evtNode=dfc3b2ee-e472-4af4-9379-66f665026249, customEvt=DynamicCacheChangeBatch [id=43e2d593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqs=ArrayList [DynamicCacheChangeRequest [cacheName=encrypted, hasCfg=true, nodeId=dfc3b2ee-e472-4af4-9379-66f665026249, clientStartOnly=false, stop=false, destroy=false, disabledAfterStart=false]], exchangeActions=ExchangeActions [startCaches=[encrypted], stopCaches=null, startGrps=[encrypted], stopGrps=[], resetParts=null, stateChangeRequest=null], startCaches=false], allowMerge=false, exchangeFreeSwitch=false] [21:04:57] : [Step 4/5] [2021-11-19 21:04:57,536][INFO ][exchange-worker-#9819%grid-0%][PageMemoryImpl] Started page memory [memoryAllocated=24.0 MiB, pages=5952, tableSize=474.2 KiB, replacementSize=768 B, checkpointBuffer=10.0 MiB] [21:04:57] : [Step 4/5] [2021-11-19 21:04:57,538][INFO ][exchange-worker-#9941%grid-3%][PageMemoryImpl] Started page memory [memoryAllocated=24.0 MiB, pages=5952, tableSize=474.2 KiB, replacementSize=768 B, checkpointBuffer=10.0 MiB] [21:04:57] : [Step 4/5] [2021-11-19 21:04:57,797][INFO ][exchange-worker-#9819%grid-0%][GridCacheProcessor] Started cache [name=encrypted, id=1613773252, dataRegionName=default, mode=PARTITIONED, atomicity=ATOMIC, backups=0, mvcc=false] [21:04:57]W: [org.apache.ignite:ignite-core] [2021-11-19 21:04:57,799][WARN ][exchange-worker-#9819%grid-0%][CacheAffinitySharedManager] Cache group 'encrypted' brings high overhead for its metainformation in data region 'default'. Metainformation required for its partitions (528 partitions, 4096 bytes per partition, 2 MBs total) will consume more than 15% of data region memory (10 MBs). It may lead to critical errors on the node and cluster instability. Please reduce number of partitions, add more memory to the data region or add more server nodes for this cache group. [21:04:57] : [Step 4/5] [2021-11-19 21:04:57,801][INFO ][exchange-worker-#9819%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], waitTime=0ms, futInfo=NA, mode=DISTRIBUTED] [21:04:57] : [Step 4/5] [2021-11-19 21:04:57,827][INFO ][exchange-worker-#9941%grid-3%][GridCacheProcessor] Started cache [name=encrypted, id=1613773252, dataRegionName=default, mode=PARTITIONED, atomicity=ATOMIC, backups=0, mvcc=false] [21:04:57]W: [org.apache.ignite:ignite-core] [2021-11-19 21:04:57,829][WARN ][exchange-worker-#9941%grid-3%][CacheAffinitySharedManager] Cache group 'encrypted' brings high overhead for its metainformation in data region 'default'. Metainformation required for its partitions (496 partitions, 4096 bytes per partition, 1 MBs total) will consume more than 15% of data region memory (10 MBs). It may lead to critical errors on the node and cluster instability. Please reduce number of partitions, add more memory to the data region or add more server nodes for this cache group. [21:04:57] : [Step 4/5] [2021-11-19 21:04:57,830][INFO ][exchange-worker-#9941%grid-3%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], waitTime=0ms, futInfo=NA, mode=DISTRIBUTED] [21:04:57] : [Step 4/5] [2021-11-19 21:04:57,831][INFO ][exchange-worker-#9819%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partitions release latch: ServerLatch [permits=0, pendingAcks=HashSet [], super=CompletableLatch [id=CompletableLatchUid [id=exchange, topVer=AffinityTopologyVersion [topVer=3, minorTopVer=1]]]] [21:04:57] : [Step 4/5] [2021-11-19 21:04:57,832][INFO ][exchange-worker-#9941%grid-3%][GridDhtPartitionsExchangeFuture] Finished waiting for partitions release latch: ClientLatch [coordinator=TcpDiscoveryNode [id=00e326d4-0c21-42d9-93eb-188856bb0000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345096392, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], ackSent=true, super=CompletableLatch [id=CompletableLatchUid [id=exchange, topVer=AffinityTopologyVersion [topVer=3, minorTopVer=1]]]] [21:04:57] : [Step 4/5] [2021-11-19 21:04:57,832][INFO ][exchange-worker-#9819%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:04:57] : [Step 4/5] [2021-11-19 21:04:57,833][INFO ][exchange-worker-#9941%grid-3%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:04:57] : [Step 4/5] [2021-11-19 21:04:57,872][INFO ][exchange-worker-#9819%grid-0%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], crd=true] [21:04:57] : [Step 4/5] [2021-11-19 21:04:57,874][INFO ][exchange-worker-#9941%grid-3%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], crd=false] [21:04:57] : [Step 4/5] [2021-11-19 21:04:57,874][INFO ][sys-#9806%grid-0%][GridDhtPartitionsExchangeFuture] Coordinator received single message [ver=AffinityTopologyVersion [topVer=3, minorTopVer=1], node=30fb8db0-e121-45b9-b689-f4f0f4589003, allReceived=true] [21:04:57] : [Step 4/5] [2021-11-19 21:04:57,875][INFO ][sys-#9806%grid-0%][GridDhtPartitionsExchangeFuture] finishExchangeOnCoordinator [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=1]] [21:04:57] : [Step 4/5] [2021-11-19 21:04:57,905][INFO ][sys-#9806%grid-0%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], err=null, rebalanced=true, wasRebalanced=true] [21:04:57] : [Step 4/5] [2021-11-19 21:04:57,911][INFO ][sys-#9919%grid-3%][GridDhtPartitionsExchangeFuture] Received full message, will finish exchange [node=00e326d4-0c21-42d9-93eb-188856bb0000, resVer=AffinityTopologyVersion [topVer=3, minorTopVer=1]] [21:04:57] : [Step 4/5] [2021-11-19 21:04:57,912][INFO ][sys-#9919%grid-3%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], err=null, rebalanced=true, wasRebalanced=true] [21:04:57] : [Step 4/5] [2021-11-19 21:04:57,913][INFO ][sys-#9806%grid-0%][GridCacheProcessor] Finish proxy initialization, cacheName=encrypted, localNodeId=00e326d4-0c21-42d9-93eb-188856bb0000 [21:04:57] : [Step 4/5] [2021-11-19 21:04:57,914][INFO ][sys-#9806%grid-0%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=00e326d4-0c21-42d9-93eb-188856bb0000, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=dfc3b2ee-e472-4af4-9379-66f665026249, consistentId=client, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:0], discPort=0, order=3, intOrder=3, lastExchangeTime=1637345096677, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=true], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=3, minorTopVer=1]] [21:04:57] : [Step 4/5] [2021-11-19 21:04:57,914][INFO ][exchange-worker-#9819%grid-0%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=3, minorTopVer=1], force=false, evt=DISCOVERY_CUSTOM_EVT, node=dfc3b2ee-e472-4af4-9379-66f665026249] [21:04:57] : [Step 4/5] [2021-11-19 21:04:57,914][INFO ][sys-#9919%grid-3%][GridCacheProcessor] Finish proxy initialization, cacheName=encrypted, localNodeId=30fb8db0-e121-45b9-b689-f4f0f4589003 [21:04:57] : [Step 4/5] [2021-11-19 21:04:57,916][INFO ][sys-#9919%grid-3%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=30fb8db0-e121-45b9-b689-f4f0f4589003, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=dfc3b2ee-e472-4af4-9379-66f665026249, consistentId=client, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:0], discPort=0, order=3, intOrder=3, lastExchangeTime=1637345096687, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=true], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=3, minorTopVer=1]] [21:04:57] : [Step 4/5] [2021-11-19 21:04:57,918][INFO ][sys-#9919%grid-3%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], stage="Waiting in exchange queue" (1 ms), stage="Exchange parameters initialization" (1 ms), stage="Update caches registry" (0 ms), stage="Start caches" (289 ms), stage="Affinity initialization on cache group start" (3 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Wait partitions release latch [latch=exchange]" (1 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Restore partition states" (11 ms), stage="After states restored callback" (27 ms), stage="WAL history reservation" (0 ms), stage="Waiting for Full message" (37 ms), stage="Affinity recalculation" (0 ms), stage="Full map updating" (1 ms), stage="Exchange done" (5 ms), stage="Total time" (376 ms)] [21:04:57] : [Step 4/5] [2021-11-19 21:04:57,920][INFO ][sys-#9919%grid-3%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], stage="Affinity initialization on cache group start [grp=encrypted]" (2 ms) (parent=Affinity initialization on cache group start), stage="Restore partition states [grp=encrypted]" (11 ms) (parent=Restore partition states), stage="Restore partition states [grp=ignite-sys-cache]" (0 ms) (parent=Restore partition states)] [21:04:57] : [Step 4/5] [2021-11-19 21:04:57,915][INFO ][sys-#9806%grid-0%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], stage="Waiting in exchange queue" (685 ms), stage="Exchange parameters initialization" (1 ms), stage="Update caches registry" (0 ms), stage="Start caches" (262 ms), stage="Affinity initialization on cache group start" (2 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Wait partitions release latch [latch=exchange]" (30 ms), stage="Wait partitions release [latch=exchange]" (1 ms), stage="Restore partition states" (11 ms), stage="After states restored callback" (26 ms), stage="WAL history reservation" (0 ms), stage="Waiting for all single messages" (3 ms), stage="Affinity recalculation (crd)" (0 ms), stage="Collect update counters and create affinity messages" (0 ms), stage="Assign partitions states" (5 ms), stage="Validate partitions states" (0 ms), stage="Apply update counters" (0 ms), stage="Full message preparing" (22 ms), stage="Full message sending" (0 ms), stage="Exchange done" (10 ms), stage="Total time" (1058 ms), Discovery lag=685 ms, Latest started node id=30fb8db0-e121-45b9-b689-f4f0f4589003] [21:04:57] : [Step 4/5] [2021-11-19 21:04:57,917][INFO ][exchange-worker-#9941%grid-3%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=3, minorTopVer=1], force=false, evt=DISCOVERY_CUSTOM_EVT, node=dfc3b2ee-e472-4af4-9379-66f665026249] [21:04:57] : [Step 4/5] [2021-11-19 21:04:57,924][INFO ][sys-#9806%grid-0%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], stage="Affinity initialization on cache group start [grp=encrypted]" (1 ms) (parent=Affinity initialization on cache group start), stage="Restore partition states [grp=encrypted]" (11 ms) (parent=Restore partition states), stage="Restore partition states [grp=ignite-sys-cache]" (0 ms) (parent=Restore partition states)] [21:04:57] : [Step 4/5] [2021-11-19 21:04:57,926][INFO ][sys-#10078%client%][GridDhtPartitionsExchangeFuture] Received full message, will finish exchange [node=00e326d4-0c21-42d9-93eb-188856bb0000, resVer=AffinityTopologyVersion [topVer=3, minorTopVer=1]] [21:04:57] : [Step 4/5] [2021-11-19 21:04:57,931][INFO ][sys-#10078%client%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], err=null, rebalanced=true, wasRebalanced=true] [21:04:57] : [Step 4/5] [2021-11-19 21:04:57,933][INFO ][sys-#10078%client%][GridCacheProcessor] Finish proxy initialization, cacheName=encrypted, localNodeId=dfc3b2ee-e472-4af4-9379-66f665026249 [21:04:57] : [Step 4/5] [2021-11-19 21:04:57,933][INFO ][exchange-worker-#10061%client%][GridCachePartitionExchangeManager] AffinityTopologyVersion [topVer=3, minorTopVer=1], evt=DISCOVERY_CUSTOM_EVT, evtNode=dfc3b2ee-e472-4af4-9379-66f665026249, client=true] [21:04:57] : [Step 4/5] [2021-11-19 21:04:57,934][INFO ][sys-#10078%client%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=dfc3b2ee-e472-4af4-9379-66f665026249, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=dfc3b2ee-e472-4af4-9379-66f665026249, consistentId=client, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:0], discPort=0, order=3, intOrder=0, lastExchangeTime=1637345096667, loc=true, ver=2.13.0#20211119-sha1:00000000, isClient=true], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=3, minorTopVer=1]] [21:04:57] : [Step 4/5] [2021-11-19 21:04:57,935][INFO ][sys-#10078%client%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (1 ms), stage="Update caches registry" (0 ms), stage="Start caches" (5 ms), stage="Affinity initialization on cache group start" (6 ms), stage="Determine exchange type" (0 ms), stage="Waiting for Full message" (1079 ms), stage="Affinity recalculation" (0 ms), stage="Full map updating" (4 ms), stage="Exchange done" (4 ms), stage="Total time" (1099 ms)] [21:04:57] : [Step 4/5] [2021-11-19 21:04:57,939][INFO ][sys-#10078%client%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], stage="Affinity initialization on cache group start [grp=encrypted]" (6 ms) (parent=Affinity initialization on cache group start)] [21:05:00] : [Step 4/5] [21:05:00] >>> Stopping test: EncryptedCacheNodeJoinTest#testClientNodeJoin in 6840 ms <<< [21:05:00] : [Step 4/5] [2021-11-19 21:05:00,928][INFO ][main][root] >>> Stopping test: EncryptedCacheNodeJoinTest#testClientNodeJoin in 6840 ms <<< [21:05:00] : [Step 4/5] [21:05:00] >>> Heap: 287 MB used / 1913 MB commited / 1913 MB max <<< [21:05:00] : [Step 4/5] [2021-11-19 21:05:00,929][INFO ][main][root] >>> Heap: 287 MB used / 1913 MB commited / 1913 MB max <<< [21:05:00] : [Step 4/5] [21:05:00] >>> Non-Heap: 141 MB used / 155 MB commited / 0 MB max <<< [21:05:00] : [Step 4/5] [2021-11-19 21:05:00,929][INFO ][main][root] >>> Non-Heap: 141 MB used / 155 MB commited / 0 MB max <<< [21:05:00] : [Step 4/5] [2021-11-19 21:05:00,929][INFO ][main][root] >>> Stopping grid [name=client, id=dfc3b2ee-e472-4af4-9379-66f665026249] [21:05:00] : [Step 4/5] [2021-11-19 21:05:00,947][INFO ][disco-event-worker-#9818%grid-0%][GridDiscoveryManager] Node left topology: TcpDiscoveryNode [id=dfc3b2ee-e472-4af4-9379-66f665026249, consistentId=client, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:0], discPort=0, order=3, intOrder=3, lastExchangeTime=1637345096677, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=true] [21:05:00] : [Step 4/5] [2021-11-19 21:05:00,948][INFO ][tcp-disco-sock-reader-[dfc3b2ee 127.0.0.1:38011 client]-#524%grid-3%-#10057%grid-3%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:38011, rmtPort=38011, rmtNodeId=dfc3b2ee-e472-4af4-9379-66f665026249] [21:05:00] : [Step 4/5] [2021-11-19 21:05:00,947][INFO ][disco-event-worker-#9940%grid-3%][GridDiscoveryManager] Node left topology: TcpDiscoveryNode [id=dfc3b2ee-e472-4af4-9379-66f665026249, consistentId=client, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:0], discPort=0, order=3, intOrder=3, lastExchangeTime=1637345096687, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=true] [21:05:00] : [Step 4/5] [2021-11-19 21:05:00,964][INFO ][disco-event-worker-#9940%grid-3%][GridDiscoveryManager] Topology snapshot [ver=4, locNode=30fb8db0, servers=2, clients=0, state=ACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=00e326d4-0c21-42d9-93eb-188856bb0000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=30fb8db0-e121-45b9-b689-f4f0f4589003, consistentId=grid-3, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:05:00] : [Step 4/5] [2021-11-19 21:05:00,965][INFO ][disco-event-worker-#9940%grid-3%][GridDiscoveryManager] ^-- Baseline [id=0, size=2, online=2, offline=0] [21:05:00]W: [org.apache.ignite:ignite-core] [2021-11-19 21:05:00,967][WARN ][grid-nio-worker-tcp-comm-1-#9877%TcpCommunicationSpi%][TcpCommunicationSpi] Failed to shutdown socket [21:05:00]W: [org.apache.ignite:ignite-core] java.nio.channels.ClosedChannelException [21:05:00]W: [org.apache.ignite:ignite-core] at sun.nio.ch.SocketChannelImpl.shutdownOutput(SocketChannelImpl.java:795) [21:05:00]W: [org.apache.ignite:ignite-core] at sun.nio.ch.SocketAdaptor.shutdownOutput(SocketAdaptor.java:407) [21:05:00]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.close(IgniteUtils.java:4247) [21:05:00]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.closeKey(GridNioServer.java:2784) [21:05:00]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.close(GridNioServer.java:2835) [21:05:00]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.close(GridNioServer.java:2794) [21:05:00]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.bodyInternal(GridNioServer.java:2157) [21:05:00]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.body(GridNioServer.java:1910) [21:05:00]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:125) [21:05:00]W: [org.apache.ignite:ignite-core] at java.lang.Thread.run(Thread.java:748) [21:05:00] : [Step 4/5] [2021-11-19 21:05:00,960][INFO ][main][GridCacheProcessor] Stopped cache [cacheName=ignite-sys-cache] [21:05:00] : [Step 4/5] [2021-11-19 21:05:00,953][INFO ][disco-event-worker-#9818%grid-0%][GridDiscoveryManager] Topology snapshot [ver=4, locNode=00e326d4, servers=2, clients=0, state=ACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=00e326d4-0c21-42d9-93eb-188856bb0000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=30fb8db0-e121-45b9-b689-f4f0f4589003, consistentId=grid-3, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:05:00] : [Step 4/5] [2021-11-19 21:05:00,970][INFO ][main][GridCacheProcessor] Stopped cache [cacheName=encrypted] [21:05:00] : [Step 4/5] [2021-11-19 21:05:00,968][INFO ][exchange-worker-#9941%grid-3%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], crd=false, evt=NODE_LEFT, evtNode=dfc3b2ee-e472-4af4-9379-66f665026249, customEvt=null, allowMerge=true, exchangeFreeSwitch=false] [21:05:00] : [Step 4/5] [2021-11-19 21:05:00,971][INFO ][disco-event-worker-#9818%grid-0%][GridDiscoveryManager] ^-- Baseline [id=0, size=2, online=2, offline=0] [21:05:00] : [Step 4/5] [2021-11-19 21:05:00,975][INFO ][exchange-worker-#9941%grid-3%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], err=null, rebalanced=true, wasRebalanced=true] [21:05:00] : [Step 4/5] [2021-11-19 21:05:00,976][INFO ][main][GridDeploymentLocalStore] Removed undeployed class: GridDeployment [ts=1637345096768, depMode=SHARED, clsLdr=IsolatedClassLoader{roleName='test'}, clsLdrId=e2e2d593d71-dfc3b2ee-e472-4af4-9379-66f665026249, userVer=0, loc=true, sampleClsName=org.apache.ignite.internal.processors.cache.distributed.dht.preloader.GridDhtPartitionFullMap, pendingUndeploy=false, undeployed=true, usage=0] [21:05:00] : [Step 4/5] [2021-11-19 21:05:00,977][INFO ][exchange-worker-#9941%grid-3%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=30fb8db0-e121-45b9-b689-f4f0f4589003, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], evt=NODE_LEFT, evtNode=TcpDiscoveryNode [id=dfc3b2ee-e472-4af4-9379-66f665026249, consistentId=client, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:0], discPort=0, order=3, intOrder=3, lastExchangeTime=1637345096687, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=true], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0]] [21:05:00] : [Step 4/5] [2021-11-19 21:05:00,979][INFO ][exchange-worker-#9941%grid-3%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (4 ms), stage="Determine exchange type" (0 ms), stage="Exchange done" (7 ms), stage="Total time" (11 ms)] [21:05:00] : [Step 4/5] [2021-11-19 21:05:00,980][INFO ][exchange-worker-#9941%grid-3%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=0]] [21:05:00] : [Step 4/5] [2021-11-19 21:05:00,985][INFO ][exchange-worker-#9819%grid-0%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], crd=true, evt=NODE_LEFT, evtNode=dfc3b2ee-e472-4af4-9379-66f665026249, customEvt=null, allowMerge=true, exchangeFreeSwitch=false] [21:05:00] : [Step 4/5] [2021-11-19 21:05:00,987][INFO ][exchange-worker-#9819%grid-0%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], err=null, rebalanced=true, wasRebalanced=true] [21:05:00] : [Step 4/5] [2021-11-19 21:05:00,987][INFO ][exchange-worker-#9941%grid-3%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], crd=false] [21:05:00] : [Step 4/5] [2021-11-19 21:05:00,992][INFO ][exchange-worker-#9819%grid-0%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=00e326d4-0c21-42d9-93eb-188856bb0000, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], evt=NODE_LEFT, evtNode=TcpDiscoveryNode [id=dfc3b2ee-e472-4af4-9379-66f665026249, consistentId=client, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:0], discPort=0, order=3, intOrder=3, lastExchangeTime=1637345096677, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=true], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0]] [21:05:00] : [Step 4/5] [2021-11-19 21:05:00,995][INFO ][exchange-worker-#9941%grid-3%][GridCachePartitionExchangeManager] AffinityTopologyVersion [topVer=4, minorTopVer=0], evt=NODE_LEFT, evtNode=dfc3b2ee-e472-4af4-9379-66f665026249, client=false] [21:05:00] : [Step 4/5] [2021-11-19 21:05:00,996][INFO ][exchange-worker-#9819%grid-0%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], stage="Waiting in exchange queue" (2 ms), stage="Exchange parameters initialization" (7 ms), stage="Determine exchange type" (0 ms), stage="Exchange done" (8 ms), stage="Total time" (17 ms)] [21:05:00] : [Step 4/5] [2021-11-19 21:05:00,997][INFO ][exchange-worker-#9819%grid-0%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=0]] [21:05:00] : [Step 4/5] [2021-11-19 21:05:00,997][INFO ][exchange-worker-#9819%grid-0%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], crd=true] [21:05:00] : [Step 4/5] [2021-11-19 21:05:00,998][INFO ][exchange-worker-#9819%grid-0%][GridCachePartitionExchangeManager] AffinityTopologyVersion [topVer=4, minorTopVer=0], evt=NODE_LEFT, evtNode=dfc3b2ee-e472-4af4-9379-66f665026249, client=false] [21:05:01] : [Step 4/5] [2021-11-19 21:05:01,019][INFO ][main][IgniteKernal%client] [21:05:01] : [Step 4/5] [21:05:01] : [Step 4/5] >>> +------------------------------------------------------+ [21:05:01] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV stopped OK [21:05:01] : [Step 4/5] >>> +------------------------------------------------------+ [21:05:01] : [Step 4/5] >>> Ignite instance name: client [21:05:01] : [Step 4/5] >>> Grid uptime: 00:00:04.229 [21:05:01] : [Step 4/5] [21:05:01] : [Step 4/5] [21:05:01] : [Step 4/5] [2021-11-19 21:05:01,020][INFO ][main][root] >>> Stopping grid [name=grid-0, id=00e326d4-0c21-42d9-93eb-188856bb0000] [21:05:01] : [Step 4/5] [2021-11-19 21:05:01,626][INFO ][db-checkpoint-thread-#9951%grid-0%][Checkpointer] Checkpoint started [checkpointId=3bbe6de7-1df2-4136-b76e-68d74f7c9310, startPtr=WALPointer [idx=0, fileOff=672160, len=11985], checkpointBeforeLockTime=8ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=86ms, writeCheckpointEntryDuration=490ms, splitAndSortCpPagesDuration=1ms, pages=490, reason='timeout'] [21:05:01] : [Step 4/5] [2021-11-19 21:05:01,639][INFO ][tcp-disco-sock-reader-[30fb8db0 127.0.0.1:35901]-#517%grid-0%-#9938%grid-0%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:35901, rmtPort=35901, rmtNodeId=30fb8db0-e121-45b9-b689-f4f0f4589003] [21:05:01] : [Step 4/5] [2021-11-19 21:05:01,650][INFO ][disco-event-worker-#9940%grid-3%][GridDiscoveryManager] Node left topology: TcpDiscoveryNode [id=00e326d4-0c21-42d9-93eb-188856bb0000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345096392, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false] [21:05:01] : [Step 4/5] [2021-11-19 21:05:01,651][INFO ][disco-event-worker-#9940%grid-3%][GridDiscoveryManager] Topology snapshot [ver=5, locNode=30fb8db0, servers=1, clients=0, state=ACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=30fb8db0-e121-45b9-b689-f4f0f4589003, consistentId=grid-3, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:05:01] : [Step 4/5] [2021-11-19 21:05:01,653][INFO ][main][GridCacheProcessor] Stopped cache [cacheName=ignite-sys-cache] [21:05:01] : [Step 4/5] [2021-11-19 21:05:01,654][INFO ][disco-event-worker-#9940%grid-3%][GridDiscoveryManager] Coordinator changed [prev=TcpDiscoveryNode [id=00e326d4-0c21-42d9-93eb-188856bb0000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345096392, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], cur=TcpDiscoveryNode [id=30fb8db0-e121-45b9-b689-f4f0f4589003, consistentId=grid-3, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637345101633, loc=true, ver=2.13.0#20211119-sha1:00000000, isClient=false]] [21:05:01] : [Step 4/5] [2021-11-19 21:05:01,654][INFO ][main][GridCacheProcessor] Stopped cache [cacheName=encrypted] [21:05:01] : [Step 4/5] [2021-11-19 21:05:01,655][INFO ][disco-event-worker-#9940%grid-3%][GridDiscoveryManager] ^-- Baseline [id=0, size=2, online=1, offline=1] [21:05:01] : [Step 4/5] [2021-11-19 21:05:01,656][INFO ][disco-event-worker-#9940%grid-3%][MvccProcessorImpl] Assigned mvcc coordinator [crd=MvccCoordinator [topVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], nodeId=30fb8db0-e121-45b9-b689-f4f0f4589003, ver=1637345095093, local=true, initialized=false]] [21:05:01] : [Step 4/5] [2021-11-19 21:05:01,661][INFO ][sys-#9930%grid-3%][ExchangeLatchManager] Become new coordinator 30fb8db0-e121-45b9-b689-f4f0f4589003 [21:05:01] : [Step 4/5] [2021-11-19 21:05:01,662][INFO ][exchange-worker-#9941%grid-3%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], crd=true, evt=NODE_LEFT, evtNode=00e326d4-0c21-42d9-93eb-188856bb0000, customEvt=null, allowMerge=false, exchangeFreeSwitch=true] [21:05:01] : [Step 4/5] [2021-11-19 21:05:01,663][INFO ][sys-#9910%grid-3%][GridAffinityAssignmentCache] Local node affinity assignment distribution is not ideal [cache=encrypted, expectedPrimary=1024.00, actualPrimary=496, expectedBackups=0.00, actualBackups=0, warningThreshold=50.00%] [21:05:01] : [Step 4/5] [2021-11-19 21:05:01,664][INFO ][exchange-worker-#9941%grid-3%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:05:01] : [Step 4/5] [2021-11-19 21:05:01,667][INFO ][exchange-worker-#9941%grid-3%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], err=null, rebalanced=true, wasRebalanced=true] [21:05:01]W: [org.apache.ignite:ignite-core] [2021-11-19 21:05:01,669][WARN ][exchange-worker-#9941%grid-3%][GridDhtPartitionTopologyImpl] Detected lost partitions [grp=encrypted, parts=[3-4, 6-13, 17-18, 20, 23, 27, 31-32, 35, 37-41, 43-46, 48, 53, 56, 61, 64-65, 69-71, 73, 75-76, 80, 82-83, 88-90, 93, 98-99, 101, 103-104, 109-110, 112-113, 115-117, 120-121, 123-125, 127-131, 137, 139, 142, 144, 146, 148-149, 152-153, 155, 157, 162, 165, 167-168, 177-179, 181, 184, 187-188, 190-192, 194-195, 203-204, 206, 210, 212-213, 215-218, 220-221, 225-228, 232-238, 241, 246, 249-255, 258, 260, 264-268, 271, 273-274, 277-279, 281, 283-284, 286, 288-291, 293, 296, 298-301, 303, 307, 309-310, 314-315, 318, 321-324, 327-328, 330-331, 333-334, 336-337, 342-343, 347-349, 351-352, 355-356, 358, 361, 363-364, 368, 370-375, 379-385, 391, 393-394, 398-400, 402-407, 409-410, 413-414, 416-418, 422-423, 426, 429-432, 434, 438-439, 442-444, 446-447, 449, 451, 454-455, 457-459, 462, 464, 468-472, 474-487, 493-494, 497-498, 501, 508, 513, 517, 519, 523-524, 526-527, 529-530, 532-534, 536, 539, 541, 543-544, 547, 549, 552-553, 555-557, 560-561, 566-567, 569-571, 574, 576-577, 580, 583, 593, 598-599, 604, 606, 610-612, 616-617, 620-622, 625, 630-631, 633-635, 637-641, 643-644, 647, 650-654, 662, 664-667, 674-676, 678, 681, 685-689, 691-692, 696, 699-702, 708-711, 715-720, 722, 726, 728, 730-731, 733-734, 737, 743-745, 747-748, 751, 753-755, 757, 763, 765-766, 768-769, 771, 774-776, 778-779, 781-782, 784, 792-794, 797, 801-802, 804-807, 809, 813-815, 820, 822-823, 827, 829-830, 834-835, 837-838, 840-842, 844-847, 850, 852-853, 855, 859, 861, 863-864, 867-870, 873-874, 876-877, 879, 881-883, 885-888, 890-891, 893, 896-897, 900-901, 903-904, 906, 910-913, 915-916, 925, 929-930, 932, 934-935, 938, 940, 942, 945, 949-950, 952-953, 956, 958-963, 966, 970-971, 973-974, 977, 980, 982-983, 985-987, 989, 992, 995-1000, 1002, 1005-1011, 1014, 1016-1018, 1020-1023], topVer=AffinityTopologyVersion [topVer=5, minorTopVer=0]] [21:05:01] : [Step 4/5] [2021-11-19 21:05:01,674][INFO ][exchange-worker-#9941%grid-3%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=30fb8db0-e121-45b9-b689-f4f0f4589003, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], evt=NODE_LEFT, evtNode=TcpDiscoveryNode [id=00e326d4-0c21-42d9-93eb-188856bb0000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345096392, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=5, minorTopVer=0]] [21:05:01] : [Step 4/5] [2021-11-19 21:05:01,675][INFO ][exchange-worker-#9941%grid-3%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (0 ms), stage="Determine exchange type" (2 ms), stage="Preloading notification" (0 ms), stage="After states restored callback" (0 ms), stage="WAL history reservation" (0 ms), stage="Finalize update counters" (0 ms), stage="Detect lost partitions" (6 ms), stage="Exchange done" (2 ms), stage="Total time" (10 ms)] [21:05:01] : [Step 4/5] [2021-11-19 21:05:01,676][INFO ][exchange-worker-#9941%grid-3%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], stage="Affinity initialization (exchange-free switch on fully-rebalanced topology) [grp=encrypted]" (1 ms) (parent=Determine exchange type), stage="Affinity initialization (exchange-free switch on fully-rebalanced topology) [grp=ignite-sys-cache]" (0 ms) (parent=Determine exchange type)] [21:05:01] : [Step 4/5] [2021-11-19 21:05:01,678][INFO ][exchange-worker-#9941%grid-3%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], crd=true] [21:05:01] : [Step 4/5] [2021-11-19 21:05:01,680][INFO ][exchange-worker-#9941%grid-3%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=5, minorTopVer=0], force=false, evt=NODE_LEFT, node=00e326d4-0c21-42d9-93eb-188856bb0000] [21:05:03] : [Step 4/5] [2021-11-19 21:05:03,407][INFO ][main][FilePageStoreManager] Cleanup cache stores [total=4, left=0, cleanFiles=false] [21:05:03] : [Step 4/5] [2021-11-19 21:05:03,410][INFO ][main][GridDeploymentLocalStore] Removed undeployed class: GridDeployment [ts=1637345096493, depMode=SHARED, clsLdr=IsolatedClassLoader{roleName='test'}, clsLdrId=dcd2d593d71-00e326d4-0c21-42d9-93eb-188856bb0000, userVer=0, loc=true, sampleClsName=org.apache.ignite.internal.processors.cache.distributed.dht.preloader.GridDhtPartitionMap, pendingUndeploy=false, undeployed=true, usage=0] [21:05:03] : [Step 4/5] [2021-11-19 21:05:03,418][INFO ][main][IgniteKernal%grid-0] [21:05:03] : [Step 4/5] [21:05:03] : [Step 4/5] >>> +------------------------------------------------------+ [21:05:03] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV stopped OK [21:05:03] : [Step 4/5] >>> +------------------------------------------------------+ [21:05:03] : [Step 4/5] >>> Ignite instance name: grid-0 [21:05:03] : [Step 4/5] >>> Grid uptime: 00:00:08.290 [21:05:03] : [Step 4/5] [21:05:03] : [Step 4/5] [21:05:03] : [Step 4/5] [2021-11-19 21:05:03,418][INFO ][main][root] >>> Stopping grid [name=grid-3, id=30fb8db0-e121-45b9-b689-f4f0f4589003] [21:05:03] : [Step 4/5] [2021-11-19 21:05:03,443][INFO ][db-checkpoint-thread-#9950%grid-3%][Checkpointer] Checkpoint started [checkpointId=f990ce95-5e6d-4df1-94d9-81479d36d1c1, startPtr=WALPointer [idx=0, fileOff=702325, len=11377], checkpointBeforeLockTime=5ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=1ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=10ms, writeCheckpointEntryDuration=2ms, splitAndSortCpPagesDuration=1ms, pages=530, reason='timeout'] [21:05:03]W: [org.apache.ignite:ignite-core] [2021-11-19 21:05:03,448][WARN ][tcp-disco-sock-reader-[00e326d4 127.0.0.1:56625]-#516%grid-3%-#9937%grid-3%][TestTcpDiscoverySpi] Failed to shutdown socket [21:05:03]W: [org.apache.ignite:ignite-core] java.net.SocketException: Socket is closed [21:05:03]W: [org.apache.ignite:ignite-core] at java.net.Socket.shutdownOutput(Socket.java:1568) [21:05:03]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.close(IgniteUtils.java:4247) [21:05:03] : [Step 4/5] [2021-11-19 21:05:03,449][INFO ][tcp-disco-sock-reader-[00e326d4 127.0.0.1:56625]-#516%grid-3%-#9937%grid-3%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:56625, rmtPort=56625, rmtNodeId=00e326d4-0c21-42d9-93eb-188856bb0000] [21:05:03]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.discovery.tcp.ServerImpl$SocketReader.body(ServerImpl.java:7370) [21:05:03]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.IgniteSpiThread.run(IgniteSpiThread.java:58) [21:05:03] : [Step 4/5] [2021-11-19 21:05:03,450][INFO ][main][GridCacheProcessor] Stopped cache [cacheName=ignite-sys-cache] [21:05:03] : [Step 4/5] [2021-11-19 21:05:03,451][INFO ][main][GridCacheProcessor] Stopped cache [cacheName=encrypted] [21:05:03] : [Step 4/5] [2021-11-19 21:05:03,906][INFO ][main][FilePageStoreManager] Cleanup cache stores [total=4, left=0, cleanFiles=false] [21:05:03] : [Step 4/5] [2021-11-19 21:05:03,909][INFO ][main][GridDeploymentLocalStore] Removed undeployed class: GridDeployment [ts=1637345096526, depMode=SHARED, clsLdr=IsolatedClassLoader{roleName='test'}, clsLdrId=fcd2d593d71-30fb8db0-e121-45b9-b689-f4f0f4589003, userVer=0, loc=true, sampleClsName=org.apache.ignite.internal.processors.cache.distributed.dht.preloader.IgniteDhtPartitionsToReloadMap, pendingUndeploy=false, undeployed=true, usage=0] [21:05:03] : [Step 4/5] [2021-11-19 21:05:03,924][INFO ][main][IgniteKernal%grid-3] [21:05:03] : [Step 4/5] [21:05:03] : [Step 4/5] >>> +------------------------------------------------------+ [21:05:03] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV stopped OK [21:05:03] : [Step 4/5] >>> +------------------------------------------------------+ [21:05:03] : [Step 4/5] >>> Ignite instance name: grid-3 [21:05:03] : [Step 4/5] >>> Grid uptime: 00:00:07.484 [21:05:03] : [Step 4/5] [21:05:03] : [Step 4/5] [21:05:04] : [Step 4/5] [21:05:04] >>> Starting test: EncryptedCacheNodeJoinTest#testThirdNodeCanJoin <<< [21:05:04] : [Step 4/5] [2021-11-19 21:05:04,201][INFO ][main][root] >>> Starting test: EncryptedCacheNodeJoinTest#testThirdNodeCanJoin <<< [21:05:04] : [Step 4/5] [21:05:04] >>> Heap: 298 MB used / 1913 MB commited / 1913 MB max <<< [21:05:04] : [Step 4/5] [2021-11-19 21:05:04,202][INFO ][main][root] >>> Heap: 298 MB used / 1913 MB commited / 1913 MB max <<< [21:05:04] : [Step 4/5] [21:05:04] >>> Non-Heap: 141 MB used / 155 MB commited / 0 MB max <<< [21:05:04] : [Step 4/5] [2021-11-19 21:05:04,202][INFO ][main][root] >>> Non-Heap: 141 MB used / 155 MB commited / 0 MB max <<< [21:05:04]W: [org.apache.ignite:ignite-core] [2021-11-19 21:05:04,209][WARN ][test-runner-#10093%encryption.EncryptedCacheNodeJoinTest%][G] Ignite work directory is not provided, automatically resolved to: /opt/buildagent/work/7bc1c54bc719b67c/work [21:05:04] : [Step 4/5] [2021-11-19 21:05:04,211][INFO ][test-runner-#10093%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] [21:05:04] : [Step 4/5] [21:05:04] : [Step 4/5] >>> __________ ________________ [21:05:04] : [Step 4/5] >>> / _/ ___/ |/ / _/_ __/ __/ [21:05:04] : [Step 4/5] >>> _/ // (7 7 // / / / / _/ [21:05:04] : [Step 4/5] >>> /___/\___/_/|_/___/ /_/ /___/ [21:05:04] : [Step 4/5] >>> [21:05:04] : [Step 4/5] >>> ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:05:04] : [Step 4/5] >>> 2021 Copyright(C) Apache Software Foundation [21:05:04] : [Step 4/5] >>> [21:05:04] : [Step 4/5] >>> Ignite documentation: http://ignite.apache.org [21:05:04] : [Step 4/5] [21:05:04] : [Step 4/5] [2021-11-19 21:05:04,212][INFO ][test-runner-#10093%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] Config URL: n/a [21:05:04] : [Step 4/5] [2021-11-19 21:05:04,212][INFO ][test-runner-#10093%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] IgniteConfiguration [igniteInstanceName=grid-0, pubPoolSize=24, svcPoolSize=24, callbackPoolSize=24, stripedPoolSize=24, sysPoolSize=24, mgmtPoolSize=4, dataStreamerPoolSize=24, utilityCachePoolSize=24, utilityCacheKeepAliveTime=60000, p2pPoolSize=2, qryPoolSize=24, buildIdxPoolSize=4, igniteHome=/opt/buildagent/work/7bc1c54bc719b67c, igniteWorkDir=/opt/buildagent/work/7bc1c54bc719b67c/work, mbeanSrv=com.sun.jmx.mbeanserver.JmxMBeanServer@6fe85038, nodeId=00b79a21-5f82-4914-a1d6-50f2b7cd2000, marsh=BinaryMarshaller [], marshLocJobs=false, daemon=false, p2pEnabled=true, netTimeout=10000, netCompressionLevel=1, sndRetryDelay=1000, sndRetryCnt=3, metricsHistSize=10000, metricsUpdateFreq=1000, metricsExpTime=9223372036854775807, discoSpi=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=0, ackTimeout=0, marsh=null, reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], segPlc=STOP, segResolveAttempts=2, waitForSegOnStart=true, allResolversPassReq=true, segChkFreq=10000, commSpi=TcpCommunicationSpi [connectGate=org.apache.ignite.spi.communication.tcp.internal.ConnectGateway@719a4452, ctxInitLatch=java.util.concurrent.CountDownLatch@2b7b7814[Count = 1], stopping=false, clientPool=null, nioSrvWrapper=null, stateProvider=null], evtSpi=MemoryEventStorageSpi [expireAgeMs=9223372036854775807, expireCnt=10000, filter=null], colSpi=NoopCollisionSpi [], deploySpi=LocalDeploymentSpi [], indexingSpi=org.apache.ignite.spi.indexing.noop.NoopIndexingSpi@5b67382c, addrRslvr=null, encryptionSpi=org.apache.ignite.spi.encryption.keystore.KeystoreEncryptionSpi@43f0643, tracingSpi=org.apache.ignite.spi.tracing.NoopTracingSpi@35a1b2ca, clientMode=false, rebalanceThreadPoolSize=4, rebalanceTimeout=10000, rebalanceBatchesPrefetchCnt=3, rebalanceThrottle=0, rebalanceBatchSize=524288, txCfg=TransactionConfiguration [txSerEnabled=false, dfltIsolation=REPEATABLE_READ, dfltConcurrency=PESSIMISTIC, dfltTxTimeout=0, txTimeoutOnPartitionMapExchange=0, deadlockTimeout=10000, pessimisticTxLogSize=0, pessimisticTxLogLinger=10000, tmLookupClsName=null, txManagerFactory=null, useJtaSync=false], cacheSanityCheckEnabled=true, discoStartupDelay=60000, deployMode=SHARED, p2pMissedCacheSize=100, locHost=127.0.0.1, timeSrvPortBase=31100, timeSrvPortRange=100, failureDetectionTimeout=10000, sysWorkerBlockedTimeout=null, clientFailureDetectionTimeout=10000, metricsLogFreq=0, connectorCfg=null, odbcCfg=null, warmupClos=null, atomicCfg=AtomicConfiguration [seqReserveSize=1000, cacheMode=PARTITIONED, backups=1, aff=null, grpName=null], classLdr=null, sslCtxFactory=null, platformCfg=null, binaryCfg=null, memCfg=null, pstCfg=null, dsCfg=DataStorageConfiguration [sysRegionInitSize=41943040, sysRegionMaxSize=104857600, pageSize=4096, concLvl=0, dfltDataRegConf=DataRegionConfiguration [name=default, maxSize=10485760, initSize=268435456, swapPath=null, pageEvictionMode=DISABLED, pageReplacementMode=CLOCK, evictionThreshold=0.9, emptyPagesPoolSize=100, metricsEnabled=false, metricsSubIntervalCount=5, metricsRateTimeInterval=60000, persistenceEnabled=true, checkpointPageBufSize=0, lazyMemoryAllocation=true, warmUpCfg=null], dataRegions=null, storagePath=null, checkpointFreq=180000, lockWaitTime=10000, checkpointThreads=4, checkpointWriteOrder=SEQUENTIAL, walHistSize=20, maxWalArchiveSize=1073741824, walSegments=10, walSegmentSize=67108864, walPath=db/wal, walArchivePath=db/wal/archive, cdcWalPath=db/wal/cdc, cdcEnabled=false, metricsEnabled=false, walMode=FSYNC, walTlbSize=131072, walBuffSize=0, walFlushFreq=2000, walFsyncDelay=1000, walRecordIterBuffSize=67108864, alwaysWriteFullPages=false, fileIOFactory=org.apache.ignite.internal.processors.cache.persistence.file.AsyncFileIOFactory@5297c183, metricsSubIntervalCnt=5, metricsRateTimeInterval=60000, walAutoArchiveAfterInactivity=-1, walForceArchiveTimeout=-1, writeThrottlingEnabled=false, walCompactionEnabled=false, walCompactionLevel=1, checkpointReadLockTimeout=null, walPageCompression=DISABLED, walPageCompressionLevel=null, dfltWarmUpCfg=null, encCfg=org.apache.ignite.configuration.EncryptionConfiguration@590643d7, defragmentationThreadPoolSize=4, minWalArchiveSize=-1], snapshotPath=snapshots, activeOnStart=true, activeOnStartPropSetFlag=false, autoActivation=true, autoActivationPropSetFlag=false, clusterStateOnStart=null, sqlConnCfg=null, cliConnCfg=ClientConnectorConfiguration [host=null, port=10800, portRange=100, sockSndBufSize=0, sockRcvBufSize=0, tcpNoDelay=true, maxOpenCursorsPerConn=128, threadPoolSize=24, selectorCnt=12, idleTimeout=0, handshakeTimeout=10000, jdbcEnabled=true, odbcEnabled=true, thinCliEnabled=true, sslEnabled=false, useIgniteSslCtxFactory=true, sslClientAuth=false, sslCtxFactory=null, thinCliCfg=ThinClientConfiguration [maxActiveTxPerConn=100, maxActiveComputeTasksPerConn=0]], mvccVacuumThreadCnt=2, mvccVacuumFreq=5000, authEnabled=false, failureHnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]], commFailureRslvr=null, sqlCfg=SqlConfiguration [longQryWarnTimeout=3000, dfltQryTimeout=0, sqlQryHistSize=1000, validationEnabled=false], asyncContinuationExecutor=null] [21:05:04] : [Step 4/5] [2021-11-19 21:05:04,219][INFO ][test-runner-#10093%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] Daemon mode: off [21:05:04] : [Step 4/5] [2021-11-19 21:05:04,220][INFO ][test-runner-#10093%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] OS: Linux 4.15.0-151-generic amd64 [21:05:04] : [Step 4/5] [2021-11-19 21:05:04,220][INFO ][test-runner-#10093%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] OS user: teamcity [21:05:04] : [Step 4/5] [2021-11-19 21:05:04,220][INFO ][test-runner-#10093%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] PID: 16724 [21:05:04] : [Step 4/5] [2021-11-19 21:05:04,221][INFO ][test-runner-#10093%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] Language runtime: Java Platform API Specification ver. 1.8 [21:05:04] : [Step 4/5] [2021-11-19 21:05:04,221][INFO ][test-runner-#10093%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] VM information: Java(TM) SE Runtime Environment 1.8.0_261-b12 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 25.261-b12 [21:05:04] : [Step 4/5] [2021-11-19 21:05:04,221][INFO ][test-runner-#10093%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] VM total memory: 1.9GB [21:05:04] : [Step 4/5] [2021-11-19 21:05:04,221][INFO ][test-runner-#10093%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] Remote Management [restart: off, REST: off, JMX (remote: off)] [21:05:04] : [Step 4/5] [2021-11-19 21:05:04,222][INFO ][test-runner-#10093%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] Logger: GridTestLog4jLogger [quiet=false, config=null] [21:05:04] : [Step 4/5] [2021-11-19 21:05:04,222][INFO ][test-runner-#10093%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] IGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c [21:05:04] : [Step 4/5] [2021-11-19 21:05:04,222][INFO ][test-runner-#10093%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] VM arguments: [-DIGNITE_DUMP_THREADS_ON_FAILURE=false, -DMono=/usr/bin/mono-sgen, -DMono4.0_x64=/usr/lib/mono/4.0, -DMono4.5_x64=/usr/lib/mono/4.5, -DMonoVersion=6.12.0.90, -DSKIP_BUILD=false, -Dagent.home.dir=/opt/buildagent, -Dagent.name=aitc-lin02_03, -Dagent.ownPort=9090, -Dagent.work.dir=/opt/buildagent/work, -Dbuild.number=95, -Dbuild.vcs.number=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.1=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.GitHubApacheIgnite=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dclassworlds.conf=/opt/buildagent/temp/buildTmp/teamcity.m2.conf, -Dcom.jetbrains.maven.watcher.report.file=/opt/buildagent/temp/buildTmp/maven-build-info.xml, -Djava.io.tmpdir=/opt/buildagent/temp/buildTmp, -Dmaven.home=/opt/buildagent/tools/maven3_6, -Dmaven.multiModuleProjectDirectory=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.agent.cpuBenchmark=457, -Dteamcity.agent.dotnet.agent_url=http://localhost:9090/RPC2, -Dteamcity.agent.dotnet.build_id=6278078, -Dteamcity.auth.password=*******, -Dteamcity.auth.userId=TeamCityBuildId=6278078, -Dteamcity.build.changedFiles.file=/opt/buildagent/temp/buildTmp/changedFiles6342607772318147725.txt, -Dteamcity.build.checkoutDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.build.id=6278078, -Dteamcity.build.properties.file=/opt/buildagent/temp/buildTmp/teamcity.build5164517880467851002.properties, -Dteamcity.build.tempDir=/opt/buildagent/temp/buildTmp, -Dteamcity.build.workingDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.buildConfName=Basic 3, -Dteamcity.buildType.id=IgniteTests24Java8_Basic3, -Dteamcity.configuration.properties.file=/opt/buildagent/temp/buildTmp/teamcity.config5591980786735343870.properties, -Dteamcity.maven.userSettings.path=/opt/buildagent/temp/buildTmp/maven_settings_585072866407032347.xml, -Dteamcity.maven.watcher.home=/opt/buildagent/plugins/mavenPlugin/maven-watcher-jdk16, -Dteamcity.projectName=Ignite Tests 2.x (JDK 8/11), -Dteamcity.runner.properties.file=/opt/buildagent/temp/buildTmp/teamcity.runner9098465561618137420.properties, -Dteamcity.tests.recentlyFailedTests.file=/opt/buildagent/temp/buildTmp/testsToRunFirst3891775683130404069.txt, -Dteamcity.version=2021.2 (build 99542), -ea, -Xms2g, -Xmx2g, -XX:+HeapDumpOnOutOfMemoryError, -DIGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_TEST_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_UPDATE_NOTIFIER=false, -DIGNITE_NO_DISCO_ORDER=true, -DIGNITE_PERFORMANCE_SUGGESTIONS_DISABLED=true, -Djava.net.preferIPv4Stack=true, -DTEST_SCALE_FACTOR=1.0, -DIGNITE_TEST_PROP_LOG4J_FILE=log4j-tc-test.xml, -DIGNITE_QUIET=false, -DIGNITE_MARSHAL_BUFFERS_RECHECK=1000, -Dmaven.repo.local=/opt/buildagent/.m2/repository] [21:05:04] : [Step 4/5] [2021-11-19 21:05:04,226][INFO ][test-runner-#10093%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] System cache's DataRegion size is configured to 40 MB. Use DataStorageConfiguration.systemRegionInitialSize property to change the setting. [21:05:04] : [Step 4/5] [2021-11-19 21:05:04,226][INFO ][test-runner-#10093%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] Configured caches [in 'sysMemPlc' dataRegion: ['ignite-sys-cache']] [21:05:04]W: [org.apache.ignite:ignite-core] [2021-11-19 21:05:04,227][WARN ][test-runner-#10093%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] Peer class loading is enabled (disable it in production for performance and deployment consistency reasons) [21:05:04] : [Step 4/5] [2021-11-19 21:05:04,227][INFO ][test-runner-#10093%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] 3-rd party licenses can be found at: /opt/buildagent/work/7bc1c54bc719b67c/libs/licenses [21:05:04] : [Step 4/5] [2021-11-19 21:05:04,231][INFO ][test-runner-#10093%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] Configured plugins: [21:05:04] : [Step 4/5] [2021-11-19 21:05:04,232][INFO ][test-runner-#10093%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- StanByClusterTestProvider 1.0 [21:05:04] : [Step 4/5] [2021-11-19 21:05:04,232][INFO ][test-runner-#10093%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- null [21:05:04] : [Step 4/5] [2021-11-19 21:05:04,232][INFO ][test-runner-#10093%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] [21:05:04] : [Step 4/5] [2021-11-19 21:05:04,232][INFO ][test-runner-#10093%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- PageMemory tracker plugin 1.0 [21:05:04] : [Step 4/5] [2021-11-19 21:05:04,232][INFO ][test-runner-#10093%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- null [21:05:04] : [Step 4/5] [2021-11-19 21:05:04,233][INFO ][test-runner-#10093%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] [21:05:04] : [Step 4/5] [2021-11-19 21:05:04,233][INFO ][test-runner-#10093%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- TestDistibutedConfigurationPlugin 1.0 [21:05:04] : [Step 4/5] [2021-11-19 21:05:04,233][INFO ][test-runner-#10093%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- null [21:05:04] : [Step 4/5] [2021-11-19 21:05:04,233][INFO ][test-runner-#10093%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] [21:05:04] : [Step 4/5] [2021-11-19 21:05:04,233][INFO ][test-runner-#10093%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- NodeValidationPluginProvider 1.0 [21:05:04] : [Step 4/5] [2021-11-19 21:05:04,233][INFO ][test-runner-#10093%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- null [21:05:04] : [Step 4/5] [2021-11-19 21:05:04,234][INFO ][test-runner-#10093%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] [21:05:04] : [Step 4/5] [2021-11-19 21:05:04,234][INFO ][test-runner-#10093%encryption.EncryptedCacheNodeJoinTest%][FailureProcessor] Configured failure handler: [hnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]]] [21:05:04] : [Step 4/5] [2021-11-19 21:05:04,249][INFO ][test-runner-#10093%encryption.EncryptedCacheNodeJoinTest%][TcpCommunicationSpi] Successfully bound communication NIO server to TCP port [port=45150, locHost=/127.0.0.1, selectorsCnt=12, selectorSpins=0, pairedConn=false] [21:05:04]W: [org.apache.ignite:ignite-core] [2021-11-19 21:05:04,250][WARN ][test-runner-#10093%encryption.EncryptedCacheNodeJoinTest%][TcpCommunicationSpi] Message queue limit is set to 0 which may lead to potential OOMEs when running cache operations in FULL_ASYNC or PRIMARY_SYNC modes due to message queues growth on sender and receiver sides. [21:05:04] : [Step 4/5] [2021-11-19 21:05:04,256][INFO ][test-runner-#10093%encryption.EncryptedCacheNodeJoinTest%][GridCollisionManager] Collision resolution is disabled (all jobs will be activated upon arrival). [21:05:04] : [Step 4/5] [2021-11-19 21:05:04,256][INFO ][test-runner-#10093%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] Security status [authentication=off, sandbox=off, tls/ssl=off] [21:05:04] : [Step 4/5] [2021-11-19 21:05:04,318][INFO ][test-runner-#10093%encryption.EncryptedCacheNodeJoinTest%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:05:04] : [Step 4/5] [2021-11-19 21:05:04,405][INFO ][test-runner-#10093%encryption.EncryptedCacheNodeJoinTest%][MaintenanceProcessor] Resolved store directory for node persistent data: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0 [21:05:04] : [Step 4/5] [2021-11-19 21:05:04,406][INFO ][test-runner-#10093%encryption.EncryptedCacheNodeJoinTest%][CacheObjectBinaryProcessorImpl] Resolved directory for serialized binary metadata: /opt/buildagent/work/7bc1c54bc719b67c/work/db/binary_meta/grid_0 [21:05:04] : [Step 4/5] [2021-11-19 21:05:04,411][INFO ][test-runner-#10093%encryption.EncryptedCacheNodeJoinTest%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0 [21:05:04] : [Step 4/5] [2021-11-19 21:05:04,411][INFO ][test-runner-#10093%encryption.EncryptedCacheNodeJoinTest%][FileWriteAheadLogManager] Resolved write ahead log work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0 [21:05:04] : [Step 4/5] [2021-11-19 21:05:04,412][INFO ][test-runner-#10093%encryption.EncryptedCacheNodeJoinTest%][FileWriteAheadLogManager] Resolved write ahead log archive directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0 [21:05:04] : [Step 4/5] [2021-11-19 21:05:04,839][INFO ][test-runner-#10093%encryption.EncryptedCacheNodeJoinTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000000.wal [21:05:04]W: [org.apache.ignite:ignite-core] [2021-11-19 21:05:04,840][WARN ][test-runner-#10093%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] DataRegion maxSize=10.5 MB is smaller than defaultInitialSize=268.4 MB, setting initialSize to 10.5 MB [21:05:04] : [Step 4/5] [2021-11-19 21:05:04,847][INFO ][test-runner-#10093%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Configured data regions initialized successfully [total=5] [21:05:04] : [Step 4/5] [2021-11-19 21:05:04,855][INFO ][test-runner-#10093%encryption.EncryptedCacheNodeJoinTest%][IgniteSnapshotManager] Resolved snapshot work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/snapshots [21:05:04] : [Step 4/5] [2021-11-19 21:05:04,856][INFO ][test-runner-#10093%encryption.EncryptedCacheNodeJoinTest%][IgniteSnapshotManager] Resolved temp directory for snapshot creation: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0/snp [21:05:04] : [Step 4/5] [2021-11-19 21:05:04,859][INFO ][test-runner-#10093%encryption.EncryptedCacheNodeJoinTest%][ClientListenerProcessor] Client connector processor has started on TCP port 10800 [21:05:04] : [Step 4/5] [2021-11-19 21:05:04,865][INFO ][test-runner-#10093%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] Non-loopback local IPs: 172.17.0.4 [21:05:04] : [Step 4/5] [2021-11-19 21:05:04,865][INFO ][test-runner-#10093%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] Enabled local MACs: 0242AC110004 [21:05:04] : [Step 4/5] [2021-11-19 21:05:04,867][INFO ][test-runner-#10093%encryption.EncryptedCacheNodeJoinTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:05:04] : [Step 4/5] [2021-11-19 21:05:04,868][INFO ][test-runner-#10093%encryption.EncryptedCacheNodeJoinTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:05:04] : [Step 4/5] [2021-11-19 21:05:04,868][INFO ][test-runner-#10093%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:05:04] : [Step 4/5] [2021-11-19 21:05:04,872][INFO ][test-runner-#10093%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Applying lost metastore updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:05:04] : [Step 4/5] [2021-11-19 21:05:04,873][INFO ][test-runner-#10093%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=0 ms] [21:05:04] : [Step 4/5] [2021-11-19 21:05:04,874][INFO ][test-runner-#10093%encryption.EncryptedCacheNodeJoinTest%][GridCacheProcessor] Restoring partition state for local groups. [21:05:04] : [Step 4/5] [2021-11-19 21:05:04,874][INFO ][test-runner-#10093%encryption.EncryptedCacheNodeJoinTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=0, partitionsProcessed=0, time=10ms] [21:05:04] : [Step 4/5] [2021-11-19 21:05:04,875][INFO ][test-runner-#10093%encryption.EncryptedCacheNodeJoinTest%][GridEncryptionManager] Encryption keys loaded from metastore. [grps=, masterKeyName=ignite.master.key] [21:05:04] : [Step 4/5] [2021-11-19 21:05:04,881][INFO ][test-runner-#10093%encryption.EncryptedCacheNodeJoinTest%][ClusterProcessor] Cluster ID and tag has been read from metastorage: null [21:05:04] : [Step 4/5] [2021-11-19 21:05:04,881][INFO ][test-runner-#10093%encryption.EncryptedCacheNodeJoinTest%][IgniteClusterImpl] Shutdown policy was updated [oldVal=null, newVal=null] [21:05:04] : [Step 4/5] [2021-11-19 21:05:04,882][INFO ][test-runner-#10093%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Checkpoint frequency deviation changed [oldVal=null, newVal=null] [21:05:04] : [Step 4/5] [2021-11-19 21:05:04,897][INFO ][test-runner-#10093%encryption.EncryptedCacheNodeJoinTest%][FilePageStoreManager] Cleanup cache stores [total=1, left=0, cleanFiles=false] [21:05:04] : [Step 4/5] [2021-11-19 21:05:04,900][INFO ][test-runner-#10093%encryption.EncryptedCacheNodeJoinTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:05:04] : [Step 4/5] [2021-11-19 21:05:04,901][INFO ][test-runner-#10093%encryption.EncryptedCacheNodeJoinTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:05:04] : [Step 4/5] [2021-11-19 21:05:04,902][INFO ][test-runner-#10093%encryption.EncryptedCacheNodeJoinTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:05:04] : [Step 4/5] [2021-11-19 21:05:04,903][INFO ][test-runner-#10093%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Data Regions Started: 5 [21:05:04] : [Step 4/5] [2021-11-19 21:05:04,903][INFO ][test-runner-#10093%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] ^-- sysMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:05:04] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:05:04] : [Step 4/5] ^-- default region [type=default, persistence=true, lazyAlloc=true, [21:05:04] : [Step 4/5] ... initCfg=10MB, maxCfg=10MB, usedRam=0MB, freeRam=100%, allocRam=0MB, allocTotal=0MB] [21:05:04] : [Step 4/5] ^-- metastoreMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:05:04] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:05:04] : [Step 4/5] ^-- TxLog region [type=internal, persistence=true, lazyAlloc=false, [21:05:04] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:05:04] : [Step 4/5] ^-- volatileDsMemPlc region [type=user, persistence=false, lazyAlloc=true, [21:05:04] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB] [21:05:04] : [Step 4/5] ^-- Ignite persistence [used=0MB] [21:05:04] : [Step 4/5] [21:05:04] : [Step 4/5] [2021-11-19 21:05:04,905][INFO ][test-runner-#10093%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Starting binary memory restore for: [-2100569601] [21:05:04] : [Step 4/5] [2021-11-19 21:05:04,917][INFO ][test-runner-#10093%encryption.EncryptedCacheNodeJoinTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:05:04] : [Step 4/5] [2021-11-19 21:05:04,918][INFO ][test-runner-#10093%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:05:04] : [Step 4/5] [2021-11-19 21:05:04,920][INFO ][test-runner-#10093%encryption.EncryptedCacheNodeJoinTest%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000000.wal, offset=0, ver=2] [21:05:04] : [Step 4/5] [2021-11-19 21:05:04,932][INFO ][test-runner-#10093%encryption.EncryptedCacheNodeJoinTest%][GridCacheProcessor] Started cache in recovery mode [name=ignite-sys-cache, id=-2100569601, dataRegionName=sysMemPlc, mode=REPLICATED, atomicity=TRANSACTIONAL, backups=2147483647, mvcc=false] [21:05:04] : [Step 4/5] [2021-11-19 21:05:04,932][INFO ][test-runner-#10093%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Binary recovery performed in 27 ms. [21:05:04] : [Step 4/5] [2021-11-19 21:05:04,933][INFO ][test-runner-#10093%encryption.EncryptedCacheNodeJoinTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:05:04] : [Step 4/5] [2021-11-19 21:05:04,933][INFO ][test-runner-#10093%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Applying lost cache updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:05:05] : [Step 4/5] [2021-11-19 21:05:05,007][INFO ][test-runner-#10093%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=82 ms] [21:05:05] : [Step 4/5] [2021-11-19 21:05:05,007][INFO ][test-runner-#10093%encryption.EncryptedCacheNodeJoinTest%][GridCacheProcessor] Restoring partition state for local groups. [21:05:05] : [Step 4/5] [2021-11-19 21:05:05,024][INFO ][test-runner-#10093%encryption.EncryptedCacheNodeJoinTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=1, partitionsProcessed=100, time=10ms] [21:05:05] : [Step 4/5] [2021-11-19 21:05:05,342][INFO ][test-runner-#10093%encryption.EncryptedCacheNodeJoinTest%][TestTcpDiscoverySpi] Successfully bound to TCP port [port=47500, localHost=localhost/127.0.0.1, locNodeId=00b79a21-5f82-4914-a1d6-50f2b7cd2000] [21:05:05] : [Step 4/5] [2021-11-19 21:05:05,354][INFO ][disco-notifier-worker-#10204%grid-0%][MvccProcessorImpl] Assigned mvcc coordinator [crd=MvccCoordinator [topVer=AffinityTopologyVersion [topVer=1, minorTopVer=0], nodeId=00b79a21-5f82-4914-a1d6-50f2b7cd2000, ver=1637345105351, local=true, initialized=false]] [21:05:05] : [Step 4/5] [2021-11-19 21:05:05,355][INFO ][sys-#10185%grid-0%][ClusterProcessor] Writing cluster ID and tag to metastorage on ready for write ClusterIdAndTag [id=b461fdbb-e7f7-4f48-8369-cc48bdbea497, tag=upbeat_noyce] [21:05:05] : [Step 4/5] [2021-11-19 21:05:05,360][INFO ][disco-notifier-worker-#10204%grid-0%][ClusterProcessor] upbeat_noyce [21:05:05] : [Step 4/5] [2021-11-19 21:05:05,362][INFO ][disco-notifier-worker-#10204%grid-0%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustEnabled' was changed from 'null' to 'false' [21:05:05] : [Step 4/5] [2021-11-19 21:05:05,363][INFO ][disco-notifier-worker-#10204%grid-0%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustTimeout' was changed from 'null' to '300000' [21:05:05] : [Step 4/5] [2021-11-19 21:05:05,364][INFO ][disco-notifier-worker-#10204%grid-0%][IgniteTxManager] Transactions parameter 'longOperationsDumpTimeout' was changed from 'null' to '60000' [21:05:05] : [Step 4/5] [2021-11-19 21:05:05,365][INFO ][disco-notifier-worker-#10204%grid-0%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpThreshold' was changed from 'null' to '0' [21:05:05] : [Step 4/5] [2021-11-19 21:05:05,365][INFO ][disco-notifier-worker-#10204%grid-0%][IgniteTxManager] Transactions parameter 'transactionTimeDumpSamplesCoefficient' was changed from 'null' to '0.0' [21:05:05] : [Step 4/5] [2021-11-19 21:05:05,366][INFO ][disco-notifier-worker-#10204%grid-0%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpSamplesPerSecondLimit' was changed from 'null' to '5' [21:05:05] : [Step 4/5] [2021-11-19 21:05:05,367][INFO ][disco-notifier-worker-#10204%grid-0%][IgniteTxManager] Transactions parameter 'collisionsDumpInterval' was changed from 'null' to '1000' [21:05:05] : [Step 4/5] [2021-11-19 21:05:05,368][INFO ][disco-notifier-worker-#10204%grid-0%][IgniteTxManager] Transactions parameter 'txOwnerDumpRequestsAllowed' was changed from 'null' to 'true' [21:05:05] : [Step 4/5] [2021-11-19 21:05:05,370][INFO ][test-runner-#10093%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] To start Console Management & Monitoring run ignitevisorcmd.{sh|bat} [21:05:05] : [Step 4/5] [2021-11-19 21:05:05,371][INFO ][test-runner-#10093%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] [21:05:05] : [Step 4/5] [21:05:05] : [Step 4/5] >>> +-------------------------------------------+ [21:05:05] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:05:05] : [Step 4/5] >>> +-------------------------------------------+ [21:05:05] : [Step 4/5] >>> OS name: Linux 4.15.0-151-generic amd64 [21:05:05] : [Step 4/5] >>> CPU(s): 24 [21:05:05] : [Step 4/5] >>> Heap: 2.0GB [21:05:05] : [Step 4/5] >>> VM name: 16724@c4dfe9a430b2 [21:05:05] : [Step 4/5] >>> Ignite instance name: grid-0 [21:05:05] : [Step 4/5] >>> Local node [ID=00B79A21-5F82-4914-A1D6-50F2B7CD2000, order=1, clientMode=false] [21:05:05] : [Step 4/5] >>> Local node addresses: [127.0.0.1] [21:05:05] : [Step 4/5] >>> Local ports: TCP:10800 TCP:45150 TCP:47500 [21:05:05] : [Step 4/5] [21:05:05] : [Step 4/5] [2021-11-19 21:05:05,372][INFO ][test-runner-#10093%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] >>> Ignite cluster is in INACTIVE state (limited functionality available). Use control.(sh|bat) script or IgniteCluster.state(ClusterState.ACTIVE) to change the state. [21:05:05] : [Step 4/5] [2021-11-19 21:05:05,373][INFO ][disco-notifier-worker-#10204%grid-0%][GridCacheDatabaseSharedManager] Historical rebalance WAL threshold changed [property=historical.rebalance.threshold, oldVal=null, newVal=500] [21:05:05] : [Step 4/5] [2021-11-19 21:05:05,373][INFO ][test-runner-#10093%encryption.EncryptedCacheNodeJoinTest%][GridDiscoveryManager] Topology snapshot [ver=1, locNode=00b79a21, servers=1, clients=0, state=INACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=00b79a21-5f82-4914-a1d6-50f2b7cd2000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:05:05] : [Step 4/5] [2021-11-19 21:05:05,375][INFO ][test-runner-#10093%encryption.EncryptedCacheNodeJoinTest%][G] Node started : [stage="Configure system pool" (0 ms),stage="Start managers" (196 ms),stage="Configure binary metadata" (2 ms),stage="Start processors" (455 ms),stage="Start 'StanByClusterTestProvider' plugin" (0 ms),stage="Start 'PageMemory tracker plugin' plugin" (0 ms),stage="Start 'TestDistibutedConfigurationPlugin' plugin" (0 ms),stage="Start 'NodeValidationPluginProvider' plugin" (0 ms),stage="Init metastore" (33 ms),stage="Init and start regions" (7 ms),stage="Restore binary memory" (27 ms),stage="Restore logical state" (92 ms),stage="Finish recovery" (315 ms),stage="Join topology" (13 ms),stage="Await transition" (2 ms),stage="Await exchange" (18 ms),stage="Total time" (1160 ms)] [21:05:05] : [Step 4/5] [2021-11-19 21:05:05,376][INFO ][test-runner-#10093%encryption.EncryptedCacheNodeJoinTest%][root] Node started with the following configuration [id=00b79a21-5f82-4914-a1d6-50f2b7cd2000, marshaller=BinaryMarshaller [], discovery=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=5000, ackTimeout=5000, marsh=JdkMarshaller [clsFilter=org.apache.ignite.marshaller.MarshallerUtils$1@5a9aa566], reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], binaryCfg=null, lateAff=true] [21:05:05]W: [org.apache.ignite:ignite-core] [2021-11-19 21:05:05,384][WARN ][test-runner-#10093%encryption.EncryptedCacheNodeJoinTest%][G] Ignite work directory is not provided, automatically resolved to: /opt/buildagent/work/7bc1c54bc719b67c/work [21:05:05] : [Step 4/5] [2021-11-19 21:05:05,385][INFO ][test-runner-#10093%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-3] [21:05:05] : [Step 4/5] [21:05:05] : [Step 4/5] >>> __________ ________________ [21:05:05] : [Step 4/5] >>> / _/ ___/ |/ / _/_ __/ __/ [21:05:05] : [Step 4/5] >>> _/ // (7 7 // / / / / _/ [21:05:05] : [Step 4/5] >>> /___/\___/_/|_/___/ /_/ /___/ [21:05:05] : [Step 4/5] >>> [21:05:05] : [Step 4/5] >>> ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:05:05] : [Step 4/5] >>> 2021 Copyright(C) Apache Software Foundation [21:05:05] : [Step 4/5] >>> [21:05:05] : [Step 4/5] >>> Ignite documentation: http://ignite.apache.org [21:05:05] : [Step 4/5] [21:05:05] : [Step 4/5] [2021-11-19 21:05:05,386][INFO ][test-runner-#10093%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-3] Config URL: n/a [21:05:05] : [Step 4/5] [2021-11-19 21:05:05,386][INFO ][test-runner-#10093%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-3] IgniteConfiguration [igniteInstanceName=grid-3, pubPoolSize=24, svcPoolSize=24, callbackPoolSize=24, stripedPoolSize=24, sysPoolSize=24, mgmtPoolSize=4, dataStreamerPoolSize=24, utilityCachePoolSize=24, utilityCacheKeepAliveTime=60000, p2pPoolSize=2, qryPoolSize=24, buildIdxPoolSize=4, igniteHome=/opt/buildagent/work/7bc1c54bc719b67c, igniteWorkDir=/opt/buildagent/work/7bc1c54bc719b67c/work, mbeanSrv=com.sun.jmx.mbeanserver.JmxMBeanServer@6fe85038, nodeId=30452784-820b-4296-b945-9e9cdd509003, marsh=BinaryMarshaller [], marshLocJobs=false, daemon=false, p2pEnabled=true, netTimeout=10000, netCompressionLevel=1, sndRetryDelay=1000, sndRetryCnt=3, metricsHistSize=10000, metricsUpdateFreq=1000, metricsExpTime=9223372036854775807, discoSpi=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=0, ackTimeout=0, marsh=null, reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], segPlc=STOP, segResolveAttempts=2, waitForSegOnStart=true, allResolversPassReq=true, segChkFreq=10000, commSpi=TcpCommunicationSpi [connectGate=org.apache.ignite.spi.communication.tcp.internal.ConnectGateway@3d59a5c2, ctxInitLatch=java.util.concurrent.CountDownLatch@22199d08[Count = 1], stopping=false, clientPool=null, nioSrvWrapper=null, stateProvider=null], evtSpi=MemoryEventStorageSpi [expireAgeMs=9223372036854775807, expireCnt=10000, filter=null], colSpi=NoopCollisionSpi [], deploySpi=LocalDeploymentSpi [], indexingSpi=org.apache.ignite.spi.indexing.noop.NoopIndexingSpi@63e928d2, addrRslvr=null, encryptionSpi=org.apache.ignite.spi.encryption.keystore.KeystoreEncryptionSpi@7d377f2b, tracingSpi=org.apache.ignite.spi.tracing.NoopTracingSpi@e768a35, clientMode=false, rebalanceThreadPoolSize=4, rebalanceTimeout=10000, rebalanceBatchesPrefetchCnt=3, rebalanceThrottle=0, rebalanceBatchSize=524288, txCfg=TransactionConfiguration [txSerEnabled=false, dfltIsolation=REPEATABLE_READ, dfltConcurrency=PESSIMISTIC, dfltTxTimeout=0, txTimeoutOnPartitionMapExchange=0, deadlockTimeout=10000, pessimisticTxLogSize=0, pessimisticTxLogLinger=10000, tmLookupClsName=null, txManagerFactory=null, useJtaSync=false], cacheSanityCheckEnabled=true, discoStartupDelay=60000, deployMode=SHARED, p2pMissedCacheSize=100, locHost=127.0.0.1, timeSrvPortBase=31100, timeSrvPortRange=100, failureDetectionTimeout=10000, sysWorkerBlockedTimeout=null, clientFailureDetectionTimeout=10000, metricsLogFreq=0, connectorCfg=null, odbcCfg=null, warmupClos=null, atomicCfg=AtomicConfiguration [seqReserveSize=1000, cacheMode=PARTITIONED, backups=1, aff=null, grpName=null], classLdr=null, sslCtxFactory=null, platformCfg=null, binaryCfg=null, memCfg=null, pstCfg=null, dsCfg=DataStorageConfiguration [sysRegionInitSize=41943040, sysRegionMaxSize=104857600, pageSize=4096, concLvl=0, dfltDataRegConf=DataRegionConfiguration [name=default, maxSize=10485760, initSize=268435456, swapPath=null, pageEvictionMode=DISABLED, pageReplacementMode=CLOCK, evictionThreshold=0.9, emptyPagesPoolSize=100, metricsEnabled=false, metricsSubIntervalCount=5, metricsRateTimeInterval=60000, persistenceEnabled=true, checkpointPageBufSize=0, lazyMemoryAllocation=true, warmUpCfg=null], dataRegions=null, storagePath=null, checkpointFreq=180000, lockWaitTime=10000, checkpointThreads=4, checkpointWriteOrder=SEQUENTIAL, walHistSize=20, maxWalArchiveSize=1073741824, walSegments=10, walSegmentSize=67108864, walPath=db/wal, walArchivePath=db/wal/archive, cdcWalPath=db/wal/cdc, cdcEnabled=false, metricsEnabled=false, walMode=FSYNC, walTlbSize=131072, walBuffSize=0, walFlushFreq=2000, walFsyncDelay=1000, walRecordIterBuffSize=67108864, alwaysWriteFullPages=false, fileIOFactory=org.apache.ignite.internal.processors.cache.persistence.file.AsyncFileIOFactory@5317ac0b, metricsSubIntervalCnt=5, metricsRateTimeInterval=60000, walAutoArchiveAfterInactivity=-1, walForceArchiveTimeout=-1, writeThrottlingEnabled=false, walCompactionEnabled=false, walCompactionLevel=1, checkpointReadLockTimeout=null, walPageCompression=DISABLED, walPageCompressionLevel=null, dfltWarmUpCfg=null, encCfg=org.apache.ignite.configuration.EncryptionConfiguration@3537e0b4, defragmentationThreadPoolSize=4, minWalArchiveSize=-1], snapshotPath=snapshots, activeOnStart=true, activeOnStartPropSetFlag=false, autoActivation=true, autoActivationPropSetFlag=false, clusterStateOnStart=null, sqlConnCfg=null, cliConnCfg=ClientConnectorConfiguration [host=null, port=10800, portRange=100, sockSndBufSize=0, sockRcvBufSize=0, tcpNoDelay=true, maxOpenCursorsPerConn=128, threadPoolSize=24, selectorCnt=12, idleTimeout=0, handshakeTimeout=10000, jdbcEnabled=true, odbcEnabled=true, thinCliEnabled=true, sslEnabled=false, useIgniteSslCtxFactory=true, sslClientAuth=false, sslCtxFactory=null, thinCliCfg=ThinClientConfiguration [maxActiveTxPerConn=100, maxActiveComputeTasksPerConn=0]], mvccVacuumThreadCnt=2, mvccVacuumFreq=5000, authEnabled=false, failureHnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]], commFailureRslvr=null, sqlCfg=SqlConfiguration [longQryWarnTimeout=3000, dfltQryTimeout=0, sqlQryHistSize=1000, validationEnabled=false], asyncContinuationExecutor=null] [21:05:05] : [Step 4/5] [2021-11-19 21:05:05,397][INFO ][test-runner-#10093%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-3] Daemon mode: off [21:05:05] : [Step 4/5] [2021-11-19 21:05:05,397][INFO ][test-runner-#10093%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-3] OS: Linux 4.15.0-151-generic amd64 [21:05:05] : [Step 4/5] [2021-11-19 21:05:05,397][INFO ][test-runner-#10093%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-3] OS user: teamcity [21:05:05] : [Step 4/5] [2021-11-19 21:05:05,398][INFO ][test-runner-#10093%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-3] PID: 16724 [21:05:05] : [Step 4/5] [2021-11-19 21:05:05,398][INFO ][test-runner-#10093%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-3] Language runtime: Java Platform API Specification ver. 1.8 [21:05:05] : [Step 4/5] [2021-11-19 21:05:05,398][INFO ][test-runner-#10093%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-3] VM information: Java(TM) SE Runtime Environment 1.8.0_261-b12 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 25.261-b12 [21:05:05] : [Step 4/5] [2021-11-19 21:05:05,399][INFO ][test-runner-#10093%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-3] VM total memory: 1.9GB [21:05:05] : [Step 4/5] [2021-11-19 21:05:05,399][INFO ][test-runner-#10093%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-3] Remote Management [restart: off, REST: off, JMX (remote: off)] [21:05:05] : [Step 4/5] [2021-11-19 21:05:05,400][INFO ][test-runner-#10093%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-3] Logger: GridTestLog4jLogger [quiet=false, config=null] [21:05:05] : [Step 4/5] [2021-11-19 21:05:05,400][INFO ][test-runner-#10093%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-3] IGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c [21:05:05] : [Step 4/5] [2021-11-19 21:05:05,400][INFO ][test-runner-#10093%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-3] VM arguments: [-DIGNITE_DUMP_THREADS_ON_FAILURE=false, -DMono=/usr/bin/mono-sgen, -DMono4.0_x64=/usr/lib/mono/4.0, -DMono4.5_x64=/usr/lib/mono/4.5, -DMonoVersion=6.12.0.90, -DSKIP_BUILD=false, -Dagent.home.dir=/opt/buildagent, -Dagent.name=aitc-lin02_03, -Dagent.ownPort=9090, -Dagent.work.dir=/opt/buildagent/work, -Dbuild.number=95, -Dbuild.vcs.number=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.1=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.GitHubApacheIgnite=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dclassworlds.conf=/opt/buildagent/temp/buildTmp/teamcity.m2.conf, -Dcom.jetbrains.maven.watcher.report.file=/opt/buildagent/temp/buildTmp/maven-build-info.xml, -Djava.io.tmpdir=/opt/buildagent/temp/buildTmp, -Dmaven.home=/opt/buildagent/tools/maven3_6, -Dmaven.multiModuleProjectDirectory=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.agent.cpuBenchmark=457, -Dteamcity.agent.dotnet.agent_url=http://localhost:9090/RPC2, -Dteamcity.agent.dotnet.build_id=6278078, -Dteamcity.auth.password=*******, -Dteamcity.auth.userId=TeamCityBuildId=6278078, -Dteamcity.build.changedFiles.file=/opt/buildagent/temp/buildTmp/changedFiles6342607772318147725.txt, -Dteamcity.build.checkoutDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.build.id=6278078, -Dteamcity.build.properties.file=/opt/buildagent/temp/buildTmp/teamcity.build5164517880467851002.properties, -Dteamcity.build.tempDir=/opt/buildagent/temp/buildTmp, -Dteamcity.build.workingDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.buildConfName=Basic 3, -Dteamcity.buildType.id=IgniteTests24Java8_Basic3, -Dteamcity.configuration.properties.file=/opt/buildagent/temp/buildTmp/teamcity.config5591980786735343870.properties, -Dteamcity.maven.userSettings.path=/opt/buildagent/temp/buildTmp/maven_settings_585072866407032347.xml, -Dteamcity.maven.watcher.home=/opt/buildagent/plugins/mavenPlugin/maven-watcher-jdk16, -Dteamcity.projectName=Ignite Tests 2.x (JDK 8/11), -Dteamcity.runner.properties.file=/opt/buildagent/temp/buildTmp/teamcity.runner9098465561618137420.properties, -Dteamcity.tests.recentlyFailedTests.file=/opt/buildagent/temp/buildTmp/testsToRunFirst3891775683130404069.txt, -Dteamcity.version=2021.2 (build 99542), -ea, -Xms2g, -Xmx2g, -XX:+HeapDumpOnOutOfMemoryError, -DIGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_TEST_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_UPDATE_NOTIFIER=false, -DIGNITE_NO_DISCO_ORDER=true, -DIGNITE_PERFORMANCE_SUGGESTIONS_DISABLED=true, -Djava.net.preferIPv4Stack=true, -DTEST_SCALE_FACTOR=1.0, -DIGNITE_TEST_PROP_LOG4J_FILE=log4j-tc-test.xml, -DIGNITE_QUIET=false, -DIGNITE_MARSHAL_BUFFERS_RECHECK=1000, -Dmaven.repo.local=/opt/buildagent/.m2/repository] [21:05:05] : [Step 4/5] [2021-11-19 21:05:05,406][INFO ][test-runner-#10093%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-3] System cache's DataRegion size is configured to 40 MB. Use DataStorageConfiguration.systemRegionInitialSize property to change the setting. [21:05:05] : [Step 4/5] [2021-11-19 21:05:05,406][INFO ][test-runner-#10093%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-3] Configured caches [in 'sysMemPlc' dataRegion: ['ignite-sys-cache']] [21:05:05]W: [org.apache.ignite:ignite-core] [2021-11-19 21:05:05,407][WARN ][test-runner-#10093%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-3] Peer class loading is enabled (disable it in production for performance and deployment consistency reasons) [21:05:05] : [Step 4/5] [2021-11-19 21:05:05,407][INFO ][test-runner-#10093%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-3] 3-rd party licenses can be found at: /opt/buildagent/work/7bc1c54bc719b67c/libs/licenses [21:05:05] : [Step 4/5] [2021-11-19 21:05:05,412][INFO ][test-runner-#10093%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] Configured plugins: [21:05:05] : [Step 4/5] [2021-11-19 21:05:05,412][INFO ][test-runner-#10093%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- StanByClusterTestProvider 1.0 [21:05:05] : [Step 4/5] [2021-11-19 21:05:05,412][INFO ][test-runner-#10093%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- null [21:05:05] : [Step 4/5] [2021-11-19 21:05:05,412][INFO ][test-runner-#10093%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] [21:05:05] : [Step 4/5] [2021-11-19 21:05:05,413][INFO ][test-runner-#10093%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- PageMemory tracker plugin 1.0 [21:05:05] : [Step 4/5] [2021-11-19 21:05:05,413][INFO ][test-runner-#10093%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- null [21:05:05] : [Step 4/5] [2021-11-19 21:05:05,413][INFO ][test-runner-#10093%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] [21:05:05] : [Step 4/5] [2021-11-19 21:05:05,413][INFO ][test-runner-#10093%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- TestDistibutedConfigurationPlugin 1.0 [21:05:05] : [Step 4/5] [2021-11-19 21:05:05,413][INFO ][test-runner-#10093%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- null [21:05:05] : [Step 4/5] [2021-11-19 21:05:05,413][INFO ][test-runner-#10093%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] [21:05:05] : [Step 4/5] [2021-11-19 21:05:05,414][INFO ][test-runner-#10093%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- NodeValidationPluginProvider 1.0 [21:05:05] : [Step 4/5] [2021-11-19 21:05:05,414][INFO ][test-runner-#10093%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- null [21:05:05] : [Step 4/5] [2021-11-19 21:05:05,414][INFO ][test-runner-#10093%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] [21:05:05] : [Step 4/5] [2021-11-19 21:05:05,414][INFO ][test-runner-#10093%encryption.EncryptedCacheNodeJoinTest%][FailureProcessor] Configured failure handler: [hnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]]] [21:05:05] : [Step 4/5] [2021-11-19 21:05:05,454][INFO ][test-runner-#10093%encryption.EncryptedCacheNodeJoinTest%][TcpCommunicationSpi] Successfully bound communication NIO server to TCP port [port=45151, locHost=/127.0.0.1, selectorsCnt=12, selectorSpins=0, pairedConn=false] [21:05:05]W: [org.apache.ignite:ignite-core] [2021-11-19 21:05:05,454][WARN ][test-runner-#10093%encryption.EncryptedCacheNodeJoinTest%][TcpCommunicationSpi] Message queue limit is set to 0 which may lead to potential OOMEs when running cache operations in FULL_ASYNC or PRIMARY_SYNC modes due to message queues growth on sender and receiver sides. [21:05:05] : [Step 4/5] [2021-11-19 21:05:05,461][INFO ][test-runner-#10093%encryption.EncryptedCacheNodeJoinTest%][GridCollisionManager] Collision resolution is disabled (all jobs will be activated upon arrival). [21:05:05] : [Step 4/5] [2021-11-19 21:05:05,462][INFO ][test-runner-#10093%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-3] Security status [authentication=off, sandbox=off, tls/ssl=off] [21:05:05] : [Step 4/5] [2021-11-19 21:05:05,524][INFO ][test-runner-#10093%encryption.EncryptedCacheNodeJoinTest%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:05:05] : [Step 4/5] [2021-11-19 21:05:05,617][INFO ][test-runner-#10093%encryption.EncryptedCacheNodeJoinTest%][MaintenanceProcessor] Resolved store directory for node persistent data: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_3 [21:05:05] : [Step 4/5] [2021-11-19 21:05:05,618][INFO ][test-runner-#10093%encryption.EncryptedCacheNodeJoinTest%][CacheObjectBinaryProcessorImpl] Resolved directory for serialized binary metadata: /opt/buildagent/work/7bc1c54bc719b67c/work/db/binary_meta/grid_3 [21:05:05] : [Step 4/5] [2021-11-19 21:05:05,623][INFO ][test-runner-#10093%encryption.EncryptedCacheNodeJoinTest%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_3 [21:05:05] : [Step 4/5] [2021-11-19 21:05:05,624][INFO ][test-runner-#10093%encryption.EncryptedCacheNodeJoinTest%][FileWriteAheadLogManager] Resolved write ahead log work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_3 [21:05:05] : [Step 4/5] [2021-11-19 21:05:05,625][INFO ][test-runner-#10093%encryption.EncryptedCacheNodeJoinTest%][FileWriteAheadLogManager] Resolved write ahead log archive directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_3 [21:05:06] : [Step 4/5] [2021-11-19 21:05:06,064][INFO ][test-runner-#10093%encryption.EncryptedCacheNodeJoinTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_3/0000000000000000.wal [21:05:06] : [Step 4/5] [2021-11-19 21:05:06,075][INFO ][test-runner-#10093%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Configured data regions initialized successfully [total=5] [21:05:06] : [Step 4/5] [2021-11-19 21:05:06,081][INFO ][test-runner-#10093%encryption.EncryptedCacheNodeJoinTest%][IgniteSnapshotManager] Resolved snapshot work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/snapshots [21:05:06] : [Step 4/5] [2021-11-19 21:05:06,081][INFO ][test-runner-#10093%encryption.EncryptedCacheNodeJoinTest%][IgniteSnapshotManager] Resolved temp directory for snapshot creation: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_3/snp [21:05:06] : [Step 4/5] [2021-11-19 21:05:06,084][INFO ][test-runner-#10093%encryption.EncryptedCacheNodeJoinTest%][ClientListenerProcessor] Client connector processor has started on TCP port 10801 [21:05:06] : [Step 4/5] [2021-11-19 21:05:06,087][INFO ][test-runner-#10093%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-3] Non-loopback local IPs: 172.17.0.4 [21:05:06] : [Step 4/5] [2021-11-19 21:05:06,087][INFO ][test-runner-#10093%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-3] Enabled local MACs: 0242AC110004 [21:05:06] : [Step 4/5] [2021-11-19 21:05:06,088][INFO ][test-runner-#10093%encryption.EncryptedCacheNodeJoinTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:05:06] : [Step 4/5] [2021-11-19 21:05:06,089][INFO ][test-runner-#10093%encryption.EncryptedCacheNodeJoinTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:05:06] : [Step 4/5] [2021-11-19 21:05:06,089][INFO ][test-runner-#10093%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:05:06] : [Step 4/5] [2021-11-19 21:05:06,092][INFO ][test-runner-#10093%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Applying lost metastore updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:05:06] : [Step 4/5] [2021-11-19 21:05:06,093][INFO ][test-runner-#10093%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=0 ms] [21:05:06] : [Step 4/5] [2021-11-19 21:05:06,093][INFO ][test-runner-#10093%encryption.EncryptedCacheNodeJoinTest%][GridCacheProcessor] Restoring partition state for local groups. [21:05:06] : [Step 4/5] [2021-11-19 21:05:06,093][INFO ][test-runner-#10093%encryption.EncryptedCacheNodeJoinTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=0, partitionsProcessed=0, time=0ms] [21:05:06] : [Step 4/5] [2021-11-19 21:05:06,094][INFO ][test-runner-#10093%encryption.EncryptedCacheNodeJoinTest%][GridEncryptionManager] Encryption keys loaded from metastore. [grps=, masterKeyName=ignite.master.key] [21:05:06] : [Step 4/5] [2021-11-19 21:05:06,095][INFO ][test-runner-#10093%encryption.EncryptedCacheNodeJoinTest%][ClusterProcessor] Cluster ID and tag has been read from metastorage: null [21:05:06] : [Step 4/5] [2021-11-19 21:05:06,095][INFO ][test-runner-#10093%encryption.EncryptedCacheNodeJoinTest%][IgniteClusterImpl] Shutdown policy was updated [oldVal=null, newVal=null] [21:05:06] : [Step 4/5] [2021-11-19 21:05:06,096][INFO ][test-runner-#10093%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Checkpoint frequency deviation changed [oldVal=null, newVal=null] [21:05:06] : [Step 4/5] [2021-11-19 21:05:06,106][INFO ][test-runner-#10093%encryption.EncryptedCacheNodeJoinTest%][FilePageStoreManager] Cleanup cache stores [total=1, left=0, cleanFiles=false] [21:05:06] : [Step 4/5] [2021-11-19 21:05:06,109][INFO ][test-runner-#10093%encryption.EncryptedCacheNodeJoinTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:05:06] : [Step 4/5] [2021-11-19 21:05:06,110][INFO ][test-runner-#10093%encryption.EncryptedCacheNodeJoinTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:05:06] : [Step 4/5] [2021-11-19 21:05:06,111][INFO ][test-runner-#10093%encryption.EncryptedCacheNodeJoinTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:05:06] : [Step 4/5] [2021-11-19 21:05:06,111][INFO ][test-runner-#10093%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Data Regions Started: 5 [21:05:06] : [Step 4/5] [2021-11-19 21:05:06,112][INFO ][test-runner-#10093%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] ^-- sysMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:05:06] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:05:06] : [Step 4/5] ^-- default region [type=default, persistence=true, lazyAlloc=true, [21:05:06] : [Step 4/5] ... initCfg=10MB, maxCfg=10MB, usedRam=0MB, freeRam=100%, allocRam=0MB, allocTotal=0MB] [21:05:06] : [Step 4/5] ^-- metastoreMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:05:06] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:05:06] : [Step 4/5] ^-- TxLog region [type=internal, persistence=true, lazyAlloc=false, [21:05:06] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:05:06] : [Step 4/5] ^-- volatileDsMemPlc region [type=user, persistence=false, lazyAlloc=true, [21:05:06] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB] [21:05:06] : [Step 4/5] ^-- Ignite persistence [used=0MB] [21:05:06] : [Step 4/5] [21:05:06] : [Step 4/5] [2021-11-19 21:05:06,114][INFO ][test-runner-#10093%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Starting binary memory restore for: [-2100569601] [21:05:06] : [Step 4/5] [2021-11-19 21:05:06,126][INFO ][test-runner-#10093%encryption.EncryptedCacheNodeJoinTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:05:06] : [Step 4/5] [2021-11-19 21:05:06,126][INFO ][test-runner-#10093%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:05:06] : [Step 4/5] [2021-11-19 21:05:06,127][INFO ][test-runner-#10093%encryption.EncryptedCacheNodeJoinTest%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_3/0000000000000000.wal, offset=0, ver=2] [21:05:06] : [Step 4/5] [2021-11-19 21:05:06,133][INFO ][test-runner-#10093%encryption.EncryptedCacheNodeJoinTest%][GridCacheProcessor] Started cache in recovery mode [name=ignite-sys-cache, id=-2100569601, dataRegionName=sysMemPlc, mode=REPLICATED, atomicity=TRANSACTIONAL, backups=2147483647, mvcc=false] [21:05:06] : [Step 4/5] [2021-11-19 21:05:06,134][INFO ][test-runner-#10093%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Binary recovery performed in 20 ms. [21:05:06] : [Step 4/5] [2021-11-19 21:05:06,135][INFO ][test-runner-#10093%encryption.EncryptedCacheNodeJoinTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:05:06] : [Step 4/5] [2021-11-19 21:05:06,135][INFO ][test-runner-#10093%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Applying lost cache updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:05:06] : [Step 4/5] [2021-11-19 21:05:06,228][INFO ][test-runner-#10093%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=101 ms] [21:05:06] : [Step 4/5] [2021-11-19 21:05:06,229][INFO ][test-runner-#10093%encryption.EncryptedCacheNodeJoinTest%][GridCacheProcessor] Restoring partition state for local groups. [21:05:06] : [Step 4/5] [2021-11-19 21:05:06,237][INFO ][test-runner-#10093%encryption.EncryptedCacheNodeJoinTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=1, partitionsProcessed=100, time=0ms] [21:05:06] : [Step 4/5] [2021-11-19 21:05:06,542][INFO ][test-runner-#10093%encryption.EncryptedCacheNodeJoinTest%][TestTcpDiscoverySpi] Successfully bound to TCP port [port=47501, localHost=localhost/127.0.0.1, locNodeId=30452784-820b-4296-b945-9e9cdd509003] [21:05:06] : [Step 4/5] [2021-11-19 21:05:06,545][INFO ][tcp-disco-srvr-[:47500]-#529%grid-0%-#10206%grid-0%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=35407] [21:05:06] : [Step 4/5] [2021-11-19 21:05:06,545][INFO ][tcp-disco-srvr-[:47500]-#529%grid-0%-#10206%grid-0%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=35407] [21:05:06] : [Step 4/5] [2021-11-19 21:05:06,546][INFO ][tcp-disco-sock-reader-[]-#535%grid-0%-#10325%grid-0%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:35407, rmtPort=35407] [21:05:06] : [Step 4/5] [2021-11-19 21:05:06,548][INFO ][tcp-disco-sock-reader-[30452784 127.0.0.1:35407]-#535%grid-0%-#10325%grid-0%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=30452784-820b-4296-b945-9e9cdd509003, rmtAddr=/127.0.0.1:35407] [21:05:06] : [Step 4/5] [2021-11-19 21:05:06,554][INFO ][tcp-disco-srvr-[:47501]-#534%grid-3%-#10324%grid-3%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=44715] [21:05:06] : [Step 4/5] [2021-11-19 21:05:06,554][INFO ][tcp-disco-srvr-[:47501]-#534%grid-3%-#10324%grid-3%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=44715] [21:05:06] : [Step 4/5] [2021-11-19 21:05:06,555][INFO ][tcp-disco-sock-reader-[]-#536%grid-3%-#10326%grid-3%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:44715, rmtPort=44715] [21:05:06] : [Step 4/5] [2021-11-19 21:05:06,555][INFO ][tcp-disco-sock-reader-[]-#536%grid-3%-#10326%grid-3%][TestTcpDiscoverySpi] Received ping request from the remote node [rmtNodeId=00b79a21-5f82-4914-a1d6-50f2b7cd2000, rmtAddr=/127.0.0.1:44715, rmtPort=44715] [21:05:06] : [Step 4/5] [2021-11-19 21:05:06,557][INFO ][tcp-disco-sock-reader-[]-#536%grid-3%-#10326%grid-3%][TestTcpDiscoverySpi] Finished writing ping response [rmtNodeId=00b79a21-5f82-4914-a1d6-50f2b7cd2000, rmtAddr=/127.0.0.1:44715, rmtPort=44715] [21:05:06]W: [org.apache.ignite:ignite-core] [2021-11-19 21:05:06,557][WARN ][tcp-disco-sock-reader-[]-#536%grid-3%-#10326%grid-3%][TestTcpDiscoverySpi] Failed to shutdown socket [21:05:06]W: [org.apache.ignite:ignite-core] java.net.SocketException: Socket output is already shutdown [21:05:06]W: [org.apache.ignite:ignite-core] at java.net.Socket.shutdownOutput(Socket.java:1572) [21:05:06]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.close(IgniteUtils.java:4247) [21:05:06]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.discovery.tcp.ServerImpl$SocketReader.body(ServerImpl.java:7370) [21:05:06] : [Step 4/5] [2021-11-19 21:05:06,557][INFO ][tcp-disco-sock-reader-[30452784 127.0.0.1:35407]-#535%grid-0%-#10325%grid-0%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:35407, rmtPort=35407, rmtNodeId=30452784-820b-4296-b945-9e9cdd509003] [21:05:06]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.IgniteSpiThread.run(IgniteSpiThread.java:58) [21:05:06] : [Step 4/5] [2021-11-19 21:05:06,559][INFO ][tcp-disco-sock-reader-[]-#536%grid-3%-#10326%grid-3%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:44715, rmtPort=44715, rmtNodeId=null] [21:05:06] : [Step 4/5] [2021-11-19 21:05:06,561][INFO ][tcp-disco-msg-worker-[crd]-#528%grid-0%-#10205%grid-0%][GridEncryptionManager] Joining node doesn't have stored group keys [node=30452784-820b-4296-b945-9e9cdd509003] [21:05:06] : [Step 4/5] [2021-11-19 21:05:06,568][INFO ][tcp-disco-msg-worker-[crd]-#528%grid-0%-#10205%grid-0%][TestTcpDiscoverySpi] New next node [newNext=TcpDiscoveryNode [id=30452784-820b-4296-b945-9e9cdd509003, consistentId=grid-3, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=0, intOrder=2, lastExchangeTime=1637345106550, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false]] [21:05:06] : [Step 4/5] [2021-11-19 21:05:06,569][INFO ][tcp-disco-srvr-[:47501]-#534%grid-3%-#10324%grid-3%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=53493] [21:05:06] : [Step 4/5] [2021-11-19 21:05:06,570][INFO ][tcp-disco-srvr-[:47501]-#534%grid-3%-#10324%grid-3%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=53493] [21:05:06] : [Step 4/5] [2021-11-19 21:05:06,570][INFO ][tcp-disco-sock-reader-[]-#537%grid-3%-#10327%grid-3%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:53493, rmtPort=53493] [21:05:06] : [Step 4/5] [2021-11-19 21:05:06,571][INFO ][tcp-disco-sock-reader-[00b79a21 127.0.0.1:53493]-#537%grid-3%-#10327%grid-3%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=00b79a21-5f82-4914-a1d6-50f2b7cd2000, rmtAddr=/127.0.0.1:53493] [21:05:06] : [Step 4/5] [2021-11-19 21:05:06,575][INFO ][tcp-disco-msg-worker-[]-#533%grid-3%-#10323%grid-3%][TestTcpDiscoverySpi] New next node [newNext=TcpDiscoveryNode [id=00b79a21-5f82-4914-a1d6-50f2b7cd2000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345106570, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false]] [21:05:06] : [Step 4/5] [2021-11-19 21:05:06,575][INFO ][tcp-disco-srvr-[:47500]-#529%grid-0%-#10206%grid-0%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=57173] [21:05:06] : [Step 4/5] [2021-11-19 21:05:06,576][INFO ][tcp-disco-srvr-[:47500]-#529%grid-0%-#10206%grid-0%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=57173] [21:05:06] : [Step 4/5] [2021-11-19 21:05:06,576][INFO ][tcp-disco-sock-reader-[]-#538%grid-0%-#10328%grid-0%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:57173, rmtPort=57173] [21:05:06] : [Step 4/5] [2021-11-19 21:05:06,577][INFO ][tcp-disco-sock-reader-[30452784 127.0.0.1:57173]-#538%grid-0%-#10328%grid-0%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=30452784-820b-4296-b945-9e9cdd509003, rmtAddr=/127.0.0.1:57173] [21:05:06] : [Step 4/5] [2021-11-19 21:05:06,579][INFO ][disco-event-worker-#10208%grid-0%][GridDiscoveryManager] Added new node to topology: TcpDiscoveryNode [id=30452784-820b-4296-b945-9e9cdd509003, consistentId=grid-3, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637345106550, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false] [21:05:06] : [Step 4/5] [2021-11-19 21:05:06,580][INFO ][disco-event-worker-#10208%grid-0%][GridDiscoveryManager] Topology snapshot [ver=2, locNode=00b79a21, servers=2, clients=0, state=INACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=00b79a21-5f82-4914-a1d6-50f2b7cd2000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=30452784-820b-4296-b945-9e9cdd509003, consistentId=grid-3, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:05:06] : [Step 4/5] [2021-11-19 21:05:06,582][INFO ][tcp-disco-msg-worker-[00b79a21 127.0.0.1:47500]-#533%grid-3%-#10323%grid-3%][ClusterProcessor] upbeat_noyce [21:05:06] : [Step 4/5] [2021-11-19 21:05:06,582][INFO ][tcp-disco-msg-worker-[00b79a21 127.0.0.1:47500]-#533%grid-3%-#10323%grid-3%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustEnabled' was changed from 'null' to 'false' [21:05:06] : [Step 4/5] [2021-11-19 21:05:06,583][INFO ][tcp-disco-msg-worker-[00b79a21 127.0.0.1:47500]-#533%grid-3%-#10323%grid-3%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustTimeout' was changed from 'null' to '300000' [21:05:06] : [Step 4/5] [2021-11-19 21:05:06,583][INFO ][tcp-disco-msg-worker-[00b79a21 127.0.0.1:47500]-#533%grid-3%-#10323%grid-3%][IgniteTxManager] Transactions parameter 'longOperationsDumpTimeout' was changed from 'null' to '60000' [21:05:06] : [Step 4/5] [2021-11-19 21:05:06,584][INFO ][tcp-disco-msg-worker-[00b79a21 127.0.0.1:47500]-#533%grid-3%-#10323%grid-3%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpThreshold' was changed from 'null' to '0' [21:05:06] : [Step 4/5] [2021-11-19 21:05:06,584][INFO ][tcp-disco-msg-worker-[00b79a21 127.0.0.1:47500]-#533%grid-3%-#10323%grid-3%][IgniteTxManager] Transactions parameter 'transactionTimeDumpSamplesCoefficient' was changed from 'null' to '0.0' [21:05:06] : [Step 4/5] [2021-11-19 21:05:06,585][INFO ][tcp-disco-msg-worker-[00b79a21 127.0.0.1:47500]-#533%grid-3%-#10323%grid-3%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpSamplesPerSecondLimit' was changed from 'null' to '5' [21:05:06] : [Step 4/5] [2021-11-19 21:05:06,585][INFO ][tcp-disco-msg-worker-[00b79a21 127.0.0.1:47500]-#533%grid-3%-#10323%grid-3%][IgniteTxManager] Transactions parameter 'collisionsDumpInterval' was changed from 'null' to '1000' [21:05:06] : [Step 4/5] [2021-11-19 21:05:06,586][INFO ][tcp-disco-msg-worker-[00b79a21 127.0.0.1:47500]-#533%grid-3%-#10323%grid-3%][IgniteTxManager] Transactions parameter 'txOwnerDumpRequestsAllowed' was changed from 'null' to 'true' [21:05:06] : [Step 4/5] [2021-11-19 21:05:06,586][INFO ][tcp-disco-msg-worker-[00b79a21 127.0.0.1:47500]-#533%grid-3%-#10323%grid-3%][GridCacheDatabaseSharedManager] Historical rebalance WAL threshold changed [property=historical.rebalance.threshold, oldVal=null, newVal=500] [21:05:06] : [Step 4/5] [2021-11-19 21:05:06,587][INFO ][disco-notifier-worker-#10322%grid-3%][MvccProcessorImpl] Assigned mvcc coordinator [crd=MvccCoordinator [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=0], nodeId=00b79a21-5f82-4914-a1d6-50f2b7cd2000, ver=1637345105351, local=false, initialized=false]] [21:05:06] : [Step 4/5] [2021-11-19 21:05:06,588][INFO ][sys-#10300%grid-3%][ClusterProcessor] Writing cluster ID and tag to metastorage on ready for write ClusterIdAndTag [id=b461fdbb-e7f7-4f48-8369-cc48bdbea497, tag=upbeat_noyce] [21:05:06] : [Step 4/5] [2021-11-19 21:05:06,603][INFO ][test-runner-#10093%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-3] To start Console Management & Monitoring run ignitevisorcmd.{sh|bat} [21:05:06] : [Step 4/5] [2021-11-19 21:05:06,604][INFO ][test-runner-#10093%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-3] [21:05:06] : [Step 4/5] [21:05:06] : [Step 4/5] >>> +-------------------------------------------+ [21:05:06] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:05:06] : [Step 4/5] >>> +-------------------------------------------+ [21:05:06] : [Step 4/5] >>> OS name: Linux 4.15.0-151-generic amd64 [21:05:06] : [Step 4/5] >>> CPU(s): 24 [21:05:06] : [Step 4/5] >>> Heap: 2.0GB [21:05:06] : [Step 4/5] >>> VM name: 16724@c4dfe9a430b2 [21:05:06] : [Step 4/5] >>> Ignite instance name: grid-3 [21:05:06] : [Step 4/5] >>> Local node [ID=30452784-820B-4296-B945-9E9CDD509003, order=2, clientMode=false] [21:05:06] : [Step 4/5] >>> Local node addresses: [127.0.0.1] [21:05:06] : [Step 4/5] >>> Local ports: TCP:10801 TCP:45151 TCP:47501 [21:05:06] : [Step 4/5] [21:05:06] : [Step 4/5] [2021-11-19 21:05:06,605][INFO ][test-runner-#10093%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-3] >>> Ignite cluster is in INACTIVE state (limited functionality available). Use control.(sh|bat) script or IgniteCluster.state(ClusterState.ACTIVE) to change the state. [21:05:06] : [Step 4/5] [2021-11-19 21:05:06,605][INFO ][test-runner-#10093%encryption.EncryptedCacheNodeJoinTest%][GridDiscoveryManager] Topology snapshot [ver=2, locNode=30452784, servers=2, clients=0, state=INACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=00b79a21-5f82-4914-a1d6-50f2b7cd2000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=30452784-820b-4296-b945-9e9cdd509003, consistentId=grid-3, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:05:06] : [Step 4/5] [2021-11-19 21:05:06,606][INFO ][test-runner-#10093%encryption.EncryptedCacheNodeJoinTest%][G] Node started : [stage="Configure system pool" (0 ms),stage="Start managers" (233 ms),stage="Configure binary metadata" (2 ms),stage="Start processors" (465 ms),stage="Start 'StanByClusterTestProvider' plugin" (0 ms),stage="Start 'PageMemory tracker plugin' plugin" (0 ms),stage="Start 'TestDistibutedConfigurationPlugin' plugin" (0 ms),stage="Start 'NodeValidationPluginProvider' plugin" (0 ms),stage="Init metastore" (19 ms),stage="Init and start regions" (7 ms),stage="Restore binary memory" (20 ms),stage="Restore logical state" (102 ms),stage="Finish recovery" (303 ms),stage="Join topology" (46 ms),stage="Await transition" (2 ms),stage="Await exchange" (16 ms),stage="Total time" (1215 ms)] [21:05:06] : [Step 4/5] [2021-11-19 21:05:06,607][INFO ][test-runner-#10093%encryption.EncryptedCacheNodeJoinTest%][root] Node started with the following configuration [id=30452784-820b-4296-b945-9e9cdd509003, marshaller=BinaryMarshaller [], discovery=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=5000, ackTimeout=5000, marsh=JdkMarshaller [clsFilter=org.apache.ignite.marshaller.MarshallerUtils$1@348c042e], reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], binaryCfg=null, lateAff=true] [21:05:06] : [Step 4/5] [2021-11-19 21:05:06,608][INFO ][test-runner-#10093%encryption.EncryptedCacheNodeJoinTest%][GridClusterStateProcessor] Sending activate cluster request with BaselineTopology BaselineTopology [id=0, branchingHash=-2475315499, branchingType='New BaselineTopology', baselineNodes=[grid-0, grid-3]] [21:05:06] : [Step 4/5] [2021-11-19 21:05:06,613][INFO ][disco-notifier-worker-#10204%grid-0%][GridClusterStateProcessor] Received activate cluster request with BaselineTopology[id=0] initiator node ID: 30452784-820b-4296-b945-9e9cdd509003 [21:05:06] : [Step 4/5] [2021-11-19 21:05:06,613][INFO ][disco-notifier-worker-#10204%grid-0%][GridClusterStateProcessor] Started state transition: activate cluster [21:05:06] : [Step 4/5] [2021-11-19 21:05:06,614][INFO ][disco-notifier-worker-#10322%grid-3%][GridClusterStateProcessor] Received activate cluster request with BaselineTopology[id=0] initiator node ID: 30452784-820b-4296-b945-9e9cdd509003 [21:05:06] : [Step 4/5] [2021-11-19 21:05:06,616][INFO ][exchange-worker-#10209%grid-0%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], crd=true, evt=DISCOVERY_CUSTOM_EVT, evtNode=30452784-820b-4296-b945-9e9cdd509003, customEvt=ChangeGlobalStateMessage [id=b503d593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqId=3004bba0-2bc6-4c85-ade2-e639015672ee, initiatingNodeId=30452784-820b-4296-b945-9e9cdd509003, state=ACTIVE, baselineTopology=BaselineTopology [id=0, branchingHash=-2475315499, branchingType='New BaselineTopology', baselineNodes=[grid-0, grid-3]], forceChangeBaselineTopology=false, timestamp=1637345106608, forceDeactivation=true], allowMerge=false, exchangeFreeSwitch=false] [21:05:06] : [Step 4/5] [2021-11-19 21:05:06,618][INFO ][exchange-worker-#10209%grid-0%][GridDhtPartitionsExchangeFuture] Start activation process [nodeId=00b79a21-5f82-4914-a1d6-50f2b7cd2000, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]]. New state: ACTIVE [21:05:06] : [Step 4/5] [2021-11-19 21:05:06,616][INFO ][disco-notifier-worker-#10322%grid-3%][GridClusterStateProcessor] Started state transition: activate cluster [21:05:06] : [Step 4/5] [2021-11-19 21:05:06,618][INFO ][exchange-worker-#10209%grid-0%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0 [21:05:06] : [Step 4/5] [2021-11-19 21:05:06,619][INFO ][exchange-worker-#10331%grid-3%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], crd=false, evt=DISCOVERY_CUSTOM_EVT, evtNode=30452784-820b-4296-b945-9e9cdd509003, customEvt=ChangeGlobalStateMessage [id=b503d593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqId=3004bba0-2bc6-4c85-ade2-e639015672ee, initiatingNodeId=30452784-820b-4296-b945-9e9cdd509003, state=ACTIVE, baselineTopology=BaselineTopology [id=0, branchingHash=-2475315499, branchingType='New BaselineTopology', baselineNodes=[grid-0, grid-3]], forceChangeBaselineTopology=false, timestamp=1637345106608, forceDeactivation=true], allowMerge=false, exchangeFreeSwitch=false] [21:05:06] : [Step 4/5] [2021-11-19 21:05:06,620][INFO ][exchange-worker-#10331%grid-3%][GridDhtPartitionsExchangeFuture] Start activation process [nodeId=30452784-820b-4296-b945-9e9cdd509003, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]]. New state: ACTIVE [21:05:06] : [Step 4/5] [2021-11-19 21:05:06,620][INFO ][exchange-worker-#10331%grid-3%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_3 [21:05:06] : [Step 4/5] [2021-11-19 21:05:06,620][INFO ][exchange-worker-#10209%grid-0%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000000.wal, offset=8713, ver=2] [21:05:06] : [Step 4/5] [2021-11-19 21:05:06,622][INFO ][exchange-worker-#10331%grid-3%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_3/0000000000000000.wal, offset=8713, ver=2] [21:05:06] : [Step 4/5] [2021-11-19 21:05:06,623][INFO ][exchange-worker-#10209%grid-0%][GridClusterStateProcessor] Writing BaselineTopology[id=0] [21:05:06] : [Step 4/5] [2021-11-19 21:05:06,624][INFO ][exchange-worker-#10331%grid-3%][GridClusterStateProcessor] Writing BaselineTopology[id=0] [21:05:06] : [Step 4/5] [2021-11-19 21:05:06,633][INFO ][exchange-worker-#10209%grid-0%][GridCacheDatabaseSharedManager] Finish recovery performed in 14 ms. [21:05:06] : [Step 4/5] [2021-11-19 21:05:06,633][INFO ][exchange-worker-#10331%grid-3%][GridCacheDatabaseSharedManager] Finish recovery performed in 12 ms. [21:05:06] : [Step 4/5] [2021-11-19 21:05:06,634][INFO ][exchange-worker-#10209%grid-0%][msg] Components activation performed in 16 ms. [21:05:06] : [Step 4/5] [2021-11-19 21:05:06,635][INFO ][exchange-worker-#10331%grid-3%][msg] Components activation performed in 15 ms. [21:05:06] : [Step 4/5] [2021-11-19 21:05:06,636][INFO ][exchange-worker-#10209%grid-0%][GridCacheProcessor] Finished recovery for cache [cache=ignite-sys-cache, grp=ignite-sys-cache, startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:05:06] : [Step 4/5] [2021-11-19 21:05:06,636][INFO ][exchange-worker-#10331%grid-3%][GridCacheProcessor] Finished recovery for cache [cache=ignite-sys-cache, grp=ignite-sys-cache, startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:05:06] : [Step 4/5] [2021-11-19 21:05:06,637][INFO ][exchange-worker-#10209%grid-0%][GridDhtPartitionsExchangeFuture] Successfully activated caches [nodeId=00b79a21-5f82-4914-a1d6-50f2b7cd2000, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], newState=ACTIVE] [21:05:06] : [Step 4/5] [2021-11-19 21:05:06,637][INFO ][exchange-worker-#10331%grid-3%][GridDhtPartitionsExchangeFuture] Successfully activated caches [nodeId=30452784-820b-4296-b945-9e9cdd509003, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], newState=ACTIVE] [21:05:06] : [Step 4/5] [2021-11-19 21:05:06,638][INFO ][exchange-worker-#10209%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:05:06] : [Step 4/5] [2021-11-19 21:05:06,638][INFO ][exchange-worker-#10331%grid-3%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:05:06] : [Step 4/5] [2021-11-19 21:05:06,681][INFO ][exchange-worker-#10209%grid-0%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], crd=true] [21:05:06] : [Step 4/5] [2021-11-19 21:05:06,684][INFO ][grid-nio-worker-tcp-comm-0-#10148%TcpCommunicationSpi%][TcpCommunicationSpi] Accepted incoming communication connection [locAddr=/127.0.0.1:45150, rmtAddr=/127.0.0.1:59718] [21:05:06] : [Step 4/5] [2021-11-19 21:05:06,686][INFO ][grid-nio-worker-tcp-comm-0-#10266%TcpCommunicationSpi%][TcpCommunicationSpi] Established outgoing communication connection [locAddr=/127.0.0.1:59718, rmtAddr=/127.0.0.1:45150] [21:05:06] : [Step 4/5] [2021-11-19 21:05:06,687][INFO ][exchange-worker-#10331%grid-3%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], crd=false] [21:05:06] : [Step 4/5] [2021-11-19 21:05:06,689][INFO ][sys-#10182%grid-0%][GridDhtPartitionsExchangeFuture] Coordinator received single message [ver=AffinityTopologyVersion [topVer=2, minorTopVer=1], node=30452784-820b-4296-b945-9e9cdd509003, allReceived=true] [21:05:06] : [Step 4/5] [2021-11-19 21:05:06,690][INFO ][sys-#10182%grid-0%][GridDhtPartitionsExchangeFuture] finishExchangeOnCoordinator [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:05:06] : [Step 4/5] [2021-11-19 21:05:06,697][INFO ][sys-#10182%grid-0%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], err=null, rebalanced=true, wasRebalanced=false] [21:05:06] : [Step 4/5] [2021-11-19 21:05:06,699][INFO ][disco-notifier-worker-#10322%grid-3%][GridClusterStateProcessor] Received state change finish message: ACTIVE [21:05:06] : [Step 4/5] [2021-11-19 21:05:06,699][INFO ][sys-#10308%grid-3%][GridDhtPartitionsExchangeFuture] Received full message, will finish exchange [node=00b79a21-5f82-4914-a1d6-50f2b7cd2000, resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:05:06] : [Step 4/5] [2021-11-19 21:05:06,698][INFO ][disco-notifier-worker-#10204%grid-0%][GridClusterStateProcessor] Received state change finish message: ACTIVE [21:05:06] : [Step 4/5] [2021-11-19 21:05:06,704][INFO ][disco-notifier-worker-#10204%grid-0%][GridClusterStateProcessor] Cluster state was changed from INACTIVE to ACTIVE [21:05:06] : [Step 4/5] [2021-11-19 21:05:06,704][INFO ][sys-#10182%grid-0%][GridCacheProcessor] Finish proxy initialization, cacheName=ignite-sys-cache, localNodeId=00b79a21-5f82-4914-a1d6-50f2b7cd2000 [21:05:06] : [Step 4/5] [2021-11-19 21:05:06,704][INFO ][disco-notifier-worker-#10322%grid-3%][GridClusterStateProcessor] Cluster state was changed from INACTIVE to ACTIVE [21:05:06] : [Step 4/5] [2021-11-19 21:05:06,705][INFO ][sys-#10199%grid-0%][DistributedBaselineConfiguration] Baseline auto-adjust is 'disabled' with timeout='300000' ms [21:05:06] : [Step 4/5] [2021-11-19 21:05:06,706][INFO ][exchange-worker-#10209%grid-0%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=2, minorTopVer=1], force=false, evt=DISCOVERY_CUSTOM_EVT, node=30452784-820b-4296-b945-9e9cdd509003] [21:05:06] : [Step 4/5] [2021-11-19 21:05:06,702][INFO ][sys-#10321%grid-3%][GridCachePartitionExchangeManager] Delay process full message without exchange id (there is exchange in progress) [nodeId=00b79a21-5f82-4914-a1d6-50f2b7cd2000] [21:05:06] : [Step 4/5] [2021-11-19 21:05:06,706][INFO ][sys-#10199%grid-0%][GridClusterStateProcessor] Successfully performed final activation steps [nodeId=00b79a21-5f82-4914-a1d6-50f2b7cd2000, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:05:06] : [Step 4/5] [2021-11-19 21:05:06,706][INFO ][sys-#10182%grid-0%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=00b79a21-5f82-4914-a1d6-50f2b7cd2000, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=30452784-820b-4296-b945-9e9cdd509003, consistentId=grid-3, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637345106550, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:05:06] : [Step 4/5] [2021-11-19 21:05:06,705][INFO ][sys-#10308%grid-3%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], err=null, rebalanced=true, wasRebalanced=false] [21:05:06] : [Step 4/5] [2021-11-19 21:05:06,709][INFO ][sys-#10182%grid-0%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (3 ms), stage="Update caches registry" (18 ms), stage="Start caches" (0 ms), stage="Affinity initialization on cache group start" (0 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Restore partition states" (0 ms), stage="After states restored callback" (42 ms), stage="WAL history reservation" (0 ms), stage="Waiting for all single messages" (9 ms), stage="Affinity recalculation (crd)" (0 ms), stage="Collect update counters and create affinity messages" (0 ms), stage="Assign partitions states" (0 ms), stage="Validate partitions states" (0 ms), stage="Ideal affinity diff calculation (enforced)" (0 ms), stage="Apply update counters" (0 ms), stage="Full message preparing" (4 ms), stage="Full message sending" (0 ms), stage="State finish message sending" (0 ms), stage="Detect lost partitions" (4 ms), stage="Exchange done" (6 ms), stage="Total time" (86 ms), Discovery lag=4 ms, Latest started node id=30452784-820b-4296-b945-9e9cdd509003] [21:05:06] : [Step 4/5] [2021-11-19 21:05:06,712][INFO ][sys-#10308%grid-3%][GridCacheProcessor] Finish proxy initialization, cacheName=ignite-sys-cache, localNodeId=30452784-820b-4296-b945-9e9cdd509003 [21:05:06] : [Step 4/5] [2021-11-19 21:05:06,711][INFO ][db-checkpoint-thread-#10341%grid-0%][Checkpointer] Checkpoint started [checkpointId=2f42d1be-8b96-44d4-97fc-0530b01a679e, startPtr=WALPointer [idx=0, fileOff=75216, len=1963], checkpointBeforeLockTime=11ms, checkpointLockWait=22ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=10ms, writeCheckpointEntryDuration=19ms, splitAndSortCpPagesDuration=1ms, pages=17, reason='node started'] [21:05:06] : [Step 4/5] [2021-11-19 21:05:06,711][INFO ][db-checkpoint-thread-#10340%grid-3%][Checkpointer] Checkpoint started [checkpointId=81b92ad1-61ab-4261-9c91-4cd998496935, startPtr=WALPointer [idx=0, fileOff=75216, len=1963], checkpointBeforeLockTime=11ms, checkpointLockWait=22ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=10ms, writeCheckpointEntryDuration=19ms, splitAndSortCpPagesDuration=1ms, pages=17, reason='node started'] [21:05:06] : [Step 4/5] [2021-11-19 21:05:06,716][INFO ][sys-#10308%grid-3%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=30452784-820b-4296-b945-9e9cdd509003, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=30452784-820b-4296-b945-9e9cdd509003, consistentId=grid-3, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637345106693, loc=true, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:05:06] : [Step 4/5] [2021-11-19 21:05:06,716][INFO ][exchange-worker-#10331%grid-3%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=2, minorTopVer=1], force=false, evt=DISCOVERY_CUSTOM_EVT, node=30452784-820b-4296-b945-9e9cdd509003] [21:05:06] : [Step 4/5] [2021-11-19 21:05:06,716][INFO ][sys-#10317%grid-3%][DistributedBaselineConfiguration] Baseline auto-adjust is 'disabled' with timeout='300000' ms [21:05:06] : [Step 4/5] [2021-11-19 21:05:06,714][INFO ][sys-#10182%grid-0%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], stage="Affinity initialization on cache group start [grp=ignite-sys-cache]" (0 ms) (parent=Affinity initialization on cache group start), stage="Affinity centralized initialization (crd) [grp=ignite-sys-cache, crd=true]" (0 ms) (parent=Determine exchange type), stage="Restore partition states [grp=ignite-sys-cache]" (0 ms) (parent=Restore partition states), stage="Affinity recalculation (partitions availability) [grp=ignite-sys-cache]" (0 ms) (parent=Ideal affinity diff calculation (enforced))] [21:05:06] : [Step 4/5] [2021-11-19 21:05:06,720][INFO ][sys-#10317%grid-3%][GridClusterStateProcessor] Successfully performed final activation steps [nodeId=30452784-820b-4296-b945-9e9cdd509003, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:05:06] : [Step 4/5] [2021-11-19 21:05:06,719][INFO ][sys-#10308%grid-3%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (1 ms), stage="Update caches registry" (15 ms), stage="Start caches" (1 ms), stage="Affinity initialization on cache group start" (0 ms), stage="Determine exchange type" (1 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Restore partition states" (0 ms), stage="After states restored callback" (41 ms), stage="WAL history reservation" (0 ms), stage="Waiting for Full message" (17 ms), stage="Affinity recalculation" (5 ms), stage="Full map updating" (0 ms), stage="Detect lost partitions" (6 ms), stage="Exchange done" (7 ms), stage="Total time" (94 ms)] [21:05:06] : [Step 4/5] [2021-11-19 21:05:06,724][INFO ][sys-#10308%grid-3%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], stage="Affinity initialization on cache group start [grp=ignite-sys-cache]" (0 ms) (parent=Affinity initialization on cache group start), stage="Affinity centralized initialization (crd) [grp=ignite-sys-cache, crd=false]" (0 ms) (parent=Determine exchange type), stage="Restore partition states [grp=ignite-sys-cache]" (0 ms) (parent=Restore partition states), stage="Affinity applying from full message [grp=ignite-sys-cache]" (5 ms) (parent=Affinity recalculation)] [21:05:06] : [Step 4/5] [2021-11-19 21:05:06,745][INFO ][exchange-worker-#10209%grid-0%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], crd=true, evt=DISCOVERY_CUSTOM_EVT, evtNode=00b79a21-5f82-4914-a1d6-50f2b7cd2000, customEvt=DynamicCacheChangeBatch [id=1803d593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqs=ArrayList [DynamicCacheChangeRequest [cacheName=encrypted, hasCfg=true, nodeId=00b79a21-5f82-4914-a1d6-50f2b7cd2000, clientStartOnly=false, stop=false, destroy=false, disabledAfterStart=false]], exchangeActions=ExchangeActions [startCaches=[encrypted], stopCaches=null, startGrps=[encrypted], stopGrps=[], resetParts=null, stateChangeRequest=null], startCaches=false], allowMerge=false, exchangeFreeSwitch=false] [21:05:06] : [Step 4/5] [2021-11-19 21:05:06,747][INFO ][exchange-worker-#10209%grid-0%][PageMemoryImpl] Started page memory [memoryAllocated=24.0 MiB, pages=5952, tableSize=474.2 KiB, replacementSize=768 B, checkpointBuffer=10.0 MiB] [21:05:06] : [Step 4/5] [2021-11-19 21:05:06,811][INFO ][exchange-worker-#10209%grid-0%][GridCacheProcessor] Started cache [name=encrypted, id=1613773252, dataRegionName=default, mode=PARTITIONED, atomicity=ATOMIC, backups=0, mvcc=false] [21:05:06]W: [org.apache.ignite:ignite-core] [2021-11-19 21:05:06,813][WARN ][exchange-worker-#10209%grid-0%][CacheAffinitySharedManager] Cache group 'encrypted' brings high overhead for its metainformation in data region 'default'. Metainformation required for its partitions (528 partitions, 4096 bytes per partition, 2 MBs total) will consume more than 15% of data region memory (10 MBs). It may lead to critical errors on the node and cluster instability. Please reduce number of partitions, add more memory to the data region or add more server nodes for this cache group. [21:05:06] : [Step 4/5] [2021-11-19 21:05:06,814][INFO ][exchange-worker-#10209%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], waitTime=0ms, futInfo=NA, mode=DISTRIBUTED] [21:05:06] : [Step 4/5] [2021-11-19 21:05:06,917][INFO ][exchange-worker-#10331%grid-3%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], crd=false, evt=DISCOVERY_CUSTOM_EVT, evtNode=00b79a21-5f82-4914-a1d6-50f2b7cd2000, customEvt=DynamicCacheChangeBatch [id=1803d593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqs=ArrayList [DynamicCacheChangeRequest [cacheName=encrypted, hasCfg=true, nodeId=00b79a21-5f82-4914-a1d6-50f2b7cd2000, clientStartOnly=false, stop=false, destroy=false, disabledAfterStart=false]], exchangeActions=ExchangeActions [startCaches=[encrypted], stopCaches=null, startGrps=[encrypted], stopGrps=[], resetParts=null, stateChangeRequest=null], startCaches=false], allowMerge=false, exchangeFreeSwitch=false] [21:05:06] : [Step 4/5] [2021-11-19 21:05:06,945][INFO ][exchange-worker-#10331%grid-3%][PageMemoryImpl] Started page memory [memoryAllocated=24.0 MiB, pages=5952, tableSize=474.2 KiB, replacementSize=768 B, checkpointBuffer=10.0 MiB] [21:05:07] : [Step 4/5] [2021-11-19 21:05:07,010][INFO ][exchange-worker-#10331%grid-3%][GridCacheProcessor] Started cache [name=encrypted, id=1613773252, dataRegionName=default, mode=PARTITIONED, atomicity=ATOMIC, backups=0, mvcc=false] [21:05:07]W: [org.apache.ignite:ignite-core] [2021-11-19 21:05:07,012][WARN ][exchange-worker-#10331%grid-3%][CacheAffinitySharedManager] Cache group 'encrypted' brings high overhead for its metainformation in data region 'default'. Metainformation required for its partitions (496 partitions, 4096 bytes per partition, 1 MBs total) will consume more than 15% of data region memory (10 MBs). It may lead to critical errors on the node and cluster instability. Please reduce number of partitions, add more memory to the data region or add more server nodes for this cache group. [21:05:07] : [Step 4/5] [2021-11-19 21:05:07,013][INFO ][exchange-worker-#10331%grid-3%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], waitTime=0ms, futInfo=NA, mode=DISTRIBUTED] [21:05:07] : [Step 4/5] [2021-11-19 21:05:07,014][INFO ][exchange-worker-#10209%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partitions release latch: ServerLatch [permits=0, pendingAcks=HashSet [], super=CompletableLatch [id=CompletableLatchUid [id=exchange, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2]]]] [21:05:07] : [Step 4/5] [2021-11-19 21:05:07,015][INFO ][exchange-worker-#10331%grid-3%][GridDhtPartitionsExchangeFuture] Finished waiting for partitions release latch: ClientLatch [coordinator=TcpDiscoveryNode [id=00b79a21-5f82-4914-a1d6-50f2b7cd2000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345106570, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], ackSent=true, super=CompletableLatch [id=CompletableLatchUid [id=exchange, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2]]]] [21:05:07] : [Step 4/5] [2021-11-19 21:05:07,015][INFO ][exchange-worker-#10209%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:05:07] : [Step 4/5] [2021-11-19 21:05:07,016][INFO ][exchange-worker-#10331%grid-3%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:05:07] : [Step 4/5] [2021-11-19 21:05:07,059][INFO ][exchange-worker-#10331%grid-3%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], crd=false] [21:05:07] : [Step 4/5] [2021-11-19 21:05:07,062][INFO ][exchange-worker-#10209%grid-0%][GridDhtPartitionsExchangeFuture] Coordinator received single message [ver=AffinityTopologyVersion [topVer=2, minorTopVer=2], node=30452784-820b-4296-b945-9e9cdd509003, allReceived=true] [21:05:07] : [Step 4/5] [2021-11-19 21:05:07,063][INFO ][exchange-worker-#10209%grid-0%][GridDhtPartitionsExchangeFuture] finishExchangeOnCoordinator [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2]] [21:05:07] : [Step 4/5] [2021-11-19 21:05:07,070][INFO ][exchange-worker-#10209%grid-0%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], err=null, rebalanced=true, wasRebalanced=true] [21:05:07] : [Step 4/5] [2021-11-19 21:05:07,071][INFO ][sys-#10304%grid-3%][GridDhtPartitionsExchangeFuture] Received full message, will finish exchange [node=00b79a21-5f82-4914-a1d6-50f2b7cd2000, resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2]] [21:05:07] : [Step 4/5] [2021-11-19 21:05:07,071][INFO ][exchange-worker-#10209%grid-0%][GridCacheProcessor] Finish proxy initialization, cacheName=encrypted, localNodeId=00b79a21-5f82-4914-a1d6-50f2b7cd2000 [21:05:07] : [Step 4/5] [2021-11-19 21:05:07,074][INFO ][exchange-worker-#10209%grid-0%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=00b79a21-5f82-4914-a1d6-50f2b7cd2000, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=00b79a21-5f82-4914-a1d6-50f2b7cd2000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345106724, loc=true, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2]] [21:05:07] : [Step 4/5] [2021-11-19 21:05:07,075][INFO ][exchange-worker-#10209%grid-0%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (1 ms), stage="Update caches registry" (0 ms), stage="Start caches" (64 ms), stage="Affinity initialization on cache group start" (2 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Wait partitions release latch [latch=exchange]" (200 ms), stage="Wait partitions release [latch=exchange]" (1 ms), stage="Restore partition states" (14 ms), stage="After states restored callback" (31 ms), stage="WAL history reservation" (0 ms), stage="Waiting for all single messages" (0 ms), stage="Affinity recalculation (crd)" (0 ms), stage="Collect update counters and create affinity messages" (0 ms), stage="Assign partitions states" (3 ms), stage="Validate partitions states" (0 ms), stage="Apply update counters" (0 ms), stage="Full message preparing" (2 ms), stage="Full message sending" (0 ms), stage="Exchange done" (4 ms), stage="Total time" (322 ms), Discovery lag=172 ms, Latest started node id=30452784-820b-4296-b945-9e9cdd509003] [21:05:07] : [Step 4/5] [2021-11-19 21:05:07,075][INFO ][sys-#10304%grid-3%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], err=null, rebalanced=true, wasRebalanced=true] [21:05:07] : [Step 4/5] [2021-11-19 21:05:07,077][INFO ][exchange-worker-#10209%grid-0%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], stage="Affinity initialization on cache group start [grp=encrypted]" (1 ms) (parent=Affinity initialization on cache group start), stage="Restore partition states [grp=encrypted]" (14 ms) (parent=Restore partition states), stage="Restore partition states [grp=ignite-sys-cache]" (0 ms) (parent=Restore partition states)] [21:05:07] : [Step 4/5] [2021-11-19 21:05:07,078][INFO ][sys-#10304%grid-3%][GridCacheProcessor] Finish proxy initialization, cacheName=encrypted, localNodeId=30452784-820b-4296-b945-9e9cdd509003 [21:05:07] : [Step 4/5] [2021-11-19 21:05:07,078][INFO ][exchange-worker-#10209%grid-0%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], crd=true] [21:05:07] : [Step 4/5] [2021-11-19 21:05:07,079][INFO ][sys-#10304%grid-3%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=30452784-820b-4296-b945-9e9cdd509003, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=00b79a21-5f82-4914-a1d6-50f2b7cd2000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345106570, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2]] [21:05:07] : [Step 4/5] [2021-11-19 21:05:07,079][INFO ][exchange-worker-#10209%grid-0%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=2, minorTopVer=2], force=false, evt=DISCOVERY_CUSTOM_EVT, node=00b79a21-5f82-4914-a1d6-50f2b7cd2000] [21:05:07] : [Step 4/5] [2021-11-19 21:05:07,079][INFO ][exchange-worker-#10331%grid-3%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=2, minorTopVer=2], force=false, evt=DISCOVERY_CUSTOM_EVT, node=00b79a21-5f82-4914-a1d6-50f2b7cd2000] [21:05:07] : [Step 4/5] [2021-11-19 21:05:07,080][INFO ][sys-#10304%grid-3%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (10 ms), stage="Update caches registry" (17 ms), stage="Start caches" (65 ms), stage="Affinity initialization on cache group start" (2 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Wait partitions release latch [latch=exchange]" (1 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Restore partition states" (10 ms), stage="After states restored callback" (29 ms), stage="WAL history reservation" (0 ms), stage="Waiting for Full message" (13 ms), stage="Affinity recalculation" (0 ms), stage="Full map updating" (4 ms), stage="Exchange done" (4 ms), stage="Total time" (155 ms)] [21:05:07] : [Step 4/5] [2021-11-19 21:05:07,083][INFO ][sys-#10304%grid-3%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], stage="Affinity initialization on cache group start [grp=encrypted]" (1 ms) (parent=Affinity initialization on cache group start), stage="Restore partition states [grp=encrypted]" (10 ms) (parent=Restore partition states), stage="Restore partition states [grp=ignite-sys-cache]" (0 ms) (parent=Restore partition states)] [21:05:07] : [Step 4/5] [2021-11-19 21:05:07,340][INFO ][db-checkpoint-thread-#10340%grid-3%][Checkpointer] Checkpoint finished [cpId=81b92ad1-61ab-4261-9c91-4cd998496935, pages=17, markPos=WALPointer [idx=0, fileOff=75216, len=1963], walSegmentsCovered=[], markDuration=39ms, pagesWrite=12ms, fsync=609ms, total=693ms] [21:05:07] : [Step 4/5] [2021-11-19 21:05:07,340][INFO ][db-checkpoint-thread-#10341%grid-0%][Checkpointer] Checkpoint finished [cpId=2f42d1be-8b96-44d4-97fc-0530b01a679e, pages=17, markPos=WALPointer [idx=0, fileOff=75216, len=1963], walSegmentsCovered=[], markDuration=36ms, pagesWrite=11ms, fsync=613ms, total=693ms] [21:05:09]W: [org.apache.ignite:ignite-core] [2021-11-19 21:05:09,443][WARN ][test-runner-#10093%encryption.EncryptedCacheNodeJoinTest%][G] Ignite work directory is not provided, automatically resolved to: /opt/buildagent/work/7bc1c54bc719b67c/work [21:05:09] : [Step 4/5] [2021-11-19 21:05:09,443][INFO ][test-runner-#10093%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-4] [21:05:09] : [Step 4/5] [21:05:09] : [Step 4/5] >>> __________ ________________ [21:05:09] : [Step 4/5] >>> / _/ ___/ |/ / _/_ __/ __/ [21:05:09] : [Step 4/5] >>> _/ // (7 7 // / / / / _/ [21:05:09] : [Step 4/5] >>> /___/\___/_/|_/___/ /_/ /___/ [21:05:09] : [Step 4/5] >>> [21:05:09] : [Step 4/5] >>> ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:05:09] : [Step 4/5] >>> 2021 Copyright(C) Apache Software Foundation [21:05:09] : [Step 4/5] >>> [21:05:09] : [Step 4/5] >>> Ignite documentation: http://ignite.apache.org [21:05:09] : [Step 4/5] [21:05:09] : [Step 4/5] [2021-11-19 21:05:09,444][INFO ][test-runner-#10093%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-4] Config URL: n/a [21:05:09] : [Step 4/5] [2021-11-19 21:05:09,444][INFO ][test-runner-#10093%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-4] IgniteConfiguration [igniteInstanceName=grid-4, pubPoolSize=24, svcPoolSize=24, callbackPoolSize=24, stripedPoolSize=24, sysPoolSize=24, mgmtPoolSize=4, dataStreamerPoolSize=24, utilityCachePoolSize=24, utilityCacheKeepAliveTime=60000, p2pPoolSize=2, qryPoolSize=24, buildIdxPoolSize=4, igniteHome=/opt/buildagent/work/7bc1c54bc719b67c, igniteWorkDir=/opt/buildagent/work/7bc1c54bc719b67c/work, mbeanSrv=com.sun.jmx.mbeanserver.JmxMBeanServer@6fe85038, nodeId=403a8bc7-744c-4854-9a1a-6778c9410004, marsh=BinaryMarshaller [], marshLocJobs=false, daemon=false, p2pEnabled=true, netTimeout=10000, netCompressionLevel=1, sndRetryDelay=1000, sndRetryCnt=3, metricsHistSize=10000, metricsUpdateFreq=1000, metricsExpTime=9223372036854775807, discoSpi=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=0, ackTimeout=0, marsh=null, reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], segPlc=STOP, segResolveAttempts=2, waitForSegOnStart=true, allResolversPassReq=true, segChkFreq=10000, commSpi=TcpCommunicationSpi [connectGate=org.apache.ignite.spi.communication.tcp.internal.ConnectGateway@72769fe9, ctxInitLatch=java.util.concurrent.CountDownLatch@3c9f6110[Count = 1], stopping=false, clientPool=null, nioSrvWrapper=null, stateProvider=null], evtSpi=MemoryEventStorageSpi [expireAgeMs=9223372036854775807, expireCnt=10000, filter=null], colSpi=NoopCollisionSpi [], deploySpi=LocalDeploymentSpi [], indexingSpi=org.apache.ignite.spi.indexing.noop.NoopIndexingSpi@3dbd8c60, addrRslvr=null, encryptionSpi=org.apache.ignite.spi.encryption.keystore.KeystoreEncryptionSpi@2f06f024, tracingSpi=org.apache.ignite.spi.tracing.NoopTracingSpi@6eeb8ae, clientMode=false, rebalanceThreadPoolSize=4, rebalanceTimeout=10000, rebalanceBatchesPrefetchCnt=3, rebalanceThrottle=0, rebalanceBatchSize=524288, txCfg=TransactionConfiguration [txSerEnabled=false, dfltIsolation=REPEATABLE_READ, dfltConcurrency=PESSIMISTIC, dfltTxTimeout=0, txTimeoutOnPartitionMapExchange=0, deadlockTimeout=10000, pessimisticTxLogSize=0, pessimisticTxLogLinger=10000, tmLookupClsName=null, txManagerFactory=null, useJtaSync=false], cacheSanityCheckEnabled=true, discoStartupDelay=60000, deployMode=SHARED, p2pMissedCacheSize=100, locHost=127.0.0.1, timeSrvPortBase=31100, timeSrvPortRange=100, failureDetectionTimeout=10000, sysWorkerBlockedTimeout=null, clientFailureDetectionTimeout=10000, metricsLogFreq=0, connectorCfg=null, odbcCfg=null, warmupClos=null, atomicCfg=AtomicConfiguration [seqReserveSize=1000, cacheMode=PARTITIONED, backups=1, aff=null, grpName=null], classLdr=null, sslCtxFactory=null, platformCfg=null, binaryCfg=null, memCfg=null, pstCfg=null, dsCfg=DataStorageConfiguration [sysRegionInitSize=41943040, sysRegionMaxSize=104857600, pageSize=4096, concLvl=0, dfltDataRegConf=DataRegionConfiguration [name=default, maxSize=10485760, initSize=268435456, swapPath=null, pageEvictionMode=DISABLED, pageReplacementMode=CLOCK, evictionThreshold=0.9, emptyPagesPoolSize=100, metricsEnabled=false, metricsSubIntervalCount=5, metricsRateTimeInterval=60000, persistenceEnabled=true, checkpointPageBufSize=0, lazyMemoryAllocation=true, warmUpCfg=null], dataRegions=null, storagePath=null, checkpointFreq=180000, lockWaitTime=10000, checkpointThreads=4, checkpointWriteOrder=SEQUENTIAL, walHistSize=20, maxWalArchiveSize=1073741824, walSegments=10, walSegmentSize=67108864, walPath=db/wal, walArchivePath=db/wal/archive, cdcWalPath=db/wal/cdc, cdcEnabled=false, metricsEnabled=false, walMode=FSYNC, walTlbSize=131072, walBuffSize=0, walFlushFreq=2000, walFsyncDelay=1000, walRecordIterBuffSize=67108864, alwaysWriteFullPages=false, fileIOFactory=org.apache.ignite.internal.processors.cache.persistence.file.AsyncFileIOFactory@1f6dd900, metricsSubIntervalCnt=5, metricsRateTimeInterval=60000, walAutoArchiveAfterInactivity=-1, walForceArchiveTimeout=-1, writeThrottlingEnabled=false, walCompactionEnabled=false, walCompactionLevel=1, checkpointReadLockTimeout=null, walPageCompression=DISABLED, walPageCompressionLevel=null, dfltWarmUpCfg=null, encCfg=org.apache.ignite.configuration.EncryptionConfiguration@367d6a44, defragmentationThreadPoolSize=4, minWalArchiveSize=-1], snapshotPath=snapshots, activeOnStart=true, activeOnStartPropSetFlag=false, autoActivation=true, autoActivationPropSetFlag=false, clusterStateOnStart=null, sqlConnCfg=null, cliConnCfg=ClientConnectorConfiguration [host=null, port=10800, portRange=100, sockSndBufSize=0, sockRcvBufSize=0, tcpNoDelay=true, maxOpenCursorsPerConn=128, threadPoolSize=24, selectorCnt=12, idleTimeout=0, handshakeTimeout=10000, jdbcEnabled=true, odbcEnabled=true, thinCliEnabled=true, sslEnabled=false, useIgniteSslCtxFactory=true, sslClientAuth=false, sslCtxFactory=null, thinCliCfg=ThinClientConfiguration [maxActiveTxPerConn=100, maxActiveComputeTasksPerConn=0]], mvccVacuumThreadCnt=2, mvccVacuumFreq=5000, authEnabled=false, failureHnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]], commFailureRslvr=null, sqlCfg=SqlConfiguration [longQryWarnTimeout=3000, dfltQryTimeout=0, sqlQryHistSize=1000, validationEnabled=false], asyncContinuationExecutor=null] [21:05:09] : [Step 4/5] [2021-11-19 21:05:09,452][INFO ][test-runner-#10093%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-4] Daemon mode: off [21:05:09] : [Step 4/5] [2021-11-19 21:05:09,452][INFO ][test-runner-#10093%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-4] OS: Linux 4.15.0-151-generic amd64 [21:05:09] : [Step 4/5] [2021-11-19 21:05:09,452][INFO ][test-runner-#10093%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-4] OS user: teamcity [21:05:09] : [Step 4/5] [2021-11-19 21:05:09,453][INFO ][test-runner-#10093%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-4] PID: 16724 [21:05:09] : [Step 4/5] [2021-11-19 21:05:09,453][INFO ][test-runner-#10093%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-4] Language runtime: Java Platform API Specification ver. 1.8 [21:05:09] : [Step 4/5] [2021-11-19 21:05:09,453][INFO ][test-runner-#10093%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-4] VM information: Java(TM) SE Runtime Environment 1.8.0_261-b12 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 25.261-b12 [21:05:09] : [Step 4/5] [2021-11-19 21:05:09,453][INFO ][test-runner-#10093%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-4] VM total memory: 1.9GB [21:05:09] : [Step 4/5] [2021-11-19 21:05:09,454][INFO ][test-runner-#10093%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-4] Remote Management [restart: off, REST: off, JMX (remote: off)] [21:05:09] : [Step 4/5] [2021-11-19 21:05:09,454][INFO ][test-runner-#10093%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-4] Logger: GridTestLog4jLogger [quiet=false, config=null] [21:05:09] : [Step 4/5] [2021-11-19 21:05:09,454][INFO ][test-runner-#10093%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-4] IGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c [21:05:09] : [Step 4/5] [2021-11-19 21:05:09,454][INFO ][test-runner-#10093%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-4] VM arguments: [-DIGNITE_DUMP_THREADS_ON_FAILURE=false, -DMono=/usr/bin/mono-sgen, -DMono4.0_x64=/usr/lib/mono/4.0, -DMono4.5_x64=/usr/lib/mono/4.5, -DMonoVersion=6.12.0.90, -DSKIP_BUILD=false, -Dagent.home.dir=/opt/buildagent, -Dagent.name=aitc-lin02_03, -Dagent.ownPort=9090, -Dagent.work.dir=/opt/buildagent/work, -Dbuild.number=95, -Dbuild.vcs.number=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.1=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.GitHubApacheIgnite=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dclassworlds.conf=/opt/buildagent/temp/buildTmp/teamcity.m2.conf, -Dcom.jetbrains.maven.watcher.report.file=/opt/buildagent/temp/buildTmp/maven-build-info.xml, -Djava.io.tmpdir=/opt/buildagent/temp/buildTmp, -Dmaven.home=/opt/buildagent/tools/maven3_6, -Dmaven.multiModuleProjectDirectory=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.agent.cpuBenchmark=457, -Dteamcity.agent.dotnet.agent_url=http://localhost:9090/RPC2, -Dteamcity.agent.dotnet.build_id=6278078, -Dteamcity.auth.password=*******, -Dteamcity.auth.userId=TeamCityBuildId=6278078, -Dteamcity.build.changedFiles.file=/opt/buildagent/temp/buildTmp/changedFiles6342607772318147725.txt, -Dteamcity.build.checkoutDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.build.id=6278078, -Dteamcity.build.properties.file=/opt/buildagent/temp/buildTmp/teamcity.build5164517880467851002.properties, -Dteamcity.build.tempDir=/opt/buildagent/temp/buildTmp, -Dteamcity.build.workingDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.buildConfName=Basic 3, -Dteamcity.buildType.id=IgniteTests24Java8_Basic3, -Dteamcity.configuration.properties.file=/opt/buildagent/temp/buildTmp/teamcity.config5591980786735343870.properties, -Dteamcity.maven.userSettings.path=/opt/buildagent/temp/buildTmp/maven_settings_585072866407032347.xml, -Dteamcity.maven.watcher.home=/opt/buildagent/plugins/mavenPlugin/maven-watcher-jdk16, -Dteamcity.projectName=Ignite Tests 2.x (JDK 8/11), -Dteamcity.runner.properties.file=/opt/buildagent/temp/buildTmp/teamcity.runner9098465561618137420.properties, -Dteamcity.tests.recentlyFailedTests.file=/opt/buildagent/temp/buildTmp/testsToRunFirst3891775683130404069.txt, -Dteamcity.version=2021.2 (build 99542), -ea, -Xms2g, -Xmx2g, -XX:+HeapDumpOnOutOfMemoryError, -DIGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_TEST_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_UPDATE_NOTIFIER=false, -DIGNITE_NO_DISCO_ORDER=true, -DIGNITE_PERFORMANCE_SUGGESTIONS_DISABLED=true, -Djava.net.preferIPv4Stack=true, -DTEST_SCALE_FACTOR=1.0, -DIGNITE_TEST_PROP_LOG4J_FILE=log4j-tc-test.xml, -DIGNITE_QUIET=false, -DIGNITE_MARSHAL_BUFFERS_RECHECK=1000, -Dmaven.repo.local=/opt/buildagent/.m2/repository] [21:05:09] : [Step 4/5] [2021-11-19 21:05:09,458][INFO ][test-runner-#10093%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-4] System cache's DataRegion size is configured to 40 MB. Use DataStorageConfiguration.systemRegionInitialSize property to change the setting. [21:05:09] : [Step 4/5] [2021-11-19 21:05:09,459][INFO ][test-runner-#10093%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-4] Configured caches [in 'sysMemPlc' dataRegion: ['ignite-sys-cache']] [21:05:09] : [Step 4/5] [2021-11-19 21:05:09,459][INFO ][test-runner-#10093%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-4] 3-rd party licenses can be found at: /opt/buildagent/work/7bc1c54bc719b67c/libs/licenses [21:05:09]W: [org.apache.ignite:ignite-core] [2021-11-19 21:05:09,459][WARN ][test-runner-#10093%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-4] Peer class loading is enabled (disable it in production for performance and deployment consistency reasons) [21:05:09] : [Step 4/5] [2021-11-19 21:05:09,463][INFO ][test-runner-#10093%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] Configured plugins: [21:05:09] : [Step 4/5] [2021-11-19 21:05:09,463][INFO ][test-runner-#10093%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- StanByClusterTestProvider 1.0 [21:05:09] : [Step 4/5] [2021-11-19 21:05:09,463][INFO ][test-runner-#10093%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- null [21:05:09] : [Step 4/5] [2021-11-19 21:05:09,463][INFO ][test-runner-#10093%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] [21:05:09] : [Step 4/5] [2021-11-19 21:05:09,464][INFO ][test-runner-#10093%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- PageMemory tracker plugin 1.0 [21:05:09] : [Step 4/5] [2021-11-19 21:05:09,464][INFO ][test-runner-#10093%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- null [21:05:09] : [Step 4/5] [2021-11-19 21:05:09,464][INFO ][test-runner-#10093%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] [21:05:09] : [Step 4/5] [2021-11-19 21:05:09,464][INFO ][test-runner-#10093%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- TestDistibutedConfigurationPlugin 1.0 [21:05:09] : [Step 4/5] [2021-11-19 21:05:09,464][INFO ][test-runner-#10093%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- null [21:05:09] : [Step 4/5] [2021-11-19 21:05:09,464][INFO ][test-runner-#10093%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] [21:05:09] : [Step 4/5] [2021-11-19 21:05:09,465][INFO ][test-runner-#10093%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- NodeValidationPluginProvider 1.0 [21:05:09] : [Step 4/5] [2021-11-19 21:05:09,465][INFO ][test-runner-#10093%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- null [21:05:09] : [Step 4/5] [2021-11-19 21:05:09,465][INFO ][test-runner-#10093%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] [21:05:09] : [Step 4/5] [2021-11-19 21:05:09,465][INFO ][test-runner-#10093%encryption.EncryptedCacheNodeJoinTest%][FailureProcessor] Configured failure handler: [hnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]]] [21:05:09] : [Step 4/5] [2021-11-19 21:05:09,480][INFO ][test-runner-#10093%encryption.EncryptedCacheNodeJoinTest%][TcpCommunicationSpi] Successfully bound communication NIO server to TCP port [port=45152, locHost=/127.0.0.1, selectorsCnt=12, selectorSpins=0, pairedConn=false] [21:05:09]W: [org.apache.ignite:ignite-core] [2021-11-19 21:05:09,480][WARN ][test-runner-#10093%encryption.EncryptedCacheNodeJoinTest%][TcpCommunicationSpi] Message queue limit is set to 0 which may lead to potential OOMEs when running cache operations in FULL_ASYNC or PRIMARY_SYNC modes due to message queues growth on sender and receiver sides. [21:05:09] : [Step 4/5] [2021-11-19 21:05:09,484][INFO ][test-runner-#10093%encryption.EncryptedCacheNodeJoinTest%][GridCollisionManager] Collision resolution is disabled (all jobs will be activated upon arrival). [21:05:09] : [Step 4/5] [2021-11-19 21:05:09,484][INFO ][test-runner-#10093%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-4] Security status [authentication=off, sandbox=off, tls/ssl=off] [21:05:09] : [Step 4/5] [2021-11-19 21:05:09,540][INFO ][test-runner-#10093%encryption.EncryptedCacheNodeJoinTest%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:05:09] : [Step 4/5] [2021-11-19 21:05:09,624][INFO ][test-runner-#10093%encryption.EncryptedCacheNodeJoinTest%][MaintenanceProcessor] Resolved store directory for node persistent data: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_4 [21:05:09] : [Step 4/5] [2021-11-19 21:05:09,625][INFO ][test-runner-#10093%encryption.EncryptedCacheNodeJoinTest%][CacheObjectBinaryProcessorImpl] Resolved directory for serialized binary metadata: /opt/buildagent/work/7bc1c54bc719b67c/work/db/binary_meta/grid_4 [21:05:09] : [Step 4/5] [2021-11-19 21:05:09,629][INFO ][test-runner-#10093%encryption.EncryptedCacheNodeJoinTest%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_4 [21:05:09] : [Step 4/5] [2021-11-19 21:05:09,630][INFO ][test-runner-#10093%encryption.EncryptedCacheNodeJoinTest%][FileWriteAheadLogManager] Resolved write ahead log work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_4 [21:05:09] : [Step 4/5] [2021-11-19 21:05:09,630][INFO ][test-runner-#10093%encryption.EncryptedCacheNodeJoinTest%][FileWriteAheadLogManager] Resolved write ahead log archive directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_4 [21:05:10] : [Step 4/5] [2021-11-19 21:05:10,245][INFO ][test-runner-#10093%encryption.EncryptedCacheNodeJoinTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_4/0000000000000000.wal [21:05:10] : [Step 4/5] [2021-11-19 21:05:10,249][INFO ][test-runner-#10093%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Configured data regions initialized successfully [total=5] [21:05:10] : [Step 4/5] [2021-11-19 21:05:10,252][INFO ][test-runner-#10093%encryption.EncryptedCacheNodeJoinTest%][IgniteSnapshotManager] Resolved snapshot work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/snapshots [21:05:10] : [Step 4/5] [2021-11-19 21:05:10,252][INFO ][test-runner-#10093%encryption.EncryptedCacheNodeJoinTest%][IgniteSnapshotManager] Resolved temp directory for snapshot creation: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_4/snp [21:05:10] : [Step 4/5] [2021-11-19 21:05:10,385][INFO ][test-runner-#10093%encryption.EncryptedCacheNodeJoinTest%][ClientListenerProcessor] Client connector processor has started on TCP port 10802 [21:05:10] : [Step 4/5] [2021-11-19 21:05:10,388][INFO ][test-runner-#10093%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-4] Non-loopback local IPs: 172.17.0.4 [21:05:10] : [Step 4/5] [2021-11-19 21:05:10,389][INFO ][test-runner-#10093%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-4] Enabled local MACs: 0242AC110004 [21:05:10] : [Step 4/5] [2021-11-19 21:05:10,390][INFO ][test-runner-#10093%encryption.EncryptedCacheNodeJoinTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:05:10] : [Step 4/5] [2021-11-19 21:05:10,391][INFO ][test-runner-#10093%encryption.EncryptedCacheNodeJoinTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:05:10] : [Step 4/5] [2021-11-19 21:05:10,392][INFO ][test-runner-#10093%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:05:10] : [Step 4/5] [2021-11-19 21:05:10,394][INFO ][test-runner-#10093%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Applying lost metastore updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:05:10] : [Step 4/5] [2021-11-19 21:05:10,395][INFO ][test-runner-#10093%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=0 ms] [21:05:10] : [Step 4/5] [2021-11-19 21:05:10,395][INFO ][test-runner-#10093%encryption.EncryptedCacheNodeJoinTest%][GridCacheProcessor] Restoring partition state for local groups. [21:05:10] : [Step 4/5] [2021-11-19 21:05:10,396][INFO ][test-runner-#10093%encryption.EncryptedCacheNodeJoinTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=0, partitionsProcessed=0, time=0ms] [21:05:10] : [Step 4/5] [2021-11-19 21:05:10,396][INFO ][test-runner-#10093%encryption.EncryptedCacheNodeJoinTest%][GridEncryptionManager] Encryption keys loaded from metastore. [grps=, masterKeyName=ignite.master.key] [21:05:10] : [Step 4/5] [2021-11-19 21:05:10,398][INFO ][test-runner-#10093%encryption.EncryptedCacheNodeJoinTest%][ClusterProcessor] Cluster ID and tag has been read from metastorage: null [21:05:10] : [Step 4/5] [2021-11-19 21:05:10,398][INFO ][test-runner-#10093%encryption.EncryptedCacheNodeJoinTest%][IgniteClusterImpl] Shutdown policy was updated [oldVal=null, newVal=null] [21:05:10] : [Step 4/5] [2021-11-19 21:05:10,398][INFO ][test-runner-#10093%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Checkpoint frequency deviation changed [oldVal=null, newVal=null] [21:05:11] : [Step 4/5] [2021-11-19 21:05:11,469][INFO ][test-runner-#10093%encryption.EncryptedCacheNodeJoinTest%][FilePageStoreManager] Cleanup cache stores [total=1, left=0, cleanFiles=false] [21:05:11] : [Step 4/5] [2021-11-19 21:05:11,471][INFO ][test-runner-#10093%encryption.EncryptedCacheNodeJoinTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:05:11] : [Step 4/5] [2021-11-19 21:05:11,472][INFO ][test-runner-#10093%encryption.EncryptedCacheNodeJoinTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:05:11] : [Step 4/5] [2021-11-19 21:05:11,474][INFO ][test-runner-#10093%encryption.EncryptedCacheNodeJoinTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:05:11] : [Step 4/5] [2021-11-19 21:05:11,475][INFO ][test-runner-#10093%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Data Regions Started: 5 [21:05:11] : [Step 4/5] [2021-11-19 21:05:11,475][INFO ][test-runner-#10093%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] ^-- sysMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:05:11] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:05:11] : [Step 4/5] ^-- default region [type=default, persistence=true, lazyAlloc=true, [21:05:11] : [Step 4/5] ... initCfg=10MB, maxCfg=10MB, usedRam=0MB, freeRam=100%, allocRam=0MB, allocTotal=0MB] [21:05:11] : [Step 4/5] ^-- metastoreMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:05:11] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:05:11] : [Step 4/5] ^-- TxLog region [type=internal, persistence=true, lazyAlloc=false, [21:05:11] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:05:11] : [Step 4/5] ^-- volatileDsMemPlc region [type=user, persistence=false, lazyAlloc=true, [21:05:11] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB] [21:05:11] : [Step 4/5] ^-- Ignite persistence [used=0MB] [21:05:11] : [Step 4/5] [21:05:11] : [Step 4/5] [2021-11-19 21:05:11,477][INFO ][test-runner-#10093%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Starting binary memory restore for: [-2100569601] [21:05:11] : [Step 4/5] [2021-11-19 21:05:11,487][INFO ][test-runner-#10093%encryption.EncryptedCacheNodeJoinTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:05:11] : [Step 4/5] [2021-11-19 21:05:11,487][INFO ][test-runner-#10093%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:05:11] : [Step 4/5] [2021-11-19 21:05:11,488][INFO ][test-runner-#10093%encryption.EncryptedCacheNodeJoinTest%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_4/0000000000000000.wal, offset=0, ver=2] [21:05:11] : [Step 4/5] [2021-11-19 21:05:11,498][INFO ][test-runner-#10093%encryption.EncryptedCacheNodeJoinTest%][GridCacheProcessor] Started cache in recovery mode [name=ignite-sys-cache, id=-2100569601, dataRegionName=sysMemPlc, mode=REPLICATED, atomicity=TRANSACTIONAL, backups=2147483647, mvcc=false] [21:05:11] : [Step 4/5] [2021-11-19 21:05:11,499][INFO ][test-runner-#10093%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Binary recovery performed in 22 ms. [21:05:11] : [Step 4/5] [2021-11-19 21:05:11,500][INFO ][test-runner-#10093%encryption.EncryptedCacheNodeJoinTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:05:11] : [Step 4/5] [2021-11-19 21:05:11,500][INFO ][test-runner-#10093%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Applying lost cache updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:05:11] : [Step 4/5] [2021-11-19 21:05:11,594][INFO ][test-runner-#10093%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=91 ms] [21:05:11] : [Step 4/5] [2021-11-19 21:05:11,594][INFO ][test-runner-#10093%encryption.EncryptedCacheNodeJoinTest%][GridCacheProcessor] Restoring partition state for local groups. [21:05:11] : [Step 4/5] [2021-11-19 21:05:11,612][INFO ][test-runner-#10093%encryption.EncryptedCacheNodeJoinTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=1, partitionsProcessed=100, time=20ms] [21:05:13] : [Step 4/5] [2021-11-19 21:05:13,094][INFO ][test-runner-#10093%encryption.EncryptedCacheNodeJoinTest%][TestTcpDiscoverySpi] Successfully bound to TCP port [port=47502, localHost=localhost/127.0.0.1, locNodeId=403a8bc7-744c-4854-9a1a-6778c9410004] [21:05:13] : [Step 4/5] [2021-11-19 21:05:13,099][INFO ][tcp-disco-srvr-[:47501]-#534%grid-3%-#10324%grid-3%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=46239] [21:05:13] : [Step 4/5] [2021-11-19 21:05:13,099][INFO ][tcp-disco-srvr-[:47501]-#534%grid-3%-#10324%grid-3%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=46239] [21:05:13] : [Step 4/5] [2021-11-19 21:05:13,100][INFO ][tcp-disco-sock-reader-[]-#544%grid-3%-#10476%grid-3%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:46239, rmtPort=46239] [21:05:13] : [Step 4/5] [2021-11-19 21:05:13,102][INFO ][tcp-disco-sock-reader-[403a8bc7 127.0.0.1:46239]-#544%grid-3%-#10476%grid-3%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=403a8bc7-744c-4854-9a1a-6778c9410004, rmtAddr=/127.0.0.1:46239] [21:05:13] : [Step 4/5] [2021-11-19 21:05:13,105][INFO ][tcp-disco-srvr-[:47502]-#543%grid-4%-#10475%grid-4%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=36595] [21:05:13] : [Step 4/5] [2021-11-19 21:05:13,106][INFO ][tcp-disco-srvr-[:47502]-#543%grid-4%-#10475%grid-4%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=36595] [21:05:13] : [Step 4/5] [2021-11-19 21:05:13,106][INFO ][tcp-disco-sock-reader-[]-#545%grid-4%-#10477%grid-4%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:36595, rmtPort=36595] [21:05:13] : [Step 4/5] [2021-11-19 21:05:13,107][INFO ][tcp-disco-sock-reader-[]-#545%grid-4%-#10477%grid-4%][TestTcpDiscoverySpi] Received ping request from the remote node [rmtNodeId=30452784-820b-4296-b945-9e9cdd509003, rmtAddr=/127.0.0.1:36595, rmtPort=36595] [21:05:13] : [Step 4/5] [2021-11-19 21:05:13,108][INFO ][tcp-disco-sock-reader-[]-#545%grid-4%-#10477%grid-4%][TestTcpDiscoverySpi] Finished writing ping response [rmtNodeId=30452784-820b-4296-b945-9e9cdd509003, rmtAddr=/127.0.0.1:36595, rmtPort=36595] [21:05:13] : [Step 4/5] [2021-11-19 21:05:13,108][INFO ][tcp-disco-sock-reader-[]-#545%grid-4%-#10477%grid-4%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:36595, rmtPort=36595, rmtNodeId=null] [21:05:13] : [Step 4/5] [2021-11-19 21:05:13,108][INFO ][tcp-disco-sock-reader-[403a8bc7 127.0.0.1:46239]-#544%grid-3%-#10476%grid-3%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:46239, rmtPort=46239, rmtNodeId=403a8bc7-744c-4854-9a1a-6778c9410004] [21:05:13] : [Step 4/5] [2021-11-19 21:05:13,112][INFO ][tcp-disco-msg-worker-[30452784 127.0.0.1:47501 crd]-#528%grid-0%-#10205%grid-0%][GridEncryptionManager] Joining node doesn't have stored group keys [node=403a8bc7-744c-4854-9a1a-6778c9410004] [21:05:13] : [Step 4/5] [2021-11-19 21:05:13,124][INFO ][tcp-disco-msg-worker-[00b79a21 127.0.0.1:47500]-#533%grid-3%-#10323%grid-3%][TestTcpDiscoverySpi] New next node [newNext=TcpDiscoveryNode [id=403a8bc7-744c-4854-9a1a-6778c9410004, consistentId=grid-4, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47502], discPort=47502, order=0, intOrder=3, lastExchangeTime=1637345113115, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false]] [21:05:13] : [Step 4/5] [2021-11-19 21:05:13,125][INFO ][tcp-disco-sock-reader-[30452784 127.0.0.1:57173]-#538%grid-0%-#10328%grid-0%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:57173, rmtPort=57173, rmtNodeId=30452784-820b-4296-b945-9e9cdd509003] [21:05:13] : [Step 4/5] [2021-11-19 21:05:13,125][INFO ][tcp-disco-srvr-[:47502]-#543%grid-4%-#10475%grid-4%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=34935] [21:05:13] : [Step 4/5] [2021-11-19 21:05:13,126][INFO ][tcp-disco-srvr-[:47502]-#543%grid-4%-#10475%grid-4%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=34935] [21:05:13] : [Step 4/5] [2021-11-19 21:05:13,127][INFO ][tcp-disco-sock-reader-[]-#546%grid-4%-#10478%grid-4%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:34935, rmtPort=34935] [21:05:13] : [Step 4/5] [2021-11-19 21:05:13,128][INFO ][tcp-disco-sock-reader-[30452784 127.0.0.1:34935]-#546%grid-4%-#10478%grid-4%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=30452784-820b-4296-b945-9e9cdd509003, rmtAddr=/127.0.0.1:34935] [21:05:13] : [Step 4/5] [2021-11-19 21:05:13,133][INFO ][tcp-disco-msg-worker-[]-#542%grid-4%-#10474%grid-4%][TestTcpDiscoverySpi] New next node [newNext=TcpDiscoveryNode [id=00b79a21-5f82-4914-a1d6-50f2b7cd2000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345113125, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false]] [21:05:13] : [Step 4/5] [2021-11-19 21:05:13,134][INFO ][tcp-disco-srvr-[:47500]-#529%grid-0%-#10206%grid-0%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=49151] [21:05:13] : [Step 4/5] [2021-11-19 21:05:13,134][INFO ][tcp-disco-srvr-[:47500]-#529%grid-0%-#10206%grid-0%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=49151] [21:05:13] : [Step 4/5] [2021-11-19 21:05:13,135][INFO ][tcp-disco-sock-reader-[]-#547%grid-0%-#10479%grid-0%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:49151, rmtPort=49151] [21:05:13] : [Step 4/5] [2021-11-19 21:05:13,136][INFO ][tcp-disco-sock-reader-[403a8bc7 127.0.0.1:49151]-#547%grid-0%-#10479%grid-0%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=403a8bc7-744c-4854-9a1a-6778c9410004, rmtAddr=/127.0.0.1:49151] [21:05:13] : [Step 4/5] [2021-11-19 21:05:13,139][INFO ][disco-event-worker-#10208%grid-0%][GridDiscoveryManager] Added new node to topology: TcpDiscoveryNode [id=403a8bc7-744c-4854-9a1a-6778c9410004, consistentId=grid-4, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47502], discPort=47502, order=3, intOrder=3, lastExchangeTime=1637345113105, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false] [21:05:13] : [Step 4/5] [2021-11-19 21:05:13,139][INFO ][disco-event-worker-#10330%grid-3%][GridDiscoveryManager] Added new node to topology: TcpDiscoveryNode [id=403a8bc7-744c-4854-9a1a-6778c9410004, consistentId=grid-4, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47502], discPort=47502, order=3, intOrder=3, lastExchangeTime=1637345113115, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false] [21:05:13] : [Step 4/5] [2021-11-19 21:05:13,140][INFO ][disco-event-worker-#10208%grid-0%][GridDiscoveryManager] Topology snapshot [ver=3, locNode=00b79a21, servers=3, clients=0, state=ACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=00b79a21-5f82-4914-a1d6-50f2b7cd2000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=30452784-820b-4296-b945-9e9cdd509003, consistentId=grid-3, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=403a8bc7-744c-4854-9a1a-6778c9410004, consistentId=grid-4, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:05:13] : [Step 4/5] [2021-11-19 21:05:13,141][INFO ][disco-event-worker-#10330%grid-3%][GridDiscoveryManager] Topology snapshot [ver=3, locNode=30452784, servers=3, clients=0, state=ACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=00b79a21-5f82-4914-a1d6-50f2b7cd2000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=30452784-820b-4296-b945-9e9cdd509003, consistentId=grid-3, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=403a8bc7-744c-4854-9a1a-6778c9410004, consistentId=grid-4, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:05:13] : [Step 4/5] [2021-11-19 21:05:13,142][INFO ][disco-event-worker-#10208%grid-0%][GridDiscoveryManager] ^-- Baseline [id=0, size=2, online=2, offline=0] [21:05:13] : [Step 4/5] [2021-11-19 21:05:13,143][INFO ][disco-event-worker-#10330%grid-3%][GridDiscoveryManager] ^-- Baseline [id=0, size=2, online=2, offline=0] [21:05:13] : [Step 4/5] [2021-11-19 21:05:13,144][INFO ][exchange-worker-#10209%grid-0%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], crd=true, evt=NODE_JOINED, evtNode=403a8bc7-744c-4854-9a1a-6778c9410004, customEvt=null, allowMerge=true, exchangeFreeSwitch=false] [21:05:13] : [Step 4/5] [2021-11-19 21:05:13,144][INFO ][tcp-disco-msg-worker-[00b79a21 127.0.0.1:47500]-#542%grid-4%-#10474%grid-4%][GridEncryptionManager] Store group key received from coordinator [grp=1613773252, keyId=0] [21:05:13] : [Step 4/5] [2021-11-19 21:05:13,144][INFO ][exchange-worker-#10331%grid-3%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], crd=false, evt=NODE_JOINED, evtNode=403a8bc7-744c-4854-9a1a-6778c9410004, customEvt=null, allowMerge=true, exchangeFreeSwitch=false] [21:05:13] : [Step 4/5] [2021-11-19 21:05:13,145][INFO ][exchange-worker-#10209%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], waitTime=0ms, futInfo=NA, mode=DISTRIBUTED] [21:05:13] : [Step 4/5] [2021-11-19 21:05:13,145][INFO ][tcp-disco-msg-worker-[00b79a21 127.0.0.1:47500]-#542%grid-4%-#10474%grid-4%][ClusterProcessor] upbeat_noyce [21:05:13] : [Step 4/5] [2021-11-19 21:05:13,145][INFO ][exchange-worker-#10331%grid-3%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], waitTime=0ms, futInfo=NA, mode=DISTRIBUTED] [21:05:13] : [Step 4/5] [2021-11-19 21:05:13,146][INFO ][tcp-disco-msg-worker-[00b79a21 127.0.0.1:47500]-#542%grid-4%-#10474%grid-4%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustEnabled' was changed from 'null' to 'false' [21:05:13] : [Step 4/5] [2021-11-19 21:05:13,147][INFO ][tcp-disco-msg-worker-[00b79a21 127.0.0.1:47500]-#542%grid-4%-#10474%grid-4%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustTimeout' was changed from 'null' to '300000' [21:05:13] : [Step 4/5] [2021-11-19 21:05:13,147][INFO ][exchange-worker-#10209%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partitions release latch: ServerLatch [permits=0, pendingAcks=HashSet [], super=CompletableLatch [id=CompletableLatchUid [id=exchange, topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0]]]] [21:05:13] : [Step 4/5] [2021-11-19 21:05:13,147][INFO ][exchange-worker-#10331%grid-3%][GridDhtPartitionsExchangeFuture] Finished waiting for partitions release latch: ClientLatch [coordinator=TcpDiscoveryNode [id=00b79a21-5f82-4914-a1d6-50f2b7cd2000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345106570, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], ackSent=true, super=CompletableLatch [id=CompletableLatchUid [id=exchange, topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0]]]] [21:05:13] : [Step 4/5] [2021-11-19 21:05:13,147][INFO ][tcp-disco-msg-worker-[00b79a21 127.0.0.1:47500]-#542%grid-4%-#10474%grid-4%][IgniteTxManager] Transactions parameter 'longOperationsDumpTimeout' was changed from 'null' to '60000' [21:05:13] : [Step 4/5] [2021-11-19 21:05:13,149][INFO ][exchange-worker-#10331%grid-3%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:05:13] : [Step 4/5] [2021-11-19 21:05:13,148][INFO ][exchange-worker-#10209%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:05:13] : [Step 4/5] [2021-11-19 21:05:13,149][INFO ][tcp-disco-msg-worker-[00b79a21 127.0.0.1:47500]-#542%grid-4%-#10474%grid-4%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpThreshold' was changed from 'null' to '0' [21:05:13] : [Step 4/5] [2021-11-19 21:05:13,150][INFO ][exchange-worker-#10209%grid-0%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], crd=true] [21:05:13] : [Step 4/5] [2021-11-19 21:05:13,150][INFO ][tcp-disco-msg-worker-[00b79a21 127.0.0.1:47500]-#542%grid-4%-#10474%grid-4%][IgniteTxManager] Transactions parameter 'transactionTimeDumpSamplesCoefficient' was changed from 'null' to '0.0' [21:05:13] : [Step 4/5] [2021-11-19 21:05:13,151][INFO ][tcp-disco-msg-worker-[00b79a21 127.0.0.1:47500]-#542%grid-4%-#10474%grid-4%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpSamplesPerSecondLimit' was changed from 'null' to '5' [21:05:13] : [Step 4/5] [2021-11-19 21:05:13,151][INFO ][exchange-worker-#10331%grid-3%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], crd=false] [21:05:13] : [Step 4/5] [2021-11-19 21:05:13,151][INFO ][tcp-disco-msg-worker-[00b79a21 127.0.0.1:47500]-#542%grid-4%-#10474%grid-4%][IgniteTxManager] Transactions parameter 'collisionsDumpInterval' was changed from 'null' to '1000' [21:05:13] : [Step 4/5] [2021-11-19 21:05:13,152][INFO ][sys-#10198%grid-0%][GridDhtPartitionsExchangeFuture] Coordinator received single message [ver=AffinityTopologyVersion [topVer=3, minorTopVer=0], node=30452784-820b-4296-b945-9e9cdd509003, remainingNodes=1, allReceived=false] [21:05:13] : [Step 4/5] [2021-11-19 21:05:13,152][INFO ][tcp-disco-msg-worker-[00b79a21 127.0.0.1:47500]-#542%grid-4%-#10474%grid-4%][IgniteTxManager] Transactions parameter 'txOwnerDumpRequestsAllowed' was changed from 'null' to 'true' [21:05:13] : [Step 4/5] [2021-11-19 21:05:13,153][INFO ][tcp-disco-msg-worker-[00b79a21 127.0.0.1:47500]-#542%grid-4%-#10474%grid-4%][GridCacheDatabaseSharedManager] Historical rebalance WAL threshold changed [property=historical.rebalance.threshold, oldVal=null, newVal=500] [21:05:13] : [Step 4/5] [2021-11-19 21:05:13,154][INFO ][disco-notifier-worker-#10473%grid-4%][MvccProcessorImpl] Assigned mvcc coordinator [crd=MvccCoordinator [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], nodeId=00b79a21-5f82-4914-a1d6-50f2b7cd2000, ver=1637345105351, local=false, initialized=false]] [21:05:13] : [Step 4/5] [2021-11-19 21:05:13,155][INFO ][disco-notifier-worker-#10473%grid-4%][GridClusterStateProcessor] Local node is not included in Baseline Topology and will not be used for data storage. Use control.(sh|bat) script or IgniteCluster interface to include the node to Baseline Topology. [21:05:13] : [Step 4/5] [2021-11-19 21:05:13,157][INFO ][sys-#10455%grid-4%][ClusterProcessor] Writing cluster ID and tag to metastorage on ready for write ClusterIdAndTag [id=b461fdbb-e7f7-4f48-8369-cc48bdbea497, tag=upbeat_noyce] [21:05:13] : [Step 4/5] [2021-11-19 21:05:13,167][INFO ][exchange-worker-#10482%grid-4%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], crd=false, evt=NODE_JOINED, evtNode=403a8bc7-744c-4854-9a1a-6778c9410004, customEvt=null, allowMerge=true, exchangeFreeSwitch=false] [21:05:13] : [Step 4/5] [2021-11-19 21:05:13,169][INFO ][exchange-worker-#10482%grid-4%][GridCacheProcessor] Stopped cache [cacheName=ignite-sys-cache] [21:05:13] : [Step 4/5] [2021-11-19 21:05:13,169][INFO ][exchange-worker-#10482%grid-4%][GridCacheDatabaseSharedManager] Page memory sysMemPlc for CacheGroupDescriptor [grpId=-2100569601, grpName=null, startTopVer=null, rcvdFrom=00b79a21-5f82-4914-a1d6-50f2b7cd2000, deploymentId=daf2d593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, caches=SingletonMap {ignite-sys-cache=-2100569601}, rcvdFromVer=null, persistenceEnabled=true, walEnabled=true, cacheCfgEnrichment=CacheConfigurationEnrichment [fieldClassNames=HashMap {storeFactory=null, storeSesLsnrs=null, evictFilter=null, interceptor=null, evictPlcFactory=null}], cacheCfgEnriched=false, cacheName=ignite-sys-cache] has invalidated. [21:05:13] : [Step 4/5] [2021-11-19 21:05:13,170][INFO ][exchange-worker-#10482%grid-4%][GridCacheDatabaseSharedManager] Page memory default for CacheGroupDescriptor [grpId=1613773252, grpName=null, startTopVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], rcvdFrom=00b79a21-5f82-4914-a1d6-50f2b7cd2000, deploymentId=0803d593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, caches=SingletonMap {encrypted=1613773252}, rcvdFromVer=null, persistenceEnabled=true, walEnabled=true, cacheCfgEnrichment=CacheConfigurationEnrichment [fieldClassNames=HashMap {storeFactory=null, storeSesLsnrs=null, evictFilter=null, interceptor=null, evictPlcFactory=null}], cacheCfgEnriched=false, cacheName=encrypted] has invalidated. [21:05:13] : [Step 4/5] [2021-11-19 21:05:13,172][INFO ][exchange-worker-#10482%grid-4%][FilePageStoreManager] Cache stores cleanup started asynchronously [21:05:13] : [Step 4/5] [2021-11-19 21:05:13,172][INFO ][exchange-worker-#10482%grid-4%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_4 [21:05:14] : [Step 4/5] [2021-11-19 21:05:14,092][INFO ][async-file-store-cleanup-task-2-#10483%grid-4%][FilePageStoreManager] Cleanup cache stores [total=2, left=1, cleanFiles=true] [21:05:14] : [Step 4/5] [2021-11-19 21:05:14,096][INFO ][exchange-worker-#10482%grid-4%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_4/0000000000000000.wal, offset=8713, ver=2] [21:05:14] : [Step 4/5] [2021-11-19 21:05:14,101][INFO ][exchange-worker-#10482%grid-4%][GridClusterStateProcessor] Writing BaselineTopology[id=0] [21:05:14] : [Step 4/5] [2021-11-19 21:05:14,103][INFO ][exchange-worker-#10482%grid-4%][GridCacheDatabaseSharedManager] Finish recovery performed in 930 ms. [21:05:14] : [Step 4/5] [2021-11-19 21:05:14,105][INFO ][exchange-worker-#10482%grid-4%][msg] Components activation performed in 933 ms. [21:05:14] : [Step 4/5] [2021-11-19 21:05:14,106][INFO ][sys-#10456%grid-4%][PageMemoryImpl] Started page memory [memoryAllocated=24.0 MiB, pages=5952, tableSize=474.2 KiB, replacementSize=768 B, checkpointBuffer=10.0 MiB] [21:05:14] : [Step 4/5] [2021-11-19 21:05:14,200][INFO ][exchange-worker-#10482%grid-4%][GridCacheProcessor] Started cache [name=ignite-sys-cache, id=-2100569601, dataRegionName=sysMemPlc, mode=REPLICATED, atomicity=TRANSACTIONAL, backups=2147483647, mvcc=false] [21:05:14] : [Step 4/5] [2021-11-19 21:05:14,200][INFO ][sys-#10459%grid-4%][GridCacheProcessor] Started cache [name=encrypted, id=1613773252, dataRegionName=default, mode=PARTITIONED, atomicity=ATOMIC, backups=0, mvcc=false] [21:05:14] : [Step 4/5] [2021-11-19 21:05:14,201][INFO ][exchange-worker-#10482%grid-4%][GridCacheProcessor] Starting caches on local join performed in 103 ms. [21:05:14] : [Step 4/5] [2021-11-19 21:05:14,202][INFO ][exchange-worker-#10482%grid-4%][GridDhtPartitionsExchangeFuture] Skipped waiting for partitions release future (local node is joining) [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0]] [21:05:14] : [Step 4/5] [2021-11-19 21:05:14,228][INFO ][grid-nio-worker-tcp-comm-1-#10149%TcpCommunicationSpi%][TcpCommunicationSpi] Accepted incoming communication connection [locAddr=/127.0.0.1:45150, rmtAddr=/127.0.0.1:59802] [21:05:14] : [Step 4/5] [2021-11-19 21:05:14,231][INFO ][grid-nio-worker-tcp-comm-0-#10417%TcpCommunicationSpi%][TcpCommunicationSpi] Established outgoing communication connection [locAddr=/127.0.0.1:59802, rmtAddr=/127.0.0.1:45150] [21:05:14] : [Step 4/5] [2021-11-19 21:05:14,231][INFO ][exchange-worker-#10482%grid-4%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], crd=false] [21:05:14] : [Step 4/5] [2021-11-19 21:05:14,232][INFO ][sys-#10200%grid-0%][GridDhtPartitionsExchangeFuture] Coordinator received single message [ver=AffinityTopologyVersion [topVer=3, minorTopVer=0], node=403a8bc7-744c-4854-9a1a-6778c9410004, allReceived=true] [21:05:14] : [Step 4/5] [2021-11-19 21:05:14,232][INFO ][sys-#10200%grid-0%][GridDhtPartitionsExchangeFuture] Coordinator received all messages, try merge [ver=AffinityTopologyVersion [topVer=3, minorTopVer=0]] [21:05:14] : [Step 4/5] [2021-11-19 21:05:14,233][INFO ][sys-#10200%grid-0%][GridDhtPartitionsExchangeFuture] finishExchangeOnCoordinator [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=0]] [21:05:14] : [Step 4/5] [2021-11-19 21:05:14,247][INFO ][sys-#10200%grid-0%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], err=null, rebalanced=true, wasRebalanced=true] [21:05:14] : [Step 4/5] [2021-11-19 21:05:14,249][INFO ][sys-#10313%grid-3%][GridDhtPartitionsExchangeFuture] Received full message, will finish exchange [node=00b79a21-5f82-4914-a1d6-50f2b7cd2000, resVer=AffinityTopologyVersion [topVer=3, minorTopVer=0]] [21:05:14] : [Step 4/5] [2021-11-19 21:05:14,251][INFO ][sys-#10200%grid-0%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=00b79a21-5f82-4914-a1d6-50f2b7cd2000, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], evt=NODE_JOINED, evtNode=TcpDiscoveryNode [id=403a8bc7-744c-4854-9a1a-6778c9410004, consistentId=grid-4, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47502], discPort=47502, order=3, intOrder=3, lastExchangeTime=1637345113105, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0]] [21:05:14] : [Step 4/5] [2021-11-19 21:05:14,252][INFO ][sys-#10200%grid-0%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (0 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (1 ms), stage="Wait partitions release latch [latch=exchange]" (2 ms), stage="Wait partitions release [latch=exchange]" (2 ms), stage="After states restored callback" (0 ms), stage="WAL history reservation" (0 ms), stage="Waiting for all single messages" (1082 ms), stage="Exchanges merge" (0 ms), stage="Affinity recalculation (crd)" (3 ms), stage="Collect update counters and create affinity messages" (1 ms), stage="Assign partitions states" (5 ms), stage="Validate partitions states" (1 ms), stage="Apply update counters" (0 ms), stage="Full message preparing" (1 ms), stage="Full message sending" (0 ms), stage="Exchange done" (5 ms), stage="Total time" (1103 ms), Discovery lag=12 ms, Latest started node id=403a8bc7-744c-4854-9a1a-6778c9410004] [21:05:14] : [Step 4/5] [2021-11-19 21:05:14,251][INFO ][exchange-worker-#10209%grid-0%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=3, minorTopVer=0], force=false, evt=NODE_JOINED, node=403a8bc7-744c-4854-9a1a-6778c9410004] [21:05:14] : [Step 4/5] [2021-11-19 21:05:14,257][INFO ][sys-#10200%grid-0%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], stage="Affinity initialization (node join) [grp=encrypted, crd=true]" (3 ms) (parent=Affinity recalculation (crd)), stage="Affinity initialization (node join) [grp=ignite-sys-cache, crd=true]" (0 ms) (parent=Affinity recalculation (crd))] [21:05:14] : [Step 4/5] [2021-11-19 21:05:14,257][INFO ][sys-#10463%grid-4%][GridDhtPartitionsExchangeFuture] Received full message, will finish exchange [node=00b79a21-5f82-4914-a1d6-50f2b7cd2000, resVer=AffinityTopologyVersion [topVer=3, minorTopVer=0]] [21:05:14] : [Step 4/5] [2021-11-19 21:05:14,256][INFO ][sys-#10313%grid-3%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], err=null, rebalanced=true, wasRebalanced=true] [21:05:14] : [Step 4/5] [2021-11-19 21:05:14,262][INFO ][sys-#10467%grid-4%][GridAffinityAssignmentCache] Local node affinity assignment distribution is not ideal [cache=encrypted, expectedPrimary=512.00, actualPrimary=0, expectedBackups=0.00, actualBackups=0, warningThreshold=50.00%] [21:05:14] : [Step 4/5] [2021-11-19 21:05:14,266][INFO ][sys-#10313%grid-3%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=30452784-820b-4296-b945-9e9cdd509003, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], evt=NODE_JOINED, evtNode=TcpDiscoveryNode [id=403a8bc7-744c-4854-9a1a-6778c9410004, consistentId=grid-4, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47502], discPort=47502, order=3, intOrder=3, lastExchangeTime=1637345113115, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0]] [21:05:14] : [Step 4/5] [2021-11-19 21:05:14,269][INFO ][sys-#10313%grid-3%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (1 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (1 ms), stage="Wait partitions release latch [latch=exchange]" (2 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="After states restored callback" (0 ms), stage="WAL history reservation" (0 ms), stage="Waiting for Full message" (1099 ms), stage="Affinity recalculation" (2 ms), stage="Full map updating" (3 ms), stage="Exchange done" (13 ms), stage="Total time" (1121 ms)] [21:05:14] : [Step 4/5] [2021-11-19 21:05:14,269][INFO ][sys-#10463%grid-4%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], err=null, rebalanced=true, wasRebalanced=false] [21:05:14] : [Step 4/5] [2021-11-19 21:05:14,266][INFO ][exchange-worker-#10331%grid-3%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=3, minorTopVer=0], force=false, evt=NODE_JOINED, node=403a8bc7-744c-4854-9a1a-6778c9410004] [21:05:14] : [Step 4/5] [2021-11-19 21:05:14,270][INFO ][sys-#10313%grid-3%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], stage="Affinity initialization (node join) [grp=encrypted, crd=false]" (2 ms) (parent=Affinity recalculation), stage="Affinity initialization (node join) [grp=ignite-sys-cache, crd=false]" (0 ms) (parent=Affinity recalculation)] [21:05:14] : [Step 4/5] [2021-11-19 21:05:14,274][INFO ][sys-#10463%grid-4%][GridCacheProcessor] Finish proxy initialization, cacheName=ignite-sys-cache, localNodeId=403a8bc7-744c-4854-9a1a-6778c9410004 [21:05:14] : [Step 4/5] [2021-11-19 21:05:14,274][INFO ][sys-#10463%grid-4%][GridCacheProcessor] Finish proxy initialization, cacheName=encrypted, localNodeId=403a8bc7-744c-4854-9a1a-6778c9410004 [21:05:14] : [Step 4/5] [2021-11-19 21:05:14,275][INFO ][sys-#10463%grid-4%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=403a8bc7-744c-4854-9a1a-6778c9410004, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], evt=NODE_JOINED, evtNode=TcpDiscoveryNode [id=403a8bc7-744c-4854-9a1a-6778c9410004, consistentId=grid-4, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47502], discPort=47502, order=3, intOrder=3, lastExchangeTime=1637345113894, loc=true, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0]] [21:05:14] : [Step 4/5] [2021-11-19 21:05:14,276][INFO ][sys-#10463%grid-4%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], stage="Waiting in exchange queue" (12 ms), stage="Exchange parameters initialization" (0 ms), stage="Baseline change callback" (4 ms), stage="Components activation" (932 ms), stage="Determine exchange type" (97 ms), stage="Preloading notification" (0 ms), stage="Restore partition states" (17 ms), stage="After states restored callback" (5 ms), stage="WAL history reservation" (0 ms), stage="Waiting for Full message" (31 ms), stage="Affinity recalculation" (8 ms), stage="Full map updating" (3 ms), stage="Exchange done" (6 ms), stage="Total time" (1115 ms)] [21:05:14] : [Step 4/5] [2021-11-19 21:05:14,277][INFO ][sys-#10463%grid-4%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], stage="Affinity fetch" (97 ms) (parent=Determine exchange type), stage="Restore partition states [grp=encrypted]" (17 ms) (parent=Restore partition states), stage="Restore partition states [grp=ignite-sys-cache]" (2 ms) (parent=Restore partition states), stage="Affinity initialization (local join) [grp=encrypted]" (8 ms) (parent=Affinity recalculation), stage="Affinity initialization (local join) [grp=ignite-sys-cache]" (3 ms) (parent=Affinity recalculation)] [21:05:14] : [Step 4/5] [2021-11-19 21:05:14,275][INFO ][exchange-worker-#10482%grid-4%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=3, minorTopVer=0], force=false, evt=NODE_JOINED, node=403a8bc7-744c-4854-9a1a-6778c9410004] [21:05:14] : [Step 4/5] [2021-11-19 21:05:14,286][INFO ][test-runner-#10093%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-4] To start Console Management & Monitoring run ignitevisorcmd.{sh|bat} [21:05:14] : [Step 4/5] [2021-11-19 21:05:14,287][INFO ][test-runner-#10093%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-4] [21:05:14] : [Step 4/5] [21:05:14] : [Step 4/5] >>> +-------------------------------------------+ [21:05:14] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:05:14] : [Step 4/5] >>> +-------------------------------------------+ [21:05:14] : [Step 4/5] >>> OS name: Linux 4.15.0-151-generic amd64 [21:05:14] : [Step 4/5] >>> CPU(s): 24 [21:05:14] : [Step 4/5] >>> Heap: 2.0GB [21:05:14] : [Step 4/5] >>> VM name: 16724@c4dfe9a430b2 [21:05:14] : [Step 4/5] >>> Ignite instance name: grid-4 [21:05:14] : [Step 4/5] >>> Local node [ID=403A8BC7-744C-4854-9A1A-6778C9410004, order=3, clientMode=false] [21:05:14] : [Step 4/5] >>> Local node addresses: [127.0.0.1] [21:05:14] : [Step 4/5] >>> Local ports: TCP:10802 TCP:45152 TCP:47502 [21:05:14] : [Step 4/5] [21:05:14] : [Step 4/5] [2021-11-19 21:05:14,287][INFO ][test-runner-#10093%encryption.EncryptedCacheNodeJoinTest%][GridDiscoveryManager] Topology snapshot [ver=3, locNode=403a8bc7, servers=3, clients=0, state=ACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=00b79a21-5f82-4914-a1d6-50f2b7cd2000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=30452784-820b-4296-b945-9e9cdd509003, consistentId=grid-3, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=403a8bc7-744c-4854-9a1a-6778c9410004, consistentId=grid-4, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:05:14] : [Step 4/5] [2021-11-19 21:05:14,289][INFO ][test-runner-#10093%encryption.EncryptedCacheNodeJoinTest%][GridDiscoveryManager] ^-- Baseline [id=0, size=2, online=2, offline=0] [21:05:14] : [Step 4/5] [2021-11-19 21:05:14,289][INFO ][test-runner-#10093%encryption.EncryptedCacheNodeJoinTest%][G] Node started : [stage="Configure system pool" (0 ms),stage="Start managers" (182 ms),stage="Configure binary metadata" (1 ms),stage="Start processors" (760 ms),stage="Start 'StanByClusterTestProvider' plugin" (0 ms),stage="Start 'PageMemory tracker plugin' plugin" (0 ms),stage="Start 'TestDistibutedConfigurationPlugin' plugin" (0 ms),stage="Start 'NodeValidationPluginProvider' plugin" (0 ms),stage="Init metastore" (1081 ms),stage="Init and start regions" (7 ms),stage="Restore binary memory" (23 ms),stage="Restore logical state" (113 ms),stage="Finish recovery" (1479 ms),stage="Join topology" (61 ms),stage="Await transition" (3 ms),stage="Await exchange" (1130 ms),stage="Total time" (4840 ms)] [21:05:14] : [Step 4/5] [2021-11-19 21:05:14,290][INFO ][test-runner-#10093%encryption.EncryptedCacheNodeJoinTest%][root] Node started with the following configuration [id=403a8bc7-744c-4854-9a1a-6778c9410004, marshaller=BinaryMarshaller [], discovery=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=5000, ackTimeout=5000, marsh=JdkMarshaller [clsFilter=org.apache.ignite.marshaller.MarshallerUtils$1@6799e274], reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], binaryCfg=null, lateAff=true] [21:05:14] : [Step 4/5] [2021-11-19 21:05:14,306][INFO ][test-runner-#10093%encryption.EncryptedCacheNodeJoinTest%][root] awaitPartitionMapExchange finished [21:05:14] : [Step 4/5] [21:05:14] >>> Stopping test: EncryptedCacheNodeJoinTest#testThirdNodeCanJoin in 10141 ms <<< [21:05:14] : [Step 4/5] [2021-11-19 21:05:14,344][INFO ][main][root] >>> Stopping test: EncryptedCacheNodeJoinTest#testThirdNodeCanJoin in 10141 ms <<< [21:05:14] : [Step 4/5] [21:05:14] >>> Heap: 471 MB used / 1913 MB commited / 1913 MB max <<< [21:05:14] : [Step 4/5] [2021-11-19 21:05:14,345][INFO ][main][root] >>> Heap: 471 MB used / 1913 MB commited / 1913 MB max <<< [21:05:14] : [Step 4/5] [21:05:14] >>> Non-Heap: 143 MB used / 156 MB commited / 0 MB max <<< [21:05:14] : [Step 4/5] [2021-11-19 21:05:14,345][INFO ][main][root] >>> Non-Heap: 143 MB used / 156 MB commited / 0 MB max <<< [21:05:14] : [Step 4/5] [2021-11-19 21:05:14,345][INFO ][main][root] >>> Stopping grid [name=grid-0, id=00b79a21-5f82-4914-a1d6-50f2b7cd2000] [21:05:14] : [Step 4/5] [2021-11-19 21:05:14,540][INFO ][db-checkpoint-thread-#10488%grid-4%][Checkpointer] Checkpoint started [checkpointId=4d46decd-475d-4630-a601-d430be268be5, startPtr=WALPointer [idx=0, fileOff=88997, len=69], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=2ms, checkpointLockHoldTime=4ms, walCpRecordFsyncDuration=288ms, writeCheckpointEntryDuration=27ms, splitAndSortCpPagesDuration=0ms, pages=23, reason='node started'] [21:05:14] : [Step 4/5] [2021-11-19 21:05:14,549][INFO ][db-checkpoint-thread-#10341%grid-0%][Checkpointer] Checkpoint started [checkpointId=2bbad391-891e-4370-8dc3-0b7ac850342c, startPtr=WALPointer [idx=0, fileOff=672244, len=11985], checkpointBeforeLockTime=5ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=1ms, checkpointLockHoldTime=2ms, walCpRecordFsyncDuration=181ms, writeCheckpointEntryDuration=10ms, splitAndSortCpPagesDuration=0ms, pages=491, reason='timeout'] [21:05:14] : [Step 4/5] [2021-11-19 21:05:14,558][INFO ][disco-event-worker-#10330%grid-3%][GridDiscoveryManager] Node left topology: TcpDiscoveryNode [id=00b79a21-5f82-4914-a1d6-50f2b7cd2000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345106570, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false] [21:05:14] : [Step 4/5] [2021-11-19 21:05:14,558][INFO ][tcp-disco-sock-reader-[403a8bc7 127.0.0.1:49151]-#547%grid-0%-#10479%grid-0%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:49151, rmtPort=49151, rmtNodeId=403a8bc7-744c-4854-9a1a-6778c9410004] [21:05:14] : [Step 4/5] [2021-11-19 21:05:14,558][INFO ][disco-event-worker-#10481%grid-4%][GridDiscoveryManager] Node left topology: TcpDiscoveryNode [id=00b79a21-5f82-4914-a1d6-50f2b7cd2000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345113125, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false] [21:05:14] : [Step 4/5] [2021-11-19 21:05:14,558][INFO ][tcp-disco-msg-worker-[00b79a21 127.0.0.1:47500]-#542%grid-4%-#10474%grid-4%][TestTcpDiscoverySpi] New next node [newNext=TcpDiscoveryNode [id=30452784-820b-4296-b945-9e9cdd509003, consistentId=grid-3, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637345113125, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false]] [21:05:14] : [Step 4/5] [2021-11-19 21:05:14,563][INFO ][main][GridCacheProcessor] Stopped cache [cacheName=ignite-sys-cache] [21:05:14] : [Step 4/5] [2021-11-19 21:05:14,561][INFO ][disco-event-worker-#10481%grid-4%][GridDiscoveryManager] Topology snapshot [ver=4, locNode=403a8bc7, servers=2, clients=0, state=ACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=30452784-820b-4296-b945-9e9cdd509003, consistentId=grid-3, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=403a8bc7-744c-4854-9a1a-6778c9410004, consistentId=grid-4, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:05:14] : [Step 4/5] [2021-11-19 21:05:14,559][INFO ][disco-event-worker-#10330%grid-3%][GridDiscoveryManager] Topology snapshot [ver=4, locNode=30452784, servers=2, clients=0, state=ACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=30452784-820b-4296-b945-9e9cdd509003, consistentId=grid-3, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=403a8bc7-744c-4854-9a1a-6778c9410004, consistentId=grid-4, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:05:14] : [Step 4/5] [2021-11-19 21:05:14,567][INFO ][disco-event-worker-#10481%grid-4%][GridDiscoveryManager] Coordinator changed [prev=TcpDiscoveryNode [id=00b79a21-5f82-4914-a1d6-50f2b7cd2000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345113125, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], cur=TcpDiscoveryNode [id=30452784-820b-4296-b945-9e9cdd509003, consistentId=grid-3, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637345113125, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false]] [21:05:14] : [Step 4/5] [2021-11-19 21:05:14,566][INFO ][main][GridCacheProcessor] Stopped cache [cacheName=encrypted] [21:05:14] : [Step 4/5] [2021-11-19 21:05:14,564][INFO ][tcp-disco-srvr-[:47501]-#534%grid-3%-#10324%grid-3%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=47231] [21:05:14] : [Step 4/5] [2021-11-19 21:05:14,569][INFO ][disco-event-worker-#10481%grid-4%][GridDiscoveryManager] ^-- Baseline [id=0, size=2, online=1, offline=1] [21:05:14] : [Step 4/5] [2021-11-19 21:05:14,568][INFO ][disco-event-worker-#10330%grid-3%][GridDiscoveryManager] Coordinator changed [prev=TcpDiscoveryNode [id=00b79a21-5f82-4914-a1d6-50f2b7cd2000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345106570, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], cur=TcpDiscoveryNode [id=30452784-820b-4296-b945-9e9cdd509003, consistentId=grid-3, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637345114557, loc=true, ver=2.13.0#20211119-sha1:00000000, isClient=false]] [21:05:14]W: [org.apache.ignite:ignite-core] [2021-11-19 21:05:14,570][WARN ][grid-nio-worker-tcp-comm-0-#10417%TcpCommunicationSpi%][TcpCommunicationSpi] Failed to shutdown socket [21:05:14]W: [org.apache.ignite:ignite-core] java.nio.channels.ClosedChannelException [21:05:14]W: [org.apache.ignite:ignite-core] at sun.nio.ch.SocketChannelImpl.shutdownOutput(SocketChannelImpl.java:795) [21:05:14]W: [org.apache.ignite:ignite-core] at sun.nio.ch.SocketAdaptor.shutdownOutput(SocketAdaptor.java:407) [21:05:14]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.close(IgniteUtils.java:4247) [21:05:14]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.closeKey(GridNioServer.java:2784) [21:05:14]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.close(GridNioServer.java:2835) [21:05:14]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.close(GridNioServer.java:2794) [21:05:14]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.bodyInternal(GridNioServer.java:2157) [21:05:14]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.body(GridNioServer.java:1910) [21:05:14]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:125) [21:05:14]W: [org.apache.ignite:ignite-core] at java.lang.Thread.run(Thread.java:748) [21:05:14] : [Step 4/5] [2021-11-19 21:05:14,570][INFO ][disco-event-worker-#10481%grid-4%][MvccProcessorImpl] Assigned mvcc coordinator [crd=MvccCoordinator [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], nodeId=30452784-820b-4296-b945-9e9cdd509003, ver=1637345105352, local=false, initialized=false]] [21:05:14] : [Step 4/5] [2021-11-19 21:05:14,570][INFO ][tcp-disco-srvr-[:47501]-#534%grid-3%-#10324%grid-3%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=47231] [21:05:14] : [Step 4/5] [2021-11-19 21:05:14,577][INFO ][db-checkpoint-thread-#10488%grid-4%][Checkpointer] Checkpoint finished [cpId=4d46decd-475d-4630-a601-d430be268be5, pages=23, markPos=WALPointer [idx=0, fileOff=88997, len=69], walSegmentsCovered=[], markDuration=320ms, pagesWrite=1ms, fsync=35ms, total=356ms] [21:05:14] : [Step 4/5] [2021-11-19 21:05:14,582][INFO ][exchange-worker-#10482%grid-4%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], crd=false, evt=NODE_LEFT, evtNode=00b79a21-5f82-4914-a1d6-50f2b7cd2000, customEvt=null, allowMerge=false, exchangeFreeSwitch=true] [21:05:14] : [Step 4/5] [2021-11-19 21:05:14,573][INFO ][disco-event-worker-#10330%grid-3%][GridDiscoveryManager] ^-- Baseline [id=0, size=2, online=1, offline=1] [21:05:14] : [Step 4/5] [2021-11-19 21:05:14,583][INFO ][sys-#10458%grid-4%][GridAffinityAssignmentCache] Local node affinity assignment distribution is not ideal [cache=encrypted, expectedPrimary=1024.00, actualPrimary=0, expectedBackups=0.00, actualBackups=0, warningThreshold=50.00%] [21:05:14] : [Step 4/5] [2021-11-19 21:05:14,581][INFO ][grid-nio-worker-tcp-comm-1-#10267%TcpCommunicationSpi%][TcpCommunicationSpi] Accepted incoming communication connection [locAddr=/127.0.0.1:45151, rmtAddr=/127.0.0.1:33038] [21:05:14] : [Step 4/5] [2021-11-19 21:05:14,580][INFO ][tcp-disco-sock-reader-[]-#549%grid-3%-#10504%grid-3%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:47231, rmtPort=47231] [21:05:14] : [Step 4/5] [2021-11-19 21:05:14,584][INFO ][exchange-worker-#10482%grid-4%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:05:14] : [Step 4/5] [2021-11-19 21:05:14,584][INFO ][disco-event-worker-#10330%grid-3%][MvccProcessorImpl] Assigned mvcc coordinator [crd=MvccCoordinator [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], nodeId=30452784-820b-4296-b945-9e9cdd509003, ver=1637345105352, local=true, initialized=false]] [21:05:14] : [Step 4/5] [2021-11-19 21:05:14,588][INFO ][grid-nio-worker-tcp-comm-1-#10418%TcpCommunicationSpi%][TcpCommunicationSpi] Established outgoing communication connection [locAddr=/127.0.0.1:33038, rmtAddr=/127.0.0.1:45151] [21:05:14] : [Step 4/5] [2021-11-19 21:05:14,589][INFO ][tcp-disco-sock-reader-[403a8bc7 127.0.0.1:47231]-#549%grid-3%-#10504%grid-3%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=403a8bc7-744c-4854-9a1a-6778c9410004, rmtAddr=/127.0.0.1:47231] [21:05:14] : [Step 4/5] [2021-11-19 21:05:14,589][INFO ][exchange-worker-#10482%grid-4%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], err=null, rebalanced=true, wasRebalanced=true] [21:05:14] : [Step 4/5] [2021-11-19 21:05:14,591][INFO ][exchange-worker-#10331%grid-3%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], crd=true, evt=NODE_LEFT, evtNode=00b79a21-5f82-4914-a1d6-50f2b7cd2000, customEvt=null, allowMerge=false, exchangeFreeSwitch=true] [21:05:14] : [Step 4/5] [2021-11-19 21:05:14,591][INFO ][sys-#10320%grid-3%][ExchangeLatchManager] Become new coordinator 30452784-820b-4296-b945-9e9cdd509003 [21:05:14] : [Step 4/5] [2021-11-19 21:05:14,592][INFO ][exchange-worker-#10331%grid-3%][GridAffinityAssignmentCache] Local node affinity assignment distribution is not ideal [cache=encrypted, expectedPrimary=1024.00, actualPrimary=496, expectedBackups=0.00, actualBackups=0, warningThreshold=50.00%] [21:05:14] : [Step 4/5] [2021-11-19 21:05:14,593][INFO ][exchange-worker-#10331%grid-3%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:05:14]W: [org.apache.ignite:ignite-core] [2021-11-19 21:05:14,593][WARN ][exchange-worker-#10482%grid-4%][GridDhtPartitionTopologyImpl] Detected lost partitions [grp=encrypted, parts=[3-4, 6-13, 17-18, 20, 23, 27, 31-32, 35, 37-41, 43-46, 48, 53, 56, 61, 64-65, 69-71, 73, 75-76, 80, 82-83, 88-90, 93, 98-99, 101, 103-104, 109-110, 112-113, 115-117, 120-121, 123-125, 127-131, 137, 139, 142, 144, 146, 148-149, 152-153, 155, 157, 162, 165, 167-168, 177-179, 181, 184, 187-188, 190-192, 194-195, 203-204, 206, 210, 212-213, 215-218, 220-221, 225-228, 232-238, 241, 246, 249-255, 258, 260, 264-268, 271, 273-274, 277-279, 281, 283-284, 286, 288-291, 293, 296, 298-301, 303, 307, 309-310, 314-315, 318, 321-324, 327-328, 330-331, 333-334, 336-337, 342-343, 347-349, 351-352, 355-356, 358, 361, 363-364, 368, 370-375, 379-385, 391, 393-394, 398-400, 402-407, 409-410, 413-414, 416-418, 422-423, 426, 429-432, 434, 438-439, 442-444, 446-447, 449, 451, 454-455, 457-459, 462, 464, 468-472, 474-487, 493-494, 497-498, 501, 508, 513, 517, 519, 523-524, 526-527, 529-530, 532-534, 536, 539, 541, 543-544, 547, 549, 552-553, 555-557, 560-561, 566-567, 569-571, 574, 576-577, 580, 583, 593, 598-599, 604, 606, 610-612, 616-617, 620-622, 625, 630-631, 633-635, 637-641, 643-644, 647, 650-654, 662, 664-667, 674-676, 678, 681, 685-689, 691-692, 696, 699-702, 708-711, 715-720, 722, 726, 728, 730-731, 733-734, 737, 743-745, 747-748, 751, 753-755, 757, 763, 765-766, 768-769, 771, 774-776, 778-779, 781-782, 784, 792-794, 797, 801-802, 804-807, 809, 813-815, 820, 822-823, 827, 829-830, 834-835, 837-838, 840-842, 844-847, 850, 852-853, 855, 859, 861, 863-864, 867-870, 873-874, 876-877, 879, 881-883, 885-888, 890-891, 893, 896-897, 900-901, 903-904, 906, 910-913, 915-916, 925, 929-930, 932, 934-935, 938, 940, 942, 945, 949-950, 952-953, 956, 958-963, 966, 970-971, 973-974, 977, 980, 982-983, 985-987, 989, 992, 995-1000, 1002, 1005-1011, 1014, 1016-1018, 1020-1023], topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0]] [21:05:14] : [Step 4/5] [2021-11-19 21:05:14,595][INFO ][exchange-worker-#10331%grid-3%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], err=null, rebalanced=true, wasRebalanced=true] [21:05:14] : [Step 4/5] [2021-11-19 21:05:14,598][INFO ][exchange-worker-#10482%grid-4%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=403a8bc7-744c-4854-9a1a-6778c9410004, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], evt=NODE_LEFT, evtNode=TcpDiscoveryNode [id=00b79a21-5f82-4914-a1d6-50f2b7cd2000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345113125, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0]] [21:05:14] : [Step 4/5] [2021-11-19 21:05:14,599][INFO ][exchange-worker-#10482%grid-4%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (0 ms), stage="Determine exchange type" (1 ms), stage="Preloading notification" (0 ms), stage="After states restored callback" (2 ms), stage="WAL history reservation" (1 ms), stage="Finalize update counters" (0 ms), stage="Detect lost partitions" (8 ms), stage="Exchange done" (1 ms), stage="Total time" (13 ms)] [21:05:14] : [Step 4/5] [2021-11-19 21:05:14,600][INFO ][exchange-worker-#10482%grid-4%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], stage="Affinity initialization (exchange-free switch on fully-rebalanced topology) [grp=encrypted]" (1 ms) (parent=Determine exchange type), stage="Affinity initialization (exchange-free switch on fully-rebalanced topology) [grp=ignite-sys-cache]" (0 ms) (parent=Determine exchange type)] [21:05:14]W: [org.apache.ignite:ignite-core] [2021-11-19 21:05:14,599][WARN ][exchange-worker-#10331%grid-3%][GridDhtPartitionTopologyImpl] Detected lost partitions [grp=encrypted, parts=[3-4, 6-13, 17-18, 20, 23, 27, 31-32, 35, 37-41, 43-46, 48, 53, 56, 61, 64-65, 69-71, 73, 75-76, 80, 82-83, 88-90, 93, 98-99, 101, 103-104, 109-110, 112-113, 115-117, 120-121, 123-125, 127-131, 137, 139, 142, 144, 146, 148-149, 152-153, 155, 157, 162, 165, 167-168, 177-179, 181, 184, 187-188, 190-192, 194-195, 203-204, 206, 210, 212-213, 215-218, 220-221, 225-228, 232-238, 241, 246, 249-255, 258, 260, 264-268, 271, 273-274, 277-279, 281, 283-284, 286, 288-291, 293, 296, 298-301, 303, 307, 309-310, 314-315, 318, 321-324, 327-328, 330-331, 333-334, 336-337, 342-343, 347-349, 351-352, 355-356, 358, 361, 363-364, 368, 370-375, 379-385, 391, 393-394, 398-400, 402-407, 409-410, 413-414, 416-418, 422-423, 426, 429-432, 434, 438-439, 442-444, 446-447, 449, 451, 454-455, 457-459, 462, 464, 468-472, 474-487, 493-494, 497-498, 501, 508, 513, 517, 519, 523-524, 526-527, 529-530, 532-534, 536, 539, 541, 543-544, 547, 549, 552-553, 555-557, 560-561, 566-567, 569-571, 574, 576-577, 580, 583, 593, 598-599, 604, 606, 610-612, 616-617, 620-622, 625, 630-631, 633-635, 637-641, 643-644, 647, 650-654, 662, 664-667, 674-676, 678, 681, 685-689, 691-692, 696, 699-702, 708-711, 715-720, 722, 726, 728, 730-731, 733-734, 737, 743-745, 747-748, 751, 753-755, 757, 763, 765-766, 768-769, 771, 774-776, 778-779, 781-782, 784, 792-794, 797, 801-802, 804-807, 809, 813-815, 820, 822-823, 827, 829-830, 834-835, 837-838, 840-842, 844-847, 850, 852-853, 855, 859, 861, 863-864, 867-870, 873-874, 876-877, 879, 881-883, 885-888, 890-891, 893, 896-897, 900-901, 903-904, 906, 910-913, 915-916, 925, 929-930, 932, 934-935, 938, 940, 942, 945, 949-950, 952-953, 956, 958-963, 966, 970-971, 973-974, 977, 980, 982-983, 985-987, 989, 992, 995-1000, 1002, 1005-1011, 1014, 1016-1018, 1020-1023], topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0]] [21:05:14] : [Step 4/5] [2021-11-19 21:05:14,600][INFO ][exchange-worker-#10482%grid-4%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], crd=false] [21:05:14] : [Step 4/5] [2021-11-19 21:05:14,604][INFO ][exchange-worker-#10331%grid-3%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=30452784-820b-4296-b945-9e9cdd509003, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], evt=NODE_LEFT, evtNode=TcpDiscoveryNode [id=00b79a21-5f82-4914-a1d6-50f2b7cd2000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345106570, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0]] [21:05:14] : [Step 4/5] [2021-11-19 21:05:14,604][INFO ][exchange-worker-#10482%grid-4%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=4, minorTopVer=0], force=false, evt=NODE_LEFT, node=00b79a21-5f82-4914-a1d6-50f2b7cd2000] [21:05:14] : [Step 4/5] [2021-11-19 21:05:14,605][INFO ][exchange-worker-#10331%grid-3%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (0 ms), stage="Determine exchange type" (1 ms), stage="Preloading notification" (0 ms), stage="After states restored callback" (0 ms), stage="WAL history reservation" (0 ms), stage="Finalize update counters" (0 ms), stage="Detect lost partitions" (8 ms), stage="Exchange done" (1 ms), stage="Total time" (10 ms)] [21:05:14] : [Step 4/5] [2021-11-19 21:05:14,606][INFO ][exchange-worker-#10331%grid-3%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], stage="Affinity initialization (exchange-free switch on fully-rebalanced topology) [grp=encrypted]" (1 ms) (parent=Determine exchange type), stage="Affinity initialization (exchange-free switch on fully-rebalanced topology) [grp=ignite-sys-cache]" (0 ms) (parent=Determine exchange type)] [21:05:14] : [Step 4/5] [2021-11-19 21:05:14,607][INFO ][exchange-worker-#10331%grid-3%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], crd=true] [21:05:14] : [Step 4/5] [2021-11-19 21:05:14,608][INFO ][exchange-worker-#10331%grid-3%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=4, minorTopVer=0], force=false, evt=NODE_LEFT, node=00b79a21-5f82-4914-a1d6-50f2b7cd2000] [21:05:16] : [Step 4/5] [2021-11-19 21:05:16,663][INFO ][main][FilePageStoreManager] Cleanup cache stores [total=4, left=0, cleanFiles=false] [21:05:16] : [Step 4/5] [2021-11-19 21:05:16,666][INFO ][main][GridDeploymentLocalStore] Removed undeployed class: GridDeployment [ts=1637345106682, depMode=SHARED, clsLdr=IsolatedClassLoader{roleName='test'}, clsLdrId=9603d593d71-00b79a21-5f82-4914-a1d6-50f2b7cd2000, userVer=0, loc=true, sampleClsName=org.apache.ignite.internal.processors.cache.distributed.dht.preloader.GridDhtPartitionMap, pendingUndeploy=false, undeployed=true, usage=0] [21:05:16] : [Step 4/5] [2021-11-19 21:05:16,675][INFO ][main][IgniteKernal%grid-0] [21:05:16] : [Step 4/5] [21:05:16] : [Step 4/5] >>> +------------------------------------------------------+ [21:05:16] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV stopped OK [21:05:16] : [Step 4/5] >>> +------------------------------------------------------+ [21:05:16] : [Step 4/5] >>> Ignite instance name: grid-0 [21:05:16] : [Step 4/5] >>> Grid uptime: 00:00:11.298 [21:05:16] : [Step 4/5] [21:05:16] : [Step 4/5] [21:05:16] : [Step 4/5] [2021-11-19 21:05:16,676][INFO ][main][root] >>> Stopping grid [name=grid-3, id=30452784-820b-4296-b945-9e9cdd509003] [21:05:17] : [Step 4/5] [2021-11-19 21:05:17,283][INFO ][db-checkpoint-thread-#10340%grid-3%][Checkpointer] Checkpoint started [checkpointId=62677099-a633-4d54-8588-7558b1c35331, startPtr=WALPointer [idx=0, fileOff=706747, len=11377], checkpointBeforeLockTime=5ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=1ms, checkpointLockHoldTime=2ms, walCpRecordFsyncDuration=147ms, writeCheckpointEntryDuration=446ms, splitAndSortCpPagesDuration=1ms, pages=531, reason='timeout'] [21:05:17] : [Step 4/5] [2021-11-19 21:05:17,290][INFO ][tcp-disco-sock-reader-[403a8bc7 127.0.0.1:47231]-#549%grid-3%-#10504%grid-3%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:47231, rmtPort=47231, rmtNodeId=403a8bc7-744c-4854-9a1a-6778c9410004] [21:05:17]W: [org.apache.ignite:ignite-core] [2021-11-19 21:05:17,292][WARN ][tcp-disco-sock-reader-[00b79a21 127.0.0.1:53493]-#537%grid-3%-#10327%grid-3%][TestTcpDiscoverySpi] Failed to shutdown socket [21:05:17]W: [org.apache.ignite:ignite-core] java.net.SocketException: Socket is closed [21:05:17]W: [org.apache.ignite:ignite-core] at java.net.Socket.shutdownOutput(Socket.java:1568) [21:05:17] : [Step 4/5] [2021-11-19 21:05:17,293][INFO ][tcp-disco-sock-reader-[00b79a21 127.0.0.1:53493]-#537%grid-3%-#10327%grid-3%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:53493, rmtPort=53493, rmtNodeId=00b79a21-5f82-4914-a1d6-50f2b7cd2000] [21:05:17]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.close(IgniteUtils.java:4247) [21:05:17]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.discovery.tcp.ServerImpl$SocketReader.body(ServerImpl.java:7370) [21:05:17]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.IgniteSpiThread.run(IgniteSpiThread.java:58) [21:05:17] : [Step 4/5] [2021-11-19 21:05:17,296][INFO ][main][GridCacheProcessor] Stopped cache [cacheName=ignite-sys-cache] [21:05:17] : [Step 4/5] [2021-11-19 21:05:17,297][INFO ][main][GridCacheProcessor] Stopped cache [cacheName=encrypted] [21:05:17] : [Step 4/5] [2021-11-19 21:05:17,297][INFO ][disco-event-worker-#10481%grid-4%][GridDiscoveryManager] Node left topology: TcpDiscoveryNode [id=30452784-820b-4296-b945-9e9cdd509003, consistentId=grid-3, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637345113125, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false] [21:05:17] : [Step 4/5] [2021-11-19 21:05:17,299][INFO ][disco-event-worker-#10481%grid-4%][GridDiscoveryManager] Topology snapshot [ver=5, locNode=403a8bc7, servers=1, clients=0, state=ACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=403a8bc7-744c-4854-9a1a-6778c9410004, consistentId=grid-4, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:05:17] : [Step 4/5] [2021-11-19 21:05:17,300][INFO ][disco-event-worker-#10481%grid-4%][GridDiscoveryManager] Coordinator changed [prev=TcpDiscoveryNode [id=30452784-820b-4296-b945-9e9cdd509003, consistentId=grid-3, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637345113125, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], cur=TcpDiscoveryNode [id=403a8bc7-744c-4854-9a1a-6778c9410004, consistentId=grid-4, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47502], discPort=47502, order=3, intOrder=3, lastExchangeTime=1637345117284, loc=true, ver=2.13.0#20211119-sha1:00000000, isClient=false]] [21:05:17] : [Step 4/5] [2021-11-19 21:05:17,301][INFO ][disco-event-worker-#10481%grid-4%][GridDiscoveryManager] ^-- Baseline [id=0, size=2, online=0, offline=2] [21:05:17] : [Step 4/5] [2021-11-19 21:05:17,302][INFO ][disco-event-worker-#10481%grid-4%][MvccProcessorImpl] Assigned mvcc coordinator [crd=MvccCoordinator [topVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], nodeId=403a8bc7-744c-4854-9a1a-6778c9410004, ver=1637345105353, local=true, initialized=false]] [21:05:17] : [Step 4/5] [2021-11-19 21:05:17,304][INFO ][sys-#10453%grid-4%][ExchangeLatchManager] Become new coordinator 403a8bc7-744c-4854-9a1a-6778c9410004 [21:05:17] : [Step 4/5] [2021-11-19 21:05:17,304][INFO ][exchange-worker-#10482%grid-4%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], crd=true, evt=NODE_LEFT, evtNode=30452784-820b-4296-b945-9e9cdd509003, customEvt=null, allowMerge=false, exchangeFreeSwitch=true] [21:05:17]W: [org.apache.ignite:ignite-core] [2021-11-19 21:05:17,305][WARN ][exchange-worker-#10482%grid-4%][ExchangeDiscoveryEvents] All server nodes for the following caches have left the cluster: 'ignite-sys-cache', 'encrypted' [21:05:17]W: [org.apache.ignite:ignite-core] [2021-11-19 21:05:17,306][WARN ][exchange-worker-#10482%grid-4%][ExchangeDiscoveryEvents] Must have server nodes for caches to operate. [21:05:17] : [Step 4/5] [2021-11-19 21:05:17,306][INFO ][sys-#10466%grid-4%][GridAffinityAssignmentCache] Local node affinity assignment distribution is not ideal [cache=encrypted, expectedPrimary=Infinity, actualPrimary=0, expectedBackups=NaN, actualBackups=0, warningThreshold=50.00%] [21:05:17] : [Step 4/5] [2021-11-19 21:05:17,307][INFO ][exchange-worker-#10482%grid-4%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:05:17] : [Step 4/5] [2021-11-19 21:05:17,309][INFO ][exchange-worker-#10482%grid-4%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], err=null, rebalanced=true, wasRebalanced=true] [21:05:17]W: [org.apache.ignite:ignite-core] [2021-11-19 21:05:17,310][WARN ][sys-#10470%grid-4%][GridDhtPartitionTopologyImpl] Detected lost partitions [grp=ignite-sys-cache, parts=[0-99], topVer=AffinityTopologyVersion [topVer=5, minorTopVer=0]] [21:05:17]W: [org.apache.ignite:ignite-core] [2021-11-19 21:05:17,311][WARN ][exchange-worker-#10482%grid-4%][GridDhtPartitionTopologyImpl] Detected lost partitions [grp=encrypted, parts=[0-2, 5, 14-16, 19, 21-22, 24-26, 28-30, 33-34, 36, 42, 47, 49-52, 54-55, 57-60, 62-63, 66-68, 72, 74, 77-79, 81, 84-87, 91-92, 94-97, 100, 102, 105-108, 111, 114, 118-119, 122, 126, 132-136, 138, 140-141, 143, 145, 147, 150-151, 154, 156, 158-161, 163-164, 166, 169-176, 180, 182-183, 185-186, 189, 193, 196-202, 205, 207-209, 211, 214, 219, 222-224, 229-231, 239-240, 242-245, 247-248, 256-257, 259, 261-263, 269-270, 272, 275-276, 280, 282, 285, 287, 292, 294-295, 297, 302, 304-306, 308, 311-313, 316-317, 319-320, 325-326, 329, 332, 335, 338-341, 344-346, 350, 353-354, 357, 359-360, 362, 365-367, 369, 376-378, 386-390, 392, 395-397, 401, 408, 411-412, 415, 419-421, 424-425, 427-428, 433, 435-437, 440-441, 445, 448, 450, 452-453, 456, 460-461, 463, 465-467, 473, 488-492, 495-496, 499-500, 502-507, 509-512, 514-516, 518, 520-522, 525, 528, 531, 535, 537-538, 540, 542, 545-546, 548, 550-551, 554, 558-559, 562-565, 568, 572-573, 575, 578-579, 581-582, 584-592, 594-597, 600-603, 605, 607-609, 613-615, 618-619, 623-624, 626-629, 632, 636, 642, 645-646, 648-649, 655-661, 663, 668-673, 677, 679-680, 682-684, 690, 693-695, 697-698, 703-707, 712-714, 721, 723-725, 727, 729, 732, 735-736, 738-742, 746, 749-750, 752, 756, 758-762, 764, 767, 770, 772-773, 777, 780, 783, 785-791, 795-796, 798-800, 803, 808, 810-812, 816-819, 821, 824-826, 828, 831-833, 836, 839, 843, 848-849, 851, 854, 856-858, 860, 862, 865-866, 871-872, 875, 878, 880, 884, 889, 892, 894-895, 898-899, 902, 905, 907-909, 914, 917-924, 926-928, 931, 933, 936-937, 939, 941, 943-944, 946-948, 951, 954-955, 957, 964-965, 967-969, 972, 975-976, 978-979, 981, 984, 988, 990-991, 993-994, 1001, 1003-1004, 1012-1013, 1015, 1019], topVer=AffinityTopologyVersion [topVer=5, minorTopVer=0]] [21:05:17] : [Step 4/5] [2021-11-19 21:05:17,314][INFO ][exchange-worker-#10482%grid-4%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=403a8bc7-744c-4854-9a1a-6778c9410004, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], evt=NODE_LEFT, evtNode=TcpDiscoveryNode [id=30452784-820b-4296-b945-9e9cdd509003, consistentId=grid-3, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637345113125, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=5, minorTopVer=0]] [21:05:17] : [Step 4/5] [2021-11-19 21:05:17,315][INFO ][exchange-worker-#10482%grid-4%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (0 ms), stage="Determine exchange type" (2 ms), stage="Preloading notification" (0 ms), stage="After states restored callback" (0 ms), stage="WAL history reservation" (0 ms), stage="Finalize update counters" (0 ms), stage="Detect lost partitions" (4 ms), stage="Exchange done" (1 ms), stage="Total time" (7 ms)] [21:05:17] : [Step 4/5] [2021-11-19 21:05:17,315][INFO ][exchange-worker-#10482%grid-4%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], stage="Affinity initialization (exchange-free switch on fully-rebalanced topology) [grp=encrypted]" (2 ms) (parent=Determine exchange type), stage="Affinity initialization (exchange-free switch on fully-rebalanced topology) [grp=ignite-sys-cache]" (1 ms) (parent=Determine exchange type)] [21:05:17] : [Step 4/5] [2021-11-19 21:05:17,317][INFO ][exchange-worker-#10482%grid-4%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], crd=true] [21:05:17] : [Step 4/5] [2021-11-19 21:05:17,317][INFO ][exchange-worker-#10482%grid-4%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=5, minorTopVer=0], force=false, evt=NODE_LEFT, node=30452784-820b-4296-b945-9e9cdd509003] [21:05:19] : [Step 4/5] [2021-11-19 21:05:19,494][INFO ][main][FilePageStoreManager] Cleanup cache stores [total=4, left=0, cleanFiles=false] [21:05:19] : [Step 4/5] [2021-11-19 21:05:19,497][INFO ][main][GridDeploymentLocalStore] Removed undeployed class: GridDeployment [ts=1637345106693, depMode=SHARED, clsLdr=IsolatedClassLoader{roleName='test'}, clsLdrId=b603d593d71-30452784-820b-4296-b945-9e9cdd509003, userVer=0, loc=true, sampleClsName=org.apache.ignite.internal.processors.cache.distributed.dht.preloader.IgniteDhtPartitionHistorySuppliersMap, pendingUndeploy=false, undeployed=true, usage=0] [21:05:19] : [Step 4/5] [2021-11-19 21:05:19,505][INFO ][main][IgniteKernal%grid-3] [21:05:19] : [Step 4/5] [21:05:19] : [Step 4/5] >>> +------------------------------------------------------+ [21:05:19] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV stopped OK [21:05:19] : [Step 4/5] >>> +------------------------------------------------------+ [21:05:19] : [Step 4/5] >>> Ignite instance name: grid-3 [21:05:19] : [Step 4/5] >>> Grid uptime: 00:00:12.903 [21:05:19] : [Step 4/5] [21:05:19] : [Step 4/5] [21:05:19] : [Step 4/5] [2021-11-19 21:05:19,506][INFO ][main][root] >>> Stopping grid [name=grid-4, id=403a8bc7-744c-4854-9a1a-6778c9410004] [21:05:19] : [Step 4/5] [2021-11-19 21:05:19,513][INFO ][db-checkpoint-thread-#10488%grid-4%][Checkpointer] Skipping checkpoint (no pages were modified) [checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, reason='timeout'] [21:05:19] : [Step 4/5] [2021-11-19 21:05:19,518][INFO ][tcp-disco-sock-reader-[30452784 127.0.0.1:34935]-#546%grid-4%-#10478%grid-4%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:34935, rmtPort=34935, rmtNodeId=30452784-820b-4296-b945-9e9cdd509003] [21:05:19] : [Step 4/5] [2021-11-19 21:05:19,528][INFO ][main][GridCacheProcessor] Stopped cache [cacheName=ignite-sys-cache] [21:05:19] : [Step 4/5] [2021-11-19 21:05:19,529][INFO ][main][GridCacheProcessor] Stopped cache [cacheName=encrypted] [21:05:19] : [Step 4/5] [2021-11-19 21:05:19,533][INFO ][main][FilePageStoreManager] Cleanup cache stores [total=4, left=0, cleanFiles=false] [21:05:19] : [Step 4/5] [2021-11-19 21:05:19,535][INFO ][main][GridDeploymentLocalStore] Removed undeployed class: GridDeployment [ts=1637345114249, depMode=SHARED, clsLdr=IsolatedClassLoader{roleName='test'}, clsLdrId=fb23d593d71-403a8bc7-744c-4854-9a1a-6778c9410004, userVer=0, loc=true, sampleClsName=org.apache.ignite.internal.processors.cache.distributed.dht.preloader.IgniteDhtPartitionHistorySuppliersMap, pendingUndeploy=false, undeployed=true, usage=0] [21:05:19] : [Step 4/5] [2021-11-19 21:05:19,544][INFO ][main][IgniteKernal%grid-4] [21:05:19] : [Step 4/5] [21:05:19] : [Step 4/5] >>> +------------------------------------------------------+ [21:05:19] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV stopped OK [21:05:19] : [Step 4/5] >>> +------------------------------------------------------+ [21:05:19] : [Step 4/5] >>> Ignite instance name: grid-4 [21:05:19] : [Step 4/5] >>> Grid uptime: 00:00:05.255 [21:05:19] : [Step 4/5] [21:05:19] : [Step 4/5] [21:05:19] : [Step 4/5] [21:05:19] >>> Starting test: EncryptedCacheNodeJoinTest#testClientNodeJoinInactiveClusterWithExistingStaticCacheConfig <<< [21:05:19] : [Step 4/5] [2021-11-19 21:05:19,978][INFO ][main][root] >>> Starting test: EncryptedCacheNodeJoinTest#testClientNodeJoinInactiveClusterWithExistingStaticCacheConfig <<< [21:05:19] : [Step 4/5] [21:05:19] >>> Heap: 486 MB used / 1913 MB commited / 1913 MB max <<< [21:05:19] : [Step 4/5] [2021-11-19 21:05:19,979][INFO ][main][root] >>> Heap: 486 MB used / 1913 MB commited / 1913 MB max <<< [21:05:19] : [Step 4/5] [21:05:19] >>> Non-Heap: 143 MB used / 156 MB commited / 0 MB max <<< [21:05:19] : [Step 4/5] [2021-11-19 21:05:19,979][INFO ][main][root] >>> Non-Heap: 143 MB used / 156 MB commited / 0 MB max <<< [21:05:19]W: [org.apache.ignite:ignite-core] [2021-11-19 21:05:19,986][WARN ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][G] Ignite work directory is not provided, automatically resolved to: /opt/buildagent/work/7bc1c54bc719b67c/work [21:05:19] : [Step 4/5] [2021-11-19 21:05:19,988][INFO ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] [21:05:19] : [Step 4/5] [21:05:19] : [Step 4/5] >>> __________ ________________ [21:05:19] : [Step 4/5] >>> / _/ ___/ |/ / _/_ __/ __/ [21:05:19] : [Step 4/5] >>> _/ // (7 7 // / / / / _/ [21:05:19] : [Step 4/5] >>> /___/\___/_/|_/___/ /_/ /___/ [21:05:19] : [Step 4/5] >>> [21:05:19] : [Step 4/5] >>> ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:05:19] : [Step 4/5] >>> 2021 Copyright(C) Apache Software Foundation [21:05:19] : [Step 4/5] >>> [21:05:19] : [Step 4/5] >>> Ignite documentation: http://ignite.apache.org [21:05:19] : [Step 4/5] [21:05:19] : [Step 4/5] [2021-11-19 21:05:19,990][INFO ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] Config URL: n/a [21:05:20] : [Step 4/5] [2021-11-19 21:05:19,990][INFO ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] IgniteConfiguration [igniteInstanceName=grid-0, pubPoolSize=24, svcPoolSize=24, callbackPoolSize=24, stripedPoolSize=24, sysPoolSize=24, mgmtPoolSize=4, dataStreamerPoolSize=24, utilityCachePoolSize=24, utilityCacheKeepAliveTime=60000, p2pPoolSize=2, qryPoolSize=24, buildIdxPoolSize=4, igniteHome=/opt/buildagent/work/7bc1c54bc719b67c, igniteWorkDir=/opt/buildagent/work/7bc1c54bc719b67c/work, mbeanSrv=com.sun.jmx.mbeanserver.JmxMBeanServer@6fe85038, nodeId=00622f8d-e1fe-42dd-95f9-54f5fc364000, marsh=BinaryMarshaller [], marshLocJobs=false, daemon=false, p2pEnabled=true, netTimeout=10000, netCompressionLevel=1, sndRetryDelay=1000, sndRetryCnt=3, metricsHistSize=10000, metricsUpdateFreq=1000, metricsExpTime=9223372036854775807, discoSpi=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=0, ackTimeout=0, marsh=null, reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], segPlc=STOP, segResolveAttempts=2, waitForSegOnStart=true, allResolversPassReq=true, segChkFreq=10000, commSpi=TcpCommunicationSpi [connectGate=org.apache.ignite.spi.communication.tcp.internal.ConnectGateway@7cec7ab, ctxInitLatch=java.util.concurrent.CountDownLatch@4b6a7528[Count = 1], stopping=false, clientPool=null, nioSrvWrapper=null, stateProvider=null], evtSpi=MemoryEventStorageSpi [expireAgeMs=9223372036854775807, expireCnt=10000, filter=null], colSpi=NoopCollisionSpi [], deploySpi=LocalDeploymentSpi [], indexingSpi=org.apache.ignite.spi.indexing.noop.NoopIndexingSpi@1a583a29, addrRslvr=null, encryptionSpi=org.apache.ignite.spi.encryption.keystore.KeystoreEncryptionSpi@1137fc0d, tracingSpi=org.apache.ignite.spi.tracing.NoopTracingSpi@6fb920b5, clientMode=false, rebalanceThreadPoolSize=4, rebalanceTimeout=10000, rebalanceBatchesPrefetchCnt=3, rebalanceThrottle=0, rebalanceBatchSize=524288, txCfg=TransactionConfiguration [txSerEnabled=false, dfltIsolation=REPEATABLE_READ, dfltConcurrency=PESSIMISTIC, dfltTxTimeout=0, txTimeoutOnPartitionMapExchange=0, deadlockTimeout=10000, pessimisticTxLogSize=0, pessimisticTxLogLinger=10000, tmLookupClsName=null, txManagerFactory=null, useJtaSync=false], cacheSanityCheckEnabled=true, discoStartupDelay=60000, deployMode=SHARED, p2pMissedCacheSize=100, locHost=127.0.0.1, timeSrvPortBase=31100, timeSrvPortRange=100, failureDetectionTimeout=10000, sysWorkerBlockedTimeout=null, clientFailureDetectionTimeout=10000, metricsLogFreq=0, connectorCfg=null, odbcCfg=null, warmupClos=null, atomicCfg=AtomicConfiguration [seqReserveSize=1000, cacheMode=PARTITIONED, backups=1, aff=null, grpName=null], classLdr=null, sslCtxFactory=null, platformCfg=null, binaryCfg=null, memCfg=null, pstCfg=null, dsCfg=DataStorageConfiguration [sysRegionInitSize=41943040, sysRegionMaxSize=104857600, pageSize=4096, concLvl=0, dfltDataRegConf=DataRegionConfiguration [name=default, maxSize=10485760, initSize=268435456, swapPath=null, pageEvictionMode=DISABLED, pageReplacementMode=CLOCK, evictionThreshold=0.9, emptyPagesPoolSize=100, metricsEnabled=false, metricsSubIntervalCount=5, metricsRateTimeInterval=60000, persistenceEnabled=true, checkpointPageBufSize=0, lazyMemoryAllocation=true, warmUpCfg=null], dataRegions=null, storagePath=null, checkpointFreq=180000, lockWaitTime=10000, checkpointThreads=4, checkpointWriteOrder=SEQUENTIAL, walHistSize=20, maxWalArchiveSize=1073741824, walSegments=10, walSegmentSize=67108864, walPath=db/wal, walArchivePath=db/wal/archive, cdcWalPath=db/wal/cdc, cdcEnabled=false, metricsEnabled=false, walMode=FSYNC, walTlbSize=131072, walBuffSize=0, walFlushFreq=2000, walFsyncDelay=1000, walRecordIterBuffSize=67108864, alwaysWriteFullPages=false, fileIOFactory=org.apache.ignite.internal.processors.cache.persistence.file.AsyncFileIOFactory@1e4c59e6, metricsSubIntervalCnt=5, metricsRateTimeInterval=60000, walAutoArchiveAfterInactivity=-1, walForceArchiveTimeout=-1, writeThrottlingEnabled=false, walCompactionEnabled=false, walCompactionLevel=1, checkpointReadLockTimeout=null, walPageCompression=DISABLED, walPageCompressionLevel=null, dfltWarmUpCfg=null, encCfg=org.apache.ignite.configuration.EncryptionConfiguration@1b093c1b, defragmentationThreadPoolSize=4, minWalArchiveSize=-1], snapshotPath=snapshots, activeOnStart=true, activeOnStartPropSetFlag=false, autoActivation=true, autoActivationPropSetFlag=false, clusterStateOnStart=null, sqlConnCfg=null, cliConnCfg=ClientConnectorConfiguration [host=null, port=10800, portRange=100, sockSndBufSize=0, sockRcvBufSize=0, tcpNoDelay=true, maxOpenCursorsPerConn=128, threadPoolSize=24, selectorCnt=12, idleTimeout=0, handshakeTimeout=10000, jdbcEnabled=true, odbcEnabled=true, thinCliEnabled=true, sslEnabled=false, useIgniteSslCtxFactory=true, sslClientAuth=false, sslCtxFactory=null, thinCliCfg=ThinClientConfiguration [maxActiveTxPerConn=100, maxActiveComputeTasksPerConn=0]], mvccVacuumThreadCnt=2, mvccVacuumFreq=5000, authEnabled=false, failureHnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]], commFailureRslvr=null, sqlCfg=SqlConfiguration [longQryWarnTimeout=3000, dfltQryTimeout=0, sqlQryHistSize=1000, validationEnabled=false], asyncContinuationExecutor=null] [21:05:20] : [Step 4/5] [2021-11-19 21:05:20,000][INFO ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] Daemon mode: off [21:05:20] : [Step 4/5] [2021-11-19 21:05:20,000][INFO ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] OS: Linux 4.15.0-151-generic amd64 [21:05:20] : [Step 4/5] [2021-11-19 21:05:20,001][INFO ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] OS user: teamcity [21:05:20] : [Step 4/5] [2021-11-19 21:05:20,001][INFO ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] PID: 16724 [21:05:20] : [Step 4/5] [2021-11-19 21:05:20,002][INFO ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] Language runtime: Java Platform API Specification ver. 1.8 [21:05:20] : [Step 4/5] [2021-11-19 21:05:20,002][INFO ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] VM information: Java(TM) SE Runtime Environment 1.8.0_261-b12 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 25.261-b12 [21:05:20] : [Step 4/5] [2021-11-19 21:05:20,003][INFO ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] VM total memory: 1.9GB [21:05:20] : [Step 4/5] [2021-11-19 21:05:20,003][INFO ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] Remote Management [restart: off, REST: off, JMX (remote: off)] [21:05:20] : [Step 4/5] [2021-11-19 21:05:20,003][INFO ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] Logger: GridTestLog4jLogger [quiet=false, config=null] [21:05:20] : [Step 4/5] [2021-11-19 21:05:20,003][INFO ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] IGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c [21:05:20] : [Step 4/5] [2021-11-19 21:05:20,004][INFO ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] VM arguments: [-DIGNITE_DUMP_THREADS_ON_FAILURE=false, -DMono=/usr/bin/mono-sgen, -DMono4.0_x64=/usr/lib/mono/4.0, -DMono4.5_x64=/usr/lib/mono/4.5, -DMonoVersion=6.12.0.90, -DSKIP_BUILD=false, -Dagent.home.dir=/opt/buildagent, -Dagent.name=aitc-lin02_03, -Dagent.ownPort=9090, -Dagent.work.dir=/opt/buildagent/work, -Dbuild.number=95, -Dbuild.vcs.number=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.1=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.GitHubApacheIgnite=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dclassworlds.conf=/opt/buildagent/temp/buildTmp/teamcity.m2.conf, -Dcom.jetbrains.maven.watcher.report.file=/opt/buildagent/temp/buildTmp/maven-build-info.xml, -Djava.io.tmpdir=/opt/buildagent/temp/buildTmp, -Dmaven.home=/opt/buildagent/tools/maven3_6, -Dmaven.multiModuleProjectDirectory=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.agent.cpuBenchmark=457, -Dteamcity.agent.dotnet.agent_url=http://localhost:9090/RPC2, -Dteamcity.agent.dotnet.build_id=6278078, -Dteamcity.auth.password=*******, -Dteamcity.auth.userId=TeamCityBuildId=6278078, -Dteamcity.build.changedFiles.file=/opt/buildagent/temp/buildTmp/changedFiles6342607772318147725.txt, -Dteamcity.build.checkoutDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.build.id=6278078, -Dteamcity.build.properties.file=/opt/buildagent/temp/buildTmp/teamcity.build5164517880467851002.properties, -Dteamcity.build.tempDir=/opt/buildagent/temp/buildTmp, -Dteamcity.build.workingDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.buildConfName=Basic 3, -Dteamcity.buildType.id=IgniteTests24Java8_Basic3, -Dteamcity.configuration.properties.file=/opt/buildagent/temp/buildTmp/teamcity.config5591980786735343870.properties, -Dteamcity.maven.userSettings.path=/opt/buildagent/temp/buildTmp/maven_settings_585072866407032347.xml, -Dteamcity.maven.watcher.home=/opt/buildagent/plugins/mavenPlugin/maven-watcher-jdk16, -Dteamcity.projectName=Ignite Tests 2.x (JDK 8/11), -Dteamcity.runner.properties.file=/opt/buildagent/temp/buildTmp/teamcity.runner9098465561618137420.properties, -Dteamcity.tests.recentlyFailedTests.file=/opt/buildagent/temp/buildTmp/testsToRunFirst3891775683130404069.txt, -Dteamcity.version=2021.2 (build 99542), -ea, -Xms2g, -Xmx2g, -XX:+HeapDumpOnOutOfMemoryError, -DIGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_TEST_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_UPDATE_NOTIFIER=false, -DIGNITE_NO_DISCO_ORDER=true, -DIGNITE_PERFORMANCE_SUGGESTIONS_DISABLED=true, -Djava.net.preferIPv4Stack=true, -DTEST_SCALE_FACTOR=1.0, -DIGNITE_TEST_PROP_LOG4J_FILE=log4j-tc-test.xml, -DIGNITE_QUIET=false, -DIGNITE_MARSHAL_BUFFERS_RECHECK=1000, -Dmaven.repo.local=/opt/buildagent/.m2/repository] [21:05:20] : [Step 4/5] [2021-11-19 21:05:20,009][INFO ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] System cache's DataRegion size is configured to 40 MB. Use DataStorageConfiguration.systemRegionInitialSize property to change the setting. [21:05:20] : [Step 4/5] [2021-11-19 21:05:20,010][INFO ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] Configured caches [in 'sysMemPlc' dataRegion: ['ignite-sys-cache'], in 'default' dataRegion: ['encrypted']] [21:05:20]W: [org.apache.ignite:ignite-core] [2021-11-19 21:05:20,010][WARN ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] Peer class loading is enabled (disable it in production for performance and deployment consistency reasons) [21:05:20] : [Step 4/5] [2021-11-19 21:05:20,010][INFO ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] 3-rd party licenses can be found at: /opt/buildagent/work/7bc1c54bc719b67c/libs/licenses [21:05:20] : [Step 4/5] [2021-11-19 21:05:20,016][INFO ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] Configured plugins: [21:05:20] : [Step 4/5] [2021-11-19 21:05:20,017][INFO ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- StanByClusterTestProvider 1.0 [21:05:20] : [Step 4/5] [2021-11-19 21:05:20,017][INFO ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- null [21:05:20] : [Step 4/5] [2021-11-19 21:05:20,017][INFO ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] [21:05:20] : [Step 4/5] [2021-11-19 21:05:20,017][INFO ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- PageMemory tracker plugin 1.0 [21:05:20] : [Step 4/5] [2021-11-19 21:05:20,018][INFO ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- null [21:05:20] : [Step 4/5] [2021-11-19 21:05:20,018][INFO ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] [21:05:20] : [Step 4/5] [2021-11-19 21:05:20,018][INFO ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- TestDistibutedConfigurationPlugin 1.0 [21:05:20] : [Step 4/5] [2021-11-19 21:05:20,019][INFO ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- null [21:05:20] : [Step 4/5] [2021-11-19 21:05:20,019][INFO ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] [21:05:20] : [Step 4/5] [2021-11-19 21:05:20,019][INFO ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- NodeValidationPluginProvider 1.0 [21:05:20] : [Step 4/5] [2021-11-19 21:05:20,019][INFO ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- null [21:05:20] : [Step 4/5] [2021-11-19 21:05:20,020][INFO ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] [21:05:20] : [Step 4/5] [2021-11-19 21:05:20,020][INFO ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][FailureProcessor] Configured failure handler: [hnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]]] [21:05:20] : [Step 4/5] [2021-11-19 21:05:20,051][INFO ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][TcpCommunicationSpi] Successfully bound communication NIO server to TCP port [port=45150, locHost=/127.0.0.1, selectorsCnt=12, selectorSpins=0, pairedConn=false] [21:05:20]W: [org.apache.ignite:ignite-core] [2021-11-19 21:05:20,052][WARN ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][TcpCommunicationSpi] Message queue limit is set to 0 which may lead to potential OOMEs when running cache operations in FULL_ASYNC or PRIMARY_SYNC modes due to message queues growth on sender and receiver sides. [21:05:20] : [Step 4/5] [2021-11-19 21:05:20,062][INFO ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][GridCollisionManager] Collision resolution is disabled (all jobs will be activated upon arrival). [21:05:20] : [Step 4/5] [2021-11-19 21:05:20,062][INFO ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] Security status [authentication=off, sandbox=off, tls/ssl=off] [21:05:20] : [Step 4/5] [2021-11-19 21:05:20,141][INFO ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:05:20] : [Step 4/5] [2021-11-19 21:05:20,257][INFO ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][MaintenanceProcessor] Resolved store directory for node persistent data: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0 [21:05:20] : [Step 4/5] [2021-11-19 21:05:20,259][INFO ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][CacheObjectBinaryProcessorImpl] Resolved directory for serialized binary metadata: /opt/buildagent/work/7bc1c54bc719b67c/work/db/binary_meta/grid_0 [21:05:20] : [Step 4/5] [2021-11-19 21:05:20,264][INFO ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0 [21:05:20] : [Step 4/5] [2021-11-19 21:05:20,264][INFO ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][FileWriteAheadLogManager] Resolved write ahead log work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0 [21:05:20] : [Step 4/5] [2021-11-19 21:05:20,265][INFO ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][FileWriteAheadLogManager] Resolved write ahead log archive directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0 [21:05:20] : [Step 4/5] [2021-11-19 21:05:20,732][INFO ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000000.wal [21:05:20]W: [org.apache.ignite:ignite-core] [2021-11-19 21:05:20,733][WARN ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] DataRegion maxSize=10.5 MB is smaller than defaultInitialSize=268.4 MB, setting initialSize to 10.5 MB [21:05:20] : [Step 4/5] [2021-11-19 21:05:20,739][INFO ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Configured data regions initialized successfully [total=5] [21:05:20] : [Step 4/5] [2021-11-19 21:05:20,748][INFO ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][IgniteSnapshotManager] Resolved snapshot work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/snapshots [21:05:20] : [Step 4/5] [2021-11-19 21:05:20,749][INFO ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][IgniteSnapshotManager] Resolved temp directory for snapshot creation: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0/snp [21:05:20] : [Step 4/5] [2021-11-19 21:05:20,752][INFO ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][ClientListenerProcessor] Client connector processor has started on TCP port 10800 [21:05:20] : [Step 4/5] [2021-11-19 21:05:20,759][INFO ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] Non-loopback local IPs: 172.17.0.4 [21:05:20] : [Step 4/5] [2021-11-19 21:05:20,759][INFO ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] Enabled local MACs: 0242AC110004 [21:05:20] : [Step 4/5] [2021-11-19 21:05:20,762][INFO ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:05:20] : [Step 4/5] [2021-11-19 21:05:20,764][INFO ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:05:20] : [Step 4/5] [2021-11-19 21:05:20,765][INFO ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:05:20] : [Step 4/5] [2021-11-19 21:05:20,767][INFO ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Applying lost metastore updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:05:20] : [Step 4/5] [2021-11-19 21:05:20,768][INFO ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=0 ms] [21:05:20] : [Step 4/5] [2021-11-19 21:05:20,768][INFO ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][GridCacheProcessor] Restoring partition state for local groups. [21:05:20] : [Step 4/5] [2021-11-19 21:05:20,769][INFO ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=0, partitionsProcessed=0, time=0ms] [21:05:20] : [Step 4/5] [2021-11-19 21:05:20,769][INFO ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][GridEncryptionManager] Encryption keys loaded from metastore. [grps=, masterKeyName=ignite.master.key] [21:05:20] : [Step 4/5] [2021-11-19 21:05:20,776][INFO ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][ClusterProcessor] Cluster ID and tag has been read from metastorage: null [21:05:20] : [Step 4/5] [2021-11-19 21:05:20,777][INFO ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][IgniteClusterImpl] Shutdown policy was updated [oldVal=null, newVal=null] [21:05:20] : [Step 4/5] [2021-11-19 21:05:20,777][INFO ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Checkpoint frequency deviation changed [oldVal=null, newVal=null] [21:05:20] : [Step 4/5] [2021-11-19 21:05:20,791][INFO ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][FilePageStoreManager] Cleanup cache stores [total=1, left=0, cleanFiles=false] [21:05:20] : [Step 4/5] [2021-11-19 21:05:20,795][INFO ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:05:20] : [Step 4/5] [2021-11-19 21:05:20,795][INFO ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:05:20] : [Step 4/5] [2021-11-19 21:05:20,799][INFO ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:05:20] : [Step 4/5] [2021-11-19 21:05:20,799][INFO ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Data Regions Started: 5 [21:05:20] : [Step 4/5] [2021-11-19 21:05:20,799][INFO ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] ^-- sysMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:05:20] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:05:20] : [Step 4/5] ^-- default region [type=default, persistence=true, lazyAlloc=true, [21:05:20] : [Step 4/5] ... initCfg=10MB, maxCfg=10MB, usedRam=0MB, freeRam=100%, allocRam=0MB, allocTotal=0MB] [21:05:20] : [Step 4/5] ^-- metastoreMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:05:20] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:05:20] : [Step 4/5] ^-- TxLog region [type=internal, persistence=true, lazyAlloc=false, [21:05:20] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:05:20] : [Step 4/5] ^-- volatileDsMemPlc region [type=user, persistence=false, lazyAlloc=true, [21:05:20] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB] [21:05:20] : [Step 4/5] ^-- Ignite persistence [used=0MB] [21:05:20] : [Step 4/5] [21:05:20] : [Step 4/5] [2021-11-19 21:05:20,801][INFO ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Starting binary memory restore for: [-2100569601, 1613773252] [21:05:20] : [Step 4/5] [2021-11-19 21:05:20,857][INFO ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:05:20] : [Step 4/5] [2021-11-19 21:05:20,858][INFO ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:05:20] : [Step 4/5] [2021-11-19 21:05:20,859][INFO ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000000.wal, offset=0, ver=2] [21:05:20] : [Step 4/5] [2021-11-19 21:05:20,868][INFO ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][GridCacheProcessor] Started cache in recovery mode [name=ignite-sys-cache, id=-2100569601, dataRegionName=sysMemPlc, mode=REPLICATED, atomicity=TRANSACTIONAL, backups=2147483647, mvcc=false] [21:05:20] : [Step 4/5] [2021-11-19 21:05:20,869][INFO ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][PageMemoryImpl] Started page memory [memoryAllocated=24.0 MiB, pages=5952, tableSize=474.2 KiB, replacementSize=768 B, checkpointBuffer=10.0 MiB] [21:05:20] : [Step 4/5] [2021-11-19 21:05:20,872][INFO ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][GridCacheProcessor] Started cache in recovery mode [name=encrypted, id=1613773252, dataRegionName=default, mode=PARTITIONED, atomicity=TRANSACTIONAL, backups=0, mvcc=false] [21:05:20] : [Step 4/5] [2021-11-19 21:05:20,873][INFO ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Binary recovery performed in 72 ms. [21:05:20] : [Step 4/5] [2021-11-19 21:05:20,873][INFO ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:05:20] : [Step 4/5] [2021-11-19 21:05:20,874][INFO ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Applying lost cache updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:05:20] : [Step 4/5] [2021-11-19 21:05:20,937][INFO ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=60 ms] [21:05:20] : [Step 4/5] [2021-11-19 21:05:20,938][INFO ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][GridCacheProcessor] Restoring partition state for local groups. [21:05:20] : [Step 4/5] [2021-11-19 21:05:20,947][INFO ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=2, partitionsProcessed=1124, time=10ms] [21:05:21] : [Step 4/5] [2021-11-19 21:05:21,298][INFO ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][TestTcpDiscoverySpi] Successfully bound to TCP port [port=47500, localHost=localhost/127.0.0.1, locNodeId=00622f8d-e1fe-42dd-95f9-54f5fc364000] [21:05:21] : [Step 4/5] [2021-11-19 21:05:21,300][INFO ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][GridEncryptionManager] Sending new group keys to coordinator [grps=1613773252] [21:05:21] : [Step 4/5] [2021-11-19 21:05:21,309][INFO ][disco-notifier-worker-#10623%grid-0%][MvccProcessorImpl] Assigned mvcc coordinator [crd=MvccCoordinator [topVer=AffinityTopologyVersion [topVer=1, minorTopVer=0], nodeId=00622f8d-e1fe-42dd-95f9-54f5fc364000, ver=1637345121302, local=true, initialized=false]] [21:05:21] : [Step 4/5] [2021-11-19 21:05:21,310][INFO ][disco-notifier-worker-#10623%grid-0%][GridEncryptionManager] Added encryption key on local join [grpId=1613773252] [21:05:21] : [Step 4/5] [2021-11-19 21:05:21,312][INFO ][sys-#10612%grid-0%][ClusterProcessor] Writing cluster ID and tag to metastorage on ready for write ClusterIdAndTag [id=4d51a675-d292-405e-874a-2005d519e647, tag=nervous_murdock] [21:05:21] : [Step 4/5] [2021-11-19 21:05:21,314][INFO ][disco-notifier-worker-#10623%grid-0%][ClusterProcessor] nervous_murdock [21:05:21] : [Step 4/5] [2021-11-19 21:05:21,315][INFO ][disco-notifier-worker-#10623%grid-0%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustEnabled' was changed from 'null' to 'false' [21:05:21] : [Step 4/5] [2021-11-19 21:05:21,315][INFO ][disco-notifier-worker-#10623%grid-0%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustTimeout' was changed from 'null' to '300000' [21:05:21] : [Step 4/5] [2021-11-19 21:05:21,316][INFO ][disco-notifier-worker-#10623%grid-0%][IgniteTxManager] Transactions parameter 'longOperationsDumpTimeout' was changed from 'null' to '60000' [21:05:21] : [Step 4/5] [2021-11-19 21:05:21,316][INFO ][disco-notifier-worker-#10623%grid-0%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpThreshold' was changed from 'null' to '0' [21:05:21] : [Step 4/5] [2021-11-19 21:05:21,317][INFO ][disco-notifier-worker-#10623%grid-0%][IgniteTxManager] Transactions parameter 'transactionTimeDumpSamplesCoefficient' was changed from 'null' to '0.0' [21:05:21] : [Step 4/5] [2021-11-19 21:05:21,317][INFO ][disco-notifier-worker-#10623%grid-0%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpSamplesPerSecondLimit' was changed from 'null' to '5' [21:05:21] : [Step 4/5] [2021-11-19 21:05:21,318][INFO ][disco-notifier-worker-#10623%grid-0%][IgniteTxManager] Transactions parameter 'collisionsDumpInterval' was changed from 'null' to '1000' [21:05:21] : [Step 4/5] [2021-11-19 21:05:21,318][INFO ][disco-notifier-worker-#10623%grid-0%][IgniteTxManager] Transactions parameter 'txOwnerDumpRequestsAllowed' was changed from 'null' to 'true' [21:05:21] : [Step 4/5] [2021-11-19 21:05:21,319][INFO ][disco-notifier-worker-#10623%grid-0%][GridCacheDatabaseSharedManager] Historical rebalance WAL threshold changed [property=historical.rebalance.threshold, oldVal=null, newVal=500] [21:05:21] : [Step 4/5] [2021-11-19 21:05:21,322][INFO ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] To start Console Management & Monitoring run ignitevisorcmd.{sh|bat} [21:05:21] : [Step 4/5] [2021-11-19 21:05:21,323][INFO ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] [21:05:21] : [Step 4/5] [21:05:21] : [Step 4/5] >>> +-------------------------------------------+ [21:05:21] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:05:21] : [Step 4/5] >>> +-------------------------------------------+ [21:05:21] : [Step 4/5] >>> OS name: Linux 4.15.0-151-generic amd64 [21:05:21] : [Step 4/5] >>> CPU(s): 24 [21:05:21] : [Step 4/5] >>> Heap: 2.0GB [21:05:21] : [Step 4/5] >>> VM name: 16724@c4dfe9a430b2 [21:05:21] : [Step 4/5] >>> Ignite instance name: grid-0 [21:05:21] : [Step 4/5] >>> Local node [ID=00622F8D-E1FE-42DD-95F9-54F5FC364000, order=1, clientMode=false] [21:05:21] : [Step 4/5] >>> Local node addresses: [127.0.0.1] [21:05:21] : [Step 4/5] >>> Local ports: TCP:10800 TCP:45150 TCP:47500 [21:05:21] : [Step 4/5] [21:05:21] : [Step 4/5] [2021-11-19 21:05:21,323][INFO ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] >>> Ignite cluster is in INACTIVE state (limited functionality available). Use control.(sh|bat) script or IgniteCluster.state(ClusterState.ACTIVE) to change the state. [21:05:21] : [Step 4/5] [2021-11-19 21:05:21,324][INFO ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][GridDiscoveryManager] Topology snapshot [ver=1, locNode=00622f8d, servers=1, clients=0, state=INACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=00622f8d-e1fe-42dd-95f9-54f5fc364000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:05:21] : [Step 4/5] [2021-11-19 21:05:21,325][INFO ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][G] Node started : [stage="Configure system pool" (0 ms),stage="Start managers" (270 ms),stage="Configure binary metadata" (2 ms),stage="Start processors" (497 ms),stage="Start 'StanByClusterTestProvider' plugin" (0 ms),stage="Start 'PageMemory tracker plugin' plugin" (0 ms),stage="Start 'TestDistibutedConfigurationPlugin' plugin" (0 ms),stage="Start 'NodeValidationPluginProvider' plugin" (0 ms),stage="Init metastore" (32 ms),stage="Init and start regions" (9 ms),stage="Restore binary memory" (72 ms),stage="Restore logical state" (74 ms),stage="Finish recovery" (348 ms),stage="Join topology" (12 ms),stage="Await transition" (3 ms),stage="Await exchange" (12 ms),stage="Total time" (1331 ms)] [21:05:21] : [Step 4/5] [2021-11-19 21:05:21,326][INFO ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][root] Node started with the following configuration [id=00622f8d-e1fe-42dd-95f9-54f5fc364000, marshaller=BinaryMarshaller [], discovery=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=5000, ackTimeout=5000, marsh=JdkMarshaller [clsFilter=org.apache.ignite.marshaller.MarshallerUtils$1@7f4015a], reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], binaryCfg=null, lateAff=true] [21:05:21]W: [org.apache.ignite:ignite-core] [2021-11-19 21:05:21,331][WARN ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][G] Ignite work directory is not provided, automatically resolved to: /opt/buildagent/work/7bc1c54bc719b67c/work [21:05:21] : [Step 4/5] [2021-11-19 21:05:21,332][INFO ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-6] [21:05:21] : [Step 4/5] [21:05:21] : [Step 4/5] >>> __________ ________________ [21:05:21] : [Step 4/5] >>> / _/ ___/ |/ / _/_ __/ __/ [21:05:21] : [Step 4/5] >>> _/ // (7 7 // / / / / _/ [21:05:21] : [Step 4/5] >>> /___/\___/_/|_/___/ /_/ /___/ [21:05:21] : [Step 4/5] >>> [21:05:21] : [Step 4/5] >>> ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:05:21] : [Step 4/5] >>> 2021 Copyright(C) Apache Software Foundation [21:05:21] : [Step 4/5] >>> [21:05:21] : [Step 4/5] >>> Ignite documentation: http://ignite.apache.org [21:05:21] : [Step 4/5] [21:05:21] : [Step 4/5] [2021-11-19 21:05:21,333][INFO ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-6] Config URL: n/a [21:05:21] : [Step 4/5] [2021-11-19 21:05:21,333][INFO ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-6] IgniteConfiguration [igniteInstanceName=grid-6, pubPoolSize=24, svcPoolSize=24, callbackPoolSize=24, stripedPoolSize=24, sysPoolSize=24, mgmtPoolSize=4, dataStreamerPoolSize=24, utilityCachePoolSize=24, utilityCacheKeepAliveTime=60000, p2pPoolSize=2, qryPoolSize=24, buildIdxPoolSize=4, igniteHome=/opt/buildagent/work/7bc1c54bc719b67c, igniteWorkDir=/opt/buildagent/work/7bc1c54bc719b67c/work, mbeanSrv=com.sun.jmx.mbeanserver.JmxMBeanServer@6fe85038, nodeId=60cf419a-9798-4b04-bea7-d09e78da3006, marsh=BinaryMarshaller [], marshLocJobs=false, daemon=false, p2pEnabled=true, netTimeout=10000, netCompressionLevel=1, sndRetryDelay=1000, sndRetryCnt=3, metricsHistSize=10000, metricsUpdateFreq=1000, metricsExpTime=9223372036854775807, discoSpi=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=0, ackTimeout=0, marsh=null, reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], segPlc=STOP, segResolveAttempts=2, waitForSegOnStart=true, allResolversPassReq=true, segChkFreq=10000, commSpi=TcpCommunicationSpi [connectGate=org.apache.ignite.spi.communication.tcp.internal.ConnectGateway@4a2100ea, ctxInitLatch=java.util.concurrent.CountDownLatch@147c4704[Count = 1], stopping=false, clientPool=null, nioSrvWrapper=null, stateProvider=null], evtSpi=MemoryEventStorageSpi [expireAgeMs=9223372036854775807, expireCnt=10000, filter=null], colSpi=NoopCollisionSpi [], deploySpi=LocalDeploymentSpi [], indexingSpi=org.apache.ignite.spi.indexing.noop.NoopIndexingSpi@1fe7c214, addrRslvr=null, encryptionSpi=org.apache.ignite.spi.encryption.keystore.KeystoreEncryptionSpi@22819cfb, tracingSpi=org.apache.ignite.spi.tracing.NoopTracingSpi@56bd2bd, clientMode=false, rebalanceThreadPoolSize=4, rebalanceTimeout=10000, rebalanceBatchesPrefetchCnt=3, rebalanceThrottle=0, rebalanceBatchSize=524288, txCfg=TransactionConfiguration [txSerEnabled=false, dfltIsolation=REPEATABLE_READ, dfltConcurrency=PESSIMISTIC, dfltTxTimeout=0, txTimeoutOnPartitionMapExchange=0, deadlockTimeout=10000, pessimisticTxLogSize=0, pessimisticTxLogLinger=10000, tmLookupClsName=null, txManagerFactory=null, useJtaSync=false], cacheSanityCheckEnabled=true, discoStartupDelay=60000, deployMode=SHARED, p2pMissedCacheSize=100, locHost=127.0.0.1, timeSrvPortBase=31100, timeSrvPortRange=100, failureDetectionTimeout=10000, sysWorkerBlockedTimeout=null, clientFailureDetectionTimeout=10000, metricsLogFreq=0, connectorCfg=null, odbcCfg=null, warmupClos=null, atomicCfg=AtomicConfiguration [seqReserveSize=1000, cacheMode=PARTITIONED, backups=1, aff=null, grpName=null], classLdr=null, sslCtxFactory=null, platformCfg=null, binaryCfg=null, memCfg=null, pstCfg=null, dsCfg=DataStorageConfiguration [sysRegionInitSize=41943040, sysRegionMaxSize=104857600, pageSize=4096, concLvl=0, dfltDataRegConf=DataRegionConfiguration [name=default, maxSize=10485760, initSize=268435456, swapPath=null, pageEvictionMode=DISABLED, pageReplacementMode=CLOCK, evictionThreshold=0.9, emptyPagesPoolSize=100, metricsEnabled=false, metricsSubIntervalCount=5, metricsRateTimeInterval=60000, persistenceEnabled=true, checkpointPageBufSize=0, lazyMemoryAllocation=true, warmUpCfg=null], dataRegions=null, storagePath=null, checkpointFreq=180000, lockWaitTime=10000, checkpointThreads=4, checkpointWriteOrder=SEQUENTIAL, walHistSize=20, maxWalArchiveSize=1073741824, walSegments=10, walSegmentSize=67108864, walPath=db/wal, walArchivePath=db/wal/archive, cdcWalPath=db/wal/cdc, cdcEnabled=false, metricsEnabled=false, walMode=FSYNC, walTlbSize=131072, walBuffSize=0, walFlushFreq=2000, walFsyncDelay=1000, walRecordIterBuffSize=67108864, alwaysWriteFullPages=false, fileIOFactory=org.apache.ignite.internal.processors.cache.persistence.file.AsyncFileIOFactory@68f19574, metricsSubIntervalCnt=5, metricsRateTimeInterval=60000, walAutoArchiveAfterInactivity=-1, walForceArchiveTimeout=-1, writeThrottlingEnabled=false, walCompactionEnabled=false, walCompactionLevel=1, checkpointReadLockTimeout=null, walPageCompression=DISABLED, walPageCompressionLevel=null, dfltWarmUpCfg=null, encCfg=org.apache.ignite.configuration.EncryptionConfiguration@77323320, defragmentationThreadPoolSize=4, minWalArchiveSize=-1], snapshotPath=snapshots, activeOnStart=true, activeOnStartPropSetFlag=false, autoActivation=true, autoActivationPropSetFlag=false, clusterStateOnStart=null, sqlConnCfg=null, cliConnCfg=ClientConnectorConfiguration [host=null, port=10800, portRange=100, sockSndBufSize=0, sockRcvBufSize=0, tcpNoDelay=true, maxOpenCursorsPerConn=128, threadPoolSize=24, selectorCnt=12, idleTimeout=0, handshakeTimeout=10000, jdbcEnabled=true, odbcEnabled=true, thinCliEnabled=true, sslEnabled=false, useIgniteSslCtxFactory=true, sslClientAuth=false, sslCtxFactory=null, thinCliCfg=ThinClientConfiguration [maxActiveTxPerConn=100, maxActiveComputeTasksPerConn=0]], mvccVacuumThreadCnt=2, mvccVacuumFreq=5000, authEnabled=false, failureHnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]], commFailureRslvr=null, sqlCfg=SqlConfiguration [longQryWarnTimeout=3000, dfltQryTimeout=0, sqlQryHistSize=1000, validationEnabled=false], asyncContinuationExecutor=null] [21:05:21] : [Step 4/5] [2021-11-19 21:05:21,340][INFO ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-6] Daemon mode: off [21:05:21] : [Step 4/5] [2021-11-19 21:05:21,340][INFO ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-6] OS: Linux 4.15.0-151-generic amd64 [21:05:21] : [Step 4/5] [2021-11-19 21:05:21,340][INFO ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-6] OS user: teamcity [21:05:21] : [Step 4/5] [2021-11-19 21:05:21,341][INFO ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-6] PID: 16724 [21:05:21] : [Step 4/5] [2021-11-19 21:05:21,341][INFO ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-6] Language runtime: Java Platform API Specification ver. 1.8 [21:05:21] : [Step 4/5] [2021-11-19 21:05:21,341][INFO ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-6] VM information: Java(TM) SE Runtime Environment 1.8.0_261-b12 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 25.261-b12 [21:05:21] : [Step 4/5] [2021-11-19 21:05:21,342][INFO ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-6] VM total memory: 1.9GB [21:05:21] : [Step 4/5] [2021-11-19 21:05:21,342][INFO ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-6] Remote Management [restart: off, REST: off, JMX (remote: off)] [21:05:21] : [Step 4/5] [2021-11-19 21:05:21,342][INFO ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-6] Logger: GridTestLog4jLogger [quiet=false, config=null] [21:05:21] : [Step 4/5] [2021-11-19 21:05:21,343][INFO ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-6] IGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c [21:05:21]W: [org.apache.ignite:ignite-core] [2021-11-19 21:05:21,349][WARN ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-6] Peer class loading is enabled (disable it in production for performance and deployment consistency reasons) [21:05:21] : [Step 4/5] [2021-11-19 21:05:21,343][INFO ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-6] VM arguments: [-DIGNITE_DUMP_THREADS_ON_FAILURE=false, -DMono=/usr/bin/mono-sgen, -DMono4.0_x64=/usr/lib/mono/4.0, -DMono4.5_x64=/usr/lib/mono/4.5, -DMonoVersion=6.12.0.90, -DSKIP_BUILD=false, -Dagent.home.dir=/opt/buildagent, -Dagent.name=aitc-lin02_03, -Dagent.ownPort=9090, -Dagent.work.dir=/opt/buildagent/work, -Dbuild.number=95, -Dbuild.vcs.number=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.1=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.GitHubApacheIgnite=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dclassworlds.conf=/opt/buildagent/temp/buildTmp/teamcity.m2.conf, -Dcom.jetbrains.maven.watcher.report.file=/opt/buildagent/temp/buildTmp/maven-build-info.xml, -Djava.io.tmpdir=/opt/buildagent/temp/buildTmp, -Dmaven.home=/opt/buildagent/tools/maven3_6, -Dmaven.multiModuleProjectDirectory=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.agent.cpuBenchmark=457, -Dteamcity.agent.dotnet.agent_url=http://localhost:9090/RPC2, -Dteamcity.agent.dotnet.build_id=6278078, -Dteamcity.auth.password=*******, -Dteamcity.auth.userId=TeamCityBuildId=6278078, -Dteamcity.build.changedFiles.file=/opt/buildagent/temp/buildTmp/changedFiles6342607772318147725.txt, -Dteamcity.build.checkoutDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.build.id=6278078, -Dteamcity.build.properties.file=/opt/buildagent/temp/buildTmp/teamcity.build5164517880467851002.properties, -Dteamcity.build.tempDir=/opt/buildagent/temp/buildTmp, -Dteamcity.build.workingDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.buildConfName=Basic 3, -Dteamcity.buildType.id=IgniteTests24Java8_Basic3, -Dteamcity.configuration.properties.file=/opt/buildagent/temp/buildTmp/teamcity.config5591980786735343870.properties, -Dteamcity.maven.userSettings.path=/opt/buildagent/temp/buildTmp/maven_settings_585072866407032347.xml, -Dteamcity.maven.watcher.home=/opt/buildagent/plugins/mavenPlugin/maven-watcher-jdk16, -Dteamcity.projectName=Ignite Tests 2.x (JDK 8/11), -Dteamcity.runner.properties.file=/opt/buildagent/temp/buildTmp/teamcity.runner9098465561618137420.properties, -Dteamcity.tests.recentlyFailedTests.file=/opt/buildagent/temp/buildTmp/testsToRunFirst3891775683130404069.txt, -Dteamcity.version=2021.2 (build 99542), -ea, -Xms2g, -Xmx2g, -XX:+HeapDumpOnOutOfMemoryError, -DIGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_TEST_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_UPDATE_NOTIFIER=false, -DIGNITE_NO_DISCO_ORDER=true, -DIGNITE_PERFORMANCE_SUGGESTIONS_DISABLED=true, -Djava.net.preferIPv4Stack=true, -DTEST_SCALE_FACTOR=1.0, -DIGNITE_TEST_PROP_LOG4J_FILE=log4j-tc-test.xml, -DIGNITE_QUIET=false, -DIGNITE_MARSHAL_BUFFERS_RECHECK=1000, -Dmaven.repo.local=/opt/buildagent/.m2/repository] [21:05:21] : [Step 4/5] [2021-11-19 21:05:21,348][INFO ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-6] System cache's DataRegion size is configured to 40 MB. Use DataStorageConfiguration.systemRegionInitialSize property to change the setting. [21:05:21] : [Step 4/5] [2021-11-19 21:05:21,348][INFO ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-6] Configured caches [in 'sysMemPlc' dataRegion: ['ignite-sys-cache'], in 'default' dataRegion: ['encrypted']] [21:05:21] : [Step 4/5] [2021-11-19 21:05:21,349][INFO ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-6] 3-rd party licenses can be found at: /opt/buildagent/work/7bc1c54bc719b67c/libs/licenses [21:05:21] : [Step 4/5] [2021-11-19 21:05:21,354][INFO ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] Configured plugins: [21:05:21] : [Step 4/5] [2021-11-19 21:05:21,354][INFO ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- StanByClusterTestProvider 1.0 [21:05:21] : [Step 4/5] [2021-11-19 21:05:21,354][INFO ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- null [21:05:21] : [Step 4/5] [2021-11-19 21:05:21,355][INFO ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] [21:05:21] : [Step 4/5] [2021-11-19 21:05:21,355][INFO ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- PageMemory tracker plugin 1.0 [21:05:21] : [Step 4/5] [2021-11-19 21:05:21,355][INFO ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- null [21:05:21] : [Step 4/5] [2021-11-19 21:05:21,355][INFO ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] [21:05:21] : [Step 4/5] [2021-11-19 21:05:21,356][INFO ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- TestDistibutedConfigurationPlugin 1.0 [21:05:21] : [Step 4/5] [2021-11-19 21:05:21,356][INFO ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- null [21:05:21] : [Step 4/5] [2021-11-19 21:05:21,356][INFO ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] [21:05:21] : [Step 4/5] [2021-11-19 21:05:21,356][INFO ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- NodeValidationPluginProvider 1.0 [21:05:21] : [Step 4/5] [2021-11-19 21:05:21,357][INFO ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- null [21:05:21] : [Step 4/5] [2021-11-19 21:05:21,357][INFO ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] [21:05:21] : [Step 4/5] [2021-11-19 21:05:21,357][INFO ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][FailureProcessor] Configured failure handler: [hnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]]] [21:05:21]W: [org.apache.ignite:ignite-core] [2021-11-19 21:05:21,414][WARN ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][TcpCommunicationSpi] Message queue limit is set to 0 which may lead to potential OOMEs when running cache operations in FULL_ASYNC or PRIMARY_SYNC modes due to message queues growth on sender and receiver sides. [21:05:21] : [Step 4/5] [2021-11-19 21:05:21,413][INFO ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][TcpCommunicationSpi] Successfully bound communication NIO server to TCP port [port=45151, locHost=/127.0.0.1, selectorsCnt=12, selectorSpins=0, pairedConn=false] [21:05:21] : [Step 4/5] [2021-11-19 21:05:21,420][INFO ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][GridCollisionManager] Collision resolution is disabled (all jobs will be activated upon arrival). [21:05:21] : [Step 4/5] [2021-11-19 21:05:21,420][INFO ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-6] Security status [authentication=off, sandbox=off, tls/ssl=off] [21:05:21] : [Step 4/5] [2021-11-19 21:05:21,474][INFO ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:05:21] : [Step 4/5] [2021-11-19 21:05:21,556][INFO ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][MaintenanceProcessor] Resolved store directory for node persistent data: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_6 [21:05:21] : [Step 4/5] [2021-11-19 21:05:21,557][INFO ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][CacheObjectBinaryProcessorImpl] Resolved directory for serialized binary metadata: /opt/buildagent/work/7bc1c54bc719b67c/work/db/binary_meta/grid_6 [21:05:21] : [Step 4/5] [2021-11-19 21:05:21,561][INFO ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_6 [21:05:21] : [Step 4/5] [2021-11-19 21:05:21,561][INFO ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][FileWriteAheadLogManager] Resolved write ahead log work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_6 [21:05:21] : [Step 4/5] [2021-11-19 21:05:21,562][INFO ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][FileWriteAheadLogManager] Resolved write ahead log archive directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_6 [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,000][INFO ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_6/0000000000000000.wal [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,007][INFO ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Configured data regions initialized successfully [total=5] [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,017][INFO ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][IgniteSnapshotManager] Resolved snapshot work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/snapshots [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,017][INFO ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][IgniteSnapshotManager] Resolved temp directory for snapshot creation: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_6/snp [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,021][INFO ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][ClientListenerProcessor] Client connector processor has started on TCP port 10801 [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,024][INFO ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-6] Non-loopback local IPs: 172.17.0.4 [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,024][INFO ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-6] Enabled local MACs: 0242AC110004 [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,025][INFO ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,026][INFO ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,026][INFO ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,029][INFO ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Applying lost metastore updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,030][INFO ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=0 ms] [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,030][INFO ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][GridCacheProcessor] Restoring partition state for local groups. [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,030][INFO ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=0, partitionsProcessed=0, time=0ms] [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,031][INFO ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][GridEncryptionManager] Encryption keys loaded from metastore. [grps=, masterKeyName=ignite.master.key] [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,033][INFO ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][ClusterProcessor] Cluster ID and tag has been read from metastorage: null [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,033][INFO ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][IgniteClusterImpl] Shutdown policy was updated [oldVal=null, newVal=null] [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,034][INFO ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Checkpoint frequency deviation changed [oldVal=null, newVal=null] [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,051][INFO ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][FilePageStoreManager] Cleanup cache stores [total=1, left=0, cleanFiles=false] [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,054][INFO ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,055][INFO ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,056][INFO ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,057][INFO ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Data Regions Started: 5 [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,057][INFO ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] ^-- sysMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:05:22] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:05:22] : [Step 4/5] ^-- default region [type=default, persistence=true, lazyAlloc=true, [21:05:22] : [Step 4/5] ... initCfg=10MB, maxCfg=10MB, usedRam=0MB, freeRam=100%, allocRam=0MB, allocTotal=0MB] [21:05:22] : [Step 4/5] ^-- metastoreMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:05:22] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:05:22] : [Step 4/5] ^-- TxLog region [type=internal, persistence=true, lazyAlloc=false, [21:05:22] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:05:22] : [Step 4/5] ^-- volatileDsMemPlc region [type=user, persistence=false, lazyAlloc=true, [21:05:22] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB] [21:05:22] : [Step 4/5] ^-- Ignite persistence [used=0MB] [21:05:22] : [Step 4/5] [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,058][INFO ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Starting binary memory restore for: [-2100569601, 1613773252] [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,124][INFO ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,125][INFO ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,126][INFO ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_6/0000000000000000.wal, offset=0, ver=2] [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,137][INFO ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][GridCacheProcessor] Started cache in recovery mode [name=ignite-sys-cache, id=-2100569601, dataRegionName=sysMemPlc, mode=REPLICATED, atomicity=TRANSACTIONAL, backups=2147483647, mvcc=false] [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,138][INFO ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][PageMemoryImpl] Started page memory [memoryAllocated=24.0 MiB, pages=5952, tableSize=474.2 KiB, replacementSize=768 B, checkpointBuffer=10.0 MiB] [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,142][INFO ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][GridCacheProcessor] Started cache in recovery mode [name=encrypted, id=1613773252, dataRegionName=default, mode=PARTITIONED, atomicity=TRANSACTIONAL, backups=0, mvcc=false] [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,143][INFO ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Binary recovery performed in 85 ms. [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,143][INFO ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,143][INFO ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Applying lost cache updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,206][INFO ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=60 ms] [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,206][INFO ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][GridCacheProcessor] Restoring partition state for local groups. [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,218][INFO ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=2, partitionsProcessed=1124, time=10ms] [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,565][INFO ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][TestTcpDiscoverySpi] Successfully bound to TCP port [port=47501, localHost=localhost/127.0.0.1, locNodeId=60cf419a-9798-4b04-bea7-d09e78da3006] [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,568][INFO ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][GridEncryptionManager] Sending new group keys to coordinator [grps=1613773252] [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,570][INFO ][tcp-disco-srvr-[:47500]-#553%grid-0%-#10625%grid-0%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=36261] [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,570][INFO ][tcp-disco-srvr-[:47500]-#553%grid-0%-#10625%grid-0%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=36261] [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,571][INFO ][tcp-disco-sock-reader-[]-#559%grid-0%-#10745%grid-0%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:36261, rmtPort=36261] [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,572][INFO ][tcp-disco-sock-reader-[60cf419a 127.0.0.1:36261]-#559%grid-0%-#10745%grid-0%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=60cf419a-9798-4b04-bea7-d09e78da3006, rmtAddr=/127.0.0.1:36261] [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,578][INFO ][tcp-disco-srvr-[:47501]-#558%grid-6%-#10744%grid-6%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=34309] [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,578][INFO ][tcp-disco-srvr-[:47501]-#558%grid-6%-#10744%grid-6%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=34309] [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,578][INFO ][tcp-disco-sock-reader-[]-#560%grid-6%-#10746%grid-6%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:34309, rmtPort=34309] [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,579][INFO ][tcp-disco-sock-reader-[]-#560%grid-6%-#10746%grid-6%][TestTcpDiscoverySpi] Received ping request from the remote node [rmtNodeId=00622f8d-e1fe-42dd-95f9-54f5fc364000, rmtAddr=/127.0.0.1:34309, rmtPort=34309] [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,580][INFO ][tcp-disco-sock-reader-[]-#560%grid-6%-#10746%grid-6%][TestTcpDiscoverySpi] Finished writing ping response [rmtNodeId=00622f8d-e1fe-42dd-95f9-54f5fc364000, rmtAddr=/127.0.0.1:34309, rmtPort=34309] [21:05:22]W: [org.apache.ignite:ignite-core] [2021-11-19 21:05:22,580][WARN ][tcp-disco-sock-reader-[]-#560%grid-6%-#10746%grid-6%][TestTcpDiscoverySpi] Failed to shutdown socket [21:05:22]W: [org.apache.ignite:ignite-core] java.net.SocketException: Socket output is already shutdown [21:05:22]W: [org.apache.ignite:ignite-core] at java.net.Socket.shutdownOutput(Socket.java:1572) [21:05:22]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.close(IgniteUtils.java:4247) [21:05:22]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.discovery.tcp.ServerImpl$SocketReader.body(ServerImpl.java:7370) [21:05:22]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.IgniteSpiThread.run(IgniteSpiThread.java:58) [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,580][INFO ][tcp-disco-sock-reader-[60cf419a 127.0.0.1:36261]-#559%grid-0%-#10745%grid-0%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:36261, rmtPort=36261, rmtNodeId=60cf419a-9798-4b04-bea7-d09e78da3006] [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,581][INFO ][tcp-disco-sock-reader-[]-#560%grid-6%-#10746%grid-6%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:34309, rmtPort=34309, rmtNodeId=null] [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,583][INFO ][tcp-disco-msg-worker-[crd]-#552%grid-0%-#10624%grid-0%][GridEncryptionManager] Joining node doesn't have stored group keys [node=60cf419a-9798-4b04-bea7-d09e78da3006] [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,585][INFO ][tcp-disco-msg-worker-[crd]-#552%grid-0%-#10624%grid-0%][GridEncryptionManager] Skip group key received from joining node. Already exists. [node=60cf419a-9798-4b04-bea7-d09e78da3006, grp=1613773252] [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,593][INFO ][tcp-disco-msg-worker-[crd]-#552%grid-0%-#10624%grid-0%][TestTcpDiscoverySpi] New next node [newNext=TcpDiscoveryNode [id=60cf419a-9798-4b04-bea7-d09e78da3006, consistentId=grid-6, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=0, intOrder=2, lastExchangeTime=1637345122572, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false]] [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,594][INFO ][tcp-disco-srvr-[:47501]-#558%grid-6%-#10744%grid-6%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=40111] [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,594][INFO ][tcp-disco-srvr-[:47501]-#558%grid-6%-#10744%grid-6%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=40111] [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,594][INFO ][tcp-disco-sock-reader-[]-#561%grid-6%-#10747%grid-6%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:40111, rmtPort=40111] [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,595][INFO ][tcp-disco-sock-reader-[00622f8d 127.0.0.1:40111]-#561%grid-6%-#10747%grid-6%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=00622f8d-e1fe-42dd-95f9-54f5fc364000, rmtAddr=/127.0.0.1:40111] [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,598][INFO ][tcp-disco-msg-worker-[]-#557%grid-6%-#10743%grid-6%][TestTcpDiscoverySpi] New next node [newNext=TcpDiscoveryNode [id=00622f8d-e1fe-42dd-95f9-54f5fc364000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345122592, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false]] [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,599][INFO ][tcp-disco-srvr-[:47500]-#553%grid-0%-#10625%grid-0%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=34631] [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,600][INFO ][tcp-disco-srvr-[:47500]-#553%grid-0%-#10625%grid-0%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=34631] [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,600][INFO ][tcp-disco-sock-reader-[]-#562%grid-0%-#10748%grid-0%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:34631, rmtPort=34631] [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,601][INFO ][tcp-disco-sock-reader-[60cf419a 127.0.0.1:34631]-#562%grid-0%-#10748%grid-0%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=60cf419a-9798-4b04-bea7-d09e78da3006, rmtAddr=/127.0.0.1:34631] [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,603][INFO ][disco-event-worker-#10627%grid-0%][GridDiscoveryManager] Added new node to topology: TcpDiscoveryNode [id=60cf419a-9798-4b04-bea7-d09e78da3006, consistentId=grid-6, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637345122572, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false] [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,605][INFO ][disco-event-worker-#10627%grid-0%][GridDiscoveryManager] Topology snapshot [ver=2, locNode=00622f8d, servers=2, clients=0, state=INACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=00622f8d-e1fe-42dd-95f9-54f5fc364000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=60cf419a-9798-4b04-bea7-d09e78da3006, consistentId=grid-6, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,608][INFO ][tcp-disco-msg-worker-[00622f8d 127.0.0.1:47500]-#557%grid-6%-#10743%grid-6%][GridEncryptionManager] Store group key received from coordinator [grp=1613773252, keyId=0] [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,609][INFO ][tcp-disco-msg-worker-[00622f8d 127.0.0.1:47500]-#557%grid-6%-#10743%grid-6%][ClusterProcessor] nervous_murdock [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,609][INFO ][tcp-disco-msg-worker-[00622f8d 127.0.0.1:47500]-#557%grid-6%-#10743%grid-6%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustEnabled' was changed from 'null' to 'false' [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,610][INFO ][tcp-disco-msg-worker-[00622f8d 127.0.0.1:47500]-#557%grid-6%-#10743%grid-6%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustTimeout' was changed from 'null' to '300000' [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,610][INFO ][tcp-disco-msg-worker-[00622f8d 127.0.0.1:47500]-#557%grid-6%-#10743%grid-6%][IgniteTxManager] Transactions parameter 'longOperationsDumpTimeout' was changed from 'null' to '60000' [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,611][INFO ][tcp-disco-msg-worker-[00622f8d 127.0.0.1:47500]-#557%grid-6%-#10743%grid-6%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpThreshold' was changed from 'null' to '0' [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,611][INFO ][tcp-disco-msg-worker-[00622f8d 127.0.0.1:47500]-#557%grid-6%-#10743%grid-6%][IgniteTxManager] Transactions parameter 'transactionTimeDumpSamplesCoefficient' was changed from 'null' to '0.0' [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,612][INFO ][tcp-disco-msg-worker-[00622f8d 127.0.0.1:47500]-#557%grid-6%-#10743%grid-6%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpSamplesPerSecondLimit' was changed from 'null' to '5' [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,612][INFO ][tcp-disco-msg-worker-[00622f8d 127.0.0.1:47500]-#557%grid-6%-#10743%grid-6%][IgniteTxManager] Transactions parameter 'collisionsDumpInterval' was changed from 'null' to '1000' [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,613][INFO ][tcp-disco-msg-worker-[00622f8d 127.0.0.1:47500]-#557%grid-6%-#10743%grid-6%][IgniteTxManager] Transactions parameter 'txOwnerDumpRequestsAllowed' was changed from 'null' to 'true' [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,613][INFO ][tcp-disco-msg-worker-[00622f8d 127.0.0.1:47500]-#557%grid-6%-#10743%grid-6%][GridCacheDatabaseSharedManager] Historical rebalance WAL threshold changed [property=historical.rebalance.threshold, oldVal=null, newVal=500] [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,614][INFO ][disco-notifier-worker-#10742%grid-6%][MvccProcessorImpl] Assigned mvcc coordinator [crd=MvccCoordinator [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=0], nodeId=00622f8d-e1fe-42dd-95f9-54f5fc364000, ver=1637345121302, local=false, initialized=false]] [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,616][INFO ][sys-#10740%grid-6%][ClusterProcessor] Writing cluster ID and tag to metastorage on ready for write ClusterIdAndTag [id=4d51a675-d292-405e-874a-2005d519e647, tag=nervous_murdock] [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,640][INFO ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-6] To start Console Management & Monitoring run ignitevisorcmd.{sh|bat} [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,640][INFO ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-6] [21:05:22] : [Step 4/5] [21:05:22] : [Step 4/5] >>> +-------------------------------------------+ [21:05:22] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:05:22] : [Step 4/5] >>> +-------------------------------------------+ [21:05:22] : [Step 4/5] >>> OS name: Linux 4.15.0-151-generic amd64 [21:05:22] : [Step 4/5] >>> CPU(s): 24 [21:05:22] : [Step 4/5] >>> Heap: 2.0GB [21:05:22] : [Step 4/5] >>> VM name: 16724@c4dfe9a430b2 [21:05:22] : [Step 4/5] >>> Ignite instance name: grid-6 [21:05:22] : [Step 4/5] >>> Local node [ID=60CF419A-9798-4B04-BEA7-D09E78DA3006, order=2, clientMode=false] [21:05:22] : [Step 4/5] >>> Local node addresses: [127.0.0.1] [21:05:22] : [Step 4/5] >>> Local ports: TCP:10801 TCP:45151 TCP:47501 [21:05:22] : [Step 4/5] [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,641][INFO ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-6] >>> Ignite cluster is in INACTIVE state (limited functionality available). Use control.(sh|bat) script or IgniteCluster.state(ClusterState.ACTIVE) to change the state. [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,642][INFO ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][GridDiscoveryManager] Topology snapshot [ver=2, locNode=60cf419a, servers=2, clients=0, state=INACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=00622f8d-e1fe-42dd-95f9-54f5fc364000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=60cf419a-9798-4b04-bea7-d09e78da3006, consistentId=grid-6, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,643][INFO ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][G] Node started : [stage="Configure system pool" (0 ms),stage="Start managers" (225 ms),stage="Configure binary metadata" (2 ms),stage="Start processors" (464 ms),stage="Start 'StanByClusterTestProvider' plugin" (0 ms),stage="Start 'PageMemory tracker plugin' plugin" (0 ms),stage="Start 'TestDistibutedConfigurationPlugin' plugin" (0 ms),stage="Start 'NodeValidationPluginProvider' plugin" (0 ms),stage="Init metastore" (28 ms),stage="Init and start regions" (7 ms),stage="Restore binary memory" (84 ms),stage="Restore logical state" (75 ms),stage="Finish recovery" (345 ms),stage="Join topology" (50 ms),stage="Await transition" (3 ms),stage="Await exchange" (25 ms),stage="Total time" (1308 ms)] [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,645][INFO ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][root] Node started with the following configuration [id=60cf419a-9798-4b04-bea7-d09e78da3006, marshaller=BinaryMarshaller [], discovery=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=5000, ackTimeout=5000, marsh=JdkMarshaller [clsFilter=org.apache.ignite.marshaller.MarshallerUtils$1@750eaf6a], reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], binaryCfg=null, lateAff=true] [21:05:22]W: [org.apache.ignite:ignite-core] [2021-11-19 21:05:22,652][WARN ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][G] Ignite work directory is not provided, automatically resolved to: /opt/buildagent/work/7bc1c54bc719b67c/work [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,653][INFO ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%client1] [21:05:22] : [Step 4/5] [21:05:22] : [Step 4/5] >>> __________ ________________ [21:05:22] : [Step 4/5] >>> / _/ ___/ |/ / _/_ __/ __/ [21:05:22] : [Step 4/5] >>> _/ // (7 7 // / / / / _/ [21:05:22] : [Step 4/5] >>> /___/\___/_/|_/___/ /_/ /___/ [21:05:22] : [Step 4/5] >>> [21:05:22] : [Step 4/5] >>> ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:05:22] : [Step 4/5] >>> 2021 Copyright(C) Apache Software Foundation [21:05:22] : [Step 4/5] >>> [21:05:22] : [Step 4/5] >>> Ignite documentation: http://ignite.apache.org [21:05:22] : [Step 4/5] [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,653][INFO ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%client1] Config URL: n/a [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,654][INFO ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%client1] IgniteConfiguration [igniteInstanceName=client1, pubPoolSize=24, svcPoolSize=24, callbackPoolSize=24, stripedPoolSize=24, sysPoolSize=24, mgmtPoolSize=4, dataStreamerPoolSize=24, utilityCachePoolSize=24, utilityCacheKeepAliveTime=60000, p2pPoolSize=2, qryPoolSize=24, buildIdxPoolSize=4, igniteHome=/opt/buildagent/work/7bc1c54bc719b67c, igniteWorkDir=/opt/buildagent/work/7bc1c54bc719b67c/work, mbeanSrv=com.sun.jmx.mbeanserver.JmxMBeanServer@6fe85038, nodeId=109539ac-d8d7-4dcf-8b8a-e4ff21e9c001, marsh=BinaryMarshaller [], marshLocJobs=false, daemon=false, p2pEnabled=true, netTimeout=10000, netCompressionLevel=1, sndRetryDelay=1000, sndRetryCnt=3, metricsHistSize=10000, metricsUpdateFreq=1000, metricsExpTime=9223372036854775807, discoSpi=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=0, ackTimeout=0, marsh=null, reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], segPlc=STOP, segResolveAttempts=2, waitForSegOnStart=true, allResolversPassReq=true, segChkFreq=10000, commSpi=TcpCommunicationSpi [connectGate=org.apache.ignite.spi.communication.tcp.internal.ConnectGateway@68f1850a, ctxInitLatch=java.util.concurrent.CountDownLatch@6653faf6[Count = 1], stopping=false, clientPool=null, nioSrvWrapper=null, stateProvider=null], evtSpi=MemoryEventStorageSpi [expireAgeMs=9223372036854775807, expireCnt=10000, filter=null], colSpi=NoopCollisionSpi [], deploySpi=LocalDeploymentSpi [], indexingSpi=org.apache.ignite.spi.indexing.noop.NoopIndexingSpi@57d020c9, addrRslvr=null, encryptionSpi=org.apache.ignite.spi.encryption.noop.NoopEncryptionSpi@2bd47063, tracingSpi=org.apache.ignite.spi.tracing.NoopTracingSpi@667812a2, clientMode=true, rebalanceThreadPoolSize=4, rebalanceTimeout=10000, rebalanceBatchesPrefetchCnt=3, rebalanceThrottle=0, rebalanceBatchSize=524288, txCfg=TransactionConfiguration [txSerEnabled=false, dfltIsolation=REPEATABLE_READ, dfltConcurrency=PESSIMISTIC, dfltTxTimeout=0, txTimeoutOnPartitionMapExchange=0, deadlockTimeout=10000, pessimisticTxLogSize=0, pessimisticTxLogLinger=10000, tmLookupClsName=null, txManagerFactory=null, useJtaSync=false], cacheSanityCheckEnabled=true, discoStartupDelay=60000, deployMode=SHARED, p2pMissedCacheSize=100, locHost=127.0.0.1, timeSrvPortBase=31100, timeSrvPortRange=100, failureDetectionTimeout=10000, sysWorkerBlockedTimeout=null, clientFailureDetectionTimeout=10000, metricsLogFreq=0, connectorCfg=null, odbcCfg=null, warmupClos=null, atomicCfg=AtomicConfiguration [seqReserveSize=1000, cacheMode=PARTITIONED, backups=1, aff=null, grpName=null], classLdr=null, sslCtxFactory=null, platformCfg=null, binaryCfg=null, memCfg=null, pstCfg=null, dsCfg=DataStorageConfiguration [sysRegionInitSize=41943040, sysRegionMaxSize=104857600, pageSize=4096, concLvl=0, dfltDataRegConf=DataRegionConfiguration [name=default, maxSize=10485760, initSize=268435456, swapPath=null, pageEvictionMode=DISABLED, pageReplacementMode=CLOCK, evictionThreshold=0.9, emptyPagesPoolSize=100, metricsEnabled=false, metricsSubIntervalCount=5, metricsRateTimeInterval=60000, persistenceEnabled=true, checkpointPageBufSize=0, lazyMemoryAllocation=true, warmUpCfg=null], dataRegions=null, storagePath=null, checkpointFreq=180000, lockWaitTime=10000, checkpointThreads=4, checkpointWriteOrder=SEQUENTIAL, walHistSize=20, maxWalArchiveSize=1073741824, walSegments=10, walSegmentSize=67108864, walPath=db/wal, walArchivePath=db/wal/archive, cdcWalPath=db/wal/cdc, cdcEnabled=false, metricsEnabled=false, walMode=FSYNC, walTlbSize=131072, walBuffSize=0, walFlushFreq=2000, walFsyncDelay=1000, walRecordIterBuffSize=67108864, alwaysWriteFullPages=false, fileIOFactory=org.apache.ignite.internal.processors.cache.persistence.file.AsyncFileIOFactory@41f1d424, metricsSubIntervalCnt=5, metricsRateTimeInterval=60000, walAutoArchiveAfterInactivity=-1, walForceArchiveTimeout=-1, writeThrottlingEnabled=false, walCompactionEnabled=false, walCompactionLevel=1, checkpointReadLockTimeout=null, walPageCompression=DISABLED, walPageCompressionLevel=null, dfltWarmUpCfg=null, encCfg=org.apache.ignite.configuration.EncryptionConfiguration@75eaedda, defragmentationThreadPoolSize=4, minWalArchiveSize=-1], snapshotPath=snapshots, activeOnStart=true, activeOnStartPropSetFlag=false, autoActivation=true, autoActivationPropSetFlag=false, clusterStateOnStart=null, sqlConnCfg=null, cliConnCfg=ClientConnectorConfiguration [host=null, port=10800, portRange=100, sockSndBufSize=0, sockRcvBufSize=0, tcpNoDelay=true, maxOpenCursorsPerConn=128, threadPoolSize=24, selectorCnt=12, idleTimeout=0, handshakeTimeout=10000, jdbcEnabled=true, odbcEnabled=true, thinCliEnabled=true, sslEnabled=false, useIgniteSslCtxFactory=true, sslClientAuth=false, sslCtxFactory=null, thinCliCfg=ThinClientConfiguration [maxActiveTxPerConn=100, maxActiveComputeTasksPerConn=0]], mvccVacuumThreadCnt=2, mvccVacuumFreq=5000, authEnabled=false, failureHnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]], commFailureRslvr=null, sqlCfg=SqlConfiguration [longQryWarnTimeout=3000, dfltQryTimeout=0, sqlQryHistSize=1000, validationEnabled=false], asyncContinuationExecutor=null] [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,664][INFO ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%client1] Daemon mode: off [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,664][INFO ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%client1] OS: Linux 4.15.0-151-generic amd64 [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,665][INFO ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%client1] OS user: teamcity [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,665][INFO ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%client1] PID: 16724 [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,665][INFO ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%client1] Language runtime: Java Platform API Specification ver. 1.8 [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,666][INFO ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%client1] VM information: Java(TM) SE Runtime Environment 1.8.0_261-b12 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 25.261-b12 [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,666][INFO ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%client1] VM total memory: 1.9GB [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,667][INFO ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%client1] Remote Management [restart: off, REST: off, JMX (remote: off)] [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,667][INFO ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%client1] Logger: GridTestLog4jLogger [quiet=false, config=null] [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,667][INFO ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%client1] IGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,668][INFO ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%client1] VM arguments: [-DIGNITE_DUMP_THREADS_ON_FAILURE=false, -DMono=/usr/bin/mono-sgen, -DMono4.0_x64=/usr/lib/mono/4.0, -DMono4.5_x64=/usr/lib/mono/4.5, -DMonoVersion=6.12.0.90, -DSKIP_BUILD=false, -Dagent.home.dir=/opt/buildagent, -Dagent.name=aitc-lin02_03, -Dagent.ownPort=9090, -Dagent.work.dir=/opt/buildagent/work, -Dbuild.number=95, -Dbuild.vcs.number=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.1=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.GitHubApacheIgnite=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dclassworlds.conf=/opt/buildagent/temp/buildTmp/teamcity.m2.conf, -Dcom.jetbrains.maven.watcher.report.file=/opt/buildagent/temp/buildTmp/maven-build-info.xml, -Djava.io.tmpdir=/opt/buildagent/temp/buildTmp, -Dmaven.home=/opt/buildagent/tools/maven3_6, -Dmaven.multiModuleProjectDirectory=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.agent.cpuBenchmark=457, -Dteamcity.agent.dotnet.agent_url=http://localhost:9090/RPC2, -Dteamcity.agent.dotnet.build_id=6278078, -Dteamcity.auth.password=*******, -Dteamcity.auth.userId=TeamCityBuildId=6278078, -Dteamcity.build.changedFiles.file=/opt/buildagent/temp/buildTmp/changedFiles6342607772318147725.txt, -Dteamcity.build.checkoutDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.build.id=6278078, -Dteamcity.build.properties.file=/opt/buildagent/temp/buildTmp/teamcity.build5164517880467851002.properties, -Dteamcity.build.tempDir=/opt/buildagent/temp/buildTmp, -Dteamcity.build.workingDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.buildConfName=Basic 3, -Dteamcity.buildType.id=IgniteTests24Java8_Basic3, -Dteamcity.configuration.properties.file=/opt/buildagent/temp/buildTmp/teamcity.config5591980786735343870.properties, -Dteamcity.maven.userSettings.path=/opt/buildagent/temp/buildTmp/maven_settings_585072866407032347.xml, -Dteamcity.maven.watcher.home=/opt/buildagent/plugins/mavenPlugin/maven-watcher-jdk16, -Dteamcity.projectName=Ignite Tests 2.x (JDK 8/11), -Dteamcity.runner.properties.file=/opt/buildagent/temp/buildTmp/teamcity.runner9098465561618137420.properties, -Dteamcity.tests.recentlyFailedTests.file=/opt/buildagent/temp/buildTmp/testsToRunFirst3891775683130404069.txt, -Dteamcity.version=2021.2 (build 99542), -ea, -Xms2g, -Xmx2g, -XX:+HeapDumpOnOutOfMemoryError, -DIGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_TEST_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_UPDATE_NOTIFIER=false, -DIGNITE_NO_DISCO_ORDER=true, -DIGNITE_PERFORMANCE_SUGGESTIONS_DISABLED=true, -Djava.net.preferIPv4Stack=true, -DTEST_SCALE_FACTOR=1.0, -DIGNITE_TEST_PROP_LOG4J_FILE=log4j-tc-test.xml, -DIGNITE_QUIET=false, -DIGNITE_MARSHAL_BUFFERS_RECHECK=1000, -Dmaven.repo.local=/opt/buildagent/.m2/repository] [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,672][INFO ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%client1] System cache's DataRegion size is configured to 40 MB. Use DataStorageConfiguration.systemRegionInitialSize property to change the setting. [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,672][INFO ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%client1] Configured caches [in 'sysMemPlc' dataRegion: ['ignite-sys-cache'], in 'default' dataRegion: ['encrypted']] [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,673][INFO ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%client1] 3-rd party licenses can be found at: /opt/buildagent/work/7bc1c54bc719b67c/libs/licenses [21:05:22]W: [org.apache.ignite:ignite-core] [2021-11-19 21:05:22,673][WARN ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%client1] Peer class loading is enabled (disable it in production for performance and deployment consistency reasons) [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,677][INFO ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] Configured plugins: [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,677][INFO ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- StanByClusterTestProvider 1.0 [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,677][INFO ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- null [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,678][INFO ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,678][INFO ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- PageMemory tracker plugin 1.0 [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,678][INFO ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- null [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,678][INFO ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,678][INFO ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- TestDistibutedConfigurationPlugin 1.0 [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,679][INFO ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- null [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,679][INFO ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,679][INFO ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- NodeValidationPluginProvider 1.0 [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,679][INFO ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- null [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,680][INFO ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,680][INFO ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][FailureProcessor] Configured failure handler: [hnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]]] [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,705][INFO ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][TcpCommunicationSpi] Successfully bound communication NIO server to TCP port [port=45152, locHost=/127.0.0.1, selectorsCnt=12, selectorSpins=0, pairedConn=false] [21:05:22]W: [org.apache.ignite:ignite-core] [2021-11-19 21:05:22,706][WARN ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][TcpCommunicationSpi] Message queue limit is set to 0 which may lead to potential OOMEs when running cache operations in FULL_ASYNC or PRIMARY_SYNC modes due to message queues growth on sender and receiver sides. [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,709][INFO ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][GridCollisionManager] Collision resolution is disabled (all jobs will be activated upon arrival). [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,709][INFO ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%client1] Security status [authentication=off, sandbox=off, tls/ssl=off] [21:05:22]W: [org.apache.ignite:ignite-core] [2021-11-19 21:05:22,712][WARN ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][GridCacheProcessor] Persistent Store is not supported on client nodes (Persistent Store's configuration will be ignored). [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,714][INFO ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][IgniteCacheDatabaseSharedManager] Configured data regions initialized successfully [total=4] [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,717][INFO ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][ClientListenerProcessor] Client connector processor has started on TCP port 10802 [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,719][INFO ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%client1] Non-loopback local IPs: 172.17.0.4 [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,719][INFO ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%client1] Enabled local MACs: 0242AC110004 [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,719][INFO ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][ClusterProcessor] Cluster ID and tag has been read from metastorage: null [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,720][INFO ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][IgniteClusterImpl] Shutdown policy was updated [oldVal=null, newVal=null] [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,723][INFO ][tcp-disco-srvr-[:47501]-#558%grid-6%-#10744%grid-6%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=50377] [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,723][INFO ][tcp-disco-srvr-[:47501]-#558%grid-6%-#10744%grid-6%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=50377] [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,724][INFO ][tcp-disco-sock-reader-[]-#569%grid-6%-#10842%grid-6%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:50377, rmtPort=50377] [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,724][INFO ][tcp-disco-sock-reader-[109539ac 127.0.0.1:50377 client]-#569%grid-6%-#10842%grid-6%][TestTcpDiscoverySpi] Initialized connection with remote client node [nodeId=109539ac-d8d7-4dcf-8b8a-e4ff21e9c001, rmtAddr=/127.0.0.1:50377] [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,742][INFO ][disco-event-worker-#10627%grid-0%][GridDiscoveryManager] Added new node to topology: TcpDiscoveryNode [id=109539ac-d8d7-4dcf-8b8a-e4ff21e9c001, consistentId=client1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:0], discPort=0, order=3, intOrder=3, lastExchangeTime=1637345122724, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=true] [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,744][INFO ][disco-event-worker-#10627%grid-0%][GridDiscoveryManager] Topology snapshot [ver=3, locNode=00622f8d, servers=2, clients=1, state=INACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=00622f8d-e1fe-42dd-95f9-54f5fc364000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=60cf419a-9798-4b04-bea7-d09e78da3006, consistentId=grid-6, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=109539ac-d8d7-4dcf-8b8a-e4ff21e9c001, consistentId=client1, isClient=true, ver=2.13.0#20211119-sha1:00000000]]] [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,747][INFO ][disco-event-worker-#10750%grid-6%][GridDiscoveryManager] Added new node to topology: TcpDiscoveryNode [id=109539ac-d8d7-4dcf-8b8a-e4ff21e9c001, consistentId=client1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:0], discPort=0, order=3, intOrder=3, lastExchangeTime=1637345122734, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=true] [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,747][INFO ][tcp-client-disco-msg-worker-#568%client1%-#10840%client1%][TestTcpDiscoverySpi] Router node: TcpDiscoveryNode [id=60cf419a-9798-4b04-bea7-d09e78da3006, consistentId=grid-6, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637345122734, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false] [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,747][INFO ][disco-event-worker-#10750%grid-6%][GridDiscoveryManager] Topology snapshot [ver=3, locNode=60cf419a, servers=2, clients=1, state=INACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=00622f8d-e1fe-42dd-95f9-54f5fc364000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=60cf419a-9798-4b04-bea7-d09e78da3006, consistentId=grid-6, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=109539ac-d8d7-4dcf-8b8a-e4ff21e9c001, consistentId=client1, isClient=true, ver=2.13.0#20211119-sha1:00000000]]] [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,752][INFO ][tcp-client-disco-msg-worker-#568%client1%-#10840%client1%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustEnabled' was changed from 'null' to 'false' [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,752][INFO ][tcp-client-disco-msg-worker-#568%client1%-#10840%client1%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustTimeout' was changed from 'null' to '300000' [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,753][INFO ][tcp-client-disco-msg-worker-#568%client1%-#10840%client1%][IgniteTxManager] Transactions parameter 'collisionsDumpInterval' was changed from 'null' to '1000' [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,753][INFO ][tcp-client-disco-msg-worker-#568%client1%-#10840%client1%][IgniteTxManager] Transactions parameter 'longOperationsDumpTimeout' was changed from 'null' to '60000' [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,754][INFO ][tcp-client-disco-msg-worker-#568%client1%-#10840%client1%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpSamplesPerSecondLimit' was changed from 'null' to '5' [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,754][INFO ][tcp-client-disco-msg-worker-#568%client1%-#10840%client1%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpThreshold' was changed from 'null' to '0' [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,755][INFO ][tcp-client-disco-msg-worker-#568%client1%-#10840%client1%][IgniteTxManager] Transactions parameter 'transactionTimeDumpSamplesCoefficient' was changed from 'null' to '0.0' [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,755][INFO ][tcp-client-disco-msg-worker-#568%client1%-#10840%client1%][IgniteTxManager] Transactions parameter 'txOwnerDumpRequestsAllowed' was changed from 'null' to 'true' [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,755][INFO ][tcp-client-disco-msg-worker-#568%client1%-#10840%client1%][ClusterProcessor] nervous_murdock [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,756][INFO ][disco-notifier-worker-#10837%client1%][MvccProcessorImpl] Assigned mvcc coordinator [crd=MvccCoordinator [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], nodeId=00622f8d-e1fe-42dd-95f9-54f5fc364000, ver=1637345121302, local=false, initialized=false]] [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,758][INFO ][sys-#10844%client1%][ClusterProcessor] Writing cluster ID and tag to metastorage on ready for write ClusterIdAndTag [id=4d51a675-d292-405e-874a-2005d519e647, tag=nervous_murdock] [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,769][INFO ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%client1] To start Console Management & Monitoring run ignitevisorcmd.{sh|bat} [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,770][INFO ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%client1] [21:05:22] : [Step 4/5] [21:05:22] : [Step 4/5] >>> +-------------------------------------------+ [21:05:22] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:05:22] : [Step 4/5] >>> +-------------------------------------------+ [21:05:22] : [Step 4/5] >>> OS name: Linux 4.15.0-151-generic amd64 [21:05:22] : [Step 4/5] >>> CPU(s): 24 [21:05:22] : [Step 4/5] >>> Heap: 2.0GB [21:05:22] : [Step 4/5] >>> VM name: 16724@c4dfe9a430b2 [21:05:22] : [Step 4/5] >>> Ignite instance name: client1 [21:05:22] : [Step 4/5] >>> Local node [ID=109539AC-D8D7-4DCF-8B8A-E4FF21E9C001, order=3, clientMode=true] [21:05:22] : [Step 4/5] >>> Local node addresses: [127.0.0.1] [21:05:22] : [Step 4/5] >>> Local ports: TCP:10802 TCP:45152 [21:05:22] : [Step 4/5] [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,770][INFO ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%client1] >>> Ignite cluster is in INACTIVE state (limited functionality available). Use control.(sh|bat) script or IgniteCluster.state(ClusterState.ACTIVE) to change the state. [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,771][INFO ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][GridDiscoveryManager] Topology snapshot [ver=3, locNode=109539ac, servers=2, clients=1, state=INACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=109539ac-d8d7-4dcf-8b8a-e4ff21e9c001, consistentId=client1, isClient=true, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=00622f8d-e1fe-42dd-95f9-54f5fc364000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=60cf419a-9798-4b04-bea7-d09e78da3006, consistentId=grid-6, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,773][INFO ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][G] Node started : [stage="Configure system pool" (0 ms),stage="Start managers" (58 ms),stage="Configure binary metadata" (1 ms),stage="Start processors" (6 ms),stage="Start 'StanByClusterTestProvider' plugin" (0 ms),stage="Start 'PageMemory tracker plugin' plugin" (0 ms),stage="Start 'TestDistibutedConfigurationPlugin' plugin" (0 ms),stage="Start 'NodeValidationPluginProvider' plugin" (0 ms),stage="Init metastore" (1 ms),stage="Finish recovery" (0 ms),stage="Join topology" (38 ms),stage="Await transition" (1 ms),stage="Await exchange" (12 ms),stage="Total time" (117 ms)] [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,774][INFO ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][root] Node started with the following configuration [id=109539ac-d8d7-4dcf-8b8a-e4ff21e9c001, marshaller=BinaryMarshaller [], discovery=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=5000, ackTimeout=5000, marsh=JdkMarshaller [clsFilter=org.apache.ignite.marshaller.MarshallerUtils$1@18608246], reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], binaryCfg=null, lateAff=true] [21:05:22]W: [org.apache.ignite:ignite-core] [2021-11-19 21:05:22,778][WARN ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][G] Ignite work directory is not provided, automatically resolved to: /opt/buildagent/work/7bc1c54bc719b67c/work [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,779][INFO ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%client] [21:05:22] : [Step 4/5] [21:05:22] : [Step 4/5] >>> __________ ________________ [21:05:22] : [Step 4/5] >>> / _/ ___/ |/ / _/_ __/ __/ [21:05:22] : [Step 4/5] >>> _/ // (7 7 // / / / / _/ [21:05:22] : [Step 4/5] >>> /___/\___/_/|_/___/ /_/ /___/ [21:05:22] : [Step 4/5] >>> [21:05:22] : [Step 4/5] >>> ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:05:22] : [Step 4/5] >>> 2021 Copyright(C) Apache Software Foundation [21:05:22] : [Step 4/5] >>> [21:05:22] : [Step 4/5] >>> Ignite documentation: http://ignite.apache.org [21:05:22] : [Step 4/5] [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,780][INFO ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%client] Config URL: n/a [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,780][INFO ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%client] IgniteConfiguration [igniteInstanceName=client, pubPoolSize=24, svcPoolSize=24, callbackPoolSize=24, stripedPoolSize=24, sysPoolSize=24, mgmtPoolSize=4, dataStreamerPoolSize=24, utilityCachePoolSize=24, utilityCacheKeepAliveTime=60000, p2pPoolSize=2, qryPoolSize=24, buildIdxPoolSize=4, igniteHome=/opt/buildagent/work/7bc1c54bc719b67c, igniteWorkDir=/opt/buildagent/work/7bc1c54bc719b67c/work, mbeanSrv=com.sun.jmx.mbeanserver.JmxMBeanServer@6fe85038, nodeId=1bac54b7-e378-44aa-9fdb-4d39cfa9e560, marsh=BinaryMarshaller [], marshLocJobs=false, daemon=false, p2pEnabled=true, netTimeout=10000, netCompressionLevel=1, sndRetryDelay=1000, sndRetryCnt=3, metricsHistSize=10000, metricsUpdateFreq=1000, metricsExpTime=9223372036854775807, discoSpi=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=0, ackTimeout=0, marsh=null, reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], segPlc=STOP, segResolveAttempts=2, waitForSegOnStart=true, allResolversPassReq=true, segChkFreq=10000, commSpi=TcpCommunicationSpi [connectGate=org.apache.ignite.spi.communication.tcp.internal.ConnectGateway@48f2c35d, ctxInitLatch=java.util.concurrent.CountDownLatch@6c2c8ff[Count = 1], stopping=false, clientPool=null, nioSrvWrapper=null, stateProvider=null], evtSpi=MemoryEventStorageSpi [expireAgeMs=9223372036854775807, expireCnt=10000, filter=null], colSpi=NoopCollisionSpi [], deploySpi=LocalDeploymentSpi [], indexingSpi=org.apache.ignite.spi.indexing.noop.NoopIndexingSpi@63edc668, addrRslvr=null, encryptionSpi=org.apache.ignite.spi.encryption.noop.NoopEncryptionSpi@5a9cbab9, tracingSpi=org.apache.ignite.spi.tracing.NoopTracingSpi@2d234ee, clientMode=true, rebalanceThreadPoolSize=4, rebalanceTimeout=10000, rebalanceBatchesPrefetchCnt=3, rebalanceThrottle=0, rebalanceBatchSize=524288, txCfg=TransactionConfiguration [txSerEnabled=false, dfltIsolation=REPEATABLE_READ, dfltConcurrency=PESSIMISTIC, dfltTxTimeout=0, txTimeoutOnPartitionMapExchange=0, deadlockTimeout=10000, pessimisticTxLogSize=0, pessimisticTxLogLinger=10000, tmLookupClsName=null, txManagerFactory=null, useJtaSync=false], cacheSanityCheckEnabled=true, discoStartupDelay=60000, deployMode=SHARED, p2pMissedCacheSize=100, locHost=127.0.0.1, timeSrvPortBase=31100, timeSrvPortRange=100, failureDetectionTimeout=10000, sysWorkerBlockedTimeout=null, clientFailureDetectionTimeout=10000, metricsLogFreq=0, connectorCfg=null, odbcCfg=null, warmupClos=null, atomicCfg=AtomicConfiguration [seqReserveSize=1000, cacheMode=PARTITIONED, backups=1, aff=null, grpName=null], classLdr=null, sslCtxFactory=null, platformCfg=null, binaryCfg=null, memCfg=null, pstCfg=null, dsCfg=DataStorageConfiguration [sysRegionInitSize=41943040, sysRegionMaxSize=104857600, pageSize=4096, concLvl=0, dfltDataRegConf=DataRegionConfiguration [name=default, maxSize=10485760, initSize=268435456, swapPath=null, pageEvictionMode=DISABLED, pageReplacementMode=CLOCK, evictionThreshold=0.9, emptyPagesPoolSize=100, metricsEnabled=false, metricsSubIntervalCount=5, metricsRateTimeInterval=60000, persistenceEnabled=true, checkpointPageBufSize=0, lazyMemoryAllocation=true, warmUpCfg=null], dataRegions=null, storagePath=null, checkpointFreq=180000, lockWaitTime=10000, checkpointThreads=4, checkpointWriteOrder=SEQUENTIAL, walHistSize=20, maxWalArchiveSize=1073741824, walSegments=10, walSegmentSize=67108864, walPath=db/wal, walArchivePath=db/wal/archive, cdcWalPath=db/wal/cdc, cdcEnabled=false, metricsEnabled=false, walMode=FSYNC, walTlbSize=131072, walBuffSize=0, walFlushFreq=2000, walFsyncDelay=1000, walRecordIterBuffSize=67108864, alwaysWriteFullPages=false, fileIOFactory=org.apache.ignite.internal.processors.cache.persistence.file.AsyncFileIOFactory@bb21010, metricsSubIntervalCnt=5, metricsRateTimeInterval=60000, walAutoArchiveAfterInactivity=-1, walForceArchiveTimeout=-1, writeThrottlingEnabled=false, walCompactionEnabled=false, walCompactionLevel=1, checkpointReadLockTimeout=null, walPageCompression=DISABLED, walPageCompressionLevel=null, dfltWarmUpCfg=null, encCfg=org.apache.ignite.configuration.EncryptionConfiguration@26cf6d34, defragmentationThreadPoolSize=4, minWalArchiveSize=-1], snapshotPath=snapshots, activeOnStart=true, activeOnStartPropSetFlag=false, autoActivation=true, autoActivationPropSetFlag=false, clusterStateOnStart=null, sqlConnCfg=null, cliConnCfg=ClientConnectorConfiguration [host=null, port=10800, portRange=100, sockSndBufSize=0, sockRcvBufSize=0, tcpNoDelay=true, maxOpenCursorsPerConn=128, threadPoolSize=24, selectorCnt=12, idleTimeout=0, handshakeTimeout=10000, jdbcEnabled=true, odbcEnabled=true, thinCliEnabled=true, sslEnabled=false, useIgniteSslCtxFactory=true, sslClientAuth=false, sslCtxFactory=null, thinCliCfg=ThinClientConfiguration [maxActiveTxPerConn=100, maxActiveComputeTasksPerConn=0]], mvccVacuumThreadCnt=2, mvccVacuumFreq=5000, authEnabled=false, failureHnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]], commFailureRslvr=null, sqlCfg=SqlConfiguration [longQryWarnTimeout=3000, dfltQryTimeout=0, sqlQryHistSize=1000, validationEnabled=false], asyncContinuationExecutor=null] [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,787][INFO ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%client] Daemon mode: off [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,787][INFO ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%client] OS: Linux 4.15.0-151-generic amd64 [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,788][INFO ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%client] OS user: teamcity [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,788][INFO ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%client] PID: 16724 [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,788][INFO ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%client] Language runtime: Java Platform API Specification ver. 1.8 [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,788][INFO ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%client] VM information: Java(TM) SE Runtime Environment 1.8.0_261-b12 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 25.261-b12 [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,789][INFO ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%client] VM total memory: 1.9GB [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,789][INFO ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%client] Remote Management [restart: off, REST: off, JMX (remote: off)] [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,789][INFO ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%client] Logger: GridTestLog4jLogger [quiet=false, config=null] [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,789][INFO ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%client] IGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,790][INFO ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%client] VM arguments: [-DIGNITE_DUMP_THREADS_ON_FAILURE=false, -DMono=/usr/bin/mono-sgen, -DMono4.0_x64=/usr/lib/mono/4.0, -DMono4.5_x64=/usr/lib/mono/4.5, -DMonoVersion=6.12.0.90, -DSKIP_BUILD=false, -Dagent.home.dir=/opt/buildagent, -Dagent.name=aitc-lin02_03, -Dagent.ownPort=9090, -Dagent.work.dir=/opt/buildagent/work, -Dbuild.number=95, -Dbuild.vcs.number=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.1=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.GitHubApacheIgnite=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dclassworlds.conf=/opt/buildagent/temp/buildTmp/teamcity.m2.conf, -Dcom.jetbrains.maven.watcher.report.file=/opt/buildagent/temp/buildTmp/maven-build-info.xml, -Djava.io.tmpdir=/opt/buildagent/temp/buildTmp, -Dmaven.home=/opt/buildagent/tools/maven3_6, -Dmaven.multiModuleProjectDirectory=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.agent.cpuBenchmark=457, -Dteamcity.agent.dotnet.agent_url=http://localhost:9090/RPC2, -Dteamcity.agent.dotnet.build_id=6278078, -Dteamcity.auth.password=*******, -Dteamcity.auth.userId=TeamCityBuildId=6278078, -Dteamcity.build.changedFiles.file=/opt/buildagent/temp/buildTmp/changedFiles6342607772318147725.txt, -Dteamcity.build.checkoutDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.build.id=6278078, -Dteamcity.build.properties.file=/opt/buildagent/temp/buildTmp/teamcity.build5164517880467851002.properties, -Dteamcity.build.tempDir=/opt/buildagent/temp/buildTmp, -Dteamcity.build.workingDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.buildConfName=Basic 3, -Dteamcity.buildType.id=IgniteTests24Java8_Basic3, -Dteamcity.configuration.properties.file=/opt/buildagent/temp/buildTmp/teamcity.config5591980786735343870.properties, -Dteamcity.maven.userSettings.path=/opt/buildagent/temp/buildTmp/maven_settings_585072866407032347.xml, -Dteamcity.maven.watcher.home=/opt/buildagent/plugins/mavenPlugin/maven-watcher-jdk16, -Dteamcity.projectName=Ignite Tests 2.x (JDK 8/11), -Dteamcity.runner.properties.file=/opt/buildagent/temp/buildTmp/teamcity.runner9098465561618137420.properties, -Dteamcity.tests.recentlyFailedTests.file=/opt/buildagent/temp/buildTmp/testsToRunFirst3891775683130404069.txt, -Dteamcity.version=2021.2 (build 99542), -ea, -Xms2g, -Xmx2g, -XX:+HeapDumpOnOutOfMemoryError, -DIGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_TEST_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_UPDATE_NOTIFIER=false, -DIGNITE_NO_DISCO_ORDER=true, -DIGNITE_PERFORMANCE_SUGGESTIONS_DISABLED=true, -Djava.net.preferIPv4Stack=true, -DTEST_SCALE_FACTOR=1.0, -DIGNITE_TEST_PROP_LOG4J_FILE=log4j-tc-test.xml, -DIGNITE_QUIET=false, -DIGNITE_MARSHAL_BUFFERS_RECHECK=1000, -Dmaven.repo.local=/opt/buildagent/.m2/repository] [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,793][INFO ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%client] System cache's DataRegion size is configured to 40 MB. Use DataStorageConfiguration.systemRegionInitialSize property to change the setting. [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,794][INFO ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%client] Configured caches [in 'sysMemPlc' dataRegion: ['ignite-sys-cache'], in 'default' dataRegion: ['encrypted']] [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,794][INFO ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%client] 3-rd party licenses can be found at: /opt/buildagent/work/7bc1c54bc719b67c/libs/licenses [21:05:22]W: [org.apache.ignite:ignite-core] [2021-11-19 21:05:22,794][WARN ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%client] Peer class loading is enabled (disable it in production for performance and deployment consistency reasons) [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,798][INFO ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] Configured plugins: [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,798][INFO ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- StanByClusterTestProvider 1.0 [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,798][INFO ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- null [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,799][INFO ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,799][INFO ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- PageMemory tracker plugin 1.0 [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,799][INFO ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- null [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,799][INFO ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,799][INFO ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- TestDistibutedConfigurationPlugin 1.0 [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,799][INFO ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- null [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,800][INFO ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,800][INFO ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- NodeValidationPluginProvider 1.0 [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,800][INFO ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- null [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,800][INFO ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,800][INFO ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][FailureProcessor] Configured failure handler: [hnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]]] [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,815][INFO ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][TcpCommunicationSpi] Successfully bound communication NIO server to TCP port [port=45153, locHost=/127.0.0.1, selectorsCnt=12, selectorSpins=0, pairedConn=false] [21:05:22]W: [org.apache.ignite:ignite-core] [2021-11-19 21:05:22,815][WARN ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][TcpCommunicationSpi] Message queue limit is set to 0 which may lead to potential OOMEs when running cache operations in FULL_ASYNC or PRIMARY_SYNC modes due to message queues growth on sender and receiver sides. [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,819][INFO ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][GridCollisionManager] Collision resolution is disabled (all jobs will be activated upon arrival). [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,819][INFO ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%client] Security status [authentication=off, sandbox=off, tls/ssl=off] [21:05:22]W: [org.apache.ignite:ignite-core] [2021-11-19 21:05:22,823][WARN ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][GridCacheProcessor] Persistent Store is not supported on client nodes (Persistent Store's configuration will be ignored). [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,825][INFO ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][IgniteCacheDatabaseSharedManager] Configured data regions initialized successfully [total=4] [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,828][INFO ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][ClientListenerProcessor] Client connector processor has started on TCP port 10803 [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,830][INFO ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%client] Non-loopback local IPs: 172.17.0.4 [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,830][INFO ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%client] Enabled local MACs: 0242AC110004 [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,831][INFO ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][ClusterProcessor] Cluster ID and tag has been read from metastorage: null [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,831][INFO ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][IgniteClusterImpl] Shutdown policy was updated [oldVal=null, newVal=null] [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,834][INFO ][tcp-disco-srvr-[:47500]-#553%grid-0%-#10625%grid-0%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=40979] [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,834][INFO ][tcp-disco-srvr-[:47500]-#553%grid-0%-#10625%grid-0%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=40979] [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,835][INFO ][tcp-disco-sock-reader-[]-#576%grid-0%-#10937%grid-0%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:40979, rmtPort=40979] [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,836][INFO ][tcp-disco-sock-reader-[1bac54b7 127.0.0.1:40979 client]-#576%grid-0%-#10937%grid-0%][TestTcpDiscoverySpi] Initialized connection with remote client node [nodeId=1bac54b7-e378-44aa-9fdb-4d39cfa9e560, rmtAddr=/127.0.0.1:40979] [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,852][INFO ][disco-event-worker-#10627%grid-0%][GridDiscoveryManager] Added new node to topology: TcpDiscoveryNode [id=1bac54b7-e378-44aa-9fdb-4d39cfa9e560, consistentId=client, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:0], discPort=0, order=4, intOrder=4, lastExchangeTime=1637345122835, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=true] [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,853][INFO ][tcp-client-disco-msg-worker-#575%client%-#10935%client%][TestTcpDiscoverySpi] Router node: TcpDiscoveryNode [id=00622f8d-e1fe-42dd-95f9-54f5fc364000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345122846, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false] [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,853][INFO ][disco-event-worker-#10627%grid-0%][GridDiscoveryManager] Topology snapshot [ver=4, locNode=00622f8d, servers=2, clients=2, state=INACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=00622f8d-e1fe-42dd-95f9-54f5fc364000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=60cf419a-9798-4b04-bea7-d09e78da3006, consistentId=grid-6, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=109539ac-d8d7-4dcf-8b8a-e4ff21e9c001, consistentId=client1, isClient=true, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=1bac54b7-e378-44aa-9fdb-4d39cfa9e560, consistentId=client, isClient=true, ver=2.13.0#20211119-sha1:00000000]]] [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,854][INFO ][tcp-client-disco-msg-worker-#568%client1%-#10840%client1%][TestTcpDiscoverySpi] Router node: TcpDiscoveryNode [id=60cf419a-9798-4b04-bea7-d09e78da3006, consistentId=grid-6, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637345122734, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false] [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,854][INFO ][disco-event-worker-#10750%grid-6%][GridDiscoveryManager] Added new node to topology: TcpDiscoveryNode [id=1bac54b7-e378-44aa-9fdb-4d39cfa9e560, consistentId=client, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:0], discPort=0, order=4, intOrder=4, lastExchangeTime=1637345122835, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=true] [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,857][INFO ][tcp-client-disco-msg-worker-#575%client%-#10935%client%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustEnabled' was changed from 'null' to 'false' [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,857][INFO ][disco-event-worker-#10845%client1%][GridDiscoveryManager] Added new node to topology: TcpDiscoveryNode [id=1bac54b7-e378-44aa-9fdb-4d39cfa9e560, consistentId=client, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:0], discPort=0, order=4, intOrder=4, lastExchangeTime=1637345122846, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=true] [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,858][INFO ][tcp-client-disco-msg-worker-#575%client%-#10935%client%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustTimeout' was changed from 'null' to '300000' [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,857][INFO ][disco-event-worker-#10750%grid-6%][GridDiscoveryManager] Topology snapshot [ver=4, locNode=60cf419a, servers=2, clients=2, state=INACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=00622f8d-e1fe-42dd-95f9-54f5fc364000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=60cf419a-9798-4b04-bea7-d09e78da3006, consistentId=grid-6, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=109539ac-d8d7-4dcf-8b8a-e4ff21e9c001, consistentId=client1, isClient=true, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=1bac54b7-e378-44aa-9fdb-4d39cfa9e560, consistentId=client, isClient=true, ver=2.13.0#20211119-sha1:00000000]]] [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,859][INFO ][disco-event-worker-#10845%client1%][GridDiscoveryManager] Topology snapshot [ver=4, locNode=109539ac, servers=2, clients=2, state=INACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=109539ac-d8d7-4dcf-8b8a-e4ff21e9c001, consistentId=client1, isClient=true, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=00622f8d-e1fe-42dd-95f9-54f5fc364000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=60cf419a-9798-4b04-bea7-d09e78da3006, consistentId=grid-6, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=1bac54b7-e378-44aa-9fdb-4d39cfa9e560, consistentId=client, isClient=true, ver=2.13.0#20211119-sha1:00000000]]] [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,859][INFO ][tcp-client-disco-msg-worker-#575%client%-#10935%client%][IgniteTxManager] Transactions parameter 'collisionsDumpInterval' was changed from 'null' to '1000' [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,861][INFO ][tcp-client-disco-msg-worker-#575%client%-#10935%client%][IgniteTxManager] Transactions parameter 'longOperationsDumpTimeout' was changed from 'null' to '60000' [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,862][INFO ][tcp-client-disco-msg-worker-#575%client%-#10935%client%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpSamplesPerSecondLimit' was changed from 'null' to '5' [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,862][INFO ][tcp-client-disco-msg-worker-#575%client%-#10935%client%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpThreshold' was changed from 'null' to '0' [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,862][INFO ][tcp-client-disco-msg-worker-#575%client%-#10935%client%][IgniteTxManager] Transactions parameter 'transactionTimeDumpSamplesCoefficient' was changed from 'null' to '0.0' [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,863][INFO ][tcp-client-disco-msg-worker-#575%client%-#10935%client%][IgniteTxManager] Transactions parameter 'txOwnerDumpRequestsAllowed' was changed from 'null' to 'true' [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,863][INFO ][tcp-client-disco-msg-worker-#575%client%-#10935%client%][ClusterProcessor] nervous_murdock [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,863][INFO ][disco-notifier-worker-#10932%client%][MvccProcessorImpl] Assigned mvcc coordinator [crd=MvccCoordinator [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], nodeId=00622f8d-e1fe-42dd-95f9-54f5fc364000, ver=1637345121302, local=false, initialized=false]] [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,866][INFO ][sys-#10939%client%][ClusterProcessor] Writing cluster ID and tag to metastorage on ready for write ClusterIdAndTag [id=4d51a675-d292-405e-874a-2005d519e647, tag=nervous_murdock] [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,877][INFO ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%client] To start Console Management & Monitoring run ignitevisorcmd.{sh|bat} [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,877][INFO ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%client] [21:05:22] : [Step 4/5] [21:05:22] : [Step 4/5] >>> +-------------------------------------------+ [21:05:22] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:05:22] : [Step 4/5] >>> +-------------------------------------------+ [21:05:22] : [Step 4/5] >>> OS name: Linux 4.15.0-151-generic amd64 [21:05:22] : [Step 4/5] >>> CPU(s): 24 [21:05:22] : [Step 4/5] >>> Heap: 2.0GB [21:05:22] : [Step 4/5] >>> VM name: 16724@c4dfe9a430b2 [21:05:22] : [Step 4/5] >>> Ignite instance name: client [21:05:22] : [Step 4/5] >>> Local node [ID=1BAC54B7-E378-44AA-9FDB-4D39CFA9E560, order=4, clientMode=true] [21:05:22] : [Step 4/5] >>> Local node addresses: [127.0.0.1] [21:05:22] : [Step 4/5] >>> Local ports: TCP:10803 TCP:45153 [21:05:22] : [Step 4/5] [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,878][INFO ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%client] >>> Ignite cluster is in INACTIVE state (limited functionality available). Use control.(sh|bat) script or IgniteCluster.state(ClusterState.ACTIVE) to change the state. [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,878][INFO ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][GridDiscoveryManager] Topology snapshot [ver=4, locNode=1bac54b7, servers=2, clients=2, state=INACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=1bac54b7-e378-44aa-9fdb-4d39cfa9e560, consistentId=client, isClient=true, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=00622f8d-e1fe-42dd-95f9-54f5fc364000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=60cf419a-9798-4b04-bea7-d09e78da3006, consistentId=grid-6, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=109539ac-d8d7-4dcf-8b8a-e4ff21e9c001, consistentId=client1, isClient=true, ver=2.13.0#20211119-sha1:00000000]]] [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,879][INFO ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][G] Node started : [stage="Configure system pool" (0 ms),stage="Start managers" (41 ms),stage="Configure binary metadata" (1 ms),stage="Start processors" (7 ms),stage="Start 'StanByClusterTestProvider' plugin" (0 ms),stage="Start 'PageMemory tracker plugin' plugin" (0 ms),stage="Start 'TestDistibutedConfigurationPlugin' plugin" (0 ms),stage="Start 'NodeValidationPluginProvider' plugin" (0 ms),stage="Init metastore" (1 ms),stage="Finish recovery" (0 ms),stage="Join topology" (34 ms),stage="Await transition" (2 ms),stage="Await exchange" (11 ms),stage="Total time" (97 ms)] [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,880][INFO ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][root] Node started with the following configuration [id=1bac54b7-e378-44aa-9fdb-4d39cfa9e560, marshaller=BinaryMarshaller [], discovery=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=5000, ackTimeout=5000, marsh=JdkMarshaller [clsFilter=org.apache.ignite.marshaller.MarshallerUtils$1@4d820e10], reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], binaryCfg=null, lateAff=true] [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,882][INFO ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][GridClusterStateProcessor] Sending activate cluster request with BaselineTopology BaselineTopology [id=0, branchingHash=-2475315496, branchingType='New BaselineTopology', baselineNodes=[grid-0, grid-6]] [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,884][INFO ][disco-notifier-worker-#10623%grid-0%][GridClusterStateProcessor] Received activate cluster request with BaselineTopology[id=0] initiator node ID: 00622f8d-e1fe-42dd-95f9-54f5fc364000 [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,885][INFO ][disco-notifier-worker-#10623%grid-0%][GridClusterStateProcessor] Started state transition: activate cluster [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,886][INFO ][exchange-worker-#10628%grid-0%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], crd=true, evt=DISCOVERY_CUSTOM_EVT, evtNode=00622f8d-e1fe-42dd-95f9-54f5fc364000, customEvt=ChangeGlobalStateMessage [id=e153d593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqId=656f3609-d5b4-4dad-bd54-441e59ed5bd1, initiatingNodeId=00622f8d-e1fe-42dd-95f9-54f5fc364000, state=ACTIVE, baselineTopology=BaselineTopology [id=0, branchingHash=-2475315496, branchingType='New BaselineTopology', baselineNodes=[grid-0, grid-6]], forceChangeBaselineTopology=false, timestamp=1637345122882, forceDeactivation=true], allowMerge=false, exchangeFreeSwitch=false] [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,886][INFO ][disco-notifier-worker-#10932%client%][GridClusterStateProcessor] Received activate cluster request with BaselineTopology[id=0] initiator node ID: 00622f8d-e1fe-42dd-95f9-54f5fc364000 [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,886][INFO ][disco-notifier-worker-#10742%grid-6%][GridClusterStateProcessor] Received activate cluster request with BaselineTopology[id=0] initiator node ID: 00622f8d-e1fe-42dd-95f9-54f5fc364000 [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,887][INFO ][disco-notifier-worker-#10932%client%][GridClusterStateProcessor] Started state transition: activate cluster [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,887][INFO ][disco-notifier-worker-#10837%client1%][GridClusterStateProcessor] Received activate cluster request with BaselineTopology[id=0] initiator node ID: 00622f8d-e1fe-42dd-95f9-54f5fc364000 [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,887][INFO ][exchange-worker-#10628%grid-0%][GridDhtPartitionsExchangeFuture] Start activation process [nodeId=00622f8d-e1fe-42dd-95f9-54f5fc364000, client=false, topVer=AffinityTopologyVersion [topVer=4, minorTopVer=1]]. New state: ACTIVE [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,888][INFO ][disco-notifier-worker-#10837%client1%][GridClusterStateProcessor] Started state transition: activate cluster [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,888][INFO ][disco-notifier-worker-#10742%grid-6%][GridClusterStateProcessor] Started state transition: activate cluster [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,889][INFO ][exchange-worker-#10628%grid-0%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0 [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,890][INFO ][exchange-worker-#10941%client%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], crd=false, evt=DISCOVERY_CUSTOM_EVT, evtNode=00622f8d-e1fe-42dd-95f9-54f5fc364000, customEvt=ChangeGlobalStateMessage [id=e153d593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqId=656f3609-d5b4-4dad-bd54-441e59ed5bd1, initiatingNodeId=00622f8d-e1fe-42dd-95f9-54f5fc364000, state=ACTIVE, baselineTopology=BaselineTopology [id=0, branchingHash=-2475315496, branchingType='New BaselineTopology', baselineNodes=[grid-0, grid-6]], forceChangeBaselineTopology=false, timestamp=1637345122882, forceDeactivation=true], allowMerge=false, exchangeFreeSwitch=false] [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,890][INFO ][exchange-worker-#10751%grid-6%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], crd=false, evt=DISCOVERY_CUSTOM_EVT, evtNode=00622f8d-e1fe-42dd-95f9-54f5fc364000, customEvt=ChangeGlobalStateMessage [id=e153d593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqId=656f3609-d5b4-4dad-bd54-441e59ed5bd1, initiatingNodeId=00622f8d-e1fe-42dd-95f9-54f5fc364000, state=ACTIVE, baselineTopology=BaselineTopology [id=0, branchingHash=-2475315496, branchingType='New BaselineTopology', baselineNodes=[grid-0, grid-6]], forceChangeBaselineTopology=false, timestamp=1637345122882, forceDeactivation=true], allowMerge=false, exchangeFreeSwitch=false] [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,890][INFO ][exchange-worker-#10846%client1%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], crd=false, evt=DISCOVERY_CUSTOM_EVT, evtNode=00622f8d-e1fe-42dd-95f9-54f5fc364000, customEvt=ChangeGlobalStateMessage [id=e153d593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqId=656f3609-d5b4-4dad-bd54-441e59ed5bd1, initiatingNodeId=00622f8d-e1fe-42dd-95f9-54f5fc364000, state=ACTIVE, baselineTopology=BaselineTopology [id=0, branchingHash=-2475315496, branchingType='New BaselineTopology', baselineNodes=[grid-0, grid-6]], forceChangeBaselineTopology=false, timestamp=1637345122882, forceDeactivation=true], allowMerge=false, exchangeFreeSwitch=false] [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,894][INFO ][exchange-worker-#10751%grid-6%][GridDhtPartitionsExchangeFuture] Start activation process [nodeId=60cf419a-9798-4b04-bea7-d09e78da3006, client=false, topVer=AffinityTopologyVersion [topVer=4, minorTopVer=1]]. New state: ACTIVE [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,893][INFO ][exchange-worker-#10941%client%][GridDhtPartitionsExchangeFuture] Start activation process [nodeId=1bac54b7-e378-44aa-9fdb-4d39cfa9e560, client=true, topVer=AffinityTopologyVersion [topVer=4, minorTopVer=1]]. New state: ACTIVE [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,893][INFO ][exchange-worker-#10628%grid-0%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000000.wal, offset=13104, ver=2] [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,896][INFO ][exchange-worker-#10751%grid-6%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_6 [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,896][INFO ][exchange-worker-#10846%client1%][GridDhtPartitionsExchangeFuture] Start activation process [nodeId=109539ac-d8d7-4dcf-8b8a-e4ff21e9c001, client=true, topVer=AffinityTopologyVersion [topVer=4, minorTopVer=1]]. New state: ACTIVE [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,902][INFO ][exchange-worker-#10941%client%][IgniteCacheDatabaseSharedManager] Data Regions Started: 4 [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,902][INFO ][exchange-worker-#10941%client%][IgniteCacheDatabaseSharedManager] ^-- sysMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:05:22] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB, allocTotal=0MB] [21:05:22] : [Step 4/5] ^-- default region [type=default, persistence=true, lazyAlloc=true, [21:05:22] : [Step 4/5] ... initCfg=10MB, maxCfg=10MB, usedRam=0MB, freeRam=100%, allocRam=0MB, allocTotal=0MB] [21:05:22] : [Step 4/5] ^-- TxLog region [type=internal, persistence=true, lazyAlloc=false, [21:05:22] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB, allocTotal=0MB] [21:05:22] : [Step 4/5] ^-- volatileDsMemPlc region [type=user, persistence=false, lazyAlloc=true, [21:05:22] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB] [21:05:22] : [Step 4/5] ^-- Ignite persistence [used=0MB] [21:05:22] : [Step 4/5] [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,903][INFO ][exchange-worker-#10751%grid-6%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_6/0000000000000000.wal, offset=13104, ver=2] [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,903][INFO ][exchange-worker-#10846%client1%][IgniteCacheDatabaseSharedManager] Data Regions Started: 4 [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,904][INFO ][exchange-worker-#10941%client%][msg] Components activation performed in 7 ms. [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,909][INFO ][exchange-worker-#10628%grid-0%][GridClusterStateProcessor] Writing BaselineTopology[id=0] [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,911][INFO ][exchange-worker-#10846%client1%][IgniteCacheDatabaseSharedManager] ^-- sysMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:05:22] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB, allocTotal=0MB] [21:05:22] : [Step 4/5] ^-- default region [type=default, persistence=true, lazyAlloc=true, [21:05:22] : [Step 4/5] ... initCfg=10MB, maxCfg=10MB, usedRam=0MB, freeRam=100%, allocRam=0MB, allocTotal=0MB] [21:05:22] : [Step 4/5] ^-- TxLog region [type=internal, persistence=true, lazyAlloc=false, [21:05:22] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB, allocTotal=0MB] [21:05:22] : [Step 4/5] ^-- volatileDsMemPlc region [type=user, persistence=false, lazyAlloc=true, [21:05:22] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB] [21:05:22] : [Step 4/5] ^-- Ignite persistence [used=0MB] [21:05:22] : [Step 4/5] [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,912][INFO ][exchange-worker-#10751%grid-6%][GridClusterStateProcessor] Writing BaselineTopology[id=0] [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,913][INFO ][exchange-worker-#10846%client1%][msg] Components activation performed in 11 ms. [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,919][INFO ][exchange-worker-#10628%grid-0%][GridCacheDatabaseSharedManager] Finish recovery performed in 29 ms. [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,925][INFO ][exchange-worker-#10628%grid-0%][msg] Components activation performed in 36 ms. [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,925][INFO ][exchange-worker-#10751%grid-6%][GridCacheDatabaseSharedManager] Finish recovery performed in 24 ms. [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,925][INFO ][exchange-worker-#10751%grid-6%][msg] Components activation performed in 29 ms. [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,928][INFO ][sys-#10955%client%][GridCacheProcessor] Started cache [name=encrypted, id=1613773252, dataRegionName=default, mode=PARTITIONED, atomicity=TRANSACTIONAL, backups=0, mvcc=false] [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,928][INFO ][exchange-worker-#10628%grid-0%][GridCacheProcessor] Finished recovery for cache [cache=encrypted, grp=encrypted, startVer=AffinityTopologyVersion [topVer=4, minorTopVer=1]] [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,928][INFO ][sys-#10601%grid-0%][GridCacheProcessor] Finished recovery for cache [cache=ignite-sys-cache, grp=ignite-sys-cache, startVer=AffinityTopologyVersion [topVer=4, minorTopVer=1]] [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,928][INFO ][sys-#10736%grid-6%][GridCacheProcessor] Finished recovery for cache [cache=ignite-sys-cache, grp=ignite-sys-cache, startVer=AffinityTopologyVersion [topVer=4, minorTopVer=1]] [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,928][INFO ][exchange-worker-#10751%grid-6%][GridCacheProcessor] Finished recovery for cache [cache=encrypted, grp=encrypted, startVer=AffinityTopologyVersion [topVer=4, minorTopVer=1]] [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,928][INFO ][exchange-worker-#10941%client%][GridCacheProcessor] Started cache [name=ignite-sys-cache, id=-2100569601, dataRegionName=sysMemPlc, mode=REPLICATED, atomicity=TRANSACTIONAL, backups=2147483647, mvcc=false] [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,930][INFO ][sys-#10958%client1%][GridCacheProcessor] Started cache [name=encrypted, id=1613773252, dataRegionName=default, mode=PARTITIONED, atomicity=TRANSACTIONAL, backups=0, mvcc=false] [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,930][INFO ][exchange-worker-#10846%client1%][GridCacheProcessor] Started cache [name=ignite-sys-cache, id=-2100569601, dataRegionName=sysMemPlc, mode=REPLICATED, atomicity=TRANSACTIONAL, backups=2147483647, mvcc=false] [21:05:22]W: [org.apache.ignite:ignite-core] [2021-11-19 21:05:22,931][WARN ][sys-#10613%grid-0%][CacheAffinitySharedManager] Cache group 'encrypted' brings high overhead for its metainformation in data region 'default'. Metainformation required for its partitions (525 partitions, 4096 bytes per partition, 2 MBs total) will consume more than 15% of data region memory (10 MBs). It may lead to critical errors on the node and cluster instability. Please reduce number of partitions, add more memory to the data region or add more server nodes for this cache group. [21:05:22]W: [org.apache.ignite:ignite-core] [2021-11-19 21:05:22,931][WARN ][exchange-worker-#10751%grid-6%][CacheAffinitySharedManager] Cache group 'encrypted' brings high overhead for its metainformation in data region 'default'. Metainformation required for its partitions (499 partitions, 4096 bytes per partition, 1 MBs total) will consume more than 15% of data region memory (10 MBs). It may lead to critical errors on the node and cluster instability. Please reduce number of partitions, add more memory to the data region or add more server nodes for this cache group. [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,932][INFO ][exchange-worker-#10628%grid-0%][GridDhtPartitionsExchangeFuture] Successfully activated caches [nodeId=00622f8d-e1fe-42dd-95f9-54f5fc364000, client=false, topVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], newState=ACTIVE] [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,933][INFO ][exchange-worker-#10751%grid-6%][GridDhtPartitionsExchangeFuture] Successfully activated caches [nodeId=60cf419a-9798-4b04-bea7-d09e78da3006, client=false, topVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], newState=ACTIVE] [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,934][INFO ][exchange-worker-#10846%client1%][GridDhtPartitionsExchangeFuture] Successfully activated caches [nodeId=109539ac-d8d7-4dcf-8b8a-e4ff21e9c001, client=true, topVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], newState=ACTIVE] [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,933][INFO ][exchange-worker-#10941%client%][GridDhtPartitionsExchangeFuture] Successfully activated caches [nodeId=1bac54b7-e378-44aa-9fdb-4d39cfa9e560, client=true, topVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], newState=ACTIVE] [21:05:22]W: [org.apache.ignite:ignite-core] [2021-11-19 21:05:22,934][WARN ][exchange-worker-#10751%grid-6%][CacheAffinitySharedManager] Cache group 'encrypted' brings high overhead for its metainformation in data region 'default'. Metainformation required for its partitions (499 partitions, 4096 bytes per partition, 1 MBs total) will consume more than 15% of data region memory (10 MBs). It may lead to critical errors on the node and cluster instability. Please reduce number of partitions, add more memory to the data region or add more server nodes for this cache group. [21:05:22]W: [org.apache.ignite:ignite-core] [2021-11-19 21:05:22,934][WARN ][sys-#10610%grid-0%][CacheAffinitySharedManager] Cache group 'encrypted' brings high overhead for its metainformation in data region 'default'. Metainformation required for its partitions (525 partitions, 4096 bytes per partition, 2 MBs total) will consume more than 15% of data region memory (10 MBs). It may lead to critical errors on the node and cluster instability. Please reduce number of partitions, add more memory to the data region or add more server nodes for this cache group. [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,936][INFO ][grid-nio-worker-tcp-comm-0-#10566%TcpCommunicationSpi%][TcpCommunicationSpi] Accepted incoming communication connection [locAddr=/127.0.0.1:45150, rmtAddr=/127.0.0.1:59878] [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,937][INFO ][exchange-worker-#10628%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,936][INFO ][exchange-worker-#10751%grid-6%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,940][INFO ][grid-nio-worker-tcp-comm-1-#10567%TcpCommunicationSpi%][TcpCommunicationSpi] Accepted incoming communication connection [locAddr=/127.0.0.1:45150, rmtAddr=/127.0.0.1:59880] [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,942][INFO ][grid-nio-worker-tcp-comm-0-#10808%TcpCommunicationSpi%][TcpCommunicationSpi] Established outgoing communication connection [locAddr=/127.0.0.1:59878, rmtAddr=/127.0.0.1:45150] [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,944][INFO ][grid-nio-worker-tcp-comm-0-#10903%TcpCommunicationSpi%][TcpCommunicationSpi] Established outgoing communication connection [locAddr=/127.0.0.1:59880, rmtAddr=/127.0.0.1:45150] [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,944][INFO ][exchange-worker-#10846%client1%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], crd=false] [21:05:22] : [Step 4/5] [2021-11-19 21:05:22,945][INFO ][exchange-worker-#10941%client%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], crd=false] [21:05:23] : [Step 4/5] [2021-11-19 21:05:23,002][INFO ][exchange-worker-#10628%grid-0%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], crd=true] [21:05:23] : [Step 4/5] [2021-11-19 21:05:23,014][INFO ][grid-nio-worker-tcp-comm-2-#10568%TcpCommunicationSpi%][TcpCommunicationSpi] Accepted incoming communication connection [locAddr=/127.0.0.1:45150, rmtAddr=/127.0.0.1:59882] [21:05:23] : [Step 4/5] [2021-11-19 21:05:23,017][INFO ][grid-nio-worker-tcp-comm-0-#10685%TcpCommunicationSpi%][TcpCommunicationSpi] Established outgoing communication connection [locAddr=/127.0.0.1:59882, rmtAddr=/127.0.0.1:45150] [21:05:23] : [Step 4/5] [2021-11-19 21:05:23,018][INFO ][exchange-worker-#10751%grid-6%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], crd=false] [21:05:23] : [Step 4/5] [2021-11-19 21:05:23,019][INFO ][sys-#10620%grid-0%][GridDhtPartitionsExchangeFuture] Coordinator received single message [ver=AffinityTopologyVersion [topVer=4, minorTopVer=1], node=60cf419a-9798-4b04-bea7-d09e78da3006, allReceived=true] [21:05:23] : [Step 4/5] [2021-11-19 21:05:23,020][INFO ][sys-#10620%grid-0%][GridDhtPartitionsExchangeFuture] finishExchangeOnCoordinator [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=1]] [21:05:23] : [Step 4/5] [2021-11-19 21:05:23,034][INFO ][sys-#10620%grid-0%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], err=null, rebalanced=true, wasRebalanced=false] [21:05:23] : [Step 4/5] [2021-11-19 21:05:23,035][INFO ][disco-notifier-worker-#10837%client1%][GridClusterStateProcessor] Received state change finish message: ACTIVE [21:05:23] : [Step 4/5] [2021-11-19 21:05:23,035][INFO ][disco-notifier-worker-#10932%client%][GridClusterStateProcessor] Received state change finish message: ACTIVE [21:05:23] : [Step 4/5] [2021-11-19 21:05:23,034][INFO ][disco-notifier-worker-#10742%grid-6%][GridClusterStateProcessor] Received state change finish message: ACTIVE [21:05:23] : [Step 4/5] [2021-11-19 21:05:23,105][INFO ][disco-notifier-worker-#10742%grid-6%][GridClusterStateProcessor] Cluster state was changed from INACTIVE to ACTIVE [21:05:23] : [Step 4/5] [2021-11-19 21:05:23,034][INFO ][sys-#10719%grid-6%][GridDhtPartitionsExchangeFuture] Received full message, will finish exchange [node=00622f8d-e1fe-42dd-95f9-54f5fc364000, resVer=AffinityTopologyVersion [topVer=4, minorTopVer=1]] [21:05:23] : [Step 4/5] [2021-11-19 21:05:23,034][INFO ][disco-notifier-worker-#10623%grid-0%][GridClusterStateProcessor] Received state change finish message: ACTIVE [21:05:23] : [Step 4/5] [2021-11-19 21:05:23,103][INFO ][disco-notifier-worker-#10932%client%][GridClusterStateProcessor] Cluster state was changed from INACTIVE to ACTIVE [21:05:23] : [Step 4/5] [2021-11-19 21:05:23,102][INFO ][disco-notifier-worker-#10837%client1%][GridClusterStateProcessor] Cluster state was changed from INACTIVE to ACTIVE [21:05:23] : [Step 4/5] [2021-11-19 21:05:23,106][INFO ][disco-notifier-worker-#10623%grid-0%][GridClusterStateProcessor] Cluster state was changed from INACTIVE to ACTIVE [21:05:23] : [Step 4/5] [2021-11-19 21:05:23,107][INFO ][sys-#10722%grid-6%][GridCachePartitionExchangeManager] Delay process full message without exchange id (there is exchange in progress) [nodeId=00622f8d-e1fe-42dd-95f9-54f5fc364000] [21:05:23] : [Step 4/5] [2021-11-19 21:05:23,110][INFO ][sys-#10719%grid-6%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], err=null, rebalanced=true, wasRebalanced=false] [21:05:23] : [Step 4/5] [2021-11-19 21:05:23,111][INFO ][sys-#10982%client1%][GridCachePartitionExchangeManager] Delay process full message without exchange id (there is exchange in progress) [nodeId=00622f8d-e1fe-42dd-95f9-54f5fc364000] [21:05:23] : [Step 4/5] [2021-11-19 21:05:23,111][INFO ][sys-#10620%grid-0%][GridCacheProcessor] Finish proxy initialization, cacheName=ignite-sys-cache, localNodeId=00622f8d-e1fe-42dd-95f9-54f5fc364000 [21:05:23] : [Step 4/5] [2021-11-19 21:05:23,110][INFO ][sys-#10981%client%][GridCachePartitionExchangeManager] Delay process full message without exchange id (there is exchange in progress) [nodeId=00622f8d-e1fe-42dd-95f9-54f5fc364000] [21:05:23] : [Step 4/5] [2021-11-19 21:05:23,114][INFO ][sys-#10620%grid-0%][GridCacheProcessor] Finish proxy initialization, cacheName=encrypted, localNodeId=00622f8d-e1fe-42dd-95f9-54f5fc364000 [21:05:23] : [Step 4/5] [2021-11-19 21:05:23,115][INFO ][sys-#10603%grid-0%][DistributedBaselineConfiguration] Baseline auto-adjust is 'disabled' with timeout='300000' ms [21:05:23] : [Step 4/5] [2021-11-19 21:05:23,115][INFO ][sys-#10603%grid-0%][GridClusterStateProcessor] Successfully performed final activation steps [nodeId=00622f8d-e1fe-42dd-95f9-54f5fc364000, client=false, topVer=AffinityTopologyVersion [topVer=4, minorTopVer=1]] [21:05:23] : [Step 4/5] [2021-11-19 21:05:23,115][INFO ][sys-#10620%grid-0%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=00622f8d-e1fe-42dd-95f9-54f5fc364000, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=00622f8d-e1fe-42dd-95f9-54f5fc364000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345123033, loc=true, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=4, minorTopVer=1]] [21:05:23] : [Step 4/5] [2021-11-19 21:05:23,117][INFO ][sys-#10719%grid-6%][GridCacheProcessor] Finish proxy initialization, cacheName=ignite-sys-cache, localNodeId=60cf419a-9798-4b04-bea7-d09e78da3006 [21:05:23] : [Step 4/5] [2021-11-19 21:05:23,117][INFO ][exchange-worker-#10628%grid-0%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=4, minorTopVer=1], force=false, evt=DISCOVERY_CUSTOM_EVT, node=00622f8d-e1fe-42dd-95f9-54f5fc364000] [21:05:23] : [Step 4/5] [2021-11-19 21:05:23,118][INFO ][sys-#10719%grid-6%][GridCacheProcessor] Finish proxy initialization, cacheName=encrypted, localNodeId=60cf419a-9798-4b04-bea7-d09e78da3006 [21:05:23] : [Step 4/5] [2021-11-19 21:05:23,118][INFO ][sys-#10985%client1%][GridDhtPartitionsExchangeFuture] Received full message, will finish exchange [node=00622f8d-e1fe-42dd-95f9-54f5fc364000, resVer=AffinityTopologyVersion [topVer=4, minorTopVer=1]] [21:05:23] : [Step 4/5] [2021-11-19 21:05:23,118][INFO ][sys-#10620%grid-0%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (1 ms), stage="Update caches registry" (40 ms), stage="Start caches" (1 ms), stage="Affinity initialization on cache group start" (3 ms), stage="Determine exchange type" (4 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (2 ms), stage="Restore partition states" (0 ms), stage="After states restored callback" (61 ms), stage="WAL history reservation" (0 ms), stage="Waiting for all single messages" (18 ms), stage="Affinity recalculation (crd)" (0 ms), stage="Collect update counters and create affinity messages" (0 ms), stage="Assign partitions states" (3 ms), stage="Validate partitions states" (0 ms), stage="Ideal affinity diff calculation (enforced)" (3 ms), stage="Apply update counters" (0 ms), stage="Full message preparing" (4 ms), stage="Full message sending" (0 ms), stage="State finish message sending" (1 ms), stage="Detect lost partitions" (72 ms), stage="Exchange done" (11 ms), stage="Total time" (224 ms), Discovery lag=5 ms, Latest started node id=60cf419a-9798-4b04-bea7-d09e78da3006] [21:05:23] : [Step 4/5] [2021-11-19 21:05:23,126][INFO ][sys-#10620%grid-0%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], stage="Affinity initialization on cache group start [grp=encrypted]" (1 ms) (parent=Affinity initialization on cache group start), stage="Affinity initialization on cache group start [grp=ignite-sys-cache]" (0 ms) (parent=Affinity initialization on cache group start), stage="Affinity centralized initialization (crd) [grp=ignite-sys-cache, crd=true]" (1 ms) (parent=Determine exchange type), stage="Affinity centralized initialization (crd) [grp=encrypted, crd=true]" (1 ms) (parent=Determine exchange type), stage="Restore partition states [grp=ignite-sys-cache]" (0 ms) (parent=Restore partition states), stage="Restore partition states [grp=encrypted]" (0 ms) (parent=Restore partition states), stage="Affinity recalculation (partitions availability) [grp=encrypted]" (2 ms) (parent=Ideal affinity diff calculation (enforced)), stage="Affinity recalculation (partitions availability) [grp=ignite-sys-cache]" (0 ms) (parent=Ideal affinity diff calculation (enforced))] [21:05:23] : [Step 4/5] [2021-11-19 21:05:23,123][INFO ][sys-#10986%client%][GridDhtPartitionsExchangeFuture] Received full message, will finish exchange [node=00622f8d-e1fe-42dd-95f9-54f5fc364000, resVer=AffinityTopologyVersion [topVer=4, minorTopVer=1]] [21:05:23] : [Step 4/5] [2021-11-19 21:05:23,122][INFO ][exchange-worker-#10751%grid-6%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=4, minorTopVer=1], force=false, evt=DISCOVERY_CUSTOM_EVT, node=00622f8d-e1fe-42dd-95f9-54f5fc364000] [21:05:23] : [Step 4/5] [2021-11-19 21:05:23,122][INFO ][sys-#10719%grid-6%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=60cf419a-9798-4b04-bea7-d09e78da3006, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=00622f8d-e1fe-42dd-95f9-54f5fc364000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345122592, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=4, minorTopVer=1]] [21:05:23] : [Step 4/5] [2021-11-19 21:05:23,119][INFO ][sys-#10734%grid-6%][DistributedBaselineConfiguration] Baseline auto-adjust is 'disabled' with timeout='300000' ms [21:05:23] : [Step 4/5] [2021-11-19 21:05:23,134][INFO ][sys-#10734%grid-6%][GridClusterStateProcessor] Successfully performed final activation steps [nodeId=60cf419a-9798-4b04-bea7-d09e78da3006, client=false, topVer=AffinityTopologyVersion [topVer=4, minorTopVer=1]] [21:05:23] : [Step 4/5] [2021-11-19 21:05:23,134][INFO ][sys-#10985%client1%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], err=null, rebalanced=true, wasRebalanced=false] [21:05:23] : [Step 4/5] [2021-11-19 21:05:23,134][INFO ][sys-#10719%grid-6%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (4 ms), stage="Update caches registry" (31 ms), stage="Start caches" (3 ms), stage="Affinity initialization on cache group start" (3 ms), stage="Determine exchange type" (2 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (3 ms), stage="Restore partition states" (0 ms), stage="After states restored callback" (70 ms), stage="WAL history reservation" (0 ms), stage="Waiting for Full message" (23 ms), stage="Affinity recalculation" (72 ms), stage="Full map updating" (4 ms), stage="Detect lost partitions" (4 ms), stage="Exchange done" (18 ms), stage="Total time" (237 ms)] [21:05:23] : [Step 4/5] [2021-11-19 21:05:23,139][INFO ][sys-#10719%grid-6%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], stage="Affinity initialization on cache group start [grp=encrypted]" (1 ms) (parent=Affinity initialization on cache group start), stage="Affinity initialization on cache group start [grp=ignite-sys-cache]" (0 ms) (parent=Affinity initialization on cache group start), stage="Affinity centralized initialization (crd) [grp=ignite-sys-cache, crd=false]" (1 ms) (parent=Determine exchange type), stage="Affinity centralized initialization (crd) [grp=encrypted, crd=false]" (1 ms) (parent=Determine exchange type), stage="Restore partition states [grp=ignite-sys-cache]" (0 ms) (parent=Restore partition states), stage="Restore partition states [grp=encrypted]" (0 ms) (parent=Restore partition states), stage="Affinity applying from full message [grp=encrypted]" (72 ms) (parent=Affinity recalculation), stage="Affinity applying from full message [grp=ignite-sys-cache]" (71 ms) (parent=Affinity recalculation)] [21:05:23] : [Step 4/5] [2021-11-19 21:05:23,137][INFO ][sys-#10986%client%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], err=null, rebalanced=true, wasRebalanced=false] [21:05:23] : [Step 4/5] [2021-11-19 21:05:23,139][INFO ][sys-#10985%client1%][GridCacheProcessor] Finish proxy initialization, cacheName=ignite-sys-cache, localNodeId=109539ac-d8d7-4dcf-8b8a-e4ff21e9c001 [21:05:23] : [Step 4/5] [2021-11-19 21:05:23,141][INFO ][sys-#10985%client1%][GridCacheProcessor] Finish proxy initialization, cacheName=encrypted, localNodeId=109539ac-d8d7-4dcf-8b8a-e4ff21e9c001 [21:05:23] : [Step 4/5] [2021-11-19 21:05:23,143][INFO ][sys-#11007%client1%][DistributedBaselineConfiguration] Baseline auto-adjust is 'disabled' with timeout='300000' ms [21:05:23] : [Step 4/5] [2021-11-19 21:05:23,144][INFO ][sys-#10986%client%][GridCacheProcessor] Finish proxy initialization, cacheName=ignite-sys-cache, localNodeId=1bac54b7-e378-44aa-9fdb-4d39cfa9e560 [21:05:23] : [Step 4/5] [2021-11-19 21:05:23,144][INFO ][sys-#11007%client1%][GridClusterStateProcessor] Successfully performed final activation steps [nodeId=109539ac-d8d7-4dcf-8b8a-e4ff21e9c001, client=true, topVer=AffinityTopologyVersion [topVer=4, minorTopVer=1]] [21:05:23] : [Step 4/5] [2021-11-19 21:05:23,144][INFO ][sys-#10985%client1%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=109539ac-d8d7-4dcf-8b8a-e4ff21e9c001, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=00622f8d-e1fe-42dd-95f9-54f5fc364000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345122734, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=4, minorTopVer=1]] [21:05:23] : [Step 4/5] [2021-11-19 21:05:23,145][INFO ][sys-#10985%client1%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (6 ms), stage="Update caches registry" (17 ms), stage="Start caches" (17 ms), stage="Affinity initialization on cache group start" (2 ms), stage="Determine exchange type" (1 ms), stage="Waiting for Full message" (182 ms), stage="Affinity recalculation" (5 ms), stage="Full map updating" (10 ms), stage="Detect lost partitions" (3 ms), stage="Exchange done" (7 ms), stage="Total time" (250 ms)] [21:05:23] : [Step 4/5] [2021-11-19 21:05:23,144][INFO ][exchange-worker-#10846%client1%][GridCachePartitionExchangeManager] AffinityTopologyVersion [topVer=4, minorTopVer=1], evt=DISCOVERY_CUSTOM_EVT, evtNode=00622f8d-e1fe-42dd-95f9-54f5fc364000, client=true] [21:05:23] : [Step 4/5] [2021-11-19 21:05:23,144][INFO ][sys-#10986%client%][GridCacheProcessor] Finish proxy initialization, cacheName=encrypted, localNodeId=1bac54b7-e378-44aa-9fdb-4d39cfa9e560 [21:05:23] : [Step 4/5] [2021-11-19 21:05:23,146][INFO ][sys-#10985%client1%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], stage="Affinity initialization on cache group start [grp=encrypted]" (2 ms) (parent=Affinity initialization on cache group start), stage="Affinity initialization on cache group start [grp=ignite-sys-cache]" (0 ms) (parent=Affinity initialization on cache group start), stage="Affinity centralized initialization (crd) [grp=ignite-sys-cache, crd=false]" (1 ms) (parent=Determine exchange type), stage="Affinity centralized initialization (crd) [grp=encrypted, crd=false]" (1 ms) (parent=Determine exchange type), stage="Affinity applying from full message [grp=encrypted]" (5 ms) (parent=Affinity recalculation), stage="Affinity applying from full message [grp=ignite-sys-cache]" (4 ms) (parent=Affinity recalculation)] [21:05:23] : [Step 4/5] [2021-11-19 21:05:23,149][INFO ][exchange-worker-#10941%client%][GridCachePartitionExchangeManager] AffinityTopologyVersion [topVer=4, minorTopVer=1], evt=DISCOVERY_CUSTOM_EVT, evtNode=00622f8d-e1fe-42dd-95f9-54f5fc364000, client=true] [21:05:23] : [Step 4/5] [2021-11-19 21:05:23,149][INFO ][sys-#11009%client%][DistributedBaselineConfiguration] Baseline auto-adjust is 'disabled' with timeout='300000' ms [21:05:23] : [Step 4/5] [2021-11-19 21:05:23,150][INFO ][sys-#10986%client%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=1bac54b7-e378-44aa-9fdb-4d39cfa9e560, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=00622f8d-e1fe-42dd-95f9-54f5fc364000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345122846, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=4, minorTopVer=1]] [21:05:23] : [Step 4/5] [2021-11-19 21:05:23,150][INFO ][sys-#11009%client%][GridClusterStateProcessor] Successfully performed final activation steps [nodeId=1bac54b7-e378-44aa-9fdb-4d39cfa9e560, client=true, topVer=AffinityTopologyVersion [topVer=4, minorTopVer=1]] [21:05:23] : [Step 4/5] [2021-11-19 21:05:23,152][INFO ][sys-#10986%client%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (3 ms), stage="Update caches registry" (18 ms), stage="Start caches" (18 ms), stage="Affinity initialization on cache group start" (3 ms), stage="Determine exchange type" (2 ms), stage="Waiting for Full message" (186 ms), stage="Affinity recalculation" (9 ms), stage="Full map updating" (3 ms), stage="Detect lost partitions" (6 ms), stage="Exchange done" (8 ms), stage="Total time" (256 ms)] [21:05:23] : [Step 4/5] [2021-11-19 21:05:23,153][INFO ][sys-#10986%client%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], stage="Affinity initialization on cache group start [grp=encrypted]" (2 ms) (parent=Affinity initialization on cache group start), stage="Affinity initialization on cache group start [grp=ignite-sys-cache]" (0 ms) (parent=Affinity initialization on cache group start), stage="Affinity centralized initialization (crd) [grp=encrypted, crd=false]" (2 ms) (parent=Determine exchange type), stage="Affinity centralized initialization (crd) [grp=ignite-sys-cache, crd=false]" (1 ms) (parent=Determine exchange type), stage="Affinity applying from full message [grp=encrypted]" (9 ms) (parent=Affinity recalculation), stage="Affinity applying from full message [grp=ignite-sys-cache]" (7 ms) (parent=Affinity recalculation)] [21:05:23] : [Step 4/5] [2021-11-19 21:05:23,171][INFO ][test-runner-#10511%encryption.EncryptedCacheNodeJoinTest%][root] awaitPartitionMapExchange finished [21:05:23] : [Step 4/5] [2021-11-19 21:05:23,717][INFO ][db-checkpoint-thread-#10970%grid-0%][Checkpointer] Checkpoint started [checkpointId=be8b8777-1232-40e9-9572-0dfff3243941, startPtr=WALPointer [idx=0, fileOff=167910, len=11944], checkpointBeforeLockTime=3ms, checkpointLockWait=9ms, checkpointListenersExecuteTime=1ms, checkpointLockHoldTime=2ms, walCpRecordFsyncDuration=6ms, writeCheckpointEntryDuration=709ms, splitAndSortCpPagesDuration=0ms, pages=24, reason='node started'] [21:05:23] : [Step 4/5] [2021-11-19 21:05:23,717][INFO ][db-checkpoint-thread-#10975%grid-6%][Checkpointer] Checkpoint started [checkpointId=0dbc8c0e-2936-480a-9719-54ec9badfd24, startPtr=WALPointer [idx=0, fileOff=161893, len=11450], checkpointBeforeLockTime=3ms, checkpointLockWait=14ms, checkpointListenersExecuteTime=1ms, checkpointLockHoldTime=3ms, walCpRecordFsyncDuration=7ms, writeCheckpointEntryDuration=700ms, splitAndSortCpPagesDuration=0ms, pages=24, reason='node started'] [21:05:23] : [Step 4/5] [2021-11-19 21:05:23,780][INFO ][db-checkpoint-thread-#10975%grid-6%][Checkpointer] Checkpoint finished [cpId=0dbc8c0e-2936-480a-9719-54ec9badfd24, pages=24, markPos=WALPointer [idx=0, fileOff=161893, len=11450], walSegmentsCovered=[], markDuration=712ms, pagesWrite=1ms, fsync=60ms, total=790ms] [21:05:23] : [Step 4/5] [2021-11-19 21:05:23,780][INFO ][db-checkpoint-thread-#10970%grid-0%][Checkpointer] Checkpoint finished [cpId=be8b8777-1232-40e9-9572-0dfff3243941, pages=24, markPos=WALPointer [idx=0, fileOff=167910, len=11944], walSegmentsCovered=[], markDuration=719ms, pagesWrite=1ms, fsync=61ms, total=793ms] [21:05:23] : [Step 4/5] [2021-11-19 21:05:23,809][INFO ][grid-nio-worker-tcp-comm-1-#10686%TcpCommunicationSpi%][TcpCommunicationSpi] Accepted incoming communication connection [locAddr=/127.0.0.1:45151, rmtAddr=/127.0.0.1:33126] [21:05:23] : [Step 4/5] [2021-11-19 21:05:23,814][INFO ][grid-nio-worker-tcp-comm-1-#10904%TcpCommunicationSpi%][TcpCommunicationSpi] Established outgoing communication connection [locAddr=/127.0.0.1:33126, rmtAddr=/127.0.0.1:45151] [21:05:28] : [Step 4/5] [2021-11-19 21:05:28,661][INFO ][grid-nio-worker-tcp-comm-2-#10687%TcpCommunicationSpi%][TcpCommunicationSpi] Accepted incoming communication connection [locAddr=/127.0.0.1:45151, rmtAddr=/127.0.0.1:33154] [21:05:28] : [Step 4/5] [2021-11-19 21:05:28,664][INFO ][grid-nio-worker-tcp-comm-1-#10809%TcpCommunicationSpi%][TcpCommunicationSpi] Established outgoing communication connection [locAddr=/127.0.0.1:33154, rmtAddr=/127.0.0.1:45151] [21:05:28] : [Step 4/5] [21:05:28] >>> Stopping test: EncryptedCacheNodeJoinTest#testClientNodeJoinInactiveClusterWithExistingStaticCacheConfig in 8784 ms <<< [21:05:28] : [Step 4/5] [2021-11-19 21:05:28,764][INFO ][main][root] >>> Stopping test: EncryptedCacheNodeJoinTest#testClientNodeJoinInactiveClusterWithExistingStaticCacheConfig in 8784 ms <<< [21:05:28] : [Step 4/5] [21:05:28] >>> Heap: 683 MB used / 1913 MB commited / 1913 MB max <<< [21:05:28] : [Step 4/5] [2021-11-19 21:05:28,764][INFO ][main][root] >>> Heap: 683 MB used / 1913 MB commited / 1913 MB max <<< [21:05:28] : [Step 4/5] [21:05:28] >>> Non-Heap: 145 MB used / 158 MB commited / 0 MB max <<< [21:05:28] : [Step 4/5] [2021-11-19 21:05:28,765][INFO ][main][root] >>> Non-Heap: 145 MB used / 158 MB commited / 0 MB max <<< [21:05:28] : [Step 4/5] [2021-11-19 21:05:28,765][INFO ][main][root] >>> Stopping grid [name=client, id=1bac54b7-e378-44aa-9fdb-4d39cfa9e560] [21:05:28] : [Step 4/5] [2021-11-19 21:05:28,778][INFO ][disco-event-worker-#10627%grid-0%][GridDiscoveryManager] Node left topology: TcpDiscoveryNode [id=1bac54b7-e378-44aa-9fdb-4d39cfa9e560, consistentId=client, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:0], discPort=0, order=4, intOrder=4, lastExchangeTime=1637345122835, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=true] [21:05:28] : [Step 4/5] [2021-11-19 21:05:28,785][INFO ][disco-event-worker-#10845%client1%][GridDiscoveryManager] Node left topology: TcpDiscoveryNode [id=1bac54b7-e378-44aa-9fdb-4d39cfa9e560, consistentId=client, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:0], discPort=0, order=4, intOrder=4, lastExchangeTime=1637345122846, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=true] [21:05:28] : [Step 4/5] [2021-11-19 21:05:28,787][INFO ][disco-event-worker-#10627%grid-0%][GridDiscoveryManager] Topology snapshot [ver=5, locNode=00622f8d, servers=2, clients=1, state=ACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=00622f8d-e1fe-42dd-95f9-54f5fc364000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=60cf419a-9798-4b04-bea7-d09e78da3006, consistentId=grid-6, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=109539ac-d8d7-4dcf-8b8a-e4ff21e9c001, consistentId=client1, isClient=true, ver=2.13.0#20211119-sha1:00000000]]] [21:05:28] : [Step 4/5] [2021-11-19 21:05:28,786][INFO ][main][GridCacheProcessor] Stopped cache [cacheName=encrypted] [21:05:28] : [Step 4/5] [2021-11-19 21:05:28,781][INFO ][disco-event-worker-#10750%grid-6%][GridDiscoveryManager] Node left topology: TcpDiscoveryNode [id=1bac54b7-e378-44aa-9fdb-4d39cfa9e560, consistentId=client, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:0], discPort=0, order=4, intOrder=4, lastExchangeTime=1637345122835, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=true] [21:05:28] : [Step 4/5] [2021-11-19 21:05:28,781][INFO ][tcp-disco-sock-reader-[1bac54b7 127.0.0.1:40979 client]-#576%grid-0%-#10937%grid-0%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:40979, rmtPort=40979, rmtNodeId=1bac54b7-e378-44aa-9fdb-4d39cfa9e560] [21:05:28] : [Step 4/5] [2021-11-19 21:05:28,790][INFO ][disco-event-worker-#10750%grid-6%][GridDiscoveryManager] Topology snapshot [ver=5, locNode=60cf419a, servers=2, clients=1, state=ACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=00622f8d-e1fe-42dd-95f9-54f5fc364000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=60cf419a-9798-4b04-bea7-d09e78da3006, consistentId=grid-6, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=109539ac-d8d7-4dcf-8b8a-e4ff21e9c001, consistentId=client1, isClient=true, ver=2.13.0#20211119-sha1:00000000]]] [21:05:28] : [Step 4/5] [2021-11-19 21:05:28,789][INFO ][main][GridCacheProcessor] Stopped cache [cacheName=ignite-sys-cache] [21:05:28] : [Step 4/5] [2021-11-19 21:05:28,788][INFO ][disco-event-worker-#10627%grid-0%][GridDiscoveryManager] ^-- Baseline [id=0, size=2, online=2, offline=0] [21:05:28] : [Step 4/5] [2021-11-19 21:05:28,787][INFO ][disco-event-worker-#10845%client1%][GridDiscoveryManager] Topology snapshot [ver=5, locNode=109539ac, servers=2, clients=1, state=ACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=109539ac-d8d7-4dcf-8b8a-e4ff21e9c001, consistentId=client1, isClient=true, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=00622f8d-e1fe-42dd-95f9-54f5fc364000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=60cf419a-9798-4b04-bea7-d09e78da3006, consistentId=grid-6, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:05:28] : [Step 4/5] [2021-11-19 21:05:28,797][INFO ][main][GridDeploymentLocalStore] Removed undeployed class: GridDeployment [ts=1637345123103, depMode=SHARED, clsLdr=IsolatedClassLoader{roleName='test'}, clsLdrId=0453d593d71-1bac54b7-e378-44aa-9fdb-4d39cfa9e560, userVer=0, loc=true, sampleClsName=org.apache.ignite.internal.processors.cache.distributed.dht.preloader.GridDhtPartitionFullMap, pendingUndeploy=false, undeployed=true, usage=0] [21:05:28]W: [org.apache.ignite:ignite-core] [2021-11-19 21:05:28,797][WARN ][grid-nio-worker-tcp-comm-1-#10567%TcpCommunicationSpi%][TcpCommunicationSpi] Failed to shutdown socket [21:05:28]W: [org.apache.ignite:ignite-core] java.nio.channels.ClosedChannelException [21:05:28]W: [org.apache.ignite:ignite-core] at sun.nio.ch.SocketChannelImpl.shutdownOutput(SocketChannelImpl.java:795) [21:05:28]W: [org.apache.ignite:ignite-core] at sun.nio.ch.SocketAdaptor.shutdownOutput(SocketAdaptor.java:407) [21:05:28]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.close(IgniteUtils.java:4247) [21:05:28]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.closeKey(GridNioServer.java:2784) [21:05:28]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.close(GridNioServer.java:2835) [21:05:28]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.close(GridNioServer.java:2794) [21:05:28]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.bodyInternal(GridNioServer.java:2157) [21:05:28]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.body(GridNioServer.java:1910) [21:05:28] : [Step 4/5] [2021-11-19 21:05:28,791][INFO ][disco-event-worker-#10750%grid-6%][GridDiscoveryManager] ^-- Baseline [id=0, size=2, online=2, offline=0] [21:05:28]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:125) [21:05:28]W: [org.apache.ignite:ignite-core] at java.lang.Thread.run(Thread.java:748) [21:05:28] : [Step 4/5] [2021-11-19 21:05:28,797][INFO ][exchange-worker-#10628%grid-0%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], crd=true, evt=NODE_LEFT, evtNode=1bac54b7-e378-44aa-9fdb-4d39cfa9e560, customEvt=null, allowMerge=true, exchangeFreeSwitch=false] [21:05:28] : [Step 4/5] [2021-11-19 21:05:28,797][INFO ][disco-event-worker-#10845%client1%][GridDiscoveryManager] ^-- Baseline [id=0, size=2, online=2, offline=0] [21:05:28] : [Step 4/5] [2021-11-19 21:05:28,807][INFO ][exchange-worker-#10628%grid-0%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], err=null, rebalanced=true, wasRebalanced=true] [21:05:28] : [Step 4/5] [2021-11-19 21:05:28,811][INFO ][exchange-worker-#10751%grid-6%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], crd=false, evt=NODE_LEFT, evtNode=1bac54b7-e378-44aa-9fdb-4d39cfa9e560, customEvt=null, allowMerge=true, exchangeFreeSwitch=false] [21:05:28] : [Step 4/5] [2021-11-19 21:05:28,811][INFO ][exchange-worker-#10846%client1%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], crd=false, evt=NODE_LEFT, evtNode=1bac54b7-e378-44aa-9fdb-4d39cfa9e560, customEvt=null, allowMerge=true, exchangeFreeSwitch=false] [21:05:28] : [Step 4/5] [2021-11-19 21:05:28,812][INFO ][exchange-worker-#10751%grid-6%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], err=null, rebalanced=true, wasRebalanced=true] [21:05:28] : [Step 4/5] [2021-11-19 21:05:28,813][INFO ][exchange-worker-#10846%client1%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], err=null, rebalanced=true, wasRebalanced=true] [21:05:28] : [Step 4/5] [2021-11-19 21:05:28,814][INFO ][exchange-worker-#10628%grid-0%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=00622f8d-e1fe-42dd-95f9-54f5fc364000, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], evt=NODE_LEFT, evtNode=TcpDiscoveryNode [id=1bac54b7-e378-44aa-9fdb-4d39cfa9e560, consistentId=client, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:0], discPort=0, order=4, intOrder=4, lastExchangeTime=1637345122835, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=true], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=5, minorTopVer=0]] [21:05:28] : [Step 4/5] [2021-11-19 21:05:28,813][INFO ][main][IgniteKernal%client] [21:05:28] : [Step 4/5] [21:05:28] : [Step 4/5] >>> +------------------------------------------------------+ [21:05:28] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV stopped OK [21:05:28] : [Step 4/5] >>> +------------------------------------------------------+ [21:05:28] : [Step 4/5] >>> Ignite instance name: client [21:05:28] : [Step 4/5] >>> Grid uptime: 00:00:05.944 [21:05:28] : [Step 4/5] [21:05:28] : [Step 4/5] [21:05:28] : [Step 4/5] [2021-11-19 21:05:28,815][INFO ][exchange-worker-#10628%grid-0%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (8 ms), stage="Determine exchange type" (0 ms), stage="Exchange done" (8 ms), stage="Total time" (16 ms)] [21:05:28] : [Step 4/5] [2021-11-19 21:05:28,814][INFO ][exchange-worker-#10846%client1%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=109539ac-d8d7-4dcf-8b8a-e4ff21e9c001, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], evt=NODE_LEFT, evtNode=TcpDiscoveryNode [id=1bac54b7-e378-44aa-9fdb-4d39cfa9e560, consistentId=client, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:0], discPort=0, order=4, intOrder=4, lastExchangeTime=1637345122846, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=true], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=5, minorTopVer=0]] [21:05:28] : [Step 4/5] [2021-11-19 21:05:28,814][INFO ][exchange-worker-#10751%grid-6%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=60cf419a-9798-4b04-bea7-d09e78da3006, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], evt=NODE_LEFT, evtNode=TcpDiscoveryNode [id=1bac54b7-e378-44aa-9fdb-4d39cfa9e560, consistentId=client, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:0], discPort=0, order=4, intOrder=4, lastExchangeTime=1637345122835, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=true], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=5, minorTopVer=0]] [21:05:28] : [Step 4/5] [2021-11-19 21:05:28,817][INFO ][exchange-worker-#10846%client1%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], stage="Waiting in exchange queue" (2 ms), stage="Exchange parameters initialization" (1 ms), stage="Determine exchange type" (0 ms), stage="Exchange done" (4 ms), stage="Total time" (7 ms)] [21:05:28] : [Step 4/5] [2021-11-19 21:05:28,818][INFO ][exchange-worker-#10846%client1%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=5, minorTopVer=0]] [21:05:28] : [Step 4/5] [2021-11-19 21:05:28,816][INFO ][exchange-worker-#10628%grid-0%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=5, minorTopVer=0]] [21:05:28] : [Step 4/5] [2021-11-19 21:05:28,815][INFO ][main][root] >>> Stopping grid [name=client1, id=109539ac-d8d7-4dcf-8b8a-e4ff21e9c001] [21:05:28] : [Step 4/5] [2021-11-19 21:05:28,819][INFO ][exchange-worker-#10628%grid-0%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], crd=true] [21:05:28] : [Step 4/5] [2021-11-19 21:05:28,819][INFO ][exchange-worker-#10846%client1%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], crd=false] [21:05:28] : [Step 4/5] [2021-11-19 21:05:28,818][INFO ][exchange-worker-#10751%grid-6%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], stage="Waiting in exchange queue" (3 ms), stage="Exchange parameters initialization" (0 ms), stage="Determine exchange type" (0 ms), stage="Exchange done" (6 ms), stage="Total time" (9 ms)] [21:05:28] : [Step 4/5] [2021-11-19 21:05:28,823][INFO ][exchange-worker-#10846%client1%][GridCachePartitionExchangeManager] AffinityTopologyVersion [topVer=5, minorTopVer=0], evt=NODE_LEFT, evtNode=1bac54b7-e378-44aa-9fdb-4d39cfa9e560, client=true] [21:05:28] : [Step 4/5] [2021-11-19 21:05:28,823][INFO ][exchange-worker-#10628%grid-0%][GridCachePartitionExchangeManager] AffinityTopologyVersion [topVer=5, minorTopVer=0], evt=NODE_LEFT, evtNode=1bac54b7-e378-44aa-9fdb-4d39cfa9e560, client=false] [21:05:28] : [Step 4/5] [2021-11-19 21:05:28,825][INFO ][exchange-worker-#10751%grid-6%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=5, minorTopVer=0]] [21:05:28] : [Step 4/5] [2021-11-19 21:05:28,831][INFO ][exchange-worker-#10751%grid-6%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], crd=false] [21:05:28] : [Step 4/5] [2021-11-19 21:05:28,831][INFO ][exchange-worker-#10751%grid-6%][GridCachePartitionExchangeManager] AffinityTopologyVersion [topVer=5, minorTopVer=0], evt=NODE_LEFT, evtNode=1bac54b7-e378-44aa-9fdb-4d39cfa9e560, client=false] [21:05:28] : [Step 4/5] [2021-11-19 21:05:28,933][INFO ][disco-event-worker-#10627%grid-0%][GridDiscoveryManager] Node left topology: TcpDiscoveryNode [id=109539ac-d8d7-4dcf-8b8a-e4ff21e9c001, consistentId=client1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:0], discPort=0, order=3, intOrder=3, lastExchangeTime=1637345122724, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=true] [21:05:28] : [Step 4/5] [2021-11-19 21:05:28,934][INFO ][disco-event-worker-#10750%grid-6%][GridDiscoveryManager] Node left topology: TcpDiscoveryNode [id=109539ac-d8d7-4dcf-8b8a-e4ff21e9c001, consistentId=client1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:0], discPort=0, order=3, intOrder=3, lastExchangeTime=1637345122734, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=true] [21:05:28] : [Step 4/5] [2021-11-19 21:05:28,936][INFO ][tcp-disco-sock-reader-[109539ac 127.0.0.1:50377 client]-#569%grid-6%-#10842%grid-6%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:50377, rmtPort=50377, rmtNodeId=109539ac-d8d7-4dcf-8b8a-e4ff21e9c001] [21:05:28] : [Step 4/5] [2021-11-19 21:05:28,934][INFO ][disco-event-worker-#10627%grid-0%][GridDiscoveryManager] Topology snapshot [ver=6, locNode=00622f8d, servers=2, clients=0, state=ACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=00622f8d-e1fe-42dd-95f9-54f5fc364000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=60cf419a-9798-4b04-bea7-d09e78da3006, consistentId=grid-6, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:05:28] : [Step 4/5] [2021-11-19 21:05:28,939][INFO ][main][GridCacheProcessor] Stopped cache [cacheName=encrypted] [21:05:28] : [Step 4/5] [2021-11-19 21:05:28,939][INFO ][disco-event-worker-#10750%grid-6%][GridDiscoveryManager] Topology snapshot [ver=6, locNode=60cf419a, servers=2, clients=0, state=ACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=00622f8d-e1fe-42dd-95f9-54f5fc364000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=60cf419a-9798-4b04-bea7-d09e78da3006, consistentId=grid-6, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:05:28] : [Step 4/5] [2021-11-19 21:05:28,942][INFO ][main][GridCacheProcessor] Stopped cache [cacheName=ignite-sys-cache] [21:05:28] : [Step 4/5] [2021-11-19 21:05:28,941][INFO ][disco-event-worker-#10627%grid-0%][GridDiscoveryManager] ^-- Baseline [id=0, size=2, online=2, offline=0] [21:05:28] : [Step 4/5] [2021-11-19 21:05:28,943][INFO ][disco-event-worker-#10750%grid-6%][GridDiscoveryManager] ^-- Baseline [id=0, size=2, online=2, offline=0] [21:05:28] : [Step 4/5] [2021-11-19 21:05:28,946][INFO ][main][GridDeploymentLocalStore] Removed undeployed class: GridDeployment [ts=1637345123103, depMode=SHARED, clsLdr=IsolatedClassLoader{roleName='test'}, clsLdrId=2453d593d71-109539ac-d8d7-4dcf-8b8a-e4ff21e9c001, userVer=0, loc=true, sampleClsName=org.apache.ignite.internal.processors.cache.distributed.dht.preloader.GridDhtPartitionFullMap, pendingUndeploy=false, undeployed=true, usage=0] [21:05:28] : [Step 4/5] [2021-11-19 21:05:28,947][INFO ][exchange-worker-#10628%grid-0%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=6, minorTopVer=0], crd=true, evt=NODE_LEFT, evtNode=109539ac-d8d7-4dcf-8b8a-e4ff21e9c001, customEvt=null, allowMerge=true, exchangeFreeSwitch=false] [21:05:28] : [Step 4/5] [2021-11-19 21:05:28,947][INFO ][exchange-worker-#10751%grid-6%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=6, minorTopVer=0], crd=false, evt=NODE_LEFT, evtNode=109539ac-d8d7-4dcf-8b8a-e4ff21e9c001, customEvt=null, allowMerge=true, exchangeFreeSwitch=false] [21:05:28] : [Step 4/5] [2021-11-19 21:05:28,951][INFO ][exchange-worker-#10628%grid-0%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=6, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=6, minorTopVer=0], err=null, rebalanced=true, wasRebalanced=true] [21:05:28] : [Step 4/5] [2021-11-19 21:05:28,951][INFO ][exchange-worker-#10751%grid-6%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=6, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=6, minorTopVer=0], err=null, rebalanced=true, wasRebalanced=true] [21:05:28] : [Step 4/5] [2021-11-19 21:05:28,953][INFO ][exchange-worker-#10628%grid-0%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=00622f8d-e1fe-42dd-95f9-54f5fc364000, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=6, minorTopVer=0], evt=NODE_LEFT, evtNode=TcpDiscoveryNode [id=109539ac-d8d7-4dcf-8b8a-e4ff21e9c001, consistentId=client1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:0], discPort=0, order=3, intOrder=3, lastExchangeTime=1637345122724, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=true], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=6, minorTopVer=0]] [21:05:28] : [Step 4/5] [2021-11-19 21:05:28,954][INFO ][exchange-worker-#10751%grid-6%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=60cf419a-9798-4b04-bea7-d09e78da3006, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=6, minorTopVer=0], evt=NODE_LEFT, evtNode=TcpDiscoveryNode [id=109539ac-d8d7-4dcf-8b8a-e4ff21e9c001, consistentId=client1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:0], discPort=0, order=3, intOrder=3, lastExchangeTime=1637345122734, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=true], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=6, minorTopVer=0]] [21:05:28] : [Step 4/5] [2021-11-19 21:05:28,955][INFO ][exchange-worker-#10628%grid-0%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=6, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=6, minorTopVer=0], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (1 ms), stage="Determine exchange type" (2 ms), stage="Exchange done" (3 ms), stage="Total time" (6 ms)] [21:05:28] : [Step 4/5] [2021-11-19 21:05:28,956][INFO ][exchange-worker-#10751%grid-6%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=6, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=6, minorTopVer=0], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (2 ms), stage="Determine exchange type" (1 ms), stage="Exchange done" (4 ms), stage="Total time" (7 ms)] [21:05:28] : [Step 4/5] [2021-11-19 21:05:28,958][INFO ][main][IgniteKernal%client1] [21:05:28] : [Step 4/5] [21:05:28] : [Step 4/5] >>> +------------------------------------------------------+ [21:05:28] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV stopped OK [21:05:28] : [Step 4/5] >>> +------------------------------------------------------+ [21:05:28] : [Step 4/5] >>> Ignite instance name: client1 [21:05:28] : [Step 4/5] >>> Grid uptime: 00:00:06.188 [21:05:28] : [Step 4/5] [21:05:28] : [Step 4/5] [21:05:28] : [Step 4/5] [2021-11-19 21:05:28,957][INFO ][exchange-worker-#10628%grid-0%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=6, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=6, minorTopVer=0]] [21:05:28] : [Step 4/5] [2021-11-19 21:05:28,959][INFO ][main][root] >>> Stopping grid [name=grid-0, id=00622f8d-e1fe-42dd-95f9-54f5fc364000] [21:05:28] : [Step 4/5] [2021-11-19 21:05:28,959][INFO ][exchange-worker-#10751%grid-6%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=6, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=6, minorTopVer=0]] [21:05:28] : [Step 4/5] [2021-11-19 21:05:28,959][INFO ][exchange-worker-#10628%grid-0%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=6, minorTopVer=0], crd=true] [21:05:28] : [Step 4/5] [2021-11-19 21:05:28,962][INFO ][exchange-worker-#10751%grid-6%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=6, minorTopVer=0], crd=false] [21:05:28] : [Step 4/5] [2021-11-19 21:05:28,962][INFO ][exchange-worker-#10628%grid-0%][GridCachePartitionExchangeManager] AffinityTopologyVersion [topVer=6, minorTopVer=0], evt=NODE_LEFT, evtNode=109539ac-d8d7-4dcf-8b8a-e4ff21e9c001, client=false] [21:05:28] : [Step 4/5] [2021-11-19 21:05:28,963][INFO ][exchange-worker-#10751%grid-6%][GridCachePartitionExchangeManager] AffinityTopologyVersion [topVer=6, minorTopVer=0], evt=NODE_LEFT, evtNode=109539ac-d8d7-4dcf-8b8a-e4ff21e9c001, client=false] [21:05:29] : [Step 4/5] [2021-11-19 21:05:29,867][INFO ][db-checkpoint-thread-#10970%grid-0%][Checkpointer] Checkpoint started [checkpointId=c70db404-269f-450a-ac62-97878b2f1976, startPtr=WALPointer [idx=0, fileOff=677801, len=11928], checkpointBeforeLockTime=12ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=6ms, checkpointLockHoldTime=7ms, walCpRecordFsyncDuration=408ms, writeCheckpointEntryDuration=475ms, splitAndSortCpPagesDuration=0ms, pages=468, reason='timeout'] [21:05:29] : [Step 4/5] [2021-11-19 21:05:29,874][INFO ][tcp-disco-sock-reader-[60cf419a 127.0.0.1:34631]-#562%grid-0%-#10748%grid-0%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:34631, rmtPort=34631, rmtNodeId=60cf419a-9798-4b04-bea7-d09e78da3006] [21:05:29] : [Step 4/5] [2021-11-19 21:05:29,884][INFO ][main][GridCacheProcessor] Stopped cache [cacheName=encrypted] [21:05:29] : [Step 4/5] [2021-11-19 21:05:29,884][INFO ][main][GridCacheProcessor] Stopped cache [cacheName=ignite-sys-cache] [21:05:29] : [Step 4/5] [2021-11-19 21:05:29,890][INFO ][disco-event-worker-#10750%grid-6%][GridDiscoveryManager] Node left topology: TcpDiscoveryNode [id=00622f8d-e1fe-42dd-95f9-54f5fc364000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345122592, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false] [21:05:29] : [Step 4/5] [2021-11-19 21:05:29,891][INFO ][disco-event-worker-#10750%grid-6%][GridDiscoveryManager] Topology snapshot [ver=7, locNode=60cf419a, servers=1, clients=0, state=ACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=60cf419a-9798-4b04-bea7-d09e78da3006, consistentId=grid-6, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:05:29] : [Step 4/5] [2021-11-19 21:05:29,891][INFO ][disco-event-worker-#10750%grid-6%][GridDiscoveryManager] Coordinator changed [prev=TcpDiscoveryNode [id=00622f8d-e1fe-42dd-95f9-54f5fc364000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345122592, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], cur=TcpDiscoveryNode [id=60cf419a-9798-4b04-bea7-d09e78da3006, consistentId=grid-6, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637345129873, loc=true, ver=2.13.0#20211119-sha1:00000000, isClient=false]] [21:05:29] : [Step 4/5] [2021-11-19 21:05:29,893][INFO ][disco-event-worker-#10750%grid-6%][GridDiscoveryManager] ^-- Baseline [id=0, size=2, online=1, offline=1] [21:05:29] : [Step 4/5] [2021-11-19 21:05:29,894][INFO ][disco-event-worker-#10750%grid-6%][MvccProcessorImpl] Assigned mvcc coordinator [crd=MvccCoordinator [topVer=AffinityTopologyVersion [topVer=7, minorTopVer=0], nodeId=60cf419a-9798-4b04-bea7-d09e78da3006, ver=1637345121303, local=true, initialized=false]] [21:05:29] : [Step 4/5] [2021-11-19 21:05:29,896][INFO ][exchange-worker-#10751%grid-6%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=7, minorTopVer=0], crd=true, evt=NODE_LEFT, evtNode=00622f8d-e1fe-42dd-95f9-54f5fc364000, customEvt=null, allowMerge=false, exchangeFreeSwitch=true] [21:05:29] : [Step 4/5] [2021-11-19 21:05:29,897][INFO ][exchange-worker-#10751%grid-6%][GridAffinityAssignmentCache] Local node affinity assignment distribution is not ideal [cache=encrypted, expectedPrimary=1024.00, actualPrimary=499, expectedBackups=0.00, actualBackups=0, warningThreshold=50.00%] [21:05:29] : [Step 4/5] [2021-11-19 21:05:29,898][INFO ][exchange-worker-#10751%grid-6%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=7, minorTopVer=0], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:05:29] : [Step 4/5] [2021-11-19 21:05:29,896][INFO ][sys-#10718%grid-6%][ExchangeLatchManager] Become new coordinator 60cf419a-9798-4b04-bea7-d09e78da3006 [21:05:29] : [Step 4/5] [2021-11-19 21:05:29,900][INFO ][exchange-worker-#10751%grid-6%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=7, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=7, minorTopVer=0], err=null, rebalanced=true, wasRebalanced=true] [21:05:29]W: [org.apache.ignite:ignite-core] [2021-11-19 21:05:29,910][WARN ][sys-#10725%grid-6%][GridDhtPartitionTopologyImpl] Detected lost partitions [grp=encrypted, parts=[0-2, 4-8, 12-13, 17-18, 20, 24, 27, 31, 35-38, 41-43, 45-46, 48, 51, 53, 55, 57-58, 61, 63, 65, 70-73, 77, 80, 82-83, 88-89, 93, 95, 100, 103, 108-115, 119, 123-131, 133, 136-137, 142, 148, 152-153, 157-161, 163, 167-170, 178-184, 186, 188-190, 192-195, 200-201, 203-204, 207, 212, 215-218, 223, 225-228, 230, 232-234, 236, 238, 244, 246-247, 250-255, 257-260, 262-265, 267-268, 270, 274-275, 278, 281-282, 286, 288, 293, 296, 298, 300-301, 305, 307, 309, 313-315, 321, 323-324, 329, 331-338, 342-344, 347, 349-352, 354, 356, 362-364, 368-371, 375-376, 379-384, 389, 391, 393-395, 398-400, 403-404, 406-407, 409, 411-415, 417-418, 423, 427-432, 434, 436, 439, 444, 446-448, 451, 453, 457-460, 462, 464, 466, 469, 471-479, 481-484, 486-487, 489, 491, 493-494, 496, 498, 501, 504, 508, 511, 514, 517, 519-523, 526-528, 533-534, 536-537, 539-540, 542-545, 548, 550, 553-557, 560-561, 565-567, 570-571, 574, 576-578, 580, 582-583, 586, 590, 592-593, 595, 597-599, 601, 606, 610, 616-617, 620-626, 630-632, 634-635, 638, 641, 643, 645, 648-650, 653-655, 662-663, 666-667, 674-678, 680-681, 685, 687-691, 696-697, 699-702, 708, 710-711, 714-715, 718-720, 724, 726, 729, 731, 734, 736, 740-741, 743-744, 747-748, 753-757, 759, 761, 765-767, 769, 771-772, 774, 777, 779-781, 788, 791, 794-795, 797, 802, 804, 806-807, 810, 812, 814-816, 818-819, 821, 826-827, 830-831, 834-835, 837-838, 840-847, 852-853, 855-856, 859, 861-862, 864, 868-869, 873-877, 881-883, 885, 887-895, 897-898, 900-903, 907, 910-913, 916, 918-919, 921-924, 927, 929-930, 934-935, 938, 940, 943, 946, 949, 953, 955-966, 971, 974, 980, 982, 989, 991-992, 997-1000, 1002, 1006, 1008-1010, 1012, 1014-1015, 1017, 1019-1020, 1023], topVer=AffinityTopologyVersion [topVer=7, minorTopVer=0]] [21:05:29] : [Step 4/5] [2021-11-19 21:05:29,917][INFO ][exchange-worker-#10751%grid-6%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=60cf419a-9798-4b04-bea7-d09e78da3006, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=7, minorTopVer=0], evt=NODE_LEFT, evtNode=TcpDiscoveryNode [id=00622f8d-e1fe-42dd-95f9-54f5fc364000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345122592, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=7, minorTopVer=0]] [21:05:29] : [Step 4/5] [2021-11-19 21:05:29,918][INFO ][exchange-worker-#10751%grid-6%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=7, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=7, minorTopVer=0], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (0 ms), stage="Determine exchange type" (1 ms), stage="Preloading notification" (0 ms), stage="After states restored callback" (0 ms), stage="WAL history reservation" (0 ms), stage="Finalize update counters" (0 ms), stage="Detect lost partitions" (16 ms), stage="Exchange done" (2 ms), stage="Total time" (19 ms)] [21:05:29] : [Step 4/5] [2021-11-19 21:05:29,919][INFO ][exchange-worker-#10751%grid-6%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=7, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=7, minorTopVer=0], stage="Affinity initialization (exchange-free switch on fully-rebalanced topology) [grp=encrypted]" (1 ms) (parent=Determine exchange type), stage="Affinity initialization (exchange-free switch on fully-rebalanced topology) [grp=ignite-sys-cache]" (0 ms) (parent=Determine exchange type)] [21:05:29] : [Step 4/5] [2021-11-19 21:05:29,921][INFO ][exchange-worker-#10751%grid-6%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=7, minorTopVer=0], crd=true] [21:05:29] : [Step 4/5] [2021-11-19 21:05:29,922][INFO ][exchange-worker-#10751%grid-6%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=7, minorTopVer=0], force=false, evt=NODE_LEFT, node=00622f8d-e1fe-42dd-95f9-54f5fc364000] [21:05:30] : [Step 4/5] [2021-11-19 21:05:30,279][INFO ][main][FilePageStoreManager] Cleanup cache stores [total=4, left=0, cleanFiles=false] [21:05:30] : [Step 4/5] [2021-11-19 21:05:30,282][INFO ][main][GridDeploymentLocalStore] Removed undeployed class: GridDeployment [ts=1637345123013, depMode=SHARED, clsLdr=IsolatedClassLoader{roleName='test'}, clsLdrId=e253d593d71-00622f8d-e1fe-42dd-95f9-54f5fc364000, userVer=0, loc=true, sampleClsName=org.apache.ignite.internal.processors.cache.distributed.dht.preloader.GridDhtPartitionMap, pendingUndeploy=false, undeployed=true, usage=0] [21:05:30] : [Step 4/5] [2021-11-19 21:05:30,291][INFO ][main][IgniteKernal%grid-0] [21:05:30] : [Step 4/5] [21:05:30] : [Step 4/5] >>> +------------------------------------------------------+ [21:05:30] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV stopped OK [21:05:30] : [Step 4/5] >>> +------------------------------------------------------+ [21:05:30] : [Step 4/5] >>> Ignite instance name: grid-0 [21:05:30] : [Step 4/5] >>> Grid uptime: 00:00:08.969 [21:05:30] : [Step 4/5] [21:05:30] : [Step 4/5] [21:05:30] : [Step 4/5] [2021-11-19 21:05:30,291][INFO ][main][root] >>> Stopping grid [name=grid-6, id=60cf419a-9798-4b04-bea7-d09e78da3006] [21:05:30] : [Step 4/5] [2021-11-19 21:05:30,315][INFO ][db-checkpoint-thread-#10975%grid-6%][Checkpointer] Checkpoint started [checkpointId=d1aa8636-da7c-4cbd-8410-60b6d5af7ef9, startPtr=WALPointer [idx=0, fileOff=753601, len=11434], checkpointBeforeLockTime=4ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=10ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=1ms, pages=548, reason='timeout'] [21:05:30]W: [org.apache.ignite:ignite-core] [2021-11-19 21:05:30,319][WARN ][tcp-disco-sock-reader-[00622f8d 127.0.0.1:40111]-#561%grid-6%-#10747%grid-6%][TestTcpDiscoverySpi] Failed to shutdown socket [21:05:30]W: [org.apache.ignite:ignite-core] java.net.SocketException: Socket is closed [21:05:30]W: [org.apache.ignite:ignite-core] at java.net.Socket.shutdownOutput(Socket.java:1568) [21:05:30]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.close(IgniteUtils.java:4247) [21:05:30]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.discovery.tcp.ServerImpl$SocketReader.body(ServerImpl.java:7370) [21:05:30] : [Step 4/5] [2021-11-19 21:05:30,320][INFO ][tcp-disco-sock-reader-[00622f8d 127.0.0.1:40111]-#561%grid-6%-#10747%grid-6%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:40111, rmtPort=40111, rmtNodeId=00622f8d-e1fe-42dd-95f9-54f5fc364000] [21:05:30]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.IgniteSpiThread.run(IgniteSpiThread.java:58) [21:05:30] : [Step 4/5] [2021-11-19 21:05:30,321][INFO ][main][GridCacheProcessor] Stopped cache [cacheName=encrypted] [21:05:30] : [Step 4/5] [2021-11-19 21:05:30,321][INFO ][main][GridCacheProcessor] Stopped cache [cacheName=ignite-sys-cache] [21:05:30] : [Step 4/5] [2021-11-19 21:05:30,791][INFO ][main][FilePageStoreManager] Cleanup cache stores [total=4, left=0, cleanFiles=false] [21:05:30] : [Step 4/5] [2021-11-19 21:05:30,794][INFO ][main][GridDeploymentLocalStore] Removed undeployed class: GridDeployment [ts=1637345123033, depMode=SHARED, clsLdr=IsolatedClassLoader{roleName='test'}, clsLdrId=0353d593d71-60cf419a-9798-4b04-bea7-d09e78da3006, userVer=0, loc=true, sampleClsName=org.apache.ignite.internal.processors.cache.distributed.dht.preloader.IgniteDhtPartitionHistorySuppliersMap, pendingUndeploy=false, undeployed=true, usage=0] [21:05:30] : [Step 4/5] [2021-11-19 21:05:30,801][INFO ][main][IgniteKernal%grid-6] [21:05:30] : [Step 4/5] [21:05:30] : [Step 4/5] >>> +------------------------------------------------------+ [21:05:30] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV stopped OK [21:05:30] : [Step 4/5] >>> +------------------------------------------------------+ [21:05:30] : [Step 4/5] >>> Ignite instance name: grid-6 [21:05:30] : [Step 4/5] >>> Grid uptime: 00:00:08.163 [21:05:30] : [Step 4/5] [21:05:30] : [Step 4/5] [21:05:31] : [Step 4/5] [21:05:31] >>> Starting test: EncryptedCacheNodeJoinTest#testNodeCantJoinWithSameNameButEncCache <<< [21:05:31] : [Step 4/5] [2021-11-19 21:05:31,061][INFO ][main][root] >>> Starting test: EncryptedCacheNodeJoinTest#testNodeCantJoinWithSameNameButEncCache <<< [21:05:31] : [Step 4/5] [21:05:31] >>> Heap: 253 MB used / 1893 MB commited / 1893 MB max <<< [21:05:31] : [Step 4/5] [2021-11-19 21:05:31,061][INFO ][main][root] >>> Heap: 253 MB used / 1893 MB commited / 1893 MB max <<< [21:05:31] : [Step 4/5] [21:05:31] >>> Non-Heap: 145 MB used / 158 MB commited / 0 MB max <<< [21:05:31] : [Step 4/5] [2021-11-19 21:05:31,061][INFO ][main][root] >>> Non-Heap: 145 MB used / 158 MB commited / 0 MB max <<< [21:05:31]W: [org.apache.ignite:ignite-core] [2021-11-19 21:05:31,066][WARN ][test-runner-#11043%encryption.EncryptedCacheNodeJoinTest%][G] Ignite work directory is not provided, automatically resolved to: /opt/buildagent/work/7bc1c54bc719b67c/work [21:05:31] : [Step 4/5] [2021-11-19 21:05:31,068][INFO ][test-runner-#11043%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-5] [21:05:31] : [Step 4/5] [21:05:31] : [Step 4/5] >>> __________ ________________ [21:05:31] : [Step 4/5] >>> / _/ ___/ |/ / _/_ __/ __/ [21:05:31] : [Step 4/5] >>> _/ // (7 7 // / / / / _/ [21:05:31] : [Step 4/5] >>> /___/\___/_/|_/___/ /_/ /___/ [21:05:31] : [Step 4/5] >>> [21:05:31] : [Step 4/5] >>> ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:05:31] : [Step 4/5] >>> 2021 Copyright(C) Apache Software Foundation [21:05:31] : [Step 4/5] >>> [21:05:31] : [Step 4/5] >>> Ignite documentation: http://ignite.apache.org [21:05:31] : [Step 4/5] [21:05:31] : [Step 4/5] [2021-11-19 21:05:31,069][INFO ][test-runner-#11043%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-5] Config URL: n/a [21:05:31] : [Step 4/5] [2021-11-19 21:05:31,069][INFO ][test-runner-#11043%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-5] IgniteConfiguration [igniteInstanceName=grid-5, pubPoolSize=24, svcPoolSize=24, callbackPoolSize=24, stripedPoolSize=24, sysPoolSize=24, mgmtPoolSize=4, dataStreamerPoolSize=24, utilityCachePoolSize=24, utilityCacheKeepAliveTime=60000, p2pPoolSize=2, qryPoolSize=24, buildIdxPoolSize=4, igniteHome=/opt/buildagent/work/7bc1c54bc719b67c, igniteWorkDir=/opt/buildagent/work/7bc1c54bc719b67c/work, mbeanSrv=com.sun.jmx.mbeanserver.JmxMBeanServer@6fe85038, nodeId=502bd102-0a78-48d8-9b8f-f181ec67e005, marsh=BinaryMarshaller [], marshLocJobs=false, daemon=false, p2pEnabled=true, netTimeout=10000, netCompressionLevel=1, sndRetryDelay=1000, sndRetryCnt=3, metricsHistSize=10000, metricsUpdateFreq=1000, metricsExpTime=9223372036854775807, discoSpi=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=0, ackTimeout=0, marsh=null, reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], segPlc=STOP, segResolveAttempts=2, waitForSegOnStart=true, allResolversPassReq=true, segChkFreq=10000, commSpi=TcpCommunicationSpi [connectGate=org.apache.ignite.spi.communication.tcp.internal.ConnectGateway@5032ba13, ctxInitLatch=java.util.concurrent.CountDownLatch@442d1f7b[Count = 1], stopping=false, clientPool=null, nioSrvWrapper=null, stateProvider=null], evtSpi=MemoryEventStorageSpi [expireAgeMs=9223372036854775807, expireCnt=10000, filter=null], colSpi=NoopCollisionSpi [], deploySpi=LocalDeploymentSpi [], indexingSpi=org.apache.ignite.spi.indexing.noop.NoopIndexingSpi@4d5d78b4, addrRslvr=null, encryptionSpi=org.apache.ignite.spi.encryption.keystore.KeystoreEncryptionSpi@26792bbe, tracingSpi=org.apache.ignite.spi.tracing.NoopTracingSpi@7d4eab5, clientMode=false, rebalanceThreadPoolSize=4, rebalanceTimeout=10000, rebalanceBatchesPrefetchCnt=3, rebalanceThrottle=0, rebalanceBatchSize=524288, txCfg=TransactionConfiguration [txSerEnabled=false, dfltIsolation=REPEATABLE_READ, dfltConcurrency=PESSIMISTIC, dfltTxTimeout=0, txTimeoutOnPartitionMapExchange=0, deadlockTimeout=10000, pessimisticTxLogSize=0, pessimisticTxLogLinger=10000, tmLookupClsName=null, txManagerFactory=null, useJtaSync=false], cacheSanityCheckEnabled=true, discoStartupDelay=60000, deployMode=SHARED, p2pMissedCacheSize=100, locHost=127.0.0.1, timeSrvPortBase=31100, timeSrvPortRange=100, failureDetectionTimeout=10000, sysWorkerBlockedTimeout=null, clientFailureDetectionTimeout=10000, metricsLogFreq=0, connectorCfg=null, odbcCfg=null, warmupClos=null, atomicCfg=AtomicConfiguration [seqReserveSize=1000, cacheMode=PARTITIONED, backups=1, aff=null, grpName=null], classLdr=null, sslCtxFactory=null, platformCfg=null, binaryCfg=null, memCfg=null, pstCfg=null, dsCfg=DataStorageConfiguration [sysRegionInitSize=41943040, sysRegionMaxSize=104857600, pageSize=4096, concLvl=0, dfltDataRegConf=DataRegionConfiguration [name=default, maxSize=10485760, initSize=268435456, swapPath=null, pageEvictionMode=DISABLED, pageReplacementMode=CLOCK, evictionThreshold=0.9, emptyPagesPoolSize=100, metricsEnabled=false, metricsSubIntervalCount=5, metricsRateTimeInterval=60000, persistenceEnabled=true, checkpointPageBufSize=0, lazyMemoryAllocation=true, warmUpCfg=null], dataRegions=null, storagePath=null, checkpointFreq=180000, lockWaitTime=10000, checkpointThreads=4, checkpointWriteOrder=SEQUENTIAL, walHistSize=20, maxWalArchiveSize=1073741824, walSegments=10, walSegmentSize=67108864, walPath=db/wal, walArchivePath=db/wal/archive, cdcWalPath=db/wal/cdc, cdcEnabled=false, metricsEnabled=false, walMode=FSYNC, walTlbSize=131072, walBuffSize=0, walFlushFreq=2000, walFsyncDelay=1000, walRecordIterBuffSize=67108864, alwaysWriteFullPages=false, fileIOFactory=org.apache.ignite.internal.processors.cache.persistence.file.AsyncFileIOFactory@5afa6dc2, metricsSubIntervalCnt=5, metricsRateTimeInterval=60000, walAutoArchiveAfterInactivity=-1, walForceArchiveTimeout=-1, writeThrottlingEnabled=false, walCompactionEnabled=false, walCompactionLevel=1, checkpointReadLockTimeout=null, walPageCompression=DISABLED, walPageCompressionLevel=null, dfltWarmUpCfg=null, encCfg=org.apache.ignite.configuration.EncryptionConfiguration@4e646fdf, defragmentationThreadPoolSize=4, minWalArchiveSize=-1], snapshotPath=snapshots, activeOnStart=true, activeOnStartPropSetFlag=false, autoActivation=true, autoActivationPropSetFlag=false, clusterStateOnStart=null, sqlConnCfg=null, cliConnCfg=ClientConnectorConfiguration [host=null, port=10800, portRange=100, sockSndBufSize=0, sockRcvBufSize=0, tcpNoDelay=true, maxOpenCursorsPerConn=128, threadPoolSize=24, selectorCnt=12, idleTimeout=0, handshakeTimeout=10000, jdbcEnabled=true, odbcEnabled=true, thinCliEnabled=true, sslEnabled=false, useIgniteSslCtxFactory=true, sslClientAuth=false, sslCtxFactory=null, thinCliCfg=ThinClientConfiguration [maxActiveTxPerConn=100, maxActiveComputeTasksPerConn=0]], mvccVacuumThreadCnt=2, mvccVacuumFreq=5000, authEnabled=false, failureHnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]], commFailureRslvr=null, sqlCfg=SqlConfiguration [longQryWarnTimeout=3000, dfltQryTimeout=0, sqlQryHistSize=1000, validationEnabled=false], asyncContinuationExecutor=null] [21:05:31] : [Step 4/5] [2021-11-19 21:05:31,077][INFO ][test-runner-#11043%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-5] Daemon mode: off [21:05:31] : [Step 4/5] [2021-11-19 21:05:31,077][INFO ][test-runner-#11043%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-5] OS: Linux 4.15.0-151-generic amd64 [21:05:31] : [Step 4/5] [2021-11-19 21:05:31,078][INFO ][test-runner-#11043%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-5] OS user: teamcity [21:05:31] : [Step 4/5] [2021-11-19 21:05:31,078][INFO ][test-runner-#11043%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-5] PID: 16724 [21:05:31] : [Step 4/5] [2021-11-19 21:05:31,078][INFO ][test-runner-#11043%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-5] Language runtime: Java Platform API Specification ver. 1.8 [21:05:31] : [Step 4/5] [2021-11-19 21:05:31,078][INFO ][test-runner-#11043%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-5] VM information: Java(TM) SE Runtime Environment 1.8.0_261-b12 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 25.261-b12 [21:05:31] : [Step 4/5] [2021-11-19 21:05:31,079][INFO ][test-runner-#11043%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-5] VM total memory: 1.8GB [21:05:31] : [Step 4/5] [2021-11-19 21:05:31,079][INFO ][test-runner-#11043%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-5] Remote Management [restart: off, REST: off, JMX (remote: off)] [21:05:31] : [Step 4/5] [2021-11-19 21:05:31,079][INFO ][test-runner-#11043%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-5] Logger: GridTestLog4jLogger [quiet=false, config=null] [21:05:31] : [Step 4/5] [2021-11-19 21:05:31,079][INFO ][test-runner-#11043%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-5] IGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c [21:05:31]W: [org.apache.ignite:ignite-core] [2021-11-19 21:05:31,085][WARN ][test-runner-#11043%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-5] Peer class loading is enabled (disable it in production for performance and deployment consistency reasons) [21:05:31] : [Step 4/5] [2021-11-19 21:05:31,080][INFO ][test-runner-#11043%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-5] VM arguments: [-DIGNITE_DUMP_THREADS_ON_FAILURE=false, -DMono=/usr/bin/mono-sgen, -DMono4.0_x64=/usr/lib/mono/4.0, -DMono4.5_x64=/usr/lib/mono/4.5, -DMonoVersion=6.12.0.90, -DSKIP_BUILD=false, -Dagent.home.dir=/opt/buildagent, -Dagent.name=aitc-lin02_03, -Dagent.ownPort=9090, -Dagent.work.dir=/opt/buildagent/work, -Dbuild.number=95, -Dbuild.vcs.number=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.1=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.GitHubApacheIgnite=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dclassworlds.conf=/opt/buildagent/temp/buildTmp/teamcity.m2.conf, -Dcom.jetbrains.maven.watcher.report.file=/opt/buildagent/temp/buildTmp/maven-build-info.xml, -Djava.io.tmpdir=/opt/buildagent/temp/buildTmp, -Dmaven.home=/opt/buildagent/tools/maven3_6, -Dmaven.multiModuleProjectDirectory=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.agent.cpuBenchmark=457, -Dteamcity.agent.dotnet.agent_url=http://localhost:9090/RPC2, -Dteamcity.agent.dotnet.build_id=6278078, -Dteamcity.auth.password=*******, -Dteamcity.auth.userId=TeamCityBuildId=6278078, -Dteamcity.build.changedFiles.file=/opt/buildagent/temp/buildTmp/changedFiles6342607772318147725.txt, -Dteamcity.build.checkoutDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.build.id=6278078, -Dteamcity.build.properties.file=/opt/buildagent/temp/buildTmp/teamcity.build5164517880467851002.properties, -Dteamcity.build.tempDir=/opt/buildagent/temp/buildTmp, -Dteamcity.build.workingDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.buildConfName=Basic 3, -Dteamcity.buildType.id=IgniteTests24Java8_Basic3, -Dteamcity.configuration.properties.file=/opt/buildagent/temp/buildTmp/teamcity.config5591980786735343870.properties, -Dteamcity.maven.userSettings.path=/opt/buildagent/temp/buildTmp/maven_settings_585072866407032347.xml, -Dteamcity.maven.watcher.home=/opt/buildagent/plugins/mavenPlugin/maven-watcher-jdk16, -Dteamcity.projectName=Ignite Tests 2.x (JDK 8/11), -Dteamcity.runner.properties.file=/opt/buildagent/temp/buildTmp/teamcity.runner9098465561618137420.properties, -Dteamcity.tests.recentlyFailedTests.file=/opt/buildagent/temp/buildTmp/testsToRunFirst3891775683130404069.txt, -Dteamcity.version=2021.2 (build 99542), -ea, -Xms2g, -Xmx2g, -XX:+HeapDumpOnOutOfMemoryError, -DIGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_TEST_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_UPDATE_NOTIFIER=false, -DIGNITE_NO_DISCO_ORDER=true, -DIGNITE_PERFORMANCE_SUGGESTIONS_DISABLED=true, -Djava.net.preferIPv4Stack=true, -DTEST_SCALE_FACTOR=1.0, -DIGNITE_TEST_PROP_LOG4J_FILE=log4j-tc-test.xml, -DIGNITE_QUIET=false, -DIGNITE_MARSHAL_BUFFERS_RECHECK=1000, -Dmaven.repo.local=/opt/buildagent/.m2/repository] [21:05:31] : [Step 4/5] [2021-11-19 21:05:31,084][INFO ][test-runner-#11043%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-5] System cache's DataRegion size is configured to 40 MB. Use DataStorageConfiguration.systemRegionInitialSize property to change the setting. [21:05:31] : [Step 4/5] [2021-11-19 21:05:31,084][INFO ][test-runner-#11043%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-5] Configured caches [in 'sysMemPlc' dataRegion: ['ignite-sys-cache'], in 'default' dataRegion: ['encrypted']] [21:05:31] : [Step 4/5] [2021-11-19 21:05:31,085][INFO ][test-runner-#11043%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-5] 3-rd party licenses can be found at: /opt/buildagent/work/7bc1c54bc719b67c/libs/licenses [21:05:31] : [Step 4/5] [2021-11-19 21:05:31,088][INFO ][test-runner-#11043%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] Configured plugins: [21:05:31] : [Step 4/5] [2021-11-19 21:05:31,089][INFO ][test-runner-#11043%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- StanByClusterTestProvider 1.0 [21:05:31] : [Step 4/5] [2021-11-19 21:05:31,089][INFO ][test-runner-#11043%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- null [21:05:31] : [Step 4/5] [2021-11-19 21:05:31,089][INFO ][test-runner-#11043%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] [21:05:31] : [Step 4/5] [2021-11-19 21:05:31,089][INFO ][test-runner-#11043%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- PageMemory tracker plugin 1.0 [21:05:31] : [Step 4/5] [2021-11-19 21:05:31,089][INFO ][test-runner-#11043%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- null [21:05:31] : [Step 4/5] [2021-11-19 21:05:31,090][INFO ][test-runner-#11043%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] [21:05:31] : [Step 4/5] [2021-11-19 21:05:31,090][INFO ][test-runner-#11043%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- TestDistibutedConfigurationPlugin 1.0 [21:05:31] : [Step 4/5] [2021-11-19 21:05:31,090][INFO ][test-runner-#11043%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- null [21:05:31] : [Step 4/5] [2021-11-19 21:05:31,090][INFO ][test-runner-#11043%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] [21:05:31] : [Step 4/5] [2021-11-19 21:05:31,090][INFO ][test-runner-#11043%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- NodeValidationPluginProvider 1.0 [21:05:31] : [Step 4/5] [2021-11-19 21:05:31,090][INFO ][test-runner-#11043%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- null [21:05:31] : [Step 4/5] [2021-11-19 21:05:31,091][INFO ][test-runner-#11043%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] [21:05:31] : [Step 4/5] [2021-11-19 21:05:31,091][INFO ][test-runner-#11043%encryption.EncryptedCacheNodeJoinTest%][FailureProcessor] Configured failure handler: [hnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]]] [21:05:31] : [Step 4/5] [2021-11-19 21:05:31,101][INFO ][test-runner-#11043%encryption.EncryptedCacheNodeJoinTest%][TcpCommunicationSpi] Successfully bound communication NIO server to TCP port [port=45150, locHost=/127.0.0.1, selectorsCnt=12, selectorSpins=0, pairedConn=false] [21:05:31]W: [org.apache.ignite:ignite-core] [2021-11-19 21:05:31,101][WARN ][test-runner-#11043%encryption.EncryptedCacheNodeJoinTest%][TcpCommunicationSpi] Message queue limit is set to 0 which may lead to potential OOMEs when running cache operations in FULL_ASYNC or PRIMARY_SYNC modes due to message queues growth on sender and receiver sides. [21:05:31] : [Step 4/5] [2021-11-19 21:05:31,105][INFO ][test-runner-#11043%encryption.EncryptedCacheNodeJoinTest%][GridCollisionManager] Collision resolution is disabled (all jobs will be activated upon arrival). [21:05:31] : [Step 4/5] [2021-11-19 21:05:31,105][INFO ][test-runner-#11043%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-5] Security status [authentication=off, sandbox=off, tls/ssl=off] [21:05:31] : [Step 4/5] [2021-11-19 21:05:31,160][INFO ][test-runner-#11043%encryption.EncryptedCacheNodeJoinTest%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:05:31] : [Step 4/5] [2021-11-19 21:05:31,241][INFO ][test-runner-#11043%encryption.EncryptedCacheNodeJoinTest%][MaintenanceProcessor] Resolved store directory for node persistent data: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_5 [21:05:31] : [Step 4/5] [2021-11-19 21:05:31,242][INFO ][test-runner-#11043%encryption.EncryptedCacheNodeJoinTest%][CacheObjectBinaryProcessorImpl] Resolved directory for serialized binary metadata: /opt/buildagent/work/7bc1c54bc719b67c/work/db/binary_meta/grid_5 [21:05:31] : [Step 4/5] [2021-11-19 21:05:31,246][INFO ][test-runner-#11043%encryption.EncryptedCacheNodeJoinTest%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_5 [21:05:31] : [Step 4/5] [2021-11-19 21:05:31,247][INFO ][test-runner-#11043%encryption.EncryptedCacheNodeJoinTest%][FileWriteAheadLogManager] Resolved write ahead log work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_5 [21:05:31] : [Step 4/5] [2021-11-19 21:05:31,247][INFO ][test-runner-#11043%encryption.EncryptedCacheNodeJoinTest%][FileWriteAheadLogManager] Resolved write ahead log archive directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_5 [21:05:31] : [Step 4/5] [2021-11-19 21:05:31,876][INFO ][test-runner-#11043%encryption.EncryptedCacheNodeJoinTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_5/0000000000000000.wal [21:05:31]W: [org.apache.ignite:ignite-core] [2021-11-19 21:05:31,876][WARN ][test-runner-#11043%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] DataRegion maxSize=10.5 MB is smaller than defaultInitialSize=268.4 MB, setting initialSize to 10.5 MB [21:05:31] : [Step 4/5] [2021-11-19 21:05:31,880][INFO ][test-runner-#11043%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Configured data regions initialized successfully [total=5] [21:05:31] : [Step 4/5] [2021-11-19 21:05:31,884][INFO ][test-runner-#11043%encryption.EncryptedCacheNodeJoinTest%][IgniteSnapshotManager] Resolved snapshot work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/snapshots [21:05:31] : [Step 4/5] [2021-11-19 21:05:31,884][INFO ][test-runner-#11043%encryption.EncryptedCacheNodeJoinTest%][IgniteSnapshotManager] Resolved temp directory for snapshot creation: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_5/snp [21:05:31] : [Step 4/5] [2021-11-19 21:05:31,886][INFO ][test-runner-#11043%encryption.EncryptedCacheNodeJoinTest%][ClientListenerProcessor] Client connector processor has started on TCP port 10800 [21:05:31] : [Step 4/5] [2021-11-19 21:05:31,892][INFO ][test-runner-#11043%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-5] Non-loopback local IPs: 172.17.0.4 [21:05:31] : [Step 4/5] [2021-11-19 21:05:31,892][INFO ][test-runner-#11043%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-5] Enabled local MACs: 0242AC110004 [21:05:31] : [Step 4/5] [2021-11-19 21:05:31,894][INFO ][test-runner-#11043%encryption.EncryptedCacheNodeJoinTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:05:31] : [Step 4/5] [2021-11-19 21:05:31,895][INFO ][test-runner-#11043%encryption.EncryptedCacheNodeJoinTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:05:31] : [Step 4/5] [2021-11-19 21:05:31,896][INFO ][test-runner-#11043%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:05:31] : [Step 4/5] [2021-11-19 21:05:31,898][INFO ][test-runner-#11043%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Applying lost metastore updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:05:31] : [Step 4/5] [2021-11-19 21:05:31,898][INFO ][test-runner-#11043%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=0 ms] [21:05:31] : [Step 4/5] [2021-11-19 21:05:31,899][INFO ][test-runner-#11043%encryption.EncryptedCacheNodeJoinTest%][GridCacheProcessor] Restoring partition state for local groups. [21:05:31] : [Step 4/5] [2021-11-19 21:05:31,899][INFO ][test-runner-#11043%encryption.EncryptedCacheNodeJoinTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=0, partitionsProcessed=0, time=0ms] [21:05:31] : [Step 4/5] [2021-11-19 21:05:31,899][INFO ][test-runner-#11043%encryption.EncryptedCacheNodeJoinTest%][GridEncryptionManager] Encryption keys loaded from metastore. [grps=, masterKeyName=ignite.master.key] [21:05:31] : [Step 4/5] [2021-11-19 21:05:31,905][INFO ][test-runner-#11043%encryption.EncryptedCacheNodeJoinTest%][ClusterProcessor] Cluster ID and tag has been read from metastorage: null [21:05:31] : [Step 4/5] [2021-11-19 21:05:31,905][INFO ][test-runner-#11043%encryption.EncryptedCacheNodeJoinTest%][IgniteClusterImpl] Shutdown policy was updated [oldVal=null, newVal=null] [21:05:31] : [Step 4/5] [2021-11-19 21:05:31,906][INFO ][test-runner-#11043%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Checkpoint frequency deviation changed [oldVal=null, newVal=null] [21:05:31] : [Step 4/5] [2021-11-19 21:05:31,919][INFO ][test-runner-#11043%encryption.EncryptedCacheNodeJoinTest%][FilePageStoreManager] Cleanup cache stores [total=1, left=0, cleanFiles=false] [21:05:31] : [Step 4/5] [2021-11-19 21:05:31,921][INFO ][test-runner-#11043%encryption.EncryptedCacheNodeJoinTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:05:31] : [Step 4/5] [2021-11-19 21:05:31,922][INFO ][test-runner-#11043%encryption.EncryptedCacheNodeJoinTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:05:31] : [Step 4/5] [2021-11-19 21:05:31,923][INFO ][test-runner-#11043%encryption.EncryptedCacheNodeJoinTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:05:31] : [Step 4/5] [2021-11-19 21:05:31,924][INFO ][test-runner-#11043%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Data Regions Started: 5 [21:05:31] : [Step 4/5] [2021-11-19 21:05:31,924][INFO ][test-runner-#11043%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] ^-- sysMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:05:31] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:05:31] : [Step 4/5] ^-- default region [type=default, persistence=true, lazyAlloc=true, [21:05:31] : [Step 4/5] ... initCfg=10MB, maxCfg=10MB, usedRam=0MB, freeRam=100%, allocRam=0MB, allocTotal=0MB] [21:05:31] : [Step 4/5] ^-- metastoreMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:05:31] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:05:31] : [Step 4/5] ^-- TxLog region [type=internal, persistence=true, lazyAlloc=false, [21:05:31] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:05:31] : [Step 4/5] ^-- volatileDsMemPlc region [type=user, persistence=false, lazyAlloc=true, [21:05:31] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB] [21:05:31] : [Step 4/5] ^-- Ignite persistence [used=0MB] [21:05:31] : [Step 4/5] [21:05:31] : [Step 4/5] [2021-11-19 21:05:31,926][INFO ][test-runner-#11043%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Starting binary memory restore for: [-2100569601, 1613773252] [21:05:31] : [Step 4/5] [2021-11-19 21:05:31,984][INFO ][test-runner-#11043%encryption.EncryptedCacheNodeJoinTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:05:31] : [Step 4/5] [2021-11-19 21:05:31,984][INFO ][test-runner-#11043%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:05:31] : [Step 4/5] [2021-11-19 21:05:31,986][INFO ][test-runner-#11043%encryption.EncryptedCacheNodeJoinTest%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_5/0000000000000000.wal, offset=0, ver=2] [21:05:31] : [Step 4/5] [2021-11-19 21:05:31,998][INFO ][test-runner-#11043%encryption.EncryptedCacheNodeJoinTest%][GridCacheProcessor] Started cache in recovery mode [name=ignite-sys-cache, id=-2100569601, dataRegionName=sysMemPlc, mode=REPLICATED, atomicity=TRANSACTIONAL, backups=2147483647, mvcc=false] [21:05:31] : [Step 4/5] [2021-11-19 21:05:31,998][INFO ][test-runner-#11043%encryption.EncryptedCacheNodeJoinTest%][PageMemoryImpl] Started page memory [memoryAllocated=24.0 MiB, pages=5952, tableSize=474.2 KiB, replacementSize=768 B, checkpointBuffer=10.0 MiB] [21:05:32] : [Step 4/5] [2021-11-19 21:05:32,002][INFO ][test-runner-#11043%encryption.EncryptedCacheNodeJoinTest%][GridCacheProcessor] Started cache in recovery mode [name=encrypted, id=1613773252, dataRegionName=default, mode=PARTITIONED, atomicity=TRANSACTIONAL, backups=0, mvcc=false] [21:05:32] : [Step 4/5] [2021-11-19 21:05:32,002][INFO ][test-runner-#11043%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Binary recovery performed in 76 ms. [21:05:32] : [Step 4/5] [2021-11-19 21:05:32,003][INFO ][test-runner-#11043%encryption.EncryptedCacheNodeJoinTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:05:32] : [Step 4/5] [2021-11-19 21:05:32,003][INFO ][test-runner-#11043%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Applying lost cache updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:05:32] : [Step 4/5] [2021-11-19 21:05:32,057][INFO ][test-runner-#11043%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=50 ms] [21:05:32] : [Step 4/5] [2021-11-19 21:05:32,057][INFO ][test-runner-#11043%encryption.EncryptedCacheNodeJoinTest%][GridCacheProcessor] Restoring partition state for local groups. [21:05:32] : [Step 4/5] [2021-11-19 21:05:32,066][INFO ][test-runner-#11043%encryption.EncryptedCacheNodeJoinTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=2, partitionsProcessed=1124, time=10ms] [21:05:32] : [Step 4/5] [2021-11-19 21:05:32,478][INFO ][test-runner-#11043%encryption.EncryptedCacheNodeJoinTest%][TestTcpDiscoverySpi] Successfully bound to TCP port [port=47500, localHost=localhost/127.0.0.1, locNodeId=502bd102-0a78-48d8-9b8f-f181ec67e005] [21:05:32] : [Step 4/5] [2021-11-19 21:05:32,489][INFO ][disco-notifier-worker-#11155%grid-5%][MvccProcessorImpl] Assigned mvcc coordinator [crd=MvccCoordinator [topVer=AffinityTopologyVersion [topVer=1, minorTopVer=0], nodeId=502bd102-0a78-48d8-9b8f-f181ec67e005, ver=1637345132485, local=true, initialized=false]] [21:05:32] : [Step 4/5] [2021-11-19 21:05:32,490][INFO ][sys-#11150%grid-5%][ClusterProcessor] Writing cluster ID and tag to metastorage on ready for write ClusterIdAndTag [id=4390820d-1324-4b9e-b4e0-d926ef998ae5, tag=optimistic_shamir] [21:05:32] : [Step 4/5] [2021-11-19 21:05:32,493][INFO ][disco-notifier-worker-#11155%grid-5%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustEnabled' was changed from 'null' to 'false' [21:05:32] : [Step 4/5] [2021-11-19 21:05:32,494][INFO ][disco-notifier-worker-#11155%grid-5%][ClusterProcessor] optimistic_shamir [21:05:32] : [Step 4/5] [2021-11-19 21:05:32,495][INFO ][disco-notifier-worker-#11155%grid-5%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustTimeout' was changed from 'null' to '300000' [21:05:32] : [Step 4/5] [2021-11-19 21:05:32,496][INFO ][disco-notifier-worker-#11155%grid-5%][IgniteTxManager] Transactions parameter 'longOperationsDumpTimeout' was changed from 'null' to '60000' [21:05:32] : [Step 4/5] [2021-11-19 21:05:32,496][INFO ][disco-notifier-worker-#11155%grid-5%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpThreshold' was changed from 'null' to '0' [21:05:32] : [Step 4/5] [2021-11-19 21:05:32,497][INFO ][disco-notifier-worker-#11155%grid-5%][IgniteTxManager] Transactions parameter 'transactionTimeDumpSamplesCoefficient' was changed from 'null' to '0.0' [21:05:32] : [Step 4/5] [2021-11-19 21:05:32,497][INFO ][disco-notifier-worker-#11155%grid-5%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpSamplesPerSecondLimit' was changed from 'null' to '5' [21:05:32] : [Step 4/5] [2021-11-19 21:05:32,502][INFO ][disco-notifier-worker-#11155%grid-5%][IgniteTxManager] Transactions parameter 'collisionsDumpInterval' was changed from 'null' to '1000' [21:05:32] : [Step 4/5] [2021-11-19 21:05:32,502][INFO ][test-runner-#11043%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-5] To start Console Management & Monitoring run ignitevisorcmd.{sh|bat} [21:05:32] : [Step 4/5] [2021-11-19 21:05:32,502][INFO ][disco-notifier-worker-#11155%grid-5%][IgniteTxManager] Transactions parameter 'txOwnerDumpRequestsAllowed' was changed from 'null' to 'true' [21:05:32] : [Step 4/5] [2021-11-19 21:05:32,503][INFO ][test-runner-#11043%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-5] [21:05:32] : [Step 4/5] [21:05:32] : [Step 4/5] >>> +-------------------------------------------+ [21:05:32] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:05:32] : [Step 4/5] >>> +-------------------------------------------+ [21:05:32] : [Step 4/5] >>> OS name: Linux 4.15.0-151-generic amd64 [21:05:32] : [Step 4/5] >>> CPU(s): 24 [21:05:32] : [Step 4/5] >>> Heap: 2.0GB [21:05:32] : [Step 4/5] >>> VM name: 16724@c4dfe9a430b2 [21:05:32] : [Step 4/5] >>> Ignite instance name: grid-5 [21:05:32] : [Step 4/5] >>> Local node [ID=502BD102-0A78-48D8-9B8F-F181EC67E005, order=1, clientMode=false] [21:05:32] : [Step 4/5] >>> Local node addresses: [127.0.0.1] [21:05:32] : [Step 4/5] >>> Local ports: TCP:10800 TCP:45150 TCP:47500 [21:05:32] : [Step 4/5] [21:05:32] : [Step 4/5] [2021-11-19 21:05:32,504][INFO ][test-runner-#11043%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-5] >>> Ignite cluster is in INACTIVE state (limited functionality available). Use control.(sh|bat) script or IgniteCluster.state(ClusterState.ACTIVE) to change the state. [21:05:32] : [Step 4/5] [2021-11-19 21:05:32,503][INFO ][disco-notifier-worker-#11155%grid-5%][GridCacheDatabaseSharedManager] Historical rebalance WAL threshold changed [property=historical.rebalance.threshold, oldVal=null, newVal=500] [21:05:32] : [Step 4/5] [2021-11-19 21:05:32,504][INFO ][test-runner-#11043%encryption.EncryptedCacheNodeJoinTest%][GridDiscoveryManager] Topology snapshot [ver=1, locNode=502bd102, servers=1, clients=0, state=INACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=502bd102-0a78-48d8-9b8f-f181ec67e005, consistentId=grid-5, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:05:32] : [Step 4/5] [2021-11-19 21:05:32,505][INFO ][test-runner-#11043%encryption.EncryptedCacheNodeJoinTest%][G] Node started : [stage="Configure system pool" (0 ms),stage="Start managers" (174 ms),stage="Configure binary metadata" (2 ms),stage="Start processors" (647 ms),stage="Start 'StanByClusterTestProvider' plugin" (0 ms),stage="Start 'PageMemory tracker plugin' plugin" (0 ms),stage="Start 'TestDistibutedConfigurationPlugin' plugin" (0 ms),stage="Start 'NodeValidationPluginProvider' plugin" (0 ms),stage="Init metastore" (27 ms),stage="Init and start regions" (6 ms),stage="Restore binary memory" (77 ms),stage="Restore logical state" (63 ms),stage="Finish recovery" (410 ms),stage="Join topology" (12 ms),stage="Await transition" (1 ms),stage="Await exchange" (14 ms),stage="Total time" (1433 ms)] [21:05:32] : [Step 4/5] [2021-11-19 21:05:32,506][INFO ][test-runner-#11043%encryption.EncryptedCacheNodeJoinTest%][root] Node started with the following configuration [id=502bd102-0a78-48d8-9b8f-f181ec67e005, marshaller=BinaryMarshaller [], discovery=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=5000, ackTimeout=5000, marsh=JdkMarshaller [clsFilter=org.apache.ignite.marshaller.MarshallerUtils$1@6ea2fe7c], reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], binaryCfg=null, lateAff=true] [21:05:32] : [Step 4/5] [2021-11-19 21:05:32,507][INFO ][test-runner-#11043%encryption.EncryptedCacheNodeJoinTest%][GridClusterStateProcessor] Sending activate cluster request with BaselineTopology BaselineTopology [id=0, branchingHash=-1237657746, branchingType='New BaselineTopology', baselineNodes=[grid-5]] [21:05:32] : [Step 4/5] [2021-11-19 21:05:32,513][INFO ][disco-notifier-worker-#11155%grid-5%][GridClusterStateProcessor] Received activate cluster request with BaselineTopology[id=0] initiator node ID: 502bd102-0a78-48d8-9b8f-f181ec67e005 [21:05:32] : [Step 4/5] [2021-11-19 21:05:32,513][INFO ][disco-notifier-worker-#11155%grid-5%][GridClusterStateProcessor] Started state transition: activate cluster [21:05:32] : [Step 4/5] [2021-11-19 21:05:32,514][INFO ][exchange-worker-#11160%grid-5%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=1, minorTopVer=1], crd=true, evt=DISCOVERY_CUSTOM_EVT, evtNode=502bd102-0a78-48d8-9b8f-f181ec67e005, customEvt=ChangeGlobalStateMessage [id=b9b3d593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqId=bf533157-7153-4604-891f-23f6e78bdac0, initiatingNodeId=502bd102-0a78-48d8-9b8f-f181ec67e005, state=ACTIVE, baselineTopology=BaselineTopology [id=0, branchingHash=-1237657746, branchingType='New BaselineTopology', baselineNodes=[grid-5]], forceChangeBaselineTopology=false, timestamp=1637345132507, forceDeactivation=true], allowMerge=false, exchangeFreeSwitch=false] [21:05:32] : [Step 4/5] [2021-11-19 21:05:32,515][INFO ][exchange-worker-#11160%grid-5%][GridDhtPartitionsExchangeFuture] Start activation process [nodeId=502bd102-0a78-48d8-9b8f-f181ec67e005, client=false, topVer=AffinityTopologyVersion [topVer=1, minorTopVer=1]]. New state: ACTIVE [21:05:32] : [Step 4/5] [2021-11-19 21:05:32,516][INFO ][exchange-worker-#11160%grid-5%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_5 [21:05:32] : [Step 4/5] [2021-11-19 21:05:32,517][INFO ][exchange-worker-#11160%grid-5%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_5/0000000000000000.wal, offset=13104, ver=2] [21:05:32] : [Step 4/5] [2021-11-19 21:05:32,518][INFO ][exchange-worker-#11160%grid-5%][GridClusterStateProcessor] Writing BaselineTopology[id=0] [21:05:32] : [Step 4/5] [2021-11-19 21:05:32,527][INFO ][exchange-worker-#11160%grid-5%][GridCacheDatabaseSharedManager] Finish recovery performed in 11 ms. [21:05:32] : [Step 4/5] [2021-11-19 21:05:32,528][INFO ][exchange-worker-#11160%grid-5%][msg] Components activation performed in 12 ms. [21:05:32] : [Step 4/5] [2021-11-19 21:05:32,530][INFO ][exchange-worker-#11160%grid-5%][GridCacheProcessor] Finished recovery for cache [cache=ignite-sys-cache, grp=ignite-sys-cache, startVer=AffinityTopologyVersion [topVer=1, minorTopVer=1]] [21:05:32] : [Step 4/5] [2021-11-19 21:05:32,530][INFO ][sys-#11141%grid-5%][GridCacheProcessor] Finished recovery for cache [cache=encrypted, grp=encrypted, startVer=AffinityTopologyVersion [topVer=1, minorTopVer=1]] [21:05:32] : [Step 4/5] [2021-11-19 21:05:32,533][INFO ][exchange-worker-#11160%grid-5%][GridDhtPartitionsExchangeFuture] Successfully activated caches [nodeId=502bd102-0a78-48d8-9b8f-f181ec67e005, client=false, topVer=AffinityTopologyVersion [topVer=1, minorTopVer=1], newState=ACTIVE] [21:05:32]W: [org.apache.ignite:ignite-core] [2021-11-19 21:05:32,531][WARN ][exchange-worker-#11160%grid-5%][CacheAffinitySharedManager] Cache group 'encrypted' brings high overhead for its metainformation in data region 'default'. Metainformation required for its partitions (1024 partitions, 4096 bytes per partition, 4 MBs total) will consume more than 15% of data region memory (10 MBs). It may lead to critical errors on the node and cluster instability. Please reduce number of partitions, add more memory to the data region or add more server nodes for this cache group. [21:05:32]W: [org.apache.ignite:ignite-core] [2021-11-19 21:05:32,533][WARN ][sys-#11139%grid-5%][CacheAffinitySharedManager] Cache group 'encrypted' brings high overhead for its metainformation in data region 'default'. Metainformation required for its partitions (1024 partitions, 4096 bytes per partition, 4 MBs total) will consume more than 15% of data region memory (10 MBs). It may lead to critical errors on the node and cluster instability. Please reduce number of partitions, add more memory to the data region or add more server nodes for this cache group. [21:05:32] : [Step 4/5] [2021-11-19 21:05:32,534][INFO ][exchange-worker-#11160%grid-5%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=1, minorTopVer=1], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:05:32] : [Step 4/5] [2021-11-19 21:05:32,577][INFO ][exchange-worker-#11160%grid-5%][GridDhtPartitionsExchangeFuture] finishExchangeOnCoordinator [topVer=AffinityTopologyVersion [topVer=1, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=1, minorTopVer=1]] [21:05:32] : [Step 4/5] [2021-11-19 21:05:32,580][INFO ][db-checkpoint-thread-#11166%grid-5%][Checkpointer] Checkpoint started [checkpointId=842ae7f4-4913-4b4a-ada6-0a73cbe56a36, startPtr=WALPointer [idx=0, fileOff=148404, len=21425], checkpointBeforeLockTime=2ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=2ms, writeCheckpointEntryDuration=2ms, splitAndSortCpPagesDuration=0ms, pages=21, reason='node started'] [21:05:32] : [Step 4/5] [2021-11-19 21:05:32,587][INFO ][exchange-worker-#11160%grid-5%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=1, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=1, minorTopVer=1], err=null, rebalanced=true, wasRebalanced=false] [21:05:32] : [Step 4/5] [2021-11-19 21:05:32,587][INFO ][disco-notifier-worker-#11155%grid-5%][GridClusterStateProcessor] Received state change finish message: ACTIVE [21:05:32] : [Step 4/5] [2021-11-19 21:05:32,588][INFO ][disco-notifier-worker-#11155%grid-5%][GridClusterStateProcessor] Cluster state was changed from INACTIVE to ACTIVE [21:05:32] : [Step 4/5] [2021-11-19 21:05:32,591][INFO ][exchange-worker-#11160%grid-5%][GridCacheProcessor] Finish proxy initialization, cacheName=ignite-sys-cache, localNodeId=502bd102-0a78-48d8-9b8f-f181ec67e005 [21:05:32] : [Step 4/5] [2021-11-19 21:05:32,591][INFO ][exchange-worker-#11160%grid-5%][GridCacheProcessor] Finish proxy initialization, cacheName=encrypted, localNodeId=502bd102-0a78-48d8-9b8f-f181ec67e005 [21:05:32] : [Step 4/5] [2021-11-19 21:05:32,591][INFO ][sys-#11141%grid-5%][DistributedBaselineConfiguration] Baseline auto-adjust is 'disabled' with timeout='300000' ms [21:05:32] : [Step 4/5] [2021-11-19 21:05:32,592][INFO ][exchange-worker-#11160%grid-5%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=502bd102-0a78-48d8-9b8f-f181ec67e005, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=1, minorTopVer=1], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=502bd102-0a78-48d8-9b8f-f181ec67e005, consistentId=grid-5, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345132474, loc=true, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=1, minorTopVer=1]] [21:05:32] : [Step 4/5] [2021-11-19 21:05:32,592][INFO ][sys-#11141%grid-5%][GridClusterStateProcessor] Successfully performed final activation steps [nodeId=502bd102-0a78-48d8-9b8f-f181ec67e005, client=false, topVer=AffinityTopologyVersion [topVer=1, minorTopVer=1]] [21:05:32] : [Step 4/5] [2021-11-19 21:05:32,593][INFO ][exchange-worker-#11160%grid-5%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=1, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=1, minorTopVer=1], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (1 ms), stage="Update caches registry" (14 ms), stage="Start caches" (1 ms), stage="Affinity initialization on cache group start" (2 ms), stage="Determine exchange type" (1 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Restore partition states" (0 ms), stage="After states restored callback" (42 ms), stage="WAL history reservation" (0 ms), stage="Waiting for all single messages" (0 ms), stage="Affinity recalculation (crd)" (0 ms), stage="Collect update counters and create affinity messages" (0 ms), stage="Assign partitions states" (3 ms), stage="Validate partitions states" (0 ms), stage="Ideal affinity diff calculation (enforced)" (2 ms), stage="Apply update counters" (0 ms), stage="Full message preparing" (2 ms), stage="Full message sending" (0 ms), stage="State finish message sending" (0 ms), stage="Detect lost partitions" (2 ms), stage="Exchange done" (2 ms), stage="Total time" (72 ms)] [21:05:32] : [Step 4/5] [2021-11-19 21:05:32,595][INFO ][exchange-worker-#11160%grid-5%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=1, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=1, minorTopVer=1], stage="Affinity initialization on cache group start [grp=ignite-sys-cache]" (0 ms) (parent=Affinity initialization on cache group start), stage="Affinity initialization on cache group start [grp=encrypted]" (0 ms) (parent=Affinity initialization on cache group start), stage="Affinity centralized initialization (crd) [grp=ignite-sys-cache, crd=true]" (0 ms) (parent=Determine exchange type), stage="Affinity centralized initialization (crd) [grp=encrypted, crd=true]" (0 ms) (parent=Determine exchange type), stage="Restore partition states [grp=ignite-sys-cache]" (0 ms) (parent=Restore partition states), stage="Restore partition states [grp=encrypted]" (0 ms) (parent=Restore partition states), stage="Affinity recalculation (partitions availability) [grp=encrypted]" (1 ms) (parent=Ideal affinity diff calculation (enforced)), stage="Affinity recalculation (partitions availability) [grp=ignite-sys-cache]" (0 ms) (parent=Ideal affinity diff calculation (enforced))] [21:05:32]W: [org.apache.ignite:ignite-core] [2021-11-19 21:05:32,596][WARN ][test-runner-#11043%encryption.EncryptedCacheNodeJoinTest%][G] Ignite work directory is not provided, automatically resolved to: /opt/buildagent/work/7bc1c54bc719b67c/work [21:05:32] : [Step 4/5] [2021-11-19 21:05:32,597][INFO ][exchange-worker-#11160%grid-5%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=1, minorTopVer=1], crd=true] [21:05:32] : [Step 4/5] [2021-11-19 21:05:32,648][INFO ][test-runner-#11043%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] [21:05:32] : [Step 4/5] [21:05:32] : [Step 4/5] >>> __________ ________________ [21:05:32] : [Step 4/5] >>> / _/ ___/ |/ / _/_ __/ __/ [21:05:32] : [Step 4/5] >>> _/ // (7 7 // / / / / _/ [21:05:32] : [Step 4/5] >>> /___/\___/_/|_/___/ /_/ /___/ [21:05:32] : [Step 4/5] >>> [21:05:32] : [Step 4/5] >>> ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:05:32] : [Step 4/5] >>> 2021 Copyright(C) Apache Software Foundation [21:05:32] : [Step 4/5] >>> [21:05:32] : [Step 4/5] >>> Ignite documentation: http://ignite.apache.org [21:05:32] : [Step 4/5] [21:05:32] : [Step 4/5] [2021-11-19 21:05:32,649][INFO ][test-runner-#11043%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] Config URL: n/a [21:05:32] : [Step 4/5] [2021-11-19 21:05:32,649][INFO ][exchange-worker-#11160%grid-5%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=1, minorTopVer=1], force=false, evt=DISCOVERY_CUSTOM_EVT, node=502bd102-0a78-48d8-9b8f-f181ec67e005] [21:05:32] : [Step 4/5] [2021-11-19 21:05:32,649][INFO ][test-runner-#11043%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] IgniteConfiguration [igniteInstanceName=grid-0, pubPoolSize=24, svcPoolSize=24, callbackPoolSize=24, stripedPoolSize=24, sysPoolSize=24, mgmtPoolSize=4, dataStreamerPoolSize=24, utilityCachePoolSize=24, utilityCacheKeepAliveTime=60000, p2pPoolSize=2, qryPoolSize=24, buildIdxPoolSize=4, igniteHome=/opt/buildagent/work/7bc1c54bc719b67c, igniteWorkDir=/opt/buildagent/work/7bc1c54bc719b67c/work, mbeanSrv=com.sun.jmx.mbeanserver.JmxMBeanServer@6fe85038, nodeId=009fc6f1-991c-4d21-a8fb-6db0e46d9000, marsh=BinaryMarshaller [], marshLocJobs=false, daemon=false, p2pEnabled=true, netTimeout=10000, netCompressionLevel=1, sndRetryDelay=1000, sndRetryCnt=3, metricsHistSize=10000, metricsUpdateFreq=1000, metricsExpTime=9223372036854775807, discoSpi=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=0, ackTimeout=0, marsh=null, reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], segPlc=STOP, segResolveAttempts=2, waitForSegOnStart=true, allResolversPassReq=true, segChkFreq=10000, commSpi=TcpCommunicationSpi [connectGate=org.apache.ignite.spi.communication.tcp.internal.ConnectGateway@b3b0358, ctxInitLatch=java.util.concurrent.CountDownLatch@5dc405cf[Count = 1], stopping=false, clientPool=null, nioSrvWrapper=null, stateProvider=null], evtSpi=MemoryEventStorageSpi [expireAgeMs=9223372036854775807, expireCnt=10000, filter=null], colSpi=NoopCollisionSpi [], deploySpi=LocalDeploymentSpi [], indexingSpi=org.apache.ignite.spi.indexing.noop.NoopIndexingSpi@1fa022bf, addrRslvr=null, encryptionSpi=org.apache.ignite.spi.encryption.keystore.KeystoreEncryptionSpi@53fc4bb5, tracingSpi=org.apache.ignite.spi.tracing.NoopTracingSpi@48cd762f, clientMode=false, rebalanceThreadPoolSize=4, rebalanceTimeout=10000, rebalanceBatchesPrefetchCnt=3, rebalanceThrottle=0, rebalanceBatchSize=524288, txCfg=TransactionConfiguration [txSerEnabled=false, dfltIsolation=REPEATABLE_READ, dfltConcurrency=PESSIMISTIC, dfltTxTimeout=0, txTimeoutOnPartitionMapExchange=0, deadlockTimeout=10000, pessimisticTxLogSize=0, pessimisticTxLogLinger=10000, tmLookupClsName=null, txManagerFactory=null, useJtaSync=false], cacheSanityCheckEnabled=true, discoStartupDelay=60000, deployMode=SHARED, p2pMissedCacheSize=100, locHost=127.0.0.1, timeSrvPortBase=31100, timeSrvPortRange=100, failureDetectionTimeout=10000, sysWorkerBlockedTimeout=null, clientFailureDetectionTimeout=10000, metricsLogFreq=0, connectorCfg=null, odbcCfg=null, warmupClos=null, atomicCfg=AtomicConfiguration [seqReserveSize=1000, cacheMode=PARTITIONED, backups=1, aff=null, grpName=null], classLdr=null, sslCtxFactory=null, platformCfg=null, binaryCfg=null, memCfg=null, pstCfg=null, dsCfg=DataStorageConfiguration [sysRegionInitSize=41943040, sysRegionMaxSize=104857600, pageSize=4096, concLvl=0, dfltDataRegConf=DataRegionConfiguration [name=default, maxSize=10485760, initSize=268435456, swapPath=null, pageEvictionMode=DISABLED, pageReplacementMode=CLOCK, evictionThreshold=0.9, emptyPagesPoolSize=100, metricsEnabled=false, metricsSubIntervalCount=5, metricsRateTimeInterval=60000, persistenceEnabled=true, checkpointPageBufSize=0, lazyMemoryAllocation=true, warmUpCfg=null], dataRegions=null, storagePath=null, checkpointFreq=180000, lockWaitTime=10000, checkpointThreads=4, checkpointWriteOrder=SEQUENTIAL, walHistSize=20, maxWalArchiveSize=1073741824, walSegments=10, walSegmentSize=67108864, walPath=db/wal, walArchivePath=db/wal/archive, cdcWalPath=db/wal/cdc, cdcEnabled=false, metricsEnabled=false, walMode=FSYNC, walTlbSize=131072, walBuffSize=0, walFlushFreq=2000, walFsyncDelay=1000, walRecordIterBuffSize=67108864, alwaysWriteFullPages=false, fileIOFactory=org.apache.ignite.internal.processors.cache.persistence.file.AsyncFileIOFactory@40ace241, metricsSubIntervalCnt=5, metricsRateTimeInterval=60000, walAutoArchiveAfterInactivity=-1, walForceArchiveTimeout=-1, writeThrottlingEnabled=false, walCompactionEnabled=false, walCompactionLevel=1, checkpointReadLockTimeout=null, walPageCompression=DISABLED, walPageCompressionLevel=null, dfltWarmUpCfg=null, encCfg=org.apache.ignite.configuration.EncryptionConfiguration@62707a5, defragmentationThreadPoolSize=4, minWalArchiveSize=-1], snapshotPath=snapshots, activeOnStart=true, activeOnStartPropSetFlag=false, autoActivation=true, autoActivationPropSetFlag=false, clusterStateOnStart=null, sqlConnCfg=null, cliConnCfg=ClientConnectorConfiguration [host=null, port=10800, portRange=100, sockSndBufSize=0, sockRcvBufSize=0, tcpNoDelay=true, maxOpenCursorsPerConn=128, threadPoolSize=24, selectorCnt=12, idleTimeout=0, handshakeTimeout=10000, jdbcEnabled=true, odbcEnabled=true, thinCliEnabled=true, sslEnabled=false, useIgniteSslCtxFactory=true, sslClientAuth=false, sslCtxFactory=null, thinCliCfg=ThinClientConfiguration [maxActiveTxPerConn=100, maxActiveComputeTasksPerConn=0]], mvccVacuumThreadCnt=2, mvccVacuumFreq=5000, authEnabled=false, failureHnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]], commFailureRslvr=null, sqlCfg=SqlConfiguration [longQryWarnTimeout=3000, dfltQryTimeout=0, sqlQryHistSize=1000, validationEnabled=false], asyncContinuationExecutor=null] [21:05:32] : [Step 4/5] [2021-11-19 21:05:32,658][INFO ][test-runner-#11043%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] Daemon mode: off [21:05:32] : [Step 4/5] [2021-11-19 21:05:32,658][INFO ][test-runner-#11043%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] OS: Linux 4.15.0-151-generic amd64 [21:05:32] : [Step 4/5] [2021-11-19 21:05:32,658][INFO ][test-runner-#11043%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] OS user: teamcity [21:05:32] : [Step 4/5] [2021-11-19 21:05:32,658][INFO ][test-runner-#11043%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] PID: 16724 [21:05:32] : [Step 4/5] [2021-11-19 21:05:32,658][INFO ][test-runner-#11043%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] Language runtime: Java Platform API Specification ver. 1.8 [21:05:32] : [Step 4/5] [2021-11-19 21:05:32,659][INFO ][test-runner-#11043%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] VM information: Java(TM) SE Runtime Environment 1.8.0_261-b12 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 25.261-b12 [21:05:32] : [Step 4/5] [2021-11-19 21:05:32,659][INFO ][test-runner-#11043%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] VM total memory: 1.8GB [21:05:32] : [Step 4/5] [2021-11-19 21:05:32,659][INFO ][test-runner-#11043%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] Remote Management [restart: off, REST: off, JMX (remote: off)] [21:05:32] : [Step 4/5] [2021-11-19 21:05:32,659][INFO ][test-runner-#11043%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] Logger: GridTestLog4jLogger [quiet=false, config=null] [21:05:32] : [Step 4/5] [2021-11-19 21:05:32,660][INFO ][test-runner-#11043%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] IGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c [21:05:32] : [Step 4/5] [2021-11-19 21:05:32,660][INFO ][test-runner-#11043%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] VM arguments: [-DIGNITE_DUMP_THREADS_ON_FAILURE=false, -DMono=/usr/bin/mono-sgen, -DMono4.0_x64=/usr/lib/mono/4.0, -DMono4.5_x64=/usr/lib/mono/4.5, -DMonoVersion=6.12.0.90, -DSKIP_BUILD=false, -Dagent.home.dir=/opt/buildagent, -Dagent.name=aitc-lin02_03, -Dagent.ownPort=9090, -Dagent.work.dir=/opt/buildagent/work, -Dbuild.number=95, -Dbuild.vcs.number=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.1=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.GitHubApacheIgnite=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dclassworlds.conf=/opt/buildagent/temp/buildTmp/teamcity.m2.conf, -Dcom.jetbrains.maven.watcher.report.file=/opt/buildagent/temp/buildTmp/maven-build-info.xml, -Djava.io.tmpdir=/opt/buildagent/temp/buildTmp, -Dmaven.home=/opt/buildagent/tools/maven3_6, -Dmaven.multiModuleProjectDirectory=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.agent.cpuBenchmark=457, -Dteamcity.agent.dotnet.agent_url=http://localhost:9090/RPC2, -Dteamcity.agent.dotnet.build_id=6278078, -Dteamcity.auth.password=*******, -Dteamcity.auth.userId=TeamCityBuildId=6278078, -Dteamcity.build.changedFiles.file=/opt/buildagent/temp/buildTmp/changedFiles6342607772318147725.txt, -Dteamcity.build.checkoutDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.build.id=6278078, -Dteamcity.build.properties.file=/opt/buildagent/temp/buildTmp/teamcity.build5164517880467851002.properties, -Dteamcity.build.tempDir=/opt/buildagent/temp/buildTmp, -Dteamcity.build.workingDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.buildConfName=Basic 3, -Dteamcity.buildType.id=IgniteTests24Java8_Basic3, -Dteamcity.configuration.properties.file=/opt/buildagent/temp/buildTmp/teamcity.config5591980786735343870.properties, -Dteamcity.maven.userSettings.path=/opt/buildagent/temp/buildTmp/maven_settings_585072866407032347.xml, -Dteamcity.maven.watcher.home=/opt/buildagent/plugins/mavenPlugin/maven-watcher-jdk16, -Dteamcity.projectName=Ignite Tests 2.x (JDK 8/11), -Dteamcity.runner.properties.file=/opt/buildagent/temp/buildTmp/teamcity.runner9098465561618137420.properties, -Dteamcity.tests.recentlyFailedTests.file=/opt/buildagent/temp/buildTmp/testsToRunFirst3891775683130404069.txt, -Dteamcity.version=2021.2 (build 99542), -ea, -Xms2g, -Xmx2g, -XX:+HeapDumpOnOutOfMemoryError, -DIGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_TEST_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_UPDATE_NOTIFIER=false, -DIGNITE_NO_DISCO_ORDER=true, -DIGNITE_PERFORMANCE_SUGGESTIONS_DISABLED=true, -Djava.net.preferIPv4Stack=true, -DTEST_SCALE_FACTOR=1.0, -DIGNITE_TEST_PROP_LOG4J_FILE=log4j-tc-test.xml, -DIGNITE_QUIET=false, -DIGNITE_MARSHAL_BUFFERS_RECHECK=1000, -Dmaven.repo.local=/opt/buildagent/.m2/repository] [21:05:32] : [Step 4/5] [2021-11-19 21:05:32,664][INFO ][test-runner-#11043%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] System cache's DataRegion size is configured to 40 MB. Use DataStorageConfiguration.systemRegionInitialSize property to change the setting. [21:05:32] : [Step 4/5] [2021-11-19 21:05:32,665][INFO ][test-runner-#11043%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] Configured caches [in 'sysMemPlc' dataRegion: ['ignite-sys-cache'], in 'default' dataRegion: ['encrypted']] [21:05:32]W: [org.apache.ignite:ignite-core] [2021-11-19 21:05:32,665][WARN ][test-runner-#11043%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] Peer class loading is enabled (disable it in production for performance and deployment consistency reasons) [21:05:32] : [Step 4/5] [2021-11-19 21:05:32,665][INFO ][test-runner-#11043%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] 3-rd party licenses can be found at: /opt/buildagent/work/7bc1c54bc719b67c/libs/licenses [21:05:32] : [Step 4/5] [2021-11-19 21:05:32,669][INFO ][test-runner-#11043%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] Configured plugins: [21:05:32] : [Step 4/5] [2021-11-19 21:05:32,669][INFO ][test-runner-#11043%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- StanByClusterTestProvider 1.0 [21:05:32] : [Step 4/5] [2021-11-19 21:05:32,669][INFO ][test-runner-#11043%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- null [21:05:32] : [Step 4/5] [2021-11-19 21:05:32,669][INFO ][test-runner-#11043%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] [21:05:32] : [Step 4/5] [2021-11-19 21:05:32,669][INFO ][test-runner-#11043%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- PageMemory tracker plugin 1.0 [21:05:32] : [Step 4/5] [2021-11-19 21:05:32,670][INFO ][test-runner-#11043%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- null [21:05:32] : [Step 4/5] [2021-11-19 21:05:32,670][INFO ][test-runner-#11043%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] [21:05:32] : [Step 4/5] [2021-11-19 21:05:32,670][INFO ][test-runner-#11043%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- TestDistibutedConfigurationPlugin 1.0 [21:05:32] : [Step 4/5] [2021-11-19 21:05:32,670][INFO ][test-runner-#11043%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- null [21:05:32] : [Step 4/5] [2021-11-19 21:05:32,670][INFO ][test-runner-#11043%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] [21:05:32] : [Step 4/5] [2021-11-19 21:05:32,670][INFO ][test-runner-#11043%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- NodeValidationPluginProvider 1.0 [21:05:32] : [Step 4/5] [2021-11-19 21:05:32,671][INFO ][test-runner-#11043%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- null [21:05:32] : [Step 4/5] [2021-11-19 21:05:32,671][INFO ][test-runner-#11043%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] [21:05:32] : [Step 4/5] [2021-11-19 21:05:32,671][INFO ][test-runner-#11043%encryption.EncryptedCacheNodeJoinTest%][FailureProcessor] Configured failure handler: [hnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]]] [21:05:32] : [Step 4/5] [2021-11-19 21:05:32,682][INFO ][test-runner-#11043%encryption.EncryptedCacheNodeJoinTest%][TcpCommunicationSpi] Successfully bound communication NIO server to TCP port [port=45151, locHost=/127.0.0.1, selectorsCnt=12, selectorSpins=0, pairedConn=false] [21:05:32]W: [org.apache.ignite:ignite-core] [2021-11-19 21:05:32,682][WARN ][test-runner-#11043%encryption.EncryptedCacheNodeJoinTest%][TcpCommunicationSpi] Message queue limit is set to 0 which may lead to potential OOMEs when running cache operations in FULL_ASYNC or PRIMARY_SYNC modes due to message queues growth on sender and receiver sides. [21:05:32] : [Step 4/5] [2021-11-19 21:05:32,685][INFO ][test-runner-#11043%encryption.EncryptedCacheNodeJoinTest%][GridCollisionManager] Collision resolution is disabled (all jobs will be activated upon arrival). [21:05:32] : [Step 4/5] [2021-11-19 21:05:32,686][INFO ][test-runner-#11043%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] Security status [authentication=off, sandbox=off, tls/ssl=off] [21:05:32] : [Step 4/5] [2021-11-19 21:05:32,741][INFO ][test-runner-#11043%encryption.EncryptedCacheNodeJoinTest%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:05:32] : [Step 4/5] [2021-11-19 21:05:32,923][INFO ][test-runner-#11043%encryption.EncryptedCacheNodeJoinTest%][MaintenanceProcessor] Resolved store directory for node persistent data: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0 [21:05:32] : [Step 4/5] [2021-11-19 21:05:32,924][INFO ][test-runner-#11043%encryption.EncryptedCacheNodeJoinTest%][CacheObjectBinaryProcessorImpl] Resolved directory for serialized binary metadata: /opt/buildagent/work/7bc1c54bc719b67c/work/db/binary_meta/grid_0 [21:05:32] : [Step 4/5] [2021-11-19 21:05:32,928][INFO ][test-runner-#11043%encryption.EncryptedCacheNodeJoinTest%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0 [21:05:32] : [Step 4/5] [2021-11-19 21:05:32,928][INFO ][test-runner-#11043%encryption.EncryptedCacheNodeJoinTest%][FileWriteAheadLogManager] Resolved write ahead log work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0 [21:05:32] : [Step 4/5] [2021-11-19 21:05:32,928][INFO ][test-runner-#11043%encryption.EncryptedCacheNodeJoinTest%][FileWriteAheadLogManager] Resolved write ahead log archive directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0 [21:05:32] : [Step 4/5] [2021-11-19 21:05:32,986][INFO ][db-checkpoint-thread-#11166%grid-5%][Checkpointer] Checkpoint finished [cpId=842ae7f4-4913-4b4a-ada6-0a73cbe56a36, pages=21, markPos=WALPointer [idx=0, fileOff=148404, len=21425], walSegmentsCovered=[], markDuration=6ms, pagesWrite=1ms, fsync=404ms, total=413ms] [21:05:33] : [Step 4/5] [2021-11-19 21:05:33,899][INFO ][test-runner-#11043%encryption.EncryptedCacheNodeJoinTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000000.wal [21:05:33] : [Step 4/5] [2021-11-19 21:05:33,903][INFO ][test-runner-#11043%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Configured data regions initialized successfully [total=5] [21:05:33] : [Step 4/5] [2021-11-19 21:05:33,906][INFO ][test-runner-#11043%encryption.EncryptedCacheNodeJoinTest%][IgniteSnapshotManager] Resolved snapshot work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/snapshots [21:05:33] : [Step 4/5] [2021-11-19 21:05:33,906][INFO ][test-runner-#11043%encryption.EncryptedCacheNodeJoinTest%][IgniteSnapshotManager] Resolved temp directory for snapshot creation: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0/snp [21:05:33] : [Step 4/5] [2021-11-19 21:05:33,908][INFO ][test-runner-#11043%encryption.EncryptedCacheNodeJoinTest%][ClientListenerProcessor] Client connector processor has started on TCP port 10801 [21:05:33] : [Step 4/5] [2021-11-19 21:05:33,911][INFO ][test-runner-#11043%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] Non-loopback local IPs: 172.17.0.4 [21:05:33] : [Step 4/5] [2021-11-19 21:05:33,911][INFO ][test-runner-#11043%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] Enabled local MACs: 0242AC110004 [21:05:33] : [Step 4/5] [2021-11-19 21:05:33,912][INFO ][test-runner-#11043%encryption.EncryptedCacheNodeJoinTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:05:33] : [Step 4/5] [2021-11-19 21:05:33,914][INFO ][test-runner-#11043%encryption.EncryptedCacheNodeJoinTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:05:33] : [Step 4/5] [2021-11-19 21:05:33,914][INFO ][test-runner-#11043%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:05:33] : [Step 4/5] [2021-11-19 21:05:33,916][INFO ][test-runner-#11043%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Applying lost metastore updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:05:33] : [Step 4/5] [2021-11-19 21:05:33,917][INFO ][test-runner-#11043%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=0 ms] [21:05:33] : [Step 4/5] [2021-11-19 21:05:33,917][INFO ][test-runner-#11043%encryption.EncryptedCacheNodeJoinTest%][GridCacheProcessor] Restoring partition state for local groups. [21:05:33] : [Step 4/5] [2021-11-19 21:05:33,917][INFO ][test-runner-#11043%encryption.EncryptedCacheNodeJoinTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=0, partitionsProcessed=0, time=0ms] [21:05:33] : [Step 4/5] [2021-11-19 21:05:33,918][INFO ][test-runner-#11043%encryption.EncryptedCacheNodeJoinTest%][GridEncryptionManager] Encryption keys loaded from metastore. [grps=, masterKeyName=ignite.master.key] [21:05:33] : [Step 4/5] [2021-11-19 21:05:33,919][INFO ][test-runner-#11043%encryption.EncryptedCacheNodeJoinTest%][ClusterProcessor] Cluster ID and tag has been read from metastorage: null [21:05:33] : [Step 4/5] [2021-11-19 21:05:33,920][INFO ][test-runner-#11043%encryption.EncryptedCacheNodeJoinTest%][IgniteClusterImpl] Shutdown policy was updated [oldVal=null, newVal=null] [21:05:33] : [Step 4/5] [2021-11-19 21:05:33,920][INFO ][test-runner-#11043%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Checkpoint frequency deviation changed [oldVal=null, newVal=null] [21:05:33] : [Step 4/5] [2021-11-19 21:05:33,932][INFO ][test-runner-#11043%encryption.EncryptedCacheNodeJoinTest%][FilePageStoreManager] Cleanup cache stores [total=1, left=0, cleanFiles=false] [21:05:33] : [Step 4/5] [2021-11-19 21:05:33,934][INFO ][test-runner-#11043%encryption.EncryptedCacheNodeJoinTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:05:33] : [Step 4/5] [2021-11-19 21:05:33,935][INFO ][test-runner-#11043%encryption.EncryptedCacheNodeJoinTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:05:33] : [Step 4/5] [2021-11-19 21:05:33,937][INFO ][test-runner-#11043%encryption.EncryptedCacheNodeJoinTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:05:33] : [Step 4/5] [2021-11-19 21:05:33,937][INFO ][test-runner-#11043%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Data Regions Started: 5 [21:05:33] : [Step 4/5] [2021-11-19 21:05:33,937][INFO ][test-runner-#11043%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] ^-- sysMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:05:33] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:05:33] : [Step 4/5] ^-- default region [type=default, persistence=true, lazyAlloc=true, [21:05:33] : [Step 4/5] ... initCfg=10MB, maxCfg=10MB, usedRam=0MB, freeRam=100%, allocRam=0MB, allocTotal=0MB] [21:05:33] : [Step 4/5] ^-- metastoreMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:05:33] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:05:33] : [Step 4/5] ^-- TxLog region [type=internal, persistence=true, lazyAlloc=false, [21:05:33] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:05:33] : [Step 4/5] ^-- volatileDsMemPlc region [type=user, persistence=false, lazyAlloc=true, [21:05:33] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB] [21:05:33] : [Step 4/5] ^-- Ignite persistence [used=0MB] [21:05:33] : [Step 4/5] [21:05:33] : [Step 4/5] [2021-11-19 21:05:33,939][INFO ][test-runner-#11043%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Starting binary memory restore for: [-2100569601, 1613773252] [21:05:34] : [Step 4/5] [2021-11-19 21:05:34,000][INFO ][test-runner-#11043%encryption.EncryptedCacheNodeJoinTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:05:34] : [Step 4/5] [2021-11-19 21:05:34,000][INFO ][test-runner-#11043%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:05:34] : [Step 4/5] [2021-11-19 21:05:34,002][INFO ][test-runner-#11043%encryption.EncryptedCacheNodeJoinTest%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000000.wal, offset=0, ver=2] [21:05:34] : [Step 4/5] [2021-11-19 21:05:34,155][INFO ][test-runner-#11043%encryption.EncryptedCacheNodeJoinTest%][GridCacheProcessor] Started cache in recovery mode [name=ignite-sys-cache, id=-2100569601, dataRegionName=sysMemPlc, mode=REPLICATED, atomicity=TRANSACTIONAL, backups=2147483647, mvcc=false] [21:05:34] : [Step 4/5] [2021-11-19 21:05:34,156][INFO ][test-runner-#11043%encryption.EncryptedCacheNodeJoinTest%][PageMemoryImpl] Started page memory [memoryAllocated=24.0 MiB, pages=5952, tableSize=474.2 KiB, replacementSize=768 B, checkpointBuffer=10.0 MiB] [21:05:34] : [Step 4/5] [2021-11-19 21:05:34,159][INFO ][test-runner-#11043%encryption.EncryptedCacheNodeJoinTest%][GridCacheProcessor] Started cache in recovery mode [name=encrypted, id=1613773252, dataRegionName=default, mode=PARTITIONED, atomicity=TRANSACTIONAL, backups=0, mvcc=false] [21:05:34] : [Step 4/5] [2021-11-19 21:05:34,160][INFO ][test-runner-#11043%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Binary recovery performed in 221 ms. [21:05:34] : [Step 4/5] [2021-11-19 21:05:34,160][INFO ][test-runner-#11043%encryption.EncryptedCacheNodeJoinTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:05:34] : [Step 4/5] [2021-11-19 21:05:34,160][INFO ][test-runner-#11043%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Applying lost cache updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:05:34] : [Step 4/5] [2021-11-19 21:05:34,224][INFO ][test-runner-#11043%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=71 ms] [21:05:34] : [Step 4/5] [2021-11-19 21:05:34,224][INFO ][test-runner-#11043%encryption.EncryptedCacheNodeJoinTest%][GridCacheProcessor] Restoring partition state for local groups. [21:05:34] : [Step 4/5] [2021-11-19 21:05:34,241][INFO ][test-runner-#11043%encryption.EncryptedCacheNodeJoinTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=2, partitionsProcessed=1124, time=10ms] [21:05:34] : [Step 4/5] [2021-11-19 21:05:34,729][INFO ][test-runner-#11043%encryption.EncryptedCacheNodeJoinTest%][TestTcpDiscoverySpi] Successfully bound to TCP port [port=47501, localHost=localhost/127.0.0.1, locNodeId=009fc6f1-991c-4d21-a8fb-6db0e46d9000] [21:05:34] : [Step 4/5] [2021-11-19 21:05:34,732][INFO ][test-runner-#11043%encryption.EncryptedCacheNodeJoinTest%][GridEncryptionManager] Sending new group keys to coordinator [grps=1613773252] [21:05:34] : [Step 4/5] [2021-11-19 21:05:34,735][INFO ][tcp-disco-srvr-[:47500]-#581%grid-5%-#11157%grid-5%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=42709] [21:05:34] : [Step 4/5] [2021-11-19 21:05:34,735][INFO ][tcp-disco-srvr-[:47500]-#581%grid-5%-#11157%grid-5%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=42709] [21:05:34] : [Step 4/5] [2021-11-19 21:05:34,736][INFO ][tcp-disco-sock-reader-[]-#587%grid-5%-#11289%grid-5%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:42709, rmtPort=42709] [21:05:34] : [Step 4/5] [2021-11-19 21:05:34,738][INFO ][tcp-disco-sock-reader-[009fc6f1 127.0.0.1:42709]-#587%grid-5%-#11289%grid-5%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=009fc6f1-991c-4d21-a8fb-6db0e46d9000, rmtAddr=/127.0.0.1:42709] [21:05:34] : [Step 4/5] [2021-11-19 21:05:34,743][INFO ][tcp-disco-srvr-[:47501]-#586%grid-0%-#11288%grid-0%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=54597] [21:05:34] : [Step 4/5] [2021-11-19 21:05:34,744][INFO ][tcp-disco-srvr-[:47501]-#586%grid-0%-#11288%grid-0%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=54597] [21:05:34] : [Step 4/5] [2021-11-19 21:05:34,745][INFO ][tcp-disco-sock-reader-[]-#588%grid-0%-#11290%grid-0%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:54597, rmtPort=54597] [21:05:34] : [Step 4/5] [2021-11-19 21:05:34,745][INFO ][tcp-disco-sock-reader-[]-#588%grid-0%-#11290%grid-0%][TestTcpDiscoverySpi] Received ping request from the remote node [rmtNodeId=502bd102-0a78-48d8-9b8f-f181ec67e005, rmtAddr=/127.0.0.1:54597, rmtPort=54597] [21:05:34] : [Step 4/5] [2021-11-19 21:05:34,746][INFO ][tcp-disco-sock-reader-[]-#588%grid-0%-#11290%grid-0%][TestTcpDiscoverySpi] Finished writing ping response [rmtNodeId=502bd102-0a78-48d8-9b8f-f181ec67e005, rmtAddr=/127.0.0.1:54597, rmtPort=54597] [21:05:34]W: [org.apache.ignite:ignite-core] [2021-11-19 21:05:34,747][WARN ][tcp-disco-sock-reader-[]-#588%grid-0%-#11290%grid-0%][TestTcpDiscoverySpi] Failed to shutdown socket [21:05:34]W: [org.apache.ignite:ignite-core] java.net.SocketException: Socket output is already shutdown [21:05:34]W: [org.apache.ignite:ignite-core] at java.net.Socket.shutdownOutput(Socket.java:1572) [21:05:34]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.close(IgniteUtils.java:4247) [21:05:34]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.discovery.tcp.ServerImpl$SocketReader.body(ServerImpl.java:7370) [21:05:34]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.IgniteSpiThread.run(IgniteSpiThread.java:58) [21:05:34] : [Step 4/5] [2021-11-19 21:05:34,747][INFO ][tcp-disco-sock-reader-[009fc6f1 127.0.0.1:42709]-#587%grid-5%-#11289%grid-5%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:42709, rmtPort=42709, rmtNodeId=009fc6f1-991c-4d21-a8fb-6db0e46d9000] [21:05:34] : [Step 4/5] [2021-11-19 21:05:34,748][INFO ][tcp-disco-sock-reader-[]-#588%grid-0%-#11290%grid-0%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:54597, rmtPort=54597, rmtNodeId=null] [21:05:34] : [Step 4/5] [2021-11-19 21:05:34,750][INFO ][tcp-disco-msg-worker-[crd]-#580%grid-5%-#11156%grid-5%][GridEncryptionManager] Joining node doesn't have stored group keys [node=009fc6f1-991c-4d21-a8fb-6db0e46d9000] [21:05:34] : [Step 4/5] [2021-11-19 21:05:34,752][INFO ][tcp-disco-srvr-[:47501]-#586%grid-0%-#11288%grid-0%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=37333] [21:05:34] : [Step 4/5] [2021-11-19 21:05:34,752][INFO ][tcp-disco-srvr-[:47501]-#586%grid-0%-#11288%grid-0%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=37333] [21:05:34] : [Step 4/5] [2021-11-19 21:05:34,753][INFO ][tcp-disco-sock-reader-[]-#589%grid-0%-#11292%grid-0%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:37333, rmtPort=37333] [21:05:34] : [Step 4/5] [2021-11-19 21:05:34,753][INFO ][tcp-disco-sock-reader-[]-#589%grid-0%-#11292%grid-0%][TestTcpDiscoverySpi] Received ping request from the remote node [rmtNodeId=502bd102-0a78-48d8-9b8f-f181ec67e005, rmtAddr=/127.0.0.1:37333, rmtPort=37333] [21:05:34] : [Step 4/5] [2021-11-19 21:05:34,754][INFO ][tcp-disco-sock-reader-[]-#589%grid-0%-#11292%grid-0%][TestTcpDiscoverySpi] Finished writing ping response [rmtNodeId=502bd102-0a78-48d8-9b8f-f181ec67e005, rmtAddr=/127.0.0.1:37333, rmtPort=37333] [21:05:34]W: [org.apache.ignite:ignite-core] [2021-11-19 21:05:34,755][WARN ][disco-pool-#11291%grid-5%][TestTcpDiscoverySpi] Failed to join node to the cluster (encryption settings are different for cache 'encrypted' : local=true, remote=false.) [21:05:34] : [Step 4/5] [2021-11-19 21:05:34,755][INFO ][tcp-disco-sock-reader-[]-#589%grid-0%-#11292%grid-0%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:37333, rmtPort=37333, rmtNodeId=null] [21:05:34] : [Step 4/5] [2021-11-19 21:05:34,756][INFO ][tcp-disco-srvr-[:47501]-#586%grid-0%-#11288%grid-0%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=35463] [21:05:34] : [Step 4/5] [2021-11-19 21:05:34,756][INFO ][tcp-disco-srvr-[:47501]-#586%grid-0%-#11288%grid-0%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=35463] [21:05:34] : [Step 4/5] [2021-11-19 21:05:34,756][INFO ][tcp-disco-sock-reader-[]-#590%grid-0%-#11293%grid-0%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:35463, rmtPort=35463] [21:05:34] : [Step 4/5] [2021-11-19 21:05:34,758][INFO ][tcp-disco-sock-reader-[502bd102 127.0.0.1:35463]-#590%grid-0%-#11293%grid-0%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=502bd102-0a78-48d8-9b8f-f181ec67e005, rmtAddr=/127.0.0.1:35463] [21:05:34] : [Step 4/5] [2021-11-19 21:05:34,760][INFO ][tcp-disco-sock-reader-[502bd102 127.0.0.1:35463]-#590%grid-0%-#11293%grid-0%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:35463, rmtPort=35463, rmtNodeId=502bd102-0a78-48d8-9b8f-f181ec67e005] [21:05:34]W: [org.apache.ignite:ignite-core] [2021-11-19 21:05:34,761][ERROR][test-runner-#11043%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] Failed to start manager: GridManagerAdapter [enabled=true, name=o.a.i.i.managers.discovery.GridDiscoveryManager] [21:05:34]W: [org.apache.ignite:ignite-core] class org.apache.ignite.IgniteCheckedException: Failed to start SPI: TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=5000, ackTimeout=5000, marsh=JdkMarshaller [clsFilter=org.apache.ignite.marshaller.MarshallerUtils$1@7d84b186], reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false] [21:05:34]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.managers.GridManagerAdapter.startSpi(GridManagerAdapter.java:281) [21:05:34]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.managers.discovery.GridDiscoveryManager.start(GridDiscoveryManager.java:1091) [21:05:34]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.IgniteKernal.startManager(IgniteKernal.java:1953) [21:05:34]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.IgniteKernal.start(IgniteKernal.java:1300) [21:05:34]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.IgnitionEx$IgniteNamedInstance.start0(IgnitionEx.java:1798) [21:05:34]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.IgnitionEx$IgniteNamedInstance.start(IgnitionEx.java:1720) [21:05:34]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.IgnitionEx.start0(IgnitionEx.java:1159) [21:05:34]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.IgnitionEx.start(IgnitionEx.java:629) [21:05:34]W: [org.apache.ignite:ignite-core] at org.apache.ignite.testframework.junits.GridAbstractTest.startGrid(GridAbstractTest.java:1252) [21:05:34]W: [org.apache.ignite:ignite-core] at org.apache.ignite.testframework.junits.GridAbstractTest.startGrid(GridAbstractTest.java:1169) [21:05:34]W: [org.apache.ignite:ignite-core] at org.apache.ignite.testframework.junits.GridAbstractTest.startGrid(GridAbstractTest.java:1145) [21:05:34]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.encryption.EncryptedCacheNodeJoinTest.lambda$testNodeCantJoinWithSameNameButEncCache$5(EncryptedCacheNodeJoinTest.java:351) [21:05:34]W: [org.apache.ignite:ignite-core] at org.apache.ignite.testframework.GridTestUtils$1.call(GridTestUtils.java:616) [21:05:34]W: [org.apache.ignite:ignite-core] at org.apache.ignite.testframework.GridTestUtils$1.call(GridTestUtils.java:614) [21:05:34]W: [org.apache.ignite:ignite-core] at org.apache.ignite.testframework.GridTestUtils.assertThrowsWithCause(GridTestUtils.java:636) [21:05:34]W: [org.apache.ignite:ignite-core] at org.apache.ignite.testframework.GridTestUtils.assertThrowsWithCause(GridTestUtils.java:614) [21:05:34]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.encryption.EncryptedCacheNodeJoinTest.testNodeCantJoinWithSameNameButEncCache(EncryptedCacheNodeJoinTest.java:349) [21:05:34]W: [org.apache.ignite:ignite-core] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) [21:05:34]W: [org.apache.ignite:ignite-core] at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) [21:05:34]W: [org.apache.ignite:ignite-core] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [21:05:34]W: [org.apache.ignite:ignite-core] at java.lang.reflect.Method.invoke(Method.java:498) [21:05:34]W: [org.apache.ignite:ignite-core] at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50) [21:05:34]W: [org.apache.ignite:ignite-core] at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) [21:05:34]W: [org.apache.ignite:ignite-core] at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47) [21:05:34]W: [org.apache.ignite:ignite-core] at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) [21:05:34]W: [org.apache.ignite:ignite-core] at org.apache.ignite.testframework.junits.GridAbstractTest$7.run(GridAbstractTest.java:2432) [21:05:34]W: [org.apache.ignite:ignite-core] at java.lang.Thread.run(Thread.java:748) [21:05:34]W: [org.apache.ignite:ignite-core] Caused by: class org.apache.ignite.spi.IgniteSpiException: Failed to join node to the cluster (encryption settings are different for cache 'encrypted' : local=true, remote=false.) [21:05:34]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.discovery.tcp.TcpDiscoverySpi.checkFailedError(TcpDiscoverySpi.java:2108) [21:05:34]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.discovery.tcp.ServerImpl.joinTopology(ServerImpl.java:1206) [21:05:34]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.discovery.tcp.ServerImpl.spiStart(ServerImpl.java:474) [21:05:34]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.discovery.tcp.TcpDiscoverySpi.spiStart(TcpDiscoverySpi.java:2210) [21:05:34]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.managers.GridManagerAdapter.startSpi(GridManagerAdapter.java:278) [21:05:34]W: [org.apache.ignite:ignite-core] ... 26 more [21:05:34]W: [org.apache.ignite:ignite-core] [2021-11-19 21:05:34,769][ERROR][test-runner-#11043%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] Got exception while starting (will rollback startup routine). [21:05:34]W: [org.apache.ignite:ignite-core] class org.apache.ignite.IgniteCheckedException: Failed to start manager: GridManagerAdapter [enabled=true, name=org.apache.ignite.internal.managers.discovery.GridDiscoveryManager] [21:05:34]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.IgniteKernal.startManager(IgniteKernal.java:1958) [21:05:34]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.IgniteKernal.start(IgniteKernal.java:1300) [21:05:34]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.IgnitionEx$IgniteNamedInstance.start0(IgnitionEx.java:1798) [21:05:34]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.IgnitionEx$IgniteNamedInstance.start(IgnitionEx.java:1720) [21:05:34]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.IgnitionEx.start0(IgnitionEx.java:1159) [21:05:34]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.IgnitionEx.start(IgnitionEx.java:629) [21:05:34]W: [org.apache.ignite:ignite-core] at org.apache.ignite.testframework.junits.GridAbstractTest.startGrid(GridAbstractTest.java:1252) [21:05:34]W: [org.apache.ignite:ignite-core] at org.apache.ignite.testframework.junits.GridAbstractTest.startGrid(GridAbstractTest.java:1169) [21:05:34]W: [org.apache.ignite:ignite-core] at org.apache.ignite.testframework.junits.GridAbstractTest.startGrid(GridAbstractTest.java:1145) [21:05:34]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.encryption.EncryptedCacheNodeJoinTest.lambda$testNodeCantJoinWithSameNameButEncCache$5(EncryptedCacheNodeJoinTest.java:351) [21:05:34]W: [org.apache.ignite:ignite-core] at org.apache.ignite.testframework.GridTestUtils$1.call(GridTestUtils.java:616) [21:05:34]W: [org.apache.ignite:ignite-core] at org.apache.ignite.testframework.GridTestUtils$1.call(GridTestUtils.java:614) [21:05:34]W: [org.apache.ignite:ignite-core] at org.apache.ignite.testframework.GridTestUtils.assertThrowsWithCause(GridTestUtils.java:636) [21:05:34]W: [org.apache.ignite:ignite-core] at org.apache.ignite.testframework.GridTestUtils.assertThrowsWithCause(GridTestUtils.java:614) [21:05:34]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.encryption.EncryptedCacheNodeJoinTest.testNodeCantJoinWithSameNameButEncCache(EncryptedCacheNodeJoinTest.java:349) [21:05:34]W: [org.apache.ignite:ignite-core] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) [21:05:34]W: [org.apache.ignite:ignite-core] at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) [21:05:34]W: [org.apache.ignite:ignite-core] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [21:05:34]W: [org.apache.ignite:ignite-core] at java.lang.reflect.Method.invoke(Method.java:498) [21:05:34]W: [org.apache.ignite:ignite-core] at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50) [21:05:34]W: [org.apache.ignite:ignite-core] at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) [21:05:34]W: [org.apache.ignite:ignite-core] at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47) [21:05:34]W: [org.apache.ignite:ignite-core] at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) [21:05:34]W: [org.apache.ignite:ignite-core] at org.apache.ignite.testframework.junits.GridAbstractTest$7.run(GridAbstractTest.java:2432) [21:05:34]W: [org.apache.ignite:ignite-core] at java.lang.Thread.run(Thread.java:748) [21:05:34]W: [org.apache.ignite:ignite-core] Caused by: class org.apache.ignite.IgniteCheckedException: Failed to start SPI: TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=5000, ackTimeout=5000, marsh=JdkMarshaller [clsFilter=org.apache.ignite.marshaller.MarshallerUtils$1@7d84b186], reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false] [21:05:34]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.managers.GridManagerAdapter.startSpi(GridManagerAdapter.java:281) [21:05:34]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.managers.discovery.GridDiscoveryManager.start(GridDiscoveryManager.java:1091) [21:05:34]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.IgniteKernal.startManager(IgniteKernal.java:1953) [21:05:34]W: [org.apache.ignite:ignite-core] ... 24 more [21:05:34]W: [org.apache.ignite:ignite-core] Caused by: class org.apache.ignite.spi.IgniteSpiException: Failed to join node to the cluster (encryption settings are different for cache 'encrypted' : local=true, remote=false.) [21:05:34]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.discovery.tcp.TcpDiscoverySpi.checkFailedError(TcpDiscoverySpi.java:2108) [21:05:34]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.discovery.tcp.ServerImpl.joinTopology(ServerImpl.java:1206) [21:05:34]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.discovery.tcp.ServerImpl.spiStart(ServerImpl.java:474) [21:05:34]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.discovery.tcp.TcpDiscoverySpi.spiStart(TcpDiscoverySpi.java:2210) [21:05:34]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.managers.GridManagerAdapter.startSpi(GridManagerAdapter.java:278) [21:05:34]W: [org.apache.ignite:ignite-core] ... 26 more [21:05:39] : [Step 4/5] [2021-11-19 21:05:39,780][INFO ][test-runner-#11043%encryption.EncryptedCacheNodeJoinTest%][TestTcpDiscoverySpi] No verification for local node leave has been received from coordinator (will stop node anyway). [21:05:39] : [Step 4/5] [2021-11-19 21:05:39,783][INFO ][test-runner-#11043%encryption.EncryptedCacheNodeJoinTest%][GridCacheProcessor] Stopped cache [cacheName=encrypted] [21:05:39] : [Step 4/5] [2021-11-19 21:05:39,785][INFO ][test-runner-#11043%encryption.EncryptedCacheNodeJoinTest%][GridCacheProcessor] Stopped cache [cacheName=ignite-sys-cache] [21:05:39] : [Step 4/5] [2021-11-19 21:05:39,969][INFO ][test-runner-#11043%encryption.EncryptedCacheNodeJoinTest%][FilePageStoreManager] Cleanup cache stores [total=4, left=0, cleanFiles=false] [21:05:39] : [Step 4/5] [2021-11-19 21:05:39,978][INFO ][test-runner-#11043%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] [21:05:39] : [Step 4/5] [21:05:39] : [Step 4/5] >>> +------------------------------------------------------+ [21:05:39] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV stopped OK [21:05:39] : [Step 4/5] >>> +------------------------------------------------------+ [21:05:39] : [Step 4/5] >>> Ignite instance name: grid-0 [21:05:39] : [Step 4/5] >>> Grid uptime: 00:00:07.330 [21:05:39] : [Step 4/5] [21:05:39] : [Step 4/5] [21:05:39] : [Step 4/5] [21:05:39] >>> Stopping test: EncryptedCacheNodeJoinTest#testNodeCantJoinWithSameNameButEncCache in 8917 ms <<< [21:05:39] : [Step 4/5] [2021-11-19 21:05:39,979][INFO ][main][root] >>> Stopping test: EncryptedCacheNodeJoinTest#testNodeCantJoinWithSameNameButEncCache in 8917 ms <<< [21:05:39] : [Step 4/5] [21:05:39] >>> Heap: 348 MB used / 1893 MB commited / 1893 MB max <<< [21:05:39] : [Step 4/5] [2021-11-19 21:05:39,979][INFO ][main][root] >>> Heap: 348 MB used / 1893 MB commited / 1893 MB max <<< [21:05:39] : [Step 4/5] [21:05:39] >>> Non-Heap: 145 MB used / 158 MB commited / 0 MB max <<< [21:05:39] : [Step 4/5] [2021-11-19 21:05:39,980][INFO ][main][root] >>> Non-Heap: 145 MB used / 158 MB commited / 0 MB max <<< [21:05:39] : [Step 4/5] [2021-11-19 21:05:39,980][INFO ][main][root] >>> Stopping grid [name=grid-5, id=502bd102-0a78-48d8-9b8f-f181ec67e005] [21:05:39] : [Step 4/5] [2021-11-19 21:05:39,990][INFO ][db-checkpoint-thread-#11166%grid-5%][Checkpointer] Skipping checkpoint (no pages were modified) [checkpointBeforeLockTime=3ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=1ms, checkpointLockHoldTime=2ms, reason='timeout'] [21:05:39] : [Step 4/5] [2021-11-19 21:05:39,996][INFO ][main][GridCacheProcessor] Stopped cache [cacheName=encrypted] [21:05:39] : [Step 4/5] [2021-11-19 21:05:39,997][INFO ][main][GridCacheProcessor] Stopped cache [cacheName=ignite-sys-cache] [21:05:40] : [Step 4/5] [2021-11-19 21:05:40,000][INFO ][main][FilePageStoreManager] Cleanup cache stores [total=4, left=0, cleanFiles=false] [21:05:40] : [Step 4/5] [2021-11-19 21:05:40,009][INFO ][main][IgniteKernal%grid-5] [21:05:40] : [Step 4/5] [21:05:40] : [Step 4/5] >>> +------------------------------------------------------+ [21:05:40] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV stopped OK [21:05:40] : [Step 4/5] >>> +------------------------------------------------------+ [21:05:40] : [Step 4/5] >>> Ignite instance name: grid-5 [21:05:40] : [Step 4/5] >>> Grid uptime: 00:00:07.512 [21:05:40] : [Step 4/5] [21:05:40] : [Step 4/5] [21:05:40] : [Step 4/5] [21:05:40] >>> Starting test: EncryptedCacheNodeJoinTest#testNodeCanJoin <<< [21:05:40] : [Step 4/5] [2021-11-19 21:05:40,185][INFO ][main][root] >>> Starting test: EncryptedCacheNodeJoinTest#testNodeCanJoin <<< [21:05:40] : [Step 4/5] [21:05:40] >>> Heap: 349 MB used / 1893 MB commited / 1893 MB max <<< [21:05:40] : [Step 4/5] [2021-11-19 21:05:40,185][INFO ][main][root] >>> Heap: 349 MB used / 1893 MB commited / 1893 MB max <<< [21:05:40] : [Step 4/5] [21:05:40] >>> Non-Heap: 145 MB used / 158 MB commited / 0 MB max <<< [21:05:40] : [Step 4/5] [2021-11-19 21:05:40,186][INFO ][main][root] >>> Non-Heap: 145 MB used / 158 MB commited / 0 MB max <<< [21:05:40]W: [org.apache.ignite:ignite-core] [2021-11-19 21:05:40,190][WARN ][test-runner-#11294%encryption.EncryptedCacheNodeJoinTest%][G] Ignite work directory is not provided, automatically resolved to: /opt/buildagent/work/7bc1c54bc719b67c/work [21:05:40] : [Step 4/5] [2021-11-19 21:05:40,192][INFO ][test-runner-#11294%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] [21:05:40] : [Step 4/5] [21:05:40] : [Step 4/5] >>> __________ ________________ [21:05:40] : [Step 4/5] >>> / _/ ___/ |/ / _/_ __/ __/ [21:05:40] : [Step 4/5] >>> _/ // (7 7 // / / / / _/ [21:05:40] : [Step 4/5] >>> /___/\___/_/|_/___/ /_/ /___/ [21:05:40] : [Step 4/5] >>> [21:05:40] : [Step 4/5] >>> ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:05:40] : [Step 4/5] >>> 2021 Copyright(C) Apache Software Foundation [21:05:40] : [Step 4/5] >>> [21:05:40] : [Step 4/5] >>> Ignite documentation: http://ignite.apache.org [21:05:40] : [Step 4/5] [21:05:40] : [Step 4/5] [2021-11-19 21:05:40,194][INFO ][test-runner-#11294%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] Config URL: n/a [21:05:40] : [Step 4/5] [2021-11-19 21:05:40,195][INFO ][test-runner-#11294%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] IgniteConfiguration [igniteInstanceName=grid-0, pubPoolSize=24, svcPoolSize=24, callbackPoolSize=24, stripedPoolSize=24, sysPoolSize=24, mgmtPoolSize=4, dataStreamerPoolSize=24, utilityCachePoolSize=24, utilityCacheKeepAliveTime=60000, p2pPoolSize=2, qryPoolSize=24, buildIdxPoolSize=4, igniteHome=/opt/buildagent/work/7bc1c54bc719b67c, igniteWorkDir=/opt/buildagent/work/7bc1c54bc719b67c/work, mbeanSrv=com.sun.jmx.mbeanserver.JmxMBeanServer@6fe85038, nodeId=0003343f-ac12-43ac-80ca-eb6563417000, marsh=BinaryMarshaller [], marshLocJobs=false, daemon=false, p2pEnabled=true, netTimeout=10000, netCompressionLevel=1, sndRetryDelay=1000, sndRetryCnt=3, metricsHistSize=10000, metricsUpdateFreq=1000, metricsExpTime=9223372036854775807, discoSpi=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=0, ackTimeout=0, marsh=null, reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], segPlc=STOP, segResolveAttempts=2, waitForSegOnStart=true, allResolversPassReq=true, segChkFreq=10000, commSpi=TcpCommunicationSpi [connectGate=org.apache.ignite.spi.communication.tcp.internal.ConnectGateway@3d6b5a1c, ctxInitLatch=java.util.concurrent.CountDownLatch@49d8af90[Count = 1], stopping=false, clientPool=null, nioSrvWrapper=null, stateProvider=null], evtSpi=MemoryEventStorageSpi [expireAgeMs=9223372036854775807, expireCnt=10000, filter=null], colSpi=NoopCollisionSpi [], deploySpi=LocalDeploymentSpi [], indexingSpi=org.apache.ignite.spi.indexing.noop.NoopIndexingSpi@36098bfe, addrRslvr=null, encryptionSpi=org.apache.ignite.spi.encryption.keystore.KeystoreEncryptionSpi@5a868b61, tracingSpi=org.apache.ignite.spi.tracing.NoopTracingSpi@6f26f8c0, clientMode=false, rebalanceThreadPoolSize=4, rebalanceTimeout=10000, rebalanceBatchesPrefetchCnt=3, rebalanceThrottle=0, rebalanceBatchSize=524288, txCfg=TransactionConfiguration [txSerEnabled=false, dfltIsolation=REPEATABLE_READ, dfltConcurrency=PESSIMISTIC, dfltTxTimeout=0, txTimeoutOnPartitionMapExchange=0, deadlockTimeout=10000, pessimisticTxLogSize=0, pessimisticTxLogLinger=10000, tmLookupClsName=null, txManagerFactory=null, useJtaSync=false], cacheSanityCheckEnabled=true, discoStartupDelay=60000, deployMode=SHARED, p2pMissedCacheSize=100, locHost=127.0.0.1, timeSrvPortBase=31100, timeSrvPortRange=100, failureDetectionTimeout=10000, sysWorkerBlockedTimeout=null, clientFailureDetectionTimeout=10000, metricsLogFreq=0, connectorCfg=null, odbcCfg=null, warmupClos=null, atomicCfg=AtomicConfiguration [seqReserveSize=1000, cacheMode=PARTITIONED, backups=1, aff=null, grpName=null], classLdr=null, sslCtxFactory=null, platformCfg=null, binaryCfg=null, memCfg=null, pstCfg=null, dsCfg=DataStorageConfiguration [sysRegionInitSize=41943040, sysRegionMaxSize=104857600, pageSize=4096, concLvl=0, dfltDataRegConf=DataRegionConfiguration [name=default, maxSize=10485760, initSize=268435456, swapPath=null, pageEvictionMode=DISABLED, pageReplacementMode=CLOCK, evictionThreshold=0.9, emptyPagesPoolSize=100, metricsEnabled=false, metricsSubIntervalCount=5, metricsRateTimeInterval=60000, persistenceEnabled=true, checkpointPageBufSize=0, lazyMemoryAllocation=true, warmUpCfg=null], dataRegions=null, storagePath=null, checkpointFreq=180000, lockWaitTime=10000, checkpointThreads=4, checkpointWriteOrder=SEQUENTIAL, walHistSize=20, maxWalArchiveSize=1073741824, walSegments=10, walSegmentSize=67108864, walPath=db/wal, walArchivePath=db/wal/archive, cdcWalPath=db/wal/cdc, cdcEnabled=false, metricsEnabled=false, walMode=FSYNC, walTlbSize=131072, walBuffSize=0, walFlushFreq=2000, walFsyncDelay=1000, walRecordIterBuffSize=67108864, alwaysWriteFullPages=false, fileIOFactory=org.apache.ignite.internal.processors.cache.persistence.file.AsyncFileIOFactory@521f8646, metricsSubIntervalCnt=5, metricsRateTimeInterval=60000, walAutoArchiveAfterInactivity=-1, walForceArchiveTimeout=-1, writeThrottlingEnabled=false, walCompactionEnabled=false, walCompactionLevel=1, checkpointReadLockTimeout=null, walPageCompression=DISABLED, walPageCompressionLevel=null, dfltWarmUpCfg=null, encCfg=org.apache.ignite.configuration.EncryptionConfiguration@128459ad, defragmentationThreadPoolSize=4, minWalArchiveSize=-1], snapshotPath=snapshots, activeOnStart=true, activeOnStartPropSetFlag=false, autoActivation=true, autoActivationPropSetFlag=false, clusterStateOnStart=null, sqlConnCfg=null, cliConnCfg=ClientConnectorConfiguration [host=null, port=10800, portRange=100, sockSndBufSize=0, sockRcvBufSize=0, tcpNoDelay=true, maxOpenCursorsPerConn=128, threadPoolSize=24, selectorCnt=12, idleTimeout=0, handshakeTimeout=10000, jdbcEnabled=true, odbcEnabled=true, thinCliEnabled=true, sslEnabled=false, useIgniteSslCtxFactory=true, sslClientAuth=false, sslCtxFactory=null, thinCliCfg=ThinClientConfiguration [maxActiveTxPerConn=100, maxActiveComputeTasksPerConn=0]], mvccVacuumThreadCnt=2, mvccVacuumFreq=5000, authEnabled=false, failureHnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]], commFailureRslvr=null, sqlCfg=SqlConfiguration [longQryWarnTimeout=3000, dfltQryTimeout=0, sqlQryHistSize=1000, validationEnabled=false], asyncContinuationExecutor=null] [21:05:40] : [Step 4/5] [2021-11-19 21:05:40,204][INFO ][test-runner-#11294%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] Daemon mode: off [21:05:40] : [Step 4/5] [2021-11-19 21:05:40,205][INFO ][test-runner-#11294%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] OS: Linux 4.15.0-151-generic amd64 [21:05:40] : [Step 4/5] [2021-11-19 21:05:40,205][INFO ][test-runner-#11294%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] OS user: teamcity [21:05:40] : [Step 4/5] [2021-11-19 21:05:40,205][INFO ][test-runner-#11294%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] PID: 16724 [21:05:40] : [Step 4/5] [2021-11-19 21:05:40,206][INFO ][test-runner-#11294%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] Language runtime: Java Platform API Specification ver. 1.8 [21:05:40] : [Step 4/5] [2021-11-19 21:05:40,206][INFO ][test-runner-#11294%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] VM information: Java(TM) SE Runtime Environment 1.8.0_261-b12 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 25.261-b12 [21:05:40] : [Step 4/5] [2021-11-19 21:05:40,206][INFO ][test-runner-#11294%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] VM total memory: 1.8GB [21:05:40] : [Step 4/5] [2021-11-19 21:05:40,206][INFO ][test-runner-#11294%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] Remote Management [restart: off, REST: off, JMX (remote: off)] [21:05:40] : [Step 4/5] [2021-11-19 21:05:40,207][INFO ][test-runner-#11294%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] Logger: GridTestLog4jLogger [quiet=false, config=null] [21:05:40] : [Step 4/5] [2021-11-19 21:05:40,207][INFO ][test-runner-#11294%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] IGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c [21:05:40] : [Step 4/5] [2021-11-19 21:05:40,207][INFO ][test-runner-#11294%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] VM arguments: [-DIGNITE_DUMP_THREADS_ON_FAILURE=false, -DMono=/usr/bin/mono-sgen, -DMono4.0_x64=/usr/lib/mono/4.0, -DMono4.5_x64=/usr/lib/mono/4.5, -DMonoVersion=6.12.0.90, -DSKIP_BUILD=false, -Dagent.home.dir=/opt/buildagent, -Dagent.name=aitc-lin02_03, -Dagent.ownPort=9090, -Dagent.work.dir=/opt/buildagent/work, -Dbuild.number=95, -Dbuild.vcs.number=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.1=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.GitHubApacheIgnite=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dclassworlds.conf=/opt/buildagent/temp/buildTmp/teamcity.m2.conf, -Dcom.jetbrains.maven.watcher.report.file=/opt/buildagent/temp/buildTmp/maven-build-info.xml, -Djava.io.tmpdir=/opt/buildagent/temp/buildTmp, -Dmaven.home=/opt/buildagent/tools/maven3_6, -Dmaven.multiModuleProjectDirectory=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.agent.cpuBenchmark=457, -Dteamcity.agent.dotnet.agent_url=http://localhost:9090/RPC2, -Dteamcity.agent.dotnet.build_id=6278078, -Dteamcity.auth.password=*******, -Dteamcity.auth.userId=TeamCityBuildId=6278078, -Dteamcity.build.changedFiles.file=/opt/buildagent/temp/buildTmp/changedFiles6342607772318147725.txt, -Dteamcity.build.checkoutDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.build.id=6278078, -Dteamcity.build.properties.file=/opt/buildagent/temp/buildTmp/teamcity.build5164517880467851002.properties, -Dteamcity.build.tempDir=/opt/buildagent/temp/buildTmp, -Dteamcity.build.workingDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.buildConfName=Basic 3, -Dteamcity.buildType.id=IgniteTests24Java8_Basic3, -Dteamcity.configuration.properties.file=/opt/buildagent/temp/buildTmp/teamcity.config5591980786735343870.properties, -Dteamcity.maven.userSettings.path=/opt/buildagent/temp/buildTmp/maven_settings_585072866407032347.xml, -Dteamcity.maven.watcher.home=/opt/buildagent/plugins/mavenPlugin/maven-watcher-jdk16, -Dteamcity.projectName=Ignite Tests 2.x (JDK 8/11), -Dteamcity.runner.properties.file=/opt/buildagent/temp/buildTmp/teamcity.runner9098465561618137420.properties, -Dteamcity.tests.recentlyFailedTests.file=/opt/buildagent/temp/buildTmp/testsToRunFirst3891775683130404069.txt, -Dteamcity.version=2021.2 (build 99542), -ea, -Xms2g, -Xmx2g, -XX:+HeapDumpOnOutOfMemoryError, -DIGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_TEST_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_UPDATE_NOTIFIER=false, -DIGNITE_NO_DISCO_ORDER=true, -DIGNITE_PERFORMANCE_SUGGESTIONS_DISABLED=true, -Djava.net.preferIPv4Stack=true, -DTEST_SCALE_FACTOR=1.0, -DIGNITE_TEST_PROP_LOG4J_FILE=log4j-tc-test.xml, -DIGNITE_QUIET=false, -DIGNITE_MARSHAL_BUFFERS_RECHECK=1000, -Dmaven.repo.local=/opt/buildagent/.m2/repository] [21:05:40] : [Step 4/5] [2021-11-19 21:05:40,212][INFO ][test-runner-#11294%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] System cache's DataRegion size is configured to 40 MB. Use DataStorageConfiguration.systemRegionInitialSize property to change the setting. [21:05:40] : [Step 4/5] [2021-11-19 21:05:40,212][INFO ][test-runner-#11294%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] Configured caches [in 'sysMemPlc' dataRegion: ['ignite-sys-cache']] [21:05:40]W: [org.apache.ignite:ignite-core] [2021-11-19 21:05:40,213][WARN ][test-runner-#11294%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] Peer class loading is enabled (disable it in production for performance and deployment consistency reasons) [21:05:40] : [Step 4/5] [2021-11-19 21:05:40,213][INFO ][test-runner-#11294%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] 3-rd party licenses can be found at: /opt/buildagent/work/7bc1c54bc719b67c/libs/licenses [21:05:40] : [Step 4/5] [2021-11-19 21:05:40,217][INFO ][test-runner-#11294%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] Configured plugins: [21:05:40] : [Step 4/5] [2021-11-19 21:05:40,218][INFO ][test-runner-#11294%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- StanByClusterTestProvider 1.0 [21:05:40] : [Step 4/5] [2021-11-19 21:05:40,218][INFO ][test-runner-#11294%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- null [21:05:40] : [Step 4/5] [2021-11-19 21:05:40,218][INFO ][test-runner-#11294%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] [21:05:40] : [Step 4/5] [2021-11-19 21:05:40,218][INFO ][test-runner-#11294%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- PageMemory tracker plugin 1.0 [21:05:40] : [Step 4/5] [2021-11-19 21:05:40,218][INFO ][test-runner-#11294%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- null [21:05:40] : [Step 4/5] [2021-11-19 21:05:40,219][INFO ][test-runner-#11294%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] [21:05:40] : [Step 4/5] [2021-11-19 21:05:40,219][INFO ][test-runner-#11294%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- TestDistibutedConfigurationPlugin 1.0 [21:05:40] : [Step 4/5] [2021-11-19 21:05:40,219][INFO ][test-runner-#11294%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- null [21:05:40] : [Step 4/5] [2021-11-19 21:05:40,219][INFO ][test-runner-#11294%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] [21:05:40] : [Step 4/5] [2021-11-19 21:05:40,219][INFO ][test-runner-#11294%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- NodeValidationPluginProvider 1.0 [21:05:40] : [Step 4/5] [2021-11-19 21:05:40,219][INFO ][test-runner-#11294%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- null [21:05:40] : [Step 4/5] [2021-11-19 21:05:40,220][INFO ][test-runner-#11294%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] [21:05:40] : [Step 4/5] [2021-11-19 21:05:40,220][INFO ][test-runner-#11294%encryption.EncryptedCacheNodeJoinTest%][FailureProcessor] Configured failure handler: [hnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]]] [21:05:40] : [Step 4/5] [2021-11-19 21:05:40,234][INFO ][test-runner-#11294%encryption.EncryptedCacheNodeJoinTest%][TcpCommunicationSpi] Successfully bound communication NIO server to TCP port [port=45150, locHost=/127.0.0.1, selectorsCnt=12, selectorSpins=0, pairedConn=false] [21:05:40]W: [org.apache.ignite:ignite-core] [2021-11-19 21:05:40,234][WARN ][test-runner-#11294%encryption.EncryptedCacheNodeJoinTest%][TcpCommunicationSpi] Message queue limit is set to 0 which may lead to potential OOMEs when running cache operations in FULL_ASYNC or PRIMARY_SYNC modes due to message queues growth on sender and receiver sides. [21:05:40] : [Step 4/5] [2021-11-19 21:05:40,239][INFO ][test-runner-#11294%encryption.EncryptedCacheNodeJoinTest%][GridCollisionManager] Collision resolution is disabled (all jobs will be activated upon arrival). [21:05:40] : [Step 4/5] [2021-11-19 21:05:40,239][INFO ][test-runner-#11294%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] Security status [authentication=off, sandbox=off, tls/ssl=off] [21:05:40] : [Step 4/5] [2021-11-19 21:05:40,296][INFO ][test-runner-#11294%encryption.EncryptedCacheNodeJoinTest%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:05:40] : [Step 4/5] [2021-11-19 21:05:40,405][INFO ][test-runner-#11294%encryption.EncryptedCacheNodeJoinTest%][MaintenanceProcessor] Resolved store directory for node persistent data: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0 [21:05:40] : [Step 4/5] [2021-11-19 21:05:40,407][INFO ][test-runner-#11294%encryption.EncryptedCacheNodeJoinTest%][CacheObjectBinaryProcessorImpl] Resolved directory for serialized binary metadata: /opt/buildagent/work/7bc1c54bc719b67c/work/db/binary_meta/grid_0 [21:05:40] : [Step 4/5] [2021-11-19 21:05:40,414][INFO ][test-runner-#11294%encryption.EncryptedCacheNodeJoinTest%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0 [21:05:40] : [Step 4/5] [2021-11-19 21:05:40,415][INFO ][test-runner-#11294%encryption.EncryptedCacheNodeJoinTest%][FileWriteAheadLogManager] Resolved write ahead log work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0 [21:05:40] : [Step 4/5] [2021-11-19 21:05:40,415][INFO ][test-runner-#11294%encryption.EncryptedCacheNodeJoinTest%][FileWriteAheadLogManager] Resolved write ahead log archive directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0 [21:05:41] : [Step 4/5] [2021-11-19 21:05:41,139][INFO ][test-runner-#11294%encryption.EncryptedCacheNodeJoinTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000000.wal [21:05:41]W: [org.apache.ignite:ignite-core] [2021-11-19 21:05:41,140][WARN ][test-runner-#11294%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] DataRegion maxSize=10.5 MB is smaller than defaultInitialSize=268.4 MB, setting initialSize to 10.5 MB [21:05:41] : [Step 4/5] [2021-11-19 21:05:41,146][INFO ][test-runner-#11294%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Configured data regions initialized successfully [total=5] [21:05:41] : [Step 4/5] [2021-11-19 21:05:41,217][INFO ][test-runner-#11294%encryption.EncryptedCacheNodeJoinTest%][IgniteSnapshotManager] Resolved snapshot work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/snapshots [21:05:41] : [Step 4/5] [2021-11-19 21:05:41,218][INFO ][test-runner-#11294%encryption.EncryptedCacheNodeJoinTest%][IgniteSnapshotManager] Resolved temp directory for snapshot creation: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0/snp [21:05:41] : [Step 4/5] [2021-11-19 21:05:41,221][INFO ][test-runner-#11294%encryption.EncryptedCacheNodeJoinTest%][ClientListenerProcessor] Client connector processor has started on TCP port 10800 [21:05:41] : [Step 4/5] [2021-11-19 21:05:41,224][INFO ][test-runner-#11294%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] Non-loopback local IPs: 172.17.0.4 [21:05:41] : [Step 4/5] [2021-11-19 21:05:41,224][INFO ][test-runner-#11294%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] Enabled local MACs: 0242AC110004 [21:05:41] : [Step 4/5] [2021-11-19 21:05:41,225][INFO ][test-runner-#11294%encryption.EncryptedCacheNodeJoinTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:05:41] : [Step 4/5] [2021-11-19 21:05:41,226][INFO ][test-runner-#11294%encryption.EncryptedCacheNodeJoinTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:05:41] : [Step 4/5] [2021-11-19 21:05:41,226][INFO ][test-runner-#11294%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:05:41] : [Step 4/5] [2021-11-19 21:05:41,228][INFO ][test-runner-#11294%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Applying lost metastore updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:05:41] : [Step 4/5] [2021-11-19 21:05:41,229][INFO ][test-runner-#11294%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=0 ms] [21:05:41] : [Step 4/5] [2021-11-19 21:05:41,229][INFO ][test-runner-#11294%encryption.EncryptedCacheNodeJoinTest%][GridCacheProcessor] Restoring partition state for local groups. [21:05:41] : [Step 4/5] [2021-11-19 21:05:41,230][INFO ][test-runner-#11294%encryption.EncryptedCacheNodeJoinTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=0, partitionsProcessed=0, time=0ms] [21:05:41] : [Step 4/5] [2021-11-19 21:05:41,230][INFO ][test-runner-#11294%encryption.EncryptedCacheNodeJoinTest%][GridEncryptionManager] Encryption keys loaded from metastore. [grps=, masterKeyName=ignite.master.key] [21:05:41] : [Step 4/5] [2021-11-19 21:05:41,232][INFO ][test-runner-#11294%encryption.EncryptedCacheNodeJoinTest%][ClusterProcessor] Cluster ID and tag has been read from metastorage: null [21:05:41] : [Step 4/5] [2021-11-19 21:05:41,233][INFO ][test-runner-#11294%encryption.EncryptedCacheNodeJoinTest%][IgniteClusterImpl] Shutdown policy was updated [oldVal=null, newVal=null] [21:05:41] : [Step 4/5] [2021-11-19 21:05:41,233][INFO ][test-runner-#11294%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Checkpoint frequency deviation changed [oldVal=null, newVal=null] [21:05:41] : [Step 4/5] [2021-11-19 21:05:41,243][INFO ][test-runner-#11294%encryption.EncryptedCacheNodeJoinTest%][FilePageStoreManager] Cleanup cache stores [total=1, left=0, cleanFiles=false] [21:05:41] : [Step 4/5] [2021-11-19 21:05:41,246][INFO ][test-runner-#11294%encryption.EncryptedCacheNodeJoinTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:05:41] : [Step 4/5] [2021-11-19 21:05:41,247][INFO ][test-runner-#11294%encryption.EncryptedCacheNodeJoinTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:05:41] : [Step 4/5] [2021-11-19 21:05:41,249][INFO ][test-runner-#11294%encryption.EncryptedCacheNodeJoinTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:05:41] : [Step 4/5] [2021-11-19 21:05:41,249][INFO ][test-runner-#11294%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Data Regions Started: 5 [21:05:41] : [Step 4/5] [2021-11-19 21:05:41,250][INFO ][test-runner-#11294%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] ^-- sysMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:05:41] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:05:41] : [Step 4/5] ^-- default region [type=default, persistence=true, lazyAlloc=true, [21:05:41] : [Step 4/5] ... initCfg=10MB, maxCfg=10MB, usedRam=0MB, freeRam=100%, allocRam=0MB, allocTotal=0MB] [21:05:41] : [Step 4/5] ^-- metastoreMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:05:41] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:05:41] : [Step 4/5] ^-- TxLog region [type=internal, persistence=true, lazyAlloc=false, [21:05:41] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:05:41] : [Step 4/5] ^-- volatileDsMemPlc region [type=user, persistence=false, lazyAlloc=true, [21:05:41] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB] [21:05:41] : [Step 4/5] ^-- Ignite persistence [used=0MB] [21:05:41] : [Step 4/5] [21:05:41] : [Step 4/5] [2021-11-19 21:05:41,252][INFO ][test-runner-#11294%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Starting binary memory restore for: [-2100569601] [21:05:41] : [Step 4/5] [2021-11-19 21:05:41,263][INFO ][test-runner-#11294%encryption.EncryptedCacheNodeJoinTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:05:41] : [Step 4/5] [2021-11-19 21:05:41,263][INFO ][test-runner-#11294%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:05:41] : [Step 4/5] [2021-11-19 21:05:41,266][INFO ][test-runner-#11294%encryption.EncryptedCacheNodeJoinTest%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000000.wal, offset=0, ver=2] [21:05:41] : [Step 4/5] [2021-11-19 21:05:41,271][INFO ][test-runner-#11294%encryption.EncryptedCacheNodeJoinTest%][GridCacheProcessor] Started cache in recovery mode [name=ignite-sys-cache, id=-2100569601, dataRegionName=sysMemPlc, mode=REPLICATED, atomicity=TRANSACTIONAL, backups=2147483647, mvcc=false] [21:05:41] : [Step 4/5] [2021-11-19 21:05:41,272][INFO ][test-runner-#11294%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Binary recovery performed in 20 ms. [21:05:41] : [Step 4/5] [2021-11-19 21:05:41,272][INFO ][test-runner-#11294%encryption.EncryptedCacheNodeJoinTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:05:41] : [Step 4/5] [2021-11-19 21:05:41,273][INFO ][test-runner-#11294%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Applying lost cache updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:05:41] : [Step 4/5] [2021-11-19 21:05:41,361][INFO ][test-runner-#11294%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=92 ms] [21:05:41] : [Step 4/5] [2021-11-19 21:05:41,362][INFO ][test-runner-#11294%encryption.EncryptedCacheNodeJoinTest%][GridCacheProcessor] Restoring partition state for local groups. [21:05:41] : [Step 4/5] [2021-11-19 21:05:41,390][INFO ][test-runner-#11294%encryption.EncryptedCacheNodeJoinTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=1, partitionsProcessed=100, time=30ms] [21:05:41] : [Step 4/5] [2021-11-19 21:05:41,715][INFO ][test-runner-#11294%encryption.EncryptedCacheNodeJoinTest%][TestTcpDiscoverySpi] Successfully bound to TCP port [port=47500, localHost=localhost/127.0.0.1, locNodeId=0003343f-ac12-43ac-80ca-eb6563417000] [21:05:41] : [Step 4/5] [2021-11-19 21:05:41,720][INFO ][disco-notifier-worker-#11405%grid-0%][MvccProcessorImpl] Assigned mvcc coordinator [crd=MvccCoordinator [topVer=AffinityTopologyVersion [topVer=1, minorTopVer=0], nodeId=0003343f-ac12-43ac-80ca-eb6563417000, ver=1637345141714, local=true, initialized=false]] [21:05:41] : [Step 4/5] [2021-11-19 21:05:41,722][INFO ][disco-notifier-worker-#11405%grid-0%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustEnabled' was changed from 'null' to 'false' [21:05:41] : [Step 4/5] [2021-11-19 21:05:41,723][INFO ][sys-#11387%grid-0%][ClusterProcessor] Writing cluster ID and tag to metastorage on ready for write ClusterIdAndTag [id=887321de-84f1-4676-a99f-9968f80b1f13, tag=heuristic_hoover] [21:05:41] : [Step 4/5] [2021-11-19 21:05:41,723][INFO ][disco-notifier-worker-#11405%grid-0%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustTimeout' was changed from 'null' to '300000' [21:05:41] : [Step 4/5] [2021-11-19 21:05:41,724][INFO ][disco-notifier-worker-#11405%grid-0%][IgniteTxManager] Transactions parameter 'longOperationsDumpTimeout' was changed from 'null' to '60000' [21:05:41] : [Step 4/5] [2021-11-19 21:05:41,724][INFO ][disco-notifier-worker-#11405%grid-0%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpThreshold' was changed from 'null' to '0' [21:05:41] : [Step 4/5] [2021-11-19 21:05:41,725][INFO ][disco-notifier-worker-#11405%grid-0%][IgniteTxManager] Transactions parameter 'transactionTimeDumpSamplesCoefficient' was changed from 'null' to '0.0' [21:05:41] : [Step 4/5] [2021-11-19 21:05:41,725][INFO ][disco-notifier-worker-#11405%grid-0%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpSamplesPerSecondLimit' was changed from 'null' to '5' [21:05:41] : [Step 4/5] [2021-11-19 21:05:41,726][INFO ][disco-notifier-worker-#11405%grid-0%][IgniteTxManager] Transactions parameter 'collisionsDumpInterval' was changed from 'null' to '1000' [21:05:41] : [Step 4/5] [2021-11-19 21:05:41,726][INFO ][disco-notifier-worker-#11405%grid-0%][IgniteTxManager] Transactions parameter 'txOwnerDumpRequestsAllowed' was changed from 'null' to 'true' [21:05:41] : [Step 4/5] [2021-11-19 21:05:41,727][INFO ][disco-notifier-worker-#11405%grid-0%][GridCacheDatabaseSharedManager] Historical rebalance WAL threshold changed [property=historical.rebalance.threshold, oldVal=null, newVal=500] [21:05:41] : [Step 4/5] [2021-11-19 21:05:41,728][INFO ][disco-notifier-worker-#11405%grid-0%][ClusterProcessor] heuristic_hoover [21:05:41] : [Step 4/5] [2021-11-19 21:05:41,737][INFO ][test-runner-#11294%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] To start Console Management & Monitoring run ignitevisorcmd.{sh|bat} [21:05:41] : [Step 4/5] [2021-11-19 21:05:41,738][INFO ][test-runner-#11294%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] [21:05:41] : [Step 4/5] [21:05:41] : [Step 4/5] >>> +-------------------------------------------+ [21:05:41] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:05:41] : [Step 4/5] >>> +-------------------------------------------+ [21:05:41] : [Step 4/5] >>> OS name: Linux 4.15.0-151-generic amd64 [21:05:41] : [Step 4/5] >>> CPU(s): 24 [21:05:41] : [Step 4/5] >>> Heap: 2.0GB [21:05:41] : [Step 4/5] >>> VM name: 16724@c4dfe9a430b2 [21:05:41] : [Step 4/5] >>> Ignite instance name: grid-0 [21:05:41] : [Step 4/5] >>> Local node [ID=0003343F-AC12-43AC-80CA-EB6563417000, order=1, clientMode=false] [21:05:41] : [Step 4/5] >>> Local node addresses: [127.0.0.1] [21:05:41] : [Step 4/5] >>> Local ports: TCP:10800 TCP:45150 TCP:47500 [21:05:41] : [Step 4/5] [21:05:41] : [Step 4/5] [2021-11-19 21:05:41,739][INFO ][test-runner-#11294%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] >>> Ignite cluster is in INACTIVE state (limited functionality available). Use control.(sh|bat) script or IgniteCluster.state(ClusterState.ACTIVE) to change the state. [21:05:41] : [Step 4/5] [2021-11-19 21:05:41,740][INFO ][test-runner-#11294%encryption.EncryptedCacheNodeJoinTest%][GridDiscoveryManager] Topology snapshot [ver=1, locNode=0003343f, servers=1, clients=0, state=INACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=0003343f-ac12-43ac-80ca-eb6563417000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:05:41] : [Step 4/5] [2021-11-19 21:05:41,741][INFO ][test-runner-#11294%encryption.EncryptedCacheNodeJoinTest%][G] Node started : [stage="Configure system pool" (0 ms),stage="Start managers" (214 ms),stage="Configure binary metadata" (3 ms),stage="Start processors" (813 ms),stage="Start 'StanByClusterTestProvider' plugin" (0 ms),stage="Start 'PageMemory tracker plugin' plugin" (0 ms),stage="Start 'TestDistibutedConfigurationPlugin' plugin" (0 ms),stage="Start 'NodeValidationPluginProvider' plugin" (0 ms),stage="Init metastore" (20 ms),stage="Init and start regions" (8 ms),stage="Restore binary memory" (20 ms),stage="Restore logical state" (118 ms),stage="Finish recovery" (323 ms),stage="Join topology" (6 ms),stage="Await transition" (2 ms),stage="Await exchange" (17 ms),stage="Total time" (1544 ms)] [21:05:41] : [Step 4/5] [2021-11-19 21:05:41,742][INFO ][test-runner-#11294%encryption.EncryptedCacheNodeJoinTest%][root] Node started with the following configuration [id=0003343f-ac12-43ac-80ca-eb6563417000, marshaller=BinaryMarshaller [], discovery=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=5000, ackTimeout=5000, marsh=JdkMarshaller [clsFilter=org.apache.ignite.marshaller.MarshallerUtils$1@4e3593cd], reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], binaryCfg=null, lateAff=true] [21:05:41]W: [org.apache.ignite:ignite-core] [2021-11-19 21:05:41,750][WARN ][test-runner-#11294%encryption.EncryptedCacheNodeJoinTest%][G] Ignite work directory is not provided, automatically resolved to: /opt/buildagent/work/7bc1c54bc719b67c/work [21:05:41] : [Step 4/5] [2021-11-19 21:05:41,751][INFO ][test-runner-#11294%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-3] [21:05:41] : [Step 4/5] [21:05:41] : [Step 4/5] >>> __________ ________________ [21:05:41] : [Step 4/5] >>> / _/ ___/ |/ / _/_ __/ __/ [21:05:41] : [Step 4/5] >>> _/ // (7 7 // / / / / _/ [21:05:41] : [Step 4/5] >>> /___/\___/_/|_/___/ /_/ /___/ [21:05:41] : [Step 4/5] >>> [21:05:41] : [Step 4/5] >>> ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:05:41] : [Step 4/5] >>> 2021 Copyright(C) Apache Software Foundation [21:05:41] : [Step 4/5] >>> [21:05:41] : [Step 4/5] >>> Ignite documentation: http://ignite.apache.org [21:05:41] : [Step 4/5] [21:05:41] : [Step 4/5] [2021-11-19 21:05:41,752][INFO ][test-runner-#11294%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-3] Config URL: n/a [21:05:41] : [Step 4/5] [2021-11-19 21:05:41,752][INFO ][test-runner-#11294%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-3] IgniteConfiguration [igniteInstanceName=grid-3, pubPoolSize=24, svcPoolSize=24, callbackPoolSize=24, stripedPoolSize=24, sysPoolSize=24, mgmtPoolSize=4, dataStreamerPoolSize=24, utilityCachePoolSize=24, utilityCacheKeepAliveTime=60000, p2pPoolSize=2, qryPoolSize=24, buildIdxPoolSize=4, igniteHome=/opt/buildagent/work/7bc1c54bc719b67c, igniteWorkDir=/opt/buildagent/work/7bc1c54bc719b67c/work, mbeanSrv=com.sun.jmx.mbeanserver.JmxMBeanServer@6fe85038, nodeId=3064a31c-9502-4c0e-9458-13320711e003, marsh=BinaryMarshaller [], marshLocJobs=false, daemon=false, p2pEnabled=true, netTimeout=10000, netCompressionLevel=1, sndRetryDelay=1000, sndRetryCnt=3, metricsHistSize=10000, metricsUpdateFreq=1000, metricsExpTime=9223372036854775807, discoSpi=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=0, ackTimeout=0, marsh=null, reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], segPlc=STOP, segResolveAttempts=2, waitForSegOnStart=true, allResolversPassReq=true, segChkFreq=10000, commSpi=TcpCommunicationSpi [connectGate=org.apache.ignite.spi.communication.tcp.internal.ConnectGateway@32ba778b, ctxInitLatch=java.util.concurrent.CountDownLatch@303b912[Count = 1], stopping=false, clientPool=null, nioSrvWrapper=null, stateProvider=null], evtSpi=MemoryEventStorageSpi [expireAgeMs=9223372036854775807, expireCnt=10000, filter=null], colSpi=NoopCollisionSpi [], deploySpi=LocalDeploymentSpi [], indexingSpi=org.apache.ignite.spi.indexing.noop.NoopIndexingSpi@2dfc4356, addrRslvr=null, encryptionSpi=org.apache.ignite.spi.encryption.keystore.KeystoreEncryptionSpi@612ff832, tracingSpi=org.apache.ignite.spi.tracing.NoopTracingSpi@47e0b15e, clientMode=false, rebalanceThreadPoolSize=4, rebalanceTimeout=10000, rebalanceBatchesPrefetchCnt=3, rebalanceThrottle=0, rebalanceBatchSize=524288, txCfg=TransactionConfiguration [txSerEnabled=false, dfltIsolation=REPEATABLE_READ, dfltConcurrency=PESSIMISTIC, dfltTxTimeout=0, txTimeoutOnPartitionMapExchange=0, deadlockTimeout=10000, pessimisticTxLogSize=0, pessimisticTxLogLinger=10000, tmLookupClsName=null, txManagerFactory=null, useJtaSync=false], cacheSanityCheckEnabled=true, discoStartupDelay=60000, deployMode=SHARED, p2pMissedCacheSize=100, locHost=127.0.0.1, timeSrvPortBase=31100, timeSrvPortRange=100, failureDetectionTimeout=10000, sysWorkerBlockedTimeout=null, clientFailureDetectionTimeout=10000, metricsLogFreq=0, connectorCfg=null, odbcCfg=null, warmupClos=null, atomicCfg=AtomicConfiguration [seqReserveSize=1000, cacheMode=PARTITIONED, backups=1, aff=null, grpName=null], classLdr=null, sslCtxFactory=null, platformCfg=null, binaryCfg=null, memCfg=null, pstCfg=null, dsCfg=DataStorageConfiguration [sysRegionInitSize=41943040, sysRegionMaxSize=104857600, pageSize=4096, concLvl=0, dfltDataRegConf=DataRegionConfiguration [name=default, maxSize=10485760, initSize=268435456, swapPath=null, pageEvictionMode=DISABLED, pageReplacementMode=CLOCK, evictionThreshold=0.9, emptyPagesPoolSize=100, metricsEnabled=false, metricsSubIntervalCount=5, metricsRateTimeInterval=60000, persistenceEnabled=true, checkpointPageBufSize=0, lazyMemoryAllocation=true, warmUpCfg=null], dataRegions=null, storagePath=null, checkpointFreq=180000, lockWaitTime=10000, checkpointThreads=4, checkpointWriteOrder=SEQUENTIAL, walHistSize=20, maxWalArchiveSize=1073741824, walSegments=10, walSegmentSize=67108864, walPath=db/wal, walArchivePath=db/wal/archive, cdcWalPath=db/wal/cdc, cdcEnabled=false, metricsEnabled=false, walMode=FSYNC, walTlbSize=131072, walBuffSize=0, walFlushFreq=2000, walFsyncDelay=1000, walRecordIterBuffSize=67108864, alwaysWriteFullPages=false, fileIOFactory=org.apache.ignite.internal.processors.cache.persistence.file.AsyncFileIOFactory@73626400, metricsSubIntervalCnt=5, metricsRateTimeInterval=60000, walAutoArchiveAfterInactivity=-1, walForceArchiveTimeout=-1, writeThrottlingEnabled=false, walCompactionEnabled=false, walCompactionLevel=1, checkpointReadLockTimeout=null, walPageCompression=DISABLED, walPageCompressionLevel=null, dfltWarmUpCfg=null, encCfg=org.apache.ignite.configuration.EncryptionConfiguration@2e5f794d, defragmentationThreadPoolSize=4, minWalArchiveSize=-1], snapshotPath=snapshots, activeOnStart=true, activeOnStartPropSetFlag=false, autoActivation=true, autoActivationPropSetFlag=false, clusterStateOnStart=null, sqlConnCfg=null, cliConnCfg=ClientConnectorConfiguration [host=null, port=10800, portRange=100, sockSndBufSize=0, sockRcvBufSize=0, tcpNoDelay=true, maxOpenCursorsPerConn=128, threadPoolSize=24, selectorCnt=12, idleTimeout=0, handshakeTimeout=10000, jdbcEnabled=true, odbcEnabled=true, thinCliEnabled=true, sslEnabled=false, useIgniteSslCtxFactory=true, sslClientAuth=false, sslCtxFactory=null, thinCliCfg=ThinClientConfiguration [maxActiveTxPerConn=100, maxActiveComputeTasksPerConn=0]], mvccVacuumThreadCnt=2, mvccVacuumFreq=5000, authEnabled=false, failureHnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]], commFailureRslvr=null, sqlCfg=SqlConfiguration [longQryWarnTimeout=3000, dfltQryTimeout=0, sqlQryHistSize=1000, validationEnabled=false], asyncContinuationExecutor=null] [21:05:41] : [Step 4/5] [2021-11-19 21:05:41,763][INFO ][test-runner-#11294%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-3] Daemon mode: off [21:05:41] : [Step 4/5] [2021-11-19 21:05:41,763][INFO ][test-runner-#11294%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-3] OS: Linux 4.15.0-151-generic amd64 [21:05:41] : [Step 4/5] [2021-11-19 21:05:41,763][INFO ][test-runner-#11294%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-3] OS user: teamcity [21:05:41] : [Step 4/5] [2021-11-19 21:05:41,764][INFO ][test-runner-#11294%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-3] PID: 16724 [21:05:41] : [Step 4/5] [2021-11-19 21:05:41,765][INFO ][test-runner-#11294%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-3] Language runtime: Java Platform API Specification ver. 1.8 [21:05:41] : [Step 4/5] [2021-11-19 21:05:41,765][INFO ][test-runner-#11294%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-3] VM information: Java(TM) SE Runtime Environment 1.8.0_261-b12 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 25.261-b12 [21:05:41] : [Step 4/5] [2021-11-19 21:05:41,765][INFO ][test-runner-#11294%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-3] VM total memory: 1.8GB [21:05:41] : [Step 4/5] [2021-11-19 21:05:41,766][INFO ][test-runner-#11294%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-3] Remote Management [restart: off, REST: off, JMX (remote: off)] [21:05:41] : [Step 4/5] [2021-11-19 21:05:41,766][INFO ][test-runner-#11294%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-3] Logger: GridTestLog4jLogger [quiet=false, config=null] [21:05:41] : [Step 4/5] [2021-11-19 21:05:41,766][INFO ][test-runner-#11294%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-3] IGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c [21:05:41] : [Step 4/5] [2021-11-19 21:05:41,767][INFO ][test-runner-#11294%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-3] VM arguments: [-DIGNITE_DUMP_THREADS_ON_FAILURE=false, -DMono=/usr/bin/mono-sgen, -DMono4.0_x64=/usr/lib/mono/4.0, -DMono4.5_x64=/usr/lib/mono/4.5, -DMonoVersion=6.12.0.90, -DSKIP_BUILD=false, -Dagent.home.dir=/opt/buildagent, -Dagent.name=aitc-lin02_03, -Dagent.ownPort=9090, -Dagent.work.dir=/opt/buildagent/work, -Dbuild.number=95, -Dbuild.vcs.number=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.1=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.GitHubApacheIgnite=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dclassworlds.conf=/opt/buildagent/temp/buildTmp/teamcity.m2.conf, -Dcom.jetbrains.maven.watcher.report.file=/opt/buildagent/temp/buildTmp/maven-build-info.xml, -Djava.io.tmpdir=/opt/buildagent/temp/buildTmp, -Dmaven.home=/opt/buildagent/tools/maven3_6, -Dmaven.multiModuleProjectDirectory=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.agent.cpuBenchmark=457, -Dteamcity.agent.dotnet.agent_url=http://localhost:9090/RPC2, -Dteamcity.agent.dotnet.build_id=6278078, -Dteamcity.auth.password=*******, -Dteamcity.auth.userId=TeamCityBuildId=6278078, -Dteamcity.build.changedFiles.file=/opt/buildagent/temp/buildTmp/changedFiles6342607772318147725.txt, -Dteamcity.build.checkoutDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.build.id=6278078, -Dteamcity.build.properties.file=/opt/buildagent/temp/buildTmp/teamcity.build5164517880467851002.properties, -Dteamcity.build.tempDir=/opt/buildagent/temp/buildTmp, -Dteamcity.build.workingDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.buildConfName=Basic 3, -Dteamcity.buildType.id=IgniteTests24Java8_Basic3, -Dteamcity.configuration.properties.file=/opt/buildagent/temp/buildTmp/teamcity.config5591980786735343870.properties, -Dteamcity.maven.userSettings.path=/opt/buildagent/temp/buildTmp/maven_settings_585072866407032347.xml, -Dteamcity.maven.watcher.home=/opt/buildagent/plugins/mavenPlugin/maven-watcher-jdk16, -Dteamcity.projectName=Ignite Tests 2.x (JDK 8/11), -Dteamcity.runner.properties.file=/opt/buildagent/temp/buildTmp/teamcity.runner9098465561618137420.properties, -Dteamcity.tests.recentlyFailedTests.file=/opt/buildagent/temp/buildTmp/testsToRunFirst3891775683130404069.txt, -Dteamcity.version=2021.2 (build 99542), -ea, -Xms2g, -Xmx2g, -XX:+HeapDumpOnOutOfMemoryError, -DIGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_TEST_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_UPDATE_NOTIFIER=false, -DIGNITE_NO_DISCO_ORDER=true, -DIGNITE_PERFORMANCE_SUGGESTIONS_DISABLED=true, -Djava.net.preferIPv4Stack=true, -DTEST_SCALE_FACTOR=1.0, -DIGNITE_TEST_PROP_LOG4J_FILE=log4j-tc-test.xml, -DIGNITE_QUIET=false, -DIGNITE_MARSHAL_BUFFERS_RECHECK=1000, -Dmaven.repo.local=/opt/buildagent/.m2/repository] [21:05:41] : [Step 4/5] [2021-11-19 21:05:41,772][INFO ][test-runner-#11294%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-3] System cache's DataRegion size is configured to 40 MB. Use DataStorageConfiguration.systemRegionInitialSize property to change the setting. [21:05:41] : [Step 4/5] [2021-11-19 21:05:41,773][INFO ][test-runner-#11294%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-3] Configured caches [in 'sysMemPlc' dataRegion: ['ignite-sys-cache']] [21:05:41]W: [org.apache.ignite:ignite-core] [2021-11-19 21:05:41,773][WARN ][test-runner-#11294%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-3] Peer class loading is enabled (disable it in production for performance and deployment consistency reasons) [21:05:41] : [Step 4/5] [2021-11-19 21:05:41,773][INFO ][test-runner-#11294%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-3] 3-rd party licenses can be found at: /opt/buildagent/work/7bc1c54bc719b67c/libs/licenses [21:05:41] : [Step 4/5] [2021-11-19 21:05:41,779][INFO ][test-runner-#11294%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] Configured plugins: [21:05:41] : [Step 4/5] [2021-11-19 21:05:41,780][INFO ][test-runner-#11294%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- StanByClusterTestProvider 1.0 [21:05:41] : [Step 4/5] [2021-11-19 21:05:41,780][INFO ][test-runner-#11294%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- null [21:05:41] : [Step 4/5] [2021-11-19 21:05:41,780][INFO ][test-runner-#11294%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] [21:05:41] : [Step 4/5] [2021-11-19 21:05:41,780][INFO ][test-runner-#11294%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- PageMemory tracker plugin 1.0 [21:05:41] : [Step 4/5] [2021-11-19 21:05:41,781][INFO ][test-runner-#11294%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- null [21:05:41] : [Step 4/5] [2021-11-19 21:05:41,781][INFO ][test-runner-#11294%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] [21:05:41] : [Step 4/5] [2021-11-19 21:05:41,781][INFO ][test-runner-#11294%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- TestDistibutedConfigurationPlugin 1.0 [21:05:41] : [Step 4/5] [2021-11-19 21:05:41,781][INFO ][test-runner-#11294%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- null [21:05:41] : [Step 4/5] [2021-11-19 21:05:41,782][INFO ][test-runner-#11294%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] [21:05:41] : [Step 4/5] [2021-11-19 21:05:41,782][INFO ][test-runner-#11294%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- NodeValidationPluginProvider 1.0 [21:05:41] : [Step 4/5] [2021-11-19 21:05:41,782][INFO ][test-runner-#11294%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- null [21:05:41] : [Step 4/5] [2021-11-19 21:05:41,783][INFO ][test-runner-#11294%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] [21:05:41] : [Step 4/5] [2021-11-19 21:05:41,783][INFO ][test-runner-#11294%encryption.EncryptedCacheNodeJoinTest%][FailureProcessor] Configured failure handler: [hnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]]] [21:05:41] : [Step 4/5] [2021-11-19 21:05:41,832][INFO ][test-runner-#11294%encryption.EncryptedCacheNodeJoinTest%][TcpCommunicationSpi] Successfully bound communication NIO server to TCP port [port=45151, locHost=/127.0.0.1, selectorsCnt=12, selectorSpins=0, pairedConn=false] [21:05:41]W: [org.apache.ignite:ignite-core] [2021-11-19 21:05:41,833][WARN ][test-runner-#11294%encryption.EncryptedCacheNodeJoinTest%][TcpCommunicationSpi] Message queue limit is set to 0 which may lead to potential OOMEs when running cache operations in FULL_ASYNC or PRIMARY_SYNC modes due to message queues growth on sender and receiver sides. [21:05:41] : [Step 4/5] [2021-11-19 21:05:41,846][INFO ][test-runner-#11294%encryption.EncryptedCacheNodeJoinTest%][GridCollisionManager] Collision resolution is disabled (all jobs will be activated upon arrival). [21:05:41] : [Step 4/5] [2021-11-19 21:05:41,846][INFO ][test-runner-#11294%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-3] Security status [authentication=off, sandbox=off, tls/ssl=off] [21:05:41] : [Step 4/5] [2021-11-19 21:05:41,929][INFO ][test-runner-#11294%encryption.EncryptedCacheNodeJoinTest%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:05:42] : [Step 4/5] [2021-11-19 21:05:42,032][INFO ][test-runner-#11294%encryption.EncryptedCacheNodeJoinTest%][MaintenanceProcessor] Resolved store directory for node persistent data: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_3 [21:05:42] : [Step 4/5] [2021-11-19 21:05:42,034][INFO ][test-runner-#11294%encryption.EncryptedCacheNodeJoinTest%][CacheObjectBinaryProcessorImpl] Resolved directory for serialized binary metadata: /opt/buildagent/work/7bc1c54bc719b67c/work/db/binary_meta/grid_3 [21:05:42] : [Step 4/5] [2021-11-19 21:05:42,038][INFO ][test-runner-#11294%encryption.EncryptedCacheNodeJoinTest%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_3 [21:05:42] : [Step 4/5] [2021-11-19 21:05:42,039][INFO ][test-runner-#11294%encryption.EncryptedCacheNodeJoinTest%][FileWriteAheadLogManager] Resolved write ahead log work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_3 [21:05:42] : [Step 4/5] [2021-11-19 21:05:42,039][INFO ][test-runner-#11294%encryption.EncryptedCacheNodeJoinTest%][FileWriteAheadLogManager] Resolved write ahead log archive directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_3 [21:05:42] : [Step 4/5] [2021-11-19 21:05:42,480][INFO ][test-runner-#11294%encryption.EncryptedCacheNodeJoinTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_3/0000000000000000.wal [21:05:42] : [Step 4/5] [2021-11-19 21:05:42,486][INFO ][test-runner-#11294%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Configured data regions initialized successfully [total=5] [21:05:42] : [Step 4/5] [2021-11-19 21:05:42,488][INFO ][test-runner-#11294%encryption.EncryptedCacheNodeJoinTest%][IgniteSnapshotManager] Resolved snapshot work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/snapshots [21:05:42] : [Step 4/5] [2021-11-19 21:05:42,488][INFO ][test-runner-#11294%encryption.EncryptedCacheNodeJoinTest%][IgniteSnapshotManager] Resolved temp directory for snapshot creation: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_3/snp [21:05:42] : [Step 4/5] [2021-11-19 21:05:42,491][INFO ][test-runner-#11294%encryption.EncryptedCacheNodeJoinTest%][ClientListenerProcessor] Client connector processor has started on TCP port 10801 [21:05:42] : [Step 4/5] [2021-11-19 21:05:42,494][INFO ][test-runner-#11294%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-3] Non-loopback local IPs: 172.17.0.4 [21:05:42] : [Step 4/5] [2021-11-19 21:05:42,494][INFO ][test-runner-#11294%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-3] Enabled local MACs: 0242AC110004 [21:05:42] : [Step 4/5] [2021-11-19 21:05:42,495][INFO ][test-runner-#11294%encryption.EncryptedCacheNodeJoinTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:05:42] : [Step 4/5] [2021-11-19 21:05:42,496][INFO ][test-runner-#11294%encryption.EncryptedCacheNodeJoinTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:05:42] : [Step 4/5] [2021-11-19 21:05:42,497][INFO ][test-runner-#11294%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:05:42] : [Step 4/5] [2021-11-19 21:05:42,501][INFO ][test-runner-#11294%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Applying lost metastore updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:05:42] : [Step 4/5] [2021-11-19 21:05:42,502][INFO ][test-runner-#11294%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=0 ms] [21:05:42] : [Step 4/5] [2021-11-19 21:05:42,502][INFO ][test-runner-#11294%encryption.EncryptedCacheNodeJoinTest%][GridCacheProcessor] Restoring partition state for local groups. [21:05:42] : [Step 4/5] [2021-11-19 21:05:42,503][INFO ][test-runner-#11294%encryption.EncryptedCacheNodeJoinTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=0, partitionsProcessed=0, time=0ms] [21:05:42] : [Step 4/5] [2021-11-19 21:05:42,503][INFO ][test-runner-#11294%encryption.EncryptedCacheNodeJoinTest%][GridEncryptionManager] Encryption keys loaded from metastore. [grps=, masterKeyName=ignite.master.key] [21:05:42] : [Step 4/5] [2021-11-19 21:05:42,505][INFO ][test-runner-#11294%encryption.EncryptedCacheNodeJoinTest%][ClusterProcessor] Cluster ID and tag has been read from metastorage: null [21:05:42] : [Step 4/5] [2021-11-19 21:05:42,505][INFO ][test-runner-#11294%encryption.EncryptedCacheNodeJoinTest%][IgniteClusterImpl] Shutdown policy was updated [oldVal=null, newVal=null] [21:05:42] : [Step 4/5] [2021-11-19 21:05:42,506][INFO ][test-runner-#11294%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Checkpoint frequency deviation changed [oldVal=null, newVal=null] [21:05:42] : [Step 4/5] [2021-11-19 21:05:42,516][INFO ][test-runner-#11294%encryption.EncryptedCacheNodeJoinTest%][FilePageStoreManager] Cleanup cache stores [total=1, left=0, cleanFiles=false] [21:05:42] : [Step 4/5] [2021-11-19 21:05:42,518][INFO ][test-runner-#11294%encryption.EncryptedCacheNodeJoinTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:05:42] : [Step 4/5] [2021-11-19 21:05:42,519][INFO ][test-runner-#11294%encryption.EncryptedCacheNodeJoinTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:05:42] : [Step 4/5] [2021-11-19 21:05:42,520][INFO ][test-runner-#11294%encryption.EncryptedCacheNodeJoinTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:05:42] : [Step 4/5] [2021-11-19 21:05:42,521][INFO ][test-runner-#11294%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Data Regions Started: 5 [21:05:42] : [Step 4/5] [2021-11-19 21:05:42,521][INFO ][test-runner-#11294%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] ^-- sysMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:05:42] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:05:42] : [Step 4/5] ^-- default region [type=default, persistence=true, lazyAlloc=true, [21:05:42] : [Step 4/5] ... initCfg=10MB, maxCfg=10MB, usedRam=0MB, freeRam=100%, allocRam=0MB, allocTotal=0MB] [21:05:42] : [Step 4/5] ^-- metastoreMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:05:42] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:05:42] : [Step 4/5] ^-- TxLog region [type=internal, persistence=true, lazyAlloc=false, [21:05:42] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:05:42] : [Step 4/5] ^-- volatileDsMemPlc region [type=user, persistence=false, lazyAlloc=true, [21:05:42] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB] [21:05:42] : [Step 4/5] ^-- Ignite persistence [used=0MB] [21:05:42] : [Step 4/5] [21:05:42] : [Step 4/5] [2021-11-19 21:05:42,523][INFO ][test-runner-#11294%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Starting binary memory restore for: [-2100569601] [21:05:42] : [Step 4/5] [2021-11-19 21:05:42,531][INFO ][test-runner-#11294%encryption.EncryptedCacheNodeJoinTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:05:42] : [Step 4/5] [2021-11-19 21:05:42,532][INFO ][test-runner-#11294%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:05:42] : [Step 4/5] [2021-11-19 21:05:42,537][INFO ][test-runner-#11294%encryption.EncryptedCacheNodeJoinTest%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_3/0000000000000000.wal, offset=0, ver=2] [21:05:42] : [Step 4/5] [2021-11-19 21:05:42,544][INFO ][test-runner-#11294%encryption.EncryptedCacheNodeJoinTest%][GridCacheProcessor] Started cache in recovery mode [name=ignite-sys-cache, id=-2100569601, dataRegionName=sysMemPlc, mode=REPLICATED, atomicity=TRANSACTIONAL, backups=2147483647, mvcc=false] [21:05:42] : [Step 4/5] [2021-11-19 21:05:42,545][INFO ][test-runner-#11294%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Binary recovery performed in 22 ms. [21:05:42] : [Step 4/5] [2021-11-19 21:05:42,545][INFO ][test-runner-#11294%encryption.EncryptedCacheNodeJoinTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:05:42] : [Step 4/5] [2021-11-19 21:05:42,545][INFO ][test-runner-#11294%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Applying lost cache updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:05:42] : [Step 4/5] [2021-11-19 21:05:42,619][INFO ][test-runner-#11294%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=71 ms] [21:05:42] : [Step 4/5] [2021-11-19 21:05:42,619][INFO ][test-runner-#11294%encryption.EncryptedCacheNodeJoinTest%][GridCacheProcessor] Restoring partition state for local groups. [21:05:42] : [Step 4/5] [2021-11-19 21:05:42,641][INFO ][test-runner-#11294%encryption.EncryptedCacheNodeJoinTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=1, partitionsProcessed=100, time=31ms] [21:05:43] : [Step 4/5] [2021-11-19 21:05:43,346][INFO ][test-runner-#11294%encryption.EncryptedCacheNodeJoinTest%][TestTcpDiscoverySpi] Successfully bound to TCP port [port=47501, localHost=localhost/127.0.0.1, locNodeId=3064a31c-9502-4c0e-9458-13320711e003] [21:05:43] : [Step 4/5] [2021-11-19 21:05:43,350][INFO ][tcp-disco-srvr-[:47500]-#594%grid-0%-#11407%grid-0%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=44033] [21:05:43] : [Step 4/5] [2021-11-19 21:05:43,350][INFO ][tcp-disco-srvr-[:47500]-#594%grid-0%-#11407%grid-0%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=44033] [21:05:43] : [Step 4/5] [2021-11-19 21:05:43,352][INFO ][tcp-disco-sock-reader-[]-#600%grid-0%-#11526%grid-0%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:44033, rmtPort=44033] [21:05:43] : [Step 4/5] [2021-11-19 21:05:43,354][INFO ][tcp-disco-sock-reader-[3064a31c 127.0.0.1:44033]-#600%grid-0%-#11526%grid-0%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=3064a31c-9502-4c0e-9458-13320711e003, rmtAddr=/127.0.0.1:44033] [21:05:43] : [Step 4/5] [2021-11-19 21:05:43,357][INFO ][tcp-disco-srvr-[:47501]-#599%grid-3%-#11525%grid-3%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=46489] [21:05:43] : [Step 4/5] [2021-11-19 21:05:43,357][INFO ][tcp-disco-srvr-[:47501]-#599%grid-3%-#11525%grid-3%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=46489] [21:05:43] : [Step 4/5] [2021-11-19 21:05:43,358][INFO ][tcp-disco-sock-reader-[]-#601%grid-3%-#11527%grid-3%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:46489, rmtPort=46489] [21:05:43] : [Step 4/5] [2021-11-19 21:05:43,359][INFO ][tcp-disco-sock-reader-[]-#601%grid-3%-#11527%grid-3%][TestTcpDiscoverySpi] Received ping request from the remote node [rmtNodeId=0003343f-ac12-43ac-80ca-eb6563417000, rmtAddr=/127.0.0.1:46489, rmtPort=46489] [21:05:43] : [Step 4/5] [2021-11-19 21:05:43,360][INFO ][tcp-disco-sock-reader-[]-#601%grid-3%-#11527%grid-3%][TestTcpDiscoverySpi] Finished writing ping response [rmtNodeId=0003343f-ac12-43ac-80ca-eb6563417000, rmtAddr=/127.0.0.1:46489, rmtPort=46489] [21:05:43]W: [org.apache.ignite:ignite-core] [2021-11-19 21:05:43,361][WARN ][tcp-disco-sock-reader-[]-#601%grid-3%-#11527%grid-3%][TestTcpDiscoverySpi] Failed to shutdown socket [21:05:43]W: [org.apache.ignite:ignite-core] java.net.SocketException: Socket output is already shutdown [21:05:43]W: [org.apache.ignite:ignite-core] at java.net.Socket.shutdownOutput(Socket.java:1572) [21:05:43]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.close(IgniteUtils.java:4247) [21:05:43]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.discovery.tcp.ServerImpl$SocketReader.body(ServerImpl.java:7370) [21:05:43]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.IgniteSpiThread.run(IgniteSpiThread.java:58) [21:05:43] : [Step 4/5] [2021-11-19 21:05:43,363][INFO ][tcp-disco-sock-reader-[]-#601%grid-3%-#11527%grid-3%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:46489, rmtPort=46489, rmtNodeId=null] [21:05:43] : [Step 4/5] [2021-11-19 21:05:43,363][INFO ][tcp-disco-msg-worker-[crd]-#593%grid-0%-#11406%grid-0%][GridEncryptionManager] Joining node doesn't have stored group keys [node=3064a31c-9502-4c0e-9458-13320711e003] [21:05:43] : [Step 4/5] [2021-11-19 21:05:43,362][INFO ][tcp-disco-sock-reader-[3064a31c 127.0.0.1:44033]-#600%grid-0%-#11526%grid-0%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:44033, rmtPort=44033, rmtNodeId=3064a31c-9502-4c0e-9458-13320711e003] [21:05:43] : [Step 4/5] [2021-11-19 21:05:43,374][INFO ][tcp-disco-msg-worker-[crd]-#593%grid-0%-#11406%grid-0%][TestTcpDiscoverySpi] New next node [newNext=TcpDiscoveryNode [id=3064a31c-9502-4c0e-9458-13320711e003, consistentId=grid-3, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=0, intOrder=2, lastExchangeTime=1637345143348, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false]] [21:05:43] : [Step 4/5] [2021-11-19 21:05:43,375][INFO ][tcp-disco-srvr-[:47501]-#599%grid-3%-#11525%grid-3%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=60583] [21:05:43] : [Step 4/5] [2021-11-19 21:05:43,375][INFO ][tcp-disco-srvr-[:47501]-#599%grid-3%-#11525%grid-3%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=60583] [21:05:43] : [Step 4/5] [2021-11-19 21:05:43,376][INFO ][tcp-disco-sock-reader-[]-#602%grid-3%-#11528%grid-3%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:60583, rmtPort=60583] [21:05:43] : [Step 4/5] [2021-11-19 21:05:43,377][INFO ][tcp-disco-sock-reader-[0003343f 127.0.0.1:60583]-#602%grid-3%-#11528%grid-3%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=0003343f-ac12-43ac-80ca-eb6563417000, rmtAddr=/127.0.0.1:60583] [21:05:43] : [Step 4/5] [2021-11-19 21:05:43,381][INFO ][tcp-disco-msg-worker-[]-#598%grid-3%-#11524%grid-3%][TestTcpDiscoverySpi] New next node [newNext=TcpDiscoveryNode [id=0003343f-ac12-43ac-80ca-eb6563417000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345143378, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false]] [21:05:43] : [Step 4/5] [2021-11-19 21:05:43,383][INFO ][tcp-disco-srvr-[:47500]-#594%grid-0%-#11407%grid-0%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=50995] [21:05:43] : [Step 4/5] [2021-11-19 21:05:43,383][INFO ][tcp-disco-srvr-[:47500]-#594%grid-0%-#11407%grid-0%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=50995] [21:05:43] : [Step 4/5] [2021-11-19 21:05:43,384][INFO ][tcp-disco-sock-reader-[]-#603%grid-0%-#11529%grid-0%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:50995, rmtPort=50995] [21:05:43] : [Step 4/5] [2021-11-19 21:05:43,385][INFO ][tcp-disco-sock-reader-[3064a31c 127.0.0.1:50995]-#603%grid-0%-#11529%grid-0%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=3064a31c-9502-4c0e-9458-13320711e003, rmtAddr=/127.0.0.1:50995] [21:05:43] : [Step 4/5] [2021-11-19 21:05:43,391][INFO ][disco-event-worker-#11409%grid-0%][GridDiscoveryManager] Added new node to topology: TcpDiscoveryNode [id=3064a31c-9502-4c0e-9458-13320711e003, consistentId=grid-3, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637345143348, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false] [21:05:43] : [Step 4/5] [2021-11-19 21:05:43,392][INFO ][tcp-disco-msg-worker-[0003343f 127.0.0.1:47500]-#598%grid-3%-#11524%grid-3%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustEnabled' was changed from 'null' to 'false' [21:05:43] : [Step 4/5] [2021-11-19 21:05:43,392][INFO ][tcp-disco-msg-worker-[0003343f 127.0.0.1:47500]-#598%grid-3%-#11524%grid-3%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustTimeout' was changed from 'null' to '300000' [21:05:43] : [Step 4/5] [2021-11-19 21:05:43,393][INFO ][disco-event-worker-#11409%grid-0%][GridDiscoveryManager] Topology snapshot [ver=2, locNode=0003343f, servers=2, clients=0, state=INACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=0003343f-ac12-43ac-80ca-eb6563417000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=3064a31c-9502-4c0e-9458-13320711e003, consistentId=grid-3, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:05:43] : [Step 4/5] [2021-11-19 21:05:43,393][INFO ][tcp-disco-msg-worker-[0003343f 127.0.0.1:47500]-#598%grid-3%-#11524%grid-3%][IgniteTxManager] Transactions parameter 'longOperationsDumpTimeout' was changed from 'null' to '60000' [21:05:43] : [Step 4/5] [2021-11-19 21:05:43,394][INFO ][tcp-disco-msg-worker-[0003343f 127.0.0.1:47500]-#598%grid-3%-#11524%grid-3%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpThreshold' was changed from 'null' to '0' [21:05:43] : [Step 4/5] [2021-11-19 21:05:43,395][INFO ][tcp-disco-msg-worker-[0003343f 127.0.0.1:47500]-#598%grid-3%-#11524%grid-3%][IgniteTxManager] Transactions parameter 'transactionTimeDumpSamplesCoefficient' was changed from 'null' to '0.0' [21:05:43] : [Step 4/5] [2021-11-19 21:05:43,395][INFO ][tcp-disco-msg-worker-[0003343f 127.0.0.1:47500]-#598%grid-3%-#11524%grid-3%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpSamplesPerSecondLimit' was changed from 'null' to '5' [21:05:43] : [Step 4/5] [2021-11-19 21:05:43,395][INFO ][tcp-disco-msg-worker-[0003343f 127.0.0.1:47500]-#598%grid-3%-#11524%grid-3%][IgniteTxManager] Transactions parameter 'collisionsDumpInterval' was changed from 'null' to '1000' [21:05:43] : [Step 4/5] [2021-11-19 21:05:43,396][INFO ][tcp-disco-msg-worker-[0003343f 127.0.0.1:47500]-#598%grid-3%-#11524%grid-3%][IgniteTxManager] Transactions parameter 'txOwnerDumpRequestsAllowed' was changed from 'null' to 'true' [21:05:43] : [Step 4/5] [2021-11-19 21:05:43,396][INFO ][tcp-disco-msg-worker-[0003343f 127.0.0.1:47500]-#598%grid-3%-#11524%grid-3%][GridCacheDatabaseSharedManager] Historical rebalance WAL threshold changed [property=historical.rebalance.threshold, oldVal=null, newVal=500] [21:05:43] : [Step 4/5] [2021-11-19 21:05:43,397][INFO ][tcp-disco-msg-worker-[0003343f 127.0.0.1:47500]-#598%grid-3%-#11524%grid-3%][ClusterProcessor] heuristic_hoover [21:05:43] : [Step 4/5] [2021-11-19 21:05:43,398][INFO ][disco-notifier-worker-#11523%grid-3%][MvccProcessorImpl] Assigned mvcc coordinator [crd=MvccCoordinator [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=0], nodeId=0003343f-ac12-43ac-80ca-eb6563417000, ver=1637345141714, local=false, initialized=false]] [21:05:43] : [Step 4/5] [2021-11-19 21:05:43,400][INFO ][sys-#11506%grid-3%][ClusterProcessor] Writing cluster ID and tag to metastorage on ready for write ClusterIdAndTag [id=887321de-84f1-4676-a99f-9968f80b1f13, tag=heuristic_hoover] [21:05:43] : [Step 4/5] [2021-11-19 21:05:43,439][INFO ][test-runner-#11294%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-3] To start Console Management & Monitoring run ignitevisorcmd.{sh|bat} [21:05:43] : [Step 4/5] [2021-11-19 21:05:43,440][INFO ][test-runner-#11294%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-3] [21:05:43] : [Step 4/5] [21:05:43] : [Step 4/5] >>> +-------------------------------------------+ [21:05:43] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:05:43] : [Step 4/5] >>> +-------------------------------------------+ [21:05:43] : [Step 4/5] >>> OS name: Linux 4.15.0-151-generic amd64 [21:05:43] : [Step 4/5] >>> CPU(s): 24 [21:05:43] : [Step 4/5] >>> Heap: 2.0GB [21:05:43] : [Step 4/5] >>> VM name: 16724@c4dfe9a430b2 [21:05:43] : [Step 4/5] >>> Ignite instance name: grid-3 [21:05:43] : [Step 4/5] >>> Local node [ID=3064A31C-9502-4C0E-9458-13320711E003, order=2, clientMode=false] [21:05:43] : [Step 4/5] >>> Local node addresses: [127.0.0.1] [21:05:43] : [Step 4/5] >>> Local ports: TCP:10801 TCP:45151 TCP:47501 [21:05:43] : [Step 4/5] [21:05:43] : [Step 4/5] [2021-11-19 21:05:43,441][INFO ][test-runner-#11294%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-3] >>> Ignite cluster is in INACTIVE state (limited functionality available). Use control.(sh|bat) script or IgniteCluster.state(ClusterState.ACTIVE) to change the state. [21:05:43] : [Step 4/5] [2021-11-19 21:05:43,442][INFO ][test-runner-#11294%encryption.EncryptedCacheNodeJoinTest%][GridDiscoveryManager] Topology snapshot [ver=2, locNode=3064a31c, servers=2, clients=0, state=INACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=0003343f-ac12-43ac-80ca-eb6563417000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=3064a31c-9502-4c0e-9458-13320711e003, consistentId=grid-3, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:05:43] : [Step 4/5] [2021-11-19 21:05:43,443][INFO ][test-runner-#11294%encryption.EncryptedCacheNodeJoinTest%][G] Node started : [stage="Configure system pool" (0 ms),stage="Start managers" (282 ms),stage="Configure binary metadata" (2 ms),stage="Start processors" (458 ms),stage="Start 'StanByClusterTestProvider' plugin" (0 ms),stage="Start 'PageMemory tracker plugin' plugin" (0 ms),stage="Start 'TestDistibutedConfigurationPlugin' plugin" (0 ms),stage="Start 'NodeValidationPluginProvider' plugin" (0 ms),stage="Init metastore" (22 ms),stage="Init and start regions" (6 ms),stage="Restore binary memory" (22 ms),stage="Restore logical state" (96 ms),stage="Finish recovery" (703 ms),stage="Join topology" (56 ms),stage="Await transition" (2 ms),stage="Await exchange" (40 ms),stage="Total time" (1689 ms)] [21:05:43] : [Step 4/5] [2021-11-19 21:05:43,445][INFO ][test-runner-#11294%encryption.EncryptedCacheNodeJoinTest%][root] Node started with the following configuration [id=3064a31c-9502-4c0e-9458-13320711e003, marshaller=BinaryMarshaller [], discovery=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=5000, ackTimeout=5000, marsh=JdkMarshaller [clsFilter=org.apache.ignite.marshaller.MarshallerUtils$1@5bd8063d], reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], binaryCfg=null, lateAff=true] [21:05:43] : [Step 4/5] [2021-11-19 21:05:43,447][INFO ][test-runner-#11294%encryption.EncryptedCacheNodeJoinTest%][GridClusterStateProcessor] Sending activate cluster request with BaselineTopology BaselineTopology [id=0, branchingHash=-2475315499, branchingType='New BaselineTopology', baselineNodes=[grid-0, grid-3]] [21:05:43] : [Step 4/5] [2021-11-19 21:05:43,450][INFO ][disco-notifier-worker-#11405%grid-0%][GridClusterStateProcessor] Received activate cluster request with BaselineTopology[id=0] initiator node ID: 3064a31c-9502-4c0e-9458-13320711e003 [21:05:43] : [Step 4/5] [2021-11-19 21:05:43,451][INFO ][disco-notifier-worker-#11405%grid-0%][GridClusterStateProcessor] Started state transition: activate cluster [21:05:43] : [Step 4/5] [2021-11-19 21:05:43,451][INFO ][disco-notifier-worker-#11523%grid-3%][GridClusterStateProcessor] Received activate cluster request with BaselineTopology[id=0] initiator node ID: 3064a31c-9502-4c0e-9458-13320711e003 [21:05:43] : [Step 4/5] [2021-11-19 21:05:43,451][INFO ][exchange-worker-#11410%grid-0%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], crd=true, evt=DISCOVERY_CUSTOM_EVT, evtNode=3064a31c-9502-4c0e-9458-13320711e003, customEvt=ChangeGlobalStateMessage [id=58c3d593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqId=e9b601dd-ce7b-444e-bbe4-cf3b0c8149c2, initiatingNodeId=3064a31c-9502-4c0e-9458-13320711e003, state=ACTIVE, baselineTopology=BaselineTopology [id=0, branchingHash=-2475315499, branchingType='New BaselineTopology', baselineNodes=[grid-0, grid-3]], forceChangeBaselineTopology=false, timestamp=1637345143447, forceDeactivation=true], allowMerge=false, exchangeFreeSwitch=false] [21:05:43] : [Step 4/5] [2021-11-19 21:05:43,452][INFO ][disco-notifier-worker-#11523%grid-3%][GridClusterStateProcessor] Started state transition: activate cluster [21:05:43] : [Step 4/5] [2021-11-19 21:05:43,453][INFO ][exchange-worker-#11410%grid-0%][GridDhtPartitionsExchangeFuture] Start activation process [nodeId=0003343f-ac12-43ac-80ca-eb6563417000, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]]. New state: ACTIVE [21:05:43] : [Step 4/5] [2021-11-19 21:05:43,453][INFO ][exchange-worker-#11410%grid-0%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0 [21:05:43] : [Step 4/5] [2021-11-19 21:05:43,454][INFO ][exchange-worker-#11532%grid-3%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], crd=false, evt=DISCOVERY_CUSTOM_EVT, evtNode=3064a31c-9502-4c0e-9458-13320711e003, customEvt=ChangeGlobalStateMessage [id=58c3d593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqId=e9b601dd-ce7b-444e-bbe4-cf3b0c8149c2, initiatingNodeId=3064a31c-9502-4c0e-9458-13320711e003, state=ACTIVE, baselineTopology=BaselineTopology [id=0, branchingHash=-2475315499, branchingType='New BaselineTopology', baselineNodes=[grid-0, grid-3]], forceChangeBaselineTopology=false, timestamp=1637345143447, forceDeactivation=true], allowMerge=false, exchangeFreeSwitch=false] [21:05:43] : [Step 4/5] [2021-11-19 21:05:43,456][INFO ][exchange-worker-#11532%grid-3%][GridDhtPartitionsExchangeFuture] Start activation process [nodeId=3064a31c-9502-4c0e-9458-13320711e003, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]]. New state: ACTIVE [21:05:43] : [Step 4/5] [2021-11-19 21:05:43,456][INFO ][exchange-worker-#11532%grid-3%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_3 [21:05:43] : [Step 4/5] [2021-11-19 21:05:43,464][INFO ][exchange-worker-#11410%grid-0%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000000.wal, offset=8713, ver=2] [21:05:43] : [Step 4/5] [2021-11-19 21:05:43,467][INFO ][exchange-worker-#11410%grid-0%][GridClusterStateProcessor] Writing BaselineTopology[id=0] [21:05:43] : [Step 4/5] [2021-11-19 21:05:43,467][INFO ][exchange-worker-#11532%grid-3%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_3/0000000000000000.wal, offset=8713, ver=2] [21:05:43] : [Step 4/5] [2021-11-19 21:05:43,470][INFO ][exchange-worker-#11532%grid-3%][GridClusterStateProcessor] Writing BaselineTopology[id=0] [21:05:43] : [Step 4/5] [2021-11-19 21:05:43,473][INFO ][exchange-worker-#11410%grid-0%][GridCacheDatabaseSharedManager] Finish recovery performed in 19 ms. [21:05:43] : [Step 4/5] [2021-11-19 21:05:43,474][INFO ][exchange-worker-#11410%grid-0%][msg] Components activation performed in 21 ms. [21:05:43] : [Step 4/5] [2021-11-19 21:05:43,476][INFO ][exchange-worker-#11410%grid-0%][GridCacheProcessor] Finished recovery for cache [cache=ignite-sys-cache, grp=ignite-sys-cache, startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:05:43] : [Step 4/5] [2021-11-19 21:05:43,477][INFO ][exchange-worker-#11410%grid-0%][GridDhtPartitionsExchangeFuture] Successfully activated caches [nodeId=0003343f-ac12-43ac-80ca-eb6563417000, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], newState=ACTIVE] [21:05:43] : [Step 4/5] [2021-11-19 21:05:43,478][INFO ][exchange-worker-#11410%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:05:43] : [Step 4/5] [2021-11-19 21:05:43,480][INFO ][exchange-worker-#11532%grid-3%][GridCacheDatabaseSharedManager] Finish recovery performed in 23 ms. [21:05:43] : [Step 4/5] [2021-11-19 21:05:43,482][INFO ][exchange-worker-#11532%grid-3%][msg] Components activation performed in 26 ms. [21:05:43] : [Step 4/5] [2021-11-19 21:05:43,483][INFO ][exchange-worker-#11532%grid-3%][GridCacheProcessor] Finished recovery for cache [cache=ignite-sys-cache, grp=ignite-sys-cache, startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:05:43] : [Step 4/5] [2021-11-19 21:05:43,483][INFO ][exchange-worker-#11532%grid-3%][GridDhtPartitionsExchangeFuture] Successfully activated caches [nodeId=3064a31c-9502-4c0e-9458-13320711e003, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], newState=ACTIVE] [21:05:43] : [Step 4/5] [2021-11-19 21:05:43,484][INFO ][exchange-worker-#11532%grid-3%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:05:43] : [Step 4/5] [2021-11-19 21:05:43,520][INFO ][grid-nio-worker-tcp-comm-0-#11349%TcpCommunicationSpi%][TcpCommunicationSpi] Accepted incoming communication connection [locAddr=/127.0.0.1:45150, rmtAddr=/127.0.0.1:60070] [21:05:43] : [Step 4/5] [2021-11-19 21:05:43,523][INFO ][grid-nio-worker-tcp-comm-0-#11467%TcpCommunicationSpi%][TcpCommunicationSpi] Established outgoing communication connection [locAddr=/127.0.0.1:60070, rmtAddr=/127.0.0.1:45150] [21:05:43] : [Step 4/5] [2021-11-19 21:05:43,524][INFO ][exchange-worker-#11532%grid-3%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], crd=false] [21:05:43] : [Step 4/5] [2021-11-19 21:05:43,593][INFO ][exchange-worker-#11410%grid-0%][GridDhtPartitionsExchangeFuture] Coordinator received single message [ver=AffinityTopologyVersion [topVer=2, minorTopVer=1], node=3064a31c-9502-4c0e-9458-13320711e003, allReceived=true] [21:05:43] : [Step 4/5] [2021-11-19 21:05:43,665][INFO ][exchange-worker-#11410%grid-0%][GridDhtPartitionsExchangeFuture] finishExchangeOnCoordinator [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:05:43] : [Step 4/5] [2021-11-19 21:05:43,678][INFO ][disco-notifier-worker-#11405%grid-0%][GridClusterStateProcessor] Received state change finish message: ACTIVE [21:05:43] : [Step 4/5] [2021-11-19 21:05:43,678][INFO ][disco-notifier-worker-#11405%grid-0%][GridClusterStateProcessor] Cluster state was changed from INACTIVE to ACTIVE [21:05:43] : [Step 4/5] [2021-11-19 21:05:43,679][INFO ][exchange-worker-#11410%grid-0%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], err=null, rebalanced=true, wasRebalanced=false] [21:05:43] : [Step 4/5] [2021-11-19 21:05:43,680][INFO ][disco-notifier-worker-#11523%grid-3%][GridClusterStateProcessor] Received state change finish message: ACTIVE [21:05:43] : [Step 4/5] [2021-11-19 21:05:43,684][INFO ][disco-notifier-worker-#11523%grid-3%][GridClusterStateProcessor] Cluster state was changed from INACTIVE to ACTIVE [21:05:43] : [Step 4/5] [2021-11-19 21:05:43,685][INFO ][exchange-worker-#11410%grid-0%][GridCacheProcessor] Finish proxy initialization, cacheName=ignite-sys-cache, localNodeId=0003343f-ac12-43ac-80ca-eb6563417000 [21:05:43] : [Step 4/5] [2021-11-19 21:05:43,686][INFO ][sys-#11394%grid-0%][DistributedBaselineConfiguration] Baseline auto-adjust is 'disabled' with timeout='300000' ms [21:05:43] : [Step 4/5] [2021-11-19 21:05:43,686][INFO ][sys-#11394%grid-0%][GridClusterStateProcessor] Successfully performed final activation steps [nodeId=0003343f-ac12-43ac-80ca-eb6563417000, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:05:43] : [Step 4/5] [2021-11-19 21:05:43,686][INFO ][exchange-worker-#11410%grid-0%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=0003343f-ac12-43ac-80ca-eb6563417000, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=3064a31c-9502-4c0e-9458-13320711e003, consistentId=grid-3, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637345143348, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:05:43] : [Step 4/5] [2021-11-19 21:05:43,690][INFO ][exchange-worker-#11410%grid-0%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (1 ms), stage="Update caches registry" (22 ms), stage="Start caches" (0 ms), stage="Affinity initialization on cache group start" (0 ms), stage="Determine exchange type" (1 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Restore partition states" (0 ms), stage="After states restored callback" (114 ms), stage="WAL history reservation" (0 ms), stage="Waiting for all single messages" (71 ms), stage="Affinity recalculation (crd)" (0 ms), stage="Collect update counters and create affinity messages" (0 ms), stage="Assign partitions states" (0 ms), stage="Validate partitions states" (0 ms), stage="Ideal affinity diff calculation (enforced)" (0 ms), stage="Apply update counters" (0 ms), stage="Full message preparing" (10 ms), stage="Full message sending" (0 ms), stage="State finish message sending" (1 ms), stage="Detect lost partitions" (6 ms), stage="Exchange done" (5 ms), stage="Total time" (231 ms), Discovery lag=2 ms, Latest started node id=3064a31c-9502-4c0e-9458-13320711e003] [21:05:43] : [Step 4/5] [2021-11-19 21:05:43,694][INFO ][exchange-worker-#11410%grid-0%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], stage="Affinity initialization on cache group start [grp=ignite-sys-cache]" (0 ms) (parent=Affinity initialization on cache group start), stage="Affinity centralized initialization (crd) [grp=ignite-sys-cache, crd=true]" (0 ms) (parent=Determine exchange type), stage="Restore partition states [grp=ignite-sys-cache]" (0 ms) (parent=Restore partition states), stage="Affinity recalculation (partitions availability) [grp=ignite-sys-cache]" (0 ms) (parent=Ideal affinity diff calculation (enforced))] [21:05:43] : [Step 4/5] [2021-11-19 21:05:43,692][INFO ][sys-#11510%grid-3%][GridCachePartitionExchangeManager] Delay process full message without exchange id (there is exchange in progress) [nodeId=0003343f-ac12-43ac-80ca-eb6563417000] [21:05:43] : [Step 4/5] [2021-11-19 21:05:43,692][INFO ][sys-#11509%grid-3%][GridDhtPartitionsExchangeFuture] Received full message, will finish exchange [node=0003343f-ac12-43ac-80ca-eb6563417000, resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:05:43] : [Step 4/5] [2021-11-19 21:05:43,696][INFO ][exchange-worker-#11410%grid-0%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], crd=true] [21:05:43] : [Step 4/5] [2021-11-19 21:05:43,699][INFO ][exchange-worker-#11410%grid-0%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=2, minorTopVer=1], force=false, evt=DISCOVERY_CUSTOM_EVT, node=3064a31c-9502-4c0e-9458-13320711e003] [21:05:43] : [Step 4/5] [2021-11-19 21:05:43,699][INFO ][sys-#11509%grid-3%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], err=null, rebalanced=true, wasRebalanced=false] [21:05:43] : [Step 4/5] [2021-11-19 21:05:43,706][INFO ][sys-#11509%grid-3%][GridCacheProcessor] Finish proxy initialization, cacheName=ignite-sys-cache, localNodeId=3064a31c-9502-4c0e-9458-13320711e003 [21:05:43] : [Step 4/5] [21:05:43] >>> Stopping test: EncryptedCacheNodeJoinTest#testNodeCanJoin in 3522 ms <<< [21:05:43] : [Step 4/5] [2021-11-19 21:05:43,708][INFO ][main][root] >>> Stopping test: EncryptedCacheNodeJoinTest#testNodeCanJoin in 3522 ms <<< [21:05:43] : [Step 4/5] [2021-11-19 2[21:05:43] >>> Heap: 423 MB used / 1893 MB commited / 1893 MB max <<< [21:05:43] : [Step 4/5] 1:05:43,708][INFO ][exchange-worker-#11532%grid-3%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=2, minorTopVer=1], force=false, evt=DISCOVERY_CUSTOM_EVT, node=3064a31c-9502-4c0e-9458-13320711e003] [21:05:43] : [Step 4/5] [2021-11-19 21:05:43,708][INFO ][sys-#11518%grid-3%][DistributedBaselineConfiguration] Baseline auto-adjust is 'disabled' with timeout='300000' ms [21:05:43] : [Step 4/5] [2021-11-19 21:05:43,711][INFO ][sys-#11518%grid-3%][GridClusterStateProcessor] Successfully performed final activation steps [nodeId=3064a31c-9502-4c0e-9458-13320711e003, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:05:43] : [Step 4/5] [2021-11-19 21:05:43,708][INFO ][main][root] >>> Heap: 423 MB used / 1893 MB commited / 1893 MB max <<< [21:05:43] : [Step 4/5] [2021-11-19[21:05 21:05:43,708][INFO ][sys-#11509%grid-3%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=3064a31c-9502-4c0e-9458-13320711e003, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=3064a31c-9502-4c0e-9458-13320711e003, consistentId=grid-3, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637345143676, loc=true, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:05:43] : [Step 4/5] [2021-11-19 21:05:43,714][INFO ][sys-#11509%grid-3%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (2 ms), stage="Update caches registry" (26 ms), stage="Start caches" (0 ms), stage="Affinity initialization on cache group start" (0 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Restore partition states" (0 ms), stage="After states restored callback" (30 ms), stage="WAL history reservation" (0 ms), stage="Waiting for Full message" (176 ms), stage="Affinity recalculation" (6 ms), stage="Full map updating" (0 ms), stage="Detect lost partitions" (4 ms), stage="Exchange done" (10 ms), stage="Total time" (254 ms)] [21:05:43] : [Step 4/5] :43] >>> Non-Heap: 146 MB used / 15[2021-11-19 21:05:43,716][INFO ][sys-#11509%grid-3%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], stage="Affinity initialization on cache group start [grp=ignite-sys-cache]" (0 ms) (parent=Affinity initialization on cache group start), stage="Affinity centralized initialization (crd) [grp=ignite-sys-cache, crd=false]" (0 ms) (parent=Determine exchange type), stage="Restore partition states [grp=ignite-sys-cache]" (0 ms) (parent=Restore partition states), stage="Affinity applying from full message [grp=ignite-sys-cache]" (6 ms) (parent=Affinity recalculation)] [21:05:43] : [Step 4/5] 8 MB commited / 0 MB max <<< [21:05:43] : [Step 4/5] [2021-11-19 21:05:43,720][INFO ][main][root] >>> Non-Heap: 146 MB used / 158 MB commited / 0 MB max <<< [21:05:43] : [Step 4/5] [2021-11-19 21:05:43,720][INFO ][main][root] >>> Stopping grid [name=grid-0, id=0003343f-ac12-43ac-80ca-eb6563417000] [21:05:43] : [Step 4/5] [2021-11-19 21:05:43,814][INFO ][db-checkpoint-thread-#11542%grid-3%][Checkpointer] Checkpoint started [checkpointId=1dd93c1a-251f-4f51-8b93-3f2bd84e12da, startPtr=WALPointer [idx=0, fileOff=78239, len=1963], checkpointBeforeLockTime=20ms, checkpointLockWait=3ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=71ms, writeCheckpointEntryDuration=228ms, splitAndSortCpPagesDuration=0ms, pages=18, reason='node started'] [21:05:44] : [Step 4/5] [2021-11-19 21:05:44,628][INFO ][db-checkpoint-thread-#11541%grid-0%][Checkpointer] Checkpoint started [checkpointId=c4ce0d87-62aa-4fe4-bbe3-284d868a9339, startPtr=WALPointer [idx=0, fileOff=88165, len=1963], checkpointBeforeLockTime=22ms, checkpointLockWait=78ms, checkpointListenersExecuteTime=4ms, checkpointLockHoldTime=4ms, walCpRecordFsyncDuration=395ms, writeCheckpointEntryDuration=640ms, splitAndSortCpPagesDuration=0ms, pages=19, reason='node started'] [21:05:44] : [Step 4/5] [2021-11-19 21:05:44,648][INFO ][tcp-disco-sock-reader-[3064a31c 127.0.0.1:50995]-#603%grid-0%-#11529%grid-0%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:50995, rmtPort=50995, rmtNodeId=3064a31c-9502-4c0e-9458-13320711e003] [21:05:44] : [Step 4/5] [2021-11-19 21:05:44,649][INFO ][disco-event-worker-#11531%grid-3%][GridDiscoveryManager] Node left topology: TcpDiscoveryNode [id=0003343f-ac12-43ac-80ca-eb6563417000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345143378, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false] [21:05:44] : [Step 4/5] [2021-11-19 21:05:44,651][INFO ][main][GridCacheProcessor] Stopped cache [cacheName=ignite-sys-cache] [21:05:44] : [Step 4/5] [2021-11-19 21:05:44,652][INFO ][disco-event-worker-#11531%grid-3%][GridDiscoveryManager] Topology snapshot [ver=3, locNode=3064a31c, servers=1, clients=0, state=ACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=3064a31c-9502-4c0e-9458-13320711e003, consistentId=grid-3, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:05:44] : [Step 4/5] [2021-11-19 21:05:44,654][INFO ][disco-event-worker-#11531%grid-3%][GridDiscoveryManager] Coordinator changed [prev=TcpDiscoveryNode [id=0003343f-ac12-43ac-80ca-eb6563417000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345143378, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], cur=TcpDiscoveryNode [id=3064a31c-9502-4c0e-9458-13320711e003, consistentId=grid-3, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637345144644, loc=true, ver=2.13.0#20211119-sha1:00000000, isClient=false]] [21:05:44] : [Step 4/5] [2021-11-19 21:05:44,656][INFO ][disco-event-worker-#11531%grid-3%][GridDiscoveryManager] ^-- Baseline [id=0, size=2, online=1, offline=1] [21:05:44] : [Step 4/5] [2021-11-19 21:05:44,656][INFO ][disco-event-worker-#11531%grid-3%][MvccProcessorImpl] Assigned mvcc coordinator [crd=MvccCoordinator [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], nodeId=3064a31c-9502-4c0e-9458-13320711e003, ver=1637345141715, local=true, initialized=false]] [21:05:44]W: [org.apache.ignite:ignite-core] [2021-11-19 21:05:44,657][WARN ][grid-nio-worker-tcp-comm-0-#11467%TcpCommunicationSpi%][TcpCommunicationSpi] Failed to shutdown socket [21:05:44]W: [org.apache.ignite:ignite-core] java.nio.channels.ClosedChannelException [21:05:44]W: [org.apache.ignite:ignite-core] at sun.nio.ch.SocketChannelImpl.shutdownOutput(SocketChannelImpl.java:795) [21:05:44]W: [org.apache.ignite:ignite-core] at sun.nio.ch.SocketAdaptor.shutdownOutput(SocketAdaptor.java:407) [21:05:44]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.close(IgniteUtils.java:4247) [21:05:44]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.closeKey(GridNioServer.java:2784) [21:05:44] : [Step 4/5] [2021-11-19 21:05:44,661][INFO ][sys-#11503%grid-3%][ExchangeLatchManager] Become new coordinator 3064a31c-9502-4c0e-9458-13320711e003 [21:05:44]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.close(GridNioServer.java:2835) [21:05:44] : [Step 4/5] [2021-11-19 21:05:44,661][INFO ][exchange-worker-#11532%grid-3%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], crd=true, evt=NODE_LEFT, evtNode=0003343f-ac12-43ac-80ca-eb6563417000, customEvt=null, allowMerge=false, exchangeFreeSwitch=true] [21:05:44]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.close(GridNioServer.java:2794) [21:05:44]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.bodyInternal(GridNioServer.java:2157) [21:05:44]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.body(GridNioServer.java:1910) [21:05:44]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:125) [21:05:44]W: [org.apache.ignite:ignite-core] at java.lang.Thread.run(Thread.java:748) [21:05:44] : [Step 4/5] [2021-11-19 21:05:44,662][INFO ][exchange-worker-#11532%grid-3%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:05:44] : [Step 4/5] [2021-11-19 21:05:44,665][INFO ][exchange-worker-#11532%grid-3%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], err=null, rebalanced=true, wasRebalanced=true] [21:05:44] : [Step 4/5] [2021-11-19 21:05:44,666][INFO ][exchange-worker-#11532%grid-3%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=3064a31c-9502-4c0e-9458-13320711e003, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], evt=NODE_LEFT, evtNode=TcpDiscoveryNode [id=0003343f-ac12-43ac-80ca-eb6563417000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345143378, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0]] [21:05:44] : [Step 4/5] [2021-11-19 21:05:44,667][INFO ][exchange-worker-#11532%grid-3%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (0 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="After states restored callback" (0 ms), stage="WAL history reservation" (2 ms), stage="Finalize update counters" (0 ms), stage="Detect lost partitions" (0 ms), stage="Exchange done" (1 ms), stage="Total time" (3 ms)] [21:05:44] : [Step 4/5] [2021-11-19 21:05:44,668][INFO ][exchange-worker-#11532%grid-3%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], stage="Affinity initialization (exchange-free switch on fully-rebalanced topology) [grp=ignite-sys-cache]" (0 ms) (parent=Determine exchange type)] [21:05:44] : [Step 4/5] [2021-11-19 21:05:44,669][INFO ][exchange-worker-#11532%grid-3%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], crd=true] [21:05:44] : [Step 4/5] [2021-11-19 21:05:44,669][INFO ][exchange-worker-#11532%grid-3%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=3, minorTopVer=0], force=false, evt=NODE_LEFT, node=0003343f-ac12-43ac-80ca-eb6563417000] [21:05:44] : [Step 4/5] [2021-11-19 21:05:44,847][INFO ][db-checkpoint-thread-#11542%grid-3%][Checkpointer] Checkpoint finished [cpId=1dd93c1a-251f-4f51-8b93-3f2bd84e12da, pages=18, markPos=WALPointer [idx=0, fileOff=78239, len=1963], walSegmentsCovered=[], markDuration=299ms, pagesWrite=5ms, fsync=1028ms, total=1355ms] [21:05:46] : [Step 4/5] [2021-11-19 21:05:46,322][INFO ][main][FilePageStoreManager] Cleanup cache stores [total=3, left=0, cleanFiles=false] [21:05:46] : [Step 4/5] [2021-11-19 21:05:46,325][INFO ][main][GridDeploymentLocalStore] Removed undeployed class: GridDeployment [ts=1637345143517, depMode=SHARED, clsLdr=IsolatedClassLoader{roleName='test'}, clsLdrId=39c3d593d71-0003343f-ac12-43ac-80ca-eb6563417000, userVer=0, loc=true, sampleClsName=org.apache.ignite.internal.processors.cache.distributed.dht.preloader.GridDhtPartitionMap, pendingUndeploy=false, undeployed=true, usage=0] [21:05:46] : [Step 4/5] [2021-11-19 21:05:46,334][INFO ][main][IgniteKernal%grid-0] [21:05:46] : [Step 4/5] [21:05:46] : [Step 4/5] >>> +------------------------------------------------------+ [21:05:46] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV stopped OK [21:05:46] : [Step 4/5] >>> +------------------------------------------------------+ [21:05:46] : [Step 4/5] >>> Ignite instance name: grid-0 [21:05:46] : [Step 4/5] >>> Grid uptime: 00:00:04.601 [21:05:46] : [Step 4/5] [21:05:46] : [Step 4/5] [21:05:46] : [Step 4/5] [2021-11-19 21:05:46,335][INFO ][main][root] >>> Stopping grid [name=grid-3, id=3064a31c-9502-4c0e-9458-13320711e003] [21:05:46] : [Step 4/5] [2021-11-19 21:05:46,804][INFO ][db-checkpoint-thread-#11542%grid-3%][Checkpointer] Checkpoint started [checkpointId=838fdacd-6155-451e-81de-3ee42a543c74, startPtr=WALPointer [idx=0, fileOff=112770, len=1947], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=109ms, writeCheckpointEntryDuration=355ms, splitAndSortCpPagesDuration=0ms, pages=8, reason='timeout'] [21:05:46]W: [org.apache.ignite:ignite-core] [2021-11-19 21:05:46,810][WARN ][tcp-disco-sock-reader-[0003343f 127.0.0.1:60583]-#602%grid-3%-#11528%grid-3%][TestTcpDiscoverySpi] Failed to shutdown socket [21:05:46]W: [org.apache.ignite:ignite-core] java.net.SocketException: Socket is closed [21:05:46]W: [org.apache.ignite:ignite-core] at java.net.Socket.shutdownOutput(Socket.java:1568) [21:05:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.close(IgniteUtils.java:4247) [21:05:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.discovery.tcp.ServerImpl$SocketReader.body(ServerImpl.java:7370) [21:05:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.IgniteSpiThread.run(IgniteSpiThread.java:58) [21:05:46] : [Step 4/5] [2021-11-19 21:05:46,811][INFO ][tcp-disco-sock-reader-[0003343f 127.0.0.1:60583]-#602%grid-3%-#11528%grid-3%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:60583, rmtPort=60583, rmtNodeId=0003343f-ac12-43ac-80ca-eb6563417000] [21:05:46] : [Step 4/5] [2021-11-19 21:05:46,813][INFO ][main][GridCacheProcessor] Stopped cache [cacheName=ignite-sys-cache] [21:05:47] : [Step 4/5] [2021-11-19 21:05:47,478][INFO ][main][FilePageStoreManager] Cleanup cache stores [total=3, left=0, cleanFiles=false] [21:05:47] : [Step 4/5] [2021-11-19 21:05:47,481][INFO ][main][GridDeploymentLocalStore] Removed undeployed class: GridDeployment [ts=1637345143686, depMode=SHARED, clsLdr=IsolatedClassLoader{roleName='test'}, clsLdrId=4ac3d593d71-3064a31c-9502-4c0e-9458-13320711e003, userVer=0, loc=true, sampleClsName=org.apache.ignite.internal.processors.cache.distributed.dht.preloader.IgniteDhtPartitionsToReloadMap, pendingUndeploy=false, undeployed=true, usage=0] [21:05:47] : [Step 4/5] [2021-11-19 21:05:47,495][INFO ][main][IgniteKernal%grid-3] [21:05:47] : [Step 4/5] [21:05:47] : [Step 4/5] >>> +------------------------------------------------------+ [21:05:47] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV stopped OK [21:05:47] : [Step 4/5] >>> +------------------------------------------------------+ [21:05:47] : [Step 4/5] >>> Ignite instance name: grid-3 [21:05:47] : [Step 4/5] >>> Grid uptime: 00:00:04.056 [21:05:47] : [Step 4/5] [21:05:47] : [Step 4/5] [21:05:47] : [Step 4/5] [21:05:47] >>> Starting test: EncryptedCacheNodeJoinTest#testNodeCantJoinWithoutEncryptionSpi <<< [21:05:47] : [Step 4/5] [2021-11-19 21:05:47,659][INFO ][main][root] >>> Starting test: EncryptedCacheNodeJoinTest#testNodeCantJoinWithoutEncryptionSpi <<< [21:05:47] : [Step 4/5] [21:05:47] >>> Heap: 427 MB used / 1893 MB commited / 1893 MB max <<< [21:05:47] : [Step 4/5] [2021-11-19 21:05:47,659][INFO ][main][root] >>> Heap: 427 MB used / 1893 MB commited / 1893 MB max <<< [21:05:47] : [Step 4/5] [21:05:47] >>> Non-Heap: 146 MB used / 158 MB commited / 0 MB max <<< [21:05:47] : [Step 4/5] [2021-11-19 21:05:47,659][INFO ][main][root] >>> Non-Heap: 146 MB used / 158 MB commited / 0 MB max <<< [21:05:47]W: [org.apache.ignite:ignite-core] [2021-11-19 21:05:47,667][WARN ][test-runner-#11562%encryption.EncryptedCacheNodeJoinTest%][G] Ignite work directory is not provided, automatically resolved to: /opt/buildagent/work/7bc1c54bc719b67c/work [21:05:47] : [Step 4/5] [2021-11-19 21:05:47,669][INFO ][test-runner-#11562%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] [21:05:47] : [Step 4/5] [21:05:47] : [Step 4/5] >>> __________ ________________ [21:05:47] : [Step 4/5] >>> / _/ ___/ |/ / _/_ __/ __/ [21:05:47] : [Step 4/5] >>> _/ // (7 7 // / / / / _/ [21:05:47] : [Step 4/5] >>> /___/\___/_/|_/___/ /_/ /___/ [21:05:47] : [Step 4/5] >>> [21:05:47] : [Step 4/5] >>> ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:05:47] : [Step 4/5] >>> 2021 Copyright(C) Apache Software Foundation [21:05:47] : [Step 4/5] >>> [21:05:47] : [Step 4/5] >>> Ignite documentation: http://ignite.apache.org [21:05:47] : [Step 4/5] [21:05:47] : [Step 4/5] [2021-11-19 21:05:47,671][INFO ][test-runner-#11562%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] Config URL: n/a [21:05:47] : [Step 4/5] [2021-11-19 21:05:47,671][INFO ][test-runner-#11562%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] IgniteConfiguration [igniteInstanceName=grid-0, pubPoolSize=24, svcPoolSize=24, callbackPoolSize=24, stripedPoolSize=24, sysPoolSize=24, mgmtPoolSize=4, dataStreamerPoolSize=24, utilityCachePoolSize=24, utilityCacheKeepAliveTime=60000, p2pPoolSize=2, qryPoolSize=24, buildIdxPoolSize=4, igniteHome=/opt/buildagent/work/7bc1c54bc719b67c, igniteWorkDir=/opt/buildagent/work/7bc1c54bc719b67c/work, mbeanSrv=com.sun.jmx.mbeanserver.JmxMBeanServer@6fe85038, nodeId=0072825b-bc58-4699-8b84-6e50366b4000, marsh=BinaryMarshaller [], marshLocJobs=false, daemon=false, p2pEnabled=true, netTimeout=10000, netCompressionLevel=1, sndRetryDelay=1000, sndRetryCnt=3, metricsHistSize=10000, metricsUpdateFreq=1000, metricsExpTime=9223372036854775807, discoSpi=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=0, ackTimeout=0, marsh=null, reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], segPlc=STOP, segResolveAttempts=2, waitForSegOnStart=true, allResolversPassReq=true, segChkFreq=10000, commSpi=TcpCommunicationSpi [connectGate=org.apache.ignite.spi.communication.tcp.internal.ConnectGateway@58f20735, ctxInitLatch=java.util.concurrent.CountDownLatch@69b4e7a4[Count = 1], stopping=false, clientPool=null, nioSrvWrapper=null, stateProvider=null], evtSpi=MemoryEventStorageSpi [expireAgeMs=9223372036854775807, expireCnt=10000, filter=null], colSpi=NoopCollisionSpi [], deploySpi=LocalDeploymentSpi [], indexingSpi=org.apache.ignite.spi.indexing.noop.NoopIndexingSpi@5a000e43, addrRslvr=null, encryptionSpi=org.apache.ignite.spi.encryption.keystore.KeystoreEncryptionSpi@5f2e5adc, tracingSpi=org.apache.ignite.spi.tracing.NoopTracingSpi@22fa056e, clientMode=false, rebalanceThreadPoolSize=4, rebalanceTimeout=10000, rebalanceBatchesPrefetchCnt=3, rebalanceThrottle=0, rebalanceBatchSize=524288, txCfg=TransactionConfiguration [txSerEnabled=false, dfltIsolation=REPEATABLE_READ, dfltConcurrency=PESSIMISTIC, dfltTxTimeout=0, txTimeoutOnPartitionMapExchange=0, deadlockTimeout=10000, pessimisticTxLogSize=0, pessimisticTxLogLinger=10000, tmLookupClsName=null, txManagerFactory=null, useJtaSync=false], cacheSanityCheckEnabled=true, discoStartupDelay=60000, deployMode=SHARED, p2pMissedCacheSize=100, locHost=127.0.0.1, timeSrvPortBase=31100, timeSrvPortRange=100, failureDetectionTimeout=10000, sysWorkerBlockedTimeout=null, clientFailureDetectionTimeout=10000, metricsLogFreq=0, connectorCfg=null, odbcCfg=null, warmupClos=null, atomicCfg=AtomicConfiguration [seqReserveSize=1000, cacheMode=PARTITIONED, backups=1, aff=null, grpName=null], classLdr=null, sslCtxFactory=null, platformCfg=null, binaryCfg=null, memCfg=null, pstCfg=null, dsCfg=DataStorageConfiguration [sysRegionInitSize=41943040, sysRegionMaxSize=104857600, pageSize=4096, concLvl=0, dfltDataRegConf=DataRegionConfiguration [name=default, maxSize=10485760, initSize=268435456, swapPath=null, pageEvictionMode=DISABLED, pageReplacementMode=CLOCK, evictionThreshold=0.9, emptyPagesPoolSize=100, metricsEnabled=false, metricsSubIntervalCount=5, metricsRateTimeInterval=60000, persistenceEnabled=true, checkpointPageBufSize=0, lazyMemoryAllocation=true, warmUpCfg=null], dataRegions=null, storagePath=null, checkpointFreq=180000, lockWaitTime=10000, checkpointThreads=4, checkpointWriteOrder=SEQUENTIAL, walHistSize=20, maxWalArchiveSize=1073741824, walSegments=10, walSegmentSize=67108864, walPath=db/wal, walArchivePath=db/wal/archive, cdcWalPath=db/wal/cdc, cdcEnabled=false, metricsEnabled=false, walMode=FSYNC, walTlbSize=131072, walBuffSize=0, walFlushFreq=2000, walFsyncDelay=1000, walRecordIterBuffSize=67108864, alwaysWriteFullPages=false, fileIOFactory=org.apache.ignite.internal.processors.cache.persistence.file.AsyncFileIOFactory@347f11b6, metricsSubIntervalCnt=5, metricsRateTimeInterval=60000, walAutoArchiveAfterInactivity=-1, walForceArchiveTimeout=-1, writeThrottlingEnabled=false, walCompactionEnabled=false, walCompactionLevel=1, checkpointReadLockTimeout=null, walPageCompression=DISABLED, walPageCompressionLevel=null, dfltWarmUpCfg=null, encCfg=org.apache.ignite.configuration.EncryptionConfiguration@7f50ec2f, defragmentationThreadPoolSize=4, minWalArchiveSize=-1], snapshotPath=snapshots, activeOnStart=true, activeOnStartPropSetFlag=false, autoActivation=true, autoActivationPropSetFlag=false, clusterStateOnStart=null, sqlConnCfg=null, cliConnCfg=ClientConnectorConfiguration [host=null, port=10800, portRange=100, sockSndBufSize=0, sockRcvBufSize=0, tcpNoDelay=true, maxOpenCursorsPerConn=128, threadPoolSize=24, selectorCnt=12, idleTimeout=0, handshakeTimeout=10000, jdbcEnabled=true, odbcEnabled=true, thinCliEnabled=true, sslEnabled=false, useIgniteSslCtxFactory=true, sslClientAuth=false, sslCtxFactory=null, thinCliCfg=ThinClientConfiguration [maxActiveTxPerConn=100, maxActiveComputeTasksPerConn=0]], mvccVacuumThreadCnt=2, mvccVacuumFreq=5000, authEnabled=false, failureHnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]], commFailureRslvr=null, sqlCfg=SqlConfiguration [longQryWarnTimeout=3000, dfltQryTimeout=0, sqlQryHistSize=1000, validationEnabled=false], asyncContinuationExecutor=null] [21:05:47] : [Step 4/5] [2021-11-19 21:05:47,684][INFO ][test-runner-#11562%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] Daemon mode: off [21:05:47] : [Step 4/5] [2021-11-19 21:05:47,684][INFO ][test-runner-#11562%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] OS: Linux 4.15.0-151-generic amd64 [21:05:47] : [Step 4/5] [2021-11-19 21:05:47,684][INFO ][test-runner-#11562%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] OS user: teamcity [21:05:47] : [Step 4/5] [2021-11-19 21:05:47,685][INFO ][test-runner-#11562%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] PID: 16724 [21:05:47] : [Step 4/5] [2021-11-19 21:05:47,685][INFO ][test-runner-#11562%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] Language runtime: Java Platform API Specification ver. 1.8 [21:05:47] : [Step 4/5] [2021-11-19 21:05:47,686][INFO ][test-runner-#11562%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] VM information: Java(TM) SE Runtime Environment 1.8.0_261-b12 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 25.261-b12 [21:05:47] : [Step 4/5] [2021-11-19 21:05:47,686][INFO ][test-runner-#11562%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] VM total memory: 1.8GB [21:05:47] : [Step 4/5] [2021-11-19 21:05:47,687][INFO ][test-runner-#11562%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] Remote Management [restart: off, REST: off, JMX (remote: off)] [21:05:47] : [Step 4/5] [2021-11-19 21:05:47,687][INFO ][test-runner-#11562%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] Logger: GridTestLog4jLogger [quiet=false, config=null] [21:05:47] : [Step 4/5] [2021-11-19 21:05:47,687][INFO ][test-runner-#11562%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] IGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c [21:05:47] : [Step 4/5] [2021-11-19 21:05:47,688][INFO ][test-runner-#11562%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] VM arguments: [-DIGNITE_DUMP_THREADS_ON_FAILURE=false, -DMono=/usr/bin/mono-sgen, -DMono4.0_x64=/usr/lib/mono/4.0, -DMono4.5_x64=/usr/lib/mono/4.5, -DMonoVersion=6.12.0.90, -DSKIP_BUILD=false, -Dagent.home.dir=/opt/buildagent, -Dagent.name=aitc-lin02_03, -Dagent.ownPort=9090, -Dagent.work.dir=/opt/buildagent/work, -Dbuild.number=95, -Dbuild.vcs.number=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.1=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.GitHubApacheIgnite=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dclassworlds.conf=/opt/buildagent/temp/buildTmp/teamcity.m2.conf, -Dcom.jetbrains.maven.watcher.report.file=/opt/buildagent/temp/buildTmp/maven-build-info.xml, -Djava.io.tmpdir=/opt/buildagent/temp/buildTmp, -Dmaven.home=/opt/buildagent/tools/maven3_6, -Dmaven.multiModuleProjectDirectory=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.agent.cpuBenchmark=457, -Dteamcity.agent.dotnet.agent_url=http://localhost:9090/RPC2, -Dteamcity.agent.dotnet.build_id=6278078, -Dteamcity.auth.password=*******, -Dteamcity.auth.userId=TeamCityBuildId=6278078, -Dteamcity.build.changedFiles.file=/opt/buildagent/temp/buildTmp/changedFiles6342607772318147725.txt, -Dteamcity.build.checkoutDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.build.id=6278078, -Dteamcity.build.properties.file=/opt/buildagent/temp/buildTmp/teamcity.build5164517880467851002.properties, -Dteamcity.build.tempDir=/opt/buildagent/temp/buildTmp, -Dteamcity.build.workingDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.buildConfName=Basic 3, -Dteamcity.buildType.id=IgniteTests24Java8_Basic3, -Dteamcity.configuration.properties.file=/opt/buildagent/temp/buildTmp/teamcity.config5591980786735343870.properties, -Dteamcity.maven.userSettings.path=/opt/buildagent/temp/buildTmp/maven_settings_585072866407032347.xml, -Dteamcity.maven.watcher.home=/opt/buildagent/plugins/mavenPlugin/maven-watcher-jdk16, -Dteamcity.projectName=Ignite Tests 2.x (JDK 8/11), -Dteamcity.runner.properties.file=/opt/buildagent/temp/buildTmp/teamcity.runner9098465561618137420.properties, -Dteamcity.tests.recentlyFailedTests.file=/opt/buildagent/temp/buildTmp/testsToRunFirst3891775683130404069.txt, -Dteamcity.version=2021.2 (build 99542), -ea, -Xms2g, -Xmx2g, -XX:+HeapDumpOnOutOfMemoryError, -DIGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_TEST_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_UPDATE_NOTIFIER=false, -DIGNITE_NO_DISCO_ORDER=true, -DIGNITE_PERFORMANCE_SUGGESTIONS_DISABLED=true, -Djava.net.preferIPv4Stack=true, -DTEST_SCALE_FACTOR=1.0, -DIGNITE_TEST_PROP_LOG4J_FILE=log4j-tc-test.xml, -DIGNITE_QUIET=false, -DIGNITE_MARSHAL_BUFFERS_RECHECK=1000, -Dmaven.repo.local=/opt/buildagent/.m2/repository] [21:05:47] : [Step 4/5] [2021-11-19 21:05:47,694][INFO ][test-runner-#11562%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] System cache's DataRegion size is configured to 40 MB. Use DataStorageConfiguration.systemRegionInitialSize property to change the setting. [21:05:47] : [Step 4/5] [2021-11-19 21:05:47,695][INFO ][test-runner-#11562%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] Configured caches [in 'sysMemPlc' dataRegion: ['ignite-sys-cache']] [21:05:47]W: [org.apache.ignite:ignite-core] [2021-11-19 21:05:47,695][WARN ][test-runner-#11562%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] Peer class loading is enabled (disable it in production for performance and deployment consistency reasons) [21:05:47] : [Step 4/5] [2021-11-19 21:05:47,696][INFO ][test-runner-#11562%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] 3-rd party licenses can be found at: /opt/buildagent/work/7bc1c54bc719b67c/libs/licenses [21:05:47] : [Step 4/5] [2021-11-19 21:05:47,702][INFO ][test-runner-#11562%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] Configured plugins: [21:05:47] : [Step 4/5] [2021-11-19 21:05:47,702][INFO ][test-runner-#11562%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- StanByClusterTestProvider 1.0 [21:05:47] : [Step 4/5] [2021-11-19 21:05:47,702][INFO ][test-runner-#11562%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- null [21:05:47] : [Step 4/5] [2021-11-19 21:05:47,703][INFO ][test-runner-#11562%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] [21:05:47] : [Step 4/5] [2021-11-19 21:05:47,703][INFO ][test-runner-#11562%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- PageMemory tracker plugin 1.0 [21:05:47] : [Step 4/5] [2021-11-19 21:05:47,703][INFO ][test-runner-#11562%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- null [21:05:47] : [Step 4/5] [2021-11-19 21:05:47,703][INFO ][test-runner-#11562%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] [21:05:47] : [Step 4/5] [2021-11-19 21:05:47,704][INFO ][test-runner-#11562%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- TestDistibutedConfigurationPlugin 1.0 [21:05:47] : [Step 4/5] [2021-11-19 21:05:47,704][INFO ][test-runner-#11562%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- null [21:05:47] : [Step 4/5] [2021-11-19 21:05:47,704][INFO ][test-runner-#11562%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] [21:05:47] : [Step 4/5] [2021-11-19 21:05:47,704][INFO ][test-runner-#11562%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- NodeValidationPluginProvider 1.0 [21:05:47] : [Step 4/5] [2021-11-19 21:05:47,705][INFO ][test-runner-#11562%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- null [21:05:47] : [Step 4/5] [2021-11-19 21:05:47,705][INFO ][test-runner-#11562%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] [21:05:47] : [Step 4/5] [2021-11-19 21:05:47,705][INFO ][test-runner-#11562%encryption.EncryptedCacheNodeJoinTest%][FailureProcessor] Configured failure handler: [hnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]]] [21:05:47]W: [org.apache.ignite:ignite-core] [2021-11-19 21:05:47,745][WARN ][test-runner-#11562%encryption.EncryptedCacheNodeJoinTest%][TcpCommunicationSpi] Message queue limit is set to 0 which may lead to potential OOMEs when running cache operations in FULL_ASYNC or PRIMARY_SYNC modes due to message queues growth on sender and receiver sides. [21:05:47] : [Step 4/5] [2021-11-19 21:05:47,745][INFO ][test-runner-#11562%encryption.EncryptedCacheNodeJoinTest%][TcpCommunicationSpi] Successfully bound communication NIO server to TCP port [port=45150, locHost=/127.0.0.1, selectorsCnt=12, selectorSpins=0, pairedConn=false] [21:05:47] : [Step 4/5] [2021-11-19 21:05:47,767][INFO ][test-runner-#11562%encryption.EncryptedCacheNodeJoinTest%][GridCollisionManager] Collision resolution is disabled (all jobs will be activated upon arrival). [21:05:47] : [Step 4/5] [2021-11-19 21:05:47,768][INFO ][test-runner-#11562%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] Security status [authentication=off, sandbox=off, tls/ssl=off] [21:05:47] : [Step 4/5] [2021-11-19 21:05:47,844][INFO ][test-runner-#11562%encryption.EncryptedCacheNodeJoinTest%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:05:47] : [Step 4/5] [2021-11-19 21:05:47,933][INFO ][test-runner-#11562%encryption.EncryptedCacheNodeJoinTest%][MaintenanceProcessor] Resolved store directory for node persistent data: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0 [21:05:47] : [Step 4/5] [2021-11-19 21:05:47,934][INFO ][test-runner-#11562%encryption.EncryptedCacheNodeJoinTest%][CacheObjectBinaryProcessorImpl] Resolved directory for serialized binary metadata: /opt/buildagent/work/7bc1c54bc719b67c/work/db/binary_meta/grid_0 [21:05:47] : [Step 4/5] [2021-11-19 21:05:47,939][INFO ][test-runner-#11562%encryption.EncryptedCacheNodeJoinTest%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0 [21:05:47] : [Step 4/5] [2021-11-19 21:05:47,940][INFO ][test-runner-#11562%encryption.EncryptedCacheNodeJoinTest%][FileWriteAheadLogManager] Resolved write ahead log work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0 [21:05:47] : [Step 4/5] [2021-11-19 21:05:47,940][INFO ][test-runner-#11562%encryption.EncryptedCacheNodeJoinTest%][FileWriteAheadLogManager] Resolved write ahead log archive directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0 [21:05:48] : [Step 4/5] [2021-11-19 21:05:48,392][INFO ][test-runner-#11562%encryption.EncryptedCacheNodeJoinTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000000.wal [21:05:48]W: [org.apache.ignite:ignite-core] [2021-11-19 21:05:48,392][WARN ][test-runner-#11562%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] DataRegion maxSize=10.5 MB is smaller than defaultInitialSize=268.4 MB, setting initialSize to 10.5 MB [21:05:48] : [Step 4/5] [2021-11-19 21:05:48,398][INFO ][test-runner-#11562%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Configured data regions initialized successfully [total=5] [21:05:48] : [Step 4/5] [2021-11-19 21:05:48,400][INFO ][test-runner-#11562%encryption.EncryptedCacheNodeJoinTest%][IgniteSnapshotManager] Resolved snapshot work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/snapshots [21:05:48] : [Step 4/5] [2021-11-19 21:05:48,401][INFO ][test-runner-#11562%encryption.EncryptedCacheNodeJoinTest%][IgniteSnapshotManager] Resolved temp directory for snapshot creation: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0/snp [21:05:48] : [Step 4/5] [2021-11-19 21:05:48,404][INFO ][test-runner-#11562%encryption.EncryptedCacheNodeJoinTest%][ClientListenerProcessor] Client connector processor has started on TCP port 10800 [21:05:48] : [Step 4/5] [2021-11-19 21:05:48,412][INFO ][test-runner-#11562%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] Non-loopback local IPs: 172.17.0.4 [21:05:48] : [Step 4/5] [2021-11-19 21:05:48,412][INFO ][test-runner-#11562%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] Enabled local MACs: 0242AC110004 [21:05:48] : [Step 4/5] [2021-11-19 21:05:48,415][INFO ][test-runner-#11562%encryption.EncryptedCacheNodeJoinTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:05:48] : [Step 4/5] [2021-11-19 21:05:48,416][INFO ][test-runner-#11562%encryption.EncryptedCacheNodeJoinTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:05:48] : [Step 4/5] [2021-11-19 21:05:48,417][INFO ][test-runner-#11562%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:05:48] : [Step 4/5] [2021-11-19 21:05:48,419][INFO ][test-runner-#11562%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Applying lost metastore updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:05:48] : [Step 4/5] [2021-11-19 21:05:48,421][INFO ][test-runner-#11562%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=0 ms] [21:05:48] : [Step 4/5] [2021-11-19 21:05:48,421][INFO ][test-runner-#11562%encryption.EncryptedCacheNodeJoinTest%][GridCacheProcessor] Restoring partition state for local groups. [21:05:48] : [Step 4/5] [2021-11-19 21:05:48,421][INFO ][test-runner-#11562%encryption.EncryptedCacheNodeJoinTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=0, partitionsProcessed=0, time=0ms] [21:05:48] : [Step 4/5] [2021-11-19 21:05:48,422][INFO ][test-runner-#11562%encryption.EncryptedCacheNodeJoinTest%][GridEncryptionManager] Encryption keys loaded from metastore. [grps=, masterKeyName=ignite.master.key] [21:05:48] : [Step 4/5] [2021-11-19 21:05:48,429][INFO ][test-runner-#11562%encryption.EncryptedCacheNodeJoinTest%][ClusterProcessor] Cluster ID and tag has been read from metastorage: null [21:05:48] : [Step 4/5] [2021-11-19 21:05:48,429][INFO ][test-runner-#11562%encryption.EncryptedCacheNodeJoinTest%][IgniteClusterImpl] Shutdown policy was updated [oldVal=null, newVal=null] [21:05:48] : [Step 4/5] [2021-11-19 21:05:48,430][INFO ][test-runner-#11562%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Checkpoint frequency deviation changed [oldVal=null, newVal=null] [21:05:48] : [Step 4/5] [2021-11-19 21:05:48,440][INFO ][test-runner-#11562%encryption.EncryptedCacheNodeJoinTest%][FilePageStoreManager] Cleanup cache stores [total=1, left=0, cleanFiles=false] [21:05:48] : [Step 4/5] [2021-11-19 21:05:48,442][INFO ][test-runner-#11562%encryption.EncryptedCacheNodeJoinTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:05:48] : [Step 4/5] [2021-11-19 21:05:48,444][INFO ][test-runner-#11562%encryption.EncryptedCacheNodeJoinTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:05:48] : [Step 4/5] [2021-11-19 21:05:48,445][INFO ][test-runner-#11562%encryption.EncryptedCacheNodeJoinTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:05:48] : [Step 4/5] [2021-11-19 21:05:48,445][INFO ][test-runner-#11562%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Data Regions Started: 5 [21:05:48] : [Step 4/5] [2021-11-19 21:05:48,446][INFO ][test-runner-#11562%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] ^-- sysMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:05:48] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:05:48] : [Step 4/5] ^-- default region [type=default, persistence=true, lazyAlloc=true, [21:05:48] : [Step 4/5] ... initCfg=10MB, maxCfg=10MB, usedRam=0MB, freeRam=100%, allocRam=0MB, allocTotal=0MB] [21:05:48] : [Step 4/5] ^-- metastoreMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:05:48] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:05:48] : [Step 4/5] ^-- TxLog region [type=internal, persistence=true, lazyAlloc=false, [21:05:48] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:05:48] : [Step 4/5] ^-- volatileDsMemPlc region [type=user, persistence=false, lazyAlloc=true, [21:05:48] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB] [21:05:48] : [Step 4/5] ^-- Ignite persistence [used=0MB] [21:05:48] : [Step 4/5] [21:05:48] : [Step 4/5] [2021-11-19 21:05:48,448][INFO ][test-runner-#11562%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Starting binary memory restore for: [-2100569601] [21:05:48] : [Step 4/5] [2021-11-19 21:05:48,461][INFO ][test-runner-#11562%encryption.EncryptedCacheNodeJoinTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:05:48] : [Step 4/5] [2021-11-19 21:05:48,461][INFO ][test-runner-#11562%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:05:48] : [Step 4/5] [2021-11-19 21:05:48,466][INFO ][test-runner-#11562%encryption.EncryptedCacheNodeJoinTest%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000000.wal, offset=0, ver=2] [21:05:48] : [Step 4/5] [2021-11-19 21:05:48,470][INFO ][test-runner-#11562%encryption.EncryptedCacheNodeJoinTest%][GridCacheProcessor] Started cache in recovery mode [name=ignite-sys-cache, id=-2100569601, dataRegionName=sysMemPlc, mode=REPLICATED, atomicity=TRANSACTIONAL, backups=2147483647, mvcc=false] [21:05:48] : [Step 4/5] [2021-11-19 21:05:48,471][INFO ][test-runner-#11562%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Binary recovery performed in 23 ms. [21:05:48] : [Step 4/5] [2021-11-19 21:05:48,472][INFO ][test-runner-#11562%encryption.EncryptedCacheNodeJoinTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:05:48] : [Step 4/5] [2021-11-19 21:05:48,472][INFO ][test-runner-#11562%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Applying lost cache updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:05:48] : [Step 4/5] [2021-11-19 21:05:48,542][INFO ][test-runner-#11562%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=71 ms] [21:05:48] : [Step 4/5] [2021-11-19 21:05:48,543][INFO ][test-runner-#11562%encryption.EncryptedCacheNodeJoinTest%][GridCacheProcessor] Restoring partition state for local groups. [21:05:48] : [Step 4/5] [2021-11-19 21:05:48,573][INFO ][test-runner-#11562%encryption.EncryptedCacheNodeJoinTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=1, partitionsProcessed=100, time=30ms] [21:05:49] : [Step 4/5] [2021-11-19 21:05:49,183][INFO ][test-runner-#11562%encryption.EncryptedCacheNodeJoinTest%][TestTcpDiscoverySpi] Successfully bound to TCP port [port=47500, localHost=localhost/127.0.0.1, locNodeId=0072825b-bc58-4699-8b84-6e50366b4000] [21:05:49] : [Step 4/5] [2021-11-19 21:05:49,192][INFO ][disco-notifier-worker-#11673%grid-0%][MvccProcessorImpl] Assigned mvcc coordinator [crd=MvccCoordinator [topVer=AffinityTopologyVersion [topVer=1, minorTopVer=0], nodeId=0072825b-bc58-4699-8b84-6e50366b4000, ver=1637345149191, local=true, initialized=false]] [21:05:49] : [Step 4/5] [2021-11-19 21:05:49,193][INFO ][sys-#11672%grid-0%][ClusterProcessor] Writing cluster ID and tag to metastorage on ready for write ClusterIdAndTag [id=dc52f45c-a081-4d96-aa2d-bc8bb33519df, tag=gallant_davinci] [21:05:49] : [Step 4/5] [2021-11-19 21:05:49,197][INFO ][disco-notifier-worker-#11673%grid-0%][ClusterProcessor] gallant_davinci [21:05:49] : [Step 4/5] [2021-11-19 21:05:49,198][INFO ][disco-notifier-worker-#11673%grid-0%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustEnabled' was changed from 'null' to 'false' [21:05:49] : [Step 4/5] [2021-11-19 21:05:49,199][INFO ][disco-notifier-worker-#11673%grid-0%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustTimeout' was changed from 'null' to '300000' [21:05:49] : [Step 4/5] [2021-11-19 21:05:49,199][INFO ][disco-notifier-worker-#11673%grid-0%][IgniteTxManager] Transactions parameter 'longOperationsDumpTimeout' was changed from 'null' to '60000' [21:05:49] : [Step 4/5] [2021-11-19 21:05:49,200][INFO ][disco-notifier-worker-#11673%grid-0%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpThreshold' was changed from 'null' to '0' [21:05:49] : [Step 4/5] [2021-11-19 21:05:49,200][INFO ][disco-notifier-worker-#11673%grid-0%][IgniteTxManager] Transactions parameter 'transactionTimeDumpSamplesCoefficient' was changed from 'null' to '0.0' [21:05:49] : [Step 4/5] [2021-11-19 21:05:49,201][INFO ][disco-notifier-worker-#11673%grid-0%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpSamplesPerSecondLimit' was changed from 'null' to '5' [21:05:49] : [Step 4/5] [2021-11-19 21:05:49,201][INFO ][disco-notifier-worker-#11673%grid-0%][IgniteTxManager] Transactions parameter 'collisionsDumpInterval' was changed from 'null' to '1000' [21:05:49] : [Step 4/5] [2021-11-19 21:05:49,202][INFO ][disco-notifier-worker-#11673%grid-0%][IgniteTxManager] Transactions parameter 'txOwnerDumpRequestsAllowed' was changed from 'null' to 'true' [21:05:49] : [Step 4/5] [2021-11-19 21:05:49,203][INFO ][disco-notifier-worker-#11673%grid-0%][GridCacheDatabaseSharedManager] Historical rebalance WAL threshold changed [property=historical.rebalance.threshold, oldVal=null, newVal=500] [21:05:49] : [Step 4/5] [2021-11-19 21:05:49,204][INFO ][test-runner-#11562%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] To start Console Management & Monitoring run ignitevisorcmd.{sh|bat} [21:05:49] : [Step 4/5] [2021-11-19 21:05:49,204][INFO ][test-runner-#11562%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] [21:05:49] : [Step 4/5] [21:05:49] : [Step 4/5] >>> +-------------------------------------------+ [21:05:49] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:05:49] : [Step 4/5] >>> +-------------------------------------------+ [21:05:49] : [Step 4/5] >>> OS name: Linux 4.15.0-151-generic amd64 [21:05:49] : [Step 4/5] >>> CPU(s): 24 [21:05:49] : [Step 4/5] >>> Heap: 2.0GB [21:05:49] : [Step 4/5] >>> VM name: 16724@c4dfe9a430b2 [21:05:49] : [Step 4/5] >>> Ignite instance name: grid-0 [21:05:49] : [Step 4/5] >>> Local node [ID=0072825B-BC58-4699-8B84-6E50366B4000, order=1, clientMode=false] [21:05:49] : [Step 4/5] >>> Local node addresses: [127.0.0.1] [21:05:49] : [Step 4/5] >>> Local ports: TCP:10800 TCP:45150 TCP:47500 [21:05:49] : [Step 4/5] [21:05:49] : [Step 4/5] [2021-11-19 21:05:49,205][INFO ][test-runner-#11562%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] >>> Ignite cluster is in INACTIVE state (limited functionality available). Use control.(sh|bat) script or IgniteCluster.state(ClusterState.ACTIVE) to change the state. [21:05:49] : [Step 4/5] [2021-11-19 21:05:49,206][INFO ][test-runner-#11562%encryption.EncryptedCacheNodeJoinTest%][GridDiscoveryManager] Topology snapshot [ver=1, locNode=0072825b, servers=1, clients=0, state=INACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=0072825b-bc58-4699-8b84-6e50366b4000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:05:49] : [Step 4/5] [2021-11-19 21:05:49,207][INFO ][test-runner-#11562%encryption.EncryptedCacheNodeJoinTest%][G] Node started : [stage="Configure system pool" (0 ms),stage="Start managers" (265 ms),stage="Configure binary metadata" (2 ms),stage="Start processors" (474 ms),stage="Start 'StanByClusterTestProvider' plugin" (0 ms),stage="Start 'PageMemory tracker plugin' plugin" (0 ms),stage="Start 'TestDistibutedConfigurationPlugin' plugin" (0 ms),stage="Start 'NodeValidationPluginProvider' plugin" (0 ms),stage="Init metastore" (29 ms),stage="Init and start regions" (7 ms),stage="Restore binary memory" (24 ms),stage="Restore logical state" (101 ms),stage="Finish recovery" (608 ms),stage="Join topology" (10 ms),stage="Await transition" (1 ms),stage="Await exchange" (12 ms),stage="Total time" (1533 ms)] [21:05:49] : [Step 4/5] [2021-11-19 21:05:49,208][INFO ][test-runner-#11562%encryption.EncryptedCacheNodeJoinTest%][root] Node started with the following configuration [id=0072825b-bc58-4699-8b84-6e50366b4000, marshaller=BinaryMarshaller [], discovery=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=5000, ackTimeout=5000, marsh=JdkMarshaller [clsFilter=org.apache.ignite.marshaller.MarshallerUtils$1@345803f], reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], binaryCfg=null, lateAff=true] [21:05:49]W: [org.apache.ignite:ignite-core] [2021-11-19 21:05:49,213][WARN ][test-runner-#11562%encryption.EncryptedCacheNodeJoinTest%][G] Ignite work directory is not provided, automatically resolved to: /opt/buildagent/work/7bc1c54bc719b67c/work [21:05:49] : [Step 4/5] [2021-11-19 21:05:49,214][INFO ][test-runner-#11562%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-1] [21:05:49] : [Step 4/5] [21:05:49] : [Step 4/5] >>> __________ ________________ [21:05:49] : [Step 4/5] >>> / _/ ___/ |/ / _/_ __/ __/ [21:05:49] : [Step 4/5] >>> _/ // (7 7 // / / / / _/ [21:05:49] : [Step 4/5] >>> /___/\___/_/|_/___/ /_/ /___/ [21:05:49] : [Step 4/5] >>> [21:05:49] : [Step 4/5] >>> ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:05:49] : [Step 4/5] >>> 2021 Copyright(C) Apache Software Foundation [21:05:49] : [Step 4/5] >>> [21:05:49] : [Step 4/5] >>> Ignite documentation: http://ignite.apache.org [21:05:49] : [Step 4/5] [21:05:49] : [Step 4/5] [2021-11-19 21:05:49,214][INFO ][test-runner-#11562%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-1] Config URL: n/a [21:05:49] : [Step 4/5] [2021-11-19 21:05:49,215][INFO ][test-runner-#11562%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-1] IgniteConfiguration [igniteInstanceName=grid-1, pubPoolSize=24, svcPoolSize=24, callbackPoolSize=24, stripedPoolSize=24, sysPoolSize=24, mgmtPoolSize=4, dataStreamerPoolSize=24, utilityCachePoolSize=24, utilityCacheKeepAliveTime=60000, p2pPoolSize=2, qryPoolSize=24, buildIdxPoolSize=4, igniteHome=/opt/buildagent/work/7bc1c54bc719b67c, igniteWorkDir=/opt/buildagent/work/7bc1c54bc719b67c/work, mbeanSrv=com.sun.jmx.mbeanserver.JmxMBeanServer@6fe85038, nodeId=10e58fc8-9c34-4cb7-b622-18bd0aae0001, marsh=BinaryMarshaller [], marshLocJobs=false, daemon=false, p2pEnabled=true, netTimeout=10000, netCompressionLevel=1, sndRetryDelay=1000, sndRetryCnt=3, metricsHistSize=10000, metricsUpdateFreq=1000, metricsExpTime=9223372036854775807, discoSpi=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=0, ackTimeout=0, marsh=null, reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], segPlc=STOP, segResolveAttempts=2, waitForSegOnStart=true, allResolversPassReq=true, segChkFreq=10000, commSpi=TcpCommunicationSpi [connectGate=org.apache.ignite.spi.communication.tcp.internal.ConnectGateway@48e9558b, ctxInitLatch=java.util.concurrent.CountDownLatch@44f2f7ee[Count = 1], stopping=false, clientPool=null, nioSrvWrapper=null, stateProvider=null], evtSpi=MemoryEventStorageSpi [expireAgeMs=9223372036854775807, expireCnt=10000, filter=null], colSpi=NoopCollisionSpi [], deploySpi=LocalDeploymentSpi [], indexingSpi=org.apache.ignite.spi.indexing.noop.NoopIndexingSpi@616c62e4, addrRslvr=null, encryptionSpi=org.apache.ignite.spi.encryption.noop.NoopEncryptionSpi@6c140ec, tracingSpi=org.apache.ignite.spi.tracing.NoopTracingSpi@19690f0f, clientMode=false, rebalanceThreadPoolSize=4, rebalanceTimeout=10000, rebalanceBatchesPrefetchCnt=3, rebalanceThrottle=0, rebalanceBatchSize=524288, txCfg=TransactionConfiguration [txSerEnabled=false, dfltIsolation=REPEATABLE_READ, dfltConcurrency=PESSIMISTIC, dfltTxTimeout=0, txTimeoutOnPartitionMapExchange=0, deadlockTimeout=10000, pessimisticTxLogSize=0, pessimisticTxLogLinger=10000, tmLookupClsName=null, txManagerFactory=null, useJtaSync=false], cacheSanityCheckEnabled=true, discoStartupDelay=60000, deployMode=SHARED, p2pMissedCacheSize=100, locHost=127.0.0.1, timeSrvPortBase=31100, timeSrvPortRange=100, failureDetectionTimeout=10000, sysWorkerBlockedTimeout=null, clientFailureDetectionTimeout=10000, metricsLogFreq=0, connectorCfg=null, odbcCfg=null, warmupClos=null, atomicCfg=AtomicConfiguration [seqReserveSize=1000, cacheMode=PARTITIONED, backups=1, aff=null, grpName=null], classLdr=null, sslCtxFactory=null, platformCfg=null, binaryCfg=null, memCfg=null, pstCfg=null, dsCfg=DataStorageConfiguration [sysRegionInitSize=41943040, sysRegionMaxSize=104857600, pageSize=4096, concLvl=0, dfltDataRegConf=DataRegionConfiguration [name=default, maxSize=10485760, initSize=268435456, swapPath=null, pageEvictionMode=DISABLED, pageReplacementMode=CLOCK, evictionThreshold=0.9, emptyPagesPoolSize=100, metricsEnabled=false, metricsSubIntervalCount=5, metricsRateTimeInterval=60000, persistenceEnabled=true, checkpointPageBufSize=0, lazyMemoryAllocation=true, warmUpCfg=null], dataRegions=null, storagePath=null, checkpointFreq=180000, lockWaitTime=10000, checkpointThreads=4, checkpointWriteOrder=SEQUENTIAL, walHistSize=20, maxWalArchiveSize=1073741824, walSegments=10, walSegmentSize=67108864, walPath=db/wal, walArchivePath=db/wal/archive, cdcWalPath=db/wal/cdc, cdcEnabled=false, metricsEnabled=false, walMode=FSYNC, walTlbSize=131072, walBuffSize=0, walFlushFreq=2000, walFsyncDelay=1000, walRecordIterBuffSize=67108864, alwaysWriteFullPages=false, fileIOFactory=org.apache.ignite.internal.processors.cache.persistence.file.AsyncFileIOFactory@55f5460a, metricsSubIntervalCnt=5, metricsRateTimeInterval=60000, walAutoArchiveAfterInactivity=-1, walForceArchiveTimeout=-1, writeThrottlingEnabled=false, walCompactionEnabled=false, walCompactionLevel=1, checkpointReadLockTimeout=null, walPageCompression=DISABLED, walPageCompressionLevel=null, dfltWarmUpCfg=null, encCfg=org.apache.ignite.configuration.EncryptionConfiguration@7869c418, defragmentationThreadPoolSize=4, minWalArchiveSize=-1], snapshotPath=snapshots, activeOnStart=true, activeOnStartPropSetFlag=false, autoActivation=true, autoActivationPropSetFlag=false, clusterStateOnStart=null, sqlConnCfg=null, cliConnCfg=ClientConnectorConfiguration [host=null, port=10800, portRange=100, sockSndBufSize=0, sockRcvBufSize=0, tcpNoDelay=true, maxOpenCursorsPerConn=128, threadPoolSize=24, selectorCnt=12, idleTimeout=0, handshakeTimeout=10000, jdbcEnabled=true, odbcEnabled=true, thinCliEnabled=true, sslEnabled=false, useIgniteSslCtxFactory=true, sslClientAuth=false, sslCtxFactory=null, thinCliCfg=ThinClientConfiguration [maxActiveTxPerConn=100, maxActiveComputeTasksPerConn=0]], mvccVacuumThreadCnt=2, mvccVacuumFreq=5000, authEnabled=false, failureHnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]], commFailureRslvr=null, sqlCfg=SqlConfiguration [longQryWarnTimeout=3000, dfltQryTimeout=0, sqlQryHistSize=1000, validationEnabled=false], asyncContinuationExecutor=null] [21:05:49] : [Step 4/5] [2021-11-19 21:05:49,222][INFO ][test-runner-#11562%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-1] Daemon mode: off [21:05:49] : [Step 4/5] [2021-11-19 21:05:49,222][INFO ][test-runner-#11562%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-1] OS: Linux 4.15.0-151-generic amd64 [21:05:49] : [Step 4/5] [2021-11-19 21:05:49,222][INFO ][test-runner-#11562%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-1] OS user: teamcity [21:05:49] : [Step 4/5] [2021-11-19 21:05:49,222][INFO ][test-runner-#11562%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-1] PID: 16724 [21:05:49] : [Step 4/5] [2021-11-19 21:05:49,223][INFO ][test-runner-#11562%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-1] Language runtime: Java Platform API Specification ver. 1.8 [21:05:49] : [Step 4/5] [2021-11-19 21:05:49,223][INFO ][test-runner-#11562%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-1] VM information: Java(TM) SE Runtime Environment 1.8.0_261-b12 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 25.261-b12 [21:05:49] : [Step 4/5] [2021-11-19 21:05:49,223][INFO ][test-runner-#11562%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-1] VM total memory: 1.8GB [21:05:49] : [Step 4/5] [2021-11-19 21:05:49,223][INFO ][test-runner-#11562%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-1] Remote Management [restart: off, REST: off, JMX (remote: off)] [21:05:49] : [Step 4/5] [2021-11-19 21:05:49,224][INFO ][test-runner-#11562%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-1] Logger: GridTestLog4jLogger [quiet=false, config=null] [21:05:49] : [Step 4/5] [2021-11-19 21:05:49,224][INFO ][test-runner-#11562%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-1] IGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c [21:05:49] : [Step 4/5] [2021-11-19 21:05:49,224][INFO ][test-runner-#11562%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-1] VM arguments: [-DIGNITE_DUMP_THREADS_ON_FAILURE=false, -DMono=/usr/bin/mono-sgen, -DMono4.0_x64=/usr/lib/mono/4.0, -DMono4.5_x64=/usr/lib/mono/4.5, -DMonoVersion=6.12.0.90, -DSKIP_BUILD=false, -Dagent.home.dir=/opt/buildagent, -Dagent.name=aitc-lin02_03, -Dagent.ownPort=9090, -Dagent.work.dir=/opt/buildagent/work, -Dbuild.number=95, -Dbuild.vcs.number=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.1=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.GitHubApacheIgnite=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dclassworlds.conf=/opt/buildagent/temp/buildTmp/teamcity.m2.conf, -Dcom.jetbrains.maven.watcher.report.file=/opt/buildagent/temp/buildTmp/maven-build-info.xml, -Djava.io.tmpdir=/opt/buildagent/temp/buildTmp, -Dmaven.home=/opt/buildagent/tools/maven3_6, -Dmaven.multiModuleProjectDirectory=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.agent.cpuBenchmark=457, -Dteamcity.agent.dotnet.agent_url=http://localhost:9090/RPC2, -Dteamcity.agent.dotnet.build_id=6278078, -Dteamcity.auth.password=*******, -Dteamcity.auth.userId=TeamCityBuildId=6278078, -Dteamcity.build.changedFiles.file=/opt/buildagent/temp/buildTmp/changedFiles6342607772318147725.txt, -Dteamcity.build.checkoutDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.build.id=6278078, -Dteamcity.build.properties.file=/opt/buildagent/temp/buildTmp/teamcity.build5164517880467851002.properties, -Dteamcity.build.tempDir=/opt/buildagent/temp/buildTmp, -Dteamcity.build.workingDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.buildConfName=Basic 3, -Dteamcity.buildType.id=IgniteTests24Java8_Basic3, -Dteamcity.configuration.properties.file=/opt/buildagent/temp/buildTmp/teamcity.config5591980786735343870.properties, -Dteamcity.maven.userSettings.path=/opt/buildagent/temp/buildTmp/maven_settings_585072866407032347.xml, -Dteamcity.maven.watcher.home=/opt/buildagent/plugins/mavenPlugin/maven-watcher-jdk16, -Dteamcity.projectName=Ignite Tests 2.x (JDK 8/11), -Dteamcity.runner.properties.file=/opt/buildagent/temp/buildTmp/teamcity.runner9098465561618137420.properties, -Dteamcity.tests.recentlyFailedTests.file=/opt/buildagent/temp/buildTmp/testsToRunFirst3891775683130404069.txt, -Dteamcity.version=2021.2 (build 99542), -ea, -Xms2g, -Xmx2g, -XX:+HeapDumpOnOutOfMemoryError, -DIGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_TEST_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_UPDATE_NOTIFIER=false, -DIGNITE_NO_DISCO_ORDER=true, -DIGNITE_PERFORMANCE_SUGGESTIONS_DISABLED=true, -Djava.net.preferIPv4Stack=true, -DTEST_SCALE_FACTOR=1.0, -DIGNITE_TEST_PROP_LOG4J_FILE=log4j-tc-test.xml, -DIGNITE_QUIET=false, -DIGNITE_MARSHAL_BUFFERS_RECHECK=1000, -Dmaven.repo.local=/opt/buildagent/.m2/repository] [21:05:49] : [Step 4/5] [2021-11-19 21:05:49,228][INFO ][test-runner-#11562%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-1] System cache's DataRegion size is configured to 40 MB. Use DataStorageConfiguration.systemRegionInitialSize property to change the setting. [21:05:49] : [Step 4/5] [2021-11-19 21:05:49,228][INFO ][test-runner-#11562%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-1] Configured caches [in 'sysMemPlc' dataRegion: ['ignite-sys-cache']] [21:05:49]W: [org.apache.ignite:ignite-core] [2021-11-19 21:05:49,229][WARN ][test-runner-#11562%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-1] Peer class loading is enabled (disable it in production for performance and deployment consistency reasons) [21:05:49] : [Step 4/5] [2021-11-19 21:05:49,229][INFO ][test-runner-#11562%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-1] 3-rd party licenses can be found at: /opt/buildagent/work/7bc1c54bc719b67c/libs/licenses [21:05:49] : [Step 4/5] [2021-11-19 21:05:49,233][INFO ][test-runner-#11562%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] Configured plugins: [21:05:49] : [Step 4/5] [2021-11-19 21:05:49,234][INFO ][test-runner-#11562%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- StanByClusterTestProvider 1.0 [21:05:49] : [Step 4/5] [2021-11-19 21:05:49,234][INFO ][test-runner-#11562%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- null [21:05:49] : [Step 4/5] [2021-11-19 21:05:49,234][INFO ][test-runner-#11562%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] [21:05:49] : [Step 4/5] [2021-11-19 21:05:49,234][INFO ][test-runner-#11562%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- PageMemory tracker plugin 1.0 [21:05:49] : [Step 4/5] [2021-11-19 21:05:49,234][INFO ][test-runner-#11562%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- null [21:05:49] : [Step 4/5] [2021-11-19 21:05:49,234][INFO ][test-runner-#11562%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] [21:05:49] : [Step 4/5] [2021-11-19 21:05:49,234][INFO ][test-runner-#11562%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- TestDistibutedConfigurationPlugin 1.0 [21:05:49] : [Step 4/5] [2021-11-19 21:05:49,235][INFO ][test-runner-#11562%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- null [21:05:49] : [Step 4/5] [2021-11-19 21:05:49,235][INFO ][test-runner-#11562%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] [21:05:49] : [Step 4/5] [2021-11-19 21:05:49,235][INFO ][test-runner-#11562%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- NodeValidationPluginProvider 1.0 [21:05:49] : [Step 4/5] [2021-11-19 21:05:49,235][INFO ][test-runner-#11562%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- null [21:05:49] : [Step 4/5] [2021-11-19 21:05:49,235][INFO ][test-runner-#11562%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] [21:05:49] : [Step 4/5] [2021-11-19 21:05:49,236][INFO ][test-runner-#11562%encryption.EncryptedCacheNodeJoinTest%][FailureProcessor] Configured failure handler: [hnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]]] [21:05:49] : [Step 4/5] [2021-11-19 21:05:49,246][INFO ][test-runner-#11562%encryption.EncryptedCacheNodeJoinTest%][TcpCommunicationSpi] Successfully bound communication NIO server to TCP port [port=45151, locHost=/127.0.0.1, selectorsCnt=12, selectorSpins=0, pairedConn=false] [21:05:49]W: [org.apache.ignite:ignite-core] [2021-11-19 21:05:49,246][WARN ][test-runner-#11562%encryption.EncryptedCacheNodeJoinTest%][TcpCommunicationSpi] Message queue limit is set to 0 which may lead to potential OOMEs when running cache operations in FULL_ASYNC or PRIMARY_SYNC modes due to message queues growth on sender and receiver sides. [21:05:49] : [Step 4/5] [2021-11-19 21:05:49,250][INFO ][test-runner-#11562%encryption.EncryptedCacheNodeJoinTest%][GridCollisionManager] Collision resolution is disabled (all jobs will be activated upon arrival). [21:05:49] : [Step 4/5] [2021-11-19 21:05:49,250][INFO ][test-runner-#11562%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-1] Security status [authentication=off, sandbox=off, tls/ssl=off] [21:05:49] : [Step 4/5] [2021-11-19 21:05:49,251][INFO ][test-runner-#11562%encryption.EncryptedCacheNodeJoinTest%][MaintenanceProcessor] Resolved store directory for node persistent data: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1 [21:05:49] : [Step 4/5] [2021-11-19 21:05:49,252][INFO ][test-runner-#11562%encryption.EncryptedCacheNodeJoinTest%][CacheObjectBinaryProcessorImpl] Resolved directory for serialized binary metadata: /opt/buildagent/work/7bc1c54bc719b67c/work/db/binary_meta/grid_1 [21:05:49] : [Step 4/5] [2021-11-19 21:05:49,256][INFO ][test-runner-#11562%encryption.EncryptedCacheNodeJoinTest%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1 [21:05:49] : [Step 4/5] [2021-11-19 21:05:49,257][INFO ][test-runner-#11562%encryption.EncryptedCacheNodeJoinTest%][FileWriteAheadLogManager] Resolved write ahead log work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1 [21:05:49] : [Step 4/5] [2021-11-19 21:05:49,257][INFO ][test-runner-#11562%encryption.EncryptedCacheNodeJoinTest%][FileWriteAheadLogManager] Resolved write ahead log archive directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1 [21:05:49] : [Step 4/5] [2021-11-19 21:05:49,679][INFO ][test-runner-#11562%encryption.EncryptedCacheNodeJoinTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000000.wal [21:05:49] : [Step 4/5] [2021-11-19 21:05:49,684][INFO ][test-runner-#11562%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Configured data regions initialized successfully [total=5] [21:05:49] : [Step 4/5] [2021-11-19 21:05:49,687][INFO ][test-runner-#11562%encryption.EncryptedCacheNodeJoinTest%][IgniteSnapshotManager] Resolved snapshot work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/snapshots [21:05:49] : [Step 4/5] [2021-11-19 21:05:49,687][INFO ][test-runner-#11562%encryption.EncryptedCacheNodeJoinTest%][IgniteSnapshotManager] Resolved temp directory for snapshot creation: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1/snp [21:05:49] : [Step 4/5] [2021-11-19 21:05:49,690][INFO ][test-runner-#11562%encryption.EncryptedCacheNodeJoinTest%][ClientListenerProcessor] Client connector processor has started on TCP port 10801 [21:05:49] : [Step 4/5] [2021-11-19 21:05:49,692][INFO ][test-runner-#11562%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-1] Non-loopback local IPs: 172.17.0.4 [21:05:49] : [Step 4/5] [2021-11-19 21:05:49,692][INFO ][test-runner-#11562%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-1] Enabled local MACs: 0242AC110004 [21:05:49] : [Step 4/5] [2021-11-19 21:05:49,693][INFO ][test-runner-#11562%encryption.EncryptedCacheNodeJoinTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:05:49] : [Step 4/5] [2021-11-19 21:05:49,694][INFO ][test-runner-#11562%encryption.EncryptedCacheNodeJoinTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:05:49] : [Step 4/5] [2021-11-19 21:05:49,694][INFO ][test-runner-#11562%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:05:49] : [Step 4/5] [2021-11-19 21:05:49,697][INFO ][test-runner-#11562%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Applying lost metastore updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:05:49] : [Step 4/5] [2021-11-19 21:05:49,697][INFO ][test-runner-#11562%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=0 ms] [21:05:49] : [Step 4/5] [2021-11-19 21:05:49,698][INFO ][test-runner-#11562%encryption.EncryptedCacheNodeJoinTest%][GridCacheProcessor] Restoring partition state for local groups. [21:05:49] : [Step 4/5] [2021-11-19 21:05:49,698][INFO ][test-runner-#11562%encryption.EncryptedCacheNodeJoinTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=0, partitionsProcessed=0, time=0ms] [21:05:49] : [Step 4/5] [2021-11-19 21:05:49,698][INFO ][test-runner-#11562%encryption.EncryptedCacheNodeJoinTest%][GridEncryptionManager] Encryption keys loaded from metastore. [grps=, masterKeyName=null] [21:05:49] : [Step 4/5] [2021-11-19 21:05:49,700][INFO ][test-runner-#11562%encryption.EncryptedCacheNodeJoinTest%][ClusterProcessor] Cluster ID and tag has been read from metastorage: null [21:05:49] : [Step 4/5] [2021-11-19 21:05:49,700][INFO ][test-runner-#11562%encryption.EncryptedCacheNodeJoinTest%][IgniteClusterImpl] Shutdown policy was updated [oldVal=null, newVal=null] [21:05:49] : [Step 4/5] [2021-11-19 21:05:49,700][INFO ][test-runner-#11562%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Checkpoint frequency deviation changed [oldVal=null, newVal=null] [21:05:49] : [Step 4/5] [2021-11-19 21:05:49,710][INFO ][test-runner-#11562%encryption.EncryptedCacheNodeJoinTest%][FilePageStoreManager] Cleanup cache stores [total=1, left=0, cleanFiles=false] [21:05:49] : [Step 4/5] [2021-11-19 21:05:49,712][INFO ][test-runner-#11562%encryption.EncryptedCacheNodeJoinTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:05:49] : [Step 4/5] [2021-11-19 21:05:49,713][INFO ][test-runner-#11562%encryption.EncryptedCacheNodeJoinTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:05:49] : [Step 4/5] [2021-11-19 21:05:49,714][INFO ][test-runner-#11562%encryption.EncryptedCacheNodeJoinTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:05:49] : [Step 4/5] [2021-11-19 21:05:49,714][INFO ][test-runner-#11562%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Data Regions Started: 5 [21:05:49] : [Step 4/5] [2021-11-19 21:05:49,714][INFO ][test-runner-#11562%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] ^-- sysMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:05:49] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:05:49] : [Step 4/5] ^-- default region [type=default, persistence=true, lazyAlloc=true, [21:05:49] : [Step 4/5] ... initCfg=10MB, maxCfg=10MB, usedRam=0MB, freeRam=100%, allocRam=0MB, allocTotal=0MB] [21:05:49] : [Step 4/5] ^-- metastoreMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:05:49] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:05:49] : [Step 4/5] ^-- TxLog region [type=internal, persistence=true, lazyAlloc=false, [21:05:49] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:05:49] : [Step 4/5] ^-- volatileDsMemPlc region [type=user, persistence=false, lazyAlloc=true, [21:05:49] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB] [21:05:49] : [Step 4/5] ^-- Ignite persistence [used=0MB] [21:05:49] : [Step 4/5] [21:05:49] : [Step 4/5] [2021-11-19 21:05:49,716][INFO ][test-runner-#11562%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Starting binary memory restore for: [-2100569601] [21:05:49] : [Step 4/5] [2021-11-19 21:05:49,724][INFO ][test-runner-#11562%encryption.EncryptedCacheNodeJoinTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:05:49] : [Step 4/5] [2021-11-19 21:05:49,724][INFO ][test-runner-#11562%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:05:49] : [Step 4/5] [2021-11-19 21:05:49,726][INFO ][test-runner-#11562%encryption.EncryptedCacheNodeJoinTest%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000000.wal, offset=0, ver=2] [21:05:49] : [Step 4/5] [2021-11-19 21:05:49,730][INFO ][test-runner-#11562%encryption.EncryptedCacheNodeJoinTest%][GridCacheProcessor] Started cache in recovery mode [name=ignite-sys-cache, id=-2100569601, dataRegionName=sysMemPlc, mode=REPLICATED, atomicity=TRANSACTIONAL, backups=2147483647, mvcc=false] [21:05:49] : [Step 4/5] [2021-11-19 21:05:49,731][INFO ][test-runner-#11562%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Binary recovery performed in 15 ms. [21:05:49] : [Step 4/5] [2021-11-19 21:05:49,731][INFO ][test-runner-#11562%encryption.EncryptedCacheNodeJoinTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:05:49] : [Step 4/5] [2021-11-19 21:05:49,731][INFO ][test-runner-#11562%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Applying lost cache updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:05:49] : [Step 4/5] [2021-11-19 21:05:49,791][INFO ][test-runner-#11562%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=60 ms] [21:05:49] : [Step 4/5] [2021-11-19 21:05:49,791][INFO ][test-runner-#11562%encryption.EncryptedCacheNodeJoinTest%][GridCacheProcessor] Restoring partition state for local groups. [21:05:49] : [Step 4/5] [2021-11-19 21:05:49,796][INFO ][test-runner-#11562%encryption.EncryptedCacheNodeJoinTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=1, partitionsProcessed=100, time=10ms] [21:05:50] : [Step 4/5] [2021-11-19 21:05:50,187][INFO ][test-runner-#11562%encryption.EncryptedCacheNodeJoinTest%][TestTcpDiscoverySpi] Successfully bound to TCP port [port=47501, localHost=localhost/127.0.0.1, locNodeId=10e58fc8-9c34-4cb7-b622-18bd0aae0001] [21:05:50] : [Step 4/5] [2021-11-19 21:05:50,195][INFO ][tcp-disco-srvr-[:47500]-#608%grid-0%-#11675%grid-0%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=59801] [21:05:50] : [Step 4/5] [2021-11-19 21:05:50,199][INFO ][tcp-disco-srvr-[:47500]-#608%grid-0%-#11675%grid-0%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=59801] [21:05:50] : [Step 4/5] [2021-11-19 21:05:50,202][INFO ][tcp-disco-sock-reader-[]-#614%grid-0%-#11794%grid-0%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:59801, rmtPort=59801] [21:05:50] : [Step 4/5] [2021-11-19 21:05:50,204][INFO ][tcp-disco-sock-reader-[10e58fc8 127.0.0.1:59801]-#614%grid-0%-#11794%grid-0%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=10e58fc8-9c34-4cb7-b622-18bd0aae0001, rmtAddr=/127.0.0.1:59801] [21:05:50] : [Step 4/5] [2021-11-19 21:05:50,213][INFO ][tcp-disco-srvr-[:47501]-#613%grid-1%-#11793%grid-1%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=33613] [21:05:50] : [Step 4/5] [2021-11-19 21:05:50,213][INFO ][tcp-disco-srvr-[:47501]-#613%grid-1%-#11793%grid-1%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=33613] [21:05:50] : [Step 4/5] [2021-11-19 21:05:50,214][INFO ][tcp-disco-sock-reader-[]-#615%grid-1%-#11795%grid-1%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:33613, rmtPort=33613] [21:05:50] : [Step 4/5] [2021-11-19 21:05:50,215][INFO ][tcp-disco-sock-reader-[]-#615%grid-1%-#11795%grid-1%][TestTcpDiscoverySpi] Received ping request from the remote node [rmtNodeId=0072825b-bc58-4699-8b84-6e50366b4000, rmtAddr=/127.0.0.1:33613, rmtPort=33613] [21:05:50] : [Step 4/5] [2021-11-19 21:05:50,217][INFO ][tcp-disco-sock-reader-[]-#615%grid-1%-#11795%grid-1%][TestTcpDiscoverySpi] Finished writing ping response [rmtNodeId=0072825b-bc58-4699-8b84-6e50366b4000, rmtAddr=/127.0.0.1:33613, rmtPort=33613] [21:05:50]W: [org.apache.ignite:ignite-core] [2021-11-19 21:05:50,217][WARN ][tcp-disco-sock-reader-[]-#615%grid-1%-#11795%grid-1%][TestTcpDiscoverySpi] Failed to shutdown socket [21:05:50]W: [org.apache.ignite:ignite-core] java.net.SocketException: Socket output is already shutdown [21:05:50]W: [org.apache.ignite:ignite-core] at java.net.Socket.shutdownOutput(Socket.java:1572) [21:05:50]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.close(IgniteUtils.java:4247) [21:05:50] : [Step 4/5] [2021-11-19 21:05:50,219][INFO ][tcp-disco-sock-reader-[]-#615%grid-1%-#11795%grid-1%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:33613, rmtPort=33613, rmtNodeId=null] [21:05:50]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.discovery.tcp.ServerImpl$SocketReader.body(ServerImpl.java:7370) [21:05:50]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.IgniteSpiThread.run(IgniteSpiThread.java:58) [21:05:50] : [Step 4/5] [2021-11-19 21:05:50,220][INFO ][tcp-disco-sock-reader-[10e58fc8 127.0.0.1:59801]-#614%grid-0%-#11794%grid-0%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:59801, rmtPort=59801, rmtNodeId=10e58fc8-9c34-4cb7-b622-18bd0aae0001] [21:05:50]W: [org.apache.ignite:ignite-core] [2021-11-19 21:05:50,232][WARN ][disco-pool-#11796%grid-0%][TestTcpDiscoverySpi] Master key digest differs! Node join is rejected. [node=10e58fc8-9c34-4cb7-b622-18bd0aae0001] [21:05:50] : [Step 4/5] [2021-11-19 21:05:50,233][INFO ][tcp-disco-srvr-[:47501]-#613%grid-1%-#11793%grid-1%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=57123] [21:05:50] : [Step 4/5] [2021-11-19 21:05:50,233][INFO ][tcp-disco-srvr-[:47501]-#613%grid-1%-#11793%grid-1%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=57123] [21:05:50] : [Step 4/5] [2021-11-19 21:05:50,234][INFO ][tcp-disco-sock-reader-[]-#616%grid-1%-#11797%grid-1%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:57123, rmtPort=57123] [21:05:50] : [Step 4/5] [2021-11-19 21:05:50,235][INFO ][tcp-disco-sock-reader-[0072825b 127.0.0.1:57123]-#616%grid-1%-#11797%grid-1%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=0072825b-bc58-4699-8b84-6e50366b4000, rmtAddr=/127.0.0.1:57123] [21:05:50]W: [org.apache.ignite:ignite-core] [2021-11-19 21:05:50,243][ERROR][test-runner-#11562%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-1] Failed to start manager: GridManagerAdapter [enabled=true, name=o.a.i.i.managers.discovery.GridDiscoveryManager] [21:05:50]W: [org.apache.ignite:ignite-core] class org.apache.ignite.IgniteCheckedException: Failed to start SPI: TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=5000, ackTimeout=5000, marsh=JdkMarshaller [clsFilter=org.apache.ignite.marshaller.MarshallerUtils$1@381f3d54], reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false] [21:05:50]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.managers.GridManagerAdapter.startSpi(GridManagerAdapter.java:281) [21:05:50]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.managers.discovery.GridDiscoveryManager.start(GridDiscoveryManager.java:1091) [21:05:50]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.IgniteKernal.startManager(IgniteKernal.java:1953) [21:05:50]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.IgniteKernal.start(IgniteKernal.java:1300) [21:05:50]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.IgnitionEx$IgniteNamedInstance.start0(IgnitionEx.java:1798) [21:05:50]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.IgnitionEx$IgniteNamedInstance.start(IgnitionEx.java:1720) [21:05:50]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.IgnitionEx.start0(IgnitionEx.java:1159) [21:05:50]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.IgnitionEx.start(IgnitionEx.java:629) [21:05:50]W: [org.apache.ignite:ignite-core] at org.apache.ignite.testframework.junits.GridAbstractTest.startGrid(GridAbstractTest.java:1252) [21:05:50]W: [org.apache.ignite:ignite-core] at org.apache.ignite.testframework.junits.GridAbstractTest.startGrid(GridAbstractTest.java:1169) [21:05:50]W: [org.apache.ignite:ignite-core] at org.apache.ignite.testframework.junits.GridAbstractTest.startGrid(GridAbstractTest.java:1145) [21:05:50]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.encryption.EncryptedCacheNodeJoinTest.lambda$testNodeCantJoinWithoutEncryptionSpi$0(EncryptedCacheNodeJoinTest.java:130) [21:05:50]W: [org.apache.ignite:ignite-core] at org.apache.ignite.testframework.GridTestUtils$1.call(GridTestUtils.java:616) [21:05:50]W: [org.apache.ignite:ignite-core] at org.apache.ignite.testframework.GridTestUtils$1.call(GridTestUtils.java:614) [21:05:50]W: [org.apache.ignite:ignite-core] at org.apache.ignite.testframework.GridTestUtils.assertThrowsWithCause(GridTestUtils.java:636) [21:05:50]W: [org.apache.ignite:ignite-core] at org.apache.ignite.testframework.GridTestUtils.assertThrowsWithCause(GridTestUtils.java:614) [21:05:50]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.encryption.EncryptedCacheNodeJoinTest.testNodeCantJoinWithoutEncryptionSpi(EncryptedCacheNodeJoinTest.java:128) [21:05:50]W: [org.apache.ignite:ignite-core] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) [21:05:50]W: [org.apache.ignite:ignite-core] at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) [21:05:50]W: [org.apache.ignite:ignite-core] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [21:05:50]W: [org.apache.ignite:ignite-core] at java.lang.reflect.Method.invoke(Method.java:498) [21:05:50]W: [org.apache.ignite:ignite-core] at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50) [21:05:50]W: [org.apache.ignite:ignite-core] at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) [21:05:50]W: [org.apache.ignite:ignite-core] at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47) [21:05:50]W: [org.apache.ignite:ignite-core] at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) [21:05:50]W: [org.apache.ignite:ignite-core] at org.apache.ignite.testframework.junits.GridAbstractTest$7.run(GridAbstractTest.java:2432) [21:05:50] : [Step 4/5] [2021-11-19 21:05:50,244][INFO ][tcp-disco-sock-reader-[0072825b 127.0.0.1:57123]-#616%grid-1%-#11797%grid-1%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:57123, rmtPort=57123, rmtNodeId=0072825b-bc58-4699-8b84-6e50366b4000] [21:05:50]W: [org.apache.ignite:ignite-core] at java.lang.Thread.run(Thread.java:748) [21:05:50]W: [org.apache.ignite:ignite-core] Caused by: class org.apache.ignite.spi.IgniteSpiException: Master key digest differs! Node join is rejected. [21:05:50]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.discovery.tcp.TcpDiscoverySpi.checkFailedError(TcpDiscoverySpi.java:2108) [21:05:50]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.discovery.tcp.ServerImpl.joinTopology(ServerImpl.java:1206) [21:05:50]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.discovery.tcp.ServerImpl.spiStart(ServerImpl.java:474) [21:05:50]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.discovery.tcp.TcpDiscoverySpi.spiStart(TcpDiscoverySpi.java:2210) [21:05:50]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.managers.GridManagerAdapter.startSpi(GridManagerAdapter.java:278) [21:05:50]W: [org.apache.ignite:ignite-core] ... 26 more [21:05:50]W: [org.apache.ignite:ignite-core] [2021-11-19 21:05:50,250][ERROR][test-runner-#11562%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-1] Got exception while starting (will rollback startup routine). [21:05:50]W: [org.apache.ignite:ignite-core] class org.apache.ignite.IgniteCheckedException: Failed to start manager: GridManagerAdapter [enabled=true, name=org.apache.ignite.internal.managers.discovery.GridDiscoveryManager] [21:05:50]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.IgniteKernal.startManager(IgniteKernal.java:1958) [21:05:50]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.IgniteKernal.start(IgniteKernal.java:1300) [21:05:50]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.IgnitionEx$IgniteNamedInstance.start0(IgnitionEx.java:1798) [21:05:50]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.IgnitionEx$IgniteNamedInstance.start(IgnitionEx.java:1720) [21:05:50]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.IgnitionEx.start0(IgnitionEx.java:1159) [21:05:50]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.IgnitionEx.start(IgnitionEx.java:629) [21:05:50]W: [org.apache.ignite:ignite-core] at org.apache.ignite.testframework.junits.GridAbstractTest.startGrid(GridAbstractTest.java:1252) [21:05:50]W: [org.apache.ignite:ignite-core] at org.apache.ignite.testframework.junits.GridAbstractTest.startGrid(GridAbstractTest.java:1169) [21:05:50]W: [org.apache.ignite:ignite-core] at org.apache.ignite.testframework.junits.GridAbstractTest.startGrid(GridAbstractTest.java:1145) [21:05:50]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.encryption.EncryptedCacheNodeJoinTest.lambda$testNodeCantJoinWithoutEncryptionSpi$0(EncryptedCacheNodeJoinTest.java:130) [21:05:50]W: [org.apache.ignite:ignite-core] at org.apache.ignite.testframework.GridTestUtils$1.call(GridTestUtils.java:616) [21:05:50]W: [org.apache.ignite:ignite-core] at org.apache.ignite.testframework.GridTestUtils$1.call(GridTestUtils.java:614) [21:05:50]W: [org.apache.ignite:ignite-core] at org.apache.ignite.testframework.GridTestUtils.assertThrowsWithCause(GridTestUtils.java:636) [21:05:50]W: [org.apache.ignite:ignite-core] at org.apache.ignite.testframework.GridTestUtils.assertThrowsWithCause(GridTestUtils.java:614) [21:05:50]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.encryption.EncryptedCacheNodeJoinTest.testNodeCantJoinWithoutEncryptionSpi(EncryptedCacheNodeJoinTest.java:128) [21:05:50]W: [org.apache.ignite:ignite-core] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) [21:05:50]W: [org.apache.ignite:ignite-core] at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) [21:05:50]W: [org.apache.ignite:ignite-core] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [21:05:50]W: [org.apache.ignite:ignite-core] at java.lang.reflect.Method.invoke(Method.java:498) [21:05:50]W: [org.apache.ignite:ignite-core] at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50) [21:05:50]W: [org.apache.ignite:ignite-core] at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) [21:05:50]W: [org.apache.ignite:ignite-core] at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47) [21:05:50]W: [org.apache.ignite:ignite-core] at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) [21:05:50]W: [org.apache.ignite:ignite-core] at org.apache.ignite.testframework.junits.GridAbstractTest$7.run(GridAbstractTest.java:2432) [21:05:50]W: [org.apache.ignite:ignite-core] at java.lang.Thread.run(Thread.java:748) [21:05:50]W: [org.apache.ignite:ignite-core] Caused by: class org.apache.ignite.IgniteCheckedException: Failed to start SPI: TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=5000, ackTimeout=5000, marsh=JdkMarshaller [clsFilter=org.apache.ignite.marshaller.MarshallerUtils$1@381f3d54], reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false] [21:05:50]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.managers.GridManagerAdapter.startSpi(GridManagerAdapter.java:281) [21:05:50]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.managers.discovery.GridDiscoveryManager.start(GridDiscoveryManager.java:1091) [21:05:50]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.IgniteKernal.startManager(IgniteKernal.java:1953) [21:05:50]W: [org.apache.ignite:ignite-core] ... 24 more [21:05:50]W: [org.apache.ignite:ignite-core] Caused by: class org.apache.ignite.spi.IgniteSpiException: Master key digest differs! Node join is rejected. [21:05:50]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.discovery.tcp.TcpDiscoverySpi.checkFailedError(TcpDiscoverySpi.java:2108) [21:05:50]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.discovery.tcp.ServerImpl.joinTopology(ServerImpl.java:1206) [21:05:50]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.discovery.tcp.ServerImpl.spiStart(ServerImpl.java:474) [21:05:50]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.discovery.tcp.TcpDiscoverySpi.spiStart(TcpDiscoverySpi.java:2210) [21:05:50]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.managers.GridManagerAdapter.startSpi(GridManagerAdapter.java:278) [21:05:50]W: [org.apache.ignite:ignite-core] ... 26 more [21:05:55] : [Step 4/5] [2021-11-19 21:05:55,260][INFO ][test-runner-#11562%encryption.EncryptedCacheNodeJoinTest%][TestTcpDiscoverySpi] No verification for local node leave has been received from coordinator (will stop node anyway). [21:05:55] : [Step 4/5] [2021-11-19 21:05:55,265][INFO ][test-runner-#11562%encryption.EncryptedCacheNodeJoinTest%][GridCacheProcessor] Stopped cache [cacheName=ignite-sys-cache] [21:05:55] : [Step 4/5] [2021-11-19 21:05:55,269][INFO ][test-runner-#11562%encryption.EncryptedCacheNodeJoinTest%][FilePageStoreManager] Cleanup cache stores [total=3, left=0, cleanFiles=false] [21:05:55] : [Step 4/5] [2021-11-19 21:05:55,276][INFO ][test-runner-#11562%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-1] [21:05:55] : [Step 4/5] [21:05:55] : [Step 4/5] >>> +------------------------------------------------------+ [21:05:55] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV stopped OK [21:05:55] : [Step 4/5] >>> +------------------------------------------------------+ [21:05:55] : [Step 4/5] >>> Ignite instance name: grid-1 [21:05:55] : [Step 4/5] >>> Grid uptime: 00:00:06.060 [21:05:55] : [Step 4/5] [21:05:55] : [Step 4/5] [21:05:55] : [Step 4/5] [21:05:55] >>> Stopping test: EncryptedCacheNodeJoinTest#testNodeCantJoinWithoutEncryptionSpi in 7617 ms <<< [21:05:55] : [Step 4/5] [2021-11-19 21:05:55,277][INFO ][main][root] >>> Stopping test: EncryptedCacheNodeJoinTest#testNodeCantJoinWithoutEncryptionSpi in 7617 ms <<< [21:05:55] : [Step 4/5] [21:05:55] >>> Heap: 484 MB used / 1893 MB commited / 1893 MB max <<< [21:05:55] : [Step 4/5] [2021-11-19 21:05:55,278][INFO ][main][root] >>> Heap: 484 MB used / 1893 MB commited / 1893 MB max <<< [21:05:55] : [Step 4/5] [21:05:55] >>> Non-Heap: 145 MB used / 159 MB commited / 0 MB max <<< [21:05:55] : [Step 4/5] [2021-11-19 21:05:55,278][INFO ][main][root] >>> Non-Heap: 145 MB used / 159 MB commited / 0 MB max <<< [21:05:55] : [Step 4/5] [2021-11-19 21:05:55,278][INFO ][main][root] >>> Stopping grid [name=grid-0, id=0072825b-bc58-4699-8b84-6e50366b4000] [21:05:55] : [Step 4/5] [2021-11-19 21:05:55,287][INFO ][main][GridCacheProcessor] Stopped cache [cacheName=ignite-sys-cache] [21:05:55] : [Step 4/5] [2021-11-19 21:05:55,290][INFO ][main][FilePageStoreManager] Cleanup cache stores [total=3, left=0, cleanFiles=false] [21:05:55] : [Step 4/5] [2021-11-19 21:05:55,296][INFO ][main][IgniteKernal%grid-0] [21:05:55] : [Step 4/5] [21:05:55] : [Step 4/5] >>> +------------------------------------------------------+ [21:05:55] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV stopped OK [21:05:55] : [Step 4/5] >>> +------------------------------------------------------+ [21:05:55] : [Step 4/5] >>> Ignite instance name: grid-0 [21:05:55] : [Step 4/5] >>> Grid uptime: 00:00:06.091 [21:05:55] : [Step 4/5] [21:05:55] : [Step 4/5] [21:05:55] : [Step 4/5] [21:05:55] >>> Starting test: EncryptedCacheNodeJoinTest#testClientNodeJoinActiveClusterWithExistingStaticCacheConfig <<< [21:05:55] : [Step 4/5] [2021-11-19 21:05:55,344][INFO ][main][root] >>> Starting test: EncryptedCacheNodeJoinTest#testClientNodeJoinActiveClusterWithExistingStaticCacheConfig <<< [21:05:55] : [Step 4/5] [21:05:55] >>> Heap: 484 MB used / 1893 MB commited / 1893 MB max <<< [21:05:55] : [Step 4/5] [2021-11-19 21:05:55,345][INFO ][main][root] >>> Heap: 484 MB used / 1893 MB commited / 1893 MB max <<< [21:05:55] : [Step 4/5] [21:05:55] >>> Non-Heap: 145 MB used / 159 MB commited / 0 MB max <<< [21:05:55] : [Step 4/5] [2021-11-19 21:05:55,345][INFO ][main][root] >>> Non-Heap: 145 MB used / 159 MB commited / 0 MB max <<< [21:05:55]W: [org.apache.ignite:ignite-core] [2021-11-19 21:05:55,349][WARN ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][G] Ignite work directory is not provided, automatically resolved to: /opt/buildagent/work/7bc1c54bc719b67c/work [21:05:55] : [Step 4/5] [2021-11-19 21:05:55,351][INFO ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] [21:05:55] : [Step 4/5] [21:05:55] : [Step 4/5] >>> __________ ________________ [21:05:55] : [Step 4/5] >>> / _/ ___/ |/ / _/_ __/ __/ [21:05:55] : [Step 4/5] >>> _/ // (7 7 // / / / / _/ [21:05:55] : [Step 4/5] >>> /___/\___/_/|_/___/ /_/ /___/ [21:05:55] : [Step 4/5] >>> [21:05:55] : [Step 4/5] >>> ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:05:55] : [Step 4/5] >>> 2021 Copyright(C) Apache Software Foundation [21:05:55] : [Step 4/5] >>> [21:05:55] : [Step 4/5] >>> Ignite documentation: http://ignite.apache.org [21:05:55] : [Step 4/5] [21:05:55] : [Step 4/5] [2021-11-19 21:05:55,352][INFO ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] Config URL: n/a [21:05:55] : [Step 4/5] [2021-11-19 21:05:55,352][INFO ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] IgniteConfiguration [igniteInstanceName=grid-0, pubPoolSize=24, svcPoolSize=24, callbackPoolSize=24, stripedPoolSize=24, sysPoolSize=24, mgmtPoolSize=4, dataStreamerPoolSize=24, utilityCachePoolSize=24, utilityCacheKeepAliveTime=60000, p2pPoolSize=2, qryPoolSize=24, buildIdxPoolSize=4, igniteHome=/opt/buildagent/work/7bc1c54bc719b67c, igniteWorkDir=/opt/buildagent/work/7bc1c54bc719b67c/work, mbeanSrv=com.sun.jmx.mbeanserver.JmxMBeanServer@6fe85038, nodeId=003a0cc9-2754-4d39-b63e-fbb30d05a000, marsh=BinaryMarshaller [], marshLocJobs=false, daemon=false, p2pEnabled=true, netTimeout=10000, netCompressionLevel=1, sndRetryDelay=1000, sndRetryCnt=3, metricsHistSize=10000, metricsUpdateFreq=1000, metricsExpTime=9223372036854775807, discoSpi=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=0, ackTimeout=0, marsh=null, reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], segPlc=STOP, segResolveAttempts=2, waitForSegOnStart=true, allResolversPassReq=true, segChkFreq=10000, commSpi=TcpCommunicationSpi [connectGate=org.apache.ignite.spi.communication.tcp.internal.ConnectGateway@1f82a624, ctxInitLatch=java.util.concurrent.CountDownLatch@aca8790[Count = 1], stopping=false, clientPool=null, nioSrvWrapper=null, stateProvider=null], evtSpi=MemoryEventStorageSpi [expireAgeMs=9223372036854775807, expireCnt=10000, filter=null], colSpi=NoopCollisionSpi [], deploySpi=LocalDeploymentSpi [], indexingSpi=org.apache.ignite.spi.indexing.noop.NoopIndexingSpi@31dfc167, addrRslvr=null, encryptionSpi=org.apache.ignite.spi.encryption.keystore.KeystoreEncryptionSpi@6aa519c, tracingSpi=org.apache.ignite.spi.tracing.NoopTracingSpi@13d19360, clientMode=false, rebalanceThreadPoolSize=4, rebalanceTimeout=10000, rebalanceBatchesPrefetchCnt=3, rebalanceThrottle=0, rebalanceBatchSize=524288, txCfg=TransactionConfiguration [txSerEnabled=false, dfltIsolation=REPEATABLE_READ, dfltConcurrency=PESSIMISTIC, dfltTxTimeout=0, txTimeoutOnPartitionMapExchange=0, deadlockTimeout=10000, pessimisticTxLogSize=0, pessimisticTxLogLinger=10000, tmLookupClsName=null, txManagerFactory=null, useJtaSync=false], cacheSanityCheckEnabled=true, discoStartupDelay=60000, deployMode=SHARED, p2pMissedCacheSize=100, locHost=127.0.0.1, timeSrvPortBase=31100, timeSrvPortRange=100, failureDetectionTimeout=10000, sysWorkerBlockedTimeout=null, clientFailureDetectionTimeout=10000, metricsLogFreq=0, connectorCfg=null, odbcCfg=null, warmupClos=null, atomicCfg=AtomicConfiguration [seqReserveSize=1000, cacheMode=PARTITIONED, backups=1, aff=null, grpName=null], classLdr=null, sslCtxFactory=null, platformCfg=null, binaryCfg=null, memCfg=null, pstCfg=null, dsCfg=DataStorageConfiguration [sysRegionInitSize=41943040, sysRegionMaxSize=104857600, pageSize=4096, concLvl=0, dfltDataRegConf=DataRegionConfiguration [name=default, maxSize=10485760, initSize=268435456, swapPath=null, pageEvictionMode=DISABLED, pageReplacementMode=CLOCK, evictionThreshold=0.9, emptyPagesPoolSize=100, metricsEnabled=false, metricsSubIntervalCount=5, metricsRateTimeInterval=60000, persistenceEnabled=true, checkpointPageBufSize=0, lazyMemoryAllocation=true, warmUpCfg=null], dataRegions=null, storagePath=null, checkpointFreq=180000, lockWaitTime=10000, checkpointThreads=4, checkpointWriteOrder=SEQUENTIAL, walHistSize=20, maxWalArchiveSize=1073741824, walSegments=10, walSegmentSize=67108864, walPath=db/wal, walArchivePath=db/wal/archive, cdcWalPath=db/wal/cdc, cdcEnabled=false, metricsEnabled=false, walMode=FSYNC, walTlbSize=131072, walBuffSize=0, walFlushFreq=2000, walFsyncDelay=1000, walRecordIterBuffSize=67108864, alwaysWriteFullPages=false, fileIOFactory=org.apache.ignite.internal.processors.cache.persistence.file.AsyncFileIOFactory@6249a75, metricsSubIntervalCnt=5, metricsRateTimeInterval=60000, walAutoArchiveAfterInactivity=-1, walForceArchiveTimeout=-1, writeThrottlingEnabled=false, walCompactionEnabled=false, walCompactionLevel=1, checkpointReadLockTimeout=null, walPageCompression=DISABLED, walPageCompressionLevel=null, dfltWarmUpCfg=null, encCfg=org.apache.ignite.configuration.EncryptionConfiguration@66753907, defragmentationThreadPoolSize=4, minWalArchiveSize=-1], snapshotPath=snapshots, activeOnStart=true, activeOnStartPropSetFlag=false, autoActivation=true, autoActivationPropSetFlag=false, clusterStateOnStart=null, sqlConnCfg=null, cliConnCfg=ClientConnectorConfiguration [host=null, port=10800, portRange=100, sockSndBufSize=0, sockRcvBufSize=0, tcpNoDelay=true, maxOpenCursorsPerConn=128, threadPoolSize=24, selectorCnt=12, idleTimeout=0, handshakeTimeout=10000, jdbcEnabled=true, odbcEnabled=true, thinCliEnabled=true, sslEnabled=false, useIgniteSslCtxFactory=true, sslClientAuth=false, sslCtxFactory=null, thinCliCfg=ThinClientConfiguration [maxActiveTxPerConn=100, maxActiveComputeTasksPerConn=0]], mvccVacuumThreadCnt=2, mvccVacuumFreq=5000, authEnabled=false, failureHnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]], commFailureRslvr=null, sqlCfg=SqlConfiguration [longQryWarnTimeout=3000, dfltQryTimeout=0, sqlQryHistSize=1000, validationEnabled=false], asyncContinuationExecutor=null] [21:05:55] : [Step 4/5] [2021-11-19 21:05:55,359][INFO ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] Daemon mode: off [21:05:55] : [Step 4/5] [2021-11-19 21:05:55,359][INFO ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] OS: Linux 4.15.0-151-generic amd64 [21:05:55] : [Step 4/5] [2021-11-19 21:05:55,359][INFO ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] OS user: teamcity [21:05:55] : [Step 4/5] [2021-11-19 21:05:55,360][INFO ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] PID: 16724 [21:05:55] : [Step 4/5] [2021-11-19 21:05:55,360][INFO ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] Language runtime: Java Platform API Specification ver. 1.8 [21:05:55] : [Step 4/5] [2021-11-19 21:05:55,360][INFO ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] VM information: Java(TM) SE Runtime Environment 1.8.0_261-b12 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 25.261-b12 [21:05:55] : [Step 4/5] [2021-11-19 21:05:55,360][INFO ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] VM total memory: 1.8GB [21:05:55] : [Step 4/5] [2021-11-19 21:05:55,361][INFO ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] Remote Management [restart: off, REST: off, JMX (remote: off)] [21:05:55] : [Step 4/5] [2021-11-19 21:05:55,361][INFO ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] Logger: GridTestLog4jLogger [quiet=false, config=null] [21:05:55] : [Step 4/5] [2021-11-19 21:05:55,361][INFO ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] IGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c [21:05:55] : [Step 4/5] [2021-11-19 21:05:55,361][INFO ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] VM arguments: [-DIGNITE_DUMP_THREADS_ON_FAILURE=false, -DMono=/usr/bin/mono-sgen, -DMono4.0_x64=/usr/lib/mono/4.0, -DMono4.5_x64=/usr/lib/mono/4.5, -DMonoVersion=6.12.0.90, -DSKIP_BUILD=false, -Dagent.home.dir=/opt/buildagent, -Dagent.name=aitc-lin02_03, -Dagent.ownPort=9090, -Dagent.work.dir=/opt/buildagent/work, -Dbuild.number=95, -Dbuild.vcs.number=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.1=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.GitHubApacheIgnite=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dclassworlds.conf=/opt/buildagent/temp/buildTmp/teamcity.m2.conf, -Dcom.jetbrains.maven.watcher.report.file=/opt/buildagent/temp/buildTmp/maven-build-info.xml, -Djava.io.tmpdir=/opt/buildagent/temp/buildTmp, -Dmaven.home=/opt/buildagent/tools/maven3_6, -Dmaven.multiModuleProjectDirectory=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.agent.cpuBenchmark=457, -Dteamcity.agent.dotnet.agent_url=http://localhost:9090/RPC2, -Dteamcity.agent.dotnet.build_id=6278078, -Dteamcity.auth.password=*******, -Dteamcity.auth.userId=TeamCityBuildId=6278078, -Dteamcity.build.changedFiles.file=/opt/buildagent/temp/buildTmp/changedFiles6342607772318147725.txt, -Dteamcity.build.checkoutDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.build.id=6278078, -Dteamcity.build.properties.file=/opt/buildagent/temp/buildTmp/teamcity.build5164517880467851002.properties, -Dteamcity.build.tempDir=/opt/buildagent/temp/buildTmp, -Dteamcity.build.workingDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.buildConfName=Basic 3, -Dteamcity.buildType.id=IgniteTests24Java8_Basic3, -Dteamcity.configuration.properties.file=/opt/buildagent/temp/buildTmp/teamcity.config5591980786735343870.properties, -Dteamcity.maven.userSettings.path=/opt/buildagent/temp/buildTmp/maven_settings_585072866407032347.xml, -Dteamcity.maven.watcher.home=/opt/buildagent/plugins/mavenPlugin/maven-watcher-jdk16, -Dteamcity.projectName=Ignite Tests 2.x (JDK 8/11), -Dteamcity.runner.properties.file=/opt/buildagent/temp/buildTmp/teamcity.runner9098465561618137420.properties, -Dteamcity.tests.recentlyFailedTests.file=/opt/buildagent/temp/buildTmp/testsToRunFirst3891775683130404069.txt, -Dteamcity.version=2021.2 (build 99542), -ea, -Xms2g, -Xmx2g, -XX:+HeapDumpOnOutOfMemoryError, -DIGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_TEST_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_UPDATE_NOTIFIER=false, -DIGNITE_NO_DISCO_ORDER=true, -DIGNITE_PERFORMANCE_SUGGESTIONS_DISABLED=true, -Djava.net.preferIPv4Stack=true, -DTEST_SCALE_FACTOR=1.0, -DIGNITE_TEST_PROP_LOG4J_FILE=log4j-tc-test.xml, -DIGNITE_QUIET=false, -DIGNITE_MARSHAL_BUFFERS_RECHECK=1000, -Dmaven.repo.local=/opt/buildagent/.m2/repository] [21:05:55] : [Step 4/5] [2021-11-19 21:05:55,365][INFO ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] System cache's DataRegion size is configured to 40 MB. Use DataStorageConfiguration.systemRegionInitialSize property to change the setting. [21:05:55] : [Step 4/5] [2021-11-19 21:05:55,365][INFO ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] Configured caches [in 'sysMemPlc' dataRegion: ['ignite-sys-cache'], in 'default' dataRegion: ['encrypted']] [21:05:55]W: [org.apache.ignite:ignite-core] [2021-11-19 21:05:55,366][WARN ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] Peer class loading is enabled (disable it in production for performance and deployment consistency reasons) [21:05:55] : [Step 4/5] [2021-11-19 21:05:55,366][INFO ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] 3-rd party licenses can be found at: /opt/buildagent/work/7bc1c54bc719b67c/libs/licenses [21:05:55] : [Step 4/5] [2021-11-19 21:05:55,370][INFO ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] Configured plugins: [21:05:55] : [Step 4/5] [2021-11-19 21:05:55,370][INFO ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- StanByClusterTestProvider 1.0 [21:05:55] : [Step 4/5] [2021-11-19 21:05:55,370][INFO ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- null [21:05:55] : [Step 4/5] [2021-11-19 21:05:55,370][INFO ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] [21:05:55] : [Step 4/5] [2021-11-19 21:05:55,370][INFO ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- PageMemory tracker plugin 1.0 [21:05:55] : [Step 4/5] [2021-11-19 21:05:55,370][INFO ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- null [21:05:55] : [Step 4/5] [2021-11-19 21:05:55,371][INFO ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] [21:05:55] : [Step 4/5] [2021-11-19 21:05:55,371][INFO ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- TestDistibutedConfigurationPlugin 1.0 [21:05:55] : [Step 4/5] [2021-11-19 21:05:55,371][INFO ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- null [21:05:55] : [Step 4/5] [2021-11-19 21:05:55,371][INFO ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] [21:05:55] : [Step 4/5] [2021-11-19 21:05:55,371][INFO ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- NodeValidationPluginProvider 1.0 [21:05:55] : [Step 4/5] [2021-11-19 21:05:55,371][INFO ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- null [21:05:55] : [Step 4/5] [2021-11-19 21:05:55,371][INFO ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] [21:05:55] : [Step 4/5] [2021-11-19 21:05:55,372][INFO ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][FailureProcessor] Configured failure handler: [hnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]]] [21:05:55]W: [org.apache.ignite:ignite-core] [2021-11-19 21:05:55,381][WARN ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][TcpCommunicationSpi] Message queue limit is set to 0 which may lead to potential OOMEs when running cache operations in FULL_ASYNC or PRIMARY_SYNC modes due to message queues growth on sender and receiver sides. [21:05:55] : [Step 4/5] [2021-11-19 21:05:55,381][INFO ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][TcpCommunicationSpi] Successfully bound communication NIO server to TCP port [port=45150, locHost=/127.0.0.1, selectorsCnt=12, selectorSpins=0, pairedConn=false] [21:05:55] : [Step 4/5] [2021-11-19 21:05:55,385][INFO ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][GridCollisionManager] Collision resolution is disabled (all jobs will be activated upon arrival). [21:05:55] : [Step 4/5] [2021-11-19 21:05:55,385][INFO ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] Security status [authentication=off, sandbox=off, tls/ssl=off] [21:05:55] : [Step 4/5] [2021-11-19 21:05:55,437][INFO ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:05:55] : [Step 4/5] [2021-11-19 21:05:55,523][INFO ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][MaintenanceProcessor] Resolved store directory for node persistent data: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0 [21:05:55] : [Step 4/5] [2021-11-19 21:05:55,525][INFO ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][CacheObjectBinaryProcessorImpl] Resolved directory for serialized binary metadata: /opt/buildagent/work/7bc1c54bc719b67c/work/db/binary_meta/grid_0 [21:05:55] : [Step 4/5] [2021-11-19 21:05:55,531][INFO ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0 [21:05:55] : [Step 4/5] [2021-11-19 21:05:55,531][INFO ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][FileWriteAheadLogManager] Resolved write ahead log work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0 [21:05:55] : [Step 4/5] [2021-11-19 21:05:55,532][INFO ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][FileWriteAheadLogManager] Resolved write ahead log archive directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0 [21:05:56] : [Step 4/5] [2021-11-19 21:05:56,102][INFO ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000000.wal [21:05:56]W: [org.apache.ignite:ignite-core] [2021-11-19 21:05:56,103][WARN ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] DataRegion maxSize=10.5 MB is smaller than defaultInitialSize=268.4 MB, setting initialSize to 10.5 MB [21:05:56] : [Step 4/5] [2021-11-19 21:05:56,110][INFO ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Configured data regions initialized successfully [total=5] [21:05:56] : [Step 4/5] [2021-11-19 21:05:56,153][INFO ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][IgniteSnapshotManager] Resolved snapshot work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/snapshots [21:05:56] : [Step 4/5] [2021-11-19 21:05:56,153][INFO ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][IgniteSnapshotManager] Resolved temp directory for snapshot creation: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0/snp [21:05:56] : [Step 4/5] [2021-11-19 21:05:56,155][INFO ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][ClientListenerProcessor] Client connector processor has started on TCP port 10800 [21:05:56] : [Step 4/5] [2021-11-19 21:05:56,158][INFO ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] Non-loopback local IPs: 172.17.0.4 [21:05:56] : [Step 4/5] [2021-11-19 21:05:56,158][INFO ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] Enabled local MACs: 0242AC110004 [21:05:56] : [Step 4/5] [2021-11-19 21:05:56,159][INFO ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:05:56] : [Step 4/5] [2021-11-19 21:05:56,160][INFO ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:05:56] : [Step 4/5] [2021-11-19 21:05:56,161][INFO ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:05:56] : [Step 4/5] [2021-11-19 21:05:56,163][INFO ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Applying lost metastore updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:05:56] : [Step 4/5] [2021-11-19 21:05:56,164][INFO ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=0 ms] [21:05:56] : [Step 4/5] [2021-11-19 21:05:56,164][INFO ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][GridCacheProcessor] Restoring partition state for local groups. [21:05:56] : [Step 4/5] [2021-11-19 21:05:56,164][INFO ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=0, partitionsProcessed=0, time=0ms] [21:05:56] : [Step 4/5] [2021-11-19 21:05:56,165][INFO ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][GridEncryptionManager] Encryption keys loaded from metastore. [grps=, masterKeyName=ignite.master.key] [21:05:56] : [Step 4/5] [2021-11-19 21:05:56,167][INFO ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][ClusterProcessor] Cluster ID and tag has been read from metastorage: null [21:05:56] : [Step 4/5] [2021-11-19 21:05:56,168][INFO ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][IgniteClusterImpl] Shutdown policy was updated [oldVal=null, newVal=null] [21:05:56] : [Step 4/5] [2021-11-19 21:05:56,168][INFO ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Checkpoint frequency deviation changed [oldVal=null, newVal=null] [21:05:56] : [Step 4/5] [2021-11-19 21:05:56,252][INFO ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][FilePageStoreManager] Cleanup cache stores [total=1, left=0, cleanFiles=false] [21:05:56] : [Step 4/5] [2021-11-19 21:05:56,254][INFO ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:05:56] : [Step 4/5] [2021-11-19 21:05:56,255][INFO ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:05:56] : [Step 4/5] [2021-11-19 21:05:56,256][INFO ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:05:56] : [Step 4/5] [2021-11-19 21:05:56,257][INFO ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Data Regions Started: 5 [21:05:56] : [Step 4/5] [2021-11-19 21:05:56,257][INFO ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] ^-- sysMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:05:56] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:05:56] : [Step 4/5] ^-- default region [type=default, persistence=true, lazyAlloc=true, [21:05:56] : [Step 4/5] ... initCfg=10MB, maxCfg=10MB, usedRam=0MB, freeRam=100%, allocRam=0MB, allocTotal=0MB] [21:05:56] : [Step 4/5] ^-- metastoreMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:05:56] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:05:56] : [Step 4/5] ^-- TxLog region [type=internal, persistence=true, lazyAlloc=false, [21:05:56] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:05:56] : [Step 4/5] ^-- volatileDsMemPlc region [type=user, persistence=false, lazyAlloc=true, [21:05:56] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB] [21:05:56] : [Step 4/5] ^-- Ignite persistence [used=0MB] [21:05:56] : [Step 4/5] [21:05:56] : [Step 4/5] [2021-11-19 21:05:56,258][INFO ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Starting binary memory restore for: [-2100569601, 1613773252] [21:05:56] : [Step 4/5] [2021-11-19 21:05:56,355][INFO ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:05:56] : [Step 4/5] [2021-11-19 21:05:56,356][INFO ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:05:56] : [Step 4/5] [2021-11-19 21:05:56,358][INFO ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000000.wal, offset=0, ver=2] [21:05:56] : [Step 4/5] [2021-11-19 21:05:56,376][INFO ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][GridCacheProcessor] Started cache in recovery mode [name=ignite-sys-cache, id=-2100569601, dataRegionName=sysMemPlc, mode=REPLICATED, atomicity=TRANSACTIONAL, backups=2147483647, mvcc=false] [21:05:56] : [Step 4/5] [2021-11-19 21:05:56,377][INFO ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][PageMemoryImpl] Started page memory [memoryAllocated=24.0 MiB, pages=5952, tableSize=474.2 KiB, replacementSize=768 B, checkpointBuffer=10.0 MiB] [21:05:56] : [Step 4/5] [2021-11-19 21:05:56,383][INFO ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][GridCacheProcessor] Started cache in recovery mode [name=encrypted, id=1613773252, dataRegionName=default, mode=PARTITIONED, atomicity=TRANSACTIONAL, backups=0, mvcc=false] [21:05:56] : [Step 4/5] [2021-11-19 21:05:56,384][INFO ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Binary recovery performed in 126 ms. [21:05:56] : [Step 4/5] [2021-11-19 21:05:56,385][INFO ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:05:56] : [Step 4/5] [2021-11-19 21:05:56,385][INFO ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Applying lost cache updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:05:56] : [Step 4/5] [2021-11-19 21:05:56,470][INFO ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=81 ms] [21:05:56] : [Step 4/5] [2021-11-19 21:05:56,470][INFO ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][GridCacheProcessor] Restoring partition state for local groups. [21:05:56] : [Step 4/5] [2021-11-19 21:05:56,503][INFO ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=2, partitionsProcessed=1124, time=30ms] [21:05:57] : [Step 4/5] [2021-11-19 21:05:57,191][INFO ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][TestTcpDiscoverySpi] Successfully bound to TCP port [port=47500, localHost=localhost/127.0.0.1, locNodeId=003a0cc9-2754-4d39-b63e-fbb30d05a000] [21:05:57] : [Step 4/5] [2021-11-19 21:05:57,194][INFO ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][GridEncryptionManager] Sending new group keys to coordinator [grps=1613773252] [21:05:57] : [Step 4/5] [2021-11-19 21:05:57,198][INFO ][disco-notifier-worker-#11910%grid-0%][MvccProcessorImpl] Assigned mvcc coordinator [crd=MvccCoordinator [topVer=AffinityTopologyVersion [topVer=1, minorTopVer=0], nodeId=003a0cc9-2754-4d39-b63e-fbb30d05a000, ver=1637345157192, local=true, initialized=false]] [21:05:57] : [Step 4/5] [2021-11-19 21:05:57,199][INFO ][disco-notifier-worker-#11910%grid-0%][GridEncryptionManager] Added encryption key on local join [grpId=1613773252] [21:05:57] : [Step 4/5] [2021-11-19 21:05:57,200][INFO ][sys-#11904%grid-0%][ClusterProcessor] Writing cluster ID and tag to metastorage on ready for write ClusterIdAndTag [id=31400863-ff27-4063-8faa-2fafe901f2b1, tag=hardcore_hertz] [21:05:57] : [Step 4/5] [2021-11-19 21:05:57,200][INFO ][disco-notifier-worker-#11910%grid-0%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustEnabled' was changed from 'null' to 'false' [21:05:57] : [Step 4/5] [2021-11-19 21:05:57,201][INFO ][disco-notifier-worker-#11910%grid-0%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustTimeout' was changed from 'null' to '300000' [21:05:57] : [Step 4/5] [2021-11-19 21:05:57,201][INFO ][disco-notifier-worker-#11910%grid-0%][IgniteTxManager] Transactions parameter 'longOperationsDumpTimeout' was changed from 'null' to '60000' [21:05:57] : [Step 4/5] [2021-11-19 21:05:57,202][INFO ][disco-notifier-worker-#11910%grid-0%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpThreshold' was changed from 'null' to '0' [21:05:57] : [Step 4/5] [2021-11-19 21:05:57,202][INFO ][disco-notifier-worker-#11910%grid-0%][IgniteTxManager] Transactions parameter 'transactionTimeDumpSamplesCoefficient' was changed from 'null' to '0.0' [21:05:57] : [Step 4/5] [2021-11-19 21:05:57,203][INFO ][disco-notifier-worker-#11910%grid-0%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpSamplesPerSecondLimit' was changed from 'null' to '5' [21:05:57] : [Step 4/5] [2021-11-19 21:05:57,203][INFO ][disco-notifier-worker-#11910%grid-0%][IgniteTxManager] Transactions parameter 'collisionsDumpInterval' was changed from 'null' to '1000' [21:05:57] : [Step 4/5] [2021-11-19 21:05:57,204][INFO ][disco-notifier-worker-#11910%grid-0%][IgniteTxManager] Transactions parameter 'txOwnerDumpRequestsAllowed' was changed from 'null' to 'true' [21:05:57] : [Step 4/5] [2021-11-19 21:05:57,204][INFO ][disco-notifier-worker-#11910%grid-0%][GridCacheDatabaseSharedManager] Historical rebalance WAL threshold changed [property=historical.rebalance.threshold, oldVal=null, newVal=500] [21:05:57] : [Step 4/5] [2021-11-19 21:05:57,205][INFO ][disco-notifier-worker-#11910%grid-0%][ClusterProcessor] hardcore_hertz [21:05:57] : [Step 4/5] [2021-11-19 21:05:57,212][INFO ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] To start Console Management & Monitoring run ignitevisorcmd.{sh|bat} [21:05:57] : [Step 4/5] [2021-11-19 21:05:57,213][INFO ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] [21:05:57] : [Step 4/5] [21:05:57] : [Step 4/5] >>> +-------------------------------------------+ [21:05:57] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:05:57] : [Step 4/5] >>> +-------------------------------------------+ [21:05:57] : [Step 4/5] >>> OS name: Linux 4.15.0-151-generic amd64 [21:05:57] : [Step 4/5] >>> CPU(s): 24 [21:05:57] : [Step 4/5] >>> Heap: 2.0GB [21:05:57] : [Step 4/5] >>> VM name: 16724@c4dfe9a430b2 [21:05:57] : [Step 4/5] >>> Ignite instance name: grid-0 [21:05:57] : [Step 4/5] >>> Local node [ID=003A0CC9-2754-4D39-B63E-FBB30D05A000, order=1, clientMode=false] [21:05:57] : [Step 4/5] >>> Local node addresses: [127.0.0.1] [21:05:57] : [Step 4/5] >>> Local ports: TCP:10800 TCP:45150 TCP:47500 [21:05:57] : [Step 4/5] [21:05:57] : [Step 4/5] [2021-11-19 21:05:57,213][INFO ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] >>> Ignite cluster is in INACTIVE state (limited functionality available). Use control.(sh|bat) script or IgniteCluster.state(ClusterState.ACTIVE) to change the state. [21:05:57] : [Step 4/5] [2021-11-19 21:05:57,214][INFO ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][GridDiscoveryManager] Topology snapshot [ver=1, locNode=003a0cc9, servers=1, clients=0, state=INACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=003a0cc9-2754-4d39-b63e-fbb30d05a000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:05:57] : [Step 4/5] [2021-11-19 21:05:57,215][INFO ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][G] Node started : [stage="Configure system pool" (0 ms),stage="Start managers" (173 ms),stage="Configure binary metadata" (3 ms),stage="Start processors" (629 ms),stage="Start 'StanByClusterTestProvider' plugin" (0 ms),stage="Start 'PageMemory tracker plugin' plugin" (0 ms),stage="Start 'TestDistibutedConfigurationPlugin' plugin" (0 ms),stage="Start 'NodeValidationPluginProvider' plugin" (0 ms),stage="Init metastore" (94 ms),stage="Init and start regions" (5 ms),stage="Restore binary memory" (126 ms),stage="Restore logical state" (119 ms),stage="Finish recovery" (685 ms),stage="Join topology" (8 ms),stage="Await transition" (2 ms),stage="Await exchange" (13 ms),stage="Total time" (1857 ms)] [21:05:57] : [Step 4/5] [2021-11-19 21:05:57,216][INFO ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][root] Node started with the following configuration [id=003a0cc9-2754-4d39-b63e-fbb30d05a000, marshaller=BinaryMarshaller [], discovery=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=5000, ackTimeout=5000, marsh=JdkMarshaller [clsFilter=org.apache.ignite.marshaller.MarshallerUtils$1@5a4b2235], reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], binaryCfg=null, lateAff=true] [21:05:57]W: [org.apache.ignite:ignite-core] [2021-11-19 21:05:57,221][WARN ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][G] Ignite work directory is not provided, automatically resolved to: /opt/buildagent/work/7bc1c54bc719b67c/work [21:05:57] : [Step 4/5] [2021-11-19 21:05:57,222][INFO ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-6] [21:05:57] : [Step 4/5] [21:05:57] : [Step 4/5] >>> __________ ________________ [21:05:57] : [Step 4/5] >>> / _/ ___/ |/ / _/_ __/ __/ [21:05:57] : [Step 4/5] >>> _/ // (7 7 // / / / / _/ [21:05:57] : [Step 4/5] >>> /___/\___/_/|_/___/ /_/ /___/ [21:05:57] : [Step 4/5] >>> [21:05:57] : [Step 4/5] >>> ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:05:57] : [Step 4/5] >>> 2021 Copyright(C) Apache Software Foundation [21:05:57] : [Step 4/5] >>> [21:05:57] : [Step 4/5] >>> Ignite documentation: http://ignite.apache.org [21:05:57] : [Step 4/5] [21:05:57] : [Step 4/5] [2021-11-19 21:05:57,223][INFO ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-6] Config URL: n/a [21:05:57] : [Step 4/5] [2021-11-19 21:05:57,223][INFO ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-6] IgniteConfiguration [igniteInstanceName=grid-6, pubPoolSize=24, svcPoolSize=24, callbackPoolSize=24, stripedPoolSize=24, sysPoolSize=24, mgmtPoolSize=4, dataStreamerPoolSize=24, utilityCachePoolSize=24, utilityCacheKeepAliveTime=60000, p2pPoolSize=2, qryPoolSize=24, buildIdxPoolSize=4, igniteHome=/opt/buildagent/work/7bc1c54bc719b67c, igniteWorkDir=/opt/buildagent/work/7bc1c54bc719b67c/work, mbeanSrv=com.sun.jmx.mbeanserver.JmxMBeanServer@6fe85038, nodeId=60efc20b-b98d-4d8a-a216-3e743b573006, marsh=BinaryMarshaller [], marshLocJobs=false, daemon=false, p2pEnabled=true, netTimeout=10000, netCompressionLevel=1, sndRetryDelay=1000, sndRetryCnt=3, metricsHistSize=10000, metricsUpdateFreq=1000, metricsExpTime=9223372036854775807, discoSpi=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=0, ackTimeout=0, marsh=null, reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], segPlc=STOP, segResolveAttempts=2, waitForSegOnStart=true, allResolversPassReq=true, segChkFreq=10000, commSpi=TcpCommunicationSpi [connectGate=org.apache.ignite.spi.communication.tcp.internal.ConnectGateway@736fc31f, ctxInitLatch=java.util.concurrent.CountDownLatch@687a955d[Count = 1], stopping=false, clientPool=null, nioSrvWrapper=null, stateProvider=null], evtSpi=MemoryEventStorageSpi [expireAgeMs=9223372036854775807, expireCnt=10000, filter=null], colSpi=NoopCollisionSpi [], deploySpi=LocalDeploymentSpi [], indexingSpi=org.apache.ignite.spi.indexing.noop.NoopIndexingSpi@100ca8bb, addrRslvr=null, encryptionSpi=org.apache.ignite.spi.encryption.keystore.KeystoreEncryptionSpi@7703767f, tracingSpi=org.apache.ignite.spi.tracing.NoopTracingSpi@4aafa47, clientMode=false, rebalanceThreadPoolSize=4, rebalanceTimeout=10000, rebalanceBatchesPrefetchCnt=3, rebalanceThrottle=0, rebalanceBatchSize=524288, txCfg=TransactionConfiguration [txSerEnabled=false, dfltIsolation=REPEATABLE_READ, dfltConcurrency=PESSIMISTIC, dfltTxTimeout=0, txTimeoutOnPartitionMapExchange=0, deadlockTimeout=10000, pessimisticTxLogSize=0, pessimisticTxLogLinger=10000, tmLookupClsName=null, txManagerFactory=null, useJtaSync=false], cacheSanityCheckEnabled=true, discoStartupDelay=60000, deployMode=SHARED, p2pMissedCacheSize=100, locHost=127.0.0.1, timeSrvPortBase=31100, timeSrvPortRange=100, failureDetectionTimeout=10000, sysWorkerBlockedTimeout=null, clientFailureDetectionTimeout=10000, metricsLogFreq=0, connectorCfg=null, odbcCfg=null, warmupClos=null, atomicCfg=AtomicConfiguration [seqReserveSize=1000, cacheMode=PARTITIONED, backups=1, aff=null, grpName=null], classLdr=null, sslCtxFactory=null, platformCfg=null, binaryCfg=null, memCfg=null, pstCfg=null, dsCfg=DataStorageConfiguration [sysRegionInitSize=41943040, sysRegionMaxSize=104857600, pageSize=4096, concLvl=0, dfltDataRegConf=DataRegionConfiguration [name=default, maxSize=10485760, initSize=268435456, swapPath=null, pageEvictionMode=DISABLED, pageReplacementMode=CLOCK, evictionThreshold=0.9, emptyPagesPoolSize=100, metricsEnabled=false, metricsSubIntervalCount=5, metricsRateTimeInterval=60000, persistenceEnabled=true, checkpointPageBufSize=0, lazyMemoryAllocation=true, warmUpCfg=null], dataRegions=null, storagePath=null, checkpointFreq=180000, lockWaitTime=10000, checkpointThreads=4, checkpointWriteOrder=SEQUENTIAL, walHistSize=20, maxWalArchiveSize=1073741824, walSegments=10, walSegmentSize=67108864, walPath=db/wal, walArchivePath=db/wal/archive, cdcWalPath=db/wal/cdc, cdcEnabled=false, metricsEnabled=false, walMode=FSYNC, walTlbSize=131072, walBuffSize=0, walFlushFreq=2000, walFsyncDelay=1000, walRecordIterBuffSize=67108864, alwaysWriteFullPages=false, fileIOFactory=org.apache.ignite.internal.processors.cache.persistence.file.AsyncFileIOFactory@76ba36bc, metricsSubIntervalCnt=5, metricsRateTimeInterval=60000, walAutoArchiveAfterInactivity=-1, walForceArchiveTimeout=-1, writeThrottlingEnabled=false, walCompactionEnabled=false, walCompactionLevel=1, checkpointReadLockTimeout=null, walPageCompression=DISABLED, walPageCompressionLevel=null, dfltWarmUpCfg=null, encCfg=org.apache.ignite.configuration.EncryptionConfiguration@78a30011, defragmentationThreadPoolSize=4, minWalArchiveSize=-1], snapshotPath=snapshots, activeOnStart=true, activeOnStartPropSetFlag=false, autoActivation=true, autoActivationPropSetFlag=false, clusterStateOnStart=null, sqlConnCfg=null, cliConnCfg=ClientConnectorConfiguration [host=null, port=10800, portRange=100, sockSndBufSize=0, sockRcvBufSize=0, tcpNoDelay=true, maxOpenCursorsPerConn=128, threadPoolSize=24, selectorCnt=12, idleTimeout=0, handshakeTimeout=10000, jdbcEnabled=true, odbcEnabled=true, thinCliEnabled=true, sslEnabled=false, useIgniteSslCtxFactory=true, sslClientAuth=false, sslCtxFactory=null, thinCliCfg=ThinClientConfiguration [maxActiveTxPerConn=100, maxActiveComputeTasksPerConn=0]], mvccVacuumThreadCnt=2, mvccVacuumFreq=5000, authEnabled=false, failureHnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]], commFailureRslvr=null, sqlCfg=SqlConfiguration [longQryWarnTimeout=3000, dfltQryTimeout=0, sqlQryHistSize=1000, validationEnabled=false], asyncContinuationExecutor=null] [21:05:57] : [Step 4/5] [2021-11-19 21:05:57,232][INFO ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-6] Daemon mode: off [21:05:57] : [Step 4/5] [2021-11-19 21:05:57,232][INFO ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-6] OS: Linux 4.15.0-151-generic amd64 [21:05:57] : [Step 4/5] [2021-11-19 21:05:57,232][INFO ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-6] OS user: teamcity [21:05:57] : [Step 4/5] [2021-11-19 21:05:57,232][INFO ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-6] PID: 16724 [21:05:57] : [Step 4/5] [2021-11-19 21:05:57,232][INFO ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-6] Language runtime: Java Platform API Specification ver. 1.8 [21:05:57] : [Step 4/5] [2021-11-19 21:05:57,233][INFO ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-6] VM information: Java(TM) SE Runtime Environment 1.8.0_261-b12 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 25.261-b12 [21:05:57] : [Step 4/5] [2021-11-19 21:05:57,233][INFO ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-6] VM total memory: 1.8GB [21:05:57] : [Step 4/5] [2021-11-19 21:05:57,233][INFO ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-6] Remote Management [restart: off, REST: off, JMX (remote: off)] [21:05:57] : [Step 4/5] [2021-11-19 21:05:57,233][INFO ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-6] Logger: GridTestLog4jLogger [quiet=false, config=null] [21:05:57] : [Step 4/5] [2021-11-19 21:05:57,234][INFO ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-6] IGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c [21:05:57] : [Step 4/5] [2021-11-19 21:05:57,234][INFO ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-6] VM arguments: [-DIGNITE_DUMP_THREADS_ON_FAILURE=false, -DMono=/usr/bin/mono-sgen, -DMono4.0_x64=/usr/lib/mono/4.0, -DMono4.5_x64=/usr/lib/mono/4.5, -DMonoVersion=6.12.0.90, -DSKIP_BUILD=false, -Dagent.home.dir=/opt/buildagent, -Dagent.name=aitc-lin02_03, -Dagent.ownPort=9090, -Dagent.work.dir=/opt/buildagent/work, -Dbuild.number=95, -Dbuild.vcs.number=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.1=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.GitHubApacheIgnite=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dclassworlds.conf=/opt/buildagent/temp/buildTmp/teamcity.m2.conf, -Dcom.jetbrains.maven.watcher.report.file=/opt/buildagent/temp/buildTmp/maven-build-info.xml, -Djava.io.tmpdir=/opt/buildagent/temp/buildTmp, -Dmaven.home=/opt/buildagent/tools/maven3_6, -Dmaven.multiModuleProjectDirectory=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.agent.cpuBenchmark=457, -Dteamcity.agent.dotnet.agent_url=http://localhost:9090/RPC2, -Dteamcity.agent.dotnet.build_id=6278078, -Dteamcity.auth.password=*******, -Dteamcity.auth.userId=TeamCityBuildId=6278078, -Dteamcity.build.changedFiles.file=/opt/buildagent/temp/buildTmp/changedFiles6342607772318147725.txt, -Dteamcity.build.checkoutDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.build.id=6278078, -Dteamcity.build.properties.file=/opt/buildagent/temp/buildTmp/teamcity.build5164517880467851002.properties, -Dteamcity.build.tempDir=/opt/buildagent/temp/buildTmp, -Dteamcity.build.workingDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.buildConfName=Basic 3, -Dteamcity.buildType.id=IgniteTests24Java8_Basic3, -Dteamcity.configuration.properties.file=/opt/buildagent/temp/buildTmp/teamcity.config5591980786735343870.properties, -Dteamcity.maven.userSettings.path=/opt/buildagent/temp/buildTmp/maven_settings_585072866407032347.xml, -Dteamcity.maven.watcher.home=/opt/buildagent/plugins/mavenPlugin/maven-watcher-jdk16, -Dteamcity.projectName=Ignite Tests 2.x (JDK 8/11), -Dteamcity.runner.properties.file=/opt/buildagent/temp/buildTmp/teamcity.runner9098465561618137420.properties, -Dteamcity.tests.recentlyFailedTests.file=/opt/buildagent/temp/buildTmp/testsToRunFirst3891775683130404069.txt, -Dteamcity.version=2021.2 (build 99542), -ea, -Xms2g, -Xmx2g, -XX:+HeapDumpOnOutOfMemoryError, -DIGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_TEST_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_UPDATE_NOTIFIER=false, -DIGNITE_NO_DISCO_ORDER=true, -DIGNITE_PERFORMANCE_SUGGESTIONS_DISABLED=true, -Djava.net.preferIPv4Stack=true, -DTEST_SCALE_FACTOR=1.0, -DIGNITE_TEST_PROP_LOG4J_FILE=log4j-tc-test.xml, -DIGNITE_QUIET=false, -DIGNITE_MARSHAL_BUFFERS_RECHECK=1000, -Dmaven.repo.local=/opt/buildagent/.m2/repository] [21:05:57] : [Step 4/5] [2021-11-19 21:05:57,238][INFO ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-6] System cache's DataRegion size is configured to 40 MB. Use DataStorageConfiguration.systemRegionInitialSize property to change the setting. [21:05:57] : [Step 4/5] [2021-11-19 21:05:57,239][INFO ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-6] Configured caches [in 'sysMemPlc' dataRegion: ['ignite-sys-cache'], in 'default' dataRegion: ['encrypted']] [21:05:57]W: [org.apache.ignite:ignite-core] [2021-11-19 21:05:57,239][WARN ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-6] Peer class loading is enabled (disable it in production for performance and deployment consistency reasons) [21:05:57] : [Step 4/5] [2021-11-19 21:05:57,239][INFO ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-6] 3-rd party licenses can be found at: /opt/buildagent/work/7bc1c54bc719b67c/libs/licenses [21:05:57] : [Step 4/5] [2021-11-19 21:05:57,243][INFO ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] Configured plugins: [21:05:57] : [Step 4/5] [2021-11-19 21:05:57,243][INFO ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- StanByClusterTestProvider 1.0 [21:05:57] : [Step 4/5] [2021-11-19 21:05:57,244][INFO ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- null [21:05:57] : [Step 4/5] [2021-11-19 21:05:57,244][INFO ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] [21:05:57] : [Step 4/5] [2021-11-19 21:05:57,244][INFO ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- PageMemory tracker plugin 1.0 [21:05:57] : [Step 4/5] [2021-11-19 21:05:57,244][INFO ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- null [21:05:57] : [Step 4/5] [2021-11-19 21:05:57,244][INFO ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] [21:05:57] : [Step 4/5] [2021-11-19 21:05:57,245][INFO ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- TestDistibutedConfigurationPlugin 1.0 [21:05:57] : [Step 4/5] [2021-11-19 21:05:57,245][INFO ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- null [21:05:57] : [Step 4/5] [2021-11-19 21:05:57,245][INFO ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] [21:05:57] : [Step 4/5] [2021-11-19 21:05:57,245][INFO ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- NodeValidationPluginProvider 1.0 [21:05:57] : [Step 4/5] [2021-11-19 21:05:57,245][INFO ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- null [21:05:57] : [Step 4/5] [2021-11-19 21:05:57,246][INFO ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] [21:05:57] : [Step 4/5] [2021-11-19 21:05:57,246][INFO ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][FailureProcessor] Configured failure handler: [hnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]]] [21:05:57] : [Step 4/5] [2021-11-19 21:05:57,258][INFO ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][TcpCommunicationSpi] Successfully bound communication NIO server to TCP port [port=45151, locHost=/127.0.0.1, selectorsCnt=12, selectorSpins=0, pairedConn=false] [21:05:57]W: [org.apache.ignite:ignite-core] [2021-11-19 21:05:57,258][WARN ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][TcpCommunicationSpi] Message queue limit is set to 0 which may lead to potential OOMEs when running cache operations in FULL_ASYNC or PRIMARY_SYNC modes due to message queues growth on sender and receiver sides. [21:05:57] : [Step 4/5] [2021-11-19 21:05:57,262][INFO ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][GridCollisionManager] Collision resolution is disabled (all jobs will be activated upon arrival). [21:05:57] : [Step 4/5] [2021-11-19 21:05:57,262][INFO ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-6] Security status [authentication=off, sandbox=off, tls/ssl=off] [21:05:57] : [Step 4/5] [2021-11-19 21:05:57,318][INFO ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:05:57] : [Step 4/5] [2021-11-19 21:05:57,412][INFO ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][MaintenanceProcessor] Resolved store directory for node persistent data: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_6 [21:05:57] : [Step 4/5] [2021-11-19 21:05:57,414][INFO ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][CacheObjectBinaryProcessorImpl] Resolved directory for serialized binary metadata: /opt/buildagent/work/7bc1c54bc719b67c/work/db/binary_meta/grid_6 [21:05:57] : [Step 4/5] [2021-11-19 21:05:57,418][INFO ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_6 [21:05:57] : [Step 4/5] [2021-11-19 21:05:57,418][INFO ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][FileWriteAheadLogManager] Resolved write ahead log work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_6 [21:05:57] : [Step 4/5] [2021-11-19 21:05:57,419][INFO ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][FileWriteAheadLogManager] Resolved write ahead log archive directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_6 [21:05:57] : [Step 4/5] [2021-11-19 21:05:57,877][INFO ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_6/0000000000000000.wal [21:05:57] : [Step 4/5] [2021-11-19 21:05:57,881][INFO ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Configured data regions initialized successfully [total=5] [21:05:57] : [Step 4/5] [2021-11-19 21:05:57,885][INFO ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][IgniteSnapshotManager] Resolved snapshot work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/snapshots [21:05:57] : [Step 4/5] [2021-11-19 21:05:57,885][INFO ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][IgniteSnapshotManager] Resolved temp directory for snapshot creation: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_6/snp [21:05:57] : [Step 4/5] [2021-11-19 21:05:57,888][INFO ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][ClientListenerProcessor] Client connector processor has started on TCP port 10801 [21:05:57] : [Step 4/5] [2021-11-19 21:05:57,890][INFO ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-6] Non-loopback local IPs: 172.17.0.4 [21:05:57] : [Step 4/5] [2021-11-19 21:05:57,890][INFO ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-6] Enabled local MACs: 0242AC110004 [21:05:57] : [Step 4/5] [2021-11-19 21:05:57,890][INFO ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:05:57] : [Step 4/5] [2021-11-19 21:05:57,892][INFO ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:05:57] : [Step 4/5] [2021-11-19 21:05:57,892][INFO ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:05:57] : [Step 4/5] [2021-11-19 21:05:57,894][INFO ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Applying lost metastore updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:05:57] : [Step 4/5] [2021-11-19 21:05:57,895][INFO ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=0 ms] [21:05:57] : [Step 4/5] [2021-11-19 21:05:57,895][INFO ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][GridCacheProcessor] Restoring partition state for local groups. [21:05:57] : [Step 4/5] [2021-11-19 21:05:57,895][INFO ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=0, partitionsProcessed=0, time=0ms] [21:05:57] : [Step 4/5] [2021-11-19 21:05:57,896][INFO ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][GridEncryptionManager] Encryption keys loaded from metastore. [grps=, masterKeyName=ignite.master.key] [21:05:57] : [Step 4/5] [2021-11-19 21:05:57,897][INFO ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][ClusterProcessor] Cluster ID and tag has been read from metastorage: null [21:05:57] : [Step 4/5] [2021-11-19 21:05:57,897][INFO ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][IgniteClusterImpl] Shutdown policy was updated [oldVal=null, newVal=null] [21:05:57] : [Step 4/5] [2021-11-19 21:05:57,898][INFO ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Checkpoint frequency deviation changed [oldVal=null, newVal=null] [21:05:57] : [Step 4/5] [2021-11-19 21:05:57,908][INFO ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][FilePageStoreManager] Cleanup cache stores [total=1, left=0, cleanFiles=false] [21:05:57] : [Step 4/5] [2021-11-19 21:05:57,910][INFO ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:05:57] : [Step 4/5] [2021-11-19 21:05:57,911][INFO ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:05:57] : [Step 4/5] [2021-11-19 21:05:57,913][INFO ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:05:57] : [Step 4/5] [2021-11-19 21:05:57,914][INFO ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Data Regions Started: 5 [21:05:57] : [Step 4/5] [2021-11-19 21:05:57,914][INFO ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] ^-- sysMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:05:57] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:05:57] : [Step 4/5] ^-- default region [type=default, persistence=true, lazyAlloc=true, [21:05:57] : [Step 4/5] ... initCfg=10MB, maxCfg=10MB, usedRam=0MB, freeRam=100%, allocRam=0MB, allocTotal=0MB] [21:05:57] : [Step 4/5] ^-- metastoreMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:05:57] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:05:57] : [Step 4/5] ^-- TxLog region [type=internal, persistence=true, lazyAlloc=false, [21:05:57] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:05:57] : [Step 4/5] ^-- volatileDsMemPlc region [type=user, persistence=false, lazyAlloc=true, [21:05:57] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB] [21:05:57] : [Step 4/5] ^-- Ignite persistence [used=0MB] [21:05:57] : [Step 4/5] [21:05:57] : [Step 4/5] [2021-11-19 21:05:57,916][INFO ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Starting binary memory restore for: [-2100569601, 1613773252] [21:05:57] : [Step 4/5] [2021-11-19 21:05:57,979][INFO ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:05:57] : [Step 4/5] [2021-11-19 21:05:57,979][INFO ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:05:57] : [Step 4/5] [2021-11-19 21:05:57,981][INFO ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_6/0000000000000000.wal, offset=0, ver=2] [21:05:57] : [Step 4/5] [2021-11-19 21:05:57,985][INFO ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][GridCacheProcessor] Started cache in recovery mode [name=ignite-sys-cache, id=-2100569601, dataRegionName=sysMemPlc, mode=REPLICATED, atomicity=TRANSACTIONAL, backups=2147483647, mvcc=false] [21:05:57] : [Step 4/5] [2021-11-19 21:05:57,986][INFO ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][PageMemoryImpl] Started page memory [memoryAllocated=24.0 MiB, pages=5952, tableSize=474.2 KiB, replacementSize=768 B, checkpointBuffer=10.0 MiB] [21:05:57] : [Step 4/5] [2021-11-19 21:05:57,990][INFO ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][GridCacheProcessor] Started cache in recovery mode [name=encrypted, id=1613773252, dataRegionName=default, mode=PARTITIONED, atomicity=TRANSACTIONAL, backups=0, mvcc=false] [21:05:57] : [Step 4/5] [2021-11-19 21:05:57,991][INFO ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Binary recovery performed in 75 ms. [21:05:57] : [Step 4/5] [2021-11-19 21:05:57,992][INFO ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:05:57] : [Step 4/5] [2021-11-19 21:05:57,992][INFO ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Applying lost cache updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:05:58] : [Step 4/5] [2021-11-19 21:05:58,043][INFO ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=50 ms] [21:05:58] : [Step 4/5] [2021-11-19 21:05:58,043][INFO ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][GridCacheProcessor] Restoring partition state for local groups. [21:05:58] : [Step 4/5] [2021-11-19 21:05:58,053][INFO ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=2, partitionsProcessed=1124, time=10ms] [21:05:58] : [Step 4/5] [2021-11-19 21:05:58,405][INFO ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][TestTcpDiscoverySpi] Successfully bound to TCP port [port=47501, localHost=localhost/127.0.0.1, locNodeId=60efc20b-b98d-4d8a-a216-3e743b573006] [21:05:58] : [Step 4/5] [2021-11-19 21:05:58,407][INFO ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][GridEncryptionManager] Sending new group keys to coordinator [grps=1613773252] [21:05:58] : [Step 4/5] [2021-11-19 21:05:58,409][INFO ][tcp-disco-srvr-[:47500]-#620%grid-0%-#11912%grid-0%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=47431] [21:05:58] : [Step 4/5] [2021-11-19 21:05:58,409][INFO ][tcp-disco-srvr-[:47500]-#620%grid-0%-#11912%grid-0%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=47431] [21:05:58] : [Step 4/5] [2021-11-19 21:05:58,410][INFO ][tcp-disco-sock-reader-[]-#626%grid-0%-#12032%grid-0%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:47431, rmtPort=47431] [21:05:58] : [Step 4/5] [2021-11-19 21:05:58,411][INFO ][tcp-disco-sock-reader-[60efc20b 127.0.0.1:47431]-#626%grid-0%-#12032%grid-0%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=60efc20b-b98d-4d8a-a216-3e743b573006, rmtAddr=/127.0.0.1:47431] [21:05:58] : [Step 4/5] [2021-11-19 21:05:58,414][INFO ][tcp-disco-srvr-[:47501]-#625%grid-6%-#12031%grid-6%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=42347] [21:05:58] : [Step 4/5] [2021-11-19 21:05:58,414][INFO ][tcp-disco-srvr-[:47501]-#625%grid-6%-#12031%grid-6%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=42347] [21:05:58] : [Step 4/5] [2021-11-19 21:05:58,415][INFO ][tcp-disco-sock-reader-[]-#627%grid-6%-#12033%grid-6%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:42347, rmtPort=42347] [21:05:58] : [Step 4/5] [2021-11-19 21:05:58,415][INFO ][tcp-disco-sock-reader-[]-#627%grid-6%-#12033%grid-6%][TestTcpDiscoverySpi] Received ping request from the remote node [rmtNodeId=003a0cc9-2754-4d39-b63e-fbb30d05a000, rmtAddr=/127.0.0.1:42347, rmtPort=42347] [21:05:58] : [Step 4/5] [2021-11-19 21:05:58,416][INFO ][tcp-disco-sock-reader-[]-#627%grid-6%-#12033%grid-6%][TestTcpDiscoverySpi] Finished writing ping response [rmtNodeId=003a0cc9-2754-4d39-b63e-fbb30d05a000, rmtAddr=/127.0.0.1:42347, rmtPort=42347] [21:05:58]W: [org.apache.ignite:ignite-core] [2021-11-19 21:05:58,417][WARN ][tcp-disco-sock-reader-[]-#627%grid-6%-#12033%grid-6%][TestTcpDiscoverySpi] Failed to shutdown socket [21:05:58]W: [org.apache.ignite:ignite-core] java.net.SocketException: Socket output is already shutdown [21:05:58]W: [org.apache.ignite:ignite-core] at java.net.Socket.shutdownOutput(Socket.java:1572) [21:05:58]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.close(IgniteUtils.java:4247) [21:05:58]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.discovery.tcp.ServerImpl$SocketReader.body(ServerImpl.java:7370) [21:05:58]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.IgniteSpiThread.run(IgniteSpiThread.java:58) [21:05:58] : [Step 4/5] [2021-11-19 21:05:58,417][INFO ][tcp-disco-sock-reader-[60efc20b 127.0.0.1:47431]-#626%grid-0%-#12032%grid-0%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:47431, rmtPort=47431, rmtNodeId=60efc20b-b98d-4d8a-a216-3e743b573006] [21:05:58] : [Step 4/5] [2021-11-19 21:05:58,418][INFO ][tcp-disco-sock-reader-[]-#627%grid-6%-#12033%grid-6%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:42347, rmtPort=42347, rmtNodeId=null] [21:05:58] : [Step 4/5] [2021-11-19 21:05:58,420][INFO ][tcp-disco-msg-worker-[crd]-#619%grid-0%-#11911%grid-0%][GridEncryptionManager] Joining node doesn't have stored group keys [node=60efc20b-b98d-4d8a-a216-3e743b573006] [21:05:58] : [Step 4/5] [2021-11-19 21:05:58,422][INFO ][tcp-disco-msg-worker-[crd]-#619%grid-0%-#11911%grid-0%][GridEncryptionManager] Skip group key received from joining node. Already exists. [node=60efc20b-b98d-4d8a-a216-3e743b573006, grp=1613773252] [21:05:58] : [Step 4/5] [2021-11-19 21:05:58,430][INFO ][tcp-disco-msg-worker-[crd]-#619%grid-0%-#11911%grid-0%][TestTcpDiscoverySpi] New next node [newNext=TcpDiscoveryNode [id=60efc20b-b98d-4d8a-a216-3e743b573006, consistentId=grid-6, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=0, intOrder=2, lastExchangeTime=1637345158413, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false]] [21:05:58] : [Step 4/5] [2021-11-19 21:05:58,431][INFO ][tcp-disco-srvr-[:47501]-#625%grid-6%-#12031%grid-6%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=36751] [21:05:58] : [Step 4/5] [2021-11-19 21:05:58,431][INFO ][tcp-disco-srvr-[:47501]-#625%grid-6%-#12031%grid-6%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=36751] [21:05:58] : [Step 4/5] [2021-11-19 21:05:58,432][INFO ][tcp-disco-sock-reader-[]-#628%grid-6%-#12034%grid-6%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:36751, rmtPort=36751] [21:05:58] : [Step 4/5] [2021-11-19 21:05:58,433][INFO ][tcp-disco-sock-reader-[003a0cc9 127.0.0.1:36751]-#628%grid-6%-#12034%grid-6%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=003a0cc9-2754-4d39-b63e-fbb30d05a000, rmtAddr=/127.0.0.1:36751] [21:05:58] : [Step 4/5] [2021-11-19 21:05:58,436][INFO ][tcp-disco-msg-worker-[]-#624%grid-6%-#12030%grid-6%][TestTcpDiscoverySpi] New next node [newNext=TcpDiscoveryNode [id=003a0cc9-2754-4d39-b63e-fbb30d05a000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345158433, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false]] [21:05:58] : [Step 4/5] [2021-11-19 21:05:58,437][INFO ][tcp-disco-srvr-[:47500]-#620%grid-0%-#11912%grid-0%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=53403] [21:05:58] : [Step 4/5] [2021-11-19 21:05:58,437][INFO ][tcp-disco-srvr-[:47500]-#620%grid-0%-#11912%grid-0%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=53403] [21:05:58] : [Step 4/5] [2021-11-19 21:05:58,438][INFO ][tcp-disco-sock-reader-[]-#629%grid-0%-#12035%grid-0%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:53403, rmtPort=53403] [21:05:58] : [Step 4/5] [2021-11-19 21:05:58,439][INFO ][tcp-disco-sock-reader-[60efc20b 127.0.0.1:53403]-#629%grid-0%-#12035%grid-0%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=60efc20b-b98d-4d8a-a216-3e743b573006, rmtAddr=/127.0.0.1:53403] [21:05:58] : [Step 4/5] [2021-11-19 21:05:58,441][INFO ][disco-event-worker-#11914%grid-0%][GridDiscoveryManager] Added new node to topology: TcpDiscoveryNode [id=60efc20b-b98d-4d8a-a216-3e743b573006, consistentId=grid-6, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637345158413, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false] [21:05:58] : [Step 4/5] [2021-11-19 21:05:58,442][INFO ][disco-event-worker-#11914%grid-0%][GridDiscoveryManager] Topology snapshot [ver=2, locNode=003a0cc9, servers=2, clients=0, state=INACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=003a0cc9-2754-4d39-b63e-fbb30d05a000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=60efc20b-b98d-4d8a-a216-3e743b573006, consistentId=grid-6, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:05:58] : [Step 4/5] [2021-11-19 21:05:58,444][INFO ][tcp-disco-msg-worker-[003a0cc9 127.0.0.1:47500]-#624%grid-6%-#12030%grid-6%][GridEncryptionManager] Store group key received from coordinator [grp=1613773252, keyId=0] [21:05:58] : [Step 4/5] [2021-11-19 21:05:58,445][INFO ][tcp-disco-msg-worker-[003a0cc9 127.0.0.1:47500]-#624%grid-6%-#12030%grid-6%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustEnabled' was changed from 'null' to 'false' [21:05:58] : [Step 4/5] [2021-11-19 21:05:58,445][INFO ][tcp-disco-msg-worker-[003a0cc9 127.0.0.1:47500]-#624%grid-6%-#12030%grid-6%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustTimeout' was changed from 'null' to '300000' [21:05:58] : [Step 4/5] [2021-11-19 21:05:58,446][INFO ][tcp-disco-msg-worker-[003a0cc9 127.0.0.1:47500]-#624%grid-6%-#12030%grid-6%][IgniteTxManager] Transactions parameter 'longOperationsDumpTimeout' was changed from 'null' to '60000' [21:05:58] : [Step 4/5] [2021-11-19 21:05:58,446][INFO ][tcp-disco-msg-worker-[003a0cc9 127.0.0.1:47500]-#624%grid-6%-#12030%grid-6%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpThreshold' was changed from 'null' to '0' [21:05:58] : [Step 4/5] [2021-11-19 21:05:58,446][INFO ][tcp-disco-msg-worker-[003a0cc9 127.0.0.1:47500]-#624%grid-6%-#12030%grid-6%][IgniteTxManager] Transactions parameter 'transactionTimeDumpSamplesCoefficient' was changed from 'null' to '0.0' [21:05:58] : [Step 4/5] [2021-11-19 21:05:58,447][INFO ][tcp-disco-msg-worker-[003a0cc9 127.0.0.1:47500]-#624%grid-6%-#12030%grid-6%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpSamplesPerSecondLimit' was changed from 'null' to '5' [21:05:58] : [Step 4/5] [2021-11-19 21:05:58,447][INFO ][tcp-disco-msg-worker-[003a0cc9 127.0.0.1:47500]-#624%grid-6%-#12030%grid-6%][IgniteTxManager] Transactions parameter 'collisionsDumpInterval' was changed from 'null' to '1000' [21:05:58] : [Step 4/5] [2021-11-19 21:05:58,447][INFO ][tcp-disco-msg-worker-[003a0cc9 127.0.0.1:47500]-#624%grid-6%-#12030%grid-6%][IgniteTxManager] Transactions parameter 'txOwnerDumpRequestsAllowed' was changed from 'null' to 'true' [21:05:58] : [Step 4/5] [2021-11-19 21:05:58,448][INFO ][tcp-disco-msg-worker-[003a0cc9 127.0.0.1:47500]-#624%grid-6%-#12030%grid-6%][GridCacheDatabaseSharedManager] Historical rebalance WAL threshold changed [property=historical.rebalance.threshold, oldVal=null, newVal=500] [21:05:58] : [Step 4/5] [2021-11-19 21:05:58,448][INFO ][tcp-disco-msg-worker-[003a0cc9 127.0.0.1:47500]-#624%grid-6%-#12030%grid-6%][ClusterProcessor] hardcore_hertz [21:05:58] : [Step 4/5] [2021-11-19 21:05:58,449][INFO ][disco-notifier-worker-#12029%grid-6%][MvccProcessorImpl] Assigned mvcc coordinator [crd=MvccCoordinator [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=0], nodeId=003a0cc9-2754-4d39-b63e-fbb30d05a000, ver=1637345157192, local=false, initialized=false]] [21:05:58] : [Step 4/5] [2021-11-19 21:05:58,450][INFO ][sys-#12022%grid-6%][ClusterProcessor] Writing cluster ID and tag to metastorage on ready for write ClusterIdAndTag [id=31400863-ff27-4063-8faa-2fafe901f2b1, tag=hardcore_hertz] [21:05:58] : [Step 4/5] [2021-11-19 21:05:58,467][INFO ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-6] To start Console Management & Monitoring run ignitevisorcmd.{sh|bat} [21:05:58] : [Step 4/5] [2021-11-19 21:05:58,468][INFO ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-6] [21:05:58] : [Step 4/5] [21:05:58] : [Step 4/5] >>> +-------------------------------------------+ [21:05:58] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:05:58] : [Step 4/5] >>> +-------------------------------------------+ [21:05:58] : [Step 4/5] >>> OS name: Linux 4.15.0-151-generic amd64 [21:05:58] : [Step 4/5] >>> CPU(s): 24 [21:05:58] : [Step 4/5] >>> Heap: 2.0GB [21:05:58] : [Step 4/5] >>> VM name: 16724@c4dfe9a430b2 [21:05:58] : [Step 4/5] >>> Ignite instance name: grid-6 [21:05:58] : [Step 4/5] >>> Local node [ID=60EFC20B-B98D-4D8A-A216-3E743B573006, order=2, clientMode=false] [21:05:58] : [Step 4/5] >>> Local node addresses: [127.0.0.1] [21:05:58] : [Step 4/5] >>> Local ports: TCP:10801 TCP:45151 TCP:47501 [21:05:58] : [Step 4/5] [21:05:58] : [Step 4/5] [2021-11-19 21:05:58,468][INFO ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-6] >>> Ignite cluster is in INACTIVE state (limited functionality available). Use control.(sh|bat) script or IgniteCluster.state(ClusterState.ACTIVE) to change the state. [21:05:58] : [Step 4/5] [2021-11-19 21:05:58,469][INFO ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][GridDiscoveryManager] Topology snapshot [ver=2, locNode=60efc20b, servers=2, clients=0, state=INACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=003a0cc9-2754-4d39-b63e-fbb30d05a000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=60efc20b-b98d-4d8a-a216-3e743b573006, consistentId=grid-6, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:05:58] : [Step 4/5] [2021-11-19 21:05:58,470][INFO ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][G] Node started : [stage="Configure system pool" (0 ms),stage="Start managers" (191 ms),stage="Configure binary metadata" (2 ms),stage="Start processors" (473 ms),stage="Start 'StanByClusterTestProvider' plugin" (0 ms),stage="Start 'PageMemory tracker plugin' plugin" (0 ms),stage="Start 'TestDistibutedConfigurationPlugin' plugin" (0 ms),stage="Start 'NodeValidationPluginProvider' plugin" (0 ms),stage="Init metastore" (18 ms),stage="Init and start regions" (8 ms),stage="Restore binary memory" (75 ms),stage="Restore logical state" (62 ms),stage="Finish recovery" (350 ms),stage="Join topology" (44 ms),stage="Await transition" (2 ms),stage="Await exchange" (18 ms),stage="Total time" (1243 ms)] [21:05:58] : [Step 4/5] [2021-11-19 21:05:58,472][INFO ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][root] Node started with the following configuration [id=60efc20b-b98d-4d8a-a216-3e743b573006, marshaller=BinaryMarshaller [], discovery=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=5000, ackTimeout=5000, marsh=JdkMarshaller [clsFilter=org.apache.ignite.marshaller.MarshallerUtils$1@250c2f1d], reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], binaryCfg=null, lateAff=true] [21:05:58]W: [org.apache.ignite:ignite-core] [2021-11-19 21:05:58,477][WARN ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][G] Ignite work directory is not provided, automatically resolved to: /opt/buildagent/work/7bc1c54bc719b67c/work [21:05:58] : [Step 4/5] [2021-11-19 21:05:58,478][INFO ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%client1] [21:05:58] : [Step 4/5] [21:05:58] : [Step 4/5] >>> __________ ________________ [21:05:58] : [Step 4/5] >>> / _/ ___/ |/ / _/_ __/ __/ [21:05:58] : [Step 4/5] >>> _/ // (7 7 // / / / / _/ [21:05:58] : [Step 4/5] >>> /___/\___/_/|_/___/ /_/ /___/ [21:05:58] : [Step 4/5] >>> [21:05:58] : [Step 4/5] >>> ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:05:58] : [Step 4/5] >>> 2021 Copyright(C) Apache Software Foundation [21:05:58] : [Step 4/5] >>> [21:05:58] : [Step 4/5] >>> Ignite documentation: http://ignite.apache.org [21:05:58] : [Step 4/5] [21:05:58] : [Step 4/5] [2021-11-19 21:05:58,478][INFO ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%client1] Config URL: n/a [21:05:58] : [Step 4/5] [2021-11-19 21:05:58,478][INFO ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%client1] IgniteConfiguration [igniteInstanceName=client1, pubPoolSize=24, svcPoolSize=24, callbackPoolSize=24, stripedPoolSize=24, sysPoolSize=24, mgmtPoolSize=4, dataStreamerPoolSize=24, utilityCachePoolSize=24, utilityCacheKeepAliveTime=60000, p2pPoolSize=2, qryPoolSize=24, buildIdxPoolSize=4, igniteHome=/opt/buildagent/work/7bc1c54bc719b67c, igniteWorkDir=/opt/buildagent/work/7bc1c54bc719b67c/work, mbeanSrv=com.sun.jmx.mbeanserver.JmxMBeanServer@6fe85038, nodeId=10ce8c9f-e4f8-4677-9026-4a4de00ef001, marsh=BinaryMarshaller [], marshLocJobs=false, daemon=false, p2pEnabled=true, netTimeout=10000, netCompressionLevel=1, sndRetryDelay=1000, sndRetryCnt=3, metricsHistSize=10000, metricsUpdateFreq=1000, metricsExpTime=9223372036854775807, discoSpi=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=0, ackTimeout=0, marsh=null, reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], segPlc=STOP, segResolveAttempts=2, waitForSegOnStart=true, allResolversPassReq=true, segChkFreq=10000, commSpi=TcpCommunicationSpi [connectGate=org.apache.ignite.spi.communication.tcp.internal.ConnectGateway@292f70d2, ctxInitLatch=java.util.concurrent.CountDownLatch@716704bf[Count = 1], stopping=false, clientPool=null, nioSrvWrapper=null, stateProvider=null], evtSpi=MemoryEventStorageSpi [expireAgeMs=9223372036854775807, expireCnt=10000, filter=null], colSpi=NoopCollisionSpi [], deploySpi=LocalDeploymentSpi [], indexingSpi=org.apache.ignite.spi.indexing.noop.NoopIndexingSpi@4695057b, addrRslvr=null, encryptionSpi=org.apache.ignite.spi.encryption.noop.NoopEncryptionSpi@5332cb1a, tracingSpi=org.apache.ignite.spi.tracing.NoopTracingSpi@2167a679, clientMode=true, rebalanceThreadPoolSize=4, rebalanceTimeout=10000, rebalanceBatchesPrefetchCnt=3, rebalanceThrottle=0, rebalanceBatchSize=524288, txCfg=TransactionConfiguration [txSerEnabled=false, dfltIsolation=REPEATABLE_READ, dfltConcurrency=PESSIMISTIC, dfltTxTimeout=0, txTimeoutOnPartitionMapExchange=0, deadlockTimeout=10000, pessimisticTxLogSize=0, pessimisticTxLogLinger=10000, tmLookupClsName=null, txManagerFactory=null, useJtaSync=false], cacheSanityCheckEnabled=true, discoStartupDelay=60000, deployMode=SHARED, p2pMissedCacheSize=100, locHost=127.0.0.1, timeSrvPortBase=31100, timeSrvPortRange=100, failureDetectionTimeout=10000, sysWorkerBlockedTimeout=null, clientFailureDetectionTimeout=10000, metricsLogFreq=0, connectorCfg=null, odbcCfg=null, warmupClos=null, atomicCfg=AtomicConfiguration [seqReserveSize=1000, cacheMode=PARTITIONED, backups=1, aff=null, grpName=null], classLdr=null, sslCtxFactory=null, platformCfg=null, binaryCfg=null, memCfg=null, pstCfg=null, dsCfg=DataStorageConfiguration [sysRegionInitSize=41943040, sysRegionMaxSize=104857600, pageSize=4096, concLvl=0, dfltDataRegConf=DataRegionConfiguration [name=default, maxSize=10485760, initSize=268435456, swapPath=null, pageEvictionMode=DISABLED, pageReplacementMode=CLOCK, evictionThreshold=0.9, emptyPagesPoolSize=100, metricsEnabled=false, metricsSubIntervalCount=5, metricsRateTimeInterval=60000, persistenceEnabled=true, checkpointPageBufSize=0, lazyMemoryAllocation=true, warmUpCfg=null], dataRegions=null, storagePath=null, checkpointFreq=180000, lockWaitTime=10000, checkpointThreads=4, checkpointWriteOrder=SEQUENTIAL, walHistSize=20, maxWalArchiveSize=1073741824, walSegments=10, walSegmentSize=67108864, walPath=db/wal, walArchivePath=db/wal/archive, cdcWalPath=db/wal/cdc, cdcEnabled=false, metricsEnabled=false, walMode=FSYNC, walTlbSize=131072, walBuffSize=0, walFlushFreq=2000, walFsyncDelay=1000, walRecordIterBuffSize=67108864, alwaysWriteFullPages=false, fileIOFactory=org.apache.ignite.internal.processors.cache.persistence.file.AsyncFileIOFactory@21afaa06, metricsSubIntervalCnt=5, metricsRateTimeInterval=60000, walAutoArchiveAfterInactivity=-1, walForceArchiveTimeout=-1, writeThrottlingEnabled=false, walCompactionEnabled=false, walCompactionLevel=1, checkpointReadLockTimeout=null, walPageCompression=DISABLED, walPageCompressionLevel=null, dfltWarmUpCfg=null, encCfg=org.apache.ignite.configuration.EncryptionConfiguration@5cacfb0b, defragmentationThreadPoolSize=4, minWalArchiveSize=-1], snapshotPath=snapshots, activeOnStart=true, activeOnStartPropSetFlag=false, autoActivation=true, autoActivationPropSetFlag=false, clusterStateOnStart=null, sqlConnCfg=null, cliConnCfg=ClientConnectorConfiguration [host=null, port=10800, portRange=100, sockSndBufSize=0, sockRcvBufSize=0, tcpNoDelay=true, maxOpenCursorsPerConn=128, threadPoolSize=24, selectorCnt=12, idleTimeout=0, handshakeTimeout=10000, jdbcEnabled=true, odbcEnabled=true, thinCliEnabled=true, sslEnabled=false, useIgniteSslCtxFactory=true, sslClientAuth=false, sslCtxFactory=null, thinCliCfg=ThinClientConfiguration [maxActiveTxPerConn=100, maxActiveComputeTasksPerConn=0]], mvccVacuumThreadCnt=2, mvccVacuumFreq=5000, authEnabled=false, failureHnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]], commFailureRslvr=null, sqlCfg=SqlConfiguration [longQryWarnTimeout=3000, dfltQryTimeout=0, sqlQryHistSize=1000, validationEnabled=false], asyncContinuationExecutor=null] [21:05:58] : [Step 4/5] [2021-11-19 21:05:58,485][INFO ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%client1] Daemon mode: off [21:05:58] : [Step 4/5] [2021-11-19 21:05:58,486][INFO ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%client1] OS: Linux 4.15.0-151-generic amd64 [21:05:58] : [Step 4/5] [2021-11-19 21:05:58,486][INFO ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%client1] OS user: teamcity [21:05:58] : [Step 4/5] [2021-11-19 21:05:58,486][INFO ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%client1] PID: 16724 [21:05:58] : [Step 4/5] [2021-11-19 21:05:58,486][INFO ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%client1] Language runtime: Java Platform API Specification ver. 1.8 [21:05:58] : [Step 4/5] [2021-11-19 21:05:58,487][INFO ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%client1] VM information: Java(TM) SE Runtime Environment 1.8.0_261-b12 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 25.261-b12 [21:05:58] : [Step 4/5] [2021-11-19 21:05:58,487][INFO ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%client1] VM total memory: 1.8GB [21:05:58] : [Step 4/5] [2021-11-19 21:05:58,487][INFO ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%client1] Remote Management [restart: off, REST: off, JMX (remote: off)] [21:05:58] : [Step 4/5] [2021-11-19 21:05:58,487][INFO ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%client1] Logger: GridTestLog4jLogger [quiet=false, config=null] [21:05:58] : [Step 4/5] [2021-11-19 21:05:58,487][INFO ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%client1] IGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c [21:05:58] : [Step 4/5] [2021-11-19 21:05:58,488][INFO ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%client1] VM arguments: [-DIGNITE_DUMP_THREADS_ON_FAILURE=false, -DMono=/usr/bin/mono-sgen, -DMono4.0_x64=/usr/lib/mono/4.0, -DMono4.5_x64=/usr/lib/mono/4.5, -DMonoVersion=6.12.0.90, -DSKIP_BUILD=false, -Dagent.home.dir=/opt/buildagent, -Dagent.name=aitc-lin02_03, -Dagent.ownPort=9090, -Dagent.work.dir=/opt/buildagent/work, -Dbuild.number=95, -Dbuild.vcs.number=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.1=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.GitHubApacheIgnite=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dclassworlds.conf=/opt/buildagent/temp/buildTmp/teamcity.m2.conf, -Dcom.jetbrains.maven.watcher.report.file=/opt/buildagent/temp/buildTmp/maven-build-info.xml, -Djava.io.tmpdir=/opt/buildagent/temp/buildTmp, -Dmaven.home=/opt/buildagent/tools/maven3_6, -Dmaven.multiModuleProjectDirectory=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.agent.cpuBenchmark=457, -Dteamcity.agent.dotnet.agent_url=http://localhost:9090/RPC2, -Dteamcity.agent.dotnet.build_id=6278078, -Dteamcity.auth.password=*******, -Dteamcity.auth.userId=TeamCityBuildId=6278078, -Dteamcity.build.changedFiles.file=/opt/buildagent/temp/buildTmp/changedFiles6342607772318147725.txt, -Dteamcity.build.checkoutDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.build.id=6278078, -Dteamcity.build.properties.file=/opt/buildagent/temp/buildTmp/teamcity.build5164517880467851002.properties, -Dteamcity.build.tempDir=/opt/buildagent/temp/buildTmp, -Dteamcity.build.workingDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.buildConfName=Basic 3, -Dteamcity.buildType.id=IgniteTests24Java8_Basic3, -Dteamcity.configuration.properties.file=/opt/buildagent/temp/buildTmp/teamcity.config5591980786735343870.properties, -Dteamcity.maven.userSettings.path=/opt/buildagent/temp/buildTmp/maven_settings_585072866407032347.xml, -Dteamcity.maven.watcher.home=/opt/buildagent/plugins/mavenPlugin/maven-watcher-jdk16, -Dteamcity.projectName=Ignite Tests 2.x (JDK 8/11), -Dteamcity.runner.properties.file=/opt/buildagent/temp/buildTmp/teamcity.runner9098465561618137420.properties, -Dteamcity.tests.recentlyFailedTests.file=/opt/buildagent/temp/buildTmp/testsToRunFirst3891775683130404069.txt, -Dteamcity.version=2021.2 (build 99542), -ea, -Xms2g, -Xmx2g, -XX:+HeapDumpOnOutOfMemoryError, -DIGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_TEST_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_UPDATE_NOTIFIER=false, -DIGNITE_NO_DISCO_ORDER=true, -DIGNITE_PERFORMANCE_SUGGESTIONS_DISABLED=true, -Djava.net.preferIPv4Stack=true, -DTEST_SCALE_FACTOR=1.0, -DIGNITE_TEST_PROP_LOG4J_FILE=log4j-tc-test.xml, -DIGNITE_QUIET=false, -DIGNITE_MARSHAL_BUFFERS_RECHECK=1000, -Dmaven.repo.local=/opt/buildagent/.m2/repository] [21:05:58] : [Step 4/5] [2021-11-19 21:05:58,491][INFO ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%client1] System cache's DataRegion size is configured to 40 MB. Use DataStorageConfiguration.systemRegionInitialSize property to change the setting. [21:05:58] : [Step 4/5] [2021-11-19 21:05:58,492][INFO ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%client1] Configured caches [in 'sysMemPlc' dataRegion: ['ignite-sys-cache'], in 'default' dataRegion: ['encrypted']] [21:05:58]W: [org.apache.ignite:ignite-core] [2021-11-19 21:05:58,492][WARN ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%client1] Peer class loading is enabled (disable it in production for performance and deployment consistency reasons) [21:05:58] : [Step 4/5] [2021-11-19 21:05:58,492][INFO ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%client1] 3-rd party licenses can be found at: /opt/buildagent/work/7bc1c54bc719b67c/libs/licenses [21:05:58] : [Step 4/5] [2021-11-19 21:05:58,496][INFO ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] Configured plugins: [21:05:58] : [Step 4/5] [2021-11-19 21:05:58,497][INFO ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- StanByClusterTestProvider 1.0 [21:05:58] : [Step 4/5] [2021-11-19 21:05:58,497][INFO ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- null [21:05:58] : [Step 4/5] [2021-11-19 21:05:58,497][INFO ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] [21:05:58] : [Step 4/5] [2021-11-19 21:05:58,497][INFO ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- PageMemory tracker plugin 1.0 [21:05:58] : [Step 4/5] [2021-11-19 21:05:58,497][INFO ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- null [21:05:58] : [Step 4/5] [2021-11-19 21:05:58,497][INFO ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] [21:05:58] : [Step 4/5] [2021-11-19 21:05:58,498][INFO ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- TestDistibutedConfigurationPlugin 1.0 [21:05:58] : [Step 4/5] [2021-11-19 21:05:58,498][INFO ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- null [21:05:58] : [Step 4/5] [2021-11-19 21:05:58,498][INFO ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] [21:05:58] : [Step 4/5] [2021-11-19 21:05:58,498][INFO ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- NodeValidationPluginProvider 1.0 [21:05:58] : [Step 4/5] [2021-11-19 21:05:58,498][INFO ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- null [21:05:58] : [Step 4/5] [2021-11-19 21:05:58,498][INFO ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] [21:05:58] : [Step 4/5] [2021-11-19 21:05:58,499][INFO ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][FailureProcessor] Configured failure handler: [hnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]]] [21:05:58] : [Step 4/5] [2021-11-19 21:05:58,527][INFO ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][TcpCommunicationSpi] Successfully bound communication NIO server to TCP port [port=45152, locHost=/127.0.0.1, selectorsCnt=12, selectorSpins=0, pairedConn=false] [21:05:58]W: [org.apache.ignite:ignite-core] [2021-11-19 21:05:58,527][WARN ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][TcpCommunicationSpi] Message queue limit is set to 0 which may lead to potential OOMEs when running cache operations in FULL_ASYNC or PRIMARY_SYNC modes due to message queues growth on sender and receiver sides. [21:05:58] : [Step 4/5] [2021-11-19 21:05:58,537][INFO ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][GridCollisionManager] Collision resolution is disabled (all jobs will be activated upon arrival). [21:05:58] : [Step 4/5] [2021-11-19 21:05:58,538][INFO ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%client1] Security status [authentication=off, sandbox=off, tls/ssl=off] [21:05:58]W: [org.apache.ignite:ignite-core] [2021-11-19 21:05:58,541][WARN ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][GridCacheProcessor] Persistent Store is not supported on client nodes (Persistent Store's configuration will be ignored). [21:05:58] : [Step 4/5] [2021-11-19 21:05:58,543][INFO ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][IgniteCacheDatabaseSharedManager] Configured data regions initialized successfully [total=4] [21:05:58] : [Step 4/5] [2021-11-19 21:05:58,547][INFO ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][ClientListenerProcessor] Client connector processor has started on TCP port 10802 [21:05:58] : [Step 4/5] [2021-11-19 21:05:58,548][INFO ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%client1] Non-loopback local IPs: 172.17.0.4 [21:05:58] : [Step 4/5] [2021-11-19 21:05:58,549][INFO ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%client1] Enabled local MACs: 0242AC110004 [21:05:58] : [Step 4/5] [2021-11-19 21:05:58,549][INFO ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][ClusterProcessor] Cluster ID and tag has been read from metastorage: null [21:05:58] : [Step 4/5] [2021-11-19 21:05:58,549][INFO ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][IgniteClusterImpl] Shutdown policy was updated [oldVal=null, newVal=null] [21:05:58] : [Step 4/5] [2021-11-19 21:05:58,553][INFO ][tcp-disco-srvr-[:47500]-#620%grid-0%-#11912%grid-0%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=50467] [21:05:58] : [Step 4/5] [2021-11-19 21:05:58,553][INFO ][tcp-disco-srvr-[:47500]-#620%grid-0%-#11912%grid-0%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=50467] [21:05:58] : [Step 4/5] [2021-11-19 21:05:58,553][INFO ][tcp-disco-sock-reader-[]-#636%grid-0%-#12129%grid-0%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:50467, rmtPort=50467] [21:05:58] : [Step 4/5] [2021-11-19 21:05:58,554][INFO ][tcp-disco-sock-reader-[10ce8c9f 127.0.0.1:50467 client]-#636%grid-0%-#12129%grid-0%][TestTcpDiscoverySpi] Initialized connection with remote client node [nodeId=10ce8c9f-e4f8-4677-9026-4a4de00ef001, rmtAddr=/127.0.0.1:50467] [21:05:58] : [Step 4/5] [2021-11-19 21:05:58,574][INFO ][disco-event-worker-#11914%grid-0%][GridDiscoveryManager] Added new node to topology: TcpDiscoveryNode [id=10ce8c9f-e4f8-4677-9026-4a4de00ef001, consistentId=client1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:0], discPort=0, order=3, intOrder=3, lastExchangeTime=1637345158554, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=true] [21:05:58] : [Step 4/5] [2021-11-19 21:05:58,574][INFO ][disco-event-worker-#11914%grid-0%][GridDiscoveryManager] Topology snapshot [ver=3, locNode=003a0cc9, servers=2, clients=1, state=INACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=003a0cc9-2754-4d39-b63e-fbb30d05a000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=60efc20b-b98d-4d8a-a216-3e743b573006, consistentId=grid-6, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=10ce8c9f-e4f8-4677-9026-4a4de00ef001, consistentId=client1, isClient=true, ver=2.13.0#20211119-sha1:00000000]]] [21:05:58] : [Step 4/5] [2021-11-19 21:05:58,577][INFO ][tcp-client-disco-msg-worker-#635%client1%-#12127%client1%][TestTcpDiscoverySpi] Router node: TcpDiscoveryNode [id=003a0cc9-2754-4d39-b63e-fbb30d05a000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345158564, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false] [21:05:58] : [Step 4/5] [2021-11-19 21:05:58,578][INFO ][disco-event-worker-#12037%grid-6%][GridDiscoveryManager] Added new node to topology: TcpDiscoveryNode [id=10ce8c9f-e4f8-4677-9026-4a4de00ef001, consistentId=client1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:0], discPort=0, order=3, intOrder=3, lastExchangeTime=1637345158564, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=true] [21:05:58] : [Step 4/5] [2021-11-19 21:05:58,579][INFO ][disco-event-worker-#12037%grid-6%][GridDiscoveryManager] Topology snapshot [ver=3, locNode=60efc20b, servers=2, clients=1, state=INACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=003a0cc9-2754-4d39-b63e-fbb30d05a000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=60efc20b-b98d-4d8a-a216-3e743b573006, consistentId=grid-6, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=10ce8c9f-e4f8-4677-9026-4a4de00ef001, consistentId=client1, isClient=true, ver=2.13.0#20211119-sha1:00000000]]] [21:05:58] : [Step 4/5] [2021-11-19 21:05:58,581][INFO ][tcp-client-disco-msg-worker-#635%client1%-#12127%client1%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustEnabled' was changed from 'null' to 'false' [21:05:58] : [Step 4/5] [2021-11-19 21:05:58,581][INFO ][tcp-client-disco-msg-worker-#635%client1%-#12127%client1%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustTimeout' was changed from 'null' to '300000' [21:05:58] : [Step 4/5] [2021-11-19 21:05:58,581][INFO ][tcp-client-disco-msg-worker-#635%client1%-#12127%client1%][IgniteTxManager] Transactions parameter 'collisionsDumpInterval' was changed from 'null' to '1000' [21:05:58] : [Step 4/5] [2021-11-19 21:05:58,582][INFO ][tcp-client-disco-msg-worker-#635%client1%-#12127%client1%][IgniteTxManager] Transactions parameter 'longOperationsDumpTimeout' was changed from 'null' to '60000' [21:05:58] : [Step 4/5] [2021-11-19 21:05:58,582][INFO ][tcp-client-disco-msg-worker-#635%client1%-#12127%client1%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpSamplesPerSecondLimit' was changed from 'null' to '5' [21:05:58] : [Step 4/5] [2021-11-19 21:05:58,583][INFO ][tcp-client-disco-msg-worker-#635%client1%-#12127%client1%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpThreshold' was changed from 'null' to '0' [21:05:58] : [Step 4/5] [2021-11-19 21:05:58,583][INFO ][tcp-client-disco-msg-worker-#635%client1%-#12127%client1%][IgniteTxManager] Transactions parameter 'transactionTimeDumpSamplesCoefficient' was changed from 'null' to '0.0' [21:05:58] : [Step 4/5] [2021-11-19 21:05:58,583][INFO ][tcp-client-disco-msg-worker-#635%client1%-#12127%client1%][IgniteTxManager] Transactions parameter 'txOwnerDumpRequestsAllowed' was changed from 'null' to 'true' [21:05:58] : [Step 4/5] [2021-11-19 21:05:58,584][INFO ][tcp-client-disco-msg-worker-#635%client1%-#12127%client1%][ClusterProcessor] hardcore_hertz [21:05:58] : [Step 4/5] [2021-11-19 21:05:58,584][INFO ][disco-notifier-worker-#12124%client1%][MvccProcessorImpl] Assigned mvcc coordinator [crd=MvccCoordinator [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], nodeId=003a0cc9-2754-4d39-b63e-fbb30d05a000, ver=1637345157192, local=false, initialized=false]] [21:05:58] : [Step 4/5] [2021-11-19 21:05:58,587][INFO ][sys-#12131%client1%][ClusterProcessor] Writing cluster ID and tag to metastorage on ready for write ClusterIdAndTag [id=31400863-ff27-4063-8faa-2fafe901f2b1, tag=hardcore_hertz] [21:05:58] : [Step 4/5] [2021-11-19 21:05:58,599][INFO ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%client1] To start Console Management & Monitoring run ignitevisorcmd.{sh|bat} [21:05:58] : [Step 4/5] [2021-11-19 21:05:58,600][INFO ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%client1] [21:05:58] : [Step 4/5] [21:05:58] : [Step 4/5] >>> +-------------------------------------------+ [21:05:58] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:05:58] : [Step 4/5] >>> +-------------------------------------------+ [21:05:58] : [Step 4/5] >>> OS name: Linux 4.15.0-151-generic amd64 [21:05:58] : [Step 4/5] >>> CPU(s): 24 [21:05:58] : [Step 4/5] >>> Heap: 2.0GB [21:05:58] : [Step 4/5] >>> VM name: 16724@c4dfe9a430b2 [21:05:58] : [Step 4/5] >>> Ignite instance name: client1 [21:05:58] : [Step 4/5] >>> Local node [ID=10CE8C9F-E4F8-4677-9026-4A4DE00EF001, order=3, clientMode=true] [21:05:58] : [Step 4/5] >>> Local node addresses: [127.0.0.1] [21:05:58] : [Step 4/5] >>> Local ports: TCP:10802 TCP:45152 [21:05:58] : [Step 4/5] [21:05:58] : [Step 4/5] [2021-11-19 21:05:58,601][INFO ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%client1] >>> Ignite cluster is in INACTIVE state (limited functionality available). Use control.(sh|bat) script or IgniteCluster.state(ClusterState.ACTIVE) to change the state. [21:05:58] : [Step 4/5] [2021-11-19 21:05:58,601][INFO ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][GridDiscoveryManager] Topology snapshot [ver=3, locNode=10ce8c9f, servers=2, clients=1, state=INACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=10ce8c9f-e4f8-4677-9026-4a4de00ef001, consistentId=client1, isClient=true, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=003a0cc9-2754-4d39-b63e-fbb30d05a000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=60efc20b-b98d-4d8a-a216-3e743b573006, consistentId=grid-6, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:05:58] : [Step 4/5] [2021-11-19 21:05:58,602][INFO ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][G] Node started : [stage="Configure system pool" (0 ms),stage="Start managers" (61 ms),stage="Configure binary metadata" (1 ms),stage="Start processors" (7 ms),stage="Start 'StanByClusterTestProvider' plugin" (0 ms),stage="Start 'PageMemory tracker plugin' plugin" (0 ms),stage="Start 'TestDistibutedConfigurationPlugin' plugin" (0 ms),stage="Start 'NodeValidationPluginProvider' plugin" (0 ms),stage="Init metastore" (1 ms),stage="Finish recovery" (0 ms),stage="Join topology" (36 ms),stage="Await transition" (2 ms),stage="Await exchange" (12 ms),stage="Total time" (120 ms)] [21:05:58] : [Step 4/5] [2021-11-19 21:05:58,603][INFO ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][root] Node started with the following configuration [id=10ce8c9f-e4f8-4677-9026-4a4de00ef001, marshaller=BinaryMarshaller [], discovery=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=5000, ackTimeout=5000, marsh=JdkMarshaller [clsFilter=org.apache.ignite.marshaller.MarshallerUtils$1@6571312a], reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], binaryCfg=null, lateAff=true] [21:05:58] : [Step 4/5] [2021-11-19 21:05:58,605][INFO ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][GridClusterStateProcessor] Sending activate cluster request with BaselineTopology BaselineTopology [id=0, branchingHash=-2475315496, branchingType='New BaselineTopology', baselineNodes=[grid-0, grid-6]] [21:05:58] : [Step 4/5] [2021-11-19 21:05:58,607][INFO ][disco-notifier-worker-#11910%grid-0%][GridClusterStateProcessor] Received activate cluster request with BaselineTopology[id=0] initiator node ID: 003a0cc9-2754-4d39-b63e-fbb30d05a000 [21:05:58] : [Step 4/5] [2021-11-19 21:05:58,608][INFO ][disco-notifier-worker-#11910%grid-0%][GridClusterStateProcessor] Started state transition: activate cluster [21:05:58] : [Step 4/5] [2021-11-19 21:05:58,609][INFO ][exchange-worker-#11915%grid-0%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], crd=true, evt=DISCOVERY_CUSTOM_EVT, evtNode=003a0cc9-2754-4d39-b63e-fbb30d05a000, customEvt=ChangeGlobalStateMessage [id=74e3d593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqId=9188e606-8a6e-4022-bcc2-96eade1ca7df, initiatingNodeId=003a0cc9-2754-4d39-b63e-fbb30d05a000, state=ACTIVE, baselineTopology=BaselineTopology [id=0, branchingHash=-2475315496, branchingType='New BaselineTopology', baselineNodes=[grid-0, grid-6]], forceChangeBaselineTopology=false, timestamp=1637345158605, forceDeactivation=true], allowMerge=false, exchangeFreeSwitch=false] [21:05:58] : [Step 4/5] [2021-11-19 21:05:58,610][INFO ][exchange-worker-#11915%grid-0%][GridDhtPartitionsExchangeFuture] Start activation process [nodeId=003a0cc9-2754-4d39-b63e-fbb30d05a000, client=false, topVer=AffinityTopologyVersion [topVer=3, minorTopVer=1]]. New state: ACTIVE [21:05:58] : [Step 4/5] [2021-11-19 21:05:58,609][INFO ][disco-notifier-worker-#12029%grid-6%][GridClusterStateProcessor] Received activate cluster request with BaselineTopology[id=0] initiator node ID: 003a0cc9-2754-4d39-b63e-fbb30d05a000 [21:05:58] : [Step 4/5] [2021-11-19 21:05:58,609][INFO ][disco-notifier-worker-#12124%client1%][GridClusterStateProcessor] Received activate cluster request with BaselineTopology[id=0] initiator node ID: 003a0cc9-2754-4d39-b63e-fbb30d05a000 [21:05:58] : [Step 4/5] [2021-11-19 21:05:58,612][INFO ][disco-notifier-worker-#12029%grid-6%][GridClusterStateProcessor] Started state transition: activate cluster [21:05:58] : [Step 4/5] [2021-11-19 21:05:58,611][INFO ][exchange-worker-#11915%grid-0%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0 [21:05:58] : [Step 4/5] [2021-11-19 21:05:58,612][INFO ][disco-notifier-worker-#12124%client1%][GridClusterStateProcessor] Started state transition: activate cluster [21:05:58] : [Step 4/5] [2021-11-19 21:05:58,613][INFO ][exchange-worker-#12038%grid-6%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], crd=false, evt=DISCOVERY_CUSTOM_EVT, evtNode=003a0cc9-2754-4d39-b63e-fbb30d05a000, customEvt=ChangeGlobalStateMessage [id=74e3d593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqId=9188e606-8a6e-4022-bcc2-96eade1ca7df, initiatingNodeId=003a0cc9-2754-4d39-b63e-fbb30d05a000, state=ACTIVE, baselineTopology=BaselineTopology [id=0, branchingHash=-2475315496, branchingType='New BaselineTopology', baselineNodes=[grid-0, grid-6]], forceChangeBaselineTopology=false, timestamp=1637345158605, forceDeactivation=true], allowMerge=false, exchangeFreeSwitch=false] [21:05:58] : [Step 4/5] [2021-11-19 21:05:58,614][INFO ][exchange-worker-#12133%client1%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], crd=false, evt=DISCOVERY_CUSTOM_EVT, evtNode=003a0cc9-2754-4d39-b63e-fbb30d05a000, customEvt=ChangeGlobalStateMessage [id=74e3d593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqId=9188e606-8a6e-4022-bcc2-96eade1ca7df, initiatingNodeId=003a0cc9-2754-4d39-b63e-fbb30d05a000, state=ACTIVE, baselineTopology=BaselineTopology [id=0, branchingHash=-2475315496, branchingType='New BaselineTopology', baselineNodes=[grid-0, grid-6]], forceChangeBaselineTopology=false, timestamp=1637345158605, forceDeactivation=true], allowMerge=false, exchangeFreeSwitch=false] [21:05:58] : [Step 4/5] [2021-11-19 21:05:58,615][INFO ][exchange-worker-#11915%grid-0%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000000.wal, offset=13104, ver=2] [21:05:58] : [Step 4/5] [2021-11-19 21:05:58,615][INFO ][exchange-worker-#12038%grid-6%][GridDhtPartitionsExchangeFuture] Start activation process [nodeId=60efc20b-b98d-4d8a-a216-3e743b573006, client=false, topVer=AffinityTopologyVersion [topVer=3, minorTopVer=1]]. New state: ACTIVE [21:05:58] : [Step 4/5] [2021-11-19 21:05:58,616][INFO ][exchange-worker-#12133%client1%][GridDhtPartitionsExchangeFuture] Start activation process [nodeId=10ce8c9f-e4f8-4677-9026-4a4de00ef001, client=true, topVer=AffinityTopologyVersion [topVer=3, minorTopVer=1]]. New state: ACTIVE [21:05:58] : [Step 4/5] [2021-11-19 21:05:58,618][INFO ][exchange-worker-#12038%grid-6%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_6 [21:05:58] : [Step 4/5] [2021-11-19 21:05:58,619][INFO ][exchange-worker-#11915%grid-0%][GridClusterStateProcessor] Writing BaselineTopology[id=0] [21:05:58] : [Step 4/5] [2021-11-19 21:05:58,620][INFO ][exchange-worker-#12133%client1%][IgniteCacheDatabaseSharedManager] Data Regions Started: 4 [21:05:58] : [Step 4/5] [2021-11-19 21:05:58,621][INFO ][exchange-worker-#12133%client1%][IgniteCacheDatabaseSharedManager] ^-- sysMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:05:58] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB, allocTotal=0MB] [21:05:58] : [Step 4/5] ^-- default region [type=default, persistence=true, lazyAlloc=true, [21:05:58] : [Step 4/5] ... initCfg=10MB, maxCfg=10MB, usedRam=0MB, freeRam=100%, allocRam=0MB, allocTotal=0MB] [21:05:58] : [Step 4/5] ^-- TxLog region [type=internal, persistence=true, lazyAlloc=false, [21:05:58] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB, allocTotal=0MB] [21:05:58] : [Step 4/5] ^-- volatileDsMemPlc region [type=user, persistence=false, lazyAlloc=true, [21:05:58] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB] [21:05:58] : [Step 4/5] ^-- Ignite persistence [used=0MB] [21:05:58] : [Step 4/5] [21:05:58] : [Step 4/5] [2021-11-19 21:05:58,621][INFO ][exchange-worker-#12038%grid-6%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_6/0000000000000000.wal, offset=13104, ver=2] [21:05:58] : [Step 4/5] [2021-11-19 21:05:58,622][INFO ][exchange-worker-#11915%grid-0%][GridCacheDatabaseSharedManager] Finish recovery performed in 9 ms. [21:05:58] : [Step 4/5] [2021-11-19 21:05:58,622][INFO ][exchange-worker-#12133%client1%][msg] Components activation performed in 3 ms. [21:05:58] : [Step 4/5] [2021-11-19 21:05:58,625][INFO ][exchange-worker-#11915%grid-0%][msg] Components activation performed in 14 ms. [21:05:58] : [Step 4/5] [2021-11-19 21:05:58,626][INFO ][exchange-worker-#12038%grid-6%][GridClusterStateProcessor] Writing BaselineTopology[id=0] [21:05:58] : [Step 4/5] [2021-11-19 21:05:58,627][INFO ][exchange-worker-#11915%grid-0%][GridCacheProcessor] Finished recovery for cache [cache=ignite-sys-cache, grp=ignite-sys-cache, startVer=AffinityTopologyVersion [topVer=3, minorTopVer=1]] [21:05:58] : [Step 4/5] [2021-11-19 21:05:58,627][INFO ][sys-#11903%grid-0%][GridCacheProcessor] Finished recovery for cache [cache=encrypted, grp=encrypted, startVer=AffinityTopologyVersion [topVer=3, minorTopVer=1]] [21:05:58] : [Step 4/5] [2021-11-19 21:05:58,630][INFO ][exchange-worker-#12038%grid-6%][GridCacheDatabaseSharedManager] Finish recovery performed in 10 ms. [21:05:58] : [Step 4/5] [2021-11-19 21:05:58,631][INFO ][exchange-worker-#12038%grid-6%][msg] Components activation performed in 13 ms. [21:05:58] : [Step 4/5] [2021-11-19 21:05:58,631][INFO ][exchange-worker-#12133%client1%][GridCacheProcessor] Started cache [name=ignite-sys-cache, id=-2100569601, dataRegionName=sysMemPlc, mode=REPLICATED, atomicity=TRANSACTIONAL, backups=2147483647, mvcc=false] [21:05:58] : [Step 4/5] [2021-11-19 21:05:58,631][INFO ][sys-#12145%client1%][GridCacheProcessor] Started cache [name=encrypted, id=1613773252, dataRegionName=default, mode=PARTITIONED, atomicity=TRANSACTIONAL, backups=0, mvcc=false] [21:05:58]W: [org.apache.ignite:ignite-core] [2021-11-19 21:05:58,632][WARN ][exchange-worker-#11915%grid-0%][CacheAffinitySharedManager] Cache group 'encrypted' brings high overhead for its metainformation in data region 'default'. Metainformation required for its partitions (525 partitions, 4096 bytes per partition, 2 MBs total) will consume more than 15% of data region memory (10 MBs). It may lead to critical errors on the node and cluster instability. Please reduce number of partitions, add more memory to the data region or add more server nodes for this cache group. [21:05:58] : [Step 4/5] [2021-11-19 21:05:58,633][INFO ][exchange-worker-#12038%grid-6%][GridCacheProcessor] Finished recovery for cache [cache=ignite-sys-cache, grp=ignite-sys-cache, startVer=AffinityTopologyVersion [topVer=3, minorTopVer=1]] [21:05:58] : [Step 4/5] [2021-11-19 21:05:58,633][INFO ][sys-#12018%grid-6%][GridCacheProcessor] Finished recovery for cache [cache=encrypted, grp=encrypted, startVer=AffinityTopologyVersion [topVer=3, minorTopVer=1]] [21:05:58] : [Step 4/5] [2021-11-19 21:05:58,633][INFO ][exchange-worker-#11915%grid-0%][GridDhtPartitionsExchangeFuture] Successfully activated caches [nodeId=003a0cc9-2754-4d39-b63e-fbb30d05a000, client=false, topVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], newState=ACTIVE] [21:05:58] : [Step 4/5] [2021-11-19 21:05:58,634][INFO ][exchange-worker-#12133%client1%][GridDhtPartitionsExchangeFuture] Successfully activated caches [nodeId=10ce8c9f-e4f8-4677-9026-4a4de00ef001, client=true, topVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], newState=ACTIVE] [21:05:58]W: [org.apache.ignite:ignite-core] [2021-11-19 21:05:58,635][WARN ][exchange-worker-#11915%grid-0%][CacheAffinitySharedManager] Cache group 'encrypted' brings high overhead for its metainformation in data region 'default'. Metainformation required for its partitions (525 partitions, 4096 bytes per partition, 2 MBs total) will consume more than 15% of data region memory (10 MBs). It may lead to critical errors on the node and cluster instability. Please reduce number of partitions, add more memory to the data region or add more server nodes for this cache group. [21:05:58] : [Step 4/5] [2021-11-19 21:05:58,636][INFO ][exchange-worker-#11915%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:05:58]W: [org.apache.ignite:ignite-core] [2021-11-19 21:05:58,636][WARN ][exchange-worker-#12038%grid-6%][CacheAffinitySharedManager] Cache group 'encrypted' brings high overhead for its metainformation in data region 'default'. Metainformation required for its partitions (499 partitions, 4096 bytes per partition, 1 MBs total) will consume more than 15% of data region memory (10 MBs). It may lead to critical errors on the node and cluster instability. Please reduce number of partitions, add more memory to the data region or add more server nodes for this cache group. [21:05:58] : [Step 4/5] [2021-11-19 21:05:58,637][INFO ][exchange-worker-#12038%grid-6%][GridDhtPartitionsExchangeFuture] Successfully activated caches [nodeId=60efc20b-b98d-4d8a-a216-3e743b573006, client=false, topVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], newState=ACTIVE] [21:05:58] : [Step 4/5] [2021-11-19 21:05:58,637][INFO ][grid-nio-worker-tcp-comm-0-#11853%TcpCommunicationSpi%][TcpCommunicationSpi] Accepted incoming communication connection [locAddr=/127.0.0.1:45150, rmtAddr=/127.0.0.1:60186] [21:05:58]W: [org.apache.ignite:ignite-core] [2021-11-19 21:05:58,638][WARN ][exchange-worker-#12038%grid-6%][CacheAffinitySharedManager] Cache group 'encrypted' brings high overhead for its metainformation in data region 'default'. Metainformation required for its partitions (499 partitions, 4096 bytes per partition, 1 MBs total) will consume more than 15% of data region memory (10 MBs). It may lead to critical errors on the node and cluster instability. Please reduce number of partitions, add more memory to the data region or add more server nodes for this cache group. [21:05:58] : [Step 4/5] [2021-11-19 21:05:58,640][INFO ][grid-nio-worker-tcp-comm-0-#12095%TcpCommunicationSpi%][TcpCommunicationSpi] Established outgoing communication connection [locAddr=/127.0.0.1:60186, rmtAddr=/127.0.0.1:45150] [21:05:58] : [Step 4/5] [2021-11-19 21:05:58,641][INFO ][exchange-worker-#12038%grid-6%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:05:58] : [Step 4/5] [2021-11-19 21:05:58,642][INFO ][exchange-worker-#12133%client1%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], crd=false] [21:05:58] : [Step 4/5] [2021-11-19 21:05:58,672][INFO ][exchange-worker-#11915%grid-0%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], crd=true] [21:05:58] : [Step 4/5] [2021-11-19 21:05:58,676][INFO ][db-checkpoint-thread-#12152%grid-0%][Checkpointer] Checkpoint started [checkpointId=4191c105-5cfb-4597-b725-6efae115edc8, startPtr=WALPointer [idx=0, fileOff=175001, len=11944], checkpointBeforeLockTime=2ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=4ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=0ms, pages=23, reason='node started'] [21:05:58] : [Step 4/5] [2021-11-19 21:05:58,688][INFO ][grid-nio-worker-tcp-comm-1-#11854%TcpCommunicationSpi%][TcpCommunicationSpi] Accepted incoming communication connection [locAddr=/127.0.0.1:45150, rmtAddr=/127.0.0.1:60188] [21:05:58] : [Step 4/5] [2021-11-19 21:05:58,690][INFO ][grid-nio-worker-tcp-comm-0-#11972%TcpCommunicationSpi%][TcpCommunicationSpi] Established outgoing communication connection [locAddr=/127.0.0.1:60188, rmtAddr=/127.0.0.1:45150] [21:05:58] : [Step 4/5] [2021-11-19 21:05:58,690][INFO ][exchange-worker-#12038%grid-6%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], crd=false] [21:05:58] : [Step 4/5] [2021-11-19 21:05:58,691][INFO ][sys-#11888%grid-0%][GridDhtPartitionsExchangeFuture] Coordinator received single message [ver=AffinityTopologyVersion [topVer=3, minorTopVer=1], node=60efc20b-b98d-4d8a-a216-3e743b573006, allReceived=true] [21:05:58] : [Step 4/5] [2021-11-19 21:05:58,691][INFO ][sys-#11888%grid-0%][GridDhtPartitionsExchangeFuture] finishExchangeOnCoordinator [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=1]] [21:05:58] : [Step 4/5] [2021-11-19 21:05:58,702][INFO ][sys-#11888%grid-0%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], err=null, rebalanced=true, wasRebalanced=false] [21:05:58] : [Step 4/5] [2021-11-19 21:05:58,702][INFO ][disco-notifier-worker-#11910%grid-0%][GridClusterStateProcessor] Received state change finish message: ACTIVE [21:05:58] : [Step 4/5] [2021-11-19 21:05:58,705][INFO ][disco-notifier-worker-#12029%grid-6%][GridClusterStateProcessor] Received state change finish message: ACTIVE [21:05:58] : [Step 4/5] [2021-11-19 21:05:58,707][INFO ][disco-notifier-worker-#12029%grid-6%][GridClusterStateProcessor] Cluster state was changed from INACTIVE to ACTIVE [21:05:58] : [Step 4/5] [2021-11-19 21:05:58,704][INFO ][disco-notifier-worker-#12124%client1%][GridClusterStateProcessor] Received state change finish message: ACTIVE [21:05:58] : [Step 4/5] [2021-11-19 21:05:58,707][INFO ][disco-notifier-worker-#12124%client1%][GridClusterStateProcessor] Cluster state was changed from INACTIVE to ACTIVE [21:05:58] : [Step 4/5] [2021-11-19 21:05:58,704][INFO ][sys-#12027%grid-6%][GridDhtPartitionsExchangeFuture] Received full message, will finish exchange [node=003a0cc9-2754-4d39-b63e-fbb30d05a000, resVer=AffinityTopologyVersion [topVer=3, minorTopVer=1]] [21:05:58] : [Step 4/5] [2021-11-19 21:05:58,707][INFO ][db-checkpoint-thread-#12157%grid-6%][Checkpointer] Checkpoint started [checkpointId=e056bebc-6b98-4777-baec-84c2aebde189, startPtr=WALPointer [idx=0, fileOff=170893, len=11450], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=1ms, checkpointLockHoldTime=7ms, walCpRecordFsyncDuration=12ms, writeCheckpointEntryDuration=10ms, splitAndSortCpPagesDuration=1ms, pages=23, reason='node started'] [21:05:58] : [Step 4/5] [2021-11-19 21:05:58,706][INFO ][disco-notifier-worker-#11910%grid-0%][GridClusterStateProcessor] Cluster state was changed from INACTIVE to ACTIVE [21:05:58] : [Step 4/5] [2021-11-19 21:05:58,712][INFO ][sys-#12025%grid-6%][GridCachePartitionExchangeManager] Delay process full message without exchange id (there is exchange in progress) [nodeId=003a0cc9-2754-4d39-b63e-fbb30d05a000] [21:05:58] : [Step 4/5] [2021-11-19 21:05:58,712][INFO ][sys-#11888%grid-0%][GridCacheProcessor] Finish proxy initialization, cacheName=ignite-sys-cache, localNodeId=003a0cc9-2754-4d39-b63e-fbb30d05a000 [21:05:58] : [Step 4/5] [2021-11-19 21:05:58,712][INFO ][sys-#12167%client1%][GridCachePartitionExchangeManager] Delay process full message without exchange id (there is exchange in progress) [nodeId=003a0cc9-2754-4d39-b63e-fbb30d05a000] [21:05:58] : [Step 4/5] [2021-11-19 21:05:58,715][INFO ][sys-#12027%grid-6%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], err=null, rebalanced=true, wasRebalanced=false] [21:05:58] : [Step 4/5] [2021-11-19 21:05:58,715][INFO ][sys-#11888%grid-0%][GridCacheProcessor] Finish proxy initialization, cacheName=encrypted, localNodeId=003a0cc9-2754-4d39-b63e-fbb30d05a000 [21:05:58] : [Step 4/5] [2021-11-19 21:05:58,716][INFO ][db-checkpoint-thread-#12152%grid-0%][Checkpointer] Checkpoint finished [cpId=4191c105-5cfb-4597-b725-6efae115edc8, pages=23, markPos=WALPointer [idx=0, fileOff=175001, len=11944], walSegmentsCovered=[], markDuration=7ms, pagesWrite=9ms, fsync=30ms, total=48ms] [21:05:58] : [Step 4/5] [2021-11-19 21:05:58,719][INFO ][sys-#11888%grid-0%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=003a0cc9-2754-4d39-b63e-fbb30d05a000, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=003a0cc9-2754-4d39-b63e-fbb30d05a000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345158706, loc=true, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=3, minorTopVer=1]] [21:05:58] : [Step 4/5] [2021-11-19 21:05:58,719][INFO ][sys-#11891%grid-0%][DistributedBaselineConfiguration] Baseline auto-adjust is 'disabled' with timeout='300000' ms [21:05:58] : [Step 4/5] [2021-11-19 21:05:58,722][INFO ][sys-#11891%grid-0%][GridClusterStateProcessor] Successfully performed final activation steps [nodeId=003a0cc9-2754-4d39-b63e-fbb30d05a000, client=false, topVer=AffinityTopologyVersion [topVer=3, minorTopVer=1]] [21:05:58] : [Step 4/5] [2021-11-19 21:05:58,721][INFO ][sys-#12027%grid-6%][GridCacheProcessor] Finish proxy initialization, cacheName=ignite-sys-cache, localNodeId=60efc20b-b98d-4d8a-a216-3e743b573006 [21:05:58] : [Step 4/5] [2021-11-19 21:05:58,721][INFO ][sys-#11888%grid-0%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (1 ms), stage="Update caches registry" (15 ms), stage="Start caches" (3 ms), stage="Affinity initialization on cache group start" (3 ms), stage="Determine exchange type" (2 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Restore partition states" (0 ms), stage="After states restored callback" (34 ms), stage="WAL history reservation" (0 ms), stage="Waiting for all single messages" (19 ms), stage="Affinity recalculation (crd)" (0 ms), stage="Collect update counters and create affinity messages" (0 ms), stage="Assign partitions states" (2 ms), stage="Validate partitions states" (0 ms), stage="Ideal affinity diff calculation (enforced)" (2 ms), stage="Apply update counters" (0 ms), stage="Full message preparing" (3 ms), stage="Full message sending" (0 ms), stage="State finish message sending" (0 ms), stage="Detect lost partitions" (6 ms), stage="Exchange done" (12 ms), stage="Total time" (102 ms), Discovery lag=3 ms, Latest started node id=60efc20b-b98d-4d8a-a216-3e743b573006] [21:05:58] : [Step 4/5] [2021-11-19 21:05:58,719][INFO ][exchange-worker-#11915%grid-0%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=3, minorTopVer=1], force=false, evt=DISCOVERY_CUSTOM_EVT, node=003a0cc9-2754-4d39-b63e-fbb30d05a000] [21:05:58] : [Step 4/5] [2021-11-19 21:05:58,725][INFO ][sys-#11888%grid-0%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], stage="Affinity initialization on cache group start [grp=encrypted]" (2 ms) (parent=Affinity initialization on cache group start), stage="Affinity initialization on cache group start [grp=ignite-sys-cache]" (0 ms) (parent=Affinity initialization on cache group start), stage="Affinity centralized initialization (crd) [grp=ignite-sys-cache, crd=true]" (1 ms) (parent=Determine exchange type), stage="Affinity centralized initialization (crd) [grp=encrypted, crd=true]" (0 ms) (parent=Determine exchange type), stage="Restore partition states [grp=ignite-sys-cache]" (0 ms) (parent=Restore partition states), stage="Restore partition states [grp=encrypted]" (0 ms) (parent=Restore partition states), stage="Affinity recalculation (partitions availability) [grp=encrypted]" (2 ms) (parent=Ideal affinity diff calculation (enforced)), stage="Affinity recalculation (partitions availability) [grp=ignite-sys-cache]" (0 ms) (parent=Ideal affinity diff calculation (enforced))] [21:05:58] : [Step 4/5] [2021-11-19 21:05:58,722][INFO ][sys-#12027%grid-6%][GridCacheProcessor] Finish proxy initialization, cacheName=encrypted, localNodeId=60efc20b-b98d-4d8a-a216-3e743b573006 [21:05:58] : [Step 4/5] [2021-11-19 21:05:58,729][INFO ][sys-#12173%client1%][GridDhtPartitionsExchangeFuture] Received full message, will finish exchange [node=003a0cc9-2754-4d39-b63e-fbb30d05a000, resVer=AffinityTopologyVersion [topVer=3, minorTopVer=1]] [21:05:58] : [Step 4/5] [2021-11-19 21:05:58,732][INFO ][sys-#12015%grid-6%][DistributedBaselineConfiguration] Baseline auto-adjust is 'disabled' with timeout='300000' ms [21:05:58] : [Step 4/5] [2021-11-19 21:05:58,732][INFO ][sys-#12015%grid-6%][GridClusterStateProcessor] Successfully performed final activation steps [nodeId=60efc20b-b98d-4d8a-a216-3e743b573006, client=false, topVer=AffinityTopologyVersion [topVer=3, minorTopVer=1]] [21:05:58] : [Step 4/5] [2021-11-19 21:05:58,733][INFO ][sys-#12027%grid-6%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=60efc20b-b98d-4d8a-a216-3e743b573006, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=003a0cc9-2754-4d39-b63e-fbb30d05a000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345158433, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=3, minorTopVer=1]] [21:05:58] : [Step 4/5] [2021-11-19 21:05:58,733][INFO ][exchange-worker-#12038%grid-6%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=3, minorTopVer=1], force=false, evt=DISCOVERY_CUSTOM_EVT, node=003a0cc9-2754-4d39-b63e-fbb30d05a000] [21:05:58] : [Step 4/5] [2021-11-19 21:05:58,734][INFO ][sys-#12027%grid-6%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (2 ms), stage="Update caches registry" (17 ms), stage="Start caches" (2 ms), stage="Affinity initialization on cache group start" (3 ms), stage="Determine exchange type" (3 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (1 ms), stage="Restore partition states" (0 ms), stage="After states restored callback" (40 ms), stage="WAL history reservation" (0 ms), stage="Waiting for Full message" (20 ms), stage="Affinity recalculation" (7 ms), stage="Full map updating" (3 ms), stage="Detect lost partitions" (4 ms), stage="Exchange done" (14 ms), stage="Total time" (116 ms)] [21:05:58] : [Step 4/5] [2021-11-19 21:05:58,738][INFO ][sys-#12173%client1%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], err=null, rebalanced=true, wasRebalanced=false] [21:05:58] : [Step 4/5] [2021-11-19 21:05:58,739][INFO ][sys-#12027%grid-6%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], stage="Affinity initialization on cache group start [grp=encrypted]" (1 ms) (parent=Affinity initialization on cache group start), stage="Affinity initialization on cache group start [grp=ignite-sys-cache]" (0 ms) (parent=Affinity initialization on cache group start), stage="Affinity centralized initialization (crd) [grp=ignite-sys-cache, crd=false]" (0 ms) (parent=Determine exchange type), stage="Affinity centralized initialization (crd) [grp=encrypted, crd=false]" (0 ms) (parent=Determine exchange type), stage="Restore partition states [grp=ignite-sys-cache]" (0 ms) (parent=Restore partition states), stage="Restore partition states [grp=encrypted]" (0 ms) (parent=Restore partition states), stage="Affinity applying from full message [grp=encrypted]" (7 ms) (parent=Affinity recalculation), stage="Affinity applying from full message [grp=ignite-sys-cache]" (4 ms) (parent=Affinity recalculation)] [21:05:58] : [Step 4/5] [2021-11-19 21:05:58,872][INFO ][sys-#12173%client1%][GridCacheProcessor] Finish proxy initialization, cacheName=ignite-sys-cache, localNodeId=10ce8c9f-e4f8-4677-9026-4a4de00ef001 [21:05:58] : [Step 4/5] [2021-11-19 21:05:58,873][INFO ][sys-#12173%client1%][GridCacheProcessor] Finish proxy initialization, cacheName=encrypted, localNodeId=10ce8c9f-e4f8-4677-9026-4a4de00ef001 [21:05:58] : [Step 4/5] [2021-11-19 21:05:58,874][INFO ][sys-#12184%client1%][DistributedBaselineConfiguration] Baseline auto-adjust is 'disabled' with timeout='300000' ms [21:05:58] : [Step 4/5] [2021-11-19 21:05:58,876][INFO ][sys-#12184%client1%][GridClusterStateProcessor] Successfully performed final activation steps [nodeId=10ce8c9f-e4f8-4677-9026-4a4de00ef001, client=true, topVer=AffinityTopologyVersion [topVer=3, minorTopVer=1]] [21:05:58] : [Step 4/5] [2021-11-19 21:05:58,876][INFO ][exchange-worker-#12133%client1%][GridCachePartitionExchangeManager] AffinityTopologyVersion [topVer=3, minorTopVer=1], evt=DISCOVERY_CUSTOM_EVT, evtNode=003a0cc9-2754-4d39-b63e-fbb30d05a000, client=true] [21:05:58] : [Step 4/5] [2021-11-19 21:05:58,877][INFO ][sys-#12173%client1%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=10ce8c9f-e4f8-4677-9026-4a4de00ef001, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=003a0cc9-2754-4d39-b63e-fbb30d05a000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345158564, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=3, minorTopVer=1]] [21:05:58] : [Step 4/5] [2021-11-19 21:05:58,878][INFO ][sys-#12173%client1%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (2 ms), stage="Update caches registry" (9 ms), stage="Start caches" (6 ms), stage="Affinity initialization on cache group start" (2 ms), stage="Determine exchange type" (1 ms), stage="Waiting for Full message" (93 ms), stage="Affinity recalculation" (3 ms), stage="Full map updating" (5 ms), stage="Detect lost partitions" (133 ms), stage="Exchange done" (6 ms), stage="Total time" (260 ms)] [21:05:58]W: [org.apache.ignite:ignite-core] [2021-11-19 21:05:58,880][WARN ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][G] Ignite work directory is not provided, automatically resolved to: /opt/buildagent/work/7bc1c54bc719b67c/work [21:05:58] : [Step 4/5] [2021-11-19 21:05:58,879][INFO ][sys-#12173%client1%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], stage="Affinity initialization on cache group start [grp=encrypted]" (1 ms) (parent=Affinity initialization on cache group start), stage="Affinity initialization on cache group start [grp=ignite-sys-cache]" (0 ms) (parent=Affinity initialization on cache group start), stage="Affinity centralized initialization (crd) [grp=ignite-sys-cache, crd=false]" (1 ms) (parent=Determine exchange type), stage="Affinity centralized initialization (crd) [grp=encrypted, crd=false]" (1 ms) (parent=Determine exchange type), stage="Affinity applying from full message [grp=ignite-sys-cache]" (3 ms) (parent=Affinity recalculation), stage="Affinity applying from full message [grp=encrypted]" (3 ms) (parent=Affinity recalculation)] [21:05:58] : [Step 4/5] [2021-11-19 21:05:58,882][INFO ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%client] [21:05:58] : [Step 4/5] [21:05:58] : [Step 4/5] >>> __________ ________________ [21:05:58] : [Step 4/5] >>> / _/ ___/ |/ / _/_ __/ __/ [21:05:58] : [Step 4/5] >>> _/ // (7 7 // / / / / _/ [21:05:58] : [Step 4/5] >>> /___/\___/_/|_/___/ /_/ /___/ [21:05:58] : [Step 4/5] >>> [21:05:58] : [Step 4/5] >>> ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:05:58] : [Step 4/5] >>> 2021 Copyright(C) Apache Software Foundation [21:05:58] : [Step 4/5] >>> [21:05:58] : [Step 4/5] >>> Ignite documentation: http://ignite.apache.org [21:05:58] : [Step 4/5] [21:05:58] : [Step 4/5] [2021-11-19 21:05:58,882][INFO ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%client] Config URL: n/a [21:05:58] : [Step 4/5] [2021-11-19 21:05:58,883][INFO ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%client] IgniteConfiguration [igniteInstanceName=client, pubPoolSize=24, svcPoolSize=24, callbackPoolSize=24, stripedPoolSize=24, sysPoolSize=24, mgmtPoolSize=4, dataStreamerPoolSize=24, utilityCachePoolSize=24, utilityCacheKeepAliveTime=60000, p2pPoolSize=2, qryPoolSize=24, buildIdxPoolSize=4, igniteHome=/opt/buildagent/work/7bc1c54bc719b67c, igniteWorkDir=/opt/buildagent/work/7bc1c54bc719b67c/work, mbeanSrv=com.sun.jmx.mbeanserver.JmxMBeanServer@6fe85038, nodeId=ab614ee4-4a24-4ad9-adf7-87a3db16b0bc, marsh=BinaryMarshaller [], marshLocJobs=false, daemon=false, p2pEnabled=true, netTimeout=10000, netCompressionLevel=1, sndRetryDelay=1000, sndRetryCnt=3, metricsHistSize=10000, metricsUpdateFreq=1000, metricsExpTime=9223372036854775807, discoSpi=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=0, ackTimeout=0, marsh=null, reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], segPlc=STOP, segResolveAttempts=2, waitForSegOnStart=true, allResolversPassReq=true, segChkFreq=10000, commSpi=TcpCommunicationSpi [connectGate=org.apache.ignite.spi.communication.tcp.internal.ConnectGateway@7943550a, ctxInitLatch=java.util.concurrent.CountDownLatch@60a20d00[Count = 1], stopping=false, clientPool=null, nioSrvWrapper=null, stateProvider=null], evtSpi=MemoryEventStorageSpi [expireAgeMs=9223372036854775807, expireCnt=10000, filter=null], colSpi=NoopCollisionSpi [], deploySpi=LocalDeploymentSpi [], indexingSpi=org.apache.ignite.spi.indexing.noop.NoopIndexingSpi@7cde17e7, addrRslvr=null, encryptionSpi=org.apache.ignite.spi.encryption.noop.NoopEncryptionSpi@464366b9, tracingSpi=org.apache.ignite.spi.tracing.NoopTracingSpi@48b594f7, clientMode=true, rebalanceThreadPoolSize=4, rebalanceTimeout=10000, rebalanceBatchesPrefetchCnt=3, rebalanceThrottle=0, rebalanceBatchSize=524288, txCfg=TransactionConfiguration [txSerEnabled=false, dfltIsolation=REPEATABLE_READ, dfltConcurrency=PESSIMISTIC, dfltTxTimeout=0, txTimeoutOnPartitionMapExchange=0, deadlockTimeout=10000, pessimisticTxLogSize=0, pessimisticTxLogLinger=10000, tmLookupClsName=null, txManagerFactory=null, useJtaSync=false], cacheSanityCheckEnabled=true, discoStartupDelay=60000, deployMode=SHARED, p2pMissedCacheSize=100, locHost=127.0.0.1, timeSrvPortBase=31100, timeSrvPortRange=100, failureDetectionTimeout=10000, sysWorkerBlockedTimeout=null, clientFailureDetectionTimeout=10000, metricsLogFreq=0, connectorCfg=null, odbcCfg=null, warmupClos=null, atomicCfg=AtomicConfiguration [seqReserveSize=1000, cacheMode=PARTITIONED, backups=1, aff=null, grpName=null], classLdr=null, sslCtxFactory=null, platformCfg=null, binaryCfg=null, memCfg=null, pstCfg=null, dsCfg=DataStorageConfiguration [sysRegionInitSize=41943040, sysRegionMaxSize=104857600, pageSize=4096, concLvl=0, dfltDataRegConf=DataRegionConfiguration [name=default, maxSize=10485760, initSize=268435456, swapPath=null, pageEvictionMode=DISABLED, pageReplacementMode=CLOCK, evictionThreshold=0.9, emptyPagesPoolSize=100, metricsEnabled=false, metricsSubIntervalCount=5, metricsRateTimeInterval=60000, persistenceEnabled=true, checkpointPageBufSize=0, lazyMemoryAllocation=true, warmUpCfg=null], dataRegions=null, storagePath=null, checkpointFreq=180000, lockWaitTime=10000, checkpointThreads=4, checkpointWriteOrder=SEQUENTIAL, walHistSize=20, maxWalArchiveSize=1073741824, walSegments=10, walSegmentSize=67108864, walPath=db/wal, walArchivePath=db/wal/archive, cdcWalPath=db/wal/cdc, cdcEnabled=false, metricsEnabled=false, walMode=FSYNC, walTlbSize=131072, walBuffSize=0, walFlushFreq=2000, walFsyncDelay=1000, walRecordIterBuffSize=67108864, alwaysWriteFullPages=false, fileIOFactory=org.apache.ignite.internal.processors.cache.persistence.file.AsyncFileIOFactory@36cb9a17, metricsSubIntervalCnt=5, metricsRateTimeInterval=60000, walAutoArchiveAfterInactivity=-1, walForceArchiveTimeout=-1, writeThrottlingEnabled=false, walCompactionEnabled=false, walCompactionLevel=1, checkpointReadLockTimeout=null, walPageCompression=DISABLED, walPageCompressionLevel=null, dfltWarmUpCfg=null, encCfg=org.apache.ignite.configuration.EncryptionConfiguration@6439d8a3, defragmentationThreadPoolSize=4, minWalArchiveSize=-1], snapshotPath=snapshots, activeOnStart=true, activeOnStartPropSetFlag=false, autoActivation=true, autoActivationPropSetFlag=false, clusterStateOnStart=null, sqlConnCfg=null, cliConnCfg=ClientConnectorConfiguration [host=null, port=10800, portRange=100, sockSndBufSize=0, sockRcvBufSize=0, tcpNoDelay=true, maxOpenCursorsPerConn=128, threadPoolSize=24, selectorCnt=12, idleTimeout=0, handshakeTimeout=10000, jdbcEnabled=true, odbcEnabled=true, thinCliEnabled=true, sslEnabled=false, useIgniteSslCtxFactory=true, sslClientAuth=false, sslCtxFactory=null, thinCliCfg=ThinClientConfiguration [maxActiveTxPerConn=100, maxActiveComputeTasksPerConn=0]], mvccVacuumThreadCnt=2, mvccVacuumFreq=5000, authEnabled=false, failureHnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]], commFailureRslvr=null, sqlCfg=SqlConfiguration [longQryWarnTimeout=3000, dfltQryTimeout=0, sqlQryHistSize=1000, validationEnabled=false], asyncContinuationExecutor=null] [21:05:58] : [Step 4/5] [2021-11-19 21:05:58,890][INFO ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%client] Daemon mode: off [21:05:58] : [Step 4/5] [2021-11-19 21:05:58,891][INFO ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%client] OS: Linux 4.15.0-151-generic amd64 [21:05:58] : [Step 4/5] [2021-11-19 21:05:58,891][INFO ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%client] OS user: teamcity [21:05:58] : [Step 4/5] [2021-11-19 21:05:58,891][INFO ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%client] PID: 16724 [21:05:58] : [Step 4/5] [2021-11-19 21:05:58,891][INFO ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%client] Language runtime: Java Platform API Specification ver. 1.8 [21:05:58] : [Step 4/5] [2021-11-19 21:05:58,892][INFO ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%client] VM information: Java(TM) SE Runtime Environment 1.8.0_261-b12 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 25.261-b12 [21:05:59] : [Step 4/5] [2021-11-19 21:05:58,892][INFO ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%client] VM total memory: 1.8GB [21:05:59] : [Step 4/5] [2021-11-19 21:05:59,157][INFO ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%client] Remote Management [restart: off, REST: off, JMX (remote: off)] [21:05:59] : [Step 4/5] [2021-11-19 21:05:59,158][INFO ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%client] Logger: GridTestLog4jLogger [quiet=false, config=null] [21:05:59] : [Step 4/5] [2021-11-19 21:05:59,158][INFO ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%client] IGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c [21:05:59] : [Step 4/5] [2021-11-19 21:05:59,158][INFO ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%client] VM arguments: [-DIGNITE_DUMP_THREADS_ON_FAILURE=false, -DMono=/usr/bin/mono-sgen, -DMono4.0_x64=/usr/lib/mono/4.0, -DMono4.5_x64=/usr/lib/mono/4.5, -DMonoVersion=6.12.0.90, -DSKIP_BUILD=false, -Dagent.home.dir=/opt/buildagent, -Dagent.name=aitc-lin02_03, -Dagent.ownPort=9090, -Dagent.work.dir=/opt/buildagent/work, -Dbuild.number=95, -Dbuild.vcs.number=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.1=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.GitHubApacheIgnite=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dclassworlds.conf=/opt/buildagent/temp/buildTmp/teamcity.m2.conf, -Dcom.jetbrains.maven.watcher.report.file=/opt/buildagent/temp/buildTmp/maven-build-info.xml, -Djava.io.tmpdir=/opt/buildagent/temp/buildTmp, -Dmaven.home=/opt/buildagent/tools/maven3_6, -Dmaven.multiModuleProjectDirectory=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.agent.cpuBenchmark=457, -Dteamcity.agent.dotnet.agent_url=http://localhost:9090/RPC2, -Dteamcity.agent.dotnet.build_id=6278078, -Dteamcity.auth.password=*******, -Dteamcity.auth.userId=TeamCityBuildId=6278078, -Dteamcity.build.changedFiles.file=/opt/buildagent/temp/buildTmp/changedFiles6342607772318147725.txt, -Dteamcity.build.checkoutDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.build.id=6278078, -Dteamcity.build.properties.file=/opt/buildagent/temp/buildTmp/teamcity.build5164517880467851002.properties, -Dteamcity.build.tempDir=/opt/buildagent/temp/buildTmp, -Dteamcity.build.workingDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.buildConfName=Basic 3, -Dteamcity.buildType.id=IgniteTests24Java8_Basic3, -Dteamcity.configuration.properties.file=/opt/buildagent/temp/buildTmp/teamcity.config5591980786735343870.properties, -Dteamcity.maven.userSettings.path=/opt/buildagent/temp/buildTmp/maven_settings_585072866407032347.xml, -Dteamcity.maven.watcher.home=/opt/buildagent/plugins/mavenPlugin/maven-watcher-jdk16, -Dteamcity.projectName=Ignite Tests 2.x (JDK 8/11), -Dteamcity.runner.properties.file=/opt/buildagent/temp/buildTmp/teamcity.runner9098465561618137420.properties, -Dteamcity.tests.recentlyFailedTests.file=/opt/buildagent/temp/buildTmp/testsToRunFirst3891775683130404069.txt, -Dteamcity.version=2021.2 (build 99542), -ea, -Xms2g, -Xmx2g, -XX:+HeapDumpOnOutOfMemoryError, -DIGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_TEST_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_UPDATE_NOTIFIER=false, -DIGNITE_NO_DISCO_ORDER=true, -DIGNITE_PERFORMANCE_SUGGESTIONS_DISABLED=true, -Djava.net.preferIPv4Stack=true, -DTEST_SCALE_FACTOR=1.0, -DIGNITE_TEST_PROP_LOG4J_FILE=log4j-tc-test.xml, -DIGNITE_QUIET=false, -DIGNITE_MARSHAL_BUFFERS_RECHECK=1000, -Dmaven.repo.local=/opt/buildagent/.m2/repository] [21:05:59] : [Step 4/5] [2021-11-19 21:05:59,163][INFO ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%client] System cache's DataRegion size is configured to 40 MB. Use DataStorageConfiguration.systemRegionInitialSize property to change the setting. [21:05:59] : [Step 4/5] [2021-11-19 21:05:59,163][INFO ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%client] Configured caches [in 'sysMemPlc' dataRegion: ['ignite-sys-cache'], in 'default' dataRegion: ['encrypted']] [21:05:59] : [Step 4/5] [2021-11-19 21:05:59,164][INFO ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%client] 3-rd party licenses can be found at: /opt/buildagent/work/7bc1c54bc719b67c/libs/licenses [21:05:59]W: [org.apache.ignite:ignite-core] [2021-11-19 21:05:59,163][WARN ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%client] Peer class loading is enabled (disable it in production for performance and deployment consistency reasons) [21:05:59] : [Step 4/5] [2021-11-19 21:05:59,169][INFO ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] Configured plugins: [21:05:59] : [Step 4/5] [2021-11-19 21:05:59,169][INFO ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- StanByClusterTestProvider 1.0 [21:05:59] : [Step 4/5] [2021-11-19 21:05:59,170][INFO ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- null [21:05:59] : [Step 4/5] [2021-11-19 21:05:59,170][INFO ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] [21:05:59] : [Step 4/5] [2021-11-19 21:05:59,170][INFO ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- PageMemory tracker plugin 1.0 [21:05:59] : [Step 4/5] [2021-11-19 21:05:59,170][INFO ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- null [21:05:59] : [Step 4/5] [2021-11-19 21:05:59,170][INFO ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] [21:05:59] : [Step 4/5] [2021-11-19 21:05:59,170][INFO ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- TestDistibutedConfigurationPlugin 1.0 [21:05:59] : [Step 4/5] [2021-11-19 21:05:59,171][INFO ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- null [21:05:59] : [Step 4/5] [2021-11-19 21:05:59,171][INFO ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] [21:05:59] : [Step 4/5] [2021-11-19 21:05:59,171][INFO ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- NodeValidationPluginProvider 1.0 [21:05:59] : [Step 4/5] [2021-11-19 21:05:59,171][INFO ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- null [21:05:59] : [Step 4/5] [2021-11-19 21:05:59,172][INFO ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] [21:05:59] : [Step 4/5] [2021-11-19 21:05:59,172][INFO ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][FailureProcessor] Configured failure handler: [hnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]]] [21:05:59] : [Step 4/5] [2021-11-19 21:05:59,184][INFO ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][TcpCommunicationSpi] Successfully bound communication NIO server to TCP port [port=45153, locHost=/127.0.0.1, selectorsCnt=12, selectorSpins=0, pairedConn=false] [21:05:59]W: [org.apache.ignite:ignite-core] [2021-11-19 21:05:59,184][WARN ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][TcpCommunicationSpi] Message queue limit is set to 0 which may lead to potential OOMEs when running cache operations in FULL_ASYNC or PRIMARY_SYNC modes due to message queues growth on sender and receiver sides. [21:05:59] : [Step 4/5] [2021-11-19 21:05:59,189][INFO ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][GridCollisionManager] Collision resolution is disabled (all jobs will be activated upon arrival). [21:05:59] : [Step 4/5] [2021-11-19 21:05:59,189][INFO ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%client] Security status [authentication=off, sandbox=off, tls/ssl=off] [21:05:59]W: [org.apache.ignite:ignite-core] [2021-11-19 21:05:59,192][WARN ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][GridCacheProcessor] Persistent Store is not supported on client nodes (Persistent Store's configuration will be ignored). [21:05:59] : [Step 4/5] [2021-11-19 21:05:59,195][INFO ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][IgniteCacheDatabaseSharedManager] Configured data regions initialized successfully [total=4] [21:05:59] : [Step 4/5] [2021-11-19 21:05:59,198][INFO ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][ClientListenerProcessor] Client connector processor has started on TCP port 10803 [21:05:59] : [Step 4/5] [2021-11-19 21:05:59,201][INFO ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%client] Non-loopback local IPs: 172.17.0.4 [21:05:59] : [Step 4/5] [2021-11-19 21:05:59,201][INFO ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%client] Enabled local MACs: 0242AC110004 [21:05:59] : [Step 4/5] [2021-11-19 21:05:59,202][INFO ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][ClusterProcessor] Cluster ID and tag has been read from metastorage: null [21:05:59] : [Step 4/5] [2021-11-19 21:05:59,202][INFO ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][IgniteClusterImpl] Shutdown policy was updated [oldVal=null, newVal=null] [21:05:59] : [Step 4/5] [2021-11-19 21:05:59,205][INFO ][tcp-disco-srvr-[:47500]-#620%grid-0%-#11912%grid-0%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=40473] [21:05:59] : [Step 4/5] [2021-11-19 21:05:59,206][INFO ][tcp-disco-srvr-[:47500]-#620%grid-0%-#11912%grid-0%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=40473] [21:05:59] : [Step 4/5] [2021-11-19 21:05:59,206][INFO ][tcp-disco-sock-reader-[]-#643%grid-0%-#12274%grid-0%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:40473, rmtPort=40473] [21:05:59] : [Step 4/5] [2021-11-19 21:05:59,207][INFO ][tcp-disco-sock-reader-[ab614ee4 127.0.0.1:40473 client]-#643%grid-0%-#12274%grid-0%][TestTcpDiscoverySpi] Initialized connection with remote client node [nodeId=ab614ee4-4a24-4ad9-adf7-87a3db16b0bc, rmtAddr=/127.0.0.1:40473] [21:05:59] : [Step 4/5] [2021-11-19 21:05:59,226][INFO ][disco-event-worker-#11914%grid-0%][GridDiscoveryManager] Added new node to topology: TcpDiscoveryNode [id=ab614ee4-4a24-4ad9-adf7-87a3db16b0bc, consistentId=client, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:0], discPort=0, order=4, intOrder=4, lastExchangeTime=1637345159201, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=true] [21:05:59] : [Step 4/5] [2021-11-19 21:05:59,227][INFO ][disco-event-worker-#11914%grid-0%][GridDiscoveryManager] Topology snapshot [ver=4, locNode=003a0cc9, servers=2, clients=2, state=ACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=003a0cc9-2754-4d39-b63e-fbb30d05a000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=60efc20b-b98d-4d8a-a216-3e743b573006, consistentId=grid-6, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=10ce8c9f-e4f8-4677-9026-4a4de00ef001, consistentId=client1, isClient=true, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=ab614ee4-4a24-4ad9-adf7-87a3db16b0bc, consistentId=client, isClient=true, ver=2.13.0#20211119-sha1:00000000]]] [21:05:59] : [Step 4/5] [2021-11-19 21:05:59,227][INFO ][disco-event-worker-#12037%grid-6%][GridDiscoveryManager] Added new node to topology: TcpDiscoveryNode [id=ab614ee4-4a24-4ad9-adf7-87a3db16b0bc, consistentId=client, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:0], discPort=0, order=4, intOrder=4, lastExchangeTime=1637345159211, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=true] [21:05:59] : [Step 4/5] [2021-11-19 21:05:59,227][INFO ][tcp-client-disco-msg-worker-#642%client%-#12272%client%][TestTcpDiscoverySpi] Router node: TcpDiscoveryNode [id=003a0cc9-2754-4d39-b63e-fbb30d05a000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345159211, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false] [21:05:59] : [Step 4/5] [2021-11-19 21:05:59,227][INFO ][tcp-client-disco-msg-worker-#635%client1%-#12127%client1%][TestTcpDiscoverySpi] Router node: TcpDiscoveryNode [id=003a0cc9-2754-4d39-b63e-fbb30d05a000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345158564, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false] [21:05:59] : [Step 4/5] [2021-11-19 21:05:59,229][INFO ][disco-event-worker-#12037%grid-6%][GridDiscoveryManager] Topology snapshot [ver=4, locNode=60efc20b, servers=2, clients=2, state=ACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=003a0cc9-2754-4d39-b63e-fbb30d05a000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=60efc20b-b98d-4d8a-a216-3e743b573006, consistentId=grid-6, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=10ce8c9f-e4f8-4677-9026-4a4de00ef001, consistentId=client1, isClient=true, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=ab614ee4-4a24-4ad9-adf7-87a3db16b0bc, consistentId=client, isClient=true, ver=2.13.0#20211119-sha1:00000000]]] [21:05:59] : [Step 4/5] [2021-11-19 21:05:59,228][INFO ][disco-event-worker-#11914%grid-0%][GridDiscoveryManager] ^-- Baseline [id=0, size=2, online=2, offline=0] [21:05:59] : [Step 4/5] [2021-11-19 21:05:59,231][INFO ][disco-event-worker-#12037%grid-6%][GridDiscoveryManager] ^-- Baseline [id=0, size=2, online=2, offline=0] [21:05:59] : [Step 4/5] [2021-11-19 21:05:59,230][INFO ][disco-event-worker-#12132%client1%][GridDiscoveryManager] Added new node to topology: TcpDiscoveryNode [id=ab614ee4-4a24-4ad9-adf7-87a3db16b0bc, consistentId=client, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:0], discPort=0, order=4, intOrder=4, lastExchangeTime=1637345159211, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=true] [21:05:59] : [Step 4/5] [2021-11-19 21:05:59,231][INFO ][exchange-worker-#12038%grid-6%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], crd=false, evt=NODE_JOINED, evtNode=ab614ee4-4a24-4ad9-adf7-87a3db16b0bc, customEvt=null, allowMerge=true, exchangeFreeSwitch=false] [21:05:59] : [Step 4/5] [2021-11-19 21:05:59,231][INFO ][exchange-worker-#11915%grid-0%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], crd=true, evt=NODE_JOINED, evtNode=ab614ee4-4a24-4ad9-adf7-87a3db16b0bc, customEvt=null, allowMerge=true, exchangeFreeSwitch=false] [21:05:59] : [Step 4/5] [2021-11-19 21:05:59,233][INFO ][exchange-worker-#12038%grid-6%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], err=null, rebalanced=true, wasRebalanced=true] [21:05:59] : [Step 4/5] [2021-11-19 21:05:59,232][INFO ][disco-event-worker-#12132%client1%][GridDiscoveryManager] Topology snapshot [ver=4, locNode=10ce8c9f, servers=2, clients=2, state=ACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=10ce8c9f-e4f8-4677-9026-4a4de00ef001, consistentId=client1, isClient=true, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=003a0cc9-2754-4d39-b63e-fbb30d05a000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=60efc20b-b98d-4d8a-a216-3e743b573006, consistentId=grid-6, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=ab614ee4-4a24-4ad9-adf7-87a3db16b0bc, consistentId=client, isClient=true, ver=2.13.0#20211119-sha1:00000000]]] [21:05:59] : [Step 4/5] [2021-11-19 21:05:59,234][INFO ][disco-event-worker-#12132%client1%][GridDiscoveryManager] ^-- Baseline [id=0, size=2, online=2, offline=0] [21:05:59] : [Step 4/5] [2021-11-19 21:05:59,234][INFO ][tcp-client-disco-msg-worker-#642%client%-#12272%client%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustEnabled' was changed from 'null' to 'false' [21:05:59] : [Step 4/5] [2021-11-19 21:05:59,234][INFO ][exchange-worker-#12038%grid-6%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=60efc20b-b98d-4d8a-a216-3e743b573006, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], evt=NODE_JOINED, evtNode=TcpDiscoveryNode [id=ab614ee4-4a24-4ad9-adf7-87a3db16b0bc, consistentId=client, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:0], discPort=0, order=4, intOrder=4, lastExchangeTime=1637345159211, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=true], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0]] [21:05:59] : [Step 4/5] [2021-11-19 21:05:59,233][INFO ][exchange-worker-#11915%grid-0%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], err=null, rebalanced=true, wasRebalanced=true] [21:05:59] : [Step 4/5] [2021-11-19 21:05:59,236][INFO ][exchange-worker-#12038%grid-6%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (0 ms), stage="Determine exchange type" (0 ms), stage="Exchange done" (3 ms), stage="Total time" (3 ms)] [21:05:59] : [Step 4/5] [2021-11-19 21:05:59,237][INFO ][exchange-worker-#12038%grid-6%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=0]] [21:05:59] : [Step 4/5] [2021-11-19 21:05:59,237][INFO ][exchange-worker-#12038%grid-6%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], crd=false] [21:05:59] : [Step 4/5] [2021-11-19 21:05:59,235][INFO ][tcp-client-disco-msg-worker-#642%client%-#12272%client%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustTimeout' was changed from 'null' to '300000' [21:05:59] : [Step 4/5] [2021-11-19 21:05:59,235][INFO ][exchange-worker-#12133%client1%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], crd=false, evt=NODE_JOINED, evtNode=ab614ee4-4a24-4ad9-adf7-87a3db16b0bc, customEvt=null, allowMerge=true, exchangeFreeSwitch=false] [21:05:59] : [Step 4/5] [2021-11-19 21:05:59,238][INFO ][tcp-client-disco-msg-worker-#642%client%-#12272%client%][IgniteTxManager] Transactions parameter 'collisionsDumpInterval' was changed from 'null' to '1000' [21:05:59] : [Step 4/5] [2021-11-19 21:05:59,238][INFO ][exchange-worker-#12038%grid-6%][GridCachePartitionExchangeManager] AffinityTopologyVersion [topVer=4, minorTopVer=0], evt=NODE_JOINED, evtNode=ab614ee4-4a24-4ad9-adf7-87a3db16b0bc, client=false] [21:05:59] : [Step 4/5] [2021-11-19 21:05:59,237][INFO ][exchange-worker-#11915%grid-0%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=003a0cc9-2754-4d39-b63e-fbb30d05a000, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], evt=NODE_JOINED, evtNode=TcpDiscoveryNode [id=ab614ee4-4a24-4ad9-adf7-87a3db16b0bc, consistentId=client, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:0], discPort=0, order=4, intOrder=4, lastExchangeTime=1637345159201, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=true], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0]] [21:05:59] : [Step 4/5] [2021-11-19 21:05:59,239][INFO ][tcp-client-disco-msg-worker-#642%client%-#12272%client%][IgniteTxManager] Transactions parameter 'longOperationsDumpTimeout' was changed from 'null' to '60000' [21:05:59] : [Step 4/5] [2021-11-19 21:05:59,239][INFO ][exchange-worker-#12133%client1%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], err=null, rebalanced=true, wasRebalanced=true] [21:05:59] : [Step 4/5] [2021-11-19 21:05:59,241][INFO ][tcp-client-disco-msg-worker-#642%client%-#12272%client%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpSamplesPerSecondLimit' was changed from 'null' to '5' [21:05:59] : [Step 4/5] [2021-11-19 21:05:59,240][INFO ][exchange-worker-#11915%grid-0%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (1 ms), stage="Determine exchange type" (0 ms), stage="Exchange done" (7 ms), stage="Total time" (8 ms)] [21:05:59] : [Step 4/5] [2021-11-19 21:05:59,242][INFO ][exchange-worker-#11915%grid-0%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=0]] [21:05:59] : [Step 4/5] [2021-11-19 21:05:59,243][INFO ][exchange-worker-#11915%grid-0%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], crd=true] [21:05:59] : [Step 4/5] [2021-11-19 21:05:59,242][INFO ][tcp-client-disco-msg-worker-#642%client%-#12272%client%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpThreshold' was changed from 'null' to '0' [21:05:59] : [Step 4/5] [2021-11-19 21:05:59,243][INFO ][tcp-client-disco-msg-worker-#642%client%-#12272%client%][IgniteTxManager] Transactions parameter 'transactionTimeDumpSamplesCoefficient' was changed from 'null' to '0.0' [21:05:59] : [Step 4/5] [2021-11-19 21:05:59,242][INFO ][exchange-worker-#12133%client1%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=10ce8c9f-e4f8-4677-9026-4a4de00ef001, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], evt=NODE_JOINED, evtNode=TcpDiscoveryNode [id=ab614ee4-4a24-4ad9-adf7-87a3db16b0bc, consistentId=client, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:0], discPort=0, order=4, intOrder=4, lastExchangeTime=1637345159211, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=true], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0]] [21:05:59] : [Step 4/5] [2021-11-19 21:05:59,243][INFO ][tcp-client-disco-msg-worker-#642%client%-#12272%client%][IgniteTxManager] Transactions parameter 'txOwnerDumpRequestsAllowed' was changed from 'null' to 'true' [21:05:59] : [Step 4/5] [2021-11-19 21:05:59,243][INFO ][exchange-worker-#11915%grid-0%][GridCachePartitionExchangeManager] AffinityTopologyVersion [topVer=4, minorTopVer=0], evt=NODE_JOINED, evtNode=ab614ee4-4a24-4ad9-adf7-87a3db16b0bc, client=false] [21:05:59] : [Step 4/5] [2021-11-19 21:05:59,245][INFO ][tcp-client-disco-msg-worker-#642%client%-#12272%client%][ClusterProcessor] hardcore_hertz [21:05:59] : [Step 4/5] [2021-11-19 21:05:59,244][INFO ][exchange-worker-#12133%client1%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (3 ms), stage="Determine exchange type" (0 ms), stage="Exchange done" (5 ms), stage="Total time" (8 ms)] [21:05:59] : [Step 4/5] [2021-11-19 21:05:59,246][INFO ][disco-notifier-worker-#12269%client%][MvccProcessorImpl] Assigned mvcc coordinator [crd=MvccCoordinator [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], nodeId=003a0cc9-2754-4d39-b63e-fbb30d05a000, ver=1637345157192, local=false, initialized=false]] [21:05:59] : [Step 4/5] [2021-11-19 21:05:59,246][INFO ][exchange-worker-#12133%client1%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=0]] [21:05:59] : [Step 4/5] [2021-11-19 21:05:59,249][INFO ][exchange-worker-#12133%client1%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], crd=false] [21:05:59] : [Step 4/5] [2021-11-19 21:05:59,249][INFO ][sys-#12276%client%][ClusterProcessor] Writing cluster ID and tag to metastorage on ready for write ClusterIdAndTag [id=31400863-ff27-4063-8faa-2fafe901f2b1, tag=hardcore_hertz] [21:05:59] : [Step 4/5] [2021-11-19 21:05:59,249][INFO ][exchange-worker-#12133%client1%][GridCachePartitionExchangeManager] AffinityTopologyVersion [topVer=4, minorTopVer=0], evt=NODE_JOINED, evtNode=ab614ee4-4a24-4ad9-adf7-87a3db16b0bc, client=true] [21:05:59] : [Step 4/5] [2021-11-19 21:05:59,261][INFO ][exchange-worker-#12278%client%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], crd=false, evt=NODE_JOINED, evtNode=ab614ee4-4a24-4ad9-adf7-87a3db16b0bc, customEvt=null, allowMerge=true, exchangeFreeSwitch=false] [21:05:59] : [Step 4/5] [2021-11-19 21:05:59,262][INFO ][exchange-worker-#12278%client%][IgniteCacheDatabaseSharedManager] Data Regions Started: 4 [21:05:59] : [Step 4/5] [2021-11-19 21:05:59,262][INFO ][exchange-worker-#12278%client%][IgniteCacheDatabaseSharedManager] ^-- sysMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:05:59] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB, allocTotal=0MB] [21:05:59] : [Step 4/5] ^-- default region [type=default, persistence=true, lazyAlloc=true, [21:05:59] : [Step 4/5] ... initCfg=10MB, maxCfg=10MB, usedRam=0MB, freeRam=100%, allocRam=0MB, allocTotal=0MB] [21:05:59] : [Step 4/5] ^-- TxLog region [type=internal, persistence=true, lazyAlloc=false, [21:05:59] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB, allocTotal=0MB] [21:05:59] : [Step 4/5] ^-- volatileDsMemPlc region [type=user, persistence=false, lazyAlloc=true, [21:05:59] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB] [21:05:59] : [Step 4/5] ^-- Ignite persistence [used=0MB] [21:05:59] : [Step 4/5] [21:05:59] : [Step 4/5] [2021-11-19 21:05:59,263][INFO ][exchange-worker-#12278%client%][msg] Components activation performed in 2 ms. [21:05:59] : [Step 4/5] [2021-11-19 21:05:59,268][INFO ][sys-#12282%client%][GridCacheProcessor] Started cache [name=encrypted, id=1613773252, dataRegionName=default, mode=PARTITIONED, atomicity=TRANSACTIONAL, backups=0, mvcc=false] [21:05:59] : [Step 4/5] [2021-11-19 21:05:59,268][INFO ][exchange-worker-#12278%client%][GridCacheProcessor] Started cache [name=ignite-sys-cache, id=-2100569601, dataRegionName=sysMemPlc, mode=REPLICATED, atomicity=TRANSACTIONAL, backups=2147483647, mvcc=false] [21:05:59] : [Step 4/5] [2021-11-19 21:05:59,268][INFO ][exchange-worker-#12278%client%][GridCacheProcessor] Starting caches on local join performed in 0 ms. [21:05:59] : [Step 4/5] [2021-11-19 21:05:59,272][INFO ][grid-nio-worker-tcp-comm-2-#11855%TcpCommunicationSpi%][TcpCommunicationSpi] Accepted incoming communication connection [locAddr=/127.0.0.1:45150, rmtAddr=/127.0.0.1:60192] [21:05:59] : [Step 4/5] [2021-11-19 21:05:59,274][INFO ][grid-nio-worker-tcp-comm-0-#12240%TcpCommunicationSpi%][TcpCommunicationSpi] Established outgoing communication connection [locAddr=/127.0.0.1:60192, rmtAddr=/127.0.0.1:45150] [21:05:59] : [Step 4/5] [2021-11-19 21:05:59,275][INFO ][exchange-worker-#12278%client%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], crd=false] [21:05:59] : [Step 4/5] [2021-11-19 21:05:59,282][INFO ][sys-#11890%grid-0%][GridCachePartitionExchangeManager] Fast replied to single message [exchId=GridDhtPartitionExchangeId [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], discoEvt=null, nodeId=ab614ee4, evt=NODE_JOINED], nodeId=ab614ee4-4a24-4ad9-adf7-87a3db16b0bc] [21:05:59] : [Step 4/5] [2021-11-19 21:05:59,288][INFO ][sys-#12287%client%][GridDhtPartitionsExchangeFuture] Received full message, will finish exchange [node=003a0cc9-2754-4d39-b63e-fbb30d05a000, resVer=AffinityTopologyVersion [topVer=4, minorTopVer=0]] [21:05:59] : [Step 4/5] [2021-11-19 21:05:59,295][INFO ][sys-#12287%client%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], err=null, rebalanced=true, wasRebalanced=false] [21:05:59] : [Step 4/5] [2021-11-19 21:05:59,296][INFO ][sys-#12287%client%][GridCacheProcessor] Finish proxy initialization, cacheName=ignite-sys-cache, localNodeId=ab614ee4-4a24-4ad9-adf7-87a3db16b0bc [21:05:59] : [Step 4/5] [2021-11-19 21:05:59,296][INFO ][sys-#12287%client%][GridCacheProcessor] Finish proxy initialization, cacheName=encrypted, localNodeId=ab614ee4-4a24-4ad9-adf7-87a3db16b0bc [21:05:59] : [Step 4/5] [2021-11-19 21:05:59,297][INFO ][exchange-worker-#12278%client%][GridCachePartitionExchangeManager] AffinityTopologyVersion [topVer=4, minorTopVer=0], evt=NODE_JOINED, evtNode=ab614ee4-4a24-4ad9-adf7-87a3db16b0bc, client=true] [21:05:59] : [Step 4/5] [2021-11-19 21:05:59,297][INFO ][sys-#12287%client%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=ab614ee4-4a24-4ad9-adf7-87a3db16b0bc, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], evt=NODE_JOINED, evtNode=TcpDiscoveryNode [id=ab614ee4-4a24-4ad9-adf7-87a3db16b0bc, consistentId=client, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:0], discPort=0, order=4, intOrder=0, lastExchangeTime=1637345159201, loc=true, ver=2.13.0#20211119-sha1:00000000, isClient=true], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0]] [21:05:59] : [Step 4/5] [2021-11-19 21:05:59,298][INFO ][sys-#12287%client%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], stage="Waiting in exchange queue" (14 ms), stage="Exchange parameters initialization" (0 ms), stage="Components activation" (2 ms), stage="Determine exchange type" (8 ms), stage="Waiting for Full message" (17 ms), stage="Affinity recalculation" (2 ms), stage="Full map updating" (4 ms), stage="Exchange done" (3 ms), stage="Total time" (50 ms)] [21:05:59] : [Step 4/5] [2021-11-19 21:05:59,299][INFO ][sys-#12287%client%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], stage="Affinity initialization (local join) [grp=encrypted]" (2 ms) (parent=Affinity recalculation), stage="Affinity initialization (local join) [grp=ignite-sys-cache]" (0 ms) (parent=Affinity recalculation)] [21:05:59] : [Step 4/5] [2021-11-19 21:05:59,305][INFO ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%client] To start Console Management & Monitoring run ignitevisorcmd.{sh|bat} [21:05:59] : [Step 4/5] [2021-11-19 21:05:59,306][INFO ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%client] [21:05:59] : [Step 4/5] [21:05:59] : [Step 4/5] >>> +-------------------------------------------+ [21:05:59] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:05:59] : [Step 4/5] >>> +-------------------------------------------+ [21:05:59] : [Step 4/5] >>> OS name: Linux 4.15.0-151-generic amd64 [21:05:59] : [Step 4/5] >>> CPU(s): 24 [21:05:59] : [Step 4/5] >>> Heap: 2.0GB [21:05:59] : [Step 4/5] >>> VM name: 16724@c4dfe9a430b2 [21:05:59] : [Step 4/5] >>> Ignite instance name: client [21:05:59] : [Step 4/5] >>> Local node [ID=AB614EE4-4A24-4AD9-ADF7-87A3DB16B0BC, order=4, clientMode=true] [21:05:59] : [Step 4/5] >>> Local node addresses: [127.0.0.1] [21:05:59] : [Step 4/5] >>> Local ports: TCP:10803 TCP:45153 [21:05:59] : [Step 4/5] [21:05:59] : [Step 4/5] [2021-11-19 21:05:59,307][INFO ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][GridDiscoveryManager] Topology snapshot [ver=4, locNode=ab614ee4, servers=2, clients=2, state=ACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=ab614ee4-4a24-4ad9-adf7-87a3db16b0bc, consistentId=client, isClient=true, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=003a0cc9-2754-4d39-b63e-fbb30d05a000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=60efc20b-b98d-4d8a-a216-3e743b573006, consistentId=grid-6, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=10ce8c9f-e4f8-4677-9026-4a4de00ef001, consistentId=client1, isClient=true, ver=2.13.0#20211119-sha1:00000000]]] [21:05:59] : [Step 4/5] [2021-11-19 21:05:59,309][INFO ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][GridDiscoveryManager] ^-- Baseline [id=0, size=2, online=2, offline=0] [21:05:59] : [Step 4/5] [2021-11-19 21:05:59,309][INFO ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][G] Node started : [stage="Configure system pool" (0 ms),stage="Start managers" (308 ms),stage="Configure binary metadata" (1 ms),stage="Start processors" (8 ms),stage="Start 'StanByClusterTestProvider' plugin" (0 ms),stage="Start 'PageMemory tracker plugin' plugin" (0 ms),stage="Start 'TestDistibutedConfigurationPlugin' plugin" (0 ms),stage="Start 'NodeValidationPluginProvider' plugin" (0 ms),stage="Init metastore" (1 ms),stage="Finish recovery" (0 ms),stage="Join topology" (46 ms),stage="Await transition" (2 ms),stage="Await exchange" (57 ms),stage="Total time" (423 ms)] [21:05:59] : [Step 4/5] [2021-11-19 21:05:59,311][INFO ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][root] Node started with the following configuration [id=ab614ee4-4a24-4ad9-adf7-87a3db16b0bc, marshaller=BinaryMarshaller [], discovery=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=5000, ackTimeout=5000, marsh=JdkMarshaller [clsFilter=org.apache.ignite.marshaller.MarshallerUtils$1@6abb34d5], reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], binaryCfg=null, lateAff=true] [21:05:59] : [Step 4/5] [2021-11-19 21:05:59,336][INFO ][test-runner-#11798%encryption.EncryptedCacheNodeJoinTest%][root] awaitPartitionMapExchange finished [21:06:00] : [Step 4/5] [2021-11-19 21:06:00,331][INFO ][db-checkpoint-thread-#12157%grid-6%][Checkpointer] Checkpoint finished [cpId=e056bebc-6b98-4777-baec-84c2aebde189, pages=23, markPos=WALPointer [idx=0, fileOff=170893, len=11450], walSegmentsCovered=[], markDuration=34ms, pagesWrite=5ms, fsync=1615ms, total=1655ms] [21:06:00] : [Step 4/5] [2021-11-19 21:06:00,871][INFO ][grid-nio-worker-tcp-comm-1-#11973%TcpCommunicationSpi%][TcpCommunicationSpi] Accepted incoming communication connection [locAddr=/127.0.0.1:45151, rmtAddr=/127.0.0.1:33424] [21:06:00] : [Step 4/5] [2021-11-19 21:06:00,877][INFO ][grid-nio-worker-tcp-comm-1-#12241%TcpCommunicationSpi%][TcpCommunicationSpi] Established outgoing communication connection [locAddr=/127.0.0.1:33424, rmtAddr=/127.0.0.1:45151] [21:06:05] : [Step 4/5] [2021-11-19 21:06:05,492][INFO ][grid-nio-worker-tcp-comm-2-#11974%TcpCommunicationSpi%][TcpCommunicationSpi] Accepted incoming communication connection [locAddr=/127.0.0.1:45151, rmtAddr=/127.0.0.1:33522] [21:06:05] : [Step 4/5] [2021-11-19 21:06:05,495][INFO ][grid-nio-worker-tcp-comm-1-#12096%TcpCommunicationSpi%][TcpCommunicationSpi] Established outgoing communication connection [locAddr=/127.0.0.1:33522, rmtAddr=/127.0.0.1:45151] [21:06:05] : [Step 4/5] [21:06:05] >>> Stopping test: EncryptedCacheNodeJoinTest#testClientNodeJoinActiveClusterWithExistingStaticCacheConfig in 10252 ms <<< [21:06:05] : [Step 4/5] [2021-11-19 21:06:05,597][INFO ][main][root] >>> Stopping test: EncryptedCacheNodeJoinTest#testClientNodeJoinActiveClusterWithExistingStaticCacheConfig in 10252 ms <<< [21:06:05] : [Step 4/5] [21:06:05] >>> Heap: 265 MB used / 1899 MB commited / 1899 MB max <<< [21:06:05] : [Step 4/5] [2021-11-19 21:06:05,597][INFO ][main][root] >>> Heap: 265 MB used / 1899 MB commited / 1899 MB max <<< [21:06:05] : [Step 4/5] [21:06:05] >>> Non-Heap: 147 MB used / 160 MB commited / 0 MB max <<< [21:06:05] : [Step 4/5] [2021-11-19 21:06:05,598][INFO ][main][root] >>> Non-Heap: 147 MB used / 160 MB commited / 0 MB max <<< [21:06:05] : [Step 4/5] [2021-11-19 21:06:05,598][INFO ][main][root] >>> Stopping grid [name=client, id=ab614ee4-4a24-4ad9-adf7-87a3db16b0bc] [21:06:05] : [Step 4/5] [2021-11-19 21:06:05,611][INFO ][disco-event-worker-#11914%grid-0%][GridDiscoveryManager] Node left topology: TcpDiscoveryNode [id=ab614ee4-4a24-4ad9-adf7-87a3db16b0bc, consistentId=client, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:0], discPort=0, order=4, intOrder=4, lastExchangeTime=1637345159201, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=true] [21:06:05] : [Step 4/5] [2021-11-19 21:06:05,619][INFO ][main][GridCacheProcessor] Stopped cache [cacheName=encrypted] [21:06:05] : [Step 4/5] [2021-11-19 21:06:05,614][INFO ][tcp-disco-sock-reader-[ab614ee4 127.0.0.1:40473 client]-#643%grid-0%-#12274%grid-0%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:40473, rmtPort=40473, rmtNodeId=ab614ee4-4a24-4ad9-adf7-87a3db16b0bc] [21:06:05] : [Step 4/5] [2021-11-19 21:06:05,614][INFO ][disco-event-worker-#12037%grid-6%][GridDiscoveryManager] Node left topology: TcpDiscoveryNode [id=ab614ee4-4a24-4ad9-adf7-87a3db16b0bc, consistentId=client, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:0], discPort=0, order=4, intOrder=4, lastExchangeTime=1637345159211, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=true] [21:06:05] : [Step 4/5] [2021-11-19 21:06:05,614][INFO ][disco-event-worker-#12132%client1%][GridDiscoveryManager] Node left topology: TcpDiscoveryNode [id=ab614ee4-4a24-4ad9-adf7-87a3db16b0bc, consistentId=client, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:0], discPort=0, order=4, intOrder=4, lastExchangeTime=1637345159211, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=true] [21:06:05] : [Step 4/5] [2021-11-19 21:06:05,621][INFO ][disco-event-worker-#12037%grid-6%][GridDiscoveryManager] Topology snapshot [ver=5, locNode=60efc20b, servers=2, clients=1, state=ACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=003a0cc9-2754-4d39-b63e-fbb30d05a000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=60efc20b-b98d-4d8a-a216-3e743b573006, consistentId=grid-6, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=10ce8c9f-e4f8-4677-9026-4a4de00ef001, consistentId=client1, isClient=true, ver=2.13.0#20211119-sha1:00000000]]] [21:06:05] : [Step 4/5] [2021-11-19 21:06:05,622][INFO ][disco-event-worker-#12037%grid-6%][GridDiscoveryManager] ^-- Baseline [id=0, size=2, online=2, offline=0] [21:06:05] : [Step 4/5] [2021-11-19 21:06:05,620][INFO ][disco-event-worker-#11914%grid-0%][GridDiscoveryManager] Topology snapshot [ver=5, locNode=003a0cc9, servers=2, clients=1, state=ACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=003a0cc9-2754-4d39-b63e-fbb30d05a000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=60efc20b-b98d-4d8a-a216-3e743b573006, consistentId=grid-6, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=10ce8c9f-e4f8-4677-9026-4a4de00ef001, consistentId=client1, isClient=true, ver=2.13.0#20211119-sha1:00000000]]] [21:06:05] : [Step 4/5] [2021-11-19 21:06:05,624][INFO ][disco-event-worker-#11914%grid-0%][GridDiscoveryManager] ^-- Baseline [id=0, size=2, online=2, offline=0] [21:06:05] : [Step 4/5] [2021-11-19 21:06:05,620][INFO ][main][GridCacheProcessor] Stopped cache [cacheName=ignite-sys-cache] [21:06:05] : [Step 4/5] [2021-11-19 21:06:05,624][INFO ][exchange-worker-#12038%grid-6%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], crd=false, evt=NODE_LEFT, evtNode=ab614ee4-4a24-4ad9-adf7-87a3db16b0bc, customEvt=null, allowMerge=true, exchangeFreeSwitch=false] [21:06:05]W: [org.apache.ignite:ignite-core] [2021-11-19 21:06:05,623][WARN ][grid-nio-worker-tcp-comm-1-#11973%TcpCommunicationSpi%][TcpCommunicationSpi] Failed to shutdown socket [21:06:05]W: [org.apache.ignite:ignite-core] java.nio.channels.ClosedChannelException [21:06:05]W: [org.apache.ignite:ignite-core] at sun.nio.ch.SocketChannelImpl.shutdownOutput(SocketChannelImpl.java:795) [21:06:05]W: [org.apache.ignite:ignite-core] at sun.nio.ch.SocketAdaptor.shutdownOutput(SocketAdaptor.java:407) [21:06:05]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.close(IgniteUtils.java:4247) [21:06:05]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.closeKey(GridNioServer.java:2784) [21:06:05]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.close(GridNioServer.java:2835) [21:06:05]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.close(GridNioServer.java:2794) [21:06:05]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.bodyInternal(GridNioServer.java:2157) [21:06:05]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.body(GridNioServer.java:1910) [21:06:05]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:125) [21:06:05]W: [org.apache.ignite:ignite-core] at java.lang.Thread.run(Thread.java:748) [21:06:05] : [Step 4/5] [2021-11-19 21:06:05,622][INFO ][disco-event-worker-#12132%client1%][GridDiscoveryManager] Topology snapshot [ver=5, locNode=10ce8c9f, servers=2, clients=1, state=ACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=10ce8c9f-e4f8-4677-9026-4a4de00ef001, consistentId=client1, isClient=true, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=003a0cc9-2754-4d39-b63e-fbb30d05a000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=60efc20b-b98d-4d8a-a216-3e743b573006, consistentId=grid-6, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:06:05] : [Step 4/5] [2021-11-19 21:06:05,631][INFO ][disco-event-worker-#12132%client1%][GridDiscoveryManager] ^-- Baseline [id=0, size=2, online=2, offline=0] [21:06:05] : [Step 4/5] [2021-11-19 21:06:05,629][INFO ][main][GridDeploymentLocalStore] Removed undeployed class: GridDeployment [ts=1637345159282, depMode=SHARED, clsLdr=IsolatedClassLoader{roleName='test'}, clsLdrId=6de3d593d71-ab614ee4-4a24-4ad9-adf7-87a3db16b0bc, userVer=0, loc=true, sampleClsName=org.apache.ignite.internal.processors.cache.distributed.dht.preloader.GridDhtPartitionFullMap, pendingUndeploy=false, undeployed=true, usage=0] [21:06:05] : [Step 4/5] [2021-11-19 21:06:05,628][INFO ][exchange-worker-#11915%grid-0%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], crd=true, evt=NODE_LEFT, evtNode=ab614ee4-4a24-4ad9-adf7-87a3db16b0bc, customEvt=null, allowMerge=true, exchangeFreeSwitch=false] [21:06:05] : [Step 4/5] [2021-11-19 21:06:05,627][INFO ][exchange-worker-#12038%grid-6%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], err=null, rebalanced=true, wasRebalanced=true] [21:06:05] : [Step 4/5] [2021-11-19 21:06:05,634][INFO ][exchange-worker-#11915%grid-0%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], err=null, rebalanced=true, wasRebalanced=true] [21:06:05] : [Step 4/5] [2021-11-19 21:06:05,634][INFO ][exchange-worker-#12133%client1%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], crd=false, evt=NODE_LEFT, evtNode=ab614ee4-4a24-4ad9-adf7-87a3db16b0bc, customEvt=null, allowMerge=true, exchangeFreeSwitch=false] [21:06:05] : [Step 4/5] [2021-11-19 21:06:05,637][INFO ][exchange-worker-#11915%grid-0%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=003a0cc9-2754-4d39-b63e-fbb30d05a000, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], evt=NODE_LEFT, evtNode=TcpDiscoveryNode [id=ab614ee4-4a24-4ad9-adf7-87a3db16b0bc, consistentId=client, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:0], discPort=0, order=4, intOrder=4, lastExchangeTime=1637345159201, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=true], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=5, minorTopVer=0]] [21:06:05] : [Step 4/5] [2021-11-19 21:06:05,635][INFO ][exchange-worker-#12038%grid-6%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=60efc20b-b98d-4d8a-a216-3e743b573006, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], evt=NODE_LEFT, evtNode=TcpDiscoveryNode [id=ab614ee4-4a24-4ad9-adf7-87a3db16b0bc, consistentId=client, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:0], discPort=0, order=4, intOrder=4, lastExchangeTime=1637345159211, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=true], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=5, minorTopVer=0]] [21:06:05] : [Step 4/5] [2021-11-19 21:06:05,641][INFO ][main][IgniteKernal%client] [21:06:05] : [Step 4/5] [21:06:05] : [Step 4/5] >>> +------------------------------------------------------+ [21:06:05] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV stopped OK [21:06:05] : [Step 4/5] >>> +------------------------------------------------------+ [21:06:05] : [Step 4/5] >>> Ignite instance name: client [21:06:05] : [Step 4/5] >>> Grid uptime: 00:00:06.334 [21:06:05] : [Step 4/5] [21:06:05] : [Step 4/5] [21:06:05] : [Step 4/5] [2021-11-19 21:06:05,639][INFO ][exchange-worker-#11915%grid-0%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (5 ms), stage="Determine exchange type" (0 ms), stage="Exchange done" (4 ms), stage="Total time" (9 ms)] [21:06:05] : [Step 4/5] [2021-11-19 21:06:05,638][INFO ][exchange-worker-#12133%client1%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], err=null, rebalanced=true, wasRebalanced=true] [21:06:05] : [Step 4/5] [2021-11-19 21:06:05,643][INFO ][exchange-worker-#11915%grid-0%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=5, minorTopVer=0]] [21:06:05] : [Step 4/5] [2021-11-19 21:06:05,642][INFO ][main][root] >>> Stopping grid [name=client1, id=10ce8c9f-e4f8-4677-9026-4a4de00ef001] [21:06:05] : [Step 4/5] [2021-11-19 21:06:05,642][INFO ][exchange-worker-#12038%grid-6%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (0 ms), stage="Determine exchange type" (2 ms), stage="Exchange done" (14 ms), stage="Total time" (16 ms)] [21:06:05] : [Step 4/5] [2021-11-19 21:06:05,643][INFO ][exchange-worker-#11915%grid-0%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], crd=true] [21:06:05] : [Step 4/5] [2021-11-19 21:06:05,643][INFO ][exchange-worker-#12133%client1%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=10ce8c9f-e4f8-4677-9026-4a4de00ef001, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], evt=NODE_LEFT, evtNode=TcpDiscoveryNode [id=ab614ee4-4a24-4ad9-adf7-87a3db16b0bc, consistentId=client, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:0], discPort=0, order=4, intOrder=4, lastExchangeTime=1637345159211, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=true], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=5, minorTopVer=0]] [21:06:05] : [Step 4/5] [2021-11-19 21:06:05,647][INFO ][exchange-worker-#11915%grid-0%][GridCachePartitionExchangeManager] AffinityTopologyVersion [topVer=5, minorTopVer=0], evt=NODE_LEFT, evtNode=ab614ee4-4a24-4ad9-adf7-87a3db16b0bc, client=false] [21:06:05] : [Step 4/5] [2021-11-19 21:06:05,646][INFO ][exchange-worker-#12038%grid-6%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=5, minorTopVer=0]] [21:06:05] : [Step 4/5] [2021-11-19 21:06:05,648][INFO ][exchange-worker-#12133%client1%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], stage="Waiting in exchange queue" (1 ms), stage="Exchange parameters initialization" (3 ms), stage="Determine exchange type" (0 ms), stage="Exchange done" (10 ms), stage="Total time" (14 ms)] [21:06:05] : [Step 4/5] [2021-11-19 21:06:05,649][INFO ][exchange-worker-#12133%client1%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=5, minorTopVer=0]] [21:06:05] : [Step 4/5] [2021-11-19 21:06:05,649][INFO ][exchange-worker-#12133%client1%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], crd=false] [21:06:05] : [Step 4/5] [2021-11-19 21:06:05,648][INFO ][exchange-worker-#12038%grid-6%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], crd=false] [21:06:05] : [Step 4/5] [2021-11-19 21:06:05,650][INFO ][exchange-worker-#12133%client1%][GridCachePartitionExchangeManager] AffinityTopologyVersion [topVer=5, minorTopVer=0], evt=NODE_LEFT, evtNode=ab614ee4-4a24-4ad9-adf7-87a3db16b0bc, client=true] [21:06:05] : [Step 4/5] [2021-11-19 21:06:05,650][INFO ][exchange-worker-#12038%grid-6%][GridCachePartitionExchangeManager] AffinityTopologyVersion [topVer=5, minorTopVer=0], evt=NODE_LEFT, evtNode=ab614ee4-4a24-4ad9-adf7-87a3db16b0bc, client=false] [21:06:05] : [Step 4/5] [2021-11-19 21:06:05,656][INFO ][disco-event-worker-#11914%grid-0%][GridDiscoveryManager] Node left topology: TcpDiscoveryNode [id=10ce8c9f-e4f8-4677-9026-4a4de00ef001, consistentId=client1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:0], discPort=0, order=3, intOrder=3, lastExchangeTime=1637345158554, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=true] [21:06:05] : [Step 4/5] [2021-11-19 21:06:05,659][INFO ][tcp-disco-sock-reader-[10ce8c9f 127.0.0.1:50467 client]-#636%grid-0%-#12129%grid-0%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:50467, rmtPort=50467, rmtNodeId=10ce8c9f-e4f8-4677-9026-4a4de00ef001] [21:06:05] : [Step 4/5] [2021-11-19 21:06:05,662][INFO ][main][GridCacheProcessor] Stopped cache [cacheName=encrypted] [21:06:05] : [Step 4/5] [2021-11-19 21:06:05,660][INFO ][disco-event-worker-#11914%grid-0%][GridDiscoveryManager] Topology snapshot [ver=6, locNode=003a0cc9, servers=2, clients=0, state=ACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=003a0cc9-2754-4d39-b63e-fbb30d05a000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=60efc20b-b98d-4d8a-a216-3e743b573006, consistentId=grid-6, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:06:05] : [Step 4/5] [2021-11-19 21:06:05,664][INFO ][disco-event-worker-#11914%grid-0%][GridDiscoveryManager] ^-- Baseline [id=0, size=2, online=2, offline=0] [21:06:05] : [Step 4/5] [2021-11-19 21:06:05,660][INFO ][disco-event-worker-#12037%grid-6%][GridDiscoveryManager] Node left topology: TcpDiscoveryNode [id=10ce8c9f-e4f8-4677-9026-4a4de00ef001, consistentId=client1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:0], discPort=0, order=3, intOrder=3, lastExchangeTime=1637345158564, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=true] [21:06:05] : [Step 4/5] [2021-11-19 21:06:05,663][INFO ][main][GridCacheProcessor] Stopped cache [cacheName=ignite-sys-cache] [21:06:05] : [Step 4/5] [2021-11-19 21:06:05,665][INFO ][disco-event-worker-#12037%grid-6%][GridDiscoveryManager] Topology snapshot [ver=6, locNode=60efc20b, servers=2, clients=0, state=ACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=003a0cc9-2754-4d39-b63e-fbb30d05a000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=60efc20b-b98d-4d8a-a216-3e743b573006, consistentId=grid-6, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:06:05] : [Step 4/5] [2021-11-19 21:06:05,665][INFO ][exchange-worker-#11915%grid-0%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=6, minorTopVer=0], crd=true, evt=NODE_LEFT, evtNode=10ce8c9f-e4f8-4677-9026-4a4de00ef001, customEvt=null, allowMerge=true, exchangeFreeSwitch=false] [21:06:05] : [Step 4/5] [2021-11-19 21:06:05,668][INFO ][disco-event-worker-#12037%grid-6%][GridDiscoveryManager] ^-- Baseline [id=0, size=2, online=2, offline=0] [21:06:05] : [Step 4/5] [2021-11-19 21:06:05,668][INFO ][main][GridDeploymentLocalStore] Removed undeployed class: GridDeployment [ts=1637345158706, depMode=SHARED, clsLdr=IsolatedClassLoader{roleName='test'}, clsLdrId=56e3d593d71-10ce8c9f-e4f8-4677-9026-4a4de00ef001, userVer=0, loc=true, sampleClsName=org.apache.ignite.internal.processors.cache.distributed.dht.preloader.GridDhtPartitionFullMap, pendingUndeploy=false, undeployed=true, usage=0] [21:06:05] : [Step 4/5] [2021-11-19 21:06:05,669][INFO ][exchange-worker-#11915%grid-0%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=6, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=6, minorTopVer=0], err=null, rebalanced=true, wasRebalanced=true] [21:06:05] : [Step 4/5] [2021-11-19 21:06:05,671][INFO ][exchange-worker-#12038%grid-6%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=6, minorTopVer=0], crd=false, evt=NODE_LEFT, evtNode=10ce8c9f-e4f8-4677-9026-4a4de00ef001, customEvt=null, allowMerge=true, exchangeFreeSwitch=false] [21:06:05] : [Step 4/5] [2021-11-19 21:06:05,671][INFO ][exchange-worker-#11915%grid-0%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=003a0cc9-2754-4d39-b63e-fbb30d05a000, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=6, minorTopVer=0], evt=NODE_LEFT, evtNode=TcpDiscoveryNode [id=10ce8c9f-e4f8-4677-9026-4a4de00ef001, consistentId=client1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:0], discPort=0, order=3, intOrder=3, lastExchangeTime=1637345158554, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=true], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=6, minorTopVer=0]] [21:06:05] : [Step 4/5] [2021-11-19 21:06:05,674][INFO ][exchange-worker-#11915%grid-0%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=6, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=6, minorTopVer=0], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (3 ms), stage="Determine exchange type" (0 ms), stage="Exchange done" (5 ms), stage="Total time" (8 ms)] [21:06:05] : [Step 4/5] [2021-11-19 21:06:05,672][INFO ][exchange-worker-#12038%grid-6%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=6, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=6, minorTopVer=0], err=null, rebalanced=true, wasRebalanced=true] [21:06:05] : [Step 4/5] [2021-11-19 21:06:05,675][INFO ][exchange-worker-#11915%grid-0%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=6, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=6, minorTopVer=0]] [21:06:05] : [Step 4/5] [2021-11-19 21:06:05,677][INFO ][exchange-worker-#11915%grid-0%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=6, minorTopVer=0], crd=true] [21:06:05] : [Step 4/5] [2021-11-19 21:06:05,677][INFO ][exchange-worker-#12038%grid-6%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=60efc20b-b98d-4d8a-a216-3e743b573006, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=6, minorTopVer=0], evt=NODE_LEFT, evtNode=TcpDiscoveryNode [id=10ce8c9f-e4f8-4677-9026-4a4de00ef001, consistentId=client1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:0], discPort=0, order=3, intOrder=3, lastExchangeTime=1637345158564, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=true], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=6, minorTopVer=0]] [21:06:05] : [Step 4/5] [2021-11-19 21:06:05,679][INFO ][exchange-worker-#12038%grid-6%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=6, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=6, minorTopVer=0], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (0 ms), stage="Determine exchange type" (0 ms), stage="Exchange done" (7 ms), stage="Total time" (7 ms)] [21:06:05] : [Step 4/5] [2021-11-19 21:06:05,679][INFO ][exchange-worker-#12038%grid-6%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=6, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=6, minorTopVer=0]] [21:06:05] : [Step 4/5] [2021-11-19 21:06:05,680][INFO ][exchange-worker-#12038%grid-6%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=6, minorTopVer=0], crd=false] [21:06:05] : [Step 4/5] [2021-11-19 21:06:05,678][INFO ][exchange-worker-#11915%grid-0%][GridCachePartitionExchangeManager] AffinityTopologyVersion [topVer=6, minorTopVer=0], evt=NODE_LEFT, evtNode=10ce8c9f-e4f8-4677-9026-4a4de00ef001, client=false] [21:06:05] : [Step 4/5] [2021-11-19 21:06:05,678][INFO ][main][IgniteKernal%client1] [21:06:05] : [Step 4/5] [21:06:05] : [Step 4/5] >>> +------------------------------------------------------+ [21:06:05] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV stopped OK [21:06:05] : [Step 4/5] >>> +------------------------------------------------------+ [21:06:05] : [Step 4/5] >>> Ignite instance name: client1 [21:06:05] : [Step 4/5] >>> Grid uptime: 00:00:07.082 [21:06:05] : [Step 4/5] [21:06:05] : [Step 4/5] [21:06:05] : [Step 4/5] [2021-11-19 21:06:05,680][INFO ][exchange-worker-#12038%grid-6%][GridCachePartitionExchangeManager] AffinityTopologyVersion [topVer=6, minorTopVer=0], evt=NODE_LEFT, evtNode=10ce8c9f-e4f8-4677-9026-4a4de00ef001, client=false] [21:06:05] : [Step 4/5] [2021-11-19 21:06:05,681][INFO ][main][root] >>> Stopping grid [name=grid-0, id=003a0cc9-2754-4d39-b63e-fbb30d05a000] [21:06:06] : [Step 4/5] [2021-11-19 21:06:06,411][INFO ][db-checkpoint-thread-#12152%grid-0%][Checkpointer] Checkpoint started [checkpointId=835cd0c5-c735-4f5a-867f-1082fcadff2a, startPtr=WALPointer [idx=0, fileOff=649015, len=11928], checkpointBeforeLockTime=4ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=1ms, checkpointLockHoldTime=2ms, walCpRecordFsyncDuration=456ms, writeCheckpointEntryDuration=260ms, splitAndSortCpPagesDuration=1ms, pages=460, reason='timeout'] [21:06:06] : [Step 4/5] [2021-11-19 21:06:06,419][INFO ][tcp-disco-sock-reader-[60efc20b 127.0.0.1:53403]-#629%grid-0%-#12035%grid-0%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:53403, rmtPort=53403, rmtNodeId=60efc20b-b98d-4d8a-a216-3e743b573006] [21:06:06] : [Step 4/5] [2021-11-19 21:06:06,422][INFO ][main][GridCacheProcessor] Stopped cache [cacheName=encrypted] [21:06:06] : [Step 4/5] [2021-11-19 21:06:06,424][INFO ][main][GridCacheProcessor] Stopped cache [cacheName=ignite-sys-cache] [21:06:06] : [Step 4/5] [2021-11-19 21:06:06,427][INFO ][disco-event-worker-#12037%grid-6%][GridDiscoveryManager] Node left topology: TcpDiscoveryNode [id=003a0cc9-2754-4d39-b63e-fbb30d05a000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345158433, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false] [21:06:06] : [Step 4/5] [2021-11-19 21:06:06,428][INFO ][disco-event-worker-#12037%grid-6%][GridDiscoveryManager] Topology snapshot [ver=7, locNode=60efc20b, servers=1, clients=0, state=ACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=60efc20b-b98d-4d8a-a216-3e743b573006, consistentId=grid-6, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:06:06] : [Step 4/5] [2021-11-19 21:06:06,429][INFO ][disco-event-worker-#12037%grid-6%][GridDiscoveryManager] Coordinator changed [prev=TcpDiscoveryNode [id=003a0cc9-2754-4d39-b63e-fbb30d05a000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345158433, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], cur=TcpDiscoveryNode [id=60efc20b-b98d-4d8a-a216-3e743b573006, consistentId=grid-6, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637345166414, loc=true, ver=2.13.0#20211119-sha1:00000000, isClient=false]] [21:06:06] : [Step 4/5] [2021-11-19 21:06:06,430][INFO ][disco-event-worker-#12037%grid-6%][GridDiscoveryManager] ^-- Baseline [id=0, size=2, online=1, offline=1] [21:06:06] : [Step 4/5] [2021-11-19 21:06:06,431][INFO ][disco-event-worker-#12037%grid-6%][MvccProcessorImpl] Assigned mvcc coordinator [crd=MvccCoordinator [topVer=AffinityTopologyVersion [topVer=7, minorTopVer=0], nodeId=60efc20b-b98d-4d8a-a216-3e743b573006, ver=1637345157193, local=true, initialized=false]] [21:06:06] : [Step 4/5] [2021-11-19 21:06:06,433][INFO ][sys-#12028%grid-6%][ExchangeLatchManager] Become new coordinator 60efc20b-b98d-4d8a-a216-3e743b573006 [21:06:06] : [Step 4/5] [2021-11-19 21:06:06,433][INFO ][exchange-worker-#12038%grid-6%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=7, minorTopVer=0], crd=true, evt=NODE_LEFT, evtNode=003a0cc9-2754-4d39-b63e-fbb30d05a000, customEvt=null, allowMerge=false, exchangeFreeSwitch=true] [21:06:06] : [Step 4/5] [2021-11-19 21:06:06,434][INFO ][sys-#12025%grid-6%][GridAffinityAssignmentCache] Local node affinity assignment distribution is not ideal [cache=encrypted, expectedPrimary=1024.00, actualPrimary=499, expectedBackups=0.00, actualBackups=0, warningThreshold=50.00%] [21:06:06] : [Step 4/5] [2021-11-19 21:06:06,435][INFO ][exchange-worker-#12038%grid-6%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=7, minorTopVer=0], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:06:06] : [Step 4/5] [2021-11-19 21:06:06,437][INFO ][exchange-worker-#12038%grid-6%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=7, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=7, minorTopVer=0], err=null, rebalanced=true, wasRebalanced=true] [21:06:06]W: [org.apache.ignite:ignite-core] [2021-11-19 21:06:06,440][WARN ][exchange-worker-#12038%grid-6%][GridDhtPartitionTopologyImpl] Detected lost partitions [grp=encrypted, parts=[0-2, 4-8, 12-13, 17-18, 20, 24, 27, 31, 35-38, 41-43, 45-46, 48, 51, 53, 55, 57-58, 61, 63, 65, 70-73, 77, 80, 82-83, 88-89, 93, 95, 100, 103, 108-115, 119, 123-131, 133, 136-137, 142, 148, 152-153, 157-161, 163, 167-170, 178-184, 186, 188-190, 192-195, 200-201, 203-204, 207, 212, 215-218, 223, 225-228, 230, 232-234, 236, 238, 244, 246-247, 250-255, 257-260, 262-265, 267-268, 270, 274-275, 278, 281-282, 286, 288, 293, 296, 298, 300-301, 305, 307, 309, 313-315, 321, 323-324, 329, 331-338, 342-344, 347, 349-352, 354, 356, 362-364, 368-371, 375-376, 379-384, 389, 391, 393-395, 398-400, 403-404, 406-407, 409, 411-415, 417-418, 423, 427-432, 434, 436, 439, 444, 446-448, 451, 453, 457-460, 462, 464, 466, 469, 471-479, 481-484, 486-487, 489, 491, 493-494, 496, 498, 501, 504, 508, 511, 514, 517, 519-523, 526-528, 533-534, 536-537, 539-540, 542-545, 548, 550, 553-557, 560-561, 565-567, 570-571, 574, 576-578, 580, 582-583, 586, 590, 592-593, 595, 597-599, 601, 606, 610, 616-617, 620-626, 630-632, 634-635, 638, 641, 643, 645, 648-650, 653-655, 662-663, 666-667, 674-678, 680-681, 685, 687-691, 696-697, 699-702, 708, 710-711, 714-715, 718-720, 724, 726, 729, 731, 734, 736, 740-741, 743-744, 747-748, 753-757, 759, 761, 765-767, 769, 771-772, 774, 777, 779-781, 788, 791, 794-795, 797, 802, 804, 806-807, 810, 812, 814-816, 818-819, 821, 826-827, 830-831, 834-835, 837-838, 840-847, 852-853, 855-856, 859, 861-862, 864, 868-869, 873-877, 881-883, 885, 887-895, 897-898, 900-903, 907, 910-913, 916, 918-919, 921-924, 927, 929-930, 934-935, 938, 940, 943, 946, 949, 953, 955-966, 971, 974, 980, 982, 989, 991-992, 997-1000, 1002, 1006, 1008-1010, 1012, 1014-1015, 1017, 1019-1020, 1023], topVer=AffinityTopologyVersion [topVer=7, minorTopVer=0]] [21:06:06] : [Step 4/5] [2021-11-19 21:06:06,444][INFO ][exchange-worker-#12038%grid-6%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=60efc20b-b98d-4d8a-a216-3e743b573006, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=7, minorTopVer=0], evt=NODE_LEFT, evtNode=TcpDiscoveryNode [id=003a0cc9-2754-4d39-b63e-fbb30d05a000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345158433, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=7, minorTopVer=0]] [21:06:06] : [Step 4/5] [2021-11-19 21:06:06,446][INFO ][exchange-worker-#12038%grid-6%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=7, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=7, minorTopVer=0], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (1 ms), stage="Determine exchange type" (1 ms), stage="Preloading notification" (0 ms), stage="After states restored callback" (0 ms), stage="WAL history reservation" (0 ms), stage="Finalize update counters" (0 ms), stage="Detect lost partitions" (6 ms), stage="Exchange done" (2 ms), stage="Total time" (10 ms)] [21:06:06] : [Step 4/5] [2021-11-19 21:06:06,447][INFO ][exchange-worker-#12038%grid-6%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=7, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=7, minorTopVer=0], stage="Affinity initialization (exchange-free switch on fully-rebalanced topology) [grp=encrypted]" (1 ms) (parent=Determine exchange type), stage="Affinity initialization (exchange-free switch on fully-rebalanced topology) [grp=ignite-sys-cache]" (0 ms) (parent=Determine exchange type)] [21:06:06] : [Step 4/5] [2021-11-19 21:06:06,448][INFO ][exchange-worker-#12038%grid-6%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=7, minorTopVer=0], crd=true] [21:06:06] : [Step 4/5] [2021-11-19 21:06:06,450][INFO ][exchange-worker-#12038%grid-6%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=7, minorTopVer=0], force=false, evt=NODE_LEFT, node=003a0cc9-2754-4d39-b63e-fbb30d05a000] [21:06:10] : [Step 4/5] [2021-11-19 21:06:10,101][INFO ][main][FilePageStoreManager] Cleanup cache stores [total=4, left=0, cleanFiles=false] [21:06:10] : [Step 4/5] [2021-11-19 21:06:10,104][INFO ][main][GridDeploymentLocalStore] Removed undeployed class: GridDeployment [ts=1637345158686, depMode=SHARED, clsLdr=IsolatedClassLoader{roleName='test'}, clsLdrId=55e3d593d71-003a0cc9-2754-4d39-b63e-fbb30d05a000, userVer=0, loc=true, sampleClsName=org.apache.ignite.internal.processors.cache.distributed.dht.preloader.GridDhtPartitionMap, pendingUndeploy=false, undeployed=true, usage=0] [21:06:10] : [Step 4/5] [2021-11-19 21:06:10,113][INFO ][main][IgniteKernal%grid-0] [21:06:10] : [Step 4/5] [21:06:10] : [Step 4/5] >>> +------------------------------------------------------+ [21:06:10] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV stopped OK [21:06:10] : [Step 4/5] >>> +------------------------------------------------------+ [21:06:10] : [Step 4/5] >>> Ignite instance name: grid-0 [21:06:10] : [Step 4/5] >>> Grid uptime: 00:00:12.897 [21:06:10] : [Step 4/5] [21:06:10] : [Step 4/5] [21:06:10] : [Step 4/5] [2021-11-19 21:06:10,114][INFO ][main][root] >>> Stopping grid [name=grid-6, id=60efc20b-b98d-4d8a-a216-3e743b573006] [21:06:10] : [Step 4/5] [2021-11-19 21:06:10,131][INFO ][db-checkpoint-thread-#12157%grid-6%][Checkpointer] Checkpoint started [checkpointId=e624c0dd-6bea-4c5d-99ce-83139aad6327, startPtr=WALPointer [idx=0, fileOff=724808, len=11434], checkpointBeforeLockTime=5ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=1ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=5ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=0ms, pages=540, reason='timeout'] [21:06:10] : [Step 4/5] [2021-11-19 21:06:10,135][INFO ][tcp-disco-sock-reader-[003a0cc9 127.0.0.1:36751]-#628%grid-6%-#12034%grid-6%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:36751, rmtPort=36751, rmtNodeId=003a0cc9-2754-4d39-b63e-fbb30d05a000] [21:06:10] : [Step 4/5] [2021-11-19 21:06:10,137][INFO ][main][GridCacheProcessor] Stopped cache [cacheName=encrypted] [21:06:10] : [Step 4/5] [2021-11-19 21:06:10,139][INFO ][main][GridCacheProcessor] Stopped cache [cacheName=ignite-sys-cache] [21:06:11] : [Step 4/5] [2021-11-19 21:06:11,024][INFO ][main][FilePageStoreManager] Cleanup cache stores [total=4, left=0, cleanFiles=false] [21:06:11] : [Step 4/5] [2021-11-19 21:06:11,026][INFO ][main][GridDeploymentLocalStore] Removed undeployed class: GridDeployment [ts=1637345158696, depMode=SHARED, clsLdr=IsolatedClassLoader{roleName='test'}, clsLdrId=75e3d593d71-60efc20b-b98d-4d8a-a216-3e743b573006, userVer=0, loc=true, sampleClsName=org.apache.ignite.internal.processors.cache.distributed.dht.preloader.IgniteDhtPartitionHistorySuppliersMap, pendingUndeploy=false, undeployed=true, usage=0] [21:06:11] : [Step 4/5] [2021-11-19 21:06:11,033][INFO ][main][IgniteKernal%grid-6] [21:06:11] : [Step 4/5] [21:06:11] : [Step 4/5] >>> +------------------------------------------------------+ [21:06:11] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV stopped OK [21:06:11] : [Step 4/5] >>> +------------------------------------------------------+ [21:06:11] : [Step 4/5] >>> Ignite instance name: grid-6 [21:06:11] : [Step 4/5] >>> Grid uptime: 00:00:12.564 [21:06:11] : [Step 4/5] [21:06:11] : [Step 4/5] [21:06:11] : [Step 4/5] [21:06:11] >>> Starting test: EncryptedCacheNodeJoinTest#testNodeCantJoinWithSameNameButNotEncCache <<< [21:06:11] : [Step 4/5] [2021-11-19 21:06:11,317][INFO ][main][root] >>> Starting test: EncryptedCacheNodeJoinTest#testNodeCantJoinWithSameNameButNotEncCache <<< [21:06:11] : [Step 4/5] [21:06:11] >>> Heap: 283 MB used / 1899 MB commited / 1899 MB max <<< [21:06:11] : [Step 4/5] [2021-11-19 21:06:11,318][INFO ][main][root] >>> Heap: 283 MB used / 1899 MB commited / 1899 MB max <<< [21:06:11] : [Step 4/5] [21:06:11] >>> Non-Heap: 147 MB used / 160 MB commited / 0 MB max <<< [21:06:11] : [Step 4/5] [2021-11-19 21:06:11,318][INFO ][main][root] >>> Non-Heap: 147 MB used / 160 MB commited / 0 MB max <<< [21:06:11]W: [org.apache.ignite:ignite-core] [2021-11-19 21:06:11,323][WARN ][test-runner-#12324%encryption.EncryptedCacheNodeJoinTest%][G] Ignite work directory is not provided, automatically resolved to: /opt/buildagent/work/7bc1c54bc719b67c/work [21:06:11] : [Step 4/5] [2021-11-19 21:06:11,324][INFO ][test-runner-#12324%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] [21:06:11] : [Step 4/5] [21:06:11] : [Step 4/5] >>> __________ ________________ [21:06:11] : [Step 4/5] >>> / _/ ___/ |/ / _/_ __/ __/ [21:06:11] : [Step 4/5] >>> _/ // (7 7 // / / / / _/ [21:06:11] : [Step 4/5] >>> /___/\___/_/|_/___/ /_/ /___/ [21:06:11] : [Step 4/5] >>> [21:06:11] : [Step 4/5] >>> ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:06:11] : [Step 4/5] >>> 2021 Copyright(C) Apache Software Foundation [21:06:11] : [Step 4/5] >>> [21:06:11] : [Step 4/5] >>> Ignite documentation: http://ignite.apache.org [21:06:11] : [Step 4/5] [21:06:11] : [Step 4/5] [2021-11-19 21:06:11,325][INFO ][test-runner-#12324%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] Config URL: n/a [21:06:11] : [Step 4/5] [2021-11-19 21:06:11,326][INFO ][test-runner-#12324%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] IgniteConfiguration [igniteInstanceName=grid-0, pubPoolSize=24, svcPoolSize=24, callbackPoolSize=24, stripedPoolSize=24, sysPoolSize=24, mgmtPoolSize=4, dataStreamerPoolSize=24, utilityCachePoolSize=24, utilityCacheKeepAliveTime=60000, p2pPoolSize=2, qryPoolSize=24, buildIdxPoolSize=4, igniteHome=/opt/buildagent/work/7bc1c54bc719b67c, igniteWorkDir=/opt/buildagent/work/7bc1c54bc719b67c/work, mbeanSrv=com.sun.jmx.mbeanserver.JmxMBeanServer@6fe85038, nodeId=00036eec-694d-4fb2-8ed7-204087e9d000, marsh=BinaryMarshaller [], marshLocJobs=false, daemon=false, p2pEnabled=true, netTimeout=10000, netCompressionLevel=1, sndRetryDelay=1000, sndRetryCnt=3, metricsHistSize=10000, metricsUpdateFreq=1000, metricsExpTime=9223372036854775807, discoSpi=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=0, ackTimeout=0, marsh=null, reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], segPlc=STOP, segResolveAttempts=2, waitForSegOnStart=true, allResolversPassReq=true, segChkFreq=10000, commSpi=TcpCommunicationSpi [connectGate=org.apache.ignite.spi.communication.tcp.internal.ConnectGateway@47a58a3b, ctxInitLatch=java.util.concurrent.CountDownLatch@6f49980c[Count = 1], stopping=false, clientPool=null, nioSrvWrapper=null, stateProvider=null], evtSpi=MemoryEventStorageSpi [expireAgeMs=9223372036854775807, expireCnt=10000, filter=null], colSpi=NoopCollisionSpi [], deploySpi=LocalDeploymentSpi [], indexingSpi=org.apache.ignite.spi.indexing.noop.NoopIndexingSpi@30f256db, addrRslvr=null, encryptionSpi=org.apache.ignite.spi.encryption.keystore.KeystoreEncryptionSpi@2e1494a6, tracingSpi=org.apache.ignite.spi.tracing.NoopTracingSpi@6af69375, clientMode=false, rebalanceThreadPoolSize=4, rebalanceTimeout=10000, rebalanceBatchesPrefetchCnt=3, rebalanceThrottle=0, rebalanceBatchSize=524288, txCfg=TransactionConfiguration [txSerEnabled=false, dfltIsolation=REPEATABLE_READ, dfltConcurrency=PESSIMISTIC, dfltTxTimeout=0, txTimeoutOnPartitionMapExchange=0, deadlockTimeout=10000, pessimisticTxLogSize=0, pessimisticTxLogLinger=10000, tmLookupClsName=null, txManagerFactory=null, useJtaSync=false], cacheSanityCheckEnabled=true, discoStartupDelay=60000, deployMode=SHARED, p2pMissedCacheSize=100, locHost=127.0.0.1, timeSrvPortBase=31100, timeSrvPortRange=100, failureDetectionTimeout=10000, sysWorkerBlockedTimeout=null, clientFailureDetectionTimeout=10000, metricsLogFreq=0, connectorCfg=null, odbcCfg=null, warmupClos=null, atomicCfg=AtomicConfiguration [seqReserveSize=1000, cacheMode=PARTITIONED, backups=1, aff=null, grpName=null], classLdr=null, sslCtxFactory=null, platformCfg=null, binaryCfg=null, memCfg=null, pstCfg=null, dsCfg=DataStorageConfiguration [sysRegionInitSize=41943040, sysRegionMaxSize=104857600, pageSize=4096, concLvl=0, dfltDataRegConf=DataRegionConfiguration [name=default, maxSize=10485760, initSize=268435456, swapPath=null, pageEvictionMode=DISABLED, pageReplacementMode=CLOCK, evictionThreshold=0.9, emptyPagesPoolSize=100, metricsEnabled=false, metricsSubIntervalCount=5, metricsRateTimeInterval=60000, persistenceEnabled=true, checkpointPageBufSize=0, lazyMemoryAllocation=true, warmUpCfg=null], dataRegions=null, storagePath=null, checkpointFreq=180000, lockWaitTime=10000, checkpointThreads=4, checkpointWriteOrder=SEQUENTIAL, walHistSize=20, maxWalArchiveSize=1073741824, walSegments=10, walSegmentSize=67108864, walPath=db/wal, walArchivePath=db/wal/archive, cdcWalPath=db/wal/cdc, cdcEnabled=false, metricsEnabled=false, walMode=FSYNC, walTlbSize=131072, walBuffSize=0, walFlushFreq=2000, walFsyncDelay=1000, walRecordIterBuffSize=67108864, alwaysWriteFullPages=false, fileIOFactory=org.apache.ignite.internal.processors.cache.persistence.file.AsyncFileIOFactory@1771f329, metricsSubIntervalCnt=5, metricsRateTimeInterval=60000, walAutoArchiveAfterInactivity=-1, walForceArchiveTimeout=-1, writeThrottlingEnabled=false, walCompactionEnabled=false, walCompactionLevel=1, checkpointReadLockTimeout=null, walPageCompression=DISABLED, walPageCompressionLevel=null, dfltWarmUpCfg=null, encCfg=org.apache.ignite.configuration.EncryptionConfiguration@1e757aff, defragmentationThreadPoolSize=4, minWalArchiveSize=-1], snapshotPath=snapshots, activeOnStart=true, activeOnStartPropSetFlag=false, autoActivation=true, autoActivationPropSetFlag=false, clusterStateOnStart=null, sqlConnCfg=null, cliConnCfg=ClientConnectorConfiguration [host=null, port=10800, portRange=100, sockSndBufSize=0, sockRcvBufSize=0, tcpNoDelay=true, maxOpenCursorsPerConn=128, threadPoolSize=24, selectorCnt=12, idleTimeout=0, handshakeTimeout=10000, jdbcEnabled=true, odbcEnabled=true, thinCliEnabled=true, sslEnabled=false, useIgniteSslCtxFactory=true, sslClientAuth=false, sslCtxFactory=null, thinCliCfg=ThinClientConfiguration [maxActiveTxPerConn=100, maxActiveComputeTasksPerConn=0]], mvccVacuumThreadCnt=2, mvccVacuumFreq=5000, authEnabled=false, failureHnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]], commFailureRslvr=null, sqlCfg=SqlConfiguration [longQryWarnTimeout=3000, dfltQryTimeout=0, sqlQryHistSize=1000, validationEnabled=false], asyncContinuationExecutor=null] [21:06:11] : [Step 4/5] [2021-11-19 21:06:11,333][INFO ][test-runner-#12324%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] Daemon mode: off [21:06:11] : [Step 4/5] [2021-11-19 21:06:11,333][INFO ][test-runner-#12324%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] OS: Linux 4.15.0-151-generic amd64 [21:06:11] : [Step 4/5] [2021-11-19 21:06:11,333][INFO ][test-runner-#12324%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] OS user: teamcity [21:06:11] : [Step 4/5] [2021-11-19 21:06:11,334][INFO ][test-runner-#12324%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] PID: 16724 [21:06:11] : [Step 4/5] [2021-11-19 21:06:11,334][INFO ][test-runner-#12324%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] Language runtime: Java Platform API Specification ver. 1.8 [21:06:11] : [Step 4/5] [2021-11-19 21:06:11,334][INFO ][test-runner-#12324%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] VM information: Java(TM) SE Runtime Environment 1.8.0_261-b12 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 25.261-b12 [21:06:11] : [Step 4/5] [2021-11-19 21:06:11,334][INFO ][test-runner-#12324%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] VM total memory: 1.9GB [21:06:11] : [Step 4/5] [2021-11-19 21:06:11,335][INFO ][test-runner-#12324%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] Remote Management [restart: off, REST: off, JMX (remote: off)] [21:06:11] : [Step 4/5] [2021-11-19 21:06:11,335][INFO ][test-runner-#12324%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] Logger: GridTestLog4jLogger [quiet=false, config=null] [21:06:11] : [Step 4/5] [2021-11-19 21:06:11,335][INFO ][test-runner-#12324%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] IGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c [21:06:11] : [Step 4/5] [2021-11-19 21:06:11,335][INFO ][test-runner-#12324%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] VM arguments: [-DIGNITE_DUMP_THREADS_ON_FAILURE=false, -DMono=/usr/bin/mono-sgen, -DMono4.0_x64=/usr/lib/mono/4.0, -DMono4.5_x64=/usr/lib/mono/4.5, -DMonoVersion=6.12.0.90, -DSKIP_BUILD=false, -Dagent.home.dir=/opt/buildagent, -Dagent.name=aitc-lin02_03, -Dagent.ownPort=9090, -Dagent.work.dir=/opt/buildagent/work, -Dbuild.number=95, -Dbuild.vcs.number=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.1=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.GitHubApacheIgnite=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dclassworlds.conf=/opt/buildagent/temp/buildTmp/teamcity.m2.conf, -Dcom.jetbrains.maven.watcher.report.file=/opt/buildagent/temp/buildTmp/maven-build-info.xml, -Djava.io.tmpdir=/opt/buildagent/temp/buildTmp, -Dmaven.home=/opt/buildagent/tools/maven3_6, -Dmaven.multiModuleProjectDirectory=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.agent.cpuBenchmark=457, -Dteamcity.agent.dotnet.agent_url=http://localhost:9090/RPC2, -Dteamcity.agent.dotnet.build_id=6278078, -Dteamcity.auth.password=*******, -Dteamcity.auth.userId=TeamCityBuildId=6278078, -Dteamcity.build.changedFiles.file=/opt/buildagent/temp/buildTmp/changedFiles6342607772318147725.txt, -Dteamcity.build.checkoutDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.build.id=6278078, -Dteamcity.build.properties.file=/opt/buildagent/temp/buildTmp/teamcity.build5164517880467851002.properties, -Dteamcity.build.tempDir=/opt/buildagent/temp/buildTmp, -Dteamcity.build.workingDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.buildConfName=Basic 3, -Dteamcity.buildType.id=IgniteTests24Java8_Basic3, -Dteamcity.configuration.properties.file=/opt/buildagent/temp/buildTmp/teamcity.config5591980786735343870.properties, -Dteamcity.maven.userSettings.path=/opt/buildagent/temp/buildTmp/maven_settings_585072866407032347.xml, -Dteamcity.maven.watcher.home=/opt/buildagent/plugins/mavenPlugin/maven-watcher-jdk16, -Dteamcity.projectName=Ignite Tests 2.x (JDK 8/11), -Dteamcity.runner.properties.file=/opt/buildagent/temp/buildTmp/teamcity.runner9098465561618137420.properties, -Dteamcity.tests.recentlyFailedTests.file=/opt/buildagent/temp/buildTmp/testsToRunFirst3891775683130404069.txt, -Dteamcity.version=2021.2 (build 99542), -ea, -Xms2g, -Xmx2g, -XX:+HeapDumpOnOutOfMemoryError, -DIGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_TEST_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_UPDATE_NOTIFIER=false, -DIGNITE_NO_DISCO_ORDER=true, -DIGNITE_PERFORMANCE_SUGGESTIONS_DISABLED=true, -Djava.net.preferIPv4Stack=true, -DTEST_SCALE_FACTOR=1.0, -DIGNITE_TEST_PROP_LOG4J_FILE=log4j-tc-test.xml, -DIGNITE_QUIET=false, -DIGNITE_MARSHAL_BUFFERS_RECHECK=1000, -Dmaven.repo.local=/opt/buildagent/.m2/repository] [21:06:11] : [Step 4/5] [2021-11-19 21:06:11,339][INFO ][test-runner-#12324%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] System cache's DataRegion size is configured to 40 MB. Use DataStorageConfiguration.systemRegionInitialSize property to change the setting. [21:06:11] : [Step 4/5] [2021-11-19 21:06:11,339][INFO ][test-runner-#12324%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] Configured caches [in 'sysMemPlc' dataRegion: ['ignite-sys-cache'], in 'default' dataRegion: ['encrypted']] [21:06:11]W: [org.apache.ignite:ignite-core] [2021-11-19 21:06:11,340][WARN ][test-runner-#12324%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] Peer class loading is enabled (disable it in production for performance and deployment consistency reasons) [21:06:11] : [Step 4/5] [2021-11-19 21:06:11,340][INFO ][test-runner-#12324%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] 3-rd party licenses can be found at: /opt/buildagent/work/7bc1c54bc719b67c/libs/licenses [21:06:11] : [Step 4/5] [2021-11-19 21:06:11,344][INFO ][test-runner-#12324%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] Configured plugins: [21:06:11] : [Step 4/5] [2021-11-19 21:06:11,344][INFO ][test-runner-#12324%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- StanByClusterTestProvider 1.0 [21:06:11] : [Step 4/5] [2021-11-19 21:06:11,344][INFO ][test-runner-#12324%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- null [21:06:11] : [Step 4/5] [2021-11-19 21:06:11,344][INFO ][test-runner-#12324%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] [21:06:11] : [Step 4/5] [2021-11-19 21:06:11,344][INFO ][test-runner-#12324%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- PageMemory tracker plugin 1.0 [21:06:11] : [Step 4/5] [2021-11-19 21:06:11,344][INFO ][test-runner-#12324%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- null [21:06:11] : [Step 4/5] [2021-11-19 21:06:11,345][INFO ][test-runner-#12324%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] [21:06:11] : [Step 4/5] [2021-11-19 21:06:11,345][INFO ][test-runner-#12324%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- TestDistibutedConfigurationPlugin 1.0 [21:06:11] : [Step 4/5] [2021-11-19 21:06:11,345][INFO ][test-runner-#12324%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- null [21:06:11] : [Step 4/5] [2021-11-19 21:06:11,345][INFO ][test-runner-#12324%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] [21:06:11] : [Step 4/5] [2021-11-19 21:06:11,345][INFO ][test-runner-#12324%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- NodeValidationPluginProvider 1.0 [21:06:11] : [Step 4/5] [2021-11-19 21:06:11,346][INFO ][test-runner-#12324%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- null [21:06:11] : [Step 4/5] [2021-11-19 21:06:11,346][INFO ][test-runner-#12324%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] [21:06:11] : [Step 4/5] [2021-11-19 21:06:11,346][INFO ][test-runner-#12324%encryption.EncryptedCacheNodeJoinTest%][FailureProcessor] Configured failure handler: [hnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]]] [21:06:11] : [Step 4/5] [2021-11-19 21:06:11,356][INFO ][test-runner-#12324%encryption.EncryptedCacheNodeJoinTest%][TcpCommunicationSpi] Successfully bound communication NIO server to TCP port [port=45150, locHost=/127.0.0.1, selectorsCnt=12, selectorSpins=0, pairedConn=false] [21:06:11]W: [org.apache.ignite:ignite-core] [2021-11-19 21:06:11,357][WARN ][test-runner-#12324%encryption.EncryptedCacheNodeJoinTest%][TcpCommunicationSpi] Message queue limit is set to 0 which may lead to potential OOMEs when running cache operations in FULL_ASYNC or PRIMARY_SYNC modes due to message queues growth on sender and receiver sides. [21:06:11] : [Step 4/5] [2021-11-19 21:06:11,361][INFO ][test-runner-#12324%encryption.EncryptedCacheNodeJoinTest%][GridCollisionManager] Collision resolution is disabled (all jobs will be activated upon arrival). [21:06:11] : [Step 4/5] [2021-11-19 21:06:11,361][INFO ][test-runner-#12324%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] Security status [authentication=off, sandbox=off, tls/ssl=off] [21:06:11] : [Step 4/5] [2021-11-19 21:06:11,418][INFO ][test-runner-#12324%encryption.EncryptedCacheNodeJoinTest%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:06:11] : [Step 4/5] [2021-11-19 21:06:11,505][INFO ][test-runner-#12324%encryption.EncryptedCacheNodeJoinTest%][MaintenanceProcessor] Resolved store directory for node persistent data: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0 [21:06:11] : [Step 4/5] [2021-11-19 21:06:11,507][INFO ][test-runner-#12324%encryption.EncryptedCacheNodeJoinTest%][CacheObjectBinaryProcessorImpl] Resolved directory for serialized binary metadata: /opt/buildagent/work/7bc1c54bc719b67c/work/db/binary_meta/grid_0 [21:06:11] : [Step 4/5] [2021-11-19 21:06:11,511][INFO ][test-runner-#12324%encryption.EncryptedCacheNodeJoinTest%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0 [21:06:11] : [Step 4/5] [2021-11-19 21:06:11,512][INFO ][test-runner-#12324%encryption.EncryptedCacheNodeJoinTest%][FileWriteAheadLogManager] Resolved write ahead log work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0 [21:06:11] : [Step 4/5] [2021-11-19 21:06:11,512][INFO ][test-runner-#12324%encryption.EncryptedCacheNodeJoinTest%][FileWriteAheadLogManager] Resolved write ahead log archive directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0 [21:06:11] : [Step 4/5] [2021-11-19 21:06:11,944][INFO ][test-runner-#12324%encryption.EncryptedCacheNodeJoinTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000000.wal [21:06:11]W: [org.apache.ignite:ignite-core] [2021-11-19 21:06:11,946][WARN ][test-runner-#12324%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] DataRegion maxSize=10.5 MB is smaller than defaultInitialSize=268.4 MB, setting initialSize to 10.5 MB [21:06:11] : [Step 4/5] [2021-11-19 21:06:11,950][INFO ][test-runner-#12324%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Configured data regions initialized successfully [total=5] [21:06:11] : [Step 4/5] [2021-11-19 21:06:11,952][INFO ][test-runner-#12324%encryption.EncryptedCacheNodeJoinTest%][IgniteSnapshotManager] Resolved snapshot work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/snapshots [21:06:11] : [Step 4/5] [2021-11-19 21:06:11,953][INFO ][test-runner-#12324%encryption.EncryptedCacheNodeJoinTest%][IgniteSnapshotManager] Resolved temp directory for snapshot creation: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0/snp [21:06:11] : [Step 4/5] [2021-11-19 21:06:11,955][INFO ][test-runner-#12324%encryption.EncryptedCacheNodeJoinTest%][ClientListenerProcessor] Client connector processor has started on TCP port 10800 [21:06:11] : [Step 4/5] [2021-11-19 21:06:11,961][INFO ][test-runner-#12324%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] Non-loopback local IPs: 172.17.0.4 [21:06:11] : [Step 4/5] [2021-11-19 21:06:11,961][INFO ][test-runner-#12324%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] Enabled local MACs: 0242AC110004 [21:06:11] : [Step 4/5] [2021-11-19 21:06:11,963][INFO ][test-runner-#12324%encryption.EncryptedCacheNodeJoinTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:06:11] : [Step 4/5] [2021-11-19 21:06:11,964][INFO ][test-runner-#12324%encryption.EncryptedCacheNodeJoinTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:06:11] : [Step 4/5] [2021-11-19 21:06:11,965][INFO ][test-runner-#12324%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:06:11] : [Step 4/5] [2021-11-19 21:06:11,968][INFO ][test-runner-#12324%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Applying lost metastore updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:06:11] : [Step 4/5] [2021-11-19 21:06:11,969][INFO ][test-runner-#12324%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=0 ms] [21:06:11] : [Step 4/5] [2021-11-19 21:06:11,969][INFO ][test-runner-#12324%encryption.EncryptedCacheNodeJoinTest%][GridCacheProcessor] Restoring partition state for local groups. [21:06:11] : [Step 4/5] [2021-11-19 21:06:11,969][INFO ][test-runner-#12324%encryption.EncryptedCacheNodeJoinTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=0, partitionsProcessed=0, time=0ms] [21:06:11] : [Step 4/5] [2021-11-19 21:06:11,970][INFO ][test-runner-#12324%encryption.EncryptedCacheNodeJoinTest%][GridEncryptionManager] Encryption keys loaded from metastore. [grps=, masterKeyName=ignite.master.key] [21:06:11] : [Step 4/5] [2021-11-19 21:06:11,975][INFO ][test-runner-#12324%encryption.EncryptedCacheNodeJoinTest%][ClusterProcessor] Cluster ID and tag has been read from metastorage: null [21:06:11] : [Step 4/5] [2021-11-19 21:06:11,975][INFO ][test-runner-#12324%encryption.EncryptedCacheNodeJoinTest%][IgniteClusterImpl] Shutdown policy was updated [oldVal=null, newVal=null] [21:06:11] : [Step 4/5] [2021-11-19 21:06:11,976][INFO ][test-runner-#12324%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Checkpoint frequency deviation changed [oldVal=null, newVal=null] [21:06:11] : [Step 4/5] [2021-11-19 21:06:11,985][INFO ][test-runner-#12324%encryption.EncryptedCacheNodeJoinTest%][FilePageStoreManager] Cleanup cache stores [total=1, left=0, cleanFiles=false] [21:06:11] : [Step 4/5] [2021-11-19 21:06:11,988][INFO ][test-runner-#12324%encryption.EncryptedCacheNodeJoinTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:06:11] : [Step 4/5] [2021-11-19 21:06:11,988][INFO ][test-runner-#12324%encryption.EncryptedCacheNodeJoinTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:06:11] : [Step 4/5] [2021-11-19 21:06:11,990][INFO ][test-runner-#12324%encryption.EncryptedCacheNodeJoinTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:06:11] : [Step 4/5] [2021-11-19 21:06:11,990][INFO ][test-runner-#12324%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Data Regions Started: 5 [21:06:11] : [Step 4/5] [2021-11-19 21:06:11,991][INFO ][test-runner-#12324%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] ^-- sysMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:06:11] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:06:11] : [Step 4/5] ^-- default region [type=default, persistence=true, lazyAlloc=true, [21:06:11] : [Step 4/5] ... initCfg=10MB, maxCfg=10MB, usedRam=0MB, freeRam=100%, allocRam=0MB, allocTotal=0MB] [21:06:11] : [Step 4/5] ^-- metastoreMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:06:11] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:06:11] : [Step 4/5] ^-- TxLog region [type=internal, persistence=true, lazyAlloc=false, [21:06:11] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:06:11] : [Step 4/5] ^-- volatileDsMemPlc region [type=user, persistence=false, lazyAlloc=true, [21:06:11] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB] [21:06:11] : [Step 4/5] ^-- Ignite persistence [used=0MB] [21:06:11] : [Step 4/5] [21:06:11] : [Step 4/5] [2021-11-19 21:06:11,992][INFO ][test-runner-#12324%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Starting binary memory restore for: [-2100569601, 1613773252] [21:06:12] : [Step 4/5] [2021-11-19 21:06:12,051][INFO ][test-runner-#12324%encryption.EncryptedCacheNodeJoinTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:06:12] : [Step 4/5] [2021-11-19 21:06:12,051][INFO ][test-runner-#12324%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:06:12] : [Step 4/5] [2021-11-19 21:06:12,052][INFO ][test-runner-#12324%encryption.EncryptedCacheNodeJoinTest%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000000.wal, offset=0, ver=2] [21:06:12] : [Step 4/5] [2021-11-19 21:06:12,058][INFO ][test-runner-#12324%encryption.EncryptedCacheNodeJoinTest%][GridCacheProcessor] Started cache in recovery mode [name=ignite-sys-cache, id=-2100569601, dataRegionName=sysMemPlc, mode=REPLICATED, atomicity=TRANSACTIONAL, backups=2147483647, mvcc=false] [21:06:12] : [Step 4/5] [2021-11-19 21:06:12,059][INFO ][test-runner-#12324%encryption.EncryptedCacheNodeJoinTest%][PageMemoryImpl] Started page memory [memoryAllocated=24.0 MiB, pages=5952, tableSize=474.2 KiB, replacementSize=768 B, checkpointBuffer=10.0 MiB] [21:06:12] : [Step 4/5] [2021-11-19 21:06:12,062][INFO ][test-runner-#12324%encryption.EncryptedCacheNodeJoinTest%][GridCacheProcessor] Started cache in recovery mode [name=encrypted, id=1613773252, dataRegionName=default, mode=PARTITIONED, atomicity=TRANSACTIONAL, backups=0, mvcc=false] [21:06:12] : [Step 4/5] [2021-11-19 21:06:12,063][INFO ][test-runner-#12324%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Binary recovery performed in 71 ms. [21:06:12] : [Step 4/5] [2021-11-19 21:06:12,063][INFO ][test-runner-#12324%encryption.EncryptedCacheNodeJoinTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:06:12] : [Step 4/5] [2021-11-19 21:06:12,064][INFO ][test-runner-#12324%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Applying lost cache updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:06:12] : [Step 4/5] [2021-11-19 21:06:12,134][INFO ][test-runner-#12324%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=71 ms] [21:06:12] : [Step 4/5] [2021-11-19 21:06:12,135][INFO ][test-runner-#12324%encryption.EncryptedCacheNodeJoinTest%][GridCacheProcessor] Restoring partition state for local groups. [21:06:12] : [Step 4/5] [2021-11-19 21:06:12,156][INFO ][test-runner-#12324%encryption.EncryptedCacheNodeJoinTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=2, partitionsProcessed=1124, time=20ms] [21:06:12] : [Step 4/5] [2021-11-19 21:06:12,532][INFO ][test-runner-#12324%encryption.EncryptedCacheNodeJoinTest%][TestTcpDiscoverySpi] Successfully bound to TCP port [port=47500, localHost=localhost/127.0.0.1, locNodeId=00036eec-694d-4fb2-8ed7-204087e9d000] [21:06:12] : [Step 4/5] [2021-11-19 21:06:12,535][INFO ][test-runner-#12324%encryption.EncryptedCacheNodeJoinTest%][GridEncryptionManager] Sending new group keys to coordinator [grps=1613773252] [21:06:12] : [Step 4/5] [2021-11-19 21:06:12,544][INFO ][disco-notifier-worker-#12436%grid-0%][MvccProcessorImpl] Assigned mvcc coordinator [crd=MvccCoordinator [topVer=AffinityTopologyVersion [topVer=1, minorTopVer=0], nodeId=00036eec-694d-4fb2-8ed7-204087e9d000, ver=1637345172536, local=true, initialized=false]] [21:06:12] : [Step 4/5] [2021-11-19 21:06:12,545][INFO ][disco-notifier-worker-#12436%grid-0%][GridEncryptionManager] Added encryption key on local join [grpId=1613773252] [21:06:12] : [Step 4/5] [2021-11-19 21:06:12,546][INFO ][sys-#12414%grid-0%][ClusterProcessor] Writing cluster ID and tag to metastorage on ready for write ClusterIdAndTag [id=636d0e0f-9adc-4c20-9e64-fb5246382e0b, tag=interesting_montalcini] [21:06:12] : [Step 4/5] [2021-11-19 21:06:12,549][INFO ][disco-notifier-worker-#12436%grid-0%][ClusterProcessor] interesting_montalcini [21:06:12] : [Step 4/5] [2021-11-19 21:06:12,549][INFO ][disco-notifier-worker-#12436%grid-0%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustEnabled' was changed from 'null' to 'false' [21:06:12] : [Step 4/5] [2021-11-19 21:06:12,551][INFO ][disco-notifier-worker-#12436%grid-0%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustTimeout' was changed from 'null' to '300000' [21:06:12] : [Step 4/5] [2021-11-19 21:06:12,551][INFO ][disco-notifier-worker-#12436%grid-0%][IgniteTxManager] Transactions parameter 'longOperationsDumpTimeout' was changed from 'null' to '60000' [21:06:12] : [Step 4/5] [2021-11-19 21:06:12,552][INFO ][disco-notifier-worker-#12436%grid-0%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpThreshold' was changed from 'null' to '0' [21:06:12] : [Step 4/5] [2021-11-19 21:06:12,552][INFO ][disco-notifier-worker-#12436%grid-0%][IgniteTxManager] Transactions parameter 'transactionTimeDumpSamplesCoefficient' was changed from 'null' to '0.0' [21:06:12] : [Step 4/5] [2021-11-19 21:06:12,553][INFO ][disco-notifier-worker-#12436%grid-0%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpSamplesPerSecondLimit' was changed from 'null' to '5' [21:06:12] : [Step 4/5] [2021-11-19 21:06:12,553][INFO ][disco-notifier-worker-#12436%grid-0%][IgniteTxManager] Transactions parameter 'collisionsDumpInterval' was changed from 'null' to '1000' [21:06:12] : [Step 4/5] [2021-11-19 21:06:12,553][INFO ][disco-notifier-worker-#12436%grid-0%][IgniteTxManager] Transactions parameter 'txOwnerDumpRequestsAllowed' was changed from 'null' to 'true' [21:06:12] : [Step 4/5] [2021-11-19 21:06:12,554][INFO ][disco-notifier-worker-#12436%grid-0%][GridCacheDatabaseSharedManager] Historical rebalance WAL threshold changed [property=historical.rebalance.threshold, oldVal=null, newVal=500] [21:06:12] : [Step 4/5] [2021-11-19 21:06:12,562][INFO ][test-runner-#12324%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] To start Console Management & Monitoring run ignitevisorcmd.{sh|bat} [21:06:12] : [Step 4/5] [2021-11-19 21:06:12,562][INFO ][test-runner-#12324%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] [21:06:12] : [Step 4/5] [21:06:12] : [Step 4/5] >>> +-------------------------------------------+ [21:06:12] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:06:12] : [Step 4/5] >>> +-------------------------------------------+ [21:06:12] : [Step 4/5] >>> OS name: Linux 4.15.0-151-generic amd64 [21:06:12] : [Step 4/5] >>> CPU(s): 24 [21:06:12] : [Step 4/5] >>> Heap: 2.0GB [21:06:12] : [Step 4/5] >>> VM name: 16724@c4dfe9a430b2 [21:06:12] : [Step 4/5] >>> Ignite instance name: grid-0 [21:06:12] : [Step 4/5] >>> Local node [ID=00036EEC-694D-4FB2-8ED7-204087E9D000, order=1, clientMode=false] [21:06:12] : [Step 4/5] >>> Local node addresses: [127.0.0.1] [21:06:12] : [Step 4/5] >>> Local ports: TCP:10800 TCP:45150 TCP:47500 [21:06:12] : [Step 4/5] [21:06:12] : [Step 4/5] [2021-11-19 21:06:12,563][INFO ][test-runner-#12324%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] >>> Ignite cluster is in INACTIVE state (limited functionality available). Use control.(sh|bat) script or IgniteCluster.state(ClusterState.ACTIVE) to change the state. [21:06:12] : [Step 4/5] [2021-11-19 21:06:12,564][INFO ][test-runner-#12324%encryption.EncryptedCacheNodeJoinTest%][GridDiscoveryManager] Topology snapshot [ver=1, locNode=00036eec, servers=1, clients=0, state=INACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=00036eec-694d-4fb2-8ed7-204087e9d000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:06:12] : [Step 4/5] [2021-11-19 21:06:12,564][INFO ][test-runner-#12324%encryption.EncryptedCacheNodeJoinTest%][G] Node started : [stage="Configure system pool" (0 ms),stage="Start managers" (182 ms),stage="Configure binary metadata" (2 ms),stage="Start processors" (451 ms),stage="Start 'StanByClusterTestProvider' plugin" (0 ms),stage="Start 'PageMemory tracker plugin' plugin" (0 ms),stage="Start 'TestDistibutedConfigurationPlugin' plugin" (0 ms),stage="Start 'NodeValidationPluginProvider' plugin" (0 ms),stage="Init metastore" (25 ms),stage="Init and start regions" (6 ms),stage="Restore binary memory" (71 ms),stage="Restore logical state" (92 ms),stage="Finish recovery" (374 ms),stage="Join topology" (13 ms),stage="Await transition" (2 ms),stage="Await exchange" (17 ms),stage="Total time" (1235 ms)] [21:06:12] : [Step 4/5] [2021-11-19 21:06:12,566][INFO ][test-runner-#12324%encryption.EncryptedCacheNodeJoinTest%][root] Node started with the following configuration [id=00036eec-694d-4fb2-8ed7-204087e9d000, marshaller=BinaryMarshaller [], discovery=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=5000, ackTimeout=5000, marsh=JdkMarshaller [clsFilter=org.apache.ignite.marshaller.MarshallerUtils$1@7328aab4], reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], binaryCfg=null, lateAff=true] [21:06:12] : [Step 4/5] [2021-11-19 21:06:12,568][INFO ][test-runner-#12324%encryption.EncryptedCacheNodeJoinTest%][GridClusterStateProcessor] Sending activate cluster request with BaselineTopology BaselineTopology [id=0, branchingHash=-1237657751, branchingType='New BaselineTopology', baselineNodes=[grid-0]] [21:06:12] : [Step 4/5] [2021-11-19 21:06:12,574][INFO ][disco-notifier-worker-#12436%grid-0%][GridClusterStateProcessor] Received activate cluster request with BaselineTopology[id=0] initiator node ID: 00036eec-694d-4fb2-8ed7-204087e9d000 [21:06:12] : [Step 4/5] [2021-11-19 21:06:12,574][INFO ][disco-notifier-worker-#12436%grid-0%][GridClusterStateProcessor] Started state transition: activate cluster [21:06:12] : [Step 4/5] [2021-11-19 21:06:12,575][INFO ][exchange-worker-#12441%grid-0%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=1, minorTopVer=1], crd=true, evt=DISCOVERY_CUSTOM_EVT, evtNode=00036eec-694d-4fb2-8ed7-204087e9d000, customEvt=ChangeGlobalStateMessage [id=4454d593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqId=ea031a5b-52ae-47c0-a985-2e37c42b03bd, initiatingNodeId=00036eec-694d-4fb2-8ed7-204087e9d000, state=ACTIVE, baselineTopology=BaselineTopology [id=0, branchingHash=-1237657751, branchingType='New BaselineTopology', baselineNodes=[grid-0]], forceChangeBaselineTopology=false, timestamp=1637345172568, forceDeactivation=true], allowMerge=false, exchangeFreeSwitch=false] [21:06:12] : [Step 4/5] [2021-11-19 21:06:12,576][INFO ][exchange-worker-#12441%grid-0%][GridDhtPartitionsExchangeFuture] Start activation process [nodeId=00036eec-694d-4fb2-8ed7-204087e9d000, client=false, topVer=AffinityTopologyVersion [topVer=1, minorTopVer=1]]. New state: ACTIVE [21:06:12] : [Step 4/5] [2021-11-19 21:06:12,577][INFO ][exchange-worker-#12441%grid-0%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0 [21:06:12] : [Step 4/5] [2021-11-19 21:06:12,579][INFO ][exchange-worker-#12441%grid-0%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000000.wal, offset=13104, ver=2] [21:06:12] : [Step 4/5] [2021-11-19 21:06:12,582][INFO ][exchange-worker-#12441%grid-0%][GridClusterStateProcessor] Writing BaselineTopology[id=0] [21:06:12] : [Step 4/5] [2021-11-19 21:06:12,584][INFO ][exchange-worker-#12441%grid-0%][GridCacheDatabaseSharedManager] Finish recovery performed in 6 ms. [21:06:12] : [Step 4/5] [2021-11-19 21:06:12,585][INFO ][exchange-worker-#12441%grid-0%][msg] Components activation performed in 8 ms. [21:06:12] : [Step 4/5] [2021-11-19 21:06:12,586][INFO ][exchange-worker-#12441%grid-0%][GridCacheProcessor] Finished recovery for cache [cache=ignite-sys-cache, grp=ignite-sys-cache, startVer=AffinityTopologyVersion [topVer=1, minorTopVer=1]] [21:06:12] : [Step 4/5] [2021-11-19 21:06:12,586][INFO ][sys-#12424%grid-0%][GridCacheProcessor] Finished recovery for cache [cache=encrypted, grp=encrypted, startVer=AffinityTopologyVersion [topVer=1, minorTopVer=1]] [21:06:12]W: [org.apache.ignite:ignite-core] [2021-11-19 21:06:12,588][WARN ][sys-#12422%grid-0%][CacheAffinitySharedManager] Cache group 'encrypted' brings high overhead for its metainformation in data region 'default'. Metainformation required for its partitions (1024 partitions, 4096 bytes per partition, 4 MBs total) will consume more than 15% of data region memory (10 MBs). It may lead to critical errors on the node and cluster instability. Please reduce number of partitions, add more memory to the data region or add more server nodes for this cache group. [21:06:12] : [Step 4/5] [2021-11-19 21:06:12,589][INFO ][exchange-worker-#12441%grid-0%][GridDhtPartitionsExchangeFuture] Successfully activated caches [nodeId=00036eec-694d-4fb2-8ed7-204087e9d000, client=false, topVer=AffinityTopologyVersion [topVer=1, minorTopVer=1], newState=ACTIVE] [21:06:12]W: [org.apache.ignite:ignite-core] [2021-11-19 21:06:12,590][WARN ][sys-#12428%grid-0%][CacheAffinitySharedManager] Cache group 'encrypted' brings high overhead for its metainformation in data region 'default'. Metainformation required for its partitions (1024 partitions, 4096 bytes per partition, 4 MBs total) will consume more than 15% of data region memory (10 MBs). It may lead to critical errors on the node and cluster instability. Please reduce number of partitions, add more memory to the data region or add more server nodes for this cache group. [21:06:12] : [Step 4/5] [2021-11-19 21:06:12,591][INFO ][exchange-worker-#12441%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=1, minorTopVer=1], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:06:12] : [Step 4/5] [2021-11-19 21:06:12,644][INFO ][exchange-worker-#12441%grid-0%][GridDhtPartitionsExchangeFuture] finishExchangeOnCoordinator [topVer=AffinityTopologyVersion [topVer=1, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=1, minorTopVer=1]] [21:06:12] : [Step 4/5] [2021-11-19 21:06:12,656][INFO ][db-checkpoint-thread-#12447%grid-0%][Checkpointer] Checkpoint started [checkpointId=2238e43b-3301-4073-951d-e0a01e3b5ee1, startPtr=WALPointer [idx=0, fileOff=233711, len=21425], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=1ms, checkpointLockHoldTime=2ms, walCpRecordFsyncDuration=10ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=1ms, pages=21, reason='node started'] [21:06:12] : [Step 4/5] [2021-11-19 21:06:12,657][INFO ][exchange-worker-#12441%grid-0%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=1, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=1, minorTopVer=1], err=null, rebalanced=true, wasRebalanced=false] [21:06:12] : [Step 4/5] [2021-11-19 21:06:12,657][INFO ][disco-notifier-worker-#12436%grid-0%][GridClusterStateProcessor] Received state change finish message: ACTIVE [21:06:12] : [Step 4/5] [2021-11-19 21:06:12,658][INFO ][disco-notifier-worker-#12436%grid-0%][GridClusterStateProcessor] Cluster state was changed from INACTIVE to ACTIVE [21:06:12] : [Step 4/5] [2021-11-19 21:06:12,662][INFO ][exchange-worker-#12441%grid-0%][GridCacheProcessor] Finish proxy initialization, cacheName=ignite-sys-cache, localNodeId=00036eec-694d-4fb2-8ed7-204087e9d000 [21:06:12] : [Step 4/5] [2021-11-19 21:06:12,662][INFO ][exchange-worker-#12441%grid-0%][GridCacheProcessor] Finish proxy initialization, cacheName=encrypted, localNodeId=00036eec-694d-4fb2-8ed7-204087e9d000 [21:06:12] : [Step 4/5] [2021-11-19 21:06:12,663][INFO ][sys-#12415%grid-0%][DistributedBaselineConfiguration] Baseline auto-adjust is 'disabled' with timeout='300000' ms [21:06:12] : [Step 4/5] [2021-11-19 21:06:12,663][INFO ][exchange-worker-#12441%grid-0%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=00036eec-694d-4fb2-8ed7-204087e9d000, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=1, minorTopVer=1], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=00036eec-694d-4fb2-8ed7-204087e9d000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345172524, loc=true, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=1, minorTopVer=1]] [21:06:12] : [Step 4/5] [2021-11-19 21:06:12,663][INFO ][sys-#12415%grid-0%][GridClusterStateProcessor] Successfully performed final activation steps [nodeId=00036eec-694d-4fb2-8ed7-204087e9d000, client=false, topVer=AffinityTopologyVersion [topVer=1, minorTopVer=1]] [21:06:12] : [Step 4/5] [2021-11-19 21:06:12,664][INFO ][exchange-worker-#12441%grid-0%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=1, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=1, minorTopVer=1], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (1 ms), stage="Update caches registry" (8 ms), stage="Start caches" (1 ms), stage="Affinity initialization on cache group start" (2 ms), stage="Determine exchange type" (2 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Restore partition states" (0 ms), stage="After states restored callback" (52 ms), stage="WAL history reservation" (0 ms), stage="Waiting for all single messages" (0 ms), stage="Affinity recalculation (crd)" (0 ms), stage="Collect update counters and create affinity messages" (0 ms), stage="Assign partitions states" (4 ms), stage="Validate partitions states" (0 ms), stage="Ideal affinity diff calculation (enforced)" (2 ms), stage="Apply update counters" (0 ms), stage="Full message preparing" (2 ms), stage="Full message sending" (0 ms), stage="State finish message sending" (0 ms), stage="Detect lost partitions" (3 ms), stage="Exchange done" (3 ms), stage="Total time" (80 ms)] [21:06:12] : [Step 4/5] [2021-11-19 21:06:12,666][INFO ][exchange-worker-#12441%grid-0%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=1, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=1, minorTopVer=1], stage="Affinity initialization on cache group start [grp=ignite-sys-cache]" (0 ms) (parent=Affinity initialization on cache group start), stage="Affinity initialization on cache group start [grp=encrypted]" (0 ms) (parent=Affinity initialization on cache group start), stage="Affinity centralized initialization (crd) [grp=ignite-sys-cache, crd=true]" (0 ms) (parent=Determine exchange type), stage="Affinity centralized initialization (crd) [grp=encrypted, crd=true]" (0 ms) (parent=Determine exchange type), stage="Restore partition states [grp=ignite-sys-cache]" (0 ms) (parent=Restore partition states), stage="Restore partition states [grp=encrypted]" (0 ms) (parent=Restore partition states), stage="Affinity recalculation (partitions availability) [grp=encrypted]" (2 ms) (parent=Ideal affinity diff calculation (enforced)), stage="Affinity recalculation (partitions availability) [grp=ignite-sys-cache]" (0 ms) (parent=Ideal affinity diff calculation (enforced))] [21:06:12] : [Step 4/5] [2021-11-19 21:06:12,668][INFO ][exchange-worker-#12441%grid-0%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=1, minorTopVer=1], crd=true] [21:06:12]W: [org.apache.ignite:ignite-core] [2021-11-19 21:06:12,669][WARN ][test-runner-#12324%encryption.EncryptedCacheNodeJoinTest%][G] Ignite work directory is not provided, automatically resolved to: /opt/buildagent/work/7bc1c54bc719b67c/work [21:06:12] : [Step 4/5] [2021-11-19 21:06:12,669][INFO ][exchange-worker-#12441%grid-0%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=1, minorTopVer=1], force=false, evt=DISCOVERY_CUSTOM_EVT, node=00036eec-694d-4fb2-8ed7-204087e9d000] [21:06:12] : [Step 4/5] [2021-11-19 21:06:12,670][INFO ][test-runner-#12324%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-5] [21:06:12] : [Step 4/5] [21:06:12] : [Step 4/5] >>> __________ ________________ [21:06:12] : [Step 4/5] >>> / _/ ___/ |/ / _/_ __/ __/ [21:06:12] : [Step 4/5] >>> _/ // (7 7 // / / / / _/ [21:06:12] : [Step 4/5] >>> /___/\___/_/|_/___/ /_/ /___/ [21:06:12] : [Step 4/5] >>> [21:06:12] : [Step 4/5] >>> ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:06:12] : [Step 4/5] >>> 2021 Copyright(C) Apache Software Foundation [21:06:12] : [Step 4/5] >>> [21:06:12] : [Step 4/5] >>> Ignite documentation: http://ignite.apache.org [21:06:12] : [Step 4/5] [21:06:12] : [Step 4/5] [2021-11-19 21:06:12,670][INFO ][test-runner-#12324%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-5] Config URL: n/a [21:06:12] : [Step 4/5] [2021-11-19 21:06:12,671][INFO ][test-runner-#12324%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-5] IgniteConfiguration [igniteInstanceName=grid-5, pubPoolSize=24, svcPoolSize=24, callbackPoolSize=24, stripedPoolSize=24, sysPoolSize=24, mgmtPoolSize=4, dataStreamerPoolSize=24, utilityCachePoolSize=24, utilityCacheKeepAliveTime=60000, p2pPoolSize=2, qryPoolSize=24, buildIdxPoolSize=4, igniteHome=/opt/buildagent/work/7bc1c54bc719b67c, igniteWorkDir=/opt/buildagent/work/7bc1c54bc719b67c/work, mbeanSrv=com.sun.jmx.mbeanserver.JmxMBeanServer@6fe85038, nodeId=50248931-c0cf-4416-9357-a2c4d69f6005, marsh=BinaryMarshaller [], marshLocJobs=false, daemon=false, p2pEnabled=true, netTimeout=10000, netCompressionLevel=1, sndRetryDelay=1000, sndRetryCnt=3, metricsHistSize=10000, metricsUpdateFreq=1000, metricsExpTime=9223372036854775807, discoSpi=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=0, ackTimeout=0, marsh=null, reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], segPlc=STOP, segResolveAttempts=2, waitForSegOnStart=true, allResolversPassReq=true, segChkFreq=10000, commSpi=TcpCommunicationSpi [connectGate=org.apache.ignite.spi.communication.tcp.internal.ConnectGateway@4af58550, ctxInitLatch=java.util.concurrent.CountDownLatch@523d182b[Count = 1], stopping=false, clientPool=null, nioSrvWrapper=null, stateProvider=null], evtSpi=MemoryEventStorageSpi [expireAgeMs=9223372036854775807, expireCnt=10000, filter=null], colSpi=NoopCollisionSpi [], deploySpi=LocalDeploymentSpi [], indexingSpi=org.apache.ignite.spi.indexing.noop.NoopIndexingSpi@6d50ed7d, addrRslvr=null, encryptionSpi=org.apache.ignite.spi.encryption.keystore.KeystoreEncryptionSpi@783c3b67, tracingSpi=org.apache.ignite.spi.tracing.NoopTracingSpi@35621053, clientMode=false, rebalanceThreadPoolSize=4, rebalanceTimeout=10000, rebalanceBatchesPrefetchCnt=3, rebalanceThrottle=0, rebalanceBatchSize=524288, txCfg=TransactionConfiguration [txSerEnabled=false, dfltIsolation=REPEATABLE_READ, dfltConcurrency=PESSIMISTIC, dfltTxTimeout=0, txTimeoutOnPartitionMapExchange=0, deadlockTimeout=10000, pessimisticTxLogSize=0, pessimisticTxLogLinger=10000, tmLookupClsName=null, txManagerFactory=null, useJtaSync=false], cacheSanityCheckEnabled=true, discoStartupDelay=60000, deployMode=SHARED, p2pMissedCacheSize=100, locHost=127.0.0.1, timeSrvPortBase=31100, timeSrvPortRange=100, failureDetectionTimeout=10000, sysWorkerBlockedTimeout=null, clientFailureDetectionTimeout=10000, metricsLogFreq=0, connectorCfg=null, odbcCfg=null, warmupClos=null, atomicCfg=AtomicConfiguration [seqReserveSize=1000, cacheMode=PARTITIONED, backups=1, aff=null, grpName=null], classLdr=null, sslCtxFactory=null, platformCfg=null, binaryCfg=null, memCfg=null, pstCfg=null, dsCfg=DataStorageConfiguration [sysRegionInitSize=41943040, sysRegionMaxSize=104857600, pageSize=4096, concLvl=0, dfltDataRegConf=DataRegionConfiguration [name=default, maxSize=10485760, initSize=268435456, swapPath=null, pageEvictionMode=DISABLED, pageReplacementMode=CLOCK, evictionThreshold=0.9, emptyPagesPoolSize=100, metricsEnabled=false, metricsSubIntervalCount=5, metricsRateTimeInterval=60000, persistenceEnabled=true, checkpointPageBufSize=0, lazyMemoryAllocation=true, warmUpCfg=null], dataRegions=null, storagePath=null, checkpointFreq=180000, lockWaitTime=10000, checkpointThreads=4, checkpointWriteOrder=SEQUENTIAL, walHistSize=20, maxWalArchiveSize=1073741824, walSegments=10, walSegmentSize=67108864, walPath=db/wal, walArchivePath=db/wal/archive, cdcWalPath=db/wal/cdc, cdcEnabled=false, metricsEnabled=false, walMode=FSYNC, walTlbSize=131072, walBuffSize=0, walFlushFreq=2000, walFsyncDelay=1000, walRecordIterBuffSize=67108864, alwaysWriteFullPages=false, fileIOFactory=org.apache.ignite.internal.processors.cache.persistence.file.AsyncFileIOFactory@49e56636, metricsSubIntervalCnt=5, metricsRateTimeInterval=60000, walAutoArchiveAfterInactivity=-1, walForceArchiveTimeout=-1, writeThrottlingEnabled=false, walCompactionEnabled=false, walCompactionLevel=1, checkpointReadLockTimeout=null, walPageCompression=DISABLED, walPageCompressionLevel=null, dfltWarmUpCfg=null, encCfg=org.apache.ignite.configuration.EncryptionConfiguration@6b1ba40c, defragmentationThreadPoolSize=4, minWalArchiveSize=-1], snapshotPath=snapshots, activeOnStart=true, activeOnStartPropSetFlag=false, autoActivation=true, autoActivationPropSetFlag=false, clusterStateOnStart=null, sqlConnCfg=null, cliConnCfg=ClientConnectorConfiguration [host=null, port=10800, portRange=100, sockSndBufSize=0, sockRcvBufSize=0, tcpNoDelay=true, maxOpenCursorsPerConn=128, threadPoolSize=24, selectorCnt=12, idleTimeout=0, handshakeTimeout=10000, jdbcEnabled=true, odbcEnabled=true, thinCliEnabled=true, sslEnabled=false, useIgniteSslCtxFactory=true, sslClientAuth=false, sslCtxFactory=null, thinCliCfg=ThinClientConfiguration [maxActiveTxPerConn=100, maxActiveComputeTasksPerConn=0]], mvccVacuumThreadCnt=2, mvccVacuumFreq=5000, authEnabled=false, failureHnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]], commFailureRslvr=null, sqlCfg=SqlConfiguration [longQryWarnTimeout=3000, dfltQryTimeout=0, sqlQryHistSize=1000, validationEnabled=false], asyncContinuationExecutor=null] [21:06:12] : [Step 4/5] [2021-11-19 21:06:12,680][INFO ][test-runner-#12324%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-5] Daemon mode: off [21:06:12] : [Step 4/5] [2021-11-19 21:06:12,712][INFO ][test-runner-#12324%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-5] OS: Linux 4.15.0-151-generic amd64 [21:06:12] : [Step 4/5] [2021-11-19 21:06:12,713][INFO ][test-runner-#12324%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-5] OS user: teamcity [21:06:12] : [Step 4/5] [2021-11-19 21:06:12,713][INFO ][test-runner-#12324%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-5] PID: 16724 [21:06:12] : [Step 4/5] [2021-11-19 21:06:12,713][INFO ][test-runner-#12324%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-5] Language runtime: Java Platform API Specification ver. 1.8 [21:06:12] : [Step 4/5] [2021-11-19 21:06:12,714][INFO ][test-runner-#12324%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-5] VM information: Java(TM) SE Runtime Environment 1.8.0_261-b12 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 25.261-b12 [21:06:12] : [Step 4/5] [2021-11-19 21:06:12,714][INFO ][test-runner-#12324%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-5] VM total memory: 1.9GB [21:06:12] : [Step 4/5] [2021-11-19 21:06:12,714][INFO ][test-runner-#12324%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-5] Remote Management [restart: off, REST: off, JMX (remote: off)] [21:06:12] : [Step 4/5] [2021-11-19 21:06:12,714][INFO ][test-runner-#12324%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-5] Logger: GridTestLog4jLogger [quiet=false, config=null] [21:06:12] : [Step 4/5] [2021-11-19 21:06:12,715][INFO ][test-runner-#12324%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-5] IGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c [21:06:12] : [Step 4/5] [2021-11-19 21:06:12,715][INFO ][test-runner-#12324%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-5] VM arguments: [-DIGNITE_DUMP_THREADS_ON_FAILURE=false, -DMono=/usr/bin/mono-sgen, -DMono4.0_x64=/usr/lib/mono/4.0, -DMono4.5_x64=/usr/lib/mono/4.5, -DMonoVersion=6.12.0.90, -DSKIP_BUILD=false, -Dagent.home.dir=/opt/buildagent, -Dagent.name=aitc-lin02_03, -Dagent.ownPort=9090, -Dagent.work.dir=/opt/buildagent/work, -Dbuild.number=95, -Dbuild.vcs.number=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.1=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.GitHubApacheIgnite=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dclassworlds.conf=/opt/buildagent/temp/buildTmp/teamcity.m2.conf, -Dcom.jetbrains.maven.watcher.report.file=/opt/buildagent/temp/buildTmp/maven-build-info.xml, -Djava.io.tmpdir=/opt/buildagent/temp/buildTmp, -Dmaven.home=/opt/buildagent/tools/maven3_6, -Dmaven.multiModuleProjectDirectory=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.agent.cpuBenchmark=457, -Dteamcity.agent.dotnet.agent_url=http://localhost:9090/RPC2, -Dteamcity.agent.dotnet.build_id=6278078, -Dteamcity.auth.password=*******, -Dteamcity.auth.userId=TeamCityBuildId=6278078, -Dteamcity.build.changedFiles.file=/opt/buildagent/temp/buildTmp/changedFiles6342607772318147725.txt, -Dteamcity.build.checkoutDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.build.id=6278078, -Dteamcity.build.properties.file=/opt/buildagent/temp/buildTmp/teamcity.build5164517880467851002.properties, -Dteamcity.build.tempDir=/opt/buildagent/temp/buildTmp, -Dteamcity.build.workingDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.buildConfName=Basic 3, -Dteamcity.buildType.id=IgniteTests24Java8_Basic3, -Dteamcity.configuration.properties.file=/opt/buildagent/temp/buildTmp/teamcity.config5591980786735343870.properties, -Dteamcity.maven.userSettings.path=/opt/buildagent/temp/buildTmp/maven_settings_585072866407032347.xml, -Dteamcity.maven.watcher.home=/opt/buildagent/plugins/mavenPlugin/maven-watcher-jdk16, -Dteamcity.projectName=Ignite Tests 2.x (JDK 8/11), -Dteamcity.runner.properties.file=/opt/buildagent/temp/buildTmp/teamcity.runner9098465561618137420.properties, -Dteamcity.tests.recentlyFailedTests.file=/opt/buildagent/temp/buildTmp/testsToRunFirst3891775683130404069.txt, -Dteamcity.version=2021.2 (build 99542), -ea, -Xms2g, -Xmx2g, -XX:+HeapDumpOnOutOfMemoryError, -DIGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_TEST_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_UPDATE_NOTIFIER=false, -DIGNITE_NO_DISCO_ORDER=true, -DIGNITE_PERFORMANCE_SUGGESTIONS_DISABLED=true, -Djava.net.preferIPv4Stack=true, -DTEST_SCALE_FACTOR=1.0, -DIGNITE_TEST_PROP_LOG4J_FILE=log4j-tc-test.xml, -DIGNITE_QUIET=false, -DIGNITE_MARSHAL_BUFFERS_RECHECK=1000, -Dmaven.repo.local=/opt/buildagent/.m2/repository] [21:06:12] : [Step 4/5] [2021-11-19 21:06:12,719][INFO ][test-runner-#12324%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-5] System cache's DataRegion size is configured to 40 MB. Use DataStorageConfiguration.systemRegionInitialSize property to change the setting. [21:06:12] : [Step 4/5] [2021-11-19 21:06:12,720][INFO ][test-runner-#12324%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-5] Configured caches [in 'sysMemPlc' dataRegion: ['ignite-sys-cache'], in 'default' dataRegion: ['encrypted']] [21:06:12]W: [org.apache.ignite:ignite-core] [2021-11-19 21:06:12,720][WARN ][test-runner-#12324%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-5] Peer class loading is enabled (disable it in production for performance and deployment consistency reasons) [21:06:12] : [Step 4/5] [2021-11-19 21:06:12,720][INFO ][test-runner-#12324%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-5] 3-rd party licenses can be found at: /opt/buildagent/work/7bc1c54bc719b67c/libs/licenses [21:06:12] : [Step 4/5] [2021-11-19 21:06:12,725][INFO ][test-runner-#12324%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] Configured plugins: [21:06:12] : [Step 4/5] [2021-11-19 21:06:12,725][INFO ][test-runner-#12324%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- StanByClusterTestProvider 1.0 [21:06:12] : [Step 4/5] [2021-11-19 21:06:12,725][INFO ][test-runner-#12324%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- null [21:06:12] : [Step 4/5] [2021-11-19 21:06:12,725][INFO ][test-runner-#12324%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] [21:06:12] : [Step 4/5] [2021-11-19 21:06:12,725][INFO ][test-runner-#12324%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- PageMemory tracker plugin 1.0 [21:06:12] : [Step 4/5] [2021-11-19 21:06:12,726][INFO ][test-runner-#12324%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- null [21:06:12] : [Step 4/5] [2021-11-19 21:06:12,726][INFO ][test-runner-#12324%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] [21:06:12] : [Step 4/5] [2021-11-19 21:06:12,726][INFO ][test-runner-#12324%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- TestDistibutedConfigurationPlugin 1.0 [21:06:12] : [Step 4/5] [2021-11-19 21:06:12,726][INFO ][test-runner-#12324%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- null [21:06:12] : [Step 4/5] [2021-11-19 21:06:12,726][INFO ][test-runner-#12324%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] [21:06:12] : [Step 4/5] [2021-11-19 21:06:12,726][INFO ][test-runner-#12324%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- NodeValidationPluginProvider 1.0 [21:06:12] : [Step 4/5] [2021-11-19 21:06:12,727][INFO ][test-runner-#12324%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- null [21:06:12] : [Step 4/5] [2021-11-19 21:06:12,727][INFO ][test-runner-#12324%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] [21:06:12] : [Step 4/5] [2021-11-19 21:06:12,727][INFO ][test-runner-#12324%encryption.EncryptedCacheNodeJoinTest%][FailureProcessor] Configured failure handler: [hnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]]] [21:06:12] : [Step 4/5] [2021-11-19 21:06:12,749][INFO ][test-runner-#12324%encryption.EncryptedCacheNodeJoinTest%][TcpCommunicationSpi] Successfully bound communication NIO server to TCP port [port=45151, locHost=/127.0.0.1, selectorsCnt=12, selectorSpins=0, pairedConn=false] [21:06:12]W: [org.apache.ignite:ignite-core] [2021-11-19 21:06:12,749][WARN ][test-runner-#12324%encryption.EncryptedCacheNodeJoinTest%][TcpCommunicationSpi] Message queue limit is set to 0 which may lead to potential OOMEs when running cache operations in FULL_ASYNC or PRIMARY_SYNC modes due to message queues growth on sender and receiver sides. [21:06:12] : [Step 4/5] [2021-11-19 21:06:12,753][INFO ][test-runner-#12324%encryption.EncryptedCacheNodeJoinTest%][GridCollisionManager] Collision resolution is disabled (all jobs will be activated upon arrival). [21:06:12] : [Step 4/5] [2021-11-19 21:06:12,753][INFO ][test-runner-#12324%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-5] Security status [authentication=off, sandbox=off, tls/ssl=off] [21:06:12] : [Step 4/5] [2021-11-19 21:06:12,808][INFO ][test-runner-#12324%encryption.EncryptedCacheNodeJoinTest%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:06:13] : [Step 4/5] [2021-11-19 21:06:13,023][INFO ][test-runner-#12324%encryption.EncryptedCacheNodeJoinTest%][MaintenanceProcessor] Resolved store directory for node persistent data: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_5 [21:06:13] : [Step 4/5] [2021-11-19 21:06:13,025][INFO ][test-runner-#12324%encryption.EncryptedCacheNodeJoinTest%][CacheObjectBinaryProcessorImpl] Resolved directory for serialized binary metadata: /opt/buildagent/work/7bc1c54bc719b67c/work/db/binary_meta/grid_5 [21:06:13] : [Step 4/5] [2021-11-19 21:06:13,029][INFO ][test-runner-#12324%encryption.EncryptedCacheNodeJoinTest%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_5 [21:06:13] : [Step 4/5] [2021-11-19 21:06:13,030][INFO ][test-runner-#12324%encryption.EncryptedCacheNodeJoinTest%][FileWriteAheadLogManager] Resolved write ahead log work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_5 [21:06:13] : [Step 4/5] [2021-11-19 21:06:13,030][INFO ][test-runner-#12324%encryption.EncryptedCacheNodeJoinTest%][FileWriteAheadLogManager] Resolved write ahead log archive directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_5 [21:06:14] : [Step 4/5] [2021-11-19 21:06:14,694][INFO ][db-checkpoint-thread-#12447%grid-0%][Checkpointer] Checkpoint finished [cpId=2238e43b-3301-4073-951d-e0a01e3b5ee1, pages=21, markPos=WALPointer [idx=0, fileOff=233711, len=21425], walSegmentsCovered=[], markDuration=15ms, pagesWrite=2ms, fsync=2034ms, total=2052ms] [21:06:14] : [Step 4/5] [2021-11-19 21:06:14,694][INFO ][test-runner-#12324%encryption.EncryptedCacheNodeJoinTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_5/0000000000000000.wal [21:06:14] : [Step 4/5] [2021-11-19 21:06:14,700][INFO ][test-runner-#12324%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Configured data regions initialized successfully [total=5] [21:06:14] : [Step 4/5] [2021-11-19 21:06:14,818][INFO ][test-runner-#12324%encryption.EncryptedCacheNodeJoinTest%][IgniteSnapshotManager] Resolved snapshot work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/snapshots [21:06:14] : [Step 4/5] [2021-11-19 21:06:14,818][INFO ][test-runner-#12324%encryption.EncryptedCacheNodeJoinTest%][IgniteSnapshotManager] Resolved temp directory for snapshot creation: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_5/snp [21:06:14] : [Step 4/5] [2021-11-19 21:06:14,822][INFO ][test-runner-#12324%encryption.EncryptedCacheNodeJoinTest%][ClientListenerProcessor] Client connector processor has started on TCP port 10801 [21:06:14] : [Step 4/5] [2021-11-19 21:06:14,826][INFO ][test-runner-#12324%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-5] Non-loopback local IPs: 172.17.0.4 [21:06:14] : [Step 4/5] [2021-11-19 21:06:14,826][INFO ][test-runner-#12324%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-5] Enabled local MACs: 0242AC110004 [21:06:14] : [Step 4/5] [2021-11-19 21:06:14,827][INFO ][test-runner-#12324%encryption.EncryptedCacheNodeJoinTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:06:14] : [Step 4/5] [2021-11-19 21:06:14,828][INFO ][test-runner-#12324%encryption.EncryptedCacheNodeJoinTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:06:14] : [Step 4/5] [2021-11-19 21:06:14,829][INFO ][test-runner-#12324%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:06:14] : [Step 4/5] [2021-11-19 21:06:14,832][INFO ][test-runner-#12324%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Applying lost metastore updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:06:14] : [Step 4/5] [2021-11-19 21:06:14,832][INFO ][test-runner-#12324%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=0 ms] [21:06:14] : [Step 4/5] [2021-11-19 21:06:14,833][INFO ][test-runner-#12324%encryption.EncryptedCacheNodeJoinTest%][GridCacheProcessor] Restoring partition state for local groups. [21:06:14] : [Step 4/5] [2021-11-19 21:06:14,833][INFO ][test-runner-#12324%encryption.EncryptedCacheNodeJoinTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=0, partitionsProcessed=0, time=0ms] [21:06:14] : [Step 4/5] [2021-11-19 21:06:14,834][INFO ][test-runner-#12324%encryption.EncryptedCacheNodeJoinTest%][GridEncryptionManager] Encryption keys loaded from metastore. [grps=, masterKeyName=ignite.master.key] [21:06:14] : [Step 4/5] [2021-11-19 21:06:14,836][INFO ][test-runner-#12324%encryption.EncryptedCacheNodeJoinTest%][ClusterProcessor] Cluster ID and tag has been read from metastorage: null [21:06:14] : [Step 4/5] [2021-11-19 21:06:14,836][INFO ][test-runner-#12324%encryption.EncryptedCacheNodeJoinTest%][IgniteClusterImpl] Shutdown policy was updated [oldVal=null, newVal=null] [21:06:14] : [Step 4/5] [2021-11-19 21:06:14,837][INFO ][test-runner-#12324%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Checkpoint frequency deviation changed [oldVal=null, newVal=null] [21:06:15] : [Step 4/5] [2021-11-19 21:06:15,981][INFO ][test-runner-#12324%encryption.EncryptedCacheNodeJoinTest%][FilePageStoreManager] Cleanup cache stores [total=1, left=0, cleanFiles=false] [21:06:15] : [Step 4/5] [2021-11-19 21:06:15,984][INFO ][test-runner-#12324%encryption.EncryptedCacheNodeJoinTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:06:15] : [Step 4/5] [2021-11-19 21:06:15,985][INFO ][test-runner-#12324%encryption.EncryptedCacheNodeJoinTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:06:15] : [Step 4/5] [2021-11-19 21:06:15,987][INFO ][test-runner-#12324%encryption.EncryptedCacheNodeJoinTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:06:15] : [Step 4/5] [2021-11-19 21:06:15,987][INFO ][test-runner-#12324%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Data Regions Started: 5 [21:06:15] : [Step 4/5] [2021-11-19 21:06:15,988][INFO ][test-runner-#12324%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] ^-- sysMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:06:15] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:06:15] : [Step 4/5] ^-- default region [type=default, persistence=true, lazyAlloc=true, [21:06:15] : [Step 4/5] ... initCfg=10MB, maxCfg=10MB, usedRam=0MB, freeRam=100%, allocRam=0MB, allocTotal=0MB] [21:06:15] : [Step 4/5] ^-- metastoreMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:06:15] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:06:15] : [Step 4/5] ^-- TxLog region [type=internal, persistence=true, lazyAlloc=false, [21:06:15] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:06:15] : [Step 4/5] ^-- volatileDsMemPlc region [type=user, persistence=false, lazyAlloc=true, [21:06:15] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB] [21:06:15] : [Step 4/5] ^-- Ignite persistence [used=0MB] [21:06:15] : [Step 4/5] [21:06:15] : [Step 4/5] [2021-11-19 21:06:15,989][INFO ][test-runner-#12324%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Starting binary memory restore for: [-2100569601, 1613773252] [21:06:16] : [Step 4/5] [2021-11-19 21:06:16,082][INFO ][test-runner-#12324%encryption.EncryptedCacheNodeJoinTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:06:16] : [Step 4/5] [2021-11-19 21:06:16,082][INFO ][test-runner-#12324%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:06:16] : [Step 4/5] [2021-11-19 21:06:16,089][INFO ][test-runner-#12324%encryption.EncryptedCacheNodeJoinTest%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_5/0000000000000000.wal, offset=0, ver=2] [21:06:16] : [Step 4/5] [2021-11-19 21:06:16,539][INFO ][test-runner-#12324%encryption.EncryptedCacheNodeJoinTest%][GridCacheProcessor] Started cache in recovery mode [name=ignite-sys-cache, id=-2100569601, dataRegionName=sysMemPlc, mode=REPLICATED, atomicity=TRANSACTIONAL, backups=2147483647, mvcc=false] [21:06:16] : [Step 4/5] [2021-11-19 21:06:16,540][INFO ][test-runner-#12324%encryption.EncryptedCacheNodeJoinTest%][PageMemoryImpl] Started page memory [memoryAllocated=24.0 MiB, pages=5952, tableSize=474.2 KiB, replacementSize=768 B, checkpointBuffer=10.0 MiB] [21:06:16] : [Step 4/5] [2021-11-19 21:06:16,542][INFO ][test-runner-#12324%encryption.EncryptedCacheNodeJoinTest%][GridCacheProcessor] Started cache in recovery mode [name=encrypted, id=1613773252, dataRegionName=default, mode=PARTITIONED, atomicity=TRANSACTIONAL, backups=0, mvcc=false] [21:06:16] : [Step 4/5] [2021-11-19 21:06:16,543][INFO ][test-runner-#12324%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Binary recovery performed in 554 ms. [21:06:16] : [Step 4/5] [2021-11-19 21:06:16,544][INFO ][test-runner-#12324%encryption.EncryptedCacheNodeJoinTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:06:16] : [Step 4/5] [2021-11-19 21:06:16,544][INFO ][test-runner-#12324%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Applying lost cache updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:06:16] : [Step 4/5] [2021-11-19 21:06:16,602][INFO ][test-runner-#12324%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=51 ms] [21:06:16] : [Step 4/5] [2021-11-19 21:06:16,603][INFO ][test-runner-#12324%encryption.EncryptedCacheNodeJoinTest%][GridCacheProcessor] Restoring partition state for local groups. [21:06:16] : [Step 4/5] [2021-11-19 21:06:16,613][INFO ][test-runner-#12324%encryption.EncryptedCacheNodeJoinTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=2, partitionsProcessed=1124, time=20ms] [21:06:17] : [Step 4/5] [2021-11-19 21:06:17,259][INFO ][test-runner-#12324%encryption.EncryptedCacheNodeJoinTest%][TestTcpDiscoverySpi] Successfully bound to TCP port [port=47501, localHost=localhost/127.0.0.1, locNodeId=50248931-c0cf-4416-9357-a2c4d69f6005] [21:06:17] : [Step 4/5] [2021-11-19 21:06:17,268][INFO ][tcp-disco-srvr-[:47500]-#648%grid-0%-#12438%grid-0%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=48009] [21:06:17] : [Step 4/5] [2021-11-19 21:06:17,268][INFO ][tcp-disco-srvr-[:47500]-#648%grid-0%-#12438%grid-0%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=48009] [21:06:17] : [Step 4/5] [2021-11-19 21:06:17,269][INFO ][tcp-disco-sock-reader-[]-#654%grid-0%-#12570%grid-0%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:48009, rmtPort=48009] [21:06:17] : [Step 4/5] [2021-11-19 21:06:17,271][INFO ][tcp-disco-sock-reader-[50248931 127.0.0.1:48009]-#654%grid-0%-#12570%grid-0%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=50248931-c0cf-4416-9357-a2c4d69f6005, rmtAddr=/127.0.0.1:48009] [21:06:17] : [Step 4/5] [2021-11-19 21:06:17,276][INFO ][tcp-disco-srvr-[:47501]-#653%grid-5%-#12569%grid-5%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=55461] [21:06:17] : [Step 4/5] [2021-11-19 21:06:17,277][INFO ][tcp-disco-srvr-[:47501]-#653%grid-5%-#12569%grid-5%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=55461] [21:06:17] : [Step 4/5] [2021-11-19 21:06:17,278][INFO ][tcp-disco-sock-reader-[]-#655%grid-5%-#12571%grid-5%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:55461, rmtPort=55461] [21:06:17] : [Step 4/5] [2021-11-19 21:06:17,278][INFO ][tcp-disco-sock-reader-[]-#655%grid-5%-#12571%grid-5%][TestTcpDiscoverySpi] Received ping request from the remote node [rmtNodeId=00036eec-694d-4fb2-8ed7-204087e9d000, rmtAddr=/127.0.0.1:55461, rmtPort=55461] [21:06:17] : [Step 4/5] [2021-11-19 21:06:17,280][INFO ][tcp-disco-sock-reader-[]-#655%grid-5%-#12571%grid-5%][TestTcpDiscoverySpi] Finished writing ping response [rmtNodeId=00036eec-694d-4fb2-8ed7-204087e9d000, rmtAddr=/127.0.0.1:55461, rmtPort=55461] [21:06:17] : [Step 4/5] [2021-11-19 21:06:17,280][INFO ][tcp-disco-sock-reader-[50248931 127.0.0.1:48009]-#654%grid-0%-#12570%grid-0%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:48009, rmtPort=48009, rmtNodeId=50248931-c0cf-4416-9357-a2c4d69f6005] [21:06:17]W: [org.apache.ignite:ignite-core] [2021-11-19 21:06:17,280][WARN ][tcp-disco-sock-reader-[]-#655%grid-5%-#12571%grid-5%][TestTcpDiscoverySpi] Failed to shutdown socket [21:06:17]W: [org.apache.ignite:ignite-core] java.net.SocketException: Socket output is already shutdown [21:06:17]W: [org.apache.ignite:ignite-core] at java.net.Socket.shutdownOutput(Socket.java:1572) [21:06:17]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.close(IgniteUtils.java:4247) [21:06:17]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.discovery.tcp.ServerImpl$SocketReader.body(ServerImpl.java:7370) [21:06:17]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.IgniteSpiThread.run(IgniteSpiThread.java:58) [21:06:17] : [Step 4/5] [2021-11-19 21:06:17,283][INFO ][tcp-disco-sock-reader-[]-#655%grid-5%-#12571%grid-5%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:55461, rmtPort=55461, rmtNodeId=null] [21:06:17] : [Step 4/5] [2021-11-19 21:06:17,284][INFO ][tcp-disco-msg-worker-[crd]-#647%grid-0%-#12437%grid-0%][GridEncryptionManager] Joining node doesn't have stored group keys [node=50248931-c0cf-4416-9357-a2c4d69f6005] [21:06:17] : [Step 4/5] [2021-11-19 21:06:17,285][INFO ][tcp-disco-srvr-[:47501]-#653%grid-5%-#12569%grid-5%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=44491] [21:06:17] : [Step 4/5] [2021-11-19 21:06:17,286][INFO ][tcp-disco-srvr-[:47501]-#653%grid-5%-#12569%grid-5%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=44491] [21:06:17] : [Step 4/5] [2021-11-19 21:06:17,286][INFO ][tcp-disco-sock-reader-[]-#656%grid-5%-#12573%grid-5%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:44491, rmtPort=44491] [21:06:17] : [Step 4/5] [2021-11-19 21:06:17,287][INFO ][tcp-disco-sock-reader-[]-#656%grid-5%-#12573%grid-5%][TestTcpDiscoverySpi] Received ping request from the remote node [rmtNodeId=00036eec-694d-4fb2-8ed7-204087e9d000, rmtAddr=/127.0.0.1:44491, rmtPort=44491] [21:06:17]W: [org.apache.ignite:ignite-core] [2021-11-19 21:06:17,288][WARN ][disco-pool-#12572%grid-0%][TestTcpDiscoverySpi] Failed to join node to the cluster (encryption settings are different for cache 'encrypted' : local=false, remote=true.) [21:06:17] : [Step 4/5] [2021-11-19 21:06:17,288][INFO ][tcp-disco-sock-reader-[]-#656%grid-5%-#12573%grid-5%][TestTcpDiscoverySpi] Finished writing ping response [rmtNodeId=00036eec-694d-4fb2-8ed7-204087e9d000, rmtAddr=/127.0.0.1:44491, rmtPort=44491] [21:06:17] : [Step 4/5] [2021-11-19 21:06:17,288][INFO ][tcp-disco-sock-reader-[]-#656%grid-5%-#12573%grid-5%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:44491, rmtPort=44491, rmtNodeId=null] [21:06:17] : [Step 4/5] [2021-11-19 21:06:17,289][INFO ][tcp-disco-srvr-[:47501]-#653%grid-5%-#12569%grid-5%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=46373] [21:06:17] : [Step 4/5] [2021-11-19 21:06:17,289][INFO ][tcp-disco-srvr-[:47501]-#653%grid-5%-#12569%grid-5%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=46373] [21:06:17] : [Step 4/5] [2021-11-19 21:06:17,290][INFO ][tcp-disco-sock-reader-[]-#657%grid-5%-#12574%grid-5%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:46373, rmtPort=46373] [21:06:17] : [Step 4/5] [2021-11-19 21:06:17,291][INFO ][tcp-disco-sock-reader-[00036eec 127.0.0.1:46373]-#657%grid-5%-#12574%grid-5%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=00036eec-694d-4fb2-8ed7-204087e9d000, rmtAddr=/127.0.0.1:46373] [21:06:17]W: [org.apache.ignite:ignite-core] [2021-11-19 21:06:17,294][ERROR][test-runner-#12324%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-5] Failed to start manager: GridManagerAdapter [enabled=true, name=o.a.i.i.managers.discovery.GridDiscoveryManager] [21:06:17]W: [org.apache.ignite:ignite-core] class org.apache.ignite.IgniteCheckedException: Failed to start SPI: TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=5000, ackTimeout=5000, marsh=JdkMarshaller [clsFilter=org.apache.ignite.marshaller.MarshallerUtils$1@3c15b6fc], reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false] [21:06:17]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.managers.GridManagerAdapter.startSpi(GridManagerAdapter.java:281) [21:06:17]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.managers.discovery.GridDiscoveryManager.start(GridDiscoveryManager.java:1091) [21:06:17]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.IgniteKernal.startManager(IgniteKernal.java:1953) [21:06:17]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.IgniteKernal.start(IgniteKernal.java:1300) [21:06:17]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.IgnitionEx$IgniteNamedInstance.start0(IgnitionEx.java:1798) [21:06:17]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.IgnitionEx$IgniteNamedInstance.start(IgnitionEx.java:1720) [21:06:17]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.IgnitionEx.start0(IgnitionEx.java:1159) [21:06:17]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.IgnitionEx.start(IgnitionEx.java:629) [21:06:17]W: [org.apache.ignite:ignite-core] at org.apache.ignite.testframework.junits.GridAbstractTest.startGrid(GridAbstractTest.java:1252) [21:06:17]W: [org.apache.ignite:ignite-core] at org.apache.ignite.testframework.junits.GridAbstractTest.startGrid(GridAbstractTest.java:1169) [21:06:17]W: [org.apache.ignite:ignite-core] at org.apache.ignite.testframework.junits.GridAbstractTest.startGrid(GridAbstractTest.java:1145) [21:06:17]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.encryption.EncryptedCacheNodeJoinTest.lambda$testNodeCantJoinWithSameNameButNotEncCache$4(EncryptedCacheNodeJoinTest.java:332) [21:06:17]W: [org.apache.ignite:ignite-core] at org.apache.ignite.testframework.GridTestUtils$1.call(GridTestUtils.java:616) [21:06:17]W: [org.apache.ignite:ignite-core] at org.apache.ignite.testframework.GridTestUtils$1.call(GridTestUtils.java:614) [21:06:17]W: [org.apache.ignite:ignite-core] at org.apache.ignite.testframework.GridTestUtils.assertThrowsWithCause(GridTestUtils.java:636) [21:06:17]W: [org.apache.ignite:ignite-core] at org.apache.ignite.testframework.GridTestUtils.assertThrowsWithCause(GridTestUtils.java:614) [21:06:17]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.encryption.EncryptedCacheNodeJoinTest.testNodeCantJoinWithSameNameButNotEncCache(EncryptedCacheNodeJoinTest.java:330) [21:06:17]W: [org.apache.ignite:ignite-core] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) [21:06:17]W: [org.apache.ignite:ignite-core] at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) [21:06:17]W: [org.apache.ignite:ignite-core] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [21:06:17]W: [org.apache.ignite:ignite-core] at java.lang.reflect.Method.invoke(Method.java:498) [21:06:17]W: [org.apache.ignite:ignite-core] at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50) [21:06:17]W: [org.apache.ignite:ignite-core] at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) [21:06:17]W: [org.apache.ignite:ignite-core] at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47) [21:06:17]W: [org.apache.ignite:ignite-core] at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) [21:06:17]W: [org.apache.ignite:ignite-core] at org.apache.ignite.testframework.junits.GridAbstractTest$7.run(GridAbstractTest.java:2432) [21:06:17]W: [org.apache.ignite:ignite-core] at java.lang.Thread.run(Thread.java:748) [21:06:17] : [Step 4/5] [2021-11-19 21:06:17,294][INFO ][tcp-disco-sock-reader-[00036eec 127.0.0.1:46373]-#657%grid-5%-#12574%grid-5%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:46373, rmtPort=46373, rmtNodeId=00036eec-694d-4fb2-8ed7-204087e9d000] [21:06:17]W: [org.apache.ignite:ignite-core] Caused by: class org.apache.ignite.spi.IgniteSpiException: Failed to join node to the cluster (encryption settings are different for cache 'encrypted' : local=false, remote=true.) [21:06:17]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.discovery.tcp.TcpDiscoverySpi.checkFailedError(TcpDiscoverySpi.java:2108) [21:06:17]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.discovery.tcp.ServerImpl.joinTopology(ServerImpl.java:1206) [21:06:17]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.discovery.tcp.ServerImpl.spiStart(ServerImpl.java:474) [21:06:17]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.discovery.tcp.TcpDiscoverySpi.spiStart(TcpDiscoverySpi.java:2210) [21:06:17]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.managers.GridManagerAdapter.startSpi(GridManagerAdapter.java:278) [21:06:17]W: [org.apache.ignite:ignite-core] ... 26 more [21:06:17]W: [org.apache.ignite:ignite-core] [2021-11-19 21:06:17,301][ERROR][test-runner-#12324%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-5] Got exception while starting (will rollback startup routine). [21:06:17]W: [org.apache.ignite:ignite-core] class org.apache.ignite.IgniteCheckedException: Failed to start manager: GridManagerAdapter [enabled=true, name=org.apache.ignite.internal.managers.discovery.GridDiscoveryManager] [21:06:17]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.IgniteKernal.startManager(IgniteKernal.java:1958) [21:06:17]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.IgniteKernal.start(IgniteKernal.java:1300) [21:06:17]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.IgnitionEx$IgniteNamedInstance.start0(IgnitionEx.java:1798) [21:06:17]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.IgnitionEx$IgniteNamedInstance.start(IgnitionEx.java:1720) [21:06:17]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.IgnitionEx.start0(IgnitionEx.java:1159) [21:06:17]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.IgnitionEx.start(IgnitionEx.java:629) [21:06:17]W: [org.apache.ignite:ignite-core] at org.apache.ignite.testframework.junits.GridAbstractTest.startGrid(GridAbstractTest.java:1252) [21:06:17]W: [org.apache.ignite:ignite-core] at org.apache.ignite.testframework.junits.GridAbstractTest.startGrid(GridAbstractTest.java:1169) [21:06:17]W: [org.apache.ignite:ignite-core] at org.apache.ignite.testframework.junits.GridAbstractTest.startGrid(GridAbstractTest.java:1145) [21:06:17]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.encryption.EncryptedCacheNodeJoinTest.lambda$testNodeCantJoinWithSameNameButNotEncCache$4(EncryptedCacheNodeJoinTest.java:332) [21:06:17]W: [org.apache.ignite:ignite-core] at org.apache.ignite.testframework.GridTestUtils$1.call(GridTestUtils.java:616) [21:06:17]W: [org.apache.ignite:ignite-core] at org.apache.ignite.testframework.GridTestUtils$1.call(GridTestUtils.java:614) [21:06:17]W: [org.apache.ignite:ignite-core] at org.apache.ignite.testframework.GridTestUtils.assertThrowsWithCause(GridTestUtils.java:636) [21:06:17]W: [org.apache.ignite:ignite-core] at org.apache.ignite.testframework.GridTestUtils.assertThrowsWithCause(GridTestUtils.java:614) [21:06:17]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.encryption.EncryptedCacheNodeJoinTest.testNodeCantJoinWithSameNameButNotEncCache(EncryptedCacheNodeJoinTest.java:330) [21:06:17]W: [org.apache.ignite:ignite-core] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) [21:06:17]W: [org.apache.ignite:ignite-core] at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) [21:06:17]W: [org.apache.ignite:ignite-core] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [21:06:17]W: [org.apache.ignite:ignite-core] at java.lang.reflect.Method.invoke(Method.java:498) [21:06:17]W: [org.apache.ignite:ignite-core] at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50) [21:06:17]W: [org.apache.ignite:ignite-core] at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) [21:06:17]W: [org.apache.ignite:ignite-core] at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47) [21:06:17]W: [org.apache.ignite:ignite-core] at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) [21:06:17]W: [org.apache.ignite:ignite-core] at org.apache.ignite.testframework.junits.GridAbstractTest$7.run(GridAbstractTest.java:2432) [21:06:17]W: [org.apache.ignite:ignite-core] at java.lang.Thread.run(Thread.java:748) [21:06:17]W: [org.apache.ignite:ignite-core] Caused by: class org.apache.ignite.IgniteCheckedException: Failed to start SPI: TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=5000, ackTimeout=5000, marsh=JdkMarshaller [clsFilter=org.apache.ignite.marshaller.MarshallerUtils$1@3c15b6fc], reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false] [21:06:17]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.managers.GridManagerAdapter.startSpi(GridManagerAdapter.java:281) [21:06:17]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.managers.discovery.GridDiscoveryManager.start(GridDiscoveryManager.java:1091) [21:06:17]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.IgniteKernal.startManager(IgniteKernal.java:1953) [21:06:17]W: [org.apache.ignite:ignite-core] ... 24 more [21:06:17]W: [org.apache.ignite:ignite-core] Caused by: class org.apache.ignite.spi.IgniteSpiException: Failed to join node to the cluster (encryption settings are different for cache 'encrypted' : local=false, remote=true.) [21:06:17]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.discovery.tcp.TcpDiscoverySpi.checkFailedError(TcpDiscoverySpi.java:2108) [21:06:17]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.discovery.tcp.ServerImpl.joinTopology(ServerImpl.java:1206) [21:06:17]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.discovery.tcp.ServerImpl.spiStart(ServerImpl.java:474) [21:06:17]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.discovery.tcp.TcpDiscoverySpi.spiStart(TcpDiscoverySpi.java:2210) [21:06:17]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.managers.GridManagerAdapter.startSpi(GridManagerAdapter.java:278) [21:06:17]W: [org.apache.ignite:ignite-core] ... 26 more [21:06:22] : [Step 4/5] [2021-11-19 21:06:22,310][INFO ][test-runner-#12324%encryption.EncryptedCacheNodeJoinTest%][TestTcpDiscoverySpi] No verification for local node leave has been received from coordinator (will stop node anyway). [21:06:22] : [Step 4/5] [2021-11-19 21:06:22,314][INFO ][test-runner-#12324%encryption.EncryptedCacheNodeJoinTest%][GridCacheProcessor] Stopped cache [cacheName=encrypted] [21:06:22] : [Step 4/5] [2021-11-19 21:06:22,315][INFO ][test-runner-#12324%encryption.EncryptedCacheNodeJoinTest%][GridCacheProcessor] Stopped cache [cacheName=ignite-sys-cache] [21:06:22] : [Step 4/5] [2021-11-19 21:06:22,490][INFO ][test-runner-#12324%encryption.EncryptedCacheNodeJoinTest%][FilePageStoreManager] Cleanup cache stores [total=4, left=0, cleanFiles=false] [21:06:22] : [Step 4/5] [2021-11-19 21:06:22,498][INFO ][test-runner-#12324%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-5] [21:06:22] : [Step 4/5] [21:06:22] : [Step 4/5] >>> +------------------------------------------------------+ [21:06:22] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV stopped OK [21:06:22] : [Step 4/5] >>> +------------------------------------------------------+ [21:06:22] : [Step 4/5] >>> Ignite instance name: grid-5 [21:06:22] : [Step 4/5] >>> Grid uptime: 00:00:09.829 [21:06:22] : [Step 4/5] [21:06:22] : [Step 4/5] [21:06:22] : [Step 4/5] [21:06:22] >>> Stopping test: EncryptedCacheNodeJoinTest#testNodeCantJoinWithSameNameButNotEncCache in 11181 ms <<< [21:06:22] : [Step 4/5] [2021-11-19 21:06:22,499][INFO ][main][root] >>> Stopping test: EncryptedCacheNodeJoinTest#testNodeCantJoinWithSameNameButNotEncCache in 11181 ms <<< [21:06:22] : [Step 4/5] [21:06:22] >>> Heap: 378 MB used / 1899 MB commited / 1899 MB max <<< [21:06:22] : [Step 4/5] [2021-11-19 21:06:22,500][INFO ][main][root] >>> Heap: 378 MB used / 1899 MB commited / 1899 MB max <<< [21:06:22] : [Step 4/5] [21:06:22] >>> Non-Heap: 148 MB used / 161 MB commited / 0 MB max <<< [21:06:22] : [Step 4/5] [2021-11-19 21:06:22,500][INFO ][main][root] >>> Non-Heap: 148 MB used / 161 MB commited / 0 MB max <<< [21:06:22] : [Step 4/5] [2021-11-19 21:06:22,500][INFO ][main][root] >>> Stopping grid [name=grid-0, id=00036eec-694d-4fb2-8ed7-204087e9d000] [21:06:22] : [Step 4/5] [2021-11-19 21:06:22,510][INFO ][db-checkpoint-thread-#12447%grid-0%][Checkpointer] Skipping checkpoint (no pages were modified) [checkpointBeforeLockTime=2ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=1ms, checkpointLockHoldTime=2ms, reason='timeout'] [21:06:22] : [Step 4/5] [2021-11-19 21:06:22,515][INFO ][main][GridCacheProcessor] Stopped cache [cacheName=encrypted] [21:06:22] : [Step 4/5] [2021-11-19 21:06:22,516][INFO ][main][GridCacheProcessor] Stopped cache [cacheName=ignite-sys-cache] [21:06:22] : [Step 4/5] [2021-11-19 21:06:22,524][INFO ][main][FilePageStoreManager] Cleanup cache stores [total=4, left=0, cleanFiles=false] [21:06:22] : [Step 4/5] [2021-11-19 21:06:22,534][INFO ][main][IgniteKernal%grid-0] [21:06:22] : [Step 4/5] [21:06:22] : [Step 4/5] >>> +------------------------------------------------------+ [21:06:22] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV stopped OK [21:06:22] : [Step 4/5] >>> +------------------------------------------------------+ [21:06:22] : [Step 4/5] >>> Ignite instance name: grid-0 [21:06:22] : [Step 4/5] >>> Grid uptime: 00:00:09.971 [21:06:22] : [Step 4/5] [21:06:22] : [Step 4/5] [21:06:22] : [Step 4/5] [21:06:22] >>> Starting test: EncryptedCacheNodeJoinTest#testNodeCantJoinWithDifferentKeyStore <<< [21:06:22] : [Step 4/5] [2021-11-19 21:06:22,702][INFO ][main][root] >>> Starting test: EncryptedCacheNodeJoinTest#testNodeCantJoinWithDifferentKeyStore <<< [21:06:22] : [Step 4/5] [21:06:22] >>> Heap: 379 MB used / 1899 MB commited / 1899 MB max <<< [21:06:22] : [Step 4/5] [2021-11-19 21:06:22,702][INFO ][main][root] >>> Heap: 379 MB used / 1899 MB commited / 1899 MB max <<< [21:06:22] : [Step 4/5] [21:06:22] >>> Non-Heap: 148 MB used / 161 MB commited / 0 MB max <<< [21:06:22] : [Step 4/5] [2021-11-19 21:06:22,703][INFO ][main][root] >>> Non-Heap: 148 MB used / 161 MB commited / 0 MB max <<< [21:06:22]W: [org.apache.ignite:ignite-core] [2021-11-19 21:06:22,707][WARN ][test-runner-#12575%encryption.EncryptedCacheNodeJoinTest%][G] Ignite work directory is not provided, automatically resolved to: /opt/buildagent/work/7bc1c54bc719b67c/work [21:06:22] : [Step 4/5] [2021-11-19 21:06:22,709][INFO ][test-runner-#12575%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] [21:06:22] : [Step 4/5] [21:06:22] : [Step 4/5] >>> __________ ________________ [21:06:22] : [Step 4/5] >>> / _/ ___/ |/ / _/_ __/ __/ [21:06:22] : [Step 4/5] >>> _/ // (7 7 // / / / / _/ [21:06:22] : [Step 4/5] >>> /___/\___/_/|_/___/ /_/ /___/ [21:06:22] : [Step 4/5] >>> [21:06:22] : [Step 4/5] >>> ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:06:22] : [Step 4/5] >>> 2021 Copyright(C) Apache Software Foundation [21:06:22] : [Step 4/5] >>> [21:06:22] : [Step 4/5] >>> Ignite documentation: http://ignite.apache.org [21:06:22] : [Step 4/5] [21:06:22] : [Step 4/5] [2021-11-19 21:06:22,710][INFO ][test-runner-#12575%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] Config URL: n/a [21:06:22] : [Step 4/5] [2021-11-19 21:06:22,710][INFO ][test-runner-#12575%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] IgniteConfiguration [igniteInstanceName=grid-0, pubPoolSize=24, svcPoolSize=24, callbackPoolSize=24, stripedPoolSize=24, sysPoolSize=24, mgmtPoolSize=4, dataStreamerPoolSize=24, utilityCachePoolSize=24, utilityCacheKeepAliveTime=60000, p2pPoolSize=2, qryPoolSize=24, buildIdxPoolSize=4, igniteHome=/opt/buildagent/work/7bc1c54bc719b67c, igniteWorkDir=/opt/buildagent/work/7bc1c54bc719b67c/work, mbeanSrv=com.sun.jmx.mbeanserver.JmxMBeanServer@6fe85038, nodeId=00cd7723-ef5f-442c-96b8-d04940a9d000, marsh=BinaryMarshaller [], marshLocJobs=false, daemon=false, p2pEnabled=true, netTimeout=10000, netCompressionLevel=1, sndRetryDelay=1000, sndRetryCnt=3, metricsHistSize=10000, metricsUpdateFreq=1000, metricsExpTime=9223372036854775807, discoSpi=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=0, ackTimeout=0, marsh=null, reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], segPlc=STOP, segResolveAttempts=2, waitForSegOnStart=true, allResolversPassReq=true, segChkFreq=10000, commSpi=TcpCommunicationSpi [connectGate=org.apache.ignite.spi.communication.tcp.internal.ConnectGateway@7bd6a32a, ctxInitLatch=java.util.concurrent.CountDownLatch@8f76060[Count = 1], stopping=false, clientPool=null, nioSrvWrapper=null, stateProvider=null], evtSpi=MemoryEventStorageSpi [expireAgeMs=9223372036854775807, expireCnt=10000, filter=null], colSpi=NoopCollisionSpi [], deploySpi=LocalDeploymentSpi [], indexingSpi=org.apache.ignite.spi.indexing.noop.NoopIndexingSpi@4017631c, addrRslvr=null, encryptionSpi=org.apache.ignite.spi.encryption.keystore.KeystoreEncryptionSpi@bc9baad, tracingSpi=org.apache.ignite.spi.tracing.NoopTracingSpi@383b002b, clientMode=false, rebalanceThreadPoolSize=4, rebalanceTimeout=10000, rebalanceBatchesPrefetchCnt=3, rebalanceThrottle=0, rebalanceBatchSize=524288, txCfg=TransactionConfiguration [txSerEnabled=false, dfltIsolation=REPEATABLE_READ, dfltConcurrency=PESSIMISTIC, dfltTxTimeout=0, txTimeoutOnPartitionMapExchange=0, deadlockTimeout=10000, pessimisticTxLogSize=0, pessimisticTxLogLinger=10000, tmLookupClsName=null, txManagerFactory=null, useJtaSync=false], cacheSanityCheckEnabled=true, discoStartupDelay=60000, deployMode=SHARED, p2pMissedCacheSize=100, locHost=127.0.0.1, timeSrvPortBase=31100, timeSrvPortRange=100, failureDetectionTimeout=10000, sysWorkerBlockedTimeout=null, clientFailureDetectionTimeout=10000, metricsLogFreq=0, connectorCfg=null, odbcCfg=null, warmupClos=null, atomicCfg=AtomicConfiguration [seqReserveSize=1000, cacheMode=PARTITIONED, backups=1, aff=null, grpName=null], classLdr=null, sslCtxFactory=null, platformCfg=null, binaryCfg=null, memCfg=null, pstCfg=null, dsCfg=DataStorageConfiguration [sysRegionInitSize=41943040, sysRegionMaxSize=104857600, pageSize=4096, concLvl=0, dfltDataRegConf=DataRegionConfiguration [name=default, maxSize=10485760, initSize=268435456, swapPath=null, pageEvictionMode=DISABLED, pageReplacementMode=CLOCK, evictionThreshold=0.9, emptyPagesPoolSize=100, metricsEnabled=false, metricsSubIntervalCount=5, metricsRateTimeInterval=60000, persistenceEnabled=true, checkpointPageBufSize=0, lazyMemoryAllocation=true, warmUpCfg=null], dataRegions=null, storagePath=null, checkpointFreq=180000, lockWaitTime=10000, checkpointThreads=4, checkpointWriteOrder=SEQUENTIAL, walHistSize=20, maxWalArchiveSize=1073741824, walSegments=10, walSegmentSize=67108864, walPath=db/wal, walArchivePath=db/wal/archive, cdcWalPath=db/wal/cdc, cdcEnabled=false, metricsEnabled=false, walMode=FSYNC, walTlbSize=131072, walBuffSize=0, walFlushFreq=2000, walFsyncDelay=1000, walRecordIterBuffSize=67108864, alwaysWriteFullPages=false, fileIOFactory=org.apache.ignite.internal.processors.cache.persistence.file.AsyncFileIOFactory@6fb8cb12, metricsSubIntervalCnt=5, metricsRateTimeInterval=60000, walAutoArchiveAfterInactivity=-1, walForceArchiveTimeout=-1, writeThrottlingEnabled=false, walCompactionEnabled=false, walCompactionLevel=1, checkpointReadLockTimeout=null, walPageCompression=DISABLED, walPageCompressionLevel=null, dfltWarmUpCfg=null, encCfg=org.apache.ignite.configuration.EncryptionConfiguration@7da8a858, defragmentationThreadPoolSize=4, minWalArchiveSize=-1], snapshotPath=snapshots, activeOnStart=true, activeOnStartPropSetFlag=false, autoActivation=true, autoActivationPropSetFlag=false, clusterStateOnStart=null, sqlConnCfg=null, cliConnCfg=ClientConnectorConfiguration [host=null, port=10800, portRange=100, sockSndBufSize=0, sockRcvBufSize=0, tcpNoDelay=true, maxOpenCursorsPerConn=128, threadPoolSize=24, selectorCnt=12, idleTimeout=0, handshakeTimeout=10000, jdbcEnabled=true, odbcEnabled=true, thinCliEnabled=true, sslEnabled=false, useIgniteSslCtxFactory=true, sslClientAuth=false, sslCtxFactory=null, thinCliCfg=ThinClientConfiguration [maxActiveTxPerConn=100, maxActiveComputeTasksPerConn=0]], mvccVacuumThreadCnt=2, mvccVacuumFreq=5000, authEnabled=false, failureHnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]], commFailureRslvr=null, sqlCfg=SqlConfiguration [longQryWarnTimeout=3000, dfltQryTimeout=0, sqlQryHistSize=1000, validationEnabled=false], asyncContinuationExecutor=null] [21:06:22] : [Step 4/5] [2021-11-19 21:06:22,717][INFO ][test-runner-#12575%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] Daemon mode: off [21:06:22] : [Step 4/5] [2021-11-19 21:06:22,717][INFO ][test-runner-#12575%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] OS: Linux 4.15.0-151-generic amd64 [21:06:22] : [Step 4/5] [2021-11-19 21:06:22,718][INFO ][test-runner-#12575%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] OS user: teamcity [21:06:22] : [Step 4/5] [2021-11-19 21:06:22,718][INFO ][test-runner-#12575%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] PID: 16724 [21:06:22] : [Step 4/5] [2021-11-19 21:06:22,718][INFO ][test-runner-#12575%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] Language runtime: Java Platform API Specification ver. 1.8 [21:06:22] : [Step 4/5] [2021-11-19 21:06:22,719][INFO ][test-runner-#12575%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] VM information: Java(TM) SE Runtime Environment 1.8.0_261-b12 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 25.261-b12 [21:06:22] : [Step 4/5] [2021-11-19 21:06:22,719][INFO ][test-runner-#12575%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] VM total memory: 1.9GB [21:06:22] : [Step 4/5] [2021-11-19 21:06:22,719][INFO ][test-runner-#12575%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] Remote Management [restart: off, REST: off, JMX (remote: off)] [21:06:22] : [Step 4/5] [2021-11-19 21:06:22,719][INFO ][test-runner-#12575%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] Logger: GridTestLog4jLogger [quiet=false, config=null] [21:06:22] : [Step 4/5] [2021-11-19 21:06:22,720][INFO ][test-runner-#12575%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] IGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c [21:06:22] : [Step 4/5] [2021-11-19 21:06:22,720][INFO ][test-runner-#12575%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] VM arguments: [-DIGNITE_DUMP_THREADS_ON_FAILURE=false, -DMono=/usr/bin/mono-sgen, -DMono4.0_x64=/usr/lib/mono/4.0, -DMono4.5_x64=/usr/lib/mono/4.5, -DMonoVersion=6.12.0.90, -DSKIP_BUILD=false, -Dagent.home.dir=/opt/buildagent, -Dagent.name=aitc-lin02_03, -Dagent.ownPort=9090, -Dagent.work.dir=/opt/buildagent/work, -Dbuild.number=95, -Dbuild.vcs.number=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.1=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.GitHubApacheIgnite=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dclassworlds.conf=/opt/buildagent/temp/buildTmp/teamcity.m2.conf, -Dcom.jetbrains.maven.watcher.report.file=/opt/buildagent/temp/buildTmp/maven-build-info.xml, -Djava.io.tmpdir=/opt/buildagent/temp/buildTmp, -Dmaven.home=/opt/buildagent/tools/maven3_6, -Dmaven.multiModuleProjectDirectory=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.agent.cpuBenchmark=457, -Dteamcity.agent.dotnet.agent_url=http://localhost:9090/RPC2, -Dteamcity.agent.dotnet.build_id=6278078, -Dteamcity.auth.password=*******, -Dteamcity.auth.userId=TeamCityBuildId=6278078, -Dteamcity.build.changedFiles.file=/opt/buildagent/temp/buildTmp/changedFiles6342607772318147725.txt, -Dteamcity.build.checkoutDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.build.id=6278078, -Dteamcity.build.properties.file=/opt/buildagent/temp/buildTmp/teamcity.build5164517880467851002.properties, -Dteamcity.build.tempDir=/opt/buildagent/temp/buildTmp, -Dteamcity.build.workingDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.buildConfName=Basic 3, -Dteamcity.buildType.id=IgniteTests24Java8_Basic3, -Dteamcity.configuration.properties.file=/opt/buildagent/temp/buildTmp/teamcity.config5591980786735343870.properties, -Dteamcity.maven.userSettings.path=/opt/buildagent/temp/buildTmp/maven_settings_585072866407032347.xml, -Dteamcity.maven.watcher.home=/opt/buildagent/plugins/mavenPlugin/maven-watcher-jdk16, -Dteamcity.projectName=Ignite Tests 2.x (JDK 8/11), -Dteamcity.runner.properties.file=/opt/buildagent/temp/buildTmp/teamcity.runner9098465561618137420.properties, -Dteamcity.tests.recentlyFailedTests.file=/opt/buildagent/temp/buildTmp/testsToRunFirst3891775683130404069.txt, -Dteamcity.version=2021.2 (build 99542), -ea, -Xms2g, -Xmx2g, -XX:+HeapDumpOnOutOfMemoryError, -DIGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_TEST_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_UPDATE_NOTIFIER=false, -DIGNITE_NO_DISCO_ORDER=true, -DIGNITE_PERFORMANCE_SUGGESTIONS_DISABLED=true, -Djava.net.preferIPv4Stack=true, -DTEST_SCALE_FACTOR=1.0, -DIGNITE_TEST_PROP_LOG4J_FILE=log4j-tc-test.xml, -DIGNITE_QUIET=false, -DIGNITE_MARSHAL_BUFFERS_RECHECK=1000, -Dmaven.repo.local=/opt/buildagent/.m2/repository] [21:06:22] : [Step 4/5] [2021-11-19 21:06:22,724][INFO ][test-runner-#12575%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] System cache's DataRegion size is configured to 40 MB. Use DataStorageConfiguration.systemRegionInitialSize property to change the setting. [21:06:22] : [Step 4/5] [2021-11-19 21:06:22,724][INFO ][test-runner-#12575%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] Configured caches [in 'sysMemPlc' dataRegion: ['ignite-sys-cache']] [21:06:22]W: [org.apache.ignite:ignite-core] [2021-11-19 21:06:22,724][WARN ][test-runner-#12575%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] Peer class loading is enabled (disable it in production for performance and deployment consistency reasons) [21:06:22] : [Step 4/5] [2021-11-19 21:06:22,724][INFO ][test-runner-#12575%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] 3-rd party licenses can be found at: /opt/buildagent/work/7bc1c54bc719b67c/libs/licenses [21:06:22] : [Step 4/5] [2021-11-19 21:06:22,728][INFO ][test-runner-#12575%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] Configured plugins: [21:06:22] : [Step 4/5] [2021-11-19 21:06:22,728][INFO ][test-runner-#12575%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- StanByClusterTestProvider 1.0 [21:06:22] : [Step 4/5] [2021-11-19 21:06:22,728][INFO ][test-runner-#12575%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- null [21:06:22] : [Step 4/5] [2021-11-19 21:06:22,728][INFO ][test-runner-#12575%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] [21:06:22] : [Step 4/5] [2021-11-19 21:06:22,729][INFO ][test-runner-#12575%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- PageMemory tracker plugin 1.0 [21:06:22] : [Step 4/5] [2021-11-19 21:06:22,729][INFO ][test-runner-#12575%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- null [21:06:22] : [Step 4/5] [2021-11-19 21:06:22,729][INFO ][test-runner-#12575%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] [21:06:22] : [Step 4/5] [2021-11-19 21:06:22,729][INFO ][test-runner-#12575%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- TestDistibutedConfigurationPlugin 1.0 [21:06:22] : [Step 4/5] [2021-11-19 21:06:22,729][INFO ][test-runner-#12575%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- null [21:06:22] : [Step 4/5] [2021-11-19 21:06:22,729][INFO ][test-runner-#12575%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] [21:06:22] : [Step 4/5] [2021-11-19 21:06:22,730][INFO ][test-runner-#12575%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- NodeValidationPluginProvider 1.0 [21:06:22] : [Step 4/5] [2021-11-19 21:06:22,730][INFO ][test-runner-#12575%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- null [21:06:22] : [Step 4/5] [2021-11-19 21:06:22,730][INFO ][test-runner-#12575%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] [21:06:22] : [Step 4/5] [2021-11-19 21:06:22,730][INFO ][test-runner-#12575%encryption.EncryptedCacheNodeJoinTest%][FailureProcessor] Configured failure handler: [hnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]]] [21:06:22] : [Step 4/5] [2021-11-19 21:06:22,739][INFO ][test-runner-#12575%encryption.EncryptedCacheNodeJoinTest%][TcpCommunicationSpi] Successfully bound communication NIO server to TCP port [port=45150, locHost=/127.0.0.1, selectorsCnt=12, selectorSpins=0, pairedConn=false] [21:06:22]W: [org.apache.ignite:ignite-core] [2021-11-19 21:06:22,739][WARN ][test-runner-#12575%encryption.EncryptedCacheNodeJoinTest%][TcpCommunicationSpi] Message queue limit is set to 0 which may lead to potential OOMEs when running cache operations in FULL_ASYNC or PRIMARY_SYNC modes due to message queues growth on sender and receiver sides. [21:06:22] : [Step 4/5] [2021-11-19 21:06:22,742][INFO ][test-runner-#12575%encryption.EncryptedCacheNodeJoinTest%][GridCollisionManager] Collision resolution is disabled (all jobs will be activated upon arrival). [21:06:22] : [Step 4/5] [2021-11-19 21:06:22,743][INFO ][test-runner-#12575%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] Security status [authentication=off, sandbox=off, tls/ssl=off] [21:06:22] : [Step 4/5] [2021-11-19 21:06:22,799][INFO ][test-runner-#12575%encryption.EncryptedCacheNodeJoinTest%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:06:22] : [Step 4/5] [2021-11-19 21:06:22,882][INFO ][test-runner-#12575%encryption.EncryptedCacheNodeJoinTest%][MaintenanceProcessor] Resolved store directory for node persistent data: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0 [21:06:22] : [Step 4/5] [2021-11-19 21:06:22,883][INFO ][test-runner-#12575%encryption.EncryptedCacheNodeJoinTest%][CacheObjectBinaryProcessorImpl] Resolved directory for serialized binary metadata: /opt/buildagent/work/7bc1c54bc719b67c/work/db/binary_meta/grid_0 [21:06:22] : [Step 4/5] [2021-11-19 21:06:22,887][INFO ][test-runner-#12575%encryption.EncryptedCacheNodeJoinTest%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0 [21:06:22] : [Step 4/5] [2021-11-19 21:06:22,887][INFO ][test-runner-#12575%encryption.EncryptedCacheNodeJoinTest%][FileWriteAheadLogManager] Resolved write ahead log work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0 [21:06:22] : [Step 4/5] [2021-11-19 21:06:22,888][INFO ][test-runner-#12575%encryption.EncryptedCacheNodeJoinTest%][FileWriteAheadLogManager] Resolved write ahead log archive directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0 [21:06:23] : [Step 4/5] [2021-11-19 21:06:23,599][INFO ][test-runner-#12575%encryption.EncryptedCacheNodeJoinTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000000.wal [21:06:23]W: [org.apache.ignite:ignite-core] [2021-11-19 21:06:23,600][WARN ][test-runner-#12575%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] DataRegion maxSize=10.5 MB is smaller than defaultInitialSize=268.4 MB, setting initialSize to 10.5 MB [21:06:23] : [Step 4/5] [2021-11-19 21:06:23,606][INFO ][test-runner-#12575%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Configured data regions initialized successfully [total=5] [21:06:23] : [Step 4/5] [2021-11-19 21:06:23,614][INFO ][test-runner-#12575%encryption.EncryptedCacheNodeJoinTest%][IgniteSnapshotManager] Resolved snapshot work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/snapshots [21:06:23] : [Step 4/5] [2021-11-19 21:06:23,615][INFO ][test-runner-#12575%encryption.EncryptedCacheNodeJoinTest%][IgniteSnapshotManager] Resolved temp directory for snapshot creation: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0/snp [21:06:23] : [Step 4/5] [2021-11-19 21:06:23,618][INFO ][test-runner-#12575%encryption.EncryptedCacheNodeJoinTest%][ClientListenerProcessor] Client connector processor has started on TCP port 10800 [21:06:23] : [Step 4/5] [2021-11-19 21:06:23,620][INFO ][test-runner-#12575%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] Non-loopback local IPs: 172.17.0.4 [21:06:23] : [Step 4/5] [2021-11-19 21:06:23,621][INFO ][test-runner-#12575%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] Enabled local MACs: 0242AC110004 [21:06:23] : [Step 4/5] [2021-11-19 21:06:23,621][INFO ][test-runner-#12575%encryption.EncryptedCacheNodeJoinTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:06:23] : [Step 4/5] [2021-11-19 21:06:23,622][INFO ][test-runner-#12575%encryption.EncryptedCacheNodeJoinTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:06:23] : [Step 4/5] [2021-11-19 21:06:23,623][INFO ][test-runner-#12575%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:06:23] : [Step 4/5] [2021-11-19 21:06:23,625][INFO ][test-runner-#12575%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Applying lost metastore updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:06:23] : [Step 4/5] [2021-11-19 21:06:23,626][INFO ][test-runner-#12575%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=0 ms] [21:06:23] : [Step 4/5] [2021-11-19 21:06:23,626][INFO ][test-runner-#12575%encryption.EncryptedCacheNodeJoinTest%][GridCacheProcessor] Restoring partition state for local groups. [21:06:23] : [Step 4/5] [2021-11-19 21:06:23,626][INFO ][test-runner-#12575%encryption.EncryptedCacheNodeJoinTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=0, partitionsProcessed=0, time=0ms] [21:06:23] : [Step 4/5] [2021-11-19 21:06:23,627][INFO ][test-runner-#12575%encryption.EncryptedCacheNodeJoinTest%][GridEncryptionManager] Encryption keys loaded from metastore. [grps=, masterKeyName=ignite.master.key] [21:06:23] : [Step 4/5] [2021-11-19 21:06:23,628][INFO ][test-runner-#12575%encryption.EncryptedCacheNodeJoinTest%][ClusterProcessor] Cluster ID and tag has been read from metastorage: null [21:06:23] : [Step 4/5] [2021-11-19 21:06:23,629][INFO ][test-runner-#12575%encryption.EncryptedCacheNodeJoinTest%][IgniteClusterImpl] Shutdown policy was updated [oldVal=null, newVal=null] [21:06:23] : [Step 4/5] [2021-11-19 21:06:23,629][INFO ][test-runner-#12575%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Checkpoint frequency deviation changed [oldVal=null, newVal=null] [21:06:23] : [Step 4/5] [2021-11-19 21:06:23,640][INFO ][test-runner-#12575%encryption.EncryptedCacheNodeJoinTest%][FilePageStoreManager] Cleanup cache stores [total=1, left=0, cleanFiles=false] [21:06:23] : [Step 4/5] [2021-11-19 21:06:23,642][INFO ][test-runner-#12575%encryption.EncryptedCacheNodeJoinTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:06:23] : [Step 4/5] [2021-11-19 21:06:23,643][INFO ][test-runner-#12575%encryption.EncryptedCacheNodeJoinTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:06:23] : [Step 4/5] [2021-11-19 21:06:23,644][INFO ][test-runner-#12575%encryption.EncryptedCacheNodeJoinTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:06:23] : [Step 4/5] [2021-11-19 21:06:23,645][INFO ][test-runner-#12575%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Data Regions Started: 5 [21:06:23] : [Step 4/5] [2021-11-19 21:06:23,645][INFO ][test-runner-#12575%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] ^-- sysMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:06:23] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:06:23] : [Step 4/5] ^-- default region [type=default, persistence=true, lazyAlloc=true, [21:06:23] : [Step 4/5] ... initCfg=10MB, maxCfg=10MB, usedRam=0MB, freeRam=100%, allocRam=0MB, allocTotal=0MB] [21:06:23] : [Step 4/5] ^-- metastoreMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:06:23] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:06:23] : [Step 4/5] ^-- TxLog region [type=internal, persistence=true, lazyAlloc=false, [21:06:23] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:06:23] : [Step 4/5] ^-- volatileDsMemPlc region [type=user, persistence=false, lazyAlloc=true, [21:06:23] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB] [21:06:23] : [Step 4/5] ^-- Ignite persistence [used=0MB] [21:06:23] : [Step 4/5] [21:06:23] : [Step 4/5] [2021-11-19 21:06:23,646][INFO ][test-runner-#12575%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Starting binary memory restore for: [-2100569601] [21:06:23] : [Step 4/5] [2021-11-19 21:06:23,653][INFO ][test-runner-#12575%encryption.EncryptedCacheNodeJoinTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:06:23] : [Step 4/5] [2021-11-19 21:06:23,653][INFO ][test-runner-#12575%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:06:23] : [Step 4/5] [2021-11-19 21:06:23,655][INFO ][test-runner-#12575%encryption.EncryptedCacheNodeJoinTest%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000000.wal, offset=0, ver=2] [21:06:23] : [Step 4/5] [2021-11-19 21:06:23,659][INFO ][test-runner-#12575%encryption.EncryptedCacheNodeJoinTest%][GridCacheProcessor] Started cache in recovery mode [name=ignite-sys-cache, id=-2100569601, dataRegionName=sysMemPlc, mode=REPLICATED, atomicity=TRANSACTIONAL, backups=2147483647, mvcc=false] [21:06:23] : [Step 4/5] [2021-11-19 21:06:23,659][INFO ][test-runner-#12575%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Binary recovery performed in 13 ms. [21:06:23] : [Step 4/5] [2021-11-19 21:06:23,660][INFO ][test-runner-#12575%encryption.EncryptedCacheNodeJoinTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:06:23] : [Step 4/5] [2021-11-19 21:06:23,660][INFO ][test-runner-#12575%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Applying lost cache updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:06:23] : [Step 4/5] [2021-11-19 21:06:23,723][INFO ][test-runner-#12575%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=60 ms] [21:06:23] : [Step 4/5] [2021-11-19 21:06:23,723][INFO ][test-runner-#12575%encryption.EncryptedCacheNodeJoinTest%][GridCacheProcessor] Restoring partition state for local groups. [21:06:23] : [Step 4/5] [2021-11-19 21:06:23,731][INFO ][test-runner-#12575%encryption.EncryptedCacheNodeJoinTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=1, partitionsProcessed=100, time=11ms] [21:06:24] : [Step 4/5] [2021-11-19 21:06:24,325][INFO ][test-runner-#12575%encryption.EncryptedCacheNodeJoinTest%][TestTcpDiscoverySpi] Successfully bound to TCP port [port=47500, localHost=localhost/127.0.0.1, locNodeId=00cd7723-ef5f-442c-96b8-d04940a9d000] [21:06:24] : [Step 4/5] [2021-11-19 21:06:24,332][INFO ][disco-notifier-worker-#12686%grid-0%][MvccProcessorImpl] Assigned mvcc coordinator [crd=MvccCoordinator [topVer=AffinityTopologyVersion [topVer=1, minorTopVer=0], nodeId=00cd7723-ef5f-442c-96b8-d04940a9d000, ver=1637345184323, local=true, initialized=false]] [21:06:24] : [Step 4/5] [2021-11-19 21:06:24,334][INFO ][sys-#12685%grid-0%][ClusterProcessor] Writing cluster ID and tag to metastorage on ready for write ClusterIdAndTag [id=dd189d6f-e622-4e9b-884c-236180f44c54, tag=loving_jang] [21:06:24] : [Step 4/5] [2021-11-19 21:06:24,334][INFO ][disco-notifier-worker-#12686%grid-0%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustEnabled' was changed from 'null' to 'false' [21:06:24] : [Step 4/5] [2021-11-19 21:06:24,335][INFO ][disco-notifier-worker-#12686%grid-0%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustTimeout' was changed from 'null' to '300000' [21:06:24] : [Step 4/5] [2021-11-19 21:06:24,336][INFO ][disco-notifier-worker-#12686%grid-0%][IgniteTxManager] Transactions parameter 'longOperationsDumpTimeout' was changed from 'null' to '60000' [21:06:24] : [Step 4/5] [2021-11-19 21:06:24,336][INFO ][disco-notifier-worker-#12686%grid-0%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpThreshold' was changed from 'null' to '0' [21:06:24] : [Step 4/5] [2021-11-19 21:06:24,337][INFO ][disco-notifier-worker-#12686%grid-0%][IgniteTxManager] Transactions parameter 'transactionTimeDumpSamplesCoefficient' was changed from 'null' to '0.0' [21:06:24] : [Step 4/5] [2021-11-19 21:06:24,337][INFO ][disco-notifier-worker-#12686%grid-0%][ClusterProcessor] loving_jang [21:06:24] : [Step 4/5] [2021-11-19 21:06:24,338][INFO ][disco-notifier-worker-#12686%grid-0%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpSamplesPerSecondLimit' was changed from 'null' to '5' [21:06:24] : [Step 4/5] [2021-11-19 21:06:24,338][INFO ][disco-notifier-worker-#12686%grid-0%][IgniteTxManager] Transactions parameter 'collisionsDumpInterval' was changed from 'null' to '1000' [21:06:24] : [Step 4/5] [2021-11-19 21:06:24,339][INFO ][disco-notifier-worker-#12686%grid-0%][IgniteTxManager] Transactions parameter 'txOwnerDumpRequestsAllowed' was changed from 'null' to 'true' [21:06:24] : [Step 4/5] [2021-11-19 21:06:24,340][INFO ][disco-notifier-worker-#12686%grid-0%][GridCacheDatabaseSharedManager] Historical rebalance WAL threshold changed [property=historical.rebalance.threshold, oldVal=null, newVal=500] [21:06:24] : [Step 4/5] [2021-11-19 21:06:24,349][INFO ][test-runner-#12575%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] To start Console Management & Monitoring run ignitevisorcmd.{sh|bat} [21:06:24] : [Step 4/5] [2021-11-19 21:06:24,350][INFO ][test-runner-#12575%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] [21:06:24] : [Step 4/5] [21:06:24] : [Step 4/5] >>> +-------------------------------------------+ [21:06:24] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:06:24] : [Step 4/5] >>> +-------------------------------------------+ [21:06:24] : [Step 4/5] >>> OS name: Linux 4.15.0-151-generic amd64 [21:06:24] : [Step 4/5] >>> CPU(s): 24 [21:06:24] : [Step 4/5] >>> Heap: 2.0GB [21:06:24] : [Step 4/5] >>> VM name: 16724@c4dfe9a430b2 [21:06:24] : [Step 4/5] >>> Ignite instance name: grid-0 [21:06:24] : [Step 4/5] >>> Local node [ID=00CD7723-EF5F-442C-96B8-D04940A9D000, order=1, clientMode=false] [21:06:24] : [Step 4/5] >>> Local node addresses: [127.0.0.1] [21:06:24] : [Step 4/5] >>> Local ports: TCP:10800 TCP:45150 TCP:47500 [21:06:24] : [Step 4/5] [21:06:24] : [Step 4/5] [2021-11-19 21:06:24,351][INFO ][test-runner-#12575%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] >>> Ignite cluster is in INACTIVE state (limited functionality available). Use control.(sh|bat) script or IgniteCluster.state(ClusterState.ACTIVE) to change the state. [21:06:24] : [Step 4/5] [2021-11-19 21:06:24,352][INFO ][test-runner-#12575%encryption.EncryptedCacheNodeJoinTest%][GridDiscoveryManager] Topology snapshot [ver=1, locNode=00cd7723, servers=1, clients=0, state=INACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=00cd7723-ef5f-442c-96b8-d04940a9d000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:06:24] : [Step 4/5] [2021-11-19 21:06:24,353][INFO ][test-runner-#12575%encryption.EncryptedCacheNodeJoinTest%][G] Node started : [stage="Configure system pool" (0 ms),stage="Start managers" (174 ms),stage="Configure binary metadata" (1 ms),stage="Start processors" (735 ms),stage="Start 'StanByClusterTestProvider' plugin" (0 ms),stage="Start 'PageMemory tracker plugin' plugin" (0 ms),stage="Start 'TestDistibutedConfigurationPlugin' plugin" (0 ms),stage="Start 'NodeValidationPluginProvider' plugin" (0 ms),stage="Init metastore" (20 ms),stage="Init and start regions" (5 ms),stage="Restore binary memory" (13 ms),stage="Restore logical state" (71 ms),stage="Finish recovery" (592 ms),stage="Join topology" (7 ms),stage="Await transition" (2 ms),stage="Await exchange" (18 ms),stage="Total time" (1638 ms)] [21:06:24] : [Step 4/5] [2021-11-19 21:06:24,354][INFO ][test-runner-#12575%encryption.EncryptedCacheNodeJoinTest%][root] Node started with the following configuration [id=00cd7723-ef5f-442c-96b8-d04940a9d000, marshaller=BinaryMarshaller [], discovery=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=5000, ackTimeout=5000, marsh=JdkMarshaller [clsFilter=org.apache.ignite.marshaller.MarshallerUtils$1@8a2443c], reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], binaryCfg=null, lateAff=true] [21:06:24]W: [org.apache.ignite:ignite-core] [2021-11-19 21:06:24,361][WARN ][test-runner-#12575%encryption.EncryptedCacheNodeJoinTest%][G] Ignite work directory is not provided, automatically resolved to: /opt/buildagent/work/7bc1c54bc719b67c/work [21:06:24] : [Step 4/5] [2021-11-19 21:06:24,362][INFO ][test-runner-#12575%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-2] [21:06:24] : [Step 4/5] [21:06:24] : [Step 4/5] >>> __________ ________________ [21:06:24] : [Step 4/5] >>> / _/ ___/ |/ / _/_ __/ __/ [21:06:24] : [Step 4/5] >>> _/ // (7 7 // / / / / _/ [21:06:24] : [Step 4/5] >>> /___/\___/_/|_/___/ /_/ /___/ [21:06:24] : [Step 4/5] >>> [21:06:24] : [Step 4/5] >>> ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:06:24] : [Step 4/5] >>> 2021 Copyright(C) Apache Software Foundation [21:06:24] : [Step 4/5] >>> [21:06:24] : [Step 4/5] >>> Ignite documentation: http://ignite.apache.org [21:06:24] : [Step 4/5] [21:06:24] : [Step 4/5] [2021-11-19 21:06:24,362][INFO ][test-runner-#12575%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-2] Config URL: n/a [21:06:24] : [Step 4/5] [2021-11-19 21:06:24,363][INFO ][test-runner-#12575%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-2] IgniteConfiguration [igniteInstanceName=grid-2, pubPoolSize=24, svcPoolSize=24, callbackPoolSize=24, stripedPoolSize=24, sysPoolSize=24, mgmtPoolSize=4, dataStreamerPoolSize=24, utilityCachePoolSize=24, utilityCacheKeepAliveTime=60000, p2pPoolSize=2, qryPoolSize=24, buildIdxPoolSize=4, igniteHome=/opt/buildagent/work/7bc1c54bc719b67c, igniteWorkDir=/opt/buildagent/work/7bc1c54bc719b67c/work, mbeanSrv=com.sun.jmx.mbeanserver.JmxMBeanServer@6fe85038, nodeId=20c43ac3-a7ad-4106-a1ad-18c49bbfa002, marsh=BinaryMarshaller [], marshLocJobs=false, daemon=false, p2pEnabled=true, netTimeout=10000, netCompressionLevel=1, sndRetryDelay=1000, sndRetryCnt=3, metricsHistSize=10000, metricsUpdateFreq=1000, metricsExpTime=9223372036854775807, discoSpi=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=0, ackTimeout=0, marsh=null, reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], segPlc=STOP, segResolveAttempts=2, waitForSegOnStart=true, allResolversPassReq=true, segChkFreq=10000, commSpi=TcpCommunicationSpi [connectGate=org.apache.ignite.spi.communication.tcp.internal.ConnectGateway@3e0ebe1f, ctxInitLatch=java.util.concurrent.CountDownLatch@b8e5b9f[Count = 1], stopping=false, clientPool=null, nioSrvWrapper=null, stateProvider=null], evtSpi=MemoryEventStorageSpi [expireAgeMs=9223372036854775807, expireCnt=10000, filter=null], colSpi=NoopCollisionSpi [], deploySpi=LocalDeploymentSpi [], indexingSpi=org.apache.ignite.spi.indexing.noop.NoopIndexingSpi@3b392f79, addrRslvr=null, encryptionSpi=org.apache.ignite.spi.encryption.keystore.KeystoreEncryptionSpi@2bcc4a75, tracingSpi=org.apache.ignite.spi.tracing.NoopTracingSpi@19223c59, clientMode=false, rebalanceThreadPoolSize=4, rebalanceTimeout=10000, rebalanceBatchesPrefetchCnt=3, rebalanceThrottle=0, rebalanceBatchSize=524288, txCfg=TransactionConfiguration [txSerEnabled=false, dfltIsolation=REPEATABLE_READ, dfltConcurrency=PESSIMISTIC, dfltTxTimeout=0, txTimeoutOnPartitionMapExchange=0, deadlockTimeout=10000, pessimisticTxLogSize=0, pessimisticTxLogLinger=10000, tmLookupClsName=null, txManagerFactory=null, useJtaSync=false], cacheSanityCheckEnabled=true, discoStartupDelay=60000, deployMode=SHARED, p2pMissedCacheSize=100, locHost=127.0.0.1, timeSrvPortBase=31100, timeSrvPortRange=100, failureDetectionTimeout=10000, sysWorkerBlockedTimeout=null, clientFailureDetectionTimeout=10000, metricsLogFreq=0, connectorCfg=null, odbcCfg=null, warmupClos=null, atomicCfg=AtomicConfiguration [seqReserveSize=1000, cacheMode=PARTITIONED, backups=1, aff=null, grpName=null], classLdr=null, sslCtxFactory=null, platformCfg=null, binaryCfg=null, memCfg=null, pstCfg=null, dsCfg=DataStorageConfiguration [sysRegionInitSize=41943040, sysRegionMaxSize=104857600, pageSize=4096, concLvl=0, dfltDataRegConf=DataRegionConfiguration [name=default, maxSize=10485760, initSize=268435456, swapPath=null, pageEvictionMode=DISABLED, pageReplacementMode=CLOCK, evictionThreshold=0.9, emptyPagesPoolSize=100, metricsEnabled=false, metricsSubIntervalCount=5, metricsRateTimeInterval=60000, persistenceEnabled=true, checkpointPageBufSize=0, lazyMemoryAllocation=true, warmUpCfg=null], dataRegions=null, storagePath=null, checkpointFreq=180000, lockWaitTime=10000, checkpointThreads=4, checkpointWriteOrder=SEQUENTIAL, walHistSize=20, maxWalArchiveSize=1073741824, walSegments=10, walSegmentSize=67108864, walPath=db/wal, walArchivePath=db/wal/archive, cdcWalPath=db/wal/cdc, cdcEnabled=false, metricsEnabled=false, walMode=FSYNC, walTlbSize=131072, walBuffSize=0, walFlushFreq=2000, walFsyncDelay=1000, walRecordIterBuffSize=67108864, alwaysWriteFullPages=false, fileIOFactory=org.apache.ignite.internal.processors.cache.persistence.file.AsyncFileIOFactory@6ea33bd1, metricsSubIntervalCnt=5, metricsRateTimeInterval=60000, walAutoArchiveAfterInactivity=-1, walForceArchiveTimeout=-1, writeThrottlingEnabled=false, walCompactionEnabled=false, walCompactionLevel=1, checkpointReadLockTimeout=null, walPageCompression=DISABLED, walPageCompressionLevel=null, dfltWarmUpCfg=null, encCfg=org.apache.ignite.configuration.EncryptionConfiguration@400e3a3a, defragmentationThreadPoolSize=4, minWalArchiveSize=-1], snapshotPath=snapshots, activeOnStart=true, activeOnStartPropSetFlag=false, autoActivation=true, autoActivationPropSetFlag=false, clusterStateOnStart=null, sqlConnCfg=null, cliConnCfg=ClientConnectorConfiguration [host=null, port=10800, portRange=100, sockSndBufSize=0, sockRcvBufSize=0, tcpNoDelay=true, maxOpenCursorsPerConn=128, threadPoolSize=24, selectorCnt=12, idleTimeout=0, handshakeTimeout=10000, jdbcEnabled=true, odbcEnabled=true, thinCliEnabled=true, sslEnabled=false, useIgniteSslCtxFactory=true, sslClientAuth=false, sslCtxFactory=null, thinCliCfg=ThinClientConfiguration [maxActiveTxPerConn=100, maxActiveComputeTasksPerConn=0]], mvccVacuumThreadCnt=2, mvccVacuumFreq=5000, authEnabled=false, failureHnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]], commFailureRslvr=null, sqlCfg=SqlConfiguration [longQryWarnTimeout=3000, dfltQryTimeout=0, sqlQryHistSize=1000, validationEnabled=false], asyncContinuationExecutor=null] [21:06:24] : [Step 4/5] [2021-11-19 21:06:24,370][INFO ][test-runner-#12575%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-2] Daemon mode: off [21:06:24] : [Step 4/5] [2021-11-19 21:06:24,370][INFO ][test-runner-#12575%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-2] OS: Linux 4.15.0-151-generic amd64 [21:06:24] : [Step 4/5] [2021-11-19 21:06:24,370][INFO ][test-runner-#12575%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-2] OS user: teamcity [21:06:24] : [Step 4/5] [2021-11-19 21:06:24,370][INFO ][test-runner-#12575%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-2] PID: 16724 [21:06:24] : [Step 4/5] [2021-11-19 21:06:24,371][INFO ][test-runner-#12575%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-2] Language runtime: Java Platform API Specification ver. 1.8 [21:06:24] : [Step 4/5] [2021-11-19 21:06:24,371][INFO ][test-runner-#12575%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-2] VM information: Java(TM) SE Runtime Environment 1.8.0_261-b12 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 25.261-b12 [21:06:24] : [Step 4/5] [2021-11-19 21:06:24,371][INFO ][test-runner-#12575%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-2] VM total memory: 1.9GB [21:06:24] : [Step 4/5] [2021-11-19 21:06:24,371][INFO ][test-runner-#12575%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-2] Remote Management [restart: off, REST: off, JMX (remote: off)] [21:06:24] : [Step 4/5] [2021-11-19 21:06:24,372][INFO ][test-runner-#12575%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-2] Logger: GridTestLog4jLogger [quiet=false, config=null] [21:06:24] : [Step 4/5] [2021-11-19 21:06:24,372][INFO ][test-runner-#12575%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-2] IGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c [21:06:24] : [Step 4/5] [2021-11-19 21:06:24,372][INFO ][test-runner-#12575%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-2] VM arguments: [-DIGNITE_DUMP_THREADS_ON_FAILURE=false, -DMono=/usr/bin/mono-sgen, -DMono4.0_x64=/usr/lib/mono/4.0, -DMono4.5_x64=/usr/lib/mono/4.5, -DMonoVersion=6.12.0.90, -DSKIP_BUILD=false, -Dagent.home.dir=/opt/buildagent, -Dagent.name=aitc-lin02_03, -Dagent.ownPort=9090, -Dagent.work.dir=/opt/buildagent/work, -Dbuild.number=95, -Dbuild.vcs.number=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.1=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.GitHubApacheIgnite=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dclassworlds.conf=/opt/buildagent/temp/buildTmp/teamcity.m2.conf, -Dcom.jetbrains.maven.watcher.report.file=/opt/buildagent/temp/buildTmp/maven-build-info.xml, -Djava.io.tmpdir=/opt/buildagent/temp/buildTmp, -Dmaven.home=/opt/buildagent/tools/maven3_6, -Dmaven.multiModuleProjectDirectory=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.agent.cpuBenchmark=457, -Dteamcity.agent.dotnet.agent_url=http://localhost:9090/RPC2, -Dteamcity.agent.dotnet.build_id=6278078, -Dteamcity.auth.password=*******, -Dteamcity.auth.userId=TeamCityBuildId=6278078, -Dteamcity.build.changedFiles.file=/opt/buildagent/temp/buildTmp/changedFiles6342607772318147725.txt, -Dteamcity.build.checkoutDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.build.id=6278078, -Dteamcity.build.properties.file=/opt/buildagent/temp/buildTmp/teamcity.build5164517880467851002.properties, -Dteamcity.build.tempDir=/opt/buildagent/temp/buildTmp, -Dteamcity.build.workingDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.buildConfName=Basic 3, -Dteamcity.buildType.id=IgniteTests24Java8_Basic3, -Dteamcity.configuration.properties.file=/opt/buildagent/temp/buildTmp/teamcity.config5591980786735343870.properties, -Dteamcity.maven.userSettings.path=/opt/buildagent/temp/buildTmp/maven_settings_585072866407032347.xml, -Dteamcity.maven.watcher.home=/opt/buildagent/plugins/mavenPlugin/maven-watcher-jdk16, -Dteamcity.projectName=Ignite Tests 2.x (JDK 8/11), -Dteamcity.runner.properties.file=/opt/buildagent/temp/buildTmp/teamcity.runner9098465561618137420.properties, -Dteamcity.tests.recentlyFailedTests.file=/opt/buildagent/temp/buildTmp/testsToRunFirst3891775683130404069.txt, -Dteamcity.version=2021.2 (build 99542), -ea, -Xms2g, -Xmx2g, -XX:+HeapDumpOnOutOfMemoryError, -DIGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_TEST_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_UPDATE_NOTIFIER=false, -DIGNITE_NO_DISCO_ORDER=true, -DIGNITE_PERFORMANCE_SUGGESTIONS_DISABLED=true, -Djava.net.preferIPv4Stack=true, -DTEST_SCALE_FACTOR=1.0, -DIGNITE_TEST_PROP_LOG4J_FILE=log4j-tc-test.xml, -DIGNITE_QUIET=false, -DIGNITE_MARSHAL_BUFFERS_RECHECK=1000, -Dmaven.repo.local=/opt/buildagent/.m2/repository] [21:06:24] : [Step 4/5] [2021-11-19 21:06:24,376][INFO ][test-runner-#12575%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-2] System cache's DataRegion size is configured to 40 MB. Use DataStorageConfiguration.systemRegionInitialSize property to change the setting. [21:06:24] : [Step 4/5] [2021-11-19 21:06:24,376][INFO ][test-runner-#12575%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-2] Configured caches [in 'sysMemPlc' dataRegion: ['ignite-sys-cache']] [21:06:24]W: [org.apache.ignite:ignite-core] [2021-11-19 21:06:24,377][WARN ][test-runner-#12575%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-2] Peer class loading is enabled (disable it in production for performance and deployment consistency reasons) [21:06:24] : [Step 4/5] [2021-11-19 21:06:24,377][INFO ][test-runner-#12575%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-2] 3-rd party licenses can be found at: /opt/buildagent/work/7bc1c54bc719b67c/libs/licenses [21:06:24] : [Step 4/5] [2021-11-19 21:06:24,381][INFO ][test-runner-#12575%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] Configured plugins: [21:06:24] : [Step 4/5] [2021-11-19 21:06:24,381][INFO ][test-runner-#12575%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- StanByClusterTestProvider 1.0 [21:06:24] : [Step 4/5] [2021-11-19 21:06:24,381][INFO ][test-runner-#12575%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- null [21:06:24] : [Step 4/5] [2021-11-19 21:06:24,382][INFO ][test-runner-#12575%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] [21:06:24] : [Step 4/5] [2021-11-19 21:06:24,382][INFO ][test-runner-#12575%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- PageMemory tracker plugin 1.0 [21:06:24] : [Step 4/5] [2021-11-19 21:06:24,382][INFO ][test-runner-#12575%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- null [21:06:24] : [Step 4/5] [2021-11-19 21:06:24,382][INFO ][test-runner-#12575%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] [21:06:24] : [Step 4/5] [2021-11-19 21:06:24,382][INFO ][test-runner-#12575%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- TestDistibutedConfigurationPlugin 1.0 [21:06:24] : [Step 4/5] [2021-11-19 21:06:24,382][INFO ][test-runner-#12575%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- null [21:06:24] : [Step 4/5] [2021-11-19 21:06:24,383][INFO ][test-runner-#12575%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] [21:06:24] : [Step 4/5] [2021-11-19 21:06:24,383][INFO ][test-runner-#12575%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- NodeValidationPluginProvider 1.0 [21:06:24] : [Step 4/5] [2021-11-19 21:06:24,383][INFO ][test-runner-#12575%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- null [21:06:24] : [Step 4/5] [2021-11-19 21:06:24,383][INFO ][test-runner-#12575%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] [21:06:24] : [Step 4/5] [2021-11-19 21:06:24,383][INFO ][test-runner-#12575%encryption.EncryptedCacheNodeJoinTest%][FailureProcessor] Configured failure handler: [hnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]]] [21:06:24] : [Step 4/5] [2021-11-19 21:06:24,399][INFO ][test-runner-#12575%encryption.EncryptedCacheNodeJoinTest%][TcpCommunicationSpi] Successfully bound communication NIO server to TCP port [port=45151, locHost=/127.0.0.1, selectorsCnt=12, selectorSpins=0, pairedConn=false] [21:06:24]W: [org.apache.ignite:ignite-core] [2021-11-19 21:06:24,399][WARN ][test-runner-#12575%encryption.EncryptedCacheNodeJoinTest%][TcpCommunicationSpi] Message queue limit is set to 0 which may lead to potential OOMEs when running cache operations in FULL_ASYNC or PRIMARY_SYNC modes due to message queues growth on sender and receiver sides. [21:06:24] : [Step 4/5] [2021-11-19 21:06:24,403][INFO ][test-runner-#12575%encryption.EncryptedCacheNodeJoinTest%][GridCollisionManager] Collision resolution is disabled (all jobs will be activated upon arrival). [21:06:24] : [Step 4/5] [2021-11-19 21:06:24,403][INFO ][test-runner-#12575%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-2] Security status [authentication=off, sandbox=off, tls/ssl=off] [21:06:24] : [Step 4/5] [2021-11-19 21:06:24,460][INFO ][test-runner-#12575%encryption.EncryptedCacheNodeJoinTest%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/other_tde_keystore.jks] [21:06:24] : [Step 4/5] [2021-11-19 21:06:24,543][INFO ][test-runner-#12575%encryption.EncryptedCacheNodeJoinTest%][MaintenanceProcessor] Resolved store directory for node persistent data: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_2 [21:06:24] : [Step 4/5] [2021-11-19 21:06:24,545][INFO ][test-runner-#12575%encryption.EncryptedCacheNodeJoinTest%][CacheObjectBinaryProcessorImpl] Resolved directory for serialized binary metadata: /opt/buildagent/work/7bc1c54bc719b67c/work/db/binary_meta/grid_2 [21:06:24] : [Step 4/5] [2021-11-19 21:06:24,549][INFO ][test-runner-#12575%encryption.EncryptedCacheNodeJoinTest%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_2 [21:06:24] : [Step 4/5] [2021-11-19 21:06:24,549][INFO ][test-runner-#12575%encryption.EncryptedCacheNodeJoinTest%][FileWriteAheadLogManager] Resolved write ahead log work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_2 [21:06:24] : [Step 4/5] [2021-11-19 21:06:24,549][INFO ][test-runner-#12575%encryption.EncryptedCacheNodeJoinTest%][FileWriteAheadLogManager] Resolved write ahead log archive directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_2 [21:06:24] : [Step 4/5] [2021-11-19 21:06:24,975][INFO ][test-runner-#12575%encryption.EncryptedCacheNodeJoinTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_2/0000000000000000.wal [21:06:24] : [Step 4/5] [2021-11-19 21:06:24,980][INFO ][test-runner-#12575%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Configured data regions initialized successfully [total=5] [21:06:24] : [Step 4/5] [2021-11-19 21:06:24,982][INFO ][test-runner-#12575%encryption.EncryptedCacheNodeJoinTest%][IgniteSnapshotManager] Resolved snapshot work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/snapshots [21:06:24] : [Step 4/5] [2021-11-19 21:06:24,983][INFO ][test-runner-#12575%encryption.EncryptedCacheNodeJoinTest%][IgniteSnapshotManager] Resolved temp directory for snapshot creation: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_2/snp [21:06:24] : [Step 4/5] [2021-11-19 21:06:24,986][INFO ][test-runner-#12575%encryption.EncryptedCacheNodeJoinTest%][ClientListenerProcessor] Client connector processor has started on TCP port 10801 [21:06:24] : [Step 4/5] [2021-11-19 21:06:24,989][INFO ][test-runner-#12575%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-2] Non-loopback local IPs: 172.17.0.4 [21:06:24] : [Step 4/5] [2021-11-19 21:06:24,990][INFO ][test-runner-#12575%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-2] Enabled local MACs: 0242AC110004 [21:06:24] : [Step 4/5] [2021-11-19 21:06:24,990][INFO ][test-runner-#12575%encryption.EncryptedCacheNodeJoinTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:06:24] : [Step 4/5] [2021-11-19 21:06:24,991][INFO ][test-runner-#12575%encryption.EncryptedCacheNodeJoinTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:06:24] : [Step 4/5] [2021-11-19 21:06:24,992][INFO ][test-runner-#12575%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:06:24] : [Step 4/5] [2021-11-19 21:06:24,994][INFO ][test-runner-#12575%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Applying lost metastore updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:06:24] : [Step 4/5] [2021-11-19 21:06:24,995][INFO ][test-runner-#12575%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=0 ms] [21:06:24] : [Step 4/5] [2021-11-19 21:06:24,996][INFO ][test-runner-#12575%encryption.EncryptedCacheNodeJoinTest%][GridCacheProcessor] Restoring partition state for local groups. [21:06:24] : [Step 4/5] [2021-11-19 21:06:24,996][INFO ][test-runner-#12575%encryption.EncryptedCacheNodeJoinTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=0, partitionsProcessed=0, time=0ms] [21:06:24] : [Step 4/5] [2021-11-19 21:06:24,996][INFO ][test-runner-#12575%encryption.EncryptedCacheNodeJoinTest%][GridEncryptionManager] Encryption keys loaded from metastore. [grps=, masterKeyName=ignite.master.key] [21:06:24] : [Step 4/5] [2021-11-19 21:06:24,998][INFO ][test-runner-#12575%encryption.EncryptedCacheNodeJoinTest%][ClusterProcessor] Cluster ID and tag has been read from metastorage: null [21:06:24] : [Step 4/5] [2021-11-19 21:06:24,999][INFO ][test-runner-#12575%encryption.EncryptedCacheNodeJoinTest%][IgniteClusterImpl] Shutdown policy was updated [oldVal=null, newVal=null] [21:06:24] : [Step 4/5] [2021-11-19 21:06:24,999][INFO ][test-runner-#12575%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Checkpoint frequency deviation changed [oldVal=null, newVal=null] [21:06:25] : [Step 4/5] [2021-11-19 21:06:25,009][INFO ][test-runner-#12575%encryption.EncryptedCacheNodeJoinTest%][FilePageStoreManager] Cleanup cache stores [total=1, left=0, cleanFiles=false] [21:06:25] : [Step 4/5] [2021-11-19 21:06:25,011][INFO ][test-runner-#12575%encryption.EncryptedCacheNodeJoinTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:06:25] : [Step 4/5] [2021-11-19 21:06:25,012][INFO ][test-runner-#12575%encryption.EncryptedCacheNodeJoinTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:06:25] : [Step 4/5] [2021-11-19 21:06:25,013][INFO ][test-runner-#12575%encryption.EncryptedCacheNodeJoinTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:06:25] : [Step 4/5] [2021-11-19 21:06:25,014][INFO ][test-runner-#12575%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Data Regions Started: 5 [21:06:25] : [Step 4/5] [2021-11-19 21:06:25,015][INFO ][test-runner-#12575%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] ^-- sysMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:06:25] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:06:25] : [Step 4/5] ^-- default region [type=default, persistence=true, lazyAlloc=true, [21:06:25] : [Step 4/5] ... initCfg=10MB, maxCfg=10MB, usedRam=0MB, freeRam=100%, allocRam=0MB, allocTotal=0MB] [21:06:25] : [Step 4/5] ^-- metastoreMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:06:25] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:06:25] : [Step 4/5] ^-- TxLog region [type=internal, persistence=true, lazyAlloc=false, [21:06:25] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:06:25] : [Step 4/5] ^-- volatileDsMemPlc region [type=user, persistence=false, lazyAlloc=true, [21:06:25] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB] [21:06:25] : [Step 4/5] ^-- Ignite persistence [used=0MB] [21:06:25] : [Step 4/5] [21:06:25] : [Step 4/5] [2021-11-19 21:06:25,017][INFO ][test-runner-#12575%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Starting binary memory restore for: [-2100569601] [21:06:25] : [Step 4/5] [2021-11-19 21:06:25,027][INFO ][test-runner-#12575%encryption.EncryptedCacheNodeJoinTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:06:25] : [Step 4/5] [2021-11-19 21:06:25,028][INFO ][test-runner-#12575%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:06:25] : [Step 4/5] [2021-11-19 21:06:25,029][INFO ][test-runner-#12575%encryption.EncryptedCacheNodeJoinTest%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_2/0000000000000000.wal, offset=0, ver=2] [21:06:25] : [Step 4/5] [2021-11-19 21:06:25,036][INFO ][test-runner-#12575%encryption.EncryptedCacheNodeJoinTest%][GridCacheProcessor] Started cache in recovery mode [name=ignite-sys-cache, id=-2100569601, dataRegionName=sysMemPlc, mode=REPLICATED, atomicity=TRANSACTIONAL, backups=2147483647, mvcc=false] [21:06:25] : [Step 4/5] [2021-11-19 21:06:25,037][INFO ][test-runner-#12575%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Binary recovery performed in 20 ms. [21:06:25] : [Step 4/5] [2021-11-19 21:06:25,037][INFO ][test-runner-#12575%encryption.EncryptedCacheNodeJoinTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:06:25] : [Step 4/5] [2021-11-19 21:06:25,037][INFO ][test-runner-#12575%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Applying lost cache updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:06:25] : [Step 4/5] [2021-11-19 21:06:25,096][INFO ][test-runner-#12575%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=60 ms] [21:06:25] : [Step 4/5] [2021-11-19 21:06:25,097][INFO ][test-runner-#12575%encryption.EncryptedCacheNodeJoinTest%][GridCacheProcessor] Restoring partition state for local groups. [21:06:25] : [Step 4/5] [2021-11-19 21:06:25,105][INFO ][test-runner-#12575%encryption.EncryptedCacheNodeJoinTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=1, partitionsProcessed=100, time=10ms] [21:06:25] : [Step 4/5] [2021-11-19 21:06:25,403][INFO ][test-runner-#12575%encryption.EncryptedCacheNodeJoinTest%][TestTcpDiscoverySpi] Successfully bound to TCP port [port=47501, localHost=localhost/127.0.0.1, locNodeId=20c43ac3-a7ad-4106-a1ad-18c49bbfa002] [21:06:25] : [Step 4/5] [2021-11-19 21:06:25,406][INFO ][tcp-disco-srvr-[:47500]-#661%grid-0%-#12688%grid-0%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=54923] [21:06:25] : [Step 4/5] [2021-11-19 21:06:25,406][INFO ][tcp-disco-srvr-[:47500]-#661%grid-0%-#12688%grid-0%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=54923] [21:06:25] : [Step 4/5] [2021-11-19 21:06:25,407][INFO ][tcp-disco-sock-reader-[]-#667%grid-0%-#12807%grid-0%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:54923, rmtPort=54923] [21:06:25] : [Step 4/5] [2021-11-19 21:06:25,408][INFO ][tcp-disco-sock-reader-[20c43ac3 127.0.0.1:54923]-#667%grid-0%-#12807%grid-0%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=20c43ac3-a7ad-4106-a1ad-18c49bbfa002, rmtAddr=/127.0.0.1:54923] [21:06:25] : [Step 4/5] [2021-11-19 21:06:25,411][INFO ][tcp-disco-srvr-[:47501]-#666%grid-2%-#12806%grid-2%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=43337] [21:06:25] : [Step 4/5] [2021-11-19 21:06:25,412][INFO ][tcp-disco-srvr-[:47501]-#666%grid-2%-#12806%grid-2%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=43337] [21:06:25] : [Step 4/5] [2021-11-19 21:06:25,416][INFO ][tcp-disco-sock-reader-[]-#668%grid-2%-#12808%grid-2%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:43337, rmtPort=43337] [21:06:25] : [Step 4/5] [2021-11-19 21:06:25,417][INFO ][tcp-disco-sock-reader-[]-#668%grid-2%-#12808%grid-2%][TestTcpDiscoverySpi] Received ping request from the remote node [rmtNodeId=00cd7723-ef5f-442c-96b8-d04940a9d000, rmtAddr=/127.0.0.1:43337, rmtPort=43337] [21:06:25] : [Step 4/5] [2021-11-19 21:06:25,418][INFO ][tcp-disco-sock-reader-[]-#668%grid-2%-#12808%grid-2%][TestTcpDiscoverySpi] Finished writing ping response [rmtNodeId=00cd7723-ef5f-442c-96b8-d04940a9d000, rmtAddr=/127.0.0.1:43337, rmtPort=43337] [21:06:25]W: [org.apache.ignite:ignite-core] [2021-11-19 21:06:25,419][WARN ][tcp-disco-sock-reader-[]-#668%grid-2%-#12808%grid-2%][TestTcpDiscoverySpi] Failed to shutdown socket [21:06:25]W: [org.apache.ignite:ignite-core] java.net.SocketException: Socket output is already shutdown [21:06:25]W: [org.apache.ignite:ignite-core] at java.net.Socket.shutdownOutput(Socket.java:1572) [21:06:25]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.close(IgniteUtils.java:4247) [21:06:25]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.discovery.tcp.ServerImpl$SocketReader.body(ServerImpl.java:7370) [21:06:25]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.IgniteSpiThread.run(IgniteSpiThread.java:58) [21:06:25] : [Step 4/5] [2021-11-19 21:06:25,422][INFO ][tcp-disco-sock-reader-[]-#668%grid-2%-#12808%grid-2%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:43337, rmtPort=43337, rmtNodeId=null] [21:06:25] : [Step 4/5] [2021-11-19 21:06:25,425][INFO ][tcp-disco-sock-reader-[20c43ac3 127.0.0.1:54923]-#667%grid-0%-#12807%grid-0%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:54923, rmtPort=54923, rmtNodeId=20c43ac3-a7ad-4106-a1ad-18c49bbfa002] [21:06:25] : [Step 4/5] [2021-11-19 21:06:25,427][INFO ][tcp-disco-srvr-[:47501]-#666%grid-2%-#12806%grid-2%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=53625] [21:06:25] : [Step 4/5] [2021-11-19 21:06:25,428][INFO ][tcp-disco-srvr-[:47501]-#666%grid-2%-#12806%grid-2%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=53625] [21:06:25]W: [org.apache.ignite:ignite-core] [2021-11-19 21:06:25,425][WARN ][disco-pool-#12809%grid-0%][TestTcpDiscoverySpi] Master key digest differs! Node join is rejected. [node=20c43ac3-a7ad-4106-a1ad-18c49bbfa002] [21:06:25] : [Step 4/5] [2021-11-19 21:06:25,432][INFO ][tcp-disco-sock-reader-[]-#669%grid-2%-#12810%grid-2%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:53625, rmtPort=53625] [21:06:25] : [Step 4/5] [2021-11-19 21:06:25,433][INFO ][tcp-disco-sock-reader-[00cd7723 127.0.0.1:53625]-#669%grid-2%-#12810%grid-2%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=00cd7723-ef5f-442c-96b8-d04940a9d000, rmtAddr=/127.0.0.1:53625] [21:06:25] : [Step 4/5] [2021-11-19 21:06:25,436][INFO ][tcp-disco-sock-reader-[00cd7723 127.0.0.1:53625]-#669%grid-2%-#12810%grid-2%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:53625, rmtPort=53625, rmtNodeId=00cd7723-ef5f-442c-96b8-d04940a9d000] [21:06:25]W: [org.apache.ignite:ignite-core] [2021-11-19 21:06:25,436][ERROR][test-runner-#12575%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-2] Failed to start manager: GridManagerAdapter [enabled=true, name=o.a.i.i.managers.discovery.GridDiscoveryManager] [21:06:25]W: [org.apache.ignite:ignite-core] class org.apache.ignite.IgniteCheckedException: Failed to start SPI: TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=5000, ackTimeout=5000, marsh=JdkMarshaller [clsFilter=org.apache.ignite.marshaller.MarshallerUtils$1@2bee5797], reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false] [21:06:25]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.managers.GridManagerAdapter.startSpi(GridManagerAdapter.java:281) [21:06:25]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.managers.discovery.GridDiscoveryManager.start(GridDiscoveryManager.java:1091) [21:06:25]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.IgniteKernal.startManager(IgniteKernal.java:1953) [21:06:25]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.IgniteKernal.start(IgniteKernal.java:1300) [21:06:25]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.IgnitionEx$IgniteNamedInstance.start0(IgnitionEx.java:1798) [21:06:25]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.IgnitionEx$IgniteNamedInstance.start(IgnitionEx.java:1720) [21:06:25]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.IgnitionEx.start0(IgnitionEx.java:1159) [21:06:25]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.IgnitionEx.start(IgnitionEx.java:629) [21:06:25]W: [org.apache.ignite:ignite-core] at org.apache.ignite.testframework.junits.GridAbstractTest.startGrid(GridAbstractTest.java:1252) [21:06:25]W: [org.apache.ignite:ignite-core] at org.apache.ignite.testframework.junits.GridAbstractTest.startGrid(GridAbstractTest.java:1169) [21:06:25]W: [org.apache.ignite:ignite-core] at org.apache.ignite.testframework.junits.GridAbstractTest.startGrid(GridAbstractTest.java:1145) [21:06:25]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.encryption.EncryptedCacheNodeJoinTest.lambda$testNodeCantJoinWithDifferentKeyStore$1(EncryptedCacheNodeJoinTest.java:145) [21:06:25]W: [org.apache.ignite:ignite-core] at org.apache.ignite.testframework.GridTestUtils$1.call(GridTestUtils.java:616) [21:06:25]W: [org.apache.ignite:ignite-core] at org.apache.ignite.testframework.GridTestUtils$1.call(GridTestUtils.java:614) [21:06:25]W: [org.apache.ignite:ignite-core] at org.apache.ignite.testframework.GridTestUtils.assertThrowsWithCause(GridTestUtils.java:636) [21:06:25]W: [org.apache.ignite:ignite-core] at org.apache.ignite.testframework.GridTestUtils.assertThrowsWithCause(GridTestUtils.java:614) [21:06:25]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.encryption.EncryptedCacheNodeJoinTest.testNodeCantJoinWithDifferentKeyStore(EncryptedCacheNodeJoinTest.java:143) [21:06:25]W: [org.apache.ignite:ignite-core] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) [21:06:25]W: [org.apache.ignite:ignite-core] at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) [21:06:25]W: [org.apache.ignite:ignite-core] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [21:06:25]W: [org.apache.ignite:ignite-core] at java.lang.reflect.Method.invoke(Method.java:498) [21:06:25]W: [org.apache.ignite:ignite-core] at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50) [21:06:25]W: [org.apache.ignite:ignite-core] at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) [21:06:25]W: [org.apache.ignite:ignite-core] at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47) [21:06:25]W: [org.apache.ignite:ignite-core] at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) [21:06:25]W: [org.apache.ignite:ignite-core] at org.apache.ignite.testframework.junits.GridAbstractTest$7.run(GridAbstractTest.java:2432) [21:06:25]W: [org.apache.ignite:ignite-core] at java.lang.Thread.run(Thread.java:748) [21:06:25]W: [org.apache.ignite:ignite-core] Caused by: class org.apache.ignite.spi.IgniteSpiException: Master key digest differs! Node join is rejected. [21:06:25]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.discovery.tcp.TcpDiscoverySpi.checkFailedError(TcpDiscoverySpi.java:2108) [21:06:25]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.discovery.tcp.ServerImpl.joinTopology(ServerImpl.java:1206) [21:06:25]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.discovery.tcp.ServerImpl.spiStart(ServerImpl.java:474) [21:06:25]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.discovery.tcp.TcpDiscoverySpi.spiStart(TcpDiscoverySpi.java:2210) [21:06:25]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.managers.GridManagerAdapter.startSpi(GridManagerAdapter.java:278) [21:06:25]W: [org.apache.ignite:ignite-core] ... 26 more [21:06:25]W: [org.apache.ignite:ignite-core] [2021-11-19 21:06:25,444][ERROR][test-runner-#12575%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-2] Got exception while starting (will rollback startup routine). [21:06:25]W: [org.apache.ignite:ignite-core] class org.apache.ignite.IgniteCheckedException: Failed to start manager: GridManagerAdapter [enabled=true, name=org.apache.ignite.internal.managers.discovery.GridDiscoveryManager] [21:06:25]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.IgniteKernal.startManager(IgniteKernal.java:1958) [21:06:25]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.IgniteKernal.start(IgniteKernal.java:1300) [21:06:25]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.IgnitionEx$IgniteNamedInstance.start0(IgnitionEx.java:1798) [21:06:25]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.IgnitionEx$IgniteNamedInstance.start(IgnitionEx.java:1720) [21:06:25]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.IgnitionEx.start0(IgnitionEx.java:1159) [21:06:25]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.IgnitionEx.start(IgnitionEx.java:629) [21:06:25]W: [org.apache.ignite:ignite-core] at org.apache.ignite.testframework.junits.GridAbstractTest.startGrid(GridAbstractTest.java:1252) [21:06:25]W: [org.apache.ignite:ignite-core] at org.apache.ignite.testframework.junits.GridAbstractTest.startGrid(GridAbstractTest.java:1169) [21:06:25]W: [org.apache.ignite:ignite-core] at org.apache.ignite.testframework.junits.GridAbstractTest.startGrid(GridAbstractTest.java:1145) [21:06:25]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.encryption.EncryptedCacheNodeJoinTest.lambda$testNodeCantJoinWithDifferentKeyStore$1(EncryptedCacheNodeJoinTest.java:145) [21:06:25]W: [org.apache.ignite:ignite-core] at org.apache.ignite.testframework.GridTestUtils$1.call(GridTestUtils.java:616) [21:06:25]W: [org.apache.ignite:ignite-core] at org.apache.ignite.testframework.GridTestUtils$1.call(GridTestUtils.java:614) [21:06:25]W: [org.apache.ignite:ignite-core] at org.apache.ignite.testframework.GridTestUtils.assertThrowsWithCause(GridTestUtils.java:636) [21:06:25]W: [org.apache.ignite:ignite-core] at org.apache.ignite.testframework.GridTestUtils.assertThrowsWithCause(GridTestUtils.java:614) [21:06:25]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.encryption.EncryptedCacheNodeJoinTest.testNodeCantJoinWithDifferentKeyStore(EncryptedCacheNodeJoinTest.java:143) [21:06:25]W: [org.apache.ignite:ignite-core] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) [21:06:25]W: [org.apache.ignite:ignite-core] at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) [21:06:25]W: [org.apache.ignite:ignite-core] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [21:06:25]W: [org.apache.ignite:ignite-core] at java.lang.reflect.Method.invoke(Method.java:498) [21:06:25]W: [org.apache.ignite:ignite-core] at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50) [21:06:25]W: [org.apache.ignite:ignite-core] at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) [21:06:25]W: [org.apache.ignite:ignite-core] at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47) [21:06:25]W: [org.apache.ignite:ignite-core] at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) [21:06:25]W: [org.apache.ignite:ignite-core] at org.apache.ignite.testframework.junits.GridAbstractTest$7.run(GridAbstractTest.java:2432) [21:06:25]W: [org.apache.ignite:ignite-core] at java.lang.Thread.run(Thread.java:748) [21:06:25]W: [org.apache.ignite:ignite-core] Caused by: class org.apache.ignite.IgniteCheckedException: Failed to start SPI: TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=5000, ackTimeout=5000, marsh=JdkMarshaller [clsFilter=org.apache.ignite.marshaller.MarshallerUtils$1@2bee5797], reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false] [21:06:25]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.managers.GridManagerAdapter.startSpi(GridManagerAdapter.java:281) [21:06:25]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.managers.discovery.GridDiscoveryManager.start(GridDiscoveryManager.java:1091) [21:06:25]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.IgniteKernal.startManager(IgniteKernal.java:1953) [21:06:25]W: [org.apache.ignite:ignite-core] ... 24 more [21:06:25]W: [org.apache.ignite:ignite-core] Caused by: class org.apache.ignite.spi.IgniteSpiException: Master key digest differs! Node join is rejected. [21:06:25]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.discovery.tcp.TcpDiscoverySpi.checkFailedError(TcpDiscoverySpi.java:2108) [21:06:25]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.discovery.tcp.ServerImpl.joinTopology(ServerImpl.java:1206) [21:06:25]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.discovery.tcp.ServerImpl.spiStart(ServerImpl.java:474) [21:06:25]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.discovery.tcp.TcpDiscoverySpi.spiStart(TcpDiscoverySpi.java:2210) [21:06:25]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.managers.GridManagerAdapter.startSpi(GridManagerAdapter.java:278) [21:06:25]W: [org.apache.ignite:ignite-core] ... 26 more [21:06:30] : [Step 4/5] [2021-11-19 21:06:30,457][INFO ][test-runner-#12575%encryption.EncryptedCacheNodeJoinTest%][TestTcpDiscoverySpi] No verification for local node leave has been received from coordinator (will stop node anyway). [21:06:30] : [Step 4/5] [2021-11-19 21:06:30,461][INFO ][test-runner-#12575%encryption.EncryptedCacheNodeJoinTest%][GridCacheProcessor] Stopped cache [cacheName=ignite-sys-cache] [21:06:30] : [Step 4/5] [2021-11-19 21:06:30,466][INFO ][test-runner-#12575%encryption.EncryptedCacheNodeJoinTest%][FilePageStoreManager] Cleanup cache stores [total=3, left=0, cleanFiles=false] [21:06:30] : [Step 4/5] [2021-11-19 21:06:30,473][INFO ][test-runner-#12575%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-2] [21:06:30] : [Step 4/5] [21:06:30] : [Step 4/5] >>> +------------------------------------------------------+ [21:06:30] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV stopped OK [21:06:30] : [Step 4/5] >>> +------------------------------------------------------+ [21:06:30] : [Step 4/5] >>> Ignite instance name: grid-2 [21:06:30] : [Step 4/5] >>> Grid uptime: 00:00:06.118 [21:06:30] : [Step 4/5] [21:06:30] : [Step 4/5] [21:06:30] : [Step 4/5] [21:06:30] >>> Stopping test: EncryptedCacheNodeJoinTest#testNodeCantJoinWithDifferentKeyStore in 7771 ms <<< [21:06:30] : [Step 4/5] [2021-11-19 21:06:30,474][INFO ][main][root] >>> Stopping test: EncryptedCacheNodeJoinTest#testNodeCantJoinWithDifferentKeyStore in 7771 ms <<< [21:06:30] : [Step 4/5] [21:06:30] >>> Heap: 443 MB used / 1899 MB commited / 1899 MB max <<< [21:06:30] : [Step 4/5] [2021-11-19 21:06:30,475][INFO ][main][root] >>> Heap: 443 MB used / 1899 MB commited / 1899 MB max <<< [21:06:30] : [Step 4/5] [21:06:30] >>> Non-Heap: 148 MB used / 161 MB commited / 0 MB max <<< [21:06:30] : [Step 4/5] [2021-11-19 21:06:30,475][INFO ][main][root] >>> Non-Heap: 148 MB used / 161 MB commited / 0 MB max <<< [21:06:30] : [Step 4/5] [2021-11-19 21:06:30,475][INFO ][main][root] >>> Stopping grid [name=grid-0, id=00cd7723-ef5f-442c-96b8-d04940a9d000] [21:06:30] : [Step 4/5] [2021-11-19 21:06:30,487][INFO ][main][GridCacheProcessor] Stopped cache [cacheName=ignite-sys-cache] [21:06:30] : [Step 4/5] [2021-11-19 21:06:30,503][INFO ][main][FilePageStoreManager] Cleanup cache stores [total=3, left=0, cleanFiles=false] [21:06:30] : [Step 4/5] [2021-11-19 21:06:30,514][INFO ][main][IgniteKernal%grid-0] [21:06:30] : [Step 4/5] [21:06:30] : [Step 4/5] >>> +------------------------------------------------------+ [21:06:30] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV stopped OK [21:06:30] : [Step 4/5] >>> +------------------------------------------------------+ [21:06:30] : [Step 4/5] >>> Ignite instance name: grid-0 [21:06:30] : [Step 4/5] >>> Grid uptime: 00:00:06.168 [21:06:30] : [Step 4/5] [21:06:30] : [Step 4/5] [21:06:30] : [Step 4/5] [21:06:30] >>> Starting test: EncryptedCacheNodeJoinTest#testNodeCantJoinWithDifferentCacheKeys <<< [21:06:30] : [Step 4/5] [2021-11-19 21:06:30,590][INFO ][main][root] >>> Starting test: EncryptedCacheNodeJoinTest#testNodeCantJoinWithDifferentCacheKeys <<< [21:06:30] : [Step 4/5] [21:06:30] >>> Heap: 443 MB used / 1899 MB commited / 1899 MB max <<< [21:06:30] : [Step 4/5] [2021-11-19 21:06:30,590][INFO ][main][root] >>> Heap: 443 MB used / 1899 MB commited / 1899 MB max <<< [21:06:30] : [Step 4/5] [21:06:30] >>> Non-Heap: 148 MB used / 161 MB commited / 0 MB max <<< [21:06:30] : [Step 4/5] [2021-11-19 21:06:30,591][INFO ][main][root] >>> Non-Heap: 148 MB used / 161 MB commited / 0 MB max <<< [21:06:30]W: [org.apache.ignite:ignite-core] [2021-11-19 21:06:30,596][WARN ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][G] Ignite work directory is not provided, automatically resolved to: /opt/buildagent/work/7bc1c54bc719b67c/work [21:06:30] : [Step 4/5] [2021-11-19 21:06:30,599][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] [21:06:30] : [Step 4/5] [21:06:30] : [Step 4/5] >>> __________ ________________ [21:06:30] : [Step 4/5] >>> / _/ ___/ |/ / _/_ __/ __/ [21:06:30] : [Step 4/5] >>> _/ // (7 7 // / / / / _/ [21:06:30] : [Step 4/5] >>> /___/\___/_/|_/___/ /_/ /___/ [21:06:30] : [Step 4/5] >>> [21:06:30] : [Step 4/5] >>> ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:06:30] : [Step 4/5] >>> 2021 Copyright(C) Apache Software Foundation [21:06:30] : [Step 4/5] >>> [21:06:30] : [Step 4/5] >>> Ignite documentation: http://ignite.apache.org [21:06:30] : [Step 4/5] [21:06:30] : [Step 4/5] [2021-11-19 21:06:30,600][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] Config URL: n/a [21:06:30] : [Step 4/5] [2021-11-19 21:06:30,600][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] IgniteConfiguration [igniteInstanceName=grid-0, pubPoolSize=24, svcPoolSize=24, callbackPoolSize=24, stripedPoolSize=24, sysPoolSize=24, mgmtPoolSize=4, dataStreamerPoolSize=24, utilityCachePoolSize=24, utilityCacheKeepAliveTime=60000, p2pPoolSize=2, qryPoolSize=24, buildIdxPoolSize=4, igniteHome=/opt/buildagent/work/7bc1c54bc719b67c, igniteWorkDir=/opt/buildagent/work/7bc1c54bc719b67c/work, mbeanSrv=com.sun.jmx.mbeanserver.JmxMBeanServer@6fe85038, nodeId=007123ac-333f-44e2-b470-a92210284000, marsh=BinaryMarshaller [], marshLocJobs=false, daemon=false, p2pEnabled=true, netTimeout=10000, netCompressionLevel=1, sndRetryDelay=1000, sndRetryCnt=3, metricsHistSize=10000, metricsUpdateFreq=1000, metricsExpTime=9223372036854775807, discoSpi=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=0, ackTimeout=0, marsh=null, reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], segPlc=STOP, segResolveAttempts=2, waitForSegOnStart=true, allResolversPassReq=true, segChkFreq=10000, commSpi=TcpCommunicationSpi [connectGate=org.apache.ignite.spi.communication.tcp.internal.ConnectGateway@4e97827d, ctxInitLatch=java.util.concurrent.CountDownLatch@55548c1[Count = 1], stopping=false, clientPool=null, nioSrvWrapper=null, stateProvider=null], evtSpi=MemoryEventStorageSpi [expireAgeMs=9223372036854775807, expireCnt=10000, filter=null], colSpi=NoopCollisionSpi [], deploySpi=LocalDeploymentSpi [], indexingSpi=org.apache.ignite.spi.indexing.noop.NoopIndexingSpi@24a0d62c, addrRslvr=null, encryptionSpi=org.apache.ignite.spi.encryption.keystore.KeystoreEncryptionSpi@3ffaad51, tracingSpi=org.apache.ignite.spi.tracing.NoopTracingSpi@15153a8f, clientMode=false, rebalanceThreadPoolSize=4, rebalanceTimeout=10000, rebalanceBatchesPrefetchCnt=3, rebalanceThrottle=0, rebalanceBatchSize=524288, txCfg=TransactionConfiguration [txSerEnabled=false, dfltIsolation=REPEATABLE_READ, dfltConcurrency=PESSIMISTIC, dfltTxTimeout=0, txTimeoutOnPartitionMapExchange=0, deadlockTimeout=10000, pessimisticTxLogSize=0, pessimisticTxLogLinger=10000, tmLookupClsName=null, txManagerFactory=null, useJtaSync=false], cacheSanityCheckEnabled=true, discoStartupDelay=60000, deployMode=SHARED, p2pMissedCacheSize=100, locHost=127.0.0.1, timeSrvPortBase=31100, timeSrvPortRange=100, failureDetectionTimeout=10000, sysWorkerBlockedTimeout=null, clientFailureDetectionTimeout=10000, metricsLogFreq=0, connectorCfg=null, odbcCfg=null, warmupClos=null, atomicCfg=AtomicConfiguration [seqReserveSize=1000, cacheMode=PARTITIONED, backups=1, aff=null, grpName=null], classLdr=null, sslCtxFactory=null, platformCfg=null, binaryCfg=null, memCfg=null, pstCfg=null, dsCfg=DataStorageConfiguration [sysRegionInitSize=41943040, sysRegionMaxSize=104857600, pageSize=4096, concLvl=0, dfltDataRegConf=DataRegionConfiguration [name=default, maxSize=10485760, initSize=268435456, swapPath=null, pageEvictionMode=DISABLED, pageReplacementMode=CLOCK, evictionThreshold=0.9, emptyPagesPoolSize=100, metricsEnabled=false, metricsSubIntervalCount=5, metricsRateTimeInterval=60000, persistenceEnabled=true, checkpointPageBufSize=0, lazyMemoryAllocation=true, warmUpCfg=null], dataRegions=null, storagePath=null, checkpointFreq=180000, lockWaitTime=10000, checkpointThreads=4, checkpointWriteOrder=SEQUENTIAL, walHistSize=20, maxWalArchiveSize=1073741824, walSegments=10, walSegmentSize=67108864, walPath=db/wal, walArchivePath=db/wal/archive, cdcWalPath=db/wal/cdc, cdcEnabled=false, metricsEnabled=false, walMode=FSYNC, walTlbSize=131072, walBuffSize=0, walFlushFreq=2000, walFsyncDelay=1000, walRecordIterBuffSize=67108864, alwaysWriteFullPages=false, fileIOFactory=org.apache.ignite.internal.processors.cache.persistence.file.AsyncFileIOFactory@4c4b2168, metricsSubIntervalCnt=5, metricsRateTimeInterval=60000, walAutoArchiveAfterInactivity=-1, walForceArchiveTimeout=-1, writeThrottlingEnabled=false, walCompactionEnabled=false, walCompactionLevel=1, checkpointReadLockTimeout=null, walPageCompression=DISABLED, walPageCompressionLevel=null, dfltWarmUpCfg=null, encCfg=org.apache.ignite.configuration.EncryptionConfiguration@61bf9c3f, defragmentationThreadPoolSize=4, minWalArchiveSize=-1], snapshotPath=snapshots, activeOnStart=true, activeOnStartPropSetFlag=false, autoActivation=true, autoActivationPropSetFlag=false, clusterStateOnStart=null, sqlConnCfg=null, cliConnCfg=ClientConnectorConfiguration [host=null, port=10800, portRange=100, sockSndBufSize=0, sockRcvBufSize=0, tcpNoDelay=true, maxOpenCursorsPerConn=128, threadPoolSize=24, selectorCnt=12, idleTimeout=0, handshakeTimeout=10000, jdbcEnabled=true, odbcEnabled=true, thinCliEnabled=true, sslEnabled=false, useIgniteSslCtxFactory=true, sslClientAuth=false, sslCtxFactory=null, thinCliCfg=ThinClientConfiguration [maxActiveTxPerConn=100, maxActiveComputeTasksPerConn=0]], mvccVacuumThreadCnt=2, mvccVacuumFreq=5000, authEnabled=false, failureHnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]], commFailureRslvr=null, sqlCfg=SqlConfiguration [longQryWarnTimeout=3000, dfltQryTimeout=0, sqlQryHistSize=1000, validationEnabled=false], asyncContinuationExecutor=null] [21:06:30] : [Step 4/5] [2021-11-19 21:06:30,608][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] Daemon mode: off [21:06:30] : [Step 4/5] [2021-11-19 21:06:30,608][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] OS: Linux 4.15.0-151-generic amd64 [21:06:30] : [Step 4/5] [2021-11-19 21:06:30,608][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] OS user: teamcity [21:06:30] : [Step 4/5] [2021-11-19 21:06:30,609][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] PID: 16724 [21:06:30] : [Step 4/5] [2021-11-19 21:06:30,609][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] Language runtime: Java Platform API Specification ver. 1.8 [21:06:30] : [Step 4/5] [2021-11-19 21:06:30,609][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] VM information: Java(TM) SE Runtime Environment 1.8.0_261-b12 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 25.261-b12 [21:06:30] : [Step 4/5] [2021-11-19 21:06:30,609][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] VM total memory: 1.9GB [21:06:30] : [Step 4/5] [2021-11-19 21:06:30,610][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] Remote Management [restart: off, REST: off, JMX (remote: off)] [21:06:30] : [Step 4/5] [2021-11-19 21:06:30,610][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] Logger: GridTestLog4jLogger [quiet=false, config=null] [21:06:30] : [Step 4/5] [2021-11-19 21:06:30,610][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] IGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c [21:06:30] : [Step 4/5] [2021-11-19 21:06:30,610][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] VM arguments: [-DIGNITE_DUMP_THREADS_ON_FAILURE=false, -DMono=/usr/bin/mono-sgen, -DMono4.0_x64=/usr/lib/mono/4.0, -DMono4.5_x64=/usr/lib/mono/4.5, -DMonoVersion=6.12.0.90, -DSKIP_BUILD=false, -Dagent.home.dir=/opt/buildagent, -Dagent.name=aitc-lin02_03, -Dagent.ownPort=9090, -Dagent.work.dir=/opt/buildagent/work, -Dbuild.number=95, -Dbuild.vcs.number=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.1=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.GitHubApacheIgnite=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dclassworlds.conf=/opt/buildagent/temp/buildTmp/teamcity.m2.conf, -Dcom.jetbrains.maven.watcher.report.file=/opt/buildagent/temp/buildTmp/maven-build-info.xml, -Djava.io.tmpdir=/opt/buildagent/temp/buildTmp, -Dmaven.home=/opt/buildagent/tools/maven3_6, -Dmaven.multiModuleProjectDirectory=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.agent.cpuBenchmark=457, -Dteamcity.agent.dotnet.agent_url=http://localhost:9090/RPC2, -Dteamcity.agent.dotnet.build_id=6278078, -Dteamcity.auth.password=*******, -Dteamcity.auth.userId=TeamCityBuildId=6278078, -Dteamcity.build.changedFiles.file=/opt/buildagent/temp/buildTmp/changedFiles6342607772318147725.txt, -Dteamcity.build.checkoutDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.build.id=6278078, -Dteamcity.build.properties.file=/opt/buildagent/temp/buildTmp/teamcity.build5164517880467851002.properties, -Dteamcity.build.tempDir=/opt/buildagent/temp/buildTmp, -Dteamcity.build.workingDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.buildConfName=Basic 3, -Dteamcity.buildType.id=IgniteTests24Java8_Basic3, -Dteamcity.configuration.properties.file=/opt/buildagent/temp/buildTmp/teamcity.config5591980786735343870.properties, -Dteamcity.maven.userSettings.path=/opt/buildagent/temp/buildTmp/maven_settings_585072866407032347.xml, -Dteamcity.maven.watcher.home=/opt/buildagent/plugins/mavenPlugin/maven-watcher-jdk16, -Dteamcity.projectName=Ignite Tests 2.x (JDK 8/11), -Dteamcity.runner.properties.file=/opt/buildagent/temp/buildTmp/teamcity.runner9098465561618137420.properties, -Dteamcity.tests.recentlyFailedTests.file=/opt/buildagent/temp/buildTmp/testsToRunFirst3891775683130404069.txt, -Dteamcity.version=2021.2 (build 99542), -ea, -Xms2g, -Xmx2g, -XX:+HeapDumpOnOutOfMemoryError, -DIGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_TEST_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_UPDATE_NOTIFIER=false, -DIGNITE_NO_DISCO_ORDER=true, -DIGNITE_PERFORMANCE_SUGGESTIONS_DISABLED=true, -Djava.net.preferIPv4Stack=true, -DTEST_SCALE_FACTOR=1.0, -DIGNITE_TEST_PROP_LOG4J_FILE=log4j-tc-test.xml, -DIGNITE_QUIET=false, -DIGNITE_MARSHAL_BUFFERS_RECHECK=1000, -Dmaven.repo.local=/opt/buildagent/.m2/repository] [21:06:30] : [Step 4/5] [2021-11-19 21:06:30,615][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] System cache's DataRegion size is configured to 40 MB. Use DataStorageConfiguration.systemRegionInitialSize property to change the setting. [21:06:30] : [Step 4/5] [2021-11-19 21:06:30,615][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] Configured caches [in 'sysMemPlc' dataRegion: ['ignite-sys-cache']] [21:06:30]W: [org.apache.ignite:ignite-core] [2021-11-19 21:06:30,615][WARN ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] Peer class loading is enabled (disable it in production for performance and deployment consistency reasons) [21:06:30] : [Step 4/5] [2021-11-19 21:06:30,615][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] 3-rd party licenses can be found at: /opt/buildagent/work/7bc1c54bc719b67c/libs/licenses [21:06:30] : [Step 4/5] [2021-11-19 21:06:30,620][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] Configured plugins: [21:06:30] : [Step 4/5] [2021-11-19 21:06:30,620][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- StanByClusterTestProvider 1.0 [21:06:30] : [Step 4/5] [2021-11-19 21:06:30,620][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- null [21:06:30] : [Step 4/5] [2021-11-19 21:06:30,621][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] [21:06:30] : [Step 4/5] [2021-11-19 21:06:30,621][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- PageMemory tracker plugin 1.0 [21:06:30] : [Step 4/5] [2021-11-19 21:06:30,621][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- null [21:06:30] : [Step 4/5] [2021-11-19 21:06:30,622][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] [21:06:30] : [Step 4/5] [2021-11-19 21:06:30,622][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- TestDistibutedConfigurationPlugin 1.0 [21:06:30] : [Step 4/5] [2021-11-19 21:06:30,622][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- null [21:06:30] : [Step 4/5] [2021-11-19 21:06:30,622][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] [21:06:30] : [Step 4/5] [2021-11-19 21:06:30,623][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- NodeValidationPluginProvider 1.0 [21:06:30] : [Step 4/5] [2021-11-19 21:06:30,623][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- null [21:06:30] : [Step 4/5] [2021-11-19 21:06:30,623][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] [21:06:30] : [Step 4/5] [2021-11-19 21:06:30,623][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][FailureProcessor] Configured failure handler: [hnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]]] [21:06:30] : [Step 4/5] [2021-11-19 21:06:30,664][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][TcpCommunicationSpi] Successfully bound communication NIO server to TCP port [port=45150, locHost=/127.0.0.1, selectorsCnt=12, selectorSpins=0, pairedConn=false] [21:06:30]W: [org.apache.ignite:ignite-core] [2021-11-19 21:06:30,665][WARN ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][TcpCommunicationSpi] Message queue limit is set to 0 which may lead to potential OOMEs when running cache operations in FULL_ASYNC or PRIMARY_SYNC modes due to message queues growth on sender and receiver sides. [21:06:30] : [Step 4/5] [2021-11-19 21:06:30,673][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][GridCollisionManager] Collision resolution is disabled (all jobs will be activated upon arrival). [21:06:30] : [Step 4/5] [2021-11-19 21:06:30,673][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] Security status [authentication=off, sandbox=off, tls/ssl=off] [21:06:30] : [Step 4/5] [2021-11-19 21:06:30,731][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:06:30] : [Step 4/5] [2021-11-19 21:06:30,837][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][MaintenanceProcessor] Resolved store directory for node persistent data: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0 [21:06:30] : [Step 4/5] [2021-11-19 21:06:30,838][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][CacheObjectBinaryProcessorImpl] Resolved directory for serialized binary metadata: /opt/buildagent/work/7bc1c54bc719b67c/work/db/binary_meta/grid_0 [21:06:30] : [Step 4/5] [2021-11-19 21:06:30,845][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0 [21:06:30] : [Step 4/5] [2021-11-19 21:06:30,845][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][FileWriteAheadLogManager] Resolved write ahead log work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0 [21:06:30] : [Step 4/5] [2021-11-19 21:06:30,846][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][FileWriteAheadLogManager] Resolved write ahead log archive directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0 [21:06:31] : [Step 4/5] [2021-11-19 21:06:31,224][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000000.wal [21:06:31]W: [org.apache.ignite:ignite-core] [2021-11-19 21:06:31,224][WARN ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] DataRegion maxSize=10.5 MB is smaller than defaultInitialSize=268.4 MB, setting initialSize to 10.5 MB [21:06:31] : [Step 4/5] [2021-11-19 21:06:31,229][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Configured data regions initialized successfully [total=5] [21:06:31] : [Step 4/5] [2021-11-19 21:06:31,231][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][IgniteSnapshotManager] Resolved snapshot work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/snapshots [21:06:31] : [Step 4/5] [2021-11-19 21:06:31,231][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][IgniteSnapshotManager] Resolved temp directory for snapshot creation: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0/snp [21:06:31] : [Step 4/5] [2021-11-19 21:06:31,234][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][ClientListenerProcessor] Client connector processor has started on TCP port 10800 [21:06:31] : [Step 4/5] [2021-11-19 21:06:31,237][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] Non-loopback local IPs: 172.17.0.4 [21:06:31] : [Step 4/5] [2021-11-19 21:06:31,237][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] Enabled local MACs: 0242AC110004 [21:06:31] : [Step 4/5] [2021-11-19 21:06:31,237][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:06:31] : [Step 4/5] [2021-11-19 21:06:31,238][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:06:31] : [Step 4/5] [2021-11-19 21:06:31,239][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:06:31] : [Step 4/5] [2021-11-19 21:06:31,241][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Applying lost metastore updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:06:31] : [Step 4/5] [2021-11-19 21:06:31,244][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=0 ms] [21:06:31] : [Step 4/5] [2021-11-19 21:06:31,244][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][GridCacheProcessor] Restoring partition state for local groups. [21:06:31] : [Step 4/5] [2021-11-19 21:06:31,245][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=0, partitionsProcessed=0, time=0ms] [21:06:31] : [Step 4/5] [2021-11-19 21:06:31,245][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][GridEncryptionManager] Encryption keys loaded from metastore. [grps=, masterKeyName=ignite.master.key] [21:06:31] : [Step 4/5] [2021-11-19 21:06:31,247][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][ClusterProcessor] Cluster ID and tag has been read from metastorage: null [21:06:31] : [Step 4/5] [2021-11-19 21:06:31,248][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][IgniteClusterImpl] Shutdown policy was updated [oldVal=null, newVal=null] [21:06:31] : [Step 4/5] [2021-11-19 21:06:31,248][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Checkpoint frequency deviation changed [oldVal=null, newVal=null] [21:06:31] : [Step 4/5] [2021-11-19 21:06:31,258][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][FilePageStoreManager] Cleanup cache stores [total=1, left=0, cleanFiles=false] [21:06:31] : [Step 4/5] [2021-11-19 21:06:31,260][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:06:31] : [Step 4/5] [2021-11-19 21:06:31,261][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:06:31] : [Step 4/5] [2021-11-19 21:06:31,262][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:06:31] : [Step 4/5] [2021-11-19 21:06:31,263][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Data Regions Started: 5 [21:06:31] : [Step 4/5] [2021-11-19 21:06:31,263][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] ^-- sysMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:06:31] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:06:31] : [Step 4/5] ^-- default region [type=default, persistence=true, lazyAlloc=true, [21:06:31] : [Step 4/5] ... initCfg=10MB, maxCfg=10MB, usedRam=0MB, freeRam=100%, allocRam=0MB, allocTotal=0MB] [21:06:31] : [Step 4/5] ^-- metastoreMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:06:31] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:06:31] : [Step 4/5] ^-- TxLog region [type=internal, persistence=true, lazyAlloc=false, [21:06:31] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:06:31] : [Step 4/5] ^-- volatileDsMemPlc region [type=user, persistence=false, lazyAlloc=true, [21:06:31] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB] [21:06:31] : [Step 4/5] ^-- Ignite persistence [used=0MB] [21:06:31] : [Step 4/5] [21:06:31] : [Step 4/5] [2021-11-19 21:06:31,265][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Starting binary memory restore for: [-2100569601] [21:06:31] : [Step 4/5] [2021-11-19 21:06:31,274][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:06:31] : [Step 4/5] [2021-11-19 21:06:31,275][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:06:31] : [Step 4/5] [2021-11-19 21:06:31,277][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000000.wal, offset=0, ver=2] [21:06:31] : [Step 4/5] [2021-11-19 21:06:31,280][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][GridCacheProcessor] Started cache in recovery mode [name=ignite-sys-cache, id=-2100569601, dataRegionName=sysMemPlc, mode=REPLICATED, atomicity=TRANSACTIONAL, backups=2147483647, mvcc=false] [21:06:31] : [Step 4/5] [2021-11-19 21:06:31,282][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Binary recovery performed in 17 ms. [21:06:31] : [Step 4/5] [2021-11-19 21:06:31,282][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:06:31] : [Step 4/5] [2021-11-19 21:06:31,283][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Applying lost cache updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:06:31] : [Step 4/5] [2021-11-19 21:06:31,361][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=84 ms] [21:06:31] : [Step 4/5] [2021-11-19 21:06:31,361][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][GridCacheProcessor] Restoring partition state for local groups. [21:06:31] : [Step 4/5] [2021-11-19 21:06:31,412][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=1, partitionsProcessed=100, time=55ms] [21:06:31] : [Step 4/5] [2021-11-19 21:06:31,943][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][TestTcpDiscoverySpi] Successfully bound to TCP port [port=47500, localHost=localhost/127.0.0.1, locNodeId=007123ac-333f-44e2-b470-a92210284000] [21:06:31] : [Step 4/5] [2021-11-19 21:06:31,947][INFO ][disco-notifier-worker-#12922%grid-0%][MvccProcessorImpl] Assigned mvcc coordinator [crd=MvccCoordinator [topVer=AffinityTopologyVersion [topVer=1, minorTopVer=0], nodeId=007123ac-333f-44e2-b470-a92210284000, ver=1637345191938, local=true, initialized=false]] [21:06:31] : [Step 4/5] [2021-11-19 21:06:31,948][INFO ][sys-#12920%grid-0%][ClusterProcessor] Writing cluster ID and tag to metastorage on ready for write ClusterIdAndTag [id=430fd593-d346-4408-af9b-ca934799bba8, tag=amazing_hermann] [21:06:31] : [Step 4/5] [2021-11-19 21:06:31,949][INFO ][disco-notifier-worker-#12922%grid-0%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustEnabled' was changed from 'null' to 'false' [21:06:31] : [Step 4/5] [2021-11-19 21:06:31,950][INFO ][disco-notifier-worker-#12922%grid-0%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustTimeout' was changed from 'null' to '300000' [21:06:31] : [Step 4/5] [2021-11-19 21:06:31,950][INFO ][disco-notifier-worker-#12922%grid-0%][IgniteTxManager] Transactions parameter 'longOperationsDumpTimeout' was changed from 'null' to '60000' [21:06:31] : [Step 4/5] [2021-11-19 21:06:31,951][INFO ][disco-notifier-worker-#12922%grid-0%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpThreshold' was changed from 'null' to '0' [21:06:31] : [Step 4/5] [2021-11-19 21:06:31,951][INFO ][disco-notifier-worker-#12922%grid-0%][IgniteTxManager] Transactions parameter 'transactionTimeDumpSamplesCoefficient' was changed from 'null' to '0.0' [21:06:31] : [Step 4/5] [2021-11-19 21:06:31,952][INFO ][disco-notifier-worker-#12922%grid-0%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpSamplesPerSecondLimit' was changed from 'null' to '5' [21:06:31] : [Step 4/5] [2021-11-19 21:06:31,953][INFO ][disco-notifier-worker-#12922%grid-0%][IgniteTxManager] Transactions parameter 'collisionsDumpInterval' was changed from 'null' to '1000' [21:06:31] : [Step 4/5] [2021-11-19 21:06:31,953][INFO ][disco-notifier-worker-#12922%grid-0%][ClusterProcessor] amazing_hermann [21:06:31] : [Step 4/5] [2021-11-19 21:06:31,954][INFO ][disco-notifier-worker-#12922%grid-0%][IgniteTxManager] Transactions parameter 'txOwnerDumpRequestsAllowed' was changed from 'null' to 'true' [21:06:31] : [Step 4/5] [2021-11-19 21:06:31,954][INFO ][disco-notifier-worker-#12922%grid-0%][GridCacheDatabaseSharedManager] Historical rebalance WAL threshold changed [property=historical.rebalance.threshold, oldVal=null, newVal=500] [21:06:31] : [Step 4/5] [2021-11-19 21:06:31,959][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] To start Console Management & Monitoring run ignitevisorcmd.{sh|bat} [21:06:31] : [Step 4/5] [2021-11-19 21:06:31,960][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] [21:06:31] : [Step 4/5] [21:06:31] : [Step 4/5] >>> +-------------------------------------------+ [21:06:31] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:06:31] : [Step 4/5] >>> +-------------------------------------------+ [21:06:31] : [Step 4/5] >>> OS name: Linux 4.15.0-151-generic amd64 [21:06:31] : [Step 4/5] >>> CPU(s): 24 [21:06:31] : [Step 4/5] >>> Heap: 2.0GB [21:06:31] : [Step 4/5] >>> VM name: 16724@c4dfe9a430b2 [21:06:31] : [Step 4/5] >>> Ignite instance name: grid-0 [21:06:31] : [Step 4/5] >>> Local node [ID=007123AC-333F-44E2-B470-A92210284000, order=1, clientMode=false] [21:06:31] : [Step 4/5] >>> Local node addresses: [127.0.0.1] [21:06:31] : [Step 4/5] >>> Local ports: TCP:10800 TCP:45150 TCP:47500 [21:06:31] : [Step 4/5] [21:06:31] : [Step 4/5] [2021-11-19 21:06:31,961][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] >>> Ignite cluster is in INACTIVE state (limited functionality available). Use control.(sh|bat) script or IgniteCluster.state(ClusterState.ACTIVE) to change the state. [21:06:31] : [Step 4/5] [2021-11-19 21:06:31,962][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][GridDiscoveryManager] Topology snapshot [ver=1, locNode=007123ac, servers=1, clients=0, state=INACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=007123ac-333f-44e2-b470-a92210284000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:06:31] : [Step 4/5] [2021-11-19 21:06:31,963][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][G] Node started : [stage="Configure system pool" (0 ms),stage="Start managers" (241 ms),stage="Configure binary metadata" (3 ms),stage="Start processors" (394 ms),stage="Start 'StanByClusterTestProvider' plugin" (0 ms),stage="Start 'PageMemory tracker plugin' plugin" (0 ms),stage="Start 'TestDistibutedConfigurationPlugin' plugin" (0 ms),stage="Start 'NodeValidationPluginProvider' plugin" (0 ms),stage="Init metastore" (21 ms),stage="Init and start regions" (6 ms),stage="Restore binary memory" (16 ms),stage="Restore logical state" (130 ms),stage="Finish recovery" (528 ms),stage="Join topology" (5 ms),stage="Await transition" (1 ms),stage="Await exchange" (13 ms),stage="Total time" (1358 ms)] [21:06:31] : [Step 4/5] [2021-11-19 21:06:31,964][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][root] Node started with the following configuration [id=007123ac-333f-44e2-b470-a92210284000, marshaller=BinaryMarshaller [], discovery=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=5000, ackTimeout=5000, marsh=JdkMarshaller [clsFilter=org.apache.ignite.marshaller.MarshallerUtils$1@7b10a766], reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], binaryCfg=null, lateAff=true] [21:06:31]W: [org.apache.ignite:ignite-core] [2021-11-19 21:06:31,969][WARN ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][G] Ignite work directory is not provided, automatically resolved to: /opt/buildagent/work/7bc1c54bc719b67c/work [21:06:31] : [Step 4/5] [2021-11-19 21:06:31,970][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-3] [21:06:31] : [Step 4/5] [21:06:31] : [Step 4/5] >>> __________ ________________ [21:06:31] : [Step 4/5] >>> / _/ ___/ |/ / _/_ __/ __/ [21:06:31] : [Step 4/5] >>> _/ // (7 7 // / / / / _/ [21:06:31] : [Step 4/5] >>> /___/\___/_/|_/___/ /_/ /___/ [21:06:31] : [Step 4/5] >>> [21:06:31] : [Step 4/5] >>> ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:06:31] : [Step 4/5] >>> 2021 Copyright(C) Apache Software Foundation [21:06:31] : [Step 4/5] >>> [21:06:31] : [Step 4/5] >>> Ignite documentation: http://ignite.apache.org [21:06:31] : [Step 4/5] [21:06:31] : [Step 4/5] [2021-11-19 21:06:31,970][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-3] Config URL: n/a [21:06:31] : [Step 4/5] [2021-11-19 21:06:31,971][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-3] IgniteConfiguration [igniteInstanceName=grid-3, pubPoolSize=24, svcPoolSize=24, callbackPoolSize=24, stripedPoolSize=24, sysPoolSize=24, mgmtPoolSize=4, dataStreamerPoolSize=24, utilityCachePoolSize=24, utilityCacheKeepAliveTime=60000, p2pPoolSize=2, qryPoolSize=24, buildIdxPoolSize=4, igniteHome=/opt/buildagent/work/7bc1c54bc719b67c, igniteWorkDir=/opt/buildagent/work/7bc1c54bc719b67c/work, mbeanSrv=com.sun.jmx.mbeanserver.JmxMBeanServer@6fe85038, nodeId=305f992f-5d53-4aba-a7f7-4bc45c5ca003, marsh=BinaryMarshaller [], marshLocJobs=false, daemon=false, p2pEnabled=true, netTimeout=10000, netCompressionLevel=1, sndRetryDelay=1000, sndRetryCnt=3, metricsHistSize=10000, metricsUpdateFreq=1000, metricsExpTime=9223372036854775807, discoSpi=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=0, ackTimeout=0, marsh=null, reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], segPlc=STOP, segResolveAttempts=2, waitForSegOnStart=true, allResolversPassReq=true, segChkFreq=10000, commSpi=TcpCommunicationSpi [connectGate=org.apache.ignite.spi.communication.tcp.internal.ConnectGateway@137fee2, ctxInitLatch=java.util.concurrent.CountDownLatch@68b0076[Count = 1], stopping=false, clientPool=null, nioSrvWrapper=null, stateProvider=null], evtSpi=MemoryEventStorageSpi [expireAgeMs=9223372036854775807, expireCnt=10000, filter=null], colSpi=NoopCollisionSpi [], deploySpi=LocalDeploymentSpi [], indexingSpi=org.apache.ignite.spi.indexing.noop.NoopIndexingSpi@2d3099a1, addrRslvr=null, encryptionSpi=org.apache.ignite.spi.encryption.keystore.KeystoreEncryptionSpi@39ebd373, tracingSpi=org.apache.ignite.spi.tracing.NoopTracingSpi@303f31d2, clientMode=false, rebalanceThreadPoolSize=4, rebalanceTimeout=10000, rebalanceBatchesPrefetchCnt=3, rebalanceThrottle=0, rebalanceBatchSize=524288, txCfg=TransactionConfiguration [txSerEnabled=false, dfltIsolation=REPEATABLE_READ, dfltConcurrency=PESSIMISTIC, dfltTxTimeout=0, txTimeoutOnPartitionMapExchange=0, deadlockTimeout=10000, pessimisticTxLogSize=0, pessimisticTxLogLinger=10000, tmLookupClsName=null, txManagerFactory=null, useJtaSync=false], cacheSanityCheckEnabled=true, discoStartupDelay=60000, deployMode=SHARED, p2pMissedCacheSize=100, locHost=127.0.0.1, timeSrvPortBase=31100, timeSrvPortRange=100, failureDetectionTimeout=10000, sysWorkerBlockedTimeout=null, clientFailureDetectionTimeout=10000, metricsLogFreq=0, connectorCfg=null, odbcCfg=null, warmupClos=null, atomicCfg=AtomicConfiguration [seqReserveSize=1000, cacheMode=PARTITIONED, backups=1, aff=null, grpName=null], classLdr=null, sslCtxFactory=null, platformCfg=null, binaryCfg=null, memCfg=null, pstCfg=null, dsCfg=DataStorageConfiguration [sysRegionInitSize=41943040, sysRegionMaxSize=104857600, pageSize=4096, concLvl=0, dfltDataRegConf=DataRegionConfiguration [name=default, maxSize=10485760, initSize=268435456, swapPath=null, pageEvictionMode=DISABLED, pageReplacementMode=CLOCK, evictionThreshold=0.9, emptyPagesPoolSize=100, metricsEnabled=false, metricsSubIntervalCount=5, metricsRateTimeInterval=60000, persistenceEnabled=true, checkpointPageBufSize=0, lazyMemoryAllocation=true, warmUpCfg=null], dataRegions=null, storagePath=null, checkpointFreq=180000, lockWaitTime=10000, checkpointThreads=4, checkpointWriteOrder=SEQUENTIAL, walHistSize=20, maxWalArchiveSize=1073741824, walSegments=10, walSegmentSize=67108864, walPath=db/wal, walArchivePath=db/wal/archive, cdcWalPath=db/wal/cdc, cdcEnabled=false, metricsEnabled=false, walMode=FSYNC, walTlbSize=131072, walBuffSize=0, walFlushFreq=2000, walFsyncDelay=1000, walRecordIterBuffSize=67108864, alwaysWriteFullPages=false, fileIOFactory=org.apache.ignite.internal.processors.cache.persistence.file.AsyncFileIOFactory@63494c24, metricsSubIntervalCnt=5, metricsRateTimeInterval=60000, walAutoArchiveAfterInactivity=-1, walForceArchiveTimeout=-1, writeThrottlingEnabled=false, walCompactionEnabled=false, walCompactionLevel=1, checkpointReadLockTimeout=null, walPageCompression=DISABLED, walPageCompressionLevel=null, dfltWarmUpCfg=null, encCfg=org.apache.ignite.configuration.EncryptionConfiguration@72dfacda, defragmentationThreadPoolSize=4, minWalArchiveSize=-1], snapshotPath=snapshots, activeOnStart=true, activeOnStartPropSetFlag=false, autoActivation=true, autoActivationPropSetFlag=false, clusterStateOnStart=null, sqlConnCfg=null, cliConnCfg=ClientConnectorConfiguration [host=null, port=10800, portRange=100, sockSndBufSize=0, sockRcvBufSize=0, tcpNoDelay=true, maxOpenCursorsPerConn=128, threadPoolSize=24, selectorCnt=12, idleTimeout=0, handshakeTimeout=10000, jdbcEnabled=true, odbcEnabled=true, thinCliEnabled=true, sslEnabled=false, useIgniteSslCtxFactory=true, sslClientAuth=false, sslCtxFactory=null, thinCliCfg=ThinClientConfiguration [maxActiveTxPerConn=100, maxActiveComputeTasksPerConn=0]], mvccVacuumThreadCnt=2, mvccVacuumFreq=5000, authEnabled=false, failureHnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]], commFailureRslvr=null, sqlCfg=SqlConfiguration [longQryWarnTimeout=3000, dfltQryTimeout=0, sqlQryHistSize=1000, validationEnabled=false], asyncContinuationExecutor=null] [21:06:31] : [Step 4/5] [2021-11-19 21:06:31,980][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-3] Daemon mode: off [21:06:31] : [Step 4/5] [2021-11-19 21:06:31,981][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-3] OS: Linux 4.15.0-151-generic amd64 [21:06:31] : [Step 4/5] [2021-11-19 21:06:31,981][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-3] OS user: teamcity [21:06:31] : [Step 4/5] [2021-11-19 21:06:31,981][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-3] PID: 16724 [21:06:31] : [Step 4/5] [2021-11-19 21:06:31,982][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-3] Language runtime: Java Platform API Specification ver. 1.8 [21:06:31] : [Step 4/5] [2021-11-19 21:06:31,982][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-3] VM information: Java(TM) SE Runtime Environment 1.8.0_261-b12 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 25.261-b12 [21:06:31] : [Step 4/5] [2021-11-19 21:06:31,983][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-3] VM total memory: 1.9GB [21:06:31] : [Step 4/5] [2021-11-19 21:06:31,983][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-3] Remote Management [restart: off, REST: off, JMX (remote: off)] [21:06:31] : [Step 4/5] [2021-11-19 21:06:31,983][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-3] Logger: GridTestLog4jLogger [quiet=false, config=null] [21:06:31] : [Step 4/5] [2021-11-19 21:06:31,983][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-3] IGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c [21:06:31] : [Step 4/5] [2021-11-19 21:06:31,984][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-3] VM arguments: [-DIGNITE_DUMP_THREADS_ON_FAILURE=false, -DMono=/usr/bin/mono-sgen, -DMono4.0_x64=/usr/lib/mono/4.0, -DMono4.5_x64=/usr/lib/mono/4.5, -DMonoVersion=6.12.0.90, -DSKIP_BUILD=false, -Dagent.home.dir=/opt/buildagent, -Dagent.name=aitc-lin02_03, -Dagent.ownPort=9090, -Dagent.work.dir=/opt/buildagent/work, -Dbuild.number=95, -Dbuild.vcs.number=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.1=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.GitHubApacheIgnite=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dclassworlds.conf=/opt/buildagent/temp/buildTmp/teamcity.m2.conf, -Dcom.jetbrains.maven.watcher.report.file=/opt/buildagent/temp/buildTmp/maven-build-info.xml, -Djava.io.tmpdir=/opt/buildagent/temp/buildTmp, -Dmaven.home=/opt/buildagent/tools/maven3_6, -Dmaven.multiModuleProjectDirectory=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.agent.cpuBenchmark=457, -Dteamcity.agent.dotnet.agent_url=http://localhost:9090/RPC2, -Dteamcity.agent.dotnet.build_id=6278078, -Dteamcity.auth.password=*******, -Dteamcity.auth.userId=TeamCityBuildId=6278078, -Dteamcity.build.changedFiles.file=/opt/buildagent/temp/buildTmp/changedFiles6342607772318147725.txt, -Dteamcity.build.checkoutDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.build.id=6278078, -Dteamcity.build.properties.file=/opt/buildagent/temp/buildTmp/teamcity.build5164517880467851002.properties, -Dteamcity.build.tempDir=/opt/buildagent/temp/buildTmp, -Dteamcity.build.workingDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.buildConfName=Basic 3, -Dteamcity.buildType.id=IgniteTests24Java8_Basic3, -Dteamcity.configuration.properties.file=/opt/buildagent/temp/buildTmp/teamcity.config5591980786735343870.properties, -Dteamcity.maven.userSettings.path=/opt/buildagent/temp/buildTmp/maven_settings_585072866407032347.xml, -Dteamcity.maven.watcher.home=/opt/buildagent/plugins/mavenPlugin/maven-watcher-jdk16, -Dteamcity.projectName=Ignite Tests 2.x (JDK 8/11), -Dteamcity.runner.properties.file=/opt/buildagent/temp/buildTmp/teamcity.runner9098465561618137420.properties, -Dteamcity.tests.recentlyFailedTests.file=/opt/buildagent/temp/buildTmp/testsToRunFirst3891775683130404069.txt, -Dteamcity.version=2021.2 (build 99542), -ea, -Xms2g, -Xmx2g, -XX:+HeapDumpOnOutOfMemoryError, -DIGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_TEST_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_UPDATE_NOTIFIER=false, -DIGNITE_NO_DISCO_ORDER=true, -DIGNITE_PERFORMANCE_SUGGESTIONS_DISABLED=true, -Djava.net.preferIPv4Stack=true, -DTEST_SCALE_FACTOR=1.0, -DIGNITE_TEST_PROP_LOG4J_FILE=log4j-tc-test.xml, -DIGNITE_QUIET=false, -DIGNITE_MARSHAL_BUFFERS_RECHECK=1000, -Dmaven.repo.local=/opt/buildagent/.m2/repository] [21:06:31] : [Step 4/5] [2021-11-19 21:06:31,988][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-3] System cache's DataRegion size is configured to 40 MB. Use DataStorageConfiguration.systemRegionInitialSize property to change the setting. [21:06:31] : [Step 4/5] [2021-11-19 21:06:31,989][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-3] Configured caches [in 'sysMemPlc' dataRegion: ['ignite-sys-cache']] [21:06:31]W: [org.apache.ignite:ignite-core] [2021-11-19 21:06:31,989][WARN ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-3] Peer class loading is enabled (disable it in production for performance and deployment consistency reasons) [21:06:31] : [Step 4/5] [2021-11-19 21:06:31,990][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-3] 3-rd party licenses can be found at: /opt/buildagent/work/7bc1c54bc719b67c/libs/licenses [21:06:31] : [Step 4/5] [2021-11-19 21:06:31,993][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] Configured plugins: [21:06:31] : [Step 4/5] [2021-11-19 21:06:31,993][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- StanByClusterTestProvider 1.0 [21:06:31] : [Step 4/5] [2021-11-19 21:06:31,994][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- null [21:06:31] : [Step 4/5] [2021-11-19 21:06:31,994][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] [21:06:31] : [Step 4/5] [2021-11-19 21:06:31,994][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- PageMemory tracker plugin 1.0 [21:06:31] : [Step 4/5] [2021-11-19 21:06:31,994][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- null [21:06:31] : [Step 4/5] [2021-11-19 21:06:31,994][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] [21:06:31] : [Step 4/5] [2021-11-19 21:06:31,995][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- TestDistibutedConfigurationPlugin 1.0 [21:06:31] : [Step 4/5] [2021-11-19 21:06:31,995][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- null [21:06:31] : [Step 4/5] [2021-11-19 21:06:31,995][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] [21:06:31] : [Step 4/5] [2021-11-19 21:06:31,995][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- NodeValidationPluginProvider 1.0 [21:06:31] : [Step 4/5] [2021-11-19 21:06:31,996][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- null [21:06:31] : [Step 4/5] [2021-11-19 21:06:31,996][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] [21:06:31] : [Step 4/5] [2021-11-19 21:06:31,996][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][FailureProcessor] Configured failure handler: [hnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]]] [21:06:32] : [Step 4/5] [2021-11-19 21:06:32,005][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][TcpCommunicationSpi] Successfully bound communication NIO server to TCP port [port=45151, locHost=/127.0.0.1, selectorsCnt=12, selectorSpins=0, pairedConn=false] [21:06:32]W: [org.apache.ignite:ignite-core] [2021-11-19 21:06:32,005][WARN ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][TcpCommunicationSpi] Message queue limit is set to 0 which may lead to potential OOMEs when running cache operations in FULL_ASYNC or PRIMARY_SYNC modes due to message queues growth on sender and receiver sides. [21:06:32] : [Step 4/5] [2021-11-19 21:06:32,008][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][GridCollisionManager] Collision resolution is disabled (all jobs will be activated upon arrival). [21:06:32] : [Step 4/5] [2021-11-19 21:06:32,009][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-3] Security status [authentication=off, sandbox=off, tls/ssl=off] [21:06:32] : [Step 4/5] [2021-11-19 21:06:32,066][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:06:32] : [Step 4/5] [2021-11-19 21:06:32,161][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][MaintenanceProcessor] Resolved store directory for node persistent data: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_3 [21:06:32] : [Step 4/5] [2021-11-19 21:06:32,162][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][CacheObjectBinaryProcessorImpl] Resolved directory for serialized binary metadata: /opt/buildagent/work/7bc1c54bc719b67c/work/db/binary_meta/grid_3 [21:06:32] : [Step 4/5] [2021-11-19 21:06:32,167][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_3 [21:06:32] : [Step 4/5] [2021-11-19 21:06:32,168][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][FileWriteAheadLogManager] Resolved write ahead log work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_3 [21:06:32] : [Step 4/5] [2021-11-19 21:06:32,168][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][FileWriteAheadLogManager] Resolved write ahead log archive directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_3 [21:06:32] : [Step 4/5] [2021-11-19 21:06:32,800][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_3/0000000000000000.wal [21:06:32] : [Step 4/5] [2021-11-19 21:06:32,808][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Configured data regions initialized successfully [total=5] [21:06:32] : [Step 4/5] [2021-11-19 21:06:32,811][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][IgniteSnapshotManager] Resolved snapshot work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/snapshots [21:06:32] : [Step 4/5] [2021-11-19 21:06:32,811][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][IgniteSnapshotManager] Resolved temp directory for snapshot creation: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_3/snp [21:06:32] : [Step 4/5] [2021-11-19 21:06:32,815][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][ClientListenerProcessor] Client connector processor has started on TCP port 10801 [21:06:32] : [Step 4/5] [2021-11-19 21:06:32,818][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-3] Non-loopback local IPs: 172.17.0.4 [21:06:32] : [Step 4/5] [2021-11-19 21:06:32,818][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-3] Enabled local MACs: 0242AC110004 [21:06:32] : [Step 4/5] [2021-11-19 21:06:32,819][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:06:32] : [Step 4/5] [2021-11-19 21:06:32,820][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:06:32] : [Step 4/5] [2021-11-19 21:06:32,821][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:06:32] : [Step 4/5] [2021-11-19 21:06:32,823][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Applying lost metastore updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:06:32] : [Step 4/5] [2021-11-19 21:06:32,824][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=0 ms] [21:06:32] : [Step 4/5] [2021-11-19 21:06:32,824][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][GridCacheProcessor] Restoring partition state for local groups. [21:06:32] : [Step 4/5] [2021-11-19 21:06:32,825][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=0, partitionsProcessed=0, time=0ms] [21:06:32] : [Step 4/5] [2021-11-19 21:06:32,826][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][GridEncryptionManager] Encryption keys loaded from metastore. [grps=, masterKeyName=ignite.master.key] [21:06:32] : [Step 4/5] [2021-11-19 21:06:32,827][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][ClusterProcessor] Cluster ID and tag has been read from metastorage: null [21:06:32] : [Step 4/5] [2021-11-19 21:06:32,828][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][IgniteClusterImpl] Shutdown policy was updated [oldVal=null, newVal=null] [21:06:32] : [Step 4/5] [2021-11-19 21:06:32,828][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Checkpoint frequency deviation changed [oldVal=null, newVal=null] [21:06:32] : [Step 4/5] [2021-11-19 21:06:32,841][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][FilePageStoreManager] Cleanup cache stores [total=1, left=0, cleanFiles=false] [21:06:32] : [Step 4/5] [2021-11-19 21:06:32,844][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:06:32] : [Step 4/5] [2021-11-19 21:06:32,845][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:06:32] : [Step 4/5] [2021-11-19 21:06:32,846][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:06:32] : [Step 4/5] [2021-11-19 21:06:32,846][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Data Regions Started: 5 [21:06:32] : [Step 4/5] [2021-11-19 21:06:32,847][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] ^-- sysMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:06:32] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:06:32] : [Step 4/5] ^-- default region [type=default, persistence=true, lazyAlloc=true, [21:06:32] : [Step 4/5] ... initCfg=10MB, maxCfg=10MB, usedRam=0MB, freeRam=100%, allocRam=0MB, allocTotal=0MB] [21:06:32] : [Step 4/5] ^-- metastoreMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:06:32] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:06:32] : [Step 4/5] ^-- TxLog region [type=internal, persistence=true, lazyAlloc=false, [21:06:32] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:06:32] : [Step 4/5] ^-- volatileDsMemPlc region [type=user, persistence=false, lazyAlloc=true, [21:06:32] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB] [21:06:32] : [Step 4/5] ^-- Ignite persistence [used=0MB] [21:06:32] : [Step 4/5] [21:06:32] : [Step 4/5] [2021-11-19 21:06:32,848][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Starting binary memory restore for: [-2100569601] [21:06:32] : [Step 4/5] [2021-11-19 21:06:32,856][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:06:32] : [Step 4/5] [2021-11-19 21:06:32,856][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:06:32] : [Step 4/5] [2021-11-19 21:06:32,858][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_3/0000000000000000.wal, offset=0, ver=2] [21:06:32] : [Step 4/5] [2021-11-19 21:06:32,864][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][GridCacheProcessor] Started cache in recovery mode [name=ignite-sys-cache, id=-2100569601, dataRegionName=sysMemPlc, mode=REPLICATED, atomicity=TRANSACTIONAL, backups=2147483647, mvcc=false] [21:06:32] : [Step 4/5] [2021-11-19 21:06:32,865][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Binary recovery performed in 17 ms. [21:06:32] : [Step 4/5] [2021-11-19 21:06:32,866][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:06:32] : [Step 4/5] [2021-11-19 21:06:32,866][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Applying lost cache updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:06:32] : [Step 4/5] [2021-11-19 21:06:32,937][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=71 ms] [21:06:32] : [Step 4/5] [2021-11-19 21:06:32,938][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][GridCacheProcessor] Restoring partition state for local groups. [21:06:32] : [Step 4/5] [2021-11-19 21:06:32,943][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=1, partitionsProcessed=100, time=0ms] [21:06:34] : [Step 4/5] [2021-11-19 21:06:34,295][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][TestTcpDiscoverySpi] Successfully bound to TCP port [port=47501, localHost=localhost/127.0.0.1, locNodeId=305f992f-5d53-4aba-a7f7-4bc45c5ca003] [21:06:34] : [Step 4/5] [2021-11-19 21:06:34,298][INFO ][tcp-disco-srvr-[:47500]-#673%grid-0%-#12924%grid-0%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=35035] [21:06:34] : [Step 4/5] [2021-11-19 21:06:34,298][INFO ][tcp-disco-srvr-[:47500]-#673%grid-0%-#12924%grid-0%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=35035] [21:06:34] : [Step 4/5] [2021-11-19 21:06:34,299][INFO ][tcp-disco-sock-reader-[]-#679%grid-0%-#13043%grid-0%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:35035, rmtPort=35035] [21:06:34] : [Step 4/5] [2021-11-19 21:06:34,299][INFO ][tcp-disco-sock-reader-[305f992f 127.0.0.1:35035]-#679%grid-0%-#13043%grid-0%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=305f992f-5d53-4aba-a7f7-4bc45c5ca003, rmtAddr=/127.0.0.1:35035] [21:06:34] : [Step 4/5] [2021-11-19 21:06:34,301][INFO ][tcp-disco-srvr-[:47501]-#678%grid-3%-#13042%grid-3%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=47699] [21:06:34] : [Step 4/5] [2021-11-19 21:06:34,302][INFO ][tcp-disco-srvr-[:47501]-#678%grid-3%-#13042%grid-3%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=47699] [21:06:34] : [Step 4/5] [2021-11-19 21:06:34,303][INFO ][tcp-disco-sock-reader-[]-#680%grid-3%-#13044%grid-3%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:47699, rmtPort=47699] [21:06:34] : [Step 4/5] [2021-11-19 21:06:34,303][INFO ][tcp-disco-sock-reader-[]-#680%grid-3%-#13044%grid-3%][TestTcpDiscoverySpi] Received ping request from the remote node [rmtNodeId=007123ac-333f-44e2-b470-a92210284000, rmtAddr=/127.0.0.1:47699, rmtPort=47699] [21:06:34] : [Step 4/5] [2021-11-19 21:06:34,304][INFO ][tcp-disco-sock-reader-[]-#680%grid-3%-#13044%grid-3%][TestTcpDiscoverySpi] Finished writing ping response [rmtNodeId=007123ac-333f-44e2-b470-a92210284000, rmtAddr=/127.0.0.1:47699, rmtPort=47699] [21:06:34]W: [org.apache.ignite:ignite-core] [2021-11-19 21:06:34,304][WARN ][tcp-disco-sock-reader-[]-#680%grid-3%-#13044%grid-3%][TestTcpDiscoverySpi] Failed to shutdown socket [21:06:34]W: [org.apache.ignite:ignite-core] java.net.SocketException: Socket output is already shutdown [21:06:34]W: [org.apache.ignite:ignite-core] at java.net.Socket.shutdownOutput(Socket.java:1572) [21:06:34]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.close(IgniteUtils.java:4247) [21:06:34]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.discovery.tcp.ServerImpl$SocketReader.body(ServerImpl.java:7370) [21:06:34]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.IgniteSpiThread.run(IgniteSpiThread.java:58) [21:06:34] : [Step 4/5] [2021-11-19 21:06:34,304][INFO ][tcp-disco-sock-reader-[305f992f 127.0.0.1:35035]-#679%grid-0%-#13043%grid-0%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:35035, rmtPort=35035, rmtNodeId=305f992f-5d53-4aba-a7f7-4bc45c5ca003] [21:06:34] : [Step 4/5] [2021-11-19 21:06:34,305][INFO ][tcp-disco-sock-reader-[]-#680%grid-3%-#13044%grid-3%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:47699, rmtPort=47699, rmtNodeId=null] [21:06:34] : [Step 4/5] [2021-11-19 21:06:34,307][INFO ][tcp-disco-msg-worker-[crd]-#672%grid-0%-#12923%grid-0%][GridEncryptionManager] Joining node doesn't have stored group keys [node=305f992f-5d53-4aba-a7f7-4bc45c5ca003] [21:06:34] : [Step 4/5] [2021-11-19 21:06:34,315][INFO ][tcp-disco-msg-worker-[crd]-#672%grid-0%-#12923%grid-0%][TestTcpDiscoverySpi] New next node [newNext=TcpDiscoveryNode [id=305f992f-5d53-4aba-a7f7-4bc45c5ca003, consistentId=grid-3, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=0, intOrder=2, lastExchangeTime=1637345194298, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false]] [21:06:34] : [Step 4/5] [2021-11-19 21:06:34,316][INFO ][tcp-disco-srvr-[:47501]-#678%grid-3%-#13042%grid-3%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=36287] [21:06:34] : [Step 4/5] [2021-11-19 21:06:34,316][INFO ][tcp-disco-srvr-[:47501]-#678%grid-3%-#13042%grid-3%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=36287] [21:06:34] : [Step 4/5] [2021-11-19 21:06:34,317][INFO ][tcp-disco-sock-reader-[]-#681%grid-3%-#13045%grid-3%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:36287, rmtPort=36287] [21:06:34] : [Step 4/5] [2021-11-19 21:06:34,317][INFO ][tcp-disco-sock-reader-[007123ac 127.0.0.1:36287]-#681%grid-3%-#13045%grid-3%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=007123ac-333f-44e2-b470-a92210284000, rmtAddr=/127.0.0.1:36287] [21:06:34] : [Step 4/5] [2021-11-19 21:06:34,320][INFO ][tcp-disco-msg-worker-[]-#677%grid-3%-#13041%grid-3%][TestTcpDiscoverySpi] New next node [newNext=TcpDiscoveryNode [id=007123ac-333f-44e2-b470-a92210284000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345194318, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false]] [21:06:34] : [Step 4/5] [2021-11-19 21:06:34,321][INFO ][tcp-disco-srvr-[:47500]-#673%grid-0%-#12924%grid-0%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=53765] [21:06:34] : [Step 4/5] [2021-11-19 21:06:34,322][INFO ][tcp-disco-srvr-[:47500]-#673%grid-0%-#12924%grid-0%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=53765] [21:06:34] : [Step 4/5] [2021-11-19 21:06:34,322][INFO ][tcp-disco-sock-reader-[]-#682%grid-0%-#13046%grid-0%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:53765, rmtPort=53765] [21:06:34] : [Step 4/5] [2021-11-19 21:06:34,323][INFO ][tcp-disco-sock-reader-[305f992f 127.0.0.1:53765]-#682%grid-0%-#13046%grid-0%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=305f992f-5d53-4aba-a7f7-4bc45c5ca003, rmtAddr=/127.0.0.1:53765] [21:06:34] : [Step 4/5] [2021-11-19 21:06:34,325][INFO ][disco-event-worker-#12926%grid-0%][GridDiscoveryManager] Added new node to topology: TcpDiscoveryNode [id=305f992f-5d53-4aba-a7f7-4bc45c5ca003, consistentId=grid-3, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637345194298, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false] [21:06:34] : [Step 4/5] [2021-11-19 21:06:34,326][INFO ][disco-event-worker-#12926%grid-0%][GridDiscoveryManager] Topology snapshot [ver=2, locNode=007123ac, servers=2, clients=0, state=INACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=007123ac-333f-44e2-b470-a92210284000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=305f992f-5d53-4aba-a7f7-4bc45c5ca003, consistentId=grid-3, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:06:34] : [Step 4/5] [2021-11-19 21:06:34,329][INFO ][tcp-disco-msg-worker-[007123ac 127.0.0.1:47500]-#677%grid-3%-#13041%grid-3%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustEnabled' was changed from 'null' to 'false' [21:06:34] : [Step 4/5] [2021-11-19 21:06:34,329][INFO ][tcp-disco-msg-worker-[007123ac 127.0.0.1:47500]-#677%grid-3%-#13041%grid-3%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustTimeout' was changed from 'null' to '300000' [21:06:34] : [Step 4/5] [2021-11-19 21:06:34,330][INFO ][tcp-disco-msg-worker-[007123ac 127.0.0.1:47500]-#677%grid-3%-#13041%grid-3%][IgniteTxManager] Transactions parameter 'longOperationsDumpTimeout' was changed from 'null' to '60000' [21:06:34] : [Step 4/5] [2021-11-19 21:06:34,330][INFO ][tcp-disco-msg-worker-[007123ac 127.0.0.1:47500]-#677%grid-3%-#13041%grid-3%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpThreshold' was changed from 'null' to '0' [21:06:34] : [Step 4/5] [2021-11-19 21:06:34,330][INFO ][tcp-disco-msg-worker-[007123ac 127.0.0.1:47500]-#677%grid-3%-#13041%grid-3%][IgniteTxManager] Transactions parameter 'transactionTimeDumpSamplesCoefficient' was changed from 'null' to '0.0' [21:06:34] : [Step 4/5] [2021-11-19 21:06:34,331][INFO ][tcp-disco-msg-worker-[007123ac 127.0.0.1:47500]-#677%grid-3%-#13041%grid-3%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpSamplesPerSecondLimit' was changed from 'null' to '5' [21:06:34] : [Step 4/5] [2021-11-19 21:06:34,331][INFO ][tcp-disco-msg-worker-[007123ac 127.0.0.1:47500]-#677%grid-3%-#13041%grid-3%][IgniteTxManager] Transactions parameter 'collisionsDumpInterval' was changed from 'null' to '1000' [21:06:34] : [Step 4/5] [2021-11-19 21:06:34,332][INFO ][tcp-disco-msg-worker-[007123ac 127.0.0.1:47500]-#677%grid-3%-#13041%grid-3%][ClusterProcessor] amazing_hermann [21:06:34] : [Step 4/5] [2021-11-19 21:06:34,332][INFO ][tcp-disco-msg-worker-[007123ac 127.0.0.1:47500]-#677%grid-3%-#13041%grid-3%][IgniteTxManager] Transactions parameter 'txOwnerDumpRequestsAllowed' was changed from 'null' to 'true' [21:06:34] : [Step 4/5] [2021-11-19 21:06:34,332][INFO ][tcp-disco-msg-worker-[007123ac 127.0.0.1:47500]-#677%grid-3%-#13041%grid-3%][GridCacheDatabaseSharedManager] Historical rebalance WAL threshold changed [property=historical.rebalance.threshold, oldVal=null, newVal=500] [21:06:34] : [Step 4/5] [2021-11-19 21:06:34,333][INFO ][disco-notifier-worker-#13040%grid-3%][MvccProcessorImpl] Assigned mvcc coordinator [crd=MvccCoordinator [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=0], nodeId=007123ac-333f-44e2-b470-a92210284000, ver=1637345191938, local=false, initialized=false]] [21:06:34] : [Step 4/5] [2021-11-19 21:06:34,334][INFO ][sys-#13021%grid-3%][ClusterProcessor] Writing cluster ID and tag to metastorage on ready for write ClusterIdAndTag [id=430fd593-d346-4408-af9b-ca934799bba8, tag=amazing_hermann] [21:06:34] : [Step 4/5] [2021-11-19 21:06:34,344][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-3] To start Console Management & Monitoring run ignitevisorcmd.{sh|bat} [21:06:34] : [Step 4/5] [2021-11-19 21:06:34,345][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-3] [21:06:34] : [Step 4/5] [21:06:34] : [Step 4/5] >>> +-------------------------------------------+ [21:06:34] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:06:34] : [Step 4/5] >>> +-------------------------------------------+ [21:06:34] : [Step 4/5] >>> OS name: Linux 4.15.0-151-generic amd64 [21:06:34] : [Step 4/5] >>> CPU(s): 24 [21:06:34] : [Step 4/5] >>> Heap: 2.0GB [21:06:34] : [Step 4/5] >>> VM name: 16724@c4dfe9a430b2 [21:06:34] : [Step 4/5] >>> Ignite instance name: grid-3 [21:06:34] : [Step 4/5] >>> Local node [ID=305F992F-5D53-4ABA-A7F7-4BC45C5CA003, order=2, clientMode=false] [21:06:34] : [Step 4/5] >>> Local node addresses: [127.0.0.1] [21:06:34] : [Step 4/5] >>> Local ports: TCP:10801 TCP:45151 TCP:47501 [21:06:34] : [Step 4/5] [21:06:34] : [Step 4/5] [2021-11-19 21:06:34,345][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-3] >>> Ignite cluster is in INACTIVE state (limited functionality available). Use control.(sh|bat) script or IgniteCluster.state(ClusterState.ACTIVE) to change the state. [21:06:34] : [Step 4/5] [2021-11-19 21:06:34,346][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][GridDiscoveryManager] Topology snapshot [ver=2, locNode=305f992f, servers=2, clients=0, state=INACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=007123ac-333f-44e2-b470-a92210284000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=305f992f-5d53-4aba-a7f7-4bc45c5ca003, consistentId=grid-3, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:06:34] : [Step 4/5] [2021-11-19 21:06:34,346][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][G] Node started : [stage="Configure system pool" (0 ms),stage="Start managers" (192 ms),stage="Configure binary metadata" (2 ms),stage="Start processors" (652 ms),stage="Start 'StanByClusterTestProvider' plugin" (0 ms),stage="Start 'PageMemory tracker plugin' plugin" (0 ms),stage="Start 'TestDistibutedConfigurationPlugin' plugin" (0 ms),stage="Start 'NodeValidationPluginProvider' plugin" (0 ms),stage="Init metastore" (24 ms),stage="Init and start regions" (6 ms),stage="Restore binary memory" (17 ms),stage="Restore logical state" (78 ms),stage="Finish recovery" (1350 ms),stage="Join topology" (39 ms),stage="Await transition" (2 ms),stage="Await exchange" (11 ms),stage="Total time" (2373 ms)] [21:06:34] : [Step 4/5] [2021-11-19 21:06:34,348][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][root] Node started with the following configuration [id=305f992f-5d53-4aba-a7f7-4bc45c5ca003, marshaller=BinaryMarshaller [], discovery=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=5000, ackTimeout=5000, marsh=JdkMarshaller [clsFilter=org.apache.ignite.marshaller.MarshallerUtils$1@4567c5a4], reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], binaryCfg=null, lateAff=true] [21:06:34] : [Step 4/5] [2021-11-19 21:06:34,349][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][GridClusterStateProcessor] Sending activate cluster request with BaselineTopology BaselineTopology [id=0, branchingHash=-2475315499, branchingType='New BaselineTopology', baselineNodes=[grid-0, grid-3]] [21:06:34] : [Step 4/5] [2021-11-19 21:06:34,350][INFO ][disco-notifier-worker-#12922%grid-0%][GridClusterStateProcessor] Received activate cluster request with BaselineTopology[id=0] initiator node ID: 007123ac-333f-44e2-b470-a92210284000 [21:06:34] : [Step 4/5] [2021-11-19 21:06:34,351][INFO ][disco-notifier-worker-#12922%grid-0%][GridClusterStateProcessor] Started state transition: activate cluster [21:06:34] : [Step 4/5] [2021-11-19 21:06:34,351][INFO ][exchange-worker-#12927%grid-0%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], crd=true, evt=DISCOVERY_CUSTOM_EVT, evtNode=007123ac-333f-44e2-b470-a92210284000, customEvt=ChangeGlobalStateMessage [id=8b64d593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqId=7c7445c7-35b1-43d2-b755-52497f6e4e25, initiatingNodeId=007123ac-333f-44e2-b470-a92210284000, state=ACTIVE, baselineTopology=BaselineTopology [id=0, branchingHash=-2475315499, branchingType='New BaselineTopology', baselineNodes=[grid-0, grid-3]], forceChangeBaselineTopology=false, timestamp=1637345194349, forceDeactivation=true], allowMerge=false, exchangeFreeSwitch=false] [21:06:34] : [Step 4/5] [2021-11-19 21:06:34,352][INFO ][disco-notifier-worker-#13040%grid-3%][GridClusterStateProcessor] Received activate cluster request with BaselineTopology[id=0] initiator node ID: 007123ac-333f-44e2-b470-a92210284000 [21:06:34] : [Step 4/5] [2021-11-19 21:06:34,352][INFO ][exchange-worker-#12927%grid-0%][GridDhtPartitionsExchangeFuture] Start activation process [nodeId=007123ac-333f-44e2-b470-a92210284000, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]]. New state: ACTIVE [21:06:34] : [Step 4/5] [2021-11-19 21:06:34,353][INFO ][disco-notifier-worker-#13040%grid-3%][GridClusterStateProcessor] Started state transition: activate cluster [21:06:34] : [Step 4/5] [2021-11-19 21:06:34,353][INFO ][exchange-worker-#12927%grid-0%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0 [21:06:34] : [Step 4/5] [2021-11-19 21:06:34,354][INFO ][exchange-worker-#13049%grid-3%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], crd=false, evt=DISCOVERY_CUSTOM_EVT, evtNode=007123ac-333f-44e2-b470-a92210284000, customEvt=ChangeGlobalStateMessage [id=8b64d593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqId=7c7445c7-35b1-43d2-b755-52497f6e4e25, initiatingNodeId=007123ac-333f-44e2-b470-a92210284000, state=ACTIVE, baselineTopology=BaselineTopology [id=0, branchingHash=-2475315499, branchingType='New BaselineTopology', baselineNodes=[grid-0, grid-3]], forceChangeBaselineTopology=false, timestamp=1637345194349, forceDeactivation=true], allowMerge=false, exchangeFreeSwitch=false] [21:06:34] : [Step 4/5] [2021-11-19 21:06:34,356][INFO ][exchange-worker-#13049%grid-3%][GridDhtPartitionsExchangeFuture] Start activation process [nodeId=305f992f-5d53-4aba-a7f7-4bc45c5ca003, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]]. New state: ACTIVE [21:06:34] : [Step 4/5] [2021-11-19 21:06:34,357][INFO ][exchange-worker-#13049%grid-3%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_3 [21:06:34] : [Step 4/5] [2021-11-19 21:06:34,355][INFO ][exchange-worker-#12927%grid-0%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000000.wal, offset=8713, ver=2] [21:06:34] : [Step 4/5] [2021-11-19 21:06:34,359][INFO ][exchange-worker-#12927%grid-0%][GridClusterStateProcessor] Writing BaselineTopology[id=0] [21:06:34] : [Step 4/5] [2021-11-19 21:06:34,359][INFO ][exchange-worker-#13049%grid-3%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_3/0000000000000000.wal, offset=8713, ver=2] [21:06:34] : [Step 4/5] [2021-11-19 21:06:34,361][INFO ][exchange-worker-#13049%grid-3%][GridClusterStateProcessor] Writing BaselineTopology[id=0] [21:06:34] : [Step 4/5] [2021-11-19 21:06:34,438][INFO ][exchange-worker-#13049%grid-3%][GridCacheDatabaseSharedManager] Finish recovery performed in 81 ms. [21:06:34] : [Step 4/5] [2021-11-19 21:06:34,440][INFO ][exchange-worker-#13049%grid-3%][msg] Components activation performed in 83 ms. [21:06:34] : [Step 4/5] [2021-11-19 21:06:34,441][INFO ][exchange-worker-#13049%grid-3%][GridCacheProcessor] Finished recovery for cache [cache=ignite-sys-cache, grp=ignite-sys-cache, startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:06:34] : [Step 4/5] [2021-11-19 21:06:34,442][INFO ][exchange-worker-#13049%grid-3%][GridDhtPartitionsExchangeFuture] Successfully activated caches [nodeId=305f992f-5d53-4aba-a7f7-4bc45c5ca003, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], newState=ACTIVE] [21:06:34] : [Step 4/5] [2021-11-19 21:06:34,442][INFO ][exchange-worker-#13049%grid-3%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:06:34] : [Step 4/5] [2021-11-19 21:06:34,898][INFO ][exchange-worker-#12927%grid-0%][GridCacheDatabaseSharedManager] Finish recovery performed in 544 ms. [21:06:34] : [Step 4/5] [2021-11-19 21:06:34,899][INFO ][exchange-worker-#12927%grid-0%][msg] Components activation performed in 546 ms. [21:06:34] : [Step 4/5] [2021-11-19 21:06:34,900][INFO ][exchange-worker-#12927%grid-0%][GridCacheProcessor] Finished recovery for cache [cache=ignite-sys-cache, grp=ignite-sys-cache, startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:06:34] : [Step 4/5] [2021-11-19 21:06:34,900][INFO ][exchange-worker-#12927%grid-0%][GridDhtPartitionsExchangeFuture] Successfully activated caches [nodeId=007123ac-333f-44e2-b470-a92210284000, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], newState=ACTIVE] [21:06:34] : [Step 4/5] [2021-11-19 21:06:34,901][INFO ][exchange-worker-#12927%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:06:35] : [Step 4/5] [2021-11-19 21:06:35,012][INFO ][exchange-worker-#12927%grid-0%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], crd=true] [21:06:35] : [Step 4/5] [2021-11-19 21:06:35,406][INFO ][grid-nio-worker-tcp-comm-0-#12866%TcpCommunicationSpi%][TcpCommunicationSpi] Accepted incoming communication connection [locAddr=/127.0.0.1:45150, rmtAddr=/127.0.0.1:60576] [21:06:35] : [Step 4/5] [2021-11-19 21:06:35,407][INFO ][grid-nio-worker-tcp-comm-0-#12984%TcpCommunicationSpi%][TcpCommunicationSpi] Established outgoing communication connection [locAddr=/127.0.0.1:60576, rmtAddr=/127.0.0.1:45150] [21:06:35] : [Step 4/5] [2021-11-19 21:06:35,408][INFO ][exchange-worker-#13049%grid-3%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], crd=false] [21:06:35] : [Step 4/5] [2021-11-19 21:06:35,409][INFO ][sys-#12902%grid-0%][GridDhtPartitionsExchangeFuture] Coordinator received single message [ver=AffinityTopologyVersion [topVer=2, minorTopVer=1], node=305f992f-5d53-4aba-a7f7-4bc45c5ca003, allReceived=true] [21:06:35] : [Step 4/5] [2021-11-19 21:06:35,409][INFO ][sys-#12902%grid-0%][GridDhtPartitionsExchangeFuture] finishExchangeOnCoordinator [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:06:35] : [Step 4/5] [2021-11-19 21:06:35,417][INFO ][sys-#12902%grid-0%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], err=null, rebalanced=true, wasRebalanced=false] [21:06:35] : [Step 4/5] [2021-11-19 21:06:35,417][INFO ][disco-notifier-worker-#12922%grid-0%][GridClusterStateProcessor] Received state change finish message: ACTIVE [21:06:35] : [Step 4/5] [2021-11-19 21:06:35,418][INFO ][disco-notifier-worker-#13040%grid-3%][GridClusterStateProcessor] Received state change finish message: ACTIVE [21:06:35] : [Step 4/5] [2021-11-19 21:06:35,418][INFO ][disco-notifier-worker-#13040%grid-3%][GridClusterStateProcessor] Cluster state was changed from INACTIVE to ACTIVE [21:06:35] : [Step 4/5] [2021-11-19 21:06:35,418][INFO ][disco-notifier-worker-#12922%grid-0%][GridClusterStateProcessor] Cluster state was changed from INACTIVE to ACTIVE [21:06:35] : [Step 4/5] [2021-11-19 21:06:35,420][INFO ][sys-#12902%grid-0%][GridCacheProcessor] Finish proxy initialization, cacheName=ignite-sys-cache, localNodeId=007123ac-333f-44e2-b470-a92210284000 [21:06:35] : [Step 4/5] [2021-11-19 21:06:35,419][INFO ][sys-#13031%grid-3%][GridCachePartitionExchangeManager] Delay process full message without exchange id (there is exchange in progress) [nodeId=007123ac-333f-44e2-b470-a92210284000] [21:06:35] : [Step 4/5] [2021-11-19 21:06:35,419][INFO ][sys-#13026%grid-3%][GridDhtPartitionsExchangeFuture] Received full message, will finish exchange [node=007123ac-333f-44e2-b470-a92210284000, resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:06:35] : [Step 4/5] [2021-11-19 21:06:35,421][INFO ][exchange-worker-#12927%grid-0%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=2, minorTopVer=1], force=false, evt=DISCOVERY_CUSTOM_EVT, node=007123ac-333f-44e2-b470-a92210284000] [21:06:35] : [Step 4/5] [2021-11-19 21:06:35,422][INFO ][sys-#13026%grid-3%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], err=null, rebalanced=true, wasRebalanced=false] [21:06:35] : [Step 4/5] [2021-11-19 21:06:35,421][INFO ][sys-#12902%grid-0%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=007123ac-333f-44e2-b470-a92210284000, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=007123ac-333f-44e2-b470-a92210284000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345195419, loc=true, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:06:35] : [Step 4/5] [2021-11-19 21:06:35,420][INFO ][sys-#12915%grid-0%][DistributedBaselineConfiguration] Baseline auto-adjust is 'disabled' with timeout='300000' ms [21:06:35] : [Step 4/5] [2021-11-19 21:06:35,424][INFO ][sys-#12915%grid-0%][GridClusterStateProcessor] Successfully performed final activation steps [nodeId=007123ac-333f-44e2-b470-a92210284000, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:06:35] : [Step 4/5] [2021-11-19 21:06:35,424][INFO ][sys-#12902%grid-0%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (1 ms), stage="Update caches registry" (546 ms), stage="Start caches" (0 ms), stage="Affinity initialization on cache group start" (0 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Restore partition states" (0 ms), stage="After states restored callback" (110 ms), stage="WAL history reservation" (0 ms), stage="Waiting for all single messages" (397 ms), stage="Affinity recalculation (crd)" (0 ms), stage="Collect update counters and create affinity messages" (0 ms), stage="Assign partitions states" (0 ms), stage="Validate partitions states" (0 ms), stage="Ideal affinity diff calculation (enforced)" (0 ms), stage="Apply update counters" (0 ms), stage="Full message preparing" (5 ms), stage="Full message sending" (0 ms), stage="State finish message sending" (0 ms), stage="Detect lost partitions" (2 ms), stage="Exchange done" (4 ms), stage="Total time" (1065 ms), Discovery lag=3 ms, Latest started node id=305f992f-5d53-4aba-a7f7-4bc45c5ca003] [21:06:35] : [Step 4/5] [2021-11-19 21:06:35,426][INFO ][sys-#12902%grid-0%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], stage="Affinity initialization on cache group start [grp=ignite-sys-cache]" (0 ms) (parent=Affinity initialization on cache group start), stage="Affinity centralized initialization (crd) [grp=ignite-sys-cache, crd=true]" (0 ms) (parent=Determine exchange type), stage="Restore partition states [grp=ignite-sys-cache]" (0 ms) (parent=Restore partition states), stage="Affinity recalculation (partitions availability) [grp=ignite-sys-cache]" (0 ms) (parent=Ideal affinity diff calculation (enforced))] [21:06:35] : [Step 4/5] [2021-11-19 21:06:35,423][INFO ][sys-#13026%grid-3%][GridCacheProcessor] Finish proxy initialization, cacheName=ignite-sys-cache, localNodeId=305f992f-5d53-4aba-a7f7-4bc45c5ca003 [21:06:35] : [Step 4/5] [2021-11-19 21:06:35,428][INFO ][sys-#13036%grid-3%][DistributedBaselineConfiguration] Baseline auto-adjust is 'disabled' with timeout='300000' ms [21:06:35] : [Step 4/5] [2021-11-19 21:06:35,428][INFO ][sys-#13036%grid-3%][GridClusterStateProcessor] Successfully performed final activation steps [nodeId=305f992f-5d53-4aba-a7f7-4bc45c5ca003, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:06:35] : [Step 4/5] [2021-11-19 21:06:35,429][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][root] >>> Stopping grid [name=grid-3, id=305f992f-5d53-4aba-a7f7-4bc45c5ca003] [21:06:35] : [Step 4/5] [2021-11-19 21:06:35,428][INFO ][sys-#13026%grid-3%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=305f992f-5d53-4aba-a7f7-4bc45c5ca003, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=007123ac-333f-44e2-b470-a92210284000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345194318, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:06:35] : [Step 4/5] [2021-11-19 21:06:35,428][INFO ][exchange-worker-#13049%grid-3%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=2, minorTopVer=1], force=false, evt=DISCOVERY_CUSTOM_EVT, node=007123ac-333f-44e2-b470-a92210284000] [21:06:35] : [Step 4/5] [2021-11-19 21:06:35,430][INFO ][sys-#13026%grid-3%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (2 ms), stage="Update caches registry" (84 ms), stage="Start caches" (0 ms), stage="Affinity initialization on cache group start" (0 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Restore partition states" (0 ms), stage="After states restored callback" (960 ms), stage="WAL history reservation" (0 ms), stage="Waiting for Full message" (15 ms), stage="Affinity recalculation" (2 ms), stage="Full map updating" (0 ms), stage="Detect lost partitions" (1 ms), stage="Exchange done" (7 ms), stage="Total time" (1071 ms)] [21:06:35] : [Step 4/5] [2021-11-19 21:06:35,432][INFO ][sys-#13026%grid-3%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], stage="Affinity initialization on cache group start [grp=ignite-sys-cache]" (0 ms) (parent=Affinity initialization on cache group start), stage="Affinity centralized initialization (crd) [grp=ignite-sys-cache, crd=false]" (0 ms) (parent=Determine exchange type), stage="Restore partition states [grp=ignite-sys-cache]" (0 ms) (parent=Restore partition states), stage="Affinity applying from full message [grp=ignite-sys-cache]" (2 ms) (parent=Affinity recalculation)] [21:06:35] : [Step 4/5] [2021-11-19 21:06:35,776][INFO ][db-checkpoint-thread-#13063%grid-0%][Checkpointer] Checkpoint started [checkpointId=82b3d963-07c5-4e63-b6a0-f06d5a846295, startPtr=WALPointer [idx=0, fileOff=66667, len=1963], checkpointBeforeLockTime=1ms, checkpointLockWait=105ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=373ms, writeCheckpointEntryDuration=392ms, splitAndSortCpPagesDuration=0ms, pages=16, reason='node started'] [21:06:35] : [Step 4/5] [2021-11-19 21:06:35,849][INFO ][db-checkpoint-thread-#13057%grid-3%][Checkpointer] Checkpoint started [checkpointId=7cb364c3-279d-4a0d-bf81-f60085072a53, startPtr=WALPointer [idx=0, fileOff=72774, len=1963], checkpointBeforeLockTime=1ms, checkpointLockWait=954ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=372ms, writeCheckpointEntryDuration=73ms, splitAndSortCpPagesDuration=1ms, pages=17, reason='node started'] [21:06:37] : [Step 4/5] [2021-11-19 21:06:37,219][INFO ][db-checkpoint-thread-#13063%grid-0%][Checkpointer] Checkpoint finished [cpId=82b3d963-07c5-4e63-b6a0-f06d5a846295, pages=16, markPos=WALPointer [idx=0, fileOff=66667, len=1963], walSegmentsCovered=[], markDuration=766ms, pagesWrite=71ms, fsync=1371ms, total=2314ms] [21:06:37] : [Step 4/5] [2021-11-19 21:06:37,219][INFO ][db-checkpoint-thread-#13057%grid-3%][Checkpointer] Checkpoint finished [cpId=7cb364c3-279d-4a0d-bf81-f60085072a53, pages=17, markPos=WALPointer [idx=0, fileOff=72774, len=1963], walSegmentsCovered=[], markDuration=447ms, pagesWrite=1ms, fsync=1368ms, total=2771ms] [21:06:37] : [Step 4/5] [2021-11-19 21:06:37,287][INFO ][db-checkpoint-thread-#13057%grid-3%][Checkpointer] Checkpoint started [checkpointId=40a0be64-2b5a-42f2-82f1-2f09e574b1c5, startPtr=WALPointer [idx=0, fileOff=108798, len=1947], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=1ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=0ms, pages=7, reason='timeout'] [21:06:37] : [Step 4/5] [2021-11-19 21:06:37,304][INFO ][db-checkpoint-thread-#13057%grid-3%][Checkpointer] Checkpoint finished [cpId=40a0be64-2b5a-42f2-82f1-2f09e574b1c5, pages=7, markPos=WALPointer [idx=0, fileOff=108798, len=1947], walSegmentsCovered=[], markDuration=3ms, pagesWrite=0ms, fsync=16ms, total=20ms] [21:06:37] : [Step 4/5] [2021-11-19 21:06:37,306][INFO ][db-checkpoint-thread-#13057%grid-3%][Checkpointer] Skipping checkpoint (no pages were modified) [checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, reason='timeout'] [21:06:37] : [Step 4/5] [2021-11-19 21:06:37,311][INFO ][tcp-disco-sock-reader-[007123ac 127.0.0.1:36287]-#681%grid-3%-#13045%grid-3%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:36287, rmtPort=36287, rmtNodeId=007123ac-333f-44e2-b470-a92210284000] [21:06:37] : [Step 4/5] [2021-11-19 21:06:37,312][INFO ][disco-event-worker-#12926%grid-0%][GridDiscoveryManager] Node left topology: TcpDiscoveryNode [id=305f992f-5d53-4aba-a7f7-4bc45c5ca003, consistentId=grid-3, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637345194298, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false] [21:06:37] : [Step 4/5] [2021-11-19 21:06:37,314][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][GridCacheProcessor] Stopped cache [cacheName=ignite-sys-cache] [21:06:37] : [Step 4/5] [2021-11-19 21:06:37,314][INFO ][disco-event-worker-#12926%grid-0%][GridDiscoveryManager] Topology snapshot [ver=3, locNode=007123ac, servers=1, clients=0, state=ACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=007123ac-333f-44e2-b470-a92210284000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:06:37] : [Step 4/5] [2021-11-19 21:06:37,314][INFO ][disco-event-worker-#12926%grid-0%][GridDiscoveryManager] ^-- Baseline [id=0, size=2, online=1, offline=1] [21:06:37]W: [org.apache.ignite:ignite-core] [2021-11-19 21:06:37,315][WARN ][grid-nio-worker-tcp-comm-0-#12866%TcpCommunicationSpi%][TcpCommunicationSpi] Failed to shutdown socket [21:06:37]W: [org.apache.ignite:ignite-core] java.nio.channels.ClosedChannelException [21:06:37]W: [org.apache.ignite:ignite-core] at sun.nio.ch.SocketChannelImpl.shutdownOutput(SocketChannelImpl.java:795) [21:06:37]W: [org.apache.ignite:ignite-core] at sun.nio.ch.SocketAdaptor.shutdownOutput(SocketAdaptor.java:407) [21:06:37]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.close(IgniteUtils.java:4247) [21:06:37]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.closeKey(GridNioServer.java:2784) [21:06:37]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.close(GridNioServer.java:2835) [21:06:37]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.close(GridNioServer.java:2794) [21:06:37]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.bodyInternal(GridNioServer.java:2157) [21:06:37]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.body(GridNioServer.java:1910) [21:06:37] : [Step 4/5] [2021-11-19 21:06:37,316][INFO ][exchange-worker-#12927%grid-0%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], crd=true, evt=NODE_LEFT, evtNode=305f992f-5d53-4aba-a7f7-4bc45c5ca003, customEvt=null, allowMerge=false, exchangeFreeSwitch=true] [21:06:37]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:125) [21:06:37]W: [org.apache.ignite:ignite-core] at java.lang.Thread.run(Thread.java:748) [21:06:37] : [Step 4/5] [2021-11-19 21:06:37,317][INFO ][exchange-worker-#12927%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:06:37] : [Step 4/5] [2021-11-19 21:06:37,318][INFO ][exchange-worker-#12927%grid-0%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], err=null, rebalanced=true, wasRebalanced=true] [21:06:37] : [Step 4/5] [2021-11-19 21:06:37,319][INFO ][exchange-worker-#12927%grid-0%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=007123ac-333f-44e2-b470-a92210284000, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], evt=NODE_LEFT, evtNode=TcpDiscoveryNode [id=305f992f-5d53-4aba-a7f7-4bc45c5ca003, consistentId=grid-3, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637345194298, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0]] [21:06:37] : [Step 4/5] [2021-11-19 21:06:37,320][INFO ][exchange-worker-#12927%grid-0%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (1 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="After states restored callback" (0 ms), stage="WAL history reservation" (0 ms), stage="Finalize update counters" (0 ms), stage="Detect lost partitions" (0 ms), stage="Exchange done" (1 ms), stage="Total time" (2 ms)] [21:06:37] : [Step 4/5] [2021-11-19 21:06:37,321][INFO ][exchange-worker-#12927%grid-0%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], stage="Affinity initialization (exchange-free switch on fully-rebalanced topology) [grp=ignite-sys-cache]" (0 ms) (parent=Determine exchange type)] [21:06:37] : [Step 4/5] [2021-11-19 21:06:37,322][INFO ][exchange-worker-#12927%grid-0%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], crd=true] [21:06:37] : [Step 4/5] [2021-11-19 21:06:37,322][INFO ][exchange-worker-#12927%grid-0%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=3, minorTopVer=0], force=false, evt=NODE_LEFT, node=305f992f-5d53-4aba-a7f7-4bc45c5ca003] [21:06:38] : [Step 4/5] [2021-11-19 21:06:38,529][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][FilePageStoreManager] Cleanup cache stores [total=3, left=0, cleanFiles=false] [21:06:38] : [Step 4/5] [2021-11-19 21:06:38,531][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][GridDeploymentLocalStore] Removed undeployed class: GridDeployment [ts=1637345195409, depMode=SHARED, clsLdr=IsolatedClassLoader{roleName='test'}, clsLdrId=cd64d593d71-305f992f-5d53-4aba-a7f7-4bc45c5ca003, userVer=0, loc=true, sampleClsName=org.apache.ignite.internal.processors.cache.distributed.dht.preloader.GridDhtPartitionFullMap, pendingUndeploy=false, undeployed=true, usage=0] [21:06:38] : [Step 4/5] [2021-11-19 21:06:38,537][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-3] [21:06:38] : [Step 4/5] [21:06:38] : [Step 4/5] >>> +------------------------------------------------------+ [21:06:38] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV stopped OK [21:06:38] : [Step 4/5] >>> +------------------------------------------------------+ [21:06:38] : [Step 4/5] >>> Ignite instance name: grid-3 [21:06:38] : [Step 4/5] >>> Grid uptime: 00:00:04.198 [21:06:38] : [Step 4/5] [21:06:38] : [Step 4/5] [21:06:38] : [Step 4/5] [2021-11-19 21:06:38,638][INFO ][exchange-worker-#12927%grid-0%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], crd=true, evt=DISCOVERY_CUSTOM_EVT, evtNode=007123ac-333f-44e2-b470-a92210284000, customEvt=DynamicCacheChangeBatch [id=d174d593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqs=ArrayList [DynamicCacheChangeRequest [cacheName=encrypted, hasCfg=true, nodeId=007123ac-333f-44e2-b470-a92210284000, clientStartOnly=false, stop=false, destroy=false, disabledAfterStart=false]], exchangeActions=ExchangeActions [startCaches=[encrypted], stopCaches=null, startGrps=[encrypted], stopGrps=[], resetParts=null, stateChangeRequest=null], startCaches=false], allowMerge=false, exchangeFreeSwitch=false] [21:06:38] : [Step 4/5] [2021-11-19 21:06:38,641][INFO ][exchange-worker-#12927%grid-0%][PageMemoryImpl] Started page memory [memoryAllocated=24.0 MiB, pages=5952, tableSize=474.2 KiB, replacementSize=768 B, checkpointBuffer=10.0 MiB] [21:06:38] : [Step 4/5] [2021-11-19 21:06:38,700][INFO ][exchange-worker-#12927%grid-0%][GridCacheProcessor] Started cache [name=encrypted, id=1613773252, dataRegionName=default, mode=PARTITIONED, atomicity=ATOMIC, backups=0, mvcc=false] [21:06:38]W: [org.apache.ignite:ignite-core] [2021-11-19 21:06:38,702][WARN ][exchange-worker-#12927%grid-0%][CacheAffinitySharedManager] Cache group 'encrypted' brings high overhead for its metainformation in data region 'default'. Metainformation required for its partitions (528 partitions, 4096 bytes per partition, 2 MBs total) will consume more than 15% of data region memory (10 MBs). It may lead to critical errors on the node and cluster instability. Please reduce number of partitions, add more memory to the data region or add more server nodes for this cache group. [21:06:38] : [Step 4/5] [2021-11-19 21:06:38,703][INFO ][exchange-worker-#12927%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], waitTime=0ms, futInfo=NA, mode=DISTRIBUTED] [21:06:38] : [Step 4/5] [2021-11-19 21:06:38,703][INFO ][exchange-worker-#12927%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partitions release latch: ServerLatch [permits=0, pendingAcks=HashSet [], super=CompletableLatch [id=CompletableLatchUid [id=exchange, topVer=AffinityTopologyVersion [topVer=3, minorTopVer=1]]]] [21:06:38] : [Step 4/5] [2021-11-19 21:06:38,704][INFO ][exchange-worker-#12927%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:06:38] : [Step 4/5] [2021-11-19 21:06:38,734][INFO ][exchange-worker-#12927%grid-0%][GridDhtPartitionsExchangeFuture] finishExchangeOnCoordinator [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=1]] [21:06:38] : [Step 4/5] [2021-11-19 21:06:38,745][INFO ][exchange-worker-#12927%grid-0%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], err=null, rebalanced=true, wasRebalanced=true] [21:06:38] : [Step 4/5] [2021-11-19 21:06:38,746][INFO ][exchange-worker-#12927%grid-0%][GridCacheProcessor] Finish proxy initialization, cacheName=encrypted, localNodeId=007123ac-333f-44e2-b470-a92210284000 [21:06:38] : [Step 4/5] [2021-11-19 21:06:38,747][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][root] >>> Stopping grid [name=grid-0, id=007123ac-333f-44e2-b470-a92210284000] [21:06:38] : [Step 4/5] [2021-11-19 21:06:38,747][INFO ][exchange-worker-#12927%grid-0%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=007123ac-333f-44e2-b470-a92210284000, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=007123ac-333f-44e2-b470-a92210284000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345197306, loc=true, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=3, minorTopVer=1]] [21:06:38] : [Step 4/5] [2021-11-19 21:06:38,748][INFO ][exchange-worker-#12927%grid-0%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (1 ms), stage="Update caches registry" (1 ms), stage="Start caches" (59 ms), stage="Affinity initialization on cache group start" (2 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Wait partitions release latch [latch=exchange]" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Restore partition states" (10 ms), stage="After states restored callback" (19 ms), stage="WAL history reservation" (0 ms), stage="Waiting for all single messages" (0 ms), stage="Affinity recalculation (crd)" (0 ms), stage="Collect update counters and create affinity messages" (0 ms), stage="Assign partitions states" (3 ms), stage="Validate partitions states" (0 ms), stage="Apply update counters" (0 ms), stage="Full message preparing" (5 ms), stage="Full message sending" (0 ms), stage="Exchange done" (3 ms), stage="Total time" (103 ms)] [21:06:38] : [Step 4/5] [2021-11-19 21:06:38,751][INFO ][exchange-worker-#12927%grid-0%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], stage="Affinity initialization on cache group start [grp=encrypted]" (1 ms) (parent=Affinity initialization on cache group start), stage="Restore partition states [grp=encrypted]" (10 ms) (parent=Restore partition states), stage="Restore partition states [grp=ignite-sys-cache]" (0 ms) (parent=Restore partition states)] [21:06:38] : [Step 4/5] [2021-11-19 21:06:38,752][INFO ][exchange-worker-#12927%grid-0%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], crd=true] [21:06:38] : [Step 4/5] [2021-11-19 21:06:38,753][INFO ][exchange-worker-#12927%grid-0%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=3, minorTopVer=1], force=false, evt=DISCOVERY_CUSTOM_EVT, node=007123ac-333f-44e2-b470-a92210284000] [21:06:39] : [Step 4/5] [2021-11-19 21:06:39,123][INFO ][db-checkpoint-thread-#13063%grid-0%][Checkpointer] Checkpoint started [checkpointId=0b5bdd5c-3435-45f6-ad87-314ce3943eee, startPtr=WALPointer [idx=0, fileOff=193859, len=11985], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=1ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=318ms, writeCheckpointEntryDuration=47ms, splitAndSortCpPagesDuration=1ms, pages=12, reason='timeout'] [21:06:39] : [Step 4/5] [2021-11-19 21:06:39,191][INFO ][db-checkpoint-thread-#13063%grid-0%][Checkpointer] Checkpoint finished [cpId=0b5bdd5c-3435-45f6-ad87-314ce3943eee, pages=12, markPos=WALPointer [idx=0, fileOff=193859, len=11985], walSegmentsCovered=[], markDuration=367ms, pagesWrite=1ms, fsync=66ms, total=435ms] [21:06:39] : [Step 4/5] [2021-11-19 21:06:39,194][INFO ][db-checkpoint-thread-#13063%grid-0%][Checkpointer] Skipping checkpoint (no pages were modified) [checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=1ms, checkpointLockHoldTime=2ms, reason='timeout'] [21:06:39]W: [org.apache.ignite:ignite-core] [2021-11-19 21:06:39,199][WARN ][tcp-disco-sock-reader-[305f992f 127.0.0.1:53765]-#682%grid-0%-#13046%grid-0%][TestTcpDiscoverySpi] Failed to shutdown socket [21:06:39]W: [org.apache.ignite:ignite-core] java.net.SocketException: Socket is closed [21:06:39]W: [org.apache.ignite:ignite-core] at java.net.Socket.shutdownOutput(Socket.java:1568) [21:06:39]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.close(IgniteUtils.java:4247) [21:06:39]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.discovery.tcp.ServerImpl$SocketReader.body(ServerImpl.java:7370) [21:06:39]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.IgniteSpiThread.run(IgniteSpiThread.java:58) [21:06:39] : [Step 4/5] [2021-11-19 21:06:39,200][INFO ][tcp-disco-sock-reader-[305f992f 127.0.0.1:53765]-#682%grid-0%-#13046%grid-0%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:53765, rmtPort=53765, rmtNodeId=305f992f-5d53-4aba-a7f7-4bc45c5ca003] [21:06:39] : [Step 4/5] [2021-11-19 21:06:39,202][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][GridCacheProcessor] Stopped cache [cacheName=ignite-sys-cache] [21:06:39] : [Step 4/5] [2021-11-19 21:06:39,202][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][GridCacheProcessor] Stopped cache [cacheName=encrypted] [21:06:39] : [Step 4/5] [2021-11-19 21:06:39,592][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][FilePageStoreManager] Cleanup cache stores [total=4, left=0, cleanFiles=false] [21:06:39] : [Step 4/5] [2021-11-19 21:06:39,594][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][GridDeploymentLocalStore] Removed undeployed class: GridDeployment [ts=1637345195398, depMode=SHARED, clsLdr=IsolatedClassLoader{roleName='test'}, clsLdrId=7d64d593d71-007123ac-333f-44e2-b470-a92210284000, userVer=0, loc=true, sampleClsName=org.apache.ignite.internal.processors.cache.distributed.dht.preloader.GridDhtPartitionMap, pendingUndeploy=false, undeployed=true, usage=0] [21:06:39] : [Step 4/5] [2021-11-19 21:06:39,599][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] [21:06:39] : [Step 4/5] [21:06:39] : [Step 4/5] >>> +------------------------------------------------------+ [21:06:39] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV stopped OK [21:06:39] : [Step 4/5] >>> +------------------------------------------------------+ [21:06:39] : [Step 4/5] >>> Ignite instance name: grid-0 [21:06:39] : [Step 4/5] >>> Grid uptime: 00:00:07.638 [21:06:39] : [Step 4/5] [21:06:39] : [Step 4/5] [21:06:39]W: [org.apache.ignite:ignite-core] [2021-11-19 21:06:39,604][WARN ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][G] Ignite work directory is not provided, automatically resolved to: /opt/buildagent/work/7bc1c54bc719b67c/work [21:06:39] : [Step 4/5] [2021-11-19 21:06:39,606][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-3] [21:06:39] : [Step 4/5] [21:06:39] : [Step 4/5] >>> __________ ________________ [21:06:39] : [Step 4/5] >>> / _/ ___/ |/ / _/_ __/ __/ [21:06:39] : [Step 4/5] >>> _/ // (7 7 // / / / / _/ [21:06:39] : [Step 4/5] >>> /___/\___/_/|_/___/ /_/ /___/ [21:06:39] : [Step 4/5] >>> [21:06:39] : [Step 4/5] >>> ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:06:39] : [Step 4/5] >>> 2021 Copyright(C) Apache Software Foundation [21:06:39] : [Step 4/5] >>> [21:06:39] : [Step 4/5] >>> Ignite documentation: http://ignite.apache.org [21:06:39] : [Step 4/5] [21:06:39] : [Step 4/5] [2021-11-19 21:06:39,606][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-3] Config URL: n/a [21:06:39] : [Step 4/5] [2021-11-19 21:06:39,607][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-3] IgniteConfiguration [igniteInstanceName=grid-3, pubPoolSize=24, svcPoolSize=24, callbackPoolSize=24, stripedPoolSize=24, sysPoolSize=24, mgmtPoolSize=4, dataStreamerPoolSize=24, utilityCachePoolSize=24, utilityCacheKeepAliveTime=60000, p2pPoolSize=2, qryPoolSize=24, buildIdxPoolSize=4, igniteHome=/opt/buildagent/work/7bc1c54bc719b67c, igniteWorkDir=/opt/buildagent/work/7bc1c54bc719b67c/work, mbeanSrv=com.sun.jmx.mbeanserver.JmxMBeanServer@6fe85038, nodeId=30dac517-cf3b-41e2-82be-81795e246003, marsh=BinaryMarshaller [], marshLocJobs=false, daemon=false, p2pEnabled=true, netTimeout=10000, netCompressionLevel=1, sndRetryDelay=1000, sndRetryCnt=3, metricsHistSize=10000, metricsUpdateFreq=1000, metricsExpTime=9223372036854775807, discoSpi=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=0, ackTimeout=0, marsh=null, reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], segPlc=STOP, segResolveAttempts=2, waitForSegOnStart=true, allResolversPassReq=true, segChkFreq=10000, commSpi=TcpCommunicationSpi [connectGate=org.apache.ignite.spi.communication.tcp.internal.ConnectGateway@6f94afa5, ctxInitLatch=java.util.concurrent.CountDownLatch@437279a3[Count = 1], stopping=false, clientPool=null, nioSrvWrapper=null, stateProvider=null], evtSpi=MemoryEventStorageSpi [expireAgeMs=9223372036854775807, expireCnt=10000, filter=null], colSpi=NoopCollisionSpi [], deploySpi=LocalDeploymentSpi [], indexingSpi=org.apache.ignite.spi.indexing.noop.NoopIndexingSpi@3d1365d4, addrRslvr=null, encryptionSpi=org.apache.ignite.spi.encryption.keystore.KeystoreEncryptionSpi@6f996906, tracingSpi=org.apache.ignite.spi.tracing.NoopTracingSpi@367c04c9, clientMode=false, rebalanceThreadPoolSize=4, rebalanceTimeout=10000, rebalanceBatchesPrefetchCnt=3, rebalanceThrottle=0, rebalanceBatchSize=524288, txCfg=TransactionConfiguration [txSerEnabled=false, dfltIsolation=REPEATABLE_READ, dfltConcurrency=PESSIMISTIC, dfltTxTimeout=0, txTimeoutOnPartitionMapExchange=0, deadlockTimeout=10000, pessimisticTxLogSize=0, pessimisticTxLogLinger=10000, tmLookupClsName=null, txManagerFactory=null, useJtaSync=false], cacheSanityCheckEnabled=true, discoStartupDelay=60000, deployMode=SHARED, p2pMissedCacheSize=100, locHost=127.0.0.1, timeSrvPortBase=31100, timeSrvPortRange=100, failureDetectionTimeout=10000, sysWorkerBlockedTimeout=null, clientFailureDetectionTimeout=10000, metricsLogFreq=0, connectorCfg=null, odbcCfg=null, warmupClos=null, atomicCfg=AtomicConfiguration [seqReserveSize=1000, cacheMode=PARTITIONED, backups=1, aff=null, grpName=null], classLdr=null, sslCtxFactory=null, platformCfg=null, binaryCfg=null, memCfg=null, pstCfg=null, dsCfg=DataStorageConfiguration [sysRegionInitSize=41943040, sysRegionMaxSize=104857600, pageSize=4096, concLvl=0, dfltDataRegConf=DataRegionConfiguration [name=default, maxSize=10485760, initSize=268435456, swapPath=null, pageEvictionMode=DISABLED, pageReplacementMode=CLOCK, evictionThreshold=0.9, emptyPagesPoolSize=100, metricsEnabled=false, metricsSubIntervalCount=5, metricsRateTimeInterval=60000, persistenceEnabled=true, checkpointPageBufSize=0, lazyMemoryAllocation=true, warmUpCfg=null], dataRegions=null, storagePath=null, checkpointFreq=180000, lockWaitTime=10000, checkpointThreads=4, checkpointWriteOrder=SEQUENTIAL, walHistSize=20, maxWalArchiveSize=1073741824, walSegments=10, walSegmentSize=67108864, walPath=db/wal, walArchivePath=db/wal/archive, cdcWalPath=db/wal/cdc, cdcEnabled=false, metricsEnabled=false, walMode=FSYNC, walTlbSize=131072, walBuffSize=0, walFlushFreq=2000, walFsyncDelay=1000, walRecordIterBuffSize=67108864, alwaysWriteFullPages=false, fileIOFactory=org.apache.ignite.internal.processors.cache.persistence.file.AsyncFileIOFactory@35bc0a37, metricsSubIntervalCnt=5, metricsRateTimeInterval=60000, walAutoArchiveAfterInactivity=-1, walForceArchiveTimeout=-1, writeThrottlingEnabled=false, walCompactionEnabled=false, walCompactionLevel=1, checkpointReadLockTimeout=null, walPageCompression=DISABLED, walPageCompressionLevel=null, dfltWarmUpCfg=null, encCfg=org.apache.ignite.configuration.EncryptionConfiguration@25f1899b, defragmentationThreadPoolSize=4, minWalArchiveSize=-1], snapshotPath=snapshots, activeOnStart=true, activeOnStartPropSetFlag=false, autoActivation=true, autoActivationPropSetFlag=false, clusterStateOnStart=null, sqlConnCfg=null, cliConnCfg=ClientConnectorConfiguration [host=null, port=10800, portRange=100, sockSndBufSize=0, sockRcvBufSize=0, tcpNoDelay=true, maxOpenCursorsPerConn=128, threadPoolSize=24, selectorCnt=12, idleTimeout=0, handshakeTimeout=10000, jdbcEnabled=true, odbcEnabled=true, thinCliEnabled=true, sslEnabled=false, useIgniteSslCtxFactory=true, sslClientAuth=false, sslCtxFactory=null, thinCliCfg=ThinClientConfiguration [maxActiveTxPerConn=100, maxActiveComputeTasksPerConn=0]], mvccVacuumThreadCnt=2, mvccVacuumFreq=5000, authEnabled=false, failureHnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]], commFailureRslvr=null, sqlCfg=SqlConfiguration [longQryWarnTimeout=3000, dfltQryTimeout=0, sqlQryHistSize=1000, validationEnabled=false], asyncContinuationExecutor=null] [21:06:39] : [Step 4/5] [2021-11-19 21:06:39,614][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-3] Daemon mode: off [21:06:39] : [Step 4/5] [2021-11-19 21:06:39,614][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-3] OS: Linux 4.15.0-151-generic amd64 [21:06:39] : [Step 4/5] [2021-11-19 21:06:39,614][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-3] OS user: teamcity [21:06:39] : [Step 4/5] [2021-11-19 21:06:39,614][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-3] PID: 16724 [21:06:39] : [Step 4/5] [2021-11-19 21:06:39,615][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-3] Language runtime: Java Platform API Specification ver. 1.8 [21:06:39] : [Step 4/5] [2021-11-19 21:06:39,615][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-3] VM information: Java(TM) SE Runtime Environment 1.8.0_261-b12 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 25.261-b12 [21:06:39] : [Step 4/5] [2021-11-19 21:06:39,615][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-3] VM total memory: 1.9GB [21:06:39] : [Step 4/5] [2021-11-19 21:06:39,616][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-3] Remote Management [restart: off, REST: off, JMX (remote: off)] [21:06:39] : [Step 4/5] [2021-11-19 21:06:39,616][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-3] Logger: GridTestLog4jLogger [quiet=false, config=null] [21:06:39] : [Step 4/5] [2021-11-19 21:06:39,616][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-3] IGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c [21:06:39] : [Step 4/5] [2021-11-19 21:06:39,616][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-3] VM arguments: [-DIGNITE_DUMP_THREADS_ON_FAILURE=false, -DMono=/usr/bin/mono-sgen, -DMono4.0_x64=/usr/lib/mono/4.0, -DMono4.5_x64=/usr/lib/mono/4.5, -DMonoVersion=6.12.0.90, -DSKIP_BUILD=false, -Dagent.home.dir=/opt/buildagent, -Dagent.name=aitc-lin02_03, -Dagent.ownPort=9090, -Dagent.work.dir=/opt/buildagent/work, -Dbuild.number=95, -Dbuild.vcs.number=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.1=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.GitHubApacheIgnite=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dclassworlds.conf=/opt/buildagent/temp/buildTmp/teamcity.m2.conf, -Dcom.jetbrains.maven.watcher.report.file=/opt/buildagent/temp/buildTmp/maven-build-info.xml, -Djava.io.tmpdir=/opt/buildagent/temp/buildTmp, -Dmaven.home=/opt/buildagent/tools/maven3_6, -Dmaven.multiModuleProjectDirectory=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.agent.cpuBenchmark=457, -Dteamcity.agent.dotnet.agent_url=http://localhost:9090/RPC2, -Dteamcity.agent.dotnet.build_id=6278078, -Dteamcity.auth.password=*******, -Dteamcity.auth.userId=TeamCityBuildId=6278078, -Dteamcity.build.changedFiles.file=/opt/buildagent/temp/buildTmp/changedFiles6342607772318147725.txt, -Dteamcity.build.checkoutDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.build.id=6278078, -Dteamcity.build.properties.file=/opt/buildagent/temp/buildTmp/teamcity.build5164517880467851002.properties, -Dteamcity.build.tempDir=/opt/buildagent/temp/buildTmp, -Dteamcity.build.workingDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.buildConfName=Basic 3, -Dteamcity.buildType.id=IgniteTests24Java8_Basic3, -Dteamcity.configuration.properties.file=/opt/buildagent/temp/buildTmp/teamcity.config5591980786735343870.properties, -Dteamcity.maven.userSettings.path=/opt/buildagent/temp/buildTmp/maven_settings_585072866407032347.xml, -Dteamcity.maven.watcher.home=/opt/buildagent/plugins/mavenPlugin/maven-watcher-jdk16, -Dteamcity.projectName=Ignite Tests 2.x (JDK 8/11), -Dteamcity.runner.properties.file=/opt/buildagent/temp/buildTmp/teamcity.runner9098465561618137420.properties, -Dteamcity.tests.recentlyFailedTests.file=/opt/buildagent/temp/buildTmp/testsToRunFirst3891775683130404069.txt, -Dteamcity.version=2021.2 (build 99542), -ea, -Xms2g, -Xmx2g, -XX:+HeapDumpOnOutOfMemoryError, -DIGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_TEST_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_UPDATE_NOTIFIER=false, -DIGNITE_NO_DISCO_ORDER=true, -DIGNITE_PERFORMANCE_SUGGESTIONS_DISABLED=true, -Djava.net.preferIPv4Stack=true, -DTEST_SCALE_FACTOR=1.0, -DIGNITE_TEST_PROP_LOG4J_FILE=log4j-tc-test.xml, -DIGNITE_QUIET=false, -DIGNITE_MARSHAL_BUFFERS_RECHECK=1000, -Dmaven.repo.local=/opt/buildagent/.m2/repository] [21:06:39] : [Step 4/5] [2021-11-19 21:06:39,620][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-3] System cache's DataRegion size is configured to 40 MB. Use DataStorageConfiguration.systemRegionInitialSize property to change the setting. [21:06:39] : [Step 4/5] [2021-11-19 21:06:39,621][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-3] Configured caches [in 'sysMemPlc' dataRegion: ['ignite-sys-cache']] [21:06:39]W: [org.apache.ignite:ignite-core] [2021-11-19 21:06:39,621][WARN ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-3] Peer class loading is enabled (disable it in production for performance and deployment consistency reasons) [21:06:39] : [Step 4/5] [2021-11-19 21:06:39,621][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-3] 3-rd party licenses can be found at: /opt/buildagent/work/7bc1c54bc719b67c/libs/licenses [21:06:39] : [Step 4/5] [2021-11-19 21:06:39,625][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] Configured plugins: [21:06:39] : [Step 4/5] [2021-11-19 21:06:39,625][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- StanByClusterTestProvider 1.0 [21:06:39] : [Step 4/5] [2021-11-19 21:06:39,626][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- null [21:06:39] : [Step 4/5] [2021-11-19 21:06:39,626][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] [21:06:39] : [Step 4/5] [2021-11-19 21:06:39,626][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- PageMemory tracker plugin 1.0 [21:06:39] : [Step 4/5] [2021-11-19 21:06:39,626][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- null [21:06:39] : [Step 4/5] [2021-11-19 21:06:39,626][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] [21:06:39] : [Step 4/5] [2021-11-19 21:06:39,627][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- TestDistibutedConfigurationPlugin 1.0 [21:06:39] : [Step 4/5] [2021-11-19 21:06:39,627][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- null [21:06:39] : [Step 4/5] [2021-11-19 21:06:39,627][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] [21:06:39] : [Step 4/5] [2021-11-19 21:06:39,627][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- NodeValidationPluginProvider 1.0 [21:06:39] : [Step 4/5] [2021-11-19 21:06:39,627][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- null [21:06:39] : [Step 4/5] [2021-11-19 21:06:39,627][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] [21:06:39] : [Step 4/5] [2021-11-19 21:06:39,628][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][FailureProcessor] Configured failure handler: [hnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]]] [21:06:39] : [Step 4/5] [2021-11-19 21:06:39,652][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][TcpCommunicationSpi] Successfully bound communication NIO server to TCP port [port=45150, locHost=/127.0.0.1, selectorsCnt=12, selectorSpins=0, pairedConn=false] [21:06:39]W: [org.apache.ignite:ignite-core] [2021-11-19 21:06:39,653][WARN ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][TcpCommunicationSpi] Message queue limit is set to 0 which may lead to potential OOMEs when running cache operations in FULL_ASYNC or PRIMARY_SYNC modes due to message queues growth on sender and receiver sides. [21:06:39] : [Step 4/5] [2021-11-19 21:06:39,668][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][GridCollisionManager] Collision resolution is disabled (all jobs will be activated upon arrival). [21:06:39] : [Step 4/5] [2021-11-19 21:06:39,668][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-3] Security status [authentication=off, sandbox=off, tls/ssl=off] [21:06:39] : [Step 4/5] [2021-11-19 21:06:39,724][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:06:39] : [Step 4/5] [2021-11-19 21:06:39,808][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][MaintenanceProcessor] Resolved store directory for node persistent data: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_3 [21:06:39] : [Step 4/5] [2021-11-19 21:06:39,809][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][CacheObjectBinaryProcessorImpl] Resolved directory for serialized binary metadata: /opt/buildagent/work/7bc1c54bc719b67c/work/db/binary_meta/grid_3 [21:06:39] : [Step 4/5] [2021-11-19 21:06:39,813][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_3 [21:06:39] : [Step 4/5] [2021-11-19 21:06:39,813][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][FileWriteAheadLogManager] Resolved write ahead log work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_3 [21:06:39] : [Step 4/5] [2021-11-19 21:06:39,814][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][FileWriteAheadLogManager] Resolved write ahead log archive directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_3 [21:06:39] : [Step 4/5] [2021-11-19 21:06:39,815][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_3/0000000000000004.wal [21:06:39] : [Step 4/5] [2021-11-19 21:06:39,816][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_3/0000000000000003.wal [21:06:39] : [Step 4/5] [2021-11-19 21:06:39,816][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_3/0000000000000002.wal [21:06:39] : [Step 4/5] [2021-11-19 21:06:39,817][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_3/0000000000000001.wal [21:06:39] : [Step 4/5] [2021-11-19 21:06:39,822][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Configured data regions initialized successfully [total=5] [21:06:39] : [Step 4/5] [2021-11-19 21:06:39,827][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][IgniteSnapshotManager] Resolved snapshot work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/snapshots [21:06:39] : [Step 4/5] [2021-11-19 21:06:39,827][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][IgniteSnapshotManager] Resolved temp directory for snapshot creation: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_3/snp [21:06:39] : [Step 4/5] [2021-11-19 21:06:39,831][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][ClientListenerProcessor] Client connector processor has started on TCP port 10800 [21:06:39] : [Step 4/5] [2021-11-19 21:06:39,838][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-3] Non-loopback local IPs: 172.17.0.4 [21:06:39] : [Step 4/5] [2021-11-19 21:06:39,839][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-3] Enabled local MACs: 0242AC110004 [21:06:39] : [Step 4/5] [2021-11-19 21:06:39,842][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=/opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_3/cp/1637345197284-40a0be64-2b5a-42f2-82f1-2f09e574b1c5-START.bin, endMarker=/opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_3/cp/1637345197284-40a0be64-2b5a-42f2-82f1-2f09e574b1c5-END.bin] [21:06:39] : [Step 4/5] [2021-11-19 21:06:39,844][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:06:39] : [Step 4/5] [2021-11-19 21:06:39,844][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=108798, len=1947], lastMarked=WALPointer [idx=0, fileOff=108798, len=1947], lastCheckpointId=40a0be64-2b5a-42f2-82f1-2f09e574b1c5] [21:06:39] : [Step 4/5] [2021-11-19 21:06:39,983][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Found last checkpoint marker [cpId=40a0be64-2b5a-42f2-82f1-2f09e574b1c5, pos=WALPointer [idx=0, fileOff=108798, len=1947]] [21:06:39] : [Step 4/5] [2021-11-19 21:06:39,991][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Applying lost metastore updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=108798, len=1947], lastCheckpointId=40a0be64-2b5a-42f2-82f1-2f09e574b1c5] [21:06:40] : [Step 4/5] [2021-11-19 21:06:40,054][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=61 ms] [21:06:40] : [Step 4/5] [2021-11-19 21:06:40,055][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][GridCacheProcessor] Restoring partition state for local groups. [21:06:40] : [Step 4/5] [2021-11-19 21:06:40,055][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=0, partitionsProcessed=0, time=0ms] [21:06:40] : [Step 4/5] [2021-11-19 21:06:40,195][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][GridEncryptionManager] Encryption keys loaded from metastore. [grps=, masterKeyName=ignite.master.key] [21:06:40] : [Step 4/5] [2021-11-19 21:06:40,202][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][GridClusterStateProcessor] Restoring history for BaselineTopology[id=0] [21:06:40] : [Step 4/5] [2021-11-19 21:06:40,210][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][ClusterProcessor] Cluster ID and tag has been read from metastorage: ClusterIdAndTag [id=430fd593-d346-4408-af9b-ca934799bba8, tag=amazing_hermann] [21:06:40] : [Step 4/5] [2021-11-19 21:06:40,211][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][IgniteClusterImpl] Shutdown policy was updated [oldVal=null, newVal=null] [21:06:40] : [Step 4/5] [2021-11-19 21:06:40,211][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustEnabled' was changed from 'null' to 'false' [21:06:40] : [Step 4/5] [2021-11-19 21:06:40,212][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustTimeout' was changed from 'null' to '300000' [21:06:40] : [Step 4/5] [2021-11-19 21:06:40,212][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][IgniteTxManager] Transactions parameter 'txOwnerDumpRequestsAllowed' was changed from 'null' to 'true' [21:06:40] : [Step 4/5] [2021-11-19 21:06:40,212][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][IgniteTxManager] Transactions parameter 'longOperationsDumpTimeout' was changed from 'null' to '60000' [21:06:40] : [Step 4/5] [2021-11-19 21:06:40,213][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpThreshold' was changed from 'null' to '0' [21:06:40] : [Step 4/5] [2021-11-19 21:06:40,214][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][IgniteTxManager] Transactions parameter 'transactionTimeDumpSamplesCoefficient' was changed from 'null' to '0.0' [21:06:40] : [Step 4/5] [2021-11-19 21:06:40,214][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpSamplesPerSecondLimit' was changed from 'null' to '5' [21:06:40] : [Step 4/5] [2021-11-19 21:06:40,215][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][IgniteTxManager] Transactions parameter 'collisionsDumpInterval' was changed from 'null' to '1000' [21:06:40] : [Step 4/5] [2021-11-19 21:06:40,215][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Historical rebalance WAL threshold changed [property=historical.rebalance.threshold, oldVal=null, newVal=500] [21:06:40] : [Step 4/5] [2021-11-19 21:06:40,215][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Checkpoint frequency deviation changed [oldVal=null, newVal=null] [21:06:40] : [Step 4/5] [2021-11-19 21:06:40,230][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][FilePageStoreManager] Cleanup cache stores [total=1, left=0, cleanFiles=false] [21:06:40] : [Step 4/5] [2021-11-19 21:06:40,232][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:06:40] : [Step 4/5] [2021-11-19 21:06:40,234][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:06:40] : [Step 4/5] [2021-11-19 21:06:40,235][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:06:40] : [Step 4/5] [2021-11-19 21:06:40,236][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Data Regions Started: 5 [21:06:40] : [Step 4/5] [2021-11-19 21:06:40,236][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] ^-- sysMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:06:40] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:06:40] : [Step 4/5] ^-- default region [type=default, persistence=true, lazyAlloc=true, [21:06:40] : [Step 4/5] ... initCfg=10MB, maxCfg=10MB, usedRam=0MB, freeRam=100%, allocRam=0MB, allocTotal=0MB] [21:06:40] : [Step 4/5] ^-- metastoreMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:06:40] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:06:40] : [Step 4/5] ^-- TxLog region [type=internal, persistence=true, lazyAlloc=false, [21:06:40] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:06:40] : [Step 4/5] ^-- volatileDsMemPlc region [type=user, persistence=false, lazyAlloc=true, [21:06:40] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB] [21:06:40] : [Step 4/5] ^-- Ignite persistence [used=0MB] [21:06:40] : [Step 4/5] [21:06:40] : [Step 4/5] [2021-11-19 21:06:40,238][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Starting binary memory restore for: [-2100569601] [21:06:40] : [Step 4/5] [2021-11-19 21:06:40,247][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=/opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_3/cp/1637345197284-40a0be64-2b5a-42f2-82f1-2f09e574b1c5-START.bin, endMarker=/opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_3/cp/1637345197284-40a0be64-2b5a-42f2-82f1-2f09e574b1c5-END.bin] [21:06:40] : [Step 4/5] [2021-11-19 21:06:40,247][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=108798, len=1947], lastMarked=WALPointer [idx=0, fileOff=108798, len=1947], lastCheckpointId=40a0be64-2b5a-42f2-82f1-2f09e574b1c5] [21:06:40] : [Step 4/5] [2021-11-19 21:06:40,392][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Found last checkpoint marker [cpId=40a0be64-2b5a-42f2-82f1-2f09e574b1c5, pos=WALPointer [idx=0, fileOff=108798, len=1947]] [21:06:40] : [Step 4/5] [2021-11-19 21:06:40,401][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Binary memory state restored at node startup [restoredPtr=WALPointer [idx=0, fileOff=110745, len=0]] [21:06:40] : [Step 4/5] [2021-11-19 21:06:40,403][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_3/0000000000000000.wal, offset=110745, ver=2] [21:06:40] : [Step 4/5] [2021-11-19 21:06:40,407][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][GridCacheProcessor] Started cache in recovery mode [name=ignite-sys-cache, id=-2100569601, dataRegionName=sysMemPlc, mode=REPLICATED, atomicity=TRANSACTIONAL, backups=2147483647, mvcc=false] [21:06:40] : [Step 4/5] [2021-11-19 21:06:40,408][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Binary recovery performed in 170 ms. [21:06:40] : [Step 4/5] [2021-11-19 21:06:40,409][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=/opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_3/cp/1637345197284-40a0be64-2b5a-42f2-82f1-2f09e574b1c5-START.bin, endMarker=/opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_3/cp/1637345197284-40a0be64-2b5a-42f2-82f1-2f09e574b1c5-END.bin] [21:06:40] : [Step 4/5] [2021-11-19 21:06:40,409][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Applying lost cache updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=108798, len=1947], lastCheckpointId=40a0be64-2b5a-42f2-82f1-2f09e574b1c5] [21:06:40] : [Step 4/5] [2021-11-19 21:06:40,480][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=73 ms] [21:06:40] : [Step 4/5] [2021-11-19 21:06:40,480][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][GridCacheProcessor] Restoring partition state for local groups. [21:06:40] : [Step 4/5] [2021-11-19 21:06:40,494][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=1, partitionsProcessed=100, time=10ms] [21:06:42] : [Step 4/5] [2021-11-19 21:06:42,340][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][TestTcpDiscoverySpi] Successfully bound to TCP port [port=47500, localHost=localhost/127.0.0.1, locNodeId=30dac517-cf3b-41e2-82be-81795e246003] [21:06:42] : [Step 4/5] [2021-11-19 21:06:42,348][INFO ][disco-notifier-worker-#13190%grid-3%][MvccProcessorImpl] Assigned mvcc coordinator [crd=MvccCoordinator [topVer=AffinityTopologyVersion [topVer=1, minorTopVer=0], nodeId=30dac517-cf3b-41e2-82be-81795e246003, ver=1637345202343, local=true, initialized=false]] [21:06:42] : [Step 4/5] [2021-11-19 21:06:42,349][INFO ][sys-#13178%grid-3%][ClusterProcessor] Writing cluster ID and tag to metastorage on ready for write ClusterIdAndTag [id=430fd593-d346-4408-af9b-ca934799bba8, tag=amazing_hermann] [21:06:42] : [Step 4/5] [2021-11-19 21:06:42,361][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-3] To start Console Management & Monitoring run ignitevisorcmd.{sh|bat} [21:06:42] : [Step 4/5] [2021-11-19 21:06:42,361][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-3] [21:06:42] : [Step 4/5] [21:06:42] : [Step 4/5] >>> +-------------------------------------------+ [21:06:42] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:06:42] : [Step 4/5] >>> +-------------------------------------------+ [21:06:42] : [Step 4/5] >>> OS name: Linux 4.15.0-151-generic amd64 [21:06:42] : [Step 4/5] >>> CPU(s): 24 [21:06:42] : [Step 4/5] >>> Heap: 2.0GB [21:06:42] : [Step 4/5] >>> VM name: 16724@c4dfe9a430b2 [21:06:42] : [Step 4/5] >>> Ignite instance name: grid-3 [21:06:42] : [Step 4/5] >>> Local node [ID=30DAC517-CF3B-41E2-82BE-81795E246003, order=1, clientMode=false] [21:06:42] : [Step 4/5] >>> Local node addresses: [127.0.0.1] [21:06:42] : [Step 4/5] >>> Local ports: TCP:10800 TCP:45150 TCP:47500 [21:06:42] : [Step 4/5] [21:06:42] : [Step 4/5] [2021-11-19 21:06:42,362][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-3] >>> Ignite cluster is in INACTIVE state (limited functionality available). Use control.(sh|bat) script or IgniteCluster.state(ClusterState.ACTIVE) to change the state. [21:06:42] : [Step 4/5] [2021-11-19 21:06:42,362][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][GridDiscoveryManager] Topology snapshot [ver=1, locNode=30dac517, servers=1, clients=0, state=INACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=30dac517-cf3b-41e2-82be-81795e246003, consistentId=grid-3, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:06:42] : [Step 4/5] [2021-11-19 21:06:42,363][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][GridDiscoveryManager] ^-- Baseline [id=0, size=2, online=1, offline=1] [21:06:42] : [Step 4/5] [2021-11-19 21:06:42,363][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][GridDiscoveryManager] ^-- 1 nodes left for auto-activation [grid-0] [21:06:42] : [Step 4/5] [2021-11-19 21:06:42,363][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][G] Node started : [stage="Configure system pool" (0 ms),stage="Start managers" (203 ms),stage="Configure binary metadata" (1 ms),stage="Start processors" (27 ms),stage="Start 'StanByClusterTestProvider' plugin" (0 ms),stage="Start 'PageMemory tracker plugin' plugin" (0 ms),stage="Start 'TestDistibutedConfigurationPlugin' plugin" (0 ms),stage="Start 'NodeValidationPluginProvider' plugin" (0 ms),stage="Init metastore" (392 ms),stage="Init and start regions" (8 ms),stage="Restore binary memory" (170 ms),stage="Restore logical state" (86 ms),stage="Finish recovery" (1844 ms),stage="Join topology" (8 ms),stage="Await transition" (1 ms),stage="Await exchange" (13 ms),stage="Total time" (2753 ms)] [21:06:42] : [Step 4/5] [2021-11-19 21:06:42,364][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][root] Node started with the following configuration [id=30dac517-cf3b-41e2-82be-81795e246003, marshaller=BinaryMarshaller [], discovery=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=5000, ackTimeout=5000, marsh=JdkMarshaller [clsFilter=org.apache.ignite.marshaller.MarshallerUtils$1@192eb2a1], reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], binaryCfg=null, lateAff=true] [21:06:42] : [Step 4/5] [2021-11-19 21:06:42,366][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][GridClusterStateProcessor] Sending activate cluster request with BaselineTopology BaselineTopology [id=0, branchingHash=-1237657748, branchingType='Cluster activation', baselineNodes=[grid-0, grid-3]] [21:06:42] : [Step 4/5] [2021-11-19 21:06:42,367][INFO ][disco-notifier-worker-#13190%grid-3%][GridClusterStateProcessor] Received activate cluster request with BaselineTopology[id=0] initiator node ID: 30dac517-cf3b-41e2-82be-81795e246003 [21:06:42] : [Step 4/5] [2021-11-19 21:06:42,368][INFO ][disco-notifier-worker-#13190%grid-3%][GridClusterStateProcessor] Started state transition: activate cluster [21:06:42] : [Step 4/5] [2021-11-19 21:06:42,369][INFO ][exchange-worker-#13195%grid-3%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=1, minorTopVer=1], crd=true, evt=DISCOVERY_CUSTOM_EVT, evtNode=30dac517-cf3b-41e2-82be-81795e246003, customEvt=ChangeGlobalStateMessage [id=9374d593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqId=160d3d7a-5638-492f-ba40-d19d83d3db1c, initiatingNodeId=30dac517-cf3b-41e2-82be-81795e246003, state=ACTIVE, baselineTopology=BaselineTopology [id=0, branchingHash=-1237657748, branchingType='Cluster activation', baselineNodes=[grid-0, grid-3]], forceChangeBaselineTopology=false, timestamp=1637345202366, forceDeactivation=true], allowMerge=false, exchangeFreeSwitch=false] [21:06:42] : [Step 4/5] [2021-11-19 21:06:42,369][INFO ][exchange-worker-#13195%grid-3%][GridDhtPartitionsExchangeFuture] Start activation process [nodeId=30dac517-cf3b-41e2-82be-81795e246003, client=false, topVer=AffinityTopologyVersion [topVer=1, minorTopVer=1]]. New state: ACTIVE [21:06:42] : [Step 4/5] [2021-11-19 21:06:42,370][INFO ][exchange-worker-#13195%grid-3%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_3 [21:06:42] : [Step 4/5] [2021-11-19 21:06:42,371][INFO ][exchange-worker-#13195%grid-3%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_3/0000000000000000.wal, offset=110745, ver=2] [21:06:42] : [Step 4/5] [2021-11-19 21:06:42,372][INFO ][exchange-worker-#13195%grid-3%][GridClusterStateProcessor] Writing BaselineTopology[id=0] [21:06:42] : [Step 4/5] [2021-11-19 21:06:42,520][INFO ][exchange-worker-#13195%grid-3%][GridCacheDatabaseSharedManager] Finish recovery performed in 150 ms. [21:06:42] : [Step 4/5] [2021-11-19 21:06:42,521][INFO ][exchange-worker-#13195%grid-3%][msg] Components activation performed in 151 ms. [21:06:42] : [Step 4/5] [2021-11-19 21:06:42,522][INFO ][exchange-worker-#13195%grid-3%][GridCacheProcessor] Finished recovery for cache [cache=ignite-sys-cache, grp=ignite-sys-cache, startVer=AffinityTopologyVersion [topVer=1, minorTopVer=1]] [21:06:42] : [Step 4/5] [2021-11-19 21:06:42,523][INFO ][exchange-worker-#13195%grid-3%][GridDhtPartitionsExchangeFuture] Successfully activated caches [nodeId=30dac517-cf3b-41e2-82be-81795e246003, client=false, topVer=AffinityTopologyVersion [topVer=1, minorTopVer=1], newState=ACTIVE] [21:06:42] : [Step 4/5] [2021-11-19 21:06:42,523][INFO ][exchange-worker-#13195%grid-3%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=1, minorTopVer=1], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:06:42] : [Step 4/5] [2021-11-19 21:06:42,525][INFO ][exchange-worker-#13195%grid-3%][GridDhtPartitionsExchangeFuture] finishExchangeOnCoordinator [topVer=AffinityTopologyVersion [topVer=1, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=1, minorTopVer=1]] [21:06:42] : [Step 4/5] [2021-11-19 21:06:42,529][INFO ][exchange-worker-#13195%grid-3%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=1, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=1, minorTopVer=1], err=null, rebalanced=true, wasRebalanced=false] [21:06:42] : [Step 4/5] [2021-11-19 21:06:42,529][INFO ][disco-notifier-worker-#13190%grid-3%][GridClusterStateProcessor] Received state change finish message: ACTIVE [21:06:42] : [Step 4/5] [2021-11-19 21:06:42,530][INFO ][disco-notifier-worker-#13190%grid-3%][GridClusterStateProcessor] Cluster state was changed from INACTIVE to ACTIVE [21:06:42] : [Step 4/5] [2021-11-19 21:06:42,531][INFO ][exchange-worker-#13195%grid-3%][GridCacheProcessor] Finish proxy initialization, cacheName=ignite-sys-cache, localNodeId=30dac517-cf3b-41e2-82be-81795e246003 [21:06:42] : [Step 4/5] [2021-11-19 21:06:42,531][INFO ][exchange-worker-#13195%grid-3%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=30dac517-cf3b-41e2-82be-81795e246003, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=1, minorTopVer=1], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=30dac517-cf3b-41e2-82be-81795e246003, consistentId=grid-3, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345202332, loc=true, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=1, minorTopVer=1]] [21:06:42] : [Step 4/5] [2021-11-19 21:06:42,532][INFO ][sys-#13174%grid-3%][DistributedBaselineConfiguration] Baseline auto-adjust is 'disabled' with timeout='300000' ms [21:06:42] : [Step 4/5] [2021-11-19 21:06:42,533][INFO ][exchange-worker-#13195%grid-3%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=1, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=1, minorTopVer=1], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (0 ms), stage="Update caches registry" (152 ms), stage="Start caches" (0 ms), stage="Affinity initialization on cache group start" (0 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Restore partition states" (0 ms), stage="After states restored callback" (1 ms), stage="WAL history reservation" (0 ms), stage="Waiting for all single messages" (0 ms), stage="Affinity recalculation (crd)" (0 ms), stage="Collect update counters and create affinity messages" (0 ms), stage="Assign partitions states" (0 ms), stage="Validate partitions states" (0 ms), stage="Ideal affinity diff calculation (enforced)" (0 ms), stage="Apply update counters" (0 ms), stage="Full message preparing" (1 ms), stage="Full message sending" (0 ms), stage="State finish message sending" (0 ms), stage="Detect lost partitions" (1 ms), stage="Exchange done" (2 ms), stage="Total time" (157 ms)] [21:06:42] : [Step 4/5] [2021-11-19 21:06:42,535][INFO ][exchange-worker-#13195%grid-3%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=1, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=1, minorTopVer=1], stage="Affinity initialization on cache group start [grp=ignite-sys-cache]" (0 ms) (parent=Affinity initialization on cache group start), stage="Affinity centralized initialization (crd) [grp=ignite-sys-cache, crd=true]" (0 ms) (parent=Determine exchange type), stage="Restore partition states [grp=ignite-sys-cache]" (0 ms) (parent=Restore partition states), stage="Affinity recalculation (partitions availability) [grp=ignite-sys-cache]" (0 ms) (parent=Ideal affinity diff calculation (enforced))] [21:06:42] : [Step 4/5] [2021-11-19 21:06:42,533][INFO ][sys-#13174%grid-3%][GridClusterStateProcessor] Successfully performed final activation steps [nodeId=30dac517-cf3b-41e2-82be-81795e246003, client=false, topVer=AffinityTopologyVersion [topVer=1, minorTopVer=1]] [21:06:42] : [Step 4/5] [2021-11-19 21:06:42,537][INFO ][exchange-worker-#13195%grid-3%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=1, minorTopVer=1], crd=true] [21:06:42] : [Step 4/5] [2021-11-19 21:06:42,538][INFO ][exchange-worker-#13195%grid-3%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=1, minorTopVer=1], force=false, evt=DISCOVERY_CUSTOM_EVT, node=30dac517-cf3b-41e2-82be-81795e246003] [21:06:43] : [Step 4/5] [2021-11-19 21:06:43,342][INFO ][exchange-worker-#13195%grid-3%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=1, minorTopVer=2], crd=true, evt=DISCOVERY_CUSTOM_EVT, evtNode=30dac517-cf3b-41e2-82be-81795e246003, customEvt=DynamicCacheChangeBatch [id=4474d593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqs=ArrayList [DynamicCacheChangeRequest [cacheName=encrypted, hasCfg=true, nodeId=30dac517-cf3b-41e2-82be-81795e246003, clientStartOnly=false, stop=false, destroy=false, disabledAfterStart=false]], exchangeActions=ExchangeActions [startCaches=[encrypted], stopCaches=null, startGrps=[encrypted], stopGrps=[], resetParts=null, stateChangeRequest=null], startCaches=false], allowMerge=false, exchangeFreeSwitch=false] [21:06:43] : [Step 4/5] [2021-11-19 21:06:43,344][INFO ][exchange-worker-#13195%grid-3%][PageMemoryImpl] Started page memory [memoryAllocated=24.0 MiB, pages=5952, tableSize=474.2 KiB, replacementSize=768 B, checkpointBuffer=10.0 MiB] [21:06:43] : [Step 4/5] [2021-11-19 21:06:43,407][INFO ][exchange-worker-#13195%grid-3%][GridCacheProcessor] Started cache [name=encrypted, id=1613773252, dataRegionName=default, mode=PARTITIONED, atomicity=ATOMIC, backups=0, mvcc=false] [21:06:43] : [Step 4/5] [2021-11-19 21:06:43,408][INFO ][exchange-worker-#13195%grid-3%][GridAffinityAssignmentCache] Local node affinity assignment distribution is not ideal [cache=encrypted, expectedPrimary=1024.00, actualPrimary=496, expectedBackups=0.00, actualBackups=0, warningThreshold=50.00%] [21:06:43]W: [org.apache.ignite:ignite-core] [2021-11-19 21:06:43,409][WARN ][exchange-worker-#13195%grid-3%][CacheAffinitySharedManager] Cache group 'encrypted' brings high overhead for its metainformation in data region 'default'. Metainformation required for its partitions (496 partitions, 4096 bytes per partition, 1 MBs total) will consume more than 15% of data region memory (10 MBs). It may lead to critical errors on the node and cluster instability. Please reduce number of partitions, add more memory to the data region or add more server nodes for this cache group. [21:06:43] : [Step 4/5] [2021-11-19 21:06:43,410][INFO ][exchange-worker-#13195%grid-3%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=1, minorTopVer=2], waitTime=0ms, futInfo=NA, mode=DISTRIBUTED] [21:06:43] : [Step 4/5] [2021-11-19 21:06:43,410][INFO ][exchange-worker-#13195%grid-3%][GridDhtPartitionsExchangeFuture] Finished waiting for partitions release latch: ServerLatch [permits=0, pendingAcks=HashSet [], super=CompletableLatch [id=CompletableLatchUid [id=exchange, topVer=AffinityTopologyVersion [topVer=1, minorTopVer=2]]]] [21:06:43] : [Step 4/5] [2021-11-19 21:06:43,411][INFO ][exchange-worker-#13195%grid-3%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=1, minorTopVer=2], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:06:43] : [Step 4/5] [2021-11-19 21:06:43,439][INFO ][exchange-worker-#13195%grid-3%][GridDhtPartitionsExchangeFuture] finishExchangeOnCoordinator [topVer=AffinityTopologyVersion [topVer=1, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=1, minorTopVer=2]] [21:06:43] : [Step 4/5] [2021-11-19 21:06:43,443][INFO ][exchange-worker-#13195%grid-3%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=1, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=1, minorTopVer=2], err=null, rebalanced=true, wasRebalanced=true] [21:06:43] : [Step 4/5] [2021-11-19 21:06:43,444][INFO ][exchange-worker-#13195%grid-3%][GridCacheProcessor] Finish proxy initialization, cacheName=encrypted, localNodeId=30dac517-cf3b-41e2-82be-81795e246003 [21:06:43] : [Step 4/5] [2021-11-19 21:06:43,445][INFO ][exchange-worker-#13195%grid-3%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=30dac517-cf3b-41e2-82be-81795e246003, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=1, minorTopVer=2], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=30dac517-cf3b-41e2-82be-81795e246003, consistentId=grid-3, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345202332, loc=true, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=1, minorTopVer=2]] [21:06:43] : [Step 4/5] [2021-11-19 21:06:43,446][INFO ][exchange-worker-#13195%grid-3%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=1, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=1, minorTopVer=2], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (1 ms), stage="Update caches registry" (0 ms), stage="Start caches" (63 ms), stage="Affinity initialization on cache group start" (2 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Wait partitions release latch [latch=exchange]" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Restore partition states" (9 ms), stage="After states restored callback" (18 ms), stage="WAL history reservation" (0 ms), stage="Waiting for all single messages" (0 ms), stage="Affinity recalculation (crd)" (0 ms), stage="Collect update counters and create affinity messages" (0 ms), stage="Assign partitions states" (1 ms), stage="Validate partitions states" (0 ms), stage="Apply update counters" (0 ms), stage="Full message preparing" (1 ms), stage="Full message sending" (0 ms), stage="Exchange done" (2 ms), stage="Total time" (97 ms)] [21:06:43] : [Step 4/5] [2021-11-19 21:06:43,447][INFO ][exchange-worker-#13195%grid-3%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=1, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=1, minorTopVer=2], stage="Affinity initialization on cache group start [grp=encrypted]" (1 ms) (parent=Affinity initialization on cache group start), stage="Restore partition states [grp=encrypted]" (9 ms) (parent=Restore partition states), stage="Restore partition states [grp=ignite-sys-cache]" (0 ms) (parent=Restore partition states)] [21:06:43] : [Step 4/5] [2021-11-19 21:06:43,448][INFO ][exchange-worker-#13195%grid-3%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=1, minorTopVer=2], crd=true] [21:06:43]W: [org.apache.ignite:ignite-core] [2021-11-19 21:06:43,449][WARN ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][G] Ignite work directory is not provided, automatically resolved to: /opt/buildagent/work/7bc1c54bc719b67c/work [21:06:43] : [Step 4/5] [2021-11-19 21:06:43,449][INFO ][exchange-worker-#13195%grid-3%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=1, minorTopVer=2], force=false, evt=DISCOVERY_CUSTOM_EVT, node=30dac517-cf3b-41e2-82be-81795e246003] [21:06:43] : [Step 4/5] [2021-11-19 21:06:43,450][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] [21:06:43] : [Step 4/5] [21:06:43] : [Step 4/5] >>> __________ ________________ [21:06:43] : [Step 4/5] >>> / _/ ___/ |/ / _/_ __/ __/ [21:06:43] : [Step 4/5] >>> _/ // (7 7 // / / / / _/ [21:06:43] : [Step 4/5] >>> /___/\___/_/|_/___/ /_/ /___/ [21:06:43] : [Step 4/5] >>> [21:06:43] : [Step 4/5] >>> ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:06:43] : [Step 4/5] >>> 2021 Copyright(C) Apache Software Foundation [21:06:43] : [Step 4/5] >>> [21:06:43] : [Step 4/5] >>> Ignite documentation: http://ignite.apache.org [21:06:43] : [Step 4/5] [21:06:43] : [Step 4/5] [2021-11-19 21:06:43,451][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] Config URL: n/a [21:06:43] : [Step 4/5] [2021-11-19 21:06:43,451][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] IgniteConfiguration [igniteInstanceName=grid-0, pubPoolSize=24, svcPoolSize=24, callbackPoolSize=24, stripedPoolSize=24, sysPoolSize=24, mgmtPoolSize=4, dataStreamerPoolSize=24, utilityCachePoolSize=24, utilityCacheKeepAliveTime=60000, p2pPoolSize=2, qryPoolSize=24, buildIdxPoolSize=4, igniteHome=/opt/buildagent/work/7bc1c54bc719b67c, igniteWorkDir=/opt/buildagent/work/7bc1c54bc719b67c/work, mbeanSrv=com.sun.jmx.mbeanserver.JmxMBeanServer@6fe85038, nodeId=00c7b7f0-2485-4a70-8278-95d8445fe000, marsh=BinaryMarshaller [], marshLocJobs=false, daemon=false, p2pEnabled=true, netTimeout=10000, netCompressionLevel=1, sndRetryDelay=1000, sndRetryCnt=3, metricsHistSize=10000, metricsUpdateFreq=1000, metricsExpTime=9223372036854775807, discoSpi=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=0, ackTimeout=0, marsh=null, reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], segPlc=STOP, segResolveAttempts=2, waitForSegOnStart=true, allResolversPassReq=true, segChkFreq=10000, commSpi=TcpCommunicationSpi [connectGate=org.apache.ignite.spi.communication.tcp.internal.ConnectGateway@1d354eef, ctxInitLatch=java.util.concurrent.CountDownLatch@79f6c600[Count = 1], stopping=false, clientPool=null, nioSrvWrapper=null, stateProvider=null], evtSpi=MemoryEventStorageSpi [expireAgeMs=9223372036854775807, expireCnt=10000, filter=null], colSpi=NoopCollisionSpi [], deploySpi=LocalDeploymentSpi [], indexingSpi=org.apache.ignite.spi.indexing.noop.NoopIndexingSpi@406de67e, addrRslvr=null, encryptionSpi=org.apache.ignite.spi.encryption.keystore.KeystoreEncryptionSpi@3dce78ae, tracingSpi=org.apache.ignite.spi.tracing.NoopTracingSpi@94f36f4, clientMode=false, rebalanceThreadPoolSize=4, rebalanceTimeout=10000, rebalanceBatchesPrefetchCnt=3, rebalanceThrottle=0, rebalanceBatchSize=524288, txCfg=TransactionConfiguration [txSerEnabled=false, dfltIsolation=REPEATABLE_READ, dfltConcurrency=PESSIMISTIC, dfltTxTimeout=0, txTimeoutOnPartitionMapExchange=0, deadlockTimeout=10000, pessimisticTxLogSize=0, pessimisticTxLogLinger=10000, tmLookupClsName=null, txManagerFactory=null, useJtaSync=false], cacheSanityCheckEnabled=true, discoStartupDelay=60000, deployMode=SHARED, p2pMissedCacheSize=100, locHost=127.0.0.1, timeSrvPortBase=31100, timeSrvPortRange=100, failureDetectionTimeout=10000, sysWorkerBlockedTimeout=null, clientFailureDetectionTimeout=10000, metricsLogFreq=0, connectorCfg=null, odbcCfg=null, warmupClos=null, atomicCfg=AtomicConfiguration [seqReserveSize=1000, cacheMode=PARTITIONED, backups=1, aff=null, grpName=null], classLdr=null, sslCtxFactory=null, platformCfg=null, binaryCfg=null, memCfg=null, pstCfg=null, dsCfg=DataStorageConfiguration [sysRegionInitSize=41943040, sysRegionMaxSize=104857600, pageSize=4096, concLvl=0, dfltDataRegConf=DataRegionConfiguration [name=default, maxSize=10485760, initSize=268435456, swapPath=null, pageEvictionMode=DISABLED, pageReplacementMode=CLOCK, evictionThreshold=0.9, emptyPagesPoolSize=100, metricsEnabled=false, metricsSubIntervalCount=5, metricsRateTimeInterval=60000, persistenceEnabled=true, checkpointPageBufSize=0, lazyMemoryAllocation=true, warmUpCfg=null], dataRegions=null, storagePath=null, checkpointFreq=180000, lockWaitTime=10000, checkpointThreads=4, checkpointWriteOrder=SEQUENTIAL, walHistSize=20, maxWalArchiveSize=1073741824, walSegments=10, walSegmentSize=67108864, walPath=db/wal, walArchivePath=db/wal/archive, cdcWalPath=db/wal/cdc, cdcEnabled=false, metricsEnabled=false, walMode=FSYNC, walTlbSize=131072, walBuffSize=0, walFlushFreq=2000, walFsyncDelay=1000, walRecordIterBuffSize=67108864, alwaysWriteFullPages=false, fileIOFactory=org.apache.ignite.internal.processors.cache.persistence.file.AsyncFileIOFactory@3a9230ba, metricsSubIntervalCnt=5, metricsRateTimeInterval=60000, walAutoArchiveAfterInactivity=-1, walForceArchiveTimeout=-1, writeThrottlingEnabled=false, walCompactionEnabled=false, walCompactionLevel=1, checkpointReadLockTimeout=null, walPageCompression=DISABLED, walPageCompressionLevel=null, dfltWarmUpCfg=null, encCfg=org.apache.ignite.configuration.EncryptionConfiguration@26bb7c9b, defragmentationThreadPoolSize=4, minWalArchiveSize=-1], snapshotPath=snapshots, activeOnStart=true, activeOnStartPropSetFlag=false, autoActivation=true, autoActivationPropSetFlag=false, clusterStateOnStart=null, sqlConnCfg=null, cliConnCfg=ClientConnectorConfiguration [host=null, port=10800, portRange=100, sockSndBufSize=0, sockRcvBufSize=0, tcpNoDelay=true, maxOpenCursorsPerConn=128, threadPoolSize=24, selectorCnt=12, idleTimeout=0, handshakeTimeout=10000, jdbcEnabled=true, odbcEnabled=true, thinCliEnabled=true, sslEnabled=false, useIgniteSslCtxFactory=true, sslClientAuth=false, sslCtxFactory=null, thinCliCfg=ThinClientConfiguration [maxActiveTxPerConn=100, maxActiveComputeTasksPerConn=0]], mvccVacuumThreadCnt=2, mvccVacuumFreq=5000, authEnabled=false, failureHnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]], commFailureRslvr=null, sqlCfg=SqlConfiguration [longQryWarnTimeout=3000, dfltQryTimeout=0, sqlQryHistSize=1000, validationEnabled=false], asyncContinuationExecutor=null] [21:06:43] : [Step 4/5] [2021-11-19 21:06:43,458][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] Daemon mode: off [21:06:43] : [Step 4/5] [2021-11-19 21:06:43,458][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] OS: Linux 4.15.0-151-generic amd64 [21:06:43] : [Step 4/5] [2021-11-19 21:06:43,458][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] OS user: teamcity [21:06:43] : [Step 4/5] [2021-11-19 21:06:43,459][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] PID: 16724 [21:06:43] : [Step 4/5] [2021-11-19 21:06:43,459][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] Language runtime: Java Platform API Specification ver. 1.8 [21:06:43] : [Step 4/5] [2021-11-19 21:06:43,459][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] VM information: Java(TM) SE Runtime Environment 1.8.0_261-b12 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 25.261-b12 [21:06:43] : [Step 4/5] [2021-11-19 21:06:43,459][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] VM total memory: 1.9GB [21:06:43] : [Step 4/5] [2021-11-19 21:06:43,460][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] Remote Management [restart: off, REST: off, JMX (remote: off)] [21:06:43] : [Step 4/5] [2021-11-19 21:06:43,460][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] Logger: GridTestLog4jLogger [quiet=false, config=null] [21:06:43] : [Step 4/5] [2021-11-19 21:06:43,460][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] IGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c [21:06:43] : [Step 4/5] [2021-11-19 21:06:43,460][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] VM arguments: [-DIGNITE_DUMP_THREADS_ON_FAILURE=false, -DMono=/usr/bin/mono-sgen, -DMono4.0_x64=/usr/lib/mono/4.0, -DMono4.5_x64=/usr/lib/mono/4.5, -DMonoVersion=6.12.0.90, -DSKIP_BUILD=false, -Dagent.home.dir=/opt/buildagent, -Dagent.name=aitc-lin02_03, -Dagent.ownPort=9090, -Dagent.work.dir=/opt/buildagent/work, -Dbuild.number=95, -Dbuild.vcs.number=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.1=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.GitHubApacheIgnite=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dclassworlds.conf=/opt/buildagent/temp/buildTmp/teamcity.m2.conf, -Dcom.jetbrains.maven.watcher.report.file=/opt/buildagent/temp/buildTmp/maven-build-info.xml, -Djava.io.tmpdir=/opt/buildagent/temp/buildTmp, -Dmaven.home=/opt/buildagent/tools/maven3_6, -Dmaven.multiModuleProjectDirectory=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.agent.cpuBenchmark=457, -Dteamcity.agent.dotnet.agent_url=http://localhost:9090/RPC2, -Dteamcity.agent.dotnet.build_id=6278078, -Dteamcity.auth.password=*******, -Dteamcity.auth.userId=TeamCityBuildId=6278078, -Dteamcity.build.changedFiles.file=/opt/buildagent/temp/buildTmp/changedFiles6342607772318147725.txt, -Dteamcity.build.checkoutDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.build.id=6278078, -Dteamcity.build.properties.file=/opt/buildagent/temp/buildTmp/teamcity.build5164517880467851002.properties, -Dteamcity.build.tempDir=/opt/buildagent/temp/buildTmp, -Dteamcity.build.workingDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.buildConfName=Basic 3, -Dteamcity.buildType.id=IgniteTests24Java8_Basic3, -Dteamcity.configuration.properties.file=/opt/buildagent/temp/buildTmp/teamcity.config5591980786735343870.properties, -Dteamcity.maven.userSettings.path=/opt/buildagent/temp/buildTmp/maven_settings_585072866407032347.xml, -Dteamcity.maven.watcher.home=/opt/buildagent/plugins/mavenPlugin/maven-watcher-jdk16, -Dteamcity.projectName=Ignite Tests 2.x (JDK 8/11), -Dteamcity.runner.properties.file=/opt/buildagent/temp/buildTmp/teamcity.runner9098465561618137420.properties, -Dteamcity.tests.recentlyFailedTests.file=/opt/buildagent/temp/buildTmp/testsToRunFirst3891775683130404069.txt, -Dteamcity.version=2021.2 (build 99542), -ea, -Xms2g, -Xmx2g, -XX:+HeapDumpOnOutOfMemoryError, -DIGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_TEST_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_UPDATE_NOTIFIER=false, -DIGNITE_NO_DISCO_ORDER=true, -DIGNITE_PERFORMANCE_SUGGESTIONS_DISABLED=true, -Djava.net.preferIPv4Stack=true, -DTEST_SCALE_FACTOR=1.0, -DIGNITE_TEST_PROP_LOG4J_FILE=log4j-tc-test.xml, -DIGNITE_QUIET=false, -DIGNITE_MARSHAL_BUFFERS_RECHECK=1000, -Dmaven.repo.local=/opt/buildagent/.m2/repository] [21:06:43] : [Step 4/5] [2021-11-19 21:06:43,464][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] System cache's DataRegion size is configured to 40 MB. Use DataStorageConfiguration.systemRegionInitialSize property to change the setting. [21:06:43] : [Step 4/5] [2021-11-19 21:06:43,464][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] Configured caches [in 'sysMemPlc' dataRegion: ['ignite-sys-cache']] [21:06:43]W: [org.apache.ignite:ignite-core] [2021-11-19 21:06:43,464][WARN ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] Peer class loading is enabled (disable it in production for performance and deployment consistency reasons) [21:06:43] : [Step 4/5] [2021-11-19 21:06:43,465][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] 3-rd party licenses can be found at: /opt/buildagent/work/7bc1c54bc719b67c/libs/licenses [21:06:43] : [Step 4/5] [2021-11-19 21:06:43,469][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] Configured plugins: [21:06:43] : [Step 4/5] [2021-11-19 21:06:43,469][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- StanByClusterTestProvider 1.0 [21:06:43] : [Step 4/5] [2021-11-19 21:06:43,469][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- null [21:06:43] : [Step 4/5] [2021-11-19 21:06:43,469][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] [21:06:43] : [Step 4/5] [2021-11-19 21:06:43,470][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- PageMemory tracker plugin 1.0 [21:06:43] : [Step 4/5] [2021-11-19 21:06:43,470][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- null [21:06:43] : [Step 4/5] [2021-11-19 21:06:43,470][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] [21:06:43] : [Step 4/5] [2021-11-19 21:06:43,470][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- TestDistibutedConfigurationPlugin 1.0 [21:06:43] : [Step 4/5] [2021-11-19 21:06:43,471][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- null [21:06:43] : [Step 4/5] [2021-11-19 21:06:43,471][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] [21:06:43] : [Step 4/5] [2021-11-19 21:06:43,471][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- NodeValidationPluginProvider 1.0 [21:06:43] : [Step 4/5] [2021-11-19 21:06:43,471][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- null [21:06:43] : [Step 4/5] [2021-11-19 21:06:43,472][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] [21:06:43] : [Step 4/5] [2021-11-19 21:06:43,472][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][FailureProcessor] Configured failure handler: [hnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]]] [21:06:43]W: [org.apache.ignite:ignite-core] [2021-11-19 21:06:43,498][WARN ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][TcpCommunicationSpi] Message queue limit is set to 0 which may lead to potential OOMEs when running cache operations in FULL_ASYNC or PRIMARY_SYNC modes due to message queues growth on sender and receiver sides. [21:06:43] : [Step 4/5] [2021-11-19 21:06:43,498][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][TcpCommunicationSpi] Successfully bound communication NIO server to TCP port [port=45151, locHost=/127.0.0.1, selectorsCnt=12, selectorSpins=0, pairedConn=false] [21:06:43] : [Step 4/5] [2021-11-19 21:06:43,502][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][GridCollisionManager] Collision resolution is disabled (all jobs will be activated upon arrival). [21:06:43] : [Step 4/5] [2021-11-19 21:06:43,502][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] Security status [authentication=off, sandbox=off, tls/ssl=off] [21:06:43] : [Step 4/5] [2021-11-19 21:06:43,560][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:06:43] : [Step 4/5] [2021-11-19 21:06:43,681][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][MaintenanceProcessor] Resolved store directory for node persistent data: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0 [21:06:43] : [Step 4/5] [2021-11-19 21:06:43,683][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][CacheObjectBinaryProcessorImpl] Resolved directory for serialized binary metadata: /opt/buildagent/work/7bc1c54bc719b67c/work/db/binary_meta/grid_0 [21:06:43] : [Step 4/5] [2021-11-19 21:06:43,687][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0 [21:06:43] : [Step 4/5] [2021-11-19 21:06:43,688][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][FileWriteAheadLogManager] Resolved write ahead log work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0 [21:06:43] : [Step 4/5] [2021-11-19 21:06:43,688][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][FileWriteAheadLogManager] Resolved write ahead log archive directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0 [21:06:43] : [Step 4/5] [2021-11-19 21:06:43,690][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000005.wal [21:06:43] : [Step 4/5] [2021-11-19 21:06:43,690][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000006.wal [21:06:43] : [Step 4/5] [2021-11-19 21:06:43,690][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000004.wal [21:06:43] : [Step 4/5] [2021-11-19 21:06:43,691][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000003.wal [21:06:43] : [Step 4/5] [2021-11-19 21:06:43,691][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000002.wal [21:06:43] : [Step 4/5] [2021-11-19 21:06:43,692][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000001.wal [21:06:43] : [Step 4/5] [2021-11-19 21:06:43,696][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Configured data regions initialized successfully [total=5] [21:06:43] : [Step 4/5] [2021-11-19 21:06:43,872][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][IgniteSnapshotManager] Resolved snapshot work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/snapshots [21:06:43] : [Step 4/5] [2021-11-19 21:06:43,872][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][IgniteSnapshotManager] Resolved temp directory for snapshot creation: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0/snp [21:06:43] : [Step 4/5] [2021-11-19 21:06:43,875][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][ClientListenerProcessor] Client connector processor has started on TCP port 10801 [21:06:43] : [Step 4/5] [2021-11-19 21:06:43,878][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] Non-loopback local IPs: 172.17.0.4 [21:06:43] : [Step 4/5] [2021-11-19 21:06:43,879][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] Enabled local MACs: 0242AC110004 [21:06:43] : [Step 4/5] [2021-11-19 21:06:43,880][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=/opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0/cp/1637345198755-0b5bdd5c-3435-45f6-ad87-314ce3943eee-START.bin, endMarker=/opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0/cp/1637345198755-0b5bdd5c-3435-45f6-ad87-314ce3943eee-END.bin] [21:06:43] : [Step 4/5] [2021-11-19 21:06:43,881][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:06:43] : [Step 4/5] [2021-11-19 21:06:43,881][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=193859, len=11985], lastMarked=WALPointer [idx=0, fileOff=193859, len=11985], lastCheckpointId=0b5bdd5c-3435-45f6-ad87-314ce3943eee] [21:06:44] : [Step 4/5] [2021-11-19 21:06:44,025][INFO ][db-checkpoint-thread-#13201%grid-3%][Checkpointer] Checkpoint started [checkpointId=48badc14-8ce9-4516-b719-0a727390d857, startPtr=WALPointer [idx=0, fileOff=193897, len=1963], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=153ms, writeCheckpointEntryDuration=1347ms, splitAndSortCpPagesDuration=0ms, pages=15, reason='node started'] [21:06:44] : [Step 4/5] [2021-11-19 21:06:44,025][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Found last checkpoint marker [cpId=0b5bdd5c-3435-45f6-ad87-314ce3943eee, pos=WALPointer [idx=0, fileOff=193859, len=11985]] [21:06:44] : [Step 4/5] [2021-11-19 21:06:44,034][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Applying lost metastore updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=193859, len=11985], lastCheckpointId=0b5bdd5c-3435-45f6-ad87-314ce3943eee] [21:06:44] : [Step 4/5] [2021-11-19 21:06:44,112][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=81 ms] [21:06:44] : [Step 4/5] [2021-11-19 21:06:44,113][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][GridCacheProcessor] Restoring partition state for local groups. [21:06:44] : [Step 4/5] [2021-11-19 21:06:44,113][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=0, partitionsProcessed=0, time=0ms] [21:06:44] : [Step 4/5] [2021-11-19 21:06:44,278][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][GridClusterStateProcessor] Restoring history for BaselineTopology[id=0] [21:06:44] : [Step 4/5] [2021-11-19 21:06:44,373][INFO ][db-checkpoint-thread-#13201%grid-3%][Checkpointer] Checkpoint finished [cpId=48badc14-8ce9-4516-b719-0a727390d857, pages=15, markPos=WALPointer [idx=0, fileOff=193897, len=1963], walSegmentsCovered=[], markDuration=1501ms, pagesWrite=10ms, fsync=337ms, total=1849ms] [21:06:44] : [Step 4/5] [2021-11-19 21:06:44,374][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][ClusterProcessor] Cluster ID and tag has been read from metastorage: ClusterIdAndTag [id=430fd593-d346-4408-af9b-ca934799bba8, tag=amazing_hermann] [21:06:44] : [Step 4/5] [2021-11-19 21:06:44,375][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][IgniteClusterImpl] Shutdown policy was updated [oldVal=null, newVal=null] [21:06:44] : [Step 4/5] [2021-11-19 21:06:44,376][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustEnabled' was changed from 'null' to 'false' [21:06:44] : [Step 4/5] [2021-11-19 21:06:44,376][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustTimeout' was changed from 'null' to '300000' [21:06:44] : [Step 4/5] [2021-11-19 21:06:44,377][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][IgniteTxManager] Transactions parameter 'txOwnerDumpRequestsAllowed' was changed from 'null' to 'true' [21:06:44] : [Step 4/5] [2021-11-19 21:06:44,377][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][IgniteTxManager] Transactions parameter 'longOperationsDumpTimeout' was changed from 'null' to '60000' [21:06:44] : [Step 4/5] [2021-11-19 21:06:44,378][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpThreshold' was changed from 'null' to '0' [21:06:44] : [Step 4/5] [2021-11-19 21:06:44,378][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][IgniteTxManager] Transactions parameter 'transactionTimeDumpSamplesCoefficient' was changed from 'null' to '0.0' [21:06:44] : [Step 4/5] [2021-11-19 21:06:44,379][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpSamplesPerSecondLimit' was changed from 'null' to '5' [21:06:44] : [Step 4/5] [2021-11-19 21:06:44,379][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][IgniteTxManager] Transactions parameter 'collisionsDumpInterval' was changed from 'null' to '1000' [21:06:44] : [Step 4/5] [2021-11-19 21:06:44,380][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Historical rebalance WAL threshold changed [property=historical.rebalance.threshold, oldVal=null, newVal=500] [21:06:44] : [Step 4/5] [2021-11-19 21:06:44,380][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Checkpoint frequency deviation changed [oldVal=null, newVal=null] [21:06:44] : [Step 4/5] [2021-11-19 21:06:44,425][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][FilePageStoreManager] Cleanup cache stores [total=1, left=0, cleanFiles=false] [21:06:44] : [Step 4/5] [2021-11-19 21:06:44,428][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:06:44] : [Step 4/5] [2021-11-19 21:06:44,430][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:06:44] : [Step 4/5] [2021-11-19 21:06:44,431][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:06:44] : [Step 4/5] [2021-11-19 21:06:44,431][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Data Regions Started: 5 [21:06:44] : [Step 4/5] [2021-11-19 21:06:44,432][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] ^-- sysMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:06:44] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:06:44] : [Step 4/5] ^-- default region [type=default, persistence=true, lazyAlloc=true, [21:06:44] : [Step 4/5] ... initCfg=10MB, maxCfg=10MB, usedRam=0MB, freeRam=100%, allocRam=0MB, allocTotal=0MB] [21:06:44] : [Step 4/5] ^-- metastoreMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:06:44] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:06:44] : [Step 4/5] ^-- TxLog region [type=internal, persistence=true, lazyAlloc=false, [21:06:44] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:06:44] : [Step 4/5] ^-- volatileDsMemPlc region [type=user, persistence=false, lazyAlloc=true, [21:06:44] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB] [21:06:44] : [Step 4/5] ^-- Ignite persistence [used=0MB] [21:06:44] : [Step 4/5] [21:06:44] : [Step 4/5] [2021-11-19 21:06:44,433][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Starting binary memory restore for: [-2100569601, 1613773252] [21:06:44] : [Step 4/5] [2021-11-19 21:06:44,546][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=/opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0/cp/1637345198755-0b5bdd5c-3435-45f6-ad87-314ce3943eee-START.bin, endMarker=/opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0/cp/1637345198755-0b5bdd5c-3435-45f6-ad87-314ce3943eee-END.bin] [21:06:44] : [Step 4/5] [2021-11-19 21:06:44,546][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=193859, len=11985], lastMarked=WALPointer [idx=0, fileOff=193859, len=11985], lastCheckpointId=0b5bdd5c-3435-45f6-ad87-314ce3943eee] [21:06:44] : [Step 4/5] [2021-11-19 21:06:44,691][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Found last checkpoint marker [cpId=0b5bdd5c-3435-45f6-ad87-314ce3943eee, pos=WALPointer [idx=0, fileOff=193859, len=11985]] [21:06:44] : [Step 4/5] [2021-11-19 21:06:44,698][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Binary memory state restored at node startup [restoredPtr=WALPointer [idx=0, fileOff=205844, len=0]] [21:06:44] : [Step 4/5] [2021-11-19 21:06:44,699][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000000.wal, offset=205844, ver=2] [21:06:44] : [Step 4/5] [2021-11-19 21:06:44,703][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][GridCacheProcessor] Started cache in recovery mode [name=ignite-sys-cache, id=-2100569601, dataRegionName=sysMemPlc, mode=REPLICATED, atomicity=TRANSACTIONAL, backups=2147483647, mvcc=false] [21:06:44] : [Step 4/5] [2021-11-19 21:06:44,706][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][PageMemoryImpl] Started page memory [memoryAllocated=24.0 MiB, pages=5952, tableSize=474.2 KiB, replacementSize=768 B, checkpointBuffer=10.0 MiB] [21:06:44] : [Step 4/5] [2021-11-19 21:06:44,713][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][GridCacheProcessor] Started cache in recovery mode [name=encrypted, id=1613773252, dataRegionName=default, mode=PARTITIONED, atomicity=ATOMIC, backups=0, mvcc=false] [21:06:44] : [Step 4/5] [2021-11-19 21:06:44,715][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Binary recovery performed in 282 ms. [21:06:44] : [Step 4/5] [2021-11-19 21:06:44,716][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=/opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0/cp/1637345198755-0b5bdd5c-3435-45f6-ad87-314ce3943eee-START.bin, endMarker=/opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0/cp/1637345198755-0b5bdd5c-3435-45f6-ad87-314ce3943eee-END.bin] [21:06:44] : [Step 4/5] [2021-11-19 21:06:44,716][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Applying lost cache updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=193859, len=11985], lastCheckpointId=0b5bdd5c-3435-45f6-ad87-314ce3943eee] [21:06:44] : [Step 4/5] [2021-11-19 21:06:44,809][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=91 ms] [21:06:44] : [Step 4/5] [2021-11-19 21:06:44,810][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][GridCacheProcessor] Restoring partition state for local groups. [21:06:44] : [Step 4/5] [2021-11-19 21:06:44,882][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=2, partitionsProcessed=1124, time=71ms] [21:06:45] : [Step 4/5] [2021-11-19 21:06:45,746][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][TestTcpDiscoverySpi] Successfully bound to TCP port [port=47501, localHost=localhost/127.0.0.1, locNodeId=00c7b7f0-2485-4a70-8278-95d8445fe000] [21:06:45] : [Step 4/5] [2021-11-19 21:06:45,748][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][GridEncryptionManager] Sending stored group keys to coordinator [grps=1613773252] [21:06:45] : [Step 4/5] [2021-11-19 21:06:45,751][INFO ][tcp-disco-srvr-[:47500]-#687%grid-3%-#13192%grid-3%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=60151] [21:06:45] : [Step 4/5] [2021-11-19 21:06:45,751][INFO ][tcp-disco-srvr-[:47500]-#687%grid-3%-#13192%grid-3%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=60151] [21:06:45] : [Step 4/5] [2021-11-19 21:06:45,752][INFO ][tcp-disco-sock-reader-[]-#693%grid-3%-#13325%grid-3%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:60151, rmtPort=60151] [21:06:45] : [Step 4/5] [2021-11-19 21:06:45,754][INFO ][tcp-disco-sock-reader-[00c7b7f0 127.0.0.1:60151]-#693%grid-3%-#13325%grid-3%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=00c7b7f0-2485-4a70-8278-95d8445fe000, rmtAddr=/127.0.0.1:60151] [21:06:45] : [Step 4/5] [2021-11-19 21:06:45,759][INFO ][tcp-disco-srvr-[:47501]-#692%grid-0%-#13324%grid-0%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=37037] [21:06:45] : [Step 4/5] [2021-11-19 21:06:45,760][INFO ][tcp-disco-srvr-[:47501]-#692%grid-0%-#13324%grid-0%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=37037] [21:06:45] : [Step 4/5] [2021-11-19 21:06:45,760][INFO ][tcp-disco-sock-reader-[]-#694%grid-0%-#13326%grid-0%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:37037, rmtPort=37037] [21:06:45] : [Step 4/5] [2021-11-19 21:06:45,761][INFO ][tcp-disco-sock-reader-[]-#694%grid-0%-#13326%grid-0%][TestTcpDiscoverySpi] Received ping request from the remote node [rmtNodeId=30dac517-cf3b-41e2-82be-81795e246003, rmtAddr=/127.0.0.1:37037, rmtPort=37037] [21:06:45] : [Step 4/5] [2021-11-19 21:06:45,763][INFO ][tcp-disco-sock-reader-[]-#694%grid-0%-#13326%grid-0%][TestTcpDiscoverySpi] Finished writing ping response [rmtNodeId=30dac517-cf3b-41e2-82be-81795e246003, rmtAddr=/127.0.0.1:37037, rmtPort=37037] [21:06:45] : [Step 4/5] [2021-11-19 21:06:45,764][INFO ][tcp-disco-sock-reader-[]-#694%grid-0%-#13326%grid-0%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:37037, rmtPort=37037, rmtNodeId=null] [21:06:45] : [Step 4/5] [2021-11-19 21:06:45,764][INFO ][tcp-disco-sock-reader-[00c7b7f0 127.0.0.1:60151]-#693%grid-3%-#13325%grid-3%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:60151, rmtPort=60151, rmtNodeId=00c7b7f0-2485-4a70-8278-95d8445fe000] [21:06:45]W: [org.apache.ignite:ignite-core] [2021-11-19 21:06:45,768][WARN ][disco-pool-#13327%grid-3%][TestTcpDiscoverySpi] Cache key differs! Node join is rejected. [node=00c7b7f0-2485-4a70-8278-95d8445fe000, grp=1613773252] [21:06:45] : [Step 4/5] [2021-11-19 21:06:45,768][INFO ][tcp-disco-srvr-[:47501]-#692%grid-0%-#13324%grid-0%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=41231] [21:06:45] : [Step 4/5] [2021-11-19 21:06:45,769][INFO ][tcp-disco-srvr-[:47501]-#692%grid-0%-#13324%grid-0%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=41231] [21:06:45] : [Step 4/5] [2021-11-19 21:06:45,770][INFO ][tcp-disco-sock-reader-[]-#695%grid-0%-#13328%grid-0%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:41231, rmtPort=41231] [21:06:45] : [Step 4/5] [2021-11-19 21:06:45,771][INFO ][tcp-disco-sock-reader-[30dac517 127.0.0.1:41231]-#695%grid-0%-#13328%grid-0%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=30dac517-cf3b-41e2-82be-81795e246003, rmtAddr=/127.0.0.1:41231] [21:06:45]W: [org.apache.ignite:ignite-core] [2021-11-19 21:06:45,774][ERROR][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] Failed to start manager: GridManagerAdapter [enabled=true, name=o.a.i.i.managers.discovery.GridDiscoveryManager] [21:06:45]W: [org.apache.ignite:ignite-core] class org.apache.ignite.IgniteCheckedException: Failed to start SPI: TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=5000, ackTimeout=5000, marsh=JdkMarshaller [clsFilter=org.apache.ignite.marshaller.MarshallerUtils$1@74045469], reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false] [21:06:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.managers.GridManagerAdapter.startSpi(GridManagerAdapter.java:281) [21:06:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.managers.discovery.GridDiscoveryManager.start(GridDiscoveryManager.java:1091) [21:06:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.IgniteKernal.startManager(IgniteKernal.java:1953) [21:06:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.IgniteKernal.start(IgniteKernal.java:1300) [21:06:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.IgnitionEx$IgniteNamedInstance.start0(IgnitionEx.java:1798) [21:06:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.IgnitionEx$IgniteNamedInstance.start(IgnitionEx.java:1720) [21:06:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.IgnitionEx.start0(IgnitionEx.java:1159) [21:06:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.IgnitionEx.start(IgnitionEx.java:629) [21:06:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.testframework.junits.GridAbstractTest.startGrid(GridAbstractTest.java:1252) [21:06:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.testframework.junits.GridAbstractTest.startGrid(GridAbstractTest.java:1169) [21:06:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.testframework.junits.GridAbstractTest.startGrid(GridAbstractTest.java:1145) [21:06:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.encryption.EncryptedCacheNodeJoinTest.lambda$testNodeCantJoinWithDifferentCacheKeys$2(EncryptedCacheNodeJoinTest.java:182) [21:06:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.testframework.GridTestUtils$1.call(GridTestUtils.java:616) [21:06:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.testframework.GridTestUtils$1.call(GridTestUtils.java:614) [21:06:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.testframework.GridTestUtils.assertThrowsWithCause(GridTestUtils.java:636) [21:06:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.testframework.GridTestUtils.assertThrowsWithCause(GridTestUtils.java:614) [21:06:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.encryption.EncryptedCacheNodeJoinTest.testNodeCantJoinWithDifferentCacheKeys(EncryptedCacheNodeJoinTest.java:180) [21:06:45]W: [org.apache.ignite:ignite-core] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) [21:06:45]W: [org.apache.ignite:ignite-core] at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) [21:06:45]W: [org.apache.ignite:ignite-core] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [21:06:45]W: [org.apache.ignite:ignite-core] at java.lang.reflect.Method.invoke(Method.java:498) [21:06:45]W: [org.apache.ignite:ignite-core] at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50) [21:06:45]W: [org.apache.ignite:ignite-core] at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) [21:06:45]W: [org.apache.ignite:ignite-core] at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47) [21:06:45]W: [org.apache.ignite:ignite-core] at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) [21:06:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.testframework.junits.GridAbstractTest$7.run(GridAbstractTest.java:2432) [21:06:45]W: [org.apache.ignite:ignite-core] at java.lang.Thread.run(Thread.java:748) [21:06:45]W: [org.apache.ignite:ignite-core] Caused by: class org.apache.ignite.spi.IgniteSpiException: Cache key differs! Node join is rejected. [21:06:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.discovery.tcp.TcpDiscoverySpi.checkFailedError(TcpDiscoverySpi.java:2108) [21:06:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.discovery.tcp.ServerImpl.joinTopology(ServerImpl.java:1206) [21:06:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.discovery.tcp.ServerImpl.spiStart(ServerImpl.java:474) [21:06:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.discovery.tcp.TcpDiscoverySpi.spiStart(TcpDiscoverySpi.java:2210) [21:06:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.managers.GridManagerAdapter.startSpi(GridManagerAdapter.java:278) [21:06:45]W: [org.apache.ignite:ignite-core] ... 26 more [21:06:45] : [Step 4/5] [2021-11-19 21:06:45,774][INFO ][tcp-disco-sock-reader-[30dac517 127.0.0.1:41231]-#695%grid-0%-#13328%grid-0%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:41231, rmtPort=41231, rmtNodeId=30dac517-cf3b-41e2-82be-81795e246003] [21:06:45]W: [org.apache.ignite:ignite-core] [2021-11-19 21:06:45,782][ERROR][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] Got exception while starting (will rollback startup routine). [21:06:45]W: [org.apache.ignite:ignite-core] class org.apache.ignite.IgniteCheckedException: Failed to start manager: GridManagerAdapter [enabled=true, name=org.apache.ignite.internal.managers.discovery.GridDiscoveryManager] [21:06:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.IgniteKernal.startManager(IgniteKernal.java:1958) [21:06:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.IgniteKernal.start(IgniteKernal.java:1300) [21:06:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.IgnitionEx$IgniteNamedInstance.start0(IgnitionEx.java:1798) [21:06:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.IgnitionEx$IgniteNamedInstance.start(IgnitionEx.java:1720) [21:06:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.IgnitionEx.start0(IgnitionEx.java:1159) [21:06:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.IgnitionEx.start(IgnitionEx.java:629) [21:06:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.testframework.junits.GridAbstractTest.startGrid(GridAbstractTest.java:1252) [21:06:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.testframework.junits.GridAbstractTest.startGrid(GridAbstractTest.java:1169) [21:06:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.testframework.junits.GridAbstractTest.startGrid(GridAbstractTest.java:1145) [21:06:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.encryption.EncryptedCacheNodeJoinTest.lambda$testNodeCantJoinWithDifferentCacheKeys$2(EncryptedCacheNodeJoinTest.java:182) [21:06:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.testframework.GridTestUtils$1.call(GridTestUtils.java:616) [21:06:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.testframework.GridTestUtils$1.call(GridTestUtils.java:614) [21:06:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.testframework.GridTestUtils.assertThrowsWithCause(GridTestUtils.java:636) [21:06:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.testframework.GridTestUtils.assertThrowsWithCause(GridTestUtils.java:614) [21:06:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.encryption.EncryptedCacheNodeJoinTest.testNodeCantJoinWithDifferentCacheKeys(EncryptedCacheNodeJoinTest.java:180) [21:06:45]W: [org.apache.ignite:ignite-core] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) [21:06:45]W: [org.apache.ignite:ignite-core] at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) [21:06:45]W: [org.apache.ignite:ignite-core] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [21:06:45]W: [org.apache.ignite:ignite-core] at java.lang.reflect.Method.invoke(Method.java:498) [21:06:45]W: [org.apache.ignite:ignite-core] at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50) [21:06:45]W: [org.apache.ignite:ignite-core] at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) [21:06:45]W: [org.apache.ignite:ignite-core] at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47) [21:06:45]W: [org.apache.ignite:ignite-core] at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) [21:06:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.testframework.junits.GridAbstractTest$7.run(GridAbstractTest.java:2432) [21:06:45]W: [org.apache.ignite:ignite-core] at java.lang.Thread.run(Thread.java:748) [21:06:45]W: [org.apache.ignite:ignite-core] Caused by: class org.apache.ignite.IgniteCheckedException: Failed to start SPI: TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=5000, ackTimeout=5000, marsh=JdkMarshaller [clsFilter=org.apache.ignite.marshaller.MarshallerUtils$1@74045469], reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false] [21:06:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.managers.GridManagerAdapter.startSpi(GridManagerAdapter.java:281) [21:06:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.managers.discovery.GridDiscoveryManager.start(GridDiscoveryManager.java:1091) [21:06:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.IgniteKernal.startManager(IgniteKernal.java:1953) [21:06:45]W: [org.apache.ignite:ignite-core] ... 24 more [21:06:45]W: [org.apache.ignite:ignite-core] Caused by: class org.apache.ignite.spi.IgniteSpiException: Cache key differs! Node join is rejected. [21:06:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.discovery.tcp.TcpDiscoverySpi.checkFailedError(TcpDiscoverySpi.java:2108) [21:06:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.discovery.tcp.ServerImpl.joinTopology(ServerImpl.java:1206) [21:06:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.discovery.tcp.ServerImpl.spiStart(ServerImpl.java:474) [21:06:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.discovery.tcp.TcpDiscoverySpi.spiStart(TcpDiscoverySpi.java:2210) [21:06:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.managers.GridManagerAdapter.startSpi(GridManagerAdapter.java:278) [21:06:45]W: [org.apache.ignite:ignite-core] ... 26 more [21:06:50] : [Step 4/5] [2021-11-19 21:06:50,792][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][TestTcpDiscoverySpi] No verification for local node leave has been received from coordinator (will stop node anyway). [21:06:50] : [Step 4/5] [2021-11-19 21:06:50,795][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][GridCacheProcessor] Stopped cache [cacheName=encrypted] [21:06:50] : [Step 4/5] [2021-11-19 21:06:50,797][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][GridCacheProcessor] Stopped cache [cacheName=ignite-sys-cache] [21:06:50] : [Step 4/5] [2021-11-19 21:06:50,818][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][FilePageStoreManager] Cleanup cache stores [total=4, left=0, cleanFiles=false] [21:06:50] : [Step 4/5] [2021-11-19 21:06:50,832][INFO ][test-runner-#12811%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] [21:06:50] : [Step 4/5] [21:06:50] : [Step 4/5] >>> +------------------------------------------------------+ [21:06:50] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV stopped OK [21:06:50] : [Step 4/5] >>> +------------------------------------------------------+ [21:06:50] : [Step 4/5] >>> Ignite instance name: grid-0 [21:06:50] : [Step 4/5] >>> Grid uptime: 00:00:07.385 [21:06:50] : [Step 4/5] [21:06:50] : [Step 4/5] [21:06:50] : [Step 4/5] [21:06:50] >>> Stopping test: EncryptedCacheNodeJoinTest#testNodeCantJoinWithDifferentCacheKeys in 20242 ms <<< [21:06:50] : [Step 4/5] [2021-11-19 21:06:50,833][INFO ][main][root] >>> Stopping test: EncryptedCacheNodeJoinTest#testNodeCantJoinWithDifferentCacheKeys in 20242 ms <<< [21:06:50] : [Step 4/5] [21:06:50] >>> Heap: 625 MB used / 1899 MB commited / 1899 MB max <<< [21:06:50] : [Step 4/5] [2021-11-19 21:06:50,834][INFO ][main][root] >>> Heap: 625 MB used / 1899 MB commited / 1899 MB max <<< [21:06:50] : [Step 4/5] [21:06:50] >>> Non-Heap: 148 MB used / 162 MB commited / 0 MB max <<< [21:06:50] : [Step 4/5] [2021-11-19 21:06:50,834][INFO ][main][root] >>> Non-Heap: 148 MB used / 162 MB commited / 0 MB max <<< [21:06:50] : [Step 4/5] [2021-11-19 21:06:50,834][INFO ][main][root] >>> Stopping grid [name=grid-3, id=30dac517-cf3b-41e2-82be-81795e246003] [21:06:51] : [Step 4/5] [2021-11-19 21:06:51,017][INFO ][db-checkpoint-thread-#13201%grid-3%][Checkpointer] Checkpoint started [checkpointId=7a97f1a8-ffc7-43aa-8527-92af91302db1, startPtr=WALPointer [idx=0, fileOff=304324, len=11377], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=1ms, checkpointLockHoldTime=4ms, walCpRecordFsyncDuration=60ms, writeCheckpointEntryDuration=112ms, splitAndSortCpPagesDuration=0ms, pages=11, reason='timeout'] [21:06:51] : [Step 4/5] [2021-11-19 21:06:51,022][INFO ][main][GridCacheProcessor] Stopped cache [cacheName=ignite-sys-cache] [21:06:51] : [Step 4/5] [2021-11-19 21:06:51,023][INFO ][main][GridCacheProcessor] Stopped cache [cacheName=encrypted] [21:06:51] : [Step 4/5] [2021-11-19 21:06:51,040][INFO ][main][FilePageStoreManager] Cleanup cache stores [total=4, left=0, cleanFiles=false] [21:06:51] : [Step 4/5] [2021-11-19 21:06:51,054][INFO ][main][IgniteKernal%grid-3] [21:06:51] : [Step 4/5] [21:06:51] : [Step 4/5] >>> +------------------------------------------------------+ [21:06:51] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV stopped OK [21:06:51] : [Step 4/5] >>> +------------------------------------------------------+ [21:06:51] : [Step 4/5] >>> Ignite instance name: grid-3 [21:06:51] : [Step 4/5] >>> Grid uptime: 00:00:08.696 [21:06:51] : [Step 4/5] [21:06:51] : [Step 4/5] [21:06:51] : [Step 4/5] [21:06:51] >>> Starting test: EncryptedCacheNodeJoinTest#testServerNodeJoinInactiveClusterWithNewStaticCacheConfig <<< [21:06:51] : [Step 4/5] [2021-11-19 21:06:51,335][INFO ][main][root] >>> Starting test: EncryptedCacheNodeJoinTest#testServerNodeJoinInactiveClusterWithNewStaticCacheConfig <<< [21:06:51] : [Step 4/5] [21:06:51] >>> Heap: 627 MB used / 1899 MB commited / 1899 MB max <<< [21:06:51] : [Step 4/5] [2021-11-19 21:06:51,335][INFO ][main][root] >>> Heap: 627 MB used / 1899 MB commited / 1899 MB max <<< [21:06:51] : [Step 4/5] [21:06:51] >>> Non-Heap: 148 MB used / 162 MB commited / 0 MB max <<< [21:06:51] : [Step 4/5] [2021-11-19 21:06:51,336][INFO ][main][root] >>> Non-Heap: 148 MB used / 162 MB commited / 0 MB max <<< [21:06:51]W: [org.apache.ignite:ignite-core] [2021-11-19 21:06:51,341][WARN ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][G] Ignite work directory is not provided, automatically resolved to: /opt/buildagent/work/7bc1c54bc719b67c/work [21:06:51] : [Step 4/5] [2021-11-19 21:06:51,343][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] [21:06:51] : [Step 4/5] [21:06:51] : [Step 4/5] >>> __________ ________________ [21:06:51] : [Step 4/5] >>> / _/ ___/ |/ / _/_ __/ __/ [21:06:51] : [Step 4/5] >>> _/ // (7 7 // / / / / _/ [21:06:51] : [Step 4/5] >>> /___/\___/_/|_/___/ /_/ /___/ [21:06:51] : [Step 4/5] >>> [21:06:51] : [Step 4/5] >>> ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:06:51] : [Step 4/5] >>> 2021 Copyright(C) Apache Software Foundation [21:06:51] : [Step 4/5] >>> [21:06:51] : [Step 4/5] >>> Ignite documentation: http://ignite.apache.org [21:06:51] : [Step 4/5] [21:06:51] : [Step 4/5] [2021-11-19 21:06:51,345][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] Config URL: n/a [21:06:51] : [Step 4/5] [2021-11-19 21:06:51,345][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] IgniteConfiguration [igniteInstanceName=grid-0, pubPoolSize=24, svcPoolSize=24, callbackPoolSize=24, stripedPoolSize=24, sysPoolSize=24, mgmtPoolSize=4, dataStreamerPoolSize=24, utilityCachePoolSize=24, utilityCacheKeepAliveTime=60000, p2pPoolSize=2, qryPoolSize=24, buildIdxPoolSize=4, igniteHome=/opt/buildagent/work/7bc1c54bc719b67c, igniteWorkDir=/opt/buildagent/work/7bc1c54bc719b67c/work, mbeanSrv=com.sun.jmx.mbeanserver.JmxMBeanServer@6fe85038, nodeId=009e0037-2e63-4a08-910c-f40b550ad000, marsh=BinaryMarshaller [], marshLocJobs=false, daemon=false, p2pEnabled=true, netTimeout=10000, netCompressionLevel=1, sndRetryDelay=1000, sndRetryCnt=3, metricsHistSize=10000, metricsUpdateFreq=1000, metricsExpTime=9223372036854775807, discoSpi=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=0, ackTimeout=0, marsh=null, reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], segPlc=STOP, segResolveAttempts=2, waitForSegOnStart=true, allResolversPassReq=true, segChkFreq=10000, commSpi=TcpCommunicationSpi [connectGate=org.apache.ignite.spi.communication.tcp.internal.ConnectGateway@2e4f3d7e, ctxInitLatch=java.util.concurrent.CountDownLatch@45b66c39[Count = 1], stopping=false, clientPool=null, nioSrvWrapper=null, stateProvider=null], evtSpi=MemoryEventStorageSpi [expireAgeMs=9223372036854775807, expireCnt=10000, filter=null], colSpi=NoopCollisionSpi [], deploySpi=LocalDeploymentSpi [], indexingSpi=org.apache.ignite.spi.indexing.noop.NoopIndexingSpi@3ba30ac8, addrRslvr=null, encryptionSpi=org.apache.ignite.spi.encryption.keystore.KeystoreEncryptionSpi@3bdd51b5, tracingSpi=org.apache.ignite.spi.tracing.NoopTracingSpi@29eebd8c, clientMode=false, rebalanceThreadPoolSize=4, rebalanceTimeout=10000, rebalanceBatchesPrefetchCnt=3, rebalanceThrottle=0, rebalanceBatchSize=524288, txCfg=TransactionConfiguration [txSerEnabled=false, dfltIsolation=REPEATABLE_READ, dfltConcurrency=PESSIMISTIC, dfltTxTimeout=0, txTimeoutOnPartitionMapExchange=0, deadlockTimeout=10000, pessimisticTxLogSize=0, pessimisticTxLogLinger=10000, tmLookupClsName=null, txManagerFactory=null, useJtaSync=false], cacheSanityCheckEnabled=true, discoStartupDelay=60000, deployMode=SHARED, p2pMissedCacheSize=100, locHost=127.0.0.1, timeSrvPortBase=31100, timeSrvPortRange=100, failureDetectionTimeout=10000, sysWorkerBlockedTimeout=null, clientFailureDetectionTimeout=10000, metricsLogFreq=0, connectorCfg=null, odbcCfg=null, warmupClos=null, atomicCfg=AtomicConfiguration [seqReserveSize=1000, cacheMode=PARTITIONED, backups=1, aff=null, grpName=null], classLdr=null, sslCtxFactory=null, platformCfg=null, binaryCfg=null, memCfg=null, pstCfg=null, dsCfg=DataStorageConfiguration [sysRegionInitSize=41943040, sysRegionMaxSize=104857600, pageSize=4096, concLvl=0, dfltDataRegConf=DataRegionConfiguration [name=default, maxSize=10485760, initSize=268435456, swapPath=null, pageEvictionMode=DISABLED, pageReplacementMode=CLOCK, evictionThreshold=0.9, emptyPagesPoolSize=100, metricsEnabled=false, metricsSubIntervalCount=5, metricsRateTimeInterval=60000, persistenceEnabled=true, checkpointPageBufSize=0, lazyMemoryAllocation=true, warmUpCfg=null], dataRegions=null, storagePath=null, checkpointFreq=180000, lockWaitTime=10000, checkpointThreads=4, checkpointWriteOrder=SEQUENTIAL, walHistSize=20, maxWalArchiveSize=1073741824, walSegments=10, walSegmentSize=67108864, walPath=db/wal, walArchivePath=db/wal/archive, cdcWalPath=db/wal/cdc, cdcEnabled=false, metricsEnabled=false, walMode=FSYNC, walTlbSize=131072, walBuffSize=0, walFlushFreq=2000, walFsyncDelay=1000, walRecordIterBuffSize=67108864, alwaysWriteFullPages=false, fileIOFactory=org.apache.ignite.internal.processors.cache.persistence.file.AsyncFileIOFactory@593e9ec9, metricsSubIntervalCnt=5, metricsRateTimeInterval=60000, walAutoArchiveAfterInactivity=-1, walForceArchiveTimeout=-1, writeThrottlingEnabled=false, walCompactionEnabled=false, walCompactionLevel=1, checkpointReadLockTimeout=null, walPageCompression=DISABLED, walPageCompressionLevel=null, dfltWarmUpCfg=null, encCfg=org.apache.ignite.configuration.EncryptionConfiguration@657cfb3b, defragmentationThreadPoolSize=4, minWalArchiveSize=-1], snapshotPath=snapshots, activeOnStart=true, activeOnStartPropSetFlag=false, autoActivation=true, autoActivationPropSetFlag=false, clusterStateOnStart=null, sqlConnCfg=null, cliConnCfg=ClientConnectorConfiguration [host=null, port=10800, portRange=100, sockSndBufSize=0, sockRcvBufSize=0, tcpNoDelay=true, maxOpenCursorsPerConn=128, threadPoolSize=24, selectorCnt=12, idleTimeout=0, handshakeTimeout=10000, jdbcEnabled=true, odbcEnabled=true, thinCliEnabled=true, sslEnabled=false, useIgniteSslCtxFactory=true, sslClientAuth=false, sslCtxFactory=null, thinCliCfg=ThinClientConfiguration [maxActiveTxPerConn=100, maxActiveComputeTasksPerConn=0]], mvccVacuumThreadCnt=2, mvccVacuumFreq=5000, authEnabled=false, failureHnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]], commFailureRslvr=null, sqlCfg=SqlConfiguration [longQryWarnTimeout=3000, dfltQryTimeout=0, sqlQryHistSize=1000, validationEnabled=false], asyncContinuationExecutor=null] [21:06:51] : [Step 4/5] [2021-11-19 21:06:51,355][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] Daemon mode: off [21:06:51] : [Step 4/5] [2021-11-19 21:06:51,356][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] OS: Linux 4.15.0-151-generic amd64 [21:06:51] : [Step 4/5] [2021-11-19 21:06:51,356][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] OS user: teamcity [21:06:51] : [Step 4/5] [2021-11-19 21:06:51,356][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] PID: 16724 [21:06:51] : [Step 4/5] [2021-11-19 21:06:51,357][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] Language runtime: Java Platform API Specification ver. 1.8 [21:06:51] : [Step 4/5] [2021-11-19 21:06:51,357][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] VM information: Java(TM) SE Runtime Environment 1.8.0_261-b12 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 25.261-b12 [21:06:51] : [Step 4/5] [2021-11-19 21:06:51,358][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] VM total memory: 1.9GB [21:06:51] : [Step 4/5] [2021-11-19 21:06:51,358][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] Remote Management [restart: off, REST: off, JMX (remote: off)] [21:06:51] : [Step 4/5] [2021-11-19 21:06:51,358][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] Logger: GridTestLog4jLogger [quiet=false, config=null] [21:06:51] : [Step 4/5] [2021-11-19 21:06:51,359][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] IGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c [21:06:51] : [Step 4/5] [2021-11-19 21:06:51,359][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] VM arguments: [-DIGNITE_DUMP_THREADS_ON_FAILURE=false, -DMono=/usr/bin/mono-sgen, -DMono4.0_x64=/usr/lib/mono/4.0, -DMono4.5_x64=/usr/lib/mono/4.5, -DMonoVersion=6.12.0.90, -DSKIP_BUILD=false, -Dagent.home.dir=/opt/buildagent, -Dagent.name=aitc-lin02_03, -Dagent.ownPort=9090, -Dagent.work.dir=/opt/buildagent/work, -Dbuild.number=95, -Dbuild.vcs.number=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.1=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.GitHubApacheIgnite=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dclassworlds.conf=/opt/buildagent/temp/buildTmp/teamcity.m2.conf, -Dcom.jetbrains.maven.watcher.report.file=/opt/buildagent/temp/buildTmp/maven-build-info.xml, -Djava.io.tmpdir=/opt/buildagent/temp/buildTmp, -Dmaven.home=/opt/buildagent/tools/maven3_6, -Dmaven.multiModuleProjectDirectory=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.agent.cpuBenchmark=457, -Dteamcity.agent.dotnet.agent_url=http://localhost:9090/RPC2, -Dteamcity.agent.dotnet.build_id=6278078, -Dteamcity.auth.password=*******, -Dteamcity.auth.userId=TeamCityBuildId=6278078, -Dteamcity.build.changedFiles.file=/opt/buildagent/temp/buildTmp/changedFiles6342607772318147725.txt, -Dteamcity.build.checkoutDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.build.id=6278078, -Dteamcity.build.properties.file=/opt/buildagent/temp/buildTmp/teamcity.build5164517880467851002.properties, -Dteamcity.build.tempDir=/opt/buildagent/temp/buildTmp, -Dteamcity.build.workingDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.buildConfName=Basic 3, -Dteamcity.buildType.id=IgniteTests24Java8_Basic3, -Dteamcity.configuration.properties.file=/opt/buildagent/temp/buildTmp/teamcity.config5591980786735343870.properties, -Dteamcity.maven.userSettings.path=/opt/buildagent/temp/buildTmp/maven_settings_585072866407032347.xml, -Dteamcity.maven.watcher.home=/opt/buildagent/plugins/mavenPlugin/maven-watcher-jdk16, -Dteamcity.projectName=Ignite Tests 2.x (JDK 8/11), -Dteamcity.runner.properties.file=/opt/buildagent/temp/buildTmp/teamcity.runner9098465561618137420.properties, -Dteamcity.tests.recentlyFailedTests.file=/opt/buildagent/temp/buildTmp/testsToRunFirst3891775683130404069.txt, -Dteamcity.version=2021.2 (build 99542), -ea, -Xms2g, -Xmx2g, -XX:+HeapDumpOnOutOfMemoryError, -DIGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_TEST_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_UPDATE_NOTIFIER=false, -DIGNITE_NO_DISCO_ORDER=true, -DIGNITE_PERFORMANCE_SUGGESTIONS_DISABLED=true, -Djava.net.preferIPv4Stack=true, -DTEST_SCALE_FACTOR=1.0, -DIGNITE_TEST_PROP_LOG4J_FILE=log4j-tc-test.xml, -DIGNITE_QUIET=false, -DIGNITE_MARSHAL_BUFFERS_RECHECK=1000, -Dmaven.repo.local=/opt/buildagent/.m2/repository] [21:06:51] : [Step 4/5] [2021-11-19 21:06:51,365][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] System cache's DataRegion size is configured to 40 MB. Use DataStorageConfiguration.systemRegionInitialSize property to change the setting. [21:06:51] : [Step 4/5] [2021-11-19 21:06:51,366][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] Configured caches [in 'sysMemPlc' dataRegion: ['ignite-sys-cache']] [21:06:51]W: [org.apache.ignite:ignite-core] [2021-11-19 21:06:51,366][WARN ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] Peer class loading is enabled (disable it in production for performance and deployment consistency reasons) [21:06:51] : [Step 4/5] [2021-11-19 21:06:51,366][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] 3-rd party licenses can be found at: /opt/buildagent/work/7bc1c54bc719b67c/libs/licenses [21:06:51] : [Step 4/5] [2021-11-19 21:06:51,372][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] Configured plugins: [21:06:51] : [Step 4/5] [2021-11-19 21:06:51,373][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- StanByClusterTestProvider 1.0 [21:06:51] : [Step 4/5] [2021-11-19 21:06:51,373][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- null [21:06:51] : [Step 4/5] [2021-11-19 21:06:51,373][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] [21:06:51] : [Step 4/5] [2021-11-19 21:06:51,374][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- PageMemory tracker plugin 1.0 [21:06:51] : [Step 4/5] [2021-11-19 21:06:51,374][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- null [21:06:51] : [Step 4/5] [2021-11-19 21:06:51,374][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] [21:06:51] : [Step 4/5] [2021-11-19 21:06:51,374][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- TestDistibutedConfigurationPlugin 1.0 [21:06:51] : [Step 4/5] [2021-11-19 21:06:51,375][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- null [21:06:51] : [Step 4/5] [2021-11-19 21:06:51,375][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] [21:06:51] : [Step 4/5] [2021-11-19 21:06:51,375][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- NodeValidationPluginProvider 1.0 [21:06:51] : [Step 4/5] [2021-11-19 21:06:51,376][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- null [21:06:51] : [Step 4/5] [2021-11-19 21:06:51,376][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] [21:06:51] : [Step 4/5] [2021-11-19 21:06:51,376][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][FailureProcessor] Configured failure handler: [hnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]]] [21:06:51] : [Step 4/5] [2021-11-19 21:06:51,424][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][TcpCommunicationSpi] Successfully bound communication NIO server to TCP port [port=45150, locHost=/127.0.0.1, selectorsCnt=12, selectorSpins=0, pairedConn=false] [21:06:51]W: [org.apache.ignite:ignite-core] [2021-11-19 21:06:51,425][WARN ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][TcpCommunicationSpi] Message queue limit is set to 0 which may lead to potential OOMEs when running cache operations in FULL_ASYNC or PRIMARY_SYNC modes due to message queues growth on sender and receiver sides. [21:06:51] : [Step 4/5] [2021-11-19 21:06:51,437][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][GridCollisionManager] Collision resolution is disabled (all jobs will be activated upon arrival). [21:06:51] : [Step 4/5] [2021-11-19 21:06:51,438][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] Security status [authentication=off, sandbox=off, tls/ssl=off] [21:06:51] : [Step 4/5] [2021-11-19 21:06:51,508][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:06:51] : [Step 4/5] [2021-11-19 21:06:51,598][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][MaintenanceProcessor] Resolved store directory for node persistent data: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0 [21:06:51] : [Step 4/5] [2021-11-19 21:06:51,600][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][CacheObjectBinaryProcessorImpl] Resolved directory for serialized binary metadata: /opt/buildagent/work/7bc1c54bc719b67c/work/db/binary_meta/grid_0 [21:06:51] : [Step 4/5] [2021-11-19 21:06:51,606][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0 [21:06:51] : [Step 4/5] [2021-11-19 21:06:51,607][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][FileWriteAheadLogManager] Resolved write ahead log work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0 [21:06:51] : [Step 4/5] [2021-11-19 21:06:51,607][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][FileWriteAheadLogManager] Resolved write ahead log archive directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0 [21:06:52] : [Step 4/5] [2021-11-19 21:06:52,059][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000000.wal [21:06:52]W: [org.apache.ignite:ignite-core] [2021-11-19 21:06:52,059][WARN ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] DataRegion maxSize=10.5 MB is smaller than defaultInitialSize=268.4 MB, setting initialSize to 10.5 MB [21:06:52] : [Step 4/5] [2021-11-19 21:06:52,066][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Configured data regions initialized successfully [total=5] [21:06:52] : [Step 4/5] [2021-11-19 21:06:52,068][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][IgniteSnapshotManager] Resolved snapshot work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/snapshots [21:06:52] : [Step 4/5] [2021-11-19 21:06:52,069][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][IgniteSnapshotManager] Resolved temp directory for snapshot creation: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0/snp [21:06:52] : [Step 4/5] [2021-11-19 21:06:52,071][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][ClientListenerProcessor] Client connector processor has started on TCP port 10800 [21:06:52] : [Step 4/5] [2021-11-19 21:06:52,074][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] Non-loopback local IPs: 172.17.0.4 [21:06:52] : [Step 4/5] [2021-11-19 21:06:52,074][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] Enabled local MACs: 0242AC110004 [21:06:52] : [Step 4/5] [2021-11-19 21:06:52,075][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:06:52] : [Step 4/5] [2021-11-19 21:06:52,076][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:06:52] : [Step 4/5] [2021-11-19 21:06:52,076][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:06:52] : [Step 4/5] [2021-11-19 21:06:52,081][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Applying lost metastore updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:06:52] : [Step 4/5] [2021-11-19 21:06:52,084][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=0 ms] [21:06:52] : [Step 4/5] [2021-11-19 21:06:52,084][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][GridCacheProcessor] Restoring partition state for local groups. [21:06:52] : [Step 4/5] [2021-11-19 21:06:52,085][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=0, partitionsProcessed=0, time=0ms] [21:06:52] : [Step 4/5] [2021-11-19 21:06:52,085][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][GridEncryptionManager] Encryption keys loaded from metastore. [grps=, masterKeyName=ignite.master.key] [21:06:52] : [Step 4/5] [2021-11-19 21:06:52,087][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][ClusterProcessor] Cluster ID and tag has been read from metastorage: null [21:06:52] : [Step 4/5] [2021-11-19 21:06:52,087][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][IgniteClusterImpl] Shutdown policy was updated [oldVal=null, newVal=null] [21:06:52] : [Step 4/5] [2021-11-19 21:06:52,088][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Checkpoint frequency deviation changed [oldVal=null, newVal=null] [21:06:52] : [Step 4/5] [2021-11-19 21:06:52,098][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][FilePageStoreManager] Cleanup cache stores [total=1, left=0, cleanFiles=false] [21:06:52] : [Step 4/5] [2021-11-19 21:06:52,101][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:06:52] : [Step 4/5] [2021-11-19 21:06:52,103][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:06:52] : [Step 4/5] [2021-11-19 21:06:52,104][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:06:52] : [Step 4/5] [2021-11-19 21:06:52,105][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Data Regions Started: 5 [21:06:52] : [Step 4/5] [2021-11-19 21:06:52,106][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] ^-- sysMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:06:52] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:06:52] : [Step 4/5] ^-- default region [type=default, persistence=true, lazyAlloc=true, [21:06:52] : [Step 4/5] ... initCfg=10MB, maxCfg=10MB, usedRam=0MB, freeRam=100%, allocRam=0MB, allocTotal=0MB] [21:06:52] : [Step 4/5] ^-- metastoreMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:06:52] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:06:52] : [Step 4/5] ^-- TxLog region [type=internal, persistence=true, lazyAlloc=false, [21:06:52] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:06:52] : [Step 4/5] ^-- volatileDsMemPlc region [type=user, persistence=false, lazyAlloc=true, [21:06:52] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB] [21:06:52] : [Step 4/5] ^-- Ignite persistence [used=0MB] [21:06:52] : [Step 4/5] [21:06:52] : [Step 4/5] [2021-11-19 21:06:52,107][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Starting binary memory restore for: [-2100569601] [21:06:52] : [Step 4/5] [2021-11-19 21:06:52,117][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:06:52] : [Step 4/5] [2021-11-19 21:06:52,117][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:06:52] : [Step 4/5] [2021-11-19 21:06:52,120][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000000.wal, offset=0, ver=2] [21:06:52] : [Step 4/5] [2021-11-19 21:06:52,126][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][GridCacheProcessor] Started cache in recovery mode [name=ignite-sys-cache, id=-2100569601, dataRegionName=sysMemPlc, mode=REPLICATED, atomicity=TRANSACTIONAL, backups=2147483647, mvcc=false] [21:06:52] : [Step 4/5] [2021-11-19 21:06:52,127][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Binary recovery performed in 20 ms. [21:06:52] : [Step 4/5] [2021-11-19 21:06:52,127][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:06:52] : [Step 4/5] [2021-11-19 21:06:52,127][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Applying lost cache updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:06:52] : [Step 4/5] [2021-11-19 21:06:52,200][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=74 ms] [21:06:52] : [Step 4/5] [2021-11-19 21:06:52,200][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][GridCacheProcessor] Restoring partition state for local groups. [21:06:52] : [Step 4/5] [2021-11-19 21:06:52,217][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=1, partitionsProcessed=100, time=20ms] [21:06:52] : [Step 4/5] [2021-11-19 21:06:52,596][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][TestTcpDiscoverySpi] Successfully bound to TCP port [port=47500, localHost=localhost/127.0.0.1, locNodeId=009e0037-2e63-4a08-910c-f40b550ad000] [21:06:52] : [Step 4/5] [2021-11-19 21:06:52,601][INFO ][disco-notifier-worker-#13440%grid-0%][MvccProcessorImpl] Assigned mvcc coordinator [crd=MvccCoordinator [topVer=AffinityTopologyVersion [topVer=1, minorTopVer=0], nodeId=009e0037-2e63-4a08-910c-f40b550ad000, ver=1637345212601, local=true, initialized=false]] [21:06:52] : [Step 4/5] [2021-11-19 21:06:52,609][INFO ][sys-#13417%grid-0%][ClusterProcessor] Writing cluster ID and tag to metastorage on ready for write ClusterIdAndTag [id=0e0553ff-9beb-4886-8624-87e3619f7395, tag=objective_sammet] [21:06:52] : [Step 4/5] [2021-11-19 21:06:52,610][INFO ][disco-notifier-worker-#13440%grid-0%][ClusterProcessor] objective_sammet [21:06:52] : [Step 4/5] [2021-11-19 21:06:52,611][INFO ][disco-notifier-worker-#13440%grid-0%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustEnabled' was changed from 'null' to 'false' [21:06:52] : [Step 4/5] [2021-11-19 21:06:52,612][INFO ][disco-notifier-worker-#13440%grid-0%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustTimeout' was changed from 'null' to '300000' [21:06:52] : [Step 4/5] [2021-11-19 21:06:52,614][INFO ][disco-notifier-worker-#13440%grid-0%][IgniteTxManager] Transactions parameter 'longOperationsDumpTimeout' was changed from 'null' to '60000' [21:06:52] : [Step 4/5] [2021-11-19 21:06:52,615][INFO ][disco-notifier-worker-#13440%grid-0%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpThreshold' was changed from 'null' to '0' [21:06:52] : [Step 4/5] [2021-11-19 21:06:52,615][INFO ][disco-notifier-worker-#13440%grid-0%][IgniteTxManager] Transactions parameter 'transactionTimeDumpSamplesCoefficient' was changed from 'null' to '0.0' [21:06:52] : [Step 4/5] [2021-11-19 21:06:52,616][INFO ][disco-notifier-worker-#13440%grid-0%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpSamplesPerSecondLimit' was changed from 'null' to '5' [21:06:52] : [Step 4/5] [2021-11-19 21:06:52,616][INFO ][disco-notifier-worker-#13440%grid-0%][IgniteTxManager] Transactions parameter 'collisionsDumpInterval' was changed from 'null' to '1000' [21:06:52] : [Step 4/5] [2021-11-19 21:06:52,628][INFO ][disco-notifier-worker-#13440%grid-0%][IgniteTxManager] Transactions parameter 'txOwnerDumpRequestsAllowed' was changed from 'null' to 'true' [21:06:52] : [Step 4/5] [2021-11-19 21:06:52,672][INFO ][disco-notifier-worker-#13440%grid-0%][GridCacheDatabaseSharedManager] Historical rebalance WAL threshold changed [property=historical.rebalance.threshold, oldVal=null, newVal=500] [21:06:52] : [Step 4/5] [2021-11-19 21:06:52,673][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] To start Console Management & Monitoring run ignitevisorcmd.{sh|bat} [21:06:52] : [Step 4/5] [2021-11-19 21:06:52,674][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] [21:06:52] : [Step 4/5] [21:06:52] : [Step 4/5] >>> +-------------------------------------------+ [21:06:52] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:06:52] : [Step 4/5] >>> +-------------------------------------------+ [21:06:52] : [Step 4/5] >>> OS name: Linux 4.15.0-151-generic amd64 [21:06:52] : [Step 4/5] >>> CPU(s): 24 [21:06:52] : [Step 4/5] >>> Heap: 2.0GB [21:06:52] : [Step 4/5] >>> VM name: 16724@c4dfe9a430b2 [21:06:52] : [Step 4/5] >>> Ignite instance name: grid-0 [21:06:52] : [Step 4/5] >>> Local node [ID=009E0037-2E63-4A08-910C-F40B550AD000, order=1, clientMode=false] [21:06:52] : [Step 4/5] >>> Local node addresses: [127.0.0.1] [21:06:52] : [Step 4/5] >>> Local ports: TCP:10800 TCP:45150 TCP:47500 [21:06:52] : [Step 4/5] [21:06:52] : [Step 4/5] [2021-11-19 21:06:52,675][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-0] >>> Ignite cluster is in INACTIVE state (limited functionality available). Use control.(sh|bat) script or IgniteCluster.state(ClusterState.ACTIVE) to change the state. [21:06:52] : [Step 4/5] [2021-11-19 21:06:52,676][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][GridDiscoveryManager] Topology snapshot [ver=1, locNode=009e0037, servers=1, clients=0, state=INACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=009e0037-2e63-4a08-910c-f40b550ad000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:06:52] : [Step 4/5] [2021-11-19 21:06:52,677][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][G] Node started : [stage="Configure system pool" (0 ms),stage="Start managers" (257 ms),stage="Configure binary metadata" (4 ms),stage="Start processors" (469 ms),stage="Start 'StanByClusterTestProvider' plugin" (0 ms),stage="Start 'PageMemory tracker plugin' plugin" (0 ms),stage="Start 'TestDistibutedConfigurationPlugin' plugin" (0 ms),stage="Start 'NodeValidationPluginProvider' plugin" (0 ms),stage="Init metastore" (24 ms),stage="Init and start regions" (8 ms),stage="Restore binary memory" (19 ms),stage="Restore logical state" (90 ms),stage="Finish recovery" (375 ms),stage="Join topology" (7 ms),stage="Await transition" (3 ms),stage="Await exchange" (72 ms),stage="Total time" (1328 ms)] [21:06:52] : [Step 4/5] [2021-11-19 21:06:52,679][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][root] Node started with the following configuration [id=009e0037-2e63-4a08-910c-f40b550ad000, marshaller=BinaryMarshaller [], discovery=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=5000, ackTimeout=5000, marsh=JdkMarshaller [clsFilter=org.apache.ignite.marshaller.MarshallerUtils$1@6c786159], reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], binaryCfg=null, lateAff=true] [21:06:52]W: [org.apache.ignite:ignite-core] [2021-11-19 21:06:52,687][WARN ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][G] Ignite work directory is not provided, automatically resolved to: /opt/buildagent/work/7bc1c54bc719b67c/work [21:06:52] : [Step 4/5] [2021-11-19 21:06:52,690][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-6] [21:06:52] : [Step 4/5] [21:06:52] : [Step 4/5] >>> __________ ________________ [21:06:52] : [Step 4/5] >>> / _/ ___/ |/ / _/_ __/ __/ [21:06:52] : [Step 4/5] >>> _/ // (7 7 // / / / / _/ [21:06:52] : [Step 4/5] >>> /___/\___/_/|_/___/ /_/ /___/ [21:06:52] : [Step 4/5] >>> [21:06:52] : [Step 4/5] >>> ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:06:52] : [Step 4/5] >>> 2021 Copyright(C) Apache Software Foundation [21:06:52] : [Step 4/5] >>> [21:06:52] : [Step 4/5] >>> Ignite documentation: http://ignite.apache.org [21:06:52] : [Step 4/5] [21:06:52] : [Step 4/5] [2021-11-19 21:06:52,691][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-6] Config URL: n/a [21:06:52] : [Step 4/5] [2021-11-19 21:06:52,691][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-6] IgniteConfiguration [igniteInstanceName=grid-6, pubPoolSize=24, svcPoolSize=24, callbackPoolSize=24, stripedPoolSize=24, sysPoolSize=24, mgmtPoolSize=4, dataStreamerPoolSize=24, utilityCachePoolSize=24, utilityCacheKeepAliveTime=60000, p2pPoolSize=2, qryPoolSize=24, buildIdxPoolSize=4, igniteHome=/opt/buildagent/work/7bc1c54bc719b67c, igniteWorkDir=/opt/buildagent/work/7bc1c54bc719b67c/work, mbeanSrv=com.sun.jmx.mbeanserver.JmxMBeanServer@6fe85038, nodeId=60a34984-0e55-40a3-9b61-4f6c3e2b2006, marsh=BinaryMarshaller [], marshLocJobs=false, daemon=false, p2pEnabled=true, netTimeout=10000, netCompressionLevel=1, sndRetryDelay=1000, sndRetryCnt=3, metricsHistSize=10000, metricsUpdateFreq=1000, metricsExpTime=9223372036854775807, discoSpi=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=0, ackTimeout=0, marsh=null, reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], segPlc=STOP, segResolveAttempts=2, waitForSegOnStart=true, allResolversPassReq=true, segChkFreq=10000, commSpi=TcpCommunicationSpi [connectGate=org.apache.ignite.spi.communication.tcp.internal.ConnectGateway@51e1f468, ctxInitLatch=java.util.concurrent.CountDownLatch@36ce853[Count = 1], stopping=false, clientPool=null, nioSrvWrapper=null, stateProvider=null], evtSpi=MemoryEventStorageSpi [expireAgeMs=9223372036854775807, expireCnt=10000, filter=null], colSpi=NoopCollisionSpi [], deploySpi=LocalDeploymentSpi [], indexingSpi=org.apache.ignite.spi.indexing.noop.NoopIndexingSpi@1a8eece8, addrRslvr=null, encryptionSpi=org.apache.ignite.spi.encryption.keystore.KeystoreEncryptionSpi@63fb4679, tracingSpi=org.apache.ignite.spi.tracing.NoopTracingSpi@13f83bd, clientMode=false, rebalanceThreadPoolSize=4, rebalanceTimeout=10000, rebalanceBatchesPrefetchCnt=3, rebalanceThrottle=0, rebalanceBatchSize=524288, txCfg=TransactionConfiguration [txSerEnabled=false, dfltIsolation=REPEATABLE_READ, dfltConcurrency=PESSIMISTIC, dfltTxTimeout=0, txTimeoutOnPartitionMapExchange=0, deadlockTimeout=10000, pessimisticTxLogSize=0, pessimisticTxLogLinger=10000, tmLookupClsName=null, txManagerFactory=null, useJtaSync=false], cacheSanityCheckEnabled=true, discoStartupDelay=60000, deployMode=SHARED, p2pMissedCacheSize=100, locHost=127.0.0.1, timeSrvPortBase=31100, timeSrvPortRange=100, failureDetectionTimeout=10000, sysWorkerBlockedTimeout=null, clientFailureDetectionTimeout=10000, metricsLogFreq=0, connectorCfg=null, odbcCfg=null, warmupClos=null, atomicCfg=AtomicConfiguration [seqReserveSize=1000, cacheMode=PARTITIONED, backups=1, aff=null, grpName=null], classLdr=null, sslCtxFactory=null, platformCfg=null, binaryCfg=null, memCfg=null, pstCfg=null, dsCfg=DataStorageConfiguration [sysRegionInitSize=41943040, sysRegionMaxSize=104857600, pageSize=4096, concLvl=0, dfltDataRegConf=DataRegionConfiguration [name=default, maxSize=10485760, initSize=268435456, swapPath=null, pageEvictionMode=DISABLED, pageReplacementMode=CLOCK, evictionThreshold=0.9, emptyPagesPoolSize=100, metricsEnabled=false, metricsSubIntervalCount=5, metricsRateTimeInterval=60000, persistenceEnabled=true, checkpointPageBufSize=0, lazyMemoryAllocation=true, warmUpCfg=null], dataRegions=null, storagePath=null, checkpointFreq=180000, lockWaitTime=10000, checkpointThreads=4, checkpointWriteOrder=SEQUENTIAL, walHistSize=20, maxWalArchiveSize=1073741824, walSegments=10, walSegmentSize=67108864, walPath=db/wal, walArchivePath=db/wal/archive, cdcWalPath=db/wal/cdc, cdcEnabled=false, metricsEnabled=false, walMode=FSYNC, walTlbSize=131072, walBuffSize=0, walFlushFreq=2000, walFsyncDelay=1000, walRecordIterBuffSize=67108864, alwaysWriteFullPages=false, fileIOFactory=org.apache.ignite.internal.processors.cache.persistence.file.AsyncFileIOFactory@5ea3fe8d, metricsSubIntervalCnt=5, metricsRateTimeInterval=60000, walAutoArchiveAfterInactivity=-1, walForceArchiveTimeout=-1, writeThrottlingEnabled=false, walCompactionEnabled=false, walCompactionLevel=1, checkpointReadLockTimeout=null, walPageCompression=DISABLED, walPageCompressionLevel=null, dfltWarmUpCfg=null, encCfg=org.apache.ignite.configuration.EncryptionConfiguration@3b41dedb, defragmentationThreadPoolSize=4, minWalArchiveSize=-1], snapshotPath=snapshots, activeOnStart=true, activeOnStartPropSetFlag=false, autoActivation=true, autoActivationPropSetFlag=false, clusterStateOnStart=null, sqlConnCfg=null, cliConnCfg=ClientConnectorConfiguration [host=null, port=10800, portRange=100, sockSndBufSize=0, sockRcvBufSize=0, tcpNoDelay=true, maxOpenCursorsPerConn=128, threadPoolSize=24, selectorCnt=12, idleTimeout=0, handshakeTimeout=10000, jdbcEnabled=true, odbcEnabled=true, thinCliEnabled=true, sslEnabled=false, useIgniteSslCtxFactory=true, sslClientAuth=false, sslCtxFactory=null, thinCliCfg=ThinClientConfiguration [maxActiveTxPerConn=100, maxActiveComputeTasksPerConn=0]], mvccVacuumThreadCnt=2, mvccVacuumFreq=5000, authEnabled=false, failureHnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]], commFailureRslvr=null, sqlCfg=SqlConfiguration [longQryWarnTimeout=3000, dfltQryTimeout=0, sqlQryHistSize=1000, validationEnabled=false], asyncContinuationExecutor=null] [21:06:52] : [Step 4/5] [2021-11-19 21:06:52,700][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-6] Daemon mode: off [21:06:52] : [Step 4/5] [2021-11-19 21:06:52,700][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-6] OS: Linux 4.15.0-151-generic amd64 [21:06:52] : [Step 4/5] [2021-11-19 21:06:52,700][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-6] OS user: teamcity [21:06:52] : [Step 4/5] [2021-11-19 21:06:52,701][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-6] PID: 16724 [21:06:52] : [Step 4/5] [2021-11-19 21:06:52,701][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-6] Language runtime: Java Platform API Specification ver. 1.8 [21:06:52] : [Step 4/5] [2021-11-19 21:06:52,702][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-6] VM information: Java(TM) SE Runtime Environment 1.8.0_261-b12 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 25.261-b12 [21:06:52] : [Step 4/5] [2021-11-19 21:06:52,702][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-6] VM total memory: 1.9GB [21:06:52] : [Step 4/5] [2021-11-19 21:06:52,702][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-6] Remote Management [restart: off, REST: off, JMX (remote: off)] [21:06:52] : [Step 4/5] [2021-11-19 21:06:52,703][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-6] Logger: GridTestLog4jLogger [quiet=false, config=null] [21:06:52] : [Step 4/5] [2021-11-19 21:06:52,703][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-6] IGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c [21:06:52] : [Step 4/5] [2021-11-19 21:06:52,704][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-6] VM arguments: [-DIGNITE_DUMP_THREADS_ON_FAILURE=false, -DMono=/usr/bin/mono-sgen, -DMono4.0_x64=/usr/lib/mono/4.0, -DMono4.5_x64=/usr/lib/mono/4.5, -DMonoVersion=6.12.0.90, -DSKIP_BUILD=false, -Dagent.home.dir=/opt/buildagent, -Dagent.name=aitc-lin02_03, -Dagent.ownPort=9090, -Dagent.work.dir=/opt/buildagent/work, -Dbuild.number=95, -Dbuild.vcs.number=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.1=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.GitHubApacheIgnite=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dclassworlds.conf=/opt/buildagent/temp/buildTmp/teamcity.m2.conf, -Dcom.jetbrains.maven.watcher.report.file=/opt/buildagent/temp/buildTmp/maven-build-info.xml, -Djava.io.tmpdir=/opt/buildagent/temp/buildTmp, -Dmaven.home=/opt/buildagent/tools/maven3_6, -Dmaven.multiModuleProjectDirectory=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.agent.cpuBenchmark=457, -Dteamcity.agent.dotnet.agent_url=http://localhost:9090/RPC2, -Dteamcity.agent.dotnet.build_id=6278078, -Dteamcity.auth.password=*******, -Dteamcity.auth.userId=TeamCityBuildId=6278078, -Dteamcity.build.changedFiles.file=/opt/buildagent/temp/buildTmp/changedFiles6342607772318147725.txt, -Dteamcity.build.checkoutDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.build.id=6278078, -Dteamcity.build.properties.file=/opt/buildagent/temp/buildTmp/teamcity.build5164517880467851002.properties, -Dteamcity.build.tempDir=/opt/buildagent/temp/buildTmp, -Dteamcity.build.workingDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.buildConfName=Basic 3, -Dteamcity.buildType.id=IgniteTests24Java8_Basic3, -Dteamcity.configuration.properties.file=/opt/buildagent/temp/buildTmp/teamcity.config5591980786735343870.properties, -Dteamcity.maven.userSettings.path=/opt/buildagent/temp/buildTmp/maven_settings_585072866407032347.xml, -Dteamcity.maven.watcher.home=/opt/buildagent/plugins/mavenPlugin/maven-watcher-jdk16, -Dteamcity.projectName=Ignite Tests 2.x (JDK 8/11), -Dteamcity.runner.properties.file=/opt/buildagent/temp/buildTmp/teamcity.runner9098465561618137420.properties, -Dteamcity.tests.recentlyFailedTests.file=/opt/buildagent/temp/buildTmp/testsToRunFirst3891775683130404069.txt, -Dteamcity.version=2021.2 (build 99542), -ea, -Xms2g, -Xmx2g, -XX:+HeapDumpOnOutOfMemoryError, -DIGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_TEST_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_UPDATE_NOTIFIER=false, -DIGNITE_NO_DISCO_ORDER=true, -DIGNITE_PERFORMANCE_SUGGESTIONS_DISABLED=true, -Djava.net.preferIPv4Stack=true, -DTEST_SCALE_FACTOR=1.0, -DIGNITE_TEST_PROP_LOG4J_FILE=log4j-tc-test.xml, -DIGNITE_QUIET=false, -DIGNITE_MARSHAL_BUFFERS_RECHECK=1000, -Dmaven.repo.local=/opt/buildagent/.m2/repository] [21:06:52] : [Step 4/5] [2021-11-19 21:06:52,709][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-6] System cache's DataRegion size is configured to 40 MB. Use DataStorageConfiguration.systemRegionInitialSize property to change the setting. [21:06:52] : [Step 4/5] [2021-11-19 21:06:52,709][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-6] Configured caches [in 'sysMemPlc' dataRegion: ['ignite-sys-cache']] [21:06:52]W: [org.apache.ignite:ignite-core] [2021-11-19 21:06:52,709][WARN ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-6] Peer class loading is enabled (disable it in production for performance and deployment consistency reasons) [21:06:52] : [Step 4/5] [2021-11-19 21:06:52,710][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-6] 3-rd party licenses can be found at: /opt/buildagent/work/7bc1c54bc719b67c/libs/licenses [21:06:52] : [Step 4/5] [2021-11-19 21:06:52,715][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] Configured plugins: [21:06:52] : [Step 4/5] [2021-11-19 21:06:52,715][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- StanByClusterTestProvider 1.0 [21:06:52] : [Step 4/5] [2021-11-19 21:06:52,716][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- null [21:06:52] : [Step 4/5] [2021-11-19 21:06:52,716][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] [21:06:52] : [Step 4/5] [2021-11-19 21:06:52,716][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- PageMemory tracker plugin 1.0 [21:06:52] : [Step 4/5] [2021-11-19 21:06:52,716][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- null [21:06:52] : [Step 4/5] [2021-11-19 21:06:52,717][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] [21:06:52] : [Step 4/5] [2021-11-19 21:06:52,717][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- TestDistibutedConfigurationPlugin 1.0 [21:06:52] : [Step 4/5] [2021-11-19 21:06:52,717][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- null [21:06:52] : [Step 4/5] [2021-11-19 21:06:52,717][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] [21:06:52] : [Step 4/5] [2021-11-19 21:06:52,718][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- NodeValidationPluginProvider 1.0 [21:06:52] : [Step 4/5] [2021-11-19 21:06:52,718][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- null [21:06:52] : [Step 4/5] [2021-11-19 21:06:52,718][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] [21:06:52] : [Step 4/5] [2021-11-19 21:06:52,719][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][FailureProcessor] Configured failure handler: [hnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]]] [21:06:52] : [Step 4/5] [2021-11-19 21:06:52,803][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][TcpCommunicationSpi] Successfully bound communication NIO server to TCP port [port=45151, locHost=/127.0.0.1, selectorsCnt=12, selectorSpins=0, pairedConn=false] [21:06:52]W: [org.apache.ignite:ignite-core] [2021-11-19 21:06:52,804][WARN ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][TcpCommunicationSpi] Message queue limit is set to 0 which may lead to potential OOMEs when running cache operations in FULL_ASYNC or PRIMARY_SYNC modes due to message queues growth on sender and receiver sides. [21:06:53] : [Step 4/5] [2021-11-19 21:06:53,014][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][GridCollisionManager] Collision resolution is disabled (all jobs will be activated upon arrival). [21:06:53] : [Step 4/5] [2021-11-19 21:06:53,017][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-6] Security status [authentication=off, sandbox=off, tls/ssl=off] [21:06:53] : [Step 4/5] [2021-11-19 21:06:53,089][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:06:53] : [Step 4/5] [2021-11-19 21:06:53,186][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][MaintenanceProcessor] Resolved store directory for node persistent data: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_6 [21:06:53] : [Step 4/5] [2021-11-19 21:06:53,188][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][CacheObjectBinaryProcessorImpl] Resolved directory for serialized binary metadata: /opt/buildagent/work/7bc1c54bc719b67c/work/db/binary_meta/grid_6 [21:06:53] : [Step 4/5] [2021-11-19 21:06:53,194][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_6 [21:06:53] : [Step 4/5] [2021-11-19 21:06:53,195][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][FileWriteAheadLogManager] Resolved write ahead log work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_6 [21:06:53] : [Step 4/5] [2021-11-19 21:06:53,195][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][FileWriteAheadLogManager] Resolved write ahead log archive directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_6 [21:06:53] : [Step 4/5] [2021-11-19 21:06:53,657][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_6/0000000000000000.wal [21:06:53] : [Step 4/5] [2021-11-19 21:06:53,661][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Configured data regions initialized successfully [total=5] [21:06:53] : [Step 4/5] [2021-11-19 21:06:53,667][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][IgniteSnapshotManager] Resolved snapshot work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/snapshots [21:06:53] : [Step 4/5] [2021-11-19 21:06:53,668][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][IgniteSnapshotManager] Resolved temp directory for snapshot creation: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_6/snp [21:06:53] : [Step 4/5] [2021-11-19 21:06:53,671][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][ClientListenerProcessor] Client connector processor has started on TCP port 10801 [21:06:53] : [Step 4/5] [2021-11-19 21:06:53,674][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-6] Non-loopback local IPs: 172.17.0.4 [21:06:53] : [Step 4/5] [2021-11-19 21:06:53,674][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-6] Enabled local MACs: 0242AC110004 [21:06:53] : [Step 4/5] [2021-11-19 21:06:53,675][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:06:53] : [Step 4/5] [2021-11-19 21:06:53,676][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:06:53] : [Step 4/5] [2021-11-19 21:06:53,677][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:06:53] : [Step 4/5] [2021-11-19 21:06:53,684][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Applying lost metastore updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:06:53] : [Step 4/5] [2021-11-19 21:06:53,688][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=0 ms] [21:06:53] : [Step 4/5] [2021-11-19 21:06:53,688][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][GridCacheProcessor] Restoring partition state for local groups. [21:06:53] : [Step 4/5] [2021-11-19 21:06:53,689][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=0, partitionsProcessed=0, time=0ms] [21:06:53] : [Step 4/5] [2021-11-19 21:06:53,689][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][GridEncryptionManager] Encryption keys loaded from metastore. [grps=, masterKeyName=ignite.master.key] [21:06:53] : [Step 4/5] [2021-11-19 21:06:53,690][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][ClusterProcessor] Cluster ID and tag has been read from metastorage: null [21:06:53] : [Step 4/5] [2021-11-19 21:06:53,691][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][IgniteClusterImpl] Shutdown policy was updated [oldVal=null, newVal=null] [21:06:53] : [Step 4/5] [2021-11-19 21:06:53,691][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Checkpoint frequency deviation changed [oldVal=null, newVal=null] [21:06:53] : [Step 4/5] [2021-11-19 21:06:53,704][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][FilePageStoreManager] Cleanup cache stores [total=1, left=0, cleanFiles=false] [21:06:53] : [Step 4/5] [2021-11-19 21:06:53,707][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:06:53] : [Step 4/5] [2021-11-19 21:06:53,708][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:06:53] : [Step 4/5] [2021-11-19 21:06:53,709][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:06:53] : [Step 4/5] [2021-11-19 21:06:53,710][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Data Regions Started: 5 [21:06:53] : [Step 4/5] [2021-11-19 21:06:53,710][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] ^-- sysMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:06:53] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:06:53] : [Step 4/5] ^-- default region [type=default, persistence=true, lazyAlloc=true, [21:06:53] : [Step 4/5] ... initCfg=10MB, maxCfg=10MB, usedRam=0MB, freeRam=100%, allocRam=0MB, allocTotal=0MB] [21:06:53] : [Step 4/5] ^-- metastoreMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:06:53] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:06:53] : [Step 4/5] ^-- TxLog region [type=internal, persistence=true, lazyAlloc=false, [21:06:53] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:06:53] : [Step 4/5] ^-- volatileDsMemPlc region [type=user, persistence=false, lazyAlloc=true, [21:06:53] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB] [21:06:53] : [Step 4/5] ^-- Ignite persistence [used=0MB] [21:06:53] : [Step 4/5] [21:06:53] : [Step 4/5] [2021-11-19 21:06:53,712][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Starting binary memory restore for: [-2100569601] [21:06:53] : [Step 4/5] [2021-11-19 21:06:53,722][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:06:53] : [Step 4/5] [2021-11-19 21:06:53,723][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:06:53] : [Step 4/5] [2021-11-19 21:06:53,726][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_6/0000000000000000.wal, offset=0, ver=2] [21:06:53] : [Step 4/5] [2021-11-19 21:06:53,733][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][GridCacheProcessor] Started cache in recovery mode [name=ignite-sys-cache, id=-2100569601, dataRegionName=sysMemPlc, mode=REPLICATED, atomicity=TRANSACTIONAL, backups=2147483647, mvcc=false] [21:06:53] : [Step 4/5] [2021-11-19 21:06:53,735][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Binary recovery performed in 23 ms. [21:06:53] : [Step 4/5] [2021-11-19 21:06:53,735][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:06:53] : [Step 4/5] [2021-11-19 21:06:53,736][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Applying lost cache updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:06:53] : [Step 4/5] [2021-11-19 21:06:53,832][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=91 ms] [21:06:53] : [Step 4/5] [2021-11-19 21:06:53,832][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][GridCacheProcessor] Restoring partition state for local groups. [21:06:53] : [Step 4/5] [2021-11-19 21:06:53,853][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=1, partitionsProcessed=100, time=20ms] [21:06:54] : [Step 4/5] [2021-11-19 21:06:54,505][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][TestTcpDiscoverySpi] Successfully bound to TCP port [port=47501, localHost=localhost/127.0.0.1, locNodeId=60a34984-0e55-40a3-9b61-4f6c3e2b2006] [21:06:54] : [Step 4/5] [2021-11-19 21:06:54,509][INFO ][tcp-disco-srvr-[:47500]-#699%grid-0%-#13442%grid-0%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=59955] [21:06:54] : [Step 4/5] [2021-11-19 21:06:54,510][INFO ][tcp-disco-srvr-[:47500]-#699%grid-0%-#13442%grid-0%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=59955] [21:06:54] : [Step 4/5] [2021-11-19 21:06:54,511][INFO ][tcp-disco-sock-reader-[]-#705%grid-0%-#13561%grid-0%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:59955, rmtPort=59955] [21:06:54] : [Step 4/5] [2021-11-19 21:06:54,512][INFO ][tcp-disco-sock-reader-[60a34984 127.0.0.1:59955]-#705%grid-0%-#13561%grid-0%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=60a34984-0e55-40a3-9b61-4f6c3e2b2006, rmtAddr=/127.0.0.1:59955] [21:06:54] : [Step 4/5] [2021-11-19 21:06:54,515][INFO ][tcp-disco-srvr-[:47501]-#704%grid-6%-#13560%grid-6%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=36167] [21:06:54] : [Step 4/5] [2021-11-19 21:06:54,516][INFO ][tcp-disco-srvr-[:47501]-#704%grid-6%-#13560%grid-6%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=36167] [21:06:54] : [Step 4/5] [2021-11-19 21:06:54,517][INFO ][tcp-disco-sock-reader-[]-#706%grid-6%-#13562%grid-6%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:36167, rmtPort=36167] [21:06:54] : [Step 4/5] [2021-11-19 21:06:54,517][INFO ][tcp-disco-sock-reader-[]-#706%grid-6%-#13562%grid-6%][TestTcpDiscoverySpi] Received ping request from the remote node [rmtNodeId=009e0037-2e63-4a08-910c-f40b550ad000, rmtAddr=/127.0.0.1:36167, rmtPort=36167] [21:06:54] : [Step 4/5] [2021-11-19 21:06:54,519][INFO ][tcp-disco-sock-reader-[]-#706%grid-6%-#13562%grid-6%][TestTcpDiscoverySpi] Finished writing ping response [rmtNodeId=009e0037-2e63-4a08-910c-f40b550ad000, rmtAddr=/127.0.0.1:36167, rmtPort=36167] [21:06:54]W: [org.apache.ignite:ignite-core] [2021-11-19 21:06:54,519][WARN ][tcp-disco-sock-reader-[]-#706%grid-6%-#13562%grid-6%][TestTcpDiscoverySpi] Failed to shutdown socket [21:06:54]W: [org.apache.ignite:ignite-core] java.net.SocketException: Socket output is already shutdown [21:06:54]W: [org.apache.ignite:ignite-core] at java.net.Socket.shutdownOutput(Socket.java:1572) [21:06:54]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.close(IgniteUtils.java:4247) [21:06:54]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.discovery.tcp.ServerImpl$SocketReader.body(ServerImpl.java:7370) [21:06:54] : [Step 4/5] [2021-11-19 21:06:54,519][INFO ][tcp-disco-sock-reader-[60a34984 127.0.0.1:59955]-#705%grid-0%-#13561%grid-0%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:59955, rmtPort=59955, rmtNodeId=60a34984-0e55-40a3-9b61-4f6c3e2b2006] [21:06:54]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.IgniteSpiThread.run(IgniteSpiThread.java:58) [21:06:54] : [Step 4/5] [2021-11-19 21:06:54,522][INFO ][tcp-disco-sock-reader-[]-#706%grid-6%-#13562%grid-6%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:36167, rmtPort=36167, rmtNodeId=null] [21:06:54] : [Step 4/5] [2021-11-19 21:06:54,524][INFO ][tcp-disco-msg-worker-[crd]-#698%grid-0%-#13441%grid-0%][GridEncryptionManager] Joining node doesn't have stored group keys [node=60a34984-0e55-40a3-9b61-4f6c3e2b2006] [21:06:54] : [Step 4/5] [2021-11-19 21:06:54,535][INFO ][tcp-disco-msg-worker-[crd]-#698%grid-0%-#13441%grid-0%][TestTcpDiscoverySpi] New next node [newNext=TcpDiscoveryNode [id=60a34984-0e55-40a3-9b61-4f6c3e2b2006, consistentId=grid-6, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=0, intOrder=2, lastExchangeTime=1637345214511, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false]] [21:06:54] : [Step 4/5] [2021-11-19 21:06:54,536][INFO ][tcp-disco-srvr-[:47501]-#704%grid-6%-#13560%grid-6%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=57685] [21:06:54] : [Step 4/5] [2021-11-19 21:06:54,536][INFO ][tcp-disco-srvr-[:47501]-#704%grid-6%-#13560%grid-6%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=57685] [21:06:54] : [Step 4/5] [2021-11-19 21:06:54,538][INFO ][tcp-disco-sock-reader-[]-#707%grid-6%-#13563%grid-6%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:57685, rmtPort=57685] [21:06:54] : [Step 4/5] [2021-11-19 21:06:54,539][INFO ][tcp-disco-sock-reader-[009e0037 127.0.0.1:57685]-#707%grid-6%-#13563%grid-6%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=009e0037-2e63-4a08-910c-f40b550ad000, rmtAddr=/127.0.0.1:57685] [21:06:54] : [Step 4/5] [2021-11-19 21:06:54,548][INFO ][tcp-disco-msg-worker-[]-#703%grid-6%-#13559%grid-6%][TestTcpDiscoverySpi] New next node [newNext=TcpDiscoveryNode [id=009e0037-2e63-4a08-910c-f40b550ad000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345214542, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false]] [21:06:54] : [Step 4/5] [2021-11-19 21:06:54,549][INFO ][tcp-disco-srvr-[:47500]-#699%grid-0%-#13442%grid-0%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=37237] [21:06:54] : [Step 4/5] [2021-11-19 21:06:54,549][INFO ][tcp-disco-srvr-[:47500]-#699%grid-0%-#13442%grid-0%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=37237] [21:06:54] : [Step 4/5] [2021-11-19 21:06:54,550][INFO ][tcp-disco-sock-reader-[]-#708%grid-0%-#13564%grid-0%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:37237, rmtPort=37237] [21:06:54] : [Step 4/5] [2021-11-19 21:06:54,552][INFO ][tcp-disco-sock-reader-[60a34984 127.0.0.1:37237]-#708%grid-0%-#13564%grid-0%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=60a34984-0e55-40a3-9b61-4f6c3e2b2006, rmtAddr=/127.0.0.1:37237] [21:06:54] : [Step 4/5] [2021-11-19 21:06:54,556][INFO ][disco-event-worker-#13444%grid-0%][GridDiscoveryManager] Added new node to topology: TcpDiscoveryNode [id=60a34984-0e55-40a3-9b61-4f6c3e2b2006, consistentId=grid-6, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637345214511, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false] [21:06:54] : [Step 4/5] [2021-11-19 21:06:54,559][INFO ][disco-event-worker-#13444%grid-0%][GridDiscoveryManager] Topology snapshot [ver=2, locNode=009e0037, servers=2, clients=0, state=INACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=009e0037-2e63-4a08-910c-f40b550ad000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=60a34984-0e55-40a3-9b61-4f6c3e2b2006, consistentId=grid-6, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:06:54] : [Step 4/5] [2021-11-19 21:06:54,569][INFO ][tcp-disco-msg-worker-[009e0037 127.0.0.1:47500]-#703%grid-6%-#13559%grid-6%][ClusterProcessor] objective_sammet [21:06:54] : [Step 4/5] [2021-11-19 21:06:54,569][INFO ][tcp-disco-msg-worker-[009e0037 127.0.0.1:47500]-#703%grid-6%-#13559%grid-6%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustEnabled' was changed from 'null' to 'false' [21:06:54] : [Step 4/5] [2021-11-19 21:06:54,570][INFO ][tcp-disco-msg-worker-[009e0037 127.0.0.1:47500]-#703%grid-6%-#13559%grid-6%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustTimeout' was changed from 'null' to '300000' [21:06:54] : [Step 4/5] [2021-11-19 21:06:54,570][INFO ][tcp-disco-msg-worker-[009e0037 127.0.0.1:47500]-#703%grid-6%-#13559%grid-6%][IgniteTxManager] Transactions parameter 'longOperationsDumpTimeout' was changed from 'null' to '60000' [21:06:54] : [Step 4/5] [2021-11-19 21:06:54,571][INFO ][tcp-disco-msg-worker-[009e0037 127.0.0.1:47500]-#703%grid-6%-#13559%grid-6%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpThreshold' was changed from 'null' to '0' [21:06:54] : [Step 4/5] [2021-11-19 21:06:54,571][INFO ][tcp-disco-msg-worker-[009e0037 127.0.0.1:47500]-#703%grid-6%-#13559%grid-6%][IgniteTxManager] Transactions parameter 'transactionTimeDumpSamplesCoefficient' was changed from 'null' to '0.0' [21:06:54] : [Step 4/5] [2021-11-19 21:06:54,572][INFO ][tcp-disco-msg-worker-[009e0037 127.0.0.1:47500]-#703%grid-6%-#13559%grid-6%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpSamplesPerSecondLimit' was changed from 'null' to '5' [21:06:54] : [Step 4/5] [2021-11-19 21:06:54,572][INFO ][tcp-disco-msg-worker-[009e0037 127.0.0.1:47500]-#703%grid-6%-#13559%grid-6%][IgniteTxManager] Transactions parameter 'collisionsDumpInterval' was changed from 'null' to '1000' [21:06:54] : [Step 4/5] [2021-11-19 21:06:54,573][INFO ][tcp-disco-msg-worker-[009e0037 127.0.0.1:47500]-#703%grid-6%-#13559%grid-6%][IgniteTxManager] Transactions parameter 'txOwnerDumpRequestsAllowed' was changed from 'null' to 'true' [21:06:54] : [Step 4/5] [2021-11-19 21:06:54,573][INFO ][tcp-disco-msg-worker-[009e0037 127.0.0.1:47500]-#703%grid-6%-#13559%grid-6%][GridCacheDatabaseSharedManager] Historical rebalance WAL threshold changed [property=historical.rebalance.threshold, oldVal=null, newVal=500] [21:06:54] : [Step 4/5] [2021-11-19 21:06:54,574][INFO ][disco-notifier-worker-#13558%grid-6%][MvccProcessorImpl] Assigned mvcc coordinator [crd=MvccCoordinator [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=0], nodeId=009e0037-2e63-4a08-910c-f40b550ad000, ver=1637345212601, local=false, initialized=false]] [21:06:54] : [Step 4/5] [2021-11-19 21:06:54,575][INFO ][sys-#13538%grid-6%][ClusterProcessor] Writing cluster ID and tag to metastorage on ready for write ClusterIdAndTag [id=0e0553ff-9beb-4886-8624-87e3619f7395, tag=objective_sammet] [21:06:54] : [Step 4/5] [2021-11-19 21:06:54,639][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-6] To start Console Management & Monitoring run ignitevisorcmd.{sh|bat} [21:06:54] : [Step 4/5] [2021-11-19 21:06:54,640][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-6] [21:06:54] : [Step 4/5] [21:06:54] : [Step 4/5] >>> +-------------------------------------------+ [21:06:54] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:06:54] : [Step 4/5] >>> +-------------------------------------------+ [21:06:54] : [Step 4/5] >>> OS name: Linux 4.15.0-151-generic amd64 [21:06:54] : [Step 4/5] >>> CPU(s): 24 [21:06:54] : [Step 4/5] >>> Heap: 2.0GB [21:06:54] : [Step 4/5] >>> VM name: 16724@c4dfe9a430b2 [21:06:54] : [Step 4/5] >>> Ignite instance name: grid-6 [21:06:54] : [Step 4/5] >>> Local node [ID=60A34984-0E55-40A3-9B61-4F6C3E2B2006, order=2, clientMode=false] [21:06:54] : [Step 4/5] >>> Local node addresses: [127.0.0.1] [21:06:54] : [Step 4/5] >>> Local ports: TCP:10801 TCP:45151 TCP:47501 [21:06:54] : [Step 4/5] [21:06:54] : [Step 4/5] [2021-11-19 21:06:54,641][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-6] >>> Ignite cluster is in INACTIVE state (limited functionality available). Use control.(sh|bat) script or IgniteCluster.state(ClusterState.ACTIVE) to change the state. [21:06:54] : [Step 4/5] [2021-11-19 21:06:54,642][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][GridDiscoveryManager] Topology snapshot [ver=2, locNode=60a34984, servers=2, clients=0, state=INACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=009e0037-2e63-4a08-910c-f40b550ad000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=60a34984-0e55-40a3-9b61-4f6c3e2b2006, consistentId=grid-6, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:06:54] : [Step 4/5] [2021-11-19 21:06:54,643][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][G] Node started : [stage="Configure system pool" (0 ms),stage="Start managers" (500 ms),stage="Configure binary metadata" (3 ms),stage="Start processors" (481 ms),stage="Start 'StanByClusterTestProvider' plugin" (0 ms),stage="Start 'PageMemory tracker plugin' plugin" (0 ms),stage="Start 'TestDistibutedConfigurationPlugin' plugin" (0 ms),stage="Start 'NodeValidationPluginProvider' plugin" (0 ms),stage="Init metastore" (31 ms),stage="Init and start regions" (7 ms),stage="Restore binary memory" (23 ms),stage="Restore logical state" (118 ms),stage="Finish recovery" (650 ms),stage="Join topology" (75 ms),stage="Await transition" (3 ms),stage="Await exchange" (60 ms),stage="Total time" (1951 ms)] [21:06:54] : [Step 4/5] [2021-11-19 21:06:54,644][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][root] Node started with the following configuration [id=60a34984-0e55-40a3-9b61-4f6c3e2b2006, marshaller=BinaryMarshaller [], discovery=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=5000, ackTimeout=5000, marsh=JdkMarshaller [clsFilter=org.apache.ignite.marshaller.MarshallerUtils$1@31a00832], reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], binaryCfg=null, lateAff=true] [21:06:54]W: [org.apache.ignite:ignite-core] [2021-11-19 21:06:54,651][WARN ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][G] Ignite work directory is not provided, automatically resolved to: /opt/buildagent/work/7bc1c54bc719b67c/work [21:06:54] : [Step 4/5] [2021-11-19 21:06:54,656][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%client1] [21:06:54] : [Step 4/5] [21:06:54] : [Step 4/5] >>> __________ ________________ [21:06:54] : [Step 4/5] >>> / _/ ___/ |/ / _/_ __/ __/ [21:06:54] : [Step 4/5] >>> _/ // (7 7 // / / / / _/ [21:06:54] : [Step 4/5] >>> /___/\___/_/|_/___/ /_/ /___/ [21:06:54] : [Step 4/5] >>> [21:06:54] : [Step 4/5] >>> ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:06:54] : [Step 4/5] >>> 2021 Copyright(C) Apache Software Foundation [21:06:54] : [Step 4/5] >>> [21:06:54] : [Step 4/5] >>> Ignite documentation: http://ignite.apache.org [21:06:54] : [Step 4/5] [21:06:54] : [Step 4/5] [2021-11-19 21:06:54,657][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%client1] Config URL: n/a [21:06:54] : [Step 4/5] [2021-11-19 21:06:54,658][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%client1] IgniteConfiguration [igniteInstanceName=client1, pubPoolSize=24, svcPoolSize=24, callbackPoolSize=24, stripedPoolSize=24, sysPoolSize=24, mgmtPoolSize=4, dataStreamerPoolSize=24, utilityCachePoolSize=24, utilityCacheKeepAliveTime=60000, p2pPoolSize=2, qryPoolSize=24, buildIdxPoolSize=4, igniteHome=/opt/buildagent/work/7bc1c54bc719b67c, igniteWorkDir=/opt/buildagent/work/7bc1c54bc719b67c/work, mbeanSrv=com.sun.jmx.mbeanserver.JmxMBeanServer@6fe85038, nodeId=10b64e66-ab6d-42d1-8754-26462cd96001, marsh=BinaryMarshaller [], marshLocJobs=false, daemon=false, p2pEnabled=true, netTimeout=10000, netCompressionLevel=1, sndRetryDelay=1000, sndRetryCnt=3, metricsHistSize=10000, metricsUpdateFreq=1000, metricsExpTime=9223372036854775807, discoSpi=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=0, ackTimeout=0, marsh=null, reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], segPlc=STOP, segResolveAttempts=2, waitForSegOnStart=true, allResolversPassReq=true, segChkFreq=10000, commSpi=TcpCommunicationSpi [connectGate=org.apache.ignite.spi.communication.tcp.internal.ConnectGateway@30953105, ctxInitLatch=java.util.concurrent.CountDownLatch@19b4bdfe[Count = 1], stopping=false, clientPool=null, nioSrvWrapper=null, stateProvider=null], evtSpi=MemoryEventStorageSpi [expireAgeMs=9223372036854775807, expireCnt=10000, filter=null], colSpi=NoopCollisionSpi [], deploySpi=LocalDeploymentSpi [], indexingSpi=org.apache.ignite.spi.indexing.noop.NoopIndexingSpi@2b655f62, addrRslvr=null, encryptionSpi=org.apache.ignite.spi.encryption.noop.NoopEncryptionSpi@4e6da5fe, tracingSpi=org.apache.ignite.spi.tracing.NoopTracingSpi@72a06bf8, clientMode=true, rebalanceThreadPoolSize=4, rebalanceTimeout=10000, rebalanceBatchesPrefetchCnt=3, rebalanceThrottle=0, rebalanceBatchSize=524288, txCfg=TransactionConfiguration [txSerEnabled=false, dfltIsolation=REPEATABLE_READ, dfltConcurrency=PESSIMISTIC, dfltTxTimeout=0, txTimeoutOnPartitionMapExchange=0, deadlockTimeout=10000, pessimisticTxLogSize=0, pessimisticTxLogLinger=10000, tmLookupClsName=null, txManagerFactory=null, useJtaSync=false], cacheSanityCheckEnabled=true, discoStartupDelay=60000, deployMode=SHARED, p2pMissedCacheSize=100, locHost=127.0.0.1, timeSrvPortBase=31100, timeSrvPortRange=100, failureDetectionTimeout=10000, sysWorkerBlockedTimeout=null, clientFailureDetectionTimeout=10000, metricsLogFreq=0, connectorCfg=null, odbcCfg=null, warmupClos=null, atomicCfg=AtomicConfiguration [seqReserveSize=1000, cacheMode=PARTITIONED, backups=1, aff=null, grpName=null], classLdr=null, sslCtxFactory=null, platformCfg=null, binaryCfg=null, memCfg=null, pstCfg=null, dsCfg=DataStorageConfiguration [sysRegionInitSize=41943040, sysRegionMaxSize=104857600, pageSize=4096, concLvl=0, dfltDataRegConf=DataRegionConfiguration [name=default, maxSize=10485760, initSize=268435456, swapPath=null, pageEvictionMode=DISABLED, pageReplacementMode=CLOCK, evictionThreshold=0.9, emptyPagesPoolSize=100, metricsEnabled=false, metricsSubIntervalCount=5, metricsRateTimeInterval=60000, persistenceEnabled=true, checkpointPageBufSize=0, lazyMemoryAllocation=true, warmUpCfg=null], dataRegions=null, storagePath=null, checkpointFreq=180000, lockWaitTime=10000, checkpointThreads=4, checkpointWriteOrder=SEQUENTIAL, walHistSize=20, maxWalArchiveSize=1073741824, walSegments=10, walSegmentSize=67108864, walPath=db/wal, walArchivePath=db/wal/archive, cdcWalPath=db/wal/cdc, cdcEnabled=false, metricsEnabled=false, walMode=FSYNC, walTlbSize=131072, walBuffSize=0, walFlushFreq=2000, walFsyncDelay=1000, walRecordIterBuffSize=67108864, alwaysWriteFullPages=false, fileIOFactory=org.apache.ignite.internal.processors.cache.persistence.file.AsyncFileIOFactory@f1ff8ed, metricsSubIntervalCnt=5, metricsRateTimeInterval=60000, walAutoArchiveAfterInactivity=-1, walForceArchiveTimeout=-1, writeThrottlingEnabled=false, walCompactionEnabled=false, walCompactionLevel=1, checkpointReadLockTimeout=null, walPageCompression=DISABLED, walPageCompressionLevel=null, dfltWarmUpCfg=null, encCfg=org.apache.ignite.configuration.EncryptionConfiguration@586afeb3, defragmentationThreadPoolSize=4, minWalArchiveSize=-1], snapshotPath=snapshots, activeOnStart=true, activeOnStartPropSetFlag=false, autoActivation=true, autoActivationPropSetFlag=false, clusterStateOnStart=null, sqlConnCfg=null, cliConnCfg=ClientConnectorConfiguration [host=null, port=10800, portRange=100, sockSndBufSize=0, sockRcvBufSize=0, tcpNoDelay=true, maxOpenCursorsPerConn=128, threadPoolSize=24, selectorCnt=12, idleTimeout=0, handshakeTimeout=10000, jdbcEnabled=true, odbcEnabled=true, thinCliEnabled=true, sslEnabled=false, useIgniteSslCtxFactory=true, sslClientAuth=false, sslCtxFactory=null, thinCliCfg=ThinClientConfiguration [maxActiveTxPerConn=100, maxActiveComputeTasksPerConn=0]], mvccVacuumThreadCnt=2, mvccVacuumFreq=5000, authEnabled=false, failureHnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]], commFailureRslvr=null, sqlCfg=SqlConfiguration [longQryWarnTimeout=3000, dfltQryTimeout=0, sqlQryHistSize=1000, validationEnabled=false], asyncContinuationExecutor=null] [21:06:54] : [Step 4/5] [2021-11-19 21:06:54,669][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%client1] Daemon mode: off [21:06:54] : [Step 4/5] [2021-11-19 21:06:54,669][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%client1] OS: Linux 4.15.0-151-generic amd64 [21:06:54] : [Step 4/5] [2021-11-19 21:06:54,670][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%client1] OS user: teamcity [21:06:54] : [Step 4/5] [2021-11-19 21:06:54,670][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%client1] PID: 16724 [21:06:54] : [Step 4/5] [2021-11-19 21:06:54,671][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%client1] Language runtime: Java Platform API Specification ver. 1.8 [21:06:54] : [Step 4/5] [2021-11-19 21:06:54,671][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%client1] VM information: Java(TM) SE Runtime Environment 1.8.0_261-b12 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 25.261-b12 [21:06:54] : [Step 4/5] [2021-11-19 21:06:54,672][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%client1] VM total memory: 1.8GB [21:06:54] : [Step 4/5] [2021-11-19 21:06:54,672][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%client1] Remote Management [restart: off, REST: off, JMX (remote: off)] [21:06:54] : [Step 4/5] [2021-11-19 21:06:54,672][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%client1] Logger: GridTestLog4jLogger [quiet=false, config=null] [21:06:54] : [Step 4/5] [2021-11-19 21:06:54,673][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%client1] IGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c [21:06:54] : [Step 4/5] [2021-11-19 21:06:54,673][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%client1] VM arguments: [-DIGNITE_DUMP_THREADS_ON_FAILURE=false, -DMono=/usr/bin/mono-sgen, -DMono4.0_x64=/usr/lib/mono/4.0, -DMono4.5_x64=/usr/lib/mono/4.5, -DMonoVersion=6.12.0.90, -DSKIP_BUILD=false, -Dagent.home.dir=/opt/buildagent, -Dagent.name=aitc-lin02_03, -Dagent.ownPort=9090, -Dagent.work.dir=/opt/buildagent/work, -Dbuild.number=95, -Dbuild.vcs.number=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.1=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.GitHubApacheIgnite=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dclassworlds.conf=/opt/buildagent/temp/buildTmp/teamcity.m2.conf, -Dcom.jetbrains.maven.watcher.report.file=/opt/buildagent/temp/buildTmp/maven-build-info.xml, -Djava.io.tmpdir=/opt/buildagent/temp/buildTmp, -Dmaven.home=/opt/buildagent/tools/maven3_6, -Dmaven.multiModuleProjectDirectory=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.agent.cpuBenchmark=457, -Dteamcity.agent.dotnet.agent_url=http://localhost:9090/RPC2, -Dteamcity.agent.dotnet.build_id=6278078, -Dteamcity.auth.password=*******, -Dteamcity.auth.userId=TeamCityBuildId=6278078, -Dteamcity.build.changedFiles.file=/opt/buildagent/temp/buildTmp/changedFiles6342607772318147725.txt, -Dteamcity.build.checkoutDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.build.id=6278078, -Dteamcity.build.properties.file=/opt/buildagent/temp/buildTmp/teamcity.build5164517880467851002.properties, -Dteamcity.build.tempDir=/opt/buildagent/temp/buildTmp, -Dteamcity.build.workingDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.buildConfName=Basic 3, -Dteamcity.buildType.id=IgniteTests24Java8_Basic3, -Dteamcity.configuration.properties.file=/opt/buildagent/temp/buildTmp/teamcity.config5591980786735343870.properties, -Dteamcity.maven.userSettings.path=/opt/buildagent/temp/buildTmp/maven_settings_585072866407032347.xml, -Dteamcity.maven.watcher.home=/opt/buildagent/plugins/mavenPlugin/maven-watcher-jdk16, -Dteamcity.projectName=Ignite Tests 2.x (JDK 8/11), -Dteamcity.runner.properties.file=/opt/buildagent/temp/buildTmp/teamcity.runner9098465561618137420.properties, -Dteamcity.tests.recentlyFailedTests.file=/opt/buildagent/temp/buildTmp/testsToRunFirst3891775683130404069.txt, -Dteamcity.version=2021.2 (build 99542), -ea, -Xms2g, -Xmx2g, -XX:+HeapDumpOnOutOfMemoryError, -DIGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_TEST_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_UPDATE_NOTIFIER=false, -DIGNITE_NO_DISCO_ORDER=true, -DIGNITE_PERFORMANCE_SUGGESTIONS_DISABLED=true, -Djava.net.preferIPv4Stack=true, -DTEST_SCALE_FACTOR=1.0, -DIGNITE_TEST_PROP_LOG4J_FILE=log4j-tc-test.xml, -DIGNITE_QUIET=false, -DIGNITE_MARSHAL_BUFFERS_RECHECK=1000, -Dmaven.repo.local=/opt/buildagent/.m2/repository] [21:06:54] : [Step 4/5] [2021-11-19 21:06:54,679][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%client1] System cache's DataRegion size is configured to 40 MB. Use DataStorageConfiguration.systemRegionInitialSize property to change the setting. [21:06:54] : [Step 4/5] [2021-11-19 21:06:54,680][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%client1] Configured caches [in 'sysMemPlc' dataRegion: ['ignite-sys-cache']] [21:06:54]W: [org.apache.ignite:ignite-core] [2021-11-19 21:06:54,681][WARN ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%client1] Peer class loading is enabled (disable it in production for performance and deployment consistency reasons) [21:06:54] : [Step 4/5] [2021-11-19 21:06:54,681][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%client1] 3-rd party licenses can be found at: /opt/buildagent/work/7bc1c54bc719b67c/libs/licenses [21:06:54] : [Step 4/5] [2021-11-19 21:06:54,687][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] Configured plugins: [21:06:54] : [Step 4/5] [2021-11-19 21:06:54,688][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- StanByClusterTestProvider 1.0 [21:06:54] : [Step 4/5] [2021-11-19 21:06:54,688][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- null [21:06:54] : [Step 4/5] [2021-11-19 21:06:54,689][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] [21:06:54] : [Step 4/5] [2021-11-19 21:06:54,689][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- PageMemory tracker plugin 1.0 [21:06:54] : [Step 4/5] [2021-11-19 21:06:54,689][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- null [21:06:54] : [Step 4/5] [2021-11-19 21:06:54,689][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] [21:06:54] : [Step 4/5] [2021-11-19 21:06:54,690][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- TestDistibutedConfigurationPlugin 1.0 [21:06:54] : [Step 4/5] [2021-11-19 21:06:54,690][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- null [21:06:54] : [Step 4/5] [2021-11-19 21:06:54,690][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] [21:06:54] : [Step 4/5] [2021-11-19 21:06:54,691][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- NodeValidationPluginProvider 1.0 [21:06:54] : [Step 4/5] [2021-11-19 21:06:54,691][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- null [21:06:54] : [Step 4/5] [2021-11-19 21:06:54,691][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] [21:06:54] : [Step 4/5] [2021-11-19 21:06:54,692][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][FailureProcessor] Configured failure handler: [hnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]]] [21:06:54] : [Step 4/5] [2021-11-19 21:06:54,781][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][TcpCommunicationSpi] Successfully bound communication NIO server to TCP port [port=45152, locHost=/127.0.0.1, selectorsCnt=12, selectorSpins=0, pairedConn=false] [21:06:54]W: [org.apache.ignite:ignite-core] [2021-11-19 21:06:54,782][WARN ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][TcpCommunicationSpi] Message queue limit is set to 0 which may lead to potential OOMEs when running cache operations in FULL_ASYNC or PRIMARY_SYNC modes due to message queues growth on sender and receiver sides. [21:06:54] : [Step 4/5] [2021-11-19 21:06:54,790][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][GridCollisionManager] Collision resolution is disabled (all jobs will be activated upon arrival). [21:06:54] : [Step 4/5] [2021-11-19 21:06:54,790][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%client1] Security status [authentication=off, sandbox=off, tls/ssl=off] [21:06:54]W: [org.apache.ignite:ignite-core] [2021-11-19 21:06:54,797][WARN ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][GridCacheProcessor] Persistent Store is not supported on client nodes (Persistent Store's configuration will be ignored). [21:06:54] : [Step 4/5] [2021-11-19 21:06:54,801][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][IgniteCacheDatabaseSharedManager] Configured data regions initialized successfully [total=4] [21:06:54] : [Step 4/5] [2021-11-19 21:06:54,806][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][ClientListenerProcessor] Client connector processor has started on TCP port 10802 [21:06:54] : [Step 4/5] [2021-11-19 21:06:54,809][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%client1] Non-loopback local IPs: 172.17.0.4 [21:06:54] : [Step 4/5] [2021-11-19 21:06:54,810][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%client1] Enabled local MACs: 0242AC110004 [21:06:54] : [Step 4/5] [2021-11-19 21:06:54,811][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][ClusterProcessor] Cluster ID and tag has been read from metastorage: null [21:06:54] : [Step 4/5] [2021-11-19 21:06:54,811][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][IgniteClusterImpl] Shutdown policy was updated [oldVal=null, newVal=null] [21:06:54] : [Step 4/5] [2021-11-19 21:06:54,817][INFO ][tcp-disco-srvr-[:47501]-#704%grid-6%-#13560%grid-6%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=34971] [21:06:54] : [Step 4/5] [2021-11-19 21:06:54,817][INFO ][tcp-disco-srvr-[:47501]-#704%grid-6%-#13560%grid-6%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=34971] [21:06:54] : [Step 4/5] [2021-11-19 21:06:54,818][INFO ][tcp-disco-sock-reader-[]-#715%grid-6%-#13658%grid-6%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:34971, rmtPort=34971] [21:06:54] : [Step 4/5] [2021-11-19 21:06:54,819][INFO ][tcp-disco-sock-reader-[10b64e66 127.0.0.1:34971 client]-#715%grid-6%-#13658%grid-6%][TestTcpDiscoverySpi] Initialized connection with remote client node [nodeId=10b64e66-ab6d-42d1-8754-26462cd96001, rmtAddr=/127.0.0.1:34971] [21:06:54] : [Step 4/5] [2021-11-19 21:06:54,841][INFO ][disco-event-worker-#13444%grid-0%][GridDiscoveryManager] Added new node to topology: TcpDiscoveryNode [id=10b64e66-ab6d-42d1-8754-26462cd96001, consistentId=client1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:0], discPort=0, order=3, intOrder=3, lastExchangeTime=1637345214815, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=true] [21:06:54] : [Step 4/5] [2021-11-19 21:06:54,843][INFO ][disco-event-worker-#13444%grid-0%][GridDiscoveryManager] Topology snapshot [ver=3, locNode=009e0037, servers=2, clients=1, state=INACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=009e0037-2e63-4a08-910c-f40b550ad000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=60a34984-0e55-40a3-9b61-4f6c3e2b2006, consistentId=grid-6, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=10b64e66-ab6d-42d1-8754-26462cd96001, consistentId=client1, isClient=true, ver=2.13.0#20211119-sha1:00000000]]] [21:06:54] : [Step 4/5] [2021-11-19 21:06:54,843][INFO ][disco-event-worker-#13566%grid-6%][GridDiscoveryManager] Added new node to topology: TcpDiscoveryNode [id=10b64e66-ab6d-42d1-8754-26462cd96001, consistentId=client1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:0], discPort=0, order=3, intOrder=3, lastExchangeTime=1637345214825, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=true] [21:06:54] : [Step 4/5] [2021-11-19 21:06:54,845][INFO ][tcp-client-disco-msg-worker-#714%client1%-#13656%client1%][TestTcpDiscoverySpi] Router node: TcpDiscoveryNode [id=60a34984-0e55-40a3-9b61-4f6c3e2b2006, consistentId=grid-6, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637345214835, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false] [21:06:54] : [Step 4/5] [2021-11-19 21:06:54,845][INFO ][disco-event-worker-#13566%grid-6%][GridDiscoveryManager] Topology snapshot [ver=3, locNode=60a34984, servers=2, clients=1, state=INACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=009e0037-2e63-4a08-910c-f40b550ad000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=60a34984-0e55-40a3-9b61-4f6c3e2b2006, consistentId=grid-6, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=10b64e66-ab6d-42d1-8754-26462cd96001, consistentId=client1, isClient=true, ver=2.13.0#20211119-sha1:00000000]]] [21:06:54] : [Step 4/5] [2021-11-19 21:06:54,852][INFO ][tcp-client-disco-msg-worker-#714%client1%-#13656%client1%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustEnabled' was changed from 'null' to 'false' [21:06:54] : [Step 4/5] [2021-11-19 21:06:54,852][INFO ][tcp-client-disco-msg-worker-#714%client1%-#13656%client1%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustTimeout' was changed from 'null' to '300000' [21:06:54] : [Step 4/5] [2021-11-19 21:06:54,853][INFO ][tcp-client-disco-msg-worker-#714%client1%-#13656%client1%][IgniteTxManager] Transactions parameter 'collisionsDumpInterval' was changed from 'null' to '1000' [21:06:54] : [Step 4/5] [2021-11-19 21:06:54,853][INFO ][tcp-client-disco-msg-worker-#714%client1%-#13656%client1%][IgniteTxManager] Transactions parameter 'longOperationsDumpTimeout' was changed from 'null' to '60000' [21:06:54] : [Step 4/5] [2021-11-19 21:06:54,854][INFO ][tcp-client-disco-msg-worker-#714%client1%-#13656%client1%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpSamplesPerSecondLimit' was changed from 'null' to '5' [21:06:54] : [Step 4/5] [2021-11-19 21:06:54,855][INFO ][tcp-client-disco-msg-worker-#714%client1%-#13656%client1%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpThreshold' was changed from 'null' to '0' [21:06:54] : [Step 4/5] [2021-11-19 21:06:54,855][INFO ][tcp-client-disco-msg-worker-#714%client1%-#13656%client1%][IgniteTxManager] Transactions parameter 'transactionTimeDumpSamplesCoefficient' was changed from 'null' to '0.0' [21:06:54] : [Step 4/5] [2021-11-19 21:06:54,855][INFO ][tcp-client-disco-msg-worker-#714%client1%-#13656%client1%][IgniteTxManager] Transactions parameter 'txOwnerDumpRequestsAllowed' was changed from 'null' to 'true' [21:06:54] : [Step 4/5] [2021-11-19 21:06:54,856][INFO ][tcp-client-disco-msg-worker-#714%client1%-#13656%client1%][ClusterProcessor] objective_sammet [21:06:54] : [Step 4/5] [2021-11-19 21:06:54,857][INFO ][disco-notifier-worker-#13653%client1%][MvccProcessorImpl] Assigned mvcc coordinator [crd=MvccCoordinator [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], nodeId=009e0037-2e63-4a08-910c-f40b550ad000, ver=1637345212601, local=false, initialized=false]] [21:06:54] : [Step 4/5] [2021-11-19 21:06:54,865][INFO ][sys-#13660%client1%][ClusterProcessor] Writing cluster ID and tag to metastorage on ready for write ClusterIdAndTag [id=0e0553ff-9beb-4886-8624-87e3619f7395, tag=objective_sammet] [21:06:54] : [Step 4/5] [2021-11-19 21:06:54,916][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%client1] To start Console Management & Monitoring run ignitevisorcmd.{sh|bat} [21:06:54] : [Step 4/5] [2021-11-19 21:06:54,917][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%client1] [21:06:54] : [Step 4/5] [21:06:54] : [Step 4/5] >>> +-------------------------------------------+ [21:06:54] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:06:54] : [Step 4/5] >>> +-------------------------------------------+ [21:06:54] : [Step 4/5] >>> OS name: Linux 4.15.0-151-generic amd64 [21:06:54] : [Step 4/5] >>> CPU(s): 24 [21:06:54] : [Step 4/5] >>> Heap: 2.0GB [21:06:54] : [Step 4/5] >>> VM name: 16724@c4dfe9a430b2 [21:06:54] : [Step 4/5] >>> Ignite instance name: client1 [21:06:54] : [Step 4/5] >>> Local node [ID=10B64E66-AB6D-42D1-8754-26462CD96001, order=3, clientMode=true] [21:06:54] : [Step 4/5] >>> Local node addresses: [127.0.0.1] [21:06:54] : [Step 4/5] >>> Local ports: TCP:10802 TCP:45152 [21:06:54] : [Step 4/5] [21:06:54] : [Step 4/5] [2021-11-19 21:06:54,918][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%client1] >>> Ignite cluster is in INACTIVE state (limited functionality available). Use control.(sh|bat) script or IgniteCluster.state(ClusterState.ACTIVE) to change the state. [21:06:54] : [Step 4/5] [2021-11-19 21:06:54,919][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][GridDiscoveryManager] Topology snapshot [ver=3, locNode=10b64e66, servers=2, clients=1, state=INACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=10b64e66-ab6d-42d1-8754-26462cd96001, consistentId=client1, isClient=true, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=009e0037-2e63-4a08-910c-f40b550ad000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=60a34984-0e55-40a3-9b61-4f6c3e2b2006, consistentId=grid-6, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:06:54] : [Step 4/5] [2021-11-19 21:06:54,920][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][G] Node started : [stage="Configure system pool" (0 ms),stage="Start managers" (140 ms),stage="Configure binary metadata" (2 ms),stage="Start processors" (12 ms),stage="Start 'StanByClusterTestProvider' plugin" (0 ms),stage="Start 'PageMemory tracker plugin' plugin" (0 ms),stage="Start 'TestDistibutedConfigurationPlugin' plugin" (0 ms),stage="Start 'NodeValidationPluginProvider' plugin" (0 ms),stage="Init metastore" (2 ms),stage="Finish recovery" (0 ms),stage="Join topology" (54 ms),stage="Await transition" (2 ms),stage="Await exchange" (51 ms),stage="Total time" (263 ms)] [21:06:54] : [Step 4/5] [2021-11-19 21:06:54,922][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][root] Node started with the following configuration [id=10b64e66-ab6d-42d1-8754-26462cd96001, marshaller=BinaryMarshaller [], discovery=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=5000, ackTimeout=5000, marsh=JdkMarshaller [clsFilter=org.apache.ignite.marshaller.MarshallerUtils$1@32fe4bb5], reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], binaryCfg=null, lateAff=true] [21:06:54]W: [org.apache.ignite:ignite-core] [2021-11-19 21:06:54,927][WARN ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][G] Ignite work directory is not provided, automatically resolved to: /opt/buildagent/work/7bc1c54bc719b67c/work [21:06:54] : [Step 4/5] [2021-11-19 21:06:54,929][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-7] [21:06:54] : [Step 4/5] [21:06:54] : [Step 4/5] >>> __________ ________________ [21:06:54] : [Step 4/5] >>> / _/ ___/ |/ / _/_ __/ __/ [21:06:54] : [Step 4/5] >>> _/ // (7 7 // / / / / _/ [21:06:54] : [Step 4/5] >>> /___/\___/_/|_/___/ /_/ /___/ [21:06:54] : [Step 4/5] >>> [21:06:54] : [Step 4/5] >>> ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:06:54] : [Step 4/5] >>> 2021 Copyright(C) Apache Software Foundation [21:06:54] : [Step 4/5] >>> [21:06:54] : [Step 4/5] >>> Ignite documentation: http://ignite.apache.org [21:06:54] : [Step 4/5] [21:06:54] : [Step 4/5] [2021-11-19 21:06:54,930][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-7] Config URL: n/a [21:06:54] : [Step 4/5] [2021-11-19 21:06:54,931][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-7] IgniteConfiguration [igniteInstanceName=grid-7, pubPoolSize=24, svcPoolSize=24, callbackPoolSize=24, stripedPoolSize=24, sysPoolSize=24, mgmtPoolSize=4, dataStreamerPoolSize=24, utilityCachePoolSize=24, utilityCacheKeepAliveTime=60000, p2pPoolSize=2, qryPoolSize=24, buildIdxPoolSize=4, igniteHome=/opt/buildagent/work/7bc1c54bc719b67c, igniteWorkDir=/opt/buildagent/work/7bc1c54bc719b67c/work, mbeanSrv=com.sun.jmx.mbeanserver.JmxMBeanServer@6fe85038, nodeId=7050c3da-1695-4c5d-a6ea-692205dcd007, marsh=BinaryMarshaller [], marshLocJobs=false, daemon=false, p2pEnabled=true, netTimeout=10000, netCompressionLevel=1, sndRetryDelay=1000, sndRetryCnt=3, metricsHistSize=10000, metricsUpdateFreq=1000, metricsExpTime=9223372036854775807, discoSpi=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=0, ackTimeout=0, marsh=null, reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], segPlc=STOP, segResolveAttempts=2, waitForSegOnStart=true, allResolversPassReq=true, segChkFreq=10000, commSpi=TcpCommunicationSpi [connectGate=org.apache.ignite.spi.communication.tcp.internal.ConnectGateway@272aadb4, ctxInitLatch=java.util.concurrent.CountDownLatch@1b4a871e[Count = 1], stopping=false, clientPool=null, nioSrvWrapper=null, stateProvider=null], evtSpi=MemoryEventStorageSpi [expireAgeMs=9223372036854775807, expireCnt=10000, filter=null], colSpi=NoopCollisionSpi [], deploySpi=LocalDeploymentSpi [], indexingSpi=org.apache.ignite.spi.indexing.noop.NoopIndexingSpi@59770c7e, addrRslvr=null, encryptionSpi=org.apache.ignite.spi.encryption.keystore.KeystoreEncryptionSpi@7d470ca, tracingSpi=org.apache.ignite.spi.tracing.NoopTracingSpi@19da7dd5, clientMode=false, rebalanceThreadPoolSize=4, rebalanceTimeout=10000, rebalanceBatchesPrefetchCnt=3, rebalanceThrottle=0, rebalanceBatchSize=524288, txCfg=TransactionConfiguration [txSerEnabled=false, dfltIsolation=REPEATABLE_READ, dfltConcurrency=PESSIMISTIC, dfltTxTimeout=0, txTimeoutOnPartitionMapExchange=0, deadlockTimeout=10000, pessimisticTxLogSize=0, pessimisticTxLogLinger=10000, tmLookupClsName=null, txManagerFactory=null, useJtaSync=false], cacheSanityCheckEnabled=true, discoStartupDelay=60000, deployMode=SHARED, p2pMissedCacheSize=100, locHost=127.0.0.1, timeSrvPortBase=31100, timeSrvPortRange=100, failureDetectionTimeout=10000, sysWorkerBlockedTimeout=null, clientFailureDetectionTimeout=10000, metricsLogFreq=0, connectorCfg=null, odbcCfg=null, warmupClos=null, atomicCfg=AtomicConfiguration [seqReserveSize=1000, cacheMode=PARTITIONED, backups=1, aff=null, grpName=null], classLdr=null, sslCtxFactory=null, platformCfg=null, binaryCfg=null, memCfg=null, pstCfg=null, dsCfg=DataStorageConfiguration [sysRegionInitSize=41943040, sysRegionMaxSize=104857600, pageSize=4096, concLvl=0, dfltDataRegConf=DataRegionConfiguration [name=default, maxSize=10485760, initSize=268435456, swapPath=null, pageEvictionMode=DISABLED, pageReplacementMode=CLOCK, evictionThreshold=0.9, emptyPagesPoolSize=100, metricsEnabled=false, metricsSubIntervalCount=5, metricsRateTimeInterval=60000, persistenceEnabled=true, checkpointPageBufSize=0, lazyMemoryAllocation=true, warmUpCfg=null], dataRegions=null, storagePath=null, checkpointFreq=180000, lockWaitTime=10000, checkpointThreads=4, checkpointWriteOrder=SEQUENTIAL, walHistSize=20, maxWalArchiveSize=1073741824, walSegments=10, walSegmentSize=67108864, walPath=db/wal, walArchivePath=db/wal/archive, cdcWalPath=db/wal/cdc, cdcEnabled=false, metricsEnabled=false, walMode=FSYNC, walTlbSize=131072, walBuffSize=0, walFlushFreq=2000, walFsyncDelay=1000, walRecordIterBuffSize=67108864, alwaysWriteFullPages=false, fileIOFactory=org.apache.ignite.internal.processors.cache.persistence.file.AsyncFileIOFactory@58a4b81f, metricsSubIntervalCnt=5, metricsRateTimeInterval=60000, walAutoArchiveAfterInactivity=-1, walForceArchiveTimeout=-1, writeThrottlingEnabled=false, walCompactionEnabled=false, walCompactionLevel=1, checkpointReadLockTimeout=null, walPageCompression=DISABLED, walPageCompressionLevel=null, dfltWarmUpCfg=null, encCfg=org.apache.ignite.configuration.EncryptionConfiguration@23847dc2, defragmentationThreadPoolSize=4, minWalArchiveSize=-1], snapshotPath=snapshots, activeOnStart=true, activeOnStartPropSetFlag=false, autoActivation=true, autoActivationPropSetFlag=false, clusterStateOnStart=null, sqlConnCfg=null, cliConnCfg=ClientConnectorConfiguration [host=null, port=10800, portRange=100, sockSndBufSize=0, sockRcvBufSize=0, tcpNoDelay=true, maxOpenCursorsPerConn=128, threadPoolSize=24, selectorCnt=12, idleTimeout=0, handshakeTimeout=10000, jdbcEnabled=true, odbcEnabled=true, thinCliEnabled=true, sslEnabled=false, useIgniteSslCtxFactory=true, sslClientAuth=false, sslCtxFactory=null, thinCliCfg=ThinClientConfiguration [maxActiveTxPerConn=100, maxActiveComputeTasksPerConn=0]], mvccVacuumThreadCnt=2, mvccVacuumFreq=5000, authEnabled=false, failureHnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]], commFailureRslvr=null, sqlCfg=SqlConfiguration [longQryWarnTimeout=3000, dfltQryTimeout=0, sqlQryHistSize=1000, validationEnabled=false], asyncContinuationExecutor=null] [21:06:54] : [Step 4/5] [2021-11-19 21:06:54,939][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-7] Daemon mode: off [21:06:54] : [Step 4/5] [2021-11-19 21:06:54,939][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-7] OS: Linux 4.15.0-151-generic amd64 [21:06:54] : [Step 4/5] [2021-11-19 21:06:54,939][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-7] OS user: teamcity [21:06:54] : [Step 4/5] [2021-11-19 21:06:54,940][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-7] PID: 16724 [21:06:54] : [Step 4/5] [2021-11-19 21:06:54,940][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-7] Language runtime: Java Platform API Specification ver. 1.8 [21:06:54] : [Step 4/5] [2021-11-19 21:06:54,940][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-7] VM information: Java(TM) SE Runtime Environment 1.8.0_261-b12 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 25.261-b12 [21:06:54] : [Step 4/5] [2021-11-19 21:06:54,941][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-7] VM total memory: 1.8GB [21:06:54] : [Step 4/5] [2021-11-19 21:06:54,941][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-7] Remote Management [restart: off, REST: off, JMX (remote: off)] [21:06:54] : [Step 4/5] [2021-11-19 21:06:54,941][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-7] Logger: GridTestLog4jLogger [quiet=false, config=null] [21:06:54] : [Step 4/5] [2021-11-19 21:06:54,942][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-7] IGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c [21:06:54] : [Step 4/5] [2021-11-19 21:06:54,942][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-7] VM arguments: [-DIGNITE_DUMP_THREADS_ON_FAILURE=false, -DMono=/usr/bin/mono-sgen, -DMono4.0_x64=/usr/lib/mono/4.0, -DMono4.5_x64=/usr/lib/mono/4.5, -DMonoVersion=6.12.0.90, -DSKIP_BUILD=false, -Dagent.home.dir=/opt/buildagent, -Dagent.name=aitc-lin02_03, -Dagent.ownPort=9090, -Dagent.work.dir=/opt/buildagent/work, -Dbuild.number=95, -Dbuild.vcs.number=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.1=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.GitHubApacheIgnite=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dclassworlds.conf=/opt/buildagent/temp/buildTmp/teamcity.m2.conf, -Dcom.jetbrains.maven.watcher.report.file=/opt/buildagent/temp/buildTmp/maven-build-info.xml, -Djava.io.tmpdir=/opt/buildagent/temp/buildTmp, -Dmaven.home=/opt/buildagent/tools/maven3_6, -Dmaven.multiModuleProjectDirectory=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.agent.cpuBenchmark=457, -Dteamcity.agent.dotnet.agent_url=http://localhost:9090/RPC2, -Dteamcity.agent.dotnet.build_id=6278078, -Dteamcity.auth.password=*******, -Dteamcity.auth.userId=TeamCityBuildId=6278078, -Dteamcity.build.changedFiles.file=/opt/buildagent/temp/buildTmp/changedFiles6342607772318147725.txt, -Dteamcity.build.checkoutDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.build.id=6278078, -Dteamcity.build.properties.file=/opt/buildagent/temp/buildTmp/teamcity.build5164517880467851002.properties, -Dteamcity.build.tempDir=/opt/buildagent/temp/buildTmp, -Dteamcity.build.workingDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.buildConfName=Basic 3, -Dteamcity.buildType.id=IgniteTests24Java8_Basic3, -Dteamcity.configuration.properties.file=/opt/buildagent/temp/buildTmp/teamcity.config5591980786735343870.properties, -Dteamcity.maven.userSettings.path=/opt/buildagent/temp/buildTmp/maven_settings_585072866407032347.xml, -Dteamcity.maven.watcher.home=/opt/buildagent/plugins/mavenPlugin/maven-watcher-jdk16, -Dteamcity.projectName=Ignite Tests 2.x (JDK 8/11), -Dteamcity.runner.properties.file=/opt/buildagent/temp/buildTmp/teamcity.runner9098465561618137420.properties, -Dteamcity.tests.recentlyFailedTests.file=/opt/buildagent/temp/buildTmp/testsToRunFirst3891775683130404069.txt, -Dteamcity.version=2021.2 (build 99542), -ea, -Xms2g, -Xmx2g, -XX:+HeapDumpOnOutOfMemoryError, -DIGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_TEST_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_UPDATE_NOTIFIER=false, -DIGNITE_NO_DISCO_ORDER=true, -DIGNITE_PERFORMANCE_SUGGESTIONS_DISABLED=true, -Djava.net.preferIPv4Stack=true, -DTEST_SCALE_FACTOR=1.0, -DIGNITE_TEST_PROP_LOG4J_FILE=log4j-tc-test.xml, -DIGNITE_QUIET=false, -DIGNITE_MARSHAL_BUFFERS_RECHECK=1000, -Dmaven.repo.local=/opt/buildagent/.m2/repository] [21:06:54] : [Step 4/5] [2021-11-19 21:06:54,946][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-7] System cache's DataRegion size is configured to 40 MB. Use DataStorageConfiguration.systemRegionInitialSize property to change the setting. [21:06:54] : [Step 4/5] [2021-11-19 21:06:54,947][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-7] Configured caches [in 'sysMemPlc' dataRegion: ['ignite-sys-cache'], in 'default' dataRegion: ['encrypted']] [21:06:54]W: [org.apache.ignite:ignite-core] [2021-11-19 21:06:54,947][WARN ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-7] Peer class loading is enabled (disable it in production for performance and deployment consistency reasons) [21:06:54] : [Step 4/5] [2021-11-19 21:06:54,947][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-7] 3-rd party licenses can be found at: /opt/buildagent/work/7bc1c54bc719b67c/libs/licenses [21:06:54] : [Step 4/5] [2021-11-19 21:06:54,953][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] Configured plugins: [21:06:54] : [Step 4/5] [2021-11-19 21:06:54,953][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- StanByClusterTestProvider 1.0 [21:06:54] : [Step 4/5] [2021-11-19 21:06:54,953][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- null [21:06:54] : [Step 4/5] [2021-11-19 21:06:54,954][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] [21:06:54] : [Step 4/5] [2021-11-19 21:06:54,954][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- PageMemory tracker plugin 1.0 [21:06:54] : [Step 4/5] [2021-11-19 21:06:54,954][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- null [21:06:54] : [Step 4/5] [2021-11-19 21:06:54,954][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] [21:06:54] : [Step 4/5] [2021-11-19 21:06:54,955][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- TestDistibutedConfigurationPlugin 1.0 [21:06:54] : [Step 4/5] [2021-11-19 21:06:54,955][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- null [21:06:54] : [Step 4/5] [2021-11-19 21:06:54,955][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] [21:06:54] : [Step 4/5] [2021-11-19 21:06:54,955][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- NodeValidationPluginProvider 1.0 [21:06:54] : [Step 4/5] [2021-11-19 21:06:54,956][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] ^-- null [21:06:54] : [Step 4/5] [2021-11-19 21:06:54,956][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][IgnitePluginProcessor] [21:06:54] : [Step 4/5] [2021-11-19 21:06:54,956][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][FailureProcessor] Configured failure handler: [hnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]]] [21:06:55] : [Step 4/5] [2021-11-19 21:06:55,013][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][TcpCommunicationSpi] Successfully bound communication NIO server to TCP port [port=45153, locHost=/127.0.0.1, selectorsCnt=12, selectorSpins=0, pairedConn=false] [21:06:55]W: [org.apache.ignite:ignite-core] [2021-11-19 21:06:55,013][WARN ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][TcpCommunicationSpi] Message queue limit is set to 0 which may lead to potential OOMEs when running cache operations in FULL_ASYNC or PRIMARY_SYNC modes due to message queues growth on sender and receiver sides. [21:06:55] : [Step 4/5] [2021-11-19 21:06:55,024][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][GridCollisionManager] Collision resolution is disabled (all jobs will be activated upon arrival). [21:06:55] : [Step 4/5] [2021-11-19 21:06:55,024][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-7] Security status [authentication=off, sandbox=off, tls/ssl=off] [21:06:55] : [Step 4/5] [2021-11-19 21:06:55,087][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:06:55] : [Step 4/5] [2021-11-19 21:06:55,195][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][MaintenanceProcessor] Resolved store directory for node persistent data: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_7 [21:06:55] : [Step 4/5] [2021-11-19 21:06:55,197][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][CacheObjectBinaryProcessorImpl] Resolved directory for serialized binary metadata: /opt/buildagent/work/7bc1c54bc719b67c/work/db/binary_meta/grid_7 [21:06:55] : [Step 4/5] [2021-11-19 21:06:55,206][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_7 [21:06:55] : [Step 4/5] [2021-11-19 21:06:55,207][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][FileWriteAheadLogManager] Resolved write ahead log work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_7 [21:06:55] : [Step 4/5] [2021-11-19 21:06:55,207][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][FileWriteAheadLogManager] Resolved write ahead log archive directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_7 [21:06:56] : [Step 4/5] [2021-11-19 21:06:56,006][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_7/0000000000000000.wal [21:06:56] : [Step 4/5] [2021-11-19 21:06:56,012][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Configured data regions initialized successfully [total=5] [21:06:56] : [Step 4/5] [2021-11-19 21:06:56,018][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][IgniteSnapshotManager] Resolved snapshot work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/snapshots [21:06:56] : [Step 4/5] [2021-11-19 21:06:56,018][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][IgniteSnapshotManager] Resolved temp directory for snapshot creation: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_7/snp [21:06:56] : [Step 4/5] [2021-11-19 21:06:56,022][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][ClientListenerProcessor] Client connector processor has started on TCP port 10803 [21:06:56] : [Step 4/5] [2021-11-19 21:06:56,027][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-7] Non-loopback local IPs: 172.17.0.4 [21:06:56] : [Step 4/5] [2021-11-19 21:06:56,027][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-7] Enabled local MACs: 0242AC110004 [21:06:56] : [Step 4/5] [2021-11-19 21:06:56,028][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:06:56] : [Step 4/5] [2021-11-19 21:06:56,030][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:06:56] : [Step 4/5] [2021-11-19 21:06:56,031][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:06:56] : [Step 4/5] [2021-11-19 21:06:56,034][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Applying lost metastore updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:06:56] : [Step 4/5] [2021-11-19 21:06:56,036][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=0 ms] [21:06:56] : [Step 4/5] [2021-11-19 21:06:56,036][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][GridCacheProcessor] Restoring partition state for local groups. [21:06:56] : [Step 4/5] [2021-11-19 21:06:56,037][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=0, partitionsProcessed=0, time=0ms] [21:06:56] : [Step 4/5] [2021-11-19 21:06:56,038][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][GridEncryptionManager] Encryption keys loaded from metastore. [grps=, masterKeyName=ignite.master.key] [21:06:56] : [Step 4/5] [2021-11-19 21:06:56,040][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][ClusterProcessor] Cluster ID and tag has been read from metastorage: null [21:06:56] : [Step 4/5] [2021-11-19 21:06:56,040][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][IgniteClusterImpl] Shutdown policy was updated [oldVal=null, newVal=null] [21:06:56] : [Step 4/5] [2021-11-19 21:06:56,041][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Checkpoint frequency deviation changed [oldVal=null, newVal=null] [21:06:56] : [Step 4/5] [2021-11-19 21:06:56,053][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][FilePageStoreManager] Cleanup cache stores [total=1, left=0, cleanFiles=false] [21:06:56] : [Step 4/5] [2021-11-19 21:06:56,056][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:06:56] : [Step 4/5] [2021-11-19 21:06:56,057][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:06:56] : [Step 4/5] [2021-11-19 21:06:56,059][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:06:56] : [Step 4/5] [2021-11-19 21:06:56,060][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Data Regions Started: 5 [21:06:56] : [Step 4/5] [2021-11-19 21:06:56,060][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] ^-- sysMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:06:56] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:06:56] : [Step 4/5] ^-- default region [type=default, persistence=true, lazyAlloc=true, [21:06:56] : [Step 4/5] ... initCfg=10MB, maxCfg=10MB, usedRam=0MB, freeRam=100%, allocRam=0MB, allocTotal=0MB] [21:06:56] : [Step 4/5] ^-- metastoreMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:06:56] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:06:56] : [Step 4/5] ^-- TxLog region [type=internal, persistence=true, lazyAlloc=false, [21:06:56] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:06:56] : [Step 4/5] ^-- volatileDsMemPlc region [type=user, persistence=false, lazyAlloc=true, [21:06:56] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB] [21:06:56] : [Step 4/5] ^-- Ignite persistence [used=0MB] [21:06:56] : [Step 4/5] [21:06:56] : [Step 4/5] [2021-11-19 21:06:56,062][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Starting binary memory restore for: [-2100569601, 1613773252] [21:06:56] : [Step 4/5] [2021-11-19 21:06:56,156][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:06:56] : [Step 4/5] [2021-11-19 21:06:56,156][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:06:56] : [Step 4/5] [2021-11-19 21:06:56,158][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_7/0000000000000000.wal, offset=0, ver=2] [21:06:56] : [Step 4/5] [2021-11-19 21:06:56,277][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][GridCacheProcessor] Started cache in recovery mode [name=ignite-sys-cache, id=-2100569601, dataRegionName=sysMemPlc, mode=REPLICATED, atomicity=TRANSACTIONAL, backups=2147483647, mvcc=false] [21:06:56] : [Step 4/5] [2021-11-19 21:06:56,278][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][PageMemoryImpl] Started page memory [memoryAllocated=24.0 MiB, pages=5952, tableSize=474.2 KiB, replacementSize=768 B, checkpointBuffer=10.0 MiB] [21:06:56] : [Step 4/5] [2021-11-19 21:06:56,282][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][GridCacheProcessor] Started cache in recovery mode [name=encrypted, id=1613773252, dataRegionName=default, mode=PARTITIONED, atomicity=TRANSACTIONAL, backups=0, mvcc=false] [21:06:56] : [Step 4/5] [2021-11-19 21:06:56,283][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Binary recovery performed in 221 ms. [21:06:56] : [Step 4/5] [2021-11-19 21:06:56,283][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:06:56] : [Step 4/5] [2021-11-19 21:06:56,283][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Applying lost cache updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:06:56] : [Step 4/5] [2021-11-19 21:06:56,348][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=61 ms] [21:06:56] : [Step 4/5] [2021-11-19 21:06:56,348][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][GridCacheProcessor] Restoring partition state for local groups. [21:06:56] : [Step 4/5] [2021-11-19 21:06:56,418][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=2, partitionsProcessed=1124, time=71ms] [21:06:56] : [Step 4/5] [2021-11-19 21:06:56,814][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][TestTcpDiscoverySpi] Successfully bound to TCP port [port=47502, localHost=localhost/127.0.0.1, locNodeId=7050c3da-1695-4c5d-a6ea-692205dcd007] [21:06:56] : [Step 4/5] [2021-11-19 21:06:56,818][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][GridEncryptionManager] Sending new group keys to coordinator [grps=1613773252] [21:06:56] : [Step 4/5] [2021-11-19 21:06:56,820][INFO ][tcp-disco-srvr-[:47500]-#699%grid-0%-#13442%grid-0%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=46269] [21:06:56] : [Step 4/5] [2021-11-19 21:06:56,821][INFO ][tcp-disco-srvr-[:47500]-#699%grid-0%-#13442%grid-0%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=46269] [21:06:56] : [Step 4/5] [2021-11-19 21:06:56,824][INFO ][tcp-disco-sock-reader-[]-#721%grid-0%-#13779%grid-0%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:46269, rmtPort=46269] [21:06:56] : [Step 4/5] [2021-11-19 21:06:56,826][INFO ][tcp-disco-sock-reader-[7050c3da 127.0.0.1:46269]-#721%grid-0%-#13779%grid-0%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=7050c3da-1695-4c5d-a6ea-692205dcd007, rmtAddr=/127.0.0.1:46269] [21:06:56] : [Step 4/5] [2021-11-19 21:06:56,830][INFO ][tcp-disco-srvr-[:47502]-#720%grid-7%-#13778%grid-7%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=57035] [21:06:56] : [Step 4/5] [2021-11-19 21:06:56,830][INFO ][tcp-disco-srvr-[:47502]-#720%grid-7%-#13778%grid-7%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=57035] [21:06:56] : [Step 4/5] [2021-11-19 21:06:56,832][INFO ][tcp-disco-sock-reader-[]-#722%grid-7%-#13780%grid-7%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:57035, rmtPort=57035] [21:06:56] : [Step 4/5] [2021-11-19 21:06:56,833][INFO ][tcp-disco-sock-reader-[]-#722%grid-7%-#13780%grid-7%][TestTcpDiscoverySpi] Received ping request from the remote node [rmtNodeId=009e0037-2e63-4a08-910c-f40b550ad000, rmtAddr=/127.0.0.1:57035, rmtPort=57035] [21:06:56] : [Step 4/5] [2021-11-19 21:06:56,834][INFO ][tcp-disco-sock-reader-[7050c3da 127.0.0.1:46269]-#721%grid-0%-#13779%grid-0%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:46269, rmtPort=46269, rmtNodeId=7050c3da-1695-4c5d-a6ea-692205dcd007] [21:06:56] : [Step 4/5] [2021-11-19 21:06:56,835][INFO ][tcp-disco-sock-reader-[]-#722%grid-7%-#13780%grid-7%][TestTcpDiscoverySpi] Finished writing ping response [rmtNodeId=009e0037-2e63-4a08-910c-f40b550ad000, rmtAddr=/127.0.0.1:57035, rmtPort=57035] [21:06:56] : [Step 4/5] [2021-11-19 21:06:56,836][INFO ][tcp-disco-sock-reader-[]-#722%grid-7%-#13780%grid-7%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:57035, rmtPort=57035, rmtNodeId=null] [21:06:56] : [Step 4/5] [2021-11-19 21:06:56,837][INFO ][tcp-disco-msg-worker-[60a34984 127.0.0.1:47501 crd]-#698%grid-0%-#13441%grid-0%][GridEncryptionManager] Joining node doesn't have stored group keys [node=7050c3da-1695-4c5d-a6ea-692205dcd007] [21:06:56] : [Step 4/5] [2021-11-19 21:06:56,840][INFO ][tcp-disco-msg-worker-[60a34984 127.0.0.1:47501 crd]-#698%grid-0%-#13441%grid-0%][GridEncryptionManager] Store group key received from joining node [node=7050c3da-1695-4c5d-a6ea-692205dcd007, grp=1613773252] [21:06:56] : [Step 4/5] [2021-11-19 21:06:56,848][INFO ][tcp-disco-msg-worker-[009e0037 127.0.0.1:47500]-#703%grid-6%-#13559%grid-6%][GridEncryptionManager] Store group key received from joining node [node=7050c3da-1695-4c5d-a6ea-692205dcd007, grp=1613773252] [21:06:56] : [Step 4/5] [2021-11-19 21:06:56,851][INFO ][tcp-disco-msg-worker-[009e0037 127.0.0.1:47500]-#703%grid-6%-#13559%grid-6%][TestTcpDiscoverySpi] New next node [newNext=TcpDiscoveryNode [id=7050c3da-1695-4c5d-a6ea-692205dcd007, consistentId=grid-7, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47502], discPort=47502, order=0, intOrder=4, lastExchangeTime=1637345216838, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false]] [21:06:56] : [Step 4/5] [2021-11-19 21:06:56,852][INFO ][tcp-disco-sock-reader-[60a34984 127.0.0.1:37237]-#708%grid-0%-#13564%grid-0%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:37237, rmtPort=37237, rmtNodeId=60a34984-0e55-40a3-9b61-4f6c3e2b2006] [21:06:56] : [Step 4/5] [2021-11-19 21:06:56,852][INFO ][tcp-disco-srvr-[:47502]-#720%grid-7%-#13778%grid-7%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=49159] [21:06:56] : [Step 4/5] [2021-11-19 21:06:56,853][INFO ][tcp-disco-srvr-[:47502]-#720%grid-7%-#13778%grid-7%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=49159] [21:06:56] : [Step 4/5] [2021-11-19 21:06:56,853][INFO ][tcp-disco-sock-reader-[]-#723%grid-7%-#13781%grid-7%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:49159, rmtPort=49159] [21:06:56] : [Step 4/5] [2021-11-19 21:06:56,855][INFO ][tcp-disco-sock-reader-[60a34984 127.0.0.1:49159]-#723%grid-7%-#13781%grid-7%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=60a34984-0e55-40a3-9b61-4f6c3e2b2006, rmtAddr=/127.0.0.1:49159] [21:06:56] : [Step 4/5] [2021-11-19 21:06:56,859][INFO ][tcp-disco-msg-worker-[]-#719%grid-7%-#13777%grid-7%][TestTcpDiscoverySpi] New next node [newNext=TcpDiscoveryNode [id=009e0037-2e63-4a08-910c-f40b550ad000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345216848, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false]] [21:06:56] : [Step 4/5] [2021-11-19 21:06:56,860][INFO ][tcp-disco-srvr-[:47500]-#699%grid-0%-#13442%grid-0%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=41475] [21:06:56] : [Step 4/5] [2021-11-19 21:06:56,860][INFO ][tcp-disco-srvr-[:47500]-#699%grid-0%-#13442%grid-0%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=41475] [21:06:56] : [Step 4/5] [2021-11-19 21:06:56,861][INFO ][tcp-disco-sock-reader-[]-#724%grid-0%-#13782%grid-0%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:41475, rmtPort=41475] [21:06:56] : [Step 4/5] [2021-11-19 21:06:56,862][INFO ][tcp-disco-sock-reader-[7050c3da 127.0.0.1:41475]-#724%grid-0%-#13782%grid-0%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=7050c3da-1695-4c5d-a6ea-692205dcd007, rmtAddr=/127.0.0.1:41475] [21:06:56] : [Step 4/5] [2021-11-19 21:06:56,866][INFO ][disco-event-worker-#13444%grid-0%][GridDiscoveryManager] Added new node to topology: TcpDiscoveryNode [id=7050c3da-1695-4c5d-a6ea-692205dcd007, consistentId=grid-7, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47502], discPort=47502, order=4, intOrder=4, lastExchangeTime=1637345216817, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false] [21:06:56] : [Step 4/5] [2021-11-19 21:06:56,867][INFO ][tcp-client-disco-msg-worker-#714%client1%-#13656%client1%][TestTcpDiscoverySpi] Router node: TcpDiscoveryNode [id=60a34984-0e55-40a3-9b61-4f6c3e2b2006, consistentId=grid-6, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637345214835, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false] [21:06:56] : [Step 4/5] [2021-11-19 21:06:56,866][INFO ][disco-event-worker-#13566%grid-6%][GridDiscoveryManager] Added new node to topology: TcpDiscoveryNode [id=7050c3da-1695-4c5d-a6ea-692205dcd007, consistentId=grid-7, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47502], discPort=47502, order=4, intOrder=4, lastExchangeTime=1637345216838, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false] [21:06:56] : [Step 4/5] [2021-11-19 21:06:56,869][INFO ][disco-event-worker-#13661%client1%][GridDiscoveryManager] Added new node to topology: TcpDiscoveryNode [id=7050c3da-1695-4c5d-a6ea-692205dcd007, consistentId=grid-7, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47502], discPort=47502, order=4, intOrder=4, lastExchangeTime=1637345216848, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false] [21:06:56] : [Step 4/5] [2021-11-19 21:06:56,868][INFO ][disco-event-worker-#13444%grid-0%][GridDiscoveryManager] Topology snapshot [ver=4, locNode=009e0037, servers=3, clients=1, state=INACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=009e0037-2e63-4a08-910c-f40b550ad000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=60a34984-0e55-40a3-9b61-4f6c3e2b2006, consistentId=grid-6, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=10b64e66-ab6d-42d1-8754-26462cd96001, consistentId=client1, isClient=true, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=7050c3da-1695-4c5d-a6ea-692205dcd007, consistentId=grid-7, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:06:56] : [Step 4/5] [2021-11-19 21:06:56,870][INFO ][disco-event-worker-#13661%client1%][GridDiscoveryManager] Topology snapshot [ver=4, locNode=10b64e66, servers=3, clients=1, state=INACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=10b64e66-ab6d-42d1-8754-26462cd96001, consistentId=client1, isClient=true, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=009e0037-2e63-4a08-910c-f40b550ad000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=60a34984-0e55-40a3-9b61-4f6c3e2b2006, consistentId=grid-6, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=7050c3da-1695-4c5d-a6ea-692205dcd007, consistentId=grid-7, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:06:56] : [Step 4/5] [2021-11-19 21:06:56,870][INFO ][tcp-disco-msg-worker-[009e0037 127.0.0.1:47500]-#719%grid-7%-#13777%grid-7%][GridEncryptionManager] Store group key received from coordinator [grp=1613773252, keyId=0] [21:06:56] : [Step 4/5] [2021-11-19 21:06:56,869][INFO ][disco-event-worker-#13566%grid-6%][GridDiscoveryManager] Topology snapshot [ver=4, locNode=60a34984, servers=3, clients=1, state=INACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=009e0037-2e63-4a08-910c-f40b550ad000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=60a34984-0e55-40a3-9b61-4f6c3e2b2006, consistentId=grid-6, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=10b64e66-ab6d-42d1-8754-26462cd96001, consistentId=client1, isClient=true, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=7050c3da-1695-4c5d-a6ea-692205dcd007, consistentId=grid-7, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:06:56] : [Step 4/5] [2021-11-19 21:06:56,874][INFO ][tcp-disco-msg-worker-[009e0037 127.0.0.1:47500]-#719%grid-7%-#13777%grid-7%][ClusterProcessor] objective_sammet [21:06:56] : [Step 4/5] [2021-11-19 21:06:56,875][INFO ][tcp-disco-msg-worker-[009e0037 127.0.0.1:47500]-#719%grid-7%-#13777%grid-7%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustEnabled' was changed from 'null' to 'false' [21:06:56] : [Step 4/5] [2021-11-19 21:06:56,875][INFO ][tcp-disco-msg-worker-[009e0037 127.0.0.1:47500]-#719%grid-7%-#13777%grid-7%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustTimeout' was changed from 'null' to '300000' [21:06:56] : [Step 4/5] [2021-11-19 21:06:56,875][INFO ][tcp-disco-msg-worker-[009e0037 127.0.0.1:47500]-#719%grid-7%-#13777%grid-7%][IgniteTxManager] Transactions parameter 'longOperationsDumpTimeout' was changed from 'null' to '60000' [21:06:56] : [Step 4/5] [2021-11-19 21:06:56,876][INFO ][tcp-disco-msg-worker-[009e0037 127.0.0.1:47500]-#719%grid-7%-#13777%grid-7%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpThreshold' was changed from 'null' to '0' [21:06:56] : [Step 4/5] [2021-11-19 21:06:56,876][INFO ][tcp-disco-msg-worker-[009e0037 127.0.0.1:47500]-#719%grid-7%-#13777%grid-7%][IgniteTxManager] Transactions parameter 'transactionTimeDumpSamplesCoefficient' was changed from 'null' to '0.0' [21:06:56] : [Step 4/5] [2021-11-19 21:06:56,876][INFO ][tcp-disco-msg-worker-[009e0037 127.0.0.1:47500]-#719%grid-7%-#13777%grid-7%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpSamplesPerSecondLimit' was changed from 'null' to '5' [21:06:56] : [Step 4/5] [2021-11-19 21:06:56,877][INFO ][tcp-disco-msg-worker-[009e0037 127.0.0.1:47500]-#719%grid-7%-#13777%grid-7%][IgniteTxManager] Transactions parameter 'collisionsDumpInterval' was changed from 'null' to '1000' [21:06:56] : [Step 4/5] [2021-11-19 21:06:56,877][INFO ][tcp-disco-msg-worker-[009e0037 127.0.0.1:47500]-#719%grid-7%-#13777%grid-7%][IgniteTxManager] Transactions parameter 'txOwnerDumpRequestsAllowed' was changed from 'null' to 'true' [21:06:56] : [Step 4/5] [2021-11-19 21:06:56,877][INFO ][tcp-disco-msg-worker-[009e0037 127.0.0.1:47500]-#719%grid-7%-#13777%grid-7%][GridCacheDatabaseSharedManager] Historical rebalance WAL threshold changed [property=historical.rebalance.threshold, oldVal=null, newVal=500] [21:06:56] : [Step 4/5] [2021-11-19 21:06:56,879][INFO ][disco-notifier-worker-#13776%grid-7%][MvccProcessorImpl] Assigned mvcc coordinator [crd=MvccCoordinator [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], nodeId=009e0037-2e63-4a08-910c-f40b550ad000, ver=1637345212601, local=false, initialized=false]] [21:06:56] : [Step 4/5] [2021-11-19 21:06:56,886][INFO ][sys-#13765%grid-7%][ClusterProcessor] Writing cluster ID and tag to metastorage on ready for write ClusterIdAndTag [id=0e0553ff-9beb-4886-8624-87e3619f7395, tag=objective_sammet] [21:06:56] : [Step 4/5] [2021-11-19 21:06:56,923][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-7] To start Console Management & Monitoring run ignitevisorcmd.{sh|bat} [21:06:56] : [Step 4/5] [2021-11-19 21:06:56,924][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-7] [21:06:56] : [Step 4/5] [21:06:56] : [Step 4/5] >>> +-------------------------------------------+ [21:06:56] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:06:56] : [Step 4/5] >>> +-------------------------------------------+ [21:06:56] : [Step 4/5] >>> OS name: Linux 4.15.0-151-generic amd64 [21:06:56] : [Step 4/5] >>> CPU(s): 24 [21:06:56] : [Step 4/5] >>> Heap: 2.0GB [21:06:56] : [Step 4/5] >>> VM name: 16724@c4dfe9a430b2 [21:06:56] : [Step 4/5] >>> Ignite instance name: grid-7 [21:06:56] : [Step 4/5] >>> Local node [ID=7050C3DA-1695-4C5D-A6EA-692205DCD007, order=4, clientMode=false] [21:06:56] : [Step 4/5] >>> Local node addresses: [127.0.0.1] [21:06:56] : [Step 4/5] >>> Local ports: TCP:10803 TCP:45153 TCP:47502 [21:06:56] : [Step 4/5] [21:06:56] : [Step 4/5] [2021-11-19 21:06:56,925][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][IgniteKernal%grid-7] >>> Ignite cluster is in INACTIVE state (limited functionality available). Use control.(sh|bat) script or IgniteCluster.state(ClusterState.ACTIVE) to change the state. [21:06:56] : [Step 4/5] [2021-11-19 21:06:56,926][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][GridDiscoveryManager] Topology snapshot [ver=4, locNode=7050c3da, servers=3, clients=1, state=INACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=009e0037-2e63-4a08-910c-f40b550ad000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=60a34984-0e55-40a3-9b61-4f6c3e2b2006, consistentId=grid-6, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=10b64e66-ab6d-42d1-8754-26462cd96001, consistentId=client1, isClient=true, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=7050c3da-1695-4c5d-a6ea-692205dcd007, consistentId=grid-7, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:06:56] : [Step 4/5] [2021-11-19 21:06:56,928][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][G] Node started : [stage="Configure system pool" (0 ms),stage="Start managers" (268 ms),stage="Configure binary metadata" (5 ms),stage="Start processors" (824 ms),stage="Start 'StanByClusterTestProvider' plugin" (0 ms),stage="Start 'PageMemory tracker plugin' plugin" (0 ms),stage="Start 'TestDistibutedConfigurationPlugin' plugin" (0 ms),stage="Start 'NodeValidationPluginProvider' plugin" (0 ms),stage="Init metastore" (27 ms),stage="Init and start regions" (8 ms),stage="Restore binary memory" (220 ms),stage="Restore logical state" (135 ms),stage="Finish recovery" (388 ms),stage="Join topology" (72 ms),stage="Await transition" (8 ms),stage="Await exchange" (40 ms),stage="Total time" (1995 ms)] [21:06:56] : [Step 4/5] [2021-11-19 21:06:56,929][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][root] Node started with the following configuration [id=7050c3da-1695-4c5d-a6ea-692205dcd007, marshaller=BinaryMarshaller [], discovery=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=5000, ackTimeout=5000, marsh=JdkMarshaller [clsFilter=org.apache.ignite.marshaller.MarshallerUtils$1@1bd693b4], reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], binaryCfg=null, lateAff=true] [21:06:56] : [Step 4/5] [2021-11-19 21:06:56,931][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][GridClusterStateProcessor] Sending activate cluster request with BaselineTopology BaselineTopology [id=0, branchingHash=-3712973240, branchingType='New BaselineTopology', baselineNodes=[grid-0, grid-6, grid-7]] [21:06:56] : [Step 4/5] [2021-11-19 21:06:56,933][INFO ][disco-notifier-worker-#13440%grid-0%][GridClusterStateProcessor] Received activate cluster request with BaselineTopology[id=0] initiator node ID: 009e0037-2e63-4a08-910c-f40b550ad000 [21:06:56] : [Step 4/5] [2021-11-19 21:06:56,934][INFO ][disco-notifier-worker-#13440%grid-0%][GridClusterStateProcessor] Started state transition: activate cluster [21:06:56] : [Step 4/5] [2021-11-19 21:06:56,936][INFO ][exchange-worker-#13445%grid-0%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], crd=true, evt=DISCOVERY_CUSTOM_EVT, evtNode=009e0037-2e63-4a08-910c-f40b550ad000, customEvt=ChangeGlobalStateMessage [id=f294d593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqId=7eccf38a-2eff-4431-858a-ce89b08c53da, initiatingNodeId=009e0037-2e63-4a08-910c-f40b550ad000, state=ACTIVE, baselineTopology=BaselineTopology [id=0, branchingHash=-3712973240, branchingType='New BaselineTopology', baselineNodes=[grid-0, grid-6, grid-7]], forceChangeBaselineTopology=false, timestamp=1637345216931, forceDeactivation=true], allowMerge=false, exchangeFreeSwitch=false] [21:06:56] : [Step 4/5] [2021-11-19 21:06:56,937][INFO ][exchange-worker-#13445%grid-0%][GridDhtPartitionsExchangeFuture] Start activation process [nodeId=009e0037-2e63-4a08-910c-f40b550ad000, client=false, topVer=AffinityTopologyVersion [topVer=4, minorTopVer=1]]. New state: ACTIVE [21:06:56] : [Step 4/5] [2021-11-19 21:06:56,938][INFO ][exchange-worker-#13445%grid-0%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0 [21:06:56] : [Step 4/5] [2021-11-19 21:06:56,936][INFO ][disco-notifier-worker-#13558%grid-6%][GridClusterStateProcessor] Received activate cluster request with BaselineTopology[id=0] initiator node ID: 009e0037-2e63-4a08-910c-f40b550ad000 [21:06:56] : [Step 4/5] [2021-11-19 21:06:56,944][INFO ][exchange-worker-#13445%grid-0%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000000.wal, offset=8713, ver=2] [21:06:56] : [Step 4/5] [2021-11-19 21:06:56,944][INFO ][disco-notifier-worker-#13653%client1%][GridClusterStateProcessor] Received activate cluster request with BaselineTopology[id=0] initiator node ID: 009e0037-2e63-4a08-910c-f40b550ad000 [21:06:56] : [Step 4/5] [2021-11-19 21:06:56,938][INFO ][disco-notifier-worker-#13776%grid-7%][GridClusterStateProcessor] Received activate cluster request with BaselineTopology[id=0] initiator node ID: 009e0037-2e63-4a08-910c-f40b550ad000 [21:06:56] : [Step 4/5] [2021-11-19 21:06:56,950][INFO ][disco-notifier-worker-#13653%client1%][GridClusterStateProcessor] Started state transition: activate cluster [21:06:56] : [Step 4/5] [2021-11-19 21:06:56,945][INFO ][disco-notifier-worker-#13558%grid-6%][GridClusterStateProcessor] Started state transition: activate cluster [21:06:56] : [Step 4/5] [2021-11-19 21:06:56,951][INFO ][exchange-worker-#13445%grid-0%][GridClusterStateProcessor] Writing BaselineTopology[id=0] [21:06:56] : [Step 4/5] [2021-11-19 21:06:56,956][INFO ][exchange-worker-#13662%client1%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], crd=false, evt=DISCOVERY_CUSTOM_EVT, evtNode=009e0037-2e63-4a08-910c-f40b550ad000, customEvt=ChangeGlobalStateMessage [id=f294d593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqId=7eccf38a-2eff-4431-858a-ce89b08c53da, initiatingNodeId=009e0037-2e63-4a08-910c-f40b550ad000, state=ACTIVE, baselineTopology=BaselineTopology [id=0, branchingHash=-3712973240, branchingType='New BaselineTopology', baselineNodes=[grid-0, grid-6, grid-7]], forceChangeBaselineTopology=false, timestamp=1637345216931, forceDeactivation=true], allowMerge=false, exchangeFreeSwitch=false] [21:06:56] : [Step 4/5] [2021-11-19 21:06:56,951][INFO ][disco-notifier-worker-#13776%grid-7%][GridClusterStateProcessor] Started state transition: activate cluster [21:06:56] : [Step 4/5] [2021-11-19 21:06:56,957][INFO ][exchange-worker-#13662%client1%][GridDhtPartitionsExchangeFuture] Start activation process [nodeId=10b64e66-ab6d-42d1-8754-26462cd96001, client=true, topVer=AffinityTopologyVersion [topVer=4, minorTopVer=1]]. New state: ACTIVE [21:06:56] : [Step 4/5] [2021-11-19 21:06:56,956][INFO ][exchange-worker-#13567%grid-6%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], crd=false, evt=DISCOVERY_CUSTOM_EVT, evtNode=009e0037-2e63-4a08-910c-f40b550ad000, customEvt=ChangeGlobalStateMessage [id=f294d593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqId=7eccf38a-2eff-4431-858a-ce89b08c53da, initiatingNodeId=009e0037-2e63-4a08-910c-f40b550ad000, state=ACTIVE, baselineTopology=BaselineTopology [id=0, branchingHash=-3712973240, branchingType='New BaselineTopology', baselineNodes=[grid-0, grid-6, grid-7]], forceChangeBaselineTopology=false, timestamp=1637345216931, forceDeactivation=true], allowMerge=false, exchangeFreeSwitch=false] [21:06:56] : [Step 4/5] [2021-11-19 21:06:56,959][INFO ][exchange-worker-#13662%client1%][IgniteCacheDatabaseSharedManager] Data Regions Started: 4 [21:06:56] : [Step 4/5] [2021-11-19 21:06:56,958][INFO ][exchange-worker-#13445%grid-0%][GridCacheDatabaseSharedManager] Finish recovery performed in 20 ms. [21:06:56] : [Step 4/5] [2021-11-19 21:06:56,958][INFO ][exchange-worker-#13785%grid-7%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], crd=false, evt=DISCOVERY_CUSTOM_EVT, evtNode=009e0037-2e63-4a08-910c-f40b550ad000, customEvt=ChangeGlobalStateMessage [id=f294d593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqId=7eccf38a-2eff-4431-858a-ce89b08c53da, initiatingNodeId=009e0037-2e63-4a08-910c-f40b550ad000, state=ACTIVE, baselineTopology=BaselineTopology [id=0, branchingHash=-3712973240, branchingType='New BaselineTopology', baselineNodes=[grid-0, grid-6, grid-7]], forceChangeBaselineTopology=false, timestamp=1637345216931, forceDeactivation=true], allowMerge=false, exchangeFreeSwitch=false] [21:06:56] : [Step 4/5] [2021-11-19 21:06:56,962][INFO ][exchange-worker-#13445%grid-0%][msg] Components activation performed in 25 ms. [21:06:56] : [Step 4/5] [2021-11-19 21:06:56,960][INFO ][exchange-worker-#13662%client1%][IgniteCacheDatabaseSharedManager] ^-- sysMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:06:56] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB, allocTotal=0MB] [21:06:56] : [Step 4/5] ^-- default region [type=default, persistence=true, lazyAlloc=true, [21:06:56] : [Step 4/5] ... initCfg=10MB, maxCfg=10MB, usedRam=0MB, freeRam=100%, allocRam=0MB, allocTotal=0MB] [21:06:56] : [Step 4/5] ^-- TxLog region [type=internal, persistence=true, lazyAlloc=false, [21:06:56] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB, allocTotal=0MB] [21:06:56] : [Step 4/5] ^-- volatileDsMemPlc region [type=user, persistence=false, lazyAlloc=true, [21:06:56] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB] [21:06:56] : [Step 4/5] ^-- Ignite persistence [used=0MB] [21:06:56] : [Step 4/5] [21:06:56] : [Step 4/5] [2021-11-19 21:06:56,965][INFO ][sys-#13420%grid-0%][PageMemoryImpl] Started page memory [memoryAllocated=24.0 MiB, pages=5952, tableSize=474.2 KiB, replacementSize=768 B, checkpointBuffer=10.0 MiB] [21:06:56] : [Step 4/5] [2021-11-19 21:06:56,960][INFO ][exchange-worker-#13567%grid-6%][GridDhtPartitionsExchangeFuture] Start activation process [nodeId=60a34984-0e55-40a3-9b61-4f6c3e2b2006, client=false, topVer=AffinityTopologyVersion [topVer=4, minorTopVer=1]]. New state: ACTIVE [21:06:56] : [Step 4/5] [2021-11-19 21:06:56,965][INFO ][exchange-worker-#13662%client1%][msg] Components activation performed in 7 ms. [21:06:56] : [Step 4/5] [2021-11-19 21:06:56,963][INFO ][exchange-worker-#13785%grid-7%][GridDhtPartitionsExchangeFuture] Start activation process [nodeId=7050c3da-1695-4c5d-a6ea-692205dcd007, client=false, topVer=AffinityTopologyVersion [topVer=4, minorTopVer=1]]. New state: ACTIVE [21:06:56] : [Step 4/5] [2021-11-19 21:06:56,965][INFO ][exchange-worker-#13567%grid-6%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_6 [21:06:56] : [Step 4/5] [2021-11-19 21:06:56,966][INFO ][exchange-worker-#13785%grid-7%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_7 [21:06:56] : [Step 4/5] [2021-11-19 21:06:56,972][INFO ][exchange-worker-#13567%grid-6%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_6/0000000000000000.wal, offset=8713, ver=2] [21:06:56] : [Step 4/5] [2021-11-19 21:06:56,972][INFO ][exchange-worker-#13662%client1%][GridCacheProcessor] Started cache [name=ignite-sys-cache, id=-2100569601, dataRegionName=sysMemPlc, mode=REPLICATED, atomicity=TRANSACTIONAL, backups=2147483647, mvcc=false] [21:06:56] : [Step 4/5] [2021-11-19 21:06:56,981][INFO ][exchange-worker-#13785%grid-7%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_7/0000000000000000.wal, offset=13104, ver=2] [21:06:56] : [Step 4/5] [2021-11-19 21:06:56,996][INFO ][exchange-worker-#13662%client1%][GridDhtPartitionsExchangeFuture] Successfully activated caches [nodeId=10b64e66-ab6d-42d1-8754-26462cd96001, client=true, topVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], newState=ACTIVE] [21:06:57] : [Step 4/5] [2021-11-19 21:06:57,006][INFO ][exchange-worker-#13567%grid-6%][GridClusterStateProcessor] Writing BaselineTopology[id=0] [21:06:57] : [Step 4/5] [2021-11-19 21:06:57,019][INFO ][grid-nio-worker-tcp-comm-0-#13384%TcpCommunicationSpi%][TcpCommunicationSpi] Accepted incoming communication connection [locAddr=/127.0.0.1:45150, rmtAddr=/127.0.0.1:60834] [21:06:57] : [Step 4/5] [2021-11-19 21:06:57,020][INFO ][exchange-worker-#13785%grid-7%][GridClusterStateProcessor] Writing BaselineTopology[id=0] [21:06:57] : [Step 4/5] [2021-11-19 21:06:57,024][INFO ][exchange-worker-#13567%grid-6%][GridCacheDatabaseSharedManager] Finish recovery performed in 57 ms. [21:06:57] : [Step 4/5] [2021-11-19 21:06:57,029][INFO ][exchange-worker-#13567%grid-6%][msg] Components activation performed in 64 ms. [21:06:57] : [Step 4/5] [2021-11-19 21:06:57,029][INFO ][grid-nio-worker-tcp-comm-0-#13624%TcpCommunicationSpi%][TcpCommunicationSpi] Established outgoing communication connection [locAddr=/127.0.0.1:60834, rmtAddr=/127.0.0.1:45150] [21:06:57] : [Step 4/5] [2021-11-19 21:06:57,030][INFO ][exchange-worker-#13662%client1%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], crd=false] [21:06:57] : [Step 4/5] [2021-11-19 21:06:57,031][INFO ][exchange-worker-#13567%grid-6%][PageMemoryImpl] Started page memory [memoryAllocated=24.0 MiB, pages=5952, tableSize=474.2 KiB, replacementSize=768 B, checkpointBuffer=10.0 MiB] [21:06:57] : [Step 4/5] [2021-11-19 21:06:57,037][INFO ][exchange-worker-#13785%grid-7%][GridCacheDatabaseSharedManager] Finish recovery performed in 65 ms. [21:06:57] : [Step 4/5] [2021-11-19 21:06:57,039][INFO ][exchange-worker-#13785%grid-7%][msg] Components activation performed in 73 ms. [21:06:57] : [Step 4/5] [2021-11-19 21:06:57,040][INFO ][exchange-worker-#13785%grid-7%][GridCacheProcessor] Finished recovery for cache [cache=encrypted, grp=encrypted, startVer=AffinityTopologyVersion [topVer=4, minorTopVer=1]] [21:06:57] : [Step 4/5] [2021-11-19 21:06:57,041][INFO ][exchange-worker-#13785%grid-7%][GridCacheProcessor] Finished recovery for cache [cache=ignite-sys-cache, grp=ignite-sys-cache, startVer=AffinityTopologyVersion [topVer=4, minorTopVer=1]] [21:06:57] : [Step 4/5] [2021-11-19 21:06:57,044][INFO ][exchange-worker-#13785%grid-7%][GridDhtPartitionsExchangeFuture] Successfully activated caches [nodeId=7050c3da-1695-4c5d-a6ea-692205dcd007, client=false, topVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], newState=ACTIVE] [21:06:57] : [Step 4/5] [2021-11-19 21:06:57,049][INFO ][exchange-worker-#13785%grid-7%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:06:57] : [Step 4/5] [2021-11-19 21:06:57,113][INFO ][sys-#13423%grid-0%][GridCacheProcessor] Started cache [name=encrypted, id=1613773252, dataRegionName=default, mode=PARTITIONED, atomicity=TRANSACTIONAL, backups=0, mvcc=false] [21:06:57] : [Step 4/5] [2021-11-19 21:06:57,114][INFO ][exchange-worker-#13445%grid-0%][GridCacheProcessor] Finished recovery for cache [cache=ignite-sys-cache, grp=ignite-sys-cache, startVer=AffinityTopologyVersion [topVer=4, minorTopVer=1]] [21:06:57] : [Step 4/5] [2021-11-19 21:06:57,123][INFO ][exchange-worker-#13445%grid-0%][GridDhtPartitionsExchangeFuture] Successfully activated caches [nodeId=009e0037-2e63-4a08-910c-f40b550ad000, client=false, topVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], newState=ACTIVE] [21:06:57] : [Step 4/5] [2021-11-19 21:06:57,128][INFO ][exchange-worker-#13445%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:06:57] : [Step 4/5] [2021-11-19 21:06:57,128][INFO ][grid-nio-worker-tcp-comm-1-#13385%TcpCommunicationSpi%][TcpCommunicationSpi] Accepted incoming communication connection [locAddr=/127.0.0.1:45150, rmtAddr=/127.0.0.1:60842] [21:06:57] : [Step 4/5] [2021-11-19 21:06:57,161][INFO ][db-checkpoint-thread-#13802%grid-7%][Checkpointer] Checkpoint started [checkpointId=05395488-db06-4098-b120-761398f9f93e, startPtr=WALPointer [idx=0, fileOff=165559, len=8372], checkpointBeforeLockTime=40ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=1ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=14ms, writeCheckpointEntryDuration=30ms, splitAndSortCpPagesDuration=0ms, pages=26, reason='node started'] [21:06:57] : [Step 4/5] [2021-11-19 21:06:57,164][INFO ][grid-nio-worker-tcp-comm-0-#13719%TcpCommunicationSpi%][TcpCommunicationSpi] Established outgoing communication connection [locAddr=/127.0.0.1:60842, rmtAddr=/127.0.0.1:45150] [21:06:57] : [Step 4/5] [2021-11-19 21:06:57,166][INFO ][exchange-worker-#13785%grid-7%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], crd=false] [21:06:57] : [Step 4/5] [2021-11-19 21:06:57,196][INFO ][exchange-worker-#13567%grid-6%][GridCacheProcessor] Started cache [name=encrypted, id=1613773252, dataRegionName=default, mode=PARTITIONED, atomicity=TRANSACTIONAL, backups=0, mvcc=false] [21:06:57] : [Step 4/5] [2021-11-19 21:06:57,197][INFO ][exchange-worker-#13567%grid-6%][GridCacheProcessor] Finished recovery for cache [cache=ignite-sys-cache, grp=ignite-sys-cache, startVer=AffinityTopologyVersion [topVer=4, minorTopVer=1]] [21:06:57] : [Step 4/5] [2021-11-19 21:06:57,200][INFO ][exchange-worker-#13567%grid-6%][GridDhtPartitionsExchangeFuture] Successfully activated caches [nodeId=60a34984-0e55-40a3-9b61-4f6c3e2b2006, client=false, topVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], newState=ACTIVE] [21:06:57] : [Step 4/5] [2021-11-19 21:06:57,211][INFO ][exchange-worker-#13445%grid-0%][GridDhtPartitionsExchangeFuture] Coordinator received single message [ver=AffinityTopologyVersion [topVer=4, minorTopVer=1], node=7050c3da-1695-4c5d-a6ea-692205dcd007, remainingNodes=1, allReceived=false] [21:06:57] : [Step 4/5] [2021-11-19 21:06:57,287][INFO ][exchange-worker-#13567%grid-6%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:06:57] : [Step 4/5] [2021-11-19 21:06:57,287][INFO ][exchange-worker-#13445%grid-0%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], crd=true] [21:06:57] : [Step 4/5] [2021-11-19 21:06:57,336][INFO ][grid-nio-worker-tcp-comm-2-#13386%TcpCommunicationSpi%][TcpCommunicationSpi] Accepted incoming communication connection [locAddr=/127.0.0.1:45150, rmtAddr=/127.0.0.1:60850] [21:06:57] : [Step 4/5] [2021-11-19 21:06:57,342][INFO ][grid-nio-worker-tcp-comm-0-#13502%TcpCommunicationSpi%][TcpCommunicationSpi] Established outgoing communication connection [locAddr=/127.0.0.1:60850, rmtAddr=/127.0.0.1:45150] [21:06:57] : [Step 4/5] [2021-11-19 21:06:57,342][INFO ][exchange-worker-#13567%grid-6%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], crd=false] [21:06:57] : [Step 4/5] [2021-11-19 21:06:57,345][INFO ][sys-#13432%grid-0%][GridDhtPartitionsExchangeFuture] Coordinator received single message [ver=AffinityTopologyVersion [topVer=4, minorTopVer=1], node=60a34984-0e55-40a3-9b61-4f6c3e2b2006, allReceived=true] [21:06:57] : [Step 4/5] [2021-11-19 21:06:57,345][INFO ][sys-#13432%grid-0%][GridDhtPartitionsExchangeFuture] finishExchangeOnCoordinator [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=1]] [21:06:57] : [Step 4/5] [2021-11-19 21:06:57,362][INFO ][sys-#13432%grid-0%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], err=null, rebalanced=true, wasRebalanced=false] [21:06:57] : [Step 4/5] [2021-11-19 21:06:57,362][INFO ][disco-notifier-worker-#13440%grid-0%][GridClusterStateProcessor] Received state change finish message: ACTIVE [21:06:57] : [Step 4/5] [2021-11-19 21:06:57,365][INFO ][disco-notifier-worker-#13440%grid-0%][GridClusterStateProcessor] Cluster state was changed from INACTIVE to ACTIVE [21:06:57] : [Step 4/5] [2021-11-19 21:06:57,366][INFO ][disco-notifier-worker-#13558%grid-6%][GridClusterStateProcessor] Received state change finish message: ACTIVE [21:06:57] : [Step 4/5] [2021-11-19 21:06:57,366][INFO ][disco-notifier-worker-#13653%client1%][GridClusterStateProcessor] Received state change finish message: ACTIVE [21:06:57] : [Step 4/5] [2021-11-19 21:06:57,366][INFO ][disco-notifier-worker-#13776%grid-7%][GridClusterStateProcessor] Received state change finish message: ACTIVE [21:06:57] : [Step 4/5] [2021-11-19 21:06:57,367][INFO ][sys-#13547%grid-6%][GridDhtPartitionsExchangeFuture] Received full message, will finish exchange [node=009e0037-2e63-4a08-910c-f40b550ad000, resVer=AffinityTopologyVersion [topVer=4, minorTopVer=1]] [21:06:57] : [Step 4/5] [2021-11-19 21:06:57,366][INFO ][disco-notifier-worker-#13558%grid-6%][GridClusterStateProcessor] Cluster state was changed from INACTIVE to ACTIVE [21:06:57] : [Step 4/5] [2021-11-19 21:06:57,367][INFO ][disco-notifier-worker-#13776%grid-7%][GridClusterStateProcessor] Cluster state was changed from INACTIVE to ACTIVE [21:06:57] : [Step 4/5] [2021-11-19 21:06:57,367][INFO ][disco-notifier-worker-#13653%client1%][GridClusterStateProcessor] Cluster state was changed from INACTIVE to ACTIVE [21:06:57] : [Step 4/5] [2021-11-19 21:06:57,371][INFO ][sys-#13547%grid-6%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], err=null, rebalanced=true, wasRebalanced=false] [21:06:57] : [Step 4/5] [2021-11-19 21:06:57,372][INFO ][sys-#13755%grid-7%][GridDhtPartitionsExchangeFuture] Received full message, will finish exchange [node=009e0037-2e63-4a08-910c-f40b550ad000, resVer=AffinityTopologyVersion [topVer=4, minorTopVer=1]] [21:06:57] : [Step 4/5] [2021-11-19 21:06:57,380][INFO ][sys-#13755%grid-7%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], err=null, rebalanced=true, wasRebalanced=false] [21:06:57] : [Step 4/5] [2021-11-19 21:06:57,381][INFO ][sys-#13537%grid-6%][GridCachePartitionExchangeManager] Delay process full message without exchange id (there is exchange in progress) [nodeId=009e0037-2e63-4a08-910c-f40b550ad000] [21:06:57] : [Step 4/5] [2021-11-19 21:06:57,383][INFO ][sys-#13762%grid-7%][GridCachePartitionExchangeManager] Delay process full message without exchange id (there is exchange in progress) [nodeId=009e0037-2e63-4a08-910c-f40b550ad000] [21:06:57] : [Step 4/5] [2021-11-19 21:06:57,386][INFO ][sys-#13547%grid-6%][GridCacheProcessor] Finish proxy initialization, cacheName=ignite-sys-cache, localNodeId=60a34984-0e55-40a3-9b61-4f6c3e2b2006 [21:06:57] : [Step 4/5] [2021-11-19 21:06:57,388][INFO ][sys-#13432%grid-0%][GridCacheProcessor] Finish proxy initialization, cacheName=ignite-sys-cache, localNodeId=009e0037-2e63-4a08-910c-f40b550ad000 [21:06:57] : [Step 4/5] [2021-11-19 21:06:57,389][INFO ][sys-#13547%grid-6%][GridCacheProcessor] Finish proxy initialization, cacheName=encrypted, localNodeId=60a34984-0e55-40a3-9b61-4f6c3e2b2006 [21:06:57] : [Step 4/5] [2021-11-19 21:06:57,391][INFO ][sys-#13755%grid-7%][GridCacheProcessor] Finish proxy initialization, cacheName=ignite-sys-cache, localNodeId=7050c3da-1695-4c5d-a6ea-692205dcd007 [21:06:57] : [Step 4/5] [2021-11-19 21:06:57,391][INFO ][sys-#13825%client1%][GridCachePartitionExchangeManager] Delay process full message without exchange id (there is exchange in progress) [nodeId=009e0037-2e63-4a08-910c-f40b550ad000] [21:06:57] : [Step 4/5] [2021-11-19 21:06:57,392][INFO ][sys-#13755%grid-7%][GridCacheProcessor] Finish proxy initialization, cacheName=encrypted, localNodeId=7050c3da-1695-4c5d-a6ea-692205dcd007 [21:06:57] : [Step 4/5] [2021-11-19 21:06:57,392][INFO ][sys-#13539%grid-6%][DistributedBaselineConfiguration] Baseline auto-adjust is 'disabled' with timeout='300000' ms [21:06:57] : [Step 4/5] [2021-11-19 21:06:57,394][INFO ][sys-#13539%grid-6%][GridClusterStateProcessor] Successfully performed final activation steps [nodeId=60a34984-0e55-40a3-9b61-4f6c3e2b2006, client=false, topVer=AffinityTopologyVersion [topVer=4, minorTopVer=1]] [21:06:57] : [Step 4/5] [2021-11-19 21:06:57,391][INFO ][sys-#13432%grid-0%][GridCacheProcessor] Finish proxy initialization, cacheName=encrypted, localNodeId=009e0037-2e63-4a08-910c-f40b550ad000 [21:06:57] : [Step 4/5] [2021-11-19 21:06:57,394][INFO ][sys-#13766%grid-7%][DistributedBaselineConfiguration] Baseline auto-adjust is 'disabled' with timeout='300000' ms [21:06:57] : [Step 4/5] [2021-11-19 21:06:57,394][INFO ][exchange-worker-#13567%grid-6%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=4, minorTopVer=1], force=false, evt=DISCOVERY_CUSTOM_EVT, node=009e0037-2e63-4a08-910c-f40b550ad000] [21:06:57] : [Step 4/5] [2021-11-19 21:06:57,394][INFO ][sys-#13547%grid-6%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=60a34984-0e55-40a3-9b61-4f6c3e2b2006, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=009e0037-2e63-4a08-910c-f40b550ad000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345214542, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=4, minorTopVer=1]] [21:06:57] : [Step 4/5] [2021-11-19 21:06:57,396][INFO ][sys-#13432%grid-0%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=009e0037-2e63-4a08-910c-f40b550ad000, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=009e0037-2e63-4a08-910c-f40b550ad000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345217369, loc=true, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=4, minorTopVer=1]] [21:06:57] : [Step 4/5] [2021-11-19 21:06:57,398][INFO ][sys-#13432%grid-0%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (1 ms), stage="Update caches registry" (26 ms), stage="Start caches" (150 ms), stage="Affinity initialization on cache group start" (8 ms), stage="Determine exchange type" (4 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Restore partition states" (19 ms), stage="After states restored callback" (63 ms), stage="WAL history reservation" (0 ms), stage="Waiting for all single messages" (134 ms), stage="Affinity recalculation (crd)" (0 ms), stage="Collect update counters and create affinity messages" (0 ms), stage="Assign partitions states" (1 ms), stage="Validate partitions states" (0 ms), stage="Ideal affinity diff calculation (enforced)" (3 ms), stage="Apply update counters" (0 ms), stage="Full message preparing" (8 ms), stage="Full message sending" (0 ms), stage="State finish message sending" (0 ms), stage="Detect lost partitions" (24 ms), stage="Exchange done" (11 ms), stage="Total time" (452 ms), Discovery lag=23 ms, Latest started node id=7050c3da-1695-4c5d-a6ea-692205dcd007] [21:06:57] : [Step 4/5] [2021-11-19 21:06:57,396][INFO ][sys-#13430%grid-0%][DistributedBaselineConfiguration] Baseline auto-adjust is 'disabled' with timeout='300000' ms [21:06:57] : [Step 4/5] [2021-11-19 21:06:57,396][INFO ][exchange-worker-#13445%grid-0%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=4, minorTopVer=1], force=false, evt=DISCOVERY_CUSTOM_EVT, node=009e0037-2e63-4a08-910c-f40b550ad000] [21:06:57] : [Step 4/5] [2021-11-19 21:06:57,395][INFO ][sys-#13766%grid-7%][GridClusterStateProcessor] Successfully performed final activation steps [nodeId=7050c3da-1695-4c5d-a6ea-692205dcd007, client=false, topVer=AffinityTopologyVersion [topVer=4, minorTopVer=1]] [21:06:57] : [Step 4/5] [2021-11-19 21:06:57,409][INFO ][exchange-worker-#13785%grid-7%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=4, minorTopVer=1], force=false, evt=DISCOVERY_CUSTOM_EVT, node=009e0037-2e63-4a08-910c-f40b550ad000] [21:06:57] : [Step 4/5] [2021-11-19 21:06:57,409][INFO ][sys-#13827%client1%][GridDhtPartitionsExchangeFuture] Received full message, will finish exchange [node=009e0037-2e63-4a08-910c-f40b550ad000, resVer=AffinityTopologyVersion [topVer=4, minorTopVer=1]] [21:06:57] : [Step 4/5] [2021-11-19 21:06:57,403][INFO ][sys-#13430%grid-0%][GridClusterStateProcessor] Successfully performed final activation steps [nodeId=009e0037-2e63-4a08-910c-f40b550ad000, client=false, topVer=AffinityTopologyVersion [topVer=4, minorTopVer=1]] [21:06:57] : [Step 4/5] [2021-11-19 21:06:57,403][INFO ][sys-#13432%grid-0%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], stage="Affinity initialization on cache group start [grp=encrypted]" (7 ms) (parent=Affinity initialization on cache group start), stage="Affinity initialization on cache group start [grp=ignite-sys-cache]" (0 ms) (parent=Affinity initialization on cache group start), stage="Affinity centralized initialization (crd) [grp=encrypted, crd=true]" (3 ms) (parent=Determine exchange type), stage="Affinity centralized initialization (crd) [grp=ignite-sys-cache, crd=true]" (0 ms) (parent=Determine exchange type), stage="Restore partition states [grp=encrypted]" (19 ms) (parent=Restore partition states), stage="Restore partition states [grp=ignite-sys-cache]" (3 ms) (parent=Restore partition states), stage="Affinity recalculation (partitions availability) [grp=encrypted]" (3 ms) (parent=Ideal affinity diff calculation (enforced)), stage="Affinity recalculation (partitions availability) [grp=ignite-sys-cache]" (0 ms) (parent=Ideal affinity diff calculation (enforced))] [21:06:57] : [Step 4/5] [2021-11-19 21:06:57,403][INFO ][sys-#13755%grid-7%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=7050c3da-1695-4c5d-a6ea-692205dcd007, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=009e0037-2e63-4a08-910c-f40b550ad000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345216848, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=4, minorTopVer=1]] [21:06:57] : [Step 4/5] [2021-11-19 21:06:57,397][INFO ][sys-#13547%grid-6%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (3 ms), stage="Update caches registry" (70 ms), stage="Start caches" (167 ms), stage="Affinity initialization on cache group start" (2 ms), stage="Determine exchange type" (86 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Restore partition states" (13 ms), stage="After states restored callback" (31 ms), stage="WAL history reservation" (0 ms), stage="Waiting for Full message" (34 ms), stage="Affinity recalculation" (2 ms), stage="Full map updating" (1 ms), stage="Detect lost partitions" (10 ms), stage="Exchange done" (15 ms), stage="Total time" (434 ms)] [21:06:57] : [Step 4/5] [2021-11-19 21:06:57,415][INFO ][sys-#13755%grid-7%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (4 ms), stage="Update caches registry" (76 ms), stage="Start caches" (1 ms), stage="Affinity initialization on cache group start" (2 ms), stage="Determine exchange type" (4 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Restore partition states" (0 ms), stage="After states restored callback" (67 ms), stage="WAL history reservation" (0 ms), stage="Waiting for Full message" (255 ms), stage="Affinity recalculation" (3 ms), stage="Full map updating" (4 ms), stage="Detect lost partitions" (8 ms), stage="Exchange done" (26 ms), stage="Total time" (450 ms)] [21:06:57] : [Step 4/5] [2021-11-19 21:06:57,417][INFO ][sys-#13547%grid-6%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], stage="Affinity initialization on cache group start [grp=encrypted]" (1 ms) (parent=Affinity initialization on cache group start), stage="Affinity initialization on cache group start [grp=ignite-sys-cache]" (0 ms) (parent=Affinity initialization on cache group start), stage="Affinity centralized initialization (crd) [grp=encrypted, crd=false]" (86 ms) (parent=Determine exchange type), stage="Affinity centralized initialization (crd) [grp=ignite-sys-cache, crd=false]" (85 ms) (parent=Determine exchange type), stage="Restore partition states [grp=encrypted]" (13 ms) (parent=Restore partition states), stage="Restore partition states [grp=ignite-sys-cache]" (0 ms) (parent=Restore partition states), stage="Affinity applying from full message [grp=encrypted]" (2 ms) (parent=Affinity recalculation), stage="Affinity applying from full message [grp=ignite-sys-cache]" (0 ms) (parent=Affinity recalculation)] [21:06:57] : [Step 4/5] [2021-11-19 21:06:57,419][INFO ][sys-#13755%grid-7%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], stage="Affinity initialization on cache group start [grp=encrypted]" (2 ms) (parent=Affinity initialization on cache group start), stage="Affinity initialization on cache group start [grp=ignite-sys-cache]" (0 ms) (parent=Affinity initialization on cache group start), stage="Affinity centralized initialization (crd) [grp=ignite-sys-cache, crd=false]" (4 ms) (parent=Determine exchange type), stage="Affinity centralized initialization (crd) [grp=encrypted, crd=false]" (4 ms) (parent=Determine exchange type), stage="Restore partition states [grp=ignite-sys-cache]" (0 ms) (parent=Restore partition states), stage="Restore partition states [grp=encrypted]" (0 ms) (parent=Restore partition states), stage="Affinity applying from full message [grp=encrypted]" (3 ms) (parent=Affinity recalculation), stage="Affinity applying from full message [grp=ignite-sys-cache]" (0 ms) (parent=Affinity recalculation)] [21:06:57] : [Step 4/5] [2021-11-19 21:06:57,426][INFO ][sys-#13827%client1%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], err=null, rebalanced=true, wasRebalanced=false] [21:06:57] : [Step 4/5] [2021-11-19 21:06:57,429][INFO ][sys-#13827%client1%][GridCacheProcessor] Finish proxy initialization, cacheName=ignite-sys-cache, localNodeId=10b64e66-ab6d-42d1-8754-26462cd96001 [21:06:57] : [Step 4/5] [2021-11-19 21:06:57,431][INFO ][sys-#13838%client1%][DistributedBaselineConfiguration] Baseline auto-adjust is 'disabled' with timeout='300000' ms [21:06:57] : [Step 4/5] [2021-11-19 21:06:57,431][INFO ][sys-#13838%client1%][GridClusterStateProcessor] Successfully performed final activation steps [nodeId=10b64e66-ab6d-42d1-8754-26462cd96001, client=true, topVer=AffinityTopologyVersion [topVer=4, minorTopVer=1]] [21:06:57] : [Step 4/5] [2021-11-19 21:06:57,432][INFO ][exchange-worker-#13662%client1%][GridCachePartitionExchangeManager] AffinityTopologyVersion [topVer=4, minorTopVer=1], evt=DISCOVERY_CUSTOM_EVT, evtNode=009e0037-2e63-4a08-910c-f40b550ad000, client=true] [21:06:57] : [Step 4/5] [2021-11-19 21:06:57,433][INFO ][sys-#13827%client1%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=10b64e66-ab6d-42d1-8754-26462cd96001, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=009e0037-2e63-4a08-910c-f40b550ad000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345214835, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=4, minorTopVer=1]] [21:06:57] : [Step 4/5] [2021-11-19 21:06:57,435][INFO ][sys-#13827%client1%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (6 ms), stage="Update caches registry" (8 ms), stage="Start caches" (6 ms), stage="Affinity initialization on cache group start" (23 ms), stage="Determine exchange type" (8 ms), stage="Waiting for Full message" (403 ms), stage="Affinity recalculation" (6 ms), stage="Full map updating" (11 ms), stage="Detect lost partitions" (2 ms), stage="Exchange done" (6 ms), stage="Total time" (479 ms)] [21:06:57] : [Step 4/5] [2021-11-19 21:06:57,436][INFO ][sys-#13827%client1%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], stage="Affinity initialization on cache group start [grp=encrypted]" (8 ms) (parent=Affinity initialization on cache group start), stage="Affinity initialization on cache group start [grp=ignite-sys-cache]" (4 ms) (parent=Affinity initialization on cache group start), stage="Affinity centralized initialization (crd) [grp=ignite-sys-cache, crd=false]" (7 ms) (parent=Determine exchange type), stage="Affinity centralized initialization (crd) [grp=encrypted, crd=false]" (7 ms) (parent=Determine exchange type), stage="Affinity applying from full message [grp=encrypted]" (6 ms) (parent=Affinity recalculation), stage="Affinity applying from full message [grp=ignite-sys-cache]" (4 ms) (parent=Affinity recalculation)] [21:06:57] : [Step 4/5] [2021-11-19 21:06:57,447][INFO ][test-runner-#13329%encryption.EncryptedCacheNodeJoinTest%][root] awaitPartitionMapExchange finished [21:06:58] : [Step 4/5] [2021-11-19 21:06:58,367][INFO ][db-checkpoint-thread-#13814%grid-0%][Checkpointer] Checkpoint started [checkpointId=49cc860a-08b7-4194-912a-462abf2d20a1, startPtr=WALPointer [idx=0, fileOff=170336, len=8923], checkpointBeforeLockTime=9ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=2ms, walCpRecordFsyncDuration=111ms, writeCheckpointEntryDuration=1045ms, splitAndSortCpPagesDuration=0ms, pages=26, reason='node started'] [21:06:58] : [Step 4/5] [2021-11-19 21:06:58,368][INFO ][db-checkpoint-thread-#13819%grid-6%][Checkpointer] Checkpoint started [checkpointId=c2620bc3-5e22-4e5c-abe2-781c6a34e500, startPtr=WALPointer [idx=0, fileOff=163226, len=8068], checkpointBeforeLockTime=8ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=1ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=409ms, writeCheckpointEntryDuration=627ms, splitAndSortCpPagesDuration=0ms, pages=26, reason='node started'] [21:06:58] : [Step 4/5] [2021-11-19 21:06:58,368][INFO ][db-checkpoint-thread-#13802%grid-7%][Checkpointer] Checkpoint finished [cpId=05395488-db06-4098-b120-761398f9f93e, pages=26, markPos=WALPointer [idx=0, fileOff=165559, len=8372], walSegmentsCovered=[], markDuration=49ms, pagesWrite=15ms, fsync=1188ms, total=1292ms] [21:06:58] : [Step 4/5] [2021-11-19 21:06:58,381][INFO ][grid-nio-worker-tcp-comm-1-#13503%TcpCommunicationSpi%][TcpCommunicationSpi] Accepted incoming communication connection [locAddr=/127.0.0.1:45151, rmtAddr=/127.0.0.1:34108] [21:06:58] : [Step 4/5] [2021-11-19 21:06:58,385][INFO ][grid-nio-worker-tcp-comm-1-#13720%TcpCommunicationSpi%][TcpCommunicationSpi] Established outgoing communication connection [locAddr=/127.0.0.1:34108, rmtAddr=/127.0.0.1:45151] [21:06:58] : [Step 4/5] [2021-11-19 21:06:58,459][INFO ][db-checkpoint-thread-#13819%grid-6%][Checkpointer] Checkpoint finished [cpId=c2620bc3-5e22-4e5c-abe2-781c6a34e500, pages=26, markPos=WALPointer [idx=0, fileOff=163226, len=8068], walSegmentsCovered=[], markDuration=1040ms, pagesWrite=11ms, fsync=77ms, total=1136ms] [21:06:58] : [Step 4/5] [2021-11-19 21:06:58,459][INFO ][db-checkpoint-thread-#13814%grid-0%][Checkpointer] Checkpoint finished [cpId=49cc860a-08b7-4194-912a-462abf2d20a1, pages=26, markPos=WALPointer [idx=0, fileOff=170336, len=8923], walSegmentsCovered=[], markDuration=1159ms, pagesWrite=14ms, fsync=77ms, total=1259ms] [21:07:08] : [Step 4/5] [2021-11-19 21:07:08,306][INFO ][exchange-worker-#13662%client1%][GridCacheProcessor] Started cache [name=encrypted, id=1613773252, dataRegionName=default, mode=PARTITIONED, atomicity=TRANSACTIONAL, backups=0, mvcc=false] [21:07:08] : [Step 4/5] [2021-11-19 21:07:08,317][INFO ][exchange-worker-#13662%client1%][GridCacheProcessor] Finish proxy initialization, cacheName=encrypted, localNodeId=10b64e66-ab6d-42d1-8754-26462cd96001 [21:07:08] : [Step 4/5] [2021-11-19 21:07:08,335][INFO ][grid-nio-worker-tcp-comm-2-#13721%TcpCommunicationSpi%][TcpCommunicationSpi] Accepted incoming communication connection [locAddr=/127.0.0.1:45153, rmtAddr=/127.0.0.1:44864] [21:07:08] : [Step 4/5] [2021-11-19 21:07:08,339][INFO ][grid-nio-worker-tcp-comm-1-#13625%TcpCommunicationSpi%][TcpCommunicationSpi] Established outgoing communication connection [locAddr=/127.0.0.1:44864, rmtAddr=/127.0.0.1:45153] [21:07:08] : [Step 4/5] [2021-11-19 21:07:08,341][INFO ][grid-nio-worker-tcp-comm-2-#13504%TcpCommunicationSpi%][TcpCommunicationSpi] Accepted incoming communication connection [locAddr=/127.0.0.1:45151, rmtAddr=/127.0.0.1:34334] [21:07:08] : [Step 4/5] [2021-11-19 21:07:08,345][INFO ][grid-nio-worker-tcp-comm-2-#13626%TcpCommunicationSpi%][TcpCommunicationSpi] Established outgoing communication connection [locAddr=/127.0.0.1:34334, rmtAddr=/127.0.0.1:45151] [21:07:08] : [Step 4/5] [21:07:08] >>> Stopping test: EncryptedCacheNodeJoinTest#testServerNodeJoinInactiveClusterWithNewStaticCacheConfig in 17085 ms <<< [21:07:08] : [Step 4/5] [2021-11-19 21:07:08,421][INFO ][main][root] >>> Stopping test: EncryptedCacheNodeJoinTest#testServerNodeJoinInactiveClusterWithNewStaticCacheConfig in 17085 ms <<< [21:07:08] : [Step 4/5] [21:07:08] >>> Heap: 432 MB used / 1866 MB commited / 1866 MB max <<< [21:07:08] : [Step 4/5] [2021-11-19 21:07:08,422][INFO ][main][root] >>> Heap: 432 MB used / 1866 MB commited / 1866 MB max <<< [21:07:08] : [Step 4/5] [21:07:08] >>> Non-Heap: 151 MB used / 165 MB commited / 0 MB max <<< [21:07:08] : [Step 4/5] [2021-11-19 21:07:08,422][INFO ][main][root] >>> Non-Heap: 151 MB used / 165 MB commited / 0 MB max <<< [21:07:08] : [Step 4/5] [2021-11-19 21:07:08,422][INFO ][main][root] >>> Stopping grid [name=client1, id=10b64e66-ab6d-42d1-8754-26462cd96001] [21:07:08] : [Step 4/5] [2021-11-19 21:07:08,436][INFO ][disco-event-worker-#13444%grid-0%][GridDiscoveryManager] Node left topology: TcpDiscoveryNode [id=10b64e66-ab6d-42d1-8754-26462cd96001, consistentId=client1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:0], discPort=0, order=3, intOrder=3, lastExchangeTime=1637345214815, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=true] [21:07:08] : [Step 4/5] [2021-11-19 21:07:08,446][INFO ][disco-event-worker-#13784%grid-7%][GridDiscoveryManager] Node left topology: TcpDiscoveryNode [id=10b64e66-ab6d-42d1-8754-26462cd96001, consistentId=client1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:0], discPort=0, order=3, intOrder=3, lastExchangeTime=1637345216848, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=true] [21:07:08]W: [org.apache.ignite:ignite-core] [2021-11-19 21:07:08,445][WARN ][tcp-disco-sock-reader-[10b64e66 127.0.0.1:34971 client]-#715%grid-6%-#13658%grid-6%][TestTcpDiscoverySpi] Failed to shutdown socket [21:07:08]W: [org.apache.ignite:ignite-core] java.net.SocketException: Socket input is already shutdown [21:07:08]W: [org.apache.ignite:ignite-core] at java.net.Socket.shutdownInput(Socket.java:1542) [21:07:08]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.close(IgniteUtils.java:4248) [21:07:08]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.discovery.tcp.ServerImpl$SocketReader.body(ServerImpl.java:7370) [21:07:08]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.IgniteSpiThread.run(IgniteSpiThread.java:58) [21:07:08] : [Step 4/5] [2021-11-19 21:07:08,436][INFO ][disco-event-worker-#13566%grid-6%][GridDiscoveryManager] Node left topology: TcpDiscoveryNode [id=10b64e66-ab6d-42d1-8754-26462cd96001, consistentId=client1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:0], discPort=0, order=3, intOrder=3, lastExchangeTime=1637345214825, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=true] [21:07:08] : [Step 4/5] [2021-11-19 21:07:08,450][INFO ][tcp-disco-sock-reader-[10b64e66 127.0.0.1:34971 client]-#715%grid-6%-#13658%grid-6%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:34971, rmtPort=34971, rmtNodeId=10b64e66-ab6d-42d1-8754-26462cd96001] [21:07:08] : [Step 4/5] [2021-11-19 21:07:08,449][INFO ][disco-event-worker-#13784%grid-7%][GridDiscoveryManager] Topology snapshot [ver=5, locNode=7050c3da, servers=3, clients=0, state=ACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=009e0037-2e63-4a08-910c-f40b550ad000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=60a34984-0e55-40a3-9b61-4f6c3e2b2006, consistentId=grid-6, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=7050c3da-1695-4c5d-a6ea-692205dcd007, consistentId=grid-7, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:07:08] : [Step 4/5] [2021-11-19 21:07:08,449][INFO ][disco-event-worker-#13444%grid-0%][GridDiscoveryManager] Topology snapshot [ver=5, locNode=009e0037, servers=3, clients=0, state=ACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=009e0037-2e63-4a08-910c-f40b550ad000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=60a34984-0e55-40a3-9b61-4f6c3e2b2006, consistentId=grid-6, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=7050c3da-1695-4c5d-a6ea-692205dcd007, consistentId=grid-7, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:07:08] : [Step 4/5] [2021-11-19 21:07:08,449][INFO ][main][GridCacheProcessor] Stopped cache [cacheName=ignite-sys-cache] [21:07:08] : [Step 4/5] [2021-11-19 21:07:08,454][INFO ][disco-event-worker-#13444%grid-0%][GridDiscoveryManager] ^-- Baseline [id=0, size=3, online=3, offline=0] [21:07:08] : [Step 4/5] [2021-11-19 21:07:08,452][INFO ][disco-event-worker-#13784%grid-7%][GridDiscoveryManager] ^-- Baseline [id=0, size=3, online=3, offline=0] [21:07:08] : [Step 4/5] [2021-11-19 21:07:08,450][INFO ][disco-event-worker-#13566%grid-6%][GridDiscoveryManager] Topology snapshot [ver=5, locNode=60a34984, servers=3, clients=0, state=ACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=009e0037-2e63-4a08-910c-f40b550ad000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=60a34984-0e55-40a3-9b61-4f6c3e2b2006, consistentId=grid-6, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=7050c3da-1695-4c5d-a6ea-692205dcd007, consistentId=grid-7, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:07:08]W: [org.apache.ignite:ignite-core] [2021-11-19 21:07:08,456][WARN ][grid-nio-worker-tcp-comm-0-#13384%TcpCommunicationSpi%][TcpCommunicationSpi] Failed to shutdown socket [21:07:08]W: [org.apache.ignite:ignite-core] java.nio.channels.ClosedChannelException [21:07:08]W: [org.apache.ignite:ignite-core] at sun.nio.ch.SocketChannelImpl.shutdownOutput(SocketChannelImpl.java:795) [21:07:08]W: [org.apache.ignite:ignite-core] at sun.nio.ch.SocketAdaptor.shutdownOutput(SocketAdaptor.java:407) [21:07:08]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.close(IgniteUtils.java:4247) [21:07:08] : [Step 4/5] [2021-11-19 21:07:08,455][INFO ][main][GridCacheProcessor] Stopped cache [cacheName=encrypted] [21:07:08]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.closeKey(GridNioServer.java:2784) [21:07:08]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.close(GridNioServer.java:2835) [21:07:08]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.close(GridNioServer.java:2794) [21:07:08]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.bodyInternal(GridNioServer.java:2157) [21:07:08]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.body(GridNioServer.java:1910) [21:07:08]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:125) [21:07:08]W: [org.apache.ignite:ignite-core] at java.lang.Thread.run(Thread.java:748) [21:07:08] : [Step 4/5] [2021-11-19 21:07:08,457][INFO ][exchange-worker-#13785%grid-7%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], crd=false, evt=NODE_LEFT, evtNode=10b64e66-ab6d-42d1-8754-26462cd96001, customEvt=null, allowMerge=true, exchangeFreeSwitch=false] [21:07:08] : [Step 4/5] [2021-11-19 21:07:08,457][INFO ][exchange-worker-#13445%grid-0%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], crd=true, evt=NODE_LEFT, evtNode=10b64e66-ab6d-42d1-8754-26462cd96001, customEvt=null, allowMerge=true, exchangeFreeSwitch=false] [21:07:08] : [Step 4/5] [2021-11-19 21:07:08,457][INFO ][disco-event-worker-#13566%grid-6%][GridDiscoveryManager] ^-- Baseline [id=0, size=3, online=3, offline=0] [21:07:08] : [Step 4/5] [2021-11-19 21:07:08,464][INFO ][exchange-worker-#13445%grid-0%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], err=null, rebalanced=true, wasRebalanced=true] [21:07:08] : [Step 4/5] [2021-11-19 21:07:08,463][INFO ][main][GridDeploymentLocalStore] Removed undeployed class: GridDeployment [ts=1637345217379, depMode=SHARED, clsLdr=IsolatedClassLoader{roleName='test'}, clsLdrId=b594d593d71-10b64e66-ab6d-42d1-8754-26462cd96001, userVer=0, loc=true, sampleClsName=org.apache.ignite.internal.processors.cache.distributed.dht.preloader.GridDhtPartitionFullMap, pendingUndeploy=false, undeployed=true, usage=0] [21:07:08] : [Step 4/5] [2021-11-19 21:07:08,463][INFO ][exchange-worker-#13785%grid-7%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], err=null, rebalanced=true, wasRebalanced=true] [21:07:08] : [Step 4/5] [2021-11-19 21:07:08,465][INFO ][exchange-worker-#13567%grid-6%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], crd=false, evt=NODE_LEFT, evtNode=10b64e66-ab6d-42d1-8754-26462cd96001, customEvt=null, allowMerge=true, exchangeFreeSwitch=false] [21:07:08] : [Step 4/5] [2021-11-19 21:07:08,465][INFO ][exchange-worker-#13445%grid-0%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=009e0037-2e63-4a08-910c-f40b550ad000, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], evt=NODE_LEFT, evtNode=TcpDiscoveryNode [id=10b64e66-ab6d-42d1-8754-26462cd96001, consistentId=client1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:0], discPort=0, order=3, intOrder=3, lastExchangeTime=1637345214815, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=true], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=5, minorTopVer=0]] [21:07:08] : [Step 4/5] [2021-11-19 21:07:08,469][INFO ][exchange-worker-#13445%grid-0%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (6 ms), stage="Determine exchange type" (0 ms), stage="Exchange done" (5 ms), stage="Total time" (11 ms)] [21:07:08] : [Step 4/5] [2021-11-19 21:07:08,469][INFO ][exchange-worker-#13567%grid-6%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], err=null, rebalanced=true, wasRebalanced=true] [21:07:08] : [Step 4/5] [2021-11-19 21:07:08,468][INFO ][exchange-worker-#13785%grid-7%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=7050c3da-1695-4c5d-a6ea-692205dcd007, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], evt=NODE_LEFT, evtNode=TcpDiscoveryNode [id=10b64e66-ab6d-42d1-8754-26462cd96001, consistentId=client1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:0], discPort=0, order=3, intOrder=3, lastExchangeTime=1637345216848, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=true], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=5, minorTopVer=0]] [21:07:08] : [Step 4/5] [2021-11-19 21:07:08,471][INFO ][exchange-worker-#13567%grid-6%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=60a34984-0e55-40a3-9b61-4f6c3e2b2006, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], evt=NODE_LEFT, evtNode=TcpDiscoveryNode [id=10b64e66-ab6d-42d1-8754-26462cd96001, consistentId=client1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:0], discPort=0, order=3, intOrder=3, lastExchangeTime=1637345214825, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=true], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=5, minorTopVer=0]] [21:07:08] : [Step 4/5] [2021-11-19 21:07:08,470][INFO ][exchange-worker-#13445%grid-0%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=5, minorTopVer=0]] [21:07:08] : [Step 4/5] [2021-11-19 21:07:08,475][INFO ][exchange-worker-#13567%grid-6%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (3 ms), stage="Determine exchange type" (0 ms), stage="Exchange done" (6 ms), stage="Total time" (9 ms)] [21:07:08] : [Step 4/5] [2021-11-19 21:07:08,471][INFO ][exchange-worker-#13785%grid-7%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (2 ms), stage="Determine exchange type" (3 ms), stage="Exchange done" (8 ms), stage="Total time" (13 ms)] [21:07:08] : [Step 4/5] [2021-11-19 21:07:08,476][INFO ][exchange-worker-#13567%grid-6%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=5, minorTopVer=0]] [21:07:08] : [Step 4/5] [2021-11-19 21:07:08,476][INFO ][exchange-worker-#13445%grid-0%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], crd=true] [21:07:08] : [Step 4/5] [2021-11-19 21:07:08,478][INFO ][exchange-worker-#13567%grid-6%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], crd=false] [21:07:08] : [Step 4/5] [2021-11-19 21:07:08,477][INFO ][exchange-worker-#13785%grid-7%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=5, minorTopVer=0]] [21:07:08] : [Step 4/5] [2021-11-19 21:07:08,486][INFO ][main][IgniteKernal%client1] [21:07:08] : [Step 4/5] [21:07:08] : [Step 4/5] >>> +------------------------------------------------------+ [21:07:08] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV stopped OK [21:07:08] : [Step 4/5] >>> +------------------------------------------------------+ [21:07:08] : [Step 4/5] >>> Ignite instance name: client1 [21:07:08] : [Step 4/5] >>> Grid uptime: 00:00:13.578 [21:07:08] : [Step 4/5] [21:07:08] : [Step 4/5] [21:07:08] : [Step 4/5] [2021-11-19 21:07:08,487][INFO ][main][root] >>> Stopping grid [name=grid-0, id=009e0037-2e63-4a08-910c-f40b550ad000] [21:07:08] : [Step 4/5] [2021-11-19 21:07:08,481][INFO ][exchange-worker-#13567%grid-6%][GridCachePartitionExchangeManager] AffinityTopologyVersion [topVer=5, minorTopVer=0], evt=NODE_LEFT, evtNode=10b64e66-ab6d-42d1-8754-26462cd96001, client=false] [21:07:08] : [Step 4/5] [2021-11-19 21:07:08,479][INFO ][exchange-worker-#13445%grid-0%][GridCachePartitionExchangeManager] AffinityTopologyVersion [topVer=5, minorTopVer=0], evt=NODE_LEFT, evtNode=10b64e66-ab6d-42d1-8754-26462cd96001, client=false] [21:07:08] : [Step 4/5] [2021-11-19 21:07:08,486][INFO ][exchange-worker-#13785%grid-7%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], crd=false] [21:07:08] : [Step 4/5] [2021-11-19 21:07:08,493][INFO ][exchange-worker-#13785%grid-7%][GridCachePartitionExchangeManager] AffinityTopologyVersion [topVer=5, minorTopVer=0], evt=NODE_LEFT, evtNode=10b64e66-ab6d-42d1-8754-26462cd96001, client=false] [21:07:08] : [Step 4/5] [2021-11-19 21:07:08,518][INFO ][db-checkpoint-thread-#13814%grid-0%][Checkpointer] Checkpoint started [checkpointId=7e22ce31-94ed-4e61-a1aa-ebf39e503c8f, startPtr=WALPointer [idx=0, fileOff=500699, len=8907], checkpointBeforeLockTime=5ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=2ms, walCpRecordFsyncDuration=1ms, writeCheckpointEntryDuration=2ms, splitAndSortCpPagesDuration=0ms, pages=320, reason='timeout'] [21:07:08] : [Step 4/5] [2021-11-19 21:07:08,527][INFO ][tcp-disco-msg-worker-[009e0037 127.0.0.1:47500]-#719%grid-7%-#13777%grid-7%][TestTcpDiscoverySpi] New next node [newNext=TcpDiscoveryNode [id=60a34984-0e55-40a3-9b61-4f6c3e2b2006, consistentId=grid-6, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637345216848, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false]] [21:07:08] : [Step 4/5] [2021-11-19 21:07:08,527][INFO ][tcp-disco-sock-reader-[7050c3da 127.0.0.1:41475]-#724%grid-0%-#13782%grid-0%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:41475, rmtPort=41475, rmtNodeId=7050c3da-1695-4c5d-a6ea-692205dcd007] [21:07:08] : [Step 4/5] [2021-11-19 21:07:08,529][INFO ][tcp-disco-srvr-[:47501]-#704%grid-6%-#13560%grid-6%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=54011] [21:07:08] : [Step 4/5] [2021-11-19 21:07:08,532][INFO ][disco-event-worker-#13566%grid-6%][GridDiscoveryManager] Node left topology: TcpDiscoveryNode [id=009e0037-2e63-4a08-910c-f40b550ad000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345214542, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false] [21:07:08] : [Step 4/5] [2021-11-19 21:07:08,535][INFO ][main][GridCacheProcessor] Stopped cache [cacheName=ignite-sys-cache] [21:07:08] : [Step 4/5] [2021-11-19 21:07:08,532][INFO ][disco-event-worker-#13784%grid-7%][GridDiscoveryManager] Node left topology: TcpDiscoveryNode [id=009e0037-2e63-4a08-910c-f40b550ad000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345216848, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false] [21:07:08] : [Step 4/5] [2021-11-19 21:07:08,532][INFO ][tcp-disco-srvr-[:47501]-#704%grid-6%-#13560%grid-6%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=54011] [21:07:08] : [Step 4/5] [2021-11-19 21:07:08,536][INFO ][disco-event-worker-#13784%grid-7%][GridDiscoveryManager] Topology snapshot [ver=6, locNode=7050c3da, servers=2, clients=0, state=ACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=60a34984-0e55-40a3-9b61-4f6c3e2b2006, consistentId=grid-6, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=7050c3da-1695-4c5d-a6ea-692205dcd007, consistentId=grid-7, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:07:08] : [Step 4/5] [2021-11-19 21:07:08,536][INFO ][disco-event-worker-#13566%grid-6%][GridDiscoveryManager] Topology snapshot [ver=6, locNode=60a34984, servers=2, clients=0, state=ACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=60a34984-0e55-40a3-9b61-4f6c3e2b2006, consistentId=grid-6, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=7050c3da-1695-4c5d-a6ea-692205dcd007, consistentId=grid-7, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:07:08] : [Step 4/5] [2021-11-19 21:07:08,536][INFO ][main][GridCacheProcessor] Stopped cache [cacheName=encrypted] [21:07:08] : [Step 4/5] [2021-11-19 21:07:08,538][INFO ][disco-event-worker-#13566%grid-6%][GridDiscoveryManager] Coordinator changed [prev=TcpDiscoveryNode [id=009e0037-2e63-4a08-910c-f40b550ad000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345214542, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], cur=TcpDiscoveryNode [id=60a34984-0e55-40a3-9b61-4f6c3e2b2006, consistentId=grid-6, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637345228526, loc=true, ver=2.13.0#20211119-sha1:00000000, isClient=false]] [21:07:08] : [Step 4/5] [2021-11-19 21:07:08,538][INFO ][disco-event-worker-#13784%grid-7%][GridDiscoveryManager] Coordinator changed [prev=TcpDiscoveryNode [id=009e0037-2e63-4a08-910c-f40b550ad000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345216848, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], cur=TcpDiscoveryNode [id=60a34984-0e55-40a3-9b61-4f6c3e2b2006, consistentId=grid-6, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637345216848, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false]] [21:07:08] : [Step 4/5] [2021-11-19 21:07:08,537][INFO ][tcp-disco-sock-reader-[]-#726%grid-6%-#13873%grid-6%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:54011, rmtPort=54011] [21:07:08] : [Step 4/5] [2021-11-19 21:07:08,542][INFO ][disco-event-worker-#13784%grid-7%][GridDiscoveryManager] ^-- Baseline [id=0, size=3, online=2, offline=1] [21:07:08] : [Step 4/5] [2021-11-19 21:07:08,541][INFO ][disco-event-worker-#13566%grid-6%][GridDiscoveryManager] ^-- Baseline [id=0, size=3, online=2, offline=1] [21:07:08] : [Step 4/5] [2021-11-19 21:07:08,543][INFO ][disco-event-worker-#13784%grid-7%][MvccProcessorImpl] Assigned mvcc coordinator [crd=MvccCoordinator [topVer=AffinityTopologyVersion [topVer=6, minorTopVer=0], nodeId=60a34984-0e55-40a3-9b61-4f6c3e2b2006, ver=1637345212602, local=false, initialized=false]] [21:07:08] : [Step 4/5] [2021-11-19 21:07:08,544][INFO ][disco-event-worker-#13566%grid-6%][MvccProcessorImpl] Assigned mvcc coordinator [crd=MvccCoordinator [topVer=AffinityTopologyVersion [topVer=6, minorTopVer=0], nodeId=60a34984-0e55-40a3-9b61-4f6c3e2b2006, ver=1637345212602, local=true, initialized=false]] [21:07:08] : [Step 4/5] [2021-11-19 21:07:08,545][INFO ][tcp-disco-sock-reader-[7050c3da 127.0.0.1:54011]-#726%grid-6%-#13873%grid-6%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=7050c3da-1695-4c5d-a6ea-692205dcd007, rmtAddr=/127.0.0.1:54011] [21:07:08] : [Step 4/5] [2021-11-19 21:07:08,547][INFO ][exchange-worker-#13785%grid-7%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=6, minorTopVer=0], crd=false, evt=NODE_LEFT, evtNode=009e0037-2e63-4a08-910c-f40b550ad000, customEvt=null, allowMerge=false, exchangeFreeSwitch=true] [21:07:08] : [Step 4/5] [2021-11-19 21:07:08,547][INFO ][exchange-worker-#13567%grid-6%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=6, minorTopVer=0], crd=true, evt=NODE_LEFT, evtNode=009e0037-2e63-4a08-910c-f40b550ad000, customEvt=null, allowMerge=false, exchangeFreeSwitch=true] [21:07:08] : [Step 4/5] [2021-11-19 21:07:08,549][INFO ][exchange-worker-#13567%grid-6%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=6, minorTopVer=0], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:07:08] : [Step 4/5] [2021-11-19 21:07:08,549][INFO ][exchange-worker-#13785%grid-7%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=6, minorTopVer=0], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:07:08] : [Step 4/5] [2021-11-19 21:07:08,551][INFO ][exchange-worker-#13567%grid-6%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=6, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=6, minorTopVer=0], err=null, rebalanced=true, wasRebalanced=true] [21:07:08] : [Step 4/5] [2021-11-19 21:07:08,552][INFO ][exchange-worker-#13785%grid-7%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=6, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=6, minorTopVer=0], err=null, rebalanced=true, wasRebalanced=true] [21:07:08] : [Step 4/5] [2021-11-19 21:07:08,552][INFO ][sys-#13549%grid-6%][ExchangeLatchManager] Become new coordinator 60a34984-0e55-40a3-9b61-4f6c3e2b2006 [21:07:08]W: [org.apache.ignite:ignite-core] [2021-11-19 21:07:08,553][WARN ][exchange-worker-#13567%grid-6%][GridDhtPartitionTopologyImpl] Detected lost partitions [grp=encrypted, parts=[1-2, 4-8, 12, 17-18, 20, 24, 27, 31, 35-36, 41, 46, 48, 58, 61, 65, 71-73, 77, 80, 82-83, 88, 93, 95, 100, 103, 108-113, 123-125, 127-131, 136-137, 142, 148, 152-153, 157, 159, 161, 163, 167-169, 178-179, 181-182, 184, 186, 188-190, 192, 195, 203-204, 216-218, 225-228, 233-234, 236, 246, 250-255, 259-260, 262, 264-265, 267-268, 278, 288, 298, 300-301, 305, 309, 313-315, 323, 329, 333-334, 336-337, 342-344, 349, 351-352, 356, 362-364, 368-371, 376, 379, 381-384, 389, 393-394, 398, 403-404, 407, 411, 414-415, 417-418, 423, 427, 431, 439, 444, 447-448, 451, 453, 457, 459, 462, 466, 469, 471-479, 481-483, 489, 491, 493-494, 496, 498, 508, 511, 514, 517, 519-523, 526-528, 533-534, 536, 540, 543-544, 550, 553, 555, 560-561, 565-566, 570-571, 574, 577-578, 580, 582-583, 586, 592-593, 597-599, 606, 610, 617, 620-623, 625-626, 630-631, 634-635, 641, 643, 649-650, 653-655, 662, 666, 674, 676, 685, 687, 690, 700-702, 711, 715, 718-719, 724, 729, 734, 736, 740-741, 743-744, 748, 755-757, 759, 761, 765-767, 769, 771, 780, 788, 791, 794-795, 797, 802, 804, 806-807, 814-815, 818, 821, 826-827, 830-831, 834-835, 837-838, 841-842, 844-845, 847, 852-853, 855-856, 859, 861-862, 869, 873-877, 881, 883, 887-888, 890-891, 894-895, 897-898, 900-901, 903, 910-913, 916, 918, 923-924, 927, 929, 934-935, 938, 943, 949, 953, 958-962, 966, 971, 974, 980, 982, 989, 991-992, 997-1000, 1002, 1006, 1008-1010, 1014-1015, 1017, 1020, 1023], topVer=AffinityTopologyVersion [topVer=6, minorTopVer=0]] [21:07:08]W: [org.apache.ignite:ignite-core] [2021-11-19 21:07:08,554][WARN ][sys-#13762%grid-7%][GridDhtPartitionTopologyImpl] Detected lost partitions [grp=encrypted, parts=[1-2, 4-8, 12, 17-18, 20, 24, 27, 31, 35-36, 41, 46, 48, 58, 61, 65, 71-73, 77, 80, 82-83, 88, 93, 95, 100, 103, 108-113, 123-125, 127-131, 136-137, 142, 148, 152-153, 157, 159, 161, 163, 167-169, 178-179, 181-182, 184, 186, 188-190, 192, 195, 203-204, 216-218, 225-228, 233-234, 236, 246, 250-255, 259-260, 262, 264-265, 267-268, 278, 288, 298, 300-301, 305, 309, 313-315, 323, 329, 333-334, 336-337, 342-344, 349, 351-352, 356, 362-364, 368-371, 376, 379, 381-384, 389, 393-394, 398, 403-404, 407, 411, 414-415, 417-418, 423, 427, 431, 439, 444, 447-448, 451, 453, 457, 459, 462, 466, 469, 471-479, 481-483, 489, 491, 493-494, 496, 498, 508, 511, 514, 517, 519-523, 526-528, 533-534, 536, 540, 543-544, 550, 553, 555, 560-561, 565-566, 570-571, 574, 577-578, 580, 582-583, 586, 592-593, 597-599, 606, 610, 617, 620-623, 625-626, 630-631, 634-635, 641, 643, 649-650, 653-655, 662, 666, 674, 676, 685, 687, 690, 700-702, 711, 715, 718-719, 724, 729, 734, 736, 740-741, 743-744, 748, 755-757, 759, 761, 765-767, 769, 771, 780, 788, 791, 794-795, 797, 802, 804, 806-807, 814-815, 818, 821, 826-827, 830-831, 834-835, 837-838, 841-842, 844-845, 847, 852-853, 855-856, 859, 861-862, 869, 873-877, 881, 883, 887-888, 890-891, 894-895, 897-898, 900-901, 903, 910-913, 916, 918, 923-924, 927, 929, 934-935, 938, 943, 949, 953, 958-962, 966, 971, 974, 980, 982, 989, 991-992, 997-1000, 1002, 1006, 1008-1010, 1014-1015, 1017, 1020, 1023], topVer=AffinityTopologyVersion [topVer=6, minorTopVer=0]] [21:07:08] : [Step 4/5] [2021-11-19 21:07:08,557][INFO ][exchange-worker-#13567%grid-6%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=60a34984-0e55-40a3-9b61-4f6c3e2b2006, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=6, minorTopVer=0], evt=NODE_LEFT, evtNode=TcpDiscoveryNode [id=009e0037-2e63-4a08-910c-f40b550ad000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345214542, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=6, minorTopVer=0]] [21:07:08] : [Step 4/5] [2021-11-19 21:07:08,559][INFO ][exchange-worker-#13785%grid-7%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=7050c3da-1695-4c5d-a6ea-692205dcd007, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=6, minorTopVer=0], evt=NODE_LEFT, evtNode=TcpDiscoveryNode [id=009e0037-2e63-4a08-910c-f40b550ad000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345216848, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=6, minorTopVer=0]] [21:07:08] : [Step 4/5] [2021-11-19 21:07:08,560][INFO ][exchange-worker-#13567%grid-6%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=6, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=6, minorTopVer=0], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (0 ms), stage="Determine exchange type" (1 ms), stage="Preloading notification" (0 ms), stage="After states restored callback" (0 ms), stage="WAL history reservation" (0 ms), stage="Finalize update counters" (0 ms), stage="Detect lost partitions" (5 ms), stage="Exchange done" (3 ms), stage="Total time" (9 ms)] [21:07:08] : [Step 4/5] [2021-11-19 21:07:08,561][INFO ][exchange-worker-#13785%grid-7%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=6, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=6, minorTopVer=0], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (0 ms), stage="Determine exchange type" (1 ms), stage="Preloading notification" (0 ms), stage="After states restored callback" (0 ms), stage="WAL history reservation" (0 ms), stage="Finalize update counters" (0 ms), stage="Detect lost partitions" (7 ms), stage="Exchange done" (2 ms), stage="Total time" (10 ms)] [21:07:08] : [Step 4/5] [2021-11-19 21:07:08,562][INFO ][exchange-worker-#13567%grid-6%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=6, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=6, minorTopVer=0], stage="Affinity initialization (exchange-free switch on fully-rebalanced topology) [grp=encrypted]" (1 ms) (parent=Determine exchange type), stage="Affinity initialization (exchange-free switch on fully-rebalanced topology) [grp=ignite-sys-cache]" (0 ms) (parent=Determine exchange type)] [21:07:08] : [Step 4/5] [2021-11-19 21:07:08,563][INFO ][exchange-worker-#13785%grid-7%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=6, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=6, minorTopVer=0], stage="Affinity initialization (exchange-free switch on fully-rebalanced topology) [grp=encrypted]" (1 ms) (parent=Determine exchange type), stage="Affinity initialization (exchange-free switch on fully-rebalanced topology) [grp=ignite-sys-cache]" (0 ms) (parent=Determine exchange type)] [21:07:08] : [Step 4/5] [2021-11-19 21:07:08,564][INFO ][exchange-worker-#13567%grid-6%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=6, minorTopVer=0], crd=true] [21:07:08] : [Step 4/5] [2021-11-19 21:07:08,565][INFO ][exchange-worker-#13785%grid-7%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=6, minorTopVer=0], crd=false] [21:07:08] : [Step 4/5] [2021-11-19 21:07:08,566][INFO ][exchange-worker-#13567%grid-6%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=6, minorTopVer=0], force=false, evt=NODE_LEFT, node=009e0037-2e63-4a08-910c-f40b550ad000] [21:07:08] : [Step 4/5] [2021-11-19 21:07:08,566][INFO ][exchange-worker-#13785%grid-7%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=6, minorTopVer=0], force=false, evt=NODE_LEFT, node=009e0037-2e63-4a08-910c-f40b550ad000] [21:07:08] : [Step 4/5] [2021-11-19 21:07:08,801][INFO ][main][FilePageStoreManager] Cleanup cache stores [total=4, left=0, cleanFiles=false] [21:07:08] : [Step 4/5] [2021-11-19 21:07:08,806][INFO ][main][GridDeploymentLocalStore] Removed undeployed class: GridDeployment [ts=1637345217161, depMode=SHARED, clsLdr=IsolatedClassLoader{roleName='test'}, clsLdrId=3494d593d71-009e0037-2e63-4a08-910c-f40b550ad000, userVer=0, loc=true, sampleClsName=org.apache.ignite.internal.processors.cache.distributed.dht.preloader.GridDhtPartitionMap, pendingUndeploy=false, undeployed=true, usage=0] [21:07:08] : [Step 4/5] [2021-11-19 21:07:08,825][INFO ][main][IgniteKernal%grid-0] [21:07:08] : [Step 4/5] [21:07:08] : [Step 4/5] >>> +------------------------------------------------------+ [21:07:08] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV stopped OK [21:07:08] : [Step 4/5] >>> +------------------------------------------------------+ [21:07:08] : [Step 4/5] >>> Ignite instance name: grid-0 [21:07:08] : [Step 4/5] >>> Grid uptime: 00:00:16.149 [21:07:08] : [Step 4/5] [21:07:08] : [Step 4/5] [21:07:08] : [Step 4/5] [2021-11-19 21:07:08,825][INFO ][main][root] >>> Stopping grid [name=grid-6, id=60a34984-0e55-40a3-9b61-4f6c3e2b2006] [21:07:08] : [Step 4/5] [2021-11-19 21:07:08,843][INFO ][db-checkpoint-thread-#13819%grid-6%][Checkpointer] Checkpoint started [checkpointId=df6adc66-caf7-4052-955e-02d1035f282f, startPtr=WALPointer [idx=0, fileOff=542994, len=8052], checkpointBeforeLockTime=4ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=1ms, checkpointLockHoldTime=2ms, walCpRecordFsyncDuration=2ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=1ms, pages=370, reason='timeout'] [21:07:08] : [Step 4/5] [2021-11-19 21:07:08,850][INFO ][tcp-disco-sock-reader-[7050c3da 127.0.0.1:54011]-#726%grid-6%-#13873%grid-6%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:54011, rmtPort=54011, rmtNodeId=7050c3da-1695-4c5d-a6ea-692205dcd007] [21:07:08] : [Step 4/5] [2021-11-19 21:07:08,855][INFO ][disco-event-worker-#13784%grid-7%][GridDiscoveryManager] Node left topology: TcpDiscoveryNode [id=60a34984-0e55-40a3-9b61-4f6c3e2b2006, consistentId=grid-6, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637345216848, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false] [21:07:08]W: [org.apache.ignite:ignite-core] [2021-11-19 21:07:08,852][WARN ][tcp-disco-sock-reader-[009e0037 127.0.0.1:57685]-#707%grid-6%-#13563%grid-6%][TestTcpDiscoverySpi] Failed to shutdown socket [21:07:08]W: [org.apache.ignite:ignite-core] java.net.SocketException: Socket is closed [21:07:08]W: [org.apache.ignite:ignite-core] at java.net.Socket.shutdownOutput(Socket.java:1568) [21:07:08]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.close(IgniteUtils.java:4247) [21:07:08]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.discovery.tcp.ServerImpl$SocketReader.body(ServerImpl.java:7370) [21:07:08]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.IgniteSpiThread.run(IgniteSpiThread.java:58) [21:07:08] : [Step 4/5] [2021-11-19 21:07:08,857][INFO ][disco-event-worker-#13784%grid-7%][GridDiscoveryManager] Topology snapshot [ver=7, locNode=7050c3da, servers=1, clients=0, state=ACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=7050c3da-1695-4c5d-a6ea-692205dcd007, consistentId=grid-7, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:07:08] : [Step 4/5] [2021-11-19 21:07:08,858][INFO ][tcp-disco-sock-reader-[009e0037 127.0.0.1:57685]-#707%grid-6%-#13563%grid-6%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:57685, rmtPort=57685, rmtNodeId=009e0037-2e63-4a08-910c-f40b550ad000] [21:07:08] : [Step 4/5] [2021-11-19 21:07:08,859][INFO ][disco-event-worker-#13784%grid-7%][GridDiscoveryManager] Coordinator changed [prev=TcpDiscoveryNode [id=60a34984-0e55-40a3-9b61-4f6c3e2b2006, consistentId=grid-6, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637345216848, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], cur=TcpDiscoveryNode [id=7050c3da-1695-4c5d-a6ea-692205dcd007, consistentId=grid-7, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47502], discPort=47502, order=4, intOrder=4, lastExchangeTime=1637345228842, loc=true, ver=2.13.0#20211119-sha1:00000000, isClient=false]] [21:07:08] : [Step 4/5] [2021-11-19 21:07:08,861][INFO ][main][GridCacheProcessor] Stopped cache [cacheName=ignite-sys-cache] [21:07:08] : [Step 4/5] [2021-11-19 21:07:08,862][INFO ][disco-event-worker-#13784%grid-7%][GridDiscoveryManager] ^-- Baseline [id=0, size=3, online=1, offline=2] [21:07:08] : [Step 4/5] [2021-11-19 21:07:08,862][INFO ][main][GridCacheProcessor] Stopped cache [cacheName=encrypted] [21:07:08] : [Step 4/5] [2021-11-19 21:07:08,863][INFO ][disco-event-worker-#13784%grid-7%][MvccProcessorImpl] Assigned mvcc coordinator [crd=MvccCoordinator [topVer=AffinityTopologyVersion [topVer=7, minorTopVer=0], nodeId=7050c3da-1695-4c5d-a6ea-692205dcd007, ver=1637345212604, local=true, initialized=false]] [21:07:08] : [Step 4/5] [2021-11-19 21:07:08,865][INFO ][sys-#13766%grid-7%][ExchangeLatchManager] Become new coordinator 7050c3da-1695-4c5d-a6ea-692205dcd007 [21:07:08] : [Step 4/5] [2021-11-19 21:07:08,865][INFO ][exchange-worker-#13785%grid-7%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=7, minorTopVer=0], crd=true, evt=NODE_LEFT, evtNode=60a34984-0e55-40a3-9b61-4f6c3e2b2006, customEvt=null, allowMerge=false, exchangeFreeSwitch=true] [21:07:08] : [Step 4/5] [2021-11-19 21:07:08,867][INFO ][exchange-worker-#13785%grid-7%][GridAffinityAssignmentCache] Local node affinity assignment distribution is not ideal [cache=encrypted, expectedPrimary=1024.00, actualPrimary=337, expectedBackups=0.00, actualBackups=0, warningThreshold=50.00%] [21:07:08] : [Step 4/5] [2021-11-19 21:07:08,868][INFO ][exchange-worker-#13785%grid-7%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=7, minorTopVer=0], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:07:08] : [Step 4/5] [2021-11-19 21:07:08,869][INFO ][exchange-worker-#13785%grid-7%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=7, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=7, minorTopVer=0], err=null, rebalanced=true, wasRebalanced=true] [21:07:08]W: [org.apache.ignite:ignite-core] [2021-11-19 21:07:08,870][WARN ][sys-#13773%grid-7%][GridDhtPartitionTopologyImpl] Detected lost partitions [grp=encrypted, parts=[3, 10, 14-16, 21-23, 29-30, 32-34, 39-40, 44, 47, 54, 56, 60, 62, 68-69, 74-75, 78, 81, 84-85, 87, 90-92, 96-99, 101-102, 104, 116-117, 120, 132, 139, 146-147, 151, 154-156, 165, 172-173, 176-177, 185, 191, 197, 199, 202, 208, 210-211, 213-214, 219-222, 229, 237, 240, 242-243, 248, 256, 266, 269, 272-273, 276-277, 279, 283-284, 287, 289-292, 294-295, 302, 304, 308, 310, 312, 316-318, 320, 322, 326-328, 330, 341, 345-346, 353, 355, 358, 360, 367, 373-374, 378, 387, 392, 396-397, 401-402, 405, 410, 420-422, 424, 426, 435, 437, 441-443, 449-450, 454, 456, 461, 467-468, 470, 480, 485, 488, 492, 495, 499-500, 503, 506-507, 509-510, 512-513, 515-516, 518, 524-525, 529, 535, 538, 541, 546-547, 551-552, 558, 562, 564, 568-569, 572-573, 575, 579, 581, 585, 588, 591, 596, 600, 603-604, 607, 609, 612, 614, 619, 627, 633, 637, 640, 642, 644, 651-652, 658-661, 668-671, 679, 683-684, 686, 692, 694-695, 698, 703-705, 707, 709, 712, 716, 721-723, 727-728, 730, 733, 735, 737, 739, 745, 752, 758, 762-763, 768, 770, 776, 778, 782-783, 785-786, 789-790, 793, 796, 798, 800, 803, 805, 813, 820, 822-825, 828-829, 832-833, 848, 850-851, 854, 857, 860, 863, 865, 867, 871, 878-880, 886, 896, 899, 904-906, 914-915, 920, 925-926, 928, 932-933, 947-948, 950, 952, 954, 967, 972-973, 977, 979, 981, 983-984, 986-987, 990, 994-996, 1001, 1003-1005, 1007, 1011, 1013, 1018, 1021-1022], topVer=AffinityTopologyVersion [topVer=7, minorTopVer=0]] [21:07:08] : [Step 4/5] [2021-11-19 21:07:08,873][INFO ][exchange-worker-#13785%grid-7%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=7050c3da-1695-4c5d-a6ea-692205dcd007, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=7, minorTopVer=0], evt=NODE_LEFT, evtNode=TcpDiscoveryNode [id=60a34984-0e55-40a3-9b61-4f6c3e2b2006, consistentId=grid-6, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637345216848, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=7, minorTopVer=0]] [21:07:08] : [Step 4/5] [2021-11-19 21:07:08,874][INFO ][exchange-worker-#13785%grid-7%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=7, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=7, minorTopVer=0], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (1 ms), stage="Determine exchange type" (1 ms), stage="Preloading notification" (0 ms), stage="After states restored callback" (0 ms), stage="WAL history reservation" (0 ms), stage="Finalize update counters" (0 ms), stage="Detect lost partitions" (4 ms), stage="Exchange done" (1 ms), stage="Total time" (7 ms)] [21:07:08] : [Step 4/5] [2021-11-19 21:07:08,875][INFO ][exchange-worker-#13785%grid-7%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=7, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=7, minorTopVer=0], stage="Affinity initialization (exchange-free switch on fully-rebalanced topology) [grp=ignite-sys-cache]" (0 ms) (parent=Determine exchange type), stage="Affinity initialization (exchange-free switch on fully-rebalanced topology) [grp=encrypted]" (0 ms) (parent=Determine exchange type)] [21:07:08] : [Step 4/5] [2021-11-19 21:07:08,876][INFO ][exchange-worker-#13785%grid-7%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=7, minorTopVer=0], crd=true] [21:07:08] : [Step 4/5] [2021-11-19 21:07:08,877][INFO ][exchange-worker-#13785%grid-7%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=7, minorTopVer=0], force=false, evt=NODE_LEFT, node=60a34984-0e55-40a3-9b61-4f6c3e2b2006] [21:07:09] : [Step 4/5] [2021-11-19 21:07:09,168][INFO ][main][FilePageStoreManager] Cleanup cache stores [total=4, left=0, cleanFiles=false] [21:07:09] : [Step 4/5] [2021-11-19 21:07:09,170][INFO ][main][GridDeploymentLocalStore] Removed undeployed class: GridDeployment [ts=1637345217358, depMode=SHARED, clsLdr=IsolatedClassLoader{roleName='test'}, clsLdrId=6494d593d71-60a34984-0e55-40a3-9b61-4f6c3e2b2006, userVer=0, loc=true, sampleClsName=org.apache.ignite.internal.processors.cache.distributed.dht.preloader.IgniteDhtPartitionHistorySuppliersMap, pendingUndeploy=false, undeployed=true, usage=0] [21:07:09] : [Step 4/5] [2021-11-19 21:07:09,178][INFO ][main][IgniteKernal%grid-6] [21:07:09] : [Step 4/5] [21:07:09] : [Step 4/5] >>> +------------------------------------------------------+ [21:07:09] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV stopped OK [21:07:09] : [Step 4/5] >>> +------------------------------------------------------+ [21:07:09] : [Step 4/5] >>> Ignite instance name: grid-6 [21:07:09] : [Step 4/5] >>> Grid uptime: 00:00:14.547 [21:07:09] : [Step 4/5] [21:07:09] : [Step 4/5] [21:07:09] : [Step 4/5] [2021-11-19 21:07:09,179][INFO ][main][root] >>> Stopping grid [name=grid-7, id=7050c3da-1695-4c5d-a6ea-692205dcd007] [21:07:09] : [Step 4/5] [2021-11-19 21:07:09,194][INFO ][db-checkpoint-thread-#13802%grid-7%][Checkpointer] Checkpoint started [checkpointId=63042cb8-b578-4cec-82da-736eca7c91f8, startPtr=WALPointer [idx=0, fileOff=500196, len=8356], checkpointBeforeLockTime=5ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=1ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=2ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=0ms, pages=310, reason='timeout'] [21:07:09] : [Step 4/5] [2021-11-19 21:07:09,201][INFO ][tcp-disco-sock-reader-[60a34984 127.0.0.1:49159]-#723%grid-7%-#13781%grid-7%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:49159, rmtPort=49159, rmtNodeId=60a34984-0e55-40a3-9b61-4f6c3e2b2006] [21:07:09] : [Step 4/5] [2021-11-19 21:07:09,203][INFO ][main][GridCacheProcessor] Stopped cache [cacheName=encrypted] [21:07:09] : [Step 4/5] [2021-11-19 21:07:09,203][INFO ][main][GridCacheProcessor] Stopped cache [cacheName=ignite-sys-cache] [21:07:09] : [Step 4/5] [2021-11-19 21:07:09,421][INFO ][main][FilePageStoreManager] Cleanup cache stores [total=4, left=0, cleanFiles=false] [21:07:09] : [Step 4/5] [2021-11-19 21:07:09,423][INFO ][main][GridDeploymentLocalStore] Removed undeployed class: GridDeployment [ts=1637345217358, depMode=SHARED, clsLdr=IsolatedClassLoader{roleName='test'}, clsLdrId=f494d593d71-7050c3da-1695-4c5d-a6ea-692205dcd007, userVer=0, loc=true, sampleClsName=org.apache.ignite.internal.processors.cache.distributed.dht.preloader.GridDhtPartitionFullMap, pendingUndeploy=false, undeployed=true, usage=0] [21:07:09] : [Step 4/5] [2021-11-19 21:07:09,431][INFO ][main][IgniteKernal%grid-7] [21:07:09] : [Step 4/5] [21:07:09] : [Step 4/5] >>> +------------------------------------------------------+ [21:07:09] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV stopped OK [21:07:09] : [Step 4/5] >>> +------------------------------------------------------+ [21:07:09] : [Step 4/5] >>> Ignite instance name: grid-7 [21:07:09] : [Step 4/5] >>> Grid uptime: 00:00:12.508 [21:07:09] : [Step 4/5] [21:07:09] : [Step 4/5] [21:07:09] : [Step 4/5] [21:07:09] >>> Stopping test class: EncryptedCacheNodeJoinTest <<< [21:07:09] : [Step 4/5] [2021-11-19 21:07:09,859][INFO ][main][root] >>> Stopping test class: EncryptedCacheNodeJoinTest <<< [21:07:09] : [Step 4/5] [21:07:09] >>> Starting test class: EncryptedCacheRestartTest <<< [21:07:09] : [Step 4/5] [2021-11-19 21:07:09,860][INFO ][main][root] >>> Starting test class: EncryptedCacheRestartTest <<< [21:07:09] : [Step 4/5] Running org.apache.ignite.internal.encryption.EncryptedCacheRestartTest [21:07:09]i: [Step 4/5] ##teamcity[importData type='surefire' path='/opt/buildagent/temp/buildTmp/ignite-tools-junit-reports1777670380320881607/test-org.apache.ignite.testsuites.IgniteBasicWithPersistenceTestSuite1637345072191.xml'] [21:07:09] : [Step 4/5] Importing data from '/opt/buildagent/temp/buildTmp/ignite-tools-junit-reports1777670380320881607/test-org.apache.ignite.testsuites.IgniteBasicWithPersistenceTestSuite1637345072191.xml' (2.27 KB) with 'surefire' processor [21:07:09] : [Step 4/5] [21:07:09] >>> Starting test: EncryptedCacheRestartTest#testCreateEncryptedCache <<< [21:07:09] : [Step 4/5] [2021-11-19 21:07:09,871][INFO ][main][root] >>> Starting test: EncryptedCacheRestartTest#testCreateEncryptedCache <<< [21:07:09] : [Step 4/5] [21:07:09] >>> Heap: 453 MB used / 1866 MB commited / 1866 MB max <<< [21:07:09] : [Step 4/5] [2021-11-19 21:07:09,871][INFO ][main][root] >>> Heap: 453 MB used / 1866 MB commited / 1866 MB max <<< [21:07:09] : [Step 4/5] [21:07:09] >>> Non-Heap: 151 MB used / 165 MB commited / 0 MB max <<< [21:07:09] : [Step 4/5] [2021-11-19 21:07:09,872][INFO ][main][root] >>> Non-Heap: 151 MB used / 165 MB commited / 0 MB max <<< [21:07:09]W: [org.apache.ignite:ignite-core] [2021-11-19 21:07:09,885][WARN ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][G] Ignite work directory is not provided, automatically resolved to: /opt/buildagent/work/7bc1c54bc719b67c/work [21:07:09] : [Step 4/5] [2021-11-19 21:07:09,886][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][IgniteKernal%grid-0] [21:07:09] : [Step 4/5] [21:07:09] : [Step 4/5] >>> __________ ________________ [21:07:09] : [Step 4/5] >>> / _/ ___/ |/ / _/_ __/ __/ [21:07:09] : [Step 4/5] >>> _/ // (7 7 // / / / / _/ [21:07:09] : [Step 4/5] >>> /___/\___/_/|_/___/ /_/ /___/ [21:07:09] : [Step 4/5] >>> [21:07:09] : [Step 4/5] >>> ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:07:09] : [Step 4/5] >>> 2021 Copyright(C) Apache Software Foundation [21:07:09] : [Step 4/5] >>> [21:07:09] : [Step 4/5] >>> Ignite documentation: http://ignite.apache.org [21:07:09] : [Step 4/5] [21:07:09] : [Step 4/5] [2021-11-19 21:07:09,887][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][IgniteKernal%grid-0] Config URL: n/a [21:07:09] : [Step 4/5] [2021-11-19 21:07:09,888][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][IgniteKernal%grid-0] IgniteConfiguration [igniteInstanceName=grid-0, pubPoolSize=24, svcPoolSize=24, callbackPoolSize=24, stripedPoolSize=24, sysPoolSize=24, mgmtPoolSize=4, dataStreamerPoolSize=24, utilityCachePoolSize=24, utilityCacheKeepAliveTime=60000, p2pPoolSize=2, qryPoolSize=24, buildIdxPoolSize=4, igniteHome=/opt/buildagent/work/7bc1c54bc719b67c, igniteWorkDir=/opt/buildagent/work/7bc1c54bc719b67c/work, mbeanSrv=com.sun.jmx.mbeanserver.JmxMBeanServer@6fe85038, nodeId=004f3da2-3eac-4791-a4d2-e9628138a000, marsh=BinaryMarshaller [], marshLocJobs=false, daemon=false, p2pEnabled=true, netTimeout=10000, netCompressionLevel=1, sndRetryDelay=1000, sndRetryCnt=3, metricsHistSize=10000, metricsUpdateFreq=1000, metricsExpTime=9223372036854775807, discoSpi=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=0, ackTimeout=0, marsh=null, reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], segPlc=STOP, segResolveAttempts=2, waitForSegOnStart=true, allResolversPassReq=true, segChkFreq=10000, commSpi=TcpCommunicationSpi [connectGate=org.apache.ignite.spi.communication.tcp.internal.ConnectGateway@43e57010, ctxInitLatch=java.util.concurrent.CountDownLatch@7afe559[Count = 1], stopping=false, clientPool=null, nioSrvWrapper=null, stateProvider=null], evtSpi=MemoryEventStorageSpi [expireAgeMs=9223372036854775807, expireCnt=10000, filter=null], colSpi=NoopCollisionSpi [], deploySpi=LocalDeploymentSpi [], indexingSpi=org.apache.ignite.spi.indexing.noop.NoopIndexingSpi@1ca0be73, addrRslvr=null, encryptionSpi=org.apache.ignite.spi.encryption.keystore.KeystoreEncryptionSpi@52fa97b8, tracingSpi=org.apache.ignite.spi.tracing.NoopTracingSpi@5a5504bf, clientMode=false, rebalanceThreadPoolSize=4, rebalanceTimeout=10000, rebalanceBatchesPrefetchCnt=3, rebalanceThrottle=0, rebalanceBatchSize=524288, txCfg=TransactionConfiguration [txSerEnabled=false, dfltIsolation=REPEATABLE_READ, dfltConcurrency=PESSIMISTIC, dfltTxTimeout=0, txTimeoutOnPartitionMapExchange=0, deadlockTimeout=10000, pessimisticTxLogSize=0, pessimisticTxLogLinger=10000, tmLookupClsName=null, txManagerFactory=null, useJtaSync=false], cacheSanityCheckEnabled=true, discoStartupDelay=60000, deployMode=SHARED, p2pMissedCacheSize=100, locHost=127.0.0.1, timeSrvPortBase=31100, timeSrvPortRange=100, failureDetectionTimeout=10000, sysWorkerBlockedTimeout=null, clientFailureDetectionTimeout=10000, metricsLogFreq=0, connectorCfg=null, odbcCfg=null, warmupClos=null, atomicCfg=AtomicConfiguration [seqReserveSize=1000, cacheMode=PARTITIONED, backups=1, aff=null, grpName=null], classLdr=null, sslCtxFactory=null, platformCfg=null, binaryCfg=null, memCfg=null, pstCfg=null, dsCfg=DataStorageConfiguration [sysRegionInitSize=41943040, sysRegionMaxSize=104857600, pageSize=4096, concLvl=0, dfltDataRegConf=DataRegionConfiguration [name=default, maxSize=10485760, initSize=268435456, swapPath=null, pageEvictionMode=DISABLED, pageReplacementMode=CLOCK, evictionThreshold=0.9, emptyPagesPoolSize=100, metricsEnabled=false, metricsSubIntervalCount=5, metricsRateTimeInterval=60000, persistenceEnabled=true, checkpointPageBufSize=0, lazyMemoryAllocation=true, warmUpCfg=null], dataRegions=null, storagePath=null, checkpointFreq=180000, lockWaitTime=10000, checkpointThreads=4, checkpointWriteOrder=SEQUENTIAL, walHistSize=20, maxWalArchiveSize=1073741824, walSegments=10, walSegmentSize=67108864, walPath=db/wal, walArchivePath=db/wal/archive, cdcWalPath=db/wal/cdc, cdcEnabled=false, metricsEnabled=false, walMode=FSYNC, walTlbSize=131072, walBuffSize=0, walFlushFreq=2000, walFsyncDelay=1000, walRecordIterBuffSize=67108864, alwaysWriteFullPages=false, fileIOFactory=org.apache.ignite.internal.processors.cache.persistence.file.AsyncFileIOFactory@64bfaf72, metricsSubIntervalCnt=5, metricsRateTimeInterval=60000, walAutoArchiveAfterInactivity=-1, walForceArchiveTimeout=-1, writeThrottlingEnabled=false, walCompactionEnabled=false, walCompactionLevel=1, checkpointReadLockTimeout=null, walPageCompression=DISABLED, walPageCompressionLevel=null, dfltWarmUpCfg=null, encCfg=org.apache.ignite.configuration.EncryptionConfiguration@17eaca52, defragmentationThreadPoolSize=4, minWalArchiveSize=-1], snapshotPath=snapshots, activeOnStart=true, activeOnStartPropSetFlag=false, autoActivation=true, autoActivationPropSetFlag=false, clusterStateOnStart=null, sqlConnCfg=null, cliConnCfg=ClientConnectorConfiguration [host=null, port=10800, portRange=100, sockSndBufSize=0, sockRcvBufSize=0, tcpNoDelay=true, maxOpenCursorsPerConn=128, threadPoolSize=24, selectorCnt=12, idleTimeout=0, handshakeTimeout=10000, jdbcEnabled=true, odbcEnabled=true, thinCliEnabled=true, sslEnabled=false, useIgniteSslCtxFactory=true, sslClientAuth=false, sslCtxFactory=null, thinCliCfg=ThinClientConfiguration [maxActiveTxPerConn=100, maxActiveComputeTasksPerConn=0]], mvccVacuumThreadCnt=2, mvccVacuumFreq=5000, authEnabled=false, failureHnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]], commFailureRslvr=null, sqlCfg=SqlConfiguration [longQryWarnTimeout=3000, dfltQryTimeout=0, sqlQryHistSize=1000, validationEnabled=false], asyncContinuationExecutor=null] [21:07:09] : [Step 4/5] [2021-11-19 21:07:09,896][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][IgniteKernal%grid-0] Daemon mode: off [21:07:09] : [Step 4/5] [2021-11-19 21:07:09,896][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][IgniteKernal%grid-0] OS: Linux 4.15.0-151-generic amd64 [21:07:09] : [Step 4/5] [2021-11-19 21:07:09,896][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][IgniteKernal%grid-0] OS user: teamcity [21:07:09] : [Step 4/5] [2021-11-19 21:07:09,897][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][IgniteKernal%grid-0] PID: 16724 [21:07:09] : [Step 4/5] [2021-11-19 21:07:09,897][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][IgniteKernal%grid-0] Language runtime: Java Platform API Specification ver. 1.8 [21:07:09] : [Step 4/5] [2021-11-19 21:07:09,897][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][IgniteKernal%grid-0] VM information: Java(TM) SE Runtime Environment 1.8.0_261-b12 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 25.261-b12 [21:07:09] : [Step 4/5] [2021-11-19 21:07:09,897][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][IgniteKernal%grid-0] VM total memory: 1.8GB [21:07:09] : [Step 4/5] [2021-11-19 21:07:09,898][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][IgniteKernal%grid-0] Remote Management [restart: off, REST: off, JMX (remote: off)] [21:07:09] : [Step 4/5] [2021-11-19 21:07:09,898][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][IgniteKernal%grid-0] Logger: GridTestLog4jLogger [quiet=false, config=null] [21:07:09] : [Step 4/5] [2021-11-19 21:07:09,898][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][IgniteKernal%grid-0] IGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c [21:07:09] : [Step 4/5] [2021-11-19 21:07:09,898][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][IgniteKernal%grid-0] VM arguments: [-DIGNITE_DUMP_THREADS_ON_FAILURE=false, -DMono=/usr/bin/mono-sgen, -DMono4.0_x64=/usr/lib/mono/4.0, -DMono4.5_x64=/usr/lib/mono/4.5, -DMonoVersion=6.12.0.90, -DSKIP_BUILD=false, -Dagent.home.dir=/opt/buildagent, -Dagent.name=aitc-lin02_03, -Dagent.ownPort=9090, -Dagent.work.dir=/opt/buildagent/work, -Dbuild.number=95, -Dbuild.vcs.number=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.1=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.GitHubApacheIgnite=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dclassworlds.conf=/opt/buildagent/temp/buildTmp/teamcity.m2.conf, -Dcom.jetbrains.maven.watcher.report.file=/opt/buildagent/temp/buildTmp/maven-build-info.xml, -Djava.io.tmpdir=/opt/buildagent/temp/buildTmp, -Dmaven.home=/opt/buildagent/tools/maven3_6, -Dmaven.multiModuleProjectDirectory=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.agent.cpuBenchmark=457, -Dteamcity.agent.dotnet.agent_url=http://localhost:9090/RPC2, -Dteamcity.agent.dotnet.build_id=6278078, -Dteamcity.auth.password=*******, -Dteamcity.auth.userId=TeamCityBuildId=6278078, -Dteamcity.build.changedFiles.file=/opt/buildagent/temp/buildTmp/changedFiles6342607772318147725.txt, -Dteamcity.build.checkoutDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.build.id=6278078, -Dteamcity.build.properties.file=/opt/buildagent/temp/buildTmp/teamcity.build5164517880467851002.properties, -Dteamcity.build.tempDir=/opt/buildagent/temp/buildTmp, -Dteamcity.build.workingDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.buildConfName=Basic 3, -Dteamcity.buildType.id=IgniteTests24Java8_Basic3, -Dteamcity.configuration.properties.file=/opt/buildagent/temp/buildTmp/teamcity.config5591980786735343870.properties, -Dteamcity.maven.userSettings.path=/opt/buildagent/temp/buildTmp/maven_settings_585072866407032347.xml, -Dteamcity.maven.watcher.home=/opt/buildagent/plugins/mavenPlugin/maven-watcher-jdk16, -Dteamcity.projectName=Ignite Tests 2.x (JDK 8/11), -Dteamcity.runner.properties.file=/opt/buildagent/temp/buildTmp/teamcity.runner9098465561618137420.properties, -Dteamcity.tests.recentlyFailedTests.file=/opt/buildagent/temp/buildTmp/testsToRunFirst3891775683130404069.txt, -Dteamcity.version=2021.2 (build 99542), -ea, -Xms2g, -Xmx2g, -XX:+HeapDumpOnOutOfMemoryError, -DIGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_TEST_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_UPDATE_NOTIFIER=false, -DIGNITE_NO_DISCO_ORDER=true, -DIGNITE_PERFORMANCE_SUGGESTIONS_DISABLED=true, -Djava.net.preferIPv4Stack=true, -DTEST_SCALE_FACTOR=1.0, -DIGNITE_TEST_PROP_LOG4J_FILE=log4j-tc-test.xml, -DIGNITE_QUIET=false, -DIGNITE_MARSHAL_BUFFERS_RECHECK=1000, -Dmaven.repo.local=/opt/buildagent/.m2/repository] [21:07:09] : [Step 4/5] [2021-11-19 21:07:09,902][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][IgniteKernal%grid-0] System cache's DataRegion size is configured to 40 MB. Use DataStorageConfiguration.systemRegionInitialSize property to change the setting. [21:07:09] : [Step 4/5] [2021-11-19 21:07:09,903][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][IgniteKernal%grid-0] Configured caches [in 'sysMemPlc' dataRegion: ['ignite-sys-cache']] [21:07:09]W: [org.apache.ignite:ignite-core] [2021-11-19 21:07:09,903][WARN ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][IgniteKernal%grid-0] Peer class loading is enabled (disable it in production for performance and deployment consistency reasons) [21:07:09] : [Step 4/5] [2021-11-19 21:07:09,903][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][IgniteKernal%grid-0] 3-rd party licenses can be found at: /opt/buildagent/work/7bc1c54bc719b67c/libs/licenses [21:07:09] : [Step 4/5] [2021-11-19 21:07:09,908][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][IgnitePluginProcessor] Configured plugins: [21:07:09] : [Step 4/5] [2021-11-19 21:07:09,908][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][IgnitePluginProcessor] ^-- StanByClusterTestProvider 1.0 [21:07:09] : [Step 4/5] [2021-11-19 21:07:09,908][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][IgnitePluginProcessor] ^-- null [21:07:09] : [Step 4/5] [2021-11-19 21:07:09,908][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][IgnitePluginProcessor] [21:07:09] : [Step 4/5] [2021-11-19 21:07:09,909][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][IgnitePluginProcessor] ^-- PageMemory tracker plugin 1.0 [21:07:09] : [Step 4/5] [2021-11-19 21:07:09,909][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][IgnitePluginProcessor] ^-- null [21:07:09] : [Step 4/5] [2021-11-19 21:07:09,909][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][IgnitePluginProcessor] [21:07:09] : [Step 4/5] [2021-11-19 21:07:09,909][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][IgnitePluginProcessor] ^-- TestDistibutedConfigurationPlugin 1.0 [21:07:09] : [Step 4/5] [2021-11-19 21:07:09,910][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][IgnitePluginProcessor] ^-- null [21:07:09] : [Step 4/5] [2021-11-19 21:07:09,910][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][IgnitePluginProcessor] [21:07:09] : [Step 4/5] [2021-11-19 21:07:09,910][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][IgnitePluginProcessor] ^-- NodeValidationPluginProvider 1.0 [21:07:09] : [Step 4/5] [2021-11-19 21:07:09,911][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][IgnitePluginProcessor] ^-- null [21:07:09] : [Step 4/5] [2021-11-19 21:07:09,911][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][IgnitePluginProcessor] [21:07:09] : [Step 4/5] [2021-11-19 21:07:09,911][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][FailureProcessor] Configured failure handler: [hnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]]] [21:07:09] : [Step 4/5] [2021-11-19 21:07:09,973][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][TcpCommunicationSpi] Successfully bound communication NIO server to TCP port [port=45160, locHost=/127.0.0.1, selectorsCnt=12, selectorSpins=0, pairedConn=false] [21:07:09]W: [org.apache.ignite:ignite-core] [2021-11-19 21:07:09,973][WARN ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][TcpCommunicationSpi] Message queue limit is set to 0 which may lead to potential OOMEs when running cache operations in FULL_ASYNC or PRIMARY_SYNC modes due to message queues growth on sender and receiver sides. [21:07:09] : [Step 4/5] [2021-11-19 21:07:09,983][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][GridCollisionManager] Collision resolution is disabled (all jobs will be activated upon arrival). [21:07:09] : [Step 4/5] [2021-11-19 21:07:09,984][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][IgniteKernal%grid-0] Security status [authentication=off, sandbox=off, tls/ssl=off] [21:07:10] : [Step 4/5] [2021-11-19 21:07:10,048][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:07:10] : [Step 4/5] [2021-11-19 21:07:10,164][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][MaintenanceProcessor] Resolved store directory for node persistent data: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0 [21:07:10] : [Step 4/5] [2021-11-19 21:07:10,165][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][CacheObjectBinaryProcessorImpl] Resolved directory for serialized binary metadata: /opt/buildagent/work/7bc1c54bc719b67c/work/db/binary_meta/grid_0 [21:07:10] : [Step 4/5] Surefire report watcher [21:07:10] : [Surefire report watcher] Watching paths: [21:07:10] : [Surefire report watcher] /opt/buildagent/temp/buildTmp/ignite-tools-junit-reports1777670380320881607/test-org.apache.ignite.testsuites.IgniteBasicWithPersistenceTestSuite1637345072191.xml [21:07:10]i: [Step 4/5] org.apache.ignite.testsuites.IgniteBasicWithPersistenceTestSuite [21:07:10]i: [org.apache.ignite.testsuites.IgniteBasicWithPersistenceTestSuite] org.apache.ignite.internal.encryption.EncryptedCacheNodeJoinTest.testServerNodeJoinActiveClusterWithNewStaticCacheConfig [21:07:10] : [Step 4/5] [2021-11-19 21:07:10,169][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0 [21:07:10]i: [org.apache.ignite.testsuites.IgniteBasicWithPersistenceTestSuite] org.apache.ignite.internal.encryption.EncryptedCacheNodeJoinTest.testClientNodeJoinActiveClusterWithNewStaticCacheConfig [21:07:10] : [Step 4/5] [2021-11-19 21:07:10,170][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][FileWriteAheadLogManager] Resolved write ahead log work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0 [21:07:10]i: [org.apache.ignite.testsuites.IgniteBasicWithPersistenceTestSuite] org.apache.ignite.internal.encryption.EncryptedCacheNodeJoinTest.testClientNodeJoinInactiveClusterWithNewStaticCacheConfig [21:07:10]i: [org.apache.ignite.testsuites.IgniteBasicWithPersistenceTestSuite] org.apache.ignite.internal.encryption.EncryptedCacheNodeJoinTest.testClientNodeJoin [21:07:10] : [Step 4/5] [2021-11-19 21:07:10,170][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][FileWriteAheadLogManager] Resolved write ahead log archive directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0 [21:07:10]i: [org.apache.ignite.testsuites.IgniteBasicWithPersistenceTestSuite] org.apache.ignite.internal.encryption.EncryptedCacheNodeJoinTest.testThirdNodeCanJoin [21:07:10]i: [org.apache.ignite.testsuites.IgniteBasicWithPersistenceTestSuite] org.apache.ignite.internal.encryption.EncryptedCacheNodeJoinTest.testClientNodeJoinInactiveClusterWithExistingStaticCacheConfig [21:07:10]i: [org.apache.ignite.testsuites.IgniteBasicWithPersistenceTestSuite] org.apache.ignite.internal.encryption.EncryptedCacheNodeJoinTest.testNodeCantJoinWithSameNameButEncCache [21:07:10]i: [org.apache.ignite.testsuites.IgniteBasicWithPersistenceTestSuite] org.apache.ignite.internal.encryption.EncryptedCacheNodeJoinTest.testNodeCanJoin [21:07:10]i: [org.apache.ignite.testsuites.IgniteBasicWithPersistenceTestSuite] org.apache.ignite.internal.encryption.EncryptedCacheNodeJoinTest.testNodeCantJoinWithoutEncryptionSpi [21:07:10]i: [org.apache.ignite.testsuites.IgniteBasicWithPersistenceTestSuite] org.apache.ignite.internal.encryption.EncryptedCacheNodeJoinTest.testClientNodeJoinActiveClusterWithExistingStaticCacheConfig [21:07:10]i: [org.apache.ignite.testsuites.IgniteBasicWithPersistenceTestSuite] org.apache.ignite.internal.encryption.EncryptedCacheNodeJoinTest.testNodeCantJoinWithSameNameButNotEncCache [21:07:10]i: [org.apache.ignite.testsuites.IgniteBasicWithPersistenceTestSuite] org.apache.ignite.internal.encryption.EncryptedCacheNodeJoinTest.testNodeCantJoinWithDifferentKeyStore [21:07:10]i: [org.apache.ignite.testsuites.IgniteBasicWithPersistenceTestSuite] org.apache.ignite.internal.encryption.EncryptedCacheNodeJoinTest.testNodeCantJoinWithDifferentCacheKeys [21:07:10]i: [org.apache.ignite.testsuites.IgniteBasicWithPersistenceTestSuite] org.apache.ignite.internal.encryption.EncryptedCacheNodeJoinTest.testServerNodeJoinInactiveClusterWithNewStaticCacheConfig [21:07:10] : [Step 4/5] [2021-11-19 21:07:10,589][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000000.wal [21:07:10]W: [org.apache.ignite:ignite-core] [2021-11-19 21:07:10,590][WARN ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][GridCacheDatabaseSharedManager] DataRegion maxSize=10.5 MB is smaller than defaultInitialSize=268.4 MB, setting initialSize to 10.5 MB [21:07:10] : [Step 4/5] [2021-11-19 21:07:10,596][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][GridCacheDatabaseSharedManager] Configured data regions initialized successfully [total=5] [21:07:10] : [Step 4/5] [2021-11-19 21:07:10,599][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][IgniteSnapshotManager] Resolved snapshot work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/snapshots [21:07:10] : [Step 4/5] [2021-11-19 21:07:10,599][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][IgniteSnapshotManager] Resolved temp directory for snapshot creation: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0/snp [21:07:10] : [Step 4/5] [2021-11-19 21:07:10,602][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][ClientListenerProcessor] Client connector processor has started on TCP port 10800 [21:07:10] : [Step 4/5] [2021-11-19 21:07:10,608][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][IgniteKernal%grid-0] Non-loopback local IPs: 172.17.0.4 [21:07:10] : [Step 4/5] [2021-11-19 21:07:10,608][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][IgniteKernal%grid-0] Enabled local MACs: 0242AC110004 [21:07:10] : [Step 4/5] [2021-11-19 21:07:10,611][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:07:10] : [Step 4/5] [2021-11-19 21:07:10,612][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:07:10] : [Step 4/5] [2021-11-19 21:07:10,612][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:07:10] : [Step 4/5] [2021-11-19 21:07:10,614][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][GridCacheDatabaseSharedManager] Applying lost metastore updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:07:10] : [Step 4/5] [2021-11-19 21:07:10,616][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=0 ms] [21:07:10] : [Step 4/5] [2021-11-19 21:07:10,616][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][GridCacheProcessor] Restoring partition state for local groups. [21:07:10] : [Step 4/5] [2021-11-19 21:07:10,617][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=0, partitionsProcessed=0, time=0ms] [21:07:10] : [Step 4/5] [2021-11-19 21:07:10,617][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][GridEncryptionManager] Encryption keys loaded from metastore. [grps=, masterKeyName=ignite.master.key] [21:07:10] : [Step 4/5] [2021-11-19 21:07:10,623][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][ClusterProcessor] Cluster ID and tag has been read from metastorage: null [21:07:10] : [Step 4/5] [2021-11-19 21:07:10,624][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][IgniteClusterImpl] Shutdown policy was updated [oldVal=null, newVal=null] [21:07:10] : [Step 4/5] [2021-11-19 21:07:10,624][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][GridCacheDatabaseSharedManager] Checkpoint frequency deviation changed [oldVal=null, newVal=null] [21:07:10] : [Step 4/5] [2021-11-19 21:07:10,634][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][FilePageStoreManager] Cleanup cache stores [total=1, left=0, cleanFiles=false] [21:07:10] : [Step 4/5] [2021-11-19 21:07:10,636][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:07:10] : [Step 4/5] [2021-11-19 21:07:10,637][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:07:10] : [Step 4/5] [2021-11-19 21:07:10,638][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:07:10] : [Step 4/5] [2021-11-19 21:07:10,639][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][GridCacheDatabaseSharedManager] Data Regions Started: 5 [21:07:10] : [Step 4/5] [2021-11-19 21:07:10,639][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][GridCacheDatabaseSharedManager] ^-- sysMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:07:10] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:07:10] : [Step 4/5] ^-- default region [type=default, persistence=true, lazyAlloc=true, [21:07:10] : [Step 4/5] ... initCfg=10MB, maxCfg=10MB, usedRam=0MB, freeRam=100%, allocRam=0MB, allocTotal=0MB] [21:07:10] : [Step 4/5] ^-- metastoreMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:07:10] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:07:10] : [Step 4/5] ^-- TxLog region [type=internal, persistence=true, lazyAlloc=false, [21:07:10] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:07:10] : [Step 4/5] ^-- volatileDsMemPlc region [type=user, persistence=false, lazyAlloc=true, [21:07:10] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB] [21:07:10] : [Step 4/5] ^-- Ignite persistence [used=0MB] [21:07:10] : [Step 4/5] [21:07:10] : [Step 4/5] [2021-11-19 21:07:10,641][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][GridCacheDatabaseSharedManager] Starting binary memory restore for: [-2100569601] [21:07:10] : [Step 4/5] [2021-11-19 21:07:10,649][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:07:10] : [Step 4/5] [2021-11-19 21:07:10,650][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:07:10] : [Step 4/5] [2021-11-19 21:07:10,652][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000000.wal, offset=0, ver=2] [21:07:10] : [Step 4/5] [2021-11-19 21:07:10,655][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][GridCacheProcessor] Started cache in recovery mode [name=ignite-sys-cache, id=-2100569601, dataRegionName=sysMemPlc, mode=REPLICATED, atomicity=TRANSACTIONAL, backups=2147483647, mvcc=false] [21:07:10] : [Step 4/5] [2021-11-19 21:07:10,656][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][GridCacheDatabaseSharedManager] Binary recovery performed in 16 ms. [21:07:10] : [Step 4/5] [2021-11-19 21:07:10,657][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:07:10] : [Step 4/5] [2021-11-19 21:07:10,657][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][GridCacheDatabaseSharedManager] Applying lost cache updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:07:10] : [Step 4/5] [2021-11-19 21:07:10,724][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=70 ms] [21:07:10] : [Step 4/5] [2021-11-19 21:07:10,724][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][GridCacheProcessor] Restoring partition state for local groups. [21:07:10] : [Step 4/5] [2021-11-19 21:07:10,730][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=1, partitionsProcessed=100, time=10ms] [21:07:11] : [Step 4/5] [2021-11-19 21:07:11,079][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][TestTcpDiscoverySpi] Successfully bound to TCP port [port=47500, localHost=localhost/127.0.0.1, locNodeId=004f3da2-3eac-4791-a4d2-e9628138a000] [21:07:11] : [Step 4/5] [2021-11-19 21:07:11,088][INFO ][disco-notifier-worker-#13991%grid-0%][MvccProcessorImpl] Assigned mvcc coordinator [crd=MvccCoordinator [topVer=AffinityTopologyVersion [topVer=1, minorTopVer=0], nodeId=004f3da2-3eac-4791-a4d2-e9628138a000, ver=1637345231085, local=true, initialized=false]] [21:07:11] : [Step 4/5] [2021-11-19 21:07:11,089][INFO ][sys-#13979%grid-0%][ClusterProcessor] Writing cluster ID and tag to metastorage on ready for write ClusterIdAndTag [id=a7269b46-6430-4ed2-8b21-f79ca0c657d2, tag=busy_austin] [21:07:11] : [Step 4/5] [2021-11-19 21:07:11,093][INFO ][disco-notifier-worker-#13991%grid-0%][ClusterProcessor] busy_austin [21:07:11] : [Step 4/5] [2021-11-19 21:07:11,094][INFO ][disco-notifier-worker-#13991%grid-0%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustEnabled' was changed from 'null' to 'false' [21:07:11] : [Step 4/5] [2021-11-19 21:07:11,095][INFO ][disco-notifier-worker-#13991%grid-0%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustTimeout' was changed from 'null' to '300000' [21:07:11] : [Step 4/5] [2021-11-19 21:07:11,096][INFO ][disco-notifier-worker-#13991%grid-0%][IgniteTxManager] Transactions parameter 'longOperationsDumpTimeout' was changed from 'null' to '60000' [21:07:11] : [Step 4/5] [2021-11-19 21:07:11,097][INFO ][disco-notifier-worker-#13991%grid-0%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpThreshold' was changed from 'null' to '0' [21:07:11] : [Step 4/5] [2021-11-19 21:07:11,098][INFO ][disco-notifier-worker-#13991%grid-0%][IgniteTxManager] Transactions parameter 'transactionTimeDumpSamplesCoefficient' was changed from 'null' to '0.0' [21:07:11] : [Step 4/5] [2021-11-19 21:07:11,101][INFO ][disco-notifier-worker-#13991%grid-0%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpSamplesPerSecondLimit' was changed from 'null' to '5' [21:07:11] : [Step 4/5] [2021-11-19 21:07:11,106][INFO ][disco-notifier-worker-#13991%grid-0%][IgniteTxManager] Transactions parameter 'collisionsDumpInterval' was changed from 'null' to '1000' [21:07:11] : [Step 4/5] [2021-11-19 21:07:11,107][INFO ][disco-notifier-worker-#13991%grid-0%][IgniteTxManager] Transactions parameter 'txOwnerDumpRequestsAllowed' was changed from 'null' to 'true' [21:07:11] : [Step 4/5] [2021-11-19 21:07:11,107][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][IgniteKernal%grid-0] To start Console Management & Monitoring run ignitevisorcmd.{sh|bat} [21:07:11] : [Step 4/5] [2021-11-19 21:07:11,107][INFO ][disco-notifier-worker-#13991%grid-0%][GridCacheDatabaseSharedManager] Historical rebalance WAL threshold changed [property=historical.rebalance.threshold, oldVal=null, newVal=500] [21:07:11] : [Step 4/5] [2021-11-19 21:07:11,108][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][IgniteKernal%grid-0] [21:07:11] : [Step 4/5] [21:07:11] : [Step 4/5] >>> +-------------------------------------------+ [21:07:11] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:07:11] : [Step 4/5] >>> +-------------------------------------------+ [21:07:11] : [Step 4/5] >>> OS name: Linux 4.15.0-151-generic amd64 [21:07:11] : [Step 4/5] >>> CPU(s): 24 [21:07:11] : [Step 4/5] >>> Heap: 2.0GB [21:07:11] : [Step 4/5] >>> VM name: 16724@c4dfe9a430b2 [21:07:11] : [Step 4/5] >>> Ignite instance name: grid-0 [21:07:11] : [Step 4/5] >>> Local node [ID=004F3DA2-3EAC-4791-A4D2-E9628138A000, order=1, clientMode=false] [21:07:11] : [Step 4/5] >>> Local node addresses: [127.0.0.1] [21:07:11] : [Step 4/5] >>> Local ports: TCP:10800 TCP:45160 TCP:47500 [21:07:11] : [Step 4/5] [21:07:11] : [Step 4/5] [2021-11-19 21:07:11,109][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][IgniteKernal%grid-0] >>> Ignite cluster is in INACTIVE state (limited functionality available). Use control.(sh|bat) script or IgniteCluster.state(ClusterState.ACTIVE) to change the state. [21:07:11] : [Step 4/5] [2021-11-19 21:07:11,110][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][GridDiscoveryManager] Topology snapshot [ver=1, locNode=004f3da2, servers=1, clients=0, state=INACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=004f3da2-3eac-4791-a4d2-e9628138a000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:07:11] : [Step 4/5] [2021-11-19 21:07:11,110][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][G] Node started : [stage="Configure system pool" (0 ms),stage="Start managers" (279 ms),stage="Configure binary metadata" (2 ms),stage="Start processors" (440 ms),stage="Start 'StanByClusterTestProvider' plugin" (0 ms),stage="Start 'PageMemory tracker plugin' plugin" (0 ms),stage="Start 'TestDistibutedConfigurationPlugin' plugin" (0 ms),stage="Start 'NodeValidationPluginProvider' plugin" (0 ms),stage="Init metastore" (27 ms),stage="Init and start regions" (6 ms),stage="Restore binary memory" (15 ms),stage="Restore logical state" (74 ms),stage="Finish recovery" (347 ms),stage="Join topology" (9 ms),stage="Await transition" (1 ms),stage="Await exchange" (20 ms),stage="Total time" (1220 ms)] [21:07:11] : [Step 4/5] [2021-11-19 21:07:11,112][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][root] Node started with the following configuration [id=004f3da2-3eac-4791-a4d2-e9628138a000, marshaller=BinaryMarshaller [], discovery=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=5000, ackTimeout=5000, marsh=JdkMarshaller [clsFilter=org.apache.ignite.marshaller.MarshallerUtils$1@315f938d], reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], binaryCfg=null, lateAff=true] [21:07:11]W: [org.apache.ignite:ignite-core] [2021-11-19 21:07:11,117][WARN ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][G] Ignite work directory is not provided, automatically resolved to: /opt/buildagent/work/7bc1c54bc719b67c/work [21:07:11] : [Step 4/5] [2021-11-19 21:07:11,118][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][IgniteKernal%grid-1] [21:07:11] : [Step 4/5] [21:07:11] : [Step 4/5] >>> __________ ________________ [21:07:11] : [Step 4/5] >>> / _/ ___/ |/ / _/_ __/ __/ [21:07:11] : [Step 4/5] >>> _/ // (7 7 // / / / / _/ [21:07:11] : [Step 4/5] >>> /___/\___/_/|_/___/ /_/ /___/ [21:07:11] : [Step 4/5] >>> [21:07:11] : [Step 4/5] >>> ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:07:11] : [Step 4/5] >>> 2021 Copyright(C) Apache Software Foundation [21:07:11] : [Step 4/5] >>> [21:07:11] : [Step 4/5] >>> Ignite documentation: http://ignite.apache.org [21:07:11] : [Step 4/5] [21:07:11] : [Step 4/5] [2021-11-19 21:07:11,118][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][IgniteKernal%grid-1] Config URL: n/a [21:07:11] : [Step 4/5] [2021-11-19 21:07:11,119][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][IgniteKernal%grid-1] IgniteConfiguration [igniteInstanceName=grid-1, pubPoolSize=24, svcPoolSize=24, callbackPoolSize=24, stripedPoolSize=24, sysPoolSize=24, mgmtPoolSize=4, dataStreamerPoolSize=24, utilityCachePoolSize=24, utilityCacheKeepAliveTime=60000, p2pPoolSize=2, qryPoolSize=24, buildIdxPoolSize=4, igniteHome=/opt/buildagent/work/7bc1c54bc719b67c, igniteWorkDir=/opt/buildagent/work/7bc1c54bc719b67c/work, mbeanSrv=com.sun.jmx.mbeanserver.JmxMBeanServer@6fe85038, nodeId=10f8f56a-7627-4fb3-b0c0-cbf65f7dc001, marsh=BinaryMarshaller [], marshLocJobs=false, daemon=false, p2pEnabled=true, netTimeout=10000, netCompressionLevel=1, sndRetryDelay=1000, sndRetryCnt=3, metricsHistSize=10000, metricsUpdateFreq=1000, metricsExpTime=9223372036854775807, discoSpi=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=0, ackTimeout=0, marsh=null, reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], segPlc=STOP, segResolveAttempts=2, waitForSegOnStart=true, allResolversPassReq=true, segChkFreq=10000, commSpi=TcpCommunicationSpi [connectGate=org.apache.ignite.spi.communication.tcp.internal.ConnectGateway@414cf288, ctxInitLatch=java.util.concurrent.CountDownLatch@161c34a2[Count = 1], stopping=false, clientPool=null, nioSrvWrapper=null, stateProvider=null], evtSpi=MemoryEventStorageSpi [expireAgeMs=9223372036854775807, expireCnt=10000, filter=null], colSpi=NoopCollisionSpi [], deploySpi=LocalDeploymentSpi [], indexingSpi=org.apache.ignite.spi.indexing.noop.NoopIndexingSpi@2b8dd510, addrRslvr=null, encryptionSpi=org.apache.ignite.spi.encryption.keystore.KeystoreEncryptionSpi@7518a994, tracingSpi=org.apache.ignite.spi.tracing.NoopTracingSpi@6605077a, clientMode=false, rebalanceThreadPoolSize=4, rebalanceTimeout=10000, rebalanceBatchesPrefetchCnt=3, rebalanceThrottle=0, rebalanceBatchSize=524288, txCfg=TransactionConfiguration [txSerEnabled=false, dfltIsolation=REPEATABLE_READ, dfltConcurrency=PESSIMISTIC, dfltTxTimeout=0, txTimeoutOnPartitionMapExchange=0, deadlockTimeout=10000, pessimisticTxLogSize=0, pessimisticTxLogLinger=10000, tmLookupClsName=null, txManagerFactory=null, useJtaSync=false], cacheSanityCheckEnabled=true, discoStartupDelay=60000, deployMode=SHARED, p2pMissedCacheSize=100, locHost=127.0.0.1, timeSrvPortBase=31100, timeSrvPortRange=100, failureDetectionTimeout=10000, sysWorkerBlockedTimeout=null, clientFailureDetectionTimeout=10000, metricsLogFreq=0, connectorCfg=null, odbcCfg=null, warmupClos=null, atomicCfg=AtomicConfiguration [seqReserveSize=1000, cacheMode=PARTITIONED, backups=1, aff=null, grpName=null], classLdr=null, sslCtxFactory=null, platformCfg=null, binaryCfg=null, memCfg=null, pstCfg=null, dsCfg=DataStorageConfiguration [sysRegionInitSize=41943040, sysRegionMaxSize=104857600, pageSize=4096, concLvl=0, dfltDataRegConf=DataRegionConfiguration [name=default, maxSize=10485760, initSize=268435456, swapPath=null, pageEvictionMode=DISABLED, pageReplacementMode=CLOCK, evictionThreshold=0.9, emptyPagesPoolSize=100, metricsEnabled=false, metricsSubIntervalCount=5, metricsRateTimeInterval=60000, persistenceEnabled=true, checkpointPageBufSize=0, lazyMemoryAllocation=true, warmUpCfg=null], dataRegions=null, storagePath=null, checkpointFreq=180000, lockWaitTime=10000, checkpointThreads=4, checkpointWriteOrder=SEQUENTIAL, walHistSize=20, maxWalArchiveSize=1073741824, walSegments=10, walSegmentSize=67108864, walPath=db/wal, walArchivePath=db/wal/archive, cdcWalPath=db/wal/cdc, cdcEnabled=false, metricsEnabled=false, walMode=FSYNC, walTlbSize=131072, walBuffSize=0, walFlushFreq=2000, walFsyncDelay=1000, walRecordIterBuffSize=67108864, alwaysWriteFullPages=false, fileIOFactory=org.apache.ignite.internal.processors.cache.persistence.file.AsyncFileIOFactory@6a704593, metricsSubIntervalCnt=5, metricsRateTimeInterval=60000, walAutoArchiveAfterInactivity=-1, walForceArchiveTimeout=-1, writeThrottlingEnabled=false, walCompactionEnabled=false, walCompactionLevel=1, checkpointReadLockTimeout=null, walPageCompression=DISABLED, walPageCompressionLevel=null, dfltWarmUpCfg=null, encCfg=org.apache.ignite.configuration.EncryptionConfiguration@14c9c26d, defragmentationThreadPoolSize=4, minWalArchiveSize=-1], snapshotPath=snapshots, activeOnStart=true, activeOnStartPropSetFlag=false, autoActivation=true, autoActivationPropSetFlag=false, clusterStateOnStart=null, sqlConnCfg=null, cliConnCfg=ClientConnectorConfiguration [host=null, port=10800, portRange=100, sockSndBufSize=0, sockRcvBufSize=0, tcpNoDelay=true, maxOpenCursorsPerConn=128, threadPoolSize=24, selectorCnt=12, idleTimeout=0, handshakeTimeout=10000, jdbcEnabled=true, odbcEnabled=true, thinCliEnabled=true, sslEnabled=false, useIgniteSslCtxFactory=true, sslClientAuth=false, sslCtxFactory=null, thinCliCfg=ThinClientConfiguration [maxActiveTxPerConn=100, maxActiveComputeTasksPerConn=0]], mvccVacuumThreadCnt=2, mvccVacuumFreq=5000, authEnabled=false, failureHnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]], commFailureRslvr=null, sqlCfg=SqlConfiguration [longQryWarnTimeout=3000, dfltQryTimeout=0, sqlQryHistSize=1000, validationEnabled=false], asyncContinuationExecutor=null] [21:07:11] : [Step 4/5] [2021-11-19 21:07:11,127][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][IgniteKernal%grid-1] Daemon mode: off [21:07:11] : [Step 4/5] [2021-11-19 21:07:11,127][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][IgniteKernal%grid-1] OS: Linux 4.15.0-151-generic amd64 [21:07:11] : [Step 4/5] [2021-11-19 21:07:11,128][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][IgniteKernal%grid-1] OS user: teamcity [21:07:11] : [Step 4/5] [2021-11-19 21:07:11,128][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][IgniteKernal%grid-1] PID: 16724 [21:07:11] : [Step 4/5] [2021-11-19 21:07:11,128][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][IgniteKernal%grid-1] Language runtime: Java Platform API Specification ver. 1.8 [21:07:11] : [Step 4/5] [2021-11-19 21:07:11,129][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][IgniteKernal%grid-1] VM information: Java(TM) SE Runtime Environment 1.8.0_261-b12 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 25.261-b12 [21:07:11] : [Step 4/5] [2021-11-19 21:07:11,129][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][IgniteKernal%grid-1] VM total memory: 1.8GB [21:07:11] : [Step 4/5] [2021-11-19 21:07:11,129][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][IgniteKernal%grid-1] Remote Management [restart: off, REST: off, JMX (remote: off)] [21:07:11] : [Step 4/5] [2021-11-19 21:07:11,130][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][IgniteKernal%grid-1] Logger: GridTestLog4jLogger [quiet=false, config=null] [21:07:11] : [Step 4/5] [2021-11-19 21:07:11,130][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][IgniteKernal%grid-1] IGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c [21:07:11] : [Step 4/5] [2021-11-19 21:07:11,130][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][IgniteKernal%grid-1] VM arguments: [-DIGNITE_DUMP_THREADS_ON_FAILURE=false, -DMono=/usr/bin/mono-sgen, -DMono4.0_x64=/usr/lib/mono/4.0, -DMono4.5_x64=/usr/lib/mono/4.5, -DMonoVersion=6.12.0.90, -DSKIP_BUILD=false, -Dagent.home.dir=/opt/buildagent, -Dagent.name=aitc-lin02_03, -Dagent.ownPort=9090, -Dagent.work.dir=/opt/buildagent/work, -Dbuild.number=95, -Dbuild.vcs.number=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.1=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.GitHubApacheIgnite=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dclassworlds.conf=/opt/buildagent/temp/buildTmp/teamcity.m2.conf, -Dcom.jetbrains.maven.watcher.report.file=/opt/buildagent/temp/buildTmp/maven-build-info.xml, -Djava.io.tmpdir=/opt/buildagent/temp/buildTmp, -Dmaven.home=/opt/buildagent/tools/maven3_6, -Dmaven.multiModuleProjectDirectory=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.agent.cpuBenchmark=457, -Dteamcity.agent.dotnet.agent_url=http://localhost:9090/RPC2, -Dteamcity.agent.dotnet.build_id=6278078, -Dteamcity.auth.password=*******, -Dteamcity.auth.userId=TeamCityBuildId=6278078, -Dteamcity.build.changedFiles.file=/opt/buildagent/temp/buildTmp/changedFiles6342607772318147725.txt, -Dteamcity.build.checkoutDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.build.id=6278078, -Dteamcity.build.properties.file=/opt/buildagent/temp/buildTmp/teamcity.build5164517880467851002.properties, -Dteamcity.build.tempDir=/opt/buildagent/temp/buildTmp, -Dteamcity.build.workingDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.buildConfName=Basic 3, -Dteamcity.buildType.id=IgniteTests24Java8_Basic3, -Dteamcity.configuration.properties.file=/opt/buildagent/temp/buildTmp/teamcity.config5591980786735343870.properties, -Dteamcity.maven.userSettings.path=/opt/buildagent/temp/buildTmp/maven_settings_585072866407032347.xml, -Dteamcity.maven.watcher.home=/opt/buildagent/plugins/mavenPlugin/maven-watcher-jdk16, -Dteamcity.projectName=Ignite Tests 2.x (JDK 8/11), -Dteamcity.runner.properties.file=/opt/buildagent/temp/buildTmp/teamcity.runner9098465561618137420.properties, -Dteamcity.tests.recentlyFailedTests.file=/opt/buildagent/temp/buildTmp/testsToRunFirst3891775683130404069.txt, -Dteamcity.version=2021.2 (build 99542), -ea, -Xms2g, -Xmx2g, -XX:+HeapDumpOnOutOfMemoryError, -DIGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_TEST_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_UPDATE_NOTIFIER=false, -DIGNITE_NO_DISCO_ORDER=true, -DIGNITE_PERFORMANCE_SUGGESTIONS_DISABLED=true, -Djava.net.preferIPv4Stack=true, -DTEST_SCALE_FACTOR=1.0, -DIGNITE_TEST_PROP_LOG4J_FILE=log4j-tc-test.xml, -DIGNITE_QUIET=false, -DIGNITE_MARSHAL_BUFFERS_RECHECK=1000, -Dmaven.repo.local=/opt/buildagent/.m2/repository] [21:07:11] : [Step 4/5] [2021-11-19 21:07:11,135][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][IgniteKernal%grid-1] System cache's DataRegion size is configured to 40 MB. Use DataStorageConfiguration.systemRegionInitialSize property to change the setting. [21:07:11] : [Step 4/5] [2021-11-19 21:07:11,135][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][IgniteKernal%grid-1] Configured caches [in 'sysMemPlc' dataRegion: ['ignite-sys-cache']] [21:07:11]W: [org.apache.ignite:ignite-core] [2021-11-19 21:07:11,135][WARN ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][IgniteKernal%grid-1] Peer class loading is enabled (disable it in production for performance and deployment consistency reasons) [21:07:11] : [Step 4/5] [2021-11-19 21:07:11,136][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][IgniteKernal%grid-1] 3-rd party licenses can be found at: /opt/buildagent/work/7bc1c54bc719b67c/libs/licenses [21:07:11] : [Step 4/5] [2021-11-19 21:07:11,140][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][IgnitePluginProcessor] Configured plugins: [21:07:11] : [Step 4/5] [2021-11-19 21:07:11,140][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][IgnitePluginProcessor] ^-- StanByClusterTestProvider 1.0 [21:07:11] : [Step 4/5] [2021-11-19 21:07:11,140][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][IgnitePluginProcessor] ^-- null [21:07:11] : [Step 4/5] [2021-11-19 21:07:11,140][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][IgnitePluginProcessor] [21:07:11] : [Step 4/5] [2021-11-19 21:07:11,140][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][IgnitePluginProcessor] ^-- PageMemory tracker plugin 1.0 [21:07:11] : [Step 4/5] [2021-11-19 21:07:11,141][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][IgnitePluginProcessor] ^-- null [21:07:11] : [Step 4/5] [2021-11-19 21:07:11,141][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][IgnitePluginProcessor] [21:07:11] : [Step 4/5] [2021-11-19 21:07:11,141][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][IgnitePluginProcessor] ^-- TestDistibutedConfigurationPlugin 1.0 [21:07:11] : [Step 4/5] [2021-11-19 21:07:11,141][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][IgnitePluginProcessor] ^-- null [21:07:11] : [Step 4/5] [2021-11-19 21:07:11,141][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][IgnitePluginProcessor] [21:07:11] : [Step 4/5] [2021-11-19 21:07:11,142][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][IgnitePluginProcessor] ^-- NodeValidationPluginProvider 1.0 [21:07:11] : [Step 4/5] [2021-11-19 21:07:11,142][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][IgnitePluginProcessor] ^-- null [21:07:11] : [Step 4/5] [2021-11-19 21:07:11,142][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][IgnitePluginProcessor] [21:07:11] : [Step 4/5] [2021-11-19 21:07:11,142][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][FailureProcessor] Configured failure handler: [hnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]]] [21:07:11] : [Step 4/5] [2021-11-19 21:07:11,161][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][TcpCommunicationSpi] Successfully bound communication NIO server to TCP port [port=45161, locHost=/127.0.0.1, selectorsCnt=12, selectorSpins=0, pairedConn=false] [21:07:11]W: [org.apache.ignite:ignite-core] [2021-11-19 21:07:11,161][WARN ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][TcpCommunicationSpi] Message queue limit is set to 0 which may lead to potential OOMEs when running cache operations in FULL_ASYNC or PRIMARY_SYNC modes due to message queues growth on sender and receiver sides. [21:07:11] : [Step 4/5] [2021-11-19 21:07:11,166][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][GridCollisionManager] Collision resolution is disabled (all jobs will be activated upon arrival). [21:07:11] : [Step 4/5] [2021-11-19 21:07:11,166][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][IgniteKernal%grid-1] Security status [authentication=off, sandbox=off, tls/ssl=off] [21:07:11] : [Step 4/5] [2021-11-19 21:07:11,224][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:07:11] : [Step 4/5] [2021-11-19 21:07:11,316][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][MaintenanceProcessor] Resolved store directory for node persistent data: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1 [21:07:11] : [Step 4/5] [2021-11-19 21:07:11,318][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][CacheObjectBinaryProcessorImpl] Resolved directory for serialized binary metadata: /opt/buildagent/work/7bc1c54bc719b67c/work/db/binary_meta/grid_1 [21:07:11] : [Step 4/5] [2021-11-19 21:07:11,324][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1 [21:07:11] : [Step 4/5] [2021-11-19 21:07:11,324][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][FileWriteAheadLogManager] Resolved write ahead log work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1 [21:07:11] : [Step 4/5] [2021-11-19 21:07:11,325][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][FileWriteAheadLogManager] Resolved write ahead log archive directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1 [21:07:11] : [Step 4/5] [2021-11-19 21:07:11,740][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000000.wal [21:07:11] : [Step 4/5] [2021-11-19 21:07:11,744][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][GridCacheDatabaseSharedManager] Configured data regions initialized successfully [total=5] [21:07:11] : [Step 4/5] [2021-11-19 21:07:11,748][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][IgniteSnapshotManager] Resolved snapshot work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/snapshots [21:07:11] : [Step 4/5] [2021-11-19 21:07:11,749][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][IgniteSnapshotManager] Resolved temp directory for snapshot creation: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1/snp [21:07:11] : [Step 4/5] [2021-11-19 21:07:11,751][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][ClientListenerProcessor] Client connector processor has started on TCP port 10801 [21:07:11] : [Step 4/5] [2021-11-19 21:07:11,753][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][IgniteKernal%grid-1] Non-loopback local IPs: 172.17.0.4 [21:07:11] : [Step 4/5] [2021-11-19 21:07:11,754][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][IgniteKernal%grid-1] Enabled local MACs: 0242AC110004 [21:07:11] : [Step 4/5] [2021-11-19 21:07:11,754][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:07:11] : [Step 4/5] [2021-11-19 21:07:11,755][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:07:11] : [Step 4/5] [2021-11-19 21:07:11,756][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:07:11] : [Step 4/5] [2021-11-19 21:07:11,758][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][GridCacheDatabaseSharedManager] Applying lost metastore updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:07:11] : [Step 4/5] [2021-11-19 21:07:11,759][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=0 ms] [21:07:11] : [Step 4/5] [2021-11-19 21:07:11,759][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][GridCacheProcessor] Restoring partition state for local groups. [21:07:11] : [Step 4/5] [2021-11-19 21:07:11,760][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=0, partitionsProcessed=0, time=0ms] [21:07:11] : [Step 4/5] [2021-11-19 21:07:11,760][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][GridEncryptionManager] Encryption keys loaded from metastore. [grps=, masterKeyName=ignite.master.key] [21:07:11] : [Step 4/5] [2021-11-19 21:07:11,762][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][ClusterProcessor] Cluster ID and tag has been read from metastorage: null [21:07:11] : [Step 4/5] [2021-11-19 21:07:11,762][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][IgniteClusterImpl] Shutdown policy was updated [oldVal=null, newVal=null] [21:07:11] : [Step 4/5] [2021-11-19 21:07:11,763][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][GridCacheDatabaseSharedManager] Checkpoint frequency deviation changed [oldVal=null, newVal=null] [21:07:11] : [Step 4/5] [2021-11-19 21:07:11,775][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][FilePageStoreManager] Cleanup cache stores [total=1, left=0, cleanFiles=false] [21:07:11] : [Step 4/5] [2021-11-19 21:07:11,777][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:07:11] : [Step 4/5] [2021-11-19 21:07:11,778][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:07:11] : [Step 4/5] [2021-11-19 21:07:11,779][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:07:11] : [Step 4/5] [2021-11-19 21:07:11,779][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][GridCacheDatabaseSharedManager] Data Regions Started: 5 [21:07:11] : [Step 4/5] [2021-11-19 21:07:11,780][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][GridCacheDatabaseSharedManager] ^-- sysMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:07:11] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:07:11] : [Step 4/5] ^-- default region [type=default, persistence=true, lazyAlloc=true, [21:07:11] : [Step 4/5] ... initCfg=10MB, maxCfg=10MB, usedRam=0MB, freeRam=100%, allocRam=0MB, allocTotal=0MB] [21:07:11] : [Step 4/5] ^-- metastoreMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:07:11] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:07:11] : [Step 4/5] ^-- TxLog region [type=internal, persistence=true, lazyAlloc=false, [21:07:11] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:07:11] : [Step 4/5] ^-- volatileDsMemPlc region [type=user, persistence=false, lazyAlloc=true, [21:07:11] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB] [21:07:11] : [Step 4/5] ^-- Ignite persistence [used=0MB] [21:07:11] : [Step 4/5] [21:07:11] : [Step 4/5] [2021-11-19 21:07:11,782][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][GridCacheDatabaseSharedManager] Starting binary memory restore for: [-2100569601] [21:07:11] : [Step 4/5] [2021-11-19 21:07:11,791][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:07:11] : [Step 4/5] [2021-11-19 21:07:11,792][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:07:11] : [Step 4/5] [2021-11-19 21:07:11,793][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000000.wal, offset=0, ver=2] [21:07:11] : [Step 4/5] [2021-11-19 21:07:11,804][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][GridCacheProcessor] Started cache in recovery mode [name=ignite-sys-cache, id=-2100569601, dataRegionName=sysMemPlc, mode=REPLICATED, atomicity=TRANSACTIONAL, backups=2147483647, mvcc=false] [21:07:11] : [Step 4/5] [2021-11-19 21:07:11,804][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][GridCacheDatabaseSharedManager] Binary recovery performed in 22 ms. [21:07:11] : [Step 4/5] [2021-11-19 21:07:11,805][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:07:11] : [Step 4/5] [2021-11-19 21:07:11,805][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][GridCacheDatabaseSharedManager] Applying lost cache updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:07:11] : [Step 4/5] [2021-11-19 21:07:11,866][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=60 ms] [21:07:11] : [Step 4/5] [2021-11-19 21:07:11,866][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][GridCacheProcessor] Restoring partition state for local groups. [21:07:11] : [Step 4/5] [2021-11-19 21:07:11,872][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=1, partitionsProcessed=100, time=10ms] [21:07:12] : [Step 4/5] [2021-11-19 21:07:12,206][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][TestTcpDiscoverySpi] Successfully bound to TCP port [port=47501, localHost=localhost/127.0.0.1, locNodeId=10f8f56a-7627-4fb3-b0c0-cbf65f7dc001] [21:07:12] : [Step 4/5] [2021-11-19 21:07:12,210][INFO ][tcp-disco-srvr-[:47500]-#730%grid-0%-#13993%grid-0%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=51277] [21:07:12] : [Step 4/5] [2021-11-19 21:07:12,210][INFO ][tcp-disco-srvr-[:47500]-#730%grid-0%-#13993%grid-0%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=51277] [21:07:12] : [Step 4/5] [2021-11-19 21:07:12,211][INFO ][tcp-disco-sock-reader-[]-#736%grid-0%-#14112%grid-0%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:51277, rmtPort=51277] [21:07:12] : [Step 4/5] [2021-11-19 21:07:12,213][INFO ][tcp-disco-sock-reader-[10f8f56a 127.0.0.1:51277]-#736%grid-0%-#14112%grid-0%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=10f8f56a-7627-4fb3-b0c0-cbf65f7dc001, rmtAddr=/127.0.0.1:51277] [21:07:12] : [Step 4/5] [2021-11-19 21:07:12,220][INFO ][tcp-disco-srvr-[:47501]-#735%grid-1%-#14111%grid-1%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=51697] [21:07:12] : [Step 4/5] [2021-11-19 21:07:12,220][INFO ][tcp-disco-srvr-[:47501]-#735%grid-1%-#14111%grid-1%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=51697] [21:07:12] : [Step 4/5] [2021-11-19 21:07:12,221][INFO ][tcp-disco-sock-reader-[]-#737%grid-1%-#14113%grid-1%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:51697, rmtPort=51697] [21:07:12] : [Step 4/5] [2021-11-19 21:07:12,221][INFO ][tcp-disco-sock-reader-[]-#737%grid-1%-#14113%grid-1%][TestTcpDiscoverySpi] Received ping request from the remote node [rmtNodeId=004f3da2-3eac-4791-a4d2-e9628138a000, rmtAddr=/127.0.0.1:51697, rmtPort=51697] [21:07:12] : [Step 4/5] [2021-11-19 21:07:12,223][INFO ][tcp-disco-sock-reader-[]-#737%grid-1%-#14113%grid-1%][TestTcpDiscoverySpi] Finished writing ping response [rmtNodeId=004f3da2-3eac-4791-a4d2-e9628138a000, rmtAddr=/127.0.0.1:51697, rmtPort=51697] [21:07:12]W: [org.apache.ignite:ignite-core] [2021-11-19 21:07:12,223][WARN ][tcp-disco-sock-reader-[]-#737%grid-1%-#14113%grid-1%][TestTcpDiscoverySpi] Failed to shutdown socket [21:07:12]W: [org.apache.ignite:ignite-core] java.net.SocketException: Socket output is already shutdown [21:07:12]W: [org.apache.ignite:ignite-core] at java.net.Socket.shutdownOutput(Socket.java:1572) [21:07:12]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.close(IgniteUtils.java:4247) [21:07:12]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.discovery.tcp.ServerImpl$SocketReader.body(ServerImpl.java:7370) [21:07:12]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.IgniteSpiThread.run(IgniteSpiThread.java:58) [21:07:12] : [Step 4/5] [2021-11-19 21:07:12,225][INFO ][tcp-disco-sock-reader-[]-#737%grid-1%-#14113%grid-1%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:51697, rmtPort=51697, rmtNodeId=null] [21:07:12] : [Step 4/5] [2021-11-19 21:07:12,224][INFO ][tcp-disco-sock-reader-[10f8f56a 127.0.0.1:51277]-#736%grid-0%-#14112%grid-0%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:51277, rmtPort=51277, rmtNodeId=10f8f56a-7627-4fb3-b0c0-cbf65f7dc001] [21:07:12] : [Step 4/5] [2021-11-19 21:07:12,227][INFO ][tcp-disco-msg-worker-[crd]-#729%grid-0%-#13992%grid-0%][GridEncryptionManager] Joining node doesn't have stored group keys [node=10f8f56a-7627-4fb3-b0c0-cbf65f7dc001] [21:07:12] : [Step 4/5] [2021-11-19 21:07:12,236][INFO ][tcp-disco-msg-worker-[crd]-#729%grid-0%-#13992%grid-0%][TestTcpDiscoverySpi] New next node [newNext=TcpDiscoveryNode [id=10f8f56a-7627-4fb3-b0c0-cbf65f7dc001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=0, intOrder=2, lastExchangeTime=1637345232214, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false]] [21:07:12] : [Step 4/5] [2021-11-19 21:07:12,237][INFO ][tcp-disco-srvr-[:47501]-#735%grid-1%-#14111%grid-1%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=53249] [21:07:12] : [Step 4/5] [2021-11-19 21:07:12,237][INFO ][tcp-disco-srvr-[:47501]-#735%grid-1%-#14111%grid-1%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=53249] [21:07:12] : [Step 4/5] [2021-11-19 21:07:12,238][INFO ][tcp-disco-sock-reader-[]-#738%grid-1%-#14114%grid-1%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:53249, rmtPort=53249] [21:07:12] : [Step 4/5] [2021-11-19 21:07:12,239][INFO ][tcp-disco-sock-reader-[004f3da2 127.0.0.1:53249]-#738%grid-1%-#14114%grid-1%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=004f3da2-3eac-4791-a4d2-e9628138a000, rmtAddr=/127.0.0.1:53249] [21:07:12] : [Step 4/5] [2021-11-19 21:07:12,243][INFO ][tcp-disco-msg-worker-[]-#734%grid-1%-#14110%grid-1%][TestTcpDiscoverySpi] New next node [newNext=TcpDiscoveryNode [id=004f3da2-3eac-4791-a4d2-e9628138a000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345232235, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false]] [21:07:12] : [Step 4/5] [2021-11-19 21:07:12,244][INFO ][tcp-disco-srvr-[:47500]-#730%grid-0%-#13993%grid-0%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=56781] [21:07:12] : [Step 4/5] [2021-11-19 21:07:12,244][INFO ][tcp-disco-srvr-[:47500]-#730%grid-0%-#13993%grid-0%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=56781] [21:07:12] : [Step 4/5] [2021-11-19 21:07:12,245][INFO ][tcp-disco-sock-reader-[]-#739%grid-0%-#14115%grid-0%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:56781, rmtPort=56781] [21:07:12] : [Step 4/5] [2021-11-19 21:07:12,246][INFO ][tcp-disco-sock-reader-[10f8f56a 127.0.0.1:56781]-#739%grid-0%-#14115%grid-0%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=10f8f56a-7627-4fb3-b0c0-cbf65f7dc001, rmtAddr=/127.0.0.1:56781] [21:07:12] : [Step 4/5] [2021-11-19 21:07:12,248][INFO ][disco-event-worker-#13995%grid-0%][GridDiscoveryManager] Added new node to topology: TcpDiscoveryNode [id=10f8f56a-7627-4fb3-b0c0-cbf65f7dc001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637345232214, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false] [21:07:12] : [Step 4/5] [2021-11-19 21:07:12,249][INFO ][disco-event-worker-#13995%grid-0%][GridDiscoveryManager] Topology snapshot [ver=2, locNode=004f3da2, servers=2, clients=0, state=INACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=004f3da2-3eac-4791-a4d2-e9628138a000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=10f8f56a-7627-4fb3-b0c0-cbf65f7dc001, consistentId=grid-1, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:07:12] : [Step 4/5] [2021-11-19 21:07:12,252][INFO ][tcp-disco-msg-worker-[004f3da2 127.0.0.1:47500]-#734%grid-1%-#14110%grid-1%][ClusterProcessor] busy_austin [21:07:12] : [Step 4/5] [2021-11-19 21:07:12,252][INFO ][tcp-disco-msg-worker-[004f3da2 127.0.0.1:47500]-#734%grid-1%-#14110%grid-1%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustEnabled' was changed from 'null' to 'false' [21:07:12] : [Step 4/5] [2021-11-19 21:07:12,253][INFO ][tcp-disco-msg-worker-[004f3da2 127.0.0.1:47500]-#734%grid-1%-#14110%grid-1%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustTimeout' was changed from 'null' to '300000' [21:07:12] : [Step 4/5] [2021-11-19 21:07:12,253][INFO ][tcp-disco-msg-worker-[004f3da2 127.0.0.1:47500]-#734%grid-1%-#14110%grid-1%][IgniteTxManager] Transactions parameter 'longOperationsDumpTimeout' was changed from 'null' to '60000' [21:07:12] : [Step 4/5] [2021-11-19 21:07:12,253][INFO ][tcp-disco-msg-worker-[004f3da2 127.0.0.1:47500]-#734%grid-1%-#14110%grid-1%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpThreshold' was changed from 'null' to '0' [21:07:12] : [Step 4/5] [2021-11-19 21:07:12,254][INFO ][tcp-disco-msg-worker-[004f3da2 127.0.0.1:47500]-#734%grid-1%-#14110%grid-1%][IgniteTxManager] Transactions parameter 'transactionTimeDumpSamplesCoefficient' was changed from 'null' to '0.0' [21:07:12] : [Step 4/5] [2021-11-19 21:07:12,254][INFO ][tcp-disco-msg-worker-[004f3da2 127.0.0.1:47500]-#734%grid-1%-#14110%grid-1%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpSamplesPerSecondLimit' was changed from 'null' to '5' [21:07:12] : [Step 4/5] [2021-11-19 21:07:12,255][INFO ][tcp-disco-msg-worker-[004f3da2 127.0.0.1:47500]-#734%grid-1%-#14110%grid-1%][IgniteTxManager] Transactions parameter 'collisionsDumpInterval' was changed from 'null' to '1000' [21:07:12] : [Step 4/5] [2021-11-19 21:07:12,255][INFO ][tcp-disco-msg-worker-[004f3da2 127.0.0.1:47500]-#734%grid-1%-#14110%grid-1%][IgniteTxManager] Transactions parameter 'txOwnerDumpRequestsAllowed' was changed from 'null' to 'true' [21:07:12] : [Step 4/5] [2021-11-19 21:07:12,255][INFO ][tcp-disco-msg-worker-[004f3da2 127.0.0.1:47500]-#734%grid-1%-#14110%grid-1%][GridCacheDatabaseSharedManager] Historical rebalance WAL threshold changed [property=historical.rebalance.threshold, oldVal=null, newVal=500] [21:07:12] : [Step 4/5] [2021-11-19 21:07:12,256][INFO ][disco-notifier-worker-#14109%grid-1%][MvccProcessorImpl] Assigned mvcc coordinator [crd=MvccCoordinator [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=0], nodeId=004f3da2-3eac-4791-a4d2-e9628138a000, ver=1637345231085, local=false, initialized=false]] [21:07:12] : [Step 4/5] [2021-11-19 21:07:12,258][INFO ][sys-#14108%grid-1%][ClusterProcessor] Writing cluster ID and tag to metastorage on ready for write ClusterIdAndTag [id=a7269b46-6430-4ed2-8b21-f79ca0c657d2, tag=busy_austin] [21:07:12] : [Step 4/5] [2021-11-19 21:07:12,269][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][IgniteKernal%grid-1] To start Console Management & Monitoring run ignitevisorcmd.{sh|bat} [21:07:12] : [Step 4/5] [2021-11-19 21:07:12,270][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][IgniteKernal%grid-1] [21:07:12] : [Step 4/5] [21:07:12] : [Step 4/5] >>> +-------------------------------------------+ [21:07:12] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:07:12] : [Step 4/5] >>> +-------------------------------------------+ [21:07:12] : [Step 4/5] >>> OS name: Linux 4.15.0-151-generic amd64 [21:07:12] : [Step 4/5] >>> CPU(s): 24 [21:07:12] : [Step 4/5] >>> Heap: 2.0GB [21:07:12] : [Step 4/5] >>> VM name: 16724@c4dfe9a430b2 [21:07:12] : [Step 4/5] >>> Ignite instance name: grid-1 [21:07:12] : [Step 4/5] >>> Local node [ID=10F8F56A-7627-4FB3-B0C0-CBF65F7DC001, order=2, clientMode=false] [21:07:12] : [Step 4/5] >>> Local node addresses: [127.0.0.1] [21:07:12] : [Step 4/5] >>> Local ports: TCP:10801 TCP:45161 TCP:47501 [21:07:12] : [Step 4/5] [21:07:12] : [Step 4/5] [2021-11-19 21:07:12,271][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][IgniteKernal%grid-1] >>> Ignite cluster is in INACTIVE state (limited functionality available). Use control.(sh|bat) script or IgniteCluster.state(ClusterState.ACTIVE) to change the state. [21:07:12] : [Step 4/5] [2021-11-19 21:07:12,271][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][GridDiscoveryManager] Topology snapshot [ver=2, locNode=10f8f56a, servers=2, clients=0, state=INACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=004f3da2-3eac-4791-a4d2-e9628138a000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=10f8f56a-7627-4fb3-b0c0-cbf65f7dc001, consistentId=grid-1, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:07:12] : [Step 4/5] [2021-11-19 21:07:12,272][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][G] Node started : [stage="Configure system pool" (0 ms),stage="Start managers" (200 ms),stage="Configure binary metadata" (2 ms),stage="Start processors" (432 ms),stage="Start 'StanByClusterTestProvider' plugin" (0 ms),stage="Start 'PageMemory tracker plugin' plugin" (0 ms),stage="Start 'TestDistibutedConfigurationPlugin' plugin" (0 ms),stage="Start 'NodeValidationPluginProvider' plugin" (0 ms),stage="Init metastore" (22 ms),stage="Init and start regions" (6 ms),stage="Restore binary memory" (22 ms),stage="Restore logical state" (67 ms),stage="Finish recovery" (331 ms),stage="Join topology" (52 ms),stage="Await transition" (2 ms),stage="Await exchange" (13 ms),stage="Total time" (1149 ms)] [21:07:12] : [Step 4/5] [2021-11-19 21:07:12,274][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][root] Node started with the following configuration [id=10f8f56a-7627-4fb3-b0c0-cbf65f7dc001, marshaller=BinaryMarshaller [], discovery=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=5000, ackTimeout=5000, marsh=JdkMarshaller [clsFilter=org.apache.ignite.marshaller.MarshallerUtils$1@150dde70], reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], binaryCfg=null, lateAff=true] [21:07:12] : [Step 4/5] [2021-11-19 21:07:12,276][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][GridClusterStateProcessor] Sending activate cluster request with BaselineTopology BaselineTopology [id=0, branchingHash=-2475315501, branchingType='New BaselineTopology', baselineNodes=[grid-1, grid-0]] [21:07:12] : [Step 4/5] [2021-11-19 21:07:12,280][INFO ][disco-notifier-worker-#13991%grid-0%][GridClusterStateProcessor] Received activate cluster request with BaselineTopology[id=0] initiator node ID: 004f3da2-3eac-4791-a4d2-e9628138a000 [21:07:12] : [Step 4/5] [2021-11-19 21:07:12,281][INFO ][disco-notifier-worker-#13991%grid-0%][GridClusterStateProcessor] Started state transition: activate cluster [21:07:12] : [Step 4/5] [2021-11-19 21:07:12,281][INFO ][exchange-worker-#13996%grid-0%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], crd=true, evt=DISCOVERY_CUSTOM_EVT, evtNode=004f3da2-3eac-4791-a4d2-e9628138a000, customEvt=ChangeGlobalStateMessage [id=e505d593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqId=68d33fc6-7475-4ef6-bce5-4020034d40e9, initiatingNodeId=004f3da2-3eac-4791-a4d2-e9628138a000, state=ACTIVE, baselineTopology=BaselineTopology [id=0, branchingHash=-2475315501, branchingType='New BaselineTopology', baselineNodes=[grid-1, grid-0]], forceChangeBaselineTopology=false, timestamp=1637345232276, forceDeactivation=true], allowMerge=false, exchangeFreeSwitch=false] [21:07:12] : [Step 4/5] [2021-11-19 21:07:12,282][INFO ][exchange-worker-#13996%grid-0%][GridDhtPartitionsExchangeFuture] Start activation process [nodeId=004f3da2-3eac-4791-a4d2-e9628138a000, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]]. New state: ACTIVE [21:07:12] : [Step 4/5] [2021-11-19 21:07:12,282][INFO ][disco-notifier-worker-#14109%grid-1%][GridClusterStateProcessor] Received activate cluster request with BaselineTopology[id=0] initiator node ID: 004f3da2-3eac-4791-a4d2-e9628138a000 [21:07:12] : [Step 4/5] [2021-11-19 21:07:12,283][INFO ][disco-notifier-worker-#14109%grid-1%][GridClusterStateProcessor] Started state transition: activate cluster [21:07:12] : [Step 4/5] [2021-11-19 21:07:12,283][INFO ][exchange-worker-#13996%grid-0%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0 [21:07:12] : [Step 4/5] [2021-11-19 21:07:12,284][INFO ][exchange-worker-#14118%grid-1%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], crd=false, evt=DISCOVERY_CUSTOM_EVT, evtNode=004f3da2-3eac-4791-a4d2-e9628138a000, customEvt=ChangeGlobalStateMessage [id=e505d593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqId=68d33fc6-7475-4ef6-bce5-4020034d40e9, initiatingNodeId=004f3da2-3eac-4791-a4d2-e9628138a000, state=ACTIVE, baselineTopology=BaselineTopology [id=0, branchingHash=-2475315501, branchingType='New BaselineTopology', baselineNodes=[grid-1, grid-0]], forceChangeBaselineTopology=false, timestamp=1637345232276, forceDeactivation=true], allowMerge=false, exchangeFreeSwitch=false] [21:07:12] : [Step 4/5] [2021-11-19 21:07:12,285][INFO ][exchange-worker-#13996%grid-0%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000000.wal, offset=8713, ver=2] [21:07:12] : [Step 4/5] [2021-11-19 21:07:12,286][INFO ][exchange-worker-#14118%grid-1%][GridDhtPartitionsExchangeFuture] Start activation process [nodeId=10f8f56a-7627-4fb3-b0c0-cbf65f7dc001, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]]. New state: ACTIVE [21:07:12] : [Step 4/5] [2021-11-19 21:07:12,287][INFO ][exchange-worker-#13996%grid-0%][GridClusterStateProcessor] Writing BaselineTopology[id=0] [21:07:12] : [Step 4/5] [2021-11-19 21:07:12,287][INFO ][exchange-worker-#14118%grid-1%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1 [21:07:12] : [Step 4/5] [2021-11-19 21:07:12,290][INFO ][exchange-worker-#14118%grid-1%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000000.wal, offset=8713, ver=2] [21:07:12] : [Step 4/5] [2021-11-19 21:07:12,291][INFO ][exchange-worker-#14118%grid-1%][GridClusterStateProcessor] Writing BaselineTopology[id=0] [21:07:12] : [Step 4/5] [2021-11-19 21:07:12,294][INFO ][exchange-worker-#13996%grid-0%][GridCacheDatabaseSharedManager] Finish recovery performed in 10 ms. [21:07:12] : [Step 4/5] [2021-11-19 21:07:12,295][INFO ][exchange-worker-#13996%grid-0%][msg] Components activation performed in 12 ms. [21:07:12] : [Step 4/5] [2021-11-19 21:07:12,295][INFO ][exchange-worker-#13996%grid-0%][GridCacheProcessor] Finished recovery for cache [cache=ignite-sys-cache, grp=ignite-sys-cache, startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:07:12] : [Step 4/5] [2021-11-19 21:07:12,296][INFO ][exchange-worker-#13996%grid-0%][GridDhtPartitionsExchangeFuture] Successfully activated caches [nodeId=004f3da2-3eac-4791-a4d2-e9628138a000, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], newState=ACTIVE] [21:07:12] : [Step 4/5] [2021-11-19 21:07:12,297][INFO ][exchange-worker-#13996%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:07:12] : [Step 4/5] [2021-11-19 21:07:12,304][INFO ][exchange-worker-#14118%grid-1%][GridCacheDatabaseSharedManager] Finish recovery performed in 15 ms. [21:07:12] : [Step 4/5] [2021-11-19 21:07:12,304][INFO ][exchange-worker-#13996%grid-0%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], crd=true] [21:07:12] : [Step 4/5] [2021-11-19 21:07:12,305][INFO ][exchange-worker-#14118%grid-1%][msg] Components activation performed in 18 ms. [21:07:12] : [Step 4/5] [2021-11-19 21:07:12,308][INFO ][exchange-worker-#14118%grid-1%][GridCacheProcessor] Finished recovery for cache [cache=ignite-sys-cache, grp=ignite-sys-cache, startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:07:12] : [Step 4/5] [2021-11-19 21:07:12,309][INFO ][exchange-worker-#14118%grid-1%][GridDhtPartitionsExchangeFuture] Successfully activated caches [nodeId=10f8f56a-7627-4fb3-b0c0-cbf65f7dc001, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], newState=ACTIVE] [21:07:12] : [Step 4/5] [2021-11-19 21:07:12,309][INFO ][exchange-worker-#14118%grid-1%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:07:12] : [Step 4/5] [2021-11-19 21:07:12,318][INFO ][db-checkpoint-thread-#14126%grid-0%][Checkpointer] Checkpoint started [checkpointId=cfa5193a-72a9-4cef-8b94-5dc288185001, startPtr=WALPointer [idx=0, fileOff=66667, len=1963], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=1ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=12ms, writeCheckpointEntryDuration=2ms, splitAndSortCpPagesDuration=0ms, pages=16, reason='node started'] [21:07:12] : [Step 4/5] [2021-11-19 21:07:12,320][INFO ][grid-nio-worker-tcp-comm-0-#13935%TcpCommunicationSpi%][TcpCommunicationSpi] Accepted incoming communication connection [locAddr=/127.0.0.1:45160, rmtAddr=/127.0.0.1:42908] [21:07:12] : [Step 4/5] [2021-11-19 21:07:12,322][INFO ][grid-nio-worker-tcp-comm-0-#14053%TcpCommunicationSpi%][TcpCommunicationSpi] Established outgoing communication connection [locAddr=/127.0.0.1:42908, rmtAddr=/127.0.0.1:45160] [21:07:12] : [Step 4/5] [2021-11-19 21:07:12,322][INFO ][exchange-worker-#14118%grid-1%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], crd=false] [21:07:12] : [Step 4/5] [2021-11-19 21:07:12,327][INFO ][sys-#13969%grid-0%][GridDhtPartitionsExchangeFuture] Coordinator received single message [ver=AffinityTopologyVersion [topVer=2, minorTopVer=1], node=10f8f56a-7627-4fb3-b0c0-cbf65f7dc001, allReceived=true] [21:07:12] : [Step 4/5] [2021-11-19 21:07:12,328][INFO ][sys-#13969%grid-0%][GridDhtPartitionsExchangeFuture] finishExchangeOnCoordinator [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:07:12] : [Step 4/5] [2021-11-19 21:07:12,334][INFO ][sys-#13969%grid-0%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], err=null, rebalanced=true, wasRebalanced=false] [21:07:12] : [Step 4/5] [2021-11-19 21:07:12,336][INFO ][disco-notifier-worker-#14109%grid-1%][GridClusterStateProcessor] Received state change finish message: ACTIVE [21:07:12] : [Step 4/5] [2021-11-19 21:07:12,337][INFO ][disco-notifier-worker-#14109%grid-1%][GridClusterStateProcessor] Cluster state was changed from INACTIVE to ACTIVE [21:07:12] : [Step 4/5] [2021-11-19 21:07:12,335][INFO ][sys-#14100%grid-1%][GridDhtPartitionsExchangeFuture] Received full message, will finish exchange [node=004f3da2-3eac-4791-a4d2-e9628138a000, resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:07:12] : [Step 4/5] [2021-11-19 21:07:12,334][INFO ][disco-notifier-worker-#13991%grid-0%][GridClusterStateProcessor] Received state change finish message: ACTIVE [21:07:12] : [Step 4/5] [2021-11-19 21:07:12,338][INFO ][disco-notifier-worker-#13991%grid-0%][GridClusterStateProcessor] Cluster state was changed from INACTIVE to ACTIVE [21:07:12] : [Step 4/5] [2021-11-19 21:07:12,339][INFO ][sys-#13969%grid-0%][GridCacheProcessor] Finish proxy initialization, cacheName=ignite-sys-cache, localNodeId=004f3da2-3eac-4791-a4d2-e9628138a000 [21:07:12] : [Step 4/5] [2021-11-19 21:07:12,340][INFO ][sys-#14100%grid-1%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], err=null, rebalanced=true, wasRebalanced=false] [21:07:12] : [Step 4/5] [2021-11-19 21:07:12,338][INFO ][sys-#14105%grid-1%][GridCachePartitionExchangeManager] Delay process full message without exchange id (there is exchange in progress) [nodeId=004f3da2-3eac-4791-a4d2-e9628138a000] [21:07:12] : [Step 4/5] [2021-11-19 21:07:12,340][INFO ][sys-#13969%grid-0%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=004f3da2-3eac-4791-a4d2-e9628138a000, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=004f3da2-3eac-4791-a4d2-e9628138a000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345232336, loc=true, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:07:12] : [Step 4/5] [2021-11-19 21:07:12,340][INFO ][exchange-worker-#13996%grid-0%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=2, minorTopVer=1], force=false, evt=DISCOVERY_CUSTOM_EVT, node=004f3da2-3eac-4791-a4d2-e9628138a000] [21:07:12] : [Step 4/5] [2021-11-19 21:07:12,340][INFO ][sys-#13975%grid-0%][DistributedBaselineConfiguration] Baseline auto-adjust is 'disabled' with timeout='300000' ms [21:07:12] : [Step 4/5] [2021-11-19 21:07:12,343][INFO ][sys-#13969%grid-0%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (1 ms), stage="Update caches registry" (12 ms), stage="Start caches" (0 ms), stage="Affinity initialization on cache group start" (0 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Restore partition states" (0 ms), stage="After states restored callback" (6 ms), stage="WAL history reservation" (0 ms), stage="Waiting for all single messages" (23 ms), stage="Affinity recalculation (crd)" (0 ms), stage="Collect update counters and create affinity messages" (0 ms), stage="Assign partitions states" (0 ms), stage="Validate partitions states" (0 ms), stage="Ideal affinity diff calculation (enforced)" (0 ms), stage="Apply update counters" (0 ms), stage="Full message preparing" (3 ms), stage="Full message sending" (0 ms), stage="State finish message sending" (0 ms), stage="Detect lost partitions" (3 ms), stage="Exchange done" (5 ms), stage="Total time" (53 ms), Discovery lag=2 ms, Latest started node id=10f8f56a-7627-4fb3-b0c0-cbf65f7dc001] [21:07:12] : [Step 4/5] [2021-11-19 21:07:12,343][INFO ][sys-#14100%grid-1%][GridCacheProcessor] Finish proxy initialization, cacheName=ignite-sys-cache, localNodeId=10f8f56a-7627-4fb3-b0c0-cbf65f7dc001 [21:07:12] : [Step 4/5] [2021-11-19 21:07:12,341][INFO ][db-checkpoint-thread-#14132%grid-1%][Checkpointer] Checkpoint started [checkpointId=b9777d28-2590-4ed1-9e47-7e5722585155, startPtr=WALPointer [idx=0, fileOff=66667, len=1963], checkpointBeforeLockTime=1ms, checkpointLockWait=1ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=10ms, writeCheckpointEntryDuration=15ms, splitAndSortCpPagesDuration=0ms, pages=16, reason='node started'] [21:07:12] : [Step 4/5] [2021-11-19 21:07:12,348][INFO ][sys-#14100%grid-1%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=10f8f56a-7627-4fb3-b0c0-cbf65f7dc001, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=004f3da2-3eac-4791-a4d2-e9628138a000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345232235, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:07:12] : [Step 4/5] [2021-11-19 21:07:12,348][INFO ][exchange-worker-#14118%grid-1%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=2, minorTopVer=1], force=false, evt=DISCOVERY_CUSTOM_EVT, node=004f3da2-3eac-4791-a4d2-e9628138a000] [21:07:12] : [Step 4/5] [2021-11-19 21:07:12,348][INFO ][sys-#14091%grid-1%][DistributedBaselineConfiguration] Baseline auto-adjust is 'disabled' with timeout='300000' ms [21:07:12] : [Step 4/5] [2021-11-19 21:07:12,346][INFO ][sys-#13969%grid-0%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], stage="Affinity initialization on cache group start [grp=ignite-sys-cache]" (0 ms) (parent=Affinity initialization on cache group start), stage="Affinity centralized initialization (crd) [grp=ignite-sys-cache, crd=true]" (0 ms) (parent=Determine exchange type), stage="Restore partition states [grp=ignite-sys-cache]" (0 ms) (parent=Restore partition states), stage="Affinity recalculation (partitions availability) [grp=ignite-sys-cache]" (0 ms) (parent=Ideal affinity diff calculation (enforced))] [21:07:12] : [Step 4/5] [2021-11-19 21:07:12,344][INFO ][sys-#13975%grid-0%][GridClusterStateProcessor] Successfully performed final activation steps [nodeId=004f3da2-3eac-4791-a4d2-e9628138a000, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:07:12] : [Step 4/5] [2021-11-19 21:07:12,350][INFO ][sys-#14091%grid-1%][GridClusterStateProcessor] Successfully performed final activation steps [nodeId=10f8f56a-7627-4fb3-b0c0-cbf65f7dc001, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:07:12] : [Step 4/5] [2021-11-19 21:07:12,349][INFO ][sys-#14100%grid-1%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (2 ms), stage="Update caches registry" (21 ms), stage="Start caches" (1 ms), stage="Affinity initialization on cache group start" (0 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Restore partition states" (0 ms), stage="After states restored callback" (6 ms), stage="WAL history reservation" (0 ms), stage="Waiting for Full message" (18 ms), stage="Affinity recalculation" (2 ms), stage="Full map updating" (2 ms), stage="Detect lost partitions" (1 ms), stage="Exchange done" (7 ms), stage="Total time" (60 ms)] [21:07:12] : [Step 4/5] [2021-11-19 21:07:12,349][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][root] awaitPartitionMapExchange finished [21:07:12] : [Step 4/5] [2021-11-19 21:07:12,354][INFO ][sys-#14100%grid-1%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], stage="Affinity initialization on cache group start [grp=ignite-sys-cache]" (0 ms) (parent=Affinity initialization on cache group start), stage="Affinity centralized initialization (crd) [grp=ignite-sys-cache, crd=false]" (0 ms) (parent=Determine exchange type), stage="Restore partition states [grp=ignite-sys-cache]" (0 ms) (parent=Restore partition states), stage="Affinity applying from full message [grp=ignite-sys-cache]" (2 ms) (parent=Affinity recalculation)] [21:07:12] : [Step 4/5] [2021-11-19 21:07:12,378][INFO ][exchange-worker-#13996%grid-0%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], crd=true, evt=DISCOVERY_CUSTOM_EVT, evtNode=004f3da2-3eac-4791-a4d2-e9628138a000, customEvt=DynamicCacheChangeBatch [id=2805d593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqs=ArrayList [DynamicCacheChangeRequest [cacheName=encrypted, hasCfg=true, nodeId=004f3da2-3eac-4791-a4d2-e9628138a000, clientStartOnly=false, stop=false, destroy=false, disabledAfterStart=false]], exchangeActions=ExchangeActions [startCaches=[encrypted], stopCaches=null, startGrps=[encrypted], stopGrps=[], resetParts=null, stateChangeRequest=null], startCaches=false], allowMerge=false, exchangeFreeSwitch=false] [21:07:12] : [Step 4/5] [2021-11-19 21:07:12,379][INFO ][exchange-worker-#13996%grid-0%][PageMemoryImpl] Started page memory [memoryAllocated=24.0 MiB, pages=5952, tableSize=474.2 KiB, replacementSize=768 B, checkpointBuffer=10.0 MiB] [21:07:12] : [Step 4/5] [2021-11-19 21:07:12,385][INFO ][exchange-worker-#14118%grid-1%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], crd=false, evt=DISCOVERY_CUSTOM_EVT, evtNode=004f3da2-3eac-4791-a4d2-e9628138a000, customEvt=DynamicCacheChangeBatch [id=2805d593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqs=ArrayList [DynamicCacheChangeRequest [cacheName=encrypted, hasCfg=true, nodeId=004f3da2-3eac-4791-a4d2-e9628138a000, clientStartOnly=false, stop=false, destroy=false, disabledAfterStart=false]], exchangeActions=ExchangeActions [startCaches=[encrypted], stopCaches=null, startGrps=[encrypted], stopGrps=[], resetParts=null, stateChangeRequest=null], startCaches=false], allowMerge=false, exchangeFreeSwitch=false] [21:07:12] : [Step 4/5] [2021-11-19 21:07:12,388][INFO ][exchange-worker-#14118%grid-1%][PageMemoryImpl] Started page memory [memoryAllocated=24.0 MiB, pages=5952, tableSize=474.2 KiB, replacementSize=768 B, checkpointBuffer=10.0 MiB] [21:07:12] : [Step 4/5] [2021-11-19 21:07:12,443][INFO ][db-checkpoint-thread-#14126%grid-0%][Checkpointer] Checkpoint finished [cpId=cfa5193a-72a9-4cef-8b94-5dc288185001, pages=16, markPos=WALPointer [idx=0, fileOff=66667, len=1963], walSegmentsCovered=[], markDuration=16ms, pagesWrite=1ms, fsync=123ms, total=141ms] [21:07:12] : [Step 4/5] [2021-11-19 21:07:12,527][INFO ][exchange-worker-#13996%grid-0%][GridCacheProcessor] Started cache [name=encrypted, id=1613773252, dataRegionName=default, mode=PARTITIONED, atomicity=ATOMIC, backups=0, mvcc=false] [21:07:12] : [Step 4/5] [2021-11-19 21:07:12,527][INFO ][exchange-worker-#14118%grid-1%][GridCacheProcessor] Started cache [name=encrypted, id=1613773252, dataRegionName=default, mode=PARTITIONED, atomicity=ATOMIC, backups=0, mvcc=false] [21:07:12]W: [org.apache.ignite:ignite-core] [2021-11-19 21:07:12,531][WARN ][exchange-worker-#13996%grid-0%][CacheAffinitySharedManager] Cache group 'encrypted' brings high overhead for its metainformation in data region 'default'. Metainformation required for its partitions (502 partitions, 4096 bytes per partition, 1 MBs total) will consume more than 15% of data region memory (10 MBs). It may lead to critical errors on the node and cluster instability. Please reduce number of partitions, add more memory to the data region or add more server nodes for this cache group. [21:07:12]W: [org.apache.ignite:ignite-core] [2021-11-19 21:07:12,531][WARN ][exchange-worker-#14118%grid-1%][CacheAffinitySharedManager] Cache group 'encrypted' brings high overhead for its metainformation in data region 'default'. Metainformation required for its partitions (522 partitions, 4096 bytes per partition, 2 MBs total) will consume more than 15% of data region memory (10 MBs). It may lead to critical errors on the node and cluster instability. Please reduce number of partitions, add more memory to the data region or add more server nodes for this cache group. [21:07:12] : [Step 4/5] [2021-11-19 21:07:12,532][INFO ][exchange-worker-#13996%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], waitTime=0ms, futInfo=NA, mode=DISTRIBUTED] [21:07:12] : [Step 4/5] [2021-11-19 21:07:12,533][INFO ][exchange-worker-#14118%grid-1%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], waitTime=0ms, futInfo=NA, mode=DISTRIBUTED] [21:07:12] : [Step 4/5] [2021-11-19 21:07:12,534][INFO ][exchange-worker-#13996%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partitions release latch: ServerLatch [permits=0, pendingAcks=HashSet [], super=CompletableLatch [id=CompletableLatchUid [id=exchange, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2]]]] [21:07:12] : [Step 4/5] [2021-11-19 21:07:12,535][INFO ][exchange-worker-#14118%grid-1%][GridDhtPartitionsExchangeFuture] Finished waiting for partitions release latch: ClientLatch [coordinator=TcpDiscoveryNode [id=004f3da2-3eac-4791-a4d2-e9628138a000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345232235, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], ackSent=true, super=CompletableLatch [id=CompletableLatchUid [id=exchange, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2]]]] [21:07:12] : [Step 4/5] [2021-11-19 21:07:12,535][INFO ][exchange-worker-#13996%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:07:12] : [Step 4/5] [2021-11-19 21:07:12,536][INFO ][exchange-worker-#14118%grid-1%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:07:12] : [Step 4/5] [2021-11-19 21:07:12,565][INFO ][db-checkpoint-thread-#14132%grid-1%][Checkpointer] Checkpoint finished [cpId=b9777d28-2590-4ed1-9e47-7e5722585155, pages=16, markPos=WALPointer [idx=0, fileOff=66667, len=1963], walSegmentsCovered=[], markDuration=32ms, pagesWrite=1ms, fsync=216ms, total=251ms] [21:07:12] : [Step 4/5] [2021-11-19 21:07:12,575][INFO ][exchange-worker-#13996%grid-0%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], crd=true] [21:07:12] : [Step 4/5] [2021-11-19 21:07:12,578][INFO ][exchange-worker-#14118%grid-1%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], crd=false] [21:07:12] : [Step 4/5] [2021-11-19 21:07:12,579][INFO ][sys-#13978%grid-0%][GridDhtPartitionsExchangeFuture] Coordinator received single message [ver=AffinityTopologyVersion [topVer=2, minorTopVer=2], node=10f8f56a-7627-4fb3-b0c0-cbf65f7dc001, allReceived=true] [21:07:12] : [Step 4/5] [2021-11-19 21:07:12,579][INFO ][sys-#13978%grid-0%][GridDhtPartitionsExchangeFuture] finishExchangeOnCoordinator [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2]] [21:07:12] : [Step 4/5] [2021-11-19 21:07:12,586][INFO ][sys-#13978%grid-0%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], err=null, rebalanced=true, wasRebalanced=true] [21:07:12] : [Step 4/5] [2021-11-19 21:07:12,587][INFO ][sys-#14086%grid-1%][GridDhtPartitionsExchangeFuture] Received full message, will finish exchange [node=004f3da2-3eac-4791-a4d2-e9628138a000, resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2]] [21:07:12] : [Step 4/5] [2021-11-19 21:07:12,587][INFO ][sys-#13978%grid-0%][GridCacheProcessor] Finish proxy initialization, cacheName=encrypted, localNodeId=004f3da2-3eac-4791-a4d2-e9628138a000 [21:07:12] : [Step 4/5] [2021-11-19 21:07:12,588][INFO ][sys-#13978%grid-0%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=004f3da2-3eac-4791-a4d2-e9628138a000, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=004f3da2-3eac-4791-a4d2-e9628138a000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345232356, loc=true, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2]] [21:07:12] : [Step 4/5] [2021-11-19 21:07:12,590][INFO ][exchange-worker-#13996%grid-0%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=2, minorTopVer=2], force=false, evt=DISCOVERY_CUSTOM_EVT, node=004f3da2-3eac-4791-a4d2-e9628138a000] [21:07:12] : [Step 4/5] [2021-11-19 21:07:12,589][INFO ][sys-#14086%grid-1%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], err=null, rebalanced=true, wasRebalanced=true] [21:07:12] : [Step 4/5] [2021-11-19 21:07:12,590][INFO ][sys-#13978%grid-0%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (1 ms), stage="Update caches registry" (0 ms), stage="Start caches" (148 ms), stage="Affinity initialization on cache group start" (4 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (1 ms), stage="Wait partitions release latch [latch=exchange]" (1 ms), stage="Wait partitions release [latch=exchange]" (1 ms), stage="Restore partition states" (13 ms), stage="After states restored callback" (25 ms), stage="WAL history reservation" (0 ms), stage="Waiting for all single messages" (4 ms), stage="Affinity recalculation (crd)" (0 ms), stage="Collect update counters and create affinity messages" (0 ms), stage="Assign partitions states" (1 ms), stage="Validate partitions states" (0 ms), stage="Apply update counters" (0 ms), stage="Full message preparing" (3 ms), stage="Full message sending" (0 ms), stage="Exchange done" (4 ms), stage="Total time" (206 ms), Discovery lag=8 ms, Latest started node id=10f8f56a-7627-4fb3-b0c0-cbf65f7dc001] [21:07:12] : [Step 4/5] [2021-11-19 21:07:12,592][INFO ][sys-#14086%grid-1%][GridCacheProcessor] Finish proxy initialization, cacheName=encrypted, localNodeId=10f8f56a-7627-4fb3-b0c0-cbf65f7dc001 [21:07:12] : [Step 4/5] [2021-11-19 21:07:12,594][INFO ][sys-#13978%grid-0%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], stage="Affinity initialization on cache group start [grp=encrypted]" (1 ms) (parent=Affinity initialization on cache group start), stage="Restore partition states [grp=encrypted]" (13 ms) (parent=Restore partition states), stage="Restore partition states [grp=ignite-sys-cache]" (0 ms) (parent=Restore partition states)] [21:07:12] : [Step 4/5] [2021-11-19 21:07:12,595][INFO ][exchange-worker-#14118%grid-1%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=2, minorTopVer=2], force=false, evt=DISCOVERY_CUSTOM_EVT, node=004f3da2-3eac-4791-a4d2-e9628138a000] [21:07:12] : [Step 4/5] [2021-11-19 21:07:12,594][INFO ][sys-#14086%grid-1%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=10f8f56a-7627-4fb3-b0c0-cbf65f7dc001, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=004f3da2-3eac-4791-a4d2-e9628138a000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345232235, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2]] [21:07:12] : [Step 4/5] [2021-11-19 21:07:12,597][INFO ][sys-#14086%grid-1%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (1 ms), stage="Update caches registry" (0 ms), stage="Start caches" (140 ms), stage="Affinity initialization on cache group start" (4 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Wait partitions release latch [latch=exchange]" (2 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Restore partition states" (13 ms), stage="After states restored callback" (26 ms), stage="WAL history reservation" (0 ms), stage="Waiting for Full message" (9 ms), stage="Affinity recalculation" (0 ms), stage="Full map updating" (2 ms), stage="Exchange done" (7 ms), stage="Total time" (204 ms)] [21:07:12] : [Step 4/5] [2021-11-19 21:07:12,599][INFO ][sys-#14086%grid-1%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], stage="Affinity initialization on cache group start [grp=encrypted]" (1 ms) (parent=Affinity initialization on cache group start), stage="Restore partition states [grp=encrypted]" (13 ms) (parent=Restore partition states), stage="Restore partition states [grp=ignite-sys-cache]" (0 ms) (parent=Restore partition states)] [21:07:18] : [Step 4/5] [2021-11-19 21:07:18,688][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][root] >>> Stopping grid [name=grid-1, id=10f8f56a-7627-4fb3-b0c0-cbf65f7dc001] [21:07:19] : [Step 4/5] [2021-11-19 21:07:19,665][INFO ][db-checkpoint-thread-#14132%grid-1%][Checkpointer] Checkpoint started [checkpointId=baaaa8dd-9c4e-4790-b3c9-7815e6825071, startPtr=WALPointer [idx=0, fileOff=627447, len=11871], checkpointBeforeLockTime=7ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=1ms, checkpointLockHoldTime=2ms, walCpRecordFsyncDuration=16ms, writeCheckpointEntryDuration=947ms, splitAndSortCpPagesDuration=0ms, pages=452, reason='timeout'] [21:07:19] : [Step 4/5] [2021-11-19 21:07:19,673][INFO ][tcp-disco-sock-reader-[004f3da2 127.0.0.1:53249]-#738%grid-1%-#14114%grid-1%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:53249, rmtPort=53249, rmtNodeId=004f3da2-3eac-4791-a4d2-e9628138a000] [21:07:19] : [Step 4/5] [2021-11-19 21:07:19,674][INFO ][disco-event-worker-#13995%grid-0%][GridDiscoveryManager] Node left topology: TcpDiscoveryNode [id=10f8f56a-7627-4fb3-b0c0-cbf65f7dc001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637345232214, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false] [21:07:19] : [Step 4/5] [2021-11-19 21:07:19,676][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][GridCacheProcessor] Stopped cache [cacheName=ignite-sys-cache] [21:07:19] : [Step 4/5] [2021-11-19 21:07:19,677][INFO ][disco-event-worker-#13995%grid-0%][GridDiscoveryManager] Topology snapshot [ver=3, locNode=004f3da2, servers=1, clients=0, state=ACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=004f3da2-3eac-4791-a4d2-e9628138a000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:07:19] : [Step 4/5] [2021-11-19 21:07:19,678][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][GridCacheProcessor] Stopped cache [cacheName=encrypted] [21:07:19] : [Step 4/5] [2021-11-19 21:07:19,678][INFO ][disco-event-worker-#13995%grid-0%][GridDiscoveryManager] ^-- Baseline [id=0, size=2, online=1, offline=1] [21:07:19]W: [org.apache.ignite:ignite-core] [2021-11-19 21:07:19,681][WARN ][grid-nio-worker-tcp-comm-0-#14053%TcpCommunicationSpi%][TcpCommunicationSpi] Failed to shutdown socket [21:07:19]W: [org.apache.ignite:ignite-core] java.nio.channels.ClosedChannelException [21:07:19]W: [org.apache.ignite:ignite-core] at sun.nio.ch.SocketChannelImpl.shutdownOutput(SocketChannelImpl.java:795) [21:07:19]W: [org.apache.ignite:ignite-core] at sun.nio.ch.SocketAdaptor.shutdownOutput(SocketAdaptor.java:407) [21:07:19]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.close(IgniteUtils.java:4247) [21:07:19]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.closeKey(GridNioServer.java:2784) [21:07:19]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.close(GridNioServer.java:2835) [21:07:19]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.close(GridNioServer.java:2794) [21:07:19]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$DirectNioClientWorker.processRead(GridNioServer.java:1357) [21:07:19]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.processSelectedKeysOptimized(GridNioServer.java:2508) [21:07:19]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.bodyInternal(GridNioServer.java:2273) [21:07:19]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.body(GridNioServer.java:1910) [21:07:19]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:125) [21:07:19]W: [org.apache.ignite:ignite-core] at java.lang.Thread.run(Thread.java:748) [21:07:19] : [Step 4/5] [2021-11-19 21:07:19,681][INFO ][exchange-worker-#13996%grid-0%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], crd=true, evt=NODE_LEFT, evtNode=10f8f56a-7627-4fb3-b0c0-cbf65f7dc001, customEvt=null, allowMerge=false, exchangeFreeSwitch=true] [21:07:19] : [Step 4/5] [2021-11-19 21:07:19,685][INFO ][sys-#13973%grid-0%][GridAffinityAssignmentCache] Local node affinity assignment distribution is not ideal [cache=encrypted, expectedPrimary=1024.00, actualPrimary=502, expectedBackups=0.00, actualBackups=0, warningThreshold=50.00%] [21:07:19] : [Step 4/5] [2021-11-19 21:07:19,686][INFO ][exchange-worker-#13996%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:07:19] : [Step 4/5] [2021-11-19 21:07:19,688][INFO ][exchange-worker-#13996%grid-0%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], err=null, rebalanced=true, wasRebalanced=true] [21:07:19]W: [org.apache.ignite:ignite-core] [2021-11-19 21:07:19,690][WARN ][exchange-worker-#13996%grid-0%][GridDhtPartitionTopologyImpl] Detected lost partitions [grp=encrypted, parts=[0, 2, 4, 6-7, 10-11, 14, 17, 21, 24-30, 32, 37, 40, 44, 47-52, 54, 57, 59, 62-64, 67-68, 74-75, 78, 81, 87-88, 91, 97, 99, 101-102, 104-107, 113-114, 116, 118, 120, 122, 124, 135-136, 138, 140-145, 147, 149-152, 154-156, 159-160, 162-164, 169, 172, 175-177, 180, 184-187, 190-191, 194, 196-202, 204-205, 209-210, 212, 214, 216, 219-224, 226, 229-232, 237, 239, 241, 243-245, 247, 249-251, 255, 257, 261, 265, 269, 272-273, 276-277, 281-282, 285, 287, 289-291, 293-297, 299, 301-304, 306, 308-309, 311-312, 315-317, 319, 322, 325-326, 328-330, 336, 339, 341, 344-346, 350, 352-354, 357-361, 363, 366-367, 371-373, 376-380, 383, 385, 387-388, 390, 392, 395-397, 400, 402, 405, 408-411, 416, 420, 422, 424-425, 429, 433, 435-438, 440-441, 445-446, 450, 452-453, 455-456, 458, 460, 462-463, 465-468, 470, 474-475, 480, 488, 490-492, 495, 497, 499-512, 516, 525, 527-531, 535, 537-538, 541-542, 545-546, 548-552, 554-555, 558, 562-564, 567-569, 572, 574, 579-580, 582-585, 587, 590-591, 594, 596, 600, 602, 604, 607-614, 617-620, 623-624, 627-629, 632-633, 636, 638, 640-642, 645-646, 648-649, 657-662, 664-665, 668-672, 677-678, 682-684, 686, 689, 692-693, 695-697, 699, 706-707, 709-710, 712-714, 716-717, 719-721, 723-728, 730-732, 734-735, 739, 742, 746, 749-750, 752, 754, 756, 762, 768-770, 772-775, 778, 780, 783-787, 789-791, 793, 796, 798-801, 803, 806, 809-812, 814, 816-817, 819, 822-825, 827-829, 832-833, 836-837, 839-840, 846, 848-851, 853-854, 857-858, 860, 863-864, 866, 868-871, 873-875, 877-878, 884, 888-889, 896-897, 900, 905-907, 914-915, 917, 919-920, 923-925, 931-933, 936, 940, 942, 944-945, 948, 950-951, 954, 956-958, 962, 965-970, 972, 975-976, 978-980, 983, 985, 988, 990, 993-994, 997-998, 1000, 1003-1004, 1007, 1009, 1014, 1016, 1018-1019], topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0]] [21:07:19] : [Step 4/5] [2021-11-19 21:07:19,695][INFO ][exchange-worker-#13996%grid-0%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=004f3da2-3eac-4791-a4d2-e9628138a000, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], evt=NODE_LEFT, evtNode=TcpDiscoveryNode [id=10f8f56a-7627-4fb3-b0c0-cbf65f7dc001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637345232214, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0]] [21:07:19] : [Step 4/5] [2021-11-19 21:07:19,696][INFO ][exchange-worker-#13996%grid-0%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (4 ms), stage="Determine exchange type" (1 ms), stage="Preloading notification" (0 ms), stage="After states restored callback" (0 ms), stage="WAL history reservation" (0 ms), stage="Finalize update counters" (0 ms), stage="Detect lost partitions" (5 ms), stage="Exchange done" (3 ms), stage="Total time" (13 ms)] [21:07:19] : [Step 4/5] [2021-11-19 21:07:19,697][INFO ][exchange-worker-#13996%grid-0%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], stage="Affinity initialization (exchange-free switch on fully-rebalanced topology) [grp=encrypted]" (1 ms) (parent=Determine exchange type), stage="Affinity initialization (exchange-free switch on fully-rebalanced topology) [grp=ignite-sys-cache]" (0 ms) (parent=Determine exchange type)] [21:07:19] : [Step 4/5] [2021-11-19 21:07:19,698][INFO ][exchange-worker-#13996%grid-0%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], crd=true] [21:07:19] : [Step 4/5] [2021-11-19 21:07:19,699][INFO ][exchange-worker-#13996%grid-0%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=3, minorTopVer=0], force=false, evt=NODE_LEFT, node=10f8f56a-7627-4fb3-b0c0-cbf65f7dc001] [21:07:21] : [Step 4/5] [2021-11-19 21:07:21,274][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][FilePageStoreManager] Cleanup cache stores [total=4, left=0, cleanFiles=false] [21:07:21] : [Step 4/5] [2021-11-19 21:07:21,276][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][GridDeploymentLocalStore] Removed undeployed class: GridDeployment [ts=1637345232325, depMode=SHARED, clsLdr=IsolatedClassLoader{roleName='test'}, clsLdrId=c605d593d71-10f8f56a-7627-4fb3-b0c0-cbf65f7dc001, userVer=0, loc=true, sampleClsName=org.apache.ignite.internal.processors.cache.distributed.dht.preloader.IgniteDhtPartitionCountersMap2, pendingUndeploy=false, undeployed=true, usage=0] [21:07:21] : [Step 4/5] [2021-11-19 21:07:21,284][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][IgniteKernal%grid-1] [21:07:21] : [Step 4/5] [21:07:21] : [Step 4/5] >>> +------------------------------------------------------+ [21:07:21] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV stopped OK [21:07:21] : [Step 4/5] >>> +------------------------------------------------------+ [21:07:21] : [Step 4/5] >>> Ignite instance name: grid-1 [21:07:21] : [Step 4/5] >>> Grid uptime: 00:00:09.016 [21:07:21] : [Step 4/5] [21:07:21] : [Step 4/5] [21:07:21] : [Step 4/5] [2021-11-19 21:07:21,285][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][root] >>> Stopping grid [name=grid-0, id=004f3da2-3eac-4791-a4d2-e9628138a000] [21:07:21] : [Step 4/5] [2021-11-19 21:07:21,320][INFO ][db-checkpoint-thread-#14126%grid-0%][Checkpointer] Checkpoint started [checkpointId=6e63c462-c447-42dc-82c8-5a15cad6e7d0, startPtr=WALPointer [idx=0, fileOff=742894, len=11491], checkpointBeforeLockTime=5ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=1ms, checkpointLockHoldTime=5ms, walCpRecordFsyncDuration=9ms, writeCheckpointEntryDuration=10ms, splitAndSortCpPagesDuration=1ms, pages=572, reason='timeout'] [21:07:21]W: [org.apache.ignite:ignite-core] [2021-11-19 21:07:21,324][WARN ][tcp-disco-sock-reader-[10f8f56a 127.0.0.1:56781]-#739%grid-0%-#14115%grid-0%][TestTcpDiscoverySpi] Failed to shutdown socket [21:07:21]W: [org.apache.ignite:ignite-core] java.net.SocketException: Socket is closed [21:07:21]W: [org.apache.ignite:ignite-core] at java.net.Socket.shutdownOutput(Socket.java:1568) [21:07:21]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.close(IgniteUtils.java:4247) [21:07:21]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.discovery.tcp.ServerImpl$SocketReader.body(ServerImpl.java:7370) [21:07:21]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.IgniteSpiThread.run(IgniteSpiThread.java:58) [21:07:21] : [Step 4/5] [2021-11-19 21:07:21,325][INFO ][tcp-disco-sock-reader-[10f8f56a 127.0.0.1:56781]-#739%grid-0%-#14115%grid-0%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:56781, rmtPort=56781, rmtNodeId=10f8f56a-7627-4fb3-b0c0-cbf65f7dc001] [21:07:21] : [Step 4/5] [2021-11-19 21:07:21,327][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][GridCacheProcessor] Stopped cache [cacheName=ignite-sys-cache] [21:07:21] : [Step 4/5] [2021-11-19 21:07:21,328][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][GridCacheProcessor] Stopped cache [cacheName=encrypted] [21:07:21] : [Step 4/5] [2021-11-19 21:07:21,838][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][FilePageStoreManager] Cleanup cache stores [total=4, left=0, cleanFiles=false] [21:07:21] : [Step 4/5] [2021-11-19 21:07:21,840][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][GridDeploymentLocalStore] Removed undeployed class: GridDeployment [ts=1637345232315, depMode=SHARED, clsLdr=IsolatedClassLoader{roleName='test'}, clsLdrId=a605d593d71-004f3da2-3eac-4791-a4d2-e9628138a000, userVer=0, loc=true, sampleClsName=org.apache.ignite.internal.processors.cache.distributed.dht.preloader.GridDhtPartitionMap, pendingUndeploy=false, undeployed=true, usage=0] [21:07:21] : [Step 4/5] [2021-11-19 21:07:21,848][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][IgniteKernal%grid-0] [21:07:21] : [Step 4/5] [21:07:21] : [Step 4/5] >>> +------------------------------------------------------+ [21:07:21] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV stopped OK [21:07:21] : [Step 4/5] >>> +------------------------------------------------------+ [21:07:21] : [Step 4/5] >>> Ignite instance name: grid-0 [21:07:21] : [Step 4/5] >>> Grid uptime: 00:00:10.741 [21:07:21] : [Step 4/5] [21:07:21] : [Step 4/5] [21:07:21]W: [org.apache.ignite:ignite-core] [2021-11-19 21:07:21,855][WARN ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][G] Ignite work directory is not provided, automatically resolved to: /opt/buildagent/work/7bc1c54bc719b67c/work [21:07:21] : [Step 4/5] [2021-11-19 21:07:21,857][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][IgniteKernal%grid-0] [21:07:21] : [Step 4/5] [21:07:21] : [Step 4/5] >>> __________ ________________ [21:07:21] : [Step 4/5] >>> / _/ ___/ |/ / _/_ __/ __/ [21:07:21] : [Step 4/5] >>> _/ // (7 7 // / / / / _/ [21:07:21] : [Step 4/5] >>> /___/\___/_/|_/___/ /_/ /___/ [21:07:21] : [Step 4/5] >>> [21:07:21] : [Step 4/5] >>> ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:07:21] : [Step 4/5] >>> 2021 Copyright(C) Apache Software Foundation [21:07:21] : [Step 4/5] >>> [21:07:21] : [Step 4/5] >>> Ignite documentation: http://ignite.apache.org [21:07:21] : [Step 4/5] [21:07:21] : [Step 4/5] [2021-11-19 21:07:21,858][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][IgniteKernal%grid-0] Config URL: n/a [21:07:21] : [Step 4/5] [2021-11-19 21:07:21,858][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][IgniteKernal%grid-0] IgniteConfiguration [igniteInstanceName=grid-0, pubPoolSize=24, svcPoolSize=24, callbackPoolSize=24, stripedPoolSize=24, sysPoolSize=24, mgmtPoolSize=4, dataStreamerPoolSize=24, utilityCachePoolSize=24, utilityCacheKeepAliveTime=60000, p2pPoolSize=2, qryPoolSize=24, buildIdxPoolSize=4, igniteHome=/opt/buildagent/work/7bc1c54bc719b67c, igniteWorkDir=/opt/buildagent/work/7bc1c54bc719b67c/work, mbeanSrv=com.sun.jmx.mbeanserver.JmxMBeanServer@6fe85038, nodeId=006acc63-081a-4937-b3e0-8ce98c28b000, marsh=BinaryMarshaller [], marshLocJobs=false, daemon=false, p2pEnabled=true, netTimeout=10000, netCompressionLevel=1, sndRetryDelay=1000, sndRetryCnt=3, metricsHistSize=10000, metricsUpdateFreq=1000, metricsExpTime=9223372036854775807, discoSpi=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=0, ackTimeout=0, marsh=null, reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], segPlc=STOP, segResolveAttempts=2, waitForSegOnStart=true, allResolversPassReq=true, segChkFreq=10000, commSpi=TcpCommunicationSpi [connectGate=org.apache.ignite.spi.communication.tcp.internal.ConnectGateway@412b97e7, ctxInitLatch=java.util.concurrent.CountDownLatch@5532110[Count = 1], stopping=false, clientPool=null, nioSrvWrapper=null, stateProvider=null], evtSpi=MemoryEventStorageSpi [expireAgeMs=9223372036854775807, expireCnt=10000, filter=null], colSpi=NoopCollisionSpi [], deploySpi=LocalDeploymentSpi [], indexingSpi=org.apache.ignite.spi.indexing.noop.NoopIndexingSpi@2de6be8f, addrRslvr=null, encryptionSpi=org.apache.ignite.spi.encryption.keystore.KeystoreEncryptionSpi@3093916d, tracingSpi=org.apache.ignite.spi.tracing.NoopTracingSpi@5f321dfc, clientMode=false, rebalanceThreadPoolSize=4, rebalanceTimeout=10000, rebalanceBatchesPrefetchCnt=3, rebalanceThrottle=0, rebalanceBatchSize=524288, txCfg=TransactionConfiguration [txSerEnabled=false, dfltIsolation=REPEATABLE_READ, dfltConcurrency=PESSIMISTIC, dfltTxTimeout=0, txTimeoutOnPartitionMapExchange=0, deadlockTimeout=10000, pessimisticTxLogSize=0, pessimisticTxLogLinger=10000, tmLookupClsName=null, txManagerFactory=null, useJtaSync=false], cacheSanityCheckEnabled=true, discoStartupDelay=60000, deployMode=SHARED, p2pMissedCacheSize=100, locHost=127.0.0.1, timeSrvPortBase=31100, timeSrvPortRange=100, failureDetectionTimeout=10000, sysWorkerBlockedTimeout=null, clientFailureDetectionTimeout=10000, metricsLogFreq=0, connectorCfg=null, odbcCfg=null, warmupClos=null, atomicCfg=AtomicConfiguration [seqReserveSize=1000, cacheMode=PARTITIONED, backups=1, aff=null, grpName=null], classLdr=null, sslCtxFactory=null, platformCfg=null, binaryCfg=null, memCfg=null, pstCfg=null, dsCfg=DataStorageConfiguration [sysRegionInitSize=41943040, sysRegionMaxSize=104857600, pageSize=4096, concLvl=0, dfltDataRegConf=DataRegionConfiguration [name=default, maxSize=10485760, initSize=268435456, swapPath=null, pageEvictionMode=DISABLED, pageReplacementMode=CLOCK, evictionThreshold=0.9, emptyPagesPoolSize=100, metricsEnabled=false, metricsSubIntervalCount=5, metricsRateTimeInterval=60000, persistenceEnabled=true, checkpointPageBufSize=0, lazyMemoryAllocation=true, warmUpCfg=null], dataRegions=null, storagePath=null, checkpointFreq=180000, lockWaitTime=10000, checkpointThreads=4, checkpointWriteOrder=SEQUENTIAL, walHistSize=20, maxWalArchiveSize=1073741824, walSegments=10, walSegmentSize=67108864, walPath=db/wal, walArchivePath=db/wal/archive, cdcWalPath=db/wal/cdc, cdcEnabled=false, metricsEnabled=false, walMode=FSYNC, walTlbSize=131072, walBuffSize=0, walFlushFreq=2000, walFsyncDelay=1000, walRecordIterBuffSize=67108864, alwaysWriteFullPages=false, fileIOFactory=org.apache.ignite.internal.processors.cache.persistence.file.AsyncFileIOFactory@356a2880, metricsSubIntervalCnt=5, metricsRateTimeInterval=60000, walAutoArchiveAfterInactivity=-1, walForceArchiveTimeout=-1, writeThrottlingEnabled=false, walCompactionEnabled=false, walCompactionLevel=1, checkpointReadLockTimeout=null, walPageCompression=DISABLED, walPageCompressionLevel=null, dfltWarmUpCfg=null, encCfg=org.apache.ignite.configuration.EncryptionConfiguration@f0aa5b3, defragmentationThreadPoolSize=4, minWalArchiveSize=-1], snapshotPath=snapshots, activeOnStart=true, activeOnStartPropSetFlag=false, autoActivation=true, autoActivationPropSetFlag=false, clusterStateOnStart=null, sqlConnCfg=null, cliConnCfg=ClientConnectorConfiguration [host=null, port=10800, portRange=100, sockSndBufSize=0, sockRcvBufSize=0, tcpNoDelay=true, maxOpenCursorsPerConn=128, threadPoolSize=24, selectorCnt=12, idleTimeout=0, handshakeTimeout=10000, jdbcEnabled=true, odbcEnabled=true, thinCliEnabled=true, sslEnabled=false, useIgniteSslCtxFactory=true, sslClientAuth=false, sslCtxFactory=null, thinCliCfg=ThinClientConfiguration [maxActiveTxPerConn=100, maxActiveComputeTasksPerConn=0]], mvccVacuumThreadCnt=2, mvccVacuumFreq=5000, authEnabled=false, failureHnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]], commFailureRslvr=null, sqlCfg=SqlConfiguration [longQryWarnTimeout=3000, dfltQryTimeout=0, sqlQryHistSize=1000, validationEnabled=false], asyncContinuationExecutor=null] [21:07:21] : [Step 4/5] [2021-11-19 21:07:21,866][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][IgniteKernal%grid-0] Daemon mode: off [21:07:21] : [Step 4/5] [2021-11-19 21:07:21,866][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][IgniteKernal%grid-0] OS: Linux 4.15.0-151-generic amd64 [21:07:21] : [Step 4/5] [2021-11-19 21:07:21,866][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][IgniteKernal%grid-0] OS user: teamcity [21:07:21] : [Step 4/5] [2021-11-19 21:07:21,867][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][IgniteKernal%grid-0] PID: 16724 [21:07:21] : [Step 4/5] [2021-11-19 21:07:21,867][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][IgniteKernal%grid-0] Language runtime: Java Platform API Specification ver. 1.8 [21:07:21] : [Step 4/5] [2021-11-19 21:07:21,867][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][IgniteKernal%grid-0] VM information: Java(TM) SE Runtime Environment 1.8.0_261-b12 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 25.261-b12 [21:07:21] : [Step 4/5] [2021-11-19 21:07:21,868][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][IgniteKernal%grid-0] VM total memory: 1.8GB [21:07:21] : [Step 4/5] [2021-11-19 21:07:21,868][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][IgniteKernal%grid-0] Remote Management [restart: off, REST: off, JMX (remote: off)] [21:07:21] : [Step 4/5] [2021-11-19 21:07:21,868][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][IgniteKernal%grid-0] Logger: GridTestLog4jLogger [quiet=false, config=null] [21:07:21] : [Step 4/5] [2021-11-19 21:07:21,869][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][IgniteKernal%grid-0] IGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c [21:07:21] : [Step 4/5] [2021-11-19 21:07:21,869][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][IgniteKernal%grid-0] VM arguments: [-DIGNITE_DUMP_THREADS_ON_FAILURE=false, -DMono=/usr/bin/mono-sgen, -DMono4.0_x64=/usr/lib/mono/4.0, -DMono4.5_x64=/usr/lib/mono/4.5, -DMonoVersion=6.12.0.90, -DSKIP_BUILD=false, -Dagent.home.dir=/opt/buildagent, -Dagent.name=aitc-lin02_03, -Dagent.ownPort=9090, -Dagent.work.dir=/opt/buildagent/work, -Dbuild.number=95, -Dbuild.vcs.number=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.1=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.GitHubApacheIgnite=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dclassworlds.conf=/opt/buildagent/temp/buildTmp/teamcity.m2.conf, -Dcom.jetbrains.maven.watcher.report.file=/opt/buildagent/temp/buildTmp/maven-build-info.xml, -Djava.io.tmpdir=/opt/buildagent/temp/buildTmp, -Dmaven.home=/opt/buildagent/tools/maven3_6, -Dmaven.multiModuleProjectDirectory=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.agent.cpuBenchmark=457, -Dteamcity.agent.dotnet.agent_url=http://localhost:9090/RPC2, -Dteamcity.agent.dotnet.build_id=6278078, -Dteamcity.auth.password=*******, -Dteamcity.auth.userId=TeamCityBuildId=6278078, -Dteamcity.build.changedFiles.file=/opt/buildagent/temp/buildTmp/changedFiles6342607772318147725.txt, -Dteamcity.build.checkoutDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.build.id=6278078, -Dteamcity.build.properties.file=/opt/buildagent/temp/buildTmp/teamcity.build5164517880467851002.properties, -Dteamcity.build.tempDir=/opt/buildagent/temp/buildTmp, -Dteamcity.build.workingDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.buildConfName=Basic 3, -Dteamcity.buildType.id=IgniteTests24Java8_Basic3, -Dteamcity.configuration.properties.file=/opt/buildagent/temp/buildTmp/teamcity.config5591980786735343870.properties, -Dteamcity.maven.userSettings.path=/opt/buildagent/temp/buildTmp/maven_settings_585072866407032347.xml, -Dteamcity.maven.watcher.home=/opt/buildagent/plugins/mavenPlugin/maven-watcher-jdk16, -Dteamcity.projectName=Ignite Tests 2.x (JDK 8/11), -Dteamcity.runner.properties.file=/opt/buildagent/temp/buildTmp/teamcity.runner9098465561618137420.properties, -Dteamcity.tests.recentlyFailedTests.file=/opt/buildagent/temp/buildTmp/testsToRunFirst3891775683130404069.txt, -Dteamcity.version=2021.2 (build 99542), -ea, -Xms2g, -Xmx2g, -XX:+HeapDumpOnOutOfMemoryError, -DIGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_TEST_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_UPDATE_NOTIFIER=false, -DIGNITE_NO_DISCO_ORDER=true, -DIGNITE_PERFORMANCE_SUGGESTIONS_DISABLED=true, -Djava.net.preferIPv4Stack=true, -DTEST_SCALE_FACTOR=1.0, -DIGNITE_TEST_PROP_LOG4J_FILE=log4j-tc-test.xml, -DIGNITE_QUIET=false, -DIGNITE_MARSHAL_BUFFERS_RECHECK=1000, -Dmaven.repo.local=/opt/buildagent/.m2/repository] [21:07:21] : [Step 4/5] [2021-11-19 21:07:21,874][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][IgniteKernal%grid-0] System cache's DataRegion size is configured to 40 MB. Use DataStorageConfiguration.systemRegionInitialSize property to change the setting. [21:07:21] : [Step 4/5] [2021-11-19 21:07:21,874][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][IgniteKernal%grid-0] Configured caches [in 'sysMemPlc' dataRegion: ['ignite-sys-cache']] [21:07:21]W: [org.apache.ignite:ignite-core] [2021-11-19 21:07:21,875][WARN ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][IgniteKernal%grid-0] Peer class loading is enabled (disable it in production for performance and deployment consistency reasons) [21:07:21] : [Step 4/5] [2021-11-19 21:07:21,875][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][IgniteKernal%grid-0] 3-rd party licenses can be found at: /opt/buildagent/work/7bc1c54bc719b67c/libs/licenses [21:07:21] : [Step 4/5] [2021-11-19 21:07:21,880][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][IgnitePluginProcessor] Configured plugins: [21:07:21] : [Step 4/5] [2021-11-19 21:07:21,880][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][IgnitePluginProcessor] ^-- StanByClusterTestProvider 1.0 [21:07:21] : [Step 4/5] [2021-11-19 21:07:21,881][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][IgnitePluginProcessor] ^-- null [21:07:21] : [Step 4/5] [2021-11-19 21:07:21,881][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][IgnitePluginProcessor] [21:07:21] : [Step 4/5] [2021-11-19 21:07:21,881][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][IgnitePluginProcessor] ^-- PageMemory tracker plugin 1.0 [21:07:21] : [Step 4/5] [2021-11-19 21:07:21,882][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][IgnitePluginProcessor] ^-- null [21:07:21] : [Step 4/5] [2021-11-19 21:07:21,882][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][IgnitePluginProcessor] [21:07:21] : [Step 4/5] [2021-11-19 21:07:21,882][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][IgnitePluginProcessor] ^-- TestDistibutedConfigurationPlugin 1.0 [21:07:21] : [Step 4/5] [2021-11-19 21:07:21,883][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][IgnitePluginProcessor] ^-- null [21:07:21] : [Step 4/5] [2021-11-19 21:07:21,883][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][IgnitePluginProcessor] [21:07:21] : [Step 4/5] [2021-11-19 21:07:21,883][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][IgnitePluginProcessor] ^-- NodeValidationPluginProvider 1.0 [21:07:21] : [Step 4/5] [2021-11-19 21:07:21,884][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][IgnitePluginProcessor] ^-- null [21:07:21] : [Step 4/5] [2021-11-19 21:07:21,884][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][IgnitePluginProcessor] [21:07:21] : [Step 4/5] [2021-11-19 21:07:21,884][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][FailureProcessor] Configured failure handler: [hnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]]] [21:07:21] : [Step 4/5] [2021-11-19 21:07:21,912][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][TcpCommunicationSpi] Successfully bound communication NIO server to TCP port [port=45160, locHost=/127.0.0.1, selectorsCnt=12, selectorSpins=0, pairedConn=false] [21:07:21]W: [org.apache.ignite:ignite-core] [2021-11-19 21:07:21,912][WARN ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][TcpCommunicationSpi] Message queue limit is set to 0 which may lead to potential OOMEs when running cache operations in FULL_ASYNC or PRIMARY_SYNC modes due to message queues growth on sender and receiver sides. [21:07:21] : [Step 4/5] [2021-11-19 21:07:21,916][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][GridCollisionManager] Collision resolution is disabled (all jobs will be activated upon arrival). [21:07:21] : [Step 4/5] [2021-11-19 21:07:21,916][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][IgniteKernal%grid-0] Security status [authentication=off, sandbox=off, tls/ssl=off] [21:07:21] : [Step 4/5] [2021-11-19 21:07:21,975][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:07:22] : [Step 4/5] [2021-11-19 21:07:22,059][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][MaintenanceProcessor] Resolved store directory for node persistent data: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0 [21:07:22] : [Step 4/5] [2021-11-19 21:07:22,061][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][CacheObjectBinaryProcessorImpl] Resolved directory for serialized binary metadata: /opt/buildagent/work/7bc1c54bc719b67c/work/db/binary_meta/grid_0 [21:07:22] : [Step 4/5] [2021-11-19 21:07:22,068][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0 [21:07:22] : [Step 4/5] [2021-11-19 21:07:22,068][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][FileWriteAheadLogManager] Resolved write ahead log work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0 [21:07:22] : [Step 4/5] [2021-11-19 21:07:22,069][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][FileWriteAheadLogManager] Resolved write ahead log archive directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0 [21:07:22] : [Step 4/5] [2021-11-19 21:07:22,071][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000005.wal [21:07:22] : [Step 4/5] [2021-11-19 21:07:22,072][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000006.wal [21:07:22] : [Step 4/5] [2021-11-19 21:07:22,072][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000008.wal [21:07:22] : [Step 4/5] [2021-11-19 21:07:22,073][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000004.wal [21:07:22] : [Step 4/5] [2021-11-19 21:07:22,073][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000003.wal [21:07:22] : [Step 4/5] [2021-11-19 21:07:22,073][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000002.wal [21:07:22] : [Step 4/5] [2021-11-19 21:07:22,074][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000007.wal [21:07:22] : [Step 4/5] [2021-11-19 21:07:22,075][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000001.wal [21:07:22] : [Step 4/5] [2021-11-19 21:07:22,075][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000009.wal [21:07:22] : [Step 4/5] [2021-11-19 21:07:22,081][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][GridCacheDatabaseSharedManager] Configured data regions initialized successfully [total=5] [21:07:22] : [Step 4/5] [2021-11-19 21:07:22,088][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][IgniteSnapshotManager] Resolved snapshot work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/snapshots [21:07:22] : [Step 4/5] [2021-11-19 21:07:22,088][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][IgniteSnapshotManager] Resolved temp directory for snapshot creation: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0/snp [21:07:22] : [Step 4/5] [2021-11-19 21:07:22,091][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][ClientListenerProcessor] Client connector processor has started on TCP port 10800 [21:07:22] : [Step 4/5] [2021-11-19 21:07:22,100][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][IgniteKernal%grid-0] Non-loopback local IPs: 172.17.0.4 [21:07:22] : [Step 4/5] [2021-11-19 21:07:22,101][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][IgniteKernal%grid-0] Enabled local MACs: 0242AC110004 [21:07:22] : [Step 4/5] [2021-11-19 21:07:22,104][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=/opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0/cp/1637345241290-6e63c462-c447-42dc-82c8-5a15cad6e7d0-START.bin, endMarker=/opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0/cp/1637345232302-cfa5193a-72a9-4cef-8b94-5dc288185001-END.bin] [21:07:22] : [Step 4/5] [2021-11-19 21:07:22,106][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:07:22] : [Step 4/5] [2021-11-19 21:07:22,106][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=66667, len=1963], lastMarked=WALPointer [idx=0, fileOff=742894, len=11491], lastCheckpointId=6e63c462-c447-42dc-82c8-5a15cad6e7d0] [21:07:22] : [Step 4/5] [2021-11-19 21:07:22,238][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][GridCacheDatabaseSharedManager] Found last checkpoint marker [cpId=6e63c462-c447-42dc-82c8-5a15cad6e7d0, pos=WALPointer [idx=0, fileOff=742894, len=11491]] [21:07:22] : [Step 4/5] [2021-11-19 21:07:22,245][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][GridCacheDatabaseSharedManager] Applying lost metastore updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=742894, len=11491], lastCheckpointId=6e63c462-c447-42dc-82c8-5a15cad6e7d0] [21:07:22] : [Step 4/5] [2021-11-19 21:07:22,304][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=60 ms] [21:07:22] : [Step 4/5] [2021-11-19 21:07:22,304][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][GridCacheProcessor] Restoring partition state for local groups. [21:07:22] : [Step 4/5] [2021-11-19 21:07:22,304][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=0, partitionsProcessed=0, time=0ms] [21:07:22] : [Step 4/5] [2021-11-19 21:07:22,431][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][GridClusterStateProcessor] Restoring history for BaselineTopology[id=0] [21:07:22] : [Step 4/5] [2021-11-19 21:07:22,442][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][ClusterProcessor] Cluster ID and tag has been read from metastorage: ClusterIdAndTag [id=a7269b46-6430-4ed2-8b21-f79ca0c657d2, tag=busy_austin] [21:07:22] : [Step 4/5] [2021-11-19 21:07:22,443][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][IgniteClusterImpl] Shutdown policy was updated [oldVal=null, newVal=null] [21:07:22] : [Step 4/5] [2021-11-19 21:07:22,443][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustEnabled' was changed from 'null' to 'false' [21:07:22] : [Step 4/5] [2021-11-19 21:07:22,444][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustTimeout' was changed from 'null' to '300000' [21:07:22] : [Step 4/5] [2021-11-19 21:07:22,444][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][IgniteTxManager] Transactions parameter 'txOwnerDumpRequestsAllowed' was changed from 'null' to 'true' [21:07:22] : [Step 4/5] [2021-11-19 21:07:22,445][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][IgniteTxManager] Transactions parameter 'longOperationsDumpTimeout' was changed from 'null' to '60000' [21:07:22] : [Step 4/5] [2021-11-19 21:07:22,445][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpThreshold' was changed from 'null' to '0' [21:07:22] : [Step 4/5] [2021-11-19 21:07:22,446][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][IgniteTxManager] Transactions parameter 'transactionTimeDumpSamplesCoefficient' was changed from 'null' to '0.0' [21:07:22] : [Step 4/5] [2021-11-19 21:07:22,447][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpSamplesPerSecondLimit' was changed from 'null' to '5' [21:07:22] : [Step 4/5] [2021-11-19 21:07:22,447][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][IgniteTxManager] Transactions parameter 'collisionsDumpInterval' was changed from 'null' to '1000' [21:07:22] : [Step 4/5] [2021-11-19 21:07:22,447][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][GridCacheDatabaseSharedManager] Historical rebalance WAL threshold changed [property=historical.rebalance.threshold, oldVal=null, newVal=500] [21:07:22] : [Step 4/5] [2021-11-19 21:07:22,448][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][GridCacheDatabaseSharedManager] Checkpoint frequency deviation changed [oldVal=null, newVal=null] [21:07:22] : [Step 4/5] [2021-11-19 21:07:22,449][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][FilePageStoreManager] Cleanup cache stores [total=1, left=0, cleanFiles=false] [21:07:22] : [Step 4/5] [2021-11-19 21:07:22,451][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:07:22] : [Step 4/5] [2021-11-19 21:07:22,452][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:07:22] : [Step 4/5] [2021-11-19 21:07:22,454][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:07:22] : [Step 4/5] [2021-11-19 21:07:22,454][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][GridCacheDatabaseSharedManager] Data Regions Started: 5 [21:07:22] : [Step 4/5] [2021-11-19 21:07:22,455][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][GridCacheDatabaseSharedManager] ^-- sysMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:07:22] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:07:22] : [Step 4/5] ^-- default region [type=default, persistence=true, lazyAlloc=true, [21:07:22] : [Step 4/5] ... initCfg=10MB, maxCfg=10MB, usedRam=0MB, freeRam=100%, allocRam=0MB, allocTotal=0MB] [21:07:22] : [Step 4/5] ^-- metastoreMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:07:22] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:07:22] : [Step 4/5] ^-- TxLog region [type=internal, persistence=true, lazyAlloc=false, [21:07:22] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:07:22] : [Step 4/5] ^-- volatileDsMemPlc region [type=user, persistence=false, lazyAlloc=true, [21:07:22] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB] [21:07:22] : [Step 4/5] ^-- Ignite persistence [used=0MB] [21:07:22] : [Step 4/5] [21:07:22] : [Step 4/5] [2021-11-19 21:07:22,456][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][GridCacheDatabaseSharedManager] Starting binary memory restore for: [-2100569601, 1613773252] [21:07:22] : [Step 4/5] [2021-11-19 21:07:22,530][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=/opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0/cp/1637345241290-6e63c462-c447-42dc-82c8-5a15cad6e7d0-START.bin, endMarker=/opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0/cp/1637345232302-cfa5193a-72a9-4cef-8b94-5dc288185001-END.bin] [21:07:22] : [Step 4/5] [2021-11-19 21:07:22,531][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=66667, len=1963], lastMarked=WALPointer [idx=0, fileOff=742894, len=11491], lastCheckpointId=6e63c462-c447-42dc-82c8-5a15cad6e7d0] [21:07:22]W: [org.apache.ignite:ignite-core] [2021-11-19 21:07:22,590][WARN ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][GridCacheDatabaseSharedManager] Ignite node stopped in the middle of checkpoint. Will restore memory state and finish checkpoint on node start. [21:07:22] : [Step 4/5] [2021-11-19 21:07:22,591][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][PageMemoryImpl] Started page memory [memoryAllocated=24.0 MiB, pages=5952, tableSize=474.2 KiB, replacementSize=768 B, checkpointBuffer=10.0 MiB] [21:07:22] : [Step 4/5] [2021-11-19 21:07:22,678][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][GridCacheDatabaseSharedManager] Found last checkpoint marker [cpId=6e63c462-c447-42dc-82c8-5a15cad6e7d0, pos=WALPointer [idx=0, fileOff=742894, len=11491]] [21:07:22] : [Step 4/5] [2021-11-19 21:07:22,683][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][GridCacheDatabaseSharedManager] Finished applying memory changes [changesApplied=1095, time=91 ms] [21:07:23] : [Step 4/5] [2021-11-19 21:07:23,105][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][CheckpointWorkflow] Checkpoint finished [cpId=6e63c462-c447-42dc-82c8-5a15cad6e7d0, pages=572, markPos=WALPointer [idx=0, fileOff=742894, len=11491], pagesWrite=21ms, fsync=384ms, total=405ms] [21:07:23] : [Step 4/5] [2021-11-19 21:07:23,106][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][GridCacheDatabaseSharedManager] Binary memory state restored at node startup [restoredPtr=WALPointer [idx=0, fileOff=754385, len=0]] [21:07:23] : [Step 4/5] [2021-11-19 21:07:23,107][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000000.wal, offset=754385, ver=2] [21:07:23] : [Step 4/5] [2021-11-19 21:07:23,111][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][GridCacheProcessor] Started cache in recovery mode [name=ignite-sys-cache, id=-2100569601, dataRegionName=sysMemPlc, mode=REPLICATED, atomicity=TRANSACTIONAL, backups=2147483647, mvcc=false] [21:07:23] : [Step 4/5] [2021-11-19 21:07:23,113][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][GridCacheProcessor] Started cache in recovery mode [name=encrypted, id=1613773252, dataRegionName=default, mode=PARTITIONED, atomicity=ATOMIC, backups=0, mvcc=false] [21:07:23] : [Step 4/5] [2021-11-19 21:07:23,113][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][GridCacheDatabaseSharedManager] Binary recovery performed in 657 ms. [21:07:23] : [Step 4/5] [2021-11-19 21:07:23,114][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=/opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0/cp/1637345241290-6e63c462-c447-42dc-82c8-5a15cad6e7d0-START.bin, endMarker=/opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0/cp/1637345241290-6e63c462-c447-42dc-82c8-5a15cad6e7d0-END.bin] [21:07:23] : [Step 4/5] [2021-11-19 21:07:23,115][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][GridCacheDatabaseSharedManager] Applying lost cache updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=742894, len=11491], lastCheckpointId=6e63c462-c447-42dc-82c8-5a15cad6e7d0] [21:07:23] : [Step 4/5] [2021-11-19 21:07:23,184][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=71 ms] [21:07:23] : [Step 4/5] [2021-11-19 21:07:23,184][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][GridCacheProcessor] Restoring partition state for local groups. [21:07:23] : [Step 4/5] [2021-11-19 21:07:23,245][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=2, partitionsProcessed=1124, time=60ms] [21:07:23] : [Step 4/5] [2021-11-19 21:07:23,249][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][TestTcpDiscoverySpi] Successfully bound to TCP port [port=47500, localHost=localhost/127.0.0.1, locNodeId=006acc63-081a-4937-b3e0-8ce98c28b000] [21:07:23] : [Step 4/5] [2021-11-19 21:07:23,251][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][GridEncryptionManager] Sending stored group keys to coordinator [grps=1613773252] [21:07:23] : [Step 4/5] [2021-11-19 21:07:23,259][INFO ][disco-notifier-worker-#14263%grid-0%][MvccProcessorImpl] Assigned mvcc coordinator [crd=MvccCoordinator [topVer=AffinityTopologyVersion [topVer=1, minorTopVer=0], nodeId=006acc63-081a-4937-b3e0-8ce98c28b000, ver=1637345243250, local=true, initialized=false]] [21:07:23] : [Step 4/5] [2021-11-19 21:07:23,261][INFO ][sys-#14243%grid-0%][ClusterProcessor] Writing cluster ID and tag to metastorage on ready for write ClusterIdAndTag [id=a7269b46-6430-4ed2-8b21-f79ca0c657d2, tag=busy_austin] [21:07:23] : [Step 4/5] [2021-11-19 21:07:23,276][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][IgniteKernal%grid-0] To start Console Management & Monitoring run ignitevisorcmd.{sh|bat} [21:07:23] : [Step 4/5] [2021-11-19 21:07:23,277][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][IgniteKernal%grid-0] [21:07:23] : [Step 4/5] [21:07:23] : [Step 4/5] >>> +-------------------------------------------+ [21:07:23] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:07:23] : [Step 4/5] >>> +-------------------------------------------+ [21:07:23] : [Step 4/5] >>> OS name: Linux 4.15.0-151-generic amd64 [21:07:23] : [Step 4/5] >>> CPU(s): 24 [21:07:23] : [Step 4/5] >>> Heap: 2.0GB [21:07:23] : [Step 4/5] >>> VM name: 16724@c4dfe9a430b2 [21:07:23] : [Step 4/5] >>> Ignite instance name: grid-0 [21:07:23] : [Step 4/5] >>> Local node [ID=006ACC63-081A-4937-B3E0-8CE98C28B000, order=1, clientMode=false] [21:07:23] : [Step 4/5] >>> Local node addresses: [127.0.0.1] [21:07:23] : [Step 4/5] >>> Local ports: TCP:10800 TCP:45160 TCP:47500 [21:07:23] : [Step 4/5] [21:07:23] : [Step 4/5] [2021-11-19 21:07:23,278][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][IgniteKernal%grid-0] >>> Ignite cluster is in INACTIVE state (limited functionality available). Use control.(sh|bat) script or IgniteCluster.state(ClusterState.ACTIVE) to change the state. [21:07:23] : [Step 4/5] [2021-11-19 21:07:23,278][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][GridDiscoveryManager] Topology snapshot [ver=1, locNode=006acc63, servers=1, clients=0, state=INACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=006acc63-081a-4937-b3e0-8ce98c28b000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:07:23] : [Step 4/5] [2021-11-19 21:07:23,279][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][GridDiscoveryManager] ^-- Baseline [id=0, size=2, online=1, offline=1] [21:07:23] : [Step 4/5] [2021-11-19 21:07:23,279][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][GridDiscoveryManager] ^-- 1 nodes left for auto-activation [grid-1] [21:07:23] : [Step 4/5] [2021-11-19 21:07:23,280][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][G] Node started : [stage="Configure system pool" (0 ms),stage="Start managers" (204 ms),stage="Configure binary metadata" (4 ms),stage="Start processors" (35 ms),stage="Start 'StanByClusterTestProvider' plugin" (0 ms),stage="Start 'PageMemory tracker plugin' plugin" (0 ms),stage="Start 'TestDistibutedConfigurationPlugin' plugin" (0 ms),stage="Start 'NodeValidationPluginProvider' plugin" (0 ms),stage="Init metastore" (349 ms),stage="Init and start regions" (7 ms),stage="Restore binary memory" (657 ms),stage="Restore logical state" (131 ms),stage="Finish recovery" (1 ms),stage="Join topology" (12 ms),stage="Await transition" (2 ms),stage="Await exchange" (18 ms),stage="Total time" (1420 ms)] [21:07:23] : [Step 4/5] [2021-11-19 21:07:23,281][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][root] Node started with the following configuration [id=006acc63-081a-4937-b3e0-8ce98c28b000, marshaller=BinaryMarshaller [], discovery=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=5000, ackTimeout=5000, marsh=JdkMarshaller [clsFilter=org.apache.ignite.marshaller.MarshallerUtils$1@62267eba], reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], binaryCfg=null, lateAff=true] [21:07:23]W: [org.apache.ignite:ignite-core] [2021-11-19 21:07:23,285][WARN ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][G] Ignite work directory is not provided, automatically resolved to: /opt/buildagent/work/7bc1c54bc719b67c/work [21:07:23] : [Step 4/5] [2021-11-19 21:07:23,286][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][IgniteKernal%grid-1] [21:07:23] : [Step 4/5] [21:07:23] : [Step 4/5] >>> __________ ________________ [21:07:23] : [Step 4/5] >>> / _/ ___/ |/ / _/_ __/ __/ [21:07:23] : [Step 4/5] >>> _/ // (7 7 // / / / / _/ [21:07:23] : [Step 4/5] >>> /___/\___/_/|_/___/ /_/ /___/ [21:07:23] : [Step 4/5] >>> [21:07:23] : [Step 4/5] >>> ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:07:23] : [Step 4/5] >>> 2021 Copyright(C) Apache Software Foundation [21:07:23] : [Step 4/5] >>> [21:07:23] : [Step 4/5] >>> Ignite documentation: http://ignite.apache.org [21:07:23] : [Step 4/5] [21:07:23] : [Step 4/5] [2021-11-19 21:07:23,287][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][IgniteKernal%grid-1] Config URL: n/a [21:07:23] : [Step 4/5] [2021-11-19 21:07:23,287][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][IgniteKernal%grid-1] IgniteConfiguration [igniteInstanceName=grid-1, pubPoolSize=24, svcPoolSize=24, callbackPoolSize=24, stripedPoolSize=24, sysPoolSize=24, mgmtPoolSize=4, dataStreamerPoolSize=24, utilityCachePoolSize=24, utilityCacheKeepAliveTime=60000, p2pPoolSize=2, qryPoolSize=24, buildIdxPoolSize=4, igniteHome=/opt/buildagent/work/7bc1c54bc719b67c, igniteWorkDir=/opt/buildagent/work/7bc1c54bc719b67c/work, mbeanSrv=com.sun.jmx.mbeanserver.JmxMBeanServer@6fe85038, nodeId=10fa0197-c2ee-456b-89ab-fbd76f344001, marsh=BinaryMarshaller [], marshLocJobs=false, daemon=false, p2pEnabled=true, netTimeout=10000, netCompressionLevel=1, sndRetryDelay=1000, sndRetryCnt=3, metricsHistSize=10000, metricsUpdateFreq=1000, metricsExpTime=9223372036854775807, discoSpi=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=0, ackTimeout=0, marsh=null, reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], segPlc=STOP, segResolveAttempts=2, waitForSegOnStart=true, allResolversPassReq=true, segChkFreq=10000, commSpi=TcpCommunicationSpi [connectGate=org.apache.ignite.spi.communication.tcp.internal.ConnectGateway@e6400e8, ctxInitLatch=java.util.concurrent.CountDownLatch@218ac18[Count = 1], stopping=false, clientPool=null, nioSrvWrapper=null, stateProvider=null], evtSpi=MemoryEventStorageSpi [expireAgeMs=9223372036854775807, expireCnt=10000, filter=null], colSpi=NoopCollisionSpi [], deploySpi=LocalDeploymentSpi [], indexingSpi=org.apache.ignite.spi.indexing.noop.NoopIndexingSpi@2a8153ac, addrRslvr=null, encryptionSpi=org.apache.ignite.spi.encryption.keystore.KeystoreEncryptionSpi@15c8fb53, tracingSpi=org.apache.ignite.spi.tracing.NoopTracingSpi@4d6e2efa, clientMode=false, rebalanceThreadPoolSize=4, rebalanceTimeout=10000, rebalanceBatchesPrefetchCnt=3, rebalanceThrottle=0, rebalanceBatchSize=524288, txCfg=TransactionConfiguration [txSerEnabled=false, dfltIsolation=REPEATABLE_READ, dfltConcurrency=PESSIMISTIC, dfltTxTimeout=0, txTimeoutOnPartitionMapExchange=0, deadlockTimeout=10000, pessimisticTxLogSize=0, pessimisticTxLogLinger=10000, tmLookupClsName=null, txManagerFactory=null, useJtaSync=false], cacheSanityCheckEnabled=true, discoStartupDelay=60000, deployMode=SHARED, p2pMissedCacheSize=100, locHost=127.0.0.1, timeSrvPortBase=31100, timeSrvPortRange=100, failureDetectionTimeout=10000, sysWorkerBlockedTimeout=null, clientFailureDetectionTimeout=10000, metricsLogFreq=0, connectorCfg=null, odbcCfg=null, warmupClos=null, atomicCfg=AtomicConfiguration [seqReserveSize=1000, cacheMode=PARTITIONED, backups=1, aff=null, grpName=null], classLdr=null, sslCtxFactory=null, platformCfg=null, binaryCfg=null, memCfg=null, pstCfg=null, dsCfg=DataStorageConfiguration [sysRegionInitSize=41943040, sysRegionMaxSize=104857600, pageSize=4096, concLvl=0, dfltDataRegConf=DataRegionConfiguration [name=default, maxSize=10485760, initSize=268435456, swapPath=null, pageEvictionMode=DISABLED, pageReplacementMode=CLOCK, evictionThreshold=0.9, emptyPagesPoolSize=100, metricsEnabled=false, metricsSubIntervalCount=5, metricsRateTimeInterval=60000, persistenceEnabled=true, checkpointPageBufSize=0, lazyMemoryAllocation=true, warmUpCfg=null], dataRegions=null, storagePath=null, checkpointFreq=180000, lockWaitTime=10000, checkpointThreads=4, checkpointWriteOrder=SEQUENTIAL, walHistSize=20, maxWalArchiveSize=1073741824, walSegments=10, walSegmentSize=67108864, walPath=db/wal, walArchivePath=db/wal/archive, cdcWalPath=db/wal/cdc, cdcEnabled=false, metricsEnabled=false, walMode=FSYNC, walTlbSize=131072, walBuffSize=0, walFlushFreq=2000, walFsyncDelay=1000, walRecordIterBuffSize=67108864, alwaysWriteFullPages=false, fileIOFactory=org.apache.ignite.internal.processors.cache.persistence.file.AsyncFileIOFactory@78c2583c, metricsSubIntervalCnt=5, metricsRateTimeInterval=60000, walAutoArchiveAfterInactivity=-1, walForceArchiveTimeout=-1, writeThrottlingEnabled=false, walCompactionEnabled=false, walCompactionLevel=1, checkpointReadLockTimeout=null, walPageCompression=DISABLED, walPageCompressionLevel=null, dfltWarmUpCfg=null, encCfg=org.apache.ignite.configuration.EncryptionConfiguration@4eb80a0f, defragmentationThreadPoolSize=4, minWalArchiveSize=-1], snapshotPath=snapshots, activeOnStart=true, activeOnStartPropSetFlag=false, autoActivation=true, autoActivationPropSetFlag=false, clusterStateOnStart=null, sqlConnCfg=null, cliConnCfg=ClientConnectorConfiguration [host=null, port=10800, portRange=100, sockSndBufSize=0, sockRcvBufSize=0, tcpNoDelay=true, maxOpenCursorsPerConn=128, threadPoolSize=24, selectorCnt=12, idleTimeout=0, handshakeTimeout=10000, jdbcEnabled=true, odbcEnabled=true, thinCliEnabled=true, sslEnabled=false, useIgniteSslCtxFactory=true, sslClientAuth=false, sslCtxFactory=null, thinCliCfg=ThinClientConfiguration [maxActiveTxPerConn=100, maxActiveComputeTasksPerConn=0]], mvccVacuumThreadCnt=2, mvccVacuumFreq=5000, authEnabled=false, failureHnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]], commFailureRslvr=null, sqlCfg=SqlConfiguration [longQryWarnTimeout=3000, dfltQryTimeout=0, sqlQryHistSize=1000, validationEnabled=false], asyncContinuationExecutor=null] [21:07:23] : [Step 4/5] [2021-11-19 21:07:23,294][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][IgniteKernal%grid-1] Daemon mode: off [21:07:23] : [Step 4/5] [2021-11-19 21:07:23,294][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][IgniteKernal%grid-1] OS: Linux 4.15.0-151-generic amd64 [21:07:23] : [Step 4/5] [2021-11-19 21:07:23,295][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][IgniteKernal%grid-1] OS user: teamcity [21:07:23] : [Step 4/5] [2021-11-19 21:07:23,295][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][IgniteKernal%grid-1] PID: 16724 [21:07:23] : [Step 4/5] [2021-11-19 21:07:23,295][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][IgniteKernal%grid-1] Language runtime: Java Platform API Specification ver. 1.8 [21:07:23] : [Step 4/5] [2021-11-19 21:07:23,295][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][IgniteKernal%grid-1] VM information: Java(TM) SE Runtime Environment 1.8.0_261-b12 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 25.261-b12 [21:07:23] : [Step 4/5] [2021-11-19 21:07:23,296][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][IgniteKernal%grid-1] VM total memory: 1.8GB [21:07:23] : [Step 4/5] [2021-11-19 21:07:23,296][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][IgniteKernal%grid-1] Remote Management [restart: off, REST: off, JMX (remote: off)] [21:07:23] : [Step 4/5] [2021-11-19 21:07:23,296][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][IgniteKernal%grid-1] Logger: GridTestLog4jLogger [quiet=false, config=null] [21:07:23] : [Step 4/5] [2021-11-19 21:07:23,296][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][IgniteKernal%grid-1] IGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c [21:07:23] : [Step 4/5] [2021-11-19 21:07:23,297][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][IgniteKernal%grid-1] VM arguments: [-DIGNITE_DUMP_THREADS_ON_FAILURE=false, -DMono=/usr/bin/mono-sgen, -DMono4.0_x64=/usr/lib/mono/4.0, -DMono4.5_x64=/usr/lib/mono/4.5, -DMonoVersion=6.12.0.90, -DSKIP_BUILD=false, -Dagent.home.dir=/opt/buildagent, -Dagent.name=aitc-lin02_03, -Dagent.ownPort=9090, -Dagent.work.dir=/opt/buildagent/work, -Dbuild.number=95, -Dbuild.vcs.number=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.1=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.GitHubApacheIgnite=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dclassworlds.conf=/opt/buildagent/temp/buildTmp/teamcity.m2.conf, -Dcom.jetbrains.maven.watcher.report.file=/opt/buildagent/temp/buildTmp/maven-build-info.xml, -Djava.io.tmpdir=/opt/buildagent/temp/buildTmp, -Dmaven.home=/opt/buildagent/tools/maven3_6, -Dmaven.multiModuleProjectDirectory=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.agent.cpuBenchmark=457, -Dteamcity.agent.dotnet.agent_url=http://localhost:9090/RPC2, -Dteamcity.agent.dotnet.build_id=6278078, -Dteamcity.auth.password=*******, -Dteamcity.auth.userId=TeamCityBuildId=6278078, -Dteamcity.build.changedFiles.file=/opt/buildagent/temp/buildTmp/changedFiles6342607772318147725.txt, -Dteamcity.build.checkoutDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.build.id=6278078, -Dteamcity.build.properties.file=/opt/buildagent/temp/buildTmp/teamcity.build5164517880467851002.properties, -Dteamcity.build.tempDir=/opt/buildagent/temp/buildTmp, -Dteamcity.build.workingDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.buildConfName=Basic 3, -Dteamcity.buildType.id=IgniteTests24Java8_Basic3, -Dteamcity.configuration.properties.file=/opt/buildagent/temp/buildTmp/teamcity.config5591980786735343870.properties, -Dteamcity.maven.userSettings.path=/opt/buildagent/temp/buildTmp/maven_settings_585072866407032347.xml, -Dteamcity.maven.watcher.home=/opt/buildagent/plugins/mavenPlugin/maven-watcher-jdk16, -Dteamcity.projectName=Ignite Tests 2.x (JDK 8/11), -Dteamcity.runner.properties.file=/opt/buildagent/temp/buildTmp/teamcity.runner9098465561618137420.properties, -Dteamcity.tests.recentlyFailedTests.file=/opt/buildagent/temp/buildTmp/testsToRunFirst3891775683130404069.txt, -Dteamcity.version=2021.2 (build 99542), -ea, -Xms2g, -Xmx2g, -XX:+HeapDumpOnOutOfMemoryError, -DIGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_TEST_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_UPDATE_NOTIFIER=false, -DIGNITE_NO_DISCO_ORDER=true, -DIGNITE_PERFORMANCE_SUGGESTIONS_DISABLED=true, -Djava.net.preferIPv4Stack=true, -DTEST_SCALE_FACTOR=1.0, -DIGNITE_TEST_PROP_LOG4J_FILE=log4j-tc-test.xml, -DIGNITE_QUIET=false, -DIGNITE_MARSHAL_BUFFERS_RECHECK=1000, -Dmaven.repo.local=/opt/buildagent/.m2/repository] [21:07:23] : [Step 4/5] [2021-11-19 21:07:23,300][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][IgniteKernal%grid-1] System cache's DataRegion size is configured to 40 MB. Use DataStorageConfiguration.systemRegionInitialSize property to change the setting. [21:07:23] : [Step 4/5] [2021-11-19 21:07:23,301][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][IgniteKernal%grid-1] Configured caches [in 'sysMemPlc' dataRegion: ['ignite-sys-cache']] [21:07:23]W: [org.apache.ignite:ignite-core] [2021-11-19 21:07:23,301][WARN ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][IgniteKernal%grid-1] Peer class loading is enabled (disable it in production for performance and deployment consistency reasons) [21:07:23] : [Step 4/5] [2021-11-19 21:07:23,301][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][IgniteKernal%grid-1] 3-rd party licenses can be found at: /opt/buildagent/work/7bc1c54bc719b67c/libs/licenses [21:07:23] : [Step 4/5] [2021-11-19 21:07:23,305][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][IgnitePluginProcessor] Configured plugins: [21:07:23] : [Step 4/5] [2021-11-19 21:07:23,305][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][IgnitePluginProcessor] ^-- StanByClusterTestProvider 1.0 [21:07:23] : [Step 4/5] [2021-11-19 21:07:23,306][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][IgnitePluginProcessor] ^-- null [21:07:23] : [Step 4/5] [2021-11-19 21:07:23,306][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][IgnitePluginProcessor] [21:07:23] : [Step 4/5] [2021-11-19 21:07:23,306][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][IgnitePluginProcessor] ^-- PageMemory tracker plugin 1.0 [21:07:23] : [Step 4/5] [2021-11-19 21:07:23,306][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][IgnitePluginProcessor] ^-- null [21:07:23] : [Step 4/5] [2021-11-19 21:07:23,306][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][IgnitePluginProcessor] [21:07:23] : [Step 4/5] [2021-11-19 21:07:23,306][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][IgnitePluginProcessor] ^-- TestDistibutedConfigurationPlugin 1.0 [21:07:23] : [Step 4/5] [2021-11-19 21:07:23,307][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][IgnitePluginProcessor] ^-- null [21:07:23] : [Step 4/5] [2021-11-19 21:07:23,307][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][IgnitePluginProcessor] [21:07:23] : [Step 4/5] [2021-11-19 21:07:23,307][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][IgnitePluginProcessor] ^-- NodeValidationPluginProvider 1.0 [21:07:23] : [Step 4/5] [2021-11-19 21:07:23,307][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][IgnitePluginProcessor] ^-- null [21:07:23] : [Step 4/5] [2021-11-19 21:07:23,308][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][IgnitePluginProcessor] [21:07:23] : [Step 4/5] [2021-11-19 21:07:23,308][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][FailureProcessor] Configured failure handler: [hnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]]] [21:07:23] : [Step 4/5] [2021-11-19 21:07:23,330][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][TcpCommunicationSpi] Successfully bound communication NIO server to TCP port [port=45161, locHost=/127.0.0.1, selectorsCnt=12, selectorSpins=0, pairedConn=false] [21:07:23]W: [org.apache.ignite:ignite-core] [2021-11-19 21:07:23,330][WARN ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][TcpCommunicationSpi] Message queue limit is set to 0 which may lead to potential OOMEs when running cache operations in FULL_ASYNC or PRIMARY_SYNC modes due to message queues growth on sender and receiver sides. [21:07:23] : [Step 4/5] [2021-11-19 21:07:23,337][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][GridCollisionManager] Collision resolution is disabled (all jobs will be activated upon arrival). [21:07:23] : [Step 4/5] [2021-11-19 21:07:23,337][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][IgniteKernal%grid-1] Security status [authentication=off, sandbox=off, tls/ssl=off] [21:07:23] : [Step 4/5] [2021-11-19 21:07:23,397][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:07:23] : [Step 4/5] [2021-11-19 21:07:23,487][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][MaintenanceProcessor] Resolved store directory for node persistent data: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1 [21:07:23] : [Step 4/5] [2021-11-19 21:07:23,488][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][CacheObjectBinaryProcessorImpl] Resolved directory for serialized binary metadata: /opt/buildagent/work/7bc1c54bc719b67c/work/db/binary_meta/grid_1 [21:07:23] : [Step 4/5] [2021-11-19 21:07:23,492][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1 [21:07:23] : [Step 4/5] [2021-11-19 21:07:23,493][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][FileWriteAheadLogManager] Resolved write ahead log work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1 [21:07:23] : [Step 4/5] [2021-11-19 21:07:23,493][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][FileWriteAheadLogManager] Resolved write ahead log archive directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1 [21:07:23] : [Step 4/5] [2021-11-19 21:07:23,495][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000005.wal [21:07:23] : [Step 4/5] [2021-11-19 21:07:23,495][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000006.wal [21:07:23] : [Step 4/5] [2021-11-19 21:07:23,496][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000008.wal [21:07:23] : [Step 4/5] [2021-11-19 21:07:23,496][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000004.wal [21:07:23] : [Step 4/5] [2021-11-19 21:07:23,497][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000003.wal [21:07:23] : [Step 4/5] [2021-11-19 21:07:23,497][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000002.wal [21:07:23] : [Step 4/5] [2021-11-19 21:07:23,497][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000007.wal [21:07:23] : [Step 4/5] [2021-11-19 21:07:23,498][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000001.wal [21:07:23] : [Step 4/5] [2021-11-19 21:07:23,499][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000009.wal [21:07:23] : [Step 4/5] [2021-11-19 21:07:23,504][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][GridCacheDatabaseSharedManager] Configured data regions initialized successfully [total=5] [21:07:23] : [Step 4/5] [2021-11-19 21:07:23,509][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][IgniteSnapshotManager] Resolved snapshot work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/snapshots [21:07:23] : [Step 4/5] [2021-11-19 21:07:23,509][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][IgniteSnapshotManager] Resolved temp directory for snapshot creation: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1/snp [21:07:23] : [Step 4/5] [2021-11-19 21:07:23,512][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][ClientListenerProcessor] Client connector processor has started on TCP port 10801 [21:07:23] : [Step 4/5] [2021-11-19 21:07:23,514][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][IgniteKernal%grid-1] Non-loopback local IPs: 172.17.0.4 [21:07:23] : [Step 4/5] [2021-11-19 21:07:23,515][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][IgniteKernal%grid-1] Enabled local MACs: 0242AC110004 [21:07:23] : [Step 4/5] [2021-11-19 21:07:23,516][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=/opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1/cp/1637345238693-baaaa8dd-9c4e-4790-b3c9-7815e6825071-START.bin, endMarker=/opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1/cp/1637345232314-b9777d28-2590-4ed1-9e47-7e5722585155-END.bin] [21:07:23] : [Step 4/5] [2021-11-19 21:07:23,518][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:07:23] : [Step 4/5] [2021-11-19 21:07:23,518][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=66667, len=1963], lastMarked=WALPointer [idx=0, fileOff=627447, len=11871], lastCheckpointId=baaaa8dd-9c4e-4790-b3c9-7815e6825071] [21:07:23] : [Step 4/5] [2021-11-19 21:07:23,625][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][GridCacheDatabaseSharedManager] Found last checkpoint marker [cpId=baaaa8dd-9c4e-4790-b3c9-7815e6825071, pos=WALPointer [idx=0, fileOff=627447, len=11871]] [21:07:23] : [Step 4/5] [2021-11-19 21:07:23,632][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][GridCacheDatabaseSharedManager] Applying lost metastore updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=627447, len=11871], lastCheckpointId=baaaa8dd-9c4e-4790-b3c9-7815e6825071] [21:07:23] : [Step 4/5] [2021-11-19 21:07:23,688][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=60 ms] [21:07:23] : [Step 4/5] [2021-11-19 21:07:23,689][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][GridCacheProcessor] Restoring partition state for local groups. [21:07:23] : [Step 4/5] [2021-11-19 21:07:23,689][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=0, partitionsProcessed=0, time=0ms] [21:07:23] : [Step 4/5] [2021-11-19 21:07:23,860][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][GridClusterStateProcessor] Restoring history for BaselineTopology[id=0] [21:07:23] : [Step 4/5] [2021-11-19 21:07:23,862][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][ClusterProcessor] Cluster ID and tag has been read from metastorage: ClusterIdAndTag [id=a7269b46-6430-4ed2-8b21-f79ca0c657d2, tag=busy_austin] [21:07:23] : [Step 4/5] [2021-11-19 21:07:23,863][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][IgniteClusterImpl] Shutdown policy was updated [oldVal=null, newVal=null] [21:07:23] : [Step 4/5] [2021-11-19 21:07:23,863][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustEnabled' was changed from 'null' to 'false' [21:07:23] : [Step 4/5] [2021-11-19 21:07:23,863][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustTimeout' was changed from 'null' to '300000' [21:07:23] : [Step 4/5] [2021-11-19 21:07:23,864][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][IgniteTxManager] Transactions parameter 'txOwnerDumpRequestsAllowed' was changed from 'null' to 'true' [21:07:23] : [Step 4/5] [2021-11-19 21:07:23,864][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][IgniteTxManager] Transactions parameter 'longOperationsDumpTimeout' was changed from 'null' to '60000' [21:07:23] : [Step 4/5] [2021-11-19 21:07:23,864][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpThreshold' was changed from 'null' to '0' [21:07:23] : [Step 4/5] [2021-11-19 21:07:23,865][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][IgniteTxManager] Transactions parameter 'transactionTimeDumpSamplesCoefficient' was changed from 'null' to '0.0' [21:07:23] : [Step 4/5] [2021-11-19 21:07:23,865][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpSamplesPerSecondLimit' was changed from 'null' to '5' [21:07:23] : [Step 4/5] [2021-11-19 21:07:23,865][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][IgniteTxManager] Transactions parameter 'collisionsDumpInterval' was changed from 'null' to '1000' [21:07:23] : [Step 4/5] [2021-11-19 21:07:23,866][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][GridCacheDatabaseSharedManager] Historical rebalance WAL threshold changed [property=historical.rebalance.threshold, oldVal=null, newVal=500] [21:07:23] : [Step 4/5] [2021-11-19 21:07:23,866][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][GridCacheDatabaseSharedManager] Checkpoint frequency deviation changed [oldVal=null, newVal=null] [21:07:23] : [Step 4/5] [2021-11-19 21:07:23,902][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][FilePageStoreManager] Cleanup cache stores [total=1, left=0, cleanFiles=false] [21:07:23] : [Step 4/5] [2021-11-19 21:07:23,904][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:07:23] : [Step 4/5] [2021-11-19 21:07:23,905][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:07:23] : [Step 4/5] [2021-11-19 21:07:23,907][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:07:23] : [Step 4/5] [2021-11-19 21:07:23,907][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][GridCacheDatabaseSharedManager] Data Regions Started: 5 [21:07:23] : [Step 4/5] [2021-11-19 21:07:23,908][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][GridCacheDatabaseSharedManager] ^-- sysMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:07:23] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:07:23] : [Step 4/5] ^-- default region [type=default, persistence=true, lazyAlloc=true, [21:07:23] : [Step 4/5] ... initCfg=10MB, maxCfg=10MB, usedRam=0MB, freeRam=100%, allocRam=0MB, allocTotal=0MB] [21:07:23] : [Step 4/5] ^-- metastoreMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:07:23] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:07:23] : [Step 4/5] ^-- TxLog region [type=internal, persistence=true, lazyAlloc=false, [21:07:23] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:07:23] : [Step 4/5] ^-- volatileDsMemPlc region [type=user, persistence=false, lazyAlloc=true, [21:07:23] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB] [21:07:23] : [Step 4/5] ^-- Ignite persistence [used=0MB] [21:07:23] : [Step 4/5] [21:07:23] : [Step 4/5] [2021-11-19 21:07:23,909][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][GridCacheDatabaseSharedManager] Starting binary memory restore for: [-2100569601, 1613773252] [21:07:23] : [Step 4/5] [2021-11-19 21:07:23,965][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=/opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1/cp/1637345238693-baaaa8dd-9c4e-4790-b3c9-7815e6825071-START.bin, endMarker=/opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1/cp/1637345232314-b9777d28-2590-4ed1-9e47-7e5722585155-END.bin] [21:07:23] : [Step 4/5] [2021-11-19 21:07:23,965][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=66667, len=1963], lastMarked=WALPointer [idx=0, fileOff=627447, len=11871], lastCheckpointId=baaaa8dd-9c4e-4790-b3c9-7815e6825071] [21:07:24]W: [org.apache.ignite:ignite-core] [2021-11-19 21:07:24,030][WARN ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][GridCacheDatabaseSharedManager] Ignite node stopped in the middle of checkpoint. Will restore memory state and finish checkpoint on node start. [21:07:24] : [Step 4/5] [2021-11-19 21:07:24,031][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][PageMemoryImpl] Started page memory [memoryAllocated=24.0 MiB, pages=5952, tableSize=474.2 KiB, replacementSize=768 B, checkpointBuffer=10.0 MiB] [21:07:24] : [Step 4/5] [2021-11-19 21:07:24,106][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][GridCacheDatabaseSharedManager] Found last checkpoint marker [cpId=baaaa8dd-9c4e-4790-b3c9-7815e6825071, pos=WALPointer [idx=0, fileOff=627447, len=11871]] [21:07:24] : [Step 4/5] [2021-11-19 21:07:24,112][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][GridCacheDatabaseSharedManager] Finished applying memory changes [changesApplied=879, time=81 ms] [21:07:24] : [Step 4/5] [2021-11-19 21:07:24,823][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][CheckpointWorkflow] Checkpoint finished [cpId=baaaa8dd-9c4e-4790-b3c9-7815e6825071, pages=452, markPos=WALPointer [idx=0, fileOff=627447, len=11871], pagesWrite=14ms, fsync=686ms, total=700ms] [21:07:24] : [Step 4/5] [2021-11-19 21:07:24,824][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][GridCacheDatabaseSharedManager] Binary memory state restored at node startup [restoredPtr=WALPointer [idx=0, fileOff=639318, len=0]] [21:07:24] : [Step 4/5] [2021-11-19 21:07:24,826][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000000.wal, offset=639318, ver=2] [21:07:24] : [Step 4/5] [2021-11-19 21:07:24,828][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][GridCacheProcessor] Started cache in recovery mode [name=ignite-sys-cache, id=-2100569601, dataRegionName=sysMemPlc, mode=REPLICATED, atomicity=TRANSACTIONAL, backups=2147483647, mvcc=false] [21:07:24] : [Step 4/5] [2021-11-19 21:07:24,830][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][GridCacheProcessor] Started cache in recovery mode [name=encrypted, id=1613773252, dataRegionName=default, mode=PARTITIONED, atomicity=ATOMIC, backups=0, mvcc=false] [21:07:24] : [Step 4/5] [2021-11-19 21:07:24,831][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][GridCacheDatabaseSharedManager] Binary recovery performed in 922 ms. [21:07:24] : [Step 4/5] [2021-11-19 21:07:24,831][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=/opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1/cp/1637345238693-baaaa8dd-9c4e-4790-b3c9-7815e6825071-START.bin, endMarker=/opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1/cp/1637345238693-baaaa8dd-9c4e-4790-b3c9-7815e6825071-END.bin] [21:07:24] : [Step 4/5] [2021-11-19 21:07:24,832][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][GridCacheDatabaseSharedManager] Applying lost cache updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=627447, len=11871], lastCheckpointId=baaaa8dd-9c4e-4790-b3c9-7815e6825071] [21:07:24] : [Step 4/5] [2021-11-19 21:07:24,885][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=60 ms] [21:07:24] : [Step 4/5] [2021-11-19 21:07:24,885][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][GridCacheProcessor] Restoring partition state for local groups. [21:07:24] : [Step 4/5] [2021-11-19 21:07:24,948][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=2, partitionsProcessed=1124, time=61ms] [21:07:24] : [Step 4/5] [2021-11-19 21:07:24,950][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][TestTcpDiscoverySpi] Successfully bound to TCP port [port=47501, localHost=localhost/127.0.0.1, locNodeId=10fa0197-c2ee-456b-89ab-fbd76f344001] [21:07:24] : [Step 4/5] [2021-11-19 21:07:24,951][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][GridEncryptionManager] Sending stored group keys to coordinator [grps=1613773252] [21:07:24] : [Step 4/5] [2021-11-19 21:07:24,954][INFO ][tcp-disco-srvr-[:47500]-#744%grid-0%-#14265%grid-0%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=33271] [21:07:24] : [Step 4/5] [2021-11-19 21:07:24,955][INFO ][tcp-disco-srvr-[:47500]-#744%grid-0%-#14265%grid-0%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=33271] [21:07:24] : [Step 4/5] [2021-11-19 21:07:24,955][INFO ][tcp-disco-sock-reader-[]-#750%grid-0%-#14385%grid-0%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:33271, rmtPort=33271] [21:07:24] : [Step 4/5] [2021-11-19 21:07:24,957][INFO ][tcp-disco-sock-reader-[10fa0197 127.0.0.1:33271]-#750%grid-0%-#14385%grid-0%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=10fa0197-c2ee-456b-89ab-fbd76f344001, rmtAddr=/127.0.0.1:33271] [21:07:24] : [Step 4/5] [2021-11-19 21:07:24,962][INFO ][tcp-disco-srvr-[:47501]-#749%grid-1%-#14384%grid-1%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=46529] [21:07:24] : [Step 4/5] [2021-11-19 21:07:24,962][INFO ][tcp-disco-srvr-[:47501]-#749%grid-1%-#14384%grid-1%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=46529] [21:07:24] : [Step 4/5] [2021-11-19 21:07:24,963][INFO ][tcp-disco-sock-reader-[]-#751%grid-1%-#14386%grid-1%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:46529, rmtPort=46529] [21:07:24] : [Step 4/5] [2021-11-19 21:07:24,963][INFO ][tcp-disco-sock-reader-[]-#751%grid-1%-#14386%grid-1%][TestTcpDiscoverySpi] Received ping request from the remote node [rmtNodeId=006acc63-081a-4937-b3e0-8ce98c28b000, rmtAddr=/127.0.0.1:46529, rmtPort=46529] [21:07:24] : [Step 4/5] [2021-11-19 21:07:24,964][INFO ][tcp-disco-sock-reader-[]-#751%grid-1%-#14386%grid-1%][TestTcpDiscoverySpi] Finished writing ping response [rmtNodeId=006acc63-081a-4937-b3e0-8ce98c28b000, rmtAddr=/127.0.0.1:46529, rmtPort=46529] [21:07:24] : [Step 4/5] [2021-11-19 21:07:24,965][INFO ][tcp-disco-sock-reader-[]-#751%grid-1%-#14386%grid-1%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:46529, rmtPort=46529, rmtNodeId=null] [21:07:24] : [Step 4/5] [2021-11-19 21:07:24,965][INFO ][tcp-disco-sock-reader-[10fa0197 127.0.0.1:33271]-#750%grid-0%-#14385%grid-0%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:33271, rmtPort=33271, rmtNodeId=10fa0197-c2ee-456b-89ab-fbd76f344001] [21:07:24] : [Step 4/5] [2021-11-19 21:07:24,979][INFO ][tcp-disco-msg-worker-[crd]-#743%grid-0%-#14264%grid-0%][TestTcpDiscoverySpi] New next node [newNext=TcpDiscoveryNode [id=10fa0197-c2ee-456b-89ab-fbd76f344001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=0, intOrder=2, lastExchangeTime=1637345244954, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false]] [21:07:24] : [Step 4/5] [2021-11-19 21:07:24,980][INFO ][tcp-disco-srvr-[:47501]-#749%grid-1%-#14384%grid-1%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=37207] [21:07:24] : [Step 4/5] [2021-11-19 21:07:24,980][INFO ][tcp-disco-srvr-[:47501]-#749%grid-1%-#14384%grid-1%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=37207] [21:07:24] : [Step 4/5] [2021-11-19 21:07:24,981][INFO ][tcp-disco-sock-reader-[]-#752%grid-1%-#14387%grid-1%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:37207, rmtPort=37207] [21:07:24] : [Step 4/5] [2021-11-19 21:07:24,981][INFO ][tcp-disco-sock-reader-[006acc63 127.0.0.1:37207]-#752%grid-1%-#14387%grid-1%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=006acc63-081a-4937-b3e0-8ce98c28b000, rmtAddr=/127.0.0.1:37207] [21:07:24] : [Step 4/5] [2021-11-19 21:07:24,985][INFO ][tcp-disco-msg-worker-[]-#748%grid-1%-#14383%grid-1%][TestTcpDiscoverySpi] New next node [newNext=TcpDiscoveryNode [id=006acc63-081a-4937-b3e0-8ce98c28b000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345244974, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false]] [21:07:24] : [Step 4/5] [2021-11-19 21:07:24,986][INFO ][tcp-disco-srvr-[:47500]-#744%grid-0%-#14265%grid-0%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=37391] [21:07:24] : [Step 4/5] [2021-11-19 21:07:24,987][INFO ][tcp-disco-srvr-[:47500]-#744%grid-0%-#14265%grid-0%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=37391] [21:07:24] : [Step 4/5] [2021-11-19 21:07:24,987][INFO ][tcp-disco-sock-reader-[]-#753%grid-0%-#14388%grid-0%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:37391, rmtPort=37391] [21:07:24] : [Step 4/5] [2021-11-19 21:07:24,988][INFO ][tcp-disco-sock-reader-[10fa0197 127.0.0.1:37391]-#753%grid-0%-#14388%grid-0%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=10fa0197-c2ee-456b-89ab-fbd76f344001, rmtAddr=/127.0.0.1:37391] [21:07:24] : [Step 4/5] [2021-11-19 21:07:24,991][INFO ][disco-event-worker-#14267%grid-0%][GridDiscoveryManager] Added new node to topology: TcpDiscoveryNode [id=10fa0197-c2ee-456b-89ab-fbd76f344001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637345244954, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false] [21:07:24] : [Step 4/5] [2021-11-19 21:07:24,991][INFO ][disco-event-worker-#14267%grid-0%][GridDiscoveryManager] Topology snapshot [ver=2, locNode=006acc63, servers=2, clients=0, state=INACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=006acc63-081a-4937-b3e0-8ce98c28b000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=10fa0197-c2ee-456b-89ab-fbd76f344001, consistentId=grid-1, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:07:24] : [Step 4/5] [2021-11-19 21:07:24,992][INFO ][disco-event-worker-#14267%grid-0%][GridDiscoveryManager] ^-- Baseline [id=0, size=2, online=2, offline=0] [21:07:24] : [Step 4/5] [2021-11-19 21:07:24,992][INFO ][disco-event-worker-#14267%grid-0%][GridDiscoveryManager] ^-- All baseline nodes are online, will start auto-activation [21:07:24] : [Step 4/5] [2021-11-19 21:07:24,995][INFO ][tcp-disco-msg-worker-[006acc63 127.0.0.1:47500]-#748%grid-1%-#14383%grid-1%][GridEncryptionManager] Skip group key received from coordinator. Already exists. [grp=1613773252, keyId=0] [21:07:24] : [Step 4/5] [2021-11-19 21:07:24,996][INFO ][disco-notifier-worker-#14382%grid-1%][MvccProcessorImpl] Assigned mvcc coordinator [crd=MvccCoordinator [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=0], nodeId=006acc63-081a-4937-b3e0-8ce98c28b000, ver=1637345243250, local=false, initialized=false]] [21:07:24] : [Step 4/5] [2021-11-19 21:07:24,997][INFO ][disco-notifier-worker-#14382%grid-1%][GridClusterStateProcessor] Sending activate cluster request with BaselineTopology BaselineTopology [id=0, branchingHash=-2475315501, branchingType='Cluster activation', baselineNodes=[grid-1, grid-0]] [21:07:25] : [Step 4/5] [2021-11-19 21:07:25,000][INFO ][sys-#14374%grid-1%][ClusterProcessor] Writing cluster ID and tag to metastorage on ready for write ClusterIdAndTag [id=a7269b46-6430-4ed2-8b21-f79ca0c657d2, tag=busy_austin] [21:07:25] : [Step 4/5] [2021-11-19 21:07:25,002][INFO ][disco-notifier-worker-#14263%grid-0%][GridClusterStateProcessor] Received activate cluster request with BaselineTopology[id=0] initiator node ID: 10fa0197-c2ee-456b-89ab-fbd76f344001 [21:07:25] : [Step 4/5] [2021-11-19 21:07:25,002][INFO ][disco-notifier-worker-#14263%grid-0%][GridClusterStateProcessor] Started state transition: activate cluster [21:07:25] : [Step 4/5] [2021-11-19 21:07:25,003][INFO ][exchange-worker-#14268%grid-0%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], crd=true, evt=DISCOVERY_CUSTOM_EVT, evtNode=10fa0197-c2ee-456b-89ab-fbd76f344001, customEvt=ChangeGlobalStateMessage [id=5925d593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqId=f74f9aef-587c-4db7-b54f-42a332c84901, initiatingNodeId=10fa0197-c2ee-456b-89ab-fbd76f344001, state=ACTIVE, baselineTopology=BaselineTopology [id=0, branchingHash=-2475315501, branchingType='Cluster activation', baselineNodes=[grid-1, grid-0]], forceChangeBaselineTopology=false, timestamp=1637345244997, forceDeactivation=true], allowMerge=false, exchangeFreeSwitch=false] [21:07:25] : [Step 4/5] [2021-11-19 21:07:25,004][INFO ][disco-notifier-worker-#14382%grid-1%][GridClusterStateProcessor] Received activate cluster request with BaselineTopology[id=0] initiator node ID: 10fa0197-c2ee-456b-89ab-fbd76f344001 [21:07:25] : [Step 4/5] [2021-11-19 21:07:25,004][INFO ][exchange-worker-#14268%grid-0%][GridDhtPartitionsExchangeFuture] Start activation process [nodeId=006acc63-081a-4937-b3e0-8ce98c28b000, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]]. New state: ACTIVE [21:07:25] : [Step 4/5] [2021-11-19 21:07:25,005][INFO ][disco-notifier-worker-#14382%grid-1%][GridClusterStateProcessor] Started state transition: activate cluster [21:07:25] : [Step 4/5] [2021-11-19 21:07:25,005][INFO ][exchange-worker-#14268%grid-0%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0 [21:07:25] : [Step 4/5] [2021-11-19 21:07:25,009][INFO ][exchange-worker-#14268%grid-0%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000000.wal, offset=754385, ver=2] [21:07:25] : [Step 4/5] [2021-11-19 21:07:25,013][INFO ][exchange-worker-#14268%grid-0%][GridClusterStateProcessor] Writing BaselineTopology[id=0] [21:07:25] : [Step 4/5] [2021-11-19 21:07:25,015][INFO ][exchange-worker-#14268%grid-0%][GridCacheDatabaseSharedManager] Finish recovery performed in 9 ms. [21:07:25] : [Step 4/5] [2021-11-19 21:07:25,016][INFO ][exchange-worker-#14268%grid-0%][msg] Components activation performed in 11 ms. [21:07:25] : [Step 4/5] [2021-11-19 21:07:25,017][INFO ][exchange-worker-#14268%grid-0%][GridCacheProcessor] Finished recovery for cache [cache=encrypted, grp=encrypted, startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:07:25] : [Step 4/5] [2021-11-19 21:07:25,017][INFO ][sys-#14257%grid-0%][GridCacheProcessor] Finished recovery for cache [cache=ignite-sys-cache, grp=ignite-sys-cache, startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:07:25] : [Step 4/5] [2021-11-19 21:07:25,018][INFO ][exchange-worker-#14394%grid-1%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], crd=false, evt=DISCOVERY_CUSTOM_EVT, evtNode=10fa0197-c2ee-456b-89ab-fbd76f344001, customEvt=ChangeGlobalStateMessage [id=5925d593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqId=f74f9aef-587c-4db7-b54f-42a332c84901, initiatingNodeId=10fa0197-c2ee-456b-89ab-fbd76f344001, state=ACTIVE, baselineTopology=BaselineTopology [id=0, branchingHash=-2475315501, branchingType='Cluster activation', baselineNodes=[grid-1, grid-0]], forceChangeBaselineTopology=false, timestamp=1637345244997, forceDeactivation=true], allowMerge=false, exchangeFreeSwitch=false] [21:07:25] : [Step 4/5] [2021-11-19 21:07:25,019][INFO ][exchange-worker-#14394%grid-1%][GridDhtPartitionsExchangeFuture] Start activation process [nodeId=10fa0197-c2ee-456b-89ab-fbd76f344001, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]]. New state: ACTIVE [21:07:25] : [Step 4/5] [2021-11-19 21:07:25,019][INFO ][exchange-worker-#14394%grid-1%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1 [21:07:25]W: [org.apache.ignite:ignite-core] [2021-11-19 21:07:25,020][WARN ][sys-#14259%grid-0%][CacheAffinitySharedManager] Cache group 'encrypted' brings high overhead for its metainformation in data region 'default'. Metainformation required for its partitions (502 partitions, 4096 bytes per partition, 1 MBs total) will consume more than 15% of data region memory (10 MBs). It may lead to critical errors on the node and cluster instability. Please reduce number of partitions, add more memory to the data region or add more server nodes for this cache group. [21:07:25] : [Step 4/5] [2021-11-19 21:07:25,022][INFO ][exchange-worker-#14268%grid-0%][GridDhtPartitionsExchangeFuture] Successfully activated caches [nodeId=006acc63-081a-4937-b3e0-8ce98c28b000, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], newState=ACTIVE] [21:07:25] : [Step 4/5] [2021-11-19 21:07:25,022][INFO ][exchange-worker-#14394%grid-1%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000000.wal, offset=639318, ver=2] [21:07:25] : [Step 4/5] [2021-11-19 21:07:25,022][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][IgniteKernal%grid-1] To start Console Management & Monitoring run ignitevisorcmd.{sh|bat} [21:07:25]W: [org.apache.ignite:ignite-core] [2021-11-19 21:07:25,023][WARN ][exchange-worker-#14268%grid-0%][CacheAffinitySharedManager] Cache group 'encrypted' brings high overhead for its metainformation in data region 'default'. Metainformation required for its partitions (502 partitions, 4096 bytes per partition, 1 MBs total) will consume more than 15% of data region memory (10 MBs). It may lead to critical errors on the node and cluster instability. Please reduce number of partitions, add more memory to the data region or add more server nodes for this cache group. [21:07:25] : [Step 4/5] [2021-11-19 21:07:25,024][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][IgniteKernal%grid-1] [21:07:25] : [Step 4/5] [21:07:25] : [Step 4/5] >>> +-------------------------------------------+ [21:07:25] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:07:25] : [Step 4/5] >>> +-------------------------------------------+ [21:07:25] : [Step 4/5] >>> OS name: Linux 4.15.0-151-generic amd64 [21:07:25] : [Step 4/5] >>> CPU(s): 24 [21:07:25] : [Step 4/5] >>> Heap: 2.0GB [21:07:25] : [Step 4/5] >>> VM name: 16724@c4dfe9a430b2 [21:07:25] : [Step 4/5] >>> Ignite instance name: grid-1 [21:07:25] : [Step 4/5] >>> Local node [ID=10FA0197-C2EE-456B-89AB-FBD76F344001, order=2, clientMode=false] [21:07:25] : [Step 4/5] >>> Local node addresses: [127.0.0.1] [21:07:25] : [Step 4/5] >>> Local ports: TCP:10801 TCP:45161 TCP:47501 [21:07:25] : [Step 4/5] [21:07:25] : [Step 4/5] [2021-11-19 21:07:25,023][INFO ][exchange-worker-#14394%grid-1%][GridClusterStateProcessor] Writing BaselineTopology[id=0] [21:07:25] : [Step 4/5] [2021-11-19 21:07:25,025][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][GridDiscoveryManager] Topology snapshot [ver=2, locNode=10fa0197, servers=2, clients=0, state=INACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=006acc63-081a-4937-b3e0-8ce98c28b000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=10fa0197-c2ee-456b-89ab-fbd76f344001, consistentId=grid-1, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:07:25] : [Step 4/5] [2021-11-19 21:07:25,024][INFO ][exchange-worker-#14268%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:07:25] : [Step 4/5] [2021-11-19 21:07:25,026][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][GridDiscoveryManager] ^-- Baseline [id=0, size=2, online=2, offline=0] [21:07:25] : [Step 4/5] [2021-11-19 21:07:25,027][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][GridDiscoveryManager] ^-- All baseline nodes are online, will start auto-activation [21:07:25] : [Step 4/5] [2021-11-19 21:07:25,027][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][G] Node started : [stage="Configure system pool" (0 ms),stage="Start managers" (201 ms),stage="Configure binary metadata" (1 ms),stage="Start processors" (23 ms),stage="Start 'StanByClusterTestProvider' plugin" (0 ms),stage="Start 'PageMemory tracker plugin' plugin" (0 ms),stage="Start 'TestDistibutedConfigurationPlugin' plugin" (0 ms),stage="Start 'NodeValidationPluginProvider' plugin" (0 ms),stage="Init metastore" (388 ms),stage="Init and start regions" (7 ms),stage="Restore binary memory" (922 ms),stage="Restore logical state" (116 ms),stage="Finish recovery" (0 ms),stage="Join topology" (46 ms),stage="Await transition" (4 ms),stage="Await exchange" (26 ms),stage="Total time" (1734 ms)] [21:07:25] : [Step 4/5] [2021-11-19 21:07:25,028][INFO ][exchange-worker-#14394%grid-1%][GridCacheDatabaseSharedManager] Finish recovery performed in 8 ms. [21:07:25] : [Step 4/5] [2021-11-19 21:07:25,029][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][root] Node started with the following configuration [id=10fa0197-c2ee-456b-89ab-fbd76f344001, marshaller=BinaryMarshaller [], discovery=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=5000, ackTimeout=5000, marsh=JdkMarshaller [clsFilter=org.apache.ignite.marshaller.MarshallerUtils$1@21f7ab73], reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], binaryCfg=null, lateAff=true] [21:07:25] : [Step 4/5] [2021-11-19 21:07:25,030][INFO ][exchange-worker-#14394%grid-1%][msg] Components activation performed in 11 ms. [21:07:25] : [Step 4/5] [2021-11-19 21:07:25,031][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][GridClusterStateProcessor] Sending activate cluster request with BaselineTopology BaselineTopology [id=0, branchingHash=-2475315501, branchingType='Cluster activation', baselineNodes=[grid-1, grid-0]] [21:07:25] : [Step 4/5] [2021-11-19 21:07:25,032][INFO ][exchange-worker-#14394%grid-1%][GridCacheProcessor] Finished recovery for cache [cache=ignite-sys-cache, grp=ignite-sys-cache, startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:07:25] : [Step 4/5] [2021-11-19 21:07:25,032][INFO ][sys-#14367%grid-1%][GridCacheProcessor] Finished recovery for cache [cache=encrypted, grp=encrypted, startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:07:25] : [Step 4/5] [2021-11-19 21:07:25,032][INFO ][disco-notifier-worker-#14263%grid-0%][GridClusterStateProcessor] Received activate cluster request with BaselineTopology[id=0] initiator node ID: 006acc63-081a-4937-b3e0-8ce98c28b000 [21:07:25]W: [org.apache.ignite:ignite-core] [2021-11-19 21:07:25,035][WARN ][sys-#14380%grid-1%][CacheAffinitySharedManager] Cache group 'encrypted' brings high overhead for its metainformation in data region 'default'. Metainformation required for its partitions (522 partitions, 4096 bytes per partition, 2 MBs total) will consume more than 15% of data region memory (10 MBs). It may lead to critical errors on the node and cluster instability. Please reduce number of partitions, add more memory to the data region or add more server nodes for this cache group. [21:07:25] : [Step 4/5] [2021-11-19 21:07:25,035][INFO ][disco-notifier-worker-#14382%grid-1%][GridClusterStateProcessor] Received activate cluster request with BaselineTopology[id=0] initiator node ID: 006acc63-081a-4937-b3e0-8ce98c28b000 [21:07:25] : [Step 4/5] [2021-11-19 21:07:25,036][INFO ][exchange-worker-#14268%grid-0%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], crd=true] [21:07:25] : [Step 4/5] [2021-11-19 21:07:25,036][INFO ][exchange-worker-#14394%grid-1%][GridDhtPartitionsExchangeFuture] Successfully activated caches [nodeId=10fa0197-c2ee-456b-89ab-fbd76f344001, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], newState=ACTIVE] [21:07:25]W: [org.apache.ignite:ignite-core] [2021-11-19 21:07:25,038][WARN ][exchange-worker-#14394%grid-1%][CacheAffinitySharedManager] Cache group 'encrypted' brings high overhead for its metainformation in data region 'default'. Metainformation required for its partitions (522 partitions, 4096 bytes per partition, 2 MBs total) will consume more than 15% of data region memory (10 MBs). It may lead to critical errors on the node and cluster instability. Please reduce number of partitions, add more memory to the data region or add more server nodes for this cache group. [21:07:25] : [Step 4/5] [2021-11-19 21:07:25,039][INFO ][exchange-worker-#14394%grid-1%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:07:25] : [Step 4/5] [2021-11-19 21:07:25,042][INFO ][db-checkpoint-thread-#14399%grid-0%][Checkpointer] Checkpoint started [checkpointId=7f9b68be-d566-4815-b5a5-5cd37583bd50, startPtr=WALPointer [idx=0, fileOff=1070413, len=11507], checkpointBeforeLockTime=7ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=4ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=1ms, pages=71, reason='node started'] [21:07:25] : [Step 4/5] [2021-11-19 21:07:25,065][INFO ][db-checkpoint-thread-#14405%grid-1%][Checkpointer] Checkpoint started [checkpointId=fa431305-cf8f-4725-9226-b19bad1718a1, startPtr=WALPointer [idx=0, fileOff=905438, len=11887], checkpointBeforeLockTime=7ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=5ms, checkpointLockHoldTime=10ms, walCpRecordFsyncDuration=5ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=1ms, pages=59, reason='node started'] [21:07:25] : [Step 4/5] [2021-11-19 21:07:25,068][INFO ][grid-nio-worker-tcp-comm-0-#14206%TcpCommunicationSpi%][TcpCommunicationSpi] Accepted incoming communication connection [locAddr=/127.0.0.1:45160, rmtAddr=/127.0.0.1:43214] [21:07:25] : [Step 4/5] [2021-11-19 21:07:25,073][INFO ][grid-nio-worker-tcp-comm-0-#14325%TcpCommunicationSpi%][TcpCommunicationSpi] Established outgoing communication connection [locAddr=/127.0.0.1:43214, rmtAddr=/127.0.0.1:45160] [21:07:25] : [Step 4/5] [2021-11-19 21:07:25,074][INFO ][exchange-worker-#14394%grid-1%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], crd=false] [21:07:25] : [Step 4/5] [2021-11-19 21:07:25,076][INFO ][sys-#14245%grid-0%][GridDhtPartitionsExchangeFuture] Coordinator received single message [ver=AffinityTopologyVersion [topVer=2, minorTopVer=1], node=10fa0197-c2ee-456b-89ab-fbd76f344001, allReceived=true] [21:07:25] : [Step 4/5] [2021-11-19 21:07:25,076][INFO ][sys-#14245%grid-0%][GridDhtPartitionsExchangeFuture] finishExchangeOnCoordinator [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:07:25] : [Step 4/5] [2021-11-19 21:07:25,093][INFO ][sys-#14370%grid-1%][GridDhtPartitionsExchangeFuture] Received full message, will finish exchange [node=006acc63-081a-4937-b3e0-8ce98c28b000, resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:07:25] : [Step 4/5] [2021-11-19 21:07:25,094][INFO ][db-checkpoint-thread-#14399%grid-0%][Checkpointer] Checkpoint finished [cpId=7f9b68be-d566-4815-b5a5-5cd37583bd50, pages=71, markPos=WALPointer [idx=0, fileOff=1070413, len=11507], walSegmentsCovered=[], markDuration=8ms, pagesWrite=13ms, fsync=38ms, total=66ms] [21:07:25] : [Step 4/5] [2021-11-19 21:07:25,094][INFO ][disco-notifier-worker-#14263%grid-0%][GridClusterStateProcessor] Received state change finish message: ACTIVE [21:07:25] : [Step 4/5] [2021-11-19 21:07:25,093][INFO ][sys-#14245%grid-0%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], err=null, rebalanced=true, wasRebalanced=false] [21:07:25] : [Step 4/5] [2021-11-19 21:07:25,095][INFO ][disco-notifier-worker-#14263%grid-0%][GridClusterStateProcessor] Cluster state was changed from INACTIVE to ACTIVE [21:07:25] : [Step 4/5] [2021-11-19 21:07:25,094][INFO ][disco-notifier-worker-#14382%grid-1%][GridClusterStateProcessor] Received state change finish message: ACTIVE [21:07:25] : [Step 4/5] [2021-11-19 21:07:25,098][INFO ][sys-#14370%grid-1%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], err=null, rebalanced=true, wasRebalanced=false] [21:07:25] : [Step 4/5] [2021-11-19 21:07:25,098][INFO ][disco-notifier-worker-#14382%grid-1%][GridClusterStateProcessor] Cluster state was changed from INACTIVE to ACTIVE [21:07:25] : [Step 4/5] [2021-11-19 21:07:25,101][INFO ][db-checkpoint-thread-#14405%grid-1%][Checkpointer] Checkpoint finished [cpId=fa431305-cf8f-4725-9226-b19bad1718a1, pages=59, markPos=WALPointer [idx=0, fileOff=905438, len=11887], walSegmentsCovered=[], markDuration=18ms, pagesWrite=10ms, fsync=24ms, total=59ms] [21:07:25] : [Step 4/5] [2021-11-19 21:07:25,101][INFO ][sys-#14364%grid-1%][GridCachePartitionExchangeManager] Delay process full message without exchange id (there is exchange in progress) [nodeId=006acc63-081a-4937-b3e0-8ce98c28b000] [21:07:25] : [Step 4/5] [2021-11-19 21:07:25,103][INFO ][sys-#14245%grid-0%][GridCacheProcessor] Finish proxy initialization, cacheName=ignite-sys-cache, localNodeId=006acc63-081a-4937-b3e0-8ce98c28b000 [21:07:25] : [Step 4/5] [2021-11-19 21:07:25,104][INFO ][sys-#14370%grid-1%][GridCacheProcessor] Finish proxy initialization, cacheName=ignite-sys-cache, localNodeId=10fa0197-c2ee-456b-89ab-fbd76f344001 [21:07:25] : [Step 4/5] [2021-11-19 21:07:25,104][INFO ][sys-#14370%grid-1%][GridCacheProcessor] Finish proxy initialization, cacheName=encrypted, localNodeId=10fa0197-c2ee-456b-89ab-fbd76f344001 [21:07:25] : [Step 4/5] [2021-11-19 21:07:25,104][INFO ][sys-#14245%grid-0%][GridCacheProcessor] Finish proxy initialization, cacheName=encrypted, localNodeId=006acc63-081a-4937-b3e0-8ce98c28b000 [21:07:25] : [Step 4/5] [2021-11-19 21:07:25,105][INFO ][sys-#14377%grid-1%][DistributedBaselineConfiguration] Baseline auto-adjust is 'disabled' with timeout='300000' ms [21:07:25] : [Step 4/5] [2021-11-19 21:07:25,106][INFO ][sys-#14377%grid-1%][GridClusterStateProcessor] Successfully performed final activation steps [nodeId=10fa0197-c2ee-456b-89ab-fbd76f344001, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:07:25] : [Step 4/5] [2021-11-19 21:07:25,106][INFO ][exchange-worker-#14268%grid-0%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=2, minorTopVer=1], force=false, evt=DISCOVERY_CUSTOM_EVT, node=10fa0197-c2ee-456b-89ab-fbd76f344001] [21:07:25] : [Step 4/5] [2021-11-19 21:07:25,105][INFO ][sys-#14259%grid-0%][DistributedBaselineConfiguration] Baseline auto-adjust is 'disabled' with timeout='300000' ms [21:07:25] : [Step 4/5] [2021-11-19 21:07:25,106][INFO ][exchange-worker-#14394%grid-1%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=2, minorTopVer=1], force=false, evt=DISCOVERY_CUSTOM_EVT, node=10fa0197-c2ee-456b-89ab-fbd76f344001] [21:07:25] : [Step 4/5] [2021-11-19 21:07:25,106][INFO ][sys-#14370%grid-1%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=10fa0197-c2ee-456b-89ab-fbd76f344001, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=10fa0197-c2ee-456b-89ab-fbd76f344001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637345245091, loc=true, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:07:25] : [Step 4/5] [2021-11-19 21:07:25,106][INFO ][sys-#14245%grid-0%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=006acc63-081a-4937-b3e0-8ce98c28b000, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=10fa0197-c2ee-456b-89ab-fbd76f344001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637345244954, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:07:25] : [Step 4/5] [2021-11-19 21:07:25,109][INFO ][sys-#14370%grid-1%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], stage="Waiting in exchange queue" (12 ms), stage="Exchange parameters initialization" (1 ms), stage="Update caches registry" (12 ms), stage="Start caches" (1 ms), stage="Affinity initialization on cache group start" (3 ms), stage="Determine exchange type" (2 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Restore partition states" (0 ms), stage="After states restored callback" (18 ms), stage="WAL history reservation" (0 ms), stage="Waiting for Full message" (34 ms), stage="Affinity recalculation" (1 ms), stage="Full map updating" (3 ms), stage="Detect lost partitions" (4 ms), stage="Exchange done" (6 ms), stage="Total time" (97 ms)] [21:07:25] : [Step 4/5] [2021-11-19 21:07:25,107][INFO ][sys-#14259%grid-0%][GridClusterStateProcessor] Successfully performed final activation steps [nodeId=006acc63-081a-4937-b3e0-8ce98c28b000, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:07:25] : [Step 4/5] [2021-11-19 21:07:25,111][INFO ][sys-#14370%grid-1%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], stage="Affinity initialization on cache group start [grp=encrypted]" (1 ms) (parent=Affinity initialization on cache group start), stage="Affinity initialization on cache group start [grp=ignite-sys-cache]" (0 ms) (parent=Affinity initialization on cache group start), stage="Affinity centralized initialization (crd) [grp=ignite-sys-cache, crd=false]" (1 ms) (parent=Determine exchange type), stage="Affinity centralized initialization (crd) [grp=encrypted, crd=false]" (0 ms) (parent=Determine exchange type), stage="Restore partition states [grp=ignite-sys-cache]" (0 ms) (parent=Restore partition states), stage="Restore partition states [grp=encrypted]" (0 ms) (parent=Restore partition states), stage="Affinity applying from full message [grp=encrypted]" (1 ms) (parent=Affinity recalculation), stage="Affinity applying from full message [grp=ignite-sys-cache]" (0 ms) (parent=Affinity recalculation)] [21:07:25] : [Step 4/5] [2021-11-19 21:07:25,110][INFO ][sys-#14245%grid-0%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (1 ms), stage="Update caches registry" (12 ms), stage="Start caches" (1 ms), stage="Affinity initialization on cache group start" (3 ms), stage="Determine exchange type" (2 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (2 ms), stage="Restore partition states" (0 ms), stage="After states restored callback" (9 ms), stage="WAL history reservation" (0 ms), stage="Waiting for all single messages" (39 ms), stage="Affinity recalculation (crd)" (0 ms), stage="Collect update counters and create affinity messages" (0 ms), stage="Assign partitions states" (1 ms), stage="Validate partitions states" (0 ms), stage="Ideal affinity diff calculation (enforced)" (2 ms), stage="Apply update counters" (0 ms), stage="Full message preparing" (8 ms), stage="Full message sending" (0 ms), stage="State finish message sending" (2 ms), stage="Detect lost partitions" (7 ms), stage="Exchange done" (8 ms), stage="Total time" (97 ms), Discovery lag=3 ms, Latest started node id=10fa0197-c2ee-456b-89ab-fbd76f344001] [21:07:25] : [Step 4/5] [2021-11-19 21:07:25,115][INFO ][sys-#14245%grid-0%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], stage="Affinity initialization on cache group start [grp=encrypted]" (1 ms) (parent=Affinity initialization on cache group start), stage="Affinity initialization on cache group start [grp=ignite-sys-cache]" (0 ms) (parent=Affinity initialization on cache group start), stage="Affinity centralized initialization (crd) [grp=ignite-sys-cache, crd=true]" (0 ms) (parent=Determine exchange type), stage="Affinity centralized initialization (crd) [grp=encrypted, crd=true]" (0 ms) (parent=Determine exchange type), stage="Restore partition states [grp=ignite-sys-cache]" (0 ms) (parent=Restore partition states), stage="Restore partition states [grp=encrypted]" (0 ms) (parent=Restore partition states), stage="Affinity recalculation (partitions availability) [grp=encrypted]" (2 ms) (parent=Ideal affinity diff calculation (enforced)), stage="Affinity recalculation (partitions availability) [grp=ignite-sys-cache]" (0 ms) (parent=Ideal affinity diff calculation (enforced))] [21:07:25] : [Step 4/5] [2021-11-19 21:07:25,117][INFO ][test-runner-#13880%encryption.EncryptedCacheRestartTest%][root] awaitPartitionMapExchange finished [21:07:25] : [Step 4/5] [21:07:25] >>> Stopping test: EncryptedCacheRestartTest#testCreateEncryptedCache in 15281 ms <<< [21:07:25] : [Step 4/5] [2021-11-19 21:07:25,153][INFO ][main][root] >>> Stopping test: EncryptedCacheRestartTest#testCreateEncryptedCache in 15281 ms <<< [21:07:25] : [Step 4/5] [21:07:25] >>> Heap: 281 MB used / 1913 MB commited / 1913 MB max <<< [21:07:25] : [Step 4/5] [2021-11-19 21:07:25,154][INFO ][main][root] >>> Heap: 281 MB used / 1913 MB commited / 1913 MB max <<< [21:07:25] : [Step 4/5] [21:07:25] >>> Non-Heap: 153 MB used / 167 MB commited / 0 MB max <<< [21:07:25] : [Step 4/5] [2021-11-19 21:07:25,154][INFO ][main][root] >>> Non-Heap: 153 MB used / 167 MB commited / 0 MB max <<< [21:07:25] : [Step 4/5] [2021-11-19 21:07:25,154][INFO ][main][root] >>> Stopping grid [name=grid-1, id=10fa0197-c2ee-456b-89ab-fbd76f344001] [21:07:25] : [Step 4/5] [2021-11-19 21:07:25,163][INFO ][db-checkpoint-thread-#14405%grid-1%][Checkpointer] Skipping checkpoint (no pages were modified) [checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=1ms, reason='timeout'] [21:07:25] : [Step 4/5] [2021-11-19 21:07:25,167][INFO ][db-checkpoint-thread-#14405%grid-1%][Checkpointer] Skipping checkpoint (no pages were modified) [checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=1ms, checkpointLockHoldTime=2ms, reason='timeout'] [21:07:25] : [Step 4/5] [2021-11-19 21:07:25,173][INFO ][tcp-disco-sock-reader-[006acc63 127.0.0.1:37207]-#752%grid-1%-#14387%grid-1%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:37207, rmtPort=37207, rmtNodeId=006acc63-081a-4937-b3e0-8ce98c28b000] [21:07:25] : [Step 4/5] [2021-11-19 21:07:25,174][INFO ][disco-event-worker-#14267%grid-0%][GridDiscoveryManager] Node left topology: TcpDiscoveryNode [id=10fa0197-c2ee-456b-89ab-fbd76f344001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637345244954, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false] [21:07:25] : [Step 4/5] [2021-11-19 21:07:25,175][INFO ][main][GridCacheProcessor] Stopped cache [cacheName=encrypted] [21:07:25] : [Step 4/5] [2021-11-19 21:07:25,176][INFO ][main][GridCacheProcessor] Stopped cache [cacheName=ignite-sys-cache] [21:07:25] : [Step 4/5] [2021-11-19 21:07:25,176][INFO ][disco-event-worker-#14267%grid-0%][GridDiscoveryManager] Topology snapshot [ver=3, locNode=006acc63, servers=1, clients=0, state=ACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=006acc63-081a-4937-b3e0-8ce98c28b000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:07:25] : [Step 4/5] [2021-11-19 21:07:25,177][INFO ][disco-event-worker-#14267%grid-0%][GridDiscoveryManager] ^-- Baseline [id=0, size=2, online=1, offline=1] [21:07:25] : [Step 4/5] [2021-11-19 21:07:25,180][INFO ][exchange-worker-#14268%grid-0%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], crd=true, evt=NODE_LEFT, evtNode=10fa0197-c2ee-456b-89ab-fbd76f344001, customEvt=null, allowMerge=false, exchangeFreeSwitch=true] [21:07:25] : [Step 4/5] [2021-11-19 21:07:25,181][INFO ][exchange-worker-#14268%grid-0%][GridAffinityAssignmentCache] Local node affinity assignment distribution is not ideal [cache=encrypted, expectedPrimary=1024.00, actualPrimary=502, expectedBackups=0.00, actualBackups=0, warningThreshold=50.00%] [21:07:25] : [Step 4/5] [2021-11-19 21:07:25,182][INFO ][exchange-worker-#14268%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:07:25] : [Step 4/5] [2021-11-19 21:07:25,184][INFO ][exchange-worker-#14268%grid-0%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], err=null, rebalanced=true, wasRebalanced=true] [21:07:25] : [Step 4/5] [2021-11-19 21:07:25,184][INFO ][main][FilePageStoreManager] Cleanup cache stores [total=4, left=0, cleanFiles=false] [21:07:25] : [Step 4/5] [2021-11-19 21:07:25,188][INFO ][main][GridDeploymentLocalStore] Removed undeployed class: GridDeployment [ts=1637345245091, depMode=SHARED, clsLdr=IsolatedClassLoader{roleName='test'}, clsLdrId=1d25d593d71-10fa0197-c2ee-456b-89ab-fbd76f344001, userVer=0, loc=true, sampleClsName=org.apache.ignite.internal.processors.cache.distributed.dht.preloader.IgniteDhtPartitionCountersMap2, pendingUndeploy=false, undeployed=true, usage=0] [21:07:25]W: [org.apache.ignite:ignite-core] [2021-11-19 21:07:25,188][WARN ][sys-#14248%grid-0%][GridDhtPartitionTopologyImpl] Detected lost partitions [grp=encrypted, parts=[0, 2, 4, 6-7, 10-11, 14, 17, 21, 24-30, 32, 37, 40, 44, 47-52, 54, 57, 59, 62-64, 67-68, 74-75, 78, 81, 87-88, 91, 97, 99, 101-102, 104-107, 113-114, 116, 118, 120, 122, 124, 135-136, 138, 140-145, 147, 149-152, 154-156, 159-160, 162-164, 169, 172, 175-177, 180, 184-187, 190-191, 194, 196-202, 204-205, 209-210, 212, 214, 216, 219-224, 226, 229-232, 237, 239, 241, 243-245, 247, 249-251, 255, 257, 261, 265, 269, 272-273, 276-277, 281-282, 285, 287, 289-291, 293-297, 299, 301-304, 306, 308-309, 311-312, 315-317, 319, 322, 325-326, 328-330, 336, 339, 341, 344-346, 350, 352-354, 357-361, 363, 366-367, 371-373, 376-380, 383, 385, 387-388, 390, 392, 395-397, 400, 402, 405, 408-411, 416, 420, 422, 424-425, 429, 433, 435-438, 440-441, 445-446, 450, 452-453, 455-456, 458, 460, 462-463, 465-468, 470, 474-475, 480, 488, 490-492, 495, 497, 499-512, 516, 525, 527-531, 535, 537-538, 541-542, 545-546, 548-552, 554-555, 558, 562-564, 567-569, 572, 574, 579-580, 582-585, 587, 590-591, 594, 596, 600, 602, 604, 607-614, 617-620, 623-624, 627-629, 632-633, 636, 638, 640-642, 645-646, 648-649, 657-662, 664-665, 668-672, 677-678, 682-684, 686, 689, 692-693, 695-697, 699, 706-707, 709-710, 712-714, 716-717, 719-721, 723-728, 730-732, 734-735, 739, 742, 746, 749-750, 752, 754, 756, 762, 768-770, 772-775, 778, 780, 783-787, 789-791, 793, 796, 798-801, 803, 806, 809-812, 814, 816-817, 819, 822-825, 827-829, 832-833, 836-837, 839-840, 846, 848-851, 853-854, 857-858, 860, 863-864, 866, 868-871, 873-875, 877-878, 884, 888-889, 896-897, 900, 905-907, 914-915, 917, 919-920, 923-925, 931-933, 936, 940, 942, 944-945, 948, 950-951, 954, 956-958, 962, 965-970, 972, 975-976, 978-980, 983, 985, 988, 990, 993-994, 997-998, 1000, 1003-1004, 1007, 1009, 1014, 1016, 1018-1019], topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0]] [21:07:25] : [Step 4/5] [2021-11-19 21:07:25,195][INFO ][exchange-worker-#14268%grid-0%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=006acc63-081a-4937-b3e0-8ce98c28b000, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], evt=NODE_LEFT, evtNode=TcpDiscoveryNode [id=10fa0197-c2ee-456b-89ab-fbd76f344001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637345244954, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0]] [21:07:25] : [Step 4/5] [2021-11-19 21:07:25,197][INFO ][exchange-worker-#14268%grid-0%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (0 ms), stage="Determine exchange type" (1 ms), stage="Preloading notification" (0 ms), stage="After states restored callback" (0 ms), stage="WAL history reservation" (0 ms), stage="Finalize update counters" (0 ms), stage="Detect lost partitions" (10 ms), stage="Exchange done" (2 ms), stage="Total time" (13 ms)] [21:07:25] : [Step 4/5] [2021-11-19 21:07:25,198][INFO ][main][IgniteKernal%grid-1] [21:07:25] : [Step 4/5] [21:07:25] : [Step 4/5] >>> +------------------------------------------------------+ [21:07:25] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV stopped OK [21:07:25] : [Step 4/5] >>> +------------------------------------------------------+ [21:07:25] : [Step 4/5] >>> Ignite instance name: grid-1 [21:07:25] : [Step 4/5] >>> Grid uptime: 00:00:00.179 [21:07:25] : [Step 4/5] [21:07:25] : [Step 4/5] [21:07:25] : [Step 4/5] [2021-11-19 21:07:25,199][INFO ][exchange-worker-#14268%grid-0%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], stage="Affinity initialization (exchange-free switch on fully-rebalanced topology) [grp=encrypted]" (1 ms) (parent=Determine exchange type), stage="Affinity initialization (exchange-free switch on fully-rebalanced topology) [grp=ignite-sys-cache]" (0 ms) (parent=Determine exchange type)] [21:07:25] : [Step 4/5] [2021-11-19 21:07:25,199][INFO ][main][root] >>> Stopping grid [name=grid-0, id=006acc63-081a-4937-b3e0-8ce98c28b000] [21:07:25] : [Step 4/5] [2021-11-19 21:07:25,200][INFO ][exchange-worker-#14268%grid-0%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], crd=true] [21:07:25] : [Step 4/5] [2021-11-19 21:07:25,203][INFO ][exchange-worker-#14268%grid-0%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=3, minorTopVer=0], force=false, evt=NODE_LEFT, node=10fa0197-c2ee-456b-89ab-fbd76f344001] [21:07:25] : [Step 4/5] [2021-11-19 21:07:25,209][INFO ][db-checkpoint-thread-#14399%grid-0%][Checkpointer] Skipping checkpoint (no pages were modified) [checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=1ms, checkpointLockHoldTime=1ms, reason='timeout'] [21:07:25] : [Step 4/5] [2021-11-19 21:07:25,214][INFO ][tcp-disco-sock-reader-[10fa0197 127.0.0.1:37391]-#753%grid-0%-#14388%grid-0%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:37391, rmtPort=37391, rmtNodeId=10fa0197-c2ee-456b-89ab-fbd76f344001] [21:07:25] : [Step 4/5] [2021-11-19 21:07:25,217][INFO ][main][GridCacheProcessor] Stopped cache [cacheName=encrypted] [21:07:25] : [Step 4/5] [2021-11-19 21:07:25,218][INFO ][main][GridCacheProcessor] Stopped cache [cacheName=ignite-sys-cache] [21:07:25] : [Step 4/5] [2021-11-19 21:07:25,225][INFO ][main][FilePageStoreManager] Cleanup cache stores [total=4, left=0, cleanFiles=false] [21:07:25] : [Step 4/5] [2021-11-19 21:07:25,229][INFO ][main][GridDeploymentLocalStore] Removed undeployed class: GridDeployment [ts=1637345245071, depMode=SHARED, clsLdr=IsolatedClassLoader{roleName='test'}, clsLdrId=fc25d593d71-006acc63-081a-4937-b3e0-8ce98c28b000, userVer=0, loc=true, sampleClsName=org.apache.ignite.internal.processors.cache.distributed.dht.preloader.GridDhtPartitionMap, pendingUndeploy=false, undeployed=true, usage=0] [21:07:25] : [Step 4/5] [2021-11-19 21:07:25,244][INFO ][main][IgniteKernal%grid-0] [21:07:25] : [Step 4/5] [21:07:25] : [Step 4/5] >>> +------------------------------------------------------+ [21:07:25] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV stopped OK [21:07:25] : [Step 4/5] >>> +------------------------------------------------------+ [21:07:25] : [Step 4/5] >>> Ignite instance name: grid-0 [21:07:25] : [Step 4/5] >>> Grid uptime: 00:00:01.964 [21:07:25] : [Step 4/5] [21:07:25] : [Step 4/5] [21:07:25] : [Step 4/5] [21:07:25] >>> Stopping test class: EncryptedCacheRestartTest <<< [21:07:25] : [Step 4/5] [2021-11-19 21:07:25,551][INFO ][main][root] >>> Stopping test class: EncryptedCacheRestartTest <<< [21:07:25] : [Step 4/5] [21:07:25] >>> Starting test class: EncryptedCachePreconfiguredRestartTest <<< [21:07:25] : [Step 4/5] [2021-11-19 21:07:25,553][INFO ][main][root] >>> Starting test class: EncryptedCachePreconfiguredRestartTest <<< [21:07:25] : [Step 4/5] Running org.apache.ignite.internal.encryption.EncryptedCachePreconfiguredRestartTest [21:07:25]i: [Step 4/5] ##teamcity[importData type='surefire' path='/opt/buildagent/temp/buildTmp/ignite-tools-junit-reports1777670380320881607/test-org.apache.ignite.testsuites.IgniteBasicWithPersistenceTestSuite1637345229870.xml'] [21:07:25] : [Step 4/5] Importing data from '/opt/buildagent/temp/buildTmp/ignite-tools-junit-reports1777670380320881607/test-org.apache.ignite.testsuites.IgniteBasicWithPersistenceTestSuite1637345229870.xml' (269 B) with 'surefire' processor [21:07:25] : [Step 4/5] [21:07:25] >>> Starting test: EncryptedCachePreconfiguredRestartTest#testCreateEncryptedCache <<< [21:07:25] : [Step 4/5] [2021-11-19 21:07:25,567][INFO ][main][root] >>> Starting test: EncryptedCachePreconfiguredRestartTest#testCreateEncryptedCache <<< [21:07:25] : [Step 4/5] [21:07:25] >>> Heap: 288 MB used / 1913 MB commited / 1913 MB max <<< [21:07:25] : [Step 4/5] [2021-11-19 21:07:25,568][INFO ][main][root] >>> Heap: 288 MB used / 1913 MB commited / 1913 MB max <<< [21:07:25] : [Step 4/5] [21:07:25] >>> Non-Heap: 153 MB used / 167 MB commited / 0 MB max <<< [21:07:25] : [Step 4/5] [2021-11-19 21:07:25,568][INFO ][main][root] >>> Non-Heap: 153 MB used / 167 MB commited / 0 MB max <<< [21:07:25]W: [org.apache.ignite:ignite-core] [2021-11-19 21:07:25,577][WARN ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][G] Ignite work directory is not provided, automatically resolved to: /opt/buildagent/work/7bc1c54bc719b67c/work [21:07:25] : [Step 4/5] [2021-11-19 21:07:25,579][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][IgniteKernal%grid-0] [21:07:25] : [Step 4/5] [21:07:25] : [Step 4/5] >>> __________ ________________ [21:07:25] : [Step 4/5] >>> / _/ ___/ |/ / _/_ __/ __/ [21:07:25] : [Step 4/5] >>> _/ // (7 7 // / / / / _/ [21:07:25] : [Step 4/5] >>> /___/\___/_/|_/___/ /_/ /___/ [21:07:25] : [Step 4/5] >>> [21:07:25] : [Step 4/5] >>> ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:07:25] : [Step 4/5] >>> 2021 Copyright(C) Apache Software Foundation [21:07:25] : [Step 4/5] >>> [21:07:25] : [Step 4/5] >>> Ignite documentation: http://ignite.apache.org [21:07:25] : [Step 4/5] [21:07:25] : [Step 4/5] [2021-11-19 21:07:25,580][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][IgniteKernal%grid-0] Config URL: n/a [21:07:25] : [Step 4/5] [2021-11-19 21:07:25,580][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][IgniteKernal%grid-0] IgniteConfiguration [igniteInstanceName=grid-0, pubPoolSize=24, svcPoolSize=24, callbackPoolSize=24, stripedPoolSize=24, sysPoolSize=24, mgmtPoolSize=4, dataStreamerPoolSize=24, utilityCachePoolSize=24, utilityCacheKeepAliveTime=60000, p2pPoolSize=2, qryPoolSize=24, buildIdxPoolSize=4, igniteHome=/opt/buildagent/work/7bc1c54bc719b67c, igniteWorkDir=/opt/buildagent/work/7bc1c54bc719b67c/work, mbeanSrv=com.sun.jmx.mbeanserver.JmxMBeanServer@6fe85038, nodeId=00030eb5-84b3-4665-8392-0c8c650f4000, marsh=BinaryMarshaller [], marshLocJobs=false, daemon=false, p2pEnabled=true, netTimeout=10000, netCompressionLevel=1, sndRetryDelay=1000, sndRetryCnt=3, metricsHistSize=10000, metricsUpdateFreq=1000, metricsExpTime=9223372036854775807, discoSpi=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=0, ackTimeout=0, marsh=null, reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], segPlc=STOP, segResolveAttempts=2, waitForSegOnStart=true, allResolversPassReq=true, segChkFreq=10000, commSpi=TcpCommunicationSpi [connectGate=org.apache.ignite.spi.communication.tcp.internal.ConnectGateway@21ff405, ctxInitLatch=java.util.concurrent.CountDownLatch@c6948c0[Count = 1], stopping=false, clientPool=null, nioSrvWrapper=null, stateProvider=null], evtSpi=MemoryEventStorageSpi [expireAgeMs=9223372036854775807, expireCnt=10000, filter=null], colSpi=NoopCollisionSpi [], deploySpi=LocalDeploymentSpi [], indexingSpi=org.apache.ignite.spi.indexing.noop.NoopIndexingSpi@121382dd, addrRslvr=null, encryptionSpi=org.apache.ignite.spi.encryption.keystore.KeystoreEncryptionSpi@17d44888, tracingSpi=org.apache.ignite.spi.tracing.NoopTracingSpi@7ac882ef, clientMode=false, rebalanceThreadPoolSize=4, rebalanceTimeout=10000, rebalanceBatchesPrefetchCnt=3, rebalanceThrottle=0, rebalanceBatchSize=524288, txCfg=TransactionConfiguration [txSerEnabled=false, dfltIsolation=REPEATABLE_READ, dfltConcurrency=PESSIMISTIC, dfltTxTimeout=0, txTimeoutOnPartitionMapExchange=0, deadlockTimeout=10000, pessimisticTxLogSize=0, pessimisticTxLogLinger=10000, tmLookupClsName=null, txManagerFactory=null, useJtaSync=false], cacheSanityCheckEnabled=true, discoStartupDelay=60000, deployMode=SHARED, p2pMissedCacheSize=100, locHost=127.0.0.1, timeSrvPortBase=31100, timeSrvPortRange=100, failureDetectionTimeout=10000, sysWorkerBlockedTimeout=null, clientFailureDetectionTimeout=10000, metricsLogFreq=0, connectorCfg=null, odbcCfg=null, warmupClos=null, atomicCfg=AtomicConfiguration [seqReserveSize=1000, cacheMode=PARTITIONED, backups=1, aff=null, grpName=null], classLdr=null, sslCtxFactory=null, platformCfg=null, binaryCfg=null, memCfg=null, pstCfg=null, dsCfg=DataStorageConfiguration [sysRegionInitSize=41943040, sysRegionMaxSize=104857600, pageSize=4096, concLvl=0, dfltDataRegConf=DataRegionConfiguration [name=default, maxSize=10485760, initSize=268435456, swapPath=null, pageEvictionMode=DISABLED, pageReplacementMode=CLOCK, evictionThreshold=0.9, emptyPagesPoolSize=100, metricsEnabled=false, metricsSubIntervalCount=5, metricsRateTimeInterval=60000, persistenceEnabled=true, checkpointPageBufSize=0, lazyMemoryAllocation=true, warmUpCfg=null], dataRegions=null, storagePath=null, checkpointFreq=180000, lockWaitTime=10000, checkpointThreads=4, checkpointWriteOrder=SEQUENTIAL, walHistSize=20, maxWalArchiveSize=1073741824, walSegments=10, walSegmentSize=67108864, walPath=db/wal, walArchivePath=db/wal/archive, cdcWalPath=db/wal/cdc, cdcEnabled=false, metricsEnabled=false, walMode=FSYNC, walTlbSize=131072, walBuffSize=0, walFlushFreq=2000, walFsyncDelay=1000, walRecordIterBuffSize=67108864, alwaysWriteFullPages=false, fileIOFactory=org.apache.ignite.internal.processors.cache.persistence.file.AsyncFileIOFactory@6172ff8b, metricsSubIntervalCnt=5, metricsRateTimeInterval=60000, walAutoArchiveAfterInactivity=-1, walForceArchiveTimeout=-1, writeThrottlingEnabled=false, walCompactionEnabled=false, walCompactionLevel=1, checkpointReadLockTimeout=null, walPageCompression=DISABLED, walPageCompressionLevel=null, dfltWarmUpCfg=null, encCfg=org.apache.ignite.configuration.EncryptionConfiguration@1e661554, defragmentationThreadPoolSize=4, minWalArchiveSize=-1], snapshotPath=snapshots, activeOnStart=true, activeOnStartPropSetFlag=false, autoActivation=true, autoActivationPropSetFlag=false, clusterStateOnStart=null, sqlConnCfg=null, cliConnCfg=ClientConnectorConfiguration [host=null, port=10800, portRange=100, sockSndBufSize=0, sockRcvBufSize=0, tcpNoDelay=true, maxOpenCursorsPerConn=128, threadPoolSize=24, selectorCnt=12, idleTimeout=0, handshakeTimeout=10000, jdbcEnabled=true, odbcEnabled=true, thinCliEnabled=true, sslEnabled=false, useIgniteSslCtxFactory=true, sslClientAuth=false, sslCtxFactory=null, thinCliCfg=ThinClientConfiguration [maxActiveTxPerConn=100, maxActiveComputeTasksPerConn=0]], mvccVacuumThreadCnt=2, mvccVacuumFreq=5000, authEnabled=false, failureHnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]], commFailureRslvr=null, sqlCfg=SqlConfiguration [longQryWarnTimeout=3000, dfltQryTimeout=0, sqlQryHistSize=1000, validationEnabled=false], asyncContinuationExecutor=null] [21:07:25] : [Step 4/5] [2021-11-19 21:07:25,588][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][IgniteKernal%grid-0] Daemon mode: off [21:07:25] : [Step 4/5] [2021-11-19 21:07:25,588][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][IgniteKernal%grid-0] OS: Linux 4.15.0-151-generic amd64 [21:07:25] : [Step 4/5] [2021-11-19 21:07:25,588][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][IgniteKernal%grid-0] OS user: teamcity [21:07:25] : [Step 4/5] [2021-11-19 21:07:25,588][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][IgniteKernal%grid-0] PID: 16724 [21:07:25] : [Step 4/5] [2021-11-19 21:07:25,589][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][IgniteKernal%grid-0] Language runtime: Java Platform API Specification ver. 1.8 [21:07:25] : [Step 4/5] [2021-11-19 21:07:25,589][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][IgniteKernal%grid-0] VM information: Java(TM) SE Runtime Environment 1.8.0_261-b12 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 25.261-b12 [21:07:25] : [Step 4/5] [2021-11-19 21:07:25,589][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][IgniteKernal%grid-0] VM total memory: 1.9GB [21:07:25] : [Step 4/5] [2021-11-19 21:07:25,590][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][IgniteKernal%grid-0] Remote Management [restart: off, REST: off, JMX (remote: off)] [21:07:25] : [Step 4/5] [2021-11-19 21:07:25,590][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][IgniteKernal%grid-0] Logger: GridTestLog4jLogger [quiet=false, config=null] [21:07:25] : [Step 4/5] [2021-11-19 21:07:25,590][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][IgniteKernal%grid-0] IGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c [21:07:25] : [Step 4/5] [2021-11-19 21:07:25,590][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][IgniteKernal%grid-0] VM arguments: [-DIGNITE_DUMP_THREADS_ON_FAILURE=false, -DMono=/usr/bin/mono-sgen, -DMono4.0_x64=/usr/lib/mono/4.0, -DMono4.5_x64=/usr/lib/mono/4.5, -DMonoVersion=6.12.0.90, -DSKIP_BUILD=false, -Dagent.home.dir=/opt/buildagent, -Dagent.name=aitc-lin02_03, -Dagent.ownPort=9090, -Dagent.work.dir=/opt/buildagent/work, -Dbuild.number=95, -Dbuild.vcs.number=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.1=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.GitHubApacheIgnite=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dclassworlds.conf=/opt/buildagent/temp/buildTmp/teamcity.m2.conf, -Dcom.jetbrains.maven.watcher.report.file=/opt/buildagent/temp/buildTmp/maven-build-info.xml, -Djava.io.tmpdir=/opt/buildagent/temp/buildTmp, -Dmaven.home=/opt/buildagent/tools/maven3_6, -Dmaven.multiModuleProjectDirectory=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.agent.cpuBenchmark=457, -Dteamcity.agent.dotnet.agent_url=http://localhost:9090/RPC2, -Dteamcity.agent.dotnet.build_id=6278078, -Dteamcity.auth.password=*******, -Dteamcity.auth.userId=TeamCityBuildId=6278078, -Dteamcity.build.changedFiles.file=/opt/buildagent/temp/buildTmp/changedFiles6342607772318147725.txt, -Dteamcity.build.checkoutDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.build.id=6278078, -Dteamcity.build.properties.file=/opt/buildagent/temp/buildTmp/teamcity.build5164517880467851002.properties, -Dteamcity.build.tempDir=/opt/buildagent/temp/buildTmp, -Dteamcity.build.workingDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.buildConfName=Basic 3, -Dteamcity.buildType.id=IgniteTests24Java8_Basic3, -Dteamcity.configuration.properties.file=/opt/buildagent/temp/buildTmp/teamcity.config5591980786735343870.properties, -Dteamcity.maven.userSettings.path=/opt/buildagent/temp/buildTmp/maven_settings_585072866407032347.xml, -Dteamcity.maven.watcher.home=/opt/buildagent/plugins/mavenPlugin/maven-watcher-jdk16, -Dteamcity.projectName=Ignite Tests 2.x (JDK 8/11), -Dteamcity.runner.properties.file=/opt/buildagent/temp/buildTmp/teamcity.runner9098465561618137420.properties, -Dteamcity.tests.recentlyFailedTests.file=/opt/buildagent/temp/buildTmp/testsToRunFirst3891775683130404069.txt, -Dteamcity.version=2021.2 (build 99542), -ea, -Xms2g, -Xmx2g, -XX:+HeapDumpOnOutOfMemoryError, -DIGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_TEST_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_UPDATE_NOTIFIER=false, -DIGNITE_NO_DISCO_ORDER=true, -DIGNITE_PERFORMANCE_SUGGESTIONS_DISABLED=true, -Djava.net.preferIPv4Stack=true, -DTEST_SCALE_FACTOR=1.0, -DIGNITE_TEST_PROP_LOG4J_FILE=log4j-tc-test.xml, -DIGNITE_QUIET=false, -DIGNITE_MARSHAL_BUFFERS_RECHECK=1000, -Dmaven.repo.local=/opt/buildagent/.m2/repository] [21:07:25] : [Step 4/5] [2021-11-19 21:07:25,594][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][IgniteKernal%grid-0] System cache's DataRegion size is configured to 40 MB. Use DataStorageConfiguration.systemRegionInitialSize property to change the setting. [21:07:25] : [Step 4/5] [2021-11-19 21:07:25,595][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][IgniteKernal%grid-0] Configured caches [in 'sysMemPlc' dataRegion: ['ignite-sys-cache'], in 'default' dataRegion: ['encrypted']] [21:07:25]W: [org.apache.ignite:ignite-core] [2021-11-19 21:07:25,595][WARN ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][IgniteKernal%grid-0] Peer class loading is enabled (disable it in production for performance and deployment consistency reasons) [21:07:25] : [Step 4/5] [2021-11-19 21:07:25,595][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][IgniteKernal%grid-0] 3-rd party licenses can be found at: /opt/buildagent/work/7bc1c54bc719b67c/libs/licenses [21:07:25] : [Step 4/5] [2021-11-19 21:07:25,599][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][IgnitePluginProcessor] Configured plugins: [21:07:25] : [Step 4/5] [2021-11-19 21:07:25,599][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][IgnitePluginProcessor] ^-- StanByClusterTestProvider 1.0 [21:07:25] : [Step 4/5] [2021-11-19 21:07:25,599][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][IgnitePluginProcessor] ^-- null [21:07:25] : [Step 4/5] [2021-11-19 21:07:25,600][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][IgnitePluginProcessor] [21:07:25] : [Step 4/5] [2021-11-19 21:07:25,600][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][IgnitePluginProcessor] ^-- PageMemory tracker plugin 1.0 [21:07:25] : [Step 4/5] [2021-11-19 21:07:25,600][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][IgnitePluginProcessor] ^-- null [21:07:25] : [Step 4/5] [2021-11-19 21:07:25,600][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][IgnitePluginProcessor] [21:07:25] : [Step 4/5] [2021-11-19 21:07:25,600][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][IgnitePluginProcessor] ^-- TestDistibutedConfigurationPlugin 1.0 [21:07:25] : [Step 4/5] [2021-11-19 21:07:25,601][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][IgnitePluginProcessor] ^-- null [21:07:25] : [Step 4/5] [2021-11-19 21:07:25,601][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][IgnitePluginProcessor] [21:07:25] : [Step 4/5] [2021-11-19 21:07:25,601][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][IgnitePluginProcessor] ^-- NodeValidationPluginProvider 1.0 [21:07:25] : [Step 4/5] [2021-11-19 21:07:25,601][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][IgnitePluginProcessor] ^-- null [21:07:25] : [Step 4/5] [2021-11-19 21:07:25,602][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][IgnitePluginProcessor] [21:07:25] : [Step 4/5] [2021-11-19 21:07:25,602][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][FailureProcessor] Configured failure handler: [hnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]]] [21:07:25]W: [org.apache.ignite:ignite-core] [2021-11-19 21:07:25,620][WARN ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][TcpCommunicationSpi] Message queue limit is set to 0 which may lead to potential OOMEs when running cache operations in FULL_ASYNC or PRIMARY_SYNC modes due to message queues growth on sender and receiver sides. [21:07:25] : [Step 4/5] [2021-11-19 21:07:25,619][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][TcpCommunicationSpi] Successfully bound communication NIO server to TCP port [port=45170, locHost=/127.0.0.1, selectorsCnt=12, selectorSpins=0, pairedConn=false] [21:07:25] : [Step 4/5] [2021-11-19 21:07:25,625][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][GridCollisionManager] Collision resolution is disabled (all jobs will be activated upon arrival). [21:07:25] : [Step 4/5] [2021-11-19 21:07:25,625][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][IgniteKernal%grid-0] Security status [authentication=off, sandbox=off, tls/ssl=off] [21:07:25] : [Step 4/5] [2021-11-19 21:07:25,680][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:07:25] : [Step 4/5] Surefire report watcher [21:07:25] : [Surefire report watcher] Watching paths: [21:07:25] : [Surefire report watcher] /opt/buildagent/temp/buildTmp/ignite-tools-junit-reports1777670380320881607/test-org.apache.ignite.testsuites.IgniteBasicWithPersistenceTestSuite1637345229870.xml [21:07:25]i: [Step 4/5] org.apache.ignite.testsuites.IgniteBasicWithPersistenceTestSuite [21:07:25]i: [org.apache.ignite.testsuites.IgniteBasicWithPersistenceTestSuite] org.apache.ignite.internal.encryption.EncryptedCacheRestartTest.testCreateEncryptedCache [21:07:25] : [Step 4/5] [2021-11-19 21:07:25,801][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][MaintenanceProcessor] Resolved store directory for node persistent data: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0 [21:07:25] : [Step 4/5] [2021-11-19 21:07:25,803][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][CacheObjectBinaryProcessorImpl] Resolved directory for serialized binary metadata: /opt/buildagent/work/7bc1c54bc719b67c/work/db/binary_meta/grid_0 [21:07:25] : [Step 4/5] [2021-11-19 21:07:25,813][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0 [21:07:25] : [Step 4/5] [2021-11-19 21:07:25,813][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][FileWriteAheadLogManager] Resolved write ahead log work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0 [21:07:25] : [Step 4/5] [2021-11-19 21:07:25,814][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][FileWriteAheadLogManager] Resolved write ahead log archive directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0 [21:07:26]W: [org.apache.ignite:ignite-core] [2021-11-19 21:07:26,304][WARN ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][GridCacheDatabaseSharedManager] DataRegion maxSize=10.5 MB is smaller than defaultInitialSize=268.4 MB, setting initialSize to 10.5 MB [21:07:26] : [Step 4/5] [2021-11-19 21:07:26,303][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000000.wal [21:07:26] : [Step 4/5] [2021-11-19 21:07:26,308][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][GridCacheDatabaseSharedManager] Configured data regions initialized successfully [total=5] [21:07:26] : [Step 4/5] [2021-11-19 21:07:26,311][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][IgniteSnapshotManager] Resolved snapshot work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/snapshots [21:07:26] : [Step 4/5] [2021-11-19 21:07:26,312][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][IgniteSnapshotManager] Resolved temp directory for snapshot creation: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0/snp [21:07:26] : [Step 4/5] [2021-11-19 21:07:26,314][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][ClientListenerProcessor] Client connector processor has started on TCP port 10800 [21:07:26] : [Step 4/5] [2021-11-19 21:07:26,320][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][IgniteKernal%grid-0] Non-loopback local IPs: 172.17.0.4 [21:07:26] : [Step 4/5] [2021-11-19 21:07:26,320][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][IgniteKernal%grid-0] Enabled local MACs: 0242AC110004 [21:07:26] : [Step 4/5] [2021-11-19 21:07:26,323][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:07:26] : [Step 4/5] [2021-11-19 21:07:26,326][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:07:26] : [Step 4/5] [2021-11-19 21:07:26,326][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:07:26] : [Step 4/5] [2021-11-19 21:07:26,328][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][GridCacheDatabaseSharedManager] Applying lost metastore updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:07:26] : [Step 4/5] [2021-11-19 21:07:26,332][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=0 ms] [21:07:26] : [Step 4/5] [2021-11-19 21:07:26,332][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][GridCacheProcessor] Restoring partition state for local groups. [21:07:26] : [Step 4/5] [2021-11-19 21:07:26,332][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=0, partitionsProcessed=0, time=0ms] [21:07:26] : [Step 4/5] [2021-11-19 21:07:26,333][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][GridEncryptionManager] Encryption keys loaded from metastore. [grps=, masterKeyName=ignite.master.key] [21:07:26] : [Step 4/5] [2021-11-19 21:07:26,338][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][ClusterProcessor] Cluster ID and tag has been read from metastorage: null [21:07:26] : [Step 4/5] [2021-11-19 21:07:26,338][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][IgniteClusterImpl] Shutdown policy was updated [oldVal=null, newVal=null] [21:07:26] : [Step 4/5] [2021-11-19 21:07:26,338][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][GridCacheDatabaseSharedManager] Checkpoint frequency deviation changed [oldVal=null, newVal=null] [21:07:26] : [Step 4/5] [2021-11-19 21:07:26,348][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][FilePageStoreManager] Cleanup cache stores [total=1, left=0, cleanFiles=false] [21:07:26] : [Step 4/5] [2021-11-19 21:07:26,350][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:07:26] : [Step 4/5] [2021-11-19 21:07:26,351][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:07:26] : [Step 4/5] [2021-11-19 21:07:26,353][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:07:26] : [Step 4/5] [2021-11-19 21:07:26,353][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][GridCacheDatabaseSharedManager] Data Regions Started: 5 [21:07:26] : [Step 4/5] [2021-11-19 21:07:26,354][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][GridCacheDatabaseSharedManager] ^-- sysMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:07:26] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:07:26] : [Step 4/5] ^-- default region [type=default, persistence=true, lazyAlloc=true, [21:07:26] : [Step 4/5] ... initCfg=10MB, maxCfg=10MB, usedRam=0MB, freeRam=100%, allocRam=0MB, allocTotal=0MB] [21:07:26] : [Step 4/5] ^-- metastoreMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:07:26] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:07:26] : [Step 4/5] ^-- TxLog region [type=internal, persistence=true, lazyAlloc=false, [21:07:26] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:07:26] : [Step 4/5] ^-- volatileDsMemPlc region [type=user, persistence=false, lazyAlloc=true, [21:07:26] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB] [21:07:26] : [Step 4/5] ^-- Ignite persistence [used=0MB] [21:07:26] : [Step 4/5] [21:07:26] : [Step 4/5] [2021-11-19 21:07:26,355][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][GridCacheDatabaseSharedManager] Starting binary memory restore for: [-2100569601, 1613773252] [21:07:26] : [Step 4/5] [2021-11-19 21:07:26,424][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:07:26] : [Step 4/5] [2021-11-19 21:07:26,424][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:07:26] : [Step 4/5] [2021-11-19 21:07:26,426][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000000.wal, offset=0, ver=2] [21:07:26] : [Step 4/5] [2021-11-19 21:07:26,568][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][GridCacheProcessor] Started cache in recovery mode [name=ignite-sys-cache, id=-2100569601, dataRegionName=sysMemPlc, mode=REPLICATED, atomicity=TRANSACTIONAL, backups=2147483647, mvcc=false] [21:07:26] : [Step 4/5] [2021-11-19 21:07:26,569][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][PageMemoryImpl] Started page memory [memoryAllocated=24.0 MiB, pages=5952, tableSize=474.2 KiB, replacementSize=768 B, checkpointBuffer=10.0 MiB] [21:07:26] : [Step 4/5] [2021-11-19 21:07:26,571][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][GridCacheProcessor] Started cache in recovery mode [name=encrypted, id=1613773252, dataRegionName=default, mode=PARTITIONED, atomicity=ATOMIC, backups=0, mvcc=false] [21:07:26] : [Step 4/5] [2021-11-19 21:07:26,572][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][GridCacheDatabaseSharedManager] Binary recovery performed in 217 ms. [21:07:26] : [Step 4/5] [2021-11-19 21:07:26,572][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:07:26] : [Step 4/5] [2021-11-19 21:07:26,573][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][GridCacheDatabaseSharedManager] Applying lost cache updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:07:26] : [Step 4/5] [2021-11-19 21:07:26,620][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=50 ms] [21:07:26] : [Step 4/5] [2021-11-19 21:07:26,620][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][GridCacheProcessor] Restoring partition state for local groups. [21:07:26] : [Step 4/5] [2021-11-19 21:07:26,637][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=2, partitionsProcessed=1124, time=21ms] [21:07:27] : [Step 4/5] [2021-11-19 21:07:27,640][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][TestTcpDiscoverySpi] Successfully bound to TCP port [port=47500, localHost=localhost/127.0.0.1, locNodeId=00030eb5-84b3-4665-8392-0c8c650f4000] [21:07:27] : [Step 4/5] [2021-11-19 21:07:27,643][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][GridEncryptionManager] Sending new group keys to coordinator [grps=1613773252] [21:07:27] : [Step 4/5] [2021-11-19 21:07:27,650][INFO ][disco-notifier-worker-#14535%grid-0%][MvccProcessorImpl] Assigned mvcc coordinator [crd=MvccCoordinator [topVer=AffinityTopologyVersion [topVer=1, minorTopVer=0], nodeId=00030eb5-84b3-4665-8392-0c8c650f4000, ver=1637345247645, local=true, initialized=false]] [21:07:27] : [Step 4/5] [2021-11-19 21:07:27,652][INFO ][disco-notifier-worker-#14535%grid-0%][GridEncryptionManager] Added encryption key on local join [grpId=1613773252] [21:07:27] : [Step 4/5] [2021-11-19 21:07:27,652][INFO ][sys-#14533%grid-0%][ClusterProcessor] Writing cluster ID and tag to metastorage on ready for write ClusterIdAndTag [id=fa571dfd-3dc3-453e-81dd-4638e2fd34ee, tag=zealous_snyder] [21:07:27] : [Step 4/5] [2021-11-19 21:07:27,655][INFO ][disco-notifier-worker-#14535%grid-0%][ClusterProcessor] zealous_snyder [21:07:27] : [Step 4/5] [2021-11-19 21:07:27,656][INFO ][disco-notifier-worker-#14535%grid-0%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustEnabled' was changed from 'null' to 'false' [21:07:27] : [Step 4/5] [2021-11-19 21:07:27,657][INFO ][disco-notifier-worker-#14535%grid-0%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustTimeout' was changed from 'null' to '300000' [21:07:27] : [Step 4/5] [2021-11-19 21:07:27,658][INFO ][disco-notifier-worker-#14535%grid-0%][IgniteTxManager] Transactions parameter 'longOperationsDumpTimeout' was changed from 'null' to '60000' [21:07:27] : [Step 4/5] [2021-11-19 21:07:27,659][INFO ][disco-notifier-worker-#14535%grid-0%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpThreshold' was changed from 'null' to '0' [21:07:27] : [Step 4/5] [2021-11-19 21:07:27,659][INFO ][disco-notifier-worker-#14535%grid-0%][IgniteTxManager] Transactions parameter 'transactionTimeDumpSamplesCoefficient' was changed from 'null' to '0.0' [21:07:27] : [Step 4/5] [2021-11-19 21:07:27,660][INFO ][disco-notifier-worker-#14535%grid-0%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpSamplesPerSecondLimit' was changed from 'null' to '5' [21:07:27] : [Step 4/5] [2021-11-19 21:07:27,660][INFO ][disco-notifier-worker-#14535%grid-0%][IgniteTxManager] Transactions parameter 'collisionsDumpInterval' was changed from 'null' to '1000' [21:07:27] : [Step 4/5] [2021-11-19 21:07:27,661][INFO ][disco-notifier-worker-#14535%grid-0%][IgniteTxManager] Transactions parameter 'txOwnerDumpRequestsAllowed' was changed from 'null' to 'true' [21:07:27] : [Step 4/5] [2021-11-19 21:07:27,661][INFO ][disco-notifier-worker-#14535%grid-0%][GridCacheDatabaseSharedManager] Historical rebalance WAL threshold changed [property=historical.rebalance.threshold, oldVal=null, newVal=500] [21:07:27] : [Step 4/5] [2021-11-19 21:07:27,665][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][IgniteKernal%grid-0] To start Console Management & Monitoring run ignitevisorcmd.{sh|bat} [21:07:27] : [Step 4/5] [2021-11-19 21:07:27,665][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][IgniteKernal%grid-0] [21:07:27] : [Step 4/5] [21:07:27] : [Step 4/5] >>> +-------------------------------------------+ [21:07:27] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:07:27] : [Step 4/5] >>> +-------------------------------------------+ [21:07:27] : [Step 4/5] >>> OS name: Linux 4.15.0-151-generic amd64 [21:07:27] : [Step 4/5] >>> CPU(s): 24 [21:07:27] : [Step 4/5] >>> Heap: 2.0GB [21:07:27] : [Step 4/5] >>> VM name: 16724@c4dfe9a430b2 [21:07:27] : [Step 4/5] >>> Ignite instance name: grid-0 [21:07:27] : [Step 4/5] >>> Local node [ID=00030EB5-84B3-4665-8392-0C8C650F4000, order=1, clientMode=false] [21:07:27] : [Step 4/5] >>> Local node addresses: [127.0.0.1] [21:07:27] : [Step 4/5] >>> Local ports: TCP:10800 TCP:45170 TCP:47500 [21:07:27] : [Step 4/5] [21:07:27] : [Step 4/5] [2021-11-19 21:07:27,666][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][IgniteKernal%grid-0] >>> Ignite cluster is in INACTIVE state (limited functionality available). Use control.(sh|bat) script or IgniteCluster.state(ClusterState.ACTIVE) to change the state. [21:07:27] : [Step 4/5] [2021-11-19 21:07:27,667][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][GridDiscoveryManager] Topology snapshot [ver=1, locNode=00030eb5, servers=1, clients=0, state=INACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=00030eb5-84b3-4665-8392-0c8c650f4000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:07:27] : [Step 4/5] [2021-11-19 21:07:27,668][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][G] Node started : [stage="Configure system pool" (0 ms),stage="Start managers" (224 ms),stage="Configure binary metadata" (4 ms),stage="Start processors" (513 ms),stage="Start 'StanByClusterTestProvider' plugin" (0 ms),stage="Start 'PageMemory tracker plugin' plugin" (0 ms),stage="Start 'TestDistibutedConfigurationPlugin' plugin" (0 ms),stage="Start 'NodeValidationPluginProvider' plugin" (0 ms),stage="Init metastore" (28 ms),stage="Init and start regions" (6 ms),stage="Restore binary memory" (217 ms),stage="Restore logical state" (65 ms),stage="Finish recovery" (1001 ms),stage="Join topology" (11 ms),stage="Await transition" (2 ms),stage="Await exchange" (14 ms),stage="Total time" (2085 ms)] [21:07:27] : [Step 4/5] [2021-11-19 21:07:27,670][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][root] Node started with the following configuration [id=00030eb5-84b3-4665-8392-0c8c650f4000, marshaller=BinaryMarshaller [], discovery=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=5000, ackTimeout=5000, marsh=JdkMarshaller [clsFilter=org.apache.ignite.marshaller.MarshallerUtils$1@7d62eede], reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], binaryCfg=null, lateAff=true] [21:07:27]W: [org.apache.ignite:ignite-core] [2021-11-19 21:07:27,675][WARN ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][G] Ignite work directory is not provided, automatically resolved to: /opt/buildagent/work/7bc1c54bc719b67c/work [21:07:27] : [Step 4/5] [2021-11-19 21:07:27,675][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][IgniteKernal%grid-1] [21:07:27] : [Step 4/5] [21:07:27] : [Step 4/5] >>> __________ ________________ [21:07:27] : [Step 4/5] >>> / _/ ___/ |/ / _/_ __/ __/ [21:07:27] : [Step 4/5] >>> _/ // (7 7 // / / / / _/ [21:07:27] : [Step 4/5] >>> /___/\___/_/|_/___/ /_/ /___/ [21:07:27] : [Step 4/5] >>> [21:07:27] : [Step 4/5] >>> ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:07:27] : [Step 4/5] >>> 2021 Copyright(C) Apache Software Foundation [21:07:27] : [Step 4/5] >>> [21:07:27] : [Step 4/5] >>> Ignite documentation: http://ignite.apache.org [21:07:27] : [Step 4/5] [21:07:27] : [Step 4/5] [2021-11-19 21:07:27,676][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][IgniteKernal%grid-1] Config URL: n/a [21:07:27] : [Step 4/5] [2021-11-19 21:07:27,676][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][IgniteKernal%grid-1] IgniteConfiguration [igniteInstanceName=grid-1, pubPoolSize=24, svcPoolSize=24, callbackPoolSize=24, stripedPoolSize=24, sysPoolSize=24, mgmtPoolSize=4, dataStreamerPoolSize=24, utilityCachePoolSize=24, utilityCacheKeepAliveTime=60000, p2pPoolSize=2, qryPoolSize=24, buildIdxPoolSize=4, igniteHome=/opt/buildagent/work/7bc1c54bc719b67c, igniteWorkDir=/opt/buildagent/work/7bc1c54bc719b67c/work, mbeanSrv=com.sun.jmx.mbeanserver.JmxMBeanServer@6fe85038, nodeId=1074fba4-df16-419e-9e72-5573d5ed6001, marsh=BinaryMarshaller [], marshLocJobs=false, daemon=false, p2pEnabled=true, netTimeout=10000, netCompressionLevel=1, sndRetryDelay=1000, sndRetryCnt=3, metricsHistSize=10000, metricsUpdateFreq=1000, metricsExpTime=9223372036854775807, discoSpi=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=0, ackTimeout=0, marsh=null, reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], segPlc=STOP, segResolveAttempts=2, waitForSegOnStart=true, allResolversPassReq=true, segChkFreq=10000, commSpi=TcpCommunicationSpi [connectGate=org.apache.ignite.spi.communication.tcp.internal.ConnectGateway@31610ef4, ctxInitLatch=java.util.concurrent.CountDownLatch@6ca5285e[Count = 1], stopping=false, clientPool=null, nioSrvWrapper=null, stateProvider=null], evtSpi=MemoryEventStorageSpi [expireAgeMs=9223372036854775807, expireCnt=10000, filter=null], colSpi=NoopCollisionSpi [], deploySpi=LocalDeploymentSpi [], indexingSpi=org.apache.ignite.spi.indexing.noop.NoopIndexingSpi@645af32e, addrRslvr=null, encryptionSpi=org.apache.ignite.spi.encryption.keystore.KeystoreEncryptionSpi@1856041, tracingSpi=org.apache.ignite.spi.tracing.NoopTracingSpi@22ef72ed, clientMode=false, rebalanceThreadPoolSize=4, rebalanceTimeout=10000, rebalanceBatchesPrefetchCnt=3, rebalanceThrottle=0, rebalanceBatchSize=524288, txCfg=TransactionConfiguration [txSerEnabled=false, dfltIsolation=REPEATABLE_READ, dfltConcurrency=PESSIMISTIC, dfltTxTimeout=0, txTimeoutOnPartitionMapExchange=0, deadlockTimeout=10000, pessimisticTxLogSize=0, pessimisticTxLogLinger=10000, tmLookupClsName=null, txManagerFactory=null, useJtaSync=false], cacheSanityCheckEnabled=true, discoStartupDelay=60000, deployMode=SHARED, p2pMissedCacheSize=100, locHost=127.0.0.1, timeSrvPortBase=31100, timeSrvPortRange=100, failureDetectionTimeout=10000, sysWorkerBlockedTimeout=null, clientFailureDetectionTimeout=10000, metricsLogFreq=0, connectorCfg=null, odbcCfg=null, warmupClos=null, atomicCfg=AtomicConfiguration [seqReserveSize=1000, cacheMode=PARTITIONED, backups=1, aff=null, grpName=null], classLdr=null, sslCtxFactory=null, platformCfg=null, binaryCfg=null, memCfg=null, pstCfg=null, dsCfg=DataStorageConfiguration [sysRegionInitSize=41943040, sysRegionMaxSize=104857600, pageSize=4096, concLvl=0, dfltDataRegConf=DataRegionConfiguration [name=default, maxSize=10485760, initSize=268435456, swapPath=null, pageEvictionMode=DISABLED, pageReplacementMode=CLOCK, evictionThreshold=0.9, emptyPagesPoolSize=100, metricsEnabled=false, metricsSubIntervalCount=5, metricsRateTimeInterval=60000, persistenceEnabled=true, checkpointPageBufSize=0, lazyMemoryAllocation=true, warmUpCfg=null], dataRegions=null, storagePath=null, checkpointFreq=180000, lockWaitTime=10000, checkpointThreads=4, checkpointWriteOrder=SEQUENTIAL, walHistSize=20, maxWalArchiveSize=1073741824, walSegments=10, walSegmentSize=67108864, walPath=db/wal, walArchivePath=db/wal/archive, cdcWalPath=db/wal/cdc, cdcEnabled=false, metricsEnabled=false, walMode=FSYNC, walTlbSize=131072, walBuffSize=0, walFlushFreq=2000, walFsyncDelay=1000, walRecordIterBuffSize=67108864, alwaysWriteFullPages=false, fileIOFactory=org.apache.ignite.internal.processors.cache.persistence.file.AsyncFileIOFactory@20a9cf93, metricsSubIntervalCnt=5, metricsRateTimeInterval=60000, walAutoArchiveAfterInactivity=-1, walForceArchiveTimeout=-1, writeThrottlingEnabled=false, walCompactionEnabled=false, walCompactionLevel=1, checkpointReadLockTimeout=null, walPageCompression=DISABLED, walPageCompressionLevel=null, dfltWarmUpCfg=null, encCfg=org.apache.ignite.configuration.EncryptionConfiguration@66f18713, defragmentationThreadPoolSize=4, minWalArchiveSize=-1], snapshotPath=snapshots, activeOnStart=true, activeOnStartPropSetFlag=false, autoActivation=true, autoActivationPropSetFlag=false, clusterStateOnStart=null, sqlConnCfg=null, cliConnCfg=ClientConnectorConfiguration [host=null, port=10800, portRange=100, sockSndBufSize=0, sockRcvBufSize=0, tcpNoDelay=true, maxOpenCursorsPerConn=128, threadPoolSize=24, selectorCnt=12, idleTimeout=0, handshakeTimeout=10000, jdbcEnabled=true, odbcEnabled=true, thinCliEnabled=true, sslEnabled=false, useIgniteSslCtxFactory=true, sslClientAuth=false, sslCtxFactory=null, thinCliCfg=ThinClientConfiguration [maxActiveTxPerConn=100, maxActiveComputeTasksPerConn=0]], mvccVacuumThreadCnt=2, mvccVacuumFreq=5000, authEnabled=false, failureHnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]], commFailureRslvr=null, sqlCfg=SqlConfiguration [longQryWarnTimeout=3000, dfltQryTimeout=0, sqlQryHistSize=1000, validationEnabled=false], asyncContinuationExecutor=null] [21:07:27] : [Step 4/5] [2021-11-19 21:07:27,686][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][IgniteKernal%grid-1] Daemon mode: off [21:07:27] : [Step 4/5] [2021-11-19 21:07:27,686][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][IgniteKernal%grid-1] OS: Linux 4.15.0-151-generic amd64 [21:07:27] : [Step 4/5] [2021-11-19 21:07:27,687][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][IgniteKernal%grid-1] OS user: teamcity [21:07:27] : [Step 4/5] [2021-11-19 21:07:27,687][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][IgniteKernal%grid-1] PID: 16724 [21:07:27] : [Step 4/5] [2021-11-19 21:07:27,687][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][IgniteKernal%grid-1] Language runtime: Java Platform API Specification ver. 1.8 [21:07:27] : [Step 4/5] [2021-11-19 21:07:27,688][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][IgniteKernal%grid-1] VM information: Java(TM) SE Runtime Environment 1.8.0_261-b12 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 25.261-b12 [21:07:27] : [Step 4/5] [2021-11-19 21:07:27,688][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][IgniteKernal%grid-1] VM total memory: 1.9GB [21:07:27] : [Step 4/5] [2021-11-19 21:07:27,689][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][IgniteKernal%grid-1] Remote Management [restart: off, REST: off, JMX (remote: off)] [21:07:27] : [Step 4/5] [2021-11-19 21:07:27,689][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][IgniteKernal%grid-1] Logger: GridTestLog4jLogger [quiet=false, config=null] [21:07:27] : [Step 4/5] [2021-11-19 21:07:27,689][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][IgniteKernal%grid-1] IGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c [21:07:27] : [Step 4/5] [2021-11-19 21:07:27,690][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][IgniteKernal%grid-1] VM arguments: [-DIGNITE_DUMP_THREADS_ON_FAILURE=false, -DMono=/usr/bin/mono-sgen, -DMono4.0_x64=/usr/lib/mono/4.0, -DMono4.5_x64=/usr/lib/mono/4.5, -DMonoVersion=6.12.0.90, -DSKIP_BUILD=false, -Dagent.home.dir=/opt/buildagent, -Dagent.name=aitc-lin02_03, -Dagent.ownPort=9090, -Dagent.work.dir=/opt/buildagent/work, -Dbuild.number=95, -Dbuild.vcs.number=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.1=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.GitHubApacheIgnite=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dclassworlds.conf=/opt/buildagent/temp/buildTmp/teamcity.m2.conf, -Dcom.jetbrains.maven.watcher.report.file=/opt/buildagent/temp/buildTmp/maven-build-info.xml, -Djava.io.tmpdir=/opt/buildagent/temp/buildTmp, -Dmaven.home=/opt/buildagent/tools/maven3_6, -Dmaven.multiModuleProjectDirectory=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.agent.cpuBenchmark=457, -Dteamcity.agent.dotnet.agent_url=http://localhost:9090/RPC2, -Dteamcity.agent.dotnet.build_id=6278078, -Dteamcity.auth.password=*******, -Dteamcity.auth.userId=TeamCityBuildId=6278078, -Dteamcity.build.changedFiles.file=/opt/buildagent/temp/buildTmp/changedFiles6342607772318147725.txt, -Dteamcity.build.checkoutDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.build.id=6278078, -Dteamcity.build.properties.file=/opt/buildagent/temp/buildTmp/teamcity.build5164517880467851002.properties, -Dteamcity.build.tempDir=/opt/buildagent/temp/buildTmp, -Dteamcity.build.workingDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.buildConfName=Basic 3, -Dteamcity.buildType.id=IgniteTests24Java8_Basic3, -Dteamcity.configuration.properties.file=/opt/buildagent/temp/buildTmp/teamcity.config5591980786735343870.properties, -Dteamcity.maven.userSettings.path=/opt/buildagent/temp/buildTmp/maven_settings_585072866407032347.xml, -Dteamcity.maven.watcher.home=/opt/buildagent/plugins/mavenPlugin/maven-watcher-jdk16, -Dteamcity.projectName=Ignite Tests 2.x (JDK 8/11), -Dteamcity.runner.properties.file=/opt/buildagent/temp/buildTmp/teamcity.runner9098465561618137420.properties, -Dteamcity.tests.recentlyFailedTests.file=/opt/buildagent/temp/buildTmp/testsToRunFirst3891775683130404069.txt, -Dteamcity.version=2021.2 (build 99542), -ea, -Xms2g, -Xmx2g, -XX:+HeapDumpOnOutOfMemoryError, -DIGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_TEST_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_UPDATE_NOTIFIER=false, -DIGNITE_NO_DISCO_ORDER=true, -DIGNITE_PERFORMANCE_SUGGESTIONS_DISABLED=true, -Djava.net.preferIPv4Stack=true, -DTEST_SCALE_FACTOR=1.0, -DIGNITE_TEST_PROP_LOG4J_FILE=log4j-tc-test.xml, -DIGNITE_QUIET=false, -DIGNITE_MARSHAL_BUFFERS_RECHECK=1000, -Dmaven.repo.local=/opt/buildagent/.m2/repository] [21:07:27] : [Step 4/5] [2021-11-19 21:07:27,695][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][IgniteKernal%grid-1] System cache's DataRegion size is configured to 40 MB. Use DataStorageConfiguration.systemRegionInitialSize property to change the setting. [21:07:27] : [Step 4/5] [2021-11-19 21:07:27,695][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][IgniteKernal%grid-1] Configured caches [in 'sysMemPlc' dataRegion: ['ignite-sys-cache'], in 'default' dataRegion: ['encrypted']] [21:07:27]W: [org.apache.ignite:ignite-core] [2021-11-19 21:07:27,696][WARN ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][IgniteKernal%grid-1] Peer class loading is enabled (disable it in production for performance and deployment consistency reasons) [21:07:27] : [Step 4/5] [2021-11-19 21:07:27,696][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][IgniteKernal%grid-1] 3-rd party licenses can be found at: /opt/buildagent/work/7bc1c54bc719b67c/libs/licenses [21:07:27] : [Step 4/5] [2021-11-19 21:07:27,700][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][IgnitePluginProcessor] Configured plugins: [21:07:27] : [Step 4/5] [2021-11-19 21:07:27,700][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][IgnitePluginProcessor] ^-- StanByClusterTestProvider 1.0 [21:07:27] : [Step 4/5] [2021-11-19 21:07:27,700][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][IgnitePluginProcessor] ^-- null [21:07:27] : [Step 4/5] [2021-11-19 21:07:27,700][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][IgnitePluginProcessor] [21:07:27] : [Step 4/5] [2021-11-19 21:07:27,701][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][IgnitePluginProcessor] ^-- PageMemory tracker plugin 1.0 [21:07:27] : [Step 4/5] [2021-11-19 21:07:27,701][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][IgnitePluginProcessor] ^-- null [21:07:27] : [Step 4/5] [2021-11-19 21:07:27,701][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][IgnitePluginProcessor] [21:07:27] : [Step 4/5] [2021-11-19 21:07:27,701][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][IgnitePluginProcessor] ^-- TestDistibutedConfigurationPlugin 1.0 [21:07:27] : [Step 4/5] [2021-11-19 21:07:27,701][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][IgnitePluginProcessor] ^-- null [21:07:27] : [Step 4/5] [2021-11-19 21:07:27,702][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][IgnitePluginProcessor] [21:07:27] : [Step 4/5] [2021-11-19 21:07:27,702][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][IgnitePluginProcessor] ^-- NodeValidationPluginProvider 1.0 [21:07:27] : [Step 4/5] [2021-11-19 21:07:27,702][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][IgnitePluginProcessor] ^-- null [21:07:27] : [Step 4/5] [2021-11-19 21:07:27,702][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][IgnitePluginProcessor] [21:07:27] : [Step 4/5] [2021-11-19 21:07:27,702][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][FailureProcessor] Configured failure handler: [hnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]]] [21:07:27]W: [org.apache.ignite:ignite-core] [2021-11-19 21:07:27,757][WARN ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][TcpCommunicationSpi] Message queue limit is set to 0 which may lead to potential OOMEs when running cache operations in FULL_ASYNC or PRIMARY_SYNC modes due to message queues growth on sender and receiver sides. [21:07:27] : [Step 4/5] [2021-11-19 21:07:27,757][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][TcpCommunicationSpi] Successfully bound communication NIO server to TCP port [port=45171, locHost=/127.0.0.1, selectorsCnt=12, selectorSpins=0, pairedConn=false] [21:07:27] : [Step 4/5] [2021-11-19 21:07:27,761][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][GridCollisionManager] Collision resolution is disabled (all jobs will be activated upon arrival). [21:07:27] : [Step 4/5] [2021-11-19 21:07:27,761][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][IgniteKernal%grid-1] Security status [authentication=off, sandbox=off, tls/ssl=off] [21:07:27] : [Step 4/5] [2021-11-19 21:07:27,819][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:07:27] : [Step 4/5] [2021-11-19 21:07:27,904][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][MaintenanceProcessor] Resolved store directory for node persistent data: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1 [21:07:27] : [Step 4/5] [2021-11-19 21:07:27,905][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][CacheObjectBinaryProcessorImpl] Resolved directory for serialized binary metadata: /opt/buildagent/work/7bc1c54bc719b67c/work/db/binary_meta/grid_1 [21:07:27] : [Step 4/5] [2021-11-19 21:07:27,909][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1 [21:07:27] : [Step 4/5] [2021-11-19 21:07:27,910][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][FileWriteAheadLogManager] Resolved write ahead log work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1 [21:07:27] : [Step 4/5] [2021-11-19 21:07:27,910][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][FileWriteAheadLogManager] Resolved write ahead log archive directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1 [21:07:28] : [Step 4/5] [2021-11-19 21:07:28,682][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000000.wal [21:07:28] : [Step 4/5] [2021-11-19 21:07:28,688][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][GridCacheDatabaseSharedManager] Configured data regions initialized successfully [total=5] [21:07:28] : [Step 4/5] [2021-11-19 21:07:28,750][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][IgniteSnapshotManager] Resolved snapshot work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/snapshots [21:07:28] : [Step 4/5] [2021-11-19 21:07:28,750][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][IgniteSnapshotManager] Resolved temp directory for snapshot creation: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1/snp [21:07:28] : [Step 4/5] [2021-11-19 21:07:28,752][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][ClientListenerProcessor] Client connector processor has started on TCP port 10801 [21:07:28] : [Step 4/5] [2021-11-19 21:07:28,754][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][IgniteKernal%grid-1] Non-loopback local IPs: 172.17.0.4 [21:07:28] : [Step 4/5] [2021-11-19 21:07:28,754][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][IgniteKernal%grid-1] Enabled local MACs: 0242AC110004 [21:07:28] : [Step 4/5] [2021-11-19 21:07:28,755][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:07:28] : [Step 4/5] [2021-11-19 21:07:28,756][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:07:28] : [Step 4/5] [2021-11-19 21:07:28,756][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:07:28] : [Step 4/5] [2021-11-19 21:07:28,758][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][GridCacheDatabaseSharedManager] Applying lost metastore updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:07:28] : [Step 4/5] [2021-11-19 21:07:28,759][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=0 ms] [21:07:28] : [Step 4/5] [2021-11-19 21:07:28,759][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][GridCacheProcessor] Restoring partition state for local groups. [21:07:28] : [Step 4/5] [2021-11-19 21:07:28,759][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=0, partitionsProcessed=0, time=0ms] [21:07:28] : [Step 4/5] [2021-11-19 21:07:28,759][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][GridEncryptionManager] Encryption keys loaded from metastore. [grps=, masterKeyName=ignite.master.key] [21:07:28] : [Step 4/5] [2021-11-19 21:07:28,761][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][ClusterProcessor] Cluster ID and tag has been read from metastorage: null [21:07:28] : [Step 4/5] [2021-11-19 21:07:28,761][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][IgniteClusterImpl] Shutdown policy was updated [oldVal=null, newVal=null] [21:07:28] : [Step 4/5] [2021-11-19 21:07:28,761][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][GridCacheDatabaseSharedManager] Checkpoint frequency deviation changed [oldVal=null, newVal=null] [21:07:28] : [Step 4/5] [2021-11-19 21:07:28,877][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][FilePageStoreManager] Cleanup cache stores [total=1, left=0, cleanFiles=false] [21:07:28] : [Step 4/5] [2021-11-19 21:07:28,879][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:07:28] : [Step 4/5] [2021-11-19 21:07:28,880][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:07:28] : [Step 4/5] [2021-11-19 21:07:28,882][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:07:28] : [Step 4/5] [2021-11-19 21:07:28,882][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][GridCacheDatabaseSharedManager] Data Regions Started: 5 [21:07:28] : [Step 4/5] [2021-11-19 21:07:28,883][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][GridCacheDatabaseSharedManager] ^-- sysMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:07:28] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:07:28] : [Step 4/5] ^-- default region [type=default, persistence=true, lazyAlloc=true, [21:07:28] : [Step 4/5] ... initCfg=10MB, maxCfg=10MB, usedRam=0MB, freeRam=100%, allocRam=0MB, allocTotal=0MB] [21:07:28] : [Step 4/5] ^-- metastoreMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:07:28] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:07:28] : [Step 4/5] ^-- TxLog region [type=internal, persistence=true, lazyAlloc=false, [21:07:28] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:07:28] : [Step 4/5] ^-- volatileDsMemPlc region [type=user, persistence=false, lazyAlloc=true, [21:07:28] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB] [21:07:28] : [Step 4/5] ^-- Ignite persistence [used=0MB] [21:07:28] : [Step 4/5] [21:07:28] : [Step 4/5] [2021-11-19 21:07:28,884][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][GridCacheDatabaseSharedManager] Starting binary memory restore for: [-2100569601, 1613773252] [21:07:28] : [Step 4/5] [2021-11-19 21:07:28,950][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:07:28] : [Step 4/5] [2021-11-19 21:07:28,950][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:07:28] : [Step 4/5] [2021-11-19 21:07:28,951][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000000.wal, offset=0, ver=2] [21:07:28] : [Step 4/5] [2021-11-19 21:07:28,962][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][GridCacheProcessor] Started cache in recovery mode [name=ignite-sys-cache, id=-2100569601, dataRegionName=sysMemPlc, mode=REPLICATED, atomicity=TRANSACTIONAL, backups=2147483647, mvcc=false] [21:07:28] : [Step 4/5] [2021-11-19 21:07:28,963][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][PageMemoryImpl] Started page memory [memoryAllocated=24.0 MiB, pages=5952, tableSize=474.2 KiB, replacementSize=768 B, checkpointBuffer=10.0 MiB] [21:07:28] : [Step 4/5] [2021-11-19 21:07:28,968][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][GridCacheProcessor] Started cache in recovery mode [name=encrypted, id=1613773252, dataRegionName=default, mode=PARTITIONED, atomicity=ATOMIC, backups=0, mvcc=false] [21:07:28] : [Step 4/5] [2021-11-19 21:07:28,969][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][GridCacheDatabaseSharedManager] Binary recovery performed in 85 ms. [21:07:28] : [Step 4/5] [2021-11-19 21:07:28,970][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:07:28] : [Step 4/5] [2021-11-19 21:07:28,970][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][GridCacheDatabaseSharedManager] Applying lost cache updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:07:29] : [Step 4/5] [2021-11-19 21:07:29,036][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=71 ms] [21:07:29] : [Step 4/5] [2021-11-19 21:07:29,036][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][GridCacheProcessor] Restoring partition state for local groups. [21:07:29] : [Step 4/5] [2021-11-19 21:07:29,056][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=2, partitionsProcessed=1124, time=20ms] [21:07:29] : [Step 4/5] [2021-11-19 21:07:29,692][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][TestTcpDiscoverySpi] Successfully bound to TCP port [port=47501, localHost=localhost/127.0.0.1, locNodeId=1074fba4-df16-419e-9e72-5573d5ed6001] [21:07:29] : [Step 4/5] [2021-11-19 21:07:29,694][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][GridEncryptionManager] Sending new group keys to coordinator [grps=1613773252] [21:07:29] : [Step 4/5] [2021-11-19 21:07:29,698][INFO ][tcp-disco-srvr-[:47500]-#758%grid-0%-#14537%grid-0%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=36277] [21:07:29] : [Step 4/5] [2021-11-19 21:07:29,698][INFO ][tcp-disco-srvr-[:47500]-#758%grid-0%-#14537%grid-0%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=36277] [21:07:29] : [Step 4/5] [2021-11-19 21:07:29,700][INFO ][tcp-disco-sock-reader-[]-#764%grid-0%-#14657%grid-0%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:36277, rmtPort=36277] [21:07:29] : [Step 4/5] [2021-11-19 21:07:29,702][INFO ][tcp-disco-sock-reader-[1074fba4 127.0.0.1:36277]-#764%grid-0%-#14657%grid-0%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=1074fba4-df16-419e-9e72-5573d5ed6001, rmtAddr=/127.0.0.1:36277] [21:07:29] : [Step 4/5] [2021-11-19 21:07:29,713][INFO ][tcp-disco-srvr-[:47501]-#763%grid-1%-#14656%grid-1%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=55873] [21:07:29] : [Step 4/5] [2021-11-19 21:07:29,714][INFO ][tcp-disco-srvr-[:47501]-#763%grid-1%-#14656%grid-1%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=55873] [21:07:29] : [Step 4/5] [2021-11-19 21:07:29,716][INFO ][tcp-disco-sock-reader-[]-#765%grid-1%-#14658%grid-1%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:55873, rmtPort=55873] [21:07:29] : [Step 4/5] [2021-11-19 21:07:29,717][INFO ][tcp-disco-sock-reader-[]-#765%grid-1%-#14658%grid-1%][TestTcpDiscoverySpi] Received ping request from the remote node [rmtNodeId=00030eb5-84b3-4665-8392-0c8c650f4000, rmtAddr=/127.0.0.1:55873, rmtPort=55873] [21:07:29] : [Step 4/5] [2021-11-19 21:07:29,718][INFO ][tcp-disco-sock-reader-[]-#765%grid-1%-#14658%grid-1%][TestTcpDiscoverySpi] Finished writing ping response [rmtNodeId=00030eb5-84b3-4665-8392-0c8c650f4000, rmtAddr=/127.0.0.1:55873, rmtPort=55873] [21:07:29]W: [org.apache.ignite:ignite-core] [2021-11-19 21:07:29,718][WARN ][tcp-disco-sock-reader-[]-#765%grid-1%-#14658%grid-1%][TestTcpDiscoverySpi] Failed to shutdown socket [21:07:29]W: [org.apache.ignite:ignite-core] java.net.SocketException: Socket output is already shutdown [21:07:29]W: [org.apache.ignite:ignite-core] at java.net.Socket.shutdownOutput(Socket.java:1572) [21:07:29]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.close(IgniteUtils.java:4247) [21:07:29]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.discovery.tcp.ServerImpl$SocketReader.body(ServerImpl.java:7370) [21:07:29]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.IgniteSpiThread.run(IgniteSpiThread.java:58) [21:07:29] : [Step 4/5] [2021-11-19 21:07:29,723][INFO ][tcp-disco-msg-worker-[crd]-#757%grid-0%-#14536%grid-0%][GridEncryptionManager] Joining node doesn't have stored group keys [node=1074fba4-df16-419e-9e72-5573d5ed6001] [21:07:29] : [Step 4/5] [2021-11-19 21:07:29,723][INFO ][tcp-disco-sock-reader-[1074fba4 127.0.0.1:36277]-#764%grid-0%-#14657%grid-0%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:36277, rmtPort=36277, rmtNodeId=1074fba4-df16-419e-9e72-5573d5ed6001] [21:07:29] : [Step 4/5] [2021-11-19 21:07:29,724][INFO ][tcp-disco-sock-reader-[]-#765%grid-1%-#14658%grid-1%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:55873, rmtPort=55873, rmtNodeId=null] [21:07:29] : [Step 4/5] [2021-11-19 21:07:29,728][INFO ][tcp-disco-msg-worker-[crd]-#757%grid-0%-#14536%grid-0%][GridEncryptionManager] Skip group key received from joining node. Already exists. [node=1074fba4-df16-419e-9e72-5573d5ed6001, grp=1613773252] [21:07:29] : [Step 4/5] [2021-11-19 21:07:29,738][INFO ][tcp-disco-msg-worker-[crd]-#757%grid-0%-#14536%grid-0%][TestTcpDiscoverySpi] New next node [newNext=TcpDiscoveryNode [id=1074fba4-df16-419e-9e72-5573d5ed6001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=0, intOrder=2, lastExchangeTime=1637345249701, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false]] [21:07:29] : [Step 4/5] [2021-11-19 21:07:29,739][INFO ][tcp-disco-srvr-[:47501]-#763%grid-1%-#14656%grid-1%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=50891] [21:07:29] : [Step 4/5] [2021-11-19 21:07:29,739][INFO ][tcp-disco-srvr-[:47501]-#763%grid-1%-#14656%grid-1%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=50891] [21:07:29] : [Step 4/5] [2021-11-19 21:07:29,740][INFO ][tcp-disco-sock-reader-[]-#766%grid-1%-#14659%grid-1%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:50891, rmtPort=50891] [21:07:29] : [Step 4/5] [2021-11-19 21:07:29,741][INFO ][tcp-disco-sock-reader-[00030eb5 127.0.0.1:50891]-#766%grid-1%-#14659%grid-1%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=00030eb5-84b3-4665-8392-0c8c650f4000, rmtAddr=/127.0.0.1:50891] [21:07:29] : [Step 4/5] [2021-11-19 21:07:29,746][INFO ][tcp-disco-msg-worker-[]-#762%grid-1%-#14655%grid-1%][TestTcpDiscoverySpi] New next node [newNext=TcpDiscoveryNode [id=00030eb5-84b3-4665-8392-0c8c650f4000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345249734, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false]] [21:07:29] : [Step 4/5] [2021-11-19 21:07:29,747][INFO ][tcp-disco-srvr-[:47500]-#758%grid-0%-#14537%grid-0%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=40549] [21:07:29] : [Step 4/5] [2021-11-19 21:07:29,747][INFO ][tcp-disco-srvr-[:47500]-#758%grid-0%-#14537%grid-0%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=40549] [21:07:29] : [Step 4/5] [2021-11-19 21:07:29,752][INFO ][tcp-disco-sock-reader-[]-#767%grid-0%-#14660%grid-0%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:40549, rmtPort=40549] [21:07:29] : [Step 4/5] [2021-11-19 21:07:29,753][INFO ][tcp-disco-sock-reader-[1074fba4 127.0.0.1:40549]-#767%grid-0%-#14660%grid-0%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=1074fba4-df16-419e-9e72-5573d5ed6001, rmtAddr=/127.0.0.1:40549] [21:07:29] : [Step 4/5] [2021-11-19 21:07:29,756][INFO ][disco-event-worker-#14539%grid-0%][GridDiscoveryManager] Added new node to topology: TcpDiscoveryNode [id=1074fba4-df16-419e-9e72-5573d5ed6001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637345249701, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false] [21:07:29] : [Step 4/5] [2021-11-19 21:07:29,757][INFO ][disco-event-worker-#14539%grid-0%][GridDiscoveryManager] Topology snapshot [ver=2, locNode=00030eb5, servers=2, clients=0, state=INACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=00030eb5-84b3-4665-8392-0c8c650f4000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=1074fba4-df16-419e-9e72-5573d5ed6001, consistentId=grid-1, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:07:29] : [Step 4/5] [2021-11-19 21:07:29,759][INFO ][tcp-disco-msg-worker-[00030eb5 127.0.0.1:47500]-#762%grid-1%-#14655%grid-1%][GridEncryptionManager] Store group key received from coordinator [grp=1613773252, keyId=0] [21:07:29] : [Step 4/5] [2021-11-19 21:07:29,760][INFO ][tcp-disco-msg-worker-[00030eb5 127.0.0.1:47500]-#762%grid-1%-#14655%grid-1%][ClusterProcessor] zealous_snyder [21:07:29] : [Step 4/5] [2021-11-19 21:07:29,761][INFO ][tcp-disco-msg-worker-[00030eb5 127.0.0.1:47500]-#762%grid-1%-#14655%grid-1%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustEnabled' was changed from 'null' to 'false' [21:07:29] : [Step 4/5] [2021-11-19 21:07:29,761][INFO ][tcp-disco-msg-worker-[00030eb5 127.0.0.1:47500]-#762%grid-1%-#14655%grid-1%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustTimeout' was changed from 'null' to '300000' [21:07:29] : [Step 4/5] [2021-11-19 21:07:29,761][INFO ][tcp-disco-msg-worker-[00030eb5 127.0.0.1:47500]-#762%grid-1%-#14655%grid-1%][IgniteTxManager] Transactions parameter 'longOperationsDumpTimeout' was changed from 'null' to '60000' [21:07:29] : [Step 4/5] [2021-11-19 21:07:29,762][INFO ][tcp-disco-msg-worker-[00030eb5 127.0.0.1:47500]-#762%grid-1%-#14655%grid-1%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpThreshold' was changed from 'null' to '0' [21:07:29] : [Step 4/5] [2021-11-19 21:07:29,762][INFO ][tcp-disco-msg-worker-[00030eb5 127.0.0.1:47500]-#762%grid-1%-#14655%grid-1%][IgniteTxManager] Transactions parameter 'transactionTimeDumpSamplesCoefficient' was changed from 'null' to '0.0' [21:07:29] : [Step 4/5] [2021-11-19 21:07:29,762][INFO ][tcp-disco-msg-worker-[00030eb5 127.0.0.1:47500]-#762%grid-1%-#14655%grid-1%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpSamplesPerSecondLimit' was changed from 'null' to '5' [21:07:29] : [Step 4/5] [2021-11-19 21:07:29,763][INFO ][tcp-disco-msg-worker-[00030eb5 127.0.0.1:47500]-#762%grid-1%-#14655%grid-1%][IgniteTxManager] Transactions parameter 'collisionsDumpInterval' was changed from 'null' to '1000' [21:07:29] : [Step 4/5] [2021-11-19 21:07:29,763][INFO ][tcp-disco-msg-worker-[00030eb5 127.0.0.1:47500]-#762%grid-1%-#14655%grid-1%][IgniteTxManager] Transactions parameter 'txOwnerDumpRequestsAllowed' was changed from 'null' to 'true' [21:07:29] : [Step 4/5] [2021-11-19 21:07:29,763][INFO ][tcp-disco-msg-worker-[00030eb5 127.0.0.1:47500]-#762%grid-1%-#14655%grid-1%][GridCacheDatabaseSharedManager] Historical rebalance WAL threshold changed [property=historical.rebalance.threshold, oldVal=null, newVal=500] [21:07:29] : [Step 4/5] [2021-11-19 21:07:29,764][INFO ][disco-notifier-worker-#14654%grid-1%][MvccProcessorImpl] Assigned mvcc coordinator [crd=MvccCoordinator [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=0], nodeId=00030eb5-84b3-4665-8392-0c8c650f4000, ver=1637345247645, local=false, initialized=false]] [21:07:29] : [Step 4/5] [2021-11-19 21:07:29,768][INFO ][sys-#14649%grid-1%][ClusterProcessor] Writing cluster ID and tag to metastorage on ready for write ClusterIdAndTag [id=fa571dfd-3dc3-453e-81dd-4638e2fd34ee, tag=zealous_snyder] [21:07:29] : [Step 4/5] [2021-11-19 21:07:29,797][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][IgniteKernal%grid-1] To start Console Management & Monitoring run ignitevisorcmd.{sh|bat} [21:07:29] : [Step 4/5] [2021-11-19 21:07:29,797][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][IgniteKernal%grid-1] [21:07:29] : [Step 4/5] [21:07:29] : [Step 4/5] >>> +-------------------------------------------+ [21:07:29] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:07:29] : [Step 4/5] >>> +-------------------------------------------+ [21:07:29] : [Step 4/5] >>> OS name: Linux 4.15.0-151-generic amd64 [21:07:29] : [Step 4/5] >>> CPU(s): 24 [21:07:29] : [Step 4/5] >>> Heap: 2.0GB [21:07:29] : [Step 4/5] >>> VM name: 16724@c4dfe9a430b2 [21:07:29] : [Step 4/5] >>> Ignite instance name: grid-1 [21:07:29] : [Step 4/5] >>> Local node [ID=1074FBA4-DF16-419E-9E72-5573D5ED6001, order=2, clientMode=false] [21:07:29] : [Step 4/5] >>> Local node addresses: [127.0.0.1] [21:07:29] : [Step 4/5] >>> Local ports: TCP:10801 TCP:45171 TCP:47501 [21:07:29] : [Step 4/5] [21:07:29] : [Step 4/5] [2021-11-19 21:07:29,799][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][IgniteKernal%grid-1] >>> Ignite cluster is in INACTIVE state (limited functionality available). Use control.(sh|bat) script or IgniteCluster.state(ClusterState.ACTIVE) to change the state. [21:07:29] : [Step 4/5] [2021-11-19 21:07:29,799][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][GridDiscoveryManager] Topology snapshot [ver=2, locNode=1074fba4, servers=2, clients=0, state=INACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=00030eb5-84b3-4665-8392-0c8c650f4000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=1074fba4-df16-419e-9e72-5573d5ed6001, consistentId=grid-1, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:07:29] : [Step 4/5] [2021-11-19 21:07:29,801][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][G] Node started : [stage="Configure system pool" (0 ms),stage="Start managers" (230 ms),stage="Configure binary metadata" (1 ms),stage="Start processors" (846 ms),stage="Start 'StanByClusterTestProvider' plugin" (0 ms),stage="Start 'PageMemory tracker plugin' plugin" (0 ms),stage="Start 'TestDistibutedConfigurationPlugin' plugin" (0 ms),stage="Start 'NodeValidationPluginProvider' plugin" (0 ms),stage="Init metastore" (123 ms),stage="Init and start regions" (6 ms),stage="Restore binary memory" (85 ms),stage="Restore logical state" (87 ms),stage="Finish recovery" (633 ms),stage="Join topology" (74 ms),stage="Await transition" (4 ms),stage="Await exchange" (31 ms),stage="Total time" (2120 ms)] [21:07:29] : [Step 4/5] [2021-11-19 21:07:29,802][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][root] Node started with the following configuration [id=1074fba4-df16-419e-9e72-5573d5ed6001, marshaller=BinaryMarshaller [], discovery=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=5000, ackTimeout=5000, marsh=JdkMarshaller [clsFilter=org.apache.ignite.marshaller.MarshallerUtils$1@6e40f344], reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], binaryCfg=null, lateAff=true] [21:07:29] : [Step 4/5] [2021-11-19 21:07:29,805][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][GridClusterStateProcessor] Sending activate cluster request with BaselineTopology BaselineTopology [id=0, branchingHash=-2475315501, branchingType='New BaselineTopology', baselineNodes=[grid-1, grid-0]] [21:07:29] : [Step 4/5] [2021-11-19 21:07:29,811][INFO ][disco-notifier-worker-#14535%grid-0%][GridClusterStateProcessor] Received activate cluster request with BaselineTopology[id=0] initiator node ID: 00030eb5-84b3-4665-8392-0c8c650f4000 [21:07:29] : [Step 4/5] [2021-11-19 21:07:29,811][INFO ][disco-notifier-worker-#14535%grid-0%][GridClusterStateProcessor] Started state transition: activate cluster [21:07:29] : [Step 4/5] [2021-11-19 21:07:29,812][INFO ][exchange-worker-#14540%grid-0%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], crd=true, evt=DISCOVERY_CUSTOM_EVT, evtNode=00030eb5-84b3-4665-8392-0c8c650f4000, customEvt=ChangeGlobalStateMessage [id=1345d593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqId=f93fe445-43f2-4767-9bff-69321137eebe, initiatingNodeId=00030eb5-84b3-4665-8392-0c8c650f4000, state=ACTIVE, baselineTopology=BaselineTopology [id=0, branchingHash=-2475315501, branchingType='New BaselineTopology', baselineNodes=[grid-1, grid-0]], forceChangeBaselineTopology=false, timestamp=1637345249805, forceDeactivation=true], allowMerge=false, exchangeFreeSwitch=false] [21:07:29] : [Step 4/5] [2021-11-19 21:07:29,813][INFO ][exchange-worker-#14540%grid-0%][GridDhtPartitionsExchangeFuture] Start activation process [nodeId=00030eb5-84b3-4665-8392-0c8c650f4000, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]]. New state: ACTIVE [21:07:29] : [Step 4/5] [2021-11-19 21:07:29,813][INFO ][exchange-worker-#14540%grid-0%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0 [21:07:29] : [Step 4/5] [2021-11-19 21:07:29,816][INFO ][disco-notifier-worker-#14654%grid-1%][GridClusterStateProcessor] Received activate cluster request with BaselineTopology[id=0] initiator node ID: 00030eb5-84b3-4665-8392-0c8c650f4000 [21:07:29] : [Step 4/5] [2021-11-19 21:07:29,818][INFO ][disco-notifier-worker-#14654%grid-1%][GridClusterStateProcessor] Started state transition: activate cluster [21:07:29] : [Step 4/5] [2021-11-19 21:07:29,826][INFO ][exchange-worker-#14663%grid-1%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], crd=false, evt=DISCOVERY_CUSTOM_EVT, evtNode=00030eb5-84b3-4665-8392-0c8c650f4000, customEvt=ChangeGlobalStateMessage [id=1345d593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqId=f93fe445-43f2-4767-9bff-69321137eebe, initiatingNodeId=00030eb5-84b3-4665-8392-0c8c650f4000, state=ACTIVE, baselineTopology=BaselineTopology [id=0, branchingHash=-2475315501, branchingType='New BaselineTopology', baselineNodes=[grid-1, grid-0]], forceChangeBaselineTopology=false, timestamp=1637345249805, forceDeactivation=true], allowMerge=false, exchangeFreeSwitch=false] [21:07:29] : [Step 4/5] [2021-11-19 21:07:29,827][INFO ][exchange-worker-#14663%grid-1%][GridDhtPartitionsExchangeFuture] Start activation process [nodeId=1074fba4-df16-419e-9e72-5573d5ed6001, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]]. New state: ACTIVE [21:07:29] : [Step 4/5] [2021-11-19 21:07:29,828][INFO ][exchange-worker-#14540%grid-0%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000000.wal, offset=13104, ver=2] [21:07:29] : [Step 4/5] [2021-11-19 21:07:29,832][INFO ][exchange-worker-#14663%grid-1%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1 [21:07:29] : [Step 4/5] [2021-11-19 21:07:29,864][INFO ][exchange-worker-#14663%grid-1%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000000.wal, offset=13104, ver=2] [21:07:29] : [Step 4/5] [2021-11-19 21:07:29,905][INFO ][exchange-worker-#14663%grid-1%][GridClusterStateProcessor] Writing BaselineTopology[id=0] [21:07:29] : [Step 4/5] [2021-11-19 21:07:29,905][INFO ][exchange-worker-#14540%grid-0%][GridClusterStateProcessor] Writing BaselineTopology[id=0] [21:07:29] : [Step 4/5] [2021-11-19 21:07:29,908][INFO ][exchange-worker-#14663%grid-1%][GridCacheDatabaseSharedManager] Finish recovery performed in 75 ms. [21:07:29] : [Step 4/5] [2021-11-19 21:07:29,909][INFO ][exchange-worker-#14663%grid-1%][msg] Components activation performed in 82 ms. [21:07:29] : [Step 4/5] [2021-11-19 21:07:29,910][INFO ][exchange-worker-#14663%grid-1%][GridCacheProcessor] Finished recovery for cache [cache=encrypted, grp=encrypted, startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:07:29] : [Step 4/5] [2021-11-19 21:07:29,911][INFO ][sys-#14643%grid-1%][GridCacheProcessor] Finished recovery for cache [cache=ignite-sys-cache, grp=ignite-sys-cache, startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:07:29]W: [org.apache.ignite:ignite-core] [2021-11-19 21:07:29,914][WARN ][sys-#14650%grid-1%][CacheAffinitySharedManager] Cache group 'encrypted' brings high overhead for its metainformation in data region 'default'. Metainformation required for its partitions (522 partitions, 4096 bytes per partition, 2 MBs total) will consume more than 15% of data region memory (10 MBs). It may lead to critical errors on the node and cluster instability. Please reduce number of partitions, add more memory to the data region or add more server nodes for this cache group. [21:07:29] : [Step 4/5] [2021-11-19 21:07:29,915][INFO ][exchange-worker-#14663%grid-1%][GridDhtPartitionsExchangeFuture] Successfully activated caches [nodeId=1074fba4-df16-419e-9e72-5573d5ed6001, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], newState=ACTIVE] [21:07:29]W: [org.apache.ignite:ignite-core] [2021-11-19 21:07:29,916][WARN ][sys-#14652%grid-1%][CacheAffinitySharedManager] Cache group 'encrypted' brings high overhead for its metainformation in data region 'default'. Metainformation required for its partitions (522 partitions, 4096 bytes per partition, 2 MBs total) will consume more than 15% of data region memory (10 MBs). It may lead to critical errors on the node and cluster instability. Please reduce number of partitions, add more memory to the data region or add more server nodes for this cache group. [21:07:29] : [Step 4/5] [2021-11-19 21:07:29,917][INFO ][exchange-worker-#14663%grid-1%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:07:29] : [Step 4/5] [2021-11-19 21:07:29,920][INFO ][exchange-worker-#14540%grid-0%][GridCacheDatabaseSharedManager] Finish recovery performed in 106 ms. [21:07:29] : [Step 4/5] [2021-11-19 21:07:29,923][INFO ][exchange-worker-#14540%grid-0%][msg] Components activation performed in 110 ms. [21:07:29] : [Step 4/5] [2021-11-19 21:07:29,925][INFO ][exchange-worker-#14540%grid-0%][GridCacheProcessor] Finished recovery for cache [cache=ignite-sys-cache, grp=ignite-sys-cache, startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:07:29] : [Step 4/5] [2021-11-19 21:07:29,926][INFO ][sys-#14525%grid-0%][GridCacheProcessor] Finished recovery for cache [cache=encrypted, grp=encrypted, startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:07:29] : [Step 4/5] [2021-11-19 21:07:29,931][INFO ][exchange-worker-#14540%grid-0%][GridDhtPartitionsExchangeFuture] Successfully activated caches [nodeId=00030eb5-84b3-4665-8392-0c8c650f4000, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], newState=ACTIVE] [21:07:29]W: [org.apache.ignite:ignite-core] [2021-11-19 21:07:29,930][WARN ][exchange-worker-#14540%grid-0%][CacheAffinitySharedManager] Cache group 'encrypted' brings high overhead for its metainformation in data region 'default'. Metainformation required for its partitions (502 partitions, 4096 bytes per partition, 1 MBs total) will consume more than 15% of data region memory (10 MBs). It may lead to critical errors on the node and cluster instability. Please reduce number of partitions, add more memory to the data region or add more server nodes for this cache group. [21:07:29]W: [org.apache.ignite:ignite-core] [2021-11-19 21:07:29,932][WARN ][sys-#14514%grid-0%][CacheAffinitySharedManager] Cache group 'encrypted' brings high overhead for its metainformation in data region 'default'. Metainformation required for its partitions (502 partitions, 4096 bytes per partition, 1 MBs total) will consume more than 15% of data region memory (10 MBs). It may lead to critical errors on the node and cluster instability. Please reduce number of partitions, add more memory to the data region or add more server nodes for this cache group. [21:07:29] : [Step 4/5] [2021-11-19 21:07:29,935][INFO ][exchange-worker-#14540%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:07:30] : [Step 4/5] [2021-11-19 21:07:30,008][INFO ][db-checkpoint-thread-#14672%grid-1%][Checkpointer] Checkpoint started [checkpointId=bc5ae79a-c166-4801-9dda-bc6ecfacf3cd, startPtr=WALPointer [idx=0, fileOff=165523, len=11887], checkpointBeforeLockTime=5ms, checkpointLockWait=5ms, checkpointListenersExecuteTime=1ms, checkpointLockHoldTime=2ms, walCpRecordFsyncDuration=8ms, writeCheckpointEntryDuration=2ms, splitAndSortCpPagesDuration=0ms, pages=24, reason='node started'] [21:07:30] : [Step 4/5] [2021-11-19 21:07:30,008][INFO ][grid-nio-worker-tcp-comm-0-#14478%TcpCommunicationSpi%][TcpCommunicationSpi] Accepted incoming communication connection [locAddr=/127.0.0.1:45170, rmtAddr=/127.0.0.1:41888] [21:07:30] : [Step 4/5] [2021-11-19 21:07:30,030][INFO ][grid-nio-worker-tcp-comm-0-#14597%TcpCommunicationSpi%][TcpCommunicationSpi] Established outgoing communication connection [locAddr=/127.0.0.1:41888, rmtAddr=/127.0.0.1:45170] [21:07:30] : [Step 4/5] [2021-11-19 21:07:30,031][INFO ][exchange-worker-#14663%grid-1%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], crd=false] [21:07:30] : [Step 4/5] [2021-11-19 21:07:30,062][INFO ][exchange-worker-#14540%grid-0%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], crd=true] [21:07:30] : [Step 4/5] [2021-11-19 21:07:30,064][INFO ][sys-#14511%grid-0%][GridDhtPartitionsExchangeFuture] Coordinator received single message [ver=AffinityTopologyVersion [topVer=2, minorTopVer=1], node=1074fba4-df16-419e-9e72-5573d5ed6001, allReceived=true] [21:07:30] : [Step 4/5] [2021-11-19 21:07:30,066][INFO ][sys-#14511%grid-0%][GridDhtPartitionsExchangeFuture] finishExchangeOnCoordinator [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:07:30] : [Step 4/5] [2021-11-19 21:07:30,078][INFO ][sys-#14511%grid-0%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], err=null, rebalanced=true, wasRebalanced=false] [21:07:30] : [Step 4/5] [2021-11-19 21:07:30,078][INFO ][disco-notifier-worker-#14654%grid-1%][GridClusterStateProcessor] Received state change finish message: ACTIVE [21:07:30] : [Step 4/5] [2021-11-19 21:07:30,078][INFO ][disco-notifier-worker-#14535%grid-0%][GridClusterStateProcessor] Received state change finish message: ACTIVE [21:07:30] : [Step 4/5] [2021-11-19 21:07:30,081][INFO ][disco-notifier-worker-#14654%grid-1%][GridClusterStateProcessor] Cluster state was changed from INACTIVE to ACTIVE [21:07:30] : [Step 4/5] [2021-11-19 21:07:30,081][INFO ][disco-notifier-worker-#14535%grid-0%][GridClusterStateProcessor] Cluster state was changed from INACTIVE to ACTIVE [21:07:30] : [Step 4/5] [2021-11-19 21:07:30,085][INFO ][sys-#14640%grid-1%][GridDhtPartitionsExchangeFuture] Received full message, will finish exchange [node=00030eb5-84b3-4665-8392-0c8c650f4000, resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:07:30] : [Step 4/5] [2021-11-19 21:07:30,089][INFO ][sys-#14640%grid-1%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], err=null, rebalanced=true, wasRebalanced=false] [21:07:30] : [Step 4/5] [2021-11-19 21:07:30,089][INFO ][sys-#14636%grid-1%][GridCachePartitionExchangeManager] Delay process full message without exchange id (there is exchange in progress) [nodeId=00030eb5-84b3-4665-8392-0c8c650f4000] [21:07:30] : [Step 4/5] [2021-11-19 21:07:30,096][INFO ][sys-#14511%grid-0%][GridCacheProcessor] Finish proxy initialization, cacheName=ignite-sys-cache, localNodeId=00030eb5-84b3-4665-8392-0c8c650f4000 [21:07:30] : [Step 4/5] [2021-11-19 21:07:30,098][INFO ][sys-#14511%grid-0%][GridCacheProcessor] Finish proxy initialization, cacheName=encrypted, localNodeId=00030eb5-84b3-4665-8392-0c8c650f4000 [21:07:30] : [Step 4/5] [2021-11-19 21:07:30,098][INFO ][sys-#14640%grid-1%][GridCacheProcessor] Finish proxy initialization, cacheName=ignite-sys-cache, localNodeId=1074fba4-df16-419e-9e72-5573d5ed6001 [21:07:30] : [Step 4/5] [2021-11-19 21:07:30,099][INFO ][sys-#14511%grid-0%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=00030eb5-84b3-4665-8392-0c8c650f4000, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=00030eb5-84b3-4665-8392-0c8c650f4000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345250075, loc=true, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:07:30] : [Step 4/5] [2021-11-19 21:07:30,098][INFO ][sys-#14514%grid-0%][DistributedBaselineConfiguration] Baseline auto-adjust is 'disabled' with timeout='300000' ms [21:07:30] : [Step 4/5] [2021-11-19 21:07:30,101][INFO ][sys-#14514%grid-0%][GridClusterStateProcessor] Successfully performed final activation steps [nodeId=00030eb5-84b3-4665-8392-0c8c650f4000, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:07:30] : [Step 4/5] [2021-11-19 21:07:30,099][INFO ][exchange-worker-#14540%grid-0%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=2, minorTopVer=1], force=false, evt=DISCOVERY_CUSTOM_EVT, node=00030eb5-84b3-4665-8392-0c8c650f4000] [21:07:30] : [Step 4/5] [2021-11-19 21:07:30,099][INFO ][sys-#14640%grid-1%][GridCacheProcessor] Finish proxy initialization, cacheName=encrypted, localNodeId=1074fba4-df16-419e-9e72-5573d5ed6001 [21:07:30] : [Step 4/5] [2021-11-19 21:07:30,101][INFO ][sys-#14511%grid-0%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (1 ms), stage="Update caches registry" (111 ms), stage="Start caches" (2 ms), stage="Affinity initialization on cache group start" (3 ms), stage="Determine exchange type" (3 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Restore partition states" (0 ms), stage="After states restored callback" (126 ms), stage="WAL history reservation" (0 ms), stage="Waiting for all single messages" (3 ms), stage="Affinity recalculation (crd)" (1 ms), stage="Collect update counters and create affinity messages" (0 ms), stage="Assign partitions states" (2 ms), stage="Validate partitions states" (0 ms), stage="Ideal affinity diff calculation (enforced)" (3 ms), stage="Apply update counters" (0 ms), stage="Full message preparing" (3 ms), stage="Full message sending" (0 ms), stage="State finish message sending" (0 ms), stage="Detect lost partitions" (7 ms), stage="Exchange done" (15 ms), stage="Total time" (280 ms), Discovery lag=8 ms, Latest started node id=1074fba4-df16-419e-9e72-5573d5ed6001] [21:07:30] : [Step 4/5] [2021-11-19 21:07:30,111][INFO ][sys-#14511%grid-0%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], stage="Affinity initialization on cache group start [grp=encrypted]" (2 ms) (parent=Affinity initialization on cache group start), stage="Affinity initialization on cache group start [grp=ignite-sys-cache]" (1 ms) (parent=Affinity initialization on cache group start), stage="Affinity centralized initialization (crd) [grp=ignite-sys-cache, crd=true]" (0 ms) (parent=Determine exchange type), stage="Affinity centralized initialization (crd) [grp=encrypted, crd=true]" (0 ms) (parent=Determine exchange type), stage="Restore partition states [grp=ignite-sys-cache]" (0 ms) (parent=Restore partition states), stage="Restore partition states [grp=encrypted]" (0 ms) (parent=Restore partition states), stage="Affinity recalculation (partitions availability) [grp=encrypted]" (3 ms) (parent=Ideal affinity diff calculation (enforced)), stage="Affinity recalculation (partitions availability) [grp=ignite-sys-cache]" (0 ms) (parent=Ideal affinity diff calculation (enforced))] [21:07:30] : [Step 4/5] [2021-11-19 21:07:30,110][INFO ][sys-#14640%grid-1%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=1074fba4-df16-419e-9e72-5573d5ed6001, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=00030eb5-84b3-4665-8392-0c8c650f4000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345249734, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:07:30] : [Step 4/5] [2021-11-19 21:07:30,105][INFO ][sys-#14630%grid-1%][DistributedBaselineConfiguration] Baseline auto-adjust is 'disabled' with timeout='300000' ms [21:07:30] : [Step 4/5] [2021-11-19 21:07:30,274][INFO ][sys-#14630%grid-1%][GridClusterStateProcessor] Successfully performed final activation steps [nodeId=1074fba4-df16-419e-9e72-5573d5ed6001, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:07:30] : [Step 4/5] [2021-11-19 21:07:30,274][INFO ][sys-#14640%grid-1%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], stage="Waiting in exchange queue" (6 ms), stage="Exchange parameters initialization" (1 ms), stage="Update caches registry" (82 ms), stage="Start caches" (1 ms), stage="Affinity initialization on cache group start" (2 ms), stage="Determine exchange type" (2 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Restore partition states" (0 ms), stage="After states restored callback" (82 ms), stage="WAL history reservation" (0 ms), stage="Waiting for Full message" (85 ms), stage="Affinity recalculation" (2 ms), stage="Full map updating" (0 ms), stage="Detect lost partitions" (7 ms), stage="Exchange done" (177 ms), stage="Total time" (447 ms)] [21:07:30] : [Step 4/5] [2021-11-19 21:07:30,119][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][root] awaitPartitionMapExchange finished [21:07:30] : [Step 4/5] [2021-11-19 21:07:30,112][INFO ][exchange-worker-#14663%grid-1%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=2, minorTopVer=1], force=false, evt=DISCOVERY_CUSTOM_EVT, node=00030eb5-84b3-4665-8392-0c8c650f4000] [21:07:30] : [Step 4/5] [2021-11-19 21:07:30,285][INFO ][sys-#14640%grid-1%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], stage="Affinity initialization on cache group start [grp=encrypted]" (1 ms) (parent=Affinity initialization on cache group start), stage="Affinity initialization on cache group start [grp=ignite-sys-cache]" (0 ms) (parent=Affinity initialization on cache group start), stage="Affinity centralized initialization (crd) [grp=ignite-sys-cache, crd=false]" (0 ms) (parent=Determine exchange type), stage="Affinity centralized initialization (crd) [grp=encrypted, crd=false]" (0 ms) (parent=Determine exchange type), stage="Restore partition states [grp=ignite-sys-cache]" (0 ms) (parent=Restore partition states), stage="Restore partition states [grp=encrypted]" (0 ms) (parent=Restore partition states), stage="Affinity applying from full message [grp=ignite-sys-cache]" (2 ms) (parent=Affinity recalculation), stage="Affinity applying from full message [grp=encrypted]" (2 ms) (parent=Affinity recalculation)] [21:07:31] : [Step 4/5] [2021-11-19 21:07:31,235][INFO ][db-checkpoint-thread-#14677%grid-0%][Checkpointer] Checkpoint started [checkpointId=8e8fa152-e6c9-4a2b-a415-21f74a424450, startPtr=WALPointer [idx=0, fileOff=162363, len=11507], checkpointBeforeLockTime=12ms, checkpointLockWait=40ms, checkpointListenersExecuteTime=3ms, checkpointLockHoldTime=10ms, walCpRecordFsyncDuration=91ms, writeCheckpointEntryDuration=1082ms, splitAndSortCpPagesDuration=0ms, pages=24, reason='node started'] [21:07:31] : [Step 4/5] [2021-11-19 21:07:31,341][INFO ][db-checkpoint-thread-#14672%grid-1%][Checkpointer] Checkpoint finished [cpId=bc5ae79a-c166-4801-9dda-bc6ecfacf3cd, pages=24, markPos=WALPointer [idx=0, fileOff=165523, len=11887], walSegmentsCovered=[], markDuration=14ms, pagesWrite=47ms, fsync=1285ms, total=1356ms] [21:07:32] : [Step 4/5] [2021-11-19 21:07:32,650][INFO ][db-checkpoint-thread-#14677%grid-0%][Checkpointer] Checkpoint finished [cpId=8e8fa152-e6c9-4a2b-a415-21f74a424450, pages=24, markPos=WALPointer [idx=0, fileOff=162363, len=11507], walSegmentsCovered=[], markDuration=1184ms, pagesWrite=21ms, fsync=1393ms, total=2650ms] [21:07:38] : [Step 4/5] [2021-11-19 21:07:38,296][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][root] >>> Stopping grid [name=grid-1, id=1074fba4-df16-419e-9e72-5573d5ed6001] [21:07:39] : [Step 4/5] [2021-11-19 21:07:39,303][INFO ][db-checkpoint-thread-#14672%grid-1%][Checkpointer] Checkpoint started [checkpointId=93e37ec0-1622-4ae5-82fb-a5550cdcf1a2, startPtr=WALPointer [idx=0, fileOff=649805, len=11871], checkpointBeforeLockTime=5ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=314ms, writeCheckpointEntryDuration=682ms, splitAndSortCpPagesDuration=0ms, pages=447, reason='timeout'] [21:07:39] : [Step 4/5] [2021-11-19 21:07:39,309][INFO ][tcp-disco-sock-reader-[00030eb5 127.0.0.1:50891]-#766%grid-1%-#14659%grid-1%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:50891, rmtPort=50891, rmtNodeId=00030eb5-84b3-4665-8392-0c8c650f4000] [21:07:39] : [Step 4/5] [2021-11-19 21:07:39,310][INFO ][disco-event-worker-#14539%grid-0%][GridDiscoveryManager] Node left topology: TcpDiscoveryNode [id=1074fba4-df16-419e-9e72-5573d5ed6001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637345249701, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false] [21:07:39] : [Step 4/5] [2021-11-19 21:07:39,311][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][GridCacheProcessor] Stopped cache [cacheName=encrypted] [21:07:39] : [Step 4/5] [2021-11-19 21:07:39,312][INFO ][disco-event-worker-#14539%grid-0%][GridDiscoveryManager] Topology snapshot [ver=3, locNode=00030eb5, servers=1, clients=0, state=ACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=00030eb5-84b3-4665-8392-0c8c650f4000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:07:39] : [Step 4/5] [2021-11-19 21:07:39,312][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][GridCacheProcessor] Stopped cache [cacheName=ignite-sys-cache] [21:07:39] : [Step 4/5] [2021-11-19 21:07:39,313][INFO ][disco-event-worker-#14539%grid-0%][GridDiscoveryManager] ^-- Baseline [id=0, size=2, online=1, offline=1] [21:07:39]W: [org.apache.ignite:ignite-core] [2021-11-19 21:07:39,314][WARN ][grid-nio-worker-tcp-comm-0-#14478%TcpCommunicationSpi%][TcpCommunicationSpi] Failed to shutdown socket [21:07:39]W: [org.apache.ignite:ignite-core] java.nio.channels.ClosedChannelException [21:07:39]W: [org.apache.ignite:ignite-core] at sun.nio.ch.SocketChannelImpl.shutdownOutput(SocketChannelImpl.java:795) [21:07:39]W: [org.apache.ignite:ignite-core] at sun.nio.ch.SocketAdaptor.shutdownOutput(SocketAdaptor.java:407) [21:07:39]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.close(IgniteUtils.java:4247) [21:07:39]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.closeKey(GridNioServer.java:2784) [21:07:39]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.close(GridNioServer.java:2835) [21:07:39]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.close(GridNioServer.java:2794) [21:07:39]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.bodyInternal(GridNioServer.java:2157) [21:07:39]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.body(GridNioServer.java:1910) [21:07:39]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:125) [21:07:39]W: [org.apache.ignite:ignite-core] at java.lang.Thread.run(Thread.java:748) [21:07:39] : [Step 4/5] [2021-11-19 21:07:39,316][INFO ][exchange-worker-#14540%grid-0%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], crd=true, evt=NODE_LEFT, evtNode=1074fba4-df16-419e-9e72-5573d5ed6001, customEvt=null, allowMerge=false, exchangeFreeSwitch=true] [21:07:39] : [Step 4/5] [2021-11-19 21:07:39,318][INFO ][sys-#14512%grid-0%][GridAffinityAssignmentCache] Local node affinity assignment distribution is not ideal [cache=encrypted, expectedPrimary=1024.00, actualPrimary=502, expectedBackups=0.00, actualBackups=0, warningThreshold=50.00%] [21:07:39] : [Step 4/5] [2021-11-19 21:07:39,319][INFO ][exchange-worker-#14540%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:07:39] : [Step 4/5] [2021-11-19 21:07:39,321][INFO ][exchange-worker-#14540%grid-0%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], err=null, rebalanced=true, wasRebalanced=true] [21:07:39]W: [org.apache.ignite:ignite-core] [2021-11-19 21:07:39,322][WARN ][exchange-worker-#14540%grid-0%][GridDhtPartitionTopologyImpl] Detected lost partitions [grp=encrypted, parts=[0, 2, 4, 6-7, 10-11, 14, 17, 21, 24-30, 32, 37, 40, 44, 47-52, 54, 57, 59, 62-64, 67-68, 74-75, 78, 81, 87-88, 91, 97, 99, 101-102, 104-107, 113-114, 116, 118, 120, 122, 124, 135-136, 138, 140-145, 147, 149-152, 154-156, 159-160, 162-164, 169, 172, 175-177, 180, 184-187, 190-191, 194, 196-202, 204-205, 209-210, 212, 214, 216, 219-224, 226, 229-232, 237, 239, 241, 243-245, 247, 249-251, 255, 257, 261, 265, 269, 272-273, 276-277, 281-282, 285, 287, 289-291, 293-297, 299, 301-304, 306, 308-309, 311-312, 315-317, 319, 322, 325-326, 328-330, 336, 339, 341, 344-346, 350, 352-354, 357-361, 363, 366-367, 371-373, 376-380, 383, 385, 387-388, 390, 392, 395-397, 400, 402, 405, 408-411, 416, 420, 422, 424-425, 429, 433, 435-438, 440-441, 445-446, 450, 452-453, 455-456, 458, 460, 462-463, 465-468, 470, 474-475, 480, 488, 490-492, 495, 497, 499-512, 516, 525, 527-531, 535, 537-538, 541-542, 545-546, 548-552, 554-555, 558, 562-564, 567-569, 572, 574, 579-580, 582-585, 587, 590-591, 594, 596, 600, 602, 604, 607-614, 617-620, 623-624, 627-629, 632-633, 636, 638, 640-642, 645-646, 648-649, 657-662, 664-665, 668-672, 677-678, 682-684, 686, 689, 692-693, 695-697, 699, 706-707, 709-710, 712-714, 716-717, 719-721, 723-728, 730-732, 734-735, 739, 742, 746, 749-750, 752, 754, 756, 762, 768-770, 772-775, 778, 780, 783-787, 789-791, 793, 796, 798-801, 803, 806, 809-812, 814, 816-817, 819, 822-825, 827-829, 832-833, 836-837, 839-840, 846, 848-851, 853-854, 857-858, 860, 863-864, 866, 868-871, 873-875, 877-878, 884, 888-889, 896-897, 900, 905-907, 914-915, 917, 919-920, 923-925, 931-933, 936, 940, 942, 944-945, 948, 950-951, 954, 956-958, 962, 965-970, 972, 975-976, 978-980, 983, 985, 988, 990, 993-994, 997-998, 1000, 1003-1004, 1007, 1009, 1014, 1016, 1018-1019], topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0]] [21:07:39] : [Step 4/5] [2021-11-19 21:07:39,326][INFO ][exchange-worker-#14540%grid-0%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=00030eb5-84b3-4665-8392-0c8c650f4000, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], evt=NODE_LEFT, evtNode=TcpDiscoveryNode [id=1074fba4-df16-419e-9e72-5573d5ed6001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637345249701, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0]] [21:07:39] : [Step 4/5] [2021-11-19 21:07:39,327][INFO ][exchange-worker-#14540%grid-0%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (2 ms), stage="Determine exchange type" (1 ms), stage="Preloading notification" (0 ms), stage="After states restored callback" (0 ms), stage="WAL history reservation" (0 ms), stage="Finalize update counters" (0 ms), stage="Detect lost partitions" (4 ms), stage="Exchange done" (1 ms), stage="Total time" (8 ms)] [21:07:39] : [Step 4/5] [2021-11-19 21:07:39,328][INFO ][exchange-worker-#14540%grid-0%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], stage="Affinity initialization (exchange-free switch on fully-rebalanced topology) [grp=ignite-sys-cache]" (0 ms) (parent=Determine exchange type), stage="Affinity initialization (exchange-free switch on fully-rebalanced topology) [grp=encrypted]" (0 ms) (parent=Determine exchange type)] [21:07:39] : [Step 4/5] [2021-11-19 21:07:39,329][INFO ][exchange-worker-#14540%grid-0%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], crd=true] [21:07:39] : [Step 4/5] [2021-11-19 21:07:39,330][INFO ][exchange-worker-#14540%grid-0%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=3, minorTopVer=0], force=false, evt=NODE_LEFT, node=1074fba4-df16-419e-9e72-5573d5ed6001] [21:07:39] : [Step 4/5] [2021-11-19 21:07:39,678][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][FilePageStoreManager] Cleanup cache stores [total=4, left=0, cleanFiles=false] [21:07:39] : [Step 4/5] [2021-11-19 21:07:39,680][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][GridDeploymentLocalStore] Removed undeployed class: GridDeployment [ts=1637345250075, depMode=SHARED, clsLdr=IsolatedClassLoader{roleName='test'}, clsLdrId=a445d593d71-1074fba4-df16-419e-9e72-5573d5ed6001, userVer=0, loc=true, sampleClsName=org.apache.ignite.internal.processors.cache.distributed.dht.preloader.IgniteDhtPartitionHistorySuppliersMap, pendingUndeploy=false, undeployed=true, usage=0] [21:07:39] : [Step 4/5] [2021-11-19 21:07:39,688][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][IgniteKernal%grid-1] [21:07:39] : [Step 4/5] [21:07:39] : [Step 4/5] >>> +------------------------------------------------------+ [21:07:39] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV stopped OK [21:07:39] : [Step 4/5] >>> +------------------------------------------------------+ [21:07:39] : [Step 4/5] >>> Ignite instance name: grid-1 [21:07:39] : [Step 4/5] >>> Grid uptime: 00:00:09.889 [21:07:39] : [Step 4/5] [21:07:39] : [Step 4/5] [21:07:39] : [Step 4/5] [2021-11-19 21:07:39,689][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][root] >>> Stopping grid [name=grid-0, id=00030eb5-84b3-4665-8392-0c8c650f4000] [21:07:39] : [Step 4/5] [2021-11-19 21:07:39,715][INFO ][db-checkpoint-thread-#14677%grid-0%][Checkpointer] Checkpoint started [checkpointId=f3aa27fa-c546-4212-95ca-8da087d84317, startPtr=WALPointer [idx=0, fileOff=764872, len=11491], checkpointBeforeLockTime=5ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=1ms, checkpointLockHoldTime=5ms, walCpRecordFsyncDuration=9ms, writeCheckpointEntryDuration=2ms, splitAndSortCpPagesDuration=1ms, pages=567, reason='timeout'] [21:07:39] : [Step 4/5] [2021-11-19 21:07:39,720][INFO ][tcp-disco-sock-reader-[1074fba4 127.0.0.1:40549]-#767%grid-0%-#14660%grid-0%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:40549, rmtPort=40549, rmtNodeId=1074fba4-df16-419e-9e72-5573d5ed6001] [21:07:39] : [Step 4/5] [2021-11-19 21:07:39,723][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][GridCacheProcessor] Stopped cache [cacheName=encrypted] [21:07:39] : [Step 4/5] [2021-11-19 21:07:39,724][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][GridCacheProcessor] Stopped cache [cacheName=ignite-sys-cache] [21:07:40] : [Step 4/5] [2021-11-19 21:07:40,216][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][FilePageStoreManager] Cleanup cache stores [total=4, left=0, cleanFiles=false] [21:07:40] : [Step 4/5] [2021-11-19 21:07:40,218][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][GridDeploymentLocalStore] Removed undeployed class: GridDeployment [ts=1637345250015, depMode=SHARED, clsLdr=IsolatedClassLoader{roleName='test'}, clsLdrId=d345d593d71-00030eb5-84b3-4665-8392-0c8c650f4000, userVer=0, loc=true, sampleClsName=org.apache.ignite.internal.processors.cache.distributed.dht.preloader.GridDhtPartitionMap, pendingUndeploy=false, undeployed=true, usage=0] [21:07:40] : [Step 4/5] [2021-11-19 21:07:40,226][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][IgniteKernal%grid-0] [21:07:40] : [Step 4/5] [21:07:40] : [Step 4/5] >>> +------------------------------------------------------+ [21:07:40] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV stopped OK [21:07:40] : [Step 4/5] >>> +------------------------------------------------------+ [21:07:40] : [Step 4/5] >>> Ignite instance name: grid-0 [21:07:40] : [Step 4/5] >>> Grid uptime: 00:00:12.552 [21:07:40] : [Step 4/5] [21:07:40] : [Step 4/5] [21:07:40]W: [org.apache.ignite:ignite-core] [2021-11-19 21:07:40,231][WARN ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][G] Ignite work directory is not provided, automatically resolved to: /opt/buildagent/work/7bc1c54bc719b67c/work [21:07:40] : [Step 4/5] [2021-11-19 21:07:40,233][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][IgniteKernal%grid-0] [21:07:40] : [Step 4/5] [21:07:40] : [Step 4/5] >>> __________ ________________ [21:07:40] : [Step 4/5] >>> / _/ ___/ |/ / _/_ __/ __/ [21:07:40] : [Step 4/5] >>> _/ // (7 7 // / / / / _/ [21:07:40] : [Step 4/5] >>> /___/\___/_/|_/___/ /_/ /___/ [21:07:40] : [Step 4/5] >>> [21:07:40] : [Step 4/5] >>> ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:07:40] : [Step 4/5] >>> 2021 Copyright(C) Apache Software Foundation [21:07:40] : [Step 4/5] >>> [21:07:40] : [Step 4/5] >>> Ignite documentation: http://ignite.apache.org [21:07:40] : [Step 4/5] [21:07:40] : [Step 4/5] [2021-11-19 21:07:40,234][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][IgniteKernal%grid-0] Config URL: n/a [21:07:40] : [Step 4/5] [2021-11-19 21:07:40,234][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][IgniteKernal%grid-0] IgniteConfiguration [igniteInstanceName=grid-0, pubPoolSize=24, svcPoolSize=24, callbackPoolSize=24, stripedPoolSize=24, sysPoolSize=24, mgmtPoolSize=4, dataStreamerPoolSize=24, utilityCachePoolSize=24, utilityCacheKeepAliveTime=60000, p2pPoolSize=2, qryPoolSize=24, buildIdxPoolSize=4, igniteHome=/opt/buildagent/work/7bc1c54bc719b67c, igniteWorkDir=/opt/buildagent/work/7bc1c54bc719b67c/work, mbeanSrv=com.sun.jmx.mbeanserver.JmxMBeanServer@6fe85038, nodeId=00983e3d-511c-4870-a39b-cacb053c0000, marsh=BinaryMarshaller [], marshLocJobs=false, daemon=false, p2pEnabled=true, netTimeout=10000, netCompressionLevel=1, sndRetryDelay=1000, sndRetryCnt=3, metricsHistSize=10000, metricsUpdateFreq=1000, metricsExpTime=9223372036854775807, discoSpi=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=0, ackTimeout=0, marsh=null, reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], segPlc=STOP, segResolveAttempts=2, waitForSegOnStart=true, allResolversPassReq=true, segChkFreq=10000, commSpi=TcpCommunicationSpi [connectGate=org.apache.ignite.spi.communication.tcp.internal.ConnectGateway@38d73b66, ctxInitLatch=java.util.concurrent.CountDownLatch@4d76f1be[Count = 1], stopping=false, clientPool=null, nioSrvWrapper=null, stateProvider=null], evtSpi=MemoryEventStorageSpi [expireAgeMs=9223372036854775807, expireCnt=10000, filter=null], colSpi=NoopCollisionSpi [], deploySpi=LocalDeploymentSpi [], indexingSpi=org.apache.ignite.spi.indexing.noop.NoopIndexingSpi@4d50ba5f, addrRslvr=null, encryptionSpi=org.apache.ignite.spi.encryption.keystore.KeystoreEncryptionSpi@4864584a, tracingSpi=org.apache.ignite.spi.tracing.NoopTracingSpi@1c51874d, clientMode=false, rebalanceThreadPoolSize=4, rebalanceTimeout=10000, rebalanceBatchesPrefetchCnt=3, rebalanceThrottle=0, rebalanceBatchSize=524288, txCfg=TransactionConfiguration [txSerEnabled=false, dfltIsolation=REPEATABLE_READ, dfltConcurrency=PESSIMISTIC, dfltTxTimeout=0, txTimeoutOnPartitionMapExchange=0, deadlockTimeout=10000, pessimisticTxLogSize=0, pessimisticTxLogLinger=10000, tmLookupClsName=null, txManagerFactory=null, useJtaSync=false], cacheSanityCheckEnabled=true, discoStartupDelay=60000, deployMode=SHARED, p2pMissedCacheSize=100, locHost=127.0.0.1, timeSrvPortBase=31100, timeSrvPortRange=100, failureDetectionTimeout=10000, sysWorkerBlockedTimeout=null, clientFailureDetectionTimeout=10000, metricsLogFreq=0, connectorCfg=null, odbcCfg=null, warmupClos=null, atomicCfg=AtomicConfiguration [seqReserveSize=1000, cacheMode=PARTITIONED, backups=1, aff=null, grpName=null], classLdr=null, sslCtxFactory=null, platformCfg=null, binaryCfg=null, memCfg=null, pstCfg=null, dsCfg=DataStorageConfiguration [sysRegionInitSize=41943040, sysRegionMaxSize=104857600, pageSize=4096, concLvl=0, dfltDataRegConf=DataRegionConfiguration [name=default, maxSize=10485760, initSize=268435456, swapPath=null, pageEvictionMode=DISABLED, pageReplacementMode=CLOCK, evictionThreshold=0.9, emptyPagesPoolSize=100, metricsEnabled=false, metricsSubIntervalCount=5, metricsRateTimeInterval=60000, persistenceEnabled=true, checkpointPageBufSize=0, lazyMemoryAllocation=true, warmUpCfg=null], dataRegions=null, storagePath=null, checkpointFreq=180000, lockWaitTime=10000, checkpointThreads=4, checkpointWriteOrder=SEQUENTIAL, walHistSize=20, maxWalArchiveSize=1073741824, walSegments=10, walSegmentSize=67108864, walPath=db/wal, walArchivePath=db/wal/archive, cdcWalPath=db/wal/cdc, cdcEnabled=false, metricsEnabled=false, walMode=FSYNC, walTlbSize=131072, walBuffSize=0, walFlushFreq=2000, walFsyncDelay=1000, walRecordIterBuffSize=67108864, alwaysWriteFullPages=false, fileIOFactory=org.apache.ignite.internal.processors.cache.persistence.file.AsyncFileIOFactory@52f5944c, metricsSubIntervalCnt=5, metricsRateTimeInterval=60000, walAutoArchiveAfterInactivity=-1, walForceArchiveTimeout=-1, writeThrottlingEnabled=false, walCompactionEnabled=false, walCompactionLevel=1, checkpointReadLockTimeout=null, walPageCompression=DISABLED, walPageCompressionLevel=null, dfltWarmUpCfg=null, encCfg=org.apache.ignite.configuration.EncryptionConfiguration@41148c2c, defragmentationThreadPoolSize=4, minWalArchiveSize=-1], snapshotPath=snapshots, activeOnStart=true, activeOnStartPropSetFlag=false, autoActivation=true, autoActivationPropSetFlag=false, clusterStateOnStart=null, sqlConnCfg=null, cliConnCfg=ClientConnectorConfiguration [host=null, port=10800, portRange=100, sockSndBufSize=0, sockRcvBufSize=0, tcpNoDelay=true, maxOpenCursorsPerConn=128, threadPoolSize=24, selectorCnt=12, idleTimeout=0, handshakeTimeout=10000, jdbcEnabled=true, odbcEnabled=true, thinCliEnabled=true, sslEnabled=false, useIgniteSslCtxFactory=true, sslClientAuth=false, sslCtxFactory=null, thinCliCfg=ThinClientConfiguration [maxActiveTxPerConn=100, maxActiveComputeTasksPerConn=0]], mvccVacuumThreadCnt=2, mvccVacuumFreq=5000, authEnabled=false, failureHnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]], commFailureRslvr=null, sqlCfg=SqlConfiguration [longQryWarnTimeout=3000, dfltQryTimeout=0, sqlQryHistSize=1000, validationEnabled=false], asyncContinuationExecutor=null] [21:07:40] : [Step 4/5] [2021-11-19 21:07:40,242][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][IgniteKernal%grid-0] Daemon mode: off [21:07:40] : [Step 4/5] [2021-11-19 21:07:40,242][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][IgniteKernal%grid-0] OS: Linux 4.15.0-151-generic amd64 [21:07:40] : [Step 4/5] [2021-11-19 21:07:40,242][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][IgniteKernal%grid-0] OS user: teamcity [21:07:40] : [Step 4/5] [2021-11-19 21:07:40,243][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][IgniteKernal%grid-0] PID: 16724 [21:07:40] : [Step 4/5] [2021-11-19 21:07:40,243][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][IgniteKernal%grid-0] Language runtime: Java Platform API Specification ver. 1.8 [21:07:40] : [Step 4/5] [2021-11-19 21:07:40,243][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][IgniteKernal%grid-0] VM information: Java(TM) SE Runtime Environment 1.8.0_261-b12 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 25.261-b12 [21:07:40] : [Step 4/5] [2021-11-19 21:07:40,244][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][IgniteKernal%grid-0] VM total memory: 1.9GB [21:07:40] : [Step 4/5] [2021-11-19 21:07:40,244][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][IgniteKernal%grid-0] Remote Management [restart: off, REST: off, JMX (remote: off)] [21:07:40] : [Step 4/5] [2021-11-19 21:07:40,244][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][IgniteKernal%grid-0] Logger: GridTestLog4jLogger [quiet=false, config=null] [21:07:40] : [Step 4/5] [2021-11-19 21:07:40,245][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][IgniteKernal%grid-0] IGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c [21:07:40]W: [org.apache.ignite:ignite-core] [2021-11-19 21:07:40,250][WARN ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][IgniteKernal%grid-0] Peer class loading is enabled (disable it in production for performance and deployment consistency reasons) [21:07:40] : [Step 4/5] [2021-11-19 21:07:40,245][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][IgniteKernal%grid-0] VM arguments: [-DIGNITE_DUMP_THREADS_ON_FAILURE=false, -DMono=/usr/bin/mono-sgen, -DMono4.0_x64=/usr/lib/mono/4.0, -DMono4.5_x64=/usr/lib/mono/4.5, -DMonoVersion=6.12.0.90, -DSKIP_BUILD=false, -Dagent.home.dir=/opt/buildagent, -Dagent.name=aitc-lin02_03, -Dagent.ownPort=9090, -Dagent.work.dir=/opt/buildagent/work, -Dbuild.number=95, -Dbuild.vcs.number=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.1=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.GitHubApacheIgnite=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dclassworlds.conf=/opt/buildagent/temp/buildTmp/teamcity.m2.conf, -Dcom.jetbrains.maven.watcher.report.file=/opt/buildagent/temp/buildTmp/maven-build-info.xml, -Djava.io.tmpdir=/opt/buildagent/temp/buildTmp, -Dmaven.home=/opt/buildagent/tools/maven3_6, -Dmaven.multiModuleProjectDirectory=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.agent.cpuBenchmark=457, -Dteamcity.agent.dotnet.agent_url=http://localhost:9090/RPC2, -Dteamcity.agent.dotnet.build_id=6278078, -Dteamcity.auth.password=*******, -Dteamcity.auth.userId=TeamCityBuildId=6278078, -Dteamcity.build.changedFiles.file=/opt/buildagent/temp/buildTmp/changedFiles6342607772318147725.txt, -Dteamcity.build.checkoutDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.build.id=6278078, -Dteamcity.build.properties.file=/opt/buildagent/temp/buildTmp/teamcity.build5164517880467851002.properties, -Dteamcity.build.tempDir=/opt/buildagent/temp/buildTmp, -Dteamcity.build.workingDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.buildConfName=Basic 3, -Dteamcity.buildType.id=IgniteTests24Java8_Basic3, -Dteamcity.configuration.properties.file=/opt/buildagent/temp/buildTmp/teamcity.config5591980786735343870.properties, -Dteamcity.maven.userSettings.path=/opt/buildagent/temp/buildTmp/maven_settings_585072866407032347.xml, -Dteamcity.maven.watcher.home=/opt/buildagent/plugins/mavenPlugin/maven-watcher-jdk16, -Dteamcity.projectName=Ignite Tests 2.x (JDK 8/11), -Dteamcity.runner.properties.file=/opt/buildagent/temp/buildTmp/teamcity.runner9098465561618137420.properties, -Dteamcity.tests.recentlyFailedTests.file=/opt/buildagent/temp/buildTmp/testsToRunFirst3891775683130404069.txt, -Dteamcity.version=2021.2 (build 99542), -ea, -Xms2g, -Xmx2g, -XX:+HeapDumpOnOutOfMemoryError, -DIGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_TEST_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_UPDATE_NOTIFIER=false, -DIGNITE_NO_DISCO_ORDER=true, -DIGNITE_PERFORMANCE_SUGGESTIONS_DISABLED=true, -Djava.net.preferIPv4Stack=true, -DTEST_SCALE_FACTOR=1.0, -DIGNITE_TEST_PROP_LOG4J_FILE=log4j-tc-test.xml, -DIGNITE_QUIET=false, -DIGNITE_MARSHAL_BUFFERS_RECHECK=1000, -Dmaven.repo.local=/opt/buildagent/.m2/repository] [21:07:40] : [Step 4/5] [2021-11-19 21:07:40,249][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][IgniteKernal%grid-0] System cache's DataRegion size is configured to 40 MB. Use DataStorageConfiguration.systemRegionInitialSize property to change the setting. [21:07:40] : [Step 4/5] [2021-11-19 21:07:40,250][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][IgniteKernal%grid-0] Configured caches [in 'sysMemPlc' dataRegion: ['ignite-sys-cache'], in 'default' dataRegion: ['encrypted']] [21:07:40] : [Step 4/5] [2021-11-19 21:07:40,250][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][IgniteKernal%grid-0] 3-rd party licenses can be found at: /opt/buildagent/work/7bc1c54bc719b67c/libs/licenses [21:07:40] : [Step 4/5] [2021-11-19 21:07:40,254][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][IgnitePluginProcessor] Configured plugins: [21:07:40] : [Step 4/5] [2021-11-19 21:07:40,254][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][IgnitePluginProcessor] ^-- StanByClusterTestProvider 1.0 [21:07:40] : [Step 4/5] [2021-11-19 21:07:40,255][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][IgnitePluginProcessor] ^-- null [21:07:40] : [Step 4/5] [2021-11-19 21:07:40,255][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][IgnitePluginProcessor] [21:07:40] : [Step 4/5] [2021-11-19 21:07:40,255][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][IgnitePluginProcessor] ^-- PageMemory tracker plugin 1.0 [21:07:40] : [Step 4/5] [2021-11-19 21:07:40,255][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][IgnitePluginProcessor] ^-- null [21:07:40] : [Step 4/5] [2021-11-19 21:07:40,255][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][IgnitePluginProcessor] [21:07:40] : [Step 4/5] [2021-11-19 21:07:40,256][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][IgnitePluginProcessor] ^-- TestDistibutedConfigurationPlugin 1.0 [21:07:40] : [Step 4/5] [2021-11-19 21:07:40,256][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][IgnitePluginProcessor] ^-- null [21:07:40] : [Step 4/5] [2021-11-19 21:07:40,256][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][IgnitePluginProcessor] [21:07:40] : [Step 4/5] [2021-11-19 21:07:40,256][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][IgnitePluginProcessor] ^-- NodeValidationPluginProvider 1.0 [21:07:40] : [Step 4/5] [2021-11-19 21:07:40,257][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][IgnitePluginProcessor] ^-- null [21:07:40] : [Step 4/5] [2021-11-19 21:07:40,257][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][IgnitePluginProcessor] [21:07:40] : [Step 4/5] [2021-11-19 21:07:40,257][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][FailureProcessor] Configured failure handler: [hnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]]] [21:07:40] : [Step 4/5] [2021-11-19 21:07:40,310][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][TcpCommunicationSpi] Successfully bound communication NIO server to TCP port [port=45170, locHost=/127.0.0.1, selectorsCnt=12, selectorSpins=0, pairedConn=false] [21:07:40]W: [org.apache.ignite:ignite-core] [2021-11-19 21:07:40,311][WARN ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][TcpCommunicationSpi] Message queue limit is set to 0 which may lead to potential OOMEs when running cache operations in FULL_ASYNC or PRIMARY_SYNC modes due to message queues growth on sender and receiver sides. [21:07:40] : [Step 4/5] [2021-11-19 21:07:40,341][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][GridCollisionManager] Collision resolution is disabled (all jobs will be activated upon arrival). [21:07:40] : [Step 4/5] [2021-11-19 21:07:40,342][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][IgniteKernal%grid-0] Security status [authentication=off, sandbox=off, tls/ssl=off] [21:07:40] : [Step 4/5] [2021-11-19 21:07:40,418][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:07:40] : [Step 4/5] [2021-11-19 21:07:40,517][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][MaintenanceProcessor] Resolved store directory for node persistent data: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0 [21:07:40] : [Step 4/5] [2021-11-19 21:07:40,518][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][CacheObjectBinaryProcessorImpl] Resolved directory for serialized binary metadata: /opt/buildagent/work/7bc1c54bc719b67c/work/db/binary_meta/grid_0 [21:07:40] : [Step 4/5] [2021-11-19 21:07:40,524][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0 [21:07:40] : [Step 4/5] [2021-11-19 21:07:40,525][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][FileWriteAheadLogManager] Resolved write ahead log work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0 [21:07:40] : [Step 4/5] [2021-11-19 21:07:40,525][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][FileWriteAheadLogManager] Resolved write ahead log archive directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0 [21:07:40] : [Step 4/5] [2021-11-19 21:07:40,527][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000005.wal [21:07:40] : [Step 4/5] [2021-11-19 21:07:40,527][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000006.wal [21:07:40] : [Step 4/5] [2021-11-19 21:07:40,528][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000008.wal [21:07:40] : [Step 4/5] [2021-11-19 21:07:40,528][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000004.wal [21:07:40] : [Step 4/5] [2021-11-19 21:07:40,529][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000003.wal [21:07:40] : [Step 4/5] [2021-11-19 21:07:40,529][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000002.wal [21:07:40] : [Step 4/5] [2021-11-19 21:07:40,530][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000007.wal [21:07:40] : [Step 4/5] [2021-11-19 21:07:40,530][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000001.wal [21:07:40] : [Step 4/5] [2021-11-19 21:07:40,531][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000009.wal [21:07:40] : [Step 4/5] [2021-11-19 21:07:40,535][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][GridCacheDatabaseSharedManager] Configured data regions initialized successfully [total=5] [21:07:40] : [Step 4/5] [2021-11-19 21:07:40,546][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][IgniteSnapshotManager] Resolved snapshot work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/snapshots [21:07:40] : [Step 4/5] [2021-11-19 21:07:40,547][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][IgniteSnapshotManager] Resolved temp directory for snapshot creation: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0/snp [21:07:40] : [Step 4/5] [2021-11-19 21:07:40,550][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][ClientListenerProcessor] Client connector processor has started on TCP port 10800 [21:07:40] : [Step 4/5] [2021-11-19 21:07:40,561][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][IgniteKernal%grid-0] Non-loopback local IPs: 172.17.0.4 [21:07:40] : [Step 4/5] [2021-11-19 21:07:40,561][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][IgniteKernal%grid-0] Enabled local MACs: 0242AC110004 [21:07:40] : [Step 4/5] [2021-11-19 21:07:40,565][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=/opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0/cp/1637345259693-f3aa27fa-c546-4212-95ca-8da087d84317-START.bin, endMarker=/opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0/cp/1637345250000-8e8fa152-e6c9-4a2b-a415-21f74a424450-END.bin] [21:07:40] : [Step 4/5] [2021-11-19 21:07:40,567][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:07:40] : [Step 4/5] [2021-11-19 21:07:40,567][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=162363, len=11507], lastMarked=WALPointer [idx=0, fileOff=764872, len=11491], lastCheckpointId=f3aa27fa-c546-4212-95ca-8da087d84317] [21:07:40] : [Step 4/5] [2021-11-19 21:07:40,678][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][GridCacheDatabaseSharedManager] Found last checkpoint marker [cpId=f3aa27fa-c546-4212-95ca-8da087d84317, pos=WALPointer [idx=0, fileOff=764872, len=11491]] [21:07:40] : [Step 4/5] [2021-11-19 21:07:40,682][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][GridCacheDatabaseSharedManager] Applying lost metastore updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=764872, len=11491], lastCheckpointId=f3aa27fa-c546-4212-95ca-8da087d84317] [21:07:40] : [Step 4/5] [2021-11-19 21:07:40,728][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=51 ms] [21:07:40] : [Step 4/5] [2021-11-19 21:07:40,728][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][GridCacheProcessor] Restoring partition state for local groups. [21:07:40] : [Step 4/5] [2021-11-19 21:07:40,729][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=0, partitionsProcessed=0, time=0ms] [21:07:40] : [Step 4/5] [2021-11-19 21:07:40,809][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][GridClusterStateProcessor] Restoring history for BaselineTopology[id=0] [21:07:40]W: [org.apache.ignite:ignite-core] [2021-11-19 21:07:40,816][WARN ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][GridLocalConfigManager] Static configuration for the following caches will be ignored because a persistent cache with the same name already exist (see https://apacheignite.readme.io/docs/cache-configuration for more information): [encrypted] [21:07:40] : [Step 4/5] [2021-11-19 21:07:40,819][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][ClusterProcessor] Cluster ID and tag has been read from metastorage: ClusterIdAndTag [id=fa571dfd-3dc3-453e-81dd-4638e2fd34ee, tag=zealous_snyder] [21:07:40] : [Step 4/5] [2021-11-19 21:07:40,820][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][IgniteClusterImpl] Shutdown policy was updated [oldVal=null, newVal=null] [21:07:40] : [Step 4/5] [2021-11-19 21:07:40,820][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustEnabled' was changed from 'null' to 'false' [21:07:40] : [Step 4/5] [2021-11-19 21:07:40,821][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustTimeout' was changed from 'null' to '300000' [21:07:40] : [Step 4/5] [2021-11-19 21:07:40,821][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][IgniteTxManager] Transactions parameter 'txOwnerDumpRequestsAllowed' was changed from 'null' to 'true' [21:07:40] : [Step 4/5] [2021-11-19 21:07:40,821][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][IgniteTxManager] Transactions parameter 'longOperationsDumpTimeout' was changed from 'null' to '60000' [21:07:40] : [Step 4/5] [2021-11-19 21:07:40,822][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpThreshold' was changed from 'null' to '0' [21:07:40] : [Step 4/5] [2021-11-19 21:07:40,823][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][IgniteTxManager] Transactions parameter 'transactionTimeDumpSamplesCoefficient' was changed from 'null' to '0.0' [21:07:40] : [Step 4/5] [2021-11-19 21:07:40,823][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpSamplesPerSecondLimit' was changed from 'null' to '5' [21:07:40] : [Step 4/5] [2021-11-19 21:07:40,823][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][IgniteTxManager] Transactions parameter 'collisionsDumpInterval' was changed from 'null' to '1000' [21:07:40] : [Step 4/5] [2021-11-19 21:07:40,824][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][GridCacheDatabaseSharedManager] Historical rebalance WAL threshold changed [property=historical.rebalance.threshold, oldVal=null, newVal=500] [21:07:40] : [Step 4/5] [2021-11-19 21:07:40,824][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][GridCacheDatabaseSharedManager] Checkpoint frequency deviation changed [oldVal=null, newVal=null] [21:07:40] : [Step 4/5] [2021-11-19 21:07:40,825][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][FilePageStoreManager] Cleanup cache stores [total=1, left=0, cleanFiles=false] [21:07:40] : [Step 4/5] [2021-11-19 21:07:40,827][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:07:40] : [Step 4/5] [2021-11-19 21:07:40,828][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:07:40] : [Step 4/5] [2021-11-19 21:07:40,829][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:07:40] : [Step 4/5] [2021-11-19 21:07:40,830][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][GridCacheDatabaseSharedManager] Data Regions Started: 5 [21:07:40] : [Step 4/5] [2021-11-19 21:07:40,830][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][GridCacheDatabaseSharedManager] ^-- sysMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:07:40] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:07:40] : [Step 4/5] ^-- default region [type=default, persistence=true, lazyAlloc=true, [21:07:40] : [Step 4/5] ... initCfg=10MB, maxCfg=10MB, usedRam=0MB, freeRam=100%, allocRam=0MB, allocTotal=0MB] [21:07:40] : [Step 4/5] ^-- metastoreMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:07:40] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:07:40] : [Step 4/5] ^-- TxLog region [type=internal, persistence=true, lazyAlloc=false, [21:07:40] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:07:40] : [Step 4/5] ^-- volatileDsMemPlc region [type=user, persistence=false, lazyAlloc=true, [21:07:40] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB] [21:07:40] : [Step 4/5] ^-- Ignite persistence [used=0MB] [21:07:40] : [Step 4/5] [21:07:40] : [Step 4/5] [2021-11-19 21:07:40,832][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][GridCacheDatabaseSharedManager] Starting binary memory restore for: [-2100569601, 1613773252] [21:07:40] : [Step 4/5] [2021-11-19 21:07:40,913][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=/opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0/cp/1637345259693-f3aa27fa-c546-4212-95ca-8da087d84317-START.bin, endMarker=/opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0/cp/1637345250000-8e8fa152-e6c9-4a2b-a415-21f74a424450-END.bin] [21:07:40] : [Step 4/5] [2021-11-19 21:07:40,913][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=162363, len=11507], lastMarked=WALPointer [idx=0, fileOff=764872, len=11491], lastCheckpointId=f3aa27fa-c546-4212-95ca-8da087d84317] [21:07:40]W: [org.apache.ignite:ignite-core] [2021-11-19 21:07:40,956][WARN ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][GridCacheDatabaseSharedManager] Ignite node stopped in the middle of checkpoint. Will restore memory state and finish checkpoint on node start. [21:07:40] : [Step 4/5] [2021-11-19 21:07:40,957][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][PageMemoryImpl] Started page memory [memoryAllocated=24.0 MiB, pages=5952, tableSize=474.2 KiB, replacementSize=768 B, checkpointBuffer=10.0 MiB] [21:07:41] : [Step 4/5] [2021-11-19 21:07:41,012][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][GridCacheDatabaseSharedManager] Found last checkpoint marker [cpId=f3aa27fa-c546-4212-95ca-8da087d84317, pos=WALPointer [idx=0, fileOff=764872, len=11491]] [21:07:41] : [Step 4/5] [2021-11-19 21:07:41,013][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][GridCacheDatabaseSharedManager] Finished applying memory changes [changesApplied=1063, time=61 ms] [21:07:41] : [Step 4/5] [2021-11-19 21:07:41,528][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][CheckpointWorkflow] Checkpoint finished [cpId=f3aa27fa-c546-4212-95ca-8da087d84317, pages=567, markPos=WALPointer [idx=0, fileOff=764872, len=11491], pagesWrite=26ms, fsync=474ms, total=500ms] [21:07:41] : [Step 4/5] [2021-11-19 21:07:41,529][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][GridCacheDatabaseSharedManager] Binary memory state restored at node startup [restoredPtr=WALPointer [idx=0, fileOff=776363, len=0]] [21:07:41] : [Step 4/5] [2021-11-19 21:07:41,537][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000000.wal, offset=776363, ver=2] [21:07:41] : [Step 4/5] [2021-11-19 21:07:41,539][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][GridCacheProcessor] Started cache in recovery mode [name=ignite-sys-cache, id=-2100569601, dataRegionName=sysMemPlc, mode=REPLICATED, atomicity=TRANSACTIONAL, backups=2147483647, mvcc=false] [21:07:41] : [Step 4/5] [2021-11-19 21:07:41,543][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][GridCacheProcessor] Started cache in recovery mode [name=encrypted, id=1613773252, dataRegionName=default, mode=PARTITIONED, atomicity=ATOMIC, backups=0, mvcc=false] [21:07:41] : [Step 4/5] [2021-11-19 21:07:41,544][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][GridCacheDatabaseSharedManager] Binary recovery performed in 713 ms. [21:07:41] : [Step 4/5] [2021-11-19 21:07:41,545][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=/opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0/cp/1637345259693-f3aa27fa-c546-4212-95ca-8da087d84317-START.bin, endMarker=/opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0/cp/1637345259693-f3aa27fa-c546-4212-95ca-8da087d84317-END.bin] [21:07:41] : [Step 4/5] [2021-11-19 21:07:41,546][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][GridCacheDatabaseSharedManager] Applying lost cache updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=764872, len=11491], lastCheckpointId=f3aa27fa-c546-4212-95ca-8da087d84317] [21:07:41] : [Step 4/5] [2021-11-19 21:07:41,584][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=42 ms] [21:07:41] : [Step 4/5] [2021-11-19 21:07:41,584][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][GridCacheProcessor] Restoring partition state for local groups. [21:07:41] : [Step 4/5] [2021-11-19 21:07:41,695][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=2, partitionsProcessed=1124, time=113ms] [21:07:41] : [Step 4/5] [2021-11-19 21:07:41,705][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][TestTcpDiscoverySpi] Successfully bound to TCP port [port=47500, localHost=localhost/127.0.0.1, locNodeId=00983e3d-511c-4870-a39b-cacb053c0000] [21:07:41] : [Step 4/5] [2021-11-19 21:07:41,708][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][GridEncryptionManager] Sending stored group keys to coordinator [grps=1613773252] [21:07:41] : [Step 4/5] [2021-11-19 21:07:41,721][INFO ][disco-notifier-worker-#14806%grid-0%][MvccProcessorImpl] Assigned mvcc coordinator [crd=MvccCoordinator [topVer=AffinityTopologyVersion [topVer=1, minorTopVer=0], nodeId=00983e3d-511c-4870-a39b-cacb053c0000, ver=1637345261712, local=true, initialized=false]] [21:07:41] : [Step 4/5] [2021-11-19 21:07:41,722][INFO ][sys-#14800%grid-0%][ClusterProcessor] Writing cluster ID and tag to metastorage on ready for write ClusterIdAndTag [id=fa571dfd-3dc3-453e-81dd-4638e2fd34ee, tag=zealous_snyder] [21:07:41] : [Step 4/5] [2021-11-19 21:07:41,745][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][IgniteKernal%grid-0] To start Console Management & Monitoring run ignitevisorcmd.{sh|bat} [21:07:41] : [Step 4/5] [2021-11-19 21:07:41,745][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][IgniteKernal%grid-0] [21:07:41] : [Step 4/5] [21:07:41] : [Step 4/5] >>> +-------------------------------------------+ [21:07:41] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:07:41] : [Step 4/5] >>> +-------------------------------------------+ [21:07:41] : [Step 4/5] >>> OS name: Linux 4.15.0-151-generic amd64 [21:07:41] : [Step 4/5] >>> CPU(s): 24 [21:07:41] : [Step 4/5] >>> Heap: 2.0GB [21:07:41] : [Step 4/5] >>> VM name: 16724@c4dfe9a430b2 [21:07:41] : [Step 4/5] >>> Ignite instance name: grid-0 [21:07:41] : [Step 4/5] >>> Local node [ID=00983E3D-511C-4870-A39B-CACB053C0000, order=1, clientMode=false] [21:07:41] : [Step 4/5] >>> Local node addresses: [127.0.0.1] [21:07:41] : [Step 4/5] >>> Local ports: TCP:10800 TCP:45170 TCP:47500 [21:07:41] : [Step 4/5] [21:07:41] : [Step 4/5] [2021-11-19 21:07:41,746][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][IgniteKernal%grid-0] >>> Ignite cluster is in INACTIVE state (limited functionality available). Use control.(sh|bat) script or IgniteCluster.state(ClusterState.ACTIVE) to change the state. [21:07:41] : [Step 4/5] [2021-11-19 21:07:41,747][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][GridDiscoveryManager] Topology snapshot [ver=1, locNode=00983e3d, servers=1, clients=0, state=INACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=00983e3d-511c-4870-a39b-cacb053c0000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:07:41] : [Step 4/5] [2021-11-19 21:07:41,748][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][GridDiscoveryManager] ^-- Baseline [id=0, size=2, online=1, offline=1] [21:07:41] : [Step 4/5] [2021-11-19 21:07:41,748][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][GridDiscoveryManager] ^-- 1 nodes left for auto-activation [grid-1] [21:07:41] : [Step 4/5] [2021-11-19 21:07:41,749][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][G] Node started : [stage="Configure system pool" (0 ms),stage="Start managers" (285 ms),stage="Configure binary metadata" (2 ms),stage="Start processors" (39 ms),stage="Start 'StanByClusterTestProvider' plugin" (0 ms),stage="Start 'PageMemory tracker plugin' plugin" (0 ms),stage="Start 'TestDistibutedConfigurationPlugin' plugin" (0 ms),stage="Start 'NodeValidationPluginProvider' plugin" (0 ms),stage="Init metastore" (264 ms),stage="Init and start regions" (6 ms),stage="Restore binary memory" (713 ms),stage="Restore logical state" (150 ms),stage="Finish recovery" (4 ms),stage="Join topology" (21 ms),stage="Await transition" (2 ms),stage="Await exchange" (24 ms),stage="Total time" (1510 ms)] [21:07:41] : [Step 4/5] [2021-11-19 21:07:41,750][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][root] Node started with the following configuration [id=00983e3d-511c-4870-a39b-cacb053c0000, marshaller=BinaryMarshaller [], discovery=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=5000, ackTimeout=5000, marsh=JdkMarshaller [clsFilter=org.apache.ignite.marshaller.MarshallerUtils$1@65e910f], reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], binaryCfg=null, lateAff=true] [21:07:41]W: [org.apache.ignite:ignite-core] [2021-11-19 21:07:41,755][WARN ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][G] Ignite work directory is not provided, automatically resolved to: /opt/buildagent/work/7bc1c54bc719b67c/work [21:07:41] : [Step 4/5] [2021-11-19 21:07:41,760][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][IgniteKernal%grid-1] [21:07:41] : [Step 4/5] [21:07:41] : [Step 4/5] >>> __________ ________________ [21:07:41] : [Step 4/5] >>> / _/ ___/ |/ / _/_ __/ __/ [21:07:41] : [Step 4/5] >>> _/ // (7 7 // / / / / _/ [21:07:41] : [Step 4/5] >>> /___/\___/_/|_/___/ /_/ /___/ [21:07:41] : [Step 4/5] >>> [21:07:41] : [Step 4/5] >>> ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:07:41] : [Step 4/5] >>> 2021 Copyright(C) Apache Software Foundation [21:07:41] : [Step 4/5] >>> [21:07:41] : [Step 4/5] >>> Ignite documentation: http://ignite.apache.org [21:07:41] : [Step 4/5] [21:07:41] : [Step 4/5] [2021-11-19 21:07:41,761][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][IgniteKernal%grid-1] Config URL: n/a [21:07:41] : [Step 4/5] [2021-11-19 21:07:41,761][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][IgniteKernal%grid-1] IgniteConfiguration [igniteInstanceName=grid-1, pubPoolSize=24, svcPoolSize=24, callbackPoolSize=24, stripedPoolSize=24, sysPoolSize=24, mgmtPoolSize=4, dataStreamerPoolSize=24, utilityCachePoolSize=24, utilityCacheKeepAliveTime=60000, p2pPoolSize=2, qryPoolSize=24, buildIdxPoolSize=4, igniteHome=/opt/buildagent/work/7bc1c54bc719b67c, igniteWorkDir=/opt/buildagent/work/7bc1c54bc719b67c/work, mbeanSrv=com.sun.jmx.mbeanserver.JmxMBeanServer@6fe85038, nodeId=10c6533b-996e-40b2-9d3e-134d0e2e9001, marsh=BinaryMarshaller [], marshLocJobs=false, daemon=false, p2pEnabled=true, netTimeout=10000, netCompressionLevel=1, sndRetryDelay=1000, sndRetryCnt=3, metricsHistSize=10000, metricsUpdateFreq=1000, metricsExpTime=9223372036854775807, discoSpi=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=0, ackTimeout=0, marsh=null, reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], segPlc=STOP, segResolveAttempts=2, waitForSegOnStart=true, allResolversPassReq=true, segChkFreq=10000, commSpi=TcpCommunicationSpi [connectGate=org.apache.ignite.spi.communication.tcp.internal.ConnectGateway@2c96168e, ctxInitLatch=java.util.concurrent.CountDownLatch@695cb43c[Count = 1], stopping=false, clientPool=null, nioSrvWrapper=null, stateProvider=null], evtSpi=MemoryEventStorageSpi [expireAgeMs=9223372036854775807, expireCnt=10000, filter=null], colSpi=NoopCollisionSpi [], deploySpi=LocalDeploymentSpi [], indexingSpi=org.apache.ignite.spi.indexing.noop.NoopIndexingSpi@3a1174d7, addrRslvr=null, encryptionSpi=org.apache.ignite.spi.encryption.keystore.KeystoreEncryptionSpi@647d2c1c, tracingSpi=org.apache.ignite.spi.tracing.NoopTracingSpi@3a2ba259, clientMode=false, rebalanceThreadPoolSize=4, rebalanceTimeout=10000, rebalanceBatchesPrefetchCnt=3, rebalanceThrottle=0, rebalanceBatchSize=524288, txCfg=TransactionConfiguration [txSerEnabled=false, dfltIsolation=REPEATABLE_READ, dfltConcurrency=PESSIMISTIC, dfltTxTimeout=0, txTimeoutOnPartitionMapExchange=0, deadlockTimeout=10000, pessimisticTxLogSize=0, pessimisticTxLogLinger=10000, tmLookupClsName=null, txManagerFactory=null, useJtaSync=false], cacheSanityCheckEnabled=true, discoStartupDelay=60000, deployMode=SHARED, p2pMissedCacheSize=100, locHost=127.0.0.1, timeSrvPortBase=31100, timeSrvPortRange=100, failureDetectionTimeout=10000, sysWorkerBlockedTimeout=null, clientFailureDetectionTimeout=10000, metricsLogFreq=0, connectorCfg=null, odbcCfg=null, warmupClos=null, atomicCfg=AtomicConfiguration [seqReserveSize=1000, cacheMode=PARTITIONED, backups=1, aff=null, grpName=null], classLdr=null, sslCtxFactory=null, platformCfg=null, binaryCfg=null, memCfg=null, pstCfg=null, dsCfg=DataStorageConfiguration [sysRegionInitSize=41943040, sysRegionMaxSize=104857600, pageSize=4096, concLvl=0, dfltDataRegConf=DataRegionConfiguration [name=default, maxSize=10485760, initSize=268435456, swapPath=null, pageEvictionMode=DISABLED, pageReplacementMode=CLOCK, evictionThreshold=0.9, emptyPagesPoolSize=100, metricsEnabled=false, metricsSubIntervalCount=5, metricsRateTimeInterval=60000, persistenceEnabled=true, checkpointPageBufSize=0, lazyMemoryAllocation=true, warmUpCfg=null], dataRegions=null, storagePath=null, checkpointFreq=180000, lockWaitTime=10000, checkpointThreads=4, checkpointWriteOrder=SEQUENTIAL, walHistSize=20, maxWalArchiveSize=1073741824, walSegments=10, walSegmentSize=67108864, walPath=db/wal, walArchivePath=db/wal/archive, cdcWalPath=db/wal/cdc, cdcEnabled=false, metricsEnabled=false, walMode=FSYNC, walTlbSize=131072, walBuffSize=0, walFlushFreq=2000, walFsyncDelay=1000, walRecordIterBuffSize=67108864, alwaysWriteFullPages=false, fileIOFactory=org.apache.ignite.internal.processors.cache.persistence.file.AsyncFileIOFactory@5207089e, metricsSubIntervalCnt=5, metricsRateTimeInterval=60000, walAutoArchiveAfterInactivity=-1, walForceArchiveTimeout=-1, writeThrottlingEnabled=false, walCompactionEnabled=false, walCompactionLevel=1, checkpointReadLockTimeout=null, walPageCompression=DISABLED, walPageCompressionLevel=null, dfltWarmUpCfg=null, encCfg=org.apache.ignite.configuration.EncryptionConfiguration@465aef48, defragmentationThreadPoolSize=4, minWalArchiveSize=-1], snapshotPath=snapshots, activeOnStart=true, activeOnStartPropSetFlag=false, autoActivation=true, autoActivationPropSetFlag=false, clusterStateOnStart=null, sqlConnCfg=null, cliConnCfg=ClientConnectorConfiguration [host=null, port=10800, portRange=100, sockSndBufSize=0, sockRcvBufSize=0, tcpNoDelay=true, maxOpenCursorsPerConn=128, threadPoolSize=24, selectorCnt=12, idleTimeout=0, handshakeTimeout=10000, jdbcEnabled=true, odbcEnabled=true, thinCliEnabled=true, sslEnabled=false, useIgniteSslCtxFactory=true, sslClientAuth=false, sslCtxFactory=null, thinCliCfg=ThinClientConfiguration [maxActiveTxPerConn=100, maxActiveComputeTasksPerConn=0]], mvccVacuumThreadCnt=2, mvccVacuumFreq=5000, authEnabled=false, failureHnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]], commFailureRslvr=null, sqlCfg=SqlConfiguration [longQryWarnTimeout=3000, dfltQryTimeout=0, sqlQryHistSize=1000, validationEnabled=false], asyncContinuationExecutor=null] [21:07:41] : [Step 4/5] [2021-11-19 21:07:41,769][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][IgniteKernal%grid-1] Daemon mode: off [21:07:41] : [Step 4/5] [2021-11-19 21:07:41,769][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][IgniteKernal%grid-1] OS: Linux 4.15.0-151-generic amd64 [21:07:41] : [Step 4/5] [2021-11-19 21:07:41,770][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][IgniteKernal%grid-1] OS user: teamcity [21:07:41] : [Step 4/5] [2021-11-19 21:07:41,770][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][IgniteKernal%grid-1] PID: 16724 [21:07:41] : [Step 4/5] [2021-11-19 21:07:41,770][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][IgniteKernal%grid-1] Language runtime: Java Platform API Specification ver. 1.8 [21:07:41] : [Step 4/5] [2021-11-19 21:07:41,771][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][IgniteKernal%grid-1] VM information: Java(TM) SE Runtime Environment 1.8.0_261-b12 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 25.261-b12 [21:07:41] : [Step 4/5] [2021-11-19 21:07:41,771][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][IgniteKernal%grid-1] VM total memory: 1.9GB [21:07:41] : [Step 4/5] [2021-11-19 21:07:41,771][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][IgniteKernal%grid-1] Remote Management [restart: off, REST: off, JMX (remote: off)] [21:07:41] : [Step 4/5] [2021-11-19 21:07:41,771][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][IgniteKernal%grid-1] Logger: GridTestLog4jLogger [quiet=false, config=null] [21:07:41] : [Step 4/5] [2021-11-19 21:07:41,772][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][IgniteKernal%grid-1] IGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c [21:07:41] : [Step 4/5] [2021-11-19 21:07:41,772][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][IgniteKernal%grid-1] VM arguments: [-DIGNITE_DUMP_THREADS_ON_FAILURE=false, -DMono=/usr/bin/mono-sgen, -DMono4.0_x64=/usr/lib/mono/4.0, -DMono4.5_x64=/usr/lib/mono/4.5, -DMonoVersion=6.12.0.90, -DSKIP_BUILD=false, -Dagent.home.dir=/opt/buildagent, -Dagent.name=aitc-lin02_03, -Dagent.ownPort=9090, -Dagent.work.dir=/opt/buildagent/work, -Dbuild.number=95, -Dbuild.vcs.number=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.1=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.GitHubApacheIgnite=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dclassworlds.conf=/opt/buildagent/temp/buildTmp/teamcity.m2.conf, -Dcom.jetbrains.maven.watcher.report.file=/opt/buildagent/temp/buildTmp/maven-build-info.xml, -Djava.io.tmpdir=/opt/buildagent/temp/buildTmp, -Dmaven.home=/opt/buildagent/tools/maven3_6, -Dmaven.multiModuleProjectDirectory=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.agent.cpuBenchmark=457, -Dteamcity.agent.dotnet.agent_url=http://localhost:9090/RPC2, -Dteamcity.agent.dotnet.build_id=6278078, -Dteamcity.auth.password=*******, -Dteamcity.auth.userId=TeamCityBuildId=6278078, -Dteamcity.build.changedFiles.file=/opt/buildagent/temp/buildTmp/changedFiles6342607772318147725.txt, -Dteamcity.build.checkoutDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.build.id=6278078, -Dteamcity.build.properties.file=/opt/buildagent/temp/buildTmp/teamcity.build5164517880467851002.properties, -Dteamcity.build.tempDir=/opt/buildagent/temp/buildTmp, -Dteamcity.build.workingDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.buildConfName=Basic 3, -Dteamcity.buildType.id=IgniteTests24Java8_Basic3, -Dteamcity.configuration.properties.file=/opt/buildagent/temp/buildTmp/teamcity.config5591980786735343870.properties, -Dteamcity.maven.userSettings.path=/opt/buildagent/temp/buildTmp/maven_settings_585072866407032347.xml, -Dteamcity.maven.watcher.home=/opt/buildagent/plugins/mavenPlugin/maven-watcher-jdk16, -Dteamcity.projectName=Ignite Tests 2.x (JDK 8/11), -Dteamcity.runner.properties.file=/opt/buildagent/temp/buildTmp/teamcity.runner9098465561618137420.properties, -Dteamcity.tests.recentlyFailedTests.file=/opt/buildagent/temp/buildTmp/testsToRunFirst3891775683130404069.txt, -Dteamcity.version=2021.2 (build 99542), -ea, -Xms2g, -Xmx2g, -XX:+HeapDumpOnOutOfMemoryError, -DIGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_TEST_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_UPDATE_NOTIFIER=false, -DIGNITE_NO_DISCO_ORDER=true, -DIGNITE_PERFORMANCE_SUGGESTIONS_DISABLED=true, -Djava.net.preferIPv4Stack=true, -DTEST_SCALE_FACTOR=1.0, -DIGNITE_TEST_PROP_LOG4J_FILE=log4j-tc-test.xml, -DIGNITE_QUIET=false, -DIGNITE_MARSHAL_BUFFERS_RECHECK=1000, -Dmaven.repo.local=/opt/buildagent/.m2/repository] [21:07:41] : [Step 4/5] [2021-11-19 21:07:41,776][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][IgniteKernal%grid-1] System cache's DataRegion size is configured to 40 MB. Use DataStorageConfiguration.systemRegionInitialSize property to change the setting. [21:07:41] : [Step 4/5] [2021-11-19 21:07:41,777][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][IgniteKernal%grid-1] Configured caches [in 'sysMemPlc' dataRegion: ['ignite-sys-cache'], in 'default' dataRegion: ['encrypted']] [21:07:41]W: [org.apache.ignite:ignite-core] [2021-11-19 21:07:41,777][WARN ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][IgniteKernal%grid-1] Peer class loading is enabled (disable it in production for performance and deployment consistency reasons) [21:07:41] : [Step 4/5] [2021-11-19 21:07:41,777][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][IgniteKernal%grid-1] 3-rd party licenses can be found at: /opt/buildagent/work/7bc1c54bc719b67c/libs/licenses [21:07:41] : [Step 4/5] [2021-11-19 21:07:41,782][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][IgnitePluginProcessor] Configured plugins: [21:07:41] : [Step 4/5] [2021-11-19 21:07:41,782][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][IgnitePluginProcessor] ^-- StanByClusterTestProvider 1.0 [21:07:41] : [Step 4/5] [2021-11-19 21:07:41,783][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][IgnitePluginProcessor] ^-- null [21:07:41] : [Step 4/5] [2021-11-19 21:07:41,783][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][IgnitePluginProcessor] [21:07:41] : [Step 4/5] [2021-11-19 21:07:41,783][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][IgnitePluginProcessor] ^-- PageMemory tracker plugin 1.0 [21:07:41] : [Step 4/5] [2021-11-19 21:07:41,783][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][IgnitePluginProcessor] ^-- null [21:07:41] : [Step 4/5] [2021-11-19 21:07:41,784][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][IgnitePluginProcessor] [21:07:41] : [Step 4/5] [2021-11-19 21:07:41,784][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][IgnitePluginProcessor] ^-- TestDistibutedConfigurationPlugin 1.0 [21:07:41] : [Step 4/5] [2021-11-19 21:07:41,784][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][IgnitePluginProcessor] ^-- null [21:07:41] : [Step 4/5] [2021-11-19 21:07:41,785][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][IgnitePluginProcessor] [21:07:41] : [Step 4/5] [2021-11-19 21:07:41,785][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][IgnitePluginProcessor] ^-- NodeValidationPluginProvider 1.0 [21:07:41] : [Step 4/5] [2021-11-19 21:07:41,785][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][IgnitePluginProcessor] ^-- null [21:07:41] : [Step 4/5] [2021-11-19 21:07:41,786][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][IgnitePluginProcessor] [21:07:41] : [Step 4/5] [2021-11-19 21:07:41,786][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][FailureProcessor] Configured failure handler: [hnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]]] [21:07:41] : [Step 4/5] [2021-11-19 21:07:41,856][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][TcpCommunicationSpi] Successfully bound communication NIO server to TCP port [port=45171, locHost=/127.0.0.1, selectorsCnt=12, selectorSpins=0, pairedConn=false] [21:07:41]W: [org.apache.ignite:ignite-core] [2021-11-19 21:07:41,856][WARN ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][TcpCommunicationSpi] Message queue limit is set to 0 which may lead to potential OOMEs when running cache operations in FULL_ASYNC or PRIMARY_SYNC modes due to message queues growth on sender and receiver sides. [21:07:41] : [Step 4/5] [2021-11-19 21:07:41,860][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][GridCollisionManager] Collision resolution is disabled (all jobs will be activated upon arrival). [21:07:41] : [Step 4/5] [2021-11-19 21:07:41,861][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][IgniteKernal%grid-1] Security status [authentication=off, sandbox=off, tls/ssl=off] [21:07:41] : [Step 4/5] [2021-11-19 21:07:41,926][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:07:42] : [Step 4/5] [2021-11-19 21:07:42,028][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][MaintenanceProcessor] Resolved store directory for node persistent data: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1 [21:07:42] : [Step 4/5] [2021-11-19 21:07:42,029][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][CacheObjectBinaryProcessorImpl] Resolved directory for serialized binary metadata: /opt/buildagent/work/7bc1c54bc719b67c/work/db/binary_meta/grid_1 [21:07:42] : [Step 4/5] [2021-11-19 21:07:42,035][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1 [21:07:42] : [Step 4/5] [2021-11-19 21:07:42,036][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][FileWriteAheadLogManager] Resolved write ahead log work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1 [21:07:42] : [Step 4/5] [2021-11-19 21:07:42,037][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][FileWriteAheadLogManager] Resolved write ahead log archive directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1 [21:07:42] : [Step 4/5] [2021-11-19 21:07:42,039][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000005.wal [21:07:42] : [Step 4/5] [2021-11-19 21:07:42,039][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000006.wal [21:07:42] : [Step 4/5] [2021-11-19 21:07:42,040][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000008.wal [21:07:42] : [Step 4/5] [2021-11-19 21:07:42,040][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000004.wal [21:07:42] : [Step 4/5] [2021-11-19 21:07:42,041][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000003.wal [21:07:42] : [Step 4/5] [2021-11-19 21:07:42,041][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000002.wal [21:07:42] : [Step 4/5] [2021-11-19 21:07:42,042][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000007.wal [21:07:42] : [Step 4/5] [2021-11-19 21:07:42,043][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000001.wal [21:07:42] : [Step 4/5] [2021-11-19 21:07:42,043][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000009.wal [21:07:42] : [Step 4/5] [2021-11-19 21:07:42,048][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][GridCacheDatabaseSharedManager] Configured data regions initialized successfully [total=5] [21:07:42] : [Step 4/5] [2021-11-19 21:07:42,055][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][IgniteSnapshotManager] Resolved snapshot work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/snapshots [21:07:42] : [Step 4/5] [2021-11-19 21:07:42,056][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][IgniteSnapshotManager] Resolved temp directory for snapshot creation: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1/snp [21:07:42] : [Step 4/5] [2021-11-19 21:07:42,059][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][ClientListenerProcessor] Client connector processor has started on TCP port 10801 [21:07:42] : [Step 4/5] [2021-11-19 21:07:42,063][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][IgniteKernal%grid-1] Non-loopback local IPs: 172.17.0.4 [21:07:42] : [Step 4/5] [2021-11-19 21:07:42,063][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][IgniteKernal%grid-1] Enabled local MACs: 0242AC110004 [21:07:42] : [Step 4/5] [2021-11-19 21:07:42,064][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=/opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1/cp/1637345258301-93e37ec0-1622-4ae5-82fb-a5550cdcf1a2-START.bin, endMarker=/opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1/cp/1637345249985-bc5ae79a-c166-4801-9dda-bc6ecfacf3cd-END.bin] [21:07:42] : [Step 4/5] [2021-11-19 21:07:42,065][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:07:42] : [Step 4/5] [2021-11-19 21:07:42,066][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=165523, len=11887], lastMarked=WALPointer [idx=0, fileOff=649805, len=11871], lastCheckpointId=93e37ec0-1622-4ae5-82fb-a5550cdcf1a2] [21:07:42] : [Step 4/5] [2021-11-19 21:07:42,166][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][GridCacheDatabaseSharedManager] Found last checkpoint marker [cpId=93e37ec0-1622-4ae5-82fb-a5550cdcf1a2, pos=WALPointer [idx=0, fileOff=649805, len=11871]] [21:07:42] : [Step 4/5] [2021-11-19 21:07:42,168][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][GridCacheDatabaseSharedManager] Applying lost metastore updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=649805, len=11871], lastCheckpointId=93e37ec0-1622-4ae5-82fb-a5550cdcf1a2] [21:07:42] : [Step 4/5] [2021-11-19 21:07:42,203][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=40 ms] [21:07:42] : [Step 4/5] [2021-11-19 21:07:42,203][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][GridCacheProcessor] Restoring partition state for local groups. [21:07:42] : [Step 4/5] [2021-11-19 21:07:42,203][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=0, partitionsProcessed=0, time=0ms] [21:07:42] : [Step 4/5] [2021-11-19 21:07:42,280][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][GridClusterStateProcessor] Restoring history for BaselineTopology[id=0] [21:07:42]W: [org.apache.ignite:ignite-core] [2021-11-19 21:07:42,283][WARN ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][GridLocalConfigManager] Static configuration for the following caches will be ignored because a persistent cache with the same name already exist (see https://apacheignite.readme.io/docs/cache-configuration for more information): [encrypted] [21:07:42] : [Step 4/5] [2021-11-19 21:07:42,284][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][ClusterProcessor] Cluster ID and tag has been read from metastorage: ClusterIdAndTag [id=fa571dfd-3dc3-453e-81dd-4638e2fd34ee, tag=zealous_snyder] [21:07:42] : [Step 4/5] [2021-11-19 21:07:42,285][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][IgniteClusterImpl] Shutdown policy was updated [oldVal=null, newVal=null] [21:07:42] : [Step 4/5] [2021-11-19 21:07:42,285][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustEnabled' was changed from 'null' to 'false' [21:07:42] : [Step 4/5] [2021-11-19 21:07:42,286][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustTimeout' was changed from 'null' to '300000' [21:07:42] : [Step 4/5] [2021-11-19 21:07:42,286][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][IgniteTxManager] Transactions parameter 'txOwnerDumpRequestsAllowed' was changed from 'null' to 'true' [21:07:42] : [Step 4/5] [2021-11-19 21:07:42,287][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][IgniteTxManager] Transactions parameter 'longOperationsDumpTimeout' was changed from 'null' to '60000' [21:07:42] : [Step 4/5] [2021-11-19 21:07:42,287][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpThreshold' was changed from 'null' to '0' [21:07:42] : [Step 4/5] [2021-11-19 21:07:42,287][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][IgniteTxManager] Transactions parameter 'transactionTimeDumpSamplesCoefficient' was changed from 'null' to '0.0' [21:07:42] : [Step 4/5] [2021-11-19 21:07:42,288][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpSamplesPerSecondLimit' was changed from 'null' to '5' [21:07:42] : [Step 4/5] [2021-11-19 21:07:42,288][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][IgniteTxManager] Transactions parameter 'collisionsDumpInterval' was changed from 'null' to '1000' [21:07:42] : [Step 4/5] [2021-11-19 21:07:42,289][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][GridCacheDatabaseSharedManager] Historical rebalance WAL threshold changed [property=historical.rebalance.threshold, oldVal=null, newVal=500] [21:07:42] : [Step 4/5] [2021-11-19 21:07:42,289][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][GridCacheDatabaseSharedManager] Checkpoint frequency deviation changed [oldVal=null, newVal=null] [21:07:42] : [Step 4/5] [2021-11-19 21:07:42,290][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][FilePageStoreManager] Cleanup cache stores [total=1, left=0, cleanFiles=false] [21:07:42] : [Step 4/5] [2021-11-19 21:07:42,293][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:07:42] : [Step 4/5] [2021-11-19 21:07:42,294][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:07:42] : [Step 4/5] [2021-11-19 21:07:42,296][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:07:42] : [Step 4/5] [2021-11-19 21:07:42,297][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][GridCacheDatabaseSharedManager] Data Regions Started: 5 [21:07:42] : [Step 4/5] [2021-11-19 21:07:42,297][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][GridCacheDatabaseSharedManager] ^-- sysMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:07:42] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:07:42] : [Step 4/5] ^-- default region [type=default, persistence=true, lazyAlloc=true, [21:07:42] : [Step 4/5] ... initCfg=10MB, maxCfg=10MB, usedRam=0MB, freeRam=100%, allocRam=0MB, allocTotal=0MB] [21:07:42] : [Step 4/5] ^-- metastoreMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:07:42] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:07:42] : [Step 4/5] ^-- TxLog region [type=internal, persistence=true, lazyAlloc=false, [21:07:42] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:07:42] : [Step 4/5] ^-- volatileDsMemPlc region [type=user, persistence=false, lazyAlloc=true, [21:07:42] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB] [21:07:42] : [Step 4/5] ^-- Ignite persistence [used=0MB] [21:07:42] : [Step 4/5] [21:07:42] : [Step 4/5] [2021-11-19 21:07:42,299][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][GridCacheDatabaseSharedManager] Starting binary memory restore for: [-2100569601, 1613773252] [21:07:42] : [Step 4/5] [2021-11-19 21:07:42,374][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=/opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1/cp/1637345258301-93e37ec0-1622-4ae5-82fb-a5550cdcf1a2-START.bin, endMarker=/opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1/cp/1637345249985-bc5ae79a-c166-4801-9dda-bc6ecfacf3cd-END.bin] [21:07:42] : [Step 4/5] [2021-11-19 21:07:42,375][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=165523, len=11887], lastMarked=WALPointer [idx=0, fileOff=649805, len=11871], lastCheckpointId=93e37ec0-1622-4ae5-82fb-a5550cdcf1a2] [21:07:42]W: [org.apache.ignite:ignite-core] [2021-11-19 21:07:42,447][WARN ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][GridCacheDatabaseSharedManager] Ignite node stopped in the middle of checkpoint. Will restore memory state and finish checkpoint on node start. [21:07:42] : [Step 4/5] [2021-11-19 21:07:42,448][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][PageMemoryImpl] Started page memory [memoryAllocated=24.0 MiB, pages=5952, tableSize=474.2 KiB, replacementSize=768 B, checkpointBuffer=10.0 MiB] [21:07:42] : [Step 4/5] [2021-11-19 21:07:42,514][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][GridCacheDatabaseSharedManager] Found last checkpoint marker [cpId=93e37ec0-1622-4ae5-82fb-a5550cdcf1a2, pos=WALPointer [idx=0, fileOff=649805, len=11871]] [21:07:42] : [Step 4/5] [2021-11-19 21:07:42,518][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][GridCacheDatabaseSharedManager] Finished applying memory changes [changesApplied=847, time=71 ms] [21:07:42] : [Step 4/5] [2021-11-19 21:07:42,917][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][CheckpointWorkflow] Checkpoint finished [cpId=93e37ec0-1622-4ae5-82fb-a5550cdcf1a2, pages=447, markPos=WALPointer [idx=0, fileOff=649805, len=11871], pagesWrite=15ms, fsync=373ms, total=388ms] [21:07:42] : [Step 4/5] [2021-11-19 21:07:42,919][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][GridCacheDatabaseSharedManager] Binary memory state restored at node startup [restoredPtr=WALPointer [idx=0, fileOff=661676, len=0]] [21:07:42] : [Step 4/5] [2021-11-19 21:07:42,920][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000000.wal, offset=661676, ver=2] [21:07:42] : [Step 4/5] [2021-11-19 21:07:42,924][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][GridCacheProcessor] Started cache in recovery mode [name=ignite-sys-cache, id=-2100569601, dataRegionName=sysMemPlc, mode=REPLICATED, atomicity=TRANSACTIONAL, backups=2147483647, mvcc=false] [21:07:42] : [Step 4/5] [2021-11-19 21:07:42,932][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][GridCacheProcessor] Started cache in recovery mode [name=encrypted, id=1613773252, dataRegionName=default, mode=PARTITIONED, atomicity=ATOMIC, backups=0, mvcc=false] [21:07:42] : [Step 4/5] [2021-11-19 21:07:42,933][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][GridCacheDatabaseSharedManager] Binary recovery performed in 634 ms. [21:07:42] : [Step 4/5] [2021-11-19 21:07:42,934][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=/opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1/cp/1637345258301-93e37ec0-1622-4ae5-82fb-a5550cdcf1a2-START.bin, endMarker=/opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1/cp/1637345258301-93e37ec0-1622-4ae5-82fb-a5550cdcf1a2-END.bin] [21:07:42] : [Step 4/5] [2021-11-19 21:07:42,935][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][GridCacheDatabaseSharedManager] Applying lost cache updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=649805, len=11871], lastCheckpointId=93e37ec0-1622-4ae5-82fb-a5550cdcf1a2] [21:07:43] : [Step 4/5] [2021-11-19 21:07:43,012][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=84 ms] [21:07:43] : [Step 4/5] [2021-11-19 21:07:43,012][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][GridCacheProcessor] Restoring partition state for local groups. [21:07:43] : [Step 4/5] [2021-11-19 21:07:43,115][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=2, partitionsProcessed=1124, time=101ms] [21:07:43] : [Step 4/5] [2021-11-19 21:07:43,124][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][TestTcpDiscoverySpi] Successfully bound to TCP port [port=47501, localHost=localhost/127.0.0.1, locNodeId=10c6533b-996e-40b2-9d3e-134d0e2e9001] [21:07:43] : [Step 4/5] [2021-11-19 21:07:43,128][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][GridEncryptionManager] Sending stored group keys to coordinator [grps=1613773252] [21:07:43] : [Step 4/5] [2021-11-19 21:07:43,134][INFO ][tcp-disco-srvr-[:47500]-#772%grid-0%-#14808%grid-0%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=36699] [21:07:43] : [Step 4/5] [2021-11-19 21:07:43,134][INFO ][tcp-disco-srvr-[:47500]-#772%grid-0%-#14808%grid-0%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=36699] [21:07:43] : [Step 4/5] [2021-11-19 21:07:43,136][INFO ][tcp-disco-sock-reader-[]-#778%grid-0%-#14928%grid-0%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:36699, rmtPort=36699] [21:07:43] : [Step 4/5] [2021-11-19 21:07:43,138][INFO ][tcp-disco-sock-reader-[10c6533b 127.0.0.1:36699]-#778%grid-0%-#14928%grid-0%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=10c6533b-996e-40b2-9d3e-134d0e2e9001, rmtAddr=/127.0.0.1:36699] [21:07:43] : [Step 4/5] [2021-11-19 21:07:43,143][INFO ][tcp-disco-srvr-[:47501]-#777%grid-1%-#14927%grid-1%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=32969] [21:07:43] : [Step 4/5] [2021-11-19 21:07:43,144][INFO ][tcp-disco-srvr-[:47501]-#777%grid-1%-#14927%grid-1%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=32969] [21:07:43] : [Step 4/5] [2021-11-19 21:07:43,145][INFO ][tcp-disco-sock-reader-[]-#779%grid-1%-#14929%grid-1%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:32969, rmtPort=32969] [21:07:43] : [Step 4/5] [2021-11-19 21:07:43,145][INFO ][tcp-disco-sock-reader-[]-#779%grid-1%-#14929%grid-1%][TestTcpDiscoverySpi] Received ping request from the remote node [rmtNodeId=00983e3d-511c-4870-a39b-cacb053c0000, rmtAddr=/127.0.0.1:32969, rmtPort=32969] [21:07:43] : [Step 4/5] [2021-11-19 21:07:43,146][INFO ][tcp-disco-sock-reader-[]-#779%grid-1%-#14929%grid-1%][TestTcpDiscoverySpi] Finished writing ping response [rmtNodeId=00983e3d-511c-4870-a39b-cacb053c0000, rmtAddr=/127.0.0.1:32969, rmtPort=32969] [21:07:43] : [Step 4/5] [2021-11-19 21:07:43,147][INFO ][tcp-disco-sock-reader-[10c6533b 127.0.0.1:36699]-#778%grid-0%-#14928%grid-0%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:36699, rmtPort=36699, rmtNodeId=10c6533b-996e-40b2-9d3e-134d0e2e9001] [21:07:43] : [Step 4/5] [2021-11-19 21:07:43,147][INFO ][tcp-disco-sock-reader-[]-#779%grid-1%-#14929%grid-1%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:32969, rmtPort=32969, rmtNodeId=null] [21:07:43] : [Step 4/5] [2021-11-19 21:07:43,166][INFO ][tcp-disco-msg-worker-[crd]-#771%grid-0%-#14807%grid-0%][TestTcpDiscoverySpi] New next node [newNext=TcpDiscoveryNode [id=10c6533b-996e-40b2-9d3e-134d0e2e9001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=0, intOrder=2, lastExchangeTime=1637345263141, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false]] [21:07:43] : [Step 4/5] [2021-11-19 21:07:43,166][INFO ][tcp-disco-srvr-[:47501]-#777%grid-1%-#14927%grid-1%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=55801] [21:07:43] : [Step 4/5] [2021-11-19 21:07:43,167][INFO ][tcp-disco-srvr-[:47501]-#777%grid-1%-#14927%grid-1%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=55801] [21:07:43] : [Step 4/5] [2021-11-19 21:07:43,167][INFO ][tcp-disco-sock-reader-[]-#780%grid-1%-#14930%grid-1%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:55801, rmtPort=55801] [21:07:43] : [Step 4/5] [2021-11-19 21:07:43,168][INFO ][tcp-disco-sock-reader-[00983e3d 127.0.0.1:55801]-#780%grid-1%-#14930%grid-1%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=00983e3d-511c-4870-a39b-cacb053c0000, rmtAddr=/127.0.0.1:55801] [21:07:43] : [Step 4/5] [2021-11-19 21:07:43,172][INFO ][tcp-disco-msg-worker-[]-#776%grid-1%-#14926%grid-1%][TestTcpDiscoverySpi] New next node [newNext=TcpDiscoveryNode [id=00983e3d-511c-4870-a39b-cacb053c0000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345263161, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false]] [21:07:43] : [Step 4/5] [2021-11-19 21:07:43,174][INFO ][tcp-disco-srvr-[:47500]-#772%grid-0%-#14808%grid-0%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=55297] [21:07:43] : [Step 4/5] [2021-11-19 21:07:43,174][INFO ][tcp-disco-srvr-[:47500]-#772%grid-0%-#14808%grid-0%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=55297] [21:07:43] : [Step 4/5] [2021-11-19 21:07:43,175][INFO ][tcp-disco-sock-reader-[]-#781%grid-0%-#14931%grid-0%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:55297, rmtPort=55297] [21:07:43] : [Step 4/5] [2021-11-19 21:07:43,176][INFO ][tcp-disco-sock-reader-[10c6533b 127.0.0.1:55297]-#781%grid-0%-#14931%grid-0%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=10c6533b-996e-40b2-9d3e-134d0e2e9001, rmtAddr=/127.0.0.1:55297] [21:07:43] : [Step 4/5] [2021-11-19 21:07:43,178][INFO ][disco-event-worker-#14810%grid-0%][GridDiscoveryManager] Added new node to topology: TcpDiscoveryNode [id=10c6533b-996e-40b2-9d3e-134d0e2e9001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637345263141, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false] [21:07:43] : [Step 4/5] [2021-11-19 21:07:43,179][INFO ][disco-event-worker-#14810%grid-0%][GridDiscoveryManager] Topology snapshot [ver=2, locNode=00983e3d, servers=2, clients=0, state=INACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=00983e3d-511c-4870-a39b-cacb053c0000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=10c6533b-996e-40b2-9d3e-134d0e2e9001, consistentId=grid-1, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:07:43] : [Step 4/5] [2021-11-19 21:07:43,180][INFO ][disco-event-worker-#14810%grid-0%][GridDiscoveryManager] ^-- Baseline [id=0, size=2, online=2, offline=0] [21:07:43] : [Step 4/5] [2021-11-19 21:07:43,180][INFO ][disco-event-worker-#14810%grid-0%][GridDiscoveryManager] ^-- All baseline nodes are online, will start auto-activation [21:07:43] : [Step 4/5] [2021-11-19 21:07:43,184][INFO ][tcp-disco-msg-worker-[00983e3d 127.0.0.1:47500]-#776%grid-1%-#14926%grid-1%][GridEncryptionManager] Skip group key received from coordinator. Already exists. [grp=1613773252, keyId=0] [21:07:43] : [Step 4/5] [2021-11-19 21:07:43,189][INFO ][disco-notifier-worker-#14925%grid-1%][MvccProcessorImpl] Assigned mvcc coordinator [crd=MvccCoordinator [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=0], nodeId=00983e3d-511c-4870-a39b-cacb053c0000, ver=1637345261712, local=false, initialized=false]] [21:07:43] : [Step 4/5] [2021-11-19 21:07:43,191][INFO ][disco-notifier-worker-#14925%grid-1%][GridClusterStateProcessor] Sending activate cluster request with BaselineTopology BaselineTopology [id=0, branchingHash=-2475315501, branchingType='Cluster activation', baselineNodes=[grid-1, grid-0]] [21:07:43] : [Step 4/5] [2021-11-19 21:07:43,194][INFO ][sys-#14914%grid-1%][ClusterProcessor] Writing cluster ID and tag to metastorage on ready for write ClusterIdAndTag [id=fa571dfd-3dc3-453e-81dd-4638e2fd34ee, tag=zealous_snyder] [21:07:43] : [Step 4/5] [2021-11-19 21:07:43,197][INFO ][disco-notifier-worker-#14806%grid-0%][GridClusterStateProcessor] Received activate cluster request with BaselineTopology[id=0] initiator node ID: 10c6533b-996e-40b2-9d3e-134d0e2e9001 [21:07:43] : [Step 4/5] [2021-11-19 21:07:43,197][INFO ][disco-notifier-worker-#14806%grid-0%][GridClusterStateProcessor] Started state transition: activate cluster [21:07:43] : [Step 4/5] [2021-11-19 21:07:43,198][INFO ][exchange-worker-#14811%grid-0%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], crd=true, evt=DISCOVERY_CUSTOM_EVT, evtNode=10c6533b-996e-40b2-9d3e-134d0e2e9001, customEvt=ChangeGlobalStateMessage [id=ce55d593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqId=593eface-6f8b-4d7c-9d27-736bfa90079f, initiatingNodeId=10c6533b-996e-40b2-9d3e-134d0e2e9001, state=ACTIVE, baselineTopology=BaselineTopology [id=0, branchingHash=-2475315501, branchingType='Cluster activation', baselineNodes=[grid-1, grid-0]], forceChangeBaselineTopology=false, timestamp=1637345263191, forceDeactivation=true], allowMerge=false, exchangeFreeSwitch=false] [21:07:43] : [Step 4/5] [2021-11-19 21:07:43,199][INFO ][exchange-worker-#14811%grid-0%][GridDhtPartitionsExchangeFuture] Start activation process [nodeId=00983e3d-511c-4870-a39b-cacb053c0000, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]]. New state: ACTIVE [21:07:43] : [Step 4/5] [2021-11-19 21:07:43,199][INFO ][disco-notifier-worker-#14925%grid-1%][GridClusterStateProcessor] Received activate cluster request with BaselineTopology[id=0] initiator node ID: 10c6533b-996e-40b2-9d3e-134d0e2e9001 [21:07:43] : [Step 4/5] [2021-11-19 21:07:43,199][INFO ][exchange-worker-#14811%grid-0%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0 [21:07:43] : [Step 4/5] [2021-11-19 21:07:43,200][INFO ][disco-notifier-worker-#14925%grid-1%][GridClusterStateProcessor] Started state transition: activate cluster [21:07:43] : [Step 4/5] [2021-11-19 21:07:43,202][INFO ][exchange-worker-#14811%grid-0%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000000.wal, offset=776363, ver=2] [21:07:43] : [Step 4/5] [2021-11-19 21:07:43,205][INFO ][exchange-worker-#14811%grid-0%][GridClusterStateProcessor] Writing BaselineTopology[id=0] [21:07:43] : [Step 4/5] [2021-11-19 21:07:43,207][INFO ][exchange-worker-#14811%grid-0%][GridCacheDatabaseSharedManager] Finish recovery performed in 7 ms. [21:07:43] : [Step 4/5] [2021-11-19 21:07:43,209][INFO ][exchange-worker-#14811%grid-0%][msg] Components activation performed in 10 ms. [21:07:43] : [Step 4/5] [2021-11-19 21:07:43,210][INFO ][exchange-worker-#14811%grid-0%][GridCacheProcessor] Finished recovery for cache [cache=ignite-sys-cache, grp=ignite-sys-cache, startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:07:43] : [Step 4/5] [2021-11-19 21:07:43,210][INFO ][sys-#14790%grid-0%][GridCacheProcessor] Finished recovery for cache [cache=encrypted, grp=encrypted, startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:07:43] : [Step 4/5] [2021-11-19 21:07:43,212][INFO ][exchange-worker-#14937%grid-1%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], crd=false, evt=DISCOVERY_CUSTOM_EVT, evtNode=10c6533b-996e-40b2-9d3e-134d0e2e9001, customEvt=ChangeGlobalStateMessage [id=ce55d593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqId=593eface-6f8b-4d7c-9d27-736bfa90079f, initiatingNodeId=10c6533b-996e-40b2-9d3e-134d0e2e9001, state=ACTIVE, baselineTopology=BaselineTopology [id=0, branchingHash=-2475315501, branchingType='Cluster activation', baselineNodes=[grid-1, grid-0]], forceChangeBaselineTopology=false, timestamp=1637345263191, forceDeactivation=true], allowMerge=false, exchangeFreeSwitch=false] [21:07:43] : [Step 4/5] [2021-11-19 21:07:43,213][INFO ][exchange-worker-#14937%grid-1%][GridDhtPartitionsExchangeFuture] Start activation process [nodeId=10c6533b-996e-40b2-9d3e-134d0e2e9001, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]]. New state: ACTIVE [21:07:43] : [Step 4/5] [2021-11-19 21:07:43,214][INFO ][exchange-worker-#14937%grid-1%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1 [21:07:43]W: [org.apache.ignite:ignite-core] [2021-11-19 21:07:43,214][WARN ][sys-#14784%grid-0%][CacheAffinitySharedManager] Cache group 'encrypted' brings high overhead for its metainformation in data region 'default'. Metainformation required for its partitions (502 partitions, 4096 bytes per partition, 1 MBs total) will consume more than 15% of data region memory (10 MBs). It may lead to critical errors on the node and cluster instability. Please reduce number of partitions, add more memory to the data region or add more server nodes for this cache group. [21:07:43] : [Step 4/5] [2021-11-19 21:07:43,215][INFO ][exchange-worker-#14811%grid-0%][GridDhtPartitionsExchangeFuture] Successfully activated caches [nodeId=00983e3d-511c-4870-a39b-cacb053c0000, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], newState=ACTIVE] [21:07:43]W: [org.apache.ignite:ignite-core] [2021-11-19 21:07:43,216][WARN ][exchange-worker-#14811%grid-0%][CacheAffinitySharedManager] Cache group 'encrypted' brings high overhead for its metainformation in data region 'default'. Metainformation required for its partitions (502 partitions, 4096 bytes per partition, 1 MBs total) will consume more than 15% of data region memory (10 MBs). It may lead to critical errors on the node and cluster instability. Please reduce number of partitions, add more memory to the data region or add more server nodes for this cache group. [21:07:43] : [Step 4/5] [2021-11-19 21:07:43,217][INFO ][exchange-worker-#14811%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:07:43] : [Step 4/5] [2021-11-19 21:07:43,226][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][IgniteKernal%grid-1] To start Console Management & Monitoring run ignitevisorcmd.{sh|bat} [21:07:43] : [Step 4/5] [2021-11-19 21:07:43,227][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][IgniteKernal%grid-1] [21:07:43] : [Step 4/5] [21:07:43] : [Step 4/5] >>> +-------------------------------------------+ [21:07:43] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:07:43] : [Step 4/5] >>> +-------------------------------------------+ [21:07:43] : [Step 4/5] >>> OS name: Linux 4.15.0-151-generic amd64 [21:07:43] : [Step 4/5] >>> CPU(s): 24 [21:07:43] : [Step 4/5] >>> Heap: 2.0GB [21:07:43] : [Step 4/5] >>> VM name: 16724@c4dfe9a430b2 [21:07:43] : [Step 4/5] >>> Ignite instance name: grid-1 [21:07:43] : [Step 4/5] >>> Local node [ID=10C6533B-996E-40B2-9D3E-134D0E2E9001, order=2, clientMode=false] [21:07:43] : [Step 4/5] >>> Local node addresses: [127.0.0.1] [21:07:43] : [Step 4/5] >>> Local ports: TCP:10801 TCP:45171 TCP:47501 [21:07:43] : [Step 4/5] [21:07:43] : [Step 4/5] [2021-11-19 21:07:43,228][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][GridDiscoveryManager] Topology snapshot [ver=2, locNode=10c6533b, servers=2, clients=0, state=INACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=00983e3d-511c-4870-a39b-cacb053c0000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=10c6533b-996e-40b2-9d3e-134d0e2e9001, consistentId=grid-1, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:07:43] : [Step 4/5] [2021-11-19 21:07:43,229][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][GridDiscoveryManager] ^-- Baseline [id=0, size=2, online=2, offline=0] [21:07:43] : [Step 4/5] [2021-11-19 21:07:43,229][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][GridDiscoveryManager] ^-- All baseline nodes are online, will start auto-activation [21:07:43] : [Step 4/5] [2021-11-19 21:07:43,230][INFO ][exchange-worker-#14937%grid-1%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000000.wal, offset=661676, ver=2] [21:07:43] : [Step 4/5] [2021-11-19 21:07:43,230][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][G] Node started : [stage="Configure system pool" (0 ms),stage="Start managers" (273 ms),stage="Configure binary metadata" (4 ms),stage="Start processors" (28 ms),stage="Start 'StanByClusterTestProvider' plugin" (0 ms),stage="Start 'PageMemory tracker plugin' plugin" (0 ms),stage="Start 'TestDistibutedConfigurationPlugin' plugin" (0 ms),stage="Start 'NodeValidationPluginProvider' plugin" (0 ms),stage="Init metastore" (228 ms),stage="Init and start regions" (8 ms),stage="Restore binary memory" (634 ms),stage="Restore logical state" (182 ms),stage="Finish recovery" (0 ms),stage="Join topology" (72 ms),stage="Await transition" (6 ms),stage="Await exchange" (33 ms),stage="Total time" (1468 ms)] [21:07:43] : [Step 4/5] [2021-11-19 21:07:43,232][INFO ][exchange-worker-#14937%grid-1%][GridClusterStateProcessor] Writing BaselineTopology[id=0] [21:07:43] : [Step 4/5] [2021-11-19 21:07:43,233][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][root] Node started with the following configuration [id=10c6533b-996e-40b2-9d3e-134d0e2e9001, marshaller=BinaryMarshaller [], discovery=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=5000, ackTimeout=5000, marsh=JdkMarshaller [clsFilter=org.apache.ignite.marshaller.MarshallerUtils$1@2af9e74], reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], binaryCfg=null, lateAff=true] [21:07:43] : [Step 4/5] [2021-11-19 21:07:43,234][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][GridClusterStateProcessor] Sending activate cluster request with BaselineTopology BaselineTopology [id=0, branchingHash=-2475315501, branchingType='Cluster activation', baselineNodes=[grid-1, grid-0]] [21:07:43] : [Step 4/5] [2021-11-19 21:07:43,235][INFO ][disco-notifier-worker-#14806%grid-0%][GridClusterStateProcessor] Received activate cluster request with BaselineTopology[id=0] initiator node ID: 00983e3d-511c-4870-a39b-cacb053c0000 [21:07:43] : [Step 4/5] [2021-11-19 21:07:43,236][INFO ][disco-notifier-worker-#14925%grid-1%][GridClusterStateProcessor] Received activate cluster request with BaselineTopology[id=0] initiator node ID: 00983e3d-511c-4870-a39b-cacb053c0000 [21:07:43] : [Step 4/5] [2021-11-19 21:07:43,237][INFO ][exchange-worker-#14811%grid-0%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], crd=true] [21:07:43] : [Step 4/5] [2021-11-19 21:07:43,242][INFO ][exchange-worker-#14937%grid-1%][GridCacheDatabaseSharedManager] Finish recovery performed in 27 ms. [21:07:43] : [Step 4/5] [2021-11-19 21:07:43,243][INFO ][exchange-worker-#14937%grid-1%][msg] Components activation performed in 29 ms. [21:07:43] : [Step 4/5] [2021-11-19 21:07:43,244][INFO ][sys-#14902%grid-1%][GridCacheProcessor] Finished recovery for cache [cache=ignite-sys-cache, grp=ignite-sys-cache, startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:07:43] : [Step 4/5] [2021-11-19 21:07:43,244][INFO ][exchange-worker-#14937%grid-1%][GridCacheProcessor] Finished recovery for cache [cache=encrypted, grp=encrypted, startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:07:43]W: [org.apache.ignite:ignite-core] [2021-11-19 21:07:43,247][WARN ][sys-#14903%grid-1%][CacheAffinitySharedManager] Cache group 'encrypted' brings high overhead for its metainformation in data region 'default'. Metainformation required for its partitions (522 partitions, 4096 bytes per partition, 2 MBs total) will consume more than 15% of data region memory (10 MBs). It may lead to critical errors on the node and cluster instability. Please reduce number of partitions, add more memory to the data region or add more server nodes for this cache group. [21:07:43] : [Step 4/5] [2021-11-19 21:07:43,248][INFO ][exchange-worker-#14937%grid-1%][GridDhtPartitionsExchangeFuture] Successfully activated caches [nodeId=10c6533b-996e-40b2-9d3e-134d0e2e9001, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], newState=ACTIVE] [21:07:43]W: [org.apache.ignite:ignite-core] [2021-11-19 21:07:43,249][WARN ][exchange-worker-#14937%grid-1%][CacheAffinitySharedManager] Cache group 'encrypted' brings high overhead for its metainformation in data region 'default'. Metainformation required for its partitions (522 partitions, 4096 bytes per partition, 2 MBs total) will consume more than 15% of data region memory (10 MBs). It may lead to critical errors on the node and cluster instability. Please reduce number of partitions, add more memory to the data region or add more server nodes for this cache group. [21:07:43] : [Step 4/5] [2021-11-19 21:07:43,250][INFO ][exchange-worker-#14937%grid-1%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:07:43] : [Step 4/5] [2021-11-19 21:07:43,253][INFO ][db-checkpoint-thread-#14939%grid-0%][Checkpointer] Checkpoint started [checkpointId=06a9c17a-f5a7-4ab0-88c4-92995a73b0b3, startPtr=WALPointer [idx=0, fileOff=1088262, len=11507], checkpointBeforeLockTime=9ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=1ms, checkpointLockHoldTime=2ms, walCpRecordFsyncDuration=14ms, writeCheckpointEntryDuration=2ms, splitAndSortCpPagesDuration=0ms, pages=70, reason='node started'] [21:07:43] : [Step 4/5] [2021-11-19 21:07:43,264][INFO ][grid-nio-worker-tcp-comm-0-#14749%TcpCommunicationSpi%][TcpCommunicationSpi] Accepted incoming communication connection [locAddr=/127.0.0.1:45170, rmtAddr=/127.0.0.1:42108] [21:07:43] : [Step 4/5] [2021-11-19 21:07:43,267][INFO ][grid-nio-worker-tcp-comm-0-#14868%TcpCommunicationSpi%][TcpCommunicationSpi] Established outgoing communication connection [locAddr=/127.0.0.1:42108, rmtAddr=/127.0.0.1:45170] [21:07:43] : [Step 4/5] [2021-11-19 21:07:43,267][INFO ][exchange-worker-#14937%grid-1%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], crd=false] [21:07:43] : [Step 4/5] [2021-11-19 21:07:43,269][INFO ][sys-#14786%grid-0%][GridDhtPartitionsExchangeFuture] Coordinator received single message [ver=AffinityTopologyVersion [topVer=2, minorTopVer=1], node=10c6533b-996e-40b2-9d3e-134d0e2e9001, allReceived=true] [21:07:43] : [Step 4/5] [2021-11-19 21:07:43,270][INFO ][sys-#14786%grid-0%][GridDhtPartitionsExchangeFuture] finishExchangeOnCoordinator [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:07:43] : [Step 4/5] [2021-11-19 21:07:43,285][INFO ][sys-#14908%grid-1%][GridDhtPartitionsExchangeFuture] Received full message, will finish exchange [node=00983e3d-511c-4870-a39b-cacb053c0000, resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:07:43] : [Step 4/5] [2021-11-19 21:07:43,287][INFO ][sys-#14908%grid-1%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], err=null, rebalanced=true, wasRebalanced=false] [21:07:43] : [Step 4/5] [2021-11-19 21:07:43,290][INFO ][disco-notifier-worker-#14806%grid-0%][GridClusterStateProcessor] Received state change finish message: ACTIVE [21:07:43] : [Step 4/5] [2021-11-19 21:07:43,291][INFO ][disco-notifier-worker-#14925%grid-1%][GridClusterStateProcessor] Received state change finish message: ACTIVE [21:07:43] : [Step 4/5] [2021-11-19 21:07:43,291][INFO ][sys-#14786%grid-0%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], err=null, rebalanced=true, wasRebalanced=false] [21:07:43] : [Step 4/5] [2021-11-19 21:07:43,291][INFO ][disco-notifier-worker-#14806%grid-0%][GridClusterStateProcessor] Cluster state was changed from INACTIVE to ACTIVE [21:07:43] : [Step 4/5] [2021-11-19 21:07:43,291][INFO ][disco-notifier-worker-#14925%grid-1%][GridClusterStateProcessor] Cluster state was changed from INACTIVE to ACTIVE [21:07:43] : [Step 4/5] [2021-11-19 21:07:43,297][INFO ][sys-#14908%grid-1%][GridCacheProcessor] Finish proxy initialization, cacheName=ignite-sys-cache, localNodeId=10c6533b-996e-40b2-9d3e-134d0e2e9001 [21:07:43] : [Step 4/5] [2021-11-19 21:07:43,297][INFO ][sys-#14908%grid-1%][GridCacheProcessor] Finish proxy initialization, cacheName=encrypted, localNodeId=10c6533b-996e-40b2-9d3e-134d0e2e9001 [21:07:43] : [Step 4/5] [2021-11-19 21:07:43,298][INFO ][sys-#14911%grid-1%][DistributedBaselineConfiguration] Baseline auto-adjust is 'disabled' with timeout='300000' ms [21:07:43] : [Step 4/5] [2021-11-19 21:07:43,299][INFO ][sys-#14911%grid-1%][GridClusterStateProcessor] Successfully performed final activation steps [nodeId=10c6533b-996e-40b2-9d3e-134d0e2e9001, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:07:43] : [Step 4/5] [2021-11-19 21:07:43,299][INFO ][sys-#14786%grid-0%][GridCacheProcessor] Finish proxy initialization, cacheName=ignite-sys-cache, localNodeId=00983e3d-511c-4870-a39b-cacb053c0000 [21:07:43] : [Step 4/5] [2021-11-19 21:07:43,300][INFO ][sys-#14786%grid-0%][GridCacheProcessor] Finish proxy initialization, cacheName=encrypted, localNodeId=00983e3d-511c-4870-a39b-cacb053c0000 [21:07:43] : [Step 4/5] [2021-11-19 21:07:43,300][INFO ][sys-#14908%grid-1%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=10c6533b-996e-40b2-9d3e-134d0e2e9001, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=10c6533b-996e-40b2-9d3e-134d0e2e9001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637345263287, loc=true, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:07:43] : [Step 4/5] [2021-11-19 21:07:43,301][INFO ][exchange-worker-#14811%grid-0%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=2, minorTopVer=1], force=false, evt=DISCOVERY_CUSTOM_EVT, node=10c6533b-996e-40b2-9d3e-134d0e2e9001] [21:07:43] : [Step 4/5] [2021-11-19 21:07:43,301][INFO ][sys-#14786%grid-0%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=00983e3d-511c-4870-a39b-cacb053c0000, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=10c6533b-996e-40b2-9d3e-134d0e2e9001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637345263141, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:07:43] : [Step 4/5] [2021-11-19 21:07:43,301][INFO ][sys-#14784%grid-0%][DistributedBaselineConfiguration] Baseline auto-adjust is 'disabled' with timeout='300000' ms [21:07:43] : [Step 4/5] [2021-11-19 21:07:43,304][INFO ][sys-#14784%grid-0%][GridClusterStateProcessor] Successfully performed final activation steps [nodeId=00983e3d-511c-4870-a39b-cacb053c0000, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:07:43] : [Step 4/5] [2021-11-19 21:07:43,300][INFO ][exchange-worker-#14937%grid-1%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=2, minorTopVer=1], force=false, evt=DISCOVERY_CUSTOM_EVT, node=10c6533b-996e-40b2-9d3e-134d0e2e9001] [21:07:43] : [Step 4/5] [2021-11-19 21:07:43,303][INFO ][sys-#14786%grid-0%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (1 ms), stage="Update caches registry" (10 ms), stage="Start caches" (2 ms), stage="Affinity initialization on cache group start" (2 ms), stage="Determine exchange type" (2 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Restore partition states" (0 ms), stage="After states restored callback" (18 ms), stage="WAL history reservation" (0 ms), stage="Waiting for all single messages" (32 ms), stage="Affinity recalculation (crd)" (0 ms), stage="Collect update counters and create affinity messages" (0 ms), stage="Assign partitions states" (2 ms), stage="Validate partitions states" (0 ms), stage="Ideal affinity diff calculation (enforced)" (3 ms), stage="Apply update counters" (0 ms), stage="Full message preparing" (3 ms), stage="Full message sending" (0 ms), stage="State finish message sending" (10 ms), stage="Detect lost partitions" (7 ms), stage="Exchange done" (4 ms), stage="Total time" (96 ms), Discovery lag=4 ms, Latest started node id=10c6533b-996e-40b2-9d3e-134d0e2e9001] [21:07:43] : [Step 4/5] [2021-11-19 21:07:43,301][INFO ][sys-#14908%grid-1%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], stage="Waiting in exchange queue" (10 ms), stage="Exchange parameters initialization" (1 ms), stage="Update caches registry" (30 ms), stage="Start caches" (1 ms), stage="Affinity initialization on cache group start" (2 ms), stage="Determine exchange type" (1 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Restore partition states" (0 ms), stage="After states restored callback" (10 ms), stage="WAL history reservation" (0 ms), stage="Waiting for Full message" (23 ms), stage="Affinity recalculation" (1 ms), stage="Full map updating" (0 ms), stage="Detect lost partitions" (4 ms), stage="Exchange done" (9 ms), stage="Total time" (92 ms)] [21:07:43] : [Step 4/5] [2021-11-19 21:07:43,308][INFO ][test-runner-#14423%encryption.EncryptedCachePreconfiguredRestartTest%][root] awaitPartitionMapExchange finished [21:07:43] : [Step 4/5] [2021-11-19 21:07:43,307][INFO ][sys-#14786%grid-0%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], stage="Affinity initialization on cache group start [grp=encrypted]" (1 ms) (parent=Affinity initialization on cache group start), stage="Affinity initialization on cache group start [grp=ignite-sys-cache]" (0 ms) (parent=Affinity initialization on cache group start), stage="Affinity centralized initialization (crd) [grp=ignite-sys-cache, crd=true]" (0 ms) (parent=Determine exchange type), stage="Affinity centralized initialization (crd) [grp=encrypted, crd=true]" (0 ms) (parent=Determine exchange type), stage="Restore partition states [grp=ignite-sys-cache]" (0 ms) (parent=Restore partition states), stage="Restore partition states [grp=encrypted]" (0 ms) (parent=Restore partition states), stage="Affinity recalculation (partitions availability) [grp=ignite-sys-cache]" (3 ms) (parent=Ideal affinity diff calculation (enforced)), stage="Affinity recalculation (partitions availability) [grp=encrypted]" (3 ms) (parent=Ideal affinity diff calculation (enforced))] [21:07:43] : [Step 4/5] [2021-11-19 21:07:43,309][INFO ][sys-#14908%grid-1%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], stage="Affinity initialization on cache group start [grp=encrypted]" (1 ms) (parent=Affinity initialization on cache group start), stage="Affinity initialization on cache group start [grp=ignite-sys-cache]" (0 ms) (parent=Affinity initialization on cache group start), stage="Affinity centralized initialization (crd) [grp=ignite-sys-cache, crd=false]" (0 ms) (parent=Determine exchange type), stage="Affinity centralized initialization (crd) [grp=encrypted, crd=false]" (0 ms) (parent=Determine exchange type), stage="Restore partition states [grp=ignite-sys-cache]" (0 ms) (parent=Restore partition states), stage="Restore partition states [grp=encrypted]" (0 ms) (parent=Restore partition states), stage="Affinity applying from full message [grp=ignite-sys-cache]" (0 ms) (parent=Affinity recalculation), stage="Affinity applying from full message [grp=encrypted]" (0 ms) (parent=Affinity recalculation)] [21:07:43] : [Step 4/5] [2021-11-19 21:07:43,320][INFO ][db-checkpoint-thread-#14948%grid-1%][Checkpointer] Checkpoint started [checkpointId=b57cf578-b2e3-4167-baa9-2ebeac845d3e, startPtr=WALPointer [idx=0, fileOff=923667, len=11887], checkpointBeforeLockTime=7ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=1ms, checkpointLockHoldTime=2ms, walCpRecordFsyncDuration=11ms, writeCheckpointEntryDuration=48ms, splitAndSortCpPagesDuration=0ms, pages=58, reason='node started'] [21:07:43] : [Step 4/5] [21:07:43] >>> Stopping test: EncryptedCachePreconfiguredRestartTest#testCreateEncryptedCache in 17780 ms <<< [21:07:43] : [Step 4/5] [2021-11-19 21:07:43,349][INFO ][main][root] >>> Stopping test: EncryptedCachePreconfiguredRestartTest#testCreateEncryptedCache in 17780 ms <<< [21:07:43] : [Step 4/5] [21:07:43] >>> Heap: 544 MB used / 1913 MB commited / 1913 MB max <<< [21:07:43] : [Step 4/5] [2021-11-19 21:07:43,349][INFO ][main][root] >>> Heap: 544 MB used / 1913 MB commited / 1913 MB max <<< [21:07:43] : [Step 4/5] [21:07:43] >>> Non-Heap: 154 MB used / 170 MB commited / 0 MB max <<< [21:07:43] : [Step 4/5] [2021-11-19 21:07:43,350][INFO ][main][root] >>> Non-Heap: 154 MB used / 170 MB commited / 0 MB max <<< [21:07:43] : [Step 4/5] [2021-11-19 21:07:43,350][INFO ][main][root] >>> Stopping grid [name=grid-1, id=10c6533b-996e-40b2-9d3e-134d0e2e9001] [21:07:43] : [Step 4/5] [2021-11-19 21:07:43,616][INFO ][db-checkpoint-thread-#14939%grid-0%][Checkpointer] Checkpoint finished [cpId=06a9c17a-f5a7-4ab0-88c4-92995a73b0b3, pages=70, markPos=WALPointer [idx=0, fileOff=1088262, len=11507], walSegmentsCovered=[], markDuration=19ms, pagesWrite=7ms, fsync=354ms, total=389ms] [21:07:43] : [Step 4/5] [2021-11-19 21:07:43,635][INFO ][db-checkpoint-thread-#14948%grid-1%][Checkpointer] Checkpoint finished [cpId=b57cf578-b2e3-4167-baa9-2ebeac845d3e, pages=58, markPos=WALPointer [idx=0, fileOff=923667, len=11887], walSegmentsCovered=[], markDuration=66ms, pagesWrite=13ms, fsync=297ms, total=383ms] [21:07:43] : [Step 4/5] [2021-11-19 21:07:43,639][INFO ][db-checkpoint-thread-#14948%grid-1%][Checkpointer] Skipping checkpoint (no pages were modified) [checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=1ms, checkpointLockHoldTime=2ms, reason='timeout'] [21:07:43] : [Step 4/5] [2021-11-19 21:07:43,644][INFO ][tcp-disco-sock-reader-[00983e3d 127.0.0.1:55801]-#780%grid-1%-#14930%grid-1%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:55801, rmtPort=55801, rmtNodeId=00983e3d-511c-4870-a39b-cacb053c0000] [21:07:43] : [Step 4/5] [2021-11-19 21:07:43,645][INFO ][disco-event-worker-#14810%grid-0%][GridDiscoveryManager] Node left topology: TcpDiscoveryNode [id=10c6533b-996e-40b2-9d3e-134d0e2e9001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637345263141, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false] [21:07:43] : [Step 4/5] [2021-11-19 21:07:43,646][INFO ][main][GridCacheProcessor] Stopped cache [cacheName=encrypted] [21:07:43] : [Step 4/5] [2021-11-19 21:07:43,647][INFO ][disco-event-worker-#14810%grid-0%][GridDiscoveryManager] Topology snapshot [ver=3, locNode=00983e3d, servers=1, clients=0, state=ACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=00983e3d-511c-4870-a39b-cacb053c0000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:07:43] : [Step 4/5] [2021-11-19 21:07:43,647][INFO ][main][GridCacheProcessor] Stopped cache [cacheName=ignite-sys-cache] [21:07:43] : [Step 4/5] [2021-11-19 21:07:43,648][INFO ][disco-event-worker-#14810%grid-0%][GridDiscoveryManager] ^-- Baseline [id=0, size=2, online=1, offline=1] [21:07:43] : [Step 4/5] [2021-11-19 21:07:43,650][INFO ][exchange-worker-#14811%grid-0%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], crd=true, evt=NODE_LEFT, evtNode=10c6533b-996e-40b2-9d3e-134d0e2e9001, customEvt=null, allowMerge=false, exchangeFreeSwitch=true] [21:07:43] : [Step 4/5] [2021-11-19 21:07:43,652][INFO ][sys-#14792%grid-0%][GridAffinityAssignmentCache] Local node affinity assignment distribution is not ideal [cache=encrypted, expectedPrimary=1024.00, actualPrimary=502, expectedBackups=0.00, actualBackups=0, warningThreshold=50.00%] [21:07:43] : [Step 4/5] [2021-11-19 21:07:43,653][INFO ][exchange-worker-#14811%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:07:43] : [Step 4/5] [2021-11-19 21:07:43,656][INFO ][exchange-worker-#14811%grid-0%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], err=null, rebalanced=true, wasRebalanced=true] [21:07:43]W: [org.apache.ignite:ignite-core] [2021-11-19 21:07:43,657][WARN ][sys-#14789%grid-0%][GridDhtPartitionTopologyImpl] Detected lost partitions [grp=encrypted, parts=[0, 2, 4, 6-7, 10-11, 14, 17, 21, 24-30, 32, 37, 40, 44, 47-52, 54, 57, 59, 62-64, 67-68, 74-75, 78, 81, 87-88, 91, 97, 99, 101-102, 104-107, 113-114, 116, 118, 120, 122, 124, 135-136, 138, 140-145, 147, 149-152, 154-156, 159-160, 162-164, 169, 172, 175-177, 180, 184-187, 190-191, 194, 196-202, 204-205, 209-210, 212, 214, 216, 219-224, 226, 229-232, 237, 239, 241, 243-245, 247, 249-251, 255, 257, 261, 265, 269, 272-273, 276-277, 281-282, 285, 287, 289-291, 293-297, 299, 301-304, 306, 308-309, 311-312, 315-317, 319, 322, 325-326, 328-330, 336, 339, 341, 344-346, 350, 352-354, 357-361, 363, 366-367, 371-373, 376-380, 383, 385, 387-388, 390, 392, 395-397, 400, 402, 405, 408-411, 416, 420, 422, 424-425, 429, 433, 435-438, 440-441, 445-446, 450, 452-453, 455-456, 458, 460, 462-463, 465-468, 470, 474-475, 480, 488, 490-492, 495, 497, 499-512, 516, 525, 527-531, 535, 537-538, 541-542, 545-546, 548-552, 554-555, 558, 562-564, 567-569, 572, 574, 579-580, 582-585, 587, 590-591, 594, 596, 600, 602, 604, 607-614, 617-620, 623-624, 627-629, 632-633, 636, 638, 640-642, 645-646, 648-649, 657-662, 664-665, 668-672, 677-678, 682-684, 686, 689, 692-693, 695-697, 699, 706-707, 709-710, 712-714, 716-717, 719-721, 723-728, 730-732, 734-735, 739, 742, 746, 749-750, 752, 754, 756, 762, 768-770, 772-775, 778, 780, 783-787, 789-791, 793, 796, 798-801, 803, 806, 809-812, 814, 816-817, 819, 822-825, 827-829, 832-833, 836-837, 839-840, 846, 848-851, 853-854, 857-858, 860, 863-864, 866, 868-871, 873-875, 877-878, 884, 888-889, 896-897, 900, 905-907, 914-915, 917, 919-920, 923-925, 931-933, 936, 940, 942, 944-945, 948, 950-951, 954, 956-958, 962, 965-970, 972, 975-976, 978-980, 983, 985, 988, 990, 993-994, 997-998, 1000, 1003-1004, 1007, 1009, 1014, 1016, 1018-1019], topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0]] [21:07:43] : [Step 4/5] [2021-11-19 21:07:43,658][INFO ][main][FilePageStoreManager] Cleanup cache stores [total=4, left=0, cleanFiles=false] [21:07:43] : [Step 4/5] [2021-11-19 21:07:43,661][INFO ][exchange-worker-#14811%grid-0%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=00983e3d-511c-4870-a39b-cacb053c0000, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], evt=NODE_LEFT, evtNode=TcpDiscoveryNode [id=10c6533b-996e-40b2-9d3e-134d0e2e9001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637345263141, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0]] [21:07:43] : [Step 4/5] [2021-11-19 21:07:43,667][INFO ][main][GridDeploymentLocalStore] Removed undeployed class: GridDeployment [ts=1637345263277, depMode=SHARED, clsLdr=IsolatedClassLoader{roleName='test'}, clsLdrId=8265d593d71-10c6533b-996e-40b2-9d3e-134d0e2e9001, userVer=0, loc=true, sampleClsName=org.apache.ignite.internal.processors.cache.distributed.dht.preloader.IgniteDhtPartitionsToReloadMap, pendingUndeploy=false, undeployed=true, usage=0] [21:07:43] : [Step 4/5] [2021-11-19 21:07:43,667][INFO ][exchange-worker-#14811%grid-0%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (1 ms), stage="Determine exchange type" (1 ms), stage="Preloading notification" (0 ms), stage="After states restored callback" (0 ms), stage="WAL history reservation" (1 ms), stage="Finalize update counters" (0 ms), stage="Detect lost partitions" (5 ms), stage="Exchange done" (6 ms), stage="Total time" (14 ms)] [21:07:43] : [Step 4/5] [2021-11-19 21:07:43,670][INFO ][exchange-worker-#14811%grid-0%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], stage="Affinity initialization (exchange-free switch on fully-rebalanced topology) [grp=encrypted]" (1 ms) (parent=Determine exchange type), stage="Affinity initialization (exchange-free switch on fully-rebalanced topology) [grp=ignite-sys-cache]" (0 ms) (parent=Determine exchange type)] [21:07:43] : [Step 4/5] [2021-11-19 21:07:43,671][INFO ][exchange-worker-#14811%grid-0%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], crd=true] [21:07:43] : [Step 4/5] [2021-11-19 21:07:43,673][INFO ][exchange-worker-#14811%grid-0%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=3, minorTopVer=0], force=false, evt=NODE_LEFT, node=10c6533b-996e-40b2-9d3e-134d0e2e9001] [21:07:43] : [Step 4/5] [2021-11-19 21:07:43,688][INFO ][main][IgniteKernal%grid-1] [21:07:43] : [Step 4/5] [21:07:43] : [Step 4/5] >>> +------------------------------------------------------+ [21:07:43] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV stopped OK [21:07:43] : [Step 4/5] >>> +------------------------------------------------------+ [21:07:43] : [Step 4/5] >>> Ignite instance name: grid-1 [21:07:43] : [Step 4/5] >>> Grid uptime: 00:00:00.461 [21:07:43] : [Step 4/5] [21:07:43] : [Step 4/5] [21:07:43] : [Step 4/5] [2021-11-19 21:07:43,689][INFO ][main][root] >>> Stopping grid [name=grid-0, id=00983e3d-511c-4870-a39b-cacb053c0000] [21:07:43] : [Step 4/5] [2021-11-19 21:07:43,701][INFO ][db-checkpoint-thread-#14939%grid-0%][Checkpointer] Skipping checkpoint (no pages were modified) [checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=1ms, reason='timeout'] [21:07:43]W: [org.apache.ignite:ignite-core] [2021-11-19 21:07:43,709][WARN ][tcp-disco-sock-reader-[10c6533b 127.0.0.1:55297]-#781%grid-0%-#14931%grid-0%][TestTcpDiscoverySpi] Failed to shutdown socket [21:07:43]W: [org.apache.ignite:ignite-core] java.net.SocketException: Socket is closed [21:07:43]W: [org.apache.ignite:ignite-core] at java.net.Socket.shutdownOutput(Socket.java:1568) [21:07:43]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.close(IgniteUtils.java:4247) [21:07:43]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.discovery.tcp.ServerImpl$SocketReader.body(ServerImpl.java:7370) [21:07:43] : [Step 4/5] [2021-11-19 21:07:43,710][INFO ][tcp-disco-sock-reader-[10c6533b 127.0.0.1:55297]-#781%grid-0%-#14931%grid-0%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:55297, rmtPort=55297, rmtNodeId=10c6533b-996e-40b2-9d3e-134d0e2e9001] [21:07:43]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.IgniteSpiThread.run(IgniteSpiThread.java:58) [21:07:43] : [Step 4/5] [2021-11-19 21:07:43,720][INFO ][main][GridCacheProcessor] Stopped cache [cacheName=encrypted] [21:07:43] : [Step 4/5] [2021-11-19 21:07:43,720][INFO ][main][GridCacheProcessor] Stopped cache [cacheName=ignite-sys-cache] [21:07:43] : [Step 4/5] [2021-11-19 21:07:43,727][INFO ][main][FilePageStoreManager] Cleanup cache stores [total=4, left=0, cleanFiles=false] [21:07:43] : [Step 4/5] [2021-11-19 21:07:43,729][INFO ][main][GridDeploymentLocalStore] Removed undeployed class: GridDeployment [ts=1637345263267, depMode=SHARED, clsLdr=IsolatedClassLoader{roleName='test'}, clsLdrId=6265d593d71-00983e3d-511c-4870-a39b-cacb053c0000, userVer=0, loc=true, sampleClsName=org.apache.ignite.internal.processors.cache.distributed.dht.preloader.GridDhtPartitionMap, pendingUndeploy=false, undeployed=true, usage=0] [21:07:43] : [Step 4/5] [2021-11-19 21:07:43,736][INFO ][main][IgniteKernal%grid-0] [21:07:43] : [Step 4/5] [21:07:43] : [Step 4/5] >>> +------------------------------------------------------+ [21:07:43] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV stopped OK [21:07:43] : [Step 4/5] >>> +------------------------------------------------------+ [21:07:43] : [Step 4/5] >>> Ignite instance name: grid-0 [21:07:43] : [Step 4/5] >>> Grid uptime: 00:00:01.986 [21:07:43] : [Step 4/5] [21:07:43] : [Step 4/5] [21:07:44] : [Step 4/5] [21:07:44] >>> Starting test: EncryptedCachePreconfiguredRestartTest#testDifferentPreconfiguredCachesOnNodes <<< [21:07:44] : [Step 4/5] [2021-11-19 21:07:44,010][INFO ][main][root] >>> Starting test: EncryptedCachePreconfiguredRestartTest#testDifferentPreconfiguredCachesOnNodes <<< [21:07:44] : [Step 4/5] [21:07:44] >>> Heap: 548 MB used / 1913 MB commited / 1913 MB max <<< [21:07:44] : [Step 4/5] [2021-11-19 21:07:44,010][INFO ][main][root] >>> Heap: 548 MB used / 1913 MB commited / 1913 MB max <<< [21:07:44] : [Step 4/5] [21:07:44] >>> Non-Heap: 154 MB used / 170 MB commited / 0 MB max <<< [21:07:44] : [Step 4/5] [2021-11-19 21:07:44,010][INFO ][main][root] >>> Non-Heap: 154 MB used / 170 MB commited / 0 MB max <<< [21:07:44]W: [org.apache.ignite:ignite-core] [2021-11-19 21:07:44,015][WARN ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][G] Ignite work directory is not provided, automatically resolved to: /opt/buildagent/work/7bc1c54bc719b67c/work [21:07:44] : [Step 4/5] [2021-11-19 21:07:44,017][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][IgniteKernal%grid-0] [21:07:44] : [Step 4/5] [21:07:44] : [Step 4/5] >>> __________ ________________ [21:07:44] : [Step 4/5] >>> / _/ ___/ |/ / _/_ __/ __/ [21:07:44] : [Step 4/5] >>> _/ // (7 7 // / / / / _/ [21:07:44] : [Step 4/5] >>> /___/\___/_/|_/___/ /_/ /___/ [21:07:44] : [Step 4/5] >>> [21:07:44] : [Step 4/5] >>> ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:07:44] : [Step 4/5] >>> 2021 Copyright(C) Apache Software Foundation [21:07:44] : [Step 4/5] >>> [21:07:44] : [Step 4/5] >>> Ignite documentation: http://ignite.apache.org [21:07:44] : [Step 4/5] [21:07:44] : [Step 4/5] [2021-11-19 21:07:44,018][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][IgniteKernal%grid-0] Config URL: n/a [21:07:44] : [Step 4/5] [2021-11-19 21:07:44,019][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][IgniteKernal%grid-0] IgniteConfiguration [igniteInstanceName=grid-0, pubPoolSize=24, svcPoolSize=24, callbackPoolSize=24, stripedPoolSize=24, sysPoolSize=24, mgmtPoolSize=4, dataStreamerPoolSize=24, utilityCachePoolSize=24, utilityCacheKeepAliveTime=60000, p2pPoolSize=2, qryPoolSize=24, buildIdxPoolSize=4, igniteHome=/opt/buildagent/work/7bc1c54bc719b67c, igniteWorkDir=/opt/buildagent/work/7bc1c54bc719b67c/work, mbeanSrv=com.sun.jmx.mbeanserver.JmxMBeanServer@6fe85038, nodeId=00ffc1ff-7fc9-4784-aee1-5882a311b000, marsh=BinaryMarshaller [], marshLocJobs=false, daemon=false, p2pEnabled=true, netTimeout=10000, netCompressionLevel=1, sndRetryDelay=1000, sndRetryCnt=3, metricsHistSize=10000, metricsUpdateFreq=1000, metricsExpTime=9223372036854775807, discoSpi=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=0, ackTimeout=0, marsh=null, reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], segPlc=STOP, segResolveAttempts=2, waitForSegOnStart=true, allResolversPassReq=true, segChkFreq=10000, commSpi=TcpCommunicationSpi [connectGate=org.apache.ignite.spi.communication.tcp.internal.ConnectGateway@2911413d, ctxInitLatch=java.util.concurrent.CountDownLatch@78548576[Count = 1], stopping=false, clientPool=null, nioSrvWrapper=null, stateProvider=null], evtSpi=MemoryEventStorageSpi [expireAgeMs=9223372036854775807, expireCnt=10000, filter=null], colSpi=NoopCollisionSpi [], deploySpi=LocalDeploymentSpi [], indexingSpi=org.apache.ignite.spi.indexing.noop.NoopIndexingSpi@1603b4f0, addrRslvr=null, encryptionSpi=org.apache.ignite.spi.encryption.keystore.KeystoreEncryptionSpi@79b43efd, tracingSpi=org.apache.ignite.spi.tracing.NoopTracingSpi@4ac6bb40, clientMode=false, rebalanceThreadPoolSize=4, rebalanceTimeout=10000, rebalanceBatchesPrefetchCnt=3, rebalanceThrottle=0, rebalanceBatchSize=524288, txCfg=TransactionConfiguration [txSerEnabled=false, dfltIsolation=REPEATABLE_READ, dfltConcurrency=PESSIMISTIC, dfltTxTimeout=0, txTimeoutOnPartitionMapExchange=0, deadlockTimeout=10000, pessimisticTxLogSize=0, pessimisticTxLogLinger=10000, tmLookupClsName=null, txManagerFactory=null, useJtaSync=false], cacheSanityCheckEnabled=true, discoStartupDelay=60000, deployMode=SHARED, p2pMissedCacheSize=100, locHost=127.0.0.1, timeSrvPortBase=31100, timeSrvPortRange=100, failureDetectionTimeout=10000, sysWorkerBlockedTimeout=null, clientFailureDetectionTimeout=10000, metricsLogFreq=0, connectorCfg=null, odbcCfg=null, warmupClos=null, atomicCfg=AtomicConfiguration [seqReserveSize=1000, cacheMode=PARTITIONED, backups=1, aff=null, grpName=null], classLdr=null, sslCtxFactory=null, platformCfg=null, binaryCfg=null, memCfg=null, pstCfg=null, dsCfg=DataStorageConfiguration [sysRegionInitSize=41943040, sysRegionMaxSize=104857600, pageSize=4096, concLvl=0, dfltDataRegConf=DataRegionConfiguration [name=default, maxSize=10485760, initSize=268435456, swapPath=null, pageEvictionMode=DISABLED, pageReplacementMode=CLOCK, evictionThreshold=0.9, emptyPagesPoolSize=100, metricsEnabled=false, metricsSubIntervalCount=5, metricsRateTimeInterval=60000, persistenceEnabled=true, checkpointPageBufSize=0, lazyMemoryAllocation=true, warmUpCfg=null], dataRegions=null, storagePath=null, checkpointFreq=180000, lockWaitTime=10000, checkpointThreads=4, checkpointWriteOrder=SEQUENTIAL, walHistSize=20, maxWalArchiveSize=1073741824, walSegments=10, walSegmentSize=67108864, walPath=db/wal, walArchivePath=db/wal/archive, cdcWalPath=db/wal/cdc, cdcEnabled=false, metricsEnabled=false, walMode=FSYNC, walTlbSize=131072, walBuffSize=0, walFlushFreq=2000, walFsyncDelay=1000, walRecordIterBuffSize=67108864, alwaysWriteFullPages=false, fileIOFactory=org.apache.ignite.internal.processors.cache.persistence.file.AsyncFileIOFactory@b5c6d58, metricsSubIntervalCnt=5, metricsRateTimeInterval=60000, walAutoArchiveAfterInactivity=-1, walForceArchiveTimeout=-1, writeThrottlingEnabled=false, walCompactionEnabled=false, walCompactionLevel=1, checkpointReadLockTimeout=null, walPageCompression=DISABLED, walPageCompressionLevel=null, dfltWarmUpCfg=null, encCfg=org.apache.ignite.configuration.EncryptionConfiguration@3e700605, defragmentationThreadPoolSize=4, minWalArchiveSize=-1], snapshotPath=snapshots, activeOnStart=true, activeOnStartPropSetFlag=false, autoActivation=true, autoActivationPropSetFlag=false, clusterStateOnStart=null, sqlConnCfg=null, cliConnCfg=ClientConnectorConfiguration [host=null, port=10800, portRange=100, sockSndBufSize=0, sockRcvBufSize=0, tcpNoDelay=true, maxOpenCursorsPerConn=128, threadPoolSize=24, selectorCnt=12, idleTimeout=0, handshakeTimeout=10000, jdbcEnabled=true, odbcEnabled=true, thinCliEnabled=true, sslEnabled=false, useIgniteSslCtxFactory=true, sslClientAuth=false, sslCtxFactory=null, thinCliCfg=ThinClientConfiguration [maxActiveTxPerConn=100, maxActiveComputeTasksPerConn=0]], mvccVacuumThreadCnt=2, mvccVacuumFreq=5000, authEnabled=false, failureHnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]], commFailureRslvr=null, sqlCfg=SqlConfiguration [longQryWarnTimeout=3000, dfltQryTimeout=0, sqlQryHistSize=1000, validationEnabled=false], asyncContinuationExecutor=null] [21:07:44] : [Step 4/5] [2021-11-19 21:07:44,027][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][IgniteKernal%grid-0] Daemon mode: off [21:07:44] : [Step 4/5] [2021-11-19 21:07:44,027][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][IgniteKernal%grid-0] OS: Linux 4.15.0-151-generic amd64 [21:07:44] : [Step 4/5] [2021-11-19 21:07:44,027][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][IgniteKernal%grid-0] OS user: teamcity [21:07:44] : [Step 4/5] [2021-11-19 21:07:44,027][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][IgniteKernal%grid-0] PID: 16724 [21:07:44] : [Step 4/5] [2021-11-19 21:07:44,028][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][IgniteKernal%grid-0] Language runtime: Java Platform API Specification ver. 1.8 [21:07:44] : [Step 4/5] [2021-11-19 21:07:44,028][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][IgniteKernal%grid-0] VM information: Java(TM) SE Runtime Environment 1.8.0_261-b12 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 25.261-b12 [21:07:44] : [Step 4/5] [2021-11-19 21:07:44,028][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][IgniteKernal%grid-0] VM total memory: 1.9GB [21:07:44] : [Step 4/5] [2021-11-19 21:07:44,029][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][IgniteKernal%grid-0] Remote Management [restart: off, REST: off, JMX (remote: off)] [21:07:44] : [Step 4/5] [2021-11-19 21:07:44,029][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][IgniteKernal%grid-0] Logger: GridTestLog4jLogger [quiet=false, config=null] [21:07:44] : [Step 4/5] [2021-11-19 21:07:44,029][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][IgniteKernal%grid-0] IGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c [21:07:44] : [Step 4/5] [2021-11-19 21:07:44,029][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][IgniteKernal%grid-0] VM arguments: [-DIGNITE_DUMP_THREADS_ON_FAILURE=false, -DMono=/usr/bin/mono-sgen, -DMono4.0_x64=/usr/lib/mono/4.0, -DMono4.5_x64=/usr/lib/mono/4.5, -DMonoVersion=6.12.0.90, -DSKIP_BUILD=false, -Dagent.home.dir=/opt/buildagent, -Dagent.name=aitc-lin02_03, -Dagent.ownPort=9090, -Dagent.work.dir=/opt/buildagent/work, -Dbuild.number=95, -Dbuild.vcs.number=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.1=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.GitHubApacheIgnite=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dclassworlds.conf=/opt/buildagent/temp/buildTmp/teamcity.m2.conf, -Dcom.jetbrains.maven.watcher.report.file=/opt/buildagent/temp/buildTmp/maven-build-info.xml, -Djava.io.tmpdir=/opt/buildagent/temp/buildTmp, -Dmaven.home=/opt/buildagent/tools/maven3_6, -Dmaven.multiModuleProjectDirectory=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.agent.cpuBenchmark=457, -Dteamcity.agent.dotnet.agent_url=http://localhost:9090/RPC2, -Dteamcity.agent.dotnet.build_id=6278078, -Dteamcity.auth.password=*******, -Dteamcity.auth.userId=TeamCityBuildId=6278078, -Dteamcity.build.changedFiles.file=/opt/buildagent/temp/buildTmp/changedFiles6342607772318147725.txt, -Dteamcity.build.checkoutDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.build.id=6278078, -Dteamcity.build.properties.file=/opt/buildagent/temp/buildTmp/teamcity.build5164517880467851002.properties, -Dteamcity.build.tempDir=/opt/buildagent/temp/buildTmp, -Dteamcity.build.workingDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.buildConfName=Basic 3, -Dteamcity.buildType.id=IgniteTests24Java8_Basic3, -Dteamcity.configuration.properties.file=/opt/buildagent/temp/buildTmp/teamcity.config5591980786735343870.properties, -Dteamcity.maven.userSettings.path=/opt/buildagent/temp/buildTmp/maven_settings_585072866407032347.xml, -Dteamcity.maven.watcher.home=/opt/buildagent/plugins/mavenPlugin/maven-watcher-jdk16, -Dteamcity.projectName=Ignite Tests 2.x (JDK 8/11), -Dteamcity.runner.properties.file=/opt/buildagent/temp/buildTmp/teamcity.runner9098465561618137420.properties, -Dteamcity.tests.recentlyFailedTests.file=/opt/buildagent/temp/buildTmp/testsToRunFirst3891775683130404069.txt, -Dteamcity.version=2021.2 (build 99542), -ea, -Xms2g, -Xmx2g, -XX:+HeapDumpOnOutOfMemoryError, -DIGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_TEST_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_UPDATE_NOTIFIER=false, -DIGNITE_NO_DISCO_ORDER=true, -DIGNITE_PERFORMANCE_SUGGESTIONS_DISABLED=true, -Djava.net.preferIPv4Stack=true, -DTEST_SCALE_FACTOR=1.0, -DIGNITE_TEST_PROP_LOG4J_FILE=log4j-tc-test.xml, -DIGNITE_QUIET=false, -DIGNITE_MARSHAL_BUFFERS_RECHECK=1000, -Dmaven.repo.local=/opt/buildagent/.m2/repository] [21:07:44] : [Step 4/5] [2021-11-19 21:07:44,033][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][IgniteKernal%grid-0] System cache's DataRegion size is configured to 40 MB. Use DataStorageConfiguration.systemRegionInitialSize property to change the setting. [21:07:44] : [Step 4/5] [2021-11-19 21:07:44,034][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][IgniteKernal%grid-0] Configured caches [in 'sysMemPlc' dataRegion: ['ignite-sys-cache'], in 'default' dataRegion: ['encrypted.grid-0']] [21:07:44]W: [org.apache.ignite:ignite-core] [2021-11-19 21:07:44,034][WARN ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][IgniteKernal%grid-0] Peer class loading is enabled (disable it in production for performance and deployment consistency reasons) [21:07:44] : [Step 4/5] [2021-11-19 21:07:44,034][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][IgniteKernal%grid-0] 3-rd party licenses can be found at: /opt/buildagent/work/7bc1c54bc719b67c/libs/licenses [21:07:44] : [Step 4/5] [2021-11-19 21:07:44,038][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][IgnitePluginProcessor] Configured plugins: [21:07:44] : [Step 4/5] [2021-11-19 21:07:44,038][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][IgnitePluginProcessor] ^-- StanByClusterTestProvider 1.0 [21:07:44] : [Step 4/5] [2021-11-19 21:07:44,038][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][IgnitePluginProcessor] ^-- null [21:07:44] : [Step 4/5] [2021-11-19 21:07:44,038][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][IgnitePluginProcessor] [21:07:44] : [Step 4/5] [2021-11-19 21:07:44,039][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][IgnitePluginProcessor] ^-- PageMemory tracker plugin 1.0 [21:07:44] : [Step 4/5] [2021-11-19 21:07:44,039][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][IgnitePluginProcessor] ^-- null [21:07:44] : [Step 4/5] [2021-11-19 21:07:44,039][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][IgnitePluginProcessor] [21:07:44] : [Step 4/5] [2021-11-19 21:07:44,039][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][IgnitePluginProcessor] ^-- TestDistibutedConfigurationPlugin 1.0 [21:07:44] : [Step 4/5] [2021-11-19 21:07:44,039][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][IgnitePluginProcessor] ^-- null [21:07:44] : [Step 4/5] [2021-11-19 21:07:44,040][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][IgnitePluginProcessor] [21:07:44] : [Step 4/5] [2021-11-19 21:07:44,040][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][IgnitePluginProcessor] ^-- NodeValidationPluginProvider 1.0 [21:07:44] : [Step 4/5] [2021-11-19 21:07:44,040][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][IgnitePluginProcessor] ^-- null [21:07:44] : [Step 4/5] [2021-11-19 21:07:44,040][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][IgnitePluginProcessor] [21:07:44] : [Step 4/5] [2021-11-19 21:07:44,040][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][FailureProcessor] Configured failure handler: [hnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]]] [21:07:44] : [Step 4/5] [2021-11-19 21:07:44,051][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][TcpCommunicationSpi] Successfully bound communication NIO server to TCP port [port=45170, locHost=/127.0.0.1, selectorsCnt=12, selectorSpins=0, pairedConn=false] [21:07:44]W: [org.apache.ignite:ignite-core] [2021-11-19 21:07:44,051][WARN ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][TcpCommunicationSpi] Message queue limit is set to 0 which may lead to potential OOMEs when running cache operations in FULL_ASYNC or PRIMARY_SYNC modes due to message queues growth on sender and receiver sides. [21:07:44] : [Step 4/5] [2021-11-19 21:07:44,055][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][GridCollisionManager] Collision resolution is disabled (all jobs will be activated upon arrival). [21:07:44] : [Step 4/5] [2021-11-19 21:07:44,055][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][IgniteKernal%grid-0] Security status [authentication=off, sandbox=off, tls/ssl=off] [21:07:44] : [Step 4/5] [2021-11-19 21:07:44,111][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:07:44] : [Step 4/5] [2021-11-19 21:07:44,194][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][MaintenanceProcessor] Resolved store directory for node persistent data: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0 [21:07:44] : [Step 4/5] [2021-11-19 21:07:44,195][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][CacheObjectBinaryProcessorImpl] Resolved directory for serialized binary metadata: /opt/buildagent/work/7bc1c54bc719b67c/work/db/binary_meta/grid_0 [21:07:44] : [Step 4/5] [2021-11-19 21:07:44,200][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0 [21:07:44] : [Step 4/5] [2021-11-19 21:07:44,201][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][FileWriteAheadLogManager] Resolved write ahead log work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0 [21:07:44] : [Step 4/5] [2021-11-19 21:07:44,201][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][FileWriteAheadLogManager] Resolved write ahead log archive directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0 [21:07:44] : [Step 4/5] [2021-11-19 21:07:44,825][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000000.wal [21:07:44]W: [org.apache.ignite:ignite-core] [2021-11-19 21:07:44,825][WARN ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][GridCacheDatabaseSharedManager] DataRegion maxSize=10.5 MB is smaller than defaultInitialSize=268.4 MB, setting initialSize to 10.5 MB [21:07:44] : [Step 4/5] [2021-11-19 21:07:44,831][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][GridCacheDatabaseSharedManager] Configured data regions initialized successfully [total=5] [21:07:44] : [Step 4/5] [2021-11-19 21:07:44,841][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][IgniteSnapshotManager] Resolved snapshot work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/snapshots [21:07:44] : [Step 4/5] [2021-11-19 21:07:44,842][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][IgniteSnapshotManager] Resolved temp directory for snapshot creation: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0/snp [21:07:44] : [Step 4/5] [2021-11-19 21:07:44,844][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][ClientListenerProcessor] Client connector processor has started on TCP port 10800 [21:07:44] : [Step 4/5] [2021-11-19 21:07:44,851][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][IgniteKernal%grid-0] Non-loopback local IPs: 172.17.0.4 [21:07:44] : [Step 4/5] [2021-11-19 21:07:44,851][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][IgniteKernal%grid-0] Enabled local MACs: 0242AC110004 [21:07:44] : [Step 4/5] [2021-11-19 21:07:44,854][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:07:44] : [Step 4/5] [2021-11-19 21:07:44,856][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:07:44] : [Step 4/5] [2021-11-19 21:07:44,856][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:07:44] : [Step 4/5] [2021-11-19 21:07:44,858][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][GridCacheDatabaseSharedManager] Applying lost metastore updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:07:44] : [Step 4/5] [2021-11-19 21:07:44,859][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=0 ms] [21:07:44] : [Step 4/5] [2021-11-19 21:07:44,860][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][GridCacheProcessor] Restoring partition state for local groups. [21:07:44] : [Step 4/5] [2021-11-19 21:07:44,860][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=0, partitionsProcessed=0, time=0ms] [21:07:44] : [Step 4/5] [2021-11-19 21:07:44,861][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][GridEncryptionManager] Encryption keys loaded from metastore. [grps=, masterKeyName=ignite.master.key] [21:07:44] : [Step 4/5] [2021-11-19 21:07:44,867][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][ClusterProcessor] Cluster ID and tag has been read from metastorage: null [21:07:44] : [Step 4/5] [2021-11-19 21:07:44,867][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][IgniteClusterImpl] Shutdown policy was updated [oldVal=null, newVal=null] [21:07:44] : [Step 4/5] [2021-11-19 21:07:44,867][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][GridCacheDatabaseSharedManager] Checkpoint frequency deviation changed [oldVal=null, newVal=null] [21:07:44] : [Step 4/5] [2021-11-19 21:07:44,874][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][FilePageStoreManager] Cleanup cache stores [total=1, left=0, cleanFiles=false] [21:07:44] : [Step 4/5] [2021-11-19 21:07:44,876][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:07:44] : [Step 4/5] [2021-11-19 21:07:44,877][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:07:44] : [Step 4/5] [2021-11-19 21:07:44,879][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:07:44] : [Step 4/5] [2021-11-19 21:07:44,879][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][GridCacheDatabaseSharedManager] Data Regions Started: 5 [21:07:44] : [Step 4/5] [2021-11-19 21:07:44,880][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][GridCacheDatabaseSharedManager] ^-- sysMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:07:44] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:07:44] : [Step 4/5] ^-- default region [type=default, persistence=true, lazyAlloc=true, [21:07:44] : [Step 4/5] ... initCfg=10MB, maxCfg=10MB, usedRam=0MB, freeRam=100%, allocRam=0MB, allocTotal=0MB] [21:07:44] : [Step 4/5] ^-- metastoreMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:07:44] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:07:44] : [Step 4/5] ^-- TxLog region [type=internal, persistence=true, lazyAlloc=false, [21:07:44] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:07:44] : [Step 4/5] ^-- volatileDsMemPlc region [type=user, persistence=false, lazyAlloc=true, [21:07:44] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB] [21:07:44] : [Step 4/5] ^-- Ignite persistence [used=0MB] [21:07:44] : [Step 4/5] [21:07:44] : [Step 4/5] [2021-11-19 21:07:44,881][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][GridCacheDatabaseSharedManager] Starting binary memory restore for: [-2100569601, -322076973] [21:07:44] : [Step 4/5] [2021-11-19 21:07:44,943][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:07:44] : [Step 4/5] [2021-11-19 21:07:44,943][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:07:44] : [Step 4/5] [2021-11-19 21:07:44,944][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000000.wal, offset=0, ver=2] [21:07:44] : [Step 4/5] [2021-11-19 21:07:44,983][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][GridCacheProcessor] Started cache in recovery mode [name=ignite-sys-cache, id=-2100569601, dataRegionName=sysMemPlc, mode=REPLICATED, atomicity=TRANSACTIONAL, backups=2147483647, mvcc=false] [21:07:44] : [Step 4/5] [2021-11-19 21:07:44,984][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][PageMemoryImpl] Started page memory [memoryAllocated=24.0 MiB, pages=5952, tableSize=474.2 KiB, replacementSize=768 B, checkpointBuffer=10.0 MiB] [21:07:44] : [Step 4/5] [2021-11-19 21:07:44,988][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][GridCacheProcessor] Started cache in recovery mode [name=encrypted.grid-0, id=-322076973, dataRegionName=default, mode=PARTITIONED, atomicity=ATOMIC, backups=0, mvcc=false] [21:07:44] : [Step 4/5] [2021-11-19 21:07:44,989][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][GridCacheDatabaseSharedManager] Binary recovery performed in 108 ms. [21:07:44] : [Step 4/5] [2021-11-19 21:07:44,990][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:07:44] : [Step 4/5] [2021-11-19 21:07:44,990][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][GridCacheDatabaseSharedManager] Applying lost cache updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:07:45] : [Step 4/5] [2021-11-19 21:07:45,066][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=71 ms] [21:07:45] : [Step 4/5] [2021-11-19 21:07:45,067][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][GridCacheProcessor] Restoring partition state for local groups. [21:07:45] : [Step 4/5] [2021-11-19 21:07:45,091][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=2, partitionsProcessed=1124, time=30ms] [21:07:45] : [Step 4/5] [2021-11-19 21:07:45,726][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][TestTcpDiscoverySpi] Successfully bound to TCP port [port=47500, localHost=localhost/127.0.0.1, locNodeId=00ffc1ff-7fc9-4784-aee1-5882a311b000] [21:07:45] : [Step 4/5] [2021-11-19 21:07:45,728][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][GridEncryptionManager] Sending new group keys to coordinator [grps=-322076973] [21:07:45] : [Step 4/5] [2021-11-19 21:07:45,738][INFO ][disco-notifier-worker-#15078%grid-0%][MvccProcessorImpl] Assigned mvcc coordinator [crd=MvccCoordinator [topVer=AffinityTopologyVersion [topVer=1, minorTopVer=0], nodeId=00ffc1ff-7fc9-4784-aee1-5882a311b000, ver=1637345265735, local=true, initialized=false]] [21:07:45] : [Step 4/5] [2021-11-19 21:07:45,739][INFO ][disco-notifier-worker-#15078%grid-0%][GridEncryptionManager] Added encryption key on local join [grpId=-322076973] [21:07:45] : [Step 4/5] [2021-11-19 21:07:45,740][INFO ][sys-#15054%grid-0%][ClusterProcessor] Writing cluster ID and tag to metastorage on ready for write ClusterIdAndTag [id=dfd867ac-310a-4a38-817b-39c28d352019, tag=vigilant_khayyam] [21:07:45] : [Step 4/5] [2021-11-19 21:07:45,743][INFO ][disco-notifier-worker-#15078%grid-0%][ClusterProcessor] vigilant_khayyam [21:07:45] : [Step 4/5] [2021-11-19 21:07:45,743][INFO ][disco-notifier-worker-#15078%grid-0%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustEnabled' was changed from 'null' to 'false' [21:07:45] : [Step 4/5] [2021-11-19 21:07:45,744][INFO ][disco-notifier-worker-#15078%grid-0%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustTimeout' was changed from 'null' to '300000' [21:07:45] : [Step 4/5] [2021-11-19 21:07:45,745][INFO ][disco-notifier-worker-#15078%grid-0%][IgniteTxManager] Transactions parameter 'longOperationsDumpTimeout' was changed from 'null' to '60000' [21:07:45] : [Step 4/5] [2021-11-19 21:07:45,745][INFO ][disco-notifier-worker-#15078%grid-0%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpThreshold' was changed from 'null' to '0' [21:07:45] : [Step 4/5] [2021-11-19 21:07:45,746][INFO ][disco-notifier-worker-#15078%grid-0%][IgniteTxManager] Transactions parameter 'transactionTimeDumpSamplesCoefficient' was changed from 'null' to '0.0' [21:07:45] : [Step 4/5] [2021-11-19 21:07:45,746][INFO ][disco-notifier-worker-#15078%grid-0%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpSamplesPerSecondLimit' was changed from 'null' to '5' [21:07:45] : [Step 4/5] [2021-11-19 21:07:45,747][INFO ][disco-notifier-worker-#15078%grid-0%][IgniteTxManager] Transactions parameter 'collisionsDumpInterval' was changed from 'null' to '1000' [21:07:45] : [Step 4/5] [2021-11-19 21:07:45,747][INFO ][disco-notifier-worker-#15078%grid-0%][IgniteTxManager] Transactions parameter 'txOwnerDumpRequestsAllowed' was changed from 'null' to 'true' [21:07:45] : [Step 4/5] [2021-11-19 21:07:45,748][INFO ][disco-notifier-worker-#15078%grid-0%][GridCacheDatabaseSharedManager] Historical rebalance WAL threshold changed [property=historical.rebalance.threshold, oldVal=null, newVal=500] [21:07:45] : [Step 4/5] [2021-11-19 21:07:45,750][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][IgniteKernal%grid-0] To start Console Management & Monitoring run ignitevisorcmd.{sh|bat} [21:07:45] : [Step 4/5] [2021-11-19 21:07:45,751][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][IgniteKernal%grid-0] [21:07:45] : [Step 4/5] [21:07:45] : [Step 4/5] >>> +-------------------------------------------+ [21:07:45] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:07:45] : [Step 4/5] >>> +-------------------------------------------+ [21:07:45] : [Step 4/5] >>> OS name: Linux 4.15.0-151-generic amd64 [21:07:45] : [Step 4/5] >>> CPU(s): 24 [21:07:45] : [Step 4/5] >>> Heap: 2.0GB [21:07:45] : [Step 4/5] >>> VM name: 16724@c4dfe9a430b2 [21:07:45] : [Step 4/5] >>> Ignite instance name: grid-0 [21:07:45] : [Step 4/5] >>> Local node [ID=00FFC1FF-7FC9-4784-AEE1-5882A311B000, order=1, clientMode=false] [21:07:45] : [Step 4/5] >>> Local node addresses: [127.0.0.1] [21:07:45] : [Step 4/5] >>> Local ports: TCP:10800 TCP:45170 TCP:47500 [21:07:45] : [Step 4/5] [21:07:45] : [Step 4/5] [2021-11-19 21:07:45,752][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][IgniteKernal%grid-0] >>> Ignite cluster is in INACTIVE state (limited functionality available). Use control.(sh|bat) script or IgniteCluster.state(ClusterState.ACTIVE) to change the state. [21:07:45] : [Step 4/5] [2021-11-19 21:07:45,753][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][GridDiscoveryManager] Topology snapshot [ver=1, locNode=00ffc1ff, servers=1, clients=0, state=INACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=00ffc1ff-7fc9-4784-aee1-5882a311b000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:07:45] : [Step 4/5] [2021-11-19 21:07:45,754][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][G] Node started : [stage="Configure system pool" (0 ms),stage="Start managers" (178 ms),stage="Configure binary metadata" (2 ms),stage="Start processors" (653 ms),stage="Start 'StanByClusterTestProvider' plugin" (0 ms),stage="Start 'PageMemory tracker plugin' plugin" (0 ms),stage="Start 'TestDistibutedConfigurationPlugin' plugin" (0 ms),stage="Start 'NodeValidationPluginProvider' plugin" (0 ms),stage="Init metastore" (23 ms),stage="Init and start regions" (6 ms),stage="Restore binary memory" (108 ms),stage="Restore logical state" (101 ms),stage="Finish recovery" (633 ms),stage="Join topology" (13 ms),stage="Await transition" (2 ms),stage="Await exchange" (12 ms),stage="Total time" (1731 ms)] [21:07:45] : [Step 4/5] [2021-11-19 21:07:45,755][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][root] Node started with the following configuration [id=00ffc1ff-7fc9-4784-aee1-5882a311b000, marshaller=BinaryMarshaller [], discovery=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=5000, ackTimeout=5000, marsh=JdkMarshaller [clsFilter=org.apache.ignite.marshaller.MarshallerUtils$1@53a1eaa7], reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], binaryCfg=null, lateAff=true] [21:07:45]W: [org.apache.ignite:ignite-core] [2021-11-19 21:07:45,760][WARN ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][G] Ignite work directory is not provided, automatically resolved to: /opt/buildagent/work/7bc1c54bc719b67c/work [21:07:45] : [Step 4/5] [2021-11-19 21:07:45,761][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][IgniteKernal%grid-1] [21:07:45] : [Step 4/5] [21:07:45] : [Step 4/5] >>> __________ ________________ [21:07:45] : [Step 4/5] >>> / _/ ___/ |/ / _/_ __/ __/ [21:07:45] : [Step 4/5] >>> _/ // (7 7 // / / / / _/ [21:07:45] : [Step 4/5] >>> /___/\___/_/|_/___/ /_/ /___/ [21:07:45] : [Step 4/5] >>> [21:07:45] : [Step 4/5] >>> ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:07:45] : [Step 4/5] >>> 2021 Copyright(C) Apache Software Foundation [21:07:45] : [Step 4/5] >>> [21:07:45] : [Step 4/5] >>> Ignite documentation: http://ignite.apache.org [21:07:45] : [Step 4/5] [21:07:45] : [Step 4/5] [2021-11-19 21:07:45,761][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][IgniteKernal%grid-1] Config URL: n/a [21:07:45] : [Step 4/5] [2021-11-19 21:07:45,761][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][IgniteKernal%grid-1] IgniteConfiguration [igniteInstanceName=grid-1, pubPoolSize=24, svcPoolSize=24, callbackPoolSize=24, stripedPoolSize=24, sysPoolSize=24, mgmtPoolSize=4, dataStreamerPoolSize=24, utilityCachePoolSize=24, utilityCacheKeepAliveTime=60000, p2pPoolSize=2, qryPoolSize=24, buildIdxPoolSize=4, igniteHome=/opt/buildagent/work/7bc1c54bc719b67c, igniteWorkDir=/opt/buildagent/work/7bc1c54bc719b67c/work, mbeanSrv=com.sun.jmx.mbeanserver.JmxMBeanServer@6fe85038, nodeId=10dee0aa-9c25-4677-9e29-6444f6ab2001, marsh=BinaryMarshaller [], marshLocJobs=false, daemon=false, p2pEnabled=true, netTimeout=10000, netCompressionLevel=1, sndRetryDelay=1000, sndRetryCnt=3, metricsHistSize=10000, metricsUpdateFreq=1000, metricsExpTime=9223372036854775807, discoSpi=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=0, ackTimeout=0, marsh=null, reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], segPlc=STOP, segResolveAttempts=2, waitForSegOnStart=true, allResolversPassReq=true, segChkFreq=10000, commSpi=TcpCommunicationSpi [connectGate=org.apache.ignite.spi.communication.tcp.internal.ConnectGateway@39f3d823, ctxInitLatch=java.util.concurrent.CountDownLatch@62efc28e[Count = 1], stopping=false, clientPool=null, nioSrvWrapper=null, stateProvider=null], evtSpi=MemoryEventStorageSpi [expireAgeMs=9223372036854775807, expireCnt=10000, filter=null], colSpi=NoopCollisionSpi [], deploySpi=LocalDeploymentSpi [], indexingSpi=org.apache.ignite.spi.indexing.noop.NoopIndexingSpi@74f34043, addrRslvr=null, encryptionSpi=org.apache.ignite.spi.encryption.keystore.KeystoreEncryptionSpi@72b75512, tracingSpi=org.apache.ignite.spi.tracing.NoopTracingSpi@320daeb5, clientMode=false, rebalanceThreadPoolSize=4, rebalanceTimeout=10000, rebalanceBatchesPrefetchCnt=3, rebalanceThrottle=0, rebalanceBatchSize=524288, txCfg=TransactionConfiguration [txSerEnabled=false, dfltIsolation=REPEATABLE_READ, dfltConcurrency=PESSIMISTIC, dfltTxTimeout=0, txTimeoutOnPartitionMapExchange=0, deadlockTimeout=10000, pessimisticTxLogSize=0, pessimisticTxLogLinger=10000, tmLookupClsName=null, txManagerFactory=null, useJtaSync=false], cacheSanityCheckEnabled=true, discoStartupDelay=60000, deployMode=SHARED, p2pMissedCacheSize=100, locHost=127.0.0.1, timeSrvPortBase=31100, timeSrvPortRange=100, failureDetectionTimeout=10000, sysWorkerBlockedTimeout=null, clientFailureDetectionTimeout=10000, metricsLogFreq=0, connectorCfg=null, odbcCfg=null, warmupClos=null, atomicCfg=AtomicConfiguration [seqReserveSize=1000, cacheMode=PARTITIONED, backups=1, aff=null, grpName=null], classLdr=null, sslCtxFactory=null, platformCfg=null, binaryCfg=null, memCfg=null, pstCfg=null, dsCfg=DataStorageConfiguration [sysRegionInitSize=41943040, sysRegionMaxSize=104857600, pageSize=4096, concLvl=0, dfltDataRegConf=DataRegionConfiguration [name=default, maxSize=10485760, initSize=268435456, swapPath=null, pageEvictionMode=DISABLED, pageReplacementMode=CLOCK, evictionThreshold=0.9, emptyPagesPoolSize=100, metricsEnabled=false, metricsSubIntervalCount=5, metricsRateTimeInterval=60000, persistenceEnabled=true, checkpointPageBufSize=0, lazyMemoryAllocation=true, warmUpCfg=null], dataRegions=null, storagePath=null, checkpointFreq=180000, lockWaitTime=10000, checkpointThreads=4, checkpointWriteOrder=SEQUENTIAL, walHistSize=20, maxWalArchiveSize=1073741824, walSegments=10, walSegmentSize=67108864, walPath=db/wal, walArchivePath=db/wal/archive, cdcWalPath=db/wal/cdc, cdcEnabled=false, metricsEnabled=false, walMode=FSYNC, walTlbSize=131072, walBuffSize=0, walFlushFreq=2000, walFsyncDelay=1000, walRecordIterBuffSize=67108864, alwaysWriteFullPages=false, fileIOFactory=org.apache.ignite.internal.processors.cache.persistence.file.AsyncFileIOFactory@1cfadc06, metricsSubIntervalCnt=5, metricsRateTimeInterval=60000, walAutoArchiveAfterInactivity=-1, walForceArchiveTimeout=-1, writeThrottlingEnabled=false, walCompactionEnabled=false, walCompactionLevel=1, checkpointReadLockTimeout=null, walPageCompression=DISABLED, walPageCompressionLevel=null, dfltWarmUpCfg=null, encCfg=org.apache.ignite.configuration.EncryptionConfiguration@74491c4f, defragmentationThreadPoolSize=4, minWalArchiveSize=-1], snapshotPath=snapshots, activeOnStart=true, activeOnStartPropSetFlag=false, autoActivation=true, autoActivationPropSetFlag=false, clusterStateOnStart=null, sqlConnCfg=null, cliConnCfg=ClientConnectorConfiguration [host=null, port=10800, portRange=100, sockSndBufSize=0, sockRcvBufSize=0, tcpNoDelay=true, maxOpenCursorsPerConn=128, threadPoolSize=24, selectorCnt=12, idleTimeout=0, handshakeTimeout=10000, jdbcEnabled=true, odbcEnabled=true, thinCliEnabled=true, sslEnabled=false, useIgniteSslCtxFactory=true, sslClientAuth=false, sslCtxFactory=null, thinCliCfg=ThinClientConfiguration [maxActiveTxPerConn=100, maxActiveComputeTasksPerConn=0]], mvccVacuumThreadCnt=2, mvccVacuumFreq=5000, authEnabled=false, failureHnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]], commFailureRslvr=null, sqlCfg=SqlConfiguration [longQryWarnTimeout=3000, dfltQryTimeout=0, sqlQryHistSize=1000, validationEnabled=false], asyncContinuationExecutor=null] [21:07:45] : [Step 4/5] [2021-11-19 21:07:45,769][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][IgniteKernal%grid-1] Daemon mode: off [21:07:45] : [Step 4/5] [2021-11-19 21:07:45,769][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][IgniteKernal%grid-1] OS: Linux 4.15.0-151-generic amd64 [21:07:45] : [Step 4/5] [2021-11-19 21:07:45,769][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][IgniteKernal%grid-1] OS user: teamcity [21:07:45] : [Step 4/5] [2021-11-19 21:07:45,770][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][IgniteKernal%grid-1] PID: 16724 [21:07:45] : [Step 4/5] [2021-11-19 21:07:45,770][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][IgniteKernal%grid-1] Language runtime: Java Platform API Specification ver. 1.8 [21:07:45] : [Step 4/5] [2021-11-19 21:07:45,770][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][IgniteKernal%grid-1] VM information: Java(TM) SE Runtime Environment 1.8.0_261-b12 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 25.261-b12 [21:07:45] : [Step 4/5] [2021-11-19 21:07:45,771][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][IgniteKernal%grid-1] VM total memory: 1.9GB [21:07:45] : [Step 4/5] [2021-11-19 21:07:45,771][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][IgniteKernal%grid-1] Remote Management [restart: off, REST: off, JMX (remote: off)] [21:07:45] : [Step 4/5] [2021-11-19 21:07:45,771][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][IgniteKernal%grid-1] Logger: GridTestLog4jLogger [quiet=false, config=null] [21:07:45] : [Step 4/5] [2021-11-19 21:07:45,771][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][IgniteKernal%grid-1] IGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c [21:07:45] : [Step 4/5] [2021-11-19 21:07:45,771][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][IgniteKernal%grid-1] VM arguments: [-DIGNITE_DUMP_THREADS_ON_FAILURE=false, -DMono=/usr/bin/mono-sgen, -DMono4.0_x64=/usr/lib/mono/4.0, -DMono4.5_x64=/usr/lib/mono/4.5, -DMonoVersion=6.12.0.90, -DSKIP_BUILD=false, -Dagent.home.dir=/opt/buildagent, -Dagent.name=aitc-lin02_03, -Dagent.ownPort=9090, -Dagent.work.dir=/opt/buildagent/work, -Dbuild.number=95, -Dbuild.vcs.number=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.1=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.GitHubApacheIgnite=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dclassworlds.conf=/opt/buildagent/temp/buildTmp/teamcity.m2.conf, -Dcom.jetbrains.maven.watcher.report.file=/opt/buildagent/temp/buildTmp/maven-build-info.xml, -Djava.io.tmpdir=/opt/buildagent/temp/buildTmp, -Dmaven.home=/opt/buildagent/tools/maven3_6, -Dmaven.multiModuleProjectDirectory=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.agent.cpuBenchmark=457, -Dteamcity.agent.dotnet.agent_url=http://localhost:9090/RPC2, -Dteamcity.agent.dotnet.build_id=6278078, -Dteamcity.auth.password=*******, -Dteamcity.auth.userId=TeamCityBuildId=6278078, -Dteamcity.build.changedFiles.file=/opt/buildagent/temp/buildTmp/changedFiles6342607772318147725.txt, -Dteamcity.build.checkoutDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.build.id=6278078, -Dteamcity.build.properties.file=/opt/buildagent/temp/buildTmp/teamcity.build5164517880467851002.properties, -Dteamcity.build.tempDir=/opt/buildagent/temp/buildTmp, -Dteamcity.build.workingDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.buildConfName=Basic 3, -Dteamcity.buildType.id=IgniteTests24Java8_Basic3, -Dteamcity.configuration.properties.file=/opt/buildagent/temp/buildTmp/teamcity.config5591980786735343870.properties, -Dteamcity.maven.userSettings.path=/opt/buildagent/temp/buildTmp/maven_settings_585072866407032347.xml, -Dteamcity.maven.watcher.home=/opt/buildagent/plugins/mavenPlugin/maven-watcher-jdk16, -Dteamcity.projectName=Ignite Tests 2.x (JDK 8/11), -Dteamcity.runner.properties.file=/opt/buildagent/temp/buildTmp/teamcity.runner9098465561618137420.properties, -Dteamcity.tests.recentlyFailedTests.file=/opt/buildagent/temp/buildTmp/testsToRunFirst3891775683130404069.txt, -Dteamcity.version=2021.2 (build 99542), -ea, -Xms2g, -Xmx2g, -XX:+HeapDumpOnOutOfMemoryError, -DIGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_TEST_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_UPDATE_NOTIFIER=false, -DIGNITE_NO_DISCO_ORDER=true, -DIGNITE_PERFORMANCE_SUGGESTIONS_DISABLED=true, -Djava.net.preferIPv4Stack=true, -DTEST_SCALE_FACTOR=1.0, -DIGNITE_TEST_PROP_LOG4J_FILE=log4j-tc-test.xml, -DIGNITE_QUIET=false, -DIGNITE_MARSHAL_BUFFERS_RECHECK=1000, -Dmaven.repo.local=/opt/buildagent/.m2/repository] [21:07:45] : [Step 4/5] [2021-11-19 21:07:45,776][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][IgniteKernal%grid-1] System cache's DataRegion size is configured to 40 MB. Use DataStorageConfiguration.systemRegionInitialSize property to change the setting. [21:07:45] : [Step 4/5] [2021-11-19 21:07:45,776][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][IgniteKernal%grid-1] Configured caches [in 'sysMemPlc' dataRegion: ['ignite-sys-cache'], in 'default' dataRegion: ['encrypted.grid-1']] [21:07:45]W: [org.apache.ignite:ignite-core] [2021-11-19 21:07:45,777][WARN ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][IgniteKernal%grid-1] Peer class loading is enabled (disable it in production for performance and deployment consistency reasons) [21:07:45] : [Step 4/5] [2021-11-19 21:07:45,777][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][IgniteKernal%grid-1] 3-rd party licenses can be found at: /opt/buildagent/work/7bc1c54bc719b67c/libs/licenses [21:07:45] : [Step 4/5] [2021-11-19 21:07:45,780][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][IgnitePluginProcessor] Configured plugins: [21:07:45] : [Step 4/5] [2021-11-19 21:07:45,781][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][IgnitePluginProcessor] ^-- StanByClusterTestProvider 1.0 [21:07:45] : [Step 4/5] [2021-11-19 21:07:45,781][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][IgnitePluginProcessor] ^-- null [21:07:45] : [Step 4/5] [2021-11-19 21:07:45,781][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][IgnitePluginProcessor] [21:07:45] : [Step 4/5] [2021-11-19 21:07:45,781][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][IgnitePluginProcessor] ^-- PageMemory tracker plugin 1.0 [21:07:45] : [Step 4/5] [2021-11-19 21:07:45,781][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][IgnitePluginProcessor] ^-- null [21:07:45] : [Step 4/5] [2021-11-19 21:07:45,781][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][IgnitePluginProcessor] [21:07:45] : [Step 4/5] [2021-11-19 21:07:45,782][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][IgnitePluginProcessor] ^-- TestDistibutedConfigurationPlugin 1.0 [21:07:45] : [Step 4/5] [2021-11-19 21:07:45,782][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][IgnitePluginProcessor] ^-- null [21:07:45] : [Step 4/5] [2021-11-19 21:07:45,782][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][IgnitePluginProcessor] [21:07:45] : [Step 4/5] [2021-11-19 21:07:45,782][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][IgnitePluginProcessor] ^-- NodeValidationPluginProvider 1.0 [21:07:45] : [Step 4/5] [2021-11-19 21:07:45,782][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][IgnitePluginProcessor] ^-- null [21:07:45] : [Step 4/5] [2021-11-19 21:07:45,783][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][IgnitePluginProcessor] [21:07:45] : [Step 4/5] [2021-11-19 21:07:45,783][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][FailureProcessor] Configured failure handler: [hnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]]] [21:07:45] : [Step 4/5] [2021-11-19 21:07:45,807][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][TcpCommunicationSpi] Successfully bound communication NIO server to TCP port [port=45171, locHost=/127.0.0.1, selectorsCnt=12, selectorSpins=0, pairedConn=false] [21:07:45]W: [org.apache.ignite:ignite-core] [2021-11-19 21:07:45,808][WARN ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][TcpCommunicationSpi] Message queue limit is set to 0 which may lead to potential OOMEs when running cache operations in FULL_ASYNC or PRIMARY_SYNC modes due to message queues growth on sender and receiver sides. [21:07:45] : [Step 4/5] [2021-11-19 21:07:45,816][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][GridCollisionManager] Collision resolution is disabled (all jobs will be activated upon arrival). [21:07:45] : [Step 4/5] [2021-11-19 21:07:45,817][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][IgniteKernal%grid-1] Security status [authentication=off, sandbox=off, tls/ssl=off] [21:07:45] : [Step 4/5] [2021-11-19 21:07:45,873][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:07:45] : [Step 4/5] [2021-11-19 21:07:45,957][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][MaintenanceProcessor] Resolved store directory for node persistent data: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1 [21:07:45] : [Step 4/5] [2021-11-19 21:07:45,958][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][CacheObjectBinaryProcessorImpl] Resolved directory for serialized binary metadata: /opt/buildagent/work/7bc1c54bc719b67c/work/db/binary_meta/grid_1 [21:07:45] : [Step 4/5] [2021-11-19 21:07:45,962][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1 [21:07:45] : [Step 4/5] [2021-11-19 21:07:45,962][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][FileWriteAheadLogManager] Resolved write ahead log work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1 [21:07:45] : [Step 4/5] [2021-11-19 21:07:45,963][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][FileWriteAheadLogManager] Resolved write ahead log archive directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1 [21:07:46] : [Step 4/5] [2021-11-19 21:07:46,498][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000000.wal [21:07:46] : [Step 4/5] [2021-11-19 21:07:46,505][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][GridCacheDatabaseSharedManager] Configured data regions initialized successfully [total=5] [21:07:46] : [Step 4/5] [2021-11-19 21:07:46,508][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][IgniteSnapshotManager] Resolved snapshot work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/snapshots [21:07:46] : [Step 4/5] [2021-11-19 21:07:46,509][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][IgniteSnapshotManager] Resolved temp directory for snapshot creation: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1/snp [21:07:46] : [Step 4/5] [2021-11-19 21:07:46,511][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][ClientListenerProcessor] Client connector processor has started on TCP port 10801 [21:07:46] : [Step 4/5] [2021-11-19 21:07:46,514][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][IgniteKernal%grid-1] Non-loopback local IPs: 172.17.0.4 [21:07:46] : [Step 4/5] [2021-11-19 21:07:46,514][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][IgniteKernal%grid-1] Enabled local MACs: 0242AC110004 [21:07:46] : [Step 4/5] [2021-11-19 21:07:46,515][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:07:46] : [Step 4/5] [2021-11-19 21:07:46,518][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:07:46] : [Step 4/5] [2021-11-19 21:07:46,518][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:07:46] : [Step 4/5] [2021-11-19 21:07:46,521][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][GridCacheDatabaseSharedManager] Applying lost metastore updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:07:46] : [Step 4/5] [2021-11-19 21:07:46,525][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=0 ms] [21:07:46] : [Step 4/5] [2021-11-19 21:07:46,525][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][GridCacheProcessor] Restoring partition state for local groups. [21:07:46] : [Step 4/5] [2021-11-19 21:07:46,526][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=0, partitionsProcessed=0, time=0ms] [21:07:46] : [Step 4/5] [2021-11-19 21:07:46,526][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][GridEncryptionManager] Encryption keys loaded from metastore. [grps=, masterKeyName=ignite.master.key] [21:07:46] : [Step 4/5] [2021-11-19 21:07:46,529][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][ClusterProcessor] Cluster ID and tag has been read from metastorage: null [21:07:46] : [Step 4/5] [2021-11-19 21:07:46,529][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][IgniteClusterImpl] Shutdown policy was updated [oldVal=null, newVal=null] [21:07:46] : [Step 4/5] [2021-11-19 21:07:46,530][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][GridCacheDatabaseSharedManager] Checkpoint frequency deviation changed [oldVal=null, newVal=null] [21:07:46] : [Step 4/5] [2021-11-19 21:07:46,542][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][FilePageStoreManager] Cleanup cache stores [total=1, left=0, cleanFiles=false] [21:07:46] : [Step 4/5] [2021-11-19 21:07:46,545][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:07:46] : [Step 4/5] [2021-11-19 21:07:46,546][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:07:46] : [Step 4/5] [2021-11-19 21:07:46,548][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:07:46] : [Step 4/5] [2021-11-19 21:07:46,548][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][GridCacheDatabaseSharedManager] Data Regions Started: 5 [21:07:46] : [Step 4/5] [2021-11-19 21:07:46,549][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][GridCacheDatabaseSharedManager] ^-- sysMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:07:46] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:07:46] : [Step 4/5] ^-- default region [type=default, persistence=true, lazyAlloc=true, [21:07:46] : [Step 4/5] ... initCfg=10MB, maxCfg=10MB, usedRam=0MB, freeRam=100%, allocRam=0MB, allocTotal=0MB] [21:07:46] : [Step 4/5] ^-- metastoreMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:07:46] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:07:46] : [Step 4/5] ^-- TxLog region [type=internal, persistence=true, lazyAlloc=false, [21:07:46] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:07:46] : [Step 4/5] ^-- volatileDsMemPlc region [type=user, persistence=false, lazyAlloc=true, [21:07:46] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB] [21:07:46] : [Step 4/5] ^-- Ignite persistence [used=0MB] [21:07:46] : [Step 4/5] [21:07:46] : [Step 4/5] [2021-11-19 21:07:46,550][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][GridCacheDatabaseSharedManager] Starting binary memory restore for: [-2100569601, -322076972] [21:07:46] : [Step 4/5] [2021-11-19 21:07:46,630][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:07:46] : [Step 4/5] [2021-11-19 21:07:46,631][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:07:46] : [Step 4/5] [2021-11-19 21:07:46,632][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000000.wal, offset=0, ver=2] [21:07:46] : [Step 4/5] [2021-11-19 21:07:46,710][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][GridCacheProcessor] Started cache in recovery mode [name=ignite-sys-cache, id=-2100569601, dataRegionName=sysMemPlc, mode=REPLICATED, atomicity=TRANSACTIONAL, backups=2147483647, mvcc=false] [21:07:46] : [Step 4/5] [2021-11-19 21:07:46,711][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][PageMemoryImpl] Started page memory [memoryAllocated=24.0 MiB, pages=5952, tableSize=474.2 KiB, replacementSize=768 B, checkpointBuffer=10.0 MiB] [21:07:46] : [Step 4/5] [2021-11-19 21:07:46,715][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][GridCacheProcessor] Started cache in recovery mode [name=encrypted.grid-1, id=-322076972, dataRegionName=default, mode=PARTITIONED, atomicity=ATOMIC, backups=0, mvcc=false] [21:07:46] : [Step 4/5] [2021-11-19 21:07:46,715][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][GridCacheDatabaseSharedManager] Binary recovery performed in 165 ms. [21:07:46] : [Step 4/5] [2021-11-19 21:07:46,716][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:07:46] : [Step 4/5] [2021-11-19 21:07:46,716][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][GridCacheDatabaseSharedManager] Applying lost cache updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:07:46] : [Step 4/5] [2021-11-19 21:07:46,776][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=61 ms] [21:07:46] : [Step 4/5] [2021-11-19 21:07:46,776][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][GridCacheProcessor] Restoring partition state for local groups. [21:07:46] : [Step 4/5] [2021-11-19 21:07:46,785][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=2, partitionsProcessed=1124, time=10ms] [21:07:47] : [Step 4/5] [2021-11-19 21:07:47,546][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][TestTcpDiscoverySpi] Successfully bound to TCP port [port=47501, localHost=localhost/127.0.0.1, locNodeId=10dee0aa-9c25-4677-9e29-6444f6ab2001] [21:07:47] : [Step 4/5] [2021-11-19 21:07:47,549][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][GridEncryptionManager] Sending new group keys to coordinator [grps=-322076972] [21:07:47] : [Step 4/5] [2021-11-19 21:07:47,551][INFO ][tcp-disco-srvr-[:47500]-#786%grid-0%-#15080%grid-0%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=37019] [21:07:47] : [Step 4/5] [2021-11-19 21:07:47,551][INFO ][tcp-disco-srvr-[:47500]-#786%grid-0%-#15080%grid-0%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=37019] [21:07:47] : [Step 4/5] [2021-11-19 21:07:47,552][INFO ][tcp-disco-sock-reader-[]-#792%grid-0%-#15200%grid-0%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:37019, rmtPort=37019] [21:07:47] : [Step 4/5] [2021-11-19 21:07:47,554][INFO ][tcp-disco-sock-reader-[10dee0aa 127.0.0.1:37019]-#792%grid-0%-#15200%grid-0%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=10dee0aa-9c25-4677-9e29-6444f6ab2001, rmtAddr=/127.0.0.1:37019] [21:07:47] : [Step 4/5] [2021-11-19 21:07:47,559][INFO ][tcp-disco-srvr-[:47501]-#791%grid-1%-#15199%grid-1%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=59063] [21:07:47] : [Step 4/5] [2021-11-19 21:07:47,559][INFO ][tcp-disco-srvr-[:47501]-#791%grid-1%-#15199%grid-1%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=59063] [21:07:47] : [Step 4/5] [2021-11-19 21:07:47,560][INFO ][tcp-disco-sock-reader-[]-#793%grid-1%-#15201%grid-1%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:59063, rmtPort=59063] [21:07:47] : [Step 4/5] [2021-11-19 21:07:47,560][INFO ][tcp-disco-sock-reader-[]-#793%grid-1%-#15201%grid-1%][TestTcpDiscoverySpi] Received ping request from the remote node [rmtNodeId=00ffc1ff-7fc9-4784-aee1-5882a311b000, rmtAddr=/127.0.0.1:59063, rmtPort=59063] [21:07:47] : [Step 4/5] [2021-11-19 21:07:47,561][INFO ][tcp-disco-sock-reader-[]-#793%grid-1%-#15201%grid-1%][TestTcpDiscoverySpi] Finished writing ping response [rmtNodeId=00ffc1ff-7fc9-4784-aee1-5882a311b000, rmtAddr=/127.0.0.1:59063, rmtPort=59063] [21:07:47] : [Step 4/5] [2021-11-19 21:07:47,562][INFO ][tcp-disco-sock-reader-[10dee0aa 127.0.0.1:37019]-#792%grid-0%-#15200%grid-0%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:37019, rmtPort=37019, rmtNodeId=10dee0aa-9c25-4677-9e29-6444f6ab2001] [21:07:47]W: [org.apache.ignite:ignite-core] [2021-11-19 21:07:47,562][WARN ][tcp-disco-sock-reader-[]-#793%grid-1%-#15201%grid-1%][TestTcpDiscoverySpi] Failed to shutdown socket [21:07:47]W: [org.apache.ignite:ignite-core] java.net.SocketException: Socket output is already shutdown [21:07:47]W: [org.apache.ignite:ignite-core] at java.net.Socket.shutdownOutput(Socket.java:1572) [21:07:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.close(IgniteUtils.java:4247) [21:07:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.discovery.tcp.ServerImpl$SocketReader.body(ServerImpl.java:7370) [21:07:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.IgniteSpiThread.run(IgniteSpiThread.java:58) [21:07:47] : [Step 4/5] [2021-11-19 21:07:47,564][INFO ][tcp-disco-sock-reader-[]-#793%grid-1%-#15201%grid-1%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:59063, rmtPort=59063, rmtNodeId=null] [21:07:47] : [Step 4/5] [2021-11-19 21:07:47,565][INFO ][tcp-disco-msg-worker-[crd]-#785%grid-0%-#15079%grid-0%][GridEncryptionManager] Joining node doesn't have stored group keys [node=10dee0aa-9c25-4677-9e29-6444f6ab2001] [21:07:47] : [Step 4/5] [2021-11-19 21:07:47,567][INFO ][tcp-disco-msg-worker-[crd]-#785%grid-0%-#15079%grid-0%][GridEncryptionManager] Store group key received from joining node [node=10dee0aa-9c25-4677-9e29-6444f6ab2001, grp=-322076972] [21:07:47] : [Step 4/5] [2021-11-19 21:07:47,690][INFO ][tcp-disco-msg-worker-[crd]-#785%grid-0%-#15079%grid-0%][TestTcpDiscoverySpi] New next node [newNext=TcpDiscoveryNode [id=10dee0aa-9c25-4677-9e29-6444f6ab2001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=0, intOrder=2, lastExchangeTime=1637345267551, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false]] [21:07:47] : [Step 4/5] [2021-11-19 21:07:47,691][INFO ][tcp-disco-srvr-[:47501]-#791%grid-1%-#15199%grid-1%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=39951] [21:07:47] : [Step 4/5] [2021-11-19 21:07:47,691][INFO ][tcp-disco-srvr-[:47501]-#791%grid-1%-#15199%grid-1%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=39951] [21:07:47] : [Step 4/5] [2021-11-19 21:07:47,691][INFO ][tcp-disco-sock-reader-[]-#794%grid-1%-#15202%grid-1%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:39951, rmtPort=39951] [21:07:47] : [Step 4/5] [2021-11-19 21:07:47,693][INFO ][tcp-disco-sock-reader-[00ffc1ff 127.0.0.1:39951]-#794%grid-1%-#15202%grid-1%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=00ffc1ff-7fc9-4784-aee1-5882a311b000, rmtAddr=/127.0.0.1:39951] [21:07:47] : [Step 4/5] [2021-11-19 21:07:47,696][INFO ][tcp-disco-msg-worker-[]-#790%grid-1%-#15198%grid-1%][TestTcpDiscoverySpi] New next node [newNext=TcpDiscoveryNode [id=00ffc1ff-7fc9-4784-aee1-5882a311b000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345267691, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false]] [21:07:47] : [Step 4/5] [2021-11-19 21:07:47,697][INFO ][tcp-disco-srvr-[:47500]-#786%grid-0%-#15080%grid-0%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=38507] [21:07:47] : [Step 4/5] [2021-11-19 21:07:47,697][INFO ][tcp-disco-srvr-[:47500]-#786%grid-0%-#15080%grid-0%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=38507] [21:07:47] : [Step 4/5] [2021-11-19 21:07:47,698][INFO ][tcp-disco-sock-reader-[]-#795%grid-0%-#15203%grid-0%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:38507, rmtPort=38507] [21:07:47] : [Step 4/5] [2021-11-19 21:07:47,699][INFO ][tcp-disco-sock-reader-[10dee0aa 127.0.0.1:38507]-#795%grid-0%-#15203%grid-0%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=10dee0aa-9c25-4677-9e29-6444f6ab2001, rmtAddr=/127.0.0.1:38507] [21:07:47] : [Step 4/5] [2021-11-19 21:07:47,703][INFO ][disco-event-worker-#15082%grid-0%][GridDiscoveryManager] Added new node to topology: TcpDiscoveryNode [id=10dee0aa-9c25-4677-9e29-6444f6ab2001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637345267551, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false] [21:07:47] : [Step 4/5] [2021-11-19 21:07:47,704][INFO ][disco-event-worker-#15082%grid-0%][GridDiscoveryManager] Topology snapshot [ver=2, locNode=00ffc1ff, servers=2, clients=0, state=INACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=00ffc1ff-7fc9-4784-aee1-5882a311b000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=10dee0aa-9c25-4677-9e29-6444f6ab2001, consistentId=grid-1, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:07:47] : [Step 4/5] [2021-11-19 21:07:47,706][INFO ][tcp-disco-msg-worker-[00ffc1ff 127.0.0.1:47500]-#790%grid-1%-#15198%grid-1%][GridEncryptionManager] Store group key received from coordinator [grp=-322076972, keyId=0] [21:07:47] : [Step 4/5] [2021-11-19 21:07:47,707][INFO ][tcp-disco-msg-worker-[00ffc1ff 127.0.0.1:47500]-#790%grid-1%-#15198%grid-1%][GridEncryptionManager] Store group key received from coordinator [grp=-322076973, keyId=0] [21:07:47] : [Step 4/5] [2021-11-19 21:07:47,708][INFO ][tcp-disco-msg-worker-[00ffc1ff 127.0.0.1:47500]-#790%grid-1%-#15198%grid-1%][ClusterProcessor] vigilant_khayyam [21:07:47] : [Step 4/5] [2021-11-19 21:07:47,708][INFO ][tcp-disco-msg-worker-[00ffc1ff 127.0.0.1:47500]-#790%grid-1%-#15198%grid-1%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustEnabled' was changed from 'null' to 'false' [21:07:47] : [Step 4/5] [2021-11-19 21:07:47,708][INFO ][tcp-disco-msg-worker-[00ffc1ff 127.0.0.1:47500]-#790%grid-1%-#15198%grid-1%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustTimeout' was changed from 'null' to '300000' [21:07:47] : [Step 4/5] [2021-11-19 21:07:47,709][INFO ][tcp-disco-msg-worker-[00ffc1ff 127.0.0.1:47500]-#790%grid-1%-#15198%grid-1%][IgniteTxManager] Transactions parameter 'longOperationsDumpTimeout' was changed from 'null' to '60000' [21:07:47] : [Step 4/5] [2021-11-19 21:07:47,709][INFO ][tcp-disco-msg-worker-[00ffc1ff 127.0.0.1:47500]-#790%grid-1%-#15198%grid-1%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpThreshold' was changed from 'null' to '0' [21:07:47] : [Step 4/5] [2021-11-19 21:07:47,710][INFO ][tcp-disco-msg-worker-[00ffc1ff 127.0.0.1:47500]-#790%grid-1%-#15198%grid-1%][IgniteTxManager] Transactions parameter 'transactionTimeDumpSamplesCoefficient' was changed from 'null' to '0.0' [21:07:47] : [Step 4/5] [2021-11-19 21:07:47,710][INFO ][tcp-disco-msg-worker-[00ffc1ff 127.0.0.1:47500]-#790%grid-1%-#15198%grid-1%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpSamplesPerSecondLimit' was changed from 'null' to '5' [21:07:47] : [Step 4/5] [2021-11-19 21:07:47,711][INFO ][tcp-disco-msg-worker-[00ffc1ff 127.0.0.1:47500]-#790%grid-1%-#15198%grid-1%][IgniteTxManager] Transactions parameter 'collisionsDumpInterval' was changed from 'null' to '1000' [21:07:47] : [Step 4/5] [2021-11-19 21:07:47,711][INFO ][tcp-disco-msg-worker-[00ffc1ff 127.0.0.1:47500]-#790%grid-1%-#15198%grid-1%][IgniteTxManager] Transactions parameter 'txOwnerDumpRequestsAllowed' was changed from 'null' to 'true' [21:07:47] : [Step 4/5] [2021-11-19 21:07:47,712][INFO ][tcp-disco-msg-worker-[00ffc1ff 127.0.0.1:47500]-#790%grid-1%-#15198%grid-1%][GridCacheDatabaseSharedManager] Historical rebalance WAL threshold changed [property=historical.rebalance.threshold, oldVal=null, newVal=500] [21:07:47] : [Step 4/5] [2021-11-19 21:07:47,712][INFO ][disco-notifier-worker-#15197%grid-1%][MvccProcessorImpl] Assigned mvcc coordinator [crd=MvccCoordinator [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=0], nodeId=00ffc1ff-7fc9-4784-aee1-5882a311b000, ver=1637345265735, local=false, initialized=false]] [21:07:47] : [Step 4/5] [2021-11-19 21:07:47,714][INFO ][sys-#15186%grid-1%][ClusterProcessor] Writing cluster ID and tag to metastorage on ready for write ClusterIdAndTag [id=dfd867ac-310a-4a38-817b-39c28d352019, tag=vigilant_khayyam] [21:07:47] : [Step 4/5] [2021-11-19 21:07:47,725][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][IgniteKernal%grid-1] To start Console Management & Monitoring run ignitevisorcmd.{sh|bat} [21:07:47] : [Step 4/5] [2021-11-19 21:07:47,726][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][IgniteKernal%grid-1] [21:07:47] : [Step 4/5] [21:07:47] : [Step 4/5] >>> +-------------------------------------------+ [21:07:47] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:07:47] : [Step 4/5] >>> +-------------------------------------------+ [21:07:47] : [Step 4/5] >>> OS name: Linux 4.15.0-151-generic amd64 [21:07:47] : [Step 4/5] >>> CPU(s): 24 [21:07:47] : [Step 4/5] >>> Heap: 2.0GB [21:07:47] : [Step 4/5] >>> VM name: 16724@c4dfe9a430b2 [21:07:47] : [Step 4/5] >>> Ignite instance name: grid-1 [21:07:47] : [Step 4/5] >>> Local node [ID=10DEE0AA-9C25-4677-9E29-6444F6AB2001, order=2, clientMode=false] [21:07:47] : [Step 4/5] >>> Local node addresses: [127.0.0.1] [21:07:47] : [Step 4/5] >>> Local ports: TCP:10801 TCP:45171 TCP:47501 [21:07:47] : [Step 4/5] [21:07:47] : [Step 4/5] [2021-11-19 21:07:47,727][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][IgniteKernal%grid-1] >>> Ignite cluster is in INACTIVE state (limited functionality available). Use control.(sh|bat) script or IgniteCluster.state(ClusterState.ACTIVE) to change the state. [21:07:47] : [Step 4/5] [2021-11-19 21:07:47,727][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][GridDiscoveryManager] Topology snapshot [ver=2, locNode=10dee0aa, servers=2, clients=0, state=INACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=00ffc1ff-7fc9-4784-aee1-5882a311b000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=10dee0aa-9c25-4677-9e29-6444f6ab2001, consistentId=grid-1, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:07:47] : [Step 4/5] [2021-11-19 21:07:47,728][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][G] Node started : [stage="Configure system pool" (0 ms),stage="Start managers" (198 ms),stage="Configure binary metadata" (1 ms),stage="Start processors" (553 ms),stage="Start 'StanByClusterTestProvider' plugin" (0 ms),stage="Start 'PageMemory tracker plugin' plugin" (0 ms),stage="Start 'TestDistibutedConfigurationPlugin' plugin" (0 ms),stage="Start 'NodeValidationPluginProvider' plugin" (0 ms),stage="Init metastore" (29 ms),stage="Init and start regions" (7 ms),stage="Restore binary memory" (165 ms),stage="Restore logical state" (69 ms),stage="Finish recovery" (759 ms),stage="Join topology" (168 ms),stage="Await transition" (2 ms),stage="Await exchange" (13 ms),stage="Total time" (1964 ms)] [21:07:47] : [Step 4/5] [2021-11-19 21:07:47,730][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][root] Node started with the following configuration [id=10dee0aa-9c25-4677-9e29-6444f6ab2001, marshaller=BinaryMarshaller [], discovery=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=5000, ackTimeout=5000, marsh=JdkMarshaller [clsFilter=org.apache.ignite.marshaller.MarshallerUtils$1@1583ba2c], reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], binaryCfg=null, lateAff=true] [21:07:47] : [Step 4/5] [2021-11-19 21:07:47,732][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][GridClusterStateProcessor] Sending activate cluster request with BaselineTopology BaselineTopology [id=0, branchingHash=-2475315501, branchingType='New BaselineTopology', baselineNodes=[grid-1, grid-0]] [21:07:47] : [Step 4/5] [2021-11-19 21:07:47,736][INFO ][disco-notifier-worker-#15078%grid-0%][GridClusterStateProcessor] Received activate cluster request with BaselineTopology[id=0] initiator node ID: 00ffc1ff-7fc9-4784-aee1-5882a311b000 [21:07:47] : [Step 4/5] [2021-11-19 21:07:47,737][INFO ][disco-notifier-worker-#15078%grid-0%][GridClusterStateProcessor] Started state transition: activate cluster [21:07:47] : [Step 4/5] [2021-11-19 21:07:47,738][INFO ][exchange-worker-#15083%grid-0%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], crd=true, evt=DISCOVERY_CUSTOM_EVT, evtNode=00ffc1ff-7fc9-4784-aee1-5882a311b000, customEvt=ChangeGlobalStateMessage [id=6875d593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqId=4190a84f-ce83-425a-9200-69ad1bbf8edb, initiatingNodeId=00ffc1ff-7fc9-4784-aee1-5882a311b000, state=ACTIVE, baselineTopology=BaselineTopology [id=0, branchingHash=-2475315501, branchingType='New BaselineTopology', baselineNodes=[grid-1, grid-0]], forceChangeBaselineTopology=false, timestamp=1637345267732, forceDeactivation=true], allowMerge=false, exchangeFreeSwitch=false] [21:07:47] : [Step 4/5] [2021-11-19 21:07:47,738][INFO ][disco-notifier-worker-#15197%grid-1%][GridClusterStateProcessor] Received activate cluster request with BaselineTopology[id=0] initiator node ID: 00ffc1ff-7fc9-4784-aee1-5882a311b000 [21:07:47] : [Step 4/5] [2021-11-19 21:07:47,738][INFO ][exchange-worker-#15083%grid-0%][GridDhtPartitionsExchangeFuture] Start activation process [nodeId=00ffc1ff-7fc9-4784-aee1-5882a311b000, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]]. New state: ACTIVE [21:07:47] : [Step 4/5] [2021-11-19 21:07:47,739][INFO ][disco-notifier-worker-#15197%grid-1%][GridClusterStateProcessor] Started state transition: activate cluster [21:07:47] : [Step 4/5] [2021-11-19 21:07:47,739][INFO ][exchange-worker-#15083%grid-0%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0 [21:07:47] : [Step 4/5] [2021-11-19 21:07:47,740][INFO ][exchange-worker-#15206%grid-1%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], crd=false, evt=DISCOVERY_CUSTOM_EVT, evtNode=00ffc1ff-7fc9-4784-aee1-5882a311b000, customEvt=ChangeGlobalStateMessage [id=6875d593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqId=4190a84f-ce83-425a-9200-69ad1bbf8edb, initiatingNodeId=00ffc1ff-7fc9-4784-aee1-5882a311b000, state=ACTIVE, baselineTopology=BaselineTopology [id=0, branchingHash=-2475315501, branchingType='New BaselineTopology', baselineNodes=[grid-1, grid-0]], forceChangeBaselineTopology=false, timestamp=1637345267732, forceDeactivation=true], allowMerge=false, exchangeFreeSwitch=false] [21:07:47] : [Step 4/5] [2021-11-19 21:07:47,742][INFO ][exchange-worker-#15206%grid-1%][GridDhtPartitionsExchangeFuture] Start activation process [nodeId=10dee0aa-9c25-4677-9e29-6444f6ab2001, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]]. New state: ACTIVE [21:07:47] : [Step 4/5] [2021-11-19 21:07:47,742][INFO ][exchange-worker-#15206%grid-1%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1 [21:07:47] : [Step 4/5] [2021-11-19 21:07:47,742][INFO ][exchange-worker-#15083%grid-0%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000000.wal, offset=13104, ver=2] [21:07:47] : [Step 4/5] [2021-11-19 21:07:47,746][INFO ][exchange-worker-#15206%grid-1%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000000.wal, offset=13104, ver=2] [21:07:47] : [Step 4/5] [2021-11-19 21:07:47,854][INFO ][exchange-worker-#15206%grid-1%][GridClusterStateProcessor] Writing BaselineTopology[id=0] [21:07:47] : [Step 4/5] [2021-11-19 21:07:47,854][INFO ][exchange-worker-#15083%grid-0%][GridClusterStateProcessor] Writing BaselineTopology[id=0] [21:07:48] : [Step 4/5] [2021-11-19 21:07:48,022][INFO ][exchange-worker-#15206%grid-1%][GridCacheDatabaseSharedManager] Finish recovery performed in 279 ms. [21:07:48] : [Step 4/5] [2021-11-19 21:07:48,023][INFO ][exchange-worker-#15206%grid-1%][msg] Components activation performed in 281 ms. [21:07:48] : [Step 4/5] [2021-11-19 21:07:48,078][INFO ][exchange-worker-#15083%grid-0%][GridCacheDatabaseSharedManager] Finish recovery performed in 338 ms. [21:07:48] : [Step 4/5] [2021-11-19 21:07:48,079][INFO ][exchange-worker-#15083%grid-0%][msg] Components activation performed in 340 ms. [21:07:48] : [Step 4/5] [2021-11-19 21:07:48,094][INFO ][sys-#15174%grid-1%][GridCacheProcessor] Started cache [name=encrypted.grid-0, id=-322076973, dataRegionName=default, mode=PARTITIONED, atomicity=ATOMIC, backups=0, mvcc=false] [21:07:48] : [Step 4/5] [2021-11-19 21:07:48,095][INFO ][exchange-worker-#15206%grid-1%][GridCacheProcessor] Finished recovery for cache [cache=ignite-sys-cache, grp=ignite-sys-cache, startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:07:48] : [Step 4/5] [2021-11-19 21:07:48,095][INFO ][sys-#15179%grid-1%][GridCacheProcessor] Finished recovery for cache [cache=encrypted.grid-1, grp=encrypted.grid-1, startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:07:48]W: [org.apache.ignite:ignite-core] [2021-11-19 21:07:48,098][WARN ][sys-#15176%grid-1%][CacheAffinitySharedManager] Cache group 'encrypted.grid-0' brings high overhead for its metainformation in data region 'default'. Metainformation required for its partitions (522 partitions, 4096 bytes per partition, 2 MBs total) will consume more than 15% of data region memory (10 MBs). It may lead to critical errors on the node and cluster instability. Please reduce number of partitions, add more memory to the data region or add more server nodes for this cache group. [21:07:48]W: [org.apache.ignite:ignite-core] [2021-11-19 21:07:48,098][WARN ][sys-#15196%grid-1%][CacheAffinitySharedManager] Cache group 'encrypted.grid-1' brings high overhead for its metainformation in data region 'default'. Metainformation required for its partitions (522 partitions, 4096 bytes per partition, 2 MBs total) will consume more than 15% of data region memory (10 MBs). It may lead to critical errors on the node and cluster instability. Please reduce number of partitions, add more memory to the data region or add more server nodes for this cache group. [21:07:48] : [Step 4/5] [2021-11-19 21:07:48,100][INFO ][exchange-worker-#15206%grid-1%][GridDhtPartitionsExchangeFuture] Successfully activated caches [nodeId=10dee0aa-9c25-4677-9e29-6444f6ab2001, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], newState=ACTIVE] [21:07:48]W: [org.apache.ignite:ignite-core] [2021-11-19 21:07:48,101][WARN ][exchange-worker-#15206%grid-1%][CacheAffinitySharedManager] Cache group 'encrypted.grid-0' brings high overhead for its metainformation in data region 'default'. Metainformation required for its partitions (522 partitions, 4096 bytes per partition, 2 MBs total) will consume more than 15% of data region memory (10 MBs). It may lead to critical errors on the node and cluster instability. Please reduce number of partitions, add more memory to the data region or add more server nodes for this cache group. [21:07:48]W: [org.apache.ignite:ignite-core] [2021-11-19 21:07:48,101][WARN ][sys-#15173%grid-1%][CacheAffinitySharedManager] Cache group 'encrypted.grid-1' brings high overhead for its metainformation in data region 'default'. Metainformation required for its partitions (522 partitions, 4096 bytes per partition, 2 MBs total) will consume more than 15% of data region memory (10 MBs). It may lead to critical errors on the node and cluster instability. Please reduce number of partitions, add more memory to the data region or add more server nodes for this cache group. [21:07:48] : [Step 4/5] [2021-11-19 21:07:48,103][INFO ][exchange-worker-#15206%grid-1%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:07:48] : [Step 4/5] [2021-11-19 21:07:48,150][INFO ][exchange-worker-#15083%grid-0%][GridCacheProcessor] Started cache [name=encrypted.grid-1, id=-322076972, dataRegionName=default, mode=PARTITIONED, atomicity=ATOMIC, backups=0, mvcc=false] [21:07:48] : [Step 4/5] [2021-11-19 21:07:48,150][INFO ][sys-#15062%grid-0%][GridCacheProcessor] Finished recovery for cache [cache=encrypted.grid-0, grp=encrypted.grid-0, startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:07:48] : [Step 4/5] [2021-11-19 21:07:48,150][INFO ][sys-#15057%grid-0%][GridCacheProcessor] Finished recovery for cache [cache=ignite-sys-cache, grp=ignite-sys-cache, startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:07:48]W: [org.apache.ignite:ignite-core] [2021-11-19 21:07:48,154][WARN ][exchange-worker-#15083%grid-0%][CacheAffinitySharedManager] Cache group 'encrypted.grid-0' brings high overhead for its metainformation in data region 'default'. Metainformation required for its partitions (502 partitions, 4096 bytes per partition, 1 MBs total) will consume more than 15% of data region memory (10 MBs). It may lead to critical errors on the node and cluster instability. Please reduce number of partitions, add more memory to the data region or add more server nodes for this cache group. [21:07:48]W: [org.apache.ignite:ignite-core] [2021-11-19 21:07:48,154][WARN ][sys-#15065%grid-0%][CacheAffinitySharedManager] Cache group 'encrypted.grid-1' brings high overhead for its metainformation in data region 'default'. Metainformation required for its partitions (502 partitions, 4096 bytes per partition, 1 MBs total) will consume more than 15% of data region memory (10 MBs). It may lead to critical errors on the node and cluster instability. Please reduce number of partitions, add more memory to the data region or add more server nodes for this cache group. [21:07:48] : [Step 4/5] [2021-11-19 21:07:48,155][INFO ][exchange-worker-#15083%grid-0%][GridDhtPartitionsExchangeFuture] Successfully activated caches [nodeId=00ffc1ff-7fc9-4784-aee1-5882a311b000, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], newState=ACTIVE] [21:07:48]W: [org.apache.ignite:ignite-core] [2021-11-19 21:07:48,157][WARN ][exchange-worker-#15083%grid-0%][CacheAffinitySharedManager] Cache group 'encrypted.grid-0' brings high overhead for its metainformation in data region 'default'. Metainformation required for its partitions (502 partitions, 4096 bytes per partition, 1 MBs total) will consume more than 15% of data region memory (10 MBs). It may lead to critical errors on the node and cluster instability. Please reduce number of partitions, add more memory to the data region or add more server nodes for this cache group. [21:07:48]W: [org.apache.ignite:ignite-core] [2021-11-19 21:07:48,157][WARN ][sys-#15061%grid-0%][CacheAffinitySharedManager] Cache group 'encrypted.grid-1' brings high overhead for its metainformation in data region 'default'. Metainformation required for its partitions (502 partitions, 4096 bytes per partition, 1 MBs total) will consume more than 15% of data region memory (10 MBs). It may lead to critical errors on the node and cluster instability. Please reduce number of partitions, add more memory to the data region or add more server nodes for this cache group. [21:07:48] : [Step 4/5] [2021-11-19 21:07:48,159][INFO ][exchange-worker-#15083%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:07:49] : [Step 4/5] [2021-11-19 21:07:49,068][INFO ][exchange-worker-#15083%grid-0%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], crd=true] [21:07:49] : [Step 4/5] [2021-11-19 21:07:49,071][INFO ][grid-nio-worker-tcp-comm-0-#15021%TcpCommunicationSpi%][TcpCommunicationSpi] Accepted incoming communication connection [locAddr=/127.0.0.1:45170, rmtAddr=/127.0.0.1:42216] [21:07:49] : [Step 4/5] [2021-11-19 21:07:49,074][INFO ][grid-nio-worker-tcp-comm-0-#15140%TcpCommunicationSpi%][TcpCommunicationSpi] Established outgoing communication connection [locAddr=/127.0.0.1:42216, rmtAddr=/127.0.0.1:45170] [21:07:49] : [Step 4/5] [2021-11-19 21:07:49,074][INFO ][exchange-worker-#15206%grid-1%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], crd=false] [21:07:49] : [Step 4/5] [2021-11-19 21:07:49,076][INFO ][sys-#15073%grid-0%][GridDhtPartitionsExchangeFuture] Coordinator received single message [ver=AffinityTopologyVersion [topVer=2, minorTopVer=1], node=10dee0aa-9c25-4677-9e29-6444f6ab2001, allReceived=true] [21:07:49] : [Step 4/5] [2021-11-19 21:07:49,077][INFO ][sys-#15073%grid-0%][GridDhtPartitionsExchangeFuture] finishExchangeOnCoordinator [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:07:49] : [Step 4/5] [2021-11-19 21:07:49,088][INFO ][sys-#15073%grid-0%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], err=null, rebalanced=true, wasRebalanced=false] [21:07:49] : [Step 4/5] [2021-11-19 21:07:49,088][INFO ][disco-notifier-worker-#15197%grid-1%][GridClusterStateProcessor] Received state change finish message: ACTIVE [21:07:49] : [Step 4/5] [2021-11-19 21:07:49,091][INFO ][disco-notifier-worker-#15197%grid-1%][GridClusterStateProcessor] Cluster state was changed from INACTIVE to ACTIVE [21:07:49] : [Step 4/5] [2021-11-19 21:07:49,088][INFO ][disco-notifier-worker-#15078%grid-0%][GridClusterStateProcessor] Received state change finish message: ACTIVE [21:07:49] : [Step 4/5] [2021-11-19 21:07:49,093][INFO ][sys-#15184%grid-1%][GridDhtPartitionsExchangeFuture] Received full message, will finish exchange [node=00ffc1ff-7fc9-4784-aee1-5882a311b000, resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:07:49] : [Step 4/5] [2021-11-19 21:07:49,093][INFO ][disco-notifier-worker-#15078%grid-0%][GridClusterStateProcessor] Cluster state was changed from INACTIVE to ACTIVE [21:07:49] : [Step 4/5] [2021-11-19 21:07:49,096][INFO ][sys-#15178%grid-1%][GridCachePartitionExchangeManager] Delay process full message without exchange id (there is exchange in progress) [nodeId=00ffc1ff-7fc9-4784-aee1-5882a311b000] [21:07:49] : [Step 4/5] [2021-11-19 21:07:49,098][INFO ][sys-#15184%grid-1%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], err=null, rebalanced=true, wasRebalanced=false] [21:07:49] : [Step 4/5] [2021-11-19 21:07:49,098][INFO ][sys-#15073%grid-0%][GridCacheProcessor] Finish proxy initialization, cacheName=ignite-sys-cache, localNodeId=00ffc1ff-7fc9-4784-aee1-5882a311b000 [21:07:49] : [Step 4/5] [2021-11-19 21:07:49,099][INFO ][sys-#15073%grid-0%][GridCacheProcessor] Finish proxy initialization, cacheName=encrypted.grid-1, localNodeId=00ffc1ff-7fc9-4784-aee1-5882a311b000 [21:07:49] : [Step 4/5] [2021-11-19 21:07:49,101][INFO ][sys-#15073%grid-0%][GridCacheProcessor] Finish proxy initialization, cacheName=encrypted.grid-0, localNodeId=00ffc1ff-7fc9-4784-aee1-5882a311b000 [21:07:49] : [Step 4/5] [2021-11-19 21:07:49,101][INFO ][sys-#15058%grid-0%][DistributedBaselineConfiguration] Baseline auto-adjust is 'disabled' with timeout='300000' ms [21:07:49] : [Step 4/5] [2021-11-19 21:07:49,102][INFO ][sys-#15073%grid-0%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=00ffc1ff-7fc9-4784-aee1-5882a311b000, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=00ffc1ff-7fc9-4784-aee1-5882a311b000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345269090, loc=true, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:07:49] : [Step 4/5] [2021-11-19 21:07:49,103][INFO ][sys-#15184%grid-1%][GridCacheProcessor] Finish proxy initialization, cacheName=ignite-sys-cache, localNodeId=10dee0aa-9c25-4677-9e29-6444f6ab2001 [21:07:49] : [Step 4/5] [2021-11-19 21:07:49,103][INFO ][exchange-worker-#15083%grid-0%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=2, minorTopVer=1], force=false, evt=DISCOVERY_CUSTOM_EVT, node=00ffc1ff-7fc9-4784-aee1-5882a311b000] [21:07:49] : [Step 4/5] [2021-11-19 21:07:49,102][INFO ][sys-#15058%grid-0%][GridClusterStateProcessor] Successfully performed final activation steps [nodeId=00ffc1ff-7fc9-4784-aee1-5882a311b000, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:07:49] : [Step 4/5] [2021-11-19 21:07:49,104][INFO ][sys-#15184%grid-1%][GridCacheProcessor] Finish proxy initialization, cacheName=encrypted.grid-1, localNodeId=10dee0aa-9c25-4677-9e29-6444f6ab2001 [21:07:49] : [Step 4/5] [2021-11-19 21:07:49,106][INFO ][sys-#15184%grid-1%][GridCacheProcessor] Finish proxy initialization, cacheName=encrypted.grid-0, localNodeId=10dee0aa-9c25-4677-9e29-6444f6ab2001 [21:07:49] : [Step 4/5] [2021-11-19 21:07:49,104][INFO ][sys-#15073%grid-0%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (0 ms), stage="Update caches registry" (341 ms), stage="Start caches" (71 ms), stage="Affinity initialization on cache group start" (4 ms), stage="Determine exchange type" (3 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Restore partition states" (17 ms), stage="After states restored callback" (890 ms), stage="WAL history reservation" (0 ms), stage="Waiting for all single messages" (8 ms), stage="Affinity recalculation (crd)" (0 ms), stage="Collect update counters and create affinity messages" (0 ms), stage="Assign partitions states" (2 ms), stage="Validate partitions states" (0 ms), stage="Ideal affinity diff calculation (enforced)" (2 ms), stage="Apply update counters" (0 ms), stage="Full message preparing" (3 ms), stage="Full message sending" (0 ms), stage="State finish message sending" (0 ms), stage="Detect lost partitions" (6 ms), stage="Exchange done" (9 ms), stage="Total time" (1356 ms), Discovery lag=3 ms, Latest started node id=10dee0aa-9c25-4677-9e29-6444f6ab2001] [21:07:49] : [Step 4/5] [2021-11-19 21:07:49,109][INFO ][exchange-worker-#15206%grid-1%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=2, minorTopVer=1], force=false, evt=DISCOVERY_CUSTOM_EVT, node=00ffc1ff-7fc9-4784-aee1-5882a311b000] [21:07:49] : [Step 4/5] [2021-11-19 21:07:49,108][INFO ][sys-#15184%grid-1%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=10dee0aa-9c25-4677-9e29-6444f6ab2001, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=00ffc1ff-7fc9-4784-aee1-5882a311b000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345267691, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:07:49] : [Step 4/5] [2021-11-19 21:07:49,107][INFO ][sys-#15176%grid-1%][DistributedBaselineConfiguration] Baseline auto-adjust is 'disabled' with timeout='300000' ms [21:07:49] : [Step 4/5] [2021-11-19 21:07:49,111][INFO ][sys-#15184%grid-1%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (2 ms), stage="Update caches registry" (282 ms), stage="Start caches" (71 ms), stage="Affinity initialization on cache group start" (3 ms), stage="Determine exchange type" (3 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Restore partition states" (11 ms), stage="After states restored callback" (953 ms), stage="WAL history reservation" (0 ms), stage="Waiting for Full message" (24 ms), stage="Affinity recalculation" (1 ms), stage="Full map updating" (3 ms), stage="Detect lost partitions" (4 ms), stage="Exchange done" (8 ms), stage="Total time" (1365 ms)] [21:07:49] : [Step 4/5] [2021-11-19 21:07:49,109][INFO ][sys-#15073%grid-0%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], stage="Affinity initialization on cache group start [grp=encrypted.grid-1]" (2 ms) (parent=Affinity initialization on cache group start), stage="Affinity initialization on cache group start [grp=encrypted.grid-0]" (1 ms) (parent=Affinity initialization on cache group start), stage="Affinity initialization on cache group start [grp=ignite-sys-cache]" (0 ms) (parent=Affinity initialization on cache group start), stage="Affinity centralized initialization (crd) [grp=ignite-sys-cache, crd=true]" (0 ms) (parent=Determine exchange type), stage="Affinity centralized initialization (crd) [grp=encrypted.grid-1, crd=true]" (0 ms) (parent=Determine exchange type), stage="Affinity centralized initialization (crd) [grp=encrypted.grid-0, crd=true]" (0 ms) (parent=Determine exchange type), stage="Restore partition states [grp=encrypted.grid-1]" (17 ms) (parent=Restore partition states), stage="Restore partition states [grp=ignite-sys-cache]" (0 ms) (parent=Restore partition states), stage="Restore partition states [grp=encrypted.grid-0]" (0 ms) (parent=Restore partition states), stage="Affinity recalculation (partitions availability) [grp=encrypted.grid-1]" (2 ms) (parent=Ideal affinity diff calculation (enforced)), stage="Affinity recalculation (partitions availability) [grp=encrypted.grid-0]" (2 ms) (parent=Ideal affinity diff calculation (enforced)), stage="Affinity recalculation (partitions availability) [grp=ignite-sys-cache]" (0 ms) (parent=Ideal affinity diff calculation (enforced))] [21:07:49] : [Step 4/5] [2021-11-19 21:07:49,113][INFO ][sys-#15184%grid-1%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], stage="Affinity initialization on cache group start [grp=encrypted.grid-1]" (2 ms) (parent=Affinity initialization on cache group start), stage="Affinity initialization on cache group start [grp=encrypted.grid-0]" (1 ms) (parent=Affinity initialization on cache group start), stage="Affinity initialization on cache group start [grp=ignite-sys-cache]" (0 ms) (parent=Affinity initialization on cache group start), stage="Affinity centralized initialization (crd) [grp=ignite-sys-cache, crd=false]" (0 ms) (parent=Determine exchange type), stage="Affinity centralized initialization (crd) [grp=encrypted.grid-1, crd=false]" (0 ms) (parent=Determine exchange type), stage="Affinity centralized initialization (crd) [grp=encrypted.grid-0, crd=false]" (0 ms) (parent=Determine exchange type), stage="Restore partition states [grp=encrypted.grid-0]" (11 ms) (parent=Restore partition states), stage="Restore partition states [grp=ignite-sys-cache]" (0 ms) (parent=Restore partition states), stage="Restore partition states [grp=encrypted.grid-1]" (0 ms) (parent=Restore partition states), stage="Affinity applying from full message [grp=encrypted.grid-1]" (1 ms) (parent=Affinity recalculation), stage="Affinity applying from full message [grp=encrypted.grid-0]" (1 ms) (parent=Affinity recalculation), stage="Affinity applying from full message [grp=ignite-sys-cache]" (0 ms) (parent=Affinity recalculation)] [21:07:49] : [Step 4/5] [2021-11-19 21:07:49,111][INFO ][sys-#15176%grid-1%][GridClusterStateProcessor] Successfully performed final activation steps [nodeId=10dee0aa-9c25-4677-9e29-6444f6ab2001, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:07:49] : [Step 4/5] [2021-11-19 21:07:49,123][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][root] awaitPartitionMapExchange finished [21:07:50] : [Step 4/5] [2021-11-19 21:07:50,773][INFO ][db-checkpoint-thread-#15219%grid-1%][Checkpointer] Checkpoint started [checkpointId=d6d33319-1bc0-4364-8054-36f69db017bc, startPtr=WALPointer [idx=0, fileOff=250234, len=21811], checkpointBeforeLockTime=2ms, checkpointLockWait=722ms, checkpointListenersExecuteTime=2ms, checkpointLockHoldTime=3ms, walCpRecordFsyncDuration=192ms, writeCheckpointEntryDuration=1512ms, splitAndSortCpPagesDuration=0ms, pages=29, reason='node started'] [21:07:50] : [Step 4/5] [2021-11-19 21:07:50,773][INFO ][db-checkpoint-thread-#15215%grid-0%][Checkpointer] Checkpoint started [checkpointId=a5510ec1-55a0-480b-992d-d9be69bf4ab9, startPtr=WALPointer [idx=0, fileOff=243914, len=21051], checkpointBeforeLockTime=2ms, checkpointLockWait=723ms, checkpointListenersExecuteTime=1ms, checkpointLockHoldTime=2ms, walCpRecordFsyncDuration=193ms, writeCheckpointEntryDuration=1512ms, splitAndSortCpPagesDuration=0ms, pages=29, reason='node started'] [21:07:50] : [Step 4/5] [2021-11-19 21:07:50,830][INFO ][db-checkpoint-thread-#15219%grid-1%][Checkpointer] Checkpoint finished [cpId=d6d33319-1bc0-4364-8054-36f69db017bc, pages=29, markPos=WALPointer [idx=0, fileOff=250234, len=21811], walSegmentsCovered=[], markDuration=1709ms, pagesWrite=2ms, fsync=54ms, total=2489ms] [21:07:50] : [Step 4/5] [2021-11-19 21:07:50,830][INFO ][db-checkpoint-thread-#15215%grid-0%][Checkpointer] Checkpoint finished [cpId=a5510ec1-55a0-480b-992d-d9be69bf4ab9, pages=29, markPos=WALPointer [idx=0, fileOff=243914, len=21051], walSegmentsCovered=[], markDuration=1710ms, pagesWrite=1ms, fsync=54ms, total=2490ms] [21:07:54] : [Step 4/5] [2021-11-19 21:07:54,876][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][root] >>> Stopping grid [name=grid-1, id=10dee0aa-9c25-4677-9e29-6444f6ab2001] [21:07:55] : [Step 4/5] [2021-11-19 21:07:55,527][INFO ][db-checkpoint-thread-#15219%grid-1%][Checkpointer] Checkpoint started [checkpointId=cdc4cfdb-d1fc-4d08-bf56-11ad6447c323, startPtr=WALPointer [idx=0, fileOff=748319, len=21795], checkpointBeforeLockTime=6ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=1ms, checkpointLockHoldTime=2ms, walCpRecordFsyncDuration=152ms, writeCheckpointEntryDuration=486ms, splitAndSortCpPagesDuration=0ms, pages=450, reason='timeout'] [21:07:55] : [Step 4/5] [2021-11-19 21:07:55,533][INFO ][tcp-disco-sock-reader-[00ffc1ff 127.0.0.1:39951]-#794%grid-1%-#15202%grid-1%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:39951, rmtPort=39951, rmtNodeId=00ffc1ff-7fc9-4784-aee1-5882a311b000] [21:07:55] : [Step 4/5] [2021-11-19 21:07:55,534][INFO ][disco-event-worker-#15082%grid-0%][GridDiscoveryManager] Node left topology: TcpDiscoveryNode [id=10dee0aa-9c25-4677-9e29-6444f6ab2001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637345267551, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false] [21:07:55] : [Step 4/5] [2021-11-19 21:07:55,535][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][GridCacheProcessor] Stopped cache [cacheName=encrypted.grid-1] [21:07:55] : [Step 4/5] [2021-11-19 21:07:55,536][INFO ][disco-event-worker-#15082%grid-0%][GridDiscoveryManager] Topology snapshot [ver=3, locNode=00ffc1ff, servers=1, clients=0, state=ACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=00ffc1ff-7fc9-4784-aee1-5882a311b000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:07:55] : [Step 4/5] [2021-11-19 21:07:55,536][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][GridCacheProcessor] Stopped cache [cacheName=ignite-sys-cache] [21:07:55] : [Step 4/5] [2021-11-19 21:07:55,537][INFO ][disco-event-worker-#15082%grid-0%][GridDiscoveryManager] ^-- Baseline [id=0, size=2, online=1, offline=1] [21:07:55] : [Step 4/5] [2021-11-19 21:07:55,537][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][GridCacheProcessor] Stopped cache [cacheName=encrypted.grid-0] [21:07:55]W: [org.apache.ignite:ignite-core] [2021-11-19 21:07:55,538][WARN ][grid-nio-worker-tcp-comm-0-#15021%TcpCommunicationSpi%][TcpCommunicationSpi] Failed to shutdown socket [21:07:55]W: [org.apache.ignite:ignite-core] java.nio.channels.ClosedChannelException [21:07:55]W: [org.apache.ignite:ignite-core] at sun.nio.ch.SocketChannelImpl.shutdownOutput(SocketChannelImpl.java:795) [21:07:55]W: [org.apache.ignite:ignite-core] at sun.nio.ch.SocketAdaptor.shutdownOutput(SocketAdaptor.java:407) [21:07:55]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.close(IgniteUtils.java:4247) [21:07:55]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.closeKey(GridNioServer.java:2784) [21:07:55]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.close(GridNioServer.java:2835) [21:07:55]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.close(GridNioServer.java:2794) [21:07:55]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.bodyInternal(GridNioServer.java:2157) [21:07:55]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.body(GridNioServer.java:1910) [21:07:55]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:125) [21:07:55] : [Step 4/5] [2021-11-19 21:07:55,539][INFO ][exchange-worker-#15083%grid-0%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], crd=true, evt=NODE_LEFT, evtNode=10dee0aa-9c25-4677-9e29-6444f6ab2001, customEvt=null, allowMerge=false, exchangeFreeSwitch=true] [21:07:55]W: [org.apache.ignite:ignite-core] at java.lang.Thread.run(Thread.java:748) [21:07:55] : [Step 4/5] [2021-11-19 21:07:55,541][INFO ][sys-#15057%grid-0%][GridAffinityAssignmentCache] Local node affinity assignment distribution is not ideal [cache=encrypted.grid-1, expectedPrimary=1024.00, actualPrimary=502, expectedBackups=0.00, actualBackups=0, warningThreshold=50.00%] [21:07:55] : [Step 4/5] [2021-11-19 21:07:55,541][INFO ][exchange-worker-#15083%grid-0%][GridAffinityAssignmentCache] Local node affinity assignment distribution is not ideal [cache=encrypted.grid-0, expectedPrimary=1024.00, actualPrimary=502, expectedBackups=0.00, actualBackups=0, warningThreshold=50.00%] [21:07:55] : [Step 4/5] [2021-11-19 21:07:55,542][INFO ][exchange-worker-#15083%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:07:55] : [Step 4/5] [2021-11-19 21:07:55,544][INFO ][exchange-worker-#15083%grid-0%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], err=null, rebalanced=true, wasRebalanced=true] [21:07:55]W: [org.apache.ignite:ignite-core] [2021-11-19 21:07:55,546][WARN ][sys-#15065%grid-0%][GridDhtPartitionTopologyImpl] Detected lost partitions [grp=encrypted.grid-1, parts=[0, 2, 4, 6-7, 10-11, 14, 17, 21, 24-30, 32, 37, 40, 44, 47-52, 54, 57, 59, 62-64, 67-68, 74-75, 78, 81, 87-88, 91, 97, 99, 101-102, 104-107, 113-114, 116, 118, 120, 122, 124, 135-136, 138, 140-145, 147, 149-152, 154-156, 159-160, 162-164, 169, 172, 175-177, 180, 184-187, 190-191, 194, 196-202, 204-205, 209-210, 212, 214, 216, 219-224, 226, 229-232, 237, 239, 241, 243-245, 247, 249-251, 255, 257, 261, 265, 269, 272-273, 276-277, 281-282, 285, 287, 289-291, 293-297, 299, 301-304, 306, 308-309, 311-312, 315-317, 319, 322, 325-326, 328-330, 336, 339, 341, 344-346, 350, 352-354, 357-361, 363, 366-367, 371-373, 376-380, 383, 385, 387-388, 390, 392, 395-397, 400, 402, 405, 408-411, 416, 420, 422, 424-425, 429, 433, 435-438, 440-441, 445-446, 450, 452-453, 455-456, 458, 460, 462-463, 465-468, 470, 474-475, 480, 488, 490-492, 495, 497, 499-512, 516, 525, 527-531, 535, 537-538, 541-542, 545-546, 548-552, 554-555, 558, 562-564, 567-569, 572, 574, 579-580, 582-585, 587, 590-591, 594, 596, 600, 602, 604, 607-614, 617-620, 623-624, 627-629, 632-633, 636, 638, 640-642, 645-646, 648-649, 657-662, 664-665, 668-672, 677-678, 682-684, 686, 689, 692-693, 695-697, 699, 706-707, 709-710, 712-714, 716-717, 719-721, 723-728, 730-732, 734-735, 739, 742, 746, 749-750, 752, 754, 756, 762, 768-770, 772-775, 778, 780, 783-787, 789-791, 793, 796, 798-801, 803, 806, 809-812, 814, 816-817, 819, 822-825, 827-829, 832-833, 836-837, 839-840, 846, 848-851, 853-854, 857-858, 860, 863-864, 866, 868-871, 873-875, 877-878, 884, 888-889, 896-897, 900, 905-907, 914-915, 917, 919-920, 923-925, 931-933, 936, 940, 942, 944-945, 948, 950-951, 954, 956-958, 962, 965-970, 972, 975-976, 978-980, 983, 985, 988, 990, 993-994, 997-998, 1000, 1003-1004, 1007, 1009, 1014, 1016, 1018-1019], topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0]] [21:07:55]W: [org.apache.ignite:ignite-core] [2021-11-19 21:07:55,546][WARN ][sys-#15068%grid-0%][GridDhtPartitionTopologyImpl] Detected lost partitions [grp=encrypted.grid-0, parts=[0, 2, 4, 6-7, 10-11, 14, 17, 21, 24-30, 32, 37, 40, 44, 47-52, 54, 57, 59, 62-64, 67-68, 74-75, 78, 81, 87-88, 91, 97, 99, 101-102, 104-107, 113-114, 116, 118, 120, 122, 124, 135-136, 138, 140-145, 147, 149-152, 154-156, 159-160, 162-164, 169, 172, 175-177, 180, 184-187, 190-191, 194, 196-202, 204-205, 209-210, 212, 214, 216, 219-224, 226, 229-232, 237, 239, 241, 243-245, 247, 249-251, 255, 257, 261, 265, 269, 272-273, 276-277, 281-282, 285, 287, 289-291, 293-297, 299, 301-304, 306, 308-309, 311-312, 315-317, 319, 322, 325-326, 328-330, 336, 339, 341, 344-346, 350, 352-354, 357-361, 363, 366-367, 371-373, 376-380, 383, 385, 387-388, 390, 392, 395-397, 400, 402, 405, 408-411, 416, 420, 422, 424-425, 429, 433, 435-438, 440-441, 445-446, 450, 452-453, 455-456, 458, 460, 462-463, 465-468, 470, 474-475, 480, 488, 490-492, 495, 497, 499-512, 516, 525, 527-531, 535, 537-538, 541-542, 545-546, 548-552, 554-555, 558, 562-564, 567-569, 572, 574, 579-580, 582-585, 587, 590-591, 594, 596, 600, 602, 604, 607-614, 617-620, 623-624, 627-629, 632-633, 636, 638, 640-642, 645-646, 648-649, 657-662, 664-665, 668-672, 677-678, 682-684, 686, 689, 692-693, 695-697, 699, 706-707, 709-710, 712-714, 716-717, 719-721, 723-728, 730-732, 734-735, 739, 742, 746, 749-750, 752, 754, 756, 762, 768-770, 772-775, 778, 780, 783-787, 789-791, 793, 796, 798-801, 803, 806, 809-812, 814, 816-817, 819, 822-825, 827-829, 832-833, 836-837, 839-840, 846, 848-851, 853-854, 857-858, 860, 863-864, 866, 868-871, 873-875, 877-878, 884, 888-889, 896-897, 900, 905-907, 914-915, 917, 919-920, 923-925, 931-933, 936, 940, 942, 944-945, 948, 950-951, 954, 956-958, 962, 965-970, 972, 975-976, 978-980, 983, 985, 988, 990, 993-994, 997-998, 1000, 1003-1004, 1007, 1009, 1014, 1016, 1018-1019], topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0]] [21:07:55] : [Step 4/5] [2021-11-19 21:07:55,555][INFO ][exchange-worker-#15083%grid-0%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=00ffc1ff-7fc9-4784-aee1-5882a311b000, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], evt=NODE_LEFT, evtNode=TcpDiscoveryNode [id=10dee0aa-9c25-4677-9e29-6444f6ab2001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637345267551, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0]] [21:07:55] : [Step 4/5] [2021-11-19 21:07:55,556][INFO ][exchange-worker-#15083%grid-0%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (1 ms), stage="Determine exchange type" (1 ms), stage="Preloading notification" (0 ms), stage="After states restored callback" (0 ms), stage="WAL history reservation" (0 ms), stage="Finalize update counters" (0 ms), stage="Detect lost partitions" (10 ms), stage="Exchange done" (2 ms), stage="Total time" (14 ms)] [21:07:55] : [Step 4/5] [2021-11-19 21:07:55,558][INFO ][exchange-worker-#15083%grid-0%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], stage="Affinity initialization (exchange-free switch on fully-rebalanced topology) [grp=encrypted.grid-1]" (1 ms) (parent=Determine exchange type), stage="Affinity initialization (exchange-free switch on fully-rebalanced topology) [grp=encrypted.grid-0]" (1 ms) (parent=Determine exchange type), stage="Affinity initialization (exchange-free switch on fully-rebalanced topology) [grp=ignite-sys-cache]" (0 ms) (parent=Determine exchange type)] [21:07:55] : [Step 4/5] [2021-11-19 21:07:55,559][INFO ][exchange-worker-#15083%grid-0%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], crd=true] [21:07:55] : [Step 4/5] [2021-11-19 21:07:55,561][INFO ][exchange-worker-#15083%grid-0%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=3, minorTopVer=0], force=false, evt=NODE_LEFT, node=10dee0aa-9c25-4677-9e29-6444f6ab2001] [21:07:55] : [Step 4/5] [2021-11-19 21:07:55,917][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][FilePageStoreManager] Cleanup cache stores [total=5, left=0, cleanFiles=false] [21:07:55] : [Step 4/5] [2021-11-19 21:07:55,919][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][GridDeploymentLocalStore] Removed undeployed class: GridDeployment [ts=1637345269080, depMode=SHARED, clsLdr=IsolatedClassLoader{roleName='test'}, clsLdrId=6b75d593d71-10dee0aa-9c25-4677-9e29-6444f6ab2001, userVer=0, loc=true, sampleClsName=org.apache.ignite.internal.processors.cache.distributed.dht.preloader.IgniteDhtPartitionHistorySuppliersMap, pendingUndeploy=false, undeployed=true, usage=0] [21:07:55] : [Step 4/5] [2021-11-19 21:07:55,927][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][IgniteKernal%grid-1] [21:07:55] : [Step 4/5] [21:07:55] : [Step 4/5] >>> +------------------------------------------------------+ [21:07:55] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV stopped OK [21:07:55] : [Step 4/5] >>> +------------------------------------------------------+ [21:07:55] : [Step 4/5] >>> Ignite instance name: grid-1 [21:07:55] : [Step 4/5] >>> Grid uptime: 00:00:08.199 [21:07:55] : [Step 4/5] [21:07:55] : [Step 4/5] [21:07:55] : [Step 4/5] [2021-11-19 21:07:55,928][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][root] >>> Stopping grid [name=grid-0, id=00ffc1ff-7fc9-4784-aee1-5882a311b000] [21:07:55] : [Step 4/5] [2021-11-19 21:07:55,956][INFO ][db-checkpoint-thread-#15215%grid-0%][Checkpointer] Checkpoint started [checkpointId=8ad74969-2b82-4b24-b7e6-a2e5e9d391bd, startPtr=WALPointer [idx=0, fileOff=859846, len=21035], checkpointBeforeLockTime=7ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=1ms, checkpointLockHoldTime=5ms, walCpRecordFsyncDuration=6ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=1ms, pages=570, reason='timeout'] [21:07:55]W: [org.apache.ignite:ignite-core] [2021-11-19 21:07:55,962][WARN ][tcp-disco-sock-reader-[10dee0aa 127.0.0.1:38507]-#795%grid-0%-#15203%grid-0%][TestTcpDiscoverySpi] Failed to shutdown socket [21:07:55]W: [org.apache.ignite:ignite-core] java.net.SocketException: Socket is closed [21:07:55]W: [org.apache.ignite:ignite-core] at java.net.Socket.shutdownOutput(Socket.java:1568) [21:07:55]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.close(IgniteUtils.java:4247) [21:07:55]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.discovery.tcp.ServerImpl$SocketReader.body(ServerImpl.java:7370) [21:07:55]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.IgniteSpiThread.run(IgniteSpiThread.java:58) [21:07:55] : [Step 4/5] [2021-11-19 21:07:55,963][INFO ][tcp-disco-sock-reader-[10dee0aa 127.0.0.1:38507]-#795%grid-0%-#15203%grid-0%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:38507, rmtPort=38507, rmtNodeId=10dee0aa-9c25-4677-9e29-6444f6ab2001] [21:07:55] : [Step 4/5] [2021-11-19 21:07:55,966][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][GridCacheProcessor] Stopped cache [cacheName=encrypted.grid-0] [21:07:55] : [Step 4/5] [2021-11-19 21:07:55,966][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][GridCacheProcessor] Stopped cache [cacheName=ignite-sys-cache] [21:07:55] : [Step 4/5] [2021-11-19 21:07:55,966][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][GridCacheProcessor] Stopped cache [cacheName=encrypted.grid-1] [21:07:56] : [Step 4/5] [2021-11-19 21:07:56,497][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][FilePageStoreManager] Cleanup cache stores [total=5, left=0, cleanFiles=false] [21:07:56] : [Step 4/5] [2021-11-19 21:07:56,498][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][GridDeploymentLocalStore] Removed undeployed class: GridDeployment [ts=1637345269070, depMode=SHARED, clsLdr=IsolatedClassLoader{roleName='test'}, clsLdrId=4b75d593d71-00ffc1ff-7fc9-4784-aee1-5882a311b000, userVer=0, loc=true, sampleClsName=org.apache.ignite.internal.processors.cache.distributed.dht.preloader.GridDhtPartitionMap, pendingUndeploy=false, undeployed=true, usage=0] [21:07:56] : [Step 4/5] [2021-11-19 21:07:56,508][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][IgniteKernal%grid-0] [21:07:56] : [Step 4/5] [21:07:56] : [Step 4/5] >>> +------------------------------------------------------+ [21:07:56] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV stopped OK [21:07:56] : [Step 4/5] >>> +------------------------------------------------------+ [21:07:56] : [Step 4/5] >>> Ignite instance name: grid-0 [21:07:56] : [Step 4/5] >>> Grid uptime: 00:00:10.762 [21:07:56] : [Step 4/5] [21:07:56] : [Step 4/5] [21:07:56]W: [org.apache.ignite:ignite-core] [2021-11-19 21:07:56,514][WARN ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][G] Ignite work directory is not provided, automatically resolved to: /opt/buildagent/work/7bc1c54bc719b67c/work [21:07:56] : [Step 4/5] [2021-11-19 21:07:56,516][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][IgniteKernal%grid-0] [21:07:56] : [Step 4/5] [21:07:56] : [Step 4/5] >>> __________ ________________ [21:07:56] : [Step 4/5] >>> / _/ ___/ |/ / _/_ __/ __/ [21:07:56] : [Step 4/5] >>> _/ // (7 7 // / / / / _/ [21:07:56] : [Step 4/5] >>> /___/\___/_/|_/___/ /_/ /___/ [21:07:56] : [Step 4/5] >>> [21:07:56] : [Step 4/5] >>> ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:07:56] : [Step 4/5] >>> 2021 Copyright(C) Apache Software Foundation [21:07:56] : [Step 4/5] >>> [21:07:56] : [Step 4/5] >>> Ignite documentation: http://ignite.apache.org [21:07:56] : [Step 4/5] [21:07:56] : [Step 4/5] [2021-11-19 21:07:56,516][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][IgniteKernal%grid-0] Config URL: n/a [21:07:56] : [Step 4/5] [2021-11-19 21:07:56,517][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][IgniteKernal%grid-0] IgniteConfiguration [igniteInstanceName=grid-0, pubPoolSize=24, svcPoolSize=24, callbackPoolSize=24, stripedPoolSize=24, sysPoolSize=24, mgmtPoolSize=4, dataStreamerPoolSize=24, utilityCachePoolSize=24, utilityCacheKeepAliveTime=60000, p2pPoolSize=2, qryPoolSize=24, buildIdxPoolSize=4, igniteHome=/opt/buildagent/work/7bc1c54bc719b67c, igniteWorkDir=/opt/buildagent/work/7bc1c54bc719b67c/work, mbeanSrv=com.sun.jmx.mbeanserver.JmxMBeanServer@6fe85038, nodeId=00d146be-a209-4645-889f-3df8c43ef000, marsh=BinaryMarshaller [], marshLocJobs=false, daemon=false, p2pEnabled=true, netTimeout=10000, netCompressionLevel=1, sndRetryDelay=1000, sndRetryCnt=3, metricsHistSize=10000, metricsUpdateFreq=1000, metricsExpTime=9223372036854775807, discoSpi=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=0, ackTimeout=0, marsh=null, reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], segPlc=STOP, segResolveAttempts=2, waitForSegOnStart=true, allResolversPassReq=true, segChkFreq=10000, commSpi=TcpCommunicationSpi [connectGate=org.apache.ignite.spi.communication.tcp.internal.ConnectGateway@4b25efbc, ctxInitLatch=java.util.concurrent.CountDownLatch@6542fe63[Count = 1], stopping=false, clientPool=null, nioSrvWrapper=null, stateProvider=null], evtSpi=MemoryEventStorageSpi [expireAgeMs=9223372036854775807, expireCnt=10000, filter=null], colSpi=NoopCollisionSpi [], deploySpi=LocalDeploymentSpi [], indexingSpi=org.apache.ignite.spi.indexing.noop.NoopIndexingSpi@48b23828, addrRslvr=null, encryptionSpi=org.apache.ignite.spi.encryption.keystore.KeystoreEncryptionSpi@6b2e4110, tracingSpi=org.apache.ignite.spi.tracing.NoopTracingSpi@5c70c910, clientMode=false, rebalanceThreadPoolSize=4, rebalanceTimeout=10000, rebalanceBatchesPrefetchCnt=3, rebalanceThrottle=0, rebalanceBatchSize=524288, txCfg=TransactionConfiguration [txSerEnabled=false, dfltIsolation=REPEATABLE_READ, dfltConcurrency=PESSIMISTIC, dfltTxTimeout=0, txTimeoutOnPartitionMapExchange=0, deadlockTimeout=10000, pessimisticTxLogSize=0, pessimisticTxLogLinger=10000, tmLookupClsName=null, txManagerFactory=null, useJtaSync=false], cacheSanityCheckEnabled=true, discoStartupDelay=60000, deployMode=SHARED, p2pMissedCacheSize=100, locHost=127.0.0.1, timeSrvPortBase=31100, timeSrvPortRange=100, failureDetectionTimeout=10000, sysWorkerBlockedTimeout=null, clientFailureDetectionTimeout=10000, metricsLogFreq=0, connectorCfg=null, odbcCfg=null, warmupClos=null, atomicCfg=AtomicConfiguration [seqReserveSize=1000, cacheMode=PARTITIONED, backups=1, aff=null, grpName=null], classLdr=null, sslCtxFactory=null, platformCfg=null, binaryCfg=null, memCfg=null, pstCfg=null, dsCfg=DataStorageConfiguration [sysRegionInitSize=41943040, sysRegionMaxSize=104857600, pageSize=4096, concLvl=0, dfltDataRegConf=DataRegionConfiguration [name=default, maxSize=10485760, initSize=268435456, swapPath=null, pageEvictionMode=DISABLED, pageReplacementMode=CLOCK, evictionThreshold=0.9, emptyPagesPoolSize=100, metricsEnabled=false, metricsSubIntervalCount=5, metricsRateTimeInterval=60000, persistenceEnabled=true, checkpointPageBufSize=0, lazyMemoryAllocation=true, warmUpCfg=null], dataRegions=null, storagePath=null, checkpointFreq=180000, lockWaitTime=10000, checkpointThreads=4, checkpointWriteOrder=SEQUENTIAL, walHistSize=20, maxWalArchiveSize=1073741824, walSegments=10, walSegmentSize=67108864, walPath=db/wal, walArchivePath=db/wal/archive, cdcWalPath=db/wal/cdc, cdcEnabled=false, metricsEnabled=false, walMode=FSYNC, walTlbSize=131072, walBuffSize=0, walFlushFreq=2000, walFsyncDelay=1000, walRecordIterBuffSize=67108864, alwaysWriteFullPages=false, fileIOFactory=org.apache.ignite.internal.processors.cache.persistence.file.AsyncFileIOFactory@405139a4, metricsSubIntervalCnt=5, metricsRateTimeInterval=60000, walAutoArchiveAfterInactivity=-1, walForceArchiveTimeout=-1, writeThrottlingEnabled=false, walCompactionEnabled=false, walCompactionLevel=1, checkpointReadLockTimeout=null, walPageCompression=DISABLED, walPageCompressionLevel=null, dfltWarmUpCfg=null, encCfg=org.apache.ignite.configuration.EncryptionConfiguration@3798f885, defragmentationThreadPoolSize=4, minWalArchiveSize=-1], snapshotPath=snapshots, activeOnStart=true, activeOnStartPropSetFlag=false, autoActivation=true, autoActivationPropSetFlag=false, clusterStateOnStart=null, sqlConnCfg=null, cliConnCfg=ClientConnectorConfiguration [host=null, port=10800, portRange=100, sockSndBufSize=0, sockRcvBufSize=0, tcpNoDelay=true, maxOpenCursorsPerConn=128, threadPoolSize=24, selectorCnt=12, idleTimeout=0, handshakeTimeout=10000, jdbcEnabled=true, odbcEnabled=true, thinCliEnabled=true, sslEnabled=false, useIgniteSslCtxFactory=true, sslClientAuth=false, sslCtxFactory=null, thinCliCfg=ThinClientConfiguration [maxActiveTxPerConn=100, maxActiveComputeTasksPerConn=0]], mvccVacuumThreadCnt=2, mvccVacuumFreq=5000, authEnabled=false, failureHnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]], commFailureRslvr=null, sqlCfg=SqlConfiguration [longQryWarnTimeout=3000, dfltQryTimeout=0, sqlQryHistSize=1000, validationEnabled=false], asyncContinuationExecutor=null] [21:07:56] : [Step 4/5] [2021-11-19 21:07:56,524][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][IgniteKernal%grid-0] Daemon mode: off [21:07:56] : [Step 4/5] [2021-11-19 21:07:56,524][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][IgniteKernal%grid-0] OS: Linux 4.15.0-151-generic amd64 [21:07:56] : [Step 4/5] [2021-11-19 21:07:56,525][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][IgniteKernal%grid-0] OS user: teamcity [21:07:56] : [Step 4/5] [2021-11-19 21:07:56,525][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][IgniteKernal%grid-0] PID: 16724 [21:07:56] : [Step 4/5] [2021-11-19 21:07:56,525][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][IgniteKernal%grid-0] Language runtime: Java Platform API Specification ver. 1.8 [21:07:56] : [Step 4/5] [2021-11-19 21:07:56,526][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][IgniteKernal%grid-0] VM information: Java(TM) SE Runtime Environment 1.8.0_261-b12 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 25.261-b12 [21:07:56] : [Step 4/5] [2021-11-19 21:07:56,526][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][IgniteKernal%grid-0] VM total memory: 1.9GB [21:07:56] : [Step 4/5] [2021-11-19 21:07:56,526][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][IgniteKernal%grid-0] Remote Management [restart: off, REST: off, JMX (remote: off)] [21:07:56] : [Step 4/5] [2021-11-19 21:07:56,526][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][IgniteKernal%grid-0] Logger: GridTestLog4jLogger [quiet=false, config=null] [21:07:56] : [Step 4/5] [2021-11-19 21:07:56,527][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][IgniteKernal%grid-0] IGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c [21:07:56] : [Step 4/5] [2021-11-19 21:07:56,527][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][IgniteKernal%grid-0] VM arguments: [-DIGNITE_DUMP_THREADS_ON_FAILURE=false, -DMono=/usr/bin/mono-sgen, -DMono4.0_x64=/usr/lib/mono/4.0, -DMono4.5_x64=/usr/lib/mono/4.5, -DMonoVersion=6.12.0.90, -DSKIP_BUILD=false, -Dagent.home.dir=/opt/buildagent, -Dagent.name=aitc-lin02_03, -Dagent.ownPort=9090, -Dagent.work.dir=/opt/buildagent/work, -Dbuild.number=95, -Dbuild.vcs.number=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.1=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.GitHubApacheIgnite=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dclassworlds.conf=/opt/buildagent/temp/buildTmp/teamcity.m2.conf, -Dcom.jetbrains.maven.watcher.report.file=/opt/buildagent/temp/buildTmp/maven-build-info.xml, -Djava.io.tmpdir=/opt/buildagent/temp/buildTmp, -Dmaven.home=/opt/buildagent/tools/maven3_6, -Dmaven.multiModuleProjectDirectory=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.agent.cpuBenchmark=457, -Dteamcity.agent.dotnet.agent_url=http://localhost:9090/RPC2, -Dteamcity.agent.dotnet.build_id=6278078, -Dteamcity.auth.password=*******, -Dteamcity.auth.userId=TeamCityBuildId=6278078, -Dteamcity.build.changedFiles.file=/opt/buildagent/temp/buildTmp/changedFiles6342607772318147725.txt, -Dteamcity.build.checkoutDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.build.id=6278078, -Dteamcity.build.properties.file=/opt/buildagent/temp/buildTmp/teamcity.build5164517880467851002.properties, -Dteamcity.build.tempDir=/opt/buildagent/temp/buildTmp, -Dteamcity.build.workingDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.buildConfName=Basic 3, -Dteamcity.buildType.id=IgniteTests24Java8_Basic3, -Dteamcity.configuration.properties.file=/opt/buildagent/temp/buildTmp/teamcity.config5591980786735343870.properties, -Dteamcity.maven.userSettings.path=/opt/buildagent/temp/buildTmp/maven_settings_585072866407032347.xml, -Dteamcity.maven.watcher.home=/opt/buildagent/plugins/mavenPlugin/maven-watcher-jdk16, -Dteamcity.projectName=Ignite Tests 2.x (JDK 8/11), -Dteamcity.runner.properties.file=/opt/buildagent/temp/buildTmp/teamcity.runner9098465561618137420.properties, -Dteamcity.tests.recentlyFailedTests.file=/opt/buildagent/temp/buildTmp/testsToRunFirst3891775683130404069.txt, -Dteamcity.version=2021.2 (build 99542), -ea, -Xms2g, -Xmx2g, -XX:+HeapDumpOnOutOfMemoryError, -DIGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_TEST_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_UPDATE_NOTIFIER=false, -DIGNITE_NO_DISCO_ORDER=true, -DIGNITE_PERFORMANCE_SUGGESTIONS_DISABLED=true, -Djava.net.preferIPv4Stack=true, -DTEST_SCALE_FACTOR=1.0, -DIGNITE_TEST_PROP_LOG4J_FILE=log4j-tc-test.xml, -DIGNITE_QUIET=false, -DIGNITE_MARSHAL_BUFFERS_RECHECK=1000, -Dmaven.repo.local=/opt/buildagent/.m2/repository] [21:07:56] : [Step 4/5] [2021-11-19 21:07:56,531][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][IgniteKernal%grid-0] System cache's DataRegion size is configured to 40 MB. Use DataStorageConfiguration.systemRegionInitialSize property to change the setting. [21:07:56] : [Step 4/5] [2021-11-19 21:07:56,531][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][IgniteKernal%grid-0] Configured caches [in 'sysMemPlc' dataRegion: ['ignite-sys-cache'], in 'default' dataRegion: ['encrypted.grid-0']] [21:07:56]W: [org.apache.ignite:ignite-core] [2021-11-19 21:07:56,531][WARN ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][IgniteKernal%grid-0] Peer class loading is enabled (disable it in production for performance and deployment consistency reasons) [21:07:56] : [Step 4/5] [2021-11-19 21:07:56,532][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][IgniteKernal%grid-0] 3-rd party licenses can be found at: /opt/buildagent/work/7bc1c54bc719b67c/libs/licenses [21:07:56] : [Step 4/5] [2021-11-19 21:07:56,535][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][IgnitePluginProcessor] Configured plugins: [21:07:56] : [Step 4/5] [2021-11-19 21:07:56,535][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][IgnitePluginProcessor] ^-- StanByClusterTestProvider 1.0 [21:07:56] : [Step 4/5] [2021-11-19 21:07:56,536][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][IgnitePluginProcessor] ^-- null [21:07:56] : [Step 4/5] [2021-11-19 21:07:56,536][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][IgnitePluginProcessor] [21:07:56] : [Step 4/5] [2021-11-19 21:07:56,536][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][IgnitePluginProcessor] ^-- PageMemory tracker plugin 1.0 [21:07:56] : [Step 4/5] [2021-11-19 21:07:56,536][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][IgnitePluginProcessor] ^-- null [21:07:56] : [Step 4/5] [2021-11-19 21:07:56,537][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][IgnitePluginProcessor] [21:07:56] : [Step 4/5] [2021-11-19 21:07:56,537][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][IgnitePluginProcessor] ^-- TestDistibutedConfigurationPlugin 1.0 [21:07:56] : [Step 4/5] [2021-11-19 21:07:56,537][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][IgnitePluginProcessor] ^-- null [21:07:56] : [Step 4/5] [2021-11-19 21:07:56,537][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][IgnitePluginProcessor] [21:07:56] : [Step 4/5] [2021-11-19 21:07:56,537][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][IgnitePluginProcessor] ^-- NodeValidationPluginProvider 1.0 [21:07:56] : [Step 4/5] [2021-11-19 21:07:56,538][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][IgnitePluginProcessor] ^-- null [21:07:56] : [Step 4/5] [2021-11-19 21:07:56,538][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][IgnitePluginProcessor] [21:07:56] : [Step 4/5] [2021-11-19 21:07:56,538][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][FailureProcessor] Configured failure handler: [hnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]]] [21:07:56] : [Step 4/5] [2021-11-19 21:07:56,557][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][TcpCommunicationSpi] Successfully bound communication NIO server to TCP port [port=45170, locHost=/127.0.0.1, selectorsCnt=12, selectorSpins=0, pairedConn=false] [21:07:56]W: [org.apache.ignite:ignite-core] [2021-11-19 21:07:56,557][WARN ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][TcpCommunicationSpi] Message queue limit is set to 0 which may lead to potential OOMEs when running cache operations in FULL_ASYNC or PRIMARY_SYNC modes due to message queues growth on sender and receiver sides. [21:07:56] : [Step 4/5] [2021-11-19 21:07:56,565][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][GridCollisionManager] Collision resolution is disabled (all jobs will be activated upon arrival). [21:07:56] : [Step 4/5] [2021-11-19 21:07:56,565][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][IgniteKernal%grid-0] Security status [authentication=off, sandbox=off, tls/ssl=off] [21:07:56] : [Step 4/5] [2021-11-19 21:07:56,636][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:07:56] : [Step 4/5] [2021-11-19 21:07:56,725][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][MaintenanceProcessor] Resolved store directory for node persistent data: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0 [21:07:56] : [Step 4/5] [2021-11-19 21:07:56,726][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][CacheObjectBinaryProcessorImpl] Resolved directory for serialized binary metadata: /opt/buildagent/work/7bc1c54bc719b67c/work/db/binary_meta/grid_0 [21:07:56] : [Step 4/5] [2021-11-19 21:07:56,730][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0 [21:07:56] : [Step 4/5] [2021-11-19 21:07:56,731][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][FileWriteAheadLogManager] Resolved write ahead log work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0 [21:07:56] : [Step 4/5] [2021-11-19 21:07:56,731][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][FileWriteAheadLogManager] Resolved write ahead log archive directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0 [21:07:56] : [Step 4/5] [2021-11-19 21:07:56,732][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000005.wal [21:07:56] : [Step 4/5] [2021-11-19 21:07:56,733][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000006.wal [21:07:56] : [Step 4/5] [2021-11-19 21:07:56,733][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000008.wal [21:07:56] : [Step 4/5] [2021-11-19 21:07:56,734][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000004.wal [21:07:56] : [Step 4/5] [2021-11-19 21:07:56,734][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000003.wal [21:07:56] : [Step 4/5] [2021-11-19 21:07:56,735][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000002.wal [21:07:56] : [Step 4/5] [2021-11-19 21:07:56,735][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000007.wal [21:07:56] : [Step 4/5] [2021-11-19 21:07:56,736][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000001.wal [21:07:56] : [Step 4/5] [2021-11-19 21:07:56,736][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000009.wal [21:07:56] : [Step 4/5] [2021-11-19 21:07:56,741][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][GridCacheDatabaseSharedManager] Configured data regions initialized successfully [total=5] [21:07:56] : [Step 4/5] [2021-11-19 21:07:56,750][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][IgniteSnapshotManager] Resolved snapshot work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/snapshots [21:07:56] : [Step 4/5] [2021-11-19 21:07:56,750][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][IgniteSnapshotManager] Resolved temp directory for snapshot creation: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0/snp [21:07:56] : [Step 4/5] [2021-11-19 21:07:56,752][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][ClientListenerProcessor] Client connector processor has started on TCP port 10800 [21:07:56] : [Step 4/5] [2021-11-19 21:07:56,758][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][IgniteKernal%grid-0] Non-loopback local IPs: 172.17.0.4 [21:07:56] : [Step 4/5] [2021-11-19 21:07:56,758][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][IgniteKernal%grid-0] Enabled local MACs: 0242AC110004 [21:07:56] : [Step 4/5] [2021-11-19 21:07:56,760][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=/opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0/cp/1637345275936-8ad74969-2b82-4b24-b7e6-a2e5e9d391bd-START.bin, endMarker=/opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0/cp/1637345268340-a5510ec1-55a0-480b-992d-d9be69bf4ab9-END.bin] [21:07:56] : [Step 4/5] [2021-11-19 21:07:56,762][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:07:56] : [Step 4/5] [2021-11-19 21:07:56,762][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=243914, len=21051], lastMarked=WALPointer [idx=0, fileOff=859846, len=21035], lastCheckpointId=8ad74969-2b82-4b24-b7e6-a2e5e9d391bd] [21:07:56] : [Step 4/5] [2021-11-19 21:07:56,883][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][GridCacheDatabaseSharedManager] Found last checkpoint marker [cpId=8ad74969-2b82-4b24-b7e6-a2e5e9d391bd, pos=WALPointer [idx=0, fileOff=859846, len=21035]] [21:07:56] : [Step 4/5] [2021-11-19 21:07:56,889][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][GridCacheDatabaseSharedManager] Applying lost metastore updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=859846, len=21035], lastCheckpointId=8ad74969-2b82-4b24-b7e6-a2e5e9d391bd] [21:07:56] : [Step 4/5] [2021-11-19 21:07:56,956][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=71 ms] [21:07:56] : [Step 4/5] [2021-11-19 21:07:56,956][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][GridCacheProcessor] Restoring partition state for local groups. [21:07:56] : [Step 4/5] [2021-11-19 21:07:56,957][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=0, partitionsProcessed=0, time=0ms] [21:07:57] : [Step 4/5] [2021-11-19 21:07:57,109][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][GridClusterStateProcessor] Restoring history for BaselineTopology[id=0] [21:07:57]W: [org.apache.ignite:ignite-core] [2021-11-19 21:07:57,116][WARN ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][GridLocalConfigManager] Static configuration for the following caches will be ignored because a persistent cache with the same name already exist (see https://apacheignite.readme.io/docs/cache-configuration for more information): [encrypted.grid-0] [21:07:57] : [Step 4/5] [2021-11-19 21:07:57,121][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][ClusterProcessor] Cluster ID and tag has been read from metastorage: ClusterIdAndTag [id=dfd867ac-310a-4a38-817b-39c28d352019, tag=vigilant_khayyam] [21:07:57] : [Step 4/5] [2021-11-19 21:07:57,121][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][IgniteClusterImpl] Shutdown policy was updated [oldVal=null, newVal=null] [21:07:57] : [Step 4/5] [2021-11-19 21:07:57,122][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustEnabled' was changed from 'null' to 'false' [21:07:57] : [Step 4/5] [2021-11-19 21:07:57,122][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustTimeout' was changed from 'null' to '300000' [21:07:57] : [Step 4/5] [2021-11-19 21:07:57,122][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][IgniteTxManager] Transactions parameter 'txOwnerDumpRequestsAllowed' was changed from 'null' to 'true' [21:07:57] : [Step 4/5] [2021-11-19 21:07:57,123][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][IgniteTxManager] Transactions parameter 'longOperationsDumpTimeout' was changed from 'null' to '60000' [21:07:57] : [Step 4/5] [2021-11-19 21:07:57,123][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpThreshold' was changed from 'null' to '0' [21:07:57] : [Step 4/5] [2021-11-19 21:07:57,124][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][IgniteTxManager] Transactions parameter 'transactionTimeDumpSamplesCoefficient' was changed from 'null' to '0.0' [21:07:57] : [Step 4/5] [2021-11-19 21:07:57,125][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpSamplesPerSecondLimit' was changed from 'null' to '5' [21:07:57] : [Step 4/5] [2021-11-19 21:07:57,125][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][IgniteTxManager] Transactions parameter 'collisionsDumpInterval' was changed from 'null' to '1000' [21:07:57] : [Step 4/5] [2021-11-19 21:07:57,125][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][GridCacheDatabaseSharedManager] Historical rebalance WAL threshold changed [property=historical.rebalance.threshold, oldVal=null, newVal=500] [21:07:57] : [Step 4/5] [2021-11-19 21:07:57,126][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][GridCacheDatabaseSharedManager] Checkpoint frequency deviation changed [oldVal=null, newVal=null] [21:07:57] : [Step 4/5] [2021-11-19 21:07:57,127][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][FilePageStoreManager] Cleanup cache stores [total=1, left=0, cleanFiles=false] [21:07:57] : [Step 4/5] [2021-11-19 21:07:57,129][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:07:57] : [Step 4/5] [2021-11-19 21:07:57,130][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:07:57] : [Step 4/5] [2021-11-19 21:07:57,131][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:07:57] : [Step 4/5] [2021-11-19 21:07:57,131][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][GridCacheDatabaseSharedManager] Data Regions Started: 5 [21:07:57] : [Step 4/5] [2021-11-19 21:07:57,132][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][GridCacheDatabaseSharedManager] ^-- sysMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:07:57] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:07:57] : [Step 4/5] ^-- default region [type=default, persistence=true, lazyAlloc=true, [21:07:57] : [Step 4/5] ... initCfg=10MB, maxCfg=10MB, usedRam=0MB, freeRam=100%, allocRam=0MB, allocTotal=0MB] [21:07:57] : [Step 4/5] ^-- metastoreMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:07:57] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:07:57] : [Step 4/5] ^-- TxLog region [type=internal, persistence=true, lazyAlloc=false, [21:07:57] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:07:57] : [Step 4/5] ^-- volatileDsMemPlc region [type=user, persistence=false, lazyAlloc=true, [21:07:57] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB] [21:07:57] : [Step 4/5] ^-- Ignite persistence [used=0MB] [21:07:57] : [Step 4/5] [21:07:57] : [Step 4/5] [2021-11-19 21:07:57,133][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][GridCacheDatabaseSharedManager] Starting binary memory restore for: [-2100569601, -322076972, -322076973] [21:07:57] : [Step 4/5] [2021-11-19 21:07:57,266][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=/opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0/cp/1637345275936-8ad74969-2b82-4b24-b7e6-a2e5e9d391bd-START.bin, endMarker=/opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0/cp/1637345268340-a5510ec1-55a0-480b-992d-d9be69bf4ab9-END.bin] [21:07:57] : [Step 4/5] [2021-11-19 21:07:57,267][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=243914, len=21051], lastMarked=WALPointer [idx=0, fileOff=859846, len=21035], lastCheckpointId=8ad74969-2b82-4b24-b7e6-a2e5e9d391bd] [21:07:57]W: [org.apache.ignite:ignite-core] [2021-11-19 21:07:57,326][WARN ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][GridCacheDatabaseSharedManager] Ignite node stopped in the middle of checkpoint. Will restore memory state and finish checkpoint on node start. [21:07:57] : [Step 4/5] [2021-11-19 21:07:57,327][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][PageMemoryImpl] Started page memory [memoryAllocated=24.0 MiB, pages=5952, tableSize=474.2 KiB, replacementSize=768 B, checkpointBuffer=10.0 MiB] [21:07:57] : [Step 4/5] [2021-11-19 21:07:57,406][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][GridCacheDatabaseSharedManager] Found last checkpoint marker [cpId=8ad74969-2b82-4b24-b7e6-a2e5e9d391bd, pos=WALPointer [idx=0, fileOff=859846, len=21035]] [21:07:57] : [Step 4/5] [2021-11-19 21:07:57,410][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][GridCacheDatabaseSharedManager] Finished applying memory changes [changesApplied=1084, time=80 ms] [21:07:57] : [Step 4/5] [2021-11-19 21:07:57,971][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][CheckpointWorkflow] Checkpoint finished [cpId=8ad74969-2b82-4b24-b7e6-a2e5e9d391bd, pages=570, markPos=WALPointer [idx=0, fileOff=859846, len=21035], pagesWrite=20ms, fsync=525ms, total=545ms] [21:07:57] : [Step 4/5] [2021-11-19 21:07:57,973][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][GridCacheDatabaseSharedManager] Binary memory state restored at node startup [restoredPtr=WALPointer [idx=0, fileOff=880881, len=0]] [21:07:57] : [Step 4/5] [2021-11-19 21:07:57,974][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000000.wal, offset=880881, ver=2] [21:07:57] : [Step 4/5] [2021-11-19 21:07:57,977][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][GridCacheProcessor] Started cache in recovery mode [name=ignite-sys-cache, id=-2100569601, dataRegionName=sysMemPlc, mode=REPLICATED, atomicity=TRANSACTIONAL, backups=2147483647, mvcc=false] [21:07:57] : [Step 4/5] [2021-11-19 21:07:57,981][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][GridCacheProcessor] Started cache in recovery mode [name=encrypted.grid-1, id=-322076972, dataRegionName=default, mode=PARTITIONED, atomicity=ATOMIC, backups=0, mvcc=false] [21:07:57] : [Step 4/5] [2021-11-19 21:07:57,984][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][GridCacheProcessor] Started cache in recovery mode [name=encrypted.grid-0, id=-322076973, dataRegionName=default, mode=PARTITIONED, atomicity=ATOMIC, backups=0, mvcc=false] [21:07:57] : [Step 4/5] [2021-11-19 21:07:57,985][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][GridCacheDatabaseSharedManager] Binary recovery performed in 852 ms. [21:07:57] : [Step 4/5] [2021-11-19 21:07:57,985][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=/opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0/cp/1637345275936-8ad74969-2b82-4b24-b7e6-a2e5e9d391bd-START.bin, endMarker=/opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0/cp/1637345275936-8ad74969-2b82-4b24-b7e6-a2e5e9d391bd-END.bin] [21:07:57] : [Step 4/5] [2021-11-19 21:07:57,986][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][GridCacheDatabaseSharedManager] Applying lost cache updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=859846, len=21035], lastCheckpointId=8ad74969-2b82-4b24-b7e6-a2e5e9d391bd] [21:07:58] : [Step 4/5] [2021-11-19 21:07:58,048][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=61 ms] [21:07:58] : [Step 4/5] [2021-11-19 21:07:58,048][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][GridCacheProcessor] Restoring partition state for local groups. [21:07:58] : [Step 4/5] [2021-11-19 21:07:58,169][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=3, partitionsProcessed=2148, time=119ms] [21:07:58] : [Step 4/5] [2021-11-19 21:07:58,171][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][TestTcpDiscoverySpi] Successfully bound to TCP port [port=47500, localHost=localhost/127.0.0.1, locNodeId=00d146be-a209-4645-889f-3df8c43ef000] [21:07:58] : [Step 4/5] [2021-11-19 21:07:58,175][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][GridEncryptionManager] Sending stored group keys to coordinator [grps=-322076972,-322076973] [21:07:58] : [Step 4/5] [2021-11-19 21:07:58,183][INFO ][disco-notifier-worker-#15349%grid-0%][MvccProcessorImpl] Assigned mvcc coordinator [crd=MvccCoordinator [topVer=AffinityTopologyVersion [topVer=1, minorTopVer=0], nodeId=00d146be-a209-4645-889f-3df8c43ef000, ver=1637345278176, local=true, initialized=false]] [21:07:58] : [Step 4/5] [2021-11-19 21:07:58,185][INFO ][sys-#15344%grid-0%][ClusterProcessor] Writing cluster ID and tag to metastorage on ready for write ClusterIdAndTag [id=dfd867ac-310a-4a38-817b-39c28d352019, tag=vigilant_khayyam] [21:07:58] : [Step 4/5] [2021-11-19 21:07:58,197][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][IgniteKernal%grid-0] To start Console Management & Monitoring run ignitevisorcmd.{sh|bat} [21:07:58] : [Step 4/5] [2021-11-19 21:07:58,198][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][IgniteKernal%grid-0] [21:07:58] : [Step 4/5] [21:07:58] : [Step 4/5] >>> +-------------------------------------------+ [21:07:58] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:07:58] : [Step 4/5] >>> +-------------------------------------------+ [21:07:58] : [Step 4/5] >>> OS name: Linux 4.15.0-151-generic amd64 [21:07:58] : [Step 4/5] >>> CPU(s): 24 [21:07:58] : [Step 4/5] >>> Heap: 2.0GB [21:07:58] : [Step 4/5] >>> VM name: 16724@c4dfe9a430b2 [21:07:58] : [Step 4/5] >>> Ignite instance name: grid-0 [21:07:58] : [Step 4/5] >>> Local node [ID=00D146BE-A209-4645-889F-3DF8C43EF000, order=1, clientMode=false] [21:07:58] : [Step 4/5] >>> Local node addresses: [127.0.0.1] [21:07:58] : [Step 4/5] >>> Local ports: TCP:10800 TCP:45170 TCP:47500 [21:07:58] : [Step 4/5] [21:07:58] : [Step 4/5] [2021-11-19 21:07:58,199][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][IgniteKernal%grid-0] >>> Ignite cluster is in INACTIVE state (limited functionality available). Use control.(sh|bat) script or IgniteCluster.state(ClusterState.ACTIVE) to change the state. [21:07:58] : [Step 4/5] [2021-11-19 21:07:58,199][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][GridDiscoveryManager] Topology snapshot [ver=1, locNode=00d146be, servers=1, clients=0, state=INACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=00d146be-a209-4645-889f-3df8c43ef000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:07:58] : [Step 4/5] [2021-11-19 21:07:58,200][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][GridDiscoveryManager] ^-- Baseline [id=0, size=2, online=1, offline=1] [21:07:58] : [Step 4/5] [2021-11-19 21:07:58,200][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][GridDiscoveryManager] ^-- 1 nodes left for auto-activation [grid-1] [21:07:58] : [Step 4/5] [2021-11-19 21:07:58,201][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][G] Node started : [stage="Configure system pool" (0 ms),stage="Start managers" (210 ms),stage="Configure binary metadata" (2 ms),stage="Start processors" (29 ms),stage="Start 'StanByClusterTestProvider' plugin" (0 ms),stage="Start 'PageMemory tracker plugin' plugin" (0 ms),stage="Start 'TestDistibutedConfigurationPlugin' plugin" (0 ms),stage="Start 'NodeValidationPluginProvider' plugin" (0 ms),stage="Init metastore" (369 ms),stage="Init and start regions" (6 ms),stage="Restore binary memory" (851 ms),stage="Restore logical state" (184 ms),stage="Finish recovery" (0 ms),stage="Join topology" (13 ms),stage="Await transition" (2 ms),stage="Await exchange" (14 ms),stage="Total time" (1680 ms)] [21:07:58] : [Step 4/5] [2021-11-19 21:07:58,202][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][root] Node started with the following configuration [id=00d146be-a209-4645-889f-3df8c43ef000, marshaller=BinaryMarshaller [], discovery=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=5000, ackTimeout=5000, marsh=JdkMarshaller [clsFilter=org.apache.ignite.marshaller.MarshallerUtils$1@b13ec99], reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], binaryCfg=null, lateAff=true] [21:07:58]W: [org.apache.ignite:ignite-core] [2021-11-19 21:07:58,208][WARN ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][G] Ignite work directory is not provided, automatically resolved to: /opt/buildagent/work/7bc1c54bc719b67c/work [21:07:58] : [Step 4/5] [2021-11-19 21:07:58,209][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][IgniteKernal%grid-1] [21:07:58] : [Step 4/5] [21:07:58] : [Step 4/5] >>> __________ ________________ [21:07:58] : [Step 4/5] >>> / _/ ___/ |/ / _/_ __/ __/ [21:07:58] : [Step 4/5] >>> _/ // (7 7 // / / / / _/ [21:07:58] : [Step 4/5] >>> /___/\___/_/|_/___/ /_/ /___/ [21:07:58] : [Step 4/5] >>> [21:07:58] : [Step 4/5] >>> ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:07:58] : [Step 4/5] >>> 2021 Copyright(C) Apache Software Foundation [21:07:58] : [Step 4/5] >>> [21:07:58] : [Step 4/5] >>> Ignite documentation: http://ignite.apache.org [21:07:58] : [Step 4/5] [21:07:58] : [Step 4/5] [2021-11-19 21:07:58,209][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][IgniteKernal%grid-1] Config URL: n/a [21:07:58] : [Step 4/5] [2021-11-19 21:07:58,210][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][IgniteKernal%grid-1] IgniteConfiguration [igniteInstanceName=grid-1, pubPoolSize=24, svcPoolSize=24, callbackPoolSize=24, stripedPoolSize=24, sysPoolSize=24, mgmtPoolSize=4, dataStreamerPoolSize=24, utilityCachePoolSize=24, utilityCacheKeepAliveTime=60000, p2pPoolSize=2, qryPoolSize=24, buildIdxPoolSize=4, igniteHome=/opt/buildagent/work/7bc1c54bc719b67c, igniteWorkDir=/opt/buildagent/work/7bc1c54bc719b67c/work, mbeanSrv=com.sun.jmx.mbeanserver.JmxMBeanServer@6fe85038, nodeId=102b5b7d-22c8-4475-b7a7-caa19c6c1001, marsh=BinaryMarshaller [], marshLocJobs=false, daemon=false, p2pEnabled=true, netTimeout=10000, netCompressionLevel=1, sndRetryDelay=1000, sndRetryCnt=3, metricsHistSize=10000, metricsUpdateFreq=1000, metricsExpTime=9223372036854775807, discoSpi=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=0, ackTimeout=0, marsh=null, reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], segPlc=STOP, segResolveAttempts=2, waitForSegOnStart=true, allResolversPassReq=true, segChkFreq=10000, commSpi=TcpCommunicationSpi [connectGate=org.apache.ignite.spi.communication.tcp.internal.ConnectGateway@77bb33d0, ctxInitLatch=java.util.concurrent.CountDownLatch@772d703f[Count = 1], stopping=false, clientPool=null, nioSrvWrapper=null, stateProvider=null], evtSpi=MemoryEventStorageSpi [expireAgeMs=9223372036854775807, expireCnt=10000, filter=null], colSpi=NoopCollisionSpi [], deploySpi=LocalDeploymentSpi [], indexingSpi=org.apache.ignite.spi.indexing.noop.NoopIndexingSpi@5203891c, addrRslvr=null, encryptionSpi=org.apache.ignite.spi.encryption.keystore.KeystoreEncryptionSpi@443a8487, tracingSpi=org.apache.ignite.spi.tracing.NoopTracingSpi@6553b2ff, clientMode=false, rebalanceThreadPoolSize=4, rebalanceTimeout=10000, rebalanceBatchesPrefetchCnt=3, rebalanceThrottle=0, rebalanceBatchSize=524288, txCfg=TransactionConfiguration [txSerEnabled=false, dfltIsolation=REPEATABLE_READ, dfltConcurrency=PESSIMISTIC, dfltTxTimeout=0, txTimeoutOnPartitionMapExchange=0, deadlockTimeout=10000, pessimisticTxLogSize=0, pessimisticTxLogLinger=10000, tmLookupClsName=null, txManagerFactory=null, useJtaSync=false], cacheSanityCheckEnabled=true, discoStartupDelay=60000, deployMode=SHARED, p2pMissedCacheSize=100, locHost=127.0.0.1, timeSrvPortBase=31100, timeSrvPortRange=100, failureDetectionTimeout=10000, sysWorkerBlockedTimeout=null, clientFailureDetectionTimeout=10000, metricsLogFreq=0, connectorCfg=null, odbcCfg=null, warmupClos=null, atomicCfg=AtomicConfiguration [seqReserveSize=1000, cacheMode=PARTITIONED, backups=1, aff=null, grpName=null], classLdr=null, sslCtxFactory=null, platformCfg=null, binaryCfg=null, memCfg=null, pstCfg=null, dsCfg=DataStorageConfiguration [sysRegionInitSize=41943040, sysRegionMaxSize=104857600, pageSize=4096, concLvl=0, dfltDataRegConf=DataRegionConfiguration [name=default, maxSize=10485760, initSize=268435456, swapPath=null, pageEvictionMode=DISABLED, pageReplacementMode=CLOCK, evictionThreshold=0.9, emptyPagesPoolSize=100, metricsEnabled=false, metricsSubIntervalCount=5, metricsRateTimeInterval=60000, persistenceEnabled=true, checkpointPageBufSize=0, lazyMemoryAllocation=true, warmUpCfg=null], dataRegions=null, storagePath=null, checkpointFreq=180000, lockWaitTime=10000, checkpointThreads=4, checkpointWriteOrder=SEQUENTIAL, walHistSize=20, maxWalArchiveSize=1073741824, walSegments=10, walSegmentSize=67108864, walPath=db/wal, walArchivePath=db/wal/archive, cdcWalPath=db/wal/cdc, cdcEnabled=false, metricsEnabled=false, walMode=FSYNC, walTlbSize=131072, walBuffSize=0, walFlushFreq=2000, walFsyncDelay=1000, walRecordIterBuffSize=67108864, alwaysWriteFullPages=false, fileIOFactory=org.apache.ignite.internal.processors.cache.persistence.file.AsyncFileIOFactory@4413a7fc, metricsSubIntervalCnt=5, metricsRateTimeInterval=60000, walAutoArchiveAfterInactivity=-1, walForceArchiveTimeout=-1, writeThrottlingEnabled=false, walCompactionEnabled=false, walCompactionLevel=1, checkpointReadLockTimeout=null, walPageCompression=DISABLED, walPageCompressionLevel=null, dfltWarmUpCfg=null, encCfg=org.apache.ignite.configuration.EncryptionConfiguration@6bdd562a, defragmentationThreadPoolSize=4, minWalArchiveSize=-1], snapshotPath=snapshots, activeOnStart=true, activeOnStartPropSetFlag=false, autoActivation=true, autoActivationPropSetFlag=false, clusterStateOnStart=null, sqlConnCfg=null, cliConnCfg=ClientConnectorConfiguration [host=null, port=10800, portRange=100, sockSndBufSize=0, sockRcvBufSize=0, tcpNoDelay=true, maxOpenCursorsPerConn=128, threadPoolSize=24, selectorCnt=12, idleTimeout=0, handshakeTimeout=10000, jdbcEnabled=true, odbcEnabled=true, thinCliEnabled=true, sslEnabled=false, useIgniteSslCtxFactory=true, sslClientAuth=false, sslCtxFactory=null, thinCliCfg=ThinClientConfiguration [maxActiveTxPerConn=100, maxActiveComputeTasksPerConn=0]], mvccVacuumThreadCnt=2, mvccVacuumFreq=5000, authEnabled=false, failureHnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]], commFailureRslvr=null, sqlCfg=SqlConfiguration [longQryWarnTimeout=3000, dfltQryTimeout=0, sqlQryHistSize=1000, validationEnabled=false], asyncContinuationExecutor=null] [21:07:58] : [Step 4/5] [2021-11-19 21:07:58,219][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][IgniteKernal%grid-1] Daemon mode: off [21:07:58] : [Step 4/5] [2021-11-19 21:07:58,219][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][IgniteKernal%grid-1] OS: Linux 4.15.0-151-generic amd64 [21:07:58] : [Step 4/5] [2021-11-19 21:07:58,219][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][IgniteKernal%grid-1] OS user: teamcity [21:07:58] : [Step 4/5] [2021-11-19 21:07:58,220][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][IgniteKernal%grid-1] PID: 16724 [21:07:58] : [Step 4/5] [2021-11-19 21:07:58,220][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][IgniteKernal%grid-1] Language runtime: Java Platform API Specification ver. 1.8 [21:07:58] : [Step 4/5] [2021-11-19 21:07:58,220][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][IgniteKernal%grid-1] VM information: Java(TM) SE Runtime Environment 1.8.0_261-b12 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 25.261-b12 [21:07:58] : [Step 4/5] [2021-11-19 21:07:58,221][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][IgniteKernal%grid-1] VM total memory: 1.9GB [21:07:58] : [Step 4/5] [2021-11-19 21:07:58,221][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][IgniteKernal%grid-1] Remote Management [restart: off, REST: off, JMX (remote: off)] [21:07:58] : [Step 4/5] [2021-11-19 21:07:58,222][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][IgniteKernal%grid-1] Logger: GridTestLog4jLogger [quiet=false, config=null] [21:07:58] : [Step 4/5] [2021-11-19 21:07:58,222][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][IgniteKernal%grid-1] IGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c [21:07:58] : [Step 4/5] [2021-11-19 21:07:58,222][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][IgniteKernal%grid-1] VM arguments: [-DIGNITE_DUMP_THREADS_ON_FAILURE=false, -DMono=/usr/bin/mono-sgen, -DMono4.0_x64=/usr/lib/mono/4.0, -DMono4.5_x64=/usr/lib/mono/4.5, -DMonoVersion=6.12.0.90, -DSKIP_BUILD=false, -Dagent.home.dir=/opt/buildagent, -Dagent.name=aitc-lin02_03, -Dagent.ownPort=9090, -Dagent.work.dir=/opt/buildagent/work, -Dbuild.number=95, -Dbuild.vcs.number=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.1=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.GitHubApacheIgnite=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dclassworlds.conf=/opt/buildagent/temp/buildTmp/teamcity.m2.conf, -Dcom.jetbrains.maven.watcher.report.file=/opt/buildagent/temp/buildTmp/maven-build-info.xml, -Djava.io.tmpdir=/opt/buildagent/temp/buildTmp, -Dmaven.home=/opt/buildagent/tools/maven3_6, -Dmaven.multiModuleProjectDirectory=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.agent.cpuBenchmark=457, -Dteamcity.agent.dotnet.agent_url=http://localhost:9090/RPC2, -Dteamcity.agent.dotnet.build_id=6278078, -Dteamcity.auth.password=*******, -Dteamcity.auth.userId=TeamCityBuildId=6278078, -Dteamcity.build.changedFiles.file=/opt/buildagent/temp/buildTmp/changedFiles6342607772318147725.txt, -Dteamcity.build.checkoutDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.build.id=6278078, -Dteamcity.build.properties.file=/opt/buildagent/temp/buildTmp/teamcity.build5164517880467851002.properties, -Dteamcity.build.tempDir=/opt/buildagent/temp/buildTmp, -Dteamcity.build.workingDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.buildConfName=Basic 3, -Dteamcity.buildType.id=IgniteTests24Java8_Basic3, -Dteamcity.configuration.properties.file=/opt/buildagent/temp/buildTmp/teamcity.config5591980786735343870.properties, -Dteamcity.maven.userSettings.path=/opt/buildagent/temp/buildTmp/maven_settings_585072866407032347.xml, -Dteamcity.maven.watcher.home=/opt/buildagent/plugins/mavenPlugin/maven-watcher-jdk16, -Dteamcity.projectName=Ignite Tests 2.x (JDK 8/11), -Dteamcity.runner.properties.file=/opt/buildagent/temp/buildTmp/teamcity.runner9098465561618137420.properties, -Dteamcity.tests.recentlyFailedTests.file=/opt/buildagent/temp/buildTmp/testsToRunFirst3891775683130404069.txt, -Dteamcity.version=2021.2 (build 99542), -ea, -Xms2g, -Xmx2g, -XX:+HeapDumpOnOutOfMemoryError, -DIGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_TEST_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_UPDATE_NOTIFIER=false, -DIGNITE_NO_DISCO_ORDER=true, -DIGNITE_PERFORMANCE_SUGGESTIONS_DISABLED=true, -Djava.net.preferIPv4Stack=true, -DTEST_SCALE_FACTOR=1.0, -DIGNITE_TEST_PROP_LOG4J_FILE=log4j-tc-test.xml, -DIGNITE_QUIET=false, -DIGNITE_MARSHAL_BUFFERS_RECHECK=1000, -Dmaven.repo.local=/opt/buildagent/.m2/repository] [21:07:58] : [Step 4/5] [2021-11-19 21:07:58,228][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][IgniteKernal%grid-1] System cache's DataRegion size is configured to 40 MB. Use DataStorageConfiguration.systemRegionInitialSize property to change the setting. [21:07:58] : [Step 4/5] [2021-11-19 21:07:58,229][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][IgniteKernal%grid-1] Configured caches [in 'sysMemPlc' dataRegion: ['ignite-sys-cache'], in 'default' dataRegion: ['encrypted.grid-1']] [21:07:58] : [Step 4/5] [2021-11-19 21:07:58,230][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][IgniteKernal%grid-1] 3-rd party licenses can be found at: /opt/buildagent/work/7bc1c54bc719b67c/libs/licenses [21:07:58]W: [org.apache.ignite:ignite-core] [2021-11-19 21:07:58,229][WARN ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][IgniteKernal%grid-1] Peer class loading is enabled (disable it in production for performance and deployment consistency reasons) [21:07:58] : [Step 4/5] [2021-11-19 21:07:58,236][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][IgnitePluginProcessor] Configured plugins: [21:07:58] : [Step 4/5] [2021-11-19 21:07:58,236][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][IgnitePluginProcessor] ^-- StanByClusterTestProvider 1.0 [21:07:58] : [Step 4/5] [2021-11-19 21:07:58,236][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][IgnitePluginProcessor] ^-- null [21:07:58] : [Step 4/5] [2021-11-19 21:07:58,237][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][IgnitePluginProcessor] [21:07:58] : [Step 4/5] [2021-11-19 21:07:58,237][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][IgnitePluginProcessor] ^-- PageMemory tracker plugin 1.0 [21:07:58] : [Step 4/5] [2021-11-19 21:07:58,237][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][IgnitePluginProcessor] ^-- null [21:07:58] : [Step 4/5] [2021-11-19 21:07:58,238][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][IgnitePluginProcessor] [21:07:58] : [Step 4/5] [2021-11-19 21:07:58,238][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][IgnitePluginProcessor] ^-- TestDistibutedConfigurationPlugin 1.0 [21:07:58] : [Step 4/5] [2021-11-19 21:07:58,238][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][IgnitePluginProcessor] ^-- null [21:07:58] : [Step 4/5] [2021-11-19 21:07:58,239][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][IgnitePluginProcessor] [21:07:58] : [Step 4/5] [2021-11-19 21:07:58,239][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][IgnitePluginProcessor] ^-- NodeValidationPluginProvider 1.0 [21:07:58] : [Step 4/5] [2021-11-19 21:07:58,239][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][IgnitePluginProcessor] ^-- null [21:07:58] : [Step 4/5] [2021-11-19 21:07:58,239][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][IgnitePluginProcessor] [21:07:58] : [Step 4/5] [2021-11-19 21:07:58,240][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][FailureProcessor] Configured failure handler: [hnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]]] [21:07:58]W: [org.apache.ignite:ignite-core] [2021-11-19 21:07:58,258][WARN ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][TcpCommunicationSpi] Message queue limit is set to 0 which may lead to potential OOMEs when running cache operations in FULL_ASYNC or PRIMARY_SYNC modes due to message queues growth on sender and receiver sides. [21:07:58] : [Step 4/5] [2021-11-19 21:07:58,258][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][TcpCommunicationSpi] Successfully bound communication NIO server to TCP port [port=45171, locHost=/127.0.0.1, selectorsCnt=12, selectorSpins=0, pairedConn=false] [21:07:58] : [Step 4/5] [2021-11-19 21:07:58,262][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][GridCollisionManager] Collision resolution is disabled (all jobs will be activated upon arrival). [21:07:58] : [Step 4/5] [2021-11-19 21:07:58,262][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][IgniteKernal%grid-1] Security status [authentication=off, sandbox=off, tls/ssl=off] [21:07:58] : [Step 4/5] [2021-11-19 21:07:58,325][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:07:58] : [Step 4/5] [2021-11-19 21:07:58,412][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][MaintenanceProcessor] Resolved store directory for node persistent data: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1 [21:07:58] : [Step 4/5] [2021-11-19 21:07:58,413][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][CacheObjectBinaryProcessorImpl] Resolved directory for serialized binary metadata: /opt/buildagent/work/7bc1c54bc719b67c/work/db/binary_meta/grid_1 [21:07:58] : [Step 4/5] [2021-11-19 21:07:58,420][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1 [21:07:58] : [Step 4/5] [2021-11-19 21:07:58,421][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][FileWriteAheadLogManager] Resolved write ahead log work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1 [21:07:58] : [Step 4/5] [2021-11-19 21:07:58,421][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][FileWriteAheadLogManager] Resolved write ahead log archive directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1 [21:07:58] : [Step 4/5] [2021-11-19 21:07:58,423][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000005.wal [21:07:58] : [Step 4/5] [2021-11-19 21:07:58,423][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000006.wal [21:07:58] : [Step 4/5] [2021-11-19 21:07:58,424][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000008.wal [21:07:58] : [Step 4/5] [2021-11-19 21:07:58,424][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000004.wal [21:07:58] : [Step 4/5] [2021-11-19 21:07:58,425][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000003.wal [21:07:58] : [Step 4/5] [2021-11-19 21:07:58,425][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000002.wal [21:07:58] : [Step 4/5] [2021-11-19 21:07:58,426][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000007.wal [21:07:58] : [Step 4/5] [2021-11-19 21:07:58,426][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000001.wal [21:07:58] : [Step 4/5] [2021-11-19 21:07:58,427][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000009.wal [21:07:58] : [Step 4/5] [2021-11-19 21:07:58,431][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][GridCacheDatabaseSharedManager] Configured data regions initialized successfully [total=5] [21:07:58] : [Step 4/5] [2021-11-19 21:07:58,432][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][IgniteSnapshotManager] Resolved snapshot work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/snapshots [21:07:58] : [Step 4/5] [2021-11-19 21:07:58,432][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][IgniteSnapshotManager] Resolved temp directory for snapshot creation: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1/snp [21:07:58] : [Step 4/5] [2021-11-19 21:07:58,435][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][ClientListenerProcessor] Client connector processor has started on TCP port 10801 [21:07:58] : [Step 4/5] [2021-11-19 21:07:58,437][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][IgniteKernal%grid-1] Non-loopback local IPs: 172.17.0.4 [21:07:58] : [Step 4/5] [2021-11-19 21:07:58,437][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][IgniteKernal%grid-1] Enabled local MACs: 0242AC110004 [21:07:58] : [Step 4/5] [2021-11-19 21:07:58,438][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=/opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1/cp/1637345274881-cdc4cfdb-d1fc-4d08-bf56-11ad6447c323-START.bin, endMarker=/opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1/cp/1637345268341-d6d33319-1bc0-4364-8054-36f69db017bc-END.bin] [21:07:58] : [Step 4/5] [2021-11-19 21:07:58,439][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:07:58] : [Step 4/5] [2021-11-19 21:07:58,439][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=250234, len=21811], lastMarked=WALPointer [idx=0, fileOff=748319, len=21795], lastCheckpointId=cdc4cfdb-d1fc-4d08-bf56-11ad6447c323] [21:07:58] : [Step 4/5] [2021-11-19 21:07:58,545][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][GridCacheDatabaseSharedManager] Found last checkpoint marker [cpId=cdc4cfdb-d1fc-4d08-bf56-11ad6447c323, pos=WALPointer [idx=0, fileOff=748319, len=21795]] [21:07:58] : [Step 4/5] [2021-11-19 21:07:58,551][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][GridCacheDatabaseSharedManager] Applying lost metastore updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=748319, len=21795], lastCheckpointId=cdc4cfdb-d1fc-4d08-bf56-11ad6447c323] [21:07:58] : [Step 4/5] [2021-11-19 21:07:58,604][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=61 ms] [21:07:58] : [Step 4/5] [2021-11-19 21:07:58,604][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][GridCacheProcessor] Restoring partition state for local groups. [21:07:58] : [Step 4/5] [2021-11-19 21:07:58,604][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=0, partitionsProcessed=0, time=0ms] [21:07:58] : [Step 4/5] [2021-11-19 21:07:58,719][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][GridClusterStateProcessor] Restoring history for BaselineTopology[id=0] [21:07:58]W: [org.apache.ignite:ignite-core] [2021-11-19 21:07:58,721][WARN ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][GridLocalConfigManager] Static configuration for the following caches will be ignored because a persistent cache with the same name already exist (see https://apacheignite.readme.io/docs/cache-configuration for more information): [encrypted.grid-1] [21:07:58] : [Step 4/5] [2021-11-19 21:07:58,722][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][ClusterProcessor] Cluster ID and tag has been read from metastorage: ClusterIdAndTag [id=dfd867ac-310a-4a38-817b-39c28d352019, tag=vigilant_khayyam] [21:07:58] : [Step 4/5] [2021-11-19 21:07:58,722][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][IgniteClusterImpl] Shutdown policy was updated [oldVal=null, newVal=null] [21:07:58] : [Step 4/5] [2021-11-19 21:07:58,722][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustEnabled' was changed from 'null' to 'false' [21:07:58] : [Step 4/5] [2021-11-19 21:07:58,723][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustTimeout' was changed from 'null' to '300000' [21:07:58] : [Step 4/5] [2021-11-19 21:07:58,723][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][IgniteTxManager] Transactions parameter 'txOwnerDumpRequestsAllowed' was changed from 'null' to 'true' [21:07:58] : [Step 4/5] [2021-11-19 21:07:58,723][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][IgniteTxManager] Transactions parameter 'longOperationsDumpTimeout' was changed from 'null' to '60000' [21:07:58] : [Step 4/5] [2021-11-19 21:07:58,724][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpThreshold' was changed from 'null' to '0' [21:07:58] : [Step 4/5] [2021-11-19 21:07:58,724][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][IgniteTxManager] Transactions parameter 'transactionTimeDumpSamplesCoefficient' was changed from 'null' to '0.0' [21:07:58] : [Step 4/5] [2021-11-19 21:07:58,724][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpSamplesPerSecondLimit' was changed from 'null' to '5' [21:07:58] : [Step 4/5] [2021-11-19 21:07:58,725][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][IgniteTxManager] Transactions parameter 'collisionsDumpInterval' was changed from 'null' to '1000' [21:07:58] : [Step 4/5] [2021-11-19 21:07:58,725][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][GridCacheDatabaseSharedManager] Historical rebalance WAL threshold changed [property=historical.rebalance.threshold, oldVal=null, newVal=500] [21:07:58] : [Step 4/5] [2021-11-19 21:07:58,725][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][GridCacheDatabaseSharedManager] Checkpoint frequency deviation changed [oldVal=null, newVal=null] [21:07:58] : [Step 4/5] [2021-11-19 21:07:58,726][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][FilePageStoreManager] Cleanup cache stores [total=1, left=0, cleanFiles=false] [21:07:58] : [Step 4/5] [2021-11-19 21:07:58,729][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:07:58] : [Step 4/5] [2021-11-19 21:07:58,730][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:07:58] : [Step 4/5] [2021-11-19 21:07:58,731][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:07:58] : [Step 4/5] [2021-11-19 21:07:58,732][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][GridCacheDatabaseSharedManager] Data Regions Started: 5 [21:07:58] : [Step 4/5] [2021-11-19 21:07:58,733][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][GridCacheDatabaseSharedManager] ^-- sysMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:07:58] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:07:58] : [Step 4/5] ^-- default region [type=default, persistence=true, lazyAlloc=true, [21:07:58] : [Step 4/5] ... initCfg=10MB, maxCfg=10MB, usedRam=0MB, freeRam=100%, allocRam=0MB, allocTotal=0MB] [21:07:58] : [Step 4/5] ^-- metastoreMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:07:58] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:07:58] : [Step 4/5] ^-- TxLog region [type=internal, persistence=true, lazyAlloc=false, [21:07:58] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:07:58] : [Step 4/5] ^-- volatileDsMemPlc region [type=user, persistence=false, lazyAlloc=true, [21:07:58] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB] [21:07:58] : [Step 4/5] ^-- Ignite persistence [used=0MB] [21:07:58] : [Step 4/5] [21:07:58] : [Step 4/5] [2021-11-19 21:07:58,735][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][GridCacheDatabaseSharedManager] Starting binary memory restore for: [-2100569601, -322076972, -322076973] [21:07:58] : [Step 4/5] [2021-11-19 21:07:58,866][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=/opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1/cp/1637345274881-cdc4cfdb-d1fc-4d08-bf56-11ad6447c323-START.bin, endMarker=/opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1/cp/1637345268341-d6d33319-1bc0-4364-8054-36f69db017bc-END.bin] [21:07:58] : [Step 4/5] [2021-11-19 21:07:58,867][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=250234, len=21811], lastMarked=WALPointer [idx=0, fileOff=748319, len=21795], lastCheckpointId=cdc4cfdb-d1fc-4d08-bf56-11ad6447c323] [21:07:58]W: [org.apache.ignite:ignite-core] [2021-11-19 21:07:58,941][WARN ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][GridCacheDatabaseSharedManager] Ignite node stopped in the middle of checkpoint. Will restore memory state and finish checkpoint on node start. [21:07:58] : [Step 4/5] [2021-11-19 21:07:58,941][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][PageMemoryImpl] Started page memory [memoryAllocated=24.0 MiB, pages=5952, tableSize=474.2 KiB, replacementSize=768 B, checkpointBuffer=10.0 MiB] [21:07:59] : [Step 4/5] [2021-11-19 21:07:59,017][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][GridCacheDatabaseSharedManager] Found last checkpoint marker [cpId=cdc4cfdb-d1fc-4d08-bf56-11ad6447c323, pos=WALPointer [idx=0, fileOff=748319, len=21795]] [21:07:59] : [Step 4/5] [2021-11-19 21:07:59,024][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][GridCacheDatabaseSharedManager] Finished applying memory changes [changesApplied=868, time=81 ms] [21:07:59] : [Step 4/5] [2021-11-19 21:07:59,436][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][CheckpointWorkflow] Checkpoint finished [cpId=cdc4cfdb-d1fc-4d08-bf56-11ad6447c323, pages=450, markPos=WALPointer [idx=0, fileOff=748319, len=21795], pagesWrite=16ms, fsync=384ms, total=400ms] [21:07:59] : [Step 4/5] [2021-11-19 21:07:59,438][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][GridCacheDatabaseSharedManager] Binary memory state restored at node startup [restoredPtr=WALPointer [idx=0, fileOff=770114, len=0]] [21:07:59] : [Step 4/5] [2021-11-19 21:07:59,439][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000000.wal, offset=770114, ver=2] [21:07:59] : [Step 4/5] [2021-11-19 21:07:59,441][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][GridCacheProcessor] Started cache in recovery mode [name=ignite-sys-cache, id=-2100569601, dataRegionName=sysMemPlc, mode=REPLICATED, atomicity=TRANSACTIONAL, backups=2147483647, mvcc=false] [21:07:59] : [Step 4/5] [2021-11-19 21:07:59,444][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][GridCacheProcessor] Started cache in recovery mode [name=encrypted.grid-1, id=-322076972, dataRegionName=default, mode=PARTITIONED, atomicity=ATOMIC, backups=0, mvcc=false] [21:07:59] : [Step 4/5] [2021-11-19 21:07:59,447][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][GridCacheProcessor] Started cache in recovery mode [name=encrypted.grid-0, id=-322076973, dataRegionName=default, mode=PARTITIONED, atomicity=ATOMIC, backups=0, mvcc=false] [21:07:59] : [Step 4/5] [2021-11-19 21:07:59,448][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][GridCacheDatabaseSharedManager] Binary recovery performed in 713 ms. [21:07:59] : [Step 4/5] [2021-11-19 21:07:59,448][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=/opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1/cp/1637345274881-cdc4cfdb-d1fc-4d08-bf56-11ad6447c323-START.bin, endMarker=/opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1/cp/1637345274881-cdc4cfdb-d1fc-4d08-bf56-11ad6447c323-END.bin] [21:07:59] : [Step 4/5] [2021-11-19 21:07:59,449][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][GridCacheDatabaseSharedManager] Applying lost cache updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=748319, len=21795], lastCheckpointId=cdc4cfdb-d1fc-4d08-bf56-11ad6447c323] [21:07:59] : [Step 4/5] [2021-11-19 21:07:59,514][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=61 ms] [21:07:59] : [Step 4/5] [2021-11-19 21:07:59,514][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][GridCacheProcessor] Restoring partition state for local groups. [21:07:59] : [Step 4/5] [2021-11-19 21:07:59,612][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=3, partitionsProcessed=2148, time=101ms] [21:07:59] : [Step 4/5] [2021-11-19 21:07:59,753][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][TestTcpDiscoverySpi] Successfully bound to TCP port [port=47501, localHost=localhost/127.0.0.1, locNodeId=102b5b7d-22c8-4475-b7a7-caa19c6c1001] [21:07:59] : [Step 4/5] [2021-11-19 21:07:59,754][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][GridEncryptionManager] Sending stored group keys to coordinator [grps=-322076972,-322076973] [21:07:59] : [Step 4/5] [2021-11-19 21:07:59,758][INFO ][tcp-disco-srvr-[:47500]-#800%grid-0%-#15351%grid-0%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=41311] [21:07:59] : [Step 4/5] [2021-11-19 21:07:59,758][INFO ][tcp-disco-srvr-[:47500]-#800%grid-0%-#15351%grid-0%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=41311] [21:07:59] : [Step 4/5] [2021-11-19 21:07:59,759][INFO ][tcp-disco-sock-reader-[]-#806%grid-0%-#15471%grid-0%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:41311, rmtPort=41311] [21:07:59] : [Step 4/5] [2021-11-19 21:07:59,761][INFO ][tcp-disco-sock-reader-[102b5b7d 127.0.0.1:41311]-#806%grid-0%-#15471%grid-0%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=102b5b7d-22c8-4475-b7a7-caa19c6c1001, rmtAddr=/127.0.0.1:41311] [21:07:59] : [Step 4/5] [2021-11-19 21:07:59,765][INFO ][tcp-disco-srvr-[:47501]-#805%grid-1%-#15470%grid-1%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=33789] [21:07:59] : [Step 4/5] [2021-11-19 21:07:59,766][INFO ][tcp-disco-srvr-[:47501]-#805%grid-1%-#15470%grid-1%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=33789] [21:07:59] : [Step 4/5] [2021-11-19 21:07:59,766][INFO ][tcp-disco-sock-reader-[]-#807%grid-1%-#15472%grid-1%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:33789, rmtPort=33789] [21:07:59] : [Step 4/5] [2021-11-19 21:07:59,767][INFO ][tcp-disco-sock-reader-[]-#807%grid-1%-#15472%grid-1%][TestTcpDiscoverySpi] Received ping request from the remote node [rmtNodeId=00d146be-a209-4645-889f-3df8c43ef000, rmtAddr=/127.0.0.1:33789, rmtPort=33789] [21:07:59] : [Step 4/5] [2021-11-19 21:07:59,769][INFO ][tcp-disco-sock-reader-[]-#807%grid-1%-#15472%grid-1%][TestTcpDiscoverySpi] Finished writing ping response [rmtNodeId=00d146be-a209-4645-889f-3df8c43ef000, rmtAddr=/127.0.0.1:33789, rmtPort=33789] [21:07:59] : [Step 4/5] [2021-11-19 21:07:59,770][INFO ][tcp-disco-sock-reader-[102b5b7d 127.0.0.1:41311]-#806%grid-0%-#15471%grid-0%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:41311, rmtPort=41311, rmtNodeId=102b5b7d-22c8-4475-b7a7-caa19c6c1001] [21:07:59] : [Step 4/5] [2021-11-19 21:07:59,770][INFO ][tcp-disco-sock-reader-[]-#807%grid-1%-#15472%grid-1%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:33789, rmtPort=33789, rmtNodeId=null] [21:07:59] : [Step 4/5] [2021-11-19 21:07:59,786][INFO ][tcp-disco-msg-worker-[crd]-#799%grid-0%-#15350%grid-0%][TestTcpDiscoverySpi] New next node [newNext=TcpDiscoveryNode [id=102b5b7d-22c8-4475-b7a7-caa19c6c1001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=0, intOrder=2, lastExchangeTime=1637345279758, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false]] [21:07:59] : [Step 4/5] [2021-11-19 21:07:59,787][INFO ][tcp-disco-srvr-[:47501]-#805%grid-1%-#15470%grid-1%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=48399] [21:07:59] : [Step 4/5] [2021-11-19 21:07:59,787][INFO ][tcp-disco-srvr-[:47501]-#805%grid-1%-#15470%grid-1%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=48399] [21:07:59] : [Step 4/5] [2021-11-19 21:07:59,788][INFO ][tcp-disco-sock-reader-[]-#808%grid-1%-#15473%grid-1%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:48399, rmtPort=48399] [21:07:59] : [Step 4/5] [2021-11-19 21:07:59,789][INFO ][tcp-disco-sock-reader-[00d146be 127.0.0.1:48399]-#808%grid-1%-#15473%grid-1%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=00d146be-a209-4645-889f-3df8c43ef000, rmtAddr=/127.0.0.1:48399] [21:07:59] : [Step 4/5] [2021-11-19 21:07:59,792][INFO ][tcp-disco-msg-worker-[]-#804%grid-1%-#15469%grid-1%][TestTcpDiscoverySpi] New next node [newNext=TcpDiscoveryNode [id=00d146be-a209-4645-889f-3df8c43ef000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345279788, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false]] [21:07:59] : [Step 4/5] [2021-11-19 21:07:59,793][INFO ][tcp-disco-srvr-[:47500]-#800%grid-0%-#15351%grid-0%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=42565] [21:07:59] : [Step 4/5] [2021-11-19 21:07:59,793][INFO ][tcp-disco-srvr-[:47500]-#800%grid-0%-#15351%grid-0%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=42565] [21:07:59] : [Step 4/5] [2021-11-19 21:07:59,794][INFO ][tcp-disco-sock-reader-[]-#809%grid-0%-#15474%grid-0%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:42565, rmtPort=42565] [21:07:59] : [Step 4/5] [2021-11-19 21:07:59,795][INFO ][tcp-disco-sock-reader-[102b5b7d 127.0.0.1:42565]-#809%grid-0%-#15474%grid-0%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=102b5b7d-22c8-4475-b7a7-caa19c6c1001, rmtAddr=/127.0.0.1:42565] [21:07:59] : [Step 4/5] [2021-11-19 21:07:59,798][INFO ][disco-event-worker-#15353%grid-0%][GridDiscoveryManager] Added new node to topology: TcpDiscoveryNode [id=102b5b7d-22c8-4475-b7a7-caa19c6c1001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637345279758, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false] [21:07:59] : [Step 4/5] [2021-11-19 21:07:59,798][INFO ][disco-event-worker-#15353%grid-0%][GridDiscoveryManager] Topology snapshot [ver=2, locNode=00d146be, servers=2, clients=0, state=INACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=00d146be-a209-4645-889f-3df8c43ef000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=102b5b7d-22c8-4475-b7a7-caa19c6c1001, consistentId=grid-1, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:07:59] : [Step 4/5] [2021-11-19 21:07:59,799][INFO ][disco-event-worker-#15353%grid-0%][GridDiscoveryManager] ^-- Baseline [id=0, size=2, online=2, offline=0] [21:07:59] : [Step 4/5] [2021-11-19 21:07:59,799][INFO ][disco-event-worker-#15353%grid-0%][GridDiscoveryManager] ^-- All baseline nodes are online, will start auto-activation [21:07:59] : [Step 4/5] [2021-11-19 21:07:59,802][INFO ][tcp-disco-msg-worker-[00d146be 127.0.0.1:47500]-#804%grid-1%-#15469%grid-1%][GridEncryptionManager] Skip group key received from coordinator. Already exists. [grp=-322076972, keyId=0] [21:07:59] : [Step 4/5] [2021-11-19 21:07:59,802][INFO ][tcp-disco-msg-worker-[00d146be 127.0.0.1:47500]-#804%grid-1%-#15469%grid-1%][GridEncryptionManager] Skip group key received from coordinator. Already exists. [grp=-322076973, keyId=0] [21:07:59] : [Step 4/5] [2021-11-19 21:07:59,803][INFO ][disco-notifier-worker-#15468%grid-1%][MvccProcessorImpl] Assigned mvcc coordinator [crd=MvccCoordinator [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=0], nodeId=00d146be-a209-4645-889f-3df8c43ef000, ver=1637345278176, local=false, initialized=false]] [21:07:59] : [Step 4/5] [2021-11-19 21:07:59,805][INFO ][disco-notifier-worker-#15468%grid-1%][GridClusterStateProcessor] Sending activate cluster request with BaselineTopology BaselineTopology [id=0, branchingHash=-2475315501, branchingType='Cluster activation', baselineNodes=[grid-1, grid-0]] [21:07:59] : [Step 4/5] [2021-11-19 21:07:59,807][INFO ][sys-#15445%grid-1%][ClusterProcessor] Writing cluster ID and tag to metastorage on ready for write ClusterIdAndTag [id=dfd867ac-310a-4a38-817b-39c28d352019, tag=vigilant_khayyam] [21:07:59] : [Step 4/5] [2021-11-19 21:07:59,810][INFO ][disco-notifier-worker-#15349%grid-0%][GridClusterStateProcessor] Received activate cluster request with BaselineTopology[id=0] initiator node ID: 102b5b7d-22c8-4475-b7a7-caa19c6c1001 [21:07:59] : [Step 4/5] [2021-11-19 21:07:59,810][INFO ][disco-notifier-worker-#15349%grid-0%][GridClusterStateProcessor] Started state transition: activate cluster [21:07:59] : [Step 4/5] [2021-11-19 21:07:59,811][INFO ][exchange-worker-#15354%grid-0%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], crd=true, evt=DISCOVERY_CUSTOM_EVT, evtNode=102b5b7d-22c8-4475-b7a7-caa19c6c1001, customEvt=ChangeGlobalStateMessage [id=c295d593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqId=f310f28e-e08a-4d3c-bc57-e18cf3e3071b, initiatingNodeId=102b5b7d-22c8-4475-b7a7-caa19c6c1001, state=ACTIVE, baselineTopology=BaselineTopology [id=0, branchingHash=-2475315501, branchingType='Cluster activation', baselineNodes=[grid-1, grid-0]], forceChangeBaselineTopology=false, timestamp=1637345279805, forceDeactivation=true], allowMerge=false, exchangeFreeSwitch=false] [21:07:59] : [Step 4/5] [2021-11-19 21:07:59,811][INFO ][exchange-worker-#15354%grid-0%][GridDhtPartitionsExchangeFuture] Start activation process [nodeId=00d146be-a209-4645-889f-3df8c43ef000, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]]. New state: ACTIVE [21:07:59] : [Step 4/5] [2021-11-19 21:07:59,812][INFO ][exchange-worker-#15354%grid-0%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0 [21:07:59] : [Step 4/5] [2021-11-19 21:07:59,811][INFO ][disco-notifier-worker-#15468%grid-1%][GridClusterStateProcessor] Received activate cluster request with BaselineTopology[id=0] initiator node ID: 102b5b7d-22c8-4475-b7a7-caa19c6c1001 [21:07:59] : [Step 4/5] [2021-11-19 21:07:59,812][INFO ][disco-notifier-worker-#15468%grid-1%][GridClusterStateProcessor] Started state transition: activate cluster [21:07:59] : [Step 4/5] [2021-11-19 21:07:59,814][INFO ][exchange-worker-#15354%grid-0%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000000.wal, offset=880881, ver=2] [21:07:59] : [Step 4/5] [2021-11-19 21:07:59,815][INFO ][exchange-worker-#15354%grid-0%][GridClusterStateProcessor] Writing BaselineTopology[id=0] [21:07:59] : [Step 4/5] [2021-11-19 21:07:59,820][INFO ][exchange-worker-#15479%grid-1%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], crd=false, evt=DISCOVERY_CUSTOM_EVT, evtNode=102b5b7d-22c8-4475-b7a7-caa19c6c1001, customEvt=ChangeGlobalStateMessage [id=c295d593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqId=f310f28e-e08a-4d3c-bc57-e18cf3e3071b, initiatingNodeId=102b5b7d-22c8-4475-b7a7-caa19c6c1001, state=ACTIVE, baselineTopology=BaselineTopology [id=0, branchingHash=-2475315501, branchingType='Cluster activation', baselineNodes=[grid-1, grid-0]], forceChangeBaselineTopology=false, timestamp=1637345279805, forceDeactivation=true], allowMerge=false, exchangeFreeSwitch=false] [21:07:59] : [Step 4/5] [2021-11-19 21:07:59,822][INFO ][exchange-worker-#15479%grid-1%][GridDhtPartitionsExchangeFuture] Start activation process [nodeId=102b5b7d-22c8-4475-b7a7-caa19c6c1001, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]]. New state: ACTIVE [21:07:59] : [Step 4/5] [2021-11-19 21:07:59,822][INFO ][exchange-worker-#15479%grid-1%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1 [21:07:59] : [Step 4/5] [2021-11-19 21:07:59,822][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][IgniteKernal%grid-1] To start Console Management & Monitoring run ignitevisorcmd.{sh|bat} [21:07:59] : [Step 4/5] [2021-11-19 21:07:59,824][INFO ][exchange-worker-#15479%grid-1%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000000.wal, offset=770114, ver=2] [21:07:59] : [Step 4/5] [2021-11-19 21:07:59,824][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][IgniteKernal%grid-1] [21:07:59] : [Step 4/5] [21:07:59] : [Step 4/5] >>> +-------------------------------------------+ [21:07:59] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:07:59] : [Step 4/5] >>> +-------------------------------------------+ [21:07:59] : [Step 4/5] >>> OS name: Linux 4.15.0-151-generic amd64 [21:07:59] : [Step 4/5] >>> CPU(s): 24 [21:07:59] : [Step 4/5] >>> Heap: 2.0GB [21:07:59] : [Step 4/5] >>> VM name: 16724@c4dfe9a430b2 [21:07:59] : [Step 4/5] >>> Ignite instance name: grid-1 [21:07:59] : [Step 4/5] >>> Local node [ID=102B5B7D-22C8-4475-B7A7-CAA19C6C1001, order=2, clientMode=false] [21:07:59] : [Step 4/5] >>> Local node addresses: [127.0.0.1] [21:07:59] : [Step 4/5] >>> Local ports: TCP:10801 TCP:45171 TCP:47501 [21:07:59] : [Step 4/5] [21:07:59] : [Step 4/5] [2021-11-19 21:07:59,825][INFO ][exchange-worker-#15479%grid-1%][GridClusterStateProcessor] Writing BaselineTopology[id=0] [21:07:59] : [Step 4/5] [2021-11-19 21:07:59,826][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][GridDiscoveryManager] Topology snapshot [ver=2, locNode=102b5b7d, servers=2, clients=0, state=INACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=00d146be-a209-4645-889f-3df8c43ef000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=102b5b7d-22c8-4475-b7a7-caa19c6c1001, consistentId=grid-1, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:07:59] : [Step 4/5] [2021-11-19 21:07:59,827][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][GridDiscoveryManager] ^-- Baseline [id=0, size=2, online=2, offline=0] [21:07:59] : [Step 4/5] [2021-11-19 21:07:59,827][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][GridDiscoveryManager] ^-- All baseline nodes are online, will start auto-activation [21:07:59] : [Step 4/5] [2021-11-19 21:07:59,828][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][G] Node started : [stage="Configure system pool" (0 ms),stage="Start managers" (204 ms),stage="Configure binary metadata" (2 ms),stage="Start processors" (21 ms),stage="Start 'StanByClusterTestProvider' plugin" (0 ms),stage="Start 'PageMemory tracker plugin' plugin" (0 ms),stage="Start 'TestDistibutedConfigurationPlugin' plugin" (0 ms),stage="Start 'NodeValidationPluginProvider' plugin" (0 ms),stage="Init metastore" (289 ms),stage="Init and start regions" (8 ms),stage="Restore binary memory" (713 ms),stage="Restore logical state" (164 ms),stage="Finish recovery" (138 ms),stage="Join topology" (52 ms),stage="Await transition" (4 ms),stage="Await exchange" (19 ms),stage="Total time" (1614 ms)] [21:07:59] : [Step 4/5] [2021-11-19 21:07:59,830][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][root] Node started with the following configuration [id=102b5b7d-22c8-4475-b7a7-caa19c6c1001, marshaller=BinaryMarshaller [], discovery=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=5000, ackTimeout=5000, marsh=JdkMarshaller [clsFilter=org.apache.ignite.marshaller.MarshallerUtils$1@1f82955e], reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], binaryCfg=null, lateAff=true] [21:07:59] : [Step 4/5] [2021-11-19 21:07:59,831][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][GridClusterStateProcessor] Sending activate cluster request with BaselineTopology BaselineTopology [id=0, branchingHash=-2475315501, branchingType='Cluster activation', baselineNodes=[grid-1, grid-0]] [21:07:59] : [Step 4/5] [2021-11-19 21:07:59,832][INFO ][disco-notifier-worker-#15349%grid-0%][GridClusterStateProcessor] Received activate cluster request with BaselineTopology[id=0] initiator node ID: 00d146be-a209-4645-889f-3df8c43ef000 [21:07:59] : [Step 4/5] [2021-11-19 21:07:59,833][INFO ][disco-notifier-worker-#15468%grid-1%][GridClusterStateProcessor] Received activate cluster request with BaselineTopology[id=0] initiator node ID: 00d146be-a209-4645-889f-3df8c43ef000 [21:07:59] : [Step 4/5] [2021-11-19 21:07:59,860][INFO ][exchange-worker-#15479%grid-1%][GridCacheDatabaseSharedManager] Finish recovery performed in 37 ms. [21:07:59] : [Step 4/5] [2021-11-19 21:07:59,861][INFO ][exchange-worker-#15354%grid-0%][GridCacheDatabaseSharedManager] Finish recovery performed in 49 ms. [21:07:59] : [Step 4/5] [2021-11-19 21:07:59,862][INFO ][exchange-worker-#15479%grid-1%][msg] Components activation performed in 40 ms. [21:07:59] : [Step 4/5] [2021-11-19 21:07:59,863][INFO ][exchange-worker-#15354%grid-0%][msg] Components activation performed in 51 ms. [21:07:59] : [Step 4/5] [2021-11-19 21:07:59,864][INFO ][exchange-worker-#15479%grid-1%][GridCacheProcessor] Finished recovery for cache [cache=encrypted.grid-1, grp=encrypted.grid-1, startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:07:59] : [Step 4/5] [2021-11-19 21:07:59,865][INFO ][sys-#15330%grid-0%][GridCacheProcessor] Finished recovery for cache [cache=encrypted.grid-1, grp=encrypted.grid-1, startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:07:59] : [Step 4/5] [2021-11-19 21:07:59,864][INFO ][sys-#15348%grid-0%][GridCacheProcessor] Finished recovery for cache [cache=encrypted.grid-0, grp=encrypted.grid-0, startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:07:59] : [Step 4/5] [2021-11-19 21:07:59,864][INFO ][exchange-worker-#15354%grid-0%][GridCacheProcessor] Finished recovery for cache [cache=ignite-sys-cache, grp=ignite-sys-cache, startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:07:59] : [Step 4/5] [2021-11-19 21:07:59,864][INFO ][sys-#15461%grid-1%][GridCacheProcessor] Finished recovery for cache [cache=ignite-sys-cache, grp=ignite-sys-cache, startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:07:59] : [Step 4/5] [2021-11-19 21:07:59,864][INFO ][sys-#15455%grid-1%][GridCacheProcessor] Finished recovery for cache [cache=encrypted.grid-0, grp=encrypted.grid-0, startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:07:59]W: [org.apache.ignite:ignite-core] [2021-11-19 21:07:59,869][WARN ][sys-#15326%grid-0%][CacheAffinitySharedManager] Cache group 'encrypted.grid-0' brings high overhead for its metainformation in data region 'default'. Metainformation required for its partitions (502 partitions, 4096 bytes per partition, 1 MBs total) will consume more than 15% of data region memory (10 MBs). It may lead to critical errors on the node and cluster instability. Please reduce number of partitions, add more memory to the data region or add more server nodes for this cache group. [21:07:59]W: [org.apache.ignite:ignite-core] [2021-11-19 21:07:59,871][WARN ][exchange-worker-#15479%grid-1%][CacheAffinitySharedManager] Cache group 'encrypted.grid-0' brings high overhead for its metainformation in data region 'default'. Metainformation required for its partitions (522 partitions, 4096 bytes per partition, 2 MBs total) will consume more than 15% of data region memory (10 MBs). It may lead to critical errors on the node and cluster instability. Please reduce number of partitions, add more memory to the data region or add more server nodes for this cache group. [21:07:59]W: [org.apache.ignite:ignite-core] [2021-11-19 21:07:59,872][WARN ][sys-#15327%grid-0%][CacheAffinitySharedManager] Cache group 'encrypted.grid-1' brings high overhead for its metainformation in data region 'default'. Metainformation required for its partitions (502 partitions, 4096 bytes per partition, 1 MBs total) will consume more than 15% of data region memory (10 MBs). It may lead to critical errors on the node and cluster instability. Please reduce number of partitions, add more memory to the data region or add more server nodes for this cache group. [21:07:59]W: [org.apache.ignite:ignite-core] [2021-11-19 21:07:59,872][WARN ][sys-#15449%grid-1%][CacheAffinitySharedManager] Cache group 'encrypted.grid-1' brings high overhead for its metainformation in data region 'default'. Metainformation required for its partitions (522 partitions, 4096 bytes per partition, 2 MBs total) will consume more than 15% of data region memory (10 MBs). It may lead to critical errors on the node and cluster instability. Please reduce number of partitions, add more memory to the data region or add more server nodes for this cache group. [21:07:59] : [Step 4/5] [2021-11-19 21:07:59,873][INFO ][exchange-worker-#15354%grid-0%][GridDhtPartitionsExchangeFuture] Successfully activated caches [nodeId=00d146be-a209-4645-889f-3df8c43ef000, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], newState=ACTIVE] [21:07:59] : [Step 4/5] [2021-11-19 21:07:59,873][INFO ][exchange-worker-#15479%grid-1%][GridDhtPartitionsExchangeFuture] Successfully activated caches [nodeId=102b5b7d-22c8-4475-b7a7-caa19c6c1001, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], newState=ACTIVE] [21:07:59]W: [org.apache.ignite:ignite-core] [2021-11-19 21:07:59,875][WARN ][exchange-worker-#15354%grid-0%][CacheAffinitySharedManager] Cache group 'encrypted.grid-1' brings high overhead for its metainformation in data region 'default'. Metainformation required for its partitions (502 partitions, 4096 bytes per partition, 1 MBs total) will consume more than 15% of data region memory (10 MBs). It may lead to critical errors on the node and cluster instability. Please reduce number of partitions, add more memory to the data region or add more server nodes for this cache group. [21:07:59]W: [org.apache.ignite:ignite-core] [2021-11-19 21:07:59,875][WARN ][sys-#15466%grid-1%][CacheAffinitySharedManager] Cache group 'encrypted.grid-1' brings high overhead for its metainformation in data region 'default'. Metainformation required for its partitions (522 partitions, 4096 bytes per partition, 2 MBs total) will consume more than 15% of data region memory (10 MBs). It may lead to critical errors on the node and cluster instability. Please reduce number of partitions, add more memory to the data region or add more server nodes for this cache group. [21:07:59]W: [org.apache.ignite:ignite-core] [2021-11-19 21:07:59,875][WARN ][exchange-worker-#15479%grid-1%][CacheAffinitySharedManager] Cache group 'encrypted.grid-0' brings high overhead for its metainformation in data region 'default'. Metainformation required for its partitions (522 partitions, 4096 bytes per partition, 2 MBs total) will consume more than 15% of data region memory (10 MBs). It may lead to critical errors on the node and cluster instability. Please reduce number of partitions, add more memory to the data region or add more server nodes for this cache group. [21:07:59]W: [org.apache.ignite:ignite-core] [2021-11-19 21:07:59,875][WARN ][sys-#15342%grid-0%][CacheAffinitySharedManager] Cache group 'encrypted.grid-0' brings high overhead for its metainformation in data region 'default'. Metainformation required for its partitions (502 partitions, 4096 bytes per partition, 1 MBs total) will consume more than 15% of data region memory (10 MBs). It may lead to critical errors on the node and cluster instability. Please reduce number of partitions, add more memory to the data region or add more server nodes for this cache group. [21:07:59] : [Step 4/5] [2021-11-19 21:07:59,878][INFO ][exchange-worker-#15479%grid-1%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:07:59] : [Step 4/5] [2021-11-19 21:07:59,879][INFO ][exchange-worker-#15354%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:07:59] : [Step 4/5] [2021-11-19 21:07:59,889][INFO ][exchange-worker-#15354%grid-0%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], crd=true] [21:07:59] : [Step 4/5] [2021-11-19 21:07:59,894][INFO ][db-checkpoint-thread-#15486%grid-1%][Checkpointer] Checkpoint started [checkpointId=1436868a-c69a-484e-97cd-80dc7ef7d19b, startPtr=WALPointer [idx=0, fileOff=1042209, len=21811], checkpointBeforeLockTime=5ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=2ms, checkpointLockHoldTime=3ms, walCpRecordFsyncDuration=3ms, writeCheckpointEntryDuration=2ms, splitAndSortCpPagesDuration=0ms, pages=60, reason='node started'] [21:07:59] : [Step 4/5] [2021-11-19 21:07:59,894][INFO ][grid-nio-worker-tcp-comm-0-#15292%TcpCommunicationSpi%][TcpCommunicationSpi] Accepted incoming communication connection [locAddr=/127.0.0.1:45170, rmtAddr=/127.0.0.1:42446] [21:07:59] : [Step 4/5] [2021-11-19 21:07:59,897][INFO ][grid-nio-worker-tcp-comm-0-#15411%TcpCommunicationSpi%][TcpCommunicationSpi] Established outgoing communication connection [locAddr=/127.0.0.1:42446, rmtAddr=/127.0.0.1:45170] [21:07:59] : [Step 4/5] [2021-11-19 21:07:59,897][INFO ][exchange-worker-#15479%grid-1%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], crd=false] [21:07:59] : [Step 4/5] [2021-11-19 21:07:59,901][INFO ][sys-#15334%grid-0%][GridDhtPartitionsExchangeFuture] Coordinator received single message [ver=AffinityTopologyVersion [topVer=2, minorTopVer=1], node=102b5b7d-22c8-4475-b7a7-caa19c6c1001, allReceived=true] [21:07:59] : [Step 4/5] [2021-11-19 21:07:59,902][INFO ][sys-#15334%grid-0%][GridDhtPartitionsExchangeFuture] finishExchangeOnCoordinator [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:07:59] : [Step 4/5] [2021-11-19 21:07:59,904][INFO ][db-checkpoint-thread-#15490%grid-0%][Checkpointer] Checkpoint started [checkpointId=6539ae26-003c-416e-95ae-e6632442e6c0, startPtr=WALPointer [idx=0, fileOff=1202884, len=21051], checkpointBeforeLockTime=5ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=1ms, checkpointLockHoldTime=2ms, walCpRecordFsyncDuration=14ms, writeCheckpointEntryDuration=2ms, splitAndSortCpPagesDuration=0ms, pages=72, reason='node started'] [21:07:59] : [Step 4/5] [2021-11-19 21:07:59,924][INFO ][sys-#15334%grid-0%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], err=null, rebalanced=true, wasRebalanced=false] [21:07:59] : [Step 4/5] [2021-11-19 21:07:59,926][INFO ][sys-#15456%grid-1%][GridDhtPartitionsExchangeFuture] Received full message, will finish exchange [node=00d146be-a209-4645-889f-3df8c43ef000, resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:07:59] : [Step 4/5] [2021-11-19 21:07:59,924][INFO ][disco-notifier-worker-#15349%grid-0%][GridClusterStateProcessor] Received state change finish message: ACTIVE [21:07:59] : [Step 4/5] [2021-11-19 21:07:59,926][INFO ][disco-notifier-worker-#15468%grid-1%][GridClusterStateProcessor] Received state change finish message: ACTIVE [21:07:59] : [Step 4/5] [2021-11-19 21:07:59,928][INFO ][disco-notifier-worker-#15349%grid-0%][GridClusterStateProcessor] Cluster state was changed from INACTIVE to ACTIVE [21:07:59] : [Step 4/5] [2021-11-19 21:07:59,930][INFO ][disco-notifier-worker-#15468%grid-1%][GridClusterStateProcessor] Cluster state was changed from INACTIVE to ACTIVE [21:07:59] : [Step 4/5] [2021-11-19 21:07:59,933][INFO ][db-checkpoint-thread-#15486%grid-1%][Checkpointer] Checkpoint finished [cpId=1436868a-c69a-484e-97cd-80dc7ef7d19b, pages=60, markPos=WALPointer [idx=0, fileOff=1042209, len=21811], walSegmentsCovered=[], markDuration=8ms, pagesWrite=4ms, fsync=35ms, total=52ms] [21:07:59] : [Step 4/5] [2021-11-19 21:07:59,933][INFO ][sys-#15456%grid-1%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], err=null, rebalanced=true, wasRebalanced=false] [21:07:59] : [Step 4/5] [2021-11-19 21:07:59,935][INFO ][sys-#15448%grid-1%][GridCachePartitionExchangeManager] Delay process full message without exchange id (there is exchange in progress) [nodeId=00d146be-a209-4645-889f-3df8c43ef000] [21:07:59] : [Step 4/5] [2021-11-19 21:07:59,939][INFO ][sys-#15334%grid-0%][GridCacheProcessor] Finish proxy initialization, cacheName=ignite-sys-cache, localNodeId=00d146be-a209-4645-889f-3df8c43ef000 [21:07:59] : [Step 4/5] [2021-11-19 21:07:59,939][INFO ][sys-#15334%grid-0%][GridCacheProcessor] Finish proxy initialization, cacheName=encrypted.grid-1, localNodeId=00d146be-a209-4645-889f-3df8c43ef000 [21:07:59] : [Step 4/5] [2021-11-19 21:07:59,939][INFO ][sys-#15334%grid-0%][GridCacheProcessor] Finish proxy initialization, cacheName=encrypted.grid-0, localNodeId=00d146be-a209-4645-889f-3df8c43ef000 [21:07:59] : [Step 4/5] [2021-11-19 21:07:59,941][INFO ][sys-#15334%grid-0%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=00d146be-a209-4645-889f-3df8c43ef000, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=102b5b7d-22c8-4475-b7a7-caa19c6c1001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637345279758, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:07:59] : [Step 4/5] [2021-11-19 21:07:59,942][INFO ][sys-#15456%grid-1%][GridCacheProcessor] Finish proxy initialization, cacheName=ignite-sys-cache, localNodeId=102b5b7d-22c8-4475-b7a7-caa19c6c1001 [21:07:59] : [Step 4/5] [2021-11-19 21:07:59,941][INFO ][sys-#15343%grid-0%][DistributedBaselineConfiguration] Baseline auto-adjust is 'disabled' with timeout='300000' ms [21:07:59] : [Step 4/5] [2021-11-19 21:07:59,942][INFO ][sys-#15456%grid-1%][GridCacheProcessor] Finish proxy initialization, cacheName=encrypted.grid-1, localNodeId=102b5b7d-22c8-4475-b7a7-caa19c6c1001 [21:07:59] : [Step 4/5] [2021-11-19 21:07:59,943][INFO ][sys-#15456%grid-1%][GridCacheProcessor] Finish proxy initialization, cacheName=encrypted.grid-0, localNodeId=102b5b7d-22c8-4475-b7a7-caa19c6c1001 [21:07:59] : [Step 4/5] [2021-11-19 21:07:59,942][INFO ][exchange-worker-#15354%grid-0%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=2, minorTopVer=1], force=false, evt=DISCOVERY_CUSTOM_EVT, node=102b5b7d-22c8-4475-b7a7-caa19c6c1001] [21:07:59] : [Step 4/5] [2021-11-19 21:07:59,942][INFO ][sys-#15334%grid-0%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (0 ms), stage="Update caches registry" (52 ms), stage="Start caches" (1 ms), stage="Affinity initialization on cache group start" (6 ms), stage="Determine exchange type" (6 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Restore partition states" (0 ms), stage="After states restored callback" (8 ms), stage="WAL history reservation" (0 ms), stage="Waiting for all single messages" (13 ms), stage="Affinity recalculation (crd)" (0 ms), stage="Collect update counters and create affinity messages" (0 ms), stage="Assign partitions states" (5 ms), stage="Validate partitions states" (1 ms), stage="Ideal affinity diff calculation (enforced)" (2 ms), stage="Apply update counters" (0 ms), stage="Full message preparing" (10 ms), stage="Full message sending" (0 ms), stage="State finish message sending" (1 ms), stage="Detect lost partitions" (10 ms), stage="Exchange done" (6 ms), stage="Total time" (121 ms), Discovery lag=3 ms, Latest started node id=102b5b7d-22c8-4475-b7a7-caa19c6c1001] [21:07:59] : [Step 4/5] [2021-11-19 21:07:59,946][INFO ][exchange-worker-#15479%grid-1%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=2, minorTopVer=1], force=false, evt=DISCOVERY_CUSTOM_EVT, node=102b5b7d-22c8-4475-b7a7-caa19c6c1001] [21:07:59] : [Step 4/5] [2021-11-19 21:07:59,945][INFO ][sys-#15456%grid-1%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=102b5b7d-22c8-4475-b7a7-caa19c6c1001, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=102b5b7d-22c8-4475-b7a7-caa19c6c1001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637345279919, loc=true, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:07:59] : [Step 4/5] [2021-11-19 21:07:59,944][INFO ][sys-#15454%grid-1%][DistributedBaselineConfiguration] Baseline auto-adjust is 'disabled' with timeout='300000' ms [21:07:59] : [Step 4/5] [2021-11-19 21:07:59,942][INFO ][sys-#15343%grid-0%][GridClusterStateProcessor] Successfully performed final activation steps [nodeId=00d146be-a209-4645-889f-3df8c43ef000, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:07:59] : [Step 4/5] [2021-11-19 21:07:59,948][INFO ][sys-#15454%grid-1%][GridClusterStateProcessor] Successfully performed final activation steps [nodeId=102b5b7d-22c8-4475-b7a7-caa19c6c1001, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:07:59] : [Step 4/5] [2021-11-19 21:07:59,948][INFO ][sys-#15456%grid-1%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], stage="Waiting in exchange queue" (6 ms), stage="Exchange parameters initialization" (1 ms), stage="Update caches registry" (42 ms), stage="Start caches" (3 ms), stage="Affinity initialization on cache group start" (6 ms), stage="Determine exchange type" (4 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (1 ms), stage="Restore partition states" (0 ms), stage="After states restored callback" (9 ms), stage="WAL history reservation" (0 ms), stage="Waiting for Full message" (35 ms), stage="Affinity recalculation" (4 ms), stage="Full map updating" (3 ms), stage="Detect lost partitions" (6 ms), stage="Exchange done" (8 ms), stage="Total time" (128 ms)] [21:07:59] : [Step 4/5] [2021-11-19 21:07:59,947][INFO ][sys-#15334%grid-0%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], stage="Affinity initialization on cache group start [grp=encrypted.grid-1]" (3 ms) (parent=Affinity initialization on cache group start), stage="Affinity initialization on cache group start [grp=encrypted.grid-0]" (2 ms) (parent=Affinity initialization on cache group start), stage="Affinity initialization on cache group start [grp=ignite-sys-cache]" (0 ms) (parent=Affinity initialization on cache group start), stage="Affinity centralized initialization (crd) [grp=ignite-sys-cache, crd=true]" (1 ms) (parent=Determine exchange type), stage="Affinity centralized initialization (crd) [grp=encrypted.grid-1, crd=true]" (1 ms) (parent=Determine exchange type), stage="Affinity centralized initialization (crd) [grp=encrypted.grid-0, crd=true]" (1 ms) (parent=Determine exchange type), stage="Restore partition states [grp=ignite-sys-cache]" (0 ms) (parent=Restore partition states), stage="Restore partition states [grp=encrypted.grid-1]" (0 ms) (parent=Restore partition states), stage="Restore partition states [grp=encrypted.grid-0]" (0 ms) (parent=Restore partition states), stage="Affinity recalculation (partitions availability) [grp=encrypted.grid-1]" (2 ms) (parent=Ideal affinity diff calculation (enforced)), stage="Affinity recalculation (partitions availability) [grp=encrypted.grid-0]" (2 ms) (parent=Ideal affinity diff calculation (enforced)), stage="Affinity recalculation (partitions availability) [grp=ignite-sys-cache]" (0 ms) (parent=Ideal affinity diff calculation (enforced))] [21:07:59] : [Step 4/5] [2021-11-19 21:07:59,960][INFO ][db-checkpoint-thread-#15490%grid-0%][Checkpointer] Checkpoint finished [cpId=6539ae26-003c-416e-95ae-e6632442e6c0, pages=72, markPos=WALPointer [idx=0, fileOff=1202884, len=21051], walSegmentsCovered=[], markDuration=19ms, pagesWrite=19ms, fsync=36ms, total=79ms] [21:07:59] : [Step 4/5] [2021-11-19 21:07:59,951][INFO ][sys-#15456%grid-1%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], stage="Affinity initialization on cache group start [grp=encrypted.grid-1]" (2 ms) (parent=Affinity initialization on cache group start), stage="Affinity initialization on cache group start [grp=encrypted.grid-0]" (2 ms) (parent=Affinity initialization on cache group start), stage="Affinity initialization on cache group start [grp=ignite-sys-cache]" (0 ms) (parent=Affinity initialization on cache group start), stage="Affinity centralized initialization (crd) [grp=ignite-sys-cache, crd=false]" (1 ms) (parent=Determine exchange type), stage="Affinity centralized initialization (crd) [grp=encrypted.grid-1, crd=false]" (1 ms) (parent=Determine exchange type), stage="Affinity centralized initialization (crd) [grp=encrypted.grid-0, crd=false]" (0 ms) (parent=Determine exchange type), stage="Restore partition states [grp=ignite-sys-cache]" (0 ms) (parent=Restore partition states), stage="Restore partition states [grp=encrypted.grid-1]" (0 ms) (parent=Restore partition states), stage="Restore partition states [grp=encrypted.grid-0]" (0 ms) (parent=Restore partition states), stage="Affinity applying from full message [grp=encrypted.grid-1]" (4 ms) (parent=Affinity recalculation), stage="Affinity applying from full message [grp=encrypted.grid-0]" (4 ms) (parent=Affinity recalculation), stage="Affinity applying from full message [grp=ignite-sys-cache]" (2 ms) (parent=Affinity recalculation)] [21:07:59] : [Step 4/5] [2021-11-19 21:07:59,964][INFO ][test-runner-#14966%encryption.EncryptedCachePreconfiguredRestartTest%][root] awaitPartitionMapExchange finished [21:08:00] : [Step 4/5] [21:07:59] >>> Stopping test: EncryptedCachePreconfiguredRestartTest#testDifferentPreconfiguredCachesOnNodes in 15989 ms <<< [21:08:00] : [Step 4/5] [2021-11-19 21:07:59,999][INFO ][main][root] >>> Stopping test: EncryptedCachePreconfiguredRestartTest#testDifferentPreconfiguredCachesOnNodes in 15989 ms <<< [21:08:00] : [Step 4/5] [21:07:59] >>> Heap: 467 MB used / 1908 MB commited / 1908 MB max <<< [21:08:00] : [Step 4/5] [2021-11-19 21:08:00,000][INFO ][main][root] >>> Heap: 467 MB used / 1908 MB commited / 1908 MB max <<< [21:08:00] : [Step 4/5] [21:08:00] >>> Non-Heap: 155 MB used / 171 MB commited / 0 MB max <<< [21:08:00] : [Step 4/5] [2021-11-19 21:08:00,000][INFO ][main][root] >>> Non-Heap: 155 MB used / 171 MB commited / 0 MB max <<< [21:08:00] : [Step 4/5] [2021-11-19 21:08:00,000][INFO ][main][root] >>> Stopping grid [name=grid-1, id=102b5b7d-22c8-4475-b7a7-caa19c6c1001] [21:08:00] : [Step 4/5] [2021-11-19 21:08:00,011][INFO ][db-checkpoint-thread-#15486%grid-1%][Checkpointer] Skipping checkpoint (no pages were modified) [checkpointBeforeLockTime=2ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=2ms, checkpointLockHoldTime=2ms, reason='timeout'] [21:08:00] : [Step 4/5] [2021-11-19 21:08:00,016][INFO ][db-checkpoint-thread-#15486%grid-1%][Checkpointer] Skipping checkpoint (no pages were modified) [checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=1ms, checkpointLockHoldTime=3ms, reason='timeout'] [21:08:00] : [Step 4/5] [2021-11-19 21:08:00,024][INFO ][tcp-disco-sock-reader-[00d146be 127.0.0.1:48399]-#808%grid-1%-#15473%grid-1%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:48399, rmtPort=48399, rmtNodeId=00d146be-a209-4645-889f-3df8c43ef000] [21:08:00] : [Step 4/5] [2021-11-19 21:08:00,025][INFO ][disco-event-worker-#15353%grid-0%][GridDiscoveryManager] Node left topology: TcpDiscoveryNode [id=102b5b7d-22c8-4475-b7a7-caa19c6c1001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637345279758, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false] [21:08:00] : [Step 4/5] [2021-11-19 21:08:00,027][INFO ][main][GridCacheProcessor] Stopped cache [cacheName=encrypted.grid-0] [21:08:00] : [Step 4/5] [2021-11-19 21:08:00,027][INFO ][main][GridCacheProcessor] Stopped cache [cacheName=encrypted.grid-1] [21:08:00] : [Step 4/5] [2021-11-19 21:08:00,027][INFO ][disco-event-worker-#15353%grid-0%][GridDiscoveryManager] Topology snapshot [ver=3, locNode=00d146be, servers=1, clients=0, state=ACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=00d146be-a209-4645-889f-3df8c43ef000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:08:00] : [Step 4/5] [2021-11-19 21:08:00,028][INFO ][main][GridCacheProcessor] Stopped cache [cacheName=ignite-sys-cache] [21:08:00] : [Step 4/5] [2021-11-19 21:08:00,028][INFO ][disco-event-worker-#15353%grid-0%][GridDiscoveryManager] ^-- Baseline [id=0, size=2, online=1, offline=1] [21:08:00] : [Step 4/5] [2021-11-19 21:08:00,031][INFO ][exchange-worker-#15354%grid-0%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], crd=true, evt=NODE_LEFT, evtNode=102b5b7d-22c8-4475-b7a7-caa19c6c1001, customEvt=null, allowMerge=false, exchangeFreeSwitch=true] [21:08:00] : [Step 4/5] [2021-11-19 21:08:00,032][INFO ][exchange-worker-#15354%grid-0%][GridAffinityAssignmentCache] Local node affinity assignment distribution is not ideal [cache=encrypted.grid-0, expectedPrimary=1024.00, actualPrimary=502, expectedBackups=0.00, actualBackups=0, warningThreshold=50.00%] [21:08:00] : [Step 4/5] [2021-11-19 21:08:00,032][INFO ][sys-#15329%grid-0%][GridAffinityAssignmentCache] Local node affinity assignment distribution is not ideal [cache=encrypted.grid-1, expectedPrimary=1024.00, actualPrimary=502, expectedBackups=0.00, actualBackups=0, warningThreshold=50.00%] [21:08:00] : [Step 4/5] [2021-11-19 21:08:00,033][INFO ][exchange-worker-#15354%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:08:00] : [Step 4/5] [2021-11-19 21:08:00,037][INFO ][exchange-worker-#15354%grid-0%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], err=null, rebalanced=true, wasRebalanced=true] [21:08:00]W: [org.apache.ignite:ignite-core] [2021-11-19 21:08:00,038][WARN ][exchange-worker-#15354%grid-0%][GridDhtPartitionTopologyImpl] Detected lost partitions [grp=encrypted.grid-1, parts=[0, 2, 4, 6-7, 10-11, 14, 17, 21, 24-30, 32, 37, 40, 44, 47-52, 54, 57, 59, 62-64, 67-68, 74-75, 78, 81, 87-88, 91, 97, 99, 101-102, 104-107, 113-114, 116, 118, 120, 122, 124, 135-136, 138, 140-145, 147, 149-152, 154-156, 159-160, 162-164, 169, 172, 175-177, 180, 184-187, 190-191, 194, 196-202, 204-205, 209-210, 212, 214, 216, 219-224, 226, 229-232, 237, 239, 241, 243-245, 247, 249-251, 255, 257, 261, 265, 269, 272-273, 276-277, 281-282, 285, 287, 289-291, 293-297, 299, 301-304, 306, 308-309, 311-312, 315-317, 319, 322, 325-326, 328-330, 336, 339, 341, 344-346, 350, 352-354, 357-361, 363, 366-367, 371-373, 376-380, 383, 385, 387-388, 390, 392, 395-397, 400, 402, 405, 408-411, 416, 420, 422, 424-425, 429, 433, 435-438, 440-441, 445-446, 450, 452-453, 455-456, 458, 460, 462-463, 465-468, 470, 474-475, 480, 488, 490-492, 495, 497, 499-512, 516, 525, 527-531, 535, 537-538, 541-542, 545-546, 548-552, 554-555, 558, 562-564, 567-569, 572, 574, 579-580, 582-585, 587, 590-591, 594, 596, 600, 602, 604, 607-614, 617-620, 623-624, 627-629, 632-633, 636, 638, 640-642, 645-646, 648-649, 657-662, 664-665, 668-672, 677-678, 682-684, 686, 689, 692-693, 695-697, 699, 706-707, 709-710, 712-714, 716-717, 719-721, 723-728, 730-732, 734-735, 739, 742, 746, 749-750, 752, 754, 756, 762, 768-770, 772-775, 778, 780, 783-787, 789-791, 793, 796, 798-801, 803, 806, 809-812, 814, 816-817, 819, 822-825, 827-829, 832-833, 836-837, 839-840, 846, 848-851, 853-854, 857-858, 860, 863-864, 866, 868-871, 873-875, 877-878, 884, 888-889, 896-897, 900, 905-907, 914-915, 917, 919-920, 923-925, 931-933, 936, 940, 942, 944-945, 948, 950-951, 954, 956-958, 962, 965-970, 972, 975-976, 978-980, 983, 985, 988, 990, 993-994, 997-998, 1000, 1003-1004, 1007, 1009, 1014, 1016, 1018-1019], topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0]] [21:08:00]W: [org.apache.ignite:ignite-core] [2021-11-19 21:08:00,041][WARN ][sys-#15340%grid-0%][GridDhtPartitionTopologyImpl] Detected lost partitions [grp=encrypted.grid-0, parts=[0, 2, 4, 6-7, 10-11, 14, 17, 21, 24-30, 32, 37, 40, 44, 47-52, 54, 57, 59, 62-64, 67-68, 74-75, 78, 81, 87-88, 91, 97, 99, 101-102, 104-107, 113-114, 116, 118, 120, 122, 124, 135-136, 138, 140-145, 147, 149-152, 154-156, 159-160, 162-164, 169, 172, 175-177, 180, 184-187, 190-191, 194, 196-202, 204-205, 209-210, 212, 214, 216, 219-224, 226, 229-232, 237, 239, 241, 243-245, 247, 249-251, 255, 257, 261, 265, 269, 272-273, 276-277, 281-282, 285, 287, 289-291, 293-297, 299, 301-304, 306, 308-309, 311-312, 315-317, 319, 322, 325-326, 328-330, 336, 339, 341, 344-346, 350, 352-354, 357-361, 363, 366-367, 371-373, 376-380, 383, 385, 387-388, 390, 392, 395-397, 400, 402, 405, 408-411, 416, 420, 422, 424-425, 429, 433, 435-438, 440-441, 445-446, 450, 452-453, 455-456, 458, 460, 462-463, 465-468, 470, 474-475, 480, 488, 490-492, 495, 497, 499-512, 516, 525, 527-531, 535, 537-538, 541-542, 545-546, 548-552, 554-555, 558, 562-564, 567-569, 572, 574, 579-580, 582-585, 587, 590-591, 594, 596, 600, 602, 604, 607-614, 617-620, 623-624, 627-629, 632-633, 636, 638, 640-642, 645-646, 648-649, 657-662, 664-665, 668-672, 677-678, 682-684, 686, 689, 692-693, 695-697, 699, 706-707, 709-710, 712-714, 716-717, 719-721, 723-728, 730-732, 734-735, 739, 742, 746, 749-750, 752, 754, 756, 762, 768-770, 772-775, 778, 780, 783-787, 789-791, 793, 796, 798-801, 803, 806, 809-812, 814, 816-817, 819, 822-825, 827-829, 832-833, 836-837, 839-840, 846, 848-851, 853-854, 857-858, 860, 863-864, 866, 868-871, 873-875, 877-878, 884, 888-889, 896-897, 900, 905-907, 914-915, 917, 919-920, 923-925, 931-933, 936, 940, 942, 944-945, 948, 950-951, 954, 956-958, 962, 965-970, 972, 975-976, 978-980, 983, 985, 988, 990, 993-994, 997-998, 1000, 1003-1004, 1007, 1009, 1014, 1016, 1018-1019], topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0]] [21:08:00] : [Step 4/5] [2021-11-19 21:08:00,039][INFO ][main][FilePageStoreManager] Cleanup cache stores [total=5, left=0, cleanFiles=false] [21:08:00] : [Step 4/5] [2021-11-19 21:08:00,052][INFO ][main][GridDeploymentLocalStore] Removed undeployed class: GridDeployment [ts=1637345279919, depMode=SHARED, clsLdr=IsolatedClassLoader{roleName='test'}, clsLdrId=8695d593d71-102b5b7d-22c8-4475-b7a7-caa19c6c1001, userVer=0, loc=true, sampleClsName=org.apache.ignite.internal.processors.cache.distributed.dht.preloader.GridDhtPartitionFullMap, pendingUndeploy=false, undeployed=true, usage=0] [21:08:00] : [Step 4/5] [2021-11-19 21:08:00,057][INFO ][exchange-worker-#15354%grid-0%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=00d146be-a209-4645-889f-3df8c43ef000, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], evt=NODE_LEFT, evtNode=TcpDiscoveryNode [id=102b5b7d-22c8-4475-b7a7-caa19c6c1001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637345279758, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0]] [21:08:00] : [Step 4/5] [2021-11-19 21:08:00,058][INFO ][exchange-worker-#15354%grid-0%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (0 ms), stage="Determine exchange type" (1 ms), stage="Preloading notification" (0 ms), stage="After states restored callback" (0 ms), stage="WAL history reservation" (0 ms), stage="Finalize update counters" (1 ms), stage="Detect lost partitions" (11 ms), stage="Exchange done" (10 ms), stage="Total time" (23 ms)] [21:08:00] : [Step 4/5] [2021-11-19 21:08:00,061][INFO ][exchange-worker-#15354%grid-0%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], stage="Affinity initialization (exchange-free switch on fully-rebalanced topology) [grp=encrypted.grid-1]" (1 ms) (parent=Determine exchange type), stage="Affinity initialization (exchange-free switch on fully-rebalanced topology) [grp=encrypted.grid-0]" (1 ms) (parent=Determine exchange type), stage="Affinity initialization (exchange-free switch on fully-rebalanced topology) [grp=ignite-sys-cache]" (0 ms) (parent=Determine exchange type)] [21:08:00] : [Step 4/5] [2021-11-19 21:08:00,065][INFO ][main][IgniteKernal%grid-1] [21:08:00] : [Step 4/5] [21:08:00] : [Step 4/5] >>> +------------------------------------------------------+ [21:08:00] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV stopped OK [21:08:00] : [Step 4/5] >>> +------------------------------------------------------+ [21:08:00] : [Step 4/5] >>> Ignite instance name: grid-1 [21:08:00] : [Step 4/5] >>> Grid uptime: 00:00:00.244 [21:08:00] : [Step 4/5] [21:08:00] : [Step 4/5] [21:08:00] : [Step 4/5] [2021-11-19 21:08:00,065][INFO ][exchange-worker-#15354%grid-0%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], crd=true] [21:08:00] : [Step 4/5] [2021-11-19 21:08:00,065][INFO ][main][root] >>> Stopping grid [name=grid-0, id=00d146be-a209-4645-889f-3df8c43ef000] [21:08:00] : [Step 4/5] [2021-11-19 21:08:00,069][INFO ][exchange-worker-#15354%grid-0%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=3, minorTopVer=0], force=false, evt=NODE_LEFT, node=102b5b7d-22c8-4475-b7a7-caa19c6c1001] [21:08:00] : [Step 4/5] [2021-11-19 21:08:00,079][INFO ][db-checkpoint-thread-#15490%grid-0%][Checkpointer] Skipping checkpoint (no pages were modified) [checkpointBeforeLockTime=2ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=1ms, checkpointLockHoldTime=2ms, reason='timeout'] [21:08:00] : [Step 4/5] [2021-11-19 21:08:00,083][INFO ][db-checkpoint-thread-#15490%grid-0%][Checkpointer] Skipping checkpoint (no pages were modified) [checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=1ms, checkpointLockHoldTime=2ms, reason='timeout'] [21:08:00] : [Step 4/5] [2021-11-19 21:08:00,087][INFO ][tcp-disco-sock-reader-[102b5b7d 127.0.0.1:42565]-#809%grid-0%-#15474%grid-0%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:42565, rmtPort=42565, rmtNodeId=102b5b7d-22c8-4475-b7a7-caa19c6c1001] [21:08:00] : [Step 4/5] [2021-11-19 21:08:00,233][INFO ][main][GridCacheProcessor] Stopped cache [cacheName=encrypted.grid-1] [21:08:00] : [Step 4/5] [2021-11-19 21:08:00,233][INFO ][main][GridCacheProcessor] Stopped cache [cacheName=encrypted.grid-0] [21:08:00] : [Step 4/5] [2021-11-19 21:08:00,234][INFO ][main][GridCacheProcessor] Stopped cache [cacheName=ignite-sys-cache] [21:08:00] : [Step 4/5] [2021-11-19 21:08:00,259][INFO ][main][FilePageStoreManager] Cleanup cache stores [total=5, left=0, cleanFiles=false] [21:08:00] : [Step 4/5] [2021-11-19 21:08:00,261][INFO ][main][GridDeploymentLocalStore] Removed undeployed class: GridDeployment [ts=1637345279889, depMode=SHARED, clsLdr=IsolatedClassLoader{roleName='test'}, clsLdrId=6695d593d71-00d146be-a209-4645-889f-3df8c43ef000, userVer=0, loc=true, sampleClsName=org.apache.ignite.internal.processors.cache.distributed.dht.preloader.GridDhtPartitionMap, pendingUndeploy=false, undeployed=true, usage=0] [21:08:00] : [Step 4/5] [2021-11-19 21:08:00,268][INFO ][main][IgniteKernal%grid-0] [21:08:00] : [Step 4/5] [21:08:00] : [Step 4/5] >>> +------------------------------------------------------+ [21:08:00] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV stopped OK [21:08:00] : [Step 4/5] >>> +------------------------------------------------------+ [21:08:00] : [Step 4/5] >>> Ignite instance name: grid-0 [21:08:00] : [Step 4/5] >>> Grid uptime: 00:00:02.069 [21:08:00] : [Step 4/5] [21:08:00] : [Step 4/5] [21:08:00] : [Step 4/5] [21:08:00] >>> Stopping test class: EncryptedCachePreconfiguredRestartTest <<< [21:08:00] : [Step 4/5] [2021-11-19 21:08:00,547][INFO ][main][root] >>> Stopping test class: EncryptedCachePreconfiguredRestartTest <<< [21:08:00] : [Step 4/5] [21:08:00] >>> Starting test class: SingleNodePersistenceSslTest <<< [21:08:00] : [Step 4/5] [2021-11-19 21:08:00,548][INFO ][main][root] >>> Starting test class: SingleNodePersistenceSslTest <<< [21:08:00] : [Step 4/5] Running org.apache.ignite.internal.processors.cache.persistence.SingleNodePersistenceSslTest [21:08:00]i: [Step 4/5] ##teamcity[importData type='surefire' path='/opt/buildagent/temp/buildTmp/ignite-tools-junit-reports1777670380320881607/test-org.apache.ignite.testsuites.IgniteBasicWithPersistenceTestSuite1637345245566.xml'] [21:08:00] : [Step 4/5] Importing data from '/opt/buildagent/temp/buildTmp/ignite-tools-junit-reports1777670380320881607/test-org.apache.ignite.testsuites.IgniteBasicWithPersistenceTestSuite1637345245566.xml' (448 B) with 'surefire' processor [21:08:00] : [Step 4/5] [21:08:00] >>> Starting test: SingleNodePersistenceSslTest#testActivate <<< [21:08:00] : [Step 4/5] [2021-11-19 21:08:00,558][INFO ][main][root] >>> Starting test: SingleNodePersistenceSslTest#testActivate <<< [21:08:00] : [Step 4/5] [21:08:00] >>> Heap: 475 MB used / 1908 MB commited / 1908 MB max <<< [21:08:00] : [Step 4/5] [2021-11-19 21:08:00,558][INFO ][main][root] >>> Heap: 475 MB used / 1908 MB commited / 1908 MB max <<< [21:08:00] : [Step 4/5] [21:08:00] >>> Non-Heap: 155 MB used / 171 MB commited / 0 MB max <<< [21:08:00] : [Step 4/5] [2021-11-19 21:08:00,558][INFO ][main][root] >>> Non-Heap: 155 MB used / 171 MB commited / 0 MB max <<< [21:08:00]W: [org.apache.ignite:ignite-core] [2021-11-19 21:08:00,575][WARN ][test-runner-#15509%persistence.SingleNodePersistenceSslTest%][G] Ignite work directory is not provided, automatically resolved to: /opt/buildagent/work/7bc1c54bc719b67c/work [21:08:00]W: [org.apache.ignite:ignite-core] [2021-11-19 21:08:00,575][WARN ][test-runner-#15509%persistence.SingleNodePersistenceSslTest%][G] Consistent ID is not set, it is recommended to set consistent ID for production clusters (use IgniteConfiguration.setConsistentId property) [21:08:00] : [Step 4/5] [2021-11-19 21:08:00,577][INFO ][test-runner-#15509%persistence.SingleNodePersistenceSslTest%][SingleNodePersistenceSslTest0] [21:08:00] : [Step 4/5] [21:08:00] : [Step 4/5] >>> __________ ________________ [21:08:00] : [Step 4/5] >>> / _/ ___/ |/ / _/_ __/ __/ [21:08:00] : [Step 4/5] >>> _/ // (7 7 // / / / / _/ [21:08:00] : [Step 4/5] >>> /___/\___/_/|_/___/ /_/ /___/ [21:08:00] : [Step 4/5] >>> [21:08:00] : [Step 4/5] >>> ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:08:00] : [Step 4/5] >>> 2021 Copyright(C) Apache Software Foundation [21:08:00] : [Step 4/5] >>> [21:08:00] : [Step 4/5] >>> Ignite documentation: http://ignite.apache.org [21:08:00] : [Step 4/5] [21:08:00] : [Step 4/5] [2021-11-19 21:08:00,578][INFO ][test-runner-#15509%persistence.SingleNodePersistenceSslTest%][SingleNodePersistenceSslTest0] Config URL: n/a [21:08:00] : [Step 4/5] [2021-11-19 21:08:00,579][INFO ][test-runner-#15509%persistence.SingleNodePersistenceSslTest%][SingleNodePersistenceSslTest0] IgniteConfiguration [igniteInstanceName=persistence.SingleNodePersistenceSslTest0, pubPoolSize=24, svcPoolSize=24, callbackPoolSize=24, stripedPoolSize=24, sysPoolSize=24, mgmtPoolSize=4, dataStreamerPoolSize=24, utilityCachePoolSize=24, utilityCacheKeepAliveTime=60000, p2pPoolSize=2, qryPoolSize=24, buildIdxPoolSize=4, igniteHome=/opt/buildagent/work/7bc1c54bc719b67c, igniteWorkDir=/opt/buildagent/work/7bc1c54bc719b67c/work, mbeanSrv=com.sun.jmx.mbeanserver.JmxMBeanServer@6fe85038, nodeId=6d213588-b47c-4157-b1d4-71df71900000, marsh=BinaryMarshaller [], marshLocJobs=false, daemon=false, p2pEnabled=true, netTimeout=10000, netCompressionLevel=1, sndRetryDelay=1000, sndRetryCnt=3, metricsHistSize=10000, metricsUpdateFreq=1000, metricsExpTime=9223372036854775807, discoSpi=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=0, ackTimeout=0, marsh=null, reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], segPlc=STOP, segResolveAttempts=2, waitForSegOnStart=true, allResolversPassReq=true, segChkFreq=10000, commSpi=TcpCommunicationSpi [connectGate=org.apache.ignite.spi.communication.tcp.internal.ConnectGateway@4316c029, ctxInitLatch=java.util.concurrent.CountDownLatch@4bef4a76[Count = 1], stopping=false, clientPool=null, nioSrvWrapper=null, stateProvider=null], evtSpi=MemoryEventStorageSpi [expireAgeMs=9223372036854775807, expireCnt=10000, filter=null], colSpi=NoopCollisionSpi [], deploySpi=LocalDeploymentSpi [], indexingSpi=org.apache.ignite.spi.indexing.noop.NoopIndexingSpi@3247e6e2, addrRslvr=null, encryptionSpi=org.apache.ignite.spi.encryption.noop.NoopEncryptionSpi@7da15a76, tracingSpi=org.apache.ignite.spi.tracing.NoopTracingSpi@4ab5df08, clientMode=false, rebalanceThreadPoolSize=4, rebalanceTimeout=10000, rebalanceBatchesPrefetchCnt=3, rebalanceThrottle=0, rebalanceBatchSize=524288, txCfg=TransactionConfiguration [txSerEnabled=false, dfltIsolation=REPEATABLE_READ, dfltConcurrency=PESSIMISTIC, dfltTxTimeout=0, txTimeoutOnPartitionMapExchange=0, deadlockTimeout=10000, pessimisticTxLogSize=0, pessimisticTxLogLinger=10000, tmLookupClsName=null, txManagerFactory=null, useJtaSync=false], cacheSanityCheckEnabled=true, discoStartupDelay=60000, deployMode=SHARED, p2pMissedCacheSize=100, locHost=127.0.0.1, timeSrvPortBase=31100, timeSrvPortRange=100, failureDetectionTimeout=10000, sysWorkerBlockedTimeout=null, clientFailureDetectionTimeout=10000, metricsLogFreq=0, connectorCfg=null, odbcCfg=null, warmupClos=null, atomicCfg=AtomicConfiguration [seqReserveSize=1000, cacheMode=PARTITIONED, backups=1, aff=null, grpName=null], classLdr=null, sslCtxFactory=SslContextFactory[keyStoreType=JKS, proto=TLS, keyStoreFile=/opt/buildagent/work/7bc1c54bc719b67c/modules/clients/src/test/keystore/server.jks, trustMgrs=[org.apache.ignite.ssl.SslContextFactory$DisabledX509TrustManager@63c883bc]], platformCfg=null, binaryCfg=null, memCfg=null, pstCfg=null, dsCfg=DataStorageConfiguration [sysRegionInitSize=41943040, sysRegionMaxSize=104857600, pageSize=0, concLvl=0, dfltDataRegConf=DataRegionConfiguration [name=default, maxSize=268435456, initSize=268435456, swapPath=null, pageEvictionMode=DISABLED, pageReplacementMode=CLOCK, evictionThreshold=0.9, emptyPagesPoolSize=100, metricsEnabled=false, metricsSubIntervalCount=5, metricsRateTimeInterval=60000, persistenceEnabled=true, checkpointPageBufSize=0, lazyMemoryAllocation=true, warmUpCfg=null], dataRegions=null, storagePath=null, checkpointFreq=180000, lockWaitTime=10000, checkpointThreads=4, checkpointWriteOrder=SEQUENTIAL, walHistSize=20, maxWalArchiveSize=1073741824, walSegments=10, walSegmentSize=67108864, walPath=db/wal, walArchivePath=db/wal/archive, cdcWalPath=db/wal/cdc, cdcEnabled=false, metricsEnabled=false, walMode=LOG_ONLY, walTlbSize=131072, walBuffSize=0, walFlushFreq=2000, walFsyncDelay=1000, walRecordIterBuffSize=67108864, alwaysWriteFullPages=false, fileIOFactory=org.apache.ignite.internal.processors.cache.persistence.file.AsyncFileIOFactory@5c3569f, metricsSubIntervalCnt=5, metricsRateTimeInterval=60000, walAutoArchiveAfterInactivity=-1, walForceArchiveTimeout=-1, writeThrottlingEnabled=false, walCompactionEnabled=false, walCompactionLevel=1, checkpointReadLockTimeout=null, walPageCompression=DISABLED, walPageCompressionLevel=null, dfltWarmUpCfg=null, encCfg=org.apache.ignite.configuration.EncryptionConfiguration@2231e0f8, defragmentationThreadPoolSize=4, minWalArchiveSize=-1], snapshotPath=snapshots, activeOnStart=true, activeOnStartPropSetFlag=false, autoActivation=true, autoActivationPropSetFlag=false, clusterStateOnStart=null, sqlConnCfg=null, cliConnCfg=ClientConnectorConfiguration [host=null, port=10800, portRange=100, sockSndBufSize=0, sockRcvBufSize=0, tcpNoDelay=true, maxOpenCursorsPerConn=128, threadPoolSize=24, selectorCnt=12, idleTimeout=0, handshakeTimeout=10000, jdbcEnabled=true, odbcEnabled=true, thinCliEnabled=true, sslEnabled=false, useIgniteSslCtxFactory=true, sslClientAuth=false, sslCtxFactory=null, thinCliCfg=ThinClientConfiguration [maxActiveTxPerConn=100, maxActiveComputeTasksPerConn=0]], mvccVacuumThreadCnt=2, mvccVacuumFreq=5000, authEnabled=false, failureHnd=StopNodeFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]], commFailureRslvr=null, sqlCfg=SqlConfiguration [longQryWarnTimeout=3000, dfltQryTimeout=0, sqlQryHistSize=1000, validationEnabled=false], asyncContinuationExecutor=null] [21:08:00] : [Step 4/5] [2021-11-19 21:08:00,588][INFO ][test-runner-#15509%persistence.SingleNodePersistenceSslTest%][SingleNodePersistenceSslTest0] Daemon mode: off [21:08:00] : [Step 4/5] [2021-11-19 21:08:00,588][INFO ][test-runner-#15509%persistence.SingleNodePersistenceSslTest%][SingleNodePersistenceSslTest0] OS: Linux 4.15.0-151-generic amd64 [21:08:00] : [Step 4/5] [2021-11-19 21:08:00,588][INFO ][test-runner-#15509%persistence.SingleNodePersistenceSslTest%][SingleNodePersistenceSslTest0] OS user: teamcity [21:08:00] : [Step 4/5] [2021-11-19 21:08:00,589][INFO ][test-runner-#15509%persistence.SingleNodePersistenceSslTest%][SingleNodePersistenceSslTest0] PID: 16724 [21:08:00] : [Step 4/5] [2021-11-19 21:08:00,589][INFO ][test-runner-#15509%persistence.SingleNodePersistenceSslTest%][SingleNodePersistenceSslTest0] Language runtime: Java Platform API Specification ver. 1.8 [21:08:00] : [Step 4/5] [2021-11-19 21:08:00,589][INFO ][test-runner-#15509%persistence.SingleNodePersistenceSslTest%][SingleNodePersistenceSslTest0] VM information: Java(TM) SE Runtime Environment 1.8.0_261-b12 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 25.261-b12 [21:08:00] : [Step 4/5] [2021-11-19 21:08:00,590][INFO ][test-runner-#15509%persistence.SingleNodePersistenceSslTest%][SingleNodePersistenceSslTest0] VM total memory: 1.9GB [21:08:00] : [Step 4/5] [2021-11-19 21:08:00,590][INFO ][test-runner-#15509%persistence.SingleNodePersistenceSslTest%][SingleNodePersistenceSslTest0] Remote Management [restart: off, REST: off, JMX (remote: off)] [21:08:00] : [Step 4/5] [2021-11-19 21:08:00,590][INFO ][test-runner-#15509%persistence.SingleNodePersistenceSslTest%][SingleNodePersistenceSslTest0] Logger: GridTestLog4jLogger [quiet=false, config=null] [21:08:00] : [Step 4/5] [2021-11-19 21:08:00,590][INFO ][test-runner-#15509%persistence.SingleNodePersistenceSslTest%][SingleNodePersistenceSslTest0] IGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c [21:08:00] : [Step 4/5] [2021-11-19 21:08:00,591][INFO ][test-runner-#15509%persistence.SingleNodePersistenceSslTest%][SingleNodePersistenceSslTest0] VM arguments: [-DIGNITE_DUMP_THREADS_ON_FAILURE=false, -DMono=/usr/bin/mono-sgen, -DMono4.0_x64=/usr/lib/mono/4.0, -DMono4.5_x64=/usr/lib/mono/4.5, -DMonoVersion=6.12.0.90, -DSKIP_BUILD=false, -Dagent.home.dir=/opt/buildagent, -Dagent.name=aitc-lin02_03, -Dagent.ownPort=9090, -Dagent.work.dir=/opt/buildagent/work, -Dbuild.number=95, -Dbuild.vcs.number=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.1=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.GitHubApacheIgnite=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dclassworlds.conf=/opt/buildagent/temp/buildTmp/teamcity.m2.conf, -Dcom.jetbrains.maven.watcher.report.file=/opt/buildagent/temp/buildTmp/maven-build-info.xml, -Djava.io.tmpdir=/opt/buildagent/temp/buildTmp, -Dmaven.home=/opt/buildagent/tools/maven3_6, -Dmaven.multiModuleProjectDirectory=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.agent.cpuBenchmark=457, -Dteamcity.agent.dotnet.agent_url=http://localhost:9090/RPC2, -Dteamcity.agent.dotnet.build_id=6278078, -Dteamcity.auth.password=*******, -Dteamcity.auth.userId=TeamCityBuildId=6278078, -Dteamcity.build.changedFiles.file=/opt/buildagent/temp/buildTmp/changedFiles6342607772318147725.txt, -Dteamcity.build.checkoutDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.build.id=6278078, -Dteamcity.build.properties.file=/opt/buildagent/temp/buildTmp/teamcity.build5164517880467851002.properties, -Dteamcity.build.tempDir=/opt/buildagent/temp/buildTmp, -Dteamcity.build.workingDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.buildConfName=Basic 3, -Dteamcity.buildType.id=IgniteTests24Java8_Basic3, -Dteamcity.configuration.properties.file=/opt/buildagent/temp/buildTmp/teamcity.config5591980786735343870.properties, -Dteamcity.maven.userSettings.path=/opt/buildagent/temp/buildTmp/maven_settings_585072866407032347.xml, -Dteamcity.maven.watcher.home=/opt/buildagent/plugins/mavenPlugin/maven-watcher-jdk16, -Dteamcity.projectName=Ignite Tests 2.x (JDK 8/11), -Dteamcity.runner.properties.file=/opt/buildagent/temp/buildTmp/teamcity.runner9098465561618137420.properties, -Dteamcity.tests.recentlyFailedTests.file=/opt/buildagent/temp/buildTmp/testsToRunFirst3891775683130404069.txt, -Dteamcity.version=2021.2 (build 99542), -ea, -Xms2g, -Xmx2g, -XX:+HeapDumpOnOutOfMemoryError, -DIGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_TEST_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_UPDATE_NOTIFIER=false, -DIGNITE_NO_DISCO_ORDER=true, -DIGNITE_PERFORMANCE_SUGGESTIONS_DISABLED=true, -Djava.net.preferIPv4Stack=true, -DTEST_SCALE_FACTOR=1.0, -DIGNITE_TEST_PROP_LOG4J_FILE=log4j-tc-test.xml, -DIGNITE_QUIET=false, -DIGNITE_MARSHAL_BUFFERS_RECHECK=1000, -Dmaven.repo.local=/opt/buildagent/.m2/repository] [21:08:00] : [Step 4/5] [2021-11-19 21:08:00,595][INFO ][test-runner-#15509%persistence.SingleNodePersistenceSslTest%][SingleNodePersistenceSslTest0] System cache's DataRegion size is configured to 40 MB. Use DataStorageConfiguration.systemRegionInitialSize property to change the setting. [21:08:00] : [Step 4/5] [2021-11-19 21:08:00,595][INFO ][test-runner-#15509%persistence.SingleNodePersistenceSslTest%][SingleNodePersistenceSslTest0] Configured caches [in 'sysMemPlc' dataRegion: ['ignite-sys-cache']] [21:08:00]W: [org.apache.ignite:ignite-core] [2021-11-19 21:08:00,596][WARN ][test-runner-#15509%persistence.SingleNodePersistenceSslTest%][SingleNodePersistenceSslTest0] Peer class loading is enabled (disable it in production for performance and deployment consistency reasons) [21:08:00] : [Step 4/5] [2021-11-19 21:08:00,596][INFO ][test-runner-#15509%persistence.SingleNodePersistenceSslTest%][SingleNodePersistenceSslTest0] 3-rd party licenses can be found at: /opt/buildagent/work/7bc1c54bc719b67c/libs/licenses [21:08:00] : [Step 4/5] [2021-11-19 21:08:00,600][INFO ][test-runner-#15509%persistence.SingleNodePersistenceSslTest%][IgnitePluginProcessor] Configured plugins: [21:08:00] : [Step 4/5] [2021-11-19 21:08:00,601][INFO ][test-runner-#15509%persistence.SingleNodePersistenceSslTest%][IgnitePluginProcessor] ^-- StanByClusterTestProvider 1.0 [21:08:00] : [Step 4/5] [2021-11-19 21:08:00,601][INFO ][test-runner-#15509%persistence.SingleNodePersistenceSslTest%][IgnitePluginProcessor] ^-- null [21:08:00] : [Step 4/5] [2021-11-19 21:08:00,601][INFO ][test-runner-#15509%persistence.SingleNodePersistenceSslTest%][IgnitePluginProcessor] [21:08:00] : [Step 4/5] [2021-11-19 21:08:00,601][INFO ][test-runner-#15509%persistence.SingleNodePersistenceSslTest%][IgnitePluginProcessor] ^-- PageMemory tracker plugin 1.0 [21:08:00] : [Step 4/5] [2021-11-19 21:08:00,601][INFO ][test-runner-#15509%persistence.SingleNodePersistenceSslTest%][IgnitePluginProcessor] ^-- null [21:08:00] : [Step 4/5] [2021-11-19 21:08:00,601][INFO ][test-runner-#15509%persistence.SingleNodePersistenceSslTest%][IgnitePluginProcessor] [21:08:00] : [Step 4/5] [2021-11-19 21:08:00,602][INFO ][test-runner-#15509%persistence.SingleNodePersistenceSslTest%][IgnitePluginProcessor] ^-- TestDistibutedConfigurationPlugin 1.0 [21:08:00] : [Step 4/5] [2021-11-19 21:08:00,602][INFO ][test-runner-#15509%persistence.SingleNodePersistenceSslTest%][IgnitePluginProcessor] ^-- null [21:08:00] : [Step 4/5] [2021-11-19 21:08:00,602][INFO ][test-runner-#15509%persistence.SingleNodePersistenceSslTest%][IgnitePluginProcessor] [21:08:00] : [Step 4/5] [2021-11-19 21:08:00,602][INFO ][test-runner-#15509%persistence.SingleNodePersistenceSslTest%][IgnitePluginProcessor] ^-- NodeValidationPluginProvider 1.0 [21:08:00] : [Step 4/5] [2021-11-19 21:08:00,602][INFO ][test-runner-#15509%persistence.SingleNodePersistenceSslTest%][IgnitePluginProcessor] ^-- null [21:08:00] : [Step 4/5] [2021-11-19 21:08:00,602][INFO ][test-runner-#15509%persistence.SingleNodePersistenceSslTest%][IgnitePluginProcessor] [21:08:00] : [Step 4/5] [2021-11-19 21:08:00,603][INFO ][test-runner-#15509%persistence.SingleNodePersistenceSslTest%][FailureProcessor] Configured failure handler: [hnd=StopNodeFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]]] [21:08:00] : [Step 4/5] [2021-11-19 21:08:00,683][INFO ][test-runner-#15509%persistence.SingleNodePersistenceSslTest%][TcpCommunicationSpi] Successfully bound communication NIO server to TCP port [port=45180, locHost=/127.0.0.1, selectorsCnt=12, selectorSpins=0, pairedConn=false] [21:08:00]W: [org.apache.ignite:ignite-core] [2021-11-19 21:08:00,684][WARN ][test-runner-#15509%persistence.SingleNodePersistenceSslTest%][TcpCommunicationSpi] Message queue limit is set to 0 which may lead to potential OOMEs when running cache operations in FULL_ASYNC or PRIMARY_SYNC modes due to message queues growth on sender and receiver sides. [21:08:00] : [Step 4/5] [2021-11-19 21:08:00,689][INFO ][test-runner-#15509%persistence.SingleNodePersistenceSslTest%][GridCollisionManager] Collision resolution is disabled (all jobs will be activated upon arrival). [21:08:00] : [Step 4/5] [2021-11-19 21:08:00,690][INFO ][test-runner-#15509%persistence.SingleNodePersistenceSslTest%][SingleNodePersistenceSslTest0] Security status [authentication=off, sandbox=off, tls/ssl=on] [21:08:00] : [Step 4/5] [2021-11-19 21:08:00,695][INFO ][test-runner-#15509%persistence.SingleNodePersistenceSslTest%][TestTcpDiscoverySpi] Successfully bound to TCP port [port=47500, localHost=localhost/127.0.0.1, locNodeId=6d213588-b47c-4157-b1d4-71df71900000] [21:08:00] : [Step 4/5] [2021-11-19 21:08:00,749][INFO ][test-runner-#15509%persistence.SingleNodePersistenceSslTest%][PdsFoldersResolver] Successfully created new persistent storage folder [/opt/buildagent/work/7bc1c54bc719b67c/work/db/node00-e845bbf6-3300-4744-9c29-7c79044a42e4] [21:08:00] : [Step 4/5] [2021-11-19 21:08:00,749][INFO ][test-runner-#15509%persistence.SingleNodePersistenceSslTest%][PdsFoldersResolver] Consistent ID used for local node is [e845bbf6-3300-4744-9c29-7c79044a42e4] according to persistence data storage folders [21:08:00] : [Step 4/5] [2021-11-19 21:08:00,750][INFO ][test-runner-#15509%persistence.SingleNodePersistenceSslTest%][MaintenanceProcessor] Resolved store directory for node persistent data: /opt/buildagent/work/7bc1c54bc719b67c/work/db/node00-e845bbf6-3300-4744-9c29-7c79044a42e4 [21:08:00] : [Step 4/5] [2021-11-19 21:08:00,752][INFO ][test-runner-#15509%persistence.SingleNodePersistenceSslTest%][CacheObjectBinaryProcessorImpl] Resolved directory for serialized binary metadata: /opt/buildagent/work/7bc1c54bc719b67c/work/db/binary_meta/node00-e845bbf6-3300-4744-9c29-7c79044a42e4 [21:08:00] : [Step 4/5] [2021-11-19 21:08:00,759][INFO ][test-runner-#15509%persistence.SingleNodePersistenceSslTest%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/node00-e845bbf6-3300-4744-9c29-7c79044a42e4 [21:08:00] : [Step 4/5] [2021-11-19 21:08:00,760][INFO ][test-runner-#15509%persistence.SingleNodePersistenceSslTest%][FileWriteAheadLogManager] Resolved write ahead log work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/node00-e845bbf6-3300-4744-9c29-7c79044a42e4 [21:08:00] : [Step 4/5] [2021-11-19 21:08:00,760][INFO ][test-runner-#15509%persistence.SingleNodePersistenceSslTest%][FileWriteAheadLogManager] Resolved write ahead log archive directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/node00-e845bbf6-3300-4744-9c29-7c79044a42e4 [21:08:00] : [Step 4/5] Surefire report watcher [21:08:00] : [Surefire report watcher] Watching paths: [21:08:00] : [Surefire report watcher] /opt/buildagent/temp/buildTmp/ignite-tools-junit-reports1777670380320881607/test-org.apache.ignite.testsuites.IgniteBasicWithPersistenceTestSuite1637345245566.xml [21:08:00]i: [Step 4/5] org.apache.ignite.testsuites.IgniteBasicWithPersistenceTestSuite [21:08:00]i: [org.apache.ignite.testsuites.IgniteBasicWithPersistenceTestSuite] org.apache.ignite.internal.encryption.EncryptedCachePreconfiguredRestartTest.testCreateEncryptedCache [21:08:00]i: [org.apache.ignite.testsuites.IgniteBasicWithPersistenceTestSuite] org.apache.ignite.internal.encryption.EncryptedCachePreconfiguredRestartTest.testDifferentPreconfiguredCachesOnNodes [21:08:01] : [Step 4/5] [2021-11-19 21:08:01,126][INFO ][test-runner-#15509%persistence.SingleNodePersistenceSslTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/node00-e845bbf6-3300-4744-9c29-7c79044a42e4/0000000000000000.wal [21:08:01] : [Step 4/5] [2021-11-19 21:08:01,127][INFO ][test-runner-#15509%persistence.SingleNodePersistenceSslTest%][FileHandleManagerImpl] Initialized write-ahead log manager [mode=LOG_ONLY] [21:08:01] : [Step 4/5] [2021-11-19 21:08:01,132][INFO ][test-runner-#15509%persistence.SingleNodePersistenceSslTest%][GridCacheDatabaseSharedManager] Configured data regions initialized successfully [total=5] [21:08:01] : [Step 4/5] [2021-11-19 21:08:01,132][INFO ][test-runner-#15509%persistence.SingleNodePersistenceSslTest%][IgniteSnapshotManager] Resolved snapshot work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/snapshots [21:08:01] : [Step 4/5] [2021-11-19 21:08:01,133][INFO ][test-runner-#15509%persistence.SingleNodePersistenceSslTest%][IgniteSnapshotManager] Resolved temp directory for snapshot creation: /opt/buildagent/work/7bc1c54bc719b67c/work/db/node00-e845bbf6-3300-4744-9c29-7c79044a42e4/snp [21:08:01] : [Step 4/5] [2021-11-19 21:08:01,135][INFO ][test-runner-#15509%persistence.SingleNodePersistenceSslTest%][ClientListenerProcessor] Client connector processor has started on TCP port 10800 [21:08:01] : [Step 4/5] [2021-11-19 21:08:01,141][INFO ][test-runner-#15509%persistence.SingleNodePersistenceSslTest%][SingleNodePersistenceSslTest0] Non-loopback local IPs: 172.17.0.4 [21:08:01] : [Step 4/5] [2021-11-19 21:08:01,141][INFO ][test-runner-#15509%persistence.SingleNodePersistenceSslTest%][SingleNodePersistenceSslTest0] Enabled local MACs: 0242AC110004 [21:08:01] : [Step 4/5] [2021-11-19 21:08:01,144][INFO ][test-runner-#15509%persistence.SingleNodePersistenceSslTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:08:01] : [Step 4/5] [2021-11-19 21:08:01,146][INFO ][test-runner-#15509%persistence.SingleNodePersistenceSslTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:08:01] : [Step 4/5] [2021-11-19 21:08:01,146][INFO ][test-runner-#15509%persistence.SingleNodePersistenceSslTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:08:01] : [Step 4/5] [2021-11-19 21:08:01,149][INFO ][test-runner-#15509%persistence.SingleNodePersistenceSslTest%][GridCacheDatabaseSharedManager] Applying lost metastore updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:08:01] : [Step 4/5] [2021-11-19 21:08:01,150][INFO ][test-runner-#15509%persistence.SingleNodePersistenceSslTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=0 ms] [21:08:01] : [Step 4/5] [2021-11-19 21:08:01,151][INFO ][test-runner-#15509%persistence.SingleNodePersistenceSslTest%][GridCacheProcessor] Restoring partition state for local groups. [21:08:01] : [Step 4/5] [2021-11-19 21:08:01,151][INFO ][test-runner-#15509%persistence.SingleNodePersistenceSslTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=0, partitionsProcessed=0, time=0ms] [21:08:01] : [Step 4/5] [2021-11-19 21:08:01,151][INFO ][test-runner-#15509%persistence.SingleNodePersistenceSslTest%][GridEncryptionManager] Encryption keys loaded from metastore. [grps=, masterKeyName=null] [21:08:01] : [Step 4/5] [2021-11-19 21:08:01,156][INFO ][test-runner-#15509%persistence.SingleNodePersistenceSslTest%][ClusterProcessor] Cluster ID and tag has been read from metastorage: null [21:08:01] : [Step 4/5] [2021-11-19 21:08:01,156][INFO ][test-runner-#15509%persistence.SingleNodePersistenceSslTest%][IgniteClusterImpl] Shutdown policy was updated [oldVal=null, newVal=null] [21:08:01] : [Step 4/5] [2021-11-19 21:08:01,157][INFO ][test-runner-#15509%persistence.SingleNodePersistenceSslTest%][GridCacheDatabaseSharedManager] Checkpoint frequency deviation changed [oldVal=null, newVal=null] [21:08:01] : [Step 4/5] [2021-11-19 21:08:01,169][INFO ][test-runner-#15509%persistence.SingleNodePersistenceSslTest%][FilePageStoreManager] Cleanup cache stores [total=1, left=0, cleanFiles=false] [21:08:01] : [Step 4/5] [2021-11-19 21:08:01,171][INFO ][test-runner-#15509%persistence.SingleNodePersistenceSslTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:08:01] : [Step 4/5] [2021-11-19 21:08:01,172][INFO ][test-runner-#15509%persistence.SingleNodePersistenceSslTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:08:01] : [Step 4/5] [2021-11-19 21:08:01,173][INFO ][test-runner-#15509%persistence.SingleNodePersistenceSslTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:08:01] : [Step 4/5] [2021-11-19 21:08:01,174][INFO ][test-runner-#15509%persistence.SingleNodePersistenceSslTest%][GridCacheDatabaseSharedManager] Data Regions Started: 5 [21:08:01] : [Step 4/5] [2021-11-19 21:08:01,174][INFO ][test-runner-#15509%persistence.SingleNodePersistenceSslTest%][GridCacheDatabaseSharedManager] ^-- sysMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:08:01] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:08:01] : [Step 4/5] ^-- default region [type=default, persistence=true, lazyAlloc=true, [21:08:01] : [Step 4/5] ... initCfg=256MB, maxCfg=256MB, usedRam=0MB, freeRam=100%, allocRam=0MB, allocTotal=0MB] [21:08:01] : [Step 4/5] ^-- metastoreMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:08:01] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:08:01] : [Step 4/5] ^-- TxLog region [type=internal, persistence=true, lazyAlloc=false, [21:08:01] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:08:01] : [Step 4/5] ^-- volatileDsMemPlc region [type=user, persistence=false, lazyAlloc=true, [21:08:01] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB] [21:08:01] : [Step 4/5] ^-- Ignite persistence [used=0MB] [21:08:01] : [Step 4/5] [21:08:01] : [Step 4/5] [2021-11-19 21:08:01,176][INFO ][test-runner-#15509%persistence.SingleNodePersistenceSslTest%][GridCacheDatabaseSharedManager] Starting binary memory restore for: [-2100569601] [21:08:01] : [Step 4/5] [2021-11-19 21:08:01,183][INFO ][test-runner-#15509%persistence.SingleNodePersistenceSslTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:08:01] : [Step 4/5] [2021-11-19 21:08:01,183][INFO ][test-runner-#15509%persistence.SingleNodePersistenceSslTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:08:01] : [Step 4/5] [2021-11-19 21:08:01,185][INFO ][test-runner-#15509%persistence.SingleNodePersistenceSslTest%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/node00-e845bbf6-3300-4744-9c29-7c79044a42e4/0000000000000000.wal, offset=0, ver=2] [21:08:01] : [Step 4/5] [2021-11-19 21:08:01,188][INFO ][test-runner-#15509%persistence.SingleNodePersistenceSslTest%][GridCacheProcessor] Started cache in recovery mode [name=ignite-sys-cache, id=-2100569601, dataRegionName=sysMemPlc, mode=REPLICATED, atomicity=TRANSACTIONAL, backups=2147483647, mvcc=false] [21:08:01] : [Step 4/5] [2021-11-19 21:08:01,189][INFO ][test-runner-#15509%persistence.SingleNodePersistenceSslTest%][GridCacheDatabaseSharedManager] Binary recovery performed in 13 ms. [21:08:01] : [Step 4/5] [2021-11-19 21:08:01,189][INFO ][test-runner-#15509%persistence.SingleNodePersistenceSslTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:08:01] : [Step 4/5] [2021-11-19 21:08:01,189][INFO ][test-runner-#15509%persistence.SingleNodePersistenceSslTest%][GridCacheDatabaseSharedManager] Applying lost cache updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:08:01] : [Step 4/5] [2021-11-19 21:08:01,244][INFO ][test-runner-#15509%persistence.SingleNodePersistenceSslTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=61 ms] [21:08:01] : [Step 4/5] [2021-11-19 21:08:01,244][INFO ][test-runner-#15509%persistence.SingleNodePersistenceSslTest%][GridCacheProcessor] Restoring partition state for local groups. [21:08:01] : [Step 4/5] [2021-11-19 21:08:01,257][INFO ][test-runner-#15509%persistence.SingleNodePersistenceSslTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=1, partitionsProcessed=100, time=10ms] [21:08:01] : [Step 4/5] [2021-11-19 21:08:01,647][INFO ][disco-notifier-worker-#15621%persistence.SingleNodePersistenceSslTest0%][MvccProcessorImpl] Assigned mvcc coordinator [crd=MvccCoordinator [topVer=AffinityTopologyVersion [topVer=1, minorTopVer=0], nodeId=6d213588-b47c-4157-b1d4-71df71900000, ver=1637345281639, local=true, initialized=false]] [21:08:01] : [Step 4/5] [2021-11-19 21:08:01,648][INFO ][sys-#15598%persistence.SingleNodePersistenceSslTest0%][ClusterProcessor] Writing cluster ID and tag to metastorage on ready for write ClusterIdAndTag [id=35d307c6-c3f9-47b8-aea2-9f36095907f5, tag=exciting_napier] [21:08:01] : [Step 4/5] [2021-11-19 21:08:01,652][INFO ][disco-notifier-worker-#15621%persistence.SingleNodePersistenceSslTest0%][ClusterProcessor] exciting_napier [21:08:01] : [Step 4/5] [2021-11-19 21:08:01,653][INFO ][disco-notifier-worker-#15621%persistence.SingleNodePersistenceSslTest0%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustEnabled' was changed from 'null' to 'false' [21:08:01] : [Step 4/5] [2021-11-19 21:08:01,654][INFO ][disco-notifier-worker-#15621%persistence.SingleNodePersistenceSslTest0%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustTimeout' was changed from 'null' to '300000' [21:08:01] : [Step 4/5] [2021-11-19 21:08:01,655][INFO ][disco-notifier-worker-#15621%persistence.SingleNodePersistenceSslTest0%][IgniteTxManager] Transactions parameter 'longOperationsDumpTimeout' was changed from 'null' to '60000' [21:08:01] : [Step 4/5] [2021-11-19 21:08:01,656][INFO ][disco-notifier-worker-#15621%persistence.SingleNodePersistenceSslTest0%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpThreshold' was changed from 'null' to '0' [21:08:01] : [Step 4/5] [2021-11-19 21:08:01,656][INFO ][disco-notifier-worker-#15621%persistence.SingleNodePersistenceSslTest0%][IgniteTxManager] Transactions parameter 'transactionTimeDumpSamplesCoefficient' was changed from 'null' to '0.0' [21:08:01] : [Step 4/5] [2021-11-19 21:08:01,657][INFO ][disco-notifier-worker-#15621%persistence.SingleNodePersistenceSslTest0%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpSamplesPerSecondLimit' was changed from 'null' to '5' [21:08:01] : [Step 4/5] [2021-11-19 21:08:01,658][INFO ][disco-notifier-worker-#15621%persistence.SingleNodePersistenceSslTest0%][IgniteTxManager] Transactions parameter 'collisionsDumpInterval' was changed from 'null' to '1000' [21:08:01] : [Step 4/5] [2021-11-19 21:08:01,661][INFO ][disco-notifier-worker-#15621%persistence.SingleNodePersistenceSslTest0%][IgniteTxManager] Transactions parameter 'txOwnerDumpRequestsAllowed' was changed from 'null' to 'true' [21:08:01] : [Step 4/5] [2021-11-19 21:08:01,662][INFO ][disco-notifier-worker-#15621%persistence.SingleNodePersistenceSslTest0%][GridCacheDatabaseSharedManager] Historical rebalance WAL threshold changed [property=historical.rebalance.threshold, oldVal=null, newVal=500] [21:08:01] : [Step 4/5] [2021-11-19 21:08:01,663][INFO ][test-runner-#15509%persistence.SingleNodePersistenceSslTest%][SingleNodePersistenceSslTest0] To start Console Management & Monitoring run ignitevisorcmd.{sh|bat} [21:08:01] : [Step 4/5] [2021-11-19 21:08:01,664][INFO ][test-runner-#15509%persistence.SingleNodePersistenceSslTest%][SingleNodePersistenceSslTest0] [21:08:01] : [Step 4/5] [21:08:01] : [Step 4/5] >>> +-------------------------------------------+ [21:08:01] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:08:01] : [Step 4/5] >>> +-------------------------------------------+ [21:08:01] : [Step 4/5] >>> OS name: Linux 4.15.0-151-generic amd64 [21:08:01] : [Step 4/5] >>> CPU(s): 24 [21:08:01] : [Step 4/5] >>> Heap: 2.0GB [21:08:01] : [Step 4/5] >>> VM name: 16724@c4dfe9a430b2 [21:08:01] : [Step 4/5] >>> Ignite instance name: persistence.SingleNodePersistenceSslTest0 [21:08:01] : [Step 4/5] >>> Local node [ID=6D213588-B47C-4157-B1D4-71DF71900000, order=1, clientMode=false] [21:08:01] : [Step 4/5] >>> Local node addresses: [127.0.0.1] [21:08:01] : [Step 4/5] >>> Local ports: TCP:10800 TCP:45180 TCP:47500 [21:08:01] : [Step 4/5] [21:08:01] : [Step 4/5] [2021-11-19 21:08:01,665][INFO ][test-runner-#15509%persistence.SingleNodePersistenceSslTest%][SingleNodePersistenceSslTest0] >>> Ignite cluster is in INACTIVE state (limited functionality available). Use control.(sh|bat) script or IgniteCluster.state(ClusterState.ACTIVE) to change the state. [21:08:01] : [Step 4/5] [2021-11-19 21:08:01,665][INFO ][test-runner-#15509%persistence.SingleNodePersistenceSslTest%][GridDiscoveryManager] Topology snapshot [ver=1, locNode=6d213588, servers=1, clients=0, state=INACTIVE, CPUs=24, offheap=0.25GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=6d213588-b47c-4157-b1d4-71df71900000, consistentId=e845bbf6-3300-4744-9c29-7c79044a42e4, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:08:01] : [Step 4/5] [2021-11-19 21:08:01,666][INFO ][test-runner-#15509%persistence.SingleNodePersistenceSslTest%][G] Node started : [stage="Configure system pool" (0 ms),stage="Start managers" (175 ms),stage="Configure binary metadata" (3 ms),stage="Start processors" (386 ms),stage="Start 'StanByClusterTestProvider' plugin" (0 ms),stage="Start 'PageMemory tracker plugin' plugin" (0 ms),stage="Start 'TestDistibutedConfigurationPlugin' plugin" (0 ms),stage="Start 'NodeValidationPluginProvider' plugin" (0 ms),stage="Init metastore" (28 ms),stage="Init and start regions" (6 ms),stage="Restore binary memory" (13 ms),stage="Restore logical state" (68 ms),stage="Finish recovery" (377 ms),stage="Join topology" (11 ms),stage="Await transition" (1 ms),stage="Await exchange" (16 ms),stage="Total time" (1084 ms)] [21:08:01] : [Step 4/5] [2021-11-19 21:08:01,667][INFO ][test-runner-#15509%persistence.SingleNodePersistenceSslTest%][root] Node started with the following configuration [id=6d213588-b47c-4157-b1d4-71df71900000, marshaller=BinaryMarshaller [], discovery=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=5000, ackTimeout=5000, marsh=JdkMarshaller [clsFilter=org.apache.ignite.marshaller.MarshallerUtils$1@7ad39802], reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], binaryCfg=null, lateAff=true] [21:08:01]W: [org.apache.ignite:ignite-core] [2021-11-19 21:08:01,673][WARN ][test-runner-#15509%persistence.SingleNodePersistenceSslTest%][G] Ignite work directory is not provided, automatically resolved to: /opt/buildagent/work/7bc1c54bc719b67c/work [21:08:01]W: [org.apache.ignite:ignite-core] [2021-11-19 21:08:01,673][WARN ][test-runner-#15509%persistence.SingleNodePersistenceSslTest%][G] Consistent ID is not set, it is recommended to set consistent ID for production clusters (use IgniteConfiguration.setConsistentId property) [21:08:01] : [Step 4/5] [2021-11-19 21:08:01,674][INFO ][test-runner-#15509%persistence.SingleNodePersistenceSslTest%][SingleNodePersistenceSslTest1] [21:08:01] : [Step 4/5] [21:08:01] : [Step 4/5] >>> __________ ________________ [21:08:01] : [Step 4/5] >>> / _/ ___/ |/ / _/_ __/ __/ [21:08:01] : [Step 4/5] >>> _/ // (7 7 // / / / / _/ [21:08:01] : [Step 4/5] >>> /___/\___/_/|_/___/ /_/ /___/ [21:08:01] : [Step 4/5] >>> [21:08:01] : [Step 4/5] >>> ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:08:01] : [Step 4/5] >>> 2021 Copyright(C) Apache Software Foundation [21:08:01] : [Step 4/5] >>> [21:08:01] : [Step 4/5] >>> Ignite documentation: http://ignite.apache.org [21:08:01] : [Step 4/5] [21:08:01] : [Step 4/5] [2021-11-19 21:08:01,675][INFO ][test-runner-#15509%persistence.SingleNodePersistenceSslTest%][SingleNodePersistenceSslTest1] Config URL: n/a [21:08:01] : [Step 4/5] [2021-11-19 21:08:01,675][INFO ][test-runner-#15509%persistence.SingleNodePersistenceSslTest%][SingleNodePersistenceSslTest1] IgniteConfiguration [igniteInstanceName=persistence.SingleNodePersistenceSslTest1, pubPoolSize=24, svcPoolSize=24, callbackPoolSize=24, stripedPoolSize=24, sysPoolSize=24, mgmtPoolSize=4, dataStreamerPoolSize=24, utilityCachePoolSize=24, utilityCacheKeepAliveTime=60000, p2pPoolSize=2, qryPoolSize=24, buildIdxPoolSize=4, igniteHome=/opt/buildagent/work/7bc1c54bc719b67c, igniteWorkDir=/opt/buildagent/work/7bc1c54bc719b67c/work, mbeanSrv=com.sun.jmx.mbeanserver.JmxMBeanServer@6fe85038, nodeId=6d827695-63a0-48c5-b3f8-d61ba2d00001, marsh=BinaryMarshaller [], marshLocJobs=false, daemon=false, p2pEnabled=true, netTimeout=10000, netCompressionLevel=1, sndRetryDelay=1000, sndRetryCnt=3, metricsHistSize=10000, metricsUpdateFreq=1000, metricsExpTime=9223372036854775807, discoSpi=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=0, ackTimeout=0, marsh=null, reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], segPlc=STOP, segResolveAttempts=2, waitForSegOnStart=true, allResolversPassReq=true, segChkFreq=10000, commSpi=TcpCommunicationSpi [connectGate=org.apache.ignite.spi.communication.tcp.internal.ConnectGateway@833db1a, ctxInitLatch=java.util.concurrent.CountDownLatch@627afb05[Count = 1], stopping=false, clientPool=null, nioSrvWrapper=null, stateProvider=null], evtSpi=MemoryEventStorageSpi [expireAgeMs=9223372036854775807, expireCnt=10000, filter=null], colSpi=NoopCollisionSpi [], deploySpi=LocalDeploymentSpi [], indexingSpi=org.apache.ignite.spi.indexing.noop.NoopIndexingSpi@16475c17, addrRslvr=null, encryptionSpi=org.apache.ignite.spi.encryption.noop.NoopEncryptionSpi@55f01922, tracingSpi=org.apache.ignite.spi.tracing.NoopTracingSpi@e7e61a4, clientMode=false, rebalanceThreadPoolSize=4, rebalanceTimeout=10000, rebalanceBatchesPrefetchCnt=3, rebalanceThrottle=0, rebalanceBatchSize=524288, txCfg=TransactionConfiguration [txSerEnabled=false, dfltIsolation=REPEATABLE_READ, dfltConcurrency=PESSIMISTIC, dfltTxTimeout=0, txTimeoutOnPartitionMapExchange=0, deadlockTimeout=10000, pessimisticTxLogSize=0, pessimisticTxLogLinger=10000, tmLookupClsName=null, txManagerFactory=null, useJtaSync=false], cacheSanityCheckEnabled=true, discoStartupDelay=60000, deployMode=SHARED, p2pMissedCacheSize=100, locHost=127.0.0.1, timeSrvPortBase=31100, timeSrvPortRange=100, failureDetectionTimeout=10000, sysWorkerBlockedTimeout=null, clientFailureDetectionTimeout=10000, metricsLogFreq=0, connectorCfg=null, odbcCfg=null, warmupClos=null, atomicCfg=AtomicConfiguration [seqReserveSize=1000, cacheMode=PARTITIONED, backups=1, aff=null, grpName=null], classLdr=null, sslCtxFactory=SslContextFactory[keyStoreType=JKS, proto=TLS, keyStoreFile=/opt/buildagent/work/7bc1c54bc719b67c/modules/clients/src/test/keystore/server.jks, trustMgrs=[org.apache.ignite.ssl.SslContextFactory$DisabledX509TrustManager@5ee6605c]], platformCfg=null, binaryCfg=null, memCfg=null, pstCfg=null, dsCfg=DataStorageConfiguration [sysRegionInitSize=41943040, sysRegionMaxSize=104857600, pageSize=0, concLvl=0, dfltDataRegConf=DataRegionConfiguration [name=default, maxSize=268435456, initSize=268435456, swapPath=null, pageEvictionMode=DISABLED, pageReplacementMode=CLOCK, evictionThreshold=0.9, emptyPagesPoolSize=100, metricsEnabled=false, metricsSubIntervalCount=5, metricsRateTimeInterval=60000, persistenceEnabled=true, checkpointPageBufSize=0, lazyMemoryAllocation=true, warmUpCfg=null], dataRegions=null, storagePath=null, checkpointFreq=180000, lockWaitTime=10000, checkpointThreads=4, checkpointWriteOrder=SEQUENTIAL, walHistSize=20, maxWalArchiveSize=1073741824, walSegments=10, walSegmentSize=67108864, walPath=db/wal, walArchivePath=db/wal/archive, cdcWalPath=db/wal/cdc, cdcEnabled=false, metricsEnabled=false, walMode=LOG_ONLY, walTlbSize=131072, walBuffSize=0, walFlushFreq=2000, walFsyncDelay=1000, walRecordIterBuffSize=67108864, alwaysWriteFullPages=false, fileIOFactory=org.apache.ignite.internal.processors.cache.persistence.file.AsyncFileIOFactory@39f99589, metricsSubIntervalCnt=5, metricsRateTimeInterval=60000, walAutoArchiveAfterInactivity=-1, walForceArchiveTimeout=-1, writeThrottlingEnabled=false, walCompactionEnabled=false, walCompactionLevel=1, checkpointReadLockTimeout=null, walPageCompression=DISABLED, walPageCompressionLevel=null, dfltWarmUpCfg=null, encCfg=org.apache.ignite.configuration.EncryptionConfiguration@54f0f66a, defragmentationThreadPoolSize=4, minWalArchiveSize=-1], snapshotPath=snapshots, activeOnStart=true, activeOnStartPropSetFlag=false, autoActivation=true, autoActivationPropSetFlag=false, clusterStateOnStart=null, sqlConnCfg=null, cliConnCfg=ClientConnectorConfiguration [host=null, port=10800, portRange=100, sockSndBufSize=0, sockRcvBufSize=0, tcpNoDelay=true, maxOpenCursorsPerConn=128, threadPoolSize=24, selectorCnt=12, idleTimeout=0, handshakeTimeout=10000, jdbcEnabled=true, odbcEnabled=true, thinCliEnabled=true, sslEnabled=false, useIgniteSslCtxFactory=true, sslClientAuth=false, sslCtxFactory=null, thinCliCfg=ThinClientConfiguration [maxActiveTxPerConn=100, maxActiveComputeTasksPerConn=0]], mvccVacuumThreadCnt=2, mvccVacuumFreq=5000, authEnabled=false, failureHnd=StopNodeFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]], commFailureRslvr=null, sqlCfg=SqlConfiguration [longQryWarnTimeout=3000, dfltQryTimeout=0, sqlQryHistSize=1000, validationEnabled=false], asyncContinuationExecutor=null] [21:08:01] : [Step 4/5] [2021-11-19 21:08:01,685][INFO ][test-runner-#15509%persistence.SingleNodePersistenceSslTest%][SingleNodePersistenceSslTest1] Daemon mode: off [21:08:01] : [Step 4/5] [2021-11-19 21:08:01,685][INFO ][test-runner-#15509%persistence.SingleNodePersistenceSslTest%][SingleNodePersistenceSslTest1] OS: Linux 4.15.0-151-generic amd64 [21:08:01] : [Step 4/5] [2021-11-19 21:08:01,685][INFO ][test-runner-#15509%persistence.SingleNodePersistenceSslTest%][SingleNodePersistenceSslTest1] OS user: teamcity [21:08:01] : [Step 4/5] [2021-11-19 21:08:01,685][INFO ][test-runner-#15509%persistence.SingleNodePersistenceSslTest%][SingleNodePersistenceSslTest1] PID: 16724 [21:08:01] : [Step 4/5] [2021-11-19 21:08:01,686][INFO ][test-runner-#15509%persistence.SingleNodePersistenceSslTest%][SingleNodePersistenceSslTest1] Language runtime: Java Platform API Specification ver. 1.8 [21:08:01] : [Step 4/5] [2021-11-19 21:08:01,686][INFO ][test-runner-#15509%persistence.SingleNodePersistenceSslTest%][SingleNodePersistenceSslTest1] VM information: Java(TM) SE Runtime Environment 1.8.0_261-b12 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 25.261-b12 [21:08:01] : [Step 4/5] [2021-11-19 21:08:01,687][INFO ][test-runner-#15509%persistence.SingleNodePersistenceSslTest%][SingleNodePersistenceSslTest1] VM total memory: 1.9GB [21:08:01] : [Step 4/5] [2021-11-19 21:08:01,687][INFO ][test-runner-#15509%persistence.SingleNodePersistenceSslTest%][SingleNodePersistenceSslTest1] Remote Management [restart: off, REST: off, JMX (remote: off)] [21:08:01] : [Step 4/5] [2021-11-19 21:08:01,687][INFO ][test-runner-#15509%persistence.SingleNodePersistenceSslTest%][SingleNodePersistenceSslTest1] Logger: GridTestLog4jLogger [quiet=false, config=null] [21:08:01] : [Step 4/5] [2021-11-19 21:08:01,688][INFO ][test-runner-#15509%persistence.SingleNodePersistenceSslTest%][SingleNodePersistenceSslTest1] IGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c [21:08:01] : [Step 4/5] [2021-11-19 21:08:01,688][INFO ][test-runner-#15509%persistence.SingleNodePersistenceSslTest%][SingleNodePersistenceSslTest1] VM arguments: [-DIGNITE_DUMP_THREADS_ON_FAILURE=false, -DMono=/usr/bin/mono-sgen, -DMono4.0_x64=/usr/lib/mono/4.0, -DMono4.5_x64=/usr/lib/mono/4.5, -DMonoVersion=6.12.0.90, -DSKIP_BUILD=false, -Dagent.home.dir=/opt/buildagent, -Dagent.name=aitc-lin02_03, -Dagent.ownPort=9090, -Dagent.work.dir=/opt/buildagent/work, -Dbuild.number=95, -Dbuild.vcs.number=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.1=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.GitHubApacheIgnite=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dclassworlds.conf=/opt/buildagent/temp/buildTmp/teamcity.m2.conf, -Dcom.jetbrains.maven.watcher.report.file=/opt/buildagent/temp/buildTmp/maven-build-info.xml, -Djava.io.tmpdir=/opt/buildagent/temp/buildTmp, -Dmaven.home=/opt/buildagent/tools/maven3_6, -Dmaven.multiModuleProjectDirectory=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.agent.cpuBenchmark=457, -Dteamcity.agent.dotnet.agent_url=http://localhost:9090/RPC2, -Dteamcity.agent.dotnet.build_id=6278078, -Dteamcity.auth.password=*******, -Dteamcity.auth.userId=TeamCityBuildId=6278078, -Dteamcity.build.changedFiles.file=/opt/buildagent/temp/buildTmp/changedFiles6342607772318147725.txt, -Dteamcity.build.checkoutDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.build.id=6278078, -Dteamcity.build.properties.file=/opt/buildagent/temp/buildTmp/teamcity.build5164517880467851002.properties, -Dteamcity.build.tempDir=/opt/buildagent/temp/buildTmp, -Dteamcity.build.workingDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.buildConfName=Basic 3, -Dteamcity.buildType.id=IgniteTests24Java8_Basic3, -Dteamcity.configuration.properties.file=/opt/buildagent/temp/buildTmp/teamcity.config5591980786735343870.properties, -Dteamcity.maven.userSettings.path=/opt/buildagent/temp/buildTmp/maven_settings_585072866407032347.xml, -Dteamcity.maven.watcher.home=/opt/buildagent/plugins/mavenPlugin/maven-watcher-jdk16, -Dteamcity.projectName=Ignite Tests 2.x (JDK 8/11), -Dteamcity.runner.properties.file=/opt/buildagent/temp/buildTmp/teamcity.runner9098465561618137420.properties, -Dteamcity.tests.recentlyFailedTests.file=/opt/buildagent/temp/buildTmp/testsToRunFirst3891775683130404069.txt, -Dteamcity.version=2021.2 (build 99542), -ea, -Xms2g, -Xmx2g, -XX:+HeapDumpOnOutOfMemoryError, -DIGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_TEST_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_UPDATE_NOTIFIER=false, -DIGNITE_NO_DISCO_ORDER=true, -DIGNITE_PERFORMANCE_SUGGESTIONS_DISABLED=true, -Djava.net.preferIPv4Stack=true, -DTEST_SCALE_FACTOR=1.0, -DIGNITE_TEST_PROP_LOG4J_FILE=log4j-tc-test.xml, -DIGNITE_QUIET=false, -DIGNITE_MARSHAL_BUFFERS_RECHECK=1000, -Dmaven.repo.local=/opt/buildagent/.m2/repository] [21:08:01] : [Step 4/5] [2021-11-19 21:08:01,692][INFO ][test-runner-#15509%persistence.SingleNodePersistenceSslTest%][SingleNodePersistenceSslTest1] System cache's DataRegion size is configured to 40 MB. Use DataStorageConfiguration.systemRegionInitialSize property to change the setting. [21:08:01] : [Step 4/5] [2021-11-19 21:08:01,693][INFO ][test-runner-#15509%persistence.SingleNodePersistenceSslTest%][SingleNodePersistenceSslTest1] Configured caches [in 'sysMemPlc' dataRegion: ['ignite-sys-cache']] [21:08:01] : [Step 4/5] [2021-11-19 21:08:01,694][INFO ][test-runner-#15509%persistence.SingleNodePersistenceSslTest%][SingleNodePersistenceSslTest1] 3-rd party licenses can be found at: /opt/buildagent/work/7bc1c54bc719b67c/libs/licenses [21:08:01]W: [org.apache.ignite:ignite-core] [2021-11-19 21:08:01,693][WARN ][test-runner-#15509%persistence.SingleNodePersistenceSslTest%][SingleNodePersistenceSslTest1] Peer class loading is enabled (disable it in production for performance and deployment consistency reasons) [21:08:01] : [Step 4/5] [2021-11-19 21:08:01,701][INFO ][test-runner-#15509%persistence.SingleNodePersistenceSslTest%][IgnitePluginProcessor] Configured plugins: [21:08:01] : [Step 4/5] [2021-11-19 21:08:01,701][INFO ][test-runner-#15509%persistence.SingleNodePersistenceSslTest%][IgnitePluginProcessor] ^-- StanByClusterTestProvider 1.0 [21:08:01] : [Step 4/5] [2021-11-19 21:08:01,702][INFO ][test-runner-#15509%persistence.SingleNodePersistenceSslTest%][IgnitePluginProcessor] ^-- null [21:08:01] : [Step 4/5] [2021-11-19 21:08:01,702][INFO ][test-runner-#15509%persistence.SingleNodePersistenceSslTest%][IgnitePluginProcessor] [21:08:01] : [Step 4/5] [2021-11-19 21:08:01,702][INFO ][test-runner-#15509%persistence.SingleNodePersistenceSslTest%][IgnitePluginProcessor] ^-- PageMemory tracker plugin 1.0 [21:08:01] : [Step 4/5] [2021-11-19 21:08:01,702][INFO ][test-runner-#15509%persistence.SingleNodePersistenceSslTest%][IgnitePluginProcessor] ^-- null [21:08:01] : [Step 4/5] [2021-11-19 21:08:01,703][INFO ][test-runner-#15509%persistence.SingleNodePersistenceSslTest%][IgnitePluginProcessor] [21:08:01] : [Step 4/5] [2021-11-19 21:08:01,703][INFO ][test-runner-#15509%persistence.SingleNodePersistenceSslTest%][IgnitePluginProcessor] ^-- TestDistibutedConfigurationPlugin 1.0 [21:08:01] : [Step 4/5] [2021-11-19 21:08:01,703][INFO ][test-runner-#15509%persistence.SingleNodePersistenceSslTest%][IgnitePluginProcessor] ^-- null [21:08:01] : [Step 4/5] [2021-11-19 21:08:01,703][INFO ][test-runner-#15509%persistence.SingleNodePersistenceSslTest%][IgnitePluginProcessor] [21:08:01] : [Step 4/5] [2021-11-19 21:08:01,704][INFO ][test-runner-#15509%persistence.SingleNodePersistenceSslTest%][IgnitePluginProcessor] ^-- NodeValidationPluginProvider 1.0 [21:08:01] : [Step 4/5] [2021-11-19 21:08:01,704][INFO ][test-runner-#15509%persistence.SingleNodePersistenceSslTest%][IgnitePluginProcessor] ^-- null [21:08:01] : [Step 4/5] [2021-11-19 21:08:01,704][INFO ][test-runner-#15509%persistence.SingleNodePersistenceSslTest%][IgnitePluginProcessor] [21:08:01] : [Step 4/5] [2021-11-19 21:08:01,705][INFO ][test-runner-#15509%persistence.SingleNodePersistenceSslTest%][FailureProcessor] Configured failure handler: [hnd=StopNodeFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]]] [21:08:01] : [Step 4/5] [2021-11-19 21:08:01,728][INFO ][test-runner-#15509%persistence.SingleNodePersistenceSslTest%][TcpCommunicationSpi] Successfully bound communication NIO server to TCP port [port=45181, locHost=/127.0.0.1, selectorsCnt=12, selectorSpins=0, pairedConn=false] [21:08:01]W: [org.apache.ignite:ignite-core] [2021-11-19 21:08:01,728][WARN ][test-runner-#15509%persistence.SingleNodePersistenceSslTest%][TcpCommunicationSpi] Message queue limit is set to 0 which may lead to potential OOMEs when running cache operations in FULL_ASYNC or PRIMARY_SYNC modes due to message queues growth on sender and receiver sides. [21:08:01] : [Step 4/5] [2021-11-19 21:08:01,732][INFO ][test-runner-#15509%persistence.SingleNodePersistenceSslTest%][GridCollisionManager] Collision resolution is disabled (all jobs will be activated upon arrival). [21:08:01] : [Step 4/5] [2021-11-19 21:08:01,732][INFO ][test-runner-#15509%persistence.SingleNodePersistenceSslTest%][SingleNodePersistenceSslTest1] Security status [authentication=off, sandbox=off, tls/ssl=on] [21:08:01] : [Step 4/5] [2021-11-19 21:08:01,734][INFO ][test-runner-#15509%persistence.SingleNodePersistenceSslTest%][TestTcpDiscoverySpi] Successfully bound to TCP port [port=47501, localHost=localhost/127.0.0.1, locNodeId=6d827695-63a0-48c5-b3f8-d61ba2d00001] [21:08:01]W: [org.apache.ignite:ignite-core] [2021-11-19 21:08:01,735][WARN ][test-runner-#15509%persistence.SingleNodePersistenceSslTest%][PdsFoldersResolver] Failed to acquire file lock. Will try again in 1s [nodeId=6d827695-63a0-48c5-b3f8-d61ba2d00001, holder=[6d213588-b47c-4157-b1d4-71df71900000][], path=/opt/buildagent/work/7bc1c54bc719b67c/work/db/node00-e845bbf6-3300-4744-9c29-7c79044a42e4/lock] [21:08:02] : [Step 4/5] [2021-11-19 21:08:02,735][INFO ][test-runner-#15509%persistence.SingleNodePersistenceSslTest%][PdsFoldersResolver] Unable to acquire lock to file [/opt/buildagent/work/7bc1c54bc719b67c/work/db/node00-e845bbf6-3300-4744-9c29-7c79044a42e4], reason: Failed to acquire file lock [holder=[6d213588-b47c-4157-b1d4-71df71900000][], time=1 sec, path=/opt/buildagent/work/7bc1c54bc719b67c/work/db/node00-e845bbf6-3300-4744-9c29-7c79044a42e4/lock] [21:08:02] : [Step 4/5] [2021-11-19 21:08:02,738][INFO ][test-runner-#15509%persistence.SingleNodePersistenceSslTest%][PdsFoldersResolver] Successfully created new persistent storage folder [/opt/buildagent/work/7bc1c54bc719b67c/work/db/node01-1a2dfc1f-296a-4406-b6d5-20c3b4317e2d] [21:08:02] : [Step 4/5] [2021-11-19 21:08:02,738][INFO ][test-runner-#15509%persistence.SingleNodePersistenceSslTest%][PdsFoldersResolver] Consistent ID used for local node is [1a2dfc1f-296a-4406-b6d5-20c3b4317e2d] according to persistence data storage folders [21:08:02] : [Step 4/5] [2021-11-19 21:08:02,739][INFO ][test-runner-#15509%persistence.SingleNodePersistenceSslTest%][MaintenanceProcessor] Resolved store directory for node persistent data: /opt/buildagent/work/7bc1c54bc719b67c/work/db/node01-1a2dfc1f-296a-4406-b6d5-20c3b4317e2d [21:08:02] : [Step 4/5] [2021-11-19 21:08:02,740][INFO ][test-runner-#15509%persistence.SingleNodePersistenceSslTest%][CacheObjectBinaryProcessorImpl] Resolved directory for serialized binary metadata: /opt/buildagent/work/7bc1c54bc719b67c/work/db/binary_meta/node01-1a2dfc1f-296a-4406-b6d5-20c3b4317e2d [21:08:02] : [Step 4/5] [2021-11-19 21:08:02,744][INFO ][test-runner-#15509%persistence.SingleNodePersistenceSslTest%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/node01-1a2dfc1f-296a-4406-b6d5-20c3b4317e2d [21:08:02] : [Step 4/5] [2021-11-19 21:08:02,745][INFO ][test-runner-#15509%persistence.SingleNodePersistenceSslTest%][FileWriteAheadLogManager] Resolved write ahead log work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/node01-1a2dfc1f-296a-4406-b6d5-20c3b4317e2d [21:08:02] : [Step 4/5] [2021-11-19 21:08:02,746][INFO ][test-runner-#15509%persistence.SingleNodePersistenceSslTest%][FileWriteAheadLogManager] Resolved write ahead log archive directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/node01-1a2dfc1f-296a-4406-b6d5-20c3b4317e2d [21:08:03] : [Step 4/5] [2021-11-19 21:08:03,563][INFO ][test-runner-#15509%persistence.SingleNodePersistenceSslTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/node01-1a2dfc1f-296a-4406-b6d5-20c3b4317e2d/0000000000000000.wal [21:08:03] : [Step 4/5] [2021-11-19 21:08:03,563][INFO ][test-runner-#15509%persistence.SingleNodePersistenceSslTest%][FileHandleManagerImpl] Initialized write-ahead log manager [mode=LOG_ONLY] [21:08:03] : [Step 4/5] [2021-11-19 21:08:03,568][INFO ][test-runner-#15509%persistence.SingleNodePersistenceSslTest%][GridCacheDatabaseSharedManager] Configured data regions initialized successfully [total=5] [21:08:03] : [Step 4/5] [2021-11-19 21:08:03,569][INFO ][test-runner-#15509%persistence.SingleNodePersistenceSslTest%][IgniteSnapshotManager] Resolved snapshot work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/snapshots [21:08:03] : [Step 4/5] [2021-11-19 21:08:03,569][INFO ][test-runner-#15509%persistence.SingleNodePersistenceSslTest%][IgniteSnapshotManager] Resolved temp directory for snapshot creation: /opt/buildagent/work/7bc1c54bc719b67c/work/db/node01-1a2dfc1f-296a-4406-b6d5-20c3b4317e2d/snp [21:08:03] : [Step 4/5] [2021-11-19 21:08:03,571][INFO ][test-runner-#15509%persistence.SingleNodePersistenceSslTest%][ClientListenerProcessor] Client connector processor has started on TCP port 10801 [21:08:03] : [Step 4/5] [2021-11-19 21:08:03,573][INFO ][test-runner-#15509%persistence.SingleNodePersistenceSslTest%][SingleNodePersistenceSslTest1] Non-loopback local IPs: 172.17.0.4 [21:08:03] : [Step 4/5] [2021-11-19 21:08:03,574][INFO ][test-runner-#15509%persistence.SingleNodePersistenceSslTest%][SingleNodePersistenceSslTest1] Enabled local MACs: 0242AC110004 [21:08:03] : [Step 4/5] [2021-11-19 21:08:03,574][INFO ][test-runner-#15509%persistence.SingleNodePersistenceSslTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:08:03] : [Step 4/5] [2021-11-19 21:08:03,575][INFO ][test-runner-#15509%persistence.SingleNodePersistenceSslTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:08:03] : [Step 4/5] [2021-11-19 21:08:03,575][INFO ][test-runner-#15509%persistence.SingleNodePersistenceSslTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:08:03] : [Step 4/5] [2021-11-19 21:08:03,577][INFO ][test-runner-#15509%persistence.SingleNodePersistenceSslTest%][GridCacheDatabaseSharedManager] Applying lost metastore updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:08:03] : [Step 4/5] [2021-11-19 21:08:03,578][INFO ][test-runner-#15509%persistence.SingleNodePersistenceSslTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=0 ms] [21:08:03] : [Step 4/5] [2021-11-19 21:08:03,578][INFO ][test-runner-#15509%persistence.SingleNodePersistenceSslTest%][GridCacheProcessor] Restoring partition state for local groups. [21:08:03] : [Step 4/5] [2021-11-19 21:08:03,579][INFO ][test-runner-#15509%persistence.SingleNodePersistenceSslTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=0, partitionsProcessed=0, time=0ms] [21:08:03] : [Step 4/5] [2021-11-19 21:08:03,579][INFO ][test-runner-#15509%persistence.SingleNodePersistenceSslTest%][GridEncryptionManager] Encryption keys loaded from metastore. [grps=, masterKeyName=null] [21:08:03] : [Step 4/5] [2021-11-19 21:08:03,581][INFO ][test-runner-#15509%persistence.SingleNodePersistenceSslTest%][ClusterProcessor] Cluster ID and tag has been read from metastorage: null [21:08:03] : [Step 4/5] [2021-11-19 21:08:03,581][INFO ][test-runner-#15509%persistence.SingleNodePersistenceSslTest%][IgniteClusterImpl] Shutdown policy was updated [oldVal=null, newVal=null] [21:08:03] : [Step 4/5] [2021-11-19 21:08:03,582][INFO ][test-runner-#15509%persistence.SingleNodePersistenceSslTest%][GridCacheDatabaseSharedManager] Checkpoint frequency deviation changed [oldVal=null, newVal=null] [21:08:03] : [Step 4/5] [2021-11-19 21:08:03,592][INFO ][test-runner-#15509%persistence.SingleNodePersistenceSslTest%][FilePageStoreManager] Cleanup cache stores [total=1, left=0, cleanFiles=false] [21:08:03] : [Step 4/5] [2021-11-19 21:08:03,594][INFO ][test-runner-#15509%persistence.SingleNodePersistenceSslTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:08:03] : [Step 4/5] [2021-11-19 21:08:03,595][INFO ][test-runner-#15509%persistence.SingleNodePersistenceSslTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:08:03] : [Step 4/5] [2021-11-19 21:08:03,597][INFO ][test-runner-#15509%persistence.SingleNodePersistenceSslTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:08:03] : [Step 4/5] [2021-11-19 21:08:03,597][INFO ][test-runner-#15509%persistence.SingleNodePersistenceSslTest%][GridCacheDatabaseSharedManager] Data Regions Started: 5 [21:08:03] : [Step 4/5] [2021-11-19 21:08:03,598][INFO ][test-runner-#15509%persistence.SingleNodePersistenceSslTest%][GridCacheDatabaseSharedManager] ^-- sysMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:08:03] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:08:03] : [Step 4/5] ^-- default region [type=default, persistence=true, lazyAlloc=true, [21:08:03] : [Step 4/5] ... initCfg=256MB, maxCfg=256MB, usedRam=0MB, freeRam=100%, allocRam=0MB, allocTotal=0MB] [21:08:03] : [Step 4/5] ^-- metastoreMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:08:03] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:08:03] : [Step 4/5] ^-- TxLog region [type=internal, persistence=true, lazyAlloc=false, [21:08:03] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:08:03] : [Step 4/5] ^-- volatileDsMemPlc region [type=user, persistence=false, lazyAlloc=true, [21:08:03] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB] [21:08:03] : [Step 4/5] ^-- Ignite persistence [used=0MB] [21:08:03] : [Step 4/5] [21:08:03] : [Step 4/5] [2021-11-19 21:08:03,599][INFO ][test-runner-#15509%persistence.SingleNodePersistenceSslTest%][GridCacheDatabaseSharedManager] Starting binary memory restore for: [-2100569601] [21:08:03] : [Step 4/5] [2021-11-19 21:08:03,607][INFO ][test-runner-#15509%persistence.SingleNodePersistenceSslTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:08:03] : [Step 4/5] [2021-11-19 21:08:03,607][INFO ][test-runner-#15509%persistence.SingleNodePersistenceSslTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:08:03] : [Step 4/5] [2021-11-19 21:08:03,610][INFO ][test-runner-#15509%persistence.SingleNodePersistenceSslTest%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/node01-1a2dfc1f-296a-4406-b6d5-20c3b4317e2d/0000000000000000.wal, offset=0, ver=2] [21:08:03] : [Step 4/5] [2021-11-19 21:08:03,613][INFO ][test-runner-#15509%persistence.SingleNodePersistenceSslTest%][GridCacheProcessor] Started cache in recovery mode [name=ignite-sys-cache, id=-2100569601, dataRegionName=sysMemPlc, mode=REPLICATED, atomicity=TRANSACTIONAL, backups=2147483647, mvcc=false] [21:08:03] : [Step 4/5] [2021-11-19 21:08:03,614][INFO ][test-runner-#15509%persistence.SingleNodePersistenceSslTest%][GridCacheDatabaseSharedManager] Binary recovery performed in 15 ms. [21:08:03] : [Step 4/5] [2021-11-19 21:08:03,614][INFO ][test-runner-#15509%persistence.SingleNodePersistenceSslTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:08:03] : [Step 4/5] [2021-11-19 21:08:03,614][INFO ][test-runner-#15509%persistence.SingleNodePersistenceSslTest%][GridCacheDatabaseSharedManager] Applying lost cache updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:08:03] : [Step 4/5] [2021-11-19 21:08:03,681][INFO ][test-runner-#15509%persistence.SingleNodePersistenceSslTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=71 ms] [21:08:03] : [Step 4/5] [2021-11-19 21:08:03,682][INFO ][test-runner-#15509%persistence.SingleNodePersistenceSslTest%][GridCacheProcessor] Restoring partition state for local groups. [21:08:03] : [Step 4/5] [2021-11-19 21:08:03,704][INFO ][test-runner-#15509%persistence.SingleNodePersistenceSslTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=1, partitionsProcessed=100, time=20ms] [21:08:04] : [Step 4/5] [2021-11-19 21:08:04,307][INFO ][tcp-disco-srvr-[:47500]-#814%persistence.SingleNodePersistenceSslTest0%-#15623%persistence.SingleNodePersistenceSslTest0%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=38987] [21:08:04] : [Step 4/5] [2021-11-19 21:08:04,308][INFO ][tcp-disco-srvr-[:47500]-#814%persistence.SingleNodePersistenceSslTest0%-#15623%persistence.SingleNodePersistenceSslTest0%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=38987] [21:08:04] : [Step 4/5] [2021-11-19 21:08:04,309][INFO ][tcp-disco-sock-reader-[]-#820%persistence.SingleNodePersistenceSslTest0%-#15743%persistence.SingleNodePersistenceSslTest0%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:38987, rmtPort=38987] [21:08:04] : [Step 4/5] [2021-11-19 21:08:04,463][INFO ][tcp-disco-sock-reader-[6d827695 127.0.0.1:38987]-#820%persistence.SingleNodePersistenceSslTest0%-#15743%persistence.SingleNodePersistenceSslTest0%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=6d827695-63a0-48c5-b3f8-d61ba2d00001, rmtAddr=/127.0.0.1:38987] [21:08:04] : [Step 4/5] [2021-11-19 21:08:04,478][INFO ][tcp-disco-srvr-[:47501]-#819%persistence.SingleNodePersistenceSslTest1%-#15742%persistence.SingleNodePersistenceSslTest1%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=57191] [21:08:04] : [Step 4/5] [2021-11-19 21:08:04,479][INFO ][tcp-disco-srvr-[:47501]-#819%persistence.SingleNodePersistenceSslTest1%-#15742%persistence.SingleNodePersistenceSslTest1%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=57191] [21:08:04] : [Step 4/5] [2021-11-19 21:08:04,479][INFO ][tcp-disco-sock-reader-[]-#821%persistence.SingleNodePersistenceSslTest1%-#15744%persistence.SingleNodePersistenceSslTest1%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:57191, rmtPort=57191] [21:08:04] : [Step 4/5] [2021-11-19 21:08:04,510][INFO ][tcp-disco-sock-reader-[]-#821%persistence.SingleNodePersistenceSslTest1%-#15744%persistence.SingleNodePersistenceSslTest1%][TestTcpDiscoverySpi] Received ping request from the remote node [rmtNodeId=6d213588-b47c-4157-b1d4-71df71900000, rmtAddr=/127.0.0.1:57191, rmtPort=57191] [21:08:04] : [Step 4/5] [2021-11-19 21:08:04,512][INFO ][tcp-disco-sock-reader-[]-#821%persistence.SingleNodePersistenceSslTest1%-#15744%persistence.SingleNodePersistenceSslTest1%][TestTcpDiscoverySpi] Finished writing ping response [rmtNodeId=6d213588-b47c-4157-b1d4-71df71900000, rmtAddr=/127.0.0.1:57191, rmtPort=57191] [21:08:04]W: [org.apache.ignite:ignite-core] [2021-11-19 21:08:04,514][WARN ][tcp-disco-sock-reader-[]-#821%persistence.SingleNodePersistenceSslTest1%-#15744%persistence.SingleNodePersistenceSslTest1%][TestTcpDiscoverySpi] Failed to shutdown socket: closing inbound before receiving peer's close_notify [21:08:04]W: [org.apache.ignite:ignite-core] javax.net.ssl.SSLException: closing inbound before receiving peer's close_notify [21:08:04]W: [org.apache.ignite:ignite-core] at sun.security.ssl.Alert.createSSLException(Alert.java:133) [21:08:04]W: [org.apache.ignite:ignite-core] at sun.security.ssl.Alert.createSSLException(Alert.java:117) [21:08:04]W: [org.apache.ignite:ignite-core] at sun.security.ssl.TransportContext.fatal(TransportContext.java:314) [21:08:04]W: [org.apache.ignite:ignite-core] at sun.security.ssl.TransportContext.fatal(TransportContext.java:270) [21:08:04]W: [org.apache.ignite:ignite-core] at sun.security.ssl.TransportContext.fatal(TransportContext.java:261) [21:08:04]W: [org.apache.ignite:ignite-core] at sun.security.ssl.SSLSocketImpl.shutdownInput(SSLSocketImpl.java:656) [21:08:04]W: [org.apache.ignite:ignite-core] at sun.security.ssl.SSLSocketImpl.shutdownInput(SSLSocketImpl.java:635) [21:08:04]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.close(IgniteUtils.java:4248) [21:08:04]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.discovery.tcp.ServerImpl$SocketReader.body(ServerImpl.java:7370) [21:08:04]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.IgniteSpiThread.run(IgniteSpiThread.java:58) [21:08:04] : [Step 4/5] [2021-11-19 21:08:04,517][INFO ][tcp-disco-sock-reader-[]-#821%persistence.SingleNodePersistenceSslTest1%-#15744%persistence.SingleNodePersistenceSslTest1%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:57191, rmtPort=57191, rmtNodeId=null] [21:08:04]W: [org.apache.ignite:ignite-core] [2021-11-19 21:08:04,515][WARN ][tcp-disco-sock-reader-[6d827695 127.0.0.1:38987]-#820%persistence.SingleNodePersistenceSslTest0%-#15743%persistence.SingleNodePersistenceSslTest0%][TestTcpDiscoverySpi] Failed to shutdown socket: closing inbound before receiving peer's close_notify [21:08:04]W: [org.apache.ignite:ignite-core] javax.net.ssl.SSLException: closing inbound before receiving peer's close_notify [21:08:04]W: [org.apache.ignite:ignite-core] at sun.security.ssl.Alert.createSSLException(Alert.java:133) [21:08:04]W: [org.apache.ignite:ignite-core] at sun.security.ssl.Alert.createSSLException(Alert.java:117) [21:08:04]W: [org.apache.ignite:ignite-core] at sun.security.ssl.TransportContext.fatal(TransportContext.java:314) [21:08:04]W: [org.apache.ignite:ignite-core] at sun.security.ssl.TransportContext.fatal(TransportContext.java:270) [21:08:04]W: [org.apache.ignite:ignite-core] at sun.security.ssl.TransportContext.fatal(TransportContext.java:261) [21:08:04]W: [org.apache.ignite:ignite-core] at sun.security.ssl.SSLSocketImpl.shutdownInput(SSLSocketImpl.java:656) [21:08:04]W: [org.apache.ignite:ignite-core] at sun.security.ssl.SSLSocketImpl.shutdownInput(SSLSocketImpl.java:635) [21:08:04]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.close(IgniteUtils.java:4248) [21:08:04]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.discovery.tcp.ServerImpl$SocketReader.body(ServerImpl.java:7370) [21:08:04]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.IgniteSpiThread.run(IgniteSpiThread.java:58) [21:08:04] : [Step 4/5] [2021-11-19 21:08:04,519][INFO ][tcp-disco-sock-reader-[6d827695 127.0.0.1:38987]-#820%persistence.SingleNodePersistenceSslTest0%-#15743%persistence.SingleNodePersistenceSslTest0%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:38987, rmtPort=38987, rmtNodeId=6d827695-63a0-48c5-b3f8-d61ba2d00001] [21:08:04] : [Step 4/5] [2021-11-19 21:08:04,517][INFO ][tcp-disco-msg-worker-[crd]-#813%persistence.SingleNodePersistenceSslTest0%-#15622%persistence.SingleNodePersistenceSslTest0%][GridEncryptionManager] Joining node doesn't have stored group keys [node=6d827695-63a0-48c5-b3f8-d61ba2d00001] [21:08:04] : [Step 4/5] [2021-11-19 21:08:04,529][INFO ][tcp-disco-msg-worker-[crd]-#813%persistence.SingleNodePersistenceSslTest0%-#15622%persistence.SingleNodePersistenceSslTest0%][TestTcpDiscoverySpi] New next node [newNext=TcpDiscoveryNode [id=6d827695-63a0-48c5-b3f8-d61ba2d00001, consistentId=1a2dfc1f-296a-4406-b6d5-20c3b4317e2d, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=0, intOrder=2, lastExchangeTime=1637345284474, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false]] [21:08:04] : [Step 4/5] [2021-11-19 21:08:04,530][INFO ][tcp-disco-srvr-[:47501]-#819%persistence.SingleNodePersistenceSslTest1%-#15742%persistence.SingleNodePersistenceSslTest1%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=36337] [21:08:04] : [Step 4/5] [2021-11-19 21:08:04,531][INFO ][tcp-disco-srvr-[:47501]-#819%persistence.SingleNodePersistenceSslTest1%-#15742%persistence.SingleNodePersistenceSslTest1%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=36337] [21:08:04] : [Step 4/5] [2021-11-19 21:08:04,531][INFO ][tcp-disco-sock-reader-[]-#822%persistence.SingleNodePersistenceSslTest1%-#15745%persistence.SingleNodePersistenceSslTest1%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:36337, rmtPort=36337] [21:08:04] : [Step 4/5] [2021-11-19 21:08:04,563][INFO ][tcp-disco-sock-reader-[6d213588 127.0.0.1:36337]-#822%persistence.SingleNodePersistenceSslTest1%-#15745%persistence.SingleNodePersistenceSslTest1%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=6d213588-b47c-4157-b1d4-71df71900000, rmtAddr=/127.0.0.1:36337] [21:08:04] : [Step 4/5] [2021-11-19 21:08:04,577][INFO ][tcp-disco-msg-worker-[]-#818%persistence.SingleNodePersistenceSslTest1%-#15741%persistence.SingleNodePersistenceSslTest1%][TestTcpDiscoverySpi] New next node [newNext=TcpDiscoveryNode [id=6d213588-b47c-4157-b1d4-71df71900000, consistentId=e845bbf6-3300-4744-9c29-7c79044a42e4, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345284566, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false]] [21:08:04] : [Step 4/5] [2021-11-19 21:08:04,578][INFO ][tcp-disco-srvr-[:47500]-#814%persistence.SingleNodePersistenceSslTest0%-#15623%persistence.SingleNodePersistenceSslTest0%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=48285] [21:08:04] : [Step 4/5] [2021-11-19 21:08:04,579][INFO ][tcp-disco-srvr-[:47500]-#814%persistence.SingleNodePersistenceSslTest0%-#15623%persistence.SingleNodePersistenceSslTest0%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=48285] [21:08:04] : [Step 4/5] [2021-11-19 21:08:04,579][INFO ][tcp-disco-sock-reader-[]-#823%persistence.SingleNodePersistenceSslTest0%-#15746%persistence.SingleNodePersistenceSslTest0%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:48285, rmtPort=48285] [21:08:04] : [Step 4/5] [2021-11-19 21:08:04,605][INFO ][tcp-disco-sock-reader-[6d827695 127.0.0.1:48285]-#823%persistence.SingleNodePersistenceSslTest0%-#15746%persistence.SingleNodePersistenceSslTest0%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=6d827695-63a0-48c5-b3f8-d61ba2d00001, rmtAddr=/127.0.0.1:48285] [21:08:04] : [Step 4/5] [2021-11-19 21:08:04,610][INFO ][disco-event-worker-#15625%persistence.SingleNodePersistenceSslTest0%][GridDiscoveryManager] Added new node to topology: TcpDiscoveryNode [id=6d827695-63a0-48c5-b3f8-d61ba2d00001, consistentId=1a2dfc1f-296a-4406-b6d5-20c3b4317e2d, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637345284474, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false] [21:08:04] : [Step 4/5] [2021-11-19 21:08:04,612][INFO ][disco-event-worker-#15625%persistence.SingleNodePersistenceSslTest0%][GridDiscoveryManager] Topology snapshot [ver=2, locNode=6d213588, servers=2, clients=0, state=INACTIVE, CPUs=24, offheap=0.25GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=6d213588-b47c-4157-b1d4-71df71900000, consistentId=e845bbf6-3300-4744-9c29-7c79044a42e4, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=6d827695-63a0-48c5-b3f8-d61ba2d00001, consistentId=1a2dfc1f-296a-4406-b6d5-20c3b4317e2d, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:08:04] : [Step 4/5] [2021-11-19 21:08:04,615][INFO ][tcp-disco-msg-worker-[6d213588 127.0.0.1:47500]-#818%persistence.SingleNodePersistenceSslTest1%-#15741%persistence.SingleNodePersistenceSslTest1%][ClusterProcessor] exciting_napier [21:08:04] : [Step 4/5] [2021-11-19 21:08:04,615][INFO ][tcp-disco-msg-worker-[6d213588 127.0.0.1:47500]-#818%persistence.SingleNodePersistenceSslTest1%-#15741%persistence.SingleNodePersistenceSslTest1%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustEnabled' was changed from 'null' to 'false' [21:08:04] : [Step 4/5] [2021-11-19 21:08:04,616][INFO ][tcp-disco-msg-worker-[6d213588 127.0.0.1:47500]-#818%persistence.SingleNodePersistenceSslTest1%-#15741%persistence.SingleNodePersistenceSslTest1%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustTimeout' was changed from 'null' to '300000' [21:08:04] : [Step 4/5] [2021-11-19 21:08:04,616][INFO ][tcp-disco-msg-worker-[6d213588 127.0.0.1:47500]-#818%persistence.SingleNodePersistenceSslTest1%-#15741%persistence.SingleNodePersistenceSslTest1%][IgniteTxManager] Transactions parameter 'longOperationsDumpTimeout' was changed from 'null' to '60000' [21:08:04] : [Step 4/5] [2021-11-19 21:08:04,617][INFO ][tcp-disco-msg-worker-[6d213588 127.0.0.1:47500]-#818%persistence.SingleNodePersistenceSslTest1%-#15741%persistence.SingleNodePersistenceSslTest1%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpThreshold' was changed from 'null' to '0' [21:08:04] : [Step 4/5] [2021-11-19 21:08:04,617][INFO ][tcp-disco-msg-worker-[6d213588 127.0.0.1:47500]-#818%persistence.SingleNodePersistenceSslTest1%-#15741%persistence.SingleNodePersistenceSslTest1%][IgniteTxManager] Transactions parameter 'transactionTimeDumpSamplesCoefficient' was changed from 'null' to '0.0' [21:08:04] : [Step 4/5] [2021-11-19 21:08:04,617][INFO ][tcp-disco-msg-worker-[6d213588 127.0.0.1:47500]-#818%persistence.SingleNodePersistenceSslTest1%-#15741%persistence.SingleNodePersistenceSslTest1%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpSamplesPerSecondLimit' was changed from 'null' to '5' [21:08:04] : [Step 4/5] [2021-11-19 21:08:04,618][INFO ][tcp-disco-msg-worker-[6d213588 127.0.0.1:47500]-#818%persistence.SingleNodePersistenceSslTest1%-#15741%persistence.SingleNodePersistenceSslTest1%][IgniteTxManager] Transactions parameter 'collisionsDumpInterval' was changed from 'null' to '1000' [21:08:04] : [Step 4/5] [2021-11-19 21:08:04,618][INFO ][tcp-disco-msg-worker-[6d213588 127.0.0.1:47500]-#818%persistence.SingleNodePersistenceSslTest1%-#15741%persistence.SingleNodePersistenceSslTest1%][IgniteTxManager] Transactions parameter 'txOwnerDumpRequestsAllowed' was changed from 'null' to 'true' [21:08:04] : [Step 4/5] [2021-11-19 21:08:04,619][INFO ][tcp-disco-msg-worker-[6d213588 127.0.0.1:47500]-#818%persistence.SingleNodePersistenceSslTest1%-#15741%persistence.SingleNodePersistenceSslTest1%][GridCacheDatabaseSharedManager] Historical rebalance WAL threshold changed [property=historical.rebalance.threshold, oldVal=null, newVal=500] [21:08:04] : [Step 4/5] [2021-11-19 21:08:04,620][INFO ][disco-notifier-worker-#15740%persistence.SingleNodePersistenceSslTest1%][MvccProcessorImpl] Assigned mvcc coordinator [crd=MvccCoordinator [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=0], nodeId=6d213588-b47c-4157-b1d4-71df71900000, ver=1637345281639, local=false, initialized=false]] [21:08:04] : [Step 4/5] [2021-11-19 21:08:04,622][INFO ][sys-#15739%persistence.SingleNodePersistenceSslTest1%][ClusterProcessor] Writing cluster ID and tag to metastorage on ready for write ClusterIdAndTag [id=35d307c6-c3f9-47b8-aea2-9f36095907f5, tag=exciting_napier] [21:08:04] : [Step 4/5] [2021-11-19 21:08:04,634][INFO ][test-runner-#15509%persistence.SingleNodePersistenceSslTest%][SingleNodePersistenceSslTest1] To start Console Management & Monitoring run ignitevisorcmd.{sh|bat} [21:08:04] : [Step 4/5] [2021-11-19 21:08:04,635][INFO ][test-runner-#15509%persistence.SingleNodePersistenceSslTest%][SingleNodePersistenceSslTest1] [21:08:04] : [Step 4/5] [21:08:04] : [Step 4/5] >>> +-------------------------------------------+ [21:08:04] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:08:04] : [Step 4/5] >>> +-------------------------------------------+ [21:08:04] : [Step 4/5] >>> OS name: Linux 4.15.0-151-generic amd64 [21:08:04] : [Step 4/5] >>> CPU(s): 24 [21:08:04] : [Step 4/5] >>> Heap: 2.0GB [21:08:04] : [Step 4/5] >>> VM name: 16724@c4dfe9a430b2 [21:08:04] : [Step 4/5] >>> Ignite instance name: persistence.SingleNodePersistenceSslTest1 [21:08:04] : [Step 4/5] >>> Local node [ID=6D827695-63A0-48C5-B3F8-D61BA2D00001, order=2, clientMode=false] [21:08:04] : [Step 4/5] >>> Local node addresses: [127.0.0.1] [21:08:04] : [Step 4/5] >>> Local ports: TCP:10801 TCP:45181 TCP:47501 [21:08:04] : [Step 4/5] [21:08:04] : [Step 4/5] [2021-11-19 21:08:04,636][INFO ][test-runner-#15509%persistence.SingleNodePersistenceSslTest%][SingleNodePersistenceSslTest1] >>> Ignite cluster is in INACTIVE state (limited functionality available). Use control.(sh|bat) script or IgniteCluster.state(ClusterState.ACTIVE) to change the state. [21:08:04] : [Step 4/5] [2021-11-19 21:08:04,636][INFO ][test-runner-#15509%persistence.SingleNodePersistenceSslTest%][GridDiscoveryManager] Topology snapshot [ver=2, locNode=6d827695, servers=2, clients=0, state=INACTIVE, CPUs=24, offheap=0.25GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=6d213588-b47c-4157-b1d4-71df71900000, consistentId=e845bbf6-3300-4744-9c29-7c79044a42e4, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=6d827695-63a0-48c5-b3f8-d61ba2d00001, consistentId=1a2dfc1f-296a-4406-b6d5-20c3b4317e2d, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:08:04] : [Step 4/5] [2021-11-19 21:08:04,637][INFO ][test-runner-#15509%persistence.SingleNodePersistenceSslTest%][G] Node started : [stage="Configure system pool" (0 ms),stage="Start managers" (1066 ms),stage="Configure binary metadata" (2 ms),stage="Start processors" (831 ms),stage="Start 'StanByClusterTestProvider' plugin" (0 ms),stage="Start 'PageMemory tracker plugin' plugin" (0 ms),stage="Start 'TestDistibutedConfigurationPlugin' plugin" (0 ms),stage="Start 'NodeValidationPluginProvider' plugin" (0 ms),stage="Init metastore" (19 ms),stage="Init and start regions" (6 ms),stage="Restore binary memory" (15 ms),stage="Restore logical state" (90 ms),stage="Finish recovery" (597 ms),stage="Join topology" (317 ms),stage="Await transition" (2 ms),stage="Await exchange" (14 ms),stage="Total time" (2959 ms)] [21:08:04] : [Step 4/5] [2021-11-19 21:08:04,638][INFO ][test-runner-#15509%persistence.SingleNodePersistenceSslTest%][root] Node started with the following configuration [id=6d827695-63a0-48c5-b3f8-d61ba2d00001, marshaller=BinaryMarshaller [], discovery=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=5000, ackTimeout=5000, marsh=JdkMarshaller [clsFilter=org.apache.ignite.marshaller.MarshallerUtils$1@567941f9], reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], binaryCfg=null, lateAff=true] [21:08:04] : [Step 4/5] [2021-11-19 21:08:04,640][INFO ][test-runner-#15509%persistence.SingleNodePersistenceSslTest%][GridClusterStateProcessor] Sending activate cluster request with BaselineTopology BaselineTopology [id=0, branchingHash=1959438630, branchingType='New BaselineTopology', baselineNodes=[1a2dfc1f-296a-4406-b6d5-20c3b4317e2d, e845bbf6-3300-4744-9c29-7c79044a42e4]] [21:08:04] : [Step 4/5] [2021-11-19 21:08:04,644][INFO ][disco-notifier-worker-#15621%persistence.SingleNodePersistenceSslTest0%][GridClusterStateProcessor] Received activate cluster request with BaselineTopology[id=0] initiator node ID: 6d213588-b47c-4157-b1d4-71df71900000 [21:08:04] : [Step 4/5] [2021-11-19 21:08:04,645][INFO ][disco-notifier-worker-#15621%persistence.SingleNodePersistenceSslTest0%][GridClusterStateProcessor] Started state transition: activate cluster [21:08:04] : [Step 4/5] [2021-11-19 21:08:04,646][INFO ][exchange-worker-#15626%persistence.SingleNodePersistenceSslTest0%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], crd=true, evt=DISCOVERY_CUSTOM_EVT, evtNode=6d213588-b47c-4157-b1d4-71df71900000, customEvt=ChangeGlobalStateMessage [id=6ca5d593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqId=06ff3ad3-3c7d-4f30-99e4-897406c63ebb, initiatingNodeId=6d213588-b47c-4157-b1d4-71df71900000, state=ACTIVE, baselineTopology=BaselineTopology [id=0, branchingHash=1959438630, branchingType='New BaselineTopology', baselineNodes=[1a2dfc1f-296a-4406-b6d5-20c3b4317e2d, e845bbf6-3300-4744-9c29-7c79044a42e4]], forceChangeBaselineTopology=false, timestamp=1637345284640, forceDeactivation=true], allowMerge=false, exchangeFreeSwitch=false] [21:08:04] : [Step 4/5] [2021-11-19 21:08:04,647][INFO ][exchange-worker-#15626%persistence.SingleNodePersistenceSslTest0%][GridDhtPartitionsExchangeFuture] Start activation process [nodeId=6d213588-b47c-4157-b1d4-71df71900000, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]]. New state: ACTIVE [21:08:04] : [Step 4/5] [2021-11-19 21:08:04,647][INFO ][exchange-worker-#15626%persistence.SingleNodePersistenceSslTest0%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/node00-e845bbf6-3300-4744-9c29-7c79044a42e4 [21:08:04] : [Step 4/5] [2021-11-19 21:08:04,652][INFO ][disco-notifier-worker-#15740%persistence.SingleNodePersistenceSslTest1%][GridClusterStateProcessor] Received activate cluster request with BaselineTopology[id=0] initiator node ID: 6d213588-b47c-4157-b1d4-71df71900000 [21:08:04] : [Step 4/5] [2021-11-19 21:08:04,652][INFO ][exchange-worker-#15626%persistence.SingleNodePersistenceSslTest0%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/node00-e845bbf6-3300-4744-9c29-7c79044a42e4/0000000000000000.wal, offset=8795, ver=2] [21:08:04] : [Step 4/5] [2021-11-19 21:08:04,653][INFO ][disco-notifier-worker-#15740%persistence.SingleNodePersistenceSslTest1%][GridClusterStateProcessor] Started state transition: activate cluster [21:08:04] : [Step 4/5] [2021-11-19 21:08:04,654][INFO ][exchange-worker-#15626%persistence.SingleNodePersistenceSslTest0%][GridClusterStateProcessor] Writing BaselineTopology[id=0] [21:08:04] : [Step 4/5] [2021-11-19 21:08:04,656][INFO ][exchange-worker-#15749%persistence.SingleNodePersistenceSslTest1%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], crd=false, evt=DISCOVERY_CUSTOM_EVT, evtNode=6d213588-b47c-4157-b1d4-71df71900000, customEvt=ChangeGlobalStateMessage [id=6ca5d593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqId=06ff3ad3-3c7d-4f30-99e4-897406c63ebb, initiatingNodeId=6d213588-b47c-4157-b1d4-71df71900000, state=ACTIVE, baselineTopology=BaselineTopology [id=0, branchingHash=1959438630, branchingType='New BaselineTopology', baselineNodes=[1a2dfc1f-296a-4406-b6d5-20c3b4317e2d, e845bbf6-3300-4744-9c29-7c79044a42e4]], forceChangeBaselineTopology=false, timestamp=1637345284640, forceDeactivation=true], allowMerge=false, exchangeFreeSwitch=false] [21:08:04] : [Step 4/5] [2021-11-19 21:08:04,658][INFO ][exchange-worker-#15626%persistence.SingleNodePersistenceSslTest0%][GridCacheDatabaseSharedManager] Finish recovery performed in 10 ms. [21:08:04] : [Step 4/5] [2021-11-19 21:08:04,659][INFO ][exchange-worker-#15749%persistence.SingleNodePersistenceSslTest1%][GridDhtPartitionsExchangeFuture] Start activation process [nodeId=6d827695-63a0-48c5-b3f8-d61ba2d00001, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]]. New state: ACTIVE [21:08:04] : [Step 4/5] [2021-11-19 21:08:04,660][INFO ][exchange-worker-#15626%persistence.SingleNodePersistenceSslTest0%][msg] Components activation performed in 13 ms. [21:08:04] : [Step 4/5] [2021-11-19 21:08:04,661][INFO ][exchange-worker-#15749%persistence.SingleNodePersistenceSslTest1%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/node01-1a2dfc1f-296a-4406-b6d5-20c3b4317e2d [21:08:04] : [Step 4/5] [2021-11-19 21:08:04,662][INFO ][exchange-worker-#15626%persistence.SingleNodePersistenceSslTest0%][GridCacheProcessor] Finished recovery for cache [cache=ignite-sys-cache, grp=ignite-sys-cache, startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:08:04] : [Step 4/5] [2021-11-19 21:08:04,664][INFO ][exchange-worker-#15749%persistence.SingleNodePersistenceSslTest1%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/node01-1a2dfc1f-296a-4406-b6d5-20c3b4317e2d/0000000000000000.wal, offset=8795, ver=2] [21:08:04] : [Step 4/5] [2021-11-19 21:08:04,665][INFO ][exchange-worker-#15626%persistence.SingleNodePersistenceSslTest0%][GridDhtPartitionsExchangeFuture] Successfully activated caches [nodeId=6d213588-b47c-4157-b1d4-71df71900000, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], newState=ACTIVE] [21:08:04] : [Step 4/5] [2021-11-19 21:08:04,666][INFO ][exchange-worker-#15749%persistence.SingleNodePersistenceSslTest1%][GridClusterStateProcessor] Writing BaselineTopology[id=0] [21:08:04] : [Step 4/5] [2021-11-19 21:08:04,667][INFO ][exchange-worker-#15626%persistence.SingleNodePersistenceSslTest0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:08:04] : [Step 4/5] [2021-11-19 21:08:04,670][INFO ][exchange-worker-#15749%persistence.SingleNodePersistenceSslTest1%][GridCacheDatabaseSharedManager] Finish recovery performed in 8 ms. [21:08:04] : [Step 4/5] [2021-11-19 21:08:04,671][INFO ][exchange-worker-#15749%persistence.SingleNodePersistenceSslTest1%][msg] Components activation performed in 10 ms. [21:08:04] : [Step 4/5] [2021-11-19 21:08:04,673][INFO ][exchange-worker-#15749%persistence.SingleNodePersistenceSslTest1%][GridCacheProcessor] Finished recovery for cache [cache=ignite-sys-cache, grp=ignite-sys-cache, startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:08:04] : [Step 4/5] [2021-11-19 21:08:04,674][INFO ][exchange-worker-#15749%persistence.SingleNodePersistenceSslTest1%][GridDhtPartitionsExchangeFuture] Successfully activated caches [nodeId=6d827695-63a0-48c5-b3f8-d61ba2d00001, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], newState=ACTIVE] [21:08:04] : [Step 4/5] [2021-11-19 21:08:04,675][INFO ][exchange-worker-#15749%persistence.SingleNodePersistenceSslTest1%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:08:04] : [Step 4/5] [2021-11-19 21:08:04,681][INFO ][exchange-worker-#15626%persistence.SingleNodePersistenceSslTest0%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], crd=true] [21:08:04] : [Step 4/5] [2021-11-19 21:08:04,684][INFO ][db-checkpoint-thread-#15760%persistence.SingleNodePersistenceSslTest0%][Checkpointer] Checkpoint started [checkpointId=35c2b8e8-b07d-4430-bd98-66a1bc07135c, startPtr=WALPointer [idx=0, fileOff=86673, len=1963], checkpointBeforeLockTime=2ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=1ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=1ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=0ms, pages=18, reason='node started'] [21:08:04] : [Step 4/5] [2021-11-19 21:08:04,717][INFO ][db-checkpoint-thread-#15760%persistence.SingleNodePersistenceSslTest0%][Checkpointer] Checkpoint finished [cpId=35c2b8e8-b07d-4430-bd98-66a1bc07135c, pages=18, markPos=WALPointer [idx=0, fileOff=86673, len=1963], walSegmentsCovered=[], markDuration=5ms, pagesWrite=13ms, fsync=19ms, total=39ms] [21:08:04] : [Step 4/5] [2021-11-19 21:08:04,717][INFO ][db-checkpoint-thread-#15765%persistence.SingleNodePersistenceSslTest1%][Checkpointer] Checkpoint started [checkpointId=8f5770be-0464-442d-ab25-0798b9a713f1, startPtr=WALPointer [idx=0, fileOff=86673, len=1963], checkpointBeforeLockTime=15ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=1ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=10ms, writeCheckpointEntryDuration=8ms, splitAndSortCpPagesDuration=0ms, pages=18, reason='node started'] [21:08:04] : [Step 4/5] [2021-11-19 21:08:04,744][INFO ][db-checkpoint-thread-#15765%persistence.SingleNodePersistenceSslTest1%][Checkpointer] Checkpoint finished [cpId=8f5770be-0464-442d-ab25-0798b9a713f1, pages=18, markPos=WALPointer [idx=0, fileOff=86673, len=1963], walSegmentsCovered=[], markDuration=21ms, pagesWrite=1ms, fsync=24ms, total=61ms] [21:08:04] : [Step 4/5] [2021-11-19 21:08:04,744][INFO ][grid-nio-worker-tcp-comm-0-#15564%TcpCommunicationSpi%][TcpCommunicationSpi] Accepted incoming communication connection [locAddr=/127.0.0.1:45180, rmtAddr=/127.0.0.1:59312] [21:08:04] : [Step 4/5] [2021-11-19 21:08:04,751][INFO ][exchange-worker-#15749%persistence.SingleNodePersistenceSslTest1%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], crd=false] [21:08:04] : [Step 4/5] [2021-11-19 21:08:04,754][INFO ][sys-#15605%persistence.SingleNodePersistenceSslTest0%][GridDhtPartitionsExchangeFuture] Coordinator received single message [ver=AffinityTopologyVersion [topVer=2, minorTopVer=1], node=6d827695-63a0-48c5-b3f8-d61ba2d00001, allReceived=true] [21:08:04] : [Step 4/5] [2021-11-19 21:08:04,755][INFO ][sys-#15605%persistence.SingleNodePersistenceSslTest0%][GridDhtPartitionsExchangeFuture] finishExchangeOnCoordinator [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:08:04] : [Step 4/5] [2021-11-19 21:08:04,763][INFO ][sys-#15605%persistence.SingleNodePersistenceSslTest0%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], err=null, rebalanced=true, wasRebalanced=false] [21:08:04] : [Step 4/5] [2021-11-19 21:08:04,763][INFO ][disco-notifier-worker-#15621%persistence.SingleNodePersistenceSslTest0%][GridClusterStateProcessor] Received state change finish message: ACTIVE [21:08:04] : [Step 4/5] [2021-11-19 21:08:04,765][INFO ][sys-#15727%persistence.SingleNodePersistenceSslTest1%][GridDhtPartitionsExchangeFuture] Received full message, will finish exchange [node=6d213588-b47c-4157-b1d4-71df71900000, resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:08:04] : [Step 4/5] [2021-11-19 21:08:04,765][INFO ][disco-notifier-worker-#15740%persistence.SingleNodePersistenceSslTest1%][GridClusterStateProcessor] Received state change finish message: ACTIVE [21:08:04] : [Step 4/5] [2021-11-19 21:08:04,765][INFO ][disco-notifier-worker-#15621%persistence.SingleNodePersistenceSslTest0%][GridClusterStateProcessor] Cluster state was changed from INACTIVE to ACTIVE [21:08:04] : [Step 4/5] [2021-11-19 21:08:04,766][INFO ][disco-notifier-worker-#15740%persistence.SingleNodePersistenceSslTest1%][GridClusterStateProcessor] Cluster state was changed from INACTIVE to ACTIVE [21:08:04] : [Step 4/5] [2021-11-19 21:08:04,768][INFO ][sys-#15732%persistence.SingleNodePersistenceSslTest1%][GridCachePartitionExchangeManager] Delay process full message without exchange id (there is exchange in progress) [nodeId=6d213588-b47c-4157-b1d4-71df71900000] [21:08:04] : [Step 4/5] [2021-11-19 21:08:04,768][INFO ][sys-#15727%persistence.SingleNodePersistenceSslTest1%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], err=null, rebalanced=true, wasRebalanced=false] [21:08:04] : [Step 4/5] [2021-11-19 21:08:04,767][INFO ][sys-#15605%persistence.SingleNodePersistenceSslTest0%][GridCacheProcessor] Finish proxy initialization, cacheName=ignite-sys-cache, localNodeId=6d213588-b47c-4157-b1d4-71df71900000 [21:08:04] : [Step 4/5] [2021-11-19 21:08:04,771][INFO ][sys-#15618%persistence.SingleNodePersistenceSslTest0%][DistributedBaselineConfiguration] Baseline auto-adjust is 'disabled' with timeout='300000' ms [21:08:04] : [Step 4/5] [2021-11-19 21:08:04,772][INFO ][sys-#15727%persistence.SingleNodePersistenceSslTest1%][GridCacheProcessor] Finish proxy initialization, cacheName=ignite-sys-cache, localNodeId=6d827695-63a0-48c5-b3f8-d61ba2d00001 [21:08:04] : [Step 4/5] [2021-11-19 21:08:04,771][INFO ][sys-#15605%persistence.SingleNodePersistenceSslTest0%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=6d213588-b47c-4157-b1d4-71df71900000, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=6d213588-b47c-4157-b1d4-71df71900000, consistentId=e845bbf6-3300-4744-9c29-7c79044a42e4, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastE[21xch:08:04] >>> Stopping teangeTimest:=16 SingleNodeP37345284760, ersistenceloc=tSslTesrue, ver=2.13.0#20211119-sha1:0000000t#testActivate in 4217 ms <<< [21:08:04] : [Step 4/5] 0, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:08:04] : [Step 4/5] [2021-11-19 21:08:04,771][INFO ][exchange-worker-#15626%persistence.SingleNodePersistenceSslTest0%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=2, minorTopVer=1], force=false, evt=DISCOVERY_CUSTOM_EVT, node=6d213588-b47c-4157-b1d4-71df71900000] [21:08:04] : [Step 4/5] [2021-11-19 21:08:04,777][INFO ][sys-#15605%persistence.SingleNodePersistenceSslTest0%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (1 ms), stage="Update caches registry" (14 ms), stage="Start caches" (2 ms), stage="Affinity initialization on cache group start" (0 ms), stage="Determine exchange type" (2 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (1 ms), stage="Restore partition states" (0 ms), stage="After states restored callback" (11 ms), stage="WAL history reservation" (0 ms), stage="Waiting for all single messages" (73 ms), stage="Affinity recalculation (crd)" (0 ms), stage="Collect update counters and create affinity messages" (0 ms), stage="Assign partitions states" (0 ms), stage="Validate partitions states" (0 ms), stage="Ideal affinity diff calculation (enforced)" (0 ms), stage="Apply update counters" (0 ms), stage="Full message preparing" (3 ms), stage="Full message sending" (0 ms), stage="State finish message sending" (2 ms), stage="Detect lost partitions" (2 ms), stage="Exchange done" (11 ms), stage="Total time" (122 ms), Discovery lag=9 ms, Latest started node id=6d827695-63a0-48c5-b3f8-d61ba2d00001] [21:08:04] : [Step 4/5] [2021-11-19 21:08:04,777][INFO ][main][root] >>> Stopping test: SingleNodePersistenceSslTest#testActivate in 4217 ms <<< [21:08:04] : [Step 4/5] [2021-11-19 21:08:04,776][INFO ][exchange-worker-#15749%[21:08:persistenc04] >>> Heap: 559 MB used / 1908 MB commited / 1908 MB max <<< [21:08:04] : [Step 4/5] e.SingleNodePersistenceSslTest1%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=2, minorTopVer=1], force=false, evt=DISCOVERY_CUSTOM_EVT, node=6d213588-b47c-4157-b1d4-71df71900000] [21:08:04] : [Step 4/5] [2021-11-19 21:08:04,776][INFO ][sys-#15727%persistence.SingleNodePersistenceSslTest1%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=6d827695-63a0-48c5-b3f8-d61ba2d00001, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=6d213588-b47c-4157-b1d4-71df71900000, consistentId=e845bbf6-3300-4744-9c29-7c79044a42e4, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345284566, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:08:04] : [Step 4/5] [2021-11-19 21:08:04,775][INFO ][sys-#15736%persistence.SingleNodePersistenceSslTest1%][DistributedBaselineConfiguration] Baseline auto-adjust is 'disabled' with timeout='300000' ms [21:08:04] : [Step 4/5] [2021-11-19 21:08:04,772][INFO ][sys-#15618%persistence.SingleNodePersistenceSslTest0%][GridClusterStateProcessor] Successfully performed final activation steps [nodeId=6d213588-b47c-4157-b1d4-71df71900000, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:08:04] : [Step 4/5] [2021-11-19 21:08:04,784][INFO ][sys-#15736%persistence.SingleNodePersistenceSslTest1%][GridClusterStateProcessor] Successfully performed final activation steps [nodeId=6d827695-63a0-48c5-b3f8-d61ba2d00001, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:08:04] : [Step 4/5] [2021-11-19 21:08:04,783][INFO ][sys-#15727%persistence.SingleNodePersistenceSslTest1%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (3 ms), stage="Update caches registry" (13 ms), stage="Start caches" (0 ms), stage="Affinity initialization on cache group start" (0 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Restore partition states" (0 ms), stage="After states restored callback" (23 ms), stage="WAL history reservation" (0 ms), stage="Waiting for Full message" (65 ms), stage="Affinity recalculation" (1 ms), stage="Full map updating" (1 ms), stage="Detect lost partitions" (3 ms), stage="Exchange done" (12 ms), stage="Total time" (121 ms)] [21:08:04] : [Step 4/5] [2021-11-19 21:08:04,781][INFO ][main][root] >>> Heap: 559 MB used / 1908 MB commited / 1908 MB max <<< [21:08:04] : [Step 4/5] [21:08:04] >>> Non[2021-11-19 21:08:04,781][INFO ][sys-#15605%-Heapersistenp:ce.SingleNo 159 MB used / 175 MB commdePersistenceSslTest0%][GridDhtPartitionsExchaited / 0 MB mangeFuturx <<< [21:08:04] : [Step 4/5] e] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], stage="Affinity initialization on cache group start [grp=ignite-sys-cache]" (0 ms) (parent=Affinity initialization on cache group start), stage="Affinity centralized initialization (crd) [grp=ignite-sys-cache, crd=true]" (2 ms) (parent=Determine exchange type), stage="Restore partition states [grp=ignite-sys-cache]" (0 ms) (parent=Restore partition states), stage="Affinity recalculation (partitions availability) [grp=ignite-sys-cache]" (0 ms) (parent=Ideal affinity diff calculation (enforced))] [21:08:04] : [Step 4/5] [2021-11-19 21:08:04,788][INFO ][main][root] >>> Non-Heap: 159 MB used / 175 MB commited / 0 MB max <<< [21:08:04] : [Step 4/5] [2021-11-19 21:08:04,787][INFO ][sys-#15727%persistence.SingleNodePersistenceSslTest1%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], stage="Affinity initialization on cache group start [grp=ignite-sys-cache]" (0 ms) (parent=Affinity initialization on cache group start), stage="Affinity centralized initialization (crd) [grp=ignite-sys-cache, crd=false]" (0 ms) (parent=Determine exchange type), stage="Restore partition states [grp=ignite-sys-cache]" (0 ms) (parent=Restore partition states), stage="Affinity applying from full message [grp=ignite-sys-cache]" (1 ms) (parent=Affinity recalculation)] [21:08:04] : [Step 4/5] [2021-11-19 21:08:04,790][INFO ][main][root] >>> Stopping grid [name=persistence.SingleNodePersistenceSslTest0, id=6d213588-b47c-4157-b1d4-71df71900000] [21:08:04] : [Step 4/5] [2021-11-19 21:08:04,797][INFO ][db-checkpoint-thread-#15760%persistence.SingleNodePersistenceSslTest0%][Checkpointer] Skipping checkpoint (no pages were modified) [checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, reason='timeout'] [21:08:04] : [Step 4/5] [2021-11-19 21:08:04,807][INFO ][disco-event-worker-#15748%persistence.SingleNodePersistenceSslTest1%][GridDiscoveryManager] Node left topology: TcpDiscoveryNode [id=6d213588-b47c-4157-b1d4-71df71900000, consistentId=e845bbf6-3300-4744-9c29-7c79044a42e4, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345284566, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false] [21:08:04]W: [org.apache.ignite:ignite-core] [2021-11-19 21:08:04,807][WARN ][tcp-disco-sock-reader-[6d827695 127.0.0.1:48285]-#823%persistence.SingleNodePersistenceSslTest0%-#15746%persistence.SingleNodePersistenceSslTest0%][TestTcpDiscoverySpi] Failed to shutdown socket [21:08:04]W: [org.apache.ignite:ignite-core] java.net.SocketException: Socket is closed [21:08:04]W: [org.apache.ignite:ignite-core] at java.net.Socket.shutdownInput(Socket.java:1538) [21:08:04]W: [org.apache.ignite:ignite-core] at sun.security.ssl.BaseSSLSocketImpl.shutdownInput(BaseSSLSocketImpl.java:216) [21:08:04]W: [org.apache.ignite:ignite-core] at sun.security.ssl.SSLSocketImpl.shutdownInput(SSLSocketImpl.java:662) [21:08:04]W: [org.apache.ignite:ignite-core] at sun.security.ssl.SSLSocketImpl.shutdownInput(SSLSocketImpl.java:635) [21:08:04]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.close(IgniteUtils.java:4248) [21:08:04]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.discovery.tcp.ServerImpl$SocketReader.body(ServerImpl.java:7370) [21:08:04]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.IgniteSpiThread.run(IgniteSpiThread.java:58) [21:08:04] : [Step 4/5] [2021-11-19 21:08:04,808][INFO ][disco-event-worker-#15748%persistence.SingleNodePersistenceSslTest1%][GridDiscoveryManager] Topology snapshot [ver=3, locNode=6d827695, servers=1, clients=0, state=ACTIVE, CPUs=24, offheap=0.25GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=6d827695-63a0-48c5-b3f8-d61ba2d00001, consistentId=1a2dfc1f-296a-4406-b6d5-20c3b4317e2d, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:08:04] : [Step 4/5] [2021-11-19 21:08:04,809][INFO ][tcp-disco-sock-reader-[6d827695 127.0.0.1:48285]-#823%persistence.SingleNodePersistenceSslTest0%-#15746%persistence.SingleNodePersistenceSslTest0%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:48285, rmtPort=48285, rmtNodeId=6d827695-63a0-48c5-b3f8-d61ba2d00001] [21:08:04] : [Step 4/5] [2021-11-19 21:08:04,810][INFO ][disco-event-worker-#15748%persistence.SingleNodePersistenceSslTest1%][GridDiscoveryManager] Coordinator changed [prev=TcpDiscoveryNode [id=6d213588-b47c-4157-b1d4-71df71900000, consistentId=e845bbf6-3300-4744-9c29-7c79044a42e4, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345284566, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], cur=TcpDiscoveryNode [id=6d827695-63a0-48c5-b3f8-d61ba2d00001, consistentId=1a2dfc1f-296a-4406-b6d5-20c3b4317e2d, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637345284801, loc=true, ver=2.13.0#20211119-sha1:00000000, isClient=false]] [21:08:04] : [Step 4/5] [2021-11-19 21:08:04,813][INFO ][main][GridCacheProcessor] Stopped cache [cacheName=ignite-sys-cache] [21:08:04] : [Step 4/5] [2021-11-19 21:08:04,813][INFO ][disco-event-worker-#15748%persistence.SingleNodePersistenceSslTest1%][GridDiscoveryManager] ^-- Baseline [id=0, size=2, online=1, offline=1] [21:08:04] : [Step 4/5] [2021-11-19 21:08:04,817][INFO ][disco-event-worker-#15748%persistence.SingleNodePersistenceSslTest1%][MvccProcessorImpl] Assigned mvcc coordinator [crd=MvccCoordinator [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], nodeId=6d827695-63a0-48c5-b3f8-d61ba2d00001, ver=1637345281640, local=true, initialized=false]] [21:08:04]W: [org.apache.ignite:ignite-core] [2021-11-19 21:08:04,817][WARN ][grid-nio-worker-tcp-comm-0-#15683%TcpCommunicationSpi%][TcpCommunicationSpi] Failed to shutdown socket [21:08:04]W: [org.apache.ignite:ignite-core] java.nio.channels.ClosedChannelException [21:08:04]W: [org.apache.ignite:ignite-core] at sun.nio.ch.SocketChannelImpl.shutdownOutput(SocketChannelImpl.java:795) [21:08:04]W: [org.apache.ignite:ignite-core] at sun.nio.ch.SocketAdaptor.shutdownOutput(SocketAdaptor.java:407) [21:08:04]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.close(IgniteUtils.java:4247) [21:08:04]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.closeKey(GridNioServer.java:2784) [21:08:04]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.close(GridNioServer.java:2835) [21:08:04]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.close(GridNioServer.java:2794) [21:08:04]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.bodyInternal(GridNioServer.java:2157) [21:08:04]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.body(GridNioServer.java:1910) [21:08:04]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:125) [21:08:04]W: [org.apache.ignite:ignite-core] at java.lang.Thread.run(Thread.java:748) [21:08:04] : [Step 4/5] [2021-11-19 21:08:04,820][INFO ][exchange-worker-#15749%persistence.SingleNodePersistenceSslTest1%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], crd=true, evt=NODE_LEFT, evtNode=6d213588-b47c-4157-b1d4-71df71900000, customEvt=null, allowMerge=false, exchangeFreeSwitch=true] [21:08:04] : [Step 4/5] [2021-11-19 21:08:04,819][INFO ][sys-#15718%persistence.SingleNodePersistenceSslTest1%][ExchangeLatchManager] Become new coordinator 6d827695-63a0-48c5-b3f8-d61ba2d00001 [21:08:04] : [Step 4/5] [2021-11-19 21:08:04,822][INFO ][exchange-worker-#15749%persistence.SingleNodePersistenceSslTest1%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:08:04] : [Step 4/5] [2021-11-19 21:08:04,822][INFO ][exchange-worker-#15749%persistence.SingleNodePersistenceSslTest1%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], err=null, rebalanced=true, wasRebalanced=true] [21:08:04] : [Step 4/5] [2021-11-19 21:08:04,823][INFO ][exchange-worker-#15749%persistence.SingleNodePersistenceSslTest1%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=6d827695-63a0-48c5-b3f8-d61ba2d00001, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], evt=NODE_LEFT, evtNode=TcpDiscoveryNode [id=6d213588-b47c-4157-b1d4-71df71900000, consistentId=e845bbf6-3300-4744-9c29-7c79044a42e4, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345284566, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0]] [21:08:04] : [Step 4/5] [2021-11-19 21:08:04,824][INFO ][exchange-worker-#15749%persistence.SingleNodePersistenceSslTest1%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (1 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="After states restored callback" (0 ms), stage="WAL history reservation" (0 ms), stage="Finalize update counters" (0 ms), stage="Detect lost partitions" (0 ms), stage="Exchange done" (1 ms), stage="Total time" (2 ms)] [21:08:04] : [Step 4/5] [2021-11-19 21:08:04,826][INFO ][exchange-worker-#15749%persistence.SingleNodePersistenceSslTest1%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], stage="Affinity initialization (exchange-free switch on fully-rebalanced topology) [grp=ignite-sys-cache]" (0 ms) (parent=Determine exchange type)] [21:08:04] : [Step 4/5] [2021-11-19 21:08:04,826][INFO ][exchange-worker-#15749%persistence.SingleNodePersistenceSslTest1%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], crd=true] [21:08:04] : [Step 4/5] [2021-11-19 21:08:04,827][INFO ][exchange-worker-#15749%persistence.SingleNodePersistenceSslTest1%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=3, minorTopVer=0], force=false, evt=NODE_LEFT, node=6d213588-b47c-4157-b1d4-71df71900000] [21:08:05] : [Step 4/5] [2021-11-19 21:08:05,352][INFO ][main][FilePageStoreManager] Cleanup cache stores [total=3, left=0, cleanFiles=false] [21:08:05] : [Step 4/5] [2021-11-19 21:08:05,357][INFO ][main][GridDeploymentLocalStore] Removed undeployed class: GridDeployment [ts=1637345284749, depMode=SHARED, clsLdr=IsolatedClassLoader{roleName='test'}, clsLdrId=fda5d593d71-6d213588-b47c-4157-b1d4-71df71900000, userVer=0, loc=true, sampleClsName=org.apache.ignite.internal.processors.cache.distributed.dht.preloader.GridDhtPartitionMap, pendingUndeploy=false, undeployed=true, usage=0] [21:08:05] : [Step 4/5] [2021-11-19 21:08:05,368][INFO ][main][SingleNodePersistenceSslTest0] [21:08:05] : [Step 4/5] [21:08:05] : [Step 4/5] >>> +------------------------------------------------------+ [21:08:05] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV stopped OK [21:08:05] : [Step 4/5] >>> +------------------------------------------------------+ [21:08:05] : [Step 4/5] >>> Ignite instance name: persistence.SingleNodePersistenceSslTest0 [21:08:05] : [Step 4/5] >>> Grid uptime: 00:00:03.709 [21:08:05] : [Step 4/5] [21:08:05] : [Step 4/5] [21:08:05] : [Step 4/5] [2021-11-19 21:08:05,369][INFO ][main][root] >>> Stopping grid [name=persistence.SingleNodePersistenceSslTest1, id=6d827695-63a0-48c5-b3f8-d61ba2d00001] [21:08:05]W: [org.apache.ignite:ignite-core] [2021-11-19 21:08:05,379][WARN ][tcp-disco-sock-reader-[6d213588 127.0.0.1:36337]-#822%persistence.SingleNodePersistenceSslTest1%-#15745%persistence.SingleNodePersistenceSslTest1%][TestTcpDiscoverySpi] Failed to shutdown socket: Closed transport, general or untracked problem [21:08:05]W: [org.apache.ignite:ignite-core] javax.net.ssl.SSLException: Closed transport, general or untracked problem [21:08:05]W: [org.apache.ignite:ignite-core] at sun.security.ssl.Alert.createSSLException(Alert.java:133) [21:08:05]W: [org.apache.ignite:ignite-core] at sun.security.ssl.Alert.createSSLException(Alert.java:117) [21:08:05]W: [org.apache.ignite:ignite-core] at sun.security.ssl.TransportContext.fatal(TransportContext.java:288) [21:08:05]W: [org.apache.ignite:ignite-core] at sun.security.ssl.TransportContext.fatal(TransportContext.java:270) [21:08:05]W: [org.apache.ignite:ignite-core] at sun.security.ssl.TransportContext.fatal(TransportContext.java:261) [21:08:05]W: [org.apache.ignite:ignite-core] at sun.security.ssl.SSLSocketImpl.shutdownInput(SSLSocketImpl.java:656) [21:08:05]W: [org.apache.ignite:ignite-core] at sun.security.ssl.SSLSocketImpl.shutdownInput(SSLSocketImpl.java:635) [21:08:05]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.close(IgniteUtils.java:4248) [21:08:05]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.discovery.tcp.ServerImpl$SocketReader.body(ServerImpl.java:7370) [21:08:05]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.IgniteSpiThread.run(IgniteSpiThread.java:58) [21:08:05] : [Step 4/5] [2021-11-19 21:08:05,381][INFO ][tcp-disco-sock-reader-[6d213588 127.0.0.1:36337]-#822%persistence.SingleNodePersistenceSslTest1%-#15745%persistence.SingleNodePersistenceSslTest1%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:36337, rmtPort=36337, rmtNodeId=6d213588-b47c-4157-b1d4-71df71900000] [21:08:05] : [Step 4/5] [2021-11-19 21:08:05,382][INFO ][main][GridCacheProcessor] Stopped cache [cacheName=ignite-sys-cache] [21:08:05] : [Step 4/5] [2021-11-19 21:08:05,747][INFO ][main][FilePageStoreManager] Cleanup cache stores [total=3, left=0, cleanFiles=false] [21:08:05] : [Step 4/5] [2021-11-19 21:08:05,749][INFO ][main][GridDeploymentLocalStore] Removed undeployed class: GridDeployment [ts=1637345284760, depMode=SHARED, clsLdr=IsolatedClassLoader{roleName='test'}, clsLdrId=2ea5d593d71-6d827695-63a0-48c5-b3f8-d61ba2d00001, userVer=0, loc=true, sampleClsName=org.apache.ignite.internal.processors.cache.distributed.dht.preloader.IgniteDhtPartitionHistorySuppliersMap, pendingUndeploy=false, undeployed=true, usage=0] [21:08:05] : [Step 4/5] [2021-11-19 21:08:05,758][INFO ][main][SingleNodePersistenceSslTest1] [21:08:05] : [Step 4/5] [21:08:05] : [Step 4/5] >>> +------------------------------------------------------+ [21:08:05] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV stopped OK [21:08:05] : [Step 4/5] >>> +------------------------------------------------------+ [21:08:05] : [Step 4/5] >>> Ignite instance name: persistence.SingleNodePersistenceSslTest1 [21:08:05] : [Step 4/5] >>> Grid uptime: 00:00:01.124 [21:08:05] : [Step 4/5] [21:08:05] : [Step 4/5] [21:08:05] : [Step 4/5] [21:08:05] >>> Stopping test class: SingleNodePersistenceSslTest <<< [21:08:05] : [Step 4/5] [2021-11-19 21:08:05,854][INFO ][main][root] >>> Stopping test class: SingleNodePersistenceSslTest <<< [21:08:05] : [Step 4/5] [21:08:05] >>> Starting test class: MasterKeyChangeTest <<< [21:08:05] : [Step 4/5] [2021-11-19 21:08:05,855][INFO ][main][root] >>> Starting test class: MasterKeyChangeTest <<< [21:08:05] : [Step 4/5] Running org.apache.ignite.internal.encryption.MasterKeyChangeTest [21:08:05]i: [Step 4/5] ##teamcity[importData type='surefire' path='/opt/buildagent/temp/buildTmp/ignite-tools-junit-reports1777670380320881607/test-org.apache.ignite.testsuites.IgniteBasicWithPersistenceTestSuite1637345280557.xml'] [21:08:05] : [Step 4/5] [21:08:05] >>> Starting test: MasterKeyChangeTest#testManualRecovery <<< [21:08:05] : [Step 4/5] Importing data from '/opt/buildagent/temp/buildTmp/ignite-tools-junit-reports1777670380320881607/test-org.apache.ignite.testsuites.IgniteBasicWithPersistenceTestSuite1637345280557.xml' (278 B) with 'surefire' processor [21:08:05] : [Step 4/5] [2021-11-19 21:08:05,866][INFO ][main][root] >>> Starting test: MasterKeyChangeTest#testManualRecovery <<< [21:08:05] : [Step 4/5] [21:08:05] >>> Heap: 564 MB used / 1908 MB commited / 1908 MB max <<< [21:08:05] : [Step 4/5] [2021-11-19 21:08:05,866][INFO ][main][root] >>> Heap: 564 MB used / 1908 MB commited / 1908 MB max <<< [21:08:05] : [Step 4/5] [21:08:05] >>> Non-Heap: 160 MB used / 176 MB commited / 0 MB max <<< [21:08:05] : [Step 4/5] [2021-11-19 21:08:05,866][INFO ][main][root] >>> Non-Heap: 160 MB used / 176 MB commited / 0 MB max <<< [21:08:05]W: [org.apache.ignite:ignite-core] [2021-11-19 21:08:05,878][WARN ][test-runner-#15781%encryption.MasterKeyChangeTest%][G] Ignite work directory is not provided, automatically resolved to: /opt/buildagent/work/7bc1c54bc719b67c/work [21:08:05] : [Step 4/5] [2021-11-19 21:08:05,879][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] [21:08:05] : [Step 4/5] [21:08:05] : [Step 4/5] >>> __________ ________________ [21:08:05] : [Step 4/5] >>> / _/ ___/ |/ / _/_ __/ __/ [21:08:05] : [Step 4/5] >>> _/ // (7 7 // / / / / _/ [21:08:05] : [Step 4/5] >>> /___/\___/_/|_/___/ /_/ /___/ [21:08:05] : [Step 4/5] >>> [21:08:05] : [Step 4/5] >>> ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:08:05] : [Step 4/5] >>> 2021 Copyright(C) Apache Software Foundation [21:08:05] : [Step 4/5] >>> [21:08:05] : [Step 4/5] >>> Ignite documentation: http://ignite.apache.org [21:08:05] : [Step 4/5] [21:08:05] : [Step 4/5] [2021-11-19 21:08:05,880][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] Config URL: n/a [21:08:05] : [Step 4/5] [2021-11-19 21:08:05,881][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] IgniteConfiguration [igniteInstanceName=grid-0, pubPoolSize=24, svcPoolSize=24, callbackPoolSize=24, stripedPoolSize=24, sysPoolSize=24, mgmtPoolSize=4, dataStreamerPoolSize=24, utilityCachePoolSize=24, utilityCacheKeepAliveTime=60000, p2pPoolSize=2, qryPoolSize=24, buildIdxPoolSize=4, igniteHome=/opt/buildagent/work/7bc1c54bc719b67c, igniteWorkDir=/opt/buildagent/work/7bc1c54bc719b67c/work, mbeanSrv=com.sun.jmx.mbeanserver.JmxMBeanServer@6fe85038, nodeId=00257274-13ec-45e2-bbc6-7e1e40c5d000, marsh=BinaryMarshaller [], marshLocJobs=false, daemon=false, p2pEnabled=true, netTimeout=10000, netCompressionLevel=1, sndRetryDelay=1000, sndRetryCnt=3, metricsHistSize=10000, metricsUpdateFreq=1000, metricsExpTime=9223372036854775807, discoSpi=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=0, ackTimeout=0, marsh=null, reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], segPlc=STOP, segResolveAttempts=2, waitForSegOnStart=true, allResolversPassReq=true, segChkFreq=10000, commSpi=TcpCommunicationSpi [connectGate=org.apache.ignite.spi.communication.tcp.internal.ConnectGateway@26785233, ctxInitLatch=java.util.concurrent.CountDownLatch@1af23d02[Count = 1], stopping=false, clientPool=null, nioSrvWrapper=null, stateProvider=null], evtSpi=MemoryEventStorageSpi [expireAgeMs=9223372036854775807, expireCnt=10000, filter=null], colSpi=NoopCollisionSpi [], deploySpi=LocalDeploymentSpi [], indexingSpi=org.apache.ignite.spi.indexing.noop.NoopIndexingSpi@7cdf7bc5, addrRslvr=null, encryptionSpi=org.apache.ignite.spi.encryption.keystore.KeystoreEncryptionSpi@3033dec6, tracingSpi=org.apache.ignite.spi.tracing.NoopTracingSpi@3864f431, clientMode=false, rebalanceThreadPoolSize=4, rebalanceTimeout=10000, rebalanceBatchesPrefetchCnt=3, rebalanceThrottle=0, rebalanceBatchSize=524288, txCfg=TransactionConfiguration [txSerEnabled=false, dfltIsolation=REPEATABLE_READ, dfltConcurrency=PESSIMISTIC, dfltTxTimeout=0, txTimeoutOnPartitionMapExchange=0, deadlockTimeout=10000, pessimisticTxLogSize=0, pessimisticTxLogLinger=10000, tmLookupClsName=null, txManagerFactory=null, useJtaSync=false], cacheSanityCheckEnabled=true, discoStartupDelay=60000, deployMode=SHARED, p2pMissedCacheSize=100, locHost=127.0.0.1, timeSrvPortBase=31100, timeSrvPortRange=100, failureDetectionTimeout=10000, sysWorkerBlockedTimeout=null, clientFailureDetectionTimeout=10000, metricsLogFreq=0, connectorCfg=null, odbcCfg=null, warmupClos=null, atomicCfg=AtomicConfiguration [seqReserveSize=1000, cacheMode=PARTITIONED, backups=1, aff=null, grpName=null], classLdr=null, sslCtxFactory=null, platformCfg=null, binaryCfg=null, memCfg=null, pstCfg=null, dsCfg=DataStorageConfiguration [sysRegionInitSize=41943040, sysRegionMaxSize=104857600, pageSize=4096, concLvl=0, dfltDataRegConf=DataRegionConfiguration [name=default, maxSize=10485760, initSize=268435456, swapPath=null, pageEvictionMode=DISABLED, pageReplacementMode=CLOCK, evictionThreshold=0.9, emptyPagesPoolSize=100, metricsEnabled=false, metricsSubIntervalCount=5, metricsRateTimeInterval=60000, persistenceEnabled=true, checkpointPageBufSize=0, lazyMemoryAllocation=true, warmUpCfg=null], dataRegions=null, storagePath=null, checkpointFreq=180000, lockWaitTime=10000, checkpointThreads=4, checkpointWriteOrder=SEQUENTIAL, walHistSize=20, maxWalArchiveSize=1073741824, walSegments=10, walSegmentSize=67108864, walPath=db/wal, walArchivePath=db/wal/archive, cdcWalPath=db/wal/cdc, cdcEnabled=false, metricsEnabled=false, walMode=FSYNC, walTlbSize=131072, walBuffSize=0, walFlushFreq=2000, walFsyncDelay=1000, walRecordIterBuffSize=67108864, alwaysWriteFullPages=false, fileIOFactory=org.apache.ignite.internal.processors.cache.persistence.file.AsyncFileIOFactory@3e35b16f, metricsSubIntervalCnt=5, metricsRateTimeInterval=60000, walAutoArchiveAfterInactivity=-1, walForceArchiveTimeout=-1, writeThrottlingEnabled=false, walCompactionEnabled=false, walCompactionLevel=1, checkpointReadLockTimeout=null, walPageCompression=DISABLED, walPageCompressionLevel=null, dfltWarmUpCfg=null, encCfg=org.apache.ignite.configuration.EncryptionConfiguration@74dcd819, defragmentationThreadPoolSize=4, minWalArchiveSize=-1], snapshotPath=snapshots, activeOnStart=true, activeOnStartPropSetFlag=false, autoActivation=true, autoActivationPropSetFlag=false, clusterStateOnStart=null, sqlConnCfg=null, cliConnCfg=ClientConnectorConfiguration [host=null, port=10800, portRange=100, sockSndBufSize=0, sockRcvBufSize=0, tcpNoDelay=true, maxOpenCursorsPerConn=128, threadPoolSize=24, selectorCnt=12, idleTimeout=0, handshakeTimeout=10000, jdbcEnabled=true, odbcEnabled=true, thinCliEnabled=true, sslEnabled=false, useIgniteSslCtxFactory=true, sslClientAuth=false, sslCtxFactory=null, thinCliCfg=ThinClientConfiguration [maxActiveTxPerConn=100, maxActiveComputeTasksPerConn=0]], mvccVacuumThreadCnt=2, mvccVacuumFreq=5000, authEnabled=false, failureHnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]], commFailureRslvr=null, sqlCfg=SqlConfiguration [longQryWarnTimeout=3000, dfltQryTimeout=0, sqlQryHistSize=1000, validationEnabled=false], asyncContinuationExecutor=null] [21:08:05] : [Step 4/5] [2021-11-19 21:08:05,888][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] Daemon mode: off [21:08:05] : [Step 4/5] [2021-11-19 21:08:05,889][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] OS: Linux 4.15.0-151-generic amd64 [21:08:05] : [Step 4/5] [2021-11-19 21:08:05,889][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] OS user: teamcity [21:08:05] : [Step 4/5] [2021-11-19 21:08:05,889][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] PID: 16724 [21:08:05] : [Step 4/5] [2021-11-19 21:08:05,890][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] Language runtime: Java Platform API Specification ver. 1.8 [21:08:05] : [Step 4/5] [2021-11-19 21:08:05,890][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] VM information: Java(TM) SE Runtime Environment 1.8.0_261-b12 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 25.261-b12 [21:08:05] : [Step 4/5] [2021-11-19 21:08:05,890][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] VM total memory: 1.9GB [21:08:05] : [Step 4/5] [2021-11-19 21:08:05,890][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] Remote Management [restart: off, REST: off, JMX (remote: off)] [21:08:05] : [Step 4/5] [2021-11-19 21:08:05,891][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] Logger: GridTestLog4jLogger [quiet=false, config=null] [21:08:05] : [Step 4/5] [2021-11-19 21:08:05,891][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] IGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c [21:08:05] : [Step 4/5] [2021-11-19 21:08:05,891][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] VM arguments: [-DIGNITE_DUMP_THREADS_ON_FAILURE=false, -DMono=/usr/bin/mono-sgen, -DMono4.0_x64=/usr/lib/mono/4.0, -DMono4.5_x64=/usr/lib/mono/4.5, -DMonoVersion=6.12.0.90, -DSKIP_BUILD=false, -Dagent.home.dir=/opt/buildagent, -Dagent.name=aitc-lin02_03, -Dagent.ownPort=9090, -Dagent.work.dir=/opt/buildagent/work, -Dbuild.number=95, -Dbuild.vcs.number=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.1=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.GitHubApacheIgnite=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dclassworlds.conf=/opt/buildagent/temp/buildTmp/teamcity.m2.conf, -Dcom.jetbrains.maven.watcher.report.file=/opt/buildagent/temp/buildTmp/maven-build-info.xml, -Djava.io.tmpdir=/opt/buildagent/temp/buildTmp, -Dmaven.home=/opt/buildagent/tools/maven3_6, -Dmaven.multiModuleProjectDirectory=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.agent.cpuBenchmark=457, -Dteamcity.agent.dotnet.agent_url=http://localhost:9090/RPC2, -Dteamcity.agent.dotnet.build_id=6278078, -Dteamcity.auth.password=*******, -Dteamcity.auth.userId=TeamCityBuildId=6278078, -Dteamcity.build.changedFiles.file=/opt/buildagent/temp/buildTmp/changedFiles6342607772318147725.txt, -Dteamcity.build.checkoutDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.build.id=6278078, -Dteamcity.build.properties.file=/opt/buildagent/temp/buildTmp/teamcity.build5164517880467851002.properties, -Dteamcity.build.tempDir=/opt/buildagent/temp/buildTmp, -Dteamcity.build.workingDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.buildConfName=Basic 3, -Dteamcity.buildType.id=IgniteTests24Java8_Basic3, -Dteamcity.configuration.properties.file=/opt/buildagent/temp/buildTmp/teamcity.config5591980786735343870.properties, -Dteamcity.maven.userSettings.path=/opt/buildagent/temp/buildTmp/maven_settings_585072866407032347.xml, -Dteamcity.maven.watcher.home=/opt/buildagent/plugins/mavenPlugin/maven-watcher-jdk16, -Dteamcity.projectName=Ignite Tests 2.x (JDK 8/11), -Dteamcity.runner.properties.file=/opt/buildagent/temp/buildTmp/teamcity.runner9098465561618137420.properties, -Dteamcity.tests.recentlyFailedTests.file=/opt/buildagent/temp/buildTmp/testsToRunFirst3891775683130404069.txt, -Dteamcity.version=2021.2 (build 99542), -ea, -Xms2g, -Xmx2g, -XX:+HeapDumpOnOutOfMemoryError, -DIGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_TEST_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_UPDATE_NOTIFIER=false, -DIGNITE_NO_DISCO_ORDER=true, -DIGNITE_PERFORMANCE_SUGGESTIONS_DISABLED=true, -Djava.net.preferIPv4Stack=true, -DTEST_SCALE_FACTOR=1.0, -DIGNITE_TEST_PROP_LOG4J_FILE=log4j-tc-test.xml, -DIGNITE_QUIET=false, -DIGNITE_MARSHAL_BUFFERS_RECHECK=1000, -Dmaven.repo.local=/opt/buildagent/.m2/repository] [21:08:05] : [Step 4/5] [2021-11-19 21:08:05,896][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] System cache's DataRegion size is configured to 40 MB. Use DataStorageConfiguration.systemRegionInitialSize property to change the setting. [21:08:05] : [Step 4/5] [2021-11-19 21:08:05,897][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] Configured caches [in 'sysMemPlc' dataRegion: ['ignite-sys-cache']] [21:08:05]W: [org.apache.ignite:ignite-core] [2021-11-19 21:08:05,897][WARN ][test-runner-#15781%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] Peer class loading is enabled (disable it in production for performance and deployment consistency reasons) [21:08:05] : [Step 4/5] [2021-11-19 21:08:05,897][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] 3-rd party licenses can be found at: /opt/buildagent/work/7bc1c54bc719b67c/libs/licenses [21:08:05] : [Step 4/5] [2021-11-19 21:08:05,903][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] Configured plugins: [21:08:05] : [Step 4/5] [2021-11-19 21:08:05,903][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] ^-- StanByClusterTestProvider 1.0 [21:08:05] : [Step 4/5] [2021-11-19 21:08:05,903][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:08:05] : [Step 4/5] [2021-11-19 21:08:05,903][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] [21:08:05] : [Step 4/5] [2021-11-19 21:08:05,904][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] ^-- PageMemory tracker plugin 1.0 [21:08:05] : [Step 4/5] [2021-11-19 21:08:05,904][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:08:05] : [Step 4/5] [2021-11-19 21:08:05,904][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] [21:08:05] : [Step 4/5] [2021-11-19 21:08:05,904][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] ^-- TestDistibutedConfigurationPlugin 1.0 [21:08:05] : [Step 4/5] [2021-11-19 21:08:05,905][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:08:05] : [Step 4/5] [2021-11-19 21:08:05,905][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] [21:08:05] : [Step 4/5] [2021-11-19 21:08:05,905][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] ^-- NodeValidationPluginProvider 1.0 [21:08:05] : [Step 4/5] [2021-11-19 21:08:05,905][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:08:05] : [Step 4/5] [2021-11-19 21:08:05,905][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] [21:08:05] : [Step 4/5] [2021-11-19 21:08:05,906][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][FailureProcessor] Configured failure handler: [hnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]]] [21:08:05] : [Step 4/5] [2021-11-19 21:08:05,922][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][TestRecordingCommunicationSpi] Successfully bound communication NIO server to TCP port [port=47100, locHost=/127.0.0.1, selectorsCnt=12, selectorSpins=0, pairedConn=false] [21:08:05]W: [org.apache.ignite:ignite-core] [2021-11-19 21:08:05,922][WARN ][test-runner-#15781%encryption.MasterKeyChangeTest%][TestRecordingCommunicationSpi] Message queue limit is set to 0 which may lead to potential OOMEs when running cache operations in FULL_ASYNC or PRIMARY_SYNC modes due to message queues growth on sender and receiver sides. [21:08:05] : [Step 4/5] [2021-11-19 21:08:05,927][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][GridCollisionManager] Collision resolution is disabled (all jobs will be activated upon arrival). [21:08:05] : [Step 4/5] [2021-11-19 21:08:05,927][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] Security status [authentication=off, sandbox=off, tls/ssl=off] [21:08:05] : [Step 4/5] [2021-11-19 21:08:05,987][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:08:06] : [Step 4/5] [2021-11-19 21:08:06,071][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][MaintenanceProcessor] Resolved store directory for node persistent data: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0 [21:08:06] : [Step 4/5] [2021-11-19 21:08:06,072][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][CacheObjectBinaryProcessorImpl] Resolved directory for serialized binary metadata: /opt/buildagent/work/7bc1c54bc719b67c/work/db/binary_meta/grid_0 [21:08:06] : [Step 4/5] [2021-11-19 21:08:06,076][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0 [21:08:06] : [Step 4/5] [2021-11-19 21:08:06,076][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][FileWriteAheadLogManager] Resolved write ahead log work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0 [21:08:06] : [Step 4/5] [2021-11-19 21:08:06,076][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][FileWriteAheadLogManager] Resolved write ahead log archive directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0 [21:08:06] : [Step 4/5] Surefire report watcher [21:08:06] : [Surefire report watcher] Watching paths: [21:08:06] : [Surefire report watcher] /opt/buildagent/temp/buildTmp/ignite-tools-junit-reports1777670380320881607/test-org.apache.ignite.testsuites.IgniteBasicWithPersistenceTestSuite1637345280557.xml [21:08:06]i: [Step 4/5] org.apache.ignite.testsuites.IgniteBasicWithPersistenceTestSuite [21:08:06]i: [org.apache.ignite.testsuites.IgniteBasicWithPersistenceTestSuite] org.apache.ignite.internal.processors.cache.persistence.SingleNodePersistenceSslTest.testActivate [21:08:06] : [Step 4/5] [2021-11-19 21:08:06,490][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000000.wal [21:08:06]W: [org.apache.ignite:ignite-core] [2021-11-19 21:08:06,491][WARN ][test-runner-#15781%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] DataRegion maxSize=10.5 MB is smaller than defaultInitialSize=268.4 MB, setting initialSize to 10.5 MB [21:08:06] : [Step 4/5] [2021-11-19 21:08:06,497][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Configured data regions initialized successfully [total=5] [21:08:06] : [Step 4/5] [2021-11-19 21:08:06,499][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][IgniteSnapshotManager] Resolved snapshot work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/snapshots [21:08:06] : [Step 4/5] [2021-11-19 21:08:06,500][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][IgniteSnapshotManager] Resolved temp directory for snapshot creation: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0/snp [21:08:06] : [Step 4/5] [2021-11-19 21:08:06,503][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][ClientListenerProcessor] Client connector processor has started on TCP port 10800 [21:08:06] : [Step 4/5] [2021-11-19 21:08:06,508][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] Non-loopback local IPs: 172.17.0.4 [21:08:06] : [Step 4/5] [2021-11-19 21:08:06,509][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] Enabled local MACs: 0242AC110004 [21:08:06] : [Step 4/5] [2021-11-19 21:08:06,511][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:08:06] : [Step 4/5] [2021-11-19 21:08:06,512][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:08:06] : [Step 4/5] [2021-11-19 21:08:06,512][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:08:06] : [Step 4/5] [2021-11-19 21:08:06,515][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Applying lost metastore updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:08:06] : [Step 4/5] [2021-11-19 21:08:06,516][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=0 ms] [21:08:06] : [Step 4/5] [2021-11-19 21:08:06,516][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][GridCacheProcessor] Restoring partition state for local groups. [21:08:06] : [Step 4/5] [2021-11-19 21:08:06,517][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=0, partitionsProcessed=0, time=0ms] [21:08:06] : [Step 4/5] [2021-11-19 21:08:06,517][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][GridEncryptionManager] Encryption keys loaded from metastore. [grps=, masterKeyName=ignite.master.key] [21:08:06] : [Step 4/5] [2021-11-19 21:08:06,523][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][ClusterProcessor] Cluster ID and tag has been read from metastorage: null [21:08:06] : [Step 4/5] [2021-11-19 21:08:06,523][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][IgniteClusterImpl] Shutdown policy was updated [oldVal=null, newVal=null] [21:08:06] : [Step 4/5] [2021-11-19 21:08:06,523][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Checkpoint frequency deviation changed [oldVal=null, newVal=null] [21:08:06] : [Step 4/5] [2021-11-19 21:08:06,533][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][FilePageStoreManager] Cleanup cache stores [total=1, left=0, cleanFiles=false] [21:08:06] : [Step 4/5] [2021-11-19 21:08:06,535][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:08:06] : [Step 4/5] [2021-11-19 21:08:06,535][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:08:06] : [Step 4/5] [2021-11-19 21:08:06,536][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:08:06] : [Step 4/5] [2021-11-19 21:08:06,536][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Data Regions Started: 5 [21:08:06] : [Step 4/5] [2021-11-19 21:08:06,537][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] ^-- sysMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:08:06] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:08:06] : [Step 4/5] ^-- default region [type=default, persistence=true, lazyAlloc=true, [21:08:06] : [Step 4/5] ... initCfg=10MB, maxCfg=10MB, usedRam=0MB, freeRam=100%, allocRam=0MB, allocTotal=0MB] [21:08:06] : [Step 4/5] ^-- metastoreMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:08:06] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:08:06] : [Step 4/5] ^-- TxLog region [type=internal, persistence=true, lazyAlloc=false, [21:08:06] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:08:06] : [Step 4/5] ^-- volatileDsMemPlc region [type=user, persistence=false, lazyAlloc=true, [21:08:06] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB] [21:08:06] : [Step 4/5] ^-- Ignite persistence [used=0MB] [21:08:06] : [Step 4/5] [21:08:06] : [Step 4/5] [2021-11-19 21:08:06,538][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Starting binary memory restore for: [-2100569601] [21:08:06] : [Step 4/5] [2021-11-19 21:08:06,545][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:08:06] : [Step 4/5] [2021-11-19 21:08:06,546][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:08:06] : [Step 4/5] [2021-11-19 21:08:06,547][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000000.wal, offset=0, ver=2] [21:08:06] : [Step 4/5] [2021-11-19 21:08:06,556][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][GridCacheProcessor] Started cache in recovery mode [name=ignite-sys-cache, id=-2100569601, dataRegionName=sysMemPlc, mode=REPLICATED, atomicity=TRANSACTIONAL, backups=2147483647, mvcc=false] [21:08:06] : [Step 4/5] [2021-11-19 21:08:06,557][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Binary recovery performed in 19 ms. [21:08:06] : [Step 4/5] [2021-11-19 21:08:06,557][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:08:06] : [Step 4/5] [2021-11-19 21:08:06,558][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Applying lost cache updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:08:06] : [Step 4/5] [2021-11-19 21:08:06,621][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=70 ms] [21:08:06] : [Step 4/5] [2021-11-19 21:08:06,622][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][GridCacheProcessor] Restoring partition state for local groups. [21:08:06] : [Step 4/5] [2021-11-19 21:08:06,628][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=1, partitionsProcessed=100, time=0ms] [21:08:06] : [Step 4/5] [2021-11-19 21:08:06,897][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][TestTcpDiscoverySpi] Successfully bound to TCP port [port=47500, localHost=localhost/127.0.0.1, locNodeId=00257274-13ec-45e2-bbc6-7e1e40c5d000] [21:08:06] : [Step 4/5] [2021-11-19 21:08:06,907][INFO ][disco-notifier-worker-#15892%grid-0%][MvccProcessorImpl] Assigned mvcc coordinator [crd=MvccCoordinator [topVer=AffinityTopologyVersion [topVer=1, minorTopVer=0], nodeId=00257274-13ec-45e2-bbc6-7e1e40c5d000, ver=1637345286903, local=true, initialized=false]] [21:08:06] : [Step 4/5] [2021-11-19 21:08:06,909][INFO ][sys-#15870%grid-0%][ClusterProcessor] Writing cluster ID and tag to metastorage on ready for write ClusterIdAndTag [id=4a209f43-8915-4578-bd2a-92fe2e973f4a, tag=modest_volhard] [21:08:06] : [Step 4/5] [2021-11-19 21:08:06,912][INFO ][disco-notifier-worker-#15892%grid-0%][ClusterProcessor] modest_volhard [21:08:06] : [Step 4/5] [2021-11-19 21:08:06,914][INFO ][disco-notifier-worker-#15892%grid-0%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustEnabled' was changed from 'null' to 'false' [21:08:06] : [Step 4/5] [2021-11-19 21:08:06,914][INFO ][disco-notifier-worker-#15892%grid-0%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustTimeout' was changed from 'null' to '300000' [21:08:06] : [Step 4/5] [2021-11-19 21:08:06,915][INFO ][disco-notifier-worker-#15892%grid-0%][IgniteTxManager] Transactions parameter 'longOperationsDumpTimeout' was changed from 'null' to '60000' [21:08:06] : [Step 4/5] [2021-11-19 21:08:06,916][INFO ][disco-notifier-worker-#15892%grid-0%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpThreshold' was changed from 'null' to '0' [21:08:06] : [Step 4/5] [2021-11-19 21:08:06,916][INFO ][disco-notifier-worker-#15892%grid-0%][IgniteTxManager] Transactions parameter 'transactionTimeDumpSamplesCoefficient' was changed from 'null' to '0.0' [21:08:06] : [Step 4/5] [2021-11-19 21:08:06,917][INFO ][disco-notifier-worker-#15892%grid-0%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpSamplesPerSecondLimit' was changed from 'null' to '5' [21:08:06] : [Step 4/5] [2021-11-19 21:08:06,917][INFO ][disco-notifier-worker-#15892%grid-0%][IgniteTxManager] Transactions parameter 'collisionsDumpInterval' was changed from 'null' to '1000' [21:08:06] : [Step 4/5] [2021-11-19 21:08:06,918][INFO ][disco-notifier-worker-#15892%grid-0%][IgniteTxManager] Transactions parameter 'txOwnerDumpRequestsAllowed' was changed from 'null' to 'true' [21:08:06] : [Step 4/5] [2021-11-19 21:08:06,918][INFO ][disco-notifier-worker-#15892%grid-0%][GridCacheDatabaseSharedManager] Historical rebalance WAL threshold changed [property=historical.rebalance.threshold, oldVal=null, newVal=500] [21:08:06] : [Step 4/5] [2021-11-19 21:08:06,933][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] To start Console Management & Monitoring run ignitevisorcmd.{sh|bat} [21:08:06] : [Step 4/5] [2021-11-19 21:08:06,934][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] [21:08:06] : [Step 4/5] [21:08:06] : [Step 4/5] >>> +-------------------------------------------+ [21:08:06] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:08:06] : [Step 4/5] >>> +-------------------------------------------+ [21:08:06] : [Step 4/5] >>> OS name: Linux 4.15.0-151-generic amd64 [21:08:06] : [Step 4/5] >>> CPU(s): 24 [21:08:06] : [Step 4/5] >>> Heap: 2.0GB [21:08:06] : [Step 4/5] >>> VM name: 16724@c4dfe9a430b2 [21:08:06] : [Step 4/5] >>> Ignite instance name: grid-0 [21:08:06] : [Step 4/5] >>> Local node [ID=00257274-13EC-45E2-BBC6-7E1E40C5D000, order=1, clientMode=false] [21:08:06] : [Step 4/5] >>> Local node addresses: [127.0.0.1] [21:08:06] : [Step 4/5] >>> Local ports: TCP:10800 TCP:47100 TCP:47500 [21:08:06] : [Step 4/5] [21:08:06] : [Step 4/5] [2021-11-19 21:08:06,935][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] >>> Ignite cluster is in INACTIVE state (limited functionality available). Use control.(sh|bat) script or IgniteCluster.state(ClusterState.ACTIVE) to change the state. [21:08:06] : [Step 4/5] [2021-11-19 21:08:06,936][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][GridDiscoveryManager] Topology snapshot [ver=1, locNode=00257274, servers=1, clients=0, state=INACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=00257274-13ec-45e2-bbc6-7e1e40c5d000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:08:06] : [Step 4/5] [2021-11-19 21:08:06,937][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][G] Node started : [stage="Configure system pool" (0 ms),stage="Start managers" (192 ms),stage="Configure binary metadata" (2 ms),stage="Start processors" (434 ms),stage="Start 'StanByClusterTestProvider' plugin" (0 ms),stage="Start 'PageMemory tracker plugin' plugin" (0 ms),stage="Start 'TestDistibutedConfigurationPlugin' plugin" (0 ms),stage="Start 'NodeValidationPluginProvider' plugin" (0 ms),stage="Init metastore" (25 ms),stage="Init and start regions" (4 ms),stage="Restore binary memory" (19 ms),stage="Restore logical state" (71 ms),stage="Finish recovery" (267 ms),stage="Join topology" (11 ms),stage="Await transition" (2 ms),stage="Await exchange" (26 ms),stage="Total time" (1053 ms)] [21:08:06] : [Step 4/5] [2021-11-19 21:08:06,939][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][root] Node started with the following configuration [id=00257274-13ec-45e2-bbc6-7e1e40c5d000, marshaller=BinaryMarshaller [], discovery=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=5000, ackTimeout=5000, marsh=JdkMarshaller [clsFilter=org.apache.ignite.marshaller.MarshallerUtils$1@4069a545], reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], binaryCfg=null, lateAff=true] [21:08:06]W: [org.apache.ignite:ignite-core] [2021-11-19 21:08:06,946][WARN ][test-runner-#15781%encryption.MasterKeyChangeTest%][G] Ignite work directory is not provided, automatically resolved to: /opt/buildagent/work/7bc1c54bc719b67c/work [21:08:06] : [Step 4/5] [2021-11-19 21:08:06,948][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] [21:08:06] : [Step 4/5] [21:08:06] : [Step 4/5] >>> __________ ________________ [21:08:06] : [Step 4/5] >>> / _/ ___/ |/ / _/_ __/ __/ [21:08:06] : [Step 4/5] >>> _/ // (7 7 // / / / / _/ [21:08:06] : [Step 4/5] >>> /___/\___/_/|_/___/ /_/ /___/ [21:08:06] : [Step 4/5] >>> [21:08:06] : [Step 4/5] >>> ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:08:06] : [Step 4/5] >>> 2021 Copyright(C) Apache Software Foundation [21:08:06] : [Step 4/5] >>> [21:08:06] : [Step 4/5] >>> Ignite documentation: http://ignite.apache.org [21:08:06] : [Step 4/5] [21:08:06] : [Step 4/5] [2021-11-19 21:08:06,948][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] Config URL: n/a [21:08:06] : [Step 4/5] [2021-11-19 21:08:06,949][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] IgniteConfiguration [igniteInstanceName=grid-1, pubPoolSize=24, svcPoolSize=24, callbackPoolSize=24, stripedPoolSize=24, sysPoolSize=24, mgmtPoolSize=4, dataStreamerPoolSize=24, utilityCachePoolSize=24, utilityCacheKeepAliveTime=60000, p2pPoolSize=2, qryPoolSize=24, buildIdxPoolSize=4, igniteHome=/opt/buildagent/work/7bc1c54bc719b67c, igniteWorkDir=/opt/buildagent/work/7bc1c54bc719b67c/work, mbeanSrv=com.sun.jmx.mbeanserver.JmxMBeanServer@6fe85038, nodeId=1089858a-0d81-4736-a358-ed902524c001, marsh=BinaryMarshaller [], marshLocJobs=false, daemon=false, p2pEnabled=true, netTimeout=10000, netCompressionLevel=1, sndRetryDelay=1000, sndRetryCnt=3, metricsHistSize=10000, metricsUpdateFreq=1000, metricsExpTime=9223372036854775807, discoSpi=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=0, ackTimeout=0, marsh=null, reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], segPlc=STOP, segResolveAttempts=2, waitForSegOnStart=true, allResolversPassReq=true, segChkFreq=10000, commSpi=TcpCommunicationSpi [connectGate=org.apache.ignite.spi.communication.tcp.internal.ConnectGateway@1a58de71, ctxInitLatch=java.util.concurrent.CountDownLatch@6c9a1a1d[Count = 1], stopping=false, clientPool=null, nioSrvWrapper=null, stateProvider=null], evtSpi=MemoryEventStorageSpi [expireAgeMs=9223372036854775807, expireCnt=10000, filter=null], colSpi=NoopCollisionSpi [], deploySpi=LocalDeploymentSpi [], indexingSpi=org.apache.ignite.spi.indexing.noop.NoopIndexingSpi@28b53d87, addrRslvr=null, encryptionSpi=org.apache.ignite.spi.encryption.keystore.KeystoreEncryptionSpi@555a3d4, tracingSpi=org.apache.ignite.spi.tracing.NoopTracingSpi@6e94e254, clientMode=false, rebalanceThreadPoolSize=4, rebalanceTimeout=10000, rebalanceBatchesPrefetchCnt=3, rebalanceThrottle=0, rebalanceBatchSize=524288, txCfg=TransactionConfiguration [txSerEnabled=false, dfltIsolation=REPEATABLE_READ, dfltConcurrency=PESSIMISTIC, dfltTxTimeout=0, txTimeoutOnPartitionMapExchange=0, deadlockTimeout=10000, pessimisticTxLogSize=0, pessimisticTxLogLinger=10000, tmLookupClsName=null, txManagerFactory=null, useJtaSync=false], cacheSanityCheckEnabled=true, discoStartupDelay=60000, deployMode=SHARED, p2pMissedCacheSize=100, locHost=127.0.0.1, timeSrvPortBase=31100, timeSrvPortRange=100, failureDetectionTimeout=10000, sysWorkerBlockedTimeout=null, clientFailureDetectionTimeout=10000, metricsLogFreq=0, connectorCfg=null, odbcCfg=null, warmupClos=null, atomicCfg=AtomicConfiguration [seqReserveSize=1000, cacheMode=PARTITIONED, backups=1, aff=null, grpName=null], classLdr=null, sslCtxFactory=null, platformCfg=null, binaryCfg=null, memCfg=null, pstCfg=null, dsCfg=DataStorageConfiguration [sysRegionInitSize=41943040, sysRegionMaxSize=104857600, pageSize=4096, concLvl=0, dfltDataRegConf=DataRegionConfiguration [name=default, maxSize=10485760, initSize=268435456, swapPath=null, pageEvictionMode=DISABLED, pageReplacementMode=CLOCK, evictionThreshold=0.9, emptyPagesPoolSize=100, metricsEnabled=false, metricsSubIntervalCount=5, metricsRateTimeInterval=60000, persistenceEnabled=true, checkpointPageBufSize=0, lazyMemoryAllocation=true, warmUpCfg=null], dataRegions=null, storagePath=null, checkpointFreq=180000, lockWaitTime=10000, checkpointThreads=4, checkpointWriteOrder=SEQUENTIAL, walHistSize=20, maxWalArchiveSize=1073741824, walSegments=10, walSegmentSize=67108864, walPath=db/wal, walArchivePath=db/wal/archive, cdcWalPath=db/wal/cdc, cdcEnabled=false, metricsEnabled=false, walMode=FSYNC, walTlbSize=131072, walBuffSize=0, walFlushFreq=2000, walFsyncDelay=1000, walRecordIterBuffSize=67108864, alwaysWriteFullPages=false, fileIOFactory=org.apache.ignite.internal.processors.cache.persistence.file.AsyncFileIOFactory@5645800e, metricsSubIntervalCnt=5, metricsRateTimeInterval=60000, walAutoArchiveAfterInactivity=-1, walForceArchiveTimeout=-1, writeThrottlingEnabled=false, walCompactionEnabled=false, walCompactionLevel=1, checkpointReadLockTimeout=null, walPageCompression=DISABLED, walPageCompressionLevel=null, dfltWarmUpCfg=null, encCfg=org.apache.ignite.configuration.EncryptionConfiguration@721a2c79, defragmentationThreadPoolSize=4, minWalArchiveSize=-1], snapshotPath=snapshots, activeOnStart=true, activeOnStartPropSetFlag=false, autoActivation=true, autoActivationPropSetFlag=false, clusterStateOnStart=null, sqlConnCfg=null, cliConnCfg=ClientConnectorConfiguration [host=null, port=10800, portRange=100, sockSndBufSize=0, sockRcvBufSize=0, tcpNoDelay=true, maxOpenCursorsPerConn=128, threadPoolSize=24, selectorCnt=12, idleTimeout=0, handshakeTimeout=10000, jdbcEnabled=true, odbcEnabled=true, thinCliEnabled=true, sslEnabled=false, useIgniteSslCtxFactory=true, sslClientAuth=false, sslCtxFactory=null, thinCliCfg=ThinClientConfiguration [maxActiveTxPerConn=100, maxActiveComputeTasksPerConn=0]], mvccVacuumThreadCnt=2, mvccVacuumFreq=5000, authEnabled=false, failureHnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]], commFailureRslvr=null, sqlCfg=SqlConfiguration [longQryWarnTimeout=3000, dfltQryTimeout=0, sqlQryHistSize=1000, validationEnabled=false], asyncContinuationExecutor=null] [21:08:06] : [Step 4/5] [2021-11-19 21:08:06,958][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] Daemon mode: off [21:08:06] : [Step 4/5] [2021-11-19 21:08:06,958][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] OS: Linux 4.15.0-151-generic amd64 [21:08:06] : [Step 4/5] [2021-11-19 21:08:06,958][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] OS user: teamcity [21:08:06] : [Step 4/5] [2021-11-19 21:08:06,958][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] PID: 16724 [21:08:06] : [Step 4/5] [2021-11-19 21:08:06,959][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] Language runtime: Java Platform API Specification ver. 1.8 [21:08:06] : [Step 4/5] [2021-11-19 21:08:06,959][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] VM information: Java(TM) SE Runtime Environment 1.8.0_261-b12 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 25.261-b12 [21:08:06] : [Step 4/5] [2021-11-19 21:08:06,959][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] VM total memory: 1.9GB [21:08:06] : [Step 4/5] [2021-11-19 21:08:06,959][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] Remote Management [restart: off, REST: off, JMX (remote: off)] [21:08:06] : [Step 4/5] [2021-11-19 21:08:06,960][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] Logger: GridTestLog4jLogger [quiet=false, config=null] [21:08:06] : [Step 4/5] [2021-11-19 21:08:06,960][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] IGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c [21:08:06] : [Step 4/5] [2021-11-19 21:08:06,960][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] VM arguments: [-DIGNITE_DUMP_THREADS_ON_FAILURE=false, -DMono=/usr/bin/mono-sgen, -DMono4.0_x64=/usr/lib/mono/4.0, -DMono4.5_x64=/usr/lib/mono/4.5, -DMonoVersion=6.12.0.90, -DSKIP_BUILD=false, -Dagent.home.dir=/opt/buildagent, -Dagent.name=aitc-lin02_03, -Dagent.ownPort=9090, -Dagent.work.dir=/opt/buildagent/work, -Dbuild.number=95, -Dbuild.vcs.number=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.1=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.GitHubApacheIgnite=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dclassworlds.conf=/opt/buildagent/temp/buildTmp/teamcity.m2.conf, -Dcom.jetbrains.maven.watcher.report.file=/opt/buildagent/temp/buildTmp/maven-build-info.xml, -Djava.io.tmpdir=/opt/buildagent/temp/buildTmp, -Dmaven.home=/opt/buildagent/tools/maven3_6, -Dmaven.multiModuleProjectDirectory=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.agent.cpuBenchmark=457, -Dteamcity.agent.dotnet.agent_url=http://localhost:9090/RPC2, -Dteamcity.agent.dotnet.build_id=6278078, -Dteamcity.auth.password=*******, -Dteamcity.auth.userId=TeamCityBuildId=6278078, -Dteamcity.build.changedFiles.file=/opt/buildagent/temp/buildTmp/changedFiles6342607772318147725.txt, -Dteamcity.build.checkoutDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.build.id=6278078, -Dteamcity.build.properties.file=/opt/buildagent/temp/buildTmp/teamcity.build5164517880467851002.properties, -Dteamcity.build.tempDir=/opt/buildagent/temp/buildTmp, -Dteamcity.build.workingDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.buildConfName=Basic 3, -Dteamcity.buildType.id=IgniteTests24Java8_Basic3, -Dteamcity.configuration.properties.file=/opt/buildagent/temp/buildTmp/teamcity.config5591980786735343870.properties, -Dteamcity.maven.userSettings.path=/opt/buildagent/temp/buildTmp/maven_settings_585072866407032347.xml, -Dteamcity.maven.watcher.home=/opt/buildagent/plugins/mavenPlugin/maven-watcher-jdk16, -Dteamcity.projectName=Ignite Tests 2.x (JDK 8/11), -Dteamcity.runner.properties.file=/opt/buildagent/temp/buildTmp/teamcity.runner9098465561618137420.properties, -Dteamcity.tests.recentlyFailedTests.file=/opt/buildagent/temp/buildTmp/testsToRunFirst3891775683130404069.txt, -Dteamcity.version=2021.2 (build 99542), -ea, -Xms2g, -Xmx2g, -XX:+HeapDumpOnOutOfMemoryError, -DIGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_TEST_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_UPDATE_NOTIFIER=false, -DIGNITE_NO_DISCO_ORDER=true, -DIGNITE_PERFORMANCE_SUGGESTIONS_DISABLED=true, -Djava.net.preferIPv4Stack=true, -DTEST_SCALE_FACTOR=1.0, -DIGNITE_TEST_PROP_LOG4J_FILE=log4j-tc-test.xml, -DIGNITE_QUIET=false, -DIGNITE_MARSHAL_BUFFERS_RECHECK=1000, -Dmaven.repo.local=/opt/buildagent/.m2/repository] [21:08:06] : [Step 4/5] [2021-11-19 21:08:06,965][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] System cache's DataRegion size is configured to 40 MB. Use DataStorageConfiguration.systemRegionInitialSize property to change the setting. [21:08:06] : [Step 4/5] [2021-11-19 21:08:06,965][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] Configured caches [in 'sysMemPlc' dataRegion: ['ignite-sys-cache']] [21:08:06]W: [org.apache.ignite:ignite-core] [2021-11-19 21:08:06,966][WARN ][test-runner-#15781%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] Peer class loading is enabled (disable it in production for performance and deployment consistency reasons) [21:08:06] : [Step 4/5] [2021-11-19 21:08:06,966][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] 3-rd party licenses can be found at: /opt/buildagent/work/7bc1c54bc719b67c/libs/licenses [21:08:06] : [Step 4/5] [2021-11-19 21:08:06,970][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] Configured plugins: [21:08:06] : [Step 4/5] [2021-11-19 21:08:06,970][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] ^-- StanByClusterTestProvider 1.0 [21:08:06] : [Step 4/5] [2021-11-19 21:08:06,971][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:08:06] : [Step 4/5] [2021-11-19 21:08:06,971][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] [21:08:06] : [Step 4/5] [2021-11-19 21:08:06,971][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] ^-- PageMemory tracker plugin 1.0 [21:08:06] : [Step 4/5] [2021-11-19 21:08:06,971][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:08:06] : [Step 4/5] [2021-11-19 21:08:06,971][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] [21:08:06] : [Step 4/5] [2021-11-19 21:08:06,971][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] ^-- TestDistibutedConfigurationPlugin 1.0 [21:08:06] : [Step 4/5] [2021-11-19 21:08:06,972][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:08:06] : [Step 4/5] [2021-11-19 21:08:06,972][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] [21:08:06] : [Step 4/5] [2021-11-19 21:08:06,972][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] ^-- NodeValidationPluginProvider 1.0 [21:08:06] : [Step 4/5] [2021-11-19 21:08:06,972][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:08:06] : [Step 4/5] [2021-11-19 21:08:06,972][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] [21:08:06] : [Step 4/5] [2021-11-19 21:08:06,973][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][FailureProcessor] Configured failure handler: [hnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]]] [21:08:06] : [Step 4/5] [2021-11-19 21:08:06,995][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][TestRecordingCommunicationSpi] Successfully bound communication NIO server to TCP port [port=47101, locHost=/127.0.0.1, selectorsCnt=12, selectorSpins=0, pairedConn=false] [21:08:06]W: [org.apache.ignite:ignite-core] [2021-11-19 21:08:06,996][WARN ][test-runner-#15781%encryption.MasterKeyChangeTest%][TestRecordingCommunicationSpi] Message queue limit is set to 0 which may lead to potential OOMEs when running cache operations in FULL_ASYNC or PRIMARY_SYNC modes due to message queues growth on sender and receiver sides. [21:08:07] : [Step 4/5] [2021-11-19 21:08:07,003][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][GridCollisionManager] Collision resolution is disabled (all jobs will be activated upon arrival). [21:08:07] : [Step 4/5] [2021-11-19 21:08:07,004][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] Security status [authentication=off, sandbox=off, tls/ssl=off] [21:08:07] : [Step 4/5] [2021-11-19 21:08:07,061][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:08:07] : [Step 4/5] [2021-11-19 21:08:07,151][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][MaintenanceProcessor] Resolved store directory for node persistent data: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1 [21:08:07] : [Step 4/5] [2021-11-19 21:08:07,152][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][CacheObjectBinaryProcessorImpl] Resolved directory for serialized binary metadata: /opt/buildagent/work/7bc1c54bc719b67c/work/db/binary_meta/grid_1 [21:08:07] : [Step 4/5] [2021-11-19 21:08:07,156][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1 [21:08:07] : [Step 4/5] [2021-11-19 21:08:07,156][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][FileWriteAheadLogManager] Resolved write ahead log work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1 [21:08:07] : [Step 4/5] [2021-11-19 21:08:07,157][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][FileWriteAheadLogManager] Resolved write ahead log archive directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1 [21:08:07] : [Step 4/5] [2021-11-19 21:08:07,550][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000000.wal [21:08:07] : [Step 4/5] [2021-11-19 21:08:07,554][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Configured data regions initialized successfully [total=5] [21:08:07] : [Step 4/5] [2021-11-19 21:08:07,557][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][IgniteSnapshotManager] Resolved snapshot work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/snapshots [21:08:07] : [Step 4/5] [2021-11-19 21:08:07,558][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][IgniteSnapshotManager] Resolved temp directory for snapshot creation: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1/snp [21:08:07] : [Step 4/5] [2021-11-19 21:08:07,561][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][ClientListenerProcessor] Client connector processor has started on TCP port 10801 [21:08:07] : [Step 4/5] [2021-11-19 21:08:07,564][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] Non-loopback local IPs: 172.17.0.4 [21:08:07] : [Step 4/5] [2021-11-19 21:08:07,564][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] Enabled local MACs: 0242AC110004 [21:08:07] : [Step 4/5] [2021-11-19 21:08:07,565][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:08:07] : [Step 4/5] [2021-11-19 21:08:07,566][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:08:07] : [Step 4/5] [2021-11-19 21:08:07,566][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:08:07] : [Step 4/5] [2021-11-19 21:08:07,569][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Applying lost metastore updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:08:07] : [Step 4/5] [2021-11-19 21:08:07,569][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=0 ms] [21:08:07] : [Step 4/5] [2021-11-19 21:08:07,570][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][GridCacheProcessor] Restoring partition state for local groups. [21:08:07] : [Step 4/5] [2021-11-19 21:08:07,570][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=0, partitionsProcessed=0, time=0ms] [21:08:07] : [Step 4/5] [2021-11-19 21:08:07,570][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][GridEncryptionManager] Encryption keys loaded from metastore. [grps=, masterKeyName=ignite.master.key] [21:08:07] : [Step 4/5] [2021-11-19 21:08:07,572][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][ClusterProcessor] Cluster ID and tag has been read from metastorage: null [21:08:07] : [Step 4/5] [2021-11-19 21:08:07,572][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][IgniteClusterImpl] Shutdown policy was updated [oldVal=null, newVal=null] [21:08:07] : [Step 4/5] [2021-11-19 21:08:07,573][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Checkpoint frequency deviation changed [oldVal=null, newVal=null] [21:08:07] : [Step 4/5] [2021-11-19 21:08:07,582][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][FilePageStoreManager] Cleanup cache stores [total=1, left=0, cleanFiles=false] [21:08:07] : [Step 4/5] [2021-11-19 21:08:07,585][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:08:07] : [Step 4/5] [2021-11-19 21:08:07,586][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:08:07] : [Step 4/5] [2021-11-19 21:08:07,587][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:08:07] : [Step 4/5] [2021-11-19 21:08:07,587][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Data Regions Started: 5 [21:08:07] : [Step 4/5] [2021-11-19 21:08:07,588][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] ^-- sysMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:08:07] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:08:07] : [Step 4/5] ^-- default region [type=default, persistence=true, lazyAlloc=true, [21:08:07] : [Step 4/5] ... initCfg=10MB, maxCfg=10MB, usedRam=0MB, freeRam=100%, allocRam=0MB, allocTotal=0MB] [21:08:07] : [Step 4/5] ^-- metastoreMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:08:07] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:08:07] : [Step 4/5] ^-- TxLog region [type=internal, persistence=true, lazyAlloc=false, [21:08:07] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:08:07] : [Step 4/5] ^-- volatileDsMemPlc region [type=user, persistence=false, lazyAlloc=true, [21:08:07] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB] [21:08:07] : [Step 4/5] ^-- Ignite persistence [used=0MB] [21:08:07] : [Step 4/5] [21:08:07] : [Step 4/5] [2021-11-19 21:08:07,589][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Starting binary memory restore for: [-2100569601] [21:08:07] : [Step 4/5] [2021-11-19 21:08:07,598][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:08:07] : [Step 4/5] [2021-11-19 21:08:07,598][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:08:07] : [Step 4/5] [2021-11-19 21:08:07,600][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000000.wal, offset=0, ver=2] [21:08:07] : [Step 4/5] [2021-11-19 21:08:07,603][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][GridCacheProcessor] Started cache in recovery mode [name=ignite-sys-cache, id=-2100569601, dataRegionName=sysMemPlc, mode=REPLICATED, atomicity=TRANSACTIONAL, backups=2147483647, mvcc=false] [21:08:07] : [Step 4/5] [2021-11-19 21:08:07,604][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Binary recovery performed in 15 ms. [21:08:07] : [Step 4/5] [2021-11-19 21:08:07,604][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:08:07] : [Step 4/5] [2021-11-19 21:08:07,605][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Applying lost cache updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:08:07] : [Step 4/5] [2021-11-19 21:08:07,661][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=60 ms] [21:08:07] : [Step 4/5] [2021-11-19 21:08:07,661][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][GridCacheProcessor] Restoring partition state for local groups. [21:08:07] : [Step 4/5] [2021-11-19 21:08:07,666][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=1, partitionsProcessed=100, time=0ms] [21:08:08] : [Step 4/5] [2021-11-19 21:08:08,027][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][TestTcpDiscoverySpi] Successfully bound to TCP port [port=47501, localHost=localhost/127.0.0.1, locNodeId=1089858a-0d81-4736-a358-ed902524c001] [21:08:08] : [Step 4/5] [2021-11-19 21:08:08,031][INFO ][tcp-disco-srvr-[:47500]-#828%grid-0%-#15894%grid-0%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=57481] [21:08:08] : [Step 4/5] [2021-11-19 21:08:08,032][INFO ][tcp-disco-srvr-[:47500]-#828%grid-0%-#15894%grid-0%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=57481] [21:08:08] : [Step 4/5] [2021-11-19 21:08:08,032][INFO ][tcp-disco-sock-reader-[]-#834%grid-0%-#16013%grid-0%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:57481, rmtPort=57481] [21:08:08] : [Step 4/5] [2021-11-19 21:08:08,034][INFO ][tcp-disco-sock-reader-[1089858a 127.0.0.1:57481]-#834%grid-0%-#16013%grid-0%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=1089858a-0d81-4736-a358-ed902524c001, rmtAddr=/127.0.0.1:57481] [21:08:08] : [Step 4/5] [2021-11-19 21:08:08,041][INFO ][tcp-disco-srvr-[:47501]-#833%grid-1%-#16012%grid-1%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=39711] [21:08:08] : [Step 4/5] [2021-11-19 21:08:08,042][INFO ][tcp-disco-srvr-[:47501]-#833%grid-1%-#16012%grid-1%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=39711] [21:08:08] : [Step 4/5] [2021-11-19 21:08:08,042][INFO ][tcp-disco-sock-reader-[]-#835%grid-1%-#16014%grid-1%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:39711, rmtPort=39711] [21:08:08] : [Step 4/5] [2021-11-19 21:08:08,043][INFO ][tcp-disco-sock-reader-[]-#835%grid-1%-#16014%grid-1%][TestTcpDiscoverySpi] Received ping request from the remote node [rmtNodeId=00257274-13ec-45e2-bbc6-7e1e40c5d000, rmtAddr=/127.0.0.1:39711, rmtPort=39711] [21:08:08] : [Step 4/5] [2021-11-19 21:08:08,044][INFO ][tcp-disco-sock-reader-[]-#835%grid-1%-#16014%grid-1%][TestTcpDiscoverySpi] Finished writing ping response [rmtNodeId=00257274-13ec-45e2-bbc6-7e1e40c5d000, rmtAddr=/127.0.0.1:39711, rmtPort=39711] [21:08:08]W: [org.apache.ignite:ignite-core] [2021-11-19 21:08:08,045][WARN ][tcp-disco-sock-reader-[]-#835%grid-1%-#16014%grid-1%][TestTcpDiscoverySpi] Failed to shutdown socket [21:08:08]W: [org.apache.ignite:ignite-core] java.net.SocketException: Socket output is already shutdown [21:08:08]W: [org.apache.ignite:ignite-core] at java.net.Socket.shutdownOutput(Socket.java:1572) [21:08:08]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.close(IgniteUtils.java:4247) [21:08:08]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.discovery.tcp.ServerImpl$SocketReader.body(ServerImpl.java:7370) [21:08:08]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.IgniteSpiThread.run(IgniteSpiThread.java:58) [21:08:08] : [Step 4/5] [2021-11-19 21:08:08,045][INFO ][tcp-disco-sock-reader-[1089858a 127.0.0.1:57481]-#834%grid-0%-#16013%grid-0%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:57481, rmtPort=57481, rmtNodeId=1089858a-0d81-4736-a358-ed902524c001] [21:08:08] : [Step 4/5] [2021-11-19 21:08:08,046][INFO ][tcp-disco-sock-reader-[]-#835%grid-1%-#16014%grid-1%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:39711, rmtPort=39711, rmtNodeId=null] [21:08:08] : [Step 4/5] [2021-11-19 21:08:08,049][INFO ][tcp-disco-msg-worker-[crd]-#827%grid-0%-#15893%grid-0%][GridEncryptionManager] Joining node doesn't have stored group keys [node=1089858a-0d81-4736-a358-ed902524c001] [21:08:08] : [Step 4/5] [2021-11-19 21:08:08,058][INFO ][tcp-disco-msg-worker-[crd]-#827%grid-0%-#15893%grid-0%][TestTcpDiscoverySpi] New next node [newNext=TcpDiscoveryNode [id=1089858a-0d81-4736-a358-ed902524c001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=0, intOrder=2, lastExchangeTime=1637345288031, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false]] [21:08:08] : [Step 4/5] [2021-11-19 21:08:08,059][INFO ][tcp-disco-srvr-[:47501]-#833%grid-1%-#16012%grid-1%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=40875] [21:08:08] : [Step 4/5] [2021-11-19 21:08:08,060][INFO ][tcp-disco-srvr-[:47501]-#833%grid-1%-#16012%grid-1%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=40875] [21:08:08] : [Step 4/5] [2021-11-19 21:08:08,060][INFO ][tcp-disco-sock-reader-[]-#836%grid-1%-#16015%grid-1%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:40875, rmtPort=40875] [21:08:08] : [Step 4/5] [2021-11-19 21:08:08,061][INFO ][tcp-disco-sock-reader-[00257274 127.0.0.1:40875]-#836%grid-1%-#16015%grid-1%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=00257274-13ec-45e2-bbc6-7e1e40c5d000, rmtAddr=/127.0.0.1:40875] [21:08:08] : [Step 4/5] [2021-11-19 21:08:08,065][INFO ][tcp-disco-msg-worker-[]-#832%grid-1%-#16011%grid-1%][TestTcpDiscoverySpi] New next node [newNext=TcpDiscoveryNode [id=00257274-13ec-45e2-bbc6-7e1e40c5d000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345288062, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false]] [21:08:08] : [Step 4/5] [2021-11-19 21:08:08,066][INFO ][tcp-disco-srvr-[:47500]-#828%grid-0%-#15894%grid-0%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=46113] [21:08:08] : [Step 4/5] [2021-11-19 21:08:08,066][INFO ][tcp-disco-srvr-[:47500]-#828%grid-0%-#15894%grid-0%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=46113] [21:08:08] : [Step 4/5] [2021-11-19 21:08:08,067][INFO ][tcp-disco-sock-reader-[]-#837%grid-0%-#16016%grid-0%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:46113, rmtPort=46113] [21:08:08] : [Step 4/5] [2021-11-19 21:08:08,068][INFO ][tcp-disco-sock-reader-[1089858a 127.0.0.1:46113]-#837%grid-0%-#16016%grid-0%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=1089858a-0d81-4736-a358-ed902524c001, rmtAddr=/127.0.0.1:46113] [21:08:08] : [Step 4/5] [2021-11-19 21:08:08,071][INFO ][disco-event-worker-#15896%grid-0%][GridDiscoveryManager] Added new node to topology: TcpDiscoveryNode [id=1089858a-0d81-4736-a358-ed902524c001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637345288031, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false] [21:08:08] : [Step 4/5] [2021-11-19 21:08:08,072][INFO ][disco-event-worker-#15896%grid-0%][GridDiscoveryManager] Topology snapshot [ver=2, locNode=00257274, servers=2, clients=0, state=INACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=00257274-13ec-45e2-bbc6-7e1e40c5d000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=1089858a-0d81-4736-a358-ed902524c001, consistentId=grid-1, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:08:08] : [Step 4/5] [2021-11-19 21:08:08,076][INFO ][tcp-disco-msg-worker-[00257274 127.0.0.1:47500]-#832%grid-1%-#16011%grid-1%][ClusterProcessor] modest_volhard [21:08:08] : [Step 4/5] [2021-11-19 21:08:08,077][INFO ][tcp-disco-msg-worker-[00257274 127.0.0.1:47500]-#832%grid-1%-#16011%grid-1%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustEnabled' was changed from 'null' to 'false' [21:08:08] : [Step 4/5] [2021-11-19 21:08:08,077][INFO ][tcp-disco-msg-worker-[00257274 127.0.0.1:47500]-#832%grid-1%-#16011%grid-1%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustTimeout' was changed from 'null' to '300000' [21:08:08] : [Step 4/5] [2021-11-19 21:08:08,078][INFO ][tcp-disco-msg-worker-[00257274 127.0.0.1:47500]-#832%grid-1%-#16011%grid-1%][IgniteTxManager] Transactions parameter 'longOperationsDumpTimeout' was changed from 'null' to '60000' [21:08:08] : [Step 4/5] [2021-11-19 21:08:08,078][INFO ][tcp-disco-msg-worker-[00257274 127.0.0.1:47500]-#832%grid-1%-#16011%grid-1%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpThreshold' was changed from 'null' to '0' [21:08:08] : [Step 4/5] [2021-11-19 21:08:08,079][INFO ][tcp-disco-msg-worker-[00257274 127.0.0.1:47500]-#832%grid-1%-#16011%grid-1%][IgniteTxManager] Transactions parameter 'transactionTimeDumpSamplesCoefficient' was changed from 'null' to '0.0' [21:08:08] : [Step 4/5] [2021-11-19 21:08:08,080][INFO ][tcp-disco-msg-worker-[00257274 127.0.0.1:47500]-#832%grid-1%-#16011%grid-1%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpSamplesPerSecondLimit' was changed from 'null' to '5' [21:08:08] : [Step 4/5] [2021-11-19 21:08:08,080][INFO ][tcp-disco-msg-worker-[00257274 127.0.0.1:47500]-#832%grid-1%-#16011%grid-1%][IgniteTxManager] Transactions parameter 'collisionsDumpInterval' was changed from 'null' to '1000' [21:08:08] : [Step 4/5] [2021-11-19 21:08:08,081][INFO ][tcp-disco-msg-worker-[00257274 127.0.0.1:47500]-#832%grid-1%-#16011%grid-1%][IgniteTxManager] Transactions parameter 'txOwnerDumpRequestsAllowed' was changed from 'null' to 'true' [21:08:08] : [Step 4/5] [2021-11-19 21:08:08,081][INFO ][tcp-disco-msg-worker-[00257274 127.0.0.1:47500]-#832%grid-1%-#16011%grid-1%][GridCacheDatabaseSharedManager] Historical rebalance WAL threshold changed [property=historical.rebalance.threshold, oldVal=null, newVal=500] [21:08:08] : [Step 4/5] [2021-11-19 21:08:08,082][INFO ][disco-notifier-worker-#16010%grid-1%][MvccProcessorImpl] Assigned mvcc coordinator [crd=MvccCoordinator [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=0], nodeId=00257274-13ec-45e2-bbc6-7e1e40c5d000, ver=1637345286903, local=false, initialized=false]] [21:08:08] : [Step 4/5] [2021-11-19 21:08:08,084][INFO ][sys-#15991%grid-1%][ClusterProcessor] Writing cluster ID and tag to metastorage on ready for write ClusterIdAndTag [id=4a209f43-8915-4578-bd2a-92fe2e973f4a, tag=modest_volhard] [21:08:08] : [Step 4/5] [2021-11-19 21:08:08,097][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] To start Console Management & Monitoring run ignitevisorcmd.{sh|bat} [21:08:08] : [Step 4/5] [2021-11-19 21:08:08,097][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] [21:08:08] : [Step 4/5] [21:08:08] : [Step 4/5] >>> +-------------------------------------------+ [21:08:08] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:08:08] : [Step 4/5] >>> +-------------------------------------------+ [21:08:08] : [Step 4/5] >>> OS name: Linux 4.15.0-151-generic amd64 [21:08:08] : [Step 4/5] >>> CPU(s): 24 [21:08:08] : [Step 4/5] >>> Heap: 2.0GB [21:08:08] : [Step 4/5] >>> VM name: 16724@c4dfe9a430b2 [21:08:08] : [Step 4/5] >>> Ignite instance name: grid-1 [21:08:08] : [Step 4/5] >>> Local node [ID=1089858A-0D81-4736-A358-ED902524C001, order=2, clientMode=false] [21:08:08] : [Step 4/5] >>> Local node addresses: [127.0.0.1] [21:08:08] : [Step 4/5] >>> Local ports: TCP:10801 TCP:47101 TCP:47501 [21:08:08] : [Step 4/5] [21:08:08] : [Step 4/5] [2021-11-19 21:08:08,098][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] >>> Ignite cluster is in INACTIVE state (limited functionality available). Use control.(sh|bat) script or IgniteCluster.state(ClusterState.ACTIVE) to change the state. [21:08:08] : [Step 4/5] [2021-11-19 21:08:08,099][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][GridDiscoveryManager] Topology snapshot [ver=2, locNode=1089858a, servers=2, clients=0, state=INACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=00257274-13ec-45e2-bbc6-7e1e40c5d000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=1089858a-0d81-4736-a358-ed902524c001, consistentId=grid-1, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:08:08] : [Step 4/5] [2021-11-19 21:08:08,099][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][G] Node started : [stage="Configure system pool" (0 ms),stage="Start managers" (204 ms),stage="Configure binary metadata" (1 ms),stage="Start processors" (409 ms),stage="Start 'StanByClusterTestProvider' plugin" (0 ms),stage="Start 'PageMemory tracker plugin' plugin" (0 ms),stage="Start 'TestDistibutedConfigurationPlugin' plugin" (0 ms),stage="Start 'NodeValidationPluginProvider' plugin" (0 ms),stage="Init metastore" (19 ms),stage="Init and start regions" (6 ms),stage="Restore binary memory" (15 ms),stage="Restore logical state" (62 ms),stage="Finish recovery" (359 ms),stage="Join topology" (56 ms),stage="Await transition" (2 ms),stage="Await exchange" (14 ms),stage="Total time" (1147 ms)] [21:08:08] : [Step 4/5] [2021-11-19 21:08:08,101][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][root] Node started with the following configuration [id=1089858a-0d81-4736-a358-ed902524c001, marshaller=BinaryMarshaller [], discovery=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=5000, ackTimeout=5000, marsh=JdkMarshaller [clsFilter=org.apache.ignite.marshaller.MarshallerUtils$1@45ffcf12], reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], binaryCfg=null, lateAff=true] [21:08:08] : [Step 4/5] [2021-11-19 21:08:08,102][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][GridClusterStateProcessor] Sending activate cluster request with BaselineTopology BaselineTopology [id=0, branchingHash=-2475315501, branchingType='New BaselineTopology', baselineNodes=[grid-1, grid-0]] [21:08:08] : [Step 4/5] [2021-11-19 21:08:08,107][INFO ][disco-notifier-worker-#15892%grid-0%][GridClusterStateProcessor] Received activate cluster request with BaselineTopology[id=0] initiator node ID: 00257274-13ec-45e2-bbc6-7e1e40c5d000 [21:08:08] : [Step 4/5] [2021-11-19 21:08:08,108][INFO ][disco-notifier-worker-#15892%grid-0%][GridClusterStateProcessor] Started state transition: activate cluster [21:08:08] : [Step 4/5] [2021-11-19 21:08:08,109][INFO ][exchange-worker-#15897%grid-0%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], crd=true, evt=DISCOVERY_CUSTOM_EVT, evtNode=00257274-13ec-45e2-bbc6-7e1e40c5d000, customEvt=ChangeGlobalStateMessage [id=eab5d593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqId=b1be7094-719f-4c5e-b7e5-b48ff0a07c62, initiatingNodeId=00257274-13ec-45e2-bbc6-7e1e40c5d000, state=ACTIVE, baselineTopology=BaselineTopology [id=0, branchingHash=-2475315501, branchingType='New BaselineTopology', baselineNodes=[grid-1, grid-0]], forceChangeBaselineTopology=false, timestamp=1637345288102, forceDeactivation=true], allowMerge=false, exchangeFreeSwitch=false] [21:08:08] : [Step 4/5] [2021-11-19 21:08:08,109][INFO ][disco-notifier-worker-#16010%grid-1%][GridClusterStateProcessor] Received activate cluster request with BaselineTopology[id=0] initiator node ID: 00257274-13ec-45e2-bbc6-7e1e40c5d000 [21:08:08] : [Step 4/5] [2021-11-19 21:08:08,110][INFO ][exchange-worker-#15897%grid-0%][GridDhtPartitionsExchangeFuture] Start activation process [nodeId=00257274-13ec-45e2-bbc6-7e1e40c5d000, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]]. New state: ACTIVE [21:08:08] : [Step 4/5] [2021-11-19 21:08:08,110][INFO ][disco-notifier-worker-#16010%grid-1%][GridClusterStateProcessor] Started state transition: activate cluster [21:08:08] : [Step 4/5] [2021-11-19 21:08:08,111][INFO ][exchange-worker-#15897%grid-0%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0 [21:08:08] : [Step 4/5] [2021-11-19 21:08:08,112][INFO ][exchange-worker-#16019%grid-1%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], crd=false, evt=DISCOVERY_CUSTOM_EVT, evtNode=00257274-13ec-45e2-bbc6-7e1e40c5d000, customEvt=ChangeGlobalStateMessage [id=eab5d593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqId=b1be7094-719f-4c5e-b7e5-b48ff0a07c62, initiatingNodeId=00257274-13ec-45e2-bbc6-7e1e40c5d000, state=ACTIVE, baselineTopology=BaselineTopology [id=0, branchingHash=-2475315501, branchingType='New BaselineTopology', baselineNodes=[grid-1, grid-0]], forceChangeBaselineTopology=false, timestamp=1637345288102, forceDeactivation=true], allowMerge=false, exchangeFreeSwitch=false] [21:08:08] : [Step 4/5] [2021-11-19 21:08:08,114][INFO ][exchange-worker-#16019%grid-1%][GridDhtPartitionsExchangeFuture] Start activation process [nodeId=1089858a-0d81-4736-a358-ed902524c001, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]]. New state: ACTIVE [21:08:08] : [Step 4/5] [2021-11-19 21:08:08,114][INFO ][exchange-worker-#16019%grid-1%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1 [21:08:08] : [Step 4/5] [2021-11-19 21:08:08,114][INFO ][exchange-worker-#15897%grid-0%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000000.wal, offset=8713, ver=2] [21:08:08] : [Step 4/5] [2021-11-19 21:08:08,116][INFO ][exchange-worker-#15897%grid-0%][GridClusterStateProcessor] Writing BaselineTopology[id=0] [21:08:08] : [Step 4/5] [2021-11-19 21:08:08,116][INFO ][exchange-worker-#16019%grid-1%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000000.wal, offset=8713, ver=2] [21:08:08] : [Step 4/5] [2021-11-19 21:08:08,118][INFO ][exchange-worker-#16019%grid-1%][GridClusterStateProcessor] Writing BaselineTopology[id=0] [21:08:08] : [Step 4/5] [2021-11-19 21:08:08,124][INFO ][exchange-worker-#15897%grid-0%][GridCacheDatabaseSharedManager] Finish recovery performed in 12 ms. [21:08:08] : [Step 4/5] [2021-11-19 21:08:08,125][INFO ][exchange-worker-#16019%grid-1%][GridCacheDatabaseSharedManager] Finish recovery performed in 11 ms. [21:08:08] : [Step 4/5] [2021-11-19 21:08:08,126][INFO ][exchange-worker-#15897%grid-0%][msg] Components activation performed in 15 ms. [21:08:08] : [Step 4/5] [2021-11-19 21:08:08,127][INFO ][exchange-worker-#16019%grid-1%][msg] Components activation performed in 13 ms. [21:08:08] : [Step 4/5] [2021-11-19 21:08:08,128][INFO ][exchange-worker-#15897%grid-0%][GridCacheProcessor] Finished recovery for cache [cache=ignite-sys-cache, grp=ignite-sys-cache, startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:08:08] : [Step 4/5] [2021-11-19 21:08:08,128][INFO ][exchange-worker-#16019%grid-1%][GridCacheProcessor] Finished recovery for cache [cache=ignite-sys-cache, grp=ignite-sys-cache, startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:08:08] : [Step 4/5] [2021-11-19 21:08:08,128][INFO ][exchange-worker-#15897%grid-0%][GridDhtPartitionsExchangeFuture] Successfully activated caches [nodeId=00257274-13ec-45e2-bbc6-7e1e40c5d000, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], newState=ACTIVE] [21:08:08] : [Step 4/5] [2021-11-19 21:08:08,129][INFO ][exchange-worker-#16019%grid-1%][GridDhtPartitionsExchangeFuture] Successfully activated caches [nodeId=1089858a-0d81-4736-a358-ed902524c001, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], newState=ACTIVE] [21:08:08] : [Step 4/5] [2021-11-19 21:08:08,129][INFO ][exchange-worker-#15897%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:08:08] : [Step 4/5] [2021-11-19 21:08:08,129][INFO ][exchange-worker-#16019%grid-1%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:08:08] : [Step 4/5] [2021-11-19 21:08:08,190][INFO ][exchange-worker-#15897%grid-0%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], crd=true] [21:08:08] : [Step 4/5] [2021-11-19 21:08:08,193][INFO ][grid-nio-worker-tcp-comm-0-#15836%TestRecordingCommunicationSpi%][TestRecordingCommunicationSpi] Accepted incoming communication connection [locAddr=/127.0.0.1:47100, rmtAddr=/127.0.0.1:56078] [21:08:08] : [Step 4/5] [2021-11-19 21:08:08,196][INFO ][grid-nio-worker-tcp-comm-0-#15954%TestRecordingCommunicationSpi%][TestRecordingCommunicationSpi] Established outgoing communication connection [locAddr=/127.0.0.1:56078, rmtAddr=/127.0.0.1:47100] [21:08:08] : [Step 4/5] [2021-11-19 21:08:08,196][INFO ][exchange-worker-#16019%grid-1%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], crd=false] [21:08:08] : [Step 4/5] [2021-11-19 21:08:08,198][INFO ][sys-#15879%grid-0%][GridDhtPartitionsExchangeFuture] Coordinator received single message [ver=AffinityTopologyVersion [topVer=2, minorTopVer=1], node=1089858a-0d81-4736-a358-ed902524c001, allReceived=true] [21:08:08] : [Step 4/5] [2021-11-19 21:08:08,199][INFO ][sys-#15879%grid-0%][GridDhtPartitionsExchangeFuture] finishExchangeOnCoordinator [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:08:08] : [Step 4/5] [2021-11-19 21:08:08,206][INFO ][sys-#15879%grid-0%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], err=null, rebalanced=true, wasRebalanced=false] [21:08:08] : [Step 4/5] [2021-11-19 21:08:08,208][INFO ][db-checkpoint-thread-#16028%grid-1%][Checkpointer] Checkpoint started [checkpointId=f77ea43a-1309-474d-8430-4e5e2ce5c4af, startPtr=WALPointer [idx=0, fileOff=73795, len=1963], checkpointBeforeLockTime=3ms, checkpointLockWait=52ms, checkpointListenersExecuteTime=1ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=1ms, writeCheckpointEntryDuration=16ms, splitAndSortCpPagesDuration=0ms, pages=17, reason='node started'] [21:08:08] : [Step 4/5] [2021-11-19 21:08:08,207][INFO ][disco-notifier-worker-#16010%grid-1%][GridClusterStateProcessor] Received state change finish message: ACTIVE [21:08:08] : [Step 4/5] [2021-11-19 21:08:08,207][INFO ][sys-#15992%grid-1%][GridDhtPartitionsExchangeFuture] Received full message, will finish exchange [node=00257274-13ec-45e2-bbc6-7e1e40c5d000, resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:08:08] : [Step 4/5] [2021-11-19 21:08:08,211][INFO ][sys-#15879%grid-0%][GridCacheProcessor] Finish proxy initialization, cacheName=ignite-sys-cache, localNodeId=00257274-13ec-45e2-bbc6-7e1e40c5d000 [21:08:08] : [Step 4/5] [2021-11-19 21:08:08,206][INFO ][disco-notifier-worker-#15892%grid-0%][GridClusterStateProcessor] Received state change finish message: ACTIVE [21:08:08] : [Step 4/5] [2021-11-19 21:08:08,210][INFO ][sys-#16003%grid-1%][GridCachePartitionExchangeManager] Delay process full message without exchange id (there is exchange in progress) [nodeId=00257274-13ec-45e2-bbc6-7e1e40c5d000] [21:08:08] : [Step 4/5] [2021-11-19 21:08:08,209][INFO ][disco-notifier-worker-#16010%grid-1%][GridClusterStateProcessor] Cluster state was changed from INACTIVE to ACTIVE [21:08:08] : [Step 4/5] [2021-11-19 21:08:08,208][INFO ][db-checkpoint-thread-#16029%grid-0%][Checkpointer] Checkpoint started [checkpointId=b35c26d8-2534-487b-a22e-187e60bad585, startPtr=WALPointer [idx=0, fileOff=73795, len=1963], checkpointBeforeLockTime=2ms, checkpointLockWait=52ms, checkpointListenersExecuteTime=1ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=1ms, writeCheckpointEntryDuration=16ms, splitAndSortCpPagesDuration=0ms, pages=17, reason='node started'] [21:08:08] : [Step 4/5] [2021-11-19 21:08:08,212][INFO ][sys-#15879%grid-0%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=00257274-13ec-45e2-bbc6-7e1e40c5d000, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=00257274-13ec-45e2-bbc6-7e1e40c5d000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345288204, loc=true, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:08:08] : [Step 4/5] [2021-11-19 21:08:08,212][INFO ][exchange-worker-#15897%grid-0%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=2, minorTopVer=1], force=false, evt=DISCOVERY_CUSTOM_EVT, node=00257274-13ec-45e2-bbc6-7e1e40c5d000] [21:08:08] : [Step 4/5] [2021-11-19 21:08:08,212][INFO ][sys-#15872%grid-0%][DistributedBaselineConfiguration] Baseline auto-adjust is 'disabled' with timeout='300000' ms [21:08:08] : [Step 4/5] [2021-11-19 21:08:08,211][INFO ][sys-#15992%grid-1%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], err=null, rebalanced=true, wasRebalanced=false] [21:08:08] : [Step 4/5] [2021-11-19 21:08:08,211][INFO ][disco-notifier-worker-#15892%grid-0%][GridClusterStateProcessor] Cluster state was changed from INACTIVE to ACTIVE [21:08:08] : [Step 4/5] [2021-11-19 21:08:08,215][INFO ][sys-#15872%grid-0%][GridClusterStateProcessor] Successfully performed final activation steps [nodeId=00257274-13ec-45e2-bbc6-7e1e40c5d000, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:08:08] : [Step 4/5] [2021-11-19 21:08:08,214][INFO ][sys-#15879%grid-0%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (1 ms), stage="Update caches registry" (17 ms), stage="Start caches" (0 ms), stage="Affinity initialization on cache group start" (0 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Restore partition states" (0 ms), stage="After states restored callback" (59 ms), stage="WAL history reservation" (0 ms), stage="Waiting for all single messages" (8 ms), stage="Affinity recalculation (crd)" (0 ms), stage="Collect update counters and create affinity messages" (0 ms), stage="Assign partitions states" (0 ms), stage="Validate partitions states" (0 ms), stage="Ideal affinity diff calculation (enforced)" (0 ms), stage="Apply update counters" (0 ms), stage="Full message preparing" (4 ms), stage="Full message sending" (0 ms), stage="State finish message sending" (0 ms), stage="Detect lost partitions" (3 ms), stage="Exchange done" (4 ms), stage="Total time" (96 ms), Discovery lag=3 ms, Latest started node id=1089858a-0d81-4736-a358-ed902524c001] [21:08:08] : [Step 4/5] [2021-11-19 21:08:08,218][INFO ][sys-#15992%grid-1%][GridCacheProcessor] Finish proxy initialization, cacheName=ignite-sys-cache, localNodeId=1089858a-0d81-4736-a358-ed902524c001 [21:08:08] : [Step 4/5] [2021-11-19 21:08:08,220][INFO ][sys-#15879%grid-0%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], stage="Affinity initialization on cache group start [grp=ignite-sys-cache]" (0 ms) (parent=Affinity initialization on cache group start), stage="Affinity centralized initialization (crd) [grp=ignite-sys-cache, crd=true]" (0 ms) (parent=Determine exchange type), stage="Restore partition states [grp=ignite-sys-cache]" (0 ms) (parent=Restore partition states), stage="Affinity recalculation (partitions availability) [grp=ignite-sys-cache]" (0 ms) (parent=Ideal affinity diff calculation (enforced))] [21:08:08] : [Step 4/5] [2021-11-19 21:08:08,222][INFO ][sys-#15992%grid-1%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=1089858a-0d81-4736-a358-ed902524c001, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=00257274-13ec-45e2-bbc6-7e1e40c5d000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345288062, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:08:08] : [Step 4/5] [2021-11-19 21:08:08,222][INFO ][exchange-worker-#16019%grid-1%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=2, minorTopVer=1], force=false, evt=DISCOVERY_CUSTOM_EVT, node=00257274-13ec-45e2-bbc6-7e1e40c5d000] [21:08:08] : [Step 4/5] [2021-11-19 21:08:08,222][INFO ][sys-#16008%grid-1%][DistributedBaselineConfiguration] Baseline auto-adjust is 'disabled' with timeout='300000' ms [21:08:08] : [Step 4/5] [2021-11-19 21:08:08,328][INFO ][sys-#16008%grid-1%][GridClusterStateProcessor] Successfully performed final activation steps [nodeId=1089858a-0d81-4736-a358-ed902524c001, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:08:08] : [Step 4/5] [2021-11-19 21:08:08,323][INFO ][sys-#15992%grid-1%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (1 ms), stage="Update caches registry" (14 ms), stage="Start caches" (0 ms), stage="Affinity initialization on cache group start" (0 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Restore partition states" (0 ms), stage="After states restored callback" (59 ms), stage="WAL history reservation" (0 ms), stage="Waiting for Full message" (16 ms), stage="Affinity recalculation" (4 ms), stage="Full map updating" (0 ms), stage="Detect lost partitions" (6 ms), stage="Exchange done" (105 ms), stage="Total time" (205 ms)] [21:08:08] : [Step 4/5] [2021-11-19 21:08:08,333][INFO ][sys-#15992%grid-1%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], stage="Affinity initialization on cache group start [grp=ignite-sys-cache]" (0 ms) (parent=Affinity initialization on cache group start), stage="Affinity centralized initialization (crd) [grp=ignite-sys-cache, crd=false]" (0 ms) (parent=Determine exchange type), stage="Restore partition states [grp=ignite-sys-cache]" (0 ms) (parent=Restore partition states), stage="Affinity applying from full message [grp=ignite-sys-cache]" (4 ms) (parent=Affinity recalculation)] [21:08:08] : [Step 4/5] [2021-11-19 21:08:08,323][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][root] awaitPartitionMapExchange finished [21:08:08] : [Step 4/5] [2021-11-19 21:08:08,641][INFO ][exchange-worker-#16019%grid-1%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], crd=false, evt=DISCOVERY_CUSTOM_EVT, evtNode=00257274-13ec-45e2-bbc6-7e1e40c5d000, customEvt=DynamicCacheChangeBatch [id=2db5d593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqs=ArrayList [DynamicCacheChangeRequest [cacheName=encrypted, hasCfg=true, nodeId=00257274-13ec-45e2-bbc6-7e1e40c5d000, clientStartOnly=false, stop=false, destroy=false, disabledAfterStart=false]], exchangeActions=ExchangeActions [startCaches=[encrypted], stopCaches=null, startGrps=[encrypted], stopGrps=[], resetParts=null, stateChangeRequest=null], startCaches=false], allowMerge=false, exchangeFreeSwitch=false] [21:08:08] : [Step 4/5] [2021-11-19 21:08:08,642][INFO ][exchange-worker-#15897%grid-0%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], crd=true, evt=DISCOVERY_CUSTOM_EVT, evtNode=00257274-13ec-45e2-bbc6-7e1e40c5d000, customEvt=DynamicCacheChangeBatch [id=2db5d593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqs=ArrayList [DynamicCacheChangeRequest [cacheName=encrypted, hasCfg=true, nodeId=00257274-13ec-45e2-bbc6-7e1e40c5d000, clientStartOnly=false, stop=false, destroy=false, disabledAfterStart=false]], exchangeActions=ExchangeActions [startCaches=[encrypted], stopCaches=null, startGrps=[encrypted], stopGrps=[], resetParts=null, stateChangeRequest=null], startCaches=false], allowMerge=false, exchangeFreeSwitch=false] [21:08:08] : [Step 4/5] [2021-11-19 21:08:08,643][INFO ][exchange-worker-#16019%grid-1%][PageMemoryImpl] Started page memory [memoryAllocated=24.0 MiB, pages=5952, tableSize=474.2 KiB, replacementSize=768 B, checkpointBuffer=10.0 MiB] [21:08:08] : [Step 4/5] [2021-11-19 21:08:08,645][INFO ][exchange-worker-#15897%grid-0%][PageMemoryImpl] Started page memory [memoryAllocated=24.0 MiB, pages=5952, tableSize=474.2 KiB, replacementSize=768 B, checkpointBuffer=10.0 MiB] [21:08:08] : [Step 4/5] [2021-11-19 21:08:08,714][INFO ][exchange-worker-#16019%grid-1%][GridCacheProcessor] Started cache [name=encrypted, id=1613773252, dataRegionName=default, mode=PARTITIONED, atomicity=ATOMIC, backups=0, mvcc=false] [21:08:08]W: [org.apache.ignite:ignite-core] [2021-11-19 21:08:08,715][WARN ][exchange-worker-#16019%grid-1%][CacheAffinitySharedManager] Cache group 'encrypted' brings high overhead for its metainformation in data region 'default'. Metainformation required for its partitions (522 partitions, 4096 bytes per partition, 2 MBs total) will consume more than 15% of data region memory (10 MBs). It may lead to critical errors on the node and cluster instability. Please reduce number of partitions, add more memory to the data region or add more server nodes for this cache group. [21:08:08] : [Step 4/5] [2021-11-19 21:08:08,717][INFO ][exchange-worker-#16019%grid-1%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], waitTime=0ms, futInfo=NA, mode=DISTRIBUTED] [21:08:08] : [Step 4/5] [2021-11-19 21:08:08,719][INFO ][exchange-worker-#15897%grid-0%][GridCacheProcessor] Started cache [name=encrypted, id=1613773252, dataRegionName=default, mode=PARTITIONED, atomicity=ATOMIC, backups=0, mvcc=false] [21:08:08]W: [org.apache.ignite:ignite-core] [2021-11-19 21:08:08,721][WARN ][exchange-worker-#15897%grid-0%][CacheAffinitySharedManager] Cache group 'encrypted' brings high overhead for its metainformation in data region 'default'. Metainformation required for its partitions (502 partitions, 4096 bytes per partition, 1 MBs total) will consume more than 15% of data region memory (10 MBs). It may lead to critical errors on the node and cluster instability. Please reduce number of partitions, add more memory to the data region or add more server nodes for this cache group. [21:08:08] : [Step 4/5] [2021-11-19 21:08:08,722][INFO ][exchange-worker-#15897%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], waitTime=0ms, futInfo=NA, mode=DISTRIBUTED] [21:08:08] : [Step 4/5] [2021-11-19 21:08:08,722][INFO ][exchange-worker-#15897%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partitions release latch: ServerLatch [permits=0, pendingAcks=HashSet [], super=CompletableLatch [id=CompletableLatchUid [id=exchange, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2]]]] [21:08:08] : [Step 4/5] [2021-11-19 21:08:08,723][INFO ][exchange-worker-#16019%grid-1%][GridDhtPartitionsExchangeFuture] Finished waiting for partitions release latch: ClientLatch [coordinator=TcpDiscoveryNode [id=00257274-13ec-45e2-bbc6-7e1e40c5d000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345288062, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], ackSent=true, super=CompletableLatch [id=CompletableLatchUid [id=exchange, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2]]]] [21:08:08] : [Step 4/5] [2021-11-19 21:08:08,723][INFO ][exchange-worker-#15897%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:08:08] : [Step 4/5] [2021-11-19 21:08:08,724][INFO ][exchange-worker-#16019%grid-1%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:08:08] : [Step 4/5] [2021-11-19 21:08:08,753][INFO ][exchange-worker-#15897%grid-0%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], crd=true] [21:08:08] : [Step 4/5] [2021-11-19 21:08:08,756][INFO ][exchange-worker-#16019%grid-1%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], crd=false] [21:08:08] : [Step 4/5] [2021-11-19 21:08:08,757][INFO ][sys-#15890%grid-0%][GridDhtPartitionsExchangeFuture] Coordinator received single message [ver=AffinityTopologyVersion [topVer=2, minorTopVer=2], node=1089858a-0d81-4736-a358-ed902524c001, allReceived=true] [21:08:08] : [Step 4/5] [2021-11-19 21:08:08,757][INFO ][sys-#15890%grid-0%][GridDhtPartitionsExchangeFuture] finishExchangeOnCoordinator [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2]] [21:08:08] : [Step 4/5] [2021-11-19 21:08:08,762][INFO ][sys-#15890%grid-0%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], err=null, rebalanced=true, wasRebalanced=true] [21:08:08] : [Step 4/5] [2021-11-19 21:08:08,763][INFO ][sys-#15995%grid-1%][GridDhtPartitionsExchangeFuture] Received full message, will finish exchange [node=00257274-13ec-45e2-bbc6-7e1e40c5d000, resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2]] [21:08:08] : [Step 4/5] [2021-11-19 21:08:08,763][INFO ][sys-#15890%grid-0%][GridCacheProcessor] Finish proxy initialization, cacheName=encrypted, localNodeId=00257274-13ec-45e2-bbc6-7e1e40c5d000 [21:08:08] : [Step 4/5] [2021-11-19 21:08:08,766][INFO ][sys-#15890%grid-0%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=00257274-13ec-45e2-bbc6-7e1e40c5d000, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=00257274-13ec-45e2-bbc6-7e1e40c5d000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345288332, loc=true, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2]] [21:08:08] : [Step 4/5] [2021-11-19 21:08:08,766][INFO ][exchange-worker-#15897%grid-0%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=2, minorTopVer=2], force=false, evt=DISCOVERY_CUSTOM_EVT, node=00257274-13ec-45e2-bbc6-7e1e40c5d000] [21:08:08] : [Step 4/5] [2021-11-19 21:08:08,766][INFO ][sys-#15995%grid-1%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], err=null, rebalanced=true, wasRebalanced=true] [21:08:08] : [Step 4/5] [2021-11-19 21:08:08,767][INFO ][sys-#15890%grid-0%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (2 ms), stage="Update caches registry" (0 ms), stage="Start caches" (75 ms), stage="Affinity initialization on cache group start" (1 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Wait partitions release latch [latch=exchange]" (0 ms), stage="Wait partitions release [latch=exchange]" (1 ms), stage="Restore partition states" (9 ms), stage="After states restored callback" (19 ms), stage="WAL history reservation" (0 ms), stage="Waiting for all single messages" (4 ms), stage="Affinity recalculation (crd)" (0 ms), stage="Collect update counters and create affinity messages" (0 ms), stage="Assign partitions states" (1 ms), stage="Validate partitions states" (0 ms), stage="Apply update counters" (0 ms), stage="Full message preparing" (2 ms), stage="Full message sending" (0 ms), stage="Exchange done" (4 ms), stage="Total time" (118 ms)] [21:08:08] : [Step 4/5] [2021-11-19 21:08:08,768][INFO ][sys-#15995%grid-1%][GridCacheProcessor] Finish proxy initialization, cacheName=encrypted, localNodeId=1089858a-0d81-4736-a358-ed902524c001 [21:08:08] : [Step 4/5] [2021-11-19 21:08:08,769][INFO ][sys-#15890%grid-0%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], stage="Affinity initialization on cache group start [grp=encrypted]" (1 ms) (parent=Affinity initialization on cache group start), stage="Restore partition states [grp=encrypted]" (9 ms) (parent=Restore partition states), stage="Restore partition states [grp=ignite-sys-cache]" (0 ms) (parent=Restore partition states)] [21:08:08] : [Step 4/5] [2021-11-19 21:08:08,770][INFO ][exchange-worker-#16019%grid-1%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=2, minorTopVer=2], force=false, evt=DISCOVERY_CUSTOM_EVT, node=00257274-13ec-45e2-bbc6-7e1e40c5d000] [21:08:08] : [Step 4/5] [2021-11-19 21:08:08,770][INFO ][sys-#15995%grid-1%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=1089858a-0d81-4736-a358-ed902524c001, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=00257274-13ec-45e2-bbc6-7e1e40c5d000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345288062, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2]] [21:08:08] : [Step 4/5] [2021-11-19 21:08:08,772][INFO ][sys-#15995%grid-1%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (1 ms), stage="Update caches registry" (0 ms), stage="Start caches" (71 ms), stage="Affinity initialization on cache group start" (2 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Wait partitions release latch [latch=exchange]" (6 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Restore partition states" (9 ms), stage="After states restored callback" (20 ms), stage="WAL history reservation" (0 ms), stage="Waiting for Full message" (7 ms), stage="Affinity recalculation" (0 ms), stage="Full map updating" (2 ms), stage="Exchange done" (5 ms), stage="Total time" (123 ms)] [21:08:08] : [Step 4/5] [2021-11-19 21:08:08,773][INFO ][sys-#15995%grid-1%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], stage="Affinity initialization on cache group start [grp=encrypted]" (1 ms) (parent=Affinity initialization on cache group start), stage="Restore partition states [grp=encrypted]" (9 ms) (parent=Restore partition states), stage="Restore partition states [grp=ignite-sys-cache]" (0 ms) (parent=Restore partition states)] [21:08:09] : [Step 4/5] [2021-11-19 21:08:09,125][INFO ][db-checkpoint-thread-#16028%grid-1%][Checkpointer] Checkpoint finished [cpId=f77ea43a-1309-474d-8430-4e5e2ce5c4af, pages=17, markPos=WALPointer [idx=0, fileOff=73795, len=1963], walSegmentsCovered=[], markDuration=20ms, pagesWrite=2ms, fsync=913ms, total=990ms] [21:08:09] : [Step 4/5] [2021-11-19 21:08:09,125][INFO ][db-checkpoint-thread-#16029%grid-0%][Checkpointer] Checkpoint finished [cpId=b35c26d8-2534-487b-a22e-187e60bad585, pages=17, markPos=WALPointer [idx=0, fileOff=73795, len=1963], walSegmentsCovered=[], markDuration=24ms, pagesWrite=1ms, fsync=910ms, total=989ms] [21:08:10] : [Step 4/5] [2021-11-19 21:08:10,551][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][root] >>> Stopping grid [name=grid-1, id=1089858a-0d81-4736-a358-ed902524c001] [21:08:10] : [Step 4/5] [2021-11-19 21:08:10,570][INFO ][db-checkpoint-thread-#16028%grid-1%][Checkpointer] Checkpoint started [checkpointId=e0167129-99ae-4ee1-aeba-d2163a4a1005, startPtr=WALPointer [idx=0, fileOff=632282, len=11871], checkpointBeforeLockTime=6ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=1ms, checkpointLockHoldTime=3ms, walCpRecordFsyncDuration=3ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=1ms, pages=452, reason='timeout'] [21:08:10] : [Step 4/5] [2021-11-19 21:08:10,577][INFO ][tcp-disco-sock-reader-[00257274 127.0.0.1:40875]-#836%grid-1%-#16015%grid-1%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:40875, rmtPort=40875, rmtNodeId=00257274-13ec-45e2-bbc6-7e1e40c5d000] [21:08:10] : [Step 4/5] [2021-11-19 21:08:10,578][INFO ][disco-event-worker-#15896%grid-0%][GridDiscoveryManager] Node left topology: TcpDiscoveryNode [id=1089858a-0d81-4736-a358-ed902524c001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637345288031, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false] [21:08:10] : [Step 4/5] [2021-11-19 21:08:10,580][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][GridCacheProcessor] Stopped cache [cacheName=ignite-sys-cache] [21:08:10] : [Step 4/5] [2021-11-19 21:08:10,580][INFO ][disco-event-worker-#15896%grid-0%][GridDiscoveryManager] Topology snapshot [ver=3, locNode=00257274, servers=1, clients=0, state=ACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=00257274-13ec-45e2-bbc6-7e1e40c5d000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:08:10] : [Step 4/5] [2021-11-19 21:08:10,581][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][GridCacheProcessor] Stopped cache [cacheName=encrypted] [21:08:10] : [Step 4/5] [2021-11-19 21:08:10,581][INFO ][disco-event-worker-#15896%grid-0%][GridDiscoveryManager] ^-- Baseline [id=0, size=2, online=1, offline=1] [21:08:10]W: [org.apache.ignite:ignite-core] [2021-11-19 21:08:10,583][WARN ][grid-nio-worker-tcp-comm-0-#15836%TestRecordingCommunicationSpi%][TestRecordingCommunicationSpi] Failed to shutdown socket [21:08:10]W: [org.apache.ignite:ignite-core] java.nio.channels.ClosedChannelException [21:08:10]W: [org.apache.ignite:ignite-core] at sun.nio.ch.SocketChannelImpl.shutdownOutput(SocketChannelImpl.java:795) [21:08:10]W: [org.apache.ignite:ignite-core] at sun.nio.ch.SocketAdaptor.shutdownOutput(SocketAdaptor.java:407) [21:08:10]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.close(IgniteUtils.java:4247) [21:08:10]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.closeKey(GridNioServer.java:2784) [21:08:10]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.close(GridNioServer.java:2835) [21:08:10]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.close(GridNioServer.java:2794) [21:08:10]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.bodyInternal(GridNioServer.java:2157) [21:08:10]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.body(GridNioServer.java:1910) [21:08:10]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:125) [21:08:10]W: [org.apache.ignite:ignite-core] at java.lang.Thread.run(Thread.java:748) [21:08:10] : [Step 4/5] [2021-11-19 21:08:10,583][INFO ][exchange-worker-#15897%grid-0%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], crd=true, evt=NODE_LEFT, evtNode=1089858a-0d81-4736-a358-ed902524c001, customEvt=null, allowMerge=false, exchangeFreeSwitch=true] [21:08:10] : [Step 4/5] [2021-11-19 21:08:10,586][INFO ][sys-#15891%grid-0%][GridAffinityAssignmentCache] Local node affinity assignment distribution is not ideal [cache=encrypted, expectedPrimary=1024.00, actualPrimary=502, expectedBackups=0.00, actualBackups=0, warningThreshold=50.00%] [21:08:10] : [Step 4/5] [2021-11-19 21:08:10,587][INFO ][exchange-worker-#15897%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:08:10] : [Step 4/5] [2021-11-19 21:08:10,589][INFO ][exchange-worker-#15897%grid-0%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], err=null, rebalanced=true, wasRebalanced=true] [21:08:10]W: [org.apache.ignite:ignite-core] [2021-11-19 21:08:10,590][WARN ][exchange-worker-#15897%grid-0%][GridDhtPartitionTopologyImpl] Detected lost partitions [grp=encrypted, parts=[0, 2, 4, 6-7, 10-11, 14, 17, 21, 24-30, 32, 37, 40, 44, 47-52, 54, 57, 59, 62-64, 67-68, 74-75, 78, 81, 87-88, 91, 97, 99, 101-102, 104-107, 113-114, 116, 118, 120, 122, 124, 135-136, 138, 140-145, 147, 149-152, 154-156, 159-160, 162-164, 169, 172, 175-177, 180, 184-187, 190-191, 194, 196-202, 204-205, 209-210, 212, 214, 216, 219-224, 226, 229-232, 237, 239, 241, 243-245, 247, 249-251, 255, 257, 261, 265, 269, 272-273, 276-277, 281-282, 285, 287, 289-291, 293-297, 299, 301-304, 306, 308-309, 311-312, 315-317, 319, 322, 325-326, 328-330, 336, 339, 341, 344-346, 350, 352-354, 357-361, 363, 366-367, 371-373, 376-380, 383, 385, 387-388, 390, 392, 395-397, 400, 402, 405, 408-411, 416, 420, 422, 424-425, 429, 433, 435-438, 440-441, 445-446, 450, 452-453, 455-456, 458, 460, 462-463, 465-468, 470, 474-475, 480, 488, 490-492, 495, 497, 499-512, 516, 525, 527-531, 535, 537-538, 541-542, 545-546, 548-552, 554-555, 558, 562-564, 567-569, 572, 574, 579-580, 582-585, 587, 590-591, 594, 596, 600, 602, 604, 607-614, 617-620, 623-624, 627-629, 632-633, 636, 638, 640-642, 645-646, 648-649, 657-662, 664-665, 668-672, 677-678, 682-684, 686, 689, 692-693, 695-697, 699, 706-707, 709-710, 712-714, 716-717, 719-721, 723-728, 730-732, 734-735, 739, 742, 746, 749-750, 752, 754, 756, 762, 768-770, 772-775, 778, 780, 783-787, 789-791, 793, 796, 798-801, 803, 806, 809-812, 814, 816-817, 819, 822-825, 827-829, 832-833, 836-837, 839-840, 846, 848-851, 853-854, 857-858, 860, 863-864, 866, 868-871, 873-875, 877-878, 884, 888-889, 896-897, 900, 905-907, 914-915, 917, 919-920, 923-925, 931-933, 936, 940, 942, 944-945, 948, 950-951, 954, 956-958, 962, 965-970, 972, 975-976, 978-980, 983, 985, 988, 990, 993-994, 997-998, 1000, 1003-1004, 1007, 1009, 1014, 1016, 1018-1019], topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0]] [21:08:10] : [Step 4/5] [2021-11-19 21:08:10,594][INFO ][exchange-worker-#15897%grid-0%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=00257274-13ec-45e2-bbc6-7e1e40c5d000, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], evt=NODE_LEFT, evtNode=TcpDiscoveryNode [id=1089858a-0d81-4736-a358-ed902524c001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637345288031, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0]] [21:08:10] : [Step 4/5] [2021-11-19 21:08:10,595][INFO ][exchange-worker-#15897%grid-0%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (2 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="After states restored callback" (0 ms), stage="WAL history reservation" (0 ms), stage="Finalize update counters" (0 ms), stage="Detect lost partitions" (4 ms), stage="Exchange done" (2 ms), stage="Total time" (8 ms)] [21:08:10] : [Step 4/5] [2021-11-19 21:08:10,596][INFO ][exchange-worker-#15897%grid-0%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], stage="Affinity initialization (exchange-free switch on fully-rebalanced topology) [grp=ignite-sys-cache]" (0 ms) (parent=Determine exchange type), stage="Affinity initialization (exchange-free switch on fully-rebalanced topology) [grp=encrypted]" (0 ms) (parent=Determine exchange type)] [21:08:10] : [Step 4/5] [2021-11-19 21:08:10,597][INFO ][exchange-worker-#15897%grid-0%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], crd=true] [21:08:10] : [Step 4/5] [2021-11-19 21:08:10,598][INFO ][exchange-worker-#15897%grid-0%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=3, minorTopVer=0], force=false, evt=NODE_LEFT, node=1089858a-0d81-4736-a358-ed902524c001] [21:08:12] : [Step 4/5] [2021-11-19 21:08:12,509][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][FilePageStoreManager] Cleanup cache stores [total=4, left=0, cleanFiles=false] [21:08:12] : [Step 4/5] [2021-11-19 21:08:12,511][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][GridDeploymentLocalStore] Removed undeployed class: GridDeployment [ts=1637345288204, depMode=SHARED, clsLdr=IsolatedClassLoader{roleName='test'}, clsLdrId=cbb5d593d71-1089858a-0d81-4736-a358-ed902524c001, userVer=0, loc=true, sampleClsName=org.apache.ignite.internal.processors.cache.distributed.dht.preloader.IgniteDhtPartitionCountersMap2, pendingUndeploy=false, undeployed=true, usage=0] [21:08:12] : [Step 4/5] [2021-11-19 21:08:12,517][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] [21:08:12] : [Step 4/5] [21:08:12] : [Step 4/5] >>> +------------------------------------------------------+ [21:08:12] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV stopped OK [21:08:12] : [Step 4/5] >>> +------------------------------------------------------+ [21:08:12] : [Step 4/5] >>> Ignite instance name: grid-1 [21:08:12] : [Step 4/5] >>> Grid uptime: 00:00:04.425 [21:08:12] : [Step 4/5] [21:08:12] : [Step 4/5] [21:08:12] : [Step 4/5] [2021-11-19 21:08:12,579][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:08:12] : [Step 4/5] [2021-11-19 21:08:12,733][INFO ][disco-notifier-worker-#15892%grid-0%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:08:12] : [Step 4/5] [2021-11-19 21:08:12,883][INFO ][disco-notifier-worker-#15892%grid-0%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:08:12] : [Step 4/5] [2021-11-19 21:08:12,978][INFO ][disco-notifier-worker-#15892%grid-0%][GridEncryptionManager] Start master key change [masterKeyName=ignite.master.key2] [21:08:13] : [Step 4/5] [2021-11-19 21:08:13,037][INFO ][disco-notifier-worker-#15892%grid-0%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:08:13] : [Step 4/5] [2021-11-19 21:08:13,126][INFO ][disco-notifier-worker-#15892%grid-0%][GridEncryptionManager] Master key successfully changed [masterKeyName=ignite.master.key2] [21:08:13]W: [org.apache.ignite:ignite-core] [2021-11-19 21:08:13,132][WARN ][test-runner-#15781%encryption.MasterKeyChangeTest%][G] Ignite work directory is not provided, automatically resolved to: /opt/buildagent/work/7bc1c54bc719b67c/work [21:08:13] : [Step 4/5] [2021-11-19 21:08:13,133][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] [21:08:13] : [Step 4/5] [21:08:13] : [Step 4/5] >>> __________ ________________ [21:08:13] : [Step 4/5] >>> / _/ ___/ |/ / _/_ __/ __/ [21:08:13] : [Step 4/5] >>> _/ // (7 7 // / / / / _/ [21:08:13] : [Step 4/5] >>> /___/\___/_/|_/___/ /_/ /___/ [21:08:13] : [Step 4/5] >>> [21:08:13] : [Step 4/5] >>> ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:08:13] : [Step 4/5] >>> 2021 Copyright(C) Apache Software Foundation [21:08:13] : [Step 4/5] >>> [21:08:13] : [Step 4/5] >>> Ignite documentation: http://ignite.apache.org [21:08:13] : [Step 4/5] [21:08:13] : [Step 4/5] [2021-11-19 21:08:13,134][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] Config URL: n/a [21:08:13] : [Step 4/5] [2021-11-19 21:08:13,135][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] IgniteConfiguration [igniteInstanceName=grid-1, pubPoolSize=24, svcPoolSize=24, callbackPoolSize=24, stripedPoolSize=24, sysPoolSize=24, mgmtPoolSize=4, dataStreamerPoolSize=24, utilityCachePoolSize=24, utilityCacheKeepAliveTime=60000, p2pPoolSize=2, qryPoolSize=24, buildIdxPoolSize=4, igniteHome=/opt/buildagent/work/7bc1c54bc719b67c, igniteWorkDir=/opt/buildagent/work/7bc1c54bc719b67c/work, mbeanSrv=com.sun.jmx.mbeanserver.JmxMBeanServer@6fe85038, nodeId=103d6c62-a27a-47dc-91cd-f77fd9df8001, marsh=BinaryMarshaller [], marshLocJobs=false, daemon=false, p2pEnabled=true, netTimeout=10000, netCompressionLevel=1, sndRetryDelay=1000, sndRetryCnt=3, metricsHistSize=10000, metricsUpdateFreq=1000, metricsExpTime=9223372036854775807, discoSpi=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=0, ackTimeout=0, marsh=null, reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], segPlc=STOP, segResolveAttempts=2, waitForSegOnStart=true, allResolversPassReq=true, segChkFreq=10000, commSpi=TcpCommunicationSpi [connectGate=org.apache.ignite.spi.communication.tcp.internal.ConnectGateway@79737762, ctxInitLatch=java.util.concurrent.CountDownLatch@4762019f[Count = 1], stopping=false, clientPool=null, nioSrvWrapper=null, stateProvider=null], evtSpi=MemoryEventStorageSpi [expireAgeMs=9223372036854775807, expireCnt=10000, filter=null], colSpi=NoopCollisionSpi [], deploySpi=LocalDeploymentSpi [], indexingSpi=org.apache.ignite.spi.indexing.noop.NoopIndexingSpi@633ce70, addrRslvr=null, encryptionSpi=org.apache.ignite.spi.encryption.keystore.KeystoreEncryptionSpi@35558b06, tracingSpi=org.apache.ignite.spi.tracing.NoopTracingSpi@1933520, clientMode=false, rebalanceThreadPoolSize=4, rebalanceTimeout=10000, rebalanceBatchesPrefetchCnt=3, rebalanceThrottle=0, rebalanceBatchSize=524288, txCfg=TransactionConfiguration [txSerEnabled=false, dfltIsolation=REPEATABLE_READ, dfltConcurrency=PESSIMISTIC, dfltTxTimeout=0, txTimeoutOnPartitionMapExchange=0, deadlockTimeout=10000, pessimisticTxLogSize=0, pessimisticTxLogLinger=10000, tmLookupClsName=null, txManagerFactory=null, useJtaSync=false], cacheSanityCheckEnabled=true, discoStartupDelay=60000, deployMode=SHARED, p2pMissedCacheSize=100, locHost=127.0.0.1, timeSrvPortBase=31100, timeSrvPortRange=100, failureDetectionTimeout=10000, sysWorkerBlockedTimeout=null, clientFailureDetectionTimeout=10000, metricsLogFreq=0, connectorCfg=null, odbcCfg=null, warmupClos=null, atomicCfg=AtomicConfiguration [seqReserveSize=1000, cacheMode=PARTITIONED, backups=1, aff=null, grpName=null], classLdr=null, sslCtxFactory=null, platformCfg=null, binaryCfg=null, memCfg=null, pstCfg=null, dsCfg=DataStorageConfiguration [sysRegionInitSize=41943040, sysRegionMaxSize=104857600, pageSize=4096, concLvl=0, dfltDataRegConf=DataRegionConfiguration [name=default, maxSize=10485760, initSize=268435456, swapPath=null, pageEvictionMode=DISABLED, pageReplacementMode=CLOCK, evictionThreshold=0.9, emptyPagesPoolSize=100, metricsEnabled=false, metricsSubIntervalCount=5, metricsRateTimeInterval=60000, persistenceEnabled=true, checkpointPageBufSize=0, lazyMemoryAllocation=true, warmUpCfg=null], dataRegions=null, storagePath=null, checkpointFreq=180000, lockWaitTime=10000, checkpointThreads=4, checkpointWriteOrder=SEQUENTIAL, walHistSize=20, maxWalArchiveSize=1073741824, walSegments=10, walSegmentSize=67108864, walPath=db/wal, walArchivePath=db/wal/archive, cdcWalPath=db/wal/cdc, cdcEnabled=false, metricsEnabled=false, walMode=FSYNC, walTlbSize=131072, walBuffSize=0, walFlushFreq=2000, walFsyncDelay=1000, walRecordIterBuffSize=67108864, alwaysWriteFullPages=false, fileIOFactory=org.apache.ignite.internal.processors.cache.persistence.file.AsyncFileIOFactory@3b9b0cc7, metricsSubIntervalCnt=5, metricsRateTimeInterval=60000, walAutoArchiveAfterInactivity=-1, walForceArchiveTimeout=-1, writeThrottlingEnabled=false, walCompactionEnabled=false, walCompactionLevel=1, checkpointReadLockTimeout=null, walPageCompression=DISABLED, walPageCompressionLevel=null, dfltWarmUpCfg=null, encCfg=org.apache.ignite.configuration.EncryptionConfiguration@4bcf0637, defragmentationThreadPoolSize=4, minWalArchiveSize=-1], snapshotPath=snapshots, activeOnStart=true, activeOnStartPropSetFlag=false, autoActivation=true, autoActivationPropSetFlag=false, clusterStateOnStart=null, sqlConnCfg=null, cliConnCfg=ClientConnectorConfiguration [host=null, port=10800, portRange=100, sockSndBufSize=0, sockRcvBufSize=0, tcpNoDelay=true, maxOpenCursorsPerConn=128, threadPoolSize=24, selectorCnt=12, idleTimeout=0, handshakeTimeout=10000, jdbcEnabled=true, odbcEnabled=true, thinCliEnabled=true, sslEnabled=false, useIgniteSslCtxFactory=true, sslClientAuth=false, sslCtxFactory=null, thinCliCfg=ThinClientConfiguration [maxActiveTxPerConn=100, maxActiveComputeTasksPerConn=0]], mvccVacuumThreadCnt=2, mvccVacuumFreq=5000, authEnabled=false, failureHnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]], commFailureRslvr=null, sqlCfg=SqlConfiguration [longQryWarnTimeout=3000, dfltQryTimeout=0, sqlQryHistSize=1000, validationEnabled=false], asyncContinuationExecutor=null] [21:08:13] : [Step 4/5] [2021-11-19 21:08:13,145][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] Daemon mode: off [21:08:13] : [Step 4/5] [2021-11-19 21:08:13,145][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] OS: Linux 4.15.0-151-generic amd64 [21:08:13] : [Step 4/5] [2021-11-19 21:08:13,145][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] OS user: teamcity [21:08:13] : [Step 4/5] [2021-11-19 21:08:13,145][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] PID: 16724 [21:08:13] : [Step 4/5] [2021-11-19 21:08:13,146][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] Language runtime: Java Platform API Specification ver. 1.8 [21:08:13] : [Step 4/5] [2021-11-19 21:08:13,146][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] VM information: Java(TM) SE Runtime Environment 1.8.0_261-b12 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 25.261-b12 [21:08:13] : [Step 4/5] [2021-11-19 21:08:13,146][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] VM total memory: 1.9GB [21:08:13] : [Step 4/5] [2021-11-19 21:08:13,147][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] Remote Management [restart: off, REST: off, JMX (remote: off)] [21:08:13] : [Step 4/5] [2021-11-19 21:08:13,147][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] Logger: GridTestLog4jLogger [quiet=false, config=null] [21:08:13] : [Step 4/5] [2021-11-19 21:08:13,147][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] IGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c [21:08:13] : [Step 4/5] [2021-11-19 21:08:13,147][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] VM arguments: [-DIGNITE_DUMP_THREADS_ON_FAILURE=false, -DMono=/usr/bin/mono-sgen, -DMono4.0_x64=/usr/lib/mono/4.0, -DMono4.5_x64=/usr/lib/mono/4.5, -DMonoVersion=6.12.0.90, -DSKIP_BUILD=false, -Dagent.home.dir=/opt/buildagent, -Dagent.name=aitc-lin02_03, -Dagent.ownPort=9090, -Dagent.work.dir=/opt/buildagent/work, -Dbuild.number=95, -Dbuild.vcs.number=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.1=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.GitHubApacheIgnite=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dclassworlds.conf=/opt/buildagent/temp/buildTmp/teamcity.m2.conf, -Dcom.jetbrains.maven.watcher.report.file=/opt/buildagent/temp/buildTmp/maven-build-info.xml, -Djava.io.tmpdir=/opt/buildagent/temp/buildTmp, -Dmaven.home=/opt/buildagent/tools/maven3_6, -Dmaven.multiModuleProjectDirectory=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.agent.cpuBenchmark=457, -Dteamcity.agent.dotnet.agent_url=http://localhost:9090/RPC2, -Dteamcity.agent.dotnet.build_id=6278078, -Dteamcity.auth.password=*******, -Dteamcity.auth.userId=TeamCityBuildId=6278078, -Dteamcity.build.changedFiles.file=/opt/buildagent/temp/buildTmp/changedFiles6342607772318147725.txt, -Dteamcity.build.checkoutDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.build.id=6278078, -Dteamcity.build.properties.file=/opt/buildagent/temp/buildTmp/teamcity.build5164517880467851002.properties, -Dteamcity.build.tempDir=/opt/buildagent/temp/buildTmp, -Dteamcity.build.workingDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.buildConfName=Basic 3, -Dteamcity.buildType.id=IgniteTests24Java8_Basic3, -Dteamcity.configuration.properties.file=/opt/buildagent/temp/buildTmp/teamcity.config5591980786735343870.properties, -Dteamcity.maven.userSettings.path=/opt/buildagent/temp/buildTmp/maven_settings_585072866407032347.xml, -Dteamcity.maven.watcher.home=/opt/buildagent/plugins/mavenPlugin/maven-watcher-jdk16, -Dteamcity.projectName=Ignite Tests 2.x (JDK 8/11), -Dteamcity.runner.properties.file=/opt/buildagent/temp/buildTmp/teamcity.runner9098465561618137420.properties, -Dteamcity.tests.recentlyFailedTests.file=/opt/buildagent/temp/buildTmp/testsToRunFirst3891775683130404069.txt, -Dteamcity.version=2021.2 (build 99542), -ea, -Xms2g, -Xmx2g, -XX:+HeapDumpOnOutOfMemoryError, -DIGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_TEST_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_UPDATE_NOTIFIER=false, -DIGNITE_NO_DISCO_ORDER=true, -DIGNITE_PERFORMANCE_SUGGESTIONS_DISABLED=true, -Djava.net.preferIPv4Stack=true, -DTEST_SCALE_FACTOR=1.0, -DIGNITE_TEST_PROP_LOG4J_FILE=log4j-tc-test.xml, -DIGNITE_QUIET=false, -DIGNITE_MARSHAL_BUFFERS_RECHECK=1000, -Dmaven.repo.local=/opt/buildagent/.m2/repository] [21:08:13] : [Step 4/5] [2021-11-19 21:08:13,151][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] System cache's DataRegion size is configured to 40 MB. Use DataStorageConfiguration.systemRegionInitialSize property to change the setting. [21:08:13] : [Step 4/5] [2021-11-19 21:08:13,151][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] Configured caches [in 'sysMemPlc' dataRegion: ['ignite-sys-cache']] [21:08:13]W: [org.apache.ignite:ignite-core] [2021-11-19 21:08:13,152][WARN ][test-runner-#15781%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] Peer class loading is enabled (disable it in production for performance and deployment consistency reasons) [21:08:13] : [Step 4/5] [2021-11-19 21:08:13,152][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] 3-rd party licenses can be found at: /opt/buildagent/work/7bc1c54bc719b67c/libs/licenses [21:08:13] : [Step 4/5] [2021-11-19 21:08:13,156][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] Configured plugins: [21:08:13] : [Step 4/5] [2021-11-19 21:08:13,156][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] ^-- StanByClusterTestProvider 1.0 [21:08:13] : [Step 4/5] [2021-11-19 21:08:13,156][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:08:13] : [Step 4/5] [2021-11-19 21:08:13,157][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] [21:08:13] : [Step 4/5] [2021-11-19 21:08:13,157][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] ^-- PageMemory tracker plugin 1.0 [21:08:13] : [Step 4/5] [2021-11-19 21:08:13,157][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:08:13] : [Step 4/5] [2021-11-19 21:08:13,157][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] [21:08:13] : [Step 4/5] [2021-11-19 21:08:13,157][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] ^-- TestDistibutedConfigurationPlugin 1.0 [21:08:13] : [Step 4/5] [2021-11-19 21:08:13,158][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:08:13] : [Step 4/5] [2021-11-19 21:08:13,158][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] [21:08:13] : [Step 4/5] [2021-11-19 21:08:13,158][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] ^-- NodeValidationPluginProvider 1.0 [21:08:13] : [Step 4/5] [2021-11-19 21:08:13,158][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:08:13] : [Step 4/5] [2021-11-19 21:08:13,158][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] [21:08:13] : [Step 4/5] [2021-11-19 21:08:13,159][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][FailureProcessor] Configured failure handler: [hnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]]] [21:08:13] : [Step 4/5] [2021-11-19 21:08:13,189][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][TestRecordingCommunicationSpi] Successfully bound communication NIO server to TCP port [port=47101, locHost=/127.0.0.1, selectorsCnt=12, selectorSpins=0, pairedConn=false] [21:08:13]W: [org.apache.ignite:ignite-core] [2021-11-19 21:08:13,190][WARN ][test-runner-#15781%encryption.MasterKeyChangeTest%][TestRecordingCommunicationSpi] Message queue limit is set to 0 which may lead to potential OOMEs when running cache operations in FULL_ASYNC or PRIMARY_SYNC modes due to message queues growth on sender and receiver sides. [21:08:13] : [Step 4/5] [2021-11-19 21:08:13,198][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][GridCollisionManager] Collision resolution is disabled (all jobs will be activated upon arrival). [21:08:13] : [Step 4/5] [2021-11-19 21:08:13,198][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] Security status [authentication=off, sandbox=off, tls/ssl=off] [21:08:13] : [Step 4/5] [2021-11-19 21:08:13,264][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:08:13] : [Step 4/5] [2021-11-19 21:08:13,357][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][MaintenanceProcessor] Resolved store directory for node persistent data: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1 [21:08:13] : [Step 4/5] [2021-11-19 21:08:13,358][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][CacheObjectBinaryProcessorImpl] Resolved directory for serialized binary metadata: /opt/buildagent/work/7bc1c54bc719b67c/work/db/binary_meta/grid_1 [21:08:13] : [Step 4/5] [2021-11-19 21:08:13,363][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1 [21:08:13] : [Step 4/5] [2021-11-19 21:08:13,364][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][FileWriteAheadLogManager] Resolved write ahead log work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1 [21:08:13] : [Step 4/5] [2021-11-19 21:08:13,365][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][FileWriteAheadLogManager] Resolved write ahead log archive directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1 [21:08:13] : [Step 4/5] [2021-11-19 21:08:13,366][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000005.wal [21:08:13] : [Step 4/5] [2021-11-19 21:08:13,366][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000004.wal [21:08:13] : [Step 4/5] [2021-11-19 21:08:13,367][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000003.wal [21:08:13] : [Step 4/5] [2021-11-19 21:08:13,368][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000002.wal [21:08:13] : [Step 4/5] [2021-11-19 21:08:13,368][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000001.wal [21:08:13] : [Step 4/5] [2021-11-19 21:08:13,373][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Configured data regions initialized successfully [total=5] [21:08:13] : [Step 4/5] [2021-11-19 21:08:13,374][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][IgniteSnapshotManager] Resolved snapshot work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/snapshots [21:08:13] : [Step 4/5] [2021-11-19 21:08:13,375][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][IgniteSnapshotManager] Resolved temp directory for snapshot creation: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1/snp [21:08:13] : [Step 4/5] [2021-11-19 21:08:13,378][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][ClientListenerProcessor] Client connector processor has started on TCP port 10801 [21:08:13] : [Step 4/5] [2021-11-19 21:08:13,385][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] Non-loopback local IPs: 172.17.0.4 [21:08:13] : [Step 4/5] [2021-11-19 21:08:13,385][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] Enabled local MACs: 0242AC110004 [21:08:13] : [Step 4/5] [2021-11-19 21:08:13,389][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=/opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1/cp/1637345290556-e0167129-99ae-4ee1-aeba-d2163a4a1005-START.bin, endMarker=/opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1/cp/1637345288134-f77ea43a-1309-474d-8430-4e5e2ce5c4af-END.bin] [21:08:13] : [Step 4/5] [2021-11-19 21:08:13,391][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:08:13] : [Step 4/5] [2021-11-19 21:08:13,391][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=73795, len=1963], lastMarked=WALPointer [idx=0, fileOff=632282, len=11871], lastCheckpointId=e0167129-99ae-4ee1-aeba-d2163a4a1005] [21:08:13] : [Step 4/5] [2021-11-19 21:08:13,554][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Found last checkpoint marker [cpId=e0167129-99ae-4ee1-aeba-d2163a4a1005, pos=WALPointer [idx=0, fileOff=632282, len=11871]] [21:08:13] : [Step 4/5] [2021-11-19 21:08:13,564][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Applying lost metastore updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=632282, len=11871], lastCheckpointId=e0167129-99ae-4ee1-aeba-d2163a4a1005] [21:08:13] : [Step 4/5] [2021-11-19 21:08:13,644][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=81 ms] [21:08:13] : [Step 4/5] [2021-11-19 21:08:13,644][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][GridCacheProcessor] Restoring partition state for local groups. [21:08:13] : [Step 4/5] [2021-11-19 21:08:13,645][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=0, partitionsProcessed=0, time=0ms] [21:08:13] : [Step 4/5] [2021-11-19 21:08:13,820][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][GridEncryptionManager] System property IGNITE_MASTER_KEY_NAME_TO_CHANGE_BEFORE_STARTUP is set. Master key will be changed locally and group keys will be re-encrypted before join to cluster. Result will be saved to MetaStore on activation process. [masterKeyName=ignite.master.key2] [21:08:13] : [Step 4/5] [2021-11-19 21:08:13,884][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:08:13] : [Step 4/5] [2021-11-19 21:08:13,995][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][GridClusterStateProcessor] Restoring history for BaselineTopology[id=0] [21:08:14] : [Step 4/5] [2021-11-19 21:08:14,004][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][ClusterProcessor] Cluster ID and tag has been read from metastorage: ClusterIdAndTag [id=4a209f43-8915-4578-bd2a-92fe2e973f4a, tag=modest_volhard] [21:08:14] : [Step 4/5] [2021-11-19 21:08:14,005][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][IgniteClusterImpl] Shutdown policy was updated [oldVal=null, newVal=null] [21:08:14] : [Step 4/5] [2021-11-19 21:08:14,005][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustEnabled' was changed from 'null' to 'false' [21:08:14] : [Step 4/5] [2021-11-19 21:08:14,005][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustTimeout' was changed from 'null' to '300000' [21:08:14] : [Step 4/5] [2021-11-19 21:08:14,006][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][IgniteTxManager] Transactions parameter 'txOwnerDumpRequestsAllowed' was changed from 'null' to 'true' [21:08:14] : [Step 4/5] [2021-11-19 21:08:14,006][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][IgniteTxManager] Transactions parameter 'longOperationsDumpTimeout' was changed from 'null' to '60000' [21:08:14] : [Step 4/5] [2021-11-19 21:08:14,006][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpThreshold' was changed from 'null' to '0' [21:08:14] : [Step 4/5] [2021-11-19 21:08:14,007][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][IgniteTxManager] Transactions parameter 'transactionTimeDumpSamplesCoefficient' was changed from 'null' to '0.0' [21:08:14] : [Step 4/5] [2021-11-19 21:08:14,007][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpSamplesPerSecondLimit' was changed from 'null' to '5' [21:08:14] : [Step 4/5] [2021-11-19 21:08:14,008][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][IgniteTxManager] Transactions parameter 'collisionsDumpInterval' was changed from 'null' to '1000' [21:08:14] : [Step 4/5] [2021-11-19 21:08:14,008][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Historical rebalance WAL threshold changed [property=historical.rebalance.threshold, oldVal=null, newVal=500] [21:08:14] : [Step 4/5] [2021-11-19 21:08:14,008][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Checkpoint frequency deviation changed [oldVal=null, newVal=null] [21:08:14] : [Step 4/5] [2021-11-19 21:08:14,009][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][FilePageStoreManager] Cleanup cache stores [total=1, left=0, cleanFiles=false] [21:08:14] : [Step 4/5] [2021-11-19 21:08:14,011][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:08:14] : [Step 4/5] [2021-11-19 21:08:14,012][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:08:14] : [Step 4/5] [2021-11-19 21:08:14,013][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:08:14] : [Step 4/5] [2021-11-19 21:08:14,013][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Data Regions Started: 5 [21:08:14] : [Step 4/5] [2021-11-19 21:08:14,014][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] ^-- sysMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:08:14] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:08:14] : [Step 4/5] ^-- default region [type=default, persistence=true, lazyAlloc=true, [21:08:14] : [Step 4/5] ... initCfg=10MB, maxCfg=10MB, usedRam=0MB, freeRam=100%, allocRam=0MB, allocTotal=0MB] [21:08:14] : [Step 4/5] ^-- metastoreMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:08:14] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:08:14] : [Step 4/5] ^-- TxLog region [type=internal, persistence=true, lazyAlloc=false, [21:08:14] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:08:14] : [Step 4/5] ^-- volatileDsMemPlc region [type=user, persistence=false, lazyAlloc=true, [21:08:14] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB] [21:08:14] : [Step 4/5] ^-- Ignite persistence [used=0MB] [21:08:14] : [Step 4/5] [21:08:14] : [Step 4/5] [2021-11-19 21:08:14,015][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Starting binary memory restore for: [-2100569601, 1613773252] [21:08:14] : [Step 4/5] [2021-11-19 21:08:14,077][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=/opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1/cp/1637345290556-e0167129-99ae-4ee1-aeba-d2163a4a1005-START.bin, endMarker=/opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1/cp/1637345288134-f77ea43a-1309-474d-8430-4e5e2ce5c4af-END.bin] [21:08:14] : [Step 4/5] [2021-11-19 21:08:14,078][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=73795, len=1963], lastMarked=WALPointer [idx=0, fileOff=632282, len=11871], lastCheckpointId=e0167129-99ae-4ee1-aeba-d2163a4a1005] [21:08:14]W: [org.apache.ignite:ignite-core] [2021-11-19 21:08:14,148][WARN ][test-runner-#15781%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Ignite node stopped in the middle of checkpoint. Will restore memory state and finish checkpoint on node start. [21:08:14] : [Step 4/5] [2021-11-19 21:08:14,149][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=24.0 MiB, pages=5952, tableSize=474.2 KiB, replacementSize=768 B, checkpointBuffer=10.0 MiB] [21:08:14] : [Step 4/5] [2021-11-19 21:08:14,244][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Found last checkpoint marker [cpId=e0167129-99ae-4ee1-aeba-d2163a4a1005, pos=WALPointer [idx=0, fileOff=632282, len=11871]] [21:08:14] : [Step 4/5] [2021-11-19 21:08:14,252][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Finished applying memory changes [changesApplied=872, time=102 ms] [21:08:14] : [Step 4/5] [2021-11-19 21:08:14,666][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][CheckpointWorkflow] Checkpoint finished [cpId=e0167129-99ae-4ee1-aeba-d2163a4a1005, pages=452, markPos=WALPointer [idx=0, fileOff=632282, len=11871], pagesWrite=1ms, fsync=398ms, total=399ms] [21:08:14] : [Step 4/5] [2021-11-19 21:08:14,667][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Binary memory state restored at node startup [restoredPtr=WALPointer [idx=0, fileOff=644153, len=0]] [21:08:14] : [Step 4/5] [2021-11-19 21:08:14,669][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000000.wal, offset=644153, ver=2] [21:08:14] : [Step 4/5] [2021-11-19 21:08:14,671][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][GridCacheProcessor] Started cache in recovery mode [name=ignite-sys-cache, id=-2100569601, dataRegionName=sysMemPlc, mode=REPLICATED, atomicity=TRANSACTIONAL, backups=2147483647, mvcc=false] [21:08:14] : [Step 4/5] [2021-11-19 21:08:14,674][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][GridCacheProcessor] Started cache in recovery mode [name=encrypted, id=1613773252, dataRegionName=default, mode=PARTITIONED, atomicity=ATOMIC, backups=0, mvcc=false] [21:08:14] : [Step 4/5] [2021-11-19 21:08:14,674][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Binary recovery performed in 659 ms. [21:08:14] : [Step 4/5] [2021-11-19 21:08:14,675][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=/opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1/cp/1637345290556-e0167129-99ae-4ee1-aeba-d2163a4a1005-START.bin, endMarker=/opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1/cp/1637345290556-e0167129-99ae-4ee1-aeba-d2163a4a1005-END.bin] [21:08:14] : [Step 4/5] [2021-11-19 21:08:14,675][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Applying lost cache updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=632282, len=11871], lastCheckpointId=e0167129-99ae-4ee1-aeba-d2163a4a1005] [21:08:14] : [Step 4/5] [2021-11-19 21:08:14,735][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=61 ms] [21:08:14] : [Step 4/5] [2021-11-19 21:08:14,736][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][GridCacheProcessor] Restoring partition state for local groups. [21:08:14] : [Step 4/5] [2021-11-19 21:08:14,809][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=2, partitionsProcessed=1124, time=71ms] [21:08:15] : [Step 4/5] [2021-11-19 21:08:15,320][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][TestTcpDiscoverySpi] Successfully bound to TCP port [port=47501, localHost=localhost/127.0.0.1, locNodeId=103d6c62-a27a-47dc-91cd-f77fd9df8001] [21:08:15] : [Step 4/5] [2021-11-19 21:08:15,322][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][GridEncryptionManager] Sending stored group keys to coordinator [grps=1613773252] [21:08:15] : [Step 4/5] [2021-11-19 21:08:15,327][INFO ][tcp-disco-srvr-[:47500]-#828%grid-0%-#15894%grid-0%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=35669] [21:08:15] : [Step 4/5] [2021-11-19 21:08:15,328][INFO ][tcp-disco-srvr-[:47500]-#828%grid-0%-#15894%grid-0%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=35669] [21:08:15] : [Step 4/5] [2021-11-19 21:08:15,328][INFO ][tcp-disco-sock-reader-[]-#843%grid-0%-#16165%grid-0%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:35669, rmtPort=35669] [21:08:15] : [Step 4/5] [2021-11-19 21:08:15,330][INFO ][tcp-disco-sock-reader-[103d6c62 127.0.0.1:35669]-#843%grid-0%-#16165%grid-0%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=103d6c62-a27a-47dc-91cd-f77fd9df8001, rmtAddr=/127.0.0.1:35669] [21:08:15] : [Step 4/5] [2021-11-19 21:08:15,333][INFO ][tcp-disco-srvr-[:47501]-#842%grid-1%-#16164%grid-1%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=53617] [21:08:15] : [Step 4/5] [2021-11-19 21:08:15,333][INFO ][tcp-disco-srvr-[:47501]-#842%grid-1%-#16164%grid-1%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=53617] [21:08:15] : [Step 4/5] [2021-11-19 21:08:15,334][INFO ][tcp-disco-sock-reader-[]-#844%grid-1%-#16166%grid-1%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:53617, rmtPort=53617] [21:08:15] : [Step 4/5] [2021-11-19 21:08:15,334][INFO ][tcp-disco-sock-reader-[]-#844%grid-1%-#16166%grid-1%][TestTcpDiscoverySpi] Received ping request from the remote node [rmtNodeId=00257274-13ec-45e2-bbc6-7e1e40c5d000, rmtAddr=/127.0.0.1:53617, rmtPort=53617] [21:08:15] : [Step 4/5] [2021-11-19 21:08:15,335][INFO ][tcp-disco-sock-reader-[]-#844%grid-1%-#16166%grid-1%][TestTcpDiscoverySpi] Finished writing ping response [rmtNodeId=00257274-13ec-45e2-bbc6-7e1e40c5d000, rmtAddr=/127.0.0.1:53617, rmtPort=53617] [21:08:15] : [Step 4/5] [2021-11-19 21:08:15,336][INFO ][tcp-disco-sock-reader-[]-#844%grid-1%-#16166%grid-1%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:53617, rmtPort=53617, rmtNodeId=null] [21:08:15] : [Step 4/5] [2021-11-19 21:08:15,336][INFO ][tcp-disco-sock-reader-[103d6c62 127.0.0.1:35669]-#843%grid-0%-#16165%grid-0%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:35669, rmtPort=35669, rmtNodeId=103d6c62-a27a-47dc-91cd-f77fd9df8001] [21:08:15] : [Step 4/5] [2021-11-19 21:08:15,351][INFO ][tcp-disco-msg-worker-[crd]-#827%grid-0%-#15893%grid-0%][TestTcpDiscoverySpi] New next node [newNext=TcpDiscoveryNode [id=103d6c62-a27a-47dc-91cd-f77fd9df8001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=0, intOrder=3, lastExchangeTime=1637345295328, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false]] [21:08:15] : [Step 4/5] [2021-11-19 21:08:15,352][INFO ][tcp-disco-srvr-[:47501]-#842%grid-1%-#16164%grid-1%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=34387] [21:08:15] : [Step 4/5] [2021-11-19 21:08:15,353][INFO ][tcp-disco-srvr-[:47501]-#842%grid-1%-#16164%grid-1%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=34387] [21:08:15] : [Step 4/5] [2021-11-19 21:08:15,353][INFO ][tcp-disco-sock-reader-[]-#845%grid-1%-#16167%grid-1%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:34387, rmtPort=34387] [21:08:15] : [Step 4/5] [2021-11-19 21:08:15,354][INFO ][tcp-disco-sock-reader-[00257274 127.0.0.1:34387]-#845%grid-1%-#16167%grid-1%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=00257274-13ec-45e2-bbc6-7e1e40c5d000, rmtAddr=/127.0.0.1:34387] [21:08:15] : [Step 4/5] [2021-11-19 21:08:15,359][INFO ][tcp-disco-msg-worker-[]-#841%grid-1%-#16163%grid-1%][TestTcpDiscoverySpi] New next node [newNext=TcpDiscoveryNode [id=00257274-13ec-45e2-bbc6-7e1e40c5d000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345295348, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false]] [21:08:15] : [Step 4/5] [2021-11-19 21:08:15,360][INFO ][tcp-disco-srvr-[:47500]-#828%grid-0%-#15894%grid-0%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=34833] [21:08:15] : [Step 4/5] [2021-11-19 21:08:15,361][INFO ][tcp-disco-srvr-[:47500]-#828%grid-0%-#15894%grid-0%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=34833] [21:08:15] : [Step 4/5] [2021-11-19 21:08:15,361][INFO ][tcp-disco-sock-reader-[]-#846%grid-0%-#16168%grid-0%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:34833, rmtPort=34833] [21:08:15] : [Step 4/5] [2021-11-19 21:08:15,362][INFO ][tcp-disco-sock-reader-[103d6c62 127.0.0.1:34833]-#846%grid-0%-#16168%grid-0%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=103d6c62-a27a-47dc-91cd-f77fd9df8001, rmtAddr=/127.0.0.1:34833] [21:08:15] : [Step 4/5] [2021-11-19 21:08:15,365][INFO ][disco-event-worker-#15896%grid-0%][GridDiscoveryManager] Added new node to topology: TcpDiscoveryNode [id=103d6c62-a27a-47dc-91cd-f77fd9df8001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=4, intOrder=3, lastExchangeTime=1637345295328, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false] [21:08:15] : [Step 4/5] [2021-11-19 21:08:15,366][INFO ][disco-event-worker-#15896%grid-0%][GridDiscoveryManager] Topology snapshot [ver=4, locNode=00257274, servers=2, clients=0, state=ACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=00257274-13ec-45e2-bbc6-7e1e40c5d000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=103d6c62-a27a-47dc-91cd-f77fd9df8001, consistentId=grid-1, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:08:15] : [Step 4/5] [2021-11-19 21:08:15,367][INFO ][disco-event-worker-#15896%grid-0%][GridDiscoveryManager] ^-- Baseline [id=0, size=2, online=2, offline=0] [21:08:15] : [Step 4/5] [2021-11-19 21:08:15,367][INFO ][exchange-worker-#15897%grid-0%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], crd=true, evt=NODE_JOINED, evtNode=103d6c62-a27a-47dc-91cd-f77fd9df8001, customEvt=null, allowMerge=true, exchangeFreeSwitch=false] [21:08:15] : [Step 4/5] [2021-11-19 21:08:15,368][INFO ][exchange-worker-#15897%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], waitTime=0ms, futInfo=NA, mode=DISTRIBUTED] [21:08:15] : [Step 4/5] [2021-11-19 21:08:15,369][INFO ][exchange-worker-#15897%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partitions release latch: ServerLatch [permits=0, pendingAcks=HashSet [], super=CompletableLatch [id=CompletableLatchUid [id=exchange, topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0]]]] [21:08:15] : [Step 4/5] [2021-11-19 21:08:15,369][INFO ][exchange-worker-#15897%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:08:15] : [Step 4/5] [2021-11-19 21:08:15,369][INFO ][tcp-disco-msg-worker-[00257274 127.0.0.1:47500]-#841%grid-1%-#16163%grid-1%][GridEncryptionManager] Skip group key received from coordinator. Already exists. [grp=1613773252, keyId=0] [21:08:15] : [Step 4/5] [2021-11-19 21:08:15,370][INFO ][exchange-worker-#15897%grid-0%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], crd=true] [21:08:15] : [Step 4/5] [2021-11-19 21:08:15,370][INFO ][disco-notifier-worker-#16162%grid-1%][MvccProcessorImpl] Assigned mvcc coordinator [crd=MvccCoordinator [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], nodeId=00257274-13ec-45e2-bbc6-7e1e40c5d000, ver=1637345286903, local=false, initialized=false]] [21:08:15] : [Step 4/5] [2021-11-19 21:08:15,372][INFO ][sys-#16157%grid-1%][ClusterProcessor] Writing cluster ID and tag to metastorage on ready for write ClusterIdAndTag [id=4a209f43-8915-4578-bd2a-92fe2e973f4a, tag=modest_volhard] [21:08:15] : [Step 4/5] [2021-11-19 21:08:15,386][INFO ][exchange-worker-#16171%grid-1%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], crd=false, evt=NODE_JOINED, evtNode=103d6c62-a27a-47dc-91cd-f77fd9df8001, customEvt=null, allowMerge=true, exchangeFreeSwitch=false] [21:08:15] : [Step 4/5] [2021-11-19 21:08:15,386][INFO ][exchange-worker-#16171%grid-1%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1 [21:08:15] : [Step 4/5] [2021-11-19 21:08:15,388][INFO ][exchange-worker-#16171%grid-1%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000000.wal, offset=644153, ver=2] [21:08:15] : [Step 4/5] [2021-11-19 21:08:15,391][INFO ][exchange-worker-#16171%grid-1%][GridClusterStateProcessor] Writing BaselineTopology[id=0] [21:08:15] : [Step 4/5] [2021-11-19 21:08:15,394][INFO ][exchange-worker-#16171%grid-1%][GridCacheDatabaseSharedManager] Finish recovery performed in 7 ms. [21:08:15] : [Step 4/5] [2021-11-19 21:08:15,395][INFO ][exchange-worker-#16171%grid-1%][msg] Components activation performed in 9 ms. [21:08:15] : [Step 4/5] [2021-11-19 21:08:15,396][INFO ][exchange-worker-#16171%grid-1%][GridCacheProcessor] Finished recovery for cache [cache=encrypted, grp=encrypted, startVer=AffinityTopologyVersion [topVer=4, minorTopVer=0]] [21:08:15] : [Step 4/5] [2021-11-19 21:08:15,396][INFO ][sys-#16141%grid-1%][GridCacheProcessor] Finished recovery for cache [cache=ignite-sys-cache, grp=ignite-sys-cache, startVer=AffinityTopologyVersion [topVer=4, minorTopVer=0]] [21:08:15] : [Step 4/5] [2021-11-19 21:08:15,397][INFO ][exchange-worker-#16171%grid-1%][GridCacheProcessor] Starting caches on local join performed in 0 ms. [21:08:15] : [Step 4/5] [2021-11-19 21:08:15,399][INFO ][exchange-worker-#16171%grid-1%][GridDhtPartitionsExchangeFuture] Skipped waiting for partitions release future (local node is joining) [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0]] [21:08:15] : [Step 4/5] [2021-11-19 21:08:15,411][INFO ][grid-nio-worker-tcp-comm-1-#15837%TestRecordingCommunicationSpi%][TestRecordingCommunicationSpi] Accepted incoming communication connection [locAddr=/127.0.0.1:47100, rmtAddr=/127.0.0.1:56286] [21:08:15] : [Step 4/5] [2021-11-19 21:08:15,413][INFO ][grid-nio-worker-tcp-comm-0-#16105%TestRecordingCommunicationSpi%][TestRecordingCommunicationSpi] Established outgoing communication connection [locAddr=/127.0.0.1:56286, rmtAddr=/127.0.0.1:47100] [21:08:15] : [Step 4/5] [2021-11-19 21:08:15,414][INFO ][db-checkpoint-thread-#16175%grid-1%][Checkpointer] Checkpoint started [checkpointId=0261b4e8-530c-46a1-bf20-34086bcf3d9f, startPtr=WALPointer [idx=0, fileOff=921016, len=11887], checkpointBeforeLockTime=6ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=1ms, checkpointLockHoldTime=2ms, walCpRecordFsyncDuration=4ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=0ms, pages=61, reason='node started'] [21:08:15] : [Step 4/5] [2021-11-19 21:08:15,414][INFO ][exchange-worker-#16171%grid-1%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], crd=false] [21:08:15] : [Step 4/5] [2021-11-19 21:08:15,415][INFO ][sys-#15868%grid-0%][GridDhtPartitionsExchangeFuture] Coordinator received single message [ver=AffinityTopologyVersion [topVer=4, minorTopVer=0], node=103d6c62-a27a-47dc-91cd-f77fd9df8001, allReceived=true] [21:08:15] : [Step 4/5] [2021-11-19 21:08:15,415][INFO ][sys-#15868%grid-0%][GridDhtPartitionsExchangeFuture] Coordinator received all messages, try merge [ver=AffinityTopologyVersion [topVer=4, minorTopVer=0]] [21:08:15] : [Step 4/5] [2021-11-19 21:08:15,416][INFO ][sys-#15868%grid-0%][GridDhtPartitionsExchangeFuture] finishExchangeOnCoordinator [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=0]] [21:08:15] : [Step 4/5] [2021-11-19 21:08:15,429][INFO ][sys-#15868%grid-0%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], err=null, rebalanced=false, wasRebalanced=true] [21:08:15] : [Step 4/5] [2021-11-19 21:08:15,432][INFO ][sys-#15868%grid-0%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=00257274-13ec-45e2-bbc6-7e1e40c5d000, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], evt=NODE_JOINED, evtNode=TcpDiscoveryNode [id=103d6c62-a27a-47dc-91cd-f77fd9df8001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=4, intOrder=3, lastExchangeTime=1637345295328, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=false, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0]] [21:08:15] : [Step 4/5] [2021-11-19 21:08:15,432][INFO ][sys-#16145%grid-1%][GridDhtPartitionsExchangeFuture] Received full message, will finish exchange [node=00257274-13ec-45e2-bbc6-7e1e40c5d000, resVer=AffinityTopologyVersion [topVer=4, minorTopVer=0]] [21:08:15] : [Step 4/5] [2021-11-19 21:08:15,432][INFO ][exchange-worker-#15897%grid-0%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=4, minorTopVer=0], force=false, evt=NODE_JOINED, node=103d6c62-a27a-47dc-91cd-f77fd9df8001] [21:08:15] : [Step 4/5] [2021-11-19 21:08:15,433][INFO ][sys-#15868%grid-0%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (0 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Wait partitions release latch [latch=exchange]" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="After states restored callback" (0 ms), stage="WAL history reservation" (0 ms), stage="Waiting for all single messages" (45 ms), stage="Exchanges merge" (0 ms), stage="Affinity recalculation (crd)" (3 ms), stage="Collect update counters and create affinity messages" (1 ms), stage="Assign partitions states" (2 ms), stage="Validate partitions states" (0 ms), stage="Apply update counters" (0 ms), stage="Full message preparing" (5 ms), stage="Full message sending" (0 ms), stage="Exchange done" (3 ms), stage="Total time" (59 ms), Discovery lag=4 ms, Latest started node id=103d6c62-a27a-47dc-91cd-f77fd9df8001] [21:08:15] : [Step 4/5] [2021-11-19 21:08:15,441][INFO ][sys-#15868%grid-0%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], stage="Affinity initialization (node join) [grp=encrypted, crd=true]" (2 ms) (parent=Affinity recalculation (crd)), stage="Affinity initialization (node join) [grp=ignite-sys-cache, crd=true]" (1 ms) (parent=Affinity recalculation (crd))] [21:08:15] : [Step 4/5] [2021-11-19 21:08:15,443][INFO ][sys-#16145%grid-1%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], err=null, rebalanced=false, wasRebalanced=false] [21:08:15] : [Step 4/5] [2021-11-19 21:08:15,446][INFO ][db-checkpoint-thread-#16175%grid-1%][Checkpointer] Checkpoint finished [cpId=0261b4e8-530c-46a1-bf20-34086bcf3d9f, pages=61, markPos=WALPointer [idx=0, fileOff=921016, len=11887], walSegmentsCovered=[], markDuration=8ms, pagesWrite=3ms, fsync=29ms, total=46ms] [21:08:15] : [Step 4/5] [2021-11-19 21:08:15,782][INFO ][sys-#16145%grid-1%][GridCacheProcessor] Finish proxy initialization, cacheName=ignite-sys-cache, localNodeId=103d6c62-a27a-47dc-91cd-f77fd9df8001 [21:08:15] : [Step 4/5] [2021-11-19 21:08:15,783][INFO ][sys-#16145%grid-1%][GridCacheProcessor] Finish proxy initialization, cacheName=encrypted, localNodeId=103d6c62-a27a-47dc-91cd-f77fd9df8001 [21:08:15] : [Step 4/5] [2021-11-19 21:08:15,783][INFO ][sys-#16145%grid-1%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=103d6c62-a27a-47dc-91cd-f77fd9df8001, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], evt=NODE_JOINED, evtNode=TcpDiscoveryNode [id=103d6c62-a27a-47dc-91cd-f77fd9df8001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=4, intOrder=3, lastExchangeTime=1637345295369, loc=true, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=false, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0]] [21:08:15] : [Step 4/5] [2021-11-19 21:08:15,796][INFO ][exchange-worker-#16171%grid-1%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=4, minorTopVer=0], force=false, evt=NODE_JOINED, node=103d6c62-a27a-47dc-91cd-f77fd9df8001] [21:08:15] : [Step 4/5] [2021-11-19 21:08:15,796][INFO ][sys-#16145%grid-1%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], stage="Waiting in exchange queue" (15 ms), stage="Exchange parameters initialization" (0 ms), stage="Components activation" (9 ms), stage="Determine exchange type" (3 ms), stage="Preloading notification" (0 ms), stage="Restore partition states" (0 ms), stage="After states restored callback" (8 ms), stage="WAL history reservation" (0 ms), stage="Waiting for Full message" (23 ms), stage="Affinity recalculation" (5 ms), stage="Full map updating" (5 ms), stage="Exchange done" (352 ms), stage="Total time" (420 ms)] [21:08:15] : [Step 4/5] [2021-11-19 21:08:15,798][INFO ][sys-#16145%grid-1%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], stage="Affinity fetch" (3 ms) (parent=Determine exchange type), stage="Restore partition states [grp=ignite-sys-cache]" (0 ms) (parent=Restore partition states), stage="Restore partition states [grp=encrypted]" (0 ms) (parent=Restore partition states), stage="Affinity initialization (local join) [grp=encrypted]" (5 ms) (parent=Affinity recalculation), stage="Affinity initialization (local join) [grp=ignite-sys-cache]" (3 ms) (parent=Affinity recalculation)] [21:08:15] : [Step 4/5] [2021-11-19 21:08:15,799][INFO ][exchange-worker-#15897%grid-0%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], crd=true, evt=DISCOVERY_CUSTOM_EVT, evtNode=00257274-13ec-45e2-bbc6-7e1e40c5d000, customEvt=CacheAffinityChangeMessage [id=61d5d593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], exchId=null, partsMsg=null, exchangeNeeded=true], allowMerge=false, exchangeFreeSwitch=false] [21:08:15] : [Step 4/5] [2021-11-19 21:08:15,802][INFO ][exchange-worker-#15897%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], waitTime=0ms, futInfo=NA, mode=DISTRIBUTED] [21:08:15] : [Step 4/5] [2021-11-19 21:08:15,817][INFO ][exchange-worker-#16171%grid-1%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], crd=false, evt=DISCOVERY_CUSTOM_EVT, evtNode=00257274-13ec-45e2-bbc6-7e1e40c5d000, customEvt=CacheAffinityChangeMessage [id=61d5d593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], exchId=null, partsMsg=null, exchangeNeeded=true], allowMerge=false, exchangeFreeSwitch=false] [21:08:15] : [Step 4/5] [2021-11-19 21:08:15,817][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] To start Console Management & Monitoring run ignitevisorcmd.{sh|bat} [21:08:15] : [Step 4/5] [2021-11-19 21:08:15,818][INFO ][exchange-worker-#16171%grid-1%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], waitTime=0ms, futInfo=NA, mode=DISTRIBUTED] [21:08:15] : [Step 4/5] [2021-11-19 21:08:15,818][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] [21:08:15] : [Step 4/5] [21:08:15] : [Step 4/5] >>> +-------------------------------------------+ [21:08:15] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:08:15] : [Step 4/5] >>> +-------------------------------------------+ [21:08:15] : [Step 4/5] >>> OS name: Linux 4.15.0-151-generic amd64 [21:08:15] : [Step 4/5] >>> CPU(s): 24 [21:08:15] : [Step 4/5] >>> Heap: 2.0GB [21:08:15] : [Step 4/5] >>> VM name: 16724@c4dfe9a430b2 [21:08:15] : [Step 4/5] >>> Ignite instance name: grid-1 [21:08:15] : [Step 4/5] >>> Local node [ID=103D6C62-A27A-47DC-91CD-F77FD9DF8001, order=4, clientMode=false] [21:08:15] : [Step 4/5] >>> Local node addresses: [127.0.0.1] [21:08:15] : [Step 4/5] >>> Local ports: TCP:10801 TCP:47101 TCP:47501 [21:08:15] : [Step 4/5] [21:08:15] : [Step 4/5] [2021-11-19 21:08:15,819][INFO ][exchange-worker-#15897%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partitions release latch: ServerLatch [permits=0, pendingAcks=HashSet [], super=CompletableLatch [id=CompletableLatchUid [id=exchange, topVer=AffinityTopologyVersion [topVer=4, minorTopVer=1]]]] [21:08:15] : [Step 4/5] [2021-11-19 21:08:15,820][INFO ][exchange-worker-#16171%grid-1%][GridDhtPartitionsExchangeFuture] Finished waiting for partitions release latch: ClientLatch [coordinator=TcpDiscoveryNode [id=00257274-13ec-45e2-bbc6-7e1e40c5d000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345295348, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], ackSent=true, super=CompletableLatch [id=CompletableLatchUid [id=exchange, topVer=AffinityTopologyVersion [topVer=4, minorTopVer=1]]]] [21:08:15] : [Step 4/5] [2021-11-19 21:08:15,820][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][GridDiscoveryManager] Topology snapshot [ver=4, locNode=103d6c62, servers=2, clients=0, state=ACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=00257274-13ec-45e2-bbc6-7e1e40c5d000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=103d6c62-a27a-47dc-91cd-f77fd9df8001, consistentId=grid-1, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:08:15] : [Step 4/5] [2021-11-19 21:08:15,821][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][GridDiscoveryManager] ^-- Baseline [id=0, size=2, online=2, offline=0] [21:08:15] : [Step 4/5] [2021-11-19 21:08:15,821][INFO ][exchange-worker-#16171%grid-1%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:08:15] : [Step 4/5] [2021-11-19 21:08:15,820][INFO ][exchange-worker-#15897%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:08:15] : [Step 4/5] [2021-11-19 21:08:15,822][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][G] Node started : [stage="Configure system pool" (0 ms),stage="Start managers" (225 ms),stage="Configure binary metadata" (3 ms),stage="Start processors" (22 ms),stage="Start 'StanByClusterTestProvider' plugin" (0 ms),stage="Start 'PageMemory tracker plugin' plugin" (0 ms),stage="Start 'TestDistibutedConfigurationPlugin' plugin" (0 ms),stage="Start 'NodeValidationPluginProvider' plugin" (0 ms),stage="Init metastore" (624 ms),stage="Init and start regions" (6 ms),stage="Restore binary memory" (659 ms),stage="Restore logical state" (134 ms),stage="Finish recovery" (509 ms),stage="Join topology" (51 ms),stage="Await transition" (2 ms),stage="Await exchange" (448 ms),stage="Total time" (2683 ms)] [21:08:15] : [Step 4/5] [2021-11-19 21:08:15,823][INFO ][exchange-worker-#16171%grid-1%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], crd=false] [21:08:15] : [Step 4/5] [2021-11-19 21:08:15,823][INFO ][exchange-worker-#15897%grid-0%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], crd=true] [21:08:15] : [Step 4/5] [2021-11-19 21:08:15,824][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][root] Node started with the following configuration [id=103d6c62-a27a-47dc-91cd-f77fd9df8001, marshaller=BinaryMarshaller [], discovery=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=5000, ackTimeout=5000, marsh=JdkMarshaller [clsFilter=org.apache.ignite.marshaller.MarshallerUtils$1@1df48869], reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], binaryCfg=null, lateAff=true] [21:08:15] : [Step 4/5] [2021-11-19 21:08:15,824][INFO ][sys-#15891%grid-0%][GridDhtPartitionsExchangeFuture] Coordinator received single message [ver=AffinityTopologyVersion [topVer=4, minorTopVer=1], node=103d6c62-a27a-47dc-91cd-f77fd9df8001, allReceived=true] [21:08:15] : [Step 4/5] [2021-11-19 21:08:15,826][INFO ][sys-#15891%grid-0%][GridDhtPartitionsExchangeFuture] finishExchangeOnCoordinator [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=1]] [21:08:15] : [Step 4/5] [2021-11-19 21:08:15,831][INFO ][sys-#15891%grid-0%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], err=null, rebalanced=true, wasRebalanced=false] [21:08:15] : [Step 4/5] [2021-11-19 21:08:15,833][INFO ][sys-#16157%grid-1%][GridDhtPartitionsExchangeFuture] Received full message, will finish exchange [node=00257274-13ec-45e2-bbc6-7e1e40c5d000, resVer=AffinityTopologyVersion [topVer=4, minorTopVer=1]] [21:08:15] : [Step 4/5] [2021-11-19 21:08:15,833][INFO ][sys-#15891%grid-0%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=00257274-13ec-45e2-bbc6-7e1e40c5d000, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=00257274-13ec-45e2-bbc6-7e1e40c5d000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345295825, loc=true, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=4, minorTopVer=1]] [21:08:15] : [Step 4/5] [2021-11-19 21:08:15,837][INFO ][exchange-worker-#15897%grid-0%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=4, minorTopVer=1], force=false, evt=DISCOVERY_CUSTOM_EVT, node=00257274-13ec-45e2-bbc6-7e1e40c5d000] [21:08:15] : [Step 4/5] [2021-11-19 21:08:15,838][INFO ][sys-#16157%grid-1%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], err=null, rebalanced=true, wasRebalanced=false] [21:08:15] : [Step 4/5] [2021-11-19 21:08:15,838][INFO ][sys-#15891%grid-0%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (1 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Wait partitions release latch [latch=exchange]" (17 ms), stage="Wait partitions release [latch=exchange]" (2 ms), stage="After states restored callback" (0 ms), stage="WAL history reservation" (0 ms), stage="Waiting for all single messages" (2 ms), stage="Affinity recalculation (crd)" (0 ms), stage="Collect update counters and create affinity messages" (0 ms), stage="Validate partitions states" (0 ms), stage="Apply update counters" (0 ms), stage="Full message preparing" (3 ms), stage="Full message sending" (0 ms), stage="Exchange done" (6 ms), stage="Total time" (31 ms), Discovery lag=17 ms, Latest started node id=103d6c62-a27a-47dc-91cd-f77fd9df8001] [21:08:15] : [Step 4/5] [2021-11-19 21:08:15,840][INFO ][exchange-worker-#16171%grid-1%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=4, minorTopVer=1], force=false, evt=DISCOVERY_CUSTOM_EVT, node=00257274-13ec-45e2-bbc6-7e1e40c5d000] [21:08:15] : [Step 4/5] [2021-11-19 21:08:15,839][INFO ][sys-#16157%grid-1%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=103d6c62-a27a-47dc-91cd-f77fd9df8001, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=00257274-13ec-45e2-bbc6-7e1e40c5d000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345295348, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=4, minorTopVer=1]] [21:08:15] : [Step 4/5] [2021-11-19 21:08:15,839][INFO ][exchange-worker-#15897%grid-0%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=2], crd=true, evt=DISCOVERY_CUSTOM_EVT, evtNode=00257274-13ec-45e2-bbc6-7e1e40c5d000, customEvt=DynamicCacheChangeBatch [id=72d5d593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqs=ArrayList [DynamicCacheChangeRequest [cacheName=encrypted, hasCfg=false, nodeId=00257274-13ec-45e2-bbc6-7e1e40c5d000, clientStartOnly=false, stop=false, destroy=false, disabledAfterStart=false]], exchangeActions=ExchangeActions [startCaches=null, stopCaches=null, startGrps=[], stopGrps=[], resetParts=[encrypted], stateChangeRequest=null], startCaches=false], allowMerge=false, exchangeFreeSwitch=false] [21:08:15] : [Step 4/5] [2021-11-19 21:08:15,842][INFO ][sys-#16157%grid-1%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (0 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Wait partitions release latch [latch=exchange]" (2 ms), stage="Wait partitions release [latch=exchange]" (1 ms), stage="After states restored callback" (0 ms), stage="WAL history reservation" (0 ms), stage="Waiting for Full message" (10 ms), stage="Affinity recalculation" (0 ms), stage="Full map updating" (5 ms), stage="Exchange done" (4 ms), stage="Total time" (22 ms)] [21:08:15] : [Step 4/5] [2021-11-19 21:08:15,845][INFO ][sys-#16157%grid-1%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], stage="Affinity change by custom message [grp=ignite-sys-cache]" (0 ms) (parent=Determine exchange type)] [21:08:15] : [Step 4/5] [2021-11-19 21:08:15,841][INFO ][exchange-worker-#16171%grid-1%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=2], crd=false, evt=DISCOVERY_CUSTOM_EVT, evtNode=00257274-13ec-45e2-bbc6-7e1e40c5d000, customEvt=DynamicCacheChangeBatch [id=72d5d593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqs=ArrayList [DynamicCacheChangeRequest [cacheName=encrypted, hasCfg=false, nodeId=00257274-13ec-45e2-bbc6-7e1e40c5d000, clientStartOnly=false, stop=false, destroy=false, disabledAfterStart=false]], exchangeActions=ExchangeActions [startCaches=null, stopCaches=null, startGrps=[], stopGrps=[], resetParts=[encrypted], stateChangeRequest=null], startCaches=false], allowMerge=false, exchangeFreeSwitch=false] [21:08:15] : [Step 4/5] [2021-11-19 21:08:15,841][INFO ][sys-#15891%grid-0%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], stage="Affinity change by custom message [grp=ignite-sys-cache]" (0 ms) (parent=Determine exchange type)] [21:08:15]W: [org.apache.ignite:ignite-core] [2021-11-19 21:08:15,845][WARN ][sys-#15877%grid-0%][CacheAffinitySharedManager] Cache group 'encrypted' brings high overhead for its metainformation in data region 'default'. Metainformation required for its partitions (502 partitions, 4096 bytes per partition, 1 MBs total) will consume more than 15% of data region memory (10 MBs). It may lead to critical errors on the node and cluster instability. Please reduce number of partitions, add more memory to the data region or add more server nodes for this cache group. [21:08:15]W: [org.apache.ignite:ignite-core] [2021-11-19 21:08:15,848][WARN ][exchange-worker-#16171%grid-1%][CacheAffinitySharedManager] Cache group 'encrypted' brings high overhead for its metainformation in data region 'default'. Metainformation required for its partitions (522 partitions, 4096 bytes per partition, 2 MBs total) will consume more than 15% of data region memory (10 MBs). It may lead to critical errors on the node and cluster instability. Please reduce number of partitions, add more memory to the data region or add more server nodes for this cache group. [21:08:15] : [Step 4/5] [2021-11-19 21:08:15,848][INFO ][exchange-worker-#15897%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=2], waitTime=0ms, futInfo=NA, mode=DISTRIBUTED] [21:08:15] : [Step 4/5] [2021-11-19 21:08:15,849][INFO ][exchange-worker-#16171%grid-1%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=2], waitTime=0ms, futInfo=NA, mode=DISTRIBUTED] [21:08:15] : [Step 4/5] [2021-11-19 21:08:15,851][INFO ][exchange-worker-#15897%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partitions release latch: ServerLatch [permits=0, pendingAcks=HashSet [], super=CompletableLatch [id=CompletableLatchUid [id=exchange, topVer=AffinityTopologyVersion [topVer=4, minorTopVer=2]]]] [21:08:15] : [Step 4/5] [2021-11-19 21:08:15,851][INFO ][exchange-worker-#15897%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=2], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:08:15] : [Step 4/5] [2021-11-19 21:08:15,851][INFO ][exchange-worker-#16171%grid-1%][GridDhtPartitionsExchangeFuture] Finished waiting for partitions release latch: ClientLatch [coordinator=TcpDiscoveryNode [id=00257274-13ec-45e2-bbc6-7e1e40c5d000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345295348, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], ackSent=true, super=CompletableLatch [id=CompletableLatchUid [id=exchange, topVer=AffinityTopologyVersion [topVer=4, minorTopVer=2]]]] [21:08:15] : [Step 4/5] [2021-11-19 21:08:15,853][INFO ][exchange-worker-#16171%grid-1%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=2], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:08:15] : [Step 4/5] [2021-11-19 21:08:15,853][INFO ][exchange-worker-#15897%grid-0%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=2], crd=true] [21:08:15] : [Step 4/5] [2021-11-19 21:08:15,872][INFO ][exchange-worker-#16171%grid-1%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=2], crd=false] [21:08:15] : [Step 4/5] [2021-11-19 21:08:15,872][INFO ][sys-#15886%grid-0%][GridDhtPartitionsExchangeFuture] Coordinator received single message [ver=AffinityTopologyVersion [topVer=4, minorTopVer=2], node=103d6c62-a27a-47dc-91cd-f77fd9df8001, allReceived=true] [21:08:15] : [Step 4/5] [2021-11-19 21:08:15,873][INFO ][sys-#15886%grid-0%][GridDhtPartitionsExchangeFuture] finishExchangeOnCoordinator [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=2]] [21:08:15] : [Step 4/5] [2021-11-19 21:08:15,880][INFO ][sys-#15886%grid-0%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=4, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=2], err=null, rebalanced=true, wasRebalanced=true] [21:08:15] : [Step 4/5] [2021-11-19 21:08:15,881][INFO ][sys-#16142%grid-1%][GridDhtPartitionsExchangeFuture] Received full message, will finish exchange [node=00257274-13ec-45e2-bbc6-7e1e40c5d000, resVer=AffinityTopologyVersion [topVer=4, minorTopVer=2]] [21:08:15] : [Step 4/5] [2021-11-19 21:08:15,882][INFO ][sys-#15886%grid-0%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=00257274-13ec-45e2-bbc6-7e1e40c5d000, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=2], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=00257274-13ec-45e2-bbc6-7e1e40c5d000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345295825, loc=true, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=4, minorTopVer=2]] [21:08:15] : [Step 4/5] [2021-11-19 21:08:15,885][INFO ][sys-#16142%grid-1%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=4, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=2], err=null, rebalanced=true, wasRebalanced=true] [21:08:15] : [Step 4/5] [2021-11-19 21:08:15,884][INFO ][exchange-worker-#15897%grid-0%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=4, minorTopVer=2], force=false, evt=DISCOVERY_CUSTOM_EVT, node=00257274-13ec-45e2-bbc6-7e1e40c5d000] [21:08:15] : [Step 4/5] [2021-11-19 21:08:15,885][INFO ][sys-#15886%grid-0%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=4, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=2], stage="Waiting in exchange queue" (6 ms), stage="Exchange parameters initialization" (5 ms), stage="Update caches registry" (0 ms), stage="Start caches" (0 ms), stage="Affinity initialization on cache group start" (0 ms), stage="Determine exchange type" (4 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (1 ms), stage="Wait partitions release latch [latch=exchange]" (1 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="After states restored callback" (1 ms), stage="WAL history reservation" (0 ms), stage="Waiting for all single messages" (19 ms), stage="Affinity recalculation (crd)" (0 ms), stage="Collect update counters and create affinity messages" (0 ms), stage="Assign partitions states" (1 ms), stage="Validate partitions states" (0 ms), stage="Ideal affinity diff calculation (enforced)" (2 ms), stage="Apply update counters" (0 ms), stage="Full message preparing" (2 ms), stage="Full message sending" (0 ms), stage="Exchange done" (5 ms), stage="Total time" (47 ms), Discovery lag=1 ms, Latest started node id=103d6c62-a27a-47dc-91cd-f77fd9df8001] [21:08:15] : [Step 4/5] [2021-11-19 21:08:15,891][INFO ][sys-#15886%grid-0%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=4, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=2], stage="Affinity centralized initialization (crd) [grp=ignite-sys-cache, crd=true]" (0 ms) (parent=Determine exchange type), stage="Affinity centralized initialization (crd) [grp=encrypted, crd=true]" (0 ms) (parent=Determine exchange type), stage="Affinity recalculation (partitions availability) [grp=encrypted]" (2 ms) (parent=Ideal affinity diff calculation (enforced)), stage="Affinity recalculation (partitions availability) [grp=ignite-sys-cache]" (0 ms) (parent=Ideal affinity diff calculation (enforced))] [21:08:15] : [Step 4/5] [2021-11-19 21:08:15,887][INFO ][exchange-worker-#16171%grid-1%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=4, minorTopVer=2], force=false, evt=DISCOVERY_CUSTOM_EVT, node=00257274-13ec-45e2-bbc6-7e1e40c5d000] [21:08:15] : [Step 4/5] [2021-11-19 21:08:15,887][INFO ][sys-#16142%grid-1%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=103d6c62-a27a-47dc-91cd-f77fd9df8001, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=2], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=00257274-13ec-45e2-bbc6-7e1e40c5d000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345295348, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=4, minorTopVer=2]] [21:08:15] : [Step 4/5] [2021-11-19 21:08:15,894][INFO ][sys-#16142%grid-1%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=4, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=2], stage="Waiting in exchange queue" (9 ms), stage="Exchange parameters initialization" (5 ms), stage="Update caches registry" (0 ms), stage="Start caches" (0 ms), stage="Affinity initialization on cache group start" (0 ms), stage="Determine exchange type" (2 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Wait partitions release latch [latch=exchange]" (2 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="After states restored callback" (0 ms), stage="WAL history reservation" (0 ms), stage="Waiting for Full message" (27 ms), stage="Affinity recalculation" (0 ms), stage="Full map updating" (3 ms), stage="Exchange done" (9 ms), stage="Total time" (57 ms)] [21:08:15] : [Step 4/5] [2021-11-19 21:08:15,896][INFO ][sys-#16142%grid-1%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=4, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=2], stage="Affinity centralized initialization (crd) [grp=ignite-sys-cache, crd=false]" (0 ms) (parent=Determine exchange type), stage="Affinity centralized initialization (crd) [grp=encrypted, crd=false]" (0 ms) (parent=Determine exchange type), stage="Affinity applying from full message [grp=ignite-sys-cache]" (0 ms) (parent=Affinity recalculation), stage="Affinity applying from full message [grp=encrypted]" (0 ms) (parent=Affinity recalculation)] [21:08:15] : [Step 4/5] [2021-11-19 21:08:15,917][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][root] >>> Stopping grid [name=grid-1, id=103d6c62-a27a-47dc-91cd-f77fd9df8001] [21:08:15] : [Step 4/5] [2021-11-19 21:08:15,926][INFO ][db-checkpoint-thread-#16175%grid-1%][Checkpointer] Skipping checkpoint (no pages were modified) [checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=1ms, checkpointLockHoldTime=2ms, reason='timeout'] [21:08:15] : [Step 4/5] [2021-11-19 21:08:15,933][INFO ][tcp-disco-sock-reader-[00257274 127.0.0.1:34387]-#845%grid-1%-#16167%grid-1%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:34387, rmtPort=34387, rmtNodeId=00257274-13ec-45e2-bbc6-7e1e40c5d000] [21:08:15] : [Step 4/5] [2021-11-19 21:08:15,933][INFO ][disco-event-worker-#15896%grid-0%][GridDiscoveryManager] Node left topology: TcpDiscoveryNode [id=103d6c62-a27a-47dc-91cd-f77fd9df8001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=4, intOrder=3, lastExchangeTime=1637345295328, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false] [21:08:15] : [Step 4/5] [2021-11-19 21:08:15,936][INFO ][disco-event-worker-#15896%grid-0%][GridDiscoveryManager] Topology snapshot [ver=5, locNode=00257274, servers=1, clients=0, state=ACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=00257274-13ec-45e2-bbc6-7e1e40c5d000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:08:15] : [Step 4/5] [2021-11-19 21:08:15,936][INFO ][disco-event-worker-#15896%grid-0%][GridDiscoveryManager] ^-- Baseline [id=0, size=2, online=1, offline=1] [21:08:15] : [Step 4/5] [2021-11-19 21:08:15,938][INFO ][exchange-worker-#15897%grid-0%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], crd=true, evt=NODE_LEFT, evtNode=103d6c62-a27a-47dc-91cd-f77fd9df8001, customEvt=null, allowMerge=false, exchangeFreeSwitch=true] [21:08:15] : [Step 4/5] [2021-11-19 21:08:15,939][INFO ][exchange-worker-#15897%grid-0%][GridAffinityAssignmentCache] Local node affinity assignment distribution is not ideal [cache=encrypted, expectedPrimary=1024.00, actualPrimary=502, expectedBackups=0.00, actualBackups=0, warningThreshold=50.00%] [21:08:15] : [Step 4/5] [2021-11-19 21:08:15,939][INFO ][exchange-worker-#15897%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:08:15] : [Step 4/5] [2021-11-19 21:08:15,941][INFO ][exchange-worker-#15897%grid-0%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], err=null, rebalanced=true, wasRebalanced=true] [21:08:15]W: [org.apache.ignite:ignite-core] [2021-11-19 21:08:15,942][WARN ][exchange-worker-#15897%grid-0%][GridDhtPartitionTopologyImpl] Detected lost partitions [grp=encrypted, parts=[0, 2, 4, 6-7, 10-11, 14, 17, 21, 24-30, 32, 37, 40, 44, 47-52, 54, 57, 59, 62-64, 67-68, 74-75, 78, 81, 87-88, 91, 97, 99, 101-102, 104-107, 113-114, 116, 118, 120, 122, 124, 135-136, 138, 140-145, 147, 149-152, 154-156, 159-160, 162-164, 169, 172, 175-177, 180, 184-187, 190-191, 194, 196-202, 204-205, 209-210, 212, 214, 216, 219-224, 226, 229-232, 237, 239, 241, 243-245, 247, 249-251, 255, 257, 261, 265, 269, 272-273, 276-277, 281-282, 285, 287, 289-291, 293-297, 299, 301-304, 306, 308-309, 311-312, 315-317, 319, 322, 325-326, 328-330, 336, 339, 341, 344-346, 350, 352-354, 357-361, 363, 366-367, 371-373, 376-380, 383, 385, 387-388, 390, 392, 395-397, 400, 402, 405, 408-411, 416, 420, 422, 424-425, 429, 433, 435-438, 440-441, 445-446, 450, 452-453, 455-456, 458, 460, 462-463, 465-468, 470, 474-475, 480, 488, 490-492, 495, 497, 499-512, 516, 525, 527-531, 535, 537-538, 541-542, 545-546, 548-552, 554-555, 558, 562-564, 567-569, 572, 574, 579-580, 582-585, 587, 590-591, 594, 596, 600, 602, 604, 607-614, 617-620, 623-624, 627-629, 632-633, 636, 638, 640-642, 645-646, 648-649, 657-662, 664-665, 668-672, 677-678, 682-684, 686, 689, 692-693, 695-697, 699, 706-707, 709-710, 712-714, 716-717, 719-721, 723-728, 730-732, 734-735, 739, 742, 746, 749-750, 752, 754, 756, 762, 768-770, 772-775, 778, 780, 783-787, 789-791, 793, 796, 798-801, 803, 806, 809-812, 814, 816-817, 819, 822-825, 827-829, 832-833, 836-837, 839-840, 846, 848-851, 853-854, 857-858, 860, 863-864, 866, 868-871, 873-875, 877-878, 884, 888-889, 896-897, 900, 905-907, 914-915, 917, 919-920, 923-925, 931-933, 936, 940, 942, 944-945, 948, 950-951, 954, 956-958, 962, 965-970, 972, 975-976, 978-980, 983, 985, 988, 990, 993-994, 997-998, 1000, 1003-1004, 1007, 1009, 1014, 1016, 1018-1019], topVer=AffinityTopologyVersion [topVer=5, minorTopVer=0]] [21:08:15] : [Step 4/5] [2021-11-19 21:08:15,947][INFO ][exchange-worker-#15897%grid-0%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=00257274-13ec-45e2-bbc6-7e1e40c5d000, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], evt=NODE_LEFT, evtNode=TcpDiscoveryNode [id=103d6c62-a27a-47dc-91cd-f77fd9df8001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=4, intOrder=3, lastExchangeTime=1637345295328, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=5, minorTopVer=0]] [21:08:15] : [Step 4/5] [2021-11-19 21:08:15,948][INFO ][exchange-worker-#15897%grid-0%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (0 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="After states restored callback" (0 ms), stage="WAL history reservation" (0 ms), stage="Finalize update counters" (0 ms), stage="Detect lost partitions" (5 ms), stage="Exchange done" (1 ms), stage="Total time" (6 ms)] [21:08:15] : [Step 4/5] [2021-11-19 21:08:15,948][INFO ][exchange-worker-#15897%grid-0%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], stage="Affinity initialization (exchange-free switch on fully-rebalanced topology) [grp=ignite-sys-cache]" (0 ms) (parent=Determine exchange type), stage="Affinity initialization (exchange-free switch on fully-rebalanced topology) [grp=encrypted]" (0 ms) (parent=Determine exchange type)] [21:08:15] : [Step 4/5] [2021-11-19 21:08:15,949][INFO ][exchange-worker-#15897%grid-0%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], crd=true] [21:08:15] : [Step 4/5] [2021-11-19 21:08:15,950][INFO ][exchange-worker-#15897%grid-0%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=5, minorTopVer=0], force=false, evt=NODE_LEFT, node=103d6c62-a27a-47dc-91cd-f77fd9df8001] [21:08:16] : [Step 4/5] [2021-11-19 21:08:16,086][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][GridCacheProcessor] Stopped cache [cacheName=encrypted] [21:08:16] : [Step 4/5] [2021-11-19 21:08:16,086][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][GridCacheProcessor] Stopped cache [cacheName=ignite-sys-cache] [21:08:16] : [Step 4/5] [2021-11-19 21:08:16,484][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][FilePageStoreManager] Cleanup cache stores [total=4, left=0, cleanFiles=false] [21:08:16] : [Step 4/5] [2021-11-19 21:08:16,486][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][GridDeploymentLocalStore] Removed undeployed class: GridDeployment [ts=1637345295430, depMode=SHARED, clsLdr=IsolatedClassLoader{roleName='test'}, clsLdrId=41d5d593d71-103d6c62-a27a-47dc-91cd-f77fd9df8001, userVer=0, loc=true, sampleClsName=org.apache.ignite.internal.processors.cache.distributed.dht.preloader.IgniteDhtPartitionCountersMap2, pendingUndeploy=false, undeployed=true, usage=0] [21:08:16] : [Step 4/5] [2021-11-19 21:08:16,493][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] [21:08:16] : [Step 4/5] [21:08:16] : [Step 4/5] >>> +------------------------------------------------------+ [21:08:16] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV stopped OK [21:08:16] : [Step 4/5] >>> +------------------------------------------------------+ [21:08:16] : [Step 4/5] >>> Ignite instance name: grid-1 [21:08:16] : [Step 4/5] >>> Grid uptime: 00:00:00.672 [21:08:16] : [Step 4/5] [21:08:16] : [Step 4/5] [21:08:16]W: [org.apache.ignite:ignite-core] [2021-11-19 21:08:16,499][WARN ][test-runner-#15781%encryption.MasterKeyChangeTest%][G] Ignite work directory is not provided, automatically resolved to: /opt/buildagent/work/7bc1c54bc719b67c/work [21:08:16] : [Step 4/5] [2021-11-19 21:08:16,500][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] [21:08:16] : [Step 4/5] [21:08:16] : [Step 4/5] >>> __________ ________________ [21:08:16] : [Step 4/5] >>> / _/ ___/ |/ / _/_ __/ __/ [21:08:16] : [Step 4/5] >>> _/ // (7 7 // / / / / _/ [21:08:16] : [Step 4/5] >>> /___/\___/_/|_/___/ /_/ /___/ [21:08:16] : [Step 4/5] >>> [21:08:16] : [Step 4/5] >>> ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:08:16] : [Step 4/5] >>> 2021 Copyright(C) Apache Software Foundation [21:08:16] : [Step 4/5] >>> [21:08:16] : [Step 4/5] >>> Ignite documentation: http://ignite.apache.org [21:08:16] : [Step 4/5] [21:08:16] : [Step 4/5] [2021-11-19 21:08:16,501][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] Config URL: n/a [21:08:16] : [Step 4/5] [2021-11-19 21:08:16,501][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] IgniteConfiguration [igniteInstanceName=grid-1, pubPoolSize=24, svcPoolSize=24, callbackPoolSize=24, stripedPoolSize=24, sysPoolSize=24, mgmtPoolSize=4, dataStreamerPoolSize=24, utilityCachePoolSize=24, utilityCacheKeepAliveTime=60000, p2pPoolSize=2, qryPoolSize=24, buildIdxPoolSize=4, igniteHome=/opt/buildagent/work/7bc1c54bc719b67c, igniteWorkDir=/opt/buildagent/work/7bc1c54bc719b67c/work, mbeanSrv=com.sun.jmx.mbeanserver.JmxMBeanServer@6fe85038, nodeId=10868445-2bda-42f9-b43a-7b1d2bdfc001, marsh=BinaryMarshaller [], marshLocJobs=false, daemon=false, p2pEnabled=true, netTimeout=10000, netCompressionLevel=1, sndRetryDelay=1000, sndRetryCnt=3, metricsHistSize=10000, metricsUpdateFreq=1000, metricsExpTime=9223372036854775807, discoSpi=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=0, ackTimeout=0, marsh=null, reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], segPlc=STOP, segResolveAttempts=2, waitForSegOnStart=true, allResolversPassReq=true, segChkFreq=10000, commSpi=TcpCommunicationSpi [connectGate=org.apache.ignite.spi.communication.tcp.internal.ConnectGateway@6d0e7f14, ctxInitLatch=java.util.concurrent.CountDownLatch@5026423e[Count = 1], stopping=false, clientPool=null, nioSrvWrapper=null, stateProvider=null], evtSpi=MemoryEventStorageSpi [expireAgeMs=9223372036854775807, expireCnt=10000, filter=null], colSpi=NoopCollisionSpi [], deploySpi=LocalDeploymentSpi [], indexingSpi=org.apache.ignite.spi.indexing.noop.NoopIndexingSpi@669cad26, addrRslvr=null, encryptionSpi=org.apache.ignite.spi.encryption.keystore.KeystoreEncryptionSpi@4b3152f0, tracingSpi=org.apache.ignite.spi.tracing.NoopTracingSpi@59970dc8, clientMode=false, rebalanceThreadPoolSize=4, rebalanceTimeout=10000, rebalanceBatchesPrefetchCnt=3, rebalanceThrottle=0, rebalanceBatchSize=524288, txCfg=TransactionConfiguration [txSerEnabled=false, dfltIsolation=REPEATABLE_READ, dfltConcurrency=PESSIMISTIC, dfltTxTimeout=0, txTimeoutOnPartitionMapExchange=0, deadlockTimeout=10000, pessimisticTxLogSize=0, pessimisticTxLogLinger=10000, tmLookupClsName=null, txManagerFactory=null, useJtaSync=false], cacheSanityCheckEnabled=true, discoStartupDelay=60000, deployMode=SHARED, p2pMissedCacheSize=100, locHost=127.0.0.1, timeSrvPortBase=31100, timeSrvPortRange=100, failureDetectionTimeout=10000, sysWorkerBlockedTimeout=null, clientFailureDetectionTimeout=10000, metricsLogFreq=0, connectorCfg=null, odbcCfg=null, warmupClos=null, atomicCfg=AtomicConfiguration [seqReserveSize=1000, cacheMode=PARTITIONED, backups=1, aff=null, grpName=null], classLdr=null, sslCtxFactory=null, platformCfg=null, binaryCfg=null, memCfg=null, pstCfg=null, dsCfg=DataStorageConfiguration [sysRegionInitSize=41943040, sysRegionMaxSize=104857600, pageSize=4096, concLvl=0, dfltDataRegConf=DataRegionConfiguration [name=default, maxSize=10485760, initSize=268435456, swapPath=null, pageEvictionMode=DISABLED, pageReplacementMode=CLOCK, evictionThreshold=0.9, emptyPagesPoolSize=100, metricsEnabled=false, metricsSubIntervalCount=5, metricsRateTimeInterval=60000, persistenceEnabled=true, checkpointPageBufSize=0, lazyMemoryAllocation=true, warmUpCfg=null], dataRegions=null, storagePath=null, checkpointFreq=180000, lockWaitTime=10000, checkpointThreads=4, checkpointWriteOrder=SEQUENTIAL, walHistSize=20, maxWalArchiveSize=1073741824, walSegments=10, walSegmentSize=67108864, walPath=db/wal, walArchivePath=db/wal/archive, cdcWalPath=db/wal/cdc, cdcEnabled=false, metricsEnabled=false, walMode=FSYNC, walTlbSize=131072, walBuffSize=0, walFlushFreq=2000, walFsyncDelay=1000, walRecordIterBuffSize=67108864, alwaysWriteFullPages=false, fileIOFactory=org.apache.ignite.internal.processors.cache.persistence.file.AsyncFileIOFactory@48d04801, metricsSubIntervalCnt=5, metricsRateTimeInterval=60000, walAutoArchiveAfterInactivity=-1, walForceArchiveTimeout=-1, writeThrottlingEnabled=false, walCompactionEnabled=false, walCompactionLevel=1, checkpointReadLockTimeout=null, walPageCompression=DISABLED, walPageCompressionLevel=null, dfltWarmUpCfg=null, encCfg=org.apache.ignite.configuration.EncryptionConfiguration@2302eccc, defragmentationThreadPoolSize=4, minWalArchiveSize=-1], snapshotPath=snapshots, activeOnStart=true, activeOnStartPropSetFlag=false, autoActivation=true, autoActivationPropSetFlag=false, clusterStateOnStart=null, sqlConnCfg=null, cliConnCfg=ClientConnectorConfiguration [host=null, port=10800, portRange=100, sockSndBufSize=0, sockRcvBufSize=0, tcpNoDelay=true, maxOpenCursorsPerConn=128, threadPoolSize=24, selectorCnt=12, idleTimeout=0, handshakeTimeout=10000, jdbcEnabled=true, odbcEnabled=true, thinCliEnabled=true, sslEnabled=false, useIgniteSslCtxFactory=true, sslClientAuth=false, sslCtxFactory=null, thinCliCfg=ThinClientConfiguration [maxActiveTxPerConn=100, maxActiveComputeTasksPerConn=0]], mvccVacuumThreadCnt=2, mvccVacuumFreq=5000, authEnabled=false, failureHnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]], commFailureRslvr=null, sqlCfg=SqlConfiguration [longQryWarnTimeout=3000, dfltQryTimeout=0, sqlQryHistSize=1000, validationEnabled=false], asyncContinuationExecutor=null] [21:08:16] : [Step 4/5] [2021-11-19 21:08:16,510][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] Daemon mode: off [21:08:16] : [Step 4/5] [2021-11-19 21:08:16,510][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] OS: Linux 4.15.0-151-generic amd64 [21:08:16] : [Step 4/5] [2021-11-19 21:08:16,510][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] OS user: teamcity [21:08:16] : [Step 4/5] [2021-11-19 21:08:16,510][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] PID: 16724 [21:08:16] : [Step 4/5] [2021-11-19 21:08:16,511][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] Language runtime: Java Platform API Specification ver. 1.8 [21:08:16] : [Step 4/5] [2021-11-19 21:08:16,511][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] VM information: Java(TM) SE Runtime Environment 1.8.0_261-b12 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 25.261-b12 [21:08:16] : [Step 4/5] [2021-11-19 21:08:16,511][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] VM total memory: 1.9GB [21:08:16] : [Step 4/5] [2021-11-19 21:08:16,511][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] Remote Management [restart: off, REST: off, JMX (remote: off)] [21:08:16] : [Step 4/5] [2021-11-19 21:08:16,512][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] Logger: GridTestLog4jLogger [quiet=false, config=null] [21:08:16] : [Step 4/5] [2021-11-19 21:08:16,512][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] IGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c [21:08:16] : [Step 4/5] [2021-11-19 21:08:16,512][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] VM arguments: [-DIGNITE_DUMP_THREADS_ON_FAILURE=false, -DMono=/usr/bin/mono-sgen, -DMono4.0_x64=/usr/lib/mono/4.0, -DMono4.5_x64=/usr/lib/mono/4.5, -DMonoVersion=6.12.0.90, -DSKIP_BUILD=false, -Dagent.home.dir=/opt/buildagent, -Dagent.name=aitc-lin02_03, -Dagent.ownPort=9090, -Dagent.work.dir=/opt/buildagent/work, -Dbuild.number=95, -Dbuild.vcs.number=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.1=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.GitHubApacheIgnite=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dclassworlds.conf=/opt/buildagent/temp/buildTmp/teamcity.m2.conf, -Dcom.jetbrains.maven.watcher.report.file=/opt/buildagent/temp/buildTmp/maven-build-info.xml, -Djava.io.tmpdir=/opt/buildagent/temp/buildTmp, -Dmaven.home=/opt/buildagent/tools/maven3_6, -Dmaven.multiModuleProjectDirectory=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.agent.cpuBenchmark=457, -Dteamcity.agent.dotnet.agent_url=http://localhost:9090/RPC2, -Dteamcity.agent.dotnet.build_id=6278078, -Dteamcity.auth.password=*******, -Dteamcity.auth.userId=TeamCityBuildId=6278078, -Dteamcity.build.changedFiles.file=/opt/buildagent/temp/buildTmp/changedFiles6342607772318147725.txt, -Dteamcity.build.checkoutDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.build.id=6278078, -Dteamcity.build.properties.file=/opt/buildagent/temp/buildTmp/teamcity.build5164517880467851002.properties, -Dteamcity.build.tempDir=/opt/buildagent/temp/buildTmp, -Dteamcity.build.workingDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.buildConfName=Basic 3, -Dteamcity.buildType.id=IgniteTests24Java8_Basic3, -Dteamcity.configuration.properties.file=/opt/buildagent/temp/buildTmp/teamcity.config5591980786735343870.properties, -Dteamcity.maven.userSettings.path=/opt/buildagent/temp/buildTmp/maven_settings_585072866407032347.xml, -Dteamcity.maven.watcher.home=/opt/buildagent/plugins/mavenPlugin/maven-watcher-jdk16, -Dteamcity.projectName=Ignite Tests 2.x (JDK 8/11), -Dteamcity.runner.properties.file=/opt/buildagent/temp/buildTmp/teamcity.runner9098465561618137420.properties, -Dteamcity.tests.recentlyFailedTests.file=/opt/buildagent/temp/buildTmp/testsToRunFirst3891775683130404069.txt, -Dteamcity.version=2021.2 (build 99542), -ea, -Xms2g, -Xmx2g, -XX:+HeapDumpOnOutOfMemoryError, -DIGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_TEST_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_UPDATE_NOTIFIER=false, -DIGNITE_NO_DISCO_ORDER=true, -DIGNITE_PERFORMANCE_SUGGESTIONS_DISABLED=true, -Djava.net.preferIPv4Stack=true, -DTEST_SCALE_FACTOR=1.0, -DIGNITE_TEST_PROP_LOG4J_FILE=log4j-tc-test.xml, -DIGNITE_QUIET=false, -DIGNITE_MARSHAL_BUFFERS_RECHECK=1000, -Dmaven.repo.local=/opt/buildagent/.m2/repository] [21:08:16] : [Step 4/5] [2021-11-19 21:08:16,516][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] System cache's DataRegion size is configured to 40 MB. Use DataStorageConfiguration.systemRegionInitialSize property to change the setting. [21:08:16] : [Step 4/5] [2021-11-19 21:08:16,517][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] Configured caches [in 'sysMemPlc' dataRegion: ['ignite-sys-cache']] [21:08:16]W: [org.apache.ignite:ignite-core] [2021-11-19 21:08:16,517][WARN ][test-runner-#15781%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] Peer class loading is enabled (disable it in production for performance and deployment consistency reasons) [21:08:16] : [Step 4/5] [2021-11-19 21:08:16,517][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] 3-rd party licenses can be found at: /opt/buildagent/work/7bc1c54bc719b67c/libs/licenses [21:08:16] : [Step 4/5] [2021-11-19 21:08:16,521][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] Configured plugins: [21:08:16] : [Step 4/5] [2021-11-19 21:08:16,521][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] ^-- StanByClusterTestProvider 1.0 [21:08:16] : [Step 4/5] [2021-11-19 21:08:16,521][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:08:16] : [Step 4/5] [2021-11-19 21:08:16,521][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] [21:08:16] : [Step 4/5] [2021-11-19 21:08:16,521][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] ^-- PageMemory tracker plugin 1.0 [21:08:16] : [Step 4/5] [2021-11-19 21:08:16,522][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:08:16] : [Step 4/5] [2021-11-19 21:08:16,522][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] [21:08:16] : [Step 4/5] [2021-11-19 21:08:16,522][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] ^-- TestDistibutedConfigurationPlugin 1.0 [21:08:16] : [Step 4/5] [2021-11-19 21:08:16,522][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:08:16] : [Step 4/5] [2021-11-19 21:08:16,522][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] [21:08:16] : [Step 4/5] [2021-11-19 21:08:16,523][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] ^-- NodeValidationPluginProvider 1.0 [21:08:16] : [Step 4/5] [2021-11-19 21:08:16,523][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:08:16] : [Step 4/5] [2021-11-19 21:08:16,523][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] [21:08:16] : [Step 4/5] [2021-11-19 21:08:16,523][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][FailureProcessor] Configured failure handler: [hnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]]] [21:08:16] : [Step 4/5] [2021-11-19 21:08:16,533][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][TestRecordingCommunicationSpi] Successfully bound communication NIO server to TCP port [port=47101, locHost=/127.0.0.1, selectorsCnt=12, selectorSpins=0, pairedConn=false] [21:08:16]W: [org.apache.ignite:ignite-core] [2021-11-19 21:08:16,533][WARN ][test-runner-#15781%encryption.MasterKeyChangeTest%][TestRecordingCommunicationSpi] Message queue limit is set to 0 which may lead to potential OOMEs when running cache operations in FULL_ASYNC or PRIMARY_SYNC modes due to message queues growth on sender and receiver sides. [21:08:16] : [Step 4/5] [2021-11-19 21:08:16,537][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][GridCollisionManager] Collision resolution is disabled (all jobs will be activated upon arrival). [21:08:16] : [Step 4/5] [2021-11-19 21:08:16,537][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] Security status [authentication=off, sandbox=off, tls/ssl=off] [21:08:16] : [Step 4/5] [2021-11-19 21:08:16,593][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:08:16] : [Step 4/5] [2021-11-19 21:08:16,677][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][MaintenanceProcessor] Resolved store directory for node persistent data: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1 [21:08:16] : [Step 4/5] [2021-11-19 21:08:16,678][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][CacheObjectBinaryProcessorImpl] Resolved directory for serialized binary metadata: /opt/buildagent/work/7bc1c54bc719b67c/work/db/binary_meta/grid_1 [21:08:16] : [Step 4/5] [2021-11-19 21:08:16,681][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1 [21:08:16] : [Step 4/5] [2021-11-19 21:08:16,682][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][FileWriteAheadLogManager] Resolved write ahead log work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1 [21:08:16] : [Step 4/5] [2021-11-19 21:08:16,682][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][FileWriteAheadLogManager] Resolved write ahead log archive directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1 [21:08:16] : [Step 4/5] [2021-11-19 21:08:16,684][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000005.wal [21:08:16] : [Step 4/5] [2021-11-19 21:08:16,685][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000006.wal [21:08:16] : [Step 4/5] [2021-11-19 21:08:16,685][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000004.wal [21:08:16] : [Step 4/5] [2021-11-19 21:08:16,686][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000003.wal [21:08:16] : [Step 4/5] [2021-11-19 21:08:16,686][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000002.wal [21:08:16] : [Step 4/5] [2021-11-19 21:08:16,687][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000007.wal [21:08:16] : [Step 4/5] [2021-11-19 21:08:16,687][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000001.wal [21:08:16] : [Step 4/5] [2021-11-19 21:08:16,693][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Configured data regions initialized successfully [total=5] [21:08:16] : [Step 4/5] [2021-11-19 21:08:16,792][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][IgniteSnapshotManager] Resolved snapshot work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/snapshots [21:08:16] : [Step 4/5] [2021-11-19 21:08:16,793][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][IgniteSnapshotManager] Resolved temp directory for snapshot creation: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1/snp [21:08:16] : [Step 4/5] [2021-11-19 21:08:16,795][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][ClientListenerProcessor] Client connector processor has started on TCP port 10801 [21:08:16] : [Step 4/5] [2021-11-19 21:08:16,800][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] Non-loopback local IPs: 172.17.0.4 [21:08:16] : [Step 4/5] [2021-11-19 21:08:16,800][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] Enabled local MACs: 0242AC110004 [21:08:16] : [Step 4/5] [2021-11-19 21:08:16,802][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=/opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1/cp/1637345295400-0261b4e8-530c-46a1-bf20-34086bcf3d9f-START.bin, endMarker=/opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1/cp/1637345295400-0261b4e8-530c-46a1-bf20-34086bcf3d9f-END.bin] [21:08:16] : [Step 4/5] [2021-11-19 21:08:16,803][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:08:16] : [Step 4/5] [2021-11-19 21:08:16,804][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=921016, len=11887], lastMarked=WALPointer [idx=0, fileOff=921016, len=11887], lastCheckpointId=0261b4e8-530c-46a1-bf20-34086bcf3d9f] [21:08:16] : [Step 4/5] [2021-11-19 21:08:16,901][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Found last checkpoint marker [cpId=0261b4e8-530c-46a1-bf20-34086bcf3d9f, pos=WALPointer [idx=0, fileOff=921016, len=11887]] [21:08:16] : [Step 4/5] [2021-11-19 21:08:16,908][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Applying lost metastore updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=921016, len=11887], lastCheckpointId=0261b4e8-530c-46a1-bf20-34086bcf3d9f] [21:08:16] : [Step 4/5] [2021-11-19 21:08:16,960][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=51 ms] [21:08:16] : [Step 4/5] [2021-11-19 21:08:16,961][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][GridCacheProcessor] Restoring partition state for local groups. [21:08:16] : [Step 4/5] [2021-11-19 21:08:16,961][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=0, partitionsProcessed=0, time=0ms] [21:08:17] : [Step 4/5] [2021-11-19 21:08:17,115][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][GridEncryptionManager] Master key name loaded from metastrore [masterKeyName=ignite.master.key2] [21:08:17] : [Step 4/5] [2021-11-19 21:08:17,171][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:08:17] : [Step 4/5] [2021-11-19 21:08:17,261][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][GridClusterStateProcessor] Restoring history for BaselineTopology[id=0] [21:08:17] : [Step 4/5] [2021-11-19 21:08:17,270][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][ClusterProcessor] Cluster ID and tag has been read from metastorage: ClusterIdAndTag [id=4a209f43-8915-4578-bd2a-92fe2e973f4a, tag=modest_volhard] [21:08:17] : [Step 4/5] [2021-11-19 21:08:17,271][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][IgniteClusterImpl] Shutdown policy was updated [oldVal=null, newVal=null] [21:08:17] : [Step 4/5] [2021-11-19 21:08:17,271][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustEnabled' was changed from 'null' to 'false' [21:08:17] : [Step 4/5] [2021-11-19 21:08:17,272][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustTimeout' was changed from 'null' to '300000' [21:08:17] : [Step 4/5] [2021-11-19 21:08:17,272][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][IgniteTxManager] Transactions parameter 'txOwnerDumpRequestsAllowed' was changed from 'null' to 'true' [21:08:17] : [Step 4/5] [2021-11-19 21:08:17,273][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][IgniteTxManager] Transactions parameter 'longOperationsDumpTimeout' was changed from 'null' to '60000' [21:08:17] : [Step 4/5] [2021-11-19 21:08:17,273][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpThreshold' was changed from 'null' to '0' [21:08:17] : [Step 4/5] [2021-11-19 21:08:17,274][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][IgniteTxManager] Transactions parameter 'transactionTimeDumpSamplesCoefficient' was changed from 'null' to '0.0' [21:08:17] : [Step 4/5] [2021-11-19 21:08:17,274][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpSamplesPerSecondLimit' was changed from 'null' to '5' [21:08:17] : [Step 4/5] [2021-11-19 21:08:17,275][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][IgniteTxManager] Transactions parameter 'collisionsDumpInterval' was changed from 'null' to '1000' [21:08:17] : [Step 4/5] [2021-11-19 21:08:17,275][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Historical rebalance WAL threshold changed [property=historical.rebalance.threshold, oldVal=null, newVal=500] [21:08:17] : [Step 4/5] [2021-11-19 21:08:17,276][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Checkpoint frequency deviation changed [oldVal=null, newVal=null] [21:08:17] : [Step 4/5] [2021-11-19 21:08:17,282][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][FilePageStoreManager] Cleanup cache stores [total=1, left=0, cleanFiles=false] [21:08:17] : [Step 4/5] [2021-11-19 21:08:17,285][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:08:17] : [Step 4/5] [2021-11-19 21:08:17,286][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:08:17] : [Step 4/5] [2021-11-19 21:08:17,287][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:08:17] : [Step 4/5] [2021-11-19 21:08:17,287][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Data Regions Started: 5 [21:08:17] : [Step 4/5] [2021-11-19 21:08:17,288][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] ^-- sysMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:08:17] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:08:17] : [Step 4/5] ^-- default region [type=default, persistence=true, lazyAlloc=true, [21:08:17] : [Step 4/5] ... initCfg=10MB, maxCfg=10MB, usedRam=0MB, freeRam=100%, allocRam=0MB, allocTotal=0MB] [21:08:17] : [Step 4/5] ^-- metastoreMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:08:17] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:08:17] : [Step 4/5] ^-- TxLog region [type=internal, persistence=true, lazyAlloc=false, [21:08:17] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:08:17] : [Step 4/5] ^-- volatileDsMemPlc region [type=user, persistence=false, lazyAlloc=true, [21:08:17] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB] [21:08:17] : [Step 4/5] ^-- Ignite persistence [used=0MB] [21:08:17] : [Step 4/5] [21:08:17] : [Step 4/5] [2021-11-19 21:08:17,289][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Starting binary memory restore for: [-2100569601, 1613773252] [21:08:17] : [Step 4/5] [2021-11-19 21:08:17,348][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=/opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1/cp/1637345295400-0261b4e8-530c-46a1-bf20-34086bcf3d9f-START.bin, endMarker=/opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1/cp/1637345295400-0261b4e8-530c-46a1-bf20-34086bcf3d9f-END.bin] [21:08:17] : [Step 4/5] [2021-11-19 21:08:17,348][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=921016, len=11887], lastMarked=WALPointer [idx=0, fileOff=921016, len=11887], lastCheckpointId=0261b4e8-530c-46a1-bf20-34086bcf3d9f] [21:08:17] : [Step 4/5] [2021-11-19 21:08:17,443][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Found last checkpoint marker [cpId=0261b4e8-530c-46a1-bf20-34086bcf3d9f, pos=WALPointer [idx=0, fileOff=921016, len=11887]] [21:08:17] : [Step 4/5] [2021-11-19 21:08:17,453][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Binary memory state restored at node startup [restoredPtr=WALPointer [idx=0, fileOff=974176, len=0]] [21:08:17] : [Step 4/5] [2021-11-19 21:08:17,454][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000000.wal, offset=974176, ver=2] [21:08:17] : [Step 4/5] [2021-11-19 21:08:17,458][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][GridCacheProcessor] Started cache in recovery mode [name=ignite-sys-cache, id=-2100569601, dataRegionName=sysMemPlc, mode=REPLICATED, atomicity=TRANSACTIONAL, backups=2147483647, mvcc=false] [21:08:17] : [Step 4/5] [2021-11-19 21:08:17,459][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=24.0 MiB, pages=5952, tableSize=474.2 KiB, replacementSize=768 B, checkpointBuffer=10.0 MiB] [21:08:17] : [Step 4/5] [2021-11-19 21:08:17,462][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][GridCacheProcessor] Started cache in recovery mode [name=encrypted, id=1613773252, dataRegionName=default, mode=PARTITIONED, atomicity=ATOMIC, backups=0, mvcc=false] [21:08:17] : [Step 4/5] [2021-11-19 21:08:17,463][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Binary recovery performed in 174 ms. [21:08:17] : [Step 4/5] [2021-11-19 21:08:17,463][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=/opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1/cp/1637345295400-0261b4e8-530c-46a1-bf20-34086bcf3d9f-START.bin, endMarker=/opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1/cp/1637345295400-0261b4e8-530c-46a1-bf20-34086bcf3d9f-END.bin] [21:08:17] : [Step 4/5] [2021-11-19 21:08:17,464][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Applying lost cache updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=921016, len=11887], lastCheckpointId=0261b4e8-530c-46a1-bf20-34086bcf3d9f] [21:08:17] : [Step 4/5] [2021-11-19 21:08:17,541][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=81 ms] [21:08:17] : [Step 4/5] [2021-11-19 21:08:17,542][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][GridCacheProcessor] Restoring partition state for local groups. [21:08:17] : [Step 4/5] [2021-11-19 21:08:17,605][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=2, partitionsProcessed=1124, time=60ms] [21:08:18] : [Step 4/5] [2021-11-19 21:08:18,187][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][TestTcpDiscoverySpi] Successfully bound to TCP port [port=47501, localHost=localhost/127.0.0.1, locNodeId=10868445-2bda-42f9-b43a-7b1d2bdfc001] [21:08:18] : [Step 4/5] [2021-11-19 21:08:18,190][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][GridEncryptionManager] Sending stored group keys to coordinator [grps=1613773252] [21:08:18] : [Step 4/5] [2021-11-19 21:08:18,196][INFO ][tcp-disco-srvr-[:47500]-#828%grid-0%-#15894%grid-0%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=36183] [21:08:18] : [Step 4/5] [2021-11-19 21:08:18,196][INFO ][tcp-disco-srvr-[:47500]-#828%grid-0%-#15894%grid-0%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=36183] [21:08:18] : [Step 4/5] [2021-11-19 21:08:18,197][INFO ][tcp-disco-sock-reader-[]-#852%grid-0%-#16305%grid-0%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:36183, rmtPort=36183] [21:08:18] : [Step 4/5] [2021-11-19 21:08:18,199][INFO ][tcp-disco-sock-reader-[10868445 127.0.0.1:36183]-#852%grid-0%-#16305%grid-0%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=10868445-2bda-42f9-b43a-7b1d2bdfc001, rmtAddr=/127.0.0.1:36183] [21:08:18] : [Step 4/5] [2021-11-19 21:08:18,203][INFO ][tcp-disco-srvr-[:47501]-#851%grid-1%-#16304%grid-1%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=38905] [21:08:18] : [Step 4/5] [2021-11-19 21:08:18,204][INFO ][tcp-disco-srvr-[:47501]-#851%grid-1%-#16304%grid-1%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=38905] [21:08:18] : [Step 4/5] [2021-11-19 21:08:18,205][INFO ][tcp-disco-sock-reader-[]-#853%grid-1%-#16306%grid-1%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:38905, rmtPort=38905] [21:08:18] : [Step 4/5] [2021-11-19 21:08:18,205][INFO ][tcp-disco-sock-reader-[]-#853%grid-1%-#16306%grid-1%][TestTcpDiscoverySpi] Received ping request from the remote node [rmtNodeId=00257274-13ec-45e2-bbc6-7e1e40c5d000, rmtAddr=/127.0.0.1:38905, rmtPort=38905] [21:08:18] : [Step 4/5] [2021-11-19 21:08:18,207][INFO ][tcp-disco-sock-reader-[]-#853%grid-1%-#16306%grid-1%][TestTcpDiscoverySpi] Finished writing ping response [rmtNodeId=00257274-13ec-45e2-bbc6-7e1e40c5d000, rmtAddr=/127.0.0.1:38905, rmtPort=38905] [21:08:18] : [Step 4/5] [2021-11-19 21:08:18,207][INFO ][tcp-disco-sock-reader-[]-#853%grid-1%-#16306%grid-1%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:38905, rmtPort=38905, rmtNodeId=null] [21:08:18] : [Step 4/5] [2021-11-19 21:08:18,207][INFO ][tcp-disco-sock-reader-[10868445 127.0.0.1:36183]-#852%grid-0%-#16305%grid-0%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:36183, rmtPort=36183, rmtNodeId=10868445-2bda-42f9-b43a-7b1d2bdfc001] [21:08:18] : [Step 4/5] [2021-11-19 21:08:18,222][INFO ][tcp-disco-msg-worker-[crd]-#827%grid-0%-#15893%grid-0%][TestTcpDiscoverySpi] New next node [newNext=TcpDiscoveryNode [id=10868445-2bda-42f9-b43a-7b1d2bdfc001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=0, intOrder=4, lastExchangeTime=1637345298194, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false]] [21:08:18] : [Step 4/5] [2021-11-19 21:08:18,223][INFO ][tcp-disco-srvr-[:47501]-#851%grid-1%-#16304%grid-1%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=47653] [21:08:18] : [Step 4/5] [2021-11-19 21:08:18,223][INFO ][tcp-disco-srvr-[:47501]-#851%grid-1%-#16304%grid-1%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=47653] [21:08:18] : [Step 4/5] [2021-11-19 21:08:18,224][INFO ][tcp-disco-sock-reader-[]-#854%grid-1%-#16307%grid-1%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:47653, rmtPort=47653] [21:08:18] : [Step 4/5] [2021-11-19 21:08:18,225][INFO ][tcp-disco-sock-reader-[00257274 127.0.0.1:47653]-#854%grid-1%-#16307%grid-1%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=00257274-13ec-45e2-bbc6-7e1e40c5d000, rmtAddr=/127.0.0.1:47653] [21:08:18] : [Step 4/5] [2021-11-19 21:08:18,230][INFO ][tcp-disco-msg-worker-[]-#850%grid-1%-#16303%grid-1%][TestTcpDiscoverySpi] New next node [newNext=TcpDiscoveryNode [id=00257274-13ec-45e2-bbc6-7e1e40c5d000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345298224, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false]] [21:08:18] : [Step 4/5] [2021-11-19 21:08:18,231][INFO ][tcp-disco-srvr-[:47500]-#828%grid-0%-#15894%grid-0%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=57209] [21:08:18] : [Step 4/5] [2021-11-19 21:08:18,232][INFO ][tcp-disco-srvr-[:47500]-#828%grid-0%-#15894%grid-0%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=57209] [21:08:18] : [Step 4/5] [2021-11-19 21:08:18,232][INFO ][tcp-disco-sock-reader-[]-#855%grid-0%-#16308%grid-0%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:57209, rmtPort=57209] [21:08:18] : [Step 4/5] [2021-11-19 21:08:18,233][INFO ][tcp-disco-sock-reader-[10868445 127.0.0.1:57209]-#855%grid-0%-#16308%grid-0%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=10868445-2bda-42f9-b43a-7b1d2bdfc001, rmtAddr=/127.0.0.1:57209] [21:08:18] : [Step 4/5] [2021-11-19 21:08:18,237][INFO ][disco-event-worker-#15896%grid-0%][GridDiscoveryManager] Added new node to topology: TcpDiscoveryNode [id=10868445-2bda-42f9-b43a-7b1d2bdfc001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=6, intOrder=4, lastExchangeTime=1637345298194, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false] [21:08:18] : [Step 4/5] [2021-11-19 21:08:18,239][INFO ][disco-event-worker-#15896%grid-0%][GridDiscoveryManager] Topology snapshot [ver=6, locNode=00257274, servers=2, clients=0, state=ACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=00257274-13ec-45e2-bbc6-7e1e40c5d000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=10868445-2bda-42f9-b43a-7b1d2bdfc001, consistentId=grid-1, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:08:18] : [Step 4/5] [2021-11-19 21:08:18,239][INFO ][disco-event-worker-#15896%grid-0%][GridDiscoveryManager] ^-- Baseline [id=0, size=2, online=2, offline=0] [21:08:18] : [Step 4/5] [2021-11-19 21:08:18,240][INFO ][exchange-worker-#15897%grid-0%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=6, minorTopVer=0], crd=true, evt=NODE_JOINED, evtNode=10868445-2bda-42f9-b43a-7b1d2bdfc001, customEvt=null, allowMerge=true, exchangeFreeSwitch=false] [21:08:18] : [Step 4/5] [2021-11-19 21:08:18,241][INFO ][exchange-worker-#15897%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=6, minorTopVer=0], waitTime=0ms, futInfo=NA, mode=DISTRIBUTED] [21:08:18] : [Step 4/5] [2021-11-19 21:08:18,242][INFO ][exchange-worker-#15897%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partitions release latch: ServerLatch [permits=0, pendingAcks=HashSet [], super=CompletableLatch [id=CompletableLatchUid [id=exchange, topVer=AffinityTopologyVersion [topVer=6, minorTopVer=0]]]] [21:08:18] : [Step 4/5] [2021-11-19 21:08:18,242][INFO ][exchange-worker-#15897%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=6, minorTopVer=0], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:08:18] : [Step 4/5] [2021-11-19 21:08:18,243][INFO ][exchange-worker-#15897%grid-0%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=6, minorTopVer=0], crd=true] [21:08:18] : [Step 4/5] [2021-11-19 21:08:18,244][INFO ][tcp-disco-msg-worker-[00257274 127.0.0.1:47500]-#850%grid-1%-#16303%grid-1%][GridEncryptionManager] Skip group key received from coordinator. Already exists. [grp=1613773252, keyId=0] [21:08:18] : [Step 4/5] [2021-11-19 21:08:18,245][INFO ][disco-notifier-worker-#16302%grid-1%][MvccProcessorImpl] Assigned mvcc coordinator [crd=MvccCoordinator [topVer=AffinityTopologyVersion [topVer=6, minorTopVer=0], nodeId=00257274-13ec-45e2-bbc6-7e1e40c5d000, ver=1637345286903, local=false, initialized=false]] [21:08:18] : [Step 4/5] [2021-11-19 21:08:18,246][INFO ][sys-#16286%grid-1%][ClusterProcessor] Writing cluster ID and tag to metastorage on ready for write ClusterIdAndTag [id=4a209f43-8915-4578-bd2a-92fe2e973f4a, tag=modest_volhard] [21:08:18] : [Step 4/5] [2021-11-19 21:08:18,260][INFO ][exchange-worker-#16311%grid-1%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=6, minorTopVer=0], crd=false, evt=NODE_JOINED, evtNode=10868445-2bda-42f9-b43a-7b1d2bdfc001, customEvt=null, allowMerge=true, exchangeFreeSwitch=false] [21:08:18] : [Step 4/5] [2021-11-19 21:08:18,261][INFO ][exchange-worker-#16311%grid-1%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1 [21:08:18] : [Step 4/5] [2021-11-19 21:08:18,263][INFO ][exchange-worker-#16311%grid-1%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000000.wal, offset=974176, ver=2] [21:08:18] : [Step 4/5] [2021-11-19 21:08:18,264][INFO ][exchange-worker-#16311%grid-1%][GridClusterStateProcessor] Writing BaselineTopology[id=0] [21:08:18] : [Step 4/5] [2021-11-19 21:08:18,352][INFO ][exchange-worker-#16311%grid-1%][GridCacheDatabaseSharedManager] Finish recovery performed in 91 ms. [21:08:18] : [Step 4/5] [2021-11-19 21:08:18,353][INFO ][exchange-worker-#16311%grid-1%][msg] Components activation performed in 92 ms. [21:08:18] : [Step 4/5] [2021-11-19 21:08:18,355][INFO ][sys-#16297%grid-1%][GridCacheProcessor] Finished recovery for cache [cache=encrypted, grp=encrypted, startVer=AffinityTopologyVersion [topVer=6, minorTopVer=0]] [21:08:18] : [Step 4/5] [2021-11-19 21:08:18,355][INFO ][exchange-worker-#16311%grid-1%][GridCacheProcessor] Finished recovery for cache [cache=ignite-sys-cache, grp=ignite-sys-cache, startVer=AffinityTopologyVersion [topVer=6, minorTopVer=0]] [21:08:18] : [Step 4/5] [2021-11-19 21:08:18,355][INFO ][exchange-worker-#16311%grid-1%][GridCacheProcessor] Starting caches on local join performed in 0 ms. [21:08:18] : [Step 4/5] [2021-11-19 21:08:18,356][INFO ][exchange-worker-#16311%grid-1%][GridDhtPartitionsExchangeFuture] Skipped waiting for partitions release future (local node is joining) [topVer=AffinityTopologyVersion [topVer=6, minorTopVer=0]] [21:08:18] : [Step 4/5] [2021-11-19 21:08:18,369][INFO ][grid-nio-worker-tcp-comm-2-#15838%TestRecordingCommunicationSpi%][TestRecordingCommunicationSpi] Accepted incoming communication connection [locAddr=/127.0.0.1:47100, rmtAddr=/127.0.0.1:56352] [21:08:18] : [Step 4/5] [2021-11-19 21:08:18,371][INFO ][grid-nio-worker-tcp-comm-0-#16245%TestRecordingCommunicationSpi%][TestRecordingCommunicationSpi] Established outgoing communication connection [locAddr=/127.0.0.1:56352, rmtAddr=/127.0.0.1:47100] [21:08:18] : [Step 4/5] [2021-11-19 21:08:18,372][INFO ][exchange-worker-#16311%grid-1%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=6, minorTopVer=0], crd=false] [21:08:18] : [Step 4/5] [2021-11-19 21:08:18,373][INFO ][sys-#15885%grid-0%][GridDhtPartitionsExchangeFuture] Coordinator received single message [ver=AffinityTopologyVersion [topVer=6, minorTopVer=0], node=10868445-2bda-42f9-b43a-7b1d2bdfc001, allReceived=true] [21:08:18] : [Step 4/5] [2021-11-19 21:08:18,374][INFO ][sys-#15885%grid-0%][GridDhtPartitionsExchangeFuture] Coordinator received all messages, try merge [ver=AffinityTopologyVersion [topVer=6, minorTopVer=0]] [21:08:18] : [Step 4/5] [2021-11-19 21:08:18,374][INFO ][sys-#15885%grid-0%][GridDhtPartitionsExchangeFuture] finishExchangeOnCoordinator [topVer=AffinityTopologyVersion [topVer=6, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=6, minorTopVer=0]] [21:08:18] : [Step 4/5] [2021-11-19 21:08:18,383][INFO ][sys-#15885%grid-0%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=6, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=6, minorTopVer=0], err=null, rebalanced=false, wasRebalanced=true] [21:08:18] : [Step 4/5] [2021-11-19 21:08:18,385][INFO ][sys-#16285%grid-1%][GridDhtPartitionsExchangeFuture] Received full message, will finish exchange [node=00257274-13ec-45e2-bbc6-7e1e40c5d000, resVer=AffinityTopologyVersion [topVer=6, minorTopVer=0]] [21:08:18] : [Step 4/5] [2021-11-19 21:08:18,385][INFO ][sys-#15885%grid-0%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=00257274-13ec-45e2-bbc6-7e1e40c5d000, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=6, minorTopVer=0], evt=NODE_JOINED, evtNode=TcpDiscoveryNode [id=10868445-2bda-42f9-b43a-7b1d2bdfc001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=6, intOrder=4, lastExchangeTime=1637345298194, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=false, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=6, minorTopVer=0]] [21:08:18] : [Step 4/5] [2021-11-19 21:08:18,387][INFO ][exchange-worker-#15897%grid-0%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=6, minorTopVer=0], force=false, evt=NODE_JOINED, node=10868445-2bda-42f9-b43a-7b1d2bdfc001] [21:08:18] : [Step 4/5] [2021-11-19 21:08:18,388][INFO ][sys-#15885%grid-0%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=6, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=6, minorTopVer=0], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (0 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Wait partitions release latch [latch=exchange]" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="After states restored callback" (0 ms), stage="WAL history reservation" (0 ms), stage="Waiting for all single messages" (130 ms), stage="Exchanges merge" (0 ms), stage="Affinity recalculation (crd)" (3 ms), stage="Collect update counters and create affinity messages" (0 ms), stage="Assign partitions states" (1 ms), stage="Validate partitions states" (0 ms), stage="Apply update counters" (0 ms), stage="Full message preparing" (2 ms), stage="Full message sending" (0 ms), stage="Exchange done" (4 ms), stage="Total time" (140 ms), Discovery lag=6 ms, Latest started node id=10868445-2bda-42f9-b43a-7b1d2bdfc001] [21:08:18] : [Step 4/5] [2021-11-19 21:08:18,391][INFO ][sys-#16285%grid-1%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=6, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=6, minorTopVer=0], err=null, rebalanced=false, wasRebalanced=false] [21:08:18] : [Step 4/5] [2021-11-19 21:08:18,391][INFO ][sys-#15885%grid-0%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=6, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=6, minorTopVer=0], stage="Affinity initialization (node join) [grp=encrypted, crd=true]" (2 ms) (parent=Affinity recalculation (crd)), stage="Affinity initialization (node join) [grp=ignite-sys-cache, crd=true]" (1 ms) (parent=Affinity recalculation (crd))] [21:08:18] : [Step 4/5] [2021-11-19 21:08:18,394][INFO ][sys-#16285%grid-1%][GridCacheProcessor] Finish proxy initialization, cacheName=ignite-sys-cache, localNodeId=10868445-2bda-42f9-b43a-7b1d2bdfc001 [21:08:18] : [Step 4/5] [2021-11-19 21:08:18,394][INFO ][sys-#16285%grid-1%][GridCacheProcessor] Finish proxy initialization, cacheName=encrypted, localNodeId=10868445-2bda-42f9-b43a-7b1d2bdfc001 [21:08:18] : [Step 4/5] [2021-11-19 21:08:18,394][INFO ][sys-#16285%grid-1%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=10868445-2bda-42f9-b43a-7b1d2bdfc001, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=6, minorTopVer=0], evt=NODE_JOINED, evtNode=TcpDiscoveryNode [id=10868445-2bda-42f9-b43a-7b1d2bdfc001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=6, intOrder=4, lastExchangeTime=1637345298245, loc=true, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=false, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=6, minorTopVer=0]] [21:08:18] : [Step 4/5] [2021-11-19 21:08:18,395][INFO ][exchange-worker-#16311%grid-1%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=6, minorTopVer=0], force=false, evt=NODE_JOINED, node=10868445-2bda-42f9-b43a-7b1d2bdfc001] [21:08:18] : [Step 4/5] [2021-11-19 21:08:18,395][INFO ][sys-#16285%grid-1%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=6, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=6, minorTopVer=0], stage="Waiting in exchange queue" (14 ms), stage="Exchange parameters initialization" (0 ms), stage="Components activation" (92 ms), stage="Determine exchange type" (2 ms), stage="Preloading notification" (0 ms), stage="Restore partition states" (0 ms), stage="After states restored callback" (8 ms), stage="WAL history reservation" (0 ms), stage="Waiting for Full message" (19 ms), stage="Affinity recalculation" (2 ms), stage="Full map updating" (3 ms), stage="Exchange done" (4 ms), stage="Total time" (144 ms)] [21:08:18] : [Step 4/5] [2021-11-19 21:08:18,397][INFO ][sys-#16285%grid-1%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=6, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=6, minorTopVer=0], stage="Affinity fetch" (2 ms) (parent=Determine exchange type), stage="Restore partition states [grp=ignite-sys-cache]" (0 ms) (parent=Restore partition states), stage="Restore partition states [grp=encrypted]" (0 ms) (parent=Restore partition states), stage="Affinity initialization (local join) [grp=encrypted]" (2 ms) (parent=Affinity recalculation), stage="Affinity initialization (local join) [grp=ignite-sys-cache]" (1 ms) (parent=Affinity recalculation)] [21:08:18] : [Step 4/5] [2021-11-19 21:08:18,397][INFO ][exchange-worker-#15897%grid-0%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=6, minorTopVer=1], crd=true, evt=DISCOVERY_CUSTOM_EVT, evtNode=00257274-13ec-45e2-bbc6-7e1e40c5d000, customEvt=CacheAffinityChangeMessage [id=d2e5d593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, topVer=AffinityTopologyVersion [topVer=6, minorTopVer=0], exchId=null, partsMsg=null, exchangeNeeded=true], allowMerge=false, exchangeFreeSwitch=false] [21:08:18] : [Step 4/5] [2021-11-19 21:08:18,399][INFO ][exchange-worker-#15897%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=6, minorTopVer=1], waitTime=0ms, futInfo=NA, mode=DISTRIBUTED] [21:08:18] : [Step 4/5] [2021-11-19 21:08:18,401][INFO ][exchange-worker-#16311%grid-1%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=6, minorTopVer=1], crd=false, evt=DISCOVERY_CUSTOM_EVT, evtNode=00257274-13ec-45e2-bbc6-7e1e40c5d000, customEvt=CacheAffinityChangeMessage [id=d2e5d593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, topVer=AffinityTopologyVersion [topVer=6, minorTopVer=0], exchId=null, partsMsg=null, exchangeNeeded=true], allowMerge=false, exchangeFreeSwitch=false] [21:08:18] : [Step 4/5] [2021-11-19 21:08:18,402][INFO ][exchange-worker-#16311%grid-1%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=6, minorTopVer=1], waitTime=0ms, futInfo=NA, mode=DISTRIBUTED] [21:08:18] : [Step 4/5] [2021-11-19 21:08:18,403][INFO ][exchange-worker-#15897%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partitions release latch: ServerLatch [permits=0, pendingAcks=HashSet [], super=CompletableLatch [id=CompletableLatchUid [id=exchange, topVer=AffinityTopologyVersion [topVer=6, minorTopVer=1]]]] [21:08:18] : [Step 4/5] [2021-11-19 21:08:18,403][INFO ][exchange-worker-#16311%grid-1%][GridDhtPartitionsExchangeFuture] Finished waiting for partitions release latch: ClientLatch [coordinator=TcpDiscoveryNode [id=00257274-13ec-45e2-bbc6-7e1e40c5d000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345298224, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], ackSent=true, super=CompletableLatch [id=CompletableLatchUid [id=exchange, topVer=AffinityTopologyVersion [topVer=6, minorTopVer=1]]]] [21:08:18] : [Step 4/5] [2021-11-19 21:08:18,403][INFO ][exchange-worker-#15897%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=6, minorTopVer=1], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:08:18] : [Step 4/5] [2021-11-19 21:08:18,403][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] To start Console Management & Monitoring run ignitevisorcmd.{sh|bat} [21:08:18] : [Step 4/5] [2021-11-19 21:08:18,404][INFO ][exchange-worker-#16311%grid-1%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=6, minorTopVer=1], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:08:18] : [Step 4/5] [2021-11-19 21:08:18,405][INFO ][exchange-worker-#15897%grid-0%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=6, minorTopVer=1], crd=true] [21:08:18] : [Step 4/5] [2021-11-19 21:08:18,406][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] [21:08:18] : [Step 4/5] [21:08:18] : [Step 4/5] >>> +-------------------------------------------+ [21:08:18] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:08:18] : [Step 4/5] >>> +-------------------------------------------+ [21:08:18] : [Step 4/5] >>> OS name: Linux 4.15.0-151-generic amd64 [21:08:18] : [Step 4/5] >>> CPU(s): 24 [21:08:18] : [Step 4/5] >>> Heap: 2.0GB [21:08:18] : [Step 4/5] >>> VM name: 16724@c4dfe9a430b2 [21:08:18] : [Step 4/5] >>> Ignite instance name: grid-1 [21:08:18] : [Step 4/5] >>> Local node [ID=10868445-2BDA-42F9-B43A-7B1D2BDFC001, order=6, clientMode=false] [21:08:18] : [Step 4/5] >>> Local node addresses: [127.0.0.1] [21:08:18] : [Step 4/5] >>> Local ports: TCP:10801 TCP:47101 TCP:47501 [21:08:18] : [Step 4/5] [21:08:18] : [Step 4/5] [2021-11-19 21:08:18,407][INFO ][exchange-worker-#16311%grid-1%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=6, minorTopVer=1], crd=false] [21:08:18] : [Step 4/5] [2021-11-19 21:08:18,407][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][GridDiscoveryManager] Topology snapshot [ver=6, locNode=10868445, servers=2, clients=0, state=ACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=00257274-13ec-45e2-bbc6-7e1e40c5d000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=10868445-2bda-42f9-b43a-7b1d2bdfc001, consistentId=grid-1, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:08:18] : [Step 4/5] [2021-11-19 21:08:18,408][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][GridDiscoveryManager] ^-- Baseline [id=0, size=2, online=2, offline=0] [21:08:18] : [Step 4/5] [2021-11-19 21:08:18,408][INFO ][sys-#15877%grid-0%][GridDhtPartitionsExchangeFuture] Coordinator received single message [ver=AffinityTopologyVersion [topVer=6, minorTopVer=1], node=10868445-2bda-42f9-b43a-7b1d2bdfc001, allReceived=true] [21:08:18] : [Step 4/5] [2021-11-19 21:08:18,409][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][G] Node started : [stage="Configure system pool" (0 ms),stage="Start managers" (178 ms),stage="Configure binary metadata" (1 ms),stage="Start processors" (119 ms),stage="Start 'StanByClusterTestProvider' plugin" (0 ms),stage="Start 'PageMemory tracker plugin' plugin" (0 ms),stage="Start 'TestDistibutedConfigurationPlugin' plugin" (0 ms),stage="Start 'NodeValidationPluginProvider' plugin" (0 ms),stage="Init metastore" (483 ms),stage="Init and start regions" (6 ms),stage="Restore binary memory" (173 ms),stage="Restore logical state" (142 ms),stage="Finish recovery" (580 ms),stage="Join topology" (59 ms),stage="Await transition" (2 ms),stage="Await exchange" (160 ms),stage="Total time" (1903 ms)] [21:08:18] : [Step 4/5] [2021-11-19 21:08:18,409][INFO ][sys-#15877%grid-0%][GridDhtPartitionsExchangeFuture] finishExchangeOnCoordinator [topVer=AffinityTopologyVersion [topVer=6, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=6, minorTopVer=1]] [21:08:18] : [Step 4/5] [2021-11-19 21:08:18,411][INFO ][test-runner-#15781%encryption.MasterKeyChangeTest%][root] Node started with the following configuration [id=10868445-2bda-42f9-b43a-7b1d2bdfc001, marshaller=BinaryMarshaller [], discovery=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=5000, ackTimeout=5000, marsh=JdkMarshaller [clsFilter=org.apache.ignite.marshaller.MarshallerUtils$1@4de10119], reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], binaryCfg=null, lateAff=true] [21:08:18] : [Step 4/5] [2021-11-19 21:08:18,415][INFO ][sys-#15877%grid-0%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=6, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=6, minorTopVer=1], err=null, rebalanced=true, wasRebalanced=false] [21:08:18] : [Step 4/5] [2021-11-19 21:08:18,416][INFO ][sys-#16286%grid-1%][GridDhtPartitionsExchangeFuture] Received full message, will finish exchange [node=00257274-13ec-45e2-bbc6-7e1e40c5d000, resVer=AffinityTopologyVersion [topVer=6, minorTopVer=1]] [21:08:18] : [Step 4/5] [2021-11-19 21:08:18,416][INFO ][sys-#15877%grid-0%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=00257274-13ec-45e2-bbc6-7e1e40c5d000, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=6, minorTopVer=1], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=00257274-13ec-45e2-bbc6-7e1e40c5d000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345298396, loc=true, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=6, minorTopVer=1]] [21:08:18] : [Step 4/5] [2021-11-19 21:08:18,416][INFO ][exchange-worker-#15897%grid-0%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=6, minorTopVer=1], force=false, evt=DISCOVERY_CUSTOM_EVT, node=00257274-13ec-45e2-bbc6-7e1e40c5d000] [21:08:18] : [Step 4/5] [2021-11-19 21:08:18,419][INFO ][sys-#15877%grid-0%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=6, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=6, minorTopVer=1], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (1 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Wait partitions release latch [latch=exchange]" (3 ms), stage="Wait partitions release [latch=exchange]" (1 ms), stage="After states restored callback" (0 ms), stage="WAL history reservation" (0 ms), stage="Waiting for all single messages" (3 ms), stage="Affinity recalculation (crd)" (1 ms), stage="Collect update counters and create affinity messages" (0 ms), stage="Validate partitions states" (0 ms), stage="Apply update counters" (0 ms), stage="Full message preparing" (2 ms), stage="Full message sending" (0 ms), stage="Exchange done" (4 ms), stage="Total time" (15 ms), Discovery lag=4 ms, Latest started node id=10868445-2bda-42f9-b43a-7b1d2bdfc001] [21:08:18] : [Step 4/5] [2021-11-19 21:08:18,420][INFO ][sys-#16286%grid-1%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=6, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=6, minorTopVer=1], err=null, rebalanced=true, wasRebalanced=false] [21:08:18] : [Step 4/5] [2021-11-19 21:08:18,420][INFO ][exchange-worker-#15897%grid-0%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=6, minorTopVer=2], crd=true, evt=DISCOVERY_CUSTOM_EVT, evtNode=00257274-13ec-45e2-bbc6-7e1e40c5d000, customEvt=DynamicCacheChangeBatch [id=e3e5d593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqs=ArrayList [DynamicCacheChangeRequest [cacheName=encrypted, hasCfg=false, nodeId=00257274-13ec-45e2-bbc6-7e1e40c5d000, clientStartOnly=false, stop=false, destroy=false, disabledAfterStart=false]], exchangeActions=ExchangeActions [startCaches=null, stopCaches=null, startGrps=[], stopGrps=[], resetParts=[encrypted], stateChangeRequest=null], startCaches=false], allowMerge=false, exchangeFreeSwitch=false] [21:08:18] : [Step 4/5] [2021-11-19 21:08:18,423][INFO ][exchange-worker-#16311%grid-1%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=6, minorTopVer=1], force=false, evt=DISCOVERY_CUSTOM_EVT, node=00257274-13ec-45e2-bbc6-7e1e40c5d000] [21:08:18] : [Step 4/5] [2021-11-19 21:08:18,423][INFO ][sys-#16286%grid-1%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=10868445-2bda-42f9-b43a-7b1d2bdfc001, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=6, minorTopVer=1], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=00257274-13ec-45e2-bbc6-7e1e40c5d000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345298224, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=6, minorTopVer=1]] [21:08:18] : [Step 4/5] [2021-11-19 21:08:18,425][INFO ][sys-#16286%grid-1%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=6, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=6, minorTopVer=1], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (0 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Wait partitions release latch [latch=exchange]" (2 ms), stage="Wait partitions release [latch=exchange]" (1 ms), stage="After states restored callback" (0 ms), stage="WAL history reservation" (0 ms), stage="Waiting for Full message" (9 ms), stage="Affinity recalculation" (0 ms), stage="Full map updating" (3 ms), stage="Exchange done" (5 ms), stage="Total time" (20 ms)] [21:08:18] : [Step 4/5] [2021-11-19 21:08:18,422][INFO ][sys-#15877%grid-0%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=6, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=6, minorTopVer=1], stage="Affinity change by custom message [grp=ignite-sys-cache]" (0 ms) (parent=Determine exchange type)] [21:08:18] : [Step 4/5] [2021-11-19 21:08:18,426][INFO ][sys-#16286%grid-1%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=6, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=6, minorTopVer=1], stage="Affinity change by custom message [grp=ignite-sys-cache]" (0 ms) (parent=Determine exchange type)] [21:08:18]W: [org.apache.ignite:ignite-core] [2021-11-19 21:08:18,424][WARN ][sys-#15889%grid-0%][CacheAffinitySharedManager] Cache group 'encrypted' brings high overhead for its metainformation in data region 'default'. Metainformation required for its partitions (502 partitions, 4096 bytes per partition, 1 MBs total) will consume more than 15% of data region memory (10 MBs). It may lead to critical errors on the node and cluster instability. Please reduce number of partitions, add more memory to the data region or add more server nodes for this cache group. [21:08:18] : [Step 4/5] [2021-11-19 21:08:18,424][INFO ][exchange-worker-#16311%grid-1%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=6, minorTopVer=2], crd=false, evt=DISCOVERY_CUSTOM_EVT, evtNode=00257274-13ec-45e2-bbc6-7e1e40c5d000, customEvt=DynamicCacheChangeBatch [id=e3e5d593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqs=ArrayList [DynamicCacheChangeRequest [cacheName=encrypted, hasCfg=false, nodeId=00257274-13ec-45e2-bbc6-7e1e40c5d000, clientStartOnly=false, stop=false, destroy=false, disabledAfterStart=false]], exchangeActions=ExchangeActions [startCaches=null, stopCaches=null, startGrps=[], stopGrps=[], resetParts=[encrypted], stateChangeRequest=null], startCaches=false], allowMerge=false, exchangeFreeSwitch=false] [21:08:18] : [Step 4/5] [2021-11-19 21:08:18,428][INFO ][exchange-worker-#15897%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=6, minorTopVer=2], waitTime=0ms, futInfo=NA, mode=DISTRIBUTED] [21:08:18]W: [org.apache.ignite:ignite-core] [2021-11-19 21:08:18,430][WARN ][sys-#16287%grid-1%][CacheAffinitySharedManager] Cache group 'encrypted' brings high overhead for its metainformation in data region 'default'. Metainformation required for its partitions (522 partitions, 4096 bytes per partition, 2 MBs total) will consume more than 15% of data region memory (10 MBs). It may lead to critical errors on the node and cluster instability. Please reduce number of partitions, add more memory to the data region or add more server nodes for this cache group. [21:08:18] : [Step 4/5] [2021-11-19 21:08:18,431][INFO ][exchange-worker-#16311%grid-1%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=6, minorTopVer=2], waitTime=0ms, futInfo=NA, mode=DISTRIBUTED] [21:08:18] : [Step 4/5] [2021-11-19 21:08:18,432][INFO ][exchange-worker-#15897%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partitions release latch: ServerLatch [permits=0, pendingAcks=HashSet [], super=CompletableLatch [id=CompletableLatchUid [id=exchange, topVer=AffinityTopologyVersion [topVer=6, minorTopVer=2]]]] [21:08:18] : [Step 4/5] [2021-11-19 21:08:18,432][INFO ][exchange-worker-#16311%grid-1%][GridDhtPartitionsExchangeFuture] Finished waiting for partitions release latch: ClientLatch [coordinator=TcpDiscoveryNode [id=00257274-13ec-45e2-bbc6-7e1e40c5d000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345298224, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], ackSent=true, super=CompletableLatch [id=CompletableLatchUid [id=exchange, topVer=AffinityTopologyVersion [topVer=6, minorTopVer=2]]]] [21:08:18] : [Step 4/5] [2021-11-19 21:08:18,432][INFO ][exchange-worker-#15897%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=6, minorTopVer=2], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:08:18] : [Step 4/5] [2021-11-19 21:08:18,433][INFO ][exchange-worker-#16311%grid-1%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=6, minorTopVer=2], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:08:18] : [Step 4/5] [2021-11-19 21:08:18,437][INFO ][exchange-worker-#15897%grid-0%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=6, minorTopVer=2], crd=true] [21:08:18] : [Step 4/5] [2021-11-19 21:08:18,449][INFO ][exchange-worker-#16311%grid-1%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=6, minorTopVer=2], crd=false] [21:08:18] : [Step 4/5] [2021-11-19 21:08:18,450][INFO ][sys-#15869%grid-0%][GridDhtPartitionsExchangeFuture] Coordinator received single message [ver=AffinityTopologyVersion [topVer=6, minorTopVer=2], node=10868445-2bda-42f9-b43a-7b1d2bdfc001, allReceived=true] [21:08:18] : [Step 4/5] [2021-11-19 21:08:18,450][INFO ][sys-#15869%grid-0%][GridDhtPartitionsExchangeFuture] finishExchangeOnCoordinator [topVer=AffinityTopologyVersion [topVer=6, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=6, minorTopVer=2]] [21:08:18] : [Step 4/5] [2021-11-19 21:08:18,460][INFO ][sys-#15869%grid-0%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=6, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=6, minorTopVer=2], err=null, rebalanced=true, wasRebalanced=true] [21:08:18] : [Step 4/5] [2021-11-19 21:08:18,460][INFO ][sys-#16296%grid-1%][GridDhtPartitionsExchangeFuture] Received full message, will finish exchange [node=00257274-13ec-45e2-bbc6-7e1e40c5d000, resVer=AffinityTopologyVersion [topVer=6, minorTopVer=2]] [21:08:18] : [Step 4/5] [2021-11-19 21:08:18,461][INFO ][sys-#15869%grid-0%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=00257274-13ec-45e2-bbc6-7e1e40c5d000, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=6, minorTopVer=2], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=00257274-13ec-45e2-bbc6-7e1e40c5d000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345298417, loc=true, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=6, minorTopVer=2]] [21:08:18] : [Step 4/5] [2021-11-19 21:08:18,462][INFO ][exchange-worker-#15897%grid-0%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=6, minorTopVer=2], force=false, evt=DISCOVERY_CUSTOM_EVT, node=00257274-13ec-45e2-bbc6-7e1e40c5d000] [21:08:18] : [Step 4/5] [2021-11-19 21:08:18,465][INFO ][sys-#15869%grid-0%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=6, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=6, minorTopVer=2], stage="Waiting in exchange queue" (3 ms), stage="Exchange parameters initialization" (3 ms), stage="Update caches registry" (0 ms), stage="Start caches" (0 ms), stage="Affinity initialization on cache group start" (0 ms), stage="Determine exchange type" (4 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (1 ms), stage="Wait partitions release latch [latch=exchange]" (2 ms), stage="Wait partitions release [latch=exchange]" (1 ms), stage="After states restored callback" (2 ms), stage="WAL history reservation" (1 ms), stage="Waiting for all single messages" (13 ms), stage="Affinity recalculation (crd)" (0 ms), stage="Collect update counters and create affinity messages" (0 ms), stage="Assign partitions states" (1 ms), stage="Validate partitions states" (0 ms), stage="Ideal affinity diff calculation (enforced)" (3 ms), stage="Apply update counters" (0 ms), stage="Full message preparing" (2 ms), stage="Full message sending" (0 ms), stage="Exchange done" (4 ms), stage="Total time" (40 ms), Discovery lag=1 ms, Latest started node id=10868445-2bda-42f9-b43a-7b1d2bdfc001] [21:08:18] : [Step 4/5] [2021-11-19 21:08:18,465][INFO ][sys-#16296%grid-1%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=6, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=6, minorTopVer=2], err=null, rebalanced=true, wasRebalanced=true] [21:08:18] : [Step 4/5] [2021-11-19 21:08:18,467][INFO ][sys-#15869%grid-0%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=6, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=6, minorTopVer=2], stage="Affinity centralized initialization (crd) [grp=ignite-sys-cache, crd=true]" (0 ms) (parent=Determine exchange type), stage="Affinity centralized initialization (crd) [grp=encrypted, crd=true]" (0 ms) (parent=Determine exchange type), stage="Affinity recalculation (partitions availability) [grp=encrypted]" (3 ms) (parent=Ideal affinity diff calculation (enforced)), stage="Affinity recalculation (partitions availability) [grp=ignite-sys-cache]" (0 ms) (parent=Ideal affinity diff calculation (enforced))] [21:08:18] : [Step 4/5] [2021-11-19 21:08:18,469][INFO ][sys-#16296%grid-1%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=10868445-2bda-42f9-b43a-7b1d2bdfc001, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=6, minorTopVer=2], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=00257274-13ec-45e2-bbc6-7e1e40c5d000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345298224, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=6, minorTopVer=2]] [21:08:18] : [Step 4/5] [2021-11-19 21:08:18,473][INFO ][sys-#16296%grid-1%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=6, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=6, minorTopVer=2], stage="Waiting in exchange queue" (6 ms), stage="Exchange parameters initialization" (5 ms), stage="Update caches registry" (0 ms), stage="Start caches" (0 ms), stage="Affinity initialization on cache group start" (0 ms), stage="Determine exchange type" (1 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Wait partitions release latch [latch=exchange]" (2 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="After states restored callback" (0 ms), stage="WAL history reservation" (0 ms), stage="Waiting for Full message" (25 ms), stage="Affinity recalculation" (1 ms), stage="Full map updating" (3 ms), stage="Exchange done" (7 ms), stage="Total time" (50 ms)] [21:08:18] : [Step 4/5] [2021-11-19 21:08:18,469][INFO ][exchange-worker-#16311%grid-1%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=6, minorTopVer=2], force=false, evt=DISCOVERY_CUSTOM_EVT, node=00257274-13ec-45e2-bbc6-7e1e40c5d000] [21:08:18] : [Step 4/5] [2021-11-19 21:08:18,475][INFO ][sys-#16296%grid-1%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=6, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=6, minorTopVer=2], stage="Affinity centralized initialization (crd) [grp=ignite-sys-cache, crd=false]" (0 ms) (parent=Determine exchange type), stage="Affinity centralized initialization (crd) [grp=encrypted, crd=false]" (0 ms) (parent=Determine exchange type), stage="Affinity applying from full message [grp=encrypted]" (1 ms) (parent=Affinity recalculation), stage="Affinity applying from full message [grp=ignite-sys-cache]" (0 ms) (parent=Affinity recalculation)] [21:08:18] : [Step 4/5] [21:08:18] >>> Stopping test: MasterKeyChangeTest#testManualRecovery in 12659 ms <<< [21:08:18] : [Step 4/5] [2021-11-19 21:08:18,527][INFO ][main][root] >>> Stopping test: MasterKeyChangeTest#testManualRecovery in 12659 ms <<< [21:08:18] : [Step 4/5] [21:08:18] >>> Heap: 239 MB used / 1913 MB commited / 1913 MB max <<< [21:08:18] : [Step 4/5] [2021-11-19 21:08:18,527][INFO ][main][root] >>> Heap: 239 MB used / 1913 MB commited / 1913 MB max <<< [21:08:18] : [Step 4/5] [21:08:18] >>> Non-Heap: 145 MB used / 177 MB commited / 0 MB max <<< [21:08:18] : [Step 4/5] [2021-11-19 21:08:18,527][INFO ][main][root] >>> Non-Heap: 145 MB used / 177 MB commited / 0 MB max <<< [21:08:18] : [Step 4/5] [21:08:18] >>> Starting test: MasterKeyChangeTest#testRejectCacheStartDuringRotation <<< [21:08:18] : [Step 4/5] [2021-11-19 21:08:18,528][INFO ][main][root] >>> Starting test: MasterKeyChangeTest#testRejectCacheStartDuringRotation <<< [21:08:18] : [Step 4/5] [21:08:18] >>> Heap: 239 MB used / 1913 MB commited / 1913 MB max <<< [21:08:18] : [Step 4/5] [2021-11-19 21:08:18,529][INFO ][main][root] >>> Heap: 239 MB used / 1913 MB commited / 1913 MB max <<< [21:08:18] : [Step 4/5] [21:08:18] >>> Non-Heap: 145 MB used / 177 MB commited / 0 MB max <<< [21:08:18] : [Step 4/5] [2021-11-19 21:08:18,529][INFO ][main][root] >>> Non-Heap: 145 MB used / 177 MB commited / 0 MB max <<< [21:08:18] : [Step 4/5] [2021-11-19 21:08:18,529][INFO ][main][root] >>> Stopping grid [name=grid-1, id=10868445-2bda-42f9-b43a-7b1d2bdfc001] [21:08:19] : [Step 4/5] [2021-11-19 21:08:19,072][INFO ][db-checkpoint-thread-#16315%grid-1%][Checkpointer] Checkpoint started [checkpointId=0eb73b80-6990-4b08-8606-4ee2fee89292, startPtr=WALPointer [idx=0, fileOff=1258557, len=11887], checkpointBeforeLockTime=6ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=1ms, checkpointLockHoldTime=2ms, walCpRecordFsyncDuration=167ms, writeCheckpointEntryDuration=540ms, splitAndSortCpPagesDuration=0ms, pages=62, reason='node started'] [21:08:19] : [Step 4/5] [2021-11-19 21:08:19,081][INFO ][tcp-disco-sock-reader-[00257274 127.0.0.1:47653]-#854%grid-1%-#16307%grid-1%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:47653, rmtPort=47653, rmtNodeId=00257274-13ec-45e2-bbc6-7e1e40c5d000] [21:08:19] : [Step 4/5] [2021-11-19 21:08:19,082][INFO ][disco-event-worker-#15896%grid-0%][GridDiscoveryManager] Node left topology: TcpDiscoveryNode [id=10868445-2bda-42f9-b43a-7b1d2bdfc001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=6, intOrder=4, lastExchangeTime=1637345298194, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false] [21:08:19] : [Step 4/5] [2021-11-19 21:08:19,084][INFO ][disco-event-worker-#15896%grid-0%][GridDiscoveryManager] Topology snapshot [ver=7, locNode=00257274, servers=1, clients=0, state=ACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=00257274-13ec-45e2-bbc6-7e1e40c5d000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:08:19] : [Step 4/5] [2021-11-19 21:08:19,085][INFO ][disco-event-worker-#15896%grid-0%][GridDiscoveryManager] ^-- Baseline [id=0, size=2, online=1, offline=1] [21:08:19]W: [org.apache.ignite:ignite-core] [2021-11-19 21:08:19,085][WARN ][grid-nio-worker-tcp-comm-2-#15838%TestRecordingCommunicationSpi%][TestRecordingCommunicationSpi] Failed to shutdown socket [21:08:19]W: [org.apache.ignite:ignite-core] java.nio.channels.ClosedChannelException [21:08:19]W: [org.apache.ignite:ignite-core] at sun.nio.ch.SocketChannelImpl.shutdownOutput(SocketChannelImpl.java:795) [21:08:19]W: [org.apache.ignite:ignite-core] at sun.nio.ch.SocketAdaptor.shutdownOutput(SocketAdaptor.java:407) [21:08:19]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.close(IgniteUtils.java:4247) [21:08:19]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.closeKey(GridNioServer.java:2784) [21:08:19]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.close(GridNioServer.java:2835) [21:08:19]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.close(GridNioServer.java:2794) [21:08:19]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.bodyInternal(GridNioServer.java:2157) [21:08:19]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.body(GridNioServer.java:1910) [21:08:19]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:125) [21:08:19]W: [org.apache.ignite:ignite-core] at java.lang.Thread.run(Thread.java:748) [21:08:19] : [Step 4/5] [2021-11-19 21:08:19,087][INFO ][exchange-worker-#15897%grid-0%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=7, minorTopVer=0], crd=true, evt=NODE_LEFT, evtNode=10868445-2bda-42f9-b43a-7b1d2bdfc001, customEvt=null, allowMerge=false, exchangeFreeSwitch=true] [21:08:19] : [Step 4/5] [2021-11-19 21:08:19,089][INFO ][sys-#15872%grid-0%][GridAffinityAssignmentCache] Local node affinity assignment distribution is not ideal [cache=encrypted, expectedPrimary=1024.00, actualPrimary=502, expectedBackups=0.00, actualBackups=0, warningThreshold=50.00%] [21:08:19] : [Step 4/5] [2021-11-19 21:08:19,090][INFO ][exchange-worker-#15897%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=7, minorTopVer=0], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:08:19] : [Step 4/5] [2021-11-19 21:08:19,091][INFO ][exchange-worker-#15897%grid-0%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=7, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=7, minorTopVer=0], err=null, rebalanced=true, wasRebalanced=true] [21:08:19]W: [org.apache.ignite:ignite-core] [2021-11-19 21:08:19,093][WARN ][sys-#15879%grid-0%][GridDhtPartitionTopologyImpl] Detected lost partitions [grp=encrypted, parts=[0, 2, 4, 6-7, 10-11, 14, 17, 21, 24-30, 32, 37, 40, 44, 47-52, 54, 57, 59, 62-64, 67-68, 74-75, 78, 81, 87-88, 91, 97, 99, 101-102, 104-107, 113-114, 116, 118, 120, 122, 124, 135-136, 138, 140-145, 147, 149-152, 154-156, 159-160, 162-164, 169, 172, 175-177, 180, 184-187, 190-191, 194, 196-202, 204-205, 209-210, 212, 214, 216, 219-224, 226, 229-232, 237, 239, 241, 243-245, 247, 249-251, 255, 257, 261, 265, 269, 272-273, 276-277, 281-282, 285, 287, 289-291, 293-297, 299, 301-304, 306, 308-309, 311-312, 315-317, 319, 322, 325-326, 328-330, 336, 339, 341, 344-346, 350, 352-354, 357-361, 363, 366-367, 371-373, 376-380, 383, 385, 387-388, 390, 392, 395-397, 400, 402, 405, 408-411, 416, 420, 422, 424-425, 429, 433, 435-438, 440-441, 445-446, 450, 452-453, 455-456, 458, 460, 462-463, 465-468, 470, 474-475, 480, 488, 490-492, 495, 497, 499-512, 516, 525, 527-531, 535, 537-538, 541-542, 545-546, 548-552, 554-555, 558, 562-564, 567-569, 572, 574, 579-580, 582-585, 587, 590-591, 594, 596, 600, 602, 604, 607-614, 617-620, 623-624, 627-629, 632-633, 636, 638, 640-642, 645-646, 648-649, 657-662, 664-665, 668-672, 677-678, 682-684, 686, 689, 692-693, 695-697, 699, 706-707, 709-710, 712-714, 716-717, 719-721, 723-728, 730-732, 734-735, 739, 742, 746, 749-750, 752, 754, 756, 762, 768-770, 772-775, 778, 780, 783-787, 789-791, 793, 796, 798-801, 803, 806, 809-812, 814, 816-817, 819, 822-825, 827-829, 832-833, 836-837, 839-840, 846, 848-851, 853-854, 857-858, 860, 863-864, 866, 868-871, 873-875, 877-878, 884, 888-889, 896-897, 900, 905-907, 914-915, 917, 919-920, 923-925, 931-933, 936, 940, 942, 944-945, 948, 950-951, 954, 956-958, 962, 965-970, 972, 975-976, 978-980, 983, 985, 988, 990, 993-994, 997-998, 1000, 1003-1004, 1007, 1009, 1014, 1016, 1018-1019], topVer=AffinityTopologyVersion [topVer=7, minorTopVer=0]] [21:08:19] : [Step 4/5] [2021-11-19 21:08:19,097][INFO ][exchange-worker-#15897%grid-0%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=00257274-13ec-45e2-bbc6-7e1e40c5d000, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=7, minorTopVer=0], evt=NODE_LEFT, evtNode=TcpDiscoveryNode [id=10868445-2bda-42f9-b43a-7b1d2bdfc001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=6, intOrder=4, lastExchangeTime=1637345298194, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=7, minorTopVer=0]] [21:08:19] : [Step 4/5] [2021-11-19 21:08:19,098][INFO ][exchange-worker-#15897%grid-0%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=7, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=7, minorTopVer=0], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (1 ms), stage="Determine exchange type" (1 ms), stage="Preloading notification" (0 ms), stage="After states restored callback" (0 ms), stage="WAL history reservation" (0 ms), stage="Finalize update counters" (0 ms), stage="Detect lost partitions" (5 ms), stage="Exchange done" (1 ms), stage="Total time" (8 ms)] [21:08:19] : [Step 4/5] [2021-11-19 21:08:19,099][INFO ][exchange-worker-#15897%grid-0%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=7, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=7, minorTopVer=0], stage="Affinity initialization (exchange-free switch on fully-rebalanced topology) [grp=ignite-sys-cache]" (0 ms) (parent=Determine exchange type), stage="Affinity initialization (exchange-free switch on fully-rebalanced topology) [grp=encrypted]" (0 ms) (parent=Determine exchange type)] [21:08:19] : [Step 4/5] [2021-11-19 21:08:19,100][INFO ][exchange-worker-#15897%grid-0%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=7, minorTopVer=0], crd=true] [21:08:19] : [Step 4/5] [2021-11-19 21:08:19,101][INFO ][exchange-worker-#15897%grid-0%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=7, minorTopVer=0], force=false, evt=NODE_LEFT, node=10868445-2bda-42f9-b43a-7b1d2bdfc001] [21:08:19] : [Step 4/5] [2021-11-19 21:08:19,332][INFO ][main][GridCacheProcessor] Stopped cache [cacheName=encrypted] [21:08:19] : [Step 4/5] [2021-11-19 21:08:19,333][INFO ][main][GridCacheProcessor] Stopped cache [cacheName=ignite-sys-cache] [21:08:20] : [Step 4/5] [2021-11-19 21:08:20,212][INFO ][main][FilePageStoreManager] Cleanup cache stores [total=4, left=0, cleanFiles=false] [21:08:20] : [Step 4/5] [2021-11-19 21:08:20,215][INFO ][main][GridDeploymentLocalStore] Removed undeployed class: GridDeployment [ts=1637345298376, depMode=SHARED, clsLdr=IsolatedClassLoader{roleName='test'}, clsLdrId=b2e5d593d71-10868445-2bda-42f9-b43a-7b1d2bdfc001, userVer=0, loc=true, sampleClsName=org.apache.ignite.internal.processors.cache.distributed.dht.preloader.GridDhtPartitionFullMap, pendingUndeploy=false, undeployed=true, usage=0] [21:08:20] : [Step 4/5] [2021-11-19 21:08:20,224][INFO ][main][IgniteKernal%grid-1] [21:08:20] : [Step 4/5] [21:08:20] : [Step 4/5] >>> +------------------------------------------------------+ [21:08:20] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV stopped OK [21:08:20] : [Step 4/5] >>> +------------------------------------------------------+ [21:08:20] : [Step 4/5] >>> Ignite instance name: grid-1 [21:08:20] : [Step 4/5] >>> Grid uptime: 00:00:01.823 [21:08:20] : [Step 4/5] [21:08:20] : [Step 4/5] [21:08:20] : [Step 4/5] [2021-11-19 21:08:20,225][INFO ][main][root] >>> Stopping grid [name=grid-0, id=00257274-13ec-45e2-bbc6-7e1e40c5d000] [21:08:20] : [Step 4/5] [2021-11-19 21:08:20,257][INFO ][db-checkpoint-thread-#16029%grid-0%][Checkpointer] Checkpoint started [checkpointId=324bb535-fae1-46a1-b3ba-c6a2e0c5d827, startPtr=WALPointer [idx=0, fileOff=750075, len=11491], checkpointBeforeLockTime=5ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=1ms, checkpointLockHoldTime=5ms, walCpRecordFsyncDuration=8ms, writeCheckpointEntryDuration=9ms, splitAndSortCpPagesDuration=0ms, pages=574, reason='timeout'] [21:08:20]W: [org.apache.ignite:ignite-core] [2021-11-19 21:08:20,261][WARN ][tcp-disco-sock-reader-[1089858a 127.0.0.1:46113]-#837%grid-0%-#16016%grid-0%][TestTcpDiscoverySpi] Failed to shutdown socket [21:08:20]W: [org.apache.ignite:ignite-core] java.net.SocketException: Socket is closed [21:08:20]W: [org.apache.ignite:ignite-core] at java.net.Socket.shutdownOutput(Socket.java:1568) [21:08:20]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.close(IgniteUtils.java:4247) [21:08:20]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.discovery.tcp.ServerImpl$SocketReader.body(ServerImpl.java:7370) [21:08:20]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.IgniteSpiThread.run(IgniteSpiThread.java:58) [21:08:20] : [Step 4/5] [2021-11-19 21:08:20,263][INFO ][tcp-disco-sock-reader-[1089858a 127.0.0.1:46113]-#837%grid-0%-#16016%grid-0%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:46113, rmtPort=46113, rmtNodeId=1089858a-0d81-4736-a358-ed902524c001] [21:08:20] : [Step 4/5] [2021-11-19 21:08:20,262][INFO ][tcp-disco-sock-reader-[10868445 127.0.0.1:57209]-#855%grid-0%-#16308%grid-0%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:57209, rmtPort=57209, rmtNodeId=10868445-2bda-42f9-b43a-7b1d2bdfc001] [21:08:20] : [Step 4/5] [2021-11-19 21:08:20,262][INFO ][tcp-disco-sock-reader-[103d6c62 127.0.0.1:34833]-#846%grid-0%-#16168%grid-0%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:34833, rmtPort=34833, rmtNodeId=103d6c62-a27a-47dc-91cd-f77fd9df8001] [21:08:20] : [Step 4/5] [2021-11-19 21:08:20,266][INFO ][main][GridCacheProcessor] Stopped cache [cacheName=ignite-sys-cache] [21:08:20] : [Step 4/5] [2021-11-19 21:08:20,267][INFO ][main][GridCacheProcessor] Stopped cache [cacheName=encrypted] [21:08:23] : [Step 4/5] [2021-11-19 21:08:23,553][INFO ][main][FilePageStoreManager] Cleanup cache stores [total=4, left=0, cleanFiles=false] [21:08:23] : [Step 4/5] [2021-11-19 21:08:23,555][INFO ][main][GridDeploymentLocalStore] Removed undeployed class: GridDeployment [ts=1637345288194, depMode=SHARED, clsLdr=IsolatedClassLoader{roleName='test'}, clsLdrId=abb5d593d71-00257274-13ec-45e2-bbc6-7e1e40c5d000, userVer=0, loc=true, sampleClsName=org.apache.ignite.internal.processors.cache.distributed.dht.preloader.GridDhtPartitionMap, pendingUndeploy=false, undeployed=true, usage=0] [21:08:23] : [Step 4/5] [2021-11-19 21:08:23,563][INFO ][main][IgniteKernal%grid-0] [21:08:23] : [Step 4/5] [21:08:23] : [Step 4/5] >>> +------------------------------------------------------+ [21:08:23] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV stopped OK [21:08:23] : [Step 4/5] >>> +------------------------------------------------------+ [21:08:23] : [Step 4/5] >>> Ignite instance name: grid-0 [21:08:23] : [Step 4/5] >>> Grid uptime: 00:00:16.629 [21:08:23] : [Step 4/5] [21:08:23] : [Step 4/5] [21:08:23]W: [org.apache.ignite:ignite-core] [2021-11-19 21:08:23,828][WARN ][test-runner-#16331%encryption.MasterKeyChangeTest%][G] Ignite work directory is not provided, automatically resolved to: /opt/buildagent/work/7bc1c54bc719b67c/work [21:08:23] : [Step 4/5] [2021-11-19 21:08:23,830][INFO ][test-runner-#16331%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] [21:08:23] : [Step 4/5] [21:08:23] : [Step 4/5] >>> __________ ________________ [21:08:23] : [Step 4/5] >>> / _/ ___/ |/ / _/_ __/ __/ [21:08:23] : [Step 4/5] >>> _/ // (7 7 // / / / / _/ [21:08:23] : [Step 4/5] >>> /___/\___/_/|_/___/ /_/ /___/ [21:08:23] : [Step 4/5] >>> [21:08:23] : [Step 4/5] >>> ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:08:23] : [Step 4/5] >>> 2021 Copyright(C) Apache Software Foundation [21:08:23] : [Step 4/5] >>> [21:08:23] : [Step 4/5] >>> Ignite documentation: http://ignite.apache.org [21:08:23] : [Step 4/5] [21:08:23] : [Step 4/5] [2021-11-19 21:08:23,830][INFO ][test-runner-#16331%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] Config URL: n/a [21:08:23] : [Step 4/5] [2021-11-19 21:08:23,830][INFO ][test-runner-#16331%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] IgniteConfiguration [igniteInstanceName=grid-0, pubPoolSize=24, svcPoolSize=24, callbackPoolSize=24, stripedPoolSize=24, sysPoolSize=24, mgmtPoolSize=4, dataStreamerPoolSize=24, utilityCachePoolSize=24, utilityCacheKeepAliveTime=60000, p2pPoolSize=2, qryPoolSize=24, buildIdxPoolSize=4, igniteHome=/opt/buildagent/work/7bc1c54bc719b67c, igniteWorkDir=/opt/buildagent/work/7bc1c54bc719b67c/work, mbeanSrv=com.sun.jmx.mbeanserver.JmxMBeanServer@6fe85038, nodeId=00fde489-de9a-42fc-86db-05e6dcefe000, marsh=BinaryMarshaller [], marshLocJobs=false, daemon=false, p2pEnabled=true, netTimeout=10000, netCompressionLevel=1, sndRetryDelay=1000, sndRetryCnt=3, metricsHistSize=10000, metricsUpdateFreq=1000, metricsExpTime=9223372036854775807, discoSpi=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=0, ackTimeout=0, marsh=null, reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], segPlc=STOP, segResolveAttempts=2, waitForSegOnStart=true, allResolversPassReq=true, segChkFreq=10000, commSpi=TcpCommunicationSpi [connectGate=org.apache.ignite.spi.communication.tcp.internal.ConnectGateway@41247357, ctxInitLatch=java.util.concurrent.CountDownLatch@3b65b576[Count = 1], stopping=false, clientPool=null, nioSrvWrapper=null, stateProvider=null], evtSpi=MemoryEventStorageSpi [expireAgeMs=9223372036854775807, expireCnt=10000, filter=null], colSpi=NoopCollisionSpi [], deploySpi=LocalDeploymentSpi [], indexingSpi=org.apache.ignite.spi.indexing.noop.NoopIndexingSpi@5c73cdc5, addrRslvr=null, encryptionSpi=org.apache.ignite.spi.encryption.keystore.KeystoreEncryptionSpi@11f43fad, tracingSpi=org.apache.ignite.spi.tracing.NoopTracingSpi@2ebd615, clientMode=false, rebalanceThreadPoolSize=4, rebalanceTimeout=10000, rebalanceBatchesPrefetchCnt=3, rebalanceThrottle=0, rebalanceBatchSize=524288, txCfg=TransactionConfiguration [txSerEnabled=false, dfltIsolation=REPEATABLE_READ, dfltConcurrency=PESSIMISTIC, dfltTxTimeout=0, txTimeoutOnPartitionMapExchange=0, deadlockTimeout=10000, pessimisticTxLogSize=0, pessimisticTxLogLinger=10000, tmLookupClsName=null, txManagerFactory=null, useJtaSync=false], cacheSanityCheckEnabled=true, discoStartupDelay=60000, deployMode=SHARED, p2pMissedCacheSize=100, locHost=127.0.0.1, timeSrvPortBase=31100, timeSrvPortRange=100, failureDetectionTimeout=10000, sysWorkerBlockedTimeout=null, clientFailureDetectionTimeout=10000, metricsLogFreq=0, connectorCfg=null, odbcCfg=null, warmupClos=null, atomicCfg=AtomicConfiguration [seqReserveSize=1000, cacheMode=PARTITIONED, backups=1, aff=null, grpName=null], classLdr=null, sslCtxFactory=null, platformCfg=null, binaryCfg=null, memCfg=null, pstCfg=null, dsCfg=DataStorageConfiguration [sysRegionInitSize=41943040, sysRegionMaxSize=104857600, pageSize=4096, concLvl=0, dfltDataRegConf=DataRegionConfiguration [name=default, maxSize=10485760, initSize=268435456, swapPath=null, pageEvictionMode=DISABLED, pageReplacementMode=CLOCK, evictionThreshold=0.9, emptyPagesPoolSize=100, metricsEnabled=false, metricsSubIntervalCount=5, metricsRateTimeInterval=60000, persistenceEnabled=true, checkpointPageBufSize=0, lazyMemoryAllocation=true, warmUpCfg=null], dataRegions=null, storagePath=null, checkpointFreq=180000, lockWaitTime=10000, checkpointThreads=4, checkpointWriteOrder=SEQUENTIAL, walHistSize=20, maxWalArchiveSize=1073741824, walSegments=10, walSegmentSize=67108864, walPath=db/wal, walArchivePath=db/wal/archive, cdcWalPath=db/wal/cdc, cdcEnabled=false, metricsEnabled=false, walMode=FSYNC, walTlbSize=131072, walBuffSize=0, walFlushFreq=2000, walFsyncDelay=1000, walRecordIterBuffSize=67108864, alwaysWriteFullPages=false, fileIOFactory=org.apache.ignite.internal.processors.cache.persistence.file.AsyncFileIOFactory@38529476, metricsSubIntervalCnt=5, metricsRateTimeInterval=60000, walAutoArchiveAfterInactivity=-1, walForceArchiveTimeout=-1, writeThrottlingEnabled=false, walCompactionEnabled=false, walCompactionLevel=1, checkpointReadLockTimeout=null, walPageCompression=DISABLED, walPageCompressionLevel=null, dfltWarmUpCfg=null, encCfg=org.apache.ignite.configuration.EncryptionConfiguration@66543109, defragmentationThreadPoolSize=4, minWalArchiveSize=-1], snapshotPath=snapshots, activeOnStart=true, activeOnStartPropSetFlag=false, autoActivation=true, autoActivationPropSetFlag=false, clusterStateOnStart=null, sqlConnCfg=null, cliConnCfg=ClientConnectorConfiguration [host=null, port=10800, portRange=100, sockSndBufSize=0, sockRcvBufSize=0, tcpNoDelay=true, maxOpenCursorsPerConn=128, threadPoolSize=24, selectorCnt=12, idleTimeout=0, handshakeTimeout=10000, jdbcEnabled=true, odbcEnabled=true, thinCliEnabled=true, sslEnabled=false, useIgniteSslCtxFactory=true, sslClientAuth=false, sslCtxFactory=null, thinCliCfg=ThinClientConfiguration [maxActiveTxPerConn=100, maxActiveComputeTasksPerConn=0]], mvccVacuumThreadCnt=2, mvccVacuumFreq=5000, authEnabled=false, failureHnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]], commFailureRslvr=null, sqlCfg=SqlConfiguration [longQryWarnTimeout=3000, dfltQryTimeout=0, sqlQryHistSize=1000, validationEnabled=false], asyncContinuationExecutor=null] [21:08:23] : [Step 4/5] [2021-11-19 21:08:23,837][INFO ][test-runner-#16331%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] Daemon mode: off [21:08:23] : [Step 4/5] [2021-11-19 21:08:23,838][INFO ][test-runner-#16331%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] OS: Linux 4.15.0-151-generic amd64 [21:08:23] : [Step 4/5] [2021-11-19 21:08:23,838][INFO ][test-runner-#16331%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] OS user: teamcity [21:08:23] : [Step 4/5] [2021-11-19 21:08:23,838][INFO ][test-runner-#16331%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] PID: 16724 [21:08:23] : [Step 4/5] [2021-11-19 21:08:23,838][INFO ][test-runner-#16331%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] Language runtime: Java Platform API Specification ver. 1.8 [21:08:23] : [Step 4/5] [2021-11-19 21:08:23,838][INFO ][test-runner-#16331%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] VM information: Java(TM) SE Runtime Environment 1.8.0_261-b12 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 25.261-b12 [21:08:23] : [Step 4/5] [2021-11-19 21:08:23,839][INFO ][test-runner-#16331%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] VM total memory: 1.9GB [21:08:23] : [Step 4/5] [2021-11-19 21:08:23,839][INFO ][test-runner-#16331%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] Remote Management [restart: off, REST: off, JMX (remote: off)] [21:08:23] : [Step 4/5] [2021-11-19 21:08:23,839][INFO ][test-runner-#16331%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] Logger: GridTestLog4jLogger [quiet=false, config=null] [21:08:23] : [Step 4/5] [2021-11-19 21:08:23,839][INFO ][test-runner-#16331%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] IGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c [21:08:23] : [Step 4/5] [2021-11-19 21:08:23,840][INFO ][test-runner-#16331%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] VM arguments: [-DIGNITE_DUMP_THREADS_ON_FAILURE=false, -DMono=/usr/bin/mono-sgen, -DMono4.0_x64=/usr/lib/mono/4.0, -DMono4.5_x64=/usr/lib/mono/4.5, -DMonoVersion=6.12.0.90, -DSKIP_BUILD=false, -Dagent.home.dir=/opt/buildagent, -Dagent.name=aitc-lin02_03, -Dagent.ownPort=9090, -Dagent.work.dir=/opt/buildagent/work, -Dbuild.number=95, -Dbuild.vcs.number=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.1=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.GitHubApacheIgnite=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dclassworlds.conf=/opt/buildagent/temp/buildTmp/teamcity.m2.conf, -Dcom.jetbrains.maven.watcher.report.file=/opt/buildagent/temp/buildTmp/maven-build-info.xml, -Djava.io.tmpdir=/opt/buildagent/temp/buildTmp, -Dmaven.home=/opt/buildagent/tools/maven3_6, -Dmaven.multiModuleProjectDirectory=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.agent.cpuBenchmark=457, -Dteamcity.agent.dotnet.agent_url=http://localhost:9090/RPC2, -Dteamcity.agent.dotnet.build_id=6278078, -Dteamcity.auth.password=*******, -Dteamcity.auth.userId=TeamCityBuildId=6278078, -Dteamcity.build.changedFiles.file=/opt/buildagent/temp/buildTmp/changedFiles6342607772318147725.txt, -Dteamcity.build.checkoutDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.build.id=6278078, -Dteamcity.build.properties.file=/opt/buildagent/temp/buildTmp/teamcity.build5164517880467851002.properties, -Dteamcity.build.tempDir=/opt/buildagent/temp/buildTmp, -Dteamcity.build.workingDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.buildConfName=Basic 3, -Dteamcity.buildType.id=IgniteTests24Java8_Basic3, -Dteamcity.configuration.properties.file=/opt/buildagent/temp/buildTmp/teamcity.config5591980786735343870.properties, -Dteamcity.maven.userSettings.path=/opt/buildagent/temp/buildTmp/maven_settings_585072866407032347.xml, -Dteamcity.maven.watcher.home=/opt/buildagent/plugins/mavenPlugin/maven-watcher-jdk16, -Dteamcity.projectName=Ignite Tests 2.x (JDK 8/11), -Dteamcity.runner.properties.file=/opt/buildagent/temp/buildTmp/teamcity.runner9098465561618137420.properties, -Dteamcity.tests.recentlyFailedTests.file=/opt/buildagent/temp/buildTmp/testsToRunFirst3891775683130404069.txt, -Dteamcity.version=2021.2 (build 99542), -ea, -Xms2g, -Xmx2g, -XX:+HeapDumpOnOutOfMemoryError, -DIGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_TEST_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_UPDATE_NOTIFIER=false, -DIGNITE_NO_DISCO_ORDER=true, -DIGNITE_PERFORMANCE_SUGGESTIONS_DISABLED=true, -Djava.net.preferIPv4Stack=true, -DTEST_SCALE_FACTOR=1.0, -DIGNITE_TEST_PROP_LOG4J_FILE=log4j-tc-test.xml, -DIGNITE_QUIET=false, -DIGNITE_MARSHAL_BUFFERS_RECHECK=1000, -Dmaven.repo.local=/opt/buildagent/.m2/repository] [21:08:23] : [Step 4/5] [2021-11-19 21:08:23,843][INFO ][test-runner-#16331%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] System cache's DataRegion size is configured to 40 MB. Use DataStorageConfiguration.systemRegionInitialSize property to change the setting. [21:08:23] : [Step 4/5] [2021-11-19 21:08:23,844][INFO ][test-runner-#16331%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] Configured caches [in 'sysMemPlc' dataRegion: ['ignite-sys-cache']] [21:08:23]W: [org.apache.ignite:ignite-core] [2021-11-19 21:08:23,844][WARN ][test-runner-#16331%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] Peer class loading is enabled (disable it in production for performance and deployment consistency reasons) [21:08:23] : [Step 4/5] [2021-11-19 21:08:23,844][INFO ][test-runner-#16331%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] 3-rd party licenses can be found at: /opt/buildagent/work/7bc1c54bc719b67c/libs/licenses [21:08:23] : [Step 4/5] [2021-11-19 21:08:23,847][INFO ][test-runner-#16331%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] Configured plugins: [21:08:23] : [Step 4/5] [2021-11-19 21:08:23,848][INFO ][test-runner-#16331%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] ^-- StanByClusterTestProvider 1.0 [21:08:23] : [Step 4/5] [2021-11-19 21:08:23,848][INFO ][test-runner-#16331%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:08:23] : [Step 4/5] [2021-11-19 21:08:23,848][INFO ][test-runner-#16331%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] [21:08:23] : [Step 4/5] [2021-11-19 21:08:23,848][INFO ][test-runner-#16331%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] ^-- PageMemory tracker plugin 1.0 [21:08:23] : [Step 4/5] [2021-11-19 21:08:23,848][INFO ][test-runner-#16331%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:08:23] : [Step 4/5] [2021-11-19 21:08:23,848][INFO ][test-runner-#16331%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] [21:08:23] : [Step 4/5] [2021-11-19 21:08:23,849][INFO ][test-runner-#16331%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] ^-- TestDistibutedConfigurationPlugin 1.0 [21:08:23] : [Step 4/5] [2021-11-19 21:08:23,849][INFO ][test-runner-#16331%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:08:23] : [Step 4/5] [2021-11-19 21:08:23,849][INFO ][test-runner-#16331%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] [21:08:23] : [Step 4/5] [2021-11-19 21:08:23,849][INFO ][test-runner-#16331%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] ^-- NodeValidationPluginProvider 1.0 [21:08:23] : [Step 4/5] [2021-11-19 21:08:23,849][INFO ][test-runner-#16331%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:08:23] : [Step 4/5] [2021-11-19 21:08:23,849][INFO ][test-runner-#16331%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] [21:08:23] : [Step 4/5] [2021-11-19 21:08:23,850][INFO ][test-runner-#16331%encryption.MasterKeyChangeTest%][FailureProcessor] Configured failure handler: [hnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]]] [21:08:23] : [Step 4/5] [2021-11-19 21:08:23,858][INFO ][test-runner-#16331%encryption.MasterKeyChangeTest%][TestRecordingCommunicationSpi] Successfully bound communication NIO server to TCP port [port=47100, locHost=/127.0.0.1, selectorsCnt=12, selectorSpins=0, pairedConn=false] [21:08:23]W: [org.apache.ignite:ignite-core] [2021-11-19 21:08:23,858][WARN ][test-runner-#16331%encryption.MasterKeyChangeTest%][TestRecordingCommunicationSpi] Message queue limit is set to 0 which may lead to potential OOMEs when running cache operations in FULL_ASYNC or PRIMARY_SYNC modes due to message queues growth on sender and receiver sides. [21:08:23] : [Step 4/5] [2021-11-19 21:08:23,861][INFO ][test-runner-#16331%encryption.MasterKeyChangeTest%][GridCollisionManager] Collision resolution is disabled (all jobs will be activated upon arrival). [21:08:23] : [Step 4/5] [2021-11-19 21:08:23,861][INFO ][test-runner-#16331%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] Security status [authentication=off, sandbox=off, tls/ssl=off] [21:08:23] : [Step 4/5] [2021-11-19 21:08:23,927][INFO ][test-runner-#16331%encryption.MasterKeyChangeTest%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:08:24] : [Step 4/5] [2021-11-19 21:08:24,010][INFO ][test-runner-#16331%encryption.MasterKeyChangeTest%][MaintenanceProcessor] Resolved store directory for node persistent data: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0 [21:08:24] : [Step 4/5] [2021-11-19 21:08:24,011][INFO ][test-runner-#16331%encryption.MasterKeyChangeTest%][CacheObjectBinaryProcessorImpl] Resolved directory for serialized binary metadata: /opt/buildagent/work/7bc1c54bc719b67c/work/db/binary_meta/grid_0 [21:08:24] : [Step 4/5] [2021-11-19 21:08:24,015][INFO ][test-runner-#16331%encryption.MasterKeyChangeTest%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0 [21:08:24] : [Step 4/5] [2021-11-19 21:08:24,016][INFO ][test-runner-#16331%encryption.MasterKeyChangeTest%][FileWriteAheadLogManager] Resolved write ahead log work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0 [21:08:24] : [Step 4/5] [2021-11-19 21:08:24,016][INFO ][test-runner-#16331%encryption.MasterKeyChangeTest%][FileWriteAheadLogManager] Resolved write ahead log archive directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0 [21:08:24] : [Step 4/5] [2021-11-19 21:08:24,979][INFO ][test-runner-#16331%encryption.MasterKeyChangeTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000000.wal [21:08:24]W: [org.apache.ignite:ignite-core] [2021-11-19 21:08:24,979][WARN ][test-runner-#16331%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] DataRegion maxSize=10.5 MB is smaller than defaultInitialSize=268.4 MB, setting initialSize to 10.5 MB [21:08:24] : [Step 4/5] [2021-11-19 21:08:24,983][INFO ][test-runner-#16331%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Configured data regions initialized successfully [total=5] [21:08:25] : [Step 4/5] [2021-11-19 21:08:25,017][INFO ][test-runner-#16331%encryption.MasterKeyChangeTest%][IgniteSnapshotManager] Resolved snapshot work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/snapshots [21:08:25] : [Step 4/5] [2021-11-19 21:08:25,017][INFO ][test-runner-#16331%encryption.MasterKeyChangeTest%][IgniteSnapshotManager] Resolved temp directory for snapshot creation: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0/snp [21:08:25] : [Step 4/5] [2021-11-19 21:08:25,019][INFO ][test-runner-#16331%encryption.MasterKeyChangeTest%][ClientListenerProcessor] Client connector processor has started on TCP port 10800 [21:08:25] : [Step 4/5] [2021-11-19 21:08:25,026][INFO ][test-runner-#16331%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] Non-loopback local IPs: 172.17.0.4 [21:08:25] : [Step 4/5] [2021-11-19 21:08:25,026][INFO ][test-runner-#16331%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] Enabled local MACs: 0242AC110004 [21:08:25] : [Step 4/5] [2021-11-19 21:08:25,029][INFO ][test-runner-#16331%encryption.MasterKeyChangeTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:08:25] : [Step 4/5] [2021-11-19 21:08:25,030][INFO ][test-runner-#16331%encryption.MasterKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:08:25] : [Step 4/5] [2021-11-19 21:08:25,031][INFO ][test-runner-#16331%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:08:25] : [Step 4/5] [2021-11-19 21:08:25,033][INFO ][test-runner-#16331%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Applying lost metastore updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:08:25] : [Step 4/5] [2021-11-19 21:08:25,033][INFO ][test-runner-#16331%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=0 ms] [21:08:25] : [Step 4/5] [2021-11-19 21:08:25,034][INFO ][test-runner-#16331%encryption.MasterKeyChangeTest%][GridCacheProcessor] Restoring partition state for local groups. [21:08:25] : [Step 4/5] [2021-11-19 21:08:25,034][INFO ][test-runner-#16331%encryption.MasterKeyChangeTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=0, partitionsProcessed=0, time=0ms] [21:08:25] : [Step 4/5] [2021-11-19 21:08:25,034][INFO ][test-runner-#16331%encryption.MasterKeyChangeTest%][GridEncryptionManager] Encryption keys loaded from metastore. [grps=, masterKeyName=ignite.master.key] [21:08:25] : [Step 4/5] [2021-11-19 21:08:25,039][INFO ][test-runner-#16331%encryption.MasterKeyChangeTest%][ClusterProcessor] Cluster ID and tag has been read from metastorage: null [21:08:25] : [Step 4/5] [2021-11-19 21:08:25,039][INFO ][test-runner-#16331%encryption.MasterKeyChangeTest%][IgniteClusterImpl] Shutdown policy was updated [oldVal=null, newVal=null] [21:08:25] : [Step 4/5] [2021-11-19 21:08:25,039][INFO ][test-runner-#16331%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Checkpoint frequency deviation changed [oldVal=null, newVal=null] [21:08:25] : [Step 4/5] [2021-11-19 21:08:25,045][INFO ][test-runner-#16331%encryption.MasterKeyChangeTest%][FilePageStoreManager] Cleanup cache stores [total=1, left=0, cleanFiles=false] [21:08:25] : [Step 4/5] [2021-11-19 21:08:25,048][INFO ][test-runner-#16331%encryption.MasterKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:08:25] : [Step 4/5] [2021-11-19 21:08:25,049][INFO ][test-runner-#16331%encryption.MasterKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:08:25] : [Step 4/5] [2021-11-19 21:08:25,050][INFO ][test-runner-#16331%encryption.MasterKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:08:25] : [Step 4/5] [2021-11-19 21:08:25,051][INFO ][test-runner-#16331%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Data Regions Started: 5 [21:08:25] : [Step 4/5] [2021-11-19 21:08:25,051][INFO ][test-runner-#16331%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] ^-- sysMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:08:25] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:08:25] : [Step 4/5] ^-- default region [type=default, persistence=true, lazyAlloc=true, [21:08:25] : [Step 4/5] ... initCfg=10MB, maxCfg=10MB, usedRam=0MB, freeRam=100%, allocRam=0MB, allocTotal=0MB] [21:08:25] : [Step 4/5] ^-- metastoreMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:08:25] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:08:25] : [Step 4/5] ^-- TxLog region [type=internal, persistence=true, lazyAlloc=false, [21:08:25] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:08:25] : [Step 4/5] ^-- volatileDsMemPlc region [type=user, persistence=false, lazyAlloc=true, [21:08:25] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB] [21:08:25] : [Step 4/5] ^-- Ignite persistence [used=0MB] [21:08:25] : [Step 4/5] [21:08:25] : [Step 4/5] [2021-11-19 21:08:25,053][INFO ][test-runner-#16331%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Starting binary memory restore for: [-2100569601] [21:08:25] : [Step 4/5] [2021-11-19 21:08:25,063][INFO ][test-runner-#16331%encryption.MasterKeyChangeTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:08:25] : [Step 4/5] [2021-11-19 21:08:25,064][INFO ][test-runner-#16331%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:08:25] : [Step 4/5] [2021-11-19 21:08:25,065][INFO ][test-runner-#16331%encryption.MasterKeyChangeTest%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000000.wal, offset=0, ver=2] [21:08:25] : [Step 4/5] [2021-11-19 21:08:25,076][INFO ][test-runner-#16331%encryption.MasterKeyChangeTest%][GridCacheProcessor] Started cache in recovery mode [name=ignite-sys-cache, id=-2100569601, dataRegionName=sysMemPlc, mode=REPLICATED, atomicity=TRANSACTIONAL, backups=2147483647, mvcc=false] [21:08:25] : [Step 4/5] [2021-11-19 21:08:25,077][INFO ][test-runner-#16331%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Binary recovery performed in 24 ms. [21:08:25] : [Step 4/5] [2021-11-19 21:08:25,077][INFO ][test-runner-#16331%encryption.MasterKeyChangeTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:08:25] : [Step 4/5] [2021-11-19 21:08:25,078][INFO ][test-runner-#16331%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Applying lost cache updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:08:25] : [Step 4/5] [2021-11-19 21:08:25,147][INFO ][test-runner-#16331%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=71 ms] [21:08:25] : [Step 4/5] [2021-11-19 21:08:25,148][INFO ][test-runner-#16331%encryption.MasterKeyChangeTest%][GridCacheProcessor] Restoring partition state for local groups. [21:08:25] : [Step 4/5] [2021-11-19 21:08:25,154][INFO ][test-runner-#16331%encryption.MasterKeyChangeTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=1, partitionsProcessed=100, time=0ms] [21:08:25] : [Step 4/5] [2021-11-19 21:08:25,845][INFO ][test-runner-#16331%encryption.MasterKeyChangeTest%][TestTcpDiscoverySpi] Successfully bound to TCP port [port=47500, localHost=localhost/127.0.0.1, locNodeId=00fde489-de9a-42fc-86db-05e6dcefe000] [21:08:25] : [Step 4/5] [2021-11-19 21:08:25,860][INFO ][disco-notifier-worker-#16442%grid-0%][MvccProcessorImpl] Assigned mvcc coordinator [crd=MvccCoordinator [topVer=AffinityTopologyVersion [topVer=1, minorTopVer=0], nodeId=00fde489-de9a-42fc-86db-05e6dcefe000, ver=1637345305855, local=true, initialized=false]] [21:08:25] : [Step 4/5] [2021-11-19 21:08:25,863][INFO ][sys-#16429%grid-0%][ClusterProcessor] Writing cluster ID and tag to metastorage on ready for write ClusterIdAndTag [id=974f2689-055e-4379-8a5d-034c89e8c2ae, tag=kind_chatelet] [21:08:25] : [Step 4/5] [2021-11-19 21:08:25,866][INFO ][disco-notifier-worker-#16442%grid-0%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustEnabled' was changed from 'null' to 'false' [21:08:25] : [Step 4/5] [2021-11-19 21:08:25,867][INFO ][disco-notifier-worker-#16442%grid-0%][ClusterProcessor] kind_chatelet [21:08:25] : [Step 4/5] [2021-11-19 21:08:25,868][INFO ][disco-notifier-worker-#16442%grid-0%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustTimeout' was changed from 'null' to '300000' [21:08:25] : [Step 4/5] [2021-11-19 21:08:25,868][INFO ][disco-notifier-worker-#16442%grid-0%][IgniteTxManager] Transactions parameter 'longOperationsDumpTimeout' was changed from 'null' to '60000' [21:08:25] : [Step 4/5] [2021-11-19 21:08:25,869][INFO ][disco-notifier-worker-#16442%grid-0%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpThreshold' was changed from 'null' to '0' [21:08:25] : [Step 4/5] [2021-11-19 21:08:25,869][INFO ][disco-notifier-worker-#16442%grid-0%][IgniteTxManager] Transactions parameter 'transactionTimeDumpSamplesCoefficient' was changed from 'null' to '0.0' [21:08:25] : [Step 4/5] [2021-11-19 21:08:25,870][INFO ][disco-notifier-worker-#16442%grid-0%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpSamplesPerSecondLimit' was changed from 'null' to '5' [21:08:25] : [Step 4/5] [2021-11-19 21:08:25,871][INFO ][disco-notifier-worker-#16442%grid-0%][IgniteTxManager] Transactions parameter 'collisionsDumpInterval' was changed from 'null' to '1000' [21:08:25] : [Step 4/5] [2021-11-19 21:08:25,871][INFO ][disco-notifier-worker-#16442%grid-0%][IgniteTxManager] Transactions parameter 'txOwnerDumpRequestsAllowed' was changed from 'null' to 'true' [21:08:25] : [Step 4/5] [2021-11-19 21:08:25,873][INFO ][disco-notifier-worker-#16442%grid-0%][GridCacheDatabaseSharedManager] Historical rebalance WAL threshold changed [property=historical.rebalance.threshold, oldVal=null, newVal=500] [21:08:25] : [Step 4/5] [2021-11-19 21:08:25,873][INFO ][test-runner-#16331%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] To start Console Management & Monitoring run ignitevisorcmd.{sh|bat} [21:08:25] : [Step 4/5] [2021-11-19 21:08:25,874][INFO ][test-runner-#16331%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] [21:08:25] : [Step 4/5] [21:08:25] : [Step 4/5] >>> +-------------------------------------------+ [21:08:25] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:08:25] : [Step 4/5] >>> +-------------------------------------------+ [21:08:25] : [Step 4/5] >>> OS name: Linux 4.15.0-151-generic amd64 [21:08:25] : [Step 4/5] >>> CPU(s): 24 [21:08:25] : [Step 4/5] >>> Heap: 2.0GB [21:08:25] : [Step 4/5] >>> VM name: 16724@c4dfe9a430b2 [21:08:25] : [Step 4/5] >>> Ignite instance name: grid-0 [21:08:25] : [Step 4/5] >>> Local node [ID=00FDE489-DE9A-42FC-86DB-05E6DCEFE000, order=1, clientMode=false] [21:08:25] : [Step 4/5] >>> Local node addresses: [127.0.0.1] [21:08:25] : [Step 4/5] >>> Local ports: TCP:10800 TCP:47100 TCP:47500 [21:08:25] : [Step 4/5] [21:08:25] : [Step 4/5] [2021-11-19 21:08:25,875][INFO ][test-runner-#16331%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] >>> Ignite cluster is in INACTIVE state (limited functionality available). Use control.(sh|bat) script or IgniteCluster.state(ClusterState.ACTIVE) to change the state. [21:08:25] : [Step 4/5] [2021-11-19 21:08:25,875][INFO ][test-runner-#16331%encryption.MasterKeyChangeTest%][GridDiscoveryManager] Topology snapshot [ver=1, locNode=00fde489, servers=1, clients=0, state=INACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=00fde489-de9a-42fc-86db-05e6dcefe000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:08:25] : [Step 4/5] [2021-11-19 21:08:25,876][INFO ][test-runner-#16331%encryption.MasterKeyChangeTest%][G] Node started : [stage="Configure system pool" (0 ms),stage="Start managers" (182 ms),stage="Configure binary metadata" (1 ms),stage="Start processors" (1011 ms),stage="Start 'StanByClusterTestProvider' plugin" (0 ms),stage="Start 'PageMemory tracker plugin' plugin" (0 ms),stage="Start 'TestDistibutedConfigurationPlugin' plugin" (0 ms),stage="Start 'NodeValidationPluginProvider' plugin" (0 ms),stage="Init metastore" (19 ms),stage="Init and start regions" (8 ms),stage="Restore binary memory" (24 ms),stage="Restore logical state" (76 ms),stage="Finish recovery" (689 ms),stage="Join topology" (17 ms),stage="Await transition" (2 ms),stage="Await exchange" (12 ms),stage="Total time" (2041 ms)] [21:08:25] : [Step 4/5] [2021-11-19 21:08:25,877][INFO ][test-runner-#16331%encryption.MasterKeyChangeTest%][root] Node started with the following configuration [id=00fde489-de9a-42fc-86db-05e6dcefe000, marshaller=BinaryMarshaller [], discovery=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=5000, ackTimeout=5000, marsh=JdkMarshaller [clsFilter=org.apache.ignite.marshaller.MarshallerUtils$1@34b03ff6], reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], binaryCfg=null, lateAff=true] [21:08:25]W: [org.apache.ignite:ignite-core] [2021-11-19 21:08:25,883][WARN ][test-runner-#16331%encryption.MasterKeyChangeTest%][G] Ignite work directory is not provided, automatically resolved to: /opt/buildagent/work/7bc1c54bc719b67c/work [21:08:25] : [Step 4/5] [2021-11-19 21:08:25,885][INFO ][test-runner-#16331%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] [21:08:25] : [Step 4/5] [21:08:25] : [Step 4/5] >>> __________ ________________ [21:08:25] : [Step 4/5] >>> / _/ ___/ |/ / _/_ __/ __/ [21:08:25] : [Step 4/5] >>> _/ // (7 7 // / / / / _/ [21:08:25] : [Step 4/5] >>> /___/\___/_/|_/___/ /_/ /___/ [21:08:25] : [Step 4/5] >>> [21:08:25] : [Step 4/5] >>> ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:08:25] : [Step 4/5] >>> 2021 Copyright(C) Apache Software Foundation [21:08:25] : [Step 4/5] >>> [21:08:25] : [Step 4/5] >>> Ignite documentation: http://ignite.apache.org [21:08:25] : [Step 4/5] [21:08:25] : [Step 4/5] [2021-11-19 21:08:25,885][INFO ][test-runner-#16331%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] Config URL: n/a [21:08:25] : [Step 4/5] [2021-11-19 21:08:25,886][INFO ][test-runner-#16331%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] IgniteConfiguration [igniteInstanceName=grid-1, pubPoolSize=24, svcPoolSize=24, callbackPoolSize=24, stripedPoolSize=24, sysPoolSize=24, mgmtPoolSize=4, dataStreamerPoolSize=24, utilityCachePoolSize=24, utilityCacheKeepAliveTime=60000, p2pPoolSize=2, qryPoolSize=24, buildIdxPoolSize=4, igniteHome=/opt/buildagent/work/7bc1c54bc719b67c, igniteWorkDir=/opt/buildagent/work/7bc1c54bc719b67c/work, mbeanSrv=com.sun.jmx.mbeanserver.JmxMBeanServer@6fe85038, nodeId=1042764c-e469-4e0e-ae46-3a3936f00001, marsh=BinaryMarshaller [], marshLocJobs=false, daemon=false, p2pEnabled=true, netTimeout=10000, netCompressionLevel=1, sndRetryDelay=1000, sndRetryCnt=3, metricsHistSize=10000, metricsUpdateFreq=1000, metricsExpTime=9223372036854775807, discoSpi=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=0, ackTimeout=0, marsh=null, reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], segPlc=STOP, segResolveAttempts=2, waitForSegOnStart=true, allResolversPassReq=true, segChkFreq=10000, commSpi=TcpCommunicationSpi [connectGate=org.apache.ignite.spi.communication.tcp.internal.ConnectGateway@1dd04a24, ctxInitLatch=java.util.concurrent.CountDownLatch@12572808[Count = 1], stopping=false, clientPool=null, nioSrvWrapper=null, stateProvider=null], evtSpi=MemoryEventStorageSpi [expireAgeMs=9223372036854775807, expireCnt=10000, filter=null], colSpi=NoopCollisionSpi [], deploySpi=LocalDeploymentSpi [], indexingSpi=org.apache.ignite.spi.indexing.noop.NoopIndexingSpi@274657f1, addrRslvr=null, encryptionSpi=org.apache.ignite.spi.encryption.keystore.KeystoreEncryptionSpi@43d1e064, tracingSpi=org.apache.ignite.spi.tracing.NoopTracingSpi@76013d12, clientMode=false, rebalanceThreadPoolSize=4, rebalanceTimeout=10000, rebalanceBatchesPrefetchCnt=3, rebalanceThrottle=0, rebalanceBatchSize=524288, txCfg=TransactionConfiguration [txSerEnabled=false, dfltIsolation=REPEATABLE_READ, dfltConcurrency=PESSIMISTIC, dfltTxTimeout=0, txTimeoutOnPartitionMapExchange=0, deadlockTimeout=10000, pessimisticTxLogSize=0, pessimisticTxLogLinger=10000, tmLookupClsName=null, txManagerFactory=null, useJtaSync=false], cacheSanityCheckEnabled=true, discoStartupDelay=60000, deployMode=SHARED, p2pMissedCacheSize=100, locHost=127.0.0.1, timeSrvPortBase=31100, timeSrvPortRange=100, failureDetectionTimeout=10000, sysWorkerBlockedTimeout=null, clientFailureDetectionTimeout=10000, metricsLogFreq=0, connectorCfg=null, odbcCfg=null, warmupClos=null, atomicCfg=AtomicConfiguration [seqReserveSize=1000, cacheMode=PARTITIONED, backups=1, aff=null, grpName=null], classLdr=null, sslCtxFactory=null, platformCfg=null, binaryCfg=null, memCfg=null, pstCfg=null, dsCfg=DataStorageConfiguration [sysRegionInitSize=41943040, sysRegionMaxSize=104857600, pageSize=4096, concLvl=0, dfltDataRegConf=DataRegionConfiguration [name=default, maxSize=10485760, initSize=268435456, swapPath=null, pageEvictionMode=DISABLED, pageReplacementMode=CLOCK, evictionThreshold=0.9, emptyPagesPoolSize=100, metricsEnabled=false, metricsSubIntervalCount=5, metricsRateTimeInterval=60000, persistenceEnabled=true, checkpointPageBufSize=0, lazyMemoryAllocation=true, warmUpCfg=null], dataRegions=null, storagePath=null, checkpointFreq=180000, lockWaitTime=10000, checkpointThreads=4, checkpointWriteOrder=SEQUENTIAL, walHistSize=20, maxWalArchiveSize=1073741824, walSegments=10, walSegmentSize=67108864, walPath=db/wal, walArchivePath=db/wal/archive, cdcWalPath=db/wal/cdc, cdcEnabled=false, metricsEnabled=false, walMode=FSYNC, walTlbSize=131072, walBuffSize=0, walFlushFreq=2000, walFsyncDelay=1000, walRecordIterBuffSize=67108864, alwaysWriteFullPages=false, fileIOFactory=org.apache.ignite.internal.processors.cache.persistence.file.AsyncFileIOFactory@68f46e75, metricsSubIntervalCnt=5, metricsRateTimeInterval=60000, walAutoArchiveAfterInactivity=-1, walForceArchiveTimeout=-1, writeThrottlingEnabled=false, walCompactionEnabled=false, walCompactionLevel=1, checkpointReadLockTimeout=null, walPageCompression=DISABLED, walPageCompressionLevel=null, dfltWarmUpCfg=null, encCfg=org.apache.ignite.configuration.EncryptionConfiguration@34841bf1, defragmentationThreadPoolSize=4, minWalArchiveSize=-1], snapshotPath=snapshots, activeOnStart=true, activeOnStartPropSetFlag=false, autoActivation=true, autoActivationPropSetFlag=false, clusterStateOnStart=null, sqlConnCfg=null, cliConnCfg=ClientConnectorConfiguration [host=null, port=10800, portRange=100, sockSndBufSize=0, sockRcvBufSize=0, tcpNoDelay=true, maxOpenCursorsPerConn=128, threadPoolSize=24, selectorCnt=12, idleTimeout=0, handshakeTimeout=10000, jdbcEnabled=true, odbcEnabled=true, thinCliEnabled=true, sslEnabled=false, useIgniteSslCtxFactory=true, sslClientAuth=false, sslCtxFactory=null, thinCliCfg=ThinClientConfiguration [maxActiveTxPerConn=100, maxActiveComputeTasksPerConn=0]], mvccVacuumThreadCnt=2, mvccVacuumFreq=5000, authEnabled=false, failureHnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]], commFailureRslvr=null, sqlCfg=SqlConfiguration [longQryWarnTimeout=3000, dfltQryTimeout=0, sqlQryHistSize=1000, validationEnabled=false], asyncContinuationExecutor=null] [21:08:25] : [Step 4/5] [2021-11-19 21:08:25,895][INFO ][test-runner-#16331%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] Daemon mode: off [21:08:25] : [Step 4/5] [2021-11-19 21:08:25,896][INFO ][test-runner-#16331%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] OS: Linux 4.15.0-151-generic amd64 [21:08:25] : [Step 4/5] [2021-11-19 21:08:25,896][INFO ][test-runner-#16331%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] OS user: teamcity [21:08:25] : [Step 4/5] [2021-11-19 21:08:25,896][INFO ][test-runner-#16331%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] PID: 16724 [21:08:25] : [Step 4/5] [2021-11-19 21:08:25,896][INFO ][test-runner-#16331%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] Language runtime: Java Platform API Specification ver. 1.8 [21:08:25] : [Step 4/5] [2021-11-19 21:08:25,897][INFO ][test-runner-#16331%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] VM information: Java(TM) SE Runtime Environment 1.8.0_261-b12 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 25.261-b12 [21:08:25] : [Step 4/5] [2021-11-19 21:08:25,897][INFO ][test-runner-#16331%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] VM total memory: 1.9GB [21:08:25] : [Step 4/5] [2021-11-19 21:08:25,897][INFO ][test-runner-#16331%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] Remote Management [restart: off, REST: off, JMX (remote: off)] [21:08:25] : [Step 4/5] [2021-11-19 21:08:25,897][INFO ][test-runner-#16331%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] Logger: GridTestLog4jLogger [quiet=false, config=null] [21:08:25] : [Step 4/5] [2021-11-19 21:08:25,898][INFO ][test-runner-#16331%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] IGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c [21:08:25] : [Step 4/5] [2021-11-19 21:08:25,898][INFO ][test-runner-#16331%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] VM arguments: [-DIGNITE_DUMP_THREADS_ON_FAILURE=false, -DMono=/usr/bin/mono-sgen, -DMono4.0_x64=/usr/lib/mono/4.0, -DMono4.5_x64=/usr/lib/mono/4.5, -DMonoVersion=6.12.0.90, -DSKIP_BUILD=false, -Dagent.home.dir=/opt/buildagent, -Dagent.name=aitc-lin02_03, -Dagent.ownPort=9090, -Dagent.work.dir=/opt/buildagent/work, -Dbuild.number=95, -Dbuild.vcs.number=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.1=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.GitHubApacheIgnite=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dclassworlds.conf=/opt/buildagent/temp/buildTmp/teamcity.m2.conf, -Dcom.jetbrains.maven.watcher.report.file=/opt/buildagent/temp/buildTmp/maven-build-info.xml, -Djava.io.tmpdir=/opt/buildagent/temp/buildTmp, -Dmaven.home=/opt/buildagent/tools/maven3_6, -Dmaven.multiModuleProjectDirectory=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.agent.cpuBenchmark=457, -Dteamcity.agent.dotnet.agent_url=http://localhost:9090/RPC2, -Dteamcity.agent.dotnet.build_id=6278078, -Dteamcity.auth.password=*******, -Dteamcity.auth.userId=TeamCityBuildId=6278078, -Dteamcity.build.changedFiles.file=/opt/buildagent/temp/buildTmp/changedFiles6342607772318147725.txt, -Dteamcity.build.checkoutDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.build.id=6278078, -Dteamcity.build.properties.file=/opt/buildagent/temp/buildTmp/teamcity.build5164517880467851002.properties, -Dteamcity.build.tempDir=/opt/buildagent/temp/buildTmp, -Dteamcity.build.workingDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.buildConfName=Basic 3, -Dteamcity.buildType.id=IgniteTests24Java8_Basic3, -Dteamcity.configuration.properties.file=/opt/buildagent/temp/buildTmp/teamcity.config5591980786735343870.properties, -Dteamcity.maven.userSettings.path=/opt/buildagent/temp/buildTmp/maven_settings_585072866407032347.xml, -Dteamcity.maven.watcher.home=/opt/buildagent/plugins/mavenPlugin/maven-watcher-jdk16, -Dteamcity.projectName=Ignite Tests 2.x (JDK 8/11), -Dteamcity.runner.properties.file=/opt/buildagent/temp/buildTmp/teamcity.runner9098465561618137420.properties, -Dteamcity.tests.recentlyFailedTests.file=/opt/buildagent/temp/buildTmp/testsToRunFirst3891775683130404069.txt, -Dteamcity.version=2021.2 (build 99542), -ea, -Xms2g, -Xmx2g, -XX:+HeapDumpOnOutOfMemoryError, -DIGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_TEST_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_UPDATE_NOTIFIER=false, -DIGNITE_NO_DISCO_ORDER=true, -DIGNITE_PERFORMANCE_SUGGESTIONS_DISABLED=true, -Djava.net.preferIPv4Stack=true, -DTEST_SCALE_FACTOR=1.0, -DIGNITE_TEST_PROP_LOG4J_FILE=log4j-tc-test.xml, -DIGNITE_QUIET=false, -DIGNITE_MARSHAL_BUFFERS_RECHECK=1000, -Dmaven.repo.local=/opt/buildagent/.m2/repository] [21:08:25] : [Step 4/5] [2021-11-19 21:08:25,902][INFO ][test-runner-#16331%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] System cache's DataRegion size is configured to 40 MB. Use DataStorageConfiguration.systemRegionInitialSize property to change the setting. [21:08:25] : [Step 4/5] [2021-11-19 21:08:25,903][INFO ][test-runner-#16331%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] Configured caches [in 'sysMemPlc' dataRegion: ['ignite-sys-cache']] [21:08:25]W: [org.apache.ignite:ignite-core] [2021-11-19 21:08:25,903][WARN ][test-runner-#16331%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] Peer class loading is enabled (disable it in production for performance and deployment consistency reasons) [21:08:25] : [Step 4/5] [2021-11-19 21:08:25,903][INFO ][test-runner-#16331%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] 3-rd party licenses can be found at: /opt/buildagent/work/7bc1c54bc719b67c/libs/licenses [21:08:25] : [Step 4/5] [2021-11-19 21:08:25,907][INFO ][test-runner-#16331%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] Configured plugins: [21:08:25] : [Step 4/5] [2021-11-19 21:08:25,907][INFO ][test-runner-#16331%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] ^-- StanByClusterTestProvider 1.0 [21:08:25] : [Step 4/5] [2021-11-19 21:08:25,907][INFO ][test-runner-#16331%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:08:25] : [Step 4/5] [2021-11-19 21:08:25,907][INFO ][test-runner-#16331%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] [21:08:25] : [Step 4/5] [2021-11-19 21:08:25,907][INFO ][test-runner-#16331%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] ^-- PageMemory tracker plugin 1.0 [21:08:25] : [Step 4/5] [2021-11-19 21:08:25,907][INFO ][test-runner-#16331%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:08:25] : [Step 4/5] [2021-11-19 21:08:25,908][INFO ][test-runner-#16331%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] [21:08:25] : [Step 4/5] [2021-11-19 21:08:25,908][INFO ][test-runner-#16331%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] ^-- TestDistibutedConfigurationPlugin 1.0 [21:08:25] : [Step 4/5] [2021-11-19 21:08:25,908][INFO ][test-runner-#16331%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:08:25] : [Step 4/5] [2021-11-19 21:08:25,908][INFO ][test-runner-#16331%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] [21:08:25] : [Step 4/5] [2021-11-19 21:08:25,908][INFO ][test-runner-#16331%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] ^-- NodeValidationPluginProvider 1.0 [21:08:25] : [Step 4/5] [2021-11-19 21:08:25,908][INFO ][test-runner-#16331%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:08:25] : [Step 4/5] [2021-11-19 21:08:25,908][INFO ][test-runner-#16331%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] [21:08:25] : [Step 4/5] [2021-11-19 21:08:25,909][INFO ][test-runner-#16331%encryption.MasterKeyChangeTest%][FailureProcessor] Configured failure handler: [hnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]]] [21:08:25] : [Step 4/5] [2021-11-19 21:08:25,921][INFO ][test-runner-#16331%encryption.MasterKeyChangeTest%][TestRecordingCommunicationSpi] Successfully bound communication NIO server to TCP port [port=47101, locHost=/127.0.0.1, selectorsCnt=12, selectorSpins=0, pairedConn=false] [21:08:25]W: [org.apache.ignite:ignite-core] [2021-11-19 21:08:25,922][WARN ][test-runner-#16331%encryption.MasterKeyChangeTest%][TestRecordingCommunicationSpi] Message queue limit is set to 0 which may lead to potential OOMEs when running cache operations in FULL_ASYNC or PRIMARY_SYNC modes due to message queues growth on sender and receiver sides. [21:08:25] : [Step 4/5] [2021-11-19 21:08:25,925][INFO ][test-runner-#16331%encryption.MasterKeyChangeTest%][GridCollisionManager] Collision resolution is disabled (all jobs will be activated upon arrival). [21:08:25] : [Step 4/5] [2021-11-19 21:08:25,926][INFO ][test-runner-#16331%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] Security status [authentication=off, sandbox=off, tls/ssl=off] [21:08:25] : [Step 4/5] [2021-11-19 21:08:25,981][INFO ][test-runner-#16331%encryption.MasterKeyChangeTest%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:08:26] : [Step 4/5] [2021-11-19 21:08:26,063][INFO ][test-runner-#16331%encryption.MasterKeyChangeTest%][MaintenanceProcessor] Resolved store directory for node persistent data: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1 [21:08:26] : [Step 4/5] [2021-11-19 21:08:26,064][INFO ][test-runner-#16331%encryption.MasterKeyChangeTest%][CacheObjectBinaryProcessorImpl] Resolved directory for serialized binary metadata: /opt/buildagent/work/7bc1c54bc719b67c/work/db/binary_meta/grid_1 [21:08:26] : [Step 4/5] [2021-11-19 21:08:26,067][INFO ][test-runner-#16331%encryption.MasterKeyChangeTest%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1 [21:08:26] : [Step 4/5] [2021-11-19 21:08:26,068][INFO ][test-runner-#16331%encryption.MasterKeyChangeTest%][FileWriteAheadLogManager] Resolved write ahead log work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1 [21:08:26] : [Step 4/5] [2021-11-19 21:08:26,068][INFO ][test-runner-#16331%encryption.MasterKeyChangeTest%][FileWriteAheadLogManager] Resolved write ahead log archive directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1 [21:08:26] : [Step 4/5] [2021-11-19 21:08:26,980][INFO ][test-runner-#16331%encryption.MasterKeyChangeTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000000.wal [21:08:26] : [Step 4/5] [2021-11-19 21:08:26,985][INFO ][test-runner-#16331%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Configured data regions initialized successfully [total=5] [21:08:26] : [Step 4/5] [2021-11-19 21:08:26,990][INFO ][test-runner-#16331%encryption.MasterKeyChangeTest%][IgniteSnapshotManager] Resolved snapshot work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/snapshots [21:08:26] : [Step 4/5] [2021-11-19 21:08:26,990][INFO ][test-runner-#16331%encryption.MasterKeyChangeTest%][IgniteSnapshotManager] Resolved temp directory for snapshot creation: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1/snp [21:08:26] : [Step 4/5] [2021-11-19 21:08:26,994][INFO ][test-runner-#16331%encryption.MasterKeyChangeTest%][ClientListenerProcessor] Client connector processor has started on TCP port 10801 [21:08:26] : [Step 4/5] [2021-11-19 21:08:26,996][INFO ][test-runner-#16331%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] Non-loopback local IPs: 172.17.0.4 [21:08:26] : [Step 4/5] [2021-11-19 21:08:26,997][INFO ][test-runner-#16331%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] Enabled local MACs: 0242AC110004 [21:08:26] : [Step 4/5] [2021-11-19 21:08:26,998][INFO ][test-runner-#16331%encryption.MasterKeyChangeTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:08:27] : [Step 4/5] [2021-11-19 21:08:26,999][INFO ][test-runner-#16331%encryption.MasterKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:08:27] : [Step 4/5] [2021-11-19 21:08:26,999][INFO ][test-runner-#16331%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:08:27] : [Step 4/5] [2021-11-19 21:08:27,002][INFO ][test-runner-#16331%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Applying lost metastore updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:08:27] : [Step 4/5] [2021-11-19 21:08:27,003][INFO ][test-runner-#16331%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=0 ms] [21:08:27] : [Step 4/5] [2021-11-19 21:08:27,003][INFO ][test-runner-#16331%encryption.MasterKeyChangeTest%][GridCacheProcessor] Restoring partition state for local groups. [21:08:27] : [Step 4/5] [2021-11-19 21:08:27,004][INFO ][test-runner-#16331%encryption.MasterKeyChangeTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=0, partitionsProcessed=0, time=0ms] [21:08:27] : [Step 4/5] [2021-11-19 21:08:27,005][INFO ][test-runner-#16331%encryption.MasterKeyChangeTest%][GridEncryptionManager] Encryption keys loaded from metastore. [grps=, masterKeyName=ignite.master.key] [21:08:27] : [Step 4/5] [2021-11-19 21:08:27,006][INFO ][test-runner-#16331%encryption.MasterKeyChangeTest%][ClusterProcessor] Cluster ID and tag has been read from metastorage: null [21:08:27] : [Step 4/5] [2021-11-19 21:08:27,007][INFO ][test-runner-#16331%encryption.MasterKeyChangeTest%][IgniteClusterImpl] Shutdown policy was updated [oldVal=null, newVal=null] [21:08:27] : [Step 4/5] [2021-11-19 21:08:27,007][INFO ][test-runner-#16331%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Checkpoint frequency deviation changed [oldVal=null, newVal=null] [21:08:27] : [Step 4/5] [2021-11-19 21:08:27,020][INFO ][test-runner-#16331%encryption.MasterKeyChangeTest%][FilePageStoreManager] Cleanup cache stores [total=1, left=0, cleanFiles=false] [21:08:27] : [Step 4/5] [2021-11-19 21:08:27,022][INFO ][test-runner-#16331%encryption.MasterKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:08:27] : [Step 4/5] [2021-11-19 21:08:27,023][INFO ][test-runner-#16331%encryption.MasterKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:08:27] : [Step 4/5] [2021-11-19 21:08:27,025][INFO ][test-runner-#16331%encryption.MasterKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:08:27] : [Step 4/5] [2021-11-19 21:08:27,025][INFO ][test-runner-#16331%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Data Regions Started: 5 [21:08:27] : [Step 4/5] [2021-11-19 21:08:27,026][INFO ][test-runner-#16331%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] ^-- sysMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:08:27] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:08:27] : [Step 4/5] ^-- default region [type=default, persistence=true, lazyAlloc=true, [21:08:27] : [Step 4/5] ... initCfg=10MB, maxCfg=10MB, usedRam=0MB, freeRam=100%, allocRam=0MB, allocTotal=0MB] [21:08:27] : [Step 4/5] ^-- metastoreMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:08:27] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:08:27] : [Step 4/5] ^-- TxLog region [type=internal, persistence=true, lazyAlloc=false, [21:08:27] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:08:27] : [Step 4/5] ^-- volatileDsMemPlc region [type=user, persistence=false, lazyAlloc=true, [21:08:27] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB] [21:08:27] : [Step 4/5] ^-- Ignite persistence [used=0MB] [21:08:27] : [Step 4/5] [21:08:27] : [Step 4/5] [2021-11-19 21:08:27,028][INFO ][test-runner-#16331%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Starting binary memory restore for: [-2100569601] [21:08:27] : [Step 4/5] [2021-11-19 21:08:27,039][INFO ][test-runner-#16331%encryption.MasterKeyChangeTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:08:27] : [Step 4/5] [2021-11-19 21:08:27,039][INFO ][test-runner-#16331%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:08:27] : [Step 4/5] [2021-11-19 21:08:27,040][INFO ][test-runner-#16331%encryption.MasterKeyChangeTest%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000000.wal, offset=0, ver=2] [21:08:27] : [Step 4/5] [2021-11-19 21:08:27,049][INFO ][test-runner-#16331%encryption.MasterKeyChangeTest%][GridCacheProcessor] Started cache in recovery mode [name=ignite-sys-cache, id=-2100569601, dataRegionName=sysMemPlc, mode=REPLICATED, atomicity=TRANSACTIONAL, backups=2147483647, mvcc=false] [21:08:27] : [Step 4/5] [2021-11-19 21:08:27,050][INFO ][test-runner-#16331%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Binary recovery performed in 22 ms. [21:08:27] : [Step 4/5] [2021-11-19 21:08:27,050][INFO ][test-runner-#16331%encryption.MasterKeyChangeTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:08:27] : [Step 4/5] [2021-11-19 21:08:27,050][INFO ][test-runner-#16331%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Applying lost cache updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:08:27] : [Step 4/5] [2021-11-19 21:08:27,116][INFO ][test-runner-#16331%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=71 ms] [21:08:27] : [Step 4/5] [2021-11-19 21:08:27,117][INFO ][test-runner-#16331%encryption.MasterKeyChangeTest%][GridCacheProcessor] Restoring partition state for local groups. [21:08:27] : [Step 4/5] [2021-11-19 21:08:27,123][INFO ][test-runner-#16331%encryption.MasterKeyChangeTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=1, partitionsProcessed=100, time=0ms] [21:08:27] : [Step 4/5] [2021-11-19 21:08:27,912][INFO ][test-runner-#16331%encryption.MasterKeyChangeTest%][TestTcpDiscoverySpi] Successfully bound to TCP port [port=47501, localHost=localhost/127.0.0.1, locNodeId=1042764c-e469-4e0e-ae46-3a3936f00001] [21:08:27] : [Step 4/5] [2021-11-19 21:08:27,915][INFO ][tcp-disco-srvr-[:47500]-#860%grid-0%-#16444%grid-0%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=51471] [21:08:27] : [Step 4/5] [2021-11-19 21:08:27,916][INFO ][tcp-disco-srvr-[:47500]-#860%grid-0%-#16444%grid-0%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=51471] [21:08:27] : [Step 4/5] [2021-11-19 21:08:27,916][INFO ][tcp-disco-sock-reader-[]-#866%grid-0%-#16563%grid-0%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:51471, rmtPort=51471] [21:08:27] : [Step 4/5] [2021-11-19 21:08:27,917][INFO ][tcp-disco-sock-reader-[1042764c 127.0.0.1:51471]-#866%grid-0%-#16563%grid-0%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=1042764c-e469-4e0e-ae46-3a3936f00001, rmtAddr=/127.0.0.1:51471] [21:08:27] : [Step 4/5] [2021-11-19 21:08:27,922][INFO ][tcp-disco-srvr-[:47501]-#865%grid-1%-#16562%grid-1%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=42561] [21:08:27] : [Step 4/5] [2021-11-19 21:08:27,922][INFO ][tcp-disco-srvr-[:47501]-#865%grid-1%-#16562%grid-1%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=42561] [21:08:27] : [Step 4/5] [2021-11-19 21:08:27,923][INFO ][tcp-disco-sock-reader-[]-#867%grid-1%-#16564%grid-1%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:42561, rmtPort=42561] [21:08:27] : [Step 4/5] [2021-11-19 21:08:27,923][INFO ][tcp-disco-sock-reader-[]-#867%grid-1%-#16564%grid-1%][TestTcpDiscoverySpi] Received ping request from the remote node [rmtNodeId=00fde489-de9a-42fc-86db-05e6dcefe000, rmtAddr=/127.0.0.1:42561, rmtPort=42561] [21:08:27] : [Step 4/5] [2021-11-19 21:08:27,925][INFO ][tcp-disco-sock-reader-[]-#867%grid-1%-#16564%grid-1%][TestTcpDiscoverySpi] Finished writing ping response [rmtNodeId=00fde489-de9a-42fc-86db-05e6dcefe000, rmtAddr=/127.0.0.1:42561, rmtPort=42561] [21:08:27] : [Step 4/5] [2021-11-19 21:08:27,925][INFO ][tcp-disco-sock-reader-[1042764c 127.0.0.1:51471]-#866%grid-0%-#16563%grid-0%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:51471, rmtPort=51471, rmtNodeId=1042764c-e469-4e0e-ae46-3a3936f00001] [21:08:27] : [Step 4/5] [2021-11-19 21:08:27,928][INFO ][tcp-disco-sock-reader-[]-#867%grid-1%-#16564%grid-1%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:42561, rmtPort=42561, rmtNodeId=null] [21:08:27]W: [org.apache.ignite:ignite-core] [2021-11-19 21:08:27,926][WARN ][tcp-disco-sock-reader-[]-#867%grid-1%-#16564%grid-1%][TestTcpDiscoverySpi] Failed to shutdown socket [21:08:27]W: [org.apache.ignite:ignite-core] java.net.SocketException: Socket output is already shutdown [21:08:27]W: [org.apache.ignite:ignite-core] at java.net.Socket.shutdownOutput(Socket.java:1572) [21:08:27]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.close(IgniteUtils.java:4247) [21:08:27] : [Step 4/5] [2021-11-19 21:08:27,928][INFO ][tcp-disco-msg-worker-[crd]-#859%grid-0%-#16443%grid-0%][GridEncryptionManager] Joining node doesn't have stored group keys [node=1042764c-e469-4e0e-ae46-3a3936f00001] [21:08:27]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.discovery.tcp.ServerImpl$SocketReader.body(ServerImpl.java:7370) [21:08:27]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.IgniteSpiThread.run(IgniteSpiThread.java:58) [21:08:27] : [Step 4/5] [2021-11-19 21:08:27,936][INFO ][tcp-disco-msg-worker-[crd]-#859%grid-0%-#16443%grid-0%][TestTcpDiscoverySpi] New next node [newNext=TcpDiscoveryNode [id=1042764c-e469-4e0e-ae46-3a3936f00001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=0, intOrder=2, lastExchangeTime=1637345307914, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false]] [21:08:27] : [Step 4/5] [2021-11-19 21:08:27,937][INFO ][tcp-disco-srvr-[:47501]-#865%grid-1%-#16562%grid-1%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=56847] [21:08:27] : [Step 4/5] [2021-11-19 21:08:27,937][INFO ][tcp-disco-srvr-[:47501]-#865%grid-1%-#16562%grid-1%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=56847] [21:08:27] : [Step 4/5] [2021-11-19 21:08:27,938][INFO ][tcp-disco-sock-reader-[]-#868%grid-1%-#16565%grid-1%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:56847, rmtPort=56847] [21:08:27] : [Step 4/5] [2021-11-19 21:08:27,939][INFO ][tcp-disco-sock-reader-[00fde489 127.0.0.1:56847]-#868%grid-1%-#16565%grid-1%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=00fde489-de9a-42fc-86db-05e6dcefe000, rmtAddr=/127.0.0.1:56847] [21:08:27] : [Step 4/5] [2021-11-19 21:08:27,943][INFO ][tcp-disco-msg-worker-[]-#864%grid-1%-#16561%grid-1%][TestTcpDiscoverySpi] New next node [newNext=TcpDiscoveryNode [id=00fde489-de9a-42fc-86db-05e6dcefe000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345307934, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false]] [21:08:27] : [Step 4/5] [2021-11-19 21:08:27,944][INFO ][tcp-disco-srvr-[:47500]-#860%grid-0%-#16444%grid-0%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=45267] [21:08:27] : [Step 4/5] [2021-11-19 21:08:27,945][INFO ][tcp-disco-srvr-[:47500]-#860%grid-0%-#16444%grid-0%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=45267] [21:08:27] : [Step 4/5] [2021-11-19 21:08:27,945][INFO ][tcp-disco-sock-reader-[]-#869%grid-0%-#16566%grid-0%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:45267, rmtPort=45267] [21:08:27] : [Step 4/5] [2021-11-19 21:08:27,946][INFO ][tcp-disco-sock-reader-[1042764c 127.0.0.1:45267]-#869%grid-0%-#16566%grid-0%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=1042764c-e469-4e0e-ae46-3a3936f00001, rmtAddr=/127.0.0.1:45267] [21:08:27] : [Step 4/5] [2021-11-19 21:08:27,949][INFO ][disco-event-worker-#16446%grid-0%][GridDiscoveryManager] Added new node to topology: TcpDiscoveryNode [id=1042764c-e469-4e0e-ae46-3a3936f00001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637345307914, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false] [21:08:27] : [Step 4/5] [2021-11-19 21:08:27,950][INFO ][disco-event-worker-#16446%grid-0%][GridDiscoveryManager] Topology snapshot [ver=2, locNode=00fde489, servers=2, clients=0, state=INACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=00fde489-de9a-42fc-86db-05e6dcefe000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=1042764c-e469-4e0e-ae46-3a3936f00001, consistentId=grid-1, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:08:27] : [Step 4/5] [2021-11-19 21:08:27,953][INFO ][tcp-disco-msg-worker-[00fde489 127.0.0.1:47500]-#864%grid-1%-#16561%grid-1%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustEnabled' was changed from 'null' to 'false' [21:08:27] : [Step 4/5] [2021-11-19 21:08:27,953][INFO ][tcp-disco-msg-worker-[00fde489 127.0.0.1:47500]-#864%grid-1%-#16561%grid-1%][ClusterProcessor] kind_chatelet [21:08:27] : [Step 4/5] [2021-11-19 21:08:27,953][INFO ][tcp-disco-msg-worker-[00fde489 127.0.0.1:47500]-#864%grid-1%-#16561%grid-1%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustTimeout' was changed from 'null' to '300000' [21:08:27] : [Step 4/5] [2021-11-19 21:08:27,954][INFO ][tcp-disco-msg-worker-[00fde489 127.0.0.1:47500]-#864%grid-1%-#16561%grid-1%][IgniteTxManager] Transactions parameter 'longOperationsDumpTimeout' was changed from 'null' to '60000' [21:08:27] : [Step 4/5] [2021-11-19 21:08:27,954][INFO ][tcp-disco-msg-worker-[00fde489 127.0.0.1:47500]-#864%grid-1%-#16561%grid-1%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpThreshold' was changed from 'null' to '0' [21:08:27] : [Step 4/5] [2021-11-19 21:08:27,954][INFO ][tcp-disco-msg-worker-[00fde489 127.0.0.1:47500]-#864%grid-1%-#16561%grid-1%][IgniteTxManager] Transactions parameter 'transactionTimeDumpSamplesCoefficient' was changed from 'null' to '0.0' [21:08:27] : [Step 4/5] [2021-11-19 21:08:27,955][INFO ][tcp-disco-msg-worker-[00fde489 127.0.0.1:47500]-#864%grid-1%-#16561%grid-1%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpSamplesPerSecondLimit' was changed from 'null' to '5' [21:08:27] : [Step 4/5] [2021-11-19 21:08:27,955][INFO ][tcp-disco-msg-worker-[00fde489 127.0.0.1:47500]-#864%grid-1%-#16561%grid-1%][IgniteTxManager] Transactions parameter 'collisionsDumpInterval' was changed from 'null' to '1000' [21:08:27] : [Step 4/5] [2021-11-19 21:08:27,955][INFO ][tcp-disco-msg-worker-[00fde489 127.0.0.1:47500]-#864%grid-1%-#16561%grid-1%][IgniteTxManager] Transactions parameter 'txOwnerDumpRequestsAllowed' was changed from 'null' to 'true' [21:08:27] : [Step 4/5] [2021-11-19 21:08:27,956][INFO ][tcp-disco-msg-worker-[00fde489 127.0.0.1:47500]-#864%grid-1%-#16561%grid-1%][GridCacheDatabaseSharedManager] Historical rebalance WAL threshold changed [property=historical.rebalance.threshold, oldVal=null, newVal=500] [21:08:27] : [Step 4/5] [2021-11-19 21:08:27,957][INFO ][disco-notifier-worker-#16560%grid-1%][MvccProcessorImpl] Assigned mvcc coordinator [crd=MvccCoordinator [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=0], nodeId=00fde489-de9a-42fc-86db-05e6dcefe000, ver=1637345305855, local=false, initialized=false]] [21:08:27] : [Step 4/5] [2021-11-19 21:08:27,958][INFO ][sys-#16538%grid-1%][ClusterProcessor] Writing cluster ID and tag to metastorage on ready for write ClusterIdAndTag [id=974f2689-055e-4379-8a5d-034c89e8c2ae, tag=kind_chatelet] [21:08:27] : [Step 4/5] [2021-11-19 21:08:27,973][INFO ][test-runner-#16331%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] To start Console Management & Monitoring run ignitevisorcmd.{sh|bat} [21:08:27] : [Step 4/5] [2021-11-19 21:08:27,973][INFO ][test-runner-#16331%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] [21:08:27] : [Step 4/5] [21:08:27] : [Step 4/5] >>> +-------------------------------------------+ [21:08:27] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:08:27] : [Step 4/5] >>> +-------------------------------------------+ [21:08:27] : [Step 4/5] >>> OS name: Linux 4.15.0-151-generic amd64 [21:08:27] : [Step 4/5] >>> CPU(s): 24 [21:08:27] : [Step 4/5] >>> Heap: 2.0GB [21:08:27] : [Step 4/5] >>> VM name: 16724@c4dfe9a430b2 [21:08:27] : [Step 4/5] >>> Ignite instance name: grid-1 [21:08:27] : [Step 4/5] >>> Local node [ID=1042764C-E469-4E0E-AE46-3A3936F00001, order=2, clientMode=false] [21:08:27] : [Step 4/5] >>> Local node addresses: [127.0.0.1] [21:08:27] : [Step 4/5] >>> Local ports: TCP:10801 TCP:47101 TCP:47501 [21:08:27] : [Step 4/5] [21:08:27] : [Step 4/5] [2021-11-19 21:08:27,974][INFO ][test-runner-#16331%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] >>> Ignite cluster is in INACTIVE state (limited functionality available). Use control.(sh|bat) script or IgniteCluster.state(ClusterState.ACTIVE) to change the state. [21:08:27] : [Step 4/5] [2021-11-19 21:08:27,975][INFO ][test-runner-#16331%encryption.MasterKeyChangeTest%][GridDiscoveryManager] Topology snapshot [ver=2, locNode=1042764c, servers=2, clients=0, state=INACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=00fde489-de9a-42fc-86db-05e6dcefe000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=1042764c-e469-4e0e-ae46-3a3936f00001, consistentId=grid-1, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:08:27] : [Step 4/5] [2021-11-19 21:08:27,976][INFO ][test-runner-#16331%encryption.MasterKeyChangeTest%][G] Node started : [stage="Configure system pool" (0 ms),stage="Start managers" (179 ms),stage="Configure binary metadata" (1 ms),stage="Start processors" (930 ms),stage="Start 'StanByClusterTestProvider' plugin" (0 ms),stage="Start 'PageMemory tracker plugin' plugin" (0 ms),stage="Start 'TestDistibutedConfigurationPlugin' plugin" (0 ms),stage="Start 'NodeValidationPluginProvider' plugin" (0 ms),stage="Init metastore" (24 ms),stage="Init and start regions" (8 ms),stage="Restore binary memory" (21 ms),stage="Restore logical state" (73 ms),stage="Finish recovery" (787 ms),stage="Join topology" (46 ms),stage="Await transition" (2 ms),stage="Await exchange" (16 ms),stage="Total time" (2087 ms)] [21:08:27] : [Step 4/5] [2021-11-19 21:08:27,977][INFO ][test-runner-#16331%encryption.MasterKeyChangeTest%][root] Node started with the following configuration [id=1042764c-e469-4e0e-ae46-3a3936f00001, marshaller=BinaryMarshaller [], discovery=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=5000, ackTimeout=5000, marsh=JdkMarshaller [clsFilter=org.apache.ignite.marshaller.MarshallerUtils$1@2188e746], reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], binaryCfg=null, lateAff=true] [21:08:27] : [Step 4/5] [2021-11-19 21:08:27,979][INFO ][test-runner-#16331%encryption.MasterKeyChangeTest%][GridClusterStateProcessor] Sending activate cluster request with BaselineTopology BaselineTopology [id=0, branchingHash=-2475315501, branchingType='New BaselineTopology', baselineNodes=[grid-1, grid-0]] [21:08:27] : [Step 4/5] [2021-11-19 21:08:27,983][INFO ][disco-notifier-worker-#16442%grid-0%][GridClusterStateProcessor] Received activate cluster request with BaselineTopology[id=0] initiator node ID: 00fde489-de9a-42fc-86db-05e6dcefe000 [21:08:27] : [Step 4/5] [2021-11-19 21:08:27,984][INFO ][disco-notifier-worker-#16442%grid-0%][GridClusterStateProcessor] Started state transition: activate cluster [21:08:27] : [Step 4/5] [2021-11-19 21:08:27,984][INFO ][exchange-worker-#16447%grid-0%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], crd=true, evt=DISCOVERY_CUSTOM_EVT, evtNode=00fde489-de9a-42fc-86db-05e6dcefe000, customEvt=ChangeGlobalStateMessage [id=baf5d593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqId=9bde308c-f6ed-42de-aef0-f3f9d42a5f5d, initiatingNodeId=00fde489-de9a-42fc-86db-05e6dcefe000, state=ACTIVE, baselineTopology=BaselineTopology [id=0, branchingHash=-2475315501, branchingType='New BaselineTopology', baselineNodes=[grid-1, grid-0]], forceChangeBaselineTopology=false, timestamp=1637345307979, forceDeactivation=true], allowMerge=false, exchangeFreeSwitch=false] [21:08:27] : [Step 4/5] [2021-11-19 21:08:27,985][INFO ][exchange-worker-#16447%grid-0%][GridDhtPartitionsExchangeFuture] Start activation process [nodeId=00fde489-de9a-42fc-86db-05e6dcefe000, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]]. New state: ACTIVE [21:08:27] : [Step 4/5] [2021-11-19 21:08:27,985][INFO ][disco-notifier-worker-#16560%grid-1%][GridClusterStateProcessor] Received activate cluster request with BaselineTopology[id=0] initiator node ID: 00fde489-de9a-42fc-86db-05e6dcefe000 [21:08:27] : [Step 4/5] [2021-11-19 21:08:27,986][INFO ][exchange-worker-#16447%grid-0%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0 [21:08:27] : [Step 4/5] [2021-11-19 21:08:27,986][INFO ][disco-notifier-worker-#16560%grid-1%][GridClusterStateProcessor] Started state transition: activate cluster [21:08:27] : [Step 4/5] [2021-11-19 21:08:27,988][INFO ][exchange-worker-#16569%grid-1%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], crd=false, evt=DISCOVERY_CUSTOM_EVT, evtNode=00fde489-de9a-42fc-86db-05e6dcefe000, customEvt=ChangeGlobalStateMessage [id=baf5d593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqId=9bde308c-f6ed-42de-aef0-f3f9d42a5f5d, initiatingNodeId=00fde489-de9a-42fc-86db-05e6dcefe000, state=ACTIVE, baselineTopology=BaselineTopology [id=0, branchingHash=-2475315501, branchingType='New BaselineTopology', baselineNodes=[grid-1, grid-0]], forceChangeBaselineTopology=false, timestamp=1637345307979, forceDeactivation=true], allowMerge=false, exchangeFreeSwitch=false] [21:08:27] : [Step 4/5] [2021-11-19 21:08:27,988][INFO ][exchange-worker-#16447%grid-0%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000000.wal, offset=8713, ver=2] [21:08:27] : [Step 4/5] [2021-11-19 21:08:27,989][INFO ][exchange-worker-#16569%grid-1%][GridDhtPartitionsExchangeFuture] Start activation process [nodeId=1042764c-e469-4e0e-ae46-3a3936f00001, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]]. New state: ACTIVE [21:08:27] : [Step 4/5] [2021-11-19 21:08:27,992][INFO ][exchange-worker-#16447%grid-0%][GridClusterStateProcessor] Writing BaselineTopology[id=0] [21:08:27] : [Step 4/5] [2021-11-19 21:08:27,992][INFO ][exchange-worker-#16569%grid-1%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1 [21:08:27] : [Step 4/5] [2021-11-19 21:08:27,998][INFO ][exchange-worker-#16569%grid-1%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000000.wal, offset=8713, ver=2] [21:08:27] : [Step 4/5] [2021-11-19 21:08:27,998][INFO ][exchange-worker-#16569%grid-1%][GridClusterStateProcessor] Writing BaselineTopology[id=0] [21:08:28] : [Step 4/5] [2021-11-19 21:08:28,134][INFO ][exchange-worker-#16569%grid-1%][GridCacheDatabaseSharedManager] Finish recovery performed in 138 ms. [21:08:28] : [Step 4/5] [2021-11-19 21:08:28,136][INFO ][exchange-worker-#16569%grid-1%][msg] Components activation performed in 144 ms. [21:08:28] : [Step 4/5] [2021-11-19 21:08:28,136][INFO ][exchange-worker-#16447%grid-0%][GridCacheDatabaseSharedManager] Finish recovery performed in 150 ms. [21:08:28] : [Step 4/5] [2021-11-19 21:08:28,139][INFO ][exchange-worker-#16447%grid-0%][msg] Components activation performed in 153 ms. [21:08:28] : [Step 4/5] [2021-11-19 21:08:28,139][INFO ][exchange-worker-#16569%grid-1%][GridCacheProcessor] Finished recovery for cache [cache=ignite-sys-cache, grp=ignite-sys-cache, startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:08:28] : [Step 4/5] [2021-11-19 21:08:28,140][INFO ][exchange-worker-#16447%grid-0%][GridCacheProcessor] Finished recovery for cache [cache=ignite-sys-cache, grp=ignite-sys-cache, startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:08:28] : [Step 4/5] [2021-11-19 21:08:28,140][INFO ][exchange-worker-#16569%grid-1%][GridDhtPartitionsExchangeFuture] Successfully activated caches [nodeId=1042764c-e469-4e0e-ae46-3a3936f00001, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], newState=ACTIVE] [21:08:28] : [Step 4/5] [2021-11-19 21:08:28,140][INFO ][exchange-worker-#16447%grid-0%][GridDhtPartitionsExchangeFuture] Successfully activated caches [nodeId=00fde489-de9a-42fc-86db-05e6dcefe000, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], newState=ACTIVE] [21:08:28] : [Step 4/5] [2021-11-19 21:08:28,141][INFO ][exchange-worker-#16569%grid-1%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:08:28] : [Step 4/5] [2021-11-19 21:08:28,141][INFO ][exchange-worker-#16447%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:08:28] : [Step 4/5] [2021-11-19 21:08:28,428][INFO ][exchange-worker-#16447%grid-0%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], crd=true] [21:08:28] : [Step 4/5] [2021-11-19 21:08:28,431][INFO ][grid-nio-worker-tcp-comm-0-#16386%TestRecordingCommunicationSpi%][TestRecordingCommunicationSpi] Accepted incoming communication connection [locAddr=/127.0.0.1:47100, rmtAddr=/127.0.0.1:56556] [21:08:28] : [Step 4/5] [2021-11-19 21:08:28,433][INFO ][grid-nio-worker-tcp-comm-0-#16504%TestRecordingCommunicationSpi%][TestRecordingCommunicationSpi] Established outgoing communication connection [locAddr=/127.0.0.1:56556, rmtAddr=/127.0.0.1:47100] [21:08:28] : [Step 4/5] [2021-11-19 21:08:28,434][INFO ][exchange-worker-#16569%grid-1%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], crd=false] [21:08:28] : [Step 4/5] [2021-11-19 21:08:28,436][INFO ][sys-#16431%grid-0%][GridDhtPartitionsExchangeFuture] Coordinator received single message [ver=AffinityTopologyVersion [topVer=2, minorTopVer=1], node=1042764c-e469-4e0e-ae46-3a3936f00001, allReceived=true] [21:08:28] : [Step 4/5] [2021-11-19 21:08:28,436][INFO ][sys-#16431%grid-0%][GridDhtPartitionsExchangeFuture] finishExchangeOnCoordinator [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:08:28] : [Step 4/5] [2021-11-19 21:08:28,444][INFO ][sys-#16431%grid-0%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], err=null, rebalanced=true, wasRebalanced=false] [21:08:28] : [Step 4/5] [2021-11-19 21:08:28,446][INFO ][sys-#16544%grid-1%][GridDhtPartitionsExchangeFuture] Received full message, will finish exchange [node=00fde489-de9a-42fc-86db-05e6dcefe000, resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:08:28] : [Step 4/5] [2021-11-19 21:08:28,446][INFO ][disco-notifier-worker-#16560%grid-1%][GridClusterStateProcessor] Received state change finish message: ACTIVE [21:08:28] : [Step 4/5] [2021-11-19 21:08:28,445][INFO ][disco-notifier-worker-#16442%grid-0%][GridClusterStateProcessor] Received state change finish message: ACTIVE [21:08:28] : [Step 4/5] [2021-11-19 21:08:28,447][INFO ][disco-notifier-worker-#16560%grid-1%][GridClusterStateProcessor] Cluster state was changed from INACTIVE to ACTIVE [21:08:28] : [Step 4/5] [2021-11-19 21:08:28,447][INFO ][disco-notifier-worker-#16442%grid-0%][GridClusterStateProcessor] Cluster state was changed from INACTIVE to ACTIVE [21:08:28] : [Step 4/5] [2021-11-19 21:08:28,448][INFO ][sys-#16544%grid-1%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], err=null, rebalanced=true, wasRebalanced=false] [21:08:28] : [Step 4/5] [2021-11-19 21:08:28,450][INFO ][sys-#16555%grid-1%][GridCachePartitionExchangeManager] Delay process full message without exchange id (there is exchange in progress) [nodeId=00fde489-de9a-42fc-86db-05e6dcefe000] [21:08:28] : [Step 4/5] [2021-11-19 21:08:28,451][INFO ][sys-#16431%grid-0%][GridCacheProcessor] Finish proxy initialization, cacheName=ignite-sys-cache, localNodeId=00fde489-de9a-42fc-86db-05e6dcefe000 [21:08:28] : [Step 4/5] [2021-11-19 21:08:28,452][INFO ][sys-#16544%grid-1%][GridCacheProcessor] Finish proxy initialization, cacheName=ignite-sys-cache, localNodeId=1042764c-e469-4e0e-ae46-3a3936f00001 [21:08:28] : [Step 4/5] [2021-11-19 21:08:28,452][INFO ][sys-#16431%grid-0%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=00fde489-de9a-42fc-86db-05e6dcefe000, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=00fde489-de9a-42fc-86db-05e6dcefe000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345308441, loc=true, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:08:28] : [Step 4/5] [2021-11-19 21:08:28,452][INFO ][exchange-worker-#16447%grid-0%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=2, minorTopVer=1], force=false, evt=DISCOVERY_CUSTOM_EVT, node=00fde489-de9a-42fc-86db-05e6dcefe000] [21:08:28] : [Step 4/5] [2021-11-19 21:08:28,452][INFO ][sys-#16419%grid-0%][DistributedBaselineConfiguration] Baseline auto-adjust is 'disabled' with timeout='300000' ms [21:08:28] : [Step 4/5] [2021-11-19 21:08:28,454][INFO ][sys-#16431%grid-0%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (1 ms), stage="Update caches registry" (154 ms), stage="Start caches" (0 ms), stage="Affinity initialization on cache group start" (0 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Restore partition states" (0 ms), stage="After states restored callback" (285 ms), stage="WAL history reservation" (0 ms), stage="Waiting for all single messages" (8 ms), stage="Affinity recalculation (crd)" (0 ms), stage="Collect update counters and create affinity messages" (0 ms), stage="Assign partitions states" (0 ms), stage="Validate partitions states" (0 ms), stage="Ideal affinity diff calculation (enforced)" (0 ms), stage="Apply update counters" (0 ms), stage="Full message preparing" (6 ms), stage="Full message sending" (0 ms), stage="State finish message sending" (0 ms), stage="Detect lost partitions" (4 ms), stage="Exchange done" (4 ms), stage="Total time" (462 ms), Discovery lag=4 ms, Latest started node id=1042764c-e469-4e0e-ae46-3a3936f00001] [21:08:28] : [Step 4/5] [2021-11-19 21:08:28,454][INFO ][sys-#16544%grid-1%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=1042764c-e469-4e0e-ae46-3a3936f00001, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=00fde489-de9a-42fc-86db-05e6dcefe000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345307934, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:08:28] : [Step 4/5] [2021-11-19 21:08:28,454][INFO ][exchange-worker-#16569%grid-1%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=2, minorTopVer=1], force=false, evt=DISCOVERY_CUSTOM_EVT, node=00fde489-de9a-42fc-86db-05e6dcefe000] [21:08:28] : [Step 4/5] [2021-11-19 21:08:28,453][INFO ][sys-#16557%grid-1%][DistributedBaselineConfiguration] Baseline auto-adjust is 'disabled' with timeout='300000' ms [21:08:28] : [Step 4/5] [2021-11-19 21:08:28,459][INFO ][sys-#16544%grid-1%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (1 ms), stage="Update caches registry" (149 ms), stage="Start caches" (1 ms), stage="Affinity initialization on cache group start" (0 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Restore partition states" (0 ms), stage="After states restored callback" (285 ms), stage="WAL history reservation" (0 ms), stage="Waiting for Full message" (18 ms), stage="Affinity recalculation" (0 ms), stage="Full map updating" (0 ms), stage="Detect lost partitions" (3 ms), stage="Exchange done" (7 ms), stage="Total time" (464 ms)] [21:08:28] : [Step 4/5] [2021-11-19 21:08:28,462][INFO ][sys-#16544%grid-1%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], stage="Affinity initialization on cache group start [grp=ignite-sys-cache]" (0 ms) (parent=Affinity initialization on cache group start), stage="Affinity centralized initialization (crd) [grp=ignite-sys-cache, crd=false]" (0 ms) (parent=Determine exchange type), stage="Restore partition states [grp=ignite-sys-cache]" (0 ms) (parent=Restore partition states), stage="Affinity applying from full message [grp=ignite-sys-cache]" (0 ms) (parent=Affinity recalculation)] [21:08:28] : [Step 4/5] [2021-11-19 21:08:28,457][INFO ][sys-#16431%grid-0%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], stage="Affinity initialization on cache group start [grp=ignite-sys-cache]" (0 ms) (parent=Affinity initialization on cache group start), stage="Affinity centralized initialization (crd) [grp=ignite-sys-cache, crd=true]" (0 ms) (parent=Determine exchange type), stage="Restore partition states [grp=ignite-sys-cache]" (0 ms) (parent=Restore partition states), stage="Affinity recalculation (partitions availability) [grp=ignite-sys-cache]" (0 ms) (parent=Ideal affinity diff calculation (enforced))] [21:08:28] : [Step 4/5] [2021-11-19 21:08:28,455][INFO ][test-runner-#16331%encryption.MasterKeyChangeTest%][root] awaitPartitionMapExchange finished [21:08:28] : [Step 4/5] [2021-11-19 21:08:28,455][INFO ][sys-#16419%grid-0%][GridClusterStateProcessor] Successfully performed final activation steps [nodeId=00fde489-de9a-42fc-86db-05e6dcefe000, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:08:28] : [Step 4/5] [2021-11-19 21:08:28,459][INFO ][sys-#16557%grid-1%][GridClusterStateProcessor] Successfully performed final activation steps [nodeId=1042764c-e469-4e0e-ae46-3a3936f00001, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:08:28] : [Step 4/5] [2021-11-19 21:08:28,661][INFO ][exchange-worker-#16447%grid-0%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], crd=true, evt=DISCOVERY_CUSTOM_EVT, evtNode=00fde489-de9a-42fc-86db-05e6dcefe000, customEvt=DynamicCacheChangeBatch [id=fcf5d593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqs=ArrayList [DynamicCacheChangeRequest [cacheName=encrypted, hasCfg=true, nodeId=00fde489-de9a-42fc-86db-05e6dcefe000, clientStartOnly=false, stop=false, destroy=false, disabledAfterStart=false]], exchangeActions=ExchangeActions [startCaches=[encrypted], stopCaches=null, startGrps=[encrypted], stopGrps=[], resetParts=null, stateChangeRequest=null], startCaches=false], allowMerge=false, exchangeFreeSwitch=false] [21:08:28] : [Step 4/5] [2021-11-19 21:08:28,664][INFO ][exchange-worker-#16447%grid-0%][PageMemoryImpl] Started page memory [memoryAllocated=24.0 MiB, pages=5952, tableSize=474.2 KiB, replacementSize=768 B, checkpointBuffer=10.0 MiB] [21:08:28] : [Step 4/5] [2021-11-19 21:08:28,729][INFO ][exchange-worker-#16569%grid-1%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], crd=false, evt=DISCOVERY_CUSTOM_EVT, evtNode=00fde489-de9a-42fc-86db-05e6dcefe000, customEvt=DynamicCacheChangeBatch [id=fcf5d593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqs=ArrayList [DynamicCacheChangeRequest [cacheName=encrypted, hasCfg=true, nodeId=00fde489-de9a-42fc-86db-05e6dcefe000, clientStartOnly=false, stop=false, destroy=false, disabledAfterStart=false]], exchangeActions=ExchangeActions [startCaches=[encrypted], stopCaches=null, startGrps=[encrypted], stopGrps=[], resetParts=null, stateChangeRequest=null], startCaches=false], allowMerge=false, exchangeFreeSwitch=false] [21:08:28] : [Step 4/5] [2021-11-19 21:08:28,847][INFO ][exchange-worker-#16569%grid-1%][PageMemoryImpl] Started page memory [memoryAllocated=24.0 MiB, pages=5952, tableSize=474.2 KiB, replacementSize=768 B, checkpointBuffer=10.0 MiB] [21:08:28] : [Step 4/5] [2021-11-19 21:08:28,847][INFO ][exchange-worker-#16447%grid-0%][GridCacheProcessor] Started cache [name=encrypted, id=1613773252, dataRegionName=default, mode=PARTITIONED, atomicity=ATOMIC, backups=0, mvcc=false] [21:08:28]W: [org.apache.ignite:ignite-core] [2021-11-19 21:08:28,849][WARN ][exchange-worker-#16447%grid-0%][CacheAffinitySharedManager] Cache group 'encrypted' brings high overhead for its metainformation in data region 'default'. Metainformation required for its partitions (502 partitions, 4096 bytes per partition, 1 MBs total) will consume more than 15% of data region memory (10 MBs). It may lead to critical errors on the node and cluster instability. Please reduce number of partitions, add more memory to the data region or add more server nodes for this cache group. [21:08:28] : [Step 4/5] [2021-11-19 21:08:28,850][INFO ][exchange-worker-#16447%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], waitTime=0ms, futInfo=NA, mode=DISTRIBUTED] [21:08:28] : [Step 4/5] [2021-11-19 21:08:28,916][INFO ][exchange-worker-#16569%grid-1%][GridCacheProcessor] Started cache [name=encrypted, id=1613773252, dataRegionName=default, mode=PARTITIONED, atomicity=ATOMIC, backups=0, mvcc=false] [21:08:28]W: [org.apache.ignite:ignite-core] [2021-11-19 21:08:28,918][WARN ][exchange-worker-#16569%grid-1%][CacheAffinitySharedManager] Cache group 'encrypted' brings high overhead for its metainformation in data region 'default'. Metainformation required for its partitions (522 partitions, 4096 bytes per partition, 2 MBs total) will consume more than 15% of data region memory (10 MBs). It may lead to critical errors on the node and cluster instability. Please reduce number of partitions, add more memory to the data region or add more server nodes for this cache group. [21:08:28] : [Step 4/5] [2021-11-19 21:08:28,919][INFO ][exchange-worker-#16569%grid-1%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], waitTime=0ms, futInfo=NA, mode=DISTRIBUTED] [21:08:28] : [Step 4/5] [2021-11-19 21:08:28,920][INFO ][exchange-worker-#16447%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partitions release latch: ServerLatch [permits=0, pendingAcks=HashSet [], super=CompletableLatch [id=CompletableLatchUid [id=exchange, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2]]]] [21:08:28] : [Step 4/5] [2021-11-19 21:08:28,921][INFO ][exchange-worker-#16569%grid-1%][GridDhtPartitionsExchangeFuture] Finished waiting for partitions release latch: ClientLatch [coordinator=TcpDiscoveryNode [id=00fde489-de9a-42fc-86db-05e6dcefe000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345307934, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], ackSent=true, super=CompletableLatch [id=CompletableLatchUid [id=exchange, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2]]]] [21:08:28] : [Step 4/5] [2021-11-19 21:08:28,921][INFO ][exchange-worker-#16447%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:08:28] : [Step 4/5] [2021-11-19 21:08:28,922][INFO ][exchange-worker-#16569%grid-1%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:08:28] : [Step 4/5] [2021-11-19 21:08:28,960][INFO ][exchange-worker-#16569%grid-1%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], crd=false] [21:08:28] : [Step 4/5] [2021-11-19 21:08:28,973][INFO ][exchange-worker-#16447%grid-0%][GridDhtPartitionsExchangeFuture] Coordinator received single message [ver=AffinityTopologyVersion [topVer=2, minorTopVer=2], node=1042764c-e469-4e0e-ae46-3a3936f00001, allReceived=true] [21:08:28] : [Step 4/5] [2021-11-19 21:08:28,974][INFO ][exchange-worker-#16447%grid-0%][GridDhtPartitionsExchangeFuture] finishExchangeOnCoordinator [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2]] [21:08:28] : [Step 4/5] [2021-11-19 21:08:28,979][INFO ][exchange-worker-#16447%grid-0%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], err=null, rebalanced=true, wasRebalanced=true] [21:08:28] : [Step 4/5] [2021-11-19 21:08:28,980][INFO ][sys-#16547%grid-1%][GridDhtPartitionsExchangeFuture] Received full message, will finish exchange [node=00fde489-de9a-42fc-86db-05e6dcefe000, resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2]] [21:08:28] : [Step 4/5] [2021-11-19 21:08:28,980][INFO ][exchange-worker-#16447%grid-0%][GridCacheProcessor] Finish proxy initialization, cacheName=encrypted, localNodeId=00fde489-de9a-42fc-86db-05e6dcefe000 [21:08:28] : [Step 4/5] [2021-11-19 21:08:28,981][INFO ][exchange-worker-#16447%grid-0%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=00fde489-de9a-42fc-86db-05e6dcefe000, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=00fde489-de9a-42fc-86db-05e6dcefe000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345308874, loc=true, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2]] [21:08:28] : [Step 4/5] [2021-11-19 21:08:28,982][INFO ][exchange-worker-#16447%grid-0%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (1 ms), stage="Update caches registry" (0 ms), stage="Start caches" (184 ms), stage="Affinity initialization on cache group start" (2 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Wait partitions release latch [latch=exchange]" (70 ms), stage="Wait partitions release [latch=exchange]" (1 ms), stage="Restore partition states" (19 ms), stage="After states restored callback" (31 ms), stage="WAL history reservation" (0 ms), stage="Waiting for all single messages" (0 ms), stage="Affinity recalculation (crd)" (0 ms), stage="Collect update counters and create affinity messages" (0 ms), stage="Assign partitions states" (1 ms), stage="Validate partitions states" (0 ms), stage="Apply update counters" (0 ms), stage="Full message preparing" (2 ms), stage="Full message sending" (0 ms), stage="Exchange done" (2 ms), stage="Total time" (313 ms), Discovery lag=67 ms, Latest started node id=1042764c-e469-4e0e-ae46-3a3936f00001] [21:08:28] : [Step 4/5] [2021-11-19 21:08:28,982][INFO ][sys-#16547%grid-1%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], err=null, rebalanced=true, wasRebalanced=true] [21:08:28] : [Step 4/5] [2021-11-19 21:08:28,983][INFO ][exchange-worker-#16447%grid-0%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], stage="Affinity initialization on cache group start [grp=encrypted]" (1 ms) (parent=Affinity initialization on cache group start), stage="Restore partition states [grp=encrypted]" (18 ms) (parent=Restore partition states), stage="Restore partition states [grp=ignite-sys-cache]" (0 ms) (parent=Restore partition states)] [21:08:28] : [Step 4/5] [2021-11-19 21:08:28,985][INFO ][sys-#16547%grid-1%][GridCacheProcessor] Finish proxy initialization, cacheName=encrypted, localNodeId=1042764c-e469-4e0e-ae46-3a3936f00001 [21:08:28] : [Step 4/5] [2021-11-19 21:08:28,985][INFO ][exchange-worker-#16447%grid-0%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], crd=true] [21:08:28] : [Step 4/5] [2021-11-19 21:08:28,985][INFO ][sys-#16547%grid-1%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=1042764c-e469-4e0e-ae46-3a3936f00001, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=00fde489-de9a-42fc-86db-05e6dcefe000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345307934, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2]] [21:08:28] : [Step 4/5] [2021-11-19 21:08:28,987][INFO ][sys-#16547%grid-1%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (116 ms), stage="Update caches registry" (1 ms), stage="Start caches" (70 ms), stage="Affinity initialization on cache group start" (2 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Wait partitions release latch [latch=exchange]" (1 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Restore partition states" (11 ms), stage="After states restored callback" (25 ms), stage="WAL history reservation" (0 ms), stage="Waiting for Full message" (21 ms), stage="Affinity recalculation" (0 ms), stage="Full map updating" (2 ms), stage="Exchange done" (4 ms), stage="Total time" (253 ms)] [21:08:28] : [Step 4/5] [2021-11-19 21:08:28,989][INFO ][sys-#16547%grid-1%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], stage="Affinity initialization on cache group start [grp=encrypted]" (1 ms) (parent=Affinity initialization on cache group start), stage="Restore partition states [grp=encrypted]" (11 ms) (parent=Restore partition states), stage="Restore partition states [grp=ignite-sys-cache]" (0 ms) (parent=Restore partition states)] [21:08:28] : [Step 4/5] [2021-11-19 21:08:28,986][INFO ][exchange-worker-#16447%grid-0%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=2, minorTopVer=2], force=false, evt=DISCOVERY_CUSTOM_EVT, node=00fde489-de9a-42fc-86db-05e6dcefe000] [21:08:28] : [Step 4/5] [2021-11-19 21:08:28,986][INFO ][exchange-worker-#16569%grid-1%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=2, minorTopVer=2], force=false, evt=DISCOVERY_CUSTOM_EVT, node=00fde489-de9a-42fc-86db-05e6dcefe000] [21:08:29] : [Step 4/5] [2021-11-19 21:08:29,192][INFO ][db-checkpoint-thread-#16583%grid-0%][Checkpointer] Checkpoint started [checkpointId=12334310-bb93-41c2-a2c8-51691a85ba30, startPtr=WALPointer [idx=0, fileOff=66975, len=1963], checkpointBeforeLockTime=1ms, checkpointLockWait=277ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=143ms, writeCheckpointEntryDuration=622ms, splitAndSortCpPagesDuration=0ms, pages=16, reason='node started'] [21:08:29] : [Step 4/5] [2021-11-19 21:08:29,192][INFO ][db-checkpoint-thread-#16578%grid-1%][Checkpointer] Checkpoint started [checkpointId=779e2ccf-33b8-404c-8589-14e6f4381450, startPtr=WALPointer [idx=0, fileOff=66975, len=1963], checkpointBeforeLockTime=1ms, checkpointLockWait=280ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=212ms, writeCheckpointEntryDuration=552ms, splitAndSortCpPagesDuration=0ms, pages=16, reason='node started'] [21:08:29] : [Step 4/5] [2021-11-19 21:08:29,210][INFO ][db-checkpoint-thread-#16583%grid-0%][Checkpointer] Checkpoint finished [cpId=12334310-bb93-41c2-a2c8-51691a85ba30, pages=16, markPos=WALPointer [idx=0, fileOff=66975, len=1963], walSegmentsCovered=[], markDuration=766ms, pagesWrite=1ms, fsync=16ms, total=1061ms] [21:08:29] : [Step 4/5] [2021-11-19 21:08:29,229][INFO ][db-checkpoint-thread-#16578%grid-1%][Checkpointer] Checkpoint finished [cpId=779e2ccf-33b8-404c-8589-14e6f4381450, pages=16, markPos=WALPointer [idx=0, fileOff=66975, len=1963], walSegmentsCovered=[], markDuration=767ms, pagesWrite=10ms, fsync=25ms, total=1083ms] [21:08:35] : [Step 4/5] [2021-11-19 21:08:35,048][INFO ][test-runner-#16331%encryption.MasterKeyChangeTest%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:08:35] : [Step 4/5] [2021-11-19 21:08:35,196][INFO ][disco-notifier-worker-#16560%grid-1%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:08:35] : [Step 4/5] [2021-11-19 21:08:35,203][INFO ][disco-notifier-worker-#16442%grid-0%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:08:35] : [Step 4/5] [2021-11-19 21:08:35,344][INFO ][disco-notifier-worker-#16560%grid-1%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:08:35] : [Step 4/5] [2021-11-19 21:08:35,347][INFO ][disco-notifier-worker-#16442%grid-0%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:08:35] : [Step 4/5] [2021-11-19 21:08:35,427][INFO ][disco-notifier-worker-#16560%grid-1%][IgniteTestResources] Block message [node=00fde489-de9a-42fc-86db-05e6dcefe000, order=1, msg=org.apache.ignite.internal.util.distributed.SingleNodeMessage@3d62b1ed] [21:08:35]W: [org.apache.ignite:ignite-core] [2021-11-19 21:08:35,433][WARN ][disco-notifier-worker-#16442%grid-0%][ClusterCachesInfo] Ignore cache start request during the master key change process. [21:08:35]W: [org.apache.ignite:ignite-core] class org.apache.ignite.IgniteCheckedException: Cache start failed. Master key change is in progress. [21:08:35]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.ClusterCachesInfo.processStartNewCacheRequest(ClusterCachesInfo.java:1028) [21:08:35]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.ClusterCachesInfo.processCacheChangeRequest0(ClusterCachesInfo.java:756) [21:08:35]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.ClusterCachesInfo.processCacheChangeRequests(ClusterCachesInfo.java:663) [21:08:35]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.ClusterCachesInfo.onCacheChangeRequested(ClusterCachesInfo.java:612) [21:08:35]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.GridCacheProcessor.onCustomEvent(GridCacheProcessor.java:4297) [21:08:35]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.managers.discovery.GridDiscoveryManager$4.onDiscovery0(GridDiscoveryManager.java:682) [21:08:35]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.managers.discovery.GridDiscoveryManager$4.access$7500(GridDiscoveryManager.java:561) [21:08:35]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.managers.discovery.GridDiscoveryManager$4$NotificationTask.run(GridDiscoveryManager.java:996) [21:08:35]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.managers.discovery.GridDiscoveryManager$DiscoveryMessageNotifierWorker.body0(GridDiscoveryManager.java:2871) [21:08:35]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.managers.discovery.GridDiscoveryManager$DiscoveryMessageNotifierWorker.body(GridDiscoveryManager.java:2909) [21:08:35]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:125) [21:08:35]W: [org.apache.ignite:ignite-core] at java.lang.Thread.run(Thread.java:748) [21:08:35]W: [org.apache.ignite:ignite-core] [2021-11-19 21:08:35,434][WARN ][disco-notifier-worker-#16560%grid-1%][ClusterCachesInfo] Ignore cache start request during the master key change process. [21:08:35]W: [org.apache.ignite:ignite-core] class org.apache.ignite.IgniteCheckedException: Cache start failed. Master key change is in progress. [21:08:35]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.ClusterCachesInfo.processStartNewCacheRequest(ClusterCachesInfo.java:1028) [21:08:35]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.ClusterCachesInfo.processCacheChangeRequest0(ClusterCachesInfo.java:756) [21:08:35]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.ClusterCachesInfo.processCacheChangeRequests(ClusterCachesInfo.java:663) [21:08:35]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.ClusterCachesInfo.onCacheChangeRequested(ClusterCachesInfo.java:612) [21:08:35]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.GridCacheProcessor.onCustomEvent(GridCacheProcessor.java:4297) [21:08:35]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.managers.discovery.GridDiscoveryManager$4.onDiscovery0(GridDiscoveryManager.java:682) [21:08:35]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.managers.discovery.GridDiscoveryManager$4.access$7500(GridDiscoveryManager.java:561) [21:08:35]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.managers.discovery.GridDiscoveryManager$4$NotificationTask.run(GridDiscoveryManager.java:996) [21:08:35]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.managers.discovery.GridDiscoveryManager$DiscoveryMessageNotifierWorker.body0(GridDiscoveryManager.java:2871) [21:08:35]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.managers.discovery.GridDiscoveryManager$DiscoveryMessageNotifierWorker.body(GridDiscoveryManager.java:2909) [21:08:35]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:125) [21:08:35]W: [org.apache.ignite:ignite-core] at java.lang.Thread.run(Thread.java:748) [21:08:35] : [Step 4/5] [2021-11-19 21:08:35,438][INFO ][test-runner-#16331%encryption.MasterKeyChangeTest%][IgniteTestResources] Send blocked message [node=00fde489-de9a-42fc-86db-05e6dcefe000, order=1, msg=org.apache.ignite.internal.util.distributed.SingleNodeMessage@3d62b1ed] [21:08:35] : [Step 4/5] [2021-11-19 21:08:35,444][INFO ][disco-notifier-worker-#16442%grid-0%][GridEncryptionManager] Start master key change [masterKeyName=ignite.master.key2] [21:08:35] : [Step 4/5] [2021-11-19 21:08:35,444][INFO ][disco-notifier-worker-#16560%grid-1%][GridEncryptionManager] Start master key change [masterKeyName=ignite.master.key2] [21:08:35] : [Step 4/5] [2021-11-19 21:08:35,501][INFO ][disco-notifier-worker-#16560%grid-1%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:08:35] : [Step 4/5] [2021-11-19 21:08:35,502][INFO ][disco-notifier-worker-#16442%grid-0%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:08:35] : [Step 4/5] [2021-11-19 21:08:35,653][INFO ][disco-notifier-worker-#16560%grid-1%][GridEncryptionManager] Master key successfully changed [masterKeyName=ignite.master.key2] [21:08:35] : [Step 4/5] [2021-11-19 21:08:35,653][INFO ][disco-notifier-worker-#16442%grid-0%][GridEncryptionManager] Master key successfully changed [masterKeyName=ignite.master.key2] [21:08:35] : [Step 4/5] [2021-11-19 21:08:35,827][INFO ][exchange-worker-#16447%grid-0%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=3], crd=true, evt=DISCOVERY_CUSTOM_EVT, evtNode=00fde489-de9a-42fc-86db-05e6dcefe000, customEvt=DynamicCacheChangeBatch [id=0316d593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqs=ArrayList [DynamicCacheChangeRequest [cacheName=cache2, hasCfg=true, nodeId=00fde489-de9a-42fc-86db-05e6dcefe000, clientStartOnly=false, stop=false, destroy=false, disabledAfterStart=false]], exchangeActions=ExchangeActions [startCaches=[cache2], stopCaches=null, startGrps=[cache2], stopGrps=[], resetParts=null, stateChangeRequest=null], startCaches=false], allowMerge=false, exchangeFreeSwitch=false] [21:08:35] : [Step 4/5] [2021-11-19 21:08:35,858][INFO ][exchange-worker-#16569%grid-1%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=3], crd=false, evt=DISCOVERY_CUSTOM_EVT, evtNode=00fde489-de9a-42fc-86db-05e6dcefe000, customEvt=DynamicCacheChangeBatch [id=0316d593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqs=ArrayList [DynamicCacheChangeRequest [cacheName=cache2, hasCfg=true, nodeId=00fde489-de9a-42fc-86db-05e6dcefe000, clientStartOnly=false, stop=false, destroy=false, disabledAfterStart=false]], exchangeActions=ExchangeActions [startCaches=[cache2], stopCaches=null, startGrps=[cache2], stopGrps=[], resetParts=null, stateChangeRequest=null], startCaches=false], allowMerge=false, exchangeFreeSwitch=false] [21:08:35] : [Step 4/5] [2021-11-19 21:08:35,892][INFO ][exchange-worker-#16447%grid-0%][GridCacheProcessor] Started cache [name=cache2, id=-1368047376, dataRegionName=default, mode=PARTITIONED, atomicity=ATOMIC, backups=0, mvcc=false] [21:08:35]W: [org.apache.ignite:ignite-core] [2021-11-19 21:08:35,894][WARN ][exchange-worker-#16447%grid-0%][CacheAffinitySharedManager] Cache group 'cache2' brings high overhead for its metainformation in data region 'default'. Metainformation required for its partitions (502 partitions, 4096 bytes per partition, 1 MBs total) will consume more than 15% of data region memory (10 MBs). It may lead to critical errors on the node and cluster instability. Please reduce number of partitions, add more memory to the data region or add more server nodes for this cache group. [21:08:35] : [Step 4/5] [2021-11-19 21:08:35,895][INFO ][exchange-worker-#16447%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=3], waitTime=0ms, futInfo=NA, mode=DISTRIBUTED] [21:08:35] : [Step 4/5] [2021-11-19 21:08:35,920][INFO ][exchange-worker-#16569%grid-1%][GridCacheProcessor] Started cache [name=cache2, id=-1368047376, dataRegionName=default, mode=PARTITIONED, atomicity=ATOMIC, backups=0, mvcc=false] [21:08:35]W: [org.apache.ignite:ignite-core] [2021-11-19 21:08:35,922][WARN ][exchange-worker-#16569%grid-1%][CacheAffinitySharedManager] Cache group 'cache2' brings high overhead for its metainformation in data region 'default'. Metainformation required for its partitions (522 partitions, 4096 bytes per partition, 2 MBs total) will consume more than 15% of data region memory (10 MBs). It may lead to critical errors on the node and cluster instability. Please reduce number of partitions, add more memory to the data region or add more server nodes for this cache group. [21:08:35] : [Step 4/5] [2021-11-19 21:08:35,923][INFO ][exchange-worker-#16569%grid-1%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=3], waitTime=0ms, futInfo=NA, mode=DISTRIBUTED] [21:08:35] : [Step 4/5] [2021-11-19 21:08:35,924][INFO ][exchange-worker-#16447%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partitions release latch: ServerLatch [permits=0, pendingAcks=HashSet [], super=CompletableLatch [id=CompletableLatchUid [id=exchange, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=3]]]] [21:08:35] : [Step 4/5] [2021-11-19 21:08:35,925][INFO ][exchange-worker-#16569%grid-1%][GridDhtPartitionsExchangeFuture] Finished waiting for partitions release latch: ClientLatch [coordinator=TcpDiscoveryNode [id=00fde489-de9a-42fc-86db-05e6dcefe000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345307934, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], ackSent=true, super=CompletableLatch [id=CompletableLatchUid [id=exchange, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=3]]]] [21:08:35] : [Step 4/5] [2021-11-19 21:08:35,925][INFO ][exchange-worker-#16447%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=3], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:08:35] : [Step 4/5] [2021-11-19 21:08:35,926][INFO ][exchange-worker-#16569%grid-1%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=3], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:08:35] : [Step 4/5] [2021-11-19 21:08:35,960][INFO ][exchange-worker-#16447%grid-0%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=3], crd=true] [21:08:35] : [Step 4/5] [2021-11-19 21:08:35,964][INFO ][exchange-worker-#16569%grid-1%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=3], crd=false] [21:08:35] : [Step 4/5] [2021-11-19 21:08:35,965][INFO ][sys-#16425%grid-0%][GridDhtPartitionsExchangeFuture] Coordinator received single message [ver=AffinityTopologyVersion [topVer=2, minorTopVer=3], node=1042764c-e469-4e0e-ae46-3a3936f00001, allReceived=true] [21:08:35] : [Step 4/5] [2021-11-19 21:08:35,966][INFO ][sys-#16425%grid-0%][GridDhtPartitionsExchangeFuture] finishExchangeOnCoordinator [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=3], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=3]] [21:08:35] : [Step 4/5] [2021-11-19 21:08:35,972][INFO ][sys-#16425%grid-0%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=3], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=3], err=null, rebalanced=true, wasRebalanced=true] [21:08:35] : [Step 4/5] [2021-11-19 21:08:35,974][INFO ][sys-#16557%grid-1%][GridDhtPartitionsExchangeFuture] Received full message, will finish exchange [node=00fde489-de9a-42fc-86db-05e6dcefe000, resVer=AffinityTopologyVersion [topVer=2, minorTopVer=3]] [21:08:35] : [Step 4/5] [2021-11-19 21:08:35,975][INFO ][sys-#16425%grid-0%][GridCacheProcessor] Finish proxy initialization, cacheName=cache2, localNodeId=00fde489-de9a-42fc-86db-05e6dcefe000 [21:08:35] : [Step 4/5] [2021-11-19 21:08:35,977][INFO ][sys-#16425%grid-0%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=00fde489-de9a-42fc-86db-05e6dcefe000, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=3], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=00fde489-de9a-42fc-86db-05e6dcefe000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345315898, loc=true, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=2, minorTopVer=3]] [21:08:35] : [Step 4/5] [2021-11-19 21:08:35,978][INFO ][exchange-worker-#16447%grid-0%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=2, minorTopVer=3], force=false, evt=DISCOVERY_CUSTOM_EVT, node=00fde489-de9a-42fc-86db-05e6dcefe000] [21:08:35] : [Step 4/5] [2021-11-19 21:08:35,978][INFO ][sys-#16557%grid-1%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=3], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=3], err=null, rebalanced=true, wasRebalanced=true] [21:08:35] : [Step 4/5] [2021-11-19 21:08:35,979][INFO ][sys-#16425%grid-0%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=3], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=3], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (1 ms), stage="Update caches registry" (0 ms), stage="Start caches" (64 ms), stage="Affinity initialization on cache group start" (2 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Wait partitions release latch [latch=exchange]" (29 ms), stage="Wait partitions release [latch=exchange]" (1 ms), stage="Restore partition states" (12 ms), stage="After states restored callback" (21 ms), stage="WAL history reservation" (0 ms), stage="Waiting for all single messages" (5 ms), stage="Affinity recalculation (crd)" (0 ms), stage="Collect update counters and create affinity messages" (0 ms), stage="Assign partitions states" (1 ms), stage="Validate partitions states" (0 ms), stage="Apply update counters" (0 ms), stage="Full message preparing" (2 ms), stage="Full message sending" (0 ms), stage="Exchange done" (7 ms), stage="Total time" (145 ms), Discovery lag=32 ms, Latest started node id=1042764c-e469-4e0e-ae46-3a3936f00001] [21:08:35] : [Step 4/5] [2021-11-19 21:08:35,982][INFO ][sys-#16557%grid-1%][GridCacheProcessor] Finish proxy initialization, cacheName=cache2, localNodeId=1042764c-e469-4e0e-ae46-3a3936f00001 [21:08:35] : [Step 4/5] [2021-11-19 21:08:35,983][INFO ][sys-#16425%grid-0%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=3], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=3], stage="Affinity initialization on cache group start [grp=cache2]" (1 ms) (parent=Affinity initialization on cache group start), stage="Restore partition states [grp=cache2]" (12 ms) (parent=Restore partition states), stage="Restore partition states [grp=ignite-sys-cache]" (0 ms) (parent=Restore partition states), stage="Restore partition states [grp=encrypted]" (0 ms) (parent=Restore partition states)] [21:08:35] : [Step 4/5] [2021-11-19 21:08:35,985][INFO ][sys-#16557%grid-1%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=1042764c-e469-4e0e-ae46-3a3936f00001, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=3], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=00fde489-de9a-42fc-86db-05e6dcefe000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345307934, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=2, minorTopVer=3]] [21:08:35] : [Step 4/5] [2021-11-19 21:08:35,986][INFO ][exchange-worker-#16569%grid-1%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=2, minorTopVer=3], force=false, evt=DISCOVERY_CUSTOM_EVT, node=00fde489-de9a-42fc-86db-05e6dcefe000] [21:08:35] : [Step 4/5] [2021-11-19 21:08:35,987][INFO ][sys-#16557%grid-1%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=3], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=3], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (1 ms), stage="Update caches registry" (0 ms), stage="Start caches" (60 ms), stage="Affinity initialization on cache group start" (2 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Wait partitions release latch [latch=exchange]" (1 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Restore partition states" (12 ms), stage="After states restored callback" (23 ms), stage="WAL history reservation" (0 ms), stage="Waiting for Full message" (11 ms), stage="Affinity recalculation" (0 ms), stage="Full map updating" (3 ms), stage="Exchange done" (8 ms), stage="Total time" (121 ms)] [21:08:35] : [Step 4/5] [2021-11-19 21:08:35,989][INFO ][sys-#16557%grid-1%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=3], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=3], stage="Affinity initialization on cache group start [grp=cache2]" (1 ms) (parent=Affinity initialization on cache group start), stage="Restore partition states [grp=cache2]" (12 ms) (parent=Restore partition states), stage="Restore partition states [grp=ignite-sys-cache]" (0 ms) (parent=Restore partition states), stage="Restore partition states [grp=encrypted]" (0 ms) (parent=Restore partition states)] [21:08:37] : [Step 4/5] [21:08:37] >>> Stopping test: MasterKeyChangeTest#testRejectCacheStartDuringRotation in 13213 ms <<< [21:08:37] : [Step 4/5] [2021-11-19 21:08:37,037][INFO ][main][root] >>> Stopping test: MasterKeyChangeTest#testRejectCacheStartDuringRotation in 13213 ms <<< [21:08:37] : [Step 4/5] [21:08:37] >>> Heap: 459 MB used / 1913 MB commited / 1913 MB max <<< [21:08:37] : [Step 4/5] [2021-11-19 21:08:37,038][INFO ][main][root] >>> Heap: 459 MB used / 1913 MB commited / 1913 MB max <<< [21:08:37] : [Step 4/5] [21:08:37] >>> Non-Heap: 146 MB used / 179 MB commited / 0 MB max <<< [21:08:37] : [Step 4/5] [2021-11-19 21:08:37,038][INFO ][main][root] >>> Non-Heap: 146 MB used / 179 MB commited / 0 MB max <<< [21:08:37] : [Step 4/5] [21:08:37] >>> Starting test: MasterKeyChangeTest#testRejectCacheStartOnClientDuringRotation <<< [21:08:37] : [Step 4/5] [2021-11-19 21:08:37,040][INFO ][main][root] >>> Starting test: MasterKeyChangeTest#testRejectCacheStartOnClientDuringRotation <<< [21:08:37] : [Step 4/5] [21:08:37] >>> Heap: 459 MB used / 1913 MB commited / 1913 MB max <<< [21:08:37] : [Step 4/5] [2021-11-19 21:08:37,040][INFO ][main][root] >>> Heap: 459 MB used / 1913 MB commited / 1913 MB max <<< [21:08:37] : [Step 4/5] [21:08:37] >>> Non-Heap: 146 MB used / 179 MB commited / 0 MB max <<< [21:08:37] : [Step 4/5] [2021-11-19 21:08:37,041][INFO ][main][root] >>> Non-Heap: 146 MB used / 179 MB commited / 0 MB max <<< [21:08:37] : [Step 4/5] [2021-11-19 21:08:37,041][INFO ][main][root] >>> Stopping grid [name=grid-1, id=1042764c-e469-4e0e-ae46-3a3936f00001] [21:08:37] : [Step 4/5] [2021-11-19 21:08:37,072][INFO ][db-checkpoint-thread-#16578%grid-1%][Checkpointer] Checkpoint started [checkpointId=0f93f2e1-bab6-4262-b05d-a687b689e347, startPtr=WALPointer [idx=0, fileOff=1153292, len=21795], checkpointBeforeLockTime=10ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=1ms, checkpointLockHoldTime=2ms, walCpRecordFsyncDuration=10ms, writeCheckpointEntryDuration=2ms, splitAndSortCpPagesDuration=1ms, pages=899, reason='timeout'] [21:08:37] : [Step 4/5] [2021-11-19 21:08:37,080][INFO ][tcp-disco-sock-reader-[00fde489 127.0.0.1:56847]-#868%grid-1%-#16565%grid-1%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:56847, rmtPort=56847, rmtNodeId=00fde489-de9a-42fc-86db-05e6dcefe000] [21:08:37] : [Step 4/5] [2021-11-19 21:08:37,081][INFO ][disco-event-worker-#16446%grid-0%][GridDiscoveryManager] Node left topology: TcpDiscoveryNode [id=1042764c-e469-4e0e-ae46-3a3936f00001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637345307914, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false] [21:08:37] : [Step 4/5] [2021-11-19 21:08:37,083][INFO ][main][GridCacheProcessor] Stopped cache [cacheName=ignite-sys-cache] [21:08:37] : [Step 4/5] [2021-11-19 21:08:37,083][INFO ][disco-event-worker-#16446%grid-0%][GridDiscoveryManager] Topology snapshot [ver=3, locNode=00fde489, servers=1, clients=0, state=ACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=00fde489-de9a-42fc-86db-05e6dcefe000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:08:37] : [Step 4/5] [2021-11-19 21:08:37,084][INFO ][disco-event-worker-#16446%grid-0%][GridDiscoveryManager] ^-- Baseline [id=0, size=2, online=1, offline=1] [21:08:37] : [Step 4/5] [2021-11-19 21:08:37,084][INFO ][main][GridCacheProcessor] Stopped cache [cacheName=encrypted] [21:08:37]W: [org.apache.ignite:ignite-core] [2021-11-19 21:08:37,085][WARN ][grid-nio-worker-tcp-comm-0-#16386%TestRecordingCommunicationSpi%][TestRecordingCommunicationSpi] Failed to shutdown socket [21:08:37]W: [org.apache.ignite:ignite-core] java.nio.channels.ClosedChannelException [21:08:37]W: [org.apache.ignite:ignite-core] at sun.nio.ch.SocketChannelImpl.shutdownOutput(SocketChannelImpl.java:795) [21:08:37]W: [org.apache.ignite:ignite-core] at sun.nio.ch.SocketAdaptor.shutdownOutput(SocketAdaptor.java:407) [21:08:37]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.close(IgniteUtils.java:4247) [21:08:37]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.closeKey(GridNioServer.java:2784) [21:08:37]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.close(GridNioServer.java:2835) [21:08:37]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.close(GridNioServer.java:2794) [21:08:37]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.bodyInternal(GridNioServer.java:2157) [21:08:37]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.body(GridNioServer.java:1910) [21:08:37]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:125) [21:08:37]W: [org.apache.ignite:ignite-core] at java.lang.Thread.run(Thread.java:748) [21:08:37] : [Step 4/5] [2021-11-19 21:08:37,087][INFO ][exchange-worker-#16447%grid-0%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], crd=true, evt=NODE_LEFT, evtNode=1042764c-e469-4e0e-ae46-3a3936f00001, customEvt=null, allowMerge=false, exchangeFreeSwitch=true] [21:08:37] : [Step 4/5] [2021-11-19 21:08:37,086][INFO ][main][GridCacheProcessor] Stopped cache [cacheName=cache2] [21:08:37] : [Step 4/5] [2021-11-19 21:08:37,090][INFO ][sys-#16431%grid-0%][GridAffinityAssignmentCache] Local node affinity assignment distribution is not ideal [cache=cache2, expectedPrimary=1024.00, actualPrimary=502, expectedBackups=0.00, actualBackups=0, warningThreshold=50.00%] [21:08:37] : [Step 4/5] [2021-11-19 21:08:37,090][INFO ][sys-#16441%grid-0%][GridAffinityAssignmentCache] Local node affinity assignment distribution is not ideal [cache=encrypted, expectedPrimary=1024.00, actualPrimary=502, expectedBackups=0.00, actualBackups=0, warningThreshold=50.00%] [21:08:37] : [Step 4/5] [2021-11-19 21:08:37,092][INFO ][exchange-worker-#16447%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:08:37] : [Step 4/5] [2021-11-19 21:08:37,095][INFO ][exchange-worker-#16447%grid-0%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], err=null, rebalanced=true, wasRebalanced=true] [21:08:37]W: [org.apache.ignite:ignite-core] [2021-11-19 21:08:37,096][WARN ][sys-#16418%grid-0%][GridDhtPartitionTopologyImpl] Detected lost partitions [grp=encrypted, parts=[0, 2, 4, 6-7, 10-11, 14, 17, 21, 24-30, 32, 37, 40, 44, 47-52, 54, 57, 59, 62-64, 67-68, 74-75, 78, 81, 87-88, 91, 97, 99, 101-102, 104-107, 113-114, 116, 118, 120, 122, 124, 135-136, 138, 140-145, 147, 149-152, 154-156, 159-160, 162-164, 169, 172, 175-177, 180, 184-187, 190-191, 194, 196-202, 204-205, 209-210, 212, 214, 216, 219-224, 226, 229-232, 237, 239, 241, 243-245, 247, 249-251, 255, 257, 261, 265, 269, 272-273, 276-277, 281-282, 285, 287, 289-291, 293-297, 299, 301-304, 306, 308-309, 311-312, 315-317, 319, 322, 325-326, 328-330, 336, 339, 341, 344-346, 350, 352-354, 357-361, 363, 366-367, 371-373, 376-380, 383, 385, 387-388, 390, 392, 395-397, 400, 402, 405, 408-411, 416, 420, 422, 424-425, 429, 433, 435-438, 440-441, 445-446, 450, 452-453, 455-456, 458, 460, 462-463, 465-468, 470, 474-475, 480, 488, 490-492, 495, 497, 499-512, 516, 525, 527-531, 535, 537-538, 541-542, 545-546, 548-552, 554-555, 558, 562-564, 567-569, 572, 574, 579-580, 582-585, 587, 590-591, 594, 596, 600, 602, 604, 607-614, 617-620, 623-624, 627-629, 632-633, 636, 638, 640-642, 645-646, 648-649, 657-662, 664-665, 668-672, 677-678, 682-684, 686, 689, 692-693, 695-697, 699, 706-707, 709-710, 712-714, 716-717, 719-721, 723-728, 730-732, 734-735, 739, 742, 746, 749-750, 752, 754, 756, 762, 768-770, 772-775, 778, 780, 783-787, 789-791, 793, 796, 798-801, 803, 806, 809-812, 814, 816-817, 819, 822-825, 827-829, 832-833, 836-837, 839-840, 846, 848-851, 853-854, 857-858, 860, 863-864, 866, 868-871, 873-875, 877-878, 884, 888-889, 896-897, 900, 905-907, 914-915, 917, 919-920, 923-925, 931-933, 936, 940, 942, 944-945, 948, 950-951, 954, 956-958, 962, 965-970, 972, 975-976, 978-980, 983, 985, 988, 990, 993-994, 997-998, 1000, 1003-1004, 1007, 1009, 1014, 1016, 1018-1019], topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0]] [21:08:37]W: [org.apache.ignite:ignite-core] [2021-11-19 21:08:37,097][WARN ][exchange-worker-#16447%grid-0%][GridDhtPartitionTopologyImpl] Detected lost partitions [grp=cache2, parts=[0, 2, 4, 6-7, 10-11, 14, 17, 21, 24-30, 32, 37, 40, 44, 47-52, 54, 57, 59, 62-64, 67-68, 74-75, 78, 81, 87-88, 91, 97, 99, 101-102, 104-107, 113-114, 116, 118, 120, 122, 124, 135-136, 138, 140-145, 147, 149-152, 154-156, 159-160, 162-164, 169, 172, 175-177, 180, 184-187, 190-191, 194, 196-202, 204-205, 209-210, 212, 214, 216, 219-224, 226, 229-232, 237, 239, 241, 243-245, 247, 249-251, 255, 257, 261, 265, 269, 272-273, 276-277, 281-282, 285, 287, 289-291, 293-297, 299, 301-304, 306, 308-309, 311-312, 315-317, 319, 322, 325-326, 328-330, 336, 339, 341, 344-346, 350, 352-354, 357-361, 363, 366-367, 371-373, 376-380, 383, 385, 387-388, 390, 392, 395-397, 400, 402, 405, 408-411, 416, 420, 422, 424-425, 429, 433, 435-438, 440-441, 445-446, 450, 452-453, 455-456, 458, 460, 462-463, 465-468, 470, 474-475, 480, 488, 490-492, 495, 497, 499-512, 516, 525, 527-531, 535, 537-538, 541-542, 545-546, 548-552, 554-555, 558, 562-564, 567-569, 572, 574, 579-580, 582-585, 587, 590-591, 594, 596, 600, 602, 604, 607-614, 617-620, 623-624, 627-629, 632-633, 636, 638, 640-642, 645-646, 648-649, 657-662, 664-665, 668-672, 677-678, 682-684, 686, 689, 692-693, 695-697, 699, 706-707, 709-710, 712-714, 716-717, 719-721, 723-728, 730-732, 734-735, 739, 742, 746, 749-750, 752, 754, 756, 762, 768-770, 772-775, 778, 780, 783-787, 789-791, 793, 796, 798-801, 803, 806, 809-812, 814, 816-817, 819, 822-825, 827-829, 832-833, 836-837, 839-840, 846, 848-851, 853-854, 857-858, 860, 863-864, 866, 868-871, 873-875, 877-878, 884, 888-889, 896-897, 900, 905-907, 914-915, 917, 919-920, 923-925, 931-933, 936, 940, 942, 944-945, 948, 950-951, 954, 956-958, 962, 965-970, 972, 975-976, 978-980, 983, 985, 988, 990, 993-994, 997-998, 1000, 1003-1004, 1007, 1009, 1014, 1016, 1018-1019], topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0]] [21:08:37] : [Step 4/5] [2021-11-19 21:08:37,105][INFO ][exchange-worker-#16447%grid-0%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=00fde489-de9a-42fc-86db-05e6dcefe000, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], evt=NODE_LEFT, evtNode=TcpDiscoveryNode [id=1042764c-e469-4e0e-ae46-3a3936f00001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637345307914, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0]] [21:08:37] : [Step 4/5] [2021-11-19 21:08:37,106][INFO ][exchange-worker-#16447%grid-0%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (1 ms), stage="Determine exchange type" (3 ms), stage="Preloading notification" (0 ms), stage="After states restored callback" (0 ms), stage="WAL history reservation" (0 ms), stage="Finalize update counters" (0 ms), stage="Detect lost partitions" (9 ms), stage="Exchange done" (2 ms), stage="Total time" (15 ms)] [21:08:37] : [Step 4/5] [2021-11-19 21:08:37,107][INFO ][exchange-worker-#16447%grid-0%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], stage="Affinity initialization (exchange-free switch on fully-rebalanced topology) [grp=encrypted]" (2 ms) (parent=Determine exchange type), stage="Affinity initialization (exchange-free switch on fully-rebalanced topology) [grp=cache2]" (1 ms) (parent=Determine exchange type), stage="Affinity initialization (exchange-free switch on fully-rebalanced topology) [grp=ignite-sys-cache]" (0 ms) (parent=Determine exchange type)] [21:08:37] : [Step 4/5] [2021-11-19 21:08:37,109][INFO ][exchange-worker-#16447%grid-0%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], crd=true] [21:08:37] : [Step 4/5] [2021-11-19 21:08:37,111][INFO ][exchange-worker-#16447%grid-0%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=3, minorTopVer=0], force=false, evt=NODE_LEFT, node=1042764c-e469-4e0e-ae46-3a3936f00001] [21:08:37] : [Step 4/5] [2021-11-19 21:08:37,788][INFO ][main][FilePageStoreManager] Cleanup cache stores [total=5, left=0, cleanFiles=false] [21:08:37] : [Step 4/5] [2021-11-19 21:08:37,791][INFO ][main][GridDeploymentLocalStore] Removed undeployed class: GridDeployment [ts=1637345308441, depMode=SHARED, clsLdr=IsolatedClassLoader{roleName='test'}, clsLdrId=9bf5d593d71-1042764c-e469-4e0e-ae46-3a3936f00001, userVer=0, loc=true, sampleClsName=org.apache.ignite.internal.processors.cache.distributed.dht.preloader.IgniteDhtPartitionCountersMap2, pendingUndeploy=false, undeployed=true, usage=0] [21:08:37] : [Step 4/5] [2021-11-19 21:08:37,801][INFO ][main][IgniteKernal%grid-1] [21:08:37] : [Step 4/5] [21:08:37] : [Step 4/5] >>> +------------------------------------------------------+ [21:08:37] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV stopped OK [21:08:37] : [Step 4/5] >>> +------------------------------------------------------+ [21:08:37] : [Step 4/5] >>> Ignite instance name: grid-1 [21:08:37] : [Step 4/5] >>> Grid uptime: 00:00:09.832 [21:08:37] : [Step 4/5] [21:08:37] : [Step 4/5] [21:08:37] : [Step 4/5] [2021-11-19 21:08:37,801][INFO ][main][root] >>> Stopping grid [name=grid-0, id=00fde489-de9a-42fc-86db-05e6dcefe000] [21:08:37] : [Step 4/5] [2021-11-19 21:08:37,827][INFO ][db-checkpoint-thread-#16583%grid-0%][Checkpointer] Checkpoint started [checkpointId=6995b72b-4590-46b3-809c-07ced663bb5f, startPtr=WALPointer [idx=0, fileOff=1384151, len=21035], checkpointBeforeLockTime=7ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=2ms, checkpointLockHoldTime=6ms, walCpRecordFsyncDuration=3ms, writeCheckpointEntryDuration=2ms, splitAndSortCpPagesDuration=1ms, pages=1139, reason='timeout'] [21:08:37]W: [org.apache.ignite:ignite-core] [2021-11-19 21:08:37,831][WARN ][tcp-disco-sock-reader-[1042764c 127.0.0.1:45267]-#869%grid-0%-#16566%grid-0%][TestTcpDiscoverySpi] Failed to shutdown socket [21:08:37]W: [org.apache.ignite:ignite-core] java.net.SocketException: Socket is closed [21:08:37]W: [org.apache.ignite:ignite-core] at java.net.Socket.shutdownOutput(Socket.java:1568) [21:08:37]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.close(IgniteUtils.java:4247) [21:08:37]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.discovery.tcp.ServerImpl$SocketReader.body(ServerImpl.java:7370) [21:08:37]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.IgniteSpiThread.run(IgniteSpiThread.java:58) [21:08:37] : [Step 4/5] [2021-11-19 21:08:37,833][INFO ][tcp-disco-sock-reader-[1042764c 127.0.0.1:45267]-#869%grid-0%-#16566%grid-0%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:45267, rmtPort=45267, rmtNodeId=1042764c-e469-4e0e-ae46-3a3936f00001] [21:08:37] : [Step 4/5] [2021-11-19 21:08:37,835][INFO ][main][GridCacheProcessor] Stopped cache [cacheName=ignite-sys-cache] [21:08:37] : [Step 4/5] [2021-11-19 21:08:37,835][INFO ][main][GridCacheProcessor] Stopped cache [cacheName=encrypted] [21:08:37] : [Step 4/5] [2021-11-19 21:08:37,837][INFO ][main][GridCacheProcessor] Stopped cache [cacheName=cache2] [21:08:38] : [Step 4/5] [2021-11-19 21:08:38,768][INFO ][main][FilePageStoreManager] Cleanup cache stores [total=5, left=0, cleanFiles=false] [21:08:38] : [Step 4/5] [2021-11-19 21:08:38,770][INFO ][main][GridDeploymentLocalStore] Removed undeployed class: GridDeployment [ts=1637345308430, depMode=SHARED, clsLdr=IsolatedClassLoader{roleName='test'}, clsLdrId=7bf5d593d71-00fde489-de9a-42fc-86db-05e6dcefe000, userVer=0, loc=true, sampleClsName=org.apache.ignite.internal.processors.cache.distributed.dht.preloader.GridDhtPartitionMap, pendingUndeploy=false, undeployed=true, usage=0] [21:08:38] : [Step 4/5] [2021-11-19 21:08:38,779][INFO ][main][IgniteKernal%grid-0] [21:08:38] : [Step 4/5] [21:08:38] : [Step 4/5] >>> +------------------------------------------------------+ [21:08:38] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV stopped OK [21:08:38] : [Step 4/5] >>> +------------------------------------------------------+ [21:08:38] : [Step 4/5] >>> Ignite instance name: grid-0 [21:08:38] : [Step 4/5] >>> Grid uptime: 00:00:12.912 [21:08:38] : [Step 4/5] [21:08:38] : [Step 4/5] [21:08:39]W: [org.apache.ignite:ignite-core] [2021-11-19 21:08:39,070][WARN ][test-runner-#16603%encryption.MasterKeyChangeTest%][G] Ignite work directory is not provided, automatically resolved to: /opt/buildagent/work/7bc1c54bc719b67c/work [21:08:39] : [Step 4/5] [2021-11-19 21:08:39,072][INFO ][test-runner-#16603%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] [21:08:39] : [Step 4/5] [21:08:39] : [Step 4/5] >>> __________ ________________ [21:08:39] : [Step 4/5] >>> / _/ ___/ |/ / _/_ __/ __/ [21:08:39] : [Step 4/5] >>> _/ // (7 7 // / / / / _/ [21:08:39] : [Step 4/5] >>> /___/\___/_/|_/___/ /_/ /___/ [21:08:39] : [Step 4/5] >>> [21:08:39] : [Step 4/5] >>> ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:08:39] : [Step 4/5] >>> 2021 Copyright(C) Apache Software Foundation [21:08:39] : [Step 4/5] >>> [21:08:39] : [Step 4/5] >>> Ignite documentation: http://ignite.apache.org [21:08:39] : [Step 4/5] [21:08:39] : [Step 4/5] [2021-11-19 21:08:39,073][INFO ][test-runner-#16603%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] Config URL: n/a [21:08:39] : [Step 4/5] [2021-11-19 21:08:39,073][INFO ][test-runner-#16603%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] IgniteConfiguration [igniteInstanceName=grid-0, pubPoolSize=24, svcPoolSize=24, callbackPoolSize=24, stripedPoolSize=24, sysPoolSize=24, mgmtPoolSize=4, dataStreamerPoolSize=24, utilityCachePoolSize=24, utilityCacheKeepAliveTime=60000, p2pPoolSize=2, qryPoolSize=24, buildIdxPoolSize=4, igniteHome=/opt/buildagent/work/7bc1c54bc719b67c, igniteWorkDir=/opt/buildagent/work/7bc1c54bc719b67c/work, mbeanSrv=com.sun.jmx.mbeanserver.JmxMBeanServer@6fe85038, nodeId=00a02231-1868-4c3c-bdce-ddb61ce23000, marsh=BinaryMarshaller [], marshLocJobs=false, daemon=false, p2pEnabled=true, netTimeout=10000, netCompressionLevel=1, sndRetryDelay=1000, sndRetryCnt=3, metricsHistSize=10000, metricsUpdateFreq=1000, metricsExpTime=9223372036854775807, discoSpi=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=0, ackTimeout=0, marsh=null, reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], segPlc=STOP, segResolveAttempts=2, waitForSegOnStart=true, allResolversPassReq=true, segChkFreq=10000, commSpi=TcpCommunicationSpi [connectGate=org.apache.ignite.spi.communication.tcp.internal.ConnectGateway@6f8924a1, ctxInitLatch=java.util.concurrent.CountDownLatch@1d158bc2[Count = 1], stopping=false, clientPool=null, nioSrvWrapper=null, stateProvider=null], evtSpi=MemoryEventStorageSpi [expireAgeMs=9223372036854775807, expireCnt=10000, filter=null], colSpi=NoopCollisionSpi [], deploySpi=LocalDeploymentSpi [], indexingSpi=org.apache.ignite.spi.indexing.noop.NoopIndexingSpi@55f18c1a, addrRslvr=null, encryptionSpi=org.apache.ignite.spi.encryption.keystore.KeystoreEncryptionSpi@be2fe21, tracingSpi=org.apache.ignite.spi.tracing.NoopTracingSpi@47ef1ee2, clientMode=false, rebalanceThreadPoolSize=4, rebalanceTimeout=10000, rebalanceBatchesPrefetchCnt=3, rebalanceThrottle=0, rebalanceBatchSize=524288, txCfg=TransactionConfiguration [txSerEnabled=false, dfltIsolation=REPEATABLE_READ, dfltConcurrency=PESSIMISTIC, dfltTxTimeout=0, txTimeoutOnPartitionMapExchange=0, deadlockTimeout=10000, pessimisticTxLogSize=0, pessimisticTxLogLinger=10000, tmLookupClsName=null, txManagerFactory=null, useJtaSync=false], cacheSanityCheckEnabled=true, discoStartupDelay=60000, deployMode=SHARED, p2pMissedCacheSize=100, locHost=127.0.0.1, timeSrvPortBase=31100, timeSrvPortRange=100, failureDetectionTimeout=10000, sysWorkerBlockedTimeout=null, clientFailureDetectionTimeout=10000, metricsLogFreq=0, connectorCfg=null, odbcCfg=null, warmupClos=null, atomicCfg=AtomicConfiguration [seqReserveSize=1000, cacheMode=PARTITIONED, backups=1, aff=null, grpName=null], classLdr=null, sslCtxFactory=null, platformCfg=null, binaryCfg=null, memCfg=null, pstCfg=null, dsCfg=DataStorageConfiguration [sysRegionInitSize=41943040, sysRegionMaxSize=104857600, pageSize=4096, concLvl=0, dfltDataRegConf=DataRegionConfiguration [name=default, maxSize=10485760, initSize=268435456, swapPath=null, pageEvictionMode=DISABLED, pageReplacementMode=CLOCK, evictionThreshold=0.9, emptyPagesPoolSize=100, metricsEnabled=false, metricsSubIntervalCount=5, metricsRateTimeInterval=60000, persistenceEnabled=true, checkpointPageBufSize=0, lazyMemoryAllocation=true, warmUpCfg=null], dataRegions=null, storagePath=null, checkpointFreq=180000, lockWaitTime=10000, checkpointThreads=4, checkpointWriteOrder=SEQUENTIAL, walHistSize=20, maxWalArchiveSize=1073741824, walSegments=10, walSegmentSize=67108864, walPath=db/wal, walArchivePath=db/wal/archive, cdcWalPath=db/wal/cdc, cdcEnabled=false, metricsEnabled=false, walMode=FSYNC, walTlbSize=131072, walBuffSize=0, walFlushFreq=2000, walFsyncDelay=1000, walRecordIterBuffSize=67108864, alwaysWriteFullPages=false, fileIOFactory=org.apache.ignite.internal.processors.cache.persistence.file.AsyncFileIOFactory@7bc58284, metricsSubIntervalCnt=5, metricsRateTimeInterval=60000, walAutoArchiveAfterInactivity=-1, walForceArchiveTimeout=-1, writeThrottlingEnabled=false, walCompactionEnabled=false, walCompactionLevel=1, checkpointReadLockTimeout=null, walPageCompression=DISABLED, walPageCompressionLevel=null, dfltWarmUpCfg=null, encCfg=org.apache.ignite.configuration.EncryptionConfiguration@1b53429f, defragmentationThreadPoolSize=4, minWalArchiveSize=-1], snapshotPath=snapshots, activeOnStart=true, activeOnStartPropSetFlag=false, autoActivation=true, autoActivationPropSetFlag=false, clusterStateOnStart=null, sqlConnCfg=null, cliConnCfg=ClientConnectorConfiguration [host=null, port=10800, portRange=100, sockSndBufSize=0, sockRcvBufSize=0, tcpNoDelay=true, maxOpenCursorsPerConn=128, threadPoolSize=24, selectorCnt=12, idleTimeout=0, handshakeTimeout=10000, jdbcEnabled=true, odbcEnabled=true, thinCliEnabled=true, sslEnabled=false, useIgniteSslCtxFactory=true, sslClientAuth=false, sslCtxFactory=null, thinCliCfg=ThinClientConfiguration [maxActiveTxPerConn=100, maxActiveComputeTasksPerConn=0]], mvccVacuumThreadCnt=2, mvccVacuumFreq=5000, authEnabled=false, failureHnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]], commFailureRslvr=null, sqlCfg=SqlConfiguration [longQryWarnTimeout=3000, dfltQryTimeout=0, sqlQryHistSize=1000, validationEnabled=false], asyncContinuationExecutor=null] [21:08:39] : [Step 4/5] [2021-11-19 21:08:39,083][INFO ][test-runner-#16603%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] Daemon mode: off [21:08:39] : [Step 4/5] [2021-11-19 21:08:39,084][INFO ][test-runner-#16603%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] OS: Linux 4.15.0-151-generic amd64 [21:08:39] : [Step 4/5] [2021-11-19 21:08:39,084][INFO ][test-runner-#16603%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] OS user: teamcity [21:08:39] : [Step 4/5] [2021-11-19 21:08:39,084][INFO ][test-runner-#16603%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] PID: 16724 [21:08:39] : [Step 4/5] [2021-11-19 21:08:39,084][INFO ][test-runner-#16603%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] Language runtime: Java Platform API Specification ver. 1.8 [21:08:39] : [Step 4/5] [2021-11-19 21:08:39,085][INFO ][test-runner-#16603%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] VM information: Java(TM) SE Runtime Environment 1.8.0_261-b12 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 25.261-b12 [21:08:39] : [Step 4/5] [2021-11-19 21:08:39,085][INFO ][test-runner-#16603%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] VM total memory: 1.9GB [21:08:39] : [Step 4/5] [2021-11-19 21:08:39,085][INFO ][test-runner-#16603%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] Remote Management [restart: off, REST: off, JMX (remote: off)] [21:08:39] : [Step 4/5] [2021-11-19 21:08:39,085][INFO ][test-runner-#16603%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] Logger: GridTestLog4jLogger [quiet=false, config=null] [21:08:39] : [Step 4/5] [2021-11-19 21:08:39,086][INFO ][test-runner-#16603%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] IGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c [21:08:39] : [Step 4/5] [2021-11-19 21:08:39,086][INFO ][test-runner-#16603%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] VM arguments: [-DIGNITE_DUMP_THREADS_ON_FAILURE=false, -DMono=/usr/bin/mono-sgen, -DMono4.0_x64=/usr/lib/mono/4.0, -DMono4.5_x64=/usr/lib/mono/4.5, -DMonoVersion=6.12.0.90, -DSKIP_BUILD=false, -Dagent.home.dir=/opt/buildagent, -Dagent.name=aitc-lin02_03, -Dagent.ownPort=9090, -Dagent.work.dir=/opt/buildagent/work, -Dbuild.number=95, -Dbuild.vcs.number=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.1=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.GitHubApacheIgnite=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dclassworlds.conf=/opt/buildagent/temp/buildTmp/teamcity.m2.conf, -Dcom.jetbrains.maven.watcher.report.file=/opt/buildagent/temp/buildTmp/maven-build-info.xml, -Djava.io.tmpdir=/opt/buildagent/temp/buildTmp, -Dmaven.home=/opt/buildagent/tools/maven3_6, -Dmaven.multiModuleProjectDirectory=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.agent.cpuBenchmark=457, -Dteamcity.agent.dotnet.agent_url=http://localhost:9090/RPC2, -Dteamcity.agent.dotnet.build_id=6278078, -Dteamcity.auth.password=*******, -Dteamcity.auth.userId=TeamCityBuildId=6278078, -Dteamcity.build.changedFiles.file=/opt/buildagent/temp/buildTmp/changedFiles6342607772318147725.txt, -Dteamcity.build.checkoutDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.build.id=6278078, -Dteamcity.build.properties.file=/opt/buildagent/temp/buildTmp/teamcity.build5164517880467851002.properties, -Dteamcity.build.tempDir=/opt/buildagent/temp/buildTmp, -Dteamcity.build.workingDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.buildConfName=Basic 3, -Dteamcity.buildType.id=IgniteTests24Java8_Basic3, -Dteamcity.configuration.properties.file=/opt/buildagent/temp/buildTmp/teamcity.config5591980786735343870.properties, -Dteamcity.maven.userSettings.path=/opt/buildagent/temp/buildTmp/maven_settings_585072866407032347.xml, -Dteamcity.maven.watcher.home=/opt/buildagent/plugins/mavenPlugin/maven-watcher-jdk16, -Dteamcity.projectName=Ignite Tests 2.x (JDK 8/11), -Dteamcity.runner.properties.file=/opt/buildagent/temp/buildTmp/teamcity.runner9098465561618137420.properties, -Dteamcity.tests.recentlyFailedTests.file=/opt/buildagent/temp/buildTmp/testsToRunFirst3891775683130404069.txt, -Dteamcity.version=2021.2 (build 99542), -ea, -Xms2g, -Xmx2g, -XX:+HeapDumpOnOutOfMemoryError, -DIGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_TEST_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_UPDATE_NOTIFIER=false, -DIGNITE_NO_DISCO_ORDER=true, -DIGNITE_PERFORMANCE_SUGGESTIONS_DISABLED=true, -Djava.net.preferIPv4Stack=true, -DTEST_SCALE_FACTOR=1.0, -DIGNITE_TEST_PROP_LOG4J_FILE=log4j-tc-test.xml, -DIGNITE_QUIET=false, -DIGNITE_MARSHAL_BUFFERS_RECHECK=1000, -Dmaven.repo.local=/opt/buildagent/.m2/repository] [21:08:39] : [Step 4/5] [2021-11-19 21:08:39,090][INFO ][test-runner-#16603%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] System cache's DataRegion size is configured to 40 MB. Use DataStorageConfiguration.systemRegionInitialSize property to change the setting. [21:08:39] : [Step 4/5] [2021-11-19 21:08:39,091][INFO ][test-runner-#16603%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] Configured caches [in 'sysMemPlc' dataRegion: ['ignite-sys-cache']] [21:08:39]W: [org.apache.ignite:ignite-core] [2021-11-19 21:08:39,091][WARN ][test-runner-#16603%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] Peer class loading is enabled (disable it in production for performance and deployment consistency reasons) [21:08:39] : [Step 4/5] [2021-11-19 21:08:39,091][INFO ][test-runner-#16603%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] 3-rd party licenses can be found at: /opt/buildagent/work/7bc1c54bc719b67c/libs/licenses [21:08:39] : [Step 4/5] [2021-11-19 21:08:39,095][INFO ][test-runner-#16603%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] Configured plugins: [21:08:39] : [Step 4/5] [2021-11-19 21:08:39,095][INFO ][test-runner-#16603%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] ^-- StanByClusterTestProvider 1.0 [21:08:39] : [Step 4/5] [2021-11-19 21:08:39,095][INFO ][test-runner-#16603%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:08:39] : [Step 4/5] [2021-11-19 21:08:39,095][INFO ][test-runner-#16603%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] [21:08:39] : [Step 4/5] [2021-11-19 21:08:39,096][INFO ][test-runner-#16603%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] ^-- PageMemory tracker plugin 1.0 [21:08:39] : [Step 4/5] [2021-11-19 21:08:39,096][INFO ][test-runner-#16603%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:08:39] : [Step 4/5] [2021-11-19 21:08:39,096][INFO ][test-runner-#16603%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] [21:08:39] : [Step 4/5] [2021-11-19 21:08:39,096][INFO ][test-runner-#16603%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] ^-- TestDistibutedConfigurationPlugin 1.0 [21:08:39] : [Step 4/5] [2021-11-19 21:08:39,096][INFO ][test-runner-#16603%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:08:39] : [Step 4/5] [2021-11-19 21:08:39,096][INFO ][test-runner-#16603%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] [21:08:39] : [Step 4/5] [2021-11-19 21:08:39,097][INFO ][test-runner-#16603%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] ^-- NodeValidationPluginProvider 1.0 [21:08:39] : [Step 4/5] [2021-11-19 21:08:39,097][INFO ][test-runner-#16603%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:08:39] : [Step 4/5] [2021-11-19 21:08:39,097][INFO ][test-runner-#16603%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] [21:08:39] : [Step 4/5] [2021-11-19 21:08:39,097][INFO ][test-runner-#16603%encryption.MasterKeyChangeTest%][FailureProcessor] Configured failure handler: [hnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]]] [21:08:39] : [Step 4/5] [2021-11-19 21:08:39,109][INFO ][test-runner-#16603%encryption.MasterKeyChangeTest%][TestRecordingCommunicationSpi] Successfully bound communication NIO server to TCP port [port=47100, locHost=/127.0.0.1, selectorsCnt=12, selectorSpins=0, pairedConn=false] [21:08:39]W: [org.apache.ignite:ignite-core] [2021-11-19 21:08:39,110][WARN ][test-runner-#16603%encryption.MasterKeyChangeTest%][TestRecordingCommunicationSpi] Message queue limit is set to 0 which may lead to potential OOMEs when running cache operations in FULL_ASYNC or PRIMARY_SYNC modes due to message queues growth on sender and receiver sides. [21:08:39] : [Step 4/5] [2021-11-19 21:08:39,114][INFO ][test-runner-#16603%encryption.MasterKeyChangeTest%][GridCollisionManager] Collision resolution is disabled (all jobs will be activated upon arrival). [21:08:39] : [Step 4/5] [2021-11-19 21:08:39,114][INFO ][test-runner-#16603%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] Security status [authentication=off, sandbox=off, tls/ssl=off] [21:08:39] : [Step 4/5] [2021-11-19 21:08:39,171][INFO ][test-runner-#16603%encryption.MasterKeyChangeTest%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:08:39] : [Step 4/5] [2021-11-19 21:08:39,258][INFO ][test-runner-#16603%encryption.MasterKeyChangeTest%][MaintenanceProcessor] Resolved store directory for node persistent data: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0 [21:08:39] : [Step 4/5] [2021-11-19 21:08:39,259][INFO ][test-runner-#16603%encryption.MasterKeyChangeTest%][CacheObjectBinaryProcessorImpl] Resolved directory for serialized binary metadata: /opt/buildagent/work/7bc1c54bc719b67c/work/db/binary_meta/grid_0 [21:08:39] : [Step 4/5] [2021-11-19 21:08:39,264][INFO ][test-runner-#16603%encryption.MasterKeyChangeTest%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0 [21:08:39] : [Step 4/5] [2021-11-19 21:08:39,264][INFO ][test-runner-#16603%encryption.MasterKeyChangeTest%][FileWriteAheadLogManager] Resolved write ahead log work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0 [21:08:39] : [Step 4/5] [2021-11-19 21:08:39,265][INFO ][test-runner-#16603%encryption.MasterKeyChangeTest%][FileWriteAheadLogManager] Resolved write ahead log archive directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0 [21:08:39] : [Step 4/5] [2021-11-19 21:08:39,725][INFO ][test-runner-#16603%encryption.MasterKeyChangeTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000000.wal [21:08:39]W: [org.apache.ignite:ignite-core] [2021-11-19 21:08:39,725][WARN ][test-runner-#16603%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] DataRegion maxSize=10.5 MB is smaller than defaultInitialSize=268.4 MB, setting initialSize to 10.5 MB [21:08:39] : [Step 4/5] [2021-11-19 21:08:39,730][INFO ][test-runner-#16603%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Configured data regions initialized successfully [total=5] [21:08:39] : [Step 4/5] [2021-11-19 21:08:39,732][INFO ][test-runner-#16603%encryption.MasterKeyChangeTest%][IgniteSnapshotManager] Resolved snapshot work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/snapshots [21:08:39] : [Step 4/5] [2021-11-19 21:08:39,732][INFO ][test-runner-#16603%encryption.MasterKeyChangeTest%][IgniteSnapshotManager] Resolved temp directory for snapshot creation: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0/snp [21:08:39] : [Step 4/5] [2021-11-19 21:08:39,735][INFO ][test-runner-#16603%encryption.MasterKeyChangeTest%][ClientListenerProcessor] Client connector processor has started on TCP port 10800 [21:08:39] : [Step 4/5] [2021-11-19 21:08:39,740][INFO ][test-runner-#16603%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] Non-loopback local IPs: 172.17.0.4 [21:08:39] : [Step 4/5] [2021-11-19 21:08:39,740][INFO ][test-runner-#16603%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] Enabled local MACs: 0242AC110004 [21:08:39] : [Step 4/5] [2021-11-19 21:08:39,743][INFO ][test-runner-#16603%encryption.MasterKeyChangeTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:08:39] : [Step 4/5] [2021-11-19 21:08:39,744][INFO ][test-runner-#16603%encryption.MasterKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:08:39] : [Step 4/5] [2021-11-19 21:08:39,745][INFO ][test-runner-#16603%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:08:39] : [Step 4/5] [2021-11-19 21:08:39,747][INFO ][test-runner-#16603%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Applying lost metastore updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:08:39] : [Step 4/5] [2021-11-19 21:08:39,747][INFO ][test-runner-#16603%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=0 ms] [21:08:39] : [Step 4/5] [2021-11-19 21:08:39,748][INFO ][test-runner-#16603%encryption.MasterKeyChangeTest%][GridCacheProcessor] Restoring partition state for local groups. [21:08:39] : [Step 4/5] [2021-11-19 21:08:39,748][INFO ][test-runner-#16603%encryption.MasterKeyChangeTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=0, partitionsProcessed=0, time=0ms] [21:08:39] : [Step 4/5] [2021-11-19 21:08:39,749][INFO ][test-runner-#16603%encryption.MasterKeyChangeTest%][GridEncryptionManager] Encryption keys loaded from metastore. [grps=, masterKeyName=ignite.master.key] [21:08:39] : [Step 4/5] [2021-11-19 21:08:39,753][INFO ][test-runner-#16603%encryption.MasterKeyChangeTest%][ClusterProcessor] Cluster ID and tag has been read from metastorage: null [21:08:39] : [Step 4/5] [2021-11-19 21:08:39,753][INFO ][test-runner-#16603%encryption.MasterKeyChangeTest%][IgniteClusterImpl] Shutdown policy was updated [oldVal=null, newVal=null] [21:08:39] : [Step 4/5] [2021-11-19 21:08:39,754][INFO ][test-runner-#16603%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Checkpoint frequency deviation changed [oldVal=null, newVal=null] [21:08:39] : [Step 4/5] [2021-11-19 21:08:39,763][INFO ][test-runner-#16603%encryption.MasterKeyChangeTest%][FilePageStoreManager] Cleanup cache stores [total=1, left=0, cleanFiles=false] [21:08:39] : [Step 4/5] [2021-11-19 21:08:39,766][INFO ][test-runner-#16603%encryption.MasterKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:08:39] : [Step 4/5] [2021-11-19 21:08:39,767][INFO ][test-runner-#16603%encryption.MasterKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:08:39] : [Step 4/5] [2021-11-19 21:08:39,768][INFO ][test-runner-#16603%encryption.MasterKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:08:39] : [Step 4/5] [2021-11-19 21:08:39,768][INFO ][test-runner-#16603%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Data Regions Started: 5 [21:08:39] : [Step 4/5] [2021-11-19 21:08:39,769][INFO ][test-runner-#16603%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] ^-- sysMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:08:39] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:08:39] : [Step 4/5] ^-- default region [type=default, persistence=true, lazyAlloc=true, [21:08:39] : [Step 4/5] ... initCfg=10MB, maxCfg=10MB, usedRam=0MB, freeRam=100%, allocRam=0MB, allocTotal=0MB] [21:08:39] : [Step 4/5] ^-- metastoreMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:08:39] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:08:39] : [Step 4/5] ^-- TxLog region [type=internal, persistence=true, lazyAlloc=false, [21:08:39] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:08:39] : [Step 4/5] ^-- volatileDsMemPlc region [type=user, persistence=false, lazyAlloc=true, [21:08:39] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB] [21:08:39] : [Step 4/5] ^-- Ignite persistence [used=0MB] [21:08:39] : [Step 4/5] [21:08:39] : [Step 4/5] [2021-11-19 21:08:39,770][INFO ][test-runner-#16603%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Starting binary memory restore for: [-2100569601] [21:08:39] : [Step 4/5] [2021-11-19 21:08:39,778][INFO ][test-runner-#16603%encryption.MasterKeyChangeTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:08:39] : [Step 4/5] [2021-11-19 21:08:39,778][INFO ][test-runner-#16603%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:08:39] : [Step 4/5] [2021-11-19 21:08:39,780][INFO ][test-runner-#16603%encryption.MasterKeyChangeTest%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000000.wal, offset=0, ver=2] [21:08:39] : [Step 4/5] [2021-11-19 21:08:39,783][INFO ][test-runner-#16603%encryption.MasterKeyChangeTest%][GridCacheProcessor] Started cache in recovery mode [name=ignite-sys-cache, id=-2100569601, dataRegionName=sysMemPlc, mode=REPLICATED, atomicity=TRANSACTIONAL, backups=2147483647, mvcc=false] [21:08:39] : [Step 4/5] [2021-11-19 21:08:39,784][INFO ][test-runner-#16603%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Binary recovery performed in 14 ms. [21:08:39] : [Step 4/5] [2021-11-19 21:08:39,784][INFO ][test-runner-#16603%encryption.MasterKeyChangeTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:08:39] : [Step 4/5] [2021-11-19 21:08:39,784][INFO ][test-runner-#16603%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Applying lost cache updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:08:39] : [Step 4/5] [2021-11-19 21:08:39,846][INFO ][test-runner-#16603%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=60 ms] [21:08:39] : [Step 4/5] [2021-11-19 21:08:39,847][INFO ][test-runner-#16603%encryption.MasterKeyChangeTest%][GridCacheProcessor] Restoring partition state for local groups. [21:08:39] : [Step 4/5] [2021-11-19 21:08:39,852][INFO ][test-runner-#16603%encryption.MasterKeyChangeTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=1, partitionsProcessed=100, time=0ms] [21:08:40] : [Step 4/5] [2021-11-19 21:08:40,215][INFO ][test-runner-#16603%encryption.MasterKeyChangeTest%][TestTcpDiscoverySpi] Successfully bound to TCP port [port=47500, localHost=localhost/127.0.0.1, locNodeId=00a02231-1868-4c3c-bdce-ddb61ce23000] [21:08:40] : [Step 4/5] [2021-11-19 21:08:40,226][INFO ][disco-notifier-worker-#16714%grid-0%][MvccProcessorImpl] Assigned mvcc coordinator [crd=MvccCoordinator [topVer=AffinityTopologyVersion [topVer=1, minorTopVer=0], nodeId=00a02231-1868-4c3c-bdce-ddb61ce23000, ver=1637345320220, local=true, initialized=false]] [21:08:40] : [Step 4/5] [2021-11-19 21:08:40,227][INFO ][sys-#16693%grid-0%][ClusterProcessor] Writing cluster ID and tag to metastorage on ready for write ClusterIdAndTag [id=c7543684-4cf7-4bdc-acb3-085b0bf86634, tag=magical_tu] [21:08:40] : [Step 4/5] [2021-11-19 21:08:40,232][INFO ][disco-notifier-worker-#16714%grid-0%][ClusterProcessor] magical_tu [21:08:40] : [Step 4/5] [2021-11-19 21:08:40,232][INFO ][disco-notifier-worker-#16714%grid-0%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustEnabled' was changed from 'null' to 'false' [21:08:40] : [Step 4/5] [2021-11-19 21:08:40,233][INFO ][disco-notifier-worker-#16714%grid-0%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustTimeout' was changed from 'null' to '300000' [21:08:40] : [Step 4/5] [2021-11-19 21:08:40,234][INFO ][disco-notifier-worker-#16714%grid-0%][IgniteTxManager] Transactions parameter 'longOperationsDumpTimeout' was changed from 'null' to '60000' [21:08:40] : [Step 4/5] [2021-11-19 21:08:40,234][INFO ][disco-notifier-worker-#16714%grid-0%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpThreshold' was changed from 'null' to '0' [21:08:40] : [Step 4/5] [2021-11-19 21:08:40,235][INFO ][disco-notifier-worker-#16714%grid-0%][IgniteTxManager] Transactions parameter 'transactionTimeDumpSamplesCoefficient' was changed from 'null' to '0.0' [21:08:40] : [Step 4/5] [2021-11-19 21:08:40,235][INFO ][disco-notifier-worker-#16714%grid-0%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpSamplesPerSecondLimit' was changed from 'null' to '5' [21:08:40] : [Step 4/5] [2021-11-19 21:08:40,235][INFO ][disco-notifier-worker-#16714%grid-0%][IgniteTxManager] Transactions parameter 'collisionsDumpInterval' was changed from 'null' to '1000' [21:08:40] : [Step 4/5] [2021-11-19 21:08:40,236][INFO ][disco-notifier-worker-#16714%grid-0%][IgniteTxManager] Transactions parameter 'txOwnerDumpRequestsAllowed' was changed from 'null' to 'true' [21:08:40] : [Step 4/5] [2021-11-19 21:08:40,236][INFO ][disco-notifier-worker-#16714%grid-0%][GridCacheDatabaseSharedManager] Historical rebalance WAL threshold changed [property=historical.rebalance.threshold, oldVal=null, newVal=500] [21:08:40] : [Step 4/5] [2021-11-19 21:08:40,245][INFO ][test-runner-#16603%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] To start Console Management & Monitoring run ignitevisorcmd.{sh|bat} [21:08:40] : [Step 4/5] [2021-11-19 21:08:40,245][INFO ][test-runner-#16603%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] [21:08:40] : [Step 4/5] [21:08:40] : [Step 4/5] >>> +-------------------------------------------+ [21:08:40] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:08:40] : [Step 4/5] >>> +-------------------------------------------+ [21:08:40] : [Step 4/5] >>> OS name: Linux 4.15.0-151-generic amd64 [21:08:40] : [Step 4/5] >>> CPU(s): 24 [21:08:40] : [Step 4/5] >>> Heap: 2.0GB [21:08:40] : [Step 4/5] >>> VM name: 16724@c4dfe9a430b2 [21:08:40] : [Step 4/5] >>> Ignite instance name: grid-0 [21:08:40] : [Step 4/5] >>> Local node [ID=00A02231-1868-4C3C-BDCE-DDB61CE23000, order=1, clientMode=false] [21:08:40] : [Step 4/5] >>> Local node addresses: [127.0.0.1] [21:08:40] : [Step 4/5] >>> Local ports: TCP:10800 TCP:47100 TCP:47500 [21:08:40] : [Step 4/5] [21:08:40] : [Step 4/5] [2021-11-19 21:08:40,246][INFO ][test-runner-#16603%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] >>> Ignite cluster is in INACTIVE state (limited functionality available). Use control.(sh|bat) script or IgniteCluster.state(ClusterState.ACTIVE) to change the state. [21:08:40] : [Step 4/5] [2021-11-19 21:08:40,247][INFO ][test-runner-#16603%encryption.MasterKeyChangeTest%][GridDiscoveryManager] Topology snapshot [ver=1, locNode=00a02231, servers=1, clients=0, state=INACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=00a02231-1868-4c3c-bdce-ddb61ce23000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:08:40] : [Step 4/5] [2021-11-19 21:08:40,247][INFO ][test-runner-#16603%encryption.MasterKeyChangeTest%][G] Node started : [stage="Configure system pool" (0 ms),stage="Start managers" (187 ms),stage="Configure binary metadata" (2 ms),stage="Start processors" (478 ms),stage="Start 'StanByClusterTestProvider' plugin" (0 ms),stage="Start 'PageMemory tracker plugin' plugin" (0 ms),stage="Start 'TestDistibutedConfigurationPlugin' plugin" (0 ms),stage="Start 'NodeValidationPluginProvider' plugin" (0 ms),stage="Init metastore" (23 ms),stage="Init and start regions" (6 ms),stage="Restore binary memory" (13 ms),stage="Restore logical state" (68 ms),stage="Finish recovery" (360 ms),stage="Join topology" (14 ms),stage="Await transition" (2 ms),stage="Await exchange" (17 ms),stage="Total time" (1170 ms)] [21:08:40] : [Step 4/5] [2021-11-19 21:08:40,249][INFO ][test-runner-#16603%encryption.MasterKeyChangeTest%][root] Node started with the following configuration [id=00a02231-1868-4c3c-bdce-ddb61ce23000, marshaller=BinaryMarshaller [], discovery=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=5000, ackTimeout=5000, marsh=JdkMarshaller [clsFilter=org.apache.ignite.marshaller.MarshallerUtils$1@4fd3a84e], reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], binaryCfg=null, lateAff=true] [21:08:40]W: [org.apache.ignite:ignite-core] [2021-11-19 21:08:40,254][WARN ][test-runner-#16603%encryption.MasterKeyChangeTest%][G] Ignite work directory is not provided, automatically resolved to: /opt/buildagent/work/7bc1c54bc719b67c/work [21:08:40] : [Step 4/5] [2021-11-19 21:08:40,256][INFO ][test-runner-#16603%encryption.MasterKeyChangeTest%][IgniteKernal%client] [21:08:40] : [Step 4/5] [21:08:40] : [Step 4/5] >>> __________ ________________ [21:08:40] : [Step 4/5] >>> / _/ ___/ |/ / _/_ __/ __/ [21:08:40] : [Step 4/5] >>> _/ // (7 7 // / / / / _/ [21:08:40] : [Step 4/5] >>> /___/\___/_/|_/___/ /_/ /___/ [21:08:40] : [Step 4/5] >>> [21:08:40] : [Step 4/5] >>> ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:08:40] : [Step 4/5] >>> 2021 Copyright(C) Apache Software Foundation [21:08:40] : [Step 4/5] >>> [21:08:40] : [Step 4/5] >>> Ignite documentation: http://ignite.apache.org [21:08:40] : [Step 4/5] [21:08:40] : [Step 4/5] [2021-11-19 21:08:40,257][INFO ][test-runner-#16603%encryption.MasterKeyChangeTest%][IgniteKernal%client] Config URL: n/a [21:08:40] : [Step 4/5] [2021-11-19 21:08:40,257][INFO ][test-runner-#16603%encryption.MasterKeyChangeTest%][IgniteKernal%client] IgniteConfiguration [igniteInstanceName=client, pubPoolSize=24, svcPoolSize=24, callbackPoolSize=24, stripedPoolSize=24, sysPoolSize=24, mgmtPoolSize=4, dataStreamerPoolSize=24, utilityCachePoolSize=24, utilityCacheKeepAliveTime=60000, p2pPoolSize=2, qryPoolSize=24, buildIdxPoolSize=4, igniteHome=/opt/buildagent/work/7bc1c54bc719b67c, igniteWorkDir=/opt/buildagent/work/7bc1c54bc719b67c/work, mbeanSrv=com.sun.jmx.mbeanserver.JmxMBeanServer@6fe85038, nodeId=3375120d-e768-45d0-9e9a-d20ff15f9344, marsh=BinaryMarshaller [], marshLocJobs=false, daemon=false, p2pEnabled=true, netTimeout=10000, netCompressionLevel=1, sndRetryDelay=1000, sndRetryCnt=3, metricsHistSize=10000, metricsUpdateFreq=1000, metricsExpTime=9223372036854775807, discoSpi=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=0, ackTimeout=0, marsh=null, reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], segPlc=STOP, segResolveAttempts=2, waitForSegOnStart=true, allResolversPassReq=true, segChkFreq=10000, commSpi=TcpCommunicationSpi [connectGate=org.apache.ignite.spi.communication.tcp.internal.ConnectGateway@30f0f8ff, ctxInitLatch=java.util.concurrent.CountDownLatch@2c4a0c2e[Count = 1], stopping=false, clientPool=null, nioSrvWrapper=null, stateProvider=null], evtSpi=MemoryEventStorageSpi [expireAgeMs=9223372036854775807, expireCnt=10000, filter=null], colSpi=NoopCollisionSpi [], deploySpi=LocalDeploymentSpi [], indexingSpi=org.apache.ignite.spi.indexing.noop.NoopIndexingSpi@19355230, addrRslvr=null, encryptionSpi=org.apache.ignite.spi.encryption.keystore.KeystoreEncryptionSpi@783e533a, tracingSpi=org.apache.ignite.spi.tracing.NoopTracingSpi@3b3c411c, clientMode=true, rebalanceThreadPoolSize=4, rebalanceTimeout=10000, rebalanceBatchesPrefetchCnt=3, rebalanceThrottle=0, rebalanceBatchSize=524288, txCfg=TransactionConfiguration [txSerEnabled=false, dfltIsolation=REPEATABLE_READ, dfltConcurrency=PESSIMISTIC, dfltTxTimeout=0, txTimeoutOnPartitionMapExchange=0, deadlockTimeout=10000, pessimisticTxLogSize=0, pessimisticTxLogLinger=10000, tmLookupClsName=null, txManagerFactory=null, useJtaSync=false], cacheSanityCheckEnabled=true, discoStartupDelay=60000, deployMode=SHARED, p2pMissedCacheSize=100, locHost=127.0.0.1, timeSrvPortBase=31100, timeSrvPortRange=100, failureDetectionTimeout=10000, sysWorkerBlockedTimeout=null, clientFailureDetectionTimeout=10000, metricsLogFreq=0, connectorCfg=null, odbcCfg=null, warmupClos=null, atomicCfg=AtomicConfiguration [seqReserveSize=1000, cacheMode=PARTITIONED, backups=1, aff=null, grpName=null], classLdr=null, sslCtxFactory=null, platformCfg=null, binaryCfg=null, memCfg=null, pstCfg=null, dsCfg=DataStorageConfiguration [sysRegionInitSize=41943040, sysRegionMaxSize=104857600, pageSize=4096, concLvl=0, dfltDataRegConf=DataRegionConfiguration [name=default, maxSize=10485760, initSize=268435456, swapPath=null, pageEvictionMode=DISABLED, pageReplacementMode=CLOCK, evictionThreshold=0.9, emptyPagesPoolSize=100, metricsEnabled=false, metricsSubIntervalCount=5, metricsRateTimeInterval=60000, persistenceEnabled=true, checkpointPageBufSize=0, lazyMemoryAllocation=true, warmUpCfg=null], dataRegions=null, storagePath=null, checkpointFreq=180000, lockWaitTime=10000, checkpointThreads=4, checkpointWriteOrder=SEQUENTIAL, walHistSize=20, maxWalArchiveSize=1073741824, walSegments=10, walSegmentSize=67108864, walPath=db/wal, walArchivePath=db/wal/archive, cdcWalPath=db/wal/cdc, cdcEnabled=false, metricsEnabled=false, walMode=FSYNC, walTlbSize=131072, walBuffSize=0, walFlushFreq=2000, walFsyncDelay=1000, walRecordIterBuffSize=67108864, alwaysWriteFullPages=false, fileIOFactory=org.apache.ignite.internal.processors.cache.persistence.file.AsyncFileIOFactory@2f39be01, metricsSubIntervalCnt=5, metricsRateTimeInterval=60000, walAutoArchiveAfterInactivity=-1, walForceArchiveTimeout=-1, writeThrottlingEnabled=false, walCompactionEnabled=false, walCompactionLevel=1, checkpointReadLockTimeout=null, walPageCompression=DISABLED, walPageCompressionLevel=null, dfltWarmUpCfg=null, encCfg=org.apache.ignite.configuration.EncryptionConfiguration@13d63c81, defragmentationThreadPoolSize=4, minWalArchiveSize=-1], snapshotPath=snapshots, activeOnStart=true, activeOnStartPropSetFlag=false, autoActivation=true, autoActivationPropSetFlag=false, clusterStateOnStart=null, sqlConnCfg=null, cliConnCfg=ClientConnectorConfiguration [host=null, port=10800, portRange=100, sockSndBufSize=0, sockRcvBufSize=0, tcpNoDelay=true, maxOpenCursorsPerConn=128, threadPoolSize=24, selectorCnt=12, idleTimeout=0, handshakeTimeout=10000, jdbcEnabled=true, odbcEnabled=true, thinCliEnabled=true, sslEnabled=false, useIgniteSslCtxFactory=true, sslClientAuth=false, sslCtxFactory=null, thinCliCfg=ThinClientConfiguration [maxActiveTxPerConn=100, maxActiveComputeTasksPerConn=0]], mvccVacuumThreadCnt=2, mvccVacuumFreq=5000, authEnabled=false, failureHnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]], commFailureRslvr=null, sqlCfg=SqlConfiguration [longQryWarnTimeout=3000, dfltQryTimeout=0, sqlQryHistSize=1000, validationEnabled=false], asyncContinuationExecutor=null] [21:08:40] : [Step 4/5] [2021-11-19 21:08:40,266][INFO ][test-runner-#16603%encryption.MasterKeyChangeTest%][IgniteKernal%client] Daemon mode: off [21:08:40] : [Step 4/5] [2021-11-19 21:08:40,266][INFO ][test-runner-#16603%encryption.MasterKeyChangeTest%][IgniteKernal%client] OS: Linux 4.15.0-151-generic amd64 [21:08:40] : [Step 4/5] [2021-11-19 21:08:40,266][INFO ][test-runner-#16603%encryption.MasterKeyChangeTest%][IgniteKernal%client] OS user: teamcity [21:08:40] : [Step 4/5] [2021-11-19 21:08:40,267][INFO ][test-runner-#16603%encryption.MasterKeyChangeTest%][IgniteKernal%client] PID: 16724 [21:08:40] : [Step 4/5] [2021-11-19 21:08:40,267][INFO ][test-runner-#16603%encryption.MasterKeyChangeTest%][IgniteKernal%client] Language runtime: Java Platform API Specification ver. 1.8 [21:08:40] : [Step 4/5] [2021-11-19 21:08:40,267][INFO ][test-runner-#16603%encryption.MasterKeyChangeTest%][IgniteKernal%client] VM information: Java(TM) SE Runtime Environment 1.8.0_261-b12 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 25.261-b12 [21:08:40] : [Step 4/5] [2021-11-19 21:08:40,268][INFO ][test-runner-#16603%encryption.MasterKeyChangeTest%][IgniteKernal%client] VM total memory: 1.9GB [21:08:40] : [Step 4/5] [2021-11-19 21:08:40,268][INFO ][test-runner-#16603%encryption.MasterKeyChangeTest%][IgniteKernal%client] Remote Management [restart: off, REST: off, JMX (remote: off)] [21:08:40] : [Step 4/5] [2021-11-19 21:08:40,268][INFO ][test-runner-#16603%encryption.MasterKeyChangeTest%][IgniteKernal%client] Logger: GridTestLog4jLogger [quiet=false, config=null] [21:08:40] : [Step 4/5] [2021-11-19 21:08:40,269][INFO ][test-runner-#16603%encryption.MasterKeyChangeTest%][IgniteKernal%client] IGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c [21:08:40] : [Step 4/5] [2021-11-19 21:08:40,269][INFO ][test-runner-#16603%encryption.MasterKeyChangeTest%][IgniteKernal%client] VM arguments: [-DIGNITE_DUMP_THREADS_ON_FAILURE=false, -DMono=/usr/bin/mono-sgen, -DMono4.0_x64=/usr/lib/mono/4.0, -DMono4.5_x64=/usr/lib/mono/4.5, -DMonoVersion=6.12.0.90, -DSKIP_BUILD=false, -Dagent.home.dir=/opt/buildagent, -Dagent.name=aitc-lin02_03, -Dagent.ownPort=9090, -Dagent.work.dir=/opt/buildagent/work, -Dbuild.number=95, -Dbuild.vcs.number=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.1=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.GitHubApacheIgnite=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dclassworlds.conf=/opt/buildagent/temp/buildTmp/teamcity.m2.conf, -Dcom.jetbrains.maven.watcher.report.file=/opt/buildagent/temp/buildTmp/maven-build-info.xml, -Djava.io.tmpdir=/opt/buildagent/temp/buildTmp, -Dmaven.home=/opt/buildagent/tools/maven3_6, -Dmaven.multiModuleProjectDirectory=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.agent.cpuBenchmark=457, -Dteamcity.agent.dotnet.agent_url=http://localhost:9090/RPC2, -Dteamcity.agent.dotnet.build_id=6278078, -Dteamcity.auth.password=*******, -Dteamcity.auth.userId=TeamCityBuildId=6278078, -Dteamcity.build.changedFiles.file=/opt/buildagent/temp/buildTmp/changedFiles6342607772318147725.txt, -Dteamcity.build.checkoutDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.build.id=6278078, -Dteamcity.build.properties.file=/opt/buildagent/temp/buildTmp/teamcity.build5164517880467851002.properties, -Dteamcity.build.tempDir=/opt/buildagent/temp/buildTmp, -Dteamcity.build.workingDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.buildConfName=Basic 3, -Dteamcity.buildType.id=IgniteTests24Java8_Basic3, -Dteamcity.configuration.properties.file=/opt/buildagent/temp/buildTmp/teamcity.config5591980786735343870.properties, -Dteamcity.maven.userSettings.path=/opt/buildagent/temp/buildTmp/maven_settings_585072866407032347.xml, -Dteamcity.maven.watcher.home=/opt/buildagent/plugins/mavenPlugin/maven-watcher-jdk16, -Dteamcity.projectName=Ignite Tests 2.x (JDK 8/11), -Dteamcity.runner.properties.file=/opt/buildagent/temp/buildTmp/teamcity.runner9098465561618137420.properties, -Dteamcity.tests.recentlyFailedTests.file=/opt/buildagent/temp/buildTmp/testsToRunFirst3891775683130404069.txt, -Dteamcity.version=2021.2 (build 99542), -ea, -Xms2g, -Xmx2g, -XX:+HeapDumpOnOutOfMemoryError, -DIGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_TEST_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_UPDATE_NOTIFIER=false, -DIGNITE_NO_DISCO_ORDER=true, -DIGNITE_PERFORMANCE_SUGGESTIONS_DISABLED=true, -Djava.net.preferIPv4Stack=true, -DTEST_SCALE_FACTOR=1.0, -DIGNITE_TEST_PROP_LOG4J_FILE=log4j-tc-test.xml, -DIGNITE_QUIET=false, -DIGNITE_MARSHAL_BUFFERS_RECHECK=1000, -Dmaven.repo.local=/opt/buildagent/.m2/repository] [21:08:40] : [Step 4/5] [2021-11-19 21:08:40,273][INFO ][test-runner-#16603%encryption.MasterKeyChangeTest%][IgniteKernal%client] System cache's DataRegion size is configured to 40 MB. Use DataStorageConfiguration.systemRegionInitialSize property to change the setting. [21:08:40] : [Step 4/5] [2021-11-19 21:08:40,273][INFO ][test-runner-#16603%encryption.MasterKeyChangeTest%][IgniteKernal%client] Configured caches [in 'sysMemPlc' dataRegion: ['ignite-sys-cache']] [21:08:40]W: [org.apache.ignite:ignite-core] [2021-11-19 21:08:40,274][WARN ][test-runner-#16603%encryption.MasterKeyChangeTest%][IgniteKernal%client] Peer class loading is enabled (disable it in production for performance and deployment consistency reasons) [21:08:40] : [Step 4/5] [2021-11-19 21:08:40,274][INFO ][test-runner-#16603%encryption.MasterKeyChangeTest%][IgniteKernal%client] 3-rd party licenses can be found at: /opt/buildagent/work/7bc1c54bc719b67c/libs/licenses [21:08:40] : [Step 4/5] [2021-11-19 21:08:40,278][INFO ][test-runner-#16603%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] Configured plugins: [21:08:40] : [Step 4/5] [2021-11-19 21:08:40,279][INFO ][test-runner-#16603%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] ^-- StanByClusterTestProvider 1.0 [21:08:40] : [Step 4/5] [2021-11-19 21:08:40,279][INFO ][test-runner-#16603%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:08:40] : [Step 4/5] [2021-11-19 21:08:40,279][INFO ][test-runner-#16603%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] [21:08:40] : [Step 4/5] [2021-11-19 21:08:40,279][INFO ][test-runner-#16603%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] ^-- PageMemory tracker plugin 1.0 [21:08:40] : [Step 4/5] [2021-11-19 21:08:40,279][INFO ][test-runner-#16603%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:08:40] : [Step 4/5] [2021-11-19 21:08:40,280][INFO ][test-runner-#16603%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] [21:08:40] : [Step 4/5] [2021-11-19 21:08:40,280][INFO ][test-runner-#16603%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] ^-- TestDistibutedConfigurationPlugin 1.0 [21:08:40] : [Step 4/5] [2021-11-19 21:08:40,280][INFO ][test-runner-#16603%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:08:40] : [Step 4/5] [2021-11-19 21:08:40,280][INFO ][test-runner-#16603%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] [21:08:40] : [Step 4/5] [2021-11-19 21:08:40,280][INFO ][test-runner-#16603%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] ^-- NodeValidationPluginProvider 1.0 [21:08:40] : [Step 4/5] [2021-11-19 21:08:40,281][INFO ][test-runner-#16603%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:08:40] : [Step 4/5] [2021-11-19 21:08:40,281][INFO ][test-runner-#16603%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] [21:08:40] : [Step 4/5] [2021-11-19 21:08:40,281][INFO ][test-runner-#16603%encryption.MasterKeyChangeTest%][FailureProcessor] Configured failure handler: [hnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]]] [21:08:40] : [Step 4/5] [2021-11-19 21:08:40,297][INFO ][test-runner-#16603%encryption.MasterKeyChangeTest%][TestRecordingCommunicationSpi] Successfully bound communication NIO server to TCP port [port=47101, locHost=/127.0.0.1, selectorsCnt=12, selectorSpins=0, pairedConn=false] [21:08:40]W: [org.apache.ignite:ignite-core] [2021-11-19 21:08:40,297][WARN ][test-runner-#16603%encryption.MasterKeyChangeTest%][TestRecordingCommunicationSpi] Message queue limit is set to 0 which may lead to potential OOMEs when running cache operations in FULL_ASYNC or PRIMARY_SYNC modes due to message queues growth on sender and receiver sides. [21:08:40] : [Step 4/5] [2021-11-19 21:08:40,302][INFO ][test-runner-#16603%encryption.MasterKeyChangeTest%][GridCollisionManager] Collision resolution is disabled (all jobs will be activated upon arrival). [21:08:40] : [Step 4/5] [2021-11-19 21:08:40,302][INFO ][test-runner-#16603%encryption.MasterKeyChangeTest%][IgniteKernal%client] Security status [authentication=off, sandbox=off, tls/ssl=off] [21:08:40] : [Step 4/5] [2021-11-19 21:08:40,361][INFO ][test-runner-#16603%encryption.MasterKeyChangeTest%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:08:40]W: [org.apache.ignite:ignite-core] [2021-11-19 21:08:40,451][WARN ][test-runner-#16603%encryption.MasterKeyChangeTest%][GridCacheProcessor] Persistent Store is not supported on client nodes (Persistent Store's configuration will be ignored). [21:08:40] : [Step 4/5] [2021-11-19 21:08:40,454][INFO ][test-runner-#16603%encryption.MasterKeyChangeTest%][IgniteCacheDatabaseSharedManager] Configured data regions initialized successfully [total=4] [21:08:40] : [Step 4/5] [2021-11-19 21:08:40,457][INFO ][test-runner-#16603%encryption.MasterKeyChangeTest%][ClientListenerProcessor] Client connector processor has started on TCP port 10801 [21:08:40] : [Step 4/5] [2021-11-19 21:08:40,459][INFO ][test-runner-#16603%encryption.MasterKeyChangeTest%][IgniteKernal%client] Non-loopback local IPs: 172.17.0.4 [21:08:40] : [Step 4/5] [2021-11-19 21:08:40,460][INFO ][test-runner-#16603%encryption.MasterKeyChangeTest%][IgniteKernal%client] Enabled local MACs: 0242AC110004 [21:08:40] : [Step 4/5] [2021-11-19 21:08:40,461][INFO ][test-runner-#16603%encryption.MasterKeyChangeTest%][ClusterProcessor] Cluster ID and tag has been read from metastorage: null [21:08:40] : [Step 4/5] [2021-11-19 21:08:40,461][INFO ][test-runner-#16603%encryption.MasterKeyChangeTest%][IgniteClusterImpl] Shutdown policy was updated [oldVal=null, newVal=null] [21:08:40] : [Step 4/5] [2021-11-19 21:08:40,464][INFO ][tcp-disco-srvr-[:47500]-#874%grid-0%-#16716%grid-0%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=41421] [21:08:40] : [Step 4/5] [2021-11-19 21:08:40,465][INFO ][tcp-disco-srvr-[:47500]-#874%grid-0%-#16716%grid-0%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=41421] [21:08:40] : [Step 4/5] [2021-11-19 21:08:40,465][INFO ][tcp-disco-sock-reader-[]-#881%grid-0%-#16810%grid-0%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:41421, rmtPort=41421] [21:08:40] : [Step 4/5] [2021-11-19 21:08:40,467][INFO ][tcp-disco-sock-reader-[3375120d 127.0.0.1:41421 client]-#881%grid-0%-#16810%grid-0%][TestTcpDiscoverySpi] Initialized connection with remote client node [nodeId=3375120d-e768-45d0-9e9a-d20ff15f9344, rmtAddr=/127.0.0.1:41421] [21:08:40] : [Step 4/5] [2021-11-19 21:08:40,492][INFO ][disco-event-worker-#16718%grid-0%][GridDiscoveryManager] Added new node to topology: TcpDiscoveryNode [id=3375120d-e768-45d0-9e9a-d20ff15f9344, consistentId=client, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:0], discPort=0, order=2, intOrder=2, lastExchangeTime=1637345320472, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=true] [21:08:40] : [Step 4/5] [2021-11-19 21:08:40,493][INFO ][disco-event-worker-#16718%grid-0%][GridDiscoveryManager] Topology snapshot [ver=2, locNode=00a02231, servers=1, clients=1, state=INACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=00a02231-1868-4c3c-bdce-ddb61ce23000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=3375120d-e768-45d0-9e9a-d20ff15f9344, consistentId=client, isClient=true, ver=2.13.0#20211119-sha1:00000000]]] [21:08:40] : [Step 4/5] [2021-11-19 21:08:40,499][INFO ][tcp-client-disco-msg-worker-#880%client%-#16808%client%][TestTcpDiscoverySpi] Router node: TcpDiscoveryNode [id=00a02231-1868-4c3c-bdce-ddb61ce23000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345320492, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false] [21:08:40] : [Step 4/5] [2021-11-19 21:08:40,503][INFO ][tcp-client-disco-msg-worker-#880%client%-#16808%client%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustEnabled' was changed from 'null' to 'false' [21:08:40] : [Step 4/5] [2021-11-19 21:08:40,503][INFO ][tcp-client-disco-msg-worker-#880%client%-#16808%client%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustTimeout' was changed from 'null' to '300000' [21:08:40] : [Step 4/5] [2021-11-19 21:08:40,503][INFO ][tcp-client-disco-msg-worker-#880%client%-#16808%client%][IgniteTxManager] Transactions parameter 'collisionsDumpInterval' was changed from 'null' to '1000' [21:08:40] : [Step 4/5] [2021-11-19 21:08:40,504][INFO ][tcp-client-disco-msg-worker-#880%client%-#16808%client%][IgniteTxManager] Transactions parameter 'longOperationsDumpTimeout' was changed from 'null' to '60000' [21:08:40] : [Step 4/5] [2021-11-19 21:08:40,504][INFO ][tcp-client-disco-msg-worker-#880%client%-#16808%client%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpSamplesPerSecondLimit' was changed from 'null' to '5' [21:08:40] : [Step 4/5] [2021-11-19 21:08:40,505][INFO ][tcp-client-disco-msg-worker-#880%client%-#16808%client%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpThreshold' was changed from 'null' to '0' [21:08:40] : [Step 4/5] [2021-11-19 21:08:40,505][INFO ][tcp-client-disco-msg-worker-#880%client%-#16808%client%][IgniteTxManager] Transactions parameter 'transactionTimeDumpSamplesCoefficient' was changed from 'null' to '0.0' [21:08:40] : [Step 4/5] [2021-11-19 21:08:40,506][INFO ][tcp-client-disco-msg-worker-#880%client%-#16808%client%][IgniteTxManager] Transactions parameter 'txOwnerDumpRequestsAllowed' was changed from 'null' to 'true' [21:08:40] : [Step 4/5] [2021-11-19 21:08:40,506][INFO ][tcp-client-disco-msg-worker-#880%client%-#16808%client%][ClusterProcessor] magical_tu [21:08:40] : [Step 4/5] [2021-11-19 21:08:40,507][INFO ][disco-notifier-worker-#16805%client%][MvccProcessorImpl] Assigned mvcc coordinator [crd=MvccCoordinator [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=0], nodeId=00a02231-1868-4c3c-bdce-ddb61ce23000, ver=1637345320220, local=false, initialized=false]] [21:08:40] : [Step 4/5] [2021-11-19 21:08:40,509][INFO ][sys-#16812%client%][ClusterProcessor] Writing cluster ID and tag to metastorage on ready for write ClusterIdAndTag [id=c7543684-4cf7-4bdc-acb3-085b0bf86634, tag=magical_tu] [21:08:40] : [Step 4/5] [2021-11-19 21:08:40,521][INFO ][test-runner-#16603%encryption.MasterKeyChangeTest%][IgniteKernal%client] To start Console Management & Monitoring run ignitevisorcmd.{sh|bat} [21:08:40] : [Step 4/5] [2021-11-19 21:08:40,522][INFO ][test-runner-#16603%encryption.MasterKeyChangeTest%][IgniteKernal%client] [21:08:40] : [Step 4/5] [21:08:40] : [Step 4/5] >>> +-------------------------------------------+ [21:08:40] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:08:40] : [Step 4/5] >>> +-------------------------------------------+ [21:08:40] : [Step 4/5] >>> OS name: Linux 4.15.0-151-generic amd64 [21:08:40] : [Step 4/5] >>> CPU(s): 24 [21:08:40] : [Step 4/5] >>> Heap: 2.0GB [21:08:40] : [Step 4/5] >>> VM name: 16724@c4dfe9a430b2 [21:08:40] : [Step 4/5] >>> Ignite instance name: client [21:08:40] : [Step 4/5] >>> Local node [ID=3375120D-E768-45D0-9E9A-D20FF15F9344, order=2, clientMode=true] [21:08:40] : [Step 4/5] >>> Local node addresses: [127.0.0.1] [21:08:40] : [Step 4/5] >>> Local ports: TCP:10801 TCP:47101 [21:08:40] : [Step 4/5] [21:08:40] : [Step 4/5] [2021-11-19 21:08:40,523][INFO ][test-runner-#16603%encryption.MasterKeyChangeTest%][IgniteKernal%client] >>> Ignite cluster is in INACTIVE state (limited functionality available). Use control.(sh|bat) script or IgniteCluster.state(ClusterState.ACTIVE) to change the state. [21:08:40] : [Step 4/5] [2021-11-19 21:08:40,523][INFO ][test-runner-#16603%encryption.MasterKeyChangeTest%][GridDiscoveryManager] Topology snapshot [ver=2, locNode=3375120d, servers=1, clients=1, state=INACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=3375120d-e768-45d0-9e9a-d20ff15f9344, consistentId=client, isClient=true, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=00a02231-1868-4c3c-bdce-ddb61ce23000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:08:40] : [Step 4/5] [2021-11-19 21:08:40,524][INFO ][test-runner-#16603%encryption.MasterKeyChangeTest%][G] Node started : [stage="Configure system pool" (0 ms),stage="Start managers" (194 ms),stage="Configure binary metadata" (1 ms),stage="Start processors" (8 ms),stage="Start 'StanByClusterTestProvider' plugin" (0 ms),stage="Start 'PageMemory tracker plugin' plugin" (0 ms),stage="Start 'TestDistibutedConfigurationPlugin' plugin" (0 ms),stage="Start 'NodeValidationPluginProvider' plugin" (0 ms),stage="Init metastore" (2 ms),stage="Finish recovery" (0 ms),stage="Join topology" (48 ms),stage="Await transition" (1 ms),stage="Await exchange" (12 ms),stage="Total time" (266 ms)] [21:08:40] : [Step 4/5] [2021-11-19 21:08:40,525][INFO ][test-runner-#16603%encryption.MasterKeyChangeTest%][root] Node started with the following configuration [id=3375120d-e768-45d0-9e9a-d20ff15f9344, marshaller=BinaryMarshaller [], discovery=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=5000, ackTimeout=5000, marsh=JdkMarshaller [clsFilter=org.apache.ignite.marshaller.MarshallerUtils$1@28e04ab5], reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], binaryCfg=null, lateAff=true] [21:08:40] : [Step 4/5] [2021-11-19 21:08:40,526][INFO ][test-runner-#16603%encryption.MasterKeyChangeTest%][GridClusterStateProcessor] Sending activate cluster request with BaselineTopology BaselineTopology [id=0, branchingHash=-1237657751, branchingType='New BaselineTopology', baselineNodes=[grid-0]] [21:08:40] : [Step 4/5] [2021-11-19 21:08:40,529][INFO ][disco-notifier-worker-#16714%grid-0%][GridClusterStateProcessor] Received activate cluster request with BaselineTopology[id=0] initiator node ID: 00a02231-1868-4c3c-bdce-ddb61ce23000 [21:08:40] : [Step 4/5] [2021-11-19 21:08:40,529][INFO ][disco-notifier-worker-#16714%grid-0%][GridClusterStateProcessor] Started state transition: activate cluster [21:08:40] : [Step 4/5] [2021-11-19 21:08:40,530][INFO ][exchange-worker-#16719%grid-0%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], crd=true, evt=DISCOVERY_CUSTOM_EVT, evtNode=00a02231-1868-4c3c-bdce-ddb61ce23000, customEvt=ChangeGlobalStateMessage [id=2136d593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqId=587871b3-7a1c-4f00-b029-d51beb847f15, initiatingNodeId=00a02231-1868-4c3c-bdce-ddb61ce23000, state=ACTIVE, baselineTopology=BaselineTopology [id=0, branchingHash=-1237657751, branchingType='New BaselineTopology', baselineNodes=[grid-0]], forceChangeBaselineTopology=false, timestamp=1637345320526, forceDeactivation=true], allowMerge=false, exchangeFreeSwitch=false] [21:08:40] : [Step 4/5] [2021-11-19 21:08:40,530][INFO ][disco-notifier-worker-#16805%client%][GridClusterStateProcessor] Received activate cluster request with BaselineTopology[id=0] initiator node ID: 00a02231-1868-4c3c-bdce-ddb61ce23000 [21:08:40] : [Step 4/5] [2021-11-19 21:08:40,531][INFO ][exchange-worker-#16719%grid-0%][GridDhtPartitionsExchangeFuture] Start activation process [nodeId=00a02231-1868-4c3c-bdce-ddb61ce23000, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]]. New state: ACTIVE [21:08:40] : [Step 4/5] [2021-11-19 21:08:40,532][INFO ][disco-notifier-worker-#16805%client%][GridClusterStateProcessor] Started state transition: activate cluster [21:08:40] : [Step 4/5] [2021-11-19 21:08:40,532][INFO ][exchange-worker-#16719%grid-0%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0 [21:08:40] : [Step 4/5] [2021-11-19 21:08:40,535][INFO ][exchange-worker-#16814%client%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], crd=false, evt=DISCOVERY_CUSTOM_EVT, evtNode=00a02231-1868-4c3c-bdce-ddb61ce23000, customEvt=ChangeGlobalStateMessage [id=2136d593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqId=587871b3-7a1c-4f00-b029-d51beb847f15, initiatingNodeId=00a02231-1868-4c3c-bdce-ddb61ce23000, state=ACTIVE, baselineTopology=BaselineTopology [id=0, branchingHash=-1237657751, branchingType='New BaselineTopology', baselineNodes=[grid-0]], forceChangeBaselineTopology=false, timestamp=1637345320526, forceDeactivation=true], allowMerge=false, exchangeFreeSwitch=false] [21:08:40] : [Step 4/5] [2021-11-19 21:08:40,536][INFO ][exchange-worker-#16719%grid-0%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000000.wal, offset=8713, ver=2] [21:08:40] : [Step 4/5] [2021-11-19 21:08:40,536][INFO ][exchange-worker-#16814%client%][GridDhtPartitionsExchangeFuture] Start activation process [nodeId=3375120d-e768-45d0-9e9a-d20ff15f9344, client=true, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]]. New state: ACTIVE [21:08:40] : [Step 4/5] [2021-11-19 21:08:40,537][INFO ][exchange-worker-#16719%grid-0%][GridClusterStateProcessor] Writing BaselineTopology[id=0] [21:08:40] : [Step 4/5] [2021-11-19 21:08:40,539][INFO ][exchange-worker-#16814%client%][IgniteCacheDatabaseSharedManager] Data Regions Started: 4 [21:08:40] : [Step 4/5] [2021-11-19 21:08:40,539][INFO ][exchange-worker-#16814%client%][IgniteCacheDatabaseSharedManager] ^-- sysMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:08:40] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB, allocTotal=0MB] [21:08:40] : [Step 4/5] ^-- default region [type=default, persistence=true, lazyAlloc=true, [21:08:40] : [Step 4/5] ... initCfg=10MB, maxCfg=10MB, usedRam=0MB, freeRam=100%, allocRam=0MB, allocTotal=0MB] [21:08:40] : [Step 4/5] ^-- TxLog region [type=internal, persistence=true, lazyAlloc=false, [21:08:40] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB, allocTotal=0MB] [21:08:40] : [Step 4/5] ^-- volatileDsMemPlc region [type=user, persistence=false, lazyAlloc=true, [21:08:40] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB] [21:08:40] : [Step 4/5] ^-- Ignite persistence [used=0MB] [21:08:40] : [Step 4/5] [21:08:40] : [Step 4/5] [2021-11-19 21:08:40,540][INFO ][exchange-worker-#16719%grid-0%][GridCacheDatabaseSharedManager] Finish recovery performed in 5 ms. [21:08:40] : [Step 4/5] [2021-11-19 21:08:40,540][INFO ][exchange-worker-#16814%client%][msg] Components activation performed in 3 ms. [21:08:40] : [Step 4/5] [2021-11-19 21:08:40,541][INFO ][exchange-worker-#16719%grid-0%][msg] Components activation performed in 9 ms. [21:08:40] : [Step 4/5] [2021-11-19 21:08:40,542][INFO ][exchange-worker-#16719%grid-0%][GridCacheProcessor] Finished recovery for cache [cache=ignite-sys-cache, grp=ignite-sys-cache, startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:08:40] : [Step 4/5] [2021-11-19 21:08:40,543][INFO ][exchange-worker-#16814%client%][GridCacheProcessor] Started cache [name=ignite-sys-cache, id=-2100569601, dataRegionName=sysMemPlc, mode=REPLICATED, atomicity=TRANSACTIONAL, backups=2147483647, mvcc=false] [21:08:40] : [Step 4/5] [2021-11-19 21:08:40,543][INFO ][exchange-worker-#16719%grid-0%][GridDhtPartitionsExchangeFuture] Successfully activated caches [nodeId=00a02231-1868-4c3c-bdce-ddb61ce23000, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], newState=ACTIVE] [21:08:40] : [Step 4/5] [2021-11-19 21:08:40,543][INFO ][exchange-worker-#16814%client%][GridDhtPartitionsExchangeFuture] Successfully activated caches [nodeId=3375120d-e768-45d0-9e9a-d20ff15f9344, client=true, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], newState=ACTIVE] [21:08:40] : [Step 4/5] [2021-11-19 21:08:40,544][INFO ][exchange-worker-#16719%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:08:40] : [Step 4/5] [2021-11-19 21:08:40,545][INFO ][grid-nio-worker-tcp-comm-0-#16658%TestRecordingCommunicationSpi%][TestRecordingCommunicationSpi] Accepted incoming communication connection [locAddr=/127.0.0.1:47100, rmtAddr=/127.0.0.1:56782] [21:08:40] : [Step 4/5] [2021-11-19 21:08:40,547][INFO ][grid-nio-worker-tcp-comm-0-#16776%TestRecordingCommunicationSpi%][TestRecordingCommunicationSpi] Established outgoing communication connection [locAddr=/127.0.0.1:56782, rmtAddr=/127.0.0.1:47100] [21:08:40] : [Step 4/5] [2021-11-19 21:08:40,547][INFO ][exchange-worker-#16814%client%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], crd=false] [21:08:40] : [Step 4/5] [2021-11-19 21:08:40,565][INFO ][exchange-worker-#16719%grid-0%][GridDhtPartitionsExchangeFuture] finishExchangeOnCoordinator [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:08:40] : [Step 4/5] [2021-11-19 21:08:40,567][INFO ][db-checkpoint-thread-#16823%grid-0%][Checkpointer] Checkpoint started [checkpointId=92387737-7f42-4272-8a20-bc8919371870, startPtr=WALPointer [idx=0, fileOff=66315, len=1963], checkpointBeforeLockTime=8ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=1ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=1ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=0ms, pages=16, reason='node started'] [21:08:40] : [Step 4/5] [2021-11-19 21:08:40,571][INFO ][exchange-worker-#16719%grid-0%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], err=null, rebalanced=true, wasRebalanced=false] [21:08:40] : [Step 4/5] [2021-11-19 21:08:40,573][INFO ][disco-notifier-worker-#16714%grid-0%][GridClusterStateProcessor] Received state change finish message: ACTIVE [21:08:40] : [Step 4/5] [2021-11-19 21:08:40,573][INFO ][disco-notifier-worker-#16714%grid-0%][GridClusterStateProcessor] Cluster state was changed from INACTIVE to ACTIVE [21:08:40] : [Step 4/5] [2021-11-19 21:08:40,574][INFO ][disco-notifier-worker-#16805%client%][GridClusterStateProcessor] Received state change finish message: ACTIVE [21:08:40] : [Step 4/5] [2021-11-19 21:08:40,574][INFO ][disco-notifier-worker-#16805%client%][GridClusterStateProcessor] Cluster state was changed from INACTIVE to ACTIVE [21:08:40] : [Step 4/5] [2021-11-19 21:08:40,574][INFO ][exchange-worker-#16719%grid-0%][GridCacheProcessor] Finish proxy initialization, cacheName=ignite-sys-cache, localNodeId=00a02231-1868-4c3c-bdce-ddb61ce23000 [21:08:40] : [Step 4/5] [2021-11-19 21:08:40,575][INFO ][sys-#16712%grid-0%][DistributedBaselineConfiguration] Baseline auto-adjust is 'disabled' with timeout='300000' ms [21:08:40] : [Step 4/5] [2021-11-19 21:08:40,575][INFO ][sys-#16712%grid-0%][GridClusterStateProcessor] Successfully performed final activation steps [nodeId=00a02231-1868-4c3c-bdce-ddb61ce23000, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:08:40] : [Step 4/5] [2021-11-19 21:08:40,575][INFO ][exchange-worker-#16719%grid-0%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=00a02231-1868-4c3c-bdce-ddb61ce23000, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=00a02231-1868-4c3c-bdce-ddb61ce23000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345320482, loc=true, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:08:40] : [Step 4/5] [2021-11-19 21:08:40,576][INFO ][exchange-worker-#16719%grid-0%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (1 ms), stage="Update caches registry" (10 ms), stage="Start caches" (0 ms), stage="Affinity initialization on cache group start" (0 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (1 ms), stage="Restore partition states" (0 ms), stage="After states restored callback" (20 ms), stage="WAL history reservation" (0 ms), stage="Waiting for all single messages" (0 ms), stage="Affinity recalculation (crd)" (0 ms), stage="Collect update counters and create affinity messages" (0 ms), stage="Assign partitions states" (0 ms), stage="Validate partitions states" (0 ms), stage="Ideal affinity diff calculation (enforced)" (0 ms), stage="Apply update counters" (0 ms), stage="Full message preparing" (4 ms), stage="Full message sending" (0 ms), stage="State finish message sending" (0 ms), stage="Detect lost partitions" (2 ms), stage="Exchange done" (2 ms), stage="Total time" (40 ms)] [21:08:40] : [Step 4/5] [2021-11-19 21:08:40,578][INFO ][exchange-worker-#16719%grid-0%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], stage="Affinity initialization on cache group start [grp=ignite-sys-cache]" (0 ms) (parent=Affinity initialization on cache group start), stage="Affinity centralized initialization (crd) [grp=ignite-sys-cache, crd=true]" (0 ms) (parent=Determine exchange type), stage="Restore partition states [grp=ignite-sys-cache]" (0 ms) (parent=Restore partition states), stage="Affinity recalculation (partitions availability) [grp=ignite-sys-cache]" (0 ms) (parent=Ideal affinity diff calculation (enforced))] [21:08:40] : [Step 4/5] [2021-11-19 21:08:40,579][INFO ][exchange-worker-#16719%grid-0%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], crd=true] [21:08:40] : [Step 4/5] [2021-11-19 21:08:40,580][INFO ][exchange-worker-#16719%grid-0%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=2, minorTopVer=1], force=false, evt=DISCOVERY_CUSTOM_EVT, node=00a02231-1868-4c3c-bdce-ddb61ce23000] [21:08:40] : [Step 4/5] [2021-11-19 21:08:40,581][INFO ][sys-#16830%client%][GridCachePartitionExchangeManager] Delay process full message without exchange id (there is exchange in progress) [nodeId=00a02231-1868-4c3c-bdce-ddb61ce23000] [21:08:40] : [Step 4/5] [2021-11-19 21:08:40,588][INFO ][sys-#16832%client%][GridDhtPartitionsExchangeFuture] Received full message, will finish exchange [node=00a02231-1868-4c3c-bdce-ddb61ce23000, resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:08:40] : [Step 4/5] [2021-11-19 21:08:40,589][INFO ][sys-#16832%client%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], err=null, rebalanced=true, wasRebalanced=false] [21:08:40] : [Step 4/5] [2021-11-19 21:08:40,591][INFO ][sys-#16832%client%][GridCacheProcessor] Finish proxy initialization, cacheName=ignite-sys-cache, localNodeId=3375120d-e768-45d0-9e9a-d20ff15f9344 [21:08:40] : [Step 4/5] [2021-11-19 21:08:40,593][INFO ][sys-#16842%client%][DistributedBaselineConfiguration] Baseline auto-adjust is 'disabled' with timeout='300000' ms [21:08:40] : [Step 4/5] [2021-11-19 21:08:40,593][INFO ][sys-#16842%client%][GridClusterStateProcessor] Successfully performed final activation steps [nodeId=3375120d-e768-45d0-9e9a-d20ff15f9344, client=true, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:08:40] : [Step 4/5] [2021-11-19 21:08:40,594][INFO ][exchange-worker-#16814%client%][GridCachePartitionExchangeManager] AffinityTopologyVersion [topVer=2, minorTopVer=1], evt=DISCOVERY_CUSTOM_EVT, evtNode=00a02231-1868-4c3c-bdce-ddb61ce23000, client=true] [21:08:40] : [Step 4/5] [2021-11-19 21:08:40,594][INFO ][test-runner-#16603%encryption.MasterKeyChangeTest%][root] awaitPartitionMapExchange finished [21:08:40] : [Step 4/5] [2021-11-19 21:08:40,596][INFO ][sys-#16832%client%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=3375120d-e768-45d0-9e9a-d20ff15f9344, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=00a02231-1868-4c3c-bdce-ddb61ce23000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345320492, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:08:40] : [Step 4/5] [2021-11-19 21:08:40,598][INFO ][sys-#16832%client%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (3 ms), stage="Update caches registry" (5 ms), stage="Start caches" (1 ms), stage="Affinity initialization on cache group start" (0 ms), stage="Determine exchange type" (0 ms), stage="Waiting for Full message" (43 ms), stage="Affinity recalculation" (0 ms), stage="Full map updating" (0 ms), stage="Detect lost partitions" (1 ms), stage="Exchange done" (6 ms), stage="Total time" (59 ms)] [21:08:40] : [Step 4/5] [2021-11-19 21:08:40,599][INFO ][sys-#16832%client%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], stage="Affinity initialization on cache group start [grp=ignite-sys-cache]" (0 ms) (parent=Affinity initialization on cache group start), stage="Affinity centralized initialization (crd) [grp=ignite-sys-cache, crd=false]" (0 ms) (parent=Determine exchange type), stage="Affinity applying from full message [grp=ignite-sys-cache]" (0 ms) (parent=Affinity recalculation)] [21:08:40] : [Step 4/5] [2021-11-19 21:08:40,601][INFO ][sys-#16697%grid-0%][IgniteTestResources] Block message [node=3375120d-e768-45d0-9e9a-d20ff15f9344, order=2, msg=GenerateEncryptionKeyResponse [id=5236d593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf]] [21:08:40] : [Step 4/5] [2021-11-19 21:08:40,604][INFO ][db-checkpoint-thread-#16823%grid-0%][Checkpointer] Checkpoint finished [cpId=92387737-7f42-4272-8a20-bc8919371870, pages=16, markPos=WALPointer [idx=0, fileOff=66315, len=1963], walSegmentsCovered=[], markDuration=6ms, pagesWrite=16ms, fsync=18ms, total=48ms] [21:08:40] : [Step 4/5] [2021-11-19 21:08:40,671][INFO ][test-runner-#16603%encryption.MasterKeyChangeTest%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:08:40] : [Step 4/5] [2021-11-19 21:08:40,783][INFO ][test-runner-#16603%encryption.MasterKeyChangeTest%][IgniteTestResources] Send blocked message [node=3375120d-e768-45d0-9e9a-d20ff15f9344, order=2, msg=GenerateEncryptionKeyResponse [id=5236d593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf]] [21:08:40]W: [org.apache.ignite:ignite-core] [2021-11-19 21:08:40,789][WARN ][disco-notifier-worker-#16805%client%][ClusterCachesInfo] Ignore cache start request during the master key change process. [21:08:40]W: [org.apache.ignite:ignite-core] class org.apache.ignite.IgniteCheckedException: Cache start failed. Master key change is in progress. [21:08:40]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.ClusterCachesInfo.processStartNewCacheRequest(ClusterCachesInfo.java:1028) [21:08:40]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.ClusterCachesInfo.processCacheChangeRequest0(ClusterCachesInfo.java:756) [21:08:40]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.ClusterCachesInfo.processCacheChangeRequests(ClusterCachesInfo.java:663) [21:08:40]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.ClusterCachesInfo.onCacheChangeRequested(ClusterCachesInfo.java:612) [21:08:40]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.GridCacheProcessor.onCustomEvent(GridCacheProcessor.java:4297) [21:08:40]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.managers.discovery.GridDiscoveryManager$4.onDiscovery0(GridDiscoveryManager.java:682) [21:08:40]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.managers.discovery.GridDiscoveryManager$4.access$7500(GridDiscoveryManager.java:561) [21:08:40]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.managers.discovery.GridDiscoveryManager$4$NotificationTask.run(GridDiscoveryManager.java:996) [21:08:40]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.managers.discovery.GridDiscoveryManager$DiscoveryMessageNotifierWorker.body0(GridDiscoveryManager.java:2871) [21:08:40]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.managers.discovery.GridDiscoveryManager$DiscoveryMessageNotifierWorker.body(GridDiscoveryManager.java:2909) [21:08:40]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:125) [21:08:40]W: [org.apache.ignite:ignite-core] at java.lang.Thread.run(Thread.java:748) [21:08:40] : [Step 4/5] [2021-11-19 21:08:40,932][INFO ][disco-notifier-worker-#16714%grid-0%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:08:41] : [Step 4/5] [2021-11-19 21:08:41,094][INFO ][disco-notifier-worker-#16714%grid-0%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:08:41]W: [org.apache.ignite:ignite-core] [2021-11-19 21:08:41,190][WARN ][disco-notifier-worker-#16714%grid-0%][ClusterCachesInfo] Ignore cache start request during the master key change process. [21:08:41]W: [org.apache.ignite:ignite-core] class org.apache.ignite.IgniteCheckedException: Cache start failed. Master key change is in progress. [21:08:41]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.ClusterCachesInfo.processStartNewCacheRequest(ClusterCachesInfo.java:1028) [21:08:41]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.ClusterCachesInfo.processCacheChangeRequest0(ClusterCachesInfo.java:756) [21:08:41]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.ClusterCachesInfo.processCacheChangeRequests(ClusterCachesInfo.java:663) [21:08:41]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.ClusterCachesInfo.onCacheChangeRequested(ClusterCachesInfo.java:612) [21:08:41]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.GridCacheProcessor.onCustomEvent(GridCacheProcessor.java:4297) [21:08:41]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.managers.discovery.GridDiscoveryManager$4.onDiscovery0(GridDiscoveryManager.java:682) [21:08:41]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.managers.discovery.GridDiscoveryManager$4.access$7500(GridDiscoveryManager.java:561) [21:08:41]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.managers.discovery.GridDiscoveryManager$4$NotificationTask.run(GridDiscoveryManager.java:996) [21:08:41]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.managers.discovery.GridDiscoveryManager$DiscoveryMessageNotifierWorker.body0(GridDiscoveryManager.java:2871) [21:08:41]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.managers.discovery.GridDiscoveryManager$DiscoveryMessageNotifierWorker.body(GridDiscoveryManager.java:2909) [21:08:41] : [Step 4/5] [2021-11-19 21:08:41,193][INFO ][disco-notifier-worker-#16714%grid-0%][GridEncryptionManager] Start master key change [masterKeyName=ignite.master.key2] [21:08:41]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:125) [21:08:41]W: [org.apache.ignite:ignite-core] at java.lang.Thread.run(Thread.java:748) [21:08:41] : [Step 4/5] [2021-11-19 21:08:41,250][INFO ][disco-notifier-worker-#16714%grid-0%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:08:41] : [Step 4/5] [2021-11-19 21:08:41,336][INFO ][disco-notifier-worker-#16714%grid-0%][GridEncryptionManager] Master key successfully changed [masterKeyName=ignite.master.key2] [21:08:41] : [Step 4/5] [2021-11-19 21:08:41,339][INFO ][exchange-worker-#16814%client%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], crd=false, evt=DISCOVERY_CUSTOM_EVT, evtNode=00a02231-1868-4c3c-bdce-ddb61ce23000, customEvt=DynamicCacheChangeBatch [id=f436d593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqs=ArrayList [DynamicCacheChangeRequest [cacheName=encrypted, hasCfg=true, nodeId=00a02231-1868-4c3c-bdce-ddb61ce23000, clientStartOnly=false, stop=false, destroy=false, disabledAfterStart=false]], exchangeActions=ExchangeActions [startCaches=[encrypted], stopCaches=null, startGrps=[encrypted], stopGrps=[], resetParts=null, stateChangeRequest=null], startCaches=false], allowMerge=false, exchangeFreeSwitch=false] [21:08:41] : [Step 4/5] [2021-11-19 21:08:41,340][INFO ][exchange-worker-#16719%grid-0%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], crd=true, evt=DISCOVERY_CUSTOM_EVT, evtNode=00a02231-1868-4c3c-bdce-ddb61ce23000, customEvt=DynamicCacheChangeBatch [id=f436d593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqs=ArrayList [DynamicCacheChangeRequest [cacheName=encrypted, hasCfg=true, nodeId=00a02231-1868-4c3c-bdce-ddb61ce23000, clientStartOnly=false, stop=false, destroy=false, disabledAfterStart=false]], exchangeActions=ExchangeActions [startCaches=[encrypted], stopCaches=null, startGrps=[encrypted], stopGrps=[], resetParts=null, stateChangeRequest=null], startCaches=false], allowMerge=false, exchangeFreeSwitch=false] [21:08:41] : [Step 4/5] [2021-11-19 21:08:41,343][INFO ][exchange-worker-#16814%client%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], crd=false] [21:08:41] : [Step 4/5] [2021-11-19 21:08:41,344][INFO ][exchange-worker-#16719%grid-0%][PageMemoryImpl] Started page memory [memoryAllocated=24.0 MiB, pages=5952, tableSize=474.2 KiB, replacementSize=768 B, checkpointBuffer=10.0 MiB] [21:08:41] : [Step 4/5] [2021-11-19 21:08:41,424][INFO ][exchange-worker-#16719%grid-0%][GridCacheProcessor] Started cache [name=encrypted, id=1613773252, dataRegionName=default, mode=PARTITIONED, atomicity=ATOMIC, backups=0, mvcc=false] [21:08:41]W: [org.apache.ignite:ignite-core] [2021-11-19 21:08:41,426][WARN ][exchange-worker-#16719%grid-0%][CacheAffinitySharedManager] Cache group 'encrypted' brings high overhead for its metainformation in data region 'default'. Metainformation required for its partitions (1024 partitions, 4096 bytes per partition, 4 MBs total) will consume more than 15% of data region memory (10 MBs). It may lead to critical errors on the node and cluster instability. Please reduce number of partitions, add more memory to the data region or add more server nodes for this cache group. [21:08:41] : [Step 4/5] [2021-11-19 21:08:41,428][INFO ][exchange-worker-#16719%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], waitTime=0ms, futInfo=NA, mode=DISTRIBUTED] [21:08:41] : [Step 4/5] [2021-11-19 21:08:41,428][INFO ][exchange-worker-#16719%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partitions release latch: ServerLatch [permits=0, pendingAcks=HashSet [], super=CompletableLatch [id=CompletableLatchUid [id=exchange, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2]]]] [21:08:41] : [Step 4/5] [2021-11-19 21:08:41,429][INFO ][exchange-worker-#16719%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:08:41] : [Step 4/5] [2021-11-19 21:08:41,498][INFO ][exchange-worker-#16719%grid-0%][GridDhtPartitionsExchangeFuture] finishExchangeOnCoordinator [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2]] [21:08:41] : [Step 4/5] [2021-11-19 21:08:41,503][INFO ][exchange-worker-#16719%grid-0%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], err=null, rebalanced=true, wasRebalanced=true] [21:08:41] : [Step 4/5] [2021-11-19 21:08:41,504][INFO ][exchange-worker-#16719%grid-0%][GridCacheProcessor] Finish proxy initialization, cacheName=encrypted, localNodeId=00a02231-1868-4c3c-bdce-ddb61ce23000 [21:08:41] : [Step 4/5] [2021-11-19 21:08:41,504][INFO ][exchange-worker-#16719%grid-0%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=00a02231-1868-4c3c-bdce-ddb61ce23000, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=00a02231-1868-4c3c-bdce-ddb61ce23000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345320482, loc=true, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2]] [21:08:41] : [Step 4/5] [2021-11-19 21:08:41,506][INFO ][exchange-worker-#16719%grid-0%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (3 ms), stage="Update caches registry" (0 ms), stage="Start caches" (81 ms), stage="Affinity initialization on cache group start" (2 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Wait partitions release latch [latch=exchange]" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Restore partition states" (15 ms), stage="After states restored callback" (52 ms), stage="WAL history reservation" (0 ms), stage="Waiting for all single messages" (0 ms), stage="Affinity recalculation (crd)" (0 ms), stage="Collect update counters and create affinity messages" (0 ms), stage="Assign partitions states" (1 ms), stage="Validate partitions states" (0 ms), stage="Apply update counters" (0 ms), stage="Full message preparing" (2 ms), stage="Full message sending" (0 ms), stage="Exchange done" (2 ms), stage="Total time" (158 ms)] [21:08:41] : [Step 4/5] [2021-11-19 21:08:41,506][INFO ][sys-#16848%client%][GridDhtPartitionsExchangeFuture] Received full message, will finish exchange [node=00a02231-1868-4c3c-bdce-ddb61ce23000, resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2]] [21:08:41] : [Step 4/5] [2021-11-19 21:08:41,508][INFO ][exchange-worker-#16719%grid-0%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], stage="Affinity initialization on cache group start [grp=encrypted]" (1 ms) (parent=Affinity initialization on cache group start), stage="Restore partition states [grp=encrypted]" (15 ms) (parent=Restore partition states), stage="Restore partition states [grp=ignite-sys-cache]" (0 ms) (parent=Restore partition states)] [21:08:41] : [Step 4/5] [2021-11-19 21:08:41,509][INFO ][exchange-worker-#16719%grid-0%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], crd=true] [21:08:41] : [Step 4/5] [2021-11-19 21:08:41,511][INFO ][exchange-worker-#16719%grid-0%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=2, minorTopVer=2], force=false, evt=DISCOVERY_CUSTOM_EVT, node=00a02231-1868-4c3c-bdce-ddb61ce23000] [21:08:41] : [Step 4/5] [2021-11-19 21:08:41,511][INFO ][sys-#16848%client%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], err=null, rebalanced=true, wasRebalanced=true] [21:08:41] : [Step 4/5] [2021-11-19 21:08:41,512][INFO ][exchange-worker-#16814%client%][GridCachePartitionExchangeManager] AffinityTopologyVersion [topVer=2, minorTopVer=2], evt=DISCOVERY_CUSTOM_EVT, evtNode=00a02231-1868-4c3c-bdce-ddb61ce23000, client=true] [21:08:41] : [Step 4/5] [2021-11-19 21:08:41,512][INFO ][sys-#16848%client%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=3375120d-e768-45d0-9e9a-d20ff15f9344, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=00a02231-1868-4c3c-bdce-ddb61ce23000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345320492, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2]] [21:08:41] : [Step 4/5] [2021-11-19 21:08:41,513][INFO ][sys-#16848%client%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (1 ms), stage="Update caches registry" (0 ms), stage="Start caches" (0 ms), stage="Affinity initialization on cache group start" (1 ms), stage="Determine exchange type" (0 ms), stage="Waiting for Full message" (163 ms), stage="Affinity recalculation" (2 ms), stage="Full map updating" (3 ms), stage="Exchange done" (2 ms), stage="Total time" (172 ms)] [21:08:41] : [Step 4/5] [2021-11-19 21:08:41,514][INFO ][sys-#16848%client%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], stage="Affinity initialization on cache group start [grp=encrypted]" (1 ms) (parent=Affinity initialization on cache group start)] [21:08:44] : [Step 4/5] [2021-11-19 21:08:44,543][INFO ][exchange-worker-#16814%client%][GridCacheProcessor] Started cache [name=encrypted, id=1613773252, dataRegionName=default, mode=PARTITIONED, atomicity=ATOMIC, backups=0, mvcc=false] [21:08:44] : [Step 4/5] [2021-11-19 21:08:44,551][INFO ][exchange-worker-#16814%client%][GridCacheProcessor] Finish proxy initialization, cacheName=encrypted, localNodeId=3375120d-e768-45d0-9e9a-d20ff15f9344 [21:08:44] : [Step 4/5] [21:08:44] >>> Stopping test: MasterKeyChangeTest#testRejectCacheStartOnClientDuringRotation in 5493 ms <<< [21:08:44] : [Step 4/5] [2021-11-19 21:08:44,559][INFO ][main][root] >>> Stopping test: MasterKeyChangeTest#testRejectCacheStartOnClientDuringRotation in 5493 ms <<< [21:08:44] : [Step 4/5] [21:08:44] >>> Heap: 233 MB used / 1919 MB commited / 1919 MB max <<< [21:08:44] : [Step 4/5] [2021-11-19 21:08:44,559][INFO ][main][root] >>> Heap: 233 MB used / 1919 MB commited / 1919 MB max <<< [21:08:44] : [Step 4/5] [21:08:44] >>> Non-Heap: 147 MB used / 179 MB commited / 0 MB max <<< [21:08:44] : [Step 4/5] [2021-11-19 21:08:44,559][INFO ][main][root] >>> Non-Heap: 147 MB used / 179 MB commited / 0 MB max <<< [21:08:44] : [Step 4/5] [21:08:44] >>> Starting test: MasterKeyChangeTest#testRejectNodeJoinDuringRotation <<< [21:08:44] : [Step 4/5] [2021-11-19 21:08:44,561][INFO ][main][root] >>> Starting test: MasterKeyChangeTest#testRejectNodeJoinDuringRotation <<< [21:08:44] : [Step 4/5] [21:08:44] >>> Heap: 233 MB used / 1919 MB commited / 1919 MB max <<< [21:08:44] : [Step 4/5] [2021-11-19 21:08:44,561][INFO ][main][root] >>> Heap: 233 MB used / 1919 MB commited / 1919 MB max <<< [21:08:44] : [Step 4/5] [21:08:44] >>> Non-Heap: 147 MB used / 179 MB commited / 0 MB max <<< [21:08:44] : [Step 4/5] [2021-11-19 21:08:44,561][INFO ][main][root] >>> Non-Heap: 147 MB used / 179 MB commited / 0 MB max <<< [21:08:44] : [Step 4/5] [2021-11-19 21:08:44,562][INFO ][main][root] >>> Stopping grid [name=client, id=3375120d-e768-45d0-9e9a-d20ff15f9344] [21:08:44] : [Step 4/5] [2021-11-19 21:08:44,572][INFO ][disco-event-worker-#16718%grid-0%][GridDiscoveryManager] Node left topology: TcpDiscoveryNode [id=3375120d-e768-45d0-9e9a-d20ff15f9344, consistentId=client, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:0], discPort=0, order=2, intOrder=2, lastExchangeTime=1637345320472, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=true] [21:08:44] : [Step 4/5] [2021-11-19 21:08:44,577][INFO ][main][GridCacheProcessor] Stopped cache [cacheName=ignite-sys-cache] [21:08:44] : [Step 4/5] [2021-11-19 21:08:44,574][INFO ][tcp-disco-sock-reader-[3375120d 127.0.0.1:41421 client]-#881%grid-0%-#16810%grid-0%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:41421, rmtPort=41421, rmtNodeId=3375120d-e768-45d0-9e9a-d20ff15f9344] [21:08:44] : [Step 4/5] [2021-11-19 21:08:44,578][INFO ][disco-event-worker-#16718%grid-0%][GridDiscoveryManager] Topology snapshot [ver=3, locNode=00a02231, servers=1, clients=0, state=ACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=00a02231-1868-4c3c-bdce-ddb61ce23000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:08:44] : [Step 4/5] [2021-11-19 21:08:44,578][INFO ][main][GridCacheProcessor] Stopped cache [cacheName=encrypted] [21:08:44] : [Step 4/5] [2021-11-19 21:08:44,579][INFO ][disco-event-worker-#16718%grid-0%][GridDiscoveryManager] ^-- Baseline [id=0, size=1, online=1, offline=0] [21:08:44]W: [org.apache.ignite:ignite-core] [2021-11-19 21:08:44,581][WARN ][grid-nio-worker-tcp-comm-0-#16658%TestRecordingCommunicationSpi%][TestRecordingCommunicationSpi] Failed to shutdown socket [21:08:44]W: [org.apache.ignite:ignite-core] java.nio.channels.ClosedChannelException [21:08:44]W: [org.apache.ignite:ignite-core] at sun.nio.ch.SocketChannelImpl.shutdownOutput(SocketChannelImpl.java:795) [21:08:44]W: [org.apache.ignite:ignite-core] at sun.nio.ch.SocketAdaptor.shutdownOutput(SocketAdaptor.java:407) [21:08:44]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.close(IgniteUtils.java:4247) [21:08:44]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.closeKey(GridNioServer.java:2784) [21:08:44]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.close(GridNioServer.java:2835) [21:08:44]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.close(GridNioServer.java:2794) [21:08:44]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.bodyInternal(GridNioServer.java:2157) [21:08:44]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.body(GridNioServer.java:1910) [21:08:44]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:125) [21:08:44]W: [org.apache.ignite:ignite-core] at java.lang.Thread.run(Thread.java:748) [21:08:44] : [Step 4/5] [2021-11-19 21:08:44,583][INFO ][exchange-worker-#16719%grid-0%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], crd=true, evt=NODE_LEFT, evtNode=3375120d-e768-45d0-9e9a-d20ff15f9344, customEvt=null, allowMerge=true, exchangeFreeSwitch=false] [21:08:44] : [Step 4/5] [2021-11-19 21:08:44,582][INFO ][main][GridDeploymentLocalStore] Removed undeployed class: GridDeployment [ts=1637345320573, depMode=SHARED, clsLdr=IsolatedClassLoader{roleName='test'}, clsLdrId=0236d593d71-3375120d-e768-45d0-9e9a-d20ff15f9344, userVer=0, loc=true, sampleClsName=org.apache.ignite.internal.processors.cache.distributed.dht.preloader.GridDhtPartitionFullMap, pendingUndeploy=false, undeployed=true, usage=0] [21:08:44] : [Step 4/5] [2021-11-19 21:08:44,586][INFO ][exchange-worker-#16719%grid-0%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], err=null, rebalanced=true, wasRebalanced=true] [21:08:44] : [Step 4/5] [2021-11-19 21:08:44,589][INFO ][exchange-worker-#16719%grid-0%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=00a02231-1868-4c3c-bdce-ddb61ce23000, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], evt=NODE_LEFT, evtNode=TcpDiscoveryNode [id=3375120d-e768-45d0-9e9a-d20ff15f9344, consistentId=client, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:0], discPort=0, order=2, intOrder=2, lastExchangeTime=1637345320472, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=true], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0]] [21:08:44] : [Step 4/5] [2021-11-19 21:08:44,591][INFO ][exchange-worker-#16719%grid-0%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (2 ms), stage="Determine exchange type" (0 ms), stage="Exchange done" (5 ms), stage="Total time" (7 ms)] [21:08:44] : [Step 4/5] [2021-11-19 21:08:44,594][INFO ][exchange-worker-#16719%grid-0%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=0]] [21:08:44] : [Step 4/5] [2021-11-19 21:08:44,595][INFO ][main][IgniteKernal%client] [21:08:44] : [Step 4/5] [21:08:44] : [Step 4/5] >>> +------------------------------------------------------+ [21:08:44] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV stopped OK [21:08:44] : [Step 4/5] >>> +------------------------------------------------------+ [21:08:44] : [Step 4/5] >>> Ignite instance name: client [21:08:44] : [Step 4/5] >>> Grid uptime: 00:00:04.077 [21:08:44] : [Step 4/5] [21:08:44] : [Step 4/5] [21:08:44] : [Step 4/5] [2021-11-19 21:08:44,595][INFO ][exchange-worker-#16719%grid-0%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], crd=true] [21:08:44] : [Step 4/5] [2021-11-19 21:08:44,596][INFO ][main][root] >>> Stopping grid [name=grid-0, id=00a02231-1868-4c3c-bdce-ddb61ce23000] [21:08:44] : [Step 4/5] [2021-11-19 21:08:44,596][INFO ][exchange-worker-#16719%grid-0%][GridCachePartitionExchangeManager] AffinityTopologyVersion [topVer=3, minorTopVer=0], evt=NODE_LEFT, evtNode=3375120d-e768-45d0-9e9a-d20ff15f9344, client=false] [21:08:44] : [Step 4/5] [2021-11-19 21:08:44,629][INFO ][db-checkpoint-thread-#16823%grid-0%][Checkpointer] Checkpoint started [checkpointId=bdeff386-44c7-4d60-ad03-dd2a9da5ee02, startPtr=WALPointer [idx=0, fileOff=1240845, len=21409], checkpointBeforeLockTime=4ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=1ms, checkpointLockHoldTime=2ms, walCpRecordFsyncDuration=4ms, writeCheckpointEntryDuration=17ms, splitAndSortCpPagesDuration=1ms, pages=1010, reason='timeout'] [21:08:44] : [Step 4/5] [2021-11-19 21:08:44,634][INFO ][main][GridCacheProcessor] Stopped cache [cacheName=ignite-sys-cache] [21:08:44] : [Step 4/5] [2021-11-19 21:08:44,635][INFO ][main][GridCacheProcessor] Stopped cache [cacheName=encrypted] [21:08:45] : [Step 4/5] [2021-11-19 21:08:45,500][INFO ][main][FilePageStoreManager] Cleanup cache stores [total=4, left=0, cleanFiles=false] [21:08:45] : [Step 4/5] [2021-11-19 21:08:45,502][INFO ][main][GridDeploymentLocalStore] Removed undeployed class: GridDeployment [ts=1637345324549, depMode=SHARED, clsLdr=IsolatedClassLoader{roleName='test'}, clsLdrId=2e36d593d71-00a02231-1868-4c3c-bdce-ddb61ce23000, userVer=0, loc=true, sampleClsName=org.apache.ignite.internal.processors.cache.GridCacheAdapter$SizeTask, pendingUndeploy=false, undeployed=true, usage=0] [21:08:45] : [Step 4/5] [2021-11-19 21:08:45,510][INFO ][main][IgniteKernal%grid-0] [21:08:45] : [Step 4/5] [21:08:45] : [Step 4/5] >>> +------------------------------------------------------+ [21:08:45] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV stopped OK [21:08:45] : [Step 4/5] >>> +------------------------------------------------------+ [21:08:45] : [Step 4/5] >>> Ignite instance name: grid-0 [21:08:45] : [Step 4/5] >>> Grid uptime: 00:00:05.268 [21:08:45] : [Step 4/5] [21:08:45] : [Step 4/5] [21:08:45]W: [org.apache.ignite:ignite-core] [2021-11-19 21:08:45,666][WARN ][test-runner-#16858%encryption.MasterKeyChangeTest%][G] Ignite work directory is not provided, automatically resolved to: /opt/buildagent/work/7bc1c54bc719b67c/work [21:08:45] : [Step 4/5] [2021-11-19 21:08:45,669][INFO ][test-runner-#16858%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] [21:08:45] : [Step 4/5] [21:08:45] : [Step 4/5] >>> __________ ________________ [21:08:45] : [Step 4/5] >>> / _/ ___/ |/ / _/_ __/ __/ [21:08:45] : [Step 4/5] >>> _/ // (7 7 // / / / / _/ [21:08:45] : [Step 4/5] >>> /___/\___/_/|_/___/ /_/ /___/ [21:08:45] : [Step 4/5] >>> [21:08:45] : [Step 4/5] >>> ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:08:45] : [Step 4/5] >>> 2021 Copyright(C) Apache Software Foundation [21:08:45] : [Step 4/5] >>> [21:08:45] : [Step 4/5] >>> Ignite documentation: http://ignite.apache.org [21:08:45] : [Step 4/5] [21:08:45] : [Step 4/5] [2021-11-19 21:08:45,669][INFO ][test-runner-#16858%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] Config URL: n/a [21:08:45] : [Step 4/5] [2021-11-19 21:08:45,670][INFO ][test-runner-#16858%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] IgniteConfiguration [igniteInstanceName=grid-0, pubPoolSize=24, svcPoolSize=24, callbackPoolSize=24, stripedPoolSize=24, sysPoolSize=24, mgmtPoolSize=4, dataStreamerPoolSize=24, utilityCachePoolSize=24, utilityCacheKeepAliveTime=60000, p2pPoolSize=2, qryPoolSize=24, buildIdxPoolSize=4, igniteHome=/opt/buildagent/work/7bc1c54bc719b67c, igniteWorkDir=/opt/buildagent/work/7bc1c54bc719b67c/work, mbeanSrv=com.sun.jmx.mbeanserver.JmxMBeanServer@6fe85038, nodeId=000dfce4-d7b6-431a-a61c-277e5ca6b000, marsh=BinaryMarshaller [], marshLocJobs=false, daemon=false, p2pEnabled=true, netTimeout=10000, netCompressionLevel=1, sndRetryDelay=1000, sndRetryCnt=3, metricsHistSize=10000, metricsUpdateFreq=1000, metricsExpTime=9223372036854775807, discoSpi=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=0, ackTimeout=0, marsh=null, reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], segPlc=STOP, segResolveAttempts=2, waitForSegOnStart=true, allResolversPassReq=true, segChkFreq=10000, commSpi=TcpCommunicationSpi [connectGate=org.apache.ignite.spi.communication.tcp.internal.ConnectGateway@4d2a8447, ctxInitLatch=java.util.concurrent.CountDownLatch@3f6f8ac6[Count = 1], stopping=false, clientPool=null, nioSrvWrapper=null, stateProvider=null], evtSpi=MemoryEventStorageSpi [expireAgeMs=9223372036854775807, expireCnt=10000, filter=null], colSpi=NoopCollisionSpi [], deploySpi=LocalDeploymentSpi [], indexingSpi=org.apache.ignite.spi.indexing.noop.NoopIndexingSpi@450c3e74, addrRslvr=null, encryptionSpi=org.apache.ignite.spi.encryption.keystore.KeystoreEncryptionSpi@f98dd23, tracingSpi=org.apache.ignite.spi.tracing.NoopTracingSpi@280e7f03, clientMode=false, rebalanceThreadPoolSize=4, rebalanceTimeout=10000, rebalanceBatchesPrefetchCnt=3, rebalanceThrottle=0, rebalanceBatchSize=524288, txCfg=TransactionConfiguration [txSerEnabled=false, dfltIsolation=REPEATABLE_READ, dfltConcurrency=PESSIMISTIC, dfltTxTimeout=0, txTimeoutOnPartitionMapExchange=0, deadlockTimeout=10000, pessimisticTxLogSize=0, pessimisticTxLogLinger=10000, tmLookupClsName=null, txManagerFactory=null, useJtaSync=false], cacheSanityCheckEnabled=true, discoStartupDelay=60000, deployMode=SHARED, p2pMissedCacheSize=100, locHost=127.0.0.1, timeSrvPortBase=31100, timeSrvPortRange=100, failureDetectionTimeout=10000, sysWorkerBlockedTimeout=null, clientFailureDetectionTimeout=10000, metricsLogFreq=0, connectorCfg=null, odbcCfg=null, warmupClos=null, atomicCfg=AtomicConfiguration [seqReserveSize=1000, cacheMode=PARTITIONED, backups=1, aff=null, grpName=null], classLdr=null, sslCtxFactory=null, platformCfg=null, binaryCfg=null, memCfg=null, pstCfg=null, dsCfg=DataStorageConfiguration [sysRegionInitSize=41943040, sysRegionMaxSize=104857600, pageSize=4096, concLvl=0, dfltDataRegConf=DataRegionConfiguration [name=default, maxSize=10485760, initSize=268435456, swapPath=null, pageEvictionMode=DISABLED, pageReplacementMode=CLOCK, evictionThreshold=0.9, emptyPagesPoolSize=100, metricsEnabled=false, metricsSubIntervalCount=5, metricsRateTimeInterval=60000, persistenceEnabled=true, checkpointPageBufSize=0, lazyMemoryAllocation=true, warmUpCfg=null], dataRegions=null, storagePath=null, checkpointFreq=180000, lockWaitTime=10000, checkpointThreads=4, checkpointWriteOrder=SEQUENTIAL, walHistSize=20, maxWalArchiveSize=1073741824, walSegments=10, walSegmentSize=67108864, walPath=db/wal, walArchivePath=db/wal/archive, cdcWalPath=db/wal/cdc, cdcEnabled=false, metricsEnabled=false, walMode=FSYNC, walTlbSize=131072, walBuffSize=0, walFlushFreq=2000, walFsyncDelay=1000, walRecordIterBuffSize=67108864, alwaysWriteFullPages=false, fileIOFactory=org.apache.ignite.internal.processors.cache.persistence.file.AsyncFileIOFactory@15289aa8, metricsSubIntervalCnt=5, metricsRateTimeInterval=60000, walAutoArchiveAfterInactivity=-1, walForceArchiveTimeout=-1, writeThrottlingEnabled=false, walCompactionEnabled=false, walCompactionLevel=1, checkpointReadLockTimeout=null, walPageCompression=DISABLED, walPageCompressionLevel=null, dfltWarmUpCfg=null, encCfg=org.apache.ignite.configuration.EncryptionConfiguration@65bc5d5e, defragmentationThreadPoolSize=4, minWalArchiveSize=-1], snapshotPath=snapshots, activeOnStart=true, activeOnStartPropSetFlag=false, autoActivation=true, autoActivationPropSetFlag=false, clusterStateOnStart=null, sqlConnCfg=null, cliConnCfg=ClientConnectorConfiguration [host=null, port=10800, portRange=100, sockSndBufSize=0, sockRcvBufSize=0, tcpNoDelay=true, maxOpenCursorsPerConn=128, threadPoolSize=24, selectorCnt=12, idleTimeout=0, handshakeTimeout=10000, jdbcEnabled=true, odbcEnabled=true, thinCliEnabled=true, sslEnabled=false, useIgniteSslCtxFactory=true, sslClientAuth=false, sslCtxFactory=null, thinCliCfg=ThinClientConfiguration [maxActiveTxPerConn=100, maxActiveComputeTasksPerConn=0]], mvccVacuumThreadCnt=2, mvccVacuumFreq=5000, authEnabled=false, failureHnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]], commFailureRslvr=null, sqlCfg=SqlConfiguration [longQryWarnTimeout=3000, dfltQryTimeout=0, sqlQryHistSize=1000, validationEnabled=false], asyncContinuationExecutor=null] [21:08:45] : [Step 4/5] [2021-11-19 21:08:45,679][INFO ][test-runner-#16858%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] Daemon mode: off [21:08:45] : [Step 4/5] [2021-11-19 21:08:45,679][INFO ][test-runner-#16858%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] OS: Linux 4.15.0-151-generic amd64 [21:08:45] : [Step 4/5] [2021-11-19 21:08:45,679][INFO ][test-runner-#16858%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] OS user: teamcity [21:08:45] : [Step 4/5] [2021-11-19 21:08:45,679][INFO ][test-runner-#16858%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] PID: 16724 [21:08:45] : [Step 4/5] [2021-11-19 21:08:45,680][INFO ][test-runner-#16858%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] Language runtime: Java Platform API Specification ver. 1.8 [21:08:45] : [Step 4/5] [2021-11-19 21:08:45,680][INFO ][test-runner-#16858%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] VM information: Java(TM) SE Runtime Environment 1.8.0_261-b12 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 25.261-b12 [21:08:45] : [Step 4/5] [2021-11-19 21:08:45,681][INFO ][test-runner-#16858%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] VM total memory: 1.9GB [21:08:45] : [Step 4/5] [2021-11-19 21:08:45,681][INFO ][test-runner-#16858%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] Remote Management [restart: off, REST: off, JMX (remote: off)] [21:08:45] : [Step 4/5] [2021-11-19 21:08:45,681][INFO ][test-runner-#16858%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] Logger: GridTestLog4jLogger [quiet=false, config=null] [21:08:45] : [Step 4/5] [2021-11-19 21:08:45,681][INFO ][test-runner-#16858%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] IGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c [21:08:45] : [Step 4/5] [2021-11-19 21:08:45,682][INFO ][test-runner-#16858%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] VM arguments: [-DIGNITE_DUMP_THREADS_ON_FAILURE=false, -DMono=/usr/bin/mono-sgen, -DMono4.0_x64=/usr/lib/mono/4.0, -DMono4.5_x64=/usr/lib/mono/4.5, -DMonoVersion=6.12.0.90, -DSKIP_BUILD=false, -Dagent.home.dir=/opt/buildagent, -Dagent.name=aitc-lin02_03, -Dagent.ownPort=9090, -Dagent.work.dir=/opt/buildagent/work, -Dbuild.number=95, -Dbuild.vcs.number=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.1=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.GitHubApacheIgnite=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dclassworlds.conf=/opt/buildagent/temp/buildTmp/teamcity.m2.conf, -Dcom.jetbrains.maven.watcher.report.file=/opt/buildagent/temp/buildTmp/maven-build-info.xml, -Djava.io.tmpdir=/opt/buildagent/temp/buildTmp, -Dmaven.home=/opt/buildagent/tools/maven3_6, -Dmaven.multiModuleProjectDirectory=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.agent.cpuBenchmark=457, -Dteamcity.agent.dotnet.agent_url=http://localhost:9090/RPC2, -Dteamcity.agent.dotnet.build_id=6278078, -Dteamcity.auth.password=*******, -Dteamcity.auth.userId=TeamCityBuildId=6278078, -Dteamcity.build.changedFiles.file=/opt/buildagent/temp/buildTmp/changedFiles6342607772318147725.txt, -Dteamcity.build.checkoutDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.build.id=6278078, -Dteamcity.build.properties.file=/opt/buildagent/temp/buildTmp/teamcity.build5164517880467851002.properties, -Dteamcity.build.tempDir=/opt/buildagent/temp/buildTmp, -Dteamcity.build.workingDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.buildConfName=Basic 3, -Dteamcity.buildType.id=IgniteTests24Java8_Basic3, -Dteamcity.configuration.properties.file=/opt/buildagent/temp/buildTmp/teamcity.config5591980786735343870.properties, -Dteamcity.maven.userSettings.path=/opt/buildagent/temp/buildTmp/maven_settings_585072866407032347.xml, -Dteamcity.maven.watcher.home=/opt/buildagent/plugins/mavenPlugin/maven-watcher-jdk16, -Dteamcity.projectName=Ignite Tests 2.x (JDK 8/11), -Dteamcity.runner.properties.file=/opt/buildagent/temp/buildTmp/teamcity.runner9098465561618137420.properties, -Dteamcity.tests.recentlyFailedTests.file=/opt/buildagent/temp/buildTmp/testsToRunFirst3891775683130404069.txt, -Dteamcity.version=2021.2 (build 99542), -ea, -Xms2g, -Xmx2g, -XX:+HeapDumpOnOutOfMemoryError, -DIGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_TEST_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_UPDATE_NOTIFIER=false, -DIGNITE_NO_DISCO_ORDER=true, -DIGNITE_PERFORMANCE_SUGGESTIONS_DISABLED=true, -Djava.net.preferIPv4Stack=true, -DTEST_SCALE_FACTOR=1.0, -DIGNITE_TEST_PROP_LOG4J_FILE=log4j-tc-test.xml, -DIGNITE_QUIET=false, -DIGNITE_MARSHAL_BUFFERS_RECHECK=1000, -Dmaven.repo.local=/opt/buildagent/.m2/repository] [21:08:45] : [Step 4/5] [2021-11-19 21:08:45,686][INFO ][test-runner-#16858%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] System cache's DataRegion size is configured to 40 MB. Use DataStorageConfiguration.systemRegionInitialSize property to change the setting. [21:08:45] : [Step 4/5] [2021-11-19 21:08:45,686][INFO ][test-runner-#16858%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] Configured caches [in 'sysMemPlc' dataRegion: ['ignite-sys-cache']] [21:08:45]W: [org.apache.ignite:ignite-core] [2021-11-19 21:08:45,687][WARN ][test-runner-#16858%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] Peer class loading is enabled (disable it in production for performance and deployment consistency reasons) [21:08:45] : [Step 4/5] [2021-11-19 21:08:45,687][INFO ][test-runner-#16858%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] 3-rd party licenses can be found at: /opt/buildagent/work/7bc1c54bc719b67c/libs/licenses [21:08:45] : [Step 4/5] [2021-11-19 21:08:45,692][INFO ][test-runner-#16858%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] Configured plugins: [21:08:45] : [Step 4/5] [2021-11-19 21:08:45,692][INFO ][test-runner-#16858%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] ^-- StanByClusterTestProvider 1.0 [21:08:45] : [Step 4/5] [2021-11-19 21:08:45,692][INFO ][test-runner-#16858%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:08:45] : [Step 4/5] [2021-11-19 21:08:45,692][INFO ][test-runner-#16858%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] [21:08:45] : [Step 4/5] [2021-11-19 21:08:45,693][INFO ][test-runner-#16858%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] ^-- PageMemory tracker plugin 1.0 [21:08:45] : [Step 4/5] [2021-11-19 21:08:45,693][INFO ][test-runner-#16858%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:08:45] : [Step 4/5] [2021-11-19 21:08:45,693][INFO ][test-runner-#16858%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] [21:08:45] : [Step 4/5] [2021-11-19 21:08:45,693][INFO ][test-runner-#16858%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] ^-- TestDistibutedConfigurationPlugin 1.0 [21:08:45] : [Step 4/5] [2021-11-19 21:08:45,693][INFO ][test-runner-#16858%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:08:45] : [Step 4/5] [2021-11-19 21:08:45,693][INFO ][test-runner-#16858%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] [21:08:45] : [Step 4/5] [2021-11-19 21:08:45,694][INFO ][test-runner-#16858%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] ^-- NodeValidationPluginProvider 1.0 [21:08:45] : [Step 4/5] [2021-11-19 21:08:45,694][INFO ][test-runner-#16858%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:08:45] : [Step 4/5] [2021-11-19 21:08:45,694][INFO ][test-runner-#16858%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] [21:08:45] : [Step 4/5] [2021-11-19 21:08:45,694][INFO ][test-runner-#16858%encryption.MasterKeyChangeTest%][FailureProcessor] Configured failure handler: [hnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]]] [21:08:45] : [Step 4/5] [2021-11-19 21:08:45,715][INFO ][test-runner-#16858%encryption.MasterKeyChangeTest%][TestRecordingCommunicationSpi] Successfully bound communication NIO server to TCP port [port=47100, locHost=/127.0.0.1, selectorsCnt=12, selectorSpins=0, pairedConn=false] [21:08:45]W: [org.apache.ignite:ignite-core] [2021-11-19 21:08:45,716][WARN ][test-runner-#16858%encryption.MasterKeyChangeTest%][TestRecordingCommunicationSpi] Message queue limit is set to 0 which may lead to potential OOMEs when running cache operations in FULL_ASYNC or PRIMARY_SYNC modes due to message queues growth on sender and receiver sides. [21:08:45] : [Step 4/5] [2021-11-19 21:08:45,723][INFO ][test-runner-#16858%encryption.MasterKeyChangeTest%][GridCollisionManager] Collision resolution is disabled (all jobs will be activated upon arrival). [21:08:45] : [Step 4/5] [2021-11-19 21:08:45,724][INFO ][test-runner-#16858%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] Security status [authentication=off, sandbox=off, tls/ssl=off] [21:08:45] : [Step 4/5] [2021-11-19 21:08:45,783][INFO ][test-runner-#16858%encryption.MasterKeyChangeTest%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:08:45] : [Step 4/5] [2021-11-19 21:08:45,868][INFO ][test-runner-#16858%encryption.MasterKeyChangeTest%][MaintenanceProcessor] Resolved store directory for node persistent data: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0 [21:08:45] : [Step 4/5] [2021-11-19 21:08:45,870][INFO ][test-runner-#16858%encryption.MasterKeyChangeTest%][CacheObjectBinaryProcessorImpl] Resolved directory for serialized binary metadata: /opt/buildagent/work/7bc1c54bc719b67c/work/db/binary_meta/grid_0 [21:08:45] : [Step 4/5] [2021-11-19 21:08:45,876][INFO ][test-runner-#16858%encryption.MasterKeyChangeTest%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0 [21:08:45] : [Step 4/5] [2021-11-19 21:08:45,876][INFO ][test-runner-#16858%encryption.MasterKeyChangeTest%][FileWriteAheadLogManager] Resolved write ahead log work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0 [21:08:45] : [Step 4/5] [2021-11-19 21:08:45,877][INFO ][test-runner-#16858%encryption.MasterKeyChangeTest%][FileWriteAheadLogManager] Resolved write ahead log archive directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0 [21:08:46] : [Step 4/5] [2021-11-19 21:08:46,344][INFO ][test-runner-#16858%encryption.MasterKeyChangeTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000000.wal [21:08:46]W: [org.apache.ignite:ignite-core] [2021-11-19 21:08:46,345][WARN ][test-runner-#16858%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] DataRegion maxSize=10.5 MB is smaller than defaultInitialSize=268.4 MB, setting initialSize to 10.5 MB [21:08:46] : [Step 4/5] [2021-11-19 21:08:46,350][INFO ][test-runner-#16858%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Configured data regions initialized successfully [total=5] [21:08:46] : [Step 4/5] [2021-11-19 21:08:46,352][INFO ][test-runner-#16858%encryption.MasterKeyChangeTest%][IgniteSnapshotManager] Resolved snapshot work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/snapshots [21:08:46] : [Step 4/5] [2021-11-19 21:08:46,353][INFO ][test-runner-#16858%encryption.MasterKeyChangeTest%][IgniteSnapshotManager] Resolved temp directory for snapshot creation: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0/snp [21:08:46] : [Step 4/5] [2021-11-19 21:08:46,356][INFO ][test-runner-#16858%encryption.MasterKeyChangeTest%][ClientListenerProcessor] Client connector processor has started on TCP port 10800 [21:08:46] : [Step 4/5] [2021-11-19 21:08:46,363][INFO ][test-runner-#16858%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] Non-loopback local IPs: 172.17.0.4 [21:08:46] : [Step 4/5] [2021-11-19 21:08:46,364][INFO ][test-runner-#16858%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] Enabled local MACs: 0242AC110004 [21:08:46] : [Step 4/5] [2021-11-19 21:08:46,366][INFO ][test-runner-#16858%encryption.MasterKeyChangeTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:08:46] : [Step 4/5] [2021-11-19 21:08:46,367][INFO ][test-runner-#16858%encryption.MasterKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:08:46] : [Step 4/5] [2021-11-19 21:08:46,368][INFO ][test-runner-#16858%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:08:46] : [Step 4/5] [2021-11-19 21:08:46,370][INFO ][test-runner-#16858%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Applying lost metastore updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:08:46] : [Step 4/5] [2021-11-19 21:08:46,370][INFO ][test-runner-#16858%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=0 ms] [21:08:46] : [Step 4/5] [2021-11-19 21:08:46,371][INFO ][test-runner-#16858%encryption.MasterKeyChangeTest%][GridCacheProcessor] Restoring partition state for local groups. [21:08:46] : [Step 4/5] [2021-11-19 21:08:46,371][INFO ][test-runner-#16858%encryption.MasterKeyChangeTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=0, partitionsProcessed=0, time=0ms] [21:08:46] : [Step 4/5] [2021-11-19 21:08:46,372][INFO ][test-runner-#16858%encryption.MasterKeyChangeTest%][GridEncryptionManager] Encryption keys loaded from metastore. [grps=, masterKeyName=ignite.master.key] [21:08:46] : [Step 4/5] [2021-11-19 21:08:46,378][INFO ][test-runner-#16858%encryption.MasterKeyChangeTest%][ClusterProcessor] Cluster ID and tag has been read from metastorage: null [21:08:46] : [Step 4/5] [2021-11-19 21:08:46,378][INFO ][test-runner-#16858%encryption.MasterKeyChangeTest%][IgniteClusterImpl] Shutdown policy was updated [oldVal=null, newVal=null] [21:08:46] : [Step 4/5] [2021-11-19 21:08:46,379][INFO ][test-runner-#16858%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Checkpoint frequency deviation changed [oldVal=null, newVal=null] [21:08:46] : [Step 4/5] [2021-11-19 21:08:46,389][INFO ][test-runner-#16858%encryption.MasterKeyChangeTest%][FilePageStoreManager] Cleanup cache stores [total=1, left=0, cleanFiles=false] [21:08:46] : [Step 4/5] [2021-11-19 21:08:46,392][INFO ][test-runner-#16858%encryption.MasterKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:08:46] : [Step 4/5] [2021-11-19 21:08:46,393][INFO ][test-runner-#16858%encryption.MasterKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:08:46] : [Step 4/5] [2021-11-19 21:08:46,395][INFO ][test-runner-#16858%encryption.MasterKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:08:46] : [Step 4/5] [2021-11-19 21:08:46,395][INFO ][test-runner-#16858%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Data Regions Started: 5 [21:08:46] : [Step 4/5] [2021-11-19 21:08:46,396][INFO ][test-runner-#16858%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] ^-- sysMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:08:46] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:08:46] : [Step 4/5] ^-- default region [type=default, persistence=true, lazyAlloc=true, [21:08:46] : [Step 4/5] ... initCfg=10MB, maxCfg=10MB, usedRam=0MB, freeRam=100%, allocRam=0MB, allocTotal=0MB] [21:08:46] : [Step 4/5] ^-- metastoreMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:08:46] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:08:46] : [Step 4/5] ^-- TxLog region [type=internal, persistence=true, lazyAlloc=false, [21:08:46] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:08:46] : [Step 4/5] ^-- volatileDsMemPlc region [type=user, persistence=false, lazyAlloc=true, [21:08:46] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB] [21:08:46] : [Step 4/5] ^-- Ignite persistence [used=0MB] [21:08:46] : [Step 4/5] [21:08:46] : [Step 4/5] [2021-11-19 21:08:46,397][INFO ][test-runner-#16858%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Starting binary memory restore for: [-2100569601] [21:08:46] : [Step 4/5] [2021-11-19 21:08:46,405][INFO ][test-runner-#16858%encryption.MasterKeyChangeTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:08:46] : [Step 4/5] [2021-11-19 21:08:46,405][INFO ][test-runner-#16858%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:08:46] : [Step 4/5] [2021-11-19 21:08:46,408][INFO ][test-runner-#16858%encryption.MasterKeyChangeTest%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000000.wal, offset=0, ver=2] [21:08:46] : [Step 4/5] [2021-11-19 21:08:46,412][INFO ][test-runner-#16858%encryption.MasterKeyChangeTest%][GridCacheProcessor] Started cache in recovery mode [name=ignite-sys-cache, id=-2100569601, dataRegionName=sysMemPlc, mode=REPLICATED, atomicity=TRANSACTIONAL, backups=2147483647, mvcc=false] [21:08:46] : [Step 4/5] [2021-11-19 21:08:46,413][INFO ][test-runner-#16858%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Binary recovery performed in 16 ms. [21:08:46] : [Step 4/5] [2021-11-19 21:08:46,413][INFO ][test-runner-#16858%encryption.MasterKeyChangeTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:08:46] : [Step 4/5] [2021-11-19 21:08:46,413][INFO ][test-runner-#16858%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Applying lost cache updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:08:46] : [Step 4/5] [2021-11-19 21:08:46,476][INFO ][test-runner-#16858%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=61 ms] [21:08:46] : [Step 4/5] [2021-11-19 21:08:46,476][INFO ][test-runner-#16858%encryption.MasterKeyChangeTest%][GridCacheProcessor] Restoring partition state for local groups. [21:08:46] : [Step 4/5] [2021-11-19 21:08:46,489][INFO ][test-runner-#16858%encryption.MasterKeyChangeTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=1, partitionsProcessed=100, time=20ms] [21:08:46] : [Step 4/5] [2021-11-19 21:08:46,970][INFO ][test-runner-#16858%encryption.MasterKeyChangeTest%][TestTcpDiscoverySpi] Successfully bound to TCP port [port=47500, localHost=localhost/127.0.0.1, locNodeId=000dfce4-d7b6-431a-a61c-277e5ca6b000] [21:08:46] : [Step 4/5] [2021-11-19 21:08:46,980][INFO ][disco-notifier-worker-#16969%grid-0%][MvccProcessorImpl] Assigned mvcc coordinator [crd=MvccCoordinator [topVer=AffinityTopologyVersion [topVer=1, minorTopVer=0], nodeId=000dfce4-d7b6-431a-a61c-277e5ca6b000, ver=1637345326972, local=true, initialized=false]] [21:08:46] : [Step 4/5] [2021-11-19 21:08:46,981][INFO ][sys-#16946%grid-0%][ClusterProcessor] Writing cluster ID and tag to metastorage on ready for write ClusterIdAndTag [id=4bb81d27-c068-44ef-a586-320c607920dd, tag=determined_tu] [21:08:46] : [Step 4/5] [2021-11-19 21:08:46,985][INFO ][disco-notifier-worker-#16969%grid-0%][ClusterProcessor] determined_tu [21:08:46] : [Step 4/5] [2021-11-19 21:08:46,986][INFO ][disco-notifier-worker-#16969%grid-0%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustEnabled' was changed from 'null' to 'false' [21:08:46] : [Step 4/5] [2021-11-19 21:08:46,987][INFO ][disco-notifier-worker-#16969%grid-0%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustTimeout' was changed from 'null' to '300000' [21:08:46] : [Step 4/5] [2021-11-19 21:08:46,987][INFO ][disco-notifier-worker-#16969%grid-0%][IgniteTxManager] Transactions parameter 'longOperationsDumpTimeout' was changed from 'null' to '60000' [21:08:46] : [Step 4/5] [2021-11-19 21:08:46,988][INFO ][disco-notifier-worker-#16969%grid-0%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpThreshold' was changed from 'null' to '0' [21:08:46] : [Step 4/5] [2021-11-19 21:08:46,989][INFO ][disco-notifier-worker-#16969%grid-0%][IgniteTxManager] Transactions parameter 'transactionTimeDumpSamplesCoefficient' was changed from 'null' to '0.0' [21:08:46] : [Step 4/5] [2021-11-19 21:08:46,989][INFO ][disco-notifier-worker-#16969%grid-0%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpSamplesPerSecondLimit' was changed from 'null' to '5' [21:08:46] : [Step 4/5] [2021-11-19 21:08:46,990][INFO ][disco-notifier-worker-#16969%grid-0%][IgniteTxManager] Transactions parameter 'collisionsDumpInterval' was changed from 'null' to '1000' [21:08:46] : [Step 4/5] [2021-11-19 21:08:46,990][INFO ][disco-notifier-worker-#16969%grid-0%][IgniteTxManager] Transactions parameter 'txOwnerDumpRequestsAllowed' was changed from 'null' to 'true' [21:08:46] : [Step 4/5] [2021-11-19 21:08:46,991][INFO ][disco-notifier-worker-#16969%grid-0%][GridCacheDatabaseSharedManager] Historical rebalance WAL threshold changed [property=historical.rebalance.threshold, oldVal=null, newVal=500] [21:08:46] : [Step 4/5] [2021-11-19 21:08:46,996][INFO ][test-runner-#16858%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] To start Console Management & Monitoring run ignitevisorcmd.{sh|bat} [21:08:46] : [Step 4/5] [2021-11-19 21:08:46,996][INFO ][test-runner-#16858%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] [21:08:46] : [Step 4/5] [21:08:46] : [Step 4/5] >>> +-------------------------------------------+ [21:08:46] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:08:46] : [Step 4/5] >>> +-------------------------------------------+ [21:08:46] : [Step 4/5] >>> OS name: Linux 4.15.0-151-generic amd64 [21:08:46] : [Step 4/5] >>> CPU(s): 24 [21:08:46] : [Step 4/5] >>> Heap: 2.0GB [21:08:46] : [Step 4/5] >>> VM name: 16724@c4dfe9a430b2 [21:08:46] : [Step 4/5] >>> Ignite instance name: grid-0 [21:08:46] : [Step 4/5] >>> Local node [ID=000DFCE4-D7B6-431A-A61C-277E5CA6B000, order=1, clientMode=false] [21:08:46] : [Step 4/5] >>> Local node addresses: [127.0.0.1] [21:08:46] : [Step 4/5] >>> Local ports: TCP:10800 TCP:47100 TCP:47500 [21:08:46] : [Step 4/5] [21:08:46] : [Step 4/5] [2021-11-19 21:08:46,997][INFO ][test-runner-#16858%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] >>> Ignite cluster is in INACTIVE state (limited functionality available). Use control.(sh|bat) script or IgniteCluster.state(ClusterState.ACTIVE) to change the state. [21:08:46] : [Step 4/5] [2021-11-19 21:08:46,998][INFO ][test-runner-#16858%encryption.MasterKeyChangeTest%][GridDiscoveryManager] Topology snapshot [ver=1, locNode=000dfce4, servers=1, clients=0, state=INACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=000dfce4-d7b6-431a-a61c-277e5ca6b000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:08:47] : [Step 4/5] [2021-11-19 21:08:46,999][INFO ][test-runner-#16858%encryption.MasterKeyChangeTest%][G] Node started : [stage="Configure system pool" (0 ms),stage="Start managers" (201 ms),stage="Configure binary metadata" (2 ms),stage="Start processors" (490 ms),stage="Start 'StanByClusterTestProvider' plugin" (0 ms),stage="Start 'PageMemory tracker plugin' plugin" (0 ms),stage="Start 'TestDistibutedConfigurationPlugin' plugin" (0 ms),stage="Start 'NodeValidationPluginProvider' plugin" (0 ms),stage="Init metastore" (26 ms),stage="Init and start regions" (7 ms),stage="Restore binary memory" (15 ms),stage="Restore logical state" (76 ms),stage="Finish recovery" (478 ms),stage="Join topology" (11 ms),stage="Await transition" (2 ms),stage="Await exchange" (16 ms),stage="Total time" (1324 ms)] [21:08:47] : [Step 4/5] [2021-11-19 21:08:47,000][INFO ][test-runner-#16858%encryption.MasterKeyChangeTest%][root] Node started with the following configuration [id=000dfce4-d7b6-431a-a61c-277e5ca6b000, marshaller=BinaryMarshaller [], discovery=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=5000, ackTimeout=5000, marsh=JdkMarshaller [clsFilter=org.apache.ignite.marshaller.MarshallerUtils$1@6dab7a2], reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], binaryCfg=null, lateAff=true] [21:08:47]W: [org.apache.ignite:ignite-core] [2021-11-19 21:08:47,006][WARN ][test-runner-#16858%encryption.MasterKeyChangeTest%][G] Ignite work directory is not provided, automatically resolved to: /opt/buildagent/work/7bc1c54bc719b67c/work [21:08:47] : [Step 4/5] [2021-11-19 21:08:47,007][INFO ][test-runner-#16858%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] [21:08:47] : [Step 4/5] [21:08:47] : [Step 4/5] >>> __________ ________________ [21:08:47] : [Step 4/5] >>> / _/ ___/ |/ / _/_ __/ __/ [21:08:47] : [Step 4/5] >>> _/ // (7 7 // / / / / _/ [21:08:47] : [Step 4/5] >>> /___/\___/_/|_/___/ /_/ /___/ [21:08:47] : [Step 4/5] >>> [21:08:47] : [Step 4/5] >>> ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:08:47] : [Step 4/5] >>> 2021 Copyright(C) Apache Software Foundation [21:08:47] : [Step 4/5] >>> [21:08:47] : [Step 4/5] >>> Ignite documentation: http://ignite.apache.org [21:08:47] : [Step 4/5] [21:08:47] : [Step 4/5] [2021-11-19 21:08:47,007][INFO ][test-runner-#16858%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] Config URL: n/a [21:08:47] : [Step 4/5] [2021-11-19 21:08:47,008][INFO ][test-runner-#16858%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] IgniteConfiguration [igniteInstanceName=grid-1, pubPoolSize=24, svcPoolSize=24, callbackPoolSize=24, stripedPoolSize=24, sysPoolSize=24, mgmtPoolSize=4, dataStreamerPoolSize=24, utilityCachePoolSize=24, utilityCacheKeepAliveTime=60000, p2pPoolSize=2, qryPoolSize=24, buildIdxPoolSize=4, igniteHome=/opt/buildagent/work/7bc1c54bc719b67c, igniteWorkDir=/opt/buildagent/work/7bc1c54bc719b67c/work, mbeanSrv=com.sun.jmx.mbeanserver.JmxMBeanServer@6fe85038, nodeId=100c36d3-16b1-4c48-8740-717105362001, marsh=BinaryMarshaller [], marshLocJobs=false, daemon=false, p2pEnabled=true, netTimeout=10000, netCompressionLevel=1, sndRetryDelay=1000, sndRetryCnt=3, metricsHistSize=10000, metricsUpdateFreq=1000, metricsExpTime=9223372036854775807, discoSpi=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=0, ackTimeout=0, marsh=null, reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], segPlc=STOP, segResolveAttempts=2, waitForSegOnStart=true, allResolversPassReq=true, segChkFreq=10000, commSpi=TcpCommunicationSpi [connectGate=org.apache.ignite.spi.communication.tcp.internal.ConnectGateway@7b6d47b1, ctxInitLatch=java.util.concurrent.CountDownLatch@4bb8e83a[Count = 1], stopping=false, clientPool=null, nioSrvWrapper=null, stateProvider=null], evtSpi=MemoryEventStorageSpi [expireAgeMs=9223372036854775807, expireCnt=10000, filter=null], colSpi=NoopCollisionSpi [], deploySpi=LocalDeploymentSpi [], indexingSpi=org.apache.ignite.spi.indexing.noop.NoopIndexingSpi@203eef02, addrRslvr=null, encryptionSpi=org.apache.ignite.spi.encryption.keystore.KeystoreEncryptionSpi@6bdda0fc, tracingSpi=org.apache.ignite.spi.tracing.NoopTracingSpi@3a52e52, clientMode=false, rebalanceThreadPoolSize=4, rebalanceTimeout=10000, rebalanceBatchesPrefetchCnt=3, rebalanceThrottle=0, rebalanceBatchSize=524288, txCfg=TransactionConfiguration [txSerEnabled=false, dfltIsolation=REPEATABLE_READ, dfltConcurrency=PESSIMISTIC, dfltTxTimeout=0, txTimeoutOnPartitionMapExchange=0, deadlockTimeout=10000, pessimisticTxLogSize=0, pessimisticTxLogLinger=10000, tmLookupClsName=null, txManagerFactory=null, useJtaSync=false], cacheSanityCheckEnabled=true, discoStartupDelay=60000, deployMode=SHARED, p2pMissedCacheSize=100, locHost=127.0.0.1, timeSrvPortBase=31100, timeSrvPortRange=100, failureDetectionTimeout=10000, sysWorkerBlockedTimeout=null, clientFailureDetectionTimeout=10000, metricsLogFreq=0, connectorCfg=null, odbcCfg=null, warmupClos=null, atomicCfg=AtomicConfiguration [seqReserveSize=1000, cacheMode=PARTITIONED, backups=1, aff=null, grpName=null], classLdr=null, sslCtxFactory=null, platformCfg=null, binaryCfg=null, memCfg=null, pstCfg=null, dsCfg=DataStorageConfiguration [sysRegionInitSize=41943040, sysRegionMaxSize=104857600, pageSize=4096, concLvl=0, dfltDataRegConf=DataRegionConfiguration [name=default, maxSize=10485760, initSize=268435456, swapPath=null, pageEvictionMode=DISABLED, pageReplacementMode=CLOCK, evictionThreshold=0.9, emptyPagesPoolSize=100, metricsEnabled=false, metricsSubIntervalCount=5, metricsRateTimeInterval=60000, persistenceEnabled=true, checkpointPageBufSize=0, lazyMemoryAllocation=true, warmUpCfg=null], dataRegions=null, storagePath=null, checkpointFreq=180000, lockWaitTime=10000, checkpointThreads=4, checkpointWriteOrder=SEQUENTIAL, walHistSize=20, maxWalArchiveSize=1073741824, walSegments=10, walSegmentSize=67108864, walPath=db/wal, walArchivePath=db/wal/archive, cdcWalPath=db/wal/cdc, cdcEnabled=false, metricsEnabled=false, walMode=FSYNC, walTlbSize=131072, walBuffSize=0, walFlushFreq=2000, walFsyncDelay=1000, walRecordIterBuffSize=67108864, alwaysWriteFullPages=false, fileIOFactory=org.apache.ignite.internal.processors.cache.persistence.file.AsyncFileIOFactory@27602457, metricsSubIntervalCnt=5, metricsRateTimeInterval=60000, walAutoArchiveAfterInactivity=-1, walForceArchiveTimeout=-1, writeThrottlingEnabled=false, walCompactionEnabled=false, walCompactionLevel=1, checkpointReadLockTimeout=null, walPageCompression=DISABLED, walPageCompressionLevel=null, dfltWarmUpCfg=null, encCfg=org.apache.ignite.configuration.EncryptionConfiguration@16512ec7, defragmentationThreadPoolSize=4, minWalArchiveSize=-1], snapshotPath=snapshots, activeOnStart=true, activeOnStartPropSetFlag=false, autoActivation=true, autoActivationPropSetFlag=false, clusterStateOnStart=null, sqlConnCfg=null, cliConnCfg=ClientConnectorConfiguration [host=null, port=10800, portRange=100, sockSndBufSize=0, sockRcvBufSize=0, tcpNoDelay=true, maxOpenCursorsPerConn=128, threadPoolSize=24, selectorCnt=12, idleTimeout=0, handshakeTimeout=10000, jdbcEnabled=true, odbcEnabled=true, thinCliEnabled=true, sslEnabled=false, useIgniteSslCtxFactory=true, sslClientAuth=false, sslCtxFactory=null, thinCliCfg=ThinClientConfiguration [maxActiveTxPerConn=100, maxActiveComputeTasksPerConn=0]], mvccVacuumThreadCnt=2, mvccVacuumFreq=5000, authEnabled=false, failureHnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]], commFailureRslvr=null, sqlCfg=SqlConfiguration [longQryWarnTimeout=3000, dfltQryTimeout=0, sqlQryHistSize=1000, validationEnabled=false], asyncContinuationExecutor=null] [21:08:47] : [Step 4/5] [2021-11-19 21:08:47,016][INFO ][test-runner-#16858%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] Daemon mode: off [21:08:47] : [Step 4/5] [2021-11-19 21:08:47,016][INFO ][test-runner-#16858%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] OS: Linux 4.15.0-151-generic amd64 [21:08:47] : [Step 4/5] [2021-11-19 21:08:47,016][INFO ][test-runner-#16858%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] OS user: teamcity [21:08:47] : [Step 4/5] [2021-11-19 21:08:47,016][INFO ][test-runner-#16858%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] PID: 16724 [21:08:47] : [Step 4/5] [2021-11-19 21:08:47,017][INFO ][test-runner-#16858%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] Language runtime: Java Platform API Specification ver. 1.8 [21:08:47] : [Step 4/5] [2021-11-19 21:08:47,017][INFO ][test-runner-#16858%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] VM information: Java(TM) SE Runtime Environment 1.8.0_261-b12 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 25.261-b12 [21:08:47] : [Step 4/5] [2021-11-19 21:08:47,017][INFO ][test-runner-#16858%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] VM total memory: 1.9GB [21:08:47] : [Step 4/5] [2021-11-19 21:08:47,017][INFO ][test-runner-#16858%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] Remote Management [restart: off, REST: off, JMX (remote: off)] [21:08:47] : [Step 4/5] [2021-11-19 21:08:47,018][INFO ][test-runner-#16858%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] Logger: GridTestLog4jLogger [quiet=false, config=null] [21:08:47] : [Step 4/5] [2021-11-19 21:08:47,018][INFO ][test-runner-#16858%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] IGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c [21:08:47] : [Step 4/5] [2021-11-19 21:08:47,018][INFO ][test-runner-#16858%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] VM arguments: [-DIGNITE_DUMP_THREADS_ON_FAILURE=false, -DMono=/usr/bin/mono-sgen, -DMono4.0_x64=/usr/lib/mono/4.0, -DMono4.5_x64=/usr/lib/mono/4.5, -DMonoVersion=6.12.0.90, -DSKIP_BUILD=false, -Dagent.home.dir=/opt/buildagent, -Dagent.name=aitc-lin02_03, -Dagent.ownPort=9090, -Dagent.work.dir=/opt/buildagent/work, -Dbuild.number=95, -Dbuild.vcs.number=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.1=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.GitHubApacheIgnite=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dclassworlds.conf=/opt/buildagent/temp/buildTmp/teamcity.m2.conf, -Dcom.jetbrains.maven.watcher.report.file=/opt/buildagent/temp/buildTmp/maven-build-info.xml, -Djava.io.tmpdir=/opt/buildagent/temp/buildTmp, -Dmaven.home=/opt/buildagent/tools/maven3_6, -Dmaven.multiModuleProjectDirectory=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.agent.cpuBenchmark=457, -Dteamcity.agent.dotnet.agent_url=http://localhost:9090/RPC2, -Dteamcity.agent.dotnet.build_id=6278078, -Dteamcity.auth.password=*******, -Dteamcity.auth.userId=TeamCityBuildId=6278078, -Dteamcity.build.changedFiles.file=/opt/buildagent/temp/buildTmp/changedFiles6342607772318147725.txt, -Dteamcity.build.checkoutDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.build.id=6278078, -Dteamcity.build.properties.file=/opt/buildagent/temp/buildTmp/teamcity.build5164517880467851002.properties, -Dteamcity.build.tempDir=/opt/buildagent/temp/buildTmp, -Dteamcity.build.workingDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.buildConfName=Basic 3, -Dteamcity.buildType.id=IgniteTests24Java8_Basic3, -Dteamcity.configuration.properties.file=/opt/buildagent/temp/buildTmp/teamcity.config5591980786735343870.properties, -Dteamcity.maven.userSettings.path=/opt/buildagent/temp/buildTmp/maven_settings_585072866407032347.xml, -Dteamcity.maven.watcher.home=/opt/buildagent/plugins/mavenPlugin/maven-watcher-jdk16, -Dteamcity.projectName=Ignite Tests 2.x (JDK 8/11), -Dteamcity.runner.properties.file=/opt/buildagent/temp/buildTmp/teamcity.runner9098465561618137420.properties, -Dteamcity.tests.recentlyFailedTests.file=/opt/buildagent/temp/buildTmp/testsToRunFirst3891775683130404069.txt, -Dteamcity.version=2021.2 (build 99542), -ea, -Xms2g, -Xmx2g, -XX:+HeapDumpOnOutOfMemoryError, -DIGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_TEST_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_UPDATE_NOTIFIER=false, -DIGNITE_NO_DISCO_ORDER=true, -DIGNITE_PERFORMANCE_SUGGESTIONS_DISABLED=true, -Djava.net.preferIPv4Stack=true, -DTEST_SCALE_FACTOR=1.0, -DIGNITE_TEST_PROP_LOG4J_FILE=log4j-tc-test.xml, -DIGNITE_QUIET=false, -DIGNITE_MARSHAL_BUFFERS_RECHECK=1000, -Dmaven.repo.local=/opt/buildagent/.m2/repository] [21:08:47] : [Step 4/5] [2021-11-19 21:08:47,022][INFO ][test-runner-#16858%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] System cache's DataRegion size is configured to 40 MB. Use DataStorageConfiguration.systemRegionInitialSize property to change the setting. [21:08:47] : [Step 4/5] [2021-11-19 21:08:47,023][INFO ][test-runner-#16858%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] Configured caches [in 'sysMemPlc' dataRegion: ['ignite-sys-cache']] [21:08:47]W: [org.apache.ignite:ignite-core] [2021-11-19 21:08:47,023][WARN ][test-runner-#16858%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] Peer class loading is enabled (disable it in production for performance and deployment consistency reasons) [21:08:47] : [Step 4/5] [2021-11-19 21:08:47,023][INFO ][test-runner-#16858%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] 3-rd party licenses can be found at: /opt/buildagent/work/7bc1c54bc719b67c/libs/licenses [21:08:47] : [Step 4/5] [2021-11-19 21:08:47,027][INFO ][test-runner-#16858%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] Configured plugins: [21:08:47] : [Step 4/5] [2021-11-19 21:08:47,027][INFO ][test-runner-#16858%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] ^-- StanByClusterTestProvider 1.0 [21:08:47] : [Step 4/5] [2021-11-19 21:08:47,028][INFO ][test-runner-#16858%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:08:47] : [Step 4/5] [2021-11-19 21:08:47,028][INFO ][test-runner-#16858%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] [21:08:47] : [Step 4/5] [2021-11-19 21:08:47,028][INFO ][test-runner-#16858%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] ^-- PageMemory tracker plugin 1.0 [21:08:47] : [Step 4/5] [2021-11-19 21:08:47,028][INFO ][test-runner-#16858%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:08:47] : [Step 4/5] [2021-11-19 21:08:47,028][INFO ][test-runner-#16858%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] [21:08:47] : [Step 4/5] [2021-11-19 21:08:47,029][INFO ][test-runner-#16858%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] ^-- TestDistibutedConfigurationPlugin 1.0 [21:08:47] : [Step 4/5] [2021-11-19 21:08:47,029][INFO ][test-runner-#16858%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:08:47] : [Step 4/5] [2021-11-19 21:08:47,029][INFO ][test-runner-#16858%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] [21:08:47] : [Step 4/5] [2021-11-19 21:08:47,029][INFO ][test-runner-#16858%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] ^-- NodeValidationPluginProvider 1.0 [21:08:47] : [Step 4/5] [2021-11-19 21:08:47,029][INFO ][test-runner-#16858%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:08:47] : [Step 4/5] [2021-11-19 21:08:47,030][INFO ][test-runner-#16858%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] [21:08:47] : [Step 4/5] [2021-11-19 21:08:47,030][INFO ][test-runner-#16858%encryption.MasterKeyChangeTest%][FailureProcessor] Configured failure handler: [hnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]]] [21:08:47] : [Step 4/5] [2021-11-19 21:08:47,043][INFO ][test-runner-#16858%encryption.MasterKeyChangeTest%][TestRecordingCommunicationSpi] Successfully bound communication NIO server to TCP port [port=47101, locHost=/127.0.0.1, selectorsCnt=12, selectorSpins=0, pairedConn=false] [21:08:47]W: [org.apache.ignite:ignite-core] [2021-11-19 21:08:47,043][WARN ][test-runner-#16858%encryption.MasterKeyChangeTest%][TestRecordingCommunicationSpi] Message queue limit is set to 0 which may lead to potential OOMEs when running cache operations in FULL_ASYNC or PRIMARY_SYNC modes due to message queues growth on sender and receiver sides. [21:08:47] : [Step 4/5] [2021-11-19 21:08:47,047][INFO ][test-runner-#16858%encryption.MasterKeyChangeTest%][GridCollisionManager] Collision resolution is disabled (all jobs will be activated upon arrival). [21:08:47] : [Step 4/5] [2021-11-19 21:08:47,047][INFO ][test-runner-#16858%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] Security status [authentication=off, sandbox=off, tls/ssl=off] [21:08:47] : [Step 4/5] [2021-11-19 21:08:47,104][INFO ][test-runner-#16858%encryption.MasterKeyChangeTest%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:08:47] : [Step 4/5] [2021-11-19 21:08:47,189][INFO ][test-runner-#16858%encryption.MasterKeyChangeTest%][MaintenanceProcessor] Resolved store directory for node persistent data: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1 [21:08:47] : [Step 4/5] [2021-11-19 21:08:47,190][INFO ][test-runner-#16858%encryption.MasterKeyChangeTest%][CacheObjectBinaryProcessorImpl] Resolved directory for serialized binary metadata: /opt/buildagent/work/7bc1c54bc719b67c/work/db/binary_meta/grid_1 [21:08:47] : [Step 4/5] [2021-11-19 21:08:47,194][INFO ][test-runner-#16858%encryption.MasterKeyChangeTest%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1 [21:08:47] : [Step 4/5] [2021-11-19 21:08:47,194][INFO ][test-runner-#16858%encryption.MasterKeyChangeTest%][FileWriteAheadLogManager] Resolved write ahead log work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1 [21:08:47] : [Step 4/5] [2021-11-19 21:08:47,195][INFO ][test-runner-#16858%encryption.MasterKeyChangeTest%][FileWriteAheadLogManager] Resolved write ahead log archive directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1 [21:08:47] : [Step 4/5] [2021-11-19 21:08:47,619][INFO ][test-runner-#16858%encryption.MasterKeyChangeTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000000.wal [21:08:47] : [Step 4/5] [2021-11-19 21:08:47,624][INFO ][test-runner-#16858%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Configured data regions initialized successfully [total=5] [21:08:47] : [Step 4/5] [2021-11-19 21:08:47,627][INFO ][test-runner-#16858%encryption.MasterKeyChangeTest%][IgniteSnapshotManager] Resolved snapshot work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/snapshots [21:08:47] : [Step 4/5] [2021-11-19 21:08:47,627][INFO ][test-runner-#16858%encryption.MasterKeyChangeTest%][IgniteSnapshotManager] Resolved temp directory for snapshot creation: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1/snp [21:08:47] : [Step 4/5] [2021-11-19 21:08:47,630][INFO ][test-runner-#16858%encryption.MasterKeyChangeTest%][ClientListenerProcessor] Client connector processor has started on TCP port 10801 [21:08:47] : [Step 4/5] [2021-11-19 21:08:47,632][INFO ][test-runner-#16858%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] Non-loopback local IPs: 172.17.0.4 [21:08:47] : [Step 4/5] [2021-11-19 21:08:47,633][INFO ][test-runner-#16858%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] Enabled local MACs: 0242AC110004 [21:08:47] : [Step 4/5] [2021-11-19 21:08:47,633][INFO ][test-runner-#16858%encryption.MasterKeyChangeTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:08:47] : [Step 4/5] [2021-11-19 21:08:47,635][INFO ][test-runner-#16858%encryption.MasterKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:08:47] : [Step 4/5] [2021-11-19 21:08:47,635][INFO ][test-runner-#16858%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:08:47] : [Step 4/5] [2021-11-19 21:08:47,637][INFO ][test-runner-#16858%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Applying lost metastore updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:08:47] : [Step 4/5] [2021-11-19 21:08:47,638][INFO ][test-runner-#16858%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=10 ms] [21:08:47] : [Step 4/5] [2021-11-19 21:08:47,638][INFO ][test-runner-#16858%encryption.MasterKeyChangeTest%][GridCacheProcessor] Restoring partition state for local groups. [21:08:47] : [Step 4/5] [2021-11-19 21:08:47,638][INFO ][test-runner-#16858%encryption.MasterKeyChangeTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=0, partitionsProcessed=0, time=0ms] [21:08:47] : [Step 4/5] [2021-11-19 21:08:47,639][INFO ][test-runner-#16858%encryption.MasterKeyChangeTest%][GridEncryptionManager] Encryption keys loaded from metastore. [grps=, masterKeyName=ignite.master.key] [21:08:47] : [Step 4/5] [2021-11-19 21:08:47,640][INFO ][test-runner-#16858%encryption.MasterKeyChangeTest%][ClusterProcessor] Cluster ID and tag has been read from metastorage: null [21:08:47] : [Step 4/5] [2021-11-19 21:08:47,641][INFO ][test-runner-#16858%encryption.MasterKeyChangeTest%][IgniteClusterImpl] Shutdown policy was updated [oldVal=null, newVal=null] [21:08:47] : [Step 4/5] [2021-11-19 21:08:47,641][INFO ][test-runner-#16858%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Checkpoint frequency deviation changed [oldVal=null, newVal=null] [21:08:47] : [Step 4/5] [2021-11-19 21:08:47,651][INFO ][test-runner-#16858%encryption.MasterKeyChangeTest%][FilePageStoreManager] Cleanup cache stores [total=1, left=0, cleanFiles=false] [21:08:47] : [Step 4/5] [2021-11-19 21:08:47,653][INFO ][test-runner-#16858%encryption.MasterKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:08:47] : [Step 4/5] [2021-11-19 21:08:47,654][INFO ][test-runner-#16858%encryption.MasterKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:08:47] : [Step 4/5] [2021-11-19 21:08:47,656][INFO ][test-runner-#16858%encryption.MasterKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:08:47] : [Step 4/5] [2021-11-19 21:08:47,656][INFO ][test-runner-#16858%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Data Regions Started: 5 [21:08:47] : [Step 4/5] [2021-11-19 21:08:47,657][INFO ][test-runner-#16858%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] ^-- sysMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:08:47] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:08:47] : [Step 4/5] ^-- default region [type=default, persistence=true, lazyAlloc=true, [21:08:47] : [Step 4/5] ... initCfg=10MB, maxCfg=10MB, usedRam=0MB, freeRam=100%, allocRam=0MB, allocTotal=0MB] [21:08:47] : [Step 4/5] ^-- metastoreMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:08:47] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:08:47] : [Step 4/5] ^-- TxLog region [type=internal, persistence=true, lazyAlloc=false, [21:08:47] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:08:47] : [Step 4/5] ^-- volatileDsMemPlc region [type=user, persistence=false, lazyAlloc=true, [21:08:47] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB] [21:08:47] : [Step 4/5] ^-- Ignite persistence [used=0MB] [21:08:47] : [Step 4/5] [21:08:47] : [Step 4/5] [2021-11-19 21:08:47,658][INFO ][test-runner-#16858%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Starting binary memory restore for: [-2100569601] [21:08:47] : [Step 4/5] [2021-11-19 21:08:47,665][INFO ][test-runner-#16858%encryption.MasterKeyChangeTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:08:47] : [Step 4/5] [2021-11-19 21:08:47,666][INFO ][test-runner-#16858%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:08:47] : [Step 4/5] [2021-11-19 21:08:47,667][INFO ][test-runner-#16858%encryption.MasterKeyChangeTest%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000000.wal, offset=0, ver=2] [21:08:47] : [Step 4/5] [2021-11-19 21:08:47,671][INFO ][test-runner-#16858%encryption.MasterKeyChangeTest%][GridCacheProcessor] Started cache in recovery mode [name=ignite-sys-cache, id=-2100569601, dataRegionName=sysMemPlc, mode=REPLICATED, atomicity=TRANSACTIONAL, backups=2147483647, mvcc=false] [21:08:47] : [Step 4/5] [2021-11-19 21:08:47,672][INFO ][test-runner-#16858%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Binary recovery performed in 14 ms. [21:08:47] : [Step 4/5] [2021-11-19 21:08:47,673][INFO ][test-runner-#16858%encryption.MasterKeyChangeTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:08:47] : [Step 4/5] [2021-11-19 21:08:47,673][INFO ][test-runner-#16858%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Applying lost cache updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:08:47] : [Step 4/5] [2021-11-19 21:08:47,736][INFO ][test-runner-#16858%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=61 ms] [21:08:47] : [Step 4/5] [2021-11-19 21:08:47,737][INFO ][test-runner-#16858%encryption.MasterKeyChangeTest%][GridCacheProcessor] Restoring partition state for local groups. [21:08:47] : [Step 4/5] [2021-11-19 21:08:47,740][INFO ][test-runner-#16858%encryption.MasterKeyChangeTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=1, partitionsProcessed=100, time=10ms] [21:08:48] : [Step 4/5] [2021-11-19 21:08:48,094][INFO ][test-runner-#16858%encryption.MasterKeyChangeTest%][TestTcpDiscoverySpi] Successfully bound to TCP port [port=47501, localHost=localhost/127.0.0.1, locNodeId=100c36d3-16b1-4c48-8740-717105362001] [21:08:48] : [Step 4/5] [2021-11-19 21:08:48,097][INFO ][tcp-disco-srvr-[:47500]-#886%grid-0%-#16971%grid-0%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=37535] [21:08:48] : [Step 4/5] [2021-11-19 21:08:48,097][INFO ][tcp-disco-srvr-[:47500]-#886%grid-0%-#16971%grid-0%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=37535] [21:08:48] : [Step 4/5] [2021-11-19 21:08:48,098][INFO ][tcp-disco-sock-reader-[]-#892%grid-0%-#17090%grid-0%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:37535, rmtPort=37535] [21:08:48] : [Step 4/5] [2021-11-19 21:08:48,100][INFO ][tcp-disco-sock-reader-[100c36d3 127.0.0.1:37535]-#892%grid-0%-#17090%grid-0%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=100c36d3-16b1-4c48-8740-717105362001, rmtAddr=/127.0.0.1:37535] [21:08:48] : [Step 4/5] [2021-11-19 21:08:48,106][INFO ][tcp-disco-srvr-[:47501]-#891%grid-1%-#17089%grid-1%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=35837] [21:08:48] : [Step 4/5] [2021-11-19 21:08:48,106][INFO ][tcp-disco-srvr-[:47501]-#891%grid-1%-#17089%grid-1%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=35837] [21:08:48] : [Step 4/5] [2021-11-19 21:08:48,107][INFO ][tcp-disco-sock-reader-[]-#893%grid-1%-#17091%grid-1%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:35837, rmtPort=35837] [21:08:48] : [Step 4/5] [2021-11-19 21:08:48,107][INFO ][tcp-disco-sock-reader-[]-#893%grid-1%-#17091%grid-1%][TestTcpDiscoverySpi] Received ping request from the remote node [rmtNodeId=000dfce4-d7b6-431a-a61c-277e5ca6b000, rmtAddr=/127.0.0.1:35837, rmtPort=35837] [21:08:48] : [Step 4/5] [2021-11-19 21:08:48,109][INFO ][tcp-disco-sock-reader-[]-#893%grid-1%-#17091%grid-1%][TestTcpDiscoverySpi] Finished writing ping response [rmtNodeId=000dfce4-d7b6-431a-a61c-277e5ca6b000, rmtAddr=/127.0.0.1:35837, rmtPort=35837] [21:08:48]W: [org.apache.ignite:ignite-core] [2021-11-19 21:08:48,109][WARN ][tcp-disco-sock-reader-[]-#893%grid-1%-#17091%grid-1%][TestTcpDiscoverySpi] Failed to shutdown socket [21:08:48]W: [org.apache.ignite:ignite-core] java.net.SocketException: Socket output is already shutdown [21:08:48]W: [org.apache.ignite:ignite-core] at java.net.Socket.shutdownOutput(Socket.java:1572) [21:08:48]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.close(IgniteUtils.java:4247) [21:08:48]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.discovery.tcp.ServerImpl$SocketReader.body(ServerImpl.java:7370) [21:08:48] : [Step 4/5] [2021-11-19 21:08:48,109][INFO ][tcp-disco-sock-reader-[100c36d3 127.0.0.1:37535]-#892%grid-0%-#17090%grid-0%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:37535, rmtPort=37535, rmtNodeId=100c36d3-16b1-4c48-8740-717105362001] [21:08:48]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.IgniteSpiThread.run(IgniteSpiThread.java:58) [21:08:48] : [Step 4/5] [2021-11-19 21:08:48,110][INFO ][tcp-disco-sock-reader-[]-#893%grid-1%-#17091%grid-1%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:35837, rmtPort=35837, rmtNodeId=null] [21:08:48] : [Step 4/5] [2021-11-19 21:08:48,112][INFO ][tcp-disco-msg-worker-[crd]-#885%grid-0%-#16970%grid-0%][GridEncryptionManager] Joining node doesn't have stored group keys [node=100c36d3-16b1-4c48-8740-717105362001] [21:08:48] : [Step 4/5] [2021-11-19 21:08:48,120][INFO ][tcp-disco-msg-worker-[crd]-#885%grid-0%-#16970%grid-0%][TestTcpDiscoverySpi] New next node [newNext=TcpDiscoveryNode [id=100c36d3-16b1-4c48-8740-717105362001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=0, intOrder=2, lastExchangeTime=1637345328102, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false]] [21:08:48] : [Step 4/5] [2021-11-19 21:08:48,121][INFO ][tcp-disco-srvr-[:47501]-#891%grid-1%-#17089%grid-1%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=43433] [21:08:48] : [Step 4/5] [2021-11-19 21:08:48,121][INFO ][tcp-disco-srvr-[:47501]-#891%grid-1%-#17089%grid-1%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=43433] [21:08:48] : [Step 4/5] [2021-11-19 21:08:48,121][INFO ][tcp-disco-sock-reader-[]-#894%grid-1%-#17092%grid-1%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:43433, rmtPort=43433] [21:08:48] : [Step 4/5] [2021-11-19 21:08:48,122][INFO ][tcp-disco-sock-reader-[000dfce4 127.0.0.1:43433]-#894%grid-1%-#17092%grid-1%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=000dfce4-d7b6-431a-a61c-277e5ca6b000, rmtAddr=/127.0.0.1:43433] [21:08:48] : [Step 4/5] [2021-11-19 21:08:48,125][INFO ][tcp-disco-msg-worker-[]-#890%grid-1%-#17088%grid-1%][TestTcpDiscoverySpi] New next node [newNext=TcpDiscoveryNode [id=000dfce4-d7b6-431a-a61c-277e5ca6b000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345328122, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false]] [21:08:48] : [Step 4/5] [2021-11-19 21:08:48,126][INFO ][tcp-disco-srvr-[:47500]-#886%grid-0%-#16971%grid-0%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=39537] [21:08:48] : [Step 4/5] [2021-11-19 21:08:48,127][INFO ][tcp-disco-srvr-[:47500]-#886%grid-0%-#16971%grid-0%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=39537] [21:08:48] : [Step 4/5] [2021-11-19 21:08:48,127][INFO ][tcp-disco-sock-reader-[]-#895%grid-0%-#17093%grid-0%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:39537, rmtPort=39537] [21:08:48] : [Step 4/5] [2021-11-19 21:08:48,128][INFO ][tcp-disco-sock-reader-[100c36d3 127.0.0.1:39537]-#895%grid-0%-#17093%grid-0%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=100c36d3-16b1-4c48-8740-717105362001, rmtAddr=/127.0.0.1:39537] [21:08:48] : [Step 4/5] [2021-11-19 21:08:48,131][INFO ][disco-event-worker-#16973%grid-0%][GridDiscoveryManager] Added new node to topology: TcpDiscoveryNode [id=100c36d3-16b1-4c48-8740-717105362001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637345328102, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false] [21:08:48] : [Step 4/5] [2021-11-19 21:08:48,132][INFO ][disco-event-worker-#16973%grid-0%][GridDiscoveryManager] Topology snapshot [ver=2, locNode=000dfce4, servers=2, clients=0, state=INACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=000dfce4-d7b6-431a-a61c-277e5ca6b000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=100c36d3-16b1-4c48-8740-717105362001, consistentId=grid-1, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:08:48] : [Step 4/5] [2021-11-19 21:08:48,134][INFO ][tcp-disco-msg-worker-[000dfce4 127.0.0.1:47500]-#890%grid-1%-#17088%grid-1%][ClusterProcessor] determined_tu [21:08:48] : [Step 4/5] [2021-11-19 21:08:48,134][INFO ][tcp-disco-msg-worker-[000dfce4 127.0.0.1:47500]-#890%grid-1%-#17088%grid-1%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustEnabled' was changed from 'null' to 'false' [21:08:48] : [Step 4/5] [2021-11-19 21:08:48,135][INFO ][tcp-disco-msg-worker-[000dfce4 127.0.0.1:47500]-#890%grid-1%-#17088%grid-1%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustTimeout' was changed from 'null' to '300000' [21:08:48] : [Step 4/5] [2021-11-19 21:08:48,135][INFO ][tcp-disco-msg-worker-[000dfce4 127.0.0.1:47500]-#890%grid-1%-#17088%grid-1%][IgniteTxManager] Transactions parameter 'longOperationsDumpTimeout' was changed from 'null' to '60000' [21:08:48] : [Step 4/5] [2021-11-19 21:08:48,135][INFO ][tcp-disco-msg-worker-[000dfce4 127.0.0.1:47500]-#890%grid-1%-#17088%grid-1%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpThreshold' was changed from 'null' to '0' [21:08:48] : [Step 4/5] [2021-11-19 21:08:48,136][INFO ][tcp-disco-msg-worker-[000dfce4 127.0.0.1:47500]-#890%grid-1%-#17088%grid-1%][IgniteTxManager] Transactions parameter 'transactionTimeDumpSamplesCoefficient' was changed from 'null' to '0.0' [21:08:48] : [Step 4/5] [2021-11-19 21:08:48,136][INFO ][tcp-disco-msg-worker-[000dfce4 127.0.0.1:47500]-#890%grid-1%-#17088%grid-1%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpSamplesPerSecondLimit' was changed from 'null' to '5' [21:08:48] : [Step 4/5] [2021-11-19 21:08:48,136][INFO ][tcp-disco-msg-worker-[000dfce4 127.0.0.1:47500]-#890%grid-1%-#17088%grid-1%][IgniteTxManager] Transactions parameter 'collisionsDumpInterval' was changed from 'null' to '1000' [21:08:48] : [Step 4/5] [2021-11-19 21:08:48,137][INFO ][tcp-disco-msg-worker-[000dfce4 127.0.0.1:47500]-#890%grid-1%-#17088%grid-1%][IgniteTxManager] Transactions parameter 'txOwnerDumpRequestsAllowed' was changed from 'null' to 'true' [21:08:48] : [Step 4/5] [2021-11-19 21:08:48,137][INFO ][tcp-disco-msg-worker-[000dfce4 127.0.0.1:47500]-#890%grid-1%-#17088%grid-1%][GridCacheDatabaseSharedManager] Historical rebalance WAL threshold changed [property=historical.rebalance.threshold, oldVal=null, newVal=500] [21:08:48] : [Step 4/5] [2021-11-19 21:08:48,138][INFO ][disco-notifier-worker-#17087%grid-1%][MvccProcessorImpl] Assigned mvcc coordinator [crd=MvccCoordinator [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=0], nodeId=000dfce4-d7b6-431a-a61c-277e5ca6b000, ver=1637345326972, local=false, initialized=false]] [21:08:48] : [Step 4/5] [2021-11-19 21:08:48,139][INFO ][sys-#17065%grid-1%][ClusterProcessor] Writing cluster ID and tag to metastorage on ready for write ClusterIdAndTag [id=4bb81d27-c068-44ef-a586-320c607920dd, tag=determined_tu] [21:08:48] : [Step 4/5] [2021-11-19 21:08:48,150][INFO ][test-runner-#16858%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] To start Console Management & Monitoring run ignitevisorcmd.{sh|bat} [21:08:48] : [Step 4/5] [2021-11-19 21:08:48,150][INFO ][test-runner-#16858%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] [21:08:48] : [Step 4/5] [21:08:48] : [Step 4/5] >>> +-------------------------------------------+ [21:08:48] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:08:48] : [Step 4/5] >>> +-------------------------------------------+ [21:08:48] : [Step 4/5] >>> OS name: Linux 4.15.0-151-generic amd64 [21:08:48] : [Step 4/5] >>> CPU(s): 24 [21:08:48] : [Step 4/5] >>> Heap: 2.0GB [21:08:48] : [Step 4/5] >>> VM name: 16724@c4dfe9a430b2 [21:08:48] : [Step 4/5] >>> Ignite instance name: grid-1 [21:08:48] : [Step 4/5] >>> Local node [ID=100C36D3-16B1-4C48-8740-717105362001, order=2, clientMode=false] [21:08:48] : [Step 4/5] >>> Local node addresses: [127.0.0.1] [21:08:48] : [Step 4/5] >>> Local ports: TCP:10801 TCP:47101 TCP:47501 [21:08:48] : [Step 4/5] [21:08:48] : [Step 4/5] [2021-11-19 21:08:48,151][INFO ][test-runner-#16858%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] >>> Ignite cluster is in INACTIVE state (limited functionality available). Use control.(sh|bat) script or IgniteCluster.state(ClusterState.ACTIVE) to change the state. [21:08:48] : [Step 4/5] [2021-11-19 21:08:48,152][INFO ][test-runner-#16858%encryption.MasterKeyChangeTest%][GridDiscoveryManager] Topology snapshot [ver=2, locNode=100c36d3, servers=2, clients=0, state=INACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=000dfce4-d7b6-431a-a61c-277e5ca6b000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=100c36d3-16b1-4c48-8740-717105362001, consistentId=grid-1, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:08:48] : [Step 4/5] [2021-11-19 21:08:48,153][INFO ][test-runner-#16858%encryption.MasterKeyChangeTest%][G] Node started : [stage="Configure system pool" (0 ms),stage="Start managers" (183 ms),stage="Configure binary metadata" (1 ms),stage="Start processors" (440 ms),stage="Start 'StanByClusterTestProvider' plugin" (0 ms),stage="Start 'PageMemory tracker plugin' plugin" (0 ms),stage="Start 'TestDistibutedConfigurationPlugin' plugin" (0 ms),stage="Start 'NodeValidationPluginProvider' plugin" (0 ms),stage="Init metastore" (18 ms),stage="Init and start regions" (7 ms),stage="Restore binary memory" (14 ms),stage="Restore logical state" (68 ms),stage="Finish recovery" (351 ms),stage="Join topology" (45 ms),stage="Await transition" (2 ms),stage="Await exchange" (11 ms),stage="Total time" (1140 ms)] [21:08:48] : [Step 4/5] [2021-11-19 21:08:48,154][INFO ][test-runner-#16858%encryption.MasterKeyChangeTest%][root] Node started with the following configuration [id=100c36d3-16b1-4c48-8740-717105362001, marshaller=BinaryMarshaller [], discovery=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=5000, ackTimeout=5000, marsh=JdkMarshaller [clsFilter=org.apache.ignite.marshaller.MarshallerUtils$1@bff9fa1], reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], binaryCfg=null, lateAff=true] [21:08:48] : [Step 4/5] [2021-11-19 21:08:48,155][INFO ][test-runner-#16858%encryption.MasterKeyChangeTest%][GridClusterStateProcessor] Sending activate cluster request with BaselineTopology BaselineTopology [id=0, branchingHash=-2475315501, branchingType='New BaselineTopology', baselineNodes=[grid-1, grid-0]] [21:08:48] : [Step 4/5] [2021-11-19 21:08:48,159][INFO ][disco-notifier-worker-#16969%grid-0%][GridClusterStateProcessor] Received activate cluster request with BaselineTopology[id=0] initiator node ID: 000dfce4-d7b6-431a-a61c-277e5ca6b000 [21:08:48] : [Step 4/5] [2021-11-19 21:08:48,160][INFO ][disco-notifier-worker-#16969%grid-0%][GridClusterStateProcessor] Started state transition: activate cluster [21:08:48] : [Step 4/5] [2021-11-19 21:08:48,160][INFO ][exchange-worker-#16974%grid-0%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], crd=true, evt=DISCOVERY_CUSTOM_EVT, evtNode=000dfce4-d7b6-431a-a61c-277e5ca6b000, customEvt=ChangeGlobalStateMessage [id=ff46d593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqId=099aa702-bc3a-41ba-96a9-4ed8eb0665ba, initiatingNodeId=000dfce4-d7b6-431a-a61c-277e5ca6b000, state=ACTIVE, baselineTopology=BaselineTopology [id=0, branchingHash=-2475315501, branchingType='New BaselineTopology', baselineNodes=[grid-1, grid-0]], forceChangeBaselineTopology=false, timestamp=1637345328155, forceDeactivation=true], allowMerge=false, exchangeFreeSwitch=false] [21:08:48] : [Step 4/5] [2021-11-19 21:08:48,161][INFO ][disco-notifier-worker-#17087%grid-1%][GridClusterStateProcessor] Received activate cluster request with BaselineTopology[id=0] initiator node ID: 000dfce4-d7b6-431a-a61c-277e5ca6b000 [21:08:48] : [Step 4/5] [2021-11-19 21:08:48,161][INFO ][exchange-worker-#16974%grid-0%][GridDhtPartitionsExchangeFuture] Start activation process [nodeId=000dfce4-d7b6-431a-a61c-277e5ca6b000, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]]. New state: ACTIVE [21:08:48] : [Step 4/5] [2021-11-19 21:08:48,162][INFO ][disco-notifier-worker-#17087%grid-1%][GridClusterStateProcessor] Started state transition: activate cluster [21:08:48] : [Step 4/5] [2021-11-19 21:08:48,162][INFO ][exchange-worker-#16974%grid-0%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0 [21:08:48] : [Step 4/5] [2021-11-19 21:08:48,163][INFO ][exchange-worker-#17096%grid-1%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], crd=false, evt=DISCOVERY_CUSTOM_EVT, evtNode=000dfce4-d7b6-431a-a61c-277e5ca6b000, customEvt=ChangeGlobalStateMessage [id=ff46d593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqId=099aa702-bc3a-41ba-96a9-4ed8eb0665ba, initiatingNodeId=000dfce4-d7b6-431a-a61c-277e5ca6b000, state=ACTIVE, baselineTopology=BaselineTopology [id=0, branchingHash=-2475315501, branchingType='New BaselineTopology', baselineNodes=[grid-1, grid-0]], forceChangeBaselineTopology=false, timestamp=1637345328155, forceDeactivation=true], allowMerge=false, exchangeFreeSwitch=false] [21:08:48] : [Step 4/5] [2021-11-19 21:08:48,166][INFO ][exchange-worker-#16974%grid-0%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000000.wal, offset=8713, ver=2] [21:08:48] : [Step 4/5] [2021-11-19 21:08:48,166][INFO ][exchange-worker-#17096%grid-1%][GridDhtPartitionsExchangeFuture] Start activation process [nodeId=100c36d3-16b1-4c48-8740-717105362001, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]]. New state: ACTIVE [21:08:48] : [Step 4/5] [2021-11-19 21:08:48,168][INFO ][exchange-worker-#16974%grid-0%][GridClusterStateProcessor] Writing BaselineTopology[id=0] [21:08:48] : [Step 4/5] [2021-11-19 21:08:48,168][INFO ][exchange-worker-#17096%grid-1%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1 [21:08:48] : [Step 4/5] [2021-11-19 21:08:48,175][INFO ][exchange-worker-#17096%grid-1%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000000.wal, offset=8713, ver=2] [21:08:48] : [Step 4/5] [2021-11-19 21:08:48,175][INFO ][exchange-worker-#16974%grid-0%][GridCacheDatabaseSharedManager] Finish recovery performed in 12 ms. [21:08:48] : [Step 4/5] [2021-11-19 21:08:48,176][INFO ][exchange-worker-#17096%grid-1%][GridClusterStateProcessor] Writing BaselineTopology[id=0] [21:08:48] : [Step 4/5] [2021-11-19 21:08:48,177][INFO ][exchange-worker-#16974%grid-0%][msg] Components activation performed in 15 ms. [21:08:48] : [Step 4/5] [2021-11-19 21:08:48,179][INFO ][exchange-worker-#16974%grid-0%][GridCacheProcessor] Finished recovery for cache [cache=ignite-sys-cache, grp=ignite-sys-cache, startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:08:48] : [Step 4/5] [2021-11-19 21:08:48,180][INFO ][exchange-worker-#16974%grid-0%][GridDhtPartitionsExchangeFuture] Successfully activated caches [nodeId=000dfce4-d7b6-431a-a61c-277e5ca6b000, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], newState=ACTIVE] [21:08:48] : [Step 4/5] [2021-11-19 21:08:48,181][INFO ][exchange-worker-#16974%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:08:48] : [Step 4/5] [2021-11-19 21:08:48,184][INFO ][exchange-worker-#17096%grid-1%][GridCacheDatabaseSharedManager] Finish recovery performed in 15 ms. [21:08:48] : [Step 4/5] [2021-11-19 21:08:48,185][INFO ][exchange-worker-#17096%grid-1%][msg] Components activation performed in 17 ms. [21:08:48] : [Step 4/5] [2021-11-19 21:08:48,186][INFO ][exchange-worker-#17096%grid-1%][GridCacheProcessor] Finished recovery for cache [cache=ignite-sys-cache, grp=ignite-sys-cache, startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:08:48] : [Step 4/5] [2021-11-19 21:08:48,187][INFO ][exchange-worker-#17096%grid-1%][GridDhtPartitionsExchangeFuture] Successfully activated caches [nodeId=100c36d3-16b1-4c48-8740-717105362001, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], newState=ACTIVE] [21:08:48] : [Step 4/5] [2021-11-19 21:08:48,188][INFO ][exchange-worker-#17096%grid-1%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:08:48] : [Step 4/5] [2021-11-19 21:08:48,191][INFO ][exchange-worker-#16974%grid-0%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], crd=true] [21:08:48] : [Step 4/5] [2021-11-19 21:08:48,194][INFO ][db-checkpoint-thread-#17105%grid-0%][Checkpointer] Checkpoint started [checkpointId=4355ee01-eee6-435f-845a-adda1bb785ec, startPtr=WALPointer [idx=0, fileOff=75212, len=1963], checkpointBeforeLockTime=2ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=1ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=1ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=1ms, pages=18, reason='node started'] [21:08:48] : [Step 4/5] [2021-11-19 21:08:48,213][INFO ][grid-nio-worker-tcp-comm-0-#16913%TestRecordingCommunicationSpi%][TestRecordingCommunicationSpi] Accepted incoming communication connection [locAddr=/127.0.0.1:47100, rmtAddr=/127.0.0.1:56934] [21:08:48] : [Step 4/5] [2021-11-19 21:08:48,216][INFO ][grid-nio-worker-tcp-comm-0-#17031%TestRecordingCommunicationSpi%][TestRecordingCommunicationSpi] Established outgoing communication connection [locAddr=/127.0.0.1:56934, rmtAddr=/127.0.0.1:47100] [21:08:48] : [Step 4/5] [2021-11-19 21:08:48,217][INFO ][exchange-worker-#17096%grid-1%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], crd=false] [21:08:48] : [Step 4/5] [2021-11-19 21:08:48,219][INFO ][sys-#16952%grid-0%][GridDhtPartitionsExchangeFuture] Coordinator received single message [ver=AffinityTopologyVersion [topVer=2, minorTopVer=1], node=100c36d3-16b1-4c48-8740-717105362001, allReceived=true] [21:08:48] : [Step 4/5] [2021-11-19 21:08:48,219][INFO ][sys-#16952%grid-0%][GridDhtPartitionsExchangeFuture] finishExchangeOnCoordinator [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:08:48] : [Step 4/5] [2021-11-19 21:08:48,220][INFO ][db-checkpoint-thread-#17105%grid-0%][Checkpointer] Checkpoint finished [cpId=4355ee01-eee6-435f-845a-adda1bb785ec, pages=18, markPos=WALPointer [idx=0, fileOff=75212, len=1963], walSegmentsCovered=[], markDuration=4ms, pagesWrite=2ms, fsync=24ms, total=32ms] [21:08:48] : [Step 4/5] [2021-11-19 21:08:48,225][INFO ][sys-#16952%grid-0%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], err=null, rebalanced=true, wasRebalanced=false] [21:08:48] : [Step 4/5] [2021-11-19 21:08:48,226][INFO ][sys-#17066%grid-1%][GridDhtPartitionsExchangeFuture] Received full message, will finish exchange [node=000dfce4-d7b6-431a-a61c-277e5ca6b000, resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:08:48] : [Step 4/5] [2021-11-19 21:08:48,229][INFO ][sys-#17066%grid-1%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], err=null, rebalanced=true, wasRebalanced=false] [21:08:48] : [Step 4/5] [2021-11-19 21:08:48,225][INFO ][disco-notifier-worker-#16969%grid-0%][GridClusterStateProcessor] Received state change finish message: ACTIVE [21:08:48] : [Step 4/5] [2021-11-19 21:08:48,230][INFO ][sys-#17078%grid-1%][GridCachePartitionExchangeManager] Delay process full message without exchange id (there is exchange in progress) [nodeId=000dfce4-d7b6-431a-a61c-277e5ca6b000] [21:08:48] : [Step 4/5] [2021-11-19 21:08:48,230][INFO ][sys-#16952%grid-0%][GridCacheProcessor] Finish proxy initialization, cacheName=ignite-sys-cache, localNodeId=000dfce4-d7b6-431a-a61c-277e5ca6b000 [21:08:48] : [Step 4/5] [2021-11-19 21:08:48,229][INFO ][db-checkpoint-thread-#17110%grid-1%][Checkpointer] Checkpoint started [checkpointId=3b4625c3-aff6-4cef-a1ec-4c7a5ce2a47d, startPtr=WALPointer [idx=0, fileOff=79550, len=1963], checkpointBeforeLockTime=1ms, checkpointLockWait=15ms, checkpointListenersExecuteTime=1ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=8ms, writeCheckpointEntryDuration=10ms, splitAndSortCpPagesDuration=0ms, pages=19, reason='node started'] [21:08:48] : [Step 4/5] [2021-11-19 21:08:48,227][INFO ][disco-notifier-worker-#17087%grid-1%][GridClusterStateProcessor] Received state change finish message: ACTIVE [21:08:48] : [Step 4/5] [2021-11-19 21:08:48,234][INFO ][sys-#16952%grid-0%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=000dfce4-d7b6-431a-a61c-277e5ca6b000, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=000dfce4-d7b6-431a-a61c-277e5ca6b000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345328223, loc=true, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:08:48] : [Step 4/5] [2021-11-19 21:08:48,234][INFO ][exchange-worker-#16974%grid-0%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=2, minorTopVer=1], force=false, evt=DISCOVERY_CUSTOM_EVT, node=000dfce4-d7b6-431a-a61c-277e5ca6b000] [21:08:48] : [Step 4/5] [2021-11-19 21:08:48,234][INFO ][sys-#16966%grid-0%][DistributedBaselineConfiguration] Baseline auto-adjust is 'disabled' with timeout='300000' ms [21:08:48] : [Step 4/5] [2021-11-19 21:08:48,238][INFO ][sys-#16966%grid-0%][GridClusterStateProcessor] Successfully performed final activation steps [nodeId=000dfce4-d7b6-431a-a61c-277e5ca6b000, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:08:48] : [Step 4/5] [2021-11-19 21:08:48,233][INFO ][sys-#17066%grid-1%][GridCacheProcessor] Finish proxy initialization, cacheName=ignite-sys-cache, localNodeId=100c36d3-16b1-4c48-8740-717105362001 [21:08:48] : [Step 4/5] [2021-11-19 21:08:48,232][INFO ][disco-notifier-worker-#16969%grid-0%][GridClusterStateProcessor] Cluster state was changed from INACTIVE to ACTIVE [21:08:48] : [Step 4/5] [2021-11-19 21:08:48,240][INFO ][sys-#17083%grid-1%][DistributedBaselineConfiguration] Baseline auto-adjust is 'disabled' with timeout='300000' ms [21:08:48] : [Step 4/5] [2021-11-19 21:08:48,237][INFO ][sys-#16952%grid-0%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (1 ms), stage="Update caches registry" (16 ms), stage="Start caches" (1 ms), stage="Affinity initialization on cache group start" (0 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Restore partition states" (0 ms), stage="After states restored callback" (9 ms), stage="WAL history reservation" (0 ms), stage="Waiting for all single messages" (28 ms), stage="Affinity recalculation (crd)" (0 ms), stage="Collect update counters and create affinity messages" (0 ms), stage="Assign partitions states" (0 ms), stage="Validate partitions states" (0 ms), stage="Ideal affinity diff calculation (enforced)" (0 ms), stage="Apply update counters" (0 ms), stage="Full message preparing" (2 ms), stage="Full message sending" (0 ms), stage="State finish message sending" (0 ms), stage="Detect lost partitions" (4 ms), stage="Exchange done" (8 ms), stage="Total time" (69 ms), Discovery lag=2 ms, Latest started node id=100c36d3-16b1-4c48-8740-717105362001] [21:08:48] : [Step 4/5] [2021-11-19 21:08:48,235][INFO ][disco-notifier-worker-#17087%grid-1%][GridClusterStateProcessor] Cluster state was changed from INACTIVE to ACTIVE [21:08:48] : [Step 4/5] [2021-11-19 21:08:48,241][INFO ][sys-#17066%grid-1%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=100c36d3-16b1-4c48-8740-717105362001, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=000dfce4-d7b6-431a-a61c-277e5ca6b000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345328122, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:08:48] : [Step 4/5] [2021-11-19 21:08:48,241][INFO ][test-runner-#16858%encryption.MasterKeyChangeTest%][root] awaitPartitionMapExchange finished [21:08:48] : [Step 4/5] [2021-11-19 21:08:48,241][INFO ][sys-#17083%grid-1%][GridClusterStateProcessor] Successfully performed final activation steps [nodeId=100c36d3-16b1-4c48-8740-717105362001, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:08:48] : [Step 4/5] [2021-11-19 21:08:48,241][INFO ][exchange-worker-#17096%grid-1%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=2, minorTopVer=1], force=false, evt=DISCOVERY_CUSTOM_EVT, node=000dfce4-d7b6-431a-a61c-277e5ca6b000] [21:08:48] : [Step 4/5] [2021-11-19 21:08:48,246][INFO ][sys-#16952%grid-0%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], stage="Affinity initialization on cache group start [grp=ignite-sys-cache]" (0 ms) (parent=Affinity initialization on cache group start), stage="Affinity centralized initialization (crd) [grp=ignite-sys-cache, crd=true]" (0 ms) (parent=Determine exchange type), stage="Restore partition states [grp=ignite-sys-cache]" (0 ms) (parent=Restore partition states), stage="Affinity recalculation (partitions availability) [grp=ignite-sys-cache]" (0 ms) (parent=Ideal affinity diff calculation (enforced))] [21:08:48] : [Step 4/5] [2021-11-19 21:08:48,246][INFO ][sys-#17066%grid-1%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (3 ms), stage="Update caches registry" (19 ms), stage="Start caches" (0 ms), stage="Affinity initialization on cache group start" (0 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Restore partition states" (0 ms), stage="After states restored callback" (22 ms), stage="WAL history reservation" (0 ms), stage="Waiting for Full message" (14 ms), stage="Affinity recalculation" (2 ms), stage="Full map updating" (0 ms), stage="Detect lost partitions" (3 ms), stage="Exchange done" (13 ms), stage="Total time" (76 ms)] [21:08:48] : [Step 4/5] [2021-11-19 21:08:48,250][INFO ][sys-#17066%grid-1%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], stage="Affinity initialization on cache group start [grp=ignite-sys-cache]" (0 ms) (parent=Affinity initialization on cache group start), stage="Affinity centralized initialization (crd) [grp=ignite-sys-cache, crd=false]" (0 ms) (parent=Determine exchange type), stage="Restore partition states [grp=ignite-sys-cache]" (0 ms) (parent=Restore partition states), stage="Affinity applying from full message [grp=ignite-sys-cache]" (2 ms) (parent=Affinity recalculation)] [21:08:48] : [Step 4/5] [2021-11-19 21:08:48,255][INFO ][db-checkpoint-thread-#17110%grid-1%][Checkpointer] Checkpoint finished [cpId=3b4625c3-aff6-4cef-a1ec-4c7a5ce2a47d, pages=19, markPos=WALPointer [idx=0, fileOff=79550, len=1963], walSegmentsCovered=[], markDuration=25ms, pagesWrite=1ms, fsync=19ms, total=61ms] [21:08:48] : [Step 4/5] [2021-11-19 21:08:48,263][INFO ][exchange-worker-#17096%grid-1%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], crd=false, evt=DISCOVERY_CUSTOM_EVT, evtNode=000dfce4-d7b6-431a-a61c-277e5ca6b000, customEvt=DynamicCacheChangeBatch [id=3256d593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqs=ArrayList [DynamicCacheChangeRequest [cacheName=encrypted, hasCfg=true, nodeId=000dfce4-d7b6-431a-a61c-277e5ca6b000, clientStartOnly=false, stop=false, destroy=false, disabledAfterStart=false]], exchangeActions=ExchangeActions [startCaches=[encrypted], stopCaches=null, startGrps=[encrypted], stopGrps=[], resetParts=null, stateChangeRequest=null], startCaches=false], allowMerge=false, exchangeFreeSwitch=false] [21:08:48] : [Step 4/5] [2021-11-19 21:08:48,263][INFO ][exchange-worker-#16974%grid-0%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], crd=true, evt=DISCOVERY_CUSTOM_EVT, evtNode=000dfce4-d7b6-431a-a61c-277e5ca6b000, customEvt=DynamicCacheChangeBatch [id=3256d593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqs=ArrayList [DynamicCacheChangeRequest [cacheName=encrypted, hasCfg=true, nodeId=000dfce4-d7b6-431a-a61c-277e5ca6b000, clientStartOnly=false, stop=false, destroy=false, disabledAfterStart=false]], exchangeActions=ExchangeActions [startCaches=[encrypted], stopCaches=null, startGrps=[encrypted], stopGrps=[], resetParts=null, stateChangeRequest=null], startCaches=false], allowMerge=false, exchangeFreeSwitch=false] [21:08:48] : [Step 4/5] [2021-11-19 21:08:48,265][INFO ][exchange-worker-#17096%grid-1%][PageMemoryImpl] Started page memory [memoryAllocated=24.0 MiB, pages=5952, tableSize=474.2 KiB, replacementSize=768 B, checkpointBuffer=10.0 MiB] [21:08:48] : [Step 4/5] [2021-11-19 21:08:48,268][INFO ][exchange-worker-#16974%grid-0%][PageMemoryImpl] Started page memory [memoryAllocated=24.0 MiB, pages=5952, tableSize=474.2 KiB, replacementSize=768 B, checkpointBuffer=10.0 MiB] [21:08:48] : [Step 4/5] [2021-11-19 21:08:48,339][INFO ][exchange-worker-#17096%grid-1%][GridCacheProcessor] Started cache [name=encrypted, id=1613773252, dataRegionName=default, mode=PARTITIONED, atomicity=ATOMIC, backups=0, mvcc=false] [21:08:48]W: [org.apache.ignite:ignite-core] [2021-11-19 21:08:48,342][WARN ][exchange-worker-#17096%grid-1%][CacheAffinitySharedManager] Cache group 'encrypted' brings high overhead for its metainformation in data region 'default'. Metainformation required for its partitions (522 partitions, 4096 bytes per partition, 2 MBs total) will consume more than 15% of data region memory (10 MBs). It may lead to critical errors on the node and cluster instability. Please reduce number of partitions, add more memory to the data region or add more server nodes for this cache group. [21:08:48] : [Step 4/5] [2021-11-19 21:08:48,342][INFO ][exchange-worker-#16974%grid-0%][GridCacheProcessor] Started cache [name=encrypted, id=1613773252, dataRegionName=default, mode=PARTITIONED, atomicity=ATOMIC, backups=0, mvcc=false] [21:08:48] : [Step 4/5] [2021-11-19 21:08:48,343][INFO ][exchange-worker-#17096%grid-1%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], waitTime=0ms, futInfo=NA, mode=DISTRIBUTED] [21:08:48]W: [org.apache.ignite:ignite-core] [2021-11-19 21:08:48,344][WARN ][exchange-worker-#16974%grid-0%][CacheAffinitySharedManager] Cache group 'encrypted' brings high overhead for its metainformation in data region 'default'. Metainformation required for its partitions (502 partitions, 4096 bytes per partition, 1 MBs total) will consume more than 15% of data region memory (10 MBs). It may lead to critical errors on the node and cluster instability. Please reduce number of partitions, add more memory to the data region or add more server nodes for this cache group. [21:08:48] : [Step 4/5] [2021-11-19 21:08:48,345][INFO ][exchange-worker-#16974%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], waitTime=0ms, futInfo=NA, mode=DISTRIBUTED] [21:08:48] : [Step 4/5] [2021-11-19 21:08:48,346][INFO ][exchange-worker-#16974%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partitions release latch: ServerLatch [permits=0, pendingAcks=HashSet [], super=CompletableLatch [id=CompletableLatchUid [id=exchange, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2]]]] [21:08:48] : [Step 4/5] [2021-11-19 21:08:48,346][INFO ][exchange-worker-#17096%grid-1%][GridDhtPartitionsExchangeFuture] Finished waiting for partitions release latch: ClientLatch [coordinator=TcpDiscoveryNode [id=000dfce4-d7b6-431a-a61c-277e5ca6b000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345328122, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], ackSent=true, super=CompletableLatch [id=CompletableLatchUid [id=exchange, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2]]]] [21:08:48] : [Step 4/5] [2021-11-19 21:08:48,346][INFO ][exchange-worker-#16974%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:08:48] : [Step 4/5] [2021-11-19 21:08:48,347][INFO ][exchange-worker-#17096%grid-1%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:08:48] : [Step 4/5] [2021-11-19 21:08:48,388][INFO ][exchange-worker-#16974%grid-0%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], crd=true] [21:08:48] : [Step 4/5] [2021-11-19 21:08:48,392][INFO ][exchange-worker-#17096%grid-1%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], crd=false] [21:08:48] : [Step 4/5] [2021-11-19 21:08:48,393][INFO ][sys-#16950%grid-0%][GridDhtPartitionsExchangeFuture] Coordinator received single message [ver=AffinityTopologyVersion [topVer=2, minorTopVer=2], node=100c36d3-16b1-4c48-8740-717105362001, allReceived=true] [21:08:48] : [Step 4/5] [2021-11-19 21:08:48,394][INFO ][sys-#16950%grid-0%][GridDhtPartitionsExchangeFuture] finishExchangeOnCoordinator [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2]] [21:08:48] : [Step 4/5] [2021-11-19 21:08:48,399][INFO ][sys-#16950%grid-0%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], err=null, rebalanced=true, wasRebalanced=true] [21:08:48] : [Step 4/5] [2021-11-19 21:08:48,400][INFO ][sys-#17086%grid-1%][GridDhtPartitionsExchangeFuture] Received full message, will finish exchange [node=000dfce4-d7b6-431a-a61c-277e5ca6b000, resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2]] [21:08:48] : [Step 4/5] [2021-11-19 21:08:48,401][INFO ][sys-#16950%grid-0%][GridCacheProcessor] Finish proxy initialization, cacheName=encrypted, localNodeId=000dfce4-d7b6-431a-a61c-277e5ca6b000 [21:08:48] : [Step 4/5] [2021-11-19 21:08:48,403][INFO ][sys-#17086%grid-1%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], err=null, rebalanced=true, wasRebalanced=true] [21:08:48] : [Step 4/5] [2021-11-19 21:08:48,403][INFO ][sys-#16950%grid-0%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=000dfce4-d7b6-431a-a61c-277e5ca6b000, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=000dfce4-d7b6-431a-a61c-277e5ca6b000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345328243, loc=true, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2]] [21:08:48] : [Step 4/5] [2021-11-19 21:08:48,405][INFO ][exchange-worker-#16974%grid-0%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=2, minorTopVer=2], force=false, evt=DISCOVERY_CUSTOM_EVT, node=000dfce4-d7b6-431a-a61c-277e5ca6b000] [21:08:48] : [Step 4/5] [2021-11-19 21:08:48,404][INFO ][sys-#17086%grid-1%][GridCacheProcessor] Finish proxy initialization, cacheName=encrypted, localNodeId=100c36d3-16b1-4c48-8740-717105362001 [21:08:48] : [Step 4/5] [2021-11-19 21:08:48,405][INFO ][sys-#16950%grid-0%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (2 ms), stage="Update caches registry" (0 ms), stage="Start caches" (76 ms), stage="Affinity initialization on cache group start" (2 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Wait partitions release latch [latch=exchange]" (0 ms), stage="Wait partitions release [latch=exchange]" (1 ms), stage="Restore partition states" (11 ms), stage="After states restored callback" (27 ms), stage="WAL history reservation" (0 ms), stage="Waiting for all single messages" (6 ms), stage="Affinity recalculation (crd)" (0 ms), stage="Collect update counters and create affinity messages" (0 ms), stage="Assign partitions states" (1 ms), stage="Validate partitions states" (0 ms), stage="Apply update counters" (0 ms), stage="Full message preparing" (2 ms), stage="Full message sending" (0 ms), stage="Exchange done" (5 ms), stage="Total time" (133 ms)] [21:08:48] : [Step 4/5] [2021-11-19 21:08:48,406][INFO ][exchange-worker-#17096%grid-1%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=2, minorTopVer=2], force=false, evt=DISCOVERY_CUSTOM_EVT, node=000dfce4-d7b6-431a-a61c-277e5ca6b000] [21:08:48] : [Step 4/5] [2021-11-19 21:08:48,406][INFO ][sys-#17086%grid-1%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=100c36d3-16b1-4c48-8740-717105362001, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=000dfce4-d7b6-431a-a61c-277e5ca6b000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345328122, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2]] [21:08:48] : [Step 4/5] [2021-11-19 21:08:48,406][INFO ][test-runner-#16858%encryption.MasterKeyChangeTest%][GridCacheProcessor] Failed to wait proxy initialization, cache=encrypted, localNodeId=100c36d3-16b1-4c48-8740-717105362001 [21:08:48] : [Step 4/5] [2021-11-19 21:08:48,409][INFO ][sys-#17086%grid-1%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (1 ms), stage="Update caches registry" (0 ms), stage="Start caches" (74 ms), stage="Affinity initialization on cache group start" (2 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Wait partitions release latch [latch=exchange]" (4 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Restore partition states" (11 ms), stage="After states restored callback" (31 ms), stage="WAL history reservation" (0 ms), stage="Waiting for Full message" (8 ms), stage="Affinity recalculation" (0 ms), stage="Full map updating" (2 ms), stage="Exchange done" (5 ms), stage="Total time" (138 ms)] [21:08:48] : [Step 4/5] [2021-11-19 21:08:48,408][INFO ][sys-#16950%grid-0%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], stage="Affinity initialization on cache group start [grp=encrypted]" (1 ms) (parent=Affinity initialization on cache group start), stage="Restore partition states [grp=encrypted]" (11 ms) (parent=Restore partition states), stage="Restore partition states [grp=ignite-sys-cache]" (0 ms) (parent=Restore partition states)] [21:08:48] : [Step 4/5] [2021-11-19 21:08:48,411][INFO ][sys-#17086%grid-1%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], stage="Affinity initialization on cache group start [grp=encrypted]" (1 ms) (parent=Affinity initialization on cache group start), stage="Restore partition states [grp=encrypted]" (11 ms) (parent=Restore partition states), stage="Restore partition states [grp=ignite-sys-cache]" (0 ms) (parent=Restore partition states)] [21:08:49] : [Step 4/5] [2021-11-19 21:08:49,924][INFO ][test-runner-#16858%encryption.MasterKeyChangeTest%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:08:50] : [Step 4/5] [2021-11-19 21:08:50,079][INFO ][disco-notifier-worker-#16969%grid-0%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:08:50] : [Step 4/5] [2021-11-19 21:08:50,079][INFO ][disco-notifier-worker-#17087%grid-1%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:08:50] : [Step 4/5] [2021-11-19 21:08:50,220][INFO ][disco-notifier-worker-#17087%grid-1%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:08:50] : [Step 4/5] [2021-11-19 21:08:50,223][INFO ][disco-notifier-worker-#16969%grid-0%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:08:50] : [Step 4/5] [2021-11-19 21:08:50,308][INFO ][disco-notifier-worker-#17087%grid-1%][IgniteTestResources] Block message [node=000dfce4-d7b6-431a-a61c-277e5ca6b000, order=1, msg=org.apache.ignite.internal.util.distributed.SingleNodeMessage@6f4b1ab2] [21:08:50]W: [org.apache.ignite:ignite-core] [2021-11-19 21:08:50,314][WARN ][test-runner-#16858%encryption.MasterKeyChangeTest%][G] Ignite work directory is not provided, automatically resolved to: /opt/buildagent/work/7bc1c54bc719b67c/work [21:08:50] : [Step 4/5] [2021-11-19 21:08:50,316][INFO ][test-runner-#16858%encryption.MasterKeyChangeTest%][MasterKeyChangeTest3] [21:08:50] : [Step 4/5] [21:08:50] : [Step 4/5] >>> __________ ________________ [21:08:50] : [Step 4/5] >>> / _/ ___/ |/ / _/_ __/ __/ [21:08:50] : [Step 4/5] >>> _/ // (7 7 // / / / / _/ [21:08:50] : [Step 4/5] >>> /___/\___/_/|_/___/ /_/ /___/ [21:08:50] : [Step 4/5] >>> [21:08:50] : [Step 4/5] >>> ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:08:50] : [Step 4/5] >>> 2021 Copyright(C) Apache Software Foundation [21:08:50] : [Step 4/5] >>> [21:08:50] : [Step 4/5] >>> Ignite documentation: http://ignite.apache.org [21:08:50] : [Step 4/5] [21:08:50] : [Step 4/5] [2021-11-19 21:08:50,317][INFO ][test-runner-#16858%encryption.MasterKeyChangeTest%][MasterKeyChangeTest3] Config URL: n/a [21:08:50] : [Step 4/5] [2021-11-19 21:08:50,317][INFO ][test-runner-#16858%encryption.MasterKeyChangeTest%][MasterKeyChangeTest3] IgniteConfiguration [igniteInstanceName=encryption.MasterKeyChangeTest3, pubPoolSize=24, svcPoolSize=24, callbackPoolSize=24, stripedPoolSize=24, sysPoolSize=24, mgmtPoolSize=4, dataStreamerPoolSize=24, utilityCachePoolSize=24, utilityCacheKeepAliveTime=60000, p2pPoolSize=2, qryPoolSize=24, buildIdxPoolSize=4, igniteHome=/opt/buildagent/work/7bc1c54bc719b67c, igniteWorkDir=/opt/buildagent/work/7bc1c54bc719b67c/work, mbeanSrv=com.sun.jmx.mbeanserver.JmxMBeanServer@6fe85038, nodeId=386595f6-9ee5-443a-8fb1-a62067500003, marsh=BinaryMarshaller [], marshLocJobs=false, daemon=false, p2pEnabled=true, netTimeout=10000, netCompressionLevel=1, sndRetryDelay=1000, sndRetryCnt=3, metricsHistSize=10000, metricsUpdateFreq=1000, metricsExpTime=9223372036854775807, discoSpi=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=0, ackTimeout=0, marsh=null, reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], segPlc=STOP, segResolveAttempts=2, waitForSegOnStart=true, allResolversPassReq=true, segChkFreq=10000, commSpi=TcpCommunicationSpi [connectGate=org.apache.ignite.spi.communication.tcp.internal.ConnectGateway@5b630c01, ctxInitLatch=java.util.concurrent.CountDownLatch@b0a07df[Count = 1], stopping=false, clientPool=null, nioSrvWrapper=null, stateProvider=null], evtSpi=MemoryEventStorageSpi [expireAgeMs=9223372036854775807, expireCnt=10000, filter=null], colSpi=NoopCollisionSpi [], deploySpi=LocalDeploymentSpi [], indexingSpi=org.apache.ignite.spi.indexing.noop.NoopIndexingSpi@1a7b3cdc, addrRslvr=null, encryptionSpi=org.apache.ignite.spi.encryption.keystore.KeystoreEncryptionSpi@2882f36, tracingSpi=org.apache.ignite.spi.tracing.NoopTracingSpi@273d4f86, clientMode=false, rebalanceThreadPoolSize=4, rebalanceTimeout=10000, rebalanceBatchesPrefetchCnt=3, rebalanceThrottle=0, rebalanceBatchSize=524288, txCfg=TransactionConfiguration [txSerEnabled=false, dfltIsolation=REPEATABLE_READ, dfltConcurrency=PESSIMISTIC, dfltTxTimeout=0, txTimeoutOnPartitionMapExchange=0, deadlockTimeout=10000, pessimisticTxLogSize=0, pessimisticTxLogLinger=10000, tmLookupClsName=null, txManagerFactory=null, useJtaSync=false], cacheSanityCheckEnabled=true, discoStartupDelay=60000, deployMode=SHARED, p2pMissedCacheSize=100, locHost=127.0.0.1, timeSrvPortBase=31100, timeSrvPortRange=100, failureDetectionTimeout=10000, sysWorkerBlockedTimeout=null, clientFailureDetectionTimeout=10000, metricsLogFreq=0, connectorCfg=null, odbcCfg=null, warmupClos=null, atomicCfg=AtomicConfiguration [seqReserveSize=1000, cacheMode=PARTITIONED, backups=1, aff=null, grpName=null], classLdr=null, sslCtxFactory=null, platformCfg=null, binaryCfg=null, memCfg=null, pstCfg=null, dsCfg=DataStorageConfiguration [sysRegionInitSize=41943040, sysRegionMaxSize=104857600, pageSize=4096, concLvl=0, dfltDataRegConf=DataRegionConfiguration [name=default, maxSize=10485760, initSize=268435456, swapPath=null, pageEvictionMode=DISABLED, pageReplacementMode=CLOCK, evictionThreshold=0.9, emptyPagesPoolSize=100, metricsEnabled=false, metricsSubIntervalCount=5, metricsRateTimeInterval=60000, persistenceEnabled=true, checkpointPageBufSize=0, lazyMemoryAllocation=true, warmUpCfg=null], dataRegions=null, storagePath=null, checkpointFreq=180000, lockWaitTime=10000, checkpointThreads=4, checkpointWriteOrder=SEQUENTIAL, walHistSize=20, maxWalArchiveSize=1073741824, walSegments=10, walSegmentSize=67108864, walPath=db/wal, walArchivePath=db/wal/archive, cdcWalPath=db/wal/cdc, cdcEnabled=false, metricsEnabled=false, walMode=FSYNC, walTlbSize=131072, walBuffSize=0, walFlushFreq=2000, walFsyncDelay=1000, walRecordIterBuffSize=67108864, alwaysWriteFullPages=false, fileIOFactory=org.apache.ignite.internal.processors.cache.persistence.file.AsyncFileIOFactory@1048d42b, metricsSubIntervalCnt=5, metricsRateTimeInterval=60000, walAutoArchiveAfterInactivity=-1, walForceArchiveTimeout=-1, writeThrottlingEnabled=false, walCompactionEnabled=false, walCompactionLevel=1, checkpointReadLockTimeout=null, walPageCompression=DISABLED, walPageCompressionLevel=null, dfltWarmUpCfg=null, encCfg=org.apache.ignite.configuration.EncryptionConfiguration@1161513d, defragmentationThreadPoolSize=4, minWalArchiveSize=-1], snapshotPath=snapshots, activeOnStart=true, activeOnStartPropSetFlag=false, autoActivation=true, autoActivationPropSetFlag=false, clusterStateOnStart=null, sqlConnCfg=null, cliConnCfg=ClientConnectorConfiguration [host=null, port=10800, portRange=100, sockSndBufSize=0, sockRcvBufSize=0, tcpNoDelay=true, maxOpenCursorsPerConn=128, threadPoolSize=24, selectorCnt=12, idleTimeout=0, handshakeTimeout=10000, jdbcEnabled=true, odbcEnabled=true, thinCliEnabled=true, sslEnabled=false, useIgniteSslCtxFactory=true, sslClientAuth=false, sslCtxFactory=null, thinCliCfg=ThinClientConfiguration [maxActiveTxPerConn=100, maxActiveComputeTasksPerConn=0]], mvccVacuumThreadCnt=2, mvccVacuumFreq=5000, authEnabled=false, failureHnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]], commFailureRslvr=null, sqlCfg=SqlConfiguration [longQryWarnTimeout=3000, dfltQryTimeout=0, sqlQryHistSize=1000, validationEnabled=false], asyncContinuationExecutor=null] [21:08:50] : [Step 4/5] [2021-11-19 21:08:50,328][INFO ][test-runner-#16858%encryption.MasterKeyChangeTest%][MasterKeyChangeTest3] Daemon mode: off [21:08:50] : [Step 4/5] [2021-11-19 21:08:50,328][INFO ][test-runner-#16858%encryption.MasterKeyChangeTest%][MasterKeyChangeTest3] OS: Linux 4.15.0-151-generic amd64 [21:08:50] : [Step 4/5] [2021-11-19 21:08:50,328][INFO ][test-runner-#16858%encryption.MasterKeyChangeTest%][MasterKeyChangeTest3] OS user: teamcity [21:08:50] : [Step 4/5] [2021-11-19 21:08:50,328][INFO ][test-runner-#16858%encryption.MasterKeyChangeTest%][MasterKeyChangeTest3] PID: 16724 [21:08:50] : [Step 4/5] [2021-11-19 21:08:50,329][INFO ][test-runner-#16858%encryption.MasterKeyChangeTest%][MasterKeyChangeTest3] Language runtime: Java Platform API Specification ver. 1.8 [21:08:50] : [Step 4/5] [2021-11-19 21:08:50,329][INFO ][test-runner-#16858%encryption.MasterKeyChangeTest%][MasterKeyChangeTest3] VM information: Java(TM) SE Runtime Environment 1.8.0_261-b12 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 25.261-b12 [21:08:50] : [Step 4/5] [2021-11-19 21:08:50,329][INFO ][test-runner-#16858%encryption.MasterKeyChangeTest%][MasterKeyChangeTest3] VM total memory: 1.9GB [21:08:50] : [Step 4/5] [2021-11-19 21:08:50,330][INFO ][test-runner-#16858%encryption.MasterKeyChangeTest%][MasterKeyChangeTest3] Remote Management [restart: off, REST: off, JMX (remote: off)] [21:08:50] : [Step 4/5] [2021-11-19 21:08:50,330][INFO ][test-runner-#16858%encryption.MasterKeyChangeTest%][MasterKeyChangeTest3] Logger: GridTestLog4jLogger [quiet=false, config=null] [21:08:50] : [Step 4/5] [2021-11-19 21:08:50,330][INFO ][test-runner-#16858%encryption.MasterKeyChangeTest%][MasterKeyChangeTest3] IGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c [21:08:50] : [Step 4/5] [2021-11-19 21:08:50,331][INFO ][test-runner-#16858%encryption.MasterKeyChangeTest%][MasterKeyChangeTest3] VM arguments: [-DIGNITE_DUMP_THREADS_ON_FAILURE=false, -DMono=/usr/bin/mono-sgen, -DMono4.0_x64=/usr/lib/mono/4.0, -DMono4.5_x64=/usr/lib/mono/4.5, -DMonoVersion=6.12.0.90, -DSKIP_BUILD=false, -Dagent.home.dir=/opt/buildagent, -Dagent.name=aitc-lin02_03, -Dagent.ownPort=9090, -Dagent.work.dir=/opt/buildagent/work, -Dbuild.number=95, -Dbuild.vcs.number=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.1=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.GitHubApacheIgnite=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dclassworlds.conf=/opt/buildagent/temp/buildTmp/teamcity.m2.conf, -Dcom.jetbrains.maven.watcher.report.file=/opt/buildagent/temp/buildTmp/maven-build-info.xml, -Djava.io.tmpdir=/opt/buildagent/temp/buildTmp, -Dmaven.home=/opt/buildagent/tools/maven3_6, -Dmaven.multiModuleProjectDirectory=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.agent.cpuBenchmark=457, -Dteamcity.agent.dotnet.agent_url=http://localhost:9090/RPC2, -Dteamcity.agent.dotnet.build_id=6278078, -Dteamcity.auth.password=*******, -Dteamcity.auth.userId=TeamCityBuildId=6278078, -Dteamcity.build.changedFiles.file=/opt/buildagent/temp/buildTmp/changedFiles6342607772318147725.txt, -Dteamcity.build.checkoutDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.build.id=6278078, -Dteamcity.build.properties.file=/opt/buildagent/temp/buildTmp/teamcity.build5164517880467851002.properties, -Dteamcity.build.tempDir=/opt/buildagent/temp/buildTmp, -Dteamcity.build.workingDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.buildConfName=Basic 3, -Dteamcity.buildType.id=IgniteTests24Java8_Basic3, -Dteamcity.configuration.properties.file=/opt/buildagent/temp/buildTmp/teamcity.config5591980786735343870.properties, -Dteamcity.maven.userSettings.path=/opt/buildagent/temp/buildTmp/maven_settings_585072866407032347.xml, -Dteamcity.maven.watcher.home=/opt/buildagent/plugins/mavenPlugin/maven-watcher-jdk16, -Dteamcity.projectName=Ignite Tests 2.x (JDK 8/11), -Dteamcity.runner.properties.file=/opt/buildagent/temp/buildTmp/teamcity.runner9098465561618137420.properties, -Dteamcity.tests.recentlyFailedTests.file=/opt/buildagent/temp/buildTmp/testsToRunFirst3891775683130404069.txt, -Dteamcity.version=2021.2 (build 99542), -ea, -Xms2g, -Xmx2g, -XX:+HeapDumpOnOutOfMemoryError, -DIGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_TEST_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_UPDATE_NOTIFIER=false, -DIGNITE_NO_DISCO_ORDER=true, -DIGNITE_PERFORMANCE_SUGGESTIONS_DISABLED=true, -Djava.net.preferIPv4Stack=true, -DTEST_SCALE_FACTOR=1.0, -DIGNITE_TEST_PROP_LOG4J_FILE=log4j-tc-test.xml, -DIGNITE_QUIET=false, -DIGNITE_MARSHAL_BUFFERS_RECHECK=1000, -Dmaven.repo.local=/opt/buildagent/.m2/repository] [21:08:50] : [Step 4/5] [2021-11-19 21:08:50,335][INFO ][test-runner-#16858%encryption.MasterKeyChangeTest%][MasterKeyChangeTest3] System cache's DataRegion size is configured to 40 MB. Use DataStorageConfiguration.systemRegionInitialSize property to change the setting. [21:08:50] : [Step 4/5] [2021-11-19 21:08:50,335][INFO ][test-runner-#16858%encryption.MasterKeyChangeTest%][MasterKeyChangeTest3] Configured caches [in 'sysMemPlc' dataRegion: ['ignite-sys-cache']] [21:08:50]W: [org.apache.ignite:ignite-core] [2021-11-19 21:08:50,336][WARN ][test-runner-#16858%encryption.MasterKeyChangeTest%][MasterKeyChangeTest3] Peer class loading is enabled (disable it in production for performance and deployment consistency reasons) [21:08:50] : [Step 4/5] [2021-11-19 21:08:50,336][INFO ][test-runner-#16858%encryption.MasterKeyChangeTest%][MasterKeyChangeTest3] 3-rd party licenses can be found at: /opt/buildagent/work/7bc1c54bc719b67c/libs/licenses [21:08:50] : [Step 4/5] [2021-11-19 21:08:50,341][INFO ][test-runner-#16858%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] Configured plugins: [21:08:50] : [Step 4/5] [2021-11-19 21:08:50,341][INFO ][test-runner-#16858%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] ^-- StanByClusterTestProvider 1.0 [21:08:50] : [Step 4/5] [2021-11-19 21:08:50,341][INFO ][test-runner-#16858%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:08:50] : [Step 4/5] [2021-11-19 21:08:50,341][INFO ][test-runner-#16858%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] [21:08:50] : [Step 4/5] [2021-11-19 21:08:50,342][INFO ][test-runner-#16858%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] ^-- PageMemory tracker plugin 1.0 [21:08:50] : [Step 4/5] [2021-11-19 21:08:50,342][INFO ][test-runner-#16858%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:08:50] : [Step 4/5] [2021-11-19 21:08:50,342][INFO ][test-runner-#16858%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] [21:08:50] : [Step 4/5] [2021-11-19 21:08:50,342][INFO ][test-runner-#16858%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] ^-- TestDistibutedConfigurationPlugin 1.0 [21:08:50] : [Step 4/5] [2021-11-19 21:08:50,343][INFO ][test-runner-#16858%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:08:50] : [Step 4/5] [2021-11-19 21:08:50,343][INFO ][test-runner-#16858%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] [21:08:50] : [Step 4/5] [2021-11-19 21:08:50,343][INFO ][test-runner-#16858%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] ^-- NodeValidationPluginProvider 1.0 [21:08:50] : [Step 4/5] [2021-11-19 21:08:50,343][INFO ][test-runner-#16858%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:08:50] : [Step 4/5] [2021-11-19 21:08:50,343][INFO ][test-runner-#16858%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] [21:08:50] : [Step 4/5] [2021-11-19 21:08:50,344][INFO ][test-runner-#16858%encryption.MasterKeyChangeTest%][FailureProcessor] Configured failure handler: [hnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]]] [21:08:50] : [Step 4/5] [2021-11-19 21:08:50,355][INFO ][test-runner-#16858%encryption.MasterKeyChangeTest%][TestRecordingCommunicationSpi] Successfully bound communication NIO server to TCP port [port=47102, locHost=/127.0.0.1, selectorsCnt=12, selectorSpins=0, pairedConn=false] [21:08:50]W: [org.apache.ignite:ignite-core] [2021-11-19 21:08:50,355][WARN ][test-runner-#16858%encryption.MasterKeyChangeTest%][TestRecordingCommunicationSpi] Message queue limit is set to 0 which may lead to potential OOMEs when running cache operations in FULL_ASYNC or PRIMARY_SYNC modes due to message queues growth on sender and receiver sides. [21:08:50] : [Step 4/5] [2021-11-19 21:08:50,359][INFO ][test-runner-#16858%encryption.MasterKeyChangeTest%][GridCollisionManager] Collision resolution is disabled (all jobs will be activated upon arrival). [21:08:50] : [Step 4/5] [2021-11-19 21:08:50,359][INFO ][test-runner-#16858%encryption.MasterKeyChangeTest%][MasterKeyChangeTest3] Security status [authentication=off, sandbox=off, tls/ssl=off] [21:08:50] : [Step 4/5] [2021-11-19 21:08:50,415][INFO ][test-runner-#16858%encryption.MasterKeyChangeTest%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:08:50] : [Step 4/5] [2021-11-19 21:08:50,539][INFO ][test-runner-#16858%encryption.MasterKeyChangeTest%][MaintenanceProcessor] Resolved store directory for node persistent data: /opt/buildagent/work/7bc1c54bc719b67c/work/db/encryption_MasterKeyChangeTest3 [21:08:50] : [Step 4/5] [2021-11-19 21:08:50,540][INFO ][test-runner-#16858%encryption.MasterKeyChangeTest%][CacheObjectBinaryProcessorImpl] Resolved directory for serialized binary metadata: /opt/buildagent/work/7bc1c54bc719b67c/work/db/binary_meta/encryption_MasterKeyChangeTest3 [21:08:50] : [Step 4/5] [2021-11-19 21:08:50,544][INFO ][test-runner-#16858%encryption.MasterKeyChangeTest%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/encryption_MasterKeyChangeTest3 [21:08:50] : [Step 4/5] [2021-11-19 21:08:50,544][INFO ][test-runner-#16858%encryption.MasterKeyChangeTest%][FileWriteAheadLogManager] Resolved write ahead log work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/encryption_MasterKeyChangeTest3 [21:08:50] : [Step 4/5] [2021-11-19 21:08:50,545][INFO ][test-runner-#16858%encryption.MasterKeyChangeTest%][FileWriteAheadLogManager] Resolved write ahead log archive directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/encryption_MasterKeyChangeTest3 [21:08:51] : [Step 4/5] [2021-11-19 21:08:51,569][INFO ][test-runner-#16858%encryption.MasterKeyChangeTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/encryption_MasterKeyChangeTest3/0000000000000000.wal [21:08:51] : [Step 4/5] [2021-11-19 21:08:51,576][INFO ][test-runner-#16858%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Configured data regions initialized successfully [total=5] [21:08:51] : [Step 4/5] [2021-11-19 21:08:51,579][INFO ][test-runner-#16858%encryption.MasterKeyChangeTest%][IgniteSnapshotManager] Resolved snapshot work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/snapshots [21:08:51] : [Step 4/5] [2021-11-19 21:08:51,579][INFO ][test-runner-#16858%encryption.MasterKeyChangeTest%][IgniteSnapshotManager] Resolved temp directory for snapshot creation: /opt/buildagent/work/7bc1c54bc719b67c/work/db/encryption_MasterKeyChangeTest3/snp [21:08:51] : [Step 4/5] [2021-11-19 21:08:51,583][INFO ][test-runner-#16858%encryption.MasterKeyChangeTest%][ClientListenerProcessor] Client connector processor has started on TCP port 10802 [21:08:51] : [Step 4/5] [2021-11-19 21:08:51,586][INFO ][test-runner-#16858%encryption.MasterKeyChangeTest%][MasterKeyChangeTest3] Non-loopback local IPs: 172.17.0.4 [21:08:51] : [Step 4/5] [2021-11-19 21:08:51,587][INFO ][test-runner-#16858%encryption.MasterKeyChangeTest%][MasterKeyChangeTest3] Enabled local MACs: 0242AC110004 [21:08:51] : [Step 4/5] [2021-11-19 21:08:51,588][INFO ][test-runner-#16858%encryption.MasterKeyChangeTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:08:51] : [Step 4/5] [2021-11-19 21:08:51,589][INFO ][test-runner-#16858%encryption.MasterKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:08:51] : [Step 4/5] [2021-11-19 21:08:51,590][INFO ][test-runner-#16858%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:08:51] : [Step 4/5] [2021-11-19 21:08:51,592][INFO ][test-runner-#16858%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Applying lost metastore updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:08:51] : [Step 4/5] [2021-11-19 21:08:51,594][INFO ][test-runner-#16858%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=10 ms] [21:08:51] : [Step 4/5] [2021-11-19 21:08:51,594][INFO ][test-runner-#16858%encryption.MasterKeyChangeTest%][GridCacheProcessor] Restoring partition state for local groups. [21:08:51] : [Step 4/5] [2021-11-19 21:08:51,595][INFO ][test-runner-#16858%encryption.MasterKeyChangeTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=0, partitionsProcessed=0, time=0ms] [21:08:51] : [Step 4/5] [2021-11-19 21:08:51,595][INFO ][test-runner-#16858%encryption.MasterKeyChangeTest%][GridEncryptionManager] Encryption keys loaded from metastore. [grps=, masterKeyName=ignite.master.key] [21:08:51] : [Step 4/5] [2021-11-19 21:08:51,597][INFO ][test-runner-#16858%encryption.MasterKeyChangeTest%][ClusterProcessor] Cluster ID and tag has been read from metastorage: null [21:08:51] : [Step 4/5] [2021-11-19 21:08:51,597][INFO ][test-runner-#16858%encryption.MasterKeyChangeTest%][IgniteClusterImpl] Shutdown policy was updated [oldVal=null, newVal=null] [21:08:51] : [Step 4/5] [2021-11-19 21:08:51,598][INFO ][test-runner-#16858%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Checkpoint frequency deviation changed [oldVal=null, newVal=null] [21:08:51] : [Step 4/5] [2021-11-19 21:08:51,613][INFO ][test-runner-#16858%encryption.MasterKeyChangeTest%][FilePageStoreManager] Cleanup cache stores [total=1, left=0, cleanFiles=false] [21:08:51] : [Step 4/5] [2021-11-19 21:08:51,617][INFO ][test-runner-#16858%encryption.MasterKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:08:51] : [Step 4/5] [2021-11-19 21:08:51,618][INFO ][test-runner-#16858%encryption.MasterKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:08:51] : [Step 4/5] [2021-11-19 21:08:51,621][INFO ][test-runner-#16858%encryption.MasterKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:08:51] : [Step 4/5] [2021-11-19 21:08:51,621][INFO ][test-runner-#16858%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Data Regions Started: 5 [21:08:51] : [Step 4/5] [2021-11-19 21:08:51,622][INFO ][test-runner-#16858%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] ^-- sysMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:08:51] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:08:51] : [Step 4/5] ^-- default region [type=default, persistence=true, lazyAlloc=true, [21:08:51] : [Step 4/5] ... initCfg=10MB, maxCfg=10MB, usedRam=0MB, freeRam=100%, allocRam=0MB, allocTotal=0MB] [21:08:51] : [Step 4/5] ^-- metastoreMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:08:51] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:08:51] : [Step 4/5] ^-- TxLog region [type=internal, persistence=true, lazyAlloc=false, [21:08:51] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:08:51] : [Step 4/5] ^-- volatileDsMemPlc region [type=user, persistence=false, lazyAlloc=true, [21:08:51] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB] [21:08:51] : [Step 4/5] ^-- Ignite persistence [used=0MB] [21:08:51] : [Step 4/5] [21:08:51] : [Step 4/5] [2021-11-19 21:08:51,624][INFO ][test-runner-#16858%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Starting binary memory restore for: [-2100569601] [21:08:51] : [Step 4/5] [2021-11-19 21:08:51,635][INFO ][test-runner-#16858%encryption.MasterKeyChangeTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:08:51] : [Step 4/5] [2021-11-19 21:08:51,636][INFO ][test-runner-#16858%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:08:51] : [Step 4/5] [2021-11-19 21:08:51,637][INFO ][test-runner-#16858%encryption.MasterKeyChangeTest%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/encryption_MasterKeyChangeTest3/0000000000000000.wal, offset=0, ver=2] [21:08:51] : [Step 4/5] [2021-11-19 21:08:51,651][INFO ][test-runner-#16858%encryption.MasterKeyChangeTest%][GridCacheProcessor] Started cache in recovery mode [name=ignite-sys-cache, id=-2100569601, dataRegionName=sysMemPlc, mode=REPLICATED, atomicity=TRANSACTIONAL, backups=2147483647, mvcc=false] [21:08:51] : [Step 4/5] [2021-11-19 21:08:51,653][INFO ][test-runner-#16858%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Binary recovery performed in 29 ms. [21:08:51] : [Step 4/5] [2021-11-19 21:08:51,653][INFO ][test-runner-#16858%encryption.MasterKeyChangeTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:08:51] : [Step 4/5] [2021-11-19 21:08:51,653][INFO ][test-runner-#16858%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Applying lost cache updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:08:51] : [Step 4/5] [2021-11-19 21:08:51,722][INFO ][test-runner-#16858%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=61 ms] [21:08:51] : [Step 4/5] [2021-11-19 21:08:51,722][INFO ][test-runner-#16858%encryption.MasterKeyChangeTest%][GridCacheProcessor] Restoring partition state for local groups. [21:08:51] : [Step 4/5] [2021-11-19 21:08:51,730][INFO ][test-runner-#16858%encryption.MasterKeyChangeTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=1, partitionsProcessed=100, time=10ms] [21:08:52] : [Step 4/5] [2021-11-19 21:08:52,602][INFO ][test-runner-#16858%encryption.MasterKeyChangeTest%][TestTcpDiscoverySpi] Successfully bound to TCP port [port=47502, localHost=localhost/127.0.0.1, locNodeId=386595f6-9ee5-443a-8fb1-a62067500003] [21:08:52] : [Step 4/5] [2021-11-19 21:08:52,606][INFO ][tcp-disco-srvr-[:47501]-#891%grid-1%-#17089%grid-1%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=43883] [21:08:52] : [Step 4/5] [2021-11-19 21:08:52,606][INFO ][tcp-disco-srvr-[:47501]-#891%grid-1%-#17089%grid-1%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=43883] [21:08:52] : [Step 4/5] [2021-11-19 21:08:52,607][INFO ][tcp-disco-sock-reader-[]-#901%grid-1%-#17239%grid-1%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:43883, rmtPort=43883] [21:08:52] : [Step 4/5] [2021-11-19 21:08:52,608][INFO ][tcp-disco-sock-reader-[386595f6 127.0.0.1:43883]-#901%grid-1%-#17239%grid-1%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=386595f6-9ee5-443a-8fb1-a62067500003, rmtAddr=/127.0.0.1:43883] [21:08:52] : [Step 4/5] [2021-11-19 21:08:52,610][INFO ][tcp-disco-srvr-[:47502]-#900%encryption.MasterKeyChangeTest3%-#17238%encryption.MasterKeyChangeTest3%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=52057] [21:08:52] : [Step 4/5] [2021-11-19 21:08:52,611][INFO ][tcp-disco-srvr-[:47502]-#900%encryption.MasterKeyChangeTest3%-#17238%encryption.MasterKeyChangeTest3%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=52057] [21:08:52] : [Step 4/5] [2021-11-19 21:08:52,612][INFO ][tcp-disco-sock-reader-[]-#902%encryption.MasterKeyChangeTest3%-#17240%encryption.MasterKeyChangeTest3%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:52057, rmtPort=52057] [21:08:52] : [Step 4/5] [2021-11-19 21:08:52,613][INFO ][tcp-disco-sock-reader-[]-#902%encryption.MasterKeyChangeTest3%-#17240%encryption.MasterKeyChangeTest3%][TestTcpDiscoverySpi] Received ping request from the remote node [rmtNodeId=100c36d3-16b1-4c48-8740-717105362001, rmtAddr=/127.0.0.1:52057, rmtPort=52057] [21:08:52] : [Step 4/5] [2021-11-19 21:08:52,614][INFO ][tcp-disco-sock-reader-[]-#902%encryption.MasterKeyChangeTest3%-#17240%encryption.MasterKeyChangeTest3%][TestTcpDiscoverySpi] Finished writing ping response [rmtNodeId=100c36d3-16b1-4c48-8740-717105362001, rmtAddr=/127.0.0.1:52057, rmtPort=52057] [21:08:52] : [Step 4/5] [2021-11-19 21:08:52,614][INFO ][tcp-disco-sock-reader-[386595f6 127.0.0.1:43883]-#901%grid-1%-#17239%grid-1%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:43883, rmtPort=43883, rmtNodeId=386595f6-9ee5-443a-8fb1-a62067500003] [21:08:52] : [Step 4/5] [2021-11-19 21:08:52,615][INFO ][tcp-disco-sock-reader-[]-#902%encryption.MasterKeyChangeTest3%-#17240%encryption.MasterKeyChangeTest3%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:52057, rmtPort=52057, rmtNodeId=null] [21:08:52]W: [org.apache.ignite:ignite-core] [2021-11-19 21:08:52,620][WARN ][disco-pool-#17241%grid-0%][TestTcpDiscoverySpi] Master key change is in progress! Node join is rejected. [node=386595f6-9ee5-443a-8fb1-a62067500003] [21:08:52] : [Step 4/5] [2021-11-19 21:08:52,621][INFO ][tcp-disco-srvr-[:47502]-#900%encryption.MasterKeyChangeTest3%-#17238%encryption.MasterKeyChangeTest3%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=40025] [21:08:52] : [Step 4/5] [2021-11-19 21:08:52,621][INFO ][tcp-disco-srvr-[:47502]-#900%encryption.MasterKeyChangeTest3%-#17238%encryption.MasterKeyChangeTest3%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=40025] [21:08:52] : [Step 4/5] [2021-11-19 21:08:52,622][INFO ][tcp-disco-sock-reader-[]-#903%encryption.MasterKeyChangeTest3%-#17242%encryption.MasterKeyChangeTest3%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:40025, rmtPort=40025] [21:08:52] : [Step 4/5] [2021-11-19 21:08:52,623][INFO ][tcp-disco-sock-reader-[000dfce4 127.0.0.1:40025]-#903%encryption.MasterKeyChangeTest3%-#17242%encryption.MasterKeyChangeTest3%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=000dfce4-d7b6-431a-a61c-277e5ca6b000, rmtAddr=/127.0.0.1:40025] [21:08:52] : [Step 4/5] [2021-11-19 21:08:52,626][INFO ][tcp-disco-sock-reader-[000dfce4 127.0.0.1:40025]-#903%encryption.MasterKeyChangeTest3%-#17242%encryption.MasterKeyChangeTest3%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:40025, rmtPort=40025, rmtNodeId=000dfce4-d7b6-431a-a61c-277e5ca6b000] [21:08:52]W: [org.apache.ignite:ignite-core] [2021-11-19 21:08:52,626][ERROR][test-runner-#16858%encryption.MasterKeyChangeTest%][MasterKeyChangeTest3] Failed to start manager: GridManagerAdapter [enabled=true, name=o.a.i.i.managers.discovery.GridDiscoveryManager] [21:08:52]W: [org.apache.ignite:ignite-core] class org.apache.ignite.IgniteCheckedException: Failed to start SPI: TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=5000, ackTimeout=5000, marsh=JdkMarshaller [clsFilter=org.apache.ignite.marshaller.MarshallerUtils$1@4f10619], reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false] [21:08:52]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.managers.GridManagerAdapter.startSpi(GridManagerAdapter.java:281) [21:08:52]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.managers.discovery.GridDiscoveryManager.start(GridDiscoveryManager.java:1091) [21:08:52]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.IgniteKernal.startManager(IgniteKernal.java:1953) [21:08:52]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.IgniteKernal.start(IgniteKernal.java:1300) [21:08:52]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.IgnitionEx$IgniteNamedInstance.start0(IgnitionEx.java:1798) [21:08:52]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.IgnitionEx$IgniteNamedInstance.start(IgnitionEx.java:1720) [21:08:52]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.IgnitionEx.start0(IgnitionEx.java:1159) [21:08:52]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.IgnitionEx.start(IgnitionEx.java:629) [21:08:52]W: [org.apache.ignite:ignite-core] at org.apache.ignite.testframework.junits.GridAbstractTest.startGrid(GridAbstractTest.java:1252) [21:08:52]W: [org.apache.ignite:ignite-core] at org.apache.ignite.testframework.junits.GridAbstractTest.startGrid(GridAbstractTest.java:1169) [21:08:52]W: [org.apache.ignite:ignite-core] at org.apache.ignite.testframework.junits.GridAbstractTest.startGrid(GridAbstractTest.java:1145) [21:08:52]W: [org.apache.ignite:ignite-core] at org.apache.ignite.testframework.junits.GridAbstractTest.startGrid(GridAbstractTest.java:998) [21:08:52]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.encryption.MasterKeyChangeTest.lambda$testRejectNodeJoinDuringRotation$3(MasterKeyChangeTest.java:223) [21:08:52]W: [org.apache.ignite:ignite-core] at org.apache.ignite.testframework.GridTestUtils.assertThrowsWithCause(GridTestUtils.java:636) [21:08:52]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.encryption.MasterKeyChangeTest.testRejectNodeJoinDuringRotation(MasterKeyChangeTest.java:223) [21:08:52]W: [org.apache.ignite:ignite-core] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) [21:08:52]W: [org.apache.ignite:ignite-core] at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) [21:08:52]W: [org.apache.ignite:ignite-core] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [21:08:52]W: [org.apache.ignite:ignite-core] at java.lang.reflect.Method.invoke(Method.java:498) [21:08:52]W: [org.apache.ignite:ignite-core] at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50) [21:08:52]W: [org.apache.ignite:ignite-core] at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) [21:08:52]W: [org.apache.ignite:ignite-core] at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47) [21:08:52]W: [org.apache.ignite:ignite-core] at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) [21:08:52]W: [org.apache.ignite:ignite-core] at org.apache.ignite.testframework.junits.GridAbstractTest$7.run(GridAbstractTest.java:2432) [21:08:52]W: [org.apache.ignite:ignite-core] at java.lang.Thread.run(Thread.java:748) [21:08:52]W: [org.apache.ignite:ignite-core] Caused by: class org.apache.ignite.spi.IgniteSpiException: Master key change is in progress! Node join is rejected. [21:08:52]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.discovery.tcp.TcpDiscoverySpi.checkFailedError(TcpDiscoverySpi.java:2108) [21:08:52]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.discovery.tcp.ServerImpl.joinTopology(ServerImpl.java:1206) [21:08:52]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.discovery.tcp.ServerImpl.spiStart(ServerImpl.java:474) [21:08:52]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.discovery.tcp.TcpDiscoverySpi.spiStart(TcpDiscoverySpi.java:2210) [21:08:52]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.managers.GridManagerAdapter.startSpi(GridManagerAdapter.java:278) [21:08:52]W: [org.apache.ignite:ignite-core] ... 24 more [21:08:52]W: [org.apache.ignite:ignite-core] [2021-11-19 21:08:52,632][ERROR][test-runner-#16858%encryption.MasterKeyChangeTest%][MasterKeyChangeTest3] Got exception while starting (will rollback startup routine). [21:08:52]W: [org.apache.ignite:ignite-core] class org.apache.ignite.IgniteCheckedException: Failed to start manager: GridManagerAdapter [enabled=true, name=org.apache.ignite.internal.managers.discovery.GridDiscoveryManager] [21:08:52]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.IgniteKernal.startManager(IgniteKernal.java:1958) [21:08:52]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.IgniteKernal.start(IgniteKernal.java:1300) [21:08:52]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.IgnitionEx$IgniteNamedInstance.start0(IgnitionEx.java:1798) [21:08:52]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.IgnitionEx$IgniteNamedInstance.start(IgnitionEx.java:1720) [21:08:52]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.IgnitionEx.start0(IgnitionEx.java:1159) [21:08:52]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.IgnitionEx.start(IgnitionEx.java:629) [21:08:52]W: [org.apache.ignite:ignite-core] at org.apache.ignite.testframework.junits.GridAbstractTest.startGrid(GridAbstractTest.java:1252) [21:08:52]W: [org.apache.ignite:ignite-core] at org.apache.ignite.testframework.junits.GridAbstractTest.startGrid(GridAbstractTest.java:1169) [21:08:52]W: [org.apache.ignite:ignite-core] at org.apache.ignite.testframework.junits.GridAbstractTest.startGrid(GridAbstractTest.java:1145) [21:08:52]W: [org.apache.ignite:ignite-core] at org.apache.ignite.testframework.junits.GridAbstractTest.startGrid(GridAbstractTest.java:998) [21:08:52]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.encryption.MasterKeyChangeTest.lambda$testRejectNodeJoinDuringRotation$3(MasterKeyChangeTest.java:223) [21:08:52]W: [org.apache.ignite:ignite-core] at org.apache.ignite.testframework.GridTestUtils.assertThrowsWithCause(GridTestUtils.java:636) [21:08:52]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.encryption.MasterKeyChangeTest.testRejectNodeJoinDuringRotation(MasterKeyChangeTest.java:223) [21:08:52]W: [org.apache.ignite:ignite-core] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) [21:08:52]W: [org.apache.ignite:ignite-core] at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) [21:08:52]W: [org.apache.ignite:ignite-core] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [21:08:52]W: [org.apache.ignite:ignite-core] at java.lang.reflect.Method.invoke(Method.java:498) [21:08:52]W: [org.apache.ignite:ignite-core] at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50) [21:08:52]W: [org.apache.ignite:ignite-core] at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) [21:08:52]W: [org.apache.ignite:ignite-core] at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47) [21:08:52]W: [org.apache.ignite:ignite-core] at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) [21:08:52]W: [org.apache.ignite:ignite-core] at org.apache.ignite.testframework.junits.GridAbstractTest$7.run(GridAbstractTest.java:2432) [21:08:52]W: [org.apache.ignite:ignite-core] at java.lang.Thread.run(Thread.java:748) [21:08:52]W: [org.apache.ignite:ignite-core] Caused by: class org.apache.ignite.IgniteCheckedException: Failed to start SPI: TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=5000, ackTimeout=5000, marsh=JdkMarshaller [clsFilter=org.apache.ignite.marshaller.MarshallerUtils$1@4f10619], reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false] [21:08:52]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.managers.GridManagerAdapter.startSpi(GridManagerAdapter.java:281) [21:08:52]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.managers.discovery.GridDiscoveryManager.start(GridDiscoveryManager.java:1091) [21:08:52]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.IgniteKernal.startManager(IgniteKernal.java:1953) [21:08:52]W: [org.apache.ignite:ignite-core] ... 22 more [21:08:52]W: [org.apache.ignite:ignite-core] Caused by: class org.apache.ignite.spi.IgniteSpiException: Master key change is in progress! Node join is rejected. [21:08:52]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.discovery.tcp.TcpDiscoverySpi.checkFailedError(TcpDiscoverySpi.java:2108) [21:08:52]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.discovery.tcp.ServerImpl.joinTopology(ServerImpl.java:1206) [21:08:52]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.discovery.tcp.ServerImpl.spiStart(ServerImpl.java:474) [21:08:52]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.discovery.tcp.TcpDiscoverySpi.spiStart(TcpDiscoverySpi.java:2210) [21:08:52]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.managers.GridManagerAdapter.startSpi(GridManagerAdapter.java:278) [21:08:52]W: [org.apache.ignite:ignite-core] ... 24 more [21:08:57] : [Step 4/5] [2021-11-19 21:08:57,641][INFO ][test-runner-#16858%encryption.MasterKeyChangeTest%][TestTcpDiscoverySpi] No verification for local node leave has been received from coordinator (will stop node anyway). [21:08:57] : [Step 4/5] [2021-11-19 21:08:57,648][INFO ][test-runner-#16858%encryption.MasterKeyChangeTest%][GridCacheProcessor] Stopped cache [cacheName=ignite-sys-cache] [21:08:57] : [Step 4/5] [2021-11-19 21:08:57,652][INFO ][test-runner-#16858%encryption.MasterKeyChangeTest%][FilePageStoreManager] Cleanup cache stores [total=3, left=0, cleanFiles=false] [21:08:57] : [Step 4/5] [2021-11-19 21:08:57,658][INFO ][test-runner-#16858%encryption.MasterKeyChangeTest%][MasterKeyChangeTest3] [21:08:57] : [Step 4/5] [21:08:57] : [Step 4/5] >>> +------------------------------------------------------+ [21:08:57] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV stopped OK [21:08:57] : [Step 4/5] >>> +------------------------------------------------------+ [21:08:57] : [Step 4/5] >>> Ignite instance name: encryption.MasterKeyChangeTest3 [21:08:57] : [Step 4/5] >>> Grid uptime: 00:00:07.346 [21:08:57] : [Step 4/5] [21:08:57] : [Step 4/5] [21:08:57] : [Step 4/5] [2021-11-19 21:08:57,659][INFO ][test-runner-#16858%encryption.MasterKeyChangeTest%][IgniteTestResources] Send blocked message [node=000dfce4-d7b6-431a-a61c-277e5ca6b000, order=1, msg=org.apache.ignite.internal.util.distributed.SingleNodeMessage@6f4b1ab2] [21:08:57] : [Step 4/5] [2021-11-19 21:08:57,663][INFO ][disco-notifier-worker-#16969%grid-0%][GridEncryptionManager] Start master key change [masterKeyName=ignite.master.key2] [21:08:57] : [Step 4/5] [2021-11-19 21:08:57,663][INFO ][disco-notifier-worker-#17087%grid-1%][GridEncryptionManager] Start master key change [masterKeyName=ignite.master.key2] [21:08:57] : [Step 4/5] [2021-11-19 21:08:57,720][INFO ][disco-notifier-worker-#16969%grid-0%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:08:57] : [Step 4/5] [2021-11-19 21:08:57,722][INFO ][disco-notifier-worker-#17087%grid-1%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:08:57] : [Step 4/5] [2021-11-19 21:08:57,817][INFO ][disco-notifier-worker-#17087%grid-1%][GridEncryptionManager] Master key successfully changed [masterKeyName=ignite.master.key2] [21:08:57] : [Step 4/5] [2021-11-19 21:08:57,817][INFO ][disco-notifier-worker-#16969%grid-0%][GridEncryptionManager] Master key successfully changed [masterKeyName=ignite.master.key2] [21:08:57] : [Step 4/5] [21:08:57] >>> Stopping test: MasterKeyChangeTest#testRejectNodeJoinDuringRotation in 12185 ms <<< [21:08:57] : [Step 4/5] [2021-11-19 21:08:57,845][INFO ][main][root] >>> Stopping test: MasterKeyChangeTest#testRejectNodeJoinDuringRotation in 12185 ms <<< [21:08:57] : [Step 4/5] [21:08:57] >>> Heap: 460 MB used / 1919 MB commited / 1919 MB max <<< [21:08:57] : [Step 4/5] [2021-11-19 21:08:57,846][INFO ][main][root] >>> Heap: 460 MB used / 1919 MB commited / 1919 MB max <<< [21:08:57] : [Step 4/5] [21:08:57] >>> Non-Heap: 147 MB used / 179 MB commited / 0 MB max <<< [21:08:57] : [Step 4/5] [2021-11-19 21:08:57,846][INFO ][main][root] >>> Non-Heap: 147 MB used / 179 MB commited / 0 MB max <<< [21:08:57] : [Step 4/5] [21:08:57] >>> Starting test: MasterKeyChangeTest#testNodeFailsDuringRotationCoordinatorPerform <<< [21:08:57] : [Step 4/5] [2021-11-19 21:08:57,848][INFO ][main][root] >>> Starting test: MasterKeyChangeTest#testNodeFailsDuringRotationCoordinatorPerform <<< [21:08:57] : [Step 4/5] [21:08:57] >>> Heap: 460 MB used / 1919 MB commited / 1919 MB max <<< [21:08:57] : [Step 4/5] [2021-11-19 21:08:57,848][INFO ][main][root] >>> Heap: 460 MB used / 1919 MB commited / 1919 MB max <<< [21:08:57] : [Step 4/5] [21:08:57] >>> Non-Heap: 147 MB used / 179 MB commited / 0 MB max <<< [21:08:57] : [Step 4/5] [2021-11-19 21:08:57,849][INFO ][main][root] >>> Non-Heap: 147 MB used / 179 MB commited / 0 MB max <<< [21:08:57] : [Step 4/5] [2021-11-19 21:08:57,849][INFO ][main][root] >>> Stopping grid [name=grid-1, id=100c36d3-16b1-4c48-8740-717105362001] [21:08:57] : [Step 4/5] [2021-11-19 21:08:57,868][INFO ][db-checkpoint-thread-#17110%grid-1%][Checkpointer] Checkpoint started [checkpointId=4fe42505-b2c9-41fb-be44-ac82113cdb98, startPtr=WALPointer [idx=0, fileOff=642741, len=11871], checkpointBeforeLockTime=6ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=3ms, writeCheckpointEntryDuration=2ms, splitAndSortCpPagesDuration=0ms, pages=455, reason='timeout'] [21:08:57] : [Step 4/5] [2021-11-19 21:08:57,877][INFO ][tcp-disco-sock-reader-[000dfce4 127.0.0.1:43433]-#894%grid-1%-#17092%grid-1%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:43433, rmtPort=43433, rmtNodeId=000dfce4-d7b6-431a-a61c-277e5ca6b000] [21:08:57] : [Step 4/5] [2021-11-19 21:08:57,878][INFO ][disco-event-worker-#16973%grid-0%][GridDiscoveryManager] Node left topology: TcpDiscoveryNode [id=100c36d3-16b1-4c48-8740-717105362001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637345328102, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false] [21:08:57] : [Step 4/5] [2021-11-19 21:08:57,879][INFO ][main][GridCacheProcessor] Stopped cache [cacheName=ignite-sys-cache] [21:08:57] : [Step 4/5] [2021-11-19 21:08:57,880][INFO ][main][GridCacheProcessor] Stopped cache [cacheName=encrypted] [21:08:57] : [Step 4/5] [2021-11-19 21:08:57,880][INFO ][disco-event-worker-#16973%grid-0%][GridDiscoveryManager] Topology snapshot [ver=3, locNode=000dfce4, servers=1, clients=0, state=ACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=000dfce4-d7b6-431a-a61c-277e5ca6b000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:08:57] : [Step 4/5] [2021-11-19 21:08:57,881][INFO ][disco-event-worker-#16973%grid-0%][GridDiscoveryManager] ^-- Baseline [id=0, size=2, online=1, offline=1] [21:08:57]W: [org.apache.ignite:ignite-core] [2021-11-19 21:08:57,884][WARN ][grid-nio-worker-tcp-comm-0-#16913%TestRecordingCommunicationSpi%][TestRecordingCommunicationSpi] Failed to shutdown socket [21:08:57]W: [org.apache.ignite:ignite-core] java.nio.channels.ClosedChannelException [21:08:57]W: [org.apache.ignite:ignite-core] at sun.nio.ch.SocketChannelImpl.shutdownOutput(SocketChannelImpl.java:795) [21:08:57]W: [org.apache.ignite:ignite-core] at sun.nio.ch.SocketAdaptor.shutdownOutput(SocketAdaptor.java:407) [21:08:57] : [Step 4/5] [2021-11-19 21:08:57,886][INFO ][exchange-worker-#16974%grid-0%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], crd=true, evt=NODE_LEFT, evtNode=100c36d3-16b1-4c48-8740-717105362001, customEvt=null, allowMerge=false, exchangeFreeSwitch=true] [21:08:57] : [Step 4/5] [2021-11-19 21:08:57,888][INFO ][sys-#16945%grid-0%][GridAffinityAssignmentCache] Local node affinity assignment distribution is not ideal [cache=encrypted, expectedPrimary=1024.00, actualPrimary=502, expectedBackups=0.00, actualBackups=0, warningThreshold=50.00%] [21:08:57]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.close(IgniteUtils.java:4247) [21:08:57] : [Step 4/5] [2021-11-19 21:08:57,889][INFO ][exchange-worker-#16974%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:08:57]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.closeKey(GridNioServer.java:2784) [21:08:57] : [Step 4/5] [2021-11-19 21:08:57,891][INFO ][exchange-worker-#16974%grid-0%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], err=null, rebalanced=true, wasRebalanced=true] [21:08:57]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.close(GridNioServer.java:2835) [21:08:57]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.close(GridNioServer.java:2794) [21:08:57]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.bodyInternal(GridNioServer.java:2157) [21:08:57]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.body(GridNioServer.java:1910) [21:08:57]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:125) [21:08:57]W: [org.apache.ignite:ignite-core] at java.lang.Thread.run(Thread.java:748) [21:08:57]W: [org.apache.ignite:ignite-core] [2021-11-19 21:08:57,893][WARN ][exchange-worker-#16974%grid-0%][GridDhtPartitionTopologyImpl] Detected lost partitions [grp=encrypted, parts=[0, 2, 4, 6-7, 10-11, 14, 17, 21, 24-30, 32, 37, 40, 44, 47-52, 54, 57, 59, 62-64, 67-68, 74-75, 78, 81, 87-88, 91, 97, 99, 101-102, 104-107, 113-114, 116, 118, 120, 122, 124, 135-136, 138, 140-145, 147, 149-152, 154-156, 159-160, 162-164, 169, 172, 175-177, 180, 184-187, 190-191, 194, 196-202, 204-205, 209-210, 212, 214, 216, 219-224, 226, 229-232, 237, 239, 241, 243-245, 247, 249-251, 255, 257, 261, 265, 269, 272-273, 276-277, 281-282, 285, 287, 289-291, 293-297, 299, 301-304, 306, 308-309, 311-312, 315-317, 319, 322, 325-326, 328-330, 336, 339, 341, 344-346, 350, 352-354, 357-361, 363, 366-367, 371-373, 376-380, 383, 385, 387-388, 390, 392, 395-397, 400, 402, 405, 408-411, 416, 420, 422, 424-425, 429, 433, 435-438, 440-441, 445-446, 450, 452-453, 455-456, 458, 460, 462-463, 465-468, 470, 474-475, 480, 488, 490-492, 495, 497, 499-512, 516, 525, 527-531, 535, 537-538, 541-542, 545-546, 548-552, 554-555, 558, 562-564, 567-569, 572, 574, 579-580, 582-585, 587, 590-591, 594, 596, 600, 602, 604, 607-614, 617-620, 623-624, 627-629, 632-633, 636, 638, 640-642, 645-646, 648-649, 657-662, 664-665, 668-672, 677-678, 682-684, 686, 689, 692-693, 695-697, 699, 706-707, 709-710, 712-714, 716-717, 719-721, 723-728, 730-732, 734-735, 739, 742, 746, 749-750, 752, 754, 756, 762, 768-770, 772-775, 778, 780, 783-787, 789-791, 793, 796, 798-801, 803, 806, 809-812, 814, 816-817, 819, 822-825, 827-829, 832-833, 836-837, 839-840, 846, 848-851, 853-854, 857-858, 860, 863-864, 866, 868-871, 873-875, 877-878, 884, 888-889, 896-897, 900, 905-907, 914-915, 917, 919-920, 923-925, 931-933, 936, 940, 942, 944-945, 948, 950-951, 954, 956-958, 962, 965-970, 972, 975-976, 978-980, 983, 985, 988, 990, 993-994, 997-998, 1000, 1003-1004, 1007, 1009, 1014, 1016, 1018-1019], topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0]] [21:08:57] : [Step 4/5] [2021-11-19 21:08:57,899][INFO ][exchange-worker-#16974%grid-0%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=000dfce4-d7b6-431a-a61c-277e5ca6b000, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], evt=NODE_LEFT, evtNode=TcpDiscoveryNode [id=100c36d3-16b1-4c48-8740-717105362001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637345328102, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0]] [21:08:57] : [Step 4/5] [2021-11-19 21:08:57,900][INFO ][exchange-worker-#16974%grid-0%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (1 ms), stage="Determine exchange type" (1 ms), stage="Preloading notification" (0 ms), stage="After states restored callback" (0 ms), stage="WAL history reservation" (0 ms), stage="Finalize update counters" (0 ms), stage="Detect lost partitions" (7 ms), stage="Exchange done" (2 ms), stage="Total time" (11 ms)] [21:08:57] : [Step 4/5] [2021-11-19 21:08:57,901][INFO ][exchange-worker-#16974%grid-0%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], stage="Affinity initialization (exchange-free switch on fully-rebalanced topology) [grp=encrypted]" (1 ms) (parent=Determine exchange type), stage="Affinity initialization (exchange-free switch on fully-rebalanced topology) [grp=ignite-sys-cache]" (0 ms) (parent=Determine exchange type)] [21:08:57] : [Step 4/5] [2021-11-19 21:08:57,902][INFO ][exchange-worker-#16974%grid-0%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], crd=true] [21:08:57] : [Step 4/5] [2021-11-19 21:08:57,903][INFO ][exchange-worker-#16974%grid-0%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=3, minorTopVer=0], force=false, evt=NODE_LEFT, node=100c36d3-16b1-4c48-8740-717105362001] [21:08:58] : [Step 4/5] [2021-11-19 21:08:58,254][INFO ][main][FilePageStoreManager] Cleanup cache stores [total=4, left=0, cleanFiles=false] [21:08:58] : [Step 4/5] [2021-11-19 21:08:58,257][INFO ][main][GridDeploymentLocalStore] Removed undeployed class: GridDeployment [ts=1637345328223, depMode=SHARED, clsLdr=IsolatedClassLoader{roleName='test'}, clsLdrId=d056d593d71-100c36d3-16b1-4c48-8740-717105362001, userVer=0, loc=true, sampleClsName=org.apache.ignite.internal.processors.cache.distributed.dht.preloader.GridDhtPartitionFullMap, pendingUndeploy=false, undeployed=true, usage=0] [21:08:58] : [Step 4/5] [2021-11-19 21:08:58,265][INFO ][main][IgniteKernal%grid-1] [21:08:58] : [Step 4/5] [21:08:58] : [Step 4/5] >>> +------------------------------------------------------+ [21:08:58] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV stopped OK [21:08:58] : [Step 4/5] >>> +------------------------------------------------------+ [21:08:58] : [Step 4/5] >>> Ignite instance name: grid-1 [21:08:58] : [Step 4/5] >>> Grid uptime: 00:00:10.121 [21:08:58] : [Step 4/5] [21:08:58] : [Step 4/5] [21:08:58] : [Step 4/5] [2021-11-19 21:08:58,266][INFO ][main][root] >>> Stopping grid [name=grid-0, id=000dfce4-d7b6-431a-a61c-277e5ca6b000] [21:08:58] : [Step 4/5] [2021-11-19 21:08:58,282][INFO ][db-checkpoint-thread-#17105%grid-0%][Checkpointer] Checkpoint started [checkpointId=6c9a4e9b-66b2-45c3-ae22-4932a4175db1, startPtr=WALPointer [idx=0, fileOff=753850, len=11491], checkpointBeforeLockTime=4ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=1ms, checkpointLockHoldTime=4ms, walCpRecordFsyncDuration=2ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=0ms, pages=575, reason='timeout'] [21:08:58]W: [org.apache.ignite:ignite-core] [2021-11-19 21:08:58,287][WARN ][tcp-disco-sock-reader-[100c36d3 127.0.0.1:39537]-#895%grid-0%-#17093%grid-0%][TestTcpDiscoverySpi] Failed to shutdown socket [21:08:58]W: [org.apache.ignite:ignite-core] java.net.SocketException: Socket is closed [21:08:58]W: [org.apache.ignite:ignite-core] at java.net.Socket.shutdownOutput(Socket.java:1568) [21:08:58]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.close(IgniteUtils.java:4247) [21:08:58]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.discovery.tcp.ServerImpl$SocketReader.body(ServerImpl.java:7370) [21:08:58]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.IgniteSpiThread.run(IgniteSpiThread.java:58) [21:08:58] : [Step 4/5] [2021-11-19 21:08:58,288][INFO ][tcp-disco-sock-reader-[100c36d3 127.0.0.1:39537]-#895%grid-0%-#17093%grid-0%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:39537, rmtPort=39537, rmtNodeId=100c36d3-16b1-4c48-8740-717105362001] [21:08:58] : [Step 4/5] [2021-11-19 21:08:58,289][INFO ][main][GridCacheProcessor] Stopped cache [cacheName=ignite-sys-cache] [21:08:58] : [Step 4/5] [2021-11-19 21:08:58,290][INFO ][main][GridCacheProcessor] Stopped cache [cacheName=encrypted] [21:08:58] : [Step 4/5] [2021-11-19 21:08:58,762][INFO ][main][FilePageStoreManager] Cleanup cache stores [total=4, left=0, cleanFiles=false] [21:08:58] : [Step 4/5] [2021-11-19 21:08:58,764][INFO ][main][GridDeploymentLocalStore] Removed undeployed class: GridDeployment [ts=1637345328213, depMode=SHARED, clsLdr=IsolatedClassLoader{roleName='test'}, clsLdrId=b056d593d71-000dfce4-d7b6-431a-a61c-277e5ca6b000, userVer=0, loc=true, sampleClsName=org.apache.ignite.internal.processors.cache.distributed.dht.preloader.GridDhtPartitionMap, pendingUndeploy=false, undeployed=true, usage=0] [21:08:58] : [Step 4/5] [2021-11-19 21:08:58,771][INFO ][main][IgniteKernal%grid-0] [21:08:58] : [Step 4/5] [21:08:58] : [Step 4/5] >>> +------------------------------------------------------+ [21:08:58] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV stopped OK [21:08:58] : [Step 4/5] >>> +------------------------------------------------------+ [21:08:58] : [Step 4/5] >>> Ignite instance name: grid-0 [21:08:58] : [Step 4/5] >>> Grid uptime: 00:00:11.778 [21:08:58] : [Step 4/5] [21:08:58] : [Step 4/5] [21:08:59]W: [org.apache.ignite:ignite-core] [2021-11-19 21:08:59,096][WARN ][test-runner-#17247%encryption.MasterKeyChangeTest%][G] Ignite work directory is not provided, automatically resolved to: /opt/buildagent/work/7bc1c54bc719b67c/work [21:08:59] : [Step 4/5] [2021-11-19 21:08:59,098][INFO ][test-runner-#17247%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] [21:08:59] : [Step 4/5] [21:08:59] : [Step 4/5] >>> __________ ________________ [21:08:59] : [Step 4/5] >>> / _/ ___/ |/ / _/_ __/ __/ [21:08:59] : [Step 4/5] >>> _/ // (7 7 // / / / / _/ [21:08:59] : [Step 4/5] >>> /___/\___/_/|_/___/ /_/ /___/ [21:08:59] : [Step 4/5] >>> [21:08:59] : [Step 4/5] >>> ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:08:59] : [Step 4/5] >>> 2021 Copyright(C) Apache Software Foundation [21:08:59] : [Step 4/5] >>> [21:08:59] : [Step 4/5] >>> Ignite documentation: http://ignite.apache.org [21:08:59] : [Step 4/5] [21:08:59] : [Step 4/5] [2021-11-19 21:08:59,099][INFO ][test-runner-#17247%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] Config URL: n/a [21:08:59] : [Step 4/5] [2021-11-19 21:08:59,100][INFO ][test-runner-#17247%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] IgniteConfiguration [igniteInstanceName=grid-0, pubPoolSize=24, svcPoolSize=24, callbackPoolSize=24, stripedPoolSize=24, sysPoolSize=24, mgmtPoolSize=4, dataStreamerPoolSize=24, utilityCachePoolSize=24, utilityCacheKeepAliveTime=60000, p2pPoolSize=2, qryPoolSize=24, buildIdxPoolSize=4, igniteHome=/opt/buildagent/work/7bc1c54bc719b67c, igniteWorkDir=/opt/buildagent/work/7bc1c54bc719b67c/work, mbeanSrv=com.sun.jmx.mbeanserver.JmxMBeanServer@6fe85038, nodeId=00800e71-7913-4e3d-bbce-bf44482cf000, marsh=BinaryMarshaller [], marshLocJobs=false, daemon=false, p2pEnabled=true, netTimeout=10000, netCompressionLevel=1, sndRetryDelay=1000, sndRetryCnt=3, metricsHistSize=10000, metricsUpdateFreq=1000, metricsExpTime=9223372036854775807, discoSpi=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=0, ackTimeout=0, marsh=null, reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], segPlc=STOP, segResolveAttempts=2, waitForSegOnStart=true, allResolversPassReq=true, segChkFreq=10000, commSpi=TcpCommunicationSpi [connectGate=org.apache.ignite.spi.communication.tcp.internal.ConnectGateway@4e57d663, ctxInitLatch=java.util.concurrent.CountDownLatch@eacb938[Count = 1], stopping=false, clientPool=null, nioSrvWrapper=null, stateProvider=null], evtSpi=MemoryEventStorageSpi [expireAgeMs=9223372036854775807, expireCnt=10000, filter=null], colSpi=NoopCollisionSpi [], deploySpi=LocalDeploymentSpi [], indexingSpi=org.apache.ignite.spi.indexing.noop.NoopIndexingSpi@31ceebc, addrRslvr=null, encryptionSpi=org.apache.ignite.spi.encryption.keystore.KeystoreEncryptionSpi@76a62c71, tracingSpi=org.apache.ignite.spi.tracing.NoopTracingSpi@58bc40a1, clientMode=false, rebalanceThreadPoolSize=4, rebalanceTimeout=10000, rebalanceBatchesPrefetchCnt=3, rebalanceThrottle=0, rebalanceBatchSize=524288, txCfg=TransactionConfiguration [txSerEnabled=false, dfltIsolation=REPEATABLE_READ, dfltConcurrency=PESSIMISTIC, dfltTxTimeout=0, txTimeoutOnPartitionMapExchange=0, deadlockTimeout=10000, pessimisticTxLogSize=0, pessimisticTxLogLinger=10000, tmLookupClsName=null, txManagerFactory=null, useJtaSync=false], cacheSanityCheckEnabled=true, discoStartupDelay=60000, deployMode=SHARED, p2pMissedCacheSize=100, locHost=127.0.0.1, timeSrvPortBase=31100, timeSrvPortRange=100, failureDetectionTimeout=10000, sysWorkerBlockedTimeout=null, clientFailureDetectionTimeout=10000, metricsLogFreq=0, connectorCfg=null, odbcCfg=null, warmupClos=null, atomicCfg=AtomicConfiguration [seqReserveSize=1000, cacheMode=PARTITIONED, backups=1, aff=null, grpName=null], classLdr=null, sslCtxFactory=null, platformCfg=null, binaryCfg=null, memCfg=null, pstCfg=null, dsCfg=DataStorageConfiguration [sysRegionInitSize=41943040, sysRegionMaxSize=104857600, pageSize=4096, concLvl=0, dfltDataRegConf=DataRegionConfiguration [name=default, maxSize=10485760, initSize=268435456, swapPath=null, pageEvictionMode=DISABLED, pageReplacementMode=CLOCK, evictionThreshold=0.9, emptyPagesPoolSize=100, metricsEnabled=false, metricsSubIntervalCount=5, metricsRateTimeInterval=60000, persistenceEnabled=true, checkpointPageBufSize=0, lazyMemoryAllocation=true, warmUpCfg=null], dataRegions=null, storagePath=null, checkpointFreq=180000, lockWaitTime=10000, checkpointThreads=4, checkpointWriteOrder=SEQUENTIAL, walHistSize=20, maxWalArchiveSize=1073741824, walSegments=10, walSegmentSize=67108864, walPath=db/wal, walArchivePath=db/wal/archive, cdcWalPath=db/wal/cdc, cdcEnabled=false, metricsEnabled=false, walMode=FSYNC, walTlbSize=131072, walBuffSize=0, walFlushFreq=2000, walFsyncDelay=1000, walRecordIterBuffSize=67108864, alwaysWriteFullPages=false, fileIOFactory=org.apache.ignite.internal.processors.cache.persistence.file.AsyncFileIOFactory@3ccb9d63, metricsSubIntervalCnt=5, metricsRateTimeInterval=60000, walAutoArchiveAfterInactivity=-1, walForceArchiveTimeout=-1, writeThrottlingEnabled=false, walCompactionEnabled=false, walCompactionLevel=1, checkpointReadLockTimeout=null, walPageCompression=DISABLED, walPageCompressionLevel=null, dfltWarmUpCfg=null, encCfg=org.apache.ignite.configuration.EncryptionConfiguration@14179c4d, defragmentationThreadPoolSize=4, minWalArchiveSize=-1], snapshotPath=snapshots, activeOnStart=true, activeOnStartPropSetFlag=false, autoActivation=true, autoActivationPropSetFlag=false, clusterStateOnStart=null, sqlConnCfg=null, cliConnCfg=ClientConnectorConfiguration [host=null, port=10800, portRange=100, sockSndBufSize=0, sockRcvBufSize=0, tcpNoDelay=true, maxOpenCursorsPerConn=128, threadPoolSize=24, selectorCnt=12, idleTimeout=0, handshakeTimeout=10000, jdbcEnabled=true, odbcEnabled=true, thinCliEnabled=true, sslEnabled=false, useIgniteSslCtxFactory=true, sslClientAuth=false, sslCtxFactory=null, thinCliCfg=ThinClientConfiguration [maxActiveTxPerConn=100, maxActiveComputeTasksPerConn=0]], mvccVacuumThreadCnt=2, mvccVacuumFreq=5000, authEnabled=false, failureHnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]], commFailureRslvr=null, sqlCfg=SqlConfiguration [longQryWarnTimeout=3000, dfltQryTimeout=0, sqlQryHistSize=1000, validationEnabled=false], asyncContinuationExecutor=null] [21:08:59] : [Step 4/5] [2021-11-19 21:08:59,111][INFO ][test-runner-#17247%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] Daemon mode: off [21:08:59] : [Step 4/5] [2021-11-19 21:08:59,112][INFO ][test-runner-#17247%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] OS: Linux 4.15.0-151-generic amd64 [21:08:59] : [Step 4/5] [2021-11-19 21:08:59,112][INFO ][test-runner-#17247%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] OS user: teamcity [21:08:59] : [Step 4/5] [2021-11-19 21:08:59,112][INFO ][test-runner-#17247%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] PID: 16724 [21:08:59] : [Step 4/5] [2021-11-19 21:08:59,113][INFO ][test-runner-#17247%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] Language runtime: Java Platform API Specification ver. 1.8 [21:08:59] : [Step 4/5] [2021-11-19 21:08:59,113][INFO ][test-runner-#17247%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] VM information: Java(TM) SE Runtime Environment 1.8.0_261-b12 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 25.261-b12 [21:08:59] : [Step 4/5] [2021-11-19 21:08:59,113][INFO ][test-runner-#17247%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] VM total memory: 1.9GB [21:08:59] : [Step 4/5] [2021-11-19 21:08:59,114][INFO ][test-runner-#17247%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] Remote Management [restart: off, REST: off, JMX (remote: off)] [21:08:59] : [Step 4/5] [2021-11-19 21:08:59,114][INFO ][test-runner-#17247%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] Logger: GridTestLog4jLogger [quiet=false, config=null] [21:08:59] : [Step 4/5] [2021-11-19 21:08:59,114][INFO ][test-runner-#17247%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] IGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c [21:08:59] : [Step 4/5] [2021-11-19 21:08:59,114][INFO ][test-runner-#17247%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] VM arguments: [-DIGNITE_DUMP_THREADS_ON_FAILURE=false, -DMono=/usr/bin/mono-sgen, -DMono4.0_x64=/usr/lib/mono/4.0, -DMono4.5_x64=/usr/lib/mono/4.5, -DMonoVersion=6.12.0.90, -DSKIP_BUILD=false, -Dagent.home.dir=/opt/buildagent, -Dagent.name=aitc-lin02_03, -Dagent.ownPort=9090, -Dagent.work.dir=/opt/buildagent/work, -Dbuild.number=95, -Dbuild.vcs.number=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.1=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.GitHubApacheIgnite=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dclassworlds.conf=/opt/buildagent/temp/buildTmp/teamcity.m2.conf, -Dcom.jetbrains.maven.watcher.report.file=/opt/buildagent/temp/buildTmp/maven-build-info.xml, -Djava.io.tmpdir=/opt/buildagent/temp/buildTmp, -Dmaven.home=/opt/buildagent/tools/maven3_6, -Dmaven.multiModuleProjectDirectory=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.agent.cpuBenchmark=457, -Dteamcity.agent.dotnet.agent_url=http://localhost:9090/RPC2, -Dteamcity.agent.dotnet.build_id=6278078, -Dteamcity.auth.password=*******, -Dteamcity.auth.userId=TeamCityBuildId=6278078, -Dteamcity.build.changedFiles.file=/opt/buildagent/temp/buildTmp/changedFiles6342607772318147725.txt, -Dteamcity.build.checkoutDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.build.id=6278078, -Dteamcity.build.properties.file=/opt/buildagent/temp/buildTmp/teamcity.build5164517880467851002.properties, -Dteamcity.build.tempDir=/opt/buildagent/temp/buildTmp, -Dteamcity.build.workingDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.buildConfName=Basic 3, -Dteamcity.buildType.id=IgniteTests24Java8_Basic3, -Dteamcity.configuration.properties.file=/opt/buildagent/temp/buildTmp/teamcity.config5591980786735343870.properties, -Dteamcity.maven.userSettings.path=/opt/buildagent/temp/buildTmp/maven_settings_585072866407032347.xml, -Dteamcity.maven.watcher.home=/opt/buildagent/plugins/mavenPlugin/maven-watcher-jdk16, -Dteamcity.projectName=Ignite Tests 2.x (JDK 8/11), -Dteamcity.runner.properties.file=/opt/buildagent/temp/buildTmp/teamcity.runner9098465561618137420.properties, -Dteamcity.tests.recentlyFailedTests.file=/opt/buildagent/temp/buildTmp/testsToRunFirst3891775683130404069.txt, -Dteamcity.version=2021.2 (build 99542), -ea, -Xms2g, -Xmx2g, -XX:+HeapDumpOnOutOfMemoryError, -DIGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_TEST_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_UPDATE_NOTIFIER=false, -DIGNITE_NO_DISCO_ORDER=true, -DIGNITE_PERFORMANCE_SUGGESTIONS_DISABLED=true, -Djava.net.preferIPv4Stack=true, -DTEST_SCALE_FACTOR=1.0, -DIGNITE_TEST_PROP_LOG4J_FILE=log4j-tc-test.xml, -DIGNITE_QUIET=false, -DIGNITE_MARSHAL_BUFFERS_RECHECK=1000, -Dmaven.repo.local=/opt/buildagent/.m2/repository] [21:08:59] : [Step 4/5] [2021-11-19 21:08:59,119][INFO ][test-runner-#17247%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] System cache's DataRegion size is configured to 40 MB. Use DataStorageConfiguration.systemRegionInitialSize property to change the setting. [21:08:59] : [Step 4/5] [2021-11-19 21:08:59,120][INFO ][test-runner-#17247%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] Configured caches [in 'sysMemPlc' dataRegion: ['ignite-sys-cache']] [21:08:59]W: [org.apache.ignite:ignite-core] [2021-11-19 21:08:59,120][WARN ][test-runner-#17247%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] Peer class loading is enabled (disable it in production for performance and deployment consistency reasons) [21:08:59] : [Step 4/5] [2021-11-19 21:08:59,120][INFO ][test-runner-#17247%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] 3-rd party licenses can be found at: /opt/buildagent/work/7bc1c54bc719b67c/libs/licenses [21:08:59] : [Step 4/5] [2021-11-19 21:08:59,124][INFO ][test-runner-#17247%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] Configured plugins: [21:08:59] : [Step 4/5] [2021-11-19 21:08:59,125][INFO ][test-runner-#17247%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] ^-- StanByClusterTestProvider 1.0 [21:08:59] : [Step 4/5] [2021-11-19 21:08:59,125][INFO ][test-runner-#17247%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:08:59] : [Step 4/5] [2021-11-19 21:08:59,125][INFO ][test-runner-#17247%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] [21:08:59] : [Step 4/5] [2021-11-19 21:08:59,125][INFO ][test-runner-#17247%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] ^-- PageMemory tracker plugin 1.0 [21:08:59] : [Step 4/5] [2021-11-19 21:08:59,125][INFO ][test-runner-#17247%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:08:59] : [Step 4/5] [2021-11-19 21:08:59,125][INFO ][test-runner-#17247%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] [21:08:59] : [Step 4/5] [2021-11-19 21:08:59,126][INFO ][test-runner-#17247%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] ^-- TestDistibutedConfigurationPlugin 1.0 [21:08:59] : [Step 4/5] [2021-11-19 21:08:59,126][INFO ][test-runner-#17247%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:08:59] : [Step 4/5] [2021-11-19 21:08:59,126][INFO ][test-runner-#17247%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] [21:08:59] : [Step 4/5] [2021-11-19 21:08:59,126][INFO ][test-runner-#17247%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] ^-- NodeValidationPluginProvider 1.0 [21:08:59] : [Step 4/5] [2021-11-19 21:08:59,126][INFO ][test-runner-#17247%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:08:59] : [Step 4/5] [2021-11-19 21:08:59,126][INFO ][test-runner-#17247%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] [21:08:59] : [Step 4/5] [2021-11-19 21:08:59,127][INFO ][test-runner-#17247%encryption.MasterKeyChangeTest%][FailureProcessor] Configured failure handler: [hnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]]] [21:08:59]W: [org.apache.ignite:ignite-core] [2021-11-19 21:08:59,186][WARN ][test-runner-#17247%encryption.MasterKeyChangeTest%][TestRecordingCommunicationSpi] Message queue limit is set to 0 which may lead to potential OOMEs when running cache operations in FULL_ASYNC or PRIMARY_SYNC modes due to message queues growth on sender and receiver sides. [21:08:59] : [Step 4/5] [2021-11-19 21:08:59,186][INFO ][test-runner-#17247%encryption.MasterKeyChangeTest%][TestRecordingCommunicationSpi] Successfully bound communication NIO server to TCP port [port=47100, locHost=/127.0.0.1, selectorsCnt=12, selectorSpins=0, pairedConn=false] [21:08:59] : [Step 4/5] [2021-11-19 21:08:59,205][INFO ][test-runner-#17247%encryption.MasterKeyChangeTest%][GridCollisionManager] Collision resolution is disabled (all jobs will be activated upon arrival). [21:08:59] : [Step 4/5] [2021-11-19 21:08:59,205][INFO ][test-runner-#17247%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] Security status [authentication=off, sandbox=off, tls/ssl=off] [21:08:59] : [Step 4/5] [2021-11-19 21:08:59,270][INFO ][test-runner-#17247%encryption.MasterKeyChangeTest%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:08:59] : [Step 4/5] [2021-11-19 21:08:59,374][INFO ][test-runner-#17247%encryption.MasterKeyChangeTest%][MaintenanceProcessor] Resolved store directory for node persistent data: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0 [21:08:59] : [Step 4/5] [2021-11-19 21:08:59,375][INFO ][test-runner-#17247%encryption.MasterKeyChangeTest%][CacheObjectBinaryProcessorImpl] Resolved directory for serialized binary metadata: /opt/buildagent/work/7bc1c54bc719b67c/work/db/binary_meta/grid_0 [21:08:59] : [Step 4/5] [2021-11-19 21:08:59,380][INFO ][test-runner-#17247%encryption.MasterKeyChangeTest%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0 [21:08:59] : [Step 4/5] [2021-11-19 21:08:59,380][INFO ][test-runner-#17247%encryption.MasterKeyChangeTest%][FileWriteAheadLogManager] Resolved write ahead log work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0 [21:08:59] : [Step 4/5] [2021-11-19 21:08:59,380][INFO ][test-runner-#17247%encryption.MasterKeyChangeTest%][FileWriteAheadLogManager] Resolved write ahead log archive directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0 [21:08:59]W: [org.apache.ignite:ignite-core] [2021-11-19 21:08:59,750][WARN ][test-runner-#17247%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] DataRegion maxSize=10.5 MB is smaller than defaultInitialSize=268.4 MB, setting initialSize to 10.5 MB [21:08:59] : [Step 4/5] [2021-11-19 21:08:59,750][INFO ][test-runner-#17247%encryption.MasterKeyChangeTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000000.wal [21:08:59] : [Step 4/5] [2021-11-19 21:08:59,755][INFO ][test-runner-#17247%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Configured data regions initialized successfully [total=5] [21:08:59] : [Step 4/5] [2021-11-19 21:08:59,758][INFO ][test-runner-#17247%encryption.MasterKeyChangeTest%][IgniteSnapshotManager] Resolved snapshot work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/snapshots [21:08:59] : [Step 4/5] [2021-11-19 21:08:59,758][INFO ][test-runner-#17247%encryption.MasterKeyChangeTest%][IgniteSnapshotManager] Resolved temp directory for snapshot creation: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0/snp [21:08:59] : [Step 4/5] [2021-11-19 21:08:59,761][INFO ][test-runner-#17247%encryption.MasterKeyChangeTest%][ClientListenerProcessor] Client connector processor has started on TCP port 10800 [21:08:59] : [Step 4/5] [2021-11-19 21:08:59,767][INFO ][test-runner-#17247%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] Non-loopback local IPs: 172.17.0.4 [21:08:59] : [Step 4/5] [2021-11-19 21:08:59,767][INFO ][test-runner-#17247%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] Enabled local MACs: 0242AC110004 [21:08:59] : [Step 4/5] [2021-11-19 21:08:59,770][INFO ][test-runner-#17247%encryption.MasterKeyChangeTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:08:59] : [Step 4/5] [2021-11-19 21:08:59,772][INFO ][test-runner-#17247%encryption.MasterKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:08:59] : [Step 4/5] [2021-11-19 21:08:59,772][INFO ][test-runner-#17247%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:08:59] : [Step 4/5] [2021-11-19 21:08:59,775][INFO ][test-runner-#17247%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Applying lost metastore updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:08:59] : [Step 4/5] [2021-11-19 21:08:59,775][INFO ][test-runner-#17247%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=0 ms] [21:08:59] : [Step 4/5] [2021-11-19 21:08:59,776][INFO ][test-runner-#17247%encryption.MasterKeyChangeTest%][GridCacheProcessor] Restoring partition state for local groups. [21:08:59] : [Step 4/5] [2021-11-19 21:08:59,776][INFO ][test-runner-#17247%encryption.MasterKeyChangeTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=0, partitionsProcessed=0, time=0ms] [21:08:59] : [Step 4/5] [2021-11-19 21:08:59,776][INFO ][test-runner-#17247%encryption.MasterKeyChangeTest%][GridEncryptionManager] Encryption keys loaded from metastore. [grps=, masterKeyName=ignite.master.key] [21:08:59] : [Step 4/5] [2021-11-19 21:08:59,780][INFO ][test-runner-#17247%encryption.MasterKeyChangeTest%][ClusterProcessor] Cluster ID and tag has been read from metastorage: null [21:08:59] : [Step 4/5] [2021-11-19 21:08:59,781][INFO ][test-runner-#17247%encryption.MasterKeyChangeTest%][IgniteClusterImpl] Shutdown policy was updated [oldVal=null, newVal=null] [21:08:59] : [Step 4/5] [2021-11-19 21:08:59,781][INFO ][test-runner-#17247%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Checkpoint frequency deviation changed [oldVal=null, newVal=null] [21:08:59] : [Step 4/5] [2021-11-19 21:08:59,791][INFO ][test-runner-#17247%encryption.MasterKeyChangeTest%][FilePageStoreManager] Cleanup cache stores [total=1, left=0, cleanFiles=false] [21:08:59] : [Step 4/5] [2021-11-19 21:08:59,793][INFO ][test-runner-#17247%encryption.MasterKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:08:59] : [Step 4/5] [2021-11-19 21:08:59,794][INFO ][test-runner-#17247%encryption.MasterKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:08:59] : [Step 4/5] [2021-11-19 21:08:59,795][INFO ][test-runner-#17247%encryption.MasterKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:08:59] : [Step 4/5] [2021-11-19 21:08:59,796][INFO ][test-runner-#17247%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Data Regions Started: 5 [21:08:59] : [Step 4/5] [2021-11-19 21:08:59,796][INFO ][test-runner-#17247%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] ^-- sysMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:08:59] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:08:59] : [Step 4/5] ^-- default region [type=default, persistence=true, lazyAlloc=true, [21:08:59] : [Step 4/5] ... initCfg=10MB, maxCfg=10MB, usedRam=0MB, freeRam=100%, allocRam=0MB, allocTotal=0MB] [21:08:59] : [Step 4/5] ^-- metastoreMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:08:59] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:08:59] : [Step 4/5] ^-- TxLog region [type=internal, persistence=true, lazyAlloc=false, [21:08:59] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:08:59] : [Step 4/5] ^-- volatileDsMemPlc region [type=user, persistence=false, lazyAlloc=true, [21:08:59] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB] [21:08:59] : [Step 4/5] ^-- Ignite persistence [used=0MB] [21:08:59] : [Step 4/5] [21:08:59] : [Step 4/5] [2021-11-19 21:08:59,798][INFO ][test-runner-#17247%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Starting binary memory restore for: [-2100569601] [21:08:59] : [Step 4/5] [2021-11-19 21:08:59,805][INFO ][test-runner-#17247%encryption.MasterKeyChangeTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:08:59] : [Step 4/5] [2021-11-19 21:08:59,805][INFO ][test-runner-#17247%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:08:59] : [Step 4/5] [2021-11-19 21:08:59,807][INFO ][test-runner-#17247%encryption.MasterKeyChangeTest%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000000.wal, offset=0, ver=2] [21:08:59] : [Step 4/5] [2021-11-19 21:08:59,811][INFO ][test-runner-#17247%encryption.MasterKeyChangeTest%][GridCacheProcessor] Started cache in recovery mode [name=ignite-sys-cache, id=-2100569601, dataRegionName=sysMemPlc, mode=REPLICATED, atomicity=TRANSACTIONAL, backups=2147483647, mvcc=false] [21:08:59] : [Step 4/5] [2021-11-19 21:08:59,812][INFO ][test-runner-#17247%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Binary recovery performed in 14 ms. [21:08:59] : [Step 4/5] [2021-11-19 21:08:59,812][INFO ][test-runner-#17247%encryption.MasterKeyChangeTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:08:59] : [Step 4/5] [2021-11-19 21:08:59,813][INFO ][test-runner-#17247%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Applying lost cache updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:08:59] : [Step 4/5] [2021-11-19 21:08:59,869][INFO ][test-runner-#17247%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=64 ms] [21:08:59] : [Step 4/5] [2021-11-19 21:08:59,869][INFO ][test-runner-#17247%encryption.MasterKeyChangeTest%][GridCacheProcessor] Restoring partition state for local groups. [21:08:59] : [Step 4/5] [2021-11-19 21:08:59,882][INFO ][test-runner-#17247%encryption.MasterKeyChangeTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=1, partitionsProcessed=100, time=10ms] [21:09:00] : [Step 4/5] [2021-11-19 21:09:00,159][INFO ][test-runner-#17247%encryption.MasterKeyChangeTest%][TestTcpDiscoverySpi] Successfully bound to TCP port [port=47500, localHost=localhost/127.0.0.1, locNodeId=00800e71-7913-4e3d-bbce-bf44482cf000] [21:09:00] : [Step 4/5] [2021-11-19 21:09:00,170][INFO ][disco-notifier-worker-#17358%grid-0%][MvccProcessorImpl] Assigned mvcc coordinator [crd=MvccCoordinator [topVer=AffinityTopologyVersion [topVer=1, minorTopVer=0], nodeId=00800e71-7913-4e3d-bbce-bf44482cf000, ver=1637345340162, local=true, initialized=false]] [21:09:00] : [Step 4/5] [2021-11-19 21:09:00,170][INFO ][sys-#17340%grid-0%][ClusterProcessor] Writing cluster ID and tag to metastorage on ready for write ClusterIdAndTag [id=a127cb3c-24e9-4438-b77c-4fe1abc25b15, tag=heuristic_grothendieck] [21:09:00] : [Step 4/5] [2021-11-19 21:09:00,176][INFO ][disco-notifier-worker-#17358%grid-0%][ClusterProcessor] heuristic_grothendieck [21:09:00] : [Step 4/5] [2021-11-19 21:09:00,177][INFO ][disco-notifier-worker-#17358%grid-0%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustEnabled' was changed from 'null' to 'false' [21:09:00] : [Step 4/5] [2021-11-19 21:09:00,178][INFO ][disco-notifier-worker-#17358%grid-0%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustTimeout' was changed from 'null' to '300000' [21:09:00] : [Step 4/5] [2021-11-19 21:09:00,178][INFO ][disco-notifier-worker-#17358%grid-0%][IgniteTxManager] Transactions parameter 'longOperationsDumpTimeout' was changed from 'null' to '60000' [21:09:00] : [Step 4/5] [2021-11-19 21:09:00,179][INFO ][disco-notifier-worker-#17358%grid-0%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpThreshold' was changed from 'null' to '0' [21:09:00] : [Step 4/5] [2021-11-19 21:09:00,180][INFO ][disco-notifier-worker-#17358%grid-0%][IgniteTxManager] Transactions parameter 'transactionTimeDumpSamplesCoefficient' was changed from 'null' to '0.0' [21:09:00] : [Step 4/5] [2021-11-19 21:09:00,180][INFO ][disco-notifier-worker-#17358%grid-0%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpSamplesPerSecondLimit' was changed from 'null' to '5' [21:09:00] : [Step 4/5] [2021-11-19 21:09:00,181][INFO ][disco-notifier-worker-#17358%grid-0%][IgniteTxManager] Transactions parameter 'collisionsDumpInterval' was changed from 'null' to '1000' [21:09:00] : [Step 4/5] [2021-11-19 21:09:00,181][INFO ][disco-notifier-worker-#17358%grid-0%][IgniteTxManager] Transactions parameter 'txOwnerDumpRequestsAllowed' was changed from 'null' to 'true' [21:09:00] : [Step 4/5] [2021-11-19 21:09:00,182][INFO ][disco-notifier-worker-#17358%grid-0%][GridCacheDatabaseSharedManager] Historical rebalance WAL threshold changed [property=historical.rebalance.threshold, oldVal=null, newVal=500] [21:09:00] : [Step 4/5] [2021-11-19 21:09:00,197][INFO ][test-runner-#17247%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] To start Console Management & Monitoring run ignitevisorcmd.{sh|bat} [21:09:00] : [Step 4/5] [2021-11-19 21:09:00,197][INFO ][test-runner-#17247%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] [21:09:00] : [Step 4/5] [21:09:00] : [Step 4/5] >>> +-------------------------------------------+ [21:09:00] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:09:00] : [Step 4/5] >>> +-------------------------------------------+ [21:09:00] : [Step 4/5] >>> OS name: Linux 4.15.0-151-generic amd64 [21:09:00] : [Step 4/5] >>> CPU(s): 24 [21:09:00] : [Step 4/5] >>> Heap: 2.0GB [21:09:00] : [Step 4/5] >>> VM name: 16724@c4dfe9a430b2 [21:09:00] : [Step 4/5] >>> Ignite instance name: grid-0 [21:09:00] : [Step 4/5] >>> Local node [ID=00800E71-7913-4E3D-BBCE-BF44482CF000, order=1, clientMode=false] [21:09:00] : [Step 4/5] >>> Local node addresses: [127.0.0.1] [21:09:00] : [Step 4/5] >>> Local ports: TCP:10800 TCP:47100 TCP:47500 [21:09:00] : [Step 4/5] [21:09:00] : [Step 4/5] [2021-11-19 21:09:00,198][INFO ][test-runner-#17247%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] >>> Ignite cluster is in INACTIVE state (limited functionality available). Use control.(sh|bat) script or IgniteCluster.state(ClusterState.ACTIVE) to change the state. [21:09:00] : [Step 4/5] [2021-11-19 21:09:00,199][INFO ][test-runner-#17247%encryption.MasterKeyChangeTest%][GridDiscoveryManager] Topology snapshot [ver=1, locNode=00800e71, servers=1, clients=0, state=INACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=00800e71-7913-4e3d-bbce-bf44482cf000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:09:00] : [Step 4/5] [2021-11-19 21:09:00,200][INFO ][test-runner-#17247%encryption.MasterKeyChangeTest%][G] Node started : [stage="Configure system pool" (0 ms),stage="Start managers" (277 ms),stage="Configure binary metadata" (2 ms),stage="Start processors" (389 ms),stage="Start 'StanByClusterTestProvider' plugin" (0 ms),stage="Start 'PageMemory tracker plugin' plugin" (0 ms),stage="Start 'TestDistibutedConfigurationPlugin' plugin" (0 ms),stage="Start 'NodeValidationPluginProvider' plugin" (0 ms),stage="Init metastore" (24 ms),stage="Init and start regions" (7 ms),stage="Restore binary memory" (14 ms),stage="Restore logical state" (69 ms),stage="Finish recovery" (276 ms),stage="Join topology" (13 ms),stage="Await transition" (1 ms),stage="Await exchange" (25 ms),stage="Total time" (1097 ms)] [21:09:00] : [Step 4/5] [2021-11-19 21:09:00,201][INFO ][test-runner-#17247%encryption.MasterKeyChangeTest%][root] Node started with the following configuration [id=00800e71-7913-4e3d-bbce-bf44482cf000, marshaller=BinaryMarshaller [], discovery=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=5000, ackTimeout=5000, marsh=JdkMarshaller [clsFilter=org.apache.ignite.marshaller.MarshallerUtils$1@3fca7ad5], reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], binaryCfg=null, lateAff=true] [21:09:00]W: [org.apache.ignite:ignite-core] [2021-11-19 21:09:00,206][WARN ][test-runner-#17247%encryption.MasterKeyChangeTest%][G] Ignite work directory is not provided, automatically resolved to: /opt/buildagent/work/7bc1c54bc719b67c/work [21:09:00] : [Step 4/5] [2021-11-19 21:09:00,207][INFO ][test-runner-#17247%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] [21:09:00] : [Step 4/5] [21:09:00] : [Step 4/5] >>> __________ ________________ [21:09:00] : [Step 4/5] >>> / _/ ___/ |/ / _/_ __/ __/ [21:09:00] : [Step 4/5] >>> _/ // (7 7 // / / / / _/ [21:09:00] : [Step 4/5] >>> /___/\___/_/|_/___/ /_/ /___/ [21:09:00] : [Step 4/5] >>> [21:09:00] : [Step 4/5] >>> ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:09:00] : [Step 4/5] >>> 2021 Copyright(C) Apache Software Foundation [21:09:00] : [Step 4/5] >>> [21:09:00] : [Step 4/5] >>> Ignite documentation: http://ignite.apache.org [21:09:00] : [Step 4/5] [21:09:00] : [Step 4/5] [2021-11-19 21:09:00,207][INFO ][test-runner-#17247%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] Config URL: n/a [21:09:00] : [Step 4/5] [2021-11-19 21:09:00,208][INFO ][test-runner-#17247%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] IgniteConfiguration [igniteInstanceName=grid-1, pubPoolSize=24, svcPoolSize=24, callbackPoolSize=24, stripedPoolSize=24, sysPoolSize=24, mgmtPoolSize=4, dataStreamerPoolSize=24, utilityCachePoolSize=24, utilityCacheKeepAliveTime=60000, p2pPoolSize=2, qryPoolSize=24, buildIdxPoolSize=4, igniteHome=/opt/buildagent/work/7bc1c54bc719b67c, igniteWorkDir=/opt/buildagent/work/7bc1c54bc719b67c/work, mbeanSrv=com.sun.jmx.mbeanserver.JmxMBeanServer@6fe85038, nodeId=1057f7c4-3383-4522-9222-19e353cdc001, marsh=BinaryMarshaller [], marshLocJobs=false, daemon=false, p2pEnabled=true, netTimeout=10000, netCompressionLevel=1, sndRetryDelay=1000, sndRetryCnt=3, metricsHistSize=10000, metricsUpdateFreq=1000, metricsExpTime=9223372036854775807, discoSpi=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=0, ackTimeout=0, marsh=null, reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], segPlc=STOP, segResolveAttempts=2, waitForSegOnStart=true, allResolversPassReq=true, segChkFreq=10000, commSpi=TcpCommunicationSpi [connectGate=org.apache.ignite.spi.communication.tcp.internal.ConnectGateway@6facd6ca, ctxInitLatch=java.util.concurrent.CountDownLatch@375d805[Count = 1], stopping=false, clientPool=null, nioSrvWrapper=null, stateProvider=null], evtSpi=MemoryEventStorageSpi [expireAgeMs=9223372036854775807, expireCnt=10000, filter=null], colSpi=NoopCollisionSpi [], deploySpi=LocalDeploymentSpi [], indexingSpi=org.apache.ignite.spi.indexing.noop.NoopIndexingSpi@3d0226d4, addrRslvr=null, encryptionSpi=org.apache.ignite.spi.encryption.keystore.KeystoreEncryptionSpi@781e78a8, tracingSpi=org.apache.ignite.spi.tracing.NoopTracingSpi@2e331ae2, clientMode=false, rebalanceThreadPoolSize=4, rebalanceTimeout=10000, rebalanceBatchesPrefetchCnt=3, rebalanceThrottle=0, rebalanceBatchSize=524288, txCfg=TransactionConfiguration [txSerEnabled=false, dfltIsolation=REPEATABLE_READ, dfltConcurrency=PESSIMISTIC, dfltTxTimeout=0, txTimeoutOnPartitionMapExchange=0, deadlockTimeout=10000, pessimisticTxLogSize=0, pessimisticTxLogLinger=10000, tmLookupClsName=null, txManagerFactory=null, useJtaSync=false], cacheSanityCheckEnabled=true, discoStartupDelay=60000, deployMode=SHARED, p2pMissedCacheSize=100, locHost=127.0.0.1, timeSrvPortBase=31100, timeSrvPortRange=100, failureDetectionTimeout=10000, sysWorkerBlockedTimeout=null, clientFailureDetectionTimeout=10000, metricsLogFreq=0, connectorCfg=null, odbcCfg=null, warmupClos=null, atomicCfg=AtomicConfiguration [seqReserveSize=1000, cacheMode=PARTITIONED, backups=1, aff=null, grpName=null], classLdr=null, sslCtxFactory=null, platformCfg=null, binaryCfg=null, memCfg=null, pstCfg=null, dsCfg=DataStorageConfiguration [sysRegionInitSize=41943040, sysRegionMaxSize=104857600, pageSize=4096, concLvl=0, dfltDataRegConf=DataRegionConfiguration [name=default, maxSize=10485760, initSize=268435456, swapPath=null, pageEvictionMode=DISABLED, pageReplacementMode=CLOCK, evictionThreshold=0.9, emptyPagesPoolSize=100, metricsEnabled=false, metricsSubIntervalCount=5, metricsRateTimeInterval=60000, persistenceEnabled=true, checkpointPageBufSize=0, lazyMemoryAllocation=true, warmUpCfg=null], dataRegions=null, storagePath=null, checkpointFreq=180000, lockWaitTime=10000, checkpointThreads=4, checkpointWriteOrder=SEQUENTIAL, walHistSize=20, maxWalArchiveSize=1073741824, walSegments=10, walSegmentSize=67108864, walPath=db/wal, walArchivePath=db/wal/archive, cdcWalPath=db/wal/cdc, cdcEnabled=false, metricsEnabled=false, walMode=FSYNC, walTlbSize=131072, walBuffSize=0, walFlushFreq=2000, walFsyncDelay=1000, walRecordIterBuffSize=67108864, alwaysWriteFullPages=false, fileIOFactory=org.apache.ignite.internal.processors.cache.persistence.file.AsyncFileIOFactory@2060564, metricsSubIntervalCnt=5, metricsRateTimeInterval=60000, walAutoArchiveAfterInactivity=-1, walForceArchiveTimeout=-1, writeThrottlingEnabled=false, walCompactionEnabled=false, walCompactionLevel=1, checkpointReadLockTimeout=null, walPageCompression=DISABLED, walPageCompressionLevel=null, dfltWarmUpCfg=null, encCfg=org.apache.ignite.configuration.EncryptionConfiguration@34b90aa9, defragmentationThreadPoolSize=4, minWalArchiveSize=-1], snapshotPath=snapshots, activeOnStart=true, activeOnStartPropSetFlag=false, autoActivation=true, autoActivationPropSetFlag=false, clusterStateOnStart=null, sqlConnCfg=null, cliConnCfg=ClientConnectorConfiguration [host=null, port=10800, portRange=100, sockSndBufSize=0, sockRcvBufSize=0, tcpNoDelay=true, maxOpenCursorsPerConn=128, threadPoolSize=24, selectorCnt=12, idleTimeout=0, handshakeTimeout=10000, jdbcEnabled=true, odbcEnabled=true, thinCliEnabled=true, sslEnabled=false, useIgniteSslCtxFactory=true, sslClientAuth=false, sslCtxFactory=null, thinCliCfg=ThinClientConfiguration [maxActiveTxPerConn=100, maxActiveComputeTasksPerConn=0]], mvccVacuumThreadCnt=2, mvccVacuumFreq=5000, authEnabled=false, failureHnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]], commFailureRslvr=null, sqlCfg=SqlConfiguration [longQryWarnTimeout=3000, dfltQryTimeout=0, sqlQryHistSize=1000, validationEnabled=false], asyncContinuationExecutor=null] [21:09:00] : [Step 4/5] [2021-11-19 21:09:00,216][INFO ][test-runner-#17247%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] Daemon mode: off [21:09:00] : [Step 4/5] [2021-11-19 21:09:00,217][INFO ][test-runner-#17247%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] OS: Linux 4.15.0-151-generic amd64 [21:09:00] : [Step 4/5] [2021-11-19 21:09:00,217][INFO ][test-runner-#17247%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] OS user: teamcity [21:09:00] : [Step 4/5] [2021-11-19 21:09:00,217][INFO ][test-runner-#17247%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] PID: 16724 [21:09:00] : [Step 4/5] [2021-11-19 21:09:00,217][INFO ][test-runner-#17247%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] Language runtime: Java Platform API Specification ver. 1.8 [21:09:00] : [Step 4/5] [2021-11-19 21:09:00,218][INFO ][test-runner-#17247%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] VM information: Java(TM) SE Runtime Environment 1.8.0_261-b12 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 25.261-b12 [21:09:00] : [Step 4/5] [2021-11-19 21:09:00,218][INFO ][test-runner-#17247%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] VM total memory: 1.9GB [21:09:00] : [Step 4/5] [2021-11-19 21:09:00,218][INFO ][test-runner-#17247%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] Remote Management [restart: off, REST: off, JMX (remote: off)] [21:09:00] : [Step 4/5] [2021-11-19 21:09:00,218][INFO ][test-runner-#17247%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] Logger: GridTestLog4jLogger [quiet=false, config=null] [21:09:00] : [Step 4/5] [2021-11-19 21:09:00,219][INFO ][test-runner-#17247%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] IGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c [21:09:00] : [Step 4/5] [2021-11-19 21:09:00,219][INFO ][test-runner-#17247%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] VM arguments: [-DIGNITE_DUMP_THREADS_ON_FAILURE=false, -DMono=/usr/bin/mono-sgen, -DMono4.0_x64=/usr/lib/mono/4.0, -DMono4.5_x64=/usr/lib/mono/4.5, -DMonoVersion=6.12.0.90, -DSKIP_BUILD=false, -Dagent.home.dir=/opt/buildagent, -Dagent.name=aitc-lin02_03, -Dagent.ownPort=9090, -Dagent.work.dir=/opt/buildagent/work, -Dbuild.number=95, -Dbuild.vcs.number=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.1=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.GitHubApacheIgnite=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dclassworlds.conf=/opt/buildagent/temp/buildTmp/teamcity.m2.conf, -Dcom.jetbrains.maven.watcher.report.file=/opt/buildagent/temp/buildTmp/maven-build-info.xml, -Djava.io.tmpdir=/opt/buildagent/temp/buildTmp, -Dmaven.home=/opt/buildagent/tools/maven3_6, -Dmaven.multiModuleProjectDirectory=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.agent.cpuBenchmark=457, -Dteamcity.agent.dotnet.agent_url=http://localhost:9090/RPC2, -Dteamcity.agent.dotnet.build_id=6278078, -Dteamcity.auth.password=*******, -Dteamcity.auth.userId=TeamCityBuildId=6278078, -Dteamcity.build.changedFiles.file=/opt/buildagent/temp/buildTmp/changedFiles6342607772318147725.txt, -Dteamcity.build.checkoutDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.build.id=6278078, -Dteamcity.build.properties.file=/opt/buildagent/temp/buildTmp/teamcity.build5164517880467851002.properties, -Dteamcity.build.tempDir=/opt/buildagent/temp/buildTmp, -Dteamcity.build.workingDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.buildConfName=Basic 3, -Dteamcity.buildType.id=IgniteTests24Java8_Basic3, -Dteamcity.configuration.properties.file=/opt/buildagent/temp/buildTmp/teamcity.config5591980786735343870.properties, -Dteamcity.maven.userSettings.path=/opt/buildagent/temp/buildTmp/maven_settings_585072866407032347.xml, -Dteamcity.maven.watcher.home=/opt/buildagent/plugins/mavenPlugin/maven-watcher-jdk16, -Dteamcity.projectName=Ignite Tests 2.x (JDK 8/11), -Dteamcity.runner.properties.file=/opt/buildagent/temp/buildTmp/teamcity.runner9098465561618137420.properties, -Dteamcity.tests.recentlyFailedTests.file=/opt/buildagent/temp/buildTmp/testsToRunFirst3891775683130404069.txt, -Dteamcity.version=2021.2 (build 99542), -ea, -Xms2g, -Xmx2g, -XX:+HeapDumpOnOutOfMemoryError, -DIGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_TEST_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_UPDATE_NOTIFIER=false, -DIGNITE_NO_DISCO_ORDER=true, -DIGNITE_PERFORMANCE_SUGGESTIONS_DISABLED=true, -Djava.net.preferIPv4Stack=true, -DTEST_SCALE_FACTOR=1.0, -DIGNITE_TEST_PROP_LOG4J_FILE=log4j-tc-test.xml, -DIGNITE_QUIET=false, -DIGNITE_MARSHAL_BUFFERS_RECHECK=1000, -Dmaven.repo.local=/opt/buildagent/.m2/repository] [21:09:00] : [Step 4/5] [2021-11-19 21:09:00,224][INFO ][test-runner-#17247%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] System cache's DataRegion size is configured to 40 MB. Use DataStorageConfiguration.systemRegionInitialSize property to change the setting. [21:09:00] : [Step 4/5] [2021-11-19 21:09:00,225][INFO ][test-runner-#17247%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] Configured caches [in 'sysMemPlc' dataRegion: ['ignite-sys-cache']] [21:09:00]W: [org.apache.ignite:ignite-core] [2021-11-19 21:09:00,225][WARN ][test-runner-#17247%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] Peer class loading is enabled (disable it in production for performance and deployment consistency reasons) [21:09:00] : [Step 4/5] [2021-11-19 21:09:00,226][INFO ][test-runner-#17247%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] 3-rd party licenses can be found at: /opt/buildagent/work/7bc1c54bc719b67c/libs/licenses [21:09:00] : [Step 4/5] [2021-11-19 21:09:00,231][INFO ][test-runner-#17247%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] Configured plugins: [21:09:00] : [Step 4/5] [2021-11-19 21:09:00,231][INFO ][test-runner-#17247%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] ^-- StanByClusterTestProvider 1.0 [21:09:00] : [Step 4/5] [2021-11-19 21:09:00,232][INFO ][test-runner-#17247%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:09:00] : [Step 4/5] [2021-11-19 21:09:00,232][INFO ][test-runner-#17247%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] [21:09:00] : [Step 4/5] [2021-11-19 21:09:00,232][INFO ][test-runner-#17247%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] ^-- PageMemory tracker plugin 1.0 [21:09:00] : [Step 4/5] [2021-11-19 21:09:00,232][INFO ][test-runner-#17247%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:09:00] : [Step 4/5] [2021-11-19 21:09:00,233][INFO ][test-runner-#17247%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] [21:09:00] : [Step 4/5] [2021-11-19 21:09:00,233][INFO ][test-runner-#17247%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] ^-- TestDistibutedConfigurationPlugin 1.0 [21:09:00] : [Step 4/5] [2021-11-19 21:09:00,233][INFO ][test-runner-#17247%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:09:00] : [Step 4/5] [2021-11-19 21:09:00,233][INFO ][test-runner-#17247%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] [21:09:00] : [Step 4/5] [2021-11-19 21:09:00,234][INFO ][test-runner-#17247%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] ^-- NodeValidationPluginProvider 1.0 [21:09:00] : [Step 4/5] [2021-11-19 21:09:00,234][INFO ][test-runner-#17247%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:09:00] : [Step 4/5] [2021-11-19 21:09:00,234][INFO ][test-runner-#17247%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] [21:09:00] : [Step 4/5] [2021-11-19 21:09:00,235][INFO ][test-runner-#17247%encryption.MasterKeyChangeTest%][FailureProcessor] Configured failure handler: [hnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]]] [21:09:00] : [Step 4/5] [2021-11-19 21:09:00,352][INFO ][test-runner-#17247%encryption.MasterKeyChangeTest%][TestRecordingCommunicationSpi] Successfully bound communication NIO server to TCP port [port=47101, locHost=/127.0.0.1, selectorsCnt=12, selectorSpins=0, pairedConn=false] [21:09:00]W: [org.apache.ignite:ignite-core] [2021-11-19 21:09:00,353][WARN ][test-runner-#17247%encryption.MasterKeyChangeTest%][TestRecordingCommunicationSpi] Message queue limit is set to 0 which may lead to potential OOMEs when running cache operations in FULL_ASYNC or PRIMARY_SYNC modes due to message queues growth on sender and receiver sides. [21:09:00] : [Step 4/5] [2021-11-19 21:09:00,361][INFO ][test-runner-#17247%encryption.MasterKeyChangeTest%][GridCollisionManager] Collision resolution is disabled (all jobs will be activated upon arrival). [21:09:00] : [Step 4/5] [2021-11-19 21:09:00,362][INFO ][test-runner-#17247%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] Security status [authentication=off, sandbox=off, tls/ssl=off] [21:09:00] : [Step 4/5] [2021-11-19 21:09:00,423][INFO ][test-runner-#17247%encryption.MasterKeyChangeTest%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:09:00] : [Step 4/5] [2021-11-19 21:09:00,513][INFO ][test-runner-#17247%encryption.MasterKeyChangeTest%][MaintenanceProcessor] Resolved store directory for node persistent data: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1 [21:09:00] : [Step 4/5] [2021-11-19 21:09:00,514][INFO ][test-runner-#17247%encryption.MasterKeyChangeTest%][CacheObjectBinaryProcessorImpl] Resolved directory for serialized binary metadata: /opt/buildagent/work/7bc1c54bc719b67c/work/db/binary_meta/grid_1 [21:09:00] : [Step 4/5] [2021-11-19 21:09:00,519][INFO ][test-runner-#17247%encryption.MasterKeyChangeTest%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1 [21:09:00] : [Step 4/5] [2021-11-19 21:09:00,519][INFO ][test-runner-#17247%encryption.MasterKeyChangeTest%][FileWriteAheadLogManager] Resolved write ahead log work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1 [21:09:00] : [Step 4/5] [2021-11-19 21:09:00,519][INFO ][test-runner-#17247%encryption.MasterKeyChangeTest%][FileWriteAheadLogManager] Resolved write ahead log archive directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1 [21:09:00] : [Step 4/5] [2021-11-19 21:09:00,844][INFO ][test-runner-#17247%encryption.MasterKeyChangeTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000000.wal [21:09:00] : [Step 4/5] [2021-11-19 21:09:00,849][INFO ][test-runner-#17247%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Configured data regions initialized successfully [total=5] [21:09:00] : [Step 4/5] [2021-11-19 21:09:00,852][INFO ][test-runner-#17247%encryption.MasterKeyChangeTest%][IgniteSnapshotManager] Resolved snapshot work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/snapshots [21:09:00] : [Step 4/5] [2021-11-19 21:09:00,853][INFO ][test-runner-#17247%encryption.MasterKeyChangeTest%][IgniteSnapshotManager] Resolved temp directory for snapshot creation: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1/snp [21:09:00] : [Step 4/5] [2021-11-19 21:09:00,855][INFO ][test-runner-#17247%encryption.MasterKeyChangeTest%][ClientListenerProcessor] Client connector processor has started on TCP port 10801 [21:09:00] : [Step 4/5] [2021-11-19 21:09:00,857][INFO ][test-runner-#17247%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] Non-loopback local IPs: 172.17.0.4 [21:09:00] : [Step 4/5] [2021-11-19 21:09:00,857][INFO ][test-runner-#17247%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] Enabled local MACs: 0242AC110004 [21:09:00] : [Step 4/5] [2021-11-19 21:09:00,858][INFO ][test-runner-#17247%encryption.MasterKeyChangeTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:09:00] : [Step 4/5] [2021-11-19 21:09:00,859][INFO ][test-runner-#17247%encryption.MasterKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:09:00] : [Step 4/5] [2021-11-19 21:09:00,859][INFO ][test-runner-#17247%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:09:00] : [Step 4/5] [2021-11-19 21:09:00,861][INFO ][test-runner-#17247%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Applying lost metastore updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:09:00] : [Step 4/5] [2021-11-19 21:09:00,861][INFO ][test-runner-#17247%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=0 ms] [21:09:00] : [Step 4/5] [2021-11-19 21:09:00,862][INFO ][test-runner-#17247%encryption.MasterKeyChangeTest%][GridCacheProcessor] Restoring partition state for local groups. [21:09:00] : [Step 4/5] [2021-11-19 21:09:00,862][INFO ][test-runner-#17247%encryption.MasterKeyChangeTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=0, partitionsProcessed=0, time=0ms] [21:09:00] : [Step 4/5] [2021-11-19 21:09:00,862][INFO ][test-runner-#17247%encryption.MasterKeyChangeTest%][GridEncryptionManager] Encryption keys loaded from metastore. [grps=, masterKeyName=ignite.master.key] [21:09:00] : [Step 4/5] [2021-11-19 21:09:00,863][INFO ][test-runner-#17247%encryption.MasterKeyChangeTest%][ClusterProcessor] Cluster ID and tag has been read from metastorage: null [21:09:00] : [Step 4/5] [2021-11-19 21:09:00,863][INFO ][test-runner-#17247%encryption.MasterKeyChangeTest%][IgniteClusterImpl] Shutdown policy was updated [oldVal=null, newVal=null] [21:09:00] : [Step 4/5] [2021-11-19 21:09:00,864][INFO ][test-runner-#17247%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Checkpoint frequency deviation changed [oldVal=null, newVal=null] [21:09:00] : [Step 4/5] [2021-11-19 21:09:00,873][INFO ][test-runner-#17247%encryption.MasterKeyChangeTest%][FilePageStoreManager] Cleanup cache stores [total=1, left=0, cleanFiles=false] [21:09:00] : [Step 4/5] [2021-11-19 21:09:00,875][INFO ][test-runner-#17247%encryption.MasterKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:09:00] : [Step 4/5] [2021-11-19 21:09:00,876][INFO ][test-runner-#17247%encryption.MasterKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:09:00] : [Step 4/5] [2021-11-19 21:09:00,877][INFO ][test-runner-#17247%encryption.MasterKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:09:00] : [Step 4/5] [2021-11-19 21:09:00,878][INFO ][test-runner-#17247%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Data Regions Started: 5 [21:09:00] : [Step 4/5] [2021-11-19 21:09:00,878][INFO ][test-runner-#17247%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] ^-- sysMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:09:00] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:09:00] : [Step 4/5] ^-- default region [type=default, persistence=true, lazyAlloc=true, [21:09:00] : [Step 4/5] ... initCfg=10MB, maxCfg=10MB, usedRam=0MB, freeRam=100%, allocRam=0MB, allocTotal=0MB] [21:09:00] : [Step 4/5] ^-- metastoreMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:09:00] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:09:00] : [Step 4/5] ^-- TxLog region [type=internal, persistence=true, lazyAlloc=false, [21:09:00] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:09:00] : [Step 4/5] ^-- volatileDsMemPlc region [type=user, persistence=false, lazyAlloc=true, [21:09:00] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB] [21:09:00] : [Step 4/5] ^-- Ignite persistence [used=0MB] [21:09:00] : [Step 4/5] [21:09:00] : [Step 4/5] [2021-11-19 21:09:00,879][INFO ][test-runner-#17247%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Starting binary memory restore for: [-2100569601] [21:09:00] : [Step 4/5] [2021-11-19 21:09:00,887][INFO ][test-runner-#17247%encryption.MasterKeyChangeTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:09:00] : [Step 4/5] [2021-11-19 21:09:00,887][INFO ][test-runner-#17247%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:09:00] : [Step 4/5] [2021-11-19 21:09:00,888][INFO ][test-runner-#17247%encryption.MasterKeyChangeTest%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000000.wal, offset=0, ver=2] [21:09:00] : [Step 4/5] [2021-11-19 21:09:00,894][INFO ][test-runner-#17247%encryption.MasterKeyChangeTest%][GridCacheProcessor] Started cache in recovery mode [name=ignite-sys-cache, id=-2100569601, dataRegionName=sysMemPlc, mode=REPLICATED, atomicity=TRANSACTIONAL, backups=2147483647, mvcc=false] [21:09:00] : [Step 4/5] [2021-11-19 21:09:00,895][INFO ][test-runner-#17247%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Binary recovery performed in 16 ms. [21:09:00] : [Step 4/5] [2021-11-19 21:09:00,895][INFO ][test-runner-#17247%encryption.MasterKeyChangeTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:09:00] : [Step 4/5] [2021-11-19 21:09:00,895][INFO ][test-runner-#17247%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Applying lost cache updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:09:00] : [Step 4/5] [2021-11-19 21:09:00,949][INFO ][test-runner-#17247%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=51 ms] [21:09:00] : [Step 4/5] [2021-11-19 21:09:00,949][INFO ][test-runner-#17247%encryption.MasterKeyChangeTest%][GridCacheProcessor] Restoring partition state for local groups. [21:09:00] : [Step 4/5] [2021-11-19 21:09:00,955][INFO ][test-runner-#17247%encryption.MasterKeyChangeTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=1, partitionsProcessed=100, time=10ms] [21:09:01] : [Step 4/5] [2021-11-19 21:09:01,219][INFO ][test-runner-#17247%encryption.MasterKeyChangeTest%][TestTcpDiscoverySpi] Successfully bound to TCP port [port=47501, localHost=localhost/127.0.0.1, locNodeId=1057f7c4-3383-4522-9222-19e353cdc001] [21:09:01] : [Step 4/5] [2021-11-19 21:09:01,223][INFO ][tcp-disco-srvr-[:47500]-#907%grid-0%-#17360%grid-0%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=53633] [21:09:01] : [Step 4/5] [2021-11-19 21:09:01,224][INFO ][tcp-disco-srvr-[:47500]-#907%grid-0%-#17360%grid-0%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=53633] [21:09:01] : [Step 4/5] [2021-11-19 21:09:01,224][INFO ][tcp-disco-sock-reader-[]-#913%grid-0%-#17479%grid-0%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:53633, rmtPort=53633] [21:09:01] : [Step 4/5] [2021-11-19 21:09:01,226][INFO ][tcp-disco-sock-reader-[1057f7c4 127.0.0.1:53633]-#913%grid-0%-#17479%grid-0%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=1057f7c4-3383-4522-9222-19e353cdc001, rmtAddr=/127.0.0.1:53633] [21:09:01] : [Step 4/5] [2021-11-19 21:09:01,231][INFO ][tcp-disco-srvr-[:47501]-#912%grid-1%-#17478%grid-1%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=35303] [21:09:01] : [Step 4/5] [2021-11-19 21:09:01,232][INFO ][tcp-disco-srvr-[:47501]-#912%grid-1%-#17478%grid-1%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=35303] [21:09:01] : [Step 4/5] [2021-11-19 21:09:01,232][INFO ][tcp-disco-sock-reader-[]-#914%grid-1%-#17480%grid-1%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:35303, rmtPort=35303] [21:09:01] : [Step 4/5] [2021-11-19 21:09:01,233][INFO ][tcp-disco-sock-reader-[]-#914%grid-1%-#17480%grid-1%][TestTcpDiscoverySpi] Received ping request from the remote node [rmtNodeId=00800e71-7913-4e3d-bbce-bf44482cf000, rmtAddr=/127.0.0.1:35303, rmtPort=35303] [21:09:01] : [Step 4/5] [2021-11-19 21:09:01,234][INFO ][tcp-disco-sock-reader-[]-#914%grid-1%-#17480%grid-1%][TestTcpDiscoverySpi] Finished writing ping response [rmtNodeId=00800e71-7913-4e3d-bbce-bf44482cf000, rmtAddr=/127.0.0.1:35303, rmtPort=35303] [21:09:01]W: [org.apache.ignite:ignite-core] [2021-11-19 21:09:01,234][WARN ][tcp-disco-sock-reader-[]-#914%grid-1%-#17480%grid-1%][TestTcpDiscoverySpi] Failed to shutdown socket [21:09:01]W: [org.apache.ignite:ignite-core] java.net.SocketException: Socket output is already shutdown [21:09:01]W: [org.apache.ignite:ignite-core] at java.net.Socket.shutdownOutput(Socket.java:1572) [21:09:01]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.close(IgniteUtils.java:4247) [21:09:01]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.discovery.tcp.ServerImpl$SocketReader.body(ServerImpl.java:7370) [21:09:01]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.IgniteSpiThread.run(IgniteSpiThread.java:58) [21:09:01] : [Step 4/5] [2021-11-19 21:09:01,235][INFO ][tcp-disco-sock-reader-[]-#914%grid-1%-#17480%grid-1%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:35303, rmtPort=35303, rmtNodeId=null] [21:09:01] : [Step 4/5] [2021-11-19 21:09:01,234][INFO ][tcp-disco-sock-reader-[1057f7c4 127.0.0.1:53633]-#913%grid-0%-#17479%grid-0%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:53633, rmtPort=53633, rmtNodeId=1057f7c4-3383-4522-9222-19e353cdc001] [21:09:01] : [Step 4/5] [2021-11-19 21:09:01,237][INFO ][tcp-disco-msg-worker-[crd]-#906%grid-0%-#17359%grid-0%][GridEncryptionManager] Joining node doesn't have stored group keys [node=1057f7c4-3383-4522-9222-19e353cdc001] [21:09:01] : [Step 4/5] [2021-11-19 21:09:01,244][INFO ][tcp-disco-msg-worker-[crd]-#906%grid-0%-#17359%grid-0%][TestTcpDiscoverySpi] New next node [newNext=TcpDiscoveryNode [id=1057f7c4-3383-4522-9222-19e353cdc001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=0, intOrder=2, lastExchangeTime=1637345341223, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false]] [21:09:01] : [Step 4/5] [2021-11-19 21:09:01,244][INFO ][tcp-disco-srvr-[:47501]-#912%grid-1%-#17478%grid-1%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=56009] [21:09:01] : [Step 4/5] [2021-11-19 21:09:01,245][INFO ][tcp-disco-srvr-[:47501]-#912%grid-1%-#17478%grid-1%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=56009] [21:09:01] : [Step 4/5] [2021-11-19 21:09:01,245][INFO ][tcp-disco-sock-reader-[]-#915%grid-1%-#17481%grid-1%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:56009, rmtPort=56009] [21:09:01] : [Step 4/5] [2021-11-19 21:09:01,246][INFO ][tcp-disco-sock-reader-[00800e71 127.0.0.1:56009]-#915%grid-1%-#17481%grid-1%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=00800e71-7913-4e3d-bbce-bf44482cf000, rmtAddr=/127.0.0.1:56009] [21:09:01] : [Step 4/5] [2021-11-19 21:09:01,249][INFO ][tcp-disco-msg-worker-[]-#911%grid-1%-#17477%grid-1%][TestTcpDiscoverySpi] New next node [newNext=TcpDiscoveryNode [id=00800e71-7913-4e3d-bbce-bf44482cf000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345341243, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false]] [21:09:01] : [Step 4/5] [2021-11-19 21:09:01,250][INFO ][tcp-disco-srvr-[:47500]-#907%grid-0%-#17360%grid-0%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=39059] [21:09:01] : [Step 4/5] [2021-11-19 21:09:01,250][INFO ][tcp-disco-srvr-[:47500]-#907%grid-0%-#17360%grid-0%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=39059] [21:09:01] : [Step 4/5] [2021-11-19 21:09:01,250][INFO ][tcp-disco-sock-reader-[]-#916%grid-0%-#17482%grid-0%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:39059, rmtPort=39059] [21:09:01] : [Step 4/5] [2021-11-19 21:09:01,251][INFO ][tcp-disco-sock-reader-[1057f7c4 127.0.0.1:39059]-#916%grid-0%-#17482%grid-0%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=1057f7c4-3383-4522-9222-19e353cdc001, rmtAddr=/127.0.0.1:39059] [21:09:01] : [Step 4/5] [2021-11-19 21:09:01,253][INFO ][disco-event-worker-#17362%grid-0%][GridDiscoveryManager] Added new node to topology: TcpDiscoveryNode [id=1057f7c4-3383-4522-9222-19e353cdc001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637345341223, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false] [21:09:01] : [Step 4/5] [2021-11-19 21:09:01,254][INFO ][disco-event-worker-#17362%grid-0%][GridDiscoveryManager] Topology snapshot [ver=2, locNode=00800e71, servers=2, clients=0, state=INACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=00800e71-7913-4e3d-bbce-bf44482cf000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=1057f7c4-3383-4522-9222-19e353cdc001, consistentId=grid-1, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:09:01] : [Step 4/5] [2021-11-19 21:09:01,256][INFO ][tcp-disco-msg-worker-[00800e71 127.0.0.1:47500]-#911%grid-1%-#17477%grid-1%][ClusterProcessor] heuristic_grothendieck [21:09:01] : [Step 4/5] [2021-11-19 21:09:01,257][INFO ][tcp-disco-msg-worker-[00800e71 127.0.0.1:47500]-#911%grid-1%-#17477%grid-1%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustEnabled' was changed from 'null' to 'false' [21:09:01] : [Step 4/5] [2021-11-19 21:09:01,257][INFO ][tcp-disco-msg-worker-[00800e71 127.0.0.1:47500]-#911%grid-1%-#17477%grid-1%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustTimeout' was changed from 'null' to '300000' [21:09:01] : [Step 4/5] [2021-11-19 21:09:01,257][INFO ][tcp-disco-msg-worker-[00800e71 127.0.0.1:47500]-#911%grid-1%-#17477%grid-1%][IgniteTxManager] Transactions parameter 'longOperationsDumpTimeout' was changed from 'null' to '60000' [21:09:01] : [Step 4/5] [2021-11-19 21:09:01,258][INFO ][tcp-disco-msg-worker-[00800e71 127.0.0.1:47500]-#911%grid-1%-#17477%grid-1%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpThreshold' was changed from 'null' to '0' [21:09:01] : [Step 4/5] [2021-11-19 21:09:01,258][INFO ][tcp-disco-msg-worker-[00800e71 127.0.0.1:47500]-#911%grid-1%-#17477%grid-1%][IgniteTxManager] Transactions parameter 'transactionTimeDumpSamplesCoefficient' was changed from 'null' to '0.0' [21:09:01] : [Step 4/5] [2021-11-19 21:09:01,258][INFO ][tcp-disco-msg-worker-[00800e71 127.0.0.1:47500]-#911%grid-1%-#17477%grid-1%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpSamplesPerSecondLimit' was changed from 'null' to '5' [21:09:01] : [Step 4/5] [2021-11-19 21:09:01,258][INFO ][tcp-disco-msg-worker-[00800e71 127.0.0.1:47500]-#911%grid-1%-#17477%grid-1%][IgniteTxManager] Transactions parameter 'collisionsDumpInterval' was changed from 'null' to '1000' [21:09:01] : [Step 4/5] [2021-11-19 21:09:01,259][INFO ][tcp-disco-msg-worker-[00800e71 127.0.0.1:47500]-#911%grid-1%-#17477%grid-1%][IgniteTxManager] Transactions parameter 'txOwnerDumpRequestsAllowed' was changed from 'null' to 'true' [21:09:01] : [Step 4/5] [2021-11-19 21:09:01,259][INFO ][tcp-disco-msg-worker-[00800e71 127.0.0.1:47500]-#911%grid-1%-#17477%grid-1%][GridCacheDatabaseSharedManager] Historical rebalance WAL threshold changed [property=historical.rebalance.threshold, oldVal=null, newVal=500] [21:09:01] : [Step 4/5] [2021-11-19 21:09:01,260][INFO ][disco-notifier-worker-#17476%grid-1%][MvccProcessorImpl] Assigned mvcc coordinator [crd=MvccCoordinator [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=0], nodeId=00800e71-7913-4e3d-bbce-bf44482cf000, ver=1637345340162, local=false, initialized=false]] [21:09:01] : [Step 4/5] [2021-11-19 21:09:01,261][INFO ][sys-#17457%grid-1%][ClusterProcessor] Writing cluster ID and tag to metastorage on ready for write ClusterIdAndTag [id=a127cb3c-24e9-4438-b77c-4fe1abc25b15, tag=heuristic_grothendieck] [21:09:01] : [Step 4/5] [2021-11-19 21:09:01,275][INFO ][test-runner-#17247%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] To start Console Management & Monitoring run ignitevisorcmd.{sh|bat} [21:09:01] : [Step 4/5] [2021-11-19 21:09:01,276][INFO ][test-runner-#17247%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] [21:09:01] : [Step 4/5] [21:09:01] : [Step 4/5] >>> +-------------------------------------------+ [21:09:01] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:09:01] : [Step 4/5] >>> +-------------------------------------------+ [21:09:01] : [Step 4/5] >>> OS name: Linux 4.15.0-151-generic amd64 [21:09:01] : [Step 4/5] >>> CPU(s): 24 [21:09:01] : [Step 4/5] >>> Heap: 2.0GB [21:09:01] : [Step 4/5] >>> VM name: 16724@c4dfe9a430b2 [21:09:01] : [Step 4/5] >>> Ignite instance name: grid-1 [21:09:01] : [Step 4/5] >>> Local node [ID=1057F7C4-3383-4522-9222-19E353CDC001, order=2, clientMode=false] [21:09:01] : [Step 4/5] >>> Local node addresses: [127.0.0.1] [21:09:01] : [Step 4/5] >>> Local ports: TCP:10801 TCP:47101 TCP:47501 [21:09:01] : [Step 4/5] [21:09:01] : [Step 4/5] [2021-11-19 21:09:01,277][INFO ][test-runner-#17247%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] >>> Ignite cluster is in INACTIVE state (limited functionality available). Use control.(sh|bat) script or IgniteCluster.state(ClusterState.ACTIVE) to change the state. [21:09:01] : [Step 4/5] [2021-11-19 21:09:01,277][INFO ][test-runner-#17247%encryption.MasterKeyChangeTest%][GridDiscoveryManager] Topology snapshot [ver=2, locNode=1057f7c4, servers=2, clients=0, state=INACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=00800e71-7913-4e3d-bbce-bf44482cf000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=1057f7c4-3383-4522-9222-19e353cdc001, consistentId=grid-1, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:09:01] : [Step 4/5] [2021-11-19 21:09:01,278][INFO ][test-runner-#17247%encryption.MasterKeyChangeTest%][G] Node started : [stage="Configure system pool" (0 ms),stage="Start managers" (308 ms),stage="Configure binary metadata" (2 ms),stage="Start processors" (340 ms),stage="Start 'StanByClusterTestProvider' plugin" (0 ms),stage="Start 'PageMemory tracker plugin' plugin" (0 ms),stage="Start 'TestDistibutedConfigurationPlugin' plugin" (0 ms),stage="Start 'NodeValidationPluginProvider' plugin" (0 ms),stage="Init metastore" (16 ms),stage="Init and start regions" (5 ms),stage="Restore binary memory" (15 ms),stage="Restore logical state" (60 ms),stage="Finish recovery" (262 ms),stage="Join topology" (42 ms),stage="Await transition" (2 ms),stage="Await exchange" (15 ms),stage="Total time" (1067 ms)] [21:09:01] : [Step 4/5] [2021-11-19 21:09:01,279][INFO ][test-runner-#17247%encryption.MasterKeyChangeTest%][root] Node started with the following configuration [id=1057f7c4-3383-4522-9222-19e353cdc001, marshaller=BinaryMarshaller [], discovery=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=5000, ackTimeout=5000, marsh=JdkMarshaller [clsFilter=org.apache.ignite.marshaller.MarshallerUtils$1@58b24c4a], reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], binaryCfg=null, lateAff=true] [21:09:01] : [Step 4/5] [2021-11-19 21:09:01,281][INFO ][test-runner-#17247%encryption.MasterKeyChangeTest%][GridClusterStateProcessor] Sending activate cluster request with BaselineTopology BaselineTopology [id=0, branchingHash=-2475315501, branchingType='New BaselineTopology', baselineNodes=[grid-1, grid-0]] [21:09:01] : [Step 4/5] [2021-11-19 21:09:01,285][INFO ][disco-notifier-worker-#17358%grid-0%][GridClusterStateProcessor] Received activate cluster request with BaselineTopology[id=0] initiator node ID: 00800e71-7913-4e3d-bbce-bf44482cf000 [21:09:01] : [Step 4/5] [2021-11-19 21:09:01,285][INFO ][disco-notifier-worker-#17358%grid-0%][GridClusterStateProcessor] Started state transition: activate cluster [21:09:01] : [Step 4/5] [2021-11-19 21:09:01,286][INFO ][exchange-worker-#17363%grid-0%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], crd=true, evt=DISCOVERY_CUSTOM_EVT, evtNode=00800e71-7913-4e3d-bbce-bf44482cf000, customEvt=ChangeGlobalStateMessage [id=3186d593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqId=848e2a20-b91d-4f39-8bef-1cab5779f8ce, initiatingNodeId=00800e71-7913-4e3d-bbce-bf44482cf000, state=ACTIVE, baselineTopology=BaselineTopology [id=0, branchingHash=-2475315501, branchingType='New BaselineTopology', baselineNodes=[grid-1, grid-0]], forceChangeBaselineTopology=false, timestamp=1637345341281, forceDeactivation=true], allowMerge=false, exchangeFreeSwitch=false] [21:09:01] : [Step 4/5] [2021-11-19 21:09:01,286][INFO ][disco-notifier-worker-#17476%grid-1%][GridClusterStateProcessor] Received activate cluster request with BaselineTopology[id=0] initiator node ID: 00800e71-7913-4e3d-bbce-bf44482cf000 [21:09:01] : [Step 4/5] [2021-11-19 21:09:01,287][INFO ][exchange-worker-#17363%grid-0%][GridDhtPartitionsExchangeFuture] Start activation process [nodeId=00800e71-7913-4e3d-bbce-bf44482cf000, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]]. New state: ACTIVE [21:09:01] : [Step 4/5] [2021-11-19 21:09:01,287][INFO ][disco-notifier-worker-#17476%grid-1%][GridClusterStateProcessor] Started state transition: activate cluster [21:09:01] : [Step 4/5] [2021-11-19 21:09:01,288][INFO ][exchange-worker-#17363%grid-0%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0 [21:09:01] : [Step 4/5] [2021-11-19 21:09:01,289][INFO ][exchange-worker-#17485%grid-1%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], crd=false, evt=DISCOVERY_CUSTOM_EVT, evtNode=00800e71-7913-4e3d-bbce-bf44482cf000, customEvt=ChangeGlobalStateMessage [id=3186d593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqId=848e2a20-b91d-4f39-8bef-1cab5779f8ce, initiatingNodeId=00800e71-7913-4e3d-bbce-bf44482cf000, state=ACTIVE, baselineTopology=BaselineTopology [id=0, branchingHash=-2475315501, branchingType='New BaselineTopology', baselineNodes=[grid-1, grid-0]], forceChangeBaselineTopology=false, timestamp=1637345341281, forceDeactivation=true], allowMerge=false, exchangeFreeSwitch=false] [21:09:01] : [Step 4/5] [2021-11-19 21:09:01,291][INFO ][exchange-worker-#17485%grid-1%][GridDhtPartitionsExchangeFuture] Start activation process [nodeId=1057f7c4-3383-4522-9222-19e353cdc001, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]]. New state: ACTIVE [21:09:01] : [Step 4/5] [2021-11-19 21:09:01,291][INFO ][exchange-worker-#17485%grid-1%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1 [21:09:01] : [Step 4/5] [2021-11-19 21:09:01,291][INFO ][exchange-worker-#17363%grid-0%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000000.wal, offset=8713, ver=2] [21:09:01] : [Step 4/5] [2021-11-19 21:09:01,294][INFO ][exchange-worker-#17363%grid-0%][GridClusterStateProcessor] Writing BaselineTopology[id=0] [21:09:01] : [Step 4/5] [2021-11-19 21:09:01,294][INFO ][exchange-worker-#17485%grid-1%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000000.wal, offset=8713, ver=2] [21:09:01] : [Step 4/5] [2021-11-19 21:09:01,296][INFO ][exchange-worker-#17485%grid-1%][GridClusterStateProcessor] Writing BaselineTopology[id=0] [21:09:01] : [Step 4/5] [2021-11-19 21:09:01,297][INFO ][exchange-worker-#17363%grid-0%][GridCacheDatabaseSharedManager] Finish recovery performed in 8 ms. [21:09:01] : [Step 4/5] [2021-11-19 21:09:01,299][INFO ][exchange-worker-#17363%grid-0%][msg] Components activation performed in 11 ms. [21:09:01] : [Step 4/5] [2021-11-19 21:09:01,300][INFO ][exchange-worker-#17363%grid-0%][GridCacheProcessor] Finished recovery for cache [cache=ignite-sys-cache, grp=ignite-sys-cache, startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:09:01] : [Step 4/5] [2021-11-19 21:09:01,300][INFO ][exchange-worker-#17485%grid-1%][GridCacheDatabaseSharedManager] Finish recovery performed in 8 ms. [21:09:01] : [Step 4/5] [2021-11-19 21:09:01,301][INFO ][exchange-worker-#17485%grid-1%][msg] Components activation performed in 10 ms. [21:09:01] : [Step 4/5] [2021-11-19 21:09:01,302][INFO ][exchange-worker-#17363%grid-0%][GridDhtPartitionsExchangeFuture] Successfully activated caches [nodeId=00800e71-7913-4e3d-bbce-bf44482cf000, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], newState=ACTIVE] [21:09:01] : [Step 4/5] [2021-11-19 21:09:01,302][INFO ][exchange-worker-#17485%grid-1%][GridCacheProcessor] Finished recovery for cache [cache=ignite-sys-cache, grp=ignite-sys-cache, startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:09:01] : [Step 4/5] [2021-11-19 21:09:01,302][INFO ][exchange-worker-#17363%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:09:01] : [Step 4/5] [2021-11-19 21:09:01,303][INFO ][exchange-worker-#17485%grid-1%][GridDhtPartitionsExchangeFuture] Successfully activated caches [nodeId=1057f7c4-3383-4522-9222-19e353cdc001, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], newState=ACTIVE] [21:09:01] : [Step 4/5] [2021-11-19 21:09:01,304][INFO ][exchange-worker-#17485%grid-1%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:09:01] : [Step 4/5] [2021-11-19 21:09:01,315][INFO ][exchange-worker-#17363%grid-0%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], crd=true] [21:09:01] : [Step 4/5] [2021-11-19 21:09:01,316][INFO ][grid-nio-worker-tcp-comm-0-#17302%TestRecordingCommunicationSpi%][TestRecordingCommunicationSpi] Accepted incoming communication connection [locAddr=/127.0.0.1:47100, rmtAddr=/127.0.0.1:57510] [21:09:01] : [Step 4/5] [2021-11-19 21:09:01,316][INFO ][db-checkpoint-thread-#17494%grid-1%][Checkpointer] Checkpoint started [checkpointId=f5c88938-192a-47e5-9cde-1a03bec6d591, startPtr=WALPointer [idx=0, fileOff=83469, len=1963], checkpointBeforeLockTime=3ms, checkpointLockWait=1ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=1ms, writeCheckpointEntryDuration=2ms, splitAndSortCpPagesDuration=0ms, pages=19, reason='node started'] [21:09:01] : [Step 4/5] [2021-11-19 21:09:01,318][INFO ][grid-nio-worker-tcp-comm-0-#17420%TestRecordingCommunicationSpi%][TestRecordingCommunicationSpi] Established outgoing communication connection [locAddr=/127.0.0.1:57510, rmtAddr=/127.0.0.1:47100] [21:09:01] : [Step 4/5] [2021-11-19 21:09:01,318][INFO ][db-checkpoint-thread-#17496%grid-0%][Checkpointer] Checkpoint started [checkpointId=fed2568a-7c7c-4d80-88ba-501378daa52e, startPtr=WALPointer [idx=0, fileOff=87327, len=1963], checkpointBeforeLockTime=2ms, checkpointLockWait=2ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=1ms, writeCheckpointEntryDuration=2ms, splitAndSortCpPagesDuration=0ms, pages=19, reason='node started'] [21:09:01] : [Step 4/5] [2021-11-19 21:09:01,319][INFO ][exchange-worker-#17485%grid-1%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], crd=false] [21:09:01] : [Step 4/5] [2021-11-19 21:09:01,320][INFO ][sys-#17350%grid-0%][GridDhtPartitionsExchangeFuture] Coordinator received single message [ver=AffinityTopologyVersion [topVer=2, minorTopVer=1], node=1057f7c4-3383-4522-9222-19e353cdc001, allReceived=true] [21:09:01] : [Step 4/5] [2021-11-19 21:09:01,321][INFO ][sys-#17350%grid-0%][GridDhtPartitionsExchangeFuture] finishExchangeOnCoordinator [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:09:01] : [Step 4/5] [2021-11-19 21:09:01,326][INFO ][sys-#17350%grid-0%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], err=null, rebalanced=true, wasRebalanced=false] [21:09:01] : [Step 4/5] [2021-11-19 21:09:01,326][INFO ][disco-notifier-worker-#17358%grid-0%][GridClusterStateProcessor] Received state change finish message: ACTIVE [21:09:01] : [Step 4/5] [2021-11-19 21:09:01,329][INFO ][disco-notifier-worker-#17358%grid-0%][GridClusterStateProcessor] Cluster state was changed from INACTIVE to ACTIVE [21:09:01] : [Step 4/5] [2021-11-19 21:09:01,328][INFO ][disco-notifier-worker-#17476%grid-1%][GridClusterStateProcessor] Received state change finish message: ACTIVE [21:09:01] : [Step 4/5] [2021-11-19 21:09:01,330][INFO ][disco-notifier-worker-#17476%grid-1%][GridClusterStateProcessor] Cluster state was changed from INACTIVE to ACTIVE [21:09:01] : [Step 4/5] [2021-11-19 21:09:01,328][INFO ][sys-#17459%grid-1%][GridDhtPartitionsExchangeFuture] Received full message, will finish exchange [node=00800e71-7913-4e3d-bbce-bf44482cf000, resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:09:01] : [Step 4/5] [2021-11-19 21:09:01,330][INFO ][sys-#17350%grid-0%][GridCacheProcessor] Finish proxy initialization, cacheName=ignite-sys-cache, localNodeId=00800e71-7913-4e3d-bbce-bf44482cf000 [21:09:01] : [Step 4/5] [2021-11-19 21:09:01,330][INFO ][sys-#17465%grid-1%][GridCachePartitionExchangeManager] Delay process full message without exchange id (there is exchange in progress) [nodeId=00800e71-7913-4e3d-bbce-bf44482cf000] [21:09:01] : [Step 4/5] [2021-11-19 21:09:01,332][INFO ][sys-#17350%grid-0%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=00800e71-7913-4e3d-bbce-bf44482cf000, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=00800e71-7913-4e3d-bbce-bf44482cf000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345341325, loc=true, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:09:01] : [Step 4/5] [2021-11-19 21:09:01,332][INFO ][exchange-worker-#17363%grid-0%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=2, minorTopVer=1], force=false, evt=DISCOVERY_CUSTOM_EVT, node=00800e71-7913-4e3d-bbce-bf44482cf000] [21:09:01] : [Step 4/5] [2021-11-19 21:09:01,332][INFO ][sys-#17343%grid-0%][DistributedBaselineConfiguration] Baseline auto-adjust is 'disabled' with timeout='300000' ms [21:09:01] : [Step 4/5] [2021-11-19 21:09:01,334][INFO ][sys-#17343%grid-0%][GridClusterStateProcessor] Successfully performed final activation steps [nodeId=00800e71-7913-4e3d-bbce-bf44482cf000, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:09:01] : [Step 4/5] [2021-11-19 21:09:01,332][INFO ][sys-#17459%grid-1%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], err=null, rebalanced=true, wasRebalanced=false] [21:09:01] : [Step 4/5] [2021-11-19 21:09:01,333][INFO ][sys-#17350%grid-0%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (1 ms), stage="Update caches registry" (12 ms), stage="Start caches" (0 ms), stage="Affinity initialization on cache group start" (1 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Restore partition states" (0 ms), stage="After states restored callback" (12 ms), stage="WAL history reservation" (0 ms), stage="Waiting for all single messages" (5 ms), stage="Affinity recalculation (crd)" (0 ms), stage="Collect update counters and create affinity messages" (0 ms), stage="Assign partitions states" (0 ms), stage="Validate partitions states" (0 ms), stage="Ideal affinity diff calculation (enforced)" (0 ms), stage="Apply update counters" (0 ms), stage="Full message preparing" (2 ms), stage="Full message sending" (0 ms), stage="State finish message sending" (0 ms), stage="Detect lost partitions" (3 ms), stage="Exchange done" (3 ms), stage="Total time" (39 ms), Discovery lag=2 ms, Latest started node id=1057f7c4-3383-4522-9222-19e353cdc001] [21:09:01] : [Step 4/5] [2021-11-19 21:09:01,338][INFO ][sys-#17459%grid-1%][GridCacheProcessor] Finish proxy initialization, cacheName=ignite-sys-cache, localNodeId=1057f7c4-3383-4522-9222-19e353cdc001 [21:09:01] : [Step 4/5] [2021-11-19 21:09:01,339][INFO ][sys-#17350%grid-0%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], stage="Affinity initialization on cache group start [grp=ignite-sys-cache]" (1 ms) (parent=Affinity initialization on cache group start), stage="Affinity centralized initialization (crd) [grp=ignite-sys-cache, crd=true]" (0 ms) (parent=Determine exchange type), stage="Restore partition states [grp=ignite-sys-cache]" (0 ms) (parent=Restore partition states), stage="Affinity recalculation (partitions availability) [grp=ignite-sys-cache]" (0 ms) (parent=Ideal affinity diff calculation (enforced))] [21:09:01] : [Step 4/5] [2021-11-19 21:09:01,342][INFO ][test-runner-#17247%encryption.MasterKeyChangeTest%][root] awaitPartitionMapExchange finished [21:09:01] : [Step 4/5] [2021-11-19 21:09:01,341][INFO ][sys-#17459%grid-1%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=1057f7c4-3383-4522-9222-19e353cdc001, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=00800e71-7913-4e3d-bbce-bf44482cf000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345341243, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:09:01] : [Step 4/5] [2021-11-19 21:09:01,341][INFO ][exchange-worker-#17485%grid-1%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=2, minorTopVer=1], force=false, evt=DISCOVERY_CUSTOM_EVT, node=00800e71-7913-4e3d-bbce-bf44482cf000] [21:09:01] : [Step 4/5] [2021-11-19 21:09:01,341][INFO ][sys-#17454%grid-1%][DistributedBaselineConfiguration] Baseline auto-adjust is 'disabled' with timeout='300000' ms [21:09:01] : [Step 4/5] [2021-11-19 21:09:01,343][INFO ][db-checkpoint-thread-#17494%grid-1%][Checkpointer] Checkpoint finished [cpId=f5c88938-192a-47e5-9cde-1a03bec6d591, pages=19, markPos=WALPointer [idx=0, fileOff=83469, len=1963], walSegmentsCovered=[], markDuration=5ms, pagesWrite=1ms, fsync=24ms, total=34ms] [21:09:01] : [Step 4/5] [2021-11-19 21:09:01,343][INFO ][db-checkpoint-thread-#17496%grid-0%][Checkpointer] Checkpoint finished [cpId=fed2568a-7c7c-4d80-88ba-501378daa52e, pages=19, markPos=WALPointer [idx=0, fileOff=87327, len=1963], walSegmentsCovered=[], markDuration=4ms, pagesWrite=2ms, fsync=22ms, total=32ms] [21:09:01] : [Step 4/5] [2021-11-19 21:09:01,343][INFO ][sys-#17459%grid-1%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (1 ms), stage="Update caches registry" (11 ms), stage="Start caches" (0 ms), stage="Affinity initialization on cache group start" (0 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Restore partition states" (0 ms), stage="After states restored callback" (9 ms), stage="WAL history reservation" (0 ms), stage="Waiting for Full message" (14 ms), stage="Affinity recalculation" (2 ms), stage="Full map updating" (0 ms), stage="Detect lost partitions" (5 ms), stage="Exchange done" (6 ms), stage="Total time" (48 ms)] [21:09:01] : [Step 4/5] [2021-11-19 21:09:01,344][INFO ][sys-#17454%grid-1%][GridClusterStateProcessor] Successfully performed final activation steps [nodeId=1057f7c4-3383-4522-9222-19e353cdc001, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:09:01] : [Step 4/5] [2021-11-19 21:09:01,347][INFO ][sys-#17459%grid-1%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], stage="Affinity initialization on cache group start [grp=ignite-sys-cache]" (0 ms) (parent=Affinity initialization on cache group start), stage="Affinity centralized initialization (crd) [grp=ignite-sys-cache, crd=false]" (0 ms) (parent=Determine exchange type), stage="Restore partition states [grp=ignite-sys-cache]" (0 ms) (parent=Restore partition states), stage="Affinity applying from full message [grp=ignite-sys-cache]" (2 ms) (parent=Affinity recalculation)] [21:09:01] : [Step 4/5] [2021-11-19 21:09:01,353][INFO ][exchange-worker-#17363%grid-0%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], crd=true, evt=DISCOVERY_CUSTOM_EVT, evtNode=00800e71-7913-4e3d-bbce-bf44482cf000, customEvt=DynamicCacheChangeBatch [id=7386d593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqs=ArrayList [DynamicCacheChangeRequest [cacheName=encrypted, hasCfg=true, nodeId=00800e71-7913-4e3d-bbce-bf44482cf000, clientStartOnly=false, stop=false, destroy=false, disabledAfterStart=false]], exchangeActions=ExchangeActions [startCaches=[encrypted], stopCaches=null, startGrps=[encrypted], stopGrps=[], resetParts=null, stateChangeRequest=null], startCaches=false], allowMerge=false, exchangeFreeSwitch=false] [21:09:01] : [Step 4/5] [2021-11-19 21:09:01,355][INFO ][exchange-worker-#17363%grid-0%][PageMemoryImpl] Started page memory [memoryAllocated=24.0 MiB, pages=5952, tableSize=474.2 KiB, replacementSize=768 B, checkpointBuffer=10.0 MiB] [21:09:01] : [Step 4/5] [2021-11-19 21:09:01,356][INFO ][exchange-worker-#17485%grid-1%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], crd=false, evt=DISCOVERY_CUSTOM_EVT, evtNode=00800e71-7913-4e3d-bbce-bf44482cf000, customEvt=DynamicCacheChangeBatch [id=7386d593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqs=ArrayList [DynamicCacheChangeRequest [cacheName=encrypted, hasCfg=true, nodeId=00800e71-7913-4e3d-bbce-bf44482cf000, clientStartOnly=false, stop=false, destroy=false, disabledAfterStart=false]], exchangeActions=ExchangeActions [startCaches=[encrypted], stopCaches=null, startGrps=[encrypted], stopGrps=[], resetParts=null, stateChangeRequest=null], startCaches=false], allowMerge=false, exchangeFreeSwitch=false] [21:09:01] : [Step 4/5] [2021-11-19 21:09:01,358][INFO ][exchange-worker-#17485%grid-1%][PageMemoryImpl] Started page memory [memoryAllocated=24.0 MiB, pages=5952, tableSize=474.2 KiB, replacementSize=768 B, checkpointBuffer=10.0 MiB] [21:09:01] : [Step 4/5] [2021-11-19 21:09:01,428][INFO ][exchange-worker-#17485%grid-1%][GridCacheProcessor] Started cache [name=encrypted, id=1613773252, dataRegionName=default, mode=PARTITIONED, atomicity=ATOMIC, backups=0, mvcc=false] [21:09:01]W: [org.apache.ignite:ignite-core] [2021-11-19 21:09:01,431][WARN ][exchange-worker-#17485%grid-1%][CacheAffinitySharedManager] Cache group 'encrypted' brings high overhead for its metainformation in data region 'default'. Metainformation required for its partitions (522 partitions, 4096 bytes per partition, 2 MBs total) will consume more than 15% of data region memory (10 MBs). It may lead to critical errors on the node and cluster instability. Please reduce number of partitions, add more memory to the data region or add more server nodes for this cache group. [21:09:01] : [Step 4/5] [2021-11-19 21:09:01,432][INFO ][exchange-worker-#17485%grid-1%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], waitTime=0ms, futInfo=NA, mode=DISTRIBUTED] [21:09:01] : [Step 4/5] [2021-11-19 21:09:01,432][INFO ][exchange-worker-#17363%grid-0%][GridCacheProcessor] Started cache [name=encrypted, id=1613773252, dataRegionName=default, mode=PARTITIONED, atomicity=ATOMIC, backups=0, mvcc=false] [21:09:01]W: [org.apache.ignite:ignite-core] [2021-11-19 21:09:01,434][WARN ][exchange-worker-#17363%grid-0%][CacheAffinitySharedManager] Cache group 'encrypted' brings high overhead for its metainformation in data region 'default'. Metainformation required for its partitions (502 partitions, 4096 bytes per partition, 1 MBs total) will consume more than 15% of data region memory (10 MBs). It may lead to critical errors on the node and cluster instability. Please reduce number of partitions, add more memory to the data region or add more server nodes for this cache group. [21:09:01] : [Step 4/5] [2021-11-19 21:09:01,435][INFO ][exchange-worker-#17363%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], waitTime=0ms, futInfo=NA, mode=DISTRIBUTED] [21:09:01] : [Step 4/5] [2021-11-19 21:09:01,435][INFO ][exchange-worker-#17363%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partitions release latch: ServerLatch [permits=0, pendingAcks=HashSet [], super=CompletableLatch [id=CompletableLatchUid [id=exchange, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2]]]] [21:09:01] : [Step 4/5] [2021-11-19 21:09:01,436][INFO ][exchange-worker-#17363%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:09:01] : [Step 4/5] [2021-11-19 21:09:01,436][INFO ][exchange-worker-#17485%grid-1%][GridDhtPartitionsExchangeFuture] Finished waiting for partitions release latch: ClientLatch [coordinator=TcpDiscoveryNode [id=00800e71-7913-4e3d-bbce-bf44482cf000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345341243, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], ackSent=true, super=CompletableLatch [id=CompletableLatchUid [id=exchange, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2]]]] [21:09:01] : [Step 4/5] [2021-11-19 21:09:01,437][INFO ][exchange-worker-#17485%grid-1%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:09:01] : [Step 4/5] [2021-11-19 21:09:01,466][INFO ][exchange-worker-#17363%grid-0%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], crd=true] [21:09:01] : [Step 4/5] [2021-11-19 21:09:01,468][INFO ][exchange-worker-#17485%grid-1%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], crd=false] [21:09:01] : [Step 4/5] [2021-11-19 21:09:01,469][INFO ][sys-#17345%grid-0%][GridDhtPartitionsExchangeFuture] Coordinator received single message [ver=AffinityTopologyVersion [topVer=2, minorTopVer=2], node=1057f7c4-3383-4522-9222-19e353cdc001, allReceived=true] [21:09:01] : [Step 4/5] [2021-11-19 21:09:01,469][INFO ][sys-#17345%grid-0%][GridDhtPartitionsExchangeFuture] finishExchangeOnCoordinator [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2]] [21:09:01] : [Step 4/5] [2021-11-19 21:09:01,473][INFO ][sys-#17345%grid-0%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], err=null, rebalanced=true, wasRebalanced=true] [21:09:01] : [Step 4/5] [2021-11-19 21:09:01,474][INFO ][sys-#17345%grid-0%][GridCacheProcessor] Finish proxy initialization, cacheName=encrypted, localNodeId=00800e71-7913-4e3d-bbce-bf44482cf000 [21:09:01] : [Step 4/5] [2021-11-19 21:09:01,474][INFO ][sys-#17455%grid-1%][GridDhtPartitionsExchangeFuture] Received full message, will finish exchange [node=00800e71-7913-4e3d-bbce-bf44482cf000, resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2]] [21:09:01] : [Step 4/5] [2021-11-19 21:09:01,475][INFO ][sys-#17345%grid-0%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=00800e71-7913-4e3d-bbce-bf44482cf000, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=00800e71-7913-4e3d-bbce-bf44482cf000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345341345, loc=true, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2]] [21:09:01] : [Step 4/5] [2021-11-19 21:09:01,478][INFO ][sys-#17455%grid-1%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], err=null, rebalanced=true, wasRebalanced=true] [21:09:01] : [Step 4/5] [2021-11-19 21:09:01,475][INFO ][exchange-worker-#17363%grid-0%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=2, minorTopVer=2], force=false, evt=DISCOVERY_CUSTOM_EVT, node=00800e71-7913-4e3d-bbce-bf44482cf000] [21:09:01] : [Step 4/5] [2021-11-19 21:09:01,478][INFO ][sys-#17345%grid-0%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (1 ms), stage="Update caches registry" (0 ms), stage="Start caches" (78 ms), stage="Affinity initialization on cache group start" (1 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Wait partitions release latch [latch=exchange]" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Restore partition states" (9 ms), stage="After states restored callback" (20 ms), stage="WAL history reservation" (0 ms), stage="Waiting for all single messages" (3 ms), stage="Affinity recalculation (crd)" (0 ms), stage="Collect update counters and create affinity messages" (0 ms), stage="Assign partitions states" (1 ms), stage="Validate partitions states" (0 ms), stage="Apply update counters" (0 ms), stage="Full message preparing" (2 ms), stage="Full message sending" (0 ms), stage="Exchange done" (4 ms), stage="Total time" (119 ms), Discovery lag=4 ms, Latest started node id=1057f7c4-3383-4522-9222-19e353cdc001] [21:09:01] : [Step 4/5] [2021-11-19 21:09:01,479][INFO ][sys-#17455%grid-1%][GridCacheProcessor] Finish proxy initialization, cacheName=encrypted, localNodeId=1057f7c4-3383-4522-9222-19e353cdc001 [21:09:01] : [Step 4/5] [2021-11-19 21:09:01,480][INFO ][sys-#17345%grid-0%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], stage="Affinity initialization on cache group start [grp=encrypted]" (1 ms) (parent=Affinity initialization on cache group start), stage="Restore partition states [grp=encrypted]" (9 ms) (parent=Restore partition states), stage="Restore partition states [grp=ignite-sys-cache]" (0 ms) (parent=Restore partition states)] [21:09:01] : [Step 4/5] [2021-11-19 21:09:01,481][INFO ][exchange-worker-#17485%grid-1%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=2, minorTopVer=2], force=false, evt=DISCOVERY_CUSTOM_EVT, node=00800e71-7913-4e3d-bbce-bf44482cf000] [21:09:01] : [Step 4/5] [2021-11-19 21:09:01,481][INFO ][sys-#17455%grid-1%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=1057f7c4-3383-4522-9222-19e353cdc001, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=00800e71-7913-4e3d-bbce-bf44482cf000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345341243, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2]] [21:09:01] : [Step 4/5] [2021-11-19 21:09:01,483][INFO ][sys-#17455%grid-1%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (1 ms), stage="Update caches registry" (0 ms), stage="Start caches" (70 ms), stage="Affinity initialization on cache group start" (2 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Wait partitions release latch [latch=exchange]" (4 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Restore partition states" (9 ms), stage="After states restored callback" (20 ms), stage="WAL history reservation" (0 ms), stage="Waiting for Full message" (6 ms), stage="Affinity recalculation" (0 ms), stage="Full map updating" (2 ms), stage="Exchange done" (5 ms), stage="Total time" (119 ms)] [21:09:01] : [Step 4/5] [2021-11-19 21:09:01,485][INFO ][sys-#17455%grid-1%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], stage="Affinity initialization on cache group start [grp=encrypted]" (1 ms) (parent=Affinity initialization on cache group start), stage="Restore partition states [grp=encrypted]" (9 ms) (parent=Restore partition states), stage="Restore partition states [grp=ignite-sys-cache]" (0 ms) (parent=Restore partition states)] [21:09:02] : [Step 4/5] [2021-11-19 21:09:02,915][INFO ][test-runner-#17247%encryption.MasterKeyChangeTest%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:09:03] : [Step 4/5] [2021-11-19 21:09:03,062][INFO ][disco-notifier-worker-#17358%grid-0%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:09:03] : [Step 4/5] [2021-11-19 21:09:03,063][INFO ][disco-notifier-worker-#17476%grid-1%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:09:03] : [Step 4/5] [2021-11-19 21:09:03,279][INFO ][disco-notifier-worker-#17358%grid-0%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:09:03] : [Step 4/5] [2021-11-19 21:09:03,284][INFO ][disco-notifier-worker-#17476%grid-1%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:09:03] : [Step 4/5] [2021-11-19 21:09:03,369][INFO ][disco-notifier-worker-#17358%grid-0%][GridEncryptionManager] Start master key change [masterKeyName=ignite.master.key2] [21:09:03] : [Step 4/5] [2021-11-19 21:09:03,370][INFO ][disco-notifier-worker-#17476%grid-1%][GridEncryptionManager] Start master key change [masterKeyName=ignite.master.key2] [21:09:03] : [Step 4/5] [2021-11-19 21:09:03,424][INFO ][disco-notifier-worker-#17358%grid-0%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:09:03] : [Step 4/5] [2021-11-19 21:09:03,425][INFO ][disco-notifier-worker-#17476%grid-1%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:09:03] : [Step 4/5] [2021-11-19 21:09:03,634][INFO ][disco-notifier-worker-#17358%grid-0%][GridEncryptionManager] Master key successfully changed [masterKeyName=ignite.master.key2] [21:09:03] : [Step 4/5] [2021-11-19 21:09:03,634][INFO ][disco-notifier-worker-#17476%grid-1%][GridEncryptionManager] Master key successfully changed [masterKeyName=ignite.master.key2] [21:09:03] : [Step 4/5] [2021-11-19 21:09:03,635][INFO ][disco-notifier-worker-#17476%grid-1%][IgniteTestResources] Block message [node=00800e71-7913-4e3d-bbce-bf44482cf000, order=1, msg=org.apache.ignite.internal.util.distributed.SingleNodeMessage@6fbb420c] [21:09:03] : [Step 4/5] [2021-11-19 21:09:03,636][INFO ][async-runnable-runner-1][root] >>> Stopping grid [name=grid-0, id=00800e71-7913-4e3d-bbce-bf44482cf000] [21:09:03] : [Step 4/5] [2021-11-19 21:09:03,657][INFO ][db-checkpoint-thread-#17496%grid-0%][Checkpointer] Checkpoint started [checkpointId=a4cb4ff2-819d-42d5-ba57-4edcf200334b, startPtr=WALPointer [idx=0, fileOff=758252, len=11491], checkpointBeforeLockTime=5ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=2ms, checkpointLockHoldTime=7ms, walCpRecordFsyncDuration=1ms, writeCheckpointEntryDuration=2ms, splitAndSortCpPagesDuration=0ms, pages=575, reason='timeout'] [21:09:03] : [Step 4/5] [2021-11-19 21:09:03,666][INFO ][tcp-disco-sock-reader-[1057f7c4 127.0.0.1:39059]-#916%grid-0%-#17482%grid-0%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:39059, rmtPort=39059, rmtNodeId=1057f7c4-3383-4522-9222-19e353cdc001] [21:09:03] : [Step 4/5] [2021-11-19 21:09:03,666][INFO ][disco-event-worker-#17484%grid-1%][GridDiscoveryManager] Node left topology: TcpDiscoveryNode [id=00800e71-7913-4e3d-bbce-bf44482cf000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345341243, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false] [21:09:03] : [Step 4/5] [2021-11-19 21:09:03,670][INFO ][async-runnable-runner-1][GridCacheProcessor] Stopped cache [cacheName=ignite-sys-cache] [21:09:03] : [Step 4/5] [2021-11-19 21:09:03,671][INFO ][async-runnable-runner-1][GridCacheProcessor] Stopped cache [cacheName=encrypted] [21:09:03] : [Step 4/5] [2021-11-19 21:09:03,671][INFO ][disco-event-worker-#17484%grid-1%][GridDiscoveryManager] Topology snapshot [ver=3, locNode=1057f7c4, servers=1, clients=0, state=ACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=1057f7c4-3383-4522-9222-19e353cdc001, consistentId=grid-1, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:09:03] : [Step 4/5] [2021-11-19 21:09:03,671][INFO ][disco-event-worker-#17484%grid-1%][GridDiscoveryManager] Coordinator changed [prev=TcpDiscoveryNode [id=00800e71-7913-4e3d-bbce-bf44482cf000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345341243, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], cur=TcpDiscoveryNode [id=1057f7c4-3383-4522-9222-19e353cdc001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637345343660, loc=true, ver=2.13.0#20211119-sha1:00000000, isClient=false]] [21:09:03] : [Step 4/5] [2021-11-19 21:09:03,675][INFO ][disco-event-worker-#17484%grid-1%][GridDiscoveryManager] ^-- Baseline [id=0, size=2, online=1, offline=1] [21:09:03] : [Step 4/5] [2021-11-19 21:09:03,677][INFO ][disco-event-worker-#17484%grid-1%][MvccProcessorImpl] Assigned mvcc coordinator [crd=MvccCoordinator [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], nodeId=1057f7c4-3383-4522-9222-19e353cdc001, ver[21:09:03] >>> Stopping test: MasterKeyChange=16373Test#testNodeF45340163, local=true, initialized=false]] [21:09:03] : [Step 4/5] ailsDuringRotationCoordinatorPerform in 4589 ms <<< [21:09:03] : [Step 4/5] [2021-11-19 21:09:03,678][INFO ][main][root] >>> Stopping test: MasterKeyChangeTest#testNodeFailsDuringRotationCoordinatorPerform in 4589 ms <<< [21:09:03] : [Step 4/5] [21:09:03] >>> Heap: 239 MB used / 1918 MB commited / 1918 MB max <<< [21:09:03] : [Step 4/5] [2021-11-19 21:09:03,679][INFO ][main][root] >>> Heap: 239 MB used / 1918 MB commited / 1918 MB max <<< [21:09:03] : [Step 4/5] [21:09:03] >>> Non-Heap: 148 MB used / 179 MB commited / 0 MB max <<< [21:09:03] : [Step 4/5] [2021-11-19 21:09:03,679][INFO ][main][root] >>> Non-Heap: 148 MB used / 179 MB commited / 0 MB max <<< [21:09:03] : [Step 4/5] [2021-11-19 21:09:03,679][INFO ][sys-#17467%grid-1%][ExchangeLatchManager] Become new coordinator 1057f7c4-3383-4522-9222-19e353cdc001 [21:09:03] : [Step 4/5] [2021-11-19 21:09:03,679][INFO ][exchange-worker-#17485%grid-1%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], crd=true, evt=NODE_LEFT, evtNode=00800e71-7913-4e3d-bbce-bf44482cf000, customEvt=null, allowMerge=false, exchangeFreeSwitch=true] [21:09:03] : [Step 4/5] [2021-11-19 21:09:03,683][INFO ][exchange-worker-#17485%grid-1%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:09:03] : [Step 4/5] [21:09:03] >>> Starting test: MasterKeyChangeTest#testNodeFailsDuringRotationCoordinatorPrepare <<< [21:09:03] : [Step 4/5] [2021-11-19 21:09:03,684][INFO ][main][root] >>> Starting test: MasterKeyChangeTest#testNodeFailsDuringRotationCoordinatorPrepare <<< [21:09:03] : [Step 4/5] [21:09:03] >>> Heap: 239 MB used / 1918 MB commited / 1918 MB max <<< [21:09:03] : [Step 4/5] [2021-11-19 21:09:03,685][INFO ][main][root] >>> Heap: 239 MB used / 1918 MB commited / 1918 MB max <<< [21:09:03] : [Step 4/5] [21:09:03] >>> Non-Heap: 148 MB used / 179 MB commited / 0 MB max <<< [21:09:03] : [Step 4/5] [2021-11-19 21:09:03,685][INFO ][main][root] >>> Non-Heap: 148 MB used / 179 MB commited / 0 MB max <<< [21:09:03] : [Step 4/5] [2021-11-19 21:09:03,685][INFO ][main][root] >>> Stopping grid [name=grid-1, id=1057f7c4-3383-4522-9222-19e353cdc001] [21:09:03] : [Step 4/5] [2021-11-19 21:09:03,686][INFO ][exchange-worker-#17485%grid-1%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], err=null, rebalanced=true, wasRebalanced=true] [21:09:03]W: [org.apache.ignite:ignite-core] [2021-11-19 21:09:03,690][WARN ][exchange-worker-#17485%grid-1%][GridDhtPartitionTopologyImpl] Detected lost partitions [grp=encrypted, parts=[1, 3, 5, 8-9, 12-13, 15-16, 18-20, 22-23, 31, 33-36, 38-39, 41-43, 45-46, 53, 55-56, 58, 60-61, 65-66, 69-73, 76-77, 79-80, 82-86, 89-90, 92-96, 98, 100, 103, 108-112, 115, 117, 119, 121, 123, 125-134, 137, 139, 146, 148, 153, 157-158, 161, 165-168, 170-171, 173-174, 178-179, 181-183, 188-189, 192-193, 195, 203, 206-208, 211, 213, 215, 217-218, 225, 227-228, 233-236, 238, 240, 242, 246, 248, 252-254, 256, 258-260, 262-264, 266-268, 270-271, 274-275, 278-280, 283-284, 286, 288, 292, 298, 300, 305, 307, 310, 313-314, 318, 320-321, 323-324, 327, 331-335, 337-338, 340, 342-343, 347-349, 351, 355-356, 362, 364-365, 368-370, 374-375, 381-382, 384, 386, 389, 391, 393-394, 398-399, 401, 403-404, 406-407, 412-415, 417-419, 421, 423, 426-428, 430-432, 434, 439, 442-444, 447-449, 451, 454, 457, 459, 461, 464, 469, 471-473, 476-479, 481-487, 489, 493-494, 496, 498, 513-515, 517-524, 526, 532-534, 536, 539-540, 543-544, 547, 553, 556-557, 559-561, 565-566, 570-571, 573, 575-578, 581, 586, 588-589, 592-593, 595, 597-599, 601, 603, 605-606, 615-616, 621-622, 625-626, 630-631, 634-635, 637, 639, 643-644, 647, 650-656, 663, 666-667, 673-676, 679-681, 685, 687-688, 690-691, 694, 698, 700-705, 708, 711, 715, 718, 722, 729, 733, 736-738, 740-741, 743-745, 747-748, 751, 753, 755, 757-761, 763-767, 771, 776-777, 779, 781-782, 788, 792, 794-795, 797, 802, 804-805, 807-808, 813, 815, 818, 820-821, 826, 830-831, 834-835, 838, 841-845, 847, 852, 855-856, 859, 861-862, 865, 867, 872, 876, 879-883, 885-887, 890-895, 898-899, 901-904, 908-913, 916, 918, 921-922, 926-930, 934-935, 937-939, 941, 943, 946-947, 949, 952-953, 955, 959-961, 963-964, 971, 973-974, 977, 981-982, 984, 986-987, 989, 991-992, 995-996, 999, 1001-1002, 1005-1006, 1008, 1010-1013, 1015, 1017, 1020-1023], topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0]] [21:09:03] : [Step 4/5] [2021-11-19 21:09:03,695][INFO ][exchange-worker-#17485%grid-1%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=1057f7c4-3383-4522-9222-19e353cdc001, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], evt=NODE_LEFT, evtNode=TcpDiscoveryNode [id=00800e71-7913-4e3d-bbce-bf44482cf000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345341243, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0]] [21:09:03] : [Step 4/5] [2021-11-19 21:09:03,696][INFO ][exchange-worker-#17485%grid-1%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (2 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="After states restored callback" (0 ms), stage="WAL history reservation" (1 ms), stage="Finalize update counters" (0 ms), stage="Detect lost partitions" (9 ms), stage="Exchange done" (1 ms), stage="Total time" (13 ms)] [21:09:03] : [Step 4/5] [2021-11-19 21:09:03,697][INFO ][exchange-worker-#17485%grid-1%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], stage="Affinity initialization (exchange-free switch on fully-rebalanced topology) [grp=ignite-sys-cache]" (0 ms) (parent=Determine exchange type), stage="Affinity initialization (exchange-free switch on fully-rebalanced topology) [grp=encrypted]" (0 ms) (parent=Determine exchange type)] [21:09:03] : [Step 4/5] [2021-11-19 21:09:03,699][INFO ][exchange-worker-#17485%grid-1%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], crd=true] [21:09:03] : [Step 4/5] [2021-11-19 21:09:03,700][INFO ][exchange-worker-#17485%grid-1%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=3, minorTopVer=0], force=false, evt=NODE_LEFT, node=00800e71-7913-4e3d-bbce-bf44482cf000] [21:09:03] : [Step 4/5] [2021-11-19 21:09:03,716][INFO ][db-checkpoint-thread-#17494%grid-1%][Checkpointer] Checkpoint started [checkpointId=7cfc9b63-1c14-42f0-add3-76fe769a5234, startPtr=WALPointer [idx=0, fileOff=642823, len=11871], checkpointBeforeLockTime=5ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=1ms, checkpointLockHoldTime=2ms, walCpRecordFsyncDuration=4ms, writeCheckpointEntryDuration=2ms, splitAndSortCpPagesDuration=0ms, pages=455, reason='timeout'] [21:09:03]W: [org.apache.ignite:ignite-core] [2021-11-19 21:09:03,722][WARN ][tcp-disco-sock-reader-[00800e71 127.0.0.1:56009]-#915%grid-1%-#17481%grid-1%][TestTcpDiscoverySpi] Failed to shutdown socket [21:09:03]W: [org.apache.ignite:ignite-core] java.net.SocketException: Socket is closed [21:09:03]W: [org.apache.ignite:ignite-core] at java.net.Socket.shutdownOutput(Socket.java:1568) [21:09:03]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.close(IgniteUtils.java:4247) [21:09:03]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.discovery.tcp.ServerImpl$SocketReader.body(ServerImpl.java:7370) [21:09:03]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.IgniteSpiThread.run(IgniteSpiThread.java:58) [21:09:03] : [Step 4/5] [2021-11-19 21:09:03,723][INFO ][tcp-disco-sock-reader-[00800e71 127.0.0.1:56009]-#915%grid-1%-#17481%grid-1%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:56009, rmtPort=56009, rmtNodeId=00800e71-7913-4e3d-bbce-bf44482cf000] [21:09:03] : [Step 4/5] [2021-11-19 21:09:03,726][INFO ][main][GridCacheProcessor] Stopped cache [cacheName=ignite-sys-cache] [21:09:03] : [Step 4/5] [2021-11-19 21:09:03,728][INFO ][main][GridCacheProcessor] Stopped cache [cacheName=encrypted] [21:09:04] : [Step 4/5] [2021-11-19 21:09:04,845][INFO ][main][FilePageStoreManager] Cleanup cache stores [total=4, left=0, cleanFiles=false] [21:09:04] : [Step 4/5] [2021-11-19 21:09:04,847][INFO ][main][GridDeploymentLocalStore] Removed undeployed class: GridDeployment [ts=1637345341325, depMode=SHARED, clsLdr=IsolatedClassLoader{roleName='test'}, clsLdrId=2286d593d71-1057f7c4-3383-4522-9222-19e353cdc001, userVer=0, loc=true, sampleClsName=org.apache.ignite.internal.processors.cache.distributed.dht.preloader.IgniteDhtPartitionHistorySuppliersMap, pendingUndeploy=false, undeployed=true, usage=0] [21:09:04] : [Step 4/5] [2021-11-19 21:09:04,855][INFO ][main][IgniteKernal%grid-1] [21:09:04] : [Step 4/5] [21:09:04] : [Step 4/5] >>> +------------------------------------------------------+ [21:09:04] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV stopped OK [21:09:04] : [Step 4/5] >>> +------------------------------------------------------+ [21:09:04] : [Step 4/5] >>> Ignite instance name: grid-1 [21:09:04] : [Step 4/5] >>> Grid uptime: 00:00:03.579 [21:09:04] : [Step 4/5] [21:09:04] : [Step 4/5] [21:09:04] : [Step 4/5] [2021-11-19 21:09:04,856][INFO ][main][root] >>> Stopping grid [name=grid-0, id=00800e71-7913-4e3d-bbce-bf44482cf000] [21:09:04] : [Step 4/5] [2021-11-19 21:09:04,945][INFO ][async-runnable-runner-1][FilePageStoreManager] Cleanup cache stores [total=4, left=0, cleanFiles=false] [21:09:04] : [Step 4/5] [2021-11-19 21:09:04,947][INFO ][async-runnable-runner-1][GridDeploymentLocalStore] Removed undeployed class: GridDeployment [ts=1637345341314, depMode=SHARED, clsLdr=IsolatedClassLoader{roleName='test'}, clsLdrId=f186d593d71-00800e71-7913-4e3d-bbce-bf44482cf000, userVer=0, loc=true, sampleClsName=org.apache.ignite.internal.processors.cache.distributed.dht.preloader.GridDhtPartitionMap, pendingUndeploy=false, undeployed=true, usage=0] [21:09:04] : [Step 4/5] [2021-11-19 21:09:04,954][INFO ][async-runnable-runner-1][IgniteKernal%grid-0] [21:09:04] : [Step 4/5] [21:09:04] : [Step 4/5] >>> +------------------------------------------------------+ [21:09:04] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV stopped OK [21:09:04] : [Step 4/5] >>> +------------------------------------------------------+ [21:09:04] : [Step 4/5] >>> Ignite instance name: grid-0 [21:09:04] : [Step 4/5] >>> Grid uptime: 00:00:04.753 [21:09:04] : [Step 4/5] [21:09:04] : [Step 4/5] [21:09:05]W: [org.apache.ignite:ignite-core] [2021-11-19 21:09:05,121][WARN ][test-runner-#17517%encryption.MasterKeyChangeTest%][G] Ignite work directory is not provided, automatically resolved to: /opt/buildagent/work/7bc1c54bc719b67c/work [21:09:05] : [Step 4/5] [2021-11-19 21:09:05,122][INFO ][test-runner-#17517%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] [21:09:05] : [Step 4/5] [21:09:05] : [Step 4/5] >>> __________ ________________ [21:09:05] : [Step 4/5] >>> / _/ ___/ |/ / _/_ __/ __/ [21:09:05] : [Step 4/5] >>> _/ // (7 7 // / / / / _/ [21:09:05] : [Step 4/5] >>> /___/\___/_/|_/___/ /_/ /___/ [21:09:05] : [Step 4/5] >>> [21:09:05] : [Step 4/5] >>> ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:09:05] : [Step 4/5] >>> 2021 Copyright(C) Apache Software Foundation [21:09:05] : [Step 4/5] >>> [21:09:05] : [Step 4/5] >>> Ignite documentation: http://ignite.apache.org [21:09:05] : [Step 4/5] [21:09:05] : [Step 4/5] [2021-11-19 21:09:05,123][INFO ][test-runner-#17517%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] Config URL: n/a [21:09:05] : [Step 4/5] [2021-11-19 21:09:05,123][INFO ][test-runner-#17517%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] IgniteConfiguration [igniteInstanceName=grid-0, pubPoolSize=24, svcPoolSize=24, callbackPoolSize=24, stripedPoolSize=24, sysPoolSize=24, mgmtPoolSize=4, dataStreamerPoolSize=24, utilityCachePoolSize=24, utilityCacheKeepAliveTime=60000, p2pPoolSize=2, qryPoolSize=24, buildIdxPoolSize=4, igniteHome=/opt/buildagent/work/7bc1c54bc719b67c, igniteWorkDir=/opt/buildagent/work/7bc1c54bc719b67c/work, mbeanSrv=com.sun.jmx.mbeanserver.JmxMBeanServer@6fe85038, nodeId=00de6ea6-ad2d-479a-9898-78eaef017000, marsh=BinaryMarshaller [], marshLocJobs=false, daemon=false, p2pEnabled=true, netTimeout=10000, netCompressionLevel=1, sndRetryDelay=1000, sndRetryCnt=3, metricsHistSize=10000, metricsUpdateFreq=1000, metricsExpTime=9223372036854775807, discoSpi=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=0, ackTimeout=0, marsh=null, reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], segPlc=STOP, segResolveAttempts=2, waitForSegOnStart=true, allResolversPassReq=true, segChkFreq=10000, commSpi=TcpCommunicationSpi [connectGate=org.apache.ignite.spi.communication.tcp.internal.ConnectGateway@13a0e1ab, ctxInitLatch=java.util.concurrent.CountDownLatch@230ad74d[Count = 1], stopping=false, clientPool=null, nioSrvWrapper=null, stateProvider=null], evtSpi=MemoryEventStorageSpi [expireAgeMs=9223372036854775807, expireCnt=10000, filter=null], colSpi=NoopCollisionSpi [], deploySpi=LocalDeploymentSpi [], indexingSpi=org.apache.ignite.spi.indexing.noop.NoopIndexingSpi@7e438d90, addrRslvr=null, encryptionSpi=org.apache.ignite.spi.encryption.keystore.KeystoreEncryptionSpi@6c87b601, tracingSpi=org.apache.ignite.spi.tracing.NoopTracingSpi@ffc0f5a, clientMode=false, rebalanceThreadPoolSize=4, rebalanceTimeout=10000, rebalanceBatchesPrefetchCnt=3, rebalanceThrottle=0, rebalanceBatchSize=524288, txCfg=TransactionConfiguration [txSerEnabled=false, dfltIsolation=REPEATABLE_READ, dfltConcurrency=PESSIMISTIC, dfltTxTimeout=0, txTimeoutOnPartitionMapExchange=0, deadlockTimeout=10000, pessimisticTxLogSize=0, pessimisticTxLogLinger=10000, tmLookupClsName=null, txManagerFactory=null, useJtaSync=false], cacheSanityCheckEnabled=true, discoStartupDelay=60000, deployMode=SHARED, p2pMissedCacheSize=100, locHost=127.0.0.1, timeSrvPortBase=31100, timeSrvPortRange=100, failureDetectionTimeout=10000, sysWorkerBlockedTimeout=null, clientFailureDetectionTimeout=10000, metricsLogFreq=0, connectorCfg=null, odbcCfg=null, warmupClos=null, atomicCfg=AtomicConfiguration [seqReserveSize=1000, cacheMode=PARTITIONED, backups=1, aff=null, grpName=null], classLdr=null, sslCtxFactory=null, platformCfg=null, binaryCfg=null, memCfg=null, pstCfg=null, dsCfg=DataStorageConfiguration [sysRegionInitSize=41943040, sysRegionMaxSize=104857600, pageSize=4096, concLvl=0, dfltDataRegConf=DataRegionConfiguration [name=default, maxSize=10485760, initSize=268435456, swapPath=null, pageEvictionMode=DISABLED, pageReplacementMode=CLOCK, evictionThreshold=0.9, emptyPagesPoolSize=100, metricsEnabled=false, metricsSubIntervalCount=5, metricsRateTimeInterval=60000, persistenceEnabled=true, checkpointPageBufSize=0, lazyMemoryAllocation=true, warmUpCfg=null], dataRegions=null, storagePath=null, checkpointFreq=180000, lockWaitTime=10000, checkpointThreads=4, checkpointWriteOrder=SEQUENTIAL, walHistSize=20, maxWalArchiveSize=1073741824, walSegments=10, walSegmentSize=67108864, walPath=db/wal, walArchivePath=db/wal/archive, cdcWalPath=db/wal/cdc, cdcEnabled=false, metricsEnabled=false, walMode=FSYNC, walTlbSize=131072, walBuffSize=0, walFlushFreq=2000, walFsyncDelay=1000, walRecordIterBuffSize=67108864, alwaysWriteFullPages=false, fileIOFactory=org.apache.ignite.internal.processors.cache.persistence.file.AsyncFileIOFactory@519b9bc9, metricsSubIntervalCnt=5, metricsRateTimeInterval=60000, walAutoArchiveAfterInactivity=-1, walForceArchiveTimeout=-1, writeThrottlingEnabled=false, walCompactionEnabled=false, walCompactionLevel=1, checkpointReadLockTimeout=null, walPageCompression=DISABLED, walPageCompressionLevel=null, dfltWarmUpCfg=null, encCfg=org.apache.ignite.configuration.EncryptionConfiguration@427e3a13, defragmentationThreadPoolSize=4, minWalArchiveSize=-1], snapshotPath=snapshots, activeOnStart=true, activeOnStartPropSetFlag=false, autoActivation=true, autoActivationPropSetFlag=false, clusterStateOnStart=null, sqlConnCfg=null, cliConnCfg=ClientConnectorConfiguration [host=null, port=10800, portRange=100, sockSndBufSize=0, sockRcvBufSize=0, tcpNoDelay=true, maxOpenCursorsPerConn=128, threadPoolSize=24, selectorCnt=12, idleTimeout=0, handshakeTimeout=10000, jdbcEnabled=true, odbcEnabled=true, thinCliEnabled=true, sslEnabled=false, useIgniteSslCtxFactory=true, sslClientAuth=false, sslCtxFactory=null, thinCliCfg=ThinClientConfiguration [maxActiveTxPerConn=100, maxActiveComputeTasksPerConn=0]], mvccVacuumThreadCnt=2, mvccVacuumFreq=5000, authEnabled=false, failureHnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]], commFailureRslvr=null, sqlCfg=SqlConfiguration [longQryWarnTimeout=3000, dfltQryTimeout=0, sqlQryHistSize=1000, validationEnabled=false], asyncContinuationExecutor=null] [21:09:05] : [Step 4/5] [2021-11-19 21:09:05,132][INFO ][test-runner-#17517%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] Daemon mode: off [21:09:05] : [Step 4/5] [2021-11-19 21:09:05,132][INFO ][test-runner-#17517%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] OS: Linux 4.15.0-151-generic amd64 [21:09:05] : [Step 4/5] [2021-11-19 21:09:05,132][INFO ][test-runner-#17517%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] OS user: teamcity [21:09:05] : [Step 4/5] [2021-11-19 21:09:05,132][INFO ][test-runner-#17517%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] PID: 16724 [21:09:05] : [Step 4/5] [2021-11-19 21:09:05,133][INFO ][test-runner-#17517%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] Language runtime: Java Platform API Specification ver. 1.8 [21:09:05] : [Step 4/5] [2021-11-19 21:09:05,133][INFO ][test-runner-#17517%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] VM information: Java(TM) SE Runtime Environment 1.8.0_261-b12 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 25.261-b12 [21:09:05] : [Step 4/5] [2021-11-19 21:09:05,133][INFO ][test-runner-#17517%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] VM total memory: 1.9GB [21:09:05] : [Step 4/5] [2021-11-19 21:09:05,133][INFO ][test-runner-#17517%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] Remote Management [restart: off, REST: off, JMX (remote: off)] [21:09:05] : [Step 4/5] [2021-11-19 21:09:05,134][INFO ][test-runner-#17517%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] Logger: GridTestLog4jLogger [quiet=false, config=null] [21:09:05] : [Step 4/5] [2021-11-19 21:09:05,134][INFO ][test-runner-#17517%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] IGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c [21:09:05] : [Step 4/5] [2021-11-19 21:09:05,134][INFO ][test-runner-#17517%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] VM arguments: [-DIGNITE_DUMP_THREADS_ON_FAILURE=false, -DMono=/usr/bin/mono-sgen, -DMono4.0_x64=/usr/lib/mono/4.0, -DMono4.5_x64=/usr/lib/mono/4.5, -DMonoVersion=6.12.0.90, -DSKIP_BUILD=false, -Dagent.home.dir=/opt/buildagent, -Dagent.name=aitc-lin02_03, -Dagent.ownPort=9090, -Dagent.work.dir=/opt/buildagent/work, -Dbuild.number=95, -Dbuild.vcs.number=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.1=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.GitHubApacheIgnite=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dclassworlds.conf=/opt/buildagent/temp/buildTmp/teamcity.m2.conf, -Dcom.jetbrains.maven.watcher.report.file=/opt/buildagent/temp/buildTmp/maven-build-info.xml, -Djava.io.tmpdir=/opt/buildagent/temp/buildTmp, -Dmaven.home=/opt/buildagent/tools/maven3_6, -Dmaven.multiModuleProjectDirectory=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.agent.cpuBenchmark=457, -Dteamcity.agent.dotnet.agent_url=http://localhost:9090/RPC2, -Dteamcity.agent.dotnet.build_id=6278078, -Dteamcity.auth.password=*******, -Dteamcity.auth.userId=TeamCityBuildId=6278078, -Dteamcity.build.changedFiles.file=/opt/buildagent/temp/buildTmp/changedFiles6342607772318147725.txt, -Dteamcity.build.checkoutDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.build.id=6278078, -Dteamcity.build.properties.file=/opt/buildagent/temp/buildTmp/teamcity.build5164517880467851002.properties, -Dteamcity.build.tempDir=/opt/buildagent/temp/buildTmp, -Dteamcity.build.workingDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.buildConfName=Basic 3, -Dteamcity.buildType.id=IgniteTests24Java8_Basic3, -Dteamcity.configuration.properties.file=/opt/buildagent/temp/buildTmp/teamcity.config5591980786735343870.properties, -Dteamcity.maven.userSettings.path=/opt/buildagent/temp/buildTmp/maven_settings_585072866407032347.xml, -Dteamcity.maven.watcher.home=/opt/buildagent/plugins/mavenPlugin/maven-watcher-jdk16, -Dteamcity.projectName=Ignite Tests 2.x (JDK 8/11), -Dteamcity.runner.properties.file=/opt/buildagent/temp/buildTmp/teamcity.runner9098465561618137420.properties, -Dteamcity.tests.recentlyFailedTests.file=/opt/buildagent/temp/buildTmp/testsToRunFirst3891775683130404069.txt, -Dteamcity.version=2021.2 (build 99542), -ea, -Xms2g, -Xmx2g, -XX:+HeapDumpOnOutOfMemoryError, -DIGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_TEST_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_UPDATE_NOTIFIER=false, -DIGNITE_NO_DISCO_ORDER=true, -DIGNITE_PERFORMANCE_SUGGESTIONS_DISABLED=true, -Djava.net.preferIPv4Stack=true, -DTEST_SCALE_FACTOR=1.0, -DIGNITE_TEST_PROP_LOG4J_FILE=log4j-tc-test.xml, -DIGNITE_QUIET=false, -DIGNITE_MARSHAL_BUFFERS_RECHECK=1000, -Dmaven.repo.local=/opt/buildagent/.m2/repository] [21:09:05] : [Step 4/5] [2021-11-19 21:09:05,138][INFO ][test-runner-#17517%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] System cache's DataRegion size is configured to 40 MB. Use DataStorageConfiguration.systemRegionInitialSize property to change the setting. [21:09:05] : [Step 4/5] [2021-11-19 21:09:05,139][INFO ][test-runner-#17517%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] Configured caches [in 'sysMemPlc' dataRegion: ['ignite-sys-cache']] [21:09:05]W: [org.apache.ignite:ignite-core] [2021-11-19 21:09:05,139][WARN ][test-runner-#17517%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] Peer class loading is enabled (disable it in production for performance and deployment consistency reasons) [21:09:05] : [Step 4/5] [2021-11-19 21:09:05,139][INFO ][test-runner-#17517%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] 3-rd party licenses can be found at: /opt/buildagent/work/7bc1c54bc719b67c/libs/licenses [21:09:05] : [Step 4/5] [2021-11-19 21:09:05,143][INFO ][test-runner-#17517%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] Configured plugins: [21:09:05] : [Step 4/5] [2021-11-19 21:09:05,143][INFO ][test-runner-#17517%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] ^-- StanByClusterTestProvider 1.0 [21:09:05] : [Step 4/5] [2021-11-19 21:09:05,143][INFO ][test-runner-#17517%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:09:05] : [Step 4/5] [2021-11-19 21:09:05,144][INFO ][test-runner-#17517%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] [21:09:05] : [Step 4/5] [2021-11-19 21:09:05,144][INFO ][test-runner-#17517%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] ^-- PageMemory tracker plugin 1.0 [21:09:05] : [Step 4/5] [2021-11-19 21:09:05,144][INFO ][test-runner-#17517%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:09:05] : [Step 4/5] [2021-11-19 21:09:05,144][INFO ][test-runner-#17517%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] [21:09:05] : [Step 4/5] [2021-11-19 21:09:05,144][INFO ][test-runner-#17517%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] ^-- TestDistibutedConfigurationPlugin 1.0 [21:09:05] : [Step 4/5] [2021-11-19 21:09:05,144][INFO ][test-runner-#17517%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:09:05] : [Step 4/5] [2021-11-19 21:09:05,145][INFO ][test-runner-#17517%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] [21:09:05] : [Step 4/5] [2021-11-19 21:09:05,145][INFO ][test-runner-#17517%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] ^-- NodeValidationPluginProvider 1.0 [21:09:05] : [Step 4/5] [2021-11-19 21:09:05,145][INFO ][test-runner-#17517%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:09:05] : [Step 4/5] [2021-11-19 21:09:05,145][INFO ][test-runner-#17517%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] [21:09:05] : [Step 4/5] [2021-11-19 21:09:05,145][INFO ][test-runner-#17517%encryption.MasterKeyChangeTest%][FailureProcessor] Configured failure handler: [hnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]]] [21:09:05]W: [org.apache.ignite:ignite-core] [2021-11-19 21:09:05,160][WARN ][test-runner-#17517%encryption.MasterKeyChangeTest%][TestRecordingCommunicationSpi] Message queue limit is set to 0 which may lead to potential OOMEs when running cache operations in FULL_ASYNC or PRIMARY_SYNC modes due to message queues growth on sender and receiver sides. [21:09:05] : [Step 4/5] [2021-11-19 21:09:05,159][INFO ][test-runner-#17517%encryption.MasterKeyChangeTest%][TestRecordingCommunicationSpi] Successfully bound communication NIO server to TCP port [port=47100, locHost=/127.0.0.1, selectorsCnt=12, selectorSpins=0, pairedConn=false] [21:09:05] : [Step 4/5] [2021-11-19 21:09:05,164][INFO ][test-runner-#17517%encryption.MasterKeyChangeTest%][GridCollisionManager] Collision resolution is disabled (all jobs will be activated upon arrival). [21:09:05] : [Step 4/5] [2021-11-19 21:09:05,165][INFO ][test-runner-#17517%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] Security status [authentication=off, sandbox=off, tls/ssl=off] [21:09:05] : [Step 4/5] [2021-11-19 21:09:05,220][INFO ][test-runner-#17517%encryption.MasterKeyChangeTest%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:09:05] : [Step 4/5] [2021-11-19 21:09:05,312][INFO ][test-runner-#17517%encryption.MasterKeyChangeTest%][MaintenanceProcessor] Resolved store directory for node persistent data: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0 [21:09:05] : [Step 4/5] [2021-11-19 21:09:05,313][INFO ][test-runner-#17517%encryption.MasterKeyChangeTest%][CacheObjectBinaryProcessorImpl] Resolved directory for serialized binary metadata: /opt/buildagent/work/7bc1c54bc719b67c/work/db/binary_meta/grid_0 [21:09:05] : [Step 4/5] [2021-11-19 21:09:05,317][INFO ][test-runner-#17517%encryption.MasterKeyChangeTest%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0 [21:09:05] : [Step 4/5] [2021-11-19 21:09:05,317][INFO ][test-runner-#17517%encryption.MasterKeyChangeTest%][FileWriteAheadLogManager] Resolved write ahead log work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0 [21:09:05] : [Step 4/5] [2021-11-19 21:09:05,317][INFO ][test-runner-#17517%encryption.MasterKeyChangeTest%][FileWriteAheadLogManager] Resolved write ahead log archive directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0 [21:09:05] : [Step 4/5] [2021-11-19 21:09:05,788][INFO ][test-runner-#17517%encryption.MasterKeyChangeTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000000.wal [21:09:05]W: [org.apache.ignite:ignite-core] [2021-11-19 21:09:05,788][WARN ][test-runner-#17517%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] DataRegion maxSize=10.5 MB is smaller than defaultInitialSize=268.4 MB, setting initialSize to 10.5 MB [21:09:05] : [Step 4/5] [2021-11-19 21:09:05,792][INFO ][test-runner-#17517%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Configured data regions initialized successfully [total=5] [21:09:05] : [Step 4/5] [2021-11-19 21:09:05,795][INFO ][test-runner-#17517%encryption.MasterKeyChangeTest%][IgniteSnapshotManager] Resolved snapshot work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/snapshots [21:09:05] : [Step 4/5] [2021-11-19 21:09:05,796][INFO ][test-runner-#17517%encryption.MasterKeyChangeTest%][IgniteSnapshotManager] Resolved temp directory for snapshot creation: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0/snp [21:09:05] : [Step 4/5] [2021-11-19 21:09:05,798][INFO ][test-runner-#17517%encryption.MasterKeyChangeTest%][ClientListenerProcessor] Client connector processor has started on TCP port 10800 [21:09:05] : [Step 4/5] [2021-11-19 21:09:05,803][INFO ][test-runner-#17517%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] Non-loopback local IPs: 172.17.0.4 [21:09:05] : [Step 4/5] [2021-11-19 21:09:05,803][INFO ][test-runner-#17517%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] Enabled local MACs: 0242AC110004 [21:09:05] : [Step 4/5] [2021-11-19 21:09:05,805][INFO ][test-runner-#17517%encryption.MasterKeyChangeTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:09:05] : [Step 4/5] [2021-11-19 21:09:05,806][INFO ][test-runner-#17517%encryption.MasterKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:09:05] : [Step 4/5] [2021-11-19 21:09:05,806][INFO ][test-runner-#17517%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:09:05] : [Step 4/5] [2021-11-19 21:09:05,808][INFO ][test-runner-#17517%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Applying lost metastore updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:09:05] : [Step 4/5] [2021-11-19 21:09:05,809][INFO ][test-runner-#17517%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=0 ms] [21:09:05] : [Step 4/5] [2021-11-19 21:09:05,809][INFO ][test-runner-#17517%encryption.MasterKeyChangeTest%][GridCacheProcessor] Restoring partition state for local groups. [21:09:05] : [Step 4/5] [2021-11-19 21:09:05,809][INFO ][test-runner-#17517%encryption.MasterKeyChangeTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=0, partitionsProcessed=0, time=0ms] [21:09:05] : [Step 4/5] [2021-11-19 21:09:05,810][INFO ][test-runner-#17517%encryption.MasterKeyChangeTest%][GridEncryptionManager] Encryption keys loaded from metastore. [grps=, masterKeyName=ignite.master.key] [21:09:05] : [Step 4/5] [2021-11-19 21:09:05,814][INFO ][test-runner-#17517%encryption.MasterKeyChangeTest%][ClusterProcessor] Cluster ID and tag has been read from metastorage: null [21:09:05] : [Step 4/5] [2021-11-19 21:09:05,815][INFO ][test-runner-#17517%encryption.MasterKeyChangeTest%][IgniteClusterImpl] Shutdown policy was updated [oldVal=null, newVal=null] [21:09:05] : [Step 4/5] [2021-11-19 21:09:05,815][INFO ][test-runner-#17517%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Checkpoint frequency deviation changed [oldVal=null, newVal=null] [21:09:05] : [Step 4/5] [2021-11-19 21:09:05,825][INFO ][test-runner-#17517%encryption.MasterKeyChangeTest%][FilePageStoreManager] Cleanup cache stores [total=1, left=0, cleanFiles=false] [21:09:05] : [Step 4/5] [2021-11-19 21:09:05,827][INFO ][test-runner-#17517%encryption.MasterKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:09:05] : [Step 4/5] [2021-11-19 21:09:05,827][INFO ][test-runner-#17517%encryption.MasterKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:09:05] : [Step 4/5] [2021-11-19 21:09:05,828][INFO ][test-runner-#17517%encryption.MasterKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:09:05] : [Step 4/5] [2021-11-19 21:09:05,829][INFO ][test-runner-#17517%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Data Regions Started: 5 [21:09:05] : [Step 4/5] [2021-11-19 21:09:05,829][INFO ][test-runner-#17517%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] ^-- sysMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:09:05] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:09:05] : [Step 4/5] ^-- default region [type=default, persistence=true, lazyAlloc=true, [21:09:05] : [Step 4/5] ... initCfg=10MB, maxCfg=10MB, usedRam=0MB, freeRam=100%, allocRam=0MB, allocTotal=0MB] [21:09:05] : [Step 4/5] ^-- metastoreMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:09:05] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:09:05] : [Step 4/5] ^-- TxLog region [type=internal, persistence=true, lazyAlloc=false, [21:09:05] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:09:05] : [Step 4/5] ^-- volatileDsMemPlc region [type=user, persistence=false, lazyAlloc=true, [21:09:05] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB] [21:09:05] : [Step 4/5] ^-- Ignite persistence [used=0MB] [21:09:05] : [Step 4/5] [21:09:05] : [Step 4/5] [2021-11-19 21:09:05,830][INFO ][test-runner-#17517%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Starting binary memory restore for: [-2100569601] [21:09:05] : [Step 4/5] [2021-11-19 21:09:05,837][INFO ][test-runner-#17517%encryption.MasterKeyChangeTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:09:05] : [Step 4/5] [2021-11-19 21:09:05,838][INFO ][test-runner-#17517%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:09:05] : [Step 4/5] [2021-11-19 21:09:05,839][INFO ][test-runner-#17517%encryption.MasterKeyChangeTest%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000000.wal, offset=0, ver=2] [21:09:05] : [Step 4/5] [2021-11-19 21:09:05,843][INFO ][test-runner-#17517%encryption.MasterKeyChangeTest%][GridCacheProcessor] Started cache in recovery mode [name=ignite-sys-cache, id=-2100569601, dataRegionName=sysMemPlc, mode=REPLICATED, atomicity=TRANSACTIONAL, backups=2147483647, mvcc=false] [21:09:05] : [Step 4/5] [2021-11-19 21:09:05,844][INFO ][test-runner-#17517%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Binary recovery performed in 14 ms. [21:09:05] : [Step 4/5] [2021-11-19 21:09:05,844][INFO ][test-runner-#17517%encryption.MasterKeyChangeTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:09:05] : [Step 4/5] [2021-11-19 21:09:05,844][INFO ][test-runner-#17517%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Applying lost cache updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:09:05] : [Step 4/5] [2021-11-19 21:09:05,905][INFO ][test-runner-#17517%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=60 ms] [21:09:05] : [Step 4/5] [2021-11-19 21:09:05,906][INFO ][test-runner-#17517%encryption.MasterKeyChangeTest%][GridCacheProcessor] Restoring partition state for local groups. [21:09:05] : [Step 4/5] [2021-11-19 21:09:05,921][INFO ][test-runner-#17517%encryption.MasterKeyChangeTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=1, partitionsProcessed=100, time=10ms] [21:09:06] : [Step 4/5] [2021-11-19 21:09:06,339][INFO ][test-runner-#17517%encryption.MasterKeyChangeTest%][TestTcpDiscoverySpi] Successfully bound to TCP port [port=47500, localHost=localhost/127.0.0.1, locNodeId=00de6ea6-ad2d-479a-9898-78eaef017000] [21:09:06] : [Step 4/5] [2021-11-19 21:09:06,348][INFO ][disco-notifier-worker-#17628%grid-0%][MvccProcessorImpl] Assigned mvcc coordinator [crd=MvccCoordinator [topVer=AffinityTopologyVersion [topVer=1, minorTopVer=0], nodeId=00de6ea6-ad2d-479a-9898-78eaef017000, ver=1637345346339, local=true, initialized=false]] [21:09:06] : [Step 4/5] [2021-11-19 21:09:06,350][INFO ][sys-#17626%grid-0%][ClusterProcessor] Writing cluster ID and tag to metastorage on ready for write ClusterIdAndTag [id=1b106919-9253-4d42-a440-c2fcc6581f51, tag=agitated_leakey] [21:09:06] : [Step 4/5] [2021-11-19 21:09:06,352][INFO ][disco-notifier-worker-#17628%grid-0%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustEnabled' was changed from 'null' to 'false' [21:09:06] : [Step 4/5] [2021-11-19 21:09:06,354][INFO ][disco-notifier-worker-#17628%grid-0%][ClusterProcessor] agitated_leakey [21:09:06] : [Step 4/5] [2021-11-19 21:09:06,354][INFO ][disco-notifier-worker-#17628%grid-0%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustTimeout' was changed from 'null' to '300000' [21:09:06] : [Step 4/5] [2021-11-19 21:09:06,354][INFO ][disco-notifier-worker-#17628%grid-0%][IgniteTxManager] Transactions parameter 'longOperationsDumpTimeout' was changed from 'null' to '60000' [21:09:06] : [Step 4/5] [2021-11-19 21:09:06,355][INFO ][disco-notifier-worker-#17628%grid-0%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpThreshold' was changed from 'null' to '0' [21:09:06] : [Step 4/5] [2021-11-19 21:09:06,355][INFO ][disco-notifier-worker-#17628%grid-0%][IgniteTxManager] Transactions parameter 'transactionTimeDumpSamplesCoefficient' was changed from 'null' to '0.0' [21:09:06] : [Step 4/5] [2021-11-19 21:09:06,356][INFO ][disco-notifier-worker-#17628%grid-0%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpSamplesPerSecondLimit' was changed from 'null' to '5' [21:09:06] : [Step 4/5] [2021-11-19 21:09:06,356][INFO ][disco-notifier-worker-#17628%grid-0%][IgniteTxManager] Transactions parameter 'collisionsDumpInterval' was changed from 'null' to '1000' [21:09:06] : [Step 4/5] [2021-11-19 21:09:06,358][INFO ][disco-notifier-worker-#17628%grid-0%][IgniteTxManager] Transactions parameter 'txOwnerDumpRequestsAllowed' was changed from 'null' to 'true' [21:09:06] : [Step 4/5] [2021-11-19 21:09:06,359][INFO ][disco-notifier-worker-#17628%grid-0%][GridCacheDatabaseSharedManager] Historical rebalance WAL threshold changed [property=historical.rebalance.threshold, oldVal=null, newVal=500] [21:09:06] : [Step 4/5] [2021-11-19 21:09:06,359][INFO ][test-runner-#17517%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] To start Console Management & Monitoring run ignitevisorcmd.{sh|bat} [21:09:06] : [Step 4/5] [2021-11-19 21:09:06,359][INFO ][test-runner-#17517%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] [21:09:06] : [Step 4/5] [21:09:06] : [Step 4/5] >>> +-------------------------------------------+ [21:09:06] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:09:06] : [Step 4/5] >>> +-------------------------------------------+ [21:09:06] : [Step 4/5] >>> OS name: Linux 4.15.0-151-generic amd64 [21:09:06] : [Step 4/5] >>> CPU(s): 24 [21:09:06] : [Step 4/5] >>> Heap: 2.0GB [21:09:06] : [Step 4/5] >>> VM name: 16724@c4dfe9a430b2 [21:09:06] : [Step 4/5] >>> Ignite instance name: grid-0 [21:09:06] : [Step 4/5] >>> Local node [ID=00DE6EA6-AD2D-479A-9898-78EAEF017000, order=1, clientMode=false] [21:09:06] : [Step 4/5] >>> Local node addresses: [127.0.0.1] [21:09:06] : [Step 4/5] >>> Local ports: TCP:10800 TCP:47100 TCP:47500 [21:09:06] : [Step 4/5] [21:09:06] : [Step 4/5] [2021-11-19 21:09:06,360][INFO ][test-runner-#17517%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] >>> Ignite cluster is in INACTIVE state (limited functionality available). Use control.(sh|bat) script or IgniteCluster.state(ClusterState.ACTIVE) to change the state. [21:09:06] : [Step 4/5] [2021-11-19 21:09:06,361][INFO ][test-runner-#17517%encryption.MasterKeyChangeTest%][GridDiscoveryManager] Topology snapshot [ver=1, locNode=00de6ea6, servers=1, clients=0, state=INACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=00de6ea6-ad2d-479a-9898-78eaef017000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:09:06] : [Step 4/5] [2021-11-19 21:09:06,362][INFO ][test-runner-#17517%encryption.MasterKeyChangeTest%][G] Node started : [stage="Configure system pool" (0 ms),stage="Start managers" (191 ms),stage="Configure binary metadata" (1 ms),stage="Start processors" (487 ms),stage="Start 'StanByClusterTestProvider' plugin" (0 ms),stage="Start 'PageMemory tracker plugin' plugin" (0 ms),stage="Start 'TestDistibutedConfigurationPlugin' plugin" (0 ms),stage="Start 'NodeValidationPluginProvider' plugin" (0 ms),stage="Init metastore" (22 ms),stage="Init and start regions" (5 ms),stage="Restore binary memory" (13 ms),stage="Restore logical state" (77 ms),stage="Finish recovery" (416 ms),stage="Join topology" (10 ms),stage="Await transition" (1 ms),stage="Await exchange" (11 ms),stage="Total time" (1234 ms)] [21:09:06] : [Step 4/5] [2021-11-19 21:09:06,363][INFO ][test-runner-#17517%encryption.MasterKeyChangeTest%][root] Node started with the following configuration [id=00de6ea6-ad2d-479a-9898-78eaef017000, marshaller=BinaryMarshaller [], discovery=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=5000, ackTimeout=5000, marsh=JdkMarshaller [clsFilter=org.apache.ignite.marshaller.MarshallerUtils$1@2ac6608d], reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], binaryCfg=null, lateAff=true] [21:09:06]W: [org.apache.ignite:ignite-core] [2021-11-19 21:09:06,368][WARN ][test-runner-#17517%encryption.MasterKeyChangeTest%][G] Ignite work directory is not provided, automatically resolved to: /opt/buildagent/work/7bc1c54bc719b67c/work [21:09:06] : [Step 4/5] [2021-11-19 21:09:06,369][INFO ][test-runner-#17517%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] [21:09:06] : [Step 4/5] [21:09:06] : [Step 4/5] >>> __________ ________________ [21:09:06] : [Step 4/5] >>> / _/ ___/ |/ / _/_ __/ __/ [21:09:06] : [Step 4/5] >>> _/ // (7 7 // / / / / _/ [21:09:06] : [Step 4/5] >>> /___/\___/_/|_/___/ /_/ /___/ [21:09:06] : [Step 4/5] >>> [21:09:06] : [Step 4/5] >>> ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:09:06] : [Step 4/5] >>> 2021 Copyright(C) Apache Software Foundation [21:09:06] : [Step 4/5] >>> [21:09:06] : [Step 4/5] >>> Ignite documentation: http://ignite.apache.org [21:09:06] : [Step 4/5] [21:09:06] : [Step 4/5] [2021-11-19 21:09:06,370][INFO ][test-runner-#17517%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] Config URL: n/a [21:09:06] : [Step 4/5] [2021-11-19 21:09:06,370][INFO ][test-runner-#17517%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] IgniteConfiguration [igniteInstanceName=grid-1, pubPoolSize=24, svcPoolSize=24, callbackPoolSize=24, stripedPoolSize=24, sysPoolSize=24, mgmtPoolSize=4, dataStreamerPoolSize=24, utilityCachePoolSize=24, utilityCacheKeepAliveTime=60000, p2pPoolSize=2, qryPoolSize=24, buildIdxPoolSize=4, igniteHome=/opt/buildagent/work/7bc1c54bc719b67c, igniteWorkDir=/opt/buildagent/work/7bc1c54bc719b67c/work, mbeanSrv=com.sun.jmx.mbeanserver.JmxMBeanServer@6fe85038, nodeId=108fb582-8249-4a48-a44f-d700a8989001, marsh=BinaryMarshaller [], marshLocJobs=false, daemon=false, p2pEnabled=true, netTimeout=10000, netCompressionLevel=1, sndRetryDelay=1000, sndRetryCnt=3, metricsHistSize=10000, metricsUpdateFreq=1000, metricsExpTime=9223372036854775807, discoSpi=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=0, ackTimeout=0, marsh=null, reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], segPlc=STOP, segResolveAttempts=2, waitForSegOnStart=true, allResolversPassReq=true, segChkFreq=10000, commSpi=TcpCommunicationSpi [connectGate=org.apache.ignite.spi.communication.tcp.internal.ConnectGateway@592c759b, ctxInitLatch=java.util.concurrent.CountDownLatch@1b7ecf53[Count = 1], stopping=false, clientPool=null, nioSrvWrapper=null, stateProvider=null], evtSpi=MemoryEventStorageSpi [expireAgeMs=9223372036854775807, expireCnt=10000, filter=null], colSpi=NoopCollisionSpi [], deploySpi=LocalDeploymentSpi [], indexingSpi=org.apache.ignite.spi.indexing.noop.NoopIndexingSpi@42b8f178, addrRslvr=null, encryptionSpi=org.apache.ignite.spi.encryption.keystore.KeystoreEncryptionSpi@352f2a2, tracingSpi=org.apache.ignite.spi.tracing.NoopTracingSpi@4ab03935, clientMode=false, rebalanceThreadPoolSize=4, rebalanceTimeout=10000, rebalanceBatchesPrefetchCnt=3, rebalanceThrottle=0, rebalanceBatchSize=524288, txCfg=TransactionConfiguration [txSerEnabled=false, dfltIsolation=REPEATABLE_READ, dfltConcurrency=PESSIMISTIC, dfltTxTimeout=0, txTimeoutOnPartitionMapExchange=0, deadlockTimeout=10000, pessimisticTxLogSize=0, pessimisticTxLogLinger=10000, tmLookupClsName=null, txManagerFactory=null, useJtaSync=false], cacheSanityCheckEnabled=true, discoStartupDelay=60000, deployMode=SHARED, p2pMissedCacheSize=100, locHost=127.0.0.1, timeSrvPortBase=31100, timeSrvPortRange=100, failureDetectionTimeout=10000, sysWorkerBlockedTimeout=null, clientFailureDetectionTimeout=10000, metricsLogFreq=0, connectorCfg=null, odbcCfg=null, warmupClos=null, atomicCfg=AtomicConfiguration [seqReserveSize=1000, cacheMode=PARTITIONED, backups=1, aff=null, grpName=null], classLdr=null, sslCtxFactory=null, platformCfg=null, binaryCfg=null, memCfg=null, pstCfg=null, dsCfg=DataStorageConfiguration [sysRegionInitSize=41943040, sysRegionMaxSize=104857600, pageSize=4096, concLvl=0, dfltDataRegConf=DataRegionConfiguration [name=default, maxSize=10485760, initSize=268435456, swapPath=null, pageEvictionMode=DISABLED, pageReplacementMode=CLOCK, evictionThreshold=0.9, emptyPagesPoolSize=100, metricsEnabled=false, metricsSubIntervalCount=5, metricsRateTimeInterval=60000, persistenceEnabled=true, checkpointPageBufSize=0, lazyMemoryAllocation=true, warmUpCfg=null], dataRegions=null, storagePath=null, checkpointFreq=180000, lockWaitTime=10000, checkpointThreads=4, checkpointWriteOrder=SEQUENTIAL, walHistSize=20, maxWalArchiveSize=1073741824, walSegments=10, walSegmentSize=67108864, walPath=db/wal, walArchivePath=db/wal/archive, cdcWalPath=db/wal/cdc, cdcEnabled=false, metricsEnabled=false, walMode=FSYNC, walTlbSize=131072, walBuffSize=0, walFlushFreq=2000, walFsyncDelay=1000, walRecordIterBuffSize=67108864, alwaysWriteFullPages=false, fileIOFactory=org.apache.ignite.internal.processors.cache.persistence.file.AsyncFileIOFactory@2d8f0ac6, metricsSubIntervalCnt=5, metricsRateTimeInterval=60000, walAutoArchiveAfterInactivity=-1, walForceArchiveTimeout=-1, writeThrottlingEnabled=false, walCompactionEnabled=false, walCompactionLevel=1, checkpointReadLockTimeout=null, walPageCompression=DISABLED, walPageCompressionLevel=null, dfltWarmUpCfg=null, encCfg=org.apache.ignite.configuration.EncryptionConfiguration@5b83bf67, defragmentationThreadPoolSize=4, minWalArchiveSize=-1], snapshotPath=snapshots, activeOnStart=true, activeOnStartPropSetFlag=false, autoActivation=true, autoActivationPropSetFlag=false, clusterStateOnStart=null, sqlConnCfg=null, cliConnCfg=ClientConnectorConfiguration [host=null, port=10800, portRange=100, sockSndBufSize=0, sockRcvBufSize=0, tcpNoDelay=true, maxOpenCursorsPerConn=128, threadPoolSize=24, selectorCnt=12, idleTimeout=0, handshakeTimeout=10000, jdbcEnabled=true, odbcEnabled=true, thinCliEnabled=true, sslEnabled=false, useIgniteSslCtxFactory=true, sslClientAuth=false, sslCtxFactory=null, thinCliCfg=ThinClientConfiguration [maxActiveTxPerConn=100, maxActiveComputeTasksPerConn=0]], mvccVacuumThreadCnt=2, mvccVacuumFreq=5000, authEnabled=false, failureHnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]], commFailureRslvr=null, sqlCfg=SqlConfiguration [longQryWarnTimeout=3000, dfltQryTimeout=0, sqlQryHistSize=1000, validationEnabled=false], asyncContinuationExecutor=null] [21:09:06] : [Step 4/5] [2021-11-19 21:09:06,379][INFO ][test-runner-#17517%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] Daemon mode: off [21:09:06] : [Step 4/5] [2021-11-19 21:09:06,379][INFO ][test-runner-#17517%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] OS: Linux 4.15.0-151-generic amd64 [21:09:06] : [Step 4/5] [2021-11-19 21:09:06,380][INFO ][test-runner-#17517%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] OS user: teamcity [21:09:06] : [Step 4/5] [2021-11-19 21:09:06,380][INFO ][test-runner-#17517%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] PID: 16724 [21:09:06] : [Step 4/5] [2021-11-19 21:09:06,380][INFO ][test-runner-#17517%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] Language runtime: Java Platform API Specification ver. 1.8 [21:09:06] : [Step 4/5] [2021-11-19 21:09:06,380][INFO ][test-runner-#17517%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] VM information: Java(TM) SE Runtime Environment 1.8.0_261-b12 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 25.261-b12 [21:09:06] : [Step 4/5] [2021-11-19 21:09:06,381][INFO ][test-runner-#17517%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] VM total memory: 1.9GB [21:09:06] : [Step 4/5] [2021-11-19 21:09:06,381][INFO ][test-runner-#17517%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] Remote Management [restart: off, REST: off, JMX (remote: off)] [21:09:06] : [Step 4/5] [2021-11-19 21:09:06,381][INFO ][test-runner-#17517%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] Logger: GridTestLog4jLogger [quiet=false, config=null] [21:09:06] : [Step 4/5] [2021-11-19 21:09:06,381][INFO ][test-runner-#17517%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] IGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c [21:09:06] : [Step 4/5] [2021-11-19 21:09:06,381][INFO ][test-runner-#17517%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] VM arguments: [-DIGNITE_DUMP_THREADS_ON_FAILURE=false, -DMono=/usr/bin/mono-sgen, -DMono4.0_x64=/usr/lib/mono/4.0, -DMono4.5_x64=/usr/lib/mono/4.5, -DMonoVersion=6.12.0.90, -DSKIP_BUILD=false, -Dagent.home.dir=/opt/buildagent, -Dagent.name=aitc-lin02_03, -Dagent.ownPort=9090, -Dagent.work.dir=/opt/buildagent/work, -Dbuild.number=95, -Dbuild.vcs.number=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.1=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.GitHubApacheIgnite=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dclassworlds.conf=/opt/buildagent/temp/buildTmp/teamcity.m2.conf, -Dcom.jetbrains.maven.watcher.report.file=/opt/buildagent/temp/buildTmp/maven-build-info.xml, -Djava.io.tmpdir=/opt/buildagent/temp/buildTmp, -Dmaven.home=/opt/buildagent/tools/maven3_6, -Dmaven.multiModuleProjectDirectory=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.agent.cpuBenchmark=457, -Dteamcity.agent.dotnet.agent_url=http://localhost:9090/RPC2, -Dteamcity.agent.dotnet.build_id=6278078, -Dteamcity.auth.password=*******, -Dteamcity.auth.userId=TeamCityBuildId=6278078, -Dteamcity.build.changedFiles.file=/opt/buildagent/temp/buildTmp/changedFiles6342607772318147725.txt, -Dteamcity.build.checkoutDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.build.id=6278078, -Dteamcity.build.properties.file=/opt/buildagent/temp/buildTmp/teamcity.build5164517880467851002.properties, -Dteamcity.build.tempDir=/opt/buildagent/temp/buildTmp, -Dteamcity.build.workingDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.buildConfName=Basic 3, -Dteamcity.buildType.id=IgniteTests24Java8_Basic3, -Dteamcity.configuration.properties.file=/opt/buildagent/temp/buildTmp/teamcity.config5591980786735343870.properties, -Dteamcity.maven.userSettings.path=/opt/buildagent/temp/buildTmp/maven_settings_585072866407032347.xml, -Dteamcity.maven.watcher.home=/opt/buildagent/plugins/mavenPlugin/maven-watcher-jdk16, -Dteamcity.projectName=Ignite Tests 2.x (JDK 8/11), -Dteamcity.runner.properties.file=/opt/buildagent/temp/buildTmp/teamcity.runner9098465561618137420.properties, -Dteamcity.tests.recentlyFailedTests.file=/opt/buildagent/temp/buildTmp/testsToRunFirst3891775683130404069.txt, -Dteamcity.version=2021.2 (build 99542), -ea, -Xms2g, -Xmx2g, -XX:+HeapDumpOnOutOfMemoryError, -DIGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_TEST_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_UPDATE_NOTIFIER=false, -DIGNITE_NO_DISCO_ORDER=true, -DIGNITE_PERFORMANCE_SUGGESTIONS_DISABLED=true, -Djava.net.preferIPv4Stack=true, -DTEST_SCALE_FACTOR=1.0, -DIGNITE_TEST_PROP_LOG4J_FILE=log4j-tc-test.xml, -DIGNITE_QUIET=false, -DIGNITE_MARSHAL_BUFFERS_RECHECK=1000, -Dmaven.repo.local=/opt/buildagent/.m2/repository] [21:09:06] : [Step 4/5] [2021-11-19 21:09:06,386][INFO ][test-runner-#17517%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] System cache's DataRegion size is configured to 40 MB. Use DataStorageConfiguration.systemRegionInitialSize property to change the setting. [21:09:06] : [Step 4/5] [2021-11-19 21:09:06,386][INFO ][test-runner-#17517%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] Configured caches [in 'sysMemPlc' dataRegion: ['ignite-sys-cache']] [21:09:06]W: [org.apache.ignite:ignite-core] [2021-11-19 21:09:06,386][WARN ][test-runner-#17517%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] Peer class loading is enabled (disable it in production for performance and deployment consistency reasons) [21:09:06] : [Step 4/5] [2021-11-19 21:09:06,387][INFO ][test-runner-#17517%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] 3-rd party licenses can be found at: /opt/buildagent/work/7bc1c54bc719b67c/libs/licenses [21:09:06] : [Step 4/5] [2021-11-19 21:09:06,391][INFO ][test-runner-#17517%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] Configured plugins: [21:09:06] : [Step 4/5] [2021-11-19 21:09:06,391][INFO ][test-runner-#17517%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] ^-- StanByClusterTestProvider 1.0 [21:09:06] : [Step 4/5] [2021-11-19 21:09:06,391][INFO ][test-runner-#17517%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:09:06] : [Step 4/5] [2021-11-19 21:09:06,391][INFO ][test-runner-#17517%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] [21:09:06] : [Step 4/5] [2021-11-19 21:09:06,391][INFO ][test-runner-#17517%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] ^-- PageMemory tracker plugin 1.0 [21:09:06] : [Step 4/5] [2021-11-19 21:09:06,391][INFO ][test-runner-#17517%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:09:06] : [Step 4/5] [2021-11-19 21:09:06,392][INFO ][test-runner-#17517%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] [21:09:06] : [Step 4/5] [2021-11-19 21:09:06,392][INFO ][test-runner-#17517%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] ^-- TestDistibutedConfigurationPlugin 1.0 [21:09:06] : [Step 4/5] [2021-11-19 21:09:06,392][INFO ][test-runner-#17517%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:09:06] : [Step 4/5] [2021-11-19 21:09:06,392][INFO ][test-runner-#17517%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] [21:09:06] : [Step 4/5] [2021-11-19 21:09:06,392][INFO ][test-runner-#17517%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] ^-- NodeValidationPluginProvider 1.0 [21:09:06] : [Step 4/5] [2021-11-19 21:09:06,392][INFO ][test-runner-#17517%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:09:06] : [Step 4/5] [2021-11-19 21:09:06,393][INFO ][test-runner-#17517%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] [21:09:06] : [Step 4/5] [2021-11-19 21:09:06,393][INFO ][test-runner-#17517%encryption.MasterKeyChangeTest%][FailureProcessor] Configured failure handler: [hnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]]] [21:09:06] : [Step 4/5] [2021-11-19 21:09:06,407][INFO ][test-runner-#17517%encryption.MasterKeyChangeTest%][TestRecordingCommunicationSpi] Successfully bound communication NIO server to TCP port [port=47101, locHost=/127.0.0.1, selectorsCnt=12, selectorSpins=0, pairedConn=false] [21:09:06]W: [org.apache.ignite:ignite-core] [2021-11-19 21:09:06,408][WARN ][test-runner-#17517%encryption.MasterKeyChangeTest%][TestRecordingCommunicationSpi] Message queue limit is set to 0 which may lead to potential OOMEs when running cache operations in FULL_ASYNC or PRIMARY_SYNC modes due to message queues growth on sender and receiver sides. [21:09:06] : [Step 4/5] [2021-11-19 21:09:06,414][INFO ][test-runner-#17517%encryption.MasterKeyChangeTest%][GridCollisionManager] Collision resolution is disabled (all jobs will be activated upon arrival). [21:09:06] : [Step 4/5] [2021-11-19 21:09:06,414][INFO ][test-runner-#17517%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] Security status [authentication=off, sandbox=off, tls/ssl=off] [21:09:06] : [Step 4/5] [2021-11-19 21:09:06,469][INFO ][test-runner-#17517%encryption.MasterKeyChangeTest%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:09:06] : [Step 4/5] [2021-11-19 21:09:06,551][INFO ][test-runner-#17517%encryption.MasterKeyChangeTest%][MaintenanceProcessor] Resolved store directory for node persistent data: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1 [21:09:06] : [Step 4/5] [2021-11-19 21:09:06,552][INFO ][test-runner-#17517%encryption.MasterKeyChangeTest%][CacheObjectBinaryProcessorImpl] Resolved directory for serialized binary metadata: /opt/buildagent/work/7bc1c54bc719b67c/work/db/binary_meta/grid_1 [21:09:06] : [Step 4/5] [2021-11-19 21:09:06,555][INFO ][test-runner-#17517%encryption.MasterKeyChangeTest%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1 [21:09:06] : [Step 4/5] [2021-11-19 21:09:06,555][INFO ][test-runner-#17517%encryption.MasterKeyChangeTest%][FileWriteAheadLogManager] Resolved write ahead log work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1 [21:09:06] : [Step 4/5] [2021-11-19 21:09:06,556][INFO ][test-runner-#17517%encryption.MasterKeyChangeTest%][FileWriteAheadLogManager] Resolved write ahead log archive directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1 [21:09:07] : [Step 4/5] [2021-11-19 21:09:07,195][INFO ][test-runner-#17517%encryption.MasterKeyChangeTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000000.wal [21:09:07] : [Step 4/5] [2021-11-19 21:09:07,199][INFO ][test-runner-#17517%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Configured data regions initialized successfully [total=5] [21:09:07] : [Step 4/5] [2021-11-19 21:09:07,203][INFO ][test-runner-#17517%encryption.MasterKeyChangeTest%][IgniteSnapshotManager] Resolved snapshot work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/snapshots [21:09:07] : [Step 4/5] [2021-11-19 21:09:07,203][INFO ][test-runner-#17517%encryption.MasterKeyChangeTest%][IgniteSnapshotManager] Resolved temp directory for snapshot creation: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1/snp [21:09:07] : [Step 4/5] [2021-11-19 21:09:07,206][INFO ][test-runner-#17517%encryption.MasterKeyChangeTest%][ClientListenerProcessor] Client connector processor has started on TCP port 10801 [21:09:07] : [Step 4/5] [2021-11-19 21:09:07,207][INFO ][test-runner-#17517%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] Non-loopback local IPs: 172.17.0.4 [21:09:07] : [Step 4/5] [2021-11-19 21:09:07,208][INFO ][test-runner-#17517%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] Enabled local MACs: 0242AC110004 [21:09:07] : [Step 4/5] [2021-11-19 21:09:07,208][INFO ][test-runner-#17517%encryption.MasterKeyChangeTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:09:07] : [Step 4/5] [2021-11-19 21:09:07,210][INFO ][test-runner-#17517%encryption.MasterKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:09:07] : [Step 4/5] [2021-11-19 21:09:07,210][INFO ][test-runner-#17517%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:09:07] : [Step 4/5] [2021-11-19 21:09:07,212][INFO ][test-runner-#17517%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Applying lost metastore updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:09:07] : [Step 4/5] [2021-11-19 21:09:07,213][INFO ][test-runner-#17517%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=0 ms] [21:09:07] : [Step 4/5] [2021-11-19 21:09:07,213][INFO ][test-runner-#17517%encryption.MasterKeyChangeTest%][GridCacheProcessor] Restoring partition state for local groups. [21:09:07] : [Step 4/5] [2021-11-19 21:09:07,213][INFO ][test-runner-#17517%encryption.MasterKeyChangeTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=0, partitionsProcessed=0, time=0ms] [21:09:07] : [Step 4/5] [2021-11-19 21:09:07,214][INFO ][test-runner-#17517%encryption.MasterKeyChangeTest%][GridEncryptionManager] Encryption keys loaded from metastore. [grps=, masterKeyName=ignite.master.key] [21:09:07] : [Step 4/5] [2021-11-19 21:09:07,215][INFO ][test-runner-#17517%encryption.MasterKeyChangeTest%][ClusterProcessor] Cluster ID and tag has been read from metastorage: null [21:09:07] : [Step 4/5] [2021-11-19 21:09:07,215][INFO ][test-runner-#17517%encryption.MasterKeyChangeTest%][IgniteClusterImpl] Shutdown policy was updated [oldVal=null, newVal=null] [21:09:07] : [Step 4/5] [2021-11-19 21:09:07,215][INFO ][test-runner-#17517%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Checkpoint frequency deviation changed [oldVal=null, newVal=null] [21:09:07] : [Step 4/5] [2021-11-19 21:09:07,225][INFO ][test-runner-#17517%encryption.MasterKeyChangeTest%][FilePageStoreManager] Cleanup cache stores [total=1, left=0, cleanFiles=false] [21:09:07] : [Step 4/5] [2021-11-19 21:09:07,227][INFO ][test-runner-#17517%encryption.MasterKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:09:07] : [Step 4/5] [2021-11-19 21:09:07,228][INFO ][test-runner-#17517%encryption.MasterKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:09:07] : [Step 4/5] [2021-11-19 21:09:07,229][INFO ][test-runner-#17517%encryption.MasterKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:09:07] : [Step 4/5] [2021-11-19 21:09:07,229][INFO ][test-runner-#17517%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Data Regions Started: 5 [21:09:07] : [Step 4/5] [2021-11-19 21:09:07,230][INFO ][test-runner-#17517%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] ^-- sysMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:09:07] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:09:07] : [Step 4/5] ^-- default region [type=default, persistence=true, lazyAlloc=true, [21:09:07] : [Step 4/5] ... initCfg=10MB, maxCfg=10MB, usedRam=0MB, freeRam=100%, allocRam=0MB, allocTotal=0MB] [21:09:07] : [Step 4/5] ^-- metastoreMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:09:07] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:09:07] : [Step 4/5] ^-- TxLog region [type=internal, persistence=true, lazyAlloc=false, [21:09:07] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:09:07] : [Step 4/5] ^-- volatileDsMemPlc region [type=user, persistence=false, lazyAlloc=true, [21:09:07] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB] [21:09:07] : [Step 4/5] ^-- Ignite persistence [used=0MB] [21:09:07] : [Step 4/5] [21:09:07] : [Step 4/5] [2021-11-19 21:09:07,231][INFO ][test-runner-#17517%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Starting binary memory restore for: [-2100569601] [21:09:07] : [Step 4/5] [2021-11-19 21:09:07,237][INFO ][test-runner-#17517%encryption.MasterKeyChangeTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:09:07] : [Step 4/5] [2021-11-19 21:09:07,238][INFO ][test-runner-#17517%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:09:07] : [Step 4/5] [2021-11-19 21:09:07,239][INFO ][test-runner-#17517%encryption.MasterKeyChangeTest%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000000.wal, offset=0, ver=2] [21:09:07] : [Step 4/5] [2021-11-19 21:09:07,243][INFO ][test-runner-#17517%encryption.MasterKeyChangeTest%][GridCacheProcessor] Started cache in recovery mode [name=ignite-sys-cache, id=-2100569601, dataRegionName=sysMemPlc, mode=REPLICATED, atomicity=TRANSACTIONAL, backups=2147483647, mvcc=false] [21:09:07] : [Step 4/5] [2021-11-19 21:09:07,244][INFO ][test-runner-#17517%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Binary recovery performed in 13 ms. [21:09:07] : [Step 4/5] [2021-11-19 21:09:07,244][INFO ][test-runner-#17517%encryption.MasterKeyChangeTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:09:07] : [Step 4/5] [2021-11-19 21:09:07,245][INFO ][test-runner-#17517%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Applying lost cache updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:09:07] : [Step 4/5] [2021-11-19 21:09:07,299][INFO ][test-runner-#17517%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=60 ms] [21:09:07] : [Step 4/5] [2021-11-19 21:09:07,299][INFO ][test-runner-#17517%encryption.MasterKeyChangeTest%][GridCacheProcessor] Restoring partition state for local groups. [21:09:07] : [Step 4/5] [2021-11-19 21:09:07,304][INFO ][test-runner-#17517%encryption.MasterKeyChangeTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=1, partitionsProcessed=100, time=0ms] [21:09:08] : [Step 4/5] [2021-11-19 21:09:08,102][INFO ][test-runner-#17517%encryption.MasterKeyChangeTest%][TestTcpDiscoverySpi] Successfully bound to TCP port [port=47501, localHost=localhost/127.0.0.1, locNodeId=108fb582-8249-4a48-a44f-d700a8989001] [21:09:08] : [Step 4/5] [2021-11-19 21:09:08,105][INFO ][tcp-disco-srvr-[:47500]-#921%grid-0%-#17630%grid-0%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=52675] [21:09:08] : [Step 4/5] [2021-11-19 21:09:08,106][INFO ][tcp-disco-srvr-[:47500]-#921%grid-0%-#17630%grid-0%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=52675] [21:09:08] : [Step 4/5] [2021-11-19 21:09:08,106][INFO ][tcp-disco-sock-reader-[]-#927%grid-0%-#17749%grid-0%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:52675, rmtPort=52675] [21:09:08] : [Step 4/5] [2021-11-19 21:09:08,108][INFO ][tcp-disco-sock-reader-[108fb582 127.0.0.1:52675]-#927%grid-0%-#17749%grid-0%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=108fb582-8249-4a48-a44f-d700a8989001, rmtAddr=/127.0.0.1:52675] [21:09:08] : [Step 4/5] [2021-11-19 21:09:08,114][INFO ][tcp-disco-srvr-[:47501]-#926%grid-1%-#17748%grid-1%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=59443] [21:09:08] : [Step 4/5] [2021-11-19 21:09:08,114][INFO ][tcp-disco-srvr-[:47501]-#926%grid-1%-#17748%grid-1%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=59443] [21:09:08] : [Step 4/5] [2021-11-19 21:09:08,115][INFO ][tcp-disco-sock-reader-[]-#928%grid-1%-#17750%grid-1%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:59443, rmtPort=59443] [21:09:08] : [Step 4/5] [2021-11-19 21:09:08,115][INFO ][tcp-disco-sock-reader-[]-#928%grid-1%-#17750%grid-1%][TestTcpDiscoverySpi] Received ping request from the remote node [rmtNodeId=00de6ea6-ad2d-479a-9898-78eaef017000, rmtAddr=/127.0.0.1:59443, rmtPort=59443] [21:09:08] : [Step 4/5] [2021-11-19 21:09:08,116][INFO ][tcp-disco-sock-reader-[]-#928%grid-1%-#17750%grid-1%][TestTcpDiscoverySpi] Finished writing ping response [rmtNodeId=00de6ea6-ad2d-479a-9898-78eaef017000, rmtAddr=/127.0.0.1:59443, rmtPort=59443] [21:09:08]W: [org.apache.ignite:ignite-core] [2021-11-19 21:09:08,117][WARN ][tcp-disco-sock-reader-[]-#928%grid-1%-#17750%grid-1%][TestTcpDiscoverySpi] Failed to shutdown socket [21:09:08] : [Step 4/5] [2021-11-19 21:09:08,118][INFO ][tcp-disco-sock-reader-[]-#928%grid-1%-#17750%grid-1%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:59443, rmtPort=59443, rmtNodeId=null] [21:09:08]W: [org.apache.ignite:ignite-core] java.net.SocketException: Socket output is already shutdown [21:09:08]W: [org.apache.ignite:ignite-core] at java.net.Socket.shutdownOutput(Socket.java:1572) [21:09:08]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.close(IgniteUtils.java:4247) [21:09:08]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.discovery.tcp.ServerImpl$SocketReader.body(ServerImpl.java:7370) [21:09:08]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.IgniteSpiThread.run(IgniteSpiThread.java:58) [21:09:08] : [Step 4/5] [2021-11-19 21:09:08,117][INFO ][tcp-disco-sock-reader-[108fb582 127.0.0.1:52675]-#927%grid-0%-#17749%grid-0%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:52675, rmtPort=52675, rmtNodeId=108fb582-8249-4a48-a44f-d700a8989001] [21:09:08] : [Step 4/5] [2021-11-19 21:09:08,119][INFO ][tcp-disco-msg-worker-[crd]-#920%grid-0%-#17629%grid-0%][GridEncryptionManager] Joining node doesn't have stored group keys [node=108fb582-8249-4a48-a44f-d700a8989001] [21:09:08] : [Step 4/5] [2021-11-19 21:09:08,126][INFO ][tcp-disco-msg-worker-[crd]-#920%grid-0%-#17629%grid-0%][TestTcpDiscoverySpi] New next node [newNext=TcpDiscoveryNode [id=108fb582-8249-4a48-a44f-d700a8989001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=0, intOrder=2, lastExchangeTime=1637345348106, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false]] [21:09:08] : [Step 4/5] [2021-11-19 21:09:08,127][INFO ][tcp-disco-srvr-[:47501]-#926%grid-1%-#17748%grid-1%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=58077] [21:09:08] : [Step 4/5] [2021-11-19 21:09:08,127][INFO ][tcp-disco-srvr-[:47501]-#926%grid-1%-#17748%grid-1%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=58077] [21:09:08] : [Step 4/5] [2021-11-19 21:09:08,128][INFO ][tcp-disco-sock-reader-[]-#929%grid-1%-#17751%grid-1%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:58077, rmtPort=58077] [21:09:08] : [Step 4/5] [2021-11-19 21:09:08,129][INFO ][tcp-disco-sock-reader-[00de6ea6 127.0.0.1:58077]-#929%grid-1%-#17751%grid-1%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=00de6ea6-ad2d-479a-9898-78eaef017000, rmtAddr=/127.0.0.1:58077] [21:09:08] : [Step 4/5] [2021-11-19 21:09:08,132][INFO ][tcp-disco-msg-worker-[]-#925%grid-1%-#17747%grid-1%][TestTcpDiscoverySpi] New next node [newNext=TcpDiscoveryNode [id=00de6ea6-ad2d-479a-9898-78eaef017000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345348126, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false]] [21:09:08] : [Step 4/5] [2021-11-19 21:09:08,132][INFO ][tcp-disco-srvr-[:47500]-#921%grid-0%-#17630%grid-0%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=47737] [21:09:08] : [Step 4/5] [2021-11-19 21:09:08,133][INFO ][tcp-disco-srvr-[:47500]-#921%grid-0%-#17630%grid-0%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=47737] [21:09:08] : [Step 4/5] [2021-11-19 21:09:08,134][INFO ][tcp-disco-sock-reader-[]-#930%grid-0%-#17752%grid-0%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:47737, rmtPort=47737] [21:09:08] : [Step 4/5] [2021-11-19 21:09:08,134][INFO ][tcp-disco-sock-reader-[108fb582 127.0.0.1:47737]-#930%grid-0%-#17752%grid-0%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=108fb582-8249-4a48-a44f-d700a8989001, rmtAddr=/127.0.0.1:47737] [21:09:08] : [Step 4/5] [2021-11-19 21:09:08,137][INFO ][disco-event-worker-#17632%grid-0%][GridDiscoveryManager] Added new node to topology: TcpDiscoveryNode [id=108fb582-8249-4a48-a44f-d700a8989001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637345348106, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false] [21:09:08] : [Step 4/5] [2021-11-19 21:09:08,138][INFO ][disco-event-worker-#17632%grid-0%][GridDiscoveryManager] Topology snapshot [ver=2, locNode=00de6ea6, servers=2, clients=0, state=INACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=00de6ea6-ad2d-479a-9898-78eaef017000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=108fb582-8249-4a48-a44f-d700a8989001, consistentId=grid-1, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:09:08] : [Step 4/5] [2021-11-19 21:09:08,140][INFO ][tcp-disco-msg-worker-[00de6ea6 127.0.0.1:47500]-#925%grid-1%-#17747%grid-1%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustEnabled' was changed from 'null' to 'false' [21:09:08] : [Step 4/5] [2021-11-19 21:09:08,140][INFO ][tcp-disco-msg-worker-[00de6ea6 127.0.0.1:47500]-#925%grid-1%-#17747%grid-1%][ClusterProcessor] agitated_leakey [21:09:08] : [Step 4/5] [2021-11-19 21:09:08,140][INFO ][tcp-disco-msg-worker-[00de6ea6 127.0.0.1:47500]-#925%grid-1%-#17747%grid-1%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustTimeout' was changed from 'null' to '300000' [21:09:08] : [Step 4/5] [2021-11-19 21:09:08,141][INFO ][tcp-disco-msg-worker-[00de6ea6 127.0.0.1:47500]-#925%grid-1%-#17747%grid-1%][IgniteTxManager] Transactions parameter 'longOperationsDumpTimeout' was changed from 'null' to '60000' [21:09:08] : [Step 4/5] [2021-11-19 21:09:08,141][INFO ][tcp-disco-msg-worker-[00de6ea6 127.0.0.1:47500]-#925%grid-1%-#17747%grid-1%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpThreshold' was changed from 'null' to '0' [21:09:08] : [Step 4/5] [2021-11-19 21:09:08,142][INFO ][tcp-disco-msg-worker-[00de6ea6 127.0.0.1:47500]-#925%grid-1%-#17747%grid-1%][IgniteTxManager] Transactions parameter 'transactionTimeDumpSamplesCoefficient' was changed from 'null' to '0.0' [21:09:08] : [Step 4/5] [2021-11-19 21:09:08,142][INFO ][tcp-disco-msg-worker-[00de6ea6 127.0.0.1:47500]-#925%grid-1%-#17747%grid-1%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpSamplesPerSecondLimit' was changed from 'null' to '5' [21:09:08] : [Step 4/5] [2021-11-19 21:09:08,142][INFO ][tcp-disco-msg-worker-[00de6ea6 127.0.0.1:47500]-#925%grid-1%-#17747%grid-1%][IgniteTxManager] Transactions parameter 'collisionsDumpInterval' was changed from 'null' to '1000' [21:09:08] : [Step 4/5] [2021-11-19 21:09:08,143][INFO ][tcp-disco-msg-worker-[00de6ea6 127.0.0.1:47500]-#925%grid-1%-#17747%grid-1%][IgniteTxManager] Transactions parameter 'txOwnerDumpRequestsAllowed' was changed from 'null' to 'true' [21:09:08] : [Step 4/5] [2021-11-19 21:09:08,143][INFO ][tcp-disco-msg-worker-[00de6ea6 127.0.0.1:47500]-#925%grid-1%-#17747%grid-1%][GridCacheDatabaseSharedManager] Historical rebalance WAL threshold changed [property=historical.rebalance.threshold, oldVal=null, newVal=500] [21:09:08] : [Step 4/5] [2021-11-19 21:09:08,144][INFO ][disco-notifier-worker-#17746%grid-1%][MvccProcessorImpl] Assigned mvcc coordinator [crd=MvccCoordinator [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=0], nodeId=00de6ea6-ad2d-479a-9898-78eaef017000, ver=1637345346339, local=false, initialized=false]] [21:09:08] : [Step 4/5] [2021-11-19 21:09:08,145][INFO ][sys-#17723%grid-1%][ClusterProcessor] Writing cluster ID and tag to metastorage on ready for write ClusterIdAndTag [id=1b106919-9253-4d42-a440-c2fcc6581f51, tag=agitated_leakey] [21:09:08] : [Step 4/5] [2021-11-19 21:09:08,160][INFO ][test-runner-#17517%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] To start Console Management & Monitoring run ignitevisorcmd.{sh|bat} [21:09:08] : [Step 4/5] [2021-11-19 21:09:08,161][INFO ][test-runner-#17517%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] [21:09:08] : [Step 4/5] [21:09:08] : [Step 4/5] >>> +-------------------------------------------+ [21:09:08] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:09:08] : [Step 4/5] >>> +-------------------------------------------+ [21:09:08] : [Step 4/5] >>> OS name: Linux 4.15.0-151-generic amd64 [21:09:08] : [Step 4/5] >>> CPU(s): 24 [21:09:08] : [Step 4/5] >>> Heap: 2.0GB [21:09:08] : [Step 4/5] >>> VM name: 16724@c4dfe9a430b2 [21:09:08] : [Step 4/5] >>> Ignite instance name: grid-1 [21:09:08] : [Step 4/5] >>> Local node [ID=108FB582-8249-4A48-A44F-D700A8989001, order=2, clientMode=false] [21:09:08] : [Step 4/5] >>> Local node addresses: [127.0.0.1] [21:09:08] : [Step 4/5] >>> Local ports: TCP:10801 TCP:47101 TCP:47501 [21:09:08] : [Step 4/5] [21:09:08] : [Step 4/5] [2021-11-19 21:09:08,162][INFO ][test-runner-#17517%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] >>> Ignite cluster is in INACTIVE state (limited functionality available). Use control.(sh|bat) script or IgniteCluster.state(ClusterState.ACTIVE) to change the state. [21:09:08] : [Step 4/5] [2021-11-19 21:09:08,162][INFO ][test-runner-#17517%encryption.MasterKeyChangeTest%][GridDiscoveryManager] Topology snapshot [ver=2, locNode=108fb582, servers=2, clients=0, state=INACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=00de6ea6-ad2d-479a-9898-78eaef017000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=108fb582-8249-4a48-a44f-d700a8989001, consistentId=grid-1, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:09:08] : [Step 4/5] [2021-11-19 21:09:08,163][INFO ][test-runner-#17517%encryption.MasterKeyChangeTest%][G] Node started : [stage="Configure system pool" (0 ms),stage="Start managers" (182 ms),stage="Configure binary metadata" (1 ms),stage="Start processors" (653 ms),stage="Start 'StanByClusterTestProvider' plugin" (0 ms),stage="Start 'PageMemory tracker plugin' plugin" (0 ms),stage="Start 'TestDistibutedConfigurationPlugin' plugin" (0 ms),stage="Start 'NodeValidationPluginProvider' plugin" (0 ms),stage="Init metastore" (18 ms),stage="Init and start regions" (5 ms),stage="Restore binary memory" (13 ms),stage="Restore logical state" (60 ms),stage="Finish recovery" (796 ms),stage="Join topology" (44 ms),stage="Await transition" (2 ms),stage="Await exchange" (15 ms),stage="Total time" (1789 ms)] [21:09:08] : [Step 4/5] [2021-11-19 21:09:08,164][INFO ][test-runner-#17517%encryption.MasterKeyChangeTest%][root] Node started with the following configuration [id=108fb582-8249-4a48-a44f-d700a8989001, marshaller=BinaryMarshaller [], discovery=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=5000, ackTimeout=5000, marsh=JdkMarshaller [clsFilter=org.apache.ignite.marshaller.MarshallerUtils$1@27efd4c8], reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], binaryCfg=null, lateAff=true] [21:09:08] : [Step 4/5] [2021-11-19 21:09:08,165][INFO ][test-runner-#17517%encryption.MasterKeyChangeTest%][GridClusterStateProcessor] Sending activate cluster request with BaselineTopology BaselineTopology [id=0, branchingHash=-2475315501, branchingType='New BaselineTopology', baselineNodes=[grid-1, grid-0]] [21:09:08] : [Step 4/5] [2021-11-19 21:09:08,169][INFO ][disco-notifier-worker-#17628%grid-0%][GridClusterStateProcessor] Received activate cluster request with BaselineTopology[id=0] initiator node ID: 00de6ea6-ad2d-479a-9898-78eaef017000 [21:09:08] : [Step 4/5] [2021-11-19 21:09:08,169][INFO ][disco-notifier-worker-#17628%grid-0%][GridClusterStateProcessor] Started state transition: activate cluster [21:09:08] : [Step 4/5] [2021-11-19 21:09:08,170][INFO ][exchange-worker-#17633%grid-0%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], crd=true, evt=DISCOVERY_CUSTOM_EVT, evtNode=00de6ea6-ad2d-479a-9898-78eaef017000, customEvt=ChangeGlobalStateMessage [id=1e96d593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqId=cdf8c40a-a2df-432a-97f3-b3d160d6c905, initiatingNodeId=00de6ea6-ad2d-479a-9898-78eaef017000, state=ACTIVE, baselineTopology=BaselineTopology [id=0, branchingHash=-2475315501, branchingType='New BaselineTopology', baselineNodes=[grid-1, grid-0]], forceChangeBaselineTopology=false, timestamp=1637345348165, forceDeactivation=true], allowMerge=false, exchangeFreeSwitch=false] [21:09:08] : [Step 4/5] [2021-11-19 21:09:08,170][INFO ][disco-notifier-worker-#17746%grid-1%][GridClusterStateProcessor] Received activate cluster request with BaselineTopology[id=0] initiator node ID: 00de6ea6-ad2d-479a-9898-78eaef017000 [21:09:08] : [Step 4/5] [2021-11-19 21:09:08,171][INFO ][exchange-worker-#17633%grid-0%][GridDhtPartitionsExchangeFuture] Start activation process [nodeId=00de6ea6-ad2d-479a-9898-78eaef017000, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]]. New state: ACTIVE [21:09:08] : [Step 4/5] [2021-11-19 21:09:08,171][INFO ][disco-notifier-worker-#17746%grid-1%][GridClusterStateProcessor] Started state transition: activate cluster [21:09:08] : [Step 4/5] [2021-11-19 21:09:08,171][INFO ][exchange-worker-#17633%grid-0%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0 [21:09:08] : [Step 4/5] [2021-11-19 21:09:08,172][INFO ][exchange-worker-#17755%grid-1%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], crd=false, evt=DISCOVERY_CUSTOM_EVT, evtNode=00de6ea6-ad2d-479a-9898-78eaef017000, customEvt=ChangeGlobalStateMessage [id=1e96d593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqId=cdf8c40a-a2df-432a-97f3-b3d160d6c905, initiatingNodeId=00de6ea6-ad2d-479a-9898-78eaef017000, state=ACTIVE, baselineTopology=BaselineTopology [id=0, branchingHash=-2475315501, branchingType='New BaselineTopology', baselineNodes=[grid-1, grid-0]], forceChangeBaselineTopology=false, timestamp=1637345348165, forceDeactivation=true], allowMerge=false, exchangeFreeSwitch=false] [21:09:08] : [Step 4/5] [2021-11-19 21:09:08,174][INFO ][exchange-worker-#17755%grid-1%][GridDhtPartitionsExchangeFuture] Start activation process [nodeId=108fb582-8249-4a48-a44f-d700a8989001, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]]. New state: ACTIVE [21:09:08] : [Step 4/5] [2021-11-19 21:09:08,174][INFO ][exchange-worker-#17633%grid-0%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000000.wal, offset=8713, ver=2] [21:09:08] : [Step 4/5] [2021-11-19 21:09:08,175][INFO ][exchange-worker-#17755%grid-1%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1 [21:09:08] : [Step 4/5] [2021-11-19 21:09:08,176][INFO ][exchange-worker-#17633%grid-0%][GridClusterStateProcessor] Writing BaselineTopology[id=0] [21:09:08] : [Step 4/5] [2021-11-19 21:09:08,180][INFO ][exchange-worker-#17755%grid-1%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000000.wal, offset=8713, ver=2] [21:09:08] : [Step 4/5] [2021-11-19 21:09:08,182][INFO ][exchange-worker-#17755%grid-1%][GridClusterStateProcessor] Writing BaselineTopology[id=0] [21:09:08] : [Step 4/5] [2021-11-19 21:09:08,182][INFO ][exchange-worker-#17633%grid-0%][GridCacheDatabaseSharedManager] Finish recovery performed in 10 ms. [21:09:08] : [Step 4/5] [2021-11-19 21:09:08,183][INFO ][exchange-worker-#17633%grid-0%][msg] Components activation performed in 12 ms. [21:09:08] : [Step 4/5] [2021-11-19 21:09:08,185][INFO ][exchange-worker-#17633%grid-0%][GridCacheProcessor] Finished recovery for cache [cache=ignite-sys-cache, grp=ignite-sys-cache, startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:09:08] : [Step 4/5] [2021-11-19 21:09:08,186][INFO ][exchange-worker-#17633%grid-0%][GridDhtPartitionsExchangeFuture] Successfully activated caches [nodeId=00de6ea6-ad2d-479a-9898-78eaef017000, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], newState=ACTIVE] [21:09:08] : [Step 4/5] [2021-11-19 21:09:08,187][INFO ][exchange-worker-#17755%grid-1%][GridCacheDatabaseSharedManager] Finish recovery performed in 10 ms. [21:09:08] : [Step 4/5] [2021-11-19 21:09:08,187][INFO ][exchange-worker-#17633%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:09:08] : [Step 4/5] [2021-11-19 21:09:08,188][INFO ][exchange-worker-#17755%grid-1%][msg] Components activation performed in 13 ms. [21:09:08] : [Step 4/5] [2021-11-19 21:09:08,189][INFO ][exchange-worker-#17755%grid-1%][GridCacheProcessor] Finished recovery for cache [cache=ignite-sys-cache, grp=ignite-sys-cache, startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:09:08] : [Step 4/5] [2021-11-19 21:09:08,190][INFO ][exchange-worker-#17755%grid-1%][GridDhtPartitionsExchangeFuture] Successfully activated caches [nodeId=108fb582-8249-4a48-a44f-d700a8989001, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], newState=ACTIVE] [21:09:08] : [Step 4/5] [2021-11-19 21:09:08,190][INFO ][exchange-worker-#17755%grid-1%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:09:08] : [Step 4/5] [2021-11-19 21:09:08,199][INFO ][exchange-worker-#17633%grid-0%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], crd=true] [21:09:08] : [Step 4/5] [2021-11-19 21:09:08,201][INFO ][grid-nio-worker-tcp-comm-0-#17572%TestRecordingCommunicationSpi%][TestRecordingCommunicationSpi] Accepted incoming communication connection [locAddr=/127.0.0.1:47100, rmtAddr=/127.0.0.1:57818] [21:09:08] : [Step 4/5] [2021-11-19 21:09:08,202][INFO ][db-checkpoint-thread-#17764%grid-1%][Checkpointer] Checkpoint started [checkpointId=7d92b009-3cb2-4e7b-baeb-e3fffa16a2b0, startPtr=WALPointer [idx=0, fileOff=79558, len=1963], checkpointBeforeLockTime=2ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=1ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=1ms, writeCheckpointEntryDuration=2ms, splitAndSortCpPagesDuration=0ms, pages=19, reason='node started'] [21:09:08] : [Step 4/5] [2021-11-19 21:09:08,202][INFO ][db-checkpoint-thread-#17765%grid-0%][Checkpointer] Checkpoint started [checkpointId=8e75207f-328c-4ace-8bfc-606cfd3f12b3, startPtr=WALPointer [idx=0, fileOff=79103, len=1963], checkpointBeforeLockTime=2ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=2ms, writeCheckpointEntryDuration=2ms, splitAndSortCpPagesDuration=0ms, pages=18, reason='node started'] [21:09:08] : [Step 4/5] [2021-11-19 21:09:08,207][INFO ][grid-nio-worker-tcp-comm-0-#17690%TestRecordingCommunicationSpi%][TestRecordingCommunicationSpi] Established outgoing communication connection [locAddr=/127.0.0.1:57818, rmtAddr=/127.0.0.1:47100] [21:09:08] : [Step 4/5] [2021-11-19 21:09:08,208][INFO ][exchange-worker-#17755%grid-1%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], crd=false] [21:09:08] : [Step 4/5] [2021-11-19 21:09:08,211][INFO ][sys-#17612%grid-0%][GridDhtPartitionsExchangeFuture] Coordinator received single message [ver=AffinityTopologyVersion [topVer=2, minorTopVer=1], node=108fb582-8249-4a48-a44f-d700a8989001, allReceived=true] [21:09:08] : [Step 4/5] [2021-11-19 21:09:08,211][INFO ][sys-#17612%grid-0%][GridDhtPartitionsExchangeFuture] finishExchangeOnCoordinator [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:09:08] : [Step 4/5] [2021-11-19 21:09:08,218][INFO ][sys-#17612%grid-0%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], err=null, rebalanced=true, wasRebalanced=false] [21:09:08] : [Step 4/5] [2021-11-19 21:09:08,220][INFO ][sys-#17722%grid-1%][GridDhtPartitionsExchangeFuture] Received full message, will finish exchange [node=00de6ea6-ad2d-479a-9898-78eaef017000, resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:09:08] : [Step 4/5] [2021-11-19 21:09:08,218][INFO ][disco-notifier-worker-#17628%grid-0%][GridClusterStateProcessor] Received state change finish message: ACTIVE [21:09:08] : [Step 4/5] [2021-11-19 21:09:08,221][INFO ][disco-notifier-worker-#17746%grid-1%][GridClusterStateProcessor] Received state change finish message: ACTIVE [21:09:08] : [Step 4/5] [2021-11-19 21:09:08,222][INFO ][disco-notifier-worker-#17628%grid-0%][GridClusterStateProcessor] Cluster state was changed from INACTIVE to ACTIVE [21:09:08] : [Step 4/5] [2021-11-19 21:09:08,223][INFO ][disco-notifier-worker-#17746%grid-1%][GridClusterStateProcessor] Cluster state was changed from INACTIVE to ACTIVE [21:09:08] : [Step 4/5] [2021-11-19 21:09:08,222][INFO ][sys-#17612%grid-0%][GridCacheProcessor] Finish proxy initialization, cacheName=ignite-sys-cache, localNodeId=00de6ea6-ad2d-479a-9898-78eaef017000 [21:09:08] : [Step 4/5] [2021-11-19 21:09:08,222][INFO ][sys-#17730%grid-1%][GridCachePartitionExchangeManager] Delay process full message without exchange id (there is exchange in progress) [nodeId=00de6ea6-ad2d-479a-9898-78eaef017000] [21:09:08] : [Step 4/5] [2021-11-19 21:09:08,224][INFO ][exchange-worker-#17633%grid-0%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=2, minorTopVer=1], force=false, evt=DISCOVERY_CUSTOM_EVT, node=00de6ea6-ad2d-479a-9898-78eaef017000] [21:09:08] : [Step 4/5] [2021-11-19 21:09:08,224][INFO ][sys-#17612%grid-0%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=00de6ea6-ad2d-479a-9898-78eaef017000, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=00de6ea6-ad2d-479a-9898-78eaef017000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345348217, loc=true, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:09:08] : [Step 4/5] [2021-11-19 21:09:08,224][INFO ][sys-#17621%grid-0%][DistributedBaselineConfiguration] Baseline auto-adjust is 'disabled' with timeout='300000' ms [21:09:08] : [Step 4/5] [2021-11-19 21:09:08,226][INFO ][sys-#17621%grid-0%][GridClusterStateProcessor] Successfully performed final activation steps [nodeId=00de6ea6-ad2d-479a-9898-78eaef017000, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:09:08] : [Step 4/5] [2021-11-19 21:09:08,223][INFO ][sys-#17722%grid-1%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], err=null, rebalanced=true, wasRebalanced=false] [21:09:08] : [Step 4/5] [2021-11-19 21:09:08,225][INFO ][sys-#17612%grid-0%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (0 ms), stage="Update caches registry" (14 ms), stage="Start caches" (0 ms), stage="Affinity initialization on cache group start" (0 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (1 ms), stage="Restore partition states" (0 ms), stage="After states restored callback" (9 ms), stage="WAL history reservation" (0 ms), stage="Waiting for all single messages" (12 ms), stage="Affinity recalculation (crd)" (0 ms), stage="Collect update counters and create affinity messages" (0 ms), stage="Assign partitions states" (0 ms), stage="Validate partitions states" (0 ms), stage="Ideal affinity diff calculation (enforced)" (0 ms), stage="Apply update counters" (0 ms), stage="Full message preparing" (4 ms), stage="Full message sending" (0 ms), stage="State finish message sending" (0 ms), stage="Detect lost partitions" (3 ms), stage="Exchange done" (3 ms), stage="Total time" (46 ms), Discovery lag=2 ms, Latest started node id=108fb582-8249-4a48-a44f-d700a8989001] [21:09:08] : [Step 4/5] [2021-11-19 21:09:08,229][INFO ][db-checkpoint-thread-#17764%grid-1%][Checkpointer] Checkpoint finished [cpId=7d92b009-3cb2-4e7b-baeb-e3fffa16a2b0, pages=19, markPos=WALPointer [idx=0, fileOff=79558, len=1963], walSegmentsCovered=[], markDuration=5ms, pagesWrite=5ms, fsync=21ms, total=33ms] [21:09:08] : [Step 4/5] [2021-11-19 21:09:08,229][INFO ][sys-#17722%grid-1%][GridCacheProcessor] Finish proxy initialization, cacheName=ignite-sys-cache, localNodeId=108fb582-8249-4a48-a44f-d700a8989001 [21:09:08] : [Step 4/5] [2021-11-19 21:09:08,230][INFO ][sys-#17612%grid-0%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], stage="Affinity initialization on cache group start [grp=ignite-sys-cache]" (0 ms) (parent=Affinity initialization on cache group start), stage="Affinity centralized initialization (crd) [grp=ignite-sys-cache, crd=true]" (0 ms) (parent=Determine exchange type), stage="Restore partition states [grp=ignite-sys-cache]" (0 ms) (parent=Restore partition states), stage="Affinity recalculation (partitions availability) [grp=ignite-sys-cache]" (0 ms) (parent=Ideal affinity diff calculation (enforced))] [21:09:08] : [Step 4/5] [2021-11-19 21:09:08,232][INFO ][exchange-worker-#17755%grid-1%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=2, minorTopVer=1], force=false, evt=DISCOVERY_CUSTOM_EVT, node=00de6ea6-ad2d-479a-9898-78eaef017000] [21:09:08] : [Step 4/5] [2021-11-19 21:09:08,232][INFO ][sys-#17722%grid-1%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=108fb582-8249-4a48-a44f-d700a8989001, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=00de6ea6-ad2d-479a-9898-78eaef017000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345348126, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:09:08] : [Step 4/5] [2021-11-19 21:09:08,235][INFO ][sys-#17722%grid-1%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (2 ms), stage="Update caches registry" (14 ms), stage="Start caches" (0 ms), stage="Affinity initialization on cache group start" (0 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Restore partition states" (0 ms), stage="After states restored callback" (8 ms), stage="WAL history reservation" (0 ms), stage="Waiting for Full message" (20 ms), stage="Affinity recalculation" (1 ms), stage="Full map updating" (1 ms), stage="Detect lost partitions" (5 ms), stage="Exchange done" (6 ms), stage="Total time" (57 ms)] [21:09:08] : [Step 4/5] [2021-11-19 21:09:08,236][INFO ][sys-#17722%grid-1%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], stage="Affinity initialization on cache group start [grp=ignite-sys-cache]" (0 ms) (parent=Affinity initialization on cache group start), stage="Affinity centralized initialization (crd) [grp=ignite-sys-cache, crd=false]" (0 ms) (parent=Determine exchange type), stage="Restore partition states [grp=ignite-sys-cache]" (0 ms) (parent=Restore partition states), stage="Affinity applying from full message [grp=ignite-sys-cache]" (1 ms) (parent=Affinity recalculation)] [21:09:08] : [Step 4/5] [2021-11-19 21:09:08,231][INFO ][sys-#17735%grid-1%][DistributedBaselineConfiguration] Baseline auto-adjust is 'disabled' with timeout='300000' ms [21:09:08] : [Step 4/5] [2021-11-19 21:09:08,237][INFO ][db-checkpoint-thread-#17765%grid-0%][Checkpointer] Checkpoint finished [cpId=8e75207f-328c-4ace-8bfc-606cfd3f12b3, pages=18, markPos=WALPointer [idx=0, fileOff=79103, len=1963], walSegmentsCovered=[], markDuration=10ms, pagesWrite=4ms, fsync=25ms, total=41ms] [21:09:08] : [Step 4/5] [2021-11-19 21:09:08,233][INFO ][test-runner-#17517%encryption.MasterKeyChangeTest%][root] awaitPartitionMapExchange finished [21:09:08] : [Step 4/5] [2021-11-19 21:09:08,237][INFO ][sys-#17735%grid-1%][GridClusterStateProcessor] Successfully performed final activation steps [nodeId=108fb582-8249-4a48-a44f-d700a8989001, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:09:08] : [Step 4/5] [2021-11-19 21:09:08,246][INFO ][exchange-worker-#17633%grid-0%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], crd=true, evt=DISCOVERY_CUSTOM_EVT, evtNode=00de6ea6-ad2d-479a-9898-78eaef017000, customEvt=DynamicCacheChangeBatch [id=50a6d593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqs=ArrayList [DynamicCacheChangeRequest [cacheName=encrypted, hasCfg=true, nodeId=00de6ea6-ad2d-479a-9898-78eaef017000, clientStartOnly=false, stop=false, destroy=false, disabledAfterStart=false]], exchangeActions=ExchangeActions [startCaches=[encrypted], stopCaches=null, startGrps=[encrypted], stopGrps=[], resetParts=null, stateChangeRequest=null], startCaches=false], allowMerge=false, exchangeFreeSwitch=false] [21:09:08] : [Step 4/5] [2021-11-19 21:09:08,246][INFO ][exchange-worker-#17755%grid-1%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], crd=false, evt=DISCOVERY_CUSTOM_EVT, evtNode=00de6ea6-ad2d-479a-9898-78eaef017000, customEvt=DynamicCacheChangeBatch [id=50a6d593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqs=ArrayList [DynamicCacheChangeRequest [cacheName=encrypted, hasCfg=true, nodeId=00de6ea6-ad2d-479a-9898-78eaef017000, clientStartOnly=false, stop=false, destroy=false, disabledAfterStart=false]], exchangeActions=ExchangeActions [startCaches=[encrypted], stopCaches=null, startGrps=[encrypted], stopGrps=[], resetParts=null, stateChangeRequest=null], startCaches=false], allowMerge=false, exchangeFreeSwitch=false] [21:09:08] : [Step 4/5] [2021-11-19 21:09:08,248][INFO ][exchange-worker-#17633%grid-0%][PageMemoryImpl] Started page memory [memoryAllocated=24.0 MiB, pages=5952, tableSize=474.2 KiB, replacementSize=768 B, checkpointBuffer=10.0 MiB] [21:09:08] : [Step 4/5] [2021-11-19 21:09:08,249][INFO ][exchange-worker-#17755%grid-1%][PageMemoryImpl] Started page memory [memoryAllocated=24.0 MiB, pages=5952, tableSize=474.2 KiB, replacementSize=768 B, checkpointBuffer=10.0 MiB] [21:09:08] : [Step 4/5] [2021-11-19 21:09:08,310][INFO ][exchange-worker-#17755%grid-1%][GridCacheProcessor] Started cache [name=encrypted, id=1613773252, dataRegionName=default, mode=PARTITIONED, atomicity=ATOMIC, backups=0, mvcc=false] [21:09:08]W: [org.apache.ignite:ignite-core] [2021-11-19 21:09:08,312][WARN ][exchange-worker-#17755%grid-1%][CacheAffinitySharedManager] Cache group 'encrypted' brings high overhead for its metainformation in data region 'default'. Metainformation required for its partitions (522 partitions, 4096 bytes per partition, 2 MBs total) will consume more than 15% of data region memory (10 MBs). It may lead to critical errors on the node and cluster instability. Please reduce number of partitions, add more memory to the data region or add more server nodes for this cache group. [21:09:08] : [Step 4/5] [2021-11-19 21:09:08,313][INFO ][exchange-worker-#17755%grid-1%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], waitTime=0ms, futInfo=NA, mode=DISTRIBUTED] [21:09:08] : [Step 4/5] [2021-11-19 21:09:08,314][INFO ][exchange-worker-#17633%grid-0%][GridCacheProcessor] Started cache [name=encrypted, id=1613773252, dataRegionName=default, mode=PARTITIONED, atomicity=ATOMIC, backups=0, mvcc=false] [21:09:08]W: [org.apache.ignite:ignite-core] [2021-11-19 21:09:08,315][WARN ][exchange-worker-#17633%grid-0%][CacheAffinitySharedManager] Cache group 'encrypted' brings high overhead for its metainformation in data region 'default'. Metainformation required for its partitions (502 partitions, 4096 bytes per partition, 1 MBs total) will consume more than 15% of data region memory (10 MBs). It may lead to critical errors on the node and cluster instability. Please reduce number of partitions, add more memory to the data region or add more server nodes for this cache group. [21:09:08] : [Step 4/5] [2021-11-19 21:09:08,316][INFO ][exchange-worker-#17633%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], waitTime=0ms, futInfo=NA, mode=DISTRIBUTED] [21:09:08] : [Step 4/5] [2021-11-19 21:09:08,316][INFO ][exchange-worker-#17633%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partitions release latch: ServerLatch [permits=0, pendingAcks=HashSet [], super=CompletableLatch [id=CompletableLatchUid [id=exchange, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2]]]] [21:09:08] : [Step 4/5] [2021-11-19 21:09:08,317][INFO ][exchange-worker-#17755%grid-1%][GridDhtPartitionsExchangeFuture] Finished waiting for partitions release latch: ClientLatch [coordinator=TcpDiscoveryNode [id=00de6ea6-ad2d-479a-9898-78eaef017000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345348126, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], ackSent=true, super=CompletableLatch [id=CompletableLatchUid [id=exchange, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2]]]] [21:09:08] : [Step 4/5] [2021-11-19 21:09:08,318][INFO ][exchange-worker-#17755%grid-1%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:09:08] : [Step 4/5] [2021-11-19 21:09:08,317][INFO ][exchange-worker-#17633%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:09:08] : [Step 4/5] [2021-11-19 21:09:08,352][INFO ][exchange-worker-#17633%grid-0%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], crd=true] [21:09:08] : [Step 4/5] [2021-11-19 21:09:08,353][INFO ][exchange-worker-#17755%grid-1%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], crd=false] [21:09:08] : [Step 4/5] [2021-11-19 21:09:08,353][INFO ][sys-#17604%grid-0%][GridDhtPartitionsExchangeFuture] Coordinator received single message [ver=AffinityTopologyVersion [topVer=2, minorTopVer=2], node=108fb582-8249-4a48-a44f-d700a8989001, allReceived=true] [21:09:08] : [Step 4/5] [2021-11-19 21:09:08,354][INFO ][sys-#17604%grid-0%][GridDhtPartitionsExchangeFuture] finishExchangeOnCoordinator [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2]] [21:09:08] : [Step 4/5] [2021-11-19 21:09:08,358][INFO ][sys-#17604%grid-0%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], err=null, rebalanced=true, wasRebalanced=true] [21:09:08] : [Step 4/5] [2021-11-19 21:09:08,358][INFO ][sys-#17743%grid-1%][GridDhtPartitionsExchangeFuture] Received full message, will finish exchange [node=00de6ea6-ad2d-479a-9898-78eaef017000, resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2]] [21:09:08] : [Step 4/5] [2021-11-19 21:09:08,358][INFO ][sys-#17604%grid-0%][GridCacheProcessor] Finish proxy initialization, cacheName=encrypted, localNodeId=00de6ea6-ad2d-479a-9898-78eaef017000 [21:09:08] : [Step 4/5] [2021-11-19 21:09:08,359][INFO ][sys-#17604%grid-0%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=00de6ea6-ad2d-479a-9898-78eaef017000, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=00de6ea6-ad2d-479a-9898-78eaef017000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345348237, loc=true, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2]] [21:09:08] : [Step 4/5] [2021-11-19 21:09:08,361][INFO ][exchange-worker-#17633%grid-0%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=2, minorTopVer=2], force=false, evt=DISCOVERY_CUSTOM_EVT, node=00de6ea6-ad2d-479a-9898-78eaef017000] [21:09:08] : [Step 4/5] [2021-11-19 21:09:08,361][INFO ][sys-#17743%grid-1%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], err=null, rebalanced=true, wasRebalanced=true] [21:09:08] : [Step 4/5] [2021-11-19 21:09:08,362][INFO ][sys-#17604%grid-0%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (0 ms), stage="Update caches registry" (0 ms), stage="Start caches" (67 ms), stage="Affinity initialization on cache group start" (1 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Wait partitions release latch [latch=exchange]" (0 ms), stage="Wait partitions release [latch=exchange]" (1 ms), stage="Restore partition states" (9 ms), stage="After states restored callback" (23 ms), stage="WAL history reservation" (0 ms), stage="Waiting for all single messages" (2 ms), stage="Affinity recalculation (crd)" (0 ms), stage="Collect update counters and create affinity messages" (0 ms), stage="Assign partitions states" (0 ms), stage="Validate partitions states" (0 ms), stage="Apply update counters" (0 ms), stage="Full message preparing" (1 ms), stage="Full message sending" (0 ms), stage="Exchange done" (4 ms), stage="Total time" (108 ms)] [21:09:08] : [Step 4/5] [2021-11-19 21:09:08,363][INFO ][sys-#17743%grid-1%][GridCacheProcessor] Finish proxy initialization, cacheName=encrypted, localNodeId=108fb582-8249-4a48-a44f-d700a8989001 [21:09:08] : [Step 4/5] [2021-11-19 21:09:08,364][INFO ][sys-#17604%grid-0%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], stage="Affinity initialization on cache group start [grp=encrypted]" (0 ms) (parent=Affinity initialization on cache group start), stage="Restore partition states [grp=encrypted]" (9 ms) (parent=Restore partition states), stage="Restore partition states [grp=ignite-sys-cache]" (0 ms) (parent=Restore partition states)] [21:09:08] : [Step 4/5] [2021-11-19 21:09:08,365][INFO ][exchange-worker-#17755%grid-1%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=2, minorTopVer=2], force=false, evt=DISCOVERY_CUSTOM_EVT, node=00de6ea6-ad2d-479a-9898-78eaef017000] [21:09:08] : [Step 4/5] [2021-11-19 21:09:08,365][INFO ][sys-#17743%grid-1%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=108fb582-8249-4a48-a44f-d700a8989001, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=00de6ea6-ad2d-479a-9898-78eaef017000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345348126, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2]] [21:09:08] : [Step 4/5] [2021-11-19 21:09:08,367][INFO ][sys-#17743%grid-1%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (2 ms), stage="Update caches registry" (0 ms), stage="Start caches" (62 ms), stage="Affinity initialization on cache group start" (2 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Wait partitions release latch [latch=exchange]" (4 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Restore partition states" (9 ms), stage="After states restored callback" (24 ms), stage="WAL history reservation" (0 ms), stage="Waiting for Full message" (6 ms), stage="Affinity recalculation" (0 ms), stage="Full map updating" (1 ms), stage="Exchange done" (6 ms), stage="Total time" (116 ms)] [21:09:08] : [Step 4/5] [2021-11-19 21:09:08,368][INFO ][sys-#17743%grid-1%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], stage="Affinity initialization on cache group start [grp=encrypted]" (0 ms) (parent=Affinity initialization on cache group start), stage="Restore partition states [grp=encrypted]" (9 ms) (parent=Restore partition states), stage="Restore partition states [grp=ignite-sys-cache]" (0 ms) (parent=Restore partition states)] [21:09:10] : [Step 4/5] [2021-11-19 21:09:10,247][INFO ][test-runner-#17517%encryption.MasterKeyChangeTest%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:09:10] : [Step 4/5] [2021-11-19 21:09:10,395][INFO ][disco-notifier-worker-#17628%grid-0%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:09:10] : [Step 4/5] [2021-11-19 21:09:10,400][INFO ][disco-notifier-worker-#17746%grid-1%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:09:10] : [Step 4/5] [2021-11-19 21:09:10,531][INFO ][disco-notifier-worker-#17628%grid-0%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:09:10] : [Step 4/5] [2021-11-19 21:09:10,541][INFO ][disco-notifier-worker-#17746%grid-1%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:09:10] : [Step 4/5] [2021-11-19 21:09:10,622][INFO ][disco-notifier-worker-#17746%grid-1%][IgniteTestResources] Block message [node=00de6ea6-ad2d-479a-9898-78eaef017000, order=1, msg=org.apache.ignite.internal.util.distributed.SingleNodeMessage@1a4c18d3] [21:09:10] : [Step 4/5] [2021-11-19 21:09:10,623][INFO ][async-runnable-runner-1][root] >>> Stopping grid [name=grid-0, id=00de6ea6-ad2d-479a-9898-78eaef017000] [21:09:11] : [Step 4/5] [2021-11-19 21:09:10,999][INFO ][db-checkpoint-thread-#17765%grid-0%][Checkpointer] Checkpoint started [checkpointId=c7bae3b5-a6c2-44d9-8068-743f7b2d3bc8, startPtr=WALPointer [idx=0, fileOff=751606, len=11491], checkpointBeforeLockTime=6ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=1ms, checkpointLockHoldTime=6ms, walCpRecordFsyncDuration=30ms, writeCheckpointEntryDuration=324ms, splitAndSortCpPagesDuration=1ms, pages=573, reason='timeout'] [21:09:11] : [Step 4/5] [2021-11-19 21:09:11,006][INFO ][tcp-disco-sock-reader-[108fb582 127.0.0.1:47737]-#930%grid-0%-#17752%grid-0%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:47737, rmtPort=47737, rmtNodeId=108fb582-8249-4a48-a44f-d700a8989001] [21:09:11] : [Step 4/5] [2021-11-19 21:09:11,007][INFO ][disco-event-worker-#17754%grid-1%][GridDiscoveryManager] Node left topology: TcpDiscoveryNode [id=00de6ea6-ad2d-479a-9898-78eaef017000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345348126, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false] [21:09:11] : [Step 4/5] [2021-11-19 21:09:11,011][INFO ][async-runnable-runner-1][GridCacheProcessor] Stopped cache [cacheName=ignite-sys-cache] [21:09:11] : [Step 4/5] [2021-11-19 21:09:11,012][INFO ][async-runnable-runner-1][GridCacheProcessor] Stopped cache [cacheName=encrypted] [21:09:11] : [Step 4/5] [2021-11-19 21:09:11,012][INFO ][disco-event-worker-#17754%grid-1%][GridDiscoveryManager] Topology snapshot [ver=3, locNode=108fb582, servers=1, clients=0, state=ACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=108fb582-8249-4a48-a44f-d700a8989001, consistentId=grid-1, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:09:11] : [Step 4/5] [2021-11-19 21:09:11,013][INFO ][disco-event-worker-#17754%grid-1%][GridDiscoveryManager] Coordinator changed [prev=TcpDiscoveryNode [id=00de6ea6-ad2d-479a-9898-78eaef017000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345348126, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], cur=TcpDiscoveryNode [id=108fb582-8249-4a48-a44f-d700a8989001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637345351005, loc=true, ver=2.13.0#20211119-sha1:00000000, isClient=false]] [21:09:11] : [Step 4/5] [2021-11-19 21:09:11,015][INFO ][disco-event-worker-#17754%grid-1%][GridDiscoveryManager] ^-- Baseline [id=0, size=2, online=1, offline=1] [21:09:11]W: [org.apache.ignite:ignite-core] [2021-11-19 21:09:11,016][WARN ][grid-nio-worker-tcp-comm-0-#17690%TestRecordingCommunicationSpi%][TestRecordingCommunicationSpi] Failed to shutdown socket [21:09:11]W: [org.apache.ignite:ignite-core] java.nio.channels.ClosedChannelException [21:09:11]W: [org.apache.ignite:ignite-core] at sun.nio.ch.SocketChannelImpl.shutdownOutput(SocketChannelImpl.java:795) [21:09:11]W: [org.apache.ignite:ignite-core] at sun.nio.ch.SocketAdaptor.shutdownOutput(SocketAdaptor.java:407) [21:09:11]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.close(IgniteUtils.java:4247) [21:09:11]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.closeKey(GridNioServer.java:2784) [21:09:11]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.close(GridNioServer.java:2835) [21:09:11]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.close(GridNioServer.java:2794) [21:09:11]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.bodyInternal(GridNioServer.java:2157) [21:09:11]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.body(GridNioServer.java:1910) [21:09:11]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:125) [21:09:11]W: [org.apache.ignite:ignite-core] at java.lang.Thread.run(Thread.java:748) [21:09:11] : [Step 4/5] [2021-11-19 21:09:11,018][INFO ][disco-notifier-worker-#17746%grid-1%][GridEncryptionManager] Start master key change [masterKeyName=ignite.master.key2] [21:09:11] : [Step 4/5] [2021-11-19 21:09:11,017][INFO ][disco-event-worker-#17754%grid-1%][MvccProcessorImpl] Assigned mvcc coordinator [crd=MvccCoordinator [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], nodeId=108fb582-8249-4a48-a44f-d700a8989001, ver=1637345346340, local=true, initialized=false]] [21:09:11] : [Step 4/5] [2021-11-19 21:09:11,021][INFO ][sys-#17732%grid-1%][ExchangeLatchManager] Become new coordinator 108fb582-8249-4a48-a44f-d700a8989001 [21:09:11] : [Step 4/5] [2021-11-19 21:09:11,021][INFO ][exchange-worker-#17755%grid-1%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], crd=true, evt=NODE_LEFT, evtNode=00de6ea6-ad2d-479a-9898-78eaef017000, customEvt=null, allowMerge=false, exchangeFreeSwitch=true] [21:09:11] : [Step 4/5] [2021-11-19 21:09:11,023][INFO ][exchange-worker-#17755%grid-1%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:09:11] : [Step 4/5] [2021-11-19 21:09:11,025][INFO ][exchange-worker-#17755%grid-1%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], err=null, rebalanced=true, wasRebalanced=true] [21:09:11]W: [org.apache.ignite:ignite-core] [2021-11-19 21:09:11,026][WARN ][exchange-worker-#17755%grid-1%][GridDhtPartitionTopologyImpl] Detected lost partitions [grp=encrypted, parts=[1, 3, 5, 8-9, 12-13, 15-16, 18-20, 22-23, 31, 33-36, 38-39, 41-43, 45-46, 53, 55-56, 58, 60-61, 65-66, 69-73, 76-77, 79-80, 82-86, 89-90, 92-96, 98, 100, 103, 108-112, 115, 117, 119, 121, 123, 125-134, 137, 139, 146, 148, 153, 157-158, 161, 165-168, 170-171, 173-174, 178-179, 181-183, 188-189, 192-193, 195, 203, 206-208, 211, 213, 215, 217-218, 225, 227-228, 233-236, 238, 240, 242, 246, 248, 252-254, 256, 258-260, 262-264, 266-268, 270-271, 274-275, 278-280, 283-284, 286, 288, 292, 298, 300, 305, 307, 310, 313-314, 318, 320-321, 323-324, 327, 331-335, 337-338, 340, 342-343, 347-349, 351, 355-356, 362, 364-365, 368-370, 374-375, 381-382, 384, 386, 389, 391, 393-394, 398-399, 401, 403-404, 406-407, 412-415, 417-419, 421, 423, 426-428, 430-432, 434, 439, 442-444, 447-449, 451, 454, 457, 459, 461, 464, 469, 471-473, 476-479, 481-487, 489, 493-494, 496, 498, 513-515, 517-524, 526, 532-534, 536, 539-540, 543-544, 547, 553, 556-557, 559-561, 565-566, 570-571, 573, 575-578, 581, 586, 588-589, 592-593, 595, 597-599, 601, 603, 605-606, 615-616, 621-622, 625-626, 630-631, 634-635, 637, 639, 643-644, 647, 650-656, 663, 666-667, 673-676, 679-681, 685, 687-688, 690-691, 694, 698, 700-705, 708, 711, 715, 718, 722, 729, 733, 736-738, 740-741, 743-745, 747-748, 751, 753, 755, 757-761, 763-767, 771, 776-777, 779, 781-782, 788, 792, 794-795, 797, 802, 804-805, 807-808, 813, 815, 818, 820-821, 826, 830-831, 834-835, 838, 841-845, 847, 852, 855-856, 859, 861-862, 865, 867, 872, 876, 879-883, 885-887, 890-895, 898-899, 901-904, 908-913, 916, 918, 921-922, 926-930, 934-935, 937-939, 941, 943, 946-947, 949, 952-953, 955, 959-961, 963-964, 971, 973-974, 977, 981-982, 984, 986-987, 989, 991-992, 995-996, 999, 1001-1002, 1005-1006, 1008, 1010-1013, 1015, 1017, 1020-1023], topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0]] [21:09:11] : [Step 4/5] [2021-11-19 21:09:11,030][INFO ][exchange-worker-#17755%grid-1%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=108fb582-8249-4a48-a44f-d700a8989001, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], evt=NODE_LEFT, evtNode=TcpDiscoveryNode [id=00de6ea6-ad2d-479a-9898-78eaef017000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345348126, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0]] [21:09:11] : [Step 4/5] [2021-11-19 21:09:11,031][INFO ][exchange-worker-#17755%grid-1%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (0 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="After states restored callback" (0 ms), stage="WAL history reservation" (0 ms), stage="Finalize update counters" (0 ms), stage="Detect lost partitions" (5 ms), stage="Exchange done" (1 ms), stage="Total time" (6 ms)] [21:09:11] : [Step 4/5] [2021-11-19 21:09:11,032][INFO ][exchange-worker-#17755%grid-1%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], stage="Affinity initialization (exchange-free switch on fully-rebalanced topology) [grp=ignite-sys-cache]" (0 ms) (parent=Determine exchange type), stage="Affinity initialization (exchange-free switch on fully-rebalanced topology) [grp=encrypted]" (0 ms) (parent=Determine exchange type)] [21:09:11] : [Step 4/5] [2021-11-19 21:09:11,033][INFO ][exchange-worker-#17755%grid-1%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], crd=true] [21:09:11] : [Step 4/5] [2021-11-19 21:09:11,034][INFO ][exchange-worker-#17755%grid-1%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=3, minorTopVer=0], force=false, evt=NODE_LEFT, node=00de6ea6-ad2d-479a-9898-78eaef017000] [21:09:11] : [Step 4/5] [2021-11-19 21:09:11,079][INFO ][disco-notifier-worker-#17746%grid-1%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:09:11] : [Step 4/5] [2021-11-19 21:09:11,589][INFO ][disco-notifier-worker-#17746%grid-1%][GridEncryptionManager] Master key successfully changed [masterKeyName=ignite.master.key2] [21:09:11] : [Step 4/5] [21:09:11] >>> Stopping test: MasterKeyChangeTest#testNodeFailsDuringRotationCoordinatorPrepare in 6475 ms <<< [21:09:11] : [Step 4/5] [2021-11-19 21:09:11,591][INFO ][main][root] >>> Stopping test: MasterKeyChangeTest#testNodeFailsDuringRotationCoordinatorPrepare in 6475 ms <<< [21:09:11] : [Step 4/5] [21:09:11] >>> Heap: 419 MB used / 1918 MB commited / 1918 MB max <<< [21:09:11] : [Step 4/5] [2021-11-19 21:09:11,591][INFO ][main][root] >>> Heap: 419 MB used / 1918 MB commited / 1918 MB max <<< [21:09:11] : [Step 4/5] [21:09:11] >>> Non-Heap: 149 MB used / 179 MB commited / 0 MB max <<< [21:09:11] : [Step 4/5] [2021-11-19 21:09:11,591][INFO ][main][root] >>> Non-Heap: 149 MB used / 179 MB commited / 0 MB max <<< [21:09:11] : [Step 4/5] [21:09:11] >>> Starting test: MasterKeyChangeTest#testMultiByteMasterKeyNameWalRecovery <<< [21:09:11] : [Step 4/5] [2021-11-19 21:09:11,593][INFO ][main][root] >>> Starting test: MasterKeyChangeTest#testMultiByteMasterKeyNameWalRecovery <<< [21:09:11] : [Step 4/5] [21:09:11] >>> Heap: 419 MB used / 1918 MB commited / 1918 MB max <<< [21:09:11] : [Step 4/5] [2021-11-19 21:09:11,593][INFO ][main][root] >>> Heap: 419 MB used / 1918 MB commited / 1918 MB max <<< [21:09:11] : [Step 4/5] [21:09:11] >>> Non-Heap: 149 MB used / 179 MB commited / 0 MB max <<< [21:09:11] : [Step 4/5] [2021-11-19 21:09:11,593][INFO ][main][root] >>> Non-Heap: 149 MB used / 179 MB commited / 0 MB max <<< [21:09:11] : [Step 4/5] [2021-11-19 21:09:11,593][INFO ][main][root] >>> Stopping grid [name=grid-1, id=108fb582-8249-4a48-a44f-d700a8989001] [21:09:11] : [Step 4/5] [2021-11-19 21:09:11,776][INFO ][db-checkpoint-thread-#17764%grid-1%][Checkpointer] Checkpoint started [checkpointId=d912ef04-407b-4fab-a0eb-6fe2d09b61b9, startPtr=WALPointer [idx=0, fileOff=642784, len=11871], checkpointBeforeLockTime=6ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=1ms, checkpointLockHoldTime=2ms, walCpRecordFsyncDuration=133ms, writeCheckpointEntryDuration=36ms, splitAndSortCpPagesDuration=0ms, pages=455, reason='timeout'] [21:09:11]W: [org.apache.ignite:ignite-core] [2021-11-19 21:09:11,782][WARN ][tcp-disco-sock-reader-[00de6ea6 127.0.0.1:58077]-#929%grid-1%-#17751%grid-1%][TestTcpDiscoverySpi] Failed to shutdown socket [21:09:11]W: [org.apache.ignite:ignite-core] java.net.SocketException: Socket is closed [21:09:11]W: [org.apache.ignite:ignite-core] at java.net.Socket.shutdownOutput(Socket.java:1568) [21:09:11]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.close(IgniteUtils.java:4247) [21:09:11]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.discovery.tcp.ServerImpl$SocketReader.body(ServerImpl.java:7370) [21:09:11]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.IgniteSpiThread.run(IgniteSpiThread.java:58) [21:09:11] : [Step 4/5] [2021-11-19 21:09:11,784][INFO ][tcp-disco-sock-reader-[00de6ea6 127.0.0.1:58077]-#929%grid-1%-#17751%grid-1%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:58077, rmtPort=58077, rmtNodeId=00de6ea6-ad2d-479a-9898-78eaef017000] [21:09:11] : [Step 4/5] [2021-11-19 21:09:11,787][INFO ][main][GridCacheProcessor] Stopped cache [cacheName=ignite-sys-cache] [21:09:11] : [Step 4/5] [2021-11-19 21:09:11,787][INFO ][main][GridCacheProcessor] Stopped cache [cacheName=encrypted] [21:09:12] : [Step 4/5] [2021-11-19 21:09:12,594][INFO ][main][FilePageStoreManager] Cleanup cache stores [total=4, left=0, cleanFiles=false] [21:09:12] : [Step 4/5] [2021-11-19 21:09:12,594][INFO ][async-runnable-runner-1][FilePageStoreManager] Cleanup cache stores [total=4, left=0, cleanFiles=false] [21:09:12] : [Step 4/5] [2021-11-19 21:09:12,599][INFO ][async-runnable-runner-1][GridDeploymentLocalStore] Removed undeployed class: GridDeployment [ts=1637345348207, depMode=SHARED, clsLdr=IsolatedClassLoader{roleName='test'}, clsLdrId=de96d593d71-00de6ea6-ad2d-479a-9898-78eaef017000, userVer=0, loc=true, sampleClsName=org.apache.ignite.internal.processors.cache.distributed.dht.preloader.GridDhtPartitionMap, pendingUndeploy=false, undeployed=true, usage=0] [21:09:12] : [Step 4/5] [2021-11-19 21:09:12,599][INFO ][main][GridDeploymentLocalStore] Removed undeployed class: GridDeployment [ts=1637345348217, depMode=SHARED, clsLdr=IsolatedClassLoader{roleName='test'}, clsLdrId=0f96d593d71-108fb582-8249-4a48-a44f-d700a8989001, userVer=0, loc=true, sampleClsName=org.apache.ignite.internal.processors.cache.distributed.dht.preloader.GridDhtPartitionFullMap, pendingUndeploy=false, undeployed=true, usage=0] [21:09:12] : [Step 4/5] [2021-11-19 21:09:12,615][INFO ][async-runnable-runner-1][IgniteKernal%grid-0] [21:09:12] : [Step 4/5] [21:09:12] : [Step 4/5] >>> +------------------------------------------------------+ [21:09:12] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV stopped OK [21:09:12] : [Step 4/5] >>> +------------------------------------------------------+ [21:09:12] : [Step 4/5] >>> Ignite instance name: grid-0 [21:09:12] : [Step 4/5] >>> Grid uptime: 00:00:06.254 [21:09:12] : [Step 4/5] [21:09:12] : [Step 4/5] [21:09:12] : [Step 4/5] [2021-11-19 21:09:12,618][INFO ][main][IgniteKernal%grid-1] [21:09:12] : [Step 4/5] [21:09:12] : [Step 4/5] >>> +------------------------------------------------------+ [21:09:12] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV stopped OK [21:09:12] : [Step 4/5] >>> +------------------------------------------------------+ [21:09:12] : [Step 4/5] >>> Ignite instance name: grid-1 [21:09:12] : [Step 4/5] >>> Grid uptime: 00:00:04.456 [21:09:12] : [Step 4/5] [21:09:12] : [Step 4/5] [21:09:12]W: [org.apache.ignite:ignite-core] [2021-11-19 21:09:12,806][WARN ][test-runner-#17787%encryption.MasterKeyChangeTest%][G] Ignite work directory is not provided, automatically resolved to: /opt/buildagent/work/7bc1c54bc719b67c/work [21:09:12] : [Step 4/5] [2021-11-19 21:09:12,809][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] [21:09:12] : [Step 4/5] [21:09:12] : [Step 4/5] >>> __________ ________________ [21:09:12] : [Step 4/5] >>> / _/ ___/ |/ / _/_ __/ __/ [21:09:12] : [Step 4/5] >>> _/ // (7 7 // / / / / _/ [21:09:12] : [Step 4/5] >>> /___/\___/_/|_/___/ /_/ /___/ [21:09:12] : [Step 4/5] >>> [21:09:12] : [Step 4/5] >>> ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:09:12] : [Step 4/5] >>> 2021 Copyright(C) Apache Software Foundation [21:09:12] : [Step 4/5] >>> [21:09:12] : [Step 4/5] >>> Ignite documentation: http://ignite.apache.org [21:09:12] : [Step 4/5] [21:09:12] : [Step 4/5] [2021-11-19 21:09:12,809][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] Config URL: n/a [21:09:12] : [Step 4/5] [2021-11-19 21:09:12,810][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] IgniteConfiguration [igniteInstanceName=grid-0, pubPoolSize=24, svcPoolSize=24, callbackPoolSize=24, stripedPoolSize=24, sysPoolSize=24, mgmtPoolSize=4, dataStreamerPoolSize=24, utilityCachePoolSize=24, utilityCacheKeepAliveTime=60000, p2pPoolSize=2, qryPoolSize=24, buildIdxPoolSize=4, igniteHome=/opt/buildagent/work/7bc1c54bc719b67c, igniteWorkDir=/opt/buildagent/work/7bc1c54bc719b67c/work, mbeanSrv=com.sun.jmx.mbeanserver.JmxMBeanServer@6fe85038, nodeId=00b43dc9-2985-4f86-98d3-95505e291000, marsh=BinaryMarshaller [], marshLocJobs=false, daemon=false, p2pEnabled=true, netTimeout=10000, netCompressionLevel=1, sndRetryDelay=1000, sndRetryCnt=3, metricsHistSize=10000, metricsUpdateFreq=1000, metricsExpTime=9223372036854775807, discoSpi=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=0, ackTimeout=0, marsh=null, reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], segPlc=STOP, segResolveAttempts=2, waitForSegOnStart=true, allResolversPassReq=true, segChkFreq=10000, commSpi=TcpCommunicationSpi [connectGate=org.apache.ignite.spi.communication.tcp.internal.ConnectGateway@48f762c6, ctxInitLatch=java.util.concurrent.CountDownLatch@48d52340[Count = 1], stopping=false, clientPool=null, nioSrvWrapper=null, stateProvider=null], evtSpi=MemoryEventStorageSpi [expireAgeMs=9223372036854775807, expireCnt=10000, filter=null], colSpi=NoopCollisionSpi [], deploySpi=LocalDeploymentSpi [], indexingSpi=org.apache.ignite.spi.indexing.noop.NoopIndexingSpi@48d8a216, addrRslvr=null, encryptionSpi=org.apache.ignite.spi.encryption.keystore.KeystoreEncryptionSpi@6a662dc4, tracingSpi=org.apache.ignite.spi.tracing.NoopTracingSpi@1763a370, clientMode=false, rebalanceThreadPoolSize=4, rebalanceTimeout=10000, rebalanceBatchesPrefetchCnt=3, rebalanceThrottle=0, rebalanceBatchSize=524288, txCfg=TransactionConfiguration [txSerEnabled=false, dfltIsolation=REPEATABLE_READ, dfltConcurrency=PESSIMISTIC, dfltTxTimeout=0, txTimeoutOnPartitionMapExchange=0, deadlockTimeout=10000, pessimisticTxLogSize=0, pessimisticTxLogLinger=10000, tmLookupClsName=null, txManagerFactory=null, useJtaSync=false], cacheSanityCheckEnabled=true, discoStartupDelay=60000, deployMode=SHARED, p2pMissedCacheSize=100, locHost=127.0.0.1, timeSrvPortBase=31100, timeSrvPortRange=100, failureDetectionTimeout=10000, sysWorkerBlockedTimeout=null, clientFailureDetectionTimeout=10000, metricsLogFreq=0, connectorCfg=null, odbcCfg=null, warmupClos=null, atomicCfg=AtomicConfiguration [seqReserveSize=1000, cacheMode=PARTITIONED, backups=1, aff=null, grpName=null], classLdr=null, sslCtxFactory=null, platformCfg=null, binaryCfg=null, memCfg=null, pstCfg=null, dsCfg=DataStorageConfiguration [sysRegionInitSize=41943040, sysRegionMaxSize=104857600, pageSize=4096, concLvl=0, dfltDataRegConf=DataRegionConfiguration [name=default, maxSize=10485760, initSize=268435456, swapPath=null, pageEvictionMode=DISABLED, pageReplacementMode=CLOCK, evictionThreshold=0.9, emptyPagesPoolSize=100, metricsEnabled=false, metricsSubIntervalCount=5, metricsRateTimeInterval=60000, persistenceEnabled=true, checkpointPageBufSize=0, lazyMemoryAllocation=true, warmUpCfg=null], dataRegions=null, storagePath=null, checkpointFreq=180000, lockWaitTime=10000, checkpointThreads=4, checkpointWriteOrder=SEQUENTIAL, walHistSize=20, maxWalArchiveSize=1073741824, walSegments=10, walSegmentSize=67108864, walPath=db/wal, walArchivePath=db/wal/archive, cdcWalPath=db/wal/cdc, cdcEnabled=false, metricsEnabled=false, walMode=FSYNC, walTlbSize=131072, walBuffSize=0, walFlushFreq=2000, walFsyncDelay=1000, walRecordIterBuffSize=67108864, alwaysWriteFullPages=false, fileIOFactory=org.apache.ignite.internal.processors.cache.persistence.file.AsyncFileIOFactory@3b052686, metricsSubIntervalCnt=5, metricsRateTimeInterval=60000, walAutoArchiveAfterInactivity=-1, walForceArchiveTimeout=-1, writeThrottlingEnabled=false, walCompactionEnabled=false, walCompactionLevel=1, checkpointReadLockTimeout=null, walPageCompression=DISABLED, walPageCompressionLevel=null, dfltWarmUpCfg=null, encCfg=org.apache.ignite.configuration.EncryptionConfiguration@6be0c49c, defragmentationThreadPoolSize=4, minWalArchiveSize=-1], snapshotPath=snapshots, activeOnStart=true, activeOnStartPropSetFlag=false, autoActivation=true, autoActivationPropSetFlag=false, clusterStateOnStart=null, sqlConnCfg=null, cliConnCfg=ClientConnectorConfiguration [host=null, port=10800, portRange=100, sockSndBufSize=0, sockRcvBufSize=0, tcpNoDelay=true, maxOpenCursorsPerConn=128, threadPoolSize=24, selectorCnt=12, idleTimeout=0, handshakeTimeout=10000, jdbcEnabled=true, odbcEnabled=true, thinCliEnabled=true, sslEnabled=false, useIgniteSslCtxFactory=true, sslClientAuth=false, sslCtxFactory=null, thinCliCfg=ThinClientConfiguration [maxActiveTxPerConn=100, maxActiveComputeTasksPerConn=0]], mvccVacuumThreadCnt=2, mvccVacuumFreq=5000, authEnabled=false, failureHnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]], commFailureRslvr=null, sqlCfg=SqlConfiguration [longQryWarnTimeout=3000, dfltQryTimeout=0, sqlQryHistSize=1000, validationEnabled=false], asyncContinuationExecutor=null] [21:09:12] : [Step 4/5] [2021-11-19 21:09:12,817][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] Daemon mode: off [21:09:12] : [Step 4/5] [2021-11-19 21:09:12,817][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] OS: Linux 4.15.0-151-generic amd64 [21:09:12] : [Step 4/5] [2021-11-19 21:09:12,817][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] OS user: teamcity [21:09:12] : [Step 4/5] [2021-11-19 21:09:12,818][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] PID: 16724 [21:09:12] : [Step 4/5] [2021-11-19 21:09:12,818][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] Language runtime: Java Platform API Specification ver. 1.8 [21:09:12] : [Step 4/5] [2021-11-19 21:09:12,818][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] VM information: Java(TM) SE Runtime Environment 1.8.0_261-b12 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 25.261-b12 [21:09:12] : [Step 4/5] [2021-11-19 21:09:12,819][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] VM total memory: 1.9GB [21:09:12] : [Step 4/5] [2021-11-19 21:09:12,819][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] Remote Management [restart: off, REST: off, JMX (remote: off)] [21:09:12] : [Step 4/5] [2021-11-19 21:09:12,819][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] Logger: GridTestLog4jLogger [quiet=false, config=null] [21:09:12] : [Step 4/5] [2021-11-19 21:09:12,819][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] IGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c [21:09:12] : [Step 4/5] [2021-11-19 21:09:12,819][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] VM arguments: [-DIGNITE_DUMP_THREADS_ON_FAILURE=false, -DMono=/usr/bin/mono-sgen, -DMono4.0_x64=/usr/lib/mono/4.0, -DMono4.5_x64=/usr/lib/mono/4.5, -DMonoVersion=6.12.0.90, -DSKIP_BUILD=false, -Dagent.home.dir=/opt/buildagent, -Dagent.name=aitc-lin02_03, -Dagent.ownPort=9090, -Dagent.work.dir=/opt/buildagent/work, -Dbuild.number=95, -Dbuild.vcs.number=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.1=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.GitHubApacheIgnite=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dclassworlds.conf=/opt/buildagent/temp/buildTmp/teamcity.m2.conf, -Dcom.jetbrains.maven.watcher.report.file=/opt/buildagent/temp/buildTmp/maven-build-info.xml, -Djava.io.tmpdir=/opt/buildagent/temp/buildTmp, -Dmaven.home=/opt/buildagent/tools/maven3_6, -Dmaven.multiModuleProjectDirectory=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.agent.cpuBenchmark=457, -Dteamcity.agent.dotnet.agent_url=http://localhost:9090/RPC2, -Dteamcity.agent.dotnet.build_id=6278078, -Dteamcity.auth.password=*******, -Dteamcity.auth.userId=TeamCityBuildId=6278078, -Dteamcity.build.changedFiles.file=/opt/buildagent/temp/buildTmp/changedFiles6342607772318147725.txt, -Dteamcity.build.checkoutDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.build.id=6278078, -Dteamcity.build.properties.file=/opt/buildagent/temp/buildTmp/teamcity.build5164517880467851002.properties, -Dteamcity.build.tempDir=/opt/buildagent/temp/buildTmp, -Dteamcity.build.workingDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.buildConfName=Basic 3, -Dteamcity.buildType.id=IgniteTests24Java8_Basic3, -Dteamcity.configuration.properties.file=/opt/buildagent/temp/buildTmp/teamcity.config5591980786735343870.properties, -Dteamcity.maven.userSettings.path=/opt/buildagent/temp/buildTmp/maven_settings_585072866407032347.xml, -Dteamcity.maven.watcher.home=/opt/buildagent/plugins/mavenPlugin/maven-watcher-jdk16, -Dteamcity.projectName=Ignite Tests 2.x (JDK 8/11), -Dteamcity.runner.properties.file=/opt/buildagent/temp/buildTmp/teamcity.runner9098465561618137420.properties, -Dteamcity.tests.recentlyFailedTests.file=/opt/buildagent/temp/buildTmp/testsToRunFirst3891775683130404069.txt, -Dteamcity.version=2021.2 (build 99542), -ea, -Xms2g, -Xmx2g, -XX:+HeapDumpOnOutOfMemoryError, -DIGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_TEST_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_UPDATE_NOTIFIER=false, -DIGNITE_NO_DISCO_ORDER=true, -DIGNITE_PERFORMANCE_SUGGESTIONS_DISABLED=true, -Djava.net.preferIPv4Stack=true, -DTEST_SCALE_FACTOR=1.0, -DIGNITE_TEST_PROP_LOG4J_FILE=log4j-tc-test.xml, -DIGNITE_QUIET=false, -DIGNITE_MARSHAL_BUFFERS_RECHECK=1000, -Dmaven.repo.local=/opt/buildagent/.m2/repository] [21:09:12] : [Step 4/5] [2021-11-19 21:09:12,823][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] System cache's DataRegion size is configured to 40 MB. Use DataStorageConfiguration.systemRegionInitialSize property to change the setting. [21:09:12] : [Step 4/5] [2021-11-19 21:09:12,823][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] Configured caches [in 'sysMemPlc' dataRegion: ['ignite-sys-cache']] [21:09:12]W: [org.apache.ignite:ignite-core] [2021-11-19 21:09:12,824][WARN ][test-runner-#17787%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] Peer class loading is enabled (disable it in production for performance and deployment consistency reasons) [21:09:12] : [Step 4/5] [2021-11-19 21:09:12,824][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] 3-rd party licenses can be found at: /opt/buildagent/work/7bc1c54bc719b67c/libs/licenses [21:09:12] : [Step 4/5] [2021-11-19 21:09:12,827][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] Configured plugins: [21:09:12] : [Step 4/5] [2021-11-19 21:09:12,828][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] ^-- StanByClusterTestProvider 1.0 [21:09:12] : [Step 4/5] [2021-11-19 21:09:12,828][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:09:12] : [Step 4/5] [2021-11-19 21:09:12,828][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] [21:09:12] : [Step 4/5] [2021-11-19 21:09:12,828][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] ^-- PageMemory tracker plugin 1.0 [21:09:12] : [Step 4/5] [2021-11-19 21:09:12,828][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:09:12] : [Step 4/5] [2021-11-19 21:09:12,828][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] [21:09:12] : [Step 4/5] [2021-11-19 21:09:12,828][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] ^-- TestDistibutedConfigurationPlugin 1.0 [21:09:12] : [Step 4/5] [2021-11-19 21:09:12,829][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:09:12] : [Step 4/5] [2021-11-19 21:09:12,829][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] [21:09:12] : [Step 4/5] [2021-11-19 21:09:12,829][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] ^-- NodeValidationPluginProvider 1.0 [21:09:12] : [Step 4/5] [2021-11-19 21:09:12,829][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:09:12] : [Step 4/5] [2021-11-19 21:09:12,829][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] [21:09:12] : [Step 4/5] [2021-11-19 21:09:12,829][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][FailureProcessor] Configured failure handler: [hnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]]] [21:09:12] : [Step 4/5] [2021-11-19 21:09:12,848][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][TestRecordingCommunicationSpi] Successfully bound communication NIO server to TCP port [port=47100, locHost=/127.0.0.1, selectorsCnt=12, selectorSpins=0, pairedConn=false] [21:09:12]W: [org.apache.ignite:ignite-core] [2021-11-19 21:09:12,848][WARN ][test-runner-#17787%encryption.MasterKeyChangeTest%][TestRecordingCommunicationSpi] Message queue limit is set to 0 which may lead to potential OOMEs when running cache operations in FULL_ASYNC or PRIMARY_SYNC modes due to message queues growth on sender and receiver sides. [21:09:12] : [Step 4/5] [2021-11-19 21:09:12,861][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][GridCollisionManager] Collision resolution is disabled (all jobs will be activated upon arrival). [21:09:12] : [Step 4/5] [2021-11-19 21:09:12,861][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] Security status [authentication=off, sandbox=off, tls/ssl=off] [21:09:12] : [Step 4/5] [2021-11-19 21:09:12,915][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:09:13] : [Step 4/5] [2021-11-19 21:09:13,000][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][MaintenanceProcessor] Resolved store directory for node persistent data: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0 [21:09:13] : [Step 4/5] [2021-11-19 21:09:13,002][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][CacheObjectBinaryProcessorImpl] Resolved directory for serialized binary metadata: /opt/buildagent/work/7bc1c54bc719b67c/work/db/binary_meta/grid_0 [21:09:13] : [Step 4/5] [2021-11-19 21:09:13,006][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0 [21:09:13] : [Step 4/5] [2021-11-19 21:09:13,006][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][FileWriteAheadLogManager] Resolved write ahead log work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0 [21:09:13] : [Step 4/5] [2021-11-19 21:09:13,007][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][FileWriteAheadLogManager] Resolved write ahead log archive directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0 [21:09:13] : [Step 4/5] [2021-11-19 21:09:13,433][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000000.wal [21:09:13]W: [org.apache.ignite:ignite-core] [2021-11-19 21:09:13,434][WARN ][test-runner-#17787%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] DataRegion maxSize=10.5 MB is smaller than defaultInitialSize=268.4 MB, setting initialSize to 10.5 MB [21:09:13] : [Step 4/5] [2021-11-19 21:09:13,438][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Configured data regions initialized successfully [total=5] [21:09:13] : [Step 4/5] [2021-11-19 21:09:13,441][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][IgniteSnapshotManager] Resolved snapshot work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/snapshots [21:09:13] : [Step 4/5] [2021-11-19 21:09:13,441][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][IgniteSnapshotManager] Resolved temp directory for snapshot creation: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0/snp [21:09:13] : [Step 4/5] [2021-11-19 21:09:13,444][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][ClientListenerProcessor] Client connector processor has started on TCP port 10800 [21:09:13] : [Step 4/5] [2021-11-19 21:09:13,451][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] Non-loopback local IPs: 172.17.0.4 [21:09:13] : [Step 4/5] [2021-11-19 21:09:13,451][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] Enabled local MACs: 0242AC110004 [21:09:13] : [Step 4/5] [2021-11-19 21:09:13,453][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:09:13] : [Step 4/5] [2021-11-19 21:09:13,454][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:09:13] : [Step 4/5] [2021-11-19 21:09:13,455][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:09:13] : [Step 4/5] [2021-11-19 21:09:13,457][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Applying lost metastore updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:09:13] : [Step 4/5] [2021-11-19 21:09:13,458][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=0 ms] [21:09:13] : [Step 4/5] [2021-11-19 21:09:13,458][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][GridCacheProcessor] Restoring partition state for local groups. [21:09:13] : [Step 4/5] [2021-11-19 21:09:13,458][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=0, partitionsProcessed=0, time=0ms] [21:09:13] : [Step 4/5] [2021-11-19 21:09:13,459][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][GridEncryptionManager] Encryption keys loaded from metastore. [grps=, masterKeyName=ignite.master.key] [21:09:13] : [Step 4/5] [2021-11-19 21:09:13,464][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][ClusterProcessor] Cluster ID and tag has been read from metastorage: null [21:09:13] : [Step 4/5] [2021-11-19 21:09:13,464][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][IgniteClusterImpl] Shutdown policy was updated [oldVal=null, newVal=null] [21:09:13] : [Step 4/5] [2021-11-19 21:09:13,464][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Checkpoint frequency deviation changed [oldVal=null, newVal=null] [21:09:13] : [Step 4/5] [2021-11-19 21:09:13,474][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][FilePageStoreManager] Cleanup cache stores [total=1, left=0, cleanFiles=false] [21:09:13] : [Step 4/5] [2021-11-19 21:09:13,477][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:09:13] : [Step 4/5] [2021-11-19 21:09:13,479][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:09:13] : [Step 4/5] [2021-11-19 21:09:13,481][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:09:13] : [Step 4/5] [2021-11-19 21:09:13,481][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Data Regions Started: 5 [21:09:13] : [Step 4/5] [2021-11-19 21:09:13,482][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] ^-- sysMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:09:13] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:09:13] : [Step 4/5] ^-- default region [type=default, persistence=true, lazyAlloc=true, [21:09:13] : [Step 4/5] ... initCfg=10MB, maxCfg=10MB, usedRam=0MB, freeRam=100%, allocRam=0MB, allocTotal=0MB] [21:09:13] : [Step 4/5] ^-- metastoreMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:09:13] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:09:13] : [Step 4/5] ^-- TxLog region [type=internal, persistence=true, lazyAlloc=false, [21:09:13] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:09:13] : [Step 4/5] ^-- volatileDsMemPlc region [type=user, persistence=false, lazyAlloc=true, [21:09:13] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB] [21:09:13] : [Step 4/5] ^-- Ignite persistence [used=0MB] [21:09:13] : [Step 4/5] [21:09:13] : [Step 4/5] [2021-11-19 21:09:13,484][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Starting binary memory restore for: [-2100569601] [21:09:13] : [Step 4/5] [2021-11-19 21:09:13,497][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:09:13] : [Step 4/5] [2021-11-19 21:09:13,497][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:09:13] : [Step 4/5] [2021-11-19 21:09:13,505][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000000.wal, offset=0, ver=2] [21:09:13] : [Step 4/5] [2021-11-19 21:09:13,511][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][GridCacheProcessor] Started cache in recovery mode [name=ignite-sys-cache, id=-2100569601, dataRegionName=sysMemPlc, mode=REPLICATED, atomicity=TRANSACTIONAL, backups=2147483647, mvcc=false] [21:09:13] : [Step 4/5] [2021-11-19 21:09:13,512][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Binary recovery performed in 28 ms. [21:09:13] : [Step 4/5] [2021-11-19 21:09:13,512][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:09:13] : [Step 4/5] [2021-11-19 21:09:13,512][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Applying lost cache updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:09:13] : [Step 4/5] [2021-11-19 21:09:13,574][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=61 ms] [21:09:13] : [Step 4/5] [2021-11-19 21:09:13,574][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][GridCacheProcessor] Restoring partition state for local groups. [21:09:13] : [Step 4/5] [2021-11-19 21:09:13,581][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=1, partitionsProcessed=100, time=0ms] [21:09:13] : [Step 4/5] [2021-11-19 21:09:13,968][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][TestTcpDiscoverySpi] Successfully bound to TCP port [port=47500, localHost=localhost/127.0.0.1, locNodeId=00b43dc9-2985-4f86-98d3-95505e291000] [21:09:13] : [Step 4/5] [2021-11-19 21:09:13,978][INFO ][disco-notifier-worker-#17898%grid-0%][MvccProcessorImpl] Assigned mvcc coordinator [crd=MvccCoordinator [topVer=AffinityTopologyVersion [topVer=1, minorTopVer=0], nodeId=00b43dc9-2985-4f86-98d3-95505e291000, ver=1637345353977, local=true, initialized=false]] [21:09:13] : [Step 4/5] [2021-11-19 21:09:13,979][INFO ][sys-#17874%grid-0%][ClusterProcessor] Writing cluster ID and tag to metastorage on ready for write ClusterIdAndTag [id=f85aeea1-b103-4552-bef2-3156987284dd, tag=competent_herschel] [21:09:13] : [Step 4/5] [2021-11-19 21:09:13,983][INFO ][disco-notifier-worker-#17898%grid-0%][ClusterProcessor] competent_herschel [21:09:13] : [Step 4/5] [2021-11-19 21:09:13,984][INFO ][disco-notifier-worker-#17898%grid-0%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustEnabled' was changed from 'null' to 'false' [21:09:13] : [Step 4/5] [2021-11-19 21:09:13,985][INFO ][disco-notifier-worker-#17898%grid-0%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustTimeout' was changed from 'null' to '300000' [21:09:13] : [Step 4/5] [2021-11-19 21:09:13,985][INFO ][disco-notifier-worker-#17898%grid-0%][IgniteTxManager] Transactions parameter 'longOperationsDumpTimeout' was changed from 'null' to '60000' [21:09:13] : [Step 4/5] [2021-11-19 21:09:13,986][INFO ][disco-notifier-worker-#17898%grid-0%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpThreshold' was changed from 'null' to '0' [21:09:13] : [Step 4/5] [2021-11-19 21:09:13,987][INFO ][disco-notifier-worker-#17898%grid-0%][IgniteTxManager] Transactions parameter 'transactionTimeDumpSamplesCoefficient' was changed from 'null' to '0.0' [21:09:13] : [Step 4/5] [2021-11-19 21:09:13,987][INFO ][disco-notifier-worker-#17898%grid-0%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpSamplesPerSecondLimit' was changed from 'null' to '5' [21:09:13] : [Step 4/5] [2021-11-19 21:09:13,987][INFO ][disco-notifier-worker-#17898%grid-0%][IgniteTxManager] Transactions parameter 'collisionsDumpInterval' was changed from 'null' to '1000' [21:09:13] : [Step 4/5] [2021-11-19 21:09:13,988][INFO ][disco-notifier-worker-#17898%grid-0%][IgniteTxManager] Transactions parameter 'txOwnerDumpRequestsAllowed' was changed from 'null' to 'true' [21:09:13] : [Step 4/5] [2021-11-19 21:09:13,990][INFO ][disco-notifier-worker-#17898%grid-0%][GridCacheDatabaseSharedManager] Historical rebalance WAL threshold changed [property=historical.rebalance.threshold, oldVal=null, newVal=500] [21:09:13] : [Step 4/5] [2021-11-19 21:09:13,997][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] To start Console Management & Monitoring run ignitevisorcmd.{sh|bat} [21:09:13] : [Step 4/5] [2021-11-19 21:09:13,997][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] [21:09:13] : [Step 4/5] [21:09:13] : [Step 4/5] >>> +-------------------------------------------+ [21:09:13] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:09:13] : [Step 4/5] >>> +-------------------------------------------+ [21:09:13] : [Step 4/5] >>> OS name: Linux 4.15.0-151-generic amd64 [21:09:13] : [Step 4/5] >>> CPU(s): 24 [21:09:13] : [Step 4/5] >>> Heap: 2.0GB [21:09:13] : [Step 4/5] >>> VM name: 16724@c4dfe9a430b2 [21:09:13] : [Step 4/5] >>> Ignite instance name: grid-0 [21:09:13] : [Step 4/5] >>> Local node [ID=00B43DC9-2985-4F86-98D3-95505E291000, order=1, clientMode=false] [21:09:13] : [Step 4/5] >>> Local node addresses: [127.0.0.1] [21:09:13] : [Step 4/5] >>> Local ports: TCP:10800 TCP:47100 TCP:47500 [21:09:13] : [Step 4/5] [21:09:13] : [Step 4/5] [2021-11-19 21:09:13,998][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] >>> Ignite cluster is in INACTIVE state (limited functionality available). Use control.(sh|bat) script or IgniteCluster.state(ClusterState.ACTIVE) to change the state. [21:09:13] : [Step 4/5] [2021-11-19 21:09:13,999][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][GridDiscoveryManager] Topology snapshot [ver=1, locNode=00b43dc9, servers=1, clients=0, state=INACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=00b43dc9-2985-4f86-98d3-95505e291000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:09:14] : [Step 4/5] [2021-11-19 21:09:13,999][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][G] Node started : [stage="Configure system pool" (0 ms),stage="Start managers" (193 ms),stage="Configure binary metadata" (2 ms),stage="Start processors" (446 ms),stage="Start 'StanByClusterTestProvider' plugin" (0 ms),stage="Start 'PageMemory tracker plugin' plugin" (0 ms),stage="Start 'TestDistibutedConfigurationPlugin' plugin" (0 ms),stage="Start 'NodeValidationPluginProvider' plugin" (0 ms),stage="Init metastore" (24 ms),stage="Init and start regions" (9 ms),stage="Restore binary memory" (28 ms),stage="Restore logical state" (68 ms),stage="Finish recovery" (385 ms),stage="Join topology" (11 ms),stage="Await transition" (1 ms),stage="Await exchange" (18 ms),stage="Total time" (1185 ms)] [21:09:14] : [Step 4/5] [2021-11-19 21:09:14,000][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][root] Node started with the following configuration [id=00b43dc9-2985-4f86-98d3-95505e291000, marshaller=BinaryMarshaller [], discovery=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=5000, ackTimeout=5000, marsh=JdkMarshaller [clsFilter=org.apache.ignite.marshaller.MarshallerUtils$1@2bdb2899], reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], binaryCfg=null, lateAff=true] [21:09:14]W: [org.apache.ignite:ignite-core] [2021-11-19 21:09:14,006][WARN ][test-runner-#17787%encryption.MasterKeyChangeTest%][G] Ignite work directory is not provided, automatically resolved to: /opt/buildagent/work/7bc1c54bc719b67c/work [21:09:14] : [Step 4/5] [2021-11-19 21:09:14,006][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] [21:09:14] : [Step 4/5] [21:09:14] : [Step 4/5] >>> __________ ________________ [21:09:14] : [Step 4/5] >>> / _/ ___/ |/ / _/_ __/ __/ [21:09:14] : [Step 4/5] >>> _/ // (7 7 // / / / / _/ [21:09:14] : [Step 4/5] >>> /___/\___/_/|_/___/ /_/ /___/ [21:09:14] : [Step 4/5] >>> [21:09:14] : [Step 4/5] >>> ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:09:14] : [Step 4/5] >>> 2021 Copyright(C) Apache Software Foundation [21:09:14] : [Step 4/5] >>> [21:09:14] : [Step 4/5] >>> Ignite documentation: http://ignite.apache.org [21:09:14] : [Step 4/5] [21:09:14] : [Step 4/5] [2021-11-19 21:09:14,007][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] Config URL: n/a [21:09:14] : [Step 4/5] [2021-11-19 21:09:14,008][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] IgniteConfiguration [igniteInstanceName=grid-1, pubPoolSize=24, svcPoolSize=24, callbackPoolSize=24, stripedPoolSize=24, sysPoolSize=24, mgmtPoolSize=4, dataStreamerPoolSize=24, utilityCachePoolSize=24, utilityCacheKeepAliveTime=60000, p2pPoolSize=2, qryPoolSize=24, buildIdxPoolSize=4, igniteHome=/opt/buildagent/work/7bc1c54bc719b67c, igniteWorkDir=/opt/buildagent/work/7bc1c54bc719b67c/work, mbeanSrv=com.sun.jmx.mbeanserver.JmxMBeanServer@6fe85038, nodeId=10cd437a-3510-4fa8-a8db-3d5c653f7001, marsh=BinaryMarshaller [], marshLocJobs=false, daemon=false, p2pEnabled=true, netTimeout=10000, netCompressionLevel=1, sndRetryDelay=1000, sndRetryCnt=3, metricsHistSize=10000, metricsUpdateFreq=1000, metricsExpTime=9223372036854775807, discoSpi=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=0, ackTimeout=0, marsh=null, reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], segPlc=STOP, segResolveAttempts=2, waitForSegOnStart=true, allResolversPassReq=true, segChkFreq=10000, commSpi=TcpCommunicationSpi [connectGate=org.apache.ignite.spi.communication.tcp.internal.ConnectGateway@45767b36, ctxInitLatch=java.util.concurrent.CountDownLatch@130b27a4[Count = 1], stopping=false, clientPool=null, nioSrvWrapper=null, stateProvider=null], evtSpi=MemoryEventStorageSpi [expireAgeMs=9223372036854775807, expireCnt=10000, filter=null], colSpi=NoopCollisionSpi [], deploySpi=LocalDeploymentSpi [], indexingSpi=org.apache.ignite.spi.indexing.noop.NoopIndexingSpi@40409b1b, addrRslvr=null, encryptionSpi=org.apache.ignite.spi.encryption.keystore.KeystoreEncryptionSpi@73e0998d, tracingSpi=org.apache.ignite.spi.tracing.NoopTracingSpi@2153c65f, clientMode=false, rebalanceThreadPoolSize=4, rebalanceTimeout=10000, rebalanceBatchesPrefetchCnt=3, rebalanceThrottle=0, rebalanceBatchSize=524288, txCfg=TransactionConfiguration [txSerEnabled=false, dfltIsolation=REPEATABLE_READ, dfltConcurrency=PESSIMISTIC, dfltTxTimeout=0, txTimeoutOnPartitionMapExchange=0, deadlockTimeout=10000, pessimisticTxLogSize=0, pessimisticTxLogLinger=10000, tmLookupClsName=null, txManagerFactory=null, useJtaSync=false], cacheSanityCheckEnabled=true, discoStartupDelay=60000, deployMode=SHARED, p2pMissedCacheSize=100, locHost=127.0.0.1, timeSrvPortBase=31100, timeSrvPortRange=100, failureDetectionTimeout=10000, sysWorkerBlockedTimeout=null, clientFailureDetectionTimeout=10000, metricsLogFreq=0, connectorCfg=null, odbcCfg=null, warmupClos=null, atomicCfg=AtomicConfiguration [seqReserveSize=1000, cacheMode=PARTITIONED, backups=1, aff=null, grpName=null], classLdr=null, sslCtxFactory=null, platformCfg=null, binaryCfg=null, memCfg=null, pstCfg=null, dsCfg=DataStorageConfiguration [sysRegionInitSize=41943040, sysRegionMaxSize=104857600, pageSize=4096, concLvl=0, dfltDataRegConf=DataRegionConfiguration [name=default, maxSize=10485760, initSize=268435456, swapPath=null, pageEvictionMode=DISABLED, pageReplacementMode=CLOCK, evictionThreshold=0.9, emptyPagesPoolSize=100, metricsEnabled=false, metricsSubIntervalCount=5, metricsRateTimeInterval=60000, persistenceEnabled=true, checkpointPageBufSize=0, lazyMemoryAllocation=true, warmUpCfg=null], dataRegions=null, storagePath=null, checkpointFreq=180000, lockWaitTime=10000, checkpointThreads=4, checkpointWriteOrder=SEQUENTIAL, walHistSize=20, maxWalArchiveSize=1073741824, walSegments=10, walSegmentSize=67108864, walPath=db/wal, walArchivePath=db/wal/archive, cdcWalPath=db/wal/cdc, cdcEnabled=false, metricsEnabled=false, walMode=FSYNC, walTlbSize=131072, walBuffSize=0, walFlushFreq=2000, walFsyncDelay=1000, walRecordIterBuffSize=67108864, alwaysWriteFullPages=false, fileIOFactory=org.apache.ignite.internal.processors.cache.persistence.file.AsyncFileIOFactory@5eedd7fd, metricsSubIntervalCnt=5, metricsRateTimeInterval=60000, walAutoArchiveAfterInactivity=-1, walForceArchiveTimeout=-1, writeThrottlingEnabled=false, walCompactionEnabled=false, walCompactionLevel=1, checkpointReadLockTimeout=null, walPageCompression=DISABLED, walPageCompressionLevel=null, dfltWarmUpCfg=null, encCfg=org.apache.ignite.configuration.EncryptionConfiguration@2d7967c0, defragmentationThreadPoolSize=4, minWalArchiveSize=-1], snapshotPath=snapshots, activeOnStart=true, activeOnStartPropSetFlag=false, autoActivation=true, autoActivationPropSetFlag=false, clusterStateOnStart=null, sqlConnCfg=null, cliConnCfg=ClientConnectorConfiguration [host=null, port=10800, portRange=100, sockSndBufSize=0, sockRcvBufSize=0, tcpNoDelay=true, maxOpenCursorsPerConn=128, threadPoolSize=24, selectorCnt=12, idleTimeout=0, handshakeTimeout=10000, jdbcEnabled=true, odbcEnabled=true, thinCliEnabled=true, sslEnabled=false, useIgniteSslCtxFactory=true, sslClientAuth=false, sslCtxFactory=null, thinCliCfg=ThinClientConfiguration [maxActiveTxPerConn=100, maxActiveComputeTasksPerConn=0]], mvccVacuumThreadCnt=2, mvccVacuumFreq=5000, authEnabled=false, failureHnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]], commFailureRslvr=null, sqlCfg=SqlConfiguration [longQryWarnTimeout=3000, dfltQryTimeout=0, sqlQryHistSize=1000, validationEnabled=false], asyncContinuationExecutor=null] [21:09:14] : [Step 4/5] [2021-11-19 21:09:14,016][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] Daemon mode: off [21:09:14] : [Step 4/5] [2021-11-19 21:09:14,016][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] OS: Linux 4.15.0-151-generic amd64 [21:09:14] : [Step 4/5] [2021-11-19 21:09:14,016][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] OS user: teamcity [21:09:14] : [Step 4/5] [2021-11-19 21:09:14,017][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] PID: 16724 [21:09:14] : [Step 4/5] [2021-11-19 21:09:14,017][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] Language runtime: Java Platform API Specification ver. 1.8 [21:09:14] : [Step 4/5] [2021-11-19 21:09:14,017][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] VM information: Java(TM) SE Runtime Environment 1.8.0_261-b12 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 25.261-b12 [21:09:14] : [Step 4/5] [2021-11-19 21:09:14,018][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] VM total memory: 1.9GB [21:09:14] : [Step 4/5] [2021-11-19 21:09:14,018][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] Remote Management [restart: off, REST: off, JMX (remote: off)] [21:09:14] : [Step 4/5] [2021-11-19 21:09:14,018][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] Logger: GridTestLog4jLogger [quiet=false, config=null] [21:09:14] : [Step 4/5] [2021-11-19 21:09:14,018][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] IGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c [21:09:14] : [Step 4/5] [2021-11-19 21:09:14,018][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] VM arguments: [-DIGNITE_DUMP_THREADS_ON_FAILURE=false, -DMono=/usr/bin/mono-sgen, -DMono4.0_x64=/usr/lib/mono/4.0, -DMono4.5_x64=/usr/lib/mono/4.5, -DMonoVersion=6.12.0.90, -DSKIP_BUILD=false, -Dagent.home.dir=/opt/buildagent, -Dagent.name=aitc-lin02_03, -Dagent.ownPort=9090, -Dagent.work.dir=/opt/buildagent/work, -Dbuild.number=95, -Dbuild.vcs.number=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.1=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.GitHubApacheIgnite=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dclassworlds.conf=/opt/buildagent/temp/buildTmp/teamcity.m2.conf, -Dcom.jetbrains.maven.watcher.report.file=/opt/buildagent/temp/buildTmp/maven-build-info.xml, -Djava.io.tmpdir=/opt/buildagent/temp/buildTmp, -Dmaven.home=/opt/buildagent/tools/maven3_6, -Dmaven.multiModuleProjectDirectory=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.agent.cpuBenchmark=457, -Dteamcity.agent.dotnet.agent_url=http://localhost:9090/RPC2, -Dteamcity.agent.dotnet.build_id=6278078, -Dteamcity.auth.password=*******, -Dteamcity.auth.userId=TeamCityBuildId=6278078, -Dteamcity.build.changedFiles.file=/opt/buildagent/temp/buildTmp/changedFiles6342607772318147725.txt, -Dteamcity.build.checkoutDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.build.id=6278078, -Dteamcity.build.properties.file=/opt/buildagent/temp/buildTmp/teamcity.build5164517880467851002.properties, -Dteamcity.build.tempDir=/opt/buildagent/temp/buildTmp, -Dteamcity.build.workingDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.buildConfName=Basic 3, -Dteamcity.buildType.id=IgniteTests24Java8_Basic3, -Dteamcity.configuration.properties.file=/opt/buildagent/temp/buildTmp/teamcity.config5591980786735343870.properties, -Dteamcity.maven.userSettings.path=/opt/buildagent/temp/buildTmp/maven_settings_585072866407032347.xml, -Dteamcity.maven.watcher.home=/opt/buildagent/plugins/mavenPlugin/maven-watcher-jdk16, -Dteamcity.projectName=Ignite Tests 2.x (JDK 8/11), -Dteamcity.runner.properties.file=/opt/buildagent/temp/buildTmp/teamcity.runner9098465561618137420.properties, -Dteamcity.tests.recentlyFailedTests.file=/opt/buildagent/temp/buildTmp/testsToRunFirst3891775683130404069.txt, -Dteamcity.version=2021.2 (build 99542), -ea, -Xms2g, -Xmx2g, -XX:+HeapDumpOnOutOfMemoryError, -DIGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_TEST_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_UPDATE_NOTIFIER=false, -DIGNITE_NO_DISCO_ORDER=true, -DIGNITE_PERFORMANCE_SUGGESTIONS_DISABLED=true, -Djava.net.preferIPv4Stack=true, -DTEST_SCALE_FACTOR=1.0, -DIGNITE_TEST_PROP_LOG4J_FILE=log4j-tc-test.xml, -DIGNITE_QUIET=false, -DIGNITE_MARSHAL_BUFFERS_RECHECK=1000, -Dmaven.repo.local=/opt/buildagent/.m2/repository] [21:09:14] : [Step 4/5] [2021-11-19 21:09:14,022][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] System cache's DataRegion size is configured to 40 MB. Use DataStorageConfiguration.systemRegionInitialSize property to change the setting. [21:09:14] : [Step 4/5] [2021-11-19 21:09:14,022][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] Configured caches [in 'sysMemPlc' dataRegion: ['ignite-sys-cache']] [21:09:14]W: [org.apache.ignite:ignite-core] [2021-11-19 21:09:14,022][WARN ][test-runner-#17787%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] Peer class loading is enabled (disable it in production for performance and deployment consistency reasons) [21:09:14] : [Step 4/5] [2021-11-19 21:09:14,023][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] 3-rd party licenses can be found at: /opt/buildagent/work/7bc1c54bc719b67c/libs/licenses [21:09:14] : [Step 4/5] [2021-11-19 21:09:14,026][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] Configured plugins: [21:09:14] : [Step 4/5] [2021-11-19 21:09:14,026][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] ^-- StanByClusterTestProvider 1.0 [21:09:14] : [Step 4/5] [2021-11-19 21:09:14,026][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:09:14] : [Step 4/5] [2021-11-19 21:09:14,027][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] [21:09:14] : [Step 4/5] [2021-11-19 21:09:14,027][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] ^-- PageMemory tracker plugin 1.0 [21:09:14] : [Step 4/5] [2021-11-19 21:09:14,027][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:09:14] : [Step 4/5] [2021-11-19 21:09:14,027][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] [21:09:14] : [Step 4/5] [2021-11-19 21:09:14,027][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] ^-- TestDistibutedConfigurationPlugin 1.0 [21:09:14] : [Step 4/5] [2021-11-19 21:09:14,027][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:09:14] : [Step 4/5] [2021-11-19 21:09:14,027][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] [21:09:14] : [Step 4/5] [2021-11-19 21:09:14,028][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] ^-- NodeValidationPluginProvider 1.0 [21:09:14] : [Step 4/5] [2021-11-19 21:09:14,028][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:09:14] : [Step 4/5] [2021-11-19 21:09:14,028][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] [21:09:14] : [Step 4/5] [2021-11-19 21:09:14,028][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][FailureProcessor] Configured failure handler: [hnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]]] [21:09:14] : [Step 4/5] [2021-11-19 21:09:14,051][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][TestRecordingCommunicationSpi] Successfully bound communication NIO server to TCP port [port=47101, locHost=/127.0.0.1, selectorsCnt=12, selectorSpins=0, pairedConn=false] [21:09:14]W: [org.apache.ignite:ignite-core] [2021-11-19 21:09:14,051][WARN ][test-runner-#17787%encryption.MasterKeyChangeTest%][TestRecordingCommunicationSpi] Message queue limit is set to 0 which may lead to potential OOMEs when running cache operations in FULL_ASYNC or PRIMARY_SYNC modes due to message queues growth on sender and receiver sides. [21:09:14] : [Step 4/5] [2021-11-19 21:09:14,056][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][GridCollisionManager] Collision resolution is disabled (all jobs will be activated upon arrival). [21:09:14] : [Step 4/5] [2021-11-19 21:09:14,056][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] Security status [authentication=off, sandbox=off, tls/ssl=off] [21:09:14] : [Step 4/5] [2021-11-19 21:09:14,112][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:09:14] : [Step 4/5] [2021-11-19 21:09:14,201][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][MaintenanceProcessor] Resolved store directory for node persistent data: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1 [21:09:14] : [Step 4/5] [2021-11-19 21:09:14,202][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][CacheObjectBinaryProcessorImpl] Resolved directory for serialized binary metadata: /opt/buildagent/work/7bc1c54bc719b67c/work/db/binary_meta/grid_1 [21:09:14] : [Step 4/5] [2021-11-19 21:09:14,206][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1 [21:09:14] : [Step 4/5] [2021-11-19 21:09:14,207][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][FileWriteAheadLogManager] Resolved write ahead log work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1 [21:09:14] : [Step 4/5] [2021-11-19 21:09:14,207][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][FileWriteAheadLogManager] Resolved write ahead log archive directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1 [21:09:14] : [Step 4/5] [2021-11-19 21:09:14,657][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000000.wal [21:09:14] : [Step 4/5] [2021-11-19 21:09:14,664][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Configured data regions initialized successfully [total=5] [21:09:14] : [Step 4/5] [2021-11-19 21:09:14,666][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][IgniteSnapshotManager] Resolved snapshot work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/snapshots [21:09:14] : [Step 4/5] [2021-11-19 21:09:14,666][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][IgniteSnapshotManager] Resolved temp directory for snapshot creation: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1/snp [21:09:14] : [Step 4/5] [2021-11-19 21:09:14,669][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][ClientListenerProcessor] Client connector processor has started on TCP port 10801 [21:09:14] : [Step 4/5] [2021-11-19 21:09:14,671][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] Non-loopback local IPs: 172.17.0.4 [21:09:14] : [Step 4/5] [2021-11-19 21:09:14,671][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] Enabled local MACs: 0242AC110004 [21:09:14] : [Step 4/5] [2021-11-19 21:09:14,672][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:09:14] : [Step 4/5] [2021-11-19 21:09:14,674][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:09:14] : [Step 4/5] [2021-11-19 21:09:14,674][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:09:14] : [Step 4/5] [2021-11-19 21:09:14,676][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Applying lost metastore updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:09:14] : [Step 4/5] [2021-11-19 21:09:14,677][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=0 ms] [21:09:14] : [Step 4/5] [2021-11-19 21:09:14,678][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][GridCacheProcessor] Restoring partition state for local groups. [21:09:14] : [Step 4/5] [2021-11-19 21:09:14,678][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=0, partitionsProcessed=0, time=0ms] [21:09:14] : [Step 4/5] [2021-11-19 21:09:14,678][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][GridEncryptionManager] Encryption keys loaded from metastore. [grps=, masterKeyName=ignite.master.key] [21:09:14] : [Step 4/5] [2021-11-19 21:09:14,680][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][ClusterProcessor] Cluster ID and tag has been read from metastorage: null [21:09:14] : [Step 4/5] [2021-11-19 21:09:14,680][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][IgniteClusterImpl] Shutdown policy was updated [oldVal=null, newVal=null] [21:09:14] : [Step 4/5] [2021-11-19 21:09:14,681][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Checkpoint frequency deviation changed [oldVal=null, newVal=null] [21:09:14] : [Step 4/5] [2021-11-19 21:09:14,690][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][FilePageStoreManager] Cleanup cache stores [total=1, left=0, cleanFiles=false] [21:09:14] : [Step 4/5] [2021-11-19 21:09:14,692][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:09:14] : [Step 4/5] [2021-11-19 21:09:14,693][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:09:14] : [Step 4/5] [2021-11-19 21:09:14,694][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:09:14] : [Step 4/5] [2021-11-19 21:09:14,695][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Data Regions Started: 5 [21:09:14] : [Step 4/5] [2021-11-19 21:09:14,695][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] ^-- sysMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:09:14] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:09:14] : [Step 4/5] ^-- default region [type=default, persistence=true, lazyAlloc=true, [21:09:14] : [Step 4/5] ... initCfg=10MB, maxCfg=10MB, usedRam=0MB, freeRam=100%, allocRam=0MB, allocTotal=0MB] [21:09:14] : [Step 4/5] ^-- metastoreMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:09:14] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:09:14] : [Step 4/5] ^-- TxLog region [type=internal, persistence=true, lazyAlloc=false, [21:09:14] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:09:14] : [Step 4/5] ^-- volatileDsMemPlc region [type=user, persistence=false, lazyAlloc=true, [21:09:14] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB] [21:09:14] : [Step 4/5] ^-- Ignite persistence [used=0MB] [21:09:14] : [Step 4/5] [21:09:14] : [Step 4/5] [2021-11-19 21:09:14,696][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Starting binary memory restore for: [-2100569601] [21:09:14] : [Step 4/5] [2021-11-19 21:09:14,702][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:09:14] : [Step 4/5] [2021-11-19 21:09:14,703][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:09:14] : [Step 4/5] [2021-11-19 21:09:14,704][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000000.wal, offset=0, ver=2] [21:09:14] : [Step 4/5] [2021-11-19 21:09:14,708][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][GridCacheProcessor] Started cache in recovery mode [name=ignite-sys-cache, id=-2100569601, dataRegionName=sysMemPlc, mode=REPLICATED, atomicity=TRANSACTIONAL, backups=2147483647, mvcc=false] [21:09:14] : [Step 4/5] [2021-11-19 21:09:14,709][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Binary recovery performed in 13 ms. [21:09:14] : [Step 4/5] [2021-11-19 21:09:14,709][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:09:14] : [Step 4/5] [2021-11-19 21:09:14,710][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Applying lost cache updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:09:14] : [Step 4/5] [2021-11-19 21:09:14,776][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=70 ms] [21:09:14] : [Step 4/5] [2021-11-19 21:09:14,776][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][GridCacheProcessor] Restoring partition state for local groups. [21:09:14] : [Step 4/5] [2021-11-19 21:09:14,784][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=1, partitionsProcessed=100, time=10ms] [21:09:15] : [Step 4/5] [2021-11-19 21:09:15,203][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][TestTcpDiscoverySpi] Successfully bound to TCP port [port=47501, localHost=localhost/127.0.0.1, locNodeId=10cd437a-3510-4fa8-a8db-3d5c653f7001] [21:09:15] : [Step 4/5] [2021-11-19 21:09:15,207][INFO ][tcp-disco-srvr-[:47500]-#935%grid-0%-#17900%grid-0%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=59507] [21:09:15] : [Step 4/5] [2021-11-19 21:09:15,207][INFO ][tcp-disco-srvr-[:47500]-#935%grid-0%-#17900%grid-0%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=59507] [21:09:15] : [Step 4/5] [2021-11-19 21:09:15,208][INFO ][tcp-disco-sock-reader-[]-#941%grid-0%-#18019%grid-0%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:59507, rmtPort=59507] [21:09:15] : [Step 4/5] [2021-11-19 21:09:15,209][INFO ][tcp-disco-sock-reader-[10cd437a 127.0.0.1:59507]-#941%grid-0%-#18019%grid-0%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=10cd437a-3510-4fa8-a8db-3d5c653f7001, rmtAddr=/127.0.0.1:59507] [21:09:15] : [Step 4/5] [2021-11-19 21:09:15,214][INFO ][tcp-disco-srvr-[:47501]-#940%grid-1%-#18018%grid-1%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=45195] [21:09:15] : [Step 4/5] [2021-11-19 21:09:15,214][INFO ][tcp-disco-srvr-[:47501]-#940%grid-1%-#18018%grid-1%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=45195] [21:09:15] : [Step 4/5] [2021-11-19 21:09:15,215][INFO ][tcp-disco-sock-reader-[]-#942%grid-1%-#18020%grid-1%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:45195, rmtPort=45195] [21:09:15] : [Step 4/5] [2021-11-19 21:09:15,215][INFO ][tcp-disco-sock-reader-[]-#942%grid-1%-#18020%grid-1%][TestTcpDiscoverySpi] Received ping request from the remote node [rmtNodeId=00b43dc9-2985-4f86-98d3-95505e291000, rmtAddr=/127.0.0.1:45195, rmtPort=45195] [21:09:15] : [Step 4/5] [2021-11-19 21:09:15,217][INFO ][tcp-disco-sock-reader-[]-#942%grid-1%-#18020%grid-1%][TestTcpDiscoverySpi] Finished writing ping response [rmtNodeId=00b43dc9-2985-4f86-98d3-95505e291000, rmtAddr=/127.0.0.1:45195, rmtPort=45195] [21:09:15]W: [org.apache.ignite:ignite-core] [2021-11-19 21:09:15,217][WARN ][tcp-disco-sock-reader-[]-#942%grid-1%-#18020%grid-1%][TestTcpDiscoverySpi] Failed to shutdown socket [21:09:15]W: [org.apache.ignite:ignite-core] java.net.SocketException: Socket output is already shutdown [21:09:15]W: [org.apache.ignite:ignite-core] at java.net.Socket.shutdownOutput(Socket.java:1572) [21:09:15]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.close(IgniteUtils.java:4247) [21:09:15]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.discovery.tcp.ServerImpl$SocketReader.body(ServerImpl.java:7370) [21:09:15]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.IgniteSpiThread.run(IgniteSpiThread.java:58) [21:09:15] : [Step 4/5] [2021-11-19 21:09:15,219][INFO ][tcp-disco-sock-reader-[]-#942%grid-1%-#18020%grid-1%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:45195, rmtPort=45195, rmtNodeId=null] [21:09:15] : [Step 4/5] [2021-11-19 21:09:15,217][INFO ][tcp-disco-sock-reader-[10cd437a 127.0.0.1:59507]-#941%grid-0%-#18019%grid-0%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:59507, rmtPort=59507, rmtNodeId=10cd437a-3510-4fa8-a8db-3d5c653f7001] [21:09:15] : [Step 4/5] [2021-11-19 21:09:15,220][INFO ][tcp-disco-msg-worker-[crd]-#934%grid-0%-#17899%grid-0%][GridEncryptionManager] Joining node doesn't have stored group keys [node=10cd437a-3510-4fa8-a8db-3d5c653f7001] [21:09:15] : [Step 4/5] [2021-11-19 21:09:15,228][INFO ][tcp-disco-msg-worker-[crd]-#934%grid-0%-#17899%grid-0%][TestTcpDiscoverySpi] New next node [newNext=TcpDiscoveryNode [id=10cd437a-3510-4fa8-a8db-3d5c653f7001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=0, intOrder=2, lastExchangeTime=1637345355207, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false]] [21:09:15] : [Step 4/5] [2021-11-19 21:09:15,229][INFO ][tcp-disco-srvr-[:47501]-#940%grid-1%-#18018%grid-1%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=59593] [21:09:15] : [Step 4/5] [2021-11-19 21:09:15,229][INFO ][tcp-disco-srvr-[:47501]-#940%grid-1%-#18018%grid-1%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=59593] [21:09:15] : [Step 4/5] [2021-11-19 21:09:15,229][INFO ][tcp-disco-sock-reader-[]-#943%grid-1%-#18021%grid-1%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:59593, rmtPort=59593] [21:09:15] : [Step 4/5] [2021-11-19 21:09:15,230][INFO ][tcp-disco-sock-reader-[00b43dc9 127.0.0.1:59593]-#943%grid-1%-#18021%grid-1%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=00b43dc9-2985-4f86-98d3-95505e291000, rmtAddr=/127.0.0.1:59593] [21:09:15] : [Step 4/5] [2021-11-19 21:09:15,234][INFO ][tcp-disco-msg-worker-[]-#939%grid-1%-#18017%grid-1%][TestTcpDiscoverySpi] New next node [newNext=TcpDiscoveryNode [id=00b43dc9-2985-4f86-98d3-95505e291000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345355228, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false]] [21:09:15] : [Step 4/5] [2021-11-19 21:09:15,235][INFO ][tcp-disco-srvr-[:47500]-#935%grid-0%-#17900%grid-0%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=45935] [21:09:15] : [Step 4/5] [2021-11-19 21:09:15,235][INFO ][tcp-disco-srvr-[:47500]-#935%grid-0%-#17900%grid-0%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=45935] [21:09:15] : [Step 4/5] [2021-11-19 21:09:15,236][INFO ][tcp-disco-sock-reader-[]-#944%grid-0%-#18022%grid-0%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:45935, rmtPort=45935] [21:09:15] : [Step 4/5] [2021-11-19 21:09:15,237][INFO ][tcp-disco-sock-reader-[10cd437a 127.0.0.1:45935]-#944%grid-0%-#18022%grid-0%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=10cd437a-3510-4fa8-a8db-3d5c653f7001, rmtAddr=/127.0.0.1:45935] [21:09:15] : [Step 4/5] [2021-11-19 21:09:15,239][INFO ][disco-event-worker-#17902%grid-0%][GridDiscoveryManager] Added new node to topology: TcpDiscoveryNode [id=10cd437a-3510-4fa8-a8db-3d5c653f7001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637345355207, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false] [21:09:15] : [Step 4/5] [2021-11-19 21:09:15,240][INFO ][disco-event-worker-#17902%grid-0%][GridDiscoveryManager] Topology snapshot [ver=2, locNode=00b43dc9, servers=2, clients=0, state=INACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=00b43dc9-2985-4f86-98d3-95505e291000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=10cd437a-3510-4fa8-a8db-3d5c653f7001, consistentId=grid-1, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:09:15] : [Step 4/5] [2021-11-19 21:09:15,242][INFO ][tcp-disco-msg-worker-[00b43dc9 127.0.0.1:47500]-#939%grid-1%-#18017%grid-1%][ClusterProcessor] competent_herschel [21:09:15] : [Step 4/5] [2021-11-19 21:09:15,242][INFO ][tcp-disco-msg-worker-[00b43dc9 127.0.0.1:47500]-#939%grid-1%-#18017%grid-1%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustEnabled' was changed from 'null' to 'false' [21:09:15] : [Step 4/5] [2021-11-19 21:09:15,243][INFO ][tcp-disco-msg-worker-[00b43dc9 127.0.0.1:47500]-#939%grid-1%-#18017%grid-1%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustTimeout' was changed from 'null' to '300000' [21:09:15] : [Step 4/5] [2021-11-19 21:09:15,243][INFO ][tcp-disco-msg-worker-[00b43dc9 127.0.0.1:47500]-#939%grid-1%-#18017%grid-1%][IgniteTxManager] Transactions parameter 'longOperationsDumpTimeout' was changed from 'null' to '60000' [21:09:15] : [Step 4/5] [2021-11-19 21:09:15,244][INFO ][tcp-disco-msg-worker-[00b43dc9 127.0.0.1:47500]-#939%grid-1%-#18017%grid-1%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpThreshold' was changed from 'null' to '0' [21:09:15] : [Step 4/5] [2021-11-19 21:09:15,244][INFO ][tcp-disco-msg-worker-[00b43dc9 127.0.0.1:47500]-#939%grid-1%-#18017%grid-1%][IgniteTxManager] Transactions parameter 'transactionTimeDumpSamplesCoefficient' was changed from 'null' to '0.0' [21:09:15] : [Step 4/5] [2021-11-19 21:09:15,245][INFO ][tcp-disco-msg-worker-[00b43dc9 127.0.0.1:47500]-#939%grid-1%-#18017%grid-1%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpSamplesPerSecondLimit' was changed from 'null' to '5' [21:09:15] : [Step 4/5] [2021-11-19 21:09:15,245][INFO ][tcp-disco-msg-worker-[00b43dc9 127.0.0.1:47500]-#939%grid-1%-#18017%grid-1%][IgniteTxManager] Transactions parameter 'collisionsDumpInterval' was changed from 'null' to '1000' [21:09:15] : [Step 4/5] [2021-11-19 21:09:15,246][INFO ][tcp-disco-msg-worker-[00b43dc9 127.0.0.1:47500]-#939%grid-1%-#18017%grid-1%][IgniteTxManager] Transactions parameter 'txOwnerDumpRequestsAllowed' was changed from 'null' to 'true' [21:09:15] : [Step 4/5] [2021-11-19 21:09:15,246][INFO ][tcp-disco-msg-worker-[00b43dc9 127.0.0.1:47500]-#939%grid-1%-#18017%grid-1%][GridCacheDatabaseSharedManager] Historical rebalance WAL threshold changed [property=historical.rebalance.threshold, oldVal=null, newVal=500] [21:09:15] : [Step 4/5] [2021-11-19 21:09:15,247][INFO ][disco-notifier-worker-#18016%grid-1%][MvccProcessorImpl] Assigned mvcc coordinator [crd=MvccCoordinator [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=0], nodeId=00b43dc9-2985-4f86-98d3-95505e291000, ver=1637345353977, local=false, initialized=false]] [21:09:15] : [Step 4/5] [2021-11-19 21:09:15,248][INFO ][sys-#18005%grid-1%][ClusterProcessor] Writing cluster ID and tag to metastorage on ready for write ClusterIdAndTag [id=f85aeea1-b103-4552-bef2-3156987284dd, tag=competent_herschel] [21:09:15] : [Step 4/5] [2021-11-19 21:09:15,267][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] To start Console Management & Monitoring run ignitevisorcmd.{sh|bat} [21:09:15] : [Step 4/5] [2021-11-19 21:09:15,268][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] [21:09:15] : [Step 4/5] [21:09:15] : [Step 4/5] >>> +-------------------------------------------+ [21:09:15] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:09:15] : [Step 4/5] >>> +-------------------------------------------+ [21:09:15] : [Step 4/5] >>> OS name: Linux 4.15.0-151-generic amd64 [21:09:15] : [Step 4/5] >>> CPU(s): 24 [21:09:15] : [Step 4/5] >>> Heap: 2.0GB [21:09:15] : [Step 4/5] >>> VM name: 16724@c4dfe9a430b2 [21:09:15] : [Step 4/5] >>> Ignite instance name: grid-1 [21:09:15] : [Step 4/5] >>> Local node [ID=10CD437A-3510-4FA8-A8DB-3D5C653F7001, order=2, clientMode=false] [21:09:15] : [Step 4/5] >>> Local node addresses: [127.0.0.1] [21:09:15] : [Step 4/5] >>> Local ports: TCP:10801 TCP:47101 TCP:47501 [21:09:15] : [Step 4/5] [21:09:15] : [Step 4/5] [2021-11-19 21:09:15,269][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] >>> Ignite cluster is in INACTIVE state (limited functionality available). Use control.(sh|bat) script or IgniteCluster.state(ClusterState.ACTIVE) to change the state. [21:09:15] : [Step 4/5] [2021-11-19 21:09:15,269][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][GridDiscoveryManager] Topology snapshot [ver=2, locNode=10cd437a, servers=2, clients=0, state=INACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=00b43dc9-2985-4f86-98d3-95505e291000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=10cd437a-3510-4fa8-a8db-3d5c653f7001, consistentId=grid-1, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:09:15] : [Step 4/5] [2021-11-19 21:09:15,270][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][G] Node started : [stage="Configure system pool" (0 ms),stage="Start managers" (196 ms),stage="Configure binary metadata" (1 ms),stage="Start processors" (466 ms),stage="Start 'StanByClusterTestProvider' plugin" (0 ms),stage="Start 'PageMemory tracker plugin' plugin" (0 ms),stage="Start 'TestDistibutedConfigurationPlugin' plugin" (0 ms),stage="Start 'NodeValidationPluginProvider' plugin" (0 ms),stage="Init metastore" (19 ms),stage="Init and start regions" (5 ms),stage="Restore binary memory" (13 ms),stage="Restore logical state" (74 ms),stage="Finish recovery" (417 ms),stage="Join topology" (45 ms),stage="Await transition" (4 ms),stage="Await exchange" (18 ms),stage="Total time" (1258 ms)] [21:09:15] : [Step 4/5] [2021-11-19 21:09:15,271][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][root] Node started with the following configuration [id=10cd437a-3510-4fa8-a8db-3d5c653f7001, marshaller=BinaryMarshaller [], discovery=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=5000, ackTimeout=5000, marsh=JdkMarshaller [clsFilter=org.apache.ignite.marshaller.MarshallerUtils$1@3c508c08], reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], binaryCfg=null, lateAff=true] [21:09:15] : [Step 4/5] [2021-11-19 21:09:15,273][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][GridClusterStateProcessor] Sending activate cluster request with BaselineTopology BaselineTopology [id=0, branchingHash=-2475315501, branchingType='New BaselineTopology', baselineNodes=[grid-1, grid-0]] [21:09:15] : [Step 4/5] [2021-11-19 21:09:15,277][INFO ][disco-notifier-worker-#17898%grid-0%][GridClusterStateProcessor] Received activate cluster request with BaselineTopology[id=0] initiator node ID: 00b43dc9-2985-4f86-98d3-95505e291000 [21:09:15] : [Step 4/5] [2021-11-19 21:09:15,277][INFO ][disco-notifier-worker-#17898%grid-0%][GridClusterStateProcessor] Started state transition: activate cluster [21:09:15] : [Step 4/5] [2021-11-19 21:09:15,278][INFO ][exchange-worker-#17903%grid-0%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], crd=true, evt=DISCOVERY_CUSTOM_EVT, evtNode=00b43dc9-2985-4f86-98d3-95505e291000, customEvt=ChangeGlobalStateMessage [id=0bb6d593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqId=ec2fc873-2c64-424a-accc-3694c2e6d19d, initiatingNodeId=00b43dc9-2985-4f86-98d3-95505e291000, state=ACTIVE, baselineTopology=BaselineTopology [id=0, branchingHash=-2475315501, branchingType='New BaselineTopology', baselineNodes=[grid-1, grid-0]], forceChangeBaselineTopology=false, timestamp=1637345355273, forceDeactivation=true], allowMerge=false, exchangeFreeSwitch=false] [21:09:15] : [Step 4/5] [2021-11-19 21:09:15,278][INFO ][disco-notifier-worker-#18016%grid-1%][GridClusterStateProcessor] Received activate cluster request with BaselineTopology[id=0] initiator node ID: 00b43dc9-2985-4f86-98d3-95505e291000 [21:09:15] : [Step 4/5] [2021-11-19 21:09:15,279][INFO ][exchange-worker-#17903%grid-0%][GridDhtPartitionsExchangeFuture] Start activation process [nodeId=00b43dc9-2985-4f86-98d3-95505e291000, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]]. New state: ACTIVE [21:09:15] : [Step 4/5] [2021-11-19 21:09:15,279][INFO ][disco-notifier-worker-#18016%grid-1%][GridClusterStateProcessor] Started state transition: activate cluster [21:09:15] : [Step 4/5] [2021-11-19 21:09:15,280][INFO ][exchange-worker-#17903%grid-0%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0 [21:09:15] : [Step 4/5] [2021-11-19 21:09:15,280][INFO ][exchange-worker-#18025%grid-1%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], crd=false, evt=DISCOVERY_CUSTOM_EVT, evtNode=00b43dc9-2985-4f86-98d3-95505e291000, customEvt=ChangeGlobalStateMessage [id=0bb6d593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqId=ec2fc873-2c64-424a-accc-3694c2e6d19d, initiatingNodeId=00b43dc9-2985-4f86-98d3-95505e291000, state=ACTIVE, baselineTopology=BaselineTopology [id=0, branchingHash=-2475315501, branchingType='New BaselineTopology', baselineNodes=[grid-1, grid-0]], forceChangeBaselineTopology=false, timestamp=1637345355273, forceDeactivation=true], allowMerge=false, exchangeFreeSwitch=false] [21:09:15] : [Step 4/5] [2021-11-19 21:09:15,282][INFO ][exchange-worker-#18025%grid-1%][GridDhtPartitionsExchangeFuture] Start activation process [nodeId=10cd437a-3510-4fa8-a8db-3d5c653f7001, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]]. New state: ACTIVE [21:09:15] : [Step 4/5] [2021-11-19 21:09:15,283][INFO ][exchange-worker-#18025%grid-1%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1 [21:09:15] : [Step 4/5] [2021-11-19 21:09:15,282][INFO ][exchange-worker-#17903%grid-0%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000000.wal, offset=8713, ver=2] [21:09:15] : [Step 4/5] [2021-11-19 21:09:15,285][INFO ][exchange-worker-#17903%grid-0%][GridClusterStateProcessor] Writing BaselineTopology[id=0] [21:09:15] : [Step 4/5] [2021-11-19 21:09:15,285][INFO ][exchange-worker-#18025%grid-1%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000000.wal, offset=8713, ver=2] [21:09:15] : [Step 4/5] [2021-11-19 21:09:15,287][INFO ][exchange-worker-#18025%grid-1%][GridClusterStateProcessor] Writing BaselineTopology[id=0] [21:09:15] : [Step 4/5] [2021-11-19 21:09:15,288][INFO ][exchange-worker-#17903%grid-0%][GridCacheDatabaseSharedManager] Finish recovery performed in 8 ms. [21:09:15] : [Step 4/5] [2021-11-19 21:09:15,289][INFO ][exchange-worker-#17903%grid-0%][msg] Components activation performed in 9 ms. [21:09:15] : [Step 4/5] [2021-11-19 21:09:15,290][INFO ][exchange-worker-#18025%grid-1%][GridCacheDatabaseSharedManager] Finish recovery performed in 7 ms. [21:09:15] : [Step 4/5] [2021-11-19 21:09:15,292][INFO ][exchange-worker-#18025%grid-1%][msg] Components activation performed in 9 ms. [21:09:15] : [Step 4/5] [2021-11-19 21:09:15,293][INFO ][exchange-worker-#17903%grid-0%][GridCacheProcessor] Finished recovery for cache [cache=ignite-sys-cache, grp=ignite-sys-cache, startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:09:15] : [Step 4/5] [2021-11-19 21:09:15,293][INFO ][exchange-worker-#18025%grid-1%][GridCacheProcessor] Finished recovery for cache [cache=ignite-sys-cache, grp=ignite-sys-cache, startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:09:15] : [Step 4/5] [2021-11-19 21:09:15,293][INFO ][exchange-worker-#17903%grid-0%][GridDhtPartitionsExchangeFuture] Successfully activated caches [nodeId=00b43dc9-2985-4f86-98d3-95505e291000, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], newState=ACTIVE] [21:09:15] : [Step 4/5] [2021-11-19 21:09:15,294][INFO ][exchange-worker-#18025%grid-1%][GridDhtPartitionsExchangeFuture] Successfully activated caches [nodeId=10cd437a-3510-4fa8-a8db-3d5c653f7001, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], newState=ACTIVE] [21:09:15] : [Step 4/5] [2021-11-19 21:09:15,294][INFO ][exchange-worker-#17903%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:09:15] : [Step 4/5] [2021-11-19 21:09:15,295][INFO ][exchange-worker-#18025%grid-1%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:09:15] : [Step 4/5] [2021-11-19 21:09:15,307][INFO ][exchange-worker-#17903%grid-0%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], crd=true] [21:09:15] : [Step 4/5] [2021-11-19 21:09:15,310][INFO ][grid-nio-worker-tcp-comm-0-#17842%TestRecordingCommunicationSpi%][TestRecordingCommunicationSpi] Accepted incoming communication connection [locAddr=/127.0.0.1:47100, rmtAddr=/127.0.0.1:58138] [21:09:15] : [Step 4/5] [2021-11-19 21:09:15,310][INFO ][db-checkpoint-thread-#18035%grid-1%][Checkpointer] Checkpoint started [checkpointId=fb5c90fa-622a-4dcb-89ed-ede397e1f475, startPtr=WALPointer [idx=0, fileOff=83453, len=1963], checkpointBeforeLockTime=2ms, checkpointLockWait=2ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=1ms, writeCheckpointEntryDuration=2ms, splitAndSortCpPagesDuration=0ms, pages=19, reason='node started'] [21:09:15] : [Step 4/5] [2021-11-19 21:09:15,310][INFO ][db-checkpoint-thread-#18034%grid-0%][Checkpointer] Checkpoint started [checkpointId=8b3c27b4-824a-4551-b88a-fd54d348ce06, startPtr=WALPointer [idx=0, fileOff=83453, len=1963], checkpointBeforeLockTime=2ms, checkpointLockWait=2ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=2ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=0ms, pages=19, reason='node started'] [21:09:15] : [Step 4/5] [2021-11-19 21:09:15,312][INFO ][grid-nio-worker-tcp-comm-0-#17960%TestRecordingCommunicationSpi%][TestRecordingCommunicationSpi] Established outgoing communication connection [locAddr=/127.0.0.1:58138, rmtAddr=/127.0.0.1:47100] [21:09:15] : [Step 4/5] [2021-11-19 21:09:15,314][INFO ][exchange-worker-#18025%grid-1%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], crd=false] [21:09:15]W: [org.apache.ignite:ignite-core] [2021-11-19 21:09:15,314][WARN ][checkpoint-runner-IO-#18045%grid-1%][CheckpointPagesWriterFactory] 1 checkpoint pages were not written yet due to unsuccessful page write lock acquisition and will be retried [21:09:15] : [Step 4/5] [2021-11-19 21:09:15,316][INFO ][sys-#17884%grid-0%][GridDhtPartitionsExchangeFuture] Coordinator received single message [ver=AffinityTopologyVersion [topVer=2, minorTopVer=1], node=10cd437a-3510-4fa8-a8db-3d5c653f7001, allReceived=true] [21:09:15] : [Step 4/5] [2021-11-19 21:09:15,317][INFO ][sys-#17884%grid-0%][GridDhtPartitionsExchangeFuture] finishExchangeOnCoordinator [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:09:15] : [Step 4/5] [2021-11-19 21:09:15,322][INFO ][sys-#17884%grid-0%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], err=null, rebalanced=true, wasRebalanced=false] [21:09:15] : [Step 4/5] [2021-11-19 21:09:15,323][INFO ][sys-#18004%grid-1%][GridDhtPartitionsExchangeFuture] Received full message, will finish exchange [node=00b43dc9-2985-4f86-98d3-95505e291000, resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:09:15] : [Step 4/5] [2021-11-19 21:09:15,322][INFO ][disco-notifier-worker-#17898%grid-0%][GridClusterStateProcessor] Received state change finish message: ACTIVE [21:09:15] : [Step 4/5] [2021-11-19 21:09:15,325][INFO ][disco-notifier-worker-#17898%grid-0%][GridClusterStateProcessor] Cluster state was changed from INACTIVE to ACTIVE [21:09:15] : [Step 4/5] [2021-11-19 21:09:15,326][INFO ][sys-#18011%grid-1%][GridCachePartitionExchangeManager] Delay process full message without exchange id (there is exchange in progress) [nodeId=00b43dc9-2985-4f86-98d3-95505e291000] [21:09:15] : [Step 4/5] [2021-11-19 21:09:15,323][INFO ][disco-notifier-worker-#18016%grid-1%][GridClusterStateProcessor] Received state change finish message: ACTIVE [21:09:15] : [Step 4/5] [2021-11-19 21:09:15,326][INFO ][disco-notifier-worker-#18016%grid-1%][GridClusterStateProcessor] Cluster state was changed from INACTIVE to ACTIVE [21:09:15] : [Step 4/5] [2021-11-19 21:09:15,326][INFO ][sys-#17884%grid-0%][GridCacheProcessor] Finish proxy initialization, cacheName=ignite-sys-cache, localNodeId=00b43dc9-2985-4f86-98d3-95505e291000 [21:09:15] : [Step 4/5] [2021-11-19 21:09:15,326][INFO ][sys-#18004%grid-1%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], err=null, rebalanced=true, wasRebalanced=false] [21:09:15] : [Step 4/5] [2021-11-19 21:09:15,327][INFO ][sys-#17884%grid-0%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=00b43dc9-2985-4f86-98d3-95505e291000, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=00b43dc9-2985-4f86-98d3-95505e291000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345355323, loc=true, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:09:15] : [Step 4/5] [2021-11-19 21:09:15,327][INFO ][exchange-worker-#17903%grid-0%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=2, minorTopVer=1], force=false, evt=DISCOVERY_CUSTOM_EVT, node=00b43dc9-2985-4f86-98d3-95505e291000] [21:09:15] : [Step 4/5] [2021-11-19 21:09:15,327][INFO ][sys-#17896%grid-0%][DistributedBaselineConfiguration] Baseline auto-adjust is 'disabled' with timeout='300000' ms [21:09:15] : [Step 4/5] [2021-11-19 21:09:15,330][INFO ][sys-#17884%grid-0%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (1 ms), stage="Update caches registry" (13 ms), stage="Start caches" (0 ms), stage="Affinity initialization on cache group start" (0 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Restore partition states" (0 ms), stage="After states restored callback" (11 ms), stage="WAL history reservation" (0 ms), stage="Waiting for all single messages" (9 ms), stage="Affinity recalculation (crd)" (0 ms), stage="Collect update counters and create affinity messages" (0 ms), stage="Assign partitions states" (0 ms), stage="Validate partitions states" (0 ms), stage="Ideal affinity diff calculation (enforced)" (0 ms), stage="Apply update counters" (0 ms), stage="Full message preparing" (3 ms), stage="Full message sending" (0 ms), stage="State finish message sending" (0 ms), stage="Detect lost partitions" (2 ms), stage="Exchange done" (5 ms), stage="Total time" (44 ms), Discovery lag=3 ms, Latest started node id=10cd437a-3510-4fa8-a8db-3d5c653f7001] [21:09:15] : [Step 4/5] [2021-11-19 21:09:15,330][INFO ][sys-#18004%grid-1%][GridCacheProcessor] Finish proxy initialization, cacheName=ignite-sys-cache, localNodeId=10cd437a-3510-4fa8-a8db-3d5c653f7001 [21:09:15] : [Step 4/5] [2021-11-19 21:09:15,333][INFO ][sys-#17884%grid-0%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], stage="Affinity initialization on cache group start [grp=ignite-sys-cache]" (0 ms) (parent=Affinity initialization on cache group start), stage="Affinity centralized initialization (crd) [grp=ignite-sys-cache, crd=true]" (0 ms) (parent=Determine exchange type), stage="Restore partition states [grp=ignite-sys-cache]" (0 ms) (parent=Restore partition states), stage="Affinity recalculation (partitions availability) [grp=ignite-sys-cache]" (0 ms) (parent=Ideal affinity diff calculation (enforced))] [21:09:15] : [Step 4/5] [2021-11-19 21:09:15,331][INFO ][sys-#17896%grid-0%][GridClusterStateProcessor] Successfully performed final activation steps [nodeId=00b43dc9-2985-4f86-98d3-95505e291000, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:09:15] : [Step 4/5] [2021-11-19 21:09:15,335][INFO ][db-checkpoint-thread-#18034%grid-0%][Checkpointer] Checkpoint finished [cpId=8b3c27b4-824a-4551-b88a-fd54d348ce06, pages=19, markPos=WALPointer [idx=0, fileOff=83453, len=1963], walSegmentsCovered=[], markDuration=6ms, pagesWrite=2ms, fsync=20ms, total=32ms] [21:09:15] : [Step 4/5] [2021-11-19 21:09:15,335][INFO ][db-checkpoint-thread-#18035%grid-1%][Checkpointer] Checkpoint finished [cpId=fb5c90fa-622a-4dcb-89ed-ede397e1f475, pages=19, markPos=WALPointer [idx=0, fileOff=83453, len=1963], walSegmentsCovered=[], markDuration=4ms, pagesWrite=4ms, fsync=20ms, total=32ms] [21:09:15] : [Step 4/5] [2021-11-19 21:09:15,334][INFO ][exchange-worker-#18025%grid-1%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=2, minorTopVer=1], force=false, evt=DISCOVERY_CUSTOM_EVT, node=00b43dc9-2985-4f86-98d3-95505e291000] [21:09:15] : [Step 4/5] [2021-11-19 21:09:15,334][INFO ][sys-#18004%grid-1%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=10cd437a-3510-4fa8-a8db-3d5c653f7001, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=00b43dc9-2985-4f86-98d3-95505e291000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345355228, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:09:15] : [Step 4/5] [2021-11-19 21:09:15,334][INFO ][sys-#18014%grid-1%][DistributedBaselineConfiguration] Baseline auto-adjust is 'disabled' with timeout='300000' ms [21:09:15] : [Step 4/5] [2021-11-19 21:09:15,338][INFO ][sys-#18014%grid-1%][GridClusterStateProcessor] Successfully performed final activation steps [nodeId=10cd437a-3510-4fa8-a8db-3d5c653f7001, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:09:15] : [Step 4/5] [2021-11-19 21:09:15,338][INFO ][sys-#18004%grid-1%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (1 ms), stage="Update caches registry" (10 ms), stage="Start caches" (0 ms), stage="Affinity initialization on cache group start" (0 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Restore partition states" (0 ms), stage="After states restored callback" (11 ms), stage="WAL history reservation" (0 ms), stage="Waiting for Full message" (15 ms), stage="Affinity recalculation" (1 ms), stage="Full map updating" (0 ms), stage="Detect lost partitions" (3 ms), stage="Exchange done" (8 ms), stage="Total time" (49 ms)] [21:09:15] : [Step 4/5] [2021-11-19 21:09:15,336][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][root] awaitPartitionMapExchange finished [21:09:15] : [Step 4/5] [2021-11-19 21:09:15,340][INFO ][sys-#18004%grid-1%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], stage="Affinity initialization on cache group start [grp=ignite-sys-cache]" (0 ms) (parent=Affinity initialization on cache group start), stage="Affinity centralized initialization (crd) [grp=ignite-sys-cache, crd=false]" (0 ms) (parent=Determine exchange type), stage="Restore partition states [grp=ignite-sys-cache]" (0 ms) (parent=Restore partition states), stage="Affinity applying from full message [grp=ignite-sys-cache]" (1 ms) (parent=Affinity recalculation)] [21:09:15] : [Step 4/5] [2021-11-19 21:09:15,347][INFO ][exchange-worker-#18025%grid-1%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], crd=false, evt=DISCOVERY_CUSTOM_EVT, evtNode=00b43dc9-2985-4f86-98d3-95505e291000, customEvt=DynamicCacheChangeBatch [id=4db6d593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqs=ArrayList [DynamicCacheChangeRequest [cacheName=encrypted, hasCfg=true, nodeId=00b43dc9-2985-4f86-98d3-95505e291000, clientStartOnly=false, stop=false, destroy=false, disabledAfterStart=false]], exchangeActions=ExchangeActions [startCaches=[encrypted], stopCaches=null, startGrps=[encrypted], stopGrps=[], resetParts=null, stateChangeRequest=null], startCaches=false], allowMerge=false, exchangeFreeSwitch=false] [21:09:15] : [Step 4/5] [2021-11-19 21:09:15,347][INFO ][exchange-worker-#17903%grid-0%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], crd=true, evt=DISCOVERY_CUSTOM_EVT, evtNode=00b43dc9-2985-4f86-98d3-95505e291000, customEvt=DynamicCacheChangeBatch [id=4db6d593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqs=ArrayList [DynamicCacheChangeRequest [cacheName=encrypted, hasCfg=true, nodeId=00b43dc9-2985-4f86-98d3-95505e291000, clientStartOnly=false, stop=false, destroy=false, disabledAfterStart=false]], exchangeActions=ExchangeActions [startCaches=[encrypted], stopCaches=null, startGrps=[encrypted], stopGrps=[], resetParts=null, stateChangeRequest=null], startCaches=false], allowMerge=false, exchangeFreeSwitch=false] [21:09:15] : [Step 4/5] [2021-11-19 21:09:15,349][INFO ][exchange-worker-#18025%grid-1%][PageMemoryImpl] Started page memory [memoryAllocated=24.0 MiB, pages=5952, tableSize=474.2 KiB, replacementSize=768 B, checkpointBuffer=10.0 MiB] [21:09:15] : [Step 4/5] [2021-11-19 21:09:15,350][INFO ][exchange-worker-#17903%grid-0%][PageMemoryImpl] Started page memory [memoryAllocated=24.0 MiB, pages=5952, tableSize=474.2 KiB, replacementSize=768 B, checkpointBuffer=10.0 MiB] [21:09:15] : [Step 4/5] [2021-11-19 21:09:15,415][INFO ][exchange-worker-#18025%grid-1%][GridCacheProcessor] Started cache [name=encrypted, id=1613773252, dataRegionName=default, mode=PARTITIONED, atomicity=ATOMIC, backups=0, mvcc=false] [21:09:15]W: [org.apache.ignite:ignite-core] [2021-11-19 21:09:15,416][WARN ][exchange-worker-#18025%grid-1%][CacheAffinitySharedManager] Cache group 'encrypted' brings high overhead for its metainformation in data region 'default'. Metainformation required for its partitions (522 partitions, 4096 bytes per partition, 2 MBs total) will consume more than 15% of data region memory (10 MBs). It may lead to critical errors on the node and cluster instability. Please reduce number of partitions, add more memory to the data region or add more server nodes for this cache group. [21:09:15] : [Step 4/5] [2021-11-19 21:09:15,417][INFO ][exchange-worker-#18025%grid-1%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], waitTime=0ms, futInfo=NA, mode=DISTRIBUTED] [21:09:15] : [Step 4/5] [2021-11-19 21:09:15,432][INFO ][exchange-worker-#17903%grid-0%][GridCacheProcessor] Started cache [name=encrypted, id=1613773252, dataRegionName=default, mode=PARTITIONED, atomicity=ATOMIC, backups=0, mvcc=false] [21:09:15]W: [org.apache.ignite:ignite-core] [2021-11-19 21:09:15,434][WARN ][exchange-worker-#17903%grid-0%][CacheAffinitySharedManager] Cache group 'encrypted' brings high overhead for its metainformation in data region 'default'. Metainformation required for its partitions (502 partitions, 4096 bytes per partition, 1 MBs total) will consume more than 15% of data region memory (10 MBs). It may lead to critical errors on the node and cluster instability. Please reduce number of partitions, add more memory to the data region or add more server nodes for this cache group. [21:09:15] : [Step 4/5] [2021-11-19 21:09:15,435][INFO ][exchange-worker-#17903%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], waitTime=0ms, futInfo=NA, mode=DISTRIBUTED] [21:09:15] : [Step 4/5] [2021-11-19 21:09:15,435][INFO ][exchange-worker-#17903%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partitions release latch: ServerLatch [permits=0, pendingAcks=HashSet [], super=CompletableLatch [id=CompletableLatchUid [id=exchange, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2]]]] [21:09:15] : [Step 4/5] [2021-11-19 21:09:15,435][INFO ][exchange-worker-#17903%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:09:15] : [Step 4/5] [2021-11-19 21:09:15,436][INFO ][exchange-worker-#18025%grid-1%][GridDhtPartitionsExchangeFuture] Finished waiting for partitions release latch: ClientLatch [coordinator=TcpDiscoveryNode [id=00b43dc9-2985-4f86-98d3-95505e291000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345355228, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], ackSent=true, super=CompletableLatch [id=CompletableLatchUid [id=exchange, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2]]]] [21:09:15] : [Step 4/5] [2021-11-19 21:09:15,437][INFO ][exchange-worker-#18025%grid-1%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:09:15] : [Step 4/5] [2021-11-19 21:09:15,472][INFO ][exchange-worker-#17903%grid-0%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], crd=true] [21:09:15] : [Step 4/5] [2021-11-19 21:09:15,473][INFO ][exchange-worker-#18025%grid-1%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], crd=false] [21:09:15] : [Step 4/5] [2021-11-19 21:09:15,474][INFO ][sys-#17882%grid-0%][GridDhtPartitionsExchangeFuture] Coordinator received single message [ver=AffinityTopologyVersion [topVer=2, minorTopVer=2], node=10cd437a-3510-4fa8-a8db-3d5c653f7001, allReceived=true] [21:09:15] : [Step 4/5] [2021-11-19 21:09:15,474][INFO ][sys-#17882%grid-0%][GridDhtPartitionsExchangeFuture] finishExchangeOnCoordinator [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2]] [21:09:15] : [Step 4/5] [2021-11-19 21:09:15,479][INFO ][sys-#17882%grid-0%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], err=null, rebalanced=true, wasRebalanced=true] [21:09:15] : [Step 4/5] [2021-11-19 21:09:15,479][INFO ][sys-#18003%grid-1%][GridDhtPartitionsExchangeFuture] Received full message, will finish exchange [node=00b43dc9-2985-4f86-98d3-95505e291000, resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2]] [21:09:15] : [Step 4/5] [2021-11-19 21:09:15,480][INFO ][sys-#17882%grid-0%][GridCacheProcessor] Finish proxy initialization, cacheName=encrypted, localNodeId=00b43dc9-2985-4f86-98d3-95505e291000 [21:09:15] : [Step 4/5] [2021-11-19 21:09:15,482][INFO ][sys-#17882%grid-0%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=00b43dc9-2985-4f86-98d3-95505e291000, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=00b43dc9-2985-4f86-98d3-95505e291000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345355344, loc=true, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2]] [21:09:15] : [Step 4/5] [2021-11-19 21:09:15,482][INFO ][exchange-worker-#17903%grid-0%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=2, minorTopVer=2], force=false, evt=DISCOVERY_CUSTOM_EVT, node=00b43dc9-2985-4f86-98d3-95505e291000] [21:09:15] : [Step 4/5] [2021-11-19 21:09:15,482][INFO ][sys-#18003%grid-1%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], err=null, rebalanced=true, wasRebalanced=true] [21:09:15] : [Step 4/5] [2021-11-19 21:09:15,483][INFO ][sys-#17882%grid-0%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (2 ms), stage="Update caches registry" (0 ms), stage="Start caches" (82 ms), stage="Affinity initialization on cache group start" (1 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Wait partitions release latch [latch=exchange]" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Restore partition states" (10 ms), stage="After states restored callback" (25 ms), stage="WAL history reservation" (0 ms), stage="Waiting for all single messages" (2 ms), stage="Affinity recalculation (crd)" (0 ms), stage="Collect update counters and create affinity messages" (0 ms), stage="Assign partitions states" (1 ms), stage="Validate partitions states" (0 ms), stage="Apply update counters" (0 ms), stage="Full message preparing" (2 ms), stage="Full message sending" (0 ms), stage="Exchange done" (4 ms), stage="Total time" (129 ms)] [21:09:15] : [Step 4/5] [2021-11-19 21:09:15,485][INFO ][sys-#18003%grid-1%][GridCacheProcessor] Finish proxy initialization, cacheName=encrypted, localNodeId=10cd437a-3510-4fa8-a8db-3d5c653f7001 [21:09:15] : [Step 4/5] [2021-11-19 21:09:15,486][INFO ][sys-#17882%grid-0%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], stage="Affinity initialization on cache group start [grp=encrypted]" (0 ms) (parent=Affinity initialization on cache group start), stage="Restore partition states [grp=encrypted]" (10 ms) (parent=Restore partition states), stage="Restore partition states [grp=ignite-sys-cache]" (0 ms) (parent=Restore partition states)] [21:09:15] : [Step 4/5] [2021-11-19 21:09:15,487][INFO ][exchange-worker-#18025%grid-1%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=2, minorTopVer=2], force=false, evt=DISCOVERY_CUSTOM_EVT, node=00b43dc9-2985-4f86-98d3-95505e291000] [21:09:15] : [Step 4/5] [2021-11-19 21:09:15,486][INFO ][sys-#18003%grid-1%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=10cd437a-3510-4fa8-a8db-3d5c653f7001, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=00b43dc9-2985-4f86-98d3-95505e291000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345355228, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2]] [21:09:15] : [Step 4/5] [2021-11-19 21:09:15,488][INFO ][sys-#18003%grid-1%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (1 ms), stage="Update caches registry" (0 ms), stage="Start caches" (66 ms), stage="Affinity initialization on cache group start" (1 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Wait partitions release latch [latch=exchange]" (18 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Restore partition states" (10 ms), stage="After states restored callback" (24 ms), stage="WAL history reservation" (0 ms), stage="Waiting for Full message" (7 ms), stage="Affinity recalculation" (0 ms), stage="Full map updating" (2 ms), stage="Exchange done" (6 ms), stage="Total time" (135 ms)] [21:09:15] : [Step 4/5] [2021-11-19 21:09:15,490][INFO ][sys-#18003%grid-1%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], stage="Affinity initialization on cache group start [grp=encrypted]" (0 ms) (parent=Affinity initialization on cache group start), stage="Restore partition states [grp=encrypted]" (10 ms) (parent=Restore partition states), stage="Restore partition states [grp=ignite-sys-cache]" (0 ms) (parent=Restore partition states)] [21:09:17] : [Step 4/5] [2021-11-19 21:09:17,006][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:09:17] : [Step 4/5] [2021-11-19 21:09:17,145][INFO ][disco-notifier-worker-#17898%grid-0%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:09:17] : [Step 4/5] [2021-11-19 21:09:17,146][INFO ][disco-notifier-worker-#18016%grid-1%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:09:17] : [Step 4/5] [2021-11-19 21:09:17,281][INFO ][disco-notifier-worker-#17898%grid-0%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:09:17] : [Step 4/5] [2021-11-19 21:09:17,285][INFO ][disco-notifier-worker-#18016%grid-1%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:09:17] : [Step 4/5] [2021-11-19 21:09:17,369][INFO ][disco-notifier-worker-#17898%grid-0%][GridEncryptionManager] Start master key change [masterKeyName=мастер.ключ.1] [21:09:17] : [Step 4/5] [2021-11-19 21:09:17,369][INFO ][disco-notifier-worker-#18016%grid-1%][GridEncryptionManager] Start master key change [masterKeyName=мастер.ключ.1] [21:09:17] : [Step 4/5] [2021-11-19 21:09:17,426][INFO ][disco-notifier-worker-#18016%grid-1%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:09:17] : [Step 4/5] [2021-11-19 21:09:17,427][INFO ][disco-notifier-worker-#17898%grid-0%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:09:17] : [Step 4/5] [2021-11-19 21:09:17,952][INFO ][disco-notifier-worker-#18016%grid-1%][GridEncryptionManager] Master key successfully changed [masterKeyName=мастер.ключ.1] [21:09:17] : [Step 4/5] [2021-11-19 21:09:17,966][INFO ][disco-notifier-worker-#17898%grid-0%][GridEncryptionManager] Master key successfully changed [masterKeyName=мастер.ключ.1] [21:09:17] : [Step 4/5] [2021-11-19 21:09:17,982][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][root] >>> Stopping grid [name=grid-0, id=00b43dc9-2985-4f86-98d3-95505e291000] [21:09:17] : [Step 4/5] [2021-11-19 21:09:17,992][INFO ][tcp-disco-sock-reader-[10cd437a 127.0.0.1:45935]-#944%grid-0%-#18022%grid-0%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:45935, rmtPort=45935, rmtNodeId=10cd437a-3510-4fa8-a8db-3d5c653f7001] [21:09:17] : [Step 4/5] [2021-11-19 21:09:17,992][INFO ][disco-event-worker-#18024%grid-1%][GridDiscoveryManager] Node left topology: TcpDiscoveryNode [id=00b43dc9-2985-4f86-98d3-95505e291000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345355228, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false] [21:09:17] : [Step 4/5] [2021-11-19 21:09:17,993][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][GridCacheProcessor] Stopped cache [cacheName=ignite-sys-cache] [21:09:17] : [Step 4/5] [2021-11-19 21:09:17,994][INFO ][disco-event-worker-#18024%grid-1%][GridDiscoveryManager] Topology snapshot [ver=3, locNode=10cd437a, servers=1, clients=0, state=ACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=10cd437a-3510-4fa8-a8db-3d5c653f7001, consistentId=grid-1, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:09:17] : [Step 4/5] [2021-11-19 21:09:17,994][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][GridCacheProcessor] Stopped cache [cacheName=encrypted] [21:09:17] : [Step 4/5] [2021-11-19 21:09:17,995][INFO ][disco-event-worker-#18024%grid-1%][GridDiscoveryManager] Coordinator changed [prev=TcpDiscoveryNode [id=00b43dc9-2985-4f86-98d3-95505e291000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345355228, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], cur=TcpDiscoveryNode [id=10cd437a-3510-4fa8-a8db-3d5c653f7001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637345357990, loc=true, ver=2.13.0#20211119-sha1:00000000, isClient=false]] [21:09:17] : [Step 4/5] [2021-11-19 21:09:17,997][INFO ][disco-event-worker-#18024%grid-1%][GridDiscoveryManager] ^-- Baseline [id=0, size=2, online=1, offline=1] [21:09:17] : [Step 4/5] [2021-11-19 21:09:17,998][INFO ][disco-event-worker-#18024%grid-1%][MvccProcessorImpl] Assigned mvcc coordinator [crd=MvccCoordinator [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], nodeId=10cd437a-3510-4fa8-a8db-3d5c653f7001, ver=1637345353978, local=true, initialized=false]] [21:09:18]W: [org.apache.ignite:ignite-core] [2021-11-19 21:09:17,998][WARN ][grid-nio-worker-tcp-comm-0-#17960%TestRecordingCommunicationSpi%][TestRecordingCommunicationSpi] Failed to shutdown socket [21:09:18]W: [org.apache.ignite:ignite-core] java.nio.channels.ClosedChannelException [21:09:18]W: [org.apache.ignite:ignite-core] at sun.nio.ch.SocketChannelImpl.shutdownOutput(SocketChannelImpl.java:795) [21:09:18]W: [org.apache.ignite:ignite-core] at sun.nio.ch.SocketAdaptor.shutdownOutput(SocketAdaptor.java:407) [21:09:18]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.close(IgniteUtils.java:4247) [21:09:18]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.closeKey(GridNioServer.java:2784) [21:09:18]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.close(GridNioServer.java:2835) [21:09:18]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.close(GridNioServer.java:2794) [21:09:18]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.bodyInternal(GridNioServer.java:2157) [21:09:18]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.body(GridNioServer.java:1910) [21:09:18]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:125) [21:09:18]W: [org.apache.ignite:ignite-core] at java.lang.Thread.run(Thread.java:748) [21:09:18] : [Step 4/5] [2021-11-19 21:09:17,999][INFO ][exchange-worker-#18025%grid-1%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], crd=true, evt=NODE_LEFT, evtNode=00b43dc9-2985-4f86-98d3-95505e291000, customEvt=null, allowMerge=false, exchangeFreeSwitch=true] [21:09:18] : [Step 4/5] [2021-11-19 21:09:17,999][INFO ][sys-#18012%grid-1%][ExchangeLatchManager] Become new coordinator 10cd437a-3510-4fa8-a8db-3d5c653f7001 [21:09:18] : [Step 4/5] [2021-11-19 21:09:18,001][INFO ][exchange-worker-#18025%grid-1%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:09:18] : [Step 4/5] [2021-11-19 21:09:18,003][INFO ][exchange-worker-#18025%grid-1%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], err=null, rebalanced=true, wasRebalanced=true] [21:09:18]W: [org.apache.ignite:ignite-core] [2021-11-19 21:09:18,005][WARN ][sys-#17995%grid-1%][GridDhtPartitionTopologyImpl] Detected lost partitions [grp=encrypted, parts=[1, 3, 5, 8-9, 12-13, 15-16, 18-20, 22-23, 31, 33-36, 38-39, 41-43, 45-46, 53, 55-56, 58, 60-61, 65-66, 69-73, 76-77, 79-80, 82-86, 89-90, 92-96, 98, 100, 103, 108-112, 115, 117, 119, 121, 123, 125-134, 137, 139, 146, 148, 153, 157-158, 161, 165-168, 170-171, 173-174, 178-179, 181-183, 188-189, 192-193, 195, 203, 206-208, 211, 213, 215, 217-218, 225, 227-228, 233-236, 238, 240, 242, 246, 248, 252-254, 256, 258-260, 262-264, 266-268, 270-271, 274-275, 278-280, 283-284, 286, 288, 292, 298, 300, 305, 307, 310, 313-314, 318, 320-321, 323-324, 327, 331-335, 337-338, 340, 342-343, 347-349, 351, 355-356, 362, 364-365, 368-370, 374-375, 381-382, 384, 386, 389, 391, 393-394, 398-399, 401, 403-404, 406-407, 412-415, 417-419, 421, 423, 426-428, 430-432, 434, 439, 442-444, 447-449, 451, 454, 457, 459, 461, 464, 469, 471-473, 476-479, 481-487, 489, 493-494, 496, 498, 513-515, 517-524, 526, 532-534, 536, 539-540, 543-544, 547, 553, 556-557, 559-561, 565-566, 570-571, 573, 575-578, 581, 586, 588-589, 592-593, 595, 597-599, 601, 603, 605-606, 615-616, 621-622, 625-626, 630-631, 634-635, 637, 639, 643-644, 647, 650-656, 663, 666-667, 673-676, 679-681, 685, 687-688, 690-691, 694, 698, 700-705, 708, 711, 715, 718, 722, 729, 733, 736-738, 740-741, 743-745, 747-748, 751, 753, 755, 757-761, 763-767, 771, 776-777, 779, 781-782, 788, 792, 794-795, 797, 802, 804-805, 807-808, 813, 815, 818, 820-821, 826, 830-831, 834-835, 838, 841-845, 847, 852, 855-856, 859, 861-862, 865, 867, 872, 876, 879-883, 885-887, 890-895, 898-899, 901-904, 908-913, 916, 918, 921-922, 926-930, 934-935, 937-939, 941, 943, 946-947, 949, 952-953, 955, 959-961, 963-964, 971, 973-974, 977, 981-982, 984, 986-987, 989, 991-992, 995-996, 999, 1001-1002, 1005-1006, 1008, 1010-1013, 1015, 1017, 1020-1023], topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0]] [21:09:18] : [Step 4/5] [2021-11-19 21:09:18,009][INFO ][exchange-worker-#18025%grid-1%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=10cd437a-3510-4fa8-a8db-3d5c653f7001, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], evt=NODE_LEFT, evtNode=TcpDiscoveryNode [id=00b43dc9-2985-4f86-98d3-95505e291000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345355228, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0]] [21:09:18] : [Step 4/5] [2021-11-19 21:09:18,010][INFO ][exchange-worker-#18025%grid-1%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (1 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="After states restored callback" (0 ms), stage="WAL history reservation" (0 ms), stage="Finalize update counters" (0 ms), stage="Detect lost partitions" (5 ms), stage="Exchange done" (1 ms), stage="Total time" (7 ms)] [21:09:18] : [Step 4/5] [2021-11-19 21:09:18,011][INFO ][exchange-worker-#18025%grid-1%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], stage="Affinity initialization (exchange-free switch on fully-rebalanced topology) [grp=ignite-sys-cache]" (0 ms) (parent=Determine exchange type), stage="Affinity initialization (exchange-free switch on fully-rebalanced topology) [grp=encrypted]" (0 ms) (parent=Determine exchange type)] [21:09:18] : [Step 4/5] [2021-11-19 21:09:18,012][INFO ][exchange-worker-#18025%grid-1%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], crd=true] [21:09:18] : [Step 4/5] [2021-11-19 21:09:18,013][INFO ][exchange-worker-#18025%grid-1%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=3, minorTopVer=0], force=false, evt=NODE_LEFT, node=00b43dc9-2985-4f86-98d3-95505e291000] [21:09:21] : [Step 4/5] [2021-11-19 21:09:21,424][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][FilePageStoreManager] Cleanup cache stores [total=4, left=0, cleanFiles=false] [21:09:21] : [Step 4/5] [2021-11-19 21:09:21,427][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][GridDeploymentLocalStore] Removed undeployed class: GridDeployment [ts=1637345355313, depMode=SHARED, clsLdr=IsolatedClassLoader{roleName='test'}, clsLdrId=cbb6d593d71-00b43dc9-2985-4f86-98d3-95505e291000, userVer=0, loc=true, sampleClsName=org.apache.ignite.internal.processors.cache.distributed.dht.preloader.GridDhtPartitionMap, pendingUndeploy=false, undeployed=true, usage=0] [21:09:21] : [Step 4/5] [2021-11-19 21:09:21,434][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] [21:09:21] : [Step 4/5] [21:09:21] : [Step 4/5] >>> +------------------------------------------------------+ [21:09:21] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV stopped OK [21:09:21] : [Step 4/5] >>> +------------------------------------------------------+ [21:09:21] : [Step 4/5] >>> Ignite instance name: grid-0 [21:09:21] : [Step 4/5] >>> Grid uptime: 00:00:07.430 [21:09:21] : [Step 4/5] [21:09:21] : [Step 4/5] [21:09:21]W: [org.apache.ignite:ignite-core] [2021-11-19 21:09:21,439][WARN ][test-runner-#17787%encryption.MasterKeyChangeTest%][G] Ignite work directory is not provided, automatically resolved to: /opt/buildagent/work/7bc1c54bc719b67c/work [21:09:21] : [Step 4/5] [2021-11-19 21:09:21,440][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] [21:09:21] : [Step 4/5] [21:09:21] : [Step 4/5] >>> __________ ________________ [21:09:21] : [Step 4/5] >>> / _/ ___/ |/ / _/_ __/ __/ [21:09:21] : [Step 4/5] >>> _/ // (7 7 // / / / / _/ [21:09:21] : [Step 4/5] >>> /___/\___/_/|_/___/ /_/ /___/ [21:09:21] : [Step 4/5] >>> [21:09:21] : [Step 4/5] >>> ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:09:21] : [Step 4/5] >>> 2021 Copyright(C) Apache Software Foundation [21:09:21] : [Step 4/5] >>> [21:09:21] : [Step 4/5] >>> Ignite documentation: http://ignite.apache.org [21:09:21] : [Step 4/5] [21:09:21] : [Step 4/5] [2021-11-19 21:09:21,441][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] Config URL: n/a [21:09:21] : [Step 4/5] [2021-11-19 21:09:21,441][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] IgniteConfiguration [igniteInstanceName=grid-0, pubPoolSize=24, svcPoolSize=24, callbackPoolSize=24, stripedPoolSize=24, sysPoolSize=24, mgmtPoolSize=4, dataStreamerPoolSize=24, utilityCachePoolSize=24, utilityCacheKeepAliveTime=60000, p2pPoolSize=2, qryPoolSize=24, buildIdxPoolSize=4, igniteHome=/opt/buildagent/work/7bc1c54bc719b67c, igniteWorkDir=/opt/buildagent/work/7bc1c54bc719b67c/work, mbeanSrv=com.sun.jmx.mbeanserver.JmxMBeanServer@6fe85038, nodeId=00951441-9c23-4a84-8ea0-2300a5a74000, marsh=BinaryMarshaller [], marshLocJobs=false, daemon=false, p2pEnabled=true, netTimeout=10000, netCompressionLevel=1, sndRetryDelay=1000, sndRetryCnt=3, metricsHistSize=10000, metricsUpdateFreq=1000, metricsExpTime=9223372036854775807, discoSpi=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=0, ackTimeout=0, marsh=null, reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], segPlc=STOP, segResolveAttempts=2, waitForSegOnStart=true, allResolversPassReq=true, segChkFreq=10000, commSpi=TcpCommunicationSpi [connectGate=org.apache.ignite.spi.communication.tcp.internal.ConnectGateway@6f34f448, ctxInitLatch=java.util.concurrent.CountDownLatch@3256a8a0[Count = 1], stopping=false, clientPool=null, nioSrvWrapper=null, stateProvider=null], evtSpi=MemoryEventStorageSpi [expireAgeMs=9223372036854775807, expireCnt=10000, filter=null], colSpi=NoopCollisionSpi [], deploySpi=LocalDeploymentSpi [], indexingSpi=org.apache.ignite.spi.indexing.noop.NoopIndexingSpi@436c7482, addrRslvr=null, encryptionSpi=org.apache.ignite.spi.encryption.keystore.KeystoreEncryptionSpi@58ce97ee, tracingSpi=org.apache.ignite.spi.tracing.NoopTracingSpi@63f00596, clientMode=false, rebalanceThreadPoolSize=4, rebalanceTimeout=10000, rebalanceBatchesPrefetchCnt=3, rebalanceThrottle=0, rebalanceBatchSize=524288, txCfg=TransactionConfiguration [txSerEnabled=false, dfltIsolation=REPEATABLE_READ, dfltConcurrency=PESSIMISTIC, dfltTxTimeout=0, txTimeoutOnPartitionMapExchange=0, deadlockTimeout=10000, pessimisticTxLogSize=0, pessimisticTxLogLinger=10000, tmLookupClsName=null, txManagerFactory=null, useJtaSync=false], cacheSanityCheckEnabled=true, discoStartupDelay=60000, deployMode=SHARED, p2pMissedCacheSize=100, locHost=127.0.0.1, timeSrvPortBase=31100, timeSrvPortRange=100, failureDetectionTimeout=10000, sysWorkerBlockedTimeout=null, clientFailureDetectionTimeout=10000, metricsLogFreq=0, connectorCfg=null, odbcCfg=null, warmupClos=null, atomicCfg=AtomicConfiguration [seqReserveSize=1000, cacheMode=PARTITIONED, backups=1, aff=null, grpName=null], classLdr=null, sslCtxFactory=null, platformCfg=null, binaryCfg=null, memCfg=null, pstCfg=null, dsCfg=DataStorageConfiguration [sysRegionInitSize=41943040, sysRegionMaxSize=104857600, pageSize=4096, concLvl=0, dfltDataRegConf=DataRegionConfiguration [name=default, maxSize=10485760, initSize=268435456, swapPath=null, pageEvictionMode=DISABLED, pageReplacementMode=CLOCK, evictionThreshold=0.9, emptyPagesPoolSize=100, metricsEnabled=false, metricsSubIntervalCount=5, metricsRateTimeInterval=60000, persistenceEnabled=true, checkpointPageBufSize=0, lazyMemoryAllocation=true, warmUpCfg=null], dataRegions=null, storagePath=null, checkpointFreq=180000, lockWaitTime=10000, checkpointThreads=4, checkpointWriteOrder=SEQUENTIAL, walHistSize=20, maxWalArchiveSize=1073741824, walSegments=10, walSegmentSize=67108864, walPath=db/wal, walArchivePath=db/wal/archive, cdcWalPath=db/wal/cdc, cdcEnabled=false, metricsEnabled=false, walMode=FSYNC, walTlbSize=131072, walBuffSize=0, walFlushFreq=2000, walFsyncDelay=1000, walRecordIterBuffSize=67108864, alwaysWriteFullPages=false, fileIOFactory=org.apache.ignite.internal.processors.cache.persistence.file.AsyncFileIOFactory@3a227903, metricsSubIntervalCnt=5, metricsRateTimeInterval=60000, walAutoArchiveAfterInactivity=-1, walForceArchiveTimeout=-1, writeThrottlingEnabled=false, walCompactionEnabled=false, walCompactionLevel=1, checkpointReadLockTimeout=null, walPageCompression=DISABLED, walPageCompressionLevel=null, dfltWarmUpCfg=null, encCfg=org.apache.ignite.configuration.EncryptionConfiguration@73b0d1d0, defragmentationThreadPoolSize=4, minWalArchiveSize=-1], snapshotPath=snapshots, activeOnStart=true, activeOnStartPropSetFlag=false, autoActivation=true, autoActivationPropSetFlag=false, clusterStateOnStart=null, sqlConnCfg=null, cliConnCfg=ClientConnectorConfiguration [host=null, port=10800, portRange=100, sockSndBufSize=0, sockRcvBufSize=0, tcpNoDelay=true, maxOpenCursorsPerConn=128, threadPoolSize=24, selectorCnt=12, idleTimeout=0, handshakeTimeout=10000, jdbcEnabled=true, odbcEnabled=true, thinCliEnabled=true, sslEnabled=false, useIgniteSslCtxFactory=true, sslClientAuth=false, sslCtxFactory=null, thinCliCfg=ThinClientConfiguration [maxActiveTxPerConn=100, maxActiveComputeTasksPerConn=0]], mvccVacuumThreadCnt=2, mvccVacuumFreq=5000, authEnabled=false, failureHnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]], commFailureRslvr=null, sqlCfg=SqlConfiguration [longQryWarnTimeout=3000, dfltQryTimeout=0, sqlQryHistSize=1000, validationEnabled=false], asyncContinuationExecutor=null] [21:09:21] : [Step 4/5] [2021-11-19 21:09:21,451][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] Daemon mode: off [21:09:21] : [Step 4/5] [2021-11-19 21:09:21,451][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] OS: Linux 4.15.0-151-generic amd64 [21:09:21] : [Step 4/5] [2021-11-19 21:09:21,451][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] OS user: teamcity [21:09:21] : [Step 4/5] [2021-11-19 21:09:21,451][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] PID: 16724 [21:09:21] : [Step 4/5] [2021-11-19 21:09:21,452][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] Language runtime: Java Platform API Specification ver. 1.8 [21:09:21] : [Step 4/5] [2021-11-19 21:09:21,452][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] VM information: Java(TM) SE Runtime Environment 1.8.0_261-b12 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 25.261-b12 [21:09:21] : [Step 4/5] [2021-11-19 21:09:21,452][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] VM total memory: 1.9GB [21:09:21] : [Step 4/5] [2021-11-19 21:09:21,452][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] Remote Management [restart: off, REST: off, JMX (remote: off)] [21:09:21] : [Step 4/5] [2021-11-19 21:09:21,453][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] Logger: GridTestLog4jLogger [quiet=false, config=null] [21:09:21] : [Step 4/5] [2021-11-19 21:09:21,453][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] IGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c [21:09:21] : [Step 4/5] [2021-11-19 21:09:21,453][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] VM arguments: [-DIGNITE_DUMP_THREADS_ON_FAILURE=false, -DMono=/usr/bin/mono-sgen, -DMono4.0_x64=/usr/lib/mono/4.0, -DMono4.5_x64=/usr/lib/mono/4.5, -DMonoVersion=6.12.0.90, -DSKIP_BUILD=false, -Dagent.home.dir=/opt/buildagent, -Dagent.name=aitc-lin02_03, -Dagent.ownPort=9090, -Dagent.work.dir=/opt/buildagent/work, -Dbuild.number=95, -Dbuild.vcs.number=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.1=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.GitHubApacheIgnite=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dclassworlds.conf=/opt/buildagent/temp/buildTmp/teamcity.m2.conf, -Dcom.jetbrains.maven.watcher.report.file=/opt/buildagent/temp/buildTmp/maven-build-info.xml, -Djava.io.tmpdir=/opt/buildagent/temp/buildTmp, -Dmaven.home=/opt/buildagent/tools/maven3_6, -Dmaven.multiModuleProjectDirectory=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.agent.cpuBenchmark=457, -Dteamcity.agent.dotnet.agent_url=http://localhost:9090/RPC2, -Dteamcity.agent.dotnet.build_id=6278078, -Dteamcity.auth.password=*******, -Dteamcity.auth.userId=TeamCityBuildId=6278078, -Dteamcity.build.changedFiles.file=/opt/buildagent/temp/buildTmp/changedFiles6342607772318147725.txt, -Dteamcity.build.checkoutDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.build.id=6278078, -Dteamcity.build.properties.file=/opt/buildagent/temp/buildTmp/teamcity.build5164517880467851002.properties, -Dteamcity.build.tempDir=/opt/buildagent/temp/buildTmp, -Dteamcity.build.workingDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.buildConfName=Basic 3, -Dteamcity.buildType.id=IgniteTests24Java8_Basic3, -Dteamcity.configuration.properties.file=/opt/buildagent/temp/buildTmp/teamcity.config5591980786735343870.properties, -Dteamcity.maven.userSettings.path=/opt/buildagent/temp/buildTmp/maven_settings_585072866407032347.xml, -Dteamcity.maven.watcher.home=/opt/buildagent/plugins/mavenPlugin/maven-watcher-jdk16, -Dteamcity.projectName=Ignite Tests 2.x (JDK 8/11), -Dteamcity.runner.properties.file=/opt/buildagent/temp/buildTmp/teamcity.runner9098465561618137420.properties, -Dteamcity.tests.recentlyFailedTests.file=/opt/buildagent/temp/buildTmp/testsToRunFirst3891775683130404069.txt, -Dteamcity.version=2021.2 (build 99542), -ea, -Xms2g, -Xmx2g, -XX:+HeapDumpOnOutOfMemoryError, -DIGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_TEST_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_UPDATE_NOTIFIER=false, -DIGNITE_NO_DISCO_ORDER=true, -DIGNITE_PERFORMANCE_SUGGESTIONS_DISABLED=true, -Djava.net.preferIPv4Stack=true, -DTEST_SCALE_FACTOR=1.0, -DIGNITE_TEST_PROP_LOG4J_FILE=log4j-tc-test.xml, -DIGNITE_QUIET=false, -DIGNITE_MARSHAL_BUFFERS_RECHECK=1000, -Dmaven.repo.local=/opt/buildagent/.m2/repository] [21:09:21] : [Step 4/5] [2021-11-19 21:09:21,458][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] System cache's DataRegion size is configured to 40 MB. Use DataStorageConfiguration.systemRegionInitialSize property to change the setting. [21:09:21] : [Step 4/5] [2021-11-19 21:09:21,459][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] Configured caches [in 'sysMemPlc' dataRegion: ['ignite-sys-cache']] [21:09:21]W: [org.apache.ignite:ignite-core] [2021-11-19 21:09:21,459][WARN ][test-runner-#17787%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] Peer class loading is enabled (disable it in production for performance and deployment consistency reasons) [21:09:21] : [Step 4/5] [2021-11-19 21:09:21,459][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] 3-rd party licenses can be found at: /opt/buildagent/work/7bc1c54bc719b67c/libs/licenses [21:09:21] : [Step 4/5] [2021-11-19 21:09:21,463][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] Configured plugins: [21:09:21] : [Step 4/5] [2021-11-19 21:09:21,464][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] ^-- StanByClusterTestProvider 1.0 [21:09:21] : [Step 4/5] [2021-11-19 21:09:21,464][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:09:21] : [Step 4/5] [2021-11-19 21:09:21,464][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] [21:09:21] : [Step 4/5] [2021-11-19 21:09:21,464][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] ^-- PageMemory tracker plugin 1.0 [21:09:21] : [Step 4/5] [2021-11-19 21:09:21,464][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:09:21] : [Step 4/5] [2021-11-19 21:09:21,464][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] [21:09:21] : [Step 4/5] [2021-11-19 21:09:21,465][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] ^-- TestDistibutedConfigurationPlugin 1.0 [21:09:21] : [Step 4/5] [2021-11-19 21:09:21,465][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:09:21] : [Step 4/5] [2021-11-19 21:09:21,465][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] [21:09:21] : [Step 4/5] [2021-11-19 21:09:21,465][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] ^-- NodeValidationPluginProvider 1.0 [21:09:21] : [Step 4/5] [2021-11-19 21:09:21,465][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:09:21] : [Step 4/5] [2021-11-19 21:09:21,465][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] [21:09:21] : [Step 4/5] [2021-11-19 21:09:21,466][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][FailureProcessor] Configured failure handler: [hnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]]] [21:09:21] : [Step 4/5] [2021-11-19 21:09:21,480][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][TestRecordingCommunicationSpi] Successfully bound communication NIO server to TCP port [port=47100, locHost=/127.0.0.1, selectorsCnt=12, selectorSpins=0, pairedConn=false] [21:09:21]W: [org.apache.ignite:ignite-core] [2021-11-19 21:09:21,480][WARN ][test-runner-#17787%encryption.MasterKeyChangeTest%][TestRecordingCommunicationSpi] Message queue limit is set to 0 which may lead to potential OOMEs when running cache operations in FULL_ASYNC or PRIMARY_SYNC modes due to message queues growth on sender and receiver sides. [21:09:21] : [Step 4/5] [2021-11-19 21:09:21,484][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][GridCollisionManager] Collision resolution is disabled (all jobs will be activated upon arrival). [21:09:21] : [Step 4/5] [2021-11-19 21:09:21,484][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] Security status [authentication=off, sandbox=off, tls/ssl=off] [21:09:21] : [Step 4/5] [2021-11-19 21:09:21,601][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:09:21] : [Step 4/5] [2021-11-19 21:09:21,690][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][MaintenanceProcessor] Resolved store directory for node persistent data: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0 [21:09:21] : [Step 4/5] [2021-11-19 21:09:21,691][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][CacheObjectBinaryProcessorImpl] Resolved directory for serialized binary metadata: /opt/buildagent/work/7bc1c54bc719b67c/work/db/binary_meta/grid_0 [21:09:21] : [Step 4/5] [2021-11-19 21:09:21,695][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0 [21:09:21] : [Step 4/5] [2021-11-19 21:09:21,696][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][FileWriteAheadLogManager] Resolved write ahead log work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0 [21:09:21] : [Step 4/5] [2021-11-19 21:09:21,696][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][FileWriteAheadLogManager] Resolved write ahead log archive directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0 [21:09:21] : [Step 4/5] [2021-11-19 21:09:21,698][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000005.wal [21:09:21] : [Step 4/5] [2021-11-19 21:09:21,698][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000004.wal [21:09:21] : [Step 4/5] [2021-11-19 21:09:21,698][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000003.wal [21:09:21] : [Step 4/5] [2021-11-19 21:09:21,699][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000002.wal [21:09:21] : [Step 4/5] [2021-11-19 21:09:21,699][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000001.wal [21:09:21] : [Step 4/5] [2021-11-19 21:09:21,704][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Configured data regions initialized successfully [total=5] [21:09:21] : [Step 4/5] [2021-11-19 21:09:21,706][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][IgniteSnapshotManager] Resolved snapshot work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/snapshots [21:09:21] : [Step 4/5] [2021-11-19 21:09:21,706][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][IgniteSnapshotManager] Resolved temp directory for snapshot creation: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0/snp [21:09:21] : [Step 4/5] [2021-11-19 21:09:21,709][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][ClientListenerProcessor] Client connector processor has started on TCP port 10800 [21:09:21] : [Step 4/5] [2021-11-19 21:09:21,714][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] Non-loopback local IPs: 172.17.0.4 [21:09:21] : [Step 4/5] [2021-11-19 21:09:21,714][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] Enabled local MACs: 0242AC110004 [21:09:21] : [Step 4/5] [2021-11-19 21:09:21,717][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=/opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0/cp/1637345355303-8b3c27b4-824a-4551-b88a-fd54d348ce06-START.bin, endMarker=/opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0/cp/1637345355303-8b3c27b4-824a-4551-b88a-fd54d348ce06-END.bin] [21:09:21] : [Step 4/5] [2021-11-19 21:09:21,718][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:09:21] : [Step 4/5] [2021-11-19 21:09:21,718][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=83453, len=1963], lastMarked=WALPointer [idx=0, fileOff=83453, len=1963], lastCheckpointId=8b3c27b4-824a-4551-b88a-fd54d348ce06] [21:09:21] : [Step 4/5] [2021-11-19 21:09:21,826][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Found last checkpoint marker [cpId=8b3c27b4-824a-4551-b88a-fd54d348ce06, pos=WALPointer [idx=0, fileOff=83453, len=1963]] [21:09:21] : [Step 4/5] [2021-11-19 21:09:21,837][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Applying lost metastore updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=83453, len=1963], lastCheckpointId=8b3c27b4-824a-4551-b88a-fd54d348ce06] [21:09:21] : [Step 4/5] [2021-11-19 21:09:21,891][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][GridEncryptionManager] Master key name loaded from WAL [masterKeyName=мастер.ключ.1] [21:09:21] : [Step 4/5] [2021-11-19 21:09:21,949][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:09:22] : [Step 4/5] [2021-11-19 21:09:22,036][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=192 ms] [21:09:22] : [Step 4/5] [2021-11-19 21:09:22,036][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][GridCacheProcessor] Restoring partition state for local groups. [21:09:22] : [Step 4/5] [2021-11-19 21:09:22,036][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=0, partitionsProcessed=0, time=0ms] [21:09:22] : [Step 4/5] [2021-11-19 21:09:22,103][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][GridClusterStateProcessor] Restoring history for BaselineTopology[id=0] [21:09:22] : [Step 4/5] [2021-11-19 21:09:22,111][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][ClusterProcessor] Cluster ID and tag has been read from metastorage: ClusterIdAndTag [id=f85aeea1-b103-4552-bef2-3156987284dd, tag=competent_herschel] [21:09:22] : [Step 4/5] [2021-11-19 21:09:22,111][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][IgniteClusterImpl] Shutdown policy was updated [oldVal=null, newVal=null] [21:09:22] : [Step 4/5] [2021-11-19 21:09:22,112][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustEnabled' was changed from 'null' to 'false' [21:09:22] : [Step 4/5] [2021-11-19 21:09:22,112][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustTimeout' was changed from 'null' to '300000' [21:09:22] : [Step 4/5] [2021-11-19 21:09:22,113][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][IgniteTxManager] Transactions parameter 'txOwnerDumpRequestsAllowed' was changed from 'null' to 'true' [21:09:22] : [Step 4/5] [2021-11-19 21:09:22,113][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][IgniteTxManager] Transactions parameter 'longOperationsDumpTimeout' was changed from 'null' to '60000' [21:09:22] : [Step 4/5] [2021-11-19 21:09:22,113][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpThreshold' was changed from 'null' to '0' [21:09:22] : [Step 4/5] [2021-11-19 21:09:22,114][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][IgniteTxManager] Transactions parameter 'transactionTimeDumpSamplesCoefficient' was changed from 'null' to '0.0' [21:09:22] : [Step 4/5] [2021-11-19 21:09:22,114][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpSamplesPerSecondLimit' was changed from 'null' to '5' [21:09:22] : [Step 4/5] [2021-11-19 21:09:22,115][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][IgniteTxManager] Transactions parameter 'collisionsDumpInterval' was changed from 'null' to '1000' [21:09:22] : [Step 4/5] [2021-11-19 21:09:22,115][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Historical rebalance WAL threshold changed [property=historical.rebalance.threshold, oldVal=null, newVal=500] [21:09:22] : [Step 4/5] [2021-11-19 21:09:22,115][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Checkpoint frequency deviation changed [oldVal=null, newVal=null] [21:09:22] : [Step 4/5] [2021-11-19 21:09:22,116][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][FilePageStoreManager] Cleanup cache stores [total=1, left=0, cleanFiles=false] [21:09:22] : [Step 4/5] [2021-11-19 21:09:22,118][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:09:22] : [Step 4/5] [2021-11-19 21:09:22,119][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:09:22] : [Step 4/5] [2021-11-19 21:09:22,120][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:09:22] : [Step 4/5] [2021-11-19 21:09:22,121][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Data Regions Started: 5 [21:09:22] : [Step 4/5] [2021-11-19 21:09:22,121][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] ^-- sysMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:09:22] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:09:22] : [Step 4/5] ^-- default region [type=default, persistence=true, lazyAlloc=true, [21:09:22] : [Step 4/5] ... initCfg=10MB, maxCfg=10MB, usedRam=0MB, freeRam=100%, allocRam=0MB, allocTotal=0MB] [21:09:22] : [Step 4/5] ^-- metastoreMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:09:22] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:09:22] : [Step 4/5] ^-- TxLog region [type=internal, persistence=true, lazyAlloc=false, [21:09:22] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:09:22] : [Step 4/5] ^-- volatileDsMemPlc region [type=user, persistence=false, lazyAlloc=true, [21:09:22] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB] [21:09:22] : [Step 4/5] ^-- Ignite persistence [used=0MB] [21:09:22] : [Step 4/5] [21:09:22] : [Step 4/5] [2021-11-19 21:09:22,123][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Starting binary memory restore for: [-2100569601, 1613773252] [21:09:22] : [Step 4/5] [2021-11-19 21:09:22,199][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=/opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0/cp/1637345355303-8b3c27b4-824a-4551-b88a-fd54d348ce06-START.bin, endMarker=/opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0/cp/1637345355303-8b3c27b4-824a-4551-b88a-fd54d348ce06-END.bin] [21:09:22] : [Step 4/5] [2021-11-19 21:09:22,200][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=83453, len=1963], lastMarked=WALPointer [idx=0, fileOff=83453, len=1963], lastCheckpointId=8b3c27b4-824a-4551-b88a-fd54d348ce06] [21:09:22] : [Step 4/5] [2021-11-19 21:09:22,321][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Found last checkpoint marker [cpId=8b3c27b4-824a-4551-b88a-fd54d348ce06, pos=WALPointer [idx=0, fileOff=83453, len=1963]] [21:09:22] : [Step 4/5] [2021-11-19 21:09:22,340][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Binary memory state restored at node startup [restoredPtr=WALPointer [idx=0, fileOff=501554, len=0]] [21:09:22] : [Step 4/5] [2021-11-19 21:09:22,341][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000000.wal, offset=501554, ver=2] [21:09:22] : [Step 4/5] [2021-11-19 21:09:22,344][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][GridCacheProcessor] Started cache in recovery mode [name=ignite-sys-cache, id=-2100569601, dataRegionName=sysMemPlc, mode=REPLICATED, atomicity=TRANSACTIONAL, backups=2147483647, mvcc=false] [21:09:22] : [Step 4/5] [2021-11-19 21:09:22,345][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=24.0 MiB, pages=5952, tableSize=474.2 KiB, replacementSize=768 B, checkpointBuffer=10.0 MiB] [21:09:22] : [Step 4/5] [2021-11-19 21:09:22,347][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][GridCacheProcessor] Started cache in recovery mode [name=encrypted, id=1613773252, dataRegionName=default, mode=PARTITIONED, atomicity=ATOMIC, backups=0, mvcc=false] [21:09:22] : [Step 4/5] [2021-11-19 21:09:22,349][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Binary recovery performed in 226 ms. [21:09:22] : [Step 4/5] [2021-11-19 21:09:22,349][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=/opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0/cp/1637345355303-8b3c27b4-824a-4551-b88a-fd54d348ce06-START.bin, endMarker=/opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0/cp/1637345355303-8b3c27b4-824a-4551-b88a-fd54d348ce06-END.bin] [21:09:22] : [Step 4/5] [2021-11-19 21:09:22,350][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Applying lost cache updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=83453, len=1963], lastCheckpointId=8b3c27b4-824a-4551-b88a-fd54d348ce06] [21:09:22] : [Step 4/5] [2021-11-19 21:09:22,419][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][GridEncryptionManager] Master key name loaded from WAL [masterKeyName=мастер.ключ.1] [21:09:22] : [Step 4/5] [2021-11-19 21:09:22,476][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:09:22] : [Step 4/5] [2021-11-19 21:09:22,807][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=56, time=454 ms] [21:09:22] : [Step 4/5] [2021-11-19 21:09:22,807][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][GridCacheProcessor] Restoring partition state for local groups. [21:09:22] : [Step 4/5] [2021-11-19 21:09:22,820][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=2, partitionsProcessed=1124, time=10ms] [21:09:23] : [Step 4/5] [2021-11-19 21:09:23,244][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][TestTcpDiscoverySpi] Successfully bound to TCP port [port=47500, localHost=localhost/127.0.0.1, locNodeId=00951441-9c23-4a84-8ea0-2300a5a74000] [21:09:23] : [Step 4/5] [2021-11-19 21:09:23,246][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][GridEncryptionManager] Sending stored group keys to coordinator [grps=1613773252] [21:09:23] : [Step 4/5] [2021-11-19 21:09:23,253][INFO ][tcp-disco-srvr-[:47501]-#940%grid-1%-#18018%grid-1%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=48389] [21:09:23] : [Step 4/5] [2021-11-19 21:09:23,253][INFO ][tcp-disco-srvr-[:47501]-#940%grid-1%-#18018%grid-1%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=48389] [21:09:23] : [Step 4/5] [2021-11-19 21:09:23,254][INFO ][tcp-disco-sock-reader-[]-#950%grid-1%-#18171%grid-1%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:48389, rmtPort=48389] [21:09:23] : [Step 4/5] [2021-11-19 21:09:23,255][INFO ][tcp-disco-sock-reader-[00951441 127.0.0.1:48389]-#950%grid-1%-#18171%grid-1%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=00951441-9c23-4a84-8ea0-2300a5a74000, rmtAddr=/127.0.0.1:48389] [21:09:23] : [Step 4/5] [2021-11-19 21:09:23,259][INFO ][tcp-disco-srvr-[:47500]-#949%grid-0%-#18170%grid-0%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=40699] [21:09:23] : [Step 4/5] [2021-11-19 21:09:23,260][INFO ][tcp-disco-srvr-[:47500]-#949%grid-0%-#18170%grid-0%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=40699] [21:09:23] : [Step 4/5] [2021-11-19 21:09:23,261][INFO ][tcp-disco-sock-reader-[]-#951%grid-0%-#18172%grid-0%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:40699, rmtPort=40699] [21:09:23] : [Step 4/5] [2021-11-19 21:09:23,261][INFO ][tcp-disco-sock-reader-[]-#951%grid-0%-#18172%grid-0%][TestTcpDiscoverySpi] Received ping request from the remote node [rmtNodeId=10cd437a-3510-4fa8-a8db-3d5c653f7001, rmtAddr=/127.0.0.1:40699, rmtPort=40699] [21:09:23] : [Step 4/5] [2021-11-19 21:09:23,262][INFO ][tcp-disco-sock-reader-[]-#951%grid-0%-#18172%grid-0%][TestTcpDiscoverySpi] Finished writing ping response [rmtNodeId=10cd437a-3510-4fa8-a8db-3d5c653f7001, rmtAddr=/127.0.0.1:40699, rmtPort=40699] [21:09:23] : [Step 4/5] [2021-11-19 21:09:23,263][INFO ][tcp-disco-sock-reader-[]-#951%grid-0%-#18172%grid-0%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:40699, rmtPort=40699, rmtNodeId=null] [21:09:23] : [Step 4/5] [2021-11-19 21:09:23,263][INFO ][tcp-disco-sock-reader-[00951441 127.0.0.1:48389]-#950%grid-1%-#18171%grid-1%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:48389, rmtPort=48389, rmtNodeId=00951441-9c23-4a84-8ea0-2300a5a74000] [21:09:23] : [Step 4/5] [2021-11-19 21:09:23,277][INFO ][tcp-disco-msg-worker-[crd]-#939%grid-1%-#18017%grid-1%][TestTcpDiscoverySpi] New next node [newNext=TcpDiscoveryNode [id=00951441-9c23-4a84-8ea0-2300a5a74000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=0, intOrder=3, lastExchangeTime=1637345363257, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false]] [21:09:23] : [Step 4/5] [2021-11-19 21:09:23,278][INFO ][tcp-disco-srvr-[:47500]-#949%grid-0%-#18170%grid-0%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=40803] [21:09:23] : [Step 4/5] [2021-11-19 21:09:23,278][INFO ][tcp-disco-srvr-[:47500]-#949%grid-0%-#18170%grid-0%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=40803] [21:09:23] : [Step 4/5] [2021-11-19 21:09:23,279][INFO ][tcp-disco-sock-reader-[]-#952%grid-0%-#18173%grid-0%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:40803, rmtPort=40803] [21:09:23] : [Step 4/5] [2021-11-19 21:09:23,280][INFO ][tcp-disco-sock-reader-[10cd437a 127.0.0.1:40803]-#952%grid-0%-#18173%grid-0%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=10cd437a-3510-4fa8-a8db-3d5c653f7001, rmtAddr=/127.0.0.1:40803] [21:09:23] : [Step 4/5] [2021-11-19 21:09:23,285][INFO ][tcp-disco-msg-worker-[]-#948%grid-0%-#18169%grid-0%][TestTcpDiscoverySpi] New next node [newNext=TcpDiscoveryNode [id=10cd437a-3510-4fa8-a8db-3d5c653f7001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637345363278, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false]] [21:09:23] : [Step 4/5] [2021-11-19 21:09:23,286][INFO ][tcp-disco-srvr-[:47501]-#940%grid-1%-#18018%grid-1%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=35537] [21:09:23] : [Step 4/5] [2021-11-19 21:09:23,287][INFO ][tcp-disco-srvr-[:47501]-#940%grid-1%-#18018%grid-1%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=35537] [21:09:23] : [Step 4/5] [2021-11-19 21:09:23,287][INFO ][tcp-disco-sock-reader-[]-#953%grid-1%-#18174%grid-1%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:35537, rmtPort=35537] [21:09:23] : [Step 4/5] [2021-11-19 21:09:23,288][INFO ][tcp-disco-sock-reader-[00951441 127.0.0.1:35537]-#953%grid-1%-#18174%grid-1%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=00951441-9c23-4a84-8ea0-2300a5a74000, rmtAddr=/127.0.0.1:35537] [21:09:23] : [Step 4/5] [2021-11-19 21:09:23,290][INFO ][disco-event-worker-#18024%grid-1%][GridDiscoveryManager] Added new node to topology: TcpDiscoveryNode [id=00951441-9c23-4a84-8ea0-2300a5a74000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=4, intOrder=3, lastExchangeTime=1637345363257, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false] [21:09:23] : [Step 4/5] [2021-11-19 21:09:23,291][INFO ][disco-event-worker-#18024%grid-1%][GridDiscoveryManager] Topology snapshot [ver=4, locNode=10cd437a, servers=2, clients=0, state=ACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=10cd437a-3510-4fa8-a8db-3d5c653f7001, consistentId=grid-1, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=00951441-9c23-4a84-8ea0-2300a5a74000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:09:23] : [Step 4/5] [2021-11-19 21:09:23,292][INFO ][disco-event-worker-#18024%grid-1%][GridDiscoveryManager] ^-- Baseline [id=0, size=2, online=2, offline=0] [21:09:23] : [Step 4/5] [2021-11-19 21:09:23,292][INFO ][exchange-worker-#18025%grid-1%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], crd=true, evt=NODE_JOINED, evtNode=00951441-9c23-4a84-8ea0-2300a5a74000, customEvt=null, allowMerge=true, exchangeFreeSwitch=false] [21:09:23] : [Step 4/5] [2021-11-19 21:09:23,293][INFO ][exchange-worker-#18025%grid-1%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], waitTime=0ms, futInfo=NA, mode=DISTRIBUTED] [21:09:23] : [Step 4/5] [2021-11-19 21:09:23,293][INFO ][exchange-worker-#18025%grid-1%][GridDhtPartitionsExchangeFuture] Finished waiting for partitions release latch: ServerLatch [permits=0, pendingAcks=HashSet [], super=CompletableLatch [id=CompletableLatchUid [id=exchange, topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0]]]] [21:09:23] : [Step 4/5] [2021-11-19 21:09:23,294][INFO ][exchange-worker-#18025%grid-1%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:09:23] : [Step 4/5] [2021-11-19 21:09:23,294][INFO ][tcp-disco-msg-worker-[10cd437a 127.0.0.1:47501]-#948%grid-0%-#18169%grid-0%][GridEncryptionManager] Skip group key received from coordinator. Already exists. [grp=1613773252, keyId=0] [21:09:23] : [Step 4/5] [2021-11-19 21:09:23,294][INFO ][exchange-worker-#18025%grid-1%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], crd=true] [21:09:23] : [Step 4/5] [2021-11-19 21:09:23,295][INFO ][disco-notifier-worker-#18168%grid-0%][MvccProcessorImpl] Assigned mvcc coordinator [crd=MvccCoordinator [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], nodeId=10cd437a-3510-4fa8-a8db-3d5c653f7001, ver=1637345353978, local=false, initialized=false]] [21:09:23] : [Step 4/5] [2021-11-19 21:09:23,297][INFO ][sys-#18163%grid-0%][ClusterProcessor] Writing cluster ID and tag to metastorage on ready for write ClusterIdAndTag [id=f85aeea1-b103-4552-bef2-3156987284dd, tag=competent_herschel] [21:09:23] : [Step 4/5] [2021-11-19 21:09:23,308][INFO ][exchange-worker-#18177%grid-0%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], crd=false, evt=NODE_JOINED, evtNode=00951441-9c23-4a84-8ea0-2300a5a74000, customEvt=null, allowMerge=true, exchangeFreeSwitch=false] [21:09:23] : [Step 4/5] [2021-11-19 21:09:23,309][INFO ][exchange-worker-#18177%grid-0%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0 [21:09:23] : [Step 4/5] [2021-11-19 21:09:23,310][INFO ][exchange-worker-#18177%grid-0%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000000.wal, offset=501520, ver=2] [21:09:23] : [Step 4/5] [2021-11-19 21:09:23,313][INFO ][exchange-worker-#18177%grid-0%][GridClusterStateProcessor] Writing BaselineTopology[id=0] [21:09:23] : [Step 4/5] [2021-11-19 21:09:23,316][INFO ][exchange-worker-#18177%grid-0%][GridCacheDatabaseSharedManager] Finish recovery performed in 7 ms. [21:09:23] : [Step 4/5] [2021-11-19 21:09:23,317][INFO ][exchange-worker-#18177%grid-0%][msg] Components activation performed in 8 ms. [21:09:23] : [Step 4/5] [2021-11-19 21:09:23,318][INFO ][exchange-worker-#18177%grid-0%][GridCacheProcessor] Finished recovery for cache [cache=ignite-sys-cache, grp=ignite-sys-cache, startVer=AffinityTopologyVersion [topVer=4, minorTopVer=0]] [21:09:23] : [Step 4/5] [2021-11-19 21:09:23,318][INFO ][sys-#18157%grid-0%][GridCacheProcessor] Finished recovery for cache [cache=encrypted, grp=encrypted, startVer=AffinityTopologyVersion [topVer=4, minorTopVer=0]] [21:09:23] : [Step 4/5] [2021-11-19 21:09:23,319][INFO ][exchange-worker-#18177%grid-0%][GridCacheProcessor] Starting caches on local join performed in 10 ms. [21:09:23] : [Step 4/5] [2021-11-19 21:09:23,320][INFO ][exchange-worker-#18177%grid-0%][GridDhtPartitionsExchangeFuture] Skipped waiting for partitions release future (local node is joining) [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0]] [21:09:23] : [Step 4/5] [2021-11-19 21:09:23,335][INFO ][grid-nio-worker-tcp-comm-1-#17961%TestRecordingCommunicationSpi%][TestRecordingCommunicationSpi] Accepted incoming communication connection [locAddr=/127.0.0.1:47101, rmtAddr=/127.0.0.1:35766] [21:09:23] : [Step 4/5] [2021-11-19 21:09:23,335][INFO ][db-checkpoint-thread-#18181%grid-0%][Checkpointer] Checkpoint started [checkpointId=12015216-a26e-4f0e-bdf1-a8a98c5e8719, startPtr=WALPointer [idx=0, fileOff=827052, len=3033], checkpointBeforeLockTime=5ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=5ms, walCpRecordFsyncDuration=1ms, writeCheckpointEntryDuration=2ms, splitAndSortCpPagesDuration=1ms, pages=583, reason='node started'] [21:09:23] : [Step 4/5] [2021-11-19 21:09:23,337][INFO ][grid-nio-worker-tcp-comm-0-#18111%TestRecordingCommunicationSpi%][TestRecordingCommunicationSpi] Established outgoing communication connection [locAddr=/127.0.0.1:35766, rmtAddr=/127.0.0.1:47101] [21:09:23] : [Step 4/5] [2021-11-19 21:09:23,337][INFO ][exchange-worker-#18177%grid-0%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], crd=false] [21:09:23] : [Step 4/5] [2021-11-19 21:09:23,339][INFO ][sys-#17998%grid-1%][GridDhtPartitionsExchangeFuture] Coordinator received single message [ver=AffinityTopologyVersion [topVer=4, minorTopVer=0], node=00951441-9c23-4a84-8ea0-2300a5a74000, allReceived=true] [21:09:23] : [Step 4/5] [2021-11-19 21:09:23,340][INFO ][sys-#17998%grid-1%][GridDhtPartitionsExchangeFuture] Coordinator received all messages, try merge [ver=AffinityTopologyVersion [topVer=4, minorTopVer=0]] [21:09:23] : [Step 4/5] [2021-11-19 21:09:23,341][INFO ][sys-#17998%grid-1%][GridDhtPartitionsExchangeFuture] finishExchangeOnCoordinator [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=0]] [21:09:23] : [Step 4/5] [2021-11-19 21:09:23,362][INFO ][sys-#17998%grid-1%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], err=null, rebalanced=false, wasRebalanced=true] [21:09:23] : [Step 4/5] [2021-11-19 21:09:23,364][INFO ][sys-#18149%grid-0%][GridDhtPartitionsExchangeFuture] Received full message, will finish exchange [node=10cd437a-3510-4fa8-a8db-3d5c653f7001, resVer=AffinityTopologyVersion [topVer=4, minorTopVer=0]] [21:09:23] : [Step 4/5] [2021-11-19 21:09:23,365][INFO ][sys-#17998%grid-1%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=10cd437a-3510-4fa8-a8db-3d5c653f7001, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], evt=NODE_JOINED, evtNode=TcpDiscoveryNode [id=00951441-9c23-4a84-8ea0-2300a5a74000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=4, intOrder=3, lastExchangeTime=1637345363257, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=false, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0]] [21:09:23] : [Step 4/5] [2021-11-19 21:09:23,366][INFO ][exchange-worker-#18025%grid-1%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=4, minorTopVer=0], force=false, evt=NODE_JOINED, node=00951441-9c23-4a84-8ea0-2300a5a74000] [21:09:23] : [Step 4/5] [2021-11-19 21:09:23,367][INFO ][sys-#17998%grid-1%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (0 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Wait partitions release latch [latch=exchange]" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="After states restored callback" (0 ms), stage="WAL history reservation" (0 ms), stage="Waiting for all single messages" (45 ms), stage="Exchanges merge" (1 ms), stage="Affinity recalculation (crd)" (8 ms), stage="Collect update counters and create affinity messages" (2 ms), stage="Assign partitions states" (4 ms), stage="Validate partitions states" (0 ms), stage="Apply update counters" (2 ms), stage="Full message preparing" (3 ms), stage="Full message sending" (0 ms), stage="Exchange done" (4 ms), stage="Total time" (69 ms), Discovery lag=4 ms, Latest started node id=00951441-9c23-4a84-8ea0-2300a5a74000] [21:09:23] : [Step 4/5] [2021-11-19 21:09:23,370][INFO ][sys-#17998%grid-1%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], stage="Affinity initialization (node join) [grp=encrypted, crd=true]" (6 ms) (parent=Affinity recalculation (crd)), stage="Affinity initialization (node join) [grp=ignite-sys-cache, crd=true]" (2 ms) (parent=Affinity recalculation (crd))] [21:09:23] : [Step 4/5] [2021-11-19 21:09:23,376][INFO ][exchange-worker-#18025%grid-1%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], crd=true, evt=DISCOVERY_CUSTOM_EVT, evtNode=10cd437a-3510-4fa8-a8db-3d5c653f7001, customEvt=CacheAffinityChangeMessage [id=63d6d593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], exchId=null, partsMsg=null, exchangeNeeded=true], allowMerge=false, exchangeFreeSwitch=false] [21:09:23] : [Step 4/5] [2021-11-19 21:09:23,377][INFO ][exchange-worker-#18025%grid-1%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], waitTime=0ms, futInfo=NA, mode=DISTRIBUTED] [21:09:23] : [Step 4/5] [2021-11-19 21:09:23,389][INFO ][sys-#18149%grid-0%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], err=null, rebalanced=false, wasRebalanced=false] [21:09:23] : [Step 4/5] [2021-11-19 21:09:23,393][INFO ][sys-#18149%grid-0%][GridCacheProcessor] Finish proxy initialization, cacheName=ignite-sys-cache, localNodeId=00951441-9c23-4a84-8ea0-2300a5a74000 [21:09:23] : [Step 4/5] [2021-11-19 21:09:23,393][INFO ][sys-#18149%grid-0%][GridCacheProcessor] Finish proxy initialization, cacheName=encrypted, localNodeId=00951441-9c23-4a84-8ea0-2300a5a74000 [21:09:23] : [Step 4/5] [2021-11-19 21:09:23,393][INFO ][sys-#18149%grid-0%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=00951441-9c23-4a84-8ea0-2300a5a74000, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], evt=NODE_JOINED, evtNode=TcpDiscoveryNode [id=00951441-9c23-4a84-8ea0-2300a5a74000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=4, intOrder=3, lastExchangeTime=1637345363369, loc=true, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=false, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0]] [21:09:23] : [Step 4/5] [2021-11-19 21:09:23,394][INFO ][exchange-worker-#18177%grid-0%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=4, minorTopVer=0], force=false, evt=NODE_JOINED, node=00951441-9c23-4a84-8ea0-2300a5a74000] [21:09:23] : [Step 4/5] [2021-11-19 21:09:23,395][INFO ][sys-#18149%grid-0%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], stage="Waiting in exchange queue" (12 ms), stage="Exchange parameters initialization" (0 ms), stage="Components activation" (8 ms), stage="Determine exchange type" (2 ms), stage="Preloading notification" (0 ms), stage="Restore partition states" (0 ms), stage="After states restored callback" (10 ms), stage="WAL history reservation" (0 ms), stage="Waiting for Full message" (33 ms), stage="Affinity recalculation" (19 ms), stage="Full map updating" (5 ms), stage="Exchange done" (5 ms), stage="Total time" (94 ms)] [21:09:23] : [Step 4/5] [2021-11-19 21:09:23,396][INFO ][exchange-worker-#18177%grid-0%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], crd=false, evt=DISCOVERY_CUSTOM_EVT, evtNode=10cd437a-3510-4fa8-a8db-3d5c653f7001, customEvt=CacheAffinityChangeMessage [id=63d6d593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], exchId=null, partsMsg=null, exchangeNeeded=true], allowMerge=false, exchangeFreeSwitch=false] [21:09:23] : [Step 4/5] [2021-11-19 21:09:23,397][INFO ][sys-#18149%grid-0%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], stage="Affinity fetch" (2 ms) (parent=Determine exchange type), stage="Restore partition states [grp=ignite-sys-cache]" (0 ms) (parent=Restore partition states), stage="Restore partition states [grp=encrypted]" (0 ms) (parent=Restore partition states), stage="Affinity initialization (local join) [grp=encrypted]" (19 ms) (parent=Affinity recalculation), stage="Affinity initialization (local join) [grp=ignite-sys-cache]" (1 ms) (parent=Affinity recalculation)] [21:09:23] : [Step 4/5] [2021-11-19 21:09:23,399][INFO ][exchange-worker-#18177%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], waitTime=0ms, futInfo=NA, mode=DISTRIBUTED] [21:09:23] : [Step 4/5] [2021-11-19 21:09:23,400][INFO ][exchange-worker-#18025%grid-1%][GridDhtPartitionsExchangeFuture] Finished waiting for partitions release latch: ServerLatch [permits=0, pendingAcks=HashSet [], super=CompletableLatch [id=CompletableLatchUid [id=exchange, topVer=AffinityTopologyVersion [topVer=4, minorTopVer=1]]]] [21:09:23] : [Step 4/5] [2021-11-19 21:09:23,401][INFO ][exchange-worker-#18177%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partitions release latch: ClientLatch [coordinator=TcpDiscoveryNode [id=10cd437a-3510-4fa8-a8db-3d5c653f7001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637345363278, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], ackSent=true, super=CompletableLatch [id=CompletableLatchUid [id=exchange, topVer=AffinityTopologyVersion [topVer=4, minorTopVer=1]]]] [21:09:23] : [Step 4/5] [2021-11-19 21:09:23,401][INFO ][exchange-worker-#18177%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:09:23] : [Step 4/5] [2021-11-19 21:09:23,401][INFO ][exchange-worker-#18025%grid-1%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:09:23] : [Step 4/5] [2021-11-19 21:09:23,403][INFO ][exchange-worker-#18025%grid-1%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], crd=true] [21:09:23] : [Step 4/5] [2021-11-19 21:09:23,403][INFO ][exchange-worker-#18177%grid-0%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], crd=false] [21:09:23] : [Step 4/5] [2021-11-19 21:09:23,404][INFO ][sys-#17994%grid-1%][GridDhtPartitionsExchangeFuture] Coordinator received single message [ver=AffinityTopologyVersion [topVer=4, minorTopVer=1], node=00951441-9c23-4a84-8ea0-2300a5a74000, allReceived=true] [21:09:23] : [Step 4/5] [2021-11-19 21:09:23,405][INFO ][sys-#17994%grid-1%][GridDhtPartitionsExchangeFuture] finishExchangeOnCoordinator [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=1]] [21:09:23] : [Step 4/5] [2021-11-19 21:09:23,409][INFO ][sys-#17994%grid-1%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], err=null, rebalanced=true, wasRebalanced=false] [21:09:23] : [Step 4/5] [2021-11-19 21:09:23,410][INFO ][sys-#18163%grid-0%][GridDhtPartitionsExchangeFuture] Received full message, will finish exchange [node=10cd437a-3510-4fa8-a8db-3d5c653f7001, resVer=AffinityTopologyVersion [topVer=4, minorTopVer=1]] [21:09:23] : [Step 4/5] [2021-11-19 21:09:23,411][INFO ][sys-#17994%grid-1%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=10cd437a-3510-4fa8-a8db-3d5c653f7001, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=10cd437a-3510-4fa8-a8db-3d5c653f7001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637345363369, loc=true, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=4, minorTopVer=1]] [21:09:23] : [Step 4/5] [2021-11-19 21:09:23,413][INFO ][sys-#18163%grid-0%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], err=null, rebalanced=true, wasRebalanced=false] [21:09:23] : [Step 4/5] [2021-11-19 21:09:23,411][INFO ][exchange-worker-#18025%grid-1%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=4, minorTopVer=1], force=false, evt=DISCOVERY_CUSTOM_EVT, node=10cd437a-3510-4fa8-a8db-3d5c653f7001] [21:09:23] : [Step 4/5] [2021-11-19 21:09:23,414][INFO ][sys-#18163%grid-0%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=00951441-9c23-4a84-8ea0-2300a5a74000, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=10cd437a-3510-4fa8-a8db-3d5c653f7001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637345363278, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=4, minorTopVer=1]] [21:09:23] : [Step 4/5] [2021-11-19 21:09:23,413][INFO ][sys-#17994%grid-1%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (0 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Wait partitions release latch [latch=exchange]" (23 ms), stage="Wait partitions release [latch=exchange]" (1 ms), stage="After states restored callback" (0 ms), stage="WAL history reservation" (0 ms), stage="Waiting for all single messages" (1 ms), stage="Affinity recalculation (crd)" (0 ms), stage="Collect update counters and create affinity messages" (0 ms), stage="Validate partitions states" (0 ms), stage="Apply update counters" (0 ms), stage="Full message preparing" (2 ms), stage="Full message sending" (0 ms), stage="Exchange done" (4 ms), stage="Total time" (31 ms), Discovery lag=1 ms, Latest started node id=00951441-9c23-4a84-8ea0-2300a5a74000] [21:09:23] : [Step 4/5] [2021-11-19 21:09:23,417][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] To start Console Management & Monitoring run ignitevisorcmd.{sh|bat} [21:09:23] : [Step 4/5] [2021-11-19 21:09:23,415][INFO ][sys-#18163%grid-0%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], stage="Waiting in exchange queue" (19 ms), stage="Exchange parameters initialization" (2 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (1 ms), stage="Wait partitions release latch [latch=exchange]" (1 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="After states restored callback" (0 ms), stage="WAL history reservation" (0 ms), stage="Waiting for Full message" (8 ms), stage="Affinity recalculation" (0 ms), stage="Full map updating" (2 ms), stage="Exchange done" (2 ms), stage="Total time" (35 ms)] [21:09:23] : [Step 4/5] [2021-11-19 21:09:23,415][INFO ][exchange-worker-#18177%grid-0%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=4, minorTopVer=1], force=false, evt=DISCOVERY_CUSTOM_EVT, node=10cd437a-3510-4fa8-a8db-3d5c653f7001] [21:09:23] : [Step 4/5] [2021-11-19 21:09:23,420][INFO ][sys-#18163%grid-0%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], stage="Affinity change by custom message [grp=ignite-sys-cache]" (0 ms) (parent=Determine exchange type)] [21:09:23] : [Step 4/5] [2021-11-19 21:09:23,419][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] [21:09:23] : [Step 4/5] [21:09:23] : [Step 4/5] >>> +-------------------------------------------+ [21:09:23] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:09:23] : [Step 4/5] >>> +-------------------------------------------+ [21:09:23] : [Step 4/5] >>> OS name: Linux 4.15.0-151-generic amd64 [21:09:23] : [Step 4/5] >>> CPU(s): 24 [21:09:23] : [Step 4/5] >>> Heap: 2.0GB [21:09:23] : [Step 4/5] >>> VM name: 16724@c4dfe9a430b2 [21:09:23] : [Step 4/5] >>> Ignite instance name: grid-0 [21:09:23] : [Step 4/5] >>> Local node [ID=00951441-9C23-4A84-8EA0-2300A5A74000, order=4, clientMode=false] [21:09:23] : [Step 4/5] >>> Local node addresses: [127.0.0.1] [21:09:23] : [Step 4/5] >>> Local ports: TCP:10800 TCP:47100 TCP:47500 [21:09:23] : [Step 4/5] [21:09:23] : [Step 4/5] [2021-11-19 21:09:23,418][INFO ][sys-#17994%grid-1%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], stage="Affinity change by custom message [grp=ignite-sys-cache]" (0 ms) (parent=Determine exchange type)] [21:09:23] : [Step 4/5] [2021-11-19 21:09:23,422][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][GridDiscoveryManager] Topology snapshot [ver=4, locNode=00951441, servers=2, clients=0, state=ACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=10cd437a-3510-4fa8-a8db-3d5c653f7001, consistentId=grid-1, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=00951441-9c23-4a84-8ea0-2300a5a74000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:09:23] : [Step 4/5] [2021-11-19 21:09:23,424][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][GridDiscoveryManager] ^-- Baseline [id=0, size=2, online=2, offline=0] [21:09:23] : [Step 4/5] [2021-11-19 21:09:23,424][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][G] Node started : [stage="Configure system pool" (0 ms),stage="Start managers" (251 ms),stage="Configure binary metadata" (2 ms),stage="Start processors" (20 ms),stage="Start 'StanByClusterTestProvider' plugin" (0 ms),stage="Start 'PageMemory tracker plugin' plugin" (0 ms),stage="Start 'TestDistibutedConfigurationPlugin' plugin" (0 ms),stage="Start 'NodeValidationPluginProvider' plugin" (0 ms),stage="Init metastore" (402 ms),stage="Init and start regions" (6 ms),stage="Restore binary memory" (226 ms),stage="Restore logical state" (471 ms),stage="Finish recovery" (422 ms),stage="Join topology" (52 ms),stage="Await transition" (2 ms),stage="Await exchange" (125 ms),stage="Total time" (1979 ms)] [21:09:23] : [Step 4/5] [2021-11-19 21:09:23,425][INFO ][test-runner-#17787%encryption.MasterKeyChangeTest%][root] Node started with the following configuration [id=00951441-9c23-4a84-8ea0-2300a5a74000, marshaller=BinaryMarshaller [], discovery=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=5000, ackTimeout=5000, marsh=JdkMarshaller [clsFilter=org.apache.ignite.marshaller.MarshallerUtils$1@74a0357b], reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], binaryCfg=null, lateAff=true] [21:09:23] : [Step 4/5] [2021-11-19 21:09:23,428][INFO ][exchange-worker-#18025%grid-1%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=2], crd=true, evt=DISCOVERY_CUSTOM_EVT, evtNode=10cd437a-3510-4fa8-a8db-3d5c653f7001, customEvt=DynamicCacheChangeBatch [id=74d6d593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqs=ArrayList [DynamicCacheChangeRequest [cacheName=encrypted, hasCfg=false, nodeId=10cd437a-3510-4fa8-a8db-3d5c653f7001, clientStartOnly=false, stop=false, destroy=false, disabledAfterStart=false]], exchangeActions=ExchangeActions [startCaches=null, stopCaches=null, startGrps=[], stopGrps=[], resetParts=[encrypted], stateChangeRequest=null], startCaches=false], allowMerge=false, exchangeFreeSwitch=false] [21:09:23] : [Step 4/5] [2021-11-19 21:09:23,428][INFO ][exchange-worker-#18177%grid-0%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=2], crd=false, evt=DISCOVERY_CUSTOM_EVT, evtNode=10cd437a-3510-4fa8-a8db-3d5c653f7001, customEvt=DynamicCacheChangeBatch [id=74d6d593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqs=ArrayList [DynamicCacheChangeRequest [cacheName=encrypted, hasCfg=false, nodeId=10cd437a-3510-4fa8-a8db-3d5c653f7001, clientStartOnly=false, stop=false, destroy=false, disabledAfterStart=false]], exchangeActions=ExchangeActions [startCaches=null, stopCaches=null, startGrps=[], stopGrps=[], resetParts=[encrypted], stateChangeRequest=null], startCaches=false], allowMerge=false, exchangeFreeSwitch=false] [21:09:23]W: [org.apache.ignite:ignite-core] [2021-11-19 21:09:23,430][WARN ][exchange-worker-#18025%grid-1%][CacheAffinitySharedManager] Cache group 'encrypted' brings high overhead for its metainformation in data region 'default'. Metainformation required for its partitions (522 partitions, 4096 bytes per partition, 2 MBs total) will consume more than 15% of data region memory (10 MBs). It may lead to critical errors on the node and cluster instability. Please reduce number of partitions, add more memory to the data region or add more server nodes for this cache group. [21:09:23]W: [org.apache.ignite:ignite-core] [2021-11-19 21:09:23,431][WARN ][sys-#18156%grid-0%][CacheAffinitySharedManager] Cache group 'encrypted' brings high overhead for its metainformation in data region 'default'. Metainformation required for its partitions (502 partitions, 4096 bytes per partition, 1 MBs total) will consume more than 15% of data region memory (10 MBs). It may lead to critical errors on the node and cluster instability. Please reduce number of partitions, add more memory to the data region or add more server nodes for this cache group. [21:09:23] : [Step 4/5] [2021-11-19 21:09:23,431][INFO ][exchange-worker-#18025%grid-1%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=2], waitTime=0ms, futInfo=NA, mode=DISTRIBUTED] [21:09:23] : [Step 4/5] [2021-11-19 21:09:23,432][INFO ][exchange-worker-#18177%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=2], waitTime=0ms, futInfo=NA, mode=DISTRIBUTED] [21:09:23] : [Step 4/5] [2021-11-19 21:09:23,517][INFO ][exchange-worker-#18025%grid-1%][GridDhtPartitionsExchangeFuture] Finished waiting for partitions release latch: ServerLatch [permits=0, pendingAcks=HashSet [], super=CompletableLatch [id=CompletableLatchUid [id=exchange, topVer=AffinityTopologyVersion [topVer=4, minorTopVer=2]]]] [21:09:23] : [Step 4/5] [2021-11-19 21:09:23,517][INFO ][exchange-worker-#18177%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partitions release latch: ClientLatch [coordinator=TcpDiscoveryNode [id=10cd437a-3510-4fa8-a8db-3d5c653f7001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637345363278, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], ackSent=true, super=CompletableLatch [id=CompletableLatchUid [id=exchange, topVer=AffinityTopologyVersion [topVer=4, minorTopVer=2]]]] [21:09:23] : [Step 4/5] [2021-11-19 21:09:23,518][INFO ][exchange-worker-#18025%grid-1%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=2], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:09:23] : [Step 4/5] [2021-11-19 21:09:23,518][INFO ][exchange-worker-#18177%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=2], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:09:23] : [Step 4/5] [2021-11-19 21:09:23,520][INFO ][exchange-worker-#18025%grid-1%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=2], crd=true] [21:09:23] : [Step 4/5] [2021-11-19 21:09:23,522][INFO ][exchange-worker-#18177%grid-0%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=2], crd=false] [21:09:23] : [Step 4/5] [2021-11-19 21:09:23,523][INFO ][sys-#18005%grid-1%][GridDhtPartitionsExchangeFuture] Coordinator received single message [ver=AffinityTopologyVersion [topVer=4, minorTopVer=2], node=00951441-9c23-4a84-8ea0-2300a5a74000, allReceived=true] [21:09:23] : [Step 4/5] [2021-11-19 21:09:23,523][INFO ][sys-#18005%grid-1%][GridDhtPartitionsExchangeFuture] finishExchangeOnCoordinator [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=2]] [21:09:23] : [Step 4/5] [2021-11-19 21:09:23,532][INFO ][sys-#18005%grid-1%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=4, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=2], err=null, rebalanced=true, wasRebalanced=true] [21:09:23] : [Step 4/5] [2021-11-19 21:09:23,533][INFO ][sys-#18158%grid-0%][GridDhtPartitionsExchangeFuture] Received full message, will finish exchange [node=10cd437a-3510-4fa8-a8db-3d5c653f7001, resVer=AffinityTopologyVersion [topVer=4, minorTopVer=2]] [21:09:23] : [Step 4/5] [2021-11-19 21:09:23,534][INFO ][sys-#18005%grid-1%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=10cd437a-3510-4fa8-a8db-3d5c653f7001, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=2], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=10cd437a-3510-4fa8-a8db-3d5c653f7001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637345363419, loc=true, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=4, minorTopVer=2]] [21:09:23] : [Step 4/5] [2021-11-19 21:09:23,535][INFO ][sys-#18158%grid-0%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=4, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=2], err=null, rebalanced=true, wasRebalanced=true] [21:09:23] : [Step 4/5] [2021-11-19 21:09:23,534][INFO ][exchange-worker-#18025%grid-1%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=4, minorTopVer=2], force=false, evt=DISCOVERY_CUSTOM_EVT, node=10cd437a-3510-4fa8-a8db-3d5c653f7001] [21:09:23] : [Step 4/5] [2021-11-19 21:09:23,535][INFO ][sys-#18005%grid-1%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=4, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=2], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (1 ms), stage="Update caches registry" (0 ms), stage="Start caches" (0 ms), stage="Affinity initialization on cache group start" (0 ms), stage="Determine exchange type" (1 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (85 ms), stage="Wait partitions release latch [latch=exchange]" (1 ms), stage="Wait partitions release [latch=exchange]" (1 ms), stage="After states restored callback" (1 ms), stage="WAL history reservation" (0 ms), stage="Waiting for all single messages" (3 ms), stage="Affinity recalculation (crd)" (0 ms), stage="Collect update counters and create affinity messages" (0 ms), stage="Assign partitions states" (1 ms), stage="Validate partitions states" (0 ms), stage="Ideal affinity diff calculation (enforced)" (3 ms), stage="Apply update counters" (0 ms), stage="Full message preparing" (2 ms), stage="Full message sending" (0 ms), stage="Exchange done" (3 ms), stage="Total time" (102 ms)] [21:09:23] : [Step 4/5] [2021-11-19 21:09:23,540][INFO ][sys-#18005%grid-1%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=4, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=2], stage="Affinity centralized initialization (crd) [grp=ignite-sys-cache, crd=true]" (0 ms) (parent=Determine exchange type), stage="Affinity centralized initialization (crd) [grp=encrypted, crd=true]" (0 ms) (parent=Determine exchange type), stage="Affinity recalculation (partitions availability) [grp=encrypted]" (3 ms) (parent=Ideal affinity diff calculation (enforced)), stage="Affinity recalculation (partitions availability) [grp=ignite-sys-cache]" (0 ms) (parent=Ideal affinity diff calculation (enforced))] [21:09:23] : [Step 4/5] [2021-11-19 21:09:23,540][INFO ][exchange-worker-#18177%grid-0%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=4, minorTopVer=2], force=false, evt=DISCOVERY_CUSTOM_EVT, node=10cd437a-3510-4fa8-a8db-3d5c653f7001] [21:09:23] : [Step 4/5] [2021-11-19 21:09:23,537][INFO ][sys-#18158%grid-0%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=00951441-9c23-4a84-8ea0-2300a5a74000, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=2], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=10cd437a-3510-4fa8-a8db-3d5c653f7001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637345363278, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=4, minorTopVer=2]] [21:09:23] : [Step 4/5] [2021-11-19 21:09:23,543][INFO ][sys-#18158%grid-0%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=4, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=2], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (1 ms), stage="Update caches registry" (0 ms), stage="Start caches" (0 ms), stage="Affinity initialization on cache group start" (0 ms), stage="Determine exchange type" (1 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (84 ms), stage="Wait partitions release latch [latch=exchange]" (1 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="After states restored callback" (0 ms), stage="WAL history reservation" (0 ms), stage="Waiting for Full message" (12 ms), stage="Affinity recalculation" (1 ms), stage="Full map updating" (0 ms), stage="Exchange done" (8 ms), stage="Total time" (108 ms)] [21:09:23] : [Step 4/5] [2021-11-19 21:09:23,545][INFO ][sys-#18158%grid-0%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=4, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=2], stage="Affinity centralized initialization (crd) [grp=ignite-sys-cache, crd=false]" (0 ms) (parent=Determine exchange type), stage="Affinity centralized initialization (crd) [grp=encrypted, crd=false]" (0 ms) (parent=Determine exchange type), stage="Affinity applying from full message [grp=encrypted]" (1 ms) (parent=Affinity recalculation), stage="Affinity applying from full message [grp=ignite-sys-cache]" (0 ms) (parent=Affinity recalculation)] [21:09:23] : [Step 4/5] [21:09:23] >>> Stopping test: MasterKeyChangeTest#testMultiByteMasterKeyNameWalRecovery in 10766 ms <<< [21:09:23] : [Step 4/5] [2021-11-19 21:09:23,567][INFO ][main][root] >>> Stopping test: MasterKeyChangeTest#testMultiByteMasterKeyNameWalRecovery in 10766 ms <<< [21:09:23] : [Step 4/5] [21:09:23] >>> Heap: 286 MB used / 1926 MB commited / 1926 MB max <<< [21:09:23] : [Step 4/5] [2021-11-19 21:09:23,568][INFO ][main][root] >>> Heap: 286 MB used / 1926 MB commited / 1926 MB max <<< [21:09:23] : [Step 4/5] [21:09:23] >>> Non-Heap: 150 MB used / 179 MB commited / 0 MB max <<< [21:09:23] : [Step 4/5] [2021-11-19 21:09:23,568][INFO ][main][root] >>> Non-Heap: 150 MB used / 179 MB commited / 0 MB max <<< [21:09:23] : [Step 4/5] [21:09:23] >>> Starting test: MasterKeyChangeTest#testClusterRestart <<< [21:09:23] : [Step 4/5] [2021-11-19 21:09:23,569][INFO ][main][root] >>> Starting test: MasterKeyChangeTest#testClusterRestart <<< [21:09:23] : [Step 4/5] [21:09:23] >>> Heap: 286 MB used / 1926 MB commited / 1926 MB max <<< [21:09:23] : [Step 4/5] [2021-11-19 21:09:23,569][INFO ][main][root] >>> Heap: 286 MB used / 1926 MB commited / 1926 MB max <<< [21:09:23] : [Step 4/5] [21:09:23] >>> Non-Heap: 150 MB used / 179 MB commited / 0 MB max <<< [21:09:23] : [Step 4/5] [2021-11-19 21:09:23,569][INFO ][main][root] >>> Non-Heap: 150 MB used / 179 MB commited / 0 MB max <<< [21:09:23] : [Step 4/5] [2021-11-19 21:09:23,569][INFO ][main][root] >>> Stopping grid [name=grid-1, id=10cd437a-3510-4fa8-a8db-3d5c653f7001] [21:09:23] : [Step 4/5] [2021-11-19 21:09:23,789][INFO ][db-checkpoint-thread-#18035%grid-1%][Checkpointer] Checkpoint started [checkpointId=56a669cc-0950-4cd9-aa53-c5be03f169af, startPtr=WALPointer [idx=0, fileOff=642835, len=11871], checkpointBeforeLockTime=4ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=198ms, writeCheckpointEntryDuration=10ms, splitAndSortCpPagesDuration=1ms, pages=455, reason='timeout'] [21:09:23] : [Step 4/5] [2021-11-19 21:09:23,796][INFO ][tcp-disco-sock-reader-[00951441 127.0.0.1:35537]-#953%grid-1%-#18174%grid-1%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:35537, rmtPort=35537, rmtNodeId=00951441-9c23-4a84-8ea0-2300a5a74000] [21:09:23] : [Step 4/5] [2021-11-19 21:09:23,797][INFO ][disco-event-worker-#18176%grid-0%][GridDiscoveryManager] Node left topology: TcpDiscoveryNode [id=10cd437a-3510-4fa8-a8db-3d5c653f7001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637345363278, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false] [21:09:23]W: [org.apache.ignite:ignite-core] [2021-11-19 21:09:23,796][WARN ][tcp-disco-sock-reader-[00b43dc9 127.0.0.1:59593]-#943%grid-1%-#18021%grid-1%][TestTcpDiscoverySpi] Failed to shutdown socket [21:09:23]W: [org.apache.ignite:ignite-core] java.net.SocketException: Socket output is already shutdown [21:09:23]W: [org.apache.ignite:ignite-core] at java.net.Socket.shutdownOutput(Socket.java:1572) [21:09:23]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.close(IgniteUtils.java:4247) [21:09:23]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.discovery.tcp.ServerImpl$SocketReader.body(ServerImpl.java:7370) [21:09:23]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.IgniteSpiThread.run(IgniteSpiThread.java:58) [21:09:23] : [Step 4/5] [2021-11-19 21:09:23,800][INFO ][tcp-disco-sock-reader-[00b43dc9 127.0.0.1:59593]-#943%grid-1%-#18021%grid-1%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:59593, rmtPort=59593, rmtNodeId=00b43dc9-2985-4f86-98d3-95505e291000] [21:09:23] : [Step 4/5] [2021-11-19 21:09:23,799][INFO ][disco-event-worker-#18176%grid-0%][GridDiscoveryManager] Topology snapshot [ver=5, locNode=00951441, servers=1, clients=0, state=ACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=00951441-9c23-4a84-8ea0-2300a5a74000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:09:23] : [Step 4/5] [2021-11-19 21:09:23,802][INFO ][disco-event-worker-#18176%grid-0%][GridDiscoveryManager] Coordinator changed [prev=TcpDiscoveryNode [id=10cd437a-3510-4fa8-a8db-3d5c653f7001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637345363278, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], cur=TcpDiscoveryNode [id=00951441-9c23-4a84-8ea0-2300a5a74000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=4, intOrder=3, lastExchangeTime=1637345363793, loc=true, ver=2.13.0#20211119-sha1:00000000, isClient=false]] [21:09:23] : [Step 4/5] [2021-11-19 21:09:23,804][INFO ][disco-event-worker-#18176%grid-0%][GridDiscoveryManager] ^-- Baseline [id=0, size=2, online=1, offline=1] [21:09:23] : [Step 4/5] [2021-11-19 21:09:23,803][INFO ][main][GridCacheProcessor] Stopped cache [cacheName=ignite-sys-cache] [21:09:23] : [Step 4/5] [2021-11-19 21:09:23,805][INFO ][main][GridCacheProcessor] Stopped cache [cacheName=encrypted] [21:09:23] : [Step 4/5] [2021-11-19 21:09:23,805][INFO ][disco-event-worker-#18176%grid-0%][MvccProcessorImpl] Assigned mvcc coordinator [crd=MvccCoordinator [topVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], nodeId=00951441-9c23-4a84-8ea0-2300a5a74000, ver=1637345353980, local=true, initialized=false]] [21:09:23]W: [org.apache.ignite:ignite-core] [2021-11-19 21:09:23,806][WARN ][grid-nio-worker-tcp-comm-1-#17961%TestRecordingCommunicationSpi%][TestRecordingCommunicationSpi] Failed to shutdown socket [21:09:23]W: [org.apache.ignite:ignite-core] java.nio.channels.ClosedChannelException [21:09:23]W: [org.apache.ignite:ignite-core] at sun.nio.ch.SocketChannelImpl.shutdownOutput(SocketChannelImpl.java:795) [21:09:23]W: [org.apache.ignite:ignite-core] at sun.nio.ch.SocketAdaptor.shutdownOutput(SocketAdaptor.java:407) [21:09:23]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.close(IgniteUtils.java:4247) [21:09:23]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.closeKey(GridNioServer.java:2784) [21:09:23]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.close(GridNioServer.java:2835) [21:09:23]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.close(GridNioServer.java:2794) [21:09:23]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$DirectNioClientWorker.processRead(GridNioServer.java:1357) [21:09:23]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.processSelectedKeysOptimized(GridNioServer.java:2508) [21:09:23]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.bodyInternal(GridNioServer.java:2273) [21:09:23]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.body(GridNioServer.java:1910) [21:09:23]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:125) [21:09:23]W: [org.apache.ignite:ignite-core] at java.lang.Thread.run(Thread.java:748) [21:09:23] : [Step 4/5] [2021-11-19 21:09:23,808][INFO ][exchange-worker-#18177%grid-0%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], crd=true, evt=NODE_LEFT, evtNode=10cd437a-3510-4fa8-a8db-3d5c653f7001, customEvt=null, allowMerge=false, exchangeFreeSwitch=true] [21:09:23] : [Step 4/5] [2021-11-19 21:09:23,808][INFO ][sys-#18144%grid-0%][ExchangeLatchManager] Become new coordinator 00951441-9c23-4a84-8ea0-2300a5a74000 [21:09:23] : [Step 4/5] [2021-11-19 21:09:23,810][INFO ][sys-#18146%grid-0%][GridAffinityAssignmentCache] Local node affinity assignment distribution is not ideal [cache=encrypted, expectedPrimary=1024.00, actualPrimary=502, expectedBackups=0.00, actualBackups=0, warningThreshold=50.00%] [21:09:23] : [Step 4/5] [2021-11-19 21:09:23,811][INFO ][exchange-worker-#18177%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:09:23] : [Step 4/5] [2021-11-19 21:09:23,812][INFO ][exchange-worker-#18177%grid-0%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], err=null, rebalanced=true, wasRebalanced=true] [21:09:23]W: [org.apache.ignite:ignite-core] [2021-11-19 21:09:23,814][WARN ][sys-#18145%grid-0%][GridDhtPartitionTopologyImpl] Detected lost partitions [grp=encrypted, parts=[0, 2, 4, 6-7, 10-11, 14, 17, 21, 24-30, 32, 37, 40, 44, 47-52, 54, 57, 59, 62-64, 67-68, 74-75, 78, 81, 87-88, 91, 97, 99, 101-102, 104-107, 113-114, 116, 118, 120, 122, 124, 135-136, 138, 140-145, 147, 149-152, 154-156, 159-160, 162-164, 169, 172, 175-177, 180, 184-187, 190-191, 194, 196-202, 204-205, 209-210, 212, 214, 216, 219-224, 226, 229-232, 237, 239, 241, 243-245, 247, 249-251, 255, 257, 261, 265, 269, 272-273, 276-277, 281-282, 285, 287, 289-291, 293-297, 299, 301-304, 306, 308-309, 311-312, 315-317, 319, 322, 325-326, 328-330, 336, 339, 341, 344-346, 350, 352-354, 357-361, 363, 366-367, 371-373, 376-380, 383, 385, 387-388, 390, 392, 395-397, 400, 402, 405, 408-411, 416, 420, 422, 424-425, 429, 433, 435-438, 440-441, 445-446, 450, 452-453, 455-456, 458, 460, 462-463, 465-468, 470, 474-475, 480, 488, 490-492, 495, 497, 499-512, 516, 525, 527-531, 535, 537-538, 541-542, 545-546, 548-552, 554-555, 558, 562-564, 567-569, 572, 574, 579-580, 582-585, 587, 590-591, 594, 596, 600, 602, 604, 607-614, 617-620, 623-624, 627-629, 632-633, 636, 638, 640-642, 645-646, 648-649, 657-662, 664-665, 668-672, 677-678, 682-684, 686, 689, 692-693, 695-697, 699, 706-707, 709-710, 712-714, 716-717, 719-721, 723-728, 730-732, 734-735, 739, 742, 746, 749-750, 752, 754, 756, 762, 768-770, 772-775, 778, 780, 783-787, 789-791, 793, 796, 798-801, 803, 806, 809-812, 814, 816-817, 819, 822-825, 827-829, 832-833, 836-837, 839-840, 846, 848-851, 853-854, 857-858, 860, 863-864, 866, 868-871, 873-875, 877-878, 884, 888-889, 896-897, 900, 905-907, 914-915, 917, 919-920, 923-925, 931-933, 936, 940, 942, 944-945, 948, 950-951, 954, 956-958, 962, 965-970, 972, 975-976, 978-980, 983, 985, 988, 990, 993-994, 997-998, 1000, 1003-1004, 1007, 1009, 1014, 1016, 1018-1019], topVer=AffinityTopologyVersion [topVer=5, minorTopVer=0]] [21:09:23] : [Step 4/5] [2021-11-19 21:09:23,819][INFO ][exchange-worker-#18177%grid-0%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=00951441-9c23-4a84-8ea0-2300a5a74000, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], evt=NODE_LEFT, evtNode=TcpDiscoveryNode [id=10cd437a-3510-4fa8-a8db-3d5c653f7001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637345363278, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=5, minorTopVer=0]] [21:09:23] : [Step 4/5] [2021-11-19 21:09:23,820][INFO ][exchange-worker-#18177%grid-0%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (1 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="After states restored callback" (0 ms), stage="WAL history reservation" (0 ms), stage="Finalize update counters" (0 ms), stage="Detect lost partitions" (6 ms), stage="Exchange done" (1 ms), stage="Total time" (8 ms)] [21:09:23] : [Step 4/5] [2021-11-19 21:09:23,820][INFO ][exchange-worker-#18177%grid-0%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], stage="Affinity initialization (exchange-free switch on fully-rebalanced topology) [grp=ignite-sys-cache]" (0 ms) (parent=Determine exchange type), stage="Affinity initialization (exchange-free switch on fully-rebalanced topology) [grp=encrypted]" (0 ms) (parent=Determine exchange type)] [21:09:23] : [Step 4/5] [2021-11-19 21:09:23,821][INFO ][exchange-worker-#18177%grid-0%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], crd=true] [21:09:23] : [Step 4/5] [2021-11-19 21:09:23,822][INFO ][exchange-worker-#18177%grid-0%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=5, minorTopVer=0], force=false, evt=NODE_LEFT, node=10cd437a-3510-4fa8-a8db-3d5c653f7001] [21:09:24] : [Step 4/5] [2021-11-19 21:09:24,989][INFO ][main][FilePageStoreManager] Cleanup cache stores [total=4, left=0, cleanFiles=false] [21:09:24] : [Step 4/5] [2021-11-19 21:09:24,992][INFO ][main][GridDeploymentLocalStore] Removed undeployed class: GridDeployment [ts=1637345355313, depMode=SHARED, clsLdr=IsolatedClassLoader{roleName='test'}, clsLdrId=ebb6d593d71-10cd437a-3510-4fa8-a8db-3d5c653f7001, userVer=0, loc=true, sampleClsName=org.apache.ignite.internal.processors.cache.distributed.dht.preloader.IgniteDhtPartitionHistorySuppliersMap, pendingUndeploy=false, undeployed=true, usage=0] [21:09:24] : [Step 4/5] [2021-11-19 21:09:24,999][INFO ][main][IgniteKernal%grid-1] [21:09:24] : [Step 4/5] [21:09:24] : [Step 4/5] >>> +------------------------------------------------------+ [21:09:25] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV stopped OK [21:09:25] : [Step 4/5] >>> +------------------------------------------------------+ [21:09:25] : [Step 4/5] >>> Ignite instance name: grid-1 [21:09:25] : [Step 4/5] >>> Grid uptime: 00:00:09.735 [21:09:25] : [Step 4/5] [21:09:25] : [Step 4/5] [21:09:25] : [Step 4/5] [2021-11-19 21:09:25,000][INFO ][main][root] >>> Stopping grid [name=grid-0, id=00951441-9c23-4a84-8ea0-2300a5a74000] [21:09:25] : [Step 4/5] [2021-11-19 21:09:25,006][INFO ][db-checkpoint-thread-#18181%grid-0%][Checkpointer] Checkpoint finished [cpId=12015216-a26e-4f0e-bdf1-a8a98c5e8719, pages=583, markPos=WALPointer [idx=0, fileOff=827052, len=3033], walSegmentsCovered=[], markDuration=11ms, pagesWrite=43ms, fsync=1626ms, total=1685ms] [21:09:25]W: [org.apache.ignite:ignite-core] [2021-11-19 21:09:25,010][WARN ][tcp-disco-sock-reader-[10cd437a 127.0.0.1:40803]-#952%grid-0%-#18173%grid-0%][TestTcpDiscoverySpi] Failed to shutdown socket [21:09:25]W: [org.apache.ignite:ignite-core] java.net.SocketException: Socket is closed [21:09:25]W: [org.apache.ignite:ignite-core] at java.net.Socket.shutdownOutput(Socket.java:1568) [21:09:25]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.close(IgniteUtils.java:4247) [21:09:25]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.discovery.tcp.ServerImpl$SocketReader.body(ServerImpl.java:7370) [21:09:25]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.IgniteSpiThread.run(IgniteSpiThread.java:58) [21:09:25] : [Step 4/5] [2021-11-19 21:09:25,010][INFO ][tcp-disco-sock-reader-[10cd437a 127.0.0.1:40803]-#952%grid-0%-#18173%grid-0%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:40803, rmtPort=40803, rmtNodeId=10cd437a-3510-4fa8-a8db-3d5c653f7001] [21:09:25] : [Step 4/5] [2021-11-19 21:09:25,016][INFO ][main][GridCacheProcessor] Stopped cache [cacheName=encrypted] [21:09:25] : [Step 4/5] [2021-11-19 21:09:25,017][INFO ][main][GridCacheProcessor] Stopped cache [cacheName=ignite-sys-cache] [21:09:25] : [Step 4/5] [2021-11-19 21:09:25,025][INFO ][main][FilePageStoreManager] Cleanup cache stores [total=4, left=0, cleanFiles=false] [21:09:25] : [Step 4/5] [2021-11-19 21:09:25,026][INFO ][main][GridDeploymentLocalStore] Removed undeployed class: GridDeployment [ts=1637345363359, depMode=SHARED, clsLdr=IsolatedClassLoader{roleName='test'}, clsLdrId=43d6d593d71-00951441-9c23-4a84-8ea0-2300a5a74000, userVer=0, loc=true, sampleClsName=org.apache.ignite.internal.processors.cache.distributed.dht.preloader.IgniteDhtPartitionsToReloadMap, pendingUndeploy=false, undeployed=true, usage=0] [21:09:25] : [Step 4/5] [2021-11-19 21:09:25,034][INFO ][main][IgniteKernal%grid-0] [21:09:25] : [Step 4/5] [21:09:25] : [Step 4/5] >>> +------------------------------------------------------+ [21:09:25] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV stopped OK [21:09:25] : [Step 4/5] >>> +------------------------------------------------------+ [21:09:25] : [Step 4/5] >>> Ignite instance name: grid-0 [21:09:25] : [Step 4/5] >>> Grid uptime: 00:00:01.616 [21:09:25] : [Step 4/5] [21:09:25] : [Step 4/5] [21:09:25]W: [org.apache.ignite:ignite-core] [2021-11-19 21:09:25,325][WARN ][test-runner-#18198%encryption.MasterKeyChangeTest%][G] Ignite work directory is not provided, automatically resolved to: /opt/buildagent/work/7bc1c54bc719b67c/work [21:09:25] : [Step 4/5] [2021-11-19 21:09:25,327][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] [21:09:25] : [Step 4/5] [21:09:25] : [Step 4/5] >>> __________ ________________ [21:09:25] : [Step 4/5] >>> / _/ ___/ |/ / _/_ __/ __/ [21:09:25] : [Step 4/5] >>> _/ // (7 7 // / / / / _/ [21:09:25] : [Step 4/5] >>> /___/\___/_/|_/___/ /_/ /___/ [21:09:25] : [Step 4/5] >>> [21:09:25] : [Step 4/5] >>> ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:09:25] : [Step 4/5] >>> 2021 Copyright(C) Apache Software Foundation [21:09:25] : [Step 4/5] >>> [21:09:25] : [Step 4/5] >>> Ignite documentation: http://ignite.apache.org [21:09:25] : [Step 4/5] [21:09:25] : [Step 4/5] [2021-11-19 21:09:25,328][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] Config URL: n/a [21:09:25] : [Step 4/5] [2021-11-19 21:09:25,328][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] IgniteConfiguration [igniteInstanceName=grid-0, pubPoolSize=24, svcPoolSize=24, callbackPoolSize=24, stripedPoolSize=24, sysPoolSize=24, mgmtPoolSize=4, dataStreamerPoolSize=24, utilityCachePoolSize=24, utilityCacheKeepAliveTime=60000, p2pPoolSize=2, qryPoolSize=24, buildIdxPoolSize=4, igniteHome=/opt/buildagent/work/7bc1c54bc719b67c, igniteWorkDir=/opt/buildagent/work/7bc1c54bc719b67c/work, mbeanSrv=com.sun.jmx.mbeanserver.JmxMBeanServer@6fe85038, nodeId=0013589e-122f-4d50-8c70-af3d127be000, marsh=BinaryMarshaller [], marshLocJobs=false, daemon=false, p2pEnabled=true, netTimeout=10000, netCompressionLevel=1, sndRetryDelay=1000, sndRetryCnt=3, metricsHistSize=10000, metricsUpdateFreq=1000, metricsExpTime=9223372036854775807, discoSpi=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=0, ackTimeout=0, marsh=null, reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], segPlc=STOP, segResolveAttempts=2, waitForSegOnStart=true, allResolversPassReq=true, segChkFreq=10000, commSpi=TcpCommunicationSpi [connectGate=org.apache.ignite.spi.communication.tcp.internal.ConnectGateway@7c3f127c, ctxInitLatch=java.util.concurrent.CountDownLatch@21b34c8d[Count = 1], stopping=false, clientPool=null, nioSrvWrapper=null, stateProvider=null], evtSpi=MemoryEventStorageSpi [expireAgeMs=9223372036854775807, expireCnt=10000, filter=null], colSpi=NoopCollisionSpi [], deploySpi=LocalDeploymentSpi [], indexingSpi=org.apache.ignite.spi.indexing.noop.NoopIndexingSpi@664d0c4, addrRslvr=null, encryptionSpi=org.apache.ignite.spi.encryption.keystore.KeystoreEncryptionSpi@698c2b73, tracingSpi=org.apache.ignite.spi.tracing.NoopTracingSpi@53fd2079, clientMode=false, rebalanceThreadPoolSize=4, rebalanceTimeout=10000, rebalanceBatchesPrefetchCnt=3, rebalanceThrottle=0, rebalanceBatchSize=524288, txCfg=TransactionConfiguration [txSerEnabled=false, dfltIsolation=REPEATABLE_READ, dfltConcurrency=PESSIMISTIC, dfltTxTimeout=0, txTimeoutOnPartitionMapExchange=0, deadlockTimeout=10000, pessimisticTxLogSize=0, pessimisticTxLogLinger=10000, tmLookupClsName=null, txManagerFactory=null, useJtaSync=false], cacheSanityCheckEnabled=true, discoStartupDelay=60000, deployMode=SHARED, p2pMissedCacheSize=100, locHost=127.0.0.1, timeSrvPortBase=31100, timeSrvPortRange=100, failureDetectionTimeout=10000, sysWorkerBlockedTimeout=null, clientFailureDetectionTimeout=10000, metricsLogFreq=0, connectorCfg=null, odbcCfg=null, warmupClos=null, atomicCfg=AtomicConfiguration [seqReserveSize=1000, cacheMode=PARTITIONED, backups=1, aff=null, grpName=null], classLdr=null, sslCtxFactory=null, platformCfg=null, binaryCfg=null, memCfg=null, pstCfg=null, dsCfg=DataStorageConfiguration [sysRegionInitSize=41943040, sysRegionMaxSize=104857600, pageSize=4096, concLvl=0, dfltDataRegConf=DataRegionConfiguration [name=default, maxSize=10485760, initSize=268435456, swapPath=null, pageEvictionMode=DISABLED, pageReplacementMode=CLOCK, evictionThreshold=0.9, emptyPagesPoolSize=100, metricsEnabled=false, metricsSubIntervalCount=5, metricsRateTimeInterval=60000, persistenceEnabled=true, checkpointPageBufSize=0, lazyMemoryAllocation=true, warmUpCfg=null], dataRegions=null, storagePath=null, checkpointFreq=180000, lockWaitTime=10000, checkpointThreads=4, checkpointWriteOrder=SEQUENTIAL, walHistSize=20, maxWalArchiveSize=1073741824, walSegments=10, walSegmentSize=67108864, walPath=db/wal, walArchivePath=db/wal/archive, cdcWalPath=db/wal/cdc, cdcEnabled=false, metricsEnabled=false, walMode=FSYNC, walTlbSize=131072, walBuffSize=0, walFlushFreq=2000, walFsyncDelay=1000, walRecordIterBuffSize=67108864, alwaysWriteFullPages=false, fileIOFactory=org.apache.ignite.internal.processors.cache.persistence.file.AsyncFileIOFactory@1f094f03, metricsSubIntervalCnt=5, metricsRateTimeInterval=60000, walAutoArchiveAfterInactivity=-1, walForceArchiveTimeout=-1, writeThrottlingEnabled=false, walCompactionEnabled=false, walCompactionLevel=1, checkpointReadLockTimeout=null, walPageCompression=DISABLED, walPageCompressionLevel=null, dfltWarmUpCfg=null, encCfg=org.apache.ignite.configuration.EncryptionConfiguration@1757967b, defragmentationThreadPoolSize=4, minWalArchiveSize=-1], snapshotPath=snapshots, activeOnStart=true, activeOnStartPropSetFlag=false, autoActivation=true, autoActivationPropSetFlag=false, clusterStateOnStart=null, sqlConnCfg=null, cliConnCfg=ClientConnectorConfiguration [host=null, port=10800, portRange=100, sockSndBufSize=0, sockRcvBufSize=0, tcpNoDelay=true, maxOpenCursorsPerConn=128, threadPoolSize=24, selectorCnt=12, idleTimeout=0, handshakeTimeout=10000, jdbcEnabled=true, odbcEnabled=true, thinCliEnabled=true, sslEnabled=false, useIgniteSslCtxFactory=true, sslClientAuth=false, sslCtxFactory=null, thinCliCfg=ThinClientConfiguration [maxActiveTxPerConn=100, maxActiveComputeTasksPerConn=0]], mvccVacuumThreadCnt=2, mvccVacuumFreq=5000, authEnabled=false, failureHnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]], commFailureRslvr=null, sqlCfg=SqlConfiguration [longQryWarnTimeout=3000, dfltQryTimeout=0, sqlQryHistSize=1000, validationEnabled=false], asyncContinuationExecutor=null] [21:09:25] : [Step 4/5] [2021-11-19 21:09:25,337][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] Daemon mode: off [21:09:25] : [Step 4/5] [2021-11-19 21:09:25,337][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] OS: Linux 4.15.0-151-generic amd64 [21:09:25] : [Step 4/5] [2021-11-19 21:09:25,337][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] OS user: teamcity [21:09:25] : [Step 4/5] [2021-11-19 21:09:25,338][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] PID: 16724 [21:09:25] : [Step 4/5] [2021-11-19 21:09:25,338][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] Language runtime: Java Platform API Specification ver. 1.8 [21:09:25] : [Step 4/5] [2021-11-19 21:09:25,338][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] VM information: Java(TM) SE Runtime Environment 1.8.0_261-b12 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 25.261-b12 [21:09:25] : [Step 4/5] [2021-11-19 21:09:25,338][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] VM total memory: 1.9GB [21:09:25] : [Step 4/5] [2021-11-19 21:09:25,339][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] Remote Management [restart: off, REST: off, JMX (remote: off)] [21:09:25] : [Step 4/5] [2021-11-19 21:09:25,339][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] Logger: GridTestLog4jLogger [quiet=false, config=null] [21:09:25] : [Step 4/5] [2021-11-19 21:09:25,339][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] IGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c [21:09:25] : [Step 4/5] [2021-11-19 21:09:25,339][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] VM arguments: [-DIGNITE_DUMP_THREADS_ON_FAILURE=false, -DMono=/usr/bin/mono-sgen, -DMono4.0_x64=/usr/lib/mono/4.0, -DMono4.5_x64=/usr/lib/mono/4.5, -DMonoVersion=6.12.0.90, -DSKIP_BUILD=false, -Dagent.home.dir=/opt/buildagent, -Dagent.name=aitc-lin02_03, -Dagent.ownPort=9090, -Dagent.work.dir=/opt/buildagent/work, -Dbuild.number=95, -Dbuild.vcs.number=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.1=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.GitHubApacheIgnite=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dclassworlds.conf=/opt/buildagent/temp/buildTmp/teamcity.m2.conf, -Dcom.jetbrains.maven.watcher.report.file=/opt/buildagent/temp/buildTmp/maven-build-info.xml, -Djava.io.tmpdir=/opt/buildagent/temp/buildTmp, -Dmaven.home=/opt/buildagent/tools/maven3_6, -Dmaven.multiModuleProjectDirectory=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.agent.cpuBenchmark=457, -Dteamcity.agent.dotnet.agent_url=http://localhost:9090/RPC2, -Dteamcity.agent.dotnet.build_id=6278078, -Dteamcity.auth.password=*******, -Dteamcity.auth.userId=TeamCityBuildId=6278078, -Dteamcity.build.changedFiles.file=/opt/buildagent/temp/buildTmp/changedFiles6342607772318147725.txt, -Dteamcity.build.checkoutDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.build.id=6278078, -Dteamcity.build.properties.file=/opt/buildagent/temp/buildTmp/teamcity.build5164517880467851002.properties, -Dteamcity.build.tempDir=/opt/buildagent/temp/buildTmp, -Dteamcity.build.workingDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.buildConfName=Basic 3, -Dteamcity.buildType.id=IgniteTests24Java8_Basic3, -Dteamcity.configuration.properties.file=/opt/buildagent/temp/buildTmp/teamcity.config5591980786735343870.properties, -Dteamcity.maven.userSettings.path=/opt/buildagent/temp/buildTmp/maven_settings_585072866407032347.xml, -Dteamcity.maven.watcher.home=/opt/buildagent/plugins/mavenPlugin/maven-watcher-jdk16, -Dteamcity.projectName=Ignite Tests 2.x (JDK 8/11), -Dteamcity.runner.properties.file=/opt/buildagent/temp/buildTmp/teamcity.runner9098465561618137420.properties, -Dteamcity.tests.recentlyFailedTests.file=/opt/buildagent/temp/buildTmp/testsToRunFirst3891775683130404069.txt, -Dteamcity.version=2021.2 (build 99542), -ea, -Xms2g, -Xmx2g, -XX:+HeapDumpOnOutOfMemoryError, -DIGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_TEST_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_UPDATE_NOTIFIER=false, -DIGNITE_NO_DISCO_ORDER=true, -DIGNITE_PERFORMANCE_SUGGESTIONS_DISABLED=true, -Djava.net.preferIPv4Stack=true, -DTEST_SCALE_FACTOR=1.0, -DIGNITE_TEST_PROP_LOG4J_FILE=log4j-tc-test.xml, -DIGNITE_QUIET=false, -DIGNITE_MARSHAL_BUFFERS_RECHECK=1000, -Dmaven.repo.local=/opt/buildagent/.m2/repository] [21:09:25] : [Step 4/5] [2021-11-19 21:09:25,343][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] System cache's DataRegion size is configured to 40 MB. Use DataStorageConfiguration.systemRegionInitialSize property to change the setting. [21:09:25] : [Step 4/5] [2021-11-19 21:09:25,344][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] Configured caches [in 'sysMemPlc' dataRegion: ['ignite-sys-cache']] [21:09:25]W: [org.apache.ignite:ignite-core] [2021-11-19 21:09:25,344][WARN ][test-runner-#18198%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] Peer class loading is enabled (disable it in production for performance and deployment consistency reasons) [21:09:25] : [Step 4/5] [2021-11-19 21:09:25,344][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] 3-rd party licenses can be found at: /opt/buildagent/work/7bc1c54bc719b67c/libs/licenses [21:09:25] : [Step 4/5] [2021-11-19 21:09:25,347][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] Configured plugins: [21:09:25] : [Step 4/5] [2021-11-19 21:09:25,348][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] ^-- StanByClusterTestProvider 1.0 [21:09:25] : [Step 4/5] [2021-11-19 21:09:25,348][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:09:25] : [Step 4/5] [2021-11-19 21:09:25,348][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] [21:09:25] : [Step 4/5] [2021-11-19 21:09:25,348][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] ^-- PageMemory tracker plugin 1.0 [21:09:25] : [Step 4/5] [2021-11-19 21:09:25,348][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:09:25] : [Step 4/5] [2021-11-19 21:09:25,348][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] [21:09:25] : [Step 4/5] [2021-11-19 21:09:25,348][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] ^-- TestDistibutedConfigurationPlugin 1.0 [21:09:25] : [Step 4/5] [2021-11-19 21:09:25,349][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:09:25] : [Step 4/5] [2021-11-19 21:09:25,349][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] [21:09:25] : [Step 4/5] [2021-11-19 21:09:25,349][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] ^-- NodeValidationPluginProvider 1.0 [21:09:25] : [Step 4/5] [2021-11-19 21:09:25,349][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:09:25] : [Step 4/5] [2021-11-19 21:09:25,349][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] [21:09:25] : [Step 4/5] [2021-11-19 21:09:25,350][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][FailureProcessor] Configured failure handler: [hnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]]] [21:09:25] : [Step 4/5] [2021-11-19 21:09:25,360][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][TestRecordingCommunicationSpi] Successfully bound communication NIO server to TCP port [port=47100, locHost=/127.0.0.1, selectorsCnt=12, selectorSpins=0, pairedConn=false] [21:09:25]W: [org.apache.ignite:ignite-core] [2021-11-19 21:09:25,361][WARN ][test-runner-#18198%encryption.MasterKeyChangeTest%][TestRecordingCommunicationSpi] Message queue limit is set to 0 which may lead to potential OOMEs when running cache operations in FULL_ASYNC or PRIMARY_SYNC modes due to message queues growth on sender and receiver sides. [21:09:25] : [Step 4/5] [2021-11-19 21:09:25,365][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][GridCollisionManager] Collision resolution is disabled (all jobs will be activated upon arrival). [21:09:25] : [Step 4/5] [2021-11-19 21:09:25,365][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] Security status [authentication=off, sandbox=off, tls/ssl=off] [21:09:25] : [Step 4/5] [2021-11-19 21:09:25,421][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:09:25] : [Step 4/5] [2021-11-19 21:09:25,502][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][MaintenanceProcessor] Resolved store directory for node persistent data: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0 [21:09:25] : [Step 4/5] [2021-11-19 21:09:25,503][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][CacheObjectBinaryProcessorImpl] Resolved directory for serialized binary metadata: /opt/buildagent/work/7bc1c54bc719b67c/work/db/binary_meta/grid_0 [21:09:25] : [Step 4/5] [2021-11-19 21:09:25,507][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0 [21:09:25] : [Step 4/5] [2021-11-19 21:09:25,507][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][FileWriteAheadLogManager] Resolved write ahead log work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0 [21:09:25] : [Step 4/5] [2021-11-19 21:09:25,507][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][FileWriteAheadLogManager] Resolved write ahead log archive directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0 [21:09:26] : [Step 4/5] [2021-11-19 21:09:26,024][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000000.wal [21:09:26]W: [org.apache.ignite:ignite-core] [2021-11-19 21:09:26,025][WARN ][test-runner-#18198%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] DataRegion maxSize=10.5 MB is smaller than defaultInitialSize=268.4 MB, setting initialSize to 10.5 MB [21:09:26] : [Step 4/5] [2021-11-19 21:09:26,029][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Configured data regions initialized successfully [total=5] [21:09:26] : [Step 4/5] [2021-11-19 21:09:26,033][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][IgniteSnapshotManager] Resolved snapshot work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/snapshots [21:09:26] : [Step 4/5] [2021-11-19 21:09:26,033][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][IgniteSnapshotManager] Resolved temp directory for snapshot creation: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0/snp [21:09:26] : [Step 4/5] [2021-11-19 21:09:26,035][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][ClientListenerProcessor] Client connector processor has started on TCP port 10800 [21:09:26] : [Step 4/5] [2021-11-19 21:09:26,040][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] Non-loopback local IPs: 172.17.0.4 [21:09:26] : [Step 4/5] [2021-11-19 21:09:26,041][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] Enabled local MACs: 0242AC110004 [21:09:26] : [Step 4/5] [2021-11-19 21:09:26,042][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:09:26] : [Step 4/5] [2021-11-19 21:09:26,044][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:09:26] : [Step 4/5] [2021-11-19 21:09:26,044][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:09:26] : [Step 4/5] [2021-11-19 21:09:26,046][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Applying lost metastore updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:09:26] : [Step 4/5] [2021-11-19 21:09:26,047][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=0 ms] [21:09:26] : [Step 4/5] [2021-11-19 21:09:26,048][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][GridCacheProcessor] Restoring partition state for local groups. [21:09:26] : [Step 4/5] [2021-11-19 21:09:26,048][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=0, partitionsProcessed=0, time=0ms] [21:09:26] : [Step 4/5] [2021-11-19 21:09:26,049][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][GridEncryptionManager] Encryption keys loaded from metastore. [grps=, masterKeyName=ignite.master.key] [21:09:26] : [Step 4/5] [2021-11-19 21:09:26,054][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][ClusterProcessor] Cluster ID and tag has been read from metastorage: null [21:09:26] : [Step 4/5] [2021-11-19 21:09:26,054][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][IgniteClusterImpl] Shutdown policy was updated [oldVal=null, newVal=null] [21:09:26] : [Step 4/5] [2021-11-19 21:09:26,055][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Checkpoint frequency deviation changed [oldVal=null, newVal=null] [21:09:26] : [Step 4/5] [2021-11-19 21:09:26,064][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][FilePageStoreManager] Cleanup cache stores [total=1, left=0, cleanFiles=false] [21:09:26] : [Step 4/5] [2021-11-19 21:09:26,067][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:09:26] : [Step 4/5] [2021-11-19 21:09:26,068][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:09:26] : [Step 4/5] [2021-11-19 21:09:26,070][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:09:26] : [Step 4/5] [2021-11-19 21:09:26,070][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Data Regions Started: 5 [21:09:26] : [Step 4/5] [2021-11-19 21:09:26,071][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] ^-- sysMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:09:26] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:09:26] : [Step 4/5] ^-- default region [type=default, persistence=true, lazyAlloc=true, [21:09:26] : [Step 4/5] ... initCfg=10MB, maxCfg=10MB, usedRam=0MB, freeRam=100%, allocRam=0MB, allocTotal=0MB] [21:09:26] : [Step 4/5] ^-- metastoreMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:09:26] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:09:26] : [Step 4/5] ^-- TxLog region [type=internal, persistence=true, lazyAlloc=false, [21:09:26] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:09:26] : [Step 4/5] ^-- volatileDsMemPlc region [type=user, persistence=false, lazyAlloc=true, [21:09:26] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB] [21:09:26] : [Step 4/5] ^-- Ignite persistence [used=0MB] [21:09:26] : [Step 4/5] [21:09:26] : [Step 4/5] [2021-11-19 21:09:26,072][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Starting binary memory restore for: [-2100569601] [21:09:26] : [Step 4/5] [2021-11-19 21:09:26,080][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:09:26] : [Step 4/5] [2021-11-19 21:09:26,081][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:09:26] : [Step 4/5] [2021-11-19 21:09:26,082][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000000.wal, offset=0, ver=2] [21:09:26] : [Step 4/5] [2021-11-19 21:09:26,086][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][GridCacheProcessor] Started cache in recovery mode [name=ignite-sys-cache, id=-2100569601, dataRegionName=sysMemPlc, mode=REPLICATED, atomicity=TRANSACTIONAL, backups=2147483647, mvcc=false] [21:09:26] : [Step 4/5] [2021-11-19 21:09:26,087][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Binary recovery performed in 15 ms. [21:09:26] : [Step 4/5] [2021-11-19 21:09:26,088][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:09:26] : [Step 4/5] [2021-11-19 21:09:26,088][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Applying lost cache updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:09:26] : [Step 4/5] [2021-11-19 21:09:26,166][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=72 ms] [21:09:26] : [Step 4/5] [2021-11-19 21:09:26,166][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][GridCacheProcessor] Restoring partition state for local groups. [21:09:26] : [Step 4/5] [2021-11-19 21:09:26,181][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=1, partitionsProcessed=100, time=20ms] [21:09:26] : [Step 4/5] [2021-11-19 21:09:26,619][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][TestTcpDiscoverySpi] Successfully bound to TCP port [port=47500, localHost=localhost/127.0.0.1, locNodeId=0013589e-122f-4d50-8c70-af3d127be000] [21:09:26] : [Step 4/5] [2021-11-19 21:09:26,628][INFO ][disco-notifier-worker-#18309%grid-0%][MvccProcessorImpl] Assigned mvcc coordinator [crd=MvccCoordinator [topVer=AffinityTopologyVersion [topVer=1, minorTopVer=0], nodeId=0013589e-122f-4d50-8c70-af3d127be000, ver=1637345366624, local=true, initialized=false]] [21:09:26] : [Step 4/5] [2021-11-19 21:09:26,629][INFO ][sys-#18294%grid-0%][ClusterProcessor] Writing cluster ID and tag to metastorage on ready for write ClusterIdAndTag [id=91c8a09d-7542-4158-8b49-e9c0724f4d93, tag=cranky_hypatia] [21:09:26] : [Step 4/5] [2021-11-19 21:09:26,632][INFO ][disco-notifier-worker-#18309%grid-0%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustEnabled' was changed from 'null' to 'false' [21:09:26] : [Step 4/5] [2021-11-19 21:09:26,633][INFO ][disco-notifier-worker-#18309%grid-0%][ClusterProcessor] cranky_hypatia [21:09:26] : [Step 4/5] [2021-11-19 21:09:26,633][INFO ][disco-notifier-worker-#18309%grid-0%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustTimeout' was changed from 'null' to '300000' [21:09:26] : [Step 4/5] [2021-11-19 21:09:26,634][INFO ][disco-notifier-worker-#18309%grid-0%][IgniteTxManager] Transactions parameter 'longOperationsDumpTimeout' was changed from 'null' to '60000' [21:09:26] : [Step 4/5] [2021-11-19 21:09:26,634][INFO ][disco-notifier-worker-#18309%grid-0%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpThreshold' was changed from 'null' to '0' [21:09:26] : [Step 4/5] [2021-11-19 21:09:26,635][INFO ][disco-notifier-worker-#18309%grid-0%][IgniteTxManager] Transactions parameter 'transactionTimeDumpSamplesCoefficient' was changed from 'null' to '0.0' [21:09:26] : [Step 4/5] [2021-11-19 21:09:26,635][INFO ][disco-notifier-worker-#18309%grid-0%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpSamplesPerSecondLimit' was changed from 'null' to '5' [21:09:26] : [Step 4/5] [2021-11-19 21:09:26,637][INFO ][disco-notifier-worker-#18309%grid-0%][IgniteTxManager] Transactions parameter 'collisionsDumpInterval' was changed from 'null' to '1000' [21:09:26] : [Step 4/5] [2021-11-19 21:09:26,637][INFO ][disco-notifier-worker-#18309%grid-0%][IgniteTxManager] Transactions parameter 'txOwnerDumpRequestsAllowed' was changed from 'null' to 'true' [21:09:26] : [Step 4/5] [2021-11-19 21:09:26,637][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] To start Console Management & Monitoring run ignitevisorcmd.{sh|bat} [21:09:26] : [Step 4/5] [2021-11-19 21:09:26,638][INFO ][disco-notifier-worker-#18309%grid-0%][GridCacheDatabaseSharedManager] Historical rebalance WAL threshold changed [property=historical.rebalance.threshold, oldVal=null, newVal=500] [21:09:26] : [Step 4/5] [2021-11-19 21:09:26,638][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] [21:09:26] : [Step 4/5] [21:09:26] : [Step 4/5] >>> +-------------------------------------------+ [21:09:26] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:09:26] : [Step 4/5] >>> +-------------------------------------------+ [21:09:26] : [Step 4/5] >>> OS name: Linux 4.15.0-151-generic amd64 [21:09:26] : [Step 4/5] >>> CPU(s): 24 [21:09:26] : [Step 4/5] >>> Heap: 2.0GB [21:09:26] : [Step 4/5] >>> VM name: 16724@c4dfe9a430b2 [21:09:26] : [Step 4/5] >>> Ignite instance name: grid-0 [21:09:26] : [Step 4/5] >>> Local node [ID=0013589E-122F-4D50-8C70-AF3D127BE000, order=1, clientMode=false] [21:09:26] : [Step 4/5] >>> Local node addresses: [127.0.0.1] [21:09:26] : [Step 4/5] >>> Local ports: TCP:10800 TCP:47100 TCP:47500 [21:09:26] : [Step 4/5] [21:09:26] : [Step 4/5] [2021-11-19 21:09:26,639][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] >>> Ignite cluster is in INACTIVE state (limited functionality available). Use control.(sh|bat) script or IgniteCluster.state(ClusterState.ACTIVE) to change the state. [21:09:26] : [Step 4/5] [2021-11-19 21:09:26,639][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][GridDiscoveryManager] Topology snapshot [ver=1, locNode=0013589e, servers=1, clients=0, state=INACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=0013589e-122f-4d50-8c70-af3d127be000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:09:26] : [Step 4/5] [2021-11-19 21:09:26,640][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][G] Node started : [stage="Configure system pool" (0 ms),stage="Start managers" (176 ms),stage="Configure binary metadata" (2 ms),stage="Start processors" (535 ms),stage="Start 'StanByClusterTestProvider' plugin" (0 ms),stage="Start 'PageMemory tracker plugin' plugin" (0 ms),stage="Start 'TestDistibutedConfigurationPlugin' plugin" (0 ms),stage="Start 'NodeValidationPluginProvider' plugin" (0 ms),stage="Init metastore" (24 ms),stage="Init and start regions" (7 ms),stage="Restore binary memory" (15 ms),stage="Restore logical state" (93 ms),stage="Finish recovery" (436 ms),stage="Join topology" (9 ms),stage="Await transition" (1 ms),stage="Await exchange" (10 ms),stage="Total time" (1308 ms)] [21:09:26] : [Step 4/5] [2021-11-19 21:09:26,641][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][root] Node started with the following configuration [id=0013589e-122f-4d50-8c70-af3d127be000, marshaller=BinaryMarshaller [], discovery=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=5000, ackTimeout=5000, marsh=JdkMarshaller [clsFilter=org.apache.ignite.marshaller.MarshallerUtils$1@7ef5f77e], reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], binaryCfg=null, lateAff=true] [21:09:26]W: [org.apache.ignite:ignite-core] [2021-11-19 21:09:26,645][WARN ][test-runner-#18198%encryption.MasterKeyChangeTest%][G] Ignite work directory is not provided, automatically resolved to: /opt/buildagent/work/7bc1c54bc719b67c/work [21:09:26] : [Step 4/5] [2021-11-19 21:09:26,646][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] [21:09:26] : [Step 4/5] [21:09:26] : [Step 4/5] >>> __________ ________________ [21:09:26] : [Step 4/5] >>> / _/ ___/ |/ / _/_ __/ __/ [21:09:26] : [Step 4/5] >>> _/ // (7 7 // / / / / _/ [21:09:26] : [Step 4/5] >>> /___/\___/_/|_/___/ /_/ /___/ [21:09:26] : [Step 4/5] >>> [21:09:26] : [Step 4/5] >>> ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:09:26] : [Step 4/5] >>> 2021 Copyright(C) Apache Software Foundation [21:09:26] : [Step 4/5] >>> [21:09:26] : [Step 4/5] >>> Ignite documentation: http://ignite.apache.org [21:09:26] : [Step 4/5] [21:09:26] : [Step 4/5] [2021-11-19 21:09:26,647][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] Config URL: n/a [21:09:26] : [Step 4/5] [2021-11-19 21:09:26,647][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] IgniteConfiguration [igniteInstanceName=grid-1, pubPoolSize=24, svcPoolSize=24, callbackPoolSize=24, stripedPoolSize=24, sysPoolSize=24, mgmtPoolSize=4, dataStreamerPoolSize=24, utilityCachePoolSize=24, utilityCacheKeepAliveTime=60000, p2pPoolSize=2, qryPoolSize=24, buildIdxPoolSize=4, igniteHome=/opt/buildagent/work/7bc1c54bc719b67c, igniteWorkDir=/opt/buildagent/work/7bc1c54bc719b67c/work, mbeanSrv=com.sun.jmx.mbeanserver.JmxMBeanServer@6fe85038, nodeId=106dcde6-3f99-4598-b535-e4132e2ef001, marsh=BinaryMarshaller [], marshLocJobs=false, daemon=false, p2pEnabled=true, netTimeout=10000, netCompressionLevel=1, sndRetryDelay=1000, sndRetryCnt=3, metricsHistSize=10000, metricsUpdateFreq=1000, metricsExpTime=9223372036854775807, discoSpi=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=0, ackTimeout=0, marsh=null, reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], segPlc=STOP, segResolveAttempts=2, waitForSegOnStart=true, allResolversPassReq=true, segChkFreq=10000, commSpi=TcpCommunicationSpi [connectGate=org.apache.ignite.spi.communication.tcp.internal.ConnectGateway@71971ef1, ctxInitLatch=java.util.concurrent.CountDownLatch@45e82d79[Count = 1], stopping=false, clientPool=null, nioSrvWrapper=null, stateProvider=null], evtSpi=MemoryEventStorageSpi [expireAgeMs=9223372036854775807, expireCnt=10000, filter=null], colSpi=NoopCollisionSpi [], deploySpi=LocalDeploymentSpi [], indexingSpi=org.apache.ignite.spi.indexing.noop.NoopIndexingSpi@438567f1, addrRslvr=null, encryptionSpi=org.apache.ignite.spi.encryption.keystore.KeystoreEncryptionSpi@7b0e2b30, tracingSpi=org.apache.ignite.spi.tracing.NoopTracingSpi@2a0578f8, clientMode=false, rebalanceThreadPoolSize=4, rebalanceTimeout=10000, rebalanceBatchesPrefetchCnt=3, rebalanceThrottle=0, rebalanceBatchSize=524288, txCfg=TransactionConfiguration [txSerEnabled=false, dfltIsolation=REPEATABLE_READ, dfltConcurrency=PESSIMISTIC, dfltTxTimeout=0, txTimeoutOnPartitionMapExchange=0, deadlockTimeout=10000, pessimisticTxLogSize=0, pessimisticTxLogLinger=10000, tmLookupClsName=null, txManagerFactory=null, useJtaSync=false], cacheSanityCheckEnabled=true, discoStartupDelay=60000, deployMode=SHARED, p2pMissedCacheSize=100, locHost=127.0.0.1, timeSrvPortBase=31100, timeSrvPortRange=100, failureDetectionTimeout=10000, sysWorkerBlockedTimeout=null, clientFailureDetectionTimeout=10000, metricsLogFreq=0, connectorCfg=null, odbcCfg=null, warmupClos=null, atomicCfg=AtomicConfiguration [seqReserveSize=1000, cacheMode=PARTITIONED, backups=1, aff=null, grpName=null], classLdr=null, sslCtxFactory=null, platformCfg=null, binaryCfg=null, memCfg=null, pstCfg=null, dsCfg=DataStorageConfiguration [sysRegionInitSize=41943040, sysRegionMaxSize=104857600, pageSize=4096, concLvl=0, dfltDataRegConf=DataRegionConfiguration [name=default, maxSize=10485760, initSize=268435456, swapPath=null, pageEvictionMode=DISABLED, pageReplacementMode=CLOCK, evictionThreshold=0.9, emptyPagesPoolSize=100, metricsEnabled=false, metricsSubIntervalCount=5, metricsRateTimeInterval=60000, persistenceEnabled=true, checkpointPageBufSize=0, lazyMemoryAllocation=true, warmUpCfg=null], dataRegions=null, storagePath=null, checkpointFreq=180000, lockWaitTime=10000, checkpointThreads=4, checkpointWriteOrder=SEQUENTIAL, walHistSize=20, maxWalArchiveSize=1073741824, walSegments=10, walSegmentSize=67108864, walPath=db/wal, walArchivePath=db/wal/archive, cdcWalPath=db/wal/cdc, cdcEnabled=false, metricsEnabled=false, walMode=FSYNC, walTlbSize=131072, walBuffSize=0, walFlushFreq=2000, walFsyncDelay=1000, walRecordIterBuffSize=67108864, alwaysWriteFullPages=false, fileIOFactory=org.apache.ignite.internal.processors.cache.persistence.file.AsyncFileIOFactory@608c3e64, metricsSubIntervalCnt=5, metricsRateTimeInterval=60000, walAutoArchiveAfterInactivity=-1, walForceArchiveTimeout=-1, writeThrottlingEnabled=false, walCompactionEnabled=false, walCompactionLevel=1, checkpointReadLockTimeout=null, walPageCompression=DISABLED, walPageCompressionLevel=null, dfltWarmUpCfg=null, encCfg=org.apache.ignite.configuration.EncryptionConfiguration@7e395e5b, defragmentationThreadPoolSize=4, minWalArchiveSize=-1], snapshotPath=snapshots, activeOnStart=true, activeOnStartPropSetFlag=false, autoActivation=true, autoActivationPropSetFlag=false, clusterStateOnStart=null, sqlConnCfg=null, cliConnCfg=ClientConnectorConfiguration [host=null, port=10800, portRange=100, sockSndBufSize=0, sockRcvBufSize=0, tcpNoDelay=true, maxOpenCursorsPerConn=128, threadPoolSize=24, selectorCnt=12, idleTimeout=0, handshakeTimeout=10000, jdbcEnabled=true, odbcEnabled=true, thinCliEnabled=true, sslEnabled=false, useIgniteSslCtxFactory=true, sslClientAuth=false, sslCtxFactory=null, thinCliCfg=ThinClientConfiguration [maxActiveTxPerConn=100, maxActiveComputeTasksPerConn=0]], mvccVacuumThreadCnt=2, mvccVacuumFreq=5000, authEnabled=false, failureHnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]], commFailureRslvr=null, sqlCfg=SqlConfiguration [longQryWarnTimeout=3000, dfltQryTimeout=0, sqlQryHistSize=1000, validationEnabled=false], asyncContinuationExecutor=null] [21:09:26] : [Step 4/5] [2021-11-19 21:09:26,654][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] Daemon mode: off [21:09:26] : [Step 4/5] [2021-11-19 21:09:26,655][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] OS: Linux 4.15.0-151-generic amd64 [21:09:26] : [Step 4/5] [2021-11-19 21:09:26,655][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] OS user: teamcity [21:09:26] : [Step 4/5] [2021-11-19 21:09:26,655][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] PID: 16724 [21:09:26] : [Step 4/5] [2021-11-19 21:09:26,655][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] Language runtime: Java Platform API Specification ver. 1.8 [21:09:26] : [Step 4/5] [2021-11-19 21:09:26,655][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] VM information: Java(TM) SE Runtime Environment 1.8.0_261-b12 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 25.261-b12 [21:09:26] : [Step 4/5] [2021-11-19 21:09:26,656][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] VM total memory: 1.9GB [21:09:26] : [Step 4/5] [2021-11-19 21:09:26,656][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] Remote Management [restart: off, REST: off, JMX (remote: off)] [21:09:26] : [Step 4/5] [2021-11-19 21:09:26,656][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] Logger: GridTestLog4jLogger [quiet=false, config=null] [21:09:26] : [Step 4/5] [2021-11-19 21:09:26,656][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] IGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c [21:09:26] : [Step 4/5] [2021-11-19 21:09:26,657][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] VM arguments: [-DIGNITE_DUMP_THREADS_ON_FAILURE=false, -DMono=/usr/bin/mono-sgen, -DMono4.0_x64=/usr/lib/mono/4.0, -DMono4.5_x64=/usr/lib/mono/4.5, -DMonoVersion=6.12.0.90, -DSKIP_BUILD=false, -Dagent.home.dir=/opt/buildagent, -Dagent.name=aitc-lin02_03, -Dagent.ownPort=9090, -Dagent.work.dir=/opt/buildagent/work, -Dbuild.number=95, -Dbuild.vcs.number=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.1=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.GitHubApacheIgnite=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dclassworlds.conf=/opt/buildagent/temp/buildTmp/teamcity.m2.conf, -Dcom.jetbrains.maven.watcher.report.file=/opt/buildagent/temp/buildTmp/maven-build-info.xml, -Djava.io.tmpdir=/opt/buildagent/temp/buildTmp, -Dmaven.home=/opt/buildagent/tools/maven3_6, -Dmaven.multiModuleProjectDirectory=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.agent.cpuBenchmark=457, -Dteamcity.agent.dotnet.agent_url=http://localhost:9090/RPC2, -Dteamcity.agent.dotnet.build_id=6278078, -Dteamcity.auth.password=*******, -Dteamcity.auth.userId=TeamCityBuildId=6278078, -Dteamcity.build.changedFiles.file=/opt/buildagent/temp/buildTmp/changedFiles6342607772318147725.txt, -Dteamcity.build.checkoutDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.build.id=6278078, -Dteamcity.build.properties.file=/opt/buildagent/temp/buildTmp/teamcity.build5164517880467851002.properties, -Dteamcity.build.tempDir=/opt/buildagent/temp/buildTmp, -Dteamcity.build.workingDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.buildConfName=Basic 3, -Dteamcity.buildType.id=IgniteTests24Java8_Basic3, -Dteamcity.configuration.properties.file=/opt/buildagent/temp/buildTmp/teamcity.config5591980786735343870.properties, -Dteamcity.maven.userSettings.path=/opt/buildagent/temp/buildTmp/maven_settings_585072866407032347.xml, -Dteamcity.maven.watcher.home=/opt/buildagent/plugins/mavenPlugin/maven-watcher-jdk16, -Dteamcity.projectName=Ignite Tests 2.x (JDK 8/11), -Dteamcity.runner.properties.file=/opt/buildagent/temp/buildTmp/teamcity.runner9098465561618137420.properties, -Dteamcity.tests.recentlyFailedTests.file=/opt/buildagent/temp/buildTmp/testsToRunFirst3891775683130404069.txt, -Dteamcity.version=2021.2 (build 99542), -ea, -Xms2g, -Xmx2g, -XX:+HeapDumpOnOutOfMemoryError, -DIGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_TEST_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_UPDATE_NOTIFIER=false, -DIGNITE_NO_DISCO_ORDER=true, -DIGNITE_PERFORMANCE_SUGGESTIONS_DISABLED=true, -Djava.net.preferIPv4Stack=true, -DTEST_SCALE_FACTOR=1.0, -DIGNITE_TEST_PROP_LOG4J_FILE=log4j-tc-test.xml, -DIGNITE_QUIET=false, -DIGNITE_MARSHAL_BUFFERS_RECHECK=1000, -Dmaven.repo.local=/opt/buildagent/.m2/repository] [21:09:26] : [Step 4/5] [2021-11-19 21:09:26,660][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] System cache's DataRegion size is configured to 40 MB. Use DataStorageConfiguration.systemRegionInitialSize property to change the setting. [21:09:26] : [Step 4/5] [2021-11-19 21:09:26,661][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] Configured caches [in 'sysMemPlc' dataRegion: ['ignite-sys-cache']] [21:09:26]W: [org.apache.ignite:ignite-core] [2021-11-19 21:09:26,661][WARN ][test-runner-#18198%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] Peer class loading is enabled (disable it in production for performance and deployment consistency reasons) [21:09:26] : [Step 4/5] [2021-11-19 21:09:26,661][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] 3-rd party licenses can be found at: /opt/buildagent/work/7bc1c54bc719b67c/libs/licenses [21:09:26] : [Step 4/5] [2021-11-19 21:09:26,664][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] Configured plugins: [21:09:26] : [Step 4/5] [2021-11-19 21:09:26,665][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] ^-- StanByClusterTestProvider 1.0 [21:09:26] : [Step 4/5] [2021-11-19 21:09:26,665][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:09:26] : [Step 4/5] [2021-11-19 21:09:26,665][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] [21:09:26] : [Step 4/5] [2021-11-19 21:09:26,665][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] ^-- PageMemory tracker plugin 1.0 [21:09:26] : [Step 4/5] [2021-11-19 21:09:26,665][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:09:26] : [Step 4/5] [2021-11-19 21:09:26,665][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] [21:09:26] : [Step 4/5] [2021-11-19 21:09:26,666][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] ^-- TestDistibutedConfigurationPlugin 1.0 [21:09:26] : [Step 4/5] [2021-11-19 21:09:26,666][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:09:26] : [Step 4/5] [2021-11-19 21:09:26,666][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] [21:09:26] : [Step 4/5] [2021-11-19 21:09:26,666][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] ^-- NodeValidationPluginProvider 1.0 [21:09:26] : [Step 4/5] [2021-11-19 21:09:26,666][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:09:26] : [Step 4/5] [2021-11-19 21:09:26,666][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] [21:09:26] : [Step 4/5] [2021-11-19 21:09:26,667][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][FailureProcessor] Configured failure handler: [hnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]]] [21:09:26] : [Step 4/5] [2021-11-19 21:09:26,678][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][TestRecordingCommunicationSpi] Successfully bound communication NIO server to TCP port [port=47101, locHost=/127.0.0.1, selectorsCnt=12, selectorSpins=0, pairedConn=false] [21:09:26]W: [org.apache.ignite:ignite-core] [2021-11-19 21:09:26,679][WARN ][test-runner-#18198%encryption.MasterKeyChangeTest%][TestRecordingCommunicationSpi] Message queue limit is set to 0 which may lead to potential OOMEs when running cache operations in FULL_ASYNC or PRIMARY_SYNC modes due to message queues growth on sender and receiver sides. [21:09:26] : [Step 4/5] [2021-11-19 21:09:26,683][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][GridCollisionManager] Collision resolution is disabled (all jobs will be activated upon arrival). [21:09:26] : [Step 4/5] [2021-11-19 21:09:26,684][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] Security status [authentication=off, sandbox=off, tls/ssl=off] [21:09:26] : [Step 4/5] [2021-11-19 21:09:26,743][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:09:26] : [Step 4/5] [2021-11-19 21:09:26,842][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][MaintenanceProcessor] Resolved store directory for node persistent data: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1 [21:09:26] : [Step 4/5] [2021-11-19 21:09:26,843][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][CacheObjectBinaryProcessorImpl] Resolved directory for serialized binary metadata: /opt/buildagent/work/7bc1c54bc719b67c/work/db/binary_meta/grid_1 [21:09:26] : [Step 4/5] [2021-11-19 21:09:26,846][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1 [21:09:26] : [Step 4/5] [2021-11-19 21:09:26,847][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][FileWriteAheadLogManager] Resolved write ahead log work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1 [21:09:26] : [Step 4/5] [2021-11-19 21:09:26,847][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][FileWriteAheadLogManager] Resolved write ahead log archive directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1 [21:09:27] : [Step 4/5] [2021-11-19 21:09:27,281][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000000.wal [21:09:27] : [Step 4/5] [2021-11-19 21:09:27,287][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Configured data regions initialized successfully [total=5] [21:09:27] : [Step 4/5] [2021-11-19 21:09:27,289][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][IgniteSnapshotManager] Resolved snapshot work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/snapshots [21:09:27] : [Step 4/5] [2021-11-19 21:09:27,290][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][IgniteSnapshotManager] Resolved temp directory for snapshot creation: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1/snp [21:09:27] : [Step 4/5] [2021-11-19 21:09:27,292][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][ClientListenerProcessor] Client connector processor has started on TCP port 10801 [21:09:27] : [Step 4/5] [2021-11-19 21:09:27,295][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] Non-loopback local IPs: 172.17.0.4 [21:09:27] : [Step 4/5] [2021-11-19 21:09:27,295][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] Enabled local MACs: 0242AC110004 [21:09:27] : [Step 4/5] [2021-11-19 21:09:27,296][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:09:27] : [Step 4/5] [2021-11-19 21:09:27,297][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:09:27] : [Step 4/5] [2021-11-19 21:09:27,298][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:09:27] : [Step 4/5] [2021-11-19 21:09:27,299][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Applying lost metastore updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:09:27] : [Step 4/5] [2021-11-19 21:09:27,300][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=0 ms] [21:09:27] : [Step 4/5] [2021-11-19 21:09:27,300][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][GridCacheProcessor] Restoring partition state for local groups. [21:09:27] : [Step 4/5] [2021-11-19 21:09:27,300][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=0, partitionsProcessed=0, time=10ms] [21:09:27] : [Step 4/5] [2021-11-19 21:09:27,301][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][GridEncryptionManager] Encryption keys loaded from metastore. [grps=, masterKeyName=ignite.master.key] [21:09:27] : [Step 4/5] [2021-11-19 21:09:27,302][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][ClusterProcessor] Cluster ID and tag has been read from metastorage: null [21:09:27] : [Step 4/5] [2021-11-19 21:09:27,303][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][IgniteClusterImpl] Shutdown policy was updated [oldVal=null, newVal=null] [21:09:27] : [Step 4/5] [2021-11-19 21:09:27,303][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Checkpoint frequency deviation changed [oldVal=null, newVal=null] [21:09:27] : [Step 4/5] [2021-11-19 21:09:27,313][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][FilePageStoreManager] Cleanup cache stores [total=1, left=0, cleanFiles=false] [21:09:27] : [Step 4/5] [2021-11-19 21:09:27,315][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:09:27] : [Step 4/5] [2021-11-19 21:09:27,316][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:09:27] : [Step 4/5] [2021-11-19 21:09:27,317][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:09:27] : [Step 4/5] [2021-11-19 21:09:27,317][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Data Regions Started: 5 [21:09:27] : [Step 4/5] [2021-11-19 21:09:27,318][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] ^-- sysMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:09:27] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:09:27] : [Step 4/5] ^-- default region [type=default, persistence=true, lazyAlloc=true, [21:09:27] : [Step 4/5] ... initCfg=10MB, maxCfg=10MB, usedRam=0MB, freeRam=100%, allocRam=0MB, allocTotal=0MB] [21:09:27] : [Step 4/5] ^-- metastoreMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:09:27] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:09:27] : [Step 4/5] ^-- TxLog region [type=internal, persistence=true, lazyAlloc=false, [21:09:27] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:09:27] : [Step 4/5] ^-- volatileDsMemPlc region [type=user, persistence=false, lazyAlloc=true, [21:09:27] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB] [21:09:27] : [Step 4/5] ^-- Ignite persistence [used=0MB] [21:09:27] : [Step 4/5] [21:09:27] : [Step 4/5] [2021-11-19 21:09:27,319][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Starting binary memory restore for: [-2100569601] [21:09:27] : [Step 4/5] [2021-11-19 21:09:27,327][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:09:27] : [Step 4/5] [2021-11-19 21:09:27,327][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:09:27] : [Step 4/5] [2021-11-19 21:09:27,329][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000000.wal, offset=0, ver=2] [21:09:27] : [Step 4/5] [2021-11-19 21:09:27,333][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][GridCacheProcessor] Started cache in recovery mode [name=ignite-sys-cache, id=-2100569601, dataRegionName=sysMemPlc, mode=REPLICATED, atomicity=TRANSACTIONAL, backups=2147483647, mvcc=false] [21:09:27] : [Step 4/5] [2021-11-19 21:09:27,334][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Binary recovery performed in 15 ms. [21:09:27] : [Step 4/5] [2021-11-19 21:09:27,334][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:09:27] : [Step 4/5] [2021-11-19 21:09:27,334][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Applying lost cache updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:09:27] : [Step 4/5] [2021-11-19 21:09:27,391][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=51 ms] [21:09:27] : [Step 4/5] [2021-11-19 21:09:27,391][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][GridCacheProcessor] Restoring partition state for local groups. [21:09:27] : [Step 4/5] [2021-11-19 21:09:27,395][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=1, partitionsProcessed=100, time=0ms] [21:09:27] : [Step 4/5] [2021-11-19 21:09:27,784][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][TestTcpDiscoverySpi] Successfully bound to TCP port [port=47501, localHost=localhost/127.0.0.1, locNodeId=106dcde6-3f99-4598-b535-e4132e2ef001] [21:09:27] : [Step 4/5] [2021-11-19 21:09:27,788][INFO ][tcp-disco-srvr-[:47500]-#958%grid-0%-#18311%grid-0%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=48737] [21:09:27] : [Step 4/5] [2021-11-19 21:09:27,788][INFO ][tcp-disco-srvr-[:47500]-#958%grid-0%-#18311%grid-0%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=48737] [21:09:27] : [Step 4/5] [2021-11-19 21:09:27,788][INFO ][tcp-disco-sock-reader-[]-#964%grid-0%-#18430%grid-0%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:48737, rmtPort=48737] [21:09:27] : [Step 4/5] [2021-11-19 21:09:27,790][INFO ][tcp-disco-sock-reader-[106dcde6 127.0.0.1:48737]-#964%grid-0%-#18430%grid-0%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=106dcde6-3f99-4598-b535-e4132e2ef001, rmtAddr=/127.0.0.1:48737] [21:09:27] : [Step 4/5] [2021-11-19 21:09:27,795][INFO ][tcp-disco-srvr-[:47501]-#963%grid-1%-#18429%grid-1%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=36897] [21:09:27] : [Step 4/5] [2021-11-19 21:09:27,795][INFO ][tcp-disco-srvr-[:47501]-#963%grid-1%-#18429%grid-1%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=36897] [21:09:27] : [Step 4/5] [2021-11-19 21:09:27,796][INFO ][tcp-disco-sock-reader-[]-#965%grid-1%-#18431%grid-1%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:36897, rmtPort=36897] [21:09:27] : [Step 4/5] [2021-11-19 21:09:27,797][INFO ][tcp-disco-sock-reader-[]-#965%grid-1%-#18431%grid-1%][TestTcpDiscoverySpi] Received ping request from the remote node [rmtNodeId=0013589e-122f-4d50-8c70-af3d127be000, rmtAddr=/127.0.0.1:36897, rmtPort=36897] [21:09:27] : [Step 4/5] [2021-11-19 21:09:27,798][INFO ][tcp-disco-sock-reader-[]-#965%grid-1%-#18431%grid-1%][TestTcpDiscoverySpi] Finished writing ping response [rmtNodeId=0013589e-122f-4d50-8c70-af3d127be000, rmtAddr=/127.0.0.1:36897, rmtPort=36897] [21:09:27] : [Step 4/5] [2021-11-19 21:09:27,798][INFO ][tcp-disco-sock-reader-[]-#965%grid-1%-#18431%grid-1%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:36897, rmtPort=36897, rmtNodeId=null] [21:09:27] : [Step 4/5] [2021-11-19 21:09:27,798][INFO ][tcp-disco-sock-reader-[106dcde6 127.0.0.1:48737]-#964%grid-0%-#18430%grid-0%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:48737, rmtPort=48737, rmtNodeId=106dcde6-3f99-4598-b535-e4132e2ef001] [21:09:27] : [Step 4/5] [2021-11-19 21:09:27,801][INFO ][tcp-disco-msg-worker-[crd]-#957%grid-0%-#18310%grid-0%][GridEncryptionManager] Joining node doesn't have stored group keys [node=106dcde6-3f99-4598-b535-e4132e2ef001] [21:09:27] : [Step 4/5] [2021-11-19 21:09:27,809][INFO ][tcp-disco-msg-worker-[crd]-#957%grid-0%-#18310%grid-0%][TestTcpDiscoverySpi] New next node [newNext=TcpDiscoveryNode [id=106dcde6-3f99-4598-b535-e4132e2ef001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=0, intOrder=2, lastExchangeTime=1637345367786, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false]] [21:09:27] : [Step 4/5] [2021-11-19 21:09:27,809][INFO ][tcp-disco-srvr-[:47501]-#963%grid-1%-#18429%grid-1%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=39693] [21:09:27] : [Step 4/5] [2021-11-19 21:09:27,810][INFO ][tcp-disco-srvr-[:47501]-#963%grid-1%-#18429%grid-1%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=39693] [21:09:27] : [Step 4/5] [2021-11-19 21:09:27,810][INFO ][tcp-disco-sock-reader-[]-#966%grid-1%-#18432%grid-1%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:39693, rmtPort=39693] [21:09:27] : [Step 4/5] [2021-11-19 21:09:27,811][INFO ][tcp-disco-sock-reader-[0013589e 127.0.0.1:39693]-#966%grid-1%-#18432%grid-1%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=0013589e-122f-4d50-8c70-af3d127be000, rmtAddr=/127.0.0.1:39693] [21:09:27] : [Step 4/5] [2021-11-19 21:09:27,815][INFO ][tcp-disco-msg-worker-[]-#962%grid-1%-#18428%grid-1%][TestTcpDiscoverySpi] New next node [newNext=TcpDiscoveryNode [id=0013589e-122f-4d50-8c70-af3d127be000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345367806, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false]] [21:09:27] : [Step 4/5] [2021-11-19 21:09:27,816][INFO ][tcp-disco-srvr-[:47500]-#958%grid-0%-#18311%grid-0%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=59651] [21:09:27] : [Step 4/5] [2021-11-19 21:09:27,816][INFO ][tcp-disco-srvr-[:47500]-#958%grid-0%-#18311%grid-0%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=59651] [21:09:27] : [Step 4/5] [2021-11-19 21:09:27,817][INFO ][tcp-disco-sock-reader-[]-#967%grid-0%-#18433%grid-0%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:59651, rmtPort=59651] [21:09:27] : [Step 4/5] [2021-11-19 21:09:27,817][INFO ][tcp-disco-sock-reader-[106dcde6 127.0.0.1:59651]-#967%grid-0%-#18433%grid-0%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=106dcde6-3f99-4598-b535-e4132e2ef001, rmtAddr=/127.0.0.1:59651] [21:09:27] : [Step 4/5] [2021-11-19 21:09:27,820][INFO ][disco-event-worker-#18313%grid-0%][GridDiscoveryManager] Added new node to topology: TcpDiscoveryNode [id=106dcde6-3f99-4598-b535-e4132e2ef001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637345367786, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false] [21:09:27] : [Step 4/5] [2021-11-19 21:09:27,821][INFO ][disco-event-worker-#18313%grid-0%][GridDiscoveryManager] Topology snapshot [ver=2, locNode=0013589e, servers=2, clients=0, state=INACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=0013589e-122f-4d50-8c70-af3d127be000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=106dcde6-3f99-4598-b535-e4132e2ef001, consistentId=grid-1, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:09:27] : [Step 4/5] [2021-11-19 21:09:27,823][INFO ][tcp-disco-msg-worker-[0013589e 127.0.0.1:47500]-#962%grid-1%-#18428%grid-1%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustEnabled' was changed from 'null' to 'false' [21:09:27] : [Step 4/5] [2021-11-19 21:09:27,824][INFO ][tcp-disco-msg-worker-[0013589e 127.0.0.1:47500]-#962%grid-1%-#18428%grid-1%][ClusterProcessor] cranky_hypatia [21:09:27] : [Step 4/5] [2021-11-19 21:09:27,824][INFO ][tcp-disco-msg-worker-[0013589e 127.0.0.1:47500]-#962%grid-1%-#18428%grid-1%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustTimeout' was changed from 'null' to '300000' [21:09:27] : [Step 4/5] [2021-11-19 21:09:27,825][INFO ][tcp-disco-msg-worker-[0013589e 127.0.0.1:47500]-#962%grid-1%-#18428%grid-1%][IgniteTxManager] Transactions parameter 'longOperationsDumpTimeout' was changed from 'null' to '60000' [21:09:27] : [Step 4/5] [2021-11-19 21:09:27,825][INFO ][tcp-disco-msg-worker-[0013589e 127.0.0.1:47500]-#962%grid-1%-#18428%grid-1%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpThreshold' was changed from 'null' to '0' [21:09:27] : [Step 4/5] [2021-11-19 21:09:27,825][INFO ][tcp-disco-msg-worker-[0013589e 127.0.0.1:47500]-#962%grid-1%-#18428%grid-1%][IgniteTxManager] Transactions parameter 'transactionTimeDumpSamplesCoefficient' was changed from 'null' to '0.0' [21:09:27] : [Step 4/5] [2021-11-19 21:09:27,826][INFO ][tcp-disco-msg-worker-[0013589e 127.0.0.1:47500]-#962%grid-1%-#18428%grid-1%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpSamplesPerSecondLimit' was changed from 'null' to '5' [21:09:27] : [Step 4/5] [2021-11-19 21:09:27,826][INFO ][tcp-disco-msg-worker-[0013589e 127.0.0.1:47500]-#962%grid-1%-#18428%grid-1%][IgniteTxManager] Transactions parameter 'collisionsDumpInterval' was changed from 'null' to '1000' [21:09:27] : [Step 4/5] [2021-11-19 21:09:27,827][INFO ][tcp-disco-msg-worker-[0013589e 127.0.0.1:47500]-#962%grid-1%-#18428%grid-1%][IgniteTxManager] Transactions parameter 'txOwnerDumpRequestsAllowed' was changed from 'null' to 'true' [21:09:27] : [Step 4/5] [2021-11-19 21:09:27,827][INFO ][tcp-disco-msg-worker-[0013589e 127.0.0.1:47500]-#962%grid-1%-#18428%grid-1%][GridCacheDatabaseSharedManager] Historical rebalance WAL threshold changed [property=historical.rebalance.threshold, oldVal=null, newVal=500] [21:09:27] : [Step 4/5] [2021-11-19 21:09:27,828][INFO ][disco-notifier-worker-#18427%grid-1%][MvccProcessorImpl] Assigned mvcc coordinator [crd=MvccCoordinator [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=0], nodeId=0013589e-122f-4d50-8c70-af3d127be000, ver=1637345366624, local=false, initialized=false]] [21:09:27] : [Step 4/5] [2021-11-19 21:09:27,829][INFO ][sys-#18426%grid-1%][ClusterProcessor] Writing cluster ID and tag to metastorage on ready for write ClusterIdAndTag [id=91c8a09d-7542-4158-8b49-e9c0724f4d93, tag=cranky_hypatia] [21:09:27] : [Step 4/5] [2021-11-19 21:09:27,844][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] To start Console Management & Monitoring run ignitevisorcmd.{sh|bat} [21:09:27] : [Step 4/5] [2021-11-19 21:09:27,845][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] [21:09:27] : [Step 4/5] [21:09:27] : [Step 4/5] >>> +-------------------------------------------+ [21:09:27] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:09:27] : [Step 4/5] >>> +-------------------------------------------+ [21:09:27] : [Step 4/5] >>> OS name: Linux 4.15.0-151-generic amd64 [21:09:27] : [Step 4/5] >>> CPU(s): 24 [21:09:27] : [Step 4/5] >>> Heap: 2.0GB [21:09:27] : [Step 4/5] >>> VM name: 16724@c4dfe9a430b2 [21:09:27] : [Step 4/5] >>> Ignite instance name: grid-1 [21:09:27] : [Step 4/5] >>> Local node [ID=106DCDE6-3F99-4598-B535-E4132E2EF001, order=2, clientMode=false] [21:09:27] : [Step 4/5] >>> Local node addresses: [127.0.0.1] [21:09:27] : [Step 4/5] >>> Local ports: TCP:10801 TCP:47101 TCP:47501 [21:09:27] : [Step 4/5] [21:09:27] : [Step 4/5] [2021-11-19 21:09:27,846][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] >>> Ignite cluster is in INACTIVE state (limited functionality available). Use control.(sh|bat) script or IgniteCluster.state(ClusterState.ACTIVE) to change the state. [21:09:27] : [Step 4/5] [2021-11-19 21:09:27,847][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][GridDiscoveryManager] Topology snapshot [ver=2, locNode=106dcde6, servers=2, clients=0, state=INACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=0013589e-122f-4d50-8c70-af3d127be000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=106dcde6-3f99-4598-b535-e4132e2ef001, consistentId=grid-1, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:09:27] : [Step 4/5] [2021-11-19 21:09:27,848][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][G] Node started : [stage="Configure system pool" (0 ms),stage="Start managers" (196 ms),stage="Configure binary metadata" (1 ms),stage="Start processors" (449 ms),stage="Start 'StanByClusterTestProvider' plugin" (0 ms),stage="Start 'PageMemory tracker plugin' plugin" (0 ms),stage="Start 'TestDistibutedConfigurationPlugin' plugin" (0 ms),stage="Start 'NodeValidationPluginProvider' plugin" (0 ms),stage="Init metastore" (18 ms),stage="Init and start regions" (6 ms),stage="Restore binary memory" (14 ms),stage="Restore logical state" (61 ms),stage="Finish recovery" (386 ms),stage="Join topology" (45 ms),stage="Await transition" (2 ms),stage="Await exchange" (17 ms),stage="Total time" (1195 ms)] [21:09:27] : [Step 4/5] [2021-11-19 21:09:27,850][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][root] Node started with the following configuration [id=106dcde6-3f99-4598-b535-e4132e2ef001, marshaller=BinaryMarshaller [], discovery=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=5000, ackTimeout=5000, marsh=JdkMarshaller [clsFilter=org.apache.ignite.marshaller.MarshallerUtils$1@57734fde], reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], binaryCfg=null, lateAff=true] [21:09:27] : [Step 4/5] [2021-11-19 21:09:27,852][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][GridClusterStateProcessor] Sending activate cluster request with BaselineTopology BaselineTopology [id=0, branchingHash=-2475315501, branchingType='New BaselineTopology', baselineNodes=[grid-1, grid-0]] [21:09:27] : [Step 4/5] [2021-11-19 21:09:27,857][INFO ][disco-notifier-worker-#18309%grid-0%][GridClusterStateProcessor] Received activate cluster request with BaselineTopology[id=0] initiator node ID: 0013589e-122f-4d50-8c70-af3d127be000 [21:09:27] : [Step 4/5] [2021-11-19 21:09:27,857][INFO ][disco-notifier-worker-#18309%grid-0%][GridClusterStateProcessor] Started state transition: activate cluster [21:09:27] : [Step 4/5] [2021-11-19 21:09:27,858][INFO ][exchange-worker-#18314%grid-0%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], crd=true, evt=DISCOVERY_CUSTOM_EVT, evtNode=0013589e-122f-4d50-8c70-af3d127be000, customEvt=ChangeGlobalStateMessage [id=1ae6d593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqId=66ce4848-3530-434c-ac79-bf218d875818, initiatingNodeId=0013589e-122f-4d50-8c70-af3d127be000, state=ACTIVE, baselineTopology=BaselineTopology [id=0, branchingHash=-2475315501, branchingType='New BaselineTopology', baselineNodes=[grid-1, grid-0]], forceChangeBaselineTopology=false, timestamp=1637345367852, forceDeactivation=true], allowMerge=false, exchangeFreeSwitch=false] [21:09:27] : [Step 4/5] [2021-11-19 21:09:27,858][INFO ][disco-notifier-worker-#18427%grid-1%][GridClusterStateProcessor] Received activate cluster request with BaselineTopology[id=0] initiator node ID: 0013589e-122f-4d50-8c70-af3d127be000 [21:09:27] : [Step 4/5] [2021-11-19 21:09:27,859][INFO ][exchange-worker-#18314%grid-0%][GridDhtPartitionsExchangeFuture] Start activation process [nodeId=0013589e-122f-4d50-8c70-af3d127be000, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]]. New state: ACTIVE [21:09:27] : [Step 4/5] [2021-11-19 21:09:27,859][INFO ][disco-notifier-worker-#18427%grid-1%][GridClusterStateProcessor] Started state transition: activate cluster [21:09:27] : [Step 4/5] [2021-11-19 21:09:27,860][INFO ][exchange-worker-#18314%grid-0%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0 [21:09:27] : [Step 4/5] [2021-11-19 21:09:27,860][INFO ][exchange-worker-#18436%grid-1%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], crd=false, evt=DISCOVERY_CUSTOM_EVT, evtNode=0013589e-122f-4d50-8c70-af3d127be000, customEvt=ChangeGlobalStateMessage [id=1ae6d593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqId=66ce4848-3530-434c-ac79-bf218d875818, initiatingNodeId=0013589e-122f-4d50-8c70-af3d127be000, state=ACTIVE, baselineTopology=BaselineTopology [id=0, branchingHash=-2475315501, branchingType='New BaselineTopology', baselineNodes=[grid-1, grid-0]], forceChangeBaselineTopology=false, timestamp=1637345367852, forceDeactivation=true], allowMerge=false, exchangeFreeSwitch=false] [21:09:27] : [Step 4/5] [2021-11-19 21:09:27,862][INFO ][exchange-worker-#18314%grid-0%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000000.wal, offset=8713, ver=2] [21:09:27] : [Step 4/5] [2021-11-19 21:09:27,862][INFO ][exchange-worker-#18436%grid-1%][GridDhtPartitionsExchangeFuture] Start activation process [nodeId=106dcde6-3f99-4598-b535-e4132e2ef001, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]]. New state: ACTIVE [21:09:27] : [Step 4/5] [2021-11-19 21:09:27,863][INFO ][exchange-worker-#18436%grid-1%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1 [21:09:27] : [Step 4/5] [2021-11-19 21:09:27,863][INFO ][exchange-worker-#18314%grid-0%][GridClusterStateProcessor] Writing BaselineTopology[id=0] [21:09:27] : [Step 4/5] [2021-11-19 21:09:27,865][INFO ][exchange-worker-#18436%grid-1%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000000.wal, offset=8713, ver=2] [21:09:27] : [Step 4/5] [2021-11-19 21:09:27,868][INFO ][exchange-worker-#18436%grid-1%][GridClusterStateProcessor] Writing BaselineTopology[id=0] [21:09:27] : [Step 4/5] [2021-11-19 21:09:27,879][INFO ][exchange-worker-#18314%grid-0%][GridCacheDatabaseSharedManager] Finish recovery performed in 19 ms. [21:09:27] : [Step 4/5] [2021-11-19 21:09:27,880][INFO ][exchange-worker-#18436%grid-1%][GridCacheDatabaseSharedManager] Finish recovery performed in 16 ms. [21:09:27] : [Step 4/5] [2021-11-19 21:09:27,880][INFO ][exchange-worker-#18314%grid-0%][msg] Components activation performed in 20 ms. [21:09:27] : [Step 4/5] [2021-11-19 21:09:27,881][INFO ][exchange-worker-#18436%grid-1%][msg] Components activation performed in 18 ms. [21:09:27] : [Step 4/5] [2021-11-19 21:09:27,882][INFO ][exchange-worker-#18314%grid-0%][GridCacheProcessor] Finished recovery for cache [cache=ignite-sys-cache, grp=ignite-sys-cache, startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:09:27] : [Step 4/5] [2021-11-19 21:09:27,882][INFO ][exchange-worker-#18436%grid-1%][GridCacheProcessor] Finished recovery for cache [cache=ignite-sys-cache, grp=ignite-sys-cache, startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:09:27] : [Step 4/5] [2021-11-19 21:09:27,882][INFO ][exchange-worker-#18314%grid-0%][GridDhtPartitionsExchangeFuture] Successfully activated caches [nodeId=0013589e-122f-4d50-8c70-af3d127be000, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], newState=ACTIVE] [21:09:27] : [Step 4/5] [2021-11-19 21:09:27,883][INFO ][exchange-worker-#18436%grid-1%][GridDhtPartitionsExchangeFuture] Successfully activated caches [nodeId=106dcde6-3f99-4598-b535-e4132e2ef001, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], newState=ACTIVE] [21:09:27] : [Step 4/5] [2021-11-19 21:09:27,883][INFO ][exchange-worker-#18314%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:09:27] : [Step 4/5] [2021-11-19 21:09:27,883][INFO ][exchange-worker-#18436%grid-1%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:09:27] : [Step 4/5] [2021-11-19 21:09:27,893][INFO ][grid-nio-worker-tcp-comm-0-#18253%TestRecordingCommunicationSpi%][TestRecordingCommunicationSpi] Accepted incoming communication connection [locAddr=/127.0.0.1:47100, rmtAddr=/127.0.0.1:58666] [21:09:27] : [Step 4/5] [2021-11-19 21:09:27,895][INFO ][grid-nio-worker-tcp-comm-0-#18371%TestRecordingCommunicationSpi%][TestRecordingCommunicationSpi] Established outgoing communication connection [locAddr=/127.0.0.1:58666, rmtAddr=/127.0.0.1:47100] [21:09:27] : [Step 4/5] [2021-11-19 21:09:27,895][INFO ][exchange-worker-#18436%grid-1%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], crd=false] [21:09:27] : [Step 4/5] [2021-11-19 21:09:27,918][INFO ][exchange-worker-#18314%grid-0%][GridDhtPartitionsExchangeFuture] Coordinator received single message [ver=AffinityTopologyVersion [topVer=2, minorTopVer=1], node=106dcde6-3f99-4598-b535-e4132e2ef001, allReceived=true] [21:09:27] : [Step 4/5] [2021-11-19 21:09:27,919][INFO ][db-checkpoint-thread-#18445%grid-1%][Checkpointer] Checkpoint started [checkpointId=56119796-b45d-43c5-b7aa-cbe0255e3a58, startPtr=WALPointer [idx=0, fileOff=66975, len=1963], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=9ms, writeCheckpointEntryDuration=20ms, splitAndSortCpPagesDuration=0ms, pages=16, reason='node started'] [21:09:27] : [Step 4/5] [2021-11-19 21:09:27,919][INFO ][exchange-worker-#18314%grid-0%][GridDhtPartitionsExchangeFuture] finishExchangeOnCoordinator [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:09:27] : [Step 4/5] [2021-11-19 21:09:27,926][INFO ][exchange-worker-#18314%grid-0%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], err=null, rebalanced=true, wasRebalanced=false] [21:09:27] : [Step 4/5] [2021-11-19 21:09:27,927][INFO ][sys-#18417%grid-1%][GridDhtPartitionsExchangeFuture] Received full message, will finish exchange [node=0013589e-122f-4d50-8c70-af3d127be000, resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:09:27] : [Step 4/5] [2021-11-19 21:09:27,926][INFO ][disco-notifier-worker-#18309%grid-0%][GridClusterStateProcessor] Received state change finish message: ACTIVE [21:09:27] : [Step 4/5] [2021-11-19 21:09:27,929][INFO ][sys-#18408%grid-1%][GridCachePartitionExchangeManager] Delay process full message without exchange id (there is exchange in progress) [nodeId=0013589e-122f-4d50-8c70-af3d127be000] [21:09:27] : [Step 4/5] [2021-11-19 21:09:27,929][INFO ][exchange-worker-#18314%grid-0%][GridCacheProcessor] Finish proxy initialization, cacheName=ignite-sys-cache, localNodeId=0013589e-122f-4d50-8c70-af3d127be000 [21:09:27] : [Step 4/5] [2021-11-19 21:09:27,937][INFO ][sys-#18417%grid-1%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], err=null, rebalanced=true, wasRebalanced=false] [21:09:27] : [Step 4/5] [2021-11-19 21:09:27,928][INFO ][disco-notifier-worker-#18427%grid-1%][GridClusterStateProcessor] Received state change finish message: ACTIVE [21:09:27] : [Step 4/5] [2021-11-19 21:09:27,937][INFO ][exchange-worker-#18314%grid-0%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=0013589e-122f-4d50-8c70-af3d127be000, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=0013589e-122f-4d50-8c70-af3d127be000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345367927, loc=true, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:09:27] : [Step 4/5] [2021-11-19 21:09:27,937][INFO ][sys-#18291%grid-0%][DistributedBaselineConfiguration] Baseline auto-adjust is 'disabled' with timeout='300000' ms [21:09:27] : [Step 4/5] [2021-11-19 21:09:27,936][INFO ][disco-notifier-worker-#18309%grid-0%][GridClusterStateProcessor] Cluster state was changed from INACTIVE to ACTIVE [21:09:27] : [Step 4/5] [2021-11-19 21:09:27,954][INFO ][sys-#18291%grid-0%][GridClusterStateProcessor] Successfully performed final activation steps [nodeId=0013589e-122f-4d50-8c70-af3d127be000, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:09:27] : [Step 4/5] [2021-11-19 21:09:27,945][INFO ][exchange-worker-#18314%grid-0%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (1 ms), stage="Update caches registry" (23 ms), stage="Start caches" (0 ms), stage="Affinity initialization on cache group start" (0 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Restore partition states" (0 ms), stage="After states restored callback" (34 ms), stage="WAL history reservation" (0 ms), stage="Waiting for all single messages" (0 ms), stage="Affinity recalculation (crd)" (1 ms), stage="Collect update counters and create affinity messages" (0 ms), stage="Assign partitions states" (0 ms), stage="Validate partitions states" (0 ms), stage="Ideal affinity diff calculation (enforced)" (0 ms), stage="Apply update counters" (0 ms), stage="Full message preparing" (3 ms), stage="Full message sending" (0 ms), stage="State finish message sending" (0 ms), stage="Detect lost partitions" (3 ms), stage="Exchange done" (16 ms), stage="Total time" (81 ms), Discovery lag=3 ms, Latest started node id=106dcde6-3f99-4598-b535-e4132e2ef001] [21:09:27] : [Step 4/5] [2021-11-19 21:09:27,944][INFO ][sys-#18417%grid-1%][GridCacheProcessor] Finish proxy initialization, cacheName=ignite-sys-cache, localNodeId=106dcde6-3f99-4598-b535-e4132e2ef001 [21:09:27] : [Step 4/5] [2021-11-19 21:09:27,943][INFO ][disco-notifier-worker-#18427%grid-1%][GridClusterStateProcessor] Cluster state was changed from INACTIVE to ACTIVE [21:09:27] : [Step 4/5] [2021-11-19 21:09:27,958][INFO ][sys-#18422%grid-1%][DistributedBaselineConfiguration] Baseline auto-adjust is 'disabled' with timeout='300000' ms [21:09:27] : [Step 4/5] [2021-11-19 21:09:27,957][INFO ][exchange-worker-#18314%grid-0%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], stage="Affinity initialization on cache group start [grp=ignite-sys-cache]" (0 ms) (parent=Affinity initialization on cache group start), stage="Affinity centralized initialization (crd) [grp=ignite-sys-cache, crd=true]" (0 ms) (parent=Determine exchange type), stage="Restore partition states [grp=ignite-sys-cache]" (0 ms) (parent=Restore partition states), stage="Affinity recalculation (partitions availability) [grp=ignite-sys-cache]" (0 ms) (parent=Ideal affinity diff calculation (enforced))] [21:09:27] : [Step 4/5] [2021-11-19 21:09:27,954][INFO ][db-checkpoint-thread-#18450%grid-0%][Checkpointer] Checkpoint started [checkpointId=e4075c09-4892-4fbd-a34d-f0ab16d1288d, startPtr=WALPointer [idx=0, fileOff=73082, len=1963], checkpointBeforeLockTime=2ms, checkpointLockWait=26ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=9ms, writeCheckpointEntryDuration=27ms, splitAndSortCpPagesDuration=0ms, pages=17, reason='node started'] [21:09:27] : [Step 4/5] [2021-11-19 21:09:27,960][INFO ][exchange-worker-#18314%grid-0%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], crd=true] [21:09:27] : [Step 4/5] [2021-11-19 21:09:27,960][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][root] awaitPartitionMapExchange finished [21:09:27] : [Step 4/5] [2021-11-19 21:09:27,959][INFO ][sys-#18422%grid-1%][GridClusterStateProcessor] Successfully performed final activation steps [nodeId=106dcde6-3f99-4598-b535-e4132e2ef001, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:09:27] : [Step 4/5] [2021-11-19 21:09:27,959][INFO ][sys-#18417%grid-1%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=106dcde6-3f99-4598-b535-e4132e2ef001, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=0013589e-122f-4d50-8c70-af3d127be000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345367806, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:09:27] : [Step 4/5] [2021-11-19 21:09:27,959][INFO ][exchange-worker-#18436%grid-1%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=2, minorTopVer=1], force=false, evt=DISCOVERY_CUSTOM_EVT, node=0013589e-122f-4d50-8c70-af3d127be000] [21:09:27] : [Step 4/5] [2021-11-19 21:09:27,963][INFO ][sys-#18417%grid-1%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (1 ms), stage="Update caches registry" (19 ms), stage="Start caches" (0 ms), stage="Affinity initialization on cache group start" (0 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Restore partition states" (0 ms), stage="After states restored callback" (6 ms), stage="WAL history reservation" (0 ms), stage="Waiting for Full message" (36 ms), stage="Affinity recalculation" (8 ms), stage="Full map updating" (0 ms), stage="Detect lost partitions" (6 ms), stage="Exchange done" (19 ms), stage="Total time" (95 ms)] [21:09:27] : [Step 4/5] [2021-11-19 21:09:27,961][INFO ][exchange-worker-#18314%grid-0%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=2, minorTopVer=1], force=false, evt=DISCOVERY_CUSTOM_EVT, node=0013589e-122f-4d50-8c70-af3d127be000] [21:09:27] : [Step 4/5] [2021-11-19 21:09:27,974][INFO ][sys-#18417%grid-1%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], stage="Affinity initialization on cache group start [grp=ignite-sys-cache]" (0 ms) (parent=Affinity initialization on cache group start), stage="Affinity centralized initialization (crd) [grp=ignite-sys-cache, crd=false]" (0 ms) (parent=Determine exchange type), stage="Restore partition states [grp=ignite-sys-cache]" (0 ms) (parent=Restore partition states), stage="Affinity applying from full message [grp=ignite-sys-cache]" (8 ms) (parent=Affinity recalculation)] [21:09:27] : [Step 4/5] [2021-11-19 21:09:27,973][INFO ][db-checkpoint-thread-#18445%grid-1%][Checkpointer] Checkpoint finished [cpId=56119796-b45d-43c5-b7aa-cbe0255e3a58, pages=16, markPos=WALPointer [idx=0, fileOff=66975, len=1963], walSegmentsCovered=[], markDuration=30ms, pagesWrite=1ms, fsync=52ms, total=84ms] [21:09:28] : [Step 4/5] [2021-11-19 21:09:28,013][INFO ][exchange-worker-#18314%grid-0%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], crd=true, evt=DISCOVERY_CUSTOM_EVT, evtNode=0013589e-122f-4d50-8c70-af3d127be000, customEvt=DynamicCacheChangeBatch [id=5ce6d593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqs=ArrayList [DynamicCacheChangeRequest [cacheName=encrypted, hasCfg=true, nodeId=0013589e-122f-4d50-8c70-af3d127be000, clientStartOnly=false, stop=false, destroy=false, disabledAfterStart=false]], exchangeActions=ExchangeActions [startCaches=[encrypted], stopCaches=null, startGrps=[encrypted], stopGrps=[], resetParts=null, stateChangeRequest=null], startCaches=false], allowMerge=false, exchangeFreeSwitch=false] [21:09:28] : [Step 4/5] [2021-11-19 21:09:28,015][INFO ][exchange-worker-#18436%grid-1%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], crd=false, evt=DISCOVERY_CUSTOM_EVT, evtNode=0013589e-122f-4d50-8c70-af3d127be000, customEvt=DynamicCacheChangeBatch [id=5ce6d593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqs=ArrayList [DynamicCacheChangeRequest [cacheName=encrypted, hasCfg=true, nodeId=0013589e-122f-4d50-8c70-af3d127be000, clientStartOnly=false, stop=false, destroy=false, disabledAfterStart=false]], exchangeActions=ExchangeActions [startCaches=[encrypted], stopCaches=null, startGrps=[encrypted], stopGrps=[], resetParts=null, stateChangeRequest=null], startCaches=false], allowMerge=false, exchangeFreeSwitch=false] [21:09:28] : [Step 4/5] [2021-11-19 21:09:28,015][INFO ][exchange-worker-#18314%grid-0%][PageMemoryImpl] Started page memory [memoryAllocated=24.0 MiB, pages=5952, tableSize=474.2 KiB, replacementSize=768 B, checkpointBuffer=10.0 MiB] [21:09:28] : [Step 4/5] [2021-11-19 21:09:28,018][INFO ][exchange-worker-#18436%grid-1%][PageMemoryImpl] Started page memory [memoryAllocated=24.0 MiB, pages=5952, tableSize=474.2 KiB, replacementSize=768 B, checkpointBuffer=10.0 MiB] [21:09:28] : [Step 4/5] [2021-11-19 21:09:28,082][INFO ][exchange-worker-#18436%grid-1%][GridCacheProcessor] Started cache [name=encrypted, id=1613773252, dataRegionName=default, mode=PARTITIONED, atomicity=ATOMIC, backups=0, mvcc=false] [21:09:28]W: [org.apache.ignite:ignite-core] [2021-11-19 21:09:28,083][WARN ][exchange-worker-#18436%grid-1%][CacheAffinitySharedManager] Cache group 'encrypted' brings high overhead for its metainformation in data region 'default'. Metainformation required for its partitions (522 partitions, 4096 bytes per partition, 2 MBs total) will consume more than 15% of data region memory (10 MBs). It may lead to critical errors on the node and cluster instability. Please reduce number of partitions, add more memory to the data region or add more server nodes for this cache group. [21:09:28] : [Step 4/5] [2021-11-19 21:09:28,084][INFO ][exchange-worker-#18436%grid-1%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], waitTime=0ms, futInfo=NA, mode=DISTRIBUTED] [21:09:28] : [Step 4/5] [2021-11-19 21:09:28,089][INFO ][exchange-worker-#18314%grid-0%][GridCacheProcessor] Started cache [name=encrypted, id=1613773252, dataRegionName=default, mode=PARTITIONED, atomicity=ATOMIC, backups=0, mvcc=false] [21:09:28]W: [org.apache.ignite:ignite-core] [2021-11-19 21:09:28,090][WARN ][exchange-worker-#18314%grid-0%][CacheAffinitySharedManager] Cache group 'encrypted' brings high overhead for its metainformation in data region 'default'. Metainformation required for its partitions (502 partitions, 4096 bytes per partition, 1 MBs total) will consume more than 15% of data region memory (10 MBs). It may lead to critical errors on the node and cluster instability. Please reduce number of partitions, add more memory to the data region or add more server nodes for this cache group. [21:09:28] : [Step 4/5] [2021-11-19 21:09:28,091][INFO ][exchange-worker-#18314%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], waitTime=0ms, futInfo=NA, mode=DISTRIBUTED] [21:09:28] : [Step 4/5] [2021-11-19 21:09:28,091][INFO ][exchange-worker-#18314%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partitions release latch: ServerLatch [permits=0, pendingAcks=HashSet [], super=CompletableLatch [id=CompletableLatchUid [id=exchange, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2]]]] [21:09:28] : [Step 4/5] [2021-11-19 21:09:28,092][INFO ][exchange-worker-#18314%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:09:28] : [Step 4/5] [2021-11-19 21:09:28,092][INFO ][exchange-worker-#18436%grid-1%][GridDhtPartitionsExchangeFuture] Finished waiting for partitions release latch: ClientLatch [coordinator=TcpDiscoveryNode [id=0013589e-122f-4d50-8c70-af3d127be000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345367806, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], ackSent=true, super=CompletableLatch [id=CompletableLatchUid [id=exchange, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2]]]] [21:09:28] : [Step 4/5] [2021-11-19 21:09:28,094][INFO ][exchange-worker-#18436%grid-1%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:09:28] : [Step 4/5] [2021-11-19 21:09:28,122][INFO ][exchange-worker-#18314%grid-0%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], crd=true] [21:09:28] : [Step 4/5] [2021-11-19 21:09:28,146][INFO ][exchange-worker-#18436%grid-1%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], crd=false] [21:09:28] : [Step 4/5] [2021-11-19 21:09:28,147][INFO ][sys-#18299%grid-0%][GridDhtPartitionsExchangeFuture] Coordinator received single message [ver=AffinityTopologyVersion [topVer=2, minorTopVer=2], node=106dcde6-3f99-4598-b535-e4132e2ef001, allReceived=true] [21:09:28] : [Step 4/5] [2021-11-19 21:09:28,147][INFO ][sys-#18299%grid-0%][GridDhtPartitionsExchangeFuture] finishExchangeOnCoordinator [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2]] [21:09:28] : [Step 4/5] [2021-11-19 21:09:28,151][INFO ][sys-#18299%grid-0%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], err=null, rebalanced=true, wasRebalanced=true] [21:09:28] : [Step 4/5] [2021-11-19 21:09:28,153][INFO ][sys-#18299%grid-0%][GridCacheProcessor] Finish proxy initialization, cacheName=encrypted, localNodeId=0013589e-122f-4d50-8c70-af3d127be000 [21:09:28] : [Step 4/5] [2021-11-19 21:09:28,153][INFO ][sys-#18415%grid-1%][GridDhtPartitionsExchangeFuture] Received full message, will finish exchange [node=0013589e-122f-4d50-8c70-af3d127be000, resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2]] [21:09:28] : [Step 4/5] [2021-11-19 21:09:28,153][INFO ][sys-#18299%grid-0%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=0013589e-122f-4d50-8c70-af3d127be000, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=0013589e-122f-4d50-8c70-af3d127be000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345367958, loc=true, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2]] [21:09:28] : [Step 4/5] [2021-11-19 21:09:28,156][INFO ][sys-#18299%grid-0%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (1 ms), stage="Update caches registry" (0 ms), stage="Start caches" (74 ms), stage="Affinity initialization on cache group start" (1 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Wait partitions release latch [latch=exchange]" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Restore partition states" (9 ms), stage="After states restored callback" (20 ms), stage="WAL history reservation" (0 ms), stage="Waiting for all single messages" (24 ms), stage="Affinity recalculation (crd)" (0 ms), stage="Collect update counters and create affinity messages" (0 ms), stage="Assign partitions states" (1 ms), stage="Validate partitions states" (0 ms), stage="Apply update counters" (0 ms), stage="Full message preparing" (1 ms), stage="Full message sending" (0 ms), stage="Exchange done" (5 ms), stage="Total time" (136 ms), Discovery lag=2 ms, Latest started node id=106dcde6-3f99-4598-b535-e4132e2ef001] [21:09:28] : [Step 4/5] [2021-11-19 21:09:28,158][INFO ][sys-#18299%grid-0%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], stage="Affinity initialization on cache group start [grp=encrypted]" (0 ms) (parent=Affinity initialization on cache group start), stage="Restore partition states [grp=encrypted]" (9 ms) (parent=Restore partition states), stage="Restore partition states [grp=ignite-sys-cache]" (0 ms) (parent=Restore partition states)] [21:09:28] : [Step 4/5] [2021-11-19 21:09:28,156][INFO ][sys-#18415%grid-1%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], err=null, rebalanced=true, wasRebalanced=true] [21:09:28] : [Step 4/5] [2021-11-19 21:09:28,154][INFO ][exchange-worker-#18314%grid-0%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=2, minorTopVer=2], force=false, evt=DISCOVERY_CUSTOM_EVT, node=0013589e-122f-4d50-8c70-af3d127be000] [21:09:28] : [Step 4/5] [2021-11-19 21:09:28,160][INFO ][sys-#18415%grid-1%][GridCacheProcessor] Finish proxy initialization, cacheName=encrypted, localNodeId=106dcde6-3f99-4598-b535-e4132e2ef001 [21:09:28] : [Step 4/5] [2021-11-19 21:09:28,160][INFO ][sys-#18415%grid-1%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=106dcde6-3f99-4598-b535-e4132e2ef001, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=0013589e-122f-4d50-8c70-af3d127be000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345367806, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2]] [21:09:28] : [Step 4/5] [2021-11-19 21:09:28,161][INFO ][sys-#18415%grid-1%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (1 ms), stage="Update caches registry" (1 ms), stage="Start caches" (65 ms), stage="Affinity initialization on cache group start" (1 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Wait partitions release latch [latch=exchange]" (9 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Restore partition states" (17 ms), stage="After states restored callback" (32 ms), stage="WAL history reservation" (0 ms), stage="Waiting for Full message" (7 ms), stage="Affinity recalculation" (0 ms), stage="Full map updating" (2 ms), stage="Exchange done" (5 ms), stage="Total time" (140 ms)] [21:09:28] : [Step 4/5] [2021-11-19 21:09:28,162][INFO ][sys-#18415%grid-1%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], stage="Affinity initialization on cache group start [grp=encrypted]" (0 ms) (parent=Affinity initialization on cache group start), stage="Restore partition states [grp=encrypted]" (17 ms) (parent=Restore partition states), stage="Restore partition states [grp=ignite-sys-cache]" (0 ms) (parent=Restore partition states)] [21:09:28] : [Step 4/5] [2021-11-19 21:09:28,161][INFO ][exchange-worker-#18436%grid-1%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=2, minorTopVer=2], force=false, evt=DISCOVERY_CUSTOM_EVT, node=0013589e-122f-4d50-8c70-af3d127be000] [21:09:28] : [Step 4/5] [2021-11-19 21:09:28,748][INFO ][db-checkpoint-thread-#18450%grid-0%][Checkpointer] Checkpoint finished [cpId=e4075c09-4892-4fbd-a34d-f0ab16d1288d, pages=17, markPos=WALPointer [idx=0, fileOff=73082, len=1963], walSegmentsCovered=[], markDuration=43ms, pagesWrite=1ms, fsync=786ms, total=858ms] [21:09:31] : [Step 4/5] [2021-11-19 21:09:31,623][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:09:31] : [Step 4/5] [2021-11-19 21:09:31,765][INFO ][disco-notifier-worker-#18427%grid-1%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:09:31] : [Step 4/5] [2021-11-19 21:09:31,767][INFO ][disco-notifier-worker-#18309%grid-0%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:09:31] : [Step 4/5] [2021-11-19 21:09:31,905][INFO ][disco-notifier-worker-#18427%grid-1%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:09:31] : [Step 4/5] [2021-11-19 21:09:31,913][INFO ][disco-notifier-worker-#18309%grid-0%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:09:31] : [Step 4/5] [2021-11-19 21:09:31,999][INFO ][disco-notifier-worker-#18309%grid-0%][GridEncryptionManager] Start master key change [masterKeyName=ignite.master.key2] [21:09:31] : [Step 4/5] [2021-11-19 21:09:31,999][INFO ][disco-notifier-worker-#18427%grid-1%][GridEncryptionManager] Start master key change [masterKeyName=ignite.master.key2] [21:09:32] : [Step 4/5] [2021-11-19 21:09:32,056][INFO ][disco-notifier-worker-#18427%grid-1%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:09:32] : [Step 4/5] [2021-11-19 21:09:32,056][INFO ][disco-notifier-worker-#18309%grid-0%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:09:32] : [Step 4/5] [2021-11-19 21:09:32,464][INFO ][disco-notifier-worker-#18309%grid-0%][GridEncryptionManager] Master key successfully changed [masterKeyName=ignite.master.key2] [21:09:32] : [Step 4/5] [2021-11-19 21:09:32,464][INFO ][disco-notifier-worker-#18427%grid-1%][GridEncryptionManager] Master key successfully changed [masterKeyName=ignite.master.key2] [21:09:32] : [Step 4/5] [2021-11-19 21:09:32,500][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][root] >>> Stopping grid [name=grid-1, id=106dcde6-3f99-4598-b535-e4132e2ef001] [21:09:32] : [Step 4/5] [2021-11-19 21:09:32,531][INFO ][db-checkpoint-thread-#18445%grid-1%][Checkpointer] Checkpoint started [checkpointId=5c4a47ea-8702-43b3-86cd-22da047d7115, startPtr=WALPointer [idx=0, fileOff=630150, len=11871], checkpointBeforeLockTime=4ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=1ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=10ms, writeCheckpointEntryDuration=10ms, splitAndSortCpPagesDuration=1ms, pages=454, reason='timeout'] [21:09:32] : [Step 4/5] [2021-11-19 21:09:32,539][INFO ][tcp-disco-sock-reader-[0013589e 127.0.0.1:39693]-#966%grid-1%-#18432%grid-1%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:39693, rmtPort=39693, rmtNodeId=0013589e-122f-4d50-8c70-af3d127be000] [21:09:32] : [Step 4/5] [2021-11-19 21:09:32,540][INFO ][disco-event-worker-#18313%grid-0%][GridDiscoveryManager] Node left topology: TcpDiscoveryNode [id=106dcde6-3f99-4598-b535-e4132e2ef001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637345367786, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false] [21:09:32] : [Step 4/5] [2021-11-19 21:09:32,542][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][GridCacheProcessor] Stopped cache [cacheName=ignite-sys-cache] [21:09:32] : [Step 4/5] [2021-11-19 21:09:32,543][INFO ][disco-event-worker-#18313%grid-0%][GridDiscoveryManager] Topology snapshot [ver=3, locNode=0013589e, servers=1, clients=0, state=ACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=0013589e-122f-4d50-8c70-af3d127be000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:09:32] : [Step 4/5] [2021-11-19 21:09:32,544][INFO ][disco-event-worker-#18313%grid-0%][GridDiscoveryManager] ^-- Baseline [id=0, size=2, online=1, offline=1] [21:09:32] : [Step 4/5] [2021-11-19 21:09:32,543][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][GridCacheProcessor] Stopped cache [cacheName=encrypted] [21:09:32] : [Step 4/5] [2021-11-19 21:09:32,546][INFO ][exchange-worker-#18314%grid-0%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], crd=true, evt=NODE_LEFT, evtNode=106dcde6-3f99-4598-b535-e4132e2ef001, customEvt=null, allowMerge=false, exchangeFreeSwitch=true] [21:09:32] : [Step 4/5] [2021-11-19 21:09:32,547][INFO ][sys-#18291%grid-0%][GridAffinityAssignmentCache] Local node affinity assignment distribution is not ideal [cache=encrypted, expectedPrimary=1024.00, actualPrimary=502, expectedBackups=0.00, actualBackups=0, warningThreshold=50.00%] [21:09:32] : [Step 4/5] [2021-11-19 21:09:32,548][INFO ][exchange-worker-#18314%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:09:32] : [Step 4/5] [2021-11-19 21:09:32,549][INFO ][exchange-worker-#18314%grid-0%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], err=null, rebalanced=true, wasRebalanced=true] [21:09:32]W: [org.apache.ignite:ignite-core] [2021-11-19 21:09:32,551][WARN ][sys-#18296%grid-0%][GridDhtPartitionTopologyImpl] Detected lost partitions [grp=encrypted, parts=[0, 2, 4, 6-7, 10-11, 14, 17, 21, 24-30, 32, 37, 40, 44, 47-52, 54, 57, 59, 62-64, 67-68, 74-75, 78, 81, 87-88, 91, 97, 99, 101-102, 104-107, 113-114, 116, 118, 120, 122, 124, 135-136, 138, 140-145, 147, 149-152, 154-156, 159-160, 162-164, 169, 172, 175-177, 180, 184-187, 190-191, 194, 196-202, 204-205, 209-210, 212, 214, 216, 219-224, 226, 229-232, 237, 239, 241, 243-245, 247, 249-251, 255, 257, 261, 265, 269, 272-273, 276-277, 281-282, 285, 287, 289-291, 293-297, 299, 301-304, 306, 308-309, 311-312, 315-317, 319, 322, 325-326, 328-330, 336, 339, 341, 344-346, 350, 352-354, 357-361, 363, 366-367, 371-373, 376-380, 383, 385, 387-388, 390, 392, 395-397, 400, 402, 405, 408-411, 416, 420, 422, 424-425, 429, 433, 435-438, 440-441, 445-446, 450, 452-453, 455-456, 458, 460, 462-463, 465-468, 470, 474-475, 480, 488, 490-492, 495, 497, 499-512, 516, 525, 527-531, 535, 537-538, 541-542, 545-546, 548-552, 554-555, 558, 562-564, 567-569, 572, 574, 579-580, 582-585, 587, 590-591, 594, 596, 600, 602, 604, 607-614, 617-620, 623-624, 627-629, 632-633, 636, 638, 640-642, 645-646, 648-649, 657-662, 664-665, 668-672, 677-678, 682-684, 686, 689, 692-693, 695-697, 699, 706-707, 709-710, 712-714, 716-717, 719-721, 723-728, 730-732, 734-735, 739, 742, 746, 749-750, 752, 754, 756, 762, 768-770, 772-775, 778, 780, 783-787, 789-791, 793, 796, 798-801, 803, 806, 809-812, 814, 816-817, 819, 822-825, 827-829, 832-833, 836-837, 839-840, 846, 848-851, 853-854, 857-858, 860, 863-864, 866, 868-871, 873-875, 877-878, 884, 888-889, 896-897, 900, 905-907, 914-915, 917, 919-920, 923-925, 931-933, 936, 940, 942, 944-945, 948, 950-951, 954, 956-958, 962, 965-970, 972, 975-976, 978-980, 983, 985, 988, 990, 993-994, 997-998, 1000, 1003-1004, 1007, 1009, 1014, 1016, 1018-1019], topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0]] [21:09:32] : [Step 4/5] [2021-11-19 21:09:32,556][INFO ][exchange-worker-#18314%grid-0%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=0013589e-122f-4d50-8c70-af3d127be000, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], evt=NODE_LEFT, evtNode=TcpDiscoveryNode [id=106dcde6-3f99-4598-b535-e4132e2ef001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637345367786, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0]] [21:09:32] : [Step 4/5] [2021-11-19 21:09:32,557][INFO ][exchange-worker-#18314%grid-0%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (0 ms), stage="Determine exchange type" (1 ms), stage="Preloading notification" (0 ms), stage="After states restored callback" (0 ms), stage="WAL history reservation" (0 ms), stage="Finalize update counters" (0 ms), stage="Detect lost partitions" (4 ms), stage="Exchange done" (3 ms), stage="Total time" (8 ms)] [21:09:32] : [Step 4/5] [2021-11-19 21:09:32,559][INFO ][exchange-worker-#18314%grid-0%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], stage="Affinity initialization (exchange-free switch on fully-rebalanced topology) [grp=ignite-sys-cache]" (0 ms) (parent=Determine exchange type), stage="Affinity initialization (exchange-free switch on fully-rebalanced topology) [grp=encrypted]" (0 ms) (parent=Determine exchange type)] [21:09:32] : [Step 4/5] [2021-11-19 21:09:32,560][INFO ][exchange-worker-#18314%grid-0%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], crd=true] [21:09:32] : [Step 4/5] [2021-11-19 21:09:32,561][INFO ][exchange-worker-#18314%grid-0%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=3, minorTopVer=0], force=false, evt=NODE_LEFT, node=106dcde6-3f99-4598-b535-e4132e2ef001] [21:09:34] : [Step 4/5] [2021-11-19 21:09:34,282][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][FilePageStoreManager] Cleanup cache stores [total=4, left=0, cleanFiles=false] [21:09:34] : [Step 4/5] [2021-11-19 21:09:34,284][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][GridDeploymentLocalStore] Removed undeployed class: GridDeployment [ts=1637345367917, depMode=SHARED, clsLdr=IsolatedClassLoader{roleName='test'}, clsLdrId=fae6d593d71-106dcde6-3f99-4598-b535-e4132e2ef001, userVer=0, loc=true, sampleClsName=org.apache.ignite.internal.processors.cache.distributed.dht.preloader.IgniteDhtPartitionCountersMap2, pendingUndeploy=false, undeployed=true, usage=0] [21:09:34] : [Step 4/5] [2021-11-19 21:09:34,294][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] [21:09:34] : [Step 4/5] [21:09:34] : [Step 4/5] >>> +------------------------------------------------------+ [21:09:34] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV stopped OK [21:09:34] : [Step 4/5] >>> +------------------------------------------------------+ [21:09:34] : [Step 4/5] >>> Ignite instance name: grid-1 [21:09:34] : [Step 4/5] >>> Grid uptime: 00:00:06.451 [21:09:34] : [Step 4/5] [21:09:34] : [Step 4/5] [21:09:34] : [Step 4/5] [2021-11-19 21:09:34,294][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][root] >>> Stopping grid [name=grid-0, id=0013589e-122f-4d50-8c70-af3d127be000] [21:09:34] : [Step 4/5] [2021-11-19 21:09:34,324][INFO ][db-checkpoint-thread-#18450%grid-0%][Checkpointer] Checkpoint started [checkpointId=5d2ad1ac-9868-4816-811b-8bd3eed64905, startPtr=WALPointer [idx=0, fileOff=749755, len=11491], checkpointBeforeLockTime=4ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=1ms, checkpointLockHoldTime=4ms, walCpRecordFsyncDuration=16ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=1ms, pages=574, reason='timeout'] [21:09:34] : [Step 4/5] [2021-11-19 21:09:34,329][INFO ][tcp-disco-sock-reader-[106dcde6 127.0.0.1:59651]-#967%grid-0%-#18433%grid-0%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:59651, rmtPort=59651, rmtNodeId=106dcde6-3f99-4598-b535-e4132e2ef001] [21:09:34] : [Step 4/5] [2021-11-19 21:09:34,330][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][GridCacheProcessor] Stopped cache [cacheName=ignite-sys-cache] [21:09:34] : [Step 4/5] [2021-11-19 21:09:34,331][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][GridCacheProcessor] Stopped cache [cacheName=encrypted] [21:09:34] : [Step 4/5] [2021-11-19 21:09:34,867][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][FilePageStoreManager] Cleanup cache stores [total=4, left=0, cleanFiles=false] [21:09:34] : [Step 4/5] [2021-11-19 21:09:34,869][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][GridDeploymentLocalStore] Removed undeployed class: GridDeployment [ts=1637345367887, depMode=SHARED, clsLdr=IsolatedClassLoader{roleName='test'}, clsLdrId=dae6d593d71-0013589e-122f-4d50-8c70-af3d127be000, userVer=0, loc=true, sampleClsName=org.apache.ignite.internal.processors.cache.distributed.dht.preloader.GridDhtPartitionMap, pendingUndeploy=false, undeployed=true, usage=0] [21:09:34] : [Step 4/5] [2021-11-19 21:09:34,877][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] [21:09:34] : [Step 4/5] [21:09:34] : [Step 4/5] >>> +------------------------------------------------------+ [21:09:34] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV stopped OK [21:09:34] : [Step 4/5] >>> +------------------------------------------------------+ [21:09:34] : [Step 4/5] >>> Ignite instance name: grid-0 [21:09:34] : [Step 4/5] >>> Grid uptime: 00:00:08.241 [21:09:34] : [Step 4/5] [21:09:34] : [Step 4/5] [21:09:34]W: [org.apache.ignite:ignite-core] [2021-11-19 21:09:34,882][WARN ][test-runner-#18198%encryption.MasterKeyChangeTest%][G] Ignite work directory is not provided, automatically resolved to: /opt/buildagent/work/7bc1c54bc719b67c/work [21:09:34] : [Step 4/5] [2021-11-19 21:09:34,884][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] [21:09:34] : [Step 4/5] [21:09:34] : [Step 4/5] >>> __________ ________________ [21:09:34] : [Step 4/5] >>> / _/ ___/ |/ / _/_ __/ __/ [21:09:34] : [Step 4/5] >>> _/ // (7 7 // / / / / _/ [21:09:34] : [Step 4/5] >>> /___/\___/_/|_/___/ /_/ /___/ [21:09:34] : [Step 4/5] >>> [21:09:34] : [Step 4/5] >>> ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:09:34] : [Step 4/5] >>> 2021 Copyright(C) Apache Software Foundation [21:09:34] : [Step 4/5] >>> [21:09:34] : [Step 4/5] >>> Ignite documentation: http://ignite.apache.org [21:09:34] : [Step 4/5] [21:09:34] : [Step 4/5] [2021-11-19 21:09:34,884][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] Config URL: n/a [21:09:34] : [Step 4/5] [2021-11-19 21:09:34,885][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] IgniteConfiguration [igniteInstanceName=grid-0, pubPoolSize=24, svcPoolSize=24, callbackPoolSize=24, stripedPoolSize=24, sysPoolSize=24, mgmtPoolSize=4, dataStreamerPoolSize=24, utilityCachePoolSize=24, utilityCacheKeepAliveTime=60000, p2pPoolSize=2, qryPoolSize=24, buildIdxPoolSize=4, igniteHome=/opt/buildagent/work/7bc1c54bc719b67c, igniteWorkDir=/opt/buildagent/work/7bc1c54bc719b67c/work, mbeanSrv=com.sun.jmx.mbeanserver.JmxMBeanServer@6fe85038, nodeId=00fbb7ce-7ca4-4041-bd27-a7702c9b8000, marsh=BinaryMarshaller [], marshLocJobs=false, daemon=false, p2pEnabled=true, netTimeout=10000, netCompressionLevel=1, sndRetryDelay=1000, sndRetryCnt=3, metricsHistSize=10000, metricsUpdateFreq=1000, metricsExpTime=9223372036854775807, discoSpi=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=0, ackTimeout=0, marsh=null, reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], segPlc=STOP, segResolveAttempts=2, waitForSegOnStart=true, allResolversPassReq=true, segChkFreq=10000, commSpi=TcpCommunicationSpi [connectGate=org.apache.ignite.spi.communication.tcp.internal.ConnectGateway@6c5191e3, ctxInitLatch=java.util.concurrent.CountDownLatch@222445b3[Count = 1], stopping=false, clientPool=null, nioSrvWrapper=null, stateProvider=null], evtSpi=MemoryEventStorageSpi [expireAgeMs=9223372036854775807, expireCnt=10000, filter=null], colSpi=NoopCollisionSpi [], deploySpi=LocalDeploymentSpi [], indexingSpi=org.apache.ignite.spi.indexing.noop.NoopIndexingSpi@16100916, addrRslvr=null, encryptionSpi=org.apache.ignite.spi.encryption.keystore.KeystoreEncryptionSpi@46d17573, tracingSpi=org.apache.ignite.spi.tracing.NoopTracingSpi@c0cd402, clientMode=false, rebalanceThreadPoolSize=4, rebalanceTimeout=10000, rebalanceBatchesPrefetchCnt=3, rebalanceThrottle=0, rebalanceBatchSize=524288, txCfg=TransactionConfiguration [txSerEnabled=false, dfltIsolation=REPEATABLE_READ, dfltConcurrency=PESSIMISTIC, dfltTxTimeout=0, txTimeoutOnPartitionMapExchange=0, deadlockTimeout=10000, pessimisticTxLogSize=0, pessimisticTxLogLinger=10000, tmLookupClsName=null, txManagerFactory=null, useJtaSync=false], cacheSanityCheckEnabled=true, discoStartupDelay=60000, deployMode=SHARED, p2pMissedCacheSize=100, locHost=127.0.0.1, timeSrvPortBase=31100, timeSrvPortRange=100, failureDetectionTimeout=10000, sysWorkerBlockedTimeout=null, clientFailureDetectionTimeout=10000, metricsLogFreq=0, connectorCfg=null, odbcCfg=null, warmupClos=null, atomicCfg=AtomicConfiguration [seqReserveSize=1000, cacheMode=PARTITIONED, backups=1, aff=null, grpName=null], classLdr=null, sslCtxFactory=null, platformCfg=null, binaryCfg=null, memCfg=null, pstCfg=null, dsCfg=DataStorageConfiguration [sysRegionInitSize=41943040, sysRegionMaxSize=104857600, pageSize=4096, concLvl=0, dfltDataRegConf=DataRegionConfiguration [name=default, maxSize=10485760, initSize=268435456, swapPath=null, pageEvictionMode=DISABLED, pageReplacementMode=CLOCK, evictionThreshold=0.9, emptyPagesPoolSize=100, metricsEnabled=false, metricsSubIntervalCount=5, metricsRateTimeInterval=60000, persistenceEnabled=true, checkpointPageBufSize=0, lazyMemoryAllocation=true, warmUpCfg=null], dataRegions=null, storagePath=null, checkpointFreq=180000, lockWaitTime=10000, checkpointThreads=4, checkpointWriteOrder=SEQUENTIAL, walHistSize=20, maxWalArchiveSize=1073741824, walSegments=10, walSegmentSize=67108864, walPath=db/wal, walArchivePath=db/wal/archive, cdcWalPath=db/wal/cdc, cdcEnabled=false, metricsEnabled=false, walMode=FSYNC, walTlbSize=131072, walBuffSize=0, walFlushFreq=2000, walFsyncDelay=1000, walRecordIterBuffSize=67108864, alwaysWriteFullPages=false, fileIOFactory=org.apache.ignite.internal.processors.cache.persistence.file.AsyncFileIOFactory@456334fa, metricsSubIntervalCnt=5, metricsRateTimeInterval=60000, walAutoArchiveAfterInactivity=-1, walForceArchiveTimeout=-1, writeThrottlingEnabled=false, walCompactionEnabled=false, walCompactionLevel=1, checkpointReadLockTimeout=null, walPageCompression=DISABLED, walPageCompressionLevel=null, dfltWarmUpCfg=null, encCfg=org.apache.ignite.configuration.EncryptionConfiguration@5daf0355, defragmentationThreadPoolSize=4, minWalArchiveSize=-1], snapshotPath=snapshots, activeOnStart=true, activeOnStartPropSetFlag=false, autoActivation=true, autoActivationPropSetFlag=false, clusterStateOnStart=null, sqlConnCfg=null, cliConnCfg=ClientConnectorConfiguration [host=null, port=10800, portRange=100, sockSndBufSize=0, sockRcvBufSize=0, tcpNoDelay=true, maxOpenCursorsPerConn=128, threadPoolSize=24, selectorCnt=12, idleTimeout=0, handshakeTimeout=10000, jdbcEnabled=true, odbcEnabled=true, thinCliEnabled=true, sslEnabled=false, useIgniteSslCtxFactory=true, sslClientAuth=false, sslCtxFactory=null, thinCliCfg=ThinClientConfiguration [maxActiveTxPerConn=100, maxActiveComputeTasksPerConn=0]], mvccVacuumThreadCnt=2, mvccVacuumFreq=5000, authEnabled=false, failureHnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]], commFailureRslvr=null, sqlCfg=SqlConfiguration [longQryWarnTimeout=3000, dfltQryTimeout=0, sqlQryHistSize=1000, validationEnabled=false], asyncContinuationExecutor=null] [21:09:34] : [Step 4/5] [2021-11-19 21:09:34,892][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] Daemon mode: off [21:09:34] : [Step 4/5] [2021-11-19 21:09:34,892][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] OS: Linux 4.15.0-151-generic amd64 [21:09:34] : [Step 4/5] [2021-11-19 21:09:34,892][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] OS user: teamcity [21:09:34] : [Step 4/5] [2021-11-19 21:09:34,892][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] PID: 16724 [21:09:34] : [Step 4/5] [2021-11-19 21:09:34,893][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] Language runtime: Java Platform API Specification ver. 1.8 [21:09:34] : [Step 4/5] [2021-11-19 21:09:34,893][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] VM information: Java(TM) SE Runtime Environment 1.8.0_261-b12 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 25.261-b12 [21:09:34] : [Step 4/5] [2021-11-19 21:09:34,893][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] VM total memory: 1.9GB [21:09:34] : [Step 4/5] [2021-11-19 21:09:34,893][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] Remote Management [restart: off, REST: off, JMX (remote: off)] [21:09:34] : [Step 4/5] [2021-11-19 21:09:34,894][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] Logger: GridTestLog4jLogger [quiet=false, config=null] [21:09:34] : [Step 4/5] [2021-11-19 21:09:34,894][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] IGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c [21:09:34] : [Step 4/5] [2021-11-19 21:09:34,894][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] VM arguments: [-DIGNITE_DUMP_THREADS_ON_FAILURE=false, -DMono=/usr/bin/mono-sgen, -DMono4.0_x64=/usr/lib/mono/4.0, -DMono4.5_x64=/usr/lib/mono/4.5, -DMonoVersion=6.12.0.90, -DSKIP_BUILD=false, -Dagent.home.dir=/opt/buildagent, -Dagent.name=aitc-lin02_03, -Dagent.ownPort=9090, -Dagent.work.dir=/opt/buildagent/work, -Dbuild.number=95, -Dbuild.vcs.number=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.1=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.GitHubApacheIgnite=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dclassworlds.conf=/opt/buildagent/temp/buildTmp/teamcity.m2.conf, -Dcom.jetbrains.maven.watcher.report.file=/opt/buildagent/temp/buildTmp/maven-build-info.xml, -Djava.io.tmpdir=/opt/buildagent/temp/buildTmp, -Dmaven.home=/opt/buildagent/tools/maven3_6, -Dmaven.multiModuleProjectDirectory=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.agent.cpuBenchmark=457, -Dteamcity.agent.dotnet.agent_url=http://localhost:9090/RPC2, -Dteamcity.agent.dotnet.build_id=6278078, -Dteamcity.auth.password=*******, -Dteamcity.auth.userId=TeamCityBuildId=6278078, -Dteamcity.build.changedFiles.file=/opt/buildagent/temp/buildTmp/changedFiles6342607772318147725.txt, -Dteamcity.build.checkoutDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.build.id=6278078, -Dteamcity.build.properties.file=/opt/buildagent/temp/buildTmp/teamcity.build5164517880467851002.properties, -Dteamcity.build.tempDir=/opt/buildagent/temp/buildTmp, -Dteamcity.build.workingDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.buildConfName=Basic 3, -Dteamcity.buildType.id=IgniteTests24Java8_Basic3, -Dteamcity.configuration.properties.file=/opt/buildagent/temp/buildTmp/teamcity.config5591980786735343870.properties, -Dteamcity.maven.userSettings.path=/opt/buildagent/temp/buildTmp/maven_settings_585072866407032347.xml, -Dteamcity.maven.watcher.home=/opt/buildagent/plugins/mavenPlugin/maven-watcher-jdk16, -Dteamcity.projectName=Ignite Tests 2.x (JDK 8/11), -Dteamcity.runner.properties.file=/opt/buildagent/temp/buildTmp/teamcity.runner9098465561618137420.properties, -Dteamcity.tests.recentlyFailedTests.file=/opt/buildagent/temp/buildTmp/testsToRunFirst3891775683130404069.txt, -Dteamcity.version=2021.2 (build 99542), -ea, -Xms2g, -Xmx2g, -XX:+HeapDumpOnOutOfMemoryError, -DIGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_TEST_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_UPDATE_NOTIFIER=false, -DIGNITE_NO_DISCO_ORDER=true, -DIGNITE_PERFORMANCE_SUGGESTIONS_DISABLED=true, -Djava.net.preferIPv4Stack=true, -DTEST_SCALE_FACTOR=1.0, -DIGNITE_TEST_PROP_LOG4J_FILE=log4j-tc-test.xml, -DIGNITE_QUIET=false, -DIGNITE_MARSHAL_BUFFERS_RECHECK=1000, -Dmaven.repo.local=/opt/buildagent/.m2/repository] [21:09:34] : [Step 4/5] [2021-11-19 21:09:34,898][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] System cache's DataRegion size is configured to 40 MB. Use DataStorageConfiguration.systemRegionInitialSize property to change the setting. [21:09:34] : [Step 4/5] [2021-11-19 21:09:34,898][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] Configured caches [in 'sysMemPlc' dataRegion: ['ignite-sys-cache']] [21:09:34]W: [org.apache.ignite:ignite-core] [2021-11-19 21:09:34,898][WARN ][test-runner-#18198%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] Peer class loading is enabled (disable it in production for performance and deployment consistency reasons) [21:09:34] : [Step 4/5] [2021-11-19 21:09:34,899][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] 3-rd party licenses can be found at: /opt/buildagent/work/7bc1c54bc719b67c/libs/licenses [21:09:34] : [Step 4/5] [2021-11-19 21:09:34,903][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] Configured plugins: [21:09:34] : [Step 4/5] [2021-11-19 21:09:34,903][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] ^-- StanByClusterTestProvider 1.0 [21:09:34] : [Step 4/5] [2021-11-19 21:09:34,903][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:09:34] : [Step 4/5] [2021-11-19 21:09:34,903][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] [21:09:34] : [Step 4/5] [2021-11-19 21:09:34,904][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] ^-- PageMemory tracker plugin 1.0 [21:09:34] : [Step 4/5] [2021-11-19 21:09:34,904][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:09:34] : [Step 4/5] [2021-11-19 21:09:34,904][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] [21:09:34] : [Step 4/5] [2021-11-19 21:09:34,904][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] ^-- TestDistibutedConfigurationPlugin 1.0 [21:09:34] : [Step 4/5] [2021-11-19 21:09:34,904][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:09:34] : [Step 4/5] [2021-11-19 21:09:34,904][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] [21:09:34] : [Step 4/5] [2021-11-19 21:09:34,905][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] ^-- NodeValidationPluginProvider 1.0 [21:09:34] : [Step 4/5] [2021-11-19 21:09:34,905][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:09:34] : [Step 4/5] [2021-11-19 21:09:34,905][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] [21:09:34] : [Step 4/5] [2021-11-19 21:09:34,905][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][FailureProcessor] Configured failure handler: [hnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]]] [21:09:34] : [Step 4/5] [2021-11-19 21:09:34,916][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][TestRecordingCommunicationSpi] Successfully bound communication NIO server to TCP port [port=47100, locHost=/127.0.0.1, selectorsCnt=12, selectorSpins=0, pairedConn=false] [21:09:34]W: [org.apache.ignite:ignite-core] [2021-11-19 21:09:34,916][WARN ][test-runner-#18198%encryption.MasterKeyChangeTest%][TestRecordingCommunicationSpi] Message queue limit is set to 0 which may lead to potential OOMEs when running cache operations in FULL_ASYNC or PRIMARY_SYNC modes due to message queues growth on sender and receiver sides. [21:09:34] : [Step 4/5] [2021-11-19 21:09:34,920][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][GridCollisionManager] Collision resolution is disabled (all jobs will be activated upon arrival). [21:09:34] : [Step 4/5] [2021-11-19 21:09:34,921][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] Security status [authentication=off, sandbox=off, tls/ssl=off] [21:09:34] : [Step 4/5] [2021-11-19 21:09:34,977][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:09:35] : [Step 4/5] [2021-11-19 21:09:35,063][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][MaintenanceProcessor] Resolved store directory for node persistent data: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0 [21:09:35] : [Step 4/5] [2021-11-19 21:09:35,065][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][CacheObjectBinaryProcessorImpl] Resolved directory for serialized binary metadata: /opt/buildagent/work/7bc1c54bc719b67c/work/db/binary_meta/grid_0 [21:09:35] : [Step 4/5] [2021-11-19 21:09:35,069][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0 [21:09:35] : [Step 4/5] [2021-11-19 21:09:35,070][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][FileWriteAheadLogManager] Resolved write ahead log work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0 [21:09:35] : [Step 4/5] [2021-11-19 21:09:35,070][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][FileWriteAheadLogManager] Resolved write ahead log archive directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0 [21:09:35] : [Step 4/5] [2021-11-19 21:09:35,072][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000005.wal [21:09:35] : [Step 4/5] [2021-11-19 21:09:35,072][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000006.wal [21:09:35] : [Step 4/5] [2021-11-19 21:09:35,073][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000008.wal [21:09:35] : [Step 4/5] [2021-11-19 21:09:35,073][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000004.wal [21:09:35] : [Step 4/5] [2021-11-19 21:09:35,074][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000003.wal [21:09:35] : [Step 4/5] [2021-11-19 21:09:35,074][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000002.wal [21:09:35] : [Step 4/5] [2021-11-19 21:09:35,074][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000007.wal [21:09:35] : [Step 4/5] [2021-11-19 21:09:35,075][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000001.wal [21:09:35] : [Step 4/5] [2021-11-19 21:09:35,075][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000009.wal [21:09:35] : [Step 4/5] [2021-11-19 21:09:35,080][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Configured data regions initialized successfully [total=5] [21:09:35] : [Step 4/5] [2021-11-19 21:09:35,081][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][IgniteSnapshotManager] Resolved snapshot work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/snapshots [21:09:35] : [Step 4/5] [2021-11-19 21:09:35,081][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][IgniteSnapshotManager] Resolved temp directory for snapshot creation: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0/snp [21:09:35] : [Step 4/5] [2021-11-19 21:09:35,083][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][ClientListenerProcessor] Client connector processor has started on TCP port 10800 [21:09:35] : [Step 4/5] [2021-11-19 21:09:35,088][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] Non-loopback local IPs: 172.17.0.4 [21:09:35] : [Step 4/5] [2021-11-19 21:09:35,089][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] Enabled local MACs: 0242AC110004 [21:09:35] : [Step 4/5] [2021-11-19 21:09:35,091][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=/opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0/cp/1637345374298-5d2ad1ac-9868-4816-811b-8bd3eed64905-START.bin, endMarker=/opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0/cp/1637345367890-e4075c09-4892-4fbd-a34d-f0ab16d1288d-END.bin] [21:09:35] : [Step 4/5] [2021-11-19 21:09:35,092][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:09:35] : [Step 4/5] [2021-11-19 21:09:35,092][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=73082, len=1963], lastMarked=WALPointer [idx=0, fileOff=749755, len=11491], lastCheckpointId=5d2ad1ac-9868-4816-811b-8bd3eed64905] [21:09:35] : [Step 4/5] [2021-11-19 21:09:35,191][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Found last checkpoint marker [cpId=5d2ad1ac-9868-4816-811b-8bd3eed64905, pos=WALPointer [idx=0, fileOff=749755, len=11491]] [21:09:35] : [Step 4/5] [2021-11-19 21:09:35,198][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Applying lost metastore updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=749755, len=11491], lastCheckpointId=5d2ad1ac-9868-4816-811b-8bd3eed64905] [21:09:35] : [Step 4/5] [2021-11-19 21:09:35,247][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=40 ms] [21:09:35] : [Step 4/5] [2021-11-19 21:09:35,247][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][GridCacheProcessor] Restoring partition state for local groups. [21:09:35] : [Step 4/5] [2021-11-19 21:09:35,248][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=0, partitionsProcessed=0, time=0ms] [21:09:35] : [Step 4/5] [2021-11-19 21:09:35,347][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][GridEncryptionManager] Master key name loaded from metastrore [masterKeyName=ignite.master.key2] [21:09:35] : [Step 4/5] [2021-11-19 21:09:35,403][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:09:35] : [Step 4/5] [2021-11-19 21:09:35,495][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][GridClusterStateProcessor] Restoring history for BaselineTopology[id=0] [21:09:35] : [Step 4/5] [2021-11-19 21:09:35,502][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][ClusterProcessor] Cluster ID and tag has been read from metastorage: ClusterIdAndTag [id=91c8a09d-7542-4158-8b49-e9c0724f4d93, tag=cranky_hypatia] [21:09:35] : [Step 4/5] [2021-11-19 21:09:35,502][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][IgniteClusterImpl] Shutdown policy was updated [oldVal=null, newVal=null] [21:09:35] : [Step 4/5] [2021-11-19 21:09:35,502][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustEnabled' was changed from 'null' to 'false' [21:09:35] : [Step 4/5] [2021-11-19 21:09:35,503][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustTimeout' was changed from 'null' to '300000' [21:09:35] : [Step 4/5] [2021-11-19 21:09:35,503][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][IgniteTxManager] Transactions parameter 'txOwnerDumpRequestsAllowed' was changed from 'null' to 'true' [21:09:35] : [Step 4/5] [2021-11-19 21:09:35,503][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][IgniteTxManager] Transactions parameter 'longOperationsDumpTimeout' was changed from 'null' to '60000' [21:09:35] : [Step 4/5] [2021-11-19 21:09:35,504][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpThreshold' was changed from 'null' to '0' [21:09:35] : [Step 4/5] [2021-11-19 21:09:35,504][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][IgniteTxManager] Transactions parameter 'transactionTimeDumpSamplesCoefficient' was changed from 'null' to '0.0' [21:09:35] : [Step 4/5] [2021-11-19 21:09:35,505][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpSamplesPerSecondLimit' was changed from 'null' to '5' [21:09:35] : [Step 4/5] [2021-11-19 21:09:35,505][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][IgniteTxManager] Transactions parameter 'collisionsDumpInterval' was changed from 'null' to '1000' [21:09:35] : [Step 4/5] [2021-11-19 21:09:35,505][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Historical rebalance WAL threshold changed [property=historical.rebalance.threshold, oldVal=null, newVal=500] [21:09:35] : [Step 4/5] [2021-11-19 21:09:35,506][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Checkpoint frequency deviation changed [oldVal=null, newVal=null] [21:09:35] : [Step 4/5] [2021-11-19 21:09:35,506][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][FilePageStoreManager] Cleanup cache stores [total=1, left=0, cleanFiles=false] [21:09:35] : [Step 4/5] [2021-11-19 21:09:35,508][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:09:35] : [Step 4/5] [2021-11-19 21:09:35,509][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:09:35] : [Step 4/5] [2021-11-19 21:09:35,509][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:09:35] : [Step 4/5] [2021-11-19 21:09:35,510][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Data Regions Started: 5 [21:09:35] : [Step 4/5] [2021-11-19 21:09:35,510][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] ^-- sysMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:09:35] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:09:35] : [Step 4/5] ^-- default region [type=default, persistence=true, lazyAlloc=true, [21:09:35] : [Step 4/5] ... initCfg=10MB, maxCfg=10MB, usedRam=0MB, freeRam=100%, allocRam=0MB, allocTotal=0MB] [21:09:35] : [Step 4/5] ^-- metastoreMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:09:35] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:09:35] : [Step 4/5] ^-- TxLog region [type=internal, persistence=true, lazyAlloc=false, [21:09:35] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:09:35] : [Step 4/5] ^-- volatileDsMemPlc region [type=user, persistence=false, lazyAlloc=true, [21:09:35] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB] [21:09:35] : [Step 4/5] ^-- Ignite persistence [used=0MB] [21:09:35] : [Step 4/5] [21:09:35] : [Step 4/5] [2021-11-19 21:09:35,512][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Starting binary memory restore for: [-2100569601, 1613773252] [21:09:35] : [Step 4/5] [2021-11-19 21:09:35,575][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=/opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0/cp/1637345374298-5d2ad1ac-9868-4816-811b-8bd3eed64905-START.bin, endMarker=/opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0/cp/1637345367890-e4075c09-4892-4fbd-a34d-f0ab16d1288d-END.bin] [21:09:35] : [Step 4/5] [2021-11-19 21:09:35,576][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=73082, len=1963], lastMarked=WALPointer [idx=0, fileOff=749755, len=11491], lastCheckpointId=5d2ad1ac-9868-4816-811b-8bd3eed64905] [21:09:35]W: [org.apache.ignite:ignite-core] [2021-11-19 21:09:35,625][WARN ][test-runner-#18198%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Ignite node stopped in the middle of checkpoint. Will restore memory state and finish checkpoint on node start. [21:09:35] : [Step 4/5] [2021-11-19 21:09:35,625][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=24.0 MiB, pages=5952, tableSize=474.2 KiB, replacementSize=768 B, checkpointBuffer=10.0 MiB] [21:09:35] : [Step 4/5] [2021-11-19 21:09:35,697][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Found last checkpoint marker [cpId=5d2ad1ac-9868-4816-811b-8bd3eed64905, pos=WALPointer [idx=0, fileOff=749755, len=11491]] [21:09:35] : [Step 4/5] [2021-11-19 21:09:35,702][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Finished applying memory changes [changesApplied=1097, time=70 ms] [21:09:36] : [Step 4/5] [2021-11-19 21:09:36,212][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][CheckpointWorkflow] Checkpoint finished [cpId=5d2ad1ac-9868-4816-811b-8bd3eed64905, pages=574, markPos=WALPointer [idx=0, fileOff=749755, len=11491], pagesWrite=10ms, fsync=485ms, total=495ms] [21:09:36] : [Step 4/5] [2021-11-19 21:09:36,213][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Binary memory state restored at node startup [restoredPtr=WALPointer [idx=0, fileOff=761246, len=0]] [21:09:36] : [Step 4/5] [2021-11-19 21:09:36,215][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000000.wal, offset=761246, ver=2] [21:09:36] : [Step 4/5] [2021-11-19 21:09:36,219][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][GridCacheProcessor] Started cache in recovery mode [name=ignite-sys-cache, id=-2100569601, dataRegionName=sysMemPlc, mode=REPLICATED, atomicity=TRANSACTIONAL, backups=2147483647, mvcc=false] [21:09:36] : [Step 4/5] [2021-11-19 21:09:36,224][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][GridCacheProcessor] Started cache in recovery mode [name=encrypted, id=1613773252, dataRegionName=default, mode=PARTITIONED, atomicity=ATOMIC, backups=0, mvcc=false] [21:09:36] : [Step 4/5] [2021-11-19 21:09:36,225][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Binary recovery performed in 713 ms. [21:09:36] : [Step 4/5] [2021-11-19 21:09:36,226][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=/opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0/cp/1637345374298-5d2ad1ac-9868-4816-811b-8bd3eed64905-START.bin, endMarker=/opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0/cp/1637345374298-5d2ad1ac-9868-4816-811b-8bd3eed64905-END.bin] [21:09:36] : [Step 4/5] [2021-11-19 21:09:36,227][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Applying lost cache updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=749755, len=11491], lastCheckpointId=5d2ad1ac-9868-4816-811b-8bd3eed64905] [21:09:36] : [Step 4/5] [2021-11-19 21:09:36,300][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=80 ms] [21:09:36] : [Step 4/5] [2021-11-19 21:09:36,300][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][GridCacheProcessor] Restoring partition state for local groups. [21:09:36] : [Step 4/5] [2021-11-19 21:09:36,431][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=2, partitionsProcessed=1124, time=132ms] [21:09:36] : [Step 4/5] [2021-11-19 21:09:36,433][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][TestTcpDiscoverySpi] Successfully bound to TCP port [port=47500, localHost=localhost/127.0.0.1, locNodeId=00fbb7ce-7ca4-4041-bd27-a7702c9b8000] [21:09:36] : [Step 4/5] [2021-11-19 21:09:36,435][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][GridEncryptionManager] Sending stored group keys to coordinator [grps=1613773252] [21:09:36] : [Step 4/5] [2021-11-19 21:09:36,444][INFO ][disco-notifier-worker-#18581%grid-0%][MvccProcessorImpl] Assigned mvcc coordinator [crd=MvccCoordinator [topVer=AffinityTopologyVersion [topVer=1, minorTopVer=0], nodeId=00fbb7ce-7ca4-4041-bd27-a7702c9b8000, ver=1637345376442, local=true, initialized=false]] [21:09:36] : [Step 4/5] [2021-11-19 21:09:36,446][INFO ][sys-#18562%grid-0%][ClusterProcessor] Writing cluster ID and tag to metastorage on ready for write ClusterIdAndTag [id=91c8a09d-7542-4158-8b49-e9c0724f4d93, tag=cranky_hypatia] [21:09:36] : [Step 4/5] [2021-11-19 21:09:36,457][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] To start Console Management & Monitoring run ignitevisorcmd.{sh|bat} [21:09:36] : [Step 4/5] [2021-11-19 21:09:36,457][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] [21:09:36] : [Step 4/5] [21:09:36] : [Step 4/5] >>> +-------------------------------------------+ [21:09:36] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:09:36] : [Step 4/5] >>> +-------------------------------------------+ [21:09:36] : [Step 4/5] >>> OS name: Linux 4.15.0-151-generic amd64 [21:09:36] : [Step 4/5] >>> CPU(s): 24 [21:09:36] : [Step 4/5] >>> Heap: 2.0GB [21:09:36] : [Step 4/5] >>> VM name: 16724@c4dfe9a430b2 [21:09:36] : [Step 4/5] >>> Ignite instance name: grid-0 [21:09:36] : [Step 4/5] >>> Local node [ID=00FBB7CE-7CA4-4041-BD27-A7702C9B8000, order=1, clientMode=false] [21:09:36] : [Step 4/5] >>> Local node addresses: [127.0.0.1] [21:09:36] : [Step 4/5] >>> Local ports: TCP:10800 TCP:47100 TCP:47500 [21:09:36] : [Step 4/5] [21:09:36] : [Step 4/5] [2021-11-19 21:09:36,458][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] >>> Ignite cluster is in INACTIVE state (limited functionality available). Use control.(sh|bat) script or IgniteCluster.state(ClusterState.ACTIVE) to change the state. [21:09:36] : [Step 4/5] [2021-11-19 21:09:36,459][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][GridDiscoveryManager] Topology snapshot [ver=1, locNode=00fbb7ce, servers=1, clients=0, state=INACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=00fbb7ce-7ca4-4041-bd27-a7702c9b8000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:09:36] : [Step 4/5] [2021-11-19 21:09:36,459][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][GridDiscoveryManager] ^-- Baseline [id=0, size=2, online=1, offline=1] [21:09:36] : [Step 4/5] [2021-11-19 21:09:36,459][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][GridDiscoveryManager] ^-- 1 nodes left for auto-activation [grid-1] [21:09:36] : [Step 4/5] [2021-11-19 21:09:36,460][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][G] Node started : [stage="Configure system pool" (0 ms),stage="Start managers" (181 ms),stage="Configure binary metadata" (2 ms),stage="Start processors" (21 ms),stage="Start 'StanByClusterTestProvider' plugin" (0 ms),stage="Start 'PageMemory tracker plugin' plugin" (0 ms),stage="Start 'TestDistibutedConfigurationPlugin' plugin" (0 ms),stage="Start 'NodeValidationPluginProvider' plugin" (0 ms),stage="Init metastore" (418 ms),stage="Init and start regions" (4 ms),stage="Restore binary memory" (714 ms),stage="Restore logical state" (205 ms),stage="Finish recovery" (0 ms),stage="Join topology" (12 ms),stage="Await transition" (2 ms),stage="Await exchange" (12 ms),stage="Total time" (1571 ms)] [21:09:36] : [Step 4/5] [2021-11-19 21:09:36,461][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][root] Node started with the following configuration [id=00fbb7ce-7ca4-4041-bd27-a7702c9b8000, marshaller=BinaryMarshaller [], discovery=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=5000, ackTimeout=5000, marsh=JdkMarshaller [clsFilter=org.apache.ignite.marshaller.MarshallerUtils$1@36dc3285], reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], binaryCfg=null, lateAff=true] [21:09:36]W: [org.apache.ignite:ignite-core] [2021-11-19 21:09:36,466][WARN ][test-runner-#18198%encryption.MasterKeyChangeTest%][G] Ignite work directory is not provided, automatically resolved to: /opt/buildagent/work/7bc1c54bc719b67c/work [21:09:36] : [Step 4/5] [2021-11-19 21:09:36,467][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] [21:09:36] : [Step 4/5] [21:09:36] : [Step 4/5] >>> __________ ________________ [21:09:36] : [Step 4/5] >>> / _/ ___/ |/ / _/_ __/ __/ [21:09:36] : [Step 4/5] >>> _/ // (7 7 // / / / / _/ [21:09:36] : [Step 4/5] >>> /___/\___/_/|_/___/ /_/ /___/ [21:09:36] : [Step 4/5] >>> [21:09:36] : [Step 4/5] >>> ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:09:36] : [Step 4/5] >>> 2021 Copyright(C) Apache Software Foundation [21:09:36] : [Step 4/5] >>> [21:09:36] : [Step 4/5] >>> Ignite documentation: http://ignite.apache.org [21:09:36] : [Step 4/5] [21:09:36] : [Step 4/5] [2021-11-19 21:09:36,468][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] Config URL: n/a [21:09:36] : [Step 4/5] [2021-11-19 21:09:36,468][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] IgniteConfiguration [igniteInstanceName=grid-1, pubPoolSize=24, svcPoolSize=24, callbackPoolSize=24, stripedPoolSize=24, sysPoolSize=24, mgmtPoolSize=4, dataStreamerPoolSize=24, utilityCachePoolSize=24, utilityCacheKeepAliveTime=60000, p2pPoolSize=2, qryPoolSize=24, buildIdxPoolSize=4, igniteHome=/opt/buildagent/work/7bc1c54bc719b67c, igniteWorkDir=/opt/buildagent/work/7bc1c54bc719b67c/work, mbeanSrv=com.sun.jmx.mbeanserver.JmxMBeanServer@6fe85038, nodeId=1075ed29-078e-45fc-aa85-e2182a56a001, marsh=BinaryMarshaller [], marshLocJobs=false, daemon=false, p2pEnabled=true, netTimeout=10000, netCompressionLevel=1, sndRetryDelay=1000, sndRetryCnt=3, metricsHistSize=10000, metricsUpdateFreq=1000, metricsExpTime=9223372036854775807, discoSpi=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=0, ackTimeout=0, marsh=null, reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], segPlc=STOP, segResolveAttempts=2, waitForSegOnStart=true, allResolversPassReq=true, segChkFreq=10000, commSpi=TcpCommunicationSpi [connectGate=org.apache.ignite.spi.communication.tcp.internal.ConnectGateway@67ca26c2, ctxInitLatch=java.util.concurrent.CountDownLatch@10a94906[Count = 1], stopping=false, clientPool=null, nioSrvWrapper=null, stateProvider=null], evtSpi=MemoryEventStorageSpi [expireAgeMs=9223372036854775807, expireCnt=10000, filter=null], colSpi=NoopCollisionSpi [], deploySpi=LocalDeploymentSpi [], indexingSpi=org.apache.ignite.spi.indexing.noop.NoopIndexingSpi@349250ee, addrRslvr=null, encryptionSpi=org.apache.ignite.spi.encryption.keystore.KeystoreEncryptionSpi@5e98e2d5, tracingSpi=org.apache.ignite.spi.tracing.NoopTracingSpi@1e9e4bde, clientMode=false, rebalanceThreadPoolSize=4, rebalanceTimeout=10000, rebalanceBatchesPrefetchCnt=3, rebalanceThrottle=0, rebalanceBatchSize=524288, txCfg=TransactionConfiguration [txSerEnabled=false, dfltIsolation=REPEATABLE_READ, dfltConcurrency=PESSIMISTIC, dfltTxTimeout=0, txTimeoutOnPartitionMapExchange=0, deadlockTimeout=10000, pessimisticTxLogSize=0, pessimisticTxLogLinger=10000, tmLookupClsName=null, txManagerFactory=null, useJtaSync=false], cacheSanityCheckEnabled=true, discoStartupDelay=60000, deployMode=SHARED, p2pMissedCacheSize=100, locHost=127.0.0.1, timeSrvPortBase=31100, timeSrvPortRange=100, failureDetectionTimeout=10000, sysWorkerBlockedTimeout=null, clientFailureDetectionTimeout=10000, metricsLogFreq=0, connectorCfg=null, odbcCfg=null, warmupClos=null, atomicCfg=AtomicConfiguration [seqReserveSize=1000, cacheMode=PARTITIONED, backups=1, aff=null, grpName=null], classLdr=null, sslCtxFactory=null, platformCfg=null, binaryCfg=null, memCfg=null, pstCfg=null, dsCfg=DataStorageConfiguration [sysRegionInitSize=41943040, sysRegionMaxSize=104857600, pageSize=4096, concLvl=0, dfltDataRegConf=DataRegionConfiguration [name=default, maxSize=10485760, initSize=268435456, swapPath=null, pageEvictionMode=DISABLED, pageReplacementMode=CLOCK, evictionThreshold=0.9, emptyPagesPoolSize=100, metricsEnabled=false, metricsSubIntervalCount=5, metricsRateTimeInterval=60000, persistenceEnabled=true, checkpointPageBufSize=0, lazyMemoryAllocation=true, warmUpCfg=null], dataRegions=null, storagePath=null, checkpointFreq=180000, lockWaitTime=10000, checkpointThreads=4, checkpointWriteOrder=SEQUENTIAL, walHistSize=20, maxWalArchiveSize=1073741824, walSegments=10, walSegmentSize=67108864, walPath=db/wal, walArchivePath=db/wal/archive, cdcWalPath=db/wal/cdc, cdcEnabled=false, metricsEnabled=false, walMode=FSYNC, walTlbSize=131072, walBuffSize=0, walFlushFreq=2000, walFsyncDelay=1000, walRecordIterBuffSize=67108864, alwaysWriteFullPages=false, fileIOFactory=org.apache.ignite.internal.processors.cache.persistence.file.AsyncFileIOFactory@1d22be10, metricsSubIntervalCnt=5, metricsRateTimeInterval=60000, walAutoArchiveAfterInactivity=-1, walForceArchiveTimeout=-1, writeThrottlingEnabled=false, walCompactionEnabled=false, walCompactionLevel=1, checkpointReadLockTimeout=null, walPageCompression=DISABLED, walPageCompressionLevel=null, dfltWarmUpCfg=null, encCfg=org.apache.ignite.configuration.EncryptionConfiguration@5d50c791, defragmentationThreadPoolSize=4, minWalArchiveSize=-1], snapshotPath=snapshots, activeOnStart=true, activeOnStartPropSetFlag=false, autoActivation=true, autoActivationPropSetFlag=false, clusterStateOnStart=null, sqlConnCfg=null, cliConnCfg=ClientConnectorConfiguration [host=null, port=10800, portRange=100, sockSndBufSize=0, sockRcvBufSize=0, tcpNoDelay=true, maxOpenCursorsPerConn=128, threadPoolSize=24, selectorCnt=12, idleTimeout=0, handshakeTimeout=10000, jdbcEnabled=true, odbcEnabled=true, thinCliEnabled=true, sslEnabled=false, useIgniteSslCtxFactory=true, sslClientAuth=false, sslCtxFactory=null, thinCliCfg=ThinClientConfiguration [maxActiveTxPerConn=100, maxActiveComputeTasksPerConn=0]], mvccVacuumThreadCnt=2, mvccVacuumFreq=5000, authEnabled=false, failureHnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]], commFailureRslvr=null, sqlCfg=SqlConfiguration [longQryWarnTimeout=3000, dfltQryTimeout=0, sqlQryHistSize=1000, validationEnabled=false], asyncContinuationExecutor=null] [21:09:36] : [Step 4/5] [2021-11-19 21:09:36,475][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] Daemon mode: off [21:09:36] : [Step 4/5] [2021-11-19 21:09:36,475][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] OS: Linux 4.15.0-151-generic amd64 [21:09:36] : [Step 4/5] [2021-11-19 21:09:36,475][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] OS user: teamcity [21:09:36] : [Step 4/5] [2021-11-19 21:09:36,476][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] PID: 16724 [21:09:36] : [Step 4/5] [2021-11-19 21:09:36,476][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] Language runtime: Java Platform API Specification ver. 1.8 [21:09:36] : [Step 4/5] [2021-11-19 21:09:36,476][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] VM information: Java(TM) SE Runtime Environment 1.8.0_261-b12 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 25.261-b12 [21:09:36] : [Step 4/5] [2021-11-19 21:09:36,476][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] VM total memory: 1.9GB [21:09:36] : [Step 4/5] [2021-11-19 21:09:36,477][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] Remote Management [restart: off, REST: off, JMX (remote: off)] [21:09:36] : [Step 4/5] [2021-11-19 21:09:36,477][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] Logger: GridTestLog4jLogger [quiet=false, config=null] [21:09:36] : [Step 4/5] [2021-11-19 21:09:36,477][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] IGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c [21:09:36] : [Step 4/5] [2021-11-19 21:09:36,477][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] VM arguments: [-DIGNITE_DUMP_THREADS_ON_FAILURE=false, -DMono=/usr/bin/mono-sgen, -DMono4.0_x64=/usr/lib/mono/4.0, -DMono4.5_x64=/usr/lib/mono/4.5, -DMonoVersion=6.12.0.90, -DSKIP_BUILD=false, -Dagent.home.dir=/opt/buildagent, -Dagent.name=aitc-lin02_03, -Dagent.ownPort=9090, -Dagent.work.dir=/opt/buildagent/work, -Dbuild.number=95, -Dbuild.vcs.number=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.1=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.GitHubApacheIgnite=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dclassworlds.conf=/opt/buildagent/temp/buildTmp/teamcity.m2.conf, -Dcom.jetbrains.maven.watcher.report.file=/opt/buildagent/temp/buildTmp/maven-build-info.xml, -Djava.io.tmpdir=/opt/buildagent/temp/buildTmp, -Dmaven.home=/opt/buildagent/tools/maven3_6, -Dmaven.multiModuleProjectDirectory=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.agent.cpuBenchmark=457, -Dteamcity.agent.dotnet.agent_url=http://localhost:9090/RPC2, -Dteamcity.agent.dotnet.build_id=6278078, -Dteamcity.auth.password=*******, -Dteamcity.auth.userId=TeamCityBuildId=6278078, -Dteamcity.build.changedFiles.file=/opt/buildagent/temp/buildTmp/changedFiles6342607772318147725.txt, -Dteamcity.build.checkoutDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.build.id=6278078, -Dteamcity.build.properties.file=/opt/buildagent/temp/buildTmp/teamcity.build5164517880467851002.properties, -Dteamcity.build.tempDir=/opt/buildagent/temp/buildTmp, -Dteamcity.build.workingDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.buildConfName=Basic 3, -Dteamcity.buildType.id=IgniteTests24Java8_Basic3, -Dteamcity.configuration.properties.file=/opt/buildagent/temp/buildTmp/teamcity.config5591980786735343870.properties, -Dteamcity.maven.userSettings.path=/opt/buildagent/temp/buildTmp/maven_settings_585072866407032347.xml, -Dteamcity.maven.watcher.home=/opt/buildagent/plugins/mavenPlugin/maven-watcher-jdk16, -Dteamcity.projectName=Ignite Tests 2.x (JDK 8/11), -Dteamcity.runner.properties.file=/opt/buildagent/temp/buildTmp/teamcity.runner9098465561618137420.properties, -Dteamcity.tests.recentlyFailedTests.file=/opt/buildagent/temp/buildTmp/testsToRunFirst3891775683130404069.txt, -Dteamcity.version=2021.2 (build 99542), -ea, -Xms2g, -Xmx2g, -XX:+HeapDumpOnOutOfMemoryError, -DIGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_TEST_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_UPDATE_NOTIFIER=false, -DIGNITE_NO_DISCO_ORDER=true, -DIGNITE_PERFORMANCE_SUGGESTIONS_DISABLED=true, -Djava.net.preferIPv4Stack=true, -DTEST_SCALE_FACTOR=1.0, -DIGNITE_TEST_PROP_LOG4J_FILE=log4j-tc-test.xml, -DIGNITE_QUIET=false, -DIGNITE_MARSHAL_BUFFERS_RECHECK=1000, -Dmaven.repo.local=/opt/buildagent/.m2/repository] [21:09:36] : [Step 4/5] [2021-11-19 21:09:36,481][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] System cache's DataRegion size is configured to 40 MB. Use DataStorageConfiguration.systemRegionInitialSize property to change the setting. [21:09:36] : [Step 4/5] [2021-11-19 21:09:36,481][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] Configured caches [in 'sysMemPlc' dataRegion: ['ignite-sys-cache']] [21:09:36]W: [org.apache.ignite:ignite-core] [2021-11-19 21:09:36,482][WARN ][test-runner-#18198%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] Peer class loading is enabled (disable it in production for performance and deployment consistency reasons) [21:09:36] : [Step 4/5] [2021-11-19 21:09:36,482][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] 3-rd party licenses can be found at: /opt/buildagent/work/7bc1c54bc719b67c/libs/licenses [21:09:36] : [Step 4/5] [2021-11-19 21:09:36,486][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] Configured plugins: [21:09:36] : [Step 4/5] [2021-11-19 21:09:36,486][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] ^-- StanByClusterTestProvider 1.0 [21:09:36] : [Step 4/5] [2021-11-19 21:09:36,486][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:09:36] : [Step 4/5] [2021-11-19 21:09:36,486][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] [21:09:36] : [Step 4/5] [2021-11-19 21:09:36,486][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] ^-- PageMemory tracker plugin 1.0 [21:09:36] : [Step 4/5] [2021-11-19 21:09:36,487][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:09:36] : [Step 4/5] [2021-11-19 21:09:36,487][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] [21:09:36] : [Step 4/5] [2021-11-19 21:09:36,487][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] ^-- TestDistibutedConfigurationPlugin 1.0 [21:09:36] : [Step 4/5] [2021-11-19 21:09:36,487][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:09:36] : [Step 4/5] [2021-11-19 21:09:36,487][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] [21:09:36] : [Step 4/5] [2021-11-19 21:09:36,487][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] ^-- NodeValidationPluginProvider 1.0 [21:09:36] : [Step 4/5] [2021-11-19 21:09:36,487][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:09:36] : [Step 4/5] [2021-11-19 21:09:36,488][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] [21:09:36] : [Step 4/5] [2021-11-19 21:09:36,488][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][FailureProcessor] Configured failure handler: [hnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]]] [21:09:36]W: [org.apache.ignite:ignite-core] [2021-11-19 21:09:36,499][WARN ][test-runner-#18198%encryption.MasterKeyChangeTest%][TestRecordingCommunicationSpi] Message queue limit is set to 0 which may lead to potential OOMEs when running cache operations in FULL_ASYNC or PRIMARY_SYNC modes due to message queues growth on sender and receiver sides. [21:09:36] : [Step 4/5] [2021-11-19 21:09:36,499][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][TestRecordingCommunicationSpi] Successfully bound communication NIO server to TCP port [port=47101, locHost=/127.0.0.1, selectorsCnt=12, selectorSpins=0, pairedConn=false] [21:09:36] : [Step 4/5] [2021-11-19 21:09:36,503][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][GridCollisionManager] Collision resolution is disabled (all jobs will be activated upon arrival). [21:09:36] : [Step 4/5] [2021-11-19 21:09:36,503][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] Security status [authentication=off, sandbox=off, tls/ssl=off] [21:09:36] : [Step 4/5] [2021-11-19 21:09:36,563][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:09:36] : [Step 4/5] [2021-11-19 21:09:36,647][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][MaintenanceProcessor] Resolved store directory for node persistent data: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1 [21:09:36] : [Step 4/5] [2021-11-19 21:09:36,649][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][CacheObjectBinaryProcessorImpl] Resolved directory for serialized binary metadata: /opt/buildagent/work/7bc1c54bc719b67c/work/db/binary_meta/grid_1 [21:09:36] : [Step 4/5] [2021-11-19 21:09:36,653][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1 [21:09:36] : [Step 4/5] [2021-11-19 21:09:36,654][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][FileWriteAheadLogManager] Resolved write ahead log work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1 [21:09:36] : [Step 4/5] [2021-11-19 21:09:36,654][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][FileWriteAheadLogManager] Resolved write ahead log archive directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1 [21:09:36] : [Step 4/5] [2021-11-19 21:09:36,656][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000005.wal [21:09:36] : [Step 4/5] [2021-11-19 21:09:36,656][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000006.wal [21:09:36] : [Step 4/5] [2021-11-19 21:09:36,657][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000004.wal [21:09:36] : [Step 4/5] [2021-11-19 21:09:36,657][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000003.wal [21:09:36] : [Step 4/5] [2021-11-19 21:09:36,657][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000002.wal [21:09:36] : [Step 4/5] [2021-11-19 21:09:36,658][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000007.wal [21:09:36] : [Step 4/5] [2021-11-19 21:09:36,658][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000001.wal [21:09:36] : [Step 4/5] [2021-11-19 21:09:36,663][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Configured data regions initialized successfully [total=5] [21:09:36] : [Step 4/5] [2021-11-19 21:09:36,664][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][IgniteSnapshotManager] Resolved snapshot work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/snapshots [21:09:36] : [Step 4/5] [2021-11-19 21:09:36,665][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][IgniteSnapshotManager] Resolved temp directory for snapshot creation: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1/snp [21:09:36] : [Step 4/5] [2021-11-19 21:09:36,667][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][ClientListenerProcessor] Client connector processor has started on TCP port 10801 [21:09:36] : [Step 4/5] [2021-11-19 21:09:36,670][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] Non-loopback local IPs: 172.17.0.4 [21:09:36] : [Step 4/5] [2021-11-19 21:09:36,670][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] Enabled local MACs: 0242AC110004 [21:09:36] : [Step 4/5] [2021-11-19 21:09:36,671][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=/opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1/cp/1637345372505-5c4a47ea-8702-43b3-86cd-22da047d7115-START.bin, endMarker=/opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1/cp/1637345367889-56119796-b45d-43c5-b7aa-cbe0255e3a58-END.bin] [21:09:36] : [Step 4/5] [2021-11-19 21:09:36,672][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:09:36] : [Step 4/5] [2021-11-19 21:09:36,673][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=66975, len=1963], lastMarked=WALPointer [idx=0, fileOff=630150, len=11871], lastCheckpointId=5c4a47ea-8702-43b3-86cd-22da047d7115] [21:09:36] : [Step 4/5] [2021-11-19 21:09:36,786][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Found last checkpoint marker [cpId=5c4a47ea-8702-43b3-86cd-22da047d7115, pos=WALPointer [idx=0, fileOff=630150, len=11871]] [21:09:36] : [Step 4/5] [2021-11-19 21:09:36,795][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Applying lost metastore updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=630150, len=11871], lastCheckpointId=5c4a47ea-8702-43b3-86cd-22da047d7115] [21:09:36] : [Step 4/5] [2021-11-19 21:09:36,859][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=60 ms] [21:09:36] : [Step 4/5] [2021-11-19 21:09:36,860][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][GridCacheProcessor] Restoring partition state for local groups. [21:09:36] : [Step 4/5] [2021-11-19 21:09:36,860][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=0, partitionsProcessed=0, time=0ms] [21:09:36] : [Step 4/5] [2021-11-19 21:09:36,974][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][GridEncryptionManager] Master key name loaded from metastrore [masterKeyName=ignite.master.key2] [21:09:37] : [Step 4/5] [2021-11-19 21:09:37,032][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:09:37] : [Step 4/5] [2021-11-19 21:09:37,121][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][GridClusterStateProcessor] Restoring history for BaselineTopology[id=0] [21:09:37] : [Step 4/5] [2021-11-19 21:09:37,124][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][ClusterProcessor] Cluster ID and tag has been read from metastorage: ClusterIdAndTag [id=91c8a09d-7542-4158-8b49-e9c0724f4d93, tag=cranky_hypatia] [21:09:37] : [Step 4/5] [2021-11-19 21:09:37,124][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][IgniteClusterImpl] Shutdown policy was updated [oldVal=null, newVal=null] [21:09:37] : [Step 4/5] [2021-11-19 21:09:37,125][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustEnabled' was changed from 'null' to 'false' [21:09:37] : [Step 4/5] [2021-11-19 21:09:37,125][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustTimeout' was changed from 'null' to '300000' [21:09:37] : [Step 4/5] [2021-11-19 21:09:37,125][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][IgniteTxManager] Transactions parameter 'txOwnerDumpRequestsAllowed' was changed from 'null' to 'true' [21:09:37] : [Step 4/5] [2021-11-19 21:09:37,126][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][IgniteTxManager] Transactions parameter 'longOperationsDumpTimeout' was changed from 'null' to '60000' [21:09:37] : [Step 4/5] [2021-11-19 21:09:37,126][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpThreshold' was changed from 'null' to '0' [21:09:37] : [Step 4/5] [2021-11-19 21:09:37,126][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][IgniteTxManager] Transactions parameter 'transactionTimeDumpSamplesCoefficient' was changed from 'null' to '0.0' [21:09:37] : [Step 4/5] [2021-11-19 21:09:37,127][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpSamplesPerSecondLimit' was changed from 'null' to '5' [21:09:37] : [Step 4/5] [2021-11-19 21:09:37,127][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][IgniteTxManager] Transactions parameter 'collisionsDumpInterval' was changed from 'null' to '1000' [21:09:37] : [Step 4/5] [2021-11-19 21:09:37,127][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Historical rebalance WAL threshold changed [property=historical.rebalance.threshold, oldVal=null, newVal=500] [21:09:37] : [Step 4/5] [2021-11-19 21:09:37,127][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Checkpoint frequency deviation changed [oldVal=null, newVal=null] [21:09:37] : [Step 4/5] [2021-11-19 21:09:37,128][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][FilePageStoreManager] Cleanup cache stores [total=1, left=0, cleanFiles=false] [21:09:37] : [Step 4/5] [2021-11-19 21:09:37,130][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:09:37] : [Step 4/5] [2021-11-19 21:09:37,130][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:09:37] : [Step 4/5] [2021-11-19 21:09:37,131][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:09:37] : [Step 4/5] [2021-11-19 21:09:37,132][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Data Regions Started: 5 [21:09:37] : [Step 4/5] [2021-11-19 21:09:37,132][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] ^-- sysMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:09:37] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:09:37] : [Step 4/5] ^-- default region [type=default, persistence=true, lazyAlloc=true, [21:09:37] : [Step 4/5] ... initCfg=10MB, maxCfg=10MB, usedRam=0MB, freeRam=100%, allocRam=0MB, allocTotal=0MB] [21:09:37] : [Step 4/5] ^-- metastoreMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:09:37] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:09:37] : [Step 4/5] ^-- TxLog region [type=internal, persistence=true, lazyAlloc=false, [21:09:37] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:09:37] : [Step 4/5] ^-- volatileDsMemPlc region [type=user, persistence=false, lazyAlloc=true, [21:09:37] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB] [21:09:37] : [Step 4/5] ^-- Ignite persistence [used=0MB] [21:09:37] : [Step 4/5] [21:09:37] : [Step 4/5] [2021-11-19 21:09:37,133][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Starting binary memory restore for: [-2100569601, 1613773252] [21:09:37] : [Step 4/5] [2021-11-19 21:09:37,203][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=/opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1/cp/1637345372505-5c4a47ea-8702-43b3-86cd-22da047d7115-START.bin, endMarker=/opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1/cp/1637345367889-56119796-b45d-43c5-b7aa-cbe0255e3a58-END.bin] [21:09:37] : [Step 4/5] [2021-11-19 21:09:37,204][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=66975, len=1963], lastMarked=WALPointer [idx=0, fileOff=630150, len=11871], lastCheckpointId=5c4a47ea-8702-43b3-86cd-22da047d7115] [21:09:37]W: [org.apache.ignite:ignite-core] [2021-11-19 21:09:37,257][WARN ][test-runner-#18198%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Ignite node stopped in the middle of checkpoint. Will restore memory state and finish checkpoint on node start. [21:09:37] : [Step 4/5] [2021-11-19 21:09:37,257][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=24.0 MiB, pages=5952, tableSize=474.2 KiB, replacementSize=768 B, checkpointBuffer=10.0 MiB] [21:09:37] : [Step 4/5] [2021-11-19 21:09:37,329][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Found last checkpoint marker [cpId=5c4a47ea-8702-43b3-86cd-22da047d7115, pos=WALPointer [idx=0, fileOff=630150, len=11871]] [21:09:37] : [Step 4/5] [2021-11-19 21:09:37,334][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Finished applying memory changes [changesApplied=888, time=71 ms] [21:09:37] : [Step 4/5] [2021-11-19 21:09:37,737][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][CheckpointWorkflow] Checkpoint finished [cpId=5c4a47ea-8702-43b3-86cd-22da047d7115, pages=454, markPos=WALPointer [idx=0, fileOff=630150, len=11871], pagesWrite=5ms, fsync=383ms, total=388ms] [21:09:37] : [Step 4/5] [2021-11-19 21:09:37,739][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Binary memory state restored at node startup [restoredPtr=WALPointer [idx=0, fileOff=642021, len=0]] [21:09:37] : [Step 4/5] [2021-11-19 21:09:37,741][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000000.wal, offset=642021, ver=2] [21:09:37] : [Step 4/5] [2021-11-19 21:09:37,745][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][GridCacheProcessor] Started cache in recovery mode [name=ignite-sys-cache, id=-2100569601, dataRegionName=sysMemPlc, mode=REPLICATED, atomicity=TRANSACTIONAL, backups=2147483647, mvcc=false] [21:09:37] : [Step 4/5] [2021-11-19 21:09:37,749][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][GridCacheProcessor] Started cache in recovery mode [name=encrypted, id=1613773252, dataRegionName=default, mode=PARTITIONED, atomicity=ATOMIC, backups=0, mvcc=false] [21:09:37] : [Step 4/5] [2021-11-19 21:09:37,750][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Binary recovery performed in 617 ms. [21:09:37] : [Step 4/5] [2021-11-19 21:09:37,751][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=/opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1/cp/1637345372505-5c4a47ea-8702-43b3-86cd-22da047d7115-START.bin, endMarker=/opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1/cp/1637345372505-5c4a47ea-8702-43b3-86cd-22da047d7115-END.bin] [21:09:37] : [Step 4/5] [2021-11-19 21:09:37,752][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Applying lost cache updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=630150, len=11871], lastCheckpointId=5c4a47ea-8702-43b3-86cd-22da047d7115] [21:09:37] : [Step 4/5] [2021-11-19 21:09:37,821][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=71 ms] [21:09:37] : [Step 4/5] [2021-11-19 21:09:37,821][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][GridCacheProcessor] Restoring partition state for local groups. [21:09:37] : [Step 4/5] [2021-11-19 21:09:37,894][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=2, partitionsProcessed=1124, time=80ms] [21:09:38] : [Step 4/5] [2021-11-19 21:09:38,455][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][TestTcpDiscoverySpi] Successfully bound to TCP port [port=47501, localHost=localhost/127.0.0.1, locNodeId=1075ed29-078e-45fc-aa85-e2182a56a001] [21:09:38] : [Step 4/5] [2021-11-19 21:09:38,458][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][GridEncryptionManager] Sending stored group keys to coordinator [grps=1613773252] [21:09:38] : [Step 4/5] [2021-11-19 21:09:38,462][INFO ][tcp-disco-srvr-[:47500]-#972%grid-0%-#18583%grid-0%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=43149] [21:09:38] : [Step 4/5] [2021-11-19 21:09:38,463][INFO ][tcp-disco-srvr-[:47500]-#972%grid-0%-#18583%grid-0%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=43149] [21:09:38] : [Step 4/5] [2021-11-19 21:09:38,463][INFO ][tcp-disco-sock-reader-[]-#978%grid-0%-#18703%grid-0%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:43149, rmtPort=43149] [21:09:38] : [Step 4/5] [2021-11-19 21:09:38,466][INFO ][tcp-disco-sock-reader-[1075ed29 127.0.0.1:43149]-#978%grid-0%-#18703%grid-0%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=1075ed29-078e-45fc-aa85-e2182a56a001, rmtAddr=/127.0.0.1:43149] [21:09:38] : [Step 4/5] [2021-11-19 21:09:38,471][INFO ][tcp-disco-srvr-[:47501]-#977%grid-1%-#18702%grid-1%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=53085] [21:09:38] : [Step 4/5] [2021-11-19 21:09:38,471][INFO ][tcp-disco-srvr-[:47501]-#977%grid-1%-#18702%grid-1%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=53085] [21:09:38] : [Step 4/5] [2021-11-19 21:09:38,472][INFO ][tcp-disco-sock-reader-[]-#979%grid-1%-#18704%grid-1%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:53085, rmtPort=53085] [21:09:38] : [Step 4/5] [2021-11-19 21:09:38,472][INFO ][tcp-disco-sock-reader-[]-#979%grid-1%-#18704%grid-1%][TestTcpDiscoverySpi] Received ping request from the remote node [rmtNodeId=00fbb7ce-7ca4-4041-bd27-a7702c9b8000, rmtAddr=/127.0.0.1:53085, rmtPort=53085] [21:09:38] : [Step 4/5] [2021-11-19 21:09:38,474][INFO ][tcp-disco-sock-reader-[]-#979%grid-1%-#18704%grid-1%][TestTcpDiscoverySpi] Finished writing ping response [rmtNodeId=00fbb7ce-7ca4-4041-bd27-a7702c9b8000, rmtAddr=/127.0.0.1:53085, rmtPort=53085] [21:09:38] : [Step 4/5] [2021-11-19 21:09:38,474][INFO ][tcp-disco-sock-reader-[]-#979%grid-1%-#18704%grid-1%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:53085, rmtPort=53085, rmtNodeId=null] [21:09:38] : [Step 4/5] [2021-11-19 21:09:38,474][INFO ][tcp-disco-sock-reader-[1075ed29 127.0.0.1:43149]-#978%grid-0%-#18703%grid-0%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:43149, rmtPort=43149, rmtNodeId=1075ed29-078e-45fc-aa85-e2182a56a001] [21:09:38] : [Step 4/5] [2021-11-19 21:09:38,490][INFO ][tcp-disco-msg-worker-[crd]-#971%grid-0%-#18582%grid-0%][TestTcpDiscoverySpi] New next node [newNext=TcpDiscoveryNode [id=1075ed29-078e-45fc-aa85-e2182a56a001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=0, intOrder=2, lastExchangeTime=1637345378468, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false]] [21:09:38] : [Step 4/5] [2021-11-19 21:09:38,491][INFO ][tcp-disco-srvr-[:47501]-#977%grid-1%-#18702%grid-1%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=49497] [21:09:38] : [Step 4/5] [2021-11-19 21:09:38,491][INFO ][tcp-disco-srvr-[:47501]-#977%grid-1%-#18702%grid-1%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=49497] [21:09:38] : [Step 4/5] [2021-11-19 21:09:38,492][INFO ][tcp-disco-sock-reader-[]-#980%grid-1%-#18705%grid-1%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:49497, rmtPort=49497] [21:09:38] : [Step 4/5] [2021-11-19 21:09:38,493][INFO ][tcp-disco-sock-reader-[00fbb7ce 127.0.0.1:49497]-#980%grid-1%-#18705%grid-1%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=00fbb7ce-7ca4-4041-bd27-a7702c9b8000, rmtAddr=/127.0.0.1:49497] [21:09:38] : [Step 4/5] [2021-11-19 21:09:38,497][INFO ][tcp-disco-msg-worker-[]-#976%grid-1%-#18701%grid-1%][TestTcpDiscoverySpi] New next node [newNext=TcpDiscoveryNode [id=00fbb7ce-7ca4-4041-bd27-a7702c9b8000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345378489, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false]] [21:09:38] : [Step 4/5] [2021-11-19 21:09:38,497][INFO ][tcp-disco-srvr-[:47500]-#972%grid-0%-#18583%grid-0%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=52103] [21:09:38] : [Step 4/5] [2021-11-19 21:09:38,498][INFO ][tcp-disco-srvr-[:47500]-#972%grid-0%-#18583%grid-0%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=52103] [21:09:38] : [Step 4/5] [2021-11-19 21:09:38,498][INFO ][tcp-disco-sock-reader-[]-#981%grid-0%-#18706%grid-0%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:52103, rmtPort=52103] [21:09:38] : [Step 4/5] [2021-11-19 21:09:38,499][INFO ][tcp-disco-sock-reader-[1075ed29 127.0.0.1:52103]-#981%grid-0%-#18706%grid-0%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=1075ed29-078e-45fc-aa85-e2182a56a001, rmtAddr=/127.0.0.1:52103] [21:09:38] : [Step 4/5] [2021-11-19 21:09:38,502][INFO ][disco-event-worker-#18585%grid-0%][GridDiscoveryManager] Added new node to topology: TcpDiscoveryNode [id=1075ed29-078e-45fc-aa85-e2182a56a001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637345378468, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false] [21:09:38] : [Step 4/5] [2021-11-19 21:09:38,503][INFO ][disco-event-worker-#18585%grid-0%][GridDiscoveryManager] Topology snapshot [ver=2, locNode=00fbb7ce, servers=2, clients=0, state=INACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=00fbb7ce-7ca4-4041-bd27-a7702c9b8000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=1075ed29-078e-45fc-aa85-e2182a56a001, consistentId=grid-1, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:09:38] : [Step 4/5] [2021-11-19 21:09:38,503][INFO ][disco-event-worker-#18585%grid-0%][GridDiscoveryManager] ^-- Baseline [id=0, size=2, online=2, offline=0] [21:09:38] : [Step 4/5] [2021-11-19 21:09:38,503][INFO ][disco-event-worker-#18585%grid-0%][GridDiscoveryManager] ^-- All baseline nodes are online, will start auto-activation [21:09:38] : [Step 4/5] [2021-11-19 21:09:38,506][INFO ][tcp-disco-msg-worker-[00fbb7ce 127.0.0.1:47500]-#976%grid-1%-#18701%grid-1%][GridEncryptionManager] Skip group key received from coordinator. Already exists. [grp=1613773252, keyId=0] [21:09:38] : [Step 4/5] [2021-11-19 21:09:38,507][INFO ][disco-notifier-worker-#18700%grid-1%][MvccProcessorImpl] Assigned mvcc coordinator [crd=MvccCoordinator [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=0], nodeId=00fbb7ce-7ca4-4041-bd27-a7702c9b8000, ver=1637345376442, local=false, initialized=false]] [21:09:38] : [Step 4/5] [2021-11-19 21:09:38,509][INFO ][disco-notifier-worker-#18700%grid-1%][GridClusterStateProcessor] Sending activate cluster request with BaselineTopology BaselineTopology [id=0, branchingHash=-2475315501, branchingType='Cluster activation', baselineNodes=[grid-1, grid-0]] [21:09:38] : [Step 4/5] [2021-11-19 21:09:38,511][INFO ][sys-#18696%grid-1%][ClusterProcessor] Writing cluster ID and tag to metastorage on ready for write ClusterIdAndTag [id=91c8a09d-7542-4158-8b49-e9c0724f4d93, tag=cranky_hypatia] [21:09:38] : [Step 4/5] [2021-11-19 21:09:38,513][INFO ][disco-notifier-worker-#18581%grid-0%][GridClusterStateProcessor] Received activate cluster request with BaselineTopology[id=0] initiator node ID: 1075ed29-078e-45fc-aa85-e2182a56a001 [21:09:38] : [Step 4/5] [2021-11-19 21:09:38,514][INFO ][disco-notifier-worker-#18581%grid-0%][GridClusterStateProcessor] Started state transition: activate cluster [21:09:38] : [Step 4/5] [2021-11-19 21:09:38,514][INFO ][exchange-worker-#18586%grid-0%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], crd=true, evt=DISCOVERY_CUSTOM_EVT, evtNode=1075ed29-078e-45fc-aa85-e2182a56a001, customEvt=ChangeGlobalStateMessage [id=ec07d593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqId=a406c417-5435-43c3-afc0-d49203ca7332, initiatingNodeId=1075ed29-078e-45fc-aa85-e2182a56a001, state=ACTIVE, baselineTopology=BaselineTopology [id=0, branchingHash=-2475315501, branchingType='Cluster activation', baselineNodes=[grid-1, grid-0]], forceChangeBaselineTopology=false, timestamp=1637345378509, forceDeactivation=true], allowMerge=false, exchangeFreeSwitch=false] [21:09:38] : [Step 4/5] [2021-11-19 21:09:38,515][INFO ][exchange-worker-#18586%grid-0%][GridDhtPartitionsExchangeFuture] Start activation process [nodeId=00fbb7ce-7ca4-4041-bd27-a7702c9b8000, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]]. New state: ACTIVE [21:09:38] : [Step 4/5] [2021-11-19 21:09:38,515][INFO ][disco-notifier-worker-#18700%grid-1%][GridClusterStateProcessor] Received activate cluster request with BaselineTopology[id=0] initiator node ID: 1075ed29-078e-45fc-aa85-e2182a56a001 [21:09:38] : [Step 4/5] [2021-11-19 21:09:38,516][INFO ][exchange-worker-#18586%grid-0%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0 [21:09:38] : [Step 4/5] [2021-11-19 21:09:38,516][INFO ][disco-notifier-worker-#18700%grid-1%][GridClusterStateProcessor] Started state transition: activate cluster [21:09:38] : [Step 4/5] [2021-11-19 21:09:38,519][INFO ][exchange-worker-#18586%grid-0%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000000.wal, offset=761246, ver=2] [21:09:38] : [Step 4/5] [2021-11-19 21:09:38,521][INFO ][exchange-worker-#18586%grid-0%][GridClusterStateProcessor] Writing BaselineTopology[id=0] [21:09:38] : [Step 4/5] [2021-11-19 21:09:38,522][INFO ][exchange-worker-#18711%grid-1%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], crd=false, evt=DISCOVERY_CUSTOM_EVT, evtNode=1075ed29-078e-45fc-aa85-e2182a56a001, customEvt=ChangeGlobalStateMessage [id=ec07d593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqId=a406c417-5435-43c3-afc0-d49203ca7332, initiatingNodeId=1075ed29-078e-45fc-aa85-e2182a56a001, state=ACTIVE, baselineTopology=BaselineTopology [id=0, branchingHash=-2475315501, branchingType='Cluster activation', baselineNodes=[grid-1, grid-0]], forceChangeBaselineTopology=false, timestamp=1637345378509, forceDeactivation=true], allowMerge=false, exchangeFreeSwitch=false] [21:09:38] : [Step 4/5] [2021-11-19 21:09:38,523][INFO ][exchange-worker-#18711%grid-1%][GridDhtPartitionsExchangeFuture] Start activation process [nodeId=1075ed29-078e-45fc-aa85-e2182a56a001, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]]. New state: ACTIVE [21:09:38] : [Step 4/5] [2021-11-19 21:09:38,524][INFO ][exchange-worker-#18711%grid-1%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1 [21:09:38] : [Step 4/5] [2021-11-19 21:09:38,530][INFO ][exchange-worker-#18586%grid-0%][GridCacheDatabaseSharedManager] Finish recovery performed in 13 ms. [21:09:38] : [Step 4/5] [2021-11-19 21:09:38,530][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] To start Console Management & Monitoring run ignitevisorcmd.{sh|bat} [21:09:38] : [Step 4/5] [2021-11-19 21:09:38,532][INFO ][exchange-worker-#18711%grid-1%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000000.wal, offset=642021, ver=2] [21:09:38] : [Step 4/5] [2021-11-19 21:09:38,532][INFO ][exchange-worker-#18586%grid-0%][msg] Components activation performed in 16 ms. [21:09:38] : [Step 4/5] [2021-11-19 21:09:38,533][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] [21:09:38] : [Step 4/5] [21:09:38] : [Step 4/5] >>> +-------------------------------------------+ [21:09:38] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:09:38] : [Step 4/5] >>> +-------------------------------------------+ [21:09:38] : [Step 4/5] >>> OS name: Linux 4.15.0-151-generic amd64 [21:09:38] : [Step 4/5] >>> CPU(s): 24 [21:09:38] : [Step 4/5] >>> Heap: 2.0GB [21:09:38] : [Step 4/5] >>> VM name: 16724@c4dfe9a430b2 [21:09:38] : [Step 4/5] >>> Ignite instance name: grid-1 [21:09:38] : [Step 4/5] >>> Local node [ID=1075ED29-078E-45FC-AA85-E2182A56A001, order=2, clientMode=false] [21:09:38] : [Step 4/5] >>> Local node addresses: [127.0.0.1] [21:09:38] : [Step 4/5] >>> Local ports: TCP:10801 TCP:47101 TCP:47501 [21:09:38] : [Step 4/5] [21:09:38] : [Step 4/5] [2021-11-19 21:09:38,534][INFO ][sys-#18579%grid-0%][GridCacheProcessor] Finished recovery for cache [cache=ignite-sys-cache, grp=ignite-sys-cache, startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:09:38] : [Step 4/5] [2021-11-19 21:09:38,534][INFO ][exchange-worker-#18586%grid-0%][GridCacheProcessor] Finished recovery for cache [cache=encrypted, grp=encrypted, startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:09:38] : [Step 4/5] [2021-11-19 21:09:38,533][INFO ][exchange-worker-#18711%grid-1%][GridClusterStateProcessor] Writing BaselineTopology[id=0] [21:09:38] : [Step 4/5] [2021-11-19 21:09:38,535][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][GridDiscoveryManager] Topology snapshot [ver=2, locNode=1075ed29, servers=2, clients=0, state=INACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=00fbb7ce-7ca4-4041-bd27-a7702c9b8000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=1075ed29-078e-45fc-aa85-e2182a56a001, consistentId=grid-1, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:09:38] : [Step 4/5] [2021-11-19 21:09:38,537][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][GridDiscoveryManager] ^-- Baseline [id=0, size=2, online=2, offline=0] [21:09:38] : [Step 4/5] [2021-11-19 21:09:38,537][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][GridDiscoveryManager] ^-- All baseline nodes are online, will start auto-activation [21:09:38]W: [org.apache.ignite:ignite-core] [2021-11-19 21:09:38,537][WARN ][sys-#18576%grid-0%][CacheAffinitySharedManager] Cache group 'encrypted' brings high overhead for its metainformation in data region 'default'. Metainformation required for its partitions (502 partitions, 4096 bytes per partition, 1 MBs total) will consume more than 15% of data region memory (10 MBs). It may lead to critical errors on the node and cluster instability. Please reduce number of partitions, add more memory to the data region or add more server nodes for this cache group. [21:09:38] : [Step 4/5] [2021-11-19 21:09:38,538][INFO ][exchange-worker-#18711%grid-1%][GridCacheDatabaseSharedManager] Finish recovery performed in 13 ms. [21:09:38] : [Step 4/5] [2021-11-19 21:09:38,538][INFO ][exchange-worker-#18586%grid-0%][GridDhtPartitionsExchangeFuture] Successfully activated caches [nodeId=00fbb7ce-7ca4-4041-bd27-a7702c9b8000, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], newState=ACTIVE] [21:09:38] : [Step 4/5] [2021-11-19 21:09:38,538][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][G] Node started : [stage="Configure system pool" (0 ms),stage="Start managers" (181 ms),stage="Configure binary metadata" (1 ms),stage="Start processors" (18 ms),stage="Start 'StanByClusterTestProvider' plugin" (0 ms),stage="Start 'PageMemory tracker plugin' plugin" (0 ms),stage="Start 'TestDistibutedConfigurationPlugin' plugin" (0 ms),stage="Start 'NodeValidationPluginProvider' plugin" (0 ms),stage="Init metastore" (458 ms),stage="Init and start regions" (4 ms),stage="Restore binary memory" (617 ms),stage="Restore logical state" (144 ms),stage="Finish recovery" (558 ms),stage="Join topology" (53 ms),stage="Await transition" (4 ms),stage="Await exchange" (25 ms),stage="Total time" (2063 ms)] [21:09:38]W: [org.apache.ignite:ignite-core] [2021-11-19 21:09:38,540][WARN ][sys-#18566%grid-0%][CacheAffinitySharedManager] Cache group 'encrypted' brings high overhead for its metainformation in data region 'default'. Metainformation required for its partitions (502 partitions, 4096 bytes per partition, 1 MBs total) will consume more than 15% of data region memory (10 MBs). It may lead to critical errors on the node and cluster instability. Please reduce number of partitions, add more memory to the data region or add more server nodes for this cache group. [21:09:38] : [Step 4/5] [2021-11-19 21:09:38,540][INFO ][exchange-worker-#18711%grid-1%][msg] Components activation performed in 15 ms. [21:09:38] : [Step 4/5] [2021-11-19 21:09:38,543][INFO ][exchange-worker-#18586%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:09:38] : [Step 4/5] [2021-11-19 21:09:38,542][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][root] Node started with the following configuration [id=1075ed29-078e-45fc-aa85-e2182a56a001, marshaller=BinaryMarshaller [], discovery=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=5000, ackTimeout=5000, marsh=JdkMarshaller [clsFilter=org.apache.ignite.marshaller.MarshallerUtils$1@1683bc8e], reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], binaryCfg=null, lateAff=true] [21:09:38] : [Step 4/5] [2021-11-19 21:09:38,544][INFO ][exchange-worker-#18711%grid-1%][GridCacheProcessor] Finished recovery for cache [cache=encrypted, grp=encrypted, startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:09:38] : [Step 4/5] [2021-11-19 21:09:38,544][INFO ][sys-#18697%grid-1%][GridCacheProcessor] Finished recovery for cache [cache=ignite-sys-cache, grp=ignite-sys-cache, startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:09:38] : [Step 4/5] [2021-11-19 21:09:38,545][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][GridClusterStateProcessor] Sending activate cluster request with BaselineTopology BaselineTopology [id=0, branchingHash=-2475315501, branchingType='Cluster activation', baselineNodes=[grid-1, grid-0]] [21:09:38]W: [org.apache.ignite:ignite-core] [2021-11-19 21:09:38,615][WARN ][sys-#18679%grid-1%][CacheAffinitySharedManager] Cache group 'encrypted' brings high overhead for its metainformation in data region 'default'. Metainformation required for its partitions (522 partitions, 4096 bytes per partition, 2 MBs total) will consume more than 15% of data region memory (10 MBs). It may lead to critical errors on the node and cluster instability. Please reduce number of partitions, add more memory to the data region or add more server nodes for this cache group. [21:09:38] : [Step 4/5] [2021-11-19 21:09:38,547][INFO ][disco-notifier-worker-#18581%grid-0%][GridClusterStateProcessor] Received activate cluster request with BaselineTopology[id=0] initiator node ID: 00fbb7ce-7ca4-4041-bd27-a7702c9b8000 [21:09:38] : [Step 4/5] [2021-11-19 21:09:38,616][INFO ][exchange-worker-#18711%grid-1%][GridDhtPartitionsExchangeFuture] Successfully activated caches [nodeId=1075ed29-078e-45fc-aa85-e2182a56a001, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], newState=ACTIVE] [21:09:38] : [Step 4/5] [2021-11-19 21:09:38,616][INFO ][disco-notifier-worker-#18700%grid-1%][GridClusterStateProcessor] Received activate cluster request with BaselineTopology[id=0] initiator node ID: 00fbb7ce-7ca4-4041-bd27-a7702c9b8000 [21:09:38]W: [org.apache.ignite:ignite-core] [2021-11-19 21:09:38,617][WARN ][exchange-worker-#18711%grid-1%][CacheAffinitySharedManager] Cache group 'encrypted' brings high overhead for its metainformation in data region 'default'. Metainformation required for its partitions (522 partitions, 4096 bytes per partition, 2 MBs total) will consume more than 15% of data region memory (10 MBs). It may lead to critical errors on the node and cluster instability. Please reduce number of partitions, add more memory to the data region or add more server nodes for this cache group. [21:09:38] : [Step 4/5] [2021-11-19 21:09:38,618][INFO ][exchange-worker-#18711%grid-1%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:09:38] : [Step 4/5] [2021-11-19 21:09:38,622][INFO ][exchange-worker-#18586%grid-0%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], crd=true] [21:09:38] : [Step 4/5] [2021-11-19 21:09:38,629][INFO ][db-checkpoint-thread-#18718%grid-0%][Checkpointer] Checkpoint started [checkpointId=a6423c9a-e9b1-4bd3-989c-73f32112db94, startPtr=WALPointer [idx=0, fileOff=1083403, len=11507], checkpointBeforeLockTime=75ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=2ms, walCpRecordFsyncDuration=5ms, writeCheckpointEntryDuration=2ms, splitAndSortCpPagesDuration=0ms, pages=72, reason='node started'] [21:09:38] : [Step 4/5] [2021-11-19 21:09:38,630][INFO ][grid-nio-worker-tcp-comm-0-#18524%TestRecordingCommunicationSpi%][TestRecordingCommunicationSpi] Accepted incoming communication connection [locAddr=/127.0.0.1:47100, rmtAddr=/127.0.0.1:58998] [21:09:38] : [Step 4/5] [2021-11-19 21:09:38,633][INFO ][grid-nio-worker-tcp-comm-0-#18643%TestRecordingCommunicationSpi%][TestRecordingCommunicationSpi] Established outgoing communication connection [locAddr=/127.0.0.1:58998, rmtAddr=/127.0.0.1:47100] [21:09:38] : [Step 4/5] [2021-11-19 21:09:38,633][INFO ][exchange-worker-#18711%grid-1%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], crd=false] [21:09:38] : [Step 4/5] [2021-11-19 21:09:38,636][INFO ][sys-#18558%grid-0%][GridDhtPartitionsExchangeFuture] Coordinator received single message [ver=AffinityTopologyVersion [topVer=2, minorTopVer=1], node=1075ed29-078e-45fc-aa85-e2182a56a001, allReceived=true] [21:09:38] : [Step 4/5] [2021-11-19 21:09:38,637][INFO ][sys-#18558%grid-0%][GridDhtPartitionsExchangeFuture] finishExchangeOnCoordinator [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:09:38] : [Step 4/5] [2021-11-19 21:09:38,639][INFO ][db-checkpoint-thread-#18723%grid-1%][Checkpointer] Checkpoint started [checkpointId=de7abc2c-8c36-4096-bcd5-7f349bfab9fe, startPtr=WALPointer [idx=0, fileOff=914270, len=11887], checkpointBeforeLockTime=6ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=1ms, checkpointLockHoldTime=2ms, walCpRecordFsyncDuration=10ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=1ms, pages=60, reason='node started'] [21:09:38] : [Step 4/5] [2021-11-19 21:09:38,648][INFO ][sys-#18558%grid-0%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], err=null, rebalanced=true, wasRebalanced=false] [21:09:38] : [Step 4/5] [2021-11-19 21:09:38,649][INFO ][sys-#18690%grid-1%][GridDhtPartitionsExchangeFuture] Received full message, will finish exchange [node=00fbb7ce-7ca4-4041-bd27-a7702c9b8000, resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:09:38] : [Step 4/5] [2021-11-19 21:09:38,648][INFO ][disco-notifier-worker-#18581%grid-0%][GridClusterStateProcessor] Received state change finish message: ACTIVE [21:09:38] : [Step 4/5] [2021-11-19 21:09:38,650][INFO ][disco-notifier-worker-#18700%grid-1%][GridClusterStateProcessor] Received state change finish message: ACTIVE [21:09:38] : [Step 4/5] [2021-11-19 21:09:38,651][INFO ][disco-notifier-worker-#18581%grid-0%][GridClusterStateProcessor] Cluster state was changed from INACTIVE to ACTIVE [21:09:38] : [Step 4/5] [2021-11-19 21:09:38,652][INFO ][disco-notifier-worker-#18700%grid-1%][GridClusterStateProcessor] Cluster state was changed from INACTIVE to ACTIVE [21:09:38] : [Step 4/5] [2021-11-19 21:09:38,655][INFO ][sys-#18685%grid-1%][GridCachePartitionExchangeManager] Delay process full message without exchange id (there is exchange in progress) [nodeId=00fbb7ce-7ca4-4041-bd27-a7702c9b8000] [21:09:38] : [Step 4/5] [2021-11-19 21:09:38,657][INFO ][sys-#18690%grid-1%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], err=null, rebalanced=true, wasRebalanced=false] [21:09:38] : [Step 4/5] [2021-11-19 21:09:38,656][INFO ][sys-#18558%grid-0%][GridCacheProcessor] Finish proxy initialization, cacheName=ignite-sys-cache, localNodeId=00fbb7ce-7ca4-4041-bd27-a7702c9b8000 [21:09:38] : [Step 4/5] [2021-11-19 21:09:38,659][INFO ][sys-#18558%grid-0%][GridCacheProcessor] Finish proxy initialization, cacheName=encrypted, localNodeId=00fbb7ce-7ca4-4041-bd27-a7702c9b8000 [21:09:38] : [Step 4/5] [2021-11-19 21:09:38,662][INFO ][sys-#18567%grid-0%][DistributedBaselineConfiguration] Baseline auto-adjust is 'disabled' with timeout='300000' ms [21:09:38] : [Step 4/5] [2021-11-19 21:09:38,662][INFO ][sys-#18558%grid-0%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=00fbb7ce-7ca4-4041-bd27-a7702c9b8000, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=1075ed29-078e-45fc-aa85-e2182a56a001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637345378468, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:09:38] : [Step 4/5] [2021-11-19 21:09:38,662][INFO ][exchange-worker-#18586%grid-0%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=2, minorTopVer=1], force=false, evt=DISCOVERY_CUSTOM_EVT, node=1075ed29-078e-45fc-aa85-e2182a56a001] [21:09:38] : [Step 4/5] [2021-11-19 21:09:38,662][INFO ][sys-#18567%grid-0%][GridClusterStateProcessor] Successfully performed final activation steps [nodeId=00fbb7ce-7ca4-4041-bd27-a7702c9b8000, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:09:38] : [Step 4/5] [2021-11-19 21:09:38,664][INFO ][sys-#18690%grid-1%][GridCacheProcessor] Finish proxy initialization, cacheName=ignite-sys-cache, localNodeId=1075ed29-078e-45fc-aa85-e2182a56a001 [21:09:38] : [Step 4/5] [2021-11-19 21:09:38,666][INFO ][sys-#18690%grid-1%][GridCacheProcessor] Finish proxy initialization, cacheName=encrypted, localNodeId=1075ed29-078e-45fc-aa85-e2182a56a001 [21:09:38] : [Step 4/5] [2021-11-19 21:09:38,664][INFO ][sys-#18558%grid-0%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (1 ms), stage="Update caches registry" (18 ms), stage="Start caches" (1 ms), stage="Affinity initialization on cache group start" (2 ms), stage="Determine exchange type" (4 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Restore partition states" (0 ms), stage="After states restored callback" (77 ms), stage="WAL history reservation" (0 ms), stage="Waiting for all single messages" (14 ms), stage="Affinity recalculation (crd)" (0 ms), stage="Collect update counters and create affinity messages" (0 ms), stage="Assign partitions states" (1 ms), stage="Validate partitions states" (0 ms), stage="Ideal affinity diff calculation (enforced)" (2 ms), stage="Apply update counters" (0 ms), stage="Full message preparing" (4 ms), stage="Full message sending" (0 ms), stage="State finish message sending" (0 ms), stage="Detect lost partitions" (4 ms), stage="Exchange done" (11 ms), stage="Total time" (139 ms), Discovery lag=4 ms, Latest started node id=1075ed29-078e-45fc-aa85-e2182a56a001] [21:09:38] : [Step 4/5] [2021-11-19 21:09:38,669][INFO ][sys-#18690%grid-1%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=1075ed29-078e-45fc-aa85-e2182a56a001, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=1075ed29-078e-45fc-aa85-e2182a56a001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637345378646, loc=true, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:09:38] : [Step 4/5] [2021-11-19 21:09:38,669][INFO ][db-checkpoint-thread-#18723%grid-1%][Checkpointer] Checkpoint finished [cpId=de7abc2c-8c36-4096-bcd5-7f349bfab9fe, pages=60, markPos=WALPointer [idx=0, fileOff=914270, len=11887], walSegmentsCovered=[], markDuration=14ms, pagesWrite=3ms, fsync=26ms, total=49ms] [21:09:38] : [Step 4/5] [2021-11-19 21:09:38,667][INFO ][sys-#18683%grid-1%][DistributedBaselineConfiguration] Baseline auto-adjust is 'disabled' with timeout='300000' ms [21:09:38] : [Step 4/5] [2021-11-19 21:09:38,670][INFO ][sys-#18690%grid-1%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], stage="Waiting in exchange queue" (3 ms), stage="Exchange parameters initialization" (1 ms), stage="Update caches registry" (20 ms), stage="Start caches" (1 ms), stage="Affinity initialization on cache group start" (70 ms), stage="Determine exchange type" (1 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Restore partition states" (0 ms), stage="After states restored callback" (8 ms), stage="WAL history reservation" (0 ms), stage="Waiting for Full message" (21 ms), stage="Affinity recalculation" (2 ms), stage="Full map updating" (4 ms), stage="Detect lost partitions" (6 ms), stage="Exchange done" (7 ms), stage="Total time" (144 ms)] [21:09:38] : [Step 4/5] [2021-11-19 21:09:38,669][INFO ][exchange-worker-#18711%grid-1%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=2, minorTopVer=1], force=false, evt=DISCOVERY_CUSTOM_EVT, node=1075ed29-078e-45fc-aa85-e2182a56a001] [21:09:38] : [Step 4/5] [2021-11-19 21:09:38,669][INFO ][sys-#18558%grid-0%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], stage="Affinity initialization on cache group start [grp=encrypted]" (1 ms) (parent=Affinity initialization on cache group start), stage="Affinity initialization on cache group start [grp=ignite-sys-cache]" (0 ms) (parent=Affinity initialization on cache group start), stage="Affinity centralized initialization (crd) [grp=ignite-sys-cache, crd=true]" (1 ms) (parent=Determine exchange type), stage="Affinity centralized initialization (crd) [grp=encrypted, crd=true]" (1 ms) (parent=Determine exchange type), stage="Restore partition states [grp=ignite-sys-cache]" (0 ms) (parent=Restore partition states), stage="Restore partition states [grp=encrypted]" (0 ms) (parent=Restore partition states), stage="Affinity recalculation (partitions availability) [grp=encrypted]" (2 ms) (parent=Ideal affinity diff calculation (enforced)), stage="Affinity recalculation (partitions availability) [grp=ignite-sys-cache]" (0 ms) (parent=Ideal affinity diff calculation (enforced))] [21:09:38] : [Step 4/5] [2021-11-19 21:09:38,673][INFO ][sys-#18690%grid-1%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], stage="Affinity initialization on cache group start [grp=encrypted]" (69 ms) (parent=Affinity initialization on cache group start), stage="Affinity initialization on cache group start [grp=ignite-sys-cache]" (0 ms) (parent=Affinity initialization on cache group start), stage="Affinity centralized initialization (crd) [grp=ignite-sys-cache, crd=false]" (0 ms) (parent=Determine exchange type), stage="Affinity centralized initialization (crd) [grp=encrypted, crd=false]" (0 ms) (parent=Determine exchange type), stage="Restore partition states [grp=ignite-sys-cache]" (0 ms) (parent=Restore partition states), stage="Restore partition states [grp=encrypted]" (0 ms) (parent=Restore partition states), stage="Affinity applying from full message [grp=ignite-sys-cache]" (2 ms) (parent=Affinity recalculation), stage="Affinity applying from full message [grp=encrypted]" (2 ms) (parent=Affinity recalculation)] [21:09:38] : [Step 4/5] [2021-11-19 21:09:38,671][INFO ][db-checkpoint-thread-#18718%grid-0%][Checkpointer] Checkpoint finished [cpId=a6423c9a-e9b1-4bd3-989c-73f32112db94, pages=72, markPos=WALPointer [idx=0, fileOff=1083403, len=11507], walSegmentsCovered=[], markDuration=10ms, pagesWrite=7ms, fsync=34ms, total=126ms] [21:09:38] : [Step 4/5] [2021-11-19 21:09:38,671][INFO ][sys-#18683%grid-1%][GridClusterStateProcessor] Successfully performed final activation steps [nodeId=1075ed29-078e-45fc-aa85-e2182a56a001, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:09:38] : [Step 4/5] [2021-11-19 21:09:38,676][INFO ][test-runner-#18198%encryption.MasterKeyChangeTest%][root] awaitPartitionMapExchange finished [21:09:38] : [Step 4/5] [21:09:38] >>> Stopping test: MasterKeyChangeTest#testClusterRestart in 13394 ms <<< [21:09:38] : [Step 4/5] [2021-11-19 21:09:38,713][INFO ][main][root] >>> Stopping test: MasterKeyChangeTest#testClusterRestart in 13394 ms <<< [21:09:38] : [Step 4/5] [21:09:38] >>> Heap: 211 MB used / 1922 MB commited / 1922 MB max <<< [21:09:38] : [Step 4/5] [2021-11-19 21:09:38,713][INFO ][main][root] >>> Heap: 211 MB used / 1922 MB commited / 1922 MB max <<< [21:09:38] : [Step 4/5] [21:09:38] >>> Non-Heap: 152 MB used / 181 MB commited / 0 MB max <<< [21:09:38] : [Step 4/5] [2021-11-19 21:09:38,714][INFO ][main][root] >>> Non-Heap: 152 MB used / 181 MB commited / 0 MB max <<< [21:09:38] : [Step 4/5] [21:09:38] >>> Starting test: MasterKeyChangeTest#testRejectMasterKeyChangeDuringRotation <<< [21:09:38] : [Step 4/5] [2021-11-19 21:09:38,715][INFO ][main][root] >>> Starting test: MasterKeyChangeTest#testRejectMasterKeyChangeDuringRotation <<< [21:09:38] : [Step 4/5] [21:09:38] >>> Heap: 211 MB used / 1922 MB commited / 1922 MB max <<< [21:09:38] : [Step 4/5] [2021-11-19 21:09:38,716][INFO ][main][root] >>> Heap: 211 MB used / 1922 MB commited / 1922 MB max <<< [21:09:38] : [Step 4/5] [21:09:38] >>> Non-Heap: 152 MB used / 181 MB commited / 0 MB max <<< [21:09:38] : [Step 4/5] [2021-11-19 21:09:38,716][INFO ][main][root] >>> Non-Heap: 152 MB used / 181 MB commited / 0 MB max <<< [21:09:38] : [Step 4/5] [2021-11-19 21:09:38,716][INFO ][main][root] >>> Stopping grid [name=grid-1, id=1075ed29-078e-45fc-aa85-e2182a56a001] [21:09:38] : [Step 4/5] [2021-11-19 21:09:38,729][INFO ][db-checkpoint-thread-#18723%grid-1%][Checkpointer] Skipping checkpoint (no pages were modified) [checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=1ms, checkpointLockHoldTime=2ms, reason='timeout'] [21:09:38] : [Step 4/5] [2021-11-19 21:09:38,735][INFO ][tcp-disco-sock-reader-[00fbb7ce 127.0.0.1:49497]-#980%grid-1%-#18705%grid-1%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:49497, rmtPort=49497, rmtNodeId=00fbb7ce-7ca4-4041-bd27-a7702c9b8000] [21:09:38] : [Step 4/5] [2021-11-19 21:09:38,736][INFO ][disco-event-worker-#18585%grid-0%][GridDiscoveryManager] Node left topology: TcpDiscoveryNode [id=1075ed29-078e-45fc-aa85-e2182a56a001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637345378468, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false] [21:09:38] : [Step 4/5] [2021-11-19 21:09:38,737][INFO ][main][GridCacheProcessor] Stopped cache [cacheName=encrypted] [21:09:38] : [Step 4/5] [2021-11-19 21:09:38,738][INFO ][disco-event-worker-#18585%grid-0%][GridDiscoveryManager] Topology snapshot [ver=3, locNode=00fbb7ce, servers=1, clients=0, state=ACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=00fbb7ce-7ca4-4041-bd27-a7702c9b8000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:09:38] : [Step 4/5] [2021-11-19 21:09:38,738][INFO ][main][GridCacheProcessor] Stopped cache [cacheName=ignite-sys-cache] [21:09:38] : [Step 4/5] [2021-11-19 21:09:38,738][INFO ][disco-event-worker-#18585%grid-0%][GridDiscoveryManager] ^-- Baseline [id=0, size=2, online=1, offline=1] [21:09:38]W: [org.apache.ignite:ignite-core] [2021-11-19 21:09:38,739][WARN ][grid-nio-worker-tcp-comm-0-#18524%TestRecordingCommunicationSpi%][TestRecordingCommunicationSpi] Failed to shutdown socket [21:09:38]W: [org.apache.ignite:ignite-core] java.nio.channels.ClosedChannelException [21:09:38]W: [org.apache.ignite:ignite-core] at sun.nio.ch.SocketChannelImpl.shutdownOutput(SocketChannelImpl.java:795) [21:09:38]W: [org.apache.ignite:ignite-core] at sun.nio.ch.SocketAdaptor.shutdownOutput(SocketAdaptor.java:407) [21:09:38]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.close(IgniteUtils.java:4247) [21:09:38]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.closeKey(GridNioServer.java:2784) [21:09:38] : [Step 4/5] [2021-11-19 21:09:38,741][INFO ][exchange-worker-#18586%grid-0%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], crd=true, evt=NODE_LEFT, evtNode=1075ed29-078e-45fc-aa85-e2182a56a001, customEvt=null, allowMerge=false, exchangeFreeSwitch=true] [21:09:38]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.close(GridNioServer.java:2835) [21:09:38]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.close(GridNioServer.java:2794) [21:09:38]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.bodyInternal(GridNioServer.java:2157) [21:09:38]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.body(GridNioServer.java:1910) [21:09:38]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:125) [21:09:38]W: [org.apache.ignite:ignite-core] at java.lang.Thread.run(Thread.java:748) [21:09:38] : [Step 4/5] [2021-11-19 21:09:38,743][INFO ][exchange-worker-#18586%grid-0%][GridAffinityAssignmentCache] Local node affinity assignment distribution is not ideal [cache=encrypted, expectedPrimary=1024.00, actualPrimary=502, expectedBackups=0.00, actualBackups=0, warningThreshold=50.00%] [21:09:38] : [Step 4/5] [2021-11-19 21:09:38,744][INFO ][exchange-worker-#18586%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:09:38] : [Step 4/5] [2021-11-19 21:09:38,745][INFO ][exchange-worker-#18586%grid-0%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], err=null, rebalanced=true, wasRebalanced=true] [21:09:38]W: [org.apache.ignite:ignite-core] [2021-11-19 21:09:38,746][WARN ][sys-#18557%grid-0%][GridDhtPartitionTopologyImpl] Detected lost partitions [grp=encrypted, parts=[0, 2, 4, 6-7, 10-11, 14, 17, 21, 24-30, 32, 37, 40, 44, 47-52, 54, 57, 59, 62-64, 67-68, 74-75, 78, 81, 87-88, 91, 97, 99, 101-102, 104-107, 113-114, 116, 118, 120, 122, 124, 135-136, 138, 140-145, 147, 149-152, 154-156, 159-160, 162-164, 169, 172, 175-177, 180, 184-187, 190-191, 194, 196-202, 204-205, 209-210, 212, 214, 216, 219-224, 226, 229-232, 237, 239, 241, 243-245, 247, 249-251, 255, 257, 261, 265, 269, 272-273, 276-277, 281-282, 285, 287, 289-291, 293-297, 299, 301-304, 306, 308-309, 311-312, 315-317, 319, 322, 325-326, 328-330, 336, 339, 341, 344-346, 350, 352-354, 357-361, 363, 366-367, 371-373, 376-380, 383, 385, 387-388, 390, 392, 395-397, 400, 402, 405, 408-411, 416, 420, 422, 424-425, 429, 433, 435-438, 440-441, 445-446, 450, 452-453, 455-456, 458, 460, 462-463, 465-468, 470, 474-475, 480, 488, 490-492, 495, 497, 499-512, 516, 525, 527-531, 535, 537-538, 541-542, 545-546, 548-552, 554-555, 558, 562-564, 567-569, 572, 574, 579-580, 582-585, 587, 590-591, 594, 596, 600, 602, 604, 607-614, 617-620, 623-624, 627-629, 632-633, 636, 638, 640-642, 645-646, 648-649, 657-662, 664-665, 668-672, 677-678, 682-684, 686, 689, 692-693, 695-697, 699, 706-707, 709-710, 712-714, 716-717, 719-721, 723-728, 730-732, 734-735, 739, 742, 746, 749-750, 752, 754, 756, 762, 768-770, 772-775, 778, 780, 783-787, 789-791, 793, 796, 798-801, 803, 806, 809-812, 814, 816-817, 819, 822-825, 827-829, 832-833, 836-837, 839-840, 846, 848-851, 853-854, 857-858, 860, 863-864, 866, 868-871, 873-875, 877-878, 884, 888-889, 896-897, 900, 905-907, 914-915, 917, 919-920, 923-925, 931-933, 936, 940, 942, 944-945, 948, 950-951, 954, 956-958, 962, 965-970, 972, 975-976, 978-980, 983, 985, 988, 990, 993-994, 997-998, 1000, 1003-1004, 1007, 1009, 1014, 1016, 1018-1019], topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0]] [21:09:38] : [Step 4/5] [2021-11-19 21:09:38,750][INFO ][exchange-worker-#18586%grid-0%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=00fbb7ce-7ca4-4041-bd27-a7702c9b8000, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], evt=NODE_LEFT, evtNode=TcpDiscoveryNode [id=1075ed29-078e-45fc-aa85-e2182a56a001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637345378468, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0]] [21:09:38] : [Step 4/5] [2021-11-19 21:09:38,751][INFO ][exchange-worker-#18586%grid-0%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (1 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="After states restored callback" (0 ms), stage="WAL history reservation" (0 ms), stage="Finalize update counters" (0 ms), stage="Detect lost partitions" (5 ms), stage="Exchange done" (1 ms), stage="Total time" (7 ms)] [21:09:38] : [Step 4/5] [2021-11-19 21:09:38,752][INFO ][exchange-worker-#18586%grid-0%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], stage="Affinity initialization (exchange-free switch on fully-rebalanced topology) [grp=ignite-sys-cache]" (0 ms) (parent=Determine exchange type), stage="Affinity initialization (exchange-free switch on fully-rebalanced topology) [grp=encrypted]" (0 ms) (parent=Determine exchange type)] [21:09:38] : [Step 4/5] [2021-11-19 21:09:38,753][INFO ][exchange-worker-#18586%grid-0%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], crd=true] [21:09:38] : [Step 4/5] [2021-11-19 21:09:38,754][INFO ][exchange-worker-#18586%grid-0%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=3, minorTopVer=0], force=false, evt=NODE_LEFT, node=1075ed29-078e-45fc-aa85-e2182a56a001] [21:09:39] : [Step 4/5] [2021-11-19 21:09:39,115][INFO ][main][FilePageStoreManager] Cleanup cache stores [total=4, left=0, cleanFiles=false] [21:09:39] : [Step 4/5] [2021-11-19 21:09:39,118][INFO ][main][GridDeploymentLocalStore] Removed undeployed class: GridDeployment [ts=1637345378646, depMode=SHARED, clsLdr=IsolatedClassLoader{roleName='test'}, clsLdrId=a017d593d71-1075ed29-078e-45fc-aa85-e2182a56a001, userVer=0, loc=true, sampleClsName=org.apache.ignite.internal.processors.cache.distributed.dht.preloader.GridDhtPartitionFullMap, pendingUndeploy=false, undeployed=true, usage=0] [21:09:39] : [Step 4/5] [2021-11-19 21:09:39,125][INFO ][main][IgniteKernal%grid-1] [21:09:39] : [Step 4/5] [21:09:39] : [Step 4/5] >>> +------------------------------------------------------+ [21:09:39] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV stopped OK [21:09:39] : [Step 4/5] >>> +------------------------------------------------------+ [21:09:39] : [Step 4/5] >>> Ignite instance name: grid-1 [21:09:39] : [Step 4/5] >>> Grid uptime: 00:00:00.592 [21:09:39] : [Step 4/5] [21:09:39] : [Step 4/5] [21:09:39] : [Step 4/5] [2021-11-19 21:09:39,126][INFO ][main][root] >>> Stopping grid [name=grid-0, id=00fbb7ce-7ca4-4041-bd27-a7702c9b8000] [21:09:39] : [Step 4/5] [2021-11-19 21:09:39,135][INFO ][db-checkpoint-thread-#18718%grid-0%][Checkpointer] Skipping checkpoint (no pages were modified) [checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=1ms, checkpointLockHoldTime=2ms, reason='timeout'] [21:09:39]W: [org.apache.ignite:ignite-core] [2021-11-19 21:09:39,139][WARN ][tcp-disco-sock-reader-[1075ed29 127.0.0.1:52103]-#981%grid-0%-#18706%grid-0%][TestTcpDiscoverySpi] Failed to shutdown socket [21:09:39]W: [org.apache.ignite:ignite-core] java.net.SocketException: Socket is closed [21:09:39]W: [org.apache.ignite:ignite-core] at java.net.Socket.shutdownOutput(Socket.java:1568) [21:09:39]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.close(IgniteUtils.java:4247) [21:09:39]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.discovery.tcp.ServerImpl$SocketReader.body(ServerImpl.java:7370) [21:09:39]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.IgniteSpiThread.run(IgniteSpiThread.java:58) [21:09:39] : [Step 4/5] [2021-11-19 21:09:39,140][INFO ][tcp-disco-sock-reader-[1075ed29 127.0.0.1:52103]-#981%grid-0%-#18706%grid-0%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:52103, rmtPort=52103, rmtNodeId=1075ed29-078e-45fc-aa85-e2182a56a001] [21:09:39] : [Step 4/5] [2021-11-19 21:09:39,144][INFO ][main][GridCacheProcessor] Stopped cache [cacheName=encrypted] [21:09:39] : [Step 4/5] [2021-11-19 21:09:39,144][INFO ][main][GridCacheProcessor] Stopped cache [cacheName=ignite-sys-cache] [21:09:39] : [Step 4/5] [2021-11-19 21:09:39,150][INFO ][main][FilePageStoreManager] Cleanup cache stores [total=4, left=0, cleanFiles=false] [21:09:39] : [Step 4/5] [2021-11-19 21:09:39,153][INFO ][main][GridDeploymentLocalStore] Removed undeployed class: GridDeployment [ts=1637345378625, depMode=SHARED, clsLdr=IsolatedClassLoader{roleName='test'}, clsLdrId=8017d593d71-00fbb7ce-7ca4-4041-bd27-a7702c9b8000, userVer=0, loc=true, sampleClsName=org.apache.ignite.internal.processors.cache.distributed.dht.preloader.GridDhtPartitionMap, pendingUndeploy=false, undeployed=true, usage=0] [21:09:39] : [Step 4/5] [2021-11-19 21:09:39,160][INFO ][main][IgniteKernal%grid-0] [21:09:39] : [Step 4/5] [21:09:39] : [Step 4/5] >>> +------------------------------------------------------+ [21:09:39] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV stopped OK [21:09:39] : [Step 4/5] >>> +------------------------------------------------------+ [21:09:39] : [Step 4/5] >>> Ignite instance name: grid-0 [21:09:39] : [Step 4/5] >>> Grid uptime: 00:00:02.702 [21:09:39] : [Step 4/5] [21:09:39] : [Step 4/5] [21:09:39]W: [org.apache.ignite:ignite-core] [2021-11-19 21:09:39,439][WARN ][test-runner-#18741%encryption.MasterKeyChangeTest%][G] Ignite work directory is not provided, automatically resolved to: /opt/buildagent/work/7bc1c54bc719b67c/work [21:09:39] : [Step 4/5] [2021-11-19 21:09:39,440][INFO ][test-runner-#18741%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] [21:09:39] : [Step 4/5] [21:09:39] : [Step 4/5] >>> __________ ________________ [21:09:39] : [Step 4/5] >>> / _/ ___/ |/ / _/_ __/ __/ [21:09:39] : [Step 4/5] >>> _/ // (7 7 // / / / / _/ [21:09:39] : [Step 4/5] >>> /___/\___/_/|_/___/ /_/ /___/ [21:09:39] : [Step 4/5] >>> [21:09:39] : [Step 4/5] >>> ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:09:39] : [Step 4/5] >>> 2021 Copyright(C) Apache Software Foundation [21:09:39] : [Step 4/5] >>> [21:09:39] : [Step 4/5] >>> Ignite documentation: http://ignite.apache.org [21:09:39] : [Step 4/5] [21:09:39] : [Step 4/5] [2021-11-19 21:09:39,440][INFO ][test-runner-#18741%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] Config URL: n/a [21:09:39] : [Step 4/5] [2021-11-19 21:09:39,441][INFO ][test-runner-#18741%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] IgniteConfiguration [igniteInstanceName=grid-0, pubPoolSize=24, svcPoolSize=24, callbackPoolSize=24, stripedPoolSize=24, sysPoolSize=24, mgmtPoolSize=4, dataStreamerPoolSize=24, utilityCachePoolSize=24, utilityCacheKeepAliveTime=60000, p2pPoolSize=2, qryPoolSize=24, buildIdxPoolSize=4, igniteHome=/opt/buildagent/work/7bc1c54bc719b67c, igniteWorkDir=/opt/buildagent/work/7bc1c54bc719b67c/work, mbeanSrv=com.sun.jmx.mbeanserver.JmxMBeanServer@6fe85038, nodeId=0055470b-0938-4c8d-91e6-894fbb9ab000, marsh=BinaryMarshaller [], marshLocJobs=false, daemon=false, p2pEnabled=true, netTimeout=10000, netCompressionLevel=1, sndRetryDelay=1000, sndRetryCnt=3, metricsHistSize=10000, metricsUpdateFreq=1000, metricsExpTime=9223372036854775807, discoSpi=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=0, ackTimeout=0, marsh=null, reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], segPlc=STOP, segResolveAttempts=2, waitForSegOnStart=true, allResolversPassReq=true, segChkFreq=10000, commSpi=TcpCommunicationSpi [connectGate=org.apache.ignite.spi.communication.tcp.internal.ConnectGateway@3ee7e612, ctxInitLatch=java.util.concurrent.CountDownLatch@3a492666[Count = 1], stopping=false, clientPool=null, nioSrvWrapper=null, stateProvider=null], evtSpi=MemoryEventStorageSpi [expireAgeMs=9223372036854775807, expireCnt=10000, filter=null], colSpi=NoopCollisionSpi [], deploySpi=LocalDeploymentSpi [], indexingSpi=org.apache.ignite.spi.indexing.noop.NoopIndexingSpi@563d9c5, addrRslvr=null, encryptionSpi=org.apache.ignite.spi.encryption.keystore.KeystoreEncryptionSpi@12106fad, tracingSpi=org.apache.ignite.spi.tracing.NoopTracingSpi@59c2ac8, clientMode=false, rebalanceThreadPoolSize=4, rebalanceTimeout=10000, rebalanceBatchesPrefetchCnt=3, rebalanceThrottle=0, rebalanceBatchSize=524288, txCfg=TransactionConfiguration [txSerEnabled=false, dfltIsolation=REPEATABLE_READ, dfltConcurrency=PESSIMISTIC, dfltTxTimeout=0, txTimeoutOnPartitionMapExchange=0, deadlockTimeout=10000, pessimisticTxLogSize=0, pessimisticTxLogLinger=10000, tmLookupClsName=null, txManagerFactory=null, useJtaSync=false], cacheSanityCheckEnabled=true, discoStartupDelay=60000, deployMode=SHARED, p2pMissedCacheSize=100, locHost=127.0.0.1, timeSrvPortBase=31100, timeSrvPortRange=100, failureDetectionTimeout=10000, sysWorkerBlockedTimeout=null, clientFailureDetectionTimeout=10000, metricsLogFreq=0, connectorCfg=null, odbcCfg=null, warmupClos=null, atomicCfg=AtomicConfiguration [seqReserveSize=1000, cacheMode=PARTITIONED, backups=1, aff=null, grpName=null], classLdr=null, sslCtxFactory=null, platformCfg=null, binaryCfg=null, memCfg=null, pstCfg=null, dsCfg=DataStorageConfiguration [sysRegionInitSize=41943040, sysRegionMaxSize=104857600, pageSize=4096, concLvl=0, dfltDataRegConf=DataRegionConfiguration [name=default, maxSize=10485760, initSize=268435456, swapPath=null, pageEvictionMode=DISABLED, pageReplacementMode=CLOCK, evictionThreshold=0.9, emptyPagesPoolSize=100, metricsEnabled=false, metricsSubIntervalCount=5, metricsRateTimeInterval=60000, persistenceEnabled=true, checkpointPageBufSize=0, lazyMemoryAllocation=true, warmUpCfg=null], dataRegions=null, storagePath=null, checkpointFreq=180000, lockWaitTime=10000, checkpointThreads=4, checkpointWriteOrder=SEQUENTIAL, walHistSize=20, maxWalArchiveSize=1073741824, walSegments=10, walSegmentSize=67108864, walPath=db/wal, walArchivePath=db/wal/archive, cdcWalPath=db/wal/cdc, cdcEnabled=false, metricsEnabled=false, walMode=FSYNC, walTlbSize=131072, walBuffSize=0, walFlushFreq=2000, walFsyncDelay=1000, walRecordIterBuffSize=67108864, alwaysWriteFullPages=false, fileIOFactory=org.apache.ignite.internal.processors.cache.persistence.file.AsyncFileIOFactory@6bd4def7, metricsSubIntervalCnt=5, metricsRateTimeInterval=60000, walAutoArchiveAfterInactivity=-1, walForceArchiveTimeout=-1, writeThrottlingEnabled=false, walCompactionEnabled=false, walCompactionLevel=1, checkpointReadLockTimeout=null, walPageCompression=DISABLED, walPageCompressionLevel=null, dfltWarmUpCfg=null, encCfg=org.apache.ignite.configuration.EncryptionConfiguration@70241807, defragmentationThreadPoolSize=4, minWalArchiveSize=-1], snapshotPath=snapshots, activeOnStart=true, activeOnStartPropSetFlag=false, autoActivation=true, autoActivationPropSetFlag=false, clusterStateOnStart=null, sqlConnCfg=null, cliConnCfg=ClientConnectorConfiguration [host=null, port=10800, portRange=100, sockSndBufSize=0, sockRcvBufSize=0, tcpNoDelay=true, maxOpenCursorsPerConn=128, threadPoolSize=24, selectorCnt=12, idleTimeout=0, handshakeTimeout=10000, jdbcEnabled=true, odbcEnabled=true, thinCliEnabled=true, sslEnabled=false, useIgniteSslCtxFactory=true, sslClientAuth=false, sslCtxFactory=null, thinCliCfg=ThinClientConfiguration [maxActiveTxPerConn=100, maxActiveComputeTasksPerConn=0]], mvccVacuumThreadCnt=2, mvccVacuumFreq=5000, authEnabled=false, failureHnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]], commFailureRslvr=null, sqlCfg=SqlConfiguration [longQryWarnTimeout=3000, dfltQryTimeout=0, sqlQryHistSize=1000, validationEnabled=false], asyncContinuationExecutor=null] [21:09:39] : [Step 4/5] [2021-11-19 21:09:39,450][INFO ][test-runner-#18741%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] Daemon mode: off [21:09:39] : [Step 4/5] [2021-11-19 21:09:39,450][INFO ][test-runner-#18741%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] OS: Linux 4.15.0-151-generic amd64 [21:09:39] : [Step 4/5] [2021-11-19 21:09:39,450][INFO ][test-runner-#18741%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] OS user: teamcity [21:09:39] : [Step 4/5] [2021-11-19 21:09:39,450][INFO ][test-runner-#18741%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] PID: 16724 [21:09:39] : [Step 4/5] [2021-11-19 21:09:39,451][INFO ][test-runner-#18741%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] Language runtime: Java Platform API Specification ver. 1.8 [21:09:39] : [Step 4/5] [2021-11-19 21:09:39,451][INFO ][test-runner-#18741%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] VM information: Java(TM) SE Runtime Environment 1.8.0_261-b12 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 25.261-b12 [21:09:39] : [Step 4/5] [2021-11-19 21:09:39,451][INFO ][test-runner-#18741%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] VM total memory: 1.9GB [21:09:39] : [Step 4/5] [2021-11-19 21:09:39,451][INFO ][test-runner-#18741%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] Remote Management [restart: off, REST: off, JMX (remote: off)] [21:09:39] : [Step 4/5] [2021-11-19 21:09:39,452][INFO ][test-runner-#18741%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] Logger: GridTestLog4jLogger [quiet=false, config=null] [21:09:39] : [Step 4/5] [2021-11-19 21:09:39,452][INFO ][test-runner-#18741%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] IGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c [21:09:39] : [Step 4/5] [2021-11-19 21:09:39,452][INFO ][test-runner-#18741%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] VM arguments: [-DIGNITE_DUMP_THREADS_ON_FAILURE=false, -DMono=/usr/bin/mono-sgen, -DMono4.0_x64=/usr/lib/mono/4.0, -DMono4.5_x64=/usr/lib/mono/4.5, -DMonoVersion=6.12.0.90, -DSKIP_BUILD=false, -Dagent.home.dir=/opt/buildagent, -Dagent.name=aitc-lin02_03, -Dagent.ownPort=9090, -Dagent.work.dir=/opt/buildagent/work, -Dbuild.number=95, -Dbuild.vcs.number=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.1=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.GitHubApacheIgnite=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dclassworlds.conf=/opt/buildagent/temp/buildTmp/teamcity.m2.conf, -Dcom.jetbrains.maven.watcher.report.file=/opt/buildagent/temp/buildTmp/maven-build-info.xml, -Djava.io.tmpdir=/opt/buildagent/temp/buildTmp, -Dmaven.home=/opt/buildagent/tools/maven3_6, -Dmaven.multiModuleProjectDirectory=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.agent.cpuBenchmark=457, -Dteamcity.agent.dotnet.agent_url=http://localhost:9090/RPC2, -Dteamcity.agent.dotnet.build_id=6278078, -Dteamcity.auth.password=*******, -Dteamcity.auth.userId=TeamCityBuildId=6278078, -Dteamcity.build.changedFiles.file=/opt/buildagent/temp/buildTmp/changedFiles6342607772318147725.txt, -Dteamcity.build.checkoutDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.build.id=6278078, -Dteamcity.build.properties.file=/opt/buildagent/temp/buildTmp/teamcity.build5164517880467851002.properties, -Dteamcity.build.tempDir=/opt/buildagent/temp/buildTmp, -Dteamcity.build.workingDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.buildConfName=Basic 3, -Dteamcity.buildType.id=IgniteTests24Java8_Basic3, -Dteamcity.configuration.properties.file=/opt/buildagent/temp/buildTmp/teamcity.config5591980786735343870.properties, -Dteamcity.maven.userSettings.path=/opt/buildagent/temp/buildTmp/maven_settings_585072866407032347.xml, -Dteamcity.maven.watcher.home=/opt/buildagent/plugins/mavenPlugin/maven-watcher-jdk16, -Dteamcity.projectName=Ignite Tests 2.x (JDK 8/11), -Dteamcity.runner.properties.file=/opt/buildagent/temp/buildTmp/teamcity.runner9098465561618137420.properties, -Dteamcity.tests.recentlyFailedTests.file=/opt/buildagent/temp/buildTmp/testsToRunFirst3891775683130404069.txt, -Dteamcity.version=2021.2 (build 99542), -ea, -Xms2g, -Xmx2g, -XX:+HeapDumpOnOutOfMemoryError, -DIGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_TEST_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_UPDATE_NOTIFIER=false, -DIGNITE_NO_DISCO_ORDER=true, -DIGNITE_PERFORMANCE_SUGGESTIONS_DISABLED=true, -Djava.net.preferIPv4Stack=true, -DTEST_SCALE_FACTOR=1.0, -DIGNITE_TEST_PROP_LOG4J_FILE=log4j-tc-test.xml, -DIGNITE_QUIET=false, -DIGNITE_MARSHAL_BUFFERS_RECHECK=1000, -Dmaven.repo.local=/opt/buildagent/.m2/repository] [21:09:39] : [Step 4/5] [2021-11-19 21:09:39,456][INFO ][test-runner-#18741%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] System cache's DataRegion size is configured to 40 MB. Use DataStorageConfiguration.systemRegionInitialSize property to change the setting. [21:09:39] : [Step 4/5] [2021-11-19 21:09:39,457][INFO ][test-runner-#18741%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] Configured caches [in 'sysMemPlc' dataRegion: ['ignite-sys-cache']] [21:09:39]W: [org.apache.ignite:ignite-core] [2021-11-19 21:09:39,457][WARN ][test-runner-#18741%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] Peer class loading is enabled (disable it in production for performance and deployment consistency reasons) [21:09:39] : [Step 4/5] [2021-11-19 21:09:39,457][INFO ][test-runner-#18741%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] 3-rd party licenses can be found at: /opt/buildagent/work/7bc1c54bc719b67c/libs/licenses [21:09:39] : [Step 4/5] [2021-11-19 21:09:39,461][INFO ][test-runner-#18741%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] Configured plugins: [21:09:39] : [Step 4/5] [2021-11-19 21:09:39,462][INFO ][test-runner-#18741%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] ^-- StanByClusterTestProvider 1.0 [21:09:39] : [Step 4/5] [2021-11-19 21:09:39,462][INFO ][test-runner-#18741%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:09:39] : [Step 4/5] [2021-11-19 21:09:39,462][INFO ][test-runner-#18741%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] [21:09:39] : [Step 4/5] [2021-11-19 21:09:39,462][INFO ][test-runner-#18741%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] ^-- PageMemory tracker plugin 1.0 [21:09:39] : [Step 4/5] [2021-11-19 21:09:39,463][INFO ][test-runner-#18741%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:09:39] : [Step 4/5] [2021-11-19 21:09:39,463][INFO ][test-runner-#18741%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] [21:09:39] : [Step 4/5] [2021-11-19 21:09:39,463][INFO ][test-runner-#18741%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] ^-- TestDistibutedConfigurationPlugin 1.0 [21:09:39] : [Step 4/5] [2021-11-19 21:09:39,463][INFO ][test-runner-#18741%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:09:39] : [Step 4/5] [2021-11-19 21:09:39,464][INFO ][test-runner-#18741%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] [21:09:39] : [Step 4/5] [2021-11-19 21:09:39,464][INFO ][test-runner-#18741%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] ^-- NodeValidationPluginProvider 1.0 [21:09:39] : [Step 4/5] [2021-11-19 21:09:39,464][INFO ][test-runner-#18741%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:09:39] : [Step 4/5] [2021-11-19 21:09:39,465][INFO ][test-runner-#18741%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] [21:09:39] : [Step 4/5] [2021-11-19 21:09:39,465][INFO ][test-runner-#18741%encryption.MasterKeyChangeTest%][FailureProcessor] Configured failure handler: [hnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]]] [21:09:39] : [Step 4/5] [2021-11-19 21:09:39,478][INFO ][test-runner-#18741%encryption.MasterKeyChangeTest%][TestRecordingCommunicationSpi] Successfully bound communication NIO server to TCP port [port=47100, locHost=/127.0.0.1, selectorsCnt=12, selectorSpins=0, pairedConn=false] [21:09:39]W: [org.apache.ignite:ignite-core] [2021-11-19 21:09:39,478][WARN ][test-runner-#18741%encryption.MasterKeyChangeTest%][TestRecordingCommunicationSpi] Message queue limit is set to 0 which may lead to potential OOMEs when running cache operations in FULL_ASYNC or PRIMARY_SYNC modes due to message queues growth on sender and receiver sides. [21:09:39] : [Step 4/5] [2021-11-19 21:09:39,483][INFO ][test-runner-#18741%encryption.MasterKeyChangeTest%][GridCollisionManager] Collision resolution is disabled (all jobs will be activated upon arrival). [21:09:39] : [Step 4/5] [2021-11-19 21:09:39,483][INFO ][test-runner-#18741%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] Security status [authentication=off, sandbox=off, tls/ssl=off] [21:09:39] : [Step 4/5] [2021-11-19 21:09:39,541][INFO ][test-runner-#18741%encryption.MasterKeyChangeTest%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:09:39] : [Step 4/5] [2021-11-19 21:09:39,624][INFO ][test-runner-#18741%encryption.MasterKeyChangeTest%][MaintenanceProcessor] Resolved store directory for node persistent data: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0 [21:09:39] : [Step 4/5] [2021-11-19 21:09:39,626][INFO ][test-runner-#18741%encryption.MasterKeyChangeTest%][CacheObjectBinaryProcessorImpl] Resolved directory for serialized binary metadata: /opt/buildagent/work/7bc1c54bc719b67c/work/db/binary_meta/grid_0 [21:09:39] : [Step 4/5] [2021-11-19 21:09:39,631][INFO ][test-runner-#18741%encryption.MasterKeyChangeTest%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0 [21:09:39] : [Step 4/5] [2021-11-19 21:09:39,631][INFO ][test-runner-#18741%encryption.MasterKeyChangeTest%][FileWriteAheadLogManager] Resolved write ahead log work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0 [21:09:39] : [Step 4/5] [2021-11-19 21:09:39,632][INFO ][test-runner-#18741%encryption.MasterKeyChangeTest%][FileWriteAheadLogManager] Resolved write ahead log archive directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0 [21:09:40] : [Step 4/5] [2021-11-19 21:09:40,555][INFO ][test-runner-#18741%encryption.MasterKeyChangeTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000000.wal [21:09:40]W: [org.apache.ignite:ignite-core] [2021-11-19 21:09:40,556][WARN ][test-runner-#18741%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] DataRegion maxSize=10.5 MB is smaller than defaultInitialSize=268.4 MB, setting initialSize to 10.5 MB [21:09:40] : [Step 4/5] [2021-11-19 21:09:40,562][INFO ][test-runner-#18741%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Configured data regions initialized successfully [total=5] [21:09:40] : [Step 4/5] [2021-11-19 21:09:40,564][INFO ][test-runner-#18741%encryption.MasterKeyChangeTest%][IgniteSnapshotManager] Resolved snapshot work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/snapshots [21:09:40] : [Step 4/5] [2021-11-19 21:09:40,565][INFO ][test-runner-#18741%encryption.MasterKeyChangeTest%][IgniteSnapshotManager] Resolved temp directory for snapshot creation: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0/snp [21:09:40] : [Step 4/5] [2021-11-19 21:09:40,568][INFO ][test-runner-#18741%encryption.MasterKeyChangeTest%][ClientListenerProcessor] Client connector processor has started on TCP port 10800 [21:09:40] : [Step 4/5] [2021-11-19 21:09:40,573][INFO ][test-runner-#18741%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] Non-loopback local IPs: 172.17.0.4 [21:09:40] : [Step 4/5] [2021-11-19 21:09:40,574][INFO ][test-runner-#18741%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] Enabled local MACs: 0242AC110004 [21:09:40] : [Step 4/5] [2021-11-19 21:09:40,576][INFO ][test-runner-#18741%encryption.MasterKeyChangeTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:09:40] : [Step 4/5] [2021-11-19 21:09:40,578][INFO ][test-runner-#18741%encryption.MasterKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:09:40] : [Step 4/5] [2021-11-19 21:09:40,578][INFO ][test-runner-#18741%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:09:40] : [Step 4/5] [2021-11-19 21:09:40,580][INFO ][test-runner-#18741%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Applying lost metastore updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:09:40] : [Step 4/5] [2021-11-19 21:09:40,581][INFO ][test-runner-#18741%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=0 ms] [21:09:40] : [Step 4/5] [2021-11-19 21:09:40,581][INFO ][test-runner-#18741%encryption.MasterKeyChangeTest%][GridCacheProcessor] Restoring partition state for local groups. [21:09:40] : [Step 4/5] [2021-11-19 21:09:40,582][INFO ][test-runner-#18741%encryption.MasterKeyChangeTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=0, partitionsProcessed=0, time=0ms] [21:09:40] : [Step 4/5] [2021-11-19 21:09:40,582][INFO ][test-runner-#18741%encryption.MasterKeyChangeTest%][GridEncryptionManager] Encryption keys loaded from metastore. [grps=, masterKeyName=ignite.master.key] [21:09:40] : [Step 4/5] [2021-11-19 21:09:40,587][INFO ][test-runner-#18741%encryption.MasterKeyChangeTest%][ClusterProcessor] Cluster ID and tag has been read from metastorage: null [21:09:40] : [Step 4/5] [2021-11-19 21:09:40,587][INFO ][test-runner-#18741%encryption.MasterKeyChangeTest%][IgniteClusterImpl] Shutdown policy was updated [oldVal=null, newVal=null] [21:09:40] : [Step 4/5] [2021-11-19 21:09:40,588][INFO ][test-runner-#18741%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Checkpoint frequency deviation changed [oldVal=null, newVal=null] [21:09:40] : [Step 4/5] [2021-11-19 21:09:40,597][INFO ][test-runner-#18741%encryption.MasterKeyChangeTest%][FilePageStoreManager] Cleanup cache stores [total=1, left=0, cleanFiles=false] [21:09:40] : [Step 4/5] [2021-11-19 21:09:40,600][INFO ][test-runner-#18741%encryption.MasterKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:09:40] : [Step 4/5] [2021-11-19 21:09:40,601][INFO ][test-runner-#18741%encryption.MasterKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:09:40] : [Step 4/5] [2021-11-19 21:09:40,602][INFO ][test-runner-#18741%encryption.MasterKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:09:40] : [Step 4/5] [2021-11-19 21:09:40,603][INFO ][test-runner-#18741%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Data Regions Started: 5 [21:09:40] : [Step 4/5] [2021-11-19 21:09:40,603][INFO ][test-runner-#18741%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] ^-- sysMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:09:40] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:09:40] : [Step 4/5] ^-- default region [type=default, persistence=true, lazyAlloc=true, [21:09:40] : [Step 4/5] ... initCfg=10MB, maxCfg=10MB, usedRam=0MB, freeRam=100%, allocRam=0MB, allocTotal=0MB] [21:09:40] : [Step 4/5] ^-- metastoreMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:09:40] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:09:40] : [Step 4/5] ^-- TxLog region [type=internal, persistence=true, lazyAlloc=false, [21:09:40] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:09:40] : [Step 4/5] ^-- volatileDsMemPlc region [type=user, persistence=false, lazyAlloc=true, [21:09:40] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB] [21:09:40] : [Step 4/5] ^-- Ignite persistence [used=0MB] [21:09:40] : [Step 4/5] [21:09:40] : [Step 4/5] [2021-11-19 21:09:40,605][INFO ][test-runner-#18741%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Starting binary memory restore for: [-2100569601] [21:09:40] : [Step 4/5] [2021-11-19 21:09:40,612][INFO ][test-runner-#18741%encryption.MasterKeyChangeTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:09:40] : [Step 4/5] [2021-11-19 21:09:40,612][INFO ][test-runner-#18741%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:09:40] : [Step 4/5] [2021-11-19 21:09:40,613][INFO ][test-runner-#18741%encryption.MasterKeyChangeTest%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000000.wal, offset=0, ver=2] [21:09:40] : [Step 4/5] [2021-11-19 21:09:40,617][INFO ][test-runner-#18741%encryption.MasterKeyChangeTest%][GridCacheProcessor] Started cache in recovery mode [name=ignite-sys-cache, id=-2100569601, dataRegionName=sysMemPlc, mode=REPLICATED, atomicity=TRANSACTIONAL, backups=2147483647, mvcc=false] [21:09:40] : [Step 4/5] [2021-11-19 21:09:40,618][INFO ][test-runner-#18741%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Binary recovery performed in 13 ms. [21:09:40] : [Step 4/5] [2021-11-19 21:09:40,618][INFO ][test-runner-#18741%encryption.MasterKeyChangeTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:09:40] : [Step 4/5] [2021-11-19 21:09:40,619][INFO ][test-runner-#18741%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Applying lost cache updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:09:40] : [Step 4/5] [2021-11-19 21:09:40,664][INFO ][test-runner-#18741%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=40 ms] [21:09:40] : [Step 4/5] [2021-11-19 21:09:40,664][INFO ][test-runner-#18741%encryption.MasterKeyChangeTest%][GridCacheProcessor] Restoring partition state for local groups. [21:09:40] : [Step 4/5] [2021-11-19 21:09:40,674][INFO ][test-runner-#18741%encryption.MasterKeyChangeTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=1, partitionsProcessed=100, time=10ms] [21:09:41] : [Step 4/5] [2021-11-19 21:09:41,494][INFO ][test-runner-#18741%encryption.MasterKeyChangeTest%][TestTcpDiscoverySpi] Successfully bound to TCP port [port=47500, localHost=localhost/127.0.0.1, locNodeId=0055470b-0938-4c8d-91e6-894fbb9ab000] [21:09:41] : [Step 4/5] [2021-11-19 21:09:41,507][INFO ][disco-notifier-worker-#18852%grid-0%][MvccProcessorImpl] Assigned mvcc coordinator [crd=MvccCoordinator [topVer=AffinityTopologyVersion [topVer=1, minorTopVer=0], nodeId=0055470b-0938-4c8d-91e6-894fbb9ab000, ver=1637345381505, local=true, initialized=false]] [21:09:41] : [Step 4/5] [2021-11-19 21:09:41,509][INFO ][sys-#18833%grid-0%][ClusterProcessor] Writing cluster ID and tag to metastorage on ready for write ClusterIdAndTag [id=fc5d65cb-d6ff-4395-a783-b78604703f50, tag=magical_brattain] [21:09:41] : [Step 4/5] [2021-11-19 21:09:41,513][INFO ][disco-notifier-worker-#18852%grid-0%][ClusterProcessor] magical_brattain [21:09:41] : [Step 4/5] [2021-11-19 21:09:41,514][INFO ][disco-notifier-worker-#18852%grid-0%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustEnabled' was changed from 'null' to 'false' [21:09:41] : [Step 4/5] [2021-11-19 21:09:41,515][INFO ][disco-notifier-worker-#18852%grid-0%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustTimeout' was changed from 'null' to '300000' [21:09:41] : [Step 4/5] [2021-11-19 21:09:41,516][INFO ][disco-notifier-worker-#18852%grid-0%][IgniteTxManager] Transactions parameter 'longOperationsDumpTimeout' was changed from 'null' to '60000' [21:09:41] : [Step 4/5] [2021-11-19 21:09:41,516][INFO ][disco-notifier-worker-#18852%grid-0%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpThreshold' was changed from 'null' to '0' [21:09:41] : [Step 4/5] [2021-11-19 21:09:41,517][INFO ][disco-notifier-worker-#18852%grid-0%][IgniteTxManager] Transactions parameter 'transactionTimeDumpSamplesCoefficient' was changed from 'null' to '0.0' [21:09:41] : [Step 4/5] [2021-11-19 21:09:41,517][INFO ][disco-notifier-worker-#18852%grid-0%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpSamplesPerSecondLimit' was changed from 'null' to '5' [21:09:41] : [Step 4/5] [2021-11-19 21:09:41,518][INFO ][disco-notifier-worker-#18852%grid-0%][IgniteTxManager] Transactions parameter 'collisionsDumpInterval' was changed from 'null' to '1000' [21:09:41] : [Step 4/5] [2021-11-19 21:09:41,519][INFO ][disco-notifier-worker-#18852%grid-0%][IgniteTxManager] Transactions parameter 'txOwnerDumpRequestsAllowed' was changed from 'null' to 'true' [21:09:41] : [Step 4/5] [2021-11-19 21:09:41,519][INFO ][disco-notifier-worker-#18852%grid-0%][GridCacheDatabaseSharedManager] Historical rebalance WAL threshold changed [property=historical.rebalance.threshold, oldVal=null, newVal=500] [21:09:41] : [Step 4/5] [2021-11-19 21:09:41,524][INFO ][test-runner-#18741%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] To start Console Management & Monitoring run ignitevisorcmd.{sh|bat} [21:09:41] : [Step 4/5] [2021-11-19 21:09:41,525][INFO ][test-runner-#18741%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] [21:09:41] : [Step 4/5] [21:09:41] : [Step 4/5] >>> +-------------------------------------------+ [21:09:41] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:09:41] : [Step 4/5] >>> +-------------------------------------------+ [21:09:41] : [Step 4/5] >>> OS name: Linux 4.15.0-151-generic amd64 [21:09:41] : [Step 4/5] >>> CPU(s): 24 [21:09:41] : [Step 4/5] >>> Heap: 2.0GB [21:09:41] : [Step 4/5] >>> VM name: 16724@c4dfe9a430b2 [21:09:41] : [Step 4/5] >>> Ignite instance name: grid-0 [21:09:41] : [Step 4/5] >>> Local node [ID=0055470B-0938-4C8D-91E6-894FBB9AB000, order=1, clientMode=false] [21:09:41] : [Step 4/5] >>> Local node addresses: [127.0.0.1] [21:09:41] : [Step 4/5] >>> Local ports: TCP:10800 TCP:47100 TCP:47500 [21:09:41] : [Step 4/5] [21:09:41] : [Step 4/5] [2021-11-19 21:09:41,526][INFO ][test-runner-#18741%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] >>> Ignite cluster is in INACTIVE state (limited functionality available). Use control.(sh|bat) script or IgniteCluster.state(ClusterState.ACTIVE) to change the state. [21:09:41] : [Step 4/5] [2021-11-19 21:09:41,527][INFO ][test-runner-#18741%encryption.MasterKeyChangeTest%][GridDiscoveryManager] Topology snapshot [ver=1, locNode=0055470b, servers=1, clients=0, state=INACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=0055470b-0938-4c8d-91e6-894fbb9ab000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:09:41] : [Step 4/5] [2021-11-19 21:09:41,528][INFO ][test-runner-#18741%encryption.MasterKeyChangeTest%][G] Node started : [stage="Configure system pool" (0 ms),stage="Start managers" (185 ms),stage="Configure binary metadata" (2 ms),stage="Start processors" (944 ms),stage="Start 'StanByClusterTestProvider' plugin" (0 ms),stage="Start 'PageMemory tracker plugin' plugin" (0 ms),stage="Start 'TestDistibutedConfigurationPlugin' plugin" (0 ms),stage="Start 'NodeValidationPluginProvider' plugin" (0 ms),stage="Init metastore" (24 ms),stage="Init and start regions" (6 ms),stage="Restore binary memory" (13 ms),stage="Restore logical state" (56 ms),stage="Finish recovery" (817 ms),stage="Join topology" (14 ms),stage="Await transition" (3 ms),stage="Await exchange" (17 ms),stage="Total time" (2081 ms)] [21:09:41] : [Step 4/5] [2021-11-19 21:09:41,530][INFO ][test-runner-#18741%encryption.MasterKeyChangeTest%][root] Node started with the following configuration [id=0055470b-0938-4c8d-91e6-894fbb9ab000, marshaller=BinaryMarshaller [], discovery=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=5000, ackTimeout=5000, marsh=JdkMarshaller [clsFilter=org.apache.ignite.marshaller.MarshallerUtils$1@1834a20d], reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], binaryCfg=null, lateAff=true] [21:09:41]W: [org.apache.ignite:ignite-core] [2021-11-19 21:09:41,536][WARN ][test-runner-#18741%encryption.MasterKeyChangeTest%][G] Ignite work directory is not provided, automatically resolved to: /opt/buildagent/work/7bc1c54bc719b67c/work [21:09:41] : [Step 4/5] [2021-11-19 21:09:41,538][INFO ][test-runner-#18741%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] [21:09:41] : [Step 4/5] [21:09:41] : [Step 4/5] >>> __________ ________________ [21:09:41] : [Step 4/5] >>> / _/ ___/ |/ / _/_ __/ __/ [21:09:41] : [Step 4/5] >>> _/ // (7 7 // / / / / _/ [21:09:41] : [Step 4/5] >>> /___/\___/_/|_/___/ /_/ /___/ [21:09:41] : [Step 4/5] >>> [21:09:41] : [Step 4/5] >>> ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:09:41] : [Step 4/5] >>> 2021 Copyright(C) Apache Software Foundation [21:09:41] : [Step 4/5] >>> [21:09:41] : [Step 4/5] >>> Ignite documentation: http://ignite.apache.org [21:09:41] : [Step 4/5] [21:09:41] : [Step 4/5] [2021-11-19 21:09:41,538][INFO ][test-runner-#18741%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] Config URL: n/a [21:09:41] : [Step 4/5] [2021-11-19 21:09:41,539][INFO ][test-runner-#18741%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] IgniteConfiguration [igniteInstanceName=grid-1, pubPoolSize=24, svcPoolSize=24, callbackPoolSize=24, stripedPoolSize=24, sysPoolSize=24, mgmtPoolSize=4, dataStreamerPoolSize=24, utilityCachePoolSize=24, utilityCacheKeepAliveTime=60000, p2pPoolSize=2, qryPoolSize=24, buildIdxPoolSize=4, igniteHome=/opt/buildagent/work/7bc1c54bc719b67c, igniteWorkDir=/opt/buildagent/work/7bc1c54bc719b67c/work, mbeanSrv=com.sun.jmx.mbeanserver.JmxMBeanServer@6fe85038, nodeId=10c9b180-4e9e-47f4-91be-f461fdbc7001, marsh=BinaryMarshaller [], marshLocJobs=false, daemon=false, p2pEnabled=true, netTimeout=10000, netCompressionLevel=1, sndRetryDelay=1000, sndRetryCnt=3, metricsHistSize=10000, metricsUpdateFreq=1000, metricsExpTime=9223372036854775807, discoSpi=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=0, ackTimeout=0, marsh=null, reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], segPlc=STOP, segResolveAttempts=2, waitForSegOnStart=true, allResolversPassReq=true, segChkFreq=10000, commSpi=TcpCommunicationSpi [connectGate=org.apache.ignite.spi.communication.tcp.internal.ConnectGateway@14e8eb0a, ctxInitLatch=java.util.concurrent.CountDownLatch@32d41304[Count = 1], stopping=false, clientPool=null, nioSrvWrapper=null, stateProvider=null], evtSpi=MemoryEventStorageSpi [expireAgeMs=9223372036854775807, expireCnt=10000, filter=null], colSpi=NoopCollisionSpi [], deploySpi=LocalDeploymentSpi [], indexingSpi=org.apache.ignite.spi.indexing.noop.NoopIndexingSpi@17d5521b, addrRslvr=null, encryptionSpi=org.apache.ignite.spi.encryption.keystore.KeystoreEncryptionSpi@5b256786, tracingSpi=org.apache.ignite.spi.tracing.NoopTracingSpi@4c3d4727, clientMode=false, rebalanceThreadPoolSize=4, rebalanceTimeout=10000, rebalanceBatchesPrefetchCnt=3, rebalanceThrottle=0, rebalanceBatchSize=524288, txCfg=TransactionConfiguration [txSerEnabled=false, dfltIsolation=REPEATABLE_READ, dfltConcurrency=PESSIMISTIC, dfltTxTimeout=0, txTimeoutOnPartitionMapExchange=0, deadlockTimeout=10000, pessimisticTxLogSize=0, pessimisticTxLogLinger=10000, tmLookupClsName=null, txManagerFactory=null, useJtaSync=false], cacheSanityCheckEnabled=true, discoStartupDelay=60000, deployMode=SHARED, p2pMissedCacheSize=100, locHost=127.0.0.1, timeSrvPortBase=31100, timeSrvPortRange=100, failureDetectionTimeout=10000, sysWorkerBlockedTimeout=null, clientFailureDetectionTimeout=10000, metricsLogFreq=0, connectorCfg=null, odbcCfg=null, warmupClos=null, atomicCfg=AtomicConfiguration [seqReserveSize=1000, cacheMode=PARTITIONED, backups=1, aff=null, grpName=null], classLdr=null, sslCtxFactory=null, platformCfg=null, binaryCfg=null, memCfg=null, pstCfg=null, dsCfg=DataStorageConfiguration [sysRegionInitSize=41943040, sysRegionMaxSize=104857600, pageSize=4096, concLvl=0, dfltDataRegConf=DataRegionConfiguration [name=default, maxSize=10485760, initSize=268435456, swapPath=null, pageEvictionMode=DISABLED, pageReplacementMode=CLOCK, evictionThreshold=0.9, emptyPagesPoolSize=100, metricsEnabled=false, metricsSubIntervalCount=5, metricsRateTimeInterval=60000, persistenceEnabled=true, checkpointPageBufSize=0, lazyMemoryAllocation=true, warmUpCfg=null], dataRegions=null, storagePath=null, checkpointFreq=180000, lockWaitTime=10000, checkpointThreads=4, checkpointWriteOrder=SEQUENTIAL, walHistSize=20, maxWalArchiveSize=1073741824, walSegments=10, walSegmentSize=67108864, walPath=db/wal, walArchivePath=db/wal/archive, cdcWalPath=db/wal/cdc, cdcEnabled=false, metricsEnabled=false, walMode=FSYNC, walTlbSize=131072, walBuffSize=0, walFlushFreq=2000, walFsyncDelay=1000, walRecordIterBuffSize=67108864, alwaysWriteFullPages=false, fileIOFactory=org.apache.ignite.internal.processors.cache.persistence.file.AsyncFileIOFactory@62ffca0f, metricsSubIntervalCnt=5, metricsRateTimeInterval=60000, walAutoArchiveAfterInactivity=-1, walForceArchiveTimeout=-1, writeThrottlingEnabled=false, walCompactionEnabled=false, walCompactionLevel=1, checkpointReadLockTimeout=null, walPageCompression=DISABLED, walPageCompressionLevel=null, dfltWarmUpCfg=null, encCfg=org.apache.ignite.configuration.EncryptionConfiguration@354ad6df, defragmentationThreadPoolSize=4, minWalArchiveSize=-1], snapshotPath=snapshots, activeOnStart=true, activeOnStartPropSetFlag=false, autoActivation=true, autoActivationPropSetFlag=false, clusterStateOnStart=null, sqlConnCfg=null, cliConnCfg=ClientConnectorConfiguration [host=null, port=10800, portRange=100, sockSndBufSize=0, sockRcvBufSize=0, tcpNoDelay=true, maxOpenCursorsPerConn=128, threadPoolSize=24, selectorCnt=12, idleTimeout=0, handshakeTimeout=10000, jdbcEnabled=true, odbcEnabled=true, thinCliEnabled=true, sslEnabled=false, useIgniteSslCtxFactory=true, sslClientAuth=false, sslCtxFactory=null, thinCliCfg=ThinClientConfiguration [maxActiveTxPerConn=100, maxActiveComputeTasksPerConn=0]], mvccVacuumThreadCnt=2, mvccVacuumFreq=5000, authEnabled=false, failureHnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]], commFailureRslvr=null, sqlCfg=SqlConfiguration [longQryWarnTimeout=3000, dfltQryTimeout=0, sqlQryHistSize=1000, validationEnabled=false], asyncContinuationExecutor=null] [21:09:41] : [Step 4/5] [2021-11-19 21:09:41,550][INFO ][test-runner-#18741%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] Daemon mode: off [21:09:41] : [Step 4/5] [2021-11-19 21:09:41,551][INFO ][test-runner-#18741%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] OS: Linux 4.15.0-151-generic amd64 [21:09:41] : [Step 4/5] [2021-11-19 21:09:41,551][INFO ][test-runner-#18741%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] OS user: teamcity [21:09:41] : [Step 4/5] [2021-11-19 21:09:41,551][INFO ][test-runner-#18741%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] PID: 16724 [21:09:41] : [Step 4/5] [2021-11-19 21:09:41,552][INFO ][test-runner-#18741%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] Language runtime: Java Platform API Specification ver. 1.8 [21:09:41] : [Step 4/5] [2021-11-19 21:09:41,552][INFO ][test-runner-#18741%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] VM information: Java(TM) SE Runtime Environment 1.8.0_261-b12 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 25.261-b12 [21:09:41] : [Step 4/5] [2021-11-19 21:09:41,553][INFO ][test-runner-#18741%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] VM total memory: 1.9GB [21:09:41] : [Step 4/5] [2021-11-19 21:09:41,553][INFO ][test-runner-#18741%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] Remote Management [restart: off, REST: off, JMX (remote: off)] [21:09:41] : [Step 4/5] [2021-11-19 21:09:41,553][INFO ][test-runner-#18741%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] Logger: GridTestLog4jLogger [quiet=false, config=null] [21:09:41] : [Step 4/5] [2021-11-19 21:09:41,554][INFO ][test-runner-#18741%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] IGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c [21:09:41] : [Step 4/5] [2021-11-19 21:09:41,554][INFO ][test-runner-#18741%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] VM arguments: [-DIGNITE_DUMP_THREADS_ON_FAILURE=false, -DMono=/usr/bin/mono-sgen, -DMono4.0_x64=/usr/lib/mono/4.0, -DMono4.5_x64=/usr/lib/mono/4.5, -DMonoVersion=6.12.0.90, -DSKIP_BUILD=false, -Dagent.home.dir=/opt/buildagent, -Dagent.name=aitc-lin02_03, -Dagent.ownPort=9090, -Dagent.work.dir=/opt/buildagent/work, -Dbuild.number=95, -Dbuild.vcs.number=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.1=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.GitHubApacheIgnite=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dclassworlds.conf=/opt/buildagent/temp/buildTmp/teamcity.m2.conf, -Dcom.jetbrains.maven.watcher.report.file=/opt/buildagent/temp/buildTmp/maven-build-info.xml, -Djava.io.tmpdir=/opt/buildagent/temp/buildTmp, -Dmaven.home=/opt/buildagent/tools/maven3_6, -Dmaven.multiModuleProjectDirectory=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.agent.cpuBenchmark=457, -Dteamcity.agent.dotnet.agent_url=http://localhost:9090/RPC2, -Dteamcity.agent.dotnet.build_id=6278078, -Dteamcity.auth.password=*******, -Dteamcity.auth.userId=TeamCityBuildId=6278078, -Dteamcity.build.changedFiles.file=/opt/buildagent/temp/buildTmp/changedFiles6342607772318147725.txt, -Dteamcity.build.checkoutDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.build.id=6278078, -Dteamcity.build.properties.file=/opt/buildagent/temp/buildTmp/teamcity.build5164517880467851002.properties, -Dteamcity.build.tempDir=/opt/buildagent/temp/buildTmp, -Dteamcity.build.workingDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.buildConfName=Basic 3, -Dteamcity.buildType.id=IgniteTests24Java8_Basic3, -Dteamcity.configuration.properties.file=/opt/buildagent/temp/buildTmp/teamcity.config5591980786735343870.properties, -Dteamcity.maven.userSettings.path=/opt/buildagent/temp/buildTmp/maven_settings_585072866407032347.xml, -Dteamcity.maven.watcher.home=/opt/buildagent/plugins/mavenPlugin/maven-watcher-jdk16, -Dteamcity.projectName=Ignite Tests 2.x (JDK 8/11), -Dteamcity.runner.properties.file=/opt/buildagent/temp/buildTmp/teamcity.runner9098465561618137420.properties, -Dteamcity.tests.recentlyFailedTests.file=/opt/buildagent/temp/buildTmp/testsToRunFirst3891775683130404069.txt, -Dteamcity.version=2021.2 (build 99542), -ea, -Xms2g, -Xmx2g, -XX:+HeapDumpOnOutOfMemoryError, -DIGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_TEST_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_UPDATE_NOTIFIER=false, -DIGNITE_NO_DISCO_ORDER=true, -DIGNITE_PERFORMANCE_SUGGESTIONS_DISABLED=true, -Djava.net.preferIPv4Stack=true, -DTEST_SCALE_FACTOR=1.0, -DIGNITE_TEST_PROP_LOG4J_FILE=log4j-tc-test.xml, -DIGNITE_QUIET=false, -DIGNITE_MARSHAL_BUFFERS_RECHECK=1000, -Dmaven.repo.local=/opt/buildagent/.m2/repository] [21:09:41] : [Step 4/5] [2021-11-19 21:09:41,560][INFO ][test-runner-#18741%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] System cache's DataRegion size is configured to 40 MB. Use DataStorageConfiguration.systemRegionInitialSize property to change the setting. [21:09:41] : [Step 4/5] [2021-11-19 21:09:41,561][INFO ][test-runner-#18741%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] Configured caches [in 'sysMemPlc' dataRegion: ['ignite-sys-cache']] [21:09:41] : [Step 4/5] [2021-11-19 21:09:41,562][INFO ][test-runner-#18741%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] 3-rd party licenses can be found at: /opt/buildagent/work/7bc1c54bc719b67c/libs/licenses [21:09:41]W: [org.apache.ignite:ignite-core] [2021-11-19 21:09:41,561][WARN ][test-runner-#18741%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] Peer class loading is enabled (disable it in production for performance and deployment consistency reasons) [21:09:41] : [Step 4/5] [2021-11-19 21:09:41,567][INFO ][test-runner-#18741%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] Configured plugins: [21:09:41] : [Step 4/5] [2021-11-19 21:09:41,567][INFO ][test-runner-#18741%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] ^-- StanByClusterTestProvider 1.0 [21:09:41] : [Step 4/5] [2021-11-19 21:09:41,567][INFO ][test-runner-#18741%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:09:41] : [Step 4/5] [2021-11-19 21:09:41,568][INFO ][test-runner-#18741%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] [21:09:41] : [Step 4/5] [2021-11-19 21:09:41,568][INFO ][test-runner-#18741%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] ^-- PageMemory tracker plugin 1.0 [21:09:41] : [Step 4/5] [2021-11-19 21:09:41,568][INFO ][test-runner-#18741%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:09:41] : [Step 4/5] [2021-11-19 21:09:41,569][INFO ][test-runner-#18741%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] [21:09:41] : [Step 4/5] [2021-11-19 21:09:41,569][INFO ][test-runner-#18741%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] ^-- TestDistibutedConfigurationPlugin 1.0 [21:09:41] : [Step 4/5] [2021-11-19 21:09:41,569][INFO ][test-runner-#18741%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:09:41] : [Step 4/5] [2021-11-19 21:09:41,569][INFO ][test-runner-#18741%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] [21:09:41] : [Step 4/5] [2021-11-19 21:09:41,570][INFO ][test-runner-#18741%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] ^-- NodeValidationPluginProvider 1.0 [21:09:41] : [Step 4/5] [2021-11-19 21:09:41,570][INFO ][test-runner-#18741%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:09:41] : [Step 4/5] [2021-11-19 21:09:41,570][INFO ][test-runner-#18741%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] [21:09:41] : [Step 4/5] [2021-11-19 21:09:41,571][INFO ][test-runner-#18741%encryption.MasterKeyChangeTest%][FailureProcessor] Configured failure handler: [hnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]]] [21:09:41]W: [org.apache.ignite:ignite-core] [2021-11-19 21:09:41,606][WARN ][test-runner-#18741%encryption.MasterKeyChangeTest%][TestRecordingCommunicationSpi] Message queue limit is set to 0 which may lead to potential OOMEs when running cache operations in FULL_ASYNC or PRIMARY_SYNC modes due to message queues growth on sender and receiver sides. [21:09:41] : [Step 4/5] [2021-11-19 21:09:41,605][INFO ][test-runner-#18741%encryption.MasterKeyChangeTest%][TestRecordingCommunicationSpi] Successfully bound communication NIO server to TCP port [port=47101, locHost=/127.0.0.1, selectorsCnt=12, selectorSpins=0, pairedConn=false] [21:09:41] : [Step 4/5] [2021-11-19 21:09:41,613][INFO ][test-runner-#18741%encryption.MasterKeyChangeTest%][GridCollisionManager] Collision resolution is disabled (all jobs will be activated upon arrival). [21:09:41] : [Step 4/5] [2021-11-19 21:09:41,614][INFO ][test-runner-#18741%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] Security status [authentication=off, sandbox=off, tls/ssl=off] [21:09:41] : [Step 4/5] [2021-11-19 21:09:41,672][INFO ][test-runner-#18741%encryption.MasterKeyChangeTest%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:09:41] : [Step 4/5] [2021-11-19 21:09:41,761][INFO ][test-runner-#18741%encryption.MasterKeyChangeTest%][MaintenanceProcessor] Resolved store directory for node persistent data: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1 [21:09:41] : [Step 4/5] [2021-11-19 21:09:41,763][INFO ][test-runner-#18741%encryption.MasterKeyChangeTest%][CacheObjectBinaryProcessorImpl] Resolved directory for serialized binary metadata: /opt/buildagent/work/7bc1c54bc719b67c/work/db/binary_meta/grid_1 [21:09:41] : [Step 4/5] [2021-11-19 21:09:41,767][INFO ][test-runner-#18741%encryption.MasterKeyChangeTest%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1 [21:09:41] : [Step 4/5] [2021-11-19 21:09:41,768][INFO ][test-runner-#18741%encryption.MasterKeyChangeTest%][FileWriteAheadLogManager] Resolved write ahead log work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1 [21:09:41] : [Step 4/5] [2021-11-19 21:09:41,768][INFO ][test-runner-#18741%encryption.MasterKeyChangeTest%][FileWriteAheadLogManager] Resolved write ahead log archive directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1 [21:09:42] : [Step 4/5] [2021-11-19 21:09:42,259][INFO ][test-runner-#18741%encryption.MasterKeyChangeTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000000.wal [21:09:42] : [Step 4/5] [2021-11-19 21:09:42,268][INFO ][test-runner-#18741%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Configured data regions initialized successfully [total=5] [21:09:42] : [Step 4/5] [2021-11-19 21:09:42,270][INFO ][test-runner-#18741%encryption.MasterKeyChangeTest%][IgniteSnapshotManager] Resolved snapshot work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/snapshots [21:09:42] : [Step 4/5] [2021-11-19 21:09:42,271][INFO ][test-runner-#18741%encryption.MasterKeyChangeTest%][IgniteSnapshotManager] Resolved temp directory for snapshot creation: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1/snp [21:09:42] : [Step 4/5] [2021-11-19 21:09:42,275][INFO ][test-runner-#18741%encryption.MasterKeyChangeTest%][ClientListenerProcessor] Client connector processor has started on TCP port 10801 [21:09:42] : [Step 4/5] [2021-11-19 21:09:42,278][INFO ][test-runner-#18741%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] Non-loopback local IPs: 172.17.0.4 [21:09:42] : [Step 4/5] [2021-11-19 21:09:42,278][INFO ][test-runner-#18741%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] Enabled local MACs: 0242AC110004 [21:09:42] : [Step 4/5] [2021-11-19 21:09:42,279][INFO ][test-runner-#18741%encryption.MasterKeyChangeTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:09:42] : [Step 4/5] [2021-11-19 21:09:42,281][INFO ][test-runner-#18741%encryption.MasterKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:09:42] : [Step 4/5] [2021-11-19 21:09:42,281][INFO ][test-runner-#18741%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:09:42] : [Step 4/5] [2021-11-19 21:09:42,284][INFO ][test-runner-#18741%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Applying lost metastore updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:09:42] : [Step 4/5] [2021-11-19 21:09:42,284][INFO ][test-runner-#18741%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=0 ms] [21:09:42] : [Step 4/5] [2021-11-19 21:09:42,285][INFO ][test-runner-#18741%encryption.MasterKeyChangeTest%][GridCacheProcessor] Restoring partition state for local groups. [21:09:42] : [Step 4/5] [2021-11-19 21:09:42,285][INFO ][test-runner-#18741%encryption.MasterKeyChangeTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=0, partitionsProcessed=0, time=0ms] [21:09:42] : [Step 4/5] [2021-11-19 21:09:42,286][INFO ][test-runner-#18741%encryption.MasterKeyChangeTest%][GridEncryptionManager] Encryption keys loaded from metastore. [grps=, masterKeyName=ignite.master.key] [21:09:42] : [Step 4/5] [2021-11-19 21:09:42,287][INFO ][test-runner-#18741%encryption.MasterKeyChangeTest%][ClusterProcessor] Cluster ID and tag has been read from metastorage: null [21:09:42] : [Step 4/5] [2021-11-19 21:09:42,288][INFO ][test-runner-#18741%encryption.MasterKeyChangeTest%][IgniteClusterImpl] Shutdown policy was updated [oldVal=null, newVal=null] [21:09:42] : [Step 4/5] [2021-11-19 21:09:42,288][INFO ][test-runner-#18741%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Checkpoint frequency deviation changed [oldVal=null, newVal=null] [21:09:42] : [Step 4/5] [2021-11-19 21:09:42,298][INFO ][test-runner-#18741%encryption.MasterKeyChangeTest%][FilePageStoreManager] Cleanup cache stores [total=1, left=0, cleanFiles=false] [21:09:42] : [Step 4/5] [2021-11-19 21:09:42,301][INFO ][test-runner-#18741%encryption.MasterKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:09:42] : [Step 4/5] [2021-11-19 21:09:42,302][INFO ][test-runner-#18741%encryption.MasterKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:09:42] : [Step 4/5] [2021-11-19 21:09:42,304][INFO ][test-runner-#18741%encryption.MasterKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:09:42] : [Step 4/5] [2021-11-19 21:09:42,305][INFO ][test-runner-#18741%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Data Regions Started: 5 [21:09:42] : [Step 4/5] [2021-11-19 21:09:42,305][INFO ][test-runner-#18741%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] ^-- sysMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:09:42] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:09:42] : [Step 4/5] ^-- default region [type=default, persistence=true, lazyAlloc=true, [21:09:42] : [Step 4/5] ... initCfg=10MB, maxCfg=10MB, usedRam=0MB, freeRam=100%, allocRam=0MB, allocTotal=0MB] [21:09:42] : [Step 4/5] ^-- metastoreMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:09:42] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:09:42] : [Step 4/5] ^-- TxLog region [type=internal, persistence=true, lazyAlloc=false, [21:09:42] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:09:42] : [Step 4/5] ^-- volatileDsMemPlc region [type=user, persistence=false, lazyAlloc=true, [21:09:42] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB] [21:09:42] : [Step 4/5] ^-- Ignite persistence [used=0MB] [21:09:42] : [Step 4/5] [21:09:42] : [Step 4/5] [2021-11-19 21:09:42,307][INFO ][test-runner-#18741%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Starting binary memory restore for: [-2100569601] [21:09:42] : [Step 4/5] [2021-11-19 21:09:42,318][INFO ][test-runner-#18741%encryption.MasterKeyChangeTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:09:42] : [Step 4/5] [2021-11-19 21:09:42,319][INFO ][test-runner-#18741%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:09:42] : [Step 4/5] [2021-11-19 21:09:42,327][INFO ][test-runner-#18741%encryption.MasterKeyChangeTest%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000000.wal, offset=0, ver=2] [21:09:42] : [Step 4/5] [2021-11-19 21:09:42,344][INFO ][test-runner-#18741%encryption.MasterKeyChangeTest%][GridCacheProcessor] Started cache in recovery mode [name=ignite-sys-cache, id=-2100569601, dataRegionName=sysMemPlc, mode=REPLICATED, atomicity=TRANSACTIONAL, backups=2147483647, mvcc=false] [21:09:42] : [Step 4/5] [2021-11-19 21:09:42,353][INFO ][test-runner-#18741%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Binary recovery performed in 46 ms. [21:09:42] : [Step 4/5] [2021-11-19 21:09:42,354][INFO ][test-runner-#18741%encryption.MasterKeyChangeTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:09:42] : [Step 4/5] [2021-11-19 21:09:42,354][INFO ][test-runner-#18741%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Applying lost cache updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:09:42] : [Step 4/5] [2021-11-19 21:09:42,432][INFO ][test-runner-#18741%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=87 ms] [21:09:42] : [Step 4/5] [2021-11-19 21:09:42,432][INFO ][test-runner-#18741%encryption.MasterKeyChangeTest%][GridCacheProcessor] Restoring partition state for local groups. [21:09:42] : [Step 4/5] [2021-11-19 21:09:42,438][INFO ][test-runner-#18741%encryption.MasterKeyChangeTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=1, partitionsProcessed=100, time=0ms] [21:09:43] : [Step 4/5] [2021-11-19 21:09:43,141][INFO ][test-runner-#18741%encryption.MasterKeyChangeTest%][TestTcpDiscoverySpi] Successfully bound to TCP port [port=47501, localHost=localhost/127.0.0.1, locNodeId=10c9b180-4e9e-47f4-91be-f461fdbc7001] [21:09:43] : [Step 4/5] [2021-11-19 21:09:43,145][INFO ][tcp-disco-srvr-[:47500]-#986%grid-0%-#18854%grid-0%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=49099] [21:09:43] : [Step 4/5] [2021-11-19 21:09:43,146][INFO ][tcp-disco-srvr-[:47500]-#986%grid-0%-#18854%grid-0%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=49099] [21:09:43] : [Step 4/5] [2021-11-19 21:09:43,148][INFO ][tcp-disco-sock-reader-[]-#992%grid-0%-#18973%grid-0%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:49099, rmtPort=49099] [21:09:43] : [Step 4/5] [2021-11-19 21:09:43,150][INFO ][tcp-disco-sock-reader-[10c9b180 127.0.0.1:49099]-#992%grid-0%-#18973%grid-0%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=10c9b180-4e9e-47f4-91be-f461fdbc7001, rmtAddr=/127.0.0.1:49099] [21:09:43] : [Step 4/5] [2021-11-19 21:09:43,155][INFO ][tcp-disco-srvr-[:47501]-#991%grid-1%-#18972%grid-1%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=57385] [21:09:43] : [Step 4/5] [2021-11-19 21:09:43,156][INFO ][tcp-disco-srvr-[:47501]-#991%grid-1%-#18972%grid-1%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=57385] [21:09:43] : [Step 4/5] [2021-11-19 21:09:43,157][INFO ][tcp-disco-sock-reader-[]-#993%grid-1%-#18974%grid-1%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:57385, rmtPort=57385] [21:09:43] : [Step 4/5] [2021-11-19 21:09:43,157][INFO ][tcp-disco-sock-reader-[]-#993%grid-1%-#18974%grid-1%][TestTcpDiscoverySpi] Received ping request from the remote node [rmtNodeId=0055470b-0938-4c8d-91e6-894fbb9ab000, rmtAddr=/127.0.0.1:57385, rmtPort=57385] [21:09:43] : [Step 4/5] [2021-11-19 21:09:43,159][INFO ][tcp-disco-sock-reader-[]-#993%grid-1%-#18974%grid-1%][TestTcpDiscoverySpi] Finished writing ping response [rmtNodeId=0055470b-0938-4c8d-91e6-894fbb9ab000, rmtAddr=/127.0.0.1:57385, rmtPort=57385] [21:09:43]W: [org.apache.ignite:ignite-core] [2021-11-19 21:09:43,159][WARN ][tcp-disco-sock-reader-[]-#993%grid-1%-#18974%grid-1%][TestTcpDiscoverySpi] Failed to shutdown socket [21:09:43]W: [org.apache.ignite:ignite-core] java.net.SocketException: Socket output is already shutdown [21:09:43]W: [org.apache.ignite:ignite-core] at java.net.Socket.shutdownOutput(Socket.java:1572) [21:09:43]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.close(IgniteUtils.java:4247) [21:09:43]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.discovery.tcp.ServerImpl$SocketReader.body(ServerImpl.java:7370) [21:09:43]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.IgniteSpiThread.run(IgniteSpiThread.java:58) [21:09:43] : [Step 4/5] [2021-11-19 21:09:43,160][INFO ][tcp-disco-sock-reader-[]-#993%grid-1%-#18974%grid-1%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:57385, rmtPort=57385, rmtNodeId=null] [21:09:43] : [Step 4/5] [2021-11-19 21:09:43,159][INFO ][tcp-disco-sock-reader-[10c9b180 127.0.0.1:49099]-#992%grid-0%-#18973%grid-0%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:49099, rmtPort=49099, rmtNodeId=10c9b180-4e9e-47f4-91be-f461fdbc7001] [21:09:43] : [Step 4/5] [2021-11-19 21:09:43,164][INFO ][tcp-disco-msg-worker-[crd]-#985%grid-0%-#18853%grid-0%][GridEncryptionManager] Joining node doesn't have stored group keys [node=10c9b180-4e9e-47f4-91be-f461fdbc7001] [21:09:43] : [Step 4/5] [2021-11-19 21:09:43,175][INFO ][tcp-disco-msg-worker-[crd]-#985%grid-0%-#18853%grid-0%][TestTcpDiscoverySpi] New next node [newNext=TcpDiscoveryNode [id=10c9b180-4e9e-47f4-91be-f461fdbc7001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=0, intOrder=2, lastExchangeTime=1637345383146, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false]] [21:09:43] : [Step 4/5] [2021-11-19 21:09:43,176][INFO ][tcp-disco-srvr-[:47501]-#991%grid-1%-#18972%grid-1%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=55673] [21:09:43] : [Step 4/5] [2021-11-19 21:09:43,176][INFO ][tcp-disco-srvr-[:47501]-#991%grid-1%-#18972%grid-1%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=55673] [21:09:43] : [Step 4/5] [2021-11-19 21:09:43,178][INFO ][tcp-disco-sock-reader-[]-#994%grid-1%-#18975%grid-1%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:55673, rmtPort=55673] [21:09:43] : [Step 4/5] [2021-11-19 21:09:43,179][INFO ][tcp-disco-sock-reader-[0055470b 127.0.0.1:55673]-#994%grid-1%-#18975%grid-1%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=0055470b-0938-4c8d-91e6-894fbb9ab000, rmtAddr=/127.0.0.1:55673] [21:09:43] : [Step 4/5] [2021-11-19 21:09:43,183][INFO ][tcp-disco-msg-worker-[]-#990%grid-1%-#18971%grid-1%][TestTcpDiscoverySpi] New next node [newNext=TcpDiscoveryNode [id=0055470b-0938-4c8d-91e6-894fbb9ab000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345383176, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false]] [21:09:43] : [Step 4/5] [2021-11-19 21:09:43,184][INFO ][tcp-disco-srvr-[:47500]-#986%grid-0%-#18854%grid-0%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=33979] [21:09:43] : [Step 4/5] [2021-11-19 21:09:43,184][INFO ][tcp-disco-srvr-[:47500]-#986%grid-0%-#18854%grid-0%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=33979] [21:09:43] : [Step 4/5] [2021-11-19 21:09:43,184][INFO ][tcp-disco-sock-reader-[]-#995%grid-0%-#18976%grid-0%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:33979, rmtPort=33979] [21:09:43] : [Step 4/5] [2021-11-19 21:09:43,186][INFO ][tcp-disco-sock-reader-[10c9b180 127.0.0.1:33979]-#995%grid-0%-#18976%grid-0%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=10c9b180-4e9e-47f4-91be-f461fdbc7001, rmtAddr=/127.0.0.1:33979] [21:09:43] : [Step 4/5] [2021-11-19 21:09:43,187][INFO ][disco-event-worker-#18856%grid-0%][GridDiscoveryManager] Added new node to topology: TcpDiscoveryNode [id=10c9b180-4e9e-47f4-91be-f461fdbc7001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637345383146, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false] [21:09:43] : [Step 4/5] [2021-11-19 21:09:43,189][INFO ][disco-event-worker-#18856%grid-0%][GridDiscoveryManager] Topology snapshot [ver=2, locNode=0055470b, servers=2, clients=0, state=INACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=0055470b-0938-4c8d-91e6-894fbb9ab000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=10c9b180-4e9e-47f4-91be-f461fdbc7001, consistentId=grid-1, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:09:43] : [Step 4/5] [2021-11-19 21:09:43,191][INFO ][tcp-disco-msg-worker-[0055470b 127.0.0.1:47500]-#990%grid-1%-#18971%grid-1%][ClusterProcessor] magical_brattain [21:09:43] : [Step 4/5] [2021-11-19 21:09:43,191][INFO ][tcp-disco-msg-worker-[0055470b 127.0.0.1:47500]-#990%grid-1%-#18971%grid-1%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustEnabled' was changed from 'null' to 'false' [21:09:43] : [Step 4/5] [2021-11-19 21:09:43,192][INFO ][tcp-disco-msg-worker-[0055470b 127.0.0.1:47500]-#990%grid-1%-#18971%grid-1%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustTimeout' was changed from 'null' to '300000' [21:09:43] : [Step 4/5] [2021-11-19 21:09:43,192][INFO ][tcp-disco-msg-worker-[0055470b 127.0.0.1:47500]-#990%grid-1%-#18971%grid-1%][IgniteTxManager] Transactions parameter 'longOperationsDumpTimeout' was changed from 'null' to '60000' [21:09:43] : [Step 4/5] [2021-11-19 21:09:43,192][INFO ][tcp-disco-msg-worker-[0055470b 127.0.0.1:47500]-#990%grid-1%-#18971%grid-1%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpThreshold' was changed from 'null' to '0' [21:09:43] : [Step 4/5] [2021-11-19 21:09:43,193][INFO ][tcp-disco-msg-worker-[0055470b 127.0.0.1:47500]-#990%grid-1%-#18971%grid-1%][IgniteTxManager] Transactions parameter 'transactionTimeDumpSamplesCoefficient' was changed from 'null' to '0.0' [21:09:43] : [Step 4/5] [2021-11-19 21:09:43,193][INFO ][tcp-disco-msg-worker-[0055470b 127.0.0.1:47500]-#990%grid-1%-#18971%grid-1%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpSamplesPerSecondLimit' was changed from 'null' to '5' [21:09:43] : [Step 4/5] [2021-11-19 21:09:43,194][INFO ][tcp-disco-msg-worker-[0055470b 127.0.0.1:47500]-#990%grid-1%-#18971%grid-1%][IgniteTxManager] Transactions parameter 'collisionsDumpInterval' was changed from 'null' to '1000' [21:09:43] : [Step 4/5] [2021-11-19 21:09:43,194][INFO ][tcp-disco-msg-worker-[0055470b 127.0.0.1:47500]-#990%grid-1%-#18971%grid-1%][IgniteTxManager] Transactions parameter 'txOwnerDumpRequestsAllowed' was changed from 'null' to 'true' [21:09:43] : [Step 4/5] [2021-11-19 21:09:43,194][INFO ][tcp-disco-msg-worker-[0055470b 127.0.0.1:47500]-#990%grid-1%-#18971%grid-1%][GridCacheDatabaseSharedManager] Historical rebalance WAL threshold changed [property=historical.rebalance.threshold, oldVal=null, newVal=500] [21:09:43] : [Step 4/5] [2021-11-19 21:09:43,196][INFO ][disco-notifier-worker-#18970%grid-1%][MvccProcessorImpl] Assigned mvcc coordinator [crd=MvccCoordinator [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=0], nodeId=0055470b-0938-4c8d-91e6-894fbb9ab000, ver=1637345381505, local=false, initialized=false]] [21:09:43] : [Step 4/5] [2021-11-19 21:09:43,197][INFO ][sys-#18947%grid-1%][ClusterProcessor] Writing cluster ID and tag to metastorage on ready for write ClusterIdAndTag [id=fc5d65cb-d6ff-4395-a783-b78604703f50, tag=magical_brattain] [21:09:43] : [Step 4/5] [2021-11-19 21:09:43,211][INFO ][test-runner-#18741%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] To start Console Management & Monitoring run ignitevisorcmd.{sh|bat} [21:09:43] : [Step 4/5] [2021-11-19 21:09:43,212][INFO ][test-runner-#18741%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] [21:09:43] : [Step 4/5] [21:09:43] : [Step 4/5] >>> +-------------------------------------------+ [21:09:43] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:09:43] : [Step 4/5] >>> +-------------------------------------------+ [21:09:43] : [Step 4/5] >>> OS name: Linux 4.15.0-151-generic amd64 [21:09:43] : [Step 4/5] >>> CPU(s): 24 [21:09:43] : [Step 4/5] >>> Heap: 2.0GB [21:09:43] : [Step 4/5] >>> VM name: 16724@c4dfe9a430b2 [21:09:43] : [Step 4/5] >>> Ignite instance name: grid-1 [21:09:43] : [Step 4/5] >>> Local node [ID=10C9B180-4E9E-47F4-91BE-F461FDBC7001, order=2, clientMode=false] [21:09:43] : [Step 4/5] >>> Local node addresses: [127.0.0.1] [21:09:43] : [Step 4/5] >>> Local ports: TCP:10801 TCP:47101 TCP:47501 [21:09:43] : [Step 4/5] [21:09:43] : [Step 4/5] [2021-11-19 21:09:43,213][INFO ][test-runner-#18741%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] >>> Ignite cluster is in INACTIVE state (limited functionality available). Use control.(sh|bat) script or IgniteCluster.state(ClusterState.ACTIVE) to change the state. [21:09:43] : [Step 4/5] [2021-11-19 21:09:43,213][INFO ][test-runner-#18741%encryption.MasterKeyChangeTest%][GridDiscoveryManager] Topology snapshot [ver=2, locNode=10c9b180, servers=2, clients=0, state=INACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=0055470b-0938-4c8d-91e6-894fbb9ab000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=10c9b180-4e9e-47f4-91be-f461fdbc7001, consistentId=grid-1, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:09:43] : [Step 4/5] [2021-11-19 21:09:43,214][INFO ][test-runner-#18741%encryption.MasterKeyChangeTest%][G] Node started : [stage="Configure system pool" (0 ms),stage="Start managers" (225 ms),stage="Configure binary metadata" (2 ms),stage="Start processors" (513 ms),stage="Start 'StanByClusterTestProvider' plugin" (0 ms),stage="Start 'PageMemory tracker plugin' plugin" (0 ms),stage="Start 'TestDistibutedConfigurationPlugin' plugin" (0 ms),stage="Start 'NodeValidationPluginProvider' plugin" (0 ms),stage="Init metastore" (20 ms),stage="Init and start regions" (8 ms),stage="Restore binary memory" (46 ms),stage="Restore logical state" (84 ms),stage="Finish recovery" (702 ms),stage="Join topology" (55 ms),stage="Await transition" (2 ms),stage="Await exchange" (16 ms),stage="Total time" (1673 ms)] [21:09:43] : [Step 4/5] [2021-11-19 21:09:43,216][INFO ][test-runner-#18741%encryption.MasterKeyChangeTest%][root] Node started with the following configuration [id=10c9b180-4e9e-47f4-91be-f461fdbc7001, marshaller=BinaryMarshaller [], discovery=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=5000, ackTimeout=5000, marsh=JdkMarshaller [clsFilter=org.apache.ignite.marshaller.MarshallerUtils$1@30d2828a], reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], binaryCfg=null, lateAff=true] [21:09:43] : [Step 4/5] [2021-11-19 21:09:43,218][INFO ][test-runner-#18741%encryption.MasterKeyChangeTest%][GridClusterStateProcessor] Sending activate cluster request with BaselineTopology BaselineTopology [id=0, branchingHash=-2475315501, branchingType='New BaselineTopology', baselineNodes=[grid-1, grid-0]] [21:09:43] : [Step 4/5] [2021-11-19 21:09:43,222][INFO ][disco-notifier-worker-#18852%grid-0%][GridClusterStateProcessor] Received activate cluster request with BaselineTopology[id=0] initiator node ID: 0055470b-0938-4c8d-91e6-894fbb9ab000 [21:09:43] : [Step 4/5] [2021-11-19 21:09:43,222][INFO ][disco-notifier-worker-#18852%grid-0%][GridClusterStateProcessor] Started state transition: activate cluster [21:09:43] : [Step 4/5] [2021-11-19 21:09:43,223][INFO ][exchange-worker-#18857%grid-0%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], crd=true, evt=DISCOVERY_CUSTOM_EVT, evtNode=0055470b-0938-4c8d-91e6-894fbb9ab000, customEvt=ChangeGlobalStateMessage [id=6627d593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqId=bc2e403c-e96b-4511-88a1-2f61ed91d48f, initiatingNodeId=0055470b-0938-4c8d-91e6-894fbb9ab000, state=ACTIVE, baselineTopology=BaselineTopology [id=0, branchingHash=-2475315501, branchingType='New BaselineTopology', baselineNodes=[grid-1, grid-0]], forceChangeBaselineTopology=false, timestamp=1637345383218, forceDeactivation=true], allowMerge=false, exchangeFreeSwitch=false] [21:09:43] : [Step 4/5] [2021-11-19 21:09:43,224][INFO ][disco-notifier-worker-#18970%grid-1%][GridClusterStateProcessor] Received activate cluster request with BaselineTopology[id=0] initiator node ID: 0055470b-0938-4c8d-91e6-894fbb9ab000 [21:09:43] : [Step 4/5] [2021-11-19 21:09:43,225][INFO ][disco-notifier-worker-#18970%grid-1%][GridClusterStateProcessor] Started state transition: activate cluster [21:09:43] : [Step 4/5] [2021-11-19 21:09:43,224][INFO ][exchange-worker-#18857%grid-0%][GridDhtPartitionsExchangeFuture] Start activation process [nodeId=0055470b-0938-4c8d-91e6-894fbb9ab000, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]]. New state: ACTIVE [21:09:43] : [Step 4/5] [2021-11-19 21:09:43,226][INFO ][exchange-worker-#18979%grid-1%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], crd=false, evt=DISCOVERY_CUSTOM_EVT, evtNode=0055470b-0938-4c8d-91e6-894fbb9ab000, customEvt=ChangeGlobalStateMessage [id=6627d593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqId=bc2e403c-e96b-4511-88a1-2f61ed91d48f, initiatingNodeId=0055470b-0938-4c8d-91e6-894fbb9ab000, state=ACTIVE, baselineTopology=BaselineTopology [id=0, branchingHash=-2475315501, branchingType='New BaselineTopology', baselineNodes=[grid-1, grid-0]], forceChangeBaselineTopology=false, timestamp=1637345383218, forceDeactivation=true], allowMerge=false, exchangeFreeSwitch=false] [21:09:43] : [Step 4/5] [2021-11-19 21:09:43,227][INFO ][exchange-worker-#18857%grid-0%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0 [21:09:43] : [Step 4/5] [2021-11-19 21:09:43,228][INFO ][exchange-worker-#18979%grid-1%][GridDhtPartitionsExchangeFuture] Start activation process [nodeId=10c9b180-4e9e-47f4-91be-f461fdbc7001, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]]. New state: ACTIVE [21:09:43] : [Step 4/5] [2021-11-19 21:09:43,229][INFO ][exchange-worker-#18979%grid-1%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1 [21:09:43] : [Step 4/5] [2021-11-19 21:09:43,237][INFO ][exchange-worker-#18857%grid-0%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000000.wal, offset=8713, ver=2] [21:09:43] : [Step 4/5] [2021-11-19 21:09:43,238][INFO ][exchange-worker-#18979%grid-1%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000000.wal, offset=8713, ver=2] [21:09:43] : [Step 4/5] [2021-11-19 21:09:43,239][INFO ][exchange-worker-#18857%grid-0%][GridClusterStateProcessor] Writing BaselineTopology[id=0] [21:09:43] : [Step 4/5] [2021-11-19 21:09:43,241][INFO ][exchange-worker-#18979%grid-1%][GridClusterStateProcessor] Writing BaselineTopology[id=0] [21:09:43] : [Step 4/5] [2021-11-19 21:09:43,244][INFO ][exchange-worker-#18857%grid-0%][GridCacheDatabaseSharedManager] Finish recovery performed in 15 ms. [21:09:43] : [Step 4/5] [2021-11-19 21:09:43,244][INFO ][exchange-worker-#18979%grid-1%][GridCacheDatabaseSharedManager] Finish recovery performed in 14 ms. [21:09:43] : [Step 4/5] [2021-11-19 21:09:43,245][INFO ][exchange-worker-#18857%grid-0%][msg] Components activation performed in 18 ms. [21:09:43] : [Step 4/5] [2021-11-19 21:09:43,246][INFO ][exchange-worker-#18979%grid-1%][msg] Components activation performed in 17 ms. [21:09:43] : [Step 4/5] [2021-11-19 21:09:43,247][INFO ][exchange-worker-#18979%grid-1%][GridCacheProcessor] Finished recovery for cache [cache=ignite-sys-cache, grp=ignite-sys-cache, startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:09:43] : [Step 4/5] [2021-11-19 21:09:43,248][INFO ][exchange-worker-#18857%grid-0%][GridCacheProcessor] Finished recovery for cache [cache=ignite-sys-cache, grp=ignite-sys-cache, startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:09:43] : [Step 4/5] [2021-11-19 21:09:43,248][INFO ][exchange-worker-#18979%grid-1%][GridDhtPartitionsExchangeFuture] Successfully activated caches [nodeId=10c9b180-4e9e-47f4-91be-f461fdbc7001, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], newState=ACTIVE] [21:09:43] : [Step 4/5] [2021-11-19 21:09:43,249][INFO ][exchange-worker-#18857%grid-0%][GridDhtPartitionsExchangeFuture] Successfully activated caches [nodeId=0055470b-0938-4c8d-91e6-894fbb9ab000, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], newState=ACTIVE] [21:09:43] : [Step 4/5] [2021-11-19 21:09:43,249][INFO ][exchange-worker-#18979%grid-1%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:09:43] : [Step 4/5] [2021-11-19 21:09:43,250][INFO ][exchange-worker-#18857%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:09:43] : [Step 4/5] [2021-11-19 21:09:43,261][INFO ][exchange-worker-#18857%grid-0%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], crd=true] [21:09:43] : [Step 4/5] [2021-11-19 21:09:43,265][INFO ][grid-nio-worker-tcp-comm-0-#18796%TestRecordingCommunicationSpi%][TestRecordingCommunicationSpi] Accepted incoming communication connection [locAddr=/127.0.0.1:47100, rmtAddr=/127.0.0.1:59186] [21:09:43] : [Step 4/5] [2021-11-19 21:09:43,267][INFO ][grid-nio-worker-tcp-comm-0-#18914%TestRecordingCommunicationSpi%][TestRecordingCommunicationSpi] Established outgoing communication connection [locAddr=/127.0.0.1:59186, rmtAddr=/127.0.0.1:47100] [21:09:43] : [Step 4/5] [2021-11-19 21:09:43,267][INFO ][exchange-worker-#18979%grid-1%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], crd=false] [21:09:43] : [Step 4/5] [2021-11-19 21:09:43,271][INFO ][sys-#18842%grid-0%][GridDhtPartitionsExchangeFuture] Coordinator received single message [ver=AffinityTopologyVersion [topVer=2, minorTopVer=1], node=10c9b180-4e9e-47f4-91be-f461fdbc7001, allReceived=true] [21:09:43] : [Step 4/5] [2021-11-19 21:09:43,271][INFO ][db-checkpoint-thread-#18993%grid-0%][Checkpointer] Checkpoint started [checkpointId=6ad8928f-8b7d-4650-9d6f-9978176a6460, startPtr=WALPointer [idx=0, fileOff=75224, len=1963], checkpointBeforeLockTime=1ms, checkpointLockWait=1ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=7ms, writeCheckpointEntryDuration=3ms, splitAndSortCpPagesDuration=0ms, pages=18, reason='node started'] [21:09:43] : [Step 4/5] [2021-11-19 21:09:43,271][INFO ][db-checkpoint-thread-#18988%grid-1%][Checkpointer] Checkpoint started [checkpointId=a7366b50-c3d7-4c91-b4c4-55d06c0350b7, startPtr=WALPointer [idx=0, fileOff=79771, len=1963], checkpointBeforeLockTime=1ms, checkpointLockWait=6ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=6ms, writeCheckpointEntryDuration=3ms, splitAndSortCpPagesDuration=0ms, pages=20, reason='node started'] [21:09:43] : [Step 4/5] [2021-11-19 21:09:43,271][INFO ][sys-#18842%grid-0%][GridDhtPartitionsExchangeFuture] finishExchangeOnCoordinator [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:09:43] : [Step 4/5] [2021-11-19 21:09:43,278][INFO ][sys-#18842%grid-0%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], err=null, rebalanced=true, wasRebalanced=false] [21:09:43] : [Step 4/5] [2021-11-19 21:09:43,278][INFO ][disco-notifier-worker-#18852%grid-0%][GridClusterStateProcessor] Received state change finish message: ACTIVE [21:09:43] : [Step 4/5] [2021-11-19 21:09:43,279][INFO ][disco-notifier-worker-#18970%grid-1%][GridClusterStateProcessor] Received state change finish message: ACTIVE [21:09:43] : [Step 4/5] [2021-11-19 21:09:43,279][INFO ][sys-#18953%grid-1%][GridDhtPartitionsExchangeFuture] Received full message, will finish exchange [node=0055470b-0938-4c8d-91e6-894fbb9ab000, resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:09:43] : [Step 4/5] [2021-11-19 21:09:43,282][INFO ][sys-#18959%grid-1%][GridCachePartitionExchangeManager] Delay process full message without exchange id (there is exchange in progress) [nodeId=0055470b-0938-4c8d-91e6-894fbb9ab000] [21:09:43] : [Step 4/5] [2021-11-19 21:09:43,282][INFO ][sys-#18842%grid-0%][GridCacheProcessor] Finish proxy initialization, cacheName=ignite-sys-cache, localNodeId=0055470b-0938-4c8d-91e6-894fbb9ab000 [21:09:43] : [Step 4/5] [2021-11-19 21:09:43,281][INFO ][disco-notifier-worker-#18970%grid-1%][GridClusterStateProcessor] Cluster state was changed from INACTIVE to ACTIVE [21:09:43] : [Step 4/5] [2021-11-19 21:09:43,280][INFO ][disco-notifier-worker-#18852%grid-0%][GridClusterStateProcessor] Cluster state was changed from INACTIVE to ACTIVE [21:09:43] : [Step 4/5] [2021-11-19 21:09:43,283][INFO ][sys-#18842%grid-0%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=0055470b-0938-4c8d-91e6-894fbb9ab000, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=0055470b-0938-4c8d-91e6-894fbb9ab000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345383278, loc=true, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:09:43] : [Step 4/5] [2021-11-19 21:09:43,283][INFO ][exchange-worker-#18857%grid-0%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=2, minorTopVer=1], force=false, evt=DISCOVERY_CUSTOM_EVT, node=0055470b-0938-4c8d-91e6-894fbb9ab000] [21:09:43] : [Step 4/5] [2021-11-19 21:09:43,283][INFO ][sys-#18828%grid-0%][DistributedBaselineConfiguration] Baseline auto-adjust is 'disabled' with timeout='300000' ms [21:09:43] : [Step 4/5] [2021-11-19 21:09:43,283][INFO ][sys-#18953%grid-1%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], err=null, rebalanced=true, wasRebalanced=false] [21:09:43] : [Step 4/5] [2021-11-19 21:09:43,286][INFO ][sys-#18828%grid-0%][GridClusterStateProcessor] Successfully performed final activation steps [nodeId=0055470b-0938-4c8d-91e6-894fbb9ab000, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:09:43] : [Step 4/5] [2021-11-19 21:09:43,285][INFO ][sys-#18842%grid-0%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (1 ms), stage="Update caches registry" (22 ms), stage="Start caches" (1 ms), stage="Affinity initialization on cache group start" (0 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Restore partition states" (0 ms), stage="After states restored callback" (10 ms), stage="WAL history reservation" (0 ms), stage="Waiting for all single messages" (9 ms), stage="Affinity recalculation (crd)" (1 ms), stage="Collect update counters and create affinity messages" (0 ms), stage="Assign partitions states" (0 ms), stage="Validate partitions states" (0 ms), stage="Ideal affinity diff calculation (enforced)" (0 ms), stage="Apply update counters" (0 ms), stage="Full message preparing" (2 ms), stage="Full message sending" (0 ms), stage="State finish message sending" (0 ms), stage="Detect lost partitions" (2 ms), stage="Exchange done" (3 ms), stage="Total time" (51 ms), Discovery lag=3 ms, Latest started node id=10c9b180-4e9e-47f4-91be-f461fdbc7001] [21:09:43] : [Step 4/5] [2021-11-19 21:09:43,289][INFO ][sys-#18953%grid-1%][GridCacheProcessor] Finish proxy initialization, cacheName=ignite-sys-cache, localNodeId=10c9b180-4e9e-47f4-91be-f461fdbc7001 [21:09:43] : [Step 4/5] [2021-11-19 21:09:43,291][INFO ][sys-#18842%grid-0%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], stage="Affinity initialization on cache group start [grp=ignite-sys-cache]" (0 ms) (parent=Affinity initialization on cache group start), stage="Affinity centralized initialization (crd) [grp=ignite-sys-cache, crd=true]" (0 ms) (parent=Determine exchange type), stage="Restore partition states [grp=ignite-sys-cache]" (0 ms) (parent=Restore partition states), stage="Affinity recalculation (partitions availability) [grp=ignite-sys-cache]" (0 ms) (parent=Ideal affinity diff calculation (enforced))] [21:09:43] : [Step 4/5] [2021-11-19 21:09:43,294][INFO ][sys-#18953%grid-1%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=10c9b180-4e9e-47f4-91be-f461fdbc7001, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=0055470b-0938-4c8d-91e6-894fbb9ab000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345383176, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:09:43] : [Step 4/5] [2021-11-19 21:09:43,294][INFO ][exchange-worker-#18979%grid-1%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=2, minorTopVer=1], force=false, evt=DISCOVERY_CUSTOM_EVT, node=0055470b-0938-4c8d-91e6-894fbb9ab000] [21:09:43] : [Step 4/5] [2021-11-19 21:09:43,293][INFO ][sys-#18962%grid-1%][DistributedBaselineConfiguration] Baseline auto-adjust is 'disabled' with timeout='300000' ms [21:09:43] : [Step 4/5] [2021-11-19 21:09:43,297][INFO ][db-checkpoint-thread-#18988%grid-1%][Checkpointer] Checkpoint finished [cpId=a7366b50-c3d7-4c91-b4c4-55d06c0350b7, pages=20, markPos=WALPointer [idx=0, fileOff=79771, len=1963], walSegmentsCovered=[], markDuration=11ms, pagesWrite=1ms, fsync=23ms, total=42ms] [21:09:43] : [Step 4/5] [2021-11-19 21:09:43,296][INFO ][sys-#18953%grid-1%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (2 ms), stage="Update caches registry" (19 ms), stage="Start caches" (0 ms), stage="Affinity initialization on cache group start" (0 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Restore partition states" (0 ms), stage="After states restored callback" (12 ms), stage="WAL history reservation" (0 ms), stage="Waiting for Full message" (16 ms), stage="Affinity recalculation" (3 ms), stage="Full map updating" (0 ms), stage="Detect lost partitions" (5 ms), stage="Exchange done" (7 ms), stage="Total time" (64 ms)] [21:09:43] : [Step 4/5] [2021-11-19 21:09:43,294][INFO ][test-runner-#18741%encryption.MasterKeyChangeTest%][root] awaitPartitionMapExchange finished [21:09:43] : [Step 4/5] [2021-11-19 21:09:43,299][INFO ][sys-#18953%grid-1%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], stage="Affinity initialization on cache group start [grp=ignite-sys-cache]" (0 ms) (parent=Affinity initialization on cache group start), stage="Affinity centralized initialization (crd) [grp=ignite-sys-cache, crd=false]" (0 ms) (parent=Determine exchange type), stage="Restore partition states [grp=ignite-sys-cache]" (0 ms) (parent=Restore partition states), stage="Affinity applying from full message [grp=ignite-sys-cache]" (3 ms) (parent=Affinity recalculation)] [21:09:43] : [Step 4/5] [2021-11-19 21:09:43,297][INFO ][sys-#18962%grid-1%][GridClusterStateProcessor] Successfully performed final activation steps [nodeId=10c9b180-4e9e-47f4-91be-f461fdbc7001, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:09:43] : [Step 4/5] [2021-11-19 21:09:43,297][INFO ][db-checkpoint-thread-#18993%grid-0%][Checkpointer] Checkpoint finished [cpId=6ad8928f-8b7d-4650-9d6f-9978176a6460, pages=18, markPos=WALPointer [idx=0, fileOff=75224, len=1963], walSegmentsCovered=[], markDuration=11ms, pagesWrite=2ms, fsync=23ms, total=38ms] [21:09:43] : [Step 4/5] [2021-11-19 21:09:43,309][INFO ][exchange-worker-#18857%grid-0%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], crd=true, evt=DISCOVERY_CUSTOM_EVT, evtNode=0055470b-0938-4c8d-91e6-894fbb9ab000, customEvt=DynamicCacheChangeBatch [id=a827d593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqs=ArrayList [DynamicCacheChangeRequest [cacheName=encrypted, hasCfg=true, nodeId=0055470b-0938-4c8d-91e6-894fbb9ab000, clientStartOnly=false, stop=false, destroy=false, disabledAfterStart=false]], exchangeActions=ExchangeActions [startCaches=[encrypted], stopCaches=null, startGrps=[encrypted], stopGrps=[], resetParts=null, stateChangeRequest=null], startCaches=false], allowMerge=false, exchangeFreeSwitch=false] [21:09:43] : [Step 4/5] [2021-11-19 21:09:43,309][INFO ][exchange-worker-#18979%grid-1%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], crd=false, evt=DISCOVERY_CUSTOM_EVT, evtNode=0055470b-0938-4c8d-91e6-894fbb9ab000, customEvt=DynamicCacheChangeBatch [id=a827d593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqs=ArrayList [DynamicCacheChangeRequest [cacheName=encrypted, hasCfg=true, nodeId=0055470b-0938-4c8d-91e6-894fbb9ab000, clientStartOnly=false, stop=false, destroy=false, disabledAfterStart=false]], exchangeActions=ExchangeActions [startCaches=[encrypted], stopCaches=null, startGrps=[encrypted], stopGrps=[], resetParts=null, stateChangeRequest=null], startCaches=false], allowMerge=false, exchangeFreeSwitch=false] [21:09:43] : [Step 4/5] [2021-11-19 21:09:43,312][INFO ][exchange-worker-#18857%grid-0%][PageMemoryImpl] Started page memory [memoryAllocated=24.0 MiB, pages=5952, tableSize=474.2 KiB, replacementSize=768 B, checkpointBuffer=10.0 MiB] [21:09:43] : [Step 4/5] [2021-11-19 21:09:43,313][INFO ][exchange-worker-#18979%grid-1%][PageMemoryImpl] Started page memory [memoryAllocated=24.0 MiB, pages=5952, tableSize=474.2 KiB, replacementSize=768 B, checkpointBuffer=10.0 MiB] [21:09:43] : [Step 4/5] [2021-11-19 21:09:43,391][INFO ][exchange-worker-#18857%grid-0%][GridCacheProcessor] Started cache [name=encrypted, id=1613773252, dataRegionName=default, mode=PARTITIONED, atomicity=ATOMIC, backups=0, mvcc=false] [21:09:43]W: [org.apache.ignite:ignite-core] [2021-11-19 21:09:43,392][WARN ][exchange-worker-#18857%grid-0%][CacheAffinitySharedManager] Cache group 'encrypted' brings high overhead for its metainformation in data region 'default'. Metainformation required for its partitions (502 partitions, 4096 bytes per partition, 1 MBs total) will consume more than 15% of data region memory (10 MBs). It may lead to critical errors on the node and cluster instability. Please reduce number of partitions, add more memory to the data region or add more server nodes for this cache group. [21:09:43] : [Step 4/5] [2021-11-19 21:09:43,394][INFO ][exchange-worker-#18857%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], waitTime=0ms, futInfo=NA, mode=DISTRIBUTED] [21:09:43] : [Step 4/5] [2021-11-19 21:09:43,395][INFO ][exchange-worker-#18979%grid-1%][GridCacheProcessor] Started cache [name=encrypted, id=1613773252, dataRegionName=default, mode=PARTITIONED, atomicity=ATOMIC, backups=0, mvcc=false] [21:09:43]W: [org.apache.ignite:ignite-core] [2021-11-19 21:09:43,397][WARN ][exchange-worker-#18979%grid-1%][CacheAffinitySharedManager] Cache group 'encrypted' brings high overhead for its metainformation in data region 'default'. Metainformation required for its partitions (522 partitions, 4096 bytes per partition, 2 MBs total) will consume more than 15% of data region memory (10 MBs). It may lead to critical errors on the node and cluster instability. Please reduce number of partitions, add more memory to the data region or add more server nodes for this cache group. [21:09:43] : [Step 4/5] [2021-11-19 21:09:43,398][INFO ][exchange-worker-#18979%grid-1%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], waitTime=0ms, futInfo=NA, mode=DISTRIBUTED] [21:09:43] : [Step 4/5] [2021-11-19 21:09:43,398][INFO ][exchange-worker-#18857%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partitions release latch: ServerLatch [permits=0, pendingAcks=HashSet [], super=CompletableLatch [id=CompletableLatchUid [id=exchange, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2]]]] [21:09:43] : [Step 4/5] [2021-11-19 21:09:43,399][INFO ][exchange-worker-#18979%grid-1%][GridDhtPartitionsExchangeFuture] Finished waiting for partitions release latch: ClientLatch [coordinator=TcpDiscoveryNode [id=0055470b-0938-4c8d-91e6-894fbb9ab000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345383176, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], ackSent=true, super=CompletableLatch [id=CompletableLatchUid [id=exchange, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2]]]] [21:09:43] : [Step 4/5] [2021-11-19 21:09:43,399][INFO ][exchange-worker-#18857%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:09:43] : [Step 4/5] [2021-11-19 21:09:43,400][INFO ][exchange-worker-#18979%grid-1%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:09:43] : [Step 4/5] [2021-11-19 21:09:43,449][INFO ][exchange-worker-#18979%grid-1%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], crd=false] [21:09:43] : [Step 4/5] [2021-11-19 21:09:43,461][INFO ][exchange-worker-#18857%grid-0%][GridDhtPartitionsExchangeFuture] Coordinator received single message [ver=AffinityTopologyVersion [topVer=2, minorTopVer=2], node=10c9b180-4e9e-47f4-91be-f461fdbc7001, allReceived=true] [21:09:43] : [Step 4/5] [2021-11-19 21:09:43,462][INFO ][exchange-worker-#18857%grid-0%][GridDhtPartitionsExchangeFuture] finishExchangeOnCoordinator [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2]] [21:09:43] : [Step 4/5] [2021-11-19 21:09:43,468][INFO ][exchange-worker-#18857%grid-0%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], err=null, rebalanced=true, wasRebalanced=true] [21:09:43] : [Step 4/5] [2021-11-19 21:09:43,469][INFO ][sys-#18949%grid-1%][GridDhtPartitionsExchangeFuture] Received full message, will finish exchange [node=0055470b-0938-4c8d-91e6-894fbb9ab000, resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2]] [21:09:43] : [Step 4/5] [2021-11-19 21:09:43,469][INFO ][exchange-worker-#18857%grid-0%][GridCacheProcessor] Finish proxy initialization, cacheName=encrypted, localNodeId=0055470b-0938-4c8d-91e6-894fbb9ab000 [21:09:43] : [Step 4/5] [2021-11-19 21:09:43,470][INFO ][exchange-worker-#18857%grid-0%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=0055470b-0938-4c8d-91e6-894fbb9ab000, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=0055470b-0938-4c8d-91e6-894fbb9ab000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345383298, loc=true, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2]] [21:09:43] : [Step 4/5] [2021-11-19 21:09:43,471][INFO ][sys-#18949%grid-1%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], err=null, rebalanced=true, wasRebalanced=true] [21:09:43] : [Step 4/5] [2021-11-19 21:09:43,473][INFO ][exchange-worker-#18857%grid-0%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], stage="Waiting in exchange queue" (1 ms), stage="Exchange parameters initialization" (1 ms), stage="Update caches registry" (0 ms), stage="Start caches" (80 ms), stage="Affinity initialization on cache group start" (3 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Wait partitions release latch [latch=exchange]" (4 ms), stage="Wait partitions release [latch=exchange]" (1 ms), stage="Restore partition states" (20 ms), stage="After states restored callback" (39 ms), stage="WAL history reservation" (0 ms), stage="Waiting for all single messages" (0 ms), stage="Affinity recalculation (crd)" (0 ms), stage="Collect update counters and create affinity messages" (0 ms), stage="Assign partitions states" (1 ms), stage="Validate partitions states" (0 ms), stage="Apply update counters" (0 ms), stage="Full message preparing" (2 ms), stage="Full message sending" (0 ms), stage="Exchange done" (4 ms), stage="Total time" (156 ms)] [21:09:43] : [Step 4/5] [2021-11-19 21:09:43,474][INFO ][sys-#18949%grid-1%][GridCacheProcessor] Finish proxy initialization, cacheName=encrypted, localNodeId=10c9b180-4e9e-47f4-91be-f461fdbc7001 [21:09:43] : [Step 4/5] [2021-11-19 21:09:43,476][INFO ][exchange-worker-#18857%grid-0%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], stage="Affinity initialization on cache group start [grp=encrypted]" (1 ms) (parent=Affinity initialization on cache group start), stage="Restore partition states [grp=encrypted]" (20 ms) (parent=Restore partition states), stage="Restore partition states [grp=ignite-sys-cache]" (0 ms) (parent=Restore partition states)] [21:09:43] : [Step 4/5] [2021-11-19 21:09:43,477][INFO ][exchange-worker-#18979%grid-1%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=2, minorTopVer=2], force=false, evt=DISCOVERY_CUSTOM_EVT, node=0055470b-0938-4c8d-91e6-894fbb9ab000] [21:09:43] : [Step 4/5] [2021-11-19 21:09:43,476][INFO ][sys-#18949%grid-1%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=10c9b180-4e9e-47f4-91be-f461fdbc7001, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=0055470b-0938-4c8d-91e6-894fbb9ab000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345383176, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2]] [21:09:43] : [Step 4/5] [2021-11-19 21:09:43,478][INFO ][exchange-worker-#18857%grid-0%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], crd=true] [21:09:43] : [Step 4/5] [2021-11-19 21:09:43,480][INFO ][sys-#18949%grid-1%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], stage="Waiting in exchange queue" (1 ms), stage="Exchange parameters initialization" (3 ms), stage="Update caches registry" (0 ms), stage="Start caches" (83 ms), stage="Affinity initialization on cache group start" (2 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Wait partitions release latch [latch=exchange]" (2 ms), stage="Wait partitions release [latch=exchange]" (1 ms), stage="Restore partition states" (17 ms), stage="After states restored callback" (29 ms), stage="WAL history reservation" (0 ms), stage="Waiting for Full message" (20 ms), stage="Affinity recalculation" (0 ms), stage="Full map updating" (2 ms), stage="Exchange done" (8 ms), stage="Total time" (168 ms)] [21:09:43] : [Step 4/5] [2021-11-19 21:09:43,481][INFO ][exchange-worker-#18857%grid-0%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=2, minorTopVer=2], force=false, evt=DISCOVERY_CUSTOM_EVT, node=0055470b-0938-4c8d-91e6-894fbb9ab000] [21:09:43] : [Step 4/5] [2021-11-19 21:09:43,482][INFO ][sys-#18949%grid-1%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], stage="Affinity initialization on cache group start [grp=encrypted]" (1 ms) (parent=Affinity initialization on cache group start), stage="Restore partition states [grp=encrypted]" (17 ms) (parent=Restore partition states), stage="Restore partition states [grp=ignite-sys-cache]" (0 ms) (parent=Restore partition states)] [21:09:45] : [Step 4/5] [2021-11-19 21:09:45,333][INFO ][test-runner-#18741%encryption.MasterKeyChangeTest%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:09:45] : [Step 4/5] [2021-11-19 21:09:45,480][INFO ][disco-notifier-worker-#18852%grid-0%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:09:45] : [Step 4/5] [2021-11-19 21:09:45,482][INFO ][disco-notifier-worker-#18970%grid-1%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:09:45] : [Step 4/5] [2021-11-19 21:09:45,617][INFO ][disco-notifier-worker-#18852%grid-0%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:09:45] : [Step 4/5] [2021-11-19 21:09:45,620][INFO ][disco-notifier-worker-#18970%grid-1%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:09:45] : [Step 4/5] [2021-11-19 21:09:45,707][INFO ][disco-notifier-worker-#18970%grid-1%][IgniteTestResources] Block message [node=0055470b-0938-4c8d-91e6-894fbb9ab000, order=1, msg=org.apache.ignite.internal.util.distributed.SingleNodeMessage@36653a7] [21:09:45] : [Step 4/5] [2021-11-19 21:09:45,763][INFO ][test-runner-#18741%encryption.MasterKeyChangeTest%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:09:45] : [Step 4/5] [2021-11-19 21:09:45,870][INFO ][test-runner-#18741%encryption.MasterKeyChangeTest%][IgniteTestResources] Send blocked message [node=0055470b-0938-4c8d-91e6-894fbb9ab000, order=1, msg=org.apache.ignite.internal.util.distributed.SingleNodeMessage@36653a7] [21:09:45] : [Step 4/5] [2021-11-19 21:09:45,872][INFO ][disco-notifier-worker-#18852%grid-0%][GridEncryptionManager] Start master key change [masterKeyName=ignite.master.key2] [21:09:45] : [Step 4/5] [2021-11-19 21:09:45,873][INFO ][disco-notifier-worker-#18970%grid-1%][GridEncryptionManager] Start master key change [masterKeyName=ignite.master.key2] [21:09:45] : [Step 4/5] [2021-11-19 21:09:45,930][INFO ][disco-notifier-worker-#18852%grid-0%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:09:45] : [Step 4/5] [2021-11-19 21:09:45,930][INFO ][disco-notifier-worker-#18970%grid-1%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:09:46] : [Step 4/5] [2021-11-19 21:09:46,035][INFO ][disco-notifier-worker-#18852%grid-0%][GridEncryptionManager] Master key successfully changed [masterKeyName=ignite.master.key2] [21:09:46] : [Step 4/5] [2021-11-19 21:09:46,035][INFO ][disco-notifier-worker-#18970%grid-1%][GridEncryptionManager] Master key successfully changed [masterKeyName=ignite.master.key2] [21:09:46] : [Step 4/5] [21:09:46] >>> Stopping test: MasterKeyChangeTest#testRejectMasterKeyChangeDuringRotation in 6636 ms <<< [21:09:46] : [Step 4/5] [2021-11-19 21:09:46,068][INFO ][main][root] >>> Stopping test: MasterKeyChangeTest#testRejectMasterKeyChangeDuringRotation in 6636 ms <<< [21:09:46] : [Step 4/5] [21:09:46] >>> Heap: 408 MB used / 1922 MB commited / 1922 MB max <<< [21:09:46] : [Step 4/5] [2021-11-19 21:09:46,068][INFO ][main][root] >>> Heap: 408 MB used / 1922 MB commited / 1922 MB max <<< [21:09:46] : [Step 4/5] [21:09:46] >>> Non-Heap: 153 MB used / 181 MB commited / 0 MB max <<< [21:09:46] : [Step 4/5] [2021-11-19 21:09:46,068][INFO ][main][root] >>> Non-Heap: 153 MB used / 181 MB commited / 0 MB max <<< [21:09:46] : [Step 4/5] [21:09:46] >>> Starting test: MasterKeyChangeTest#testRecoveryFromWalWithCacheOperations <<< [21:09:46] : [Step 4/5] [2021-11-19 21:09:46,070][INFO ][main][root] >>> Starting test: MasterKeyChangeTest#testRecoveryFromWalWithCacheOperations <<< [21:09:46] : [Step 4/5] [21:09:46] >>> Heap: 408 MB used / 1922 MB commited / 1922 MB max <<< [21:09:46] : [Step 4/5] [2021-11-19 21:09:46,070][INFO ][main][root] >>> Heap: 408 MB used / 1922 MB commited / 1922 MB max <<< [21:09:46] : [Step 4/5] [21:09:46] >>> Non-Heap: 153 MB used / 181 MB commited / 0 MB max <<< [21:09:46] : [Step 4/5] [2021-11-19 21:09:46,070][INFO ][main][root] >>> Non-Heap: 153 MB used / 181 MB commited / 0 MB max <<< [21:09:46] : [Step 4/5] [2021-11-19 21:09:46,071][INFO ][main][root] >>> Stopping grid [name=grid-1, id=10c9b180-4e9e-47f4-91be-f461fdbc7001] [21:09:46] : [Step 4/5] [2021-11-19 21:09:46,716][INFO ][db-checkpoint-thread-#18988%grid-1%][Checkpointer] Checkpoint started [checkpointId=3e147080-7b46-47e9-8890-ef4e6f8519e3, startPtr=WALPointer [idx=0, fileOff=642962, len=11871], checkpointBeforeLockTime=4ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=306ms, writeCheckpointEntryDuration=327ms, splitAndSortCpPagesDuration=1ms, pages=455, reason='timeout'] [21:09:46] : [Step 4/5] [2021-11-19 21:09:46,724][INFO ][tcp-disco-sock-reader-[0055470b 127.0.0.1:55673]-#994%grid-1%-#18975%grid-1%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:55673, rmtPort=55673, rmtNodeId=0055470b-0938-4c8d-91e6-894fbb9ab000] [21:09:46] : [Step 4/5] [2021-11-19 21:09:46,725][INFO ][disco-event-worker-#18856%grid-0%][GridDiscoveryManager] Node left topology: TcpDiscoveryNode [id=10c9b180-4e9e-47f4-91be-f461fdbc7001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637345383146, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false] [21:09:46] : [Step 4/5] [2021-11-19 21:09:46,730][INFO ][main][GridCacheProcessor] Stopped cache [cacheName=ignite-sys-cache] [21:09:46] : [Step 4/5] [2021-11-19 21:09:46,731][INFO ][main][GridCacheProcessor] Stopped cache [cacheName=encrypted] [21:09:46] : [Step 4/5] [2021-11-19 21:09:46,731][INFO ][disco-event-worker-#18856%grid-0%][GridDiscoveryManager] Topology snapshot [ver=3, locNode=0055470b, servers=1, clients=0, state=ACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=0055470b-0938-4c8d-91e6-894fbb9ab000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:09:46] : [Step 4/5] [2021-11-19 21:09:46,732][INFO ][disco-event-worker-#18856%grid-0%][GridDiscoveryManager] ^-- Baseline [id=0, size=2, online=1, offline=1] [21:09:46]W: [org.apache.ignite:ignite-core] [2021-11-19 21:09:46,732][WARN ][grid-nio-worker-tcp-comm-0-#18796%TestRecordingCommunicationSpi%][TestRecordingCommunicationSpi] Failed to shutdown socket [21:09:46]W: [org.apache.ignite:ignite-core] java.nio.channels.ClosedChannelException [21:09:46]W: [org.apache.ignite:ignite-core] at sun.nio.ch.SocketChannelImpl.shutdownOutput(SocketChannelImpl.java:795) [21:09:46]W: [org.apache.ignite:ignite-core] at sun.nio.ch.SocketAdaptor.shutdownOutput(SocketAdaptor.java:407) [21:09:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.close(IgniteUtils.java:4247) [21:09:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.closeKey(GridNioServer.java:2784) [21:09:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.close(GridNioServer.java:2835) [21:09:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.close(GridNioServer.java:2794) [21:09:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.bodyInternal(GridNioServer.java:2157) [21:09:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.body(GridNioServer.java:1910) [21:09:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:125) [21:09:46]W: [org.apache.ignite:ignite-core] at java.lang.Thread.run(Thread.java:748) [21:09:46] : [Step 4/5] [2021-11-19 21:09:46,735][INFO ][exchange-worker-#18857%grid-0%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], crd=true, evt=NODE_LEFT, evtNode=10c9b180-4e9e-47f4-91be-f461fdbc7001, customEvt=null, allowMerge=false, exchangeFreeSwitch=true] [21:09:46] : [Step 4/5] [2021-11-19 21:09:46,738][INFO ][sys-#18829%grid-0%][GridAffinityAssignmentCache] Local node affinity assignment distribution is not ideal [cache=encrypted, expectedPrimary=1024.00, actualPrimary=502, expectedBackups=0.00, actualBackups=0, warningThreshold=50.00%] [21:09:46] : [Step 4/5] [2021-11-19 21:09:46,738][INFO ][exchange-worker-#18857%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:09:46] : [Step 4/5] [2021-11-19 21:09:46,739][INFO ][exchange-worker-#18857%grid-0%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], err=null, rebalanced=true, wasRebalanced=true] [21:09:46]W: [org.apache.ignite:ignite-core] [2021-11-19 21:09:46,741][WARN ][sys-#18851%grid-0%][GridDhtPartitionTopologyImpl] Detected lost partitions [grp=encrypted, parts=[0, 2, 4, 6-7, 10-11, 14, 17, 21, 24-30, 32, 37, 40, 44, 47-52, 54, 57, 59, 62-64, 67-68, 74-75, 78, 81, 87-88, 91, 97, 99, 101-102, 104-107, 113-114, 116, 118, 120, 122, 124, 135-136, 138, 140-145, 147, 149-152, 154-156, 159-160, 162-164, 169, 172, 175-177, 180, 184-187, 190-191, 194, 196-202, 204-205, 209-210, 212, 214, 216, 219-224, 226, 229-232, 237, 239, 241, 243-245, 247, 249-251, 255, 257, 261, 265, 269, 272-273, 276-277, 281-282, 285, 287, 289-291, 293-297, 299, 301-304, 306, 308-309, 311-312, 315-317, 319, 322, 325-326, 328-330, 336, 339, 341, 344-346, 350, 352-354, 357-361, 363, 366-367, 371-373, 376-380, 383, 385, 387-388, 390, 392, 395-397, 400, 402, 405, 408-411, 416, 420, 422, 424-425, 429, 433, 435-438, 440-441, 445-446, 450, 452-453, 455-456, 458, 460, 462-463, 465-468, 470, 474-475, 480, 488, 490-492, 495, 497, 499-512, 516, 525, 527-531, 535, 537-538, 541-542, 545-546, 548-552, 554-555, 558, 562-564, 567-569, 572, 574, 579-580, 582-585, 587, 590-591, 594, 596, 600, 602, 604, 607-614, 617-620, 623-624, 627-629, 632-633, 636, 638, 640-642, 645-646, 648-649, 657-662, 664-665, 668-672, 677-678, 682-684, 686, 689, 692-693, 695-697, 699, 706-707, 709-710, 712-714, 716-717, 719-721, 723-728, 730-732, 734-735, 739, 742, 746, 749-750, 752, 754, 756, 762, 768-770, 772-775, 778, 780, 783-787, 789-791, 793, 796, 798-801, 803, 806, 809-812, 814, 816-817, 819, 822-825, 827-829, 832-833, 836-837, 839-840, 846, 848-851, 853-854, 857-858, 860, 863-864, 866, 868-871, 873-875, 877-878, 884, 888-889, 896-897, 900, 905-907, 914-915, 917, 919-920, 923-925, 931-933, 936, 940, 942, 944-945, 948, 950-951, 954, 956-958, 962, 965-970, 972, 975-976, 978-980, 983, 985, 988, 990, 993-994, 997-998, 1000, 1003-1004, 1007, 1009, 1014, 1016, 1018-1019], topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0]] [21:09:46] : [Step 4/5] [2021-11-19 21:09:46,745][INFO ][exchange-worker-#18857%grid-0%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=0055470b-0938-4c8d-91e6-894fbb9ab000, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], evt=NODE_LEFT, evtNode=TcpDiscoveryNode [id=10c9b180-4e9e-47f4-91be-f461fdbc7001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637345383146, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0]] [21:09:46] : [Step 4/5] [2021-11-19 21:09:46,746][INFO ][exchange-worker-#18857%grid-0%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (2 ms), stage="Determine exchange type" (1 ms), stage="Preloading notification" (0 ms), stage="After states restored callback" (0 ms), stage="WAL history reservation" (0 ms), stage="Finalize update counters" (0 ms), stage="Detect lost partitions" (5 ms), stage="Exchange done" (1 ms), stage="Total time" (9 ms)] [21:09:46] : [Step 4/5] [2021-11-19 21:09:46,747][INFO ][exchange-worker-#18857%grid-0%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], stage="Affinity initialization (exchange-free switch on fully-rebalanced topology) [grp=ignite-sys-cache]" (0 ms) (parent=Determine exchange type), stage="Affinity initialization (exchange-free switch on fully-rebalanced topology) [grp=encrypted]" (0 ms) (parent=Determine exchange type)] [21:09:46] : [Step 4/5] [2021-11-19 21:09:46,748][INFO ][exchange-worker-#18857%grid-0%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], crd=true] [21:09:46] : [Step 4/5] [2021-11-19 21:09:46,749][INFO ][exchange-worker-#18857%grid-0%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=3, minorTopVer=0], force=false, evt=NODE_LEFT, node=10c9b180-4e9e-47f4-91be-f461fdbc7001] [21:09:48] : [Step 4/5] [2021-11-19 21:09:48,809][INFO ][main][FilePageStoreManager] Cleanup cache stores [total=4, left=0, cleanFiles=false] [21:09:48] : [Step 4/5] [2021-11-19 21:09:48,813][INFO ][main][GridDeploymentLocalStore] Removed undeployed class: GridDeployment [ts=1637345383278, depMode=SHARED, clsLdr=IsolatedClassLoader{roleName='test'}, clsLdrId=4727d593d71-10c9b180-4e9e-47f4-91be-f461fdbc7001, userVer=0, loc=true, sampleClsName=org.apache.ignite.internal.processors.cache.distributed.dht.preloader.IgniteDhtPartitionHistorySuppliersMap, pendingUndeploy=false, undeployed=true, usage=0] [21:09:48] : [Step 4/5] [2021-11-19 21:09:48,822][INFO ][main][IgniteKernal%grid-1] [21:09:48] : [Step 4/5] [21:09:48] : [Step 4/5] >>> +------------------------------------------------------+ [21:09:48] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV stopped OK [21:09:48] : [Step 4/5] >>> +------------------------------------------------------+ [21:09:48] : [Step 4/5] >>> Ignite instance name: grid-1 [21:09:48] : [Step 4/5] >>> Grid uptime: 00:00:05.609 [21:09:48] : [Step 4/5] [21:09:48] : [Step 4/5] [21:09:48] : [Step 4/5] [2021-11-19 21:09:48,823][INFO ][main][root] >>> Stopping grid [name=grid-0, id=0055470b-0938-4c8d-91e6-894fbb9ab000] [21:09:48] : [Step 4/5] [2021-11-19 21:09:48,840][INFO ][db-checkpoint-thread-#18993%grid-0%][Checkpointer] Checkpoint started [checkpointId=9b436e68-2d41-48a6-b3e3-d8ec1e2ae8e1, startPtr=WALPointer [idx=0, fileOff=753862, len=11491], checkpointBeforeLockTime=3ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=1ms, checkpointLockHoldTime=4ms, walCpRecordFsyncDuration=2ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=1ms, pages=575, reason='timeout'] [21:09:48]W: [org.apache.ignite:ignite-core] [2021-11-19 21:09:48,844][WARN ][tcp-disco-sock-reader-[10c9b180 127.0.0.1:33979]-#995%grid-0%-#18976%grid-0%][TestTcpDiscoverySpi] Failed to shutdown socket [21:09:48]W: [org.apache.ignite:ignite-core] java.net.SocketException: Socket is closed [21:09:48]W: [org.apache.ignite:ignite-core] at java.net.Socket.shutdownOutput(Socket.java:1568) [21:09:48]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.close(IgniteUtils.java:4247) [21:09:48]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.discovery.tcp.ServerImpl$SocketReader.body(ServerImpl.java:7370) [21:09:48]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.IgniteSpiThread.run(IgniteSpiThread.java:58) [21:09:48] : [Step 4/5] [2021-11-19 21:09:48,845][INFO ][tcp-disco-sock-reader-[10c9b180 127.0.0.1:33979]-#995%grid-0%-#18976%grid-0%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:33979, rmtPort=33979, rmtNodeId=10c9b180-4e9e-47f4-91be-f461fdbc7001] [21:09:48] : [Step 4/5] [2021-11-19 21:09:48,846][INFO ][main][GridCacheProcessor] Stopped cache [cacheName=ignite-sys-cache] [21:09:48] : [Step 4/5] [2021-11-19 21:09:48,847][INFO ][main][GridCacheProcessor] Stopped cache [cacheName=encrypted] [21:09:49] : [Step 4/5] [2021-11-19 21:09:49,326][INFO ][main][FilePageStoreManager] Cleanup cache stores [total=4, left=0, cleanFiles=false] [21:09:49] : [Step 4/5] [2021-11-19 21:09:49,328][INFO ][main][GridDeploymentLocalStore] Removed undeployed class: GridDeployment [ts=1637345383268, depMode=SHARED, clsLdr=IsolatedClassLoader{roleName='test'}, clsLdrId=2727d593d71-0055470b-0938-4c8d-91e6-894fbb9ab000, userVer=0, loc=true, sampleClsName=org.apache.ignite.internal.processors.cache.distributed.dht.preloader.GridDhtPartitionMap, pendingUndeploy=false, undeployed=true, usage=0] [21:09:49] : [Step 4/5] [2021-11-19 21:09:49,334][INFO ][main][IgniteKernal%grid-0] [21:09:49] : [Step 4/5] [21:09:49] : [Step 4/5] >>> +------------------------------------------------------+ [21:09:49] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV stopped OK [21:09:49] : [Step 4/5] >>> +------------------------------------------------------+ [21:09:49] : [Step 4/5] >>> Ignite instance name: grid-0 [21:09:49] : [Step 4/5] >>> Grid uptime: 00:00:07.806 [21:09:49] : [Step 4/5] [21:09:49] : [Step 4/5] [21:09:49]W: [org.apache.ignite:ignite-core] [2021-11-19 21:09:49,577][WARN ][test-runner-#19013%encryption.MasterKeyChangeTest%][G] Ignite work directory is not provided, automatically resolved to: /opt/buildagent/work/7bc1c54bc719b67c/work [21:09:49] : [Step 4/5] [2021-11-19 21:09:49,578][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] [21:09:49] : [Step 4/5] [21:09:49] : [Step 4/5] >>> __________ ________________ [21:09:49] : [Step 4/5] >>> / _/ ___/ |/ / _/_ __/ __/ [21:09:49] : [Step 4/5] >>> _/ // (7 7 // / / / / _/ [21:09:49] : [Step 4/5] >>> /___/\___/_/|_/___/ /_/ /___/ [21:09:49] : [Step 4/5] >>> [21:09:49] : [Step 4/5] >>> ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:09:49] : [Step 4/5] >>> 2021 Copyright(C) Apache Software Foundation [21:09:49] : [Step 4/5] >>> [21:09:49] : [Step 4/5] >>> Ignite documentation: http://ignite.apache.org [21:09:49] : [Step 4/5] [21:09:49] : [Step 4/5] [2021-11-19 21:09:49,579][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] Config URL: n/a [21:09:49] : [Step 4/5] [2021-11-19 21:09:49,579][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] IgniteConfiguration [igniteInstanceName=grid-0, pubPoolSize=24, svcPoolSize=24, callbackPoolSize=24, stripedPoolSize=24, sysPoolSize=24, mgmtPoolSize=4, dataStreamerPoolSize=24, utilityCachePoolSize=24, utilityCacheKeepAliveTime=60000, p2pPoolSize=2, qryPoolSize=24, buildIdxPoolSize=4, igniteHome=/opt/buildagent/work/7bc1c54bc719b67c, igniteWorkDir=/opt/buildagent/work/7bc1c54bc719b67c/work, mbeanSrv=com.sun.jmx.mbeanserver.JmxMBeanServer@6fe85038, nodeId=00f25b7e-9e72-4811-a52d-4f0fd1043000, marsh=BinaryMarshaller [], marshLocJobs=false, daemon=false, p2pEnabled=true, netTimeout=10000, netCompressionLevel=1, sndRetryDelay=1000, sndRetryCnt=3, metricsHistSize=10000, metricsUpdateFreq=1000, metricsExpTime=9223372036854775807, discoSpi=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=0, ackTimeout=0, marsh=null, reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], segPlc=STOP, segResolveAttempts=2, waitForSegOnStart=true, allResolversPassReq=true, segChkFreq=10000, commSpi=TcpCommunicationSpi [connectGate=org.apache.ignite.spi.communication.tcp.internal.ConnectGateway@6e9adda, ctxInitLatch=java.util.concurrent.CountDownLatch@44665b29[Count = 1], stopping=false, clientPool=null, nioSrvWrapper=null, stateProvider=null], evtSpi=MemoryEventStorageSpi [expireAgeMs=9223372036854775807, expireCnt=10000, filter=null], colSpi=NoopCollisionSpi [], deploySpi=LocalDeploymentSpi [], indexingSpi=org.apache.ignite.spi.indexing.noop.NoopIndexingSpi@26003441, addrRslvr=null, encryptionSpi=org.apache.ignite.spi.encryption.keystore.KeystoreEncryptionSpi@4015ecf, tracingSpi=org.apache.ignite.spi.tracing.NoopTracingSpi@34e9c529, clientMode=false, rebalanceThreadPoolSize=4, rebalanceTimeout=10000, rebalanceBatchesPrefetchCnt=3, rebalanceThrottle=0, rebalanceBatchSize=524288, txCfg=TransactionConfiguration [txSerEnabled=false, dfltIsolation=REPEATABLE_READ, dfltConcurrency=PESSIMISTIC, dfltTxTimeout=0, txTimeoutOnPartitionMapExchange=0, deadlockTimeout=10000, pessimisticTxLogSize=0, pessimisticTxLogLinger=10000, tmLookupClsName=null, txManagerFactory=null, useJtaSync=false], cacheSanityCheckEnabled=true, discoStartupDelay=60000, deployMode=SHARED, p2pMissedCacheSize=100, locHost=127.0.0.1, timeSrvPortBase=31100, timeSrvPortRange=100, failureDetectionTimeout=10000, sysWorkerBlockedTimeout=null, clientFailureDetectionTimeout=10000, metricsLogFreq=0, connectorCfg=null, odbcCfg=null, warmupClos=null, atomicCfg=AtomicConfiguration [seqReserveSize=1000, cacheMode=PARTITIONED, backups=1, aff=null, grpName=null], classLdr=null, sslCtxFactory=null, platformCfg=null, binaryCfg=null, memCfg=null, pstCfg=null, dsCfg=DataStorageConfiguration [sysRegionInitSize=41943040, sysRegionMaxSize=104857600, pageSize=4096, concLvl=0, dfltDataRegConf=DataRegionConfiguration [name=default, maxSize=10485760, initSize=268435456, swapPath=null, pageEvictionMode=DISABLED, pageReplacementMode=CLOCK, evictionThreshold=0.9, emptyPagesPoolSize=100, metricsEnabled=false, metricsSubIntervalCount=5, metricsRateTimeInterval=60000, persistenceEnabled=true, checkpointPageBufSize=0, lazyMemoryAllocation=true, warmUpCfg=null], dataRegions=null, storagePath=null, checkpointFreq=180000, lockWaitTime=10000, checkpointThreads=4, checkpointWriteOrder=SEQUENTIAL, walHistSize=20, maxWalArchiveSize=1073741824, walSegments=10, walSegmentSize=67108864, walPath=db/wal, walArchivePath=db/wal/archive, cdcWalPath=db/wal/cdc, cdcEnabled=false, metricsEnabled=false, walMode=FSYNC, walTlbSize=131072, walBuffSize=0, walFlushFreq=2000, walFsyncDelay=1000, walRecordIterBuffSize=67108864, alwaysWriteFullPages=false, fileIOFactory=org.apache.ignite.internal.processors.cache.persistence.file.AsyncFileIOFactory@6b759efe, metricsSubIntervalCnt=5, metricsRateTimeInterval=60000, walAutoArchiveAfterInactivity=-1, walForceArchiveTimeout=-1, writeThrottlingEnabled=false, walCompactionEnabled=false, walCompactionLevel=1, checkpointReadLockTimeout=null, walPageCompression=DISABLED, walPageCompressionLevel=null, dfltWarmUpCfg=null, encCfg=org.apache.ignite.configuration.EncryptionConfiguration@5842fad3, defragmentationThreadPoolSize=4, minWalArchiveSize=-1], snapshotPath=snapshots, activeOnStart=true, activeOnStartPropSetFlag=false, autoActivation=true, autoActivationPropSetFlag=false, clusterStateOnStart=null, sqlConnCfg=null, cliConnCfg=ClientConnectorConfiguration [host=null, port=10800, portRange=100, sockSndBufSize=0, sockRcvBufSize=0, tcpNoDelay=true, maxOpenCursorsPerConn=128, threadPoolSize=24, selectorCnt=12, idleTimeout=0, handshakeTimeout=10000, jdbcEnabled=true, odbcEnabled=true, thinCliEnabled=true, sslEnabled=false, useIgniteSslCtxFactory=true, sslClientAuth=false, sslCtxFactory=null, thinCliCfg=ThinClientConfiguration [maxActiveTxPerConn=100, maxActiveComputeTasksPerConn=0]], mvccVacuumThreadCnt=2, mvccVacuumFreq=5000, authEnabled=false, failureHnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]], commFailureRslvr=null, sqlCfg=SqlConfiguration [longQryWarnTimeout=3000, dfltQryTimeout=0, sqlQryHistSize=1000, validationEnabled=false], asyncContinuationExecutor=null] [21:09:49] : [Step 4/5] [2021-11-19 21:09:49,588][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] Daemon mode: off [21:09:49] : [Step 4/5] [2021-11-19 21:09:49,588][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] OS: Linux 4.15.0-151-generic amd64 [21:09:49] : [Step 4/5] [2021-11-19 21:09:49,588][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] OS user: teamcity [21:09:49] : [Step 4/5] [2021-11-19 21:09:49,588][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] PID: 16724 [21:09:49] : [Step 4/5] [2021-11-19 21:09:49,589][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] Language runtime: Java Platform API Specification ver. 1.8 [21:09:49] : [Step 4/5] [2021-11-19 21:09:49,589][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] VM information: Java(TM) SE Runtime Environment 1.8.0_261-b12 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 25.261-b12 [21:09:49] : [Step 4/5] [2021-11-19 21:09:49,589][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] VM total memory: 1.9GB [21:09:49] : [Step 4/5] [2021-11-19 21:09:49,589][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] Remote Management [restart: off, REST: off, JMX (remote: off)] [21:09:49] : [Step 4/5] [2021-11-19 21:09:49,590][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] Logger: GridTestLog4jLogger [quiet=false, config=null] [21:09:49] : [Step 4/5] [2021-11-19 21:09:49,590][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] IGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c [21:09:49] : [Step 4/5] [2021-11-19 21:09:49,590][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] VM arguments: [-DIGNITE_DUMP_THREADS_ON_FAILURE=false, -DMono=/usr/bin/mono-sgen, -DMono4.0_x64=/usr/lib/mono/4.0, -DMono4.5_x64=/usr/lib/mono/4.5, -DMonoVersion=6.12.0.90, -DSKIP_BUILD=false, -Dagent.home.dir=/opt/buildagent, -Dagent.name=aitc-lin02_03, -Dagent.ownPort=9090, -Dagent.work.dir=/opt/buildagent/work, -Dbuild.number=95, -Dbuild.vcs.number=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.1=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.GitHubApacheIgnite=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dclassworlds.conf=/opt/buildagent/temp/buildTmp/teamcity.m2.conf, -Dcom.jetbrains.maven.watcher.report.file=/opt/buildagent/temp/buildTmp/maven-build-info.xml, -Djava.io.tmpdir=/opt/buildagent/temp/buildTmp, -Dmaven.home=/opt/buildagent/tools/maven3_6, -Dmaven.multiModuleProjectDirectory=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.agent.cpuBenchmark=457, -Dteamcity.agent.dotnet.agent_url=http://localhost:9090/RPC2, -Dteamcity.agent.dotnet.build_id=6278078, -Dteamcity.auth.password=*******, -Dteamcity.auth.userId=TeamCityBuildId=6278078, -Dteamcity.build.changedFiles.file=/opt/buildagent/temp/buildTmp/changedFiles6342607772318147725.txt, -Dteamcity.build.checkoutDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.build.id=6278078, -Dteamcity.build.properties.file=/opt/buildagent/temp/buildTmp/teamcity.build5164517880467851002.properties, -Dteamcity.build.tempDir=/opt/buildagent/temp/buildTmp, -Dteamcity.build.workingDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.buildConfName=Basic 3, -Dteamcity.buildType.id=IgniteTests24Java8_Basic3, -Dteamcity.configuration.properties.file=/opt/buildagent/temp/buildTmp/teamcity.config5591980786735343870.properties, -Dteamcity.maven.userSettings.path=/opt/buildagent/temp/buildTmp/maven_settings_585072866407032347.xml, -Dteamcity.maven.watcher.home=/opt/buildagent/plugins/mavenPlugin/maven-watcher-jdk16, -Dteamcity.projectName=Ignite Tests 2.x (JDK 8/11), -Dteamcity.runner.properties.file=/opt/buildagent/temp/buildTmp/teamcity.runner9098465561618137420.properties, -Dteamcity.tests.recentlyFailedTests.file=/opt/buildagent/temp/buildTmp/testsToRunFirst3891775683130404069.txt, -Dteamcity.version=2021.2 (build 99542), -ea, -Xms2g, -Xmx2g, -XX:+HeapDumpOnOutOfMemoryError, -DIGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_TEST_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_UPDATE_NOTIFIER=false, -DIGNITE_NO_DISCO_ORDER=true, -DIGNITE_PERFORMANCE_SUGGESTIONS_DISABLED=true, -Djava.net.preferIPv4Stack=true, -DTEST_SCALE_FACTOR=1.0, -DIGNITE_TEST_PROP_LOG4J_FILE=log4j-tc-test.xml, -DIGNITE_QUIET=false, -DIGNITE_MARSHAL_BUFFERS_RECHECK=1000, -Dmaven.repo.local=/opt/buildagent/.m2/repository] [21:09:49] : [Step 4/5] [2021-11-19 21:09:49,595][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] System cache's DataRegion size is configured to 40 MB. Use DataStorageConfiguration.systemRegionInitialSize property to change the setting. [21:09:49] : [Step 4/5] [2021-11-19 21:09:49,595][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] Configured caches [in 'sysMemPlc' dataRegion: ['ignite-sys-cache']] [21:09:49]W: [org.apache.ignite:ignite-core] [2021-11-19 21:09:49,595][WARN ][test-runner-#19013%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] Peer class loading is enabled (disable it in production for performance and deployment consistency reasons) [21:09:49] : [Step 4/5] [2021-11-19 21:09:49,595][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] 3-rd party licenses can be found at: /opt/buildagent/work/7bc1c54bc719b67c/libs/licenses [21:09:49] : [Step 4/5] [2021-11-19 21:09:49,599][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] Configured plugins: [21:09:49] : [Step 4/5] [2021-11-19 21:09:49,599][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] ^-- StanByClusterTestProvider 1.0 [21:09:49] : [Step 4/5] [2021-11-19 21:09:49,599][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:09:49] : [Step 4/5] [2021-11-19 21:09:49,599][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] [21:09:49] : [Step 4/5] [2021-11-19 21:09:49,599][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] ^-- PageMemory tracker plugin 1.0 [21:09:49] : [Step 4/5] [2021-11-19 21:09:49,600][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:09:49] : [Step 4/5] [2021-11-19 21:09:49,600][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] [21:09:49] : [Step 4/5] [2021-11-19 21:09:49,600][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] ^-- TestDistibutedConfigurationPlugin 1.0 [21:09:49] : [Step 4/5] [2021-11-19 21:09:49,600][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:09:49] : [Step 4/5] [2021-11-19 21:09:49,600][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] [21:09:49] : [Step 4/5] [2021-11-19 21:09:49,600][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] ^-- NodeValidationPluginProvider 1.0 [21:09:49] : [Step 4/5] [2021-11-19 21:09:49,601][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:09:49] : [Step 4/5] [2021-11-19 21:09:49,601][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] [21:09:49] : [Step 4/5] [2021-11-19 21:09:49,601][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][FailureProcessor] Configured failure handler: [hnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]]] [21:09:49] : [Step 4/5] [2021-11-19 21:09:49,611][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][TestRecordingCommunicationSpi] Successfully bound communication NIO server to TCP port [port=47100, locHost=/127.0.0.1, selectorsCnt=12, selectorSpins=0, pairedConn=false] [21:09:49]W: [org.apache.ignite:ignite-core] [2021-11-19 21:09:49,611][WARN ][test-runner-#19013%encryption.MasterKeyChangeTest%][TestRecordingCommunicationSpi] Message queue limit is set to 0 which may lead to potential OOMEs when running cache operations in FULL_ASYNC or PRIMARY_SYNC modes due to message queues growth on sender and receiver sides. [21:09:49] : [Step 4/5] [2021-11-19 21:09:49,615][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][GridCollisionManager] Collision resolution is disabled (all jobs will be activated upon arrival). [21:09:49] : [Step 4/5] [2021-11-19 21:09:49,615][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] Security status [authentication=off, sandbox=off, tls/ssl=off] [21:09:49] : [Step 4/5] [2021-11-19 21:09:49,671][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:09:49] : [Step 4/5] [2021-11-19 21:09:49,768][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][MaintenanceProcessor] Resolved store directory for node persistent data: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0 [21:09:49] : [Step 4/5] [2021-11-19 21:09:49,770][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][CacheObjectBinaryProcessorImpl] Resolved directory for serialized binary metadata: /opt/buildagent/work/7bc1c54bc719b67c/work/db/binary_meta/grid_0 [21:09:49] : [Step 4/5] [2021-11-19 21:09:49,776][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0 [21:09:49] : [Step 4/5] [2021-11-19 21:09:49,777][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][FileWriteAheadLogManager] Resolved write ahead log work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0 [21:09:49] : [Step 4/5] [2021-11-19 21:09:49,778][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][FileWriteAheadLogManager] Resolved write ahead log archive directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0 [21:09:50] : [Step 4/5] [2021-11-19 21:09:50,311][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000000.wal [21:09:50]W: [org.apache.ignite:ignite-core] [2021-11-19 21:09:50,312][WARN ][test-runner-#19013%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] DataRegion maxSize=10.5 MB is smaller than defaultInitialSize=268.4 MB, setting initialSize to 10.5 MB [21:09:50] : [Step 4/5] [2021-11-19 21:09:50,316][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Configured data regions initialized successfully [total=5] [21:09:50] : [Step 4/5] [2021-11-19 21:09:50,319][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][IgniteSnapshotManager] Resolved snapshot work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/snapshots [21:09:50] : [Step 4/5] [2021-11-19 21:09:50,319][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][IgniteSnapshotManager] Resolved temp directory for snapshot creation: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0/snp [21:09:50] : [Step 4/5] [2021-11-19 21:09:50,321][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][ClientListenerProcessor] Client connector processor has started on TCP port 10800 [21:09:50] : [Step 4/5] [2021-11-19 21:09:50,326][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] Non-loopback local IPs: 172.17.0.4 [21:09:50] : [Step 4/5] [2021-11-19 21:09:50,326][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] Enabled local MACs: 0242AC110004 [21:09:50] : [Step 4/5] [2021-11-19 21:09:50,328][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:09:50] : [Step 4/5] [2021-11-19 21:09:50,329][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:09:50] : [Step 4/5] [2021-11-19 21:09:50,329][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:09:50] : [Step 4/5] [2021-11-19 21:09:50,331][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Applying lost metastore updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:09:50] : [Step 4/5] [2021-11-19 21:09:50,332][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=0 ms] [21:09:50] : [Step 4/5] [2021-11-19 21:09:50,332][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][GridCacheProcessor] Restoring partition state for local groups. [21:09:50] : [Step 4/5] [2021-11-19 21:09:50,332][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=0, partitionsProcessed=0, time=0ms] [21:09:50] : [Step 4/5] [2021-11-19 21:09:50,333][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][GridEncryptionManager] Encryption keys loaded from metastore. [grps=, masterKeyName=ignite.master.key] [21:09:50] : [Step 4/5] [2021-11-19 21:09:50,336][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][ClusterProcessor] Cluster ID and tag has been read from metastorage: null [21:09:50] : [Step 4/5] [2021-11-19 21:09:50,337][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][IgniteClusterImpl] Shutdown policy was updated [oldVal=null, newVal=null] [21:09:50] : [Step 4/5] [2021-11-19 21:09:50,337][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Checkpoint frequency deviation changed [oldVal=null, newVal=null] [21:09:50] : [Step 4/5] [2021-11-19 21:09:50,347][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][FilePageStoreManager] Cleanup cache stores [total=1, left=0, cleanFiles=false] [21:09:50] : [Step 4/5] [2021-11-19 21:09:50,349][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:09:50] : [Step 4/5] [2021-11-19 21:09:50,349][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:09:50] : [Step 4/5] [2021-11-19 21:09:50,351][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:09:50] : [Step 4/5] [2021-11-19 21:09:50,351][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Data Regions Started: 5 [21:09:50] : [Step 4/5] [2021-11-19 21:09:50,352][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] ^-- sysMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:09:50] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:09:50] : [Step 4/5] ^-- default region [type=default, persistence=true, lazyAlloc=true, [21:09:50] : [Step 4/5] ... initCfg=10MB, maxCfg=10MB, usedRam=0MB, freeRam=100%, allocRam=0MB, allocTotal=0MB] [21:09:50] : [Step 4/5] ^-- metastoreMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:09:50] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:09:50] : [Step 4/5] ^-- TxLog region [type=internal, persistence=true, lazyAlloc=false, [21:09:50] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:09:50] : [Step 4/5] ^-- volatileDsMemPlc region [type=user, persistence=false, lazyAlloc=true, [21:09:50] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB] [21:09:50] : [Step 4/5] ^-- Ignite persistence [used=0MB] [21:09:50] : [Step 4/5] [21:09:50] : [Step 4/5] [2021-11-19 21:09:50,353][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Starting binary memory restore for: [-2100569601] [21:09:50] : [Step 4/5] [2021-11-19 21:09:50,360][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:09:50] : [Step 4/5] [2021-11-19 21:09:50,360][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:09:50] : [Step 4/5] [2021-11-19 21:09:50,361][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000000.wal, offset=0, ver=2] [21:09:50] : [Step 4/5] [2021-11-19 21:09:50,365][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][GridCacheProcessor] Started cache in recovery mode [name=ignite-sys-cache, id=-2100569601, dataRegionName=sysMemPlc, mode=REPLICATED, atomicity=TRANSACTIONAL, backups=2147483647, mvcc=false] [21:09:50] : [Step 4/5] [2021-11-19 21:09:50,366][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Binary recovery performed in 13 ms. [21:09:50] : [Step 4/5] [2021-11-19 21:09:50,366][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:09:50] : [Step 4/5] [2021-11-19 21:09:50,366][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Applying lost cache updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:09:50] : [Step 4/5] [2021-11-19 21:09:50,423][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=61 ms] [21:09:50] : [Step 4/5] [2021-11-19 21:09:50,423][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][GridCacheProcessor] Restoring partition state for local groups. [21:09:50] : [Step 4/5] [2021-11-19 21:09:50,430][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=1, partitionsProcessed=100, time=0ms] [21:09:50] : [Step 4/5] [2021-11-19 21:09:50,932][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][TestTcpDiscoverySpi] Successfully bound to TCP port [port=47500, localHost=localhost/127.0.0.1, locNodeId=00f25b7e-9e72-4811-a52d-4f0fd1043000] [21:09:50] : [Step 4/5] [2021-11-19 21:09:50,944][INFO ][disco-notifier-worker-#19124%grid-0%][MvccProcessorImpl] Assigned mvcc coordinator [crd=MvccCoordinator [topVer=AffinityTopologyVersion [topVer=1, minorTopVer=0], nodeId=00f25b7e-9e72-4811-a52d-4f0fd1043000, ver=1637345390937, local=true, initialized=false]] [21:09:50] : [Step 4/5] [2021-11-19 21:09:50,945][INFO ][sys-#19106%grid-0%][ClusterProcessor] Writing cluster ID and tag to metastorage on ready for write ClusterIdAndTag [id=f9f004b4-3864-44de-b14d-12acab81f510, tag=kind_golick] [21:09:50] : [Step 4/5] [2021-11-19 21:09:50,949][INFO ][disco-notifier-worker-#19124%grid-0%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustEnabled' was changed from 'null' to 'false' [21:09:50] : [Step 4/5] [2021-11-19 21:09:50,950][INFO ][disco-notifier-worker-#19124%grid-0%][ClusterProcessor] kind_golick [21:09:50] : [Step 4/5] [2021-11-19 21:09:50,950][INFO ][disco-notifier-worker-#19124%grid-0%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustTimeout' was changed from 'null' to '300000' [21:09:50] : [Step 4/5] [2021-11-19 21:09:50,951][INFO ][disco-notifier-worker-#19124%grid-0%][IgniteTxManager] Transactions parameter 'longOperationsDumpTimeout' was changed from 'null' to '60000' [21:09:50] : [Step 4/5] [2021-11-19 21:09:50,951][INFO ][disco-notifier-worker-#19124%grid-0%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpThreshold' was changed from 'null' to '0' [21:09:50] : [Step 4/5] [2021-11-19 21:09:50,952][INFO ][disco-notifier-worker-#19124%grid-0%][IgniteTxManager] Transactions parameter 'transactionTimeDumpSamplesCoefficient' was changed from 'null' to '0.0' [21:09:50] : [Step 4/5] [2021-11-19 21:09:50,952][INFO ][disco-notifier-worker-#19124%grid-0%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpSamplesPerSecondLimit' was changed from 'null' to '5' [21:09:50] : [Step 4/5] [2021-11-19 21:09:50,955][INFO ][disco-notifier-worker-#19124%grid-0%][IgniteTxManager] Transactions parameter 'collisionsDumpInterval' was changed from 'null' to '1000' [21:09:50] : [Step 4/5] [2021-11-19 21:09:50,956][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] To start Console Management & Monitoring run ignitevisorcmd.{sh|bat} [21:09:50] : [Step 4/5] [2021-11-19 21:09:50,956][INFO ][disco-notifier-worker-#19124%grid-0%][IgniteTxManager] Transactions parameter 'txOwnerDumpRequestsAllowed' was changed from 'null' to 'true' [21:09:50] : [Step 4/5] [2021-11-19 21:09:50,956][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] [21:09:50] : [Step 4/5] [21:09:50] : [Step 4/5] >>> +-------------------------------------------+ [21:09:50] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:09:50] : [Step 4/5] >>> +-------------------------------------------+ [21:09:50] : [Step 4/5] >>> OS name: Linux 4.15.0-151-generic amd64 [21:09:50] : [Step 4/5] >>> CPU(s): 24 [21:09:50] : [Step 4/5] >>> Heap: 2.0GB [21:09:50] : [Step 4/5] >>> VM name: 16724@c4dfe9a430b2 [21:09:50] : [Step 4/5] >>> Ignite instance name: grid-0 [21:09:50] : [Step 4/5] >>> Local node [ID=00F25B7E-9E72-4811-A52D-4F0FD1043000, order=1, clientMode=false] [21:09:50] : [Step 4/5] >>> Local node addresses: [127.0.0.1] [21:09:50] : [Step 4/5] >>> Local ports: TCP:10800 TCP:47100 TCP:47500 [21:09:50] : [Step 4/5] [21:09:50] : [Step 4/5] [2021-11-19 21:09:50,957][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] >>> Ignite cluster is in INACTIVE state (limited functionality available). Use control.(sh|bat) script or IgniteCluster.state(ClusterState.ACTIVE) to change the state. [21:09:50] : [Step 4/5] [2021-11-19 21:09:50,956][INFO ][disco-notifier-worker-#19124%grid-0%][GridCacheDatabaseSharedManager] Historical rebalance WAL threshold changed [property=historical.rebalance.threshold, oldVal=null, newVal=500] [21:09:50] : [Step 4/5] [2021-11-19 21:09:50,958][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][GridDiscoveryManager] Topology snapshot [ver=1, locNode=00f25b7e, servers=1, clients=0, state=INACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=00f25b7e-9e72-4811-a52d-4f0fd1043000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:09:50] : [Step 4/5] [2021-11-19 21:09:50,958][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][G] Node started : [stage="Configure system pool" (0 ms),stage="Start managers" (191 ms),stage="Configure binary metadata" (3 ms),stage="Start processors" (552 ms),stage="Start 'StanByClusterTestProvider' plugin" (0 ms),stage="Start 'PageMemory tracker plugin' plugin" (0 ms),stage="Start 'TestDistibutedConfigurationPlugin' plugin" (0 ms),stage="Start 'NodeValidationPluginProvider' plugin" (0 ms),stage="Init metastore" (21 ms),stage="Init and start regions" (5 ms),stage="Restore binary memory" (13 ms),stage="Restore logical state" (64 ms),stage="Finish recovery" (500 ms),stage="Join topology" (12 ms),stage="Await transition" (2 ms),stage="Await exchange" (12 ms),stage="Total time" (1375 ms)] [21:09:50] : [Step 4/5] [2021-11-19 21:09:50,959][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][root] Node started with the following configuration [id=00f25b7e-9e72-4811-a52d-4f0fd1043000, marshaller=BinaryMarshaller [], discovery=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=5000, ackTimeout=5000, marsh=JdkMarshaller [clsFilter=org.apache.ignite.marshaller.MarshallerUtils$1@5035fff], reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], binaryCfg=null, lateAff=true] [21:09:50]W: [org.apache.ignite:ignite-core] [2021-11-19 21:09:50,963][WARN ][test-runner-#19013%encryption.MasterKeyChangeTest%][G] Ignite work directory is not provided, automatically resolved to: /opt/buildagent/work/7bc1c54bc719b67c/work [21:09:50] : [Step 4/5] [2021-11-19 21:09:50,964][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] [21:09:50] : [Step 4/5] [21:09:50] : [Step 4/5] >>> __________ ________________ [21:09:50] : [Step 4/5] >>> / _/ ___/ |/ / _/_ __/ __/ [21:09:50] : [Step 4/5] >>> _/ // (7 7 // / / / / _/ [21:09:50] : [Step 4/5] >>> /___/\___/_/|_/___/ /_/ /___/ [21:09:50] : [Step 4/5] >>> [21:09:50] : [Step 4/5] >>> ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:09:50] : [Step 4/5] >>> 2021 Copyright(C) Apache Software Foundation [21:09:50] : [Step 4/5] >>> [21:09:50] : [Step 4/5] >>> Ignite documentation: http://ignite.apache.org [21:09:50] : [Step 4/5] [21:09:50] : [Step 4/5] [2021-11-19 21:09:50,965][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] Config URL: n/a [21:09:50] : [Step 4/5] [2021-11-19 21:09:50,965][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] IgniteConfiguration [igniteInstanceName=grid-1, pubPoolSize=24, svcPoolSize=24, callbackPoolSize=24, stripedPoolSize=24, sysPoolSize=24, mgmtPoolSize=4, dataStreamerPoolSize=24, utilityCachePoolSize=24, utilityCacheKeepAliveTime=60000, p2pPoolSize=2, qryPoolSize=24, buildIdxPoolSize=4, igniteHome=/opt/buildagent/work/7bc1c54bc719b67c, igniteWorkDir=/opt/buildagent/work/7bc1c54bc719b67c/work, mbeanSrv=com.sun.jmx.mbeanserver.JmxMBeanServer@6fe85038, nodeId=107c1eca-eeb4-4ea1-a55f-a4fba30f4001, marsh=BinaryMarshaller [], marshLocJobs=false, daemon=false, p2pEnabled=true, netTimeout=10000, netCompressionLevel=1, sndRetryDelay=1000, sndRetryCnt=3, metricsHistSize=10000, metricsUpdateFreq=1000, metricsExpTime=9223372036854775807, discoSpi=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=0, ackTimeout=0, marsh=null, reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], segPlc=STOP, segResolveAttempts=2, waitForSegOnStart=true, allResolversPassReq=true, segChkFreq=10000, commSpi=TcpCommunicationSpi [connectGate=org.apache.ignite.spi.communication.tcp.internal.ConnectGateway@4a935be, ctxInitLatch=java.util.concurrent.CountDownLatch@6bdfd704[Count = 1], stopping=false, clientPool=null, nioSrvWrapper=null, stateProvider=null], evtSpi=MemoryEventStorageSpi [expireAgeMs=9223372036854775807, expireCnt=10000, filter=null], colSpi=NoopCollisionSpi [], deploySpi=LocalDeploymentSpi [], indexingSpi=org.apache.ignite.spi.indexing.noop.NoopIndexingSpi@4c594e06, addrRslvr=null, encryptionSpi=org.apache.ignite.spi.encryption.keystore.KeystoreEncryptionSpi@63d02834, tracingSpi=org.apache.ignite.spi.tracing.NoopTracingSpi@67875947, clientMode=false, rebalanceThreadPoolSize=4, rebalanceTimeout=10000, rebalanceBatchesPrefetchCnt=3, rebalanceThrottle=0, rebalanceBatchSize=524288, txCfg=TransactionConfiguration [txSerEnabled=false, dfltIsolation=REPEATABLE_READ, dfltConcurrency=PESSIMISTIC, dfltTxTimeout=0, txTimeoutOnPartitionMapExchange=0, deadlockTimeout=10000, pessimisticTxLogSize=0, pessimisticTxLogLinger=10000, tmLookupClsName=null, txManagerFactory=null, useJtaSync=false], cacheSanityCheckEnabled=true, discoStartupDelay=60000, deployMode=SHARED, p2pMissedCacheSize=100, locHost=127.0.0.1, timeSrvPortBase=31100, timeSrvPortRange=100, failureDetectionTimeout=10000, sysWorkerBlockedTimeout=null, clientFailureDetectionTimeout=10000, metricsLogFreq=0, connectorCfg=null, odbcCfg=null, warmupClos=null, atomicCfg=AtomicConfiguration [seqReserveSize=1000, cacheMode=PARTITIONED, backups=1, aff=null, grpName=null], classLdr=null, sslCtxFactory=null, platformCfg=null, binaryCfg=null, memCfg=null, pstCfg=null, dsCfg=DataStorageConfiguration [sysRegionInitSize=41943040, sysRegionMaxSize=104857600, pageSize=4096, concLvl=0, dfltDataRegConf=DataRegionConfiguration [name=default, maxSize=10485760, initSize=268435456, swapPath=null, pageEvictionMode=DISABLED, pageReplacementMode=CLOCK, evictionThreshold=0.9, emptyPagesPoolSize=100, metricsEnabled=false, metricsSubIntervalCount=5, metricsRateTimeInterval=60000, persistenceEnabled=true, checkpointPageBufSize=0, lazyMemoryAllocation=true, warmUpCfg=null], dataRegions=null, storagePath=null, checkpointFreq=180000, lockWaitTime=10000, checkpointThreads=4, checkpointWriteOrder=SEQUENTIAL, walHistSize=20, maxWalArchiveSize=1073741824, walSegments=10, walSegmentSize=67108864, walPath=db/wal, walArchivePath=db/wal/archive, cdcWalPath=db/wal/cdc, cdcEnabled=false, metricsEnabled=false, walMode=FSYNC, walTlbSize=131072, walBuffSize=0, walFlushFreq=2000, walFsyncDelay=1000, walRecordIterBuffSize=67108864, alwaysWriteFullPages=false, fileIOFactory=org.apache.ignite.internal.processors.cache.persistence.file.AsyncFileIOFactory@6f8f5229, metricsSubIntervalCnt=5, metricsRateTimeInterval=60000, walAutoArchiveAfterInactivity=-1, walForceArchiveTimeout=-1, writeThrottlingEnabled=false, walCompactionEnabled=false, walCompactionLevel=1, checkpointReadLockTimeout=null, walPageCompression=DISABLED, walPageCompressionLevel=null, dfltWarmUpCfg=null, encCfg=org.apache.ignite.configuration.EncryptionConfiguration@796839c1, defragmentationThreadPoolSize=4, minWalArchiveSize=-1], snapshotPath=snapshots, activeOnStart=true, activeOnStartPropSetFlag=false, autoActivation=true, autoActivationPropSetFlag=false, clusterStateOnStart=null, sqlConnCfg=null, cliConnCfg=ClientConnectorConfiguration [host=null, port=10800, portRange=100, sockSndBufSize=0, sockRcvBufSize=0, tcpNoDelay=true, maxOpenCursorsPerConn=128, threadPoolSize=24, selectorCnt=12, idleTimeout=0, handshakeTimeout=10000, jdbcEnabled=true, odbcEnabled=true, thinCliEnabled=true, sslEnabled=false, useIgniteSslCtxFactory=true, sslClientAuth=false, sslCtxFactory=null, thinCliCfg=ThinClientConfiguration [maxActiveTxPerConn=100, maxActiveComputeTasksPerConn=0]], mvccVacuumThreadCnt=2, mvccVacuumFreq=5000, authEnabled=false, failureHnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]], commFailureRslvr=null, sqlCfg=SqlConfiguration [longQryWarnTimeout=3000, dfltQryTimeout=0, sqlQryHistSize=1000, validationEnabled=false], asyncContinuationExecutor=null] [21:09:50] : [Step 4/5] [2021-11-19 21:09:50,972][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] Daemon mode: off [21:09:50] : [Step 4/5] [2021-11-19 21:09:50,972][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] OS: Linux 4.15.0-151-generic amd64 [21:09:50] : [Step 4/5] [2021-11-19 21:09:50,973][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] OS user: teamcity [21:09:50] : [Step 4/5] [2021-11-19 21:09:50,973][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] PID: 16724 [21:09:50] : [Step 4/5] [2021-11-19 21:09:50,973][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] Language runtime: Java Platform API Specification ver. 1.8 [21:09:50] : [Step 4/5] [2021-11-19 21:09:50,973][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] VM information: Java(TM) SE Runtime Environment 1.8.0_261-b12 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 25.261-b12 [21:09:50] : [Step 4/5] [2021-11-19 21:09:50,974][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] VM total memory: 1.9GB [21:09:50] : [Step 4/5] [2021-11-19 21:09:50,974][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] Remote Management [restart: off, REST: off, JMX (remote: off)] [21:09:50] : [Step 4/5] [2021-11-19 21:09:50,974][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] Logger: GridTestLog4jLogger [quiet=false, config=null] [21:09:50] : [Step 4/5] [2021-11-19 21:09:50,974][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] IGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c [21:09:50] : [Step 4/5] [2021-11-19 21:09:50,974][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] VM arguments: [-DIGNITE_DUMP_THREADS_ON_FAILURE=false, -DMono=/usr/bin/mono-sgen, -DMono4.0_x64=/usr/lib/mono/4.0, -DMono4.5_x64=/usr/lib/mono/4.5, -DMonoVersion=6.12.0.90, -DSKIP_BUILD=false, -Dagent.home.dir=/opt/buildagent, -Dagent.name=aitc-lin02_03, -Dagent.ownPort=9090, -Dagent.work.dir=/opt/buildagent/work, -Dbuild.number=95, -Dbuild.vcs.number=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.1=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.GitHubApacheIgnite=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dclassworlds.conf=/opt/buildagent/temp/buildTmp/teamcity.m2.conf, -Dcom.jetbrains.maven.watcher.report.file=/opt/buildagent/temp/buildTmp/maven-build-info.xml, -Djava.io.tmpdir=/opt/buildagent/temp/buildTmp, -Dmaven.home=/opt/buildagent/tools/maven3_6, -Dmaven.multiModuleProjectDirectory=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.agent.cpuBenchmark=457, -Dteamcity.agent.dotnet.agent_url=http://localhost:9090/RPC2, -Dteamcity.agent.dotnet.build_id=6278078, -Dteamcity.auth.password=*******, -Dteamcity.auth.userId=TeamCityBuildId=6278078, -Dteamcity.build.changedFiles.file=/opt/buildagent/temp/buildTmp/changedFiles6342607772318147725.txt, -Dteamcity.build.checkoutDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.build.id=6278078, -Dteamcity.build.properties.file=/opt/buildagent/temp/buildTmp/teamcity.build5164517880467851002.properties, -Dteamcity.build.tempDir=/opt/buildagent/temp/buildTmp, -Dteamcity.build.workingDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.buildConfName=Basic 3, -Dteamcity.buildType.id=IgniteTests24Java8_Basic3, -Dteamcity.configuration.properties.file=/opt/buildagent/temp/buildTmp/teamcity.config5591980786735343870.properties, -Dteamcity.maven.userSettings.path=/opt/buildagent/temp/buildTmp/maven_settings_585072866407032347.xml, -Dteamcity.maven.watcher.home=/opt/buildagent/plugins/mavenPlugin/maven-watcher-jdk16, -Dteamcity.projectName=Ignite Tests 2.x (JDK 8/11), -Dteamcity.runner.properties.file=/opt/buildagent/temp/buildTmp/teamcity.runner9098465561618137420.properties, -Dteamcity.tests.recentlyFailedTests.file=/opt/buildagent/temp/buildTmp/testsToRunFirst3891775683130404069.txt, -Dteamcity.version=2021.2 (build 99542), -ea, -Xms2g, -Xmx2g, -XX:+HeapDumpOnOutOfMemoryError, -DIGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_TEST_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_UPDATE_NOTIFIER=false, -DIGNITE_NO_DISCO_ORDER=true, -DIGNITE_PERFORMANCE_SUGGESTIONS_DISABLED=true, -Djava.net.preferIPv4Stack=true, -DTEST_SCALE_FACTOR=1.0, -DIGNITE_TEST_PROP_LOG4J_FILE=log4j-tc-test.xml, -DIGNITE_QUIET=false, -DIGNITE_MARSHAL_BUFFERS_RECHECK=1000, -Dmaven.repo.local=/opt/buildagent/.m2/repository] [21:09:50] : [Step 4/5] [2021-11-19 21:09:50,978][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] System cache's DataRegion size is configured to 40 MB. Use DataStorageConfiguration.systemRegionInitialSize property to change the setting. [21:09:50] : [Step 4/5] [2021-11-19 21:09:50,978][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] Configured caches [in 'sysMemPlc' dataRegion: ['ignite-sys-cache']] [21:09:50] : [Step 4/5] [2021-11-19 21:09:50,979][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] 3-rd party licenses can be found at: /opt/buildagent/work/7bc1c54bc719b67c/libs/licenses [21:09:50]W: [org.apache.ignite:ignite-core] [2021-11-19 21:09:50,978][WARN ][test-runner-#19013%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] Peer class loading is enabled (disable it in production for performance and deployment consistency reasons) [21:09:50] : [Step 4/5] [2021-11-19 21:09:50,982][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] Configured plugins: [21:09:50] : [Step 4/5] [2021-11-19 21:09:50,982][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] ^-- StanByClusterTestProvider 1.0 [21:09:50] : [Step 4/5] [2021-11-19 21:09:50,982][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:09:50] : [Step 4/5] [2021-11-19 21:09:50,983][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] [21:09:50] : [Step 4/5] [2021-11-19 21:09:50,983][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] ^-- PageMemory tracker plugin 1.0 [21:09:50] : [Step 4/5] [2021-11-19 21:09:50,983][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:09:50] : [Step 4/5] [2021-11-19 21:09:50,983][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] [21:09:50] : [Step 4/5] [2021-11-19 21:09:50,983][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] ^-- TestDistibutedConfigurationPlugin 1.0 [21:09:50] : [Step 4/5] [2021-11-19 21:09:50,984][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:09:50] : [Step 4/5] [2021-11-19 21:09:50,984][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] [21:09:50] : [Step 4/5] [2021-11-19 21:09:50,984][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] ^-- NodeValidationPluginProvider 1.0 [21:09:50] : [Step 4/5] [2021-11-19 21:09:50,984][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:09:50] : [Step 4/5] [2021-11-19 21:09:50,984][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] [21:09:50] : [Step 4/5] [2021-11-19 21:09:50,984][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][FailureProcessor] Configured failure handler: [hnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]]] [21:09:50] : [Step 4/5] [2021-11-19 21:09:50,996][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][TestRecordingCommunicationSpi] Successfully bound communication NIO server to TCP port [port=47101, locHost=/127.0.0.1, selectorsCnt=12, selectorSpins=0, pairedConn=false] [21:09:50]W: [org.apache.ignite:ignite-core] [2021-11-19 21:09:50,996][WARN ][test-runner-#19013%encryption.MasterKeyChangeTest%][TestRecordingCommunicationSpi] Message queue limit is set to 0 which may lead to potential OOMEs when running cache operations in FULL_ASYNC or PRIMARY_SYNC modes due to message queues growth on sender and receiver sides. [21:09:51] : [Step 4/5] [2021-11-19 21:09:50,999][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][GridCollisionManager] Collision resolution is disabled (all jobs will be activated upon arrival). [21:09:51] : [Step 4/5] [2021-11-19 21:09:51,000][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] Security status [authentication=off, sandbox=off, tls/ssl=off] [21:09:51] : [Step 4/5] [2021-11-19 21:09:51,055][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:09:51] : [Step 4/5] [2021-11-19 21:09:51,136][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][MaintenanceProcessor] Resolved store directory for node persistent data: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1 [21:09:51] : [Step 4/5] [2021-11-19 21:09:51,137][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][CacheObjectBinaryProcessorImpl] Resolved directory for serialized binary metadata: /opt/buildagent/work/7bc1c54bc719b67c/work/db/binary_meta/grid_1 [21:09:51] : [Step 4/5] [2021-11-19 21:09:51,141][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1 [21:09:51] : [Step 4/5] [2021-11-19 21:09:51,141][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][FileWriteAheadLogManager] Resolved write ahead log work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1 [21:09:51] : [Step 4/5] [2021-11-19 21:09:51,142][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][FileWriteAheadLogManager] Resolved write ahead log archive directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1 [21:09:51] : [Step 4/5] [2021-11-19 21:09:51,646][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000000.wal [21:09:51] : [Step 4/5] [2021-11-19 21:09:51,650][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Configured data regions initialized successfully [total=5] [21:09:51] : [Step 4/5] [2021-11-19 21:09:51,653][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][IgniteSnapshotManager] Resolved snapshot work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/snapshots [21:09:51] : [Step 4/5] [2021-11-19 21:09:51,654][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][IgniteSnapshotManager] Resolved temp directory for snapshot creation: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1/snp [21:09:51] : [Step 4/5] [2021-11-19 21:09:51,656][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][ClientListenerProcessor] Client connector processor has started on TCP port 10801 [21:09:51] : [Step 4/5] [2021-11-19 21:09:51,659][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] Non-loopback local IPs: 172.17.0.4 [21:09:51] : [Step 4/5] [2021-11-19 21:09:51,659][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] Enabled local MACs: 0242AC110004 [21:09:51] : [Step 4/5] [2021-11-19 21:09:51,660][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:09:51] : [Step 4/5] [2021-11-19 21:09:51,661][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:09:51] : [Step 4/5] [2021-11-19 21:09:51,661][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:09:51] : [Step 4/5] [2021-11-19 21:09:51,664][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Applying lost metastore updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:09:51] : [Step 4/5] [2021-11-19 21:09:51,665][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=0 ms] [21:09:51] : [Step 4/5] [2021-11-19 21:09:51,665][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][GridCacheProcessor] Restoring partition state for local groups. [21:09:51] : [Step 4/5] [2021-11-19 21:09:51,665][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=0, partitionsProcessed=0, time=0ms] [21:09:51] : [Step 4/5] [2021-11-19 21:09:51,666][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][GridEncryptionManager] Encryption keys loaded from metastore. [grps=, masterKeyName=ignite.master.key] [21:09:51] : [Step 4/5] [2021-11-19 21:09:51,667][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][ClusterProcessor] Cluster ID and tag has been read from metastorage: null [21:09:51] : [Step 4/5] [2021-11-19 21:09:51,668][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][IgniteClusterImpl] Shutdown policy was updated [oldVal=null, newVal=null] [21:09:51] : [Step 4/5] [2021-11-19 21:09:51,668][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Checkpoint frequency deviation changed [oldVal=null, newVal=null] [21:09:51] : [Step 4/5] [2021-11-19 21:09:51,678][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][FilePageStoreManager] Cleanup cache stores [total=1, left=0, cleanFiles=false] [21:09:51] : [Step 4/5] [2021-11-19 21:09:51,680][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:09:51] : [Step 4/5] [2021-11-19 21:09:51,681][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:09:51] : [Step 4/5] [2021-11-19 21:09:51,682][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:09:51] : [Step 4/5] [2021-11-19 21:09:51,683][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Data Regions Started: 5 [21:09:51] : [Step 4/5] [2021-11-19 21:09:51,683][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] ^-- sysMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:09:51] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:09:51] : [Step 4/5] ^-- default region [type=default, persistence=true, lazyAlloc=true, [21:09:51] : [Step 4/5] ... initCfg=10MB, maxCfg=10MB, usedRam=0MB, freeRam=100%, allocRam=0MB, allocTotal=0MB] [21:09:51] : [Step 4/5] ^-- metastoreMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:09:51] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:09:51] : [Step 4/5] ^-- TxLog region [type=internal, persistence=true, lazyAlloc=false, [21:09:51] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:09:51] : [Step 4/5] ^-- volatileDsMemPlc region [type=user, persistence=false, lazyAlloc=true, [21:09:51] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB] [21:09:51] : [Step 4/5] ^-- Ignite persistence [used=0MB] [21:09:51] : [Step 4/5] [21:09:51] : [Step 4/5] [2021-11-19 21:09:51,685][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Starting binary memory restore for: [-2100569601] [21:09:51] : [Step 4/5] [2021-11-19 21:09:51,693][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:09:51] : [Step 4/5] [2021-11-19 21:09:51,693][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:09:51] : [Step 4/5] [2021-11-19 21:09:51,694][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000000.wal, offset=0, ver=2] [21:09:51] : [Step 4/5] [2021-11-19 21:09:51,699][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][GridCacheProcessor] Started cache in recovery mode [name=ignite-sys-cache, id=-2100569601, dataRegionName=sysMemPlc, mode=REPLICATED, atomicity=TRANSACTIONAL, backups=2147483647, mvcc=false] [21:09:51] : [Step 4/5] [2021-11-19 21:09:51,700][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Binary recovery performed in 15 ms. [21:09:51] : [Step 4/5] [2021-11-19 21:09:51,700][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:09:51] : [Step 4/5] [2021-11-19 21:09:51,701][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Applying lost cache updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:09:51] : [Step 4/5] [2021-11-19 21:09:51,779][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=81 ms] [21:09:51] : [Step 4/5] [2021-11-19 21:09:51,780][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][GridCacheProcessor] Restoring partition state for local groups. [21:09:51] : [Step 4/5] [2021-11-19 21:09:51,785][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=1, partitionsProcessed=100, time=10ms] [21:09:52] : [Step 4/5] [2021-11-19 21:09:52,084][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][TestTcpDiscoverySpi] Successfully bound to TCP port [port=47501, localHost=localhost/127.0.0.1, locNodeId=107c1eca-eeb4-4ea1-a55f-a4fba30f4001] [21:09:52] : [Step 4/5] [2021-11-19 21:09:52,089][INFO ][tcp-disco-srvr-[:47500]-#1000%grid-0%-#19126%grid-0%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=51687] [21:09:52] : [Step 4/5] [2021-11-19 21:09:52,089][INFO ][tcp-disco-srvr-[:47500]-#1000%grid-0%-#19126%grid-0%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=51687] [21:09:52] : [Step 4/5] [2021-11-19 21:09:52,090][INFO ][tcp-disco-sock-reader-[]-#1006%grid-0%-#19245%grid-0%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:51687, rmtPort=51687] [21:09:52] : [Step 4/5] [2021-11-19 21:09:52,092][INFO ][tcp-disco-sock-reader-[107c1eca 127.0.0.1:51687]-#1006%grid-0%-#19245%grid-0%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=107c1eca-eeb4-4ea1-a55f-a4fba30f4001, rmtAddr=/127.0.0.1:51687] [21:09:52] : [Step 4/5] [2021-11-19 21:09:52,097][INFO ][tcp-disco-srvr-[:47501]-#1005%grid-1%-#19244%grid-1%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=57811] [21:09:52] : [Step 4/5] [2021-11-19 21:09:52,098][INFO ][tcp-disco-srvr-[:47501]-#1005%grid-1%-#19244%grid-1%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=57811] [21:09:52] : [Step 4/5] [2021-11-19 21:09:52,098][INFO ][tcp-disco-sock-reader-[]-#1007%grid-1%-#19246%grid-1%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:57811, rmtPort=57811] [21:09:52] : [Step 4/5] [2021-11-19 21:09:52,099][INFO ][tcp-disco-sock-reader-[]-#1007%grid-1%-#19246%grid-1%][TestTcpDiscoverySpi] Received ping request from the remote node [rmtNodeId=00f25b7e-9e72-4811-a52d-4f0fd1043000, rmtAddr=/127.0.0.1:57811, rmtPort=57811] [21:09:52] : [Step 4/5] [2021-11-19 21:09:52,101][INFO ][tcp-disco-sock-reader-[]-#1007%grid-1%-#19246%grid-1%][TestTcpDiscoverySpi] Finished writing ping response [rmtNodeId=00f25b7e-9e72-4811-a52d-4f0fd1043000, rmtAddr=/127.0.0.1:57811, rmtPort=57811] [21:09:52]W: [org.apache.ignite:ignite-core] [2021-11-19 21:09:52,101][WARN ][tcp-disco-sock-reader-[]-#1007%grid-1%-#19246%grid-1%][TestTcpDiscoverySpi] Failed to shutdown socket [21:09:52]W: [org.apache.ignite:ignite-core] java.net.SocketException: Socket output is already shutdown [21:09:52]W: [org.apache.ignite:ignite-core] at java.net.Socket.shutdownOutput(Socket.java:1572) [21:09:52]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.close(IgniteUtils.java:4247) [21:09:52]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.discovery.tcp.ServerImpl$SocketReader.body(ServerImpl.java:7370) [21:09:52]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.IgniteSpiThread.run(IgniteSpiThread.java:58) [21:09:52] : [Step 4/5] [2021-11-19 21:09:52,101][INFO ][tcp-disco-sock-reader-[107c1eca 127.0.0.1:51687]-#1006%grid-0%-#19245%grid-0%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:51687, rmtPort=51687, rmtNodeId=107c1eca-eeb4-4ea1-a55f-a4fba30f4001] [21:09:52] : [Step 4/5] [2021-11-19 21:09:52,102][INFO ][tcp-disco-sock-reader-[]-#1007%grid-1%-#19246%grid-1%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:57811, rmtPort=57811, rmtNodeId=null] [21:09:52] : [Step 4/5] [2021-11-19 21:09:52,104][INFO ][tcp-disco-msg-worker-[crd]-#999%grid-0%-#19125%grid-0%][GridEncryptionManager] Joining node doesn't have stored group keys [node=107c1eca-eeb4-4ea1-a55f-a4fba30f4001] [21:09:52] : [Step 4/5] [2021-11-19 21:09:52,114][INFO ][tcp-disco-msg-worker-[crd]-#999%grid-0%-#19125%grid-0%][TestTcpDiscoverySpi] New next node [newNext=TcpDiscoveryNode [id=107c1eca-eeb4-4ea1-a55f-a4fba30f4001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=0, intOrder=2, lastExchangeTime=1637345392088, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false]] [21:09:52] : [Step 4/5] [2021-11-19 21:09:52,115][INFO ][tcp-disco-srvr-[:47501]-#1005%grid-1%-#19244%grid-1%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=46009] [21:09:52] : [Step 4/5] [2021-11-19 21:09:52,115][INFO ][tcp-disco-srvr-[:47501]-#1005%grid-1%-#19244%grid-1%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=46009] [21:09:52] : [Step 4/5] [2021-11-19 21:09:52,116][INFO ][tcp-disco-sock-reader-[]-#1008%grid-1%-#19247%grid-1%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:46009, rmtPort=46009] [21:09:52] : [Step 4/5] [2021-11-19 21:09:52,117][INFO ][tcp-disco-sock-reader-[00f25b7e 127.0.0.1:46009]-#1008%grid-1%-#19247%grid-1%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=00f25b7e-9e72-4811-a52d-4f0fd1043000, rmtAddr=/127.0.0.1:46009] [21:09:52] : [Step 4/5] [2021-11-19 21:09:52,120][INFO ][tcp-disco-msg-worker-[]-#1004%grid-1%-#19243%grid-1%][TestTcpDiscoverySpi] New next node [newNext=TcpDiscoveryNode [id=00f25b7e-9e72-4811-a52d-4f0fd1043000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345392118, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false]] [21:09:52] : [Step 4/5] [2021-11-19 21:09:52,121][INFO ][tcp-disco-srvr-[:47500]-#1000%grid-0%-#19126%grid-0%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=41109] [21:09:52] : [Step 4/5] [2021-11-19 21:09:52,121][INFO ][tcp-disco-srvr-[:47500]-#1000%grid-0%-#19126%grid-0%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=41109] [21:09:52] : [Step 4/5] [2021-11-19 21:09:52,122][INFO ][tcp-disco-sock-reader-[]-#1009%grid-0%-#19248%grid-0%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:41109, rmtPort=41109] [21:09:52] : [Step 4/5] [2021-11-19 21:09:52,123][INFO ][tcp-disco-sock-reader-[107c1eca 127.0.0.1:41109]-#1009%grid-0%-#19248%grid-0%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=107c1eca-eeb4-4ea1-a55f-a4fba30f4001, rmtAddr=/127.0.0.1:41109] [21:09:52] : [Step 4/5] [2021-11-19 21:09:52,125][INFO ][disco-event-worker-#19128%grid-0%][GridDiscoveryManager] Added new node to topology: TcpDiscoveryNode [id=107c1eca-eeb4-4ea1-a55f-a4fba30f4001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637345392088, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false] [21:09:52] : [Step 4/5] [2021-11-19 21:09:52,126][INFO ][disco-event-worker-#19128%grid-0%][GridDiscoveryManager] Topology snapshot [ver=2, locNode=00f25b7e, servers=2, clients=0, state=INACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=00f25b7e-9e72-4811-a52d-4f0fd1043000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=107c1eca-eeb4-4ea1-a55f-a4fba30f4001, consistentId=grid-1, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:09:52] : [Step 4/5] [2021-11-19 21:09:52,128][INFO ][tcp-disco-msg-worker-[00f25b7e 127.0.0.1:47500]-#1004%grid-1%-#19243%grid-1%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustEnabled' was changed from 'null' to 'false' [21:09:52] : [Step 4/5] [2021-11-19 21:09:52,128][INFO ][tcp-disco-msg-worker-[00f25b7e 127.0.0.1:47500]-#1004%grid-1%-#19243%grid-1%][ClusterProcessor] kind_golick [21:09:52] : [Step 4/5] [2021-11-19 21:09:52,128][INFO ][tcp-disco-msg-worker-[00f25b7e 127.0.0.1:47500]-#1004%grid-1%-#19243%grid-1%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustTimeout' was changed from 'null' to '300000' [21:09:52] : [Step 4/5] [2021-11-19 21:09:52,128][INFO ][tcp-disco-msg-worker-[00f25b7e 127.0.0.1:47500]-#1004%grid-1%-#19243%grid-1%][IgniteTxManager] Transactions parameter 'longOperationsDumpTimeout' was changed from 'null' to '60000' [21:09:52] : [Step 4/5] [2021-11-19 21:09:52,129][INFO ][tcp-disco-msg-worker-[00f25b7e 127.0.0.1:47500]-#1004%grid-1%-#19243%grid-1%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpThreshold' was changed from 'null' to '0' [21:09:52] : [Step 4/5] [2021-11-19 21:09:52,129][INFO ][tcp-disco-msg-worker-[00f25b7e 127.0.0.1:47500]-#1004%grid-1%-#19243%grid-1%][IgniteTxManager] Transactions parameter 'transactionTimeDumpSamplesCoefficient' was changed from 'null' to '0.0' [21:09:52] : [Step 4/5] [2021-11-19 21:09:52,130][INFO ][tcp-disco-msg-worker-[00f25b7e 127.0.0.1:47500]-#1004%grid-1%-#19243%grid-1%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpSamplesPerSecondLimit' was changed from 'null' to '5' [21:09:52] : [Step 4/5] [2021-11-19 21:09:52,130][INFO ][tcp-disco-msg-worker-[00f25b7e 127.0.0.1:47500]-#1004%grid-1%-#19243%grid-1%][IgniteTxManager] Transactions parameter 'collisionsDumpInterval' was changed from 'null' to '1000' [21:09:52] : [Step 4/5] [2021-11-19 21:09:52,130][INFO ][tcp-disco-msg-worker-[00f25b7e 127.0.0.1:47500]-#1004%grid-1%-#19243%grid-1%][IgniteTxManager] Transactions parameter 'txOwnerDumpRequestsAllowed' was changed from 'null' to 'true' [21:09:52] : [Step 4/5] [2021-11-19 21:09:52,131][INFO ][tcp-disco-msg-worker-[00f25b7e 127.0.0.1:47500]-#1004%grid-1%-#19243%grid-1%][GridCacheDatabaseSharedManager] Historical rebalance WAL threshold changed [property=historical.rebalance.threshold, oldVal=null, newVal=500] [21:09:52] : [Step 4/5] [2021-11-19 21:09:52,131][INFO ][disco-notifier-worker-#19242%grid-1%][MvccProcessorImpl] Assigned mvcc coordinator [crd=MvccCoordinator [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=0], nodeId=00f25b7e-9e72-4811-a52d-4f0fd1043000, ver=1637345390937, local=false, initialized=false]] [21:09:52] : [Step 4/5] [2021-11-19 21:09:52,132][INFO ][sys-#19220%grid-1%][ClusterProcessor] Writing cluster ID and tag to metastorage on ready for write ClusterIdAndTag [id=f9f004b4-3864-44de-b14d-12acab81f510, tag=kind_golick] [21:09:52] : [Step 4/5] [2021-11-19 21:09:52,146][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] To start Console Management & Monitoring run ignitevisorcmd.{sh|bat} [21:09:52] : [Step 4/5] [2021-11-19 21:09:52,146][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] [21:09:52] : [Step 4/5] [21:09:52] : [Step 4/5] >>> +-------------------------------------------+ [21:09:52] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:09:52] : [Step 4/5] >>> +-------------------------------------------+ [21:09:52] : [Step 4/5] >>> OS name: Linux 4.15.0-151-generic amd64 [21:09:52] : [Step 4/5] >>> CPU(s): 24 [21:09:52] : [Step 4/5] >>> Heap: 2.0GB [21:09:52] : [Step 4/5] >>> VM name: 16724@c4dfe9a430b2 [21:09:52] : [Step 4/5] >>> Ignite instance name: grid-1 [21:09:52] : [Step 4/5] >>> Local node [ID=107C1ECA-EEB4-4EA1-A55F-A4FBA30F4001, order=2, clientMode=false] [21:09:52] : [Step 4/5] >>> Local node addresses: [127.0.0.1] [21:09:52] : [Step 4/5] >>> Local ports: TCP:10801 TCP:47101 TCP:47501 [21:09:52] : [Step 4/5] [21:09:52] : [Step 4/5] [2021-11-19 21:09:52,147][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] >>> Ignite cluster is in INACTIVE state (limited functionality available). Use control.(sh|bat) script or IgniteCluster.state(ClusterState.ACTIVE) to change the state. [21:09:52] : [Step 4/5] [2021-11-19 21:09:52,147][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][GridDiscoveryManager] Topology snapshot [ver=2, locNode=107c1eca, servers=2, clients=0, state=INACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=00f25b7e-9e72-4811-a52d-4f0fd1043000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=107c1eca-eeb4-4ea1-a55f-a4fba30f4001, consistentId=grid-1, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:09:52] : [Step 4/5] [2021-11-19 21:09:52,148][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][G] Node started : [stage="Configure system pool" (0 ms),stage="Start managers" (172 ms),stage="Configure binary metadata" (2 ms),stage="Start processors" (519 ms),stage="Start 'StanByClusterTestProvider' plugin" (0 ms),stage="Start 'PageMemory tracker plugin' plugin" (0 ms),stage="Start 'TestDistibutedConfigurationPlugin' plugin" (0 ms),stage="Start 'NodeValidationPluginProvider' plugin" (0 ms),stage="Init metastore" (19 ms),stage="Init and start regions" (6 ms),stage="Restore binary memory" (15 ms),stage="Restore logical state" (85 ms),stage="Finish recovery" (296 ms),stage="Join topology" (49 ms),stage="Await transition" (2 ms),stage="Await exchange" (13 ms),stage="Total time" (1178 ms)] [21:09:52] : [Step 4/5] [2021-11-19 21:09:52,149][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][root] Node started with the following configuration [id=107c1eca-eeb4-4ea1-a55f-a4fba30f4001, marshaller=BinaryMarshaller [], discovery=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=5000, ackTimeout=5000, marsh=JdkMarshaller [clsFilter=org.apache.ignite.marshaller.MarshallerUtils$1@3cde7aa3], reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], binaryCfg=null, lateAff=true] [21:09:52] : [Step 4/5] [2021-11-19 21:09:52,152][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][GridClusterStateProcessor] Sending activate cluster request with BaselineTopology BaselineTopology [id=0, branchingHash=-2475315501, branchingType='New BaselineTopology', baselineNodes=[grid-1, grid-0]] [21:09:52] : [Step 4/5] [2021-11-19 21:09:52,156][INFO ][disco-notifier-worker-#19124%grid-0%][GridClusterStateProcessor] Received activate cluster request with BaselineTopology[id=0] initiator node ID: 00f25b7e-9e72-4811-a52d-4f0fd1043000 [21:09:52] : [Step 4/5] [2021-11-19 21:09:52,156][INFO ][disco-notifier-worker-#19124%grid-0%][GridClusterStateProcessor] Started state transition: activate cluster [21:09:52] : [Step 4/5] [2021-11-19 21:09:52,157][INFO ][exchange-worker-#19129%grid-0%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], crd=true, evt=DISCOVERY_CUSTOM_EVT, evtNode=00f25b7e-9e72-4811-a52d-4f0fd1043000, customEvt=ChangeGlobalStateMessage [id=6057d593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqId=b5132ad6-0059-4953-af2c-3ad1212476cd, initiatingNodeId=00f25b7e-9e72-4811-a52d-4f0fd1043000, state=ACTIVE, baselineTopology=BaselineTopology [id=0, branchingHash=-2475315501, branchingType='New BaselineTopology', baselineNodes=[grid-1, grid-0]], forceChangeBaselineTopology=false, timestamp=1637345392152, forceDeactivation=true], allowMerge=false, exchangeFreeSwitch=false] [21:09:52] : [Step 4/5] [2021-11-19 21:09:52,157][INFO ][disco-notifier-worker-#19242%grid-1%][GridClusterStateProcessor] Received activate cluster request with BaselineTopology[id=0] initiator node ID: 00f25b7e-9e72-4811-a52d-4f0fd1043000 [21:09:52] : [Step 4/5] [2021-11-19 21:09:52,159][INFO ][disco-notifier-worker-#19242%grid-1%][GridClusterStateProcessor] Started state transition: activate cluster [21:09:52] : [Step 4/5] [2021-11-19 21:09:52,158][INFO ][exchange-worker-#19129%grid-0%][GridDhtPartitionsExchangeFuture] Start activation process [nodeId=00f25b7e-9e72-4811-a52d-4f0fd1043000, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]]. New state: ACTIVE [21:09:52] : [Step 4/5] [2021-11-19 21:09:52,159][INFO ][exchange-worker-#19251%grid-1%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], crd=false, evt=DISCOVERY_CUSTOM_EVT, evtNode=00f25b7e-9e72-4811-a52d-4f0fd1043000, customEvt=ChangeGlobalStateMessage [id=6057d593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqId=b5132ad6-0059-4953-af2c-3ad1212476cd, initiatingNodeId=00f25b7e-9e72-4811-a52d-4f0fd1043000, state=ACTIVE, baselineTopology=BaselineTopology [id=0, branchingHash=-2475315501, branchingType='New BaselineTopology', baselineNodes=[grid-1, grid-0]], forceChangeBaselineTopology=false, timestamp=1637345392152, forceDeactivation=true], allowMerge=false, exchangeFreeSwitch=false] [21:09:52] : [Step 4/5] [2021-11-19 21:09:52,159][INFO ][exchange-worker-#19129%grid-0%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0 [21:09:52] : [Step 4/5] [2021-11-19 21:09:52,160][INFO ][exchange-worker-#19251%grid-1%][GridDhtPartitionsExchangeFuture] Start activation process [nodeId=107c1eca-eeb4-4ea1-a55f-a4fba30f4001, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]]. New state: ACTIVE [21:09:52] : [Step 4/5] [2021-11-19 21:09:52,162][INFO ][exchange-worker-#19251%grid-1%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1 [21:09:52] : [Step 4/5] [2021-11-19 21:09:52,165][INFO ][exchange-worker-#19129%grid-0%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000000.wal, offset=8713, ver=2] [21:09:52] : [Step 4/5] [2021-11-19 21:09:52,165][INFO ][exchange-worker-#19251%grid-1%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000000.wal, offset=8713, ver=2] [21:09:52] : [Step 4/5] [2021-11-19 21:09:52,166][INFO ][exchange-worker-#19129%grid-0%][GridClusterStateProcessor] Writing BaselineTopology[id=0] [21:09:52] : [Step 4/5] [2021-11-19 21:09:52,168][INFO ][exchange-worker-#19251%grid-1%][GridClusterStateProcessor] Writing BaselineTopology[id=0] [21:09:52] : [Step 4/5] [2021-11-19 21:09:52,172][INFO ][exchange-worker-#19251%grid-1%][GridCacheDatabaseSharedManager] Finish recovery performed in 9 ms. [21:09:52] : [Step 4/5] [2021-11-19 21:09:52,173][INFO ][exchange-worker-#19251%grid-1%][msg] Components activation performed in 11 ms. [21:09:52] : [Step 4/5] [2021-11-19 21:09:52,173][INFO ][exchange-worker-#19129%grid-0%][GridCacheDatabaseSharedManager] Finish recovery performed in 11 ms. [21:09:52] : [Step 4/5] [2021-11-19 21:09:52,174][INFO ][exchange-worker-#19129%grid-0%][msg] Components activation performed in 15 ms. [21:09:52] : [Step 4/5] [2021-11-19 21:09:52,175][INFO ][exchange-worker-#19251%grid-1%][GridCacheProcessor] Finished recovery for cache [cache=ignite-sys-cache, grp=ignite-sys-cache, startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:09:52] : [Step 4/5] [2021-11-19 21:09:52,175][INFO ][exchange-worker-#19129%grid-0%][GridCacheProcessor] Finished recovery for cache [cache=ignite-sys-cache, grp=ignite-sys-cache, startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:09:52] : [Step 4/5] [2021-11-19 21:09:52,175][INFO ][exchange-worker-#19251%grid-1%][GridDhtPartitionsExchangeFuture] Successfully activated caches [nodeId=107c1eca-eeb4-4ea1-a55f-a4fba30f4001, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], newState=ACTIVE] [21:09:52] : [Step 4/5] [2021-11-19 21:09:52,176][INFO ][exchange-worker-#19129%grid-0%][GridDhtPartitionsExchangeFuture] Successfully activated caches [nodeId=00f25b7e-9e72-4811-a52d-4f0fd1043000, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], newState=ACTIVE] [21:09:52] : [Step 4/5] [2021-11-19 21:09:52,176][INFO ][exchange-worker-#19251%grid-1%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:09:52] : [Step 4/5] [2021-11-19 21:09:52,176][INFO ][exchange-worker-#19129%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:09:52] : [Step 4/5] [2021-11-19 21:09:52,187][INFO ][exchange-worker-#19129%grid-0%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], crd=true] [21:09:52] : [Step 4/5] [2021-11-19 21:09:52,190][INFO ][db-checkpoint-thread-#19260%grid-0%][Checkpointer] Checkpoint started [checkpointId=eed157b5-3499-42b4-8912-66c001f04117, startPtr=WALPointer [idx=0, fileOff=81472, len=1963], checkpointBeforeLockTime=1ms, checkpointLockWait=2ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=0ms, writeCheckpointEntryDuration=3ms, splitAndSortCpPagesDuration=0ms, pages=19, reason='node started'] [21:09:52] : [Step 4/5] [2021-11-19 21:09:52,191][INFO ][grid-nio-worker-tcp-comm-0-#19068%TestRecordingCommunicationSpi%][TestRecordingCommunicationSpi] Accepted incoming communication connection [locAddr=/127.0.0.1:47100, rmtAddr=/127.0.0.1:59552] [21:09:52] : [Step 4/5] [2021-11-19 21:09:52,195][INFO ][grid-nio-worker-tcp-comm-0-#19186%TestRecordingCommunicationSpi%][TestRecordingCommunicationSpi] Established outgoing communication connection [locAddr=/127.0.0.1:59552, rmtAddr=/127.0.0.1:47100] [21:09:52] : [Step 4/5] [2021-11-19 21:09:52,195][INFO ][exchange-worker-#19251%grid-1%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], crd=false] [21:09:52] : [Step 4/5] [2021-11-19 21:09:52,197][INFO ][sys-#19100%grid-0%][GridDhtPartitionsExchangeFuture] Coordinator received single message [ver=AffinityTopologyVersion [topVer=2, minorTopVer=1], node=107c1eca-eeb4-4ea1-a55f-a4fba30f4001, allReceived=true] [21:09:52] : [Step 4/5] [2021-11-19 21:09:52,198][INFO ][sys-#19100%grid-0%][GridDhtPartitionsExchangeFuture] finishExchangeOnCoordinator [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:09:52] : [Step 4/5] [2021-11-19 21:09:52,199][INFO ][db-checkpoint-thread-#19265%grid-1%][Checkpointer] Checkpoint started [checkpointId=0ad28c16-6bf9-4a4e-8820-6892becdf98c, startPtr=WALPointer [idx=0, fileOff=83425, len=1963], checkpointBeforeLockTime=1ms, checkpointLockWait=1ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=2ms, writeCheckpointEntryDuration=10ms, splitAndSortCpPagesDuration=0ms, pages=19, reason='node started'] [21:09:52] : [Step 4/5] [2021-11-19 21:09:52,206][INFO ][sys-#19100%grid-0%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], err=null, rebalanced=true, wasRebalanced=false] [21:09:52] : [Step 4/5] [2021-11-19 21:09:52,207][INFO ][sys-#19229%grid-1%][GridDhtPartitionsExchangeFuture] Received full message, will finish exchange [node=00f25b7e-9e72-4811-a52d-4f0fd1043000, resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:09:52] : [Step 4/5] [2021-11-19 21:09:52,206][INFO ][disco-notifier-worker-#19124%grid-0%][GridClusterStateProcessor] Received state change finish message: ACTIVE [21:09:52] : [Step 4/5] [2021-11-19 21:09:52,209][INFO ][disco-notifier-worker-#19124%grid-0%][GridClusterStateProcessor] Cluster state was changed from INACTIVE to ACTIVE [21:09:52] : [Step 4/5] [2021-11-19 21:09:52,208][INFO ][disco-notifier-worker-#19242%grid-1%][GridClusterStateProcessor] Received state change finish message: ACTIVE [21:09:52] : [Step 4/5] [2021-11-19 21:09:52,214][INFO ][disco-notifier-worker-#19242%grid-1%][GridClusterStateProcessor] Cluster state was changed from INACTIVE to ACTIVE [21:09:52] : [Step 4/5] [2021-11-19 21:09:52,214][INFO ][sys-#19229%grid-1%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], err=null, rebalanced=true, wasRebalanced=false] [21:09:52] : [Step 4/5] [2021-11-19 21:09:52,214][INFO ][sys-#19100%grid-0%][GridCacheProcessor] Finish proxy initialization, cacheName=ignite-sys-cache, localNodeId=00f25b7e-9e72-4811-a52d-4f0fd1043000 [21:09:52] : [Step 4/5] [2021-11-19 21:09:52,209][INFO ][sys-#19235%grid-1%][GridCachePartitionExchangeManager] Delay process full message without exchange id (there is exchange in progress) [nodeId=00f25b7e-9e72-4811-a52d-4f0fd1043000] [21:09:52] : [Step 4/5] [2021-11-19 21:09:52,216][INFO ][sys-#19100%grid-0%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=00f25b7e-9e72-4811-a52d-4f0fd1043000, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=00f25b7e-9e72-4811-a52d-4f0fd1043000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345392214, loc=true, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:09:52] : [Step 4/5] [2021-11-19 21:09:52,217][INFO ][sys-#19100%grid-0%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (1 ms), stage="Update caches registry" (16 ms), stage="Start caches" (0 ms), stage="Affinity initialization on cache group start" (0 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Restore partition states" (0 ms), stage="After states restored callback" (9 ms), stage="WAL history reservation" (0 ms), stage="Waiting for all single messages" (11 ms), stage="Affinity recalculation (crd)" (0 ms), stage="Collect update counters and create affinity messages" (0 ms), stage="Assign partitions states" (0 ms), stage="Validate partitions states" (0 ms), stage="Ideal affinity diff calculation (enforced)" (0 ms), stage="Apply update counters" (0 ms), stage="Full message preparing" (5 ms), stage="Full message sending" (0 ms), stage="State finish message sending" (0 ms), stage="Detect lost partitions" (2 ms), stage="Exchange done" (8 ms), stage="Total time" (52 ms), Discovery lag=2 ms, Latest started node id=107c1eca-eeb4-4ea1-a55f-a4fba30f4001] [21:09:52] : [Step 4/5] [2021-11-19 21:09:52,216][INFO ][exchange-worker-#19129%grid-0%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=2, minorTopVer=1], force=false, evt=DISCOVERY_CUSTOM_EVT, node=00f25b7e-9e72-4811-a52d-4f0fd1043000] [21:09:52] : [Step 4/5] [2021-11-19 21:09:52,216][INFO ][sys-#19104%grid-0%][DistributedBaselineConfiguration] Baseline auto-adjust is 'disabled' with timeout='300000' ms [21:09:52] : [Step 4/5] [2021-11-19 21:09:52,219][INFO ][sys-#19100%grid-0%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], stage="Affinity initialization on cache group start [grp=ignite-sys-cache]" (0 ms) (parent=Affinity initialization on cache group start), stage="Affinity centralized initialization (crd) [grp=ignite-sys-cache, crd=true]" (0 ms) (parent=Determine exchange type), stage="Restore partition states [grp=ignite-sys-cache]" (0 ms) (parent=Restore partition states), stage="Affinity recalculation (partitions availability) [grp=ignite-sys-cache]" (0 ms) (parent=Ideal affinity diff calculation (enforced))] [21:09:52] : [Step 4/5] [2021-11-19 21:09:52,217][INFO ][db-checkpoint-thread-#19260%grid-0%][Checkpointer] Checkpoint finished [cpId=eed157b5-3499-42b4-8912-66c001f04117, pages=19, markPos=WALPointer [idx=0, fileOff=81472, len=1963], walSegmentsCovered=[], markDuration=5ms, pagesWrite=4ms, fsync=22ms, total=34ms] [21:09:52] : [Step 4/5] [2021-11-19 21:09:52,217][INFO ][sys-#19229%grid-1%][GridCacheProcessor] Finish proxy initialization, cacheName=ignite-sys-cache, localNodeId=107c1eca-eeb4-4ea1-a55f-a4fba30f4001 [21:09:52] : [Step 4/5] [2021-11-19 21:09:52,220][INFO ][sys-#19104%grid-0%][GridClusterStateProcessor] Successfully performed final activation steps [nodeId=00f25b7e-9e72-4811-a52d-4f0fd1043000, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:09:52] : [Step 4/5] [2021-11-19 21:09:52,224][INFO ][exchange-worker-#19251%grid-1%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=2, minorTopVer=1], force=false, evt=DISCOVERY_CUSTOM_EVT, node=00f25b7e-9e72-4811-a52d-4f0fd1043000] [21:09:52] : [Step 4/5] [2021-11-19 21:09:52,224][INFO ][sys-#19239%grid-1%][DistributedBaselineConfiguration] Baseline auto-adjust is 'disabled' with timeout='300000' ms [21:09:52] : [Step 4/5] [2021-11-19 21:09:52,228][INFO ][db-checkpoint-thread-#19265%grid-1%][Checkpointer] Checkpoint finished [cpId=0ad28c16-6bf9-4a4e-8820-6892becdf98c, pages=19, markPos=WALPointer [idx=0, fileOff=83425, len=1963], walSegmentsCovered=[], markDuration=14ms, pagesWrite=4ms, fsync=23ms, total=43ms] [21:09:52] : [Step 4/5] [2021-11-19 21:09:52,224][INFO ][sys-#19229%grid-1%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=107c1eca-eeb4-4ea1-a55f-a4fba30f4001, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=00f25b7e-9e72-4811-a52d-4f0fd1043000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345392118, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:09:52] : [Step 4/5] [2021-11-19 21:09:52,230][INFO ][sys-#19229%grid-1%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (1 ms), stage="Update caches registry" (13 ms), stage="Start caches" (0 ms), stage="Affinity initialization on cache group start" (0 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Restore partition states" (0 ms), stage="After states restored callback" (10 ms), stage="WAL history reservation" (0 ms), stage="Waiting for Full message" (19 ms), stage="Affinity recalculation" (1 ms), stage="Full map updating" (5 ms), stage="Detect lost partitions" (2 ms), stage="Exchange done" (13 ms), stage="Total time" (64 ms)] [21:09:52] : [Step 4/5] [2021-11-19 21:09:52,228][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][root] awaitPartitionMapExchange finished [21:09:52] : [Step 4/5] [2021-11-19 21:09:52,228][INFO ][sys-#19239%grid-1%][GridClusterStateProcessor] Successfully performed final activation steps [nodeId=107c1eca-eeb4-4ea1-a55f-a4fba30f4001, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:09:52] : [Step 4/5] [2021-11-19 21:09:52,232][INFO ][sys-#19229%grid-1%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], stage="Affinity initialization on cache group start [grp=ignite-sys-cache]" (0 ms) (parent=Affinity initialization on cache group start), stage="Affinity centralized initialization (crd) [grp=ignite-sys-cache, crd=false]" (0 ms) (parent=Determine exchange type), stage="Restore partition states [grp=ignite-sys-cache]" (0 ms) (parent=Restore partition states), stage="Affinity applying from full message [grp=ignite-sys-cache]" (1 ms) (parent=Affinity recalculation)] [21:09:52] : [Step 4/5] [2021-11-19 21:09:52,238][INFO ][exchange-worker-#19251%grid-1%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], crd=false, evt=DISCOVERY_CUSTOM_EVT, evtNode=107c1eca-eeb4-4ea1-a55f-a4fba30f4001, customEvt=DynamicCacheChangeBatch [id=a257d593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqs=ArrayList [DynamicCacheChangeRequest [cacheName=encrypted, hasCfg=true, nodeId=107c1eca-eeb4-4ea1-a55f-a4fba30f4001, clientStartOnly=false, stop=false, destroy=false, disabledAfterStart=false]], exchangeActions=ExchangeActions [startCaches=[encrypted], stopCaches=null, startGrps=[encrypted], stopGrps=[], resetParts=null, stateChangeRequest=null], startCaches=false], allowMerge=false, exchangeFreeSwitch=false] [21:09:52] : [Step 4/5] [2021-11-19 21:09:52,238][INFO ][exchange-worker-#19129%grid-0%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], crd=true, evt=DISCOVERY_CUSTOM_EVT, evtNode=107c1eca-eeb4-4ea1-a55f-a4fba30f4001, customEvt=DynamicCacheChangeBatch [id=a257d593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqs=ArrayList [DynamicCacheChangeRequest [cacheName=encrypted, hasCfg=true, nodeId=107c1eca-eeb4-4ea1-a55f-a4fba30f4001, clientStartOnly=false, stop=false, destroy=false, disabledAfterStart=false]], exchangeActions=ExchangeActions [startCaches=[encrypted], stopCaches=null, startGrps=[encrypted], stopGrps=[], resetParts=null, stateChangeRequest=null], startCaches=false], allowMerge=false, exchangeFreeSwitch=false] [21:09:52] : [Step 4/5] [2021-11-19 21:09:52,240][INFO ][exchange-worker-#19251%grid-1%][PageMemoryImpl] Started page memory [memoryAllocated=24.0 MiB, pages=5952, tableSize=474.2 KiB, replacementSize=768 B, checkpointBuffer=10.0 MiB] [21:09:52] : [Step 4/5] [2021-11-19 21:09:52,241][INFO ][exchange-worker-#19129%grid-0%][PageMemoryImpl] Started page memory [memoryAllocated=24.0 MiB, pages=5952, tableSize=474.2 KiB, replacementSize=768 B, checkpointBuffer=10.0 MiB] [21:09:52] : [Step 4/5] [2021-11-19 21:09:52,302][INFO ][exchange-worker-#19251%grid-1%][GridCacheProcessor] Started cache [name=encrypted, id=1613773252, dataRegionName=default, mode=PARTITIONED, atomicity=TRANSACTIONAL, backups=0, mvcc=false] [21:09:52]W: [org.apache.ignite:ignite-core] [2021-11-19 21:09:52,304][WARN ][exchange-worker-#19251%grid-1%][CacheAffinitySharedManager] Cache group 'encrypted' brings high overhead for its metainformation in data region 'default'. Metainformation required for its partitions (522 partitions, 4096 bytes per partition, 2 MBs total) will consume more than 15% of data region memory (10 MBs). It may lead to critical errors on the node and cluster instability. Please reduce number of partitions, add more memory to the data region or add more server nodes for this cache group. [21:09:52] : [Step 4/5] [2021-11-19 21:09:52,304][INFO ][exchange-worker-#19251%grid-1%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], waitTime=0ms, futInfo=NA, mode=DISTRIBUTED] [21:09:52] : [Step 4/5] [2021-11-19 21:09:52,318][INFO ][exchange-worker-#19129%grid-0%][GridCacheProcessor] Started cache [name=encrypted, id=1613773252, dataRegionName=default, mode=PARTITIONED, atomicity=TRANSACTIONAL, backups=0, mvcc=false] [21:09:52]W: [org.apache.ignite:ignite-core] [2021-11-19 21:09:52,320][WARN ][exchange-worker-#19129%grid-0%][CacheAffinitySharedManager] Cache group 'encrypted' brings high overhead for its metainformation in data region 'default'. Metainformation required for its partitions (502 partitions, 4096 bytes per partition, 1 MBs total) will consume more than 15% of data region memory (10 MBs). It may lead to critical errors on the node and cluster instability. Please reduce number of partitions, add more memory to the data region or add more server nodes for this cache group. [21:09:52] : [Step 4/5] [2021-11-19 21:09:52,321][INFO ][exchange-worker-#19129%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], waitTime=0ms, futInfo=NA, mode=DISTRIBUTED] [21:09:52] : [Step 4/5] [2021-11-19 21:09:52,322][INFO ][exchange-worker-#19129%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partitions release latch: ServerLatch [permits=0, pendingAcks=HashSet [], super=CompletableLatch [id=CompletableLatchUid [id=exchange, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2]]]] [21:09:52] : [Step 4/5] [2021-11-19 21:09:52,322][INFO ][exchange-worker-#19129%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:09:52] : [Step 4/5] [2021-11-19 21:09:52,324][INFO ][exchange-worker-#19251%grid-1%][GridDhtPartitionsExchangeFuture] Finished waiting for partitions release latch: ClientLatch [coordinator=TcpDiscoveryNode [id=00f25b7e-9e72-4811-a52d-4f0fd1043000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345392118, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], ackSent=true, super=CompletableLatch [id=CompletableLatchUid [id=exchange, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2]]]] [21:09:52] : [Step 4/5] [2021-11-19 21:09:52,326][INFO ][exchange-worker-#19251%grid-1%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:09:52] : [Step 4/5] [2021-11-19 21:09:52,358][INFO ][exchange-worker-#19129%grid-0%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], crd=true] [21:09:52] : [Step 4/5] [2021-11-19 21:09:52,362][INFO ][exchange-worker-#19251%grid-1%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], crd=false] [21:09:52] : [Step 4/5] [2021-11-19 21:09:52,362][INFO ][sys-#19111%grid-0%][GridDhtPartitionsExchangeFuture] Coordinator received single message [ver=AffinityTopologyVersion [topVer=2, minorTopVer=2], node=107c1eca-eeb4-4ea1-a55f-a4fba30f4001, allReceived=true] [21:09:52] : [Step 4/5] [2021-11-19 21:09:52,363][INFO ][sys-#19111%grid-0%][GridDhtPartitionsExchangeFuture] finishExchangeOnCoordinator [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2]] [21:09:52] : [Step 4/5] [2021-11-19 21:09:52,367][INFO ][sys-#19111%grid-0%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], err=null, rebalanced=true, wasRebalanced=true] [21:09:52] : [Step 4/5] [2021-11-19 21:09:52,368][INFO ][sys-#19225%grid-1%][GridDhtPartitionsExchangeFuture] Received full message, will finish exchange [node=00f25b7e-9e72-4811-a52d-4f0fd1043000, resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2]] [21:09:52] : [Step 4/5] [2021-11-19 21:09:52,368][INFO ][sys-#19111%grid-0%][GridCacheProcessor] Finish proxy initialization, cacheName=encrypted, localNodeId=00f25b7e-9e72-4811-a52d-4f0fd1043000 [21:09:52] : [Step 4/5] [2021-11-19 21:09:52,371][INFO ][sys-#19225%grid-1%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], err=null, rebalanced=true, wasRebalanced=true] [21:09:52] : [Step 4/5] [2021-11-19 21:09:52,371][INFO ][exchange-worker-#19129%grid-0%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=2, minorTopVer=2], force=false, evt=DISCOVERY_CUSTOM_EVT, node=107c1eca-eeb4-4ea1-a55f-a4fba30f4001] [21:09:52] : [Step 4/5] [2021-11-19 21:09:52,372][INFO ][sys-#19225%grid-1%][GridCacheProcessor] Finish proxy initialization, cacheName=encrypted, localNodeId=107c1eca-eeb4-4ea1-a55f-a4fba30f4001 [21:09:52] : [Step 4/5] [2021-11-19 21:09:52,371][INFO ][sys-#19111%grid-0%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=00f25b7e-9e72-4811-a52d-4f0fd1043000, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=107c1eca-eeb4-4ea1-a55f-a4fba30f4001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637345392088, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2]] [21:09:52] : [Step 4/5] [2021-11-19 21:09:52,373][INFO ][exchange-worker-#19251%grid-1%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=2, minorTopVer=2], force=false, evt=DISCOVERY_CUSTOM_EVT, node=107c1eca-eeb4-4ea1-a55f-a4fba30f4001] [21:09:52] : [Step 4/5] [2021-11-19 21:09:52,372][INFO ][sys-#19225%grid-1%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=107c1eca-eeb4-4ea1-a55f-a4fba30f4001, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=107c1eca-eeb4-4ea1-a55f-a4fba30f4001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637345392234, loc=true, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2]] [21:09:52] : [Step 4/5] [2021-11-19 21:09:52,375][INFO ][sys-#19225%grid-1%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (1 ms), stage="Update caches registry" (0 ms), stage="Start caches" (62 ms), stage="Affinity initialization on cache group start" (1 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Wait partitions release latch [latch=exchange]" (20 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Restore partition states" (9 ms), stage="After states restored callback" (24 ms), stage="WAL history reservation" (0 ms), stage="Waiting for Full message" (7 ms), stage="Affinity recalculation" (0 ms), stage="Full map updating" (2 ms), stage="Exchange done" (3 ms), stage="Total time" (129 ms)] [21:09:52] : [Step 4/5] [2021-11-19 21:09:52,378][INFO ][sys-#19225%grid-1%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], stage="Affinity initialization on cache group start [grp=encrypted]" (0 ms) (parent=Affinity initialization on cache group start), stage="Restore partition states [grp=encrypted]" (9 ms) (parent=Restore partition states), stage="Restore partition states [grp=ignite-sys-cache]" (0 ms) (parent=Restore partition states)] [21:09:52] : [Step 4/5] [2021-11-19 21:09:52,373][INFO ][sys-#19111%grid-0%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (2 ms), stage="Update caches registry" (0 ms), stage="Start caches" (78 ms), stage="Affinity initialization on cache group start" (1 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Wait partitions release latch [latch=exchange]" (0 ms), stage="Wait partitions release [latch=exchange]" (2 ms), stage="Restore partition states" (9 ms), stage="After states restored callback" (21 ms), stage="WAL history reservation" (1 ms), stage="Waiting for all single messages" (5 ms), stage="Affinity recalculation (crd)" (0 ms), stage="Collect update counters and create affinity messages" (0 ms), stage="Assign partitions states" (1 ms), stage="Validate partitions states" (0 ms), stage="Apply update counters" (0 ms), stage="Full message preparing" (2 ms), stage="Full message sending" (0 ms), stage="Exchange done" (6 ms), stage="Total time" (128 ms)] [21:09:52] : [Step 4/5] [2021-11-19 21:09:52,381][INFO ][sys-#19111%grid-0%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], stage="Affinity initialization on cache group start [grp=encrypted]" (0 ms) (parent=Affinity initialization on cache group start), stage="Restore partition states [grp=encrypted]" (9 ms) (parent=Restore partition states), stage="Restore partition states [grp=ignite-sys-cache]" (0 ms) (parent=Restore partition states)] [21:09:53] : [Step 4/5] [2021-11-19 21:09:53,229][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:09:53] : [Step 4/5] [2021-11-19 21:09:53,365][INFO ][disco-notifier-worker-#19242%grid-1%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:09:53] : [Step 4/5] [2021-11-19 21:09:53,365][INFO ][disco-notifier-worker-#19124%grid-0%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:09:53] : [Step 4/5] [2021-11-19 21:09:53,501][INFO ][disco-notifier-worker-#19242%grid-1%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:09:53] : [Step 4/5] [2021-11-19 21:09:53,510][INFO ][disco-notifier-worker-#19124%grid-0%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:09:53] : [Step 4/5] [2021-11-19 21:09:53,603][INFO ][disco-notifier-worker-#19124%grid-0%][GridEncryptionManager] Start master key change [masterKeyName=ignite.master.key2] [21:09:53] : [Step 4/5] [2021-11-19 21:09:53,604][INFO ][disco-notifier-worker-#19242%grid-1%][GridEncryptionManager] Start master key change [masterKeyName=ignite.master.key2] [21:09:53] : [Step 4/5] [2021-11-19 21:09:53,659][INFO ][disco-notifier-worker-#19242%grid-1%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:09:53] : [Step 4/5] [2021-11-19 21:09:53,659][INFO ][disco-notifier-worker-#19124%grid-0%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:09:54] : [Step 4/5] [2021-11-19 21:09:54,179][INFO ][disco-notifier-worker-#19242%grid-1%][GridEncryptionManager] Master key successfully changed [masterKeyName=ignite.master.key2] [21:09:54] : [Step 4/5] [2021-11-19 21:09:54,299][INFO ][disco-notifier-worker-#19124%grid-0%][GridEncryptionManager] Master key successfully changed [masterKeyName=ignite.master.key2] [21:09:55] : [Step 4/5] [2021-11-19 21:09:55,034][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][root] >>> Stopping grid [name=grid-0, id=00f25b7e-9e72-4811-a52d-4f0fd1043000] [21:09:55] : [Step 4/5] [2021-11-19 21:09:55,043][INFO ][tcp-disco-sock-reader-[107c1eca 127.0.0.1:41109]-#1009%grid-0%-#19248%grid-0%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:41109, rmtPort=41109, rmtNodeId=107c1eca-eeb4-4ea1-a55f-a4fba30f4001] [21:09:55] : [Step 4/5] [2021-11-19 21:09:55,044][INFO ][disco-event-worker-#19250%grid-1%][GridDiscoveryManager] Node left topology: TcpDiscoveryNode [id=00f25b7e-9e72-4811-a52d-4f0fd1043000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345392118, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false] [21:09:55] : [Step 4/5] [2021-11-19 21:09:55,046][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][GridCacheProcessor] Stopped cache [cacheName=ignite-sys-cache] [21:09:55] : [Step 4/5] [2021-11-19 21:09:55,047][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][GridCacheProcessor] Stopped cache [cacheName=encrypted] [21:09:55] : [Step 4/5] [2021-11-19 21:09:55,047][INFO ][disco-event-worker-#19250%grid-1%][GridDiscoveryManager] Topology snapshot [ver=3, locNode=107c1eca, servers=1, clients=0, state=ACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=107c1eca-eeb4-4ea1-a55f-a4fba30f4001, consistentId=grid-1, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:09:55] : [Step 4/5] [2021-11-19 21:09:55,048][INFO ][disco-event-worker-#19250%grid-1%][GridDiscoveryManager] Coordinator changed [prev=TcpDiscoveryNode [id=00f25b7e-9e72-4811-a52d-4f0fd1043000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345392118, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], cur=TcpDiscoveryNode [id=107c1eca-eeb4-4ea1-a55f-a4fba30f4001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637345395042, loc=true, ver=2.13.0#20211119-sha1:00000000, isClient=false]] [21:09:55] : [Step 4/5] [2021-11-19 21:09:55,050][INFO ][disco-event-worker-#19250%grid-1%][GridDiscoveryManager] ^-- Baseline [id=0, size=2, online=1, offline=1] [21:09:55] : [Step 4/5] [2021-11-19 21:09:55,050][INFO ][disco-event-worker-#19250%grid-1%][MvccProcessorImpl] Assigned mvcc coordinator [crd=MvccCoordinator [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], nodeId=107c1eca-eeb4-4ea1-a55f-a4fba30f4001, ver=1637345390938, local=true, initialized=false]] [21:09:55] : [Step 4/5] [2021-11-19 21:09:55,053][INFO ][sys-#19236%grid-1%][ExchangeLatchManager] Become new coordinator 107c1eca-eeb4-4ea1-a55f-a4fba30f4001 [21:09:55] : [Step 4/5] [2021-11-19 21:09:55,053][INFO ][exchange-worker-#19251%grid-1%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], crd=true, evt=NODE_LEFT, evtNode=00f25b7e-9e72-4811-a52d-4f0fd1043000, customEvt=null, allowMerge=false, exchangeFreeSwitch=true] [21:09:55] : [Step 4/5] [2021-11-19 21:09:55,054][INFO ][exchange-worker-#19251%grid-1%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:09:55] : [Step 4/5] [2021-11-19 21:09:55,056][INFO ][exchange-worker-#19251%grid-1%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], err=null, rebalanced=true, wasRebalanced=true] [21:09:55]W: [org.apache.ignite:ignite-core] [2021-11-19 21:09:55,058][WARN ][exchange-worker-#19251%grid-1%][GridDhtPartitionTopologyImpl] Detected lost partitions [grp=encrypted, parts=[1, 3, 5, 8-9, 12-13, 15-16, 18-20, 22-23, 31, 33-36, 38-39, 41-43, 45-46, 53, 55-56, 58, 60-61, 65-66, 69-73, 76-77, 79-80, 82-86, 89-90, 92-96, 98, 100, 103, 108-112, 115, 117, 119, 121, 123, 125-134, 137, 139, 146, 148, 153, 157-158, 161, 165-168, 170-171, 173-174, 178-179, 181-183, 188-189, 192-193, 195, 203, 206-208, 211, 213, 215, 217-218, 225, 227-228, 233-236, 238, 240, 242, 246, 248, 252-254, 256, 258-260, 262-264, 266-268, 270-271, 274-275, 278-280, 283-284, 286, 288, 292, 298, 300, 305, 307, 310, 313-314, 318, 320-321, 323-324, 327, 331-335, 337-338, 340, 342-343, 347-349, 351, 355-356, 362, 364-365, 368-370, 374-375, 381-382, 384, 386, 389, 391, 393-394, 398-399, 401, 403-404, 406-407, 412-415, 417-419, 421, 423, 426-428, 430-432, 434, 439, 442-444, 447-449, 451, 454, 457, 459, 461, 464, 469, 471-473, 476-479, 481-487, 489, 493-494, 496, 498, 513-515, 517-524, 526, 532-534, 536, 539-540, 543-544, 547, 553, 556-557, 559-561, 565-566, 570-571, 573, 575-578, 581, 586, 588-589, 592-593, 595, 597-599, 601, 603, 605-606, 615-616, 621-622, 625-626, 630-631, 634-635, 637, 639, 643-644, 647, 650-656, 663, 666-667, 673-676, 679-681, 685, 687-688, 690-691, 694, 698, 700-705, 708, 711, 715, 718, 722, 729, 733, 736-738, 740-741, 743-745, 747-748, 751, 753, 755, 757-761, 763-767, 771, 776-777, 779, 781-782, 788, 792, 794-795, 797, 802, 804-805, 807-808, 813, 815, 818, 820-821, 826, 830-831, 834-835, 838, 841-845, 847, 852, 855-856, 859, 861-862, 865, 867, 872, 876, 879-883, 885-887, 890-895, 898-899, 901-904, 908-913, 916, 918, 921-922, 926-930, 934-935, 937-939, 941, 943, 946-947, 949, 952-953, 955, 959-961, 963-964, 971, 973-974, 977, 981-982, 984, 986-987, 989, 991-992, 995-996, 999, 1001-1002, 1005-1006, 1008, 1010-1013, 1015, 1017, 1020-1023], topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0]] [21:09:55] : [Step 4/5] [2021-11-19 21:09:55,062][INFO ][exchange-worker-#19251%grid-1%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=107c1eca-eeb4-4ea1-a55f-a4fba30f4001, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], evt=NODE_LEFT, evtNode=TcpDiscoveryNode [id=00f25b7e-9e72-4811-a52d-4f0fd1043000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345392118, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0]] [21:09:55] : [Step 4/5] [2021-11-19 21:09:55,063][INFO ][exchange-worker-#19251%grid-1%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (0 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="After states restored callback" (0 ms), stage="WAL history reservation" (0 ms), stage="Finalize update counters" (0 ms), stage="Detect lost partitions" (5 ms), stage="Exchange done" (1 ms), stage="Total time" (6 ms)] [21:09:55] : [Step 4/5] [2021-11-19 21:09:55,064][INFO ][exchange-worker-#19251%grid-1%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], stage="Affinity initialization (exchange-free switch on fully-rebalanced topology) [grp=ignite-sys-cache]" (0 ms) (parent=Determine exchange type), stage="Affinity initialization (exchange-free switch on fully-rebalanced topology) [grp=encrypted]" (0 ms) (parent=Determine exchange type)] [21:09:55] : [Step 4/5] [2021-11-19 21:09:55,065][INFO ][exchange-worker-#19251%grid-1%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], crd=true] [21:09:55] : [Step 4/5] [2021-11-19 21:09:55,066][INFO ][exchange-worker-#19251%grid-1%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=3, minorTopVer=0], force=false, evt=NODE_LEFT, node=00f25b7e-9e72-4811-a52d-4f0fd1043000] [21:09:56] : [Step 4/5] [2021-11-19 21:09:56,114][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][FilePageStoreManager] Cleanup cache stores [total=4, left=0, cleanFiles=false] [21:09:56] : [Step 4/5] [2021-11-19 21:09:56,117][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][GridDeploymentLocalStore] Removed undeployed class: GridDeployment [ts=1637345392189, depMode=SHARED, clsLdr=IsolatedClassLoader{roleName='test'}, clsLdrId=2157d593d71-00f25b7e-9e72-4811-a52d-4f0fd1043000, userVer=0, loc=true, sampleClsName=org.apache.ignite.internal.processors.cache.distributed.dht.preloader.GridDhtPartitionMap, pendingUndeploy=false, undeployed=true, usage=0] [21:09:56] : [Step 4/5] [2021-11-19 21:09:56,128][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] [21:09:56] : [Step 4/5] [21:09:56] : [Step 4/5] >>> +------------------------------------------------------+ [21:09:56] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV stopped OK [21:09:56] : [Step 4/5] >>> +------------------------------------------------------+ [21:09:56] : [Step 4/5] >>> Ignite instance name: grid-0 [21:09:56] : [Step 4/5] >>> Grid uptime: 00:00:05.177 [21:09:56] : [Step 4/5] [21:09:56] : [Step 4/5] [21:09:56]W: [org.apache.ignite:ignite-core] [2021-11-19 21:09:56,133][WARN ][test-runner-#19013%encryption.MasterKeyChangeTest%][G] Ignite work directory is not provided, automatically resolved to: /opt/buildagent/work/7bc1c54bc719b67c/work [21:09:56] : [Step 4/5] [2021-11-19 21:09:56,134][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] [21:09:56] : [Step 4/5] [21:09:56] : [Step 4/5] >>> __________ ________________ [21:09:56] : [Step 4/5] >>> / _/ ___/ |/ / _/_ __/ __/ [21:09:56] : [Step 4/5] >>> _/ // (7 7 // / / / / _/ [21:09:56] : [Step 4/5] >>> /___/\___/_/|_/___/ /_/ /___/ [21:09:56] : [Step 4/5] >>> [21:09:56] : [Step 4/5] >>> ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:09:56] : [Step 4/5] >>> 2021 Copyright(C) Apache Software Foundation [21:09:56] : [Step 4/5] >>> [21:09:56] : [Step 4/5] >>> Ignite documentation: http://ignite.apache.org [21:09:56] : [Step 4/5] [21:09:56] : [Step 4/5] [2021-11-19 21:09:56,135][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] Config URL: n/a [21:09:56] : [Step 4/5] [2021-11-19 21:09:56,135][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] IgniteConfiguration [igniteInstanceName=grid-0, pubPoolSize=24, svcPoolSize=24, callbackPoolSize=24, stripedPoolSize=24, sysPoolSize=24, mgmtPoolSize=4, dataStreamerPoolSize=24, utilityCachePoolSize=24, utilityCacheKeepAliveTime=60000, p2pPoolSize=2, qryPoolSize=24, buildIdxPoolSize=4, igniteHome=/opt/buildagent/work/7bc1c54bc719b67c, igniteWorkDir=/opt/buildagent/work/7bc1c54bc719b67c/work, mbeanSrv=com.sun.jmx.mbeanserver.JmxMBeanServer@6fe85038, nodeId=002cfb47-8eee-4a16-96e5-0f323891f000, marsh=BinaryMarshaller [], marshLocJobs=false, daemon=false, p2pEnabled=true, netTimeout=10000, netCompressionLevel=1, sndRetryDelay=1000, sndRetryCnt=3, metricsHistSize=10000, metricsUpdateFreq=1000, metricsExpTime=9223372036854775807, discoSpi=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=0, ackTimeout=0, marsh=null, reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], segPlc=STOP, segResolveAttempts=2, waitForSegOnStart=true, allResolversPassReq=true, segChkFreq=10000, commSpi=TcpCommunicationSpi [connectGate=org.apache.ignite.spi.communication.tcp.internal.ConnectGateway@640a2d2b, ctxInitLatch=java.util.concurrent.CountDownLatch@4d78b475[Count = 1], stopping=false, clientPool=null, nioSrvWrapper=null, stateProvider=null], evtSpi=MemoryEventStorageSpi [expireAgeMs=9223372036854775807, expireCnt=10000, filter=null], colSpi=NoopCollisionSpi [], deploySpi=LocalDeploymentSpi [], indexingSpi=org.apache.ignite.spi.indexing.noop.NoopIndexingSpi@66b47825, addrRslvr=null, encryptionSpi=org.apache.ignite.spi.encryption.keystore.KeystoreEncryptionSpi@17411583, tracingSpi=org.apache.ignite.spi.tracing.NoopTracingSpi@415ba4bc, clientMode=false, rebalanceThreadPoolSize=4, rebalanceTimeout=10000, rebalanceBatchesPrefetchCnt=3, rebalanceThrottle=0, rebalanceBatchSize=524288, txCfg=TransactionConfiguration [txSerEnabled=false, dfltIsolation=REPEATABLE_READ, dfltConcurrency=PESSIMISTIC, dfltTxTimeout=0, txTimeoutOnPartitionMapExchange=0, deadlockTimeout=10000, pessimisticTxLogSize=0, pessimisticTxLogLinger=10000, tmLookupClsName=null, txManagerFactory=null, useJtaSync=false], cacheSanityCheckEnabled=true, discoStartupDelay=60000, deployMode=SHARED, p2pMissedCacheSize=100, locHost=127.0.0.1, timeSrvPortBase=31100, timeSrvPortRange=100, failureDetectionTimeout=10000, sysWorkerBlockedTimeout=null, clientFailureDetectionTimeout=10000, metricsLogFreq=0, connectorCfg=null, odbcCfg=null, warmupClos=null, atomicCfg=AtomicConfiguration [seqReserveSize=1000, cacheMode=PARTITIONED, backups=1, aff=null, grpName=null], classLdr=null, sslCtxFactory=null, platformCfg=null, binaryCfg=null, memCfg=null, pstCfg=null, dsCfg=DataStorageConfiguration [sysRegionInitSize=41943040, sysRegionMaxSize=104857600, pageSize=4096, concLvl=0, dfltDataRegConf=DataRegionConfiguration [name=default, maxSize=10485760, initSize=268435456, swapPath=null, pageEvictionMode=DISABLED, pageReplacementMode=CLOCK, evictionThreshold=0.9, emptyPagesPoolSize=100, metricsEnabled=false, metricsSubIntervalCount=5, metricsRateTimeInterval=60000, persistenceEnabled=true, checkpointPageBufSize=0, lazyMemoryAllocation=true, warmUpCfg=null], dataRegions=null, storagePath=null, checkpointFreq=180000, lockWaitTime=10000, checkpointThreads=4, checkpointWriteOrder=SEQUENTIAL, walHistSize=20, maxWalArchiveSize=1073741824, walSegments=10, walSegmentSize=67108864, walPath=db/wal, walArchivePath=db/wal/archive, cdcWalPath=db/wal/cdc, cdcEnabled=false, metricsEnabled=false, walMode=FSYNC, walTlbSize=131072, walBuffSize=0, walFlushFreq=2000, walFsyncDelay=1000, walRecordIterBuffSize=67108864, alwaysWriteFullPages=false, fileIOFactory=org.apache.ignite.internal.processors.cache.persistence.file.AsyncFileIOFactory@112daceb, metricsSubIntervalCnt=5, metricsRateTimeInterval=60000, walAutoArchiveAfterInactivity=-1, walForceArchiveTimeout=-1, writeThrottlingEnabled=false, walCompactionEnabled=false, walCompactionLevel=1, checkpointReadLockTimeout=null, walPageCompression=DISABLED, walPageCompressionLevel=null, dfltWarmUpCfg=null, encCfg=org.apache.ignite.configuration.EncryptionConfiguration@1d66c2e2, defragmentationThreadPoolSize=4, minWalArchiveSize=-1], snapshotPath=snapshots, activeOnStart=true, activeOnStartPropSetFlag=false, autoActivation=true, autoActivationPropSetFlag=false, clusterStateOnStart=null, sqlConnCfg=null, cliConnCfg=ClientConnectorConfiguration [host=null, port=10800, portRange=100, sockSndBufSize=0, sockRcvBufSize=0, tcpNoDelay=true, maxOpenCursorsPerConn=128, threadPoolSize=24, selectorCnt=12, idleTimeout=0, handshakeTimeout=10000, jdbcEnabled=true, odbcEnabled=true, thinCliEnabled=true, sslEnabled=false, useIgniteSslCtxFactory=true, sslClientAuth=false, sslCtxFactory=null, thinCliCfg=ThinClientConfiguration [maxActiveTxPerConn=100, maxActiveComputeTasksPerConn=0]], mvccVacuumThreadCnt=2, mvccVacuumFreq=5000, authEnabled=false, failureHnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]], commFailureRslvr=null, sqlCfg=SqlConfiguration [longQryWarnTimeout=3000, dfltQryTimeout=0, sqlQryHistSize=1000, validationEnabled=false], asyncContinuationExecutor=null] [21:09:56] : [Step 4/5] [2021-11-19 21:09:56,143][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] Daemon mode: off [21:09:56] : [Step 4/5] [2021-11-19 21:09:56,143][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] OS: Linux 4.15.0-151-generic amd64 [21:09:56] : [Step 4/5] [2021-11-19 21:09:56,144][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] OS user: teamcity [21:09:56] : [Step 4/5] [2021-11-19 21:09:56,144][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] PID: 16724 [21:09:56] : [Step 4/5] [2021-11-19 21:09:56,144][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] Language runtime: Java Platform API Specification ver. 1.8 [21:09:56] : [Step 4/5] [2021-11-19 21:09:56,144][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] VM information: Java(TM) SE Runtime Environment 1.8.0_261-b12 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 25.261-b12 [21:09:56] : [Step 4/5] [2021-11-19 21:09:56,145][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] VM total memory: 1.9GB [21:09:56] : [Step 4/5] [2021-11-19 21:09:56,145][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] Remote Management [restart: off, REST: off, JMX (remote: off)] [21:09:56] : [Step 4/5] [2021-11-19 21:09:56,145][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] Logger: GridTestLog4jLogger [quiet=false, config=null] [21:09:56] : [Step 4/5] [2021-11-19 21:09:56,145][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] IGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c [21:09:56] : [Step 4/5] [2021-11-19 21:09:56,145][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] VM arguments: [-DIGNITE_DUMP_THREADS_ON_FAILURE=false, -DMono=/usr/bin/mono-sgen, -DMono4.0_x64=/usr/lib/mono/4.0, -DMono4.5_x64=/usr/lib/mono/4.5, -DMonoVersion=6.12.0.90, -DSKIP_BUILD=false, -Dagent.home.dir=/opt/buildagent, -Dagent.name=aitc-lin02_03, -Dagent.ownPort=9090, -Dagent.work.dir=/opt/buildagent/work, -Dbuild.number=95, -Dbuild.vcs.number=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.1=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.GitHubApacheIgnite=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dclassworlds.conf=/opt/buildagent/temp/buildTmp/teamcity.m2.conf, -Dcom.jetbrains.maven.watcher.report.file=/opt/buildagent/temp/buildTmp/maven-build-info.xml, -Djava.io.tmpdir=/opt/buildagent/temp/buildTmp, -Dmaven.home=/opt/buildagent/tools/maven3_6, -Dmaven.multiModuleProjectDirectory=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.agent.cpuBenchmark=457, -Dteamcity.agent.dotnet.agent_url=http://localhost:9090/RPC2, -Dteamcity.agent.dotnet.build_id=6278078, -Dteamcity.auth.password=*******, -Dteamcity.auth.userId=TeamCityBuildId=6278078, -Dteamcity.build.changedFiles.file=/opt/buildagent/temp/buildTmp/changedFiles6342607772318147725.txt, -Dteamcity.build.checkoutDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.build.id=6278078, -Dteamcity.build.properties.file=/opt/buildagent/temp/buildTmp/teamcity.build5164517880467851002.properties, -Dteamcity.build.tempDir=/opt/buildagent/temp/buildTmp, -Dteamcity.build.workingDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.buildConfName=Basic 3, -Dteamcity.buildType.id=IgniteTests24Java8_Basic3, -Dteamcity.configuration.properties.file=/opt/buildagent/temp/buildTmp/teamcity.config5591980786735343870.properties, -Dteamcity.maven.userSettings.path=/opt/buildagent/temp/buildTmp/maven_settings_585072866407032347.xml, -Dteamcity.maven.watcher.home=/opt/buildagent/plugins/mavenPlugin/maven-watcher-jdk16, -Dteamcity.projectName=Ignite Tests 2.x (JDK 8/11), -Dteamcity.runner.properties.file=/opt/buildagent/temp/buildTmp/teamcity.runner9098465561618137420.properties, -Dteamcity.tests.recentlyFailedTests.file=/opt/buildagent/temp/buildTmp/testsToRunFirst3891775683130404069.txt, -Dteamcity.version=2021.2 (build 99542), -ea, -Xms2g, -Xmx2g, -XX:+HeapDumpOnOutOfMemoryError, -DIGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_TEST_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_UPDATE_NOTIFIER=false, -DIGNITE_NO_DISCO_ORDER=true, -DIGNITE_PERFORMANCE_SUGGESTIONS_DISABLED=true, -Djava.net.preferIPv4Stack=true, -DTEST_SCALE_FACTOR=1.0, -DIGNITE_TEST_PROP_LOG4J_FILE=log4j-tc-test.xml, -DIGNITE_QUIET=false, -DIGNITE_MARSHAL_BUFFERS_RECHECK=1000, -Dmaven.repo.local=/opt/buildagent/.m2/repository] [21:09:56] : [Step 4/5] [2021-11-19 21:09:56,149][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] System cache's DataRegion size is configured to 40 MB. Use DataStorageConfiguration.systemRegionInitialSize property to change the setting. [21:09:56] : [Step 4/5] [2021-11-19 21:09:56,149][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] Configured caches [in 'sysMemPlc' dataRegion: ['ignite-sys-cache']] [21:09:56]W: [org.apache.ignite:ignite-core] [2021-11-19 21:09:56,150][WARN ][test-runner-#19013%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] Peer class loading is enabled (disable it in production for performance and deployment consistency reasons) [21:09:56] : [Step 4/5] [2021-11-19 21:09:56,150][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] 3-rd party licenses can be found at: /opt/buildagent/work/7bc1c54bc719b67c/libs/licenses [21:09:56] : [Step 4/5] [2021-11-19 21:09:56,153][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] Configured plugins: [21:09:56] : [Step 4/5] [2021-11-19 21:09:56,153][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] ^-- StanByClusterTestProvider 1.0 [21:09:56] : [Step 4/5] [2021-11-19 21:09:56,153][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:09:56] : [Step 4/5] [2021-11-19 21:09:56,154][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] [21:09:56] : [Step 4/5] [2021-11-19 21:09:56,154][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] ^-- PageMemory tracker plugin 1.0 [21:09:56] : [Step 4/5] [2021-11-19 21:09:56,154][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:09:56] : [Step 4/5] [2021-11-19 21:09:56,154][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] [21:09:56] : [Step 4/5] [2021-11-19 21:09:56,154][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] ^-- TestDistibutedConfigurationPlugin 1.0 [21:09:56] : [Step 4/5] [2021-11-19 21:09:56,154][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:09:56] : [Step 4/5] [2021-11-19 21:09:56,155][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] [21:09:56] : [Step 4/5] [2021-11-19 21:09:56,155][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] ^-- NodeValidationPluginProvider 1.0 [21:09:56] : [Step 4/5] [2021-11-19 21:09:56,155][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:09:56] : [Step 4/5] [2021-11-19 21:09:56,155][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] [21:09:56] : [Step 4/5] [2021-11-19 21:09:56,155][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][FailureProcessor] Configured failure handler: [hnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]]] [21:09:56]W: [org.apache.ignite:ignite-core] [2021-11-19 21:09:56,163][WARN ][test-runner-#19013%encryption.MasterKeyChangeTest%][TestRecordingCommunicationSpi] Message queue limit is set to 0 which may lead to potential OOMEs when running cache operations in FULL_ASYNC or PRIMARY_SYNC modes due to message queues growth on sender and receiver sides. [21:09:56] : [Step 4/5] [2021-11-19 21:09:56,163][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][TestRecordingCommunicationSpi] Successfully bound communication NIO server to TCP port [port=47100, locHost=/127.0.0.1, selectorsCnt=12, selectorSpins=0, pairedConn=false] [21:09:56] : [Step 4/5] [2021-11-19 21:09:56,167][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][GridCollisionManager] Collision resolution is disabled (all jobs will be activated upon arrival). [21:09:56] : [Step 4/5] [2021-11-19 21:09:56,167][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] Security status [authentication=off, sandbox=off, tls/ssl=off] [21:09:56] : [Step 4/5] [2021-11-19 21:09:56,237][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:09:56] : [Step 4/5] [2021-11-19 21:09:56,321][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][MaintenanceProcessor] Resolved store directory for node persistent data: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0 [21:09:56] : [Step 4/5] [2021-11-19 21:09:56,322][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][CacheObjectBinaryProcessorImpl] Resolved directory for serialized binary metadata: /opt/buildagent/work/7bc1c54bc719b67c/work/db/binary_meta/grid_0 [21:09:56] : [Step 4/5] [2021-11-19 21:09:56,325][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0 [21:09:56] : [Step 4/5] [2021-11-19 21:09:56,326][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][FileWriteAheadLogManager] Resolved write ahead log work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0 [21:09:56] : [Step 4/5] [2021-11-19 21:09:56,326][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][FileWriteAheadLogManager] Resolved write ahead log archive directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0 [21:09:56] : [Step 4/5] [2021-11-19 21:09:56,327][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000004.wal [21:09:56] : [Step 4/5] [2021-11-19 21:09:56,328][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000003.wal [21:09:56] : [Step 4/5] [2021-11-19 21:09:56,328][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000002.wal [21:09:56] : [Step 4/5] [2021-11-19 21:09:56,329][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000001.wal [21:09:56] : [Step 4/5] [2021-11-19 21:09:56,335][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Configured data regions initialized successfully [total=5] [21:09:56] : [Step 4/5] [2021-11-19 21:09:56,451][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][IgniteSnapshotManager] Resolved snapshot work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/snapshots [21:09:56] : [Step 4/5] [2021-11-19 21:09:56,452][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][IgniteSnapshotManager] Resolved temp directory for snapshot creation: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0/snp [21:09:56] : [Step 4/5] [2021-11-19 21:09:56,454][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][ClientListenerProcessor] Client connector processor has started on TCP port 10800 [21:09:56] : [Step 4/5] [2021-11-19 21:09:56,460][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] Non-loopback local IPs: 172.17.0.4 [21:09:56] : [Step 4/5] [2021-11-19 21:09:56,460][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] Enabled local MACs: 0242AC110004 [21:09:56] : [Step 4/5] [2021-11-19 21:09:56,463][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=/opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0/cp/1637345392183-eed157b5-3499-42b4-8912-66c001f04117-START.bin, endMarker=/opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0/cp/1637345392183-eed157b5-3499-42b4-8912-66c001f04117-END.bin] [21:09:56] : [Step 4/5] [2021-11-19 21:09:56,465][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:09:56] : [Step 4/5] [2021-11-19 21:09:56,465][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=81472, len=1963], lastMarked=WALPointer [idx=0, fileOff=81472, len=1963], lastCheckpointId=eed157b5-3499-42b4-8912-66c001f04117] [21:09:56] : [Step 4/5] [2021-11-19 21:09:56,588][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Found last checkpoint marker [cpId=eed157b5-3499-42b4-8912-66c001f04117, pos=WALPointer [idx=0, fileOff=81472, len=1963]] [21:09:56] : [Step 4/5] [2021-11-19 21:09:56,599][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Applying lost metastore updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=81472, len=1963], lastCheckpointId=eed157b5-3499-42b4-8912-66c001f04117] [21:09:56] : [Step 4/5] [2021-11-19 21:09:56,646][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][GridEncryptionManager] Master key name loaded from WAL [masterKeyName=ignite.master.key2] [21:09:56] : [Step 4/5] [2021-11-19 21:09:56,702][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:09:56] : [Step 4/5] [2021-11-19 21:09:56,790][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=182 ms] [21:09:56] : [Step 4/5] [2021-11-19 21:09:56,791][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][GridCacheProcessor] Restoring partition state for local groups. [21:09:56] : [Step 4/5] [2021-11-19 21:09:56,791][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=0, partitionsProcessed=0, time=10ms] [21:09:56] : [Step 4/5] [2021-11-19 21:09:56,855][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][GridClusterStateProcessor] Restoring history for BaselineTopology[id=0] [21:09:56] : [Step 4/5] [2021-11-19 21:09:56,862][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][ClusterProcessor] Cluster ID and tag has been read from metastorage: ClusterIdAndTag [id=f9f004b4-3864-44de-b14d-12acab81f510, tag=kind_golick] [21:09:56] : [Step 4/5] [2021-11-19 21:09:56,862][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][IgniteClusterImpl] Shutdown policy was updated [oldVal=null, newVal=null] [21:09:56] : [Step 4/5] [2021-11-19 21:09:56,863][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustEnabled' was changed from 'null' to 'false' [21:09:56] : [Step 4/5] [2021-11-19 21:09:56,863][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustTimeout' was changed from 'null' to '300000' [21:09:56] : [Step 4/5] [2021-11-19 21:09:56,863][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][IgniteTxManager] Transactions parameter 'txOwnerDumpRequestsAllowed' was changed from 'null' to 'true' [21:09:56] : [Step 4/5] [2021-11-19 21:09:56,864][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][IgniteTxManager] Transactions parameter 'longOperationsDumpTimeout' was changed from 'null' to '60000' [21:09:56] : [Step 4/5] [2021-11-19 21:09:56,864][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpThreshold' was changed from 'null' to '0' [21:09:56] : [Step 4/5] [2021-11-19 21:09:56,865][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][IgniteTxManager] Transactions parameter 'transactionTimeDumpSamplesCoefficient' was changed from 'null' to '0.0' [21:09:56] : [Step 4/5] [2021-11-19 21:09:56,865][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpSamplesPerSecondLimit' was changed from 'null' to '5' [21:09:56] : [Step 4/5] [2021-11-19 21:09:56,865][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][IgniteTxManager] Transactions parameter 'collisionsDumpInterval' was changed from 'null' to '1000' [21:09:56] : [Step 4/5] [2021-11-19 21:09:56,866][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Historical rebalance WAL threshold changed [property=historical.rebalance.threshold, oldVal=null, newVal=500] [21:09:56] : [Step 4/5] [2021-11-19 21:09:56,866][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Checkpoint frequency deviation changed [oldVal=null, newVal=null] [21:09:56] : [Step 4/5] [2021-11-19 21:09:56,867][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][FilePageStoreManager] Cleanup cache stores [total=1, left=0, cleanFiles=false] [21:09:56] : [Step 4/5] [2021-11-19 21:09:56,869][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:09:56] : [Step 4/5] [2021-11-19 21:09:56,870][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:09:56] : [Step 4/5] [2021-11-19 21:09:56,870][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:09:56] : [Step 4/5] [2021-11-19 21:09:56,871][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Data Regions Started: 5 [21:09:56] : [Step 4/5] [2021-11-19 21:09:56,871][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] ^-- sysMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:09:56] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:09:56] : [Step 4/5] ^-- default region [type=default, persistence=true, lazyAlloc=true, [21:09:56] : [Step 4/5] ... initCfg=10MB, maxCfg=10MB, usedRam=0MB, freeRam=100%, allocRam=0MB, allocTotal=0MB] [21:09:56] : [Step 4/5] ^-- metastoreMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:09:56] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:09:56] : [Step 4/5] ^-- TxLog region [type=internal, persistence=true, lazyAlloc=false, [21:09:56] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:09:56] : [Step 4/5] ^-- volatileDsMemPlc region [type=user, persistence=false, lazyAlloc=true, [21:09:56] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB] [21:09:56] : [Step 4/5] ^-- Ignite persistence [used=0MB] [21:09:56] : [Step 4/5] [21:09:56] : [Step 4/5] [2021-11-19 21:09:56,873][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Starting binary memory restore for: [-2100569601, 1613773252] [21:09:57] : [Step 4/5] [2021-11-19 21:09:57,009][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=/opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0/cp/1637345392183-eed157b5-3499-42b4-8912-66c001f04117-START.bin, endMarker=/opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0/cp/1637345392183-eed157b5-3499-42b4-8912-66c001f04117-END.bin] [21:09:57] : [Step 4/5] [2021-11-19 21:09:57,010][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=81472, len=1963], lastMarked=WALPointer [idx=0, fileOff=81472, len=1963], lastCheckpointId=eed157b5-3499-42b4-8912-66c001f04117] [21:09:57] : [Step 4/5] [2021-11-19 21:09:57,118][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Found last checkpoint marker [cpId=eed157b5-3499-42b4-8912-66c001f04117, pos=WALPointer [idx=0, fileOff=81472, len=1963]] [21:09:57] : [Step 4/5] [2021-11-19 21:09:57,136][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Binary memory state restored at node startup [restoredPtr=WALPointer [idx=0, fileOff=361320, len=0]] [21:09:57] : [Step 4/5] [2021-11-19 21:09:57,139][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000000.wal, offset=361320, ver=2] [21:09:57] : [Step 4/5] [2021-11-19 21:09:57,145][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][GridCacheProcessor] Started cache in recovery mode [name=ignite-sys-cache, id=-2100569601, dataRegionName=sysMemPlc, mode=REPLICATED, atomicity=TRANSACTIONAL, backups=2147483647, mvcc=false] [21:09:57] : [Step 4/5] [2021-11-19 21:09:57,146][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=24.0 MiB, pages=5952, tableSize=474.2 KiB, replacementSize=768 B, checkpointBuffer=10.0 MiB] [21:09:57] : [Step 4/5] [2021-11-19 21:09:57,149][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][GridCacheProcessor] Started cache in recovery mode [name=encrypted, id=1613773252, dataRegionName=default, mode=PARTITIONED, atomicity=TRANSACTIONAL, backups=0, mvcc=false] [21:09:57] : [Step 4/5] [2021-11-19 21:09:57,150][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Binary recovery performed in 277 ms. [21:09:57] : [Step 4/5] [2021-11-19 21:09:57,150][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=/opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0/cp/1637345392183-eed157b5-3499-42b4-8912-66c001f04117-START.bin, endMarker=/opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0/cp/1637345392183-eed157b5-3499-42b4-8912-66c001f04117-END.bin] [21:09:57] : [Step 4/5] [2021-11-19 21:09:57,151][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Applying lost cache updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=81472, len=1963], lastCheckpointId=eed157b5-3499-42b4-8912-66c001f04117] [21:09:57] : [Step 4/5] [2021-11-19 21:09:57,614][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][GridEncryptionManager] Master key name loaded from WAL [masterKeyName=ignite.master.key2] [21:09:57] : [Step 4/5] [2021-11-19 21:09:57,673][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:09:58] : [Step 4/5] [2021-11-19 21:09:58,003][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=29, time=849 ms] [21:09:58] : [Step 4/5] [2021-11-19 21:09:58,004][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][GridCacheProcessor] Restoring partition state for local groups. [21:09:58] : [Step 4/5] [2021-11-19 21:09:58,022][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=2, partitionsProcessed=1124, time=20ms] [21:09:58] : [Step 4/5] [2021-11-19 21:09:58,389][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][TestTcpDiscoverySpi] Successfully bound to TCP port [port=47500, localHost=localhost/127.0.0.1, locNodeId=002cfb47-8eee-4a16-96e5-0f323891f000] [21:09:58] : [Step 4/5] [2021-11-19 21:09:58,391][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][GridEncryptionManager] Sending stored group keys to coordinator [grps=1613773252] [21:09:58] : [Step 4/5] [2021-11-19 21:09:58,398][INFO ][tcp-disco-srvr-[:47501]-#1005%grid-1%-#19244%grid-1%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=50393] [21:09:58] : [Step 4/5] [2021-11-19 21:09:58,398][INFO ][tcp-disco-srvr-[:47501]-#1005%grid-1%-#19244%grid-1%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=50393] [21:09:58] : [Step 4/5] [2021-11-19 21:09:58,399][INFO ][tcp-disco-sock-reader-[]-#1015%grid-1%-#19397%grid-1%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:50393, rmtPort=50393] [21:09:58] : [Step 4/5] [2021-11-19 21:09:58,400][INFO ][tcp-disco-sock-reader-[002cfb47 127.0.0.1:50393]-#1015%grid-1%-#19397%grid-1%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=002cfb47-8eee-4a16-96e5-0f323891f000, rmtAddr=/127.0.0.1:50393] [21:09:58] : [Step 4/5] [2021-11-19 21:09:58,404][INFO ][tcp-disco-srvr-[:47500]-#1014%grid-0%-#19396%grid-0%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=55479] [21:09:58] : [Step 4/5] [2021-11-19 21:09:58,404][INFO ][tcp-disco-srvr-[:47500]-#1014%grid-0%-#19396%grid-0%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=55479] [21:09:58] : [Step 4/5] [2021-11-19 21:09:58,405][INFO ][tcp-disco-sock-reader-[]-#1016%grid-0%-#19398%grid-0%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:55479, rmtPort=55479] [21:09:58] : [Step 4/5] [2021-11-19 21:09:58,405][INFO ][tcp-disco-sock-reader-[]-#1016%grid-0%-#19398%grid-0%][TestTcpDiscoverySpi] Received ping request from the remote node [rmtNodeId=107c1eca-eeb4-4ea1-a55f-a4fba30f4001, rmtAddr=/127.0.0.1:55479, rmtPort=55479] [21:09:58] : [Step 4/5] [2021-11-19 21:09:58,407][INFO ][tcp-disco-sock-reader-[]-#1016%grid-0%-#19398%grid-0%][TestTcpDiscoverySpi] Finished writing ping response [rmtNodeId=107c1eca-eeb4-4ea1-a55f-a4fba30f4001, rmtAddr=/127.0.0.1:55479, rmtPort=55479] [21:09:58] : [Step 4/5] [2021-11-19 21:09:58,407][INFO ][tcp-disco-sock-reader-[002cfb47 127.0.0.1:50393]-#1015%grid-1%-#19397%grid-1%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:50393, rmtPort=50393, rmtNodeId=002cfb47-8eee-4a16-96e5-0f323891f000] [21:09:58] : [Step 4/5] [2021-11-19 21:09:58,407][INFO ][tcp-disco-sock-reader-[]-#1016%grid-0%-#19398%grid-0%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:55479, rmtPort=55479, rmtNodeId=null] [21:09:58] : [Step 4/5] [2021-11-19 21:09:58,418][INFO ][tcp-disco-msg-worker-[crd]-#1004%grid-1%-#19243%grid-1%][TestTcpDiscoverySpi] New next node [newNext=TcpDiscoveryNode [id=002cfb47-8eee-4a16-96e5-0f323891f000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=0, intOrder=3, lastExchangeTime=1637345398393, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false]] [21:09:58] : [Step 4/5] [2021-11-19 21:09:58,418][INFO ][tcp-disco-srvr-[:47500]-#1014%grid-0%-#19396%grid-0%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=37637] [21:09:58] : [Step 4/5] [2021-11-19 21:09:58,419][INFO ][tcp-disco-srvr-[:47500]-#1014%grid-0%-#19396%grid-0%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=37637] [21:09:58] : [Step 4/5] [2021-11-19 21:09:58,419][INFO ][tcp-disco-sock-reader-[]-#1017%grid-0%-#19399%grid-0%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:37637, rmtPort=37637] [21:09:58] : [Step 4/5] [2021-11-19 21:09:58,420][INFO ][tcp-disco-sock-reader-[107c1eca 127.0.0.1:37637]-#1017%grid-0%-#19399%grid-0%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=107c1eca-eeb4-4ea1-a55f-a4fba30f4001, rmtAddr=/127.0.0.1:37637] [21:09:58] : [Step 4/5] [2021-11-19 21:09:58,424][INFO ][tcp-disco-msg-worker-[]-#1013%grid-0%-#19395%grid-0%][TestTcpDiscoverySpi] New next node [newNext=TcpDiscoveryNode [id=107c1eca-eeb4-4ea1-a55f-a4fba30f4001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637345398413, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false]] [21:09:58] : [Step 4/5] [2021-11-19 21:09:58,425][INFO ][tcp-disco-srvr-[:47501]-#1005%grid-1%-#19244%grid-1%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=59331] [21:09:58] : [Step 4/5] [2021-11-19 21:09:58,425][INFO ][tcp-disco-srvr-[:47501]-#1005%grid-1%-#19244%grid-1%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=59331] [21:09:58] : [Step 4/5] [2021-11-19 21:09:58,426][INFO ][tcp-disco-sock-reader-[]-#1018%grid-1%-#19400%grid-1%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:59331, rmtPort=59331] [21:09:58] : [Step 4/5] [2021-11-19 21:09:58,427][INFO ][tcp-disco-sock-reader-[002cfb47 127.0.0.1:59331]-#1018%grid-1%-#19400%grid-1%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=002cfb47-8eee-4a16-96e5-0f323891f000, rmtAddr=/127.0.0.1:59331] [21:09:58] : [Step 4/5] [2021-11-19 21:09:58,429][INFO ][disco-event-worker-#19250%grid-1%][GridDiscoveryManager] Added new node to topology: TcpDiscoveryNode [id=002cfb47-8eee-4a16-96e5-0f323891f000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=4, intOrder=3, lastExchangeTime=1637345398393, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false] [21:09:58] : [Step 4/5] [2021-11-19 21:09:58,430][INFO ][disco-event-worker-#19250%grid-1%][GridDiscoveryManager] Topology snapshot [ver=4, locNode=107c1eca, servers=2, clients=0, state=ACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=107c1eca-eeb4-4ea1-a55f-a4fba30f4001, consistentId=grid-1, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=002cfb47-8eee-4a16-96e5-0f323891f000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:09:58] : [Step 4/5] [2021-11-19 21:09:58,431][INFO ][disco-event-worker-#19250%grid-1%][GridDiscoveryManager] ^-- Baseline [id=0, size=2, online=2, offline=0] [21:09:58] : [Step 4/5] [2021-11-19 21:09:58,431][INFO ][exchange-worker-#19251%grid-1%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], crd=true, evt=NODE_JOINED, evtNode=002cfb47-8eee-4a16-96e5-0f323891f000, customEvt=null, allowMerge=true, exchangeFreeSwitch=false] [21:09:58] : [Step 4/5] [2021-11-19 21:09:58,432][INFO ][exchange-worker-#19251%grid-1%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], waitTime=0ms, futInfo=NA, mode=DISTRIBUTED] [21:09:58] : [Step 4/5] [2021-11-19 21:09:58,432][INFO ][exchange-worker-#19251%grid-1%][GridDhtPartitionsExchangeFuture] Finished waiting for partitions release latch: ServerLatch [permits=0, pendingAcks=HashSet [], super=CompletableLatch [id=CompletableLatchUid [id=exchange, topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0]]]] [21:09:58] : [Step 4/5] [2021-11-19 21:09:58,433][INFO ][exchange-worker-#19251%grid-1%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:09:58] : [Step 4/5] [2021-11-19 21:09:58,433][INFO ][exchange-worker-#19251%grid-1%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], crd=true] [21:09:58] : [Step 4/5] [2021-11-19 21:09:58,434][INFO ][tcp-disco-msg-worker-[107c1eca 127.0.0.1:47501]-#1013%grid-0%-#19395%grid-0%][GridEncryptionManager] Skip group key received from coordinator. Already exists. [grp=1613773252, keyId=0] [21:09:58] : [Step 4/5] [2021-11-19 21:09:58,435][INFO ][disco-notifier-worker-#19394%grid-0%][MvccProcessorImpl] Assigned mvcc coordinator [crd=MvccCoordinator [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], nodeId=107c1eca-eeb4-4ea1-a55f-a4fba30f4001, ver=1637345390938, local=false, initialized=false]] [21:09:58] : [Step 4/5] [2021-11-19 21:09:58,438][INFO ][sys-#19393%grid-0%][ClusterProcessor] Writing cluster ID and tag to metastorage on ready for write ClusterIdAndTag [id=f9f004b4-3864-44de-b14d-12acab81f510, tag=kind_golick] [21:09:58] : [Step 4/5] [2021-11-19 21:09:58,449][INFO ][exchange-worker-#19403%grid-0%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], crd=false, evt=NODE_JOINED, evtNode=002cfb47-8eee-4a16-96e5-0f323891f000, customEvt=null, allowMerge=true, exchangeFreeSwitch=false] [21:09:58] : [Step 4/5] [2021-11-19 21:09:58,449][INFO ][exchange-worker-#19403%grid-0%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0 [21:09:58] : [Step 4/5] [2021-11-19 21:09:58,451][INFO ][exchange-worker-#19403%grid-0%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000000.wal, offset=545357, ver=2] [21:09:58] : [Step 4/5] [2021-11-19 21:09:58,454][INFO ][exchange-worker-#19403%grid-0%][GridClusterStateProcessor] Writing BaselineTopology[id=0] [21:09:58] : [Step 4/5] [2021-11-19 21:09:58,460][INFO ][exchange-worker-#19403%grid-0%][GridCacheDatabaseSharedManager] Finish recovery performed in 10 ms. [21:09:58] : [Step 4/5] [2021-11-19 21:09:58,461][INFO ][exchange-worker-#19403%grid-0%][msg] Components activation performed in 12 ms. [21:09:58] : [Step 4/5] [2021-11-19 21:09:58,463][INFO ][sys-#19383%grid-0%][GridCacheProcessor] Finished recovery for cache [cache=encrypted, grp=encrypted, startVer=AffinityTopologyVersion [topVer=4, minorTopVer=0]] [21:09:58] : [Step 4/5] [2021-11-19 21:09:58,463][INFO ][exchange-worker-#19403%grid-0%][GridCacheProcessor] Finished recovery for cache [cache=ignite-sys-cache, grp=ignite-sys-cache, startVer=AffinityTopologyVersion [topVer=4, minorTopVer=0]] [21:09:58] : [Step 4/5] [2021-11-19 21:09:58,464][INFO ][exchange-worker-#19403%grid-0%][GridCacheProcessor] Starting caches on local join performed in 0 ms. [21:09:58] : [Step 4/5] [2021-11-19 21:09:58,465][INFO ][exchange-worker-#19403%grid-0%][GridDhtPartitionsExchangeFuture] Skipped waiting for partitions release future (local node is joining) [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0]] [21:09:58] : [Step 4/5] [2021-11-19 21:09:58,478][INFO ][grid-nio-worker-tcp-comm-1-#19187%TestRecordingCommunicationSpi%][TestRecordingCommunicationSpi] Accepted incoming communication connection [locAddr=/127.0.0.1:47101, rmtAddr=/127.0.0.1:37094] [21:09:58] : [Step 4/5] [2021-11-19 21:09:58,479][INFO ][db-checkpoint-thread-#19407%grid-0%][Checkpointer] Checkpoint started [checkpointId=1b9a1635-183d-459f-85b6-f4ab33413328, startPtr=WALPointer [idx=0, fileOff=749124, len=2520], checkpointBeforeLockTime=7ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=2ms, writeCheckpointEntryDuration=2ms, splitAndSortCpPagesDuration=0ms, pages=313, reason='node started'] [21:09:58] : [Step 4/5] [2021-11-19 21:09:58,480][INFO ][grid-nio-worker-tcp-comm-0-#19337%TestRecordingCommunicationSpi%][TestRecordingCommunicationSpi] Established outgoing communication connection [locAddr=/127.0.0.1:37094, rmtAddr=/127.0.0.1:47101] [21:09:58] : [Step 4/5] [2021-11-19 21:09:58,481][INFO ][exchange-worker-#19403%grid-0%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], crd=false] [21:09:58] : [Step 4/5] [2021-11-19 21:09:58,482][INFO ][sys-#19241%grid-1%][GridDhtPartitionsExchangeFuture] Coordinator received single message [ver=AffinityTopologyVersion [topVer=4, minorTopVer=0], node=002cfb47-8eee-4a16-96e5-0f323891f000, allReceived=true] [21:09:58] : [Step 4/5] [2021-11-19 21:09:58,482][INFO ][sys-#19241%grid-1%][GridDhtPartitionsExchangeFuture] Coordinator received all messages, try merge [ver=AffinityTopologyVersion [topVer=4, minorTopVer=0]] [21:09:58] : [Step 4/5] [2021-11-19 21:09:58,482][INFO ][sys-#19241%grid-1%][GridDhtPartitionsExchangeFuture] finishExchangeOnCoordinator [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=0]] [21:09:58] : [Step 4/5] [2021-11-19 21:09:58,500][INFO ][sys-#19241%grid-1%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], err=null, rebalanced=false, wasRebalanced=true] [21:09:58] : [Step 4/5] [2021-11-19 21:09:58,504][INFO ][sys-#19386%grid-0%][GridDhtPartitionsExchangeFuture] Received full message, will finish exchange [node=107c1eca-eeb4-4ea1-a55f-a4fba30f4001, resVer=AffinityTopologyVersion [topVer=4, minorTopVer=0]] [21:09:58] : [Step 4/5] [2021-11-19 21:09:58,505][INFO ][sys-#19241%grid-1%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=107c1eca-eeb4-4ea1-a55f-a4fba30f4001, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], evt=NODE_JOINED, evtNode=TcpDiscoveryNode [id=002cfb47-8eee-4a16-96e5-0f323891f000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=4, intOrder=3, lastExchangeTime=1637345398393, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=false, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0]] [21:09:58] : [Step 4/5] [2021-11-19 21:09:58,509][INFO ][exchange-worker-#19251%grid-1%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=4, minorTopVer=0], force=false, evt=NODE_JOINED, node=002cfb47-8eee-4a16-96e5-0f323891f000] [21:09:58] : [Step 4/5] [2021-11-19 21:09:58,510][INFO ][sys-#19241%grid-1%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (0 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Wait partitions release latch [latch=exchange]" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="After states restored callback" (0 ms), stage="WAL history reservation" (0 ms), stage="Waiting for all single messages" (48 ms), stage="Exchanges merge" (0 ms), stage="Affinity recalculation (crd)" (4 ms), stage="Collect update counters and create affinity messages" (2 ms), stage="Assign partitions states" (3 ms), stage="Validate partitions states" (0 ms), stage="Apply update counters" (1 ms), stage="Full message preparing" (4 ms), stage="Full message sending" (0 ms), stage="Exchange done" (10 ms), stage="Total time" (72 ms), Discovery lag=4 ms, Latest started node id=002cfb47-8eee-4a16-96e5-0f323891f000] [21:09:58] : [Step 4/5] [2021-11-19 21:09:58,512][INFO ][sys-#19241%grid-1%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], stage="Affinity initialization (node join) [grp=encrypted, crd=true]" (2 ms) (parent=Affinity recalculation (crd)), stage="Affinity initialization (node join) [grp=ignite-sys-cache, crd=true]" (0 ms) (parent=Affinity recalculation (crd))] [21:09:58] : [Step 4/5] [2021-11-19 21:09:58,518][INFO ][exchange-worker-#19251%grid-1%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], crd=true, evt=DISCOVERY_CUSTOM_EVT, evtNode=107c1eca-eeb4-4ea1-a55f-a4fba30f4001, customEvt=CacheAffinityChangeMessage [id=9c67d593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], exchId=null, partsMsg=null, exchangeNeeded=true], allowMerge=false, exchangeFreeSwitch=false] [21:09:58] : [Step 4/5] [2021-11-19 21:09:58,520][INFO ][exchange-worker-#19251%grid-1%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], waitTime=0ms, futInfo=NA, mode=DISTRIBUTED] [21:09:58] : [Step 4/5] [2021-11-19 21:09:58,535][INFO ][sys-#19386%grid-0%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], err=null, rebalanced=false, wasRebalanced=false] [21:09:58] : [Step 4/5] [2021-11-19 21:09:58,539][INFO ][sys-#19386%grid-0%][GridCacheProcessor] Finish proxy initialization, cacheName=ignite-sys-cache, localNodeId=002cfb47-8eee-4a16-96e5-0f323891f000 [21:09:58] : [Step 4/5] [2021-11-19 21:09:58,539][INFO ][sys-#19386%grid-0%][GridCacheProcessor] Finish proxy initialization, cacheName=encrypted, localNodeId=002cfb47-8eee-4a16-96e5-0f323891f000 [21:09:58] : [Step 4/5] [2021-11-19 21:09:58,540][INFO ][sys-#19386%grid-0%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=002cfb47-8eee-4a16-96e5-0f323891f000, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], evt=NODE_JOINED, evtNode=TcpDiscoveryNode [id=002cfb47-8eee-4a16-96e5-0f323891f000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=4, intOrder=3, lastExchangeTime=1637345398519, loc=true, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=false, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0]] [21:09:58] : [Step 4/5] [2021-11-19 21:09:58,540][INFO ][exchange-worker-#19403%grid-0%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=4, minorTopVer=0], force=false, evt=NODE_JOINED, node=002cfb47-8eee-4a16-96e5-0f323891f000] [21:09:58] : [Step 4/5] [2021-11-19 21:09:58,542][INFO ][sys-#19386%grid-0%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], stage="Waiting in exchange queue" (13 ms), stage="Exchange parameters initialization" (0 ms), stage="Components activation" (12 ms), stage="Determine exchange type" (2 ms), stage="Preloading notification" (0 ms), stage="Restore partition states" (0 ms), stage="After states restored callback" (9 ms), stage="WAL history reservation" (0 ms), stage="Waiting for Full message" (29 ms), stage="Affinity recalculation" (27 ms), stage="Full map updating" (3 ms), stage="Exchange done" (6 ms), stage="Total time" (101 ms)] [21:09:58] : [Step 4/5] [2021-11-19 21:09:58,544][INFO ][sys-#19386%grid-0%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], stage="Affinity fetch" (2 ms) (parent=Determine exchange type), stage="Restore partition states [grp=ignite-sys-cache]" (0 ms) (parent=Restore partition states), stage="Restore partition states [grp=encrypted]" (0 ms) (parent=Restore partition states), stage="Affinity initialization (local join) [grp=encrypted]" (22 ms) (parent=Affinity recalculation), stage="Affinity initialization (local join) [grp=ignite-sys-cache]" (5 ms) (parent=Affinity recalculation)] [21:09:58] : [Step 4/5] [2021-11-19 21:09:58,542][INFO ][exchange-worker-#19403%grid-0%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], crd=false, evt=DISCOVERY_CUSTOM_EVT, evtNode=107c1eca-eeb4-4ea1-a55f-a4fba30f4001, customEvt=CacheAffinityChangeMessage [id=9c67d593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], exchId=null, partsMsg=null, exchangeNeeded=true], allowMerge=false, exchangeFreeSwitch=false] [21:09:58] : [Step 4/5] [2021-11-19 21:09:58,546][INFO ][exchange-worker-#19403%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], waitTime=0ms, futInfo=NA, mode=DISTRIBUTED] [21:09:58] : [Step 4/5] [2021-11-19 21:09:58,547][INFO ][exchange-worker-#19251%grid-1%][GridDhtPartitionsExchangeFuture] Finished waiting for partitions release latch: ServerLatch [permits=0, pendingAcks=HashSet [], super=CompletableLatch [id=CompletableLatchUid [id=exchange, topVer=AffinityTopologyVersion [topVer=4, minorTopVer=1]]]] [21:09:58] : [Step 4/5] [2021-11-19 21:09:58,548][INFO ][exchange-worker-#19403%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partitions release latch: ClientLatch [coordinator=TcpDiscoveryNode [id=107c1eca-eeb4-4ea1-a55f-a4fba30f4001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637345398413, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], ackSent=true, super=CompletableLatch [id=CompletableLatchUid [id=exchange, topVer=AffinityTopologyVersion [topVer=4, minorTopVer=1]]]] [21:09:58] : [Step 4/5] [2021-11-19 21:09:58,548][INFO ][exchange-worker-#19251%grid-1%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:09:58] : [Step 4/5] [2021-11-19 21:09:58,549][INFO ][exchange-worker-#19403%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:09:58] : [Step 4/5] [2021-11-19 21:09:58,550][INFO ][exchange-worker-#19251%grid-1%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], crd=true] [21:09:58] : [Step 4/5] [2021-11-19 21:09:58,551][INFO ][exchange-worker-#19403%grid-0%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], crd=false] [21:09:58] : [Step 4/5] [2021-11-19 21:09:58,552][INFO ][sys-#19240%grid-1%][GridDhtPartitionsExchangeFuture] Coordinator received single message [ver=AffinityTopologyVersion [topVer=4, minorTopVer=1], node=002cfb47-8eee-4a16-96e5-0f323891f000, allReceived=true] [21:09:58] : [Step 4/5] [2021-11-19 21:09:58,552][INFO ][sys-#19240%grid-1%][GridDhtPartitionsExchangeFuture] finishExchangeOnCoordinator [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=1]] [21:09:58] : [Step 4/5] [2021-11-19 21:09:58,557][INFO ][sys-#19240%grid-1%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], err=null, rebalanced=true, wasRebalanced=false] [21:09:58] : [Step 4/5] [2021-11-19 21:09:58,558][INFO ][sys-#19393%grid-0%][GridDhtPartitionsExchangeFuture] Received full message, will finish exchange [node=107c1eca-eeb4-4ea1-a55f-a4fba30f4001, resVer=AffinityTopologyVersion [topVer=4, minorTopVer=1]] [21:09:58] : [Step 4/5] [2021-11-19 21:09:58,559][INFO ][sys-#19240%grid-1%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=107c1eca-eeb4-4ea1-a55f-a4fba30f4001, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=107c1eca-eeb4-4ea1-a55f-a4fba30f4001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637345398519, loc=true, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=4, minorTopVer=1]] [21:09:58] : [Step 4/5] [2021-11-19 21:09:58,561][INFO ][sys-#19393%grid-0%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], err=null, rebalanced=true, wasRebalanced=false] [21:09:58] : [Step 4/5] [2021-11-19 21:09:58,561][INFO ][exchange-worker-#19251%grid-1%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=4, minorTopVer=1], force=false, evt=DISCOVERY_CUSTOM_EVT, node=107c1eca-eeb4-4ea1-a55f-a4fba30f4001] [21:09:58] : [Step 4/5] [2021-11-19 21:09:58,562][INFO ][sys-#19240%grid-1%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (1 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Wait partitions release latch [latch=exchange]" (27 ms), stage="Wait partitions release [latch=exchange]" (1 ms), stage="After states restored callback" (0 ms), stage="WAL history reservation" (0 ms), stage="Waiting for all single messages" (2 ms), stage="Affinity recalculation (crd)" (0 ms), stage="Collect update counters and create affinity messages" (0 ms), stage="Validate partitions states" (0 ms), stage="Apply update counters" (0 ms), stage="Full message preparing" (2 ms), stage="Full message sending" (0 ms), stage="Exchange done" (5 ms), stage="Total time" (38 ms), Discovery lag=1 ms, Latest started node id=002cfb47-8eee-4a16-96e5-0f323891f000] [21:09:58] : [Step 4/5] [2021-11-19 21:09:58,564][INFO ][exchange-worker-#19403%grid-0%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=4, minorTopVer=1], force=false, evt=DISCOVERY_CUSTOM_EVT, node=107c1eca-eeb4-4ea1-a55f-a4fba30f4001] [21:09:58] : [Step 4/5] [2021-11-19 21:09:58,563][INFO ][sys-#19393%grid-0%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=002cfb47-8eee-4a16-96e5-0f323891f000, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=107c1eca-eeb4-4ea1-a55f-a4fba30f4001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637345398413, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=4, minorTopVer=1]] [21:09:58] : [Step 4/5] [2021-11-19 21:09:58,567][INFO ][sys-#19393%grid-0%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], stage="Waiting in exchange queue" (23 ms), stage="Exchange parameters initialization" (3 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Wait partitions release latch [latch=exchange]" (2 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="After states restored callback" (0 ms), stage="WAL history reservation" (0 ms), stage="Waiting for Full message" (8 ms), stage="Affinity recalculation" (0 ms), stage="Full map updating" (2 ms), stage="Exchange done" (5 ms), stage="Total time" (43 ms)] [21:09:58] : [Step 4/5] [2021-11-19 21:09:58,566][INFO ][sys-#19240%grid-1%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], stage="Affinity change by custom message [grp=ignite-sys-cache]" (0 ms) (parent=Determine exchange type)] [21:09:58] : [Step 4/5] [2021-11-19 21:09:58,569][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] To start Console Management & Monitoring run ignitevisorcmd.{sh|bat} [21:09:58] : [Step 4/5] [2021-11-19 21:09:58,569][INFO ][sys-#19393%grid-0%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], stage="Affinity change by custom message [grp=ignite-sys-cache]" (0 ms) (parent=Determine exchange type)] [21:09:58] : [Step 4/5] [2021-11-19 21:09:58,720][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] [21:09:58] : [Step 4/5] [21:09:58] : [Step 4/5] >>> +-------------------------------------------+ [21:09:58] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:09:58] : [Step 4/5] >>> +-------------------------------------------+ [21:09:58] : [Step 4/5] >>> OS name: Linux 4.15.0-151-generic amd64 [21:09:58] : [Step 4/5] >>> CPU(s): 24 [21:09:58] : [Step 4/5] >>> Heap: 2.0GB [21:09:58] : [Step 4/5] >>> VM name: 16724@c4dfe9a430b2 [21:09:58] : [Step 4/5] >>> Ignite instance name: grid-0 [21:09:58] : [Step 4/5] >>> Local node [ID=002CFB47-8EEE-4A16-96E5-0F323891F000, order=4, clientMode=false] [21:09:58] : [Step 4/5] >>> Local node addresses: [127.0.0.1] [21:09:58] : [Step 4/5] >>> Local ports: TCP:10800 TCP:47100 TCP:47500 [21:09:58] : [Step 4/5] [21:09:58] : [Step 4/5] [2021-11-19 21:09:58,721][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][GridDiscoveryManager] Topology snapshot [ver=4, locNode=002cfb47, servers=2, clients=0, state=ACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=107c1eca-eeb4-4ea1-a55f-a4fba30f4001, consistentId=grid-1, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=002cfb47-8eee-4a16-96e5-0f323891f000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:09:58] : [Step 4/5] [2021-11-19 21:09:58,721][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][GridDiscoveryManager] ^-- Baseline [id=0, size=2, online=2, offline=0] [21:09:58] : [Step 4/5] [2021-11-19 21:09:58,721][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][G] Node started : [stage="Configure system pool" (0 ms),stage="Start managers" (187 ms),stage="Configure binary metadata" (1 ms),stage="Start processors" (136 ms),stage="Start 'StanByClusterTestProvider' plugin" (0 ms),stage="Start 'PageMemory tracker plugin' plugin" (0 ms),stage="Start 'TestDistibutedConfigurationPlugin' plugin" (0 ms),stage="Start 'NodeValidationPluginProvider' plugin" (0 ms),stage="Init metastore" (407 ms),stage="Init and start regions" (5 ms),stage="Restore binary memory" (277 ms),stage="Restore logical state" (871 ms),stage="Finish recovery" (366 ms),stage="Join topology" (47 ms),stage="Await transition" (4 ms),stage="Await exchange" (281 ms),stage="Total time" (2582 ms)] [21:09:58] : [Step 4/5] [2021-11-19 21:09:58,722][INFO ][test-runner-#19013%encryption.MasterKeyChangeTest%][root] Node started with the following configuration [id=002cfb47-8eee-4a16-96e5-0f323891f000, marshaller=BinaryMarshaller [], discovery=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=5000, ackTimeout=5000, marsh=JdkMarshaller [clsFilter=org.apache.ignite.marshaller.MarshallerUtils$1@15508ea6], reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], binaryCfg=null, lateAff=true] [21:09:58] : [Step 4/5] [2021-11-19 21:09:58,725][INFO ][exchange-worker-#19251%grid-1%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=2], crd=true, evt=DISCOVERY_CUSTOM_EVT, evtNode=107c1eca-eeb4-4ea1-a55f-a4fba30f4001, customEvt=DynamicCacheChangeBatch [id=ad67d593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqs=ArrayList [DynamicCacheChangeRequest [cacheName=encrypted, hasCfg=false, nodeId=107c1eca-eeb4-4ea1-a55f-a4fba30f4001, clientStartOnly=false, stop=false, destroy=false, disabledAfterStart=false]], exchangeActions=ExchangeActions [startCaches=null, stopCaches=null, startGrps=[], stopGrps=[], resetParts=[encrypted], stateChangeRequest=null], startCaches=false], allowMerge=false, exchangeFreeSwitch=false] [21:09:58] : [Step 4/5] [2021-11-19 21:09:58,726][INFO ][exchange-worker-#19403%grid-0%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=2], crd=false, evt=DISCOVERY_CUSTOM_EVT, evtNode=107c1eca-eeb4-4ea1-a55f-a4fba30f4001, customEvt=DynamicCacheChangeBatch [id=ad67d593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqs=ArrayList [DynamicCacheChangeRequest [cacheName=encrypted, hasCfg=false, nodeId=107c1eca-eeb4-4ea1-a55f-a4fba30f4001, clientStartOnly=false, stop=false, destroy=false, disabledAfterStart=false]], exchangeActions=ExchangeActions [startCaches=null, stopCaches=null, startGrps=[], stopGrps=[], resetParts=[encrypted], stateChangeRequest=null], startCaches=false], allowMerge=false, exchangeFreeSwitch=false] [21:09:58]W: [org.apache.ignite:ignite-core] [2021-11-19 21:09:58,727][WARN ][exchange-worker-#19251%grid-1%][CacheAffinitySharedManager] Cache group 'encrypted' brings high overhead for its metainformation in data region 'default'. Metainformation required for its partitions (522 partitions, 4096 bytes per partition, 2 MBs total) will consume more than 15% of data region memory (10 MBs). It may lead to critical errors on the node and cluster instability. Please reduce number of partitions, add more memory to the data region or add more server nodes for this cache group. [21:09:58]W: [org.apache.ignite:ignite-core] [2021-11-19 21:09:58,728][WARN ][sys-#19384%grid-0%][CacheAffinitySharedManager] Cache group 'encrypted' brings high overhead for its metainformation in data region 'default'. Metainformation required for its partitions (502 partitions, 4096 bytes per partition, 1 MBs total) will consume more than 15% of data region memory (10 MBs). It may lead to critical errors on the node and cluster instability. Please reduce number of partitions, add more memory to the data region or add more server nodes for this cache group. [21:09:58] : [Step 4/5] [2021-11-19 21:09:58,729][INFO ][exchange-worker-#19251%grid-1%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=2], waitTime=0ms, futInfo=NA, mode=DISTRIBUTED] [21:09:58] : [Step 4/5] [2021-11-19 21:09:58,729][INFO ][exchange-worker-#19403%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=2], waitTime=0ms, futInfo=NA, mode=DISTRIBUTED] [21:09:58] : [Step 4/5] [2021-11-19 21:09:58,730][INFO ][exchange-worker-#19251%grid-1%][GridDhtPartitionsExchangeFuture] Finished waiting for partitions release latch: ServerLatch [permits=0, pendingAcks=HashSet [], super=CompletableLatch [id=CompletableLatchUid [id=exchange, topVer=AffinityTopologyVersion [topVer=4, minorTopVer=2]]]] [21:09:58] : [Step 4/5] [2021-11-19 21:09:58,731][INFO ][exchange-worker-#19403%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partitions release latch: ClientLatch [coordinator=TcpDiscoveryNode [id=107c1eca-eeb4-4ea1-a55f-a4fba30f4001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637345398413, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], ackSent=true, super=CompletableLatch [id=CompletableLatchUid [id=exchange, topVer=AffinityTopologyVersion [topVer=4, minorTopVer=2]]]] [21:09:58] : [Step 4/5] [2021-11-19 21:09:58,732][INFO ][exchange-worker-#19403%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=2], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:09:58] : [Step 4/5] [2021-11-19 21:09:58,731][INFO ][exchange-worker-#19251%grid-1%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=2], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:09:58] : [Step 4/5] [2021-11-19 21:09:58,734][INFO ][exchange-worker-#19251%grid-1%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=2], crd=true] [21:09:58] : [Step 4/5] [2021-11-19 21:09:58,735][INFO ][exchange-worker-#19403%grid-0%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=2], crd=false] [21:09:58] : [Step 4/5] [2021-11-19 21:09:58,736][INFO ][sys-#19220%grid-1%][GridDhtPartitionsExchangeFuture] Coordinator received single message [ver=AffinityTopologyVersion [topVer=4, minorTopVer=2], node=002cfb47-8eee-4a16-96e5-0f323891f000, allReceived=true] [21:09:58] : [Step 4/5] [2021-11-19 21:09:58,736][INFO ][sys-#19220%grid-1%][GridDhtPartitionsExchangeFuture] finishExchangeOnCoordinator [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=2]] [21:09:58] : [Step 4/5] [2021-11-19 21:09:58,745][INFO ][sys-#19220%grid-1%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=4, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=2], err=null, rebalanced=true, wasRebalanced=true] [21:09:58] : [Step 4/5] [2021-11-19 21:09:58,746][INFO ][sys-#19374%grid-0%][GridDhtPartitionsExchangeFuture] Received full message, will finish exchange [node=107c1eca-eeb4-4ea1-a55f-a4fba30f4001, resVer=AffinityTopologyVersion [topVer=4, minorTopVer=2]] [21:09:58] : [Step 4/5] [2021-11-19 21:09:58,747][INFO ][sys-#19220%grid-1%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=107c1eca-eeb4-4ea1-a55f-a4fba30f4001, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=2], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=107c1eca-eeb4-4ea1-a55f-a4fba30f4001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637345398720, loc=true, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=4, minorTopVer=2]] [21:09:58] : [Step 4/5] [2021-11-19 21:09:58,748][INFO ][sys-#19220%grid-1%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=4, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=2], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (1 ms), stage="Update caches registry" (0 ms), stage="Start caches" (0 ms), stage="Affinity initialization on cache group start" (0 ms), stage="Determine exchange type" (2 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (1 ms), stage="Wait partitions release latch [latch=exchange]" (1 ms), stage="Wait partitions release [latch=exchange]" (2 ms), stage="After states restored callback" (0 ms), stage="WAL history reservation" (0 ms), stage="Waiting for all single messages" (2 ms), stage="Affinity recalculation (crd)" (0 ms), stage="Collect update counters and create affinity messages" (0 ms), stage="Assign partitions states" (1 ms), stage="Validate partitions states" (0 ms), stage="Ideal affinity diff calculation (enforced)" (3 ms), stage="Apply update counters" (0 ms), stage="Full message preparing" (2 ms), stage="Full message sending" (0 ms), stage="Exchange done" (2 ms), stage="Total time" (17 ms), Discovery lag=1 ms, Latest started node id=002cfb47-8eee-4a16-96e5-0f323891f000] [21:09:58] : [Step 4/5] [2021-11-19 21:09:58,747][INFO ][exchange-worker-#19251%grid-1%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=4, minorTopVer=2], force=false, evt=DISCOVERY_CUSTOM_EVT, node=107c1eca-eeb4-4ea1-a55f-a4fba30f4001] [21:09:58] : [Step 4/5] [2021-11-19 21:09:58,753][INFO ][sys-#19220%grid-1%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=4, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=2], stage="Affinity centralized initialization (crd) [grp=ignite-sys-cache, crd=true]" (0 ms) (parent=Determine exchange type), stage="Affinity centralized initialization (crd) [grp=encrypted, crd=true]" (0 ms) (parent=Determine exchange type), stage="Affinity recalculation (partitions availability) [grp=encrypted]" (3 ms) (parent=Ideal affinity diff calculation (enforced)), stage="Affinity recalculation (partitions availability) [grp=ignite-sys-cache]" (0 ms) (parent=Ideal affinity diff calculation (enforced))] [21:09:58] : [Step 4/5] [2021-11-19 21:09:58,751][INFO ][sys-#19374%grid-0%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=4, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=2], err=null, rebalanced=true, wasRebalanced=true] [21:09:58] : [Step 4/5] [2021-11-19 21:09:58,757][INFO ][sys-#19374%grid-0%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=002cfb47-8eee-4a16-96e5-0f323891f000, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=2], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=107c1eca-eeb4-4ea1-a55f-a4fba30f4001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637345398413, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=4, minorTopVer=2]] [21:09:58] : [Step 4/5] [2021-11-19 21:09:58,757][INFO ][exchange-worker-#19403%grid-0%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=4, minorTopVer=2], force=false, evt=DISCOVERY_CUSTOM_EVT, node=107c1eca-eeb4-4ea1-a55f-a4fba30f4001] [21:09:58] : [Step 4/5] [2021-11-19 21:09:58,758][INFO ][sys-#19374%grid-0%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=4, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=2], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (1 ms), stage="Update caches registry" (0 ms), stage="Start caches" (0 ms), stage="Affinity initialization on cache group start" (0 ms), stage="Determine exchange type" (1 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Wait partitions release latch [latch=exchange]" (2 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="After states restored callback" (0 ms), stage="WAL history reservation" (0 ms), stage="Waiting for Full message" (12 ms), stage="Affinity recalculation" (1 ms), stage="Full map updating" (3 ms), stage="Exchange done" (6 ms), stage="Total time" (26 ms)] [21:09:58] : [Step 4/5] [2021-11-19 21:09:58,760][INFO ][sys-#19374%grid-0%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=4, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=2], stage="Affinity centralized initialization (crd) [grp=ignite-sys-cache, crd=false]" (0 ms) (parent=Determine exchange type), stage="Affinity centralized initialization (crd) [grp=encrypted, crd=false]" (0 ms) (parent=Determine exchange type), stage="Affinity applying from full message [grp=encrypted]" (1 ms) (parent=Affinity recalculation), stage="Affinity applying from full message [grp=ignite-sys-cache]" (0 ms) (parent=Affinity recalculation)] [21:09:58] : [Step 4/5] [21:09:58] >>> Stopping test: MasterKeyChangeTest#testRecoveryFromWalWithCacheOperations in 9216 ms <<< [21:09:58] : [Step 4/5] [2021-11-19 21:09:58,789][INFO ][main][root] >>> Stopping test: MasterKeyChangeTest#testRecoveryFromWalWithCacheOperations in 9216 ms <<< [21:09:58] : [Step 4/5] [21:09:58] >>> Heap: 269 MB used / 1933 MB commited / 1933 MB max <<< [21:09:58] : [Step 4/5] [2021-11-19 21:09:58,789][INFO ][main][root] >>> Heap: 269 MB used / 1933 MB commited / 1933 MB max <<< [21:09:58] : [Step 4/5] [21:09:58] >>> Non-Heap: 155 MB used / 182 MB commited / 0 MB max <<< [21:09:58] : [Step 4/5] [2021-11-19 21:09:58,790][INFO ][main][root] >>> Non-Heap: 155 MB used / 182 MB commited / 0 MB max <<< [21:09:58] : [Step 4/5] [21:09:58] >>> Starting test: MasterKeyChangeTest#testNodeFailsDuringRotationNotCoordinatorPerform <<< [21:09:58] : [Step 4/5] [2021-11-19 21:09:58,791][INFO ][main][root] >>> Starting test: MasterKeyChangeTest#testNodeFailsDuringRotationNotCoordinatorPerform <<< [21:09:58] : [Step 4/5] [21:09:58] >>> Heap: 269 MB used / 1933 MB commited / 1933 MB max <<< [21:09:58] : [Step 4/5] [2021-11-19 21:09:58,792][INFO ][main][root] >>> Heap: 269 MB used / 1933 MB commited / 1933 MB max <<< [21:09:58] : [Step 4/5] [21:09:58] >>> Non-Heap: 155 MB used / 182 MB commited / 0 MB max <<< [21:09:58] : [Step 4/5] [2021-11-19 21:09:58,792][INFO ][main][root] >>> Non-Heap: 155 MB used / 182 MB commited / 0 MB max <<< [21:09:58] : [Step 4/5] [2021-11-19 21:09:58,793][INFO ][main][root] >>> Stopping grid [name=grid-1, id=107c1eca-eeb4-4ea1-a55f-a4fba30f4001] [21:09:58] : [Step 4/5] [2021-11-19 21:09:58,994][INFO ][db-checkpoint-thread-#19265%grid-1%][Checkpointer] Checkpoint started [checkpointId=ff19126d-b609-4021-b6fc-8b7be925f5f5, startPtr=WALPointer [idx=0, fileOff=493580, len=11871], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=1ms, checkpointLockHoldTime=5ms, walCpRecordFsyncDuration=56ms, writeCheckpointEntryDuration=129ms, splitAndSortCpPagesDuration=0ms, pages=295, reason='timeout'] [21:09:59] : [Step 4/5] [2021-11-19 21:09:59,001][INFO ][tcp-disco-sock-reader-[002cfb47 127.0.0.1:59331]-#1018%grid-1%-#19400%grid-1%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:59331, rmtPort=59331, rmtNodeId=002cfb47-8eee-4a16-96e5-0f323891f000] [21:09:59]W: [org.apache.ignite:ignite-core] [2021-11-19 21:09:59,002][WARN ][tcp-disco-sock-reader-[00f25b7e 127.0.0.1:46009]-#1008%grid-1%-#19247%grid-1%][TestTcpDiscoverySpi] Failed to shutdown socket [21:09:59]W: [org.apache.ignite:ignite-core] java.net.SocketException: Socket output is already shutdown [21:09:59]W: [org.apache.ignite:ignite-core] at java.net.Socket.shutdownOutput(Socket.java:1572) [21:09:59]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.close(IgniteUtils.java:4247) [21:09:59]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.discovery.tcp.ServerImpl$SocketReader.body(ServerImpl.java:7370) [21:09:59]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.IgniteSpiThread.run(IgniteSpiThread.java:58) [21:09:59] : [Step 4/5] [2021-11-19 21:09:59,002][INFO ][disco-event-worker-#19402%grid-0%][GridDiscoveryManager] Node left topology: TcpDiscoveryNode [id=107c1eca-eeb4-4ea1-a55f-a4fba30f4001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637345398413, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false] [21:09:59] : [Step 4/5] [2021-11-19 21:09:59,005][INFO ][tcp-disco-sock-reader-[00f25b7e 127.0.0.1:46009]-#1008%grid-1%-#19247%grid-1%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:46009, rmtPort=46009, rmtNodeId=00f25b7e-9e72-4811-a52d-4f0fd1043000] [21:09:59] : [Step 4/5] [2021-11-19 21:09:59,006][INFO ][disco-event-worker-#19402%grid-0%][GridDiscoveryManager] Topology snapshot [ver=5, locNode=002cfb47, servers=1, clients=0, state=ACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=002cfb47-8eee-4a16-96e5-0f323891f000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:09:59] : [Step 4/5] [2021-11-19 21:09:59,008][INFO ][main][GridCacheProcessor] Stopped cache [cacheName=ignite-sys-cache] [21:09:59] : [Step 4/5] [2021-11-19 21:09:59,009][INFO ][disco-event-worker-#19402%grid-0%][GridDiscoveryManager] Coordinator changed [prev=TcpDiscoveryNode [id=107c1eca-eeb4-4ea1-a55f-a4fba30f4001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637345398413, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], cur=TcpDiscoveryNode [id=002cfb47-8eee-4a16-96e5-0f323891f000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=4, intOrder=3, lastExchangeTime=1637345398995, loc=true, ver=2.13.0#20211119-sha1:00000000, isClient=false]] [21:09:59] : [Step 4/5] [2021-11-19 21:09:59,010][INFO ][main][GridCacheProcessor] Stopped cache [cacheName=encrypted] [21:09:59] : [Step 4/5] [2021-11-19 21:09:59,011][INFO ][disco-event-worker-#19402%grid-0%][GridDiscoveryManager] ^-- Baseline [id=0, size=2, online=1, offline=1] [21:09:59] : [Step 4/5] [2021-11-19 21:09:59,012][INFO ][disco-event-worker-#19402%grid-0%][MvccProcessorImpl] Assigned mvcc coordinator [crd=MvccCoordinator [topVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], nodeId=002cfb47-8eee-4a16-96e5-0f323891f000, ver=1637345390940, local=true, initialized=false]] [21:09:59] : [Step 4/5] [2021-11-19 21:09:59,015][INFO ][exchange-worker-#19403%grid-0%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], crd=true, evt=NODE_LEFT, evtNode=107c1eca-eeb4-4ea1-a55f-a4fba30f4001, customEvt=null, allowMerge=false, exchangeFreeSwitch=true] [21:09:59] : [Step 4/5] [2021-11-19 21:09:59,015][INFO ][sys-#19391%grid-0%][ExchangeLatchManager] Become new coordinator 002cfb47-8eee-4a16-96e5-0f323891f000 [21:09:59] : [Step 4/5] [2021-11-19 21:09:59,023][INFO ][exchange-worker-#19403%grid-0%][GridAffinityAssignmentCache] Local node affinity assignment distribution is not ideal [cache=encrypted, expectedPrimary=1024.00, actualPrimary=502, expectedBackups=0.00, actualBackups=0, warningThreshold=50.00%] [21:09:59] : [Step 4/5] [2021-11-19 21:09:59,024][INFO ][exchange-worker-#19403%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:09:59]W: [org.apache.ignite:ignite-core] [2021-11-19 21:09:59,013][WARN ][grid-nio-worker-tcp-comm-0-#19337%TestRecordingCommunicationSpi%][TestRecordingCommunicationSpi] Failed to shutdown socket [21:09:59]W: [org.apache.ignite:ignite-core] java.nio.channels.ClosedChannelException [21:09:59]W: [org.apache.ignite:ignite-core] at sun.nio.ch.SocketChannelImpl.shutdownOutput(SocketChannelImpl.java:795) [21:09:59]W: [org.apache.ignite:ignite-core] at sun.nio.ch.SocketAdaptor.shutdownOutput(SocketAdaptor.java:407) [21:09:59]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.close(IgniteUtils.java:4247) [21:09:59]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.closeKey(GridNioServer.java:2784) [21:09:59]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.close(GridNioServer.java:2835) [21:09:59]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.close(GridNioServer.java:2794) [21:09:59]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.bodyInternal(GridNioServer.java:2157) [21:09:59]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.body(GridNioServer.java:1910) [21:09:59]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:125) [21:09:59]W: [org.apache.ignite:ignite-core] at java.lang.Thread.run(Thread.java:748) [21:09:59] : [Step 4/5] [2021-11-19 21:09:59,027][INFO ][exchange-worker-#19403%grid-0%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], err=null, rebalanced=true, wasRebalanced=true] [21:09:59]W: [org.apache.ignite:ignite-core] [2021-11-19 21:09:59,029][WARN ][exchange-worker-#19403%grid-0%][GridDhtPartitionTopologyImpl] Detected lost partitions [grp=encrypted, parts=[0, 2, 4, 6-7, 10-11, 14, 17, 21, 24-30, 32, 37, 40, 44, 47-52, 54, 57, 59, 62-64, 67-68, 74-75, 78, 81, 87-88, 91, 97, 99, 101-102, 104-107, 113-114, 116, 118, 120, 122, 124, 135-136, 138, 140-145, 147, 149-152, 154-156, 159-160, 162-164, 169, 172, 175-177, 180, 184-187, 190-191, 194, 196-202, 204-205, 209-210, 212, 214, 216, 219-224, 226, 229-232, 237, 239, 241, 243-245, 247, 249-251, 255, 257, 261, 265, 269, 272-273, 276-277, 281-282, 285, 287, 289-291, 293-297, 299, 301-304, 306, 308-309, 311-312, 315-317, 319, 322, 325-326, 328-330, 336, 339, 341, 344-346, 350, 352-354, 357-361, 363, 366-367, 371-373, 376-380, 383, 385, 387-388, 390, 392, 395-397, 400, 402, 405, 408-411, 416, 420, 422, 424-425, 429, 433, 435-438, 440-441, 445-446, 450, 452-453, 455-456, 458, 460, 462-463, 465-468, 470, 474-475, 480, 488, 490-492, 495, 497, 499-512, 516, 525, 527-531, 535, 537-538, 541-542, 545-546, 548-552, 554-555, 558, 562-564, 567-569, 572, 574, 579-580, 582-585, 587, 590-591, 594, 596, 600, 602, 604, 607-614, 617-620, 623-624, 627-629, 632-633, 636, 638, 640-642, 645-646, 648-649, 657-662, 664-665, 668-672, 677-678, 682-684, 686, 689, 692-693, 695-697, 699, 706-707, 709-710, 712-714, 716-717, 719-721, 723-728, 730-732, 734-735, 739, 742, 746, 749-750, 752, 754, 756, 762, 768-770, 772-775, 778, 780, 783-787, 789-791, 793, 796, 798-801, 803, 806, 809-812, 814, 816-817, 819, 822-825, 827-829, 832-833, 836-837, 839-840, 846, 848-851, 853-854, 857-858, 860, 863-864, 866, 868-871, 873-875, 877-878, 884, 888-889, 896-897, 900, 905-907, 914-915, 917, 919-920, 923-925, 931-933, 936, 940, 942, 944-945, 948, 950-951, 954, 956-958, 962, 965-970, 972, 975-976, 978-980, 983, 985, 988, 990, 993-994, 997-998, 1000, 1003-1004, 1007, 1009, 1014, 1016, 1018-1019], topVer=AffinityTopologyVersion [topVer=5, minorTopVer=0]] [21:09:59] : [Step 4/5] [2021-11-19 21:09:59,039][INFO ][exchange-worker-#19403%grid-0%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=002cfb47-8eee-4a16-96e5-0f323891f000, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], evt=NODE_LEFT, evtNode=TcpDiscoveryNode [id=107c1eca-eeb4-4ea1-a55f-a4fba30f4001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637345398413, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=5, minorTopVer=0]] [21:09:59] : [Step 4/5] [2021-11-19 21:09:59,088][INFO ][exchange-worker-#19403%grid-0%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (7 ms), stage="Determine exchange type" (1 ms), stage="Preloading notification" (0 ms), stage="After states restored callback" (0 ms), stage="WAL history reservation" (0 ms), stage="Finalize update counters" (0 ms), stage="Detect lost partitions" (12 ms), stage="Exchange done" (49 ms), stage="Total time" (69 ms)] [21:09:59] : [Step 4/5] [2021-11-19 21:09:59,090][INFO ][exchange-worker-#19403%grid-0%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], stage="Affinity initialization (exchange-free switch on fully-rebalanced topology) [grp=encrypted]" (1 ms) (parent=Determine exchange type), stage="Affinity initialization (exchange-free switch on fully-rebalanced topology) [grp=ignite-sys-cache]" (0 ms) (parent=Determine exchange type)] [21:09:59] : [Step 4/5] [2021-11-19 21:09:59,091][INFO ][exchange-worker-#19403%grid-0%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], crd=true] [21:09:59] : [Step 4/5] [2021-11-19 21:09:59,092][INFO ][exchange-worker-#19403%grid-0%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=5, minorTopVer=0], force=false, evt=NODE_LEFT, node=107c1eca-eeb4-4ea1-a55f-a4fba30f4001] [21:09:59] : [Step 4/5] [2021-11-19 21:09:59,743][INFO ][db-checkpoint-thread-#19407%grid-0%][Checkpointer] Checkpoint finished [cpId=1b9a1635-183d-459f-85b6-f4ab33413328, pages=313, markPos=WALPointer [idx=0, fileOff=749124, len=2520], walSegmentsCovered=[], markDuration=7ms, pagesWrite=37ms, fsync=1225ms, total=1276ms] [21:09:59] : [Step 4/5] [2021-11-19 21:09:59,793][INFO ][main][FilePageStoreManager] Cleanup cache stores [total=4, left=0, cleanFiles=false] [21:09:59] : [Step 4/5] [2021-11-19 21:09:59,795][INFO ][main][GridDeploymentLocalStore] Removed undeployed class: GridDeployment [ts=1637345392199, depMode=SHARED, clsLdr=IsolatedClassLoader{roleName='test'}, clsLdrId=4157d593d71-107c1eca-eeb4-4ea1-a55f-a4fba30f4001, userVer=0, loc=true, sampleClsName=org.apache.ignite.internal.processors.cache.distributed.dht.preloader.IgniteDhtPartitionsToReloadMap, pendingUndeploy=false, undeployed=true, usage=0] [21:09:59] : [Step 4/5] [2021-11-19 21:09:59,803][INFO ][main][IgniteKernal%grid-1] [21:09:59] : [Step 4/5] [21:09:59] : [Step 4/5] >>> +------------------------------------------------------+ [21:09:59] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV stopped OK [21:09:59] : [Step 4/5] >>> +------------------------------------------------------+ [21:09:59] : [Step 4/5] >>> Ignite instance name: grid-1 [21:09:59] : [Step 4/5] >>> Grid uptime: 00:00:07.660 [21:09:59] : [Step 4/5] [21:09:59] : [Step 4/5] [21:09:59] : [Step 4/5] [2021-11-19 21:09:59,804][INFO ][main][root] >>> Stopping grid [name=grid-0, id=002cfb47-8eee-4a16-96e5-0f323891f000] [21:09:59] : [Step 4/5] [2021-11-19 21:09:59,821][INFO ][db-checkpoint-thread-#19407%grid-0%][Checkpointer] Checkpoint started [checkpointId=052b4206-eefe-43d6-b5e1-8d0d7241c7ae, startPtr=WALPointer [idx=0, fileOff=989008, len=11491], checkpointBeforeLockTime=4ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=4ms, writeCheckpointEntryDuration=2ms, splitAndSortCpPagesDuration=0ms, pages=29, reason='timeout'] [21:09:59]W: [org.apache.ignite:ignite-core] [2021-11-19 21:09:59,826][WARN ][tcp-disco-sock-reader-[107c1eca 127.0.0.1:37637]-#1017%grid-0%-#19399%grid-0%][TestTcpDiscoverySpi] Failed to shutdown socket [21:09:59]W: [org.apache.ignite:ignite-core] java.net.SocketException: Socket is closed [21:09:59]W: [org.apache.ignite:ignite-core] at java.net.Socket.shutdownOutput(Socket.java:1568) [21:09:59]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.close(IgniteUtils.java:4247) [21:09:59]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.discovery.tcp.ServerImpl$SocketReader.body(ServerImpl.java:7370) [21:09:59]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.IgniteSpiThread.run(IgniteSpiThread.java:58) [21:09:59] : [Step 4/5] [2021-11-19 21:09:59,826][INFO ][tcp-disco-sock-reader-[107c1eca 127.0.0.1:37637]-#1017%grid-0%-#19399%grid-0%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:37637, rmtPort=37637, rmtNodeId=107c1eca-eeb4-4ea1-a55f-a4fba30f4001] [21:09:59] : [Step 4/5] [2021-11-19 21:09:59,829][INFO ][main][GridCacheProcessor] Stopped cache [cacheName=encrypted] [21:09:59] : [Step 4/5] [2021-11-19 21:09:59,829][INFO ][main][GridCacheProcessor] Stopped cache [cacheName=ignite-sys-cache] [21:09:59] : [Step 4/5] [2021-11-19 21:09:59,835][INFO ][main][FilePageStoreManager] Cleanup cache stores [total=4, left=0, cleanFiles=false] [21:09:59] : [Step 4/5] [2021-11-19 21:09:59,837][INFO ][main][GridDeploymentLocalStore] Removed undeployed class: GridDeployment [ts=1637345398495, depMode=SHARED, clsLdr=IsolatedClassLoader{roleName='test'}, clsLdrId=7c67d593d71-002cfb47-8eee-4a16-96e5-0f323891f000, userVer=0, loc=true, sampleClsName=org.apache.ignite.internal.processors.cache.distributed.dht.preloader.IgniteDhtPartitionHistorySuppliersMap, pendingUndeploy=false, undeployed=true, usage=0] [21:09:59] : [Step 4/5] [2021-11-19 21:09:59,843][INFO ][main][IgniteKernal%grid-0] [21:09:59] : [Step 4/5] [21:09:59] : [Step 4/5] >>> +------------------------------------------------------+ [21:09:59] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV stopped OK [21:09:59] : [Step 4/5] >>> +------------------------------------------------------+ [21:09:59] : [Step 4/5] >>> Ignite instance name: grid-0 [21:09:59] : [Step 4/5] >>> Grid uptime: 00:00:01.271 [21:09:59] : [Step 4/5] [21:09:59] : [Step 4/5] [21:10:00]W: [org.apache.ignite:ignite-core] [2021-11-19 21:10:00,161][WARN ][test-runner-#19421%encryption.MasterKeyChangeTest%][G] Ignite work directory is not provided, automatically resolved to: /opt/buildagent/work/7bc1c54bc719b67c/work [21:10:00] : [Step 4/5] [2021-11-19 21:10:00,163][INFO ][test-runner-#19421%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] [21:10:00] : [Step 4/5] [21:10:00] : [Step 4/5] >>> __________ ________________ [21:10:00] : [Step 4/5] >>> / _/ ___/ |/ / _/_ __/ __/ [21:10:00] : [Step 4/5] >>> _/ // (7 7 // / / / / _/ [21:10:00] : [Step 4/5] >>> /___/\___/_/|_/___/ /_/ /___/ [21:10:00] : [Step 4/5] >>> [21:10:00] : [Step 4/5] >>> ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:10:00] : [Step 4/5] >>> 2021 Copyright(C) Apache Software Foundation [21:10:00] : [Step 4/5] >>> [21:10:00] : [Step 4/5] >>> Ignite documentation: http://ignite.apache.org [21:10:00] : [Step 4/5] [21:10:00] : [Step 4/5] [2021-11-19 21:10:00,163][INFO ][test-runner-#19421%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] Config URL: n/a [21:10:00] : [Step 4/5] [2021-11-19 21:10:00,164][INFO ][test-runner-#19421%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] IgniteConfiguration [igniteInstanceName=grid-0, pubPoolSize=24, svcPoolSize=24, callbackPoolSize=24, stripedPoolSize=24, sysPoolSize=24, mgmtPoolSize=4, dataStreamerPoolSize=24, utilityCachePoolSize=24, utilityCacheKeepAliveTime=60000, p2pPoolSize=2, qryPoolSize=24, buildIdxPoolSize=4, igniteHome=/opt/buildagent/work/7bc1c54bc719b67c, igniteWorkDir=/opt/buildagent/work/7bc1c54bc719b67c/work, mbeanSrv=com.sun.jmx.mbeanserver.JmxMBeanServer@6fe85038, nodeId=00f85d16-a7bd-480e-a77e-c4a11db13000, marsh=BinaryMarshaller [], marshLocJobs=false, daemon=false, p2pEnabled=true, netTimeout=10000, netCompressionLevel=1, sndRetryDelay=1000, sndRetryCnt=3, metricsHistSize=10000, metricsUpdateFreq=1000, metricsExpTime=9223372036854775807, discoSpi=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=0, ackTimeout=0, marsh=null, reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], segPlc=STOP, segResolveAttempts=2, waitForSegOnStart=true, allResolversPassReq=true, segChkFreq=10000, commSpi=TcpCommunicationSpi [connectGate=org.apache.ignite.spi.communication.tcp.internal.ConnectGateway@3c5d5692, ctxInitLatch=java.util.concurrent.CountDownLatch@1c73f79[Count = 1], stopping=false, clientPool=null, nioSrvWrapper=null, stateProvider=null], evtSpi=MemoryEventStorageSpi [expireAgeMs=9223372036854775807, expireCnt=10000, filter=null], colSpi=NoopCollisionSpi [], deploySpi=LocalDeploymentSpi [], indexingSpi=org.apache.ignite.spi.indexing.noop.NoopIndexingSpi@52624361, addrRslvr=null, encryptionSpi=org.apache.ignite.spi.encryption.keystore.KeystoreEncryptionSpi@5335f5f0, tracingSpi=org.apache.ignite.spi.tracing.NoopTracingSpi@22f610b7, clientMode=false, rebalanceThreadPoolSize=4, rebalanceTimeout=10000, rebalanceBatchesPrefetchCnt=3, rebalanceThrottle=0, rebalanceBatchSize=524288, txCfg=TransactionConfiguration [txSerEnabled=false, dfltIsolation=REPEATABLE_READ, dfltConcurrency=PESSIMISTIC, dfltTxTimeout=0, txTimeoutOnPartitionMapExchange=0, deadlockTimeout=10000, pessimisticTxLogSize=0, pessimisticTxLogLinger=10000, tmLookupClsName=null, txManagerFactory=null, useJtaSync=false], cacheSanityCheckEnabled=true, discoStartupDelay=60000, deployMode=SHARED, p2pMissedCacheSize=100, locHost=127.0.0.1, timeSrvPortBase=31100, timeSrvPortRange=100, failureDetectionTimeout=10000, sysWorkerBlockedTimeout=null, clientFailureDetectionTimeout=10000, metricsLogFreq=0, connectorCfg=null, odbcCfg=null, warmupClos=null, atomicCfg=AtomicConfiguration [seqReserveSize=1000, cacheMode=PARTITIONED, backups=1, aff=null, grpName=null], classLdr=null, sslCtxFactory=null, platformCfg=null, binaryCfg=null, memCfg=null, pstCfg=null, dsCfg=DataStorageConfiguration [sysRegionInitSize=41943040, sysRegionMaxSize=104857600, pageSize=4096, concLvl=0, dfltDataRegConf=DataRegionConfiguration [name=default, maxSize=10485760, initSize=268435456, swapPath=null, pageEvictionMode=DISABLED, pageReplacementMode=CLOCK, evictionThreshold=0.9, emptyPagesPoolSize=100, metricsEnabled=false, metricsSubIntervalCount=5, metricsRateTimeInterval=60000, persistenceEnabled=true, checkpointPageBufSize=0, lazyMemoryAllocation=true, warmUpCfg=null], dataRegions=null, storagePath=null, checkpointFreq=180000, lockWaitTime=10000, checkpointThreads=4, checkpointWriteOrder=SEQUENTIAL, walHistSize=20, maxWalArchiveSize=1073741824, walSegments=10, walSegmentSize=67108864, walPath=db/wal, walArchivePath=db/wal/archive, cdcWalPath=db/wal/cdc, cdcEnabled=false, metricsEnabled=false, walMode=FSYNC, walTlbSize=131072, walBuffSize=0, walFlushFreq=2000, walFsyncDelay=1000, walRecordIterBuffSize=67108864, alwaysWriteFullPages=false, fileIOFactory=org.apache.ignite.internal.processors.cache.persistence.file.AsyncFileIOFactory@7b2772ee, metricsSubIntervalCnt=5, metricsRateTimeInterval=60000, walAutoArchiveAfterInactivity=-1, walForceArchiveTimeout=-1, writeThrottlingEnabled=false, walCompactionEnabled=false, walCompactionLevel=1, checkpointReadLockTimeout=null, walPageCompression=DISABLED, walPageCompressionLevel=null, dfltWarmUpCfg=null, encCfg=org.apache.ignite.configuration.EncryptionConfiguration@4765ff91, defragmentationThreadPoolSize=4, minWalArchiveSize=-1], snapshotPath=snapshots, activeOnStart=true, activeOnStartPropSetFlag=false, autoActivation=true, autoActivationPropSetFlag=false, clusterStateOnStart=null, sqlConnCfg=null, cliConnCfg=ClientConnectorConfiguration [host=null, port=10800, portRange=100, sockSndBufSize=0, sockRcvBufSize=0, tcpNoDelay=true, maxOpenCursorsPerConn=128, threadPoolSize=24, selectorCnt=12, idleTimeout=0, handshakeTimeout=10000, jdbcEnabled=true, odbcEnabled=true, thinCliEnabled=true, sslEnabled=false, useIgniteSslCtxFactory=true, sslClientAuth=false, sslCtxFactory=null, thinCliCfg=ThinClientConfiguration [maxActiveTxPerConn=100, maxActiveComputeTasksPerConn=0]], mvccVacuumThreadCnt=2, mvccVacuumFreq=5000, authEnabled=false, failureHnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]], commFailureRslvr=null, sqlCfg=SqlConfiguration [longQryWarnTimeout=3000, dfltQryTimeout=0, sqlQryHistSize=1000, validationEnabled=false], asyncContinuationExecutor=null] [21:10:00] : [Step 4/5] [2021-11-19 21:10:00,171][INFO ][test-runner-#19421%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] Daemon mode: off [21:10:00] : [Step 4/5] [2021-11-19 21:10:00,171][INFO ][test-runner-#19421%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] OS: Linux 4.15.0-151-generic amd64 [21:10:00] : [Step 4/5] [2021-11-19 21:10:00,171][INFO ][test-runner-#19421%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] OS user: teamcity [21:10:00] : [Step 4/5] [2021-11-19 21:10:00,171][INFO ][test-runner-#19421%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] PID: 16724 [21:10:00] : [Step 4/5] [2021-11-19 21:10:00,172][INFO ][test-runner-#19421%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] Language runtime: Java Platform API Specification ver. 1.8 [21:10:00] : [Step 4/5] [2021-11-19 21:10:00,172][INFO ][test-runner-#19421%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] VM information: Java(TM) SE Runtime Environment 1.8.0_261-b12 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 25.261-b12 [21:10:00] : [Step 4/5] [2021-11-19 21:10:00,172][INFO ][test-runner-#19421%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] VM total memory: 1.9GB [21:10:00] : [Step 4/5] [2021-11-19 21:10:00,172][INFO ][test-runner-#19421%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] Remote Management [restart: off, REST: off, JMX (remote: off)] [21:10:00] : [Step 4/5] [2021-11-19 21:10:00,172][INFO ][test-runner-#19421%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] Logger: GridTestLog4jLogger [quiet=false, config=null] [21:10:00] : [Step 4/5] [2021-11-19 21:10:00,173][INFO ][test-runner-#19421%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] IGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c [21:10:00] : [Step 4/5] [2021-11-19 21:10:00,173][INFO ][test-runner-#19421%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] VM arguments: [-DIGNITE_DUMP_THREADS_ON_FAILURE=false, -DMono=/usr/bin/mono-sgen, -DMono4.0_x64=/usr/lib/mono/4.0, -DMono4.5_x64=/usr/lib/mono/4.5, -DMonoVersion=6.12.0.90, -DSKIP_BUILD=false, -Dagent.home.dir=/opt/buildagent, -Dagent.name=aitc-lin02_03, -Dagent.ownPort=9090, -Dagent.work.dir=/opt/buildagent/work, -Dbuild.number=95, -Dbuild.vcs.number=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.1=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.GitHubApacheIgnite=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dclassworlds.conf=/opt/buildagent/temp/buildTmp/teamcity.m2.conf, -Dcom.jetbrains.maven.watcher.report.file=/opt/buildagent/temp/buildTmp/maven-build-info.xml, -Djava.io.tmpdir=/opt/buildagent/temp/buildTmp, -Dmaven.home=/opt/buildagent/tools/maven3_6, -Dmaven.multiModuleProjectDirectory=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.agent.cpuBenchmark=457, -Dteamcity.agent.dotnet.agent_url=http://localhost:9090/RPC2, -Dteamcity.agent.dotnet.build_id=6278078, -Dteamcity.auth.password=*******, -Dteamcity.auth.userId=TeamCityBuildId=6278078, -Dteamcity.build.changedFiles.file=/opt/buildagent/temp/buildTmp/changedFiles6342607772318147725.txt, -Dteamcity.build.checkoutDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.build.id=6278078, -Dteamcity.build.properties.file=/opt/buildagent/temp/buildTmp/teamcity.build5164517880467851002.properties, -Dteamcity.build.tempDir=/opt/buildagent/temp/buildTmp, -Dteamcity.build.workingDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.buildConfName=Basic 3, -Dteamcity.buildType.id=IgniteTests24Java8_Basic3, -Dteamcity.configuration.properties.file=/opt/buildagent/temp/buildTmp/teamcity.config5591980786735343870.properties, -Dteamcity.maven.userSettings.path=/opt/buildagent/temp/buildTmp/maven_settings_585072866407032347.xml, -Dteamcity.maven.watcher.home=/opt/buildagent/plugins/mavenPlugin/maven-watcher-jdk16, -Dteamcity.projectName=Ignite Tests 2.x (JDK 8/11), -Dteamcity.runner.properties.file=/opt/buildagent/temp/buildTmp/teamcity.runner9098465561618137420.properties, -Dteamcity.tests.recentlyFailedTests.file=/opt/buildagent/temp/buildTmp/testsToRunFirst3891775683130404069.txt, -Dteamcity.version=2021.2 (build 99542), -ea, -Xms2g, -Xmx2g, -XX:+HeapDumpOnOutOfMemoryError, -DIGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_TEST_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_UPDATE_NOTIFIER=false, -DIGNITE_NO_DISCO_ORDER=true, -DIGNITE_PERFORMANCE_SUGGESTIONS_DISABLED=true, -Djava.net.preferIPv4Stack=true, -DTEST_SCALE_FACTOR=1.0, -DIGNITE_TEST_PROP_LOG4J_FILE=log4j-tc-test.xml, -DIGNITE_QUIET=false, -DIGNITE_MARSHAL_BUFFERS_RECHECK=1000, -Dmaven.repo.local=/opt/buildagent/.m2/repository] [21:10:00] : [Step 4/5] [2021-11-19 21:10:00,177][INFO ][test-runner-#19421%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] System cache's DataRegion size is configured to 40 MB. Use DataStorageConfiguration.systemRegionInitialSize property to change the setting. [21:10:00] : [Step 4/5] [2021-11-19 21:10:00,177][INFO ][test-runner-#19421%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] Configured caches [in 'sysMemPlc' dataRegion: ['ignite-sys-cache']] [21:10:00]W: [org.apache.ignite:ignite-core] [2021-11-19 21:10:00,177][WARN ][test-runner-#19421%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] Peer class loading is enabled (disable it in production for performance and deployment consistency reasons) [21:10:00] : [Step 4/5] [2021-11-19 21:10:00,178][INFO ][test-runner-#19421%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] 3-rd party licenses can be found at: /opt/buildagent/work/7bc1c54bc719b67c/libs/licenses [21:10:00] : [Step 4/5] [2021-11-19 21:10:00,181][INFO ][test-runner-#19421%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] Configured plugins: [21:10:00] : [Step 4/5] [2021-11-19 21:10:00,181][INFO ][test-runner-#19421%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] ^-- StanByClusterTestProvider 1.0 [21:10:00] : [Step 4/5] [2021-11-19 21:10:00,181][INFO ][test-runner-#19421%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:10:00] : [Step 4/5] [2021-11-19 21:10:00,181][INFO ][test-runner-#19421%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] [21:10:00] : [Step 4/5] [2021-11-19 21:10:00,182][INFO ][test-runner-#19421%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] ^-- PageMemory tracker plugin 1.0 [21:10:00] : [Step 4/5] [2021-11-19 21:10:00,182][INFO ][test-runner-#19421%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:10:00] : [Step 4/5] [2021-11-19 21:10:00,182][INFO ][test-runner-#19421%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] [21:10:00] : [Step 4/5] [2021-11-19 21:10:00,182][INFO ][test-runner-#19421%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] ^-- TestDistibutedConfigurationPlugin 1.0 [21:10:00] : [Step 4/5] [2021-11-19 21:10:00,182][INFO ][test-runner-#19421%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:10:00] : [Step 4/5] [2021-11-19 21:10:00,182][INFO ][test-runner-#19421%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] [21:10:00] : [Step 4/5] [2021-11-19 21:10:00,183][INFO ][test-runner-#19421%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] ^-- NodeValidationPluginProvider 1.0 [21:10:00] : [Step 4/5] [2021-11-19 21:10:00,183][INFO ][test-runner-#19421%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:10:00] : [Step 4/5] [2021-11-19 21:10:00,183][INFO ][test-runner-#19421%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] [21:10:00] : [Step 4/5] [2021-11-19 21:10:00,183][INFO ][test-runner-#19421%encryption.MasterKeyChangeTest%][FailureProcessor] Configured failure handler: [hnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]]] [21:10:00] : [Step 4/5] [2021-11-19 21:10:00,205][INFO ][test-runner-#19421%encryption.MasterKeyChangeTest%][TestRecordingCommunicationSpi] Successfully bound communication NIO server to TCP port [port=47100, locHost=/127.0.0.1, selectorsCnt=12, selectorSpins=0, pairedConn=false] [21:10:00]W: [org.apache.ignite:ignite-core] [2021-11-19 21:10:00,205][WARN ][test-runner-#19421%encryption.MasterKeyChangeTest%][TestRecordingCommunicationSpi] Message queue limit is set to 0 which may lead to potential OOMEs when running cache operations in FULL_ASYNC or PRIMARY_SYNC modes due to message queues growth on sender and receiver sides. [21:10:00] : [Step 4/5] [2021-11-19 21:10:00,210][INFO ][test-runner-#19421%encryption.MasterKeyChangeTest%][GridCollisionManager] Collision resolution is disabled (all jobs will be activated upon arrival). [21:10:00] : [Step 4/5] [2021-11-19 21:10:00,211][INFO ][test-runner-#19421%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] Security status [authentication=off, sandbox=off, tls/ssl=off] [21:10:00] : [Step 4/5] [2021-11-19 21:10:00,266][INFO ][test-runner-#19421%encryption.MasterKeyChangeTest%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:10:00] : [Step 4/5] [2021-11-19 21:10:00,352][INFO ][test-runner-#19421%encryption.MasterKeyChangeTest%][MaintenanceProcessor] Resolved store directory for node persistent data: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0 [21:10:00] : [Step 4/5] [2021-11-19 21:10:00,353][INFO ][test-runner-#19421%encryption.MasterKeyChangeTest%][CacheObjectBinaryProcessorImpl] Resolved directory for serialized binary metadata: /opt/buildagent/work/7bc1c54bc719b67c/work/db/binary_meta/grid_0 [21:10:00] : [Step 4/5] [2021-11-19 21:10:00,357][INFO ][test-runner-#19421%encryption.MasterKeyChangeTest%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0 [21:10:00] : [Step 4/5] [2021-11-19 21:10:00,358][INFO ][test-runner-#19421%encryption.MasterKeyChangeTest%][FileWriteAheadLogManager] Resolved write ahead log work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0 [21:10:00] : [Step 4/5] [2021-11-19 21:10:00,358][INFO ][test-runner-#19421%encryption.MasterKeyChangeTest%][FileWriteAheadLogManager] Resolved write ahead log archive directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0 [21:10:00] : [Step 4/5] [2021-11-19 21:10:00,967][INFO ][test-runner-#19421%encryption.MasterKeyChangeTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000000.wal [21:10:00]W: [org.apache.ignite:ignite-core] [2021-11-19 21:10:00,967][WARN ][test-runner-#19421%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] DataRegion maxSize=10.5 MB is smaller than defaultInitialSize=268.4 MB, setting initialSize to 10.5 MB [21:10:00] : [Step 4/5] [2021-11-19 21:10:00,973][INFO ][test-runner-#19421%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Configured data regions initialized successfully [total=5] [21:10:00] : [Step 4/5] [2021-11-19 21:10:00,975][INFO ][test-runner-#19421%encryption.MasterKeyChangeTest%][IgniteSnapshotManager] Resolved snapshot work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/snapshots [21:10:00] : [Step 4/5] [2021-11-19 21:10:00,975][INFO ][test-runner-#19421%encryption.MasterKeyChangeTest%][IgniteSnapshotManager] Resolved temp directory for snapshot creation: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0/snp [21:10:00] : [Step 4/5] [2021-11-19 21:10:00,978][INFO ][test-runner-#19421%encryption.MasterKeyChangeTest%][ClientListenerProcessor] Client connector processor has started on TCP port 10800 [21:10:00] : [Step 4/5] [2021-11-19 21:10:00,983][INFO ][test-runner-#19421%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] Non-loopback local IPs: 172.17.0.4 [21:10:00] : [Step 4/5] [2021-11-19 21:10:00,984][INFO ][test-runner-#19421%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] Enabled local MACs: 0242AC110004 [21:10:00] : [Step 4/5] [2021-11-19 21:10:00,986][INFO ][test-runner-#19421%encryption.MasterKeyChangeTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:10:00] : [Step 4/5] [2021-11-19 21:10:00,986][INFO ][test-runner-#19421%encryption.MasterKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:10:00] : [Step 4/5] [2021-11-19 21:10:00,987][INFO ][test-runner-#19421%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:10:00] : [Step 4/5] [2021-11-19 21:10:00,989][INFO ][test-runner-#19421%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Applying lost metastore updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:10:00] : [Step 4/5] [2021-11-19 21:10:00,989][INFO ][test-runner-#19421%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=0 ms] [21:10:00] : [Step 4/5] [2021-11-19 21:10:00,989][INFO ][test-runner-#19421%encryption.MasterKeyChangeTest%][GridCacheProcessor] Restoring partition state for local groups. [21:10:00] : [Step 4/5] [2021-11-19 21:10:00,990][INFO ][test-runner-#19421%encryption.MasterKeyChangeTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=0, partitionsProcessed=0, time=0ms] [21:10:00] : [Step 4/5] [2021-11-19 21:10:00,990][INFO ][test-runner-#19421%encryption.MasterKeyChangeTest%][GridEncryptionManager] Encryption keys loaded from metastore. [grps=, masterKeyName=ignite.master.key] [21:10:00] : [Step 4/5] [2021-11-19 21:10:00,994][INFO ][test-runner-#19421%encryption.MasterKeyChangeTest%][ClusterProcessor] Cluster ID and tag has been read from metastorage: null [21:10:00] : [Step 4/5] [2021-11-19 21:10:00,994][INFO ][test-runner-#19421%encryption.MasterKeyChangeTest%][IgniteClusterImpl] Shutdown policy was updated [oldVal=null, newVal=null] [21:10:00] : [Step 4/5] [2021-11-19 21:10:00,995][INFO ][test-runner-#19421%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Checkpoint frequency deviation changed [oldVal=null, newVal=null] [21:10:01] : [Step 4/5] [2021-11-19 21:10:01,005][INFO ][test-runner-#19421%encryption.MasterKeyChangeTest%][FilePageStoreManager] Cleanup cache stores [total=1, left=0, cleanFiles=false] [21:10:01] : [Step 4/5] [2021-11-19 21:10:01,007][INFO ][test-runner-#19421%encryption.MasterKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:10:01] : [Step 4/5] [2021-11-19 21:10:01,008][INFO ][test-runner-#19421%encryption.MasterKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:10:01] : [Step 4/5] [2021-11-19 21:10:01,009][INFO ][test-runner-#19421%encryption.MasterKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:10:01] : [Step 4/5] [2021-11-19 21:10:01,010][INFO ][test-runner-#19421%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Data Regions Started: 5 [21:10:01] : [Step 4/5] [2021-11-19 21:10:01,010][INFO ][test-runner-#19421%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] ^-- sysMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:10:01] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:10:01] : [Step 4/5] ^-- default region [type=default, persistence=true, lazyAlloc=true, [21:10:01] : [Step 4/5] ... initCfg=10MB, maxCfg=10MB, usedRam=0MB, freeRam=100%, allocRam=0MB, allocTotal=0MB] [21:10:01] : [Step 4/5] ^-- metastoreMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:10:01] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:10:01] : [Step 4/5] ^-- TxLog region [type=internal, persistence=true, lazyAlloc=false, [21:10:01] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:10:01] : [Step 4/5] ^-- volatileDsMemPlc region [type=user, persistence=false, lazyAlloc=true, [21:10:01] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB] [21:10:01] : [Step 4/5] ^-- Ignite persistence [used=0MB] [21:10:01] : [Step 4/5] [21:10:01] : [Step 4/5] [2021-11-19 21:10:01,012][INFO ][test-runner-#19421%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Starting binary memory restore for: [-2100569601] [21:10:01] : [Step 4/5] [2021-11-19 21:10:01,020][INFO ][test-runner-#19421%encryption.MasterKeyChangeTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:10:01] : [Step 4/5] [2021-11-19 21:10:01,020][INFO ][test-runner-#19421%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:10:01] : [Step 4/5] [2021-11-19 21:10:01,021][INFO ][test-runner-#19421%encryption.MasterKeyChangeTest%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000000.wal, offset=0, ver=2] [21:10:01] : [Step 4/5] [2021-11-19 21:10:01,025][INFO ][test-runner-#19421%encryption.MasterKeyChangeTest%][GridCacheProcessor] Started cache in recovery mode [name=ignite-sys-cache, id=-2100569601, dataRegionName=sysMemPlc, mode=REPLICATED, atomicity=TRANSACTIONAL, backups=2147483647, mvcc=false] [21:10:01] : [Step 4/5] [2021-11-19 21:10:01,026][INFO ][test-runner-#19421%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Binary recovery performed in 14 ms. [21:10:01] : [Step 4/5] [2021-11-19 21:10:01,026][INFO ][test-runner-#19421%encryption.MasterKeyChangeTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:10:01] : [Step 4/5] [2021-11-19 21:10:01,027][INFO ][test-runner-#19421%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Applying lost cache updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:10:01] : [Step 4/5] [2021-11-19 21:10:01,097][INFO ][test-runner-#19421%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=71 ms] [21:10:01] : [Step 4/5] [2021-11-19 21:10:01,097][INFO ][test-runner-#19421%encryption.MasterKeyChangeTest%][GridCacheProcessor] Restoring partition state for local groups. [21:10:01] : [Step 4/5] [2021-11-19 21:10:01,102][INFO ][test-runner-#19421%encryption.MasterKeyChangeTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=1, partitionsProcessed=100, time=10ms] [21:10:01] : [Step 4/5] [2021-11-19 21:10:01,707][INFO ][test-runner-#19421%encryption.MasterKeyChangeTest%][TestTcpDiscoverySpi] Successfully bound to TCP port [port=47500, localHost=localhost/127.0.0.1, locNodeId=00f85d16-a7bd-480e-a77e-c4a11db13000] [21:10:01] : [Step 4/5] [2021-11-19 21:10:01,718][INFO ][disco-notifier-worker-#19532%grid-0%][MvccProcessorImpl] Assigned mvcc coordinator [crd=MvccCoordinator [topVer=AffinityTopologyVersion [topVer=1, minorTopVer=0], nodeId=00f85d16-a7bd-480e-a77e-c4a11db13000, ver=1637345401708, local=true, initialized=false]] [21:10:01] : [Step 4/5] [2021-11-19 21:10:01,719][INFO ][sys-#19508%grid-0%][ClusterProcessor] Writing cluster ID and tag to metastorage on ready for write ClusterIdAndTag [id=821283ee-e4ac-475a-ad81-9aa0e9c42070, tag=inspiring_noether] [21:10:01] : [Step 4/5] [2021-11-19 21:10:01,722][INFO ][disco-notifier-worker-#19532%grid-0%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustEnabled' was changed from 'null' to 'false' [21:10:01] : [Step 4/5] [2021-11-19 21:10:01,723][INFO ][disco-notifier-worker-#19532%grid-0%][ClusterProcessor] inspiring_noether [21:10:01] : [Step 4/5] [2021-11-19 21:10:01,724][INFO ][disco-notifier-worker-#19532%grid-0%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustTimeout' was changed from 'null' to '300000' [21:10:01] : [Step 4/5] [2021-11-19 21:10:01,724][INFO ][disco-notifier-worker-#19532%grid-0%][IgniteTxManager] Transactions parameter 'longOperationsDumpTimeout' was changed from 'null' to '60000' [21:10:01] : [Step 4/5] [2021-11-19 21:10:01,725][INFO ][disco-notifier-worker-#19532%grid-0%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpThreshold' was changed from 'null' to '0' [21:10:01] : [Step 4/5] [2021-11-19 21:10:01,725][INFO ][disco-notifier-worker-#19532%grid-0%][IgniteTxManager] Transactions parameter 'transactionTimeDumpSamplesCoefficient' was changed from 'null' to '0.0' [21:10:01] : [Step 4/5] [2021-11-19 21:10:01,727][INFO ][disco-notifier-worker-#19532%grid-0%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpSamplesPerSecondLimit' was changed from 'null' to '5' [21:10:01] : [Step 4/5] [2021-11-19 21:10:01,728][INFO ][disco-notifier-worker-#19532%grid-0%][IgniteTxManager] Transactions parameter 'collisionsDumpInterval' was changed from 'null' to '1000' [21:10:01] : [Step 4/5] [2021-11-19 21:10:01,728][INFO ][test-runner-#19421%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] To start Console Management & Monitoring run ignitevisorcmd.{sh|bat} [21:10:01] : [Step 4/5] [2021-11-19 21:10:01,729][INFO ][disco-notifier-worker-#19532%grid-0%][IgniteTxManager] Transactions parameter 'txOwnerDumpRequestsAllowed' was changed from 'null' to 'true' [21:10:01] : [Step 4/5] [2021-11-19 21:10:01,729][INFO ][test-runner-#19421%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] [21:10:01] : [Step 4/5] [21:10:01] : [Step 4/5] >>> +-------------------------------------------+ [21:10:01] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:10:01] : [Step 4/5] >>> +-------------------------------------------+ [21:10:01] : [Step 4/5] >>> OS name: Linux 4.15.0-151-generic amd64 [21:10:01] : [Step 4/5] >>> CPU(s): 24 [21:10:01] : [Step 4/5] >>> Heap: 2.0GB [21:10:01] : [Step 4/5] >>> VM name: 16724@c4dfe9a430b2 [21:10:01] : [Step 4/5] >>> Ignite instance name: grid-0 [21:10:01] : [Step 4/5] >>> Local node [ID=00F85D16-A7BD-480E-A77E-C4A11DB13000, order=1, clientMode=false] [21:10:01] : [Step 4/5] >>> Local node addresses: [127.0.0.1] [21:10:01] : [Step 4/5] >>> Local ports: TCP:10800 TCP:47100 TCP:47500 [21:10:01] : [Step 4/5] [21:10:01] : [Step 4/5] [2021-11-19 21:10:01,730][INFO ][test-runner-#19421%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] >>> Ignite cluster is in INACTIVE state (limited functionality available). Use control.(sh|bat) script or IgniteCluster.state(ClusterState.ACTIVE) to change the state. [21:10:01] : [Step 4/5] [2021-11-19 21:10:01,729][INFO ][disco-notifier-worker-#19532%grid-0%][GridCacheDatabaseSharedManager] Historical rebalance WAL threshold changed [property=historical.rebalance.threshold, oldVal=null, newVal=500] [21:10:01] : [Step 4/5] [2021-11-19 21:10:01,730][INFO ][test-runner-#19421%encryption.MasterKeyChangeTest%][GridDiscoveryManager] Topology snapshot [ver=1, locNode=00f85d16, servers=1, clients=0, state=INACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=00f85d16-a7bd-480e-a77e-c4a11db13000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:10:01] : [Step 4/5] [2021-11-19 21:10:01,731][INFO ][test-runner-#19421%encryption.MasterKeyChangeTest%][G] Node started : [stage="Configure system pool" (0 ms),stage="Start managers" (190 ms),stage="Configure binary metadata" (1 ms),stage="Start processors" (627 ms),stage="Start 'StanByClusterTestProvider' plugin" (0 ms),stage="Start 'PageMemory tracker plugin' plugin" (0 ms),stage="Start 'TestDistibutedConfigurationPlugin' plugin" (0 ms),stage="Start 'NodeValidationPluginProvider' plugin" (0 ms),stage="Init metastore" (22 ms),stage="Init and start regions" (6 ms),stage="Restore binary memory" (14 ms),stage="Restore logical state" (76 ms),stage="Finish recovery" (603 ms),stage="Join topology" (12 ms),stage="Await transition" (1 ms),stage="Await exchange" (11 ms),stage="Total time" (1563 ms)] [21:10:01] : [Step 4/5] [2021-11-19 21:10:01,732][INFO ][test-runner-#19421%encryption.MasterKeyChangeTest%][root] Node started with the following configuration [id=00f85d16-a7bd-480e-a77e-c4a11db13000, marshaller=BinaryMarshaller [], discovery=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=5000, ackTimeout=5000, marsh=JdkMarshaller [clsFilter=org.apache.ignite.marshaller.MarshallerUtils$1@7112629b], reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], binaryCfg=null, lateAff=true] [21:10:01]W: [org.apache.ignite:ignite-core] [2021-11-19 21:10:01,737][WARN ][test-runner-#19421%encryption.MasterKeyChangeTest%][G] Ignite work directory is not provided, automatically resolved to: /opt/buildagent/work/7bc1c54bc719b67c/work [21:10:01] : [Step 4/5] [2021-11-19 21:10:01,737][INFO ][test-runner-#19421%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] [21:10:01] : [Step 4/5] [21:10:01] : [Step 4/5] >>> __________ ________________ [21:10:01] : [Step 4/5] >>> / _/ ___/ |/ / _/_ __/ __/ [21:10:01] : [Step 4/5] >>> _/ // (7 7 // / / / / _/ [21:10:01] : [Step 4/5] >>> /___/\___/_/|_/___/ /_/ /___/ [21:10:01] : [Step 4/5] >>> [21:10:01] : [Step 4/5] >>> ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:10:01] : [Step 4/5] >>> 2021 Copyright(C) Apache Software Foundation [21:10:01] : [Step 4/5] >>> [21:10:01] : [Step 4/5] >>> Ignite documentation: http://ignite.apache.org [21:10:01] : [Step 4/5] [21:10:01] : [Step 4/5] [2021-11-19 21:10:01,738][INFO ][test-runner-#19421%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] Config URL: n/a [21:10:01] : [Step 4/5] [2021-11-19 21:10:01,739][INFO ][test-runner-#19421%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] IgniteConfiguration [igniteInstanceName=grid-1, pubPoolSize=24, svcPoolSize=24, callbackPoolSize=24, stripedPoolSize=24, sysPoolSize=24, mgmtPoolSize=4, dataStreamerPoolSize=24, utilityCachePoolSize=24, utilityCacheKeepAliveTime=60000, p2pPoolSize=2, qryPoolSize=24, buildIdxPoolSize=4, igniteHome=/opt/buildagent/work/7bc1c54bc719b67c, igniteWorkDir=/opt/buildagent/work/7bc1c54bc719b67c/work, mbeanSrv=com.sun.jmx.mbeanserver.JmxMBeanServer@6fe85038, nodeId=1093e7cf-2817-4221-b4f6-8a519c5db001, marsh=BinaryMarshaller [], marshLocJobs=false, daemon=false, p2pEnabled=true, netTimeout=10000, netCompressionLevel=1, sndRetryDelay=1000, sndRetryCnt=3, metricsHistSize=10000, metricsUpdateFreq=1000, metricsExpTime=9223372036854775807, discoSpi=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=0, ackTimeout=0, marsh=null, reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], segPlc=STOP, segResolveAttempts=2, waitForSegOnStart=true, allResolversPassReq=true, segChkFreq=10000, commSpi=TcpCommunicationSpi [connectGate=org.apache.ignite.spi.communication.tcp.internal.ConnectGateway@3c83e117, ctxInitLatch=java.util.concurrent.CountDownLatch@3c40d69f[Count = 1], stopping=false, clientPool=null, nioSrvWrapper=null, stateProvider=null], evtSpi=MemoryEventStorageSpi [expireAgeMs=9223372036854775807, expireCnt=10000, filter=null], colSpi=NoopCollisionSpi [], deploySpi=LocalDeploymentSpi [], indexingSpi=org.apache.ignite.spi.indexing.noop.NoopIndexingSpi@338271c6, addrRslvr=null, encryptionSpi=org.apache.ignite.spi.encryption.keystore.KeystoreEncryptionSpi@bd61738, tracingSpi=org.apache.ignite.spi.tracing.NoopTracingSpi@2d10593, clientMode=false, rebalanceThreadPoolSize=4, rebalanceTimeout=10000, rebalanceBatchesPrefetchCnt=3, rebalanceThrottle=0, rebalanceBatchSize=524288, txCfg=TransactionConfiguration [txSerEnabled=false, dfltIsolation=REPEATABLE_READ, dfltConcurrency=PESSIMISTIC, dfltTxTimeout=0, txTimeoutOnPartitionMapExchange=0, deadlockTimeout=10000, pessimisticTxLogSize=0, pessimisticTxLogLinger=10000, tmLookupClsName=null, txManagerFactory=null, useJtaSync=false], cacheSanityCheckEnabled=true, discoStartupDelay=60000, deployMode=SHARED, p2pMissedCacheSize=100, locHost=127.0.0.1, timeSrvPortBase=31100, timeSrvPortRange=100, failureDetectionTimeout=10000, sysWorkerBlockedTimeout=null, clientFailureDetectionTimeout=10000, metricsLogFreq=0, connectorCfg=null, odbcCfg=null, warmupClos=null, atomicCfg=AtomicConfiguration [seqReserveSize=1000, cacheMode=PARTITIONED, backups=1, aff=null, grpName=null], classLdr=null, sslCtxFactory=null, platformCfg=null, binaryCfg=null, memCfg=null, pstCfg=null, dsCfg=DataStorageConfiguration [sysRegionInitSize=41943040, sysRegionMaxSize=104857600, pageSize=4096, concLvl=0, dfltDataRegConf=DataRegionConfiguration [name=default, maxSize=10485760, initSize=268435456, swapPath=null, pageEvictionMode=DISABLED, pageReplacementMode=CLOCK, evictionThreshold=0.9, emptyPagesPoolSize=100, metricsEnabled=false, metricsSubIntervalCount=5, metricsRateTimeInterval=60000, persistenceEnabled=true, checkpointPageBufSize=0, lazyMemoryAllocation=true, warmUpCfg=null], dataRegions=null, storagePath=null, checkpointFreq=180000, lockWaitTime=10000, checkpointThreads=4, checkpointWriteOrder=SEQUENTIAL, walHistSize=20, maxWalArchiveSize=1073741824, walSegments=10, walSegmentSize=67108864, walPath=db/wal, walArchivePath=db/wal/archive, cdcWalPath=db/wal/cdc, cdcEnabled=false, metricsEnabled=false, walMode=FSYNC, walTlbSize=131072, walBuffSize=0, walFlushFreq=2000, walFsyncDelay=1000, walRecordIterBuffSize=67108864, alwaysWriteFullPages=false, fileIOFactory=org.apache.ignite.internal.processors.cache.persistence.file.AsyncFileIOFactory@15324b3d, metricsSubIntervalCnt=5, metricsRateTimeInterval=60000, walAutoArchiveAfterInactivity=-1, walForceArchiveTimeout=-1, writeThrottlingEnabled=false, walCompactionEnabled=false, walCompactionLevel=1, checkpointReadLockTimeout=null, walPageCompression=DISABLED, walPageCompressionLevel=null, dfltWarmUpCfg=null, encCfg=org.apache.ignite.configuration.EncryptionConfiguration@c737778, defragmentationThreadPoolSize=4, minWalArchiveSize=-1], snapshotPath=snapshots, activeOnStart=true, activeOnStartPropSetFlag=false, autoActivation=true, autoActivationPropSetFlag=false, clusterStateOnStart=null, sqlConnCfg=null, cliConnCfg=ClientConnectorConfiguration [host=null, port=10800, portRange=100, sockSndBufSize=0, sockRcvBufSize=0, tcpNoDelay=true, maxOpenCursorsPerConn=128, threadPoolSize=24, selectorCnt=12, idleTimeout=0, handshakeTimeout=10000, jdbcEnabled=true, odbcEnabled=true, thinCliEnabled=true, sslEnabled=false, useIgniteSslCtxFactory=true, sslClientAuth=false, sslCtxFactory=null, thinCliCfg=ThinClientConfiguration [maxActiveTxPerConn=100, maxActiveComputeTasksPerConn=0]], mvccVacuumThreadCnt=2, mvccVacuumFreq=5000, authEnabled=false, failureHnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]], commFailureRslvr=null, sqlCfg=SqlConfiguration [longQryWarnTimeout=3000, dfltQryTimeout=0, sqlQryHistSize=1000, validationEnabled=false], asyncContinuationExecutor=null] [21:10:01] : [Step 4/5] [2021-11-19 21:10:01,747][INFO ][test-runner-#19421%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] Daemon mode: off [21:10:01] : [Step 4/5] [2021-11-19 21:10:01,747][INFO ][test-runner-#19421%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] OS: Linux 4.15.0-151-generic amd64 [21:10:01] : [Step 4/5] [2021-11-19 21:10:01,748][INFO ][test-runner-#19421%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] OS user: teamcity [21:10:01] : [Step 4/5] [2021-11-19 21:10:01,748][INFO ][test-runner-#19421%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] PID: 16724 [21:10:01] : [Step 4/5] [2021-11-19 21:10:01,748][INFO ][test-runner-#19421%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] Language runtime: Java Platform API Specification ver. 1.8 [21:10:01] : [Step 4/5] [2021-11-19 21:10:01,749][INFO ][test-runner-#19421%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] VM information: Java(TM) SE Runtime Environment 1.8.0_261-b12 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 25.261-b12 [21:10:01] : [Step 4/5] [2021-11-19 21:10:01,749][INFO ][test-runner-#19421%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] VM total memory: 1.9GB [21:10:01] : [Step 4/5] [2021-11-19 21:10:01,749][INFO ][test-runner-#19421%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] Remote Management [restart: off, REST: off, JMX (remote: off)] [21:10:01] : [Step 4/5] [2021-11-19 21:10:01,750][INFO ][test-runner-#19421%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] Logger: GridTestLog4jLogger [quiet=false, config=null] [21:10:01] : [Step 4/5] [2021-11-19 21:10:01,750][INFO ][test-runner-#19421%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] IGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c [21:10:01] : [Step 4/5] [2021-11-19 21:10:01,750][INFO ][test-runner-#19421%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] VM arguments: [-DIGNITE_DUMP_THREADS_ON_FAILURE=false, -DMono=/usr/bin/mono-sgen, -DMono4.0_x64=/usr/lib/mono/4.0, -DMono4.5_x64=/usr/lib/mono/4.5, -DMonoVersion=6.12.0.90, -DSKIP_BUILD=false, -Dagent.home.dir=/opt/buildagent, -Dagent.name=aitc-lin02_03, -Dagent.ownPort=9090, -Dagent.work.dir=/opt/buildagent/work, -Dbuild.number=95, -Dbuild.vcs.number=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.1=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.GitHubApacheIgnite=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dclassworlds.conf=/opt/buildagent/temp/buildTmp/teamcity.m2.conf, -Dcom.jetbrains.maven.watcher.report.file=/opt/buildagent/temp/buildTmp/maven-build-info.xml, -Djava.io.tmpdir=/opt/buildagent/temp/buildTmp, -Dmaven.home=/opt/buildagent/tools/maven3_6, -Dmaven.multiModuleProjectDirectory=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.agent.cpuBenchmark=457, -Dteamcity.agent.dotnet.agent_url=http://localhost:9090/RPC2, -Dteamcity.agent.dotnet.build_id=6278078, -Dteamcity.auth.password=*******, -Dteamcity.auth.userId=TeamCityBuildId=6278078, -Dteamcity.build.changedFiles.file=/opt/buildagent/temp/buildTmp/changedFiles6342607772318147725.txt, -Dteamcity.build.checkoutDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.build.id=6278078, -Dteamcity.build.properties.file=/opt/buildagent/temp/buildTmp/teamcity.build5164517880467851002.properties, -Dteamcity.build.tempDir=/opt/buildagent/temp/buildTmp, -Dteamcity.build.workingDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.buildConfName=Basic 3, -Dteamcity.buildType.id=IgniteTests24Java8_Basic3, -Dteamcity.configuration.properties.file=/opt/buildagent/temp/buildTmp/teamcity.config5591980786735343870.properties, -Dteamcity.maven.userSettings.path=/opt/buildagent/temp/buildTmp/maven_settings_585072866407032347.xml, -Dteamcity.maven.watcher.home=/opt/buildagent/plugins/mavenPlugin/maven-watcher-jdk16, -Dteamcity.projectName=Ignite Tests 2.x (JDK 8/11), -Dteamcity.runner.properties.file=/opt/buildagent/temp/buildTmp/teamcity.runner9098465561618137420.properties, -Dteamcity.tests.recentlyFailedTests.file=/opt/buildagent/temp/buildTmp/testsToRunFirst3891775683130404069.txt, -Dteamcity.version=2021.2 (build 99542), -ea, -Xms2g, -Xmx2g, -XX:+HeapDumpOnOutOfMemoryError, -DIGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_TEST_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_UPDATE_NOTIFIER=false, -DIGNITE_NO_DISCO_ORDER=true, -DIGNITE_PERFORMANCE_SUGGESTIONS_DISABLED=true, -Djava.net.preferIPv4Stack=true, -DTEST_SCALE_FACTOR=1.0, -DIGNITE_TEST_PROP_LOG4J_FILE=log4j-tc-test.xml, -DIGNITE_QUIET=false, -DIGNITE_MARSHAL_BUFFERS_RECHECK=1000, -Dmaven.repo.local=/opt/buildagent/.m2/repository] [21:10:01] : [Step 4/5] [2021-11-19 21:10:01,754][INFO ][test-runner-#19421%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] System cache's DataRegion size is configured to 40 MB. Use DataStorageConfiguration.systemRegionInitialSize property to change the setting. [21:10:01] : [Step 4/5] [2021-11-19 21:10:01,754][INFO ][test-runner-#19421%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] Configured caches [in 'sysMemPlc' dataRegion: ['ignite-sys-cache']] [21:10:01]W: [org.apache.ignite:ignite-core] [2021-11-19 21:10:01,755][WARN ][test-runner-#19421%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] Peer class loading is enabled (disable it in production for performance and deployment consistency reasons) [21:10:01] : [Step 4/5] [2021-11-19 21:10:01,755][INFO ][test-runner-#19421%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] 3-rd party licenses can be found at: /opt/buildagent/work/7bc1c54bc719b67c/libs/licenses [21:10:01] : [Step 4/5] [2021-11-19 21:10:01,759][INFO ][test-runner-#19421%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] Configured plugins: [21:10:01] : [Step 4/5] [2021-11-19 21:10:01,759][INFO ][test-runner-#19421%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] ^-- StanByClusterTestProvider 1.0 [21:10:01] : [Step 4/5] [2021-11-19 21:10:01,759][INFO ][test-runner-#19421%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:10:01] : [Step 4/5] [2021-11-19 21:10:01,759][INFO ][test-runner-#19421%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] [21:10:01] : [Step 4/5] [2021-11-19 21:10:01,760][INFO ][test-runner-#19421%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] ^-- PageMemory tracker plugin 1.0 [21:10:01] : [Step 4/5] [2021-11-19 21:10:01,760][INFO ][test-runner-#19421%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:10:01] : [Step 4/5] [2021-11-19 21:10:01,760][INFO ][test-runner-#19421%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] [21:10:01] : [Step 4/5] [2021-11-19 21:10:01,760][INFO ][test-runner-#19421%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] ^-- TestDistibutedConfigurationPlugin 1.0 [21:10:01] : [Step 4/5] [2021-11-19 21:10:01,760][INFO ][test-runner-#19421%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:10:01] : [Step 4/5] [2021-11-19 21:10:01,761][INFO ][test-runner-#19421%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] [21:10:01] : [Step 4/5] [2021-11-19 21:10:01,761][INFO ][test-runner-#19421%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] ^-- NodeValidationPluginProvider 1.0 [21:10:01] : [Step 4/5] [2021-11-19 21:10:01,761][INFO ][test-runner-#19421%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:10:01] : [Step 4/5] [2021-11-19 21:10:01,761][INFO ][test-runner-#19421%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] [21:10:01] : [Step 4/5] [2021-11-19 21:10:01,761][INFO ][test-runner-#19421%encryption.MasterKeyChangeTest%][FailureProcessor] Configured failure handler: [hnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]]] [21:10:01] : [Step 4/5] [2021-11-19 21:10:01,774][INFO ][test-runner-#19421%encryption.MasterKeyChangeTest%][TestRecordingCommunicationSpi] Successfully bound communication NIO server to TCP port [port=47101, locHost=/127.0.0.1, selectorsCnt=12, selectorSpins=0, pairedConn=false] [21:10:01]W: [org.apache.ignite:ignite-core] [2021-11-19 21:10:01,774][WARN ][test-runner-#19421%encryption.MasterKeyChangeTest%][TestRecordingCommunicationSpi] Message queue limit is set to 0 which may lead to potential OOMEs when running cache operations in FULL_ASYNC or PRIMARY_SYNC modes due to message queues growth on sender and receiver sides. [21:10:01] : [Step 4/5] [2021-11-19 21:10:01,780][INFO ][test-runner-#19421%encryption.MasterKeyChangeTest%][GridCollisionManager] Collision resolution is disabled (all jobs will be activated upon arrival). [21:10:01] : [Step 4/5] [2021-11-19 21:10:01,780][INFO ][test-runner-#19421%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] Security status [authentication=off, sandbox=off, tls/ssl=off] [21:10:01] : [Step 4/5] [2021-11-19 21:10:01,842][INFO ][test-runner-#19421%encryption.MasterKeyChangeTest%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:10:01] : [Step 4/5] [2021-11-19 21:10:01,927][INFO ][test-runner-#19421%encryption.MasterKeyChangeTest%][MaintenanceProcessor] Resolved store directory for node persistent data: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1 [21:10:01] : [Step 4/5] [2021-11-19 21:10:01,928][INFO ][test-runner-#19421%encryption.MasterKeyChangeTest%][CacheObjectBinaryProcessorImpl] Resolved directory for serialized binary metadata: /opt/buildagent/work/7bc1c54bc719b67c/work/db/binary_meta/grid_1 [21:10:01] : [Step 4/5] [2021-11-19 21:10:01,932][INFO ][test-runner-#19421%encryption.MasterKeyChangeTest%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1 [21:10:01] : [Step 4/5] [2021-11-19 21:10:01,933][INFO ][test-runner-#19421%encryption.MasterKeyChangeTest%][FileWriteAheadLogManager] Resolved write ahead log work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1 [21:10:01] : [Step 4/5] [2021-11-19 21:10:01,933][INFO ][test-runner-#19421%encryption.MasterKeyChangeTest%][FileWriteAheadLogManager] Resolved write ahead log archive directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1 [21:10:02] : [Step 4/5] [2021-11-19 21:10:02,459][INFO ][test-runner-#19421%encryption.MasterKeyChangeTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000000.wal [21:10:02] : [Step 4/5] [2021-11-19 21:10:02,464][INFO ][test-runner-#19421%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Configured data regions initialized successfully [total=5] [21:10:02] : [Step 4/5] [2021-11-19 21:10:02,467][INFO ][test-runner-#19421%encryption.MasterKeyChangeTest%][IgniteSnapshotManager] Resolved snapshot work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/snapshots [21:10:02] : [Step 4/5] [2021-11-19 21:10:02,467][INFO ][test-runner-#19421%encryption.MasterKeyChangeTest%][IgniteSnapshotManager] Resolved temp directory for snapshot creation: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1/snp [21:10:02] : [Step 4/5] [2021-11-19 21:10:02,470][INFO ][test-runner-#19421%encryption.MasterKeyChangeTest%][ClientListenerProcessor] Client connector processor has started on TCP port 10801 [21:10:02] : [Step 4/5] [2021-11-19 21:10:02,472][INFO ][test-runner-#19421%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] Non-loopback local IPs: 172.17.0.4 [21:10:02] : [Step 4/5] [2021-11-19 21:10:02,473][INFO ][test-runner-#19421%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] Enabled local MACs: 0242AC110004 [21:10:02] : [Step 4/5] [2021-11-19 21:10:02,473][INFO ][test-runner-#19421%encryption.MasterKeyChangeTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:10:02] : [Step 4/5] [2021-11-19 21:10:02,474][INFO ][test-runner-#19421%encryption.MasterKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:10:02] : [Step 4/5] [2021-11-19 21:10:02,474][INFO ][test-runner-#19421%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:10:02] : [Step 4/5] [2021-11-19 21:10:02,476][INFO ][test-runner-#19421%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Applying lost metastore updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:10:02] : [Step 4/5] [2021-11-19 21:10:02,477][INFO ][test-runner-#19421%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=0 ms] [21:10:02] : [Step 4/5] [2021-11-19 21:10:02,477][INFO ][test-runner-#19421%encryption.MasterKeyChangeTest%][GridCacheProcessor] Restoring partition state for local groups. [21:10:02] : [Step 4/5] [2021-11-19 21:10:02,477][INFO ][test-runner-#19421%encryption.MasterKeyChangeTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=0, partitionsProcessed=0, time=0ms] [21:10:02] : [Step 4/5] [2021-11-19 21:10:02,478][INFO ][test-runner-#19421%encryption.MasterKeyChangeTest%][GridEncryptionManager] Encryption keys loaded from metastore. [grps=, masterKeyName=ignite.master.key] [21:10:02] : [Step 4/5] [2021-11-19 21:10:02,479][INFO ][test-runner-#19421%encryption.MasterKeyChangeTest%][ClusterProcessor] Cluster ID and tag has been read from metastorage: null [21:10:02] : [Step 4/5] [2021-11-19 21:10:02,479][INFO ][test-runner-#19421%encryption.MasterKeyChangeTest%][IgniteClusterImpl] Shutdown policy was updated [oldVal=null, newVal=null] [21:10:02] : [Step 4/5] [2021-11-19 21:10:02,480][INFO ][test-runner-#19421%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Checkpoint frequency deviation changed [oldVal=null, newVal=null] [21:10:02] : [Step 4/5] [2021-11-19 21:10:02,489][INFO ][test-runner-#19421%encryption.MasterKeyChangeTest%][FilePageStoreManager] Cleanup cache stores [total=1, left=0, cleanFiles=false] [21:10:02] : [Step 4/5] [2021-11-19 21:10:02,491][INFO ][test-runner-#19421%encryption.MasterKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:10:02] : [Step 4/5] [2021-11-19 21:10:02,492][INFO ][test-runner-#19421%encryption.MasterKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:10:02] : [Step 4/5] [2021-11-19 21:10:02,493][INFO ][test-runner-#19421%encryption.MasterKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:10:02] : [Step 4/5] [2021-11-19 21:10:02,493][INFO ][test-runner-#19421%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Data Regions Started: 5 [21:10:02] : [Step 4/5] [2021-11-19 21:10:02,493][INFO ][test-runner-#19421%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] ^-- sysMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:10:02] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:10:02] : [Step 4/5] ^-- default region [type=default, persistence=true, lazyAlloc=true, [21:10:02] : [Step 4/5] ... initCfg=10MB, maxCfg=10MB, usedRam=0MB, freeRam=100%, allocRam=0MB, allocTotal=0MB] [21:10:02] : [Step 4/5] ^-- metastoreMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:10:02] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:10:02] : [Step 4/5] ^-- TxLog region [type=internal, persistence=true, lazyAlloc=false, [21:10:02] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:10:02] : [Step 4/5] ^-- volatileDsMemPlc region [type=user, persistence=false, lazyAlloc=true, [21:10:02] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB] [21:10:02] : [Step 4/5] ^-- Ignite persistence [used=0MB] [21:10:02] : [Step 4/5] [21:10:02] : [Step 4/5] [2021-11-19 21:10:02,495][INFO ][test-runner-#19421%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Starting binary memory restore for: [-2100569601] [21:10:02] : [Step 4/5] [2021-11-19 21:10:02,501][INFO ][test-runner-#19421%encryption.MasterKeyChangeTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:10:02] : [Step 4/5] [2021-11-19 21:10:02,502][INFO ][test-runner-#19421%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:10:02] : [Step 4/5] [2021-11-19 21:10:02,503][INFO ][test-runner-#19421%encryption.MasterKeyChangeTest%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000000.wal, offset=0, ver=2] [21:10:02] : [Step 4/5] [2021-11-19 21:10:02,507][INFO ][test-runner-#19421%encryption.MasterKeyChangeTest%][GridCacheProcessor] Started cache in recovery mode [name=ignite-sys-cache, id=-2100569601, dataRegionName=sysMemPlc, mode=REPLICATED, atomicity=TRANSACTIONAL, backups=2147483647, mvcc=false] [21:10:02] : [Step 4/5] [2021-11-19 21:10:02,514][INFO ][test-runner-#19421%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Binary recovery performed in 19 ms. [21:10:02] : [Step 4/5] [2021-11-19 21:10:02,514][INFO ][test-runner-#19421%encryption.MasterKeyChangeTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:10:02] : [Step 4/5] [2021-11-19 21:10:02,515][INFO ][test-runner-#19421%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Applying lost cache updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:10:02] : [Step 4/5] [2021-11-19 21:10:02,594][INFO ][test-runner-#19421%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=81 ms] [21:10:02] : [Step 4/5] [2021-11-19 21:10:02,595][INFO ][test-runner-#19421%encryption.MasterKeyChangeTest%][GridCacheProcessor] Restoring partition state for local groups. [21:10:02] : [Step 4/5] [2021-11-19 21:10:02,607][INFO ][test-runner-#19421%encryption.MasterKeyChangeTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=1, partitionsProcessed=100, time=10ms] [21:10:03] : [Step 4/5] [2021-11-19 21:10:03,028][INFO ][test-runner-#19421%encryption.MasterKeyChangeTest%][TestTcpDiscoverySpi] Successfully bound to TCP port [port=47501, localHost=localhost/127.0.0.1, locNodeId=1093e7cf-2817-4221-b4f6-8a519c5db001] [21:10:03] : [Step 4/5] [2021-11-19 21:10:03,033][INFO ][tcp-disco-srvr-[:47500]-#1023%grid-0%-#19534%grid-0%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=51649] [21:10:03] : [Step 4/5] [2021-11-19 21:10:03,034][INFO ][tcp-disco-srvr-[:47500]-#1023%grid-0%-#19534%grid-0%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=51649] [21:10:03] : [Step 4/5] [2021-11-19 21:10:03,034][INFO ][tcp-disco-sock-reader-[]-#1029%grid-0%-#19653%grid-0%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:51649, rmtPort=51649] [21:10:03] : [Step 4/5] [2021-11-19 21:10:03,036][INFO ][tcp-disco-sock-reader-[1093e7cf 127.0.0.1:51649]-#1029%grid-0%-#19653%grid-0%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=1093e7cf-2817-4221-b4f6-8a519c5db001, rmtAddr=/127.0.0.1:51649] [21:10:03] : [Step 4/5] [2021-11-19 21:10:03,042][INFO ][tcp-disco-srvr-[:47501]-#1028%grid-1%-#19652%grid-1%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=51325] [21:10:03] : [Step 4/5] [2021-11-19 21:10:03,042][INFO ][tcp-disco-srvr-[:47501]-#1028%grid-1%-#19652%grid-1%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=51325] [21:10:03] : [Step 4/5] [2021-11-19 21:10:03,043][INFO ][tcp-disco-sock-reader-[]-#1030%grid-1%-#19654%grid-1%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:51325, rmtPort=51325] [21:10:03] : [Step 4/5] [2021-11-19 21:10:03,043][INFO ][tcp-disco-sock-reader-[]-#1030%grid-1%-#19654%grid-1%][TestTcpDiscoverySpi] Received ping request from the remote node [rmtNodeId=00f85d16-a7bd-480e-a77e-c4a11db13000, rmtAddr=/127.0.0.1:51325, rmtPort=51325] [21:10:03] : [Step 4/5] [2021-11-19 21:10:03,045][INFO ][tcp-disco-sock-reader-[]-#1030%grid-1%-#19654%grid-1%][TestTcpDiscoverySpi] Finished writing ping response [rmtNodeId=00f85d16-a7bd-480e-a77e-c4a11db13000, rmtAddr=/127.0.0.1:51325, rmtPort=51325] [21:10:03] : [Step 4/5] [2021-11-19 21:10:03,045][INFO ][tcp-disco-sock-reader-[]-#1030%grid-1%-#19654%grid-1%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:51325, rmtPort=51325, rmtNodeId=null] [21:10:03] : [Step 4/5] [2021-11-19 21:10:03,045][INFO ][tcp-disco-sock-reader-[1093e7cf 127.0.0.1:51649]-#1029%grid-0%-#19653%grid-0%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:51649, rmtPort=51649, rmtNodeId=1093e7cf-2817-4221-b4f6-8a519c5db001] [21:10:03] : [Step 4/5] [2021-11-19 21:10:03,048][INFO ][tcp-disco-msg-worker-[crd]-#1022%grid-0%-#19533%grid-0%][GridEncryptionManager] Joining node doesn't have stored group keys [node=1093e7cf-2817-4221-b4f6-8a519c5db001] [21:10:03] : [Step 4/5] [2021-11-19 21:10:03,055][INFO ][tcp-disco-msg-worker-[crd]-#1022%grid-0%-#19533%grid-0%][TestTcpDiscoverySpi] New next node [newNext=TcpDiscoveryNode [id=1093e7cf-2817-4221-b4f6-8a519c5db001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=0, intOrder=2, lastExchangeTime=1637345403036, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false]] [21:10:03] : [Step 4/5] [2021-11-19 21:10:03,056][INFO ][tcp-disco-srvr-[:47501]-#1028%grid-1%-#19652%grid-1%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=48501] [21:10:03] : [Step 4/5] [2021-11-19 21:10:03,057][INFO ][tcp-disco-srvr-[:47501]-#1028%grid-1%-#19652%grid-1%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=48501] [21:10:03] : [Step 4/5] [2021-11-19 21:10:03,057][INFO ][tcp-disco-sock-reader-[]-#1031%grid-1%-#19655%grid-1%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:48501, rmtPort=48501] [21:10:03] : [Step 4/5] [2021-11-19 21:10:03,059][INFO ][tcp-disco-sock-reader-[00f85d16 127.0.0.1:48501]-#1031%grid-1%-#19655%grid-1%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=00f85d16-a7bd-480e-a77e-c4a11db13000, rmtAddr=/127.0.0.1:48501] [21:10:03] : [Step 4/5] [2021-11-19 21:10:03,062][INFO ][tcp-disco-msg-worker-[]-#1027%grid-1%-#19651%grid-1%][TestTcpDiscoverySpi] New next node [newNext=TcpDiscoveryNode [id=00f85d16-a7bd-480e-a77e-c4a11db13000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345403057, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false]] [21:10:03] : [Step 4/5] [2021-11-19 21:10:03,063][INFO ][tcp-disco-srvr-[:47500]-#1023%grid-0%-#19534%grid-0%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=60813] [21:10:03] : [Step 4/5] [2021-11-19 21:10:03,064][INFO ][tcp-disco-srvr-[:47500]-#1023%grid-0%-#19534%grid-0%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=60813] [21:10:03] : [Step 4/5] [2021-11-19 21:10:03,064][INFO ][tcp-disco-sock-reader-[]-#1032%grid-0%-#19656%grid-0%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:60813, rmtPort=60813] [21:10:03] : [Step 4/5] [2021-11-19 21:10:03,065][INFO ][tcp-disco-sock-reader-[1093e7cf 127.0.0.1:60813]-#1032%grid-0%-#19656%grid-0%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=1093e7cf-2817-4221-b4f6-8a519c5db001, rmtAddr=/127.0.0.1:60813] [21:10:03] : [Step 4/5] [2021-11-19 21:10:03,068][INFO ][disco-event-worker-#19536%grid-0%][GridDiscoveryManager] Added new node to topology: TcpDiscoveryNode [id=1093e7cf-2817-4221-b4f6-8a519c5db001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637345403036, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false] [21:10:03] : [Step 4/5] [2021-11-19 21:10:03,069][INFO ][disco-event-worker-#19536%grid-0%][GridDiscoveryManager] Topology snapshot [ver=2, locNode=00f85d16, servers=2, clients=0, state=INACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=00f85d16-a7bd-480e-a77e-c4a11db13000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=1093e7cf-2817-4221-b4f6-8a519c5db001, consistentId=grid-1, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:10:03] : [Step 4/5] [2021-11-19 21:10:03,072][INFO ][tcp-disco-msg-worker-[00f85d16 127.0.0.1:47500]-#1027%grid-1%-#19651%grid-1%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustEnabled' was changed from 'null' to 'false' [21:10:03] : [Step 4/5] [2021-11-19 21:10:03,072][INFO ][tcp-disco-msg-worker-[00f85d16 127.0.0.1:47500]-#1027%grid-1%-#19651%grid-1%][ClusterProcessor] inspiring_noether [21:10:03] : [Step 4/5] [2021-11-19 21:10:03,073][INFO ][tcp-disco-msg-worker-[00f85d16 127.0.0.1:47500]-#1027%grid-1%-#19651%grid-1%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustTimeout' was changed from 'null' to '300000' [21:10:03] : [Step 4/5] [2021-11-19 21:10:03,073][INFO ][tcp-disco-msg-worker-[00f85d16 127.0.0.1:47500]-#1027%grid-1%-#19651%grid-1%][IgniteTxManager] Transactions parameter 'longOperationsDumpTimeout' was changed from 'null' to '60000' [21:10:03] : [Step 4/5] [2021-11-19 21:10:03,074][INFO ][tcp-disco-msg-worker-[00f85d16 127.0.0.1:47500]-#1027%grid-1%-#19651%grid-1%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpThreshold' was changed from 'null' to '0' [21:10:03] : [Step 4/5] [2021-11-19 21:10:03,074][INFO ][tcp-disco-msg-worker-[00f85d16 127.0.0.1:47500]-#1027%grid-1%-#19651%grid-1%][IgniteTxManager] Transactions parameter 'transactionTimeDumpSamplesCoefficient' was changed from 'null' to '0.0' [21:10:03] : [Step 4/5] [2021-11-19 21:10:03,075][INFO ][tcp-disco-msg-worker-[00f85d16 127.0.0.1:47500]-#1027%grid-1%-#19651%grid-1%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpSamplesPerSecondLimit' was changed from 'null' to '5' [21:10:03] : [Step 4/5] [2021-11-19 21:10:03,075][INFO ][tcp-disco-msg-worker-[00f85d16 127.0.0.1:47500]-#1027%grid-1%-#19651%grid-1%][IgniteTxManager] Transactions parameter 'collisionsDumpInterval' was changed from 'null' to '1000' [21:10:03] : [Step 4/5] [2021-11-19 21:10:03,076][INFO ][tcp-disco-msg-worker-[00f85d16 127.0.0.1:47500]-#1027%grid-1%-#19651%grid-1%][IgniteTxManager] Transactions parameter 'txOwnerDumpRequestsAllowed' was changed from 'null' to 'true' [21:10:03] : [Step 4/5] [2021-11-19 21:10:03,076][INFO ][tcp-disco-msg-worker-[00f85d16 127.0.0.1:47500]-#1027%grid-1%-#19651%grid-1%][GridCacheDatabaseSharedManager] Historical rebalance WAL threshold changed [property=historical.rebalance.threshold, oldVal=null, newVal=500] [21:10:03] : [Step 4/5] [2021-11-19 21:10:03,077][INFO ][disco-notifier-worker-#19650%grid-1%][MvccProcessorImpl] Assigned mvcc coordinator [crd=MvccCoordinator [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=0], nodeId=00f85d16-a7bd-480e-a77e-c4a11db13000, ver=1637345401708, local=false, initialized=false]] [21:10:03] : [Step 4/5] [2021-11-19 21:10:03,079][INFO ][sys-#19634%grid-1%][ClusterProcessor] Writing cluster ID and tag to metastorage on ready for write ClusterIdAndTag [id=821283ee-e4ac-475a-ad81-9aa0e9c42070, tag=inspiring_noether] [21:10:03] : [Step 4/5] [2021-11-19 21:10:03,101][INFO ][test-runner-#19421%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] To start Console Management & Monitoring run ignitevisorcmd.{sh|bat} [21:10:03] : [Step 4/5] [2021-11-19 21:10:03,101][INFO ][test-runner-#19421%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] [21:10:03] : [Step 4/5] [21:10:03] : [Step 4/5] >>> +-------------------------------------------+ [21:10:03] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:10:03] : [Step 4/5] >>> +-------------------------------------------+ [21:10:03] : [Step 4/5] >>> OS name: Linux 4.15.0-151-generic amd64 [21:10:03] : [Step 4/5] >>> CPU(s): 24 [21:10:03] : [Step 4/5] >>> Heap: 2.0GB [21:10:03] : [Step 4/5] >>> VM name: 16724@c4dfe9a430b2 [21:10:03] : [Step 4/5] >>> Ignite instance name: grid-1 [21:10:03] : [Step 4/5] >>> Local node [ID=1093E7CF-2817-4221-B4F6-8A519C5DB001, order=2, clientMode=false] [21:10:03] : [Step 4/5] >>> Local node addresses: [127.0.0.1] [21:10:03] : [Step 4/5] >>> Local ports: TCP:10801 TCP:47101 TCP:47501 [21:10:03] : [Step 4/5] [21:10:03] : [Step 4/5] [2021-11-19 21:10:03,102][INFO ][test-runner-#19421%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] >>> Ignite cluster is in INACTIVE state (limited functionality available). Use control.(sh|bat) script or IgniteCluster.state(ClusterState.ACTIVE) to change the state. [21:10:03] : [Step 4/5] [2021-11-19 21:10:03,103][INFO ][test-runner-#19421%encryption.MasterKeyChangeTest%][GridDiscoveryManager] Topology snapshot [ver=2, locNode=1093e7cf, servers=2, clients=0, state=INACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=00f85d16-a7bd-480e-a77e-c4a11db13000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=1093e7cf-2817-4221-b4f6-8a519c5db001, consistentId=grid-1, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:10:03] : [Step 4/5] [2021-11-19 21:10:03,103][INFO ][test-runner-#19421%encryption.MasterKeyChangeTest%][G] Node started : [stage="Configure system pool" (0 ms),stage="Start managers" (190 ms),stage="Configure binary metadata" (1 ms),stage="Start processors" (542 ms),stage="Start 'StanByClusterTestProvider' plugin" (0 ms),stage="Start 'PageMemory tracker plugin' plugin" (0 ms),stage="Start 'TestDistibutedConfigurationPlugin' plugin" (0 ms),stage="Start 'NodeValidationPluginProvider' plugin" (0 ms),stage="Init metastore" (17 ms),stage="Init and start regions" (5 ms),stage="Restore binary memory" (19 ms),stage="Restore logical state" (92 ms),stage="Finish recovery" (419 ms),stage="Join topology" (50 ms),stage="Await transition" (2 ms),stage="Await exchange" (22 ms),stage="Total time" (1359 ms)] [21:10:03] : [Step 4/5] [2021-11-19 21:10:03,104][INFO ][test-runner-#19421%encryption.MasterKeyChangeTest%][root] Node started with the following configuration [id=1093e7cf-2817-4221-b4f6-8a519c5db001, marshaller=BinaryMarshaller [], discovery=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=5000, ackTimeout=5000, marsh=JdkMarshaller [clsFilter=org.apache.ignite.marshaller.MarshallerUtils$1@10645842], reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], binaryCfg=null, lateAff=true] [21:10:03] : [Step 4/5] [2021-11-19 21:10:03,106][INFO ][test-runner-#19421%encryption.MasterKeyChangeTest%][GridClusterStateProcessor] Sending activate cluster request with BaselineTopology BaselineTopology [id=0, branchingHash=-2475315501, branchingType='New BaselineTopology', baselineNodes=[grid-1, grid-0]] [21:10:03] : [Step 4/5] [2021-11-19 21:10:03,110][INFO ][disco-notifier-worker-#19532%grid-0%][GridClusterStateProcessor] Received activate cluster request with BaselineTopology[id=0] initiator node ID: 00f85d16-a7bd-480e-a77e-c4a11db13000 [21:10:03] : [Step 4/5] [2021-11-19 21:10:03,111][INFO ][disco-notifier-worker-#19532%grid-0%][GridClusterStateProcessor] Started state transition: activate cluster [21:10:03] : [Step 4/5] [2021-11-19 21:10:03,111][INFO ][exchange-worker-#19537%grid-0%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], crd=true, evt=DISCOVERY_CUSTOM_EVT, evtNode=00f85d16-a7bd-480e-a77e-c4a11db13000, customEvt=ChangeGlobalStateMessage [id=a487d593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqId=75bc5e73-054d-44bd-800d-131946590aa9, initiatingNodeId=00f85d16-a7bd-480e-a77e-c4a11db13000, state=ACTIVE, baselineTopology=BaselineTopology [id=0, branchingHash=-2475315501, branchingType='New BaselineTopology', baselineNodes=[grid-1, grid-0]], forceChangeBaselineTopology=false, timestamp=1637345403106, forceDeactivation=true], allowMerge=false, exchangeFreeSwitch=false] [21:10:03] : [Step 4/5] [2021-11-19 21:10:03,112][INFO ][disco-notifier-worker-#19650%grid-1%][GridClusterStateProcessor] Received activate cluster request with BaselineTopology[id=0] initiator node ID: 00f85d16-a7bd-480e-a77e-c4a11db13000 [21:10:03] : [Step 4/5] [2021-11-19 21:10:03,113][INFO ][exchange-worker-#19537%grid-0%][GridDhtPartitionsExchangeFuture] Start activation process [nodeId=00f85d16-a7bd-480e-a77e-c4a11db13000, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]]. New state: ACTIVE [21:10:03] : [Step 4/5] [2021-11-19 21:10:03,113][INFO ][disco-notifier-worker-#19650%grid-1%][GridClusterStateProcessor] Started state transition: activate cluster [21:10:03] : [Step 4/5] [2021-11-19 21:10:03,114][INFO ][exchange-worker-#19537%grid-0%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0 [21:10:03] : [Step 4/5] [2021-11-19 21:10:03,115][INFO ][exchange-worker-#19659%grid-1%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], crd=false, evt=DISCOVERY_CUSTOM_EVT, evtNode=00f85d16-a7bd-480e-a77e-c4a11db13000, customEvt=ChangeGlobalStateMessage [id=a487d593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqId=75bc5e73-054d-44bd-800d-131946590aa9, initiatingNodeId=00f85d16-a7bd-480e-a77e-c4a11db13000, state=ACTIVE, baselineTopology=BaselineTopology [id=0, branchingHash=-2475315501, branchingType='New BaselineTopology', baselineNodes=[grid-1, grid-0]], forceChangeBaselineTopology=false, timestamp=1637345403106, forceDeactivation=true], allowMerge=false, exchangeFreeSwitch=false] [21:10:03] : [Step 4/5] [2021-11-19 21:10:03,116][INFO ][exchange-worker-#19537%grid-0%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000000.wal, offset=8713, ver=2] [21:10:03] : [Step 4/5] [2021-11-19 21:10:03,116][INFO ][exchange-worker-#19659%grid-1%][GridDhtPartitionsExchangeFuture] Start activation process [nodeId=1093e7cf-2817-4221-b4f6-8a519c5db001, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]]. New state: ACTIVE [21:10:03] : [Step 4/5] [2021-11-19 21:10:03,118][INFO ][exchange-worker-#19537%grid-0%][GridClusterStateProcessor] Writing BaselineTopology[id=0] [21:10:03] : [Step 4/5] [2021-11-19 21:10:03,118][INFO ][exchange-worker-#19659%grid-1%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1 [21:10:03] : [Step 4/5] [2021-11-19 21:10:03,121][INFO ][exchange-worker-#19659%grid-1%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000000.wal, offset=8713, ver=2] [21:10:03] : [Step 4/5] [2021-11-19 21:10:03,123][INFO ][exchange-worker-#19659%grid-1%][GridClusterStateProcessor] Writing BaselineTopology[id=0] [21:10:03] : [Step 4/5] [2021-11-19 21:10:03,125][INFO ][exchange-worker-#19537%grid-0%][GridCacheDatabaseSharedManager] Finish recovery performed in 10 ms. [21:10:03] : [Step 4/5] [2021-11-19 21:10:03,127][INFO ][exchange-worker-#19537%grid-0%][msg] Components activation performed in 13 ms. [21:10:03] : [Step 4/5] [2021-11-19 21:10:03,128][INFO ][exchange-worker-#19537%grid-0%][GridCacheProcessor] Finished recovery for cache [cache=ignite-sys-cache, grp=ignite-sys-cache, startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:10:03] : [Step 4/5] [2021-11-19 21:10:03,128][INFO ][exchange-worker-#19659%grid-1%][GridCacheDatabaseSharedManager] Finish recovery performed in 8 ms. [21:10:03] : [Step 4/5] [2021-11-19 21:10:03,129][INFO ][exchange-worker-#19537%grid-0%][GridDhtPartitionsExchangeFuture] Successfully activated caches [nodeId=00f85d16-a7bd-480e-a77e-c4a11db13000, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], newState=ACTIVE] [21:10:03] : [Step 4/5] [2021-11-19 21:10:03,130][INFO ][exchange-worker-#19659%grid-1%][msg] Components activation performed in 12 ms. [21:10:03] : [Step 4/5] [2021-11-19 21:10:03,131][INFO ][exchange-worker-#19537%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:10:03] : [Step 4/5] [2021-11-19 21:10:03,132][INFO ][exchange-worker-#19659%grid-1%][GridCacheProcessor] Finished recovery for cache [cache=ignite-sys-cache, grp=ignite-sys-cache, startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:10:03] : [Step 4/5] [2021-11-19 21:10:03,132][INFO ][exchange-worker-#19659%grid-1%][GridDhtPartitionsExchangeFuture] Successfully activated caches [nodeId=1093e7cf-2817-4221-b4f6-8a519c5db001, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], newState=ACTIVE] [21:10:03] : [Step 4/5] [2021-11-19 21:10:03,133][INFO ][exchange-worker-#19659%grid-1%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:10:03] : [Step 4/5] [2021-11-19 21:10:03,140][INFO ][exchange-worker-#19537%grid-0%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], crd=true] [21:10:03] : [Step 4/5] [2021-11-19 21:10:03,142][INFO ][db-checkpoint-thread-#19668%grid-0%][Checkpointer] Checkpoint started [checkpointId=2b8d8041-8dfb-48be-ac60-d090858d17eb, startPtr=WALPointer [idx=0, fileOff=79111, len=1963], checkpointBeforeLockTime=2ms, checkpointLockWait=1ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=0ms, writeCheckpointEntryDuration=2ms, splitAndSortCpPagesDuration=0ms, pages=18, reason='node started'] [21:10:03] : [Step 4/5] [2021-11-19 21:10:03,157][INFO ][grid-nio-worker-tcp-comm-0-#19476%TestRecordingCommunicationSpi%][TestRecordingCommunicationSpi] Accepted incoming communication connection [locAddr=/127.0.0.1:47100, rmtAddr=/127.0.0.1:60012] [21:10:03] : [Step 4/5] [2021-11-19 21:10:03,162][INFO ][grid-nio-worker-tcp-comm-0-#19594%TestRecordingCommunicationSpi%][TestRecordingCommunicationSpi] Established outgoing communication connection [locAddr=/127.0.0.1:60012, rmtAddr=/127.0.0.1:47100] [21:10:03] : [Step 4/5] [2021-11-19 21:10:03,162][INFO ][exchange-worker-#19659%grid-1%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], crd=false] [21:10:03] : [Step 4/5] [2021-11-19 21:10:03,165][INFO ][sys-#19518%grid-0%][GridDhtPartitionsExchangeFuture] Coordinator received single message [ver=AffinityTopologyVersion [topVer=2, minorTopVer=1], node=1093e7cf-2817-4221-b4f6-8a519c5db001, allReceived=true] [21:10:03] : [Step 4/5] [2021-11-19 21:10:03,165][INFO ][sys-#19518%grid-0%][GridDhtPartitionsExchangeFuture] finishExchangeOnCoordinator [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:10:03] : [Step 4/5] [2021-11-19 21:10:03,171][INFO ][sys-#19518%grid-0%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], err=null, rebalanced=true, wasRebalanced=false] [21:10:03] : [Step 4/5] [2021-11-19 21:10:03,172][INFO ][db-checkpoint-thread-#19673%grid-1%][Checkpointer] Checkpoint started [checkpointId=5ee608b9-ef59-4dca-b054-ae91f3a93b65, startPtr=WALPointer [idx=0, fileOff=87307, len=1963], checkpointBeforeLockTime=12ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=1ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=8ms, writeCheckpointEntryDuration=9ms, splitAndSortCpPagesDuration=0ms, pages=19, reason='node started'] [21:10:03] : [Step 4/5] [2021-11-19 21:10:03,172][INFO ][sys-#19630%grid-1%][GridDhtPartitionsExchangeFuture] Received full message, will finish exchange [node=00f85d16-a7bd-480e-a77e-c4a11db13000, resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:10:03] : [Step 4/5] [2021-11-19 21:10:03,172][INFO ][db-checkpoint-thread-#19668%grid-0%][Checkpointer] Checkpoint finished [cpId=2b8d8041-8dfb-48be-ac60-d090858d17eb, pages=18, markPos=WALPointer [idx=0, fileOff=79111, len=1963], walSegmentsCovered=[], markDuration=3ms, pagesWrite=10ms, fsync=18ms, total=34ms] [21:10:03] : [Step 4/5] [2021-11-19 21:10:03,171][INFO ][disco-notifier-worker-#19532%grid-0%][GridClusterStateProcessor] Received state change finish message: ACTIVE [21:10:03] : [Step 4/5] [2021-11-19 21:10:03,175][INFO ][sys-#19630%grid-1%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], err=null, rebalanced=true, wasRebalanced=false] [21:10:03] : [Step 4/5] [2021-11-19 21:10:03,175][INFO ][sys-#19639%grid-1%][GridCachePartitionExchangeManager] Delay process full message without exchange id (there is exchange in progress) [nodeId=00f85d16-a7bd-480e-a77e-c4a11db13000] [21:10:03] : [Step 4/5] [2021-11-19 21:10:03,174][INFO ][disco-notifier-worker-#19650%grid-1%][GridClusterStateProcessor] Received state change finish message: ACTIVE [21:10:03] : [Step 4/5] [2021-11-19 21:10:03,176][INFO ][disco-notifier-worker-#19532%grid-0%][GridClusterStateProcessor] Cluster state was changed from INACTIVE to ACTIVE [21:10:03] : [Step 4/5] [2021-11-19 21:10:03,177][INFO ][disco-notifier-worker-#19650%grid-1%][GridClusterStateProcessor] Cluster state was changed from INACTIVE to ACTIVE [21:10:03] : [Step 4/5] [2021-11-19 21:10:03,181][INFO ][sys-#19518%grid-0%][GridCacheProcessor] Finish proxy initialization, cacheName=ignite-sys-cache, localNodeId=00f85d16-a7bd-480e-a77e-c4a11db13000 [21:10:03] : [Step 4/5] [2021-11-19 21:10:03,182][INFO ][sys-#19509%grid-0%][DistributedBaselineConfiguration] Baseline auto-adjust is 'disabled' with timeout='300000' ms [21:10:03] : [Step 4/5] [2021-11-19 21:10:03,183][INFO ][sys-#19518%grid-0%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=00f85d16-a7bd-480e-a77e-c4a11db13000, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=00f85d16-a7bd-480e-a77e-c4a11db13000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345403169, loc=true, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:10:03] : [Step 4/5] [2021-11-19 21:10:03,183][INFO ][sys-#19630%grid-1%][GridCacheProcessor] Finish proxy initialization, cacheName=ignite-sys-cache, localNodeId=1093e7cf-2817-4221-b4f6-8a519c5db001 [21:10:03] : [Step 4/5] [2021-11-19 21:10:03,182][INFO ][exchange-worker-#19537%grid-0%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=2, minorTopVer=1], force=false, evt=DISCOVERY_CUSTOM_EVT, node=00f85d16-a7bd-480e-a77e-c4a11db13000] [21:10:03] : [Step 4/5] [2021-11-19 21:10:03,186][INFO ][sys-#19645%grid-1%][DistributedBaselineConfiguration] Baseline auto-adjust is 'disabled' with timeout='300000' ms [21:10:03] : [Step 4/5] [2021-11-19 21:10:03,184][INFO ][sys-#19518%grid-0%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (1 ms), stage="Update caches registry" (14 ms), stage="Start caches" (0 ms), stage="Affinity initialization on cache group start" (0 ms), stage="Determine exchange type" (2 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Restore partition states" (0 ms), stage="After states restored callback" (8 ms), stage="WAL history reservation" (0 ms), stage="Waiting for all single messages" (25 ms), stage="Affinity recalculation (crd)" (0 ms), stage="Collect update counters and create affinity messages" (0 ms), stage="Assign partitions states" (0 ms), stage="Validate partitions states" (0 ms), stage="Ideal affinity diff calculation (enforced)" (0 ms), stage="Apply update counters" (0 ms), stage="Full message preparing" (3 ms), stage="Full message sending" (0 ms), stage="State finish message sending" (0 ms), stage="Detect lost partitions" (3 ms), stage="Exchange done" (9 ms), stage="Total time" (65 ms), Discovery lag=3 ms, Latest started node id=1093e7cf-2817-4221-b4f6-8a519c5db001] [21:10:03] : [Step 4/5] [2021-11-19 21:10:03,183][INFO ][sys-#19509%grid-0%][GridClusterStateProcessor] Successfully performed final activation steps [nodeId=00f85d16-a7bd-480e-a77e-c4a11db13000, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:10:03] : [Step 4/5] [2021-11-19 21:10:03,190][INFO ][sys-#19518%grid-0%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], stage="Affinity initialization on cache group start [grp=ignite-sys-cache]" (0 ms) (parent=Affinity initialization on cache group start), stage="Affinity centralized initialization (crd) [grp=ignite-sys-cache, crd=true]" (2 ms) (parent=Determine exchange type), stage="Restore partition states [grp=ignite-sys-cache]" (0 ms) (parent=Restore partition states), stage="Affinity recalculation (partitions availability) [grp=ignite-sys-cache]" (0 ms) (parent=Ideal affinity diff calculation (enforced))] [21:10:03] : [Step 4/5] [2021-11-19 21:10:03,187][INFO ][test-runner-#19421%encryption.MasterKeyChangeTest%][root] awaitPartitionMapExchange finished [21:10:03] : [Step 4/5] [2021-11-19 21:10:03,186][INFO ][sys-#19645%grid-1%][GridClusterStateProcessor] Successfully performed final activation steps [nodeId=1093e7cf-2817-4221-b4f6-8a519c5db001, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:10:03] : [Step 4/5] [2021-11-19 21:10:03,186][INFO ][sys-#19630%grid-1%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=1093e7cf-2817-4221-b4f6-8a519c5db001, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=00f85d16-a7bd-480e-a77e-c4a11db13000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345403057, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:10:03] : [Step 4/5] [2021-11-19 21:10:03,194][INFO ][sys-#19630%grid-1%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (1 ms), stage="Update caches registry" (15 ms), stage="Start caches" (0 ms), stage="Affinity initialization on cache group start" (0 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Restore partition states" (0 ms), stage="After states restored callback" (20 ms), stage="WAL history reservation" (0 ms), stage="Waiting for Full message" (18 ms), stage="Affinity recalculation" (2 ms), stage="Full map updating" (0 ms), stage="Detect lost partitions" (6 ms), stage="Exchange done" (12 ms), stage="Total time" (74 ms)] [21:10:03] : [Step 4/5] [2021-11-19 21:10:03,195][INFO ][sys-#19630%grid-1%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], stage="Affinity initialization on cache group start [grp=ignite-sys-cache]" (0 ms) (parent=Affinity initialization on cache group start), stage="Affinity centralized initialization (crd) [grp=ignite-sys-cache, crd=false]" (0 ms) (parent=Determine exchange type), stage="Restore partition states [grp=ignite-sys-cache]" (0 ms) (parent=Restore partition states), stage="Affinity applying from full message [grp=ignite-sys-cache]" (2 ms) (parent=Affinity recalculation)] [21:10:03] : [Step 4/5] [2021-11-19 21:10:03,186][INFO ][exchange-worker-#19659%grid-1%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=2, minorTopVer=1], force=false, evt=DISCOVERY_CUSTOM_EVT, node=00f85d16-a7bd-480e-a77e-c4a11db13000] [21:10:03] : [Step 4/5] [2021-11-19 21:10:03,199][INFO ][exchange-worker-#19659%grid-1%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], crd=false, evt=DISCOVERY_CUSTOM_EVT, evtNode=00f85d16-a7bd-480e-a77e-c4a11db13000, customEvt=DynamicCacheChangeBatch [id=e687d593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqs=ArrayList [DynamicCacheChangeRequest [cacheName=encrypted, hasCfg=true, nodeId=00f85d16-a7bd-480e-a77e-c4a11db13000, clientStartOnly=false, stop=false, destroy=false, disabledAfterStart=false]], exchangeActions=ExchangeActions [startCaches=[encrypted], stopCaches=null, startGrps=[encrypted], stopGrps=[], resetParts=null, stateChangeRequest=null], startCaches=false], allowMerge=false, exchangeFreeSwitch=false] [21:10:03] : [Step 4/5] [2021-11-19 21:10:03,200][INFO ][db-checkpoint-thread-#19673%grid-1%][Checkpointer] Checkpoint finished [cpId=5ee608b9-ef59-4dca-b054-ae91f3a93b65, pages=19, markPos=WALPointer [idx=0, fileOff=87307, len=1963], walSegmentsCovered=[], markDuration=21ms, pagesWrite=7ms, fsync=19ms, total=59ms] [21:10:03] : [Step 4/5] [2021-11-19 21:10:03,199][INFO ][exchange-worker-#19537%grid-0%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], crd=true, evt=DISCOVERY_CUSTOM_EVT, evtNode=00f85d16-a7bd-480e-a77e-c4a11db13000, customEvt=DynamicCacheChangeBatch [id=e687d593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqs=ArrayList [DynamicCacheChangeRequest [cacheName=encrypted, hasCfg=true, nodeId=00f85d16-a7bd-480e-a77e-c4a11db13000, clientStartOnly=false, stop=false, destroy=false, disabledAfterStart=false]], exchangeActions=ExchangeActions [startCaches=[encrypted], stopCaches=null, startGrps=[encrypted], stopGrps=[], resetParts=null, stateChangeRequest=null], startCaches=false], allowMerge=false, exchangeFreeSwitch=false] [21:10:03] : [Step 4/5] [2021-11-19 21:10:03,202][INFO ][exchange-worker-#19659%grid-1%][PageMemoryImpl] Started page memory [memoryAllocated=24.0 MiB, pages=5952, tableSize=474.2 KiB, replacementSize=768 B, checkpointBuffer=10.0 MiB] [21:10:03] : [Step 4/5] [2021-11-19 21:10:03,203][INFO ][exchange-worker-#19537%grid-0%][PageMemoryImpl] Started page memory [memoryAllocated=24.0 MiB, pages=5952, tableSize=474.2 KiB, replacementSize=768 B, checkpointBuffer=10.0 MiB] [21:10:03] : [Step 4/5] [2021-11-19 21:10:03,279][INFO ][exchange-worker-#19537%grid-0%][GridCacheProcessor] Started cache [name=encrypted, id=1613773252, dataRegionName=default, mode=PARTITIONED, atomicity=ATOMIC, backups=0, mvcc=false] [21:10:03]W: [org.apache.ignite:ignite-core] [2021-11-19 21:10:03,281][WARN ][exchange-worker-#19537%grid-0%][CacheAffinitySharedManager] Cache group 'encrypted' brings high overhead for its metainformation in data region 'default'. Metainformation required for its partitions (502 partitions, 4096 bytes per partition, 1 MBs total) will consume more than 15% of data region memory (10 MBs). It may lead to critical errors on the node and cluster instability. Please reduce number of partitions, add more memory to the data region or add more server nodes for this cache group. [21:10:03] : [Step 4/5] [2021-11-19 21:10:03,282][INFO ][exchange-worker-#19537%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], waitTime=0ms, futInfo=NA, mode=DISTRIBUTED] [21:10:03] : [Step 4/5] [2021-11-19 21:10:03,285][INFO ][exchange-worker-#19659%grid-1%][GridCacheProcessor] Started cache [name=encrypted, id=1613773252, dataRegionName=default, mode=PARTITIONED, atomicity=ATOMIC, backups=0, mvcc=false] [21:10:03]W: [org.apache.ignite:ignite-core] [2021-11-19 21:10:03,286][WARN ][exchange-worker-#19659%grid-1%][CacheAffinitySharedManager] Cache group 'encrypted' brings high overhead for its metainformation in data region 'default'. Metainformation required for its partitions (522 partitions, 4096 bytes per partition, 2 MBs total) will consume more than 15% of data region memory (10 MBs). It may lead to critical errors on the node and cluster instability. Please reduce number of partitions, add more memory to the data region or add more server nodes for this cache group. [21:10:03] : [Step 4/5] [2021-11-19 21:10:03,287][INFO ][exchange-worker-#19659%grid-1%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], waitTime=0ms, futInfo=NA, mode=DISTRIBUTED] [21:10:03] : [Step 4/5] [2021-11-19 21:10:03,288][INFO ][exchange-worker-#19537%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partitions release latch: ServerLatch [permits=0, pendingAcks=HashSet [], super=CompletableLatch [id=CompletableLatchUid [id=exchange, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2]]]] [21:10:03] : [Step 4/5] [2021-11-19 21:10:03,289][INFO ][exchange-worker-#19659%grid-1%][GridDhtPartitionsExchangeFuture] Finished waiting for partitions release latch: ClientLatch [coordinator=TcpDiscoveryNode [id=00f85d16-a7bd-480e-a77e-c4a11db13000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345403057, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], ackSent=true, super=CompletableLatch [id=CompletableLatchUid [id=exchange, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2]]]] [21:10:03] : [Step 4/5] [2021-11-19 21:10:03,289][INFO ][exchange-worker-#19537%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:10:03] : [Step 4/5] [2021-11-19 21:10:03,291][INFO ][exchange-worker-#19659%grid-1%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:10:03] : [Step 4/5] [2021-11-19 21:10:03,329][INFO ][exchange-worker-#19537%grid-0%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], crd=true] [21:10:03] : [Step 4/5] [2021-11-19 21:10:03,330][INFO ][exchange-worker-#19659%grid-1%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], crd=false] [21:10:03] : [Step 4/5] [2021-11-19 21:10:03,331][INFO ][sys-#19516%grid-0%][GridDhtPartitionsExchangeFuture] Coordinator received single message [ver=AffinityTopologyVersion [topVer=2, minorTopVer=2], node=1093e7cf-2817-4221-b4f6-8a519c5db001, allReceived=true] [21:10:03] : [Step 4/5] [2021-11-19 21:10:03,331][INFO ][sys-#19516%grid-0%][GridDhtPartitionsExchangeFuture] finishExchangeOnCoordinator [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2]] [21:10:03] : [Step 4/5] [2021-11-19 21:10:03,336][INFO ][sys-#19516%grid-0%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], err=null, rebalanced=true, wasRebalanced=true] [21:10:03] : [Step 4/5] [2021-11-19 21:10:03,337][INFO ][sys-#19631%grid-1%][GridDhtPartitionsExchangeFuture] Received full message, will finish exchange [node=00f85d16-a7bd-480e-a77e-c4a11db13000, resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2]] [21:10:03] : [Step 4/5] [2021-11-19 21:10:03,337][INFO ][sys-#19516%grid-0%][GridCacheProcessor] Finish proxy initialization, cacheName=encrypted, localNodeId=00f85d16-a7bd-480e-a77e-c4a11db13000 [21:10:03] : [Step 4/5] [2021-11-19 21:10:03,338][INFO ][sys-#19516%grid-0%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=00f85d16-a7bd-480e-a77e-c4a11db13000, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=00f85d16-a7bd-480e-a77e-c4a11db13000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345403189, loc=true, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2]] [21:10:03] : [Step 4/5] [2021-11-19 21:10:03,340][INFO ][exchange-worker-#19537%grid-0%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=2, minorTopVer=2], force=false, evt=DISCOVERY_CUSTOM_EVT, node=00f85d16-a7bd-480e-a77e-c4a11db13000] [21:10:03] : [Step 4/5] [2021-11-19 21:10:03,340][INFO ][sys-#19631%grid-1%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], err=null, rebalanced=true, wasRebalanced=true] [21:10:03] : [Step 4/5] [2021-11-19 21:10:03,341][INFO ][sys-#19516%grid-0%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (3 ms), stage="Update caches registry" (0 ms), stage="Start caches" (76 ms), stage="Affinity initialization on cache group start" (2 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (1 ms), stage="Wait partitions release latch [latch=exchange]" (5 ms), stage="Wait partitions release [latch=exchange]" (1 ms), stage="Restore partition states" (12 ms), stage="After states restored callback" (25 ms), stage="WAL history reservation" (0 ms), stage="Waiting for all single messages" (2 ms), stage="Affinity recalculation (crd)" (0 ms), stage="Collect update counters and create affinity messages" (0 ms), stage="Assign partitions states" (1 ms), stage="Validate partitions states" (0 ms), stage="Apply update counters" (0 ms), stage="Full message preparing" (2 ms), stage="Full message sending" (0 ms), stage="Exchange done" (5 ms), stage="Total time" (135 ms)] [21:10:03] : [Step 4/5] [2021-11-19 21:10:03,343][INFO ][sys-#19631%grid-1%][GridCacheProcessor] Finish proxy initialization, cacheName=encrypted, localNodeId=1093e7cf-2817-4221-b4f6-8a519c5db001 [21:10:03] : [Step 4/5] [2021-11-19 21:10:03,344][INFO ][sys-#19516%grid-0%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], stage="Affinity initialization on cache group start [grp=encrypted]" (1 ms) (parent=Affinity initialization on cache group start), stage="Restore partition states [grp=encrypted]" (12 ms) (parent=Restore partition states), stage="Restore partition states [grp=ignite-sys-cache]" (0 ms) (parent=Restore partition states)] [21:10:03] : [Step 4/5] [2021-11-19 21:10:03,345][INFO ][exchange-worker-#19659%grid-1%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=2, minorTopVer=2], force=false, evt=DISCOVERY_CUSTOM_EVT, node=00f85d16-a7bd-480e-a77e-c4a11db13000] [21:10:03] : [Step 4/5] [2021-11-19 21:10:03,345][INFO ][sys-#19631%grid-1%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=1093e7cf-2817-4221-b4f6-8a519c5db001, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=00f85d16-a7bd-480e-a77e-c4a11db13000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345403057, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2]] [21:10:03] : [Step 4/5] [2021-11-19 21:10:03,347][INFO ][sys-#19631%grid-1%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (1 ms), stage="Update caches registry" (0 ms), stage="Start caches" (84 ms), stage="Affinity initialization on cache group start" (2 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Wait partitions release latch [latch=exchange]" (2 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Restore partition states" (12 ms), stage="After states restored callback" (25 ms), stage="WAL history reservation" (0 ms), stage="Waiting for Full message" (7 ms), stage="Affinity recalculation" (0 ms), stage="Full map updating" (2 ms), stage="Exchange done" (7 ms), stage="Total time" (142 ms)] [21:10:03] : [Step 4/5] [2021-11-19 21:10:03,349][INFO ][sys-#19631%grid-1%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], stage="Affinity initialization on cache group start [grp=encrypted]" (1 ms) (parent=Affinity initialization on cache group start), stage="Restore partition states [grp=encrypted]" (12 ms) (parent=Restore partition states), stage="Restore partition states [grp=ignite-sys-cache]" (0 ms) (parent=Restore partition states)] [21:10:05] : [Step 4/5] [2021-11-19 21:10:05,632][INFO ][test-runner-#19421%encryption.MasterKeyChangeTest%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:10:05] : [Step 4/5] [2021-11-19 21:10:05,775][INFO ][disco-notifier-worker-#19650%grid-1%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:10:05] : [Step 4/5] [2021-11-19 21:10:05,779][INFO ][disco-notifier-worker-#19532%grid-0%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:10:05] : [Step 4/5] [2021-11-19 21:10:05,915][INFO ][disco-notifier-worker-#19650%grid-1%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:10:05] : [Step 4/5] [2021-11-19 21:10:05,937][INFO ][disco-notifier-worker-#19532%grid-0%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:10:06] : [Step 4/5] [2021-11-19 21:10:06,025][INFO ][disco-notifier-worker-#19532%grid-0%][GridEncryptionManager] Start master key change [masterKeyName=ignite.master.key2] [21:10:06] : [Step 4/5] [2021-11-19 21:10:06,025][INFO ][disco-notifier-worker-#19650%grid-1%][GridEncryptionManager] Start master key change [masterKeyName=ignite.master.key2] [21:10:06] : [Step 4/5] [2021-11-19 21:10:06,081][INFO ][disco-notifier-worker-#19532%grid-0%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:10:06] : [Step 4/5] [2021-11-19 21:10:06,086][INFO ][disco-notifier-worker-#19650%grid-1%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:10:06] : [Step 4/5] [2021-11-19 21:10:06,423][INFO ][disco-notifier-worker-#19650%grid-1%][GridEncryptionManager] Master key successfully changed [masterKeyName=ignite.master.key2] [21:10:06] : [Step 4/5] [2021-11-19 21:10:06,423][INFO ][disco-notifier-worker-#19532%grid-0%][GridEncryptionManager] Master key successfully changed [masterKeyName=ignite.master.key2] [21:10:06] : [Step 4/5] [2021-11-19 21:10:06,424][INFO ][disco-notifier-worker-#19650%grid-1%][IgniteTestResources] Block message [node=00f85d16-a7bd-480e-a77e-c4a11db13000, order=1, msg=org.apache.ignite.internal.util.distributed.SingleNodeMessage@7d9fd011] [21:10:06] : [Step 4/5] [2021-11-19 21:10:06,425][INFO ][async-runnable-runner-1][root] >>> Stopping grid [name=grid-1, id=1093e7cf-2817-4221-b4f6-8a519c5db001] [21:10:06] : [Step 4/5] [2021-11-19 21:10:06,445][INFO ][db-checkpoint-thread-#19673%grid-1%][Checkpointer] Checkpoint started [checkpointId=0e80f760-b675-460e-b2f9-f20b14f3d92b, startPtr=WALPointer [idx=0, fileOff=642798, len=11871], checkpointBeforeLockTime=6ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=1ms, checkpointLockHoldTime=2ms, walCpRecordFsyncDuration=5ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=0ms, pages=455, reason='timeout'] [21:10:06] : [Step 4/5] [2021-11-19 21:10:06,452][INFO ][tcp-disco-sock-reader-[00f85d16 127.0.0.1:48501]-#1031%grid-1%-#19655%grid-1%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:48501, rmtPort=48501, rmtNodeId=00f85d16-a7bd-480e-a77e-c4a11db13000] [21:10:06] : [Step 4/5] [2021-11-19 21:10:06,453][INFO ][disco-event-worker-#19536%grid-0%][GridDiscoveryManager] Node left topology: TcpDiscoveryNode [id=1093e7cf-2817-4221-b4f6-8a519c5db001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637345403036, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false] [21:10:06] : [Step 4/5] [2021-11-19 21:10:06,455][INFO ][async-runnable-runner-1][GridCacheProcessor] Stopped cache [cacheName=ignite-sys-cache] [21:10:06] : [Step 4/5] [2021-11-19 21:10:06,456][INFO ][disco-event-worker-#19536%grid-0%][GridDiscoveryManager] Topology snapshot [ver=3, locNode=00f85d16, servers=1, clients=0, state=ACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=00f85d16-a7bd-480e-a77e-c4a11db13000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:10:06] : [Step 4/5] [2021-11-19 21:10:06,456][INFO ][async-runnable-runner-1][GridCacheProcessor] Stopped cache [cacheName=encrypted] [21:10:06] : [Step 4/5] [2021-11-19 21:10:06,457][INFO ][disco-event-worker-#19536%grid-0%][GridDiscoveryManager] ^-- Baseline [id=0, size=2, online=1, offline=1] [21:10:06] : [Step 4/5] [21:10:06] >>> Stopping test: MasterKeyChangeTest#testNodeFailsDuringRotationNotCoordinatorPerform in 6301 ms <<< [21:10:06] : [Step 4/5] [2021-11-19 21:10:06,460][INFO ][main][root] >>> Stopping test: MasterKeyChangeTest#testNodeFailsDuringRotationNotCoordinatorPerform in 6301 ms <<< [21:10:06] : [Step 4/5] [21:10:06] >>> Heap: 459 MB used / 1933 MB commited / 1933 MB max <<< [21:10:06] : [Step 4/5] [2021-11-19 21:10:06,460][INFO ][main][root] >>> Heap: 459 MB used / 1933 MB commited / 1933 MB max <<< [21:10:06] : [Step 4/5] [21:10:06] >>> Non-Heap: 155 MB used / 182 MB commited / 0 MB max <<< [21:10:06] : [Step 4/5] [2021-11-19 21:10:06,460][INFO ][main][root] >>> Non-Heap: 155 MB used / 182 MB commited / 0 MB max <<< [21:10:06] : [Step 4/5] [2021-11-19 21:10:06,461][INFO ][exchange-worker-#19537%grid-0%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], crd=true, evt=NODE_LEFT, evtNode=1093e7cf-2817-4221-b4f6-8a519c5db001, customEvt=null, allowMerge=false, exchangeFreeSwitch=true] [21:10:06] : [Step 4/5] [2021-11-19 21:10:06,463][INFO ][sys-#19509%grid-0%][GridAffinityAssignmentCache] Local node affinity assignment distribution is not ideal [cache=encrypted, expectedPrimary=1024.00, actualPrimary=502, expectedBackups=0.00, actualBackups=0, warningThreshold=50.00%] [21:10:06] : [Step 4/5] [21:10:06] >>> Starting test: MasterKeyChangeTest#testNodeFailsDuringRotationNotCoordinatorPrepare <<< [21:10:06] : [Step 4/5] [2021-11-19 21:10:06,464][INFO ][main][root] >>> Starting test: MasterKeyChangeTest#testNodeFailsDuringRotationNotCoordinatorPrepare <<< [21:10:06] : [Step 4/5] [2021-11-19 21:10:06[21:,410:06] >>> 64][INFO ][excHeahange-worker-#19537%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], waitTime=0ms, fp: 460 MB used / utInfo=NA, mode=LOCAL] [21:10:06] : [Step 4/5] 1933 MB commited / 1933 MB max <<< [21:10:06] : [Step 4/5] [2021-11-19 21:10:06,466][INFO ][main][root] >>> Heap: 460 MB used / 1933 MB commited / 1933 MB max <<< [21:10:06] : [Step 4/5] [21:10:06] >>> Non-Heap: 155 MB used / 182 MB commited / 0 MB max <<< [21:10:06] : [Step 4/5] [2021-11-19 21:10:06,466][INFO ][main][root] >>> Non-Heap: 155 MB used / 182 MB commited / 0 MB max <<< [21:10:06] : [Step 4/5] [2021-11-19 21:10:06,466][INFO ][main][root] >>> Stopping grid [name=grid-1, id=1093e7cf-2817-4221-b4f6-8a519c5db001] [21:10:06] : [Step 4/5] [2021-11-19 21:10:06,467][INFO ][exchange-worker-#19537%grid-0%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], err=null, rebalanced=true, wasRebalanced=true] [21:10:06]W: [org.apache.ignite:ignite-core] [2021-11-19 21:10:06,468][WARN ][exchange-worker-#19537%grid-0%][GridDhtPartitionTopologyImpl] Detected lost partitions [grp=encrypted, parts=[0, 2, 4, 6-7, 10-11, 14, 17, 21, 24-30, 32, 37, 40, 44, 47-52, 54, 57, 59, 62-64, 67-68, 74-75, 78, 81, 87-88, 91, 97, 99, 101-102, 104-107, 113-114, 116, 118, 120, 122, 124, 135-136, 138, 140-145, 147, 149-152, 154-156, 159-160, 162-164, 169, 172, 175-177, 180, 184-187, 190-191, 194, 196-202, 204-205, 209-210, 212, 214, 216, 219-224, 226, 229-232, 237, 239, 241, 243-245, 247, 249-251, 255, 257, 261, 265, 269, 272-273, 276-277, 281-282, 285, 287, 289-291, 293-297, 299, 301-304, 306, 308-309, 311-312, 315-317, 319, 322, 325-326, 328-330, 336, 339, 341, 344-346, 350, 352-354, 357-361, 363, 366-367, 371-373, 376-380, 383, 385, 387-388, 390, 392, 395-397, 400, 402, 405, 408-411, 416, 420, 422, 424-425, 429, 433, 435-438, 440-441, 445-446, 450, 452-453, 455-456, 458, 460, 462-463, 465-468, 470, 474-475, 480, 488, 490-492, 495, 497, 499-512, 516, 525, 527-531, 535, 537-538, 541-542, 545-546, 548-552, 554-555, 558, 562-564, 567-569, 572, 574, 579-580, 582-585, 587, 590-591, 594, 596, 600, 602, 604, 607-614, 617-620, 623-624, 627-629, 632-633, 636, 638, 640-642, 645-646, 648-649, 657-662, 664-665, 668-672, 677-678, 682-684, 686, 689, 692-693, 695-697, 699, 706-707, 709-710, 712-714, 716-717, 719-721, 723-728, 730-732, 734-735, 739, 742, 746, 749-750, 752, 754, 756, 762, 768-770, 772-775, 778, 780, 783-787, 789-791, 793, 796, 798-801, 803, 806, 809-812, 814, 816-817, 819, 822-825, 827-829, 832-833, 836-837, 839-840, 846, 848-851, 853-854, 857-858, 860, 863-864, 866, 868-871, 873-875, 877-878, 884, 888-889, 896-897, 900, 905-907, 914-915, 917, 919-920, 923-925, 931-933, 936, 940, 942, 944-945, 948, 950-951, 954, 956-958, 962, 965-970, 972, 975-976, 978-980, 983, 985, 988, 990, 993-994, 997-998, 1000, 1003-1004, 1007, 1009, 1014, 1016, 1018-1019], topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0]] [21:10:06] : [Step 4/5] [2021-11-19 21:10:06,474][INFO ][exchange-worker-#19537%grid-0%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=00f85d16-a7bd-480e-a77e-c4a11db13000, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], evt=NODE_LEFT, evtNode=TcpDiscoveryNode [id=1093e7cf-2817-4221-b4f6-8a519c5db001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637345403036, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0]] [21:10:06] : [Step 4/5] [2021-11-19 21:10:06,475][INFO ][exchange-worker-#19537%grid-0%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (1 ms), stage="Determine exchange type" (2 ms), stage="Preloading notification" (0 ms), stage="After states restored callback" (1 ms), stage="WAL history reservation" (0 ms), stage="Finalize update counters" (0 ms), stage="Detect lost partitions" (6 ms), stage="Exchange done" (2 ms), stage="Total time" (12 ms)] [21:10:06] : [Step 4/5] [2021-11-19 21:10:06,476][INFO ][exchange-worker-#19537%grid-0%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], stage="Affinity initialization (exchange-free switch on fully-rebalanced topology) [grp=encrypted]" (1 ms) (parent=Determine exchange type), stage="Affinity initialization (exchange-free switch on fully-rebalanced topology) [grp=ignite-sys-cache]" (0 ms) (parent=Determine exchange type)] [21:10:06] : [Step 4/5] [2021-11-19 21:10:06,477][INFO ][exchange-worker-#19537%grid-0%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], crd=true] [21:10:06] : [Step 4/5] [2021-11-19 21:10:06,478][INFO ][exchange-worker-#19537%grid-0%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=3, minorTopVer=0], force=false, evt=NODE_LEFT, node=1093e7cf-2817-4221-b4f6-8a519c5db001] [21:10:09] : [Step 4/5] [2021-11-19 21:10:09,006][INFO ][async-runnable-runner-1][FilePageStoreManager] Cleanup cache stores [total=4, left=0, cleanFiles=false] [21:10:09] : [Step 4/5] [2021-11-19 21:10:09,009][INFO ][async-runnable-runner-1][GridDeploymentLocalStore] Removed undeployed class: GridDeployment [ts=1637345403169, depMode=SHARED, clsLdr=IsolatedClassLoader{roleName='test'}, clsLdrId=8587d593d71-1093e7cf-2817-4221-b4f6-8a519c5db001, userVer=0, loc=true, sampleClsName=org.apache.ignite.internal.processors.cache.distributed.dht.preloader.IgniteDhtPartitionsToReloadMap, pendingUndeploy=false, undeployed=true, usage=0] [21:10:09] : [Step 4/5] [2021-11-19 21:10:09,018][INFO ][async-runnable-runner-1][IgniteKernal%grid-1] [21:10:09] : [Step 4/5] [21:10:09] : [Step 4/5] >>> +------------------------------------------------------+ [21:10:09] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV stopped OK [21:10:09] : [Step 4/5] >>> +------------------------------------------------------+ [21:10:09] : [Step 4/5] >>> Ignite instance name: grid-1 [21:10:09] : [Step 4/5] >>> Grid uptime: 00:00:05.911 [21:10:09] : [Step 4/5] [21:10:09] : [Step 4/5] [21:10:09] : [Step 4/5] [2021-11-19 21:10:09,019][INFO ][main][root] >>> Stopping grid [name=grid-0, id=00f85d16-a7bd-480e-a77e-c4a11db13000] [21:10:09] : [Step 4/5] [2021-11-19 21:10:09,036][INFO ][db-checkpoint-thread-#19668%grid-0%][Checkpointer] Checkpoint started [checkpointId=1fdaf1e0-31d6-41e0-bffd-9497e1e671f1, startPtr=WALPointer [idx=0, fileOff=753855, len=11491], checkpointBeforeLockTime=4ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=1ms, checkpointLockHoldTime=4ms, walCpRecordFsyncDuration=2ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=0ms, pages=575, reason='timeout'] [21:10:09]W: [org.apache.ignite:ignite-core] [2021-11-19 21:10:09,040][WARN ][tcp-disco-sock-reader-[1093e7cf 127.0.0.1:60813]-#1032%grid-0%-#19656%grid-0%][TestTcpDiscoverySpi] Failed to shutdown socket [21:10:09]W: [org.apache.ignite:ignite-core] java.net.SocketException: Socket is closed [21:10:09]W: [org.apache.ignite:ignite-core] at java.net.Socket.shutdownOutput(Socket.java:1568) [21:10:09]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.close(IgniteUtils.java:4247) [21:10:09]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.discovery.tcp.ServerImpl$SocketReader.body(ServerImpl.java:7370) [21:10:09]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.IgniteSpiThread.run(IgniteSpiThread.java:58) [21:10:09] : [Step 4/5] [2021-11-19 21:10:09,042][INFO ][tcp-disco-sock-reader-[1093e7cf 127.0.0.1:60813]-#1032%grid-0%-#19656%grid-0%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:60813, rmtPort=60813, rmtNodeId=1093e7cf-2817-4221-b4f6-8a519c5db001] [21:10:09] : [Step 4/5] [2021-11-19 21:10:09,044][INFO ][main][GridCacheProcessor] Stopped cache [cacheName=ignite-sys-cache] [21:10:09] : [Step 4/5] [2021-11-19 21:10:09,046][INFO ][main][GridCacheProcessor] Stopped cache [cacheName=encrypted] [21:10:09] : [Step 4/5] [2021-11-19 21:10:09,957][INFO ][main][FilePageStoreManager] Cleanup cache stores [total=4, left=0, cleanFiles=false] [21:10:09] : [Step 4/5] [2021-11-19 21:10:09,959][INFO ][main][GridDeploymentLocalStore] Removed undeployed class: GridDeployment [ts=1637345403159, depMode=SHARED, clsLdr=IsolatedClassLoader{roleName='test'}, clsLdrId=6587d593d71-00f85d16-a7bd-480e-a77e-c4a11db13000, userVer=0, loc=true, sampleClsName=org.apache.ignite.internal.processors.cache.distributed.dht.preloader.GridDhtPartitionMap, pendingUndeploy=false, undeployed=true, usage=0] [21:10:09] : [Step 4/5] [2021-11-19 21:10:09,967][INFO ][main][IgniteKernal%grid-0] [21:10:09] : [Step 4/5] [21:10:09] : [Step 4/5] >>> +------------------------------------------------------+ [21:10:09] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV stopped OK [21:10:09] : [Step 4/5] >>> +------------------------------------------------------+ [21:10:09] : [Step 4/5] >>> Ignite instance name: grid-0 [21:10:09] : [Step 4/5] >>> Grid uptime: 00:00:08.230 [21:10:09] : [Step 4/5] [21:10:09] : [Step 4/5] [21:10:10]W: [org.apache.ignite:ignite-core] [2021-11-19 21:10:10,197][WARN ][test-runner-#19691%encryption.MasterKeyChangeTest%][G] Ignite work directory is not provided, automatically resolved to: /opt/buildagent/work/7bc1c54bc719b67c/work [21:10:10] : [Step 4/5] [2021-11-19 21:10:10,199][INFO ][test-runner-#19691%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] [21:10:10] : [Step 4/5] [21:10:10] : [Step 4/5] >>> __________ ________________ [21:10:10] : [Step 4/5] >>> / _/ ___/ |/ / _/_ __/ __/ [21:10:10] : [Step 4/5] >>> _/ // (7 7 // / / / / _/ [21:10:10] : [Step 4/5] >>> /___/\___/_/|_/___/ /_/ /___/ [21:10:10] : [Step 4/5] >>> [21:10:10] : [Step 4/5] >>> ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:10:10] : [Step 4/5] >>> 2021 Copyright(C) Apache Software Foundation [21:10:10] : [Step 4/5] >>> [21:10:10] : [Step 4/5] >>> Ignite documentation: http://ignite.apache.org [21:10:10] : [Step 4/5] [21:10:10] : [Step 4/5] [2021-11-19 21:10:10,199][INFO ][test-runner-#19691%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] Config URL: n/a [21:10:10] : [Step 4/5] [2021-11-19 21:10:10,200][INFO ][test-runner-#19691%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] IgniteConfiguration [igniteInstanceName=grid-0, pubPoolSize=24, svcPoolSize=24, callbackPoolSize=24, stripedPoolSize=24, sysPoolSize=24, mgmtPoolSize=4, dataStreamerPoolSize=24, utilityCachePoolSize=24, utilityCacheKeepAliveTime=60000, p2pPoolSize=2, qryPoolSize=24, buildIdxPoolSize=4, igniteHome=/opt/buildagent/work/7bc1c54bc719b67c, igniteWorkDir=/opt/buildagent/work/7bc1c54bc719b67c/work, mbeanSrv=com.sun.jmx.mbeanserver.JmxMBeanServer@6fe85038, nodeId=0074303f-63cc-4b9f-ac73-2eafc28d8000, marsh=BinaryMarshaller [], marshLocJobs=false, daemon=false, p2pEnabled=true, netTimeout=10000, netCompressionLevel=1, sndRetryDelay=1000, sndRetryCnt=3, metricsHistSize=10000, metricsUpdateFreq=1000, metricsExpTime=9223372036854775807, discoSpi=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=0, ackTimeout=0, marsh=null, reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], segPlc=STOP, segResolveAttempts=2, waitForSegOnStart=true, allResolversPassReq=true, segChkFreq=10000, commSpi=TcpCommunicationSpi [connectGate=org.apache.ignite.spi.communication.tcp.internal.ConnectGateway@79053d4d, ctxInitLatch=java.util.concurrent.CountDownLatch@12d4c68b[Count = 1], stopping=false, clientPool=null, nioSrvWrapper=null, stateProvider=null], evtSpi=MemoryEventStorageSpi [expireAgeMs=9223372036854775807, expireCnt=10000, filter=null], colSpi=NoopCollisionSpi [], deploySpi=LocalDeploymentSpi [], indexingSpi=org.apache.ignite.spi.indexing.noop.NoopIndexingSpi@2629e792, addrRslvr=null, encryptionSpi=org.apache.ignite.spi.encryption.keystore.KeystoreEncryptionSpi@68e83348, tracingSpi=org.apache.ignite.spi.tracing.NoopTracingSpi@3b35c934, clientMode=false, rebalanceThreadPoolSize=4, rebalanceTimeout=10000, rebalanceBatchesPrefetchCnt=3, rebalanceThrottle=0, rebalanceBatchSize=524288, txCfg=TransactionConfiguration [txSerEnabled=false, dfltIsolation=REPEATABLE_READ, dfltConcurrency=PESSIMISTIC, dfltTxTimeout=0, txTimeoutOnPartitionMapExchange=0, deadlockTimeout=10000, pessimisticTxLogSize=0, pessimisticTxLogLinger=10000, tmLookupClsName=null, txManagerFactory=null, useJtaSync=false], cacheSanityCheckEnabled=true, discoStartupDelay=60000, deployMode=SHARED, p2pMissedCacheSize=100, locHost=127.0.0.1, timeSrvPortBase=31100, timeSrvPortRange=100, failureDetectionTimeout=10000, sysWorkerBlockedTimeout=null, clientFailureDetectionTimeout=10000, metricsLogFreq=0, connectorCfg=null, odbcCfg=null, warmupClos=null, atomicCfg=AtomicConfiguration [seqReserveSize=1000, cacheMode=PARTITIONED, backups=1, aff=null, grpName=null], classLdr=null, sslCtxFactory=null, platformCfg=null, binaryCfg=null, memCfg=null, pstCfg=null, dsCfg=DataStorageConfiguration [sysRegionInitSize=41943040, sysRegionMaxSize=104857600, pageSize=4096, concLvl=0, dfltDataRegConf=DataRegionConfiguration [name=default, maxSize=10485760, initSize=268435456, swapPath=null, pageEvictionMode=DISABLED, pageReplacementMode=CLOCK, evictionThreshold=0.9, emptyPagesPoolSize=100, metricsEnabled=false, metricsSubIntervalCount=5, metricsRateTimeInterval=60000, persistenceEnabled=true, checkpointPageBufSize=0, lazyMemoryAllocation=true, warmUpCfg=null], dataRegions=null, storagePath=null, checkpointFreq=180000, lockWaitTime=10000, checkpointThreads=4, checkpointWriteOrder=SEQUENTIAL, walHistSize=20, maxWalArchiveSize=1073741824, walSegments=10, walSegmentSize=67108864, walPath=db/wal, walArchivePath=db/wal/archive, cdcWalPath=db/wal/cdc, cdcEnabled=false, metricsEnabled=false, walMode=FSYNC, walTlbSize=131072, walBuffSize=0, walFlushFreq=2000, walFsyncDelay=1000, walRecordIterBuffSize=67108864, alwaysWriteFullPages=false, fileIOFactory=org.apache.ignite.internal.processors.cache.persistence.file.AsyncFileIOFactory@61f70c85, metricsSubIntervalCnt=5, metricsRateTimeInterval=60000, walAutoArchiveAfterInactivity=-1, walForceArchiveTimeout=-1, writeThrottlingEnabled=false, walCompactionEnabled=false, walCompactionLevel=1, checkpointReadLockTimeout=null, walPageCompression=DISABLED, walPageCompressionLevel=null, dfltWarmUpCfg=null, encCfg=org.apache.ignite.configuration.EncryptionConfiguration@4799a582, defragmentationThreadPoolSize=4, minWalArchiveSize=-1], snapshotPath=snapshots, activeOnStart=true, activeOnStartPropSetFlag=false, autoActivation=true, autoActivationPropSetFlag=false, clusterStateOnStart=null, sqlConnCfg=null, cliConnCfg=ClientConnectorConfiguration [host=null, port=10800, portRange=100, sockSndBufSize=0, sockRcvBufSize=0, tcpNoDelay=true, maxOpenCursorsPerConn=128, threadPoolSize=24, selectorCnt=12, idleTimeout=0, handshakeTimeout=10000, jdbcEnabled=true, odbcEnabled=true, thinCliEnabled=true, sslEnabled=false, useIgniteSslCtxFactory=true, sslClientAuth=false, sslCtxFactory=null, thinCliCfg=ThinClientConfiguration [maxActiveTxPerConn=100, maxActiveComputeTasksPerConn=0]], mvccVacuumThreadCnt=2, mvccVacuumFreq=5000, authEnabled=false, failureHnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]], commFailureRslvr=null, sqlCfg=SqlConfiguration [longQryWarnTimeout=3000, dfltQryTimeout=0, sqlQryHistSize=1000, validationEnabled=false], asyncContinuationExecutor=null] [21:10:10] : [Step 4/5] [2021-11-19 21:10:10,209][INFO ][test-runner-#19691%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] Daemon mode: off [21:10:10] : [Step 4/5] [2021-11-19 21:10:10,209][INFO ][test-runner-#19691%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] OS: Linux 4.15.0-151-generic amd64 [21:10:10] : [Step 4/5] [2021-11-19 21:10:10,209][INFO ][test-runner-#19691%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] OS user: teamcity [21:10:10] : [Step 4/5] [2021-11-19 21:10:10,210][INFO ][test-runner-#19691%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] PID: 16724 [21:10:10] : [Step 4/5] [2021-11-19 21:10:10,210][INFO ][test-runner-#19691%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] Language runtime: Java Platform API Specification ver. 1.8 [21:10:10] : [Step 4/5] [2021-11-19 21:10:10,210][INFO ][test-runner-#19691%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] VM information: Java(TM) SE Runtime Environment 1.8.0_261-b12 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 25.261-b12 [21:10:10] : [Step 4/5] [2021-11-19 21:10:10,211][INFO ][test-runner-#19691%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] VM total memory: 1.9GB [21:10:10] : [Step 4/5] [2021-11-19 21:10:10,211][INFO ][test-runner-#19691%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] Remote Management [restart: off, REST: off, JMX (remote: off)] [21:10:10] : [Step 4/5] [2021-11-19 21:10:10,211][INFO ][test-runner-#19691%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] Logger: GridTestLog4jLogger [quiet=false, config=null] [21:10:10] : [Step 4/5] [2021-11-19 21:10:10,211][INFO ][test-runner-#19691%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] IGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c [21:10:10] : [Step 4/5] [2021-11-19 21:10:10,212][INFO ][test-runner-#19691%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] VM arguments: [-DIGNITE_DUMP_THREADS_ON_FAILURE=false, -DMono=/usr/bin/mono-sgen, -DMono4.0_x64=/usr/lib/mono/4.0, -DMono4.5_x64=/usr/lib/mono/4.5, -DMonoVersion=6.12.0.90, -DSKIP_BUILD=false, -Dagent.home.dir=/opt/buildagent, -Dagent.name=aitc-lin02_03, -Dagent.ownPort=9090, -Dagent.work.dir=/opt/buildagent/work, -Dbuild.number=95, -Dbuild.vcs.number=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.1=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.GitHubApacheIgnite=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dclassworlds.conf=/opt/buildagent/temp/buildTmp/teamcity.m2.conf, -Dcom.jetbrains.maven.watcher.report.file=/opt/buildagent/temp/buildTmp/maven-build-info.xml, -Djava.io.tmpdir=/opt/buildagent/temp/buildTmp, -Dmaven.home=/opt/buildagent/tools/maven3_6, -Dmaven.multiModuleProjectDirectory=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.agent.cpuBenchmark=457, -Dteamcity.agent.dotnet.agent_url=http://localhost:9090/RPC2, -Dteamcity.agent.dotnet.build_id=6278078, -Dteamcity.auth.password=*******, -Dteamcity.auth.userId=TeamCityBuildId=6278078, -Dteamcity.build.changedFiles.file=/opt/buildagent/temp/buildTmp/changedFiles6342607772318147725.txt, -Dteamcity.build.checkoutDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.build.id=6278078, -Dteamcity.build.properties.file=/opt/buildagent/temp/buildTmp/teamcity.build5164517880467851002.properties, -Dteamcity.build.tempDir=/opt/buildagent/temp/buildTmp, -Dteamcity.build.workingDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.buildConfName=Basic 3, -Dteamcity.buildType.id=IgniteTests24Java8_Basic3, -Dteamcity.configuration.properties.file=/opt/buildagent/temp/buildTmp/teamcity.config5591980786735343870.properties, -Dteamcity.maven.userSettings.path=/opt/buildagent/temp/buildTmp/maven_settings_585072866407032347.xml, -Dteamcity.maven.watcher.home=/opt/buildagent/plugins/mavenPlugin/maven-watcher-jdk16, -Dteamcity.projectName=Ignite Tests 2.x (JDK 8/11), -Dteamcity.runner.properties.file=/opt/buildagent/temp/buildTmp/teamcity.runner9098465561618137420.properties, -Dteamcity.tests.recentlyFailedTests.file=/opt/buildagent/temp/buildTmp/testsToRunFirst3891775683130404069.txt, -Dteamcity.version=2021.2 (build 99542), -ea, -Xms2g, -Xmx2g, -XX:+HeapDumpOnOutOfMemoryError, -DIGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_TEST_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_UPDATE_NOTIFIER=false, -DIGNITE_NO_DISCO_ORDER=true, -DIGNITE_PERFORMANCE_SUGGESTIONS_DISABLED=true, -Djava.net.preferIPv4Stack=true, -DTEST_SCALE_FACTOR=1.0, -DIGNITE_TEST_PROP_LOG4J_FILE=log4j-tc-test.xml, -DIGNITE_QUIET=false, -DIGNITE_MARSHAL_BUFFERS_RECHECK=1000, -Dmaven.repo.local=/opt/buildagent/.m2/repository] [21:10:10] : [Step 4/5] [2021-11-19 21:10:10,216][INFO ][test-runner-#19691%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] System cache's DataRegion size is configured to 40 MB. Use DataStorageConfiguration.systemRegionInitialSize property to change the setting. [21:10:10] : [Step 4/5] [2021-11-19 21:10:10,217][INFO ][test-runner-#19691%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] Configured caches [in 'sysMemPlc' dataRegion: ['ignite-sys-cache']] [21:10:10]W: [org.apache.ignite:ignite-core] [2021-11-19 21:10:10,217][WARN ][test-runner-#19691%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] Peer class loading is enabled (disable it in production for performance and deployment consistency reasons) [21:10:10] : [Step 4/5] [2021-11-19 21:10:10,218][INFO ][test-runner-#19691%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] 3-rd party licenses can be found at: /opt/buildagent/work/7bc1c54bc719b67c/libs/licenses [21:10:10] : [Step 4/5] [2021-11-19 21:10:10,222][INFO ][test-runner-#19691%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] Configured plugins: [21:10:10] : [Step 4/5] [2021-11-19 21:10:10,222][INFO ][test-runner-#19691%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] ^-- StanByClusterTestProvider 1.0 [21:10:10] : [Step 4/5] [2021-11-19 21:10:10,222][INFO ][test-runner-#19691%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:10:10] : [Step 4/5] [2021-11-19 21:10:10,222][INFO ][test-runner-#19691%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] [21:10:10] : [Step 4/5] [2021-11-19 21:10:10,222][INFO ][test-runner-#19691%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] ^-- PageMemory tracker plugin 1.0 [21:10:10] : [Step 4/5] [2021-11-19 21:10:10,223][INFO ][test-runner-#19691%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:10:10] : [Step 4/5] [2021-11-19 21:10:10,223][INFO ][test-runner-#19691%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] [21:10:10] : [Step 4/5] [2021-11-19 21:10:10,223][INFO ][test-runner-#19691%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] ^-- TestDistibutedConfigurationPlugin 1.0 [21:10:10] : [Step 4/5] [2021-11-19 21:10:10,223][INFO ][test-runner-#19691%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:10:10] : [Step 4/5] [2021-11-19 21:10:10,223][INFO ][test-runner-#19691%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] [21:10:10] : [Step 4/5] [2021-11-19 21:10:10,223][INFO ][test-runner-#19691%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] ^-- NodeValidationPluginProvider 1.0 [21:10:10] : [Step 4/5] [2021-11-19 21:10:10,224][INFO ][test-runner-#19691%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:10:10] : [Step 4/5] [2021-11-19 21:10:10,224][INFO ][test-runner-#19691%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] [21:10:10] : [Step 4/5] [2021-11-19 21:10:10,224][INFO ][test-runner-#19691%encryption.MasterKeyChangeTest%][FailureProcessor] Configured failure handler: [hnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]]] [21:10:10] : [Step 4/5] [2021-11-19 21:10:10,244][INFO ][test-runner-#19691%encryption.MasterKeyChangeTest%][TestRecordingCommunicationSpi] Successfully bound communication NIO server to TCP port [port=47100, locHost=/127.0.0.1, selectorsCnt=12, selectorSpins=0, pairedConn=false] [21:10:10]W: [org.apache.ignite:ignite-core] [2021-11-19 21:10:10,244][WARN ][test-runner-#19691%encryption.MasterKeyChangeTest%][TestRecordingCommunicationSpi] Message queue limit is set to 0 which may lead to potential OOMEs when running cache operations in FULL_ASYNC or PRIMARY_SYNC modes due to message queues growth on sender and receiver sides. [21:10:10] : [Step 4/5] [2021-11-19 21:10:10,249][INFO ][test-runner-#19691%encryption.MasterKeyChangeTest%][GridCollisionManager] Collision resolution is disabled (all jobs will be activated upon arrival). [21:10:10] : [Step 4/5] [2021-11-19 21:10:10,249][INFO ][test-runner-#19691%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] Security status [authentication=off, sandbox=off, tls/ssl=off] [21:10:10] : [Step 4/5] [2021-11-19 21:10:10,306][INFO ][test-runner-#19691%encryption.MasterKeyChangeTest%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:10:10] : [Step 4/5] [2021-11-19 21:10:10,394][INFO ][test-runner-#19691%encryption.MasterKeyChangeTest%][MaintenanceProcessor] Resolved store directory for node persistent data: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0 [21:10:10] : [Step 4/5] [2021-11-19 21:10:10,395][INFO ][test-runner-#19691%encryption.MasterKeyChangeTest%][CacheObjectBinaryProcessorImpl] Resolved directory for serialized binary metadata: /opt/buildagent/work/7bc1c54bc719b67c/work/db/binary_meta/grid_0 [21:10:10] : [Step 4/5] [2021-11-19 21:10:10,399][INFO ][test-runner-#19691%encryption.MasterKeyChangeTest%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0 [21:10:10] : [Step 4/5] [2021-11-19 21:10:10,400][INFO ][test-runner-#19691%encryption.MasterKeyChangeTest%][FileWriteAheadLogManager] Resolved write ahead log work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0 [21:10:10] : [Step 4/5] [2021-11-19 21:10:10,400][INFO ][test-runner-#19691%encryption.MasterKeyChangeTest%][FileWriteAheadLogManager] Resolved write ahead log archive directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0 [21:10:11] : [Step 4/5] [2021-11-19 21:10:11,151][INFO ][test-runner-#19691%encryption.MasterKeyChangeTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000000.wal [21:10:11]W: [org.apache.ignite:ignite-core] [2021-11-19 21:10:11,152][WARN ][test-runner-#19691%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] DataRegion maxSize=10.5 MB is smaller than defaultInitialSize=268.4 MB, setting initialSize to 10.5 MB [21:10:11] : [Step 4/5] [2021-11-19 21:10:11,158][INFO ][test-runner-#19691%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Configured data regions initialized successfully [total=5] [21:10:11] : [Step 4/5] [2021-11-19 21:10:11,160][INFO ][test-runner-#19691%encryption.MasterKeyChangeTest%][IgniteSnapshotManager] Resolved snapshot work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/snapshots [21:10:11] : [Step 4/5] [2021-11-19 21:10:11,160][INFO ][test-runner-#19691%encryption.MasterKeyChangeTest%][IgniteSnapshotManager] Resolved temp directory for snapshot creation: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0/snp [21:10:11] : [Step 4/5] [2021-11-19 21:10:11,162][INFO ][test-runner-#19691%encryption.MasterKeyChangeTest%][ClientListenerProcessor] Client connector processor has started on TCP port 10800 [21:10:11] : [Step 4/5] [2021-11-19 21:10:11,167][INFO ][test-runner-#19691%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] Non-loopback local IPs: 172.17.0.4 [21:10:11] : [Step 4/5] [2021-11-19 21:10:11,168][INFO ][test-runner-#19691%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] Enabled local MACs: 0242AC110004 [21:10:11] : [Step 4/5] [2021-11-19 21:10:11,170][INFO ][test-runner-#19691%encryption.MasterKeyChangeTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:10:11] : [Step 4/5] [2021-11-19 21:10:11,171][INFO ][test-runner-#19691%encryption.MasterKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:10:11] : [Step 4/5] [2021-11-19 21:10:11,171][INFO ][test-runner-#19691%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:10:11] : [Step 4/5] [2021-11-19 21:10:11,173][INFO ][test-runner-#19691%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Applying lost metastore updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:10:11] : [Step 4/5] [2021-11-19 21:10:11,174][INFO ][test-runner-#19691%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=0 ms] [21:10:11] : [Step 4/5] [2021-11-19 21:10:11,174][INFO ][test-runner-#19691%encryption.MasterKeyChangeTest%][GridCacheProcessor] Restoring partition state for local groups. [21:10:11] : [Step 4/5] [2021-11-19 21:10:11,175][INFO ][test-runner-#19691%encryption.MasterKeyChangeTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=0, partitionsProcessed=0, time=0ms] [21:10:11] : [Step 4/5] [2021-11-19 21:10:11,175][INFO ][test-runner-#19691%encryption.MasterKeyChangeTest%][GridEncryptionManager] Encryption keys loaded from metastore. [grps=, masterKeyName=ignite.master.key] [21:10:11] : [Step 4/5] [2021-11-19 21:10:11,180][INFO ][test-runner-#19691%encryption.MasterKeyChangeTest%][ClusterProcessor] Cluster ID and tag has been read from metastorage: null [21:10:11] : [Step 4/5] [2021-11-19 21:10:11,180][INFO ][test-runner-#19691%encryption.MasterKeyChangeTest%][IgniteClusterImpl] Shutdown policy was updated [oldVal=null, newVal=null] [21:10:11] : [Step 4/5] [2021-11-19 21:10:11,181][INFO ][test-runner-#19691%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Checkpoint frequency deviation changed [oldVal=null, newVal=null] [21:10:11] : [Step 4/5] [2021-11-19 21:10:11,191][INFO ][test-runner-#19691%encryption.MasterKeyChangeTest%][FilePageStoreManager] Cleanup cache stores [total=1, left=0, cleanFiles=false] [21:10:11] : [Step 4/5] [2021-11-19 21:10:11,194][INFO ][test-runner-#19691%encryption.MasterKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:10:11] : [Step 4/5] [2021-11-19 21:10:11,195][INFO ][test-runner-#19691%encryption.MasterKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:10:11] : [Step 4/5] [2021-11-19 21:10:11,197][INFO ][test-runner-#19691%encryption.MasterKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:10:11] : [Step 4/5] [2021-11-19 21:10:11,197][INFO ][test-runner-#19691%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Data Regions Started: 5 [21:10:11] : [Step 4/5] [2021-11-19 21:10:11,198][INFO ][test-runner-#19691%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] ^-- sysMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:10:11] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:10:11] : [Step 4/5] ^-- default region [type=default, persistence=true, lazyAlloc=true, [21:10:11] : [Step 4/5] ... initCfg=10MB, maxCfg=10MB, usedRam=0MB, freeRam=100%, allocRam=0MB, allocTotal=0MB] [21:10:11] : [Step 4/5] ^-- metastoreMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:10:11] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:10:11] : [Step 4/5] ^-- TxLog region [type=internal, persistence=true, lazyAlloc=false, [21:10:11] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:10:11] : [Step 4/5] ^-- volatileDsMemPlc region [type=user, persistence=false, lazyAlloc=true, [21:10:11] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB] [21:10:11] : [Step 4/5] ^-- Ignite persistence [used=0MB] [21:10:11] : [Step 4/5] [21:10:11] : [Step 4/5] [2021-11-19 21:10:11,199][INFO ][test-runner-#19691%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Starting binary memory restore for: [-2100569601] [21:10:11] : [Step 4/5] [2021-11-19 21:10:11,207][INFO ][test-runner-#19691%encryption.MasterKeyChangeTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:10:11] : [Step 4/5] [2021-11-19 21:10:11,207][INFO ][test-runner-#19691%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:10:11] : [Step 4/5] [2021-11-19 21:10:11,209][INFO ][test-runner-#19691%encryption.MasterKeyChangeTest%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000000.wal, offset=0, ver=2] [21:10:11] : [Step 4/5] [2021-11-19 21:10:11,213][INFO ][test-runner-#19691%encryption.MasterKeyChangeTest%][GridCacheProcessor] Started cache in recovery mode [name=ignite-sys-cache, id=-2100569601, dataRegionName=sysMemPlc, mode=REPLICATED, atomicity=TRANSACTIONAL, backups=2147483647, mvcc=false] [21:10:11] : [Step 4/5] [2021-11-19 21:10:11,214][INFO ][test-runner-#19691%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Binary recovery performed in 15 ms. [21:10:11] : [Step 4/5] [2021-11-19 21:10:11,214][INFO ][test-runner-#19691%encryption.MasterKeyChangeTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:10:11] : [Step 4/5] [2021-11-19 21:10:11,214][INFO ][test-runner-#19691%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Applying lost cache updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:10:11] : [Step 4/5] [2021-11-19 21:10:11,263][INFO ][test-runner-#19691%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=51 ms] [21:10:11] : [Step 4/5] [2021-11-19 21:10:11,264][INFO ][test-runner-#19691%encryption.MasterKeyChangeTest%][GridCacheProcessor] Restoring partition state for local groups. [21:10:11] : [Step 4/5] [2021-11-19 21:10:11,277][INFO ][test-runner-#19691%encryption.MasterKeyChangeTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=1, partitionsProcessed=100, time=10ms] [21:10:12] : [Step 4/5] [2021-11-19 21:10:12,016][INFO ][test-runner-#19691%encryption.MasterKeyChangeTest%][TestTcpDiscoverySpi] Successfully bound to TCP port [port=47500, localHost=localhost/127.0.0.1, locNodeId=0074303f-63cc-4b9f-ac73-2eafc28d8000] [21:10:12] : [Step 4/5] [2021-11-19 21:10:12,026][INFO ][disco-notifier-worker-#19802%grid-0%][MvccProcessorImpl] Assigned mvcc coordinator [crd=MvccCoordinator [topVer=AffinityTopologyVersion [topVer=1, minorTopVer=0], nodeId=0074303f-63cc-4b9f-ac73-2eafc28d8000, ver=1637345412019, local=true, initialized=false]] [21:10:12] : [Step 4/5] [2021-11-19 21:10:12,028][INFO ][sys-#19785%grid-0%][ClusterProcessor] Writing cluster ID and tag to metastorage on ready for write ClusterIdAndTag [id=c30cef27-cd5e-4eff-8d56-2ea5b6c1c188, tag=quizzical_yonath] [21:10:12] : [Step 4/5] [2021-11-19 21:10:12,032][INFO ][disco-notifier-worker-#19802%grid-0%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustEnabled' was changed from 'null' to 'false' [21:10:12] : [Step 4/5] [2021-11-19 21:10:12,033][INFO ][disco-notifier-worker-#19802%grid-0%][ClusterProcessor] quizzical_yonath [21:10:12] : [Step 4/5] [2021-11-19 21:10:12,034][INFO ][disco-notifier-worker-#19802%grid-0%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustTimeout' was changed from 'null' to '300000' [21:10:12] : [Step 4/5] [2021-11-19 21:10:12,034][INFO ][disco-notifier-worker-#19802%grid-0%][IgniteTxManager] Transactions parameter 'longOperationsDumpTimeout' was changed from 'null' to '60000' [21:10:12] : [Step 4/5] [2021-11-19 21:10:12,035][INFO ][disco-notifier-worker-#19802%grid-0%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpThreshold' was changed from 'null' to '0' [21:10:12] : [Step 4/5] [2021-11-19 21:10:12,035][INFO ][disco-notifier-worker-#19802%grid-0%][IgniteTxManager] Transactions parameter 'transactionTimeDumpSamplesCoefficient' was changed from 'null' to '0.0' [21:10:12] : [Step 4/5] [2021-11-19 21:10:12,036][INFO ][disco-notifier-worker-#19802%grid-0%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpSamplesPerSecondLimit' was changed from 'null' to '5' [21:10:12] : [Step 4/5] [2021-11-19 21:10:12,037][INFO ][disco-notifier-worker-#19802%grid-0%][IgniteTxManager] Transactions parameter 'collisionsDumpInterval' was changed from 'null' to '1000' [21:10:12] : [Step 4/5] [2021-11-19 21:10:12,037][INFO ][disco-notifier-worker-#19802%grid-0%][IgniteTxManager] Transactions parameter 'txOwnerDumpRequestsAllowed' was changed from 'null' to 'true' [21:10:12] : [Step 4/5] [2021-11-19 21:10:12,038][INFO ][disco-notifier-worker-#19802%grid-0%][GridCacheDatabaseSharedManager] Historical rebalance WAL threshold changed [property=historical.rebalance.threshold, oldVal=null, newVal=500] [21:10:12] : [Step 4/5] [2021-11-19 21:10:12,046][INFO ][test-runner-#19691%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] To start Console Management & Monitoring run ignitevisorcmd.{sh|bat} [21:10:12] : [Step 4/5] [2021-11-19 21:10:12,046][INFO ][test-runner-#19691%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] [21:10:12] : [Step 4/5] [21:10:12] : [Step 4/5] >>> +-------------------------------------------+ [21:10:12] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:10:12] : [Step 4/5] >>> +-------------------------------------------+ [21:10:12] : [Step 4/5] >>> OS name: Linux 4.15.0-151-generic amd64 [21:10:12] : [Step 4/5] >>> CPU(s): 24 [21:10:12] : [Step 4/5] >>> Heap: 2.0GB [21:10:12] : [Step 4/5] >>> VM name: 16724@c4dfe9a430b2 [21:10:12] : [Step 4/5] >>> Ignite instance name: grid-0 [21:10:12] : [Step 4/5] >>> Local node [ID=0074303F-63CC-4B9F-AC73-2EAFC28D8000, order=1, clientMode=false] [21:10:12] : [Step 4/5] >>> Local node addresses: [127.0.0.1] [21:10:12] : [Step 4/5] >>> Local ports: TCP:10800 TCP:47100 TCP:47500 [21:10:12] : [Step 4/5] [21:10:12] : [Step 4/5] [2021-11-19 21:10:12,047][INFO ][test-runner-#19691%encryption.MasterKeyChangeTest%][IgniteKernal%grid-0] >>> Ignite cluster is in INACTIVE state (limited functionality available). Use control.(sh|bat) script or IgniteCluster.state(ClusterState.ACTIVE) to change the state. [21:10:12] : [Step 4/5] [2021-11-19 21:10:12,048][INFO ][test-runner-#19691%encryption.MasterKeyChangeTest%][GridDiscoveryManager] Topology snapshot [ver=1, locNode=0074303f, servers=1, clients=0, state=INACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=0074303f-63cc-4b9f-ac73-2eafc28d8000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:10:12] : [Step 4/5] [2021-11-19 21:10:12,049][INFO ][test-runner-#19691%encryption.MasterKeyChangeTest%][G] Node started : [stage="Configure system pool" (0 ms),stage="Start managers" (196 ms),stage="Configure binary metadata" (2 ms),stage="Start processors" (770 ms),stage="Start 'StanByClusterTestProvider' plugin" (0 ms),stage="Start 'PageMemory tracker plugin' plugin" (0 ms),stage="Start 'TestDistibutedConfigurationPlugin' plugin" (0 ms),stage="Start 'NodeValidationPluginProvider' plugin" (0 ms),stage="Init metastore" (23 ms),stage="Init and start regions" (8 ms),stage="Restore binary memory" (14 ms),stage="Restore logical state" (63 ms),stage="Finish recovery" (736 ms),stage="Join topology" (11 ms),stage="Await transition" (3 ms),stage="Await exchange" (18 ms),stage="Total time" (1844 ms)] [21:10:12] : [Step 4/5] [2021-11-19 21:10:12,050][INFO ][test-runner-#19691%encryption.MasterKeyChangeTest%][root] Node started with the following configuration [id=0074303f-63cc-4b9f-ac73-2eafc28d8000, marshaller=BinaryMarshaller [], discovery=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=5000, ackTimeout=5000, marsh=JdkMarshaller [clsFilter=org.apache.ignite.marshaller.MarshallerUtils$1@3d3728a4], reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], binaryCfg=null, lateAff=true] [21:10:12]W: [org.apache.ignite:ignite-core] [2021-11-19 21:10:12,056][WARN ][test-runner-#19691%encryption.MasterKeyChangeTest%][G] Ignite work directory is not provided, automatically resolved to: /opt/buildagent/work/7bc1c54bc719b67c/work [21:10:12] : [Step 4/5] [2021-11-19 21:10:12,057][INFO ][test-runner-#19691%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] [21:10:12] : [Step 4/5] [21:10:12] : [Step 4/5] >>> __________ ________________ [21:10:12] : [Step 4/5] >>> / _/ ___/ |/ / _/_ __/ __/ [21:10:12] : [Step 4/5] >>> _/ // (7 7 // / / / / _/ [21:10:12] : [Step 4/5] >>> /___/\___/_/|_/___/ /_/ /___/ [21:10:12] : [Step 4/5] >>> [21:10:12] : [Step 4/5] >>> ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:10:12] : [Step 4/5] >>> 2021 Copyright(C) Apache Software Foundation [21:10:12] : [Step 4/5] >>> [21:10:12] : [Step 4/5] >>> Ignite documentation: http://ignite.apache.org [21:10:12] : [Step 4/5] [21:10:12] : [Step 4/5] [2021-11-19 21:10:12,057][INFO ][test-runner-#19691%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] Config URL: n/a [21:10:12] : [Step 4/5] [2021-11-19 21:10:12,058][INFO ][test-runner-#19691%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] IgniteConfiguration [igniteInstanceName=grid-1, pubPoolSize=24, svcPoolSize=24, callbackPoolSize=24, stripedPoolSize=24, sysPoolSize=24, mgmtPoolSize=4, dataStreamerPoolSize=24, utilityCachePoolSize=24, utilityCacheKeepAliveTime=60000, p2pPoolSize=2, qryPoolSize=24, buildIdxPoolSize=4, igniteHome=/opt/buildagent/work/7bc1c54bc719b67c, igniteWorkDir=/opt/buildagent/work/7bc1c54bc719b67c/work, mbeanSrv=com.sun.jmx.mbeanserver.JmxMBeanServer@6fe85038, nodeId=10d4b9db-0d6e-4075-87e3-0df59aff8001, marsh=BinaryMarshaller [], marshLocJobs=false, daemon=false, p2pEnabled=true, netTimeout=10000, netCompressionLevel=1, sndRetryDelay=1000, sndRetryCnt=3, metricsHistSize=10000, metricsUpdateFreq=1000, metricsExpTime=9223372036854775807, discoSpi=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=0, ackTimeout=0, marsh=null, reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], segPlc=STOP, segResolveAttempts=2, waitForSegOnStart=true, allResolversPassReq=true, segChkFreq=10000, commSpi=TcpCommunicationSpi [connectGate=org.apache.ignite.spi.communication.tcp.internal.ConnectGateway@5a1cc65, ctxInitLatch=java.util.concurrent.CountDownLatch@52156e2f[Count = 1], stopping=false, clientPool=null, nioSrvWrapper=null, stateProvider=null], evtSpi=MemoryEventStorageSpi [expireAgeMs=9223372036854775807, expireCnt=10000, filter=null], colSpi=NoopCollisionSpi [], deploySpi=LocalDeploymentSpi [], indexingSpi=org.apache.ignite.spi.indexing.noop.NoopIndexingSpi@18ec3772, addrRslvr=null, encryptionSpi=org.apache.ignite.spi.encryption.keystore.KeystoreEncryptionSpi@8fa678f, tracingSpi=org.apache.ignite.spi.tracing.NoopTracingSpi@21fe21d9, clientMode=false, rebalanceThreadPoolSize=4, rebalanceTimeout=10000, rebalanceBatchesPrefetchCnt=3, rebalanceThrottle=0, rebalanceBatchSize=524288, txCfg=TransactionConfiguration [txSerEnabled=false, dfltIsolation=REPEATABLE_READ, dfltConcurrency=PESSIMISTIC, dfltTxTimeout=0, txTimeoutOnPartitionMapExchange=0, deadlockTimeout=10000, pessimisticTxLogSize=0, pessimisticTxLogLinger=10000, tmLookupClsName=null, txManagerFactory=null, useJtaSync=false], cacheSanityCheckEnabled=true, discoStartupDelay=60000, deployMode=SHARED, p2pMissedCacheSize=100, locHost=127.0.0.1, timeSrvPortBase=31100, timeSrvPortRange=100, failureDetectionTimeout=10000, sysWorkerBlockedTimeout=null, clientFailureDetectionTimeout=10000, metricsLogFreq=0, connectorCfg=null, odbcCfg=null, warmupClos=null, atomicCfg=AtomicConfiguration [seqReserveSize=1000, cacheMode=PARTITIONED, backups=1, aff=null, grpName=null], classLdr=null, sslCtxFactory=null, platformCfg=null, binaryCfg=null, memCfg=null, pstCfg=null, dsCfg=DataStorageConfiguration [sysRegionInitSize=41943040, sysRegionMaxSize=104857600, pageSize=4096, concLvl=0, dfltDataRegConf=DataRegionConfiguration [name=default, maxSize=10485760, initSize=268435456, swapPath=null, pageEvictionMode=DISABLED, pageReplacementMode=CLOCK, evictionThreshold=0.9, emptyPagesPoolSize=100, metricsEnabled=false, metricsSubIntervalCount=5, metricsRateTimeInterval=60000, persistenceEnabled=true, checkpointPageBufSize=0, lazyMemoryAllocation=true, warmUpCfg=null], dataRegions=null, storagePath=null, checkpointFreq=180000, lockWaitTime=10000, checkpointThreads=4, checkpointWriteOrder=SEQUENTIAL, walHistSize=20, maxWalArchiveSize=1073741824, walSegments=10, walSegmentSize=67108864, walPath=db/wal, walArchivePath=db/wal/archive, cdcWalPath=db/wal/cdc, cdcEnabled=false, metricsEnabled=false, walMode=FSYNC, walTlbSize=131072, walBuffSize=0, walFlushFreq=2000, walFsyncDelay=1000, walRecordIterBuffSize=67108864, alwaysWriteFullPages=false, fileIOFactory=org.apache.ignite.internal.processors.cache.persistence.file.AsyncFileIOFactory@3c8247f5, metricsSubIntervalCnt=5, metricsRateTimeInterval=60000, walAutoArchiveAfterInactivity=-1, walForceArchiveTimeout=-1, writeThrottlingEnabled=false, walCompactionEnabled=false, walCompactionLevel=1, checkpointReadLockTimeout=null, walPageCompression=DISABLED, walPageCompressionLevel=null, dfltWarmUpCfg=null, encCfg=org.apache.ignite.configuration.EncryptionConfiguration@6601dd90, defragmentationThreadPoolSize=4, minWalArchiveSize=-1], snapshotPath=snapshots, activeOnStart=true, activeOnStartPropSetFlag=false, autoActivation=true, autoActivationPropSetFlag=false, clusterStateOnStart=null, sqlConnCfg=null, cliConnCfg=ClientConnectorConfiguration [host=null, port=10800, portRange=100, sockSndBufSize=0, sockRcvBufSize=0, tcpNoDelay=true, maxOpenCursorsPerConn=128, threadPoolSize=24, selectorCnt=12, idleTimeout=0, handshakeTimeout=10000, jdbcEnabled=true, odbcEnabled=true, thinCliEnabled=true, sslEnabled=false, useIgniteSslCtxFactory=true, sslClientAuth=false, sslCtxFactory=null, thinCliCfg=ThinClientConfiguration [maxActiveTxPerConn=100, maxActiveComputeTasksPerConn=0]], mvccVacuumThreadCnt=2, mvccVacuumFreq=5000, authEnabled=false, failureHnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]], commFailureRslvr=null, sqlCfg=SqlConfiguration [longQryWarnTimeout=3000, dfltQryTimeout=0, sqlQryHistSize=1000, validationEnabled=false], asyncContinuationExecutor=null] [21:10:12] : [Step 4/5] [2021-11-19 21:10:12,066][INFO ][test-runner-#19691%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] Daemon mode: off [21:10:12] : [Step 4/5] [2021-11-19 21:10:12,066][INFO ][test-runner-#19691%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] OS: Linux 4.15.0-151-generic amd64 [21:10:12] : [Step 4/5] [2021-11-19 21:10:12,066][INFO ][test-runner-#19691%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] OS user: teamcity [21:10:12] : [Step 4/5] [2021-11-19 21:10:12,067][INFO ][test-runner-#19691%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] PID: 16724 [21:10:12] : [Step 4/5] [2021-11-19 21:10:12,067][INFO ][test-runner-#19691%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] Language runtime: Java Platform API Specification ver. 1.8 [21:10:12] : [Step 4/5] [2021-11-19 21:10:12,067][INFO ][test-runner-#19691%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] VM information: Java(TM) SE Runtime Environment 1.8.0_261-b12 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 25.261-b12 [21:10:12] : [Step 4/5] [2021-11-19 21:10:12,068][INFO ][test-runner-#19691%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] VM total memory: 1.9GB [21:10:12] : [Step 4/5] [2021-11-19 21:10:12,068][INFO ][test-runner-#19691%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] Remote Management [restart: off, REST: off, JMX (remote: off)] [21:10:12] : [Step 4/5] [2021-11-19 21:10:12,068][INFO ][test-runner-#19691%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] Logger: GridTestLog4jLogger [quiet=false, config=null] [21:10:12] : [Step 4/5] [2021-11-19 21:10:12,068][INFO ][test-runner-#19691%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] IGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c [21:10:12] : [Step 4/5] [2021-11-19 21:10:12,069][INFO ][test-runner-#19691%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] VM arguments: [-DIGNITE_DUMP_THREADS_ON_FAILURE=false, -DMono=/usr/bin/mono-sgen, -DMono4.0_x64=/usr/lib/mono/4.0, -DMono4.5_x64=/usr/lib/mono/4.5, -DMonoVersion=6.12.0.90, -DSKIP_BUILD=false, -Dagent.home.dir=/opt/buildagent, -Dagent.name=aitc-lin02_03, -Dagent.ownPort=9090, -Dagent.work.dir=/opt/buildagent/work, -Dbuild.number=95, -Dbuild.vcs.number=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.1=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.GitHubApacheIgnite=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dclassworlds.conf=/opt/buildagent/temp/buildTmp/teamcity.m2.conf, -Dcom.jetbrains.maven.watcher.report.file=/opt/buildagent/temp/buildTmp/maven-build-info.xml, -Djava.io.tmpdir=/opt/buildagent/temp/buildTmp, -Dmaven.home=/opt/buildagent/tools/maven3_6, -Dmaven.multiModuleProjectDirectory=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.agent.cpuBenchmark=457, -Dteamcity.agent.dotnet.agent_url=http://localhost:9090/RPC2, -Dteamcity.agent.dotnet.build_id=6278078, -Dteamcity.auth.password=*******, -Dteamcity.auth.userId=TeamCityBuildId=6278078, -Dteamcity.build.changedFiles.file=/opt/buildagent/temp/buildTmp/changedFiles6342607772318147725.txt, -Dteamcity.build.checkoutDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.build.id=6278078, -Dteamcity.build.properties.file=/opt/buildagent/temp/buildTmp/teamcity.build5164517880467851002.properties, -Dteamcity.build.tempDir=/opt/buildagent/temp/buildTmp, -Dteamcity.build.workingDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.buildConfName=Basic 3, -Dteamcity.buildType.id=IgniteTests24Java8_Basic3, -Dteamcity.configuration.properties.file=/opt/buildagent/temp/buildTmp/teamcity.config5591980786735343870.properties, -Dteamcity.maven.userSettings.path=/opt/buildagent/temp/buildTmp/maven_settings_585072866407032347.xml, -Dteamcity.maven.watcher.home=/opt/buildagent/plugins/mavenPlugin/maven-watcher-jdk16, -Dteamcity.projectName=Ignite Tests 2.x (JDK 8/11), -Dteamcity.runner.properties.file=/opt/buildagent/temp/buildTmp/teamcity.runner9098465561618137420.properties, -Dteamcity.tests.recentlyFailedTests.file=/opt/buildagent/temp/buildTmp/testsToRunFirst3891775683130404069.txt, -Dteamcity.version=2021.2 (build 99542), -ea, -Xms2g, -Xmx2g, -XX:+HeapDumpOnOutOfMemoryError, -DIGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_TEST_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_UPDATE_NOTIFIER=false, -DIGNITE_NO_DISCO_ORDER=true, -DIGNITE_PERFORMANCE_SUGGESTIONS_DISABLED=true, -Djava.net.preferIPv4Stack=true, -DTEST_SCALE_FACTOR=1.0, -DIGNITE_TEST_PROP_LOG4J_FILE=log4j-tc-test.xml, -DIGNITE_QUIET=false, -DIGNITE_MARSHAL_BUFFERS_RECHECK=1000, -Dmaven.repo.local=/opt/buildagent/.m2/repository] [21:10:12] : [Step 4/5] [2021-11-19 21:10:12,073][INFO ][test-runner-#19691%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] System cache's DataRegion size is configured to 40 MB. Use DataStorageConfiguration.systemRegionInitialSize property to change the setting. [21:10:12] : [Step 4/5] [2021-11-19 21:10:12,073][INFO ][test-runner-#19691%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] Configured caches [in 'sysMemPlc' dataRegion: ['ignite-sys-cache']] [21:10:12]W: [org.apache.ignite:ignite-core] [2021-11-19 21:10:12,074][WARN ][test-runner-#19691%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] Peer class loading is enabled (disable it in production for performance and deployment consistency reasons) [21:10:12] : [Step 4/5] [2021-11-19 21:10:12,074][INFO ][test-runner-#19691%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] 3-rd party licenses can be found at: /opt/buildagent/work/7bc1c54bc719b67c/libs/licenses [21:10:12] : [Step 4/5] [2021-11-19 21:10:12,079][INFO ][test-runner-#19691%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] Configured plugins: [21:10:12] : [Step 4/5] [2021-11-19 21:10:12,079][INFO ][test-runner-#19691%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] ^-- StanByClusterTestProvider 1.0 [21:10:12] : [Step 4/5] [2021-11-19 21:10:12,079][INFO ][test-runner-#19691%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:10:12] : [Step 4/5] [2021-11-19 21:10:12,079][INFO ][test-runner-#19691%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] [21:10:12] : [Step 4/5] [2021-11-19 21:10:12,080][INFO ][test-runner-#19691%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] ^-- PageMemory tracker plugin 1.0 [21:10:12] : [Step 4/5] [2021-11-19 21:10:12,080][INFO ][test-runner-#19691%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:10:12] : [Step 4/5] [2021-11-19 21:10:12,080][INFO ][test-runner-#19691%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] [21:10:12] : [Step 4/5] [2021-11-19 21:10:12,080][INFO ][test-runner-#19691%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] ^-- TestDistibutedConfigurationPlugin 1.0 [21:10:12] : [Step 4/5] [2021-11-19 21:10:12,080][INFO ][test-runner-#19691%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:10:12] : [Step 4/5] [2021-11-19 21:10:12,081][INFO ][test-runner-#19691%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] [21:10:12] : [Step 4/5] [2021-11-19 21:10:12,081][INFO ][test-runner-#19691%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] ^-- NodeValidationPluginProvider 1.0 [21:10:12] : [Step 4/5] [2021-11-19 21:10:12,081][INFO ][test-runner-#19691%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:10:12] : [Step 4/5] [2021-11-19 21:10:12,081][INFO ][test-runner-#19691%encryption.MasterKeyChangeTest%][IgnitePluginProcessor] [21:10:12] : [Step 4/5] [2021-11-19 21:10:12,082][INFO ][test-runner-#19691%encryption.MasterKeyChangeTest%][FailureProcessor] Configured failure handler: [hnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]]] [21:10:12] : [Step 4/5] [2021-11-19 21:10:12,096][INFO ][test-runner-#19691%encryption.MasterKeyChangeTest%][TestRecordingCommunicationSpi] Successfully bound communication NIO server to TCP port [port=47101, locHost=/127.0.0.1, selectorsCnt=12, selectorSpins=0, pairedConn=false] [21:10:12]W: [org.apache.ignite:ignite-core] [2021-11-19 21:10:12,096][WARN ][test-runner-#19691%encryption.MasterKeyChangeTest%][TestRecordingCommunicationSpi] Message queue limit is set to 0 which may lead to potential OOMEs when running cache operations in FULL_ASYNC or PRIMARY_SYNC modes due to message queues growth on sender and receiver sides. [21:10:12] : [Step 4/5] [2021-11-19 21:10:12,101][INFO ][test-runner-#19691%encryption.MasterKeyChangeTest%][GridCollisionManager] Collision resolution is disabled (all jobs will be activated upon arrival). [21:10:12] : [Step 4/5] [2021-11-19 21:10:12,102][INFO ][test-runner-#19691%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] Security status [authentication=off, sandbox=off, tls/ssl=off] [21:10:12] : [Step 4/5] [2021-11-19 21:10:12,165][INFO ][test-runner-#19691%encryption.MasterKeyChangeTest%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:10:12] : [Step 4/5] [2021-11-19 21:10:12,248][INFO ][test-runner-#19691%encryption.MasterKeyChangeTest%][MaintenanceProcessor] Resolved store directory for node persistent data: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1 [21:10:12] : [Step 4/5] [2021-11-19 21:10:12,249][INFO ][test-runner-#19691%encryption.MasterKeyChangeTest%][CacheObjectBinaryProcessorImpl] Resolved directory for serialized binary metadata: /opt/buildagent/work/7bc1c54bc719b67c/work/db/binary_meta/grid_1 [21:10:12] : [Step 4/5] [2021-11-19 21:10:12,253][INFO ][test-runner-#19691%encryption.MasterKeyChangeTest%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1 [21:10:12] : [Step 4/5] [2021-11-19 21:10:12,254][INFO ][test-runner-#19691%encryption.MasterKeyChangeTest%][FileWriteAheadLogManager] Resolved write ahead log work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1 [21:10:12] : [Step 4/5] [2021-11-19 21:10:12,254][INFO ][test-runner-#19691%encryption.MasterKeyChangeTest%][FileWriteAheadLogManager] Resolved write ahead log archive directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1 [21:10:12] : [Step 4/5] [2021-11-19 21:10:12,669][INFO ][test-runner-#19691%encryption.MasterKeyChangeTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000000.wal [21:10:12] : [Step 4/5] [2021-11-19 21:10:12,676][INFO ][test-runner-#19691%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Configured data regions initialized successfully [total=5] [21:10:12] : [Step 4/5] [2021-11-19 21:10:12,678][INFO ][test-runner-#19691%encryption.MasterKeyChangeTest%][IgniteSnapshotManager] Resolved snapshot work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/snapshots [21:10:12] : [Step 4/5] [2021-11-19 21:10:12,678][INFO ][test-runner-#19691%encryption.MasterKeyChangeTest%][IgniteSnapshotManager] Resolved temp directory for snapshot creation: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1/snp [21:10:12] : [Step 4/5] [2021-11-19 21:10:12,681][INFO ][test-runner-#19691%encryption.MasterKeyChangeTest%][ClientListenerProcessor] Client connector processor has started on TCP port 10801 [21:10:12] : [Step 4/5] [2021-11-19 21:10:12,683][INFO ][test-runner-#19691%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] Non-loopback local IPs: 172.17.0.4 [21:10:12] : [Step 4/5] [2021-11-19 21:10:12,683][INFO ][test-runner-#19691%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] Enabled local MACs: 0242AC110004 [21:10:12] : [Step 4/5] [2021-11-19 21:10:12,684][INFO ][test-runner-#19691%encryption.MasterKeyChangeTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:10:12] : [Step 4/5] [2021-11-19 21:10:12,685][INFO ][test-runner-#19691%encryption.MasterKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:10:12] : [Step 4/5] [2021-11-19 21:10:12,685][INFO ][test-runner-#19691%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:10:12] : [Step 4/5] [2021-11-19 21:10:12,687][INFO ][test-runner-#19691%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Applying lost metastore updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:10:12] : [Step 4/5] [2021-11-19 21:10:12,688][INFO ][test-runner-#19691%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=0 ms] [21:10:12] : [Step 4/5] [2021-11-19 21:10:12,689][INFO ][test-runner-#19691%encryption.MasterKeyChangeTest%][GridCacheProcessor] Restoring partition state for local groups. [21:10:12] : [Step 4/5] [2021-11-19 21:10:12,689][INFO ][test-runner-#19691%encryption.MasterKeyChangeTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=0, partitionsProcessed=0, time=0ms] [21:10:12] : [Step 4/5] [2021-11-19 21:10:12,690][INFO ][test-runner-#19691%encryption.MasterKeyChangeTest%][GridEncryptionManager] Encryption keys loaded from metastore. [grps=, masterKeyName=ignite.master.key] [21:10:12] : [Step 4/5] [2021-11-19 21:10:12,691][INFO ][test-runner-#19691%encryption.MasterKeyChangeTest%][ClusterProcessor] Cluster ID and tag has been read from metastorage: null [21:10:12] : [Step 4/5] [2021-11-19 21:10:12,691][INFO ][test-runner-#19691%encryption.MasterKeyChangeTest%][IgniteClusterImpl] Shutdown policy was updated [oldVal=null, newVal=null] [21:10:12] : [Step 4/5] [2021-11-19 21:10:12,692][INFO ][test-runner-#19691%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Checkpoint frequency deviation changed [oldVal=null, newVal=null] [21:10:12] : [Step 4/5] [2021-11-19 21:10:12,701][INFO ][test-runner-#19691%encryption.MasterKeyChangeTest%][FilePageStoreManager] Cleanup cache stores [total=1, left=0, cleanFiles=false] [21:10:12] : [Step 4/5] [2021-11-19 21:10:12,704][INFO ][test-runner-#19691%encryption.MasterKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:10:12] : [Step 4/5] [2021-11-19 21:10:12,704][INFO ][test-runner-#19691%encryption.MasterKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:10:12] : [Step 4/5] [2021-11-19 21:10:12,706][INFO ][test-runner-#19691%encryption.MasterKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:10:12] : [Step 4/5] [2021-11-19 21:10:12,706][INFO ][test-runner-#19691%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Data Regions Started: 5 [21:10:12] : [Step 4/5] [2021-11-19 21:10:12,707][INFO ][test-runner-#19691%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] ^-- sysMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:10:12] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:10:12] : [Step 4/5] ^-- default region [type=default, persistence=true, lazyAlloc=true, [21:10:12] : [Step 4/5] ... initCfg=10MB, maxCfg=10MB, usedRam=0MB, freeRam=100%, allocRam=0MB, allocTotal=0MB] [21:10:12] : [Step 4/5] ^-- metastoreMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:10:12] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:10:12] : [Step 4/5] ^-- TxLog region [type=internal, persistence=true, lazyAlloc=false, [21:10:12] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:10:12] : [Step 4/5] ^-- volatileDsMemPlc region [type=user, persistence=false, lazyAlloc=true, [21:10:12] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB] [21:10:12] : [Step 4/5] ^-- Ignite persistence [used=0MB] [21:10:12] : [Step 4/5] [21:10:12] : [Step 4/5] [2021-11-19 21:10:12,708][INFO ][test-runner-#19691%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Starting binary memory restore for: [-2100569601] [21:10:12] : [Step 4/5] [2021-11-19 21:10:12,715][INFO ][test-runner-#19691%encryption.MasterKeyChangeTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:10:12] : [Step 4/5] [2021-11-19 21:10:12,715][INFO ][test-runner-#19691%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:10:12] : [Step 4/5] [2021-11-19 21:10:12,717][INFO ][test-runner-#19691%encryption.MasterKeyChangeTest%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000000.wal, offset=0, ver=2] [21:10:12] : [Step 4/5] [2021-11-19 21:10:12,722][INFO ][test-runner-#19691%encryption.MasterKeyChangeTest%][GridCacheProcessor] Started cache in recovery mode [name=ignite-sys-cache, id=-2100569601, dataRegionName=sysMemPlc, mode=REPLICATED, atomicity=TRANSACTIONAL, backups=2147483647, mvcc=false] [21:10:12] : [Step 4/5] [2021-11-19 21:10:12,723][INFO ][test-runner-#19691%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Binary recovery performed in 15 ms. [21:10:12] : [Step 4/5] [2021-11-19 21:10:12,723][INFO ][test-runner-#19691%encryption.MasterKeyChangeTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:10:12] : [Step 4/5] [2021-11-19 21:10:12,723][INFO ][test-runner-#19691%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Applying lost cache updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:10:12] : [Step 4/5] [2021-11-19 21:10:12,780][INFO ][test-runner-#19691%encryption.MasterKeyChangeTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=61 ms] [21:10:12] : [Step 4/5] [2021-11-19 21:10:12,781][INFO ][test-runner-#19691%encryption.MasterKeyChangeTest%][GridCacheProcessor] Restoring partition state for local groups. [21:10:12] : [Step 4/5] [2021-11-19 21:10:12,785][INFO ][test-runner-#19691%encryption.MasterKeyChangeTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=1, partitionsProcessed=100, time=0ms] [21:10:13] : [Step 4/5] [2021-11-19 21:10:13,098][INFO ][test-runner-#19691%encryption.MasterKeyChangeTest%][TestTcpDiscoverySpi] Successfully bound to TCP port [port=47501, localHost=localhost/127.0.0.1, locNodeId=10d4b9db-0d6e-4075-87e3-0df59aff8001] [21:10:13] : [Step 4/5] [2021-11-19 21:10:13,101][INFO ][tcp-disco-srvr-[:47500]-#1037%grid-0%-#19804%grid-0%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=45371] [21:10:13] : [Step 4/5] [2021-11-19 21:10:13,102][INFO ][tcp-disco-srvr-[:47500]-#1037%grid-0%-#19804%grid-0%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=45371] [21:10:13] : [Step 4/5] [2021-11-19 21:10:13,102][INFO ][tcp-disco-sock-reader-[]-#1043%grid-0%-#19923%grid-0%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:45371, rmtPort=45371] [21:10:13] : [Step 4/5] [2021-11-19 21:10:13,105][INFO ][tcp-disco-sock-reader-[10d4b9db 127.0.0.1:45371]-#1043%grid-0%-#19923%grid-0%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=10d4b9db-0d6e-4075-87e3-0df59aff8001, rmtAddr=/127.0.0.1:45371] [21:10:13] : [Step 4/5] [2021-11-19 21:10:13,110][INFO ][tcp-disco-srvr-[:47501]-#1042%grid-1%-#19922%grid-1%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=48449] [21:10:13] : [Step 4/5] [2021-11-19 21:10:13,111][INFO ][tcp-disco-srvr-[:47501]-#1042%grid-1%-#19922%grid-1%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=48449] [21:10:13] : [Step 4/5] [2021-11-19 21:10:13,111][INFO ][tcp-disco-sock-reader-[]-#1044%grid-1%-#19924%grid-1%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:48449, rmtPort=48449] [21:10:13] : [Step 4/5] [2021-11-19 21:10:13,112][INFO ][tcp-disco-sock-reader-[]-#1044%grid-1%-#19924%grid-1%][TestTcpDiscoverySpi] Received ping request from the remote node [rmtNodeId=0074303f-63cc-4b9f-ac73-2eafc28d8000, rmtAddr=/127.0.0.1:48449, rmtPort=48449] [21:10:13] : [Step 4/5] [2021-11-19 21:10:13,114][INFO ][tcp-disco-sock-reader-[]-#1044%grid-1%-#19924%grid-1%][TestTcpDiscoverySpi] Finished writing ping response [rmtNodeId=0074303f-63cc-4b9f-ac73-2eafc28d8000, rmtAddr=/127.0.0.1:48449, rmtPort=48449] [21:10:13] : [Step 4/5] [2021-11-19 21:10:13,114][INFO ][tcp-disco-sock-reader-[10d4b9db 127.0.0.1:45371]-#1043%grid-0%-#19923%grid-0%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:45371, rmtPort=45371, rmtNodeId=10d4b9db-0d6e-4075-87e3-0df59aff8001] [21:10:13]W: [org.apache.ignite:ignite-core] [2021-11-19 21:10:13,114][WARN ][tcp-disco-sock-reader-[]-#1044%grid-1%-#19924%grid-1%][TestTcpDiscoverySpi] Failed to shutdown socket [21:10:13]W: [org.apache.ignite:ignite-core] java.net.SocketException: Socket output is already shutdown [21:10:13]W: [org.apache.ignite:ignite-core] at java.net.Socket.shutdownOutput(Socket.java:1572) [21:10:13]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.close(IgniteUtils.java:4247) [21:10:13]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.discovery.tcp.ServerImpl$SocketReader.body(ServerImpl.java:7370) [21:10:13]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.IgniteSpiThread.run(IgniteSpiThread.java:58) [21:10:13] : [Step 4/5] [2021-11-19 21:10:13,117][INFO ][tcp-disco-sock-reader-[]-#1044%grid-1%-#19924%grid-1%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:48449, rmtPort=48449, rmtNodeId=null] [21:10:13] : [Step 4/5] [2021-11-19 21:10:13,117][INFO ][tcp-disco-msg-worker-[crd]-#1036%grid-0%-#19803%grid-0%][GridEncryptionManager] Joining node doesn't have stored group keys [node=10d4b9db-0d6e-4075-87e3-0df59aff8001] [21:10:13] : [Step 4/5] [2021-11-19 21:10:13,126][INFO ][tcp-disco-msg-worker-[crd]-#1036%grid-0%-#19803%grid-0%][TestTcpDiscoverySpi] New next node [newNext=TcpDiscoveryNode [id=10d4b9db-0d6e-4075-87e3-0df59aff8001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=0, intOrder=2, lastExchangeTime=1637345413100, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false]] [21:10:13] : [Step 4/5] [2021-11-19 21:10:13,127][INFO ][tcp-disco-srvr-[:47501]-#1042%grid-1%-#19922%grid-1%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=50565] [21:10:13] : [Step 4/5] [2021-11-19 21:10:13,127][INFO ][tcp-disco-srvr-[:47501]-#1042%grid-1%-#19922%grid-1%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=50565] [21:10:13] : [Step 4/5] [2021-11-19 21:10:13,128][INFO ][tcp-disco-sock-reader-[]-#1045%grid-1%-#19925%grid-1%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:50565, rmtPort=50565] [21:10:13] : [Step 4/5] [2021-11-19 21:10:13,129][INFO ][tcp-disco-sock-reader-[0074303f 127.0.0.1:50565]-#1045%grid-1%-#19925%grid-1%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=0074303f-63cc-4b9f-ac73-2eafc28d8000, rmtAddr=/127.0.0.1:50565] [21:10:13] : [Step 4/5] [2021-11-19 21:10:13,133][INFO ][tcp-disco-msg-worker-[]-#1041%grid-1%-#19921%grid-1%][TestTcpDiscoverySpi] New next node [newNext=TcpDiscoveryNode [id=0074303f-63cc-4b9f-ac73-2eafc28d8000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345413130, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false]] [21:10:13] : [Step 4/5] [2021-11-19 21:10:13,133][INFO ][tcp-disco-srvr-[:47500]-#1037%grid-0%-#19804%grid-0%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=53861] [21:10:13] : [Step 4/5] [2021-11-19 21:10:13,134][INFO ][tcp-disco-srvr-[:47500]-#1037%grid-0%-#19804%grid-0%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=53861] [21:10:13] : [Step 4/5] [2021-11-19 21:10:13,134][INFO ][tcp-disco-sock-reader-[]-#1046%grid-0%-#19926%grid-0%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:53861, rmtPort=53861] [21:10:13] : [Step 4/5] [2021-11-19 21:10:13,136][INFO ][tcp-disco-sock-reader-[10d4b9db 127.0.0.1:53861]-#1046%grid-0%-#19926%grid-0%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=10d4b9db-0d6e-4075-87e3-0df59aff8001, rmtAddr=/127.0.0.1:53861] [21:10:13] : [Step 4/5] [2021-11-19 21:10:13,138][INFO ][disco-event-worker-#19806%grid-0%][GridDiscoveryManager] Added new node to topology: TcpDiscoveryNode [id=10d4b9db-0d6e-4075-87e3-0df59aff8001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637345413100, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false] [21:10:13] : [Step 4/5] [2021-11-19 21:10:13,140][INFO ][disco-event-worker-#19806%grid-0%][GridDiscoveryManager] Topology snapshot [ver=2, locNode=0074303f, servers=2, clients=0, state=INACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=0074303f-63cc-4b9f-ac73-2eafc28d8000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=10d4b9db-0d6e-4075-87e3-0df59aff8001, consistentId=grid-1, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:10:13] : [Step 4/5] [2021-11-19 21:10:13,142][INFO ][tcp-disco-msg-worker-[0074303f 127.0.0.1:47500]-#1041%grid-1%-#19921%grid-1%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustEnabled' was changed from 'null' to 'false' [21:10:13] : [Step 4/5] [2021-11-19 21:10:13,143][INFO ][tcp-disco-msg-worker-[0074303f 127.0.0.1:47500]-#1041%grid-1%-#19921%grid-1%][ClusterProcessor] quizzical_yonath [21:10:13] : [Step 4/5] [2021-11-19 21:10:13,143][INFO ][tcp-disco-msg-worker-[0074303f 127.0.0.1:47500]-#1041%grid-1%-#19921%grid-1%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustTimeout' was changed from 'null' to '300000' [21:10:13] : [Step 4/5] [2021-11-19 21:10:13,143][INFO ][tcp-disco-msg-worker-[0074303f 127.0.0.1:47500]-#1041%grid-1%-#19921%grid-1%][IgniteTxManager] Transactions parameter 'longOperationsDumpTimeout' was changed from 'null' to '60000' [21:10:13] : [Step 4/5] [2021-11-19 21:10:13,144][INFO ][tcp-disco-msg-worker-[0074303f 127.0.0.1:47500]-#1041%grid-1%-#19921%grid-1%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpThreshold' was changed from 'null' to '0' [21:10:13] : [Step 4/5] [2021-11-19 21:10:13,144][INFO ][tcp-disco-msg-worker-[0074303f 127.0.0.1:47500]-#1041%grid-1%-#19921%grid-1%][IgniteTxManager] Transactions parameter 'transactionTimeDumpSamplesCoefficient' was changed from 'null' to '0.0' [21:10:13] : [Step 4/5] [2021-11-19 21:10:13,145][INFO ][tcp-disco-msg-worker-[0074303f 127.0.0.1:47500]-#1041%grid-1%-#19921%grid-1%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpSamplesPerSecondLimit' was changed from 'null' to '5' [21:10:13] : [Step 4/5] [2021-11-19 21:10:13,145][INFO ][tcp-disco-msg-worker-[0074303f 127.0.0.1:47500]-#1041%grid-1%-#19921%grid-1%][IgniteTxManager] Transactions parameter 'collisionsDumpInterval' was changed from 'null' to '1000' [21:10:13] : [Step 4/5] [2021-11-19 21:10:13,145][INFO ][tcp-disco-msg-worker-[0074303f 127.0.0.1:47500]-#1041%grid-1%-#19921%grid-1%][IgniteTxManager] Transactions parameter 'txOwnerDumpRequestsAllowed' was changed from 'null' to 'true' [21:10:13] : [Step 4/5] [2021-11-19 21:10:13,146][INFO ][tcp-disco-msg-worker-[0074303f 127.0.0.1:47500]-#1041%grid-1%-#19921%grid-1%][GridCacheDatabaseSharedManager] Historical rebalance WAL threshold changed [property=historical.rebalance.threshold, oldVal=null, newVal=500] [21:10:13] : [Step 4/5] [2021-11-19 21:10:13,147][INFO ][disco-notifier-worker-#19920%grid-1%][MvccProcessorImpl] Assigned mvcc coordinator [crd=MvccCoordinator [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=0], nodeId=0074303f-63cc-4b9f-ac73-2eafc28d8000, ver=1637345412019, local=false, initialized=false]] [21:10:13] : [Step 4/5] [2021-11-19 21:10:13,152][INFO ][sys-#19904%grid-1%][ClusterProcessor] Writing cluster ID and tag to metastorage on ready for write ClusterIdAndTag [id=c30cef27-cd5e-4eff-8d56-2ea5b6c1c188, tag=quizzical_yonath] [21:10:13] : [Step 4/5] [2021-11-19 21:10:13,219][INFO ][test-runner-#19691%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] To start Console Management & Monitoring run ignitevisorcmd.{sh|bat} [21:10:13] : [Step 4/5] [2021-11-19 21:10:13,219][INFO ][test-runner-#19691%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] [21:10:13] : [Step 4/5] [21:10:13] : [Step 4/5] >>> +-------------------------------------------+ [21:10:13] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:10:13] : [Step 4/5] >>> +-------------------------------------------+ [21:10:13] : [Step 4/5] >>> OS name: Linux 4.15.0-151-generic amd64 [21:10:13] : [Step 4/5] >>> CPU(s): 24 [21:10:13] : [Step 4/5] >>> Heap: 2.0GB [21:10:13] : [Step 4/5] >>> VM name: 16724@c4dfe9a430b2 [21:10:13] : [Step 4/5] >>> Ignite instance name: grid-1 [21:10:13] : [Step 4/5] >>> Local node [ID=10D4B9DB-0D6E-4075-87E3-0DF59AFF8001, order=2, clientMode=false] [21:10:13] : [Step 4/5] >>> Local node addresses: [127.0.0.1] [21:10:13] : [Step 4/5] >>> Local ports: TCP:10801 TCP:47101 TCP:47501 [21:10:13] : [Step 4/5] [21:10:13] : [Step 4/5] [2021-11-19 21:10:13,220][INFO ][test-runner-#19691%encryption.MasterKeyChangeTest%][IgniteKernal%grid-1] >>> Ignite cluster is in INACTIVE state (limited functionality available). Use control.(sh|bat) script or IgniteCluster.state(ClusterState.ACTIVE) to change the state. [21:10:13] : [Step 4/5] [2021-11-19 21:10:13,221][INFO ][test-runner-#19691%encryption.MasterKeyChangeTest%][GridDiscoveryManager] Topology snapshot [ver=2, locNode=10d4b9db, servers=2, clients=0, state=INACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=0074303f-63cc-4b9f-ac73-2eafc28d8000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=10d4b9db-0d6e-4075-87e3-0df59aff8001, consistentId=grid-1, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:10:13] : [Step 4/5] [2021-11-19 21:10:13,221][INFO ][test-runner-#19691%encryption.MasterKeyChangeTest%][G] Node started : [stage="Configure system pool" (0 ms),stage="Start managers" (192 ms),stage="Configure binary metadata" (1 ms),stage="Start processors" (431 ms),stage="Start 'StanByClusterTestProvider' plugin" (0 ms),stage="Start 'PageMemory tracker plugin' plugin" (0 ms),stage="Start 'TestDistibutedConfigurationPlugin' plugin" (0 ms),stage="Start 'NodeValidationPluginProvider' plugin" (0 ms),stage="Init metastore" (19 ms),stage="Init and start regions" (6 ms),stage="Restore binary memory" (14 ms),stage="Restore logical state" (62 ms),stage="Finish recovery" (311 ms),stage="Join topology" (50 ms),stage="Await transition" (6 ms),stage="Await exchange" (67 ms),stage="Total time" (1159 ms)] [21:10:13] : [Step 4/5] [2021-11-19 21:10:13,222][INFO ][test-runner-#19691%encryption.MasterKeyChangeTest%][root] Node started with the following configuration [id=10d4b9db-0d6e-4075-87e3-0df59aff8001, marshaller=BinaryMarshaller [], discovery=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=5000, ackTimeout=5000, marsh=JdkMarshaller [clsFilter=org.apache.ignite.marshaller.MarshallerUtils$1@13d9098a], reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], binaryCfg=null, lateAff=true] [21:10:13] : [Step 4/5] [2021-11-19 21:10:13,224][INFO ][test-runner-#19691%encryption.MasterKeyChangeTest%][GridClusterStateProcessor] Sending activate cluster request with BaselineTopology BaselineTopology [id=0, branchingHash=-2475315501, branchingType='New BaselineTopology', baselineNodes=[grid-1, grid-0]] [21:10:13] : [Step 4/5] [2021-11-19 21:10:13,228][INFO ][disco-notifier-worker-#19802%grid-0%][GridClusterStateProcessor] Received activate cluster request with BaselineTopology[id=0] initiator node ID: 0074303f-63cc-4b9f-ac73-2eafc28d8000 [21:10:13] : [Step 4/5] [2021-11-19 21:10:13,228][INFO ][disco-notifier-worker-#19802%grid-0%][GridClusterStateProcessor] Started state transition: activate cluster [21:10:13] : [Step 4/5] [2021-11-19 21:10:13,229][INFO ][exchange-worker-#19807%grid-0%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], crd=true, evt=DISCOVERY_CUSTOM_EVT, evtNode=0074303f-63cc-4b9f-ac73-2eafc28d8000, customEvt=ChangeGlobalStateMessage [id=33a7d593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqId=697da76c-1796-4692-85f6-36a746857255, initiatingNodeId=0074303f-63cc-4b9f-ac73-2eafc28d8000, state=ACTIVE, baselineTopology=BaselineTopology [id=0, branchingHash=-2475315501, branchingType='New BaselineTopology', baselineNodes=[grid-1, grid-0]], forceChangeBaselineTopology=false, timestamp=1637345413224, forceDeactivation=true], allowMerge=false, exchangeFreeSwitch=false] [21:10:13] : [Step 4/5] [2021-11-19 21:10:13,229][INFO ][disco-notifier-worker-#19920%grid-1%][GridClusterStateProcessor] Received activate cluster request with BaselineTopology[id=0] initiator node ID: 0074303f-63cc-4b9f-ac73-2eafc28d8000 [21:10:13] : [Step 4/5] [2021-11-19 21:10:13,230][INFO ][exchange-worker-#19807%grid-0%][GridDhtPartitionsExchangeFuture] Start activation process [nodeId=0074303f-63cc-4b9f-ac73-2eafc28d8000, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]]. New state: ACTIVE [21:10:13] : [Step 4/5] [2021-11-19 21:10:13,230][INFO ][disco-notifier-worker-#19920%grid-1%][GridClusterStateProcessor] Started state transition: activate cluster [21:10:13] : [Step 4/5] [2021-11-19 21:10:13,231][INFO ][exchange-worker-#19807%grid-0%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0 [21:10:13] : [Step 4/5] [2021-11-19 21:10:13,231][INFO ][exchange-worker-#19929%grid-1%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], crd=false, evt=DISCOVERY_CUSTOM_EVT, evtNode=0074303f-63cc-4b9f-ac73-2eafc28d8000, customEvt=ChangeGlobalStateMessage [id=33a7d593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqId=697da76c-1796-4692-85f6-36a746857255, initiatingNodeId=0074303f-63cc-4b9f-ac73-2eafc28d8000, state=ACTIVE, baselineTopology=BaselineTopology [id=0, branchingHash=-2475315501, branchingType='New BaselineTopology', baselineNodes=[grid-1, grid-0]], forceChangeBaselineTopology=false, timestamp=1637345413224, forceDeactivation=true], allowMerge=false, exchangeFreeSwitch=false] [21:10:13] : [Step 4/5] [2021-11-19 21:10:13,233][INFO ][exchange-worker-#19807%grid-0%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000000.wal, offset=8713, ver=2] [21:10:13] : [Step 4/5] [2021-11-19 21:10:13,233][INFO ][exchange-worker-#19929%grid-1%][GridDhtPartitionsExchangeFuture] Start activation process [nodeId=10d4b9db-0d6e-4075-87e3-0df59aff8001, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]]. New state: ACTIVE [21:10:13] : [Step 4/5] [2021-11-19 21:10:13,234][INFO ][exchange-worker-#19807%grid-0%][GridClusterStateProcessor] Writing BaselineTopology[id=0] [21:10:13] : [Step 4/5] [2021-11-19 21:10:13,234][INFO ][exchange-worker-#19929%grid-1%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1 [21:10:13] : [Step 4/5] [2021-11-19 21:10:13,239][INFO ][exchange-worker-#19929%grid-1%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000000.wal, offset=8713, ver=2] [21:10:13] : [Step 4/5] [2021-11-19 21:10:13,240][INFO ][exchange-worker-#19807%grid-0%][GridCacheDatabaseSharedManager] Finish recovery performed in 9 ms. [21:10:13] : [Step 4/5] [2021-11-19 21:10:13,243][INFO ][exchange-worker-#19929%grid-1%][GridClusterStateProcessor] Writing BaselineTopology[id=0] [21:10:13] : [Step 4/5] [2021-11-19 21:10:13,244][INFO ][exchange-worker-#19807%grid-0%][msg] Components activation performed in 13 ms. [21:10:13] : [Step 4/5] [2021-11-19 21:10:13,245][INFO ][exchange-worker-#19807%grid-0%][GridCacheProcessor] Finished recovery for cache [cache=ignite-sys-cache, grp=ignite-sys-cache, startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:10:13] : [Step 4/5] [2021-11-19 21:10:13,246][INFO ][exchange-worker-#19807%grid-0%][GridDhtPartitionsExchangeFuture] Successfully activated caches [nodeId=0074303f-63cc-4b9f-ac73-2eafc28d8000, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], newState=ACTIVE] [21:10:13] : [Step 4/5] [2021-11-19 21:10:13,247][INFO ][exchange-worker-#19929%grid-1%][GridCacheDatabaseSharedManager] Finish recovery performed in 9 ms. [21:10:13] : [Step 4/5] [2021-11-19 21:10:13,247][INFO ][exchange-worker-#19807%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:10:13] : [Step 4/5] [2021-11-19 21:10:13,249][INFO ][exchange-worker-#19929%grid-1%][msg] Components activation performed in 15 ms. [21:10:13] : [Step 4/5] [2021-11-19 21:10:13,251][INFO ][exchange-worker-#19929%grid-1%][GridCacheProcessor] Finished recovery for cache [cache=ignite-sys-cache, grp=ignite-sys-cache, startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:10:13] : [Step 4/5] [2021-11-19 21:10:13,252][INFO ][exchange-worker-#19929%grid-1%][GridDhtPartitionsExchangeFuture] Successfully activated caches [nodeId=10d4b9db-0d6e-4075-87e3-0df59aff8001, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], newState=ACTIVE] [21:10:13] : [Step 4/5] [2021-11-19 21:10:13,253][INFO ][exchange-worker-#19929%grid-1%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:10:13] : [Step 4/5] [2021-11-19 21:10:13,266][INFO ][exchange-worker-#19807%grid-0%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], crd=true] [21:10:13] : [Step 4/5] [2021-11-19 21:10:13,269][INFO ][db-checkpoint-thread-#19938%grid-0%][Checkpointer] Checkpoint started [checkpointId=294bd1fe-1b9e-46ad-84b9-8b6829deea92, startPtr=WALPointer [idx=0, fileOff=89239, len=1963], checkpointBeforeLockTime=6ms, checkpointLockWait=1ms, checkpointListenersExecuteTime=1ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=0ms, writeCheckpointEntryDuration=2ms, splitAndSortCpPagesDuration=1ms, pages=19, reason='node started'] [21:10:13] : [Step 4/5] [2021-11-19 21:10:13,269][INFO ][grid-nio-worker-tcp-comm-0-#19746%TestRecordingCommunicationSpi%][TestRecordingCommunicationSpi] Accepted incoming communication connection [locAddr=/127.0.0.1:47100, rmtAddr=/127.0.0.1:60358] [21:10:13] : [Step 4/5] [2021-11-19 21:10:13,270][INFO ][db-checkpoint-thread-#19940%grid-1%][Checkpointer] Checkpoint started [checkpointId=3454d553-d8a0-4739-b8f9-b6e11ce1f277, startPtr=WALPointer [idx=0, fileOff=85407, len=1963], checkpointBeforeLockTime=4ms, checkpointLockWait=2ms, checkpointListenersExecuteTime=1ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=1ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=0ms, pages=19, reason='node started'] [21:10:13] : [Step 4/5] [2021-11-19 21:10:13,273][INFO ][grid-nio-worker-tcp-comm-0-#19864%TestRecordingCommunicationSpi%][TestRecordingCommunicationSpi] Established outgoing communication connection [locAddr=/127.0.0.1:60358, rmtAddr=/127.0.0.1:47100] [21:10:13] : [Step 4/5] [2021-11-19 21:10:13,274][INFO ][exchange-worker-#19929%grid-1%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], crd=false] [21:10:13] : [Step 4/5] [2021-11-19 21:10:13,278][INFO ][sys-#19788%grid-0%][GridDhtPartitionsExchangeFuture] Coordinator received single message [ver=AffinityTopologyVersion [topVer=2, minorTopVer=1], node=10d4b9db-0d6e-4075-87e3-0df59aff8001, allReceived=true] [21:10:13] : [Step 4/5] [2021-11-19 21:10:13,278][INFO ][sys-#19788%grid-0%][GridDhtPartitionsExchangeFuture] finishExchangeOnCoordinator [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:10:13] : [Step 4/5] [2021-11-19 21:10:13,290][INFO ][sys-#19788%grid-0%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], err=null, rebalanced=true, wasRebalanced=false] [21:10:13] : [Step 4/5] [2021-11-19 21:10:13,292][INFO ][disco-notifier-worker-#19920%grid-1%][GridClusterStateProcessor] Received state change finish message: ACTIVE [21:10:13] : [Step 4/5] [2021-11-19 21:10:13,292][INFO ][sys-#19907%grid-1%][GridDhtPartitionsExchangeFuture] Received full message, will finish exchange [node=0074303f-63cc-4b9f-ac73-2eafc28d8000, resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:10:13] : [Step 4/5] [2021-11-19 21:10:13,290][INFO ][disco-notifier-worker-#19802%grid-0%][GridClusterStateProcessor] Received state change finish message: ACTIVE [21:10:13] : [Step 4/5] [2021-11-19 21:10:13,294][INFO ][sys-#19788%grid-0%][GridCacheProcessor] Finish proxy initialization, cacheName=ignite-sys-cache, localNodeId=0074303f-63cc-4b9f-ac73-2eafc28d8000 [21:10:13] : [Step 4/5] [2021-11-19 21:10:13,293][INFO ][disco-notifier-worker-#19920%grid-1%][GridClusterStateProcessor] Cluster state was changed from INACTIVE to ACTIVE [21:10:13] : [Step 4/5] [2021-11-19 21:10:13,295][INFO ][sys-#19779%grid-0%][DistributedBaselineConfiguration] Baseline auto-adjust is 'disabled' with timeout='300000' ms [21:10:13] : [Step 4/5] [2021-11-19 21:10:13,295][INFO ][exchange-worker-#19807%grid-0%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=2, minorTopVer=1], force=false, evt=DISCOVERY_CUSTOM_EVT, node=0074303f-63cc-4b9f-ac73-2eafc28d8000] [21:10:13] : [Step 4/5] [2021-11-19 21:10:13,295][INFO ][sys-#19907%grid-1%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], err=null, rebalanced=true, wasRebalanced=false] [21:10:13] : [Step 4/5] [2021-11-19 21:10:13,294][INFO ][sys-#19898%grid-1%][GridCachePartitionExchangeManager] Delay process full message without exchange id (there is exchange in progress) [nodeId=0074303f-63cc-4b9f-ac73-2eafc28d8000] [21:10:13] : [Step 4/5] [2021-11-19 21:10:13,294][INFO ][disco-notifier-worker-#19802%grid-0%][GridClusterStateProcessor] Cluster state was changed from INACTIVE to ACTIVE [21:10:13] : [Step 4/5] [2021-11-19 21:10:13,298][INFO ][sys-#19907%grid-1%][GridCacheProcessor] Finish proxy initialization, cacheName=ignite-sys-cache, localNodeId=10d4b9db-0d6e-4075-87e3-0df59aff8001 [21:10:13] : [Step 4/5] [2021-11-19 21:10:13,297][INFO ][db-checkpoint-thread-#19938%grid-0%][Checkpointer] Checkpoint finished [cpId=294bd1fe-1b9e-46ad-84b9-8b6829deea92, pages=19, markPos=WALPointer [idx=0, fileOff=89239, len=1963], walSegmentsCovered=[], markDuration=4ms, pagesWrite=9ms, fsync=19ms, total=39ms] [21:10:13] : [Step 4/5] [2021-11-19 21:10:13,297][INFO ][db-checkpoint-thread-#19940%grid-1%][Checkpointer] Checkpoint finished [cpId=3454d553-d8a0-4739-b8f9-b6e11ce1f277, pages=19, markPos=WALPointer [idx=0, fileOff=85407, len=1963], walSegmentsCovered=[], markDuration=5ms, pagesWrite=7ms, fsync=19ms, total=37ms] [21:10:13] : [Step 4/5] [2021-11-19 21:10:13,295][INFO ][sys-#19779%grid-0%][GridClusterStateProcessor] Successfully performed final activation steps [nodeId=0074303f-63cc-4b9f-ac73-2eafc28d8000, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:10:13] : [Step 4/5] [2021-11-19 21:10:13,295][INFO ][sys-#19788%grid-0%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=0074303f-63cc-4b9f-ac73-2eafc28d8000, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=0074303f-63cc-4b9f-ac73-2eafc28d8000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345413293, loc=true, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:10:13] : [Step 4/5] [2021-11-19 21:10:13,301][INFO ][test-runner-#19691%encryption.MasterKeyChangeTest%][root] awaitPartitionMapExchange finished [21:10:13] : [Step 4/5] [2021-11-19 21:10:13,300][INFO ][sys-#19907%grid-1%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=10d4b9db-0d6e-4075-87e3-0df59aff8001, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=0074303f-63cc-4b9f-ac73-2eafc28d8000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345413130, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:10:13] : [Step 4/5] [2021-11-19 21:10:13,300][INFO ][exchange-worker-#19929%grid-1%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=2, minorTopVer=1], force=false, evt=DISCOVERY_CUSTOM_EVT, node=0074303f-63cc-4b9f-ac73-2eafc28d8000] [21:10:13] : [Step 4/5] [2021-11-19 21:10:13,300][INFO ][sys-#19912%grid-1%][DistributedBaselineConfiguration] Baseline auto-adjust is 'disabled' with timeout='300000' ms [21:10:13] : [Step 4/5] [2021-11-19 21:10:13,304][INFO ][sys-#19907%grid-1%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (1 ms), stage="Update caches registry" (17 ms), stage="Start caches" (0 ms), stage="Affinity initialization on cache group start" (0 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Restore partition states" (0 ms), stage="After states restored callback" (13 ms), stage="WAL history reservation" (0 ms), stage="Waiting for Full message" (24 ms), stage="Affinity recalculation" (1 ms), stage="Full map updating" (1 ms), stage="Detect lost partitions" (2 ms), stage="Exchange done" (6 ms), stage="Total time" (65 ms)] [21:10:13] : [Step 4/5] [2021-11-19 21:10:13,302][INFO ][sys-#19788%grid-0%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (1 ms), stage="Update caches registry" (15 ms), stage="Start caches" (0 ms), stage="Affinity initialization on cache group start" (0 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (2 ms), stage="Restore partition states" (0 ms), stage="After states restored callback" (16 ms), stage="WAL history reservation" (0 ms), stage="Waiting for all single messages" (12 ms), stage="Affinity recalculation (crd)" (0 ms), stage="Collect update counters and create affinity messages" (0 ms), stage="Assign partitions states" (0 ms), stage="Validate partitions states" (0 ms), stage="Ideal affinity diff calculation (enforced)" (0 ms), stage="Apply update counters" (0 ms), stage="Full message preparing" (9 ms), stage="Full message sending" (0 ms), stage="State finish message sending" (0 ms), stage="Detect lost partitions" (2 ms), stage="Exchange done" (8 ms), stage="Total time" (65 ms), Discovery lag=2 ms, Latest started node id=10d4b9db-0d6e-4075-87e3-0df59aff8001] [21:10:13] : [Step 4/5] [2021-11-19 21:10:13,308][INFO ][exchange-worker-#19929%grid-1%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], crd=false, evt=DISCOVERY_CUSTOM_EVT, evtNode=0074303f-63cc-4b9f-ac73-2eafc28d8000, customEvt=DynamicCacheChangeBatch [id=75a7d593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqs=ArrayList [DynamicCacheChangeRequest [cacheName=encrypted, hasCfg=true, nodeId=0074303f-63cc-4b9f-ac73-2eafc28d8000, clientStartOnly=false, stop=false, destroy=false, disabledAfterStart=false]], exchangeActions=ExchangeActions [startCaches=[encrypted], stopCaches=null, startGrps=[encrypted], stopGrps=[], resetParts=null, stateChangeRequest=null], startCaches=false], allowMerge=false, exchangeFreeSwitch=false] [21:10:13] : [Step 4/5] [2021-11-19 21:10:13,308][INFO ][exchange-worker-#19807%grid-0%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], crd=true, evt=DISCOVERY_CUSTOM_EVT, evtNode=0074303f-63cc-4b9f-ac73-2eafc28d8000, customEvt=DynamicCacheChangeBatch [id=75a7d593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqs=ArrayList [DynamicCacheChangeRequest [cacheName=encrypted, hasCfg=true, nodeId=0074303f-63cc-4b9f-ac73-2eafc28d8000, clientStartOnly=false, stop=false, destroy=false, disabledAfterStart=false]], exchangeActions=ExchangeActions [startCaches=[encrypted], stopCaches=null, startGrps=[encrypted], stopGrps=[], resetParts=null, stateChangeRequest=null], startCaches=false], allowMerge=false, exchangeFreeSwitch=false] [21:10:13] : [Step 4/5] [2021-11-19 21:10:13,307][INFO ][sys-#19907%grid-1%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], stage="Affinity initialization on cache group start [grp=ignite-sys-cache]" (0 ms) (parent=Affinity initialization on cache group start), stage="Affinity centralized initialization (crd) [grp=ignite-sys-cache, crd=false]" (0 ms) (parent=Determine exchange type), stage="Restore partition states [grp=ignite-sys-cache]" (0 ms) (parent=Restore partition states), stage="Affinity applying from full message [grp=ignite-sys-cache]" (1 ms) (parent=Affinity recalculation)] [21:10:13] : [Step 4/5] [2021-11-19 21:10:13,305][INFO ][sys-#19912%grid-1%][GridClusterStateProcessor] Successfully performed final activation steps [nodeId=10d4b9db-0d6e-4075-87e3-0df59aff8001, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:10:13] : [Step 4/5] [2021-11-19 21:10:13,313][INFO ][exchange-worker-#19807%grid-0%][PageMemoryImpl] Started page memory [memoryAllocated=24.0 MiB, pages=5952, tableSize=474.2 KiB, replacementSize=768 B, checkpointBuffer=10.0 MiB] [21:10:13] : [Step 4/5] [2021-11-19 21:10:13,313][INFO ][exchange-worker-#19929%grid-1%][PageMemoryImpl] Started page memory [memoryAllocated=24.0 MiB, pages=5952, tableSize=474.2 KiB, replacementSize=768 B, checkpointBuffer=10.0 MiB] [21:10:13] : [Step 4/5] [2021-11-19 21:10:13,309][INFO ][sys-#19788%grid-0%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], stage="Affinity initialization on cache group start [grp=ignite-sys-cache]" (0 ms) (parent=Affinity initialization on cache group start), stage="Affinity centralized initialization (crd) [grp=ignite-sys-cache, crd=true]" (0 ms) (parent=Determine exchange type), stage="Restore partition states [grp=ignite-sys-cache]" (0 ms) (parent=Restore partition states), stage="Affinity recalculation (partitions availability) [grp=ignite-sys-cache]" (0 ms) (parent=Ideal affinity diff calculation (enforced))] [21:10:13] : [Step 4/5] [2021-11-19 21:10:13,390][INFO ][exchange-worker-#19929%grid-1%][GridCacheProcessor] Started cache [name=encrypted, id=1613773252, dataRegionName=default, mode=PARTITIONED, atomicity=ATOMIC, backups=0, mvcc=false] [21:10:13]W: [org.apache.ignite:ignite-core] [2021-11-19 21:10:13,392][WARN ][exchange-worker-#19929%grid-1%][CacheAffinitySharedManager] Cache group 'encrypted' brings high overhead for its metainformation in data region 'default'. Metainformation required for its partitions (522 partitions, 4096 bytes per partition, 2 MBs total) will consume more than 15% of data region memory (10 MBs). It may lead to critical errors on the node and cluster instability. Please reduce number of partitions, add more memory to the data region or add more server nodes for this cache group. [21:10:13] : [Step 4/5] [2021-11-19 21:10:13,393][INFO ][exchange-worker-#19929%grid-1%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], waitTime=0ms, futInfo=NA, mode=DISTRIBUTED] [21:10:13] : [Step 4/5] [2021-11-19 21:10:13,402][INFO ][exchange-worker-#19807%grid-0%][GridCacheProcessor] Started cache [name=encrypted, id=1613773252, dataRegionName=default, mode=PARTITIONED, atomicity=ATOMIC, backups=0, mvcc=false] [21:10:13]W: [org.apache.ignite:ignite-core] [2021-11-19 21:10:13,404][WARN ][exchange-worker-#19807%grid-0%][CacheAffinitySharedManager] Cache group 'encrypted' brings high overhead for its metainformation in data region 'default'. Metainformation required for its partitions (502 partitions, 4096 bytes per partition, 1 MBs total) will consume more than 15% of data region memory (10 MBs). It may lead to critical errors on the node and cluster instability. Please reduce number of partitions, add more memory to the data region or add more server nodes for this cache group. [21:10:13] : [Step 4/5] [2021-11-19 21:10:13,405][INFO ][exchange-worker-#19807%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], waitTime=0ms, futInfo=NA, mode=DISTRIBUTED] [21:10:13] : [Step 4/5] [2021-11-19 21:10:13,405][INFO ][exchange-worker-#19807%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partitions release latch: ServerLatch [permits=0, pendingAcks=HashSet [], super=CompletableLatch [id=CompletableLatchUid [id=exchange, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2]]]] [21:10:13] : [Step 4/5] [2021-11-19 21:10:13,406][INFO ][exchange-worker-#19807%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:10:13] : [Step 4/5] [2021-11-19 21:10:13,406][INFO ][exchange-worker-#19929%grid-1%][GridDhtPartitionsExchangeFuture] Finished waiting for partitions release latch: ClientLatch [coordinator=TcpDiscoveryNode [id=0074303f-63cc-4b9f-ac73-2eafc28d8000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345413130, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], ackSent=true, super=CompletableLatch [id=CompletableLatchUid [id=exchange, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2]]]] [21:10:13] : [Step 4/5] [2021-11-19 21:10:13,407][INFO ][exchange-worker-#19929%grid-1%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:10:13] : [Step 4/5] [2021-11-19 21:10:13,446][INFO ][exchange-worker-#19807%grid-0%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], crd=true] [21:10:13] : [Step 4/5] [2021-11-19 21:10:13,446][INFO ][exchange-worker-#19929%grid-1%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], crd=false] [21:10:13] : [Step 4/5] [2021-11-19 21:10:13,447][INFO ][sys-#19801%grid-0%][GridDhtPartitionsExchangeFuture] Coordinator received single message [ver=AffinityTopologyVersion [topVer=2, minorTopVer=2], node=10d4b9db-0d6e-4075-87e3-0df59aff8001, allReceived=true] [21:10:13] : [Step 4/5] [2021-11-19 21:10:13,447][INFO ][sys-#19801%grid-0%][GridDhtPartitionsExchangeFuture] finishExchangeOnCoordinator [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2]] [21:10:13] : [Step 4/5] [2021-11-19 21:10:13,451][INFO ][sys-#19801%grid-0%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], err=null, rebalanced=true, wasRebalanced=true] [21:10:13] : [Step 4/5] [2021-11-19 21:10:13,452][INFO ][sys-#19899%grid-1%][GridDhtPartitionsExchangeFuture] Received full message, will finish exchange [node=0074303f-63cc-4b9f-ac73-2eafc28d8000, resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2]] [21:10:13] : [Step 4/5] [2021-11-19 21:10:13,453][INFO ][sys-#19801%grid-0%][GridCacheProcessor] Finish proxy initialization, cacheName=encrypted, localNodeId=0074303f-63cc-4b9f-ac73-2eafc28d8000 [21:10:13] : [Step 4/5] [2021-11-19 21:10:13,455][INFO ][sys-#19899%grid-1%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], err=null, rebalanced=true, wasRebalanced=true] [21:10:13] : [Step 4/5] [2021-11-19 21:10:13,455][INFO ][sys-#19801%grid-0%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=0074303f-63cc-4b9f-ac73-2eafc28d8000, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=0074303f-63cc-4b9f-ac73-2eafc28d8000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345413303, loc=true, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2]] [21:10:13] : [Step 4/5] [2021-11-19 21:10:13,455][INFO ][sys-#19899%grid-1%][GridCacheProcessor] Finish proxy initialization, cacheName=encrypted, localNodeId=10d4b9db-0d6e-4075-87e3-0df59aff8001 [21:10:13] : [Step 4/5] [2021-11-19 21:10:13,455][INFO ][exchange-worker-#19807%grid-0%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=2, minorTopVer=2], force=false, evt=DISCOVERY_CUSTOM_EVT, node=0074303f-63cc-4b9f-ac73-2eafc28d8000] [21:10:13] : [Step 4/5] [2021-11-19 21:10:13,457][INFO ][sys-#19899%grid-1%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=10d4b9db-0d6e-4075-87e3-0df59aff8001, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=0074303f-63cc-4b9f-ac73-2eafc28d8000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345413130, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2]] [21:10:13] : [Step 4/5] [2021-11-19 21:10:13,458][INFO ][sys-#19899%grid-1%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (2 ms), stage="Update caches registry" (0 ms), stage="Start caches" (79 ms), stage="Affinity initialization on cache group start" (2 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Wait partitions release latch [latch=exchange]" (13 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Restore partition states" (11 ms), stage="After states restored callback" (26 ms), stage="WAL history reservation" (0 ms), stage="Waiting for Full message" (7 ms), stage="Affinity recalculation" (0 ms), stage="Full map updating" (1 ms), stage="Exchange done" (3 ms), stage="Total time" (144 ms)] [21:10:13] : [Step 4/5] [2021-11-19 21:10:13,460][INFO ][sys-#19899%grid-1%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], stage="Affinity initialization on cache group start [grp=encrypted]" (1 ms) (parent=Affinity initialization on cache group start), stage="Restore partition states [grp=encrypted]" (11 ms) (parent=Restore partition states), stage="Restore partition states [grp=ignite-sys-cache]" (0 ms) (parent=Restore partition states)] [21:10:13] : [Step 4/5] [2021-11-19 21:10:13,457][INFO ][sys-#19801%grid-0%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (4 ms), stage="Update caches registry" (0 ms), stage="Start caches" (89 ms), stage="Affinity initialization on cache group start" (2 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Wait partitions release latch [latch=exchange]" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Restore partition states" (12 ms), stage="After states restored callback" (27 ms), stage="WAL history reservation" (0 ms), stage="Waiting for all single messages" (1 ms), stage="Affinity recalculation (crd)" (0 ms), stage="Collect update counters and create affinity messages" (0 ms), stage="Assign partitions states" (1 ms), stage="Validate partitions states" (0 ms), stage="Apply update counters" (0 ms), stage="Full message preparing" (2 ms), stage="Full message sending" (0 ms), stage="Exchange done" (5 ms), stage="Total time" (143 ms)] [21:10:13] : [Step 4/5] [2021-11-19 21:10:13,457][INFO ][exchange-worker-#19929%grid-1%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=2, minorTopVer=2], force=false, evt=DISCOVERY_CUSTOM_EVT, node=0074303f-63cc-4b9f-ac73-2eafc28d8000] [21:10:13] : [Step 4/5] [2021-11-19 21:10:13,463][INFO ][sys-#19801%grid-0%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], stage="Affinity initialization on cache group start [grp=encrypted]" (1 ms) (parent=Affinity initialization on cache group start), stage="Restore partition states [grp=encrypted]" (12 ms) (parent=Restore partition states), stage="Restore partition states [grp=ignite-sys-cache]" (0 ms) (parent=Restore partition states)] [21:10:15] : [Step 4/5] [2021-11-19 21:10:15,022][INFO ][test-runner-#19691%encryption.MasterKeyChangeTest%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:10:15] : [Step 4/5] [2021-11-19 21:10:15,157][INFO ][disco-notifier-worker-#19920%grid-1%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:10:15] : [Step 4/5] [2021-11-19 21:10:15,157][INFO ][disco-notifier-worker-#19802%grid-0%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:10:15] : [Step 4/5] [2021-11-19 21:10:15,296][INFO ][disco-notifier-worker-#19920%grid-1%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:10:15] : [Step 4/5] [2021-11-19 21:10:15,296][INFO ][disco-notifier-worker-#19802%grid-0%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:10:15] : [Step 4/5] [2021-11-19 21:10:15,381][INFO ][disco-notifier-worker-#19920%grid-1%][IgniteTestResources] Block message [node=0074303f-63cc-4b9f-ac73-2eafc28d8000, order=1, msg=org.apache.ignite.internal.util.distributed.SingleNodeMessage@61ab239] [21:10:15] : [Step 4/5] [2021-11-19 21:10:15,382][INFO ][async-runnable-runner-1][root] >>> Stopping grid [name=grid-1, id=10d4b9db-0d6e-4075-87e3-0df59aff8001] [21:10:15] : [Step 4/5] [2021-11-19 21:10:15,584][INFO ][db-checkpoint-thread-#19940%grid-1%][Checkpointer] Checkpoint started [checkpointId=f29227e5-c438-4e60-8296-1937dc8ff485, startPtr=WALPointer [idx=0, fileOff=640558, len=11871], checkpointBeforeLockTime=4ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=1ms, checkpointLockHoldTime=2ms, walCpRecordFsyncDuration=154ms, writeCheckpointEntryDuration=36ms, splitAndSortCpPagesDuration=1ms, pages=453, reason='timeout'] [21:10:15] : [Step 4/5] [2021-11-19 21:10:15,591][INFO ][tcp-disco-sock-reader-[0074303f 127.0.0.1:50565]-#1045%grid-1%-#19925%grid-1%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:50565, rmtPort=50565, rmtNodeId=0074303f-63cc-4b9f-ac73-2eafc28d8000] [21:10:15] : [Step 4/5] [2021-11-19 21:10:15,593][INFO ][disco-event-worker-#19806%grid-0%][GridDiscoveryManager] Node left topology: TcpDiscoveryNode [id=10d4b9db-0d6e-4075-87e3-0df59aff8001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637345413100, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false] [21:10:15] : [Step 4/5] [2021-11-19 21:10:15,594][INFO ][async-runnable-runner-1][GridCacheProcessor] Stopped cache [cacheName=ignite-sys-cache] [21:10:15] : [Step 4/5] [2021-11-19 21:10:15,595][INFO ][async-runnable-runner-1][GridCacheProcessor] Stopped cache [cacheName=encrypted] [21:10:15] : [Step 4/5] [2021-11-19 21:10:15,595][INFO ][disco-event-worker-#19806%grid-0%][GridDiscoveryManager] Topology snapshot [ver=3, locNode=0074303f, servers=1, clients=0, state=ACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=0074303f-63cc-4b9f-ac73-2eafc28d8000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:10:15] : [Step 4/5] [2021-11-19 21:10:15,596][INFO ][disco-event-worker-#19806%grid-0%][GridDiscoveryManager] ^-- Baseline [id=0, size=2, online=1, offline=1] [21:10:15]W: [org.apache.ignite:ignite-core] [2021-11-19 21:10:15,598][WARN ][grid-nio-worker-tcp-comm-0-#19746%TestRecordingCommunicationSpi%][TestRecordingCommunicationSpi] Failed to shutdown socket [21:10:15]W: [org.apache.ignite:ignite-core] java.nio.channels.ClosedChannelException [21:10:15]W: [org.apache.ignite:ignite-core] at sun.nio.ch.SocketChannelImpl.shutdownOutput(SocketChannelImpl.java:795) [21:10:15]W: [org.apache.ignite:ignite-core] at sun.nio.ch.SocketAdaptor.shutdownOutput(SocketAdaptor.java:407) [21:10:15]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.close(IgniteUtils.java:4247) [21:10:15]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.closeKey(GridNioServer.java:2784) [21:10:15]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.close(GridNioServer.java:2835) [21:10:15]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.close(GridNioServer.java:2794) [21:10:15]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.bodyInternal(GridNioServer.java:2157) [21:10:15]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.body(GridNioServer.java:1910) [21:10:15]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:125) [21:10:15]W: [org.apache.ignite:ignite-core] at java.lang.Thread.run(Thread.java:748) [21:10:15] : [Step 4/5] [2021-11-19 21:10:15,603][INFO ][exchange-worker-#19807%grid-0%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], crd=true, evt=NODE_LEFT, evtNode=10d4b9db-0d6e-4075-87e3-0df59aff8001, customEvt=null, allowMerge=false, exchangeFreeSwitch=true] [21:10:15] : [Step 4/5] [2021-11-19 21:10:15,602][INFO ][disco-notifier-worker-#19802%grid-0%][GridEncryptionManager] Start master key change [masterKeyName=ignite.master.key2] [21:10:15] : [Step 4/5] [2021-11-19 21:10:15,604][INFO ][sys-#19783%grid-0%][GridAffinityAssignmentCache] Local node affinity assignment distribution is not ideal [cache=encrypted, expectedPrimary=1024.00, actualPrimary=502, expectedBackups=0.00, actualBackups=0, warningThreshold=50.00%] [21:10:15] : [Step 4/5] [2021-11-19 21:10:15,605][INFO ][exchange-worker-#19807%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:10:15] : [Step 4/5] [2021-11-19 21:10:15,607][INFO ][exchange-worker-#19807%grid-0%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], err=null, rebalanced=true, wasRebalanced=true] [21:10:15]W: [org.apache.ignite:ignite-core] [2021-11-19 21:10:15,608][WARN ][sys-#19782%grid-0%][GridDhtPartitionTopologyImpl] Detected lost partitions [grp=encrypted, parts=[0, 2, 4, 6-7, 10-11, 14, 17, 21, 24-30, 32, 37, 40, 44, 47-52, 54, 57, 59, 62-64, 67-68, 74-75, 78, 81, 87-88, 91, 97, 99, 101-102, 104-107, 113-114, 116, 118, 120, 122, 124, 135-136, 138, 140-145, 147, 149-152, 154-156, 159-160, 162-164, 169, 172, 175-177, 180, 184-187, 190-191, 194, 196-202, 204-205, 209-210, 212, 214, 216, 219-224, 226, 229-232, 237, 239, 241, 243-245, 247, 249-251, 255, 257, 261, 265, 269, 272-273, 276-277, 281-282, 285, 287, 289-291, 293-297, 299, 301-304, 306, 308-309, 311-312, 315-317, 319, 322, 325-326, 328-330, 336, 339, 341, 344-346, 350, 352-354, 357-361, 363, 366-367, 371-373, 376-380, 383, 385, 387-388, 390, 392, 395-397, 400, 402, 405, 408-411, 416, 420, 422, 424-425, 429, 433, 435-438, 440-441, 445-446, 450, 452-453, 455-456, 458, 460, 462-463, 465-468, 470, 474-475, 480, 488, 490-492, 495, 497, 499-512, 516, 525, 527-531, 535, 537-538, 541-542, 545-546, 548-552, 554-555, 558, 562-564, 567-569, 572, 574, 579-580, 582-585, 587, 590-591, 594, 596, 600, 602, 604, 607-614, 617-620, 623-624, 627-629, 632-633, 636, 638, 640-642, 645-646, 648-649, 657-662, 664-665, 668-672, 677-678, 682-684, 686, 689, 692-693, 695-697, 699, 706-707, 709-710, 712-714, 716-717, 719-721, 723-728, 730-732, 734-735, 739, 742, 746, 749-750, 752, 754, 756, 762, 768-770, 772-775, 778, 780, 783-787, 789-791, 793, 796, 798-801, 803, 806, 809-812, 814, 816-817, 819, 822-825, 827-829, 832-833, 836-837, 839-840, 846, 848-851, 853-854, 857-858, 860, 863-864, 866, 868-871, 873-875, 877-878, 884, 888-889, 896-897, 900, 905-907, 914-915, 917, 919-920, 923-925, 931-933, 936, 940, 942, 944-945, 948, 950-951, 954, 956-958, 962, 965-970, 972, 975-976, 978-980, 983, 985, 988, 990, 993-994, 997-998, 1000, 1003-1004, 1007, 1009, 1014, 1016, 1018-1019], topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0]] [21:10:15] : [Step 4/5] [2021-11-19 21:10:15,613][INFO ][exchange-worker-#19807%grid-0%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=0074303f-63cc-4b9f-ac73-2eafc28d8000, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], evt=NODE_LEFT, evtNode=TcpDiscoveryNode [id=10d4b9db-0d6e-4075-87e3-0df59aff8001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637345413100, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0]] [21:10:15] : [Step 4/5] [2021-11-19 21:10:15,614][INFO ][exchange-worker-#19807%grid-0%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (1 ms), stage="Determine exchange type" (1 ms), stage="Preloading notification" (0 ms), stage="After states restored callback" (0 ms), stage="WAL history reservation" (0 ms), stage="Finalize update counters" (0 ms), stage="Detect lost partitions" (5 ms), stage="Exchange done" (2 ms), stage="Total time" (9 ms)] [21:10:15] : [Step 4/5] [2021-11-19 21:10:15,616][INFO ][exchange-worker-#19807%grid-0%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], stage="Affinity initialization (exchange-free switch on fully-rebalanced topology) [grp=encrypted]" (1 ms) (parent=Determine exchange type), stage="Affinity initialization (exchange-free switch on fully-rebalanced topology) [grp=ignite-sys-cache]" (0 ms) (parent=Determine exchange type)] [21:10:15] : [Step 4/5] [2021-11-19 21:10:15,616][INFO ][exchange-worker-#19807%grid-0%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], crd=true] [21:10:15] : [Step 4/5] [2021-11-19 21:10:15,617][INFO ][exchange-worker-#19807%grid-0%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=3, minorTopVer=0], force=false, evt=NODE_LEFT, node=10d4b9db-0d6e-4075-87e3-0df59aff8001] [21:10:15] : [Step 4/5] [2021-11-19 21:10:15,662][INFO ][disco-notifier-worker-#19802%grid-0%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:10:16] : [Step 4/5] [2021-11-19 21:10:16,063][INFO ][disco-notifier-worker-#19802%grid-0%][GridEncryptionManager] Master key successfully changed [masterKeyName=ignite.master.key2] [21:10:16] : [Step 4/5] [21:10:16] >>> Stopping test: MasterKeyChangeTest#testNodeFailsDuringRotationNotCoordinatorPrepare in 5873 ms <<< [21:10:16] : [Step 4/5] [2021-11-19 21:10:16,065][INFO ][main][root] >>> Stopping test: MasterKeyChangeTest#testNodeFailsDuringRotationNotCoordinatorPrepare in 5873 ms <<< [21:10:16] : [Step 4/5] [21:10:16] >>> Heap: 637 MB used / 1933 MB commited / 1933 MB max <<< [21:10:16] : [Step 4/5] [2021-11-19 21:10:16,065][INFO ][main][root] >>> Heap: 637 MB used / 1933 MB commited / 1933 MB max <<< [21:10:16] : [Step 4/5] [21:10:16] >>> Non-Heap: 155 MB used / 182 MB commited / 0 MB max <<< [21:10:16] : [Step 4/5] [2021-11-19 21:10:16,066][INFO ][main][root] >>> Non-Heap: 155 MB used / 182 MB commited / 0 MB max <<< [21:10:16] : [Step 4/5] [21:10:16] >>> Stopping test class: MasterKeyChangeTest <<< [21:10:16]W: [org.apache.ignite:ignite-core] [2021-11-19 21:10:16,067][WARN ][main][root] Interrupting threads started so far: 1 [21:10:16] : [Step 4/5] [2021-11-19 21:10:16,066][INFO ][main][root] >>> Stopping test class: MasterKeyChangeTest <<< [21:10:16]W: [org.apache.ignite:ignite-core] [2021-11-19 21:10:16,068][ERROR][async-runnable-runner-1][FileWriteAheadLogManager] Failed to gracefully shutdown WAL components, thread was interrupted. [21:10:16]W: [org.apache.ignite:ignite-core] class org.apache.ignite.internal.IgniteInterruptedCheckedException: null [21:10:16]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.join(IgniteUtils.java:8224) [21:10:16]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager$FileArchiver.shutdown(FileWriteAheadLogManager.java:1874) [21:10:16]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager$FileArchiver.access$400(FileWriteAheadLogManager.java:1761) [21:10:16]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager.stop0(FileWriteAheadLogManager.java:698) [21:10:16]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.GridCacheSharedManagerAdapter.stop(GridCacheSharedManagerAdapter.java:109) [21:10:16]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.GridCacheProcessor.stop(GridCacheProcessor.java:784) [21:10:16]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.IgniteKernal.stop0(IgniteKernal.java:2616) [21:10:16]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.IgniteKernal.stop(IgniteKernal.java:2494) [21:10:16]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.IgnitionEx$IgniteNamedInstance.stop0(IgnitionEx.java:2379) [21:10:16]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.IgnitionEx$IgniteNamedInstance.stop(IgnitionEx.java:2202) [21:10:16]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.IgnitionEx.stop(IgnitionEx.java:349) [21:10:16]W: [org.apache.ignite:ignite-core] at org.apache.ignite.testframework.junits.GridAbstractTest.stopGrid0(GridAbstractTest.java:1517) [21:10:16]W: [org.apache.ignite:ignite-core] at org.apache.ignite.testframework.junits.GridAbstractTest.stopGrid(GridAbstractTest.java:1485) [21:10:16]W: [org.apache.ignite:ignite-core] at org.apache.ignite.testframework.junits.GridAbstractTest.stopGrid(GridAbstractTest.java:1475) [21:10:16]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.encryption.MasterKeyChangeTest.lambda$checkNodeFailsDuringRotation$8(MasterKeyChangeTest.java:416) [21:10:16]W: [org.apache.ignite:ignite-core] at org.apache.ignite.testframework.GridTestUtils.lambda$runAsync$2(GridTestUtils.java:1135) [21:10:16]W: [org.apache.ignite:ignite-core] at org.apache.ignite.testframework.GridTestUtils.lambda$runAsync$3(GridTestUtils.java:1191) [21:10:16]W: [org.apache.ignite:ignite-core] at org.apache.ignite.testframework.GridTestUtils$7.call(GridTestUtils.java:1512) [21:10:16]W: [org.apache.ignite:ignite-core] at org.apache.ignite.testframework.GridTestThread.run(GridTestThread.java:88) [21:10:16]W: [org.apache.ignite:ignite-core] Caused by: java.lang.InterruptedException [21:10:16]W: [org.apache.ignite:ignite-core] at java.lang.Object.wait(Native Method) [21:10:16]W: [org.apache.ignite:ignite-core] at java.lang.Thread.join(Thread.java:1252) [21:10:16]W: [org.apache.ignite:ignite-core] at java.lang.Thread.join(Thread.java:1326) [21:10:16]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.join(IgniteUtils.java:8219) [21:10:16]W: [org.apache.ignite:ignite-core] ... 18 more [21:10:18] : [Step 4/5] [2021-11-19 21:10:18,695][INFO ][async-runnable-runner-1][FilePageStoreManager] Cleanup cache stores [total=4, left=0, cleanFiles=false] [21:10:18]W: [org.apache.ignite:ignite-core] [2021-11-19 21:10:18,699][ERROR][async-runnable-runner-1][IgniteKernal%grid-1] Failed to stop component (ignoring): GridProcessorAdapter [] [21:10:18]W: [org.apache.ignite:ignite-core] class org.apache.ignite.IgniteInterruptedException: null [21:10:18]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.diagnostic.pagelocktracker.SharedPageLockTracker.stop(SharedPageLockTracker.java:316) [21:10:18]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.diagnostic.pagelocktracker.PageLockTrackerManager.stop(PageLockTrackerManager.java:262) [21:10:18]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.CacheDiagnosticManager.stop0(CacheDiagnosticManager.java:62) [21:10:18]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.GridCacheSharedManagerAdapter.stop(GridCacheSharedManagerAdapter.java:109) [21:10:18]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.GridCacheProcessor.stop(GridCacheProcessor.java:784) [21:10:18]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.IgniteKernal.stop0(IgniteKernal.java:2616) [21:10:18]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.IgniteKernal.stop(IgniteKernal.java:2494) [21:10:18]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.IgnitionEx$IgniteNamedInstance.stop0(IgnitionEx.java:2379) [21:10:18]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.IgnitionEx$IgniteNamedInstance.stop(IgnitionEx.java:2202) [21:10:18]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.IgnitionEx.stop(IgnitionEx.java:349) [21:10:18]W: [org.apache.ignite:ignite-core] at org.apache.ignite.testframework.junits.GridAbstractTest.stopGrid0(GridAbstractTest.java:1517) [21:10:18]W: [org.apache.ignite:ignite-core] at org.apache.ignite.testframework.junits.GridAbstractTest.stopGrid(GridAbstractTest.java:1485) [21:10:18]W: [org.apache.ignite:ignite-core] at org.apache.ignite.testframework.junits.GridAbstractTest.stopGrid(GridAbstractTest.java:1475) [21:10:18]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.encryption.MasterKeyChangeTest.lambda$checkNodeFailsDuringRotation$8(MasterKeyChangeTest.java:416) [21:10:18]W: [org.apache.ignite:ignite-core] at org.apache.ignite.testframework.GridTestUtils.lambda$runAsync$2(GridTestUtils.java:1135) [21:10:18]W: [org.apache.ignite:ignite-core] at org.apache.ignite.testframework.GridTestUtils.lambda$runAsync$3(GridTestUtils.java:1191) [21:10:18]W: [org.apache.ignite:ignite-core] at org.apache.ignite.testframework.GridTestUtils$7.call(GridTestUtils.java:1512) [21:10:18]W: [org.apache.ignite:ignite-core] at org.apache.ignite.testframework.GridTestThread.run(GridTestThread.java:88) [21:10:18]W: [org.apache.ignite:ignite-core] Caused by: java.lang.InterruptedException [21:10:18]W: [org.apache.ignite:ignite-core] at java.lang.Object.wait(Native Method) [21:10:18]W: [org.apache.ignite:ignite-core] at java.lang.Thread.join(Thread.java:1252) [21:10:18]W: [org.apache.ignite:ignite-core] at java.lang.Thread.join(Thread.java:1326) [21:10:18]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.diagnostic.pagelocktracker.SharedPageLockTracker.stop(SharedPageLockTracker.java:311) [21:10:18]W: [org.apache.ignite:ignite-core] ... 17 more [21:10:18] : [Step 4/5] [2021-11-19 21:10:18,703][INFO ][async-runnable-runner-1][GridDeploymentLocalStore] Removed undeployed class: GridDeployment [ts=1637345413283, depMode=SHARED, clsLdr=IsolatedClassLoader{roleName='test'}, clsLdrId=24a7d593d71-10d4b9db-0d6e-4075-87e3-0df59aff8001, userVer=0, loc=true, sampleClsName=org.apache.ignite.internal.processors.cache.distributed.dht.preloader.IgniteDhtPartitionHistorySuppliersMap, pendingUndeploy=false, undeployed=true, usage=0] [21:10:18]W: [org.apache.ignite:ignite-core] [2021-11-19 21:10:18,704][WARN ][async-runnable-runner-1][SharedFsCheckpointSpi] Got interrupted while waiting for completion of a thread: SharedFsTimeoutTask [marshaller=JdkMarshaller [clsFilter=null], lsnr=o.a.i.i.managers.checkpoint.GridCheckpointManager$1@2f18cba6] [21:10:18]W: [org.apache.ignite:ignite-core] [2021-11-19 21:10:18,705][WARN ][async-runnable-runner-1][TestRecordingCommunicationSpi] Got interrupted while waiting for completion of runnable: GridWorker [name=nio-acceptor-tcp-comm, igniteInstanceName=TestRecordingCommunicationSpi, finished=false, heartbeatTs=1637345418697, hashCode=1896001902, interrupted=true, runner=nio-acceptor-tcp-comm-#19876%TestRecordingCommunicationSpi%] [21:10:18]W: [org.apache.ignite:ignite-core] [2021-11-19 21:10:18,706][WARN ][async-runnable-runner-1][TestRecordingCommunicationSpi] Got interrupted while waiting for completion of runnable: DirectNioClientWorker [super=AbstractNioClientWorker [idx=0, bytesRcvd=14555, bytesSent=6155, bytesRcvd0=8164, bytesSent0=3545, select=false, super=GridWorker [name=grid-nio-worker-tcp-comm-0, igniteInstanceName=TestRecordingCommunicationSpi, finished=true, heartbeatTs=1637345418697, hashCode=1337910648, interrupted=true, runner=grid-nio-worker-tcp-comm-0-#19864%TestRecordingCommunicationSpi%]]] [21:10:18]W: [org.apache.ignite:ignite-core] [2021-11-19 21:10:18,707][WARN ][async-runnable-runner-1][TestRecordingCommunicationSpi] Got interrupted while waiting for completion of runnable: GridWorker [name=tcp-comm-worker, igniteInstanceName=grid-1, finished=false, heartbeatTs=1637345418697, hashCode=103748100, interrupted=false, runner=tcp-comm-worker-#1039%grid-1%-#19877%grid-1%] [21:10:18]W: [org.apache.ignite:ignite-core] [2021-11-19 21:10:18,708][ERROR][async-runnable-runner-1][IgniteKernal%grid-1] Failed to stop component (ignoring): GridProcessorAdapter [] [21:10:18]W: [org.apache.ignite:ignite-core] class org.apache.ignite.internal.IgniteInterruptedCheckedException: null [21:10:18]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.join(IgniteUtils.java:8180) [21:10:18]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.timeout.GridTimeoutProcessor.stop(GridTimeoutProcessor.java:87) [21:10:18]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.IgniteKernal.stop0(IgniteKernal.java:2616) [21:10:18]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.IgniteKernal.stop(IgniteKernal.java:2494) [21:10:18]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.IgnitionEx$IgniteNamedInstance.stop0(IgnitionEx.java:2379) [21:10:18]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.IgnitionEx$IgniteNamedInstance.stop(IgnitionEx.java:2202) [21:10:18]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.IgnitionEx.stop(IgnitionEx.java:349) [21:10:18]W: [org.apache.ignite:ignite-core] at org.apache.ignite.testframework.junits.GridAbstractTest.stopGrid0(GridAbstractTest.java:1517) [21:10:18]W: [org.apache.ignite:ignite-core] at org.apache.ignite.testframework.junits.GridAbstractTest.stopGrid(GridAbstractTest.java:1485) [21:10:18]W: [org.apache.ignite:ignite-core] at org.apache.ignite.testframework.junits.GridAbstractTest.stopGrid(GridAbstractTest.java:1475) [21:10:18]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.encryption.MasterKeyChangeTest.lambda$checkNodeFailsDuringRotation$8(MasterKeyChangeTest.java:416) [21:10:18]W: [org.apache.ignite:ignite-core] at org.apache.ignite.testframework.GridTestUtils.lambda$runAsync$2(GridTestUtils.java:1135) [21:10:18]W: [org.apache.ignite:ignite-core] at org.apache.ignite.testframework.GridTestUtils.lambda$runAsync$3(GridTestUtils.java:1191) [21:10:18]W: [org.apache.ignite:ignite-core] at org.apache.ignite.testframework.GridTestUtils$7.call(GridTestUtils.java:1512) [21:10:18]W: [org.apache.ignite:ignite-core] at org.apache.ignite.testframework.GridTestThread.run(GridTestThread.java:88) [21:10:18]W: [org.apache.ignite:ignite-core] Caused by: java.lang.InterruptedException [21:10:18]W: [org.apache.ignite:ignite-core] at java.lang.Object.wait(Native Method) [21:10:18]W: [org.apache.ignite:ignite-core] at java.lang.Object.wait(Object.java:502) [21:10:18]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.worker.GridWorker.join(GridWorker.java:249) [21:10:18]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.join(IgniteUtils.java:8175) [21:10:18]W: [org.apache.ignite:ignite-core] ... 14 more [21:10:18] : [Step 4/5] [2021-11-19 21:10:18,715][INFO ][async-runnable-runner-1][IgniteKernal%grid-1] [21:10:18] : [Step 4/5] [21:10:18] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV stopped with ERRORS [21:10:18] : [Step 4/5] >>> +---------------------------------------------------------------+ [21:10:18] : [Step 4/5] >>> Ignite instance name: grid-1 [21:10:18] : [Step 4/5] >>> Grid uptime: 00:00:05.496 [21:10:18] : [Step 4/5] >>> See log above for detailed error message. [21:10:18] : [Step 4/5] >>> Note that some errors during stop can prevent grid from [21:10:18] : [Step 4/5] >>> maintaining correct topology since this node may have [21:10:18] : [Step 4/5] >>> not exited grid properly. [21:10:18] : [Step 4/5] [21:10:18] : [Step 4/5] [21:10:18]W: [org.apache.ignite:ignite-core] [2021-11-19 21:10:18,717][ERROR][main][root] Finished interrupting threads, but some threads are still alive [size=1, threads=[Thread[async-runnable-runner-1,5,]]] [21:10:18] : [Step 4/5] [2021-11-19 21:10:18,717][INFO ][main][root] >>> Stopping grid [name=grid-0, id=0074303f-63cc-4b9f-ac73-2eafc28d8000] [21:10:18] : [Step 4/5] [2021-11-19 21:10:18,764][INFO ][db-checkpoint-thread-#19938%grid-0%][Checkpointer] Checkpoint started [checkpointId=878710ae-f389-4f91-9af2-14002ec85c15, startPtr=WALPointer [idx=0, fileOff=750068, len=11491], checkpointBeforeLockTime=4ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=4ms, walCpRecordFsyncDuration=4ms, writeCheckpointEntryDuration=28ms, splitAndSortCpPagesDuration=0ms, pages=572, reason='timeout'] [21:10:18] : [Step 4/5] [2021-11-19 21:10:18,769][INFO ][tcp-disco-sock-reader-[10d4b9db 127.0.0.1:53861]-#1046%grid-0%-#19926%grid-0%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:53861, rmtPort=53861, rmtNodeId=10d4b9db-0d6e-4075-87e3-0df59aff8001] [21:10:18] : [Step 4/5] [2021-11-19 21:10:18,770][INFO ][main][GridCacheProcessor] Stopped cache [cacheName=ignite-sys-cache] [21:10:18] : [Step 4/5] [2021-11-19 21:10:18,771][INFO ][main][GridCacheProcessor] Stopped cache [cacheName=encrypted] [21:10:19] : [Step 4/5] [2021-11-19 21:10:19,334][INFO ][main][FilePageStoreManager] Cleanup cache stores [total=4, left=0, cleanFiles=false] [21:10:19] : [Step 4/5] [2021-11-19 21:10:19,336][INFO ][main][GridDeploymentLocalStore] Removed undeployed class: GridDeployment [ts=1637345413273, depMode=SHARED, clsLdr=IsolatedClassLoader{roleName='test'}, clsLdrId=f3a7d593d71-0074303f-63cc-4b9f-ac73-2eafc28d8000, userVer=0, loc=true, sampleClsName=org.apache.ignite.internal.processors.cache.distributed.dht.preloader.GridDhtPartitionMap, pendingUndeploy=false, undeployed=true, usage=0] [21:10:19] : [Step 4/5] [2021-11-19 21:10:19,342][INFO ][main][IgniteKernal%grid-0] [21:10:19] : [Step 4/5] [21:10:19] : [Step 4/5] >>> +------------------------------------------------------+ [21:10:19] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV stopped OK [21:10:19] : [Step 4/5] >>> +------------------------------------------------------+ [21:10:19] : [Step 4/5] >>> Ignite instance name: grid-0 [21:10:19] : [Step 4/5] >>> Grid uptime: 00:00:07.296 [21:10:19] : [Step 4/5] [21:10:19] : [Step 4/5] [21:10:19] : [Step 4/5] [21:10:19] >>> Starting test class: MasterKeyChangeConsistencyCheckTest <<< [21:10:19] : [Step 4/5] [2021-11-19 21:10:19,344][INFO ][main][root] >>> Starting test class: MasterKeyChangeConsistencyCheckTest <<< [21:10:19] : [Step 4/5] Running org.apache.ignite.internal.encryption.MasterKeyChangeConsistencyCheckTest [21:10:19]i: [Step 4/5] ##teamcity[importData type='surefire' path='/opt/buildagent/temp/buildTmp/ignite-tools-junit-reports1777670380320881607/test-org.apache.ignite.testsuites.IgniteBasicWithPersistenceTestSuite1637345285864.xml'] [21:10:19] : [Step 4/5] Importing data from '/opt/buildagent/temp/buildTmp/ignite-tools-junit-reports1777670380320881607/test-org.apache.ignite.testsuites.IgniteBasicWithPersistenceTestSuite1637345285864.xml' (1.82 KB) with 'surefire' processor [21:10:19] : [Step 4/5] [21:10:19] >>> Starting test: MasterKeyChangeConsistencyCheckTest#testRejectMasterKeyChangeWithKeyConsistencyProblems <<< [21:10:19] : [Step 4/5] [2021-11-19 21:10:19,581][INFO ][main][root] >>> Starting test: MasterKeyChangeConsistencyCheckTest#testRejectMasterKeyChangeWithKeyConsistencyProblems <<< [21:10:19] : [Step 4/5] [21:10:19] >>> Heap: 643 MB used / 1933 MB commited / 1933 MB max <<< [21:10:19] : [Step 4/5] [2021-11-19 21:10:19,581][INFO ][main][root] >>> Heap: 643 MB used / 1933 MB commited / 1933 MB max <<< [21:10:19] : [Step 4/5] [21:10:19] >>> Non-Heap: 155 MB used / 182 MB commited / 0 MB max <<< [21:10:19] : [Step 4/5] [2021-11-19 21:10:19,582][INFO ][main][root] >>> Non-Heap: 155 MB used / 182 MB commited / 0 MB max <<< [21:10:19]W: [org.apache.ignite:ignite-core] [2021-11-19 21:10:19,596][WARN ][test-runner-#19961%encryption.MasterKeyChangeConsistencyCheckTest%][G] Ignite work directory is not provided, automatically resolved to: /opt/buildagent/work/7bc1c54bc719b67c/work [21:10:19] : [Step 4/5] [2021-11-19 21:10:19,598][INFO ][test-runner-#19961%encryption.MasterKeyChangeConsistencyCheckTest%][IgniteKernal%grid-0] [21:10:19] : [Step 4/5] [21:10:19] : [Step 4/5] >>> __________ ________________ [21:10:19] : [Step 4/5] >>> / _/ ___/ |/ / _/_ __/ __/ [21:10:19] : [Step 4/5] >>> _/ // (7 7 // / / / / _/ [21:10:19] : [Step 4/5] >>> /___/\___/_/|_/___/ /_/ /___/ [21:10:19] : [Step 4/5] >>> [21:10:19] : [Step 4/5] >>> ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:10:19] : [Step 4/5] >>> 2021 Copyright(C) Apache Software Foundation [21:10:19] : [Step 4/5] >>> [21:10:19] : [Step 4/5] >>> Ignite documentation: http://ignite.apache.org [21:10:19] : [Step 4/5] [21:10:19] : [Step 4/5] [2021-11-19 21:10:19,598][INFO ][test-runner-#19961%encryption.MasterKeyChangeConsistencyCheckTest%][IgniteKernal%grid-0] Config URL: n/a [21:10:19] : [Step 4/5] [2021-11-19 21:10:19,599][INFO ][test-runner-#19961%encryption.MasterKeyChangeConsistencyCheckTest%][IgniteKernal%grid-0] IgniteConfiguration [igniteInstanceName=grid-0, pubPoolSize=24, svcPoolSize=24, callbackPoolSize=24, stripedPoolSize=24, sysPoolSize=24, mgmtPoolSize=4, dataStreamerPoolSize=24, utilityCachePoolSize=24, utilityCacheKeepAliveTime=60000, p2pPoolSize=2, qryPoolSize=24, buildIdxPoolSize=4, igniteHome=/opt/buildagent/work/7bc1c54bc719b67c, igniteWorkDir=/opt/buildagent/work/7bc1c54bc719b67c/work, mbeanSrv=com.sun.jmx.mbeanserver.JmxMBeanServer@6fe85038, nodeId=0008e4b0-ddf1-4d07-ad27-2aa410fed000, marsh=BinaryMarshaller [], marshLocJobs=false, daemon=false, p2pEnabled=true, netTimeout=10000, netCompressionLevel=1, sndRetryDelay=1000, sndRetryCnt=3, metricsHistSize=10000, metricsUpdateFreq=1000, metricsExpTime=9223372036854775807, discoSpi=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=0, ackTimeout=0, marsh=null, reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], segPlc=STOP, segResolveAttempts=2, waitForSegOnStart=true, allResolversPassReq=true, segChkFreq=10000, commSpi=TcpCommunicationSpi [connectGate=org.apache.ignite.spi.communication.tcp.internal.ConnectGateway@7b71ab9e, ctxInitLatch=java.util.concurrent.CountDownLatch@3afa5386[Count = 1], stopping=false, clientPool=null, nioSrvWrapper=null, stateProvider=null], evtSpi=MemoryEventStorageSpi [expireAgeMs=9223372036854775807, expireCnt=10000, filter=null], colSpi=NoopCollisionSpi [], deploySpi=LocalDeploymentSpi [], indexingSpi=org.apache.ignite.spi.indexing.noop.NoopIndexingSpi@de959d6, addrRslvr=null, encryptionSpi=org.apache.ignite.internal.encryption.MasterKeyChangeConsistencyCheckTest$TestKeystoreEncryptionSpi@1b4aad01, tracingSpi=org.apache.ignite.spi.tracing.NoopTracingSpi@69a5ff99, clientMode=false, rebalanceThreadPoolSize=4, rebalanceTimeout=10000, rebalanceBatchesPrefetchCnt=3, rebalanceThrottle=0, rebalanceBatchSize=524288, txCfg=TransactionConfiguration [txSerEnabled=false, dfltIsolation=REPEATABLE_READ, dfltConcurrency=PESSIMISTIC, dfltTxTimeout=0, txTimeoutOnPartitionMapExchange=0, deadlockTimeout=10000, pessimisticTxLogSize=0, pessimisticTxLogLinger=10000, tmLookupClsName=null, txManagerFactory=null, useJtaSync=false], cacheSanityCheckEnabled=true, discoStartupDelay=60000, deployMode=SHARED, p2pMissedCacheSize=100, locHost=127.0.0.1, timeSrvPortBase=31100, timeSrvPortRange=100, failureDetectionTimeout=10000, sysWorkerBlockedTimeout=null, clientFailureDetectionTimeout=10000, metricsLogFreq=0, connectorCfg=null, odbcCfg=null, warmupClos=null, atomicCfg=AtomicConfiguration [seqReserveSize=1000, cacheMode=PARTITIONED, backups=1, aff=null, grpName=null], classLdr=null, sslCtxFactory=null, platformCfg=null, binaryCfg=null, memCfg=null, pstCfg=null, dsCfg=DataStorageConfiguration [sysRegionInitSize=41943040, sysRegionMaxSize=104857600, pageSize=4096, concLvl=0, dfltDataRegConf=DataRegionConfiguration [name=default, maxSize=10485760, initSize=268435456, swapPath=null, pageEvictionMode=DISABLED, pageReplacementMode=CLOCK, evictionThreshold=0.9, emptyPagesPoolSize=100, metricsEnabled=false, metricsSubIntervalCount=5, metricsRateTimeInterval=60000, persistenceEnabled=true, checkpointPageBufSize=0, lazyMemoryAllocation=true, warmUpCfg=null], dataRegions=null, storagePath=null, checkpointFreq=180000, lockWaitTime=10000, checkpointThreads=4, checkpointWriteOrder=SEQUENTIAL, walHistSize=20, maxWalArchiveSize=1073741824, walSegments=10, walSegmentSize=67108864, walPath=db/wal, walArchivePath=db/wal/archive, cdcWalPath=db/wal/cdc, cdcEnabled=false, metricsEnabled=false, walMode=FSYNC, walTlbSize=131072, walBuffSize=0, walFlushFreq=2000, walFsyncDelay=1000, walRecordIterBuffSize=67108864, alwaysWriteFullPages=false, fileIOFactory=org.apache.ignite.internal.processors.cache.persistence.file.AsyncFileIOFactory@2caed060, metricsSubIntervalCnt=5, metricsRateTimeInterval=60000, walAutoArchiveAfterInactivity=-1, walForceArchiveTimeout=-1, writeThrottlingEnabled=false, walCompactionEnabled=false, walCompactionLevel=1, checkpointReadLockTimeout=null, walPageCompression=DISABLED, walPageCompressionLevel=null, dfltWarmUpCfg=null, encCfg=org.apache.ignite.configuration.EncryptionConfiguration@504cf5d, defragmentationThreadPoolSize=4, minWalArchiveSize=-1], snapshotPath=snapshots, activeOnStart=true, activeOnStartPropSetFlag=false, autoActivation=true, autoActivationPropSetFlag=false, clusterStateOnStart=null, sqlConnCfg=null, cliConnCfg=ClientConnectorConfiguration [host=null, port=10800, portRange=100, sockSndBufSize=0, sockRcvBufSize=0, tcpNoDelay=true, maxOpenCursorsPerConn=128, threadPoolSize=24, selectorCnt=12, idleTimeout=0, handshakeTimeout=10000, jdbcEnabled=true, odbcEnabled=true, thinCliEnabled=true, sslEnabled=false, useIgniteSslCtxFactory=true, sslClientAuth=false, sslCtxFactory=null, thinCliCfg=ThinClientConfiguration [maxActiveTxPerConn=100, maxActiveComputeTasksPerConn=0]], mvccVacuumThreadCnt=2, mvccVacuumFreq=5000, authEnabled=false, failureHnd=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]], commFailureRslvr=null, sqlCfg=SqlConfiguration [longQryWarnTimeout=3000, dfltQryTimeout=0, sqlQryHistSize=1000, validationEnabled=false], asyncContinuationExecutor=null] [21:10:19] : [Step 4/5] [2021-11-19 21:10:19,606][INFO ][test-runner-#19961%encryption.MasterKeyChangeConsistencyCheckTest%][IgniteKernal%grid-0] Daemon mode: off [21:10:19] : [Step 4/5] [2021-11-19 21:10:19,606][INFO ][test-runner-#19961%encryption.MasterKeyChangeConsistencyCheckTest%][IgniteKernal%grid-0] OS: Linux 4.15.0-151-generic amd64 [21:10:19] : [Step 4/5] [2021-11-19 21:10:19,606][INFO ][test-runner-#19961%encryption.MasterKeyChangeConsistencyCheckTest%][IgniteKernal%grid-0] OS user: teamcity [21:10:19] : [Step 4/5] [2021-11-19 21:10:19,606][INFO ][test-runner-#19961%encryption.MasterKeyChangeConsistencyCheckTest%][IgniteKernal%grid-0] PID: 16724 [21:10:19] : [Step 4/5] [2021-11-19 21:10:19,607][INFO ][test-runner-#19961%encryption.MasterKeyChangeConsistencyCheckTest%][IgniteKernal%grid-0] Language runtime: Java Platform API Specification ver. 1.8 [21:10:19] : [Step 4/5] [2021-11-19 21:10:19,607][INFO ][test-runner-#19961%encryption.MasterKeyChangeConsistencyCheckTest%][IgniteKernal%grid-0] VM information: Java(TM) SE Runtime Environment 1.8.0_261-b12 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 25.261-b12 [21:10:19] : [Step 4/5] [2021-11-19 21:10:19,608][INFO ][test-runner-#19961%encryption.MasterKeyChangeConsistencyCheckTest%][IgniteKernal%grid-0] VM total memory: 1.9GB [21:10:19] : [Step 4/5] [2021-11-19 21:10:19,608][INFO ][test-runner-#19961%encryption.MasterKeyChangeConsistencyCheckTest%][IgniteKernal%grid-0] Remote Management [restart: off, REST: off, JMX (remote: off)] [21:10:19] : [Step 4/5] [2021-11-19 21:10:19,608][INFO ][test-runner-#19961%encryption.MasterKeyChangeConsistencyCheckTest%][IgniteKernal%grid-0] Logger: GridTestLog4jLogger [quiet=false, config=null] [21:10:19] : [Step 4/5] [2021-11-19 21:10:19,609][INFO ][test-runner-#19961%encryption.MasterKeyChangeConsistencyCheckTest%][IgniteKernal%grid-0] IGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c [21:10:19] : [Step 4/5] [2021-11-19 21:10:19,609][INFO ][test-runner-#19961%encryption.MasterKeyChangeConsistencyCheckTest%][IgniteKernal%grid-0] VM arguments: [-DIGNITE_DUMP_THREADS_ON_FAILURE=false, -DMono=/usr/bin/mono-sgen, -DMono4.0_x64=/usr/lib/mono/4.0, -DMono4.5_x64=/usr/lib/mono/4.5, -DMonoVersion=6.12.0.90, -DSKIP_BUILD=false, -Dagent.home.dir=/opt/buildagent, -Dagent.name=aitc-lin02_03, -Dagent.ownPort=9090, -Dagent.work.dir=/opt/buildagent/work, -Dbuild.number=95, -Dbuild.vcs.number=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.1=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.GitHubApacheIgnite=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dclassworlds.conf=/opt/buildagent/temp/buildTmp/teamcity.m2.conf, -Dcom.jetbrains.maven.watcher.report.file=/opt/buildagent/temp/buildTmp/maven-build-info.xml, -Djava.io.tmpdir=/opt/buildagent/temp/buildTmp, -Dmaven.home=/opt/buildagent/tools/maven3_6, -Dmaven.multiModuleProjectDirectory=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.agent.cpuBenchmark=457, -Dteamcity.agent.dotnet.agent_url=http://localhost:9090/RPC2, -Dteamcity.agent.dotnet.build_id=6278078, -Dteamcity.auth.password=*******, -Dteamcity.auth.userId=TeamCityBuildId=6278078, -Dteamcity.build.changedFiles.file=/opt/buildagent/temp/buildTmp/changedFiles6342607772318147725.txt, -Dteamcity.build.checkoutDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.build.id=6278078, -Dteamcity.build.properties.file=/opt/buildagent/temp/buildTmp/teamcity.build5164517880467851002.properties, -Dteamcity.build.tempDir=/opt/buildagent/temp/buildTmp, -Dteamcity.build.workingDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.buildConfName=Basic 3, -Dteamcity.buildType.id=IgniteTests24Java8_Basic3, -Dteamcity.configuration.properties.file=/opt/buildagent/temp/buildTmp/teamcity.config5591980786735343870.properties, -Dteamcity.maven.userSettings.path=/opt/buildagent/temp/buildTmp/maven_settings_585072866407032347.xml, -Dteamcity.maven.watcher.home=/opt/buildagent/plugins/mavenPlugin/maven-watcher-jdk16, -Dteamcity.projectName=Ignite Tests 2.x (JDK 8/11), -Dteamcity.runner.properties.file=/opt/buildagent/temp/buildTmp/teamcity.runner9098465561618137420.properties, -Dteamcity.tests.recentlyFailedTests.file=/opt/buildagent/temp/buildTmp/testsToRunFirst3891775683130404069.txt, -Dteamcity.version=2021.2 (build 99542), -ea, -Xms2g, -Xmx2g, -XX:+HeapDumpOnOutOfMemoryError, -DIGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_TEST_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_UPDATE_NOTIFIER=false, -DIGNITE_NO_DISCO_ORDER=true, -DIGNITE_PERFORMANCE_SUGGESTIONS_DISABLED=true, -Djava.net.preferIPv4Stack=true, -DTEST_SCALE_FACTOR=1.0, -DIGNITE_TEST_PROP_LOG4J_FILE=log4j-tc-test.xml, -DIGNITE_QUIET=false, -DIGNITE_MARSHAL_BUFFERS_RECHECK=1000, -Dmaven.repo.local=/opt/buildagent/.m2/repository] [21:10:19] : [Step 4/5] [2021-11-19 21:10:19,615][INFO ][test-runner-#19961%encryption.MasterKeyChangeConsistencyCheckTest%][IgniteKernal%grid-0] System cache's DataRegion size is configured to 40 MB. Use DataStorageConfiguration.systemRegionInitialSize property to change the setting. [21:10:19] : [Step 4/5] [2021-11-19 21:10:19,616][INFO ][test-runner-#19961%encryption.MasterKeyChangeConsistencyCheckTest%][IgniteKernal%grid-0] Configured caches [in 'sysMemPlc' dataRegion: ['ignite-sys-cache']] [21:10:19]W: [org.apache.ignite:ignite-core] [2021-11-19 21:10:19,616][WARN ][test-runner-#19961%encryption.MasterKeyChangeConsistencyCheckTest%][IgniteKernal%grid-0] Peer class loading is enabled (disable it in production for performance and deployment consistency reasons) [21:10:19] : [Step 4/5] [2021-11-19 21:10:19,617][INFO ][test-runner-#19961%encryption.MasterKeyChangeConsistencyCheckTest%][IgniteKernal%grid-0] 3-rd party licenses can be found at: /opt/buildagent/work/7bc1c54bc719b67c/libs/licenses [21:10:19] : [Step 4/5] [2021-11-19 21:10:19,622][INFO ][test-runner-#19961%encryption.MasterKeyChangeConsistencyCheckTest%][IgnitePluginProcessor] Configured plugins: [21:10:19] : [Step 4/5] [2021-11-19 21:10:19,622][INFO ][test-runner-#19961%encryption.MasterKeyChangeConsistencyCheckTest%][IgnitePluginProcessor] ^-- StanByClusterTestProvider 1.0 [21:10:19] : [Step 4/5] [2021-11-19 21:10:19,623][INFO ][test-runner-#19961%encryption.MasterKeyChangeConsistencyCheckTest%][IgnitePluginProcessor] ^-- null [21:10:19] : [Step 4/5] [2021-11-19 21:10:19,623][INFO ][test-runner-#19961%encryption.MasterKeyChangeConsistencyCheckTest%][IgnitePluginProcessor] [21:10:19] : [Step 4/5] [2021-11-19 21:10:19,623][INFO ][test-runner-#19961%encryption.MasterKeyChangeConsistencyCheckTest%][IgnitePluginProcessor] ^-- PageMemory tracker plugin 1.0 [21:10:19] : [Step 4/5] [2021-11-19 21:10:19,624][INFO ][test-runner-#19961%encryption.MasterKeyChangeConsistencyCheckTest%][IgnitePluginProcessor] ^-- null [21:10:19] : [Step 4/5] [2021-11-19 21:10:19,624][INFO ][test-runner-#19961%encryption.MasterKeyChangeConsistencyCheckTest%][IgnitePluginProcessor] [21:10:19] : [Step 4/5] [2021-11-19 21:10:19,624][INFO ][test-runner-#19961%encryption.MasterKeyChangeConsistencyCheckTest%][IgnitePluginProcessor] ^-- TestDistibutedConfigurationPlugin 1.0 [21:10:19] : [Step 4/5] [2021-11-19 21:10:19,624][INFO ][test-runner-#19961%encryption.MasterKeyChangeConsistencyCheckTest%][IgnitePluginProcessor] ^-- null [21:10:19] : [Step 4/5] [2021-11-19 21:10:19,625][INFO ][test-runner-#19961%encryption.MasterKeyChangeConsistencyCheckTest%][IgnitePluginProcessor] [21:10:19] : [Step 4/5] [2021-11-19 21:10:19,625][INFO ][test-runner-#19961%encryption.MasterKeyChangeConsistencyCheckTest%][IgnitePluginProcessor] ^-- NodeValidationPluginProvider 1.0 [21:10:19] : [Step 4/5] [2021-11-19 21:10:19,625][INFO ][test-runner-#19961%encryption.MasterKeyChangeConsistencyCheckTest%][IgnitePluginProcessor] ^-- null [21:10:19] : [Step 4/5] [2021-11-19 21:10:19,626][INFO ][test-runner-#19961%encryption.MasterKeyChangeConsistencyCheckTest%][IgnitePluginProcessor] [21:10:19] : [Step 4/5] [2021-11-19 21:10:19,626][INFO ][test-runner-#19961%encryption.MasterKeyChangeConsistencyCheckTest%][FailureProcessor] Configured failure handler: [hnd=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]] [21:10:19] : [Step 4/5] [2021-11-19 21:10:19,636][INFO ][test-runner-#19961%encryption.MasterKeyChangeConsistencyCheckTest%][TcpCommunicationSpi] Successfully bound communication NIO server to TCP port [port=45200, locHost=/127.0.0.1, selectorsCnt=12, selectorSpins=0, pairedConn=false] [21:10:19]W: [org.apache.ignite:ignite-core] [2021-11-19 21:10:19,637][WARN ][test-runner-#19961%encryption.MasterKeyChangeConsistencyCheckTest%][TcpCommunicationSpi] Message queue limit is set to 0 which may lead to potential OOMEs when running cache operations in FULL_ASYNC or PRIMARY_SYNC modes due to message queues growth on sender and receiver sides. [21:10:19] : [Step 4/5] [2021-11-19 21:10:19,643][INFO ][test-runner-#19961%encryption.MasterKeyChangeConsistencyCheckTest%][GridCollisionManager] Collision resolution is disabled (all jobs will be activated upon arrival). [21:10:19] : [Step 4/5] [2021-11-19 21:10:19,643][INFO ][test-runner-#19961%encryption.MasterKeyChangeConsistencyCheckTest%][IgniteKernal%grid-0] Security status [authentication=off, sandbox=off, tls/ssl=off] [21:10:19] : [Step 4/5] [2021-11-19 21:10:19,712][INFO ][test-runner-#19961%encryption.MasterKeyChangeConsistencyCheckTest%][MasterKeyChangeConsistencyCheckTest$TestKeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:10:19] : [Step 4/5] [2021-11-19 21:10:19,895][INFO ][test-runner-#19961%encryption.MasterKeyChangeConsistencyCheckTest%][MaintenanceProcessor] Resolved store directory for node persistent data: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0 [21:10:19] : [Step 4/5] [2021-11-19 21:10:19,896][INFO ][test-runner-#19961%encryption.MasterKeyChangeConsistencyCheckTest%][CacheObjectBinaryProcessorImpl] Resolved directory for serialized binary metadata: /opt/buildagent/work/7bc1c54bc719b67c/work/db/binary_meta/grid_0 [21:10:19] : [Step 4/5] [2021-11-19 21:10:19,900][INFO ][test-runner-#19961%encryption.MasterKeyChangeConsistencyCheckTest%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0 [21:10:19] : [Step 4/5] [2021-11-19 21:10:19,900][INFO ][test-runner-#19961%encryption.MasterKeyChangeConsistencyCheckTest%][FileWriteAheadLogManager] Resolved write ahead log work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0 [21:10:19] : [Step 4/5] [2021-11-19 21:10:19,900][INFO ][test-runner-#19961%encryption.MasterKeyChangeConsistencyCheckTest%][FileWriteAheadLogManager] Resolved write ahead log archive directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0 [21:10:20] : [Step 4/5] Surefire report watcher [21:10:20] : [Surefire report watcher] Watching paths: [21:10:20] : [Surefire report watcher] /opt/buildagent/temp/buildTmp/ignite-tools-junit-reports1777670380320881607/test-org.apache.ignite.testsuites.IgniteBasicWithPersistenceTestSuite1637345285864.xml [21:10:20]i: [Step 4/5] org.apache.ignite.testsuites.IgniteBasicWithPersistenceTestSuite [21:10:20]i: [org.apache.ignite.testsuites.IgniteBasicWithPersistenceTestSuite] org.apache.ignite.internal.encryption.MasterKeyChangeTest.testManualRecovery [21:10:20]i: [org.apache.ignite.testsuites.IgniteBasicWithPersistenceTestSuite] org.apache.ignite.internal.encryption.MasterKeyChangeTest.testRejectCacheStartDuringRotation [21:10:20]i: [org.apache.ignite.testsuites.IgniteBasicWithPersistenceTestSuite] org.apache.ignite.internal.encryption.MasterKeyChangeTest.testRejectCacheStartOnClientDuringRotation [21:10:20]i: [org.apache.ignite.testsuites.IgniteBasicWithPersistenceTestSuite] org.apache.ignite.internal.encryption.MasterKeyChangeTest.testRejectNodeJoinDuringRotation [21:10:20]i: [org.apache.ignite.testsuites.IgniteBasicWithPersistenceTestSuite] org.apache.ignite.internal.encryption.MasterKeyChangeTest.testNodeFailsDuringRotationCoordinatorPerform [21:10:20]i: [org.apache.ignite.testsuites.IgniteBasicWithPersistenceTestSuite] org.apache.ignite.internal.encryption.MasterKeyChangeTest.testNodeFailsDuringRotationCoordinatorPrepare [21:10:20]i: [org.apache.ignite.testsuites.IgniteBasicWithPersistenceTestSuite] org.apache.ignite.internal.encryption.MasterKeyChangeTest.testMultiByteMasterKeyNameWalRecovery [21:10:20]i: [org.apache.ignite.testsuites.IgniteBasicWithPersistenceTestSuite] org.apache.ignite.internal.encryption.MasterKeyChangeTest.testClusterRestart [21:10:20]i: [org.apache.ignite.testsuites.IgniteBasicWithPersistenceTestSuite] org.apache.ignite.internal.encryption.MasterKeyChangeTest.testRejectMasterKeyChangeDuringRotation [21:10:20]i: [org.apache.ignite.testsuites.IgniteBasicWithPersistenceTestSuite] org.apache.ignite.internal.encryption.MasterKeyChangeTest.testRecoveryFromWalWithCacheOperations [21:10:20]i: [org.apache.ignite.testsuites.IgniteBasicWithPersistenceTestSuite] org.apache.ignite.internal.encryption.MasterKeyChangeTest.testNodeFailsDuringRotationNotCoordinatorPerform [21:10:20]i: [org.apache.ignite.testsuites.IgniteBasicWithPersistenceTestSuite] org.apache.ignite.internal.encryption.MasterKeyChangeTest.testNodeFailsDuringRotationNotCoordinatorPrepare [21:10:20] : [Step 4/5] [2021-11-19 21:10:20,449][INFO ][test-runner-#19961%encryption.MasterKeyChangeConsistencyCheckTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000000.wal [21:10:20]W: [org.apache.ignite:ignite-core] [2021-11-19 21:10:20,450][WARN ][test-runner-#19961%encryption.MasterKeyChangeConsistencyCheckTest%][GridCacheDatabaseSharedManager] DataRegion maxSize=10.5 MB is smaller than defaultInitialSize=268.4 MB, setting initialSize to 10.5 MB [21:10:20] : [Step 4/5] [2021-11-19 21:10:20,454][INFO ][test-runner-#19961%encryption.MasterKeyChangeConsistencyCheckTest%][GridCacheDatabaseSharedManager] Configured data regions initialized successfully [total=5] [21:10:20] : [Step 4/5] [2021-11-19 21:10:20,457][INFO ][test-runner-#19961%encryption.MasterKeyChangeConsistencyCheckTest%][IgniteSnapshotManager] Resolved snapshot work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/snapshots [21:10:20] : [Step 4/5] [2021-11-19 21:10:20,457][INFO ][test-runner-#19961%encryption.MasterKeyChangeConsistencyCheckTest%][IgniteSnapshotManager] Resolved temp directory for snapshot creation: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0/snp [21:10:20] : [Step 4/5] [2021-11-19 21:10:20,460][INFO ][test-runner-#19961%encryption.MasterKeyChangeConsistencyCheckTest%][ClientListenerProcessor] Client connector processor has started on TCP port 10800 [21:10:20] : [Step 4/5] [2021-11-19 21:10:20,465][INFO ][test-runner-#19961%encryption.MasterKeyChangeConsistencyCheckTest%][IgniteKernal%grid-0] Non-loopback local IPs: 172.17.0.4 [21:10:20] : [Step 4/5] [2021-11-19 21:10:20,465][INFO ][test-runner-#19961%encryption.MasterKeyChangeConsistencyCheckTest%][IgniteKernal%grid-0] Enabled local MACs: 0242AC110004 [21:10:20] : [Step 4/5] [2021-11-19 21:10:20,467][INFO ][test-runner-#19961%encryption.MasterKeyChangeConsistencyCheckTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:10:20] : [Step 4/5] [2021-11-19 21:10:20,468][INFO ][test-runner-#19961%encryption.MasterKeyChangeConsistencyCheckTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:10:20] : [Step 4/5] [2021-11-19 21:10:20,468][INFO ][test-runner-#19961%encryption.MasterKeyChangeConsistencyCheckTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:10:20] : [Step 4/5] [2021-11-19 21:10:20,470][INFO ][test-runner-#19961%encryption.MasterKeyChangeConsistencyCheckTest%][GridCacheDatabaseSharedManager] Applying lost metastore updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:10:20] : [Step 4/5] [2021-11-19 21:10:20,471][INFO ][test-runner-#19961%encryption.MasterKeyChangeConsistencyCheckTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=10 ms] [21:10:20] : [Step 4/5] [2021-11-19 21:10:20,471][INFO ][test-runner-#19961%encryption.MasterKeyChangeConsistencyCheckTest%][GridCacheProcessor] Restoring partition state for local groups. [21:10:20] : [Step 4/5] [2021-11-19 21:10:20,472][INFO ][test-runner-#19961%encryption.MasterKeyChangeConsistencyCheckTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=0, partitionsProcessed=0, time=0ms] [21:10:20] : [Step 4/5] [2021-11-19 21:10:20,472][INFO ][test-runner-#19961%encryption.MasterKeyChangeConsistencyCheckTest%][GridEncryptionManager] Encryption keys loaded from metastore. [grps=, masterKeyName=ignite.master.key] [21:10:20] : [Step 4/5] [2021-11-19 21:10:20,476][INFO ][test-runner-#19961%encryption.MasterKeyChangeConsistencyCheckTest%][ClusterProcessor] Cluster ID and tag has been read from metastorage: null [21:10:20] : [Step 4/5] [2021-11-19 21:10:20,477][INFO ][test-runner-#19961%encryption.MasterKeyChangeConsistencyCheckTest%][IgniteClusterImpl] Shutdown policy was updated [oldVal=null, newVal=null] [21:10:20] : [Step 4/5] [2021-11-19 21:10:20,477][INFO ][test-runner-#19961%encryption.MasterKeyChangeConsistencyCheckTest%][GridCacheDatabaseSharedManager] Checkpoint frequency deviation changed [oldVal=null, newVal=null] [21:10:20] : [Step 4/5] [2021-11-19 21:10:20,487][INFO ][test-runner-#19961%encryption.MasterKeyChangeConsistencyCheckTest%][FilePageStoreManager] Cleanup cache stores [total=1, left=0, cleanFiles=false] [21:10:20] : [Step 4/5] [2021-11-19 21:10:20,489][INFO ][test-runner-#19961%encryption.MasterKeyChangeConsistencyCheckTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:10:20] : [Step 4/5] [2021-11-19 21:10:20,490][INFO ][test-runner-#19961%encryption.MasterKeyChangeConsistencyCheckTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:10:20] : [Step 4/5] [2021-11-19 21:10:20,491][INFO ][test-runner-#19961%encryption.MasterKeyChangeConsistencyCheckTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:10:20] : [Step 4/5] [2021-11-19 21:10:20,491][INFO ][test-runner-#19961%encryption.MasterKeyChangeConsistencyCheckTest%][GridCacheDatabaseSharedManager] Data Regions Started: 5 [21:10:20] : [Step 4/5] [2021-11-19 21:10:20,492][INFO ][test-runner-#19961%encryption.MasterKeyChangeConsistencyCheckTest%][GridCacheDatabaseSharedManager] ^-- sysMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:10:20] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:10:20] : [Step 4/5] ^-- default region [type=default, persistence=true, lazyAlloc=true, [21:10:20] : [Step 4/5] ... initCfg=10MB, maxCfg=10MB, usedRam=0MB, freeRam=100%, allocRam=0MB, allocTotal=0MB] [21:10:20] : [Step 4/5] ^-- metastoreMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:10:20] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:10:20] : [Step 4/5] ^-- TxLog region [type=internal, persistence=true, lazyAlloc=false, [21:10:20] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:10:20] : [Step 4/5] ^-- volatileDsMemPlc region [type=user, persistence=false, lazyAlloc=true, [21:10:20] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB] [21:10:20] : [Step 4/5] ^-- Ignite persistence [used=0MB] [21:10:20] : [Step 4/5] [21:10:20] : [Step 4/5] [2021-11-19 21:10:20,494][INFO ][test-runner-#19961%encryption.MasterKeyChangeConsistencyCheckTest%][GridCacheDatabaseSharedManager] Starting binary memory restore for: [-2100569601] [21:10:20] : [Step 4/5] [2021-11-19 21:10:20,501][INFO ][test-runner-#19961%encryption.MasterKeyChangeConsistencyCheckTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:10:20] : [Step 4/5] [2021-11-19 21:10:20,501][INFO ][test-runner-#19961%encryption.MasterKeyChangeConsistencyCheckTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:10:20] : [Step 4/5] [2021-11-19 21:10:20,503][INFO ][test-runner-#19961%encryption.MasterKeyChangeConsistencyCheckTest%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000000.wal, offset=0, ver=2] [21:10:20] : [Step 4/5] [2021-11-19 21:10:20,507][INFO ][test-runner-#19961%encryption.MasterKeyChangeConsistencyCheckTest%][GridCacheProcessor] Started cache in recovery mode [name=ignite-sys-cache, id=-2100569601, dataRegionName=sysMemPlc, mode=REPLICATED, atomicity=TRANSACTIONAL, backups=2147483647, mvcc=false] [21:10:20] : [Step 4/5] [2021-11-19 21:10:20,508][INFO ][test-runner-#19961%encryption.MasterKeyChangeConsistencyCheckTest%][GridCacheDatabaseSharedManager] Binary recovery performed in 14 ms. [21:10:20] : [Step 4/5] [2021-11-19 21:10:20,508][INFO ][test-runner-#19961%encryption.MasterKeyChangeConsistencyCheckTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:10:20] : [Step 4/5] [2021-11-19 21:10:20,509][INFO ][test-runner-#19961%encryption.MasterKeyChangeConsistencyCheckTest%][GridCacheDatabaseSharedManager] Applying lost cache updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:10:20] : [Step 4/5] [2021-11-19 21:10:20,568][INFO ][test-runner-#19961%encryption.MasterKeyChangeConsistencyCheckTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=61 ms] [21:10:20] : [Step 4/5] [2021-11-19 21:10:20,568][INFO ][test-runner-#19961%encryption.MasterKeyChangeConsistencyCheckTest%][GridCacheProcessor] Restoring partition state for local groups. [21:10:20] : [Step 4/5] [2021-11-19 21:10:20,585][INFO ][test-runner-#19961%encryption.MasterKeyChangeConsistencyCheckTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=1, partitionsProcessed=100, time=20ms] [21:10:21] : [Step 4/5] [2021-11-19 21:10:21,006][INFO ][test-runner-#19961%encryption.MasterKeyChangeConsistencyCheckTest%][TestTcpDiscoverySpi] Successfully bound to TCP port [port=47500, localHost=localhost/127.0.0.1, locNodeId=0008e4b0-ddf1-4d07-ad27-2aa410fed000] [21:10:21] : [Step 4/5] [2021-11-19 21:10:21,021][INFO ][disco-notifier-worker-#20072%grid-0%][MvccProcessorImpl] Assigned mvcc coordinator [crd=MvccCoordinator [topVer=AffinityTopologyVersion [topVer=1, minorTopVer=0], nodeId=0008e4b0-ddf1-4d07-ad27-2aa410fed000, ver=1637345421007, local=true, initialized=false]] [21:10:21] : [Step 4/5] [2021-11-19 21:10:21,022][INFO ][sys-#20050%grid-0%][ClusterProcessor] Writing cluster ID and tag to metastorage on ready for write ClusterIdAndTag [id=48c966af-63cd-4e43-8232-1e4ef83c589f, tag=friendly_nash] [21:10:21] : [Step 4/5] [2021-11-19 21:10:21,031][INFO ][disco-notifier-worker-#20072%grid-0%][ClusterProcessor] friendly_nash [21:10:21] : [Step 4/5] [2021-11-19 21:10:21,032][INFO ][disco-notifier-worker-#20072%grid-0%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustEnabled' was changed from 'null' to 'false' [21:10:21] : [Step 4/5] [2021-11-19 21:10:21,033][INFO ][disco-notifier-worker-#20072%grid-0%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustTimeout' was changed from 'null' to '300000' [21:10:21] : [Step 4/5] [2021-11-19 21:10:21,034][INFO ][disco-notifier-worker-#20072%grid-0%][IgniteTxManager] Transactions parameter 'longOperationsDumpTimeout' was changed from 'null' to '60000' [21:10:21] : [Step 4/5] [2021-11-19 21:10:21,034][INFO ][disco-notifier-worker-#20072%grid-0%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpThreshold' was changed from 'null' to '0' [21:10:21] : [Step 4/5] [2021-11-19 21:10:21,035][INFO ][disco-notifier-worker-#20072%grid-0%][IgniteTxManager] Transactions parameter 'transactionTimeDumpSamplesCoefficient' was changed from 'null' to '0.0' [21:10:21] : [Step 4/5] [2021-11-19 21:10:21,035][INFO ][disco-notifier-worker-#20072%grid-0%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpSamplesPerSecondLimit' was changed from 'null' to '5' [21:10:21] : [Step 4/5] [2021-11-19 21:10:21,036][INFO ][disco-notifier-worker-#20072%grid-0%][IgniteTxManager] Transactions parameter 'collisionsDumpInterval' was changed from 'null' to '1000' [21:10:21] : [Step 4/5] [2021-11-19 21:10:21,037][INFO ][disco-notifier-worker-#20072%grid-0%][IgniteTxManager] Transactions parameter 'txOwnerDumpRequestsAllowed' was changed from 'null' to 'true' [21:10:21] : [Step 4/5] [2021-11-19 21:10:21,037][INFO ][disco-notifier-worker-#20072%grid-0%][GridCacheDatabaseSharedManager] Historical rebalance WAL threshold changed [property=historical.rebalance.threshold, oldVal=null, newVal=500] [21:10:21] : [Step 4/5] [2021-11-19 21:10:21,047][INFO ][test-runner-#19961%encryption.MasterKeyChangeConsistencyCheckTest%][IgniteKernal%grid-0] To start Console Management & Monitoring run ignitevisorcmd.{sh|bat} [21:10:21] : [Step 4/5] [2021-11-19 21:10:21,048][INFO ][test-runner-#19961%encryption.MasterKeyChangeConsistencyCheckTest%][IgniteKernal%grid-0] [21:10:21] : [Step 4/5] [21:10:21] : [Step 4/5] >>> +-------------------------------------------+ [21:10:21] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:10:21] : [Step 4/5] >>> +-------------------------------------------+ [21:10:21] : [Step 4/5] >>> OS name: Linux 4.15.0-151-generic amd64 [21:10:21] : [Step 4/5] >>> CPU(s): 24 [21:10:21] : [Step 4/5] >>> Heap: 2.0GB [21:10:21] : [Step 4/5] >>> VM name: 16724@c4dfe9a430b2 [21:10:21] : [Step 4/5] >>> Ignite instance name: grid-0 [21:10:21] : [Step 4/5] >>> Local node [ID=0008E4B0-DDF1-4D07-AD27-2AA410FED000, order=1, clientMode=false] [21:10:21] : [Step 4/5] >>> Local node addresses: [127.0.0.1] [21:10:21] : [Step 4/5] >>> Local ports: TCP:10800 TCP:45200 TCP:47500 [21:10:21] : [Step 4/5] [21:10:21] : [Step 4/5] [2021-11-19 21:10:21,048][INFO ][test-runner-#19961%encryption.MasterKeyChangeConsistencyCheckTest%][IgniteKernal%grid-0] >>> Ignite cluster is in INACTIVE state (limited functionality available). Use control.(sh|bat) script or IgniteCluster.state(ClusterState.ACTIVE) to change the state. [21:10:21] : [Step 4/5] [2021-11-19 21:10:21,049][INFO ][test-runner-#19961%encryption.MasterKeyChangeConsistencyCheckTest%][GridDiscoveryManager] Topology snapshot [ver=1, locNode=0008e4b0, servers=1, clients=0, state=INACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=0008e4b0-ddf1-4d07-ad27-2aa410fed000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:10:21] : [Step 4/5] [2021-11-19 21:10:21,050][INFO ][test-runner-#19961%encryption.MasterKeyChangeConsistencyCheckTest%][G] Node started : [stage="Configure system pool" (0 ms),stage="Start managers" (298 ms),stage="Configure binary metadata" (1 ms),stage="Start processors" (566 ms),stage="Start 'StanByClusterTestProvider' plugin" (0 ms),stage="Start 'PageMemory tracker plugin' plugin" (0 ms),stage="Start 'TestDistibutedConfigurationPlugin' plugin" (0 ms),stage="Start 'NodeValidationPluginProvider' plugin" (0 ms),stage="Init metastore" (22 ms),stage="Init and start regions" (6 ms),stage="Restore binary memory" (14 ms),stage="Restore logical state" (77 ms),stage="Finish recovery" (418 ms),stage="Join topology" (20 ms),stage="Await transition" (5 ms),stage="Await exchange" (20 ms),stage="Total time" (1447 ms)] [21:10:21] : [Step 4/5] [2021-11-19 21:10:21,051][INFO ][test-runner-#19961%encryption.MasterKeyChangeConsistencyCheckTest%][root] Node started with the following configuration [id=0008e4b0-ddf1-4d07-ad27-2aa410fed000, marshaller=BinaryMarshaller [], discovery=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=5000, ackTimeout=5000, marsh=JdkMarshaller [clsFilter=org.apache.ignite.marshaller.MarshallerUtils$1@6ed3bd6e], reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], binaryCfg=null, lateAff=true] [21:10:21]W: [org.apache.ignite:ignite-core] [2021-11-19 21:10:21,056][WARN ][test-runner-#19961%encryption.MasterKeyChangeConsistencyCheckTest%][G] Ignite work directory is not provided, automatically resolved to: /opt/buildagent/work/7bc1c54bc719b67c/work [21:10:21] : [Step 4/5] [2021-11-19 21:10:21,057][INFO ][test-runner-#19961%encryption.MasterKeyChangeConsistencyCheckTest%][IgniteKernal%grid-1] [21:10:21] : [Step 4/5] [21:10:21] : [Step 4/5] >>> __________ ________________ [21:10:21] : [Step 4/5] >>> / _/ ___/ |/ / _/_ __/ __/ [21:10:21] : [Step 4/5] >>> _/ // (7 7 // / / / / _/ [21:10:21] : [Step 4/5] >>> /___/\___/_/|_/___/ /_/ /___/ [21:10:21] : [Step 4/5] >>> [21:10:21] : [Step 4/5] >>> ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:10:21] : [Step 4/5] >>> 2021 Copyright(C) Apache Software Foundation [21:10:21] : [Step 4/5] >>> [21:10:21] : [Step 4/5] >>> Ignite documentation: http://ignite.apache.org [21:10:21] : [Step 4/5] [21:10:21] : [Step 4/5] [2021-11-19 21:10:21,057][INFO ][test-runner-#19961%encryption.MasterKeyChangeConsistencyCheckTest%][IgniteKernal%grid-1] Config URL: n/a [21:10:21] : [Step 4/5] [2021-11-19 21:10:21,058][INFO ][test-runner-#19961%encryption.MasterKeyChangeConsistencyCheckTest%][IgniteKernal%grid-1] IgniteConfiguration [igniteInstanceName=grid-1, pubPoolSize=24, svcPoolSize=24, callbackPoolSize=24, stripedPoolSize=24, sysPoolSize=24, mgmtPoolSize=4, dataStreamerPoolSize=24, utilityCachePoolSize=24, utilityCacheKeepAliveTime=60000, p2pPoolSize=2, qryPoolSize=24, buildIdxPoolSize=4, igniteHome=/opt/buildagent/work/7bc1c54bc719b67c, igniteWorkDir=/opt/buildagent/work/7bc1c54bc719b67c/work, mbeanSrv=com.sun.jmx.mbeanserver.JmxMBeanServer@6fe85038, nodeId=1055104a-b6c6-48ff-b238-a0e22c7c0001, marsh=BinaryMarshaller [], marshLocJobs=false, daemon=false, p2pEnabled=true, netTimeout=10000, netCompressionLevel=1, sndRetryDelay=1000, sndRetryCnt=3, metricsHistSize=10000, metricsUpdateFreq=1000, metricsExpTime=9223372036854775807, discoSpi=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=0, ackTimeout=0, marsh=null, reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], segPlc=STOP, segResolveAttempts=2, waitForSegOnStart=true, allResolversPassReq=true, segChkFreq=10000, commSpi=TcpCommunicationSpi [connectGate=org.apache.ignite.spi.communication.tcp.internal.ConnectGateway@2e3b251b, ctxInitLatch=java.util.concurrent.CountDownLatch@7b101c1e[Count = 1], stopping=false, clientPool=null, nioSrvWrapper=null, stateProvider=null], evtSpi=MemoryEventStorageSpi [expireAgeMs=9223372036854775807, expireCnt=10000, filter=null], colSpi=NoopCollisionSpi [], deploySpi=LocalDeploymentSpi [], indexingSpi=org.apache.ignite.spi.indexing.noop.NoopIndexingSpi@2ef6374b, addrRslvr=null, encryptionSpi=org.apache.ignite.internal.encryption.MasterKeyChangeConsistencyCheckTest$TestKeystoreEncryptionSpi@67fcd0ff, tracingSpi=org.apache.ignite.spi.tracing.NoopTracingSpi@bd4cbe0, clientMode=false, rebalanceThreadPoolSize=4, rebalanceTimeout=10000, rebalanceBatchesPrefetchCnt=3, rebalanceThrottle=0, rebalanceBatchSize=524288, txCfg=TransactionConfiguration [txSerEnabled=false, dfltIsolation=REPEATABLE_READ, dfltConcurrency=PESSIMISTIC, dfltTxTimeout=0, txTimeoutOnPartitionMapExchange=0, deadlockTimeout=10000, pessimisticTxLogSize=0, pessimisticTxLogLinger=10000, tmLookupClsName=null, txManagerFactory=null, useJtaSync=false], cacheSanityCheckEnabled=true, discoStartupDelay=60000, deployMode=SHARED, p2pMissedCacheSize=100, locHost=127.0.0.1, timeSrvPortBase=31100, timeSrvPortRange=100, failureDetectionTimeout=10000, sysWorkerBlockedTimeout=null, clientFailureDetectionTimeout=10000, metricsLogFreq=0, connectorCfg=null, odbcCfg=null, warmupClos=null, atomicCfg=AtomicConfiguration [seqReserveSize=1000, cacheMode=PARTITIONED, backups=1, aff=null, grpName=null], classLdr=null, sslCtxFactory=null, platformCfg=null, binaryCfg=null, memCfg=null, pstCfg=null, dsCfg=DataStorageConfiguration [sysRegionInitSize=41943040, sysRegionMaxSize=104857600, pageSize=4096, concLvl=0, dfltDataRegConf=DataRegionConfiguration [name=default, maxSize=10485760, initSize=268435456, swapPath=null, pageEvictionMode=DISABLED, pageReplacementMode=CLOCK, evictionThreshold=0.9, emptyPagesPoolSize=100, metricsEnabled=false, metricsSubIntervalCount=5, metricsRateTimeInterval=60000, persistenceEnabled=true, checkpointPageBufSize=0, lazyMemoryAllocation=true, warmUpCfg=null], dataRegions=null, storagePath=null, checkpointFreq=180000, lockWaitTime=10000, checkpointThreads=4, checkpointWriteOrder=SEQUENTIAL, walHistSize=20, maxWalArchiveSize=1073741824, walSegments=10, walSegmentSize=67108864, walPath=db/wal, walArchivePath=db/wal/archive, cdcWalPath=db/wal/cdc, cdcEnabled=false, metricsEnabled=false, walMode=FSYNC, walTlbSize=131072, walBuffSize=0, walFlushFreq=2000, walFsyncDelay=1000, walRecordIterBuffSize=67108864, alwaysWriteFullPages=false, fileIOFactory=org.apache.ignite.internal.processors.cache.persistence.file.AsyncFileIOFactory@dba42a1, metricsSubIntervalCnt=5, metricsRateTimeInterval=60000, walAutoArchiveAfterInactivity=-1, walForceArchiveTimeout=-1, writeThrottlingEnabled=false, walCompactionEnabled=false, walCompactionLevel=1, checkpointReadLockTimeout=null, walPageCompression=DISABLED, walPageCompressionLevel=null, dfltWarmUpCfg=null, encCfg=org.apache.ignite.configuration.EncryptionConfiguration@1d78d1cf, defragmentationThreadPoolSize=4, minWalArchiveSize=-1], snapshotPath=snapshots, activeOnStart=true, activeOnStartPropSetFlag=false, autoActivation=true, autoActivationPropSetFlag=false, clusterStateOnStart=null, sqlConnCfg=null, cliConnCfg=ClientConnectorConfiguration [host=null, port=10800, portRange=100, sockSndBufSize=0, sockRcvBufSize=0, tcpNoDelay=true, maxOpenCursorsPerConn=128, threadPoolSize=24, selectorCnt=12, idleTimeout=0, handshakeTimeout=10000, jdbcEnabled=true, odbcEnabled=true, thinCliEnabled=true, sslEnabled=false, useIgniteSslCtxFactory=true, sslClientAuth=false, sslCtxFactory=null, thinCliCfg=ThinClientConfiguration [maxActiveTxPerConn=100, maxActiveComputeTasksPerConn=0]], mvccVacuumThreadCnt=2, mvccVacuumFreq=5000, authEnabled=false, failureHnd=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]], commFailureRslvr=null, sqlCfg=SqlConfiguration [longQryWarnTimeout=3000, dfltQryTimeout=0, sqlQryHistSize=1000, validationEnabled=false], asyncContinuationExecutor=null] [21:10:21] : [Step 4/5] [2021-11-19 21:10:21,068][INFO ][test-runner-#19961%encryption.MasterKeyChangeConsistencyCheckTest%][IgniteKernal%grid-1] Daemon mode: off [21:10:21] : [Step 4/5] [2021-11-19 21:10:21,068][INFO ][test-runner-#19961%encryption.MasterKeyChangeConsistencyCheckTest%][IgniteKernal%grid-1] OS: Linux 4.15.0-151-generic amd64 [21:10:21] : [Step 4/5] [2021-11-19 21:10:21,069][INFO ][test-runner-#19961%encryption.MasterKeyChangeConsistencyCheckTest%][IgniteKernal%grid-1] OS user: teamcity [21:10:21] : [Step 4/5] [2021-11-19 21:10:21,069][INFO ][test-runner-#19961%encryption.MasterKeyChangeConsistencyCheckTest%][IgniteKernal%grid-1] PID: 16724 [21:10:21] : [Step 4/5] [2021-11-19 21:10:21,069][INFO ][test-runner-#19961%encryption.MasterKeyChangeConsistencyCheckTest%][IgniteKernal%grid-1] Language runtime: Java Platform API Specification ver. 1.8 [21:10:21] : [Step 4/5] [2021-11-19 21:10:21,070][INFO ][test-runner-#19961%encryption.MasterKeyChangeConsistencyCheckTest%][IgniteKernal%grid-1] VM information: Java(TM) SE Runtime Environment 1.8.0_261-b12 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 25.261-b12 [21:10:21] : [Step 4/5] [2021-11-19 21:10:21,070][INFO ][test-runner-#19961%encryption.MasterKeyChangeConsistencyCheckTest%][IgniteKernal%grid-1] VM total memory: 1.9GB [21:10:21] : [Step 4/5] [2021-11-19 21:10:21,070][INFO ][test-runner-#19961%encryption.MasterKeyChangeConsistencyCheckTest%][IgniteKernal%grid-1] Remote Management [restart: off, REST: off, JMX (remote: off)] [21:10:21] : [Step 4/5] [2021-11-19 21:10:21,071][INFO ][test-runner-#19961%encryption.MasterKeyChangeConsistencyCheckTest%][IgniteKernal%grid-1] Logger: GridTestLog4jLogger [quiet=false, config=null] [21:10:21] : [Step 4/5] [2021-11-19 21:10:21,071][INFO ][test-runner-#19961%encryption.MasterKeyChangeConsistencyCheckTest%][IgniteKernal%grid-1] IGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c [21:10:21] : [Step 4/5] [2021-11-19 21:10:21,071][INFO ][test-runner-#19961%encryption.MasterKeyChangeConsistencyCheckTest%][IgniteKernal%grid-1] VM arguments: [-DIGNITE_DUMP_THREADS_ON_FAILURE=false, -DMono=/usr/bin/mono-sgen, -DMono4.0_x64=/usr/lib/mono/4.0, -DMono4.5_x64=/usr/lib/mono/4.5, -DMonoVersion=6.12.0.90, -DSKIP_BUILD=false, -Dagent.home.dir=/opt/buildagent, -Dagent.name=aitc-lin02_03, -Dagent.ownPort=9090, -Dagent.work.dir=/opt/buildagent/work, -Dbuild.number=95, -Dbuild.vcs.number=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.1=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.GitHubApacheIgnite=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dclassworlds.conf=/opt/buildagent/temp/buildTmp/teamcity.m2.conf, -Dcom.jetbrains.maven.watcher.report.file=/opt/buildagent/temp/buildTmp/maven-build-info.xml, -Djava.io.tmpdir=/opt/buildagent/temp/buildTmp, -Dmaven.home=/opt/buildagent/tools/maven3_6, -Dmaven.multiModuleProjectDirectory=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.agent.cpuBenchmark=457, -Dteamcity.agent.dotnet.agent_url=http://localhost:9090/RPC2, -Dteamcity.agent.dotnet.build_id=6278078, -Dteamcity.auth.password=*******, -Dteamcity.auth.userId=TeamCityBuildId=6278078, -Dteamcity.build.changedFiles.file=/opt/buildagent/temp/buildTmp/changedFiles6342607772318147725.txt, -Dteamcity.build.checkoutDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.build.id=6278078, -Dteamcity.build.properties.file=/opt/buildagent/temp/buildTmp/teamcity.build5164517880467851002.properties, -Dteamcity.build.tempDir=/opt/buildagent/temp/buildTmp, -Dteamcity.build.workingDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.buildConfName=Basic 3, -Dteamcity.buildType.id=IgniteTests24Java8_Basic3, -Dteamcity.configuration.properties.file=/opt/buildagent/temp/buildTmp/teamcity.config5591980786735343870.properties, -Dteamcity.maven.userSettings.path=/opt/buildagent/temp/buildTmp/maven_settings_585072866407032347.xml, -Dteamcity.maven.watcher.home=/opt/buildagent/plugins/mavenPlugin/maven-watcher-jdk16, -Dteamcity.projectName=Ignite Tests 2.x (JDK 8/11), -Dteamcity.runner.properties.file=/opt/buildagent/temp/buildTmp/teamcity.runner9098465561618137420.properties, -Dteamcity.tests.recentlyFailedTests.file=/opt/buildagent/temp/buildTmp/testsToRunFirst3891775683130404069.txt, -Dteamcity.version=2021.2 (build 99542), -ea, -Xms2g, -Xmx2g, -XX:+HeapDumpOnOutOfMemoryError, -DIGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_TEST_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_UPDATE_NOTIFIER=false, -DIGNITE_NO_DISCO_ORDER=true, -DIGNITE_PERFORMANCE_SUGGESTIONS_DISABLED=true, -Djava.net.preferIPv4Stack=true, -DTEST_SCALE_FACTOR=1.0, -DIGNITE_TEST_PROP_LOG4J_FILE=log4j-tc-test.xml, -DIGNITE_QUIET=false, -DIGNITE_MARSHAL_BUFFERS_RECHECK=1000, -Dmaven.repo.local=/opt/buildagent/.m2/repository] [21:10:21] : [Step 4/5] [2021-11-19 21:10:21,076][INFO ][test-runner-#19961%encryption.MasterKeyChangeConsistencyCheckTest%][IgniteKernal%grid-1] System cache's DataRegion size is configured to 40 MB. Use DataStorageConfiguration.systemRegionInitialSize property to change the setting. [21:10:21] : [Step 4/5] [2021-11-19 21:10:21,076][INFO ][test-runner-#19961%encryption.MasterKeyChangeConsistencyCheckTest%][IgniteKernal%grid-1] Configured caches [in 'sysMemPlc' dataRegion: ['ignite-sys-cache']] [21:10:21]W: [org.apache.ignite:ignite-core] [2021-11-19 21:10:21,077][WARN ][test-runner-#19961%encryption.MasterKeyChangeConsistencyCheckTest%][IgniteKernal%grid-1] Peer class loading is enabled (disable it in production for performance and deployment consistency reasons) [21:10:21] : [Step 4/5] [2021-11-19 21:10:21,077][INFO ][test-runner-#19961%encryption.MasterKeyChangeConsistencyCheckTest%][IgniteKernal%grid-1] 3-rd party licenses can be found at: /opt/buildagent/work/7bc1c54bc719b67c/libs/licenses [21:10:21] : [Step 4/5] [2021-11-19 21:10:21,081][INFO ][test-runner-#19961%encryption.MasterKeyChangeConsistencyCheckTest%][IgnitePluginProcessor] Configured plugins: [21:10:21] : [Step 4/5] [2021-11-19 21:10:21,082][INFO ][test-runner-#19961%encryption.MasterKeyChangeConsistencyCheckTest%][IgnitePluginProcessor] ^-- StanByClusterTestProvider 1.0 [21:10:21] : [Step 4/5] [2021-11-19 21:10:21,082][INFO ][test-runner-#19961%encryption.MasterKeyChangeConsistencyCheckTest%][IgnitePluginProcessor] ^-- null [21:10:21] : [Step 4/5] [2021-11-19 21:10:21,082][INFO ][test-runner-#19961%encryption.MasterKeyChangeConsistencyCheckTest%][IgnitePluginProcessor] [21:10:21] : [Step 4/5] [2021-11-19 21:10:21,083][INFO ][test-runner-#19961%encryption.MasterKeyChangeConsistencyCheckTest%][IgnitePluginProcessor] ^-- PageMemory tracker plugin 1.0 [21:10:21] : [Step 4/5] [2021-11-19 21:10:21,083][INFO ][test-runner-#19961%encryption.MasterKeyChangeConsistencyCheckTest%][IgnitePluginProcessor] ^-- null [21:10:21] : [Step 4/5] [2021-11-19 21:10:21,083][INFO ][test-runner-#19961%encryption.MasterKeyChangeConsistencyCheckTest%][IgnitePluginProcessor] [21:10:21] : [Step 4/5] [2021-11-19 21:10:21,083][INFO ][test-runner-#19961%encryption.MasterKeyChangeConsistencyCheckTest%][IgnitePluginProcessor] ^-- TestDistibutedConfigurationPlugin 1.0 [21:10:21] : [Step 4/5] [2021-11-19 21:10:21,084][INFO ][test-runner-#19961%encryption.MasterKeyChangeConsistencyCheckTest%][IgnitePluginProcessor] ^-- null [21:10:21] : [Step 4/5] [2021-11-19 21:10:21,084][INFO ][test-runner-#19961%encryption.MasterKeyChangeConsistencyCheckTest%][IgnitePluginProcessor] [21:10:21] : [Step 4/5] [2021-11-19 21:10:21,084][INFO ][test-runner-#19961%encryption.MasterKeyChangeConsistencyCheckTest%][IgnitePluginProcessor] ^-- NodeValidationPluginProvider 1.0 [21:10:21] : [Step 4/5] [2021-11-19 21:10:21,084][INFO ][test-runner-#19961%encryption.MasterKeyChangeConsistencyCheckTest%][IgnitePluginProcessor] ^-- null [21:10:21] : [Step 4/5] [2021-11-19 21:10:21,084][INFO ][test-runner-#19961%encryption.MasterKeyChangeConsistencyCheckTest%][IgnitePluginProcessor] [21:10:21] : [Step 4/5] [2021-11-19 21:10:21,085][INFO ][test-runner-#19961%encryption.MasterKeyChangeConsistencyCheckTest%][FailureProcessor] Configured failure handler: [hnd=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]] [21:10:21] : [Step 4/5] [2021-11-19 21:10:21,119][INFO ][test-runner-#19961%encryption.MasterKeyChangeConsistencyCheckTest%][TcpCommunicationSpi] Successfully bound communication NIO server to TCP port [port=45201, locHost=/127.0.0.1, selectorsCnt=12, selectorSpins=0, pairedConn=false] [21:10:21]W: [org.apache.ignite:ignite-core] [2021-11-19 21:10:21,120][WARN ][test-runner-#19961%encryption.MasterKeyChangeConsistencyCheckTest%][TcpCommunicationSpi] Message queue limit is set to 0 which may lead to potential OOMEs when running cache operations in FULL_ASYNC or PRIMARY_SYNC modes due to message queues growth on sender and receiver sides. [21:10:21] : [Step 4/5] [2021-11-19 21:10:21,133][INFO ][test-runner-#19961%encryption.MasterKeyChangeConsistencyCheckTest%][GridCollisionManager] Collision resolution is disabled (all jobs will be activated upon arrival). [21:10:21] : [Step 4/5] [2021-11-19 21:10:21,134][INFO ][test-runner-#19961%encryption.MasterKeyChangeConsistencyCheckTest%][IgniteKernal%grid-1] Security status [authentication=off, sandbox=off, tls/ssl=off] [21:10:21] : [Step 4/5] [2021-11-19 21:10:21,193][INFO ][test-runner-#19961%encryption.MasterKeyChangeConsistencyCheckTest%][MasterKeyChangeConsistencyCheckTest$TestKeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:10:21] : [Step 4/5] [2021-11-19 21:10:21,285][INFO ][test-runner-#19961%encryption.MasterKeyChangeConsistencyCheckTest%][MaintenanceProcessor] Resolved store directory for node persistent data: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1 [21:10:21] : [Step 4/5] [2021-11-19 21:10:21,286][INFO ][test-runner-#19961%encryption.MasterKeyChangeConsistencyCheckTest%][CacheObjectBinaryProcessorImpl] Resolved directory for serialized binary metadata: /opt/buildagent/work/7bc1c54bc719b67c/work/db/binary_meta/grid_1 [21:10:21] : [Step 4/5] [2021-11-19 21:10:21,289][INFO ][test-runner-#19961%encryption.MasterKeyChangeConsistencyCheckTest%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1 [21:10:21] : [Step 4/5] [2021-11-19 21:10:21,290][INFO ][test-runner-#19961%encryption.MasterKeyChangeConsistencyCheckTest%][FileWriteAheadLogManager] Resolved write ahead log work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1 [21:10:21] : [Step 4/5] [2021-11-19 21:10:21,290][INFO ][test-runner-#19961%encryption.MasterKeyChangeConsistencyCheckTest%][FileWriteAheadLogManager] Resolved write ahead log archive directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1 [21:10:21] : [Step 4/5] [2021-11-19 21:10:21,714][INFO ][test-runner-#19961%encryption.MasterKeyChangeConsistencyCheckTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000000.wal [21:10:21] : [Step 4/5] [2021-11-19 21:10:21,720][INFO ][test-runner-#19961%encryption.MasterKeyChangeConsistencyCheckTest%][GridCacheDatabaseSharedManager] Configured data regions initialized successfully [total=5] [21:10:21] : [Step 4/5] [2021-11-19 21:10:21,722][INFO ][test-runner-#19961%encryption.MasterKeyChangeConsistencyCheckTest%][IgniteSnapshotManager] Resolved snapshot work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/snapshots [21:10:21] : [Step 4/5] [2021-11-19 21:10:21,722][INFO ][test-runner-#19961%encryption.MasterKeyChangeConsistencyCheckTest%][IgniteSnapshotManager] Resolved temp directory for snapshot creation: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1/snp [21:10:21] : [Step 4/5] [2021-11-19 21:10:21,725][INFO ][test-runner-#19961%encryption.MasterKeyChangeConsistencyCheckTest%][ClientListenerProcessor] Client connector processor has started on TCP port 10801 [21:10:21] : [Step 4/5] [2021-11-19 21:10:21,728][INFO ][test-runner-#19961%encryption.MasterKeyChangeConsistencyCheckTest%][IgniteKernal%grid-1] Non-loopback local IPs: 172.17.0.4 [21:10:21] : [Step 4/5] [2021-11-19 21:10:21,728][INFO ][test-runner-#19961%encryption.MasterKeyChangeConsistencyCheckTest%][IgniteKernal%grid-1] Enabled local MACs: 0242AC110004 [21:10:21] : [Step 4/5] [2021-11-19 21:10:21,729][INFO ][test-runner-#19961%encryption.MasterKeyChangeConsistencyCheckTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:10:21] : [Step 4/5] [2021-11-19 21:10:21,731][INFO ][test-runner-#19961%encryption.MasterKeyChangeConsistencyCheckTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:10:21] : [Step 4/5] [2021-11-19 21:10:21,731][INFO ][test-runner-#19961%encryption.MasterKeyChangeConsistencyCheckTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:10:21] : [Step 4/5] [2021-11-19 21:10:21,734][INFO ][test-runner-#19961%encryption.MasterKeyChangeConsistencyCheckTest%][GridCacheDatabaseSharedManager] Applying lost metastore updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:10:21] : [Step 4/5] [2021-11-19 21:10:21,735][INFO ][test-runner-#19961%encryption.MasterKeyChangeConsistencyCheckTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=0 ms] [21:10:21] : [Step 4/5] [2021-11-19 21:10:21,735][INFO ][test-runner-#19961%encryption.MasterKeyChangeConsistencyCheckTest%][GridCacheProcessor] Restoring partition state for local groups. [21:10:21] : [Step 4/5] [2021-11-19 21:10:21,736][INFO ][test-runner-#19961%encryption.MasterKeyChangeConsistencyCheckTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=0, partitionsProcessed=0, time=0ms] [21:10:21] : [Step 4/5] [2021-11-19 21:10:21,737][INFO ][test-runner-#19961%encryption.MasterKeyChangeConsistencyCheckTest%][GridEncryptionManager] Encryption keys loaded from metastore. [grps=, masterKeyName=ignite.master.key] [21:10:21] : [Step 4/5] [2021-11-19 21:10:21,738][INFO ][test-runner-#19961%encryption.MasterKeyChangeConsistencyCheckTest%][ClusterProcessor] Cluster ID and tag has been read from metastorage: null [21:10:21] : [Step 4/5] [2021-11-19 21:10:21,739][INFO ][test-runner-#19961%encryption.MasterKeyChangeConsistencyCheckTest%][IgniteClusterImpl] Shutdown policy was updated [oldVal=null, newVal=null] [21:10:21] : [Step 4/5] [2021-11-19 21:10:21,739][INFO ][test-runner-#19961%encryption.MasterKeyChangeConsistencyCheckTest%][GridCacheDatabaseSharedManager] Checkpoint frequency deviation changed [oldVal=null, newVal=null] [21:10:21] : [Step 4/5] [2021-11-19 21:10:21,749][INFO ][test-runner-#19961%encryption.MasterKeyChangeConsistencyCheckTest%][FilePageStoreManager] Cleanup cache stores [total=1, left=0, cleanFiles=false] [21:10:21] : [Step 4/5] [2021-11-19 21:10:21,751][INFO ][test-runner-#19961%encryption.MasterKeyChangeConsistencyCheckTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:10:21] : [Step 4/5] [2021-11-19 21:10:21,752][INFO ][test-runner-#19961%encryption.MasterKeyChangeConsistencyCheckTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:10:21] : [Step 4/5] [2021-11-19 21:10:21,754][INFO ][test-runner-#19961%encryption.MasterKeyChangeConsistencyCheckTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:10:21] : [Step 4/5] [2021-11-19 21:10:21,754][INFO ][test-runner-#19961%encryption.MasterKeyChangeConsistencyCheckTest%][GridCacheDatabaseSharedManager] Data Regions Started: 5 [21:10:21] : [Step 4/5] [2021-11-19 21:10:21,755][INFO ][test-runner-#19961%encryption.MasterKeyChangeConsistencyCheckTest%][GridCacheDatabaseSharedManager] ^-- sysMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:10:21] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:10:21] : [Step 4/5] ^-- default region [type=default, persistence=true, lazyAlloc=true, [21:10:21] : [Step 4/5] ... initCfg=10MB, maxCfg=10MB, usedRam=0MB, freeRam=100%, allocRam=0MB, allocTotal=0MB] [21:10:21] : [Step 4/5] ^-- metastoreMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:10:21] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:10:21] : [Step 4/5] ^-- TxLog region [type=internal, persistence=true, lazyAlloc=false, [21:10:21] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:10:21] : [Step 4/5] ^-- volatileDsMemPlc region [type=user, persistence=false, lazyAlloc=true, [21:10:21] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB] [21:10:21] : [Step 4/5] ^-- Ignite persistence [used=0MB] [21:10:21] : [Step 4/5] [21:10:21] : [Step 4/5] [2021-11-19 21:10:21,756][INFO ][test-runner-#19961%encryption.MasterKeyChangeConsistencyCheckTest%][GridCacheDatabaseSharedManager] Starting binary memory restore for: [-2100569601] [21:10:21] : [Step 4/5] [2021-11-19 21:10:21,764][INFO ][test-runner-#19961%encryption.MasterKeyChangeConsistencyCheckTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:10:21] : [Step 4/5] [2021-11-19 21:10:21,764][INFO ][test-runner-#19961%encryption.MasterKeyChangeConsistencyCheckTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:10:21] : [Step 4/5] [2021-11-19 21:10:21,765][INFO ][test-runner-#19961%encryption.MasterKeyChangeConsistencyCheckTest%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000000.wal, offset=0, ver=2] [21:10:21] : [Step 4/5] [2021-11-19 21:10:21,770][INFO ][test-runner-#19961%encryption.MasterKeyChangeConsistencyCheckTest%][GridCacheProcessor] Started cache in recovery mode [name=ignite-sys-cache, id=-2100569601, dataRegionName=sysMemPlc, mode=REPLICATED, atomicity=TRANSACTIONAL, backups=2147483647, mvcc=false] [21:10:21] : [Step 4/5] [2021-11-19 21:10:21,771][INFO ][test-runner-#19961%encryption.MasterKeyChangeConsistencyCheckTest%][GridCacheDatabaseSharedManager] Binary recovery performed in 15 ms. [21:10:21] : [Step 4/5] [2021-11-19 21:10:21,772][INFO ][test-runner-#19961%encryption.MasterKeyChangeConsistencyCheckTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:10:21] : [Step 4/5] [2021-11-19 21:10:21,772][INFO ][test-runner-#19961%encryption.MasterKeyChangeConsistencyCheckTest%][GridCacheDatabaseSharedManager] Applying lost cache updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:10:21] : [Step 4/5] [2021-11-19 21:10:21,847][INFO ][test-runner-#19961%encryption.MasterKeyChangeConsistencyCheckTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=81 ms] [21:10:21] : [Step 4/5] [2021-11-19 21:10:21,847][INFO ][test-runner-#19961%encryption.MasterKeyChangeConsistencyCheckTest%][GridCacheProcessor] Restoring partition state for local groups. [21:10:21] : [Step 4/5] [2021-11-19 21:10:21,861][INFO ][test-runner-#19961%encryption.MasterKeyChangeConsistencyCheckTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=1, partitionsProcessed=100, time=10ms] [21:10:22] : [Step 4/5] [2021-11-19 21:10:22,188][INFO ][test-runner-#19961%encryption.MasterKeyChangeConsistencyCheckTest%][TestTcpDiscoverySpi] Successfully bound to TCP port [port=47501, localHost=localhost/127.0.0.1, locNodeId=1055104a-b6c6-48ff-b238-a0e22c7c0001] [21:10:22] : [Step 4/5] [2021-11-19 21:10:22,192][INFO ][tcp-disco-srvr-[:47500]-#1051%grid-0%-#20074%grid-0%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=49519] [21:10:22] : [Step 4/5] [2021-11-19 21:10:22,192][INFO ][tcp-disco-srvr-[:47500]-#1051%grid-0%-#20074%grid-0%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=49519] [21:10:22] : [Step 4/5] [2021-11-19 21:10:22,193][INFO ][tcp-disco-sock-reader-[]-#1057%grid-0%-#20193%grid-0%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:49519, rmtPort=49519] [21:10:22] : [Step 4/5] [2021-11-19 21:10:22,194][INFO ][tcp-disco-sock-reader-[1055104a 127.0.0.1:49519]-#1057%grid-0%-#20193%grid-0%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=1055104a-b6c6-48ff-b238-a0e22c7c0001, rmtAddr=/127.0.0.1:49519] [21:10:22] : [Step 4/5] [2021-11-19 21:10:22,199][INFO ][tcp-disco-srvr-[:47501]-#1056%grid-1%-#20192%grid-1%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=47143] [21:10:22] : [Step 4/5] [2021-11-19 21:10:22,199][INFO ][tcp-disco-srvr-[:47501]-#1056%grid-1%-#20192%grid-1%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=47143] [21:10:22] : [Step 4/5] [2021-11-19 21:10:22,200][INFO ][tcp-disco-sock-reader-[]-#1058%grid-1%-#20194%grid-1%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:47143, rmtPort=47143] [21:10:22] : [Step 4/5] [2021-11-19 21:10:22,200][INFO ][tcp-disco-sock-reader-[]-#1058%grid-1%-#20194%grid-1%][TestTcpDiscoverySpi] Received ping request from the remote node [rmtNodeId=0008e4b0-ddf1-4d07-ad27-2aa410fed000, rmtAddr=/127.0.0.1:47143, rmtPort=47143] [21:10:22] : [Step 4/5] [2021-11-19 21:10:22,202][INFO ][tcp-disco-sock-reader-[]-#1058%grid-1%-#20194%grid-1%][TestTcpDiscoverySpi] Finished writing ping response [rmtNodeId=0008e4b0-ddf1-4d07-ad27-2aa410fed000, rmtAddr=/127.0.0.1:47143, rmtPort=47143] [21:10:22]W: [org.apache.ignite:ignite-core] [2021-11-19 21:10:22,202][WARN ][tcp-disco-sock-reader-[]-#1058%grid-1%-#20194%grid-1%][TestTcpDiscoverySpi] Failed to shutdown socket [21:10:22]W: [org.apache.ignite:ignite-core] java.net.SocketException: Socket output is already shutdown [21:10:22]W: [org.apache.ignite:ignite-core] at java.net.Socket.shutdownOutput(Socket.java:1572) [21:10:22]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.close(IgniteUtils.java:4247) [21:10:22]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.discovery.tcp.ServerImpl$SocketReader.body(ServerImpl.java:7370) [21:10:22]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.IgniteSpiThread.run(IgniteSpiThread.java:58) [21:10:22] : [Step 4/5] [2021-11-19 21:10:22,202][INFO ][tcp-disco-sock-reader-[1055104a 127.0.0.1:49519]-#1057%grid-0%-#20193%grid-0%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:49519, rmtPort=49519, rmtNodeId=1055104a-b6c6-48ff-b238-a0e22c7c0001] [21:10:22] : [Step 4/5] [2021-11-19 21:10:22,203][INFO ][tcp-disco-sock-reader-[]-#1058%grid-1%-#20194%grid-1%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:47143, rmtPort=47143, rmtNodeId=null] [21:10:22] : [Step 4/5] [2021-11-19 21:10:22,205][INFO ][tcp-disco-msg-worker-[crd]-#1050%grid-0%-#20073%grid-0%][GridEncryptionManager] Joining node doesn't have stored group keys [node=1055104a-b6c6-48ff-b238-a0e22c7c0001] [21:10:22] : [Step 4/5] [2021-11-19 21:10:22,215][INFO ][tcp-disco-msg-worker-[crd]-#1050%grid-0%-#20073%grid-0%][TestTcpDiscoverySpi] New next node [newNext=TcpDiscoveryNode [id=1055104a-b6c6-48ff-b238-a0e22c7c0001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=0, intOrder=2, lastExchangeTime=1637345422197, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false]] [21:10:22] : [Step 4/5] [2021-11-19 21:10:22,216][INFO ][tcp-disco-srvr-[:47501]-#1056%grid-1%-#20192%grid-1%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=42007] [21:10:22] : [Step 4/5] [2021-11-19 21:10:22,216][INFO ][tcp-disco-srvr-[:47501]-#1056%grid-1%-#20192%grid-1%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=42007] [21:10:22] : [Step 4/5] [2021-11-19 21:10:22,217][INFO ][tcp-disco-sock-reader-[]-#1059%grid-1%-#20195%grid-1%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:42007, rmtPort=42007] [21:10:22] : [Step 4/5] [2021-11-19 21:10:22,218][INFO ][tcp-disco-sock-reader-[0008e4b0 127.0.0.1:42007]-#1059%grid-1%-#20195%grid-1%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=0008e4b0-ddf1-4d07-ad27-2aa410fed000, rmtAddr=/127.0.0.1:42007] [21:10:22] : [Step 4/5] [2021-11-19 21:10:22,224][INFO ][tcp-disco-msg-worker-[]-#1055%grid-1%-#20191%grid-1%][TestTcpDiscoverySpi] New next node [newNext=TcpDiscoveryNode [id=0008e4b0-ddf1-4d07-ad27-2aa410fed000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345422217, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false]] [21:10:22] : [Step 4/5] [2021-11-19 21:10:22,225][INFO ][tcp-disco-srvr-[:47500]-#1051%grid-0%-#20074%grid-0%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=45927] [21:10:22] : [Step 4/5] [2021-11-19 21:10:22,225][INFO ][tcp-disco-srvr-[:47500]-#1051%grid-0%-#20074%grid-0%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=45927] [21:10:22] : [Step 4/5] [2021-11-19 21:10:22,226][INFO ][tcp-disco-sock-reader-[]-#1060%grid-0%-#20196%grid-0%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:45927, rmtPort=45927] [21:10:22] : [Step 4/5] [2021-11-19 21:10:22,227][INFO ][tcp-disco-sock-reader-[1055104a 127.0.0.1:45927]-#1060%grid-0%-#20196%grid-0%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=1055104a-b6c6-48ff-b238-a0e22c7c0001, rmtAddr=/127.0.0.1:45927] [21:10:22] : [Step 4/5] [2021-11-19 21:10:22,231][INFO ][disco-event-worker-#20076%grid-0%][GridDiscoveryManager] Added new node to topology: TcpDiscoveryNode [id=1055104a-b6c6-48ff-b238-a0e22c7c0001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637345422197, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false] [21:10:22] : [Step 4/5] [2021-11-19 21:10:22,232][INFO ][disco-event-worker-#20076%grid-0%][GridDiscoveryManager] Topology snapshot [ver=2, locNode=0008e4b0, servers=2, clients=0, state=INACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=0008e4b0-ddf1-4d07-ad27-2aa410fed000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=1055104a-b6c6-48ff-b238-a0e22c7c0001, consistentId=grid-1, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:10:22] : [Step 4/5] [2021-11-19 21:10:22,235][INFO ][tcp-disco-msg-worker-[0008e4b0 127.0.0.1:47500]-#1055%grid-1%-#20191%grid-1%][ClusterProcessor] friendly_nash [21:10:22] : [Step 4/5] [2021-11-19 21:10:22,236][INFO ][tcp-disco-msg-worker-[0008e4b0 127.0.0.1:47500]-#1055%grid-1%-#20191%grid-1%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustEnabled' was changed from 'null' to 'false' [21:10:22] : [Step 4/5] [2021-11-19 21:10:22,236][INFO ][tcp-disco-msg-worker-[0008e4b0 127.0.0.1:47500]-#1055%grid-1%-#20191%grid-1%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustTimeout' was changed from 'null' to '300000' [21:10:22] : [Step 4/5] [2021-11-19 21:10:22,237][INFO ][tcp-disco-msg-worker-[0008e4b0 127.0.0.1:47500]-#1055%grid-1%-#20191%grid-1%][IgniteTxManager] Transactions parameter 'longOperationsDumpTimeout' was changed from 'null' to '60000' [21:10:22] : [Step 4/5] [2021-11-19 21:10:22,237][INFO ][tcp-disco-msg-worker-[0008e4b0 127.0.0.1:47500]-#1055%grid-1%-#20191%grid-1%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpThreshold' was changed from 'null' to '0' [21:10:22] : [Step 4/5] [2021-11-19 21:10:22,238][INFO ][tcp-disco-msg-worker-[0008e4b0 127.0.0.1:47500]-#1055%grid-1%-#20191%grid-1%][IgniteTxManager] Transactions parameter 'transactionTimeDumpSamplesCoefficient' was changed from 'null' to '0.0' [21:10:22] : [Step 4/5] [2021-11-19 21:10:22,238][INFO ][tcp-disco-msg-worker-[0008e4b0 127.0.0.1:47500]-#1055%grid-1%-#20191%grid-1%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpSamplesPerSecondLimit' was changed from 'null' to '5' [21:10:22] : [Step 4/5] [2021-11-19 21:10:22,239][INFO ][tcp-disco-msg-worker-[0008e4b0 127.0.0.1:47500]-#1055%grid-1%-#20191%grid-1%][IgniteTxManager] Transactions parameter 'collisionsDumpInterval' was changed from 'null' to '1000' [21:10:22] : [Step 4/5] [2021-11-19 21:10:22,239][INFO ][tcp-disco-msg-worker-[0008e4b0 127.0.0.1:47500]-#1055%grid-1%-#20191%grid-1%][IgniteTxManager] Transactions parameter 'txOwnerDumpRequestsAllowed' was changed from 'null' to 'true' [21:10:22] : [Step 4/5] [2021-11-19 21:10:22,240][INFO ][tcp-disco-msg-worker-[0008e4b0 127.0.0.1:47500]-#1055%grid-1%-#20191%grid-1%][GridCacheDatabaseSharedManager] Historical rebalance WAL threshold changed [property=historical.rebalance.threshold, oldVal=null, newVal=500] [21:10:22] : [Step 4/5] [2021-11-19 21:10:22,240][INFO ][disco-notifier-worker-#20190%grid-1%][MvccProcessorImpl] Assigned mvcc coordinator [crd=MvccCoordinator [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=0], nodeId=0008e4b0-ddf1-4d07-ad27-2aa410fed000, ver=1637345421007, local=false, initialized=false]] [21:10:22] : [Step 4/5] [2021-11-19 21:10:22,242][INFO ][sys-#20172%grid-1%][ClusterProcessor] Writing cluster ID and tag to metastorage on ready for write ClusterIdAndTag [id=48c966af-63cd-4e43-8232-1e4ef83c589f, tag=friendly_nash] [21:10:22] : [Step 4/5] [2021-11-19 21:10:22,254][INFO ][test-runner-#19961%encryption.MasterKeyChangeConsistencyCheckTest%][IgniteKernal%grid-1] To start Console Management & Monitoring run ignitevisorcmd.{sh|bat} [21:10:22] : [Step 4/5] [2021-11-19 21:10:22,255][INFO ][test-runner-#19961%encryption.MasterKeyChangeConsistencyCheckTest%][IgniteKernal%grid-1] [21:10:22] : [Step 4/5] [21:10:22] : [Step 4/5] >>> +-------------------------------------------+ [21:10:22] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:10:22] : [Step 4/5] >>> +-------------------------------------------+ [21:10:22] : [Step 4/5] >>> OS name: Linux 4.15.0-151-generic amd64 [21:10:22] : [Step 4/5] >>> CPU(s): 24 [21:10:22] : [Step 4/5] >>> Heap: 2.0GB [21:10:22] : [Step 4/5] >>> VM name: 16724@c4dfe9a430b2 [21:10:22] : [Step 4/5] >>> Ignite instance name: grid-1 [21:10:22] : [Step 4/5] >>> Local node [ID=1055104A-B6C6-48FF-B238-A0E22C7C0001, order=2, clientMode=false] [21:10:22] : [Step 4/5] >>> Local node addresses: [127.0.0.1] [21:10:22] : [Step 4/5] >>> Local ports: TCP:10801 TCP:45201 TCP:47501 [21:10:22] : [Step 4/5] [21:10:22] : [Step 4/5] [2021-11-19 21:10:22,256][INFO ][test-runner-#19961%encryption.MasterKeyChangeConsistencyCheckTest%][IgniteKernal%grid-1] >>> Ignite cluster is in INACTIVE state (limited functionality available). Use control.(sh|bat) script or IgniteCluster.state(ClusterState.ACTIVE) to change the state. [21:10:22] : [Step 4/5] [2021-11-19 21:10:22,256][INFO ][test-runner-#19961%encryption.MasterKeyChangeConsistencyCheckTest%][GridDiscoveryManager] Topology snapshot [ver=2, locNode=1055104a, servers=2, clients=0, state=INACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=0008e4b0-ddf1-4d07-ad27-2aa410fed000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=1055104a-b6c6-48ff-b238-a0e22c7c0001, consistentId=grid-1, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:10:22] : [Step 4/5] [2021-11-19 21:10:22,258][INFO ][test-runner-#19961%encryption.MasterKeyChangeConsistencyCheckTest%][G] Node started : [stage="Configure system pool" (0 ms),stage="Start managers" (229 ms),stage="Configure binary metadata" (1 ms),stage="Start processors" (440 ms),stage="Start 'StanByClusterTestProvider' plugin" (0 ms),stage="Start 'PageMemory tracker plugin' plugin" (0 ms),stage="Start 'TestDistibutedConfigurationPlugin' plugin" (0 ms),stage="Start 'NodeValidationPluginProvider' plugin" (0 ms),stage="Init metastore" (21 ms),stage="Init and start regions" (7 ms),stage="Restore binary memory" (15 ms),stage="Restore logical state" (89 ms),stage="Finish recovery" (325 ms),stage="Join topology" (54 ms),stage="Await transition" (2 ms),stage="Await exchange" (14 ms),stage="Total time" (1197 ms)] [21:10:22] : [Step 4/5] [2021-11-19 21:10:22,259][INFO ][test-runner-#19961%encryption.MasterKeyChangeConsistencyCheckTest%][root] Node started with the following configuration [id=1055104a-b6c6-48ff-b238-a0e22c7c0001, marshaller=BinaryMarshaller [], discovery=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=5000, ackTimeout=5000, marsh=JdkMarshaller [clsFilter=org.apache.ignite.marshaller.MarshallerUtils$1@70c03112], reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], binaryCfg=null, lateAff=true] [21:10:22] : [Step 4/5] [2021-11-19 21:10:22,261][INFO ][test-runner-#19961%encryption.MasterKeyChangeConsistencyCheckTest%][GridClusterStateProcessor] Sending activate cluster request with BaselineTopology BaselineTopology [id=0, branchingHash=-2475315501, branchingType='New BaselineTopology', baselineNodes=[grid-1, grid-0]] [21:10:22] : [Step 4/5] [2021-11-19 21:10:22,265][INFO ][disco-notifier-worker-#20072%grid-0%][GridClusterStateProcessor] Received activate cluster request with BaselineTopology[id=0] initiator node ID: 0008e4b0-ddf1-4d07-ad27-2aa410fed000 [21:10:22] : [Step 4/5] [2021-11-19 21:10:22,265][INFO ][disco-notifier-worker-#20072%grid-0%][GridClusterStateProcessor] Started state transition: activate cluster [21:10:22] : [Step 4/5] [2021-11-19 21:10:22,266][INFO ][exchange-worker-#20077%grid-0%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], crd=true, evt=DISCOVERY_CUSTOM_EVT, evtNode=0008e4b0-ddf1-4d07-ad27-2aa410fed000, customEvt=ChangeGlobalStateMessage [id=1fb7d593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqId=9412dd50-06c4-4028-8d13-6c22ce92ba30, initiatingNodeId=0008e4b0-ddf1-4d07-ad27-2aa410fed000, state=ACTIVE, baselineTopology=BaselineTopology [id=0, branchingHash=-2475315501, branchingType='New BaselineTopology', baselineNodes=[grid-1, grid-0]], forceChangeBaselineTopology=false, timestamp=1637345422261, forceDeactivation=true], allowMerge=false, exchangeFreeSwitch=false] [21:10:22] : [Step 4/5] [2021-11-19 21:10:22,266][INFO ][disco-notifier-worker-#20190%grid-1%][GridClusterStateProcessor] Received activate cluster request with BaselineTopology[id=0] initiator node ID: 0008e4b0-ddf1-4d07-ad27-2aa410fed000 [21:10:22] : [Step 4/5] [2021-11-19 21:10:22,267][INFO ][exchange-worker-#20077%grid-0%][GridDhtPartitionsExchangeFuture] Start activation process [nodeId=0008e4b0-ddf1-4d07-ad27-2aa410fed000, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]]. New state: ACTIVE [21:10:22] : [Step 4/5] [2021-11-19 21:10:22,268][INFO ][disco-notifier-worker-#20190%grid-1%][GridClusterStateProcessor] Started state transition: activate cluster [21:10:22] : [Step 4/5] [2021-11-19 21:10:22,268][INFO ][exchange-worker-#20077%grid-0%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0 [21:10:22] : [Step 4/5] [2021-11-19 21:10:22,271][INFO ][exchange-worker-#20199%grid-1%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], crd=false, evt=DISCOVERY_CUSTOM_EVT, evtNode=0008e4b0-ddf1-4d07-ad27-2aa410fed000, customEvt=ChangeGlobalStateMessage [id=1fb7d593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqId=9412dd50-06c4-4028-8d13-6c22ce92ba30, initiatingNodeId=0008e4b0-ddf1-4d07-ad27-2aa410fed000, state=ACTIVE, baselineTopology=BaselineTopology [id=0, branchingHash=-2475315501, branchingType='New BaselineTopology', baselineNodes=[grid-1, grid-0]], forceChangeBaselineTopology=false, timestamp=1637345422261, forceDeactivation=true], allowMerge=false, exchangeFreeSwitch=false] [21:10:22] : [Step 4/5] [2021-11-19 21:10:22,273][INFO ][exchange-worker-#20199%grid-1%][GridDhtPartitionsExchangeFuture] Start activation process [nodeId=1055104a-b6c6-48ff-b238-a0e22c7c0001, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]]. New state: ACTIVE [21:10:22] : [Step 4/5] [2021-11-19 21:10:22,273][INFO ][exchange-worker-#20077%grid-0%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000000.wal, offset=8713, ver=2] [21:10:22] : [Step 4/5] [2021-11-19 21:10:22,274][INFO ][exchange-worker-#20199%grid-1%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1 [21:10:22] : [Step 4/5] [2021-11-19 21:10:22,275][INFO ][exchange-worker-#20077%grid-0%][GridClusterStateProcessor] Writing BaselineTopology[id=0] [21:10:22] : [Step 4/5] [2021-11-19 21:10:22,277][INFO ][exchange-worker-#20199%grid-1%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000000.wal, offset=8713, ver=2] [21:10:22] : [Step 4/5] [2021-11-19 21:10:22,279][INFO ][exchange-worker-#20199%grid-1%][GridClusterStateProcessor] Writing BaselineTopology[id=0] [21:10:22] : [Step 4/5] [2021-11-19 21:10:22,279][INFO ][exchange-worker-#20077%grid-0%][GridCacheDatabaseSharedManager] Finish recovery performed in 8 ms. [21:10:22] : [Step 4/5] [2021-11-19 21:10:22,280][INFO ][exchange-worker-#20077%grid-0%][msg] Components activation performed in 12 ms. [21:10:22] : [Step 4/5] [2021-11-19 21:10:22,282][INFO ][exchange-worker-#20077%grid-0%][GridCacheProcessor] Finished recovery for cache [cache=ignite-sys-cache, grp=ignite-sys-cache, startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:10:22] : [Step 4/5] [2021-11-19 21:10:22,282][INFO ][exchange-worker-#20199%grid-1%][GridCacheDatabaseSharedManager] Finish recovery performed in 7 ms. [21:10:22] : [Step 4/5] [2021-11-19 21:10:22,284][INFO ][exchange-worker-#20199%grid-1%][msg] Components activation performed in 10 ms. [21:10:22] : [Step 4/5] [2021-11-19 21:10:22,284][INFO ][exchange-worker-#20077%grid-0%][GridDhtPartitionsExchangeFuture] Successfully activated caches [nodeId=0008e4b0-ddf1-4d07-ad27-2aa410fed000, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], newState=ACTIVE] [21:10:22] : [Step 4/5] [2021-11-19 21:10:22,285][INFO ][exchange-worker-#20199%grid-1%][GridCacheProcessor] Finished recovery for cache [cache=ignite-sys-cache, grp=ignite-sys-cache, startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:10:22] : [Step 4/5] [2021-11-19 21:10:22,285][INFO ][exchange-worker-#20077%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:10:22] : [Step 4/5] [2021-11-19 21:10:22,285][INFO ][exchange-worker-#20199%grid-1%][GridDhtPartitionsExchangeFuture] Successfully activated caches [nodeId=1055104a-b6c6-48ff-b238-a0e22c7c0001, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], newState=ACTIVE] [21:10:22] : [Step 4/5] [2021-11-19 21:10:22,286][INFO ][exchange-worker-#20199%grid-1%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:10:22] : [Step 4/5] [2021-11-19 21:10:22,357][INFO ][exchange-worker-#20077%grid-0%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], crd=true] [21:10:22] : [Step 4/5] [2021-11-19 21:10:22,363][INFO ][grid-nio-worker-tcp-comm-0-#20016%TcpCommunicationSpi%][TcpCommunicationSpi] Accepted incoming communication connection [locAddr=/127.0.0.1:45200, rmtAddr=/127.0.0.1:35614] [21:10:22] : [Step 4/5] [2021-11-19 21:10:22,434][INFO ][grid-nio-worker-tcp-comm-0-#20134%TcpCommunicationSpi%][TcpCommunicationSpi] Established outgoing communication connection [locAddr=/127.0.0.1:35614, rmtAddr=/127.0.0.1:45200] [21:10:22] : [Step 4/5] [2021-11-19 21:10:22,435][INFO ][exchange-worker-#20199%grid-1%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], crd=false] [21:10:22] : [Step 4/5] [2021-11-19 21:10:22,437][INFO ][sys-#20059%grid-0%][GridDhtPartitionsExchangeFuture] Coordinator received single message [ver=AffinityTopologyVersion [topVer=2, minorTopVer=1], node=1055104a-b6c6-48ff-b238-a0e22c7c0001, allReceived=true] [21:10:22] : [Step 4/5] [2021-11-19 21:10:22,438][INFO ][sys-#20059%grid-0%][GridDhtPartitionsExchangeFuture] finishExchangeOnCoordinator [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:10:22] : [Step 4/5] [2021-11-19 21:10:22,444][INFO ][sys-#20174%grid-1%][GridDhtPartitionsExchangeFuture] Received full message, will finish exchange [node=0008e4b0-ddf1-4d07-ad27-2aa410fed000, resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:10:22] : [Step 4/5] [2021-11-19 21:10:22,444][INFO ][sys-#20059%grid-0%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], err=null, rebalanced=true, wasRebalanced=false] [21:10:22] : [Step 4/5] [2021-11-19 21:10:22,444][INFO ][disco-notifier-worker-#20072%grid-0%][GridClusterStateProcessor] Received state change finish message: ACTIVE [21:10:22] : [Step 4/5] [2021-11-19 21:10:22,446][INFO ][disco-notifier-worker-#20190%grid-1%][GridClusterStateProcessor] Received state change finish message: ACTIVE [21:10:22] : [Step 4/5] [2021-11-19 21:10:22,446][INFO ][disco-notifier-worker-#20190%grid-1%][GridClusterStateProcessor] Cluster state was changed from INACTIVE to ACTIVE [21:10:22] : [Step 4/5] [2021-11-19 21:10:22,445][INFO ][sys-#20174%grid-1%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], err=null, rebalanced=true, wasRebalanced=false] [21:10:22] : [Step 4/5] [2021-11-19 21:10:22,447][INFO ][sys-#20059%grid-0%][GridCacheProcessor] Finish proxy initialization, cacheName=ignite-sys-cache, localNodeId=0008e4b0-ddf1-4d07-ad27-2aa410fed000 [21:10:22] : [Step 4/5] [2021-11-19 21:10:22,447][INFO ][sys-#20180%grid-1%][GridCachePartitionExchangeManager] Delay process full message without exchange id (there is exchange in progress) [nodeId=0008e4b0-ddf1-4d07-ad27-2aa410fed000] [21:10:22] : [Step 4/5] [2021-11-19 21:10:22,449][INFO ][sys-#20069%grid-0%][DistributedBaselineConfiguration] Baseline auto-adjust is 'disabled' with timeout='300000' ms [21:10:22] : [Step 4/5] [2021-11-19 21:10:22,450][INFO ][sys-#20069%grid-0%][GridClusterStateProcessor] Successfully performed final activation steps [nodeId=0008e4b0-ddf1-4d07-ad27-2aa410fed000, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:10:22] : [Step 4/5] [2021-11-19 21:10:22,446][INFO ][disco-notifier-worker-#20072%grid-0%][GridClusterStateProcessor] Cluster state was changed from INACTIVE to ACTIVE [21:10:22] : [Step 4/5] [2021-11-19 21:10:22,450][INFO ][sys-#20059%grid-0%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=0008e4b0-ddf1-4d07-ad27-2aa410fed000, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=0008e4b0-ddf1-4d07-ad27-2aa410fed000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345422440, loc=true, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:10:22] : [Step 4/5] [2021-11-19 21:10:22,450][INFO ][exchange-worker-#20077%grid-0%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=2, minorTopVer=1], force=false, evt=DISCOVERY_CUSTOM_EVT, node=0008e4b0-ddf1-4d07-ad27-2aa410fed000] [21:10:22] : [Step 4/5] [2021-11-19 21:10:22,450][INFO ][sys-#20174%grid-1%][GridCacheProcessor] Finish proxy initialization, cacheName=ignite-sys-cache, localNodeId=1055104a-b6c6-48ff-b238-a0e22c7c0001 [21:10:22] : [Step 4/5] [2021-11-19 21:10:22,452][INFO ][sys-#20059%grid-0%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (1 ms), stage="Update caches registry" (13 ms), stage="Start caches" (0 ms), stage="Affinity initialization on cache group start" (1 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Restore partition states" (0 ms), stage="After states restored callback" (70 ms), stage="WAL history reservation" (0 ms), stage="Waiting for all single messages" (81 ms), stage="Affinity recalculation (crd)" (0 ms), stage="Collect update counters and create affinity messages" (0 ms), stage="Assign partitions states" (0 ms), stage="Validate partitions states" (0 ms), stage="Ideal affinity diff calculation (enforced)" (0 ms), stage="Apply update counters" (0 ms), stage="Full message preparing" (2 ms), stage="Full message sending" (0 ms), stage="State finish message sending" (1 ms), stage="Detect lost partitions" (2 ms), stage="Exchange done" (5 ms), stage="Total time" (176 ms), Discovery lag=3 ms, Latest started node id=1055104a-b6c6-48ff-b238-a0e22c7c0001] [21:10:22] : [Step 4/5] [2021-11-19 21:10:22,455][INFO ][test-runner-#19961%encryption.MasterKeyChangeConsistencyCheckTest%][root] awaitPartitionMapExchange finished [21:10:22] : [Step 4/5] [2021-11-19 21:10:22,454][INFO ][sys-#20174%grid-1%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=1055104a-b6c6-48ff-b238-a0e22c7c0001, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=0008e4b0-ddf1-4d07-ad27-2aa410fed000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345422217, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:10:22] : [Step 4/5] [2021-11-19 21:10:22,454][INFO ][exchange-worker-#20199%grid-1%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=2, minorTopVer=1], force=false, evt=DISCOVERY_CUSTOM_EVT, node=0008e4b0-ddf1-4d07-ad27-2aa410fed000] [21:10:22] : [Step 4/5] [2021-11-19 21:10:22,454][INFO ][sys-#20183%grid-1%][DistributedBaselineConfiguration] Baseline auto-adjust is 'disabled' with timeout='300000' ms [21:10:22] : [Step 4/5] [2021-11-19 21:10:22,457][INFO ][sys-#20174%grid-1%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (4 ms), stage="Update caches registry" (11 ms), stage="Start caches" (0 ms), stage="Affinity initialization on cache group start" (0 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Restore partition states" (0 ms), stage="After states restored callback" (68 ms), stage="WAL history reservation" (0 ms), stage="Waiting for Full message" (87 ms), stage="Affinity recalculation" (0 ms), stage="Full map updating" (0 ms), stage="Detect lost partitions" (3 ms), stage="Exchange done" (8 ms), stage="Total time" (181 ms)] [21:10:22] : [Step 4/5] [2021-11-19 21:10:22,460][INFO ][sys-#20174%grid-1%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], stage="Affinity initialization on cache group start [grp=ignite-sys-cache]" (0 ms) (parent=Affinity initialization on cache group start), stage="Affinity centralized initialization (crd) [grp=ignite-sys-cache, crd=false]" (0 ms) (parent=Determine exchange type), stage="Restore partition states [grp=ignite-sys-cache]" (0 ms) (parent=Restore partition states), stage="Affinity applying from full message [grp=ignite-sys-cache]" (0 ms) (parent=Affinity recalculation)] [21:10:22] : [Step 4/5] [2021-11-19 21:10:22,455][INFO ][sys-#20059%grid-0%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], stage="Affinity initialization on cache group start [grp=ignite-sys-cache]" (1 ms) (parent=Affinity initialization on cache group start), stage="Affinity centralized initialization (crd) [grp=ignite-sys-cache, crd=true]" (0 ms) (parent=Determine exchange type), stage="Restore partition states [grp=ignite-sys-cache]" (0 ms) (parent=Restore partition states), stage="Affinity recalculation (partitions availability) [grp=ignite-sys-cache]" (0 ms) (parent=Ideal affinity diff calculation (enforced))] [21:10:22] : [Step 4/5] [2021-11-19 21:10:22,462][INFO ][db-checkpoint-thread-#20209%grid-1%][Checkpointer] Checkpoint started [checkpointId=b8755251-39f0-471f-ae91-6f84d242b79e, startPtr=WALPointer [idx=0, fileOff=66667, len=1963], checkpointBeforeLockTime=3ms, checkpointLockWait=57ms, checkpointListenersExecuteTime=1ms, checkpointLockHoldTime=2ms, walCpRecordFsyncDuration=3ms, writeCheckpointEntryDuration=102ms, splitAndSortCpPagesDuration=0ms, pages=16, reason='node started'] [21:10:22] : [Step 4/5] [2021-11-19 21:10:22,461][INFO ][db-checkpoint-thread-#20208%grid-0%][Checkpointer] Checkpoint started [checkpointId=42a565d3-9c84-494c-aad7-5b5010e1fa31, startPtr=WALPointer [idx=0, fileOff=75252, len=1963], checkpointBeforeLockTime=5ms, checkpointLockWait=58ms, checkpointListenersExecuteTime=1ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=3ms, writeCheckpointEntryDuration=102ms, splitAndSortCpPagesDuration=0ms, pages=17, reason='node started'] [21:10:22] : [Step 4/5] [2021-11-19 21:10:22,458][INFO ][sys-#20183%grid-1%][GridClusterStateProcessor] Successfully performed final activation steps [nodeId=1055104a-b6c6-48ff-b238-a0e22c7c0001, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:10:22] : [Step 4/5] [2021-11-19 21:10:22,514][INFO ][test-runner-#19961%encryption.MasterKeyChangeConsistencyCheckTest%][MasterKeyChangeConsistencyCheckTest$TestKeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:10:22] : [Step 4/5] [2021-11-19 21:10:22,667][INFO ][disco-notifier-worker-#20190%grid-1%][MasterKeyChangeConsistencyCheckTest$TestKeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:10:22] : [Step 4/5] [2021-11-19 21:10:22,671][INFO ][disco-notifier-worker-#20072%grid-0%][MasterKeyChangeConsistencyCheckTest$TestKeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:10:22] : [Step 4/5] [2021-11-19 21:10:22,806][INFO ][disco-notifier-worker-#20190%grid-1%][MasterKeyChangeConsistencyCheckTest$TestKeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:10:22] : [Step 4/5] [2021-11-19 21:10:22,809][INFO ][disco-notifier-worker-#20072%grid-0%][MasterKeyChangeConsistencyCheckTest$TestKeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:10:22] : [Step 4/5] [2021-11-19 21:10:22,916][INFO ][test-runner-#19961%encryption.MasterKeyChangeConsistencyCheckTest%][root] Caught expected exception: Master key change was rejected. Master key digest consistency check failed. Make sure that the new master key is the same at all server nodes [nodeId=1055104a-b6c6-48ff-b238-a0e22c7c0001] [21:10:22] : [Step 4/5] [2021-11-19 21:10:22,973][INFO ][test-runner-#19961%encryption.MasterKeyChangeConsistencyCheckTest%][MasterKeyChangeConsistencyCheckTest$TestKeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:10:23] : [Step 4/5] [2021-11-19 21:10:23,137][INFO ][disco-notifier-worker-#20072%grid-0%][MasterKeyChangeConsistencyCheckTest$TestKeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:10:23] : [Step 4/5] [2021-11-19 21:10:23,277][INFO ][disco-notifier-worker-#20072%grid-0%][MasterKeyChangeConsistencyCheckTest$TestKeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:10:23] : [Step 4/5] [2021-11-19 21:10:23,372][INFO ][test-runner-#19961%encryption.MasterKeyChangeConsistencyCheckTest%][root] Caught expected exception: Test error. [21:10:23] : [Step 4/5] [2021-11-19 21:10:23,430][INFO ][test-runner-#19961%encryption.MasterKeyChangeConsistencyCheckTest%][MasterKeyChangeConsistencyCheckTest$TestKeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:10:23] : [Step 4/5] [2021-11-19 21:10:23,797][INFO ][disco-notifier-worker-#20072%grid-0%][MasterKeyChangeConsistencyCheckTest$TestKeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:10:23] : [Step 4/5] [2021-11-19 21:10:23,798][INFO ][disco-notifier-worker-#20190%grid-1%][MasterKeyChangeConsistencyCheckTest$TestKeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:10:23] : [Step 4/5] [2021-11-19 21:10:23,939][INFO ][disco-notifier-worker-#20072%grid-0%][MasterKeyChangeConsistencyCheckTest$TestKeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:10:23] : [Step 4/5] [2021-11-19 21:10:23,979][INFO ][disco-notifier-worker-#20190%grid-1%][MasterKeyChangeConsistencyCheckTest$TestKeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:10:24] : [Step 4/5] [2021-11-19 21:10:24,063][INFO ][disco-notifier-worker-#20072%grid-0%][GridEncryptionManager] Start master key change [masterKeyName=ignite.master.key2] [21:10:24] : [Step 4/5] [2021-11-19 21:10:24,064][INFO ][disco-notifier-worker-#20190%grid-1%][GridEncryptionManager] Start master key change [masterKeyName=ignite.master.key2] [21:10:24] : [Step 4/5] [2021-11-19 21:10:24,121][INFO ][disco-notifier-worker-#20190%grid-1%][MasterKeyChangeConsistencyCheckTest$TestKeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:10:24] : [Step 4/5] [2021-11-19 21:10:24,126][INFO ][disco-notifier-worker-#20072%grid-0%][MasterKeyChangeConsistencyCheckTest$TestKeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:10:24] : [Step 4/5] [2021-11-19 21:10:24,480][INFO ][disco-notifier-worker-#20072%grid-0%][GridEncryptionManager] Master key successfully changed [masterKeyName=ignite.master.key2] [21:10:24] : [Step 4/5] [2021-11-19 21:10:24,480][INFO ][disco-notifier-worker-#20190%grid-1%][GridEncryptionManager] Master key successfully changed [masterKeyName=ignite.master.key2] [21:10:24] : [Step 4/5] [2021-11-19 21:10:24,481][INFO ][db-checkpoint-thread-#20209%grid-1%][Checkpointer] Checkpoint finished [cpId=b8755251-39f0-471f-ae91-6f84d242b79e, pages=16, markPos=WALPointer [idx=0, fileOff=66667, len=1963], walSegmentsCovered=[], markDuration=109ms, pagesWrite=1ms, fsync=2017ms, total=2187ms] [21:10:24] : [Step 4/5] [2021-11-19 21:10:24,481][INFO ][db-checkpoint-thread-#20208%grid-0%][Checkpointer] Checkpoint finished [cpId=42a565d3-9c84-494c-aad7-5b5010e1fa31, pages=17, markPos=WALPointer [idx=0, fileOff=75252, len=1963], walSegmentsCovered=[], markDuration=109ms, pagesWrite=1ms, fsync=2016ms, total=2189ms] [21:10:24] : [Step 4/5] [21:10:24] >>> Stopping test: MasterKeyChangeConsistencyCheckTest#testRejectMasterKeyChangeWithKeyConsistencyProblems in 4900 ms <<< [21:10:24] : [Step 4/5] [2021-11-19 21:10:24,482][INFO ][main][root] >>> Stopping test: MasterKeyChangeConsistencyCheckTest#testRejectMasterKeyChangeWithKeyConsistencyProblems in 4900 ms <<< [21:10:24] : [Step 4/5] [21:10:24] >>> Heap: 413 MB used / 1931 MB commited / 1931 MB max <<< [21:10:24] : [Step 4/5] [2021-11-19 21:10:24,483][INFO ][main][root] >>> Heap: 413 MB used / 1931 MB commited / 1931 MB max <<< [21:10:24] : [Step 4/5] [21:10:24] >>> Non-Heap: 155 MB used / 182 MB commited / 0 MB max <<< [21:10:24] : [Step 4/5] [2021-11-19 21:10:24,483][INFO ][main][root] >>> Non-Heap: 155 MB used / 182 MB commited / 0 MB max <<< [21:10:24] : [Step 4/5] [2021-11-19 21:10:24,484][INFO ][main][root] >>> Stopping grid [name=grid-1, id=1055104a-b6c6-48ff-b238-a0e22c7c0001] [21:10:24] : [Step 4/5] [2021-11-19 21:10:24,497][INFO ][db-checkpoint-thread-#20209%grid-1%][Checkpointer] Checkpoint started [checkpointId=34b60739-4e70-4e76-a30a-cd048c367338, startPtr=WALPointer [idx=0, fileOff=93187, len=1947], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=1ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=0ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=0ms, pages=7, reason='timeout'] [21:10:24] : [Step 4/5] [2021-11-19 21:10:24,503][INFO ][disco-event-worker-#20076%grid-0%][GridDiscoveryManager] Node left topology: TcpDiscoveryNode [id=1055104a-b6c6-48ff-b238-a0e22c7c0001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637345422197, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false] [21:10:24] : [Step 4/5] [2021-11-19 21:10:24,503][INFO ][disco-event-worker-#20076%grid-0%][GridDiscoveryManager] Topology snapshot [ver=3, locNode=0008e4b0, servers=1, clients=0, state=ACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=0008e4b0-ddf1-4d07-ad27-2aa410fed000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:10:24] : [Step 4/5] [2021-11-19 21:10:24,504][INFO ][tcp-disco-sock-reader-[0008e4b0 127.0.0.1:42007]-#1059%grid-1%-#20195%grid-1%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:42007, rmtPort=42007, rmtNodeId=0008e4b0-ddf1-4d07-ad27-2aa410fed000] [21:10:24] : [Step 4/5] [2021-11-19 21:10:24,505][INFO ][disco-event-worker-#20076%grid-0%][GridDiscoveryManager] ^-- Baseline [id=0, size=2, online=1, offline=1] [21:10:24] : [Step 4/5] [2021-11-19 21:10:24,506][INFO ][main][GridCacheProcessor] Stopped cache [cacheName=ignite-sys-cache] [21:10:24]W: [org.apache.ignite:ignite-core] [2021-11-19 21:10:24,507][WARN ][grid-nio-worker-tcp-comm-0-#20016%TcpCommunicationSpi%][TcpCommunicationSpi] Failed to shutdown socket [21:10:24]W: [org.apache.ignite:ignite-core] java.nio.channels.ClosedChannelException [21:10:24]W: [org.apache.ignite:ignite-core] at sun.nio.ch.SocketChannelImpl.shutdownOutput(SocketChannelImpl.java:795) [21:10:24]W: [org.apache.ignite:ignite-core] at sun.nio.ch.SocketAdaptor.shutdownOutput(SocketAdaptor.java:407) [21:10:24]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.close(IgniteUtils.java:4247) [21:10:24]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.closeKey(GridNioServer.java:2784) [21:10:24]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.close(GridNioServer.java:2835) [21:10:24]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.close(GridNioServer.java:2794) [21:10:24]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.bodyInternal(GridNioServer.java:2157) [21:10:24]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.body(GridNioServer.java:1910) [21:10:24]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:125) [21:10:24]W: [org.apache.ignite:ignite-core] at java.lang.Thread.run(Thread.java:748) [21:10:24] : [Step 4/5] [2021-11-19 21:10:24,509][INFO ][exchange-worker-#20077%grid-0%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], crd=true, evt=NODE_LEFT, evtNode=1055104a-b6c6-48ff-b238-a0e22c7c0001, customEvt=null, allowMerge=false, exchangeFreeSwitch=true] [21:10:24] : [Step 4/5] [2021-11-19 21:10:24,510][INFO ][exchange-worker-#20077%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:10:24] : [Step 4/5] [2021-11-19 21:10:24,511][INFO ][exchange-worker-#20077%grid-0%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], err=null, rebalanced=true, wasRebalanced=true] [21:10:24] : [Step 4/5] [2021-11-19 21:10:24,512][INFO ][exchange-worker-#20077%grid-0%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=0008e4b0-ddf1-4d07-ad27-2aa410fed000, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], evt=NODE_LEFT, evtNode=TcpDiscoveryNode [id=1055104a-b6c6-48ff-b238-a0e22c7c0001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637345422197, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0]] [21:10:24] : [Step 4/5] [2021-11-19 21:10:24,513][INFO ][exchange-worker-#20077%grid-0%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (1 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="After states restored callback" (0 ms), stage="WAL history reservation" (0 ms), stage="Finalize update counters" (0 ms), stage="Detect lost partitions" (0 ms), stage="Exchange done" (1 ms), stage="Total time" (2 ms)] [21:10:24] : [Step 4/5] [2021-11-19 21:10:24,514][INFO ][exchange-worker-#20077%grid-0%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], stage="Affinity initialization (exchange-free switch on fully-rebalanced topology) [grp=ignite-sys-cache]" (0 ms) (parent=Determine exchange type)] [21:10:24] : [Step 4/5] [2021-11-19 21:10:24,514][INFO ][exchange-worker-#20077%grid-0%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], crd=true] [21:10:24] : [Step 4/5] [2021-11-19 21:10:24,515][INFO ][exchange-worker-#20077%grid-0%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=3, minorTopVer=0], force=false, evt=NODE_LEFT, node=1055104a-b6c6-48ff-b238-a0e22c7c0001] [21:10:25] : [Step 4/5] [2021-11-19 21:10:25,808][INFO ][main][FilePageStoreManager] Cleanup cache stores [total=3, left=0, cleanFiles=false] [21:10:25] : [Step 4/5] [2021-11-19 21:10:25,810][INFO ][main][GridDeploymentLocalStore] Removed undeployed class: GridDeployment [ts=1637345422440, depMode=SHARED, clsLdr=IsolatedClassLoader{roleName='test'}, clsLdrId=ffb7d593d71-1055104a-b6c6-48ff-b238-a0e22c7c0001, userVer=0, loc=true, sampleClsName=org.apache.ignite.internal.processors.cache.distributed.dht.preloader.GridDhtPartitionFullMap, pendingUndeploy=false, undeployed=true, usage=0] [21:10:25] : [Step 4/5] [2021-11-19 21:10:25,824][INFO ][main][IgniteKernal%grid-1] [21:10:25] : [Step 4/5] [21:10:25] : [Step 4/5] >>> +------------------------------------------------------+ [21:10:25] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV stopped OK [21:10:25] : [Step 4/5] >>> +------------------------------------------------------+ [21:10:25] : [Step 4/5] >>> Ignite instance name: grid-1 [21:10:25] : [Step 4/5] >>> Grid uptime: 00:00:03.576 [21:10:25] : [Step 4/5] [21:10:25] : [Step 4/5] [21:10:25] : [Step 4/5] [2021-11-19 21:10:25,825][INFO ][main][root] >>> Stopping grid [name=grid-0, id=0008e4b0-ddf1-4d07-ad27-2aa410fed000] [21:10:25] : [Step 4/5] [2021-11-19 21:10:25,837][INFO ][db-checkpoint-thread-#20208%grid-0%][Checkpointer] Checkpoint started [checkpointId=da5b3644-8ccb-4557-b39d-b7a59e4595b4, startPtr=WALPointer [idx=0, fileOff=109137, len=1947], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=1ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=0ms, writeCheckpointEntryDuration=2ms, splitAndSortCpPagesDuration=0ms, pages=7, reason='timeout'] [21:10:25]W: [org.apache.ignite:ignite-core] [2021-11-19 21:10:25,844][WARN ][tcp-disco-sock-reader-[1055104a 127.0.0.1:45927]-#1060%grid-0%-#20196%grid-0%][TestTcpDiscoverySpi] Failed to shutdown socket [21:10:25]W: [org.apache.ignite:ignite-core] java.net.SocketException: Socket is closed [21:10:25]W: [org.apache.ignite:ignite-core] at java.net.Socket.shutdownOutput(Socket.java:1568) [21:10:25]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.close(IgniteUtils.java:4247) [21:10:25]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.discovery.tcp.ServerImpl$SocketReader.body(ServerImpl.java:7370) [21:10:25]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.IgniteSpiThread.run(IgniteSpiThread.java:58) [21:10:25] : [Step 4/5] [2021-11-19 21:10:25,845][INFO ][tcp-disco-sock-reader-[1055104a 127.0.0.1:45927]-#1060%grid-0%-#20196%grid-0%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:45927, rmtPort=45927, rmtNodeId=1055104a-b6c6-48ff-b238-a0e22c7c0001] [21:10:25] : [Step 4/5] [2021-11-19 21:10:25,847][INFO ][main][GridCacheProcessor] Stopped cache [cacheName=ignite-sys-cache] [21:10:27] : [Step 4/5] [2021-11-19 21:10:27,011][INFO ][main][FilePageStoreManager] Cleanup cache stores [total=3, left=0, cleanFiles=false] [21:10:27] : [Step 4/5] [2021-11-19 21:10:27,013][INFO ][main][GridDeploymentLocalStore] Removed undeployed class: GridDeployment [ts=1637345422430, depMode=SHARED, clsLdr=IsolatedClassLoader{roleName='test'}, clsLdrId=dfb7d593d71-0008e4b0-ddf1-4d07-ad27-2aa410fed000, userVer=0, loc=true, sampleClsName=org.apache.ignite.internal.processors.cache.distributed.dht.preloader.GridDhtPartitionMap, pendingUndeploy=false, undeployed=true, usage=0] [21:10:27] : [Step 4/5] [2021-11-19 21:10:27,023][INFO ][main][IgniteKernal%grid-0] [21:10:27] : [Step 4/5] [21:10:27] : [Step 4/5] >>> +------------------------------------------------------+ [21:10:27] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV stopped OK [21:10:27] : [Step 4/5] >>> +------------------------------------------------------+ [21:10:27] : [Step 4/5] >>> Ignite instance name: grid-0 [21:10:27] : [Step 4/5] >>> Grid uptime: 00:00:05.977 [21:10:27] : [Step 4/5] [21:10:27] : [Step 4/5] [21:10:27] : [Step 4/5] [21:10:27] >>> Starting test: MasterKeyChangeConsistencyCheckTest#testFailureHandledOnFailPerformMasterKeyChange <<< [21:10:27] : [Step 4/5] [2021-11-19 21:10:27,174][INFO ][main][root] >>> Starting test: MasterKeyChangeConsistencyCheckTest#testFailureHandledOnFailPerformMasterKeyChange <<< [21:10:27] : [Step 4/5] [21:10:27] >>> Heap: 417 MB used / 1931 MB commited / 1931 MB max <<< [21:10:27] : [Step 4/5] [2021-11-19 21:10:27,175][INFO ][main][root] >>> Heap: 417 MB used / 1931 MB commited / 1931 MB max <<< [21:10:27] : [Step 4/5] [21:10:27] >>> Non-Heap: 156 MB used / 182 MB commited / 0 MB max <<< [21:10:27] : [Step 4/5] [2021-11-19 21:10:27,175][INFO ][main][root] >>> Non-Heap: 156 MB used / 182 MB commited / 0 MB max <<< [21:10:27]W: [org.apache.ignite:ignite-core] [2021-11-19 21:10:27,181][WARN ][test-runner-#20229%encryption.MasterKeyChangeConsistencyCheckTest%][G] Ignite work directory is not provided, automatically resolved to: /opt/buildagent/work/7bc1c54bc719b67c/work [21:10:27] : [Step 4/5] [2021-11-19 21:10:27,184][INFO ][test-runner-#20229%encryption.MasterKeyChangeConsistencyCheckTest%][IgniteKernal%grid-0] [21:10:27] : [Step 4/5] [21:10:27] : [Step 4/5] >>> __________ ________________ [21:10:27] : [Step 4/5] >>> / _/ ___/ |/ / _/_ __/ __/ [21:10:27] : [Step 4/5] >>> _/ // (7 7 // / / / / _/ [21:10:27] : [Step 4/5] >>> /___/\___/_/|_/___/ /_/ /___/ [21:10:27] : [Step 4/5] >>> [21:10:27] : [Step 4/5] >>> ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:10:27] : [Step 4/5] >>> 2021 Copyright(C) Apache Software Foundation [21:10:27] : [Step 4/5] >>> [21:10:27] : [Step 4/5] >>> Ignite documentation: http://ignite.apache.org [21:10:27] : [Step 4/5] [21:10:27] : [Step 4/5] [2021-11-19 21:10:27,185][INFO ][test-runner-#20229%encryption.MasterKeyChangeConsistencyCheckTest%][IgniteKernal%grid-0] Config URL: n/a [21:10:27] : [Step 4/5] [2021-11-19 21:10:27,186][INFO ][test-runner-#20229%encryption.MasterKeyChangeConsistencyCheckTest%][IgniteKernal%grid-0] IgniteConfiguration [igniteInstanceName=grid-0, pubPoolSize=24, svcPoolSize=24, callbackPoolSize=24, stripedPoolSize=24, sysPoolSize=24, mgmtPoolSize=4, dataStreamerPoolSize=24, utilityCachePoolSize=24, utilityCacheKeepAliveTime=60000, p2pPoolSize=2, qryPoolSize=24, buildIdxPoolSize=4, igniteHome=/opt/buildagent/work/7bc1c54bc719b67c, igniteWorkDir=/opt/buildagent/work/7bc1c54bc719b67c/work, mbeanSrv=com.sun.jmx.mbeanserver.JmxMBeanServer@6fe85038, nodeId=00ccd666-fbef-4b00-9ba6-82602e1ab000, marsh=BinaryMarshaller [], marshLocJobs=false, daemon=false, p2pEnabled=true, netTimeout=10000, netCompressionLevel=1, sndRetryDelay=1000, sndRetryCnt=3, metricsHistSize=10000, metricsUpdateFreq=1000, metricsExpTime=9223372036854775807, discoSpi=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=0, ackTimeout=0, marsh=null, reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], segPlc=STOP, segResolveAttempts=2, waitForSegOnStart=true, allResolversPassReq=true, segChkFreq=10000, commSpi=TcpCommunicationSpi [connectGate=org.apache.ignite.spi.communication.tcp.internal.ConnectGateway@43171aaa, ctxInitLatch=java.util.concurrent.CountDownLatch@6e7b3e5c[Count = 1], stopping=false, clientPool=null, nioSrvWrapper=null, stateProvider=null], evtSpi=MemoryEventStorageSpi [expireAgeMs=9223372036854775807, expireCnt=10000, filter=null], colSpi=NoopCollisionSpi [], deploySpi=LocalDeploymentSpi [], indexingSpi=org.apache.ignite.spi.indexing.noop.NoopIndexingSpi@650b0c5f, addrRslvr=null, encryptionSpi=org.apache.ignite.internal.encryption.MasterKeyChangeConsistencyCheckTest$TestKeystoreEncryptionSpi@2057c943, tracingSpi=org.apache.ignite.spi.tracing.NoopTracingSpi@6ff62f0f, clientMode=false, rebalanceThreadPoolSize=4, rebalanceTimeout=10000, rebalanceBatchesPrefetchCnt=3, rebalanceThrottle=0, rebalanceBatchSize=524288, txCfg=TransactionConfiguration [txSerEnabled=false, dfltIsolation=REPEATABLE_READ, dfltConcurrency=PESSIMISTIC, dfltTxTimeout=0, txTimeoutOnPartitionMapExchange=0, deadlockTimeout=10000, pessimisticTxLogSize=0, pessimisticTxLogLinger=10000, tmLookupClsName=null, txManagerFactory=null, useJtaSync=false], cacheSanityCheckEnabled=true, discoStartupDelay=60000, deployMode=SHARED, p2pMissedCacheSize=100, locHost=127.0.0.1, timeSrvPortBase=31100, timeSrvPortRange=100, failureDetectionTimeout=10000, sysWorkerBlockedTimeout=null, clientFailureDetectionTimeout=10000, metricsLogFreq=0, connectorCfg=null, odbcCfg=null, warmupClos=null, atomicCfg=AtomicConfiguration [seqReserveSize=1000, cacheMode=PARTITIONED, backups=1, aff=null, grpName=null], classLdr=null, sslCtxFactory=null, platformCfg=null, binaryCfg=null, memCfg=null, pstCfg=null, dsCfg=DataStorageConfiguration [sysRegionInitSize=41943040, sysRegionMaxSize=104857600, pageSize=4096, concLvl=0, dfltDataRegConf=DataRegionConfiguration [name=default, maxSize=10485760, initSize=268435456, swapPath=null, pageEvictionMode=DISABLED, pageReplacementMode=CLOCK, evictionThreshold=0.9, emptyPagesPoolSize=100, metricsEnabled=false, metricsSubIntervalCount=5, metricsRateTimeInterval=60000, persistenceEnabled=true, checkpointPageBufSize=0, lazyMemoryAllocation=true, warmUpCfg=null], dataRegions=null, storagePath=null, checkpointFreq=180000, lockWaitTime=10000, checkpointThreads=4, checkpointWriteOrder=SEQUENTIAL, walHistSize=20, maxWalArchiveSize=1073741824, walSegments=10, walSegmentSize=67108864, walPath=db/wal, walArchivePath=db/wal/archive, cdcWalPath=db/wal/cdc, cdcEnabled=false, metricsEnabled=false, walMode=FSYNC, walTlbSize=131072, walBuffSize=0, walFlushFreq=2000, walFsyncDelay=1000, walRecordIterBuffSize=67108864, alwaysWriteFullPages=false, fileIOFactory=org.apache.ignite.internal.processors.cache.persistence.file.AsyncFileIOFactory@41f2dabb, metricsSubIntervalCnt=5, metricsRateTimeInterval=60000, walAutoArchiveAfterInactivity=-1, walForceArchiveTimeout=-1, writeThrottlingEnabled=false, walCompactionEnabled=false, walCompactionLevel=1, checkpointReadLockTimeout=null, walPageCompression=DISABLED, walPageCompressionLevel=null, dfltWarmUpCfg=null, encCfg=org.apache.ignite.configuration.EncryptionConfiguration@2b71908a, defragmentationThreadPoolSize=4, minWalArchiveSize=-1], snapshotPath=snapshots, activeOnStart=true, activeOnStartPropSetFlag=false, autoActivation=true, autoActivationPropSetFlag=false, clusterStateOnStart=null, sqlConnCfg=null, cliConnCfg=ClientConnectorConfiguration [host=null, port=10800, portRange=100, sockSndBufSize=0, sockRcvBufSize=0, tcpNoDelay=true, maxOpenCursorsPerConn=128, threadPoolSize=24, selectorCnt=12, idleTimeout=0, handshakeTimeout=10000, jdbcEnabled=true, odbcEnabled=true, thinCliEnabled=true, sslEnabled=false, useIgniteSslCtxFactory=true, sslClientAuth=false, sslCtxFactory=null, thinCliCfg=ThinClientConfiguration [maxActiveTxPerConn=100, maxActiveComputeTasksPerConn=0]], mvccVacuumThreadCnt=2, mvccVacuumFreq=5000, authEnabled=false, failureHnd=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]], commFailureRslvr=null, sqlCfg=SqlConfiguration [longQryWarnTimeout=3000, dfltQryTimeout=0, sqlQryHistSize=1000, validationEnabled=false], asyncContinuationExecutor=null] [21:10:27] : [Step 4/5] [2021-11-19 21:10:27,195][INFO ][test-runner-#20229%encryption.MasterKeyChangeConsistencyCheckTest%][IgniteKernal%grid-0] Daemon mode: off [21:10:27] : [Step 4/5] [2021-11-19 21:10:27,195][INFO ][test-runner-#20229%encryption.MasterKeyChangeConsistencyCheckTest%][IgniteKernal%grid-0] OS: Linux 4.15.0-151-generic amd64 [21:10:27] : [Step 4/5] [2021-11-19 21:10:27,195][INFO ][test-runner-#20229%encryption.MasterKeyChangeConsistencyCheckTest%][IgniteKernal%grid-0] OS user: teamcity [21:10:27] : [Step 4/5] [2021-11-19 21:10:27,195][INFO ][test-runner-#20229%encryption.MasterKeyChangeConsistencyCheckTest%][IgniteKernal%grid-0] PID: 16724 [21:10:27] : [Step 4/5] [2021-11-19 21:10:27,196][INFO ][test-runner-#20229%encryption.MasterKeyChangeConsistencyCheckTest%][IgniteKernal%grid-0] Language runtime: Java Platform API Specification ver. 1.8 [21:10:27] : [Step 4/5] [2021-11-19 21:10:27,196][INFO ][test-runner-#20229%encryption.MasterKeyChangeConsistencyCheckTest%][IgniteKernal%grid-0] VM information: Java(TM) SE Runtime Environment 1.8.0_261-b12 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 25.261-b12 [21:10:27] : [Step 4/5] [2021-11-19 21:10:27,196][INFO ][test-runner-#20229%encryption.MasterKeyChangeConsistencyCheckTest%][IgniteKernal%grid-0] VM total memory: 1.9GB [21:10:27] : [Step 4/5] [2021-11-19 21:10:27,196][INFO ][test-runner-#20229%encryption.MasterKeyChangeConsistencyCheckTest%][IgniteKernal%grid-0] Remote Management [restart: off, REST: off, JMX (remote: off)] [21:10:27] : [Step 4/5] [2021-11-19 21:10:27,197][INFO ][test-runner-#20229%encryption.MasterKeyChangeConsistencyCheckTest%][IgniteKernal%grid-0] Logger: GridTestLog4jLogger [quiet=false, config=null] [21:10:27] : [Step 4/5] [2021-11-19 21:10:27,197][INFO ][test-runner-#20229%encryption.MasterKeyChangeConsistencyCheckTest%][IgniteKernal%grid-0] IGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c [21:10:27] : [Step 4/5] [2021-11-19 21:10:27,197][INFO ][test-runner-#20229%encryption.MasterKeyChangeConsistencyCheckTest%][IgniteKernal%grid-0] VM arguments: [-DIGNITE_DUMP_THREADS_ON_FAILURE=false, -DMono=/usr/bin/mono-sgen, -DMono4.0_x64=/usr/lib/mono/4.0, -DMono4.5_x64=/usr/lib/mono/4.5, -DMonoVersion=6.12.0.90, -DSKIP_BUILD=false, -Dagent.home.dir=/opt/buildagent, -Dagent.name=aitc-lin02_03, -Dagent.ownPort=9090, -Dagent.work.dir=/opt/buildagent/work, -Dbuild.number=95, -Dbuild.vcs.number=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.1=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.GitHubApacheIgnite=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dclassworlds.conf=/opt/buildagent/temp/buildTmp/teamcity.m2.conf, -Dcom.jetbrains.maven.watcher.report.file=/opt/buildagent/temp/buildTmp/maven-build-info.xml, -Djava.io.tmpdir=/opt/buildagent/temp/buildTmp, -Dmaven.home=/opt/buildagent/tools/maven3_6, -Dmaven.multiModuleProjectDirectory=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.agent.cpuBenchmark=457, -Dteamcity.agent.dotnet.agent_url=http://localhost:9090/RPC2, -Dteamcity.agent.dotnet.build_id=6278078, -Dteamcity.auth.password=*******, -Dteamcity.auth.userId=TeamCityBuildId=6278078, -Dteamcity.build.changedFiles.file=/opt/buildagent/temp/buildTmp/changedFiles6342607772318147725.txt, -Dteamcity.build.checkoutDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.build.id=6278078, -Dteamcity.build.properties.file=/opt/buildagent/temp/buildTmp/teamcity.build5164517880467851002.properties, -Dteamcity.build.tempDir=/opt/buildagent/temp/buildTmp, -Dteamcity.build.workingDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.buildConfName=Basic 3, -Dteamcity.buildType.id=IgniteTests24Java8_Basic3, -Dteamcity.configuration.properties.file=/opt/buildagent/temp/buildTmp/teamcity.config5591980786735343870.properties, -Dteamcity.maven.userSettings.path=/opt/buildagent/temp/buildTmp/maven_settings_585072866407032347.xml, -Dteamcity.maven.watcher.home=/opt/buildagent/plugins/mavenPlugin/maven-watcher-jdk16, -Dteamcity.projectName=Ignite Tests 2.x (JDK 8/11), -Dteamcity.runner.properties.file=/opt/buildagent/temp/buildTmp/teamcity.runner9098465561618137420.properties, -Dteamcity.tests.recentlyFailedTests.file=/opt/buildagent/temp/buildTmp/testsToRunFirst3891775683130404069.txt, -Dteamcity.version=2021.2 (build 99542), -ea, -Xms2g, -Xmx2g, -XX:+HeapDumpOnOutOfMemoryError, -DIGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_TEST_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_UPDATE_NOTIFIER=false, -DIGNITE_NO_DISCO_ORDER=true, -DIGNITE_PERFORMANCE_SUGGESTIONS_DISABLED=true, -Djava.net.preferIPv4Stack=true, -DTEST_SCALE_FACTOR=1.0, -DIGNITE_TEST_PROP_LOG4J_FILE=log4j-tc-test.xml, -DIGNITE_QUIET=false, -DIGNITE_MARSHAL_BUFFERS_RECHECK=1000, -Dmaven.repo.local=/opt/buildagent/.m2/repository] [21:10:27] : [Step 4/5] [2021-11-19 21:10:27,202][INFO ][test-runner-#20229%encryption.MasterKeyChangeConsistencyCheckTest%][IgniteKernal%grid-0] System cache's DataRegion size is configured to 40 MB. Use DataStorageConfiguration.systemRegionInitialSize property to change the setting. [21:10:27] : [Step 4/5] [2021-11-19 21:10:27,202][INFO ][test-runner-#20229%encryption.MasterKeyChangeConsistencyCheckTest%][IgniteKernal%grid-0] Configured caches [in 'sysMemPlc' dataRegion: ['ignite-sys-cache']] [21:10:27]W: [org.apache.ignite:ignite-core] [2021-11-19 21:10:27,203][WARN ][test-runner-#20229%encryption.MasterKeyChangeConsistencyCheckTest%][IgniteKernal%grid-0] Peer class loading is enabled (disable it in production for performance and deployment consistency reasons) [21:10:27] : [Step 4/5] [2021-11-19 21:10:27,203][INFO ][test-runner-#20229%encryption.MasterKeyChangeConsistencyCheckTest%][IgniteKernal%grid-0] 3-rd party licenses can be found at: /opt/buildagent/work/7bc1c54bc719b67c/libs/licenses [21:10:27] : [Step 4/5] [2021-11-19 21:10:27,207][INFO ][test-runner-#20229%encryption.MasterKeyChangeConsistencyCheckTest%][IgnitePluginProcessor] Configured plugins: [21:10:27] : [Step 4/5] [2021-11-19 21:10:27,207][INFO ][test-runner-#20229%encryption.MasterKeyChangeConsistencyCheckTest%][IgnitePluginProcessor] ^-- StanByClusterTestProvider 1.0 [21:10:27] : [Step 4/5] [2021-11-19 21:10:27,207][INFO ][test-runner-#20229%encryption.MasterKeyChangeConsistencyCheckTest%][IgnitePluginProcessor] ^-- null [21:10:27] : [Step 4/5] [2021-11-19 21:10:27,207][INFO ][test-runner-#20229%encryption.MasterKeyChangeConsistencyCheckTest%][IgnitePluginProcessor] [21:10:27] : [Step 4/5] [2021-11-19 21:10:27,207][INFO ][test-runner-#20229%encryption.MasterKeyChangeConsistencyCheckTest%][IgnitePluginProcessor] ^-- PageMemory tracker plugin 1.0 [21:10:27] : [Step 4/5] [2021-11-19 21:10:27,208][INFO ][test-runner-#20229%encryption.MasterKeyChangeConsistencyCheckTest%][IgnitePluginProcessor] ^-- null [21:10:27] : [Step 4/5] [2021-11-19 21:10:27,208][INFO ][test-runner-#20229%encryption.MasterKeyChangeConsistencyCheckTest%][IgnitePluginProcessor] [21:10:27] : [Step 4/5] [2021-11-19 21:10:27,208][INFO ][test-runner-#20229%encryption.MasterKeyChangeConsistencyCheckTest%][IgnitePluginProcessor] ^-- TestDistibutedConfigurationPlugin 1.0 [21:10:27] : [Step 4/5] [2021-11-19 21:10:27,208][INFO ][test-runner-#20229%encryption.MasterKeyChangeConsistencyCheckTest%][IgnitePluginProcessor] ^-- null [21:10:27] : [Step 4/5] [2021-11-19 21:10:27,208][INFO ][test-runner-#20229%encryption.MasterKeyChangeConsistencyCheckTest%][IgnitePluginProcessor] [21:10:27] : [Step 4/5] [2021-11-19 21:10:27,209][INFO ][test-runner-#20229%encryption.MasterKeyChangeConsistencyCheckTest%][IgnitePluginProcessor] ^-- NodeValidationPluginProvider 1.0 [21:10:27] : [Step 4/5] [2021-11-19 21:10:27,209][INFO ][test-runner-#20229%encryption.MasterKeyChangeConsistencyCheckTest%][IgnitePluginProcessor] ^-- null [21:10:27] : [Step 4/5] [2021-11-19 21:10:27,209][INFO ][test-runner-#20229%encryption.MasterKeyChangeConsistencyCheckTest%][IgnitePluginProcessor] [21:10:27] : [Step 4/5] [2021-11-19 21:10:27,209][INFO ][test-runner-#20229%encryption.MasterKeyChangeConsistencyCheckTest%][FailureProcessor] Configured failure handler: [hnd=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]] [21:10:27] : [Step 4/5] [2021-11-19 21:10:27,218][INFO ][test-runner-#20229%encryption.MasterKeyChangeConsistencyCheckTest%][TcpCommunicationSpi] Successfully bound communication NIO server to TCP port [port=45200, locHost=/127.0.0.1, selectorsCnt=12, selectorSpins=0, pairedConn=false] [21:10:27]W: [org.apache.ignite:ignite-core] [2021-11-19 21:10:27,219][WARN ][test-runner-#20229%encryption.MasterKeyChangeConsistencyCheckTest%][TcpCommunicationSpi] Message queue limit is set to 0 which may lead to potential OOMEs when running cache operations in FULL_ASYNC or PRIMARY_SYNC modes due to message queues growth on sender and receiver sides. [21:10:27] : [Step 4/5] [2021-11-19 21:10:27,223][INFO ][test-runner-#20229%encryption.MasterKeyChangeConsistencyCheckTest%][GridCollisionManager] Collision resolution is disabled (all jobs will be activated upon arrival). [21:10:27] : [Step 4/5] [2021-11-19 21:10:27,223][INFO ][test-runner-#20229%encryption.MasterKeyChangeConsistencyCheckTest%][IgniteKernal%grid-0] Security status [authentication=off, sandbox=off, tls/ssl=off] [21:10:27] : [Step 4/5] [2021-11-19 21:10:27,281][INFO ][test-runner-#20229%encryption.MasterKeyChangeConsistencyCheckTest%][MasterKeyChangeConsistencyCheckTest$TestKeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:10:27] : [Step 4/5] [2021-11-19 21:10:27,367][INFO ][test-runner-#20229%encryption.MasterKeyChangeConsistencyCheckTest%][MaintenanceProcessor] Resolved store directory for node persistent data: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0 [21:10:27] : [Step 4/5] [2021-11-19 21:10:27,368][INFO ][test-runner-#20229%encryption.MasterKeyChangeConsistencyCheckTest%][CacheObjectBinaryProcessorImpl] Resolved directory for serialized binary metadata: /opt/buildagent/work/7bc1c54bc719b67c/work/db/binary_meta/grid_0 [21:10:27] : [Step 4/5] [2021-11-19 21:10:27,371][INFO ][test-runner-#20229%encryption.MasterKeyChangeConsistencyCheckTest%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0 [21:10:27] : [Step 4/5] [2021-11-19 21:10:27,372][INFO ][test-runner-#20229%encryption.MasterKeyChangeConsistencyCheckTest%][FileWriteAheadLogManager] Resolved write ahead log work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0 [21:10:27] : [Step 4/5] [2021-11-19 21:10:27,372][INFO ][test-runner-#20229%encryption.MasterKeyChangeConsistencyCheckTest%][FileWriteAheadLogManager] Resolved write ahead log archive directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0 [21:10:28] : [Step 4/5] [2021-11-19 21:10:28,353][INFO ][test-runner-#20229%encryption.MasterKeyChangeConsistencyCheckTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000000.wal [21:10:28]W: [org.apache.ignite:ignite-core] [2021-11-19 21:10:28,354][WARN ][test-runner-#20229%encryption.MasterKeyChangeConsistencyCheckTest%][GridCacheDatabaseSharedManager] DataRegion maxSize=10.5 MB is smaller than defaultInitialSize=268.4 MB, setting initialSize to 10.5 MB [21:10:28] : [Step 4/5] [2021-11-19 21:10:28,358][INFO ][test-runner-#20229%encryption.MasterKeyChangeConsistencyCheckTest%][GridCacheDatabaseSharedManager] Configured data regions initialized successfully [total=5] [21:10:28] : [Step 4/5] [2021-11-19 21:10:28,359][INFO ][test-runner-#20229%encryption.MasterKeyChangeConsistencyCheckTest%][IgniteSnapshotManager] Resolved snapshot work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/snapshots [21:10:28] : [Step 4/5] [2021-11-19 21:10:28,360][INFO ][test-runner-#20229%encryption.MasterKeyChangeConsistencyCheckTest%][IgniteSnapshotManager] Resolved temp directory for snapshot creation: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0/snp [21:10:28] : [Step 4/5] [2021-11-19 21:10:28,361][INFO ][test-runner-#20229%encryption.MasterKeyChangeConsistencyCheckTest%][ClientListenerProcessor] Client connector processor has started on TCP port 10800 [21:10:28] : [Step 4/5] [2021-11-19 21:10:28,366][INFO ][test-runner-#20229%encryption.MasterKeyChangeConsistencyCheckTest%][IgniteKernal%grid-0] Non-loopback local IPs: 172.17.0.4 [21:10:28] : [Step 4/5] [2021-11-19 21:10:28,366][INFO ][test-runner-#20229%encryption.MasterKeyChangeConsistencyCheckTest%][IgniteKernal%grid-0] Enabled local MACs: 0242AC110004 [21:10:28] : [Step 4/5] [2021-11-19 21:10:28,368][INFO ][test-runner-#20229%encryption.MasterKeyChangeConsistencyCheckTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:10:28] : [Step 4/5] [2021-11-19 21:10:28,369][INFO ][test-runner-#20229%encryption.MasterKeyChangeConsistencyCheckTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:10:28] : [Step 4/5] [2021-11-19 21:10:28,369][INFO ][test-runner-#20229%encryption.MasterKeyChangeConsistencyCheckTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:10:28] : [Step 4/5] [2021-11-19 21:10:28,370][INFO ][test-runner-#20229%encryption.MasterKeyChangeConsistencyCheckTest%][GridCacheDatabaseSharedManager] Applying lost metastore updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:10:28] : [Step 4/5] [2021-11-19 21:10:28,371][INFO ][test-runner-#20229%encryption.MasterKeyChangeConsistencyCheckTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=0 ms] [21:10:28] : [Step 4/5] [2021-11-19 21:10:28,371][INFO ][test-runner-#20229%encryption.MasterKeyChangeConsistencyCheckTest%][GridCacheProcessor] Restoring partition state for local groups. [21:10:28] : [Step 4/5] [2021-11-19 21:10:28,372][INFO ][test-runner-#20229%encryption.MasterKeyChangeConsistencyCheckTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=0, partitionsProcessed=0, time=0ms] [21:10:28] : [Step 4/5] [2021-11-19 21:10:28,372][INFO ][test-runner-#20229%encryption.MasterKeyChangeConsistencyCheckTest%][GridEncryptionManager] Encryption keys loaded from metastore. [grps=, masterKeyName=ignite.master.key] [21:10:28] : [Step 4/5] [2021-11-19 21:10:28,376][INFO ][test-runner-#20229%encryption.MasterKeyChangeConsistencyCheckTest%][ClusterProcessor] Cluster ID and tag has been read from metastorage: null [21:10:28] : [Step 4/5] [2021-11-19 21:10:28,376][INFO ][test-runner-#20229%encryption.MasterKeyChangeConsistencyCheckTest%][IgniteClusterImpl] Shutdown policy was updated [oldVal=null, newVal=null] [21:10:28] : [Step 4/5] [2021-11-19 21:10:28,376][INFO ][test-runner-#20229%encryption.MasterKeyChangeConsistencyCheckTest%][GridCacheDatabaseSharedManager] Checkpoint frequency deviation changed [oldVal=null, newVal=null] [21:10:28] : [Step 4/5] [2021-11-19 21:10:28,394][INFO ][test-runner-#20229%encryption.MasterKeyChangeConsistencyCheckTest%][FilePageStoreManager] Cleanup cache stores [total=1, left=0, cleanFiles=false] [21:10:28] : [Step 4/5] [2021-11-19 21:10:28,395][INFO ][test-runner-#20229%encryption.MasterKeyChangeConsistencyCheckTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:10:28] : [Step 4/5] [2021-11-19 21:10:28,396][INFO ][test-runner-#20229%encryption.MasterKeyChangeConsistencyCheckTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:10:28] : [Step 4/5] [2021-11-19 21:10:28,397][INFO ][test-runner-#20229%encryption.MasterKeyChangeConsistencyCheckTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:10:28] : [Step 4/5] [2021-11-19 21:10:28,398][INFO ][test-runner-#20229%encryption.MasterKeyChangeConsistencyCheckTest%][GridCacheDatabaseSharedManager] Data Regions Started: 5 [21:10:28] : [Step 4/5] [2021-11-19 21:10:28,398][INFO ][test-runner-#20229%encryption.MasterKeyChangeConsistencyCheckTest%][GridCacheDatabaseSharedManager] ^-- sysMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:10:28] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:10:28] : [Step 4/5] ^-- default region [type=default, persistence=true, lazyAlloc=true, [21:10:28] : [Step 4/5] ... initCfg=10MB, maxCfg=10MB, usedRam=0MB, freeRam=100%, allocRam=0MB, allocTotal=0MB] [21:10:28] : [Step 4/5] ^-- metastoreMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:10:28] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:10:28] : [Step 4/5] ^-- TxLog region [type=internal, persistence=true, lazyAlloc=false, [21:10:28] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:10:28] : [Step 4/5] ^-- volatileDsMemPlc region [type=user, persistence=false, lazyAlloc=true, [21:10:28] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB] [21:10:28] : [Step 4/5] ^-- Ignite persistence [used=0MB] [21:10:28] : [Step 4/5] [21:10:28] : [Step 4/5] [2021-11-19 21:10:28,400][INFO ][test-runner-#20229%encryption.MasterKeyChangeConsistencyCheckTest%][GridCacheDatabaseSharedManager] Starting binary memory restore for: [-2100569601] [21:10:28] : [Step 4/5] [2021-11-19 21:10:28,407][INFO ][test-runner-#20229%encryption.MasterKeyChangeConsistencyCheckTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:10:28] : [Step 4/5] [2021-11-19 21:10:28,407][INFO ][test-runner-#20229%encryption.MasterKeyChangeConsistencyCheckTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:10:28] : [Step 4/5] [2021-11-19 21:10:28,409][INFO ][test-runner-#20229%encryption.MasterKeyChangeConsistencyCheckTest%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000000.wal, offset=0, ver=2] [21:10:28] : [Step 4/5] [2021-11-19 21:10:28,413][INFO ][test-runner-#20229%encryption.MasterKeyChangeConsistencyCheckTest%][GridCacheProcessor] Started cache in recovery mode [name=ignite-sys-cache, id=-2100569601, dataRegionName=sysMemPlc, mode=REPLICATED, atomicity=TRANSACTIONAL, backups=2147483647, mvcc=false] [21:10:28] : [Step 4/5] [2021-11-19 21:10:28,414][INFO ][test-runner-#20229%encryption.MasterKeyChangeConsistencyCheckTest%][GridCacheDatabaseSharedManager] Binary recovery performed in 14 ms. [21:10:28] : [Step 4/5] [2021-11-19 21:10:28,414][INFO ][test-runner-#20229%encryption.MasterKeyChangeConsistencyCheckTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:10:28] : [Step 4/5] [2021-11-19 21:10:28,414][INFO ][test-runner-#20229%encryption.MasterKeyChangeConsistencyCheckTest%][GridCacheDatabaseSharedManager] Applying lost cache updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:10:28] : [Step 4/5] [2021-11-19 21:10:28,457][INFO ][test-runner-#20229%encryption.MasterKeyChangeConsistencyCheckTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=40 ms] [21:10:28] : [Step 4/5] [2021-11-19 21:10:28,457][INFO ][test-runner-#20229%encryption.MasterKeyChangeConsistencyCheckTest%][GridCacheProcessor] Restoring partition state for local groups. [21:10:28] : [Step 4/5] [2021-11-19 21:10:28,466][INFO ][test-runner-#20229%encryption.MasterKeyChangeConsistencyCheckTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=1, partitionsProcessed=100, time=10ms] [21:10:29] : [Step 4/5] [2021-11-19 21:10:29,245][INFO ][test-runner-#20229%encryption.MasterKeyChangeConsistencyCheckTest%][TestTcpDiscoverySpi] Successfully bound to TCP port [port=47500, localHost=localhost/127.0.0.1, locNodeId=00ccd666-fbef-4b00-9ba6-82602e1ab000] [21:10:29] : [Step 4/5] [2021-11-19 21:10:29,255][INFO ][disco-notifier-worker-#20340%grid-0%][MvccProcessorImpl] Assigned mvcc coordinator [crd=MvccCoordinator [topVer=AffinityTopologyVersion [topVer=1, minorTopVer=0], nodeId=00ccd666-fbef-4b00-9ba6-82602e1ab000, ver=1637345429247, local=true, initialized=false]] [21:10:29] : [Step 4/5] [2021-11-19 21:10:29,257][INFO ][sys-#20328%grid-0%][ClusterProcessor] Writing cluster ID and tag to metastorage on ready for write ClusterIdAndTag [id=2ad2a19f-5d96-4cef-a946-2aa5acc4a1a7, tag=lucid_joliot] [21:10:29] : [Step 4/5] [2021-11-19 21:10:29,260][INFO ][disco-notifier-worker-#20340%grid-0%][ClusterProcessor] lucid_joliot [21:10:29] : [Step 4/5] [2021-11-19 21:10:29,261][INFO ][disco-notifier-worker-#20340%grid-0%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustEnabled' was changed from 'null' to 'false' [21:10:29] : [Step 4/5] [2021-11-19 21:10:29,262][INFO ][disco-notifier-worker-#20340%grid-0%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustTimeout' was changed from 'null' to '300000' [21:10:29] : [Step 4/5] [2021-11-19 21:10:29,263][INFO ][disco-notifier-worker-#20340%grid-0%][IgniteTxManager] Transactions parameter 'longOperationsDumpTimeout' was changed from 'null' to '60000' [21:10:29] : [Step 4/5] [2021-11-19 21:10:29,263][INFO ][disco-notifier-worker-#20340%grid-0%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpThreshold' was changed from 'null' to '0' [21:10:29] : [Step 4/5] [2021-11-19 21:10:29,264][INFO ][disco-notifier-worker-#20340%grid-0%][IgniteTxManager] Transactions parameter 'transactionTimeDumpSamplesCoefficient' was changed from 'null' to '0.0' [21:10:29] : [Step 4/5] [2021-11-19 21:10:29,265][INFO ][disco-notifier-worker-#20340%grid-0%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpSamplesPerSecondLimit' was changed from 'null' to '5' [21:10:29] : [Step 4/5] [2021-11-19 21:10:29,265][INFO ][disco-notifier-worker-#20340%grid-0%][IgniteTxManager] Transactions parameter 'collisionsDumpInterval' was changed from 'null' to '1000' [21:10:29] : [Step 4/5] [2021-11-19 21:10:29,266][INFO ][disco-notifier-worker-#20340%grid-0%][IgniteTxManager] Transactions parameter 'txOwnerDumpRequestsAllowed' was changed from 'null' to 'true' [21:10:29] : [Step 4/5] [2021-11-19 21:10:29,266][INFO ][disco-notifier-worker-#20340%grid-0%][GridCacheDatabaseSharedManager] Historical rebalance WAL threshold changed [property=historical.rebalance.threshold, oldVal=null, newVal=500] [21:10:29] : [Step 4/5] [2021-11-19 21:10:29,269][INFO ][test-runner-#20229%encryption.MasterKeyChangeConsistencyCheckTest%][IgniteKernal%grid-0] To start Console Management & Monitoring run ignitevisorcmd.{sh|bat} [21:10:29] : [Step 4/5] [2021-11-19 21:10:29,270][INFO ][test-runner-#20229%encryption.MasterKeyChangeConsistencyCheckTest%][IgniteKernal%grid-0] [21:10:29] : [Step 4/5] [21:10:29] : [Step 4/5] >>> +-------------------------------------------+ [21:10:29] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:10:29] : [Step 4/5] >>> +-------------------------------------------+ [21:10:29] : [Step 4/5] >>> OS name: Linux 4.15.0-151-generic amd64 [21:10:29] : [Step 4/5] >>> CPU(s): 24 [21:10:29] : [Step 4/5] >>> Heap: 2.0GB [21:10:29] : [Step 4/5] >>> VM name: 16724@c4dfe9a430b2 [21:10:29] : [Step 4/5] >>> Ignite instance name: grid-0 [21:10:29] : [Step 4/5] >>> Local node [ID=00CCD666-FBEF-4B00-9BA6-82602E1AB000, order=1, clientMode=false] [21:10:29] : [Step 4/5] >>> Local node addresses: [127.0.0.1] [21:10:29] : [Step 4/5] >>> Local ports: TCP:10800 TCP:45200 TCP:47500 [21:10:29] : [Step 4/5] [21:10:29] : [Step 4/5] [2021-11-19 21:10:29,271][INFO ][test-runner-#20229%encryption.MasterKeyChangeConsistencyCheckTest%][IgniteKernal%grid-0] >>> Ignite cluster is in INACTIVE state (limited functionality available). Use control.(sh|bat) script or IgniteCluster.state(ClusterState.ACTIVE) to change the state. [21:10:29] : [Step 4/5] [2021-11-19 21:10:29,271][INFO ][test-runner-#20229%encryption.MasterKeyChangeConsistencyCheckTest%][GridDiscoveryManager] Topology snapshot [ver=1, locNode=00ccd666, servers=1, clients=0, state=INACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=00ccd666-fbef-4b00-9ba6-82602e1ab000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:10:29] : [Step 4/5] [2021-11-19 21:10:29,272][INFO ][test-runner-#20229%encryption.MasterKeyChangeConsistencyCheckTest%][G] Node started : [stage="Configure system pool" (0 ms),stage="Start managers" (185 ms),stage="Configure binary metadata" (2 ms),stage="Start processors" (995 ms),stage="Start 'StanByClusterTestProvider' plugin" (0 ms),stage="Start 'PageMemory tracker plugin' plugin" (0 ms),stage="Start 'TestDistibutedConfigurationPlugin' plugin" (0 ms),stage="Start 'NodeValidationPluginProvider' plugin" (0 ms),stage="Init metastore" (28 ms),stage="Init and start regions" (5 ms),stage="Restore binary memory" (14 ms),stage="Restore logical state" (52 ms),stage="Finish recovery" (778 ms),stage="Join topology" (10 ms),stage="Await transition" (2 ms),stage="Await exchange" (14 ms),stage="Total time" (2085 ms)] [21:10:29] : [Step 4/5] [2021-11-19 21:10:29,273][INFO ][test-runner-#20229%encryption.MasterKeyChangeConsistencyCheckTest%][root] Node started with the following configuration [id=00ccd666-fbef-4b00-9ba6-82602e1ab000, marshaller=BinaryMarshaller [], discovery=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=5000, ackTimeout=5000, marsh=JdkMarshaller [clsFilter=org.apache.ignite.marshaller.MarshallerUtils$1@39bf3370], reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], binaryCfg=null, lateAff=true] [21:10:29]W: [org.apache.ignite:ignite-core] [2021-11-19 21:10:29,278][WARN ][test-runner-#20229%encryption.MasterKeyChangeConsistencyCheckTest%][G] Ignite work directory is not provided, automatically resolved to: /opt/buildagent/work/7bc1c54bc719b67c/work [21:10:29] : [Step 4/5] [2021-11-19 21:10:29,280][INFO ][test-runner-#20229%encryption.MasterKeyChangeConsistencyCheckTest%][IgniteKernal%grid-1] [21:10:29] : [Step 4/5] [21:10:29] : [Step 4/5] >>> __________ ________________ [21:10:29] : [Step 4/5] >>> / _/ ___/ |/ / _/_ __/ __/ [21:10:29] : [Step 4/5] >>> _/ // (7 7 // / / / / _/ [21:10:29] : [Step 4/5] >>> /___/\___/_/|_/___/ /_/ /___/ [21:10:29] : [Step 4/5] >>> [21:10:29] : [Step 4/5] >>> ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:10:29] : [Step 4/5] >>> 2021 Copyright(C) Apache Software Foundation [21:10:29] : [Step 4/5] >>> [21:10:29] : [Step 4/5] >>> Ignite documentation: http://ignite.apache.org [21:10:29] : [Step 4/5] [21:10:29] : [Step 4/5] [2021-11-19 21:10:29,281][INFO ][test-runner-#20229%encryption.MasterKeyChangeConsistencyCheckTest%][IgniteKernal%grid-1] Config URL: n/a [21:10:29] : [Step 4/5] [2021-11-19 21:10:29,281][INFO ][test-runner-#20229%encryption.MasterKeyChangeConsistencyCheckTest%][IgniteKernal%grid-1] IgniteConfiguration [igniteInstanceName=grid-1, pubPoolSize=24, svcPoolSize=24, callbackPoolSize=24, stripedPoolSize=24, sysPoolSize=24, mgmtPoolSize=4, dataStreamerPoolSize=24, utilityCachePoolSize=24, utilityCacheKeepAliveTime=60000, p2pPoolSize=2, qryPoolSize=24, buildIdxPoolSize=4, igniteHome=/opt/buildagent/work/7bc1c54bc719b67c, igniteWorkDir=/opt/buildagent/work/7bc1c54bc719b67c/work, mbeanSrv=com.sun.jmx.mbeanserver.JmxMBeanServer@6fe85038, nodeId=10d30f78-bc70-4a42-b3c3-b78ea89cf001, marsh=BinaryMarshaller [], marshLocJobs=false, daemon=false, p2pEnabled=true, netTimeout=10000, netCompressionLevel=1, sndRetryDelay=1000, sndRetryCnt=3, metricsHistSize=10000, metricsUpdateFreq=1000, metricsExpTime=9223372036854775807, discoSpi=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=0, ackTimeout=0, marsh=null, reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], segPlc=STOP, segResolveAttempts=2, waitForSegOnStart=true, allResolversPassReq=true, segChkFreq=10000, commSpi=TcpCommunicationSpi [connectGate=org.apache.ignite.spi.communication.tcp.internal.ConnectGateway@597f3650, ctxInitLatch=java.util.concurrent.CountDownLatch@697d2c5d[Count = 1], stopping=false, clientPool=null, nioSrvWrapper=null, stateProvider=null], evtSpi=MemoryEventStorageSpi [expireAgeMs=9223372036854775807, expireCnt=10000, filter=null], colSpi=NoopCollisionSpi [], deploySpi=LocalDeploymentSpi [], indexingSpi=org.apache.ignite.spi.indexing.noop.NoopIndexingSpi@6e393bd6, addrRslvr=null, encryptionSpi=org.apache.ignite.internal.encryption.MasterKeyChangeConsistencyCheckTest$TestKeystoreEncryptionSpi@e05e96, tracingSpi=org.apache.ignite.spi.tracing.NoopTracingSpi@12c45781, clientMode=false, rebalanceThreadPoolSize=4, rebalanceTimeout=10000, rebalanceBatchesPrefetchCnt=3, rebalanceThrottle=0, rebalanceBatchSize=524288, txCfg=TransactionConfiguration [txSerEnabled=false, dfltIsolation=REPEATABLE_READ, dfltConcurrency=PESSIMISTIC, dfltTxTimeout=0, txTimeoutOnPartitionMapExchange=0, deadlockTimeout=10000, pessimisticTxLogSize=0, pessimisticTxLogLinger=10000, tmLookupClsName=null, txManagerFactory=null, useJtaSync=false], cacheSanityCheckEnabled=true, discoStartupDelay=60000, deployMode=SHARED, p2pMissedCacheSize=100, locHost=127.0.0.1, timeSrvPortBase=31100, timeSrvPortRange=100, failureDetectionTimeout=10000, sysWorkerBlockedTimeout=null, clientFailureDetectionTimeout=10000, metricsLogFreq=0, connectorCfg=null, odbcCfg=null, warmupClos=null, atomicCfg=AtomicConfiguration [seqReserveSize=1000, cacheMode=PARTITIONED, backups=1, aff=null, grpName=null], classLdr=null, sslCtxFactory=null, platformCfg=null, binaryCfg=null, memCfg=null, pstCfg=null, dsCfg=DataStorageConfiguration [sysRegionInitSize=41943040, sysRegionMaxSize=104857600, pageSize=4096, concLvl=0, dfltDataRegConf=DataRegionConfiguration [name=default, maxSize=10485760, initSize=268435456, swapPath=null, pageEvictionMode=DISABLED, pageReplacementMode=CLOCK, evictionThreshold=0.9, emptyPagesPoolSize=100, metricsEnabled=false, metricsSubIntervalCount=5, metricsRateTimeInterval=60000, persistenceEnabled=true, checkpointPageBufSize=0, lazyMemoryAllocation=true, warmUpCfg=null], dataRegions=null, storagePath=null, checkpointFreq=180000, lockWaitTime=10000, checkpointThreads=4, checkpointWriteOrder=SEQUENTIAL, walHistSize=20, maxWalArchiveSize=1073741824, walSegments=10, walSegmentSize=67108864, walPath=db/wal, walArchivePath=db/wal/archive, cdcWalPath=db/wal/cdc, cdcEnabled=false, metricsEnabled=false, walMode=FSYNC, walTlbSize=131072, walBuffSize=0, walFlushFreq=2000, walFsyncDelay=1000, walRecordIterBuffSize=67108864, alwaysWriteFullPages=false, fileIOFactory=org.apache.ignite.internal.processors.cache.persistence.file.AsyncFileIOFactory@1da79b12, metricsSubIntervalCnt=5, metricsRateTimeInterval=60000, walAutoArchiveAfterInactivity=-1, walForceArchiveTimeout=-1, writeThrottlingEnabled=false, walCompactionEnabled=false, walCompactionLevel=1, checkpointReadLockTimeout=null, walPageCompression=DISABLED, walPageCompressionLevel=null, dfltWarmUpCfg=null, encCfg=org.apache.ignite.configuration.EncryptionConfiguration@b6d66b0, defragmentationThreadPoolSize=4, minWalArchiveSize=-1], snapshotPath=snapshots, activeOnStart=true, activeOnStartPropSetFlag=false, autoActivation=true, autoActivationPropSetFlag=false, clusterStateOnStart=null, sqlConnCfg=null, cliConnCfg=ClientConnectorConfiguration [host=null, port=10800, portRange=100, sockSndBufSize=0, sockRcvBufSize=0, tcpNoDelay=true, maxOpenCursorsPerConn=128, threadPoolSize=24, selectorCnt=12, idleTimeout=0, handshakeTimeout=10000, jdbcEnabled=true, odbcEnabled=true, thinCliEnabled=true, sslEnabled=false, useIgniteSslCtxFactory=true, sslClientAuth=false, sslCtxFactory=null, thinCliCfg=ThinClientConfiguration [maxActiveTxPerConn=100, maxActiveComputeTasksPerConn=0]], mvccVacuumThreadCnt=2, mvccVacuumFreq=5000, authEnabled=false, failureHnd=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]], commFailureRslvr=null, sqlCfg=SqlConfiguration [longQryWarnTimeout=3000, dfltQryTimeout=0, sqlQryHistSize=1000, validationEnabled=false], asyncContinuationExecutor=null] [21:10:29] : [Step 4/5] [2021-11-19 21:10:29,290][INFO ][test-runner-#20229%encryption.MasterKeyChangeConsistencyCheckTest%][IgniteKernal%grid-1] Daemon mode: off [21:10:29] : [Step 4/5] [2021-11-19 21:10:29,290][INFO ][test-runner-#20229%encryption.MasterKeyChangeConsistencyCheckTest%][IgniteKernal%grid-1] OS: Linux 4.15.0-151-generic amd64 [21:10:29] : [Step 4/5] [2021-11-19 21:10:29,290][INFO ][test-runner-#20229%encryption.MasterKeyChangeConsistencyCheckTest%][IgniteKernal%grid-1] OS user: teamcity [21:10:29] : [Step 4/5] [2021-11-19 21:10:29,290][INFO ][test-runner-#20229%encryption.MasterKeyChangeConsistencyCheckTest%][IgniteKernal%grid-1] PID: 16724 [21:10:29] : [Step 4/5] [2021-11-19 21:10:29,291][INFO ][test-runner-#20229%encryption.MasterKeyChangeConsistencyCheckTest%][IgniteKernal%grid-1] Language runtime: Java Platform API Specification ver. 1.8 [21:10:29] : [Step 4/5] [2021-11-19 21:10:29,291][INFO ][test-runner-#20229%encryption.MasterKeyChangeConsistencyCheckTest%][IgniteKernal%grid-1] VM information: Java(TM) SE Runtime Environment 1.8.0_261-b12 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 25.261-b12 [21:10:29] : [Step 4/5] [2021-11-19 21:10:29,291][INFO ][test-runner-#20229%encryption.MasterKeyChangeConsistencyCheckTest%][IgniteKernal%grid-1] VM total memory: 1.9GB [21:10:29] : [Step 4/5] [2021-11-19 21:10:29,291][INFO ][test-runner-#20229%encryption.MasterKeyChangeConsistencyCheckTest%][IgniteKernal%grid-1] Remote Management [restart: off, REST: off, JMX (remote: off)] [21:10:29] : [Step 4/5] [2021-11-19 21:10:29,292][INFO ][test-runner-#20229%encryption.MasterKeyChangeConsistencyCheckTest%][IgniteKernal%grid-1] Logger: GridTestLog4jLogger [quiet=false, config=null] [21:10:29] : [Step 4/5] [2021-11-19 21:10:29,292][INFO ][test-runner-#20229%encryption.MasterKeyChangeConsistencyCheckTest%][IgniteKernal%grid-1] IGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c [21:10:29] : [Step 4/5] [2021-11-19 21:10:29,292][INFO ][test-runner-#20229%encryption.MasterKeyChangeConsistencyCheckTest%][IgniteKernal%grid-1] VM arguments: [-DIGNITE_DUMP_THREADS_ON_FAILURE=false, -DMono=/usr/bin/mono-sgen, -DMono4.0_x64=/usr/lib/mono/4.0, -DMono4.5_x64=/usr/lib/mono/4.5, -DMonoVersion=6.12.0.90, -DSKIP_BUILD=false, -Dagent.home.dir=/opt/buildagent, -Dagent.name=aitc-lin02_03, -Dagent.ownPort=9090, -Dagent.work.dir=/opt/buildagent/work, -Dbuild.number=95, -Dbuild.vcs.number=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.1=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.GitHubApacheIgnite=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dclassworlds.conf=/opt/buildagent/temp/buildTmp/teamcity.m2.conf, -Dcom.jetbrains.maven.watcher.report.file=/opt/buildagent/temp/buildTmp/maven-build-info.xml, -Djava.io.tmpdir=/opt/buildagent/temp/buildTmp, -Dmaven.home=/opt/buildagent/tools/maven3_6, -Dmaven.multiModuleProjectDirectory=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.agent.cpuBenchmark=457, -Dteamcity.agent.dotnet.agent_url=http://localhost:9090/RPC2, -Dteamcity.agent.dotnet.build_id=6278078, -Dteamcity.auth.password=*******, -Dteamcity.auth.userId=TeamCityBuildId=6278078, -Dteamcity.build.changedFiles.file=/opt/buildagent/temp/buildTmp/changedFiles6342607772318147725.txt, -Dteamcity.build.checkoutDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.build.id=6278078, -Dteamcity.build.properties.file=/opt/buildagent/temp/buildTmp/teamcity.build5164517880467851002.properties, -Dteamcity.build.tempDir=/opt/buildagent/temp/buildTmp, -Dteamcity.build.workingDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.buildConfName=Basic 3, -Dteamcity.buildType.id=IgniteTests24Java8_Basic3, -Dteamcity.configuration.properties.file=/opt/buildagent/temp/buildTmp/teamcity.config5591980786735343870.properties, -Dteamcity.maven.userSettings.path=/opt/buildagent/temp/buildTmp/maven_settings_585072866407032347.xml, -Dteamcity.maven.watcher.home=/opt/buildagent/plugins/mavenPlugin/maven-watcher-jdk16, -Dteamcity.projectName=Ignite Tests 2.x (JDK 8/11), -Dteamcity.runner.properties.file=/opt/buildagent/temp/buildTmp/teamcity.runner9098465561618137420.properties, -Dteamcity.tests.recentlyFailedTests.file=/opt/buildagent/temp/buildTmp/testsToRunFirst3891775683130404069.txt, -Dteamcity.version=2021.2 (build 99542), -ea, -Xms2g, -Xmx2g, -XX:+HeapDumpOnOutOfMemoryError, -DIGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_TEST_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_UPDATE_NOTIFIER=false, -DIGNITE_NO_DISCO_ORDER=true, -DIGNITE_PERFORMANCE_SUGGESTIONS_DISABLED=true, -Djava.net.preferIPv4Stack=true, -DTEST_SCALE_FACTOR=1.0, -DIGNITE_TEST_PROP_LOG4J_FILE=log4j-tc-test.xml, -DIGNITE_QUIET=false, -DIGNITE_MARSHAL_BUFFERS_RECHECK=1000, -Dmaven.repo.local=/opt/buildagent/.m2/repository] [21:10:29] : [Step 4/5] [2021-11-19 21:10:29,297][INFO ][test-runner-#20229%encryption.MasterKeyChangeConsistencyCheckTest%][IgniteKernal%grid-1] System cache's DataRegion size is configured to 40 MB. Use DataStorageConfiguration.systemRegionInitialSize property to change the setting. [21:10:29] : [Step 4/5] [2021-11-19 21:10:29,298][INFO ][test-runner-#20229%encryption.MasterKeyChangeConsistencyCheckTest%][IgniteKernal%grid-1] Configured caches [in 'sysMemPlc' dataRegion: ['ignite-sys-cache']] [21:10:29] : [Step 4/5] [2021-11-19 21:10:29,298][INFO ][test-runner-#20229%encryption.MasterKeyChangeConsistencyCheckTest%][IgniteKernal%grid-1] 3-rd party licenses can be found at: /opt/buildagent/work/7bc1c54bc719b67c/libs/licenses [21:10:29]W: [org.apache.ignite:ignite-core] [2021-11-19 21:10:29,298][WARN ][test-runner-#20229%encryption.MasterKeyChangeConsistencyCheckTest%][IgniteKernal%grid-1] Peer class loading is enabled (disable it in production for performance and deployment consistency reasons) [21:10:29] : [Step 4/5] [2021-11-19 21:10:29,302][INFO ][test-runner-#20229%encryption.MasterKeyChangeConsistencyCheckTest%][IgnitePluginProcessor] Configured plugins: [21:10:29] : [Step 4/5] [2021-11-19 21:10:29,302][INFO ][test-runner-#20229%encryption.MasterKeyChangeConsistencyCheckTest%][IgnitePluginProcessor] ^-- StanByClusterTestProvider 1.0 [21:10:29] : [Step 4/5] [2021-11-19 21:10:29,303][INFO ][test-runner-#20229%encryption.MasterKeyChangeConsistencyCheckTest%][IgnitePluginProcessor] ^-- null [21:10:29] : [Step 4/5] [2021-11-19 21:10:29,303][INFO ][test-runner-#20229%encryption.MasterKeyChangeConsistencyCheckTest%][IgnitePluginProcessor] [21:10:29] : [Step 4/5] [2021-11-19 21:10:29,303][INFO ][test-runner-#20229%encryption.MasterKeyChangeConsistencyCheckTest%][IgnitePluginProcessor] ^-- PageMemory tracker plugin 1.0 [21:10:29] : [Step 4/5] [2021-11-19 21:10:29,303][INFO ][test-runner-#20229%encryption.MasterKeyChangeConsistencyCheckTest%][IgnitePluginProcessor] ^-- null [21:10:29] : [Step 4/5] [2021-11-19 21:10:29,303][INFO ][test-runner-#20229%encryption.MasterKeyChangeConsistencyCheckTest%][IgnitePluginProcessor] [21:10:29] : [Step 4/5] [2021-11-19 21:10:29,303][INFO ][test-runner-#20229%encryption.MasterKeyChangeConsistencyCheckTest%][IgnitePluginProcessor] ^-- TestDistibutedConfigurationPlugin 1.0 [21:10:29] : [Step 4/5] [2021-11-19 21:10:29,304][INFO ][test-runner-#20229%encryption.MasterKeyChangeConsistencyCheckTest%][IgnitePluginProcessor] ^-- null [21:10:29] : [Step 4/5] [2021-11-19 21:10:29,304][INFO ][test-runner-#20229%encryption.MasterKeyChangeConsistencyCheckTest%][IgnitePluginProcessor] [21:10:29] : [Step 4/5] [2021-11-19 21:10:29,304][INFO ][test-runner-#20229%encryption.MasterKeyChangeConsistencyCheckTest%][IgnitePluginProcessor] ^-- NodeValidationPluginProvider 1.0 [21:10:29] : [Step 4/5] [2021-11-19 21:10:29,304][INFO ][test-runner-#20229%encryption.MasterKeyChangeConsistencyCheckTest%][IgnitePluginProcessor] ^-- null [21:10:29] : [Step 4/5] [2021-11-19 21:10:29,305][INFO ][test-runner-#20229%encryption.MasterKeyChangeConsistencyCheckTest%][IgnitePluginProcessor] [21:10:29] : [Step 4/5] [2021-11-19 21:10:29,305][INFO ][test-runner-#20229%encryption.MasterKeyChangeConsistencyCheckTest%][FailureProcessor] Configured failure handler: [hnd=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]] [21:10:29] : [Step 4/5] [2021-11-19 21:10:29,332][INFO ][test-runner-#20229%encryption.MasterKeyChangeConsistencyCheckTest%][TcpCommunicationSpi] Successfully bound communication NIO server to TCP port [port=45201, locHost=/127.0.0.1, selectorsCnt=12, selectorSpins=0, pairedConn=false] [21:10:29]W: [org.apache.ignite:ignite-core] [2021-11-19 21:10:29,333][WARN ][test-runner-#20229%encryption.MasterKeyChangeConsistencyCheckTest%][TcpCommunicationSpi] Message queue limit is set to 0 which may lead to potential OOMEs when running cache operations in FULL_ASYNC or PRIMARY_SYNC modes due to message queues growth on sender and receiver sides. [21:10:29] : [Step 4/5] [2021-11-19 21:10:29,347][INFO ][test-runner-#20229%encryption.MasterKeyChangeConsistencyCheckTest%][GridCollisionManager] Collision resolution is disabled (all jobs will be activated upon arrival). [21:10:29] : [Step 4/5] [2021-11-19 21:10:29,347][INFO ][test-runner-#20229%encryption.MasterKeyChangeConsistencyCheckTest%][IgniteKernal%grid-1] Security status [authentication=off, sandbox=off, tls/ssl=off] [21:10:29] : [Step 4/5] [2021-11-19 21:10:29,414][INFO ][test-runner-#20229%encryption.MasterKeyChangeConsistencyCheckTest%][MasterKeyChangeConsistencyCheckTest$TestKeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:10:29] : [Step 4/5] [2021-11-19 21:10:29,498][INFO ][test-runner-#20229%encryption.MasterKeyChangeConsistencyCheckTest%][MaintenanceProcessor] Resolved store directory for node persistent data: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1 [21:10:29] : [Step 4/5] [2021-11-19 21:10:29,499][INFO ][test-runner-#20229%encryption.MasterKeyChangeConsistencyCheckTest%][CacheObjectBinaryProcessorImpl] Resolved directory for serialized binary metadata: /opt/buildagent/work/7bc1c54bc719b67c/work/db/binary_meta/grid_1 [21:10:29] : [Step 4/5] [2021-11-19 21:10:29,503][INFO ][test-runner-#20229%encryption.MasterKeyChangeConsistencyCheckTest%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1 [21:10:29] : [Step 4/5] [2021-11-19 21:10:29,503][INFO ][test-runner-#20229%encryption.MasterKeyChangeConsistencyCheckTest%][FileWriteAheadLogManager] Resolved write ahead log work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1 [21:10:29] : [Step 4/5] [2021-11-19 21:10:29,504][INFO ][test-runner-#20229%encryption.MasterKeyChangeConsistencyCheckTest%][FileWriteAheadLogManager] Resolved write ahead log archive directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1 [21:10:31] : [Step 4/5] [2021-11-19 21:10:31,072][INFO ][test-runner-#20229%encryption.MasterKeyChangeConsistencyCheckTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000000.wal [21:10:31] : [Step 4/5] [2021-11-19 21:10:31,076][INFO ][test-runner-#20229%encryption.MasterKeyChangeConsistencyCheckTest%][GridCacheDatabaseSharedManager] Configured data regions initialized successfully [total=5] [21:10:31] : [Step 4/5] [2021-11-19 21:10:31,405][INFO ][test-runner-#20229%encryption.MasterKeyChangeConsistencyCheckTest%][IgniteSnapshotManager] Resolved snapshot work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/snapshots [21:10:31] : [Step 4/5] [2021-11-19 21:10:31,405][INFO ][test-runner-#20229%encryption.MasterKeyChangeConsistencyCheckTest%][IgniteSnapshotManager] Resolved temp directory for snapshot creation: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1/snp [21:10:31] : [Step 4/5] [2021-11-19 21:10:31,408][INFO ][test-runner-#20229%encryption.MasterKeyChangeConsistencyCheckTest%][ClientListenerProcessor] Client connector processor has started on TCP port 10801 [21:10:31] : [Step 4/5] [2021-11-19 21:10:31,410][INFO ][test-runner-#20229%encryption.MasterKeyChangeConsistencyCheckTest%][IgniteKernal%grid-1] Non-loopback local IPs: 172.17.0.4 [21:10:31] : [Step 4/5] [2021-11-19 21:10:31,410][INFO ][test-runner-#20229%encryption.MasterKeyChangeConsistencyCheckTest%][IgniteKernal%grid-1] Enabled local MACs: 0242AC110004 [21:10:31] : [Step 4/5] [2021-11-19 21:10:31,410][INFO ][test-runner-#20229%encryption.MasterKeyChangeConsistencyCheckTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:10:31] : [Step 4/5] [2021-11-19 21:10:31,411][INFO ][test-runner-#20229%encryption.MasterKeyChangeConsistencyCheckTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:10:31] : [Step 4/5] [2021-11-19 21:10:31,412][INFO ][test-runner-#20229%encryption.MasterKeyChangeConsistencyCheckTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:10:31] : [Step 4/5] [2021-11-19 21:10:31,413][INFO ][test-runner-#20229%encryption.MasterKeyChangeConsistencyCheckTest%][GridCacheDatabaseSharedManager] Applying lost metastore updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:10:31] : [Step 4/5] [2021-11-19 21:10:31,414][INFO ][test-runner-#20229%encryption.MasterKeyChangeConsistencyCheckTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=0 ms] [21:10:31] : [Step 4/5] [2021-11-19 21:10:31,414][INFO ][test-runner-#20229%encryption.MasterKeyChangeConsistencyCheckTest%][GridCacheProcessor] Restoring partition state for local groups. [21:10:31] : [Step 4/5] [2021-11-19 21:10:31,415][INFO ][test-runner-#20229%encryption.MasterKeyChangeConsistencyCheckTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=0, partitionsProcessed=0, time=0ms] [21:10:31] : [Step 4/5] [2021-11-19 21:10:31,415][INFO ][test-runner-#20229%encryption.MasterKeyChangeConsistencyCheckTest%][GridEncryptionManager] Encryption keys loaded from metastore. [grps=, masterKeyName=ignite.master.key] [21:10:31] : [Step 4/5] [2021-11-19 21:10:31,416][INFO ][test-runner-#20229%encryption.MasterKeyChangeConsistencyCheckTest%][ClusterProcessor] Cluster ID and tag has been read from metastorage: null [21:10:31] : [Step 4/5] [2021-11-19 21:10:31,417][INFO ][test-runner-#20229%encryption.MasterKeyChangeConsistencyCheckTest%][IgniteClusterImpl] Shutdown policy was updated [oldVal=null, newVal=null] [21:10:31] : [Step 4/5] [2021-11-19 21:10:31,417][INFO ][test-runner-#20229%encryption.MasterKeyChangeConsistencyCheckTest%][GridCacheDatabaseSharedManager] Checkpoint frequency deviation changed [oldVal=null, newVal=null] [21:10:31] : [Step 4/5] [2021-11-19 21:10:31,558][INFO ][test-runner-#20229%encryption.MasterKeyChangeConsistencyCheckTest%][FilePageStoreManager] Cleanup cache stores [total=1, left=0, cleanFiles=false] [21:10:31] : [Step 4/5] [2021-11-19 21:10:31,560][INFO ][test-runner-#20229%encryption.MasterKeyChangeConsistencyCheckTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:10:31] : [Step 4/5] [2021-11-19 21:10:31,561][INFO ][test-runner-#20229%encryption.MasterKeyChangeConsistencyCheckTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:10:31] : [Step 4/5] [2021-11-19 21:10:31,563][INFO ][test-runner-#20229%encryption.MasterKeyChangeConsistencyCheckTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:10:31] : [Step 4/5] [2021-11-19 21:10:31,563][INFO ][test-runner-#20229%encryption.MasterKeyChangeConsistencyCheckTest%][GridCacheDatabaseSharedManager] Data Regions Started: 5 [21:10:31] : [Step 4/5] [2021-11-19 21:10:31,564][INFO ][test-runner-#20229%encryption.MasterKeyChangeConsistencyCheckTest%][GridCacheDatabaseSharedManager] ^-- sysMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:10:31] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:10:31] : [Step 4/5] ^-- default region [type=default, persistence=true, lazyAlloc=true, [21:10:31] : [Step 4/5] ... initCfg=10MB, maxCfg=10MB, usedRam=0MB, freeRam=100%, allocRam=0MB, allocTotal=0MB] [21:10:31] : [Step 4/5] ^-- metastoreMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:10:31] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:10:31] : [Step 4/5] ^-- TxLog region [type=internal, persistence=true, lazyAlloc=false, [21:10:31] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:10:31] : [Step 4/5] ^-- volatileDsMemPlc region [type=user, persistence=false, lazyAlloc=true, [21:10:31] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB] [21:10:31] : [Step 4/5] ^-- Ignite persistence [used=0MB] [21:10:31] : [Step 4/5] [21:10:31] : [Step 4/5] [2021-11-19 21:10:31,565][INFO ][test-runner-#20229%encryption.MasterKeyChangeConsistencyCheckTest%][GridCacheDatabaseSharedManager] Starting binary memory restore for: [-2100569601] [21:10:31] : [Step 4/5] [2021-11-19 21:10:31,574][INFO ][test-runner-#20229%encryption.MasterKeyChangeConsistencyCheckTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:10:31] : [Step 4/5] [2021-11-19 21:10:31,575][INFO ][test-runner-#20229%encryption.MasterKeyChangeConsistencyCheckTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:10:31] : [Step 4/5] [2021-11-19 21:10:31,578][INFO ][test-runner-#20229%encryption.MasterKeyChangeConsistencyCheckTest%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000000.wal, offset=0, ver=2] [21:10:31] : [Step 4/5] [2021-11-19 21:10:31,581][INFO ][test-runner-#20229%encryption.MasterKeyChangeConsistencyCheckTest%][GridCacheProcessor] Started cache in recovery mode [name=ignite-sys-cache, id=-2100569601, dataRegionName=sysMemPlc, mode=REPLICATED, atomicity=TRANSACTIONAL, backups=2147483647, mvcc=false] [21:10:31] : [Step 4/5] [2021-11-19 21:10:31,582][INFO ][test-runner-#20229%encryption.MasterKeyChangeConsistencyCheckTest%][GridCacheDatabaseSharedManager] Binary recovery performed in 17 ms. [21:10:31] : [Step 4/5] [2021-11-19 21:10:31,582][INFO ][test-runner-#20229%encryption.MasterKeyChangeConsistencyCheckTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:10:31] : [Step 4/5] [2021-11-19 21:10:31,583][INFO ][test-runner-#20229%encryption.MasterKeyChangeConsistencyCheckTest%][GridCacheDatabaseSharedManager] Applying lost cache updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:10:31] : [Step 4/5] [2021-11-19 21:10:31,655][INFO ][test-runner-#20229%encryption.MasterKeyChangeConsistencyCheckTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=70 ms] [21:10:31] : [Step 4/5] [2021-11-19 21:10:31,656][INFO ][test-runner-#20229%encryption.MasterKeyChangeConsistencyCheckTest%][GridCacheProcessor] Restoring partition state for local groups. [21:10:31] : [Step 4/5] [2021-11-19 21:10:31,660][INFO ][test-runner-#20229%encryption.MasterKeyChangeConsistencyCheckTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=1, partitionsProcessed=100, time=0ms] [21:10:32] : [Step 4/5] [2021-11-19 21:10:32,564][INFO ][test-runner-#20229%encryption.MasterKeyChangeConsistencyCheckTest%][TestTcpDiscoverySpi] Successfully bound to TCP port [port=47501, localHost=localhost/127.0.0.1, locNodeId=10d30f78-bc70-4a42-b3c3-b78ea89cf001] [21:10:32] : [Step 4/5] [2021-11-19 21:10:32,585][INFO ][tcp-disco-srvr-[:47500]-#1065%grid-0%-#20342%grid-0%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=48275] [21:10:32] : [Step 4/5] [2021-11-19 21:10:32,586][INFO ][tcp-disco-srvr-[:47500]-#1065%grid-0%-#20342%grid-0%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=48275] [21:10:32] : [Step 4/5] [2021-11-19 21:10:32,592][INFO ][tcp-disco-sock-reader-[]-#1071%grid-0%-#20461%grid-0%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:48275, rmtPort=48275] [21:10:32] : [Step 4/5] [2021-11-19 21:10:32,599][INFO ][tcp-disco-sock-reader-[10d30f78 127.0.0.1:48275]-#1071%grid-0%-#20461%grid-0%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=10d30f78-bc70-4a42-b3c3-b78ea89cf001, rmtAddr=/127.0.0.1:48275] [21:10:32] : [Step 4/5] [2021-11-19 21:10:32,608][INFO ][tcp-disco-srvr-[:47501]-#1070%grid-1%-#20460%grid-1%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=47141] [21:10:32] : [Step 4/5] [2021-11-19 21:10:32,608][INFO ][tcp-disco-srvr-[:47501]-#1070%grid-1%-#20460%grid-1%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=47141] [21:10:32] : [Step 4/5] [2021-11-19 21:10:32,616][INFO ][tcp-disco-sock-reader-[]-#1072%grid-1%-#20462%grid-1%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:47141, rmtPort=47141] [21:10:32] : [Step 4/5] [2021-11-19 21:10:32,617][INFO ][tcp-disco-sock-reader-[]-#1072%grid-1%-#20462%grid-1%][TestTcpDiscoverySpi] Received ping request from the remote node [rmtNodeId=00ccd666-fbef-4b00-9ba6-82602e1ab000, rmtAddr=/127.0.0.1:47141, rmtPort=47141] [21:10:32] : [Step 4/5] [2021-11-19 21:10:32,618][INFO ][tcp-disco-sock-reader-[]-#1072%grid-1%-#20462%grid-1%][TestTcpDiscoverySpi] Finished writing ping response [rmtNodeId=00ccd666-fbef-4b00-9ba6-82602e1ab000, rmtAddr=/127.0.0.1:47141, rmtPort=47141] [21:10:32]W: [org.apache.ignite:ignite-core] [2021-11-19 21:10:32,619][WARN ][tcp-disco-sock-reader-[]-#1072%grid-1%-#20462%grid-1%][TestTcpDiscoverySpi] Failed to shutdown socket [21:10:32]W: [org.apache.ignite:ignite-core] java.net.SocketException: Socket output is already shutdown [21:10:32]W: [org.apache.ignite:ignite-core] at java.net.Socket.shutdownOutput(Socket.java:1572) [21:10:32]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.close(IgniteUtils.java:4247) [21:10:32]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.discovery.tcp.ServerImpl$SocketReader.body(ServerImpl.java:7370) [21:10:32]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.IgniteSpiThread.run(IgniteSpiThread.java:58) [21:10:32] : [Step 4/5] [2021-11-19 21:10:32,619][INFO ][tcp-disco-sock-reader-[10d30f78 127.0.0.1:48275]-#1071%grid-0%-#20461%grid-0%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:48275, rmtPort=48275, rmtNodeId=10d30f78-bc70-4a42-b3c3-b78ea89cf001] [21:10:32] : [Step 4/5] [2021-11-19 21:10:32,631][INFO ][tcp-disco-sock-reader-[]-#1072%grid-1%-#20462%grid-1%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:47141, rmtPort=47141, rmtNodeId=null] [21:10:32] : [Step 4/5] [2021-11-19 21:10:32,638][INFO ][tcp-disco-msg-worker-[crd]-#1064%grid-0%-#20341%grid-0%][GridEncryptionManager] Joining node doesn't have stored group keys [node=10d30f78-bc70-4a42-b3c3-b78ea89cf001] [21:10:32] : [Step 4/5] [2021-11-19 21:10:32,652][INFO ][tcp-disco-msg-worker-[crd]-#1064%grid-0%-#20341%grid-0%][TestTcpDiscoverySpi] New next node [newNext=TcpDiscoveryNode [id=10d30f78-bc70-4a42-b3c3-b78ea89cf001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=0, intOrder=2, lastExchangeTime=1637345432600, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false]] [21:10:32] : [Step 4/5] [2021-11-19 21:10:32,653][INFO ][tcp-disco-srvr-[:47501]-#1070%grid-1%-#20460%grid-1%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=57679] [21:10:32] : [Step 4/5] [2021-11-19 21:10:32,654][INFO ][tcp-disco-srvr-[:47501]-#1070%grid-1%-#20460%grid-1%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=57679] [21:10:32] : [Step 4/5] [2021-11-19 21:10:32,654][INFO ][tcp-disco-sock-reader-[]-#1073%grid-1%-#20463%grid-1%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:57679, rmtPort=57679] [21:10:32] : [Step 4/5] [2021-11-19 21:10:32,655][INFO ][tcp-disco-sock-reader-[00ccd666 127.0.0.1:57679]-#1073%grid-1%-#20463%grid-1%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=00ccd666-fbef-4b00-9ba6-82602e1ab000, rmtAddr=/127.0.0.1:57679] [21:10:32] : [Step 4/5] [2021-11-19 21:10:32,658][INFO ][tcp-disco-msg-worker-[]-#1069%grid-1%-#20459%grid-1%][TestTcpDiscoverySpi] New next node [newNext=TcpDiscoveryNode [id=00ccd666-fbef-4b00-9ba6-82602e1ab000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345432650, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false]] [21:10:32] : [Step 4/5] [2021-11-19 21:10:32,659][INFO ][tcp-disco-srvr-[:47500]-#1065%grid-0%-#20342%grid-0%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=50133] [21:10:32] : [Step 4/5] [2021-11-19 21:10:32,659][INFO ][tcp-disco-srvr-[:47500]-#1065%grid-0%-#20342%grid-0%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=50133] [21:10:32] : [Step 4/5] [2021-11-19 21:10:32,660][INFO ][tcp-disco-sock-reader-[]-#1074%grid-0%-#20464%grid-0%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:50133, rmtPort=50133] [21:10:32] : [Step 4/5] [2021-11-19 21:10:32,661][INFO ][tcp-disco-sock-reader-[10d30f78 127.0.0.1:50133]-#1074%grid-0%-#20464%grid-0%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=10d30f78-bc70-4a42-b3c3-b78ea89cf001, rmtAddr=/127.0.0.1:50133] [21:10:32] : [Step 4/5] [2021-11-19 21:10:32,664][INFO ][disco-event-worker-#20344%grid-0%][GridDiscoveryManager] Added new node to topology: TcpDiscoveryNode [id=10d30f78-bc70-4a42-b3c3-b78ea89cf001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637345432600, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false] [21:10:32] : [Step 4/5] [2021-11-19 21:10:32,665][INFO ][disco-event-worker-#20344%grid-0%][GridDiscoveryManager] Topology snapshot [ver=2, locNode=00ccd666, servers=2, clients=0, state=INACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=00ccd666-fbef-4b00-9ba6-82602e1ab000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=10d30f78-bc70-4a42-b3c3-b78ea89cf001, consistentId=grid-1, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:10:32] : [Step 4/5] [2021-11-19 21:10:32,667][INFO ][tcp-disco-msg-worker-[00ccd666 127.0.0.1:47500]-#1069%grid-1%-#20459%grid-1%][ClusterProcessor] lucid_joliot [21:10:32] : [Step 4/5] [2021-11-19 21:10:32,667][INFO ][tcp-disco-msg-worker-[00ccd666 127.0.0.1:47500]-#1069%grid-1%-#20459%grid-1%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustEnabled' was changed from 'null' to 'false' [21:10:32] : [Step 4/5] [2021-11-19 21:10:32,667][INFO ][tcp-disco-msg-worker-[00ccd666 127.0.0.1:47500]-#1069%grid-1%-#20459%grid-1%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustTimeout' was changed from 'null' to '300000' [21:10:32] : [Step 4/5] [2021-11-19 21:10:32,668][INFO ][tcp-disco-msg-worker-[00ccd666 127.0.0.1:47500]-#1069%grid-1%-#20459%grid-1%][IgniteTxManager] Transactions parameter 'longOperationsDumpTimeout' was changed from 'null' to '60000' [21:10:32] : [Step 4/5] [2021-11-19 21:10:32,668][INFO ][tcp-disco-msg-worker-[00ccd666 127.0.0.1:47500]-#1069%grid-1%-#20459%grid-1%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpThreshold' was changed from 'null' to '0' [21:10:32] : [Step 4/5] [2021-11-19 21:10:32,669][INFO ][tcp-disco-msg-worker-[00ccd666 127.0.0.1:47500]-#1069%grid-1%-#20459%grid-1%][IgniteTxManager] Transactions parameter 'transactionTimeDumpSamplesCoefficient' was changed from 'null' to '0.0' [21:10:32] : [Step 4/5] [2021-11-19 21:10:32,669][INFO ][tcp-disco-msg-worker-[00ccd666 127.0.0.1:47500]-#1069%grid-1%-#20459%grid-1%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpSamplesPerSecondLimit' was changed from 'null' to '5' [21:10:32] : [Step 4/5] [2021-11-19 21:10:32,669][INFO ][tcp-disco-msg-worker-[00ccd666 127.0.0.1:47500]-#1069%grid-1%-#20459%grid-1%][IgniteTxManager] Transactions parameter 'collisionsDumpInterval' was changed from 'null' to '1000' [21:10:32] : [Step 4/5] [2021-11-19 21:10:32,670][INFO ][tcp-disco-msg-worker-[00ccd666 127.0.0.1:47500]-#1069%grid-1%-#20459%grid-1%][IgniteTxManager] Transactions parameter 'txOwnerDumpRequestsAllowed' was changed from 'null' to 'true' [21:10:32] : [Step 4/5] [2021-11-19 21:10:32,670][INFO ][tcp-disco-msg-worker-[00ccd666 127.0.0.1:47500]-#1069%grid-1%-#20459%grid-1%][GridCacheDatabaseSharedManager] Historical rebalance WAL threshold changed [property=historical.rebalance.threshold, oldVal=null, newVal=500] [21:10:32] : [Step 4/5] [2021-11-19 21:10:32,671][INFO ][disco-notifier-worker-#20458%grid-1%][MvccProcessorImpl] Assigned mvcc coordinator [crd=MvccCoordinator [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=0], nodeId=00ccd666-fbef-4b00-9ba6-82602e1ab000, ver=1637345429247, local=false, initialized=false]] [21:10:32] : [Step 4/5] [2021-11-19 21:10:32,673][INFO ][sys-#20436%grid-1%][ClusterProcessor] Writing cluster ID and tag to metastorage on ready for write ClusterIdAndTag [id=2ad2a19f-5d96-4cef-a946-2aa5acc4a1a7, tag=lucid_joliot] [21:10:32] : [Step 4/5] [2021-11-19 21:10:32,685][INFO ][test-runner-#20229%encryption.MasterKeyChangeConsistencyCheckTest%][IgniteKernal%grid-1] To start Console Management & Monitoring run ignitevisorcmd.{sh|bat} [21:10:32] : [Step 4/5] [2021-11-19 21:10:32,686][INFO ][test-runner-#20229%encryption.MasterKeyChangeConsistencyCheckTest%][IgniteKernal%grid-1] [21:10:32] : [Step 4/5] [21:10:32] : [Step 4/5] >>> +-------------------------------------------+ [21:10:32] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:10:32] : [Step 4/5] >>> +-------------------------------------------+ [21:10:32] : [Step 4/5] >>> OS name: Linux 4.15.0-151-generic amd64 [21:10:32] : [Step 4/5] >>> CPU(s): 24 [21:10:32] : [Step 4/5] >>> Heap: 2.0GB [21:10:32] : [Step 4/5] >>> VM name: 16724@c4dfe9a430b2 [21:10:32] : [Step 4/5] >>> Ignite instance name: grid-1 [21:10:32] : [Step 4/5] >>> Local node [ID=10D30F78-BC70-4A42-B3C3-B78EA89CF001, order=2, clientMode=false] [21:10:32] : [Step 4/5] >>> Local node addresses: [127.0.0.1] [21:10:32] : [Step 4/5] >>> Local ports: TCP:10801 TCP:45201 TCP:47501 [21:10:32] : [Step 4/5] [21:10:32] : [Step 4/5] [2021-11-19 21:10:32,687][INFO ][test-runner-#20229%encryption.MasterKeyChangeConsistencyCheckTest%][IgniteKernal%grid-1] >>> Ignite cluster is in INACTIVE state (limited functionality available). Use control.(sh|bat) script or IgniteCluster.state(ClusterState.ACTIVE) to change the state. [21:10:32] : [Step 4/5] [2021-11-19 21:10:32,687][INFO ][test-runner-#20229%encryption.MasterKeyChangeConsistencyCheckTest%][GridDiscoveryManager] Topology snapshot [ver=2, locNode=10d30f78, servers=2, clients=0, state=INACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=00ccd666-fbef-4b00-9ba6-82602e1ab000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=10d30f78-bc70-4a42-b3c3-b78ea89cf001, consistentId=grid-1, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:10:32] : [Step 4/5] [2021-11-19 21:10:32,688][INFO ][test-runner-#20229%encryption.MasterKeyChangeConsistencyCheckTest%][G] Node started : [stage="Configure system pool" (0 ms),stage="Start managers" (220 ms),stage="Configure binary metadata" (2 ms),stage="Start processors" (1908 ms),stage="Start 'StanByClusterTestProvider' plugin" (0 ms),stage="Start 'PageMemory tracker plugin' plugin" (0 ms),stage="Start 'TestDistibutedConfigurationPlugin' plugin" (0 ms),stage="Start 'NodeValidationPluginProvider' plugin" (0 ms),stage="Init metastore" (148 ms),stage="Init and start regions" (6 ms),stage="Restore binary memory" (16 ms),stage="Restore logical state" (77 ms),stage="Finish recovery" (900 ms),stage="Join topology" (110 ms),stage="Await transition" (2 ms),stage="Await exchange" (14 ms),stage="Total time" (3403 ms)] [21:10:32] : [Step 4/5] [2021-11-19 21:10:32,689][INFO ][test-runner-#20229%encryption.MasterKeyChangeConsistencyCheckTest%][root] Node started with the following configuration [id=10d30f78-bc70-4a42-b3c3-b78ea89cf001, marshaller=BinaryMarshaller [], discovery=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=5000, ackTimeout=5000, marsh=JdkMarshaller [clsFilter=org.apache.ignite.marshaller.MarshallerUtils$1@5ffa932c], reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], binaryCfg=null, lateAff=true] [21:10:32] : [Step 4/5] [2021-11-19 21:10:32,691][INFO ][test-runner-#20229%encryption.MasterKeyChangeConsistencyCheckTest%][GridClusterStateProcessor] Sending activate cluster request with BaselineTopology BaselineTopology [id=0, branchingHash=-2475315501, branchingType='New BaselineTopology', baselineNodes=[grid-1, grid-0]] [21:10:32] : [Step 4/5] [2021-11-19 21:10:32,695][INFO ][disco-notifier-worker-#20340%grid-0%][GridClusterStateProcessor] Received activate cluster request with BaselineTopology[id=0] initiator node ID: 00ccd666-fbef-4b00-9ba6-82602e1ab000 [21:10:32] : [Step 4/5] [2021-11-19 21:10:32,695][INFO ][disco-notifier-worker-#20340%grid-0%][GridClusterStateProcessor] Started state transition: activate cluster [21:10:32] : [Step 4/5] [2021-11-19 21:10:32,696][INFO ][exchange-worker-#20345%grid-0%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], crd=true, evt=DISCOVERY_CUSTOM_EVT, evtNode=00ccd666-fbef-4b00-9ba6-82602e1ab000, customEvt=ChangeGlobalStateMessage [id=45d7d593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqId=92f99842-ff3e-4cf0-ba29-3bc48d6cdb38, initiatingNodeId=00ccd666-fbef-4b00-9ba6-82602e1ab000, state=ACTIVE, baselineTopology=BaselineTopology [id=0, branchingHash=-2475315501, branchingType='New BaselineTopology', baselineNodes=[grid-1, grid-0]], forceChangeBaselineTopology=false, timestamp=1637345432691, forceDeactivation=true], allowMerge=false, exchangeFreeSwitch=false] [21:10:32] : [Step 4/5] [2021-11-19 21:10:32,697][INFO ][disco-notifier-worker-#20458%grid-1%][GridClusterStateProcessor] Received activate cluster request with BaselineTopology[id=0] initiator node ID: 00ccd666-fbef-4b00-9ba6-82602e1ab000 [21:10:32] : [Step 4/5] [2021-11-19 21:10:32,697][INFO ][disco-notifier-worker-#20458%grid-1%][GridClusterStateProcessor] Started state transition: activate cluster [21:10:32] : [Step 4/5] [2021-11-19 21:10:32,697][INFO ][exchange-worker-#20345%grid-0%][GridDhtPartitionsExchangeFuture] Start activation process [nodeId=00ccd666-fbef-4b00-9ba6-82602e1ab000, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]]. New state: ACTIVE [21:10:32] : [Step 4/5] [2021-11-19 21:10:32,698][INFO ][exchange-worker-#20467%grid-1%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], crd=false, evt=DISCOVERY_CUSTOM_EVT, evtNode=00ccd666-fbef-4b00-9ba6-82602e1ab000, customEvt=ChangeGlobalStateMessage [id=45d7d593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqId=92f99842-ff3e-4cf0-ba29-3bc48d6cdb38, initiatingNodeId=00ccd666-fbef-4b00-9ba6-82602e1ab000, state=ACTIVE, baselineTopology=BaselineTopology [id=0, branchingHash=-2475315501, branchingType='New BaselineTopology', baselineNodes=[grid-1, grid-0]], forceChangeBaselineTopology=false, timestamp=1637345432691, forceDeactivation=true], allowMerge=false, exchangeFreeSwitch=false] [21:10:32] : [Step 4/5] [2021-11-19 21:10:32,700][INFO ][exchange-worker-#20467%grid-1%][GridDhtPartitionsExchangeFuture] Start activation process [nodeId=10d30f78-bc70-4a42-b3c3-b78ea89cf001, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]]. New state: ACTIVE [21:10:32] : [Step 4/5] [2021-11-19 21:10:32,699][INFO ][exchange-worker-#20345%grid-0%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0 [21:10:32] : [Step 4/5] [2021-11-19 21:10:32,700][INFO ][exchange-worker-#20467%grid-1%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1 [21:10:32] : [Step 4/5] [2021-11-19 21:10:32,704][INFO ][exchange-worker-#20467%grid-1%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000000.wal, offset=8713, ver=2] [21:10:32] : [Step 4/5] [2021-11-19 21:10:32,704][INFO ][exchange-worker-#20345%grid-0%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000000.wal, offset=8713, ver=2] [21:10:32] : [Step 4/5] [2021-11-19 21:10:32,705][INFO ][exchange-worker-#20467%grid-1%][GridClusterStateProcessor] Writing BaselineTopology[id=0] [21:10:32] : [Step 4/5] [2021-11-19 21:10:32,707][INFO ][exchange-worker-#20345%grid-0%][GridClusterStateProcessor] Writing BaselineTopology[id=0] [21:10:32] : [Step 4/5] [2021-11-19 21:10:32,940][INFO ][exchange-worker-#20467%grid-1%][GridCacheDatabaseSharedManager] Finish recovery performed in 238 ms. [21:10:32] : [Step 4/5] [2021-11-19 21:10:32,941][INFO ][exchange-worker-#20345%grid-0%][GridCacheDatabaseSharedManager] Finish recovery performed in 240 ms. [21:10:32] : [Step 4/5] [2021-11-19 21:10:32,942][INFO ][exchange-worker-#20467%grid-1%][msg] Components activation performed in 242 ms. [21:10:32] : [Step 4/5] [2021-11-19 21:10:32,942][INFO ][exchange-worker-#20345%grid-0%][msg] Components activation performed in 244 ms. [21:10:32] : [Step 4/5] [2021-11-19 21:10:32,943][INFO ][exchange-worker-#20467%grid-1%][GridCacheProcessor] Finished recovery for cache [cache=ignite-sys-cache, grp=ignite-sys-cache, startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:10:32] : [Step 4/5] [2021-11-19 21:10:32,943][INFO ][exchange-worker-#20345%grid-0%][GridCacheProcessor] Finished recovery for cache [cache=ignite-sys-cache, grp=ignite-sys-cache, startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:10:32] : [Step 4/5] [2021-11-19 21:10:32,944][INFO ][exchange-worker-#20467%grid-1%][GridDhtPartitionsExchangeFuture] Successfully activated caches [nodeId=10d30f78-bc70-4a42-b3c3-b78ea89cf001, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], newState=ACTIVE] [21:10:32] : [Step 4/5] [2021-11-19 21:10:32,944][INFO ][exchange-worker-#20345%grid-0%][GridDhtPartitionsExchangeFuture] Successfully activated caches [nodeId=00ccd666-fbef-4b00-9ba6-82602e1ab000, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], newState=ACTIVE] [21:10:32] : [Step 4/5] [2021-11-19 21:10:32,945][INFO ][exchange-worker-#20467%grid-1%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:10:32] : [Step 4/5] [2021-11-19 21:10:32,945][INFO ][exchange-worker-#20345%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:10:33] : [Step 4/5] [2021-11-19 21:10:33,181][INFO ][exchange-worker-#20345%grid-0%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], crd=true] [21:10:33] : [Step 4/5] [2021-11-19 21:10:33,183][INFO ][grid-nio-worker-tcp-comm-0-#20284%TcpCommunicationSpi%][TcpCommunicationSpi] Accepted incoming communication connection [locAddr=/127.0.0.1:45200, rmtAddr=/127.0.0.1:35886] [21:10:33] : [Step 4/5] [2021-11-19 21:10:33,185][INFO ][grid-nio-worker-tcp-comm-0-#20402%TcpCommunicationSpi%][TcpCommunicationSpi] Established outgoing communication connection [locAddr=/127.0.0.1:35886, rmtAddr=/127.0.0.1:45200] [21:10:33] : [Step 4/5] [2021-11-19 21:10:33,186][INFO ][exchange-worker-#20467%grid-1%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], crd=false] [21:10:33] : [Step 4/5] [2021-11-19 21:10:33,187][INFO ][sys-#20339%grid-0%][GridDhtPartitionsExchangeFuture] Coordinator received single message [ver=AffinityTopologyVersion [topVer=2, minorTopVer=1], node=10d30f78-bc70-4a42-b3c3-b78ea89cf001, allReceived=true] [21:10:33] : [Step 4/5] [2021-11-19 21:10:33,187][INFO ][sys-#20339%grid-0%][GridDhtPartitionsExchangeFuture] finishExchangeOnCoordinator [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:10:33] : [Step 4/5] [2021-11-19 21:10:33,192][INFO ][sys-#20339%grid-0%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], err=null, rebalanced=true, wasRebalanced=false] [21:10:33] : [Step 4/5] [2021-11-19 21:10:33,192][INFO ][sys-#20440%grid-1%][GridDhtPartitionsExchangeFuture] Received full message, will finish exchange [node=00ccd666-fbef-4b00-9ba6-82602e1ab000, resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:10:33] : [Step 4/5] [2021-11-19 21:10:33,192][INFO ][disco-notifier-worker-#20340%grid-0%][GridClusterStateProcessor] Received state change finish message: ACTIVE [21:10:33] : [Step 4/5] [2021-11-19 21:10:33,193][INFO ][disco-notifier-worker-#20458%grid-1%][GridClusterStateProcessor] Received state change finish message: ACTIVE [21:10:33] : [Step 4/5] [2021-11-19 21:10:33,195][INFO ][disco-notifier-worker-#20458%grid-1%][GridClusterStateProcessor] Cluster state was changed from INACTIVE to ACTIVE [21:10:33] : [Step 4/5] [2021-11-19 21:10:33,195][INFO ][sys-#20339%grid-0%][GridCacheProcessor] Finish proxy initialization, cacheName=ignite-sys-cache, localNodeId=00ccd666-fbef-4b00-9ba6-82602e1ab000 [21:10:33] : [Step 4/5] [2021-11-19 21:10:33,195][INFO ][sys-#20440%grid-1%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], err=null, rebalanced=true, wasRebalanced=false] [21:10:33] : [Step 4/5] [2021-11-19 21:10:33,196][INFO ][exchange-worker-#20345%grid-0%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=2, minorTopVer=1], force=false, evt=DISCOVERY_CUSTOM_EVT, node=00ccd666-fbef-4b00-9ba6-82602e1ab000] [21:10:33] : [Step 4/5] [2021-11-19 21:10:33,194][INFO ][sys-#20450%grid-1%][GridCachePartitionExchangeManager] Delay process full message without exchange id (there is exchange in progress) [nodeId=00ccd666-fbef-4b00-9ba6-82602e1ab000] [21:10:33] : [Step 4/5] [2021-11-19 21:10:33,194][INFO ][disco-notifier-worker-#20340%grid-0%][GridClusterStateProcessor] Cluster state was changed from INACTIVE to ACTIVE [21:10:33] : [Step 4/5] [2021-11-19 21:10:33,198][INFO ][sys-#20440%grid-1%][GridCacheProcessor] Finish proxy initialization, cacheName=ignite-sys-cache, localNodeId=10d30f78-bc70-4a42-b3c3-b78ea89cf001 [21:10:33] : [Step 4/5] [2021-11-19 21:10:33,196][INFO ][sys-#20339%grid-0%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=00ccd666-fbef-4b00-9ba6-82602e1ab000, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=00ccd666-fbef-4b00-9ba6-82602e1ab000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345433185, loc=true, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:10:33] : [Step 4/5] [2021-11-19 21:10:33,196][INFO ][sys-#20338%grid-0%][DistributedBaselineConfiguration] Baseline auto-adjust is 'disabled' with timeout='300000' ms [21:10:33] : [Step 4/5] [2021-11-19 21:10:33,201][INFO ][sys-#20338%grid-0%][GridClusterStateProcessor] Successfully performed final activation steps [nodeId=00ccd666-fbef-4b00-9ba6-82602e1ab000, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:10:33] : [Step 4/5] [2021-11-19 21:10:33,201][INFO ][sys-#20339%grid-0%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (0 ms), stage="Update caches registry" (246 ms), stage="Start caches" (0 ms), stage="Affinity initialization on cache group start" (0 ms), stage="Determine exchange type" (1 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Restore partition states" (0 ms), stage="After states restored callback" (234 ms), stage="WAL history reservation" (0 ms), stage="Waiting for all single messages" (6 ms), stage="Affinity recalculation (crd)" (0 ms), stage="Collect update counters and create affinity messages" (0 ms), stage="Assign partitions states" (0 ms), stage="Validate partitions states" (0 ms), stage="Ideal affinity diff calculation (enforced)" (0 ms), stage="Apply update counters" (0 ms), stage="Full message preparing" (2 ms), stage="Full message sending" (0 ms), stage="State finish message sending" (0 ms), stage="Detect lost partitions" (2 ms), stage="Exchange done" (6 ms), stage="Total time" (497 ms), Discovery lag=2 ms, Latest started node id=10d30f78-bc70-4a42-b3c3-b78ea89cf001] [21:10:33] : [Step 4/5] [2021-11-19 21:10:33,200][INFO ][test-runner-#20229%encryption.MasterKeyChangeConsistencyCheckTest%][root] awaitPartitionMapExchange finished [21:10:33] : [Step 4/5] [2021-11-19 21:10:33,200][INFO ][sys-#20440%grid-1%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=10d30f78-bc70-4a42-b3c3-b78ea89cf001, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=00ccd666-fbef-4b00-9ba6-82602e1ab000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345432650, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:10:33] : [Step 4/5] [2021-11-19 21:10:33,200][INFO ][exchange-worker-#20467%grid-1%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=2, minorTopVer=1], force=false, evt=DISCOVERY_CUSTOM_EVT, node=00ccd666-fbef-4b00-9ba6-82602e1ab000] [21:10:33] : [Step 4/5] [2021-11-19 21:10:33,199][INFO ][sys-#20453%grid-1%][DistributedBaselineConfiguration] Baseline auto-adjust is 'disabled' with timeout='300000' ms [21:10:33] : [Step 4/5] [2021-11-19 21:10:33,205][INFO ][sys-#20453%grid-1%][GridClusterStateProcessor] Successfully performed final activation steps [nodeId=10d30f78-bc70-4a42-b3c3-b78ea89cf001, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:10:33] : [Step 4/5] [2021-11-19 21:10:33,204][INFO ][sys-#20440%grid-1%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (1 ms), stage="Update caches registry" (243 ms), stage="Start caches" (0 ms), stage="Affinity initialization on cache group start" (0 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Restore partition states" (0 ms), stage="After states restored callback" (235 ms), stage="WAL history reservation" (0 ms), stage="Waiting for Full message" (11 ms), stage="Affinity recalculation" (1 ms), stage="Full map updating" (0 ms), stage="Detect lost partitions" (2 ms), stage="Exchange done" (7 ms), stage="Total time" (500 ms)] [21:10:33] : [Step 4/5] [2021-11-19 21:10:33,203][INFO ][sys-#20339%grid-0%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], stage="Affinity initialization on cache group start [grp=ignite-sys-cache]" (0 ms) (parent=Affinity initialization on cache group start), stage="Affinity centralized initialization (crd) [grp=ignite-sys-cache, crd=true]" (1 ms) (parent=Determine exchange type), stage="Restore partition states [grp=ignite-sys-cache]" (0 ms) (parent=Restore partition states), stage="Affinity recalculation (partitions availability) [grp=ignite-sys-cache]" (0 ms) (parent=Ideal affinity diff calculation (enforced))] [21:10:33] : [Step 4/5] [2021-11-19 21:10:33,208][INFO ][sys-#20440%grid-1%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], stage="Affinity initialization on cache group start [grp=ignite-sys-cache]" (0 ms) (parent=Affinity initialization on cache group start), stage="Affinity centralized initialization (crd) [grp=ignite-sys-cache, crd=false]" (0 ms) (parent=Determine exchange type), stage="Restore partition states [grp=ignite-sys-cache]" (0 ms) (parent=Restore partition states), stage="Affinity applying from full message [grp=ignite-sys-cache]" (1 ms) (parent=Affinity recalculation)] [21:10:33] : [Step 4/5] [2021-11-19 21:10:33,273][INFO ][test-runner-#20229%encryption.MasterKeyChangeConsistencyCheckTest%][MasterKeyChangeConsistencyCheckTest$TestKeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:10:33] : [Step 4/5] [2021-11-19 21:10:33,424][INFO ][disco-notifier-worker-#20340%grid-0%][MasterKeyChangeConsistencyCheckTest$TestKeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:10:33] : [Step 4/5] [2021-11-19 21:10:33,429][INFO ][disco-notifier-worker-#20458%grid-1%][MasterKeyChangeConsistencyCheckTest$TestKeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:10:33] : [Step 4/5] [2021-11-19 21:10:33,574][INFO ][disco-notifier-worker-#20340%grid-0%][MasterKeyChangeConsistencyCheckTest$TestKeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:10:33] : [Step 4/5] [2021-11-19 21:10:33,577][INFO ][disco-notifier-worker-#20458%grid-1%][MasterKeyChangeConsistencyCheckTest$TestKeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:10:33] : [Step 4/5] [2021-11-19 21:10:33,676][INFO ][disco-notifier-worker-#20340%grid-0%][GridEncryptionManager] Start master key change [masterKeyName=ignite.master.key2] [21:10:33] : [Step 4/5] [2021-11-19 21:10:33,676][INFO ][disco-notifier-worker-#20458%grid-1%][GridEncryptionManager] Start master key change [masterKeyName=ignite.master.key2] [21:10:33]W: [org.apache.ignite:ignite-core] [2021-11-19 21:10:33,785][ERROR][disco-notifier-worker-#20458%grid-1%][GridEncryptionManager] Unable to change master key locally. [21:10:33]W: [org.apache.ignite:ignite-core] class org.apache.ignite.spi.IgniteSpiException: Test error. [21:10:33]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.encryption.MasterKeyChangeConsistencyCheckTest$TestKeystoreEncryptionSpi.setMasterKeyName(MasterKeyChangeConsistencyCheckTest.java:148) [21:10:33]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.managers.encryption.GridEncryptionManager.doChangeMasterKey(GridEncryptionManager.java:1428) [21:10:33]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.managers.encryption.GridEncryptionManager.performMasterKeyChange(GridEncryptionManager.java:1596) [21:10:33]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.distributed.DistributedProcess.lambda$new$2(DistributedProcess.java:149) [21:10:33]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.managers.discovery.GridDiscoveryManager$4.onDiscovery0(GridDiscoveryManager.java:774) [21:10:33]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.managers.discovery.GridDiscoveryManager$4.access$7500(GridDiscoveryManager.java:561) [21:10:33]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.managers.discovery.GridDiscoveryManager$4$NotificationTask.run(GridDiscoveryManager.java:996) [21:10:33]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.managers.discovery.GridDiscoveryManager$DiscoveryMessageNotifierWorker.body0(GridDiscoveryManager.java:2871) [21:10:33]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.managers.discovery.GridDiscoveryManager$DiscoveryMessageNotifierWorker.body(GridDiscoveryManager.java:2909) [21:10:33]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:125) [21:10:33]W: [org.apache.ignite:ignite-core] at java.lang.Thread.run(Thread.java:748) [21:10:33]W: [org.apache.ignite:ignite-core] [2021-11-19 21:10:33,788][ERROR][disco-notifier-worker-#20458%grid-1%][IgniteTestResources] Critical system error detected. Will be handled accordingly to configured handler [hnd=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]], failureCtx=FailureContext [type=CRITICAL_ERROR, err=class o.a.i.IgniteException: Unable to change master key locally.]] [21:10:33]W: [org.apache.ignite:ignite-core] class org.apache.ignite.IgniteException: Unable to change master key locally. [21:10:33]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.managers.encryption.GridEncryptionManager.doChangeMasterKey(GridEncryptionManager.java:1451) [21:10:33]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.managers.encryption.GridEncryptionManager.performMasterKeyChange(GridEncryptionManager.java:1596) [21:10:33]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.distributed.DistributedProcess.lambda$new$2(DistributedProcess.java:149) [21:10:33]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.managers.discovery.GridDiscoveryManager$4.onDiscovery0(GridDiscoveryManager.java:774) [21:10:33]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.managers.discovery.GridDiscoveryManager$4.access$7500(GridDiscoveryManager.java:561) [21:10:33]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.managers.discovery.GridDiscoveryManager$4$NotificationTask.run(GridDiscoveryManager.java:996) [21:10:33]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.managers.discovery.GridDiscoveryManager$DiscoveryMessageNotifierWorker.body0(GridDiscoveryManager.java:2871) [21:10:33]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.managers.discovery.GridDiscoveryManager$DiscoveryMessageNotifierWorker.body(GridDiscoveryManager.java:2909) [21:10:33]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:125) [21:10:33]W: [org.apache.ignite:ignite-core] at java.lang.Thread.run(Thread.java:748) [21:10:33]W: [org.apache.ignite:ignite-core] Caused by: class org.apache.ignite.spi.IgniteSpiException: Test error. [21:10:33]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.encryption.MasterKeyChangeConsistencyCheckTest$TestKeystoreEncryptionSpi.setMasterKeyName(MasterKeyChangeConsistencyCheckTest.java:148) [21:10:33]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.managers.encryption.GridEncryptionManager.doChangeMasterKey(GridEncryptionManager.java:1428) [21:10:33]W: [org.apache.ignite:ignite-core] ... 9 more [21:10:33]W: [org.apache.ignite:ignite-core] [2021-11-19 21:10:33,792][WARN ][disco-notifier-worker-#20458%grid-1%][CacheDiagnosticManager] Page locks dump: [21:10:33]W: [org.apache.ignite:ignite-core] [21:10:33]W: [org.apache.ignite:ignite-core] [21:10:33]W: [org.apache.ignite:ignite-core] [21:10:33]W: [org.apache.ignite:ignite-core] [21:10:33]W: [org.apache.ignite:ignite-core] [21:10:33]W: [org.apache.ignite:ignite-core] [21:10:33]W: [org.apache.ignite:ignite-core] [2021-11-19 21:10:33,793][ERROR][disco-notifier-worker-#20458%grid-1%][FailureProcessor] Ignite node is in invalid state due to a critical failure. [21:10:33] : [Step 4/5] [2021-11-19 21:10:33,841][INFO ][disco-notifier-worker-#20340%grid-0%][MasterKeyChangeConsistencyCheckTest$TestKeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:10:33]W: [org.apache.ignite:ignite-core] [2021-11-19 21:10:33,936][ERROR][dms-writer-thread-#20474%grid-1%][DistributedMetaStorageImpl] Runtime error caught during grid runnable execution: GridWorker [name=dms-writer, igniteInstanceName=grid-1, finished=false, heartbeatTs=1637345432933, hashCode=1280595420, interrupted=false, runner=dms-writer-thread-#20474%grid-1%] [21:10:33]W: [org.apache.ignite:ignite-core] class org.apache.ignite.IgniteException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:10:33]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.convertException(IgniteUtils.java:1112) [21:10:33]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.metastorage.persistence.DmsDataWriterWorker.lambda$newDmsTask$6(DmsDataWriterWorker.java:312) [21:10:33]W: [org.apache.ignite:ignite-core] at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) [21:10:33]W: [org.apache.ignite:ignite-core] at java.util.concurrent.FutureTask.run(FutureTask.java:266) [21:10:33]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.metastorage.persistence.DmsDataWriterWorker.body(DmsDataWriterWorker.java:204) [21:10:33]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:125) [21:10:33]W: [org.apache.ignite:ignite-core] at java.lang.Thread.run(Thread.java:748) [21:10:33]W: [org.apache.ignite:ignite-core] Caused by: class org.apache.ignite.internal.processors.cache.persistence.StorageException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:10:33]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.filehandle.FsyncFileWriteHandle.checkNode(FsyncFileWriteHandle.java:421) [21:10:33]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.filehandle.FsyncFileWriteHandle.flush(FsyncFileWriteHandle.java:438) [21:10:33]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.filehandle.FsyncFileWriteHandle.flush(FsyncFileWriteHandle.java:403) [21:10:33]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.filehandle.FsyncFileWriteHandle.flushOrWait(FsyncFileWriteHandle.java:343) [21:10:33]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.filehandle.FsyncFileWriteHandle.fsync(FsyncFileWriteHandle.java:585) [21:10:33]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.filehandle.FsyncFileHandleManagerImpl.flush(FsyncFileHandleManagerImpl.java:166) [21:10:33]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager.flush(FileWriteAheadLogManager.java:973) [21:10:33]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.metastorage.MetaStorage.writeRaw(MetaStorage.java:452) [21:10:33]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.metastorage.MetaStorage.write(MetaStorage.java:415) [21:10:33]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.metastorage.persistence.DmsDataWriterWorker.lambda$update$1(DmsDataWriterWorker.java:133) [21:10:33]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.metastorage.persistence.DmsDataWriterWorker.lambda$newDmsTask$6(DmsDataWriterWorker.java:309) [21:10:33]W: [org.apache.ignite:ignite-core] ... 5 more [21:10:34] : [Step 4/5] [2021-11-19 21:10:34,001][INFO ][disco-notifier-worker-#20340%grid-0%][GridEncryptionManager] Master key successfully changed [masterKeyName=ignite.master.key2] [21:10:34] : [Step 4/5] [2021-11-19 21:10:34,002][INFO ][db-checkpoint-thread-#20476%grid-1%][Checkpointer] Checkpoint started [checkpointId=261d1c61-a07d-47f4-b175-f230d68593c6, startPtr=WALPointer [idx=0, fileOff=66667, len=1963], checkpointBeforeLockTime=1ms, checkpointLockWait=229ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=250ms, writeCheckpointEntryDuration=570ms, splitAndSor[21:10:34] >>>tCpPagesDuration=1ms Stopping te, past: ges=MasterKey16,ChangeConsi reasonstencyCheckTest#test='node started'] [21:10:34] : [Step 4/5] FailureHandledOnFailPerformMasterKeyChange i[2021-11-19 21:10:34,002][INFn 6O ][db-checkpoint-thr827 ms <>> Stopping test: MasterKeyChangeConsistencyCheckTest#testFailureHandledOnFailPerformMasterKeyChange in 6827 ms <<< [21:10:34] : [Step 4/5] [21:10:34] >>> Heap: 559 MB used / 1931 MB commited / 1931 MB max <<< [21:10:34] : [Step 4/5] [2021-11-19 21:10:34,005][INFO ][main][root] >>> Heap: 559 MB used / 1931 MB commited / 1931 MB max <<< [21:10:34] : [Step 4/5] [21:10:34] >>> Non-Heap: 156 MB used / 183 MB commited / 0 MB max <<< [21:10:34] : [Step 4/5] [2021-11-19 21:10:34,010][INFO ][main][root] >>> Non-Heap: 156 MB used / 183 MB commited / 0 MB max <<< [21:10:34] : [Step 4/5] [2021-11-19 21:10:34,010][INFO ][main][root] >>> Stopping grid [name=grid-1, id=10d30f78-bc70-4a42-b3c3-b78ea89cf001] [21:10:34] : [Step 4/5] [2021-11-19 21:10:34,216][INFO ][tcp-disco-sock-reader-[00ccd666 127.0.0.1:57679]-#1073%grid-1%-#20463%grid-1%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:57679, rmtPort=57679, rmtNodeId=00ccd666-fbef-4b00-9ba6-82602e1ab000] [21:10:34] : [Step 4/5] [2021-11-19 21:10:34,218][INFO ][disco-event-worker-#20344%grid-0%][GridDiscoveryManager] Node left topology: TcpDiscoveryNode [id=10d30f78-bc70-4a42-b3c3-b78ea89cf001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637345432600, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false] [21:10:34]W: [org.apache.ignite:ignite-core] [2021-11-19 21:10:34,220][ERROR][main][GridCacheProcessor] Failed to flush write-ahead log on cache stop [cache=ignite-sys-cache] [21:10:34]W: [org.apache.ignite:ignite-core] class org.apache.ignite.internal.processors.cache.persistence.StorageException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:10:34]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.filehandle.FsyncFileWriteHandle.checkNode(FsyncFileWriteHandle.java:421) [21:10:34]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.filehandle.FsyncFileWriteHandle.flush(FsyncFileWriteHandle.java:438) [21:10:34]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.filehandle.FsyncFileWriteHandle.flush(FsyncFileWriteHandle.java:403) [21:10:34]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.filehandle.FsyncFileWriteHandle.flushOrWait(FsyncFileWriteHandle.java:343) [21:10:34]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.filehandle.FsyncFileWriteHandle.fsync(FsyncFileWriteHandle.java:585) [21:10:34]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.filehandle.FsyncFileHandleManagerImpl.flush(FsyncFileHandleManagerImpl.java:166) [21:10:34]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager.flush(FileWriteAheadLogManager.java:973) [21:10:34]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.GridCacheProcessor.stopCache(GridCacheProcessor.java:1059) [21:10:34]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.GridCacheProcessor.stopCache(GridCacheProcessor.java:1043) [21:10:34]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.GridCacheProcessor.stopCaches(GridCacheProcessor.java:803) [21:10:34]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.GridCacheProcessor.stop(GridCacheProcessor.java:777) [21:10:34]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.IgniteKernal.stop0(IgniteKernal.java:2616) [21:10:34]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.IgniteKernal.stop(IgniteKernal.java:2494) [21:10:34]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.IgnitionEx$IgniteNamedInstance.stop0(IgnitionEx.java:2379) [21:10:34]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.IgnitionEx$IgniteNamedInstance.stop(IgnitionEx.java:2202) [21:10:34]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.IgnitionEx.stop(IgnitionEx.java:349) [21:10:34]W: [org.apache.ignite:ignite-core] at org.apache.ignite.testframework.junits.GridAbstractTest.stopGrid0(GridAbstractTest.java:1517) [21:10:34]W: [org.apache.ignite:ignite-core] at org.apache.ignite.testframework.junits.GridAbstractTest.stopGrid(GridAbstractTest.java:1485) [21:10:34]W: [org.apache.ignite:ignite-core] at org.apache.ignite.testframework.junits.GridAbstractTest.stopAllGrids(GridAbstractTest.java:1579) [21:10:34]W: [org.apache.ignite:ignite-core] at org.apache.ignite.testframework.junits.GridAbstractTest.stopAllGrids(GridAbstractTest.java:1551) [21:10:34]W: [org.apache.ignite:ignite-core] at org.apache.ignite.testframework.junits.GridAbstractTest.stopAllGrids(GridAbstractTest.java:1543) [21:10:34]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.encryption.MasterKeyChangeConsistencyCheckTest.afterTest(MasterKeyChangeConsistencyCheckTest.java:122) [21:10:34]W: [org.apache.ignite:ignite-core] at org.apache.ignite.testframework.junits.GridAbstractTest.cleanUpTestEnviroment(GridAbstractTest.java:740) [21:10:34]W: [org.apache.ignite:ignite-core] at org.apache.ignite.testframework.junits.GridAbstractTest.runTest(GridAbstractTest.java:2487) [21:10:34]W: [org.apache.ignite:ignite-core] at org.apache.ignite.testframework.junits.GridAbstractTest.access$600(GridAbstractTest.java:182) [21:10:34]W: [org.apache.ignite:ignite-core] at org.apache.ignite.testframework.junits.GridAbstractTest$2.evaluate(GridAbstractTest.java:226) [21:10:34]W: [org.apache.ignite:ignite-core] at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55) [21:10:34]W: [org.apache.ignite:ignite-core] at org.apache.ignite.testframework.junits.SystemPropertiesRule.lambda$methodStatement$1(SystemPropertiesRule.java:110) [21:10:34]W: [org.apache.ignite:ignite-core] at org.apache.ignite.testframework.junits.DelegatingJUnitStatement.evaluate(DelegatingJUnitStatement.java:49) [21:10:34]W: [org.apache.ignite:ignite-core] at org.junit.rules.RunRules.evaluate(RunRules.java:20) [21:10:34]W: [org.apache.ignite:ignite-core] at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:325) [21:10:34]W: [org.apache.ignite:ignite-core] at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:78) [21:10:34]W: [org.apache.ignite:ignite-core] at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:57) [21:10:34]W: [org.apache.ignite:ignite-core] at org.junit.runners.ParentRunner$3.run(ParentRunner.java:290) [21:10:34]W: [org.apache.ignite:ignite-core] at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:71) [21:10:34]W: [org.apache.ignite:ignite-core] at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:288) [21:10:34]W: [org.apache.ignite:ignite-core] at org.junit.runners.ParentRunner.access$000(ParentRunner.java:58) [21:10:34]W: [org.apache.ignite:ignite-core] at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:268) [21:10:34]W: [org.apache.ignite:ignite-core] at org.apache.ignite.testframework.junits.GridAbstractTest.evaluateInsideFixture(GridAbstractTest.java:2984) [21:10:34]W: [org.apache.ignite:ignite-core] at org.apache.ignite.testframework.junits.GridAbstractTest.access$500(GridAbstractTest.java:182) [21:10:34]W: [org.apache.ignite:ignite-core] at org.apache.ignite.testframework.junits.GridAbstractTest$BeforeFirstAndAfterLastTestRule$1.evaluate(GridAbstractTest.java:2964) [21:10:34]W: [org.apache.ignite:ignite-core] at org.apache.ignite.testframework.junits.SystemPropertiesRule.lambda$classStatement$0(SystemPropertiesRule.java:94) [21:10:34]W: [org.apache.ignite:ignite-core] at org.apache.ignite.testframework.junits.DelegatingJUnitStatement.evaluate(DelegatingJUnitStatement.java:49) [21:10:34]W: [org.apache.ignite:ignite-core] at org.junit.rules.RunRules.evaluate(RunRules.java:20) [21:10:34]W: [org.apache.ignite:ignite-core] at org.junit.runners.ParentRunner.run(ParentRunner.java:363) [21:10:34]W: [org.apache.ignite:ignite-core] at org.junit.runners.Suite.runChild(Suite.java:128) [21:10:34]W: [org.apache.ignite:ignite-core] at org.junit.runners.Suite.runChild(Suite.java:27) [21:10:34]W: [org.apache.ignite:ignite-core] at org.junit.runners.ParentRunner$3.run(ParentRunner.java:290) [21:10:34]W: [org.apache.ignite:ignite-core] at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:71) [21:10:34]W: [org.apache.ignite:ignite-core] at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:288) [21:10:34]W: [org.apache.ignite:ignite-core] at org.junit.runners.ParentRunner.access$000(ParentRunner.java:58) [21:10:34]W: [org.apache.ignite:ignite-core] at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:268) [21:10:34]W: [org.apache.ignite:ignite-core] at org.junit.runners.ParentRunner.run(ParentRunner.java:363) [21:10:34]W: [org.apache.ignite:ignite-core] at org.apache.maven.surefire.junit4.JUnit4Provider.execute(JUnit4Provider.java:365) [21:10:34]W: [org.apache.ignite:ignite-core] at org.apache.maven.surefire.junit4.JUnit4Provider.executeWithRerun(JUnit4Provider.java:273) [21:10:34]W: [org.apache.ignite:ignite-core] at org.apache.maven.surefire.junit4.JUnit4Provider.executeTestSet(JUnit4Provider.java:238) [21:10:34]W: [org.apache.ignite:ignite-core] at org.apache.maven.surefire.junit4.JUnit4Provider.invoke(JUnit4Provider.java:159) [21:10:34]W: [org.apache.ignite:ignite-core] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) [21:10:34]W: [org.apache.ignite:ignite-core] at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) [21:10:34]W: [org.apache.ignite:ignite-core] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [21:10:34]W: [org.apache.ignite:ignite-core] at java.lang.reflect.Method.invoke(Method.java:498) [21:10:34]W: [org.apache.ignite:ignite-core] at org.apache.maven.surefire.util.ReflectionUtils.invokeMethodWithArray2(ReflectionUtils.java:186) [21:10:34]W: [org.apache.ignite:ignite-core] at org.apache.maven.surefire.booter.ProviderFactory$ProviderProxy.invoke(ProviderFactory.java:161) [21:10:34]W: [org.apache.ignite:ignite-core] at org.apache.maven.surefire.booter.ProviderFactory.invokeProvider(ProviderFactory.java:84) [21:10:34]W: [org.apache.ignite:ignite-core] at org.apache.maven.plugin.surefire.InPluginVMSurefireStarter.runSuitesInProcess(InPluginVMSurefireStarter.java:87) [21:10:34]W: [org.apache.ignite:ignite-core] at org.apache.maven.plugin.surefire.AbstractSurefireMojo.executeProvider(AbstractSurefireMojo.java:1198) [21:10:34]W: [org.apache.ignite:ignite-core] at org.apache.maven.plugin.surefire.AbstractSurefireMojo.executeAfterPreconditionsChecked(AbstractSurefireMojo.java:1063) [21:10:34]W: [org.apache.ignite:ignite-core] at org.apache.maven.plugin.surefire.AbstractSurefireMojo.execute(AbstractSurefireMojo.java:889) [21:10:34]W: [org.apache.ignite:ignite-core] at org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo(DefaultBuildPluginManager.java:137) [21:10:34]W: [org.apache.ignite:ignite-core] at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:210) [21:10:34]W: [org.apache.ignite:ignite-core] at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:156) [21:10:34]W: [org.apache.ignite:ignite-core] at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:148) [21:10:34]W: [org.apache.ignite:ignite-core] at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:117) [21:10:34]W: [org.apache.ignite:ignite-core] at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:81) [21:10:34]W: [org.apache.ignite:ignite-core] at org.apache.maven.lifecycle.internal.builder.singlethreaded.SingleThreadedBuilder.build(SingleThreadedBuilder.java:56) [21:10:34]W: [org.apache.ignite:ignite-core] at org.apache.maven.lifecycle.internal.LifecycleStarter.execute(LifecycleStarter.java:128) [21:10:34]W: [org.apache.ignite:ignite-core] at org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:305) [21:10:34]W: [org.apache.ignite:ignite-core] at org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:192) [21:10:34]W: [org.apache.ignite:ignite-core] at org.apache.maven.DefaultMaven.execute(DefaultMaven.java:105) [21:10:34]W: [org.apache.ignite:ignite-core] at org.apache.maven.cli.MavenCli.execute(MavenCli.java:957) [21:10:34]W: [org.apache.ignite:ignite-core] at org.apache.maven.cli.MavenCli.doMain(MavenCli.java:289) [21:10:34]W: [org.apache.ignite:ignite-core] at org.apache.maven.cli.MavenCli.main(MavenCli.java:193) [21:10:34]W: [org.apache.ignite:ignite-core] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) [21:10:34]W: [org.apache.ignite:ignite-core] at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) [21:10:34]W: [org.apache.ignite:ignite-core] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [21:10:34]W: [org.apache.ignite:ignite-core] at java.lang.reflect.Method.invoke(Method.java:498) [21:10:34]W: [org.apache.ignite:ignite-core] at org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced(Launcher.java:282) [21:10:34]W: [org.apache.ignite:ignite-core] at org.codehaus.plexus.classworlds.launcher.Launcher.launch(Launcher.java:225) [21:10:34]W: [org.apache.ignite:ignite-core] at org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode(Launcher.java:406) [21:10:34]W: [org.apache.ignite:ignite-core] at org.codehaus.plexus.classworlds.launcher.Launcher.main(Launcher.java:347) [21:10:34] : [Step 4/5] [2021-11-19 21:10:34,220][INFO ][disco-event-worker-#20344%grid-0%][GridDiscoveryManager] Topology snapshot [ver=3, locNode=00ccd666, servers=1, clients=0, state=ACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=00ccd666-fbef-4b00-9ba6-82602e1ab000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:10:34] : [Step 4/5] [2021-11-19 21:10:34,233][INFO ][main][GridCacheProcessor] Stopped cache [cacheName=ignite-sys-cache] [21:10:34] : [Step 4/5] [2021-11-19 21:10:34,233][INFO ][disco-event-worker-#20344%grid-0%][GridDiscoveryManager] ^-- Baseline [id=0, size=2, online=1, offline=1] [21:10:34]W: [org.apache.ignite:ignite-core] [2021-11-19 21:10:34,234][WARN ][grid-nio-worker-tcp-comm-0-#20284%TcpCommunicationSpi%][TcpCommunicationSpi] Failed to shutdown socket [21:10:34]W: [org.apache.ignite:ignite-core] java.nio.channels.ClosedChannelException [21:10:34]W: [org.apache.ignite:ignite-core] at sun.nio.ch.SocketChannelImpl.shutdownOutput(SocketChannelImpl.java:795) [21:10:34]W: [org.apache.ignite:ignite-core] at sun.nio.ch.SocketAdaptor.shutdownOutput(SocketAdaptor.java:407) [21:10:34]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.close(IgniteUtils.java:4247) [21:10:34]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.closeKey(GridNioServer.java:2784) [21:10:34]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.close(GridNioServer.java:2835) [21:10:34]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.close(GridNioServer.java:2794) [21:10:34]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.bodyInternal(GridNioServer.java:2157) [21:10:34]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.body(GridNioServer.java:1910) [21:10:34]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:125) [21:10:34]W: [org.apache.ignite:ignite-core] at java.lang.Thread.run(Thread.java:748) [21:10:34] : [Step 4/5] [2021-11-19 21:10:34,237][INFO ][exchange-worker-#20345%grid-0%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], crd=true, evt=NODE_LEFT, evtNode=10d30f78-bc70-4a42-b3c3-b78ea89cf001, customEvt=null, allowMerge=false, exchangeFreeSwitch=true] [21:10:34]W: [org.apache.ignite:ignite-core] [2021-11-19 21:10:34,236][ERROR][main][FileWriteAheadLogManager] Failed to gracefully close WAL segment: o.a.i.i.processors.cache.persistence.wal.filehandle.FsyncFileWriteHandle@740b9a50 [21:10:34]W: [org.apache.ignite:ignite-core] class org.apache.ignite.internal.processors.cache.persistence.StorageException: Failed to perform WAL operation (environment was invalidated by a previous error) [21:10:34]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.filehandle.FsyncFileWriteHandle.checkNode(FsyncFileWriteHandle.java:421) [21:10:34]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.filehandle.FsyncFileWriteHandle.flush(FsyncFileWriteHandle.java:438) [21:10:34]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.filehandle.FsyncFileWriteHandle.flush(FsyncFileWriteHandle.java:389) [21:10:34]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.filehandle.FsyncFileWriteHandle.flushOrWait(FsyncFileWriteHandle.java:343) [21:10:34]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.filehandle.FsyncFileWriteHandle.close(FsyncFileWriteHandle.java:629) [21:10:34]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.filehandle.FsyncFileHandleManagerImpl.onDeactivate(FsyncFileHandleManagerImpl.java:130) [21:10:34]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager.stop0(FileWriteAheadLogManager.java:688) [21:10:34]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.GridCacheSharedManagerAdapter.stop(GridCacheSharedManagerAdapter.java:109) [21:10:34]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.GridCacheProcessor.stop(GridCacheProcessor.java:784) [21:10:34]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.IgniteKernal.stop0(IgniteKernal.java:2616) [21:10:34]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.IgniteKernal.stop(IgniteKernal.java:2494) [21:10:34]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.IgnitionEx$IgniteNamedInstance.stop0(IgnitionEx.java:2379) [21:10:34]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.IgnitionEx$IgniteNamedInstance.stop(IgnitionEx.java:2202) [21:10:34]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.IgnitionEx.stop(IgnitionEx.java:349) [21:10:34]W: [org.apache.ignite:ignite-core] at org.apache.ignite.testframework.junits.GridAbstractTest.stopGrid0(GridAbstractTest.java:1517) [21:10:34]W: [org.apache.ignite:ignite-core] at org.apache.ignite.testframework.junits.GridAbstractTest.stopGrid(GridAbstractTest.java:1485) [21:10:34]W: [org.apache.ignite:ignite-core] at org.apache.ignite.testframework.junits.GridAbstractTest.stopAllGrids(GridAbstractTest.java:1579) [21:10:34]W: [org.apache.ignite:ignite-core] at org.apache.ignite.testframework.junits.GridAbstractTest.stopAllGrids(GridAbstractTest.java:1551) [21:10:34]W: [org.apache.ignite:ignite-core] at org.apache.ignite.testframework.junits.GridAbstractTest.stopAllGrids(GridAbstractTest.java:1543) [21:10:34]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.encryption.MasterKeyChangeConsistencyCheckTest.afterTest(MasterKeyChangeConsistencyCheckTest.java:122) [21:10:34]W: [org.apache.ignite:ignite-core] at org.apache.ignite.testframework.junits.GridAbstractTest.cleanUpTestEnviroment(GridAbstractTest.java:740) [21:10:34]W: [org.apache.ignite:ignite-core] at org.apache.ignite.testframework.junits.GridAbstractTest.runTest(GridAbstractTest.java:2487) [21:10:34]W: [org.apache.ignite:ignite-core] at org.apache.ignite.testframework.junits.GridAbstractTest.access$600(GridAbstractTest.java:182) [21:10:34]W: [org.apache.ignite:ignite-core] at org.apache.ignite.testframework.junits.GridAbstractTest$2.evaluate(GridAbstractTest.java:226) [21:10:34]W: [org.apache.ignite:ignite-core] at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55) [21:10:34]W: [org.apache.ignite:ignite-core] at org.apache.ignite.testframework.junits.SystemPropertiesRule.lambda$methodStatement$1(SystemPropertiesRule.java:110) [21:10:34]W: [org.apache.ignite:ignite-core] at org.apache.ignite.testframework.junits.DelegatingJUnitStatement.evaluate(DelegatingJUnitStatement.java:49) [21:10:34]W: [org.apache.ignite:ignite-core] at org.junit.rules.RunRules.evaluate(RunRules.java:20) [21:10:34]W: [org.apache.ignite:ignite-core] at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:325) [21:10:34]W: [org.apache.ignite:ignite-core] at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:78) [21:10:34]W: [org.apache.ignite:ignite-core] at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:57) [21:10:34]W: [org.apache.ignite:ignite-core] at org.junit.runners.ParentRunner$3.run(ParentRunner.java:290) [21:10:34]W: [org.apache.ignite:ignite-core] at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:71) [21:10:34]W: [org.apache.ignite:ignite-core] at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:288) [21:10:34]W: [org.apache.ignite:ignite-core] at org.junit.runners.ParentRunner.access$000(ParentRunner.java:58) [21:10:34]W: [org.apache.ignite:ignite-core] at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:268) [21:10:34]W: [org.apache.ignite:ignite-core] at org.apache.ignite.testframework.junits.GridAbstractTest.evaluateInsideFixture(GridAbstractTest.java:2984) [21:10:34]W: [org.apache.ignite:ignite-core] at org.apache.ignite.testframework.junits.GridAbstractTest.access$500(GridAbstractTest.java:182) [21:10:34]W: [org.apache.ignite:ignite-core] at org.apache.ignite.testframework.junits.GridAbstractTest$BeforeFirstAndAfterLastTestRule$1.evaluate(GridAbstractTest.java:2964) [21:10:34]W: [org.apache.ignite:ignite-core] at org.apache.ignite.testframework.junits.SystemPropertiesRule.lambda$classStatement$0(SystemPropertiesRule.java:94) [21:10:34]W: [org.apache.ignite:ignite-core] at org.apache.ignite.testframework.junits.DelegatingJUnitStatement.evaluate(DelegatingJUnitStatement.java:49) [21:10:34]W: [org.apache.ignite:ignite-core] at org.junit.rules.RunRules.evaluate(RunRules.java:20) [21:10:34]W: [org.apache.ignite:ignite-core] at org.junit.runners.ParentRunner.run(ParentRunner.java:363) [21:10:34]W: [org.apache.ignite:ignite-core] at org.junit.runners.Suite.runChild(Suite.java:128) [21:10:34]W: [org.apache.ignite:ignite-core] at org.junit.runners.Suite.runChild(Suite.java:27) [21:10:34]W: [org.apache.ignite:ignite-core] at org.junit.runners.ParentRunner$3.run(ParentRunner.java:290) [21:10:34]W: [org.apache.ignite:ignite-core] at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:71) [21:10:34]W: [org.apache.ignite:ignite-core] at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:288) [21:10:34]W: [org.apache.ignite:ignite-core] at org.junit.runners.ParentRunner.access$000(ParentRunner.java:58) [21:10:34]W: [org.apache.ignite:ignite-core] at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:268) [21:10:34]W: [org.apache.ignite:ignite-core] at org.junit.runners.ParentRunner.run(ParentRunner.java:363) [21:10:34]W: [org.apache.ignite:ignite-core] at org.apache.maven.surefire.junit4.JUnit4Provider.execute(JUnit4Provider.java:365) [21:10:34]W: [org.apache.ignite:ignite-core] at org.apache.maven.surefire.junit4.JUnit4Provider.executeWithRerun(JUnit4Provider.java:273) [21:10:34]W: [org.apache.ignite:ignite-core] at org.apache.maven.surefire.junit4.JUnit4Provider.executeTestSet(JUnit4Provider.java:238) [21:10:34]W: [org.apache.ignite:ignite-core] at org.apache.maven.surefire.junit4.JUnit4Provider.invoke(JUnit4Provider.java:159) [21:10:34]W: [org.apache.ignite:ignite-core] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) [21:10:34]W: [org.apache.ignite:ignite-core] at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) [21:10:34]W: [org.apache.ignite:ignite-core] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [21:10:34]W: [org.apache.ignite:ignite-core] at java.lang.reflect.Method.invoke(Method.java:498) [21:10:34]W: [org.apache.ignite:ignite-core] at org.apache.maven.surefire.util.ReflectionUtils.invokeMethodWithArray2(ReflectionUtils.java:186) [21:10:34]W: [org.apache.ignite:ignite-core] at org.apache.maven.surefire.booter.ProviderFactory$ProviderProxy.invoke(ProviderFactory.java:161) [21:10:34]W: [org.apache.ignite:ignite-core] at org.apache.maven.surefire.booter.ProviderFactory.invokeProvider(ProviderFactory.java:84) [21:10:34]W: [org.apache.ignite:ignite-core] at org.apache.maven.plugin.surefire.InPluginVMSurefireStarter.runSuitesInProcess(InPluginVMSurefireStarter.java:87) [21:10:34]W: [org.apache.ignite:ignite-core] at org.apache.maven.plugin.surefire.AbstractSurefireMojo.executeProvider(AbstractSurefireMojo.java:1198) [21:10:34]W: [org.apache.ignite:ignite-core] at org.apache.maven.plugin.surefire.AbstractSurefireMojo.executeAfterPreconditionsChecked(AbstractSurefireMojo.java:1063) [21:10:34]W: [org.apache.ignite:ignite-core] at org.apache.maven.plugin.surefire.AbstractSurefireMojo.execute(AbstractSurefireMojo.java:889) [21:10:34]W: [org.apache.ignite:ignite-core] at org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo(DefaultBuildPluginManager.java:137) [21:10:34]W: [org.apache.ignite:ignite-core] at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:210) [21:10:34]W: [org.apache.ignite:ignite-core] at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:156) [21:10:34]W: [org.apache.ignite:ignite-core] at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:148) [21:10:34]W: [org.apache.ignite:ignite-core] at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:117) [21:10:34]W: [org.apache.ignite:ignite-core] at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:81) [21:10:34]W: [org.apache.ignite:ignite-core] at org.apache.maven.lifecycle.internal.builder.singlethreaded.SingleThreadedBuilder.build(SingleThreadedBuilder.java:56) [21:10:34]W: [org.apache.ignite:ignite-core] at org.apache.maven.lifecycle.internal.LifecycleStarter.execute(LifecycleStarter.java:128) [21:10:34]W: [org.apache.ignite:ignite-core] at org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:305) [21:10:34]W: [org.apache.ignite:ignite-core] at org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:192) [21:10:34]W: [org.apache.ignite:ignite-core] at org.apache.maven.DefaultMaven.execute(DefaultMaven.java:105) [21:10:34]W: [org.apache.ignite:ignite-core] at org.apache.maven.cli.MavenCli.execute(MavenCli.java:957) [21:10:34]W: [org.apache.ignite:ignite-core] at org.apache.maven.cli.MavenCli.doMain(MavenCli.java:289) [21:10:34]W: [org.apache.ignite:ignite-core] at org.apache.maven.cli.MavenCli.main(MavenCli.java:193) [21:10:34]W: [org.apache.ignite:ignite-core] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) [21:10:34]W: [org.apache.ignite:ignite-core] at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) [21:10:34]W: [org.apache.ignite:ignite-core] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [21:10:34]W: [org.apache.ignite:ignite-core] at java.lang.reflect.Method.invoke(Method.java:498) [21:10:34]W: [org.apache.ignite:ignite-core] at org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced(Launcher.java:282) [21:10:34]W: [org.apache.ignite:ignite-core] at org.codehaus.plexus.classworlds.launcher.Launcher.launch(Launcher.java:225) [21:10:34]W: [org.apache.ignite:ignite-core] at org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode(Launcher.java:406) [21:10:34]W: [org.apache.ignite:ignite-core] at org.codehaus.plexus.classworlds.launcher.Launcher.main(Launcher.java:347) [21:10:34] : [Step 4/5] [2021-11-19 21:10:34,239][INFO ][exchange-worker-#20345%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:10:34] : [Step 4/5] [2021-11-19 21:10:34,253][INFO ][exchange-worker-#20345%grid-0%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], err=null, rebalanced=true, wasRebalanced=true] [21:10:34] : [Step 4/5] [2021-11-19 21:10:34,254][INFO ][exchange-worker-#20345%grid-0%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=00ccd666-fbef-4b00-9ba6-82602e1ab000, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], evt=NODE_LEFT, evtNode=TcpDiscoveryNode [id=10d30f78-bc70-4a42-b3c3-b78ea89cf001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637345432600, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0]] [21:10:34] : [Step 4/5] [2021-11-19 21:10:34,256][INFO ][exchange-worker-#20345%grid-0%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (1 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="After states restored callback" (13 ms), stage="WAL history reservation" (0 ms), stage="Finalize update counters" (0 ms), stage="Detect lost partitions" (1 ms), stage="Exchange done" (1 ms), stage="Total time" (16 ms)] [21:10:34] : [Step 4/5] [2021-11-19 21:10:34,257][INFO ][exchange-worker-#20345%grid-0%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], stage="Affinity initialization (exchange-free switch on fully-rebalanced topology) [grp=ignite-sys-cache]" (0 ms) (parent=Determine exchange type)] [21:10:34] : [Step 4/5] [2021-11-19 21:10:34,258][INFO ][exchange-worker-#20345%grid-0%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], crd=true] [21:10:34] : [Step 4/5] [2021-11-19 21:10:34,259][INFO ][exchange-worker-#20345%grid-0%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=3, minorTopVer=0], force=false, evt=NODE_LEFT, node=10d30f78-bc70-4a42-b3c3-b78ea89cf001] [21:10:36] : [Step 4/5] [2021-11-19 21:10:36,874][INFO ][db-checkpoint-thread-#20480%grid-0%][Checkpointer] Checkpoint finished [cpId=54509a9e-563a-40bc-9702-49f740dc536f, pages=16, markPos=WALPointer [idx=0, fileOff=66667, len=1963], walSegmentsCovered=[], markDuration=824ms, pagesWrite=6ms, fsync=2864ms, total=3923ms] [21:10:36] : [Step 4/5] [2021-11-19 21:10:36,875][INFO ][main][FilePageStoreManager] Cleanup cache stores [total=3, left=0, cleanFiles=false] [21:10:36] : [Step 4/5] [2021-11-19 21:10:36,878][INFO ][main][GridDeploymentLocalStore] Removed undeployed class: GridDeployment [ts=1637345433185, depMode=SHARED, clsLdr=IsolatedClassLoader{roleName='test'}, clsLdrId=26d7d593d71-10d30f78-bc70-4a42-b3c3-b78ea89cf001, userVer=0, loc=true, sampleClsName=org.apache.ignite.internal.processors.cache.distributed.dht.preloader.IgniteDhtPartitionCountersMap2, pendingUndeploy=false, undeployed=true, usage=0] [21:10:36] : [Step 4/5] [2021-11-19 21:10:36,890][INFO ][main][IgniteKernal%grid-1] [21:10:36] : [Step 4/5] [21:10:36] : [Step 4/5] >>> +------------------------------------------------------+ [21:10:36] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV stopped OK [21:10:36] : [Step 4/5] >>> +------------------------------------------------------+ [21:10:36] : [Step 4/5] >>> Ignite instance name: grid-1 [21:10:36] : [Step 4/5] >>> Grid uptime: 00:00:04.209 [21:10:36] : [Step 4/5] [21:10:36] : [Step 4/5] [21:10:36] : [Step 4/5] [2021-11-19 21:10:36,891][INFO ][main][root] >>> Stopping grid [name=grid-0, id=00ccd666-fbef-4b00-9ba6-82602e1ab000] [21:10:37] : [Step 4/5] [2021-11-19 21:10:37,914][INFO ][db-checkpoint-thread-#20480%grid-0%][Checkpointer] Checkpoint started [checkpointId=7cb9f32b-1fbc-46d9-b899-a86da38865ab, startPtr=WALPointer [idx=0, fileOff=97102, len=1947], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=26ms, writeCheckpointEntryDuration=760ms, splitAndSortCpPagesDuration=0ms, pages=7, reason='timeout'] [21:10:37]W: [org.apache.ignite:ignite-core] [2021-11-19 21:10:37,920][WARN ][tcp-disco-sock-reader-[10d30f78 127.0.0.1:50133]-#1074%grid-0%-#20464%grid-0%][TestTcpDiscoverySpi] Failed to shutdown socket [21:10:37]W: [org.apache.ignite:ignite-core] java.net.SocketException: Socket is closed [21:10:37]W: [org.apache.ignite:ignite-core] at java.net.Socket.shutdownOutput(Socket.java:1568) [21:10:37]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.close(IgniteUtils.java:4247) [21:10:37]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.discovery.tcp.ServerImpl$SocketReader.body(ServerImpl.java:7370) [21:10:37]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.IgniteSpiThread.run(IgniteSpiThread.java:58) [21:10:37] : [Step 4/5] [2021-11-19 21:10:37,922][INFO ][tcp-disco-sock-reader-[10d30f78 127.0.0.1:50133]-#1074%grid-0%-#20464%grid-0%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:50133, rmtPort=50133, rmtNodeId=10d30f78-bc70-4a42-b3c3-b78ea89cf001] [21:10:37] : [Step 4/5] [2021-11-19 21:10:37,923][INFO ][main][GridCacheProcessor] Stopped cache [cacheName=ignite-sys-cache] [21:10:39] : [Step 4/5] [2021-11-19 21:10:39,090][INFO ][main][FilePageStoreManager] Cleanup cache stores [total=3, left=0, cleanFiles=false] [21:10:39] : [Step 4/5] [2021-11-19 21:10:39,092][INFO ][main][GridDeploymentLocalStore] Removed undeployed class: GridDeployment [ts=1637345433185, depMode=SHARED, clsLdr=IsolatedClassLoader{roleName='test'}, clsLdrId=06d7d593d71-00ccd666-fbef-4b00-9ba6-82602e1ab000, userVer=0, loc=true, sampleClsName=org.apache.ignite.internal.processors.cache.distributed.dht.preloader.GridDhtPartitionMap, pendingUndeploy=false, undeployed=true, usage=0] [21:10:39] : [Step 4/5] [2021-11-19 21:10:39,100][INFO ][main][IgniteKernal%grid-0] [21:10:39] : [Step 4/5] [21:10:39] : [Step 4/5] >>> +------------------------------------------------------+ [21:10:39] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV stopped OK [21:10:39] : [Step 4/5] >>> +------------------------------------------------------+ [21:10:39] : [Step 4/5] >>> Ignite instance name: grid-0 [21:10:39] : [Step 4/5] >>> Grid uptime: 00:00:09.832 [21:10:39] : [Step 4/5] [21:10:39] : [Step 4/5] [21:10:39] : [Step 4/5] [21:10:39] >>> Stopping test class: MasterKeyChangeConsistencyCheckTest <<< [21:10:39] : [Step 4/5] [2021-11-19 21:10:39,217][INFO ][main][root] >>> Stopping test class: MasterKeyChangeConsistencyCheckTest <<< [21:10:39] : [Step 4/5] [21:10:39] >>> Starting test class: CacheGroupKeyChangeTest <<< [21:10:39] : [Step 4/5] [2021-11-19 21:10:39,217][INFO ][main][root] >>> Starting test class: CacheGroupKeyChangeTest <<< [21:10:39] : [Step 4/5] Running org.apache.ignite.internal.encryption.CacheGroupKeyChangeTest [21:10:39]i: [Step 4/5] ##teamcity[importData type='surefire' path='/opt/buildagent/temp/buildTmp/ignite-tools-junit-reports1777670380320881607/test-org.apache.ignite.testsuites.IgniteBasicWithPersistenceTestSuite1637345419580.xml'] [21:10:39] : [Step 4/5] Importing data from '/opt/buildagent/temp/buildTmp/ignite-tools-junit-reports1777670380320881607/test-org.apache.ignite.testsuites.IgniteBasicWithPersistenceTestSuite1637345419580.xml' (476 B) with 'surefire' processor [21:10:39] : [Step 4/5] [21:10:39] >>> Starting test: CacheGroupKeyChangeTest#testNotAllBltNodesPresent <<< [21:10:39] : [Step 4/5] [2021-11-19 21:10:39,227][INFO ][main][root] >>> Starting test: CacheGroupKeyChangeTest#testNotAllBltNodesPresent <<< [21:10:39] : [Step 4/5] [21:10:39] >>> Heap: 566 MB used / 1931 MB commited / 1931 MB max <<< [21:10:39] : [Step 4/5] [2021-11-19 21:10:39,227][INFO ][main][root] >>> Heap: 566 MB used / 1931 MB commited / 1931 MB max <<< [21:10:39] : [Step 4/5] [21:10:39] >>> Non-Heap: 156 MB used / 183 MB commited / 0 MB max <<< [21:10:39] : [Step 4/5] [2021-11-19 21:10:39,228][INFO ][main][root] >>> Non-Heap: 156 MB used / 183 MB commited / 0 MB max <<< [21:10:39]W: [org.apache.ignite:ignite-core] [2021-11-19 21:10:39,242][WARN ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][G] Ignite work directory is not provided, automatically resolved to: /opt/buildagent/work/7bc1c54bc719b67c/work [21:10:39] : [Step 4/5] [2021-11-19 21:10:39,245][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] [21:10:39] : [Step 4/5] [21:10:39] : [Step 4/5] >>> __________ ________________ [21:10:39] : [Step 4/5] >>> / _/ ___/ |/ / _/_ __/ __/ [21:10:39] : [Step 4/5] >>> _/ // (7 7 // / / / / _/ [21:10:39] : [Step 4/5] >>> /___/\___/_/|_/___/ /_/ /___/ [21:10:39] : [Step 4/5] >>> [21:10:39] : [Step 4/5] >>> ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:10:39] : [Step 4/5] >>> 2021 Copyright(C) Apache Software Foundation [21:10:39] : [Step 4/5] >>> [21:10:39] : [Step 4/5] >>> Ignite documentation: http://ignite.apache.org [21:10:39] : [Step 4/5] [21:10:39] : [Step 4/5] [2021-11-19 21:10:39,246][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] Config URL: n/a [21:10:39] : [Step 4/5] [2021-11-19 21:10:39,246][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] IgniteConfiguration [igniteInstanceName=grid-0, pubPoolSize=24, svcPoolSize=24, callbackPoolSize=24, stripedPoolSize=24, sysPoolSize=24, mgmtPoolSize=4, dataStreamerPoolSize=24, utilityCachePoolSize=24, utilityCacheKeepAliveTime=60000, p2pPoolSize=2, qryPoolSize=24, buildIdxPoolSize=4, igniteHome=/opt/buildagent/work/7bc1c54bc719b67c, igniteWorkDir=/opt/buildagent/work/7bc1c54bc719b67c/work, mbeanSrv=com.sun.jmx.mbeanserver.JmxMBeanServer@6fe85038, nodeId=003cf075-28f9-4b6c-920d-99b2dcc37000, marsh=BinaryMarshaller [], marshLocJobs=false, daemon=false, p2pEnabled=true, netTimeout=10000, netCompressionLevel=1, sndRetryDelay=1000, sndRetryCnt=3, metricsHistSize=10000, metricsUpdateFreq=1000, metricsExpTime=9223372036854775807, discoSpi=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=0, ackTimeout=0, marsh=null, reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], segPlc=STOP, segResolveAttempts=2, waitForSegOnStart=true, allResolversPassReq=true, segChkFreq=10000, commSpi=TcpCommunicationSpi [connectGate=org.apache.ignite.spi.communication.tcp.internal.ConnectGateway@6f035c1d, ctxInitLatch=java.util.concurrent.CountDownLatch@5aeedd9a[Count = 1], stopping=false, clientPool=null, nioSrvWrapper=null, stateProvider=null], evtSpi=MemoryEventStorageSpi [expireAgeMs=9223372036854775807, expireCnt=10000, filter=null], colSpi=NoopCollisionSpi [], deploySpi=LocalDeploymentSpi [], indexingSpi=org.apache.ignite.spi.indexing.noop.NoopIndexingSpi@574493b6, addrRslvr=null, encryptionSpi=org.apache.ignite.spi.encryption.keystore.KeystoreEncryptionSpi@26611e94, tracingSpi=org.apache.ignite.spi.tracing.NoopTracingSpi@4edc4af7, clientMode=false, rebalanceThreadPoolSize=4, rebalanceTimeout=10000, rebalanceBatchesPrefetchCnt=3, rebalanceThrottle=0, rebalanceBatchSize=524288, txCfg=TransactionConfiguration [txSerEnabled=false, dfltIsolation=REPEATABLE_READ, dfltConcurrency=PESSIMISTIC, dfltTxTimeout=0, txTimeoutOnPartitionMapExchange=0, deadlockTimeout=10000, pessimisticTxLogSize=0, pessimisticTxLogLinger=10000, tmLookupClsName=null, txManagerFactory=null, useJtaSync=false], cacheSanityCheckEnabled=true, discoStartupDelay=60000, deployMode=SHARED, p2pMissedCacheSize=100, locHost=127.0.0.1, timeSrvPortBase=31100, timeSrvPortRange=100, failureDetectionTimeout=10000, sysWorkerBlockedTimeout=null, clientFailureDetectionTimeout=10000, metricsLogFreq=0, connectorCfg=null, odbcCfg=null, warmupClos=null, atomicCfg=AtomicConfiguration [seqReserveSize=1000, cacheMode=PARTITIONED, backups=1, aff=null, grpName=null], classLdr=null, sslCtxFactory=null, platformCfg=null, binaryCfg=null, memCfg=null, pstCfg=null, dsCfg=DataStorageConfiguration [sysRegionInitSize=41943040, sysRegionMaxSize=104857600, pageSize=4096, concLvl=0, dfltDataRegConf=DataRegionConfiguration [name=default, maxSize=104857600, initSize=268435456, swapPath=null, pageEvictionMode=DISABLED, pageReplacementMode=CLOCK, evictionThreshold=0.9, emptyPagesPoolSize=100, metricsEnabled=false, metricsSubIntervalCount=5, metricsRateTimeInterval=60000, persistenceEnabled=true, checkpointPageBufSize=0, lazyMemoryAllocation=true, warmUpCfg=null], dataRegions=null, storagePath=null, checkpointFreq=30000, lockWaitTime=10000, checkpointThreads=4, checkpointWriteOrder=SEQUENTIAL, walHistSize=20, maxWalArchiveSize=20971520, walSegments=10, walSegmentSize=1048576, walPath=db/wal, walArchivePath=db/wal/archive, cdcWalPath=db/wal/cdc, cdcEnabled=false, metricsEnabled=false, walMode=LOG_ONLY, walTlbSize=131072, walBuffSize=0, walFlushFreq=2000, walFsyncDelay=1000, walRecordIterBuffSize=67108864, alwaysWriteFullPages=false, fileIOFactory=org.apache.ignite.internal.processors.cache.persistence.file.AsyncFileIOFactory@1c4e06d5, metricsSubIntervalCnt=5, metricsRateTimeInterval=60000, walAutoArchiveAfterInactivity=-1, walForceArchiveTimeout=-1, writeThrottlingEnabled=false, walCompactionEnabled=false, walCompactionLevel=1, checkpointReadLockTimeout=null, walPageCompression=DISABLED, walPageCompressionLevel=null, dfltWarmUpCfg=null, encCfg=org.apache.ignite.configuration.EncryptionConfiguration@234a2f93, defragmentationThreadPoolSize=4, minWalArchiveSize=-1], snapshotPath=snapshots, activeOnStart=true, activeOnStartPropSetFlag=false, autoActivation=true, autoActivationPropSetFlag=false, clusterStateOnStart=null, sqlConnCfg=null, cliConnCfg=ClientConnectorConfiguration [host=null, port=10800, portRange=100, sockSndBufSize=0, sockRcvBufSize=0, tcpNoDelay=true, maxOpenCursorsPerConn=128, threadPoolSize=24, selectorCnt=12, idleTimeout=0, handshakeTimeout=10000, jdbcEnabled=true, odbcEnabled=true, thinCliEnabled=true, sslEnabled=false, useIgniteSslCtxFactory=true, sslClientAuth=false, sslCtxFactory=null, thinCliCfg=ThinClientConfiguration [maxActiveTxPerConn=100, maxActiveComputeTasksPerConn=0]], mvccVacuumThreadCnt=2, mvccVacuumFreq=5000, authEnabled=false, failureHnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]], commFailureRslvr=null, sqlCfg=SqlConfiguration [longQryWarnTimeout=3000, dfltQryTimeout=0, sqlQryHistSize=1000, validationEnabled=false], asyncContinuationExecutor=null] [21:10:39] : [Step 4/5] [2021-11-19 21:10:39,257][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] Daemon mode: off [21:10:39] : [Step 4/5] [2021-11-19 21:10:39,257][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] OS: Linux 4.15.0-151-generic amd64 [21:10:39] : [Step 4/5] [2021-11-19 21:10:39,257][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] OS user: teamcity [21:10:39] : [Step 4/5] [2021-11-19 21:10:39,258][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] PID: 16724 [21:10:39] : [Step 4/5] [2021-11-19 21:10:39,258][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] Language runtime: Java Platform API Specification ver. 1.8 [21:10:39] : [Step 4/5] [2021-11-19 21:10:39,259][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] VM information: Java(TM) SE Runtime Environment 1.8.0_261-b12 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 25.261-b12 [21:10:39] : [Step 4/5] [2021-11-19 21:10:39,259][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] VM total memory: 1.9GB [21:10:39] : [Step 4/5] [2021-11-19 21:10:39,259][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] Remote Management [restart: off, REST: off, JMX (remote: off)] [21:10:39] : [Step 4/5] [2021-11-19 21:10:39,260][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] Logger: GridTestLog4jLogger [quiet=false, config=null] [21:10:39] : [Step 4/5] [2021-11-19 21:10:39,260][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] IGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c [21:10:39] : [Step 4/5] [2021-11-19 21:10:39,261][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] VM arguments: [-DIGNITE_DUMP_THREADS_ON_FAILURE=false, -DMono=/usr/bin/mono-sgen, -DMono4.0_x64=/usr/lib/mono/4.0, -DMono4.5_x64=/usr/lib/mono/4.5, -DMonoVersion=6.12.0.90, -DSKIP_BUILD=false, -Dagent.home.dir=/opt/buildagent, -Dagent.name=aitc-lin02_03, -Dagent.ownPort=9090, -Dagent.work.dir=/opt/buildagent/work, -Dbuild.number=95, -Dbuild.vcs.number=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.1=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.GitHubApacheIgnite=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dclassworlds.conf=/opt/buildagent/temp/buildTmp/teamcity.m2.conf, -Dcom.jetbrains.maven.watcher.report.file=/opt/buildagent/temp/buildTmp/maven-build-info.xml, -Djava.io.tmpdir=/opt/buildagent/temp/buildTmp, -Dmaven.home=/opt/buildagent/tools/maven3_6, -Dmaven.multiModuleProjectDirectory=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.agent.cpuBenchmark=457, -Dteamcity.agent.dotnet.agent_url=http://localhost:9090/RPC2, -Dteamcity.agent.dotnet.build_id=6278078, -Dteamcity.auth.password=*******, -Dteamcity.auth.userId=TeamCityBuildId=6278078, -Dteamcity.build.changedFiles.file=/opt/buildagent/temp/buildTmp/changedFiles6342607772318147725.txt, -Dteamcity.build.checkoutDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.build.id=6278078, -Dteamcity.build.properties.file=/opt/buildagent/temp/buildTmp/teamcity.build5164517880467851002.properties, -Dteamcity.build.tempDir=/opt/buildagent/temp/buildTmp, -Dteamcity.build.workingDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.buildConfName=Basic 3, -Dteamcity.buildType.id=IgniteTests24Java8_Basic3, -Dteamcity.configuration.properties.file=/opt/buildagent/temp/buildTmp/teamcity.config5591980786735343870.properties, -Dteamcity.maven.userSettings.path=/opt/buildagent/temp/buildTmp/maven_settings_585072866407032347.xml, -Dteamcity.maven.watcher.home=/opt/buildagent/plugins/mavenPlugin/maven-watcher-jdk16, -Dteamcity.projectName=Ignite Tests 2.x (JDK 8/11), -Dteamcity.runner.properties.file=/opt/buildagent/temp/buildTmp/teamcity.runner9098465561618137420.properties, -Dteamcity.tests.recentlyFailedTests.file=/opt/buildagent/temp/buildTmp/testsToRunFirst3891775683130404069.txt, -Dteamcity.version=2021.2 (build 99542), -ea, -Xms2g, -Xmx2g, -XX:+HeapDumpOnOutOfMemoryError, -DIGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_TEST_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_UPDATE_NOTIFIER=false, -DIGNITE_NO_DISCO_ORDER=true, -DIGNITE_PERFORMANCE_SUGGESTIONS_DISABLED=true, -Djava.net.preferIPv4Stack=true, -DTEST_SCALE_FACTOR=1.0, -DIGNITE_TEST_PROP_LOG4J_FILE=log4j-tc-test.xml, -DIGNITE_QUIET=false, -DIGNITE_MARSHAL_BUFFERS_RECHECK=1000, -Dmaven.repo.local=/opt/buildagent/.m2/repository] [21:10:39] : [Step 4/5] [2021-11-19 21:10:39,265][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] System cache's DataRegion size is configured to 40 MB. Use DataStorageConfiguration.systemRegionInitialSize property to change the setting. [21:10:39] : [Step 4/5] [2021-11-19 21:10:39,265][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] Configured caches [in 'sysMemPlc' dataRegion: ['ignite-sys-cache']] [21:10:39]W: [org.apache.ignite:ignite-core] [2021-11-19 21:10:39,265][WARN ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] Peer class loading is enabled (disable it in production for performance and deployment consistency reasons) [21:10:39] : [Step 4/5] [2021-11-19 21:10:39,265][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] 3-rd party licenses can be found at: /opt/buildagent/work/7bc1c54bc719b67c/libs/licenses [21:10:39] : [Step 4/5] [2021-11-19 21:10:39,269][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] Configured plugins: [21:10:39] : [Step 4/5] [2021-11-19 21:10:39,269][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- StanByClusterTestProvider 1.0 [21:10:39] : [Step 4/5] [2021-11-19 21:10:39,270][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:10:39] : [Step 4/5] [2021-11-19 21:10:39,270][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] [21:10:39] : [Step 4/5] [2021-11-19 21:10:39,270][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- PageMemory tracker plugin 1.0 [21:10:39] : [Step 4/5] [2021-11-19 21:10:39,270][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:10:39] : [Step 4/5] [2021-11-19 21:10:39,270][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] [21:10:39] : [Step 4/5] [2021-11-19 21:10:39,270][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- TestDistibutedConfigurationPlugin 1.0 [21:10:39] : [Step 4/5] [2021-11-19 21:10:39,271][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:10:39] : [Step 4/5] [2021-11-19 21:10:39,271][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] [21:10:39] : [Step 4/5] [2021-11-19 21:10:39,271][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- NodeValidationPluginProvider 1.0 [21:10:39] : [Step 4/5] [2021-11-19 21:10:39,271][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:10:39] : [Step 4/5] [2021-11-19 21:10:39,271][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] [21:10:39] : [Step 4/5] [2021-11-19 21:10:39,272][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][FailureProcessor] Configured failure handler: [hnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]]] [21:10:39] : [Step 4/5] [2021-11-19 21:10:39,283][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][TestRecordingCommunicationSpi] Successfully bound communication NIO server to TCP port [port=47100, locHost=/127.0.0.1, selectorsCnt=12, selectorSpins=0, pairedConn=false] [21:10:39]W: [org.apache.ignite:ignite-core] [2021-11-19 21:10:39,283][WARN ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][TestRecordingCommunicationSpi] Message queue limit is set to 0 which may lead to potential OOMEs when running cache operations in FULL_ASYNC or PRIMARY_SYNC modes due to message queues growth on sender and receiver sides. [21:10:39] : [Step 4/5] [2021-11-19 21:10:39,288][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][GridCollisionManager] Collision resolution is disabled (all jobs will be activated upon arrival). [21:10:39] : [Step 4/5] [2021-11-19 21:10:39,288][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] Security status [authentication=off, sandbox=off, tls/ssl=off] [21:10:39] : [Step 4/5] [2021-11-19 21:10:39,345][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:10:39] : [Step 4/5] [2021-11-19 21:10:39,433][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][MaintenanceProcessor] Resolved store directory for node persistent data: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0 [21:10:39] : [Step 4/5] [2021-11-19 21:10:39,435][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][CacheObjectBinaryProcessorImpl] Resolved directory for serialized binary metadata: /opt/buildagent/work/7bc1c54bc719b67c/work/db/binary_meta/grid_0 [21:10:39] : [Step 4/5] [2021-11-19 21:10:39,440][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0 [21:10:39] : [Step 4/5] [2021-11-19 21:10:39,441][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][FileWriteAheadLogManager] Resolved write ahead log work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0 [21:10:39] : [Step 4/5] [2021-11-19 21:10:39,441][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][FileWriteAheadLogManager] Resolved write ahead log archive directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0 [21:10:39] : [Step 4/5] [2021-11-19 21:10:39,458][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000000.wal [21:10:39] : [Step 4/5] [2021-11-19 21:10:39,459][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][FileHandleManagerImpl] Initialized write-ahead log manager [mode=LOG_ONLY] [21:10:39]W: [org.apache.ignite:ignite-core] [2021-11-19 21:10:39,459][WARN ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] DataRegion maxSize=104.9 MB is smaller than defaultInitialSize=268.4 MB, setting initialSize to 104.9 MB [21:10:39] : [Step 4/5] [2021-11-19 21:10:39,463][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Configured data regions initialized successfully [total=5] [21:10:39] : [Step 4/5] [2021-11-19 21:10:39,467][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][IgniteSnapshotManager] Resolved snapshot work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/snapshots [21:10:39] : [Step 4/5] [2021-11-19 21:10:39,468][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][IgniteSnapshotManager] Resolved temp directory for snapshot creation: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0/snp [21:10:39] : [Step 4/5] [2021-11-19 21:10:39,471][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][ClientListenerProcessor] Client connector processor has started on TCP port 10800 [21:10:39] : [Step 4/5] [2021-11-19 21:10:39,477][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] Non-loopback local IPs: 172.17.0.4 [21:10:39] : [Step 4/5] [2021-11-19 21:10:39,478][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] Enabled local MACs: 0242AC110004 [21:10:39] : [Step 4/5] [2021-11-19 21:10:39,480][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:10:39] : [Step 4/5] [2021-11-19 21:10:39,481][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:10:39] : [Step 4/5] [2021-11-19 21:10:39,481][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:10:39] : [Step 4/5] [2021-11-19 21:10:39,482][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Applying lost metastore updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:10:39] : [Step 4/5] [2021-11-19 21:10:39,483][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=0 ms] [21:10:39] : [Step 4/5] [2021-11-19 21:10:39,483][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Restoring partition state for local groups. [21:10:39] : [Step 4/5] [2021-11-19 21:10:39,484][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=0, partitionsProcessed=0, time=0ms] [21:10:39] : [Step 4/5] [2021-11-19 21:10:39,484][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][GridEncryptionManager] Encryption keys loaded from metastore. [grps=, masterKeyName=ignite.master.key] [21:10:39] : [Step 4/5] [2021-11-19 21:10:39,488][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][ClusterProcessor] Cluster ID and tag has been read from metastorage: null [21:10:39] : [Step 4/5] [2021-11-19 21:10:39,488][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][IgniteClusterImpl] Shutdown policy was updated [oldVal=null, newVal=null] [21:10:39] : [Step 4/5] [2021-11-19 21:10:39,489][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Checkpoint frequency deviation changed [oldVal=null, newVal=null] [21:10:39] : [Step 4/5] Surefire report watcher [21:10:39] : [Surefire report watcher] Watching paths: [21:10:39] : [Surefire report watcher] /opt/buildagent/temp/buildTmp/ignite-tools-junit-reports1777670380320881607/test-org.apache.ignite.testsuites.IgniteBasicWithPersistenceTestSuite1637345419580.xml [21:10:39]i: [Step 4/5] org.apache.ignite.testsuites.IgniteBasicWithPersistenceTestSuite [21:10:39]i: [org.apache.ignite.testsuites.IgniteBasicWithPersistenceTestSuite] org.apache.ignite.internal.encryption.MasterKeyChangeConsistencyCheckTest.testRejectMasterKeyChangeWithKeyConsistencyProblems [21:10:39]i: [org.apache.ignite.testsuites.IgniteBasicWithPersistenceTestSuite] org.apache.ignite.internal.encryption.MasterKeyChangeConsistencyCheckTest.testFailureHandledOnFailPerformMasterKeyChange [21:10:39] : [Step 4/5] [2021-11-19 21:10:39,670][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][FilePageStoreManager] Cleanup cache stores [total=1, left=0, cleanFiles=false] [21:10:39] : [Step 4/5] [2021-11-19 21:10:39,673][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:10:39] : [Step 4/5] [2021-11-19 21:10:39,674][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:10:39] : [Step 4/5] [2021-11-19 21:10:39,674][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:10:39] : [Step 4/5] [2021-11-19 21:10:39,675][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Data Regions Started: 5 [21:10:39] : [Step 4/5] [2021-11-19 21:10:39,675][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] ^-- sysMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:10:39] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:10:39] : [Step 4/5] ^-- default region [type=default, persistence=true, lazyAlloc=true, [21:10:39] : [Step 4/5] ... initCfg=100MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB, allocTotal=0MB] [21:10:39] : [Step 4/5] ^-- metastoreMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:10:39] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:10:39] : [Step 4/5] ^-- TxLog region [type=internal, persistence=true, lazyAlloc=false, [21:10:39] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:10:39] : [Step 4/5] ^-- volatileDsMemPlc region [type=user, persistence=false, lazyAlloc=true, [21:10:39] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB] [21:10:39] : [Step 4/5] ^-- Ignite persistence [used=0MB] [21:10:39] : [Step 4/5] [21:10:39] : [Step 4/5] [2021-11-19 21:10:39,677][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Starting binary memory restore for: [-2100569601] [21:10:39] : [Step 4/5] [2021-11-19 21:10:39,688][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:10:39] : [Step 4/5] [2021-11-19 21:10:39,688][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:10:39] : [Step 4/5] [2021-11-19 21:10:39,690][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000000.wal, offset=0, ver=2] [21:10:39] : [Step 4/5] [2021-11-19 21:10:39,693][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Started cache in recovery mode [name=ignite-sys-cache, id=-2100569601, dataRegionName=sysMemPlc, mode=REPLICATED, atomicity=TRANSACTIONAL, backups=2147483647, mvcc=false] [21:10:39] : [Step 4/5] [2021-11-19 21:10:39,694][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Binary recovery performed in 17 ms. [21:10:39] : [Step 4/5] [2021-11-19 21:10:39,695][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:10:39] : [Step 4/5] [2021-11-19 21:10:39,695][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Applying lost cache updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:10:39] : [Step 4/5] [2021-11-19 21:10:39,696][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=0 ms] [21:10:39] : [Step 4/5] [2021-11-19 21:10:39,697][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Restoring partition state for local groups. [21:10:39] : [Step 4/5] [2021-11-19 21:10:39,700][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=1, partitionsProcessed=100, time=0ms] [21:10:39] : [Step 4/5] [2021-11-19 21:10:39,914][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][TestTcpDiscoverySpi] Successfully bound to TCP port [port=47500, localHost=localhost/127.0.0.1, locNodeId=003cf075-28f9-4b6c-920d-99b2dcc37000] [21:10:39] : [Step 4/5] [2021-11-19 21:10:39,922][INFO ][disco-notifier-worker-#20609%grid-0%][MvccProcessorImpl] Assigned mvcc coordinator [crd=MvccCoordinator [topVer=AffinityTopologyVersion [topVer=1, minorTopVer=0], nodeId=003cf075-28f9-4b6c-920d-99b2dcc37000, ver=1637345439917, local=true, initialized=false]] [21:10:39] : [Step 4/5] [2021-11-19 21:10:39,923][INFO ][sys-#20596%grid-0%][ClusterProcessor] Writing cluster ID and tag to metastorage on ready for write ClusterIdAndTag [id=4d3cbeac-e0b5-419f-89b7-16229c34ade1, tag=focused_euler] [21:10:39] : [Step 4/5] [2021-11-19 21:10:39,925][INFO ][disco-notifier-worker-#20609%grid-0%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustEnabled' was changed from 'null' to 'false' [21:10:39] : [Step 4/5] [2021-11-19 21:10:39,926][INFO ][disco-notifier-worker-#20609%grid-0%][ClusterProcessor] focused_euler [21:10:39] : [Step 4/5] [2021-11-19 21:10:39,927][INFO ][disco-notifier-worker-#20609%grid-0%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustTimeout' was changed from 'null' to '300000' [21:10:39] : [Step 4/5] [2021-11-19 21:10:39,927][INFO ][disco-notifier-worker-#20609%grid-0%][IgniteTxManager] Transactions parameter 'longOperationsDumpTimeout' was changed from 'null' to '60000' [21:10:39] : [Step 4/5] [2021-11-19 21:10:39,928][INFO ][disco-notifier-worker-#20609%grid-0%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpThreshold' was changed from 'null' to '0' [21:10:39] : [Step 4/5] [2021-11-19 21:10:39,928][INFO ][disco-notifier-worker-#20609%grid-0%][IgniteTxManager] Transactions parameter 'transactionTimeDumpSamplesCoefficient' was changed from 'null' to '0.0' [21:10:39] : [Step 4/5] [2021-11-19 21:10:39,928][INFO ][disco-notifier-worker-#20609%grid-0%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpSamplesPerSecondLimit' was changed from 'null' to '5' [21:10:39] : [Step 4/5] [2021-11-19 21:10:39,929][INFO ][disco-notifier-worker-#20609%grid-0%][IgniteTxManager] Transactions parameter 'collisionsDumpInterval' was changed from 'null' to '1000' [21:10:39] : [Step 4/5] [2021-11-19 21:10:39,929][INFO ][disco-notifier-worker-#20609%grid-0%][IgniteTxManager] Transactions parameter 'txOwnerDumpRequestsAllowed' was changed from 'null' to 'true' [21:10:39] : [Step 4/5] [2021-11-19 21:10:39,930][INFO ][disco-notifier-worker-#20609%grid-0%][GridCacheDatabaseSharedManager] Historical rebalance WAL threshold changed [property=historical.rebalance.threshold, oldVal=null, newVal=500] [21:10:39] : [Step 4/5] [2021-11-19 21:10:39,932][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] To start Console Management & Monitoring run ignitevisorcmd.{sh|bat} [21:10:39] : [Step 4/5] [2021-11-19 21:10:39,933][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] [21:10:39] : [Step 4/5] [21:10:39] : [Step 4/5] >>> +-------------------------------------------+ [21:10:39] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:10:39] : [Step 4/5] >>> +-------------------------------------------+ [21:10:39] : [Step 4/5] >>> OS name: Linux 4.15.0-151-generic amd64 [21:10:39] : [Step 4/5] >>> CPU(s): 24 [21:10:39] : [Step 4/5] >>> Heap: 2.0GB [21:10:39] : [Step 4/5] >>> VM name: 16724@c4dfe9a430b2 [21:10:39] : [Step 4/5] >>> Ignite instance name: grid-0 [21:10:39] : [Step 4/5] >>> Local node [ID=003CF075-28F9-4B6C-920D-99B2DCC37000, order=1, clientMode=false] [21:10:39] : [Step 4/5] >>> Local node addresses: [127.0.0.1] [21:10:39] : [Step 4/5] >>> Local ports: TCP:10800 TCP:47100 TCP:47500 [21:10:39] : [Step 4/5] [21:10:39] : [Step 4/5] [2021-11-19 21:10:39,934][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] >>> Ignite cluster is in INACTIVE state (limited functionality available). Use control.(sh|bat) script or IgniteCluster.state(ClusterState.ACTIVE) to change the state. [21:10:39] : [Step 4/5] [2021-11-19 21:10:39,935][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][GridDiscoveryManager] Topology snapshot [ver=1, locNode=003cf075, servers=1, clients=0, state=INACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=003cf075-28f9-4b6c-920d-99b2dcc37000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:10:39] : [Step 4/5] [2021-11-19 21:10:39,936][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][G] Node started : [stage="Configure system pool" (0 ms),stage="Start managers" (190 ms),stage="Configure binary metadata" (2 ms),stage="Start processors" (40 ms),stage="Start 'StanByClusterTestProvider' plugin" (0 ms),stage="Start 'PageMemory tracker plugin' plugin" (0 ms),stage="Start 'TestDistibutedConfigurationPlugin' plugin" (0 ms),stage="Start 'NodeValidationPluginProvider' plugin" (0 ms),stage="Init metastore" (193 ms),stage="Init and start regions" (6 ms),stage="Restore binary memory" (17 ms),stage="Restore logical state" (5 ms),stage="Finish recovery" (212 ms),stage="Join topology" (8 ms),stage="Await transition" (1 ms),stage="Await exchange" (12 ms),stage="Total time" (686 ms)] [21:10:39] : [Step 4/5] [2021-11-19 21:10:39,937][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][root] Node started with the following configuration [id=003cf075-28f9-4b6c-920d-99b2dcc37000, marshaller=BinaryMarshaller [], discovery=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=5000, ackTimeout=5000, marsh=JdkMarshaller [clsFilter=org.apache.ignite.marshaller.MarshallerUtils$1@1cba688a], reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], binaryCfg=null, lateAff=true] [21:10:39]W: [org.apache.ignite:ignite-core] [2021-11-19 21:10:39,943][WARN ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][G] Ignite work directory is not provided, automatically resolved to: /opt/buildagent/work/7bc1c54bc719b67c/work [21:10:39] : [Step 4/5] [2021-11-19 21:10:39,943][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] [21:10:39] : [Step 4/5] [21:10:39] : [Step 4/5] >>> __________ ________________ [21:10:39] : [Step 4/5] >>> / _/ ___/ |/ / _/_ __/ __/ [21:10:39] : [Step 4/5] >>> _/ // (7 7 // / / / / _/ [21:10:39] : [Step 4/5] >>> /___/\___/_/|_/___/ /_/ /___/ [21:10:39] : [Step 4/5] >>> [21:10:39] : [Step 4/5] >>> ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:10:39] : [Step 4/5] >>> 2021 Copyright(C) Apache Software Foundation [21:10:39] : [Step 4/5] >>> [21:10:39] : [Step 4/5] >>> Ignite documentation: http://ignite.apache.org [21:10:39] : [Step 4/5] [21:10:39] : [Step 4/5] [2021-11-19 21:10:39,944][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] Config URL: n/a [21:10:39] : [Step 4/5] [2021-11-19 21:10:39,944][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] IgniteConfiguration [igniteInstanceName=grid-1, pubPoolSize=24, svcPoolSize=24, callbackPoolSize=24, stripedPoolSize=24, sysPoolSize=24, mgmtPoolSize=4, dataStreamerPoolSize=24, utilityCachePoolSize=24, utilityCacheKeepAliveTime=60000, p2pPoolSize=2, qryPoolSize=24, buildIdxPoolSize=4, igniteHome=/opt/buildagent/work/7bc1c54bc719b67c, igniteWorkDir=/opt/buildagent/work/7bc1c54bc719b67c/work, mbeanSrv=com.sun.jmx.mbeanserver.JmxMBeanServer@6fe85038, nodeId=106eda8f-692b-446e-9c0b-11bdc123c001, marsh=BinaryMarshaller [], marshLocJobs=false, daemon=false, p2pEnabled=true, netTimeout=10000, netCompressionLevel=1, sndRetryDelay=1000, sndRetryCnt=3, metricsHistSize=10000, metricsUpdateFreq=1000, metricsExpTime=9223372036854775807, discoSpi=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=0, ackTimeout=0, marsh=null, reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], segPlc=STOP, segResolveAttempts=2, waitForSegOnStart=true, allResolversPassReq=true, segChkFreq=10000, commSpi=TcpCommunicationSpi [connectGate=org.apache.ignite.spi.communication.tcp.internal.ConnectGateway@196a92f5, ctxInitLatch=java.util.concurrent.CountDownLatch@12d12558[Count = 1], stopping=false, clientPool=null, nioSrvWrapper=null, stateProvider=null], evtSpi=MemoryEventStorageSpi [expireAgeMs=9223372036854775807, expireCnt=10000, filter=null], colSpi=NoopCollisionSpi [], deploySpi=LocalDeploymentSpi [], indexingSpi=org.apache.ignite.spi.indexing.noop.NoopIndexingSpi@12ec6a38, addrRslvr=null, encryptionSpi=org.apache.ignite.spi.encryption.keystore.KeystoreEncryptionSpi@20a4dae0, tracingSpi=org.apache.ignite.spi.tracing.NoopTracingSpi@1eeefd2, clientMode=false, rebalanceThreadPoolSize=4, rebalanceTimeout=10000, rebalanceBatchesPrefetchCnt=3, rebalanceThrottle=0, rebalanceBatchSize=524288, txCfg=TransactionConfiguration [txSerEnabled=false, dfltIsolation=REPEATABLE_READ, dfltConcurrency=PESSIMISTIC, dfltTxTimeout=0, txTimeoutOnPartitionMapExchange=0, deadlockTimeout=10000, pessimisticTxLogSize=0, pessimisticTxLogLinger=10000, tmLookupClsName=null, txManagerFactory=null, useJtaSync=false], cacheSanityCheckEnabled=true, discoStartupDelay=60000, deployMode=SHARED, p2pMissedCacheSize=100, locHost=127.0.0.1, timeSrvPortBase=31100, timeSrvPortRange=100, failureDetectionTimeout=10000, sysWorkerBlockedTimeout=null, clientFailureDetectionTimeout=10000, metricsLogFreq=0, connectorCfg=null, odbcCfg=null, warmupClos=null, atomicCfg=AtomicConfiguration [seqReserveSize=1000, cacheMode=PARTITIONED, backups=1, aff=null, grpName=null], classLdr=null, sslCtxFactory=null, platformCfg=null, binaryCfg=null, memCfg=null, pstCfg=null, dsCfg=DataStorageConfiguration [sysRegionInitSize=41943040, sysRegionMaxSize=104857600, pageSize=4096, concLvl=0, dfltDataRegConf=DataRegionConfiguration [name=default, maxSize=104857600, initSize=268435456, swapPath=null, pageEvictionMode=DISABLED, pageReplacementMode=CLOCK, evictionThreshold=0.9, emptyPagesPoolSize=100, metricsEnabled=false, metricsSubIntervalCount=5, metricsRateTimeInterval=60000, persistenceEnabled=true, checkpointPageBufSize=0, lazyMemoryAllocation=true, warmUpCfg=null], dataRegions=null, storagePath=null, checkpointFreq=30000, lockWaitTime=10000, checkpointThreads=4, checkpointWriteOrder=SEQUENTIAL, walHistSize=20, maxWalArchiveSize=20971520, walSegments=10, walSegmentSize=1048576, walPath=db/wal, walArchivePath=db/wal/archive, cdcWalPath=db/wal/cdc, cdcEnabled=false, metricsEnabled=false, walMode=LOG_ONLY, walTlbSize=131072, walBuffSize=0, walFlushFreq=2000, walFsyncDelay=1000, walRecordIterBuffSize=67108864, alwaysWriteFullPages=false, fileIOFactory=org.apache.ignite.internal.processors.cache.persistence.file.AsyncFileIOFactory@6496638, metricsSubIntervalCnt=5, metricsRateTimeInterval=60000, walAutoArchiveAfterInactivity=-1, walForceArchiveTimeout=-1, writeThrottlingEnabled=false, walCompactionEnabled=false, walCompactionLevel=1, checkpointReadLockTimeout=null, walPageCompression=DISABLED, walPageCompressionLevel=null, dfltWarmUpCfg=null, encCfg=org.apache.ignite.configuration.EncryptionConfiguration@3a36ea9f, defragmentationThreadPoolSize=4, minWalArchiveSize=-1], snapshotPath=snapshots, activeOnStart=true, activeOnStartPropSetFlag=false, autoActivation=true, autoActivationPropSetFlag=false, clusterStateOnStart=null, sqlConnCfg=null, cliConnCfg=ClientConnectorConfiguration [host=null, port=10800, portRange=100, sockSndBufSize=0, sockRcvBufSize=0, tcpNoDelay=true, maxOpenCursorsPerConn=128, threadPoolSize=24, selectorCnt=12, idleTimeout=0, handshakeTimeout=10000, jdbcEnabled=true, odbcEnabled=true, thinCliEnabled=true, sslEnabled=false, useIgniteSslCtxFactory=true, sslClientAuth=false, sslCtxFactory=null, thinCliCfg=ThinClientConfiguration [maxActiveTxPerConn=100, maxActiveComputeTasksPerConn=0]], mvccVacuumThreadCnt=2, mvccVacuumFreq=5000, authEnabled=false, failureHnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]], commFailureRslvr=null, sqlCfg=SqlConfiguration [longQryWarnTimeout=3000, dfltQryTimeout=0, sqlQryHistSize=1000, validationEnabled=false], asyncContinuationExecutor=null] [21:10:39] : [Step 4/5] [2021-11-19 21:10:39,952][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] Daemon mode: off [21:10:39] : [Step 4/5] [2021-11-19 21:10:39,952][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] OS: Linux 4.15.0-151-generic amd64 [21:10:39] : [Step 4/5] [2021-11-19 21:10:39,952][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] OS user: teamcity [21:10:39] : [Step 4/5] [2021-11-19 21:10:39,953][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] PID: 16724 [21:10:39] : [Step 4/5] [2021-11-19 21:10:39,953][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] Language runtime: Java Platform API Specification ver. 1.8 [21:10:39] : [Step 4/5] [2021-11-19 21:10:39,953][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] VM information: Java(TM) SE Runtime Environment 1.8.0_261-b12 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 25.261-b12 [21:10:39] : [Step 4/5] [2021-11-19 21:10:39,953][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] VM total memory: 1.9GB [21:10:39] : [Step 4/5] [2021-11-19 21:10:39,953][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] Remote Management [restart: off, REST: off, JMX (remote: off)] [21:10:39] : [Step 4/5] [2021-11-19 21:10:39,954][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] Logger: GridTestLog4jLogger [quiet=false, config=null] [21:10:39] : [Step 4/5] [2021-11-19 21:10:39,954][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] IGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c [21:10:39] : [Step 4/5] [2021-11-19 21:10:39,954][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] VM arguments: [-DIGNITE_DUMP_THREADS_ON_FAILURE=false, -DMono=/usr/bin/mono-sgen, -DMono4.0_x64=/usr/lib/mono/4.0, -DMono4.5_x64=/usr/lib/mono/4.5, -DMonoVersion=6.12.0.90, -DSKIP_BUILD=false, -Dagent.home.dir=/opt/buildagent, -Dagent.name=aitc-lin02_03, -Dagent.ownPort=9090, -Dagent.work.dir=/opt/buildagent/work, -Dbuild.number=95, -Dbuild.vcs.number=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.1=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.GitHubApacheIgnite=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dclassworlds.conf=/opt/buildagent/temp/buildTmp/teamcity.m2.conf, -Dcom.jetbrains.maven.watcher.report.file=/opt/buildagent/temp/buildTmp/maven-build-info.xml, -Djava.io.tmpdir=/opt/buildagent/temp/buildTmp, -Dmaven.home=/opt/buildagent/tools/maven3_6, -Dmaven.multiModuleProjectDirectory=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.agent.cpuBenchmark=457, -Dteamcity.agent.dotnet.agent_url=http://localhost:9090/RPC2, -Dteamcity.agent.dotnet.build_id=6278078, -Dteamcity.auth.password=*******, -Dteamcity.auth.userId=TeamCityBuildId=6278078, -Dteamcity.build.changedFiles.file=/opt/buildagent/temp/buildTmp/changedFiles6342607772318147725.txt, -Dteamcity.build.checkoutDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.build.id=6278078, -Dteamcity.build.properties.file=/opt/buildagent/temp/buildTmp/teamcity.build5164517880467851002.properties, -Dteamcity.build.tempDir=/opt/buildagent/temp/buildTmp, -Dteamcity.build.workingDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.buildConfName=Basic 3, -Dteamcity.buildType.id=IgniteTests24Java8_Basic3, -Dteamcity.configuration.properties.file=/opt/buildagent/temp/buildTmp/teamcity.config5591980786735343870.properties, -Dteamcity.maven.userSettings.path=/opt/buildagent/temp/buildTmp/maven_settings_585072866407032347.xml, -Dteamcity.maven.watcher.home=/opt/buildagent/plugins/mavenPlugin/maven-watcher-jdk16, -Dteamcity.projectName=Ignite Tests 2.x (JDK 8/11), -Dteamcity.runner.properties.file=/opt/buildagent/temp/buildTmp/teamcity.runner9098465561618137420.properties, -Dteamcity.tests.recentlyFailedTests.file=/opt/buildagent/temp/buildTmp/testsToRunFirst3891775683130404069.txt, -Dteamcity.version=2021.2 (build 99542), -ea, -Xms2g, -Xmx2g, -XX:+HeapDumpOnOutOfMemoryError, -DIGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_TEST_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_UPDATE_NOTIFIER=false, -DIGNITE_NO_DISCO_ORDER=true, -DIGNITE_PERFORMANCE_SUGGESTIONS_DISABLED=true, -Djava.net.preferIPv4Stack=true, -DTEST_SCALE_FACTOR=1.0, -DIGNITE_TEST_PROP_LOG4J_FILE=log4j-tc-test.xml, -DIGNITE_QUIET=false, -DIGNITE_MARSHAL_BUFFERS_RECHECK=1000, -Dmaven.repo.local=/opt/buildagent/.m2/repository] [21:10:39] : [Step 4/5] [2021-11-19 21:10:39,958][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] System cache's DataRegion size is configured to 40 MB. Use DataStorageConfiguration.systemRegionInitialSize property to change the setting. [21:10:39] : [Step 4/5] [2021-11-19 21:10:39,958][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] Configured caches [in 'sysMemPlc' dataRegion: ['ignite-sys-cache']] [21:10:39]W: [org.apache.ignite:ignite-core] [2021-11-19 21:10:39,959][WARN ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] Peer class loading is enabled (disable it in production for performance and deployment consistency reasons) [21:10:39] : [Step 4/5] [2021-11-19 21:10:39,959][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] 3-rd party licenses can be found at: /opt/buildagent/work/7bc1c54bc719b67c/libs/licenses [21:10:39] : [Step 4/5] [2021-11-19 21:10:39,963][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] Configured plugins: [21:10:39] : [Step 4/5] [2021-11-19 21:10:39,963][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- StanByClusterTestProvider 1.0 [21:10:39] : [Step 4/5] [2021-11-19 21:10:39,963][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:10:39] : [Step 4/5] [2021-11-19 21:10:39,963][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] [21:10:39] : [Step 4/5] [2021-11-19 21:10:39,963][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- PageMemory tracker plugin 1.0 [21:10:39] : [Step 4/5] [2021-11-19 21:10:39,963][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:10:39] : [Step 4/5] [2021-11-19 21:10:39,964][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] [21:10:39] : [Step 4/5] [2021-11-19 21:10:39,964][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- TestDistibutedConfigurationPlugin 1.0 [21:10:39] : [Step 4/5] [2021-11-19 21:10:39,964][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:10:39] : [Step 4/5] [2021-11-19 21:10:39,964][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] [21:10:39] : [Step 4/5] [2021-11-19 21:10:39,964][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- NodeValidationPluginProvider 1.0 [21:10:39] : [Step 4/5] [2021-11-19 21:10:39,965][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:10:39] : [Step 4/5] [2021-11-19 21:10:39,965][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] [21:10:39] : [Step 4/5] [2021-11-19 21:10:39,965][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][FailureProcessor] Configured failure handler: [hnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]]] [21:10:39] : [Step 4/5] [2021-11-19 21:10:39,978][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][TestRecordingCommunicationSpi] Successfully bound communication NIO server to TCP port [port=47101, locHost=/127.0.0.1, selectorsCnt=12, selectorSpins=0, pairedConn=false] [21:10:39]W: [org.apache.ignite:ignite-core] [2021-11-19 21:10:39,979][WARN ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][TestRecordingCommunicationSpi] Message queue limit is set to 0 which may lead to potential OOMEs when running cache operations in FULL_ASYNC or PRIMARY_SYNC modes due to message queues growth on sender and receiver sides. [21:10:39] : [Step 4/5] [2021-11-19 21:10:39,982][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][GridCollisionManager] Collision resolution is disabled (all jobs will be activated upon arrival). [21:10:39] : [Step 4/5] [2021-11-19 21:10:39,983][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] Security status [authentication=off, sandbox=off, tls/ssl=off] [21:10:40] : [Step 4/5] [2021-11-19 21:10:40,040][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:10:40] : [Step 4/5] [2021-11-19 21:10:40,124][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][MaintenanceProcessor] Resolved store directory for node persistent data: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1 [21:10:40] : [Step 4/5] [2021-11-19 21:10:40,125][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][CacheObjectBinaryProcessorImpl] Resolved directory for serialized binary metadata: /opt/buildagent/work/7bc1c54bc719b67c/work/db/binary_meta/grid_1 [21:10:40] : [Step 4/5] [2021-11-19 21:10:40,129][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1 [21:10:40] : [Step 4/5] [2021-11-19 21:10:40,130][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][FileWriteAheadLogManager] Resolved write ahead log work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1 [21:10:40] : [Step 4/5] [2021-11-19 21:10:40,130][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][FileWriteAheadLogManager] Resolved write ahead log archive directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1 [21:10:40] : [Step 4/5] [2021-11-19 21:10:40,280][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000000.wal [21:10:40] : [Step 4/5] [2021-11-19 21:10:40,280][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][FileHandleManagerImpl] Initialized write-ahead log manager [mode=LOG_ONLY] [21:10:40] : [Step 4/5] [2021-11-19 21:10:40,285][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Configured data regions initialized successfully [total=5] [21:10:40] : [Step 4/5] [2021-11-19 21:10:40,448][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][IgniteSnapshotManager] Resolved snapshot work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/snapshots [21:10:40] : [Step 4/5] [2021-11-19 21:10:40,449][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][IgniteSnapshotManager] Resolved temp directory for snapshot creation: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1/snp [21:10:40] : [Step 4/5] [2021-11-19 21:10:40,454][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][ClientListenerProcessor] Client connector processor has started on TCP port 10801 [21:10:40] : [Step 4/5] [2021-11-19 21:10:40,459][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] Non-loopback local IPs: 172.17.0.4 [21:10:40] : [Step 4/5] [2021-11-19 21:10:40,460][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] Enabled local MACs: 0242AC110004 [21:10:40] : [Step 4/5] [2021-11-19 21:10:40,461][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:10:40] : [Step 4/5] [2021-11-19 21:10:40,462][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:10:40] : [Step 4/5] [2021-11-19 21:10:40,463][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:10:40] : [Step 4/5] [2021-11-19 21:10:40,465][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Applying lost metastore updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:10:40] : [Step 4/5] [2021-11-19 21:10:40,466][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=0 ms] [21:10:40] : [Step 4/5] [2021-11-19 21:10:40,466][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Restoring partition state for local groups. [21:10:40] : [Step 4/5] [2021-11-19 21:10:40,466][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=0, partitionsProcessed=0, time=0ms] [21:10:40] : [Step 4/5] [2021-11-19 21:10:40,467][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][GridEncryptionManager] Encryption keys loaded from metastore. [grps=, masterKeyName=ignite.master.key] [21:10:40] : [Step 4/5] [2021-11-19 21:10:40,468][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][ClusterProcessor] Cluster ID and tag has been read from metastorage: null [21:10:40] : [Step 4/5] [2021-11-19 21:10:40,468][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][IgniteClusterImpl] Shutdown policy was updated [oldVal=null, newVal=null] [21:10:40] : [Step 4/5] [2021-11-19 21:10:40,468][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Checkpoint frequency deviation changed [oldVal=null, newVal=null] [21:10:40] : [Step 4/5] [2021-11-19 21:10:40,875][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][FilePageStoreManager] Cleanup cache stores [total=1, left=0, cleanFiles=false] [21:10:40] : [Step 4/5] [2021-11-19 21:10:40,877][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:10:40] : [Step 4/5] [2021-11-19 21:10:40,878][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:10:40] : [Step 4/5] [2021-11-19 21:10:40,879][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:10:40] : [Step 4/5] [2021-11-19 21:10:40,879][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Data Regions Started: 5 [21:10:40] : [Step 4/5] [2021-11-19 21:10:40,880][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] ^-- sysMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:10:40] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:10:40] : [Step 4/5] ^-- default region [type=default, persistence=true, lazyAlloc=true, [21:10:40] : [Step 4/5] ... initCfg=100MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB, allocTotal=0MB] [21:10:40] : [Step 4/5] ^-- metastoreMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:10:40] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:10:40] : [Step 4/5] ^-- TxLog region [type=internal, persistence=true, lazyAlloc=false, [21:10:40] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:10:40] : [Step 4/5] ^-- volatileDsMemPlc region [type=user, persistence=false, lazyAlloc=true, [21:10:40] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB] [21:10:40] : [Step 4/5] ^-- Ignite persistence [used=0MB] [21:10:40] : [Step 4/5] [21:10:40] : [Step 4/5] [2021-11-19 21:10:40,881][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Starting binary memory restore for: [-2100569601] [21:10:40] : [Step 4/5] [2021-11-19 21:10:40,889][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:10:40] : [Step 4/5] [2021-11-19 21:10:40,889][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:10:40] : [Step 4/5] [2021-11-19 21:10:40,891][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000000.wal, offset=0, ver=2] [21:10:40] : [Step 4/5] [2021-11-19 21:10:40,893][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Started cache in recovery mode [name=ignite-sys-cache, id=-2100569601, dataRegionName=sysMemPlc, mode=REPLICATED, atomicity=TRANSACTIONAL, backups=2147483647, mvcc=false] [21:10:40] : [Step 4/5] [2021-11-19 21:10:40,894][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Binary recovery performed in 13 ms. [21:10:40] : [Step 4/5] [2021-11-19 21:10:40,894][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:10:40] : [Step 4/5] [2021-11-19 21:10:40,895][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Applying lost cache updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:10:40] : [Step 4/5] [2021-11-19 21:10:40,896][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=10 ms] [21:10:40] : [Step 4/5] [2021-11-19 21:10:40,897][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Restoring partition state for local groups. [21:10:40] : [Step 4/5] [2021-11-19 21:10:40,903][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=1, partitionsProcessed=100, time=0ms] [21:10:41] : [Step 4/5] [2021-11-19 21:10:41,071][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][TestTcpDiscoverySpi] Successfully bound to TCP port [port=47501, localHost=localhost/127.0.0.1, locNodeId=106eda8f-692b-446e-9c0b-11bdc123c001] [21:10:41] : [Step 4/5] [2021-11-19 21:10:41,075][INFO ][tcp-disco-srvr-[:47500]-#1079%grid-0%-#20611%grid-0%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=46385] [21:10:41] : [Step 4/5] [2021-11-19 21:10:41,075][INFO ][tcp-disco-srvr-[:47500]-#1079%grid-0%-#20611%grid-0%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=46385] [21:10:41] : [Step 4/5] [2021-11-19 21:10:41,075][INFO ][tcp-disco-sock-reader-[]-#1085%grid-0%-#20731%grid-0%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:46385, rmtPort=46385] [21:10:41] : [Step 4/5] [2021-11-19 21:10:41,077][INFO ][tcp-disco-sock-reader-[106eda8f 127.0.0.1:46385]-#1085%grid-0%-#20731%grid-0%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=106eda8f-692b-446e-9c0b-11bdc123c001, rmtAddr=/127.0.0.1:46385] [21:10:41] : [Step 4/5] [2021-11-19 21:10:41,083][INFO ][tcp-disco-srvr-[:47501]-#1084%grid-1%-#20730%grid-1%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=50813] [21:10:41] : [Step 4/5] [2021-11-19 21:10:41,084][INFO ][tcp-disco-srvr-[:47501]-#1084%grid-1%-#20730%grid-1%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=50813] [21:10:41] : [Step 4/5] [2021-11-19 21:10:41,084][INFO ][tcp-disco-sock-reader-[]-#1086%grid-1%-#20732%grid-1%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:50813, rmtPort=50813] [21:10:41] : [Step 4/5] [2021-11-19 21:10:41,085][INFO ][tcp-disco-sock-reader-[]-#1086%grid-1%-#20732%grid-1%][TestTcpDiscoverySpi] Received ping request from the remote node [rmtNodeId=003cf075-28f9-4b6c-920d-99b2dcc37000, rmtAddr=/127.0.0.1:50813, rmtPort=50813] [21:10:41] : [Step 4/5] [2021-11-19 21:10:41,086][INFO ][tcp-disco-sock-reader-[]-#1086%grid-1%-#20732%grid-1%][TestTcpDiscoverySpi] Finished writing ping response [rmtNodeId=003cf075-28f9-4b6c-920d-99b2dcc37000, rmtAddr=/127.0.0.1:50813, rmtPort=50813] [21:10:41] : [Step 4/5] [2021-11-19 21:10:41,087][INFO ][tcp-disco-sock-reader-[106eda8f 127.0.0.1:46385]-#1085%grid-0%-#20731%grid-0%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:46385, rmtPort=46385, rmtNodeId=106eda8f-692b-446e-9c0b-11bdc123c001] [21:10:41]W: [org.apache.ignite:ignite-core] [2021-11-19 21:10:41,087][WARN ][tcp-disco-sock-reader-[]-#1086%grid-1%-#20732%grid-1%][TestTcpDiscoverySpi] Failed to shutdown socket [21:10:41]W: [org.apache.ignite:ignite-core] java.net.SocketException: Socket output is already shutdown [21:10:41]W: [org.apache.ignite:ignite-core] at java.net.Socket.shutdownOutput(Socket.java:1572) [21:10:41]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.close(IgniteUtils.java:4247) [21:10:41]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.discovery.tcp.ServerImpl$SocketReader.body(ServerImpl.java:7370) [21:10:41]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.IgniteSpiThread.run(IgniteSpiThread.java:58) [21:10:41] : [Step 4/5] [2021-11-19 21:10:41,089][INFO ][tcp-disco-sock-reader-[]-#1086%grid-1%-#20732%grid-1%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:50813, rmtPort=50813, rmtNodeId=null] [21:10:41] : [Step 4/5] [2021-11-19 21:10:41,090][INFO ][tcp-disco-msg-worker-[crd]-#1078%grid-0%-#20610%grid-0%][GridEncryptionManager] Joining node doesn't have stored group keys [node=106eda8f-692b-446e-9c0b-11bdc123c001] [21:10:41] : [Step 4/5] [2021-11-19 21:10:41,098][INFO ][tcp-disco-msg-worker-[crd]-#1078%grid-0%-#20610%grid-0%][TestTcpDiscoverySpi] New next node [newNext=TcpDiscoveryNode [id=106eda8f-692b-446e-9c0b-11bdc123c001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=0, intOrder=2, lastExchangeTime=1637345441078, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false]] [21:10:41] : [Step 4/5] [2021-11-19 21:10:41,099][INFO ][tcp-disco-srvr-[:47501]-#1084%grid-1%-#20730%grid-1%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=45285] [21:10:41] : [Step 4/5] [2021-11-19 21:10:41,099][INFO ][tcp-disco-srvr-[:47501]-#1084%grid-1%-#20730%grid-1%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=45285] [21:10:41] : [Step 4/5] [2021-11-19 21:10:41,099][INFO ][tcp-disco-sock-reader-[]-#1087%grid-1%-#20733%grid-1%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:45285, rmtPort=45285] [21:10:41] : [Step 4/5] [2021-11-19 21:10:41,101][INFO ][tcp-disco-sock-reader-[003cf075 127.0.0.1:45285]-#1087%grid-1%-#20733%grid-1%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=003cf075-28f9-4b6c-920d-99b2dcc37000, rmtAddr=/127.0.0.1:45285] [21:10:41] : [Step 4/5] [2021-11-19 21:10:41,104][INFO ][tcp-disco-msg-worker-[]-#1083%grid-1%-#20729%grid-1%][TestTcpDiscoverySpi] New next node [newNext=TcpDiscoveryNode [id=003cf075-28f9-4b6c-920d-99b2dcc37000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345441098, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false]] [21:10:41] : [Step 4/5] [2021-11-19 21:10:41,105][INFO ][tcp-disco-srvr-[:47500]-#1079%grid-0%-#20611%grid-0%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=34609] [21:10:41] : [Step 4/5] [2021-11-19 21:10:41,106][INFO ][tcp-disco-srvr-[:47500]-#1079%grid-0%-#20611%grid-0%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=34609] [21:10:41] : [Step 4/5] [2021-11-19 21:10:41,106][INFO ][tcp-disco-sock-reader-[]-#1088%grid-0%-#20734%grid-0%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:34609, rmtPort=34609] [21:10:41] : [Step 4/5] [2021-11-19 21:10:41,108][INFO ][tcp-disco-sock-reader-[106eda8f 127.0.0.1:34609]-#1088%grid-0%-#20734%grid-0%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=106eda8f-692b-446e-9c0b-11bdc123c001, rmtAddr=/127.0.0.1:34609] [21:10:41] : [Step 4/5] [2021-11-19 21:10:41,110][INFO ][disco-event-worker-#20613%grid-0%][GridDiscoveryManager] Added new node to topology: TcpDiscoveryNode [id=106eda8f-692b-446e-9c0b-11bdc123c001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637345441078, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false] [21:10:41] : [Step 4/5] [2021-11-19 21:10:41,111][INFO ][disco-event-worker-#20613%grid-0%][GridDiscoveryManager] Topology snapshot [ver=2, locNode=003cf075, servers=2, clients=0, state=INACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=003cf075-28f9-4b6c-920d-99b2dcc37000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=106eda8f-692b-446e-9c0b-11bdc123c001, consistentId=grid-1, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:10:41] : [Step 4/5] [2021-11-19 21:10:41,113][INFO ][tcp-disco-msg-worker-[003cf075 127.0.0.1:47500]-#1083%grid-1%-#20729%grid-1%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustEnabled' was changed from 'null' to 'false' [21:10:41] : [Step 4/5] [2021-11-19 21:10:41,113][INFO ][tcp-disco-msg-worker-[003cf075 127.0.0.1:47500]-#1083%grid-1%-#20729%grid-1%][ClusterProcessor] focused_euler [21:10:41] : [Step 4/5] [2021-11-19 21:10:41,113][INFO ][tcp-disco-msg-worker-[003cf075 127.0.0.1:47500]-#1083%grid-1%-#20729%grid-1%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustTimeout' was changed from 'null' to '300000' [21:10:41] : [Step 4/5] [2021-11-19 21:10:41,114][INFO ][tcp-disco-msg-worker-[003cf075 127.0.0.1:47500]-#1083%grid-1%-#20729%grid-1%][IgniteTxManager] Transactions parameter 'longOperationsDumpTimeout' was changed from 'null' to '60000' [21:10:41] : [Step 4/5] [2021-11-19 21:10:41,114][INFO ][tcp-disco-msg-worker-[003cf075 127.0.0.1:47500]-#1083%grid-1%-#20729%grid-1%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpThreshold' was changed from 'null' to '0' [21:10:41] : [Step 4/5] [2021-11-19 21:10:41,114][INFO ][tcp-disco-msg-worker-[003cf075 127.0.0.1:47500]-#1083%grid-1%-#20729%grid-1%][IgniteTxManager] Transactions parameter 'transactionTimeDumpSamplesCoefficient' was changed from 'null' to '0.0' [21:10:41] : [Step 4/5] [2021-11-19 21:10:41,115][INFO ][tcp-disco-msg-worker-[003cf075 127.0.0.1:47500]-#1083%grid-1%-#20729%grid-1%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpSamplesPerSecondLimit' was changed from 'null' to '5' [21:10:41] : [Step 4/5] [2021-11-19 21:10:41,115][INFO ][tcp-disco-msg-worker-[003cf075 127.0.0.1:47500]-#1083%grid-1%-#20729%grid-1%][IgniteTxManager] Transactions parameter 'collisionsDumpInterval' was changed from 'null' to '1000' [21:10:41] : [Step 4/5] [2021-11-19 21:10:41,115][INFO ][tcp-disco-msg-worker-[003cf075 127.0.0.1:47500]-#1083%grid-1%-#20729%grid-1%][IgniteTxManager] Transactions parameter 'txOwnerDumpRequestsAllowed' was changed from 'null' to 'true' [21:10:41] : [Step 4/5] [2021-11-19 21:10:41,116][INFO ][tcp-disco-msg-worker-[003cf075 127.0.0.1:47500]-#1083%grid-1%-#20729%grid-1%][GridCacheDatabaseSharedManager] Historical rebalance WAL threshold changed [property=historical.rebalance.threshold, oldVal=null, newVal=500] [21:10:41] : [Step 4/5] [2021-11-19 21:10:41,116][INFO ][disco-notifier-worker-#20728%grid-1%][MvccProcessorImpl] Assigned mvcc coordinator [crd=MvccCoordinator [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=0], nodeId=003cf075-28f9-4b6c-920d-99b2dcc37000, ver=1637345439917, local=false, initialized=false]] [21:10:41] : [Step 4/5] [2021-11-19 21:10:41,118][INFO ][sys-#20720%grid-1%][ClusterProcessor] Writing cluster ID and tag to metastorage on ready for write ClusterIdAndTag [id=4d3cbeac-e0b5-419f-89b7-16229c34ade1, tag=focused_euler] [21:10:41] : [Step 4/5] [2021-11-19 21:10:41,128][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] To start Console Management & Monitoring run ignitevisorcmd.{sh|bat} [21:10:41] : [Step 4/5] [2021-11-19 21:10:41,129][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] [21:10:41] : [Step 4/5] [21:10:41] : [Step 4/5] >>> +-------------------------------------------+ [21:10:41] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:10:41] : [Step 4/5] >>> +-------------------------------------------+ [21:10:41] : [Step 4/5] >>> OS name: Linux 4.15.0-151-generic amd64 [21:10:41] : [Step 4/5] >>> CPU(s): 24 [21:10:41] : [Step 4/5] >>> Heap: 2.0GB [21:10:41] : [Step 4/5] >>> VM name: 16724@c4dfe9a430b2 [21:10:41] : [Step 4/5] >>> Ignite instance name: grid-1 [21:10:41] : [Step 4/5] >>> Local node [ID=106EDA8F-692B-446E-9C0B-11BDC123C001, order=2, clientMode=false] [21:10:41] : [Step 4/5] >>> Local node addresses: [127.0.0.1] [21:10:41] : [Step 4/5] >>> Local ports: TCP:10801 TCP:47101 TCP:47501 [21:10:41] : [Step 4/5] [21:10:41] : [Step 4/5] [2021-11-19 21:10:41,130][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] >>> Ignite cluster is in INACTIVE state (limited functionality available). Use control.(sh|bat) script or IgniteCluster.state(ClusterState.ACTIVE) to change the state. [21:10:41] : [Step 4/5] [2021-11-19 21:10:41,130][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][GridDiscoveryManager] Topology snapshot [ver=2, locNode=106eda8f, servers=2, clients=0, state=INACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=003cf075-28f9-4b6c-920d-99b2dcc37000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=106eda8f-692b-446e-9c0b-11bdc123c001, consistentId=grid-1, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:10:41] : [Step 4/5] [2021-11-19 21:10:41,131][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][G] Node started : [stage="Configure system pool" (0 ms),stage="Start managers" (182 ms),stage="Configure binary metadata" (1 ms),stage="Start processors" (331 ms),stage="Start 'StanByClusterTestProvider' plugin" (0 ms),stage="Start 'PageMemory tracker plugin' plugin" (0 ms),stage="Start 'TestDistibutedConfigurationPlugin' plugin" (0 ms),stage="Start 'NodeValidationPluginProvider' plugin" (0 ms),stage="Init metastore" (416 ms),stage="Init and start regions" (5 ms),stage="Restore binary memory" (13 ms),stage="Restore logical state" (9 ms),stage="Finish recovery" (166 ms),stage="Join topology" (46 ms),stage="Await transition" (2 ms),stage="Await exchange" (11 ms),stage="Total time" (1182 ms)] [21:10:41] : [Step 4/5] [2021-11-19 21:10:41,132][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][root] Node started with the following configuration [id=106eda8f-692b-446e-9c0b-11bdc123c001, marshaller=BinaryMarshaller [], discovery=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=5000, ackTimeout=5000, marsh=JdkMarshaller [clsFilter=org.apache.ignite.marshaller.MarshallerUtils$1@35ef5a03], reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], binaryCfg=null, lateAff=true] [21:10:41] : [Step 4/5] [2021-11-19 21:10:41,133][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][GridClusterStateProcessor] Sending activate cluster request with BaselineTopology BaselineTopology [id=0, branchingHash=-2475315501, branchingType='New BaselineTopology', baselineNodes=[grid-1, grid-0]] [21:10:41] : [Step 4/5] [2021-11-19 21:10:41,137][INFO ][disco-notifier-worker-#20609%grid-0%][GridClusterStateProcessor] Received activate cluster request with BaselineTopology[id=0] initiator node ID: 003cf075-28f9-4b6c-920d-99b2dcc37000 [21:10:41] : [Step 4/5] [2021-11-19 21:10:41,138][INFO ][disco-notifier-worker-#20609%grid-0%][GridClusterStateProcessor] Started state transition: activate cluster [21:10:41] : [Step 4/5] [2021-11-19 21:10:41,138][INFO ][exchange-worker-#20614%grid-0%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], crd=true, evt=DISCOVERY_CUSTOM_EVT, evtNode=003cf075-28f9-4b6c-920d-99b2dcc37000, customEvt=ChangeGlobalStateMessage [id=67e7d593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqId=919dac50-87d6-4dee-a8b7-3d9f503f4c94, initiatingNodeId=003cf075-28f9-4b6c-920d-99b2dcc37000, state=ACTIVE, baselineTopology=BaselineTopology [id=0, branchingHash=-2475315501, branchingType='New BaselineTopology', baselineNodes=[grid-1, grid-0]], forceChangeBaselineTopology=false, timestamp=1637345441133, forceDeactivation=true], allowMerge=false, exchangeFreeSwitch=false] [21:10:41] : [Step 4/5] [2021-11-19 21:10:41,139][INFO ][disco-notifier-worker-#20728%grid-1%][GridClusterStateProcessor] Received activate cluster request with BaselineTopology[id=0] initiator node ID: 003cf075-28f9-4b6c-920d-99b2dcc37000 [21:10:41] : [Step 4/5] [2021-11-19 21:10:41,139][INFO ][exchange-worker-#20614%grid-0%][GridDhtPartitionsExchangeFuture] Start activation process [nodeId=003cf075-28f9-4b6c-920d-99b2dcc37000, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]]. New state: ACTIVE [21:10:41] : [Step 4/5] [2021-11-19 21:10:41,140][INFO ][disco-notifier-worker-#20728%grid-1%][GridClusterStateProcessor] Started state transition: activate cluster [21:10:41] : [Step 4/5] [2021-11-19 21:10:41,140][INFO ][exchange-worker-#20614%grid-0%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0 [21:10:41] : [Step 4/5] [2021-11-19 21:10:41,141][INFO ][exchange-worker-#20737%grid-1%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], crd=false, evt=DISCOVERY_CUSTOM_EVT, evtNode=003cf075-28f9-4b6c-920d-99b2dcc37000, customEvt=ChangeGlobalStateMessage [id=67e7d593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqId=919dac50-87d6-4dee-a8b7-3d9f503f4c94, initiatingNodeId=003cf075-28f9-4b6c-920d-99b2dcc37000, state=ACTIVE, baselineTopology=BaselineTopology [id=0, branchingHash=-2475315501, branchingType='New BaselineTopology', baselineNodes=[grid-1, grid-0]], forceChangeBaselineTopology=false, timestamp=1637345441133, forceDeactivation=true], allowMerge=false, exchangeFreeSwitch=false] [21:10:41] : [Step 4/5] [2021-11-19 21:10:41,143][INFO ][exchange-worker-#20614%grid-0%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000000.wal, offset=8795, ver=2] [21:10:41] : [Step 4/5] [2021-11-19 21:10:41,143][INFO ][exchange-worker-#20737%grid-1%][GridDhtPartitionsExchangeFuture] Start activation process [nodeId=106eda8f-692b-446e-9c0b-11bdc123c001, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]]. New state: ACTIVE [21:10:41] : [Step 4/5] [2021-11-19 21:10:41,144][INFO ][exchange-worker-#20614%grid-0%][GridClusterStateProcessor] Writing BaselineTopology[id=0] [21:10:41] : [Step 4/5] [2021-11-19 21:10:41,145][INFO ][exchange-worker-#20737%grid-1%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1 [21:10:41] : [Step 4/5] [2021-11-19 21:10:41,149][INFO ][exchange-worker-#20737%grid-1%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000000.wal, offset=8795, ver=2] [21:10:41] : [Step 4/5] [2021-11-19 21:10:41,150][INFO ][exchange-worker-#20614%grid-0%][GridCacheDatabaseSharedManager] Finish recovery performed in 9 ms. [21:10:41] : [Step 4/5] [2021-11-19 21:10:41,150][INFO ][exchange-worker-#20737%grid-1%][GridClusterStateProcessor] Writing BaselineTopology[id=0] [21:10:41] : [Step 4/5] [2021-11-19 21:10:41,151][INFO ][exchange-worker-#20614%grid-0%][msg] Components activation performed in 11 ms. [21:10:41] : [Step 4/5] [2021-11-19 21:10:41,153][INFO ][exchange-worker-#20614%grid-0%][GridCacheProcessor] Finished recovery for cache [cache=ignite-sys-cache, grp=ignite-sys-cache, startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:10:41] : [Step 4/5] [2021-11-19 21:10:41,153][INFO ][exchange-worker-#20737%grid-1%][GridCacheDatabaseSharedManager] Finish recovery performed in 7 ms. [21:10:41] : [Step 4/5] [2021-11-19 21:10:41,154][INFO ][exchange-worker-#20737%grid-1%][msg] Components activation performed in 10 ms. [21:10:41] : [Step 4/5] [2021-11-19 21:10:41,154][INFO ][exchange-worker-#20614%grid-0%][GridDhtPartitionsExchangeFuture] Successfully activated caches [nodeId=003cf075-28f9-4b6c-920d-99b2dcc37000, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], newState=ACTIVE] [21:10:41] : [Step 4/5] [2021-11-19 21:10:41,155][INFO ][exchange-worker-#20737%grid-1%][GridCacheProcessor] Finished recovery for cache [cache=ignite-sys-cache, grp=ignite-sys-cache, startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:10:41] : [Step 4/5] [2021-11-19 21:10:41,155][INFO ][exchange-worker-#20614%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:10:41] : [Step 4/5] [2021-11-19 21:10:41,155][INFO ][exchange-worker-#20737%grid-1%][GridDhtPartitionsExchangeFuture] Successfully activated caches [nodeId=106eda8f-692b-446e-9c0b-11bdc123c001, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], newState=ACTIVE] [21:10:41] : [Step 4/5] [2021-11-19 21:10:41,156][INFO ][exchange-worker-#20737%grid-1%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:10:41] : [Step 4/5] [2021-11-19 21:10:41,164][INFO ][exchange-worker-#20614%grid-0%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], crd=true] [21:10:41] : [Step 4/5] [2021-11-19 21:10:41,166][INFO ][grid-nio-worker-tcp-comm-0-#20552%TestRecordingCommunicationSpi%][TestRecordingCommunicationSpi] Accepted incoming communication connection [locAddr=/127.0.0.1:47100, rmtAddr=/127.0.0.1:32970] [21:10:41] : [Step 4/5] [2021-11-19 21:10:41,168][INFO ][grid-nio-worker-tcp-comm-0-#20671%TestRecordingCommunicationSpi%][TestRecordingCommunicationSpi] Established outgoing communication connection [locAddr=/127.0.0.1:32970, rmtAddr=/127.0.0.1:47100] [21:10:41] : [Step 4/5] [2021-11-19 21:10:41,168][INFO ][exchange-worker-#20737%grid-1%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], crd=false] [21:10:41] : [Step 4/5] [2021-11-19 21:10:41,170][INFO ][sys-#20585%grid-0%][GridDhtPartitionsExchangeFuture] Coordinator received single message [ver=AffinityTopologyVersion [topVer=2, minorTopVer=1], node=106eda8f-692b-446e-9c0b-11bdc123c001, allReceived=true] [21:10:41] : [Step 4/5] [2021-11-19 21:10:41,170][INFO ][sys-#20585%grid-0%][GridDhtPartitionsExchangeFuture] finishExchangeOnCoordinator [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:10:41] : [Step 4/5] [2021-11-19 21:10:41,174][INFO ][sys-#20585%grid-0%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], err=null, rebalanced=true, wasRebalanced=false] [21:10:41] : [Step 4/5] [2021-11-19 21:10:41,175][INFO ][disco-notifier-worker-#20728%grid-1%][GridClusterStateProcessor] Received state change finish message: ACTIVE [21:10:41] : [Step 4/5] [2021-11-19 21:10:41,175][INFO ][sys-#20721%grid-1%][GridDhtPartitionsExchangeFuture] Received full message, will finish exchange [node=003cf075-28f9-4b6c-920d-99b2dcc37000, resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:10:41] : [Step 4/5] [2021-11-19 21:10:41,174][INFO ][disco-notifier-worker-#20609%grid-0%][GridClusterStateProcessor] Received state change finish message: ACTIVE [21:10:41] : [Step 4/5] [2021-11-19 21:10:41,178][INFO ][sys-#20585%grid-0%][GridCacheProcessor] Finish proxy initialization, cacheName=ignite-sys-cache, localNodeId=003cf075-28f9-4b6c-920d-99b2dcc37000 [21:10:41] : [Step 4/5] [2021-11-19 21:10:41,178][INFO ][sys-#20726%grid-1%][GridCachePartitionExchangeManager] Delay process full message without exchange id (there is exchange in progress) [nodeId=003cf075-28f9-4b6c-920d-99b2dcc37000] [21:10:41] : [Step 4/5] [2021-11-19 21:10:41,176][INFO ][disco-notifier-worker-#20728%grid-1%][GridClusterStateProcessor] Cluster state was changed from INACTIVE to ACTIVE [21:10:41] : [Step 4/5] [2021-11-19 21:10:41,178][INFO ][sys-#20585%grid-0%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=003cf075-28f9-4b6c-920d-99b2dcc37000, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=003cf075-28f9-4b6c-920d-99b2dcc37000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345441169, loc=true, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:10:41] : [Step 4/5] [2021-11-19 21:10:41,178][INFO ][exchange-worker-#20614%grid-0%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=2, minorTopVer=1], force=false, evt=DISCOVERY_CUSTOM_EVT, node=003cf075-28f9-4b6c-920d-99b2dcc37000] [21:10:41] : [Step 4/5] [2021-11-19 21:10:41,178][INFO ][sys-#20591%grid-0%][DistributedBaselineConfiguration] Baseline auto-adjust is 'disabled' with timeout='300000' ms [21:10:41] : [Step 4/5] [2021-11-19 21:10:41,178][INFO ][sys-#20721%grid-1%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], err=null, rebalanced=true, wasRebalanced=false] [21:10:41] : [Step 4/5] [2021-11-19 21:10:41,178][INFO ][disco-notifier-worker-#20609%grid-0%][GridClusterStateProcessor] Cluster state was changed from INACTIVE to ACTIVE [21:10:41] : [Step 4/5] [2021-11-19 21:10:41,181][INFO ][sys-#20591%grid-0%][GridClusterStateProcessor] Successfully performed final activation steps [nodeId=003cf075-28f9-4b6c-920d-99b2dcc37000, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:10:41] : [Step 4/5] [2021-11-19 21:10:41,180][INFO ][sys-#20585%grid-0%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (1 ms), stage="Update caches registry" (13 ms), stage="Start caches" (0 ms), stage="Affinity initialization on cache group start" (0 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Restore partition states" (0 ms), stage="After states restored callback" (7 ms), stage="WAL history reservation" (0 ms), stage="Waiting for all single messages" (6 ms), stage="Affinity recalculation (crd)" (0 ms), stage="Collect update counters and create affinity messages" (0 ms), stage="Assign partitions states" (0 ms), stage="Validate partitions states" (0 ms), stage="Ideal affinity diff calculation (enforced)" (0 ms), stage="Apply update counters" (0 ms), stage="Full message preparing" (2 ms), stage="Full message sending" (0 ms), stage="State finish message sending" (0 ms), stage="Detect lost partitions" (2 ms), stage="Exchange done" (3 ms), stage="Total time" (34 ms), Discovery lag=2 ms, Latest started node id=106eda8f-692b-446e-9c0b-11bdc123c001] [21:10:41] : [Step 4/5] [2021-11-19 21:10:41,184][INFO ][sys-#20721%grid-1%][GridCacheProcessor] Finish proxy initialization, cacheName=ignite-sys-cache, localNodeId=106eda8f-692b-446e-9c0b-11bdc123c001 [21:10:41] : [Step 4/5] [2021-11-19 21:10:41,185][INFO ][sys-#20585%grid-0%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], stage="Affinity initialization on cache group start [grp=ignite-sys-cache]" (0 ms) (parent=Affinity initialization on cache group start), stage="Affinity centralized initialization (crd) [grp=ignite-sys-cache, crd=true]" (0 ms) (parent=Determine exchange type), stage="Restore partition states [grp=ignite-sys-cache]" (0 ms) (parent=Restore partition states), stage="Affinity recalculation (partitions availability) [grp=ignite-sys-cache]" (0 ms) (parent=Ideal affinity diff calculation (enforced))] [21:10:41] : [Step 4/5] [2021-11-19 21:10:41,188][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][root] awaitPartitionMapExchange finished [21:10:41] : [Step 4/5] [2021-11-19 21:10:41,188][INFO ][sys-#20721%grid-1%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=106eda8f-692b-446e-9c0b-11bdc123c001, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=003cf075-28f9-4b6c-920d-99b2dcc37000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345441098, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:10:41] : [Step 4/5] [2021-11-19 21:10:41,187][INFO ][exchange-worker-#20737%grid-1%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=2, minorTopVer=1], force=false, evt=DISCOVERY_CUSTOM_EVT, node=003cf075-28f9-4b6c-920d-99b2dcc37000] [21:10:41] : [Step 4/5] [2021-11-19 21:10:41,187][INFO ][sys-#20706%grid-1%][DistributedBaselineConfiguration] Baseline auto-adjust is 'disabled' with timeout='300000' ms [21:10:41] : [Step 4/5] [2021-11-19 21:10:41,190][INFO ][sys-#20721%grid-1%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (2 ms), stage="Update caches registry" (11 ms), stage="Start caches" (0 ms), stage="Affinity initialization on cache group start" (0 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Restore partition states" (0 ms), stage="After states restored callback" (7 ms), stage="WAL history reservation" (0 ms), stage="Waiting for Full message" (10 ms), stage="Affinity recalculation" (1 ms), stage="Full map updating" (1 ms), stage="Detect lost partitions" (4 ms), stage="Exchange done" (6 ms), stage="Total time" (42 ms)] [21:10:41] : [Step 4/5] [2021-11-19 21:10:41,266][INFO ][sys-#20706%grid-1%][GridClusterStateProcessor] Successfully performed final activation steps [nodeId=106eda8f-692b-446e-9c0b-11bdc123c001, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:10:41] : [Step 4/5] [2021-11-19 21:10:41,267][INFO ][sys-#20721%grid-1%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], stage="Affinity initialization on cache group start [grp=ignite-sys-cache]" (0 ms) (parent=Affinity initialization on cache group start), stage="Affinity centralized initialization (crd) [grp=ignite-sys-cache, crd=false]" (0 ms) (parent=Determine exchange type), stage="Restore partition states [grp=ignite-sys-cache]" (0 ms) (parent=Restore partition states), stage="Affinity applying from full message [grp=ignite-sys-cache]" (1 ms) (parent=Affinity recalculation)] [21:10:41] : [Step 4/5] [2021-11-19 21:10:41,269][INFO ][exchange-worker-#20614%grid-0%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], crd=true, evt=DISCOVERY_CUSTOM_EVT, evtNode=003cf075-28f9-4b6c-920d-99b2dcc37000, customEvt=DynamicCacheChangeBatch [id=a9e7d593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqs=ArrayList [DynamicCacheChangeRequest [cacheName=encrypted, hasCfg=true, nodeId=003cf075-28f9-4b6c-920d-99b2dcc37000, clientStartOnly=false, stop=false, destroy=false, disabledAfterStart=false]], exchangeActions=ExchangeActions [startCaches=[encrypted], stopCaches=null, startGrps=[encrypted], stopGrps=[], resetParts=null, stateChangeRequest=null], startCaches=false], allowMerge=false, exchangeFreeSwitch=false] [21:10:41] : [Step 4/5] [2021-11-19 21:10:41,270][INFO ][exchange-worker-#20737%grid-1%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], crd=false, evt=DISCOVERY_CUSTOM_EVT, evtNode=003cf075-28f9-4b6c-920d-99b2dcc37000, customEvt=DynamicCacheChangeBatch [id=a9e7d593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqs=ArrayList [DynamicCacheChangeRequest [cacheName=encrypted, hasCfg=true, nodeId=003cf075-28f9-4b6c-920d-99b2dcc37000, clientStartOnly=false, stop=false, destroy=false, disabledAfterStart=false]], exchangeActions=ExchangeActions [startCaches=[encrypted], stopCaches=null, startGrps=[encrypted], stopGrps=[], resetParts=null, stateChangeRequest=null], startCaches=false], allowMerge=false, exchangeFreeSwitch=false] [21:10:41] : [Step 4/5] [2021-11-19 21:10:41,273][INFO ][exchange-worker-#20614%grid-0%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:10:41] : [Step 4/5] [2021-11-19 21:10:41,276][INFO ][exchange-worker-#20737%grid-1%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:10:41] : [Step 4/5] [2021-11-19 21:10:41,279][INFO ][exchange-worker-#20614%grid-0%][GridCacheProcessor] Started cache [name=encrypted, id=1613773252, dataRegionName=default, mode=PARTITIONED, atomicity=ATOMIC, backups=0, mvcc=false] [21:10:41] : [Step 4/5] [2021-11-19 21:10:41,280][INFO ][exchange-worker-#20614%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], waitTime=0ms, futInfo=NA, mode=DISTRIBUTED] [21:10:41] : [Step 4/5] [2021-11-19 21:10:41,284][INFO ][exchange-worker-#20737%grid-1%][GridCacheProcessor] Started cache [name=encrypted, id=1613773252, dataRegionName=default, mode=PARTITIONED, atomicity=ATOMIC, backups=0, mvcc=false] [21:10:41] : [Step 4/5] [2021-11-19 21:10:41,285][INFO ][exchange-worker-#20737%grid-1%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], waitTime=0ms, futInfo=NA, mode=DISTRIBUTED] [21:10:41] : [Step 4/5] [2021-11-19 21:10:41,286][INFO ][exchange-worker-#20614%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partitions release latch: ServerLatch [permits=0, pendingAcks=HashSet [], super=CompletableLatch [id=CompletableLatchUid [id=exchange, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2]]]] [21:10:41] : [Step 4/5] [2021-11-19 21:10:41,286][INFO ][exchange-worker-#20737%grid-1%][GridDhtPartitionsExchangeFuture] Finished waiting for partitions release latch: ClientLatch [coordinator=TcpDiscoveryNode [id=003cf075-28f9-4b6c-920d-99b2dcc37000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345441098, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], ackSent=true, super=CompletableLatch [id=CompletableLatchUid [id=exchange, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2]]]] [21:10:41] : [Step 4/5] [2021-11-19 21:10:41,287][INFO ][exchange-worker-#20614%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:10:41] : [Step 4/5] [2021-11-19 21:10:41,287][INFO ][exchange-worker-#20737%grid-1%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:10:41] : [Step 4/5] [2021-11-19 21:10:41,289][INFO ][exchange-worker-#20614%grid-0%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], crd=true] [21:10:41] : [Step 4/5] [2021-11-19 21:10:41,289][INFO ][exchange-worker-#20737%grid-1%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], crd=false] [21:10:41] : [Step 4/5] [2021-11-19 21:10:41,290][INFO ][sys-#20588%grid-0%][GridDhtPartitionsExchangeFuture] Coordinator received single message [ver=AffinityTopologyVersion [topVer=2, minorTopVer=2], node=106eda8f-692b-446e-9c0b-11bdc123c001, allReceived=true] [21:10:41] : [Step 4/5] [2021-11-19 21:10:41,291][INFO ][sys-#20588%grid-0%][GridDhtPartitionsExchangeFuture] finishExchangeOnCoordinator [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2]] [21:10:41] : [Step 4/5] [2021-11-19 21:10:41,293][INFO ][sys-#20588%grid-0%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], err=null, rebalanced=true, wasRebalanced=true] [21:10:41] : [Step 4/5] [2021-11-19 21:10:41,294][INFO ][sys-#20727%grid-1%][GridDhtPartitionsExchangeFuture] Received full message, will finish exchange [node=003cf075-28f9-4b6c-920d-99b2dcc37000, resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2]] [21:10:41] : [Step 4/5] [2021-11-19 21:10:41,294][INFO ][sys-#20588%grid-0%][GridCacheProcessor] Finish proxy initialization, cacheName=encrypted, localNodeId=003cf075-28f9-4b6c-920d-99b2dcc37000 [21:10:41] : [Step 4/5] [2021-11-19 21:10:41,298][INFO ][sys-#20727%grid-1%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], err=null, rebalanced=true, wasRebalanced=true] [21:10:41] : [Step 4/5] [2021-11-19 21:10:41,298][INFO ][exchange-worker-#20614%grid-0%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=2, minorTopVer=2], force=false, evt=DISCOVERY_CUSTOM_EVT, node=003cf075-28f9-4b6c-920d-99b2dcc37000] [21:10:41] : [Step 4/5] [2021-11-19 21:10:41,298][INFO ][sys-#20588%grid-0%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=003cf075-28f9-4b6c-920d-99b2dcc37000, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=003cf075-28f9-4b6c-920d-99b2dcc37000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345441265, loc=true, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2]] [21:10:41] : [Step 4/5] [2021-11-19 21:10:41,299][INFO ][sys-#20727%grid-1%][GridCacheProcessor] Finish proxy initialization, cacheName=encrypted, localNodeId=106eda8f-692b-446e-9c0b-11bdc123c001 [21:10:41] : [Step 4/5] [2021-11-19 21:10:41,300][INFO ][sys-#20588%grid-0%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (1 ms), stage="Update caches registry" (0 ms), stage="Start caches" (8 ms), stage="Affinity initialization on cache group start" (0 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Wait partitions release latch [latch=exchange]" (6 ms), stage="Wait partitions release [latch=exchange]" (1 ms), stage="Restore partition states" (0 ms), stage="After states restored callback" (0 ms), stage="WAL history reservation" (0 ms), stage="Waiting for all single messages" (1 ms), stage="Affinity recalculation (crd)" (0 ms), stage="Collect update counters and create affinity messages" (0 ms), stage="Assign partitions states" (0 ms), stage="Validate partitions states" (0 ms), stage="Apply update counters" (0 ms), stage="Full message preparing" (1 ms), stage="Full message sending" (0 ms), stage="Exchange done" (6 ms), stage="Total time" (24 ms)] [21:10:41] : [Step 4/5] [2021-11-19 21:10:41,300][INFO ][exchange-worker-#20737%grid-1%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=2, minorTopVer=2], force=false, evt=DISCOVERY_CUSTOM_EVT, node=003cf075-28f9-4b6c-920d-99b2dcc37000] [21:10:41] : [Step 4/5] [2021-11-19 21:10:41,300][INFO ][sys-#20727%grid-1%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=106eda8f-692b-446e-9c0b-11bdc123c001, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=003cf075-28f9-4b6c-920d-99b2dcc37000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345441098, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2]] [21:10:41] : [Step 4/5] [2021-11-19 21:10:41,302][INFO ][sys-#20588%grid-0%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], stage="Affinity initialization on cache group start [grp=encrypted]" (0 ms) (parent=Affinity initialization on cache group start), stage="Restore partition states [grp=ignite-sys-cache]" (0 ms) (parent=Restore partition states), stage="Restore partition states [grp=encrypted]" (0 ms) (parent=Restore partition states)] [21:10:41] : [Step 4/5] [2021-11-19 21:10:41,303][INFO ][sys-#20727%grid-1%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (2 ms), stage="Update caches registry" (0 ms), stage="Start caches" (12 ms), stage="Affinity initialization on cache group start" (0 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Wait partitions release latch [latch=exchange]" (1 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Restore partition states" (0 ms), stage="After states restored callback" (0 ms), stage="WAL history reservation" (0 ms), stage="Waiting for Full message" (4 ms), stage="Affinity recalculation" (0 ms), stage="Full map updating" (3 ms), stage="Exchange done" (5 ms), stage="Total time" (27 ms)] [21:10:41] : [Step 4/5] [2021-11-19 21:10:41,305][INFO ][sys-#20727%grid-1%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], stage="Affinity initialization on cache group start [grp=encrypted]" (0 ms) (parent=Affinity initialization on cache group start), stage="Restore partition states [grp=ignite-sys-cache]" (0 ms) (parent=Restore partition states), stage="Restore partition states [grp=encrypted]" (0 ms) (parent=Restore partition states)] [21:10:41] : [Step 4/5] [2021-11-19 21:10:41,400][INFO ][db-checkpoint-thread-#20748%grid-0%][Checkpointer] Checkpoint started [checkpointId=8ab291c5-2ef7-4219-9a0e-82458e71a5f6, startPtr=WALPointer [idx=0, fileOff=86657, len=1963], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=102ms, writeCheckpointEntryDuration=134ms, splitAndSortCpPagesDuration=1ms, pages=18, reason='node started'] [21:10:41] : [Step 4/5] [2021-11-19 21:10:41,400][INFO ][db-checkpoint-thread-#20753%grid-1%][Checkpointer] Checkpoint started [checkpointId=89595c1e-6c38-4010-a61b-1d058c6fd1a2, startPtr=WALPointer [idx=0, fileOff=86657, len=1963], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=101ms, writeCheckpointEntryDuration=134ms, splitAndSortCpPagesDuration=1ms, pages=18, reason='node started'] [21:10:41] : [Step 4/5] [2021-11-19 21:10:41,609][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][root] >>> Stopping grid [name=grid-1, id=106eda8f-692b-446e-9c0b-11bdc123c001] [21:10:41] : [Step 4/5] [2021-11-19 21:10:41,839][INFO ][db-checkpoint-thread-#20748%grid-0%][Checkpointer] Checkpoint finished [cpId=8ab291c5-2ef7-4219-9a0e-82458e71a5f6, pages=18, markPos=WALPointer [idx=0, fileOff=86657, len=1963], walSegmentsCovered=[], markDuration=237ms, pagesWrite=1ms, fsync=438ms, total=677ms] [21:10:41] : [Step 4/5] [2021-11-19 21:10:41,839][INFO ][db-checkpoint-thread-#20753%grid-1%][Checkpointer] Checkpoint finished [cpId=89595c1e-6c38-4010-a61b-1d058c6fd1a2, pages=18, markPos=WALPointer [idx=0, fileOff=86657, len=1963], walSegmentsCovered=[], markDuration=237ms, pagesWrite=1ms, fsync=437ms, total=676ms] [21:10:41] : [Step 4/5] [2021-11-19 21:10:41,849][INFO ][tcp-disco-sock-reader-[003cf075 127.0.0.1:45285]-#1087%grid-1%-#20733%grid-1%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:45285, rmtPort=45285, rmtNodeId=003cf075-28f9-4b6c-920d-99b2dcc37000] [21:10:41] : [Step 4/5] [2021-11-19 21:10:41,850][INFO ][disco-event-worker-#20613%grid-0%][GridDiscoveryManager] Node left topology: TcpDiscoveryNode [id=106eda8f-692b-446e-9c0b-11bdc123c001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637345441078, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false] [21:10:41] : [Step 4/5] [2021-11-19 21:10:41,851][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Stopped cache [cacheName=ignite-sys-cache] [21:10:41] : [Step 4/5] [2021-11-19 21:10:41,852][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Stopped cache [cacheName=encrypted] [21:10:41] : [Step 4/5] [2021-11-19 21:10:41,852][INFO ][disco-event-worker-#20613%grid-0%][GridDiscoveryManager] Topology snapshot [ver=3, locNode=003cf075, servers=1, clients=0, state=ACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=003cf075-28f9-4b6c-920d-99b2dcc37000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:10:41] : [Step 4/5] [2021-11-19 21:10:41,853][INFO ][disco-event-worker-#20613%grid-0%][GridDiscoveryManager] ^-- Baseline [id=0, size=2, online=1, offline=1] [21:10:41]W: [org.apache.ignite:ignite-core] [2021-11-19 21:10:41,854][WARN ][grid-nio-worker-tcp-comm-0-#20552%TestRecordingCommunicationSpi%][TestRecordingCommunicationSpi] Failed to shutdown socket [21:10:41]W: [org.apache.ignite:ignite-core] java.nio.channels.ClosedChannelException [21:10:41]W: [org.apache.ignite:ignite-core] at sun.nio.ch.SocketChannelImpl.shutdownOutput(SocketChannelImpl.java:795) [21:10:41]W: [org.apache.ignite:ignite-core] at sun.nio.ch.SocketAdaptor.shutdownOutput(SocketAdaptor.java:407) [21:10:41]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.close(IgniteUtils.java:4247) [21:10:41]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.closeKey(GridNioServer.java:2784) [21:10:41]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.close(GridNioServer.java:2835) [21:10:41]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.close(GridNioServer.java:2794) [21:10:41]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.bodyInternal(GridNioServer.java:2157) [21:10:41]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.body(GridNioServer.java:1910) [21:10:41]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:125) [21:10:41]W: [org.apache.ignite:ignite-core] at java.lang.Thread.run(Thread.java:748) [21:10:41] : [Step 4/5] [2021-11-19 21:10:41,855][INFO ][exchange-worker-#20614%grid-0%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], crd=true, evt=NODE_LEFT, evtNode=106eda8f-692b-446e-9c0b-11bdc123c001, customEvt=null, allowMerge=false, exchangeFreeSwitch=true] [21:10:41] : [Step 4/5] [2021-11-19 21:10:41,857][INFO ][sys-#20587%grid-0%][GridAffinityAssignmentCache] Local node affinity assignment distribution is not ideal [cache=encrypted, expectedPrimary=8.00, actualPrimary=3, expectedBackups=0.00, actualBackups=0, warningThreshold=50.00%] [21:10:41] : [Step 4/5] [2021-11-19 21:10:41,857][INFO ][exchange-worker-#20614%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:10:41] : [Step 4/5] [2021-11-19 21:10:41,858][INFO ][exchange-worker-#20614%grid-0%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], err=null, rebalanced=true, wasRebalanced=true] [21:10:41]W: [org.apache.ignite:ignite-core] [2021-11-19 21:10:41,859][WARN ][sys-#20592%grid-0%][GridDhtPartitionTopologyImpl] Detected lost partitions [grp=encrypted, parts=[0, 2, 4, 6-7], topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0]] [21:10:41] : [Step 4/5] [2021-11-19 21:10:41,860][INFO ][exchange-worker-#20614%grid-0%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=003cf075-28f9-4b6c-920d-99b2dcc37000, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], evt=NODE_LEFT, evtNode=TcpDiscoveryNode [id=106eda8f-692b-446e-9c0b-11bdc123c001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637345441078, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0]] [21:10:41] : [Step 4/5] [2021-11-19 21:10:41,861][INFO ][exchange-worker-#20614%grid-0%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (1 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="After states restored callback" (0 ms), stage="WAL history reservation" (0 ms), stage="Finalize update counters" (0 ms), stage="Detect lost partitions" (1 ms), stage="Exchange done" (1 ms), stage="Total time" (3 ms)] [21:10:41] : [Step 4/5] [2021-11-19 21:10:41,861][INFO ][exchange-worker-#20614%grid-0%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], stage="Affinity initialization (exchange-free switch on fully-rebalanced topology) [grp=ignite-sys-cache]" (0 ms) (parent=Determine exchange type), stage="Affinity initialization (exchange-free switch on fully-rebalanced topology) [grp=encrypted]" (0 ms) (parent=Determine exchange type)] [21:10:41] : [Step 4/5] [2021-11-19 21:10:41,862][INFO ][exchange-worker-#20614%grid-0%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], crd=true] [21:10:41] : [Step 4/5] [2021-11-19 21:10:41,863][INFO ][exchange-worker-#20614%grid-0%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=3, minorTopVer=0], force=false, evt=NODE_LEFT, node=106eda8f-692b-446e-9c0b-11bdc123c001] [21:10:42] : [Step 4/5] [2021-11-19 21:10:42,113][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][FilePageStoreManager] Cleanup cache stores [total=4, left=0, cleanFiles=false] [21:10:42] : [Step 4/5] [2021-11-19 21:10:42,115][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][GridDeploymentLocalStore] Removed undeployed class: GridDeployment [ts=1637345441169, depMode=SHARED, clsLdr=IsolatedClassLoader{roleName='test'}, clsLdrId=48e7d593d71-106eda8f-692b-446e-9c0b-11bdc123c001, userVer=0, loc=true, sampleClsName=org.apache.ignite.internal.processors.cache.distributed.dht.preloader.IgniteDhtPartitionHistorySuppliersMap, pendingUndeploy=false, undeployed=true, usage=0] [21:10:42] : [Step 4/5] [2021-11-19 21:10:42,125][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] [21:10:42] : [Step 4/5] [21:10:42] : [Step 4/5] >>> +------------------------------------------------------+ [21:10:42] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV stopped OK [21:10:42] : [Step 4/5] >>> +------------------------------------------------------+ [21:10:42] : [Step 4/5] >>> Ignite instance name: grid-1 [21:10:42] : [Step 4/5] >>> Grid uptime: 00:00:00.999 [21:10:42] : [Step 4/5] [21:10:42] : [Step 4/5] [21:10:42] : [Step 4/5] [2021-11-19 21:10:42,141][INFO ][disco-notifier-worker-#20609%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=1] [21:10:42] : [Step 4/5] [2021-11-19 21:10:42,145][INFO ][reencrypt-#20771%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:10:42]W: [org.apache.ignite:ignite-core] [2021-11-19 21:10:42,152][WARN ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][G] Ignite work directory is not provided, automatically resolved to: /opt/buildagent/work/7bc1c54bc719b67c/work [21:10:42] : [Step 4/5] [2021-11-19 21:10:42,153][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] [21:10:42] : [Step 4/5] [21:10:42] : [Step 4/5] >>> __________ ________________ [21:10:42] : [Step 4/5] >>> / _/ ___/ |/ / _/_ __/ __/ [21:10:42] : [Step 4/5] >>> _/ // (7 7 // / / / / _/ [21:10:42] : [Step 4/5] >>> /___/\___/_/|_/___/ /_/ /___/ [21:10:42] : [Step 4/5] >>> [21:10:42] : [Step 4/5] >>> ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:10:42] : [Step 4/5] >>> 2021 Copyright(C) Apache Software Foundation [21:10:42] : [Step 4/5] >>> [21:10:42] : [Step 4/5] >>> Ignite documentation: http://ignite.apache.org [21:10:42] : [Step 4/5] [21:10:42] : [Step 4/5] [2021-11-19 21:10:42,154][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] Config URL: n/a [21:10:42] : [Step 4/5] [2021-11-19 21:10:42,154][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] IgniteConfiguration [igniteInstanceName=grid-1, pubPoolSize=24, svcPoolSize=24, callbackPoolSize=24, stripedPoolSize=24, sysPoolSize=24, mgmtPoolSize=4, dataStreamerPoolSize=24, utilityCachePoolSize=24, utilityCacheKeepAliveTime=60000, p2pPoolSize=2, qryPoolSize=24, buildIdxPoolSize=4, igniteHome=/opt/buildagent/work/7bc1c54bc719b67c, igniteWorkDir=/opt/buildagent/work/7bc1c54bc719b67c/work, mbeanSrv=com.sun.jmx.mbeanserver.JmxMBeanServer@6fe85038, nodeId=105c4cc6-a359-4c94-9c58-18620855c001, marsh=BinaryMarshaller [], marshLocJobs=false, daemon=false, p2pEnabled=true, netTimeout=10000, netCompressionLevel=1, sndRetryDelay=1000, sndRetryCnt=3, metricsHistSize=10000, metricsUpdateFreq=1000, metricsExpTime=9223372036854775807, discoSpi=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=0, ackTimeout=0, marsh=null, reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], segPlc=STOP, segResolveAttempts=2, waitForSegOnStart=true, allResolversPassReq=true, segChkFreq=10000, commSpi=TcpCommunicationSpi [connectGate=org.apache.ignite.spi.communication.tcp.internal.ConnectGateway@6c30c880, ctxInitLatch=java.util.concurrent.CountDownLatch@2aa9a209[Count = 1], stopping=false, clientPool=null, nioSrvWrapper=null, stateProvider=null], evtSpi=MemoryEventStorageSpi [expireAgeMs=9223372036854775807, expireCnt=10000, filter=null], colSpi=NoopCollisionSpi [], deploySpi=LocalDeploymentSpi [], indexingSpi=org.apache.ignite.spi.indexing.noop.NoopIndexingSpi@28b1630d, addrRslvr=null, encryptionSpi=org.apache.ignite.spi.encryption.keystore.KeystoreEncryptionSpi@522c855e, tracingSpi=org.apache.ignite.spi.tracing.NoopTracingSpi@7bfbc857, clientMode=false, rebalanceThreadPoolSize=4, rebalanceTimeout=10000, rebalanceBatchesPrefetchCnt=3, rebalanceThrottle=0, rebalanceBatchSize=524288, txCfg=TransactionConfiguration [txSerEnabled=false, dfltIsolation=REPEATABLE_READ, dfltConcurrency=PESSIMISTIC, dfltTxTimeout=0, txTimeoutOnPartitionMapExchange=0, deadlockTimeout=10000, pessimisticTxLogSize=0, pessimisticTxLogLinger=10000, tmLookupClsName=null, txManagerFactory=null, useJtaSync=false], cacheSanityCheckEnabled=true, discoStartupDelay=60000, deployMode=SHARED, p2pMissedCacheSize=100, locHost=127.0.0.1, timeSrvPortBase=31100, timeSrvPortRange=100, failureDetectionTimeout=10000, sysWorkerBlockedTimeout=null, clientFailureDetectionTimeout=10000, metricsLogFreq=0, connectorCfg=null, odbcCfg=null, warmupClos=null, atomicCfg=AtomicConfiguration [seqReserveSize=1000, cacheMode=PARTITIONED, backups=1, aff=null, grpName=null], classLdr=null, sslCtxFactory=null, platformCfg=null, binaryCfg=null, memCfg=null, pstCfg=null, dsCfg=DataStorageConfiguration [sysRegionInitSize=41943040, sysRegionMaxSize=104857600, pageSize=4096, concLvl=0, dfltDataRegConf=DataRegionConfiguration [name=default, maxSize=104857600, initSize=268435456, swapPath=null, pageEvictionMode=DISABLED, pageReplacementMode=CLOCK, evictionThreshold=0.9, emptyPagesPoolSize=100, metricsEnabled=false, metricsSubIntervalCount=5, metricsRateTimeInterval=60000, persistenceEnabled=true, checkpointPageBufSize=0, lazyMemoryAllocation=true, warmUpCfg=null], dataRegions=null, storagePath=null, checkpointFreq=30000, lockWaitTime=10000, checkpointThreads=4, checkpointWriteOrder=SEQUENTIAL, walHistSize=20, maxWalArchiveSize=20971520, walSegments=10, walSegmentSize=1048576, walPath=db/wal, walArchivePath=db/wal/archive, cdcWalPath=db/wal/cdc, cdcEnabled=false, metricsEnabled=false, walMode=LOG_ONLY, walTlbSize=131072, walBuffSize=0, walFlushFreq=2000, walFsyncDelay=1000, walRecordIterBuffSize=67108864, alwaysWriteFullPages=false, fileIOFactory=org.apache.ignite.internal.processors.cache.persistence.file.AsyncFileIOFactory@53c3b2c3, metricsSubIntervalCnt=5, metricsRateTimeInterval=60000, walAutoArchiveAfterInactivity=-1, walForceArchiveTimeout=-1, writeThrottlingEnabled=false, walCompactionEnabled=false, walCompactionLevel=1, checkpointReadLockTimeout=null, walPageCompression=DISABLED, walPageCompressionLevel=null, dfltWarmUpCfg=null, encCfg=org.apache.ignite.configuration.EncryptionConfiguration@4823ddce, defragmentationThreadPoolSize=4, minWalArchiveSize=-1], snapshotPath=snapshots, activeOnStart=true, activeOnStartPropSetFlag=false, autoActivation=true, autoActivationPropSetFlag=false, clusterStateOnStart=null, sqlConnCfg=null, cliConnCfg=ClientConnectorConfiguration [host=null, port=10800, portRange=100, sockSndBufSize=0, sockRcvBufSize=0, tcpNoDelay=true, maxOpenCursorsPerConn=128, threadPoolSize=24, selectorCnt=12, idleTimeout=0, handshakeTimeout=10000, jdbcEnabled=true, odbcEnabled=true, thinCliEnabled=true, sslEnabled=false, useIgniteSslCtxFactory=true, sslClientAuth=false, sslCtxFactory=null, thinCliCfg=ThinClientConfiguration [maxActiveTxPerConn=100, maxActiveComputeTasksPerConn=0]], mvccVacuumThreadCnt=2, mvccVacuumFreq=5000, authEnabled=false, failureHnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]], commFailureRslvr=null, sqlCfg=SqlConfiguration [longQryWarnTimeout=3000, dfltQryTimeout=0, sqlQryHistSize=1000, validationEnabled=false], asyncContinuationExecutor=null] [21:10:42] : [Step 4/5] [2021-11-19 21:10:42,163][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] Daemon mode: off [21:10:42] : [Step 4/5] [2021-11-19 21:10:42,164][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] OS: Linux 4.15.0-151-generic amd64 [21:10:42] : [Step 4/5] [2021-11-19 21:10:42,164][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] OS user: teamcity [21:10:42] : [Step 4/5] [2021-11-19 21:10:42,164][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] PID: 16724 [21:10:42] : [Step 4/5] [2021-11-19 21:10:42,165][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] Language runtime: Java Platform API Specification ver. 1.8 [21:10:42] : [Step 4/5] [2021-11-19 21:10:42,165][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] VM information: Java(TM) SE Runtime Environment 1.8.0_261-b12 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 25.261-b12 [21:10:42] : [Step 4/5] [2021-11-19 21:10:42,165][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] VM total memory: 1.9GB [21:10:42] : [Step 4/5] [2021-11-19 21:10:42,166][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] Remote Management [restart: off, REST: off, JMX (remote: off)] [21:10:42] : [Step 4/5] [2021-11-19 21:10:42,166][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] Logger: GridTestLog4jLogger [quiet=false, config=null] [21:10:42] : [Step 4/5] [2021-11-19 21:10:42,166][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] IGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c [21:10:42] : [Step 4/5] [2021-11-19 21:10:42,166][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] VM arguments: [-DIGNITE_DUMP_THREADS_ON_FAILURE=false, -DMono=/usr/bin/mono-sgen, -DMono4.0_x64=/usr/lib/mono/4.0, -DMono4.5_x64=/usr/lib/mono/4.5, -DMonoVersion=6.12.0.90, -DSKIP_BUILD=false, -Dagent.home.dir=/opt/buildagent, -Dagent.name=aitc-lin02_03, -Dagent.ownPort=9090, -Dagent.work.dir=/opt/buildagent/work, -Dbuild.number=95, -Dbuild.vcs.number=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.1=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.GitHubApacheIgnite=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dclassworlds.conf=/opt/buildagent/temp/buildTmp/teamcity.m2.conf, -Dcom.jetbrains.maven.watcher.report.file=/opt/buildagent/temp/buildTmp/maven-build-info.xml, -Djava.io.tmpdir=/opt/buildagent/temp/buildTmp, -Dmaven.home=/opt/buildagent/tools/maven3_6, -Dmaven.multiModuleProjectDirectory=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.agent.cpuBenchmark=457, -Dteamcity.agent.dotnet.agent_url=http://localhost:9090/RPC2, -Dteamcity.agent.dotnet.build_id=6278078, -Dteamcity.auth.password=*******, -Dteamcity.auth.userId=TeamCityBuildId=6278078, -Dteamcity.build.changedFiles.file=/opt/buildagent/temp/buildTmp/changedFiles6342607772318147725.txt, -Dteamcity.build.checkoutDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.build.id=6278078, -Dteamcity.build.properties.file=/opt/buildagent/temp/buildTmp/teamcity.build5164517880467851002.properties, -Dteamcity.build.tempDir=/opt/buildagent/temp/buildTmp, -Dteamcity.build.workingDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.buildConfName=Basic 3, -Dteamcity.buildType.id=IgniteTests24Java8_Basic3, -Dteamcity.configuration.properties.file=/opt/buildagent/temp/buildTmp/teamcity.config5591980786735343870.properties, -Dteamcity.maven.userSettings.path=/opt/buildagent/temp/buildTmp/maven_settings_585072866407032347.xml, -Dteamcity.maven.watcher.home=/opt/buildagent/plugins/mavenPlugin/maven-watcher-jdk16, -Dteamcity.projectName=Ignite Tests 2.x (JDK 8/11), -Dteamcity.runner.properties.file=/opt/buildagent/temp/buildTmp/teamcity.runner9098465561618137420.properties, -Dteamcity.tests.recentlyFailedTests.file=/opt/buildagent/temp/buildTmp/testsToRunFirst3891775683130404069.txt, -Dteamcity.version=2021.2 (build 99542), -ea, -Xms2g, -Xmx2g, -XX:+HeapDumpOnOutOfMemoryError, -DIGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_TEST_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_UPDATE_NOTIFIER=false, -DIGNITE_NO_DISCO_ORDER=true, -DIGNITE_PERFORMANCE_SUGGESTIONS_DISABLED=true, -Djava.net.preferIPv4Stack=true, -DTEST_SCALE_FACTOR=1.0, -DIGNITE_TEST_PROP_LOG4J_FILE=log4j-tc-test.xml, -DIGNITE_QUIET=false, -DIGNITE_MARSHAL_BUFFERS_RECHECK=1000, -Dmaven.repo.local=/opt/buildagent/.m2/repository] [21:10:42] : [Step 4/5] [2021-11-19 21:10:42,171][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] System cache's DataRegion size is configured to 40 MB. Use DataStorageConfiguration.systemRegionInitialSize property to change the setting. [21:10:42] : [Step 4/5] [2021-11-19 21:10:42,171][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] Configured caches [in 'sysMemPlc' dataRegion: ['ignite-sys-cache']] [21:10:42]W: [org.apache.ignite:ignite-core] [2021-11-19 21:10:42,172][WARN ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] Peer class loading is enabled (disable it in production for performance and deployment consistency reasons) [21:10:42] : [Step 4/5] [2021-11-19 21:10:42,172][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] 3-rd party licenses can be found at: /opt/buildagent/work/7bc1c54bc719b67c/libs/licenses [21:10:42] : [Step 4/5] [2021-11-19 21:10:42,177][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] Configured plugins: [21:10:42] : [Step 4/5] [2021-11-19 21:10:42,177][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- StanByClusterTestProvider 1.0 [21:10:42] : [Step 4/5] [2021-11-19 21:10:42,177][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:10:42] : [Step 4/5] [2021-11-19 21:10:42,177][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] [21:10:42] : [Step 4/5] [2021-11-19 21:10:42,177][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- PageMemory tracker plugin 1.0 [21:10:42] : [Step 4/5] [2021-11-19 21:10:42,178][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:10:42] : [Step 4/5] [2021-11-19 21:10:42,178][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] [21:10:42] : [Step 4/5] [2021-11-19 21:10:42,178][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- TestDistibutedConfigurationPlugin 1.0 [21:10:42] : [Step 4/5] [2021-11-19 21:10:42,178][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:10:42] : [Step 4/5] [2021-11-19 21:10:42,178][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] [21:10:42] : [Step 4/5] [2021-11-19 21:10:42,179][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- NodeValidationPluginProvider 1.0 [21:10:42] : [Step 4/5] [2021-11-19 21:10:42,179][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:10:42] : [Step 4/5] [2021-11-19 21:10:42,179][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] [21:10:42] : [Step 4/5] [2021-11-19 21:10:42,179][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][FailureProcessor] Configured failure handler: [hnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]]] [21:10:42] : [Step 4/5] [2021-11-19 21:10:42,198][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][TestRecordingCommunicationSpi] Successfully bound communication NIO server to TCP port [port=47101, locHost=/127.0.0.1, selectorsCnt=12, selectorSpins=0, pairedConn=false] [21:10:42]W: [org.apache.ignite:ignite-core] [2021-11-19 21:10:42,198][WARN ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][TestRecordingCommunicationSpi] Message queue limit is set to 0 which may lead to potential OOMEs when running cache operations in FULL_ASYNC or PRIMARY_SYNC modes due to message queues growth on sender and receiver sides. [21:10:42] : [Step 4/5] [2021-11-19 21:10:42,205][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][GridCollisionManager] Collision resolution is disabled (all jobs will be activated upon arrival). [21:10:42] : [Step 4/5] [2021-11-19 21:10:42,205][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] Security status [authentication=off, sandbox=off, tls/ssl=off] [21:10:42] : [Step 4/5] [2021-11-19 21:10:42,262][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:10:42] : [Step 4/5] [2021-11-19 21:10:42,363][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][MaintenanceProcessor] Resolved store directory for node persistent data: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1 [21:10:42] : [Step 4/5] [2021-11-19 21:10:42,364][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][CacheObjectBinaryProcessorImpl] Resolved directory for serialized binary metadata: /opt/buildagent/work/7bc1c54bc719b67c/work/db/binary_meta/grid_1 [21:10:42] : [Step 4/5] [2021-11-19 21:10:42,368][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1 [21:10:42] : [Step 4/5] [2021-11-19 21:10:42,368][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][FileWriteAheadLogManager] Resolved write ahead log work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1 [21:10:42] : [Step 4/5] [2021-11-19 21:10:42,369][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][FileWriteAheadLogManager] Resolved write ahead log archive directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1 [21:10:42] : [Step 4/5] [2021-11-19 21:10:42,370][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000005.wal [21:10:42] : [Step 4/5] [2021-11-19 21:10:42,370][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000006.wal [21:10:42] : [Step 4/5] [2021-11-19 21:10:42,371][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000004.wal [21:10:42] : [Step 4/5] [2021-11-19 21:10:42,371][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000003.wal [21:10:42] : [Step 4/5] [2021-11-19 21:10:42,371][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000002.wal [21:10:42] : [Step 4/5] [2021-11-19 21:10:42,372][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000007.wal [21:10:42] : [Step 4/5] [2021-11-19 21:10:42,372][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000001.wal [21:10:42] : [Step 4/5] [2021-11-19 21:10:42,373][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][FileHandleManagerImpl] Initialized write-ahead log manager [mode=LOG_ONLY] [21:10:42] : [Step 4/5] [2021-11-19 21:10:42,377][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Configured data regions initialized successfully [total=5] [21:10:42] : [Step 4/5] [2021-11-19 21:10:42,506][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][IgniteSnapshotManager] Resolved snapshot work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/snapshots [21:10:42] : [Step 4/5] [2021-11-19 21:10:42,506][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][IgniteSnapshotManager] Resolved temp directory for snapshot creation: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1/snp [21:10:42] : [Step 4/5] [2021-11-19 21:10:42,508][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][ClientListenerProcessor] Client connector processor has started on TCP port 10801 [21:10:42] : [Step 4/5] [2021-11-19 21:10:42,512][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] Non-loopback local IPs: 172.17.0.4 [21:10:42] : [Step 4/5] [2021-11-19 21:10:42,512][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] Enabled local MACs: 0242AC110004 [21:10:42] : [Step 4/5] [2021-11-19 21:10:42,515][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=/opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1/cp/1637345441163-89595c1e-6c38-4010-a61b-1d058c6fd1a2-START.bin, endMarker=/opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1/cp/1637345441163-89595c1e-6c38-4010-a61b-1d058c6fd1a2-END.bin] [21:10:42] : [Step 4/5] [2021-11-19 21:10:42,516][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:10:42] : [Step 4/5] [2021-11-19 21:10:42,516][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=86657, len=1963], lastMarked=WALPointer [idx=0, fileOff=86657, len=1963], lastCheckpointId=89595c1e-6c38-4010-a61b-1d058c6fd1a2] [21:10:42] : [Step 4/5] [2021-11-19 21:10:42,519][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Found last checkpoint marker [cpId=89595c1e-6c38-4010-a61b-1d058c6fd1a2, pos=WALPointer [idx=0, fileOff=86657, len=1963]] [21:10:42] : [Step 4/5] [2021-11-19 21:10:42,520][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Applying lost metastore updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=86657, len=1963], lastCheckpointId=89595c1e-6c38-4010-a61b-1d058c6fd1a2] [21:10:42] : [Step 4/5] [2021-11-19 21:10:42,521][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=0 ms] [21:10:42] : [Step 4/5] [2021-11-19 21:10:42,522][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Restoring partition state for local groups. [21:10:42] : [Step 4/5] [2021-11-19 21:10:42,522][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=0, partitionsProcessed=0, time=0ms] [21:10:42] : [Step 4/5] [2021-11-19 21:10:42,528][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][GridClusterStateProcessor] Restoring history for BaselineTopology[id=0] [21:10:42] : [Step 4/5] [2021-11-19 21:10:42,534][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][ClusterProcessor] Cluster ID and tag has been read from metastorage: ClusterIdAndTag [id=4d3cbeac-e0b5-419f-89b7-16229c34ade1, tag=focused_euler] [21:10:42] : [Step 4/5] [2021-11-19 21:10:42,534][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][IgniteClusterImpl] Shutdown policy was updated [oldVal=null, newVal=null] [21:10:42] : [Step 4/5] [2021-11-19 21:10:42,534][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustEnabled' was changed from 'null' to 'false' [21:10:42] : [Step 4/5] [2021-11-19 21:10:42,535][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustTimeout' was changed from 'null' to '300000' [21:10:42] : [Step 4/5] [2021-11-19 21:10:42,535][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][IgniteTxManager] Transactions parameter 'txOwnerDumpRequestsAllowed' was changed from 'null' to 'true' [21:10:42] : [Step 4/5] [2021-11-19 21:10:42,535][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][IgniteTxManager] Transactions parameter 'longOperationsDumpTimeout' was changed from 'null' to '60000' [21:10:42] : [Step 4/5] [2021-11-19 21:10:42,536][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpThreshold' was changed from 'null' to '0' [21:10:42] : [Step 4/5] [2021-11-19 21:10:42,536][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][IgniteTxManager] Transactions parameter 'transactionTimeDumpSamplesCoefficient' was changed from 'null' to '0.0' [21:10:42] : [Step 4/5] [2021-11-19 21:10:42,536][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpSamplesPerSecondLimit' was changed from 'null' to '5' [21:10:42] : [Step 4/5] [2021-11-19 21:10:42,537][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][IgniteTxManager] Transactions parameter 'collisionsDumpInterval' was changed from 'null' to '1000' [21:10:42] : [Step 4/5] [2021-11-19 21:10:42,537][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Historical rebalance WAL threshold changed [property=historical.rebalance.threshold, oldVal=null, newVal=500] [21:10:42] : [Step 4/5] [2021-11-19 21:10:42,537][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Checkpoint frequency deviation changed [oldVal=null, newVal=null] [21:10:42] : [Step 4/5] [2021-11-19 21:10:42,637][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][FilePageStoreManager] Cleanup cache stores [total=1, left=0, cleanFiles=false] [21:10:42] : [Step 4/5] [2021-11-19 21:10:42,639][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:10:42] : [Step 4/5] [2021-11-19 21:10:42,640][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:10:42] : [Step 4/5] [2021-11-19 21:10:42,641][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:10:42] : [Step 4/5] [2021-11-19 21:10:42,642][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Data Regions Started: 5 [21:10:42] : [Step 4/5] [2021-11-19 21:10:42,642][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] ^-- sysMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:10:42] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:10:42] : [Step 4/5] ^-- default region [type=default, persistence=true, lazyAlloc=true, [21:10:42] : [Step 4/5] ... initCfg=100MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB, allocTotal=0MB] [21:10:42] : [Step 4/5] ^-- metastoreMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:10:42] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:10:42] : [Step 4/5] ^-- TxLog region [type=internal, persistence=true, lazyAlloc=false, [21:10:42] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:10:42] : [Step 4/5] ^-- volatileDsMemPlc region [type=user, persistence=false, lazyAlloc=true, [21:10:42] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB] [21:10:42] : [Step 4/5] ^-- Ignite persistence [used=0MB] [21:10:42] : [Step 4/5] [21:10:42] : [Step 4/5] [2021-11-19 21:10:42,643][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Starting binary memory restore for: [-2100569601, 1613773252] [21:10:42] : [Step 4/5] [2021-11-19 21:10:42,651][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=/opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1/cp/1637345441163-89595c1e-6c38-4010-a61b-1d058c6fd1a2-START.bin, endMarker=/opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1/cp/1637345441163-89595c1e-6c38-4010-a61b-1d058c6fd1a2-END.bin] [21:10:42] : [Step 4/5] [2021-11-19 21:10:42,652][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=86657, len=1963], lastMarked=WALPointer [idx=0, fileOff=86657, len=1963], lastCheckpointId=89595c1e-6c38-4010-a61b-1d058c6fd1a2] [21:10:42] : [Step 4/5] [2021-11-19 21:10:42,654][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Found last checkpoint marker [cpId=89595c1e-6c38-4010-a61b-1d058c6fd1a2, pos=WALPointer [idx=0, fileOff=86657, len=1963]] [21:10:42] : [Step 4/5] [2021-11-19 21:10:42,656][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Binary memory state restored at node startup [restoredPtr=WALPointer [idx=0, fileOff=154439, len=0]] [21:10:42] : [Step 4/5] [2021-11-19 21:10:42,658][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000000.wal, offset=154439, ver=2] [21:10:42] : [Step 4/5] [2021-11-19 21:10:42,660][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Started cache in recovery mode [name=ignite-sys-cache, id=-2100569601, dataRegionName=sysMemPlc, mode=REPLICATED, atomicity=TRANSACTIONAL, backups=2147483647, mvcc=false] [21:10:42] : [Step 4/5] [2021-11-19 21:10:42,662][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:10:42] : [Step 4/5] [2021-11-19 21:10:42,665][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Started cache in recovery mode [name=encrypted, id=1613773252, dataRegionName=default, mode=PARTITIONED, atomicity=ATOMIC, backups=0, mvcc=false] [21:10:42] : [Step 4/5] [2021-11-19 21:10:42,666][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Binary recovery performed in 23 ms. [21:10:42] : [Step 4/5] [2021-11-19 21:10:42,666][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=/opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1/cp/1637345441163-89595c1e-6c38-4010-a61b-1d058c6fd1a2-START.bin, endMarker=/opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1/cp/1637345441163-89595c1e-6c38-4010-a61b-1d058c6fd1a2-END.bin] [21:10:42] : [Step 4/5] [2021-11-19 21:10:42,667][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Applying lost cache updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=86657, len=1963], lastCheckpointId=89595c1e-6c38-4010-a61b-1d058c6fd1a2] [21:10:42] : [Step 4/5] [2021-11-19 21:10:42,673][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=62, time=11 ms] [21:10:42] : [Step 4/5] [2021-11-19 21:10:42,673][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Restoring partition state for local groups. [21:10:42] : [Step 4/5] [2021-11-19 21:10:42,683][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=2, partitionsProcessed=108, time=10ms] [21:10:43] : [Step 4/5] [2021-11-19 21:10:43,245][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][TestTcpDiscoverySpi] Successfully bound to TCP port [port=47501, localHost=localhost/127.0.0.1, locNodeId=105c4cc6-a359-4c94-9c58-18620855c001] [21:10:43] : [Step 4/5] [2021-11-19 21:10:43,247][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][GridEncryptionManager] Sending stored group keys to coordinator [grps=1613773252] [21:10:43] : [Step 4/5] [2021-11-19 21:10:43,252][INFO ][tcp-disco-srvr-[:47500]-#1079%grid-0%-#20611%grid-0%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=46355] [21:10:43] : [Step 4/5] [2021-11-19 21:10:43,253][INFO ][tcp-disco-srvr-[:47500]-#1079%grid-0%-#20611%grid-0%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=46355] [21:10:43] : [Step 4/5] [2021-11-19 21:10:43,253][INFO ][tcp-disco-sock-reader-[]-#1094%grid-0%-#20887%grid-0%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:46355, rmtPort=46355] [21:10:43] : [Step 4/5] [2021-11-19 21:10:43,255][INFO ][tcp-disco-sock-reader-[105c4cc6 127.0.0.1:46355]-#1094%grid-0%-#20887%grid-0%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=105c4cc6-a359-4c94-9c58-18620855c001, rmtAddr=/127.0.0.1:46355] [21:10:43] : [Step 4/5] [2021-11-19 21:10:43,259][INFO ][tcp-disco-srvr-[:47501]-#1093%grid-1%-#20886%grid-1%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=33135] [21:10:43] : [Step 4/5] [2021-11-19 21:10:43,259][INFO ][tcp-disco-srvr-[:47501]-#1093%grid-1%-#20886%grid-1%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=33135] [21:10:43] : [Step 4/5] [2021-11-19 21:10:43,259][INFO ][tcp-disco-sock-reader-[]-#1095%grid-1%-#20888%grid-1%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:33135, rmtPort=33135] [21:10:43] : [Step 4/5] [2021-11-19 21:10:43,260][INFO ][tcp-disco-sock-reader-[]-#1095%grid-1%-#20888%grid-1%][TestTcpDiscoverySpi] Received ping request from the remote node [rmtNodeId=003cf075-28f9-4b6c-920d-99b2dcc37000, rmtAddr=/127.0.0.1:33135, rmtPort=33135] [21:10:43] : [Step 4/5] [2021-11-19 21:10:43,262][INFO ][tcp-disco-sock-reader-[]-#1095%grid-1%-#20888%grid-1%][TestTcpDiscoverySpi] Finished writing ping response [rmtNodeId=003cf075-28f9-4b6c-920d-99b2dcc37000, rmtAddr=/127.0.0.1:33135, rmtPort=33135] [21:10:43] : [Step 4/5] [2021-11-19 21:10:43,262][INFO ][tcp-disco-sock-reader-[105c4cc6 127.0.0.1:46355]-#1094%grid-0%-#20887%grid-0%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:46355, rmtPort=46355, rmtNodeId=105c4cc6-a359-4c94-9c58-18620855c001] [21:10:43] : [Step 4/5] [2021-11-19 21:10:43,262][INFO ][tcp-disco-sock-reader-[]-#1095%grid-1%-#20888%grid-1%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:33135, rmtPort=33135, rmtNodeId=null] [21:10:43] : [Step 4/5] [2021-11-19 21:10:43,273][INFO ][tcp-disco-msg-worker-[crd]-#1078%grid-0%-#20610%grid-0%][TestTcpDiscoverySpi] New next node [newNext=TcpDiscoveryNode [id=105c4cc6-a359-4c94-9c58-18620855c001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=0, intOrder=3, lastExchangeTime=1637345443257, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false]] [21:10:43] : [Step 4/5] [2021-11-19 21:10:43,273][INFO ][tcp-disco-srvr-[:47501]-#1093%grid-1%-#20886%grid-1%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=60179] [21:10:43] : [Step 4/5] [2021-11-19 21:10:43,274][INFO ][tcp-disco-srvr-[:47501]-#1093%grid-1%-#20886%grid-1%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=60179] [21:10:43] : [Step 4/5] [2021-11-19 21:10:43,274][INFO ][tcp-disco-sock-reader-[]-#1096%grid-1%-#20889%grid-1%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:60179, rmtPort=60179] [21:10:43] : [Step 4/5] [2021-11-19 21:10:43,275][INFO ][tcp-disco-sock-reader-[003cf075 127.0.0.1:60179]-#1096%grid-1%-#20889%grid-1%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=003cf075-28f9-4b6c-920d-99b2dcc37000, rmtAddr=/127.0.0.1:60179] [21:10:43] : [Step 4/5] [2021-11-19 21:10:43,279][INFO ][tcp-disco-msg-worker-[]-#1092%grid-1%-#20885%grid-1%][TestTcpDiscoverySpi] New next node [newNext=TcpDiscoveryNode [id=003cf075-28f9-4b6c-920d-99b2dcc37000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345443267, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false]] [21:10:43] : [Step 4/5] [2021-11-19 21:10:43,280][INFO ][tcp-disco-srvr-[:47500]-#1079%grid-0%-#20611%grid-0%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=43015] [21:10:43] : [Step 4/5] [2021-11-19 21:10:43,280][INFO ][tcp-disco-srvr-[:47500]-#1079%grid-0%-#20611%grid-0%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=43015] [21:10:43] : [Step 4/5] [2021-11-19 21:10:43,281][INFO ][tcp-disco-sock-reader-[]-#1097%grid-0%-#20890%grid-0%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:43015, rmtPort=43015] [21:10:43] : [Step 4/5] [2021-11-19 21:10:43,282][INFO ][tcp-disco-sock-reader-[105c4cc6 127.0.0.1:43015]-#1097%grid-0%-#20890%grid-0%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=105c4cc6-a359-4c94-9c58-18620855c001, rmtAddr=/127.0.0.1:43015] [21:10:43] : [Step 4/5] [2021-11-19 21:10:43,286][INFO ][disco-event-worker-#20613%grid-0%][GridDiscoveryManager] Added new node to topology: TcpDiscoveryNode [id=105c4cc6-a359-4c94-9c58-18620855c001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=4, intOrder=3, lastExchangeTime=1637345443257, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false] [21:10:43] : [Step 4/5] [2021-11-19 21:10:43,287][INFO ][disco-event-worker-#20613%grid-0%][GridDiscoveryManager] Topology snapshot [ver=4, locNode=003cf075, servers=2, clients=0, state=ACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=003cf075-28f9-4b6c-920d-99b2dcc37000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=105c4cc6-a359-4c94-9c58-18620855c001, consistentId=grid-1, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:10:43] : [Step 4/5] [2021-11-19 21:10:43,288][INFO ][disco-event-worker-#20613%grid-0%][GridDiscoveryManager] ^-- Baseline [id=0, size=2, online=2, offline=0] [21:10:43] : [Step 4/5] [2021-11-19 21:10:43,288][INFO ][exchange-worker-#20614%grid-0%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], crd=true, evt=NODE_JOINED, evtNode=105c4cc6-a359-4c94-9c58-18620855c001, customEvt=null, allowMerge=true, exchangeFreeSwitch=false] [21:10:43] : [Step 4/5] [2021-11-19 21:10:43,289][INFO ][exchange-worker-#20614%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], waitTime=0ms, futInfo=NA, mode=DISTRIBUTED] [21:10:43] : [Step 4/5] [2021-11-19 21:10:43,290][INFO ][exchange-worker-#20614%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partitions release latch: ServerLatch [permits=0, pendingAcks=HashSet [], super=CompletableLatch [id=CompletableLatchUid [id=exchange, topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0]]]] [21:10:43] : [Step 4/5] [2021-11-19 21:10:43,291][INFO ][exchange-worker-#20614%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:10:43] : [Step 4/5] [2021-11-19 21:10:43,291][INFO ][tcp-disco-msg-worker-[003cf075 127.0.0.1:47500]-#1092%grid-1%-#20885%grid-1%][GridEncryptionManager] Store group key received from coordinator [grp=1613773252, keyId=1] [21:10:43] : [Step 4/5] [2021-11-19 21:10:43,291][INFO ][exchange-worker-#20614%grid-0%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], crd=true] [21:10:43] : [Step 4/5] [2021-11-19 21:10:43,292][INFO ][disco-notifier-worker-#20884%grid-1%][MvccProcessorImpl] Assigned mvcc coordinator [crd=MvccCoordinator [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], nodeId=003cf075-28f9-4b6c-920d-99b2dcc37000, ver=1637345439917, local=false, initialized=false]] [21:10:43] : [Step 4/5] [2021-11-19 21:10:43,293][INFO ][sys-#20867%grid-1%][ClusterProcessor] Writing cluster ID and tag to metastorage on ready for write ClusterIdAndTag [id=4d3cbeac-e0b5-419f-89b7-16229c34ade1, tag=focused_euler] [21:10:43] : [Step 4/5] [2021-11-19 21:10:43,308][INFO ][exchange-worker-#20893%grid-1%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], crd=false, evt=NODE_JOINED, evtNode=105c4cc6-a359-4c94-9c58-18620855c001, customEvt=null, allowMerge=true, exchangeFreeSwitch=false] [21:10:43] : [Step 4/5] [2021-11-19 21:10:43,308][INFO ][exchange-worker-#20893%grid-1%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1 [21:10:43] : [Step 4/5] [2021-11-19 21:10:43,310][INFO ][exchange-worker-#20893%grid-1%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000000.wal, offset=210270, ver=2] [21:10:43] : [Step 4/5] [2021-11-19 21:10:43,313][INFO ][exchange-worker-#20893%grid-1%][GridClusterStateProcessor] Writing BaselineTopology[id=0] [21:10:43] : [Step 4/5] [2021-11-19 21:10:43,315][INFO ][exchange-worker-#20893%grid-1%][GridCacheDatabaseSharedManager] Finish recovery performed in 6 ms. [21:10:43] : [Step 4/5] [2021-11-19 21:10:43,316][INFO ][exchange-worker-#20893%grid-1%][msg] Components activation performed in 8 ms. [21:10:43] : [Step 4/5] [2021-11-19 21:10:43,317][INFO ][exchange-worker-#20893%grid-1%][GridCacheProcessor] Finished recovery for cache [cache=ignite-sys-cache, grp=ignite-sys-cache, startVer=AffinityTopologyVersion [topVer=4, minorTopVer=0]] [21:10:43] : [Step 4/5] [2021-11-19 21:10:43,317][INFO ][sys-#20863%grid-1%][GridCacheProcessor] Finished recovery for cache [cache=encrypted, grp=encrypted, startVer=AffinityTopologyVersion [topVer=4, minorTopVer=0]] [21:10:43] : [Step 4/5] [2021-11-19 21:10:43,318][INFO ][exchange-worker-#20893%grid-1%][GridCacheProcessor] Starting caches on local join performed in 0 ms. [21:10:43] : [Step 4/5] [2021-11-19 21:10:43,318][INFO ][exchange-worker-#20893%grid-1%][GridDhtPartitionsExchangeFuture] Skipped waiting for partitions release future (local node is joining) [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0]] [21:10:43] : [Step 4/5] [2021-11-19 21:10:43,325][INFO ][grid-nio-worker-tcp-comm-1-#20553%TestRecordingCommunicationSpi%][TestRecordingCommunicationSpi] Accepted incoming communication connection [locAddr=/127.0.0.1:47100, rmtAddr=/127.0.0.1:33046] [21:10:43] : [Step 4/5] [2021-11-19 21:10:43,329][INFO ][grid-nio-worker-tcp-comm-0-#20826%TestRecordingCommunicationSpi%][TestRecordingCommunicationSpi] Established outgoing communication connection [locAddr=/127.0.0.1:33046, rmtAddr=/127.0.0.1:47100] [21:10:43] : [Step 4/5] [2021-11-19 21:10:43,330][INFO ][exchange-worker-#20893%grid-1%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], crd=false] [21:10:43] : [Step 4/5] [2021-11-19 21:10:43,331][INFO ][sys-#20590%grid-0%][GridDhtPartitionsExchangeFuture] Coordinator received single message [ver=AffinityTopologyVersion [topVer=4, minorTopVer=0], node=105c4cc6-a359-4c94-9c58-18620855c001, allReceived=true] [21:10:43] : [Step 4/5] [2021-11-19 21:10:43,332][INFO ][sys-#20590%grid-0%][GridDhtPartitionsExchangeFuture] Coordinator received all messages, try merge [ver=AffinityTopologyVersion [topVer=4, minorTopVer=0]] [21:10:43] : [Step 4/5] [2021-11-19 21:10:43,332][INFO ][sys-#20590%grid-0%][GridDhtPartitionsExchangeFuture] finishExchangeOnCoordinator [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=0]] [21:10:43] : [Step 4/5] [2021-11-19 21:10:43,336][INFO ][db-checkpoint-thread-#20898%grid-1%][Checkpointer] Checkpoint started [checkpointId=36898be6-d871-4aa1-aab5-ac6525f82714, startPtr=WALPointer [idx=0, fileOff=315430, len=2064], checkpointBeforeLockTime=2ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=1ms, checkpointLockHoldTime=2ms, walCpRecordFsyncDuration=3ms, writeCheckpointEntryDuration=9ms, splitAndSortCpPagesDuration=0ms, pages=72, reason='node started'] [21:10:43] : [Step 4/5] [2021-11-19 21:10:43,337][INFO ][sys-#20590%grid-0%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], err=null, rebalanced=false, wasRebalanced=true] [21:10:43] : [Step 4/5] [2021-11-19 21:10:43,339][INFO ][exchange-worker-#20614%grid-0%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=4, minorTopVer=0], force=false, evt=NODE_JOINED, node=105c4cc6-a359-4c94-9c58-18620855c001] [21:10:43] : [Step 4/5] [2021-11-19 21:10:43,339][INFO ][sys-#20879%grid-1%][GridDhtPartitionsExchangeFuture] Received full message, will finish exchange [node=003cf075-28f9-4b6c-920d-99b2dcc37000, resVer=AffinityTopologyVersion [topVer=4, minorTopVer=0]] [21:10:43] : [Step 4/5] [2021-11-19 21:10:43,339][INFO ][sys-#20590%grid-0%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=003cf075-28f9-4b6c-920d-99b2dcc37000, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], evt=NODE_JOINED, evtNode=TcpDiscoveryNode [id=105c4cc6-a359-4c94-9c58-18620855c001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=4, intOrder=3, lastExchangeTime=1637345443257, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=false, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0]] [21:10:43] : [Step 4/5] [2021-11-19 21:10:43,346][INFO ][sys-#20879%grid-1%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], err=null, rebalanced=false, wasRebalanced=false] [21:10:43] : [Step 4/5] [2021-11-19 21:10:43,349][INFO ][sys-#20590%grid-0%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (0 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Wait partitions release latch [latch=exchange]" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="After states restored callback" (0 ms), stage="WAL history reservation" (0 ms), stage="Waiting for all single messages" (40 ms), stage="Exchanges merge" (0 ms), stage="Affinity recalculation (crd)" (1 ms), stage="Collect update counters and create affinity messages" (0 ms), stage="Assign partitions states" (0 ms), stage="Validate partitions states" (0 ms), stage="Apply update counters" (0 ms), stage="Full message preparing" (2 ms), stage="Full message sending" (0 ms), stage="Exchange done" (10 ms), stage="Total time" (53 ms), Discovery lag=5 ms, Latest started node id=105c4cc6-a359-4c94-9c58-18620855c001] [21:10:43] : [Step 4/5] [2021-11-19 21:10:43,350][INFO ][sys-#20879%grid-1%][GridCacheProcessor] Finish proxy initialization, cacheName=ignite-sys-cache, localNodeId=105c4cc6-a359-4c94-9c58-18620855c001 [21:10:43] : [Step 4/5] [2021-11-19 21:10:43,351][INFO ][sys-#20590%grid-0%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], stage="Affinity initialization (node join) [grp=ignite-sys-cache, crd=true]" (1 ms) (parent=Affinity recalculation (crd)), stage="Affinity initialization (node join) [grp=encrypted, crd=true]" (0 ms) (parent=Affinity recalculation (crd))] [21:10:43] : [Step 4/5] [2021-11-19 21:10:43,352][INFO ][sys-#20879%grid-1%][GridCacheProcessor] Finish proxy initialization, cacheName=encrypted, localNodeId=105c4cc6-a359-4c94-9c58-18620855c001 [21:10:43] : [Step 4/5] [2021-11-19 21:10:43,353][INFO ][sys-#20879%grid-1%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=105c4cc6-a359-4c94-9c58-18620855c001, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], evt=NODE_JOINED, evtNode=TcpDiscoveryNode [id=105c4cc6-a359-4c94-9c58-18620855c001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=4, intOrder=3, lastExchangeTime=1637345443288, loc=true, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=false, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0]] [21:10:43] : [Step 4/5] [2021-11-19 21:10:43,353][INFO ][exchange-worker-#20893%grid-1%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=4, minorTopVer=0], force=false, evt=NODE_JOINED, node=105c4cc6-a359-4c94-9c58-18620855c001] [21:10:43] : [Step 4/5] [2021-11-19 21:10:43,354][INFO ][sys-#20879%grid-1%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], stage="Waiting in exchange queue" (14 ms), stage="Exchange parameters initialization" (0 ms), stage="Components activation" (8 ms), stage="Determine exchange type" (1 ms), stage="Preloading notification" (0 ms), stage="Restore partition states" (0 ms), stage="After states restored callback" (4 ms), stage="WAL history reservation" (0 ms), stage="Waiting for Full message" (16 ms), stage="Affinity recalculation" (2 ms), stage="Full map updating" (4 ms), stage="Exchange done" (8 ms), stage="Total time" (57 ms)] [21:10:43] : [Step 4/5] [2021-11-19 21:10:43,356][INFO ][sys-#20879%grid-1%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], stage="Affinity fetch" (1 ms) (parent=Determine exchange type), stage="Restore partition states [grp=ignite-sys-cache]" (0 ms) (parent=Restore partition states), stage="Restore partition states [grp=encrypted]" (0 ms) (parent=Restore partition states), stage="Affinity initialization (local join) [grp=ignite-sys-cache]" (2 ms) (parent=Affinity recalculation), stage="Affinity initialization (local join) [grp=encrypted]" (2 ms) (parent=Affinity recalculation)] [21:10:43] : [Step 4/5] [2021-11-19 21:10:43,361][INFO ][exchange-worker-#20614%grid-0%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], crd=true, evt=DISCOVERY_CUSTOM_EVT, evtNode=003cf075-28f9-4b6c-920d-99b2dcc37000, customEvt=CacheAffinityChangeMessage [id=4cf7d593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], exchId=null, partsMsg=null, exchangeNeeded=true], allowMerge=false, exchangeFreeSwitch=false] [21:10:43] : [Step 4/5] [2021-11-19 21:10:43,363][INFO ][exchange-worker-#20893%grid-1%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], crd=false, evt=DISCOVERY_CUSTOM_EVT, evtNode=003cf075-28f9-4b6c-920d-99b2dcc37000, customEvt=CacheAffinityChangeMessage [id=4cf7d593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], exchId=null, partsMsg=null, exchangeNeeded=true], allowMerge=false, exchangeFreeSwitch=false] [21:10:43] : [Step 4/5] [2021-11-19 21:10:43,362][INFO ][reencrypt-#20909%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:10:43] : [Step 4/5] [2021-11-19 21:10:43,361][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] To start Console Management & Monitoring run ignitevisorcmd.{sh|bat} [21:10:43] : [Step 4/5] [2021-11-19 21:10:43,364][INFO ][exchange-worker-#20893%grid-1%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], waitTime=0ms, futInfo=NA, mode=DISTRIBUTED] [21:10:43] : [Step 4/5] [2021-11-19 21:10:43,364][INFO ][exchange-worker-#20614%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], waitTime=0ms, futInfo=NA, mode=DISTRIBUTED] [21:10:43] : [Step 4/5] [2021-11-19 21:10:43,365][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] [21:10:43] : [Step 4/5] [21:10:43] : [Step 4/5] >>> +-------------------------------------------+ [21:10:43] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:10:43] : [Step 4/5] >>> +-------------------------------------------+ [21:10:43] : [Step 4/5] >>> OS name: Linux 4.15.0-151-generic amd64 [21:10:43] : [Step 4/5] >>> CPU(s): 24 [21:10:43] : [Step 4/5] >>> Heap: 2.0GB [21:10:43] : [Step 4/5] >>> VM name: 16724@c4dfe9a430b2 [21:10:43] : [Step 4/5] >>> Ignite instance name: grid-1 [21:10:43] : [Step 4/5] >>> Local node [ID=105C4CC6-A359-4C94-9C58-18620855C001, order=4, clientMode=false] [21:10:43] : [Step 4/5] >>> Local node addresses: [127.0.0.1] [21:10:43] : [Step 4/5] >>> Local ports: TCP:10801 TCP:47101 TCP:47501 [21:10:43] : [Step 4/5] [21:10:43] : [Step 4/5] [2021-11-19 21:10:43,366][INFO ][exchange-worker-#20893%grid-1%][GridDhtPartitionsExchangeFuture] Finished waiting for partitions release latch: ClientLatch [coordinator=TcpDiscoveryNode [id=003cf075-28f9-4b6c-920d-99b2dcc37000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345443267, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], ackSent=true, super=CompletableLatch [id=CompletableLatchUid [id=exchange, topVer=AffinityTopologyVersion [topVer=4, minorTopVer=1]]]] [21:10:43] : [Step 4/5] [2021-11-19 21:10:43,366][INFO ][exchange-worker-#20614%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partitions release latch: ServerLatch [permits=0, pendingAcks=HashSet [], super=CompletableLatch [id=CompletableLatchUid [id=exchange, topVer=AffinityTopologyVersion [topVer=4, minorTopVer=1]]]] [21:10:43] : [Step 4/5] [2021-11-19 21:10:43,368][INFO ][exchange-worker-#20614%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:10:43] : [Step 4/5] [2021-11-19 21:10:43,367][INFO ][exchange-worker-#20893%grid-1%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:10:43] : [Step 4/5] [2021-11-19 21:10:43,367][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][GridDiscoveryManager] Topology snapshot [ver=4, locNode=105c4cc6, servers=2, clients=0, state=ACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=003cf075-28f9-4b6c-920d-99b2dcc37000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=105c4cc6-a359-4c94-9c58-18620855c001, consistentId=grid-1, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:10:43] : [Step 4/5] [2021-11-19 21:10:43,370][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][GridDiscoveryManager] ^-- Baseline [id=0, size=2, online=2, offline=0] [21:10:43] : [Step 4/5] [2021-11-19 21:10:43,370][INFO ][exchange-worker-#20893%grid-1%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], crd=false] [21:10:43] : [Step 4/5] [2021-11-19 21:10:43,369][INFO ][exchange-worker-#20614%grid-0%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], crd=true] [21:10:43] : [Step 4/5] [2021-11-19 21:10:43,371][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][G] Node started : [stage="Configure system pool" (0 ms),stage="Start managers" (211 ms),stage="Configure binary metadata" (1 ms),stage="Start processors" (146 ms),stage="Start 'StanByClusterTestProvider' plugin" (0 ms),stage="Start 'PageMemory tracker plugin' plugin" (0 ms),stage="Start 'TestDistibutedConfigurationPlugin' plugin" (0 ms),stage="Start 'NodeValidationPluginProvider' plugin" (0 ms),stage="Init metastore" (125 ms),stage="Init and start regions" (5 ms),stage="Restore binary memory" (22 ms),stage="Restore logical state" (16 ms),stage="Finish recovery" (560 ms),stage="Join topology" (48 ms),stage="Await transition" (2 ms),stage="Await exchange" (76 ms),stage="Total time" (1212 ms)] [21:10:43] : [Step 4/5] [2021-11-19 21:10:43,370][INFO ][sys-#20591%grid-0%][GridDhtPartitionsExchangeFuture] Coordinator received single message [ver=AffinityTopologyVersion [topVer=4, minorTopVer=1], node=105c4cc6-a359-4c94-9c58-18620855c001, allReceived=true] [21:10:43] : [Step 4/5] [2021-11-19 21:10:43,374][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][root] Node started with the following configuration [id=105c4cc6-a359-4c94-9c58-18620855c001, marshaller=BinaryMarshaller [], discovery=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=5000, ackTimeout=5000, marsh=JdkMarshaller [clsFilter=org.apache.ignite.marshaller.MarshallerUtils$1@4360c522], reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], binaryCfg=null, lateAff=true] [21:10:43] : [Step 4/5] [2021-11-19 21:10:43,374][INFO ][sys-#20591%grid-0%][GridDhtPartitionsExchangeFuture] finishExchangeOnCoordinator [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=1]] [21:10:43] : [Step 4/5] [2021-11-19 21:10:43,378][INFO ][sys-#20591%grid-0%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], err=null, rebalanced=true, wasRebalanced=false] [21:10:43] : [Step 4/5] [2021-11-19 21:10:43,379][INFO ][sys-#20867%grid-1%][GridDhtPartitionsExchangeFuture] Received full message, will finish exchange [node=003cf075-28f9-4b6c-920d-99b2dcc37000, resVer=AffinityTopologyVersion [topVer=4, minorTopVer=1]] [21:10:43] : [Step 4/5] [2021-11-19 21:10:43,379][INFO ][exchange-worker-#20614%grid-0%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=4, minorTopVer=1], force=false, evt=DISCOVERY_CUSTOM_EVT, node=003cf075-28f9-4b6c-920d-99b2dcc37000] [21:10:43] : [Step 4/5] [2021-11-19 21:10:43,379][INFO ][sys-#20591%grid-0%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=003cf075-28f9-4b6c-920d-99b2dcc37000, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=003cf075-28f9-4b6c-920d-99b2dcc37000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345443360, loc=true, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=4, minorTopVer=1]] [21:10:43] : [Step 4/5] [2021-11-19 21:10:43,382][INFO ][sys-#20867%grid-1%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], err=null, rebalanced=true, wasRebalanced=false] [21:10:43] : [Step 4/5] [2021-11-19 21:10:43,386][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=105c4cc6-a359-4c94-9c58-18620855c001, grp=1613773252] [21:10:43] : [Step 4/5] [2021-11-19 21:10:43,385][INFO ][sys-#20591%grid-0%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (2 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (1 ms), stage="Wait partitions release latch [latch=exchange]" (2 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="After states restored callback" (0 ms), stage="WAL history reservation" (0 ms), stage="Waiting for all single messages" (5 ms), stage="Affinity recalculation (crd)" (1 ms), stage="Collect update counters and create affinity messages" (0 ms), stage="Validate partitions states" (0 ms), stage="Apply update counters" (0 ms), stage="Full message preparing" (2 ms), stage="Full message sending" (0 ms), stage="Exchange done" (6 ms), stage="Total time" (19 ms), Discovery lag=1 ms, Latest started node id=105c4cc6-a359-4c94-9c58-18620855c001] [21:10:43] : [Step 4/5] [2021-11-19 21:10:43,387][INFO ][sys-#20867%grid-1%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=105c4cc6-a359-4c94-9c58-18620855c001, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=003cf075-28f9-4b6c-920d-99b2dcc37000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345443267, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=4, minorTopVer=1]] [21:10:43] : [Step 4/5] [2021-11-19 21:10:43,387][INFO ][exchange-worker-#20893%grid-1%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=4, minorTopVer=1], force=false, evt=DISCOVERY_CUSTOM_EVT, node=003cf075-28f9-4b6c-920d-99b2dcc37000] [21:10:43] : [Step 4/5] [2021-11-19 21:10:43,391][INFO ][sys-#20867%grid-1%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (2 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Wait partitions release latch [latch=exchange]" (2 ms), stage="Wait partitions release [latch=exchange]" (1 ms), stage="After states restored callback" (0 ms), stage="WAL history reservation" (0 ms), stage="Waiting for Full message" (9 ms), stage="Affinity recalculation" (0 ms), stage="Full map updating" (2 ms), stage="Exchange done" (8 ms), stage="Total time" (24 ms)] [21:10:43] : [Step 4/5] [2021-11-19 21:10:43,389][INFO ][sys-#20591%grid-0%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], stage="Affinity change by custom message [grp=ignite-sys-cache]" (0 ms) (parent=Determine exchange type)] [21:10:43] : [Step 4/5] [2021-11-19 21:10:43,393][INFO ][sys-#20867%grid-1%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], stage="Affinity change by custom message [grp=ignite-sys-cache]" (0 ms) (parent=Determine exchange type)] [21:10:43] : [Step 4/5] [2021-11-19 21:10:43,946][INFO ][db-checkpoint-thread-#20898%grid-1%][Checkpointer] Checkpoint finished [cpId=36898be6-d871-4aa1-aab5-ac6525f82714, pages=72, markPos=WALPointer [idx=0, fileOff=315430, len=2064], walSegmentsCovered=[], markDuration=16ms, pagesWrite=15ms, fsync=594ms, total=627ms] [21:10:44] : [Step 4/5] [2021-11-19 21:10:44,379][INFO ][db-checkpoint-thread-#20898%grid-1%][Checkpointer] Checkpoint started [checkpointId=475a6642-a070-4860-b190-25ddd977c042, startPtr=WALPointer [idx=0, fileOff=526508, len=2048], checkpointBeforeLockTime=3ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=19ms, writeCheckpointEntryDuration=410ms, splitAndSortCpPagesDuration=0ms, pages=50, reason='test'] [21:10:44] : [Step 4/5] [2021-11-19 21:10:44,902][INFO ][db-checkpoint-thread-#20898%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:10:44] : [Step 4/5] [2021-11-19 21:10:44,903][INFO ][db-checkpoint-thread-#20898%grid-1%][Checkpointer] Checkpoint finished [cpId=475a6642-a070-4860-b190-25ddd977c042, pages=50, markPos=WALPointer [idx=0, fileOff=526508, len=2048], walSegmentsCovered=[], markDuration=430ms, pagesWrite=3ms, fsync=521ms, total=957ms] [21:10:44] : [Step 4/5] [2021-11-19 21:10:44,910][INFO ][test-runner-#20497%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=003cf075-28f9-4b6c-920d-99b2dcc37000, grp=1613773252] [21:10:44] : [Step 4/5] [2021-11-19 21:10:44,922][INFO ][db-checkpoint-thread-#20748%grid-0%][Checkpointer] Checkpoint started [checkpointId=c2c4c0b5-3281-4860-9d63-25650eb31fe9, startPtr=WALPointer [idx=0, fileOff=158707, len=2010], checkpointBeforeLockTime=3ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=3ms, checkpointLockHoldTime=5ms, walCpRecordFsyncDuration=0ms, writeCheckpointEntryDuration=2ms, splitAndSortCpPagesDuration=0ms, pages=43, reason='test'] [21:10:44] : [Step 4/5] [2021-11-19 21:10:44,981][INFO ][db-checkpoint-thread-#20748%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:10:44] : [Step 4/5] [2021-11-19 21:10:44,982][INFO ][db-checkpoint-thread-#20748%grid-0%][Checkpointer] Checkpoint finished [cpId=c2c4c0b5-3281-4860-9d63-25650eb31fe9, pages=43, markPos=WALPointer [idx=0, fileOff=158707, len=2010], walSegmentsCovered=[], markDuration=8ms, pagesWrite=4ms, fsync=56ms, total=71ms] [21:10:44] : [Step 4/5] [21:10:44] >>> Stopping test: CacheGroupKeyChangeTest#testNotAllBltNodesPresent in 5754 ms <<< [21:10:44] : [Step 4/5] [2021-11-19 21:10:44,983][INFO ][main][root] >>> Stopping test: CacheGroupKeyChangeTest#testNotAllBltNodesPresent in 5754 ms <<< [21:10:44] : [Step 4/5] [21:10:44] >>> Heap: 261 MB used / 1940 MB commited / 1940 MB max <<< [21:10:44] : [Step 4/5] [2021-11-19 21:10:44,984][INFO ][main][root] >>> Heap: 261 MB used / 1940 MB commited / 1940 MB max <<< [21:10:44] : [Step 4/5] [21:10:44] >>> Non-Heap: 158 MB used / 183 MB commited / 0 MB max <<< [21:10:44] : [Step 4/5] [2021-11-19 21:10:44,984][INFO ][main][root] >>> Non-Heap: 158 MB used / 183 MB commited / 0 MB max <<< [21:10:44] : [Step 4/5] [2021-11-19 21:10:44,984][INFO ][main][root] >>> Stopping grid [name=grid-1, id=105c4cc6-a359-4c94-9c58-18620855c001] [21:10:44] : [Step 4/5] [2021-11-19 21:10:44,993][INFO ][db-checkpoint-thread-#20898%grid-1%][Checkpointer] Skipping checkpoint (no pages were modified) [checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=1ms, reason='timeout'] [21:10:44] : [Step 4/5] [2021-11-19 21:10:44,997][INFO ][tcp-disco-sock-reader-[003cf075 127.0.0.1:60179]-#1096%grid-1%-#20889%grid-1%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:60179, rmtPort=60179, rmtNodeId=003cf075-28f9-4b6c-920d-99b2dcc37000] [21:10:45] : [Step 4/5] [2021-11-19 21:10:44,998][INFO ][disco-event-worker-#20613%grid-0%][GridDiscoveryManager] Node left topology: TcpDiscoveryNode [id=105c4cc6-a359-4c94-9c58-18620855c001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=4, intOrder=3, lastExchangeTime=1637345443257, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false] [21:10:45] : [Step 4/5] [2021-11-19 21:10:45,000][INFO ][main][GridCacheProcessor] Stopped cache [cacheName=encrypted] [21:10:45] : [Step 4/5] [2021-11-19 21:10:45,000][INFO ][disco-event-worker-#20613%grid-0%][GridDiscoveryManager] Topology snapshot [ver=5, locNode=003cf075, servers=1, clients=0, state=ACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=003cf075-28f9-4b6c-920d-99b2dcc37000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:10:45] : [Step 4/5] [2021-11-19 21:10:45,001][INFO ][disco-event-worker-#20613%grid-0%][GridDiscoveryManager] ^-- Baseline [id=0, size=2, online=1, offline=1] [21:10:45] : [Step 4/5] [2021-11-19 21:10:45,001][INFO ][main][GridCacheProcessor] Stopped cache [cacheName=ignite-sys-cache] [21:10:45] : [Step 4/5] [2021-11-19 21:10:45,003][INFO ][exchange-worker-#20614%grid-0%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], crd=true, evt=NODE_LEFT, evtNode=105c4cc6-a359-4c94-9c58-18620855c001, customEvt=null, allowMerge=false, exchangeFreeSwitch=true] [21:10:45] : [Step 4/5] [2021-11-19 21:10:45,006][INFO ][exchange-worker-#20614%grid-0%][GridAffinityAssignmentCache] Local node affinity assignment distribution is not ideal [cache=encrypted, expectedPrimary=8.00, actualPrimary=3, expectedBackups=0.00, actualBackups=0, warningThreshold=50.00%] [21:10:45] : [Step 4/5] [2021-11-19 21:10:45,006][INFO ][main][FilePageStoreManager] Cleanup cache stores [total=4, left=0, cleanFiles=false] [21:10:45] : [Step 4/5] [2021-11-19 21:10:45,006][INFO ][exchange-worker-#20614%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:10:45] : [Step 4/5] [2021-11-19 21:10:45,008][INFO ][main][GridDeploymentLocalStore] Removed undeployed class: GridDeployment [ts=1637345443329, depMode=SHARED, clsLdr=IsolatedClassLoader{roleName='test'}, clsLdrId=2cf7d593d71-105c4cc6-a359-4c94-9c58-18620855c001, userVer=0, loc=true, sampleClsName=org.apache.ignite.internal.processors.cache.distributed.dht.preloader.IgniteDhtPartitionsToReloadMap, pendingUndeploy=false, undeployed=true, usage=0] [21:10:45] : [Step 4/5] [2021-11-19 21:10:45,008][INFO ][exchange-worker-#20614%grid-0%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], err=null, rebalanced=true, wasRebalanced=true] [21:10:45] : [Step 4/5] [2021-11-19 21:10:45,016][INFO ][exchange-worker-#20614%grid-0%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=003cf075-28f9-4b6c-920d-99b2dcc37000, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], evt=NODE_LEFT, evtNode=TcpDiscoveryNode [id=105c4cc6-a359-4c94-9c58-18620855c001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=4, intOrder=3, lastExchangeTime=1637345443257, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=5, minorTopVer=0]] [21:10:45] : [Step 4/5] [2021-11-19 21:10:45,018][INFO ][exchange-worker-#20614%grid-0%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (2 ms), stage="Determine exchange type" (1 ms), stage="Preloading notification" (0 ms), stage="After states restored callback" (1 ms), stage="WAL history reservation" (0 ms), stage="Finalize update counters" (0 ms), stage="Detect lost partitions" (7 ms), stage="Exchange done" (2 ms), stage="Total time" (13 ms)] [21:10:45] : [Step 4/5] [2021-11-19 21:10:45,017][INFO ][main][IgniteKernal%grid-1] [21:10:45] : [Step 4/5] [21:10:45] : [Step 4/5] >>> +------------------------------------------------------+ [21:10:45] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV stopped OK [21:10:45] : [Step 4/5] >>> +------------------------------------------------------+ [21:10:45] : [Step 4/5] >>> Ignite instance name: grid-1 [21:10:45] : [Step 4/5] >>> Grid uptime: 00:00:01.650 [21:10:45] : [Step 4/5] [21:10:45] : [Step 4/5] [21:10:45] : [Step 4/5] [2021-11-19 21:10:45,019][INFO ][exchange-worker-#20614%grid-0%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], stage="Affinity initialization (exchange-free switch on fully-rebalanced topology) [grp=encrypted]" (1 ms) (parent=Determine exchange type), stage="Affinity initialization (exchange-free switch on fully-rebalanced topology) [grp=ignite-sys-cache]" (0 ms) (parent=Determine exchange type)] [21:10:45] : [Step 4/5] [2021-11-19 21:10:45,019][INFO ][main][root] >>> Stopping grid [name=grid-0, id=003cf075-28f9-4b6c-920d-99b2dcc37000] [21:10:45] : [Step 4/5] [2021-11-19 21:10:45,020][INFO ][exchange-worker-#20614%grid-0%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], crd=true] [21:10:45] : [Step 4/5] [2021-11-19 21:10:45,022][INFO ][exchange-worker-#20614%grid-0%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=5, minorTopVer=0], force=false, evt=NODE_LEFT, node=105c4cc6-a359-4c94-9c58-18620855c001] [21:10:45]W: [org.apache.ignite:ignite-core] [2021-11-19 21:10:45,029][WARN ][tcp-disco-sock-reader-[106eda8f 127.0.0.1:34609]-#1088%grid-0%-#20734%grid-0%][TestTcpDiscoverySpi] Failed to shutdown socket [21:10:45]W: [org.apache.ignite:ignite-core] java.net.SocketException: Socket is closed [21:10:45]W: [org.apache.ignite:ignite-core] at java.net.Socket.shutdownOutput(Socket.java:1568) [21:10:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.close(IgniteUtils.java:4247) [21:10:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.discovery.tcp.ServerImpl$SocketReader.body(ServerImpl.java:7370) [21:10:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.IgniteSpiThread.run(IgniteSpiThread.java:58) [21:10:45] : [Step 4/5] [2021-11-19 21:10:45,029][INFO ][tcp-disco-sock-reader-[105c4cc6 127.0.0.1:43015]-#1097%grid-0%-#20890%grid-0%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:43015, rmtPort=43015, rmtNodeId=105c4cc6-a359-4c94-9c58-18620855c001] [21:10:45] : [Step 4/5] [2021-11-19 21:10:45,030][INFO ][tcp-disco-sock-reader-[106eda8f 127.0.0.1:34609]-#1088%grid-0%-#20734%grid-0%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:34609, rmtPort=34609, rmtNodeId=106eda8f-692b-446e-9c0b-11bdc123c001] [21:10:45] : [Step 4/5] [2021-11-19 21:10:45,032][INFO ][main][GridCacheProcessor] Stopped cache [cacheName=ignite-sys-cache] [21:10:45] : [Step 4/5] [2021-11-19 21:10:45,032][INFO ][main][GridCacheProcessor] Stopped cache [cacheName=encrypted] [21:10:45] : [Step 4/5] [2021-11-19 21:10:45,383][INFO ][main][FilePageStoreManager] Cleanup cache stores [total=4, left=0, cleanFiles=false] [21:10:45] : [Step 4/5] [2021-11-19 21:10:45,385][INFO ][main][GridDeploymentLocalStore] Removed undeployed class: GridDeployment [ts=1637345441169, depMode=SHARED, clsLdr=IsolatedClassLoader{roleName='test'}, clsLdrId=28e7d593d71-003cf075-28f9-4b6c-920d-99b2dcc37000, userVer=0, loc=true, sampleClsName=org.apache.ignite.internal.processors.cache.distributed.dht.preloader.GridDhtPartitionMap, pendingUndeploy=false, undeployed=true, usage=0] [21:10:45] : [Step 4/5] [2021-11-19 21:10:45,391][INFO ][main][IgniteKernal%grid-0] [21:10:45] : [Step 4/5] [21:10:45] : [Step 4/5] >>> +------------------------------------------------------+ [21:10:45] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV stopped OK [21:10:45] : [Step 4/5] >>> +------------------------------------------------------+ [21:10:45] : [Step 4/5] >>> Ignite instance name: grid-0 [21:10:45] : [Step 4/5] >>> Grid uptime: 00:00:05.458 [21:10:45] : [Step 4/5] [21:10:45] : [Step 4/5] [21:10:45] : [Step 4/5] [21:10:45] >>> Starting test: CacheGroupKeyChangeTest#testCacheStartSameGroupDuringRotation <<< [21:10:45] : [Step 4/5] [2021-11-19 21:10:45,403][INFO ][main][root] >>> Starting test: CacheGroupKeyChangeTest#testCacheStartSameGroupDuringRotation <<< [21:10:45] : [Step 4/5] [21:10:45] >>> Heap: 265 MB used / 1940 MB commited / 1940 MB max <<< [21:10:45] : [Step 4/5] [2021-11-19 21:10:45,403][INFO ][main][root] >>> Heap: 265 MB used / 1940 MB commited / 1940 MB max <<< [21:10:45] : [Step 4/5] [21:10:45] >>> Non-Heap: 158 MB used / 183 MB commited / 0 MB max <<< [21:10:45] : [Step 4/5] [2021-11-19 21:10:45,403][INFO ][main][root] >>> Non-Heap: 158 MB used / 183 MB commited / 0 MB max <<< [21:10:45]W: [org.apache.ignite:ignite-core] [2021-11-19 21:10:45,413][WARN ][test-runner-#20913%encryption.CacheGroupKeyChangeTest%][G] Ignite work directory is not provided, automatically resolved to: /opt/buildagent/work/7bc1c54bc719b67c/work [21:10:45] : [Step 4/5] [2021-11-19 21:10:45,415][INFO ][test-runner-#20913%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] [21:10:45] : [Step 4/5] [21:10:45] : [Step 4/5] >>> __________ ________________ [21:10:45] : [Step 4/5] >>> / _/ ___/ |/ / _/_ __/ __/ [21:10:45] : [Step 4/5] >>> _/ // (7 7 // / / / / _/ [21:10:45] : [Step 4/5] >>> /___/\___/_/|_/___/ /_/ /___/ [21:10:45] : [Step 4/5] >>> [21:10:45] : [Step 4/5] >>> ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:10:45] : [Step 4/5] >>> 2021 Copyright(C) Apache Software Foundation [21:10:45] : [Step 4/5] >>> [21:10:45] : [Step 4/5] >>> Ignite documentation: http://ignite.apache.org [21:10:45] : [Step 4/5] [21:10:45] : [Step 4/5] [2021-11-19 21:10:45,416][INFO ][test-runner-#20913%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] Config URL: n/a [21:10:45] : [Step 4/5] [2021-11-19 21:10:45,416][INFO ][test-runner-#20913%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] IgniteConfiguration [igniteInstanceName=grid-0, pubPoolSize=24, svcPoolSize=24, callbackPoolSize=24, stripedPoolSize=24, sysPoolSize=24, mgmtPoolSize=4, dataStreamerPoolSize=24, utilityCachePoolSize=24, utilityCacheKeepAliveTime=60000, p2pPoolSize=2, qryPoolSize=24, buildIdxPoolSize=4, igniteHome=/opt/buildagent/work/7bc1c54bc719b67c, igniteWorkDir=/opt/buildagent/work/7bc1c54bc719b67c/work, mbeanSrv=com.sun.jmx.mbeanserver.JmxMBeanServer@6fe85038, nodeId=00245d3d-89f6-46c0-9396-bcd0247bd000, marsh=BinaryMarshaller [], marshLocJobs=false, daemon=false, p2pEnabled=true, netTimeout=10000, netCompressionLevel=1, sndRetryDelay=1000, sndRetryCnt=3, metricsHistSize=10000, metricsUpdateFreq=1000, metricsExpTime=9223372036854775807, discoSpi=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=0, ackTimeout=0, marsh=null, reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], segPlc=STOP, segResolveAttempts=2, waitForSegOnStart=true, allResolversPassReq=true, segChkFreq=10000, commSpi=TcpCommunicationSpi [connectGate=org.apache.ignite.spi.communication.tcp.internal.ConnectGateway@2bc640c6, ctxInitLatch=java.util.concurrent.CountDownLatch@754f6e47[Count = 1], stopping=false, clientPool=null, nioSrvWrapper=null, stateProvider=null], evtSpi=MemoryEventStorageSpi [expireAgeMs=9223372036854775807, expireCnt=10000, filter=null], colSpi=NoopCollisionSpi [], deploySpi=LocalDeploymentSpi [], indexingSpi=org.apache.ignite.spi.indexing.noop.NoopIndexingSpi@22e77ccd, addrRslvr=null, encryptionSpi=org.apache.ignite.spi.encryption.keystore.KeystoreEncryptionSpi@77d87a0f, tracingSpi=org.apache.ignite.spi.tracing.NoopTracingSpi@2faf6789, clientMode=false, rebalanceThreadPoolSize=4, rebalanceTimeout=10000, rebalanceBatchesPrefetchCnt=3, rebalanceThrottle=0, rebalanceBatchSize=524288, txCfg=TransactionConfiguration [txSerEnabled=false, dfltIsolation=REPEATABLE_READ, dfltConcurrency=PESSIMISTIC, dfltTxTimeout=0, txTimeoutOnPartitionMapExchange=0, deadlockTimeout=10000, pessimisticTxLogSize=0, pessimisticTxLogLinger=10000, tmLookupClsName=null, txManagerFactory=null, useJtaSync=false], cacheSanityCheckEnabled=true, discoStartupDelay=60000, deployMode=SHARED, p2pMissedCacheSize=100, locHost=127.0.0.1, timeSrvPortBase=31100, timeSrvPortRange=100, failureDetectionTimeout=10000, sysWorkerBlockedTimeout=null, clientFailureDetectionTimeout=10000, metricsLogFreq=0, connectorCfg=null, odbcCfg=null, warmupClos=null, atomicCfg=AtomicConfiguration [seqReserveSize=1000, cacheMode=PARTITIONED, backups=1, aff=null, grpName=null], classLdr=null, sslCtxFactory=null, platformCfg=null, binaryCfg=null, memCfg=null, pstCfg=null, dsCfg=DataStorageConfiguration [sysRegionInitSize=41943040, sysRegionMaxSize=104857600, pageSize=4096, concLvl=0, dfltDataRegConf=DataRegionConfiguration [name=default, maxSize=104857600, initSize=268435456, swapPath=null, pageEvictionMode=DISABLED, pageReplacementMode=CLOCK, evictionThreshold=0.9, emptyPagesPoolSize=100, metricsEnabled=false, metricsSubIntervalCount=5, metricsRateTimeInterval=60000, persistenceEnabled=true, checkpointPageBufSize=0, lazyMemoryAllocation=true, warmUpCfg=null], dataRegions=null, storagePath=null, checkpointFreq=30000, lockWaitTime=10000, checkpointThreads=4, checkpointWriteOrder=SEQUENTIAL, walHistSize=20, maxWalArchiveSize=20971520, walSegments=10, walSegmentSize=1048576, walPath=db/wal, walArchivePath=db/wal/archive, cdcWalPath=db/wal/cdc, cdcEnabled=false, metricsEnabled=false, walMode=LOG_ONLY, walTlbSize=131072, walBuffSize=0, walFlushFreq=2000, walFsyncDelay=1000, walRecordIterBuffSize=67108864, alwaysWriteFullPages=false, fileIOFactory=org.apache.ignite.internal.processors.cache.persistence.file.AsyncFileIOFactory@55afe02, metricsSubIntervalCnt=5, metricsRateTimeInterval=60000, walAutoArchiveAfterInactivity=-1, walForceArchiveTimeout=-1, writeThrottlingEnabled=false, walCompactionEnabled=false, walCompactionLevel=1, checkpointReadLockTimeout=null, walPageCompression=DISABLED, walPageCompressionLevel=null, dfltWarmUpCfg=null, encCfg=org.apache.ignite.configuration.EncryptionConfiguration@6a0ffb97, defragmentationThreadPoolSize=4, minWalArchiveSize=-1], snapshotPath=snapshots, activeOnStart=true, activeOnStartPropSetFlag=false, autoActivation=true, autoActivationPropSetFlag=false, clusterStateOnStart=null, sqlConnCfg=null, cliConnCfg=ClientConnectorConfiguration [host=null, port=10800, portRange=100, sockSndBufSize=0, sockRcvBufSize=0, tcpNoDelay=true, maxOpenCursorsPerConn=128, threadPoolSize=24, selectorCnt=12, idleTimeout=0, handshakeTimeout=10000, jdbcEnabled=true, odbcEnabled=true, thinCliEnabled=true, sslEnabled=false, useIgniteSslCtxFactory=true, sslClientAuth=false, sslCtxFactory=null, thinCliCfg=ThinClientConfiguration [maxActiveTxPerConn=100, maxActiveComputeTasksPerConn=0]], mvccVacuumThreadCnt=2, mvccVacuumFreq=5000, authEnabled=false, failureHnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]], commFailureRslvr=null, sqlCfg=SqlConfiguration [longQryWarnTimeout=3000, dfltQryTimeout=0, sqlQryHistSize=1000, validationEnabled=false], asyncContinuationExecutor=null] [21:10:45] : [Step 4/5] [2021-11-19 21:10:45,424][INFO ][test-runner-#20913%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] Daemon mode: off [21:10:45] : [Step 4/5] [2021-11-19 21:10:45,424][INFO ][test-runner-#20913%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] OS: Linux 4.15.0-151-generic amd64 [21:10:45] : [Step 4/5] [2021-11-19 21:10:45,425][INFO ][test-runner-#20913%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] OS user: teamcity [21:10:45] : [Step 4/5] [2021-11-19 21:10:45,425][INFO ][test-runner-#20913%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] PID: 16724 [21:10:45] : [Step 4/5] [2021-11-19 21:10:45,425][INFO ][test-runner-#20913%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] Language runtime: Java Platform API Specification ver. 1.8 [21:10:45] : [Step 4/5] [2021-11-19 21:10:45,426][INFO ][test-runner-#20913%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] VM information: Java(TM) SE Runtime Environment 1.8.0_261-b12 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 25.261-b12 [21:10:45] : [Step 4/5] [2021-11-19 21:10:45,426][INFO ][test-runner-#20913%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] VM total memory: 1.9GB [21:10:45] : [Step 4/5] [2021-11-19 21:10:45,426][INFO ][test-runner-#20913%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] Remote Management [restart: off, REST: off, JMX (remote: off)] [21:10:45] : [Step 4/5] [2021-11-19 21:10:45,427][INFO ][test-runner-#20913%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] Logger: GridTestLog4jLogger [quiet=false, config=null] [21:10:45] : [Step 4/5] [2021-11-19 21:10:45,427][INFO ][test-runner-#20913%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] IGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c [21:10:45] : [Step 4/5] [2021-11-19 21:10:45,427][INFO ][test-runner-#20913%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] VM arguments: [-DIGNITE_DUMP_THREADS_ON_FAILURE=false, -DMono=/usr/bin/mono-sgen, -DMono4.0_x64=/usr/lib/mono/4.0, -DMono4.5_x64=/usr/lib/mono/4.5, -DMonoVersion=6.12.0.90, -DSKIP_BUILD=false, -Dagent.home.dir=/opt/buildagent, -Dagent.name=aitc-lin02_03, -Dagent.ownPort=9090, -Dagent.work.dir=/opt/buildagent/work, -Dbuild.number=95, -Dbuild.vcs.number=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.1=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.GitHubApacheIgnite=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dclassworlds.conf=/opt/buildagent/temp/buildTmp/teamcity.m2.conf, -Dcom.jetbrains.maven.watcher.report.file=/opt/buildagent/temp/buildTmp/maven-build-info.xml, -Djava.io.tmpdir=/opt/buildagent/temp/buildTmp, -Dmaven.home=/opt/buildagent/tools/maven3_6, -Dmaven.multiModuleProjectDirectory=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.agent.cpuBenchmark=457, -Dteamcity.agent.dotnet.agent_url=http://localhost:9090/RPC2, -Dteamcity.agent.dotnet.build_id=6278078, -Dteamcity.auth.password=*******, -Dteamcity.auth.userId=TeamCityBuildId=6278078, -Dteamcity.build.changedFiles.file=/opt/buildagent/temp/buildTmp/changedFiles6342607772318147725.txt, -Dteamcity.build.checkoutDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.build.id=6278078, -Dteamcity.build.properties.file=/opt/buildagent/temp/buildTmp/teamcity.build5164517880467851002.properties, -Dteamcity.build.tempDir=/opt/buildagent/temp/buildTmp, -Dteamcity.build.workingDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.buildConfName=Basic 3, -Dteamcity.buildType.id=IgniteTests24Java8_Basic3, -Dteamcity.configuration.properties.file=/opt/buildagent/temp/buildTmp/teamcity.config5591980786735343870.properties, -Dteamcity.maven.userSettings.path=/opt/buildagent/temp/buildTmp/maven_settings_585072866407032347.xml, -Dteamcity.maven.watcher.home=/opt/buildagent/plugins/mavenPlugin/maven-watcher-jdk16, -Dteamcity.projectName=Ignite Tests 2.x (JDK 8/11), -Dteamcity.runner.properties.file=/opt/buildagent/temp/buildTmp/teamcity.runner9098465561618137420.properties, -Dteamcity.tests.recentlyFailedTests.file=/opt/buildagent/temp/buildTmp/testsToRunFirst3891775683130404069.txt, -Dteamcity.version=2021.2 (build 99542), -ea, -Xms2g, -Xmx2g, -XX:+HeapDumpOnOutOfMemoryError, -DIGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_TEST_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_UPDATE_NOTIFIER=false, -DIGNITE_NO_DISCO_ORDER=true, -DIGNITE_PERFORMANCE_SUGGESTIONS_DISABLED=true, -Djava.net.preferIPv4Stack=true, -DTEST_SCALE_FACTOR=1.0, -DIGNITE_TEST_PROP_LOG4J_FILE=log4j-tc-test.xml, -DIGNITE_QUIET=false, -DIGNITE_MARSHAL_BUFFERS_RECHECK=1000, -Dmaven.repo.local=/opt/buildagent/.m2/repository] [21:10:45] : [Step 4/5] [2021-11-19 21:10:45,431][INFO ][test-runner-#20913%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] System cache's DataRegion size is configured to 40 MB. Use DataStorageConfiguration.systemRegionInitialSize property to change the setting. [21:10:45] : [Step 4/5] [2021-11-19 21:10:45,432][INFO ][test-runner-#20913%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] Configured caches [in 'sysMemPlc' dataRegion: ['ignite-sys-cache']] [21:10:45]W: [org.apache.ignite:ignite-core] [2021-11-19 21:10:45,432][WARN ][test-runner-#20913%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] Peer class loading is enabled (disable it in production for performance and deployment consistency reasons) [21:10:45] : [Step 4/5] [2021-11-19 21:10:45,432][INFO ][test-runner-#20913%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] 3-rd party licenses can be found at: /opt/buildagent/work/7bc1c54bc719b67c/libs/licenses [21:10:45] : [Step 4/5] [2021-11-19 21:10:45,436][INFO ][test-runner-#20913%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] Configured plugins: [21:10:45] : [Step 4/5] [2021-11-19 21:10:45,436][INFO ][test-runner-#20913%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- StanByClusterTestProvider 1.0 [21:10:45] : [Step 4/5] [2021-11-19 21:10:45,436][INFO ][test-runner-#20913%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:10:45] : [Step 4/5] [2021-11-19 21:10:45,437][INFO ][test-runner-#20913%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] [21:10:45] : [Step 4/5] [2021-11-19 21:10:45,437][INFO ][test-runner-#20913%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- PageMemory tracker plugin 1.0 [21:10:45] : [Step 4/5] [2021-11-19 21:10:45,437][INFO ][test-runner-#20913%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:10:45] : [Step 4/5] [2021-11-19 21:10:45,437][INFO ][test-runner-#20913%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] [21:10:45] : [Step 4/5] [2021-11-19 21:10:45,437][INFO ][test-runner-#20913%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- TestDistibutedConfigurationPlugin 1.0 [21:10:45] : [Step 4/5] [2021-11-19 21:10:45,437][INFO ][test-runner-#20913%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:10:45] : [Step 4/5] [2021-11-19 21:10:45,438][INFO ][test-runner-#20913%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] [21:10:45] : [Step 4/5] [2021-11-19 21:10:45,438][INFO ][test-runner-#20913%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- NodeValidationPluginProvider 1.0 [21:10:45] : [Step 4/5] [2021-11-19 21:10:45,438][INFO ][test-runner-#20913%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:10:45] : [Step 4/5] [2021-11-19 21:10:45,438][INFO ][test-runner-#20913%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] [21:10:45] : [Step 4/5] [2021-11-19 21:10:45,438][INFO ][test-runner-#20913%encryption.CacheGroupKeyChangeTest%][FailureProcessor] Configured failure handler: [hnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]]] [21:10:45] : [Step 4/5] [2021-11-19 21:10:45,448][INFO ][test-runner-#20913%encryption.CacheGroupKeyChangeTest%][TestRecordingCommunicationSpi] Successfully bound communication NIO server to TCP port [port=47100, locHost=/127.0.0.1, selectorsCnt=12, selectorSpins=0, pairedConn=false] [21:10:45]W: [org.apache.ignite:ignite-core] [2021-11-19 21:10:45,449][WARN ][test-runner-#20913%encryption.CacheGroupKeyChangeTest%][TestRecordingCommunicationSpi] Message queue limit is set to 0 which may lead to potential OOMEs when running cache operations in FULL_ASYNC or PRIMARY_SYNC modes due to message queues growth on sender and receiver sides. [21:10:45] : [Step 4/5] [2021-11-19 21:10:45,453][INFO ][test-runner-#20913%encryption.CacheGroupKeyChangeTest%][GridCollisionManager] Collision resolution is disabled (all jobs will be activated upon arrival). [21:10:45] : [Step 4/5] [2021-11-19 21:10:45,453][INFO ][test-runner-#20913%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] Security status [authentication=off, sandbox=off, tls/ssl=off] [21:10:45] : [Step 4/5] [2021-11-19 21:10:45,509][INFO ][test-runner-#20913%encryption.CacheGroupKeyChangeTest%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:10:45] : [Step 4/5] [2021-11-19 21:10:45,591][INFO ][test-runner-#20913%encryption.CacheGroupKeyChangeTest%][MaintenanceProcessor] Resolved store directory for node persistent data: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0 [21:10:45] : [Step 4/5] [2021-11-19 21:10:45,592][INFO ][test-runner-#20913%encryption.CacheGroupKeyChangeTest%][CacheObjectBinaryProcessorImpl] Resolved directory for serialized binary metadata: /opt/buildagent/work/7bc1c54bc719b67c/work/db/binary_meta/grid_0 [21:10:45] : [Step 4/5] [2021-11-19 21:10:45,596][INFO ][test-runner-#20913%encryption.CacheGroupKeyChangeTest%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0 [21:10:45] : [Step 4/5] [2021-11-19 21:10:45,597][INFO ][test-runner-#20913%encryption.CacheGroupKeyChangeTest%][FileWriteAheadLogManager] Resolved write ahead log work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0 [21:10:45] : [Step 4/5] [2021-11-19 21:10:45,597][INFO ][test-runner-#20913%encryption.CacheGroupKeyChangeTest%][FileWriteAheadLogManager] Resolved write ahead log archive directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0 [21:10:45]W: [org.apache.ignite:ignite-core] [2021-11-19 21:10:45,962][WARN ][test-runner-#20913%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] DataRegion maxSize=104.9 MB is smaller than defaultInitialSize=268.4 MB, setting initialSize to 104.9 MB [21:10:45] : [Step 4/5] [2021-11-19 21:10:45,961][INFO ][test-runner-#20913%encryption.CacheGroupKeyChangeTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000000.wal [21:10:45] : [Step 4/5] [2021-11-19 21:10:45,962][INFO ][test-runner-#20913%encryption.CacheGroupKeyChangeTest%][FileHandleManagerImpl] Initialized write-ahead log manager [mode=LOG_ONLY] [21:10:45] : [Step 4/5] [2021-11-19 21:10:45,967][INFO ][test-runner-#20913%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Configured data regions initialized successfully [total=5] [21:10:46] : [Step 4/5] [2021-11-19 21:10:46,215][INFO ][test-runner-#20913%encryption.CacheGroupKeyChangeTest%][IgniteSnapshotManager] Resolved snapshot work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/snapshots [21:10:46] : [Step 4/5] [2021-11-19 21:10:46,215][INFO ][test-runner-#20913%encryption.CacheGroupKeyChangeTest%][IgniteSnapshotManager] Resolved temp directory for snapshot creation: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0/snp [21:10:46] : [Step 4/5] [2021-11-19 21:10:46,217][INFO ][test-runner-#20913%encryption.CacheGroupKeyChangeTest%][ClientListenerProcessor] Client connector processor has started on TCP port 10800 [21:10:46] : [Step 4/5] [2021-11-19 21:10:46,222][INFO ][test-runner-#20913%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] Non-loopback local IPs: 172.17.0.4 [21:10:46] : [Step 4/5] [2021-11-19 21:10:46,223][INFO ][test-runner-#20913%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] Enabled local MACs: 0242AC110004 [21:10:46] : [Step 4/5] [2021-11-19 21:10:46,225][INFO ][test-runner-#20913%encryption.CacheGroupKeyChangeTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:10:46] : [Step 4/5] [2021-11-19 21:10:46,225][INFO ][test-runner-#20913%encryption.CacheGroupKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:10:46] : [Step 4/5] [2021-11-19 21:10:46,226][INFO ][test-runner-#20913%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:10:46] : [Step 4/5] [2021-11-19 21:10:46,227][INFO ][test-runner-#20913%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Applying lost metastore updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:10:46] : [Step 4/5] [2021-11-19 21:10:46,228][INFO ][test-runner-#20913%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=0 ms] [21:10:46] : [Step 4/5] [2021-11-19 21:10:46,228][INFO ][test-runner-#20913%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Restoring partition state for local groups. [21:10:46] : [Step 4/5] [2021-11-19 21:10:46,228][INFO ][test-runner-#20913%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=0, partitionsProcessed=0, time=0ms] [21:10:46] : [Step 4/5] [2021-11-19 21:10:46,229][INFO ][test-runner-#20913%encryption.CacheGroupKeyChangeTest%][GridEncryptionManager] Encryption keys loaded from metastore. [grps=, masterKeyName=ignite.master.key] [21:10:46] : [Step 4/5] [2021-11-19 21:10:46,233][INFO ][test-runner-#20913%encryption.CacheGroupKeyChangeTest%][ClusterProcessor] Cluster ID and tag has been read from metastorage: null [21:10:46] : [Step 4/5] [2021-11-19 21:10:46,233][INFO ][test-runner-#20913%encryption.CacheGroupKeyChangeTest%][IgniteClusterImpl] Shutdown policy was updated [oldVal=null, newVal=null] [21:10:46] : [Step 4/5] [2021-11-19 21:10:46,233][INFO ][test-runner-#20913%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Checkpoint frequency deviation changed [oldVal=null, newVal=null] [21:10:46] : [Step 4/5] [2021-11-19 21:10:46,469][INFO ][test-runner-#20913%encryption.CacheGroupKeyChangeTest%][FilePageStoreManager] Cleanup cache stores [total=1, left=0, cleanFiles=false] [21:10:46] : [Step 4/5] [2021-11-19 21:10:46,473][INFO ][test-runner-#20913%encryption.CacheGroupKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:10:46] : [Step 4/5] [2021-11-19 21:10:46,474][INFO ][test-runner-#20913%encryption.CacheGroupKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:10:46] : [Step 4/5] [2021-11-19 21:10:46,475][INFO ][test-runner-#20913%encryption.CacheGroupKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:10:46] : [Step 4/5] [2021-11-19 21:10:46,476][INFO ][test-runner-#20913%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Data Regions Started: 5 [21:10:46] : [Step 4/5] [2021-11-19 21:10:46,476][INFO ][test-runner-#20913%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] ^-- sysMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:10:46] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:10:46] : [Step 4/5] ^-- default region [type=default, persistence=true, lazyAlloc=true, [21:10:46] : [Step 4/5] ... initCfg=100MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB, allocTotal=0MB] [21:10:46] : [Step 4/5] ^-- metastoreMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:10:46] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:10:46] : [Step 4/5] ^-- TxLog region [type=internal, persistence=true, lazyAlloc=false, [21:10:46] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:10:46] : [Step 4/5] ^-- volatileDsMemPlc region [type=user, persistence=false, lazyAlloc=true, [21:10:46] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB] [21:10:46] : [Step 4/5] ^-- Ignite persistence [used=0MB] [21:10:46] : [Step 4/5] [21:10:46] : [Step 4/5] [2021-11-19 21:10:46,477][INFO ][test-runner-#20913%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Starting binary memory restore for: [-2100569601] [21:10:46] : [Step 4/5] [2021-11-19 21:10:46,484][INFO ][test-runner-#20913%encryption.CacheGroupKeyChangeTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:10:46] : [Step 4/5] [2021-11-19 21:10:46,485][INFO ][test-runner-#20913%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:10:46] : [Step 4/5] [2021-11-19 21:10:46,486][INFO ][test-runner-#20913%encryption.CacheGroupKeyChangeTest%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000000.wal, offset=0, ver=2] [21:10:46] : [Step 4/5] [2021-11-19 21:10:46,490][INFO ][test-runner-#20913%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Started cache in recovery mode [name=ignite-sys-cache, id=-2100569601, dataRegionName=sysMemPlc, mode=REPLICATED, atomicity=TRANSACTIONAL, backups=2147483647, mvcc=false] [21:10:46] : [Step 4/5] [2021-11-19 21:10:46,490][INFO ][test-runner-#20913%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Binary recovery performed in 13 ms. [21:10:46] : [Step 4/5] [2021-11-19 21:10:46,491][INFO ][test-runner-#20913%encryption.CacheGroupKeyChangeTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:10:46] : [Step 4/5] [2021-11-19 21:10:46,491][INFO ][test-runner-#20913%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Applying lost cache updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:10:46] : [Step 4/5] [2021-11-19 21:10:46,493][INFO ][test-runner-#20913%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=0 ms] [21:10:46] : [Step 4/5] [2021-11-19 21:10:46,493][INFO ][test-runner-#20913%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Restoring partition state for local groups. [21:10:46] : [Step 4/5] [2021-11-19 21:10:46,498][INFO ][test-runner-#20913%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=1, partitionsProcessed=100, time=10ms] [21:10:46] : [Step 4/5] [2021-11-19 21:10:46,570][INFO ][test-runner-#20913%encryption.CacheGroupKeyChangeTest%][TestTcpDiscoverySpi] Successfully bound to TCP port [port=47500, localHost=localhost/127.0.0.1, locNodeId=00245d3d-89f6-46c0-9396-bcd0247bd000] [21:10:46] : [Step 4/5] [2021-11-19 21:10:46,580][INFO ][disco-notifier-worker-#21025%grid-0%][MvccProcessorImpl] Assigned mvcc coordinator [crd=MvccCoordinator [topVer=AffinityTopologyVersion [topVer=1, minorTopVer=0], nodeId=00245d3d-89f6-46c0-9396-bcd0247bd000, ver=1637345446578, local=true, initialized=false]] [21:10:46] : [Step 4/5] [2021-11-19 21:10:46,582][INFO ][sys-#21008%grid-0%][ClusterProcessor] Writing cluster ID and tag to metastorage on ready for write ClusterIdAndTag [id=d918997f-b62b-453a-8ae5-cc339ea6deb2, tag=beautiful_hoover] [21:10:46] : [Step 4/5] [2021-11-19 21:10:46,584][INFO ][disco-notifier-worker-#21025%grid-0%][ClusterProcessor] beautiful_hoover [21:10:46] : [Step 4/5] [2021-11-19 21:10:46,585][INFO ][disco-notifier-worker-#21025%grid-0%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustEnabled' was changed from 'null' to 'false' [21:10:46] : [Step 4/5] [2021-11-19 21:10:46,586][INFO ][disco-notifier-worker-#21025%grid-0%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustTimeout' was changed from 'null' to '300000' [21:10:46] : [Step 4/5] [2021-11-19 21:10:46,586][INFO ][disco-notifier-worker-#21025%grid-0%][IgniteTxManager] Transactions parameter 'longOperationsDumpTimeout' was changed from 'null' to '60000' [21:10:46] : [Step 4/5] [2021-11-19 21:10:46,587][INFO ][disco-notifier-worker-#21025%grid-0%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpThreshold' was changed from 'null' to '0' [21:10:46] : [Step 4/5] [2021-11-19 21:10:46,587][INFO ][disco-notifier-worker-#21025%grid-0%][IgniteTxManager] Transactions parameter 'transactionTimeDumpSamplesCoefficient' was changed from 'null' to '0.0' [21:10:46] : [Step 4/5] [2021-11-19 21:10:46,588][INFO ][disco-notifier-worker-#21025%grid-0%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpSamplesPerSecondLimit' was changed from 'null' to '5' [21:10:46] : [Step 4/5] [2021-11-19 21:10:46,588][INFO ][disco-notifier-worker-#21025%grid-0%][IgniteTxManager] Transactions parameter 'collisionsDumpInterval' was changed from 'null' to '1000' [21:10:46] : [Step 4/5] [2021-11-19 21:10:46,589][INFO ][disco-notifier-worker-#21025%grid-0%][IgniteTxManager] Transactions parameter 'txOwnerDumpRequestsAllowed' was changed from 'null' to 'true' [21:10:46] : [Step 4/5] [2021-11-19 21:10:46,589][INFO ][disco-notifier-worker-#21025%grid-0%][GridCacheDatabaseSharedManager] Historical rebalance WAL threshold changed [property=historical.rebalance.threshold, oldVal=null, newVal=500] [21:10:46] : [Step 4/5] [2021-11-19 21:10:46,596][INFO ][test-runner-#20913%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] To start Console Management & Monitoring run ignitevisorcmd.{sh|bat} [21:10:46] : [Step 4/5] [2021-11-19 21:10:46,596][INFO ][test-runner-#20913%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] [21:10:46] : [Step 4/5] [21:10:46] : [Step 4/5] >>> +-------------------------------------------+ [21:10:46] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:10:46] : [Step 4/5] >>> +-------------------------------------------+ [21:10:46] : [Step 4/5] >>> OS name: Linux 4.15.0-151-generic amd64 [21:10:46] : [Step 4/5] >>> CPU(s): 24 [21:10:46] : [Step 4/5] >>> Heap: 2.0GB [21:10:46] : [Step 4/5] >>> VM name: 16724@c4dfe9a430b2 [21:10:46] : [Step 4/5] >>> Ignite instance name: grid-0 [21:10:46] : [Step 4/5] >>> Local node [ID=00245D3D-89F6-46C0-9396-BCD0247BD000, order=1, clientMode=false] [21:10:46] : [Step 4/5] >>> Local node addresses: [127.0.0.1] [21:10:46] : [Step 4/5] >>> Local ports: TCP:10800 TCP:47100 TCP:47500 [21:10:46] : [Step 4/5] [21:10:46] : [Step 4/5] [2021-11-19 21:10:46,597][INFO ][test-runner-#20913%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] >>> Ignite cluster is in INACTIVE state (limited functionality available). Use control.(sh|bat) script or IgniteCluster.state(ClusterState.ACTIVE) to change the state. [21:10:46] : [Step 4/5] [2021-11-19 21:10:46,598][INFO ][test-runner-#20913%encryption.CacheGroupKeyChangeTest%][GridDiscoveryManager] Topology snapshot [ver=1, locNode=00245d3d, servers=1, clients=0, state=INACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=00245d3d-89f6-46c0-9396-bcd0247bd000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:10:46] : [Step 4/5] [2021-11-19 21:10:46,598][INFO ][test-runner-#20913%encryption.CacheGroupKeyChangeTest%][G] Node started : [stage="Configure system pool" (0 ms),stage="Start managers" (177 ms),stage="Configure binary metadata" (1 ms),stage="Start processors" (627 ms),stage="Start 'StanByClusterTestProvider' plugin" (0 ms),stage="Start 'PageMemory tracker plugin' plugin" (0 ms),stage="Start 'TestDistibutedConfigurationPlugin' plugin" (0 ms),stage="Start 'NodeValidationPluginProvider' plugin" (0 ms),stage="Init metastore" (247 ms),stage="Init and start regions" (7 ms),stage="Restore binary memory" (13 ms),stage="Restore logical state" (7 ms),stage="Finish recovery" (70 ms),stage="Join topology" (11 ms),stage="Await transition" (1 ms),stage="Await exchange" (16 ms),stage="Total time" (1177 ms)] [21:10:46] : [Step 4/5] [2021-11-19 21:10:46,600][INFO ][test-runner-#20913%encryption.CacheGroupKeyChangeTest%][root] Node started with the following configuration [id=00245d3d-89f6-46c0-9396-bcd0247bd000, marshaller=BinaryMarshaller [], discovery=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=5000, ackTimeout=5000, marsh=JdkMarshaller [clsFilter=org.apache.ignite.marshaller.MarshallerUtils$1@3e77e7d3], reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], binaryCfg=null, lateAff=true] [21:10:46]W: [org.apache.ignite:ignite-core] [2021-11-19 21:10:46,605][WARN ][test-runner-#20913%encryption.CacheGroupKeyChangeTest%][G] Ignite work directory is not provided, automatically resolved to: /opt/buildagent/work/7bc1c54bc719b67c/work [21:10:46] : [Step 4/5] [2021-11-19 21:10:46,605][INFO ][test-runner-#20913%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] [21:10:46] : [Step 4/5] [21:10:46] : [Step 4/5] >>> __________ ________________ [21:10:46] : [Step 4/5] >>> / _/ ___/ |/ / _/_ __/ __/ [21:10:46] : [Step 4/5] >>> _/ // (7 7 // / / / / _/ [21:10:46] : [Step 4/5] >>> /___/\___/_/|_/___/ /_/ /___/ [21:10:46] : [Step 4/5] >>> [21:10:46] : [Step 4/5] >>> ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:10:46] : [Step 4/5] >>> 2021 Copyright(C) Apache Software Foundation [21:10:46] : [Step 4/5] >>> [21:10:46] : [Step 4/5] >>> Ignite documentation: http://ignite.apache.org [21:10:46] : [Step 4/5] [21:10:46] : [Step 4/5] [2021-11-19 21:10:46,606][INFO ][test-runner-#20913%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] Config URL: n/a [21:10:46] : [Step 4/5] [2021-11-19 21:10:46,606][INFO ][test-runner-#20913%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] IgniteConfiguration [igniteInstanceName=grid-1, pubPoolSize=24, svcPoolSize=24, callbackPoolSize=24, stripedPoolSize=24, sysPoolSize=24, mgmtPoolSize=4, dataStreamerPoolSize=24, utilityCachePoolSize=24, utilityCacheKeepAliveTime=60000, p2pPoolSize=2, qryPoolSize=24, buildIdxPoolSize=4, igniteHome=/opt/buildagent/work/7bc1c54bc719b67c, igniteWorkDir=/opt/buildagent/work/7bc1c54bc719b67c/work, mbeanSrv=com.sun.jmx.mbeanserver.JmxMBeanServer@6fe85038, nodeId=105bed7a-e976-48cd-8c07-342e87bf2001, marsh=BinaryMarshaller [], marshLocJobs=false, daemon=false, p2pEnabled=true, netTimeout=10000, netCompressionLevel=1, sndRetryDelay=1000, sndRetryCnt=3, metricsHistSize=10000, metricsUpdateFreq=1000, metricsExpTime=9223372036854775807, discoSpi=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=0, ackTimeout=0, marsh=null, reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], segPlc=STOP, segResolveAttempts=2, waitForSegOnStart=true, allResolversPassReq=true, segChkFreq=10000, commSpi=TcpCommunicationSpi [connectGate=org.apache.ignite.spi.communication.tcp.internal.ConnectGateway@39a5d492, ctxInitLatch=java.util.concurrent.CountDownLatch@5bda46cd[Count = 1], stopping=false, clientPool=null, nioSrvWrapper=null, stateProvider=null], evtSpi=MemoryEventStorageSpi [expireAgeMs=9223372036854775807, expireCnt=10000, filter=null], colSpi=NoopCollisionSpi [], deploySpi=LocalDeploymentSpi [], indexingSpi=org.apache.ignite.spi.indexing.noop.NoopIndexingSpi@6dae9b48, addrRslvr=null, encryptionSpi=org.apache.ignite.spi.encryption.keystore.KeystoreEncryptionSpi@ee8151c, tracingSpi=org.apache.ignite.spi.tracing.NoopTracingSpi@15dacbb8, clientMode=false, rebalanceThreadPoolSize=4, rebalanceTimeout=10000, rebalanceBatchesPrefetchCnt=3, rebalanceThrottle=0, rebalanceBatchSize=524288, txCfg=TransactionConfiguration [txSerEnabled=false, dfltIsolation=REPEATABLE_READ, dfltConcurrency=PESSIMISTIC, dfltTxTimeout=0, txTimeoutOnPartitionMapExchange=0, deadlockTimeout=10000, pessimisticTxLogSize=0, pessimisticTxLogLinger=10000, tmLookupClsName=null, txManagerFactory=null, useJtaSync=false], cacheSanityCheckEnabled=true, discoStartupDelay=60000, deployMode=SHARED, p2pMissedCacheSize=100, locHost=127.0.0.1, timeSrvPortBase=31100, timeSrvPortRange=100, failureDetectionTimeout=10000, sysWorkerBlockedTimeout=null, clientFailureDetectionTimeout=10000, metricsLogFreq=0, connectorCfg=null, odbcCfg=null, warmupClos=null, atomicCfg=AtomicConfiguration [seqReserveSize=1000, cacheMode=PARTITIONED, backups=1, aff=null, grpName=null], classLdr=null, sslCtxFactory=null, platformCfg=null, binaryCfg=null, memCfg=null, pstCfg=null, dsCfg=DataStorageConfiguration [sysRegionInitSize=41943040, sysRegionMaxSize=104857600, pageSize=4096, concLvl=0, dfltDataRegConf=DataRegionConfiguration [name=default, maxSize=104857600, initSize=268435456, swapPath=null, pageEvictionMode=DISABLED, pageReplacementMode=CLOCK, evictionThreshold=0.9, emptyPagesPoolSize=100, metricsEnabled=false, metricsSubIntervalCount=5, metricsRateTimeInterval=60000, persistenceEnabled=true, checkpointPageBufSize=0, lazyMemoryAllocation=true, warmUpCfg=null], dataRegions=null, storagePath=null, checkpointFreq=30000, lockWaitTime=10000, checkpointThreads=4, checkpointWriteOrder=SEQUENTIAL, walHistSize=20, maxWalArchiveSize=20971520, walSegments=10, walSegmentSize=1048576, walPath=db/wal, walArchivePath=db/wal/archive, cdcWalPath=db/wal/cdc, cdcEnabled=false, metricsEnabled=false, walMode=LOG_ONLY, walTlbSize=131072, walBuffSize=0, walFlushFreq=2000, walFsyncDelay=1000, walRecordIterBuffSize=67108864, alwaysWriteFullPages=false, fileIOFactory=org.apache.ignite.internal.processors.cache.persistence.file.AsyncFileIOFactory@18e441e1, metricsSubIntervalCnt=5, metricsRateTimeInterval=60000, walAutoArchiveAfterInactivity=-1, walForceArchiveTimeout=-1, writeThrottlingEnabled=false, walCompactionEnabled=false, walCompactionLevel=1, checkpointReadLockTimeout=null, walPageCompression=DISABLED, walPageCompressionLevel=null, dfltWarmUpCfg=null, encCfg=org.apache.ignite.configuration.EncryptionConfiguration@2cd5c375, defragmentationThreadPoolSize=4, minWalArchiveSize=-1], snapshotPath=snapshots, activeOnStart=true, activeOnStartPropSetFlag=false, autoActivation=true, autoActivationPropSetFlag=false, clusterStateOnStart=null, sqlConnCfg=null, cliConnCfg=ClientConnectorConfiguration [host=null, port=10800, portRange=100, sockSndBufSize=0, sockRcvBufSize=0, tcpNoDelay=true, maxOpenCursorsPerConn=128, threadPoolSize=24, selectorCnt=12, idleTimeout=0, handshakeTimeout=10000, jdbcEnabled=true, odbcEnabled=true, thinCliEnabled=true, sslEnabled=false, useIgniteSslCtxFactory=true, sslClientAuth=false, sslCtxFactory=null, thinCliCfg=ThinClientConfiguration [maxActiveTxPerConn=100, maxActiveComputeTasksPerConn=0]], mvccVacuumThreadCnt=2, mvccVacuumFreq=5000, authEnabled=false, failureHnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]], commFailureRslvr=null, sqlCfg=SqlConfiguration [longQryWarnTimeout=3000, dfltQryTimeout=0, sqlQryHistSize=1000, validationEnabled=false], asyncContinuationExecutor=null] [21:10:46] : [Step 4/5] [2021-11-19 21:10:46,615][INFO ][test-runner-#20913%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] Daemon mode: off [21:10:46] : [Step 4/5] [2021-11-19 21:10:46,615][INFO ][test-runner-#20913%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] OS: Linux 4.15.0-151-generic amd64 [21:10:46] : [Step 4/5] [2021-11-19 21:10:46,615][INFO ][test-runner-#20913%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] OS user: teamcity [21:10:46] : [Step 4/5] [2021-11-19 21:10:46,615][INFO ][test-runner-#20913%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] PID: 16724 [21:10:46] : [Step 4/5] [2021-11-19 21:10:46,616][INFO ][test-runner-#20913%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] Language runtime: Java Platform API Specification ver. 1.8 [21:10:46] : [Step 4/5] [2021-11-19 21:10:46,616][INFO ][test-runner-#20913%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] VM information: Java(TM) SE Runtime Environment 1.8.0_261-b12 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 25.261-b12 [21:10:46] : [Step 4/5] [2021-11-19 21:10:46,616][INFO ][test-runner-#20913%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] VM total memory: 1.9GB [21:10:46] : [Step 4/5] [2021-11-19 21:10:46,617][INFO ][test-runner-#20913%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] Remote Management [restart: off, REST: off, JMX (remote: off)] [21:10:46] : [Step 4/5] [2021-11-19 21:10:46,617][INFO ][test-runner-#20913%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] Logger: GridTestLog4jLogger [quiet=false, config=null] [21:10:46] : [Step 4/5] [2021-11-19 21:10:46,617][INFO ][test-runner-#20913%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] IGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c [21:10:46] : [Step 4/5] [2021-11-19 21:10:46,617][INFO ][test-runner-#20913%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] VM arguments: [-DIGNITE_DUMP_THREADS_ON_FAILURE=false, -DMono=/usr/bin/mono-sgen, -DMono4.0_x64=/usr/lib/mono/4.0, -DMono4.5_x64=/usr/lib/mono/4.5, -DMonoVersion=6.12.0.90, -DSKIP_BUILD=false, -Dagent.home.dir=/opt/buildagent, -Dagent.name=aitc-lin02_03, -Dagent.ownPort=9090, -Dagent.work.dir=/opt/buildagent/work, -Dbuild.number=95, -Dbuild.vcs.number=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.1=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.GitHubApacheIgnite=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dclassworlds.conf=/opt/buildagent/temp/buildTmp/teamcity.m2.conf, -Dcom.jetbrains.maven.watcher.report.file=/opt/buildagent/temp/buildTmp/maven-build-info.xml, -Djava.io.tmpdir=/opt/buildagent/temp/buildTmp, -Dmaven.home=/opt/buildagent/tools/maven3_6, -Dmaven.multiModuleProjectDirectory=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.agent.cpuBenchmark=457, -Dteamcity.agent.dotnet.agent_url=http://localhost:9090/RPC2, -Dteamcity.agent.dotnet.build_id=6278078, -Dteamcity.auth.password=*******, -Dteamcity.auth.userId=TeamCityBuildId=6278078, -Dteamcity.build.changedFiles.file=/opt/buildagent/temp/buildTmp/changedFiles6342607772318147725.txt, -Dteamcity.build.checkoutDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.build.id=6278078, -Dteamcity.build.properties.file=/opt/buildagent/temp/buildTmp/teamcity.build5164517880467851002.properties, -Dteamcity.build.tempDir=/opt/buildagent/temp/buildTmp, -Dteamcity.build.workingDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.buildConfName=Basic 3, -Dteamcity.buildType.id=IgniteTests24Java8_Basic3, -Dteamcity.configuration.properties.file=/opt/buildagent/temp/buildTmp/teamcity.config5591980786735343870.properties, -Dteamcity.maven.userSettings.path=/opt/buildagent/temp/buildTmp/maven_settings_585072866407032347.xml, -Dteamcity.maven.watcher.home=/opt/buildagent/plugins/mavenPlugin/maven-watcher-jdk16, -Dteamcity.projectName=Ignite Tests 2.x (JDK 8/11), -Dteamcity.runner.properties.file=/opt/buildagent/temp/buildTmp/teamcity.runner9098465561618137420.properties, -Dteamcity.tests.recentlyFailedTests.file=/opt/buildagent/temp/buildTmp/testsToRunFirst3891775683130404069.txt, -Dteamcity.version=2021.2 (build 99542), -ea, -Xms2g, -Xmx2g, -XX:+HeapDumpOnOutOfMemoryError, -DIGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_TEST_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_UPDATE_NOTIFIER=false, -DIGNITE_NO_DISCO_ORDER=true, -DIGNITE_PERFORMANCE_SUGGESTIONS_DISABLED=true, -Djava.net.preferIPv4Stack=true, -DTEST_SCALE_FACTOR=1.0, -DIGNITE_TEST_PROP_LOG4J_FILE=log4j-tc-test.xml, -DIGNITE_QUIET=false, -DIGNITE_MARSHAL_BUFFERS_RECHECK=1000, -Dmaven.repo.local=/opt/buildagent/.m2/repository] [21:10:46] : [Step 4/5] [2021-11-19 21:10:46,622][INFO ][test-runner-#20913%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] System cache's DataRegion size is configured to 40 MB. Use DataStorageConfiguration.systemRegionInitialSize property to change the setting. [21:10:46] : [Step 4/5] [2021-11-19 21:10:46,622][INFO ][test-runner-#20913%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] Configured caches [in 'sysMemPlc' dataRegion: ['ignite-sys-cache']] [21:10:46]W: [org.apache.ignite:ignite-core] [2021-11-19 21:10:46,622][WARN ][test-runner-#20913%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] Peer class loading is enabled (disable it in production for performance and deployment consistency reasons) [21:10:46] : [Step 4/5] [2021-11-19 21:10:46,623][INFO ][test-runner-#20913%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] 3-rd party licenses can be found at: /opt/buildagent/work/7bc1c54bc719b67c/libs/licenses [21:10:46] : [Step 4/5] [2021-11-19 21:10:46,626][INFO ][test-runner-#20913%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] Configured plugins: [21:10:46] : [Step 4/5] [2021-11-19 21:10:46,627][INFO ][test-runner-#20913%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- StanByClusterTestProvider 1.0 [21:10:46] : [Step 4/5] [2021-11-19 21:10:46,627][INFO ][test-runner-#20913%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:10:46] : [Step 4/5] [2021-11-19 21:10:46,627][INFO ][test-runner-#20913%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] [21:10:46] : [Step 4/5] [2021-11-19 21:10:46,627][INFO ][test-runner-#20913%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- PageMemory tracker plugin 1.0 [21:10:46] : [Step 4/5] [2021-11-19 21:10:46,627][INFO ][test-runner-#20913%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:10:46] : [Step 4/5] [2021-11-19 21:10:46,628][INFO ][test-runner-#20913%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] [21:10:46] : [Step 4/5] [2021-11-19 21:10:46,628][INFO ][test-runner-#20913%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- TestDistibutedConfigurationPlugin 1.0 [21:10:46] : [Step 4/5] [2021-11-19 21:10:46,628][INFO ][test-runner-#20913%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:10:46] : [Step 4/5] [2021-11-19 21:10:46,628][INFO ][test-runner-#20913%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] [21:10:46] : [Step 4/5] [2021-11-19 21:10:46,628][INFO ][test-runner-#20913%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- NodeValidationPluginProvider 1.0 [21:10:46] : [Step 4/5] [2021-11-19 21:10:46,629][INFO ][test-runner-#20913%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:10:46] : [Step 4/5] [2021-11-19 21:10:46,629][INFO ][test-runner-#20913%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] [21:10:46] : [Step 4/5] [2021-11-19 21:10:46,629][INFO ][test-runner-#20913%encryption.CacheGroupKeyChangeTest%][FailureProcessor] Configured failure handler: [hnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]]] [21:10:46] : [Step 4/5] [2021-11-19 21:10:46,640][INFO ][test-runner-#20913%encryption.CacheGroupKeyChangeTest%][TestRecordingCommunicationSpi] Successfully bound communication NIO server to TCP port [port=47101, locHost=/127.0.0.1, selectorsCnt=12, selectorSpins=0, pairedConn=false] [21:10:46]W: [org.apache.ignite:ignite-core] [2021-11-19 21:10:46,641][WARN ][test-runner-#20913%encryption.CacheGroupKeyChangeTest%][TestRecordingCommunicationSpi] Message queue limit is set to 0 which may lead to potential OOMEs when running cache operations in FULL_ASYNC or PRIMARY_SYNC modes due to message queues growth on sender and receiver sides. [21:10:46] : [Step 4/5] [2021-11-19 21:10:46,644][INFO ][test-runner-#20913%encryption.CacheGroupKeyChangeTest%][GridCollisionManager] Collision resolution is disabled (all jobs will be activated upon arrival). [21:10:46] : [Step 4/5] [2021-11-19 21:10:46,645][INFO ][test-runner-#20913%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] Security status [authentication=off, sandbox=off, tls/ssl=off] [21:10:46] : [Step 4/5] [2021-11-19 21:10:46,704][INFO ][test-runner-#20913%encryption.CacheGroupKeyChangeTest%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:10:46] : [Step 4/5] [2021-11-19 21:10:46,793][INFO ][test-runner-#20913%encryption.CacheGroupKeyChangeTest%][MaintenanceProcessor] Resolved store directory for node persistent data: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1 [21:10:46] : [Step 4/5] [2021-11-19 21:10:46,794][INFO ][test-runner-#20913%encryption.CacheGroupKeyChangeTest%][CacheObjectBinaryProcessorImpl] Resolved directory for serialized binary metadata: /opt/buildagent/work/7bc1c54bc719b67c/work/db/binary_meta/grid_1 [21:10:46] : [Step 4/5] [2021-11-19 21:10:46,798][INFO ][test-runner-#20913%encryption.CacheGroupKeyChangeTest%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1 [21:10:46] : [Step 4/5] [2021-11-19 21:10:46,798][INFO ][test-runner-#20913%encryption.CacheGroupKeyChangeTest%][FileWriteAheadLogManager] Resolved write ahead log work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1 [21:10:46] : [Step 4/5] [2021-11-19 21:10:46,798][INFO ][test-runner-#20913%encryption.CacheGroupKeyChangeTest%][FileWriteAheadLogManager] Resolved write ahead log archive directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1 [21:10:46] : [Step 4/5] [2021-11-19 21:10:46,808][INFO ][test-runner-#20913%encryption.CacheGroupKeyChangeTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000000.wal [21:10:46] : [Step 4/5] [2021-11-19 21:10:46,809][INFO ][test-runner-#20913%encryption.CacheGroupKeyChangeTest%][FileHandleManagerImpl] Initialized write-ahead log manager [mode=LOG_ONLY] [21:10:46] : [Step 4/5] [2021-11-19 21:10:46,814][INFO ][test-runner-#20913%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Configured data regions initialized successfully [total=5] [21:10:46] : [Step 4/5] [2021-11-19 21:10:46,825][INFO ][test-runner-#20913%encryption.CacheGroupKeyChangeTest%][IgniteSnapshotManager] Resolved snapshot work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/snapshots [21:10:46] : [Step 4/5] [2021-11-19 21:10:46,825][INFO ][test-runner-#20913%encryption.CacheGroupKeyChangeTest%][IgniteSnapshotManager] Resolved temp directory for snapshot creation: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1/snp [21:10:46] : [Step 4/5] [2021-11-19 21:10:46,827][INFO ][test-runner-#20913%encryption.CacheGroupKeyChangeTest%][ClientListenerProcessor] Client connector processor has started on TCP port 10801 [21:10:46] : [Step 4/5] [2021-11-19 21:10:46,829][INFO ][test-runner-#20913%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] Non-loopback local IPs: 172.17.0.4 [21:10:46] : [Step 4/5] [2021-11-19 21:10:46,829][INFO ][test-runner-#20913%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] Enabled local MACs: 0242AC110004 [21:10:46] : [Step 4/5] [2021-11-19 21:10:46,830][INFO ][test-runner-#20913%encryption.CacheGroupKeyChangeTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:10:46] : [Step 4/5] [2021-11-19 21:10:46,831][INFO ][test-runner-#20913%encryption.CacheGroupKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:10:46] : [Step 4/5] [2021-11-19 21:10:46,832][INFO ][test-runner-#20913%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:10:46] : [Step 4/5] [2021-11-19 21:10:46,833][INFO ][test-runner-#20913%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Applying lost metastore updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:10:46] : [Step 4/5] [2021-11-19 21:10:46,834][INFO ][test-runner-#20913%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=0 ms] [21:10:46] : [Step 4/5] [2021-11-19 21:10:46,834][INFO ][test-runner-#20913%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Restoring partition state for local groups. [21:10:46] : [Step 4/5] [2021-11-19 21:10:46,834][INFO ][test-runner-#20913%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=0, partitionsProcessed=0, time=0ms] [21:10:46] : [Step 4/5] [2021-11-19 21:10:46,835][INFO ][test-runner-#20913%encryption.CacheGroupKeyChangeTest%][GridEncryptionManager] Encryption keys loaded from metastore. [grps=, masterKeyName=ignite.master.key] [21:10:46] : [Step 4/5] [2021-11-19 21:10:46,836][INFO ][test-runner-#20913%encryption.CacheGroupKeyChangeTest%][ClusterProcessor] Cluster ID and tag has been read from metastorage: null [21:10:46] : [Step 4/5] [2021-11-19 21:10:46,836][INFO ][test-runner-#20913%encryption.CacheGroupKeyChangeTest%][IgniteClusterImpl] Shutdown policy was updated [oldVal=null, newVal=null] [21:10:46] : [Step 4/5] [2021-11-19 21:10:46,837][INFO ][test-runner-#20913%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Checkpoint frequency deviation changed [oldVal=null, newVal=null] [21:10:46] : [Step 4/5] [2021-11-19 21:10:46,898][INFO ][test-runner-#20913%encryption.CacheGroupKeyChangeTest%][FilePageStoreManager] Cleanup cache stores [total=1, left=0, cleanFiles=false] [21:10:46] : [Step 4/5] [2021-11-19 21:10:46,901][INFO ][test-runner-#20913%encryption.CacheGroupKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:10:46] : [Step 4/5] [2021-11-19 21:10:46,902][INFO ][test-runner-#20913%encryption.CacheGroupKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:10:46] : [Step 4/5] [2021-11-19 21:10:46,903][INFO ][test-runner-#20913%encryption.CacheGroupKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:10:46] : [Step 4/5] [2021-11-19 21:10:46,904][INFO ][test-runner-#20913%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Data Regions Started: 5 [21:10:46] : [Step 4/5] [2021-11-19 21:10:46,904][INFO ][test-runner-#20913%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] ^-- sysMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:10:46] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:10:46] : [Step 4/5] ^-- default region [type=default, persistence=true, lazyAlloc=true, [21:10:46] : [Step 4/5] ... initCfg=100MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB, allocTotal=0MB] [21:10:46] : [Step 4/5] ^-- metastoreMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:10:46] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:10:46] : [Step 4/5] ^-- TxLog region [type=internal, persistence=true, lazyAlloc=false, [21:10:46] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:10:46] : [Step 4/5] ^-- volatileDsMemPlc region [type=user, persistence=false, lazyAlloc=true, [21:10:46] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB] [21:10:46] : [Step 4/5] ^-- Ignite persistence [used=0MB] [21:10:46] : [Step 4/5] [21:10:46] : [Step 4/5] [2021-11-19 21:10:46,906][INFO ][test-runner-#20913%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Starting binary memory restore for: [-2100569601] [21:10:46] : [Step 4/5] [2021-11-19 21:10:46,914][INFO ][test-runner-#20913%encryption.CacheGroupKeyChangeTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:10:46] : [Step 4/5] [2021-11-19 21:10:46,914][INFO ][test-runner-#20913%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:10:46] : [Step 4/5] [2021-11-19 21:10:46,917][INFO ][test-runner-#20913%encryption.CacheGroupKeyChangeTest%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000000.wal, offset=0, ver=2] [21:10:46] : [Step 4/5] [2021-11-19 21:10:46,919][INFO ][test-runner-#20913%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Started cache in recovery mode [name=ignite-sys-cache, id=-2100569601, dataRegionName=sysMemPlc, mode=REPLICATED, atomicity=TRANSACTIONAL, backups=2147483647, mvcc=false] [21:10:46] : [Step 4/5] [2021-11-19 21:10:46,920][INFO ][test-runner-#20913%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Binary recovery performed in 14 ms. [21:10:46] : [Step 4/5] [2021-11-19 21:10:46,920][INFO ][test-runner-#20913%encryption.CacheGroupKeyChangeTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:10:46] : [Step 4/5] [2021-11-19 21:10:46,921][INFO ][test-runner-#20913%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Applying lost cache updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:10:46] : [Step 4/5] [2021-11-19 21:10:46,923][INFO ][test-runner-#20913%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=0 ms] [21:10:46] : [Step 4/5] [2021-11-19 21:10:46,923][INFO ][test-runner-#20913%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Restoring partition state for local groups. [21:10:46] : [Step 4/5] [2021-11-19 21:10:46,927][INFO ][test-runner-#20913%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=1, partitionsProcessed=100, time=0ms] [21:10:46] : [Step 4/5] [2021-11-19 21:10:46,974][INFO ][test-runner-#20913%encryption.CacheGroupKeyChangeTest%][TestTcpDiscoverySpi] Successfully bound to TCP port [port=47501, localHost=localhost/127.0.0.1, locNodeId=105bed7a-e976-48cd-8c07-342e87bf2001] [21:10:46] : [Step 4/5] [2021-11-19 21:10:46,977][INFO ][tcp-disco-srvr-[:47500]-#1102%grid-0%-#21027%grid-0%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=39265] [21:10:46] : [Step 4/5] [2021-11-19 21:10:46,978][INFO ][tcp-disco-srvr-[:47500]-#1102%grid-0%-#21027%grid-0%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=39265] [21:10:46] : [Step 4/5] [2021-11-19 21:10:46,978][INFO ][tcp-disco-sock-reader-[]-#1108%grid-0%-#21147%grid-0%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:39265, rmtPort=39265] [21:10:46] : [Step 4/5] [2021-11-19 21:10:46,980][INFO ][tcp-disco-sock-reader-[105bed7a 127.0.0.1:39265]-#1108%grid-0%-#21147%grid-0%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=105bed7a-e976-48cd-8c07-342e87bf2001, rmtAddr=/127.0.0.1:39265] [21:10:46] : [Step 4/5] [2021-11-19 21:10:46,986][INFO ][tcp-disco-srvr-[:47501]-#1107%grid-1%-#21146%grid-1%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=51833] [21:10:46] : [Step 4/5] [2021-11-19 21:10:46,986][INFO ][tcp-disco-srvr-[:47501]-#1107%grid-1%-#21146%grid-1%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=51833] [21:10:46] : [Step 4/5] [2021-11-19 21:10:46,987][INFO ][tcp-disco-sock-reader-[]-#1109%grid-1%-#21148%grid-1%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:51833, rmtPort=51833] [21:10:46] : [Step 4/5] [2021-11-19 21:10:46,987][INFO ][tcp-disco-sock-reader-[]-#1109%grid-1%-#21148%grid-1%][TestTcpDiscoverySpi] Received ping request from the remote node [rmtNodeId=00245d3d-89f6-46c0-9396-bcd0247bd000, rmtAddr=/127.0.0.1:51833, rmtPort=51833] [21:10:46] : [Step 4/5] [2021-11-19 21:10:46,989][INFO ][tcp-disco-sock-reader-[]-#1109%grid-1%-#21148%grid-1%][TestTcpDiscoverySpi] Finished writing ping response [rmtNodeId=00245d3d-89f6-46c0-9396-bcd0247bd000, rmtAddr=/127.0.0.1:51833, rmtPort=51833] [21:10:46] : [Step 4/5] [2021-11-19 21:10:46,989][INFO ][tcp-disco-sock-reader-[105bed7a 127.0.0.1:39265]-#1108%grid-0%-#21147%grid-0%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:39265, rmtPort=39265, rmtNodeId=105bed7a-e976-48cd-8c07-342e87bf2001] [21:10:46]W: [org.apache.ignite:ignite-core] [2021-11-19 21:10:46,989][WARN ][tcp-disco-sock-reader-[]-#1109%grid-1%-#21148%grid-1%][TestTcpDiscoverySpi] Failed to shutdown socket [21:10:46]W: [org.apache.ignite:ignite-core] java.net.SocketException: Socket output is already shutdown [21:10:46]W: [org.apache.ignite:ignite-core] at java.net.Socket.shutdownOutput(Socket.java:1572) [21:10:46] : [Step 4/5] [2021-11-19 21:10:46,992][INFO ][tcp-disco-sock-reader-[]-#1109%grid-1%-#21148%grid-1%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:51833, rmtPort=51833, rmtNodeId=null] [21:10:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.close(IgniteUtils.java:4247) [21:10:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.discovery.tcp.ServerImpl$SocketReader.body(ServerImpl.java:7370) [21:10:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.IgniteSpiThread.run(IgniteSpiThread.java:58) [21:10:46] : [Step 4/5] [2021-11-19 21:10:46,993][INFO ][tcp-disco-msg-worker-[crd]-#1101%grid-0%-#21026%grid-0%][GridEncryptionManager] Joining node doesn't have stored group keys [node=105bed7a-e976-48cd-8c07-342e87bf2001] [21:10:47] : [Step 4/5] [2021-11-19 21:10:47,003][INFO ][tcp-disco-msg-worker-[crd]-#1101%grid-0%-#21026%grid-0%][TestTcpDiscoverySpi] New next node [newNext=TcpDiscoveryNode [id=105bed7a-e976-48cd-8c07-342e87bf2001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=0, intOrder=2, lastExchangeTime=1637345446981, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false]] [21:10:47] : [Step 4/5] [2021-11-19 21:10:47,004][INFO ][tcp-disco-srvr-[:47501]-#1107%grid-1%-#21146%grid-1%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=40465] [21:10:47] : [Step 4/5] [2021-11-19 21:10:47,004][INFO ][tcp-disco-srvr-[:47501]-#1107%grid-1%-#21146%grid-1%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=40465] [21:10:47] : [Step 4/5] [2021-11-19 21:10:47,005][INFO ][tcp-disco-sock-reader-[]-#1110%grid-1%-#21149%grid-1%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:40465, rmtPort=40465] [21:10:47] : [Step 4/5] [2021-11-19 21:10:47,006][INFO ][tcp-disco-sock-reader-[00245d3d 127.0.0.1:40465]-#1110%grid-1%-#21149%grid-1%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=00245d3d-89f6-46c0-9396-bcd0247bd000, rmtAddr=/127.0.0.1:40465] [21:10:47] : [Step 4/5] [2021-11-19 21:10:47,009][INFO ][tcp-disco-msg-worker-[]-#1106%grid-1%-#21145%grid-1%][TestTcpDiscoverySpi] New next node [newNext=TcpDiscoveryNode [id=00245d3d-89f6-46c0-9396-bcd0247bd000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345447001, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false]] [21:10:47] : [Step 4/5] [2021-11-19 21:10:47,010][INFO ][tcp-disco-srvr-[:47500]-#1102%grid-0%-#21027%grid-0%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=42161] [21:10:47] : [Step 4/5] [2021-11-19 21:10:47,010][INFO ][tcp-disco-srvr-[:47500]-#1102%grid-0%-#21027%grid-0%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=42161] [21:10:47] : [Step 4/5] [2021-11-19 21:10:47,010][INFO ][tcp-disco-sock-reader-[]-#1111%grid-0%-#21150%grid-0%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:42161, rmtPort=42161] [21:10:47] : [Step 4/5] [2021-11-19 21:10:47,012][INFO ][tcp-disco-sock-reader-[105bed7a 127.0.0.1:42161]-#1111%grid-0%-#21150%grid-0%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=105bed7a-e976-48cd-8c07-342e87bf2001, rmtAddr=/127.0.0.1:42161] [21:10:47] : [Step 4/5] [2021-11-19 21:10:47,014][INFO ][disco-event-worker-#21029%grid-0%][GridDiscoveryManager] Added new node to topology: TcpDiscoveryNode [id=105bed7a-e976-48cd-8c07-342e87bf2001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637345446981, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false] [21:10:47] : [Step 4/5] [2021-11-19 21:10:47,015][INFO ][disco-event-worker-#21029%grid-0%][GridDiscoveryManager] Topology snapshot [ver=2, locNode=00245d3d, servers=2, clients=0, state=INACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=00245d3d-89f6-46c0-9396-bcd0247bd000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=105bed7a-e976-48cd-8c07-342e87bf2001, consistentId=grid-1, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:10:47] : [Step 4/5] [2021-11-19 21:10:47,018][INFO ][tcp-disco-msg-worker-[00245d3d 127.0.0.1:47500]-#1106%grid-1%-#21145%grid-1%][ClusterProcessor] beautiful_hoover [21:10:47] : [Step 4/5] [2021-11-19 21:10:47,018][INFO ][tcp-disco-msg-worker-[00245d3d 127.0.0.1:47500]-#1106%grid-1%-#21145%grid-1%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustEnabled' was changed from 'null' to 'false' [21:10:47] : [Step 4/5] [2021-11-19 21:10:47,019][INFO ][tcp-disco-msg-worker-[00245d3d 127.0.0.1:47500]-#1106%grid-1%-#21145%grid-1%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustTimeout' was changed from 'null' to '300000' [21:10:47] : [Step 4/5] [2021-11-19 21:10:47,019][INFO ][tcp-disco-msg-worker-[00245d3d 127.0.0.1:47500]-#1106%grid-1%-#21145%grid-1%][IgniteTxManager] Transactions parameter 'longOperationsDumpTimeout' was changed from 'null' to '60000' [21:10:47] : [Step 4/5] [2021-11-19 21:10:47,019][INFO ][tcp-disco-msg-worker-[00245d3d 127.0.0.1:47500]-#1106%grid-1%-#21145%grid-1%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpThreshold' was changed from 'null' to '0' [21:10:47] : [Step 4/5] [2021-11-19 21:10:47,020][INFO ][tcp-disco-msg-worker-[00245d3d 127.0.0.1:47500]-#1106%grid-1%-#21145%grid-1%][IgniteTxManager] Transactions parameter 'transactionTimeDumpSamplesCoefficient' was changed from 'null' to '0.0' [21:10:47] : [Step 4/5] [2021-11-19 21:10:47,020][INFO ][tcp-disco-msg-worker-[00245d3d 127.0.0.1:47500]-#1106%grid-1%-#21145%grid-1%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpSamplesPerSecondLimit' was changed from 'null' to '5' [21:10:47] : [Step 4/5] [2021-11-19 21:10:47,021][INFO ][tcp-disco-msg-worker-[00245d3d 127.0.0.1:47500]-#1106%grid-1%-#21145%grid-1%][IgniteTxManager] Transactions parameter 'collisionsDumpInterval' was changed from 'null' to '1000' [21:10:47] : [Step 4/5] [2021-11-19 21:10:47,021][INFO ][tcp-disco-msg-worker-[00245d3d 127.0.0.1:47500]-#1106%grid-1%-#21145%grid-1%][IgniteTxManager] Transactions parameter 'txOwnerDumpRequestsAllowed' was changed from 'null' to 'true' [21:10:47] : [Step 4/5] [2021-11-19 21:10:47,022][INFO ][tcp-disco-msg-worker-[00245d3d 127.0.0.1:47500]-#1106%grid-1%-#21145%grid-1%][GridCacheDatabaseSharedManager] Historical rebalance WAL threshold changed [property=historical.rebalance.threshold, oldVal=null, newVal=500] [21:10:47] : [Step 4/5] [2021-11-19 21:10:47,023][INFO ][disco-notifier-worker-#21144%grid-1%][MvccProcessorImpl] Assigned mvcc coordinator [crd=MvccCoordinator [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=0], nodeId=00245d3d-89f6-46c0-9396-bcd0247bd000, ver=1637345446578, local=false, initialized=false]] [21:10:47] : [Step 4/5] [2021-11-19 21:10:47,024][INFO ][sys-#21124%grid-1%][ClusterProcessor] Writing cluster ID and tag to metastorage on ready for write ClusterIdAndTag [id=d918997f-b62b-453a-8ae5-cc339ea6deb2, tag=beautiful_hoover] [21:10:47] : [Step 4/5] [2021-11-19 21:10:47,037][INFO ][test-runner-#20913%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] To start Console Management & Monitoring run ignitevisorcmd.{sh|bat} [21:10:47] : [Step 4/5] [2021-11-19 21:10:47,038][INFO ][test-runner-#20913%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] [21:10:47] : [Step 4/5] [21:10:47] : [Step 4/5] >>> +-------------------------------------------+ [21:10:47] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:10:47] : [Step 4/5] >>> +-------------------------------------------+ [21:10:47] : [Step 4/5] >>> OS name: Linux 4.15.0-151-generic amd64 [21:10:47] : [Step 4/5] >>> CPU(s): 24 [21:10:47] : [Step 4/5] >>> Heap: 2.0GB [21:10:47] : [Step 4/5] >>> VM name: 16724@c4dfe9a430b2 [21:10:47] : [Step 4/5] >>> Ignite instance name: grid-1 [21:10:47] : [Step 4/5] >>> Local node [ID=105BED7A-E976-48CD-8C07-342E87BF2001, order=2, clientMode=false] [21:10:47] : [Step 4/5] >>> Local node addresses: [127.0.0.1] [21:10:47] : [Step 4/5] >>> Local ports: TCP:10801 TCP:47101 TCP:47501 [21:10:47] : [Step 4/5] [21:10:47] : [Step 4/5] [2021-11-19 21:10:47,039][INFO ][test-runner-#20913%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] >>> Ignite cluster is in INACTIVE state (limited functionality available). Use control.(sh|bat) script or IgniteCluster.state(ClusterState.ACTIVE) to change the state. [21:10:47] : [Step 4/5] [2021-11-19 21:10:47,040][INFO ][test-runner-#20913%encryption.CacheGroupKeyChangeTest%][GridDiscoveryManager] Topology snapshot [ver=2, locNode=105bed7a, servers=2, clients=0, state=INACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=00245d3d-89f6-46c0-9396-bcd0247bd000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=105bed7a-e976-48cd-8c07-342e87bf2001, consistentId=grid-1, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:10:47] : [Step 4/5] [2021-11-19 21:10:47,041][INFO ][test-runner-#20913%encryption.CacheGroupKeyChangeTest%][G] Node started : [stage="Configure system pool" (0 ms),stage="Start managers" (188 ms),stage="Configure binary metadata" (1 ms),stage="Start processors" (33 ms),stage="Start 'StanByClusterTestProvider' plugin" (0 ms),stage="Start 'PageMemory tracker plugin' plugin" (0 ms),stage="Start 'TestDistibutedConfigurationPlugin' plugin" (0 ms),stage="Start 'NodeValidationPluginProvider' plugin" (0 ms),stage="Init metastore" (68 ms),stage="Init and start regions" (8 ms),stage="Restore binary memory" (14 ms),stage="Restore logical state" (6 ms),stage="Finish recovery" (45 ms),stage="Join topology" (50 ms),stage="Await transition" (2 ms),stage="Await exchange" (15 ms),stage="Total time" (430 ms)] [21:10:47] : [Step 4/5] [2021-11-19 21:10:47,043][INFO ][test-runner-#20913%encryption.CacheGroupKeyChangeTest%][root] Node started with the following configuration [id=105bed7a-e976-48cd-8c07-342e87bf2001, marshaller=BinaryMarshaller [], discovery=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=5000, ackTimeout=5000, marsh=JdkMarshaller [clsFilter=org.apache.ignite.marshaller.MarshallerUtils$1@782e5e1f], reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], binaryCfg=null, lateAff=true] [21:10:47] : [Step 4/5] [2021-11-19 21:10:47,044][INFO ][test-runner-#20913%encryption.CacheGroupKeyChangeTest%][GridClusterStateProcessor] Sending activate cluster request with BaselineTopology BaselineTopology [id=0, branchingHash=-2475315501, branchingType='New BaselineTopology', baselineNodes=[grid-1, grid-0]] [21:10:47] : [Step 4/5] [2021-11-19 21:10:47,048][INFO ][disco-notifier-worker-#21025%grid-0%][GridClusterStateProcessor] Received activate cluster request with BaselineTopology[id=0] initiator node ID: 00245d3d-89f6-46c0-9396-bcd0247bd000 [21:10:47] : [Step 4/5] [2021-11-19 21:10:47,049][INFO ][disco-notifier-worker-#21025%grid-0%][GridClusterStateProcessor] Started state transition: activate cluster [21:10:47] : [Step 4/5] [2021-11-19 21:10:47,049][INFO ][exchange-worker-#21030%grid-0%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], crd=true, evt=DISCOVERY_CUSTOM_EVT, evtNode=00245d3d-89f6-46c0-9396-bcd0247bd000, customEvt=ChangeGlobalStateMessage [id=fa08d593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqId=b9ab407d-bb39-44e4-a5f3-336d38059ff3, initiatingNodeId=00245d3d-89f6-46c0-9396-bcd0247bd000, state=ACTIVE, baselineTopology=BaselineTopology [id=0, branchingHash=-2475315501, branchingType='New BaselineTopology', baselineNodes=[grid-1, grid-0]], forceChangeBaselineTopology=false, timestamp=1637345447044, forceDeactivation=true], allowMerge=false, exchangeFreeSwitch=false] [21:10:47] : [Step 4/5] [2021-11-19 21:10:47,049][INFO ][disco-notifier-worker-#21144%grid-1%][GridClusterStateProcessor] Received activate cluster request with BaselineTopology[id=0] initiator node ID: 00245d3d-89f6-46c0-9396-bcd0247bd000 [21:10:47] : [Step 4/5] [2021-11-19 21:10:47,051][INFO ][disco-notifier-worker-#21144%grid-1%][GridClusterStateProcessor] Started state transition: activate cluster [21:10:47] : [Step 4/5] [2021-11-19 21:10:47,051][INFO ][exchange-worker-#21030%grid-0%][GridDhtPartitionsExchangeFuture] Start activation process [nodeId=00245d3d-89f6-46c0-9396-bcd0247bd000, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]]. New state: ACTIVE [21:10:47] : [Step 4/5] [2021-11-19 21:10:47,052][INFO ][exchange-worker-#21030%grid-0%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0 [21:10:47] : [Step 4/5] [2021-11-19 21:10:47,052][INFO ][exchange-worker-#21153%grid-1%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], crd=false, evt=DISCOVERY_CUSTOM_EVT, evtNode=00245d3d-89f6-46c0-9396-bcd0247bd000, customEvt=ChangeGlobalStateMessage [id=fa08d593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqId=b9ab407d-bb39-44e4-a5f3-336d38059ff3, initiatingNodeId=00245d3d-89f6-46c0-9396-bcd0247bd000, state=ACTIVE, baselineTopology=BaselineTopology [id=0, branchingHash=-2475315501, branchingType='New BaselineTopology', baselineNodes=[grid-1, grid-0]], forceChangeBaselineTopology=false, timestamp=1637345447044, forceDeactivation=true], allowMerge=false, exchangeFreeSwitch=false] [21:10:47] : [Step 4/5] [2021-11-19 21:10:47,054][INFO ][exchange-worker-#21030%grid-0%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000000.wal, offset=8795, ver=2] [21:10:47] : [Step 4/5] [2021-11-19 21:10:47,054][INFO ][exchange-worker-#21153%grid-1%][GridDhtPartitionsExchangeFuture] Start activation process [nodeId=105bed7a-e976-48cd-8c07-342e87bf2001, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]]. New state: ACTIVE [21:10:47] : [Step 4/5] [2021-11-19 21:10:47,056][INFO ][exchange-worker-#21030%grid-0%][GridClusterStateProcessor] Writing BaselineTopology[id=0] [21:10:47] : [Step 4/5] [2021-11-19 21:10:47,056][INFO ][exchange-worker-#21153%grid-1%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1 [21:10:47] : [Step 4/5] [2021-11-19 21:10:47,058][INFO ][exchange-worker-#21030%grid-0%][GridCacheDatabaseSharedManager] Finish recovery performed in 5 ms. [21:10:47] : [Step 4/5] [2021-11-19 21:10:47,058][INFO ][exchange-worker-#21153%grid-1%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000000.wal, offset=8795, ver=2] [21:10:47] : [Step 4/5] [2021-11-19 21:10:47,059][INFO ][exchange-worker-#21030%grid-0%][msg] Components activation performed in 7 ms. [21:10:47] : [Step 4/5] [2021-11-19 21:10:47,060][INFO ][exchange-worker-#21153%grid-1%][GridClusterStateProcessor] Writing BaselineTopology[id=0] [21:10:47] : [Step 4/5] [2021-11-19 21:10:47,060][INFO ][exchange-worker-#21030%grid-0%][GridCacheProcessor] Finished recovery for cache [cache=ignite-sys-cache, grp=ignite-sys-cache, startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:10:47] : [Step 4/5] [2021-11-19 21:10:47,061][INFO ][exchange-worker-#21030%grid-0%][GridDhtPartitionsExchangeFuture] Successfully activated caches [nodeId=00245d3d-89f6-46c0-9396-bcd0247bd000, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], newState=ACTIVE] [21:10:47] : [Step 4/5] [2021-11-19 21:10:47,062][INFO ][exchange-worker-#21153%grid-1%][GridCacheDatabaseSharedManager] Finish recovery performed in 5 ms. [21:10:47] : [Step 4/5] [2021-11-19 21:10:47,062][INFO ][exchange-worker-#21030%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:10:47] : [Step 4/5] [2021-11-19 21:10:47,063][INFO ][exchange-worker-#21153%grid-1%][msg] Components activation performed in 7 ms. [21:10:47] : [Step 4/5] [2021-11-19 21:10:47,092][INFO ][exchange-worker-#21153%grid-1%][GridCacheProcessor] Finished recovery for cache [cache=ignite-sys-cache, grp=ignite-sys-cache, startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:10:47] : [Step 4/5] [2021-11-19 21:10:47,093][INFO ][exchange-worker-#21153%grid-1%][GridDhtPartitionsExchangeFuture] Successfully activated caches [nodeId=105bed7a-e976-48cd-8c07-342e87bf2001, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], newState=ACTIVE] [21:10:47] : [Step 4/5] [2021-11-19 21:10:47,094][INFO ][exchange-worker-#21153%grid-1%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:10:47] : [Step 4/5] [2021-11-19 21:10:47,098][INFO ][exchange-worker-#21030%grid-0%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], crd=true] [21:10:47] : [Step 4/5] [2021-11-19 21:10:47,104][INFO ][grid-nio-worker-tcp-comm-0-#20968%TestRecordingCommunicationSpi%][TestRecordingCommunicationSpi] Accepted incoming communication connection [locAddr=/127.0.0.1:47100, rmtAddr=/127.0.0.1:33174] [21:10:47] : [Step 4/5] [2021-11-19 21:10:47,105][INFO ][grid-nio-worker-tcp-comm-0-#21087%TestRecordingCommunicationSpi%][TestRecordingCommunicationSpi] Established outgoing communication connection [locAddr=/127.0.0.1:33174, rmtAddr=/127.0.0.1:47100] [21:10:47] : [Step 4/5] [2021-11-19 21:10:47,106][INFO ][exchange-worker-#21153%grid-1%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], crd=false] [21:10:47] : [Step 4/5] [2021-11-19 21:10:47,107][INFO ][sys-#21011%grid-0%][GridDhtPartitionsExchangeFuture] Coordinator received single message [ver=AffinityTopologyVersion [topVer=2, minorTopVer=1], node=105bed7a-e976-48cd-8c07-342e87bf2001, allReceived=true] [21:10:47] : [Step 4/5] [2021-11-19 21:10:47,108][INFO ][sys-#21011%grid-0%][GridDhtPartitionsExchangeFuture] finishExchangeOnCoordinator [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:10:47] : [Step 4/5] [2021-11-19 21:10:47,112][INFO ][sys-#21011%grid-0%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], err=null, rebalanced=true, wasRebalanced=false] [21:10:47] : [Step 4/5] [2021-11-19 21:10:47,112][INFO ][disco-notifier-worker-#21025%grid-0%][GridClusterStateProcessor] Received state change finish message: ACTIVE [21:10:47] : [Step 4/5] [2021-11-19 21:10:47,113][INFO ][disco-notifier-worker-#21025%grid-0%][GridClusterStateProcessor] Cluster state was changed from INACTIVE to ACTIVE [21:10:47] : [Step 4/5] [2021-11-19 21:10:47,113][INFO ][sys-#21132%grid-1%][GridDhtPartitionsExchangeFuture] Received full message, will finish exchange [node=00245d3d-89f6-46c0-9396-bcd0247bd000, resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:10:47] : [Step 4/5] [2021-11-19 21:10:47,116][INFO ][sys-#21143%grid-1%][GridCachePartitionExchangeManager] Delay process full message without exchange id (there is exchange in progress) [nodeId=00245d3d-89f6-46c0-9396-bcd0247bd000] [21:10:47] : [Step 4/5] [2021-11-19 21:10:47,116][INFO ][sys-#21011%grid-0%][GridCacheProcessor] Finish proxy initialization, cacheName=ignite-sys-cache, localNodeId=00245d3d-89f6-46c0-9396-bcd0247bd000 [21:10:47] : [Step 4/5] [2021-11-19 21:10:47,114][INFO ][disco-notifier-worker-#21144%grid-1%][GridClusterStateProcessor] Received state change finish message: ACTIVE [21:10:47] : [Step 4/5] [2021-11-19 21:10:47,117][INFO ][sys-#21023%grid-0%][DistributedBaselineConfiguration] Baseline auto-adjust is 'disabled' with timeout='300000' ms [21:10:47] : [Step 4/5] [2021-11-19 21:10:47,117][INFO ][sys-#21023%grid-0%][GridClusterStateProcessor] Successfully performed final activation steps [nodeId=00245d3d-89f6-46c0-9396-bcd0247bd000, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:10:47] : [Step 4/5] [2021-11-19 21:10:47,117][INFO ][exchange-worker-#21030%grid-0%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=2, minorTopVer=1], force=false, evt=DISCOVERY_CUSTOM_EVT, node=00245d3d-89f6-46c0-9396-bcd0247bd000] [21:10:47] : [Step 4/5] [2021-11-19 21:10:47,116][INFO ][sys-#21132%grid-1%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], err=null, rebalanced=true, wasRebalanced=false] [21:10:47] : [Step 4/5] [2021-11-19 21:10:47,117][INFO ][sys-#21011%grid-0%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=00245d3d-89f6-46c0-9396-bcd0247bd000, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=00245d3d-89f6-46c0-9396-bcd0247bd000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345447113, loc=true, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:10:47] : [Step 4/5] [2021-11-19 21:10:47,117][INFO ][disco-notifier-worker-#21144%grid-1%][GridClusterStateProcessor] Cluster state was changed from INACTIVE to ACTIVE [21:10:47] : [Step 4/5] [2021-11-19 21:10:47,120][INFO ][sys-#21011%grid-0%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (1 ms), stage="Update caches registry" (9 ms), stage="Start caches" (0 ms), stage="Affinity initialization on cache group start" (0 ms), stage="Determine exchange type" (1 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (29 ms), stage="Restore partition states" (0 ms), stage="After states restored callback" (6 ms), stage="WAL history reservation" (0 ms), stage="Waiting for all single messages" (9 ms), stage="Affinity recalculation (crd)" (0 ms), stage="Collect update counters and create affinity messages" (0 ms), stage="Assign partitions states" (0 ms), stage="Validate partitions states" (0 ms), stage="Ideal affinity diff calculation (enforced)" (0 ms), stage="Apply update counters" (0 ms), stage="Full message preparing" (2 ms), stage="Full message sending" (0 ms), stage="State finish message sending" (0 ms), stage="Detect lost partitions" (2 ms), stage="Exchange done" (5 ms), stage="Total time" (64 ms), Discovery lag=3 ms, Latest started node id=105bed7a-e976-48cd-8c07-342e87bf2001] [21:10:47] : [Step 4/5] [2021-11-19 21:10:47,120][INFO ][sys-#21132%grid-1%][GridCacheProcessor] Finish proxy initialization, cacheName=ignite-sys-cache, localNodeId=105bed7a-e976-48cd-8c07-342e87bf2001 [21:10:47] : [Step 4/5] [2021-11-19 21:10:47,123][INFO ][sys-#21011%grid-0%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], stage="Affinity initialization on cache group start [grp=ignite-sys-cache]" (0 ms) (parent=Affinity initialization on cache group start), stage="Affinity centralized initialization (crd) [grp=ignite-sys-cache, crd=true]" (1 ms) (parent=Determine exchange type), stage="Restore partition states [grp=ignite-sys-cache]" (0 ms) (parent=Restore partition states), stage="Affinity recalculation (partitions availability) [grp=ignite-sys-cache]" (0 ms) (parent=Ideal affinity diff calculation (enforced))] [21:10:47] : [Step 4/5] [2021-11-19 21:10:47,125][INFO ][test-runner-#20913%encryption.CacheGroupKeyChangeTest%][root] awaitPartitionMapExchange finished [21:10:47] : [Step 4/5] [2021-11-19 21:10:47,124][INFO ][sys-#21132%grid-1%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=105bed7a-e976-48cd-8c07-342e87bf2001, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=00245d3d-89f6-46c0-9396-bcd0247bd000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345447001, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:10:47] : [Step 4/5] [2021-11-19 21:10:47,126][INFO ][sys-#21132%grid-1%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (2 ms), stage="Update caches registry" (37 ms), stage="Start caches" (0 ms), stage="Affinity initialization on cache group start" (0 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Restore partition states" (0 ms), stage="After states restored callback" (7 ms), stage="WAL history reservation" (0 ms), stage="Waiting for Full message" (11 ms), stage="Affinity recalculation" (2 ms), stage="Full map updating" (0 ms), stage="Detect lost partitions" (3 ms), stage="Exchange done" (6 ms), stage="Total time" (68 ms)] [21:10:47] : [Step 4/5] [2021-11-19 21:10:47,124][INFO ][exchange-worker-#21153%grid-1%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=2, minorTopVer=1], force=false, evt=DISCOVERY_CUSTOM_EVT, node=00245d3d-89f6-46c0-9396-bcd0247bd000] [21:10:47] : [Step 4/5] [2021-11-19 21:10:47,124][INFO ][sys-#21138%grid-1%][DistributedBaselineConfiguration] Baseline auto-adjust is 'disabled' with timeout='300000' ms [21:10:47] : [Step 4/5] [2021-11-19 21:10:47,127][INFO ][sys-#21132%grid-1%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], stage="Affinity initialization on cache group start [grp=ignite-sys-cache]" (0 ms) (parent=Affinity initialization on cache group start), stage="Affinity centralized initialization (crd) [grp=ignite-sys-cache, crd=false]" (0 ms) (parent=Determine exchange type), stage="Restore partition states [grp=ignite-sys-cache]" (0 ms) (parent=Restore partition states), stage="Affinity applying from full message [grp=ignite-sys-cache]" (2 ms) (parent=Affinity recalculation)] [21:10:47] : [Step 4/5] [2021-11-19 21:10:47,130][INFO ][exchange-worker-#21030%grid-0%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], crd=true, evt=DISCOVERY_CUSTOM_EVT, evtNode=00245d3d-89f6-46c0-9396-bcd0247bd000, customEvt=DynamicCacheChangeBatch [id=3d08d593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqs=ArrayList [DynamicCacheChangeRequest [cacheName=encrypted, hasCfg=true, nodeId=00245d3d-89f6-46c0-9396-bcd0247bd000, clientStartOnly=false, stop=false, destroy=false, disabledAfterStart=false]], exchangeActions=ExchangeActions [startCaches=[encrypted], stopCaches=null, startGrps=[shared], stopGrps=[], resetParts=null, stateChangeRequest=null], startCaches=false], allowMerge=false, exchangeFreeSwitch=false] [21:10:47] : [Step 4/5] [2021-11-19 21:10:47,130][INFO ][exchange-worker-#21153%grid-1%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], crd=false, evt=DISCOVERY_CUSTOM_EVT, evtNode=00245d3d-89f6-46c0-9396-bcd0247bd000, customEvt=DynamicCacheChangeBatch [id=3d08d593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqs=ArrayList [DynamicCacheChangeRequest [cacheName=encrypted, hasCfg=true, nodeId=00245d3d-89f6-46c0-9396-bcd0247bd000, clientStartOnly=false, stop=false, destroy=false, disabledAfterStart=false]], exchangeActions=ExchangeActions [startCaches=[encrypted], stopCaches=null, startGrps=[shared], stopGrps=[], resetParts=null, stateChangeRequest=null], startCaches=false], allowMerge=false, exchangeFreeSwitch=false] [21:10:47] : [Step 4/5] [2021-11-19 21:10:47,128][INFO ][sys-#21138%grid-1%][GridClusterStateProcessor] Successfully performed final activation steps [nodeId=105bed7a-e976-48cd-8c07-342e87bf2001, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:10:47] : [Step 4/5] [2021-11-19 21:10:47,134][INFO ][exchange-worker-#21030%grid-0%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:10:47] : [Step 4/5] [2021-11-19 21:10:47,134][INFO ][exchange-worker-#21153%grid-1%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:10:47] : [Step 4/5] [2021-11-19 21:10:47,164][INFO ][exchange-worker-#21030%grid-0%][GridCacheProcessor] Started cache [name=encrypted, id=1613773252, group=shared, dataRegionName=default, mode=PARTITIONED, atomicity=ATOMIC, backups=0, mvcc=false] [21:10:47] : [Step 4/5] [2021-11-19 21:10:47,164][INFO ][exchange-worker-#21153%grid-1%][GridCacheProcessor] Started cache [name=encrypted, id=1613773252, group=shared, dataRegionName=default, mode=PARTITIONED, atomicity=ATOMIC, backups=0, mvcc=false] [21:10:47] : [Step 4/5] [2021-11-19 21:10:47,164][INFO ][exchange-worker-#21030%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], waitTime=0ms, futInfo=NA, mode=DISTRIBUTED] [21:10:47] : [Step 4/5] [2021-11-19 21:10:47,164][INFO ][exchange-worker-#21153%grid-1%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], waitTime=0ms, futInfo=NA, mode=DISTRIBUTED] [21:10:47] : [Step 4/5] [2021-11-19 21:10:47,165][INFO ][exchange-worker-#21030%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partitions release latch: ServerLatch [permits=0, pendingAcks=HashSet [], super=CompletableLatch [id=CompletableLatchUid [id=exchange, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2]]]] [21:10:47] : [Step 4/5] [2021-11-19 21:10:47,166][INFO ][exchange-worker-#21030%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:10:47] : [Step 4/5] [2021-11-19 21:10:47,166][INFO ][exchange-worker-#21153%grid-1%][GridDhtPartitionsExchangeFuture] Finished waiting for partitions release latch: ClientLatch [coordinator=TcpDiscoveryNode [id=00245d3d-89f6-46c0-9396-bcd0247bd000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345447001, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], ackSent=true, super=CompletableLatch [id=CompletableLatchUid [id=exchange, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2]]]] [21:10:47] : [Step 4/5] [2021-11-19 21:10:47,167][INFO ][exchange-worker-#21153%grid-1%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:10:47] : [Step 4/5] [2021-11-19 21:10:47,167][INFO ][exchange-worker-#21030%grid-0%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], crd=true] [21:10:47] : [Step 4/5] [2021-11-19 21:10:47,168][INFO ][exchange-worker-#21153%grid-1%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], crd=false] [21:10:47] : [Step 4/5] [2021-11-19 21:10:47,169][INFO ][sys-#21009%grid-0%][GridDhtPartitionsExchangeFuture] Coordinator received single message [ver=AffinityTopologyVersion [topVer=2, minorTopVer=2], node=105bed7a-e976-48cd-8c07-342e87bf2001, allReceived=true] [21:10:47] : [Step 4/5] [2021-11-19 21:10:47,169][INFO ][sys-#21009%grid-0%][GridDhtPartitionsExchangeFuture] finishExchangeOnCoordinator [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2]] [21:10:47] : [Step 4/5] [2021-11-19 21:10:47,172][INFO ][sys-#21009%grid-0%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], err=null, rebalanced=true, wasRebalanced=true] [21:10:47] : [Step 4/5] [2021-11-19 21:10:47,173][INFO ][sys-#21009%grid-0%][GridCacheProcessor] Finish proxy initialization, cacheName=encrypted, localNodeId=00245d3d-89f6-46c0-9396-bcd0247bd000 [21:10:47] : [Step 4/5] [2021-11-19 21:10:47,173][INFO ][sys-#21128%grid-1%][GridDhtPartitionsExchangeFuture] Received full message, will finish exchange [node=00245d3d-89f6-46c0-9396-bcd0247bd000, resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2]] [21:10:47] : [Step 4/5] [2021-11-19 21:10:47,174][INFO ][exchange-worker-#21030%grid-0%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=2, minorTopVer=2], force=false, evt=DISCOVERY_CUSTOM_EVT, node=00245d3d-89f6-46c0-9396-bcd0247bd000] [21:10:47] : [Step 4/5] [2021-11-19 21:10:47,173][INFO ][sys-#21009%grid-0%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=00245d3d-89f6-46c0-9396-bcd0247bd000, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=00245d3d-89f6-46c0-9396-bcd0247bd000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345447124, loc=true, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2]] [21:10:47] : [Step 4/5] [2021-11-19 21:10:47,176][INFO ][sys-#21009%grid-0%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (1 ms), stage="Update caches registry" (0 ms), stage="Start caches" (32 ms), stage="Affinity initialization on cache group start" (0 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Wait partitions release latch [latch=exchange]" (1 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Restore partition states" (0 ms), stage="After states restored callback" (0 ms), stage="WAL history reservation" (0 ms), stage="Waiting for all single messages" (2 ms), stage="Affinity recalculation (crd)" (0 ms), stage="Collect update counters and create affinity messages" (0 ms), stage="Assign partitions states" (0 ms), stage="Validate partitions states" (0 ms), stage="Apply update counters" (0 ms), stage="Full message preparing" (2 ms), stage="Full message sending" (0 ms), stage="Exchange done" (3 ms), stage="Total time" (41 ms)] [21:10:47] : [Step 4/5] [2021-11-19 21:10:47,174][INFO ][sys-#21128%grid-1%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], err=null, rebalanced=true, wasRebalanced=true] [21:10:47] : [Step 4/5] [2021-11-19 21:10:47,178][INFO ][sys-#21009%grid-0%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], stage="Affinity initialization on cache group start [grp=shared]" (0 ms) (parent=Affinity initialization on cache group start), stage="Restore partition states [grp=shared]" (0 ms) (parent=Restore partition states), stage="Restore partition states [grp=ignite-sys-cache]" (0 ms) (parent=Restore partition states)] [21:10:47] : [Step 4/5] [2021-11-19 21:10:47,179][INFO ][sys-#21128%grid-1%][GridCacheProcessor] Finish proxy initialization, cacheName=encrypted, localNodeId=105bed7a-e976-48cd-8c07-342e87bf2001 [21:10:47] : [Step 4/5] [2021-11-19 21:10:47,180][INFO ][sys-#21128%grid-1%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=105bed7a-e976-48cd-8c07-342e87bf2001, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=00245d3d-89f6-46c0-9396-bcd0247bd000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345447001, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2]] [21:10:47] : [Step 4/5] [2021-11-19 21:10:47,181][INFO ][sys-#21128%grid-1%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (3 ms), stage="Update caches registry" (0 ms), stage="Start caches" (31 ms), stage="Affinity initialization on cache group start" (0 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Wait partitions release latch [latch=exchange]" (2 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Restore partition states" (0 ms), stage="After states restored callback" (0 ms), stage="WAL history reservation" (0 ms), stage="Waiting for Full message" (5 ms), stage="Affinity recalculation" (0 ms), stage="Full map updating" (0 ms), stage="Exchange done" (7 ms), stage="Total time" (48 ms)] [21:10:47] : [Step 4/5] [2021-11-19 21:10:47,182][INFO ][sys-#21128%grid-1%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], stage="Affinity initialization on cache group start [grp=shared]" (0 ms) (parent=Affinity initialization on cache group start), stage="Restore partition states [grp=shared]" (0 ms) (parent=Restore partition states), stage="Restore partition states [grp=ignite-sys-cache]" (0 ms) (parent=Restore partition states)] [21:10:47] : [Step 4/5] [2021-11-19 21:10:47,180][INFO ][exchange-worker-#21153%grid-1%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=2, minorTopVer=2], force=false, evt=DISCOVERY_CUSTOM_EVT, node=00245d3d-89f6-46c0-9396-bcd0247bd000] [21:10:47] : [Step 4/5] [2021-11-19 21:10:47,223][INFO ][db-checkpoint-thread-#21164%grid-0%][Checkpointer] Checkpoint started [checkpointId=c816793f-58e5-42c4-92aa-9b767a5c9801, startPtr=WALPointer [idx=0, fileOff=86669, len=1963], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=31ms, writeCheckpointEntryDuration=94ms, splitAndSortCpPagesDuration=0ms, pages=18, reason='node started'] [21:10:47] : [Step 4/5] [2021-11-19 21:10:47,223][INFO ][db-checkpoint-thread-#21169%grid-1%][Checkpointer] Checkpoint started [checkpointId=520d7b18-3850-4ee5-a0f1-05fc43f0a0ad, startPtr=WALPointer [idx=0, fileOff=86669, len=1963], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=28ms, writeCheckpointEntryDuration=94ms, splitAndSortCpPagesDuration=0ms, pages=18, reason='node started'] [21:10:47] : [Step 4/5] [2021-11-19 21:10:47,468][INFO ][disco-notifier-worker-#21144%grid-1%][IgniteTestResources] Block message [node=00245d3d-89f6-46c0-9396-bcd0247bd000, order=1, msg=org.apache.ignite.internal.util.distributed.SingleNodeMessage@71f1a692] [21:10:47] : [Step 4/5] [2021-11-19 21:10:47,470][INFO ][exchange-worker-#21030%grid-0%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=3], crd=true, evt=DISCOVERY_CUSTOM_EVT, evtNode=00245d3d-89f6-46c0-9396-bcd0247bd000, customEvt=DynamicCacheChangeBatch [id=2918d593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqs=ArrayList [DynamicCacheChangeRequest [cacheName=cache1, hasCfg=true, nodeId=00245d3d-89f6-46c0-9396-bcd0247bd000, clientStartOnly=false, stop=false, destroy=false, disabledAfterStart=false]], exchangeActions=ExchangeActions [startCaches=[cache1], stopCaches=null, startGrps=[], stopGrps=[], resetParts=null, stateChangeRequest=null], startCaches=false], allowMerge=false, exchangeFreeSwitch=false] [21:10:47] : [Step 4/5] [2021-11-19 21:10:47,470][INFO ][exchange-worker-#21153%grid-1%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=3], crd=false, evt=DISCOVERY_CUSTOM_EVT, evtNode=00245d3d-89f6-46c0-9396-bcd0247bd000, customEvt=DynamicCacheChangeBatch [id=2918d593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqs=ArrayList [DynamicCacheChangeRequest [cacheName=cache1, hasCfg=true, nodeId=00245d3d-89f6-46c0-9396-bcd0247bd000, clientStartOnly=false, stop=false, destroy=false, disabledAfterStart=false]], exchangeActions=ExchangeActions [startCaches=[cache1], stopCaches=null, startGrps=[], stopGrps=[], resetParts=null, stateChangeRequest=null], startCaches=false], allowMerge=false, exchangeFreeSwitch=false] [21:10:47] : [Step 4/5] [2021-11-19 21:10:47,514][INFO ][exchange-worker-#21030%grid-0%][GridCacheProcessor] Started cache [name=cache1, id=-1368047377, group=shared, dataRegionName=default, mode=PARTITIONED, atomicity=ATOMIC, backups=0, mvcc=false] [21:10:47] : [Step 4/5] [2021-11-19 21:10:47,514][INFO ][exchange-worker-#21153%grid-1%][GridCacheProcessor] Started cache [name=cache1, id=-1368047377, group=shared, dataRegionName=default, mode=PARTITIONED, atomicity=ATOMIC, backups=0, mvcc=false] [21:10:47] : [Step 4/5] [2021-11-19 21:10:47,515][INFO ][exchange-worker-#21030%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=3], waitTime=0ms, futInfo=NA, mode=DISTRIBUTED] [21:10:47] : [Step 4/5] [2021-11-19 21:10:47,515][INFO ][exchange-worker-#21153%grid-1%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=3], waitTime=0ms, futInfo=NA, mode=DISTRIBUTED] [21:10:47] : [Step 4/5] [2021-11-19 21:10:47,516][INFO ][exchange-worker-#21030%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partitions release latch: ServerLatch [permits=0, pendingAcks=HashSet [], super=CompletableLatch [id=CompletableLatchUid [id=exchange, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=3]]]] [21:10:47] : [Step 4/5] [2021-11-19 21:10:47,517][INFO ][exchange-worker-#21030%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=3], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:10:47] : [Step 4/5] [2021-11-19 21:10:47,517][INFO ][exchange-worker-#21153%grid-1%][GridDhtPartitionsExchangeFuture] Finished waiting for partitions release latch: ClientLatch [coordinator=TcpDiscoveryNode [id=00245d3d-89f6-46c0-9396-bcd0247bd000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345447001, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], ackSent=true, super=CompletableLatch [id=CompletableLatchUid [id=exchange, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=3]]]] [21:10:47] : [Step 4/5] [2021-11-19 21:10:47,519][INFO ][exchange-worker-#21030%grid-0%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=3], crd=true] [21:10:47] : [Step 4/5] [2021-11-19 21:10:47,519][INFO ][exchange-worker-#21153%grid-1%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=3], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:10:47] : [Step 4/5] [2021-11-19 21:10:47,521][INFO ][exchange-worker-#21153%grid-1%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=3], crd=false] [21:10:47] : [Step 4/5] [2021-11-19 21:10:47,521][INFO ][sys-#21023%grid-0%][GridDhtPartitionsExchangeFuture] Coordinator received single message [ver=AffinityTopologyVersion [topVer=2, minorTopVer=3], node=105bed7a-e976-48cd-8c07-342e87bf2001, allReceived=true] [21:10:47] : [Step 4/5] [2021-11-19 21:10:47,522][INFO ][sys-#21023%grid-0%][GridDhtPartitionsExchangeFuture] finishExchangeOnCoordinator [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=3], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=3]] [21:10:47] : [Step 4/5] [2021-11-19 21:10:47,525][INFO ][sys-#21023%grid-0%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=3], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=3], err=null, rebalanced=true, wasRebalanced=true] [21:10:47] : [Step 4/5] [2021-11-19 21:10:47,526][INFO ][sys-#21143%grid-1%][GridDhtPartitionsExchangeFuture] Received full message, will finish exchange [node=00245d3d-89f6-46c0-9396-bcd0247bd000, resVer=AffinityTopologyVersion [topVer=2, minorTopVer=3]] [21:10:47] : [Step 4/5] [2021-11-19 21:10:47,527][INFO ][sys-#21023%grid-0%][GridCacheProcessor] Finish proxy initialization, cacheName=cache1, localNodeId=00245d3d-89f6-46c0-9396-bcd0247bd000 [21:10:47] : [Step 4/5] [2021-11-19 21:10:47,528][INFO ][sys-#21143%grid-1%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=3], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=3], err=null, rebalanced=true, wasRebalanced=true] [21:10:47] : [Step 4/5] [2021-11-19 21:10:47,529][INFO ][exchange-worker-#21030%grid-0%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=2, minorTopVer=3], force=false, evt=DISCOVERY_CUSTOM_EVT, node=00245d3d-89f6-46c0-9396-bcd0247bd000] [21:10:47] : [Step 4/5] [2021-11-19 21:10:47,529][INFO ][sys-#21023%grid-0%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=00245d3d-89f6-46c0-9396-bcd0247bd000, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=3], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=00245d3d-89f6-46c0-9396-bcd0247bd000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345447467, loc=true, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=2, minorTopVer=3]] [21:10:47] : [Step 4/5] [2021-11-19 21:10:47,528][INFO ][test-runner-#20913%encryption.CacheGroupKeyChangeTest%][IgniteTestResources] Send blocked message [node=00245d3d-89f6-46c0-9396-bcd0247bd000, order=1, msg=org.apache.ignite.internal.util.distributed.SingleNodeMessage@71f1a692] [21:10:47] : [Step 4/5] [2021-11-19 21:10:47,531][INFO ][sys-#21023%grid-0%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=3], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=3], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (41 ms), stage="Update caches registry" (0 ms), stage="Start caches" (2 ms), stage="Affinity initialization on cache group start" (0 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Wait partitions release latch [latch=exchange]" (1 ms), stage="Wait partitions release [latch=exchange]" (1 ms), stage="After states restored callback" (0 ms), stage="WAL history reservation" (0 ms), stage="Waiting for all single messages" (3 ms), stage="Affinity recalculation (crd)" (0 ms), stage="Collect update counters and create affinity messages" (0 ms), stage="Assign partitions states" (0 ms), stage="Validate partitions states" (0 ms), stage="Apply update counters" (0 ms), stage="Full message preparing" (2 ms), stage="Full message sending" (0 ms), stage="Exchange done" (5 ms), stage="Total time" (55 ms)] [21:10:47] : [Step 4/5] [2021-11-19 21:10:47,529][INFO ][sys-#21143%grid-1%][GridCacheProcessor] Finish proxy initialization, cacheName=cache1, localNodeId=105bed7a-e976-48cd-8c07-342e87bf2001 [21:10:47] : [Step 4/5] [2021-11-19 21:10:47,533][INFO ][sys-#21023%grid-0%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=3], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=3], stage="Affinity initialization on cache group start [grp=shared]" (0 ms) (parent=Affinity initialization on cache group start)] [21:10:47] : [Step 4/5] [2021-11-19 21:10:47,534][INFO ][exchange-worker-#21153%grid-1%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=2, minorTopVer=3], force=false, evt=DISCOVERY_CUSTOM_EVT, node=00245d3d-89f6-46c0-9396-bcd0247bd000] [21:10:47] : [Step 4/5] [2021-11-19 21:10:47,534][INFO ][sys-#21143%grid-1%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=105bed7a-e976-48cd-8c07-342e87bf2001, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=3], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=00245d3d-89f6-46c0-9396-bcd0247bd000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345447001, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=2, minorTopVer=3]] [21:10:47] : [Step 4/5] [2021-11-19 21:10:47,535][INFO ][disco-notifier-worker-#21144%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=-903566235, keyId=1] [21:10:47] : [Step 4/5] [2021-11-19 21:10:47,535][INFO ][disco-notifier-worker-#21025%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=-903566235, keyId=1] [21:10:47] : [Step 4/5] [2021-11-19 21:10:47,537][INFO ][reencrypt-#21185%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=shared] [21:10:47] : [Step 4/5] [2021-11-19 21:10:47,536][INFO ][sys-#21143%grid-1%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=3], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=3], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (42 ms), stage="Update caches registry" (0 ms), stage="Start caches" (1 ms), stage="Affinity initialization on cache group start" (0 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Wait partitions release latch [latch=exchange]" (3 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="After states restored callback" (0 ms), stage="WAL history reservation" (0 ms), stage="Waiting for Full message" (5 ms), stage="Affinity recalculation" (1 ms), stage="Full map updating" (1 ms), stage="Exchange done" (7 ms), stage="Total time" (60 ms)] [21:10:47] : [Step 4/5] [2021-11-19 21:10:47,537][INFO ][reencrypt-#21186%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=shared] [21:10:47] : [Step 4/5] [2021-11-19 21:10:47,539][INFO ][sys-#21143%grid-1%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=3], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=3], stage="Affinity initialization on cache group start [grp=shared]" (0 ms) (parent=Affinity initialization on cache group start)] [21:10:47] : [Step 4/5] [2021-11-19 21:10:47,559][INFO ][db-checkpoint-thread-#21164%grid-0%][Checkpointer] Checkpoint finished [cpId=c816793f-58e5-42c4-92aa-9b767a5c9801, pages=18, markPos=WALPointer [idx=0, fileOff=86669, len=1963], walSegmentsCovered=[], markDuration=126ms, pagesWrite=1ms, fsync=334ms, total=462ms] [21:10:47] : [Step 4/5] [2021-11-19 21:10:47,559][INFO ][db-checkpoint-thread-#21169%grid-1%][Checkpointer] Checkpoint finished [cpId=520d7b18-3850-4ee5-a0f1-05fc43f0a0ad, pages=18, markPos=WALPointer [idx=0, fileOff=86669, len=1963], walSegmentsCovered=[], markDuration=123ms, pagesWrite=4ms, fsync=331ms, total=459ms] [21:10:47] : [Step 4/5] [2021-11-19 21:10:47,575][INFO ][test-runner-#20913%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=105bed7a-e976-48cd-8c07-342e87bf2001, grp=-903566235] [21:10:47] : [Step 4/5] [2021-11-19 21:10:47,637][INFO ][db-checkpoint-thread-#21169%grid-1%][Checkpointer] Checkpoint started [checkpointId=b4f96ca8-4d81-414c-86b1-e2b16a0c9956, startPtr=WALPointer [idx=0, fileOff=228682, len=2048], checkpointBeforeLockTime=2ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=1ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=2ms, writeCheckpointEntryDuration=57ms, splitAndSortCpPagesDuration=0ms, pages=67, reason='test'] [21:10:48] : [Step 4/5] [2021-11-19 21:10:48,737][INFO ][db-checkpoint-thread-#21169%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=shared] [21:10:48] : [Step 4/5] [2021-11-19 21:10:48,738][INFO ][db-checkpoint-thread-#21169%grid-1%][Checkpointer] Checkpoint finished [cpId=b4f96ca8-4d81-414c-86b1-e2b16a0c9956, pages=67, markPos=WALPointer [idx=0, fileOff=228682, len=2048], walSegmentsCovered=[], markDuration=61ms, pagesWrite=3ms, fsync=1097ms, total=1163ms] [21:10:48] : [Step 4/5] [2021-11-19 21:10:48,741][INFO ][test-runner-#20913%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00245d3d-89f6-46c0-9396-bcd0247bd000, grp=-903566235] [21:10:48] : [Step 4/5] [2021-11-19 21:10:48,762][INFO ][db-checkpoint-thread-#21164%grid-0%][Checkpointer] Checkpoint started [checkpointId=586c38b9-3b39-468f-af7f-2e7ed34807b4, startPtr=WALPointer [idx=0, fileOff=184064, len=2010], checkpointBeforeLockTime=2ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=8ms, writeCheckpointEntryDuration=9ms, splitAndSortCpPagesDuration=0ms, pages=45, reason='test'] [21:10:48] : [Step 4/5] [2021-11-19 21:10:48,814][INFO ][db-checkpoint-thread-#21164%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=shared] [21:10:48] : [Step 4/5] [2021-11-19 21:10:48,814][INFO ][db-checkpoint-thread-#21164%grid-0%][Checkpointer] Checkpoint finished [cpId=586c38b9-3b39-468f-af7f-2e7ed34807b4, pages=45, markPos=WALPointer [idx=0, fileOff=184064, len=2010], walSegmentsCovered=[], markDuration=19ms, pagesWrite=2ms, fsync=49ms, total=72ms] [21:10:48] : [Step 4/5] [21:10:48] >>> Stopping test: CacheGroupKeyChangeTest#testCacheStartSameGroupDuringRotation in 3411 ms <<< [21:10:48] : [Step 4/5] [2021-11-19 21:10:48,816][INFO ][main][root] >>> Stopping test: CacheGroupKeyChangeTest#testCacheStartSameGroupDuringRotation in 3411 ms <<< [21:10:48] : [Step 4/5] [21:10:48] >>> Heap: 358 MB used / 1940 MB commited / 1940 MB max <<< [21:10:48] : [Step 4/5] [2021-11-19 21:10:48,818][INFO ][main][root] >>> Heap: 358 MB used / 1940 MB commited / 1940 MB max <<< [21:10:48] : [Step 4/5] [21:10:48] >>> Non-Heap: 158 MB used / 183 MB commited / 0 MB max <<< [21:10:48] : [Step 4/5] [2021-11-19 21:10:48,818][INFO ][main][root] >>> Non-Heap: 158 MB used / 183 MB commited / 0 MB max <<< [21:10:48] : [Step 4/5] [2021-11-19 21:10:48,818][INFO ][main][root] >>> Stopping grid [name=grid-1, id=105bed7a-e976-48cd-8c07-342e87bf2001] [21:10:48] : [Step 4/5] [2021-11-19 21:10:48,826][INFO ][db-checkpoint-thread-#21169%grid-1%][Checkpointer] Skipping checkpoint (no pages were modified) [checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, reason='timeout'] [21:10:48] : [Step 4/5] [2021-11-19 21:10:48,830][INFO ][tcp-disco-sock-reader-[00245d3d 127.0.0.1:40465]-#1110%grid-1%-#21149%grid-1%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:40465, rmtPort=40465, rmtNodeId=00245d3d-89f6-46c0-9396-bcd0247bd000] [21:10:48] : [Step 4/5] [2021-11-19 21:10:48,831][INFO ][disco-event-worker-#21029%grid-0%][GridDiscoveryManager] Node left topology: TcpDiscoveryNode [id=105bed7a-e976-48cd-8c07-342e87bf2001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637345446981, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false] [21:10:48] : [Step 4/5] [2021-11-19 21:10:48,833][INFO ][main][GridCacheProcessor] Stopped cache [cacheName=ignite-sys-cache] [21:10:48] : [Step 4/5] [2021-11-19 21:10:48,833][INFO ][disco-event-worker-#21029%grid-0%][GridDiscoveryManager] Topology snapshot [ver=3, locNode=00245d3d, servers=1, clients=0, state=ACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=00245d3d-89f6-46c0-9396-bcd0247bd000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:10:48] : [Step 4/5] [2021-11-19 21:10:48,834][INFO ][main][GridCacheProcessor] Stopped cache [cacheName=encrypted, group=shared] [21:10:48] : [Step 4/5] [2021-11-19 21:10:48,834][INFO ][disco-event-worker-#21029%grid-0%][GridDiscoveryManager] ^-- Baseline [id=0, size=2, online=1, offline=1] [21:10:48] : [Step 4/5] [2021-11-19 21:10:48,835][INFO ][main][GridCacheProcessor] Stopped cache [cacheName=cache1, group=shared] [21:10:48]W: [org.apache.ignite:ignite-core] [2021-11-19 21:10:48,835][WARN ][grid-nio-worker-tcp-comm-0-#21087%TestRecordingCommunicationSpi%][TestRecordingCommunicationSpi] Failed to shutdown socket [21:10:48]W: [org.apache.ignite:ignite-core] java.nio.channels.ClosedChannelException [21:10:48]W: [org.apache.ignite:ignite-core] at sun.nio.ch.SocketChannelImpl.shutdownOutput(SocketChannelImpl.java:795) [21:10:48]W: [org.apache.ignite:ignite-core] at sun.nio.ch.SocketAdaptor.shutdownOutput(SocketAdaptor.java:407) [21:10:48]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.close(IgniteUtils.java:4247) [21:10:48]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.closeKey(GridNioServer.java:2784) [21:10:48]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.close(GridNioServer.java:2835) [21:10:48]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.close(GridNioServer.java:2794) [21:10:48]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$DirectNioClientWorker.processRead(GridNioServer.java:1357) [21:10:48]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.processSelectedKeysOptimized(GridNioServer.java:2508) [21:10:48]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.bodyInternal(GridNioServer.java:2273) [21:10:48]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.body(GridNioServer.java:1910) [21:10:48]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:125) [21:10:48]W: [org.apache.ignite:ignite-core] at java.lang.Thread.run(Thread.java:748) [21:10:48] : [Step 4/5] [2021-11-19 21:10:48,836][INFO ][exchange-worker-#21030%grid-0%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], crd=true, evt=NODE_LEFT, evtNode=105bed7a-e976-48cd-8c07-342e87bf2001, customEvt=null, allowMerge=false, exchangeFreeSwitch=true] [21:10:48] : [Step 4/5] [2021-11-19 21:10:48,839][INFO ][exchange-worker-#21030%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:10:48] : [Step 4/5] [2021-11-19 21:10:48,841][INFO ][exchange-worker-#21030%grid-0%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], err=null, rebalanced=true, wasRebalanced=true] [21:10:48]W: [org.apache.ignite:ignite-core] [2021-11-19 21:10:48,842][WARN ][exchange-worker-#21030%grid-0%][GridDhtPartitionTopologyImpl] Detected lost partitions [grp=shared, parts=[0, 2, 4, 6-7], topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0]] [21:10:48] : [Step 4/5] [2021-11-19 21:10:48,843][INFO ][exchange-worker-#21030%grid-0%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=00245d3d-89f6-46c0-9396-bcd0247bd000, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], evt=NODE_LEFT, evtNode=TcpDiscoveryNode [id=105bed7a-e976-48cd-8c07-342e87bf2001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637345446981, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0]] [21:10:48] : [Step 4/5] [2021-11-19 21:10:48,844][INFO ][exchange-worker-#21030%grid-0%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (2 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="After states restored callback" (1 ms), stage="WAL history reservation" (0 ms), stage="Finalize update counters" (0 ms), stage="Detect lost partitions" (1 ms), stage="Exchange done" (1 ms), stage="Total time" (5 ms)] [21:10:48] : [Step 4/5] [2021-11-19 21:10:48,846][INFO ][exchange-worker-#21030%grid-0%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], stage="Affinity initialization (exchange-free switch on fully-rebalanced topology) [grp=shared]" (0 ms) (parent=Determine exchange type), stage="Affinity initialization (exchange-free switch on fully-rebalanced topology) [grp=ignite-sys-cache]" (0 ms) (parent=Determine exchange type)] [21:10:48] : [Step 4/5] [2021-11-19 21:10:48,848][INFO ][exchange-worker-#21030%grid-0%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], crd=true] [21:10:48] : [Step 4/5] [2021-11-19 21:10:48,848][INFO ][exchange-worker-#21030%grid-0%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=3, minorTopVer=0], force=false, evt=NODE_LEFT, node=105bed7a-e976-48cd-8c07-342e87bf2001] [21:10:48] : [Step 4/5] [2021-11-19 21:10:48,849][INFO ][main][FilePageStoreManager] Cleanup cache stores [total=4, left=0, cleanFiles=false] [21:10:48] : [Step 4/5] [2021-11-19 21:10:48,851][INFO ][main][GridDeploymentLocalStore] Removed undeployed class: GridDeployment [ts=1637345447103, depMode=SHARED, clsLdr=IsolatedClassLoader{roleName='test'}, clsLdrId=db08d593d71-105bed7a-e976-48cd-8c07-342e87bf2001, userVer=0, loc=true, sampleClsName=org.apache.ignite.internal.processors.cache.distributed.dht.preloader.IgniteDhtPartitionCountersMap2, pendingUndeploy=false, undeployed=true, usage=0] [21:10:48] : [Step 4/5] [2021-11-19 21:10:48,864][INFO ][main][IgniteKernal%grid-1] [21:10:48] : [Step 4/5] [21:10:48] : [Step 4/5] >>> +------------------------------------------------------+ [21:10:48] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV stopped OK [21:10:48] : [Step 4/5] >>> +------------------------------------------------------+ [21:10:48] : [Step 4/5] >>> Ignite instance name: grid-1 [21:10:48] : [Step 4/5] >>> Grid uptime: 00:00:01.829 [21:10:48] : [Step 4/5] [21:10:48] : [Step 4/5] [21:10:48] : [Step 4/5] [2021-11-19 21:10:48,865][INFO ][main][root] >>> Stopping grid [name=grid-0, id=00245d3d-89f6-46c0-9396-bcd0247bd000] [21:10:48] : [Step 4/5] [2021-11-19 21:10:48,871][INFO ][db-checkpoint-thread-#21164%grid-0%][Checkpointer] Skipping checkpoint (no pages were modified) [checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=1ms, reason='timeout'] [21:10:48]W: [org.apache.ignite:ignite-core] [2021-11-19 21:10:48,875][WARN ][tcp-disco-sock-reader-[105bed7a 127.0.0.1:42161]-#1111%grid-0%-#21150%grid-0%][TestTcpDiscoverySpi] Failed to shutdown socket [21:10:48]W: [org.apache.ignite:ignite-core] java.net.SocketException: Socket is closed [21:10:48]W: [org.apache.ignite:ignite-core] at java.net.Socket.shutdownOutput(Socket.java:1568) [21:10:48]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.close(IgniteUtils.java:4247) [21:10:48]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.discovery.tcp.ServerImpl$SocketReader.body(ServerImpl.java:7370) [21:10:48]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.IgniteSpiThread.run(IgniteSpiThread.java:58) [21:10:48] : [Step 4/5] [2021-11-19 21:10:48,876][INFO ][tcp-disco-sock-reader-[105bed7a 127.0.0.1:42161]-#1111%grid-0%-#21150%grid-0%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:42161, rmtPort=42161, rmtNodeId=105bed7a-e976-48cd-8c07-342e87bf2001] [21:10:48] : [Step 4/5] [2021-11-19 21:10:48,878][INFO ][main][GridCacheProcessor] Stopped cache [cacheName=ignite-sys-cache] [21:10:48] : [Step 4/5] [2021-11-19 21:10:48,879][INFO ][main][GridCacheProcessor] Stopped cache [cacheName=encrypted, group=shared] [21:10:48] : [Step 4/5] [2021-11-19 21:10:48,879][INFO ][main][GridCacheProcessor] Stopped cache [cacheName=cache1, group=shared] [21:10:48] : [Step 4/5] [2021-11-19 21:10:48,889][INFO ][main][FilePageStoreManager] Cleanup cache stores [total=4, left=0, cleanFiles=false] [21:10:48] : [Step 4/5] [2021-11-19 21:10:48,891][INFO ][main][GridDeploymentLocalStore] Removed undeployed class: GridDeployment [ts=1637345447103, depMode=SHARED, clsLdr=IsolatedClassLoader{roleName='test'}, clsLdrId=bb08d593d71-00245d3d-89f6-46c0-9396-bcd0247bd000, userVer=0, loc=true, sampleClsName=org.apache.ignite.internal.processors.cache.distributed.dht.preloader.GridDhtPartitionMap, pendingUndeploy=false, undeployed=true, usage=0] [21:10:48] : [Step 4/5] [2021-11-19 21:10:48,898][INFO ][main][IgniteKernal%grid-0] [21:10:48] : [Step 4/5] [21:10:48] : [Step 4/5] >>> +------------------------------------------------------+ [21:10:48] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV stopped OK [21:10:48] : [Step 4/5] >>> +------------------------------------------------------+ [21:10:48] : [Step 4/5] >>> Ignite instance name: grid-0 [21:10:48] : [Step 4/5] >>> Grid uptime: 00:00:02.305 [21:10:48] : [Step 4/5] [21:10:48] : [Step 4/5] [21:10:48] : [Step 4/5] [21:10:48] >>> Starting test: CacheGroupKeyChangeTest#testNodeFailsAfterPerform <<< [21:10:48] : [Step 4/5] [2021-11-19 21:10:48,911][INFO ][main][root] >>> Starting test: CacheGroupKeyChangeTest#testNodeFailsAfterPerform <<< [21:10:48] : [Step 4/5] [21:10:48] >>> Heap: 361 MB used / 1940 MB commited / 1940 MB max <<< [21:10:48] : [Step 4/5] [2021-11-19 21:10:48,912][INFO ][main][root] >>> Heap: 361 MB used / 1940 MB commited / 1940 MB max <<< [21:10:48] : [Step 4/5] [21:10:48] >>> Non-Heap: 158 MB used / 183 MB commited / 0 MB max <<< [21:10:48] : [Step 4/5] [2021-11-19 21:10:48,912][INFO ][main][root] >>> Non-Heap: 158 MB used / 183 MB commited / 0 MB max <<< [21:10:48]W: [org.apache.ignite:ignite-core] [2021-11-19 21:10:48,920][WARN ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][G] Ignite work directory is not provided, automatically resolved to: /opt/buildagent/work/7bc1c54bc719b67c/work [21:10:48] : [Step 4/5] [2021-11-19 21:10:48,921][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] [21:10:48] : [Step 4/5] [21:10:48] : [Step 4/5] >>> __________ ________________ [21:10:48] : [Step 4/5] >>> / _/ ___/ |/ / _/_ __/ __/ [21:10:48] : [Step 4/5] >>> _/ // (7 7 // / / / / _/ [21:10:48] : [Step 4/5] >>> /___/\___/_/|_/___/ /_/ /___/ [21:10:48] : [Step 4/5] >>> [21:10:48] : [Step 4/5] >>> ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:10:48] : [Step 4/5] >>> 2021 Copyright(C) Apache Software Foundation [21:10:48] : [Step 4/5] >>> [21:10:48] : [Step 4/5] >>> Ignite documentation: http://ignite.apache.org [21:10:48] : [Step 4/5] [21:10:48] : [Step 4/5] [2021-11-19 21:10:48,922][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] Config URL: n/a [21:10:48] : [Step 4/5] [2021-11-19 21:10:48,923][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] IgniteConfiguration [igniteInstanceName=grid-0, pubPoolSize=24, svcPoolSize=24, callbackPoolSize=24, stripedPoolSize=24, sysPoolSize=24, mgmtPoolSize=4, dataStreamerPoolSize=24, utilityCachePoolSize=24, utilityCacheKeepAliveTime=60000, p2pPoolSize=2, qryPoolSize=24, buildIdxPoolSize=4, igniteHome=/opt/buildagent/work/7bc1c54bc719b67c, igniteWorkDir=/opt/buildagent/work/7bc1c54bc719b67c/work, mbeanSrv=com.sun.jmx.mbeanserver.JmxMBeanServer@6fe85038, nodeId=00a005ca-1176-4aa8-8e19-66df6832f000, marsh=BinaryMarshaller [], marshLocJobs=false, daemon=false, p2pEnabled=true, netTimeout=10000, netCompressionLevel=1, sndRetryDelay=1000, sndRetryCnt=3, metricsHistSize=10000, metricsUpdateFreq=1000, metricsExpTime=9223372036854775807, discoSpi=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=0, ackTimeout=0, marsh=null, reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], segPlc=STOP, segResolveAttempts=2, waitForSegOnStart=true, allResolversPassReq=true, segChkFreq=10000, commSpi=TcpCommunicationSpi [connectGate=org.apache.ignite.spi.communication.tcp.internal.ConnectGateway@6de8b0c9, ctxInitLatch=java.util.concurrent.CountDownLatch@413d7e09[Count = 1], stopping=false, clientPool=null, nioSrvWrapper=null, stateProvider=null], evtSpi=MemoryEventStorageSpi [expireAgeMs=9223372036854775807, expireCnt=10000, filter=null], colSpi=NoopCollisionSpi [], deploySpi=LocalDeploymentSpi [], indexingSpi=org.apache.ignite.spi.indexing.noop.NoopIndexingSpi@23240a55, addrRslvr=null, encryptionSpi=org.apache.ignite.spi.encryption.keystore.KeystoreEncryptionSpi@48b3ae1, tracingSpi=org.apache.ignite.spi.tracing.NoopTracingSpi@e16c7d9, clientMode=false, rebalanceThreadPoolSize=4, rebalanceTimeout=10000, rebalanceBatchesPrefetchCnt=3, rebalanceThrottle=0, rebalanceBatchSize=524288, txCfg=TransactionConfiguration [txSerEnabled=false, dfltIsolation=REPEATABLE_READ, dfltConcurrency=PESSIMISTIC, dfltTxTimeout=0, txTimeoutOnPartitionMapExchange=0, deadlockTimeout=10000, pessimisticTxLogSize=0, pessimisticTxLogLinger=10000, tmLookupClsName=null, txManagerFactory=null, useJtaSync=false], cacheSanityCheckEnabled=true, discoStartupDelay=60000, deployMode=SHARED, p2pMissedCacheSize=100, locHost=127.0.0.1, timeSrvPortBase=31100, timeSrvPortRange=100, failureDetectionTimeout=10000, sysWorkerBlockedTimeout=null, clientFailureDetectionTimeout=10000, metricsLogFreq=0, connectorCfg=null, odbcCfg=null, warmupClos=null, atomicCfg=AtomicConfiguration [seqReserveSize=1000, cacheMode=PARTITIONED, backups=1, aff=null, grpName=null], classLdr=null, sslCtxFactory=null, platformCfg=null, binaryCfg=null, memCfg=null, pstCfg=null, dsCfg=DataStorageConfiguration [sysRegionInitSize=41943040, sysRegionMaxSize=104857600, pageSize=4096, concLvl=0, dfltDataRegConf=DataRegionConfiguration [name=default, maxSize=104857600, initSize=268435456, swapPath=null, pageEvictionMode=DISABLED, pageReplacementMode=CLOCK, evictionThreshold=0.9, emptyPagesPoolSize=100, metricsEnabled=false, metricsSubIntervalCount=5, metricsRateTimeInterval=60000, persistenceEnabled=true, checkpointPageBufSize=0, lazyMemoryAllocation=true, warmUpCfg=null], dataRegions=null, storagePath=null, checkpointFreq=30000, lockWaitTime=10000, checkpointThreads=4, checkpointWriteOrder=SEQUENTIAL, walHistSize=20, maxWalArchiveSize=20971520, walSegments=10, walSegmentSize=1048576, walPath=db/wal, walArchivePath=db/wal/archive, cdcWalPath=db/wal/cdc, cdcEnabled=false, metricsEnabled=false, walMode=LOG_ONLY, walTlbSize=131072, walBuffSize=0, walFlushFreq=2000, walFsyncDelay=1000, walRecordIterBuffSize=67108864, alwaysWriteFullPages=false, fileIOFactory=org.apache.ignite.internal.processors.cache.persistence.file.AsyncFileIOFactory@3bf08080, metricsSubIntervalCnt=5, metricsRateTimeInterval=60000, walAutoArchiveAfterInactivity=-1, walForceArchiveTimeout=-1, writeThrottlingEnabled=false, walCompactionEnabled=false, walCompactionLevel=1, checkpointReadLockTimeout=null, walPageCompression=DISABLED, walPageCompressionLevel=null, dfltWarmUpCfg=null, encCfg=org.apache.ignite.configuration.EncryptionConfiguration@6a935f77, defragmentationThreadPoolSize=4, minWalArchiveSize=-1], snapshotPath=snapshots, activeOnStart=true, activeOnStartPropSetFlag=false, autoActivation=true, autoActivationPropSetFlag=false, clusterStateOnStart=null, sqlConnCfg=null, cliConnCfg=ClientConnectorConfiguration [host=null, port=10800, portRange=100, sockSndBufSize=0, sockRcvBufSize=0, tcpNoDelay=true, maxOpenCursorsPerConn=128, threadPoolSize=24, selectorCnt=12, idleTimeout=0, handshakeTimeout=10000, jdbcEnabled=true, odbcEnabled=true, thinCliEnabled=true, sslEnabled=false, useIgniteSslCtxFactory=true, sslClientAuth=false, sslCtxFactory=null, thinCliCfg=ThinClientConfiguration [maxActiveTxPerConn=100, maxActiveComputeTasksPerConn=0]], mvccVacuumThreadCnt=2, mvccVacuumFreq=5000, authEnabled=false, failureHnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]], commFailureRslvr=null, sqlCfg=SqlConfiguration [longQryWarnTimeout=3000, dfltQryTimeout=0, sqlQryHistSize=1000, validationEnabled=false], asyncContinuationExecutor=null] [21:10:48] : [Step 4/5] [2021-11-19 21:10:48,931][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] Daemon mode: off [21:10:48] : [Step 4/5] [2021-11-19 21:10:48,932][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] OS: Linux 4.15.0-151-generic amd64 [21:10:48] : [Step 4/5] [2021-11-19 21:10:48,932][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] OS user: teamcity [21:10:48] : [Step 4/5] [2021-11-19 21:10:48,932][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] PID: 16724 [21:10:48] : [Step 4/5] [2021-11-19 21:10:48,932][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] Language runtime: Java Platform API Specification ver. 1.8 [21:10:48] : [Step 4/5] [2021-11-19 21:10:48,933][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] VM information: Java(TM) SE Runtime Environment 1.8.0_261-b12 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 25.261-b12 [21:10:48] : [Step 4/5] [2021-11-19 21:10:48,933][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] VM total memory: 1.9GB [21:10:48] : [Step 4/5] [2021-11-19 21:10:48,933][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] Remote Management [restart: off, REST: off, JMX (remote: off)] [21:10:48] : [Step 4/5] [2021-11-19 21:10:48,934][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] Logger: GridTestLog4jLogger [quiet=false, config=null] [21:10:48] : [Step 4/5] [2021-11-19 21:10:48,934][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] IGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c [21:10:48] : [Step 4/5] [2021-11-19 21:10:48,934][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] VM arguments: [-DIGNITE_DUMP_THREADS_ON_FAILURE=false, -DMono=/usr/bin/mono-sgen, -DMono4.0_x64=/usr/lib/mono/4.0, -DMono4.5_x64=/usr/lib/mono/4.5, -DMonoVersion=6.12.0.90, -DSKIP_BUILD=false, -Dagent.home.dir=/opt/buildagent, -Dagent.name=aitc-lin02_03, -Dagent.ownPort=9090, -Dagent.work.dir=/opt/buildagent/work, -Dbuild.number=95, -Dbuild.vcs.number=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.1=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.GitHubApacheIgnite=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dclassworlds.conf=/opt/buildagent/temp/buildTmp/teamcity.m2.conf, -Dcom.jetbrains.maven.watcher.report.file=/opt/buildagent/temp/buildTmp/maven-build-info.xml, -Djava.io.tmpdir=/opt/buildagent/temp/buildTmp, -Dmaven.home=/opt/buildagent/tools/maven3_6, -Dmaven.multiModuleProjectDirectory=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.agent.cpuBenchmark=457, -Dteamcity.agent.dotnet.agent_url=http://localhost:9090/RPC2, -Dteamcity.agent.dotnet.build_id=6278078, -Dteamcity.auth.password=*******, -Dteamcity.auth.userId=TeamCityBuildId=6278078, -Dteamcity.build.changedFiles.file=/opt/buildagent/temp/buildTmp/changedFiles6342607772318147725.txt, -Dteamcity.build.checkoutDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.build.id=6278078, -Dteamcity.build.properties.file=/opt/buildagent/temp/buildTmp/teamcity.build5164517880467851002.properties, -Dteamcity.build.tempDir=/opt/buildagent/temp/buildTmp, -Dteamcity.build.workingDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.buildConfName=Basic 3, -Dteamcity.buildType.id=IgniteTests24Java8_Basic3, -Dteamcity.configuration.properties.file=/opt/buildagent/temp/buildTmp/teamcity.config5591980786735343870.properties, -Dteamcity.maven.userSettings.path=/opt/buildagent/temp/buildTmp/maven_settings_585072866407032347.xml, -Dteamcity.maven.watcher.home=/opt/buildagent/plugins/mavenPlugin/maven-watcher-jdk16, -Dteamcity.projectName=Ignite Tests 2.x (JDK 8/11), -Dteamcity.runner.properties.file=/opt/buildagent/temp/buildTmp/teamcity.runner9098465561618137420.properties, -Dteamcity.tests.recentlyFailedTests.file=/opt/buildagent/temp/buildTmp/testsToRunFirst3891775683130404069.txt, -Dteamcity.version=2021.2 (build 99542), -ea, -Xms2g, -Xmx2g, -XX:+HeapDumpOnOutOfMemoryError, -DIGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_TEST_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_UPDATE_NOTIFIER=false, -DIGNITE_NO_DISCO_ORDER=true, -DIGNITE_PERFORMANCE_SUGGESTIONS_DISABLED=true, -Djava.net.preferIPv4Stack=true, -DTEST_SCALE_FACTOR=1.0, -DIGNITE_TEST_PROP_LOG4J_FILE=log4j-tc-test.xml, -DIGNITE_QUIET=false, -DIGNITE_MARSHAL_BUFFERS_RECHECK=1000, -Dmaven.repo.local=/opt/buildagent/.m2/repository] [21:10:48] : [Step 4/5] [2021-11-19 21:10:48,939][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] System cache's DataRegion size is configured to 40 MB. Use DataStorageConfiguration.systemRegionInitialSize property to change the setting. [21:10:48] : [Step 4/5] [2021-11-19 21:10:48,940][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] Configured caches [in 'sysMemPlc' dataRegion: ['ignite-sys-cache']] [21:10:48]W: [org.apache.ignite:ignite-core] [2021-11-19 21:10:48,940][WARN ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] Peer class loading is enabled (disable it in production for performance and deployment consistency reasons) [21:10:48] : [Step 4/5] [2021-11-19 21:10:48,940][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] 3-rd party licenses can be found at: /opt/buildagent/work/7bc1c54bc719b67c/libs/licenses [21:10:48] : [Step 4/5] [2021-11-19 21:10:48,944][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] Configured plugins: [21:10:48] : [Step 4/5] [2021-11-19 21:10:48,945][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- StanByClusterTestProvider 1.0 [21:10:48] : [Step 4/5] [2021-11-19 21:10:48,945][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:10:48] : [Step 4/5] [2021-11-19 21:10:48,945][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] [21:10:48] : [Step 4/5] [2021-11-19 21:10:48,945][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- PageMemory tracker plugin 1.0 [21:10:48] : [Step 4/5] [2021-11-19 21:10:48,945][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:10:48] : [Step 4/5] [2021-11-19 21:10:48,946][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] [21:10:48] : [Step 4/5] [2021-11-19 21:10:48,946][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- TestDistibutedConfigurationPlugin 1.0 [21:10:48] : [Step 4/5] [2021-11-19 21:10:48,946][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:10:48] : [Step 4/5] [2021-11-19 21:10:48,946][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] [21:10:48] : [Step 4/5] [2021-11-19 21:10:48,946][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- NodeValidationPluginProvider 1.0 [21:10:48] : [Step 4/5] [2021-11-19 21:10:48,947][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:10:48] : [Step 4/5] [2021-11-19 21:10:48,947][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] [21:10:48] : [Step 4/5] [2021-11-19 21:10:48,947][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][FailureProcessor] Configured failure handler: [hnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]]] [21:10:48] : [Step 4/5] [2021-11-19 21:10:48,959][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][TestRecordingCommunicationSpi] Successfully bound communication NIO server to TCP port [port=47100, locHost=/127.0.0.1, selectorsCnt=12, selectorSpins=0, pairedConn=false] [21:10:48]W: [org.apache.ignite:ignite-core] [2021-11-19 21:10:48,959][WARN ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][TestRecordingCommunicationSpi] Message queue limit is set to 0 which may lead to potential OOMEs when running cache operations in FULL_ASYNC or PRIMARY_SYNC modes due to message queues growth on sender and receiver sides. [21:10:48] : [Step 4/5] [2021-11-19 21:10:48,963][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][GridCollisionManager] Collision resolution is disabled (all jobs will be activated upon arrival). [21:10:48] : [Step 4/5] [2021-11-19 21:10:48,963][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] Security status [authentication=off, sandbox=off, tls/ssl=off] [21:10:49] : [Step 4/5] [2021-11-19 21:10:49,019][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:10:49] : [Step 4/5] [2021-11-19 21:10:49,102][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][MaintenanceProcessor] Resolved store directory for node persistent data: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0 [21:10:49] : [Step 4/5] [2021-11-19 21:10:49,104][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][CacheObjectBinaryProcessorImpl] Resolved directory for serialized binary metadata: /opt/buildagent/work/7bc1c54bc719b67c/work/db/binary_meta/grid_0 [21:10:49] : [Step 4/5] [2021-11-19 21:10:49,108][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0 [21:10:49] : [Step 4/5] [2021-11-19 21:10:49,109][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][FileWriteAheadLogManager] Resolved write ahead log work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0 [21:10:49] : [Step 4/5] [2021-11-19 21:10:49,109][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][FileWriteAheadLogManager] Resolved write ahead log archive directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0 [21:10:49] : [Step 4/5] [2021-11-19 21:10:49,371][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000000.wal [21:10:49] : [Step 4/5] [2021-11-19 21:10:49,371][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][FileHandleManagerImpl] Initialized write-ahead log manager [mode=LOG_ONLY] [21:10:49]W: [org.apache.ignite:ignite-core] [2021-11-19 21:10:49,372][WARN ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] DataRegion maxSize=104.9 MB is smaller than defaultInitialSize=268.4 MB, setting initialSize to 104.9 MB [21:10:49] : [Step 4/5] [2021-11-19 21:10:49,376][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Configured data regions initialized successfully [total=5] [21:10:49] : [Step 4/5] [2021-11-19 21:10:49,379][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][IgniteSnapshotManager] Resolved snapshot work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/snapshots [21:10:49] : [Step 4/5] [2021-11-19 21:10:49,379][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][IgniteSnapshotManager] Resolved temp directory for snapshot creation: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0/snp [21:10:49] : [Step 4/5] [2021-11-19 21:10:49,382][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][ClientListenerProcessor] Client connector processor has started on TCP port 10800 [21:10:49] : [Step 4/5] [2021-11-19 21:10:49,388][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] Non-loopback local IPs: 172.17.0.4 [21:10:49] : [Step 4/5] [2021-11-19 21:10:49,388][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] Enabled local MACs: 0242AC110004 [21:10:49] : [Step 4/5] [2021-11-19 21:10:49,391][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:10:49] : [Step 4/5] [2021-11-19 21:10:49,391][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:10:49] : [Step 4/5] [2021-11-19 21:10:49,392][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:10:49] : [Step 4/5] [2021-11-19 21:10:49,394][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Applying lost metastore updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:10:49] : [Step 4/5] [2021-11-19 21:10:49,395][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=0 ms] [21:10:49] : [Step 4/5] [2021-11-19 21:10:49,395][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Restoring partition state for local groups. [21:10:49] : [Step 4/5] [2021-11-19 21:10:49,395][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=0, partitionsProcessed=0, time=0ms] [21:10:49] : [Step 4/5] [2021-11-19 21:10:49,396][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][GridEncryptionManager] Encryption keys loaded from metastore. [grps=, masterKeyName=ignite.master.key] [21:10:49] : [Step 4/5] [2021-11-19 21:10:49,400][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][ClusterProcessor] Cluster ID and tag has been read from metastorage: null [21:10:49] : [Step 4/5] [2021-11-19 21:10:49,400][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][IgniteClusterImpl] Shutdown policy was updated [oldVal=null, newVal=null] [21:10:49] : [Step 4/5] [2021-11-19 21:10:49,401][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Checkpoint frequency deviation changed [oldVal=null, newVal=null] [21:10:49] : [Step 4/5] [2021-11-19 21:10:49,413][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][FilePageStoreManager] Cleanup cache stores [total=1, left=0, cleanFiles=false] [21:10:49] : [Step 4/5] [2021-11-19 21:10:49,416][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:10:49] : [Step 4/5] [2021-11-19 21:10:49,417][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:10:49] : [Step 4/5] [2021-11-19 21:10:49,418][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:10:49] : [Step 4/5] [2021-11-19 21:10:49,418][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Data Regions Started: 5 [21:10:49] : [Step 4/5] [2021-11-19 21:10:49,419][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] ^-- sysMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:10:49] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:10:49] : [Step 4/5] ^-- default region [type=default, persistence=true, lazyAlloc=true, [21:10:49] : [Step 4/5] ... initCfg=100MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB, allocTotal=0MB] [21:10:49] : [Step 4/5] ^-- metastoreMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:10:49] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:10:49] : [Step 4/5] ^-- TxLog region [type=internal, persistence=true, lazyAlloc=false, [21:10:49] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:10:49] : [Step 4/5] ^-- volatileDsMemPlc region [type=user, persistence=false, lazyAlloc=true, [21:10:49] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB] [21:10:49] : [Step 4/5] ^-- Ignite persistence [used=0MB] [21:10:49] : [Step 4/5] [21:10:49] : [Step 4/5] [2021-11-19 21:10:49,421][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Starting binary memory restore for: [-2100569601] [21:10:49] : [Step 4/5] [2021-11-19 21:10:49,432][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:10:49] : [Step 4/5] [2021-11-19 21:10:49,432][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:10:49] : [Step 4/5] [2021-11-19 21:10:49,444][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000000.wal, offset=0, ver=2] [21:10:49] : [Step 4/5] [2021-11-19 21:10:49,459][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Started cache in recovery mode [name=ignite-sys-cache, id=-2100569601, dataRegionName=sysMemPlc, mode=REPLICATED, atomicity=TRANSACTIONAL, backups=2147483647, mvcc=false] [21:10:49] : [Step 4/5] [2021-11-19 21:10:49,462][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Binary recovery performed in 41 ms. [21:10:49] : [Step 4/5] [2021-11-19 21:10:49,462][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:10:49] : [Step 4/5] [2021-11-19 21:10:49,463][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Applying lost cache updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:10:49] : [Step 4/5] [2021-11-19 21:10:49,468][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=11 ms] [21:10:49] : [Step 4/5] [2021-11-19 21:10:49,468][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Restoring partition state for local groups. [21:10:49] : [Step 4/5] [2021-11-19 21:10:49,496][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=1, partitionsProcessed=100, time=20ms] [21:10:49] : [Step 4/5] [2021-11-19 21:10:49,519][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][TestTcpDiscoverySpi] Successfully bound to TCP port [port=47500, localHost=localhost/127.0.0.1, locNodeId=00a005ca-1176-4aa8-8e19-66df6832f000] [21:10:49] : [Step 4/5] [2021-11-19 21:10:49,529][INFO ][disco-notifier-worker-#21301%grid-0%][MvccProcessorImpl] Assigned mvcc coordinator [crd=MvccCoordinator [topVer=AffinityTopologyVersion [topVer=1, minorTopVer=0], nodeId=00a005ca-1176-4aa8-8e19-66df6832f000, ver=1637345449529, local=true, initialized=false]] [21:10:49] : [Step 4/5] [2021-11-19 21:10:49,531][INFO ][sys-#21289%grid-0%][ClusterProcessor] Writing cluster ID and tag to metastorage on ready for write ClusterIdAndTag [id=7725c528-87c9-45db-80e4-cdcc9f24cdd8, tag=vigilant_dirac] [21:10:49] : [Step 4/5] [2021-11-19 21:10:49,534][INFO ][disco-notifier-worker-#21301%grid-0%][ClusterProcessor] vigilant_dirac [21:10:49] : [Step 4/5] [2021-11-19 21:10:49,535][INFO ][disco-notifier-worker-#21301%grid-0%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustEnabled' was changed from 'null' to 'false' [21:10:49] : [Step 4/5] [2021-11-19 21:10:49,536][INFO ][disco-notifier-worker-#21301%grid-0%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustTimeout' was changed from 'null' to '300000' [21:10:49] : [Step 4/5] [2021-11-19 21:10:49,537][INFO ][disco-notifier-worker-#21301%grid-0%][IgniteTxManager] Transactions parameter 'longOperationsDumpTimeout' was changed from 'null' to '60000' [21:10:49] : [Step 4/5] [2021-11-19 21:10:49,537][INFO ][disco-notifier-worker-#21301%grid-0%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpThreshold' was changed from 'null' to '0' [21:10:49] : [Step 4/5] [2021-11-19 21:10:49,538][INFO ][disco-notifier-worker-#21301%grid-0%][IgniteTxManager] Transactions parameter 'transactionTimeDumpSamplesCoefficient' was changed from 'null' to '0.0' [21:10:49] : [Step 4/5] [2021-11-19 21:10:49,538][INFO ][disco-notifier-worker-#21301%grid-0%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpSamplesPerSecondLimit' was changed from 'null' to '5' [21:10:49] : [Step 4/5] [2021-11-19 21:10:49,539][INFO ][disco-notifier-worker-#21301%grid-0%][IgniteTxManager] Transactions parameter 'collisionsDumpInterval' was changed from 'null' to '1000' [21:10:49] : [Step 4/5] [2021-11-19 21:10:49,546][INFO ][disco-notifier-worker-#21301%grid-0%][IgniteTxManager] Transactions parameter 'txOwnerDumpRequestsAllowed' was changed from 'null' to 'true' [21:10:49] : [Step 4/5] [2021-11-19 21:10:49,546][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] To start Console Management & Monitoring run ignitevisorcmd.{sh|bat} [21:10:49] : [Step 4/5] [2021-11-19 21:10:49,547][INFO ][disco-notifier-worker-#21301%grid-0%][GridCacheDatabaseSharedManager] Historical rebalance WAL threshold changed [property=historical.rebalance.threshold, oldVal=null, newVal=500] [21:10:49] : [Step 4/5] [2021-11-19 21:10:49,547][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] [21:10:49] : [Step 4/5] [21:10:49] : [Step 4/5] >>> +-------------------------------------------+ [21:10:49] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:10:49] : [Step 4/5] >>> +-------------------------------------------+ [21:10:49] : [Step 4/5] >>> OS name: Linux 4.15.0-151-generic amd64 [21:10:49] : [Step 4/5] >>> CPU(s): 24 [21:10:49] : [Step 4/5] >>> Heap: 2.0GB [21:10:49] : [Step 4/5] >>> VM name: 16724@c4dfe9a430b2 [21:10:49] : [Step 4/5] >>> Ignite instance name: grid-0 [21:10:49] : [Step 4/5] >>> Local node [ID=00A005CA-1176-4AA8-8E19-66DF6832F000, order=1, clientMode=false] [21:10:49] : [Step 4/5] >>> Local node addresses: [127.0.0.1] [21:10:49] : [Step 4/5] >>> Local ports: TCP:10800 TCP:47100 TCP:47500 [21:10:49] : [Step 4/5] [21:10:49] : [Step 4/5] [2021-11-19 21:10:49,548][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] >>> Ignite cluster is in INACTIVE state (limited functionality available). Use control.(sh|bat) script or IgniteCluster.state(ClusterState.ACTIVE) to change the state. [21:10:49] : [Step 4/5] [2021-11-19 21:10:49,549][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][GridDiscoveryManager] Topology snapshot [ver=1, locNode=00a005ca, servers=1, clients=0, state=INACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=00a005ca-1176-4aa8-8e19-66df6832f000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:10:49] : [Step 4/5] [2021-11-19 21:10:49,550][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][G] Node started : [stage="Configure system pool" (0 ms),stage="Start managers" (182 ms),stage="Configure binary metadata" (2 ms),stage="Start processors" (282 ms),stage="Start 'StanByClusterTestProvider' plugin" (0 ms),stage="Start 'PageMemory tracker plugin' plugin" (0 ms),stage="Start 'TestDistibutedConfigurationPlugin' plugin" (0 ms),stage="Start 'NodeValidationPluginProvider' plugin" (0 ms),stage="Init metastore" (25 ms),stage="Init and start regions" (7 ms),stage="Restore binary memory" (41 ms),stage="Restore logical state" (34 ms),stage="Finish recovery" (21 ms),stage="Join topology" (10 ms),stage="Await transition" (2 ms),stage="Await exchange" (17 ms),stage="Total time" (623 ms)] [21:10:49] : [Step 4/5] [2021-11-19 21:10:49,551][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][root] Node started with the following configuration [id=00a005ca-1176-4aa8-8e19-66df6832f000, marshaller=BinaryMarshaller [], discovery=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=5000, ackTimeout=5000, marsh=JdkMarshaller [clsFilter=org.apache.ignite.marshaller.MarshallerUtils$1@5966fc83], reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], binaryCfg=null, lateAff=true] [21:10:49]W: [org.apache.ignite:ignite-core] [2021-11-19 21:10:49,557][WARN ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][G] Ignite work directory is not provided, automatically resolved to: /opt/buildagent/work/7bc1c54bc719b67c/work [21:10:49] : [Step 4/5] [2021-11-19 21:10:49,559][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] [21:10:49] : [Step 4/5] [21:10:49] : [Step 4/5] >>> __________ ________________ [21:10:49] : [Step 4/5] >>> / _/ ___/ |/ / _/_ __/ __/ [21:10:49] : [Step 4/5] >>> _/ // (7 7 // / / / / _/ [21:10:49] : [Step 4/5] >>> /___/\___/_/|_/___/ /_/ /___/ [21:10:49] : [Step 4/5] >>> [21:10:49] : [Step 4/5] >>> ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:10:49] : [Step 4/5] >>> 2021 Copyright(C) Apache Software Foundation [21:10:49] : [Step 4/5] >>> [21:10:49] : [Step 4/5] >>> Ignite documentation: http://ignite.apache.org [21:10:49] : [Step 4/5] [21:10:49] : [Step 4/5] [2021-11-19 21:10:49,560][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] Config URL: n/a [21:10:49] : [Step 4/5] [2021-11-19 21:10:49,560][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] IgniteConfiguration [igniteInstanceName=grid-1, pubPoolSize=24, svcPoolSize=24, callbackPoolSize=24, stripedPoolSize=24, sysPoolSize=24, mgmtPoolSize=4, dataStreamerPoolSize=24, utilityCachePoolSize=24, utilityCacheKeepAliveTime=60000, p2pPoolSize=2, qryPoolSize=24, buildIdxPoolSize=4, igniteHome=/opt/buildagent/work/7bc1c54bc719b67c, igniteWorkDir=/opt/buildagent/work/7bc1c54bc719b67c/work, mbeanSrv=com.sun.jmx.mbeanserver.JmxMBeanServer@6fe85038, nodeId=10a8a0d8-a507-4823-9923-6a3fda27b001, marsh=BinaryMarshaller [], marshLocJobs=false, daemon=false, p2pEnabled=true, netTimeout=10000, netCompressionLevel=1, sndRetryDelay=1000, sndRetryCnt=3, metricsHistSize=10000, metricsUpdateFreq=1000, metricsExpTime=9223372036854775807, discoSpi=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=0, ackTimeout=0, marsh=null, reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], segPlc=STOP, segResolveAttempts=2, waitForSegOnStart=true, allResolversPassReq=true, segChkFreq=10000, commSpi=TcpCommunicationSpi [connectGate=org.apache.ignite.spi.communication.tcp.internal.ConnectGateway@b66ec5a, ctxInitLatch=java.util.concurrent.CountDownLatch@6b22373e[Count = 1], stopping=false, clientPool=null, nioSrvWrapper=null, stateProvider=null], evtSpi=MemoryEventStorageSpi [expireAgeMs=9223372036854775807, expireCnt=10000, filter=null], colSpi=NoopCollisionSpi [], deploySpi=LocalDeploymentSpi [], indexingSpi=org.apache.ignite.spi.indexing.noop.NoopIndexingSpi@5636ef81, addrRslvr=null, encryptionSpi=org.apache.ignite.spi.encryption.keystore.KeystoreEncryptionSpi@2a936cad, tracingSpi=org.apache.ignite.spi.tracing.NoopTracingSpi@467426a2, clientMode=false, rebalanceThreadPoolSize=4, rebalanceTimeout=10000, rebalanceBatchesPrefetchCnt=3, rebalanceThrottle=0, rebalanceBatchSize=524288, txCfg=TransactionConfiguration [txSerEnabled=false, dfltIsolation=REPEATABLE_READ, dfltConcurrency=PESSIMISTIC, dfltTxTimeout=0, txTimeoutOnPartitionMapExchange=0, deadlockTimeout=10000, pessimisticTxLogSize=0, pessimisticTxLogLinger=10000, tmLookupClsName=null, txManagerFactory=null, useJtaSync=false], cacheSanityCheckEnabled=true, discoStartupDelay=60000, deployMode=SHARED, p2pMissedCacheSize=100, locHost=127.0.0.1, timeSrvPortBase=31100, timeSrvPortRange=100, failureDetectionTimeout=10000, sysWorkerBlockedTimeout=null, clientFailureDetectionTimeout=10000, metricsLogFreq=0, connectorCfg=null, odbcCfg=null, warmupClos=null, atomicCfg=AtomicConfiguration [seqReserveSize=1000, cacheMode=PARTITIONED, backups=1, aff=null, grpName=null], classLdr=null, sslCtxFactory=null, platformCfg=null, binaryCfg=null, memCfg=null, pstCfg=null, dsCfg=DataStorageConfiguration [sysRegionInitSize=41943040, sysRegionMaxSize=104857600, pageSize=4096, concLvl=0, dfltDataRegConf=DataRegionConfiguration [name=default, maxSize=104857600, initSize=268435456, swapPath=null, pageEvictionMode=DISABLED, pageReplacementMode=CLOCK, evictionThreshold=0.9, emptyPagesPoolSize=100, metricsEnabled=false, metricsSubIntervalCount=5, metricsRateTimeInterval=60000, persistenceEnabled=true, checkpointPageBufSize=0, lazyMemoryAllocation=true, warmUpCfg=null], dataRegions=null, storagePath=null, checkpointFreq=30000, lockWaitTime=10000, checkpointThreads=4, checkpointWriteOrder=SEQUENTIAL, walHistSize=20, maxWalArchiveSize=20971520, walSegments=10, walSegmentSize=1048576, walPath=db/wal, walArchivePath=db/wal/archive, cdcWalPath=db/wal/cdc, cdcEnabled=false, metricsEnabled=false, walMode=LOG_ONLY, walTlbSize=131072, walBuffSize=0, walFlushFreq=2000, walFsyncDelay=1000, walRecordIterBuffSize=67108864, alwaysWriteFullPages=false, fileIOFactory=org.apache.ignite.internal.processors.cache.persistence.file.AsyncFileIOFactory@129dd458, metricsSubIntervalCnt=5, metricsRateTimeInterval=60000, walAutoArchiveAfterInactivity=-1, walForceArchiveTimeout=-1, writeThrottlingEnabled=false, walCompactionEnabled=false, walCompactionLevel=1, checkpointReadLockTimeout=null, walPageCompression=DISABLED, walPageCompressionLevel=null, dfltWarmUpCfg=null, encCfg=org.apache.ignite.configuration.EncryptionConfiguration@8ad78a4, defragmentationThreadPoolSize=4, minWalArchiveSize=-1], snapshotPath=snapshots, activeOnStart=true, activeOnStartPropSetFlag=false, autoActivation=true, autoActivationPropSetFlag=false, clusterStateOnStart=null, sqlConnCfg=null, cliConnCfg=ClientConnectorConfiguration [host=null, port=10800, portRange=100, sockSndBufSize=0, sockRcvBufSize=0, tcpNoDelay=true, maxOpenCursorsPerConn=128, threadPoolSize=24, selectorCnt=12, idleTimeout=0, handshakeTimeout=10000, jdbcEnabled=true, odbcEnabled=true, thinCliEnabled=true, sslEnabled=false, useIgniteSslCtxFactory=true, sslClientAuth=false, sslCtxFactory=null, thinCliCfg=ThinClientConfiguration [maxActiveTxPerConn=100, maxActiveComputeTasksPerConn=0]], mvccVacuumThreadCnt=2, mvccVacuumFreq=5000, authEnabled=false, failureHnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]], commFailureRslvr=null, sqlCfg=SqlConfiguration [longQryWarnTimeout=3000, dfltQryTimeout=0, sqlQryHistSize=1000, validationEnabled=false], asyncContinuationExecutor=null] [21:10:49] : [Step 4/5] [2021-11-19 21:10:49,570][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] Daemon mode: off [21:10:49] : [Step 4/5] [2021-11-19 21:10:49,570][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] OS: Linux 4.15.0-151-generic amd64 [21:10:49] : [Step 4/5] [2021-11-19 21:10:49,570][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] OS user: teamcity [21:10:49] : [Step 4/5] [2021-11-19 21:10:49,571][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] PID: 16724 [21:10:49] : [Step 4/5] [2021-11-19 21:10:49,571][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] Language runtime: Java Platform API Specification ver. 1.8 [21:10:49] : [Step 4/5] [2021-11-19 21:10:49,571][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] VM information: Java(TM) SE Runtime Environment 1.8.0_261-b12 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 25.261-b12 [21:10:49] : [Step 4/5] [2021-11-19 21:10:49,571][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] VM total memory: 1.9GB [21:10:49] : [Step 4/5] [2021-11-19 21:10:49,572][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] Remote Management [restart: off, REST: off, JMX (remote: off)] [21:10:49] : [Step 4/5] [2021-11-19 21:10:49,572][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] Logger: GridTestLog4jLogger [quiet=false, config=null] [21:10:49] : [Step 4/5] [2021-11-19 21:10:49,572][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] IGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c [21:10:49] : [Step 4/5] [2021-11-19 21:10:49,573][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] VM arguments: [-DIGNITE_DUMP_THREADS_ON_FAILURE=false, -DMono=/usr/bin/mono-sgen, -DMono4.0_x64=/usr/lib/mono/4.0, -DMono4.5_x64=/usr/lib/mono/4.5, -DMonoVersion=6.12.0.90, -DSKIP_BUILD=false, -Dagent.home.dir=/opt/buildagent, -Dagent.name=aitc-lin02_03, -Dagent.ownPort=9090, -Dagent.work.dir=/opt/buildagent/work, -Dbuild.number=95, -Dbuild.vcs.number=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.1=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.GitHubApacheIgnite=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dclassworlds.conf=/opt/buildagent/temp/buildTmp/teamcity.m2.conf, -Dcom.jetbrains.maven.watcher.report.file=/opt/buildagent/temp/buildTmp/maven-build-info.xml, -Djava.io.tmpdir=/opt/buildagent/temp/buildTmp, -Dmaven.home=/opt/buildagent/tools/maven3_6, -Dmaven.multiModuleProjectDirectory=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.agent.cpuBenchmark=457, -Dteamcity.agent.dotnet.agent_url=http://localhost:9090/RPC2, -Dteamcity.agent.dotnet.build_id=6278078, -Dteamcity.auth.password=*******, -Dteamcity.auth.userId=TeamCityBuildId=6278078, -Dteamcity.build.changedFiles.file=/opt/buildagent/temp/buildTmp/changedFiles6342607772318147725.txt, -Dteamcity.build.checkoutDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.build.id=6278078, -Dteamcity.build.properties.file=/opt/buildagent/temp/buildTmp/teamcity.build5164517880467851002.properties, -Dteamcity.build.tempDir=/opt/buildagent/temp/buildTmp, -Dteamcity.build.workingDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.buildConfName=Basic 3, -Dteamcity.buildType.id=IgniteTests24Java8_Basic3, -Dteamcity.configuration.properties.file=/opt/buildagent/temp/buildTmp/teamcity.config5591980786735343870.properties, -Dteamcity.maven.userSettings.path=/opt/buildagent/temp/buildTmp/maven_settings_585072866407032347.xml, -Dteamcity.maven.watcher.home=/opt/buildagent/plugins/mavenPlugin/maven-watcher-jdk16, -Dteamcity.projectName=Ignite Tests 2.x (JDK 8/11), -Dteamcity.runner.properties.file=/opt/buildagent/temp/buildTmp/teamcity.runner9098465561618137420.properties, -Dteamcity.tests.recentlyFailedTests.file=/opt/buildagent/temp/buildTmp/testsToRunFirst3891775683130404069.txt, -Dteamcity.version=2021.2 (build 99542), -ea, -Xms2g, -Xmx2g, -XX:+HeapDumpOnOutOfMemoryError, -DIGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_TEST_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_UPDATE_NOTIFIER=false, -DIGNITE_NO_DISCO_ORDER=true, -DIGNITE_PERFORMANCE_SUGGESTIONS_DISABLED=true, -Djava.net.preferIPv4Stack=true, -DTEST_SCALE_FACTOR=1.0, -DIGNITE_TEST_PROP_LOG4J_FILE=log4j-tc-test.xml, -DIGNITE_QUIET=false, -DIGNITE_MARSHAL_BUFFERS_RECHECK=1000, -Dmaven.repo.local=/opt/buildagent/.m2/repository] [21:10:49] : [Step 4/5] [2021-11-19 21:10:49,577][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] System cache's DataRegion size is configured to 40 MB. Use DataStorageConfiguration.systemRegionInitialSize property to change the setting. [21:10:49] : [Step 4/5] [2021-11-19 21:10:49,577][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] Configured caches [in 'sysMemPlc' dataRegion: ['ignite-sys-cache']] [21:10:49]W: [org.apache.ignite:ignite-core] [2021-11-19 21:10:49,578][WARN ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] Peer class loading is enabled (disable it in production for performance and deployment consistency reasons) [21:10:49] : [Step 4/5] [2021-11-19 21:10:49,578][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] 3-rd party licenses can be found at: /opt/buildagent/work/7bc1c54bc719b67c/libs/licenses [21:10:49] : [Step 4/5] [2021-11-19 21:10:49,582][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] Configured plugins: [21:10:49] : [Step 4/5] [2021-11-19 21:10:49,582][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- StanByClusterTestProvider 1.0 [21:10:49] : [Step 4/5] [2021-11-19 21:10:49,583][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:10:49] : [Step 4/5] [2021-11-19 21:10:49,583][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] [21:10:49] : [Step 4/5] [2021-11-19 21:10:49,583][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- PageMemory tracker plugin 1.0 [21:10:49] : [Step 4/5] [2021-11-19 21:10:49,583][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:10:49] : [Step 4/5] [2021-11-19 21:10:49,583][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] [21:10:49] : [Step 4/5] [2021-11-19 21:10:49,583][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- TestDistibutedConfigurationPlugin 1.0 [21:10:49] : [Step 4/5] [2021-11-19 21:10:49,584][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:10:49] : [Step 4/5] [2021-11-19 21:10:49,584][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] [21:10:49] : [Step 4/5] [2021-11-19 21:10:49,584][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- NodeValidationPluginProvider 1.0 [21:10:49] : [Step 4/5] [2021-11-19 21:10:49,584][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:10:49] : [Step 4/5] [2021-11-19 21:10:49,584][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] [21:10:49] : [Step 4/5] [2021-11-19 21:10:49,585][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][FailureProcessor] Configured failure handler: [hnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]]] [21:10:49] : [Step 4/5] [2021-11-19 21:10:49,595][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][TestRecordingCommunicationSpi] Successfully bound communication NIO server to TCP port [port=47101, locHost=/127.0.0.1, selectorsCnt=12, selectorSpins=0, pairedConn=false] [21:10:49]W: [org.apache.ignite:ignite-core] [2021-11-19 21:10:49,595][WARN ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][TestRecordingCommunicationSpi] Message queue limit is set to 0 which may lead to potential OOMEs when running cache operations in FULL_ASYNC or PRIMARY_SYNC modes due to message queues growth on sender and receiver sides. [21:10:49] : [Step 4/5] [2021-11-19 21:10:49,599][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][GridCollisionManager] Collision resolution is disabled (all jobs will be activated upon arrival). [21:10:49] : [Step 4/5] [2021-11-19 21:10:49,600][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] Security status [authentication=off, sandbox=off, tls/ssl=off] [21:10:49] : [Step 4/5] [2021-11-19 21:10:49,658][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:10:49] : [Step 4/5] [2021-11-19 21:10:49,742][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][MaintenanceProcessor] Resolved store directory for node persistent data: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1 [21:10:49] : [Step 4/5] [2021-11-19 21:10:49,744][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][CacheObjectBinaryProcessorImpl] Resolved directory for serialized binary metadata: /opt/buildagent/work/7bc1c54bc719b67c/work/db/binary_meta/grid_1 [21:10:49] : [Step 4/5] [2021-11-19 21:10:49,747][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1 [21:10:49] : [Step 4/5] [2021-11-19 21:10:49,748][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][FileWriteAheadLogManager] Resolved write ahead log work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1 [21:10:49] : [Step 4/5] [2021-11-19 21:10:49,748][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][FileWriteAheadLogManager] Resolved write ahead log archive directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1 [21:10:49] : [Step 4/5] [2021-11-19 21:10:49,971][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000000.wal [21:10:49] : [Step 4/5] [2021-11-19 21:10:49,972][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][FileHandleManagerImpl] Initialized write-ahead log manager [mode=LOG_ONLY] [21:10:49] : [Step 4/5] [2021-11-19 21:10:49,976][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Configured data regions initialized successfully [total=5] [21:10:49] : [Step 4/5] [2021-11-19 21:10:49,979][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][IgniteSnapshotManager] Resolved snapshot work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/snapshots [21:10:49] : [Step 4/5] [2021-11-19 21:10:49,980][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][IgniteSnapshotManager] Resolved temp directory for snapshot creation: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1/snp [21:10:49] : [Step 4/5] [2021-11-19 21:10:49,982][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][ClientListenerProcessor] Client connector processor has started on TCP port 10801 [21:10:49] : [Step 4/5] [2021-11-19 21:10:49,984][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] Non-loopback local IPs: 172.17.0.4 [21:10:49] : [Step 4/5] [2021-11-19 21:10:49,985][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] Enabled local MACs: 0242AC110004 [21:10:49] : [Step 4/5] [2021-11-19 21:10:49,985][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:10:49] : [Step 4/5] [2021-11-19 21:10:49,987][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:10:49] : [Step 4/5] [2021-11-19 21:10:49,987][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:10:49] : [Step 4/5] [2021-11-19 21:10:49,989][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Applying lost metastore updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:10:49] : [Step 4/5] [2021-11-19 21:10:49,990][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=0 ms] [21:10:49] : [Step 4/5] [2021-11-19 21:10:49,990][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Restoring partition state for local groups. [21:10:49] : [Step 4/5] [2021-11-19 21:10:49,990][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=0, partitionsProcessed=0, time=0ms] [21:10:49] : [Step 4/5] [2021-11-19 21:10:49,991][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][GridEncryptionManager] Encryption keys loaded from metastore. [grps=, masterKeyName=ignite.master.key] [21:10:49] : [Step 4/5] [2021-11-19 21:10:49,992][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][ClusterProcessor] Cluster ID and tag has been read from metastorage: null [21:10:49] : [Step 4/5] [2021-11-19 21:10:49,993][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][IgniteClusterImpl] Shutdown policy was updated [oldVal=null, newVal=null] [21:10:49] : [Step 4/5] [2021-11-19 21:10:49,993][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Checkpoint frequency deviation changed [oldVal=null, newVal=null] [21:10:50] : [Step 4/5] [2021-11-19 21:10:50,009][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][FilePageStoreManager] Cleanup cache stores [total=1, left=0, cleanFiles=false] [21:10:50] : [Step 4/5] [2021-11-19 21:10:50,013][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:10:50] : [Step 4/5] [2021-11-19 21:10:50,014][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:10:50] : [Step 4/5] [2021-11-19 21:10:50,016][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:10:50] : [Step 4/5] [2021-11-19 21:10:50,016][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Data Regions Started: 5 [21:10:50] : [Step 4/5] [2021-11-19 21:10:50,017][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] ^-- sysMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:10:50] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:10:50] : [Step 4/5] ^-- default region [type=default, persistence=true, lazyAlloc=true, [21:10:50] : [Step 4/5] ... initCfg=100MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB, allocTotal=0MB] [21:10:50] : [Step 4/5] ^-- metastoreMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:10:50] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:10:50] : [Step 4/5] ^-- TxLog region [type=internal, persistence=true, lazyAlloc=false, [21:10:50] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:10:50] : [Step 4/5] ^-- volatileDsMemPlc region [type=user, persistence=false, lazyAlloc=true, [21:10:50] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB] [21:10:50] : [Step 4/5] ^-- Ignite persistence [used=0MB] [21:10:50] : [Step 4/5] [21:10:50] : [Step 4/5] [2021-11-19 21:10:50,019][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Starting binary memory restore for: [-2100569601] [21:10:50] : [Step 4/5] [2021-11-19 21:10:50,027][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:10:50] : [Step 4/5] [2021-11-19 21:10:50,028][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:10:50] : [Step 4/5] [2021-11-19 21:10:50,030][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000000.wal, offset=0, ver=2] [21:10:50] : [Step 4/5] [2021-11-19 21:10:50,035][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Started cache in recovery mode [name=ignite-sys-cache, id=-2100569601, dataRegionName=sysMemPlc, mode=REPLICATED, atomicity=TRANSACTIONAL, backups=2147483647, mvcc=false] [21:10:50] : [Step 4/5] [2021-11-19 21:10:50,036][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Binary recovery performed in 17 ms. [21:10:50] : [Step 4/5] [2021-11-19 21:10:50,036][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:10:50] : [Step 4/5] [2021-11-19 21:10:50,037][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Applying lost cache updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:10:50] : [Step 4/5] [2021-11-19 21:10:50,040][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=0 ms] [21:10:50] : [Step 4/5] [2021-11-19 21:10:50,040][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Restoring partition state for local groups. [21:10:50] : [Step 4/5] [2021-11-19 21:10:50,054][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=1, partitionsProcessed=100, time=20ms] [21:10:50] : [Step 4/5] [2021-11-19 21:10:50,078][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][TestTcpDiscoverySpi] Successfully bound to TCP port [port=47501, localHost=localhost/127.0.0.1, locNodeId=10a8a0d8-a507-4823-9923-6a3fda27b001] [21:10:50] : [Step 4/5] [2021-11-19 21:10:50,082][INFO ][tcp-disco-srvr-[:47500]-#1116%grid-0%-#21303%grid-0%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=41281] [21:10:50] : [Step 4/5] [2021-11-19 21:10:50,082][INFO ][tcp-disco-srvr-[:47500]-#1116%grid-0%-#21303%grid-0%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=41281] [21:10:50] : [Step 4/5] [2021-11-19 21:10:50,083][INFO ][tcp-disco-sock-reader-[]-#1122%grid-0%-#21423%grid-0%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:41281, rmtPort=41281] [21:10:50] : [Step 4/5] [2021-11-19 21:10:50,084][INFO ][tcp-disco-sock-reader-[10a8a0d8 127.0.0.1:41281]-#1122%grid-0%-#21423%grid-0%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=10a8a0d8-a507-4823-9923-6a3fda27b001, rmtAddr=/127.0.0.1:41281] [21:10:50] : [Step 4/5] [2021-11-19 21:10:50,090][INFO ][tcp-disco-srvr-[:47501]-#1121%grid-1%-#21422%grid-1%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=34009] [21:10:50] : [Step 4/5] [2021-11-19 21:10:50,090][INFO ][tcp-disco-srvr-[:47501]-#1121%grid-1%-#21422%grid-1%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=34009] [21:10:50] : [Step 4/5] [2021-11-19 21:10:50,091][INFO ][tcp-disco-sock-reader-[]-#1123%grid-1%-#21424%grid-1%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:34009, rmtPort=34009] [21:10:50] : [Step 4/5] [2021-11-19 21:10:50,092][INFO ][tcp-disco-sock-reader-[]-#1123%grid-1%-#21424%grid-1%][TestTcpDiscoverySpi] Received ping request from the remote node [rmtNodeId=00a005ca-1176-4aa8-8e19-66df6832f000, rmtAddr=/127.0.0.1:34009, rmtPort=34009] [21:10:50] : [Step 4/5] [2021-11-19 21:10:50,093][INFO ][tcp-disco-sock-reader-[]-#1123%grid-1%-#21424%grid-1%][TestTcpDiscoverySpi] Finished writing ping response [rmtNodeId=00a005ca-1176-4aa8-8e19-66df6832f000, rmtAddr=/127.0.0.1:34009, rmtPort=34009] [21:10:50] : [Step 4/5] [2021-11-19 21:10:50,093][INFO ][tcp-disco-sock-reader-[10a8a0d8 127.0.0.1:41281]-#1122%grid-0%-#21423%grid-0%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:41281, rmtPort=41281, rmtNodeId=10a8a0d8-a507-4823-9923-6a3fda27b001] [21:10:50]W: [org.apache.ignite:ignite-core] [2021-11-19 21:10:50,093][WARN ][tcp-disco-sock-reader-[]-#1123%grid-1%-#21424%grid-1%][TestTcpDiscoverySpi] Failed to shutdown socket [21:10:50]W: [org.apache.ignite:ignite-core] java.net.SocketException: Socket output is already shutdown [21:10:50]W: [org.apache.ignite:ignite-core] at java.net.Socket.shutdownOutput(Socket.java:1572) [21:10:50]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.close(IgniteUtils.java:4247) [21:10:50]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.discovery.tcp.ServerImpl$SocketReader.body(ServerImpl.java:7370) [21:10:50]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.IgniteSpiThread.run(IgniteSpiThread.java:58) [21:10:50] : [Step 4/5] [2021-11-19 21:10:50,096][INFO ][tcp-disco-sock-reader-[]-#1123%grid-1%-#21424%grid-1%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:34009, rmtPort=34009, rmtNodeId=null] [21:10:50] : [Step 4/5] [2021-11-19 21:10:50,097][INFO ][tcp-disco-msg-worker-[crd]-#1115%grid-0%-#21302%grid-0%][GridEncryptionManager] Joining node doesn't have stored group keys [node=10a8a0d8-a507-4823-9923-6a3fda27b001] [21:10:50] : [Step 4/5] [2021-11-19 21:10:50,106][INFO ][tcp-disco-msg-worker-[crd]-#1115%grid-0%-#21302%grid-0%][TestTcpDiscoverySpi] New next node [newNext=TcpDiscoveryNode [id=10a8a0d8-a507-4823-9923-6a3fda27b001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=0, intOrder=2, lastExchangeTime=1637345450084, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false]] [21:10:50] : [Step 4/5] [2021-11-19 21:10:50,107][INFO ][tcp-disco-srvr-[:47501]-#1121%grid-1%-#21422%grid-1%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=52725] [21:10:50] : [Step 4/5] [2021-11-19 21:10:50,107][INFO ][tcp-disco-srvr-[:47501]-#1121%grid-1%-#21422%grid-1%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=52725] [21:10:50] : [Step 4/5] [2021-11-19 21:10:50,108][INFO ][tcp-disco-sock-reader-[]-#1124%grid-1%-#21425%grid-1%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:52725, rmtPort=52725] [21:10:50] : [Step 4/5] [2021-11-19 21:10:50,109][INFO ][tcp-disco-sock-reader-[00a005ca 127.0.0.1:52725]-#1124%grid-1%-#21425%grid-1%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=00a005ca-1176-4aa8-8e19-66df6832f000, rmtAddr=/127.0.0.1:52725] [21:10:50] : [Step 4/5] [2021-11-19 21:10:50,113][INFO ][tcp-disco-msg-worker-[]-#1120%grid-1%-#21421%grid-1%][TestTcpDiscoverySpi] New next node [newNext=TcpDiscoveryNode [id=00a005ca-1176-4aa8-8e19-66df6832f000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345450105, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false]] [21:10:50] : [Step 4/5] [2021-11-19 21:10:50,114][INFO ][tcp-disco-srvr-[:47500]-#1116%grid-0%-#21303%grid-0%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=47315] [21:10:50] : [Step 4/5] [2021-11-19 21:10:50,114][INFO ][tcp-disco-srvr-[:47500]-#1116%grid-0%-#21303%grid-0%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=47315] [21:10:50] : [Step 4/5] [2021-11-19 21:10:50,114][INFO ][tcp-disco-sock-reader-[]-#1125%grid-0%-#21426%grid-0%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:47315, rmtPort=47315] [21:10:50] : [Step 4/5] [2021-11-19 21:10:50,115][INFO ][tcp-disco-sock-reader-[10a8a0d8 127.0.0.1:47315]-#1125%grid-0%-#21426%grid-0%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=10a8a0d8-a507-4823-9923-6a3fda27b001, rmtAddr=/127.0.0.1:47315] [21:10:50] : [Step 4/5] [2021-11-19 21:10:50,118][INFO ][disco-event-worker-#21305%grid-0%][GridDiscoveryManager] Added new node to topology: TcpDiscoveryNode [id=10a8a0d8-a507-4823-9923-6a3fda27b001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637345450084, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false] [21:10:50] : [Step 4/5] [2021-11-19 21:10:50,119][INFO ][disco-event-worker-#21305%grid-0%][GridDiscoveryManager] Topology snapshot [ver=2, locNode=00a005ca, servers=2, clients=0, state=INACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=00a005ca-1176-4aa8-8e19-66df6832f000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=10a8a0d8-a507-4823-9923-6a3fda27b001, consistentId=grid-1, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:10:50] : [Step 4/5] [2021-11-19 21:10:50,121][INFO ][tcp-disco-msg-worker-[00a005ca 127.0.0.1:47500]-#1120%grid-1%-#21421%grid-1%][ClusterProcessor] vigilant_dirac [21:10:50] : [Step 4/5] [2021-11-19 21:10:50,122][INFO ][tcp-disco-msg-worker-[00a005ca 127.0.0.1:47500]-#1120%grid-1%-#21421%grid-1%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustEnabled' was changed from 'null' to 'false' [21:10:50] : [Step 4/5] [2021-11-19 21:10:50,122][INFO ][tcp-disco-msg-worker-[00a005ca 127.0.0.1:47500]-#1120%grid-1%-#21421%grid-1%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustTimeout' was changed from 'null' to '300000' [21:10:50] : [Step 4/5] [2021-11-19 21:10:50,123][INFO ][tcp-disco-msg-worker-[00a005ca 127.0.0.1:47500]-#1120%grid-1%-#21421%grid-1%][IgniteTxManager] Transactions parameter 'longOperationsDumpTimeout' was changed from 'null' to '60000' [21:10:50] : [Step 4/5] [2021-11-19 21:10:50,123][INFO ][tcp-disco-msg-worker-[00a005ca 127.0.0.1:47500]-#1120%grid-1%-#21421%grid-1%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpThreshold' was changed from 'null' to '0' [21:10:50] : [Step 4/5] [2021-11-19 21:10:50,124][INFO ][tcp-disco-msg-worker-[00a005ca 127.0.0.1:47500]-#1120%grid-1%-#21421%grid-1%][IgniteTxManager] Transactions parameter 'transactionTimeDumpSamplesCoefficient' was changed from 'null' to '0.0' [21:10:50] : [Step 4/5] [2021-11-19 21:10:50,124][INFO ][tcp-disco-msg-worker-[00a005ca 127.0.0.1:47500]-#1120%grid-1%-#21421%grid-1%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpSamplesPerSecondLimit' was changed from 'null' to '5' [21:10:50] : [Step 4/5] [2021-11-19 21:10:50,125][INFO ][tcp-disco-msg-worker-[00a005ca 127.0.0.1:47500]-#1120%grid-1%-#21421%grid-1%][IgniteTxManager] Transactions parameter 'collisionsDumpInterval' was changed from 'null' to '1000' [21:10:50] : [Step 4/5] [2021-11-19 21:10:50,125][INFO ][tcp-disco-msg-worker-[00a005ca 127.0.0.1:47500]-#1120%grid-1%-#21421%grid-1%][IgniteTxManager] Transactions parameter 'txOwnerDumpRequestsAllowed' was changed from 'null' to 'true' [21:10:50] : [Step 4/5] [2021-11-19 21:10:50,126][INFO ][tcp-disco-msg-worker-[00a005ca 127.0.0.1:47500]-#1120%grid-1%-#21421%grid-1%][GridCacheDatabaseSharedManager] Historical rebalance WAL threshold changed [property=historical.rebalance.threshold, oldVal=null, newVal=500] [21:10:50] : [Step 4/5] [2021-11-19 21:10:50,127][INFO ][disco-notifier-worker-#21420%grid-1%][MvccProcessorImpl] Assigned mvcc coordinator [crd=MvccCoordinator [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=0], nodeId=00a005ca-1176-4aa8-8e19-66df6832f000, ver=1637345449529, local=false, initialized=false]] [21:10:50] : [Step 4/5] [2021-11-19 21:10:50,130][INFO ][sys-#21402%grid-1%][ClusterProcessor] Writing cluster ID and tag to metastorage on ready for write ClusterIdAndTag [id=7725c528-87c9-45db-80e4-cdcc9f24cdd8, tag=vigilant_dirac] [21:10:50] : [Step 4/5] [2021-11-19 21:10:50,153][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] To start Console Management & Monitoring run ignitevisorcmd.{sh|bat} [21:10:50] : [Step 4/5] [2021-11-19 21:10:50,153][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] [21:10:50] : [Step 4/5] [21:10:50] : [Step 4/5] >>> +-------------------------------------------+ [21:10:50] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:10:50] : [Step 4/5] >>> +-------------------------------------------+ [21:10:50] : [Step 4/5] >>> OS name: Linux 4.15.0-151-generic amd64 [21:10:50] : [Step 4/5] >>> CPU(s): 24 [21:10:50] : [Step 4/5] >>> Heap: 2.0GB [21:10:50] : [Step 4/5] >>> VM name: 16724@c4dfe9a430b2 [21:10:50] : [Step 4/5] >>> Ignite instance name: grid-1 [21:10:50] : [Step 4/5] >>> Local node [ID=10A8A0D8-A507-4823-9923-6A3FDA27B001, order=2, clientMode=false] [21:10:50] : [Step 4/5] >>> Local node addresses: [127.0.0.1] [21:10:50] : [Step 4/5] >>> Local ports: TCP:10801 TCP:47101 TCP:47501 [21:10:50] : [Step 4/5] [21:10:50] : [Step 4/5] [2021-11-19 21:10:50,155][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] >>> Ignite cluster is in INACTIVE state (limited functionality available). Use control.(sh|bat) script or IgniteCluster.state(ClusterState.ACTIVE) to change the state. [21:10:50] : [Step 4/5] [2021-11-19 21:10:50,155][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][GridDiscoveryManager] Topology snapshot [ver=2, locNode=10a8a0d8, servers=2, clients=0, state=INACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=00a005ca-1176-4aa8-8e19-66df6832f000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=10a8a0d8-a507-4823-9923-6a3fda27b001, consistentId=grid-1, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:10:50] : [Step 4/5] [2021-11-19 21:10:50,156][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][G] Node started : [stage="Configure system pool" (0 ms),stage="Start managers" (185 ms),stage="Configure binary metadata" (1 ms),stage="Start processors" (238 ms),stage="Start 'StanByClusterTestProvider' plugin" (0 ms),stage="Start 'PageMemory tracker plugin' plugin" (0 ms),stage="Start 'TestDistibutedConfigurationPlugin' plugin" (0 ms),stage="Start 'NodeValidationPluginProvider' plugin" (0 ms),stage="Init metastore" (25 ms),stage="Init and start regions" (9 ms),stage="Restore binary memory" (17 ms),stage="Restore logical state" (17 ms),stage="Finish recovery" (23 ms),stage="Join topology" (49 ms),stage="Await transition" (4 ms),stage="Await exchange" (25 ms),stage="Total time" (593 ms)] [21:10:50] : [Step 4/5] [2021-11-19 21:10:50,158][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][root] Node started with the following configuration [id=10a8a0d8-a507-4823-9923-6a3fda27b001, marshaller=BinaryMarshaller [], discovery=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=5000, ackTimeout=5000, marsh=JdkMarshaller [clsFilter=org.apache.ignite.marshaller.MarshallerUtils$1@1d9ce1c0], reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], binaryCfg=null, lateAff=true] [21:10:50] : [Step 4/5] [2021-11-19 21:10:50,160][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][GridClusterStateProcessor] Sending activate cluster request with BaselineTopology BaselineTopology [id=0, branchingHash=-2475315501, branchingType='New BaselineTopology', baselineNodes=[grid-1, grid-0]] [21:10:50] : [Step 4/5] [2021-11-19 21:10:50,165][INFO ][disco-notifier-worker-#21301%grid-0%][GridClusterStateProcessor] Received activate cluster request with BaselineTopology[id=0] initiator node ID: 00a005ca-1176-4aa8-8e19-66df6832f000 [21:10:50] : [Step 4/5] [2021-11-19 21:10:50,166][INFO ][disco-notifier-worker-#21301%grid-0%][GridClusterStateProcessor] Started state transition: activate cluster [21:10:50] : [Step 4/5] [2021-11-19 21:10:50,167][INFO ][exchange-worker-#21306%grid-0%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], crd=true, evt=DISCOVERY_CUSTOM_EVT, evtNode=00a005ca-1176-4aa8-8e19-66df6832f000, customEvt=ChangeGlobalStateMessage [id=c928d593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqId=51187384-2927-47ec-b045-64bcf5ce7304, initiatingNodeId=00a005ca-1176-4aa8-8e19-66df6832f000, state=ACTIVE, baselineTopology=BaselineTopology [id=0, branchingHash=-2475315501, branchingType='New BaselineTopology', baselineNodes=[grid-1, grid-0]], forceChangeBaselineTopology=false, timestamp=1637345450160, forceDeactivation=true], allowMerge=false, exchangeFreeSwitch=false] [21:10:50] : [Step 4/5] [2021-11-19 21:10:50,168][INFO ][exchange-worker-#21306%grid-0%][GridDhtPartitionsExchangeFuture] Start activation process [nodeId=00a005ca-1176-4aa8-8e19-66df6832f000, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]]. New state: ACTIVE [21:10:50] : [Step 4/5] [2021-11-19 21:10:50,169][INFO ][exchange-worker-#21306%grid-0%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0 [21:10:50] : [Step 4/5] [2021-11-19 21:10:50,167][INFO ][disco-notifier-worker-#21420%grid-1%][GridClusterStateProcessor] Received activate cluster request with BaselineTopology[id=0] initiator node ID: 00a005ca-1176-4aa8-8e19-66df6832f000 [21:10:50] : [Step 4/5] [2021-11-19 21:10:50,170][INFO ][disco-notifier-worker-#21420%grid-1%][GridClusterStateProcessor] Started state transition: activate cluster [21:10:50] : [Step 4/5] [2021-11-19 21:10:50,173][INFO ][exchange-worker-#21306%grid-0%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000000.wal, offset=8795, ver=2] [21:10:50] : [Step 4/5] [2021-11-19 21:10:50,175][INFO ][exchange-worker-#21306%grid-0%][GridClusterStateProcessor] Writing BaselineTopology[id=0] [21:10:50] : [Step 4/5] [2021-11-19 21:10:50,175][INFO ][exchange-worker-#21429%grid-1%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], crd=false, evt=DISCOVERY_CUSTOM_EVT, evtNode=00a005ca-1176-4aa8-8e19-66df6832f000, customEvt=ChangeGlobalStateMessage [id=c928d593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqId=51187384-2927-47ec-b045-64bcf5ce7304, initiatingNodeId=00a005ca-1176-4aa8-8e19-66df6832f000, state=ACTIVE, baselineTopology=BaselineTopology [id=0, branchingHash=-2475315501, branchingType='New BaselineTopology', baselineNodes=[grid-1, grid-0]], forceChangeBaselineTopology=false, timestamp=1637345450160, forceDeactivation=true], allowMerge=false, exchangeFreeSwitch=false] [21:10:50] : [Step 4/5] [2021-11-19 21:10:50,176][INFO ][exchange-worker-#21429%grid-1%][GridDhtPartitionsExchangeFuture] Start activation process [nodeId=10a8a0d8-a507-4823-9923-6a3fda27b001, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]]. New state: ACTIVE [21:10:50] : [Step 4/5] [2021-11-19 21:10:50,177][INFO ][exchange-worker-#21429%grid-1%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1 [21:10:50] : [Step 4/5] [2021-11-19 21:10:50,185][INFO ][exchange-worker-#21306%grid-0%][GridCacheDatabaseSharedManager] Finish recovery performed in 15 ms. [21:10:50] : [Step 4/5] [2021-11-19 21:10:50,186][INFO ][exchange-worker-#21306%grid-0%][msg] Components activation performed in 17 ms. [21:10:50] : [Step 4/5] [2021-11-19 21:10:50,192][INFO ][exchange-worker-#21306%grid-0%][GridCacheProcessor] Finished recovery for cache [cache=ignite-sys-cache, grp=ignite-sys-cache, startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:10:50] : [Step 4/5] [2021-11-19 21:10:50,193][INFO ][exchange-worker-#21306%grid-0%][GridDhtPartitionsExchangeFuture] Successfully activated caches [nodeId=00a005ca-1176-4aa8-8e19-66df6832f000, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], newState=ACTIVE] [21:10:50] : [Step 4/5] [2021-11-19 21:10:50,194][INFO ][exchange-worker-#21306%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:10:50] : [Step 4/5] [2021-11-19 21:10:50,196][INFO ][exchange-worker-#21429%grid-1%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000000.wal, offset=8795, ver=2] [21:10:50] : [Step 4/5] [2021-11-19 21:10:50,198][INFO ][exchange-worker-#21429%grid-1%][GridClusterStateProcessor] Writing BaselineTopology[id=0] [21:10:50] : [Step 4/5] [2021-11-19 21:10:50,200][INFO ][exchange-worker-#21429%grid-1%][GridCacheDatabaseSharedManager] Finish recovery performed in 9 ms. [21:10:50] : [Step 4/5] [2021-11-19 21:10:50,203][INFO ][exchange-worker-#21429%grid-1%][msg] Components activation performed in 26 ms. [21:10:50] : [Step 4/5] [2021-11-19 21:10:50,208][INFO ][exchange-worker-#21429%grid-1%][GridCacheProcessor] Finished recovery for cache [cache=ignite-sys-cache, grp=ignite-sys-cache, startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:10:50] : [Step 4/5] [2021-11-19 21:10:50,209][INFO ][exchange-worker-#21429%grid-1%][GridDhtPartitionsExchangeFuture] Successfully activated caches [nodeId=10a8a0d8-a507-4823-9923-6a3fda27b001, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], newState=ACTIVE] [21:10:50] : [Step 4/5] [2021-11-19 21:10:50,209][INFO ][exchange-worker-#21429%grid-1%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:10:50] : [Step 4/5] [2021-11-19 21:10:50,217][INFO ][exchange-worker-#21306%grid-0%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], crd=true] [21:10:50] : [Step 4/5] [2021-11-19 21:10:50,221][INFO ][grid-nio-worker-tcp-comm-0-#21244%TestRecordingCommunicationSpi%][TestRecordingCommunicationSpi] Accepted incoming communication connection [locAddr=/127.0.0.1:47100, rmtAddr=/127.0.0.1:33286] [21:10:50] : [Step 4/5] [2021-11-19 21:10:50,234][INFO ][grid-nio-worker-tcp-comm-0-#21363%TestRecordingCommunicationSpi%][TestRecordingCommunicationSpi] Established outgoing communication connection [locAddr=/127.0.0.1:33286, rmtAddr=/127.0.0.1:47100] [21:10:50] : [Step 4/5] [2021-11-19 21:10:50,235][INFO ][exchange-worker-#21429%grid-1%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], crd=false] [21:10:50] : [Step 4/5] [2021-11-19 21:10:50,236][INFO ][sys-#21300%grid-0%][GridDhtPartitionsExchangeFuture] Coordinator received single message [ver=AffinityTopologyVersion [topVer=2, minorTopVer=1], node=10a8a0d8-a507-4823-9923-6a3fda27b001, allReceived=true] [21:10:50] : [Step 4/5] [2021-11-19 21:10:50,246][INFO ][db-checkpoint-thread-#21445%grid-1%][Checkpointer] Checkpoint started [checkpointId=6646ce5b-0324-4d0a-a99c-7bd5cca3532f, startPtr=WALPointer [idx=0, fileOff=86661, len=1963], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=9ms, writeCheckpointEntryDuration=19ms, splitAndSortCpPagesDuration=0ms, pages=18, reason='node started'] [21:10:50] : [Step 4/5] [2021-11-19 21:10:50,246][INFO ][db-checkpoint-thread-#21440%grid-0%][Checkpointer] Checkpoint started [checkpointId=11bbf28c-248a-4143-9fb1-09f844ca91bf, startPtr=WALPointer [idx=0, fileOff=86661, len=1963], checkpointBeforeLockTime=7ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=10ms, writeCheckpointEntryDuration=19ms, splitAndSortCpPagesDuration=0ms, pages=18, reason='node started'] [21:10:50] : [Step 4/5] [2021-11-19 21:10:50,247][INFO ][sys-#21300%grid-0%][GridDhtPartitionsExchangeFuture] finishExchangeOnCoordinator [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:10:50] : [Step 4/5] [2021-11-19 21:10:50,255][INFO ][sys-#21300%grid-0%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], err=null, rebalanced=true, wasRebalanced=false] [21:10:50] : [Step 4/5] [2021-11-19 21:10:50,256][INFO ][sys-#21397%grid-1%][GridDhtPartitionsExchangeFuture] Received full message, will finish exchange [node=00a005ca-1176-4aa8-8e19-66df6832f000, resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:10:50] : [Step 4/5] [2021-11-19 21:10:50,255][INFO ][disco-notifier-worker-#21301%grid-0%][GridClusterStateProcessor] Received state change finish message: ACTIVE [21:10:50] : [Step 4/5] [2021-11-19 21:10:50,258][INFO ][disco-notifier-worker-#21301%grid-0%][GridClusterStateProcessor] Cluster state was changed from INACTIVE to ACTIVE [21:10:50] : [Step 4/5] [2021-11-19 21:10:50,258][INFO ][sys-#21411%grid-1%][GridCachePartitionExchangeManager] Delay process full message without exchange id (there is exchange in progress) [nodeId=00a005ca-1176-4aa8-8e19-66df6832f000] [21:10:50] : [Step 4/5] [2021-11-19 21:10:50,256][INFO ][disco-notifier-worker-#21420%grid-1%][GridClusterStateProcessor] Received state change finish message: ACTIVE [21:10:50] : [Step 4/5] [2021-11-19 21:10:50,259][INFO ][sys-#21300%grid-0%][GridCacheProcessor] Finish proxy initialization, cacheName=ignite-sys-cache, localNodeId=00a005ca-1176-4aa8-8e19-66df6832f000 [21:10:50] : [Step 4/5] [2021-11-19 21:10:50,258][INFO ][sys-#21397%grid-1%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], err=null, rebalanced=true, wasRebalanced=false] [21:10:50] : [Step 4/5] [2021-11-19 21:10:50,261][INFO ][sys-#21284%grid-0%][DistributedBaselineConfiguration] Baseline auto-adjust is 'disabled' with timeout='300000' ms [21:10:50] : [Step 4/5] [2021-11-19 21:10:50,260][INFO ][disco-notifier-worker-#21420%grid-1%][GridClusterStateProcessor] Cluster state was changed from INACTIVE to ACTIVE [21:10:50] : [Step 4/5] [2021-11-19 21:10:50,262][INFO ][sys-#21300%grid-0%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=00a005ca-1176-4aa8-8e19-66df6832f000, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=00a005ca-1176-4aa8-8e19-66df6832f000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345450254, loc=true, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:10:50] : [Step 4/5] [2021-11-19 21:10:50,262][INFO ][sys-#21284%grid-0%][GridClusterStateProcessor] Successfully performed final activation steps [nodeId=00a005ca-1176-4aa8-8e19-66df6832f000, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:10:50] : [Step 4/5] [2021-11-19 21:10:50,264][INFO ][sys-#21300%grid-0%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (1 ms), stage="Update caches registry" (18 ms), stage="Start caches" (5 ms), stage="Affinity initialization on cache group start" (0 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Restore partition states" (0 ms), stage="After states restored callback" (23 ms), stage="WAL history reservation" (0 ms), stage="Waiting for all single messages" (29 ms), stage="Affinity recalculation (crd)" (2 ms), stage="Collect update counters and create affinity messages" (0 ms), stage="Assign partitions states" (0 ms), stage="Validate partitions states" (0 ms), stage="Ideal affinity diff calculation (enforced)" (0 ms), stage="Apply update counters" (0 ms), stage="Full message preparing" (4 ms), stage="Full message sending" (0 ms), stage="State finish message sending" (0 ms), stage="Detect lost partitions" (2 ms), stage="Exchange done" (6 ms), stage="Total time" (90 ms), Discovery lag=7 ms, Latest started node id=10a8a0d8-a507-4823-9923-6a3fda27b001] [21:10:50] : [Step 4/5] [2021-11-19 21:10:50,263][INFO ][sys-#21397%grid-1%][GridCacheProcessor] Finish proxy initialization, cacheName=ignite-sys-cache, localNodeId=10a8a0d8-a507-4823-9923-6a3fda27b001 [21:10:50] : [Step 4/5] [2021-11-19 21:10:50,262][INFO ][exchange-worker-#21306%grid-0%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=2, minorTopVer=1], force=false, evt=DISCOVERY_CUSTOM_EVT, node=00a005ca-1176-4aa8-8e19-66df6832f000] [21:10:50] : [Step 4/5] [2021-11-19 21:10:50,269][INFO ][sys-#21415%grid-1%][DistributedBaselineConfiguration] Baseline auto-adjust is 'disabled' with timeout='300000' ms [21:10:50] : [Step 4/5] [2021-11-19 21:10:50,269][INFO ][exchange-worker-#21429%grid-1%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=2, minorTopVer=1], force=false, evt=DISCOVERY_CUSTOM_EVT, node=00a005ca-1176-4aa8-8e19-66df6832f000] [21:10:50] : [Step 4/5] [2021-11-19 21:10:50,269][INFO ][sys-#21397%grid-1%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=10a8a0d8-a507-4823-9923-6a3fda27b001, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=00a005ca-1176-4aa8-8e19-66df6832f000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345450105, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:10:50] : [Step 4/5] [2021-11-19 21:10:50,267][INFO ][sys-#21300%grid-0%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], stage="Affinity initialization on cache group start [grp=ignite-sys-cache]" (0 ms) (parent=Affinity initialization on cache group start), stage="Affinity centralized initialization (crd) [grp=ignite-sys-cache, crd=true]" (0 ms) (parent=Determine exchange type), stage="Restore partition states [grp=ignite-sys-cache]" (0 ms) (parent=Restore partition states), stage="Affinity recalculation (partitions availability) [grp=ignite-sys-cache]" (0 ms) (parent=Ideal affinity diff calculation (enforced))] [21:10:50] : [Step 4/5] [2021-11-19 21:10:50,272][INFO ][sys-#21397%grid-1%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], stage="Waiting in exchange queue" (1 ms), stage="Exchange parameters initialization" (1 ms), stage="Update caches registry" (31 ms), stage="Start caches" (0 ms), stage="Affinity initialization on cache group start" (0 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Restore partition states" (0 ms), stage="After states restored callback" (8 ms), stage="WAL history reservation" (0 ms), stage="Waiting for Full message" (37 ms), stage="Affinity recalculation" (1 ms), stage="Full map updating" (0 ms), stage="Detect lost partitions" (3 ms), stage="Exchange done" (9 ms), stage="Total time" (91 ms)] [21:10:50] : [Step 4/5] [2021-11-19 21:10:50,270][INFO ][sys-#21415%grid-1%][GridClusterStateProcessor] Successfully performed final activation steps [nodeId=10a8a0d8-a507-4823-9923-6a3fda27b001, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:10:50] : [Step 4/5] [2021-11-19 21:10:50,275][INFO ][exchange-worker-#21429%grid-1%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], crd=false, evt=DISCOVERY_CUSTOM_EVT, evtNode=00a005ca-1176-4aa8-8e19-66df6832f000, customEvt=DynamicCacheChangeBatch [id=0c28d593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqs=ArrayList [DynamicCacheChangeRequest [cacheName=encrypted, hasCfg=true, nodeId=00a005ca-1176-4aa8-8e19-66df6832f000, clientStartOnly=false, stop=false, destroy=false, disabledAfterStart=false]], exchangeActions=ExchangeActions [startCaches=[encrypted], stopCaches=null, startGrps=[encrypted], stopGrps=[], resetParts=null, stateChangeRequest=null], startCaches=false], allowMerge=false, exchangeFreeSwitch=false] [21:10:50] : [Step 4/5] [2021-11-19 21:10:50,275][INFO ][sys-#21397%grid-1%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], stage="Affinity initialization on cache group start [grp=ignite-sys-cache]" (0 ms) (parent=Affinity initialization on cache group start), stage="Affinity centralized initialization (crd) [grp=ignite-sys-cache, crd=false]" (0 ms) (parent=Determine exchange type), stage="Restore partition states [grp=ignite-sys-cache]" (0 ms) (parent=Restore partition states), stage="Affinity applying from full message [grp=ignite-sys-cache]" (1 ms) (parent=Affinity recalculation)] [21:10:50] : [Step 4/5] [2021-11-19 21:10:50,279][INFO ][exchange-worker-#21429%grid-1%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:10:50] : [Step 4/5] [2021-11-19 21:10:50,280][INFO ][exchange-worker-#21306%grid-0%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], crd=true, evt=DISCOVERY_CUSTOM_EVT, evtNode=00a005ca-1176-4aa8-8e19-66df6832f000, customEvt=DynamicCacheChangeBatch [id=0c28d593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqs=ArrayList [DynamicCacheChangeRequest [cacheName=encrypted, hasCfg=true, nodeId=00a005ca-1176-4aa8-8e19-66df6832f000, clientStartOnly=false, stop=false, destroy=false, disabledAfterStart=false]], exchangeActions=ExchangeActions [startCaches=[encrypted], stopCaches=null, startGrps=[encrypted], stopGrps=[], resetParts=null, stateChangeRequest=null], startCaches=false], allowMerge=false, exchangeFreeSwitch=false] [21:10:50] : [Step 4/5] [2021-11-19 21:10:50,283][INFO ][exchange-worker-#21306%grid-0%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:10:50] : [Step 4/5] [2021-11-19 21:10:50,285][INFO ][db-checkpoint-thread-#21445%grid-1%][Checkpointer] Checkpoint finished [cpId=6646ce5b-0324-4d0a-a99c-7bd5cca3532f, pages=18, markPos=WALPointer [idx=0, fileOff=86661, len=1963], walSegmentsCovered=[], markDuration=30ms, pagesWrite=1ms, fsync=36ms, total=68ms] [21:10:50] : [Step 4/5] [2021-11-19 21:10:50,287][INFO ][db-checkpoint-thread-#21440%grid-0%][Checkpointer] Checkpoint finished [cpId=11bbf28c-248a-4143-9fb1-09f844ca91bf, pages=18, markPos=WALPointer [idx=0, fileOff=86661, len=1963], walSegmentsCovered=[], markDuration=32ms, pagesWrite=5ms, fsync=33ms, total=77ms] [21:10:50] : [Step 4/5] [2021-11-19 21:10:50,290][INFO ][exchange-worker-#21306%grid-0%][GridCacheProcessor] Started cache [name=encrypted, id=1613773252, dataRegionName=default, mode=PARTITIONED, atomicity=ATOMIC, backups=0, mvcc=false] [21:10:50] : [Step 4/5] [2021-11-19 21:10:50,296][INFO ][exchange-worker-#21306%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], waitTime=0ms, futInfo=NA, mode=DISTRIBUTED] [21:10:50] : [Step 4/5] [2021-11-19 21:10:50,297][INFO ][exchange-worker-#21429%grid-1%][GridCacheProcessor] Started cache [name=encrypted, id=1613773252, dataRegionName=default, mode=PARTITIONED, atomicity=ATOMIC, backups=0, mvcc=false] [21:10:50] : [Step 4/5] [2021-11-19 21:10:50,301][INFO ][exchange-worker-#21429%grid-1%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], waitTime=0ms, futInfo=NA, mode=DISTRIBUTED] [21:10:50] : [Step 4/5] [2021-11-19 21:10:50,302][INFO ][exchange-worker-#21429%grid-1%][GridDhtPartitionsExchangeFuture] Finished waiting for partitions release latch: ClientLatch [coordinator=TcpDiscoveryNode [id=00a005ca-1176-4aa8-8e19-66df6832f000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345450105, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], ackSent=true, super=CompletableLatch [id=CompletableLatchUid [id=exchange, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2]]]] [21:10:50] : [Step 4/5] [2021-11-19 21:10:50,303][INFO ][exchange-worker-#21429%grid-1%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:10:50] : [Step 4/5] [2021-11-19 21:10:50,303][INFO ][exchange-worker-#21306%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partitions release latch: ServerLatch [permits=0, pendingAcks=HashSet [], super=CompletableLatch [id=CompletableLatchUid [id=exchange, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2]]]] [21:10:50] : [Step 4/5] [2021-11-19 21:10:50,304][INFO ][exchange-worker-#21306%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:10:50] : [Step 4/5] [2021-11-19 21:10:50,305][INFO ][exchange-worker-#21429%grid-1%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], crd=false] [21:10:50] : [Step 4/5] [2021-11-19 21:10:50,305][INFO ][exchange-worker-#21306%grid-0%][GridDhtPartitionsExchangeFuture] Coordinator received single message [ver=AffinityTopologyVersion [topVer=2, minorTopVer=2], node=10a8a0d8-a507-4823-9923-6a3fda27b001, allReceived=true] [21:10:50] : [Step 4/5] [2021-11-19 21:10:50,306][INFO ][exchange-worker-#21306%grid-0%][GridDhtPartitionsExchangeFuture] finishExchangeOnCoordinator [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2]] [21:10:50] : [Step 4/5] [2021-11-19 21:10:50,308][INFO ][exchange-worker-#21306%grid-0%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], err=null, rebalanced=true, wasRebalanced=true] [21:10:50] : [Step 4/5] [2021-11-19 21:10:50,309][INFO ][sys-#21401%grid-1%][GridDhtPartitionsExchangeFuture] Received full message, will finish exchange [node=00a005ca-1176-4aa8-8e19-66df6832f000, resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2]] [21:10:50] : [Step 4/5] [2021-11-19 21:10:50,309][INFO ][exchange-worker-#21306%grid-0%][GridCacheProcessor] Finish proxy initialization, cacheName=encrypted, localNodeId=00a005ca-1176-4aa8-8e19-66df6832f000 [21:10:50] : [Step 4/5] [2021-11-19 21:10:50,309][INFO ][sys-#21401%grid-1%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], err=null, rebalanced=true, wasRebalanced=true] [21:10:50] : [Step 4/5] [2021-11-19 21:10:50,310][INFO ][exchange-worker-#21306%grid-0%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=00a005ca-1176-4aa8-8e19-66df6832f000, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=00a005ca-1176-4aa8-8e19-66df6832f000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345450274, loc=true, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2]] [21:10:50] : [Step 4/5] [2021-11-19 21:10:50,311][INFO ][exchange-worker-#21306%grid-0%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], stage="Waiting in exchange queue" (2 ms), stage="Exchange parameters initialization" (1 ms), stage="Update caches registry" (0 ms), stage="Start caches" (8 ms), stage="Affinity initialization on cache group start" (5 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (3 ms), stage="Wait partitions release latch [latch=exchange]" (4 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Restore partition states" (0 ms), stage="After states restored callback" (0 ms), stage="WAL history reservation" (0 ms), stage="Waiting for all single messages" (0 ms), stage="Affinity recalculation (crd)" (0 ms), stage="Collect update counters and create affinity messages" (0 ms), stage="Assign partitions states" (0 ms), stage="Validate partitions states" (0 ms), stage="Apply update counters" (0 ms), stage="Full message preparing" (0 ms), stage="Full message sending" (0 ms), stage="Exchange done" (3 ms), stage="Total time" (26 ms), Discovery lag=3 ms, Latest started node id=00a005ca-1176-4aa8-8e19-66df6832f000] [21:10:50] : [Step 4/5] [2021-11-19 21:10:50,310][INFO ][sys-#21401%grid-1%][GridCacheProcessor] Finish proxy initialization, cacheName=encrypted, localNodeId=10a8a0d8-a507-4823-9923-6a3fda27b001 [21:10:50] : [Step 4/5] [2021-11-19 21:10:50,315][INFO ][sys-#21401%grid-1%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=10a8a0d8-a507-4823-9923-6a3fda27b001, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=00a005ca-1176-4aa8-8e19-66df6832f000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345450105, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2]] [21:10:50] : [Step 4/5] [2021-11-19 21:10:50,315][INFO ][exchange-worker-#21429%grid-1%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=2, minorTopVer=2], force=false, evt=DISCOVERY_CUSTOM_EVT, node=00a005ca-1176-4aa8-8e19-66df6832f000] [21:10:50] : [Step 4/5] [2021-11-19 21:10:50,316][INFO ][exchange-worker-#21306%grid-0%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], stage="Affinity initialization on cache group start [grp=encrypted]" (5 ms) (parent=Affinity initialization on cache group start), stage="Restore partition states [grp=ignite-sys-cache]" (0 ms) (parent=Restore partition states), stage="Restore partition states [grp=encrypted]" (0 ms) (parent=Restore partition states)] [21:10:50] : [Step 4/5] [2021-11-19 21:10:50,316][INFO ][sys-#21401%grid-1%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (2 ms), stage="Update caches registry" (0 ms), stage="Start caches" (22 ms), stage="Affinity initialization on cache group start" (0 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Wait partitions release latch [latch=exchange]" (1 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Restore partition states" (0 ms), stage="After states restored callback" (0 ms), stage="WAL history reservation" (0 ms), stage="Waiting for Full message" (4 ms), stage="Affinity recalculation" (0 ms), stage="Full map updating" (0 ms), stage="Exchange done" (6 ms), stage="Total time" (35 ms)] [21:10:50] : [Step 4/5] [2021-11-19 21:10:50,318][INFO ][exchange-worker-#21306%grid-0%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], crd=true] [21:10:50] : [Step 4/5] [2021-11-19 21:10:50,319][INFO ][sys-#21401%grid-1%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], stage="Affinity initialization on cache group start [grp=encrypted]" (0 ms) (parent=Affinity initialization on cache group start), stage="Restore partition states [grp=ignite-sys-cache]" (0 ms) (parent=Restore partition states), stage="Restore partition states [grp=encrypted]" (0 ms) (parent=Restore partition states)] [21:10:50] : [Step 4/5] [2021-11-19 21:10:50,320][INFO ][exchange-worker-#21306%grid-0%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=2, minorTopVer=2], force=false, evt=DISCOVERY_CUSTOM_EVT, node=00a005ca-1176-4aa8-8e19-66df6832f000] [21:10:50] : [Step 4/5] [2021-11-19 21:10:50,590][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10a8a0d8-a507-4823-9923-6a3fda27b001, grp=1613773252] [21:10:50] : [Step 4/5] [2021-11-19 21:10:50,592][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00a005ca-1176-4aa8-8e19-66df6832f000, grp=1613773252] [21:10:50] : [Step 4/5] [2021-11-19 21:10:50,599][INFO ][disco-notifier-worker-#21301%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=1] [21:10:50] : [Step 4/5] [2021-11-19 21:10:50,599][INFO ][disco-notifier-worker-#21420%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=1] [21:10:50] : [Step 4/5] [2021-11-19 21:10:50,600][INFO ][reencrypt-#21461%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:10:50] : [Step 4/5] [2021-11-19 21:10:50,600][INFO ][reencrypt-#21462%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:10:50] : [Step 4/5] [2021-11-19 21:10:50,600][INFO ][disco-notifier-worker-#21420%grid-1%][IgniteTestResources] Block message [node=00a005ca-1176-4aa8-8e19-66df6832f000, order=1, msg=org.apache.ignite.internal.util.distributed.SingleNodeMessage@3262362a] [21:10:50] : [Step 4/5] [2021-11-19 21:10:50,602][INFO ][async-runnable-runner-1][root] >>> Stopping grid [name=grid-1, id=10a8a0d8-a507-4823-9923-6a3fda27b001] [21:10:50] : [Step 4/5] [2021-11-19 21:10:50,614][INFO ][db-checkpoint-thread-#21445%grid-1%][Checkpointer] Checkpoint started [checkpointId=e09c2d9a-7ceb-4b6f-8e1b-13358ac55c94, startPtr=WALPointer [idx=0, fileOff=186661, len=2048], checkpointBeforeLockTime=2ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=1ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=1ms, writeCheckpointEntryDuration=2ms, splitAndSortCpPagesDuration=0ms, pages=63, reason='timeout'] [21:10:50] : [Step 4/5] [2021-11-19 21:10:50,619][INFO ][tcp-disco-sock-reader-[00a005ca 127.0.0.1:52725]-#1124%grid-1%-#21425%grid-1%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:52725, rmtPort=52725, rmtNodeId=00a005ca-1176-4aa8-8e19-66df6832f000] [21:10:50] : [Step 4/5] [2021-11-19 21:10:50,620][INFO ][disco-event-worker-#21305%grid-0%][GridDiscoveryManager] Node left topology: TcpDiscoveryNode [id=10a8a0d8-a507-4823-9923-6a3fda27b001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637345450084, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false] [21:10:50] : [Step 4/5] [2021-11-19 21:10:50,622][INFO ][async-runnable-runner-1][GridCacheProcessor] Stopped cache [cacheName=ignite-sys-cache] [21:10:50] : [Step 4/5] [2021-11-19 21:10:50,622][INFO ][disco-event-worker-#21305%grid-0%][GridDiscoveryManager] Topology snapshot [ver=3, locNode=00a005ca, servers=1, clients=0, state=ACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=00a005ca-1176-4aa8-8e19-66df6832f000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:10:50] : [Step 4/5] [2021-11-19 21:10:50,623][INFO ][async-runnable-runner-1][GridCacheProcessor] Stopped cache [cacheName=encrypted] [21:10:50] : [Step 4/5] [2021-11-19 21:10:50,624][INFO ][disco-event-worker-#21305%grid-0%][GridDiscoveryManager] ^-- Baseline [id=0, size=2, online=1, offline=1] [21:10:50]W: [org.apache.ignite:ignite-core] [2021-11-19 21:10:50,625][WARN ][grid-nio-worker-tcp-comm-0-#21244%TestRecordingCommunicationSpi%][TestRecordingCommunicationSpi] Failed to shutdown socket [21:10:50]W: [org.apache.ignite:ignite-core] java.nio.channels.ClosedChannelException [21:10:50]W: [org.apache.ignite:ignite-core] at sun.nio.ch.SocketChannelImpl.shutdownOutput(SocketChannelImpl.java:795) [21:10:50]W: [org.apache.ignite:ignite-core] at sun.nio.ch.SocketAdaptor.shutdownOutput(SocketAdaptor.java:407) [21:10:50]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.close(IgniteUtils.java:4247) [21:10:50]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.closeKey(GridNioServer.java:2784) [21:10:50]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.close(GridNioServer.java:2835) [21:10:50]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.close(GridNioServer.java:2794) [21:10:50]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.bodyInternal(GridNioServer.java:2157) [21:10:50]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.body(GridNioServer.java:1910) [21:10:50]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:125) [21:10:50]W: [org.apache.ignite:ignite-core] at java.lang.Thread.run(Thread.java:748) [21:10:50] : [Step 4/5] [2021-11-19 21:10:50,627][INFO ][exchange-worker-#21306%grid-0%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], crd=true, evt=NODE_LEFT, evtNode=10a8a0d8-a507-4823-9923-6a3fda27b001, customEvt=null, allowMerge=false, exchangeFreeSwitch=true] [21:10:50] : [Step 4/5] [2021-11-19 21:10:50,629][INFO ][sys-#21280%grid-0%][GridAffinityAssignmentCache] Local node affinity assignment distribution is not ideal [cache=encrypted, expectedPrimary=8.00, actualPrimary=3, expectedBackups=0.00, actualBackups=0, warningThreshold=50.00%] [21:10:50] : [Step 4/5] [2021-11-19 21:10:50,630][INFO ][exchange-worker-#21306%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:10:50] : [Step 4/5] [2021-11-19 21:10:50,630][INFO ][exchange-worker-#21306%grid-0%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], err=null, rebalanced=true, wasRebalanced=true] [21:10:50]W: [org.apache.ignite:ignite-core] [2021-11-19 21:10:50,631][WARN ][exchange-worker-#21306%grid-0%][GridDhtPartitionTopologyImpl] Detected lost partitions [grp=encrypted, parts=[0, 2, 4, 6-7], topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0]] [21:10:50] : [Step 4/5] [2021-11-19 21:10:50,632][INFO ][exchange-worker-#21306%grid-0%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=00a005ca-1176-4aa8-8e19-66df6832f000, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], evt=NODE_LEFT, evtNode=TcpDiscoveryNode [id=10a8a0d8-a507-4823-9923-6a3fda27b001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637345450084, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0]] [21:10:50] : [Step 4/5] [2021-11-19 21:10:50,633][INFO ][exchange-worker-#21306%grid-0%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (1 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="After states restored callback" (0 ms), stage="WAL history reservation" (0 ms), stage="Finalize update counters" (0 ms), stage="Detect lost partitions" (1 ms), stage="Exchange done" (1 ms), stage="Total time" (3 ms)] [21:10:50] : [Step 4/5] [2021-11-19 21:10:50,633][INFO ][exchange-worker-#21306%grid-0%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], stage="Affinity initialization (exchange-free switch on fully-rebalanced topology) [grp=ignite-sys-cache]" (0 ms) (parent=Determine exchange type), stage="Affinity initialization (exchange-free switch on fully-rebalanced topology) [grp=encrypted]" (0 ms) (parent=Determine exchange type)] [21:10:50] : [Step 4/5] [2021-11-19 21:10:50,634][INFO ][exchange-worker-#21306%grid-0%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], crd=true] [21:10:50] : [Step 4/5] [2021-11-19 21:10:50,635][INFO ][exchange-worker-#21306%grid-0%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=3, minorTopVer=0], force=false, evt=NODE_LEFT, node=10a8a0d8-a507-4823-9923-6a3fda27b001] [21:10:50] : [Step 4/5] [2021-11-19 21:10:50,674][INFO ][async-runnable-runner-1][FilePageStoreManager] Cleanup cache stores [total=4, left=0, cleanFiles=false] [21:10:50]W: [org.apache.ignite:ignite-core] [2021-11-19 21:10:50,676][WARN ][async-runnable-runner-1][GridEncryptionManager] Reencryption cancelled [grp=1613773252] [21:10:50] : [Step 4/5] [2021-11-19 21:10:50,677][INFO ][async-runnable-runner-1][GridDeploymentLocalStore] Removed undeployed class: GridDeployment [ts=1637345450254, depMode=SHARED, clsLdr=IsolatedClassLoader{roleName='test'}, clsLdrId=aa28d593d71-10a8a0d8-a507-4823-9923-6a3fda27b001, userVer=0, loc=true, sampleClsName=org.apache.ignite.internal.processors.cache.distributed.dht.preloader.GridDhtPartitionFullMap, pendingUndeploy=false, undeployed=true, usage=0] [21:10:50] : [Step 4/5] [2021-11-19 21:10:50,688][INFO ][async-runnable-runner-1][IgniteKernal%grid-1] [21:10:50] : [Step 4/5] [21:10:50] : [Step 4/5] >>> +------------------------------------------------------+ [21:10:50] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV stopped OK [21:10:50] : [Step 4/5] >>> +------------------------------------------------------+ [21:10:50] : [Step 4/5] >>> Ignite instance name: grid-1 [21:10:50] : [Step 4/5] >>> Grid uptime: 00:00:00.535 [21:10:50] : [Step 4/5] [21:10:50] : [Step 4/5] [21:10:50] : [Step 4/5] [2021-11-19 21:10:50,690][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00a005ca-1176-4aa8-8e19-66df6832f000, grp=1613773252] [21:10:50] : [Step 4/5] [2021-11-19 21:10:50,700][INFO ][db-checkpoint-thread-#21440%grid-0%][Checkpointer] Checkpoint started [checkpointId=7d38a6fe-739b-448c-9394-ec71609466d2, startPtr=WALPointer [idx=0, fileOff=158676, len=2010], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=5ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=0ms, pages=43, reason='test'] [21:10:50] : [Step 4/5] [2021-11-19 21:10:50,754][INFO ][db-checkpoint-thread-#21440%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:10:50] : [Step 4/5] [2021-11-19 21:10:50,754][INFO ][db-checkpoint-thread-#21440%grid-0%][Checkpointer] Checkpoint finished [cpId=7d38a6fe-739b-448c-9394-ec71609466d2, pages=43, markPos=WALPointer [idx=0, fileOff=158676, len=2010], walSegmentsCovered=[], markDuration=9ms, pagesWrite=2ms, fsync=51ms, total=63ms] [21:10:50]W: [org.apache.ignite:ignite-core] [2021-11-19 21:10:50,763][WARN ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][G] Ignite work directory is not provided, automatically resolved to: /opt/buildagent/work/7bc1c54bc719b67c/work [21:10:50] : [Step 4/5] [2021-11-19 21:10:50,764][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] [21:10:50] : [Step 4/5] [21:10:50] : [Step 4/5] >>> __________ ________________ [21:10:50] : [Step 4/5] >>> / _/ ___/ |/ / _/_ __/ __/ [21:10:50] : [Step 4/5] >>> _/ // (7 7 // / / / / _/ [21:10:50] : [Step 4/5] >>> /___/\___/_/|_/___/ /_/ /___/ [21:10:50] : [Step 4/5] >>> [21:10:50] : [Step 4/5] >>> ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:10:50] : [Step 4/5] >>> 2021 Copyright(C) Apache Software Foundation [21:10:50] : [Step 4/5] >>> [21:10:50] : [Step 4/5] >>> Ignite documentation: http://ignite.apache.org [21:10:50] : [Step 4/5] [21:10:50] : [Step 4/5] [2021-11-19 21:10:50,765][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] Config URL: n/a [21:10:50] : [Step 4/5] [2021-11-19 21:10:50,766][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] IgniteConfiguration [igniteInstanceName=grid-1, pubPoolSize=24, svcPoolSize=24, callbackPoolSize=24, stripedPoolSize=24, sysPoolSize=24, mgmtPoolSize=4, dataStreamerPoolSize=24, utilityCachePoolSize=24, utilityCacheKeepAliveTime=60000, p2pPoolSize=2, qryPoolSize=24, buildIdxPoolSize=4, igniteHome=/opt/buildagent/work/7bc1c54bc719b67c, igniteWorkDir=/opt/buildagent/work/7bc1c54bc719b67c/work, mbeanSrv=com.sun.jmx.mbeanserver.JmxMBeanServer@6fe85038, nodeId=10708d6c-11d6-4e22-9c25-8d72d7bd6001, marsh=BinaryMarshaller [], marshLocJobs=false, daemon=false, p2pEnabled=true, netTimeout=10000, netCompressionLevel=1, sndRetryDelay=1000, sndRetryCnt=3, metricsHistSize=10000, metricsUpdateFreq=1000, metricsExpTime=9223372036854775807, discoSpi=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=0, ackTimeout=0, marsh=null, reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], segPlc=STOP, segResolveAttempts=2, waitForSegOnStart=true, allResolversPassReq=true, segChkFreq=10000, commSpi=TcpCommunicationSpi [connectGate=org.apache.ignite.spi.communication.tcp.internal.ConnectGateway@227094d5, ctxInitLatch=java.util.concurrent.CountDownLatch@14085b5c[Count = 1], stopping=false, clientPool=null, nioSrvWrapper=null, stateProvider=null], evtSpi=MemoryEventStorageSpi [expireAgeMs=9223372036854775807, expireCnt=10000, filter=null], colSpi=NoopCollisionSpi [], deploySpi=LocalDeploymentSpi [], indexingSpi=org.apache.ignite.spi.indexing.noop.NoopIndexingSpi@acc5348, addrRslvr=null, encryptionSpi=org.apache.ignite.spi.encryption.keystore.KeystoreEncryptionSpi@62b0a812, tracingSpi=org.apache.ignite.spi.tracing.NoopTracingSpi@5e903cc8, clientMode=false, rebalanceThreadPoolSize=4, rebalanceTimeout=10000, rebalanceBatchesPrefetchCnt=3, rebalanceThrottle=0, rebalanceBatchSize=524288, txCfg=TransactionConfiguration [txSerEnabled=false, dfltIsolation=REPEATABLE_READ, dfltConcurrency=PESSIMISTIC, dfltTxTimeout=0, txTimeoutOnPartitionMapExchange=0, deadlockTimeout=10000, pessimisticTxLogSize=0, pessimisticTxLogLinger=10000, tmLookupClsName=null, txManagerFactory=null, useJtaSync=false], cacheSanityCheckEnabled=true, discoStartupDelay=60000, deployMode=SHARED, p2pMissedCacheSize=100, locHost=127.0.0.1, timeSrvPortBase=31100, timeSrvPortRange=100, failureDetectionTimeout=10000, sysWorkerBlockedTimeout=null, clientFailureDetectionTimeout=10000, metricsLogFreq=0, connectorCfg=null, odbcCfg=null, warmupClos=null, atomicCfg=AtomicConfiguration [seqReserveSize=1000, cacheMode=PARTITIONED, backups=1, aff=null, grpName=null], classLdr=null, sslCtxFactory=null, platformCfg=null, binaryCfg=null, memCfg=null, pstCfg=null, dsCfg=DataStorageConfiguration [sysRegionInitSize=41943040, sysRegionMaxSize=104857600, pageSize=4096, concLvl=0, dfltDataRegConf=DataRegionConfiguration [name=default, maxSize=104857600, initSize=268435456, swapPath=null, pageEvictionMode=DISABLED, pageReplacementMode=CLOCK, evictionThreshold=0.9, emptyPagesPoolSize=100, metricsEnabled=false, metricsSubIntervalCount=5, metricsRateTimeInterval=60000, persistenceEnabled=true, checkpointPageBufSize=0, lazyMemoryAllocation=true, warmUpCfg=null], dataRegions=null, storagePath=null, checkpointFreq=30000, lockWaitTime=10000, checkpointThreads=4, checkpointWriteOrder=SEQUENTIAL, walHistSize=20, maxWalArchiveSize=20971520, walSegments=10, walSegmentSize=1048576, walPath=db/wal, walArchivePath=db/wal/archive, cdcWalPath=db/wal/cdc, cdcEnabled=false, metricsEnabled=false, walMode=LOG_ONLY, walTlbSize=131072, walBuffSize=0, walFlushFreq=2000, walFsyncDelay=1000, walRecordIterBuffSize=67108864, alwaysWriteFullPages=false, fileIOFactory=org.apache.ignite.internal.processors.cache.persistence.file.AsyncFileIOFactory@6ebd1fd2, metricsSubIntervalCnt=5, metricsRateTimeInterval=60000, walAutoArchiveAfterInactivity=-1, walForceArchiveTimeout=-1, writeThrottlingEnabled=false, walCompactionEnabled=false, walCompactionLevel=1, checkpointReadLockTimeout=null, walPageCompression=DISABLED, walPageCompressionLevel=null, dfltWarmUpCfg=null, encCfg=org.apache.ignite.configuration.EncryptionConfiguration@1e26858a, defragmentationThreadPoolSize=4, minWalArchiveSize=-1], snapshotPath=snapshots, activeOnStart=true, activeOnStartPropSetFlag=false, autoActivation=true, autoActivationPropSetFlag=false, clusterStateOnStart=null, sqlConnCfg=null, cliConnCfg=ClientConnectorConfiguration [host=null, port=10800, portRange=100, sockSndBufSize=0, sockRcvBufSize=0, tcpNoDelay=true, maxOpenCursorsPerConn=128, threadPoolSize=24, selectorCnt=12, idleTimeout=0, handshakeTimeout=10000, jdbcEnabled=true, odbcEnabled=true, thinCliEnabled=true, sslEnabled=false, useIgniteSslCtxFactory=true, sslClientAuth=false, sslCtxFactory=null, thinCliCfg=ThinClientConfiguration [maxActiveTxPerConn=100, maxActiveComputeTasksPerConn=0]], mvccVacuumThreadCnt=2, mvccVacuumFreq=5000, authEnabled=false, failureHnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]], commFailureRslvr=null, sqlCfg=SqlConfiguration [longQryWarnTimeout=3000, dfltQryTimeout=0, sqlQryHistSize=1000, validationEnabled=false], asyncContinuationExecutor=null] [21:10:50] : [Step 4/5] [2021-11-19 21:10:50,776][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] Daemon mode: off [21:10:50] : [Step 4/5] [2021-11-19 21:10:50,777][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] OS: Linux 4.15.0-151-generic amd64 [21:10:50] : [Step 4/5] [2021-11-19 21:10:50,777][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] OS user: teamcity [21:10:50] : [Step 4/5] [2021-11-19 21:10:50,777][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] PID: 16724 [21:10:50] : [Step 4/5] [2021-11-19 21:10:50,778][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] Language runtime: Java Platform API Specification ver. 1.8 [21:10:50] : [Step 4/5] [2021-11-19 21:10:50,778][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] VM information: Java(TM) SE Runtime Environment 1.8.0_261-b12 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 25.261-b12 [21:10:50] : [Step 4/5] [2021-11-19 21:10:50,779][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] VM total memory: 1.9GB [21:10:50] : [Step 4/5] [2021-11-19 21:10:50,779][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] Remote Management [restart: off, REST: off, JMX (remote: off)] [21:10:50] : [Step 4/5] [2021-11-19 21:10:50,779][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] Logger: GridTestLog4jLogger [quiet=false, config=null] [21:10:50] : [Step 4/5] [2021-11-19 21:10:50,780][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] IGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c [21:10:50] : [Step 4/5] [2021-11-19 21:10:50,780][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] VM arguments: [-DIGNITE_DUMP_THREADS_ON_FAILURE=false, -DMono=/usr/bin/mono-sgen, -DMono4.0_x64=/usr/lib/mono/4.0, -DMono4.5_x64=/usr/lib/mono/4.5, -DMonoVersion=6.12.0.90, -DSKIP_BUILD=false, -Dagent.home.dir=/opt/buildagent, -Dagent.name=aitc-lin02_03, -Dagent.ownPort=9090, -Dagent.work.dir=/opt/buildagent/work, -Dbuild.number=95, -Dbuild.vcs.number=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.1=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.GitHubApacheIgnite=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dclassworlds.conf=/opt/buildagent/temp/buildTmp/teamcity.m2.conf, -Dcom.jetbrains.maven.watcher.report.file=/opt/buildagent/temp/buildTmp/maven-build-info.xml, -Djava.io.tmpdir=/opt/buildagent/temp/buildTmp, -Dmaven.home=/opt/buildagent/tools/maven3_6, -Dmaven.multiModuleProjectDirectory=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.agent.cpuBenchmark=457, -Dteamcity.agent.dotnet.agent_url=http://localhost:9090/RPC2, -Dteamcity.agent.dotnet.build_id=6278078, -Dteamcity.auth.password=*******, -Dteamcity.auth.userId=TeamCityBuildId=6278078, -Dteamcity.build.changedFiles.file=/opt/buildagent/temp/buildTmp/changedFiles6342607772318147725.txt, -Dteamcity.build.checkoutDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.build.id=6278078, -Dteamcity.build.properties.file=/opt/buildagent/temp/buildTmp/teamcity.build5164517880467851002.properties, -Dteamcity.build.tempDir=/opt/buildagent/temp/buildTmp, -Dteamcity.build.workingDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.buildConfName=Basic 3, -Dteamcity.buildType.id=IgniteTests24Java8_Basic3, -Dteamcity.configuration.properties.file=/opt/buildagent/temp/buildTmp/teamcity.config5591980786735343870.properties, -Dteamcity.maven.userSettings.path=/opt/buildagent/temp/buildTmp/maven_settings_585072866407032347.xml, -Dteamcity.maven.watcher.home=/opt/buildagent/plugins/mavenPlugin/maven-watcher-jdk16, -Dteamcity.projectName=Ignite Tests 2.x (JDK 8/11), -Dteamcity.runner.properties.file=/opt/buildagent/temp/buildTmp/teamcity.runner9098465561618137420.properties, -Dteamcity.tests.recentlyFailedTests.file=/opt/buildagent/temp/buildTmp/testsToRunFirst3891775683130404069.txt, -Dteamcity.version=2021.2 (build 99542), -ea, -Xms2g, -Xmx2g, -XX:+HeapDumpOnOutOfMemoryError, -DIGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_TEST_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_UPDATE_NOTIFIER=false, -DIGNITE_NO_DISCO_ORDER=true, -DIGNITE_PERFORMANCE_SUGGESTIONS_DISABLED=true, -Djava.net.preferIPv4Stack=true, -DTEST_SCALE_FACTOR=1.0, -DIGNITE_TEST_PROP_LOG4J_FILE=log4j-tc-test.xml, -DIGNITE_QUIET=false, -DIGNITE_MARSHAL_BUFFERS_RECHECK=1000, -Dmaven.repo.local=/opt/buildagent/.m2/repository] [21:10:50] : [Step 4/5] [2021-11-19 21:10:50,785][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] System cache's DataRegion size is configured to 40 MB. Use DataStorageConfiguration.systemRegionInitialSize property to change the setting. [21:10:50] : [Step 4/5] [2021-11-19 21:10:50,786][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] Configured caches [in 'sysMemPlc' dataRegion: ['ignite-sys-cache']] [21:10:50]W: [org.apache.ignite:ignite-core] [2021-11-19 21:10:50,786][WARN ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] Peer class loading is enabled (disable it in production for performance and deployment consistency reasons) [21:10:50] : [Step 4/5] [2021-11-19 21:10:50,787][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] 3-rd party licenses can be found at: /opt/buildagent/work/7bc1c54bc719b67c/libs/licenses [21:10:50] : [Step 4/5] [2021-11-19 21:10:50,792][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] Configured plugins: [21:10:50] : [Step 4/5] [2021-11-19 21:10:50,792][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- StanByClusterTestProvider 1.0 [21:10:50] : [Step 4/5] [2021-11-19 21:10:50,793][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:10:50] : [Step 4/5] [2021-11-19 21:10:50,793][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] [21:10:50] : [Step 4/5] [2021-11-19 21:10:50,793][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- PageMemory tracker plugin 1.0 [21:10:50] : [Step 4/5] [2021-11-19 21:10:50,793][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:10:50] : [Step 4/5] [2021-11-19 21:10:50,794][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] [21:10:50] : [Step 4/5] [2021-11-19 21:10:50,794][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- TestDistibutedConfigurationPlugin 1.0 [21:10:50] : [Step 4/5] [2021-11-19 21:10:50,794][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:10:50] : [Step 4/5] [2021-11-19 21:10:50,795][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] [21:10:50] : [Step 4/5] [2021-11-19 21:10:50,795][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- NodeValidationPluginProvider 1.0 [21:10:50] : [Step 4/5] [2021-11-19 21:10:50,795][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:10:50] : [Step 4/5] [2021-11-19 21:10:50,795][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] [21:10:50] : [Step 4/5] [2021-11-19 21:10:50,796][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][FailureProcessor] Configured failure handler: [hnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]]] [21:10:50] : [Step 4/5] [2021-11-19 21:10:50,808][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][TestRecordingCommunicationSpi] Successfully bound communication NIO server to TCP port [port=47101, locHost=/127.0.0.1, selectorsCnt=12, selectorSpins=0, pairedConn=false] [21:10:50]W: [org.apache.ignite:ignite-core] [2021-11-19 21:10:50,808][WARN ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][TestRecordingCommunicationSpi] Message queue limit is set to 0 which may lead to potential OOMEs when running cache operations in FULL_ASYNC or PRIMARY_SYNC modes due to message queues growth on sender and receiver sides. [21:10:50] : [Step 4/5] [2021-11-19 21:10:50,812][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][GridCollisionManager] Collision resolution is disabled (all jobs will be activated upon arrival). [21:10:50] : [Step 4/5] [2021-11-19 21:10:50,813][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] Security status [authentication=off, sandbox=off, tls/ssl=off] [21:10:50] : [Step 4/5] [2021-11-19 21:10:50,868][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:10:50] : [Step 4/5] [2021-11-19 21:10:50,951][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][MaintenanceProcessor] Resolved store directory for node persistent data: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1 [21:10:50] : [Step 4/5] [2021-11-19 21:10:50,952][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][CacheObjectBinaryProcessorImpl] Resolved directory for serialized binary metadata: /opt/buildagent/work/7bc1c54bc719b67c/work/db/binary_meta/grid_1 [21:10:50] : [Step 4/5] [2021-11-19 21:10:50,956][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1 [21:10:50] : [Step 4/5] [2021-11-19 21:10:50,957][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][FileWriteAheadLogManager] Resolved write ahead log work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1 [21:10:50] : [Step 4/5] [2021-11-19 21:10:50,957][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][FileWriteAheadLogManager] Resolved write ahead log archive directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1 [21:10:50] : [Step 4/5] [2021-11-19 21:10:50,959][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000005.wal [21:10:50] : [Step 4/5] [2021-11-19 21:10:50,959][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000006.wal [21:10:50] : [Step 4/5] [2021-11-19 21:10:50,959][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000008.wal [21:10:50] : [Step 4/5] [2021-11-19 21:10:50,960][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000004.wal [21:10:50] : [Step 4/5] [2021-11-19 21:10:50,960][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000003.wal [21:10:50] : [Step 4/5] [2021-11-19 21:10:50,961][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000002.wal [21:10:50] : [Step 4/5] [2021-11-19 21:10:50,961][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000007.wal [21:10:50] : [Step 4/5] [2021-11-19 21:10:50,962][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000001.wal [21:10:50] : [Step 4/5] [2021-11-19 21:10:50,962][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000009.wal [21:10:50] : [Step 4/5] [2021-11-19 21:10:50,962][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][FileHandleManagerImpl] Initialized write-ahead log manager [mode=LOG_ONLY] [21:10:50] : [Step 4/5] [2021-11-19 21:10:50,966][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Configured data regions initialized successfully [total=5] [21:10:51] : [Step 4/5] [2021-11-19 21:10:51,460][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][IgniteSnapshotManager] Resolved snapshot work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/snapshots [21:10:51] : [Step 4/5] [2021-11-19 21:10:51,460][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][IgniteSnapshotManager] Resolved temp directory for snapshot creation: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1/snp [21:10:51] : [Step 4/5] [2021-11-19 21:10:51,463][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][ClientListenerProcessor] Client connector processor has started on TCP port 10801 [21:10:51] : [Step 4/5] [2021-11-19 21:10:51,467][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] Non-loopback local IPs: 172.17.0.4 [21:10:51] : [Step 4/5] [2021-11-19 21:10:51,467][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] Enabled local MACs: 0242AC110004 [21:10:51] : [Step 4/5] [2021-11-19 21:10:51,469][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=/opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1/cp/1637345450608-e09c2d9a-7ceb-4b6f-8e1b-13358ac55c94-START.bin, endMarker=/opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1/cp/1637345450217-6646ce5b-0324-4d0a-a99c-7bd5cca3532f-END.bin] [21:10:51] : [Step 4/5] [2021-11-19 21:10:51,470][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:10:51] : [Step 4/5] [2021-11-19 21:10:51,470][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=86661, len=1963], lastMarked=WALPointer [idx=0, fileOff=186661, len=2048], lastCheckpointId=e09c2d9a-7ceb-4b6f-8e1b-13358ac55c94] [21:10:51] : [Step 4/5] [2021-11-19 21:10:51,473][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Found last checkpoint marker [cpId=e09c2d9a-7ceb-4b6f-8e1b-13358ac55c94, pos=WALPointer [idx=0, fileOff=186661, len=2048]] [21:10:51] : [Step 4/5] [2021-11-19 21:10:51,475][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Applying lost metastore updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=186661, len=2048], lastCheckpointId=e09c2d9a-7ceb-4b6f-8e1b-13358ac55c94] [21:10:51] : [Step 4/5] [2021-11-19 21:10:51,476][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=0 ms] [21:10:51] : [Step 4/5] [2021-11-19 21:10:51,476][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Restoring partition state for local groups. [21:10:51] : [Step 4/5] [2021-11-19 21:10:51,476][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=0, partitionsProcessed=0, time=0ms] [21:10:51] : [Step 4/5] [2021-11-19 21:10:51,485][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][GridClusterStateProcessor] Restoring history for BaselineTopology[id=0] [21:10:51] : [Step 4/5] [2021-11-19 21:10:51,491][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][ClusterProcessor] Cluster ID and tag has been read from metastorage: ClusterIdAndTag [id=7725c528-87c9-45db-80e4-cdcc9f24cdd8, tag=vigilant_dirac] [21:10:51] : [Step 4/5] [2021-11-19 21:10:51,491][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][IgniteClusterImpl] Shutdown policy was updated [oldVal=null, newVal=null] [21:10:51] : [Step 4/5] [2021-11-19 21:10:51,492][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustEnabled' was changed from 'null' to 'false' [21:10:51] : [Step 4/5] [2021-11-19 21:10:51,492][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustTimeout' was changed from 'null' to '300000' [21:10:51] : [Step 4/5] [2021-11-19 21:10:51,492][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][IgniteTxManager] Transactions parameter 'txOwnerDumpRequestsAllowed' was changed from 'null' to 'true' [21:10:51] : [Step 4/5] [2021-11-19 21:10:51,493][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][IgniteTxManager] Transactions parameter 'longOperationsDumpTimeout' was changed from 'null' to '60000' [21:10:51] : [Step 4/5] [2021-11-19 21:10:51,493][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpThreshold' was changed from 'null' to '0' [21:10:51] : [Step 4/5] [2021-11-19 21:10:51,494][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][IgniteTxManager] Transactions parameter 'transactionTimeDumpSamplesCoefficient' was changed from 'null' to '0.0' [21:10:51] : [Step 4/5] [2021-11-19 21:10:51,494][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpSamplesPerSecondLimit' was changed from 'null' to '5' [21:10:51] : [Step 4/5] [2021-11-19 21:10:51,494][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][IgniteTxManager] Transactions parameter 'collisionsDumpInterval' was changed from 'null' to '1000' [21:10:51] : [Step 4/5] [2021-11-19 21:10:51,495][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Historical rebalance WAL threshold changed [property=historical.rebalance.threshold, oldVal=null, newVal=500] [21:10:51] : [Step 4/5] [2021-11-19 21:10:51,495][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Checkpoint frequency deviation changed [oldVal=null, newVal=null] [21:10:51] : [Step 4/5] [2021-11-19 21:10:51,568][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][FilePageStoreManager] Cleanup cache stores [total=1, left=0, cleanFiles=false] [21:10:51] : [Step 4/5] [2021-11-19 21:10:51,570][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:10:51] : [Step 4/5] [2021-11-19 21:10:51,571][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:10:51] : [Step 4/5] [2021-11-19 21:10:51,572][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:10:51] : [Step 4/5] [2021-11-19 21:10:51,573][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Data Regions Started: 5 [21:10:51] : [Step 4/5] [2021-11-19 21:10:51,573][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] ^-- sysMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:10:51] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:10:51] : [Step 4/5] ^-- default region [type=default, persistence=true, lazyAlloc=true, [21:10:51] : [Step 4/5] ... initCfg=100MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB, allocTotal=0MB] [21:10:51] : [Step 4/5] ^-- metastoreMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:10:51] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:10:51] : [Step 4/5] ^-- TxLog region [type=internal, persistence=true, lazyAlloc=false, [21:10:51] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:10:51] : [Step 4/5] ^-- volatileDsMemPlc region [type=user, persistence=false, lazyAlloc=true, [21:10:51] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB] [21:10:51] : [Step 4/5] ^-- Ignite persistence [used=0MB] [21:10:51] : [Step 4/5] [21:10:51] : [Step 4/5] [2021-11-19 21:10:51,575][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Starting binary memory restore for: [-2100569601, 1613773252] [21:10:51] : [Step 4/5] [2021-11-19 21:10:51,584][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=/opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1/cp/1637345450608-e09c2d9a-7ceb-4b6f-8e1b-13358ac55c94-START.bin, endMarker=/opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1/cp/1637345450217-6646ce5b-0324-4d0a-a99c-7bd5cca3532f-END.bin] [21:10:51] : [Step 4/5] [2021-11-19 21:10:51,584][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=86661, len=1963], lastMarked=WALPointer [idx=0, fileOff=186661, len=2048], lastCheckpointId=e09c2d9a-7ceb-4b6f-8e1b-13358ac55c94] [21:10:51]W: [org.apache.ignite:ignite-core] [2021-11-19 21:10:51,586][WARN ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Ignite node stopped in the middle of checkpoint. Will restore memory state and finish checkpoint on node start. [21:10:51] : [Step 4/5] [2021-11-19 21:10:51,587][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:10:51] : [Step 4/5] [2021-11-19 21:10:51,593][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Found last checkpoint marker [cpId=e09c2d9a-7ceb-4b6f-8e1b-13358ac55c94, pos=WALPointer [idx=0, fileOff=186661, len=2048]] [21:10:51] : [Step 4/5] [2021-11-19 21:10:51,594][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Finished applying memory changes [changesApplied=233, time=10 ms] [21:10:51] : [Step 4/5] [2021-11-19 21:10:51,718][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][CheckpointWorkflow] Checkpoint finished [cpId=e09c2d9a-7ceb-4b6f-8e1b-13358ac55c94, pages=63, markPos=WALPointer [idx=0, fileOff=186661, len=2048], pagesWrite=-4ms, fsync=111ms, total=107ms] [21:10:51] : [Step 4/5] [2021-11-19 21:10:51,719][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Binary memory state restored at node startup [restoredPtr=WALPointer [idx=0, fileOff=188709, len=0]] [21:10:51] : [Step 4/5] [2021-11-19 21:10:51,721][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000000.wal, offset=188709, ver=2] [21:10:51] : [Step 4/5] [2021-11-19 21:10:51,724][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Started cache in recovery mode [name=ignite-sys-cache, id=-2100569601, dataRegionName=sysMemPlc, mode=REPLICATED, atomicity=TRANSACTIONAL, backups=2147483647, mvcc=false] [21:10:51] : [Step 4/5] [2021-11-19 21:10:51,728][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Started cache in recovery mode [name=encrypted, id=1613773252, dataRegionName=default, mode=PARTITIONED, atomicity=ATOMIC, backups=0, mvcc=false] [21:10:51] : [Step 4/5] [2021-11-19 21:10:51,729][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Binary recovery performed in 154 ms. [21:10:51] : [Step 4/5] [2021-11-19 21:10:51,729][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=/opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1/cp/1637345450608-e09c2d9a-7ceb-4b6f-8e1b-13358ac55c94-START.bin, endMarker=/opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1/cp/1637345450608-e09c2d9a-7ceb-4b6f-8e1b-13358ac55c94-END.bin] [21:10:51] : [Step 4/5] [2021-11-19 21:10:51,730][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Applying lost cache updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=186661, len=2048], lastCheckpointId=e09c2d9a-7ceb-4b6f-8e1b-13358ac55c94] [21:10:51] : [Step 4/5] [2021-11-19 21:10:51,732][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=10 ms] [21:10:51] : [Step 4/5] [2021-11-19 21:10:51,732][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Restoring partition state for local groups. [21:10:51] : [Step 4/5] [2021-11-19 21:10:51,745][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=2, partitionsProcessed=108, time=11ms] [21:10:51] : [Step 4/5] [2021-11-19 21:10:51,753][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][TestTcpDiscoverySpi] Successfully bound to TCP port [port=47501, localHost=localhost/127.0.0.1, locNodeId=10708d6c-11d6-4e22-9c25-8d72d7bd6001] [21:10:51] : [Step 4/5] [2021-11-19 21:10:51,755][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][GridEncryptionManager] Sending stored group keys to coordinator [grps=1613773252] [21:10:51] : [Step 4/5] [2021-11-19 21:10:51,760][INFO ][tcp-disco-srvr-[:47500]-#1116%grid-0%-#21303%grid-0%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=52629] [21:10:51] : [Step 4/5] [2021-11-19 21:10:51,760][INFO ][tcp-disco-srvr-[:47500]-#1116%grid-0%-#21303%grid-0%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=52629] [21:10:51] : [Step 4/5] [2021-11-19 21:10:51,762][INFO ][tcp-disco-sock-reader-[]-#1131%grid-0%-#21580%grid-0%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:52629, rmtPort=52629] [21:10:51] : [Step 4/5] [2021-11-19 21:10:51,764][INFO ][tcp-disco-sock-reader-[10708d6c 127.0.0.1:52629]-#1131%grid-0%-#21580%grid-0%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=10708d6c-11d6-4e22-9c25-8d72d7bd6001, rmtAddr=/127.0.0.1:52629] [21:10:51] : [Step 4/5] [2021-11-19 21:10:51,767][INFO ][tcp-disco-srvr-[:47501]-#1130%grid-1%-#21579%grid-1%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=55529] [21:10:51] : [Step 4/5] [2021-11-19 21:10:51,767][INFO ][tcp-disco-srvr-[:47501]-#1130%grid-1%-#21579%grid-1%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=55529] [21:10:51] : [Step 4/5] [2021-11-19 21:10:51,768][INFO ][tcp-disco-sock-reader-[]-#1132%grid-1%-#21581%grid-1%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:55529, rmtPort=55529] [21:10:51] : [Step 4/5] [2021-11-19 21:10:51,769][INFO ][tcp-disco-sock-reader-[]-#1132%grid-1%-#21581%grid-1%][TestTcpDiscoverySpi] Received ping request from the remote node [rmtNodeId=00a005ca-1176-4aa8-8e19-66df6832f000, rmtAddr=/127.0.0.1:55529, rmtPort=55529] [21:10:51] : [Step 4/5] [2021-11-19 21:10:51,769][INFO ][tcp-disco-sock-reader-[]-#1132%grid-1%-#21581%grid-1%][TestTcpDiscoverySpi] Finished writing ping response [rmtNodeId=00a005ca-1176-4aa8-8e19-66df6832f000, rmtAddr=/127.0.0.1:55529, rmtPort=55529] [21:10:51] : [Step 4/5] [2021-11-19 21:10:51,770][INFO ][tcp-disco-sock-reader-[]-#1132%grid-1%-#21581%grid-1%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:55529, rmtPort=55529, rmtNodeId=null] [21:10:51] : [Step 4/5] [2021-11-19 21:10:51,770][INFO ][tcp-disco-sock-reader-[10708d6c 127.0.0.1:52629]-#1131%grid-0%-#21580%grid-0%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:52629, rmtPort=52629, rmtNodeId=10708d6c-11d6-4e22-9c25-8d72d7bd6001] [21:10:51] : [Step 4/5] [2021-11-19 21:10:51,782][INFO ][tcp-disco-msg-worker-[crd]-#1115%grid-0%-#21302%grid-0%][TestTcpDiscoverySpi] New next node [newNext=TcpDiscoveryNode [id=10708d6c-11d6-4e22-9c25-8d72d7bd6001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=0, intOrder=3, lastExchangeTime=1637345451762, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false]] [21:10:51] : [Step 4/5] [2021-11-19 21:10:51,783][INFO ][tcp-disco-srvr-[:47501]-#1130%grid-1%-#21579%grid-1%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=36399] [21:10:51] : [Step 4/5] [2021-11-19 21:10:51,783][INFO ][tcp-disco-srvr-[:47501]-#1130%grid-1%-#21579%grid-1%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=36399] [21:10:51] : [Step 4/5] [2021-11-19 21:10:51,784][INFO ][tcp-disco-sock-reader-[]-#1133%grid-1%-#21582%grid-1%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:36399, rmtPort=36399] [21:10:51] : [Step 4/5] [2021-11-19 21:10:51,785][INFO ][tcp-disco-sock-reader-[00a005ca 127.0.0.1:36399]-#1133%grid-1%-#21582%grid-1%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=00a005ca-1176-4aa8-8e19-66df6832f000, rmtAddr=/127.0.0.1:36399] [21:10:51] : [Step 4/5] [2021-11-19 21:10:51,790][INFO ][tcp-disco-msg-worker-[]-#1129%grid-1%-#21578%grid-1%][TestTcpDiscoverySpi] New next node [newNext=TcpDiscoveryNode [id=00a005ca-1176-4aa8-8e19-66df6832f000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345451782, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false]] [21:10:51] : [Step 4/5] [2021-11-19 21:10:51,791][INFO ][tcp-disco-srvr-[:47500]-#1116%grid-0%-#21303%grid-0%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=34127] [21:10:51] : [Step 4/5] [2021-11-19 21:10:51,791][INFO ][tcp-disco-srvr-[:47500]-#1116%grid-0%-#21303%grid-0%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=34127] [21:10:51] : [Step 4/5] [2021-11-19 21:10:51,792][INFO ][tcp-disco-sock-reader-[]-#1134%grid-0%-#21583%grid-0%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:34127, rmtPort=34127] [21:10:51] : [Step 4/5] [2021-11-19 21:10:51,793][INFO ][tcp-disco-sock-reader-[10708d6c 127.0.0.1:34127]-#1134%grid-0%-#21583%grid-0%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=10708d6c-11d6-4e22-9c25-8d72d7bd6001, rmtAddr=/127.0.0.1:34127] [21:10:51] : [Step 4/5] [2021-11-19 21:10:51,796][INFO ][disco-event-worker-#21305%grid-0%][GridDiscoveryManager] Added new node to topology: TcpDiscoveryNode [id=10708d6c-11d6-4e22-9c25-8d72d7bd6001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=4, intOrder=3, lastExchangeTime=1637345451762, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false] [21:10:51] : [Step 4/5] [2021-11-19 21:10:51,797][INFO ][disco-event-worker-#21305%grid-0%][GridDiscoveryManager] Topology snapshot [ver=4, locNode=00a005ca, servers=2, clients=0, state=ACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=00a005ca-1176-4aa8-8e19-66df6832f000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=10708d6c-11d6-4e22-9c25-8d72d7bd6001, consistentId=grid-1, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:10:51] : [Step 4/5] [2021-11-19 21:10:51,797][INFO ][disco-event-worker-#21305%grid-0%][GridDiscoveryManager] ^-- Baseline [id=0, size=2, online=2, offline=0] [21:10:51] : [Step 4/5] [2021-11-19 21:10:51,798][INFO ][exchange-worker-#21306%grid-0%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], crd=true, evt=NODE_JOINED, evtNode=10708d6c-11d6-4e22-9c25-8d72d7bd6001, customEvt=null, allowMerge=true, exchangeFreeSwitch=false] [21:10:51] : [Step 4/5] [2021-11-19 21:10:51,798][INFO ][exchange-worker-#21306%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], waitTime=0ms, futInfo=NA, mode=DISTRIBUTED] [21:10:51] : [Step 4/5] [2021-11-19 21:10:51,799][INFO ][exchange-worker-#21306%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partitions release latch: ServerLatch [permits=0, pendingAcks=HashSet [], super=CompletableLatch [id=CompletableLatchUid [id=exchange, topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0]]]] [21:10:51] : [Step 4/5] [2021-11-19 21:10:51,799][INFO ][exchange-worker-#21306%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:10:51] : [Step 4/5] [2021-11-19 21:10:51,800][INFO ][exchange-worker-#21306%grid-0%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], crd=true] [21:10:51] : [Step 4/5] [2021-11-19 21:10:51,802][INFO ][tcp-disco-msg-worker-[00a005ca 127.0.0.1:47500]-#1129%grid-1%-#21578%grid-1%][GridEncryptionManager] Skip group key received from coordinator. Already exists. [grp=1613773252, keyId=1] [21:10:51] : [Step 4/5] [2021-11-19 21:10:51,803][INFO ][disco-notifier-worker-#21577%grid-1%][MvccProcessorImpl] Assigned mvcc coordinator [crd=MvccCoordinator [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], nodeId=00a005ca-1176-4aa8-8e19-66df6832f000, ver=1637345449529, local=false, initialized=false]] [21:10:51] : [Step 4/5] [2021-11-19 21:10:51,805][INFO ][sys-#21569%grid-1%][ClusterProcessor] Writing cluster ID and tag to metastorage on ready for write ClusterIdAndTag [id=7725c528-87c9-45db-80e4-cdcc9f24cdd8, tag=vigilant_dirac] [21:10:51] : [Step 4/5] [2021-11-19 21:10:51,812][INFO ][exchange-worker-#21586%grid-1%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], crd=false, evt=NODE_JOINED, evtNode=10708d6c-11d6-4e22-9c25-8d72d7bd6001, customEvt=null, allowMerge=true, exchangeFreeSwitch=false] [21:10:51] : [Step 4/5] [2021-11-19 21:10:51,813][INFO ][exchange-worker-#21586%grid-1%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1 [21:10:51] : [Step 4/5] [2021-11-19 21:10:51,814][INFO ][exchange-worker-#21586%grid-1%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000000.wal, offset=188738, ver=2] [21:10:51] : [Step 4/5] [2021-11-19 21:10:51,815][INFO ][exchange-worker-#21586%grid-1%][GridClusterStateProcessor] Writing BaselineTopology[id=0] [21:10:51] : [Step 4/5] [2021-11-19 21:10:51,818][INFO ][exchange-worker-#21586%grid-1%][GridCacheDatabaseSharedManager] Finish recovery performed in 5 ms. [21:10:51] : [Step 4/5] [2021-11-19 21:10:51,819][INFO ][exchange-worker-#21586%grid-1%][msg] Components activation performed in 6 ms. [21:10:51] : [Step 4/5] [2021-11-19 21:10:51,820][INFO ][exchange-worker-#21586%grid-1%][GridCacheProcessor] Finished recovery for cache [cache=ignite-sys-cache, grp=ignite-sys-cache, startVer=AffinityTopologyVersion [topVer=4, minorTopVer=0]] [21:10:51] : [Step 4/5] [2021-11-19 21:10:51,821][INFO ][sys-#21568%grid-1%][GridCacheProcessor] Finished recovery for cache [cache=encrypted, grp=encrypted, startVer=AffinityTopologyVersion [topVer=4, minorTopVer=0]] [21:10:51] : [Step 4/5] [2021-11-19 21:10:51,821][INFO ][exchange-worker-#21586%grid-1%][GridCacheProcessor] Starting caches on local join performed in 0 ms. [21:10:51] : [Step 4/5] [2021-11-19 21:10:51,822][INFO ][exchange-worker-#21586%grid-1%][GridDhtPartitionsExchangeFuture] Skipped waiting for partitions release future (local node is joining) [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0]] [21:10:51] : [Step 4/5] [2021-11-19 21:10:51,827][INFO ][grid-nio-worker-tcp-comm-1-#21245%TestRecordingCommunicationSpi%][TestRecordingCommunicationSpi] Accepted incoming communication connection [locAddr=/127.0.0.1:47100, rmtAddr=/127.0.0.1:33344] [21:10:51] : [Step 4/5] [2021-11-19 21:10:51,829][INFO ][grid-nio-worker-tcp-comm-0-#21519%TestRecordingCommunicationSpi%][TestRecordingCommunicationSpi] Established outgoing communication connection [locAddr=/127.0.0.1:33344, rmtAddr=/127.0.0.1:47100] [21:10:51] : [Step 4/5] [2021-11-19 21:10:51,829][INFO ][db-checkpoint-thread-#21591%grid-1%][Checkpointer] Checkpoint started [checkpointId=e0fa5d04-2f6f-4860-827d-3d5bd1e50c94, startPtr=WALPointer [idx=0, fileOff=302645, len=2064], checkpointBeforeLockTime=2ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=3ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=0ms, pages=22, reason='node started'] [21:10:51] : [Step 4/5] [2021-11-19 21:10:51,830][INFO ][exchange-worker-#21586%grid-1%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], crd=false] [21:10:51] : [Step 4/5] [2021-11-19 21:10:51,831][INFO ][sys-#21279%grid-0%][GridDhtPartitionsExchangeFuture] Coordinator received single message [ver=AffinityTopologyVersion [topVer=4, minorTopVer=0], node=10708d6c-11d6-4e22-9c25-8d72d7bd6001, allReceived=true] [21:10:51] : [Step 4/5] [2021-11-19 21:10:51,831][INFO ][sys-#21279%grid-0%][GridDhtPartitionsExchangeFuture] Coordinator received all messages, try merge [ver=AffinityTopologyVersion [topVer=4, minorTopVer=0]] [21:10:51] : [Step 4/5] [2021-11-19 21:10:51,832][INFO ][sys-#21279%grid-0%][GridDhtPartitionsExchangeFuture] finishExchangeOnCoordinator [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=0]] [21:10:51] : [Step 4/5] [2021-11-19 21:10:51,835][INFO ][sys-#21279%grid-0%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], err=null, rebalanced=false, wasRebalanced=true] [21:10:51] : [Step 4/5] [2021-11-19 21:10:51,836][INFO ][sys-#21279%grid-0%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=00a005ca-1176-4aa8-8e19-66df6832f000, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], evt=NODE_JOINED, evtNode=TcpDiscoveryNode [id=10708d6c-11d6-4e22-9c25-8d72d7bd6001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=4, intOrder=3, lastExchangeTime=1637345451762, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=false, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0]] [21:10:51] : [Step 4/5] [2021-11-19 21:10:51,836][INFO ][exchange-worker-#21306%grid-0%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=4, minorTopVer=0], force=false, evt=NODE_JOINED, node=10708d6c-11d6-4e22-9c25-8d72d7bd6001] [21:10:51] : [Step 4/5] [2021-11-19 21:10:51,838][INFO ][sys-#21279%grid-0%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (0 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Wait partitions release latch [latch=exchange]" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="After states restored callback" (0 ms), stage="WAL history reservation" (0 ms), stage="Waiting for all single messages" (31 ms), stage="Exchanges merge" (0 ms), stage="Affinity recalculation (crd)" (0 ms), stage="Collect update counters and create affinity messages" (0 ms), stage="Assign partitions states" (0 ms), stage="Validate partitions states" (0 ms), stage="Apply update counters" (0 ms), stage="Full message preparing" (1 ms), stage="Full message sending" (0 ms), stage="Exchange done" (2 ms), stage="Total time" (34 ms), Discovery lag=6 ms, Latest started node id=10708d6c-11d6-4e22-9c25-8d72d7bd6001] [21:10:51] : [Step 4/5] [2021-11-19 21:10:51,837][INFO ][sys-#21555%grid-1%][GridDhtPartitionsExchangeFuture] Received full message, will finish exchange [node=00a005ca-1176-4aa8-8e19-66df6832f000, resVer=AffinityTopologyVersion [topVer=4, minorTopVer=0]] [21:10:51] : [Step 4/5] [2021-11-19 21:10:51,840][INFO ][sys-#21279%grid-0%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], stage="Affinity initialization (node join) [grp=ignite-sys-cache, crd=true]" (0 ms) (parent=Affinity recalculation (crd)), stage="Affinity initialization (node join) [grp=encrypted, crd=true]" (0 ms) (parent=Affinity recalculation (crd))] [21:10:51] : [Step 4/5] [2021-11-19 21:10:51,845][INFO ][sys-#21555%grid-1%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], err=null, rebalanced=false, wasRebalanced=false] [21:10:51] : [Step 4/5] [2021-11-19 21:10:51,847][INFO ][sys-#21555%grid-1%][GridCacheProcessor] Finish proxy initialization, cacheName=ignite-sys-cache, localNodeId=10708d6c-11d6-4e22-9c25-8d72d7bd6001 [21:10:51] : [Step 4/5] [2021-11-19 21:10:51,847][INFO ][sys-#21555%grid-1%][GridCacheProcessor] Finish proxy initialization, cacheName=encrypted, localNodeId=10708d6c-11d6-4e22-9c25-8d72d7bd6001 [21:10:51] : [Step 4/5] [2021-11-19 21:10:51,847][INFO ][sys-#21555%grid-1%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=10708d6c-11d6-4e22-9c25-8d72d7bd6001, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], evt=NODE_JOINED, evtNode=TcpDiscoveryNode [id=10708d6c-11d6-4e22-9c25-8d72d7bd6001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=4, intOrder=3, lastExchangeTime=1637345451802, loc=true, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=false, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0]] [21:10:51] : [Step 4/5] [2021-11-19 21:10:51,847][INFO ][exchange-worker-#21586%grid-1%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=4, minorTopVer=0], force=false, evt=NODE_JOINED, node=10708d6c-11d6-4e22-9c25-8d72d7bd6001] [21:10:51] : [Step 4/5] [2021-11-19 21:10:51,855][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] To start Console Management & Monitoring run ignitevisorcmd.{sh|bat} [21:10:51] : [Step 4/5] [2021-11-19 21:10:51,850][INFO ][exchange-worker-#21306%grid-0%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], crd=true, evt=DISCOVERY_CUSTOM_EVT, evtNode=00a005ca-1176-4aa8-8e19-66df6832f000, customEvt=CacheAffinityChangeMessage [id=a048d593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], exchId=null, partsMsg=null, exchangeNeeded=true], allowMerge=false, exchangeFreeSwitch=false] [21:10:51] : [Step 4/5] [2021-11-19 21:10:51,848][INFO ][sys-#21555%grid-1%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], stage="Waiting in exchange queue" (8 ms), stage="Exchange parameters initialization" (0 ms), stage="Components activation" (6 ms), stage="Determine exchange type" (2 ms), stage="Preloading notification" (0 ms), stage="Restore partition states" (0 ms), stage="After states restored callback" (3 ms), stage="WAL history reservation" (0 ms), stage="Waiting for Full message" (11 ms), stage="Affinity recalculation" (4 ms), stage="Full map updating" (3 ms), stage="Exchange done" (3 ms), stage="Total time" (40 ms)] [21:10:51] : [Step 4/5] [2021-11-19 21:10:51,859][INFO ][sys-#21555%grid-1%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], stage="Affinity fetch" (2 ms) (parent=Determine exchange type), stage="Restore partition states [grp=ignite-sys-cache]" (0 ms) (parent=Restore partition states), stage="Restore partition states [grp=encrypted]" (0 ms) (parent=Restore partition states), stage="Affinity initialization (local join) [grp=ignite-sys-cache]" (4 ms) (parent=Affinity recalculation), stage="Affinity initialization (local join) [grp=encrypted]" (4 ms) (parent=Affinity recalculation)] [21:10:51] : [Step 4/5] [2021-11-19 21:10:51,858][INFO ][exchange-worker-#21306%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], waitTime=0ms, futInfo=NA, mode=DISTRIBUTED] [21:10:51] : [Step 4/5] [2021-11-19 21:10:51,858][INFO ][db-checkpoint-thread-#21591%grid-1%][Checkpointer] Checkpoint finished [cpId=e0fa5d04-2f6f-4860-827d-3d5bd1e50c94, pages=22, markPos=WALPointer [idx=0, fileOff=302645, len=2064], walSegmentsCovered=[], markDuration=6ms, pagesWrite=2ms, fsync=26ms, total=36ms] [21:10:51] : [Step 4/5] [2021-11-19 21:10:51,857][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] [21:10:51] : [Step 4/5] [21:10:51] : [Step 4/5] >>> +-------------------------------------------+ [21:10:51] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:10:51] : [Step 4/5] >>> +-------------------------------------------+ [21:10:51] : [Step 4/5] >>> OS name: Linux 4.15.0-151-generic amd64 [21:10:51] : [Step 4/5] >>> CPU(s): 24 [21:10:51] : [Step 4/5] >>> Heap: 2.0GB [21:10:51] : [Step 4/5] >>> VM name: 16724@c4dfe9a430b2 [21:10:51] : [Step 4/5] >>> Ignite instance name: grid-1 [21:10:51] : [Step 4/5] >>> Local node [ID=10708D6C-11D6-4E22-9C25-8D72D7BD6001, order=4, clientMode=false] [21:10:51] : [Step 4/5] >>> Local node addresses: [127.0.0.1] [21:10:51] : [Step 4/5] >>> Local ports: TCP:10801 TCP:47101 TCP:47501 [21:10:51] : [Step 4/5] [21:10:51] : [Step 4/5] [2021-11-19 21:10:51,857][INFO ][exchange-worker-#21586%grid-1%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], crd=false, evt=DISCOVERY_CUSTOM_EVT, evtNode=00a005ca-1176-4aa8-8e19-66df6832f000, customEvt=CacheAffinityChangeMessage [id=a048d593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], exchId=null, partsMsg=null, exchangeNeeded=true], allowMerge=false, exchangeFreeSwitch=false] [21:10:51] : [Step 4/5] [2021-11-19 21:10:51,862][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][GridDiscoveryManager] Topology snapshot [ver=4, locNode=10708d6c, servers=2, clients=0, state=ACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=00a005ca-1176-4aa8-8e19-66df6832f000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=10708d6c-11d6-4e22-9c25-8d72d7bd6001, consistentId=grid-1, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:10:51] : [Step 4/5] [2021-11-19 21:10:51,863][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][GridDiscoveryManager] ^-- Baseline [id=0, size=2, online=2, offline=0] [21:10:51] : [Step 4/5] [2021-11-19 21:10:51,862][INFO ][exchange-worker-#21586%grid-1%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], waitTime=0ms, futInfo=NA, mode=DISTRIBUTED] [21:10:51] : [Step 4/5] [2021-11-19 21:10:51,863][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][G] Node started : [stage="Configure system pool" (0 ms),stage="Start managers" (188 ms),stage="Configure binary metadata" (1 ms),stage="Start processors" (512 ms),stage="Start 'StanByClusterTestProvider' plugin" (0 ms),stage="Start 'PageMemory tracker plugin' plugin" (0 ms),stage="Start 'TestDistibutedConfigurationPlugin' plugin" (0 ms),stage="Start 'NodeValidationPluginProvider' plugin" (0 ms),stage="Init metastore" (101 ms),stage="Init and start regions" (6 ms),stage="Restore binary memory" (154 ms),stage="Restore logical state" (16 ms),stage="Finish recovery" (6 ms),stage="Join topology" (51 ms),stage="Await transition" (1 ms),stage="Await exchange" (57 ms),stage="Total time" (1093 ms)] [21:10:51] : [Step 4/5] [2021-11-19 21:10:51,865][INFO ][exchange-worker-#21586%grid-1%][GridDhtPartitionsExchangeFuture] Finished waiting for partitions release latch: ClientLatch [coordinator=TcpDiscoveryNode [id=00a005ca-1176-4aa8-8e19-66df6832f000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345451782, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], ackSent=true, super=CompletableLatch [id=CompletableLatchUid [id=exchange, topVer=AffinityTopologyVersion [topVer=4, minorTopVer=1]]]] [21:10:51] : [Step 4/5] [2021-11-19 21:10:51,864][INFO ][exchange-worker-#21306%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partitions release latch: ServerLatch [permits=0, pendingAcks=HashSet [], super=CompletableLatch [id=CompletableLatchUid [id=exchange, topVer=AffinityTopologyVersion [topVer=4, minorTopVer=1]]]] [21:10:51] : [Step 4/5] [2021-11-19 21:10:51,866][INFO ][exchange-worker-#21586%grid-1%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:10:51] : [Step 4/5] [2021-11-19 21:10:51,865][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][root] Node started with the following configuration [id=10708d6c-11d6-4e22-9c25-8d72d7bd6001, marshaller=BinaryMarshaller [], discovery=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=5000, ackTimeout=5000, marsh=JdkMarshaller [clsFilter=org.apache.ignite.marshaller.MarshallerUtils$1@6cfb024d], reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], binaryCfg=null, lateAff=true] [21:10:51] : [Step 4/5] [2021-11-19 21:10:51,867][INFO ][exchange-worker-#21586%grid-1%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], crd=false] [21:10:51] : [Step 4/5] [2021-11-19 21:10:51,866][INFO ][exchange-worker-#21306%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:10:51] : [Step 4/5] [2021-11-19 21:10:51,868][INFO ][exchange-worker-#21306%grid-0%][GridDhtPartitionsExchangeFuture] Coordinator received single message [ver=AffinityTopologyVersion [topVer=4, minorTopVer=1], node=10708d6c-11d6-4e22-9c25-8d72d7bd6001, allReceived=true] [21:10:51] : [Step 4/5] [2021-11-19 21:10:51,868][INFO ][exchange-worker-#21306%grid-0%][GridDhtPartitionsExchangeFuture] finishExchangeOnCoordinator [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=1]] [21:10:51] : [Step 4/5] [2021-11-19 21:10:51,871][INFO ][exchange-worker-#21306%grid-0%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], err=null, rebalanced=true, wasRebalanced=false] [21:10:51] : [Step 4/5] [2021-11-19 21:10:51,871][INFO ][sys-#21569%grid-1%][GridDhtPartitionsExchangeFuture] Received full message, will finish exchange [node=00a005ca-1176-4aa8-8e19-66df6832f000, resVer=AffinityTopologyVersion [topVer=4, minorTopVer=1]] [21:10:51] : [Step 4/5] [2021-11-19 21:10:51,872][INFO ][exchange-worker-#21306%grid-0%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=00a005ca-1176-4aa8-8e19-66df6832f000, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=00a005ca-1176-4aa8-8e19-66df6832f000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345451863, loc=true, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=4, minorTopVer=1]] [21:10:51] : [Step 4/5] [2021-11-19 21:10:51,873][INFO ][sys-#21569%grid-1%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], err=null, rebalanced=true, wasRebalanced=false] [21:10:51] : [Step 4/5] [2021-11-19 21:10:51,874][INFO ][exchange-worker-#21306%grid-0%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (8 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (2 ms), stage="Wait partitions release latch [latch=exchange]" (5 ms), stage="Wait partitions release [latch=exchange]" (1 ms), stage="After states restored callback" (0 ms), stage="WAL history reservation" (0 ms), stage="Waiting for all single messages" (0 ms), stage="Affinity recalculation (crd)" (0 ms), stage="Collect update counters and create affinity messages" (0 ms), stage="Validate partitions states" (0 ms), stage="Apply update counters" (0 ms), stage="Full message preparing" (1 ms), stage="Full message sending" (0 ms), stage="Exchange done" (3 ms), stage="Total time" (20 ms), Discovery lag=3 ms, Latest started node id=10708d6c-11d6-4e22-9c25-8d72d7bd6001] [21:10:51] : [Step 4/5] [2021-11-19 21:10:51,875][INFO ][exchange-worker-#21586%grid-1%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=4, minorTopVer=1], force=false, evt=DISCOVERY_CUSTOM_EVT, node=00a005ca-1176-4aa8-8e19-66df6832f000] [21:10:51] : [Step 4/5] [2021-11-19 21:10:51,875][INFO ][sys-#21569%grid-1%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=10708d6c-11d6-4e22-9c25-8d72d7bd6001, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=00a005ca-1176-4aa8-8e19-66df6832f000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345451782, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=4, minorTopVer=1]] [21:10:51] : [Step 4/5] [2021-11-19 21:10:51,878][INFO ][sys-#21569%grid-1%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], stage="Waiting in exchange queue" (4 ms), stage="Exchange parameters initialization" (5 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (1 ms), stage="Wait partitions release latch [latch=exchange]" (1 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="After states restored callback" (0 ms), stage="WAL history reservation" (0 ms), stage="Waiting for Full message" (4 ms), stage="Affinity recalculation" (0 ms), stage="Full map updating" (1 ms), stage="Exchange done" (4 ms), stage="Total time" (20 ms)] [21:10:51] : [Step 4/5] [2021-11-19 21:10:51,879][INFO ][sys-#21569%grid-1%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], stage="Affinity change by custom message [grp=ignite-sys-cache]" (0 ms) (parent=Determine exchange type)] [21:10:51] : [Step 4/5] [2021-11-19 21:10:51,877][INFO ][exchange-worker-#21586%grid-1%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=2], crd=false, evt=DISCOVERY_CUSTOM_EVT, evtNode=10708d6c-11d6-4e22-9c25-8d72d7bd6001, customEvt=DynamicCacheChangeBatch [id=b148d593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqs=ArrayList [DynamicCacheChangeRequest [cacheName=encrypted, hasCfg=false, nodeId=10708d6c-11d6-4e22-9c25-8d72d7bd6001, clientStartOnly=false, stop=false, destroy=false, disabledAfterStart=false]], exchangeActions=ExchangeActions [startCaches=null, stopCaches=null, startGrps=[], stopGrps=[], resetParts=[encrypted], stateChangeRequest=null], startCaches=false], allowMerge=false, exchangeFreeSwitch=false] [21:10:51] : [Step 4/5] [2021-11-19 21:10:51,876][INFO ][exchange-worker-#21306%grid-0%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], stage="Affinity change by custom message [grp=ignite-sys-cache]" (0 ms) (parent=Determine exchange type)] [21:10:51] : [Step 4/5] [2021-11-19 21:10:51,881][INFO ][exchange-worker-#21586%grid-1%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=2], waitTime=0ms, futInfo=NA, mode=DISTRIBUTED] [21:10:51] : [Step 4/5] [2021-11-19 21:10:51,881][INFO ][exchange-worker-#21306%grid-0%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], crd=true] [21:10:51] : [Step 4/5] [2021-11-19 21:10:51,882][INFO ][exchange-worker-#21306%grid-0%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=4, minorTopVer=1], force=false, evt=DISCOVERY_CUSTOM_EVT, node=00a005ca-1176-4aa8-8e19-66df6832f000] [21:10:51] : [Step 4/5] [2021-11-19 21:10:51,882][INFO ][exchange-worker-#21306%grid-0%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=2], crd=true, evt=DISCOVERY_CUSTOM_EVT, evtNode=10708d6c-11d6-4e22-9c25-8d72d7bd6001, customEvt=DynamicCacheChangeBatch [id=b148d593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqs=ArrayList [DynamicCacheChangeRequest [cacheName=encrypted, hasCfg=false, nodeId=10708d6c-11d6-4e22-9c25-8d72d7bd6001, clientStartOnly=false, stop=false, destroy=false, disabledAfterStart=false]], exchangeActions=ExchangeActions [startCaches=null, stopCaches=null, startGrps=[], stopGrps=[], resetParts=[encrypted], stateChangeRequest=null], startCaches=false], allowMerge=false, exchangeFreeSwitch=false] [21:10:51] : [Step 4/5] [2021-11-19 21:10:51,883][INFO ][exchange-worker-#21306%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=2], waitTime=0ms, futInfo=NA, mode=DISTRIBUTED] [21:10:51] : [Step 4/5] [2021-11-19 21:10:51,884][INFO ][exchange-worker-#21306%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partitions release latch: ServerLatch [permits=0, pendingAcks=HashSet [], super=CompletableLatch [id=CompletableLatchUid [id=exchange, topVer=AffinityTopologyVersion [topVer=4, minorTopVer=2]]]] [21:10:51] : [Step 4/5] [2021-11-19 21:10:51,884][INFO ][exchange-worker-#21586%grid-1%][GridDhtPartitionsExchangeFuture] Finished waiting for partitions release latch: ClientLatch [coordinator=TcpDiscoveryNode [id=00a005ca-1176-4aa8-8e19-66df6832f000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345451782, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], ackSent=true, super=CompletableLatch [id=CompletableLatchUid [id=exchange, topVer=AffinityTopologyVersion [topVer=4, minorTopVer=2]]]] [21:10:51] : [Step 4/5] [2021-11-19 21:10:51,885][INFO ][exchange-worker-#21306%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=2], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:10:51] : [Step 4/5] [2021-11-19 21:10:51,885][INFO ][exchange-worker-#21586%grid-1%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=2], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:10:51] : [Step 4/5] [2021-11-19 21:10:51,886][INFO ][exchange-worker-#21306%grid-0%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=2], crd=true] [21:10:51] : [Step 4/5] [2021-11-19 21:10:51,887][INFO ][exchange-worker-#21586%grid-1%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=2], crd=false] [21:10:51] : [Step 4/5] [2021-11-19 21:10:51,887][INFO ][sys-#21294%grid-0%][GridDhtPartitionsExchangeFuture] Coordinator received single message [ver=AffinityTopologyVersion [topVer=4, minorTopVer=2], node=10708d6c-11d6-4e22-9c25-8d72d7bd6001, allReceived=true] [21:10:51] : [Step 4/5] [2021-11-19 21:10:51,888][INFO ][sys-#21294%grid-0%][GridDhtPartitionsExchangeFuture] finishExchangeOnCoordinator [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=2]] [21:10:51] : [Step 4/5] [2021-11-19 21:10:51,891][INFO ][sys-#21294%grid-0%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=4, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=2], err=null, rebalanced=true, wasRebalanced=true] [21:10:51] : [Step 4/5] [2021-11-19 21:10:51,892][INFO ][sys-#21564%grid-1%][GridDhtPartitionsExchangeFuture] Received full message, will finish exchange [node=00a005ca-1176-4aa8-8e19-66df6832f000, resVer=AffinityTopologyVersion [topVer=4, minorTopVer=2]] [21:10:51] : [Step 4/5] [2021-11-19 21:10:51,892][INFO ][sys-#21294%grid-0%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=00a005ca-1176-4aa8-8e19-66df6832f000, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=2], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=10708d6c-11d6-4e22-9c25-8d72d7bd6001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=4, intOrder=3, lastExchangeTime=1637345451762, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=4, minorTopVer=2]] [21:10:51] : [Step 4/5] [2021-11-19 21:10:51,894][INFO ][sys-#21564%grid-1%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=4, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=2], err=null, rebalanced=true, wasRebalanced=true] [21:10:51] : [Step 4/5] [2021-11-19 21:10:51,892][INFO ][exchange-worker-#21306%grid-0%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=4, minorTopVer=2], force=false, evt=DISCOVERY_CUSTOM_EVT, node=10708d6c-11d6-4e22-9c25-8d72d7bd6001] [21:10:51] : [Step 4/5] [2021-11-19 21:10:51,895][INFO ][exchange-worker-#21586%grid-1%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=4, minorTopVer=2], force=false, evt=DISCOVERY_CUSTOM_EVT, node=10708d6c-11d6-4e22-9c25-8d72d7bd6001] [21:10:51] : [Step 4/5] [2021-11-19 21:10:51,895][INFO ][sys-#21564%grid-1%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=10708d6c-11d6-4e22-9c25-8d72d7bd6001, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=2], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=10708d6c-11d6-4e22-9c25-8d72d7bd6001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=4, intOrder=3, lastExchangeTime=1637345451863, loc=true, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=4, minorTopVer=2]] [21:10:51] : [Step 4/5] [2021-11-19 21:10:51,894][INFO ][sys-#21294%grid-0%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=4, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=2], stage="Waiting in exchange queue" (13 ms), stage="Exchange parameters initialization" (1 ms), stage="Update caches registry" (0 ms), stage="Start caches" (0 ms), stage="Affinity initialization on cache group start" (0 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Wait partitions release latch [latch=exchange]" (0 ms), stage="Wait partitions release [latch=exchange]" (1 ms), stage="After states restored callback" (0 ms), stage="WAL history reservation" (0 ms), stage="Waiting for all single messages" (2 ms), stage="Affinity recalculation (crd)" (0 ms), stage="Collect update counters and create affinity messages" (0 ms), stage="Assign partitions states" (0 ms), stage="Validate partitions states" (0 ms), stage="Ideal affinity diff calculation (enforced)" (0 ms), stage="Apply update counters" (0 ms), stage="Full message preparing" (2 ms), stage="Full message sending" (0 ms), stage="Exchange done" (2 ms), stage="Total time" (21 ms)] [21:10:51] : [Step 4/5] [2021-11-19 21:10:51,899][INFO ][sys-#21294%grid-0%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=4, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=2], stage="Affinity centralized initialization (crd) [grp=ignite-sys-cache, crd=true]" (0 ms) (parent=Determine exchange type), stage="Affinity centralized initialization (crd) [grp=encrypted, crd=true]" (0 ms) (parent=Determine exchange type), stage="Affinity recalculation (partitions availability) [grp=ignite-sys-cache]" (0 ms) (parent=Ideal affinity diff calculation (enforced)), stage="Affinity recalculation (partitions availability) [grp=encrypted]" (0 ms) (parent=Ideal affinity diff calculation (enforced))] [21:10:51] : [Step 4/5] [2021-11-19 21:10:51,897][INFO ][sys-#21564%grid-1%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=4, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=2], stage="Waiting in exchange queue" (7 ms), stage="Exchange parameters initialization" (3 ms), stage="Update caches registry" (0 ms), stage="Start caches" (0 ms), stage="Affinity initialization on cache group start" (0 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Wait partitions release latch [latch=exchange]" (4 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="After states restored callback" (0 ms), stage="WAL history reservation" (0 ms), stage="Waiting for Full message" (5 ms), stage="Affinity recalculation" (0 ms), stage="Full map updating" (1 ms), stage="Exchange done" (2 ms), stage="Total time" (22 ms)] [21:10:51] : [Step 4/5] [2021-11-19 21:10:51,895][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][root] awaitPartitionMapExchange finished [21:10:51] : [Step 4/5] [2021-11-19 21:10:51,901][INFO ][sys-#21564%grid-1%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=4, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=2], stage="Affinity centralized initialization (crd) [grp=ignite-sys-cache, crd=false]" (0 ms) (parent=Determine exchange type), stage="Affinity centralized initialization (crd) [grp=encrypted, crd=false]" (0 ms) (parent=Determine exchange type), stage="Affinity applying from full message [grp=ignite-sys-cache]" (0 ms) (parent=Affinity recalculation), stage="Affinity applying from full message [grp=encrypted]" (0 ms) (parent=Affinity recalculation)] [21:10:51] : [Step 4/5] [2021-11-19 21:10:51,904][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10708d6c-11d6-4e22-9c25-8d72d7bd6001, grp=1613773252] [21:10:51] : [Step 4/5] [2021-11-19 21:10:51,906][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00a005ca-1176-4aa8-8e19-66df6832f000, grp=1613773252] [21:10:51] : [Step 4/5] [2021-11-19 21:10:51,912][INFO ][disco-notifier-worker-#21301%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=2] [21:10:51] : [Step 4/5] [2021-11-19 21:10:51,912][INFO ][disco-notifier-worker-#21577%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=2] [21:10:51] : [Step 4/5] [2021-11-19 21:10:51,912][INFO ][reencrypt-#21461%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:10:51] : [Step 4/5] [2021-11-19 21:10:51,913][INFO ][reencrypt-#21603%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:10:52] : [Step 4/5] [2021-11-19 21:10:52,116][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10708d6c-11d6-4e22-9c25-8d72d7bd6001, grp=1613773252] [21:10:52] : [Step 4/5] [2021-11-19 21:10:52,856][INFO ][db-checkpoint-thread-#21591%grid-1%][Checkpointer] Checkpoint started [checkpointId=3b93effd-f5dd-441d-a674-f8efc420dfae, startPtr=WALPointer [idx=0, fileOff=587723, len=2048], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=1ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=402ms, writeCheckpointEntryDuration=336ms, splitAndSortCpPagesDuration=0ms, pages=67, reason='test'] [21:10:52] : [Step 4/5] [2021-11-19 21:10:52,869][INFO ][db-checkpoint-thread-#21591%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:10:52] : [Step 4/5] [2021-11-19 21:10:52,870][INFO ][db-checkpoint-thread-#21591%grid-1%][Checkpointer] Checkpoint finished [cpId=3b93effd-f5dd-441d-a674-f8efc420dfae, pages=67, markPos=WALPointer [idx=0, fileOff=587723, len=2048], walSegmentsCovered=[], markDuration=740ms, pagesWrite=5ms, fsync=8ms, total=754ms] [21:10:52] : [Step 4/5] [2021-11-19 21:10:52,871][INFO ][test-runner-#21189%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00a005ca-1176-4aa8-8e19-66df6832f000, grp=1613773252] [21:10:52] : [Step 4/5] [2021-11-19 21:10:52,879][INFO ][db-checkpoint-thread-#21440%grid-0%][Checkpointer] Checkpoint started [checkpointId=06c02f8c-1f45-419c-b326-cdd9298140b1, startPtr=WALPointer [idx=0, fileOff=336507, len=2010], checkpointBeforeLockTime=2ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=2ms, writeCheckpointEntryDuration=2ms, splitAndSortCpPagesDuration=0ms, pages=43, reason='test'] [21:10:52] : [Step 4/5] [2021-11-19 21:10:52,897][INFO ][db-checkpoint-thread-#21440%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:10:52] : [Step 4/5] [2021-11-19 21:10:52,898][INFO ][db-checkpoint-thread-#21440%grid-0%][Checkpointer] Checkpoint finished [cpId=06c02f8c-1f45-419c-b326-cdd9298140b1, pages=43, markPos=WALPointer [idx=0, fileOff=336507, len=2010], walSegmentsCovered=[], markDuration=5ms, pagesWrite=3ms, fsync=16ms, total=26ms] [21:10:52] : [Step 4/5] [21:10:52] >>> Stopping test: CacheGroupKeyChangeTest#testNodeFailsAfterPerform in 3986 ms <<< [21:10:52] : [Step 4/5] [2021-11-19 21:10:52,899][INFO ][main][root] >>> Stopping test: CacheGroupKeyChangeTest#testNodeFailsAfterPerform in 3986 ms <<< [21:10:52] : [Step 4/5] [21:10:52] >>> Heap: 513 MB used / 1940 MB commited / 1940 MB max <<< [21:10:52] : [Step 4/5] [2021-11-19 21:10:52,900][INFO ][main][root] >>> Heap: 513 MB used / 1940 MB commited / 1940 MB max <<< [21:10:52] : [Step 4/5] [21:10:52] >>> Non-Heap: 159 MB used / 183 MB commited / 0 MB max <<< [21:10:52] : [Step 4/5] [2021-11-19 21:10:52,900][INFO ][main][root] >>> Non-Heap: 159 MB used / 183 MB commited / 0 MB max <<< [21:10:52] : [Step 4/5] [2021-11-19 21:10:52,900][INFO ][main][root] >>> Stopping grid [name=grid-1, id=10708d6c-11d6-4e22-9c25-8d72d7bd6001] [21:10:52] : [Step 4/5] [2021-11-19 21:10:52,908][INFO ][db-checkpoint-thread-#21591%grid-1%][Checkpointer] Skipping checkpoint (no pages were modified) [checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=1ms, reason='timeout'] [21:10:52] : [Step 4/5] [2021-11-19 21:10:52,914][INFO ][tcp-disco-sock-reader-[00a005ca 127.0.0.1:36399]-#1133%grid-1%-#21582%grid-1%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:36399, rmtPort=36399, rmtNodeId=00a005ca-1176-4aa8-8e19-66df6832f000] [21:10:52] : [Step 4/5] [2021-11-19 21:10:52,914][INFO ][disco-event-worker-#21305%grid-0%][GridDiscoveryManager] Node left topology: TcpDiscoveryNode [id=10708d6c-11d6-4e22-9c25-8d72d7bd6001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=4, intOrder=3, lastExchangeTime=1637345451762, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false] [21:10:52] : [Step 4/5] [2021-11-19 21:10:52,917][INFO ][disco-event-worker-#21305%grid-0%][GridDiscoveryManager] Topology snapshot [ver=5, locNode=00a005ca, servers=1, clients=0, state=ACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=00a005ca-1176-4aa8-8e19-66df6832f000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:10:52] : [Step 4/5] [2021-11-19 21:10:52,918][INFO ][disco-event-worker-#21305%grid-0%][GridDiscoveryManager] ^-- Baseline [id=0, size=2, online=1, offline=1] [21:10:52] : [Step 4/5] [2021-11-19 21:10:52,919][INFO ][exchange-worker-#21306%grid-0%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], crd=true, evt=NODE_LEFT, evtNode=10708d6c-11d6-4e22-9c25-8d72d7bd6001, customEvt=null, allowMerge=false, exchangeFreeSwitch=true] [21:10:52] : [Step 4/5] [2021-11-19 21:10:52,920][INFO ][sys-#21286%grid-0%][GridAffinityAssignmentCache] Local node affinity assignment distribution is not ideal [cache=encrypted, expectedPrimary=8.00, actualPrimary=3, expectedBackups=0.00, actualBackups=0, warningThreshold=50.00%] [21:10:52] : [Step 4/5] [2021-11-19 21:10:52,923][INFO ][main][GridCacheProcessor] Stopped cache [cacheName=encrypted] [21:10:52] : [Step 4/5] [2021-11-19 21:10:52,927][INFO ][exchange-worker-#21306%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:10:52] : [Step 4/5] [2021-11-19 21:10:52,928][INFO ][main][GridCacheProcessor] Stopped cache [cacheName=ignite-sys-cache] [21:10:52] : [Step 4/5] [2021-11-19 21:10:52,928][INFO ][exchange-worker-#21306%grid-0%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], err=null, rebalanced=true, wasRebalanced=true] [21:10:52]W: [org.apache.ignite:ignite-core] [2021-11-19 21:10:52,933][WARN ][sys-#21299%grid-0%][GridDhtPartitionTopologyImpl] Detected lost partitions [grp=encrypted, parts=[0, 2, 4, 6-7], topVer=AffinityTopologyVersion [topVer=5, minorTopVer=0]] [21:10:52] : [Step 4/5] [2021-11-19 21:10:52,937][INFO ][exchange-worker-#21306%grid-0%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=00a005ca-1176-4aa8-8e19-66df6832f000, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], evt=NODE_LEFT, evtNode=TcpDiscoveryNode [id=10708d6c-11d6-4e22-9c25-8d72d7bd6001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=4, intOrder=3, lastExchangeTime=1637345451762, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=5, minorTopVer=0]] [21:10:52] : [Step 4/5] [2021-11-19 21:10:52,939][INFO ][exchange-worker-#21306%grid-0%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (0 ms), stage="Determine exchange type" (7 ms), stage="Preloading notification" (0 ms), stage="After states restored callback" (0 ms), stage="WAL history reservation" (0 ms), stage="Finalize update counters" (0 ms), stage="Detect lost partitions" (8 ms), stage="Exchange done" (1 ms), stage="Total time" (16 ms)] [21:10:52] : [Step 4/5] [2021-11-19 21:10:52,940][INFO ][exchange-worker-#21306%grid-0%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], stage="Affinity initialization (exchange-free switch on fully-rebalanced topology) [grp=encrypted]" (6 ms) (parent=Determine exchange type), stage="Affinity initialization (exchange-free switch on fully-rebalanced topology) [grp=ignite-sys-cache]" (0 ms) (parent=Determine exchange type)] [21:10:52] : [Step 4/5] [2021-11-19 21:10:52,941][INFO ][exchange-worker-#21306%grid-0%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], crd=true] [21:10:52] : [Step 4/5] [2021-11-19 21:10:52,941][INFO ][exchange-worker-#21306%grid-0%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=5, minorTopVer=0], force=false, evt=NODE_LEFT, node=10708d6c-11d6-4e22-9c25-8d72d7bd6001] [21:10:52] : [Step 4/5] [2021-11-19 21:10:52,945][INFO ][main][FilePageStoreManager] Cleanup cache stores [total=4, left=0, cleanFiles=false] [21:10:52] : [Step 4/5] [2021-11-19 21:10:52,957][INFO ][main][GridDeploymentLocalStore] Removed undeployed class: GridDeployment [ts=1637345451832, depMode=SHARED, clsLdr=IsolatedClassLoader{roleName='test'}, clsLdrId=8048d593d71-10708d6c-11d6-4e22-9c25-8d72d7bd6001, userVer=0, loc=true, sampleClsName=org.apache.ignite.internal.processors.cache.distributed.dht.preloader.GridDhtPartitionFullMap, pendingUndeploy=false, undeployed=true, usage=0] [21:10:53] : [Step 4/5] [2021-11-19 21:10:53,013][INFO ][main][IgniteKernal%grid-1] [21:10:53] : [Step 4/5] [21:10:53] : [Step 4/5] >>> +------------------------------------------------------+ [21:10:53] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV stopped OK [21:10:53] : [Step 4/5] >>> +------------------------------------------------------+ [21:10:53] : [Step 4/5] >>> Ignite instance name: grid-1 [21:10:53] : [Step 4/5] >>> Grid uptime: 00:00:01.154 [21:10:53] : [Step 4/5] [21:10:53] : [Step 4/5] [21:10:53] : [Step 4/5] [2021-11-19 21:10:53,014][INFO ][main][root] >>> Stopping grid [name=grid-0, id=00a005ca-1176-4aa8-8e19-66df6832f000] [21:10:53] : [Step 4/5] [2021-11-19 21:10:53,022][INFO ][db-checkpoint-thread-#21440%grid-0%][Checkpointer] Skipping checkpoint (no pages were modified) [checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=1ms, reason='timeout'] [21:10:53]W: [org.apache.ignite:ignite-core] [2021-11-19 21:10:53,028][WARN ][tcp-disco-sock-reader-[10a8a0d8 127.0.0.1:47315]-#1125%grid-0%-#21426%grid-0%][TestTcpDiscoverySpi] Failed to shutdown socket [21:10:53]W: [org.apache.ignite:ignite-core] java.net.SocketException: Socket is closed [21:10:53]W: [org.apache.ignite:ignite-core] at java.net.Socket.shutdownOutput(Socket.java:1568) [21:10:53]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.close(IgniteUtils.java:4247) [21:10:53]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.discovery.tcp.ServerImpl$SocketReader.body(ServerImpl.java:7370) [21:10:53]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.IgniteSpiThread.run(IgniteSpiThread.java:58) [21:10:53] : [Step 4/5] [2021-11-19 21:10:53,028][INFO ][tcp-disco-sock-reader-[10708d6c 127.0.0.1:34127]-#1134%grid-0%-#21583%grid-0%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:34127, rmtPort=34127, rmtNodeId=10708d6c-11d6-4e22-9c25-8d72d7bd6001] [21:10:53] : [Step 4/5] [2021-11-19 21:10:53,029][INFO ][tcp-disco-sock-reader-[10a8a0d8 127.0.0.1:47315]-#1125%grid-0%-#21426%grid-0%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:47315, rmtPort=47315, rmtNodeId=10a8a0d8-a507-4823-9923-6a3fda27b001] [21:10:53] : [Step 4/5] [2021-11-19 21:10:53,032][INFO ][main][GridCacheProcessor] Stopped cache [cacheName=ignite-sys-cache] [21:10:53] : [Step 4/5] [2021-11-19 21:10:53,033][INFO ][main][GridCacheProcessor] Stopped cache [cacheName=encrypted] [21:10:53] : [Step 4/5] [2021-11-19 21:10:53,038][INFO ][main][FilePageStoreManager] Cleanup cache stores [total=4, left=0, cleanFiles=false] [21:10:53] : [Step 4/5] [2021-11-19 21:10:53,041][INFO ][main][GridDeploymentLocalStore] Removed undeployed class: GridDeployment [ts=1637345450234, depMode=SHARED, clsLdr=IsolatedClassLoader{roleName='test'}, clsLdrId=8a28d593d71-00a005ca-1176-4aa8-8e19-66df6832f000, userVer=0, loc=true, sampleClsName=org.apache.ignite.internal.processors.cache.distributed.dht.preloader.GridDhtPartitionMap, pendingUndeploy=false, undeployed=true, usage=0] [21:10:53] : [Step 4/5] [2021-11-19 21:10:53,052][INFO ][main][IgniteKernal%grid-0] [21:10:53] : [Step 4/5] [21:10:53] : [Step 4/5] >>> +------------------------------------------------------+ [21:10:53] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV stopped OK [21:10:53] : [Step 4/5] >>> +------------------------------------------------------+ [21:10:53] : [Step 4/5] >>> Ignite instance name: grid-0 [21:10:53] : [Step 4/5] >>> Grid uptime: 00:00:03.510 [21:10:53] : [Step 4/5] [21:10:53] : [Step 4/5] [21:10:53] : [Step 4/5] [21:10:53] >>> Starting test: CacheGroupKeyChangeTest#testNodeFailsAfterPrepare <<< [21:10:53] : [Step 4/5] [2021-11-19 21:10:53,072][INFO ][main][root] >>> Starting test: CacheGroupKeyChangeTest#testNodeFailsAfterPrepare <<< [21:10:53] : [Step 4/5] [21:10:53] >>> Heap: 516 MB used / 1940 MB commited / 1940 MB max <<< [21:10:53] : [Step 4/5] [2021-11-19 21:10:53,072][INFO ][main][root] >>> Heap: 516 MB used / 1940 MB commited / 1940 MB max <<< [21:10:53] : [Step 4/5] [21:10:53] >>> Non-Heap: 159 MB used / 183 MB commited / 0 MB max <<< [21:10:53] : [Step 4/5] [2021-11-19 21:10:53,073][INFO ][main][root] >>> Non-Heap: 159 MB used / 183 MB commited / 0 MB max <<< [21:10:53]W: [org.apache.ignite:ignite-core] [2021-11-19 21:10:53,081][WARN ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][G] Ignite work directory is not provided, automatically resolved to: /opt/buildagent/work/7bc1c54bc719b67c/work [21:10:53] : [Step 4/5] [2021-11-19 21:10:53,083][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] [21:10:53] : [Step 4/5] [21:10:53] : [Step 4/5] >>> __________ ________________ [21:10:53] : [Step 4/5] >>> / _/ ___/ |/ / _/_ __/ __/ [21:10:53] : [Step 4/5] >>> _/ // (7 7 // / / / / _/ [21:10:53] : [Step 4/5] >>> /___/\___/_/|_/___/ /_/ /___/ [21:10:53] : [Step 4/5] >>> [21:10:53] : [Step 4/5] >>> ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:10:53] : [Step 4/5] >>> 2021 Copyright(C) Apache Software Foundation [21:10:53] : [Step 4/5] >>> [21:10:53] : [Step 4/5] >>> Ignite documentation: http://ignite.apache.org [21:10:53] : [Step 4/5] [21:10:53] : [Step 4/5] [2021-11-19 21:10:53,085][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] Config URL: n/a [21:10:53] : [Step 4/5] [2021-11-19 21:10:53,086][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] IgniteConfiguration [igniteInstanceName=grid-0, pubPoolSize=24, svcPoolSize=24, callbackPoolSize=24, stripedPoolSize=24, sysPoolSize=24, mgmtPoolSize=4, dataStreamerPoolSize=24, utilityCachePoolSize=24, utilityCacheKeepAliveTime=60000, p2pPoolSize=2, qryPoolSize=24, buildIdxPoolSize=4, igniteHome=/opt/buildagent/work/7bc1c54bc719b67c, igniteWorkDir=/opt/buildagent/work/7bc1c54bc719b67c/work, mbeanSrv=com.sun.jmx.mbeanserver.JmxMBeanServer@6fe85038, nodeId=00db608c-526f-476a-ba3c-0d39102bb000, marsh=BinaryMarshaller [], marshLocJobs=false, daemon=false, p2pEnabled=true, netTimeout=10000, netCompressionLevel=1, sndRetryDelay=1000, sndRetryCnt=3, metricsHistSize=10000, metricsUpdateFreq=1000, metricsExpTime=9223372036854775807, discoSpi=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=0, ackTimeout=0, marsh=null, reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], segPlc=STOP, segResolveAttempts=2, waitForSegOnStart=true, allResolversPassReq=true, segChkFreq=10000, commSpi=TcpCommunicationSpi [connectGate=org.apache.ignite.spi.communication.tcp.internal.ConnectGateway@1e46a0c, ctxInitLatch=java.util.concurrent.CountDownLatch@384ca0a6[Count = 1], stopping=false, clientPool=null, nioSrvWrapper=null, stateProvider=null], evtSpi=MemoryEventStorageSpi [expireAgeMs=9223372036854775807, expireCnt=10000, filter=null], colSpi=NoopCollisionSpi [], deploySpi=LocalDeploymentSpi [], indexingSpi=org.apache.ignite.spi.indexing.noop.NoopIndexingSpi@4ef740f8, addrRslvr=null, encryptionSpi=org.apache.ignite.spi.encryption.keystore.KeystoreEncryptionSpi@12350abd, tracingSpi=org.apache.ignite.spi.tracing.NoopTracingSpi@a441292, clientMode=false, rebalanceThreadPoolSize=4, rebalanceTimeout=10000, rebalanceBatchesPrefetchCnt=3, rebalanceThrottle=0, rebalanceBatchSize=524288, txCfg=TransactionConfiguration [txSerEnabled=false, dfltIsolation=REPEATABLE_READ, dfltConcurrency=PESSIMISTIC, dfltTxTimeout=0, txTimeoutOnPartitionMapExchange=0, deadlockTimeout=10000, pessimisticTxLogSize=0, pessimisticTxLogLinger=10000, tmLookupClsName=null, txManagerFactory=null, useJtaSync=false], cacheSanityCheckEnabled=true, discoStartupDelay=60000, deployMode=SHARED, p2pMissedCacheSize=100, locHost=127.0.0.1, timeSrvPortBase=31100, timeSrvPortRange=100, failureDetectionTimeout=10000, sysWorkerBlockedTimeout=null, clientFailureDetectionTimeout=10000, metricsLogFreq=0, connectorCfg=null, odbcCfg=null, warmupClos=null, atomicCfg=AtomicConfiguration [seqReserveSize=1000, cacheMode=PARTITIONED, backups=1, aff=null, grpName=null], classLdr=null, sslCtxFactory=null, platformCfg=null, binaryCfg=null, memCfg=null, pstCfg=null, dsCfg=DataStorageConfiguration [sysRegionInitSize=41943040, sysRegionMaxSize=104857600, pageSize=4096, concLvl=0, dfltDataRegConf=DataRegionConfiguration [name=default, maxSize=104857600, initSize=268435456, swapPath=null, pageEvictionMode=DISABLED, pageReplacementMode=CLOCK, evictionThreshold=0.9, emptyPagesPoolSize=100, metricsEnabled=false, metricsSubIntervalCount=5, metricsRateTimeInterval=60000, persistenceEnabled=true, checkpointPageBufSize=0, lazyMemoryAllocation=true, warmUpCfg=null], dataRegions=null, storagePath=null, checkpointFreq=30000, lockWaitTime=10000, checkpointThreads=4, checkpointWriteOrder=SEQUENTIAL, walHistSize=20, maxWalArchiveSize=20971520, walSegments=10, walSegmentSize=1048576, walPath=db/wal, walArchivePath=db/wal/archive, cdcWalPath=db/wal/cdc, cdcEnabled=false, metricsEnabled=false, walMode=LOG_ONLY, walTlbSize=131072, walBuffSize=0, walFlushFreq=2000, walFsyncDelay=1000, walRecordIterBuffSize=67108864, alwaysWriteFullPages=false, fileIOFactory=org.apache.ignite.internal.processors.cache.persistence.file.AsyncFileIOFactory@23e84354, metricsSubIntervalCnt=5, metricsRateTimeInterval=60000, walAutoArchiveAfterInactivity=-1, walForceArchiveTimeout=-1, writeThrottlingEnabled=false, walCompactionEnabled=false, walCompactionLevel=1, checkpointReadLockTimeout=null, walPageCompression=DISABLED, walPageCompressionLevel=null, dfltWarmUpCfg=null, encCfg=org.apache.ignite.configuration.EncryptionConfiguration@4edd9691, defragmentationThreadPoolSize=4, minWalArchiveSize=-1], snapshotPath=snapshots, activeOnStart=true, activeOnStartPropSetFlag=false, autoActivation=true, autoActivationPropSetFlag=false, clusterStateOnStart=null, sqlConnCfg=null, cliConnCfg=ClientConnectorConfiguration [host=null, port=10800, portRange=100, sockSndBufSize=0, sockRcvBufSize=0, tcpNoDelay=true, maxOpenCursorsPerConn=128, threadPoolSize=24, selectorCnt=12, idleTimeout=0, handshakeTimeout=10000, jdbcEnabled=true, odbcEnabled=true, thinCliEnabled=true, sslEnabled=false, useIgniteSslCtxFactory=true, sslClientAuth=false, sslCtxFactory=null, thinCliCfg=ThinClientConfiguration [maxActiveTxPerConn=100, maxActiveComputeTasksPerConn=0]], mvccVacuumThreadCnt=2, mvccVacuumFreq=5000, authEnabled=false, failureHnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]], commFailureRslvr=null, sqlCfg=SqlConfiguration [longQryWarnTimeout=3000, dfltQryTimeout=0, sqlQryHistSize=1000, validationEnabled=false], asyncContinuationExecutor=null] [21:10:53] : [Step 4/5] [2021-11-19 21:10:53,095][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] Daemon mode: off [21:10:53] : [Step 4/5] [2021-11-19 21:10:53,096][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] OS: Linux 4.15.0-151-generic amd64 [21:10:53] : [Step 4/5] [2021-11-19 21:10:53,096][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] OS user: teamcity [21:10:53] : [Step 4/5] [2021-11-19 21:10:53,096][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] PID: 16724 [21:10:53] : [Step 4/5] [2021-11-19 21:10:53,097][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] Language runtime: Java Platform API Specification ver. 1.8 [21:10:53] : [Step 4/5] [2021-11-19 21:10:53,097][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] VM information: Java(TM) SE Runtime Environment 1.8.0_261-b12 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 25.261-b12 [21:10:53] : [Step 4/5] [2021-11-19 21:10:53,098][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] VM total memory: 1.9GB [21:10:53] : [Step 4/5] [2021-11-19 21:10:53,098][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] Remote Management [restart: off, REST: off, JMX (remote: off)] [21:10:53] : [Step 4/5] [2021-11-19 21:10:53,098][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] Logger: GridTestLog4jLogger [quiet=false, config=null] [21:10:53] : [Step 4/5] [2021-11-19 21:10:53,099][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] IGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c [21:10:53] : [Step 4/5] [2021-11-19 21:10:53,099][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] VM arguments: [-DIGNITE_DUMP_THREADS_ON_FAILURE=false, -DMono=/usr/bin/mono-sgen, -DMono4.0_x64=/usr/lib/mono/4.0, -DMono4.5_x64=/usr/lib/mono/4.5, -DMonoVersion=6.12.0.90, -DSKIP_BUILD=false, -Dagent.home.dir=/opt/buildagent, -Dagent.name=aitc-lin02_03, -Dagent.ownPort=9090, -Dagent.work.dir=/opt/buildagent/work, -Dbuild.number=95, -Dbuild.vcs.number=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.1=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.GitHubApacheIgnite=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dclassworlds.conf=/opt/buildagent/temp/buildTmp/teamcity.m2.conf, -Dcom.jetbrains.maven.watcher.report.file=/opt/buildagent/temp/buildTmp/maven-build-info.xml, -Djava.io.tmpdir=/opt/buildagent/temp/buildTmp, -Dmaven.home=/opt/buildagent/tools/maven3_6, -Dmaven.multiModuleProjectDirectory=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.agent.cpuBenchmark=457, -Dteamcity.agent.dotnet.agent_url=http://localhost:9090/RPC2, -Dteamcity.agent.dotnet.build_id=6278078, -Dteamcity.auth.password=*******, -Dteamcity.auth.userId=TeamCityBuildId=6278078, -Dteamcity.build.changedFiles.file=/opt/buildagent/temp/buildTmp/changedFiles6342607772318147725.txt, -Dteamcity.build.checkoutDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.build.id=6278078, -Dteamcity.build.properties.file=/opt/buildagent/temp/buildTmp/teamcity.build5164517880467851002.properties, -Dteamcity.build.tempDir=/opt/buildagent/temp/buildTmp, -Dteamcity.build.workingDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.buildConfName=Basic 3, -Dteamcity.buildType.id=IgniteTests24Java8_Basic3, -Dteamcity.configuration.properties.file=/opt/buildagent/temp/buildTmp/teamcity.config5591980786735343870.properties, -Dteamcity.maven.userSettings.path=/opt/buildagent/temp/buildTmp/maven_settings_585072866407032347.xml, -Dteamcity.maven.watcher.home=/opt/buildagent/plugins/mavenPlugin/maven-watcher-jdk16, -Dteamcity.projectName=Ignite Tests 2.x (JDK 8/11), -Dteamcity.runner.properties.file=/opt/buildagent/temp/buildTmp/teamcity.runner9098465561618137420.properties, -Dteamcity.tests.recentlyFailedTests.file=/opt/buildagent/temp/buildTmp/testsToRunFirst3891775683130404069.txt, -Dteamcity.version=2021.2 (build 99542), -ea, -Xms2g, -Xmx2g, -XX:+HeapDumpOnOutOfMemoryError, -DIGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_TEST_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_UPDATE_NOTIFIER=false, -DIGNITE_NO_DISCO_ORDER=true, -DIGNITE_PERFORMANCE_SUGGESTIONS_DISABLED=true, -Djava.net.preferIPv4Stack=true, -DTEST_SCALE_FACTOR=1.0, -DIGNITE_TEST_PROP_LOG4J_FILE=log4j-tc-test.xml, -DIGNITE_QUIET=false, -DIGNITE_MARSHAL_BUFFERS_RECHECK=1000, -Dmaven.repo.local=/opt/buildagent/.m2/repository] [21:10:53] : [Step 4/5] [2021-11-19 21:10:53,104][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] System cache's DataRegion size is configured to 40 MB. Use DataStorageConfiguration.systemRegionInitialSize property to change the setting. [21:10:53] : [Step 4/5] [2021-11-19 21:10:53,105][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] Configured caches [in 'sysMemPlc' dataRegion: ['ignite-sys-cache']] [21:10:53]W: [org.apache.ignite:ignite-core] [2021-11-19 21:10:53,105][WARN ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] Peer class loading is enabled (disable it in production for performance and deployment consistency reasons) [21:10:53] : [Step 4/5] [2021-11-19 21:10:53,106][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] 3-rd party licenses can be found at: /opt/buildagent/work/7bc1c54bc719b67c/libs/licenses [21:10:53] : [Step 4/5] [2021-11-19 21:10:53,110][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] Configured plugins: [21:10:53] : [Step 4/5] [2021-11-19 21:10:53,111][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- StanByClusterTestProvider 1.0 [21:10:53] : [Step 4/5] [2021-11-19 21:10:53,111][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:10:53] : [Step 4/5] [2021-11-19 21:10:53,111][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] [21:10:53] : [Step 4/5] [2021-11-19 21:10:53,111][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- PageMemory tracker plugin 1.0 [21:10:53] : [Step 4/5] [2021-11-19 21:10:53,112][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:10:53] : [Step 4/5] [2021-11-19 21:10:53,112][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] [21:10:53] : [Step 4/5] [2021-11-19 21:10:53,112][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- TestDistibutedConfigurationPlugin 1.0 [21:10:53] : [Step 4/5] [2021-11-19 21:10:53,112][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:10:53] : [Step 4/5] [2021-11-19 21:10:53,113][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] [21:10:53] : [Step 4/5] [2021-11-19 21:10:53,113][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- NodeValidationPluginProvider 1.0 [21:10:53] : [Step 4/5] [2021-11-19 21:10:53,113][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:10:53] : [Step 4/5] [2021-11-19 21:10:53,113][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] [21:10:53] : [Step 4/5] [2021-11-19 21:10:53,114][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][FailureProcessor] Configured failure handler: [hnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]]] [21:10:53] : [Step 4/5] [2021-11-19 21:10:53,208][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][TestRecordingCommunicationSpi] Successfully bound communication NIO server to TCP port [port=47100, locHost=/127.0.0.1, selectorsCnt=12, selectorSpins=0, pairedConn=false] [21:10:53]W: [org.apache.ignite:ignite-core] [2021-11-19 21:10:53,209][WARN ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][TestRecordingCommunicationSpi] Message queue limit is set to 0 which may lead to potential OOMEs when running cache operations in FULL_ASYNC or PRIMARY_SYNC modes due to message queues growth on sender and receiver sides. [21:10:53] : [Step 4/5] [2021-11-19 21:10:53,239][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][GridCollisionManager] Collision resolution is disabled (all jobs will be activated upon arrival). [21:10:53] : [Step 4/5] [2021-11-19 21:10:53,240][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] Security status [authentication=off, sandbox=off, tls/ssl=off] [21:10:53] : [Step 4/5] [2021-11-19 21:10:53,309][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:10:53] : [Step 4/5] [2021-11-19 21:10:53,410][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][MaintenanceProcessor] Resolved store directory for node persistent data: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0 [21:10:53] : [Step 4/5] [2021-11-19 21:10:53,413][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][CacheObjectBinaryProcessorImpl] Resolved directory for serialized binary metadata: /opt/buildagent/work/7bc1c54bc719b67c/work/db/binary_meta/grid_0 [21:10:53] : [Step 4/5] [2021-11-19 21:10:53,425][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0 [21:10:53] : [Step 4/5] [2021-11-19 21:10:53,426][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][FileWriteAheadLogManager] Resolved write ahead log work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0 [21:10:53] : [Step 4/5] [2021-11-19 21:10:53,426][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][FileWriteAheadLogManager] Resolved write ahead log archive directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0 [21:10:53] : [Step 4/5] [2021-11-19 21:10:53,857][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000000.wal [21:10:53] : [Step 4/5] [2021-11-19 21:10:53,858][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][FileHandleManagerImpl] Initialized write-ahead log manager [mode=LOG_ONLY] [21:10:53]W: [org.apache.ignite:ignite-core] [2021-11-19 21:10:53,859][WARN ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] DataRegion maxSize=104.9 MB is smaller than defaultInitialSize=268.4 MB, setting initialSize to 104.9 MB [21:10:53] : [Step 4/5] [2021-11-19 21:10:53,865][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Configured data regions initialized successfully [total=5] [21:10:54] : [Step 4/5] [2021-11-19 21:10:54,076][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][IgniteSnapshotManager] Resolved snapshot work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/snapshots [21:10:54] : [Step 4/5] [2021-11-19 21:10:54,076][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][IgniteSnapshotManager] Resolved temp directory for snapshot creation: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0/snp [21:10:54] : [Step 4/5] [2021-11-19 21:10:54,079][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][ClientListenerProcessor] Client connector processor has started on TCP port 10800 [21:10:54] : [Step 4/5] [2021-11-19 21:10:54,087][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] Non-loopback local IPs: 172.17.0.4 [21:10:54] : [Step 4/5] [2021-11-19 21:10:54,087][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] Enabled local MACs: 0242AC110004 [21:10:54] : [Step 4/5] [2021-11-19 21:10:54,090][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:10:54] : [Step 4/5] [2021-11-19 21:10:54,091][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:10:54] : [Step 4/5] [2021-11-19 21:10:54,092][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:10:54] : [Step 4/5] [2021-11-19 21:10:54,100][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Applying lost metastore updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:10:54] : [Step 4/5] [2021-11-19 21:10:54,101][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=0 ms] [21:10:54] : [Step 4/5] [2021-11-19 21:10:54,102][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Restoring partition state for local groups. [21:10:54] : [Step 4/5] [2021-11-19 21:10:54,102][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=0, partitionsProcessed=0, time=0ms] [21:10:54] : [Step 4/5] [2021-11-19 21:10:54,103][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][GridEncryptionManager] Encryption keys loaded from metastore. [grps=, masterKeyName=ignite.master.key] [21:10:54] : [Step 4/5] [2021-11-19 21:10:54,109][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][ClusterProcessor] Cluster ID and tag has been read from metastorage: null [21:10:54] : [Step 4/5] [2021-11-19 21:10:54,109][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][IgniteClusterImpl] Shutdown policy was updated [oldVal=null, newVal=null] [21:10:54] : [Step 4/5] [2021-11-19 21:10:54,110][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Checkpoint frequency deviation changed [oldVal=null, newVal=null] [21:10:54] : [Step 4/5] [2021-11-19 21:10:54,635][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][FilePageStoreManager] Cleanup cache stores [total=1, left=0, cleanFiles=false] [21:10:54] : [Step 4/5] [2021-11-19 21:10:54,636][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:10:54] : [Step 4/5] [2021-11-19 21:10:54,637][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:10:54] : [Step 4/5] [2021-11-19 21:10:54,638][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:10:54] : [Step 4/5] [2021-11-19 21:10:54,638][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Data Regions Started: 5 [21:10:54] : [Step 4/5] [2021-11-19 21:10:54,639][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] ^-- sysMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:10:54] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:10:54] : [Step 4/5] ^-- default region [type=default, persistence=true, lazyAlloc=true, [21:10:54] : [Step 4/5] ... initCfg=100MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB, allocTotal=0MB] [21:10:54] : [Step 4/5] ^-- metastoreMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:10:54] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:10:54] : [Step 4/5] ^-- TxLog region [type=internal, persistence=true, lazyAlloc=false, [21:10:54] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:10:54] : [Step 4/5] ^-- volatileDsMemPlc region [type=user, persistence=false, lazyAlloc=true, [21:10:54] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB] [21:10:54] : [Step 4/5] ^-- Ignite persistence [used=0MB] [21:10:54] : [Step 4/5] [21:10:54] : [Step 4/5] [2021-11-19 21:10:54,640][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Starting binary memory restore for: [-2100569601] [21:10:54] : [Step 4/5] [2021-11-19 21:10:54,647][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:10:54] : [Step 4/5] [2021-11-19 21:10:54,647][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:10:54] : [Step 4/5] [2021-11-19 21:10:54,649][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000000.wal, offset=0, ver=2] [21:10:54] : [Step 4/5] [2021-11-19 21:10:54,652][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Started cache in recovery mode [name=ignite-sys-cache, id=-2100569601, dataRegionName=sysMemPlc, mode=REPLICATED, atomicity=TRANSACTIONAL, backups=2147483647, mvcc=false] [21:10:54] : [Step 4/5] [2021-11-19 21:10:54,652][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Binary recovery performed in 12 ms. [21:10:54] : [Step 4/5] [2021-11-19 21:10:54,652][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:10:54] : [Step 4/5] [2021-11-19 21:10:54,653][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Applying lost cache updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:10:54] : [Step 4/5] [2021-11-19 21:10:54,655][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=0 ms] [21:10:54] : [Step 4/5] [2021-11-19 21:10:54,655][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Restoring partition state for local groups. [21:10:54] : [Step 4/5] [2021-11-19 21:10:54,660][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=1, partitionsProcessed=100, time=10ms] [21:10:54] : [Step 4/5] [2021-11-19 21:10:54,792][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][TestTcpDiscoverySpi] Successfully bound to TCP port [port=47500, localHost=localhost/127.0.0.1, locNodeId=00db608c-526f-476a-ba3c-0d39102bb000] [21:10:54] : [Step 4/5] [2021-11-19 21:10:54,802][INFO ][disco-notifier-worker-#21718%grid-0%][MvccProcessorImpl] Assigned mvcc coordinator [crd=MvccCoordinator [topVer=AffinityTopologyVersion [topVer=1, minorTopVer=0], nodeId=00db608c-526f-476a-ba3c-0d39102bb000, ver=1637345454799, local=true, initialized=false]] [21:10:54] : [Step 4/5] [2021-11-19 21:10:54,804][INFO ][sys-#21704%grid-0%][ClusterProcessor] Writing cluster ID and tag to metastorage on ready for write ClusterIdAndTag [id=8f0e39ad-794c-4330-8dee-2e16ff8e3799, tag=laughing_joliot] [21:10:54] : [Step 4/5] [2021-11-19 21:10:54,806][INFO ][disco-notifier-worker-#21718%grid-0%][ClusterProcessor] laughing_joliot [21:10:54] : [Step 4/5] [2021-11-19 21:10:54,807][INFO ][disco-notifier-worker-#21718%grid-0%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustEnabled' was changed from 'null' to 'false' [21:10:54] : [Step 4/5] [2021-11-19 21:10:54,808][INFO ][disco-notifier-worker-#21718%grid-0%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustTimeout' was changed from 'null' to '300000' [21:10:54] : [Step 4/5] [2021-11-19 21:10:54,808][INFO ][disco-notifier-worker-#21718%grid-0%][IgniteTxManager] Transactions parameter 'longOperationsDumpTimeout' was changed from 'null' to '60000' [21:10:54] : [Step 4/5] [2021-11-19 21:10:54,809][INFO ][disco-notifier-worker-#21718%grid-0%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpThreshold' was changed from 'null' to '0' [21:10:54] : [Step 4/5] [2021-11-19 21:10:54,809][INFO ][disco-notifier-worker-#21718%grid-0%][IgniteTxManager] Transactions parameter 'transactionTimeDumpSamplesCoefficient' was changed from 'null' to '0.0' [21:10:54] : [Step 4/5] [2021-11-19 21:10:54,810][INFO ][disco-notifier-worker-#21718%grid-0%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpSamplesPerSecondLimit' was changed from 'null' to '5' [21:10:54] : [Step 4/5] [2021-11-19 21:10:54,810][INFO ][disco-notifier-worker-#21718%grid-0%][IgniteTxManager] Transactions parameter 'collisionsDumpInterval' was changed from 'null' to '1000' [21:10:54] : [Step 4/5] [2021-11-19 21:10:54,811][INFO ][disco-notifier-worker-#21718%grid-0%][IgniteTxManager] Transactions parameter 'txOwnerDumpRequestsAllowed' was changed from 'null' to 'true' [21:10:54] : [Step 4/5] [2021-11-19 21:10:54,811][INFO ][disco-notifier-worker-#21718%grid-0%][GridCacheDatabaseSharedManager] Historical rebalance WAL threshold changed [property=historical.rebalance.threshold, oldVal=null, newVal=500] [21:10:54] : [Step 4/5] [2021-11-19 21:10:54,815][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] To start Console Management & Monitoring run ignitevisorcmd.{sh|bat} [21:10:54] : [Step 4/5] [2021-11-19 21:10:54,816][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] [21:10:54] : [Step 4/5] [21:10:54] : [Step 4/5] >>> +-------------------------------------------+ [21:10:54] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:10:54] : [Step 4/5] >>> +-------------------------------------------+ [21:10:54] : [Step 4/5] >>> OS name: Linux 4.15.0-151-generic amd64 [21:10:54] : [Step 4/5] >>> CPU(s): 24 [21:10:54] : [Step 4/5] >>> Heap: 2.0GB [21:10:54] : [Step 4/5] >>> VM name: 16724@c4dfe9a430b2 [21:10:54] : [Step 4/5] >>> Ignite instance name: grid-0 [21:10:54] : [Step 4/5] >>> Local node [ID=00DB608C-526F-476A-BA3C-0D39102BB000, order=1, clientMode=false] [21:10:54] : [Step 4/5] >>> Local node addresses: [127.0.0.1] [21:10:54] : [Step 4/5] >>> Local ports: TCP:10800 TCP:47100 TCP:47500 [21:10:54] : [Step 4/5] [21:10:54] : [Step 4/5] [2021-11-19 21:10:54,817][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] >>> Ignite cluster is in INACTIVE state (limited functionality available). Use control.(sh|bat) script or IgniteCluster.state(ClusterState.ACTIVE) to change the state. [21:10:54] : [Step 4/5] [2021-11-19 21:10:54,818][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][GridDiscoveryManager] Topology snapshot [ver=1, locNode=00db608c, servers=1, clients=0, state=INACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=00db608c-526f-476a-ba3c-0d39102bb000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:10:54] : [Step 4/5] [2021-11-19 21:10:54,819][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][G] Node started : [stage="Configure system pool" (0 ms),stage="Start managers" (330 ms),stage="Configure binary metadata" (5 ms),stage="Start processors" (668 ms),stage="Start 'StanByClusterTestProvider' plugin" (0 ms),stage="Start 'PageMemory tracker plugin' plugin" (0 ms),stage="Start 'TestDistibutedConfigurationPlugin' plugin" (0 ms),stage="Start 'NodeValidationPluginProvider' plugin" (0 ms),stage="Init metastore" (548 ms),stage="Init and start regions" (4 ms),stage="Restore binary memory" (12 ms),stage="Restore logical state" (7 ms),stage="Finish recovery" (131 ms),stage="Join topology" (10 ms),stage="Await transition" (2 ms),stage="Await exchange" (14 ms),stage="Total time" (1731 ms)] [21:10:54] : [Step 4/5] [2021-11-19 21:10:54,820][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][root] Node started with the following configuration [id=00db608c-526f-476a-ba3c-0d39102bb000, marshaller=BinaryMarshaller [], discovery=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=5000, ackTimeout=5000, marsh=JdkMarshaller [clsFilter=org.apache.ignite.marshaller.MarshallerUtils$1@36525681], reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], binaryCfg=null, lateAff=true] [21:10:54]W: [org.apache.ignite:ignite-core] [2021-11-19 21:10:54,824][WARN ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][G] Ignite work directory is not provided, automatically resolved to: /opt/buildagent/work/7bc1c54bc719b67c/work [21:10:54] : [Step 4/5] [2021-11-19 21:10:54,825][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] [21:10:54] : [Step 4/5] [21:10:54] : [Step 4/5] >>> __________ ________________ [21:10:54] : [Step 4/5] >>> / _/ ___/ |/ / _/_ __/ __/ [21:10:54] : [Step 4/5] >>> _/ // (7 7 // / / / / _/ [21:10:54] : [Step 4/5] >>> /___/\___/_/|_/___/ /_/ /___/ [21:10:54] : [Step 4/5] >>> [21:10:54] : [Step 4/5] >>> ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:10:54] : [Step 4/5] >>> 2021 Copyright(C) Apache Software Foundation [21:10:54] : [Step 4/5] >>> [21:10:54] : [Step 4/5] >>> Ignite documentation: http://ignite.apache.org [21:10:54] : [Step 4/5] [21:10:54] : [Step 4/5] [2021-11-19 21:10:54,826][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] Config URL: n/a [21:10:54] : [Step 4/5] [2021-11-19 21:10:54,826][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] IgniteConfiguration [igniteInstanceName=grid-1, pubPoolSize=24, svcPoolSize=24, callbackPoolSize=24, stripedPoolSize=24, sysPoolSize=24, mgmtPoolSize=4, dataStreamerPoolSize=24, utilityCachePoolSize=24, utilityCacheKeepAliveTime=60000, p2pPoolSize=2, qryPoolSize=24, buildIdxPoolSize=4, igniteHome=/opt/buildagent/work/7bc1c54bc719b67c, igniteWorkDir=/opt/buildagent/work/7bc1c54bc719b67c/work, mbeanSrv=com.sun.jmx.mbeanserver.JmxMBeanServer@6fe85038, nodeId=10f54e13-fcdc-4ff6-8550-968ca8308001, marsh=BinaryMarshaller [], marshLocJobs=false, daemon=false, p2pEnabled=true, netTimeout=10000, netCompressionLevel=1, sndRetryDelay=1000, sndRetryCnt=3, metricsHistSize=10000, metricsUpdateFreq=1000, metricsExpTime=9223372036854775807, discoSpi=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=0, ackTimeout=0, marsh=null, reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], segPlc=STOP, segResolveAttempts=2, waitForSegOnStart=true, allResolversPassReq=true, segChkFreq=10000, commSpi=TcpCommunicationSpi [connectGate=org.apache.ignite.spi.communication.tcp.internal.ConnectGateway@2600f887, ctxInitLatch=java.util.concurrent.CountDownLatch@64b7c40d[Count = 1], stopping=false, clientPool=null, nioSrvWrapper=null, stateProvider=null], evtSpi=MemoryEventStorageSpi [expireAgeMs=9223372036854775807, expireCnt=10000, filter=null], colSpi=NoopCollisionSpi [], deploySpi=LocalDeploymentSpi [], indexingSpi=org.apache.ignite.spi.indexing.noop.NoopIndexingSpi@4f42e80f, addrRslvr=null, encryptionSpi=org.apache.ignite.spi.encryption.keystore.KeystoreEncryptionSpi@6d73c714, tracingSpi=org.apache.ignite.spi.tracing.NoopTracingSpi@fe54594, clientMode=false, rebalanceThreadPoolSize=4, rebalanceTimeout=10000, rebalanceBatchesPrefetchCnt=3, rebalanceThrottle=0, rebalanceBatchSize=524288, txCfg=TransactionConfiguration [txSerEnabled=false, dfltIsolation=REPEATABLE_READ, dfltConcurrency=PESSIMISTIC, dfltTxTimeout=0, txTimeoutOnPartitionMapExchange=0, deadlockTimeout=10000, pessimisticTxLogSize=0, pessimisticTxLogLinger=10000, tmLookupClsName=null, txManagerFactory=null, useJtaSync=false], cacheSanityCheckEnabled=true, discoStartupDelay=60000, deployMode=SHARED, p2pMissedCacheSize=100, locHost=127.0.0.1, timeSrvPortBase=31100, timeSrvPortRange=100, failureDetectionTimeout=10000, sysWorkerBlockedTimeout=null, clientFailureDetectionTimeout=10000, metricsLogFreq=0, connectorCfg=null, odbcCfg=null, warmupClos=null, atomicCfg=AtomicConfiguration [seqReserveSize=1000, cacheMode=PARTITIONED, backups=1, aff=null, grpName=null], classLdr=null, sslCtxFactory=null, platformCfg=null, binaryCfg=null, memCfg=null, pstCfg=null, dsCfg=DataStorageConfiguration [sysRegionInitSize=41943040, sysRegionMaxSize=104857600, pageSize=4096, concLvl=0, dfltDataRegConf=DataRegionConfiguration [name=default, maxSize=104857600, initSize=268435456, swapPath=null, pageEvictionMode=DISABLED, pageReplacementMode=CLOCK, evictionThreshold=0.9, emptyPagesPoolSize=100, metricsEnabled=false, metricsSubIntervalCount=5, metricsRateTimeInterval=60000, persistenceEnabled=true, checkpointPageBufSize=0, lazyMemoryAllocation=true, warmUpCfg=null], dataRegions=null, storagePath=null, checkpointFreq=30000, lockWaitTime=10000, checkpointThreads=4, checkpointWriteOrder=SEQUENTIAL, walHistSize=20, maxWalArchiveSize=20971520, walSegments=10, walSegmentSize=1048576, walPath=db/wal, walArchivePath=db/wal/archive, cdcWalPath=db/wal/cdc, cdcEnabled=false, metricsEnabled=false, walMode=LOG_ONLY, walTlbSize=131072, walBuffSize=0, walFlushFreq=2000, walFsyncDelay=1000, walRecordIterBuffSize=67108864, alwaysWriteFullPages=false, fileIOFactory=org.apache.ignite.internal.processors.cache.persistence.file.AsyncFileIOFactory@772232d1, metricsSubIntervalCnt=5, metricsRateTimeInterval=60000, walAutoArchiveAfterInactivity=-1, walForceArchiveTimeout=-1, writeThrottlingEnabled=false, walCompactionEnabled=false, walCompactionLevel=1, checkpointReadLockTimeout=null, walPageCompression=DISABLED, walPageCompressionLevel=null, dfltWarmUpCfg=null, encCfg=org.apache.ignite.configuration.EncryptionConfiguration@2225bcd2, defragmentationThreadPoolSize=4, minWalArchiveSize=-1], snapshotPath=snapshots, activeOnStart=true, activeOnStartPropSetFlag=false, autoActivation=true, autoActivationPropSetFlag=false, clusterStateOnStart=null, sqlConnCfg=null, cliConnCfg=ClientConnectorConfiguration [host=null, port=10800, portRange=100, sockSndBufSize=0, sockRcvBufSize=0, tcpNoDelay=true, maxOpenCursorsPerConn=128, threadPoolSize=24, selectorCnt=12, idleTimeout=0, handshakeTimeout=10000, jdbcEnabled=true, odbcEnabled=true, thinCliEnabled=true, sslEnabled=false, useIgniteSslCtxFactory=true, sslClientAuth=false, sslCtxFactory=null, thinCliCfg=ThinClientConfiguration [maxActiveTxPerConn=100, maxActiveComputeTasksPerConn=0]], mvccVacuumThreadCnt=2, mvccVacuumFreq=5000, authEnabled=false, failureHnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]], commFailureRslvr=null, sqlCfg=SqlConfiguration [longQryWarnTimeout=3000, dfltQryTimeout=0, sqlQryHistSize=1000, validationEnabled=false], asyncContinuationExecutor=null] [21:10:54] : [Step 4/5] [2021-11-19 21:10:54,834][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] Daemon mode: off [21:10:54] : [Step 4/5] [2021-11-19 21:10:54,835][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] OS: Linux 4.15.0-151-generic amd64 [21:10:54] : [Step 4/5] [2021-11-19 21:10:54,835][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] OS user: teamcity [21:10:54] : [Step 4/5] [2021-11-19 21:10:54,835][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] PID: 16724 [21:10:54] : [Step 4/5] [2021-11-19 21:10:54,835][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] Language runtime: Java Platform API Specification ver. 1.8 [21:10:54] : [Step 4/5] [2021-11-19 21:10:54,836][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] VM information: Java(TM) SE Runtime Environment 1.8.0_261-b12 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 25.261-b12 [21:10:54] : [Step 4/5] [2021-11-19 21:10:54,836][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] VM total memory: 1.9GB [21:10:54] : [Step 4/5] [2021-11-19 21:10:54,836][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] Remote Management [restart: off, REST: off, JMX (remote: off)] [21:10:54] : [Step 4/5] [2021-11-19 21:10:54,836][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] Logger: GridTestLog4jLogger [quiet=false, config=null] [21:10:54] : [Step 4/5] [2021-11-19 21:10:54,837][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] IGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c [21:10:54] : [Step 4/5] [2021-11-19 21:10:54,837][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] VM arguments: [-DIGNITE_DUMP_THREADS_ON_FAILURE=false, -DMono=/usr/bin/mono-sgen, -DMono4.0_x64=/usr/lib/mono/4.0, -DMono4.5_x64=/usr/lib/mono/4.5, -DMonoVersion=6.12.0.90, -DSKIP_BUILD=false, -Dagent.home.dir=/opt/buildagent, -Dagent.name=aitc-lin02_03, -Dagent.ownPort=9090, -Dagent.work.dir=/opt/buildagent/work, -Dbuild.number=95, -Dbuild.vcs.number=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.1=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.GitHubApacheIgnite=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dclassworlds.conf=/opt/buildagent/temp/buildTmp/teamcity.m2.conf, -Dcom.jetbrains.maven.watcher.report.file=/opt/buildagent/temp/buildTmp/maven-build-info.xml, -Djava.io.tmpdir=/opt/buildagent/temp/buildTmp, -Dmaven.home=/opt/buildagent/tools/maven3_6, -Dmaven.multiModuleProjectDirectory=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.agent.cpuBenchmark=457, -Dteamcity.agent.dotnet.agent_url=http://localhost:9090/RPC2, -Dteamcity.agent.dotnet.build_id=6278078, -Dteamcity.auth.password=*******, -Dteamcity.auth.userId=TeamCityBuildId=6278078, -Dteamcity.build.changedFiles.file=/opt/buildagent/temp/buildTmp/changedFiles6342607772318147725.txt, -Dteamcity.build.checkoutDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.build.id=6278078, -Dteamcity.build.properties.file=/opt/buildagent/temp/buildTmp/teamcity.build5164517880467851002.properties, -Dteamcity.build.tempDir=/opt/buildagent/temp/buildTmp, -Dteamcity.build.workingDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.buildConfName=Basic 3, -Dteamcity.buildType.id=IgniteTests24Java8_Basic3, -Dteamcity.configuration.properties.file=/opt/buildagent/temp/buildTmp/teamcity.config5591980786735343870.properties, -Dteamcity.maven.userSettings.path=/opt/buildagent/temp/buildTmp/maven_settings_585072866407032347.xml, -Dteamcity.maven.watcher.home=/opt/buildagent/plugins/mavenPlugin/maven-watcher-jdk16, -Dteamcity.projectName=Ignite Tests 2.x (JDK 8/11), -Dteamcity.runner.properties.file=/opt/buildagent/temp/buildTmp/teamcity.runner9098465561618137420.properties, -Dteamcity.tests.recentlyFailedTests.file=/opt/buildagent/temp/buildTmp/testsToRunFirst3891775683130404069.txt, -Dteamcity.version=2021.2 (build 99542), -ea, -Xms2g, -Xmx2g, -XX:+HeapDumpOnOutOfMemoryError, -DIGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_TEST_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_UPDATE_NOTIFIER=false, -DIGNITE_NO_DISCO_ORDER=true, -DIGNITE_PERFORMANCE_SUGGESTIONS_DISABLED=true, -Djava.net.preferIPv4Stack=true, -DTEST_SCALE_FACTOR=1.0, -DIGNITE_TEST_PROP_LOG4J_FILE=log4j-tc-test.xml, -DIGNITE_QUIET=false, -DIGNITE_MARSHAL_BUFFERS_RECHECK=1000, -Dmaven.repo.local=/opt/buildagent/.m2/repository] [21:10:54] : [Step 4/5] [2021-11-19 21:10:54,842][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] System cache's DataRegion size is configured to 40 MB. Use DataStorageConfiguration.systemRegionInitialSize property to change the setting. [21:10:54] : [Step 4/5] [2021-11-19 21:10:54,842][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] Configured caches [in 'sysMemPlc' dataRegion: ['ignite-sys-cache']] [21:10:54]W: [org.apache.ignite:ignite-core] [2021-11-19 21:10:54,843][WARN ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] Peer class loading is enabled (disable it in production for performance and deployment consistency reasons) [21:10:54] : [Step 4/5] [2021-11-19 21:10:54,843][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] 3-rd party licenses can be found at: /opt/buildagent/work/7bc1c54bc719b67c/libs/licenses [21:10:54] : [Step 4/5] [2021-11-19 21:10:54,847][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] Configured plugins: [21:10:54] : [Step 4/5] [2021-11-19 21:10:54,847][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- StanByClusterTestProvider 1.0 [21:10:54] : [Step 4/5] [2021-11-19 21:10:54,847][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:10:54] : [Step 4/5] [2021-11-19 21:10:54,847][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] [21:10:54] : [Step 4/5] [2021-11-19 21:10:54,848][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- PageMemory tracker plugin 1.0 [21:10:54] : [Step 4/5] [2021-11-19 21:10:54,848][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:10:54] : [Step 4/5] [2021-11-19 21:10:54,848][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] [21:10:54] : [Step 4/5] [2021-11-19 21:10:54,848][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- TestDistibutedConfigurationPlugin 1.0 [21:10:54] : [Step 4/5] [2021-11-19 21:10:54,848][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:10:54] : [Step 4/5] [2021-11-19 21:10:54,848][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] [21:10:54] : [Step 4/5] [2021-11-19 21:10:54,849][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- NodeValidationPluginProvider 1.0 [21:10:54] : [Step 4/5] [2021-11-19 21:10:54,849][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:10:54] : [Step 4/5] [2021-11-19 21:10:54,849][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] [21:10:54] : [Step 4/5] [2021-11-19 21:10:54,849][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][FailureProcessor] Configured failure handler: [hnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]]] [21:10:54] : [Step 4/5] [2021-11-19 21:10:54,860][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][TestRecordingCommunicationSpi] Successfully bound communication NIO server to TCP port [port=47101, locHost=/127.0.0.1, selectorsCnt=12, selectorSpins=0, pairedConn=false] [21:10:54]W: [org.apache.ignite:ignite-core] [2021-11-19 21:10:54,861][WARN ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][TestRecordingCommunicationSpi] Message queue limit is set to 0 which may lead to potential OOMEs when running cache operations in FULL_ASYNC or PRIMARY_SYNC modes due to message queues growth on sender and receiver sides. [21:10:54] : [Step 4/5] [2021-11-19 21:10:54,865][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][GridCollisionManager] Collision resolution is disabled (all jobs will be activated upon arrival). [21:10:54] : [Step 4/5] [2021-11-19 21:10:54,865][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] Security status [authentication=off, sandbox=off, tls/ssl=off] [21:10:54] : [Step 4/5] [2021-11-19 21:10:54,926][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:10:55] : [Step 4/5] [2021-11-19 21:10:54,999][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][MaintenanceProcessor] Resolved store directory for node persistent data: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1 [21:10:55] : [Step 4/5] [2021-11-19 21:10:55,000][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][CacheObjectBinaryProcessorImpl] Resolved directory for serialized binary metadata: /opt/buildagent/work/7bc1c54bc719b67c/work/db/binary_meta/grid_1 [21:10:55] : [Step 4/5] [2021-11-19 21:10:55,004][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1 [21:10:55] : [Step 4/5] [2021-11-19 21:10:55,004][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][FileWriteAheadLogManager] Resolved write ahead log work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1 [21:10:55] : [Step 4/5] [2021-11-19 21:10:55,004][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][FileWriteAheadLogManager] Resolved write ahead log archive directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1 [21:10:55] : [Step 4/5] [2021-11-19 21:10:55,362][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000000.wal [21:10:55] : [Step 4/5] [2021-11-19 21:10:55,362][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][FileHandleManagerImpl] Initialized write-ahead log manager [mode=LOG_ONLY] [21:10:55] : [Step 4/5] [2021-11-19 21:10:55,368][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Configured data regions initialized successfully [total=5] [21:10:55] : [Step 4/5] [2021-11-19 21:10:55,546][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][IgniteSnapshotManager] Resolved snapshot work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/snapshots [21:10:55] : [Step 4/5] [2021-11-19 21:10:55,546][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][IgniteSnapshotManager] Resolved temp directory for snapshot creation: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1/snp [21:10:55] : [Step 4/5] [2021-11-19 21:10:55,548][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][ClientListenerProcessor] Client connector processor has started on TCP port 10801 [21:10:55] : [Step 4/5] [2021-11-19 21:10:55,550][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] Non-loopback local IPs: 172.17.0.4 [21:10:55] : [Step 4/5] [2021-11-19 21:10:55,551][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] Enabled local MACs: 0242AC110004 [21:10:55] : [Step 4/5] [2021-11-19 21:10:55,551][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:10:55] : [Step 4/5] [2021-11-19 21:10:55,552][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:10:55] : [Step 4/5] [2021-11-19 21:10:55,553][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:10:55] : [Step 4/5] [2021-11-19 21:10:55,554][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Applying lost metastore updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:10:55] : [Step 4/5] [2021-11-19 21:10:55,555][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=10 ms] [21:10:55] : [Step 4/5] [2021-11-19 21:10:55,556][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Restoring partition state for local groups. [21:10:55] : [Step 4/5] [2021-11-19 21:10:55,556][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=0, partitionsProcessed=0, time=0ms] [21:10:55] : [Step 4/5] [2021-11-19 21:10:55,557][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][GridEncryptionManager] Encryption keys loaded from metastore. [grps=, masterKeyName=ignite.master.key] [21:10:55] : [Step 4/5] [2021-11-19 21:10:55,558][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][ClusterProcessor] Cluster ID and tag has been read from metastorage: null [21:10:55] : [Step 4/5] [2021-11-19 21:10:55,558][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][IgniteClusterImpl] Shutdown policy was updated [oldVal=null, newVal=null] [21:10:55] : [Step 4/5] [2021-11-19 21:10:55,558][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Checkpoint frequency deviation changed [oldVal=null, newVal=null] [21:10:55] : [Step 4/5] [2021-11-19 21:10:55,568][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][FilePageStoreManager] Cleanup cache stores [total=1, left=0, cleanFiles=false] [21:10:55] : [Step 4/5] [2021-11-19 21:10:55,570][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:10:55] : [Step 4/5] [2021-11-19 21:10:55,571][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:10:55] : [Step 4/5] [2021-11-19 21:10:55,572][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:10:55] : [Step 4/5] [2021-11-19 21:10:55,572][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Data Regions Started: 5 [21:10:55] : [Step 4/5] [2021-11-19 21:10:55,573][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] ^-- sysMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:10:55] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:10:55] : [Step 4/5] ^-- default region [type=default, persistence=true, lazyAlloc=true, [21:10:55] : [Step 4/5] ... initCfg=100MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB, allocTotal=0MB] [21:10:55] : [Step 4/5] ^-- metastoreMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:10:55] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:10:55] : [Step 4/5] ^-- TxLog region [type=internal, persistence=true, lazyAlloc=false, [21:10:55] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:10:55] : [Step 4/5] ^-- volatileDsMemPlc region [type=user, persistence=false, lazyAlloc=true, [21:10:55] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB] [21:10:55] : [Step 4/5] ^-- Ignite persistence [used=0MB] [21:10:55] : [Step 4/5] [21:10:55] : [Step 4/5] [2021-11-19 21:10:55,574][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Starting binary memory restore for: [-2100569601] [21:10:55] : [Step 4/5] [2021-11-19 21:10:55,581][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:10:55] : [Step 4/5] [2021-11-19 21:10:55,582][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:10:55] : [Step 4/5] [2021-11-19 21:10:55,583][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000000.wal, offset=0, ver=2] [21:10:55] : [Step 4/5] [2021-11-19 21:10:55,586][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Started cache in recovery mode [name=ignite-sys-cache, id=-2100569601, dataRegionName=sysMemPlc, mode=REPLICATED, atomicity=TRANSACTIONAL, backups=2147483647, mvcc=false] [21:10:55] : [Step 4/5] [2021-11-19 21:10:55,587][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Binary recovery performed in 13 ms. [21:10:55] : [Step 4/5] [2021-11-19 21:10:55,587][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:10:55] : [Step 4/5] [2021-11-19 21:10:55,587][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Applying lost cache updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:10:55] : [Step 4/5] [2021-11-19 21:10:55,589][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=0 ms] [21:10:55] : [Step 4/5] [2021-11-19 21:10:55,589][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Restoring partition state for local groups. [21:10:55] : [Step 4/5] [2021-11-19 21:10:55,593][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=1, partitionsProcessed=100, time=0ms] [21:10:55] : [Step 4/5] [2021-11-19 21:10:55,606][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][TestTcpDiscoverySpi] Successfully bound to TCP port [port=47501, localHost=localhost/127.0.0.1, locNodeId=10f54e13-fcdc-4ff6-8550-968ca8308001] [21:10:55] : [Step 4/5] [2021-11-19 21:10:55,609][INFO ][tcp-disco-srvr-[:47500]-#1139%grid-0%-#21720%grid-0%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=52943] [21:10:55] : [Step 4/5] [2021-11-19 21:10:55,610][INFO ][tcp-disco-srvr-[:47500]-#1139%grid-0%-#21720%grid-0%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=52943] [21:10:55] : [Step 4/5] [2021-11-19 21:10:55,610][INFO ][tcp-disco-sock-reader-[]-#1145%grid-0%-#21840%grid-0%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:52943, rmtPort=52943] [21:10:55] : [Step 4/5] [2021-11-19 21:10:55,611][INFO ][tcp-disco-sock-reader-[10f54e13 127.0.0.1:52943]-#1145%grid-0%-#21840%grid-0%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=10f54e13-fcdc-4ff6-8550-968ca8308001, rmtAddr=/127.0.0.1:52943] [21:10:55] : [Step 4/5] [2021-11-19 21:10:55,617][INFO ][tcp-disco-srvr-[:47501]-#1144%grid-1%-#21839%grid-1%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=56533] [21:10:55] : [Step 4/5] [2021-11-19 21:10:55,617][INFO ][tcp-disco-srvr-[:47501]-#1144%grid-1%-#21839%grid-1%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=56533] [21:10:55] : [Step 4/5] [2021-11-19 21:10:55,617][INFO ][tcp-disco-sock-reader-[]-#1146%grid-1%-#21841%grid-1%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:56533, rmtPort=56533] [21:10:55] : [Step 4/5] [2021-11-19 21:10:55,618][INFO ][tcp-disco-sock-reader-[]-#1146%grid-1%-#21841%grid-1%][TestTcpDiscoverySpi] Received ping request from the remote node [rmtNodeId=00db608c-526f-476a-ba3c-0d39102bb000, rmtAddr=/127.0.0.1:56533, rmtPort=56533] [21:10:55] : [Step 4/5] [2021-11-19 21:10:55,619][INFO ][tcp-disco-sock-reader-[]-#1146%grid-1%-#21841%grid-1%][TestTcpDiscoverySpi] Finished writing ping response [rmtNodeId=00db608c-526f-476a-ba3c-0d39102bb000, rmtAddr=/127.0.0.1:56533, rmtPort=56533] [21:10:55] : [Step 4/5] [2021-11-19 21:10:55,619][INFO ][tcp-disco-sock-reader-[10f54e13 127.0.0.1:52943]-#1145%grid-0%-#21840%grid-0%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:52943, rmtPort=52943, rmtNodeId=10f54e13-fcdc-4ff6-8550-968ca8308001] [21:10:55]W: [org.apache.ignite:ignite-core] [2021-11-19 21:10:55,619][WARN ][tcp-disco-sock-reader-[]-#1146%grid-1%-#21841%grid-1%][TestTcpDiscoverySpi] Failed to shutdown socket [21:10:55]W: [org.apache.ignite:ignite-core] java.net.SocketException: Socket output is already shutdown [21:10:55]W: [org.apache.ignite:ignite-core] at java.net.Socket.shutdownOutput(Socket.java:1572) [21:10:55]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.close(IgniteUtils.java:4247) [21:10:55]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.discovery.tcp.ServerImpl$SocketReader.body(ServerImpl.java:7370) [21:10:55] : [Step 4/5] [2021-11-19 21:10:55,623][INFO ][tcp-disco-sock-reader-[]-#1146%grid-1%-#21841%grid-1%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:56533, rmtPort=56533, rmtNodeId=null] [21:10:55]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.IgniteSpiThread.run(IgniteSpiThread.java:58) [21:10:55] : [Step 4/5] [2021-11-19 21:10:55,623][INFO ][tcp-disco-msg-worker-[crd]-#1138%grid-0%-#21719%grid-0%][GridEncryptionManager] Joining node doesn't have stored group keys [node=10f54e13-fcdc-4ff6-8550-968ca8308001] [21:10:55] : [Step 4/5] [2021-11-19 21:10:55,635][INFO ][tcp-disco-msg-worker-[crd]-#1138%grid-0%-#21719%grid-0%][TestTcpDiscoverySpi] New next node [newNext=TcpDiscoveryNode [id=10f54e13-fcdc-4ff6-8550-968ca8308001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=0, intOrder=2, lastExchangeTime=1637345455606, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false]] [21:10:55] : [Step 4/5] [2021-11-19 21:10:55,636][INFO ][tcp-disco-srvr-[:47501]-#1144%grid-1%-#21839%grid-1%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=53531] [21:10:55] : [Step 4/5] [2021-11-19 21:10:55,637][INFO ][tcp-disco-srvr-[:47501]-#1144%grid-1%-#21839%grid-1%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=53531] [21:10:55] : [Step 4/5] [2021-11-19 21:10:55,637][INFO ][tcp-disco-sock-reader-[]-#1147%grid-1%-#21842%grid-1%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:53531, rmtPort=53531] [21:10:55] : [Step 4/5] [2021-11-19 21:10:55,638][INFO ][tcp-disco-sock-reader-[00db608c 127.0.0.1:53531]-#1147%grid-1%-#21842%grid-1%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=00db608c-526f-476a-ba3c-0d39102bb000, rmtAddr=/127.0.0.1:53531] [21:10:55] : [Step 4/5] [2021-11-19 21:10:55,641][INFO ][tcp-disco-msg-worker-[]-#1143%grid-1%-#21838%grid-1%][TestTcpDiscoverySpi] New next node [newNext=TcpDiscoveryNode [id=00db608c-526f-476a-ba3c-0d39102bb000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345455636, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false]] [21:10:55] : [Step 4/5] [2021-11-19 21:10:55,642][INFO ][tcp-disco-srvr-[:47500]-#1139%grid-0%-#21720%grid-0%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=46115] [21:10:55] : [Step 4/5] [2021-11-19 21:10:55,642][INFO ][tcp-disco-srvr-[:47500]-#1139%grid-0%-#21720%grid-0%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=46115] [21:10:55] : [Step 4/5] [2021-11-19 21:10:55,643][INFO ][tcp-disco-sock-reader-[]-#1148%grid-0%-#21843%grid-0%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:46115, rmtPort=46115] [21:10:55] : [Step 4/5] [2021-11-19 21:10:55,644][INFO ][tcp-disco-sock-reader-[10f54e13 127.0.0.1:46115]-#1148%grid-0%-#21843%grid-0%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=10f54e13-fcdc-4ff6-8550-968ca8308001, rmtAddr=/127.0.0.1:46115] [21:10:55] : [Step 4/5] [2021-11-19 21:10:55,646][INFO ][disco-event-worker-#21722%grid-0%][GridDiscoveryManager] Added new node to topology: TcpDiscoveryNode [id=10f54e13-fcdc-4ff6-8550-968ca8308001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637345455606, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false] [21:10:55] : [Step 4/5] [2021-11-19 21:10:55,647][INFO ][disco-event-worker-#21722%grid-0%][GridDiscoveryManager] Topology snapshot [ver=2, locNode=00db608c, servers=2, clients=0, state=INACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=00db608c-526f-476a-ba3c-0d39102bb000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=10f54e13-fcdc-4ff6-8550-968ca8308001, consistentId=grid-1, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:10:55] : [Step 4/5] [2021-11-19 21:10:55,649][INFO ][tcp-disco-msg-worker-[00db608c 127.0.0.1:47500]-#1143%grid-1%-#21838%grid-1%][ClusterProcessor] laughing_joliot [21:10:55] : [Step 4/5] [2021-11-19 21:10:55,649][INFO ][tcp-disco-msg-worker-[00db608c 127.0.0.1:47500]-#1143%grid-1%-#21838%grid-1%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustEnabled' was changed from 'null' to 'false' [21:10:55] : [Step 4/5] [2021-11-19 21:10:55,649][INFO ][tcp-disco-msg-worker-[00db608c 127.0.0.1:47500]-#1143%grid-1%-#21838%grid-1%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustTimeout' was changed from 'null' to '300000' [21:10:55] : [Step 4/5] [2021-11-19 21:10:55,650][INFO ][tcp-disco-msg-worker-[00db608c 127.0.0.1:47500]-#1143%grid-1%-#21838%grid-1%][IgniteTxManager] Transactions parameter 'longOperationsDumpTimeout' was changed from 'null' to '60000' [21:10:55] : [Step 4/5] [2021-11-19 21:10:55,650][INFO ][tcp-disco-msg-worker-[00db608c 127.0.0.1:47500]-#1143%grid-1%-#21838%grid-1%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpThreshold' was changed from 'null' to '0' [21:10:55] : [Step 4/5] [2021-11-19 21:10:55,650][INFO ][tcp-disco-msg-worker-[00db608c 127.0.0.1:47500]-#1143%grid-1%-#21838%grid-1%][IgniteTxManager] Transactions parameter 'transactionTimeDumpSamplesCoefficient' was changed from 'null' to '0.0' [21:10:55] : [Step 4/5] [2021-11-19 21:10:55,651][INFO ][tcp-disco-msg-worker-[00db608c 127.0.0.1:47500]-#1143%grid-1%-#21838%grid-1%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpSamplesPerSecondLimit' was changed from 'null' to '5' [21:10:55] : [Step 4/5] [2021-11-19 21:10:55,651][INFO ][tcp-disco-msg-worker-[00db608c 127.0.0.1:47500]-#1143%grid-1%-#21838%grid-1%][IgniteTxManager] Transactions parameter 'collisionsDumpInterval' was changed from 'null' to '1000' [21:10:55] : [Step 4/5] [2021-11-19 21:10:55,651][INFO ][tcp-disco-msg-worker-[00db608c 127.0.0.1:47500]-#1143%grid-1%-#21838%grid-1%][IgniteTxManager] Transactions parameter 'txOwnerDumpRequestsAllowed' was changed from 'null' to 'true' [21:10:55] : [Step 4/5] [2021-11-19 21:10:55,652][INFO ][tcp-disco-msg-worker-[00db608c 127.0.0.1:47500]-#1143%grid-1%-#21838%grid-1%][GridCacheDatabaseSharedManager] Historical rebalance WAL threshold changed [property=historical.rebalance.threshold, oldVal=null, newVal=500] [21:10:55] : [Step 4/5] [2021-11-19 21:10:55,652][INFO ][disco-notifier-worker-#21837%grid-1%][MvccProcessorImpl] Assigned mvcc coordinator [crd=MvccCoordinator [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=0], nodeId=00db608c-526f-476a-ba3c-0d39102bb000, ver=1637345454799, local=false, initialized=false]] [21:10:55] : [Step 4/5] [2021-11-19 21:10:55,654][INFO ][sys-#21816%grid-1%][ClusterProcessor] Writing cluster ID and tag to metastorage on ready for write ClusterIdAndTag [id=8f0e39ad-794c-4330-8dee-2e16ff8e3799, tag=laughing_joliot] [21:10:55] : [Step 4/5] [2021-11-19 21:10:55,664][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] To start Console Management & Monitoring run ignitevisorcmd.{sh|bat} [21:10:55] : [Step 4/5] [2021-11-19 21:10:55,665][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] [21:10:55] : [Step 4/5] [21:10:55] : [Step 4/5] >>> +-------------------------------------------+ [21:10:55] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:10:55] : [Step 4/5] >>> +-------------------------------------------+ [21:10:55] : [Step 4/5] >>> OS name: Linux 4.15.0-151-generic amd64 [21:10:55] : [Step 4/5] >>> CPU(s): 24 [21:10:55] : [Step 4/5] >>> Heap: 2.0GB [21:10:55] : [Step 4/5] >>> VM name: 16724@c4dfe9a430b2 [21:10:55] : [Step 4/5] >>> Ignite instance name: grid-1 [21:10:55] : [Step 4/5] >>> Local node [ID=10F54E13-FCDC-4FF6-8550-968CA8308001, order=2, clientMode=false] [21:10:55] : [Step 4/5] >>> Local node addresses: [127.0.0.1] [21:10:55] : [Step 4/5] >>> Local ports: TCP:10801 TCP:47101 TCP:47501 [21:10:55] : [Step 4/5] [21:10:55] : [Step 4/5] [2021-11-19 21:10:55,665][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] >>> Ignite cluster is in INACTIVE state (limited functionality available). Use control.(sh|bat) script or IgniteCluster.state(ClusterState.ACTIVE) to change the state. [21:10:55] : [Step 4/5] [2021-11-19 21:10:55,666][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][GridDiscoveryManager] Topology snapshot [ver=2, locNode=10f54e13, servers=2, clients=0, state=INACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=00db608c-526f-476a-ba3c-0d39102bb000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=10f54e13-fcdc-4ff6-8550-968ca8308001, consistentId=grid-1, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:10:55] : [Step 4/5] [2021-11-19 21:10:55,667][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][G] Node started : [stage="Configure system pool" (0 ms),stage="Start managers" (175 ms),stage="Configure binary metadata" (1 ms),stage="Start processors" (548 ms),stage="Start 'StanByClusterTestProvider' plugin" (0 ms),stage="Start 'PageMemory tracker plugin' plugin" (0 ms),stage="Start 'TestDistibutedConfigurationPlugin' plugin" (0 ms),stage="Start 'NodeValidationPluginProvider' plugin" (0 ms),stage="Init metastore" (18 ms),stage="Init and start regions" (6 ms),stage="Restore binary memory" (12 ms),stage="Restore logical state" (6 ms),stage="Finish recovery" (11 ms),stage="Join topology" (47 ms),stage="Await transition" (2 ms),stage="Await exchange" (11 ms),stage="Total time" (837 ms)] [21:10:55] : [Step 4/5] [2021-11-19 21:10:55,668][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][root] Node started with the following configuration [id=10f54e13-fcdc-4ff6-8550-968ca8308001, marshaller=BinaryMarshaller [], discovery=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=5000, ackTimeout=5000, marsh=JdkMarshaller [clsFilter=org.apache.ignite.marshaller.MarshallerUtils$1@46286b63], reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], binaryCfg=null, lateAff=true] [21:10:55] : [Step 4/5] [2021-11-19 21:10:55,669][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][GridClusterStateProcessor] Sending activate cluster request with BaselineTopology BaselineTopology [id=0, branchingHash=-2475315501, branchingType='New BaselineTopology', baselineNodes=[grid-1, grid-0]] [21:10:55] : [Step 4/5] [2021-11-19 21:10:55,673][INFO ][disco-notifier-worker-#21718%grid-0%][GridClusterStateProcessor] Received activate cluster request with BaselineTopology[id=0] initiator node ID: 00db608c-526f-476a-ba3c-0d39102bb000 [21:10:55] : [Step 4/5] [2021-11-19 21:10:55,673][INFO ][disco-notifier-worker-#21718%grid-0%][GridClusterStateProcessor] Started state transition: activate cluster [21:10:55] : [Step 4/5] [2021-11-19 21:10:55,674][INFO ][exchange-worker-#21723%grid-0%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], crd=true, evt=DISCOVERY_CUSTOM_EVT, evtNode=00db608c-526f-476a-ba3c-0d39102bb000, customEvt=ChangeGlobalStateMessage [id=7258d593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqId=89c24e4e-1dc0-4187-9059-82b4949db24a, initiatingNodeId=00db608c-526f-476a-ba3c-0d39102bb000, state=ACTIVE, baselineTopology=BaselineTopology [id=0, branchingHash=-2475315501, branchingType='New BaselineTopology', baselineNodes=[grid-1, grid-0]], forceChangeBaselineTopology=false, timestamp=1637345455669, forceDeactivation=true], allowMerge=false, exchangeFreeSwitch=false] [21:10:55] : [Step 4/5] [2021-11-19 21:10:55,674][INFO ][disco-notifier-worker-#21837%grid-1%][GridClusterStateProcessor] Received activate cluster request with BaselineTopology[id=0] initiator node ID: 00db608c-526f-476a-ba3c-0d39102bb000 [21:10:55] : [Step 4/5] [2021-11-19 21:10:55,675][INFO ][exchange-worker-#21723%grid-0%][GridDhtPartitionsExchangeFuture] Start activation process [nodeId=00db608c-526f-476a-ba3c-0d39102bb000, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]]. New state: ACTIVE [21:10:55] : [Step 4/5] [2021-11-19 21:10:55,676][INFO ][disco-notifier-worker-#21837%grid-1%][GridClusterStateProcessor] Started state transition: activate cluster [21:10:55] : [Step 4/5] [2021-11-19 21:10:55,676][INFO ][exchange-worker-#21723%grid-0%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0 [21:10:55] : [Step 4/5] [2021-11-19 21:10:55,677][INFO ][exchange-worker-#21846%grid-1%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], crd=false, evt=DISCOVERY_CUSTOM_EVT, evtNode=00db608c-526f-476a-ba3c-0d39102bb000, customEvt=ChangeGlobalStateMessage [id=7258d593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqId=89c24e4e-1dc0-4187-9059-82b4949db24a, initiatingNodeId=00db608c-526f-476a-ba3c-0d39102bb000, state=ACTIVE, baselineTopology=BaselineTopology [id=0, branchingHash=-2475315501, branchingType='New BaselineTopology', baselineNodes=[grid-1, grid-0]], forceChangeBaselineTopology=false, timestamp=1637345455669, forceDeactivation=true], allowMerge=false, exchangeFreeSwitch=false] [21:10:55] : [Step 4/5] [2021-11-19 21:10:55,679][INFO ][exchange-worker-#21723%grid-0%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000000.wal, offset=8795, ver=2] [21:10:55] : [Step 4/5] [2021-11-19 21:10:55,679][INFO ][exchange-worker-#21846%grid-1%][GridDhtPartitionsExchangeFuture] Start activation process [nodeId=10f54e13-fcdc-4ff6-8550-968ca8308001, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]]. New state: ACTIVE [21:10:55] : [Step 4/5] [2021-11-19 21:10:55,680][INFO ][exchange-worker-#21723%grid-0%][GridClusterStateProcessor] Writing BaselineTopology[id=0] [21:10:55] : [Step 4/5] [2021-11-19 21:10:55,680][INFO ][exchange-worker-#21846%grid-1%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1 [21:10:55] : [Step 4/5] [2021-11-19 21:10:55,683][INFO ][exchange-worker-#21723%grid-0%][GridCacheDatabaseSharedManager] Finish recovery performed in 6 ms. [21:10:55] : [Step 4/5] [2021-11-19 21:10:55,690][INFO ][exchange-worker-#21723%grid-0%][msg] Components activation performed in 14 ms. [21:10:55] : [Step 4/5] [2021-11-19 21:10:55,690][INFO ][exchange-worker-#21846%grid-1%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000000.wal, offset=8795, ver=2] [21:10:55] : [Step 4/5] [2021-11-19 21:10:55,690][INFO ][exchange-worker-#21723%grid-0%][GridCacheProcessor] Finished recovery for cache [cache=ignite-sys-cache, grp=ignite-sys-cache, startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:10:55] : [Step 4/5] [2021-11-19 21:10:55,691][INFO ][exchange-worker-#21846%grid-1%][GridClusterStateProcessor] Writing BaselineTopology[id=0] [21:10:55] : [Step 4/5] [2021-11-19 21:10:55,692][INFO ][exchange-worker-#21723%grid-0%][GridDhtPartitionsExchangeFuture] Successfully activated caches [nodeId=00db608c-526f-476a-ba3c-0d39102bb000, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], newState=ACTIVE] [21:10:55] : [Step 4/5] [2021-11-19 21:10:55,693][INFO ][exchange-worker-#21723%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:10:55] : [Step 4/5] [2021-11-19 21:10:55,696][INFO ][exchange-worker-#21846%grid-1%][GridCacheDatabaseSharedManager] Finish recovery performed in 14 ms. [21:10:55] : [Step 4/5] [2021-11-19 21:10:55,697][INFO ][exchange-worker-#21846%grid-1%][msg] Components activation performed in 17 ms. [21:10:55] : [Step 4/5] [2021-11-19 21:10:55,698][INFO ][exchange-worker-#21846%grid-1%][GridCacheProcessor] Finished recovery for cache [cache=ignite-sys-cache, grp=ignite-sys-cache, startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:10:55] : [Step 4/5] [2021-11-19 21:10:55,698][INFO ][exchange-worker-#21846%grid-1%][GridDhtPartitionsExchangeFuture] Successfully activated caches [nodeId=10f54e13-fcdc-4ff6-8550-968ca8308001, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], newState=ACTIVE] [21:10:55] : [Step 4/5] [2021-11-19 21:10:55,699][INFO ][exchange-worker-#21846%grid-1%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:10:55] : [Step 4/5] [2021-11-19 21:10:55,782][INFO ][exchange-worker-#21723%grid-0%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], crd=true] [21:10:55] : [Step 4/5] [2021-11-19 21:10:55,789][INFO ][grid-nio-worker-tcp-comm-0-#21661%TestRecordingCommunicationSpi%][TestRecordingCommunicationSpi] Accepted incoming communication connection [locAddr=/127.0.0.1:47100, rmtAddr=/127.0.0.1:33420] [21:10:55] : [Step 4/5] [2021-11-19 21:10:55,791][INFO ][grid-nio-worker-tcp-comm-0-#21780%TestRecordingCommunicationSpi%][TestRecordingCommunicationSpi] Established outgoing communication connection [locAddr=/127.0.0.1:33420, rmtAddr=/127.0.0.1:47100] [21:10:55] : [Step 4/5] [2021-11-19 21:10:55,791][INFO ][exchange-worker-#21846%grid-1%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], crd=false] [21:10:55] : [Step 4/5] [2021-11-19 21:10:55,792][INFO ][sys-#21709%grid-0%][GridDhtPartitionsExchangeFuture] Coordinator received single message [ver=AffinityTopologyVersion [topVer=2, minorTopVer=1], node=10f54e13-fcdc-4ff6-8550-968ca8308001, allReceived=true] [21:10:55] : [Step 4/5] [2021-11-19 21:10:55,793][INFO ][sys-#21709%grid-0%][GridDhtPartitionsExchangeFuture] finishExchangeOnCoordinator [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:10:55] : [Step 4/5] [2021-11-19 21:10:55,797][INFO ][sys-#21709%grid-0%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], err=null, rebalanced=true, wasRebalanced=false] [21:10:55] : [Step 4/5] [2021-11-19 21:10:55,798][INFO ][disco-notifier-worker-#21837%grid-1%][GridClusterStateProcessor] Received state change finish message: ACTIVE [21:10:55] : [Step 4/5] [2021-11-19 21:10:55,798][INFO ][sys-#21817%grid-1%][GridDhtPartitionsExchangeFuture] Received full message, will finish exchange [node=00db608c-526f-476a-ba3c-0d39102bb000, resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:10:55] : [Step 4/5] [2021-11-19 21:10:55,797][INFO ][disco-notifier-worker-#21718%grid-0%][GridClusterStateProcessor] Received state change finish message: ACTIVE [21:10:55] : [Step 4/5] [2021-11-19 21:10:55,801][INFO ][sys-#21826%grid-1%][GridCachePartitionExchangeManager] Delay process full message without exchange id (there is exchange in progress) [nodeId=00db608c-526f-476a-ba3c-0d39102bb000] [21:10:55] : [Step 4/5] [2021-11-19 21:10:55,800][INFO ][sys-#21709%grid-0%][GridCacheProcessor] Finish proxy initialization, cacheName=ignite-sys-cache, localNodeId=00db608c-526f-476a-ba3c-0d39102bb000 [21:10:55] : [Step 4/5] [2021-11-19 21:10:55,799][INFO ][disco-notifier-worker-#21837%grid-1%][GridClusterStateProcessor] Cluster state was changed from INACTIVE to ACTIVE [21:10:55] : [Step 4/5] [2021-11-19 21:10:55,802][INFO ][sys-#21709%grid-0%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=00db608c-526f-476a-ba3c-0d39102bb000, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=00db608c-526f-476a-ba3c-0d39102bb000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345455798, loc=true, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:10:55] : [Step 4/5] [2021-11-19 21:10:55,802][INFO ][sys-#21709%grid-0%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (1 ms), stage="Update caches registry" (15 ms), stage="Start caches" (1 ms), stage="Affinity initialization on cache group start" (0 ms), stage="Determine exchange type" (1 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Restore partition states" (0 ms), stage="After states restored callback" (88 ms), stage="WAL history reservation" (0 ms), stage="Waiting for all single messages" (10 ms), stage="Affinity recalculation (crd)" (0 ms), stage="Collect update counters and create affinity messages" (0 ms), stage="Assign partitions states" (0 ms), stage="Validate partitions states" (0 ms), stage="Ideal affinity diff calculation (enforced)" (0 ms), stage="Apply update counters" (0 ms), stage="Full message preparing" (2 ms), stage="Full message sending" (0 ms), stage="State finish message sending" (0 ms), stage="Detect lost partitions" (2 ms), stage="Exchange done" (2 ms), stage="Total time" (122 ms), Discovery lag=2 ms, Latest started node id=10f54e13-fcdc-4ff6-8550-968ca8308001] [21:10:55] : [Step 4/5] [2021-11-19 21:10:55,804][INFO ][sys-#21709%grid-0%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], stage="Affinity initialization on cache group start [grp=ignite-sys-cache]" (0 ms) (parent=Affinity initialization on cache group start), stage="Affinity centralized initialization (crd) [grp=ignite-sys-cache, crd=true]" (0 ms) (parent=Determine exchange type), stage="Restore partition states [grp=ignite-sys-cache]" (0 ms) (parent=Restore partition states), stage="Affinity recalculation (partitions availability) [grp=ignite-sys-cache]" (0 ms) (parent=Ideal affinity diff calculation (enforced))] [21:10:55] : [Step 4/5] [2021-11-19 21:10:55,801][INFO ][sys-#21702%grid-0%][DistributedBaselineConfiguration] Baseline auto-adjust is 'disabled' with timeout='300000' ms [21:10:55] : [Step 4/5] [2021-11-19 21:10:55,801][INFO ][exchange-worker-#21723%grid-0%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=2, minorTopVer=1], force=false, evt=DISCOVERY_CUSTOM_EVT, node=00db608c-526f-476a-ba3c-0d39102bb000] [21:10:55] : [Step 4/5] [2021-11-19 21:10:55,801][INFO ][sys-#21817%grid-1%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], err=null, rebalanced=true, wasRebalanced=false] [21:10:55] : [Step 4/5] [2021-11-19 21:10:55,801][INFO ][disco-notifier-worker-#21718%grid-0%][GridClusterStateProcessor] Cluster state was changed from INACTIVE to ACTIVE [21:10:55] : [Step 4/5] [2021-11-19 21:10:55,805][INFO ][sys-#21702%grid-0%][GridClusterStateProcessor] Successfully performed final activation steps [nodeId=00db608c-526f-476a-ba3c-0d39102bb000, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:10:55] : [Step 4/5] [2021-11-19 21:10:55,808][INFO ][sys-#21817%grid-1%][GridCacheProcessor] Finish proxy initialization, cacheName=ignite-sys-cache, localNodeId=10f54e13-fcdc-4ff6-8550-968ca8308001 [21:10:55] : [Step 4/5] [2021-11-19 21:10:55,809][INFO ][sys-#21830%grid-1%][DistributedBaselineConfiguration] Baseline auto-adjust is 'disabled' with timeout='300000' ms [21:10:55] : [Step 4/5] [2021-11-19 21:10:55,809][INFO ][sys-#21830%grid-1%][GridClusterStateProcessor] Successfully performed final activation steps [nodeId=10f54e13-fcdc-4ff6-8550-968ca8308001, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:10:55] : [Step 4/5] [2021-11-19 21:10:55,809][INFO ][exchange-worker-#21846%grid-1%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=2, minorTopVer=1], force=false, evt=DISCOVERY_CUSTOM_EVT, node=00db608c-526f-476a-ba3c-0d39102bb000] [21:10:55] : [Step 4/5] [2021-11-19 21:10:55,809][INFO ][sys-#21817%grid-1%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=10f54e13-fcdc-4ff6-8550-968ca8308001, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=00db608c-526f-476a-ba3c-0d39102bb000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345455636, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:10:55] : [Step 4/5] [2021-11-19 21:10:55,811][INFO ][sys-#21817%grid-1%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (2 ms), stage="Update caches registry" (18 ms), stage="Start caches" (0 ms), stage="Affinity initialization on cache group start" (0 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Restore partition states" (0 ms), stage="After states restored callback" (86 ms), stage="WAL history reservation" (0 ms), stage="Waiting for Full message" (11 ms), stage="Affinity recalculation" (1 ms), stage="Full map updating" (0 ms), stage="Detect lost partitions" (6 ms), stage="Exchange done" (3 ms), stage="Total time" (127 ms)] [21:10:55] : [Step 4/5] [2021-11-19 21:10:55,813][INFO ][sys-#21817%grid-1%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], stage="Affinity initialization on cache group start [grp=ignite-sys-cache]" (0 ms) (parent=Affinity initialization on cache group start), stage="Affinity centralized initialization (crd) [grp=ignite-sys-cache, crd=false]" (0 ms) (parent=Determine exchange type), stage="Restore partition states [grp=ignite-sys-cache]" (0 ms) (parent=Restore partition states), stage="Affinity applying from full message [grp=ignite-sys-cache]" (1 ms) (parent=Affinity recalculation)] [21:10:55] : [Step 4/5] [2021-11-19 21:10:55,814][INFO ][exchange-worker-#21723%grid-0%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], crd=true, evt=DISCOVERY_CUSTOM_EVT, evtNode=00db608c-526f-476a-ba3c-0d39102bb000, customEvt=DynamicCacheChangeBatch [id=3558d593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqs=ArrayList [DynamicCacheChangeRequest [cacheName=encrypted, hasCfg=true, nodeId=00db608c-526f-476a-ba3c-0d39102bb000, clientStartOnly=false, stop=false, destroy=false, disabledAfterStart=false]], exchangeActions=ExchangeActions [startCaches=[encrypted], stopCaches=null, startGrps=[encrypted], stopGrps=[], resetParts=null, stateChangeRequest=null], startCaches=false], allowMerge=false, exchangeFreeSwitch=false] [21:10:55] : [Step 4/5] [2021-11-19 21:10:55,814][INFO ][exchange-worker-#21846%grid-1%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], crd=false, evt=DISCOVERY_CUSTOM_EVT, evtNode=00db608c-526f-476a-ba3c-0d39102bb000, customEvt=DynamicCacheChangeBatch [id=3558d593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqs=ArrayList [DynamicCacheChangeRequest [cacheName=encrypted, hasCfg=true, nodeId=00db608c-526f-476a-ba3c-0d39102bb000, clientStartOnly=false, stop=false, destroy=false, disabledAfterStart=false]], exchangeActions=ExchangeActions [startCaches=[encrypted], stopCaches=null, startGrps=[encrypted], stopGrps=[], resetParts=null, stateChangeRequest=null], startCaches=false], allowMerge=false, exchangeFreeSwitch=false] [21:10:55] : [Step 4/5] [2021-11-19 21:10:55,816][INFO ][exchange-worker-#21723%grid-0%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:10:55] : [Step 4/5] [2021-11-19 21:10:55,817][INFO ][exchange-worker-#21846%grid-1%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:10:55] : [Step 4/5] [2021-11-19 21:10:55,820][INFO ][exchange-worker-#21723%grid-0%][GridCacheProcessor] Started cache [name=encrypted, id=1613773252, dataRegionName=default, mode=PARTITIONED, atomicity=ATOMIC, backups=0, mvcc=false] [21:10:55] : [Step 4/5] [2021-11-19 21:10:55,822][INFO ][exchange-worker-#21723%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], waitTime=0ms, futInfo=NA, mode=DISTRIBUTED] [21:10:55] : [Step 4/5] [2021-11-19 21:10:55,823][INFO ][exchange-worker-#21846%grid-1%][GridCacheProcessor] Started cache [name=encrypted, id=1613773252, dataRegionName=default, mode=PARTITIONED, atomicity=ATOMIC, backups=0, mvcc=false] [21:10:55] : [Step 4/5] [2021-11-19 21:10:55,824][INFO ][exchange-worker-#21846%grid-1%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], waitTime=0ms, futInfo=NA, mode=DISTRIBUTED] [21:10:55] : [Step 4/5] [2021-11-19 21:10:55,825][INFO ][exchange-worker-#21723%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partitions release latch: ServerLatch [permits=0, pendingAcks=HashSet [], super=CompletableLatch [id=CompletableLatchUid [id=exchange, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2]]]] [21:10:55] : [Step 4/5] [2021-11-19 21:10:55,825][INFO ][exchange-worker-#21846%grid-1%][GridDhtPartitionsExchangeFuture] Finished waiting for partitions release latch: ClientLatch [coordinator=TcpDiscoveryNode [id=00db608c-526f-476a-ba3c-0d39102bb000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345455636, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], ackSent=true, super=CompletableLatch [id=CompletableLatchUid [id=exchange, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2]]]] [21:10:55] : [Step 4/5] [2021-11-19 21:10:55,826][INFO ][exchange-worker-#21846%grid-1%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:10:55] : [Step 4/5] [2021-11-19 21:10:55,825][INFO ][exchange-worker-#21723%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:10:55] : [Step 4/5] [2021-11-19 21:10:55,827][INFO ][exchange-worker-#21723%grid-0%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], crd=true] [21:10:55] : [Step 4/5] [2021-11-19 21:10:55,828][INFO ][exchange-worker-#21846%grid-1%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], crd=false] [21:10:55] : [Step 4/5] [2021-11-19 21:10:55,828][INFO ][sys-#21695%grid-0%][GridDhtPartitionsExchangeFuture] Coordinator received single message [ver=AffinityTopologyVersion [topVer=2, minorTopVer=2], node=10f54e13-fcdc-4ff6-8550-968ca8308001, allReceived=true] [21:10:55] : [Step 4/5] [2021-11-19 21:10:55,828][INFO ][sys-#21695%grid-0%][GridDhtPartitionsExchangeFuture] finishExchangeOnCoordinator [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2]] [21:10:55] : [Step 4/5] [2021-11-19 21:10:55,830][INFO ][sys-#21695%grid-0%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], err=null, rebalanced=true, wasRebalanced=true] [21:10:55] : [Step 4/5] [2021-11-19 21:10:55,830][INFO ][sys-#21695%grid-0%][GridCacheProcessor] Finish proxy initialization, cacheName=encrypted, localNodeId=00db608c-526f-476a-ba3c-0d39102bb000 [21:10:55] : [Step 4/5] [2021-11-19 21:10:55,830][INFO ][sys-#21815%grid-1%][GridDhtPartitionsExchangeFuture] Received full message, will finish exchange [node=00db608c-526f-476a-ba3c-0d39102bb000, resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2]] [21:10:55] : [Step 4/5] [2021-11-19 21:10:55,831][INFO ][exchange-worker-#21723%grid-0%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=2, minorTopVer=2], force=false, evt=DISCOVERY_CUSTOM_EVT, node=00db608c-526f-476a-ba3c-0d39102bb000] [21:10:55] : [Step 4/5] [2021-11-19 21:10:55,831][INFO ][sys-#21695%grid-0%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=00db608c-526f-476a-ba3c-0d39102bb000, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=00db608c-526f-476a-ba3c-0d39102bb000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345455808, loc=true, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2]] [21:10:55] : [Step 4/5] [2021-11-19 21:10:55,832][INFO ][sys-#21815%grid-1%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], err=null, rebalanced=true, wasRebalanced=true] [21:10:55] : [Step 4/5] [2021-11-19 21:10:55,834][INFO ][sys-#21695%grid-0%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (1 ms), stage="Update caches registry" (0 ms), stage="Start caches" (5 ms), stage="Affinity initialization on cache group start" (0 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Wait partitions release latch [latch=exchange]" (2 ms), stage="Wait partitions release [latch=exchange]" (1 ms), stage="Restore partition states" (0 ms), stage="After states restored callback" (0 ms), stage="WAL history reservation" (0 ms), stage="Waiting for all single messages" (1 ms), stage="Affinity recalculation (crd)" (0 ms), stage="Collect update counters and create affinity messages" (0 ms), stage="Assign partitions states" (0 ms), stage="Validate partitions states" (0 ms), stage="Apply update counters" (0 ms), stage="Full message preparing" (0 ms), stage="Full message sending" (0 ms), stage="Exchange done" (3 ms), stage="Total time" (13 ms)] [21:10:55] : [Step 4/5] [2021-11-19 21:10:55,834][INFO ][sys-#21815%grid-1%][GridCacheProcessor] Finish proxy initialization, cacheName=encrypted, localNodeId=10f54e13-fcdc-4ff6-8550-968ca8308001 [21:10:55] : [Step 4/5] [2021-11-19 21:10:55,836][INFO ][sys-#21695%grid-0%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], stage="Affinity initialization on cache group start [grp=encrypted]" (0 ms) (parent=Affinity initialization on cache group start), stage="Restore partition states [grp=ignite-sys-cache]" (0 ms) (parent=Restore partition states), stage="Restore partition states [grp=encrypted]" (0 ms) (parent=Restore partition states)] [21:10:55] : [Step 4/5] [2021-11-19 21:10:55,837][INFO ][exchange-worker-#21846%grid-1%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=2, minorTopVer=2], force=false, evt=DISCOVERY_CUSTOM_EVT, node=00db608c-526f-476a-ba3c-0d39102bb000] [21:10:55] : [Step 4/5] [2021-11-19 21:10:55,837][INFO ][sys-#21815%grid-1%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=10f54e13-fcdc-4ff6-8550-968ca8308001, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=00db608c-526f-476a-ba3c-0d39102bb000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345455636, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2]] [21:10:55] : [Step 4/5] [2021-11-19 21:10:55,839][INFO ][sys-#21815%grid-1%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (2 ms), stage="Update caches registry" (0 ms), stage="Start caches" (6 ms), stage="Affinity initialization on cache group start" (0 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Wait partitions release latch [latch=exchange]" (1 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Restore partition states" (0 ms), stage="After states restored callback" (0 ms), stage="WAL history reservation" (0 ms), stage="Waiting for Full message" (3 ms), stage="Affinity recalculation" (0 ms), stage="Full map updating" (1 ms), stage="Exchange done" (6 ms), stage="Total time" (19 ms)] [21:10:55] : [Step 4/5] [2021-11-19 21:10:55,840][INFO ][sys-#21815%grid-1%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], stage="Affinity initialization on cache group start [grp=encrypted]" (0 ms) (parent=Affinity initialization on cache group start), stage="Restore partition states [grp=ignite-sys-cache]" (0 ms) (parent=Restore partition states), stage="Restore partition states [grp=encrypted]" (0 ms) (parent=Restore partition states)] [21:10:56] : [Step 4/5] [2021-11-19 21:10:56,121][INFO ][db-checkpoint-thread-#21862%grid-1%][Checkpointer] Checkpoint started [checkpointId=66bbbf75-2f73-423a-b2d6-8b3d9845e9c4, startPtr=WALPointer [idx=0, fileOff=86665, len=1963], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=79ms, writeCheckpointEntryDuration=256ms, splitAndSortCpPagesDuration=0ms, pages=18, reason='node started'] [21:10:56] : [Step 4/5] [2021-11-19 21:10:56,121][INFO ][db-checkpoint-thread-#21857%grid-0%][Checkpointer] Checkpoint started [checkpointId=22679890-061f-419e-8abb-d37de93d980c, startPtr=WALPointer [idx=0, fileOff=86665, len=1963], checkpointBeforeLockTime=82ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=82ms, writeCheckpointEntryDuration=257ms, splitAndSortCpPagesDuration=0ms, pages=18, reason='node started'] [21:10:56] : [Step 4/5] [2021-11-19 21:10:56,127][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10f54e13-fcdc-4ff6-8550-968ca8308001, grp=1613773252] [21:10:56] : [Step 4/5] [2021-11-19 21:10:56,128][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00db608c-526f-476a-ba3c-0d39102bb000, grp=1613773252] [21:10:56] : [Step 4/5] [2021-11-19 21:10:56,131][INFO ][disco-notifier-worker-#21837%grid-1%][IgniteTestResources] Block message [node=00db608c-526f-476a-ba3c-0d39102bb000, order=1, msg=org.apache.ignite.internal.util.distributed.SingleNodeMessage@33463f03] [21:10:56] : [Step 4/5] [2021-11-19 21:10:56,132][INFO ][async-runnable-runner-1][root] >>> Stopping grid [name=grid-1, id=10f54e13-fcdc-4ff6-8550-968ca8308001] [21:10:56] : [Step 4/5] [2021-11-19 21:10:56,424][INFO ][tcp-disco-sock-reader-[00db608c 127.0.0.1:53531]-#1147%grid-1%-#21842%grid-1%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:53531, rmtPort=53531, rmtNodeId=00db608c-526f-476a-ba3c-0d39102bb000] [21:10:56] : [Step 4/5] [2021-11-19 21:10:56,425][INFO ][disco-event-worker-#21722%grid-0%][GridDiscoveryManager] Node left topology: TcpDiscoveryNode [id=10f54e13-fcdc-4ff6-8550-968ca8308001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637345455606, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false] [21:10:56] : [Step 4/5] [2021-11-19 21:10:56,426][INFO ][async-runnable-runner-1][GridCacheProcessor] Stopped cache [cacheName=ignite-sys-cache] [21:10:56] : [Step 4/5] [2021-11-19 21:10:56,427][INFO ][disco-event-worker-#21722%grid-0%][GridDiscoveryManager] Topology snapshot [ver=3, locNode=00db608c, servers=1, clients=0, state=ACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=00db608c-526f-476a-ba3c-0d39102bb000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:10:56] : [Step 4/5] [2021-11-19 21:10:56,428][INFO ][disco-event-worker-#21722%grid-0%][GridDiscoveryManager] ^-- Baseline [id=0, size=2, online=1, offline=1] [21:10:56] : [Step 4/5] [2021-11-19 21:10:56,428][INFO ][async-runnable-runner-1][GridCacheProcessor] Stopped cache [cacheName=encrypted] [21:10:56]W: [org.apache.ignite:ignite-core] [2021-11-19 21:10:56,429][WARN ][grid-nio-worker-tcp-comm-0-#21661%TestRecordingCommunicationSpi%][TestRecordingCommunicationSpi] Failed to shutdown socket [21:10:56]W: [org.apache.ignite:ignite-core] java.nio.channels.ClosedChannelException [21:10:56]W: [org.apache.ignite:ignite-core] at sun.nio.ch.SocketChannelImpl.shutdownOutput(SocketChannelImpl.java:795) [21:10:56]W: [org.apache.ignite:ignite-core] at sun.nio.ch.SocketAdaptor.shutdownOutput(SocketAdaptor.java:407) [21:10:56]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.close(IgniteUtils.java:4247) [21:10:56]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.closeKey(GridNioServer.java:2784) [21:10:56]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.close(GridNioServer.java:2835) [21:10:56]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.close(GridNioServer.java:2794) [21:10:56]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.bodyInternal(GridNioServer.java:2157) [21:10:56]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.body(GridNioServer.java:1910) [21:10:56]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:125) [21:10:56]W: [org.apache.ignite:ignite-core] at java.lang.Thread.run(Thread.java:748) [21:10:56] : [Step 4/5] [2021-11-19 21:10:56,432][INFO ][exchange-worker-#21723%grid-0%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], crd=true, evt=NODE_LEFT, evtNode=10f54e13-fcdc-4ff6-8550-968ca8308001, customEvt=null, allowMerge=false, exchangeFreeSwitch=true] [21:10:56] : [Step 4/5] [2021-11-19 21:10:56,433][INFO ][disco-notifier-worker-#21718%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=1] [21:10:56] : [Step 4/5] [2021-11-19 21:10:56,434][INFO ][sys-#21697%grid-0%][GridAffinityAssignmentCache] Local node affinity assignment distribution is not ideal [cache=encrypted, expectedPrimary=8.00, actualPrimary=3, expectedBackups=0.00, actualBackups=0, warningThreshold=50.00%] [21:10:56] : [Step 4/5] [2021-11-19 21:10:56,434][INFO ][reencrypt-#21880%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:10:56] : [Step 4/5] [2021-11-19 21:10:56,434][INFO ][exchange-worker-#21723%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:10:56] : [Step 4/5] [2021-11-19 21:10:56,435][INFO ][exchange-worker-#21723%grid-0%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], err=null, rebalanced=true, wasRebalanced=true] [21:10:56]W: [org.apache.ignite:ignite-core] [2021-11-19 21:10:56,436][WARN ][exchange-worker-#21723%grid-0%][GridDhtPartitionTopologyImpl] Detected lost partitions [grp=encrypted, parts=[0, 2, 4, 6-7], topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0]] [21:10:56] : [Step 4/5] [2021-11-19 21:10:56,437][INFO ][exchange-worker-#21723%grid-0%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=00db608c-526f-476a-ba3c-0d39102bb000, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], evt=NODE_LEFT, evtNode=TcpDiscoveryNode [id=10f54e13-fcdc-4ff6-8550-968ca8308001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637345455606, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0]] [21:10:56] : [Step 4/5] [2021-11-19 21:10:56,438][INFO ][exchange-worker-#21723%grid-0%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (1 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="After states restored callback" (0 ms), stage="WAL history reservation" (0 ms), stage="Finalize update counters" (0 ms), stage="Detect lost partitions" (1 ms), stage="Exchange done" (1 ms), stage="Total time" (3 ms)] [21:10:56] : [Step 4/5] [2021-11-19 21:10:56,439][INFO ][exchange-worker-#21723%grid-0%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], stage="Affinity initialization (exchange-free switch on fully-rebalanced topology) [grp=ignite-sys-cache]" (0 ms) (parent=Determine exchange type), stage="Affinity initialization (exchange-free switch on fully-rebalanced topology) [grp=encrypted]" (0 ms) (parent=Determine exchange type)] [21:10:56] : [Step 4/5] [2021-11-19 21:10:56,440][INFO ][exchange-worker-#21723%grid-0%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], crd=true] [21:10:56] : [Step 4/5] [2021-11-19 21:10:56,441][INFO ][exchange-worker-#21723%grid-0%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=3, minorTopVer=0], force=false, evt=NODE_LEFT, node=10f54e13-fcdc-4ff6-8550-968ca8308001] [21:10:57] : [Step 4/5] [2021-11-19 21:10:57,090][INFO ][db-checkpoint-thread-#21857%grid-0%][Checkpointer] Checkpoint finished [cpId=22679890-061f-419e-8abb-d37de93d980c, pages=18, markPos=WALPointer [idx=0, fileOff=86665, len=1963], walSegmentsCovered=[], markDuration=341ms, pagesWrite=1ms, fsync=966ms, total=1390ms] [21:10:57] : [Step 4/5] [2021-11-19 21:10:57,147][INFO ][async-runnable-runner-1][FilePageStoreManager] Cleanup cache stores [total=4, left=0, cleanFiles=false] [21:10:57] : [Step 4/5] [2021-11-19 21:10:57,149][INFO ][async-runnable-runner-1][GridDeploymentLocalStore] Removed undeployed class: GridDeployment [ts=1637345455788, depMode=SHARED, clsLdr=IsolatedClassLoader{roleName='test'}, clsLdrId=5358d593d71-10f54e13-fcdc-4ff6-8550-968ca8308001, userVer=0, loc=true, sampleClsName=org.apache.ignite.internal.processors.cache.distributed.dht.preloader.GridDhtPartitionFullMap, pendingUndeploy=false, undeployed=true, usage=0] [21:10:57] : [Step 4/5] [2021-11-19 21:10:57,156][INFO ][async-runnable-runner-1][IgniteKernal%grid-1] [21:10:57] : [Step 4/5] [21:10:57] : [Step 4/5] >>> +------------------------------------------------------+ [21:10:57] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV stopped OK [21:10:57] : [Step 4/5] >>> +------------------------------------------------------+ [21:10:57] : [Step 4/5] >>> Ignite instance name: grid-1 [21:10:57] : [Step 4/5] >>> Grid uptime: 00:00:01.496 [21:10:57] : [Step 4/5] [21:10:57] : [Step 4/5] [21:10:57] : [Step 4/5] [2021-11-19 21:10:57,160][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00db608c-526f-476a-ba3c-0d39102bb000, grp=1613773252] [21:10:57] : [Step 4/5] [2021-11-19 21:10:57,166][INFO ][db-checkpoint-thread-#21857%grid-0%][Checkpointer] Checkpoint started [checkpointId=b06d3f8b-2107-4941-b025-748746bfe86a, startPtr=WALPointer [idx=0, fileOff=158680, len=2010], checkpointBeforeLockTime=2ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=2ms, walCpRecordFsyncDuration=0ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=1ms, pages=43, reason='test'] [21:10:58] : [Step 4/5] [2021-11-19 21:10:58,065][INFO ][db-checkpoint-thread-#21857%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:10:58] : [Step 4/5] [2021-11-19 21:10:58,065][INFO ][db-checkpoint-thread-#21857%grid-0%][Checkpointer] Checkpoint finished [cpId=b06d3f8b-2107-4941-b025-748746bfe86a, pages=43, markPos=WALPointer [idx=0, fileOff=158680, len=2010], walSegmentsCovered=[], markDuration=4ms, pagesWrite=3ms, fsync=896ms, total=905ms] [21:10:58]W: [org.apache.ignite:ignite-core] [2021-11-19 21:10:58,070][WARN ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][G] Ignite work directory is not provided, automatically resolved to: /opt/buildagent/work/7bc1c54bc719b67c/work [21:10:58] : [Step 4/5] [2021-11-19 21:10:58,071][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] [21:10:58] : [Step 4/5] [21:10:58] : [Step 4/5] >>> __________ ________________ [21:10:58] : [Step 4/5] >>> / _/ ___/ |/ / _/_ __/ __/ [21:10:58] : [Step 4/5] >>> _/ // (7 7 // / / / / _/ [21:10:58] : [Step 4/5] >>> /___/\___/_/|_/___/ /_/ /___/ [21:10:58] : [Step 4/5] >>> [21:10:58] : [Step 4/5] >>> ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:10:58] : [Step 4/5] >>> 2021 Copyright(C) Apache Software Foundation [21:10:58] : [Step 4/5] >>> [21:10:58] : [Step 4/5] >>> Ignite documentation: http://ignite.apache.org [21:10:58] : [Step 4/5] [21:10:58] : [Step 4/5] [2021-11-19 21:10:58,072][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] Config URL: n/a [21:10:58] : [Step 4/5] [2021-11-19 21:10:58,072][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] IgniteConfiguration [igniteInstanceName=grid-1, pubPoolSize=24, svcPoolSize=24, callbackPoolSize=24, stripedPoolSize=24, sysPoolSize=24, mgmtPoolSize=4, dataStreamerPoolSize=24, utilityCachePoolSize=24, utilityCacheKeepAliveTime=60000, p2pPoolSize=2, qryPoolSize=24, buildIdxPoolSize=4, igniteHome=/opt/buildagent/work/7bc1c54bc719b67c, igniteWorkDir=/opt/buildagent/work/7bc1c54bc719b67c/work, mbeanSrv=com.sun.jmx.mbeanserver.JmxMBeanServer@6fe85038, nodeId=10fe436a-de49-4605-a91d-ce25d9b0a001, marsh=BinaryMarshaller [], marshLocJobs=false, daemon=false, p2pEnabled=true, netTimeout=10000, netCompressionLevel=1, sndRetryDelay=1000, sndRetryCnt=3, metricsHistSize=10000, metricsUpdateFreq=1000, metricsExpTime=9223372036854775807, discoSpi=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=0, ackTimeout=0, marsh=null, reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], segPlc=STOP, segResolveAttempts=2, waitForSegOnStart=true, allResolversPassReq=true, segChkFreq=10000, commSpi=TcpCommunicationSpi [connectGate=org.apache.ignite.spi.communication.tcp.internal.ConnectGateway@1bf1127a, ctxInitLatch=java.util.concurrent.CountDownLatch@77514e58[Count = 1], stopping=false, clientPool=null, nioSrvWrapper=null, stateProvider=null], evtSpi=MemoryEventStorageSpi [expireAgeMs=9223372036854775807, expireCnt=10000, filter=null], colSpi=NoopCollisionSpi [], deploySpi=LocalDeploymentSpi [], indexingSpi=org.apache.ignite.spi.indexing.noop.NoopIndexingSpi@2c7301f3, addrRslvr=null, encryptionSpi=org.apache.ignite.spi.encryption.keystore.KeystoreEncryptionSpi@574fb2f2, tracingSpi=org.apache.ignite.spi.tracing.NoopTracingSpi@754615fe, clientMode=false, rebalanceThreadPoolSize=4, rebalanceTimeout=10000, rebalanceBatchesPrefetchCnt=3, rebalanceThrottle=0, rebalanceBatchSize=524288, txCfg=TransactionConfiguration [txSerEnabled=false, dfltIsolation=REPEATABLE_READ, dfltConcurrency=PESSIMISTIC, dfltTxTimeout=0, txTimeoutOnPartitionMapExchange=0, deadlockTimeout=10000, pessimisticTxLogSize=0, pessimisticTxLogLinger=10000, tmLookupClsName=null, txManagerFactory=null, useJtaSync=false], cacheSanityCheckEnabled=true, discoStartupDelay=60000, deployMode=SHARED, p2pMissedCacheSize=100, locHost=127.0.0.1, timeSrvPortBase=31100, timeSrvPortRange=100, failureDetectionTimeout=10000, sysWorkerBlockedTimeout=null, clientFailureDetectionTimeout=10000, metricsLogFreq=0, connectorCfg=null, odbcCfg=null, warmupClos=null, atomicCfg=AtomicConfiguration [seqReserveSize=1000, cacheMode=PARTITIONED, backups=1, aff=null, grpName=null], classLdr=null, sslCtxFactory=null, platformCfg=null, binaryCfg=null, memCfg=null, pstCfg=null, dsCfg=DataStorageConfiguration [sysRegionInitSize=41943040, sysRegionMaxSize=104857600, pageSize=4096, concLvl=0, dfltDataRegConf=DataRegionConfiguration [name=default, maxSize=104857600, initSize=268435456, swapPath=null, pageEvictionMode=DISABLED, pageReplacementMode=CLOCK, evictionThreshold=0.9, emptyPagesPoolSize=100, metricsEnabled=false, metricsSubIntervalCount=5, metricsRateTimeInterval=60000, persistenceEnabled=true, checkpointPageBufSize=0, lazyMemoryAllocation=true, warmUpCfg=null], dataRegions=null, storagePath=null, checkpointFreq=30000, lockWaitTime=10000, checkpointThreads=4, checkpointWriteOrder=SEQUENTIAL, walHistSize=20, maxWalArchiveSize=20971520, walSegments=10, walSegmentSize=1048576, walPath=db/wal, walArchivePath=db/wal/archive, cdcWalPath=db/wal/cdc, cdcEnabled=false, metricsEnabled=false, walMode=LOG_ONLY, walTlbSize=131072, walBuffSize=0, walFlushFreq=2000, walFsyncDelay=1000, walRecordIterBuffSize=67108864, alwaysWriteFullPages=false, fileIOFactory=org.apache.ignite.internal.processors.cache.persistence.file.AsyncFileIOFactory@5f01fd7c, metricsSubIntervalCnt=5, metricsRateTimeInterval=60000, walAutoArchiveAfterInactivity=-1, walForceArchiveTimeout=-1, writeThrottlingEnabled=false, walCompactionEnabled=false, walCompactionLevel=1, checkpointReadLockTimeout=null, walPageCompression=DISABLED, walPageCompressionLevel=null, dfltWarmUpCfg=null, encCfg=org.apache.ignite.configuration.EncryptionConfiguration@44964d88, defragmentationThreadPoolSize=4, minWalArchiveSize=-1], snapshotPath=snapshots, activeOnStart=true, activeOnStartPropSetFlag=false, autoActivation=true, autoActivationPropSetFlag=false, clusterStateOnStart=null, sqlConnCfg=null, cliConnCfg=ClientConnectorConfiguration [host=null, port=10800, portRange=100, sockSndBufSize=0, sockRcvBufSize=0, tcpNoDelay=true, maxOpenCursorsPerConn=128, threadPoolSize=24, selectorCnt=12, idleTimeout=0, handshakeTimeout=10000, jdbcEnabled=true, odbcEnabled=true, thinCliEnabled=true, sslEnabled=false, useIgniteSslCtxFactory=true, sslClientAuth=false, sslCtxFactory=null, thinCliCfg=ThinClientConfiguration [maxActiveTxPerConn=100, maxActiveComputeTasksPerConn=0]], mvccVacuumThreadCnt=2, mvccVacuumFreq=5000, authEnabled=false, failureHnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]], commFailureRslvr=null, sqlCfg=SqlConfiguration [longQryWarnTimeout=3000, dfltQryTimeout=0, sqlQryHistSize=1000, validationEnabled=false], asyncContinuationExecutor=null] [21:10:58] : [Step 4/5] [2021-11-19 21:10:58,081][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] Daemon mode: off [21:10:58] : [Step 4/5] [2021-11-19 21:10:58,082][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] OS: Linux 4.15.0-151-generic amd64 [21:10:58] : [Step 4/5] [2021-11-19 21:10:58,082][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] OS user: teamcity [21:10:58] : [Step 4/5] [2021-11-19 21:10:58,082][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] PID: 16724 [21:10:58] : [Step 4/5] [2021-11-19 21:10:58,082][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] Language runtime: Java Platform API Specification ver. 1.8 [21:10:58] : [Step 4/5] [2021-11-19 21:10:58,083][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] VM information: Java(TM) SE Runtime Environment 1.8.0_261-b12 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 25.261-b12 [21:10:58] : [Step 4/5] [2021-11-19 21:10:58,083][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] VM total memory: 1.9GB [21:10:58] : [Step 4/5] [2021-11-19 21:10:58,083][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] Remote Management [restart: off, REST: off, JMX (remote: off)] [21:10:58] : [Step 4/5] [2021-11-19 21:10:58,083][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] Logger: GridTestLog4jLogger [quiet=false, config=null] [21:10:58] : [Step 4/5] [2021-11-19 21:10:58,084][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] IGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c [21:10:58] : [Step 4/5] [2021-11-19 21:10:58,084][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] VM arguments: [-DIGNITE_DUMP_THREADS_ON_FAILURE=false, -DMono=/usr/bin/mono-sgen, -DMono4.0_x64=/usr/lib/mono/4.0, -DMono4.5_x64=/usr/lib/mono/4.5, -DMonoVersion=6.12.0.90, -DSKIP_BUILD=false, -Dagent.home.dir=/opt/buildagent, -Dagent.name=aitc-lin02_03, -Dagent.ownPort=9090, -Dagent.work.dir=/opt/buildagent/work, -Dbuild.number=95, -Dbuild.vcs.number=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.1=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.GitHubApacheIgnite=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dclassworlds.conf=/opt/buildagent/temp/buildTmp/teamcity.m2.conf, -Dcom.jetbrains.maven.watcher.report.file=/opt/buildagent/temp/buildTmp/maven-build-info.xml, -Djava.io.tmpdir=/opt/buildagent/temp/buildTmp, -Dmaven.home=/opt/buildagent/tools/maven3_6, -Dmaven.multiModuleProjectDirectory=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.agent.cpuBenchmark=457, -Dteamcity.agent.dotnet.agent_url=http://localhost:9090/RPC2, -Dteamcity.agent.dotnet.build_id=6278078, -Dteamcity.auth.password=*******, -Dteamcity.auth.userId=TeamCityBuildId=6278078, -Dteamcity.build.changedFiles.file=/opt/buildagent/temp/buildTmp/changedFiles6342607772318147725.txt, -Dteamcity.build.checkoutDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.build.id=6278078, -Dteamcity.build.properties.file=/opt/buildagent/temp/buildTmp/teamcity.build5164517880467851002.properties, -Dteamcity.build.tempDir=/opt/buildagent/temp/buildTmp, -Dteamcity.build.workingDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.buildConfName=Basic 3, -Dteamcity.buildType.id=IgniteTests24Java8_Basic3, -Dteamcity.configuration.properties.file=/opt/buildagent/temp/buildTmp/teamcity.config5591980786735343870.properties, -Dteamcity.maven.userSettings.path=/opt/buildagent/temp/buildTmp/maven_settings_585072866407032347.xml, -Dteamcity.maven.watcher.home=/opt/buildagent/plugins/mavenPlugin/maven-watcher-jdk16, -Dteamcity.projectName=Ignite Tests 2.x (JDK 8/11), -Dteamcity.runner.properties.file=/opt/buildagent/temp/buildTmp/teamcity.runner9098465561618137420.properties, -Dteamcity.tests.recentlyFailedTests.file=/opt/buildagent/temp/buildTmp/testsToRunFirst3891775683130404069.txt, -Dteamcity.version=2021.2 (build 99542), -ea, -Xms2g, -Xmx2g, -XX:+HeapDumpOnOutOfMemoryError, -DIGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_TEST_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_UPDATE_NOTIFIER=false, -DIGNITE_NO_DISCO_ORDER=true, -DIGNITE_PERFORMANCE_SUGGESTIONS_DISABLED=true, -Djava.net.preferIPv4Stack=true, -DTEST_SCALE_FACTOR=1.0, -DIGNITE_TEST_PROP_LOG4J_FILE=log4j-tc-test.xml, -DIGNITE_QUIET=false, -DIGNITE_MARSHAL_BUFFERS_RECHECK=1000, -Dmaven.repo.local=/opt/buildagent/.m2/repository] [21:10:58] : [Step 4/5] [2021-11-19 21:10:58,088][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] System cache's DataRegion size is configured to 40 MB. Use DataStorageConfiguration.systemRegionInitialSize property to change the setting. [21:10:58] : [Step 4/5] [2021-11-19 21:10:58,088][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] Configured caches [in 'sysMemPlc' dataRegion: ['ignite-sys-cache']] [21:10:58]W: [org.apache.ignite:ignite-core] [2021-11-19 21:10:58,088][WARN ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] Peer class loading is enabled (disable it in production for performance and deployment consistency reasons) [21:10:58] : [Step 4/5] [2021-11-19 21:10:58,089][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] 3-rd party licenses can be found at: /opt/buildagent/work/7bc1c54bc719b67c/libs/licenses [21:10:58] : [Step 4/5] [2021-11-19 21:10:58,092][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] Configured plugins: [21:10:58] : [Step 4/5] [2021-11-19 21:10:58,092][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- StanByClusterTestProvider 1.0 [21:10:58] : [Step 4/5] [2021-11-19 21:10:58,093][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:10:58] : [Step 4/5] [2021-11-19 21:10:58,093][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] [21:10:58] : [Step 4/5] [2021-11-19 21:10:58,093][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- PageMemory tracker plugin 1.0 [21:10:58] : [Step 4/5] [2021-11-19 21:10:58,093][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:10:58] : [Step 4/5] [2021-11-19 21:10:58,093][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] [21:10:58] : [Step 4/5] [2021-11-19 21:10:58,093][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- TestDistibutedConfigurationPlugin 1.0 [21:10:58] : [Step 4/5] [2021-11-19 21:10:58,093][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:10:58] : [Step 4/5] [2021-11-19 21:10:58,094][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] [21:10:58] : [Step 4/5] [2021-11-19 21:10:58,094][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- NodeValidationPluginProvider 1.0 [21:10:58] : [Step 4/5] [2021-11-19 21:10:58,094][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:10:58] : [Step 4/5] [2021-11-19 21:10:58,094][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] [21:10:58] : [Step 4/5] [2021-11-19 21:10:58,094][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][FailureProcessor] Configured failure handler: [hnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]]] [21:10:58] : [Step 4/5] [2021-11-19 21:10:58,104][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][TestRecordingCommunicationSpi] Successfully bound communication NIO server to TCP port [port=47101, locHost=/127.0.0.1, selectorsCnt=12, selectorSpins=0, pairedConn=false] [21:10:58]W: [org.apache.ignite:ignite-core] [2021-11-19 21:10:58,105][WARN ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][TestRecordingCommunicationSpi] Message queue limit is set to 0 which may lead to potential OOMEs when running cache operations in FULL_ASYNC or PRIMARY_SYNC modes due to message queues growth on sender and receiver sides. [21:10:58] : [Step 4/5] [2021-11-19 21:10:58,109][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][GridCollisionManager] Collision resolution is disabled (all jobs will be activated upon arrival). [21:10:58] : [Step 4/5] [2021-11-19 21:10:58,110][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] Security status [authentication=off, sandbox=off, tls/ssl=off] [21:10:58] : [Step 4/5] [2021-11-19 21:10:58,167][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:10:58] : [Step 4/5] [2021-11-19 21:10:58,249][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][MaintenanceProcessor] Resolved store directory for node persistent data: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1 [21:10:58] : [Step 4/5] [2021-11-19 21:10:58,250][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][CacheObjectBinaryProcessorImpl] Resolved directory for serialized binary metadata: /opt/buildagent/work/7bc1c54bc719b67c/work/db/binary_meta/grid_1 [21:10:58] : [Step 4/5] [2021-11-19 21:10:58,254][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1 [21:10:58] : [Step 4/5] [2021-11-19 21:10:58,254][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][FileWriteAheadLogManager] Resolved write ahead log work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1 [21:10:58] : [Step 4/5] [2021-11-19 21:10:58,255][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][FileWriteAheadLogManager] Resolved write ahead log archive directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1 [21:10:58] : [Step 4/5] [2021-11-19 21:10:58,256][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000005.wal [21:10:58] : [Step 4/5] [2021-11-19 21:10:58,257][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000006.wal [21:10:58] : [Step 4/5] [2021-11-19 21:10:58,257][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000004.wal [21:10:58] : [Step 4/5] [2021-11-19 21:10:58,257][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000003.wal [21:10:58] : [Step 4/5] [2021-11-19 21:10:58,258][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000002.wal [21:10:58] : [Step 4/5] [2021-11-19 21:10:58,258][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000001.wal [21:10:58] : [Step 4/5] [2021-11-19 21:10:58,258][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][FileHandleManagerImpl] Initialized write-ahead log manager [mode=LOG_ONLY] [21:10:58] : [Step 4/5] [2021-11-19 21:10:58,262][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Configured data regions initialized successfully [total=5] [21:10:58] : [Step 4/5] [2021-11-19 21:10:58,501][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][IgniteSnapshotManager] Resolved snapshot work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/snapshots [21:10:58] : [Step 4/5] [2021-11-19 21:10:58,501][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][IgniteSnapshotManager] Resolved temp directory for snapshot creation: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1/snp [21:10:58] : [Step 4/5] [2021-11-19 21:10:58,504][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][ClientListenerProcessor] Client connector processor has started on TCP port 10801 [21:10:58] : [Step 4/5] [2021-11-19 21:10:58,508][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] Non-loopback local IPs: 172.17.0.4 [21:10:58] : [Step 4/5] [2021-11-19 21:10:58,509][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] Enabled local MACs: 0242AC110004 [21:10:58] : [Step 4/5] [2021-11-19 21:10:58,511][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=/opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1/cp/1637345455785-66bbbf75-2f73-423a-b2d6-8b3d9845e9c4-START.bin, endMarker=null] [21:10:58] : [Step 4/5] [2021-11-19 21:10:58,512][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:10:58] : [Step 4/5] [2021-11-19 21:10:58,512][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=86665, len=1963], lastCheckpointId=66bbbf75-2f73-423a-b2d6-8b3d9845e9c4] [21:10:58] : [Step 4/5] [2021-11-19 21:10:58,514][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Restoring checkpoint after logical recovery, will start physical recovery from back pointer: WALPointer [idx=0, fileOff=29, len=29] [21:10:58] : [Step 4/5] [2021-11-19 21:10:58,517][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Found last checkpoint marker [cpId=66bbbf75-2f73-423a-b2d6-8b3d9845e9c4, pos=WALPointer [idx=0, fileOff=86665, len=1963]] [21:10:58] : [Step 4/5] [2021-11-19 21:10:58,519][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Applying lost metastore updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=86665, len=1963], lastCheckpointId=66bbbf75-2f73-423a-b2d6-8b3d9845e9c4] [21:10:58] : [Step 4/5] [2021-11-19 21:10:58,521][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=0 ms] [21:10:58] : [Step 4/5] [2021-11-19 21:10:58,521][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Restoring partition state for local groups. [21:10:58] : [Step 4/5] [2021-11-19 21:10:58,522][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=0, partitionsProcessed=0, time=0ms] [21:10:58] : [Step 4/5] [2021-11-19 21:10:58,530][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][GridClusterStateProcessor] Restoring history for BaselineTopology[id=0] [21:10:58] : [Step 4/5] [2021-11-19 21:10:58,538][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][ClusterProcessor] Cluster ID and tag has been read from metastorage: ClusterIdAndTag [id=8f0e39ad-794c-4330-8dee-2e16ff8e3799, tag=laughing_joliot] [21:10:58] : [Step 4/5] [2021-11-19 21:10:58,538][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][IgniteClusterImpl] Shutdown policy was updated [oldVal=null, newVal=null] [21:10:58] : [Step 4/5] [2021-11-19 21:10:58,538][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustEnabled' was changed from 'null' to 'false' [21:10:58] : [Step 4/5] [2021-11-19 21:10:58,539][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustTimeout' was changed from 'null' to '300000' [21:10:58] : [Step 4/5] [2021-11-19 21:10:58,539][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][IgniteTxManager] Transactions parameter 'txOwnerDumpRequestsAllowed' was changed from 'null' to 'true' [21:10:58] : [Step 4/5] [2021-11-19 21:10:58,539][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][IgniteTxManager] Transactions parameter 'longOperationsDumpTimeout' was changed from 'null' to '60000' [21:10:58] : [Step 4/5] [2021-11-19 21:10:58,540][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpThreshold' was changed from 'null' to '0' [21:10:58] : [Step 4/5] [2021-11-19 21:10:58,540][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][IgniteTxManager] Transactions parameter 'transactionTimeDumpSamplesCoefficient' was changed from 'null' to '0.0' [21:10:58] : [Step 4/5] [2021-11-19 21:10:58,541][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpSamplesPerSecondLimit' was changed from 'null' to '5' [21:10:58] : [Step 4/5] [2021-11-19 21:10:58,541][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][IgniteTxManager] Transactions parameter 'collisionsDumpInterval' was changed from 'null' to '1000' [21:10:58] : [Step 4/5] [2021-11-19 21:10:58,541][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Historical rebalance WAL threshold changed [property=historical.rebalance.threshold, oldVal=null, newVal=500] [21:10:58] : [Step 4/5] [2021-11-19 21:10:58,542][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Checkpoint frequency deviation changed [oldVal=null, newVal=null] [21:10:58] : [Step 4/5] [2021-11-19 21:10:58,596][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][FilePageStoreManager] Cleanup cache stores [total=1, left=0, cleanFiles=false] [21:10:58] : [Step 4/5] [2021-11-19 21:10:58,598][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:10:58] : [Step 4/5] [2021-11-19 21:10:58,599][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:10:58] : [Step 4/5] [2021-11-19 21:10:58,600][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:10:58] : [Step 4/5] [2021-11-19 21:10:58,600][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Data Regions Started: 5 [21:10:58] : [Step 4/5] [2021-11-19 21:10:58,601][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] ^-- sysMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:10:58] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:10:58] : [Step 4/5] ^-- default region [type=default, persistence=true, lazyAlloc=true, [21:10:58] : [Step 4/5] ... initCfg=100MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB, allocTotal=0MB] [21:10:58] : [Step 4/5] ^-- metastoreMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:10:58] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:10:58] : [Step 4/5] ^-- TxLog region [type=internal, persistence=true, lazyAlloc=false, [21:10:58] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:10:58] : [Step 4/5] ^-- volatileDsMemPlc region [type=user, persistence=false, lazyAlloc=true, [21:10:58] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB] [21:10:58] : [Step 4/5] ^-- Ignite persistence [used=0MB] [21:10:58] : [Step 4/5] [21:10:58] : [Step 4/5] [2021-11-19 21:10:58,602][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Starting binary memory restore for: [-2100569601, 1613773252] [21:10:58] : [Step 4/5] [2021-11-19 21:10:58,611][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=/opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1/cp/1637345455785-66bbbf75-2f73-423a-b2d6-8b3d9845e9c4-START.bin, endMarker=null] [21:10:58] : [Step 4/5] [2021-11-19 21:10:58,612][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=86665, len=1963], lastCheckpointId=66bbbf75-2f73-423a-b2d6-8b3d9845e9c4] [21:10:58]W: [org.apache.ignite:ignite-core] [2021-11-19 21:10:58,613][WARN ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Ignite node stopped in the middle of checkpoint. Will restore memory state and finish checkpoint on node start. [21:10:58] : [Step 4/5] [2021-11-19 21:10:58,615][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:10:58] : [Step 4/5] [2021-11-19 21:10:58,615][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Restoring checkpoint after logical recovery, will start physical recovery from back pointer: WALPointer [idx=0, fileOff=29, len=29] [21:10:58] : [Step 4/5] [2021-11-19 21:10:58,617][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Found last checkpoint marker [cpId=66bbbf75-2f73-423a-b2d6-8b3d9845e9c4, pos=WALPointer [idx=0, fileOff=86665, len=1963]] [21:10:58] : [Step 4/5] [2021-11-19 21:10:58,620][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Finished applying memory changes [changesApplied=104, time=10 ms] [21:10:59] : [Step 4/5] [2021-11-19 21:10:59,180][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][CheckpointWorkflow] Checkpoint finished [cpId=66bbbf75-2f73-423a-b2d6-8b3d9845e9c4, pages=18, markPos=WALPointer [idx=0, fileOff=86665, len=1963], pagesWrite=-2ms, fsync=283ms, total=281ms] [21:10:59] : [Step 4/5] [2021-11-19 21:10:59,180][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Binary memory state restored at node startup [restoredPtr=WALPointer [idx=0, fileOff=156613, len=0]] [21:10:59] : [Step 4/5] [2021-11-19 21:10:59,182][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000000.wal, offset=156613, ver=2] [21:10:59] : [Step 4/5] [2021-11-19 21:10:59,184][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Started cache in recovery mode [name=ignite-sys-cache, id=-2100569601, dataRegionName=sysMemPlc, mode=REPLICATED, atomicity=TRANSACTIONAL, backups=2147483647, mvcc=false] [21:10:59] : [Step 4/5] [2021-11-19 21:10:59,188][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Started cache in recovery mode [name=encrypted, id=1613773252, dataRegionName=default, mode=PARTITIONED, atomicity=ATOMIC, backups=0, mvcc=false] [21:10:59] : [Step 4/5] [2021-11-19 21:10:59,188][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Binary recovery performed in 586 ms. [21:10:59] : [Step 4/5] [2021-11-19 21:10:59,189][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=/opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1/cp/1637345455785-66bbbf75-2f73-423a-b2d6-8b3d9845e9c4-START.bin, endMarker=/opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1/cp/1637345455785-66bbbf75-2f73-423a-b2d6-8b3d9845e9c4-END.bin] [21:10:59] : [Step 4/5] [2021-11-19 21:10:59,190][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Applying lost cache updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=86665, len=1963], lastCheckpointId=66bbbf75-2f73-423a-b2d6-8b3d9845e9c4] [21:10:59] : [Step 4/5] [2021-11-19 21:10:59,196][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=62, time=10 ms] [21:10:59] : [Step 4/5] [2021-11-19 21:10:59,196][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Restoring partition state for local groups. [21:10:59] : [Step 4/5] [2021-11-19 21:10:59,208][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=2, partitionsProcessed=108, time=10ms] [21:10:59] : [Step 4/5] [2021-11-19 21:10:59,229][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][TestTcpDiscoverySpi] Successfully bound to TCP port [port=47501, localHost=localhost/127.0.0.1, locNodeId=10fe436a-de49-4605-a91d-ce25d9b0a001] [21:10:59] : [Step 4/5] [2021-11-19 21:10:59,231][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][GridEncryptionManager] Sending stored group keys to coordinator [grps=1613773252] [21:10:59] : [Step 4/5] [2021-11-19 21:10:59,237][INFO ][tcp-disco-srvr-[:47500]-#1139%grid-0%-#21720%grid-0%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=33267] [21:10:59] : [Step 4/5] [2021-11-19 21:10:59,237][INFO ][tcp-disco-srvr-[:47500]-#1139%grid-0%-#21720%grid-0%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=33267] [21:10:59] : [Step 4/5] [2021-11-19 21:10:59,237][INFO ][tcp-disco-sock-reader-[]-#1154%grid-0%-#21996%grid-0%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:33267, rmtPort=33267] [21:10:59] : [Step 4/5] [2021-11-19 21:10:59,239][INFO ][tcp-disco-sock-reader-[10fe436a 127.0.0.1:33267]-#1154%grid-0%-#21996%grid-0%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=10fe436a-de49-4605-a91d-ce25d9b0a001, rmtAddr=/127.0.0.1:33267] [21:10:59] : [Step 4/5] [2021-11-19 21:10:59,243][INFO ][tcp-disco-srvr-[:47501]-#1153%grid-1%-#21995%grid-1%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=39019] [21:10:59] : [Step 4/5] [2021-11-19 21:10:59,243][INFO ][tcp-disco-srvr-[:47501]-#1153%grid-1%-#21995%grid-1%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=39019] [21:10:59] : [Step 4/5] [2021-11-19 21:10:59,244][INFO ][tcp-disco-sock-reader-[]-#1155%grid-1%-#21997%grid-1%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:39019, rmtPort=39019] [21:10:59] : [Step 4/5] [2021-11-19 21:10:59,245][INFO ][tcp-disco-sock-reader-[]-#1155%grid-1%-#21997%grid-1%][TestTcpDiscoverySpi] Received ping request from the remote node [rmtNodeId=00db608c-526f-476a-ba3c-0d39102bb000, rmtAddr=/127.0.0.1:39019, rmtPort=39019] [21:10:59] : [Step 4/5] [2021-11-19 21:10:59,246][INFO ][tcp-disco-sock-reader-[]-#1155%grid-1%-#21997%grid-1%][TestTcpDiscoverySpi] Finished writing ping response [rmtNodeId=00db608c-526f-476a-ba3c-0d39102bb000, rmtAddr=/127.0.0.1:39019, rmtPort=39019] [21:10:59] : [Step 4/5] [2021-11-19 21:10:59,246][INFO ][tcp-disco-sock-reader-[]-#1155%grid-1%-#21997%grid-1%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:39019, rmtPort=39019, rmtNodeId=null] [21:10:59] : [Step 4/5] [2021-11-19 21:10:59,246][INFO ][tcp-disco-sock-reader-[10fe436a 127.0.0.1:33267]-#1154%grid-0%-#21996%grid-0%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:33267, rmtPort=33267, rmtNodeId=10fe436a-de49-4605-a91d-ce25d9b0a001] [21:10:59] : [Step 4/5] [2021-11-19 21:10:59,259][INFO ][tcp-disco-msg-worker-[crd]-#1138%grid-0%-#21719%grid-0%][TestTcpDiscoverySpi] New next node [newNext=TcpDiscoveryNode [id=10fe436a-de49-4605-a91d-ce25d9b0a001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=0, intOrder=3, lastExchangeTime=1637345459235, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false]] [21:10:59] : [Step 4/5] [2021-11-19 21:10:59,260][INFO ][tcp-disco-srvr-[:47501]-#1153%grid-1%-#21995%grid-1%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=38341] [21:10:59] : [Step 4/5] [2021-11-19 21:10:59,261][INFO ][tcp-disco-srvr-[:47501]-#1153%grid-1%-#21995%grid-1%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=38341] [21:10:59] : [Step 4/5] [2021-11-19 21:10:59,261][INFO ][tcp-disco-sock-reader-[]-#1156%grid-1%-#21998%grid-1%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:38341, rmtPort=38341] [21:10:59] : [Step 4/5] [2021-11-19 21:10:59,262][INFO ][tcp-disco-sock-reader-[00db608c 127.0.0.1:38341]-#1156%grid-1%-#21998%grid-1%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=00db608c-526f-476a-ba3c-0d39102bb000, rmtAddr=/127.0.0.1:38341] [21:10:59] : [Step 4/5] [2021-11-19 21:10:59,267][INFO ][tcp-disco-msg-worker-[]-#1152%grid-1%-#21994%grid-1%][TestTcpDiscoverySpi] New next node [newNext=TcpDiscoveryNode [id=00db608c-526f-476a-ba3c-0d39102bb000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345459255, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false]] [21:10:59] : [Step 4/5] [2021-11-19 21:10:59,268][INFO ][tcp-disco-srvr-[:47500]-#1139%grid-0%-#21720%grid-0%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=46341] [21:10:59] : [Step 4/5] [2021-11-19 21:10:59,268][INFO ][tcp-disco-srvr-[:47500]-#1139%grid-0%-#21720%grid-0%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=46341] [21:10:59] : [Step 4/5] [2021-11-19 21:10:59,269][INFO ][tcp-disco-sock-reader-[]-#1157%grid-0%-#21999%grid-0%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:46341, rmtPort=46341] [21:10:59] : [Step 4/5] [2021-11-19 21:10:59,270][INFO ][tcp-disco-sock-reader-[10fe436a 127.0.0.1:46341]-#1157%grid-0%-#21999%grid-0%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=10fe436a-de49-4605-a91d-ce25d9b0a001, rmtAddr=/127.0.0.1:46341] [21:10:59] : [Step 4/5] [2021-11-19 21:10:59,273][INFO ][disco-event-worker-#21722%grid-0%][GridDiscoveryManager] Added new node to topology: TcpDiscoveryNode [id=10fe436a-de49-4605-a91d-ce25d9b0a001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=4, intOrder=3, lastExchangeTime=1637345459235, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false] [21:10:59] : [Step 4/5] [2021-11-19 21:10:59,275][INFO ][disco-event-worker-#21722%grid-0%][GridDiscoveryManager] Topology snapshot [ver=4, locNode=00db608c, servers=2, clients=0, state=ACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=00db608c-526f-476a-ba3c-0d39102bb000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=10fe436a-de49-4605-a91d-ce25d9b0a001, consistentId=grid-1, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:10:59] : [Step 4/5] [2021-11-19 21:10:59,275][INFO ][disco-event-worker-#21722%grid-0%][GridDiscoveryManager] ^-- Baseline [id=0, size=2, online=2, offline=0] [21:10:59] : [Step 4/5] [2021-11-19 21:10:59,276][INFO ][exchange-worker-#21723%grid-0%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], crd=true, evt=NODE_JOINED, evtNode=10fe436a-de49-4605-a91d-ce25d9b0a001, customEvt=null, allowMerge=true, exchangeFreeSwitch=false] [21:10:59] : [Step 4/5] [2021-11-19 21:10:59,277][INFO ][exchange-worker-#21723%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], waitTime=0ms, futInfo=NA, mode=DISTRIBUTED] [21:10:59] : [Step 4/5] [2021-11-19 21:10:59,277][INFO ][tcp-disco-msg-worker-[00db608c 127.0.0.1:47500]-#1152%grid-1%-#21994%grid-1%][GridEncryptionManager] Store group key received from coordinator [grp=1613773252, keyId=1] [21:10:59] : [Step 4/5] [2021-11-19 21:10:59,278][INFO ][exchange-worker-#21723%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partitions release latch: ServerLatch [permits=0, pendingAcks=HashSet [], super=CompletableLatch [id=CompletableLatchUid [id=exchange, topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0]]]] [21:10:59] : [Step 4/5] [2021-11-19 21:10:59,279][INFO ][exchange-worker-#21723%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:10:59] : [Step 4/5] [2021-11-19 21:10:59,279][INFO ][disco-notifier-worker-#21993%grid-1%][MvccProcessorImpl] Assigned mvcc coordinator [crd=MvccCoordinator [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], nodeId=00db608c-526f-476a-ba3c-0d39102bb000, ver=1637345454799, local=false, initialized=false]] [21:10:59] : [Step 4/5] [2021-11-19 21:10:59,279][INFO ][exchange-worker-#21723%grid-0%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], crd=true] [21:10:59] : [Step 4/5] [2021-11-19 21:10:59,281][INFO ][sys-#21971%grid-1%][ClusterProcessor] Writing cluster ID and tag to metastorage on ready for write ClusterIdAndTag [id=8f0e39ad-794c-4330-8dee-2e16ff8e3799, tag=laughing_joliot] [21:10:59] : [Step 4/5] [2021-11-19 21:10:59,427][INFO ][exchange-worker-#22002%grid-1%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], crd=false, evt=NODE_JOINED, evtNode=10fe436a-de49-4605-a91d-ce25d9b0a001, customEvt=null, allowMerge=true, exchangeFreeSwitch=false] [21:10:59] : [Step 4/5] [2021-11-19 21:10:59,427][INFO ][exchange-worker-#22002%grid-1%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1 [21:10:59] : [Step 4/5] [2021-11-19 21:10:59,429][INFO ][exchange-worker-#22002%grid-1%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000000.wal, offset=213613, ver=2] [21:10:59] : [Step 4/5] [2021-11-19 21:10:59,432][INFO ][exchange-worker-#22002%grid-1%][GridClusterStateProcessor] Writing BaselineTopology[id=0] [21:10:59] : [Step 4/5] [2021-11-19 21:10:59,435][INFO ][exchange-worker-#22002%grid-1%][GridCacheDatabaseSharedManager] Finish recovery performed in 7 ms. [21:10:59] : [Step 4/5] [2021-11-19 21:10:59,436][INFO ][exchange-worker-#22002%grid-1%][msg] Components activation performed in 9 ms. [21:10:59] : [Step 4/5] [2021-11-19 21:10:59,437][INFO ][exchange-worker-#22002%grid-1%][GridCacheProcessor] Finished recovery for cache [cache=encrypted, grp=encrypted, startVer=AffinityTopologyVersion [topVer=4, minorTopVer=0]] [21:10:59] : [Step 4/5] [2021-11-19 21:10:59,437][INFO ][sys-#21982%grid-1%][GridCacheProcessor] Finished recovery for cache [cache=ignite-sys-cache, grp=ignite-sys-cache, startVer=AffinityTopologyVersion [topVer=4, minorTopVer=0]] [21:10:59] : [Step 4/5] [2021-11-19 21:10:59,438][INFO ][exchange-worker-#22002%grid-1%][GridCacheProcessor] Starting caches on local join performed in 0 ms. [21:10:59] : [Step 4/5] [2021-11-19 21:10:59,439][INFO ][exchange-worker-#22002%grid-1%][GridDhtPartitionsExchangeFuture] Skipped waiting for partitions release future (local node is joining) [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0]] [21:10:59] : [Step 4/5] [2021-11-19 21:10:59,445][INFO ][grid-nio-worker-tcp-comm-1-#21662%TestRecordingCommunicationSpi%][TestRecordingCommunicationSpi] Accepted incoming communication connection [locAddr=/127.0.0.1:47100, rmtAddr=/127.0.0.1:33426] [21:10:59] : [Step 4/5] [2021-11-19 21:10:59,447][INFO ][grid-nio-worker-tcp-comm-0-#21935%TestRecordingCommunicationSpi%][TestRecordingCommunicationSpi] Established outgoing communication connection [locAddr=/127.0.0.1:33426, rmtAddr=/127.0.0.1:47100] [21:10:59] : [Step 4/5] [2021-11-19 21:10:59,447][INFO ][exchange-worker-#22002%grid-1%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], crd=false] [21:10:59] : [Step 4/5] [2021-11-19 21:10:59,448][INFO ][sys-#21706%grid-0%][GridDhtPartitionsExchangeFuture] Coordinator received single message [ver=AffinityTopologyVersion [topVer=4, minorTopVer=0], node=10fe436a-de49-4605-a91d-ce25d9b0a001, allReceived=true] [21:10:59] : [Step 4/5] [2021-11-19 21:10:59,449][INFO ][sys-#21706%grid-0%][GridDhtPartitionsExchangeFuture] Coordinator received all messages, try merge [ver=AffinityTopologyVersion [topVer=4, minorTopVer=0]] [21:10:59] : [Step 4/5] [2021-11-19 21:10:59,449][INFO ][sys-#21706%grid-0%][GridDhtPartitionsExchangeFuture] finishExchangeOnCoordinator [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=0]] [21:10:59] : [Step 4/5] [2021-11-19 21:10:59,454][INFO ][sys-#21706%grid-0%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], err=null, rebalanced=false, wasRebalanced=true] [21:10:59] : [Step 4/5] [2021-11-19 21:10:59,455][INFO ][sys-#21706%grid-0%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=00db608c-526f-476a-ba3c-0d39102bb000, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], evt=NODE_JOINED, evtNode=TcpDiscoveryNode [id=10fe436a-de49-4605-a91d-ce25d9b0a001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=4, intOrder=3, lastExchangeTime=1637345459235, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=false, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0]] [21:10:59] : [Step 4/5] [2021-11-19 21:10:59,456][INFO ][sys-#21706%grid-0%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (0 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Wait partitions release latch [latch=exchange]" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="After states restored callback" (0 ms), stage="WAL history reservation" (0 ms), stage="Waiting for all single messages" (169 ms), stage="Exchanges merge" (0 ms), stage="Affinity recalculation (crd)" (0 ms), stage="Collect update counters and create affinity messages" (0 ms), stage="Assign partitions states" (0 ms), stage="Validate partitions states" (0 ms), stage="Apply update counters" (0 ms), stage="Full message preparing" (3 ms), stage="Full message sending" (0 ms), stage="Exchange done" (1 ms), stage="Total time" (173 ms), Discovery lag=4 ms, Latest started node id=10fe436a-de49-4605-a91d-ce25d9b0a001] [21:10:59] : [Step 4/5] [2021-11-19 21:10:59,458][INFO ][sys-#21706%grid-0%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], stage="Affinity initialization (node join) [grp=ignite-sys-cache, crd=true]" (0 ms) (parent=Affinity recalculation (crd)), stage="Affinity initialization (node join) [grp=encrypted, crd=true]" (0 ms) (parent=Affinity recalculation (crd))] [21:10:59] : [Step 4/5] [2021-11-19 21:10:59,455][INFO ][sys-#21989%grid-1%][GridDhtPartitionsExchangeFuture] Received full message, will finish exchange [node=00db608c-526f-476a-ba3c-0d39102bb000, resVer=AffinityTopologyVersion [topVer=4, minorTopVer=0]] [21:10:59] : [Step 4/5] [2021-11-19 21:10:59,455][INFO ][exchange-worker-#21723%grid-0%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=4, minorTopVer=0], force=false, evt=NODE_JOINED, node=10fe436a-de49-4605-a91d-ce25d9b0a001] [21:10:59] : [Step 4/5] [2021-11-19 21:10:59,461][INFO ][sys-#21989%grid-1%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], err=null, rebalanced=false, wasRebalanced=false] [21:10:59] : [Step 4/5] [2021-11-19 21:10:59,462][INFO ][sys-#21989%grid-1%][GridCacheProcessor] Finish proxy initialization, cacheName=ignite-sys-cache, localNodeId=10fe436a-de49-4605-a91d-ce25d9b0a001 [21:10:59] : [Step 4/5] [2021-11-19 21:10:59,462][INFO ][sys-#21989%grid-1%][GridCacheProcessor] Finish proxy initialization, cacheName=encrypted, localNodeId=10fe436a-de49-4605-a91d-ce25d9b0a001 [21:10:59] : [Step 4/5] [2021-11-19 21:10:59,463][INFO ][sys-#21989%grid-1%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=10fe436a-de49-4605-a91d-ce25d9b0a001, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], evt=NODE_JOINED, evtNode=TcpDiscoveryNode [id=10fe436a-de49-4605-a91d-ce25d9b0a001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=4, intOrder=3, lastExchangeTime=1637345459421, loc=true, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=false, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0]] [21:10:59] : [Step 4/5] [2021-11-19 21:10:59,464][INFO ][sys-#21989%grid-1%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], stage="Waiting in exchange queue" (146 ms), stage="Exchange parameters initialization" (0 ms), stage="Components activation" (9 ms), stage="Determine exchange type" (2 ms), stage="Preloading notification" (0 ms), stage="Restore partition states" (0 ms), stage="After states restored callback" (3 ms), stage="WAL history reservation" (0 ms), stage="Waiting for Full message" (12 ms), stage="Affinity recalculation" (4 ms), stage="Full map updating" (1 ms), stage="Exchange done" (2 ms), stage="Total time" (179 ms)] [21:10:59] : [Step 4/5] [2021-11-19 21:10:59,465][INFO ][sys-#21989%grid-1%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], stage="Affinity fetch" (2 ms) (parent=Determine exchange type), stage="Restore partition states [grp=ignite-sys-cache]" (0 ms) (parent=Restore partition states), stage="Restore partition states [grp=encrypted]" (0 ms) (parent=Restore partition states), stage="Affinity initialization (local join) [grp=ignite-sys-cache]" (4 ms) (parent=Affinity recalculation), stage="Affinity initialization (local join) [grp=encrypted]" (4 ms) (parent=Affinity recalculation)] [21:10:59] : [Step 4/5] [2021-11-19 21:10:59,463][INFO ][exchange-worker-#22002%grid-1%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=4, minorTopVer=0], force=false, evt=NODE_JOINED, node=10fe436a-de49-4605-a91d-ce25d9b0a001] [21:10:59] : [Step 4/5] [2021-11-19 21:10:59,464][INFO ][exchange-worker-#21723%grid-0%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], crd=true, evt=DISCOVERY_CUSTOM_EVT, evtNode=00db608c-526f-476a-ba3c-0d39102bb000, customEvt=CacheAffinityChangeMessage [id=7868d593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], exchId=null, partsMsg=null, exchangeNeeded=true], allowMerge=false, exchangeFreeSwitch=false] [21:10:59] : [Step 4/5] [2021-11-19 21:10:59,468][INFO ][exchange-worker-#22002%grid-1%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], crd=false, evt=DISCOVERY_CUSTOM_EVT, evtNode=00db608c-526f-476a-ba3c-0d39102bb000, customEvt=CacheAffinityChangeMessage [id=7868d593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], exchId=null, partsMsg=null, exchangeNeeded=true], allowMerge=false, exchangeFreeSwitch=false] [21:10:59] : [Step 4/5] [2021-11-19 21:10:59,468][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] To start Console Management & Monitoring run ignitevisorcmd.{sh|bat} [21:10:59] : [Step 4/5] [2021-11-19 21:10:59,468][INFO ][reencrypt-#22014%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:10:59] : [Step 4/5] [2021-11-19 21:10:59,469][INFO ][exchange-worker-#22002%grid-1%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], waitTime=0ms, futInfo=NA, mode=DISTRIBUTED] [21:10:59] : [Step 4/5] [2021-11-19 21:10:59,469][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] [21:10:59] : [Step 4/5] [21:10:59] : [Step 4/5] >>> +-------------------------------------------+ [21:10:59] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:10:59] : [Step 4/5] >>> +-------------------------------------------+ [21:10:59] : [Step 4/5] >>> OS name: Linux 4.15.0-151-generic amd64 [21:10:59] : [Step 4/5] >>> CPU(s): 24 [21:10:59] : [Step 4/5] >>> Heap: 2.0GB [21:10:59] : [Step 4/5] >>> VM name: 16724@c4dfe9a430b2 [21:10:59] : [Step 4/5] >>> Ignite instance name: grid-1 [21:10:59] : [Step 4/5] >>> Local node [ID=10FE436A-DE49-4605-A91D-CE25D9B0A001, order=4, clientMode=false] [21:10:59] : [Step 4/5] >>> Local node addresses: [127.0.0.1] [21:10:59] : [Step 4/5] >>> Local ports: TCP:10801 TCP:47101 TCP:47501 [21:10:59] : [Step 4/5] [21:10:59] : [Step 4/5] [2021-11-19 21:10:59,469][INFO ][exchange-worker-#21723%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], waitTime=0ms, futInfo=NA, mode=DISTRIBUTED] [21:10:59] : [Step 4/5] [2021-11-19 21:10:59,471][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][GridDiscoveryManager] Topology snapshot [ver=4, locNode=10fe436a, servers=2, clients=0, state=ACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=00db608c-526f-476a-ba3c-0d39102bb000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=10fe436a-de49-4605-a91d-ce25d9b0a001, consistentId=grid-1, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:10:59] : [Step 4/5] [2021-11-19 21:10:59,472][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][GridDiscoveryManager] ^-- Baseline [id=0, size=2, online=2, offline=0] [21:10:59] : [Step 4/5] [2021-11-19 21:10:59,471][INFO ][exchange-worker-#22002%grid-1%][GridDhtPartitionsExchangeFuture] Finished waiting for partitions release latch: ClientLatch [coordinator=TcpDiscoveryNode [id=00db608c-526f-476a-ba3c-0d39102bb000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345459255, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], ackSent=true, super=CompletableLatch [id=CompletableLatchUid [id=exchange, topVer=AffinityTopologyVersion [topVer=4, minorTopVer=1]]]] [21:10:59] : [Step 4/5] [2021-11-19 21:10:59,471][INFO ][exchange-worker-#21723%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partitions release latch: ServerLatch [permits=0, pendingAcks=HashSet [], super=CompletableLatch [id=CompletableLatchUid [id=exchange, topVer=AffinityTopologyVersion [topVer=4, minorTopVer=1]]]] [21:10:59] : [Step 4/5] [2021-11-19 21:10:59,474][INFO ][exchange-worker-#21723%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:10:59] : [Step 4/5] [2021-11-19 21:10:59,473][INFO ][exchange-worker-#22002%grid-1%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:10:59] : [Step 4/5] [2021-11-19 21:10:59,472][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][G] Node started : [stage="Configure system pool" (0 ms),stage="Start managers" (179 ms),stage="Configure binary metadata" (1 ms),stage="Start processors" (255 ms),stage="Start 'StanByClusterTestProvider' plugin" (0 ms),stage="Start 'PageMemory tracker plugin' plugin" (0 ms),stage="Start 'TestDistibutedConfigurationPlugin' plugin" (0 ms),stage="Start 'NodeValidationPluginProvider' plugin" (0 ms),stage="Init metastore" (88 ms),stage="Init and start regions" (5 ms),stage="Restore binary memory" (586 ms),stage="Restore logical state" (19 ms),stage="Finish recovery" (19 ms),stage="Join topology" (51 ms),stage="Await transition" (2 ms),stage="Await exchange" (190 ms),stage="Total time" (1395 ms)] [21:10:59] : [Step 4/5] [2021-11-19 21:10:59,475][INFO ][sys-#21709%grid-0%][GridDhtPartitionsExchangeFuture] Coordinator received single message [ver=AffinityTopologyVersion [topVer=4, minorTopVer=1], node=10fe436a-de49-4605-a91d-ce25d9b0a001, allReceived=true] [21:10:59] : [Step 4/5] [2021-11-19 21:10:59,475][INFO ][exchange-worker-#22002%grid-1%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], crd=false] [21:10:59] : [Step 4/5] [2021-11-19 21:10:59,474][INFO ][exchange-worker-#21723%grid-0%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], crd=true] [21:10:59] : [Step 4/5] [2021-11-19 21:10:59,476][INFO ][sys-#21709%grid-0%][GridDhtPartitionsExchangeFuture] finishExchangeOnCoordinator [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=1]] [21:10:59] : [Step 4/5] [2021-11-19 21:10:59,475][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][root] Node started with the following configuration [id=10fe436a-de49-4605-a91d-ce25d9b0a001, marshaller=BinaryMarshaller [], discovery=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=5000, ackTimeout=5000, marsh=JdkMarshaller [clsFilter=org.apache.ignite.marshaller.MarshallerUtils$1@6bb0ec5d], reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], binaryCfg=null, lateAff=true] [21:10:59] : [Step 4/5] [2021-11-19 21:10:59,478][INFO ][sys-#21709%grid-0%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], err=null, rebalanced=true, wasRebalanced=false] [21:10:59] : [Step 4/5] [2021-11-19 21:10:59,479][INFO ][sys-#21971%grid-1%][GridDhtPartitionsExchangeFuture] Received full message, will finish exchange [node=00db608c-526f-476a-ba3c-0d39102bb000, resVer=AffinityTopologyVersion [topVer=4, minorTopVer=1]] [21:10:59] : [Step 4/5] [2021-11-19 21:10:59,479][INFO ][exchange-worker-#21723%grid-0%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=4, minorTopVer=1], force=false, evt=DISCOVERY_CUSTOM_EVT, node=00db608c-526f-476a-ba3c-0d39102bb000] [21:10:59] : [Step 4/5] [2021-11-19 21:10:59,479][INFO ][sys-#21709%grid-0%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=00db608c-526f-476a-ba3c-0d39102bb000, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=00db608c-526f-476a-ba3c-0d39102bb000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345459464, loc=true, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=4, minorTopVer=1]] [21:10:59] : [Step 4/5] [2021-11-19 21:10:59,482][INFO ][sys-#21709%grid-0%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (3 ms), stage="Determine exchange type" (2 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (1 ms), stage="Wait partitions release latch [latch=exchange]" (2 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="After states restored callback" (0 ms), stage="WAL history reservation" (0 ms), stage="Waiting for all single messages" (1 ms), stage="Affinity recalculation (crd)" (0 ms), stage="Collect update counters and create affinity messages" (0 ms), stage="Validate partitions states" (0 ms), stage="Apply update counters" (0 ms), stage="Full message preparing" (1 ms), stage="Full message sending" (0 ms), stage="Exchange done" (3 ms), stage="Total time" (13 ms), Discovery lag=4 ms, Latest started node id=10fe436a-de49-4605-a91d-ce25d9b0a001] [21:10:59] : [Step 4/5] [2021-11-19 21:10:59,481][INFO ][exchange-worker-#21723%grid-0%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=2], crd=true, evt=DISCOVERY_CUSTOM_EVT, evtNode=10fe436a-de49-4605-a91d-ce25d9b0a001, customEvt=DynamicCacheChangeBatch [id=8968d593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqs=ArrayList [DynamicCacheChangeRequest [cacheName=encrypted, hasCfg=false, nodeId=10fe436a-de49-4605-a91d-ce25d9b0a001, clientStartOnly=false, stop=false, destroy=false, disabledAfterStart=false]], exchangeActions=ExchangeActions [startCaches=null, stopCaches=null, startGrps=[], stopGrps=[], resetParts=[encrypted], stateChangeRequest=null], startCaches=false], allowMerge=false, exchangeFreeSwitch=false] [21:10:59] : [Step 4/5] [2021-11-19 21:10:59,480][INFO ][sys-#21971%grid-1%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], err=null, rebalanced=true, wasRebalanced=false] [21:10:59] : [Step 4/5] [2021-11-19 21:10:59,485][INFO ][exchange-worker-#21723%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=2], waitTime=0ms, futInfo=NA, mode=DISTRIBUTED] [21:10:59] : [Step 4/5] [2021-11-19 21:10:59,484][INFO ][sys-#21709%grid-0%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], stage="Affinity change by custom message [grp=ignite-sys-cache]" (2 ms) (parent=Determine exchange type)] [21:10:59] : [Step 4/5] [2021-11-19 21:10:59,486][INFO ][exchange-worker-#22002%grid-1%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=4, minorTopVer=1], force=false, evt=DISCOVERY_CUSTOM_EVT, node=00db608c-526f-476a-ba3c-0d39102bb000] [21:10:59] : [Step 4/5] [2021-11-19 21:10:59,486][INFO ][sys-#21971%grid-1%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=10fe436a-de49-4605-a91d-ce25d9b0a001, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=00db608c-526f-476a-ba3c-0d39102bb000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345459255, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=4, minorTopVer=1]] [21:10:59] : [Step 4/5] [2021-11-19 21:10:59,489][INFO ][sys-#21971%grid-1%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (0 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Wait partitions release latch [latch=exchange]" (3 ms), stage="Wait partitions release [latch=exchange]" (1 ms), stage="After states restored callback" (0 ms), stage="WAL history reservation" (0 ms), stage="Waiting for Full message" (4 ms), stage="Affinity recalculation" (0 ms), stage="Full map updating" (1 ms), stage="Exchange done" (8 ms), stage="Total time" (17 ms)] [21:10:59] : [Step 4/5] [2021-11-19 21:10:59,490][INFO ][sys-#21971%grid-1%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], stage="Affinity change by custom message [grp=ignite-sys-cache]" (0 ms) (parent=Determine exchange type)] [21:10:59] : [Step 4/5] [2021-11-19 21:10:59,487][INFO ][exchange-worker-#22002%grid-1%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=2], crd=false, evt=DISCOVERY_CUSTOM_EVT, evtNode=10fe436a-de49-4605-a91d-ce25d9b0a001, customEvt=DynamicCacheChangeBatch [id=8968d593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqs=ArrayList [DynamicCacheChangeRequest [cacheName=encrypted, hasCfg=false, nodeId=10fe436a-de49-4605-a91d-ce25d9b0a001, clientStartOnly=false, stop=false, destroy=false, disabledAfterStart=false]], exchangeActions=ExchangeActions [startCaches=null, stopCaches=null, startGrps=[], stopGrps=[], resetParts=[encrypted], stateChangeRequest=null], startCaches=false], allowMerge=false, exchangeFreeSwitch=false] [21:10:59] : [Step 4/5] [2021-11-19 21:10:59,493][INFO ][exchange-worker-#22002%grid-1%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=2], waitTime=0ms, futInfo=NA, mode=DISTRIBUTED] [21:10:59] : [Step 4/5] [2021-11-19 21:10:59,494][INFO ][exchange-worker-#21723%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partitions release latch: ServerLatch [permits=0, pendingAcks=HashSet [], super=CompletableLatch [id=CompletableLatchUid [id=exchange, topVer=AffinityTopologyVersion [topVer=4, minorTopVer=2]]]] [21:10:59] : [Step 4/5] [2021-11-19 21:10:59,495][INFO ][exchange-worker-#21723%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=2], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:10:59] : [Step 4/5] [2021-11-19 21:10:59,494][INFO ][exchange-worker-#22002%grid-1%][GridDhtPartitionsExchangeFuture] Finished waiting for partitions release latch: ClientLatch [coordinator=TcpDiscoveryNode [id=00db608c-526f-476a-ba3c-0d39102bb000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345459255, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], ackSent=true, super=CompletableLatch [id=CompletableLatchUid [id=exchange, topVer=AffinityTopologyVersion [topVer=4, minorTopVer=2]]]] [21:10:59] : [Step 4/5] [2021-11-19 21:10:59,495][INFO ][exchange-worker-#21723%grid-0%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=2], crd=true] [21:10:59] : [Step 4/5] [2021-11-19 21:10:59,496][INFO ][exchange-worker-#22002%grid-1%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=2], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:10:59] : [Step 4/5] [2021-11-19 21:10:59,498][INFO ][exchange-worker-#22002%grid-1%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=2], crd=false] [21:10:59] : [Step 4/5] [2021-11-19 21:10:59,498][INFO ][sys-#21712%grid-0%][GridDhtPartitionsExchangeFuture] Coordinator received single message [ver=AffinityTopologyVersion [topVer=4, minorTopVer=2], node=10fe436a-de49-4605-a91d-ce25d9b0a001, allReceived=true] [21:10:59] : [Step 4/5] [2021-11-19 21:10:59,499][INFO ][sys-#21712%grid-0%][GridDhtPartitionsExchangeFuture] finishExchangeOnCoordinator [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=2]] [21:10:59] : [Step 4/5] [2021-11-19 21:10:59,502][INFO ][sys-#21712%grid-0%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=4, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=2], err=null, rebalanced=true, wasRebalanced=true] [21:10:59] : [Step 4/5] [2021-11-19 21:10:59,503][INFO ][sys-#21990%grid-1%][GridDhtPartitionsExchangeFuture] Received full message, will finish exchange [node=00db608c-526f-476a-ba3c-0d39102bb000, resVer=AffinityTopologyVersion [topVer=4, minorTopVer=2]] [21:10:59] : [Step 4/5] [2021-11-19 21:10:59,503][INFO ][exchange-worker-#21723%grid-0%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=4, minorTopVer=2], force=false, evt=DISCOVERY_CUSTOM_EVT, node=10fe436a-de49-4605-a91d-ce25d9b0a001] [21:10:59] : [Step 4/5] [2021-11-19 21:10:59,503][INFO ][sys-#21712%grid-0%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=00db608c-526f-476a-ba3c-0d39102bb000, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=2], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=10fe436a-de49-4605-a91d-ce25d9b0a001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=4, intOrder=3, lastExchangeTime=1637345459235, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=4, minorTopVer=2]] [21:10:59] : [Step 4/5] [2021-11-19 21:10:59,503][INFO ][sys-#21990%grid-1%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=4, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=2], err=null, rebalanced=true, wasRebalanced=true] [21:10:59] : [Step 4/5] [2021-11-19 21:10:59,505][INFO ][sys-#21712%grid-0%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=4, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=2], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (3 ms), stage="Update caches registry" (0 ms), stage="Start caches" (0 ms), stage="Affinity initialization on cache group start" (0 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Wait partitions release latch [latch=exchange]" (8 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="After states restored callback" (0 ms), stage="WAL history reservation" (0 ms), stage="Waiting for all single messages" (3 ms), stage="Affinity recalculation (crd)" (0 ms), stage="Collect update counters and create affinity messages" (0 ms), stage="Assign partitions states" (0 ms), stage="Validate partitions states" (0 ms), stage="Ideal affinity diff calculation (enforced)" (0 ms), stage="Apply update counters" (0 ms), stage="Full message preparing" (1 ms), stage="Full message sending" (0 ms), stage="Exchange done" (3 ms), stage="Total time" (18 ms)] [21:10:59] : [Step 4/5] [2021-11-19 21:10:59,508][INFO ][sys-#21712%grid-0%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=4, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=2], stage="Affinity centralized initialization (crd) [grp=ignite-sys-cache, crd=true]" (0 ms) (parent=Determine exchange type), stage="Affinity centralized initialization (crd) [grp=encrypted, crd=true]" (0 ms) (parent=Determine exchange type), stage="Affinity recalculation (partitions availability) [grp=ignite-sys-cache]" (0 ms) (parent=Ideal affinity diff calculation (enforced)), stage="Affinity recalculation (partitions availability) [grp=encrypted]" (0 ms) (parent=Ideal affinity diff calculation (enforced))] [21:10:59] : [Step 4/5] [2021-11-19 21:10:59,506][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][root] awaitPartitionMapExchange finished [21:10:59] : [Step 4/5] [2021-11-19 21:10:59,506][INFO ][exchange-worker-#22002%grid-1%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=4, minorTopVer=2], force=false, evt=DISCOVERY_CUSTOM_EVT, node=10fe436a-de49-4605-a91d-ce25d9b0a001] [21:10:59] : [Step 4/5] [2021-11-19 21:10:59,506][INFO ][sys-#21990%grid-1%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=10fe436a-de49-4605-a91d-ce25d9b0a001, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=2], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=10fe436a-de49-4605-a91d-ce25d9b0a001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=4, intOrder=3, lastExchangeTime=1637345459474, loc=true, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=4, minorTopVer=2]] [21:10:59] : [Step 4/5] [2021-11-19 21:10:59,512][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10fe436a-de49-4605-a91d-ce25d9b0a001, grp=1613773252] [21:10:59] : [Step 4/5] [2021-11-19 21:10:59,513][INFO ][sys-#21990%grid-1%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=4, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=2], stage="Waiting in exchange queue" (5 ms), stage="Exchange parameters initialization" (5 ms), stage="Update caches registry" (0 ms), stage="Start caches" (0 ms), stage="Affinity initialization on cache group start" (0 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Wait partitions release latch [latch=exchange]" (2 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="After states restored callback" (0 ms), stage="WAL history reservation" (0 ms), stage="Waiting for Full message" (5 ms), stage="Affinity recalculation" (0 ms), stage="Full map updating" (0 ms), stage="Exchange done" (9 ms), stage="Total time" (26 ms)] [21:10:59] : [Step 4/5] [2021-11-19 21:10:59,516][INFO ][sys-#21990%grid-1%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=4, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=2], stage="Affinity centralized initialization (crd) [grp=ignite-sys-cache, crd=false]" (0 ms) (parent=Determine exchange type), stage="Affinity centralized initialization (crd) [grp=encrypted, crd=false]" (0 ms) (parent=Determine exchange type), stage="Affinity applying from full message [grp=ignite-sys-cache]" (0 ms) (parent=Affinity recalculation), stage="Affinity applying from full message [grp=encrypted]" (0 ms) (parent=Affinity recalculation)] [21:10:59] : [Step 4/5] [2021-11-19 21:10:59,986][INFO ][db-checkpoint-thread-#22007%grid-1%][Checkpointer] Checkpoint started [checkpointId=beb49e9b-c80c-44fa-87ce-9fcf715c56f0, startPtr=WALPointer [idx=0, fileOff=318728, len=2064], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=2ms, walCpRecordFsyncDuration=533ms, writeCheckpointEntryDuration=10ms, splitAndSortCpPagesDuration=0ms, pages=72, reason='node started'] [21:11:00] : [Step 4/5] [2021-11-19 21:11:00,837][INFO ][db-checkpoint-thread-#22007%grid-1%][Checkpointer] Checkpoint finished [cpId=beb49e9b-c80c-44fa-87ce-9fcf715c56f0, pages=72, markPos=WALPointer [idx=0, fileOff=318728, len=2064], walSegmentsCovered=[], markDuration=546ms, pagesWrite=9ms, fsync=841ms, total=1397ms] [21:11:00] : [Step 4/5] [2021-11-19 21:11:00,847][INFO ][db-checkpoint-thread-#22007%grid-1%][Checkpointer] Checkpoint started [checkpointId=b76f257a-aa6e-4c0b-9296-903b5c7daa71, startPtr=WALPointer [idx=0, fileOff=346571, len=2048], checkpointBeforeLockTime=2ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=5ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=0ms, pages=6, reason='test'] [21:11:00] : [Step 4/5] [2021-11-19 21:11:00,857][INFO ][db-checkpoint-thread-#22007%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:11:00] : [Step 4/5] [2021-11-19 21:11:00,857][INFO ][db-checkpoint-thread-#22007%grid-1%][Checkpointer] Checkpoint finished [cpId=b76f257a-aa6e-4c0b-9296-903b5c7daa71, pages=6, markPos=WALPointer [idx=0, fileOff=346571, len=2048], walSegmentsCovered=[], markDuration=8ms, pagesWrite=1ms, fsync=9ms, total=20ms] [21:11:00] : [Step 4/5] [2021-11-19 21:11:00,859][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00db608c-526f-476a-ba3c-0d39102bb000, grp=1613773252] [21:11:00] : [Step 4/5] [2021-11-19 21:11:00,865][INFO ][disco-notifier-worker-#21718%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=2] [21:11:00] : [Step 4/5] [2021-11-19 21:11:00,866][INFO ][reencrypt-#21880%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:11:00] : [Step 4/5] [2021-11-19 21:11:00,866][INFO ][disco-notifier-worker-#21993%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=2] [21:11:00] : [Step 4/5] [2021-11-19 21:11:00,866][INFO ][reencrypt-#22014%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:11:01] : [Step 4/5] [2021-11-19 21:11:01,070][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10fe436a-de49-4605-a91d-ce25d9b0a001, grp=1613773252] [21:11:01] : [Step 4/5] [2021-11-19 21:11:01,656][INFO ][db-checkpoint-thread-#22007%grid-1%][Checkpointer] Checkpoint started [checkpointId=19dcda49-a519-4b55-ac65-18a08f44bbc6, startPtr=WALPointer [idx=0, fileOff=623823, len=2048], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=304ms, writeCheckpointEntryDuration=279ms, splitAndSortCpPagesDuration=0ms, pages=66, reason='test'] [21:11:01] : [Step 4/5] [2021-11-19 21:11:01,676][INFO ][db-checkpoint-thread-#22007%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:11:01] : [Step 4/5] [2021-11-19 21:11:01,676][INFO ][db-checkpoint-thread-#22007%grid-1%][Checkpointer] Checkpoint finished [cpId=19dcda49-a519-4b55-ac65-18a08f44bbc6, pages=66, markPos=WALPointer [idx=0, fileOff=623823, len=2048], walSegmentsCovered=[], markDuration=585ms, pagesWrite=4ms, fsync=15ms, total=605ms] [21:11:01] : [Step 4/5] [2021-11-19 21:11:01,677][INFO ][test-runner-#21606%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00db608c-526f-476a-ba3c-0d39102bb000, grp=1613773252] [21:11:01] : [Step 4/5] [2021-11-19 21:11:01,685][INFO ][db-checkpoint-thread-#21857%grid-0%][Checkpointer] Checkpoint started [checkpointId=ffd0f0c6-4458-4508-8232-2d346a646c35, startPtr=WALPointer [idx=0, fileOff=336511, len=2010], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=1ms, checkpointLockHoldTime=2ms, walCpRecordFsyncDuration=2ms, writeCheckpointEntryDuration=2ms, splitAndSortCpPagesDuration=0ms, pages=43, reason='test'] [21:11:01] : [Step 4/5] [2021-11-19 21:11:01,703][INFO ][db-checkpoint-thread-#21857%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:11:01] : [Step 4/5] [2021-11-19 21:11:01,704][INFO ][db-checkpoint-thread-#21857%grid-0%][Checkpointer] Checkpoint finished [cpId=ffd0f0c6-4458-4508-8232-2d346a646c35, pages=43, markPos=WALPointer [idx=0, fileOff=336511, len=2010], walSegmentsCovered=[], markDuration=6ms, pagesWrite=3ms, fsync=16ms, total=26ms] [21:11:01] : [Step 4/5] [21:11:01] >>> Stopping test: CacheGroupKeyChangeTest#testNodeFailsAfterPrepare in 8631 ms <<< [21:11:01] : [Step 4/5] [2021-11-19 21:11:01,705][INFO ][main][root] >>> Stopping test: CacheGroupKeyChangeTest#testNodeFailsAfterPrepare in 8631 ms <<< [21:11:01] : [Step 4/5] [21:11:01] >>> Heap: 232 MB used / 1938 MB commited / 1938 MB max <<< [21:11:01] : [Step 4/5] [2021-11-19 21:11:01,706][INFO ][main][root] >>> Heap: 232 MB used / 1938 MB commited / 1938 MB max <<< [21:11:01] : [Step 4/5] [21:11:01] >>> Non-Heap: 161 MB used / 184 MB commited / 0 MB max <<< [21:11:01] : [Step 4/5] [2021-11-19 21:11:01,706][INFO ][main][root] >>> Non-Heap: 161 MB used / 184 MB commited / 0 MB max <<< [21:11:01] : [Step 4/5] [2021-11-19 21:11:01,706][INFO ][main][root] >>> Stopping grid [name=grid-1, id=10fe436a-de49-4605-a91d-ce25d9b0a001] [21:11:01] : [Step 4/5] [2021-11-19 21:11:01,713][INFO ][db-checkpoint-thread-#22007%grid-1%][Checkpointer] Skipping checkpoint (no pages were modified) [checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, reason='timeout'] [21:11:01] : [Step 4/5] [2021-11-19 21:11:01,721][INFO ][tcp-disco-sock-reader-[00db608c 127.0.0.1:38341]-#1156%grid-1%-#21998%grid-1%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:38341, rmtPort=38341, rmtNodeId=00db608c-526f-476a-ba3c-0d39102bb000] [21:11:01] : [Step 4/5] [2021-11-19 21:11:01,721][INFO ][disco-event-worker-#21722%grid-0%][GridDiscoveryManager] Node left topology: TcpDiscoveryNode [id=10fe436a-de49-4605-a91d-ce25d9b0a001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=4, intOrder=3, lastExchangeTime=1637345459235, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false] [21:11:01] : [Step 4/5] [2021-11-19 21:11:01,726][INFO ][main][GridCacheProcessor] Stopped cache [cacheName=encrypted] [21:11:01] : [Step 4/5] [2021-11-19 21:11:01,727][INFO ][disco-event-worker-#21722%grid-0%][GridDiscoveryManager] Topology snapshot [ver=5, locNode=00db608c, servers=1, clients=0, state=ACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=00db608c-526f-476a-ba3c-0d39102bb000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:11:01] : [Step 4/5] [2021-11-19 21:11:01,727][INFO ][main][GridCacheProcessor] Stopped cache [cacheName=ignite-sys-cache] [21:11:01] : [Step 4/5] [2021-11-19 21:11:01,728][INFO ][disco-event-worker-#21722%grid-0%][GridDiscoveryManager] ^-- Baseline [id=0, size=2, online=1, offline=1] [21:11:01] : [Step 4/5] [2021-11-19 21:11:01,731][INFO ][exchange-worker-#21723%grid-0%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], crd=true, evt=NODE_LEFT, evtNode=10fe436a-de49-4605-a91d-ce25d9b0a001, customEvt=null, allowMerge=false, exchangeFreeSwitch=true] [21:11:01] : [Step 4/5] [2021-11-19 21:11:01,732][INFO ][sys-#21710%grid-0%][GridAffinityAssignmentCache] Local node affinity assignment distribution is not ideal [cache=encrypted, expectedPrimary=8.00, actualPrimary=3, expectedBackups=0.00, actualBackups=0, warningThreshold=50.00%] [21:11:01] : [Step 4/5] [2021-11-19 21:11:01,732][INFO ][main][FilePageStoreManager] Cleanup cache stores [total=4, left=0, cleanFiles=false] [21:11:01] : [Step 4/5] [2021-11-19 21:11:01,733][INFO ][exchange-worker-#21723%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:11:01] : [Step 4/5] [2021-11-19 21:11:01,734][INFO ][main][GridDeploymentLocalStore] Removed undeployed class: GridDeployment [ts=1637345459454, depMode=SHARED, clsLdr=IsolatedClassLoader{roleName='test'}, clsLdrId=5868d593d71-10fe436a-de49-4605-a91d-ce25d9b0a001, userVer=0, loc=true, sampleClsName=org.apache.ignite.internal.processors.cache.distributed.dht.preloader.IgniteDhtPartitionHistorySuppliersMap, pendingUndeploy=false, undeployed=true, usage=0] [21:11:01] : [Step 4/5] [2021-11-19 21:11:01,735][INFO ][exchange-worker-#21723%grid-0%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], err=null, rebalanced=true, wasRebalanced=true] [21:11:01] : [Step 4/5] [2021-11-19 21:11:01,742][INFO ][main][IgniteKernal%grid-1] [21:11:01] : [Step 4/5] [21:11:01] : [Step 4/5] >>> +------------------------------------------------------+ [21:11:01] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV stopped OK [21:11:01] : [Step 4/5] >>> +------------------------------------------------------+ [21:11:01] : [Step 4/5] >>> Ignite instance name: grid-1 [21:11:01] : [Step 4/5] >>> Grid uptime: 00:00:02.275 [21:11:01] : [Step 4/5] [21:11:01] : [Step 4/5] [21:11:01] : [Step 4/5] [2021-11-19 21:11:01,743][INFO ][main][root] >>> Stopping grid [name=grid-0, id=00db608c-526f-476a-ba3c-0d39102bb000] [21:11:01]W: [org.apache.ignite:ignite-core] [2021-11-19 21:11:01,745][WARN ][exchange-worker-#21723%grid-0%][GridDhtPartitionTopologyImpl] Detected lost partitions [grp=encrypted, parts=[0, 2, 4, 6-7], topVer=AffinityTopologyVersion [topVer=5, minorTopVer=0]] [21:11:01] : [Step 4/5] [2021-11-19 21:11:01,746][INFO ][exchange-worker-#21723%grid-0%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=00db608c-526f-476a-ba3c-0d39102bb000, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], evt=NODE_LEFT, evtNode=TcpDiscoveryNode [id=10fe436a-de49-4605-a91d-ce25d9b0a001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=4, intOrder=3, lastExchangeTime=1637345459235, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=5, minorTopVer=0]] [21:11:01] : [Step 4/5] [2021-11-19 21:11:01,747][INFO ][exchange-worker-#21723%grid-0%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (0 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="After states restored callback" (1 ms), stage="WAL history reservation" (0 ms), stage="Finalize update counters" (0 ms), stage="Detect lost partitions" (10 ms), stage="Exchange done" (1 ms), stage="Total time" (12 ms)] [21:11:01] : [Step 4/5] [2021-11-19 21:11:01,748][INFO ][exchange-worker-#21723%grid-0%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], stage="Affinity initialization (exchange-free switch on fully-rebalanced topology) [grp=ignite-sys-cache]" (0 ms) (parent=Determine exchange type), stage="Affinity initialization (exchange-free switch on fully-rebalanced topology) [grp=encrypted]" (0 ms) (parent=Determine exchange type)] [21:11:01] : [Step 4/5] [2021-11-19 21:11:01,749][INFO ][exchange-worker-#21723%grid-0%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], crd=true] [21:11:01] : [Step 4/5] [2021-11-19 21:11:01,749][INFO ][exchange-worker-#21723%grid-0%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=5, minorTopVer=0], force=false, evt=NODE_LEFT, node=10fe436a-de49-4605-a91d-ce25d9b0a001] [21:11:01]W: [org.apache.ignite:ignite-core] [2021-11-19 21:11:01,756][WARN ][tcp-disco-sock-reader-[10f54e13 127.0.0.1:46115]-#1148%grid-0%-#21843%grid-0%][TestTcpDiscoverySpi] Failed to shutdown socket [21:11:01]W: [org.apache.ignite:ignite-core] java.net.SocketException: Socket is closed [21:11:01]W: [org.apache.ignite:ignite-core] at java.net.Socket.shutdownOutput(Socket.java:1568) [21:11:01]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.close(IgniteUtils.java:4247) [21:11:01]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.discovery.tcp.ServerImpl$SocketReader.body(ServerImpl.java:7370) [21:11:01]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.IgniteSpiThread.run(IgniteSpiThread.java:58) [21:11:01] : [Step 4/5] [2021-11-19 21:11:01,757][INFO ][tcp-disco-sock-reader-[10f54e13 127.0.0.1:46115]-#1148%grid-0%-#21843%grid-0%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:46115, rmtPort=46115, rmtNodeId=10f54e13-fcdc-4ff6-8550-968ca8308001] [21:11:01] : [Step 4/5] [2021-11-19 21:11:01,756][INFO ][tcp-disco-sock-reader-[10fe436a 127.0.0.1:46341]-#1157%grid-0%-#21999%grid-0%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:46341, rmtPort=46341, rmtNodeId=10fe436a-de49-4605-a91d-ce25d9b0a001] [21:11:01] : [Step 4/5] [2021-11-19 21:11:01,758][INFO ][main][GridCacheProcessor] Stopped cache [cacheName=ignite-sys-cache] [21:11:01] : [Step 4/5] [2021-11-19 21:11:01,759][INFO ][main][GridCacheProcessor] Stopped cache [cacheName=encrypted] [21:11:01] : [Step 4/5] [2021-11-19 21:11:01,966][INFO ][main][FilePageStoreManager] Cleanup cache stores [total=4, left=0, cleanFiles=false] [21:11:01] : [Step 4/5] [2021-11-19 21:11:01,968][INFO ][main][GridDeploymentLocalStore] Removed undeployed class: GridDeployment [ts=1637345455788, depMode=SHARED, clsLdr=IsolatedClassLoader{roleName='test'}, clsLdrId=3358d593d71-00db608c-526f-476a-ba3c-0d39102bb000, userVer=0, loc=true, sampleClsName=org.apache.ignite.internal.processors.cache.distributed.dht.preloader.GridDhtPartitionMap, pendingUndeploy=false, undeployed=true, usage=0] [21:11:01] : [Step 4/5] [2021-11-19 21:11:01,975][INFO ][main][IgniteKernal%grid-0] [21:11:01] : [Step 4/5] [21:11:01] : [Step 4/5] >>> +------------------------------------------------------+ [21:11:01] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV stopped OK [21:11:01] : [Step 4/5] >>> +------------------------------------------------------+ [21:11:01] : [Step 4/5] >>> Ignite instance name: grid-0 [21:11:01] : [Step 4/5] >>> Grid uptime: 00:00:07.163 [21:11:01] : [Step 4/5] [21:11:01] : [Step 4/5] [21:11:01] : [Step 4/5] [21:11:01] >>> Starting test: CacheGroupKeyChangeTest#testClientJoinDuringRotation <<< [21:11:01] : [Step 4/5] [2021-11-19 21:11:01,990][INFO ][main][root] >>> Starting test: CacheGroupKeyChangeTest#testClientJoinDuringRotation <<< [21:11:01] : [Step 4/5] [21:11:01] >>> Heap: 238 MB used / 1938 MB commited / 1938 MB max <<< [21:11:01] : [Step 4/5] [2021-11-19 21:11:01,991][INFO ][main][root] >>> Heap: 238 MB used / 1938 MB commited / 1938 MB max <<< [21:11:01] : [Step 4/5] [21:11:01] >>> Non-Heap: 161 MB used / 184 MB commited / 0 MB max <<< [21:11:01] : [Step 4/5] [2021-11-19 21:11:01,991][INFO ][main][root] >>> Non-Heap: 161 MB used / 184 MB commited / 0 MB max <<< [21:11:02]W: [org.apache.ignite:ignite-core] [2021-11-19 21:11:01,999][WARN ][test-runner-#22022%encryption.CacheGroupKeyChangeTest%][G] Ignite work directory is not provided, automatically resolved to: /opt/buildagent/work/7bc1c54bc719b67c/work [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,001][INFO ][test-runner-#22022%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] [21:11:02] : [Step 4/5] [21:11:02] : [Step 4/5] >>> __________ ________________ [21:11:02] : [Step 4/5] >>> / _/ ___/ |/ / _/_ __/ __/ [21:11:02] : [Step 4/5] >>> _/ // (7 7 // / / / / _/ [21:11:02] : [Step 4/5] >>> /___/\___/_/|_/___/ /_/ /___/ [21:11:02] : [Step 4/5] >>> [21:11:02] : [Step 4/5] >>> ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:11:02] : [Step 4/5] >>> 2021 Copyright(C) Apache Software Foundation [21:11:02] : [Step 4/5] >>> [21:11:02] : [Step 4/5] >>> Ignite documentation: http://ignite.apache.org [21:11:02] : [Step 4/5] [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,002][INFO ][test-runner-#22022%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] Config URL: n/a [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,003][INFO ][test-runner-#22022%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] IgniteConfiguration [igniteInstanceName=grid-0, pubPoolSize=24, svcPoolSize=24, callbackPoolSize=24, stripedPoolSize=24, sysPoolSize=24, mgmtPoolSize=4, dataStreamerPoolSize=24, utilityCachePoolSize=24, utilityCacheKeepAliveTime=60000, p2pPoolSize=2, qryPoolSize=24, buildIdxPoolSize=4, igniteHome=/opt/buildagent/work/7bc1c54bc719b67c, igniteWorkDir=/opt/buildagent/work/7bc1c54bc719b67c/work, mbeanSrv=com.sun.jmx.mbeanserver.JmxMBeanServer@6fe85038, nodeId=007663dd-64dd-4ed1-b5f4-5f2426572000, marsh=BinaryMarshaller [], marshLocJobs=false, daemon=false, p2pEnabled=true, netTimeout=10000, netCompressionLevel=1, sndRetryDelay=1000, sndRetryCnt=3, metricsHistSize=10000, metricsUpdateFreq=1000, metricsExpTime=9223372036854775807, discoSpi=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=0, ackTimeout=0, marsh=null, reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], segPlc=STOP, segResolveAttempts=2, waitForSegOnStart=true, allResolversPassReq=true, segChkFreq=10000, commSpi=TcpCommunicationSpi [connectGate=org.apache.ignite.spi.communication.tcp.internal.ConnectGateway@5fa5f406, ctxInitLatch=java.util.concurrent.CountDownLatch@28047aac[Count = 1], stopping=false, clientPool=null, nioSrvWrapper=null, stateProvider=null], evtSpi=MemoryEventStorageSpi [expireAgeMs=9223372036854775807, expireCnt=10000, filter=null], colSpi=NoopCollisionSpi [], deploySpi=LocalDeploymentSpi [], indexingSpi=org.apache.ignite.spi.indexing.noop.NoopIndexingSpi@8196c31, addrRslvr=null, encryptionSpi=org.apache.ignite.spi.encryption.keystore.KeystoreEncryptionSpi@5e15f0eb, tracingSpi=org.apache.ignite.spi.tracing.NoopTracingSpi@1e21bfd2, clientMode=false, rebalanceThreadPoolSize=4, rebalanceTimeout=10000, rebalanceBatchesPrefetchCnt=3, rebalanceThrottle=0, rebalanceBatchSize=524288, txCfg=TransactionConfiguration [txSerEnabled=false, dfltIsolation=REPEATABLE_READ, dfltConcurrency=PESSIMISTIC, dfltTxTimeout=0, txTimeoutOnPartitionMapExchange=0, deadlockTimeout=10000, pessimisticTxLogSize=0, pessimisticTxLogLinger=10000, tmLookupClsName=null, txManagerFactory=null, useJtaSync=false], cacheSanityCheckEnabled=true, discoStartupDelay=60000, deployMode=SHARED, p2pMissedCacheSize=100, locHost=127.0.0.1, timeSrvPortBase=31100, timeSrvPortRange=100, failureDetectionTimeout=10000, sysWorkerBlockedTimeout=null, clientFailureDetectionTimeout=10000, metricsLogFreq=0, connectorCfg=null, odbcCfg=null, warmupClos=null, atomicCfg=AtomicConfiguration [seqReserveSize=1000, cacheMode=PARTITIONED, backups=1, aff=null, grpName=null], classLdr=null, sslCtxFactory=null, platformCfg=null, binaryCfg=null, memCfg=null, pstCfg=null, dsCfg=DataStorageConfiguration [sysRegionInitSize=41943040, sysRegionMaxSize=104857600, pageSize=4096, concLvl=0, dfltDataRegConf=DataRegionConfiguration [name=default, maxSize=104857600, initSize=268435456, swapPath=null, pageEvictionMode=DISABLED, pageReplacementMode=CLOCK, evictionThreshold=0.9, emptyPagesPoolSize=100, metricsEnabled=false, metricsSubIntervalCount=5, metricsRateTimeInterval=60000, persistenceEnabled=true, checkpointPageBufSize=0, lazyMemoryAllocation=true, warmUpCfg=null], dataRegions=null, storagePath=null, checkpointFreq=30000, lockWaitTime=10000, checkpointThreads=4, checkpointWriteOrder=SEQUENTIAL, walHistSize=20, maxWalArchiveSize=20971520, walSegments=10, walSegmentSize=1048576, walPath=db/wal, walArchivePath=db/wal/archive, cdcWalPath=db/wal/cdc, cdcEnabled=false, metricsEnabled=false, walMode=LOG_ONLY, walTlbSize=131072, walBuffSize=0, walFlushFreq=2000, walFsyncDelay=1000, walRecordIterBuffSize=67108864, alwaysWriteFullPages=false, fileIOFactory=org.apache.ignite.internal.processors.cache.persistence.file.AsyncFileIOFactory@556fe248, metricsSubIntervalCnt=5, metricsRateTimeInterval=60000, walAutoArchiveAfterInactivity=-1, walForceArchiveTimeout=-1, writeThrottlingEnabled=false, walCompactionEnabled=false, walCompactionLevel=1, checkpointReadLockTimeout=null, walPageCompression=DISABLED, walPageCompressionLevel=null, dfltWarmUpCfg=null, encCfg=org.apache.ignite.configuration.EncryptionConfiguration@4a988f83, defragmentationThreadPoolSize=4, minWalArchiveSize=-1], snapshotPath=snapshots, activeOnStart=true, activeOnStartPropSetFlag=false, autoActivation=true, autoActivationPropSetFlag=false, clusterStateOnStart=null, sqlConnCfg=null, cliConnCfg=ClientConnectorConfiguration [host=null, port=10800, portRange=100, sockSndBufSize=0, sockRcvBufSize=0, tcpNoDelay=true, maxOpenCursorsPerConn=128, threadPoolSize=24, selectorCnt=12, idleTimeout=0, handshakeTimeout=10000, jdbcEnabled=true, odbcEnabled=true, thinCliEnabled=true, sslEnabled=false, useIgniteSslCtxFactory=true, sslClientAuth=false, sslCtxFactory=null, thinCliCfg=ThinClientConfiguration [maxActiveTxPerConn=100, maxActiveComputeTasksPerConn=0]], mvccVacuumThreadCnt=2, mvccVacuumFreq=5000, authEnabled=false, failureHnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]], commFailureRslvr=null, sqlCfg=SqlConfiguration [longQryWarnTimeout=3000, dfltQryTimeout=0, sqlQryHistSize=1000, validationEnabled=false], asyncContinuationExecutor=null] [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,012][INFO ][test-runner-#22022%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] Daemon mode: off [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,013][INFO ][test-runner-#22022%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] OS: Linux 4.15.0-151-generic amd64 [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,013][INFO ][test-runner-#22022%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] OS user: teamcity [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,013][INFO ][test-runner-#22022%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] PID: 16724 [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,014][INFO ][test-runner-#22022%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] Language runtime: Java Platform API Specification ver. 1.8 [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,014][INFO ][test-runner-#22022%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] VM information: Java(TM) SE Runtime Environment 1.8.0_261-b12 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 25.261-b12 [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,014][INFO ][test-runner-#22022%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] VM total memory: 1.9GB [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,014][INFO ][test-runner-#22022%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] Remote Management [restart: off, REST: off, JMX (remote: off)] [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,015][INFO ][test-runner-#22022%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] Logger: GridTestLog4jLogger [quiet=false, config=null] [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,015][INFO ][test-runner-#22022%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] IGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,015][INFO ][test-runner-#22022%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] VM arguments: [-DIGNITE_DUMP_THREADS_ON_FAILURE=false, -DMono=/usr/bin/mono-sgen, -DMono4.0_x64=/usr/lib/mono/4.0, -DMono4.5_x64=/usr/lib/mono/4.5, -DMonoVersion=6.12.0.90, -DSKIP_BUILD=false, -Dagent.home.dir=/opt/buildagent, -Dagent.name=aitc-lin02_03, -Dagent.ownPort=9090, -Dagent.work.dir=/opt/buildagent/work, -Dbuild.number=95, -Dbuild.vcs.number=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.1=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.GitHubApacheIgnite=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dclassworlds.conf=/opt/buildagent/temp/buildTmp/teamcity.m2.conf, -Dcom.jetbrains.maven.watcher.report.file=/opt/buildagent/temp/buildTmp/maven-build-info.xml, -Djava.io.tmpdir=/opt/buildagent/temp/buildTmp, -Dmaven.home=/opt/buildagent/tools/maven3_6, -Dmaven.multiModuleProjectDirectory=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.agent.cpuBenchmark=457, -Dteamcity.agent.dotnet.agent_url=http://localhost:9090/RPC2, -Dteamcity.agent.dotnet.build_id=6278078, -Dteamcity.auth.password=*******, -Dteamcity.auth.userId=TeamCityBuildId=6278078, -Dteamcity.build.changedFiles.file=/opt/buildagent/temp/buildTmp/changedFiles6342607772318147725.txt, -Dteamcity.build.checkoutDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.build.id=6278078, -Dteamcity.build.properties.file=/opt/buildagent/temp/buildTmp/teamcity.build5164517880467851002.properties, -Dteamcity.build.tempDir=/opt/buildagent/temp/buildTmp, -Dteamcity.build.workingDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.buildConfName=Basic 3, -Dteamcity.buildType.id=IgniteTests24Java8_Basic3, -Dteamcity.configuration.properties.file=/opt/buildagent/temp/buildTmp/teamcity.config5591980786735343870.properties, -Dteamcity.maven.userSettings.path=/opt/buildagent/temp/buildTmp/maven_settings_585072866407032347.xml, -Dteamcity.maven.watcher.home=/opt/buildagent/plugins/mavenPlugin/maven-watcher-jdk16, -Dteamcity.projectName=Ignite Tests 2.x (JDK 8/11), -Dteamcity.runner.properties.file=/opt/buildagent/temp/buildTmp/teamcity.runner9098465561618137420.properties, -Dteamcity.tests.recentlyFailedTests.file=/opt/buildagent/temp/buildTmp/testsToRunFirst3891775683130404069.txt, -Dteamcity.version=2021.2 (build 99542), -ea, -Xms2g, -Xmx2g, -XX:+HeapDumpOnOutOfMemoryError, -DIGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_TEST_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_UPDATE_NOTIFIER=false, -DIGNITE_NO_DISCO_ORDER=true, -DIGNITE_PERFORMANCE_SUGGESTIONS_DISABLED=true, -Djava.net.preferIPv4Stack=true, -DTEST_SCALE_FACTOR=1.0, -DIGNITE_TEST_PROP_LOG4J_FILE=log4j-tc-test.xml, -DIGNITE_QUIET=false, -DIGNITE_MARSHAL_BUFFERS_RECHECK=1000, -Dmaven.repo.local=/opt/buildagent/.m2/repository] [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,020][INFO ][test-runner-#22022%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] System cache's DataRegion size is configured to 40 MB. Use DataStorageConfiguration.systemRegionInitialSize property to change the setting. [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,021][INFO ][test-runner-#22022%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] Configured caches [in 'sysMemPlc' dataRegion: ['ignite-sys-cache']] [21:11:02]W: [org.apache.ignite:ignite-core] [2021-11-19 21:11:02,021][WARN ][test-runner-#22022%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] Peer class loading is enabled (disable it in production for performance and deployment consistency reasons) [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,021][INFO ][test-runner-#22022%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] 3-rd party licenses can be found at: /opt/buildagent/work/7bc1c54bc719b67c/libs/licenses [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,025][INFO ][test-runner-#22022%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] Configured plugins: [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,026][INFO ][test-runner-#22022%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- StanByClusterTestProvider 1.0 [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,026][INFO ][test-runner-#22022%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,026][INFO ][test-runner-#22022%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,026][INFO ][test-runner-#22022%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- PageMemory tracker plugin 1.0 [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,026][INFO ][test-runner-#22022%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,027][INFO ][test-runner-#22022%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,027][INFO ][test-runner-#22022%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- TestDistibutedConfigurationPlugin 1.0 [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,027][INFO ][test-runner-#22022%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,027][INFO ][test-runner-#22022%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,027][INFO ][test-runner-#22022%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- NodeValidationPluginProvider 1.0 [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,028][INFO ][test-runner-#22022%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,028][INFO ][test-runner-#22022%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,028][INFO ][test-runner-#22022%encryption.CacheGroupKeyChangeTest%][FailureProcessor] Configured failure handler: [hnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]]] [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,047][INFO ][test-runner-#22022%encryption.CacheGroupKeyChangeTest%][TestRecordingCommunicationSpi] Successfully bound communication NIO server to TCP port [port=47100, locHost=/127.0.0.1, selectorsCnt=12, selectorSpins=0, pairedConn=false] [21:11:02]W: [org.apache.ignite:ignite-core] [2021-11-19 21:11:02,047][WARN ][test-runner-#22022%encryption.CacheGroupKeyChangeTest%][TestRecordingCommunicationSpi] Message queue limit is set to 0 which may lead to potential OOMEs when running cache operations in FULL_ASYNC or PRIMARY_SYNC modes due to message queues growth on sender and receiver sides. [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,074][INFO ][test-runner-#22022%encryption.CacheGroupKeyChangeTest%][GridCollisionManager] Collision resolution is disabled (all jobs will be activated upon arrival). [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,075][INFO ][test-runner-#22022%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] Security status [authentication=off, sandbox=off, tls/ssl=off] [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,137][INFO ][test-runner-#22022%encryption.CacheGroupKeyChangeTest%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,232][INFO ][test-runner-#22022%encryption.CacheGroupKeyChangeTest%][MaintenanceProcessor] Resolved store directory for node persistent data: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0 [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,234][INFO ][test-runner-#22022%encryption.CacheGroupKeyChangeTest%][CacheObjectBinaryProcessorImpl] Resolved directory for serialized binary metadata: /opt/buildagent/work/7bc1c54bc719b67c/work/db/binary_meta/grid_0 [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,239][INFO ][test-runner-#22022%encryption.CacheGroupKeyChangeTest%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0 [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,239][INFO ][test-runner-#22022%encryption.CacheGroupKeyChangeTest%][FileWriteAheadLogManager] Resolved write ahead log work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0 [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,240][INFO ][test-runner-#22022%encryption.CacheGroupKeyChangeTest%][FileWriteAheadLogManager] Resolved write ahead log archive directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0 [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,281][INFO ][test-runner-#22022%encryption.CacheGroupKeyChangeTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000000.wal [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,282][INFO ][test-runner-#22022%encryption.CacheGroupKeyChangeTest%][FileHandleManagerImpl] Initialized write-ahead log manager [mode=LOG_ONLY] [21:11:02]W: [org.apache.ignite:ignite-core] [2021-11-19 21:11:02,282][WARN ][test-runner-#22022%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] DataRegion maxSize=104.9 MB is smaller than defaultInitialSize=268.4 MB, setting initialSize to 104.9 MB [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,287][INFO ][test-runner-#22022%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Configured data regions initialized successfully [total=5] [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,297][INFO ][test-runner-#22022%encryption.CacheGroupKeyChangeTest%][IgniteSnapshotManager] Resolved snapshot work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/snapshots [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,298][INFO ][test-runner-#22022%encryption.CacheGroupKeyChangeTest%][IgniteSnapshotManager] Resolved temp directory for snapshot creation: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0/snp [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,300][INFO ][test-runner-#22022%encryption.CacheGroupKeyChangeTest%][ClientListenerProcessor] Client connector processor has started on TCP port 10800 [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,306][INFO ][test-runner-#22022%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] Non-loopback local IPs: 172.17.0.4 [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,306][INFO ][test-runner-#22022%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] Enabled local MACs: 0242AC110004 [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,309][INFO ][test-runner-#22022%encryption.CacheGroupKeyChangeTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,310][INFO ][test-runner-#22022%encryption.CacheGroupKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,310][INFO ][test-runner-#22022%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,314][INFO ][test-runner-#22022%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Applying lost metastore updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,316][INFO ][test-runner-#22022%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=10 ms] [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,316][INFO ][test-runner-#22022%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Restoring partition state for local groups. [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,317][INFO ][test-runner-#22022%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=0, partitionsProcessed=0, time=0ms] [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,317][INFO ][test-runner-#22022%encryption.CacheGroupKeyChangeTest%][GridEncryptionManager] Encryption keys loaded from metastore. [grps=, masterKeyName=ignite.master.key] [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,323][INFO ][test-runner-#22022%encryption.CacheGroupKeyChangeTest%][ClusterProcessor] Cluster ID and tag has been read from metastorage: null [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,323][INFO ][test-runner-#22022%encryption.CacheGroupKeyChangeTest%][IgniteClusterImpl] Shutdown policy was updated [oldVal=null, newVal=null] [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,323][INFO ][test-runner-#22022%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Checkpoint frequency deviation changed [oldVal=null, newVal=null] [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,333][INFO ][test-runner-#22022%encryption.CacheGroupKeyChangeTest%][FilePageStoreManager] Cleanup cache stores [total=1, left=0, cleanFiles=false] [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,335][INFO ][test-runner-#22022%encryption.CacheGroupKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,337][INFO ][test-runner-#22022%encryption.CacheGroupKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,338][INFO ][test-runner-#22022%encryption.CacheGroupKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,338][INFO ][test-runner-#22022%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Data Regions Started: 5 [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,339][INFO ][test-runner-#22022%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] ^-- sysMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:11:02] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:11:02] : [Step 4/5] ^-- default region [type=default, persistence=true, lazyAlloc=true, [21:11:02] : [Step 4/5] ... initCfg=100MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB, allocTotal=0MB] [21:11:02] : [Step 4/5] ^-- metastoreMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:11:02] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:11:02] : [Step 4/5] ^-- TxLog region [type=internal, persistence=true, lazyAlloc=false, [21:11:02] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:11:02] : [Step 4/5] ^-- volatileDsMemPlc region [type=user, persistence=false, lazyAlloc=true, [21:11:02] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB] [21:11:02] : [Step 4/5] ^-- Ignite persistence [used=0MB] [21:11:02] : [Step 4/5] [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,340][INFO ][test-runner-#22022%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Starting binary memory restore for: [-2100569601] [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,351][INFO ][test-runner-#22022%encryption.CacheGroupKeyChangeTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,351][INFO ][test-runner-#22022%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,353][INFO ][test-runner-#22022%encryption.CacheGroupKeyChangeTest%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000000.wal, offset=0, ver=2] [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,356][INFO ][test-runner-#22022%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Started cache in recovery mode [name=ignite-sys-cache, id=-2100569601, dataRegionName=sysMemPlc, mode=REPLICATED, atomicity=TRANSACTIONAL, backups=2147483647, mvcc=false] [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,357][INFO ][test-runner-#22022%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Binary recovery performed in 17 ms. [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,358][INFO ][test-runner-#22022%encryption.CacheGroupKeyChangeTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,358][INFO ][test-runner-#22022%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Applying lost cache updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,360][INFO ][test-runner-#22022%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=0 ms] [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,361][INFO ][test-runner-#22022%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Restoring partition state for local groups. [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,375][INFO ][test-runner-#22022%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=1, partitionsProcessed=100, time=10ms] [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,397][INFO ][test-runner-#22022%encryption.CacheGroupKeyChangeTest%][TestTcpDiscoverySpi] Successfully bound to TCP port [port=47500, localHost=localhost/127.0.0.1, locNodeId=007663dd-64dd-4ed1-b5f4-5f2426572000] [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,409][INFO ][disco-notifier-worker-#22134%grid-0%][MvccProcessorImpl] Assigned mvcc coordinator [crd=MvccCoordinator [topVer=AffinityTopologyVersion [topVer=1, minorTopVer=0], nodeId=007663dd-64dd-4ed1-b5f4-5f2426572000, ver=1637345462407, local=true, initialized=false]] [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,420][INFO ][sys-#22111%grid-0%][ClusterProcessor] Writing cluster ID and tag to metastorage on ready for write ClusterIdAndTag [id=3c6dd018-e9fc-4e74-96a2-0d6bc471c93b, tag=affectionate_joliot] [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,423][INFO ][disco-notifier-worker-#22134%grid-0%][ClusterProcessor] affectionate_joliot [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,424][INFO ][disco-notifier-worker-#22134%grid-0%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustEnabled' was changed from 'null' to 'false' [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,425][INFO ][disco-notifier-worker-#22134%grid-0%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustTimeout' was changed from 'null' to '300000' [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,426][INFO ][disco-notifier-worker-#22134%grid-0%][IgniteTxManager] Transactions parameter 'longOperationsDumpTimeout' was changed from 'null' to '60000' [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,427][INFO ][disco-notifier-worker-#22134%grid-0%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpThreshold' was changed from 'null' to '0' [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,428][INFO ][disco-notifier-worker-#22134%grid-0%][IgniteTxManager] Transactions parameter 'transactionTimeDumpSamplesCoefficient' was changed from 'null' to '0.0' [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,428][INFO ][disco-notifier-worker-#22134%grid-0%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpSamplesPerSecondLimit' was changed from 'null' to '5' [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,429][INFO ][disco-notifier-worker-#22134%grid-0%][IgniteTxManager] Transactions parameter 'collisionsDumpInterval' was changed from 'null' to '1000' [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,429][INFO ][disco-notifier-worker-#22134%grid-0%][IgniteTxManager] Transactions parameter 'txOwnerDumpRequestsAllowed' was changed from 'null' to 'true' [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,429][INFO ][disco-notifier-worker-#22134%grid-0%][GridCacheDatabaseSharedManager] Historical rebalance WAL threshold changed [property=historical.rebalance.threshold, oldVal=null, newVal=500] [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,444][INFO ][test-runner-#22022%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] To start Console Management & Monitoring run ignitevisorcmd.{sh|bat} [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,445][INFO ][test-runner-#22022%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] [21:11:02] : [Step 4/5] [21:11:02] : [Step 4/5] >>> +-------------------------------------------+ [21:11:02] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:11:02] : [Step 4/5] >>> +-------------------------------------------+ [21:11:02] : [Step 4/5] >>> OS name: Linux 4.15.0-151-generic amd64 [21:11:02] : [Step 4/5] >>> CPU(s): 24 [21:11:02] : [Step 4/5] >>> Heap: 2.0GB [21:11:02] : [Step 4/5] >>> VM name: 16724@c4dfe9a430b2 [21:11:02] : [Step 4/5] >>> Ignite instance name: grid-0 [21:11:02] : [Step 4/5] >>> Local node [ID=007663DD-64DD-4ED1-B5F4-5F2426572000, order=1, clientMode=false] [21:11:02] : [Step 4/5] >>> Local node addresses: [127.0.0.1] [21:11:02] : [Step 4/5] >>> Local ports: TCP:10800 TCP:47100 TCP:47500 [21:11:02] : [Step 4/5] [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,446][INFO ][test-runner-#22022%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] >>> Ignite cluster is in INACTIVE state (limited functionality available). Use control.(sh|bat) script or IgniteCluster.state(ClusterState.ACTIVE) to change the state. [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,447][INFO ][test-runner-#22022%encryption.CacheGroupKeyChangeTest%][GridDiscoveryManager] Topology snapshot [ver=1, locNode=007663dd, servers=1, clients=0, state=INACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=007663dd-64dd-4ed1-b5f4-5f2426572000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,448][INFO ][test-runner-#22022%encryption.CacheGroupKeyChangeTest%][G] Node started : [stage="Configure system pool" (0 ms),stage="Start managers" (233 ms),stage="Configure binary metadata" (2 ms),stage="Start processors" (69 ms),stage="Start 'StanByClusterTestProvider' plugin" (0 ms),stage="Start 'PageMemory tracker plugin' plugin" (0 ms),stage="Start 'TestDistibutedConfigurationPlugin' plugin" (0 ms),stage="Start 'NodeValidationPluginProvider' plugin" (0 ms),stage="Init metastore" (27 ms),stage="Init and start regions" (6 ms),stage="Restore binary memory" (17 ms),stage="Restore logical state" (18 ms),stage="Finish recovery" (19 ms),stage="Join topology" (27 ms),stage="Await transition" (1 ms),stage="Await exchange" (22 ms),stage="Total time" (441 ms)] [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,452][INFO ][test-runner-#22022%encryption.CacheGroupKeyChangeTest%][root] Node started with the following configuration [id=007663dd-64dd-4ed1-b5f4-5f2426572000, marshaller=BinaryMarshaller [], discovery=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=5000, ackTimeout=5000, marsh=JdkMarshaller [clsFilter=org.apache.ignite.marshaller.MarshallerUtils$1@416486bc], reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], binaryCfg=null, lateAff=true] [21:11:02]W: [org.apache.ignite:ignite-core] [2021-11-19 21:11:02,458][WARN ][test-runner-#22022%encryption.CacheGroupKeyChangeTest%][G] Ignite work directory is not provided, automatically resolved to: /opt/buildagent/work/7bc1c54bc719b67c/work [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,459][INFO ][test-runner-#22022%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] [21:11:02] : [Step 4/5] [21:11:02] : [Step 4/5] >>> __________ ________________ [21:11:02] : [Step 4/5] >>> / _/ ___/ |/ / _/_ __/ __/ [21:11:02] : [Step 4/5] >>> _/ // (7 7 // / / / / _/ [21:11:02] : [Step 4/5] >>> /___/\___/_/|_/___/ /_/ /___/ [21:11:02] : [Step 4/5] >>> [21:11:02] : [Step 4/5] >>> ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:11:02] : [Step 4/5] >>> 2021 Copyright(C) Apache Software Foundation [21:11:02] : [Step 4/5] >>> [21:11:02] : [Step 4/5] >>> Ignite documentation: http://ignite.apache.org [21:11:02] : [Step 4/5] [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,460][INFO ][test-runner-#22022%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] Config URL: n/a [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,461][INFO ][test-runner-#22022%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] IgniteConfiguration [igniteInstanceName=grid-1, pubPoolSize=24, svcPoolSize=24, callbackPoolSize=24, stripedPoolSize=24, sysPoolSize=24, mgmtPoolSize=4, dataStreamerPoolSize=24, utilityCachePoolSize=24, utilityCacheKeepAliveTime=60000, p2pPoolSize=2, qryPoolSize=24, buildIdxPoolSize=4, igniteHome=/opt/buildagent/work/7bc1c54bc719b67c, igniteWorkDir=/opt/buildagent/work/7bc1c54bc719b67c/work, mbeanSrv=com.sun.jmx.mbeanserver.JmxMBeanServer@6fe85038, nodeId=104175b5-80ef-4f12-adf3-882ed73df001, marsh=BinaryMarshaller [], marshLocJobs=false, daemon=false, p2pEnabled=true, netTimeout=10000, netCompressionLevel=1, sndRetryDelay=1000, sndRetryCnt=3, metricsHistSize=10000, metricsUpdateFreq=1000, metricsExpTime=9223372036854775807, discoSpi=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=0, ackTimeout=0, marsh=null, reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], segPlc=STOP, segResolveAttempts=2, waitForSegOnStart=true, allResolversPassReq=true, segChkFreq=10000, commSpi=TcpCommunicationSpi [connectGate=org.apache.ignite.spi.communication.tcp.internal.ConnectGateway@28e04976, ctxInitLatch=java.util.concurrent.CountDownLatch@723aac71[Count = 1], stopping=false, clientPool=null, nioSrvWrapper=null, stateProvider=null], evtSpi=MemoryEventStorageSpi [expireAgeMs=9223372036854775807, expireCnt=10000, filter=null], colSpi=NoopCollisionSpi [], deploySpi=LocalDeploymentSpi [], indexingSpi=org.apache.ignite.spi.indexing.noop.NoopIndexingSpi@6aa029ea, addrRslvr=null, encryptionSpi=org.apache.ignite.spi.encryption.keystore.KeystoreEncryptionSpi@39568045, tracingSpi=org.apache.ignite.spi.tracing.NoopTracingSpi@268d408c, clientMode=false, rebalanceThreadPoolSize=4, rebalanceTimeout=10000, rebalanceBatchesPrefetchCnt=3, rebalanceThrottle=0, rebalanceBatchSize=524288, txCfg=TransactionConfiguration [txSerEnabled=false, dfltIsolation=REPEATABLE_READ, dfltConcurrency=PESSIMISTIC, dfltTxTimeout=0, txTimeoutOnPartitionMapExchange=0, deadlockTimeout=10000, pessimisticTxLogSize=0, pessimisticTxLogLinger=10000, tmLookupClsName=null, txManagerFactory=null, useJtaSync=false], cacheSanityCheckEnabled=true, discoStartupDelay=60000, deployMode=SHARED, p2pMissedCacheSize=100, locHost=127.0.0.1, timeSrvPortBase=31100, timeSrvPortRange=100, failureDetectionTimeout=10000, sysWorkerBlockedTimeout=null, clientFailureDetectionTimeout=10000, metricsLogFreq=0, connectorCfg=null, odbcCfg=null, warmupClos=null, atomicCfg=AtomicConfiguration [seqReserveSize=1000, cacheMode=PARTITIONED, backups=1, aff=null, grpName=null], classLdr=null, sslCtxFactory=null, platformCfg=null, binaryCfg=null, memCfg=null, pstCfg=null, dsCfg=DataStorageConfiguration [sysRegionInitSize=41943040, sysRegionMaxSize=104857600, pageSize=4096, concLvl=0, dfltDataRegConf=DataRegionConfiguration [name=default, maxSize=104857600, initSize=268435456, swapPath=null, pageEvictionMode=DISABLED, pageReplacementMode=CLOCK, evictionThreshold=0.9, emptyPagesPoolSize=100, metricsEnabled=false, metricsSubIntervalCount=5, metricsRateTimeInterval=60000, persistenceEnabled=true, checkpointPageBufSize=0, lazyMemoryAllocation=true, warmUpCfg=null], dataRegions=null, storagePath=null, checkpointFreq=30000, lockWaitTime=10000, checkpointThreads=4, checkpointWriteOrder=SEQUENTIAL, walHistSize=20, maxWalArchiveSize=20971520, walSegments=10, walSegmentSize=1048576, walPath=db/wal, walArchivePath=db/wal/archive, cdcWalPath=db/wal/cdc, cdcEnabled=false, metricsEnabled=false, walMode=LOG_ONLY, walTlbSize=131072, walBuffSize=0, walFlushFreq=2000, walFsyncDelay=1000, walRecordIterBuffSize=67108864, alwaysWriteFullPages=false, fileIOFactory=org.apache.ignite.internal.processors.cache.persistence.file.AsyncFileIOFactory@4cd25266, metricsSubIntervalCnt=5, metricsRateTimeInterval=60000, walAutoArchiveAfterInactivity=-1, walForceArchiveTimeout=-1, writeThrottlingEnabled=false, walCompactionEnabled=false, walCompactionLevel=1, checkpointReadLockTimeout=null, walPageCompression=DISABLED, walPageCompressionLevel=null, dfltWarmUpCfg=null, encCfg=org.apache.ignite.configuration.EncryptionConfiguration@1dec02a7, defragmentationThreadPoolSize=4, minWalArchiveSize=-1], snapshotPath=snapshots, activeOnStart=true, activeOnStartPropSetFlag=false, autoActivation=true, autoActivationPropSetFlag=false, clusterStateOnStart=null, sqlConnCfg=null, cliConnCfg=ClientConnectorConfiguration [host=null, port=10800, portRange=100, sockSndBufSize=0, sockRcvBufSize=0, tcpNoDelay=true, maxOpenCursorsPerConn=128, threadPoolSize=24, selectorCnt=12, idleTimeout=0, handshakeTimeout=10000, jdbcEnabled=true, odbcEnabled=true, thinCliEnabled=true, sslEnabled=false, useIgniteSslCtxFactory=true, sslClientAuth=false, sslCtxFactory=null, thinCliCfg=ThinClientConfiguration [maxActiveTxPerConn=100, maxActiveComputeTasksPerConn=0]], mvccVacuumThreadCnt=2, mvccVacuumFreq=5000, authEnabled=false, failureHnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]], commFailureRslvr=null, sqlCfg=SqlConfiguration [longQryWarnTimeout=3000, dfltQryTimeout=0, sqlQryHistSize=1000, validationEnabled=false], asyncContinuationExecutor=null] [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,469][INFO ][test-runner-#22022%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] Daemon mode: off [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,469][INFO ][test-runner-#22022%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] OS: Linux 4.15.0-151-generic amd64 [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,470][INFO ][test-runner-#22022%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] OS user: teamcity [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,470][INFO ][test-runner-#22022%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] PID: 16724 [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,470][INFO ][test-runner-#22022%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] Language runtime: Java Platform API Specification ver. 1.8 [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,471][INFO ][test-runner-#22022%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] VM information: Java(TM) SE Runtime Environment 1.8.0_261-b12 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 25.261-b12 [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,471][INFO ][test-runner-#22022%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] VM total memory: 1.9GB [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,471][INFO ][test-runner-#22022%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] Remote Management [restart: off, REST: off, JMX (remote: off)] [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,472][INFO ][test-runner-#22022%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] Logger: GridTestLog4jLogger [quiet=false, config=null] [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,472][INFO ][test-runner-#22022%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] IGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,472][INFO ][test-runner-#22022%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] VM arguments: [-DIGNITE_DUMP_THREADS_ON_FAILURE=false, -DMono=/usr/bin/mono-sgen, -DMono4.0_x64=/usr/lib/mono/4.0, -DMono4.5_x64=/usr/lib/mono/4.5, -DMonoVersion=6.12.0.90, -DSKIP_BUILD=false, -Dagent.home.dir=/opt/buildagent, -Dagent.name=aitc-lin02_03, -Dagent.ownPort=9090, -Dagent.work.dir=/opt/buildagent/work, -Dbuild.number=95, -Dbuild.vcs.number=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.1=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.GitHubApacheIgnite=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dclassworlds.conf=/opt/buildagent/temp/buildTmp/teamcity.m2.conf, -Dcom.jetbrains.maven.watcher.report.file=/opt/buildagent/temp/buildTmp/maven-build-info.xml, -Djava.io.tmpdir=/opt/buildagent/temp/buildTmp, -Dmaven.home=/opt/buildagent/tools/maven3_6, -Dmaven.multiModuleProjectDirectory=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.agent.cpuBenchmark=457, -Dteamcity.agent.dotnet.agent_url=http://localhost:9090/RPC2, -Dteamcity.agent.dotnet.build_id=6278078, -Dteamcity.auth.password=*******, -Dteamcity.auth.userId=TeamCityBuildId=6278078, -Dteamcity.build.changedFiles.file=/opt/buildagent/temp/buildTmp/changedFiles6342607772318147725.txt, -Dteamcity.build.checkoutDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.build.id=6278078, -Dteamcity.build.properties.file=/opt/buildagent/temp/buildTmp/teamcity.build5164517880467851002.properties, -Dteamcity.build.tempDir=/opt/buildagent/temp/buildTmp, -Dteamcity.build.workingDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.buildConfName=Basic 3, -Dteamcity.buildType.id=IgniteTests24Java8_Basic3, -Dteamcity.configuration.properties.file=/opt/buildagent/temp/buildTmp/teamcity.config5591980786735343870.properties, -Dteamcity.maven.userSettings.path=/opt/buildagent/temp/buildTmp/maven_settings_585072866407032347.xml, -Dteamcity.maven.watcher.home=/opt/buildagent/plugins/mavenPlugin/maven-watcher-jdk16, -Dteamcity.projectName=Ignite Tests 2.x (JDK 8/11), -Dteamcity.runner.properties.file=/opt/buildagent/temp/buildTmp/teamcity.runner9098465561618137420.properties, -Dteamcity.tests.recentlyFailedTests.file=/opt/buildagent/temp/buildTmp/testsToRunFirst3891775683130404069.txt, -Dteamcity.version=2021.2 (build 99542), -ea, -Xms2g, -Xmx2g, -XX:+HeapDumpOnOutOfMemoryError, -DIGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_TEST_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_UPDATE_NOTIFIER=false, -DIGNITE_NO_DISCO_ORDER=true, -DIGNITE_PERFORMANCE_SUGGESTIONS_DISABLED=true, -Djava.net.preferIPv4Stack=true, -DTEST_SCALE_FACTOR=1.0, -DIGNITE_TEST_PROP_LOG4J_FILE=log4j-tc-test.xml, -DIGNITE_QUIET=false, -DIGNITE_MARSHAL_BUFFERS_RECHECK=1000, -Dmaven.repo.local=/opt/buildagent/.m2/repository] [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,476][INFO ][test-runner-#22022%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] System cache's DataRegion size is configured to 40 MB. Use DataStorageConfiguration.systemRegionInitialSize property to change the setting. [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,477][INFO ][test-runner-#22022%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] Configured caches [in 'sysMemPlc' dataRegion: ['ignite-sys-cache']] [21:11:02]W: [org.apache.ignite:ignite-core] [2021-11-19 21:11:02,477][WARN ][test-runner-#22022%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] Peer class loading is enabled (disable it in production for performance and deployment consistency reasons) [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,477][INFO ][test-runner-#22022%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] 3-rd party licenses can be found at: /opt/buildagent/work/7bc1c54bc719b67c/libs/licenses [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,482][INFO ][test-runner-#22022%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] Configured plugins: [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,482][INFO ][test-runner-#22022%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- StanByClusterTestProvider 1.0 [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,482][INFO ][test-runner-#22022%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,482][INFO ][test-runner-#22022%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,483][INFO ][test-runner-#22022%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- PageMemory tracker plugin 1.0 [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,483][INFO ][test-runner-#22022%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,483][INFO ][test-runner-#22022%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,483][INFO ][test-runner-#22022%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- TestDistibutedConfigurationPlugin 1.0 [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,484][INFO ][test-runner-#22022%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,484][INFO ][test-runner-#22022%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,484][INFO ][test-runner-#22022%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- NodeValidationPluginProvider 1.0 [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,484][INFO ][test-runner-#22022%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,485][INFO ][test-runner-#22022%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,485][INFO ][test-runner-#22022%encryption.CacheGroupKeyChangeTest%][FailureProcessor] Configured failure handler: [hnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]]] [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,502][INFO ][test-runner-#22022%encryption.CacheGroupKeyChangeTest%][TestRecordingCommunicationSpi] Successfully bound communication NIO server to TCP port [port=47101, locHost=/127.0.0.1, selectorsCnt=12, selectorSpins=0, pairedConn=false] [21:11:02]W: [org.apache.ignite:ignite-core] [2021-11-19 21:11:02,502][WARN ][test-runner-#22022%encryption.CacheGroupKeyChangeTest%][TestRecordingCommunicationSpi] Message queue limit is set to 0 which may lead to potential OOMEs when running cache operations in FULL_ASYNC or PRIMARY_SYNC modes due to message queues growth on sender and receiver sides. [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,507][INFO ][test-runner-#22022%encryption.CacheGroupKeyChangeTest%][GridCollisionManager] Collision resolution is disabled (all jobs will be activated upon arrival). [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,508][INFO ][test-runner-#22022%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] Security status [authentication=off, sandbox=off, tls/ssl=off] [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,564][INFO ][test-runner-#22022%encryption.CacheGroupKeyChangeTest%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,645][INFO ][test-runner-#22022%encryption.CacheGroupKeyChangeTest%][MaintenanceProcessor] Resolved store directory for node persistent data: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1 [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,646][INFO ][test-runner-#22022%encryption.CacheGroupKeyChangeTest%][CacheObjectBinaryProcessorImpl] Resolved directory for serialized binary metadata: /opt/buildagent/work/7bc1c54bc719b67c/work/db/binary_meta/grid_1 [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,650][INFO ][test-runner-#22022%encryption.CacheGroupKeyChangeTest%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1 [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,650][INFO ][test-runner-#22022%encryption.CacheGroupKeyChangeTest%][FileWriteAheadLogManager] Resolved write ahead log work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1 [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,651][INFO ][test-runner-#22022%encryption.CacheGroupKeyChangeTest%][FileWriteAheadLogManager] Resolved write ahead log archive directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1 [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,658][INFO ][test-runner-#22022%encryption.CacheGroupKeyChangeTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000000.wal [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,659][INFO ][test-runner-#22022%encryption.CacheGroupKeyChangeTest%][FileHandleManagerImpl] Initialized write-ahead log manager [mode=LOG_ONLY] [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,663][INFO ][test-runner-#22022%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Configured data regions initialized successfully [total=5] [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,667][INFO ][test-runner-#22022%encryption.CacheGroupKeyChangeTest%][IgniteSnapshotManager] Resolved snapshot work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/snapshots [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,667][INFO ][test-runner-#22022%encryption.CacheGroupKeyChangeTest%][IgniteSnapshotManager] Resolved temp directory for snapshot creation: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1/snp [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,669][INFO ][test-runner-#22022%encryption.CacheGroupKeyChangeTest%][ClientListenerProcessor] Client connector processor has started on TCP port 10801 [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,671][INFO ][test-runner-#22022%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] Non-loopback local IPs: 172.17.0.4 [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,671][INFO ][test-runner-#22022%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] Enabled local MACs: 0242AC110004 [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,671][INFO ][test-runner-#22022%encryption.CacheGroupKeyChangeTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,672][INFO ][test-runner-#22022%encryption.CacheGroupKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,672][INFO ][test-runner-#22022%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,674][INFO ][test-runner-#22022%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Applying lost metastore updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,675][INFO ][test-runner-#22022%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=0 ms] [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,675][INFO ][test-runner-#22022%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Restoring partition state for local groups. [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,675][INFO ][test-runner-#22022%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=0, partitionsProcessed=0, time=0ms] [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,676][INFO ][test-runner-#22022%encryption.CacheGroupKeyChangeTest%][GridEncryptionManager] Encryption keys loaded from metastore. [grps=, masterKeyName=ignite.master.key] [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,677][INFO ][test-runner-#22022%encryption.CacheGroupKeyChangeTest%][ClusterProcessor] Cluster ID and tag has been read from metastorage: null [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,677][INFO ][test-runner-#22022%encryption.CacheGroupKeyChangeTest%][IgniteClusterImpl] Shutdown policy was updated [oldVal=null, newVal=null] [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,677][INFO ][test-runner-#22022%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Checkpoint frequency deviation changed [oldVal=null, newVal=null] [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,687][INFO ][test-runner-#22022%encryption.CacheGroupKeyChangeTest%][FilePageStoreManager] Cleanup cache stores [total=1, left=0, cleanFiles=false] [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,689][INFO ][test-runner-#22022%encryption.CacheGroupKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,690][INFO ][test-runner-#22022%encryption.CacheGroupKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,690][INFO ][test-runner-#22022%encryption.CacheGroupKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,691][INFO ][test-runner-#22022%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Data Regions Started: 5 [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,691][INFO ][test-runner-#22022%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] ^-- sysMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:11:02] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:11:02] : [Step 4/5] ^-- default region [type=default, persistence=true, lazyAlloc=true, [21:11:02] : [Step 4/5] ... initCfg=100MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB, allocTotal=0MB] [21:11:02] : [Step 4/5] ^-- metastoreMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:11:02] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:11:02] : [Step 4/5] ^-- TxLog region [type=internal, persistence=true, lazyAlloc=false, [21:11:02] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:11:02] : [Step 4/5] ^-- volatileDsMemPlc region [type=user, persistence=false, lazyAlloc=true, [21:11:02] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB] [21:11:02] : [Step 4/5] ^-- Ignite persistence [used=0MB] [21:11:02] : [Step 4/5] [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,692][INFO ][test-runner-#22022%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Starting binary memory restore for: [-2100569601] [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,699][INFO ][test-runner-#22022%encryption.CacheGroupKeyChangeTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,699][INFO ][test-runner-#22022%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,701][INFO ][test-runner-#22022%encryption.CacheGroupKeyChangeTest%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000000.wal, offset=0, ver=2] [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,704][INFO ][test-runner-#22022%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Started cache in recovery mode [name=ignite-sys-cache, id=-2100569601, dataRegionName=sysMemPlc, mode=REPLICATED, atomicity=TRANSACTIONAL, backups=2147483647, mvcc=false] [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,705][INFO ][test-runner-#22022%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Binary recovery performed in 13 ms. [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,705][INFO ][test-runner-#22022%encryption.CacheGroupKeyChangeTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,705][INFO ][test-runner-#22022%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Applying lost cache updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,707][INFO ][test-runner-#22022%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=10 ms] [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,707][INFO ][test-runner-#22022%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Restoring partition state for local groups. [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,716][INFO ][test-runner-#22022%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=1, partitionsProcessed=100, time=10ms] [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,738][INFO ][test-runner-#22022%encryption.CacheGroupKeyChangeTest%][TestTcpDiscoverySpi] Successfully bound to TCP port [port=47501, localHost=localhost/127.0.0.1, locNodeId=104175b5-80ef-4f12-adf3-882ed73df001] [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,742][INFO ][tcp-disco-srvr-[:47500]-#1162%grid-0%-#22136%grid-0%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=43261] [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,742][INFO ][tcp-disco-srvr-[:47500]-#1162%grid-0%-#22136%grid-0%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=43261] [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,743][INFO ][tcp-disco-sock-reader-[]-#1168%grid-0%-#22256%grid-0%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:43261, rmtPort=43261] [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,745][INFO ][tcp-disco-sock-reader-[104175b5 127.0.0.1:43261]-#1168%grid-0%-#22256%grid-0%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=104175b5-80ef-4f12-adf3-882ed73df001, rmtAddr=/127.0.0.1:43261] [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,752][INFO ][tcp-disco-srvr-[:47501]-#1167%grid-1%-#22255%grid-1%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=51323] [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,752][INFO ][tcp-disco-srvr-[:47501]-#1167%grid-1%-#22255%grid-1%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=51323] [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,753][INFO ][tcp-disco-sock-reader-[]-#1169%grid-1%-#22257%grid-1%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:51323, rmtPort=51323] [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,753][INFO ][tcp-disco-sock-reader-[]-#1169%grid-1%-#22257%grid-1%][TestTcpDiscoverySpi] Received ping request from the remote node [rmtNodeId=007663dd-64dd-4ed1-b5f4-5f2426572000, rmtAddr=/127.0.0.1:51323, rmtPort=51323] [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,755][INFO ][tcp-disco-sock-reader-[]-#1169%grid-1%-#22257%grid-1%][TestTcpDiscoverySpi] Finished writing ping response [rmtNodeId=007663dd-64dd-4ed1-b5f4-5f2426572000, rmtAddr=/127.0.0.1:51323, rmtPort=51323] [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,755][INFO ][tcp-disco-sock-reader-[104175b5 127.0.0.1:43261]-#1168%grid-0%-#22256%grid-0%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:43261, rmtPort=43261, rmtNodeId=104175b5-80ef-4f12-adf3-882ed73df001] [21:11:02]W: [org.apache.ignite:ignite-core] [2021-11-19 21:11:02,755][WARN ][tcp-disco-sock-reader-[]-#1169%grid-1%-#22257%grid-1%][TestTcpDiscoverySpi] Failed to shutdown socket [21:11:02]W: [org.apache.ignite:ignite-core] java.net.SocketException: Socket output is already shutdown [21:11:02]W: [org.apache.ignite:ignite-core] at java.net.Socket.shutdownOutput(Socket.java:1572) [21:11:02]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.close(IgniteUtils.java:4247) [21:11:02]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.discovery.tcp.ServerImpl$SocketReader.body(ServerImpl.java:7370) [21:11:02]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.IgniteSpiThread.run(IgniteSpiThread.java:58) [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,758][INFO ][tcp-disco-sock-reader-[]-#1169%grid-1%-#22257%grid-1%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:51323, rmtPort=51323, rmtNodeId=null] [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,759][INFO ][tcp-disco-msg-worker-[crd]-#1161%grid-0%-#22135%grid-0%][GridEncryptionManager] Joining node doesn't have stored group keys [node=104175b5-80ef-4f12-adf3-882ed73df001] [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,767][INFO ][tcp-disco-msg-worker-[crd]-#1161%grid-0%-#22135%grid-0%][TestTcpDiscoverySpi] New next node [newNext=TcpDiscoveryNode [id=104175b5-80ef-4f12-adf3-882ed73df001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=0, intOrder=2, lastExchangeTime=1637345462746, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false]] [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,767][INFO ][tcp-disco-srvr-[:47501]-#1167%grid-1%-#22255%grid-1%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=33771] [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,768][INFO ][tcp-disco-srvr-[:47501]-#1167%grid-1%-#22255%grid-1%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=33771] [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,768][INFO ][tcp-disco-sock-reader-[]-#1170%grid-1%-#22258%grid-1%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:33771, rmtPort=33771] [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,769][INFO ][tcp-disco-sock-reader-[007663dd 127.0.0.1:33771]-#1170%grid-1%-#22258%grid-1%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=007663dd-64dd-4ed1-b5f4-5f2426572000, rmtAddr=/127.0.0.1:33771] [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,773][INFO ][tcp-disco-msg-worker-[]-#1166%grid-1%-#22254%grid-1%][TestTcpDiscoverySpi] New next node [newNext=TcpDiscoveryNode [id=007663dd-64dd-4ed1-b5f4-5f2426572000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345462767, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false]] [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,774][INFO ][tcp-disco-srvr-[:47500]-#1162%grid-0%-#22136%grid-0%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=40997] [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,774][INFO ][tcp-disco-srvr-[:47500]-#1162%grid-0%-#22136%grid-0%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=40997] [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,775][INFO ][tcp-disco-sock-reader-[]-#1171%grid-0%-#22259%grid-0%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:40997, rmtPort=40997] [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,776][INFO ][tcp-disco-sock-reader-[104175b5 127.0.0.1:40997]-#1171%grid-0%-#22259%grid-0%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=104175b5-80ef-4f12-adf3-882ed73df001, rmtAddr=/127.0.0.1:40997] [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,779][INFO ][disco-event-worker-#22138%grid-0%][GridDiscoveryManager] Added new node to topology: TcpDiscoveryNode [id=104175b5-80ef-4f12-adf3-882ed73df001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637345462746, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false] [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,780][INFO ][disco-event-worker-#22138%grid-0%][GridDiscoveryManager] Topology snapshot [ver=2, locNode=007663dd, servers=2, clients=0, state=INACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=007663dd-64dd-4ed1-b5f4-5f2426572000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=104175b5-80ef-4f12-adf3-882ed73df001, consistentId=grid-1, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,782][INFO ][tcp-disco-msg-worker-[007663dd 127.0.0.1:47500]-#1166%grid-1%-#22254%grid-1%][ClusterProcessor] affectionate_joliot [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,783][INFO ][tcp-disco-msg-worker-[007663dd 127.0.0.1:47500]-#1166%grid-1%-#22254%grid-1%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustEnabled' was changed from 'null' to 'false' [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,783][INFO ][tcp-disco-msg-worker-[007663dd 127.0.0.1:47500]-#1166%grid-1%-#22254%grid-1%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustTimeout' was changed from 'null' to '300000' [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,784][INFO ][tcp-disco-msg-worker-[007663dd 127.0.0.1:47500]-#1166%grid-1%-#22254%grid-1%][IgniteTxManager] Transactions parameter 'longOperationsDumpTimeout' was changed from 'null' to '60000' [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,784][INFO ][tcp-disco-msg-worker-[007663dd 127.0.0.1:47500]-#1166%grid-1%-#22254%grid-1%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpThreshold' was changed from 'null' to '0' [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,785][INFO ][tcp-disco-msg-worker-[007663dd 127.0.0.1:47500]-#1166%grid-1%-#22254%grid-1%][IgniteTxManager] Transactions parameter 'transactionTimeDumpSamplesCoefficient' was changed from 'null' to '0.0' [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,785][INFO ][tcp-disco-msg-worker-[007663dd 127.0.0.1:47500]-#1166%grid-1%-#22254%grid-1%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpSamplesPerSecondLimit' was changed from 'null' to '5' [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,786][INFO ][tcp-disco-msg-worker-[007663dd 127.0.0.1:47500]-#1166%grid-1%-#22254%grid-1%][IgniteTxManager] Transactions parameter 'collisionsDumpInterval' was changed from 'null' to '1000' [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,786][INFO ][tcp-disco-msg-worker-[007663dd 127.0.0.1:47500]-#1166%grid-1%-#22254%grid-1%][IgniteTxManager] Transactions parameter 'txOwnerDumpRequestsAllowed' was changed from 'null' to 'true' [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,787][INFO ][tcp-disco-msg-worker-[007663dd 127.0.0.1:47500]-#1166%grid-1%-#22254%grid-1%][GridCacheDatabaseSharedManager] Historical rebalance WAL threshold changed [property=historical.rebalance.threshold, oldVal=null, newVal=500] [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,787][INFO ][disco-notifier-worker-#22253%grid-1%][MvccProcessorImpl] Assigned mvcc coordinator [crd=MvccCoordinator [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=0], nodeId=007663dd-64dd-4ed1-b5f4-5f2426572000, ver=1637345462407, local=false, initialized=false]] [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,789][INFO ][sys-#22238%grid-1%][ClusterProcessor] Writing cluster ID and tag to metastorage on ready for write ClusterIdAndTag [id=3c6dd018-e9fc-4e74-96a2-0d6bc471c93b, tag=affectionate_joliot] [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,805][INFO ][test-runner-#22022%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] To start Console Management & Monitoring run ignitevisorcmd.{sh|bat} [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,806][INFO ][test-runner-#22022%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] [21:11:02] : [Step 4/5] [21:11:02] : [Step 4/5] >>> +-------------------------------------------+ [21:11:02] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:11:02] : [Step 4/5] >>> +-------------------------------------------+ [21:11:02] : [Step 4/5] >>> OS name: Linux 4.15.0-151-generic amd64 [21:11:02] : [Step 4/5] >>> CPU(s): 24 [21:11:02] : [Step 4/5] >>> Heap: 2.0GB [21:11:02] : [Step 4/5] >>> VM name: 16724@c4dfe9a430b2 [21:11:02] : [Step 4/5] >>> Ignite instance name: grid-1 [21:11:02] : [Step 4/5] >>> Local node [ID=104175B5-80EF-4F12-ADF3-882ED73DF001, order=2, clientMode=false] [21:11:02] : [Step 4/5] >>> Local node addresses: [127.0.0.1] [21:11:02] : [Step 4/5] >>> Local ports: TCP:10801 TCP:47101 TCP:47501 [21:11:02] : [Step 4/5] [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,807][INFO ][test-runner-#22022%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] >>> Ignite cluster is in INACTIVE state (limited functionality available). Use control.(sh|bat) script or IgniteCluster.state(ClusterState.ACTIVE) to change the state. [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,808][INFO ][test-runner-#22022%encryption.CacheGroupKeyChangeTest%][GridDiscoveryManager] Topology snapshot [ver=2, locNode=104175b5, servers=2, clients=0, state=INACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=007663dd-64dd-4ed1-b5f4-5f2426572000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=104175b5-80ef-4f12-adf3-882ed73df001, consistentId=grid-1, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,808][INFO ][test-runner-#22022%encryption.CacheGroupKeyChangeTest%][G] Node started : [stage="Configure system pool" (0 ms),stage="Start managers" (187 ms),stage="Configure binary metadata" (1 ms),stage="Start processors" (22 ms),stage="Start 'StanByClusterTestProvider' plugin" (0 ms),stage="Start 'PageMemory tracker plugin' plugin" (0 ms),stage="Start 'TestDistibutedConfigurationPlugin' plugin" (0 ms),stage="Start 'NodeValidationPluginProvider' plugin" (0 ms),stage="Init metastore" (17 ms),stage="Init and start regions" (4 ms),stage="Restore binary memory" (12 ms),stage="Restore logical state" (11 ms),stage="Finish recovery" (20 ms),stage="Join topology" (50 ms),stage="Await transition" (2 ms),stage="Await exchange" (18 ms),stage="Total time" (344 ms)] [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,810][INFO ][test-runner-#22022%encryption.CacheGroupKeyChangeTest%][root] Node started with the following configuration [id=104175b5-80ef-4f12-adf3-882ed73df001, marshaller=BinaryMarshaller [], discovery=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=5000, ackTimeout=5000, marsh=JdkMarshaller [clsFilter=org.apache.ignite.marshaller.MarshallerUtils$1@46fc0fd2], reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], binaryCfg=null, lateAff=true] [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,811][INFO ][test-runner-#22022%encryption.CacheGroupKeyChangeTest%][GridClusterStateProcessor] Sending activate cluster request with BaselineTopology BaselineTopology [id=0, branchingHash=-2475315501, branchingType='New BaselineTopology', baselineNodes=[grid-1, grid-0]] [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,815][INFO ][disco-notifier-worker-#22134%grid-0%][GridClusterStateProcessor] Received activate cluster request with BaselineTopology[id=0] initiator node ID: 007663dd-64dd-4ed1-b5f4-5f2426572000 [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,816][INFO ][disco-notifier-worker-#22134%grid-0%][GridClusterStateProcessor] Started state transition: activate cluster [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,817][INFO ][exchange-worker-#22139%grid-0%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], crd=true, evt=DISCOVERY_CUSTOM_EVT, evtNode=007663dd-64dd-4ed1-b5f4-5f2426572000, customEvt=ChangeGlobalStateMessage [id=7b78d593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqId=39544811-bdd9-4de1-8f0e-c348da4b694b, initiatingNodeId=007663dd-64dd-4ed1-b5f4-5f2426572000, state=ACTIVE, baselineTopology=BaselineTopology [id=0, branchingHash=-2475315501, branchingType='New BaselineTopology', baselineNodes=[grid-1, grid-0]], forceChangeBaselineTopology=false, timestamp=1637345462811, forceDeactivation=true], allowMerge=false, exchangeFreeSwitch=false] [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,818][INFO ][exchange-worker-#22139%grid-0%][GridDhtPartitionsExchangeFuture] Start activation process [nodeId=007663dd-64dd-4ed1-b5f4-5f2426572000, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]]. New state: ACTIVE [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,817][INFO ][disco-notifier-worker-#22253%grid-1%][GridClusterStateProcessor] Received activate cluster request with BaselineTopology[id=0] initiator node ID: 007663dd-64dd-4ed1-b5f4-5f2426572000 [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,818][INFO ][exchange-worker-#22139%grid-0%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0 [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,819][INFO ][disco-notifier-worker-#22253%grid-1%][GridClusterStateProcessor] Started state transition: activate cluster [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,820][INFO ][exchange-worker-#22262%grid-1%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], crd=false, evt=DISCOVERY_CUSTOM_EVT, evtNode=007663dd-64dd-4ed1-b5f4-5f2426572000, customEvt=ChangeGlobalStateMessage [id=7b78d593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqId=39544811-bdd9-4de1-8f0e-c348da4b694b, initiatingNodeId=007663dd-64dd-4ed1-b5f4-5f2426572000, state=ACTIVE, baselineTopology=BaselineTopology [id=0, branchingHash=-2475315501, branchingType='New BaselineTopology', baselineNodes=[grid-1, grid-0]], forceChangeBaselineTopology=false, timestamp=1637345462811, forceDeactivation=true], allowMerge=false, exchangeFreeSwitch=false] [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,821][INFO ][exchange-worker-#22139%grid-0%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000000.wal, offset=8795, ver=2] [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,821][INFO ][exchange-worker-#22262%grid-1%][GridDhtPartitionsExchangeFuture] Start activation process [nodeId=104175b5-80ef-4f12-adf3-882ed73df001, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]]. New state: ACTIVE [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,823][INFO ][exchange-worker-#22139%grid-0%][GridClusterStateProcessor] Writing BaselineTopology[id=0] [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,823][INFO ][exchange-worker-#22262%grid-1%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1 [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,830][INFO ][exchange-worker-#22139%grid-0%][GridCacheDatabaseSharedManager] Finish recovery performed in 11 ms. [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,837][INFO ][exchange-worker-#22139%grid-0%][msg] Components activation performed in 19 ms. [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,840][INFO ][exchange-worker-#22139%grid-0%][GridCacheProcessor] Finished recovery for cache [cache=ignite-sys-cache, grp=ignite-sys-cache, startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,841][INFO ][exchange-worker-#22262%grid-1%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000000.wal, offset=8795, ver=2] [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,841][INFO ][exchange-worker-#22139%grid-0%][GridDhtPartitionsExchangeFuture] Successfully activated caches [nodeId=007663dd-64dd-4ed1-b5f4-5f2426572000, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], newState=ACTIVE] [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,844][INFO ][exchange-worker-#22262%grid-1%][GridClusterStateProcessor] Writing BaselineTopology[id=0] [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,845][INFO ][exchange-worker-#22139%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,852][INFO ][exchange-worker-#22262%grid-1%][GridCacheDatabaseSharedManager] Finish recovery performed in 27 ms. [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,852][INFO ][exchange-worker-#22262%grid-1%][msg] Components activation performed in 29 ms. [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,853][INFO ][exchange-worker-#22262%grid-1%][GridCacheProcessor] Finished recovery for cache [cache=ignite-sys-cache, grp=ignite-sys-cache, startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,854][INFO ][exchange-worker-#22262%grid-1%][GridDhtPartitionsExchangeFuture] Successfully activated caches [nodeId=104175b5-80ef-4f12-adf3-882ed73df001, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], newState=ACTIVE] [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,854][INFO ][exchange-worker-#22262%grid-1%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,858][INFO ][exchange-worker-#22139%grid-0%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], crd=true] [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,863][INFO ][grid-nio-worker-tcp-comm-0-#22077%TestRecordingCommunicationSpi%][TestRecordingCommunicationSpi] Accepted incoming communication connection [locAddr=/127.0.0.1:47100, rmtAddr=/127.0.0.1:33462] [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,865][INFO ][grid-nio-worker-tcp-comm-0-#22196%TestRecordingCommunicationSpi%][TestRecordingCommunicationSpi] Established outgoing communication connection [locAddr=/127.0.0.1:33462, rmtAddr=/127.0.0.1:47100] [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,865][INFO ][exchange-worker-#22262%grid-1%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], crd=false] [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,867][INFO ][sys-#22117%grid-0%][GridDhtPartitionsExchangeFuture] Coordinator received single message [ver=AffinityTopologyVersion [topVer=2, minorTopVer=1], node=104175b5-80ef-4f12-adf3-882ed73df001, allReceived=true] [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,867][INFO ][sys-#22117%grid-0%][GridDhtPartitionsExchangeFuture] finishExchangeOnCoordinator [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,872][INFO ][sys-#22117%grid-0%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], err=null, rebalanced=true, wasRebalanced=false] [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,872][INFO ][disco-notifier-worker-#22134%grid-0%][GridClusterStateProcessor] Received state change finish message: ACTIVE [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,875][INFO ][disco-notifier-worker-#22253%grid-1%][GridClusterStateProcessor] Received state change finish message: ACTIVE [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,875][INFO ][disco-notifier-worker-#22253%grid-1%][GridClusterStateProcessor] Cluster state was changed from INACTIVE to ACTIVE [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,875][INFO ][disco-notifier-worker-#22134%grid-0%][GridClusterStateProcessor] Cluster state was changed from INACTIVE to ACTIVE [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,874][INFO ][sys-#22240%grid-1%][GridDhtPartitionsExchangeFuture] Received full message, will finish exchange [node=007663dd-64dd-4ed1-b5f4-5f2426572000, resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,877][INFO ][sys-#22117%grid-0%][GridCacheProcessor] Finish proxy initialization, cacheName=ignite-sys-cache, localNodeId=007663dd-64dd-4ed1-b5f4-5f2426572000 [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,877][INFO ][sys-#22233%grid-1%][GridCachePartitionExchangeManager] Delay process full message without exchange id (there is exchange in progress) [nodeId=007663dd-64dd-4ed1-b5f4-5f2426572000] [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,878][INFO ][exchange-worker-#22139%grid-0%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=2, minorTopVer=1], force=false, evt=DISCOVERY_CUSTOM_EVT, node=007663dd-64dd-4ed1-b5f4-5f2426572000] [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,878][INFO ][sys-#22129%grid-0%][DistributedBaselineConfiguration] Baseline auto-adjust is 'disabled' with timeout='300000' ms [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,879][INFO ][sys-#22129%grid-0%][GridClusterStateProcessor] Successfully performed final activation steps [nodeId=007663dd-64dd-4ed1-b5f4-5f2426572000, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,878][INFO ][sys-#22240%grid-1%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], err=null, rebalanced=true, wasRebalanced=false] [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,878][INFO ][sys-#22117%grid-0%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=007663dd-64dd-4ed1-b5f4-5f2426572000, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=007663dd-64dd-4ed1-b5f4-5f2426572000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345462872, loc=true, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,882][INFO ][sys-#22240%grid-1%][GridCacheProcessor] Finish proxy initialization, cacheName=ignite-sys-cache, localNodeId=104175b5-80ef-4f12-adf3-882ed73df001 [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,883][INFO ][sys-#22117%grid-0%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (1 ms), stage="Update caches registry" (20 ms), stage="Start caches" (2 ms), stage="Affinity initialization on cache group start" (0 ms), stage="Determine exchange type" (3 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Restore partition states" (0 ms), stage="After states restored callback" (12 ms), stage="WAL history reservation" (0 ms), stage="Waiting for all single messages" (9 ms), stage="Affinity recalculation (crd)" (0 ms), stage="Collect update counters and create affinity messages" (0 ms), stage="Assign partitions states" (0 ms), stage="Validate partitions states" (0 ms), stage="Ideal affinity diff calculation (enforced)" (0 ms), stage="Apply update counters" (0 ms), stage="Full message preparing" (2 ms), stage="Full message sending" (0 ms), stage="State finish message sending" (0 ms), stage="Detect lost partitions" (3 ms), stage="Exchange done" (6 ms), stage="Total time" (58 ms), Discovery lag=4 ms, Latest started node id=104175b5-80ef-4f12-adf3-882ed73df001] [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,885][INFO ][sys-#22117%grid-0%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], stage="Affinity initialization on cache group start [grp=ignite-sys-cache]" (0 ms) (parent=Affinity initialization on cache group start), stage="Affinity centralized initialization (crd) [grp=ignite-sys-cache, crd=true]" (2 ms) (parent=Determine exchange type), stage="Restore partition states [grp=ignite-sys-cache]" (0 ms) (parent=Restore partition states), stage="Affinity recalculation (partitions availability) [grp=ignite-sys-cache]" (0 ms) (parent=Ideal affinity diff calculation (enforced))] [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,884][INFO ][test-runner-#22022%encryption.CacheGroupKeyChangeTest%][root] awaitPartitionMapExchange finished [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,884][INFO ][sys-#22240%grid-1%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=104175b5-80ef-4f12-adf3-882ed73df001, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=007663dd-64dd-4ed1-b5f4-5f2426572000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345462767, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,884][INFO ][exchange-worker-#22262%grid-1%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=2, minorTopVer=1], force=false, evt=DISCOVERY_CUSTOM_EVT, node=007663dd-64dd-4ed1-b5f4-5f2426572000] [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,884][INFO ][sys-#22250%grid-1%][DistributedBaselineConfiguration] Baseline auto-adjust is 'disabled' with timeout='300000' ms [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,888][INFO ][sys-#22240%grid-1%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (1 ms), stage="Update caches registry" (31 ms), stage="Start caches" (0 ms), stage="Affinity initialization on cache group start" (0 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Restore partition states" (0 ms), stage="After states restored callback" (5 ms), stage="WAL history reservation" (0 ms), stage="Waiting for Full message" (13 ms), stage="Affinity recalculation" (3 ms), stage="Full map updating" (0 ms), stage="Detect lost partitions" (3 ms), stage="Exchange done" (6 ms), stage="Total time" (62 ms)] [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,889][INFO ][sys-#22240%grid-1%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], stage="Affinity initialization on cache group start [grp=ignite-sys-cache]" (0 ms) (parent=Affinity initialization on cache group start), stage="Affinity centralized initialization (crd) [grp=ignite-sys-cache, crd=false]" (0 ms) (parent=Determine exchange type), stage="Restore partition states [grp=ignite-sys-cache]" (0 ms) (parent=Restore partition states), stage="Affinity applying from full message [grp=ignite-sys-cache]" (3 ms) (parent=Affinity recalculation)] [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,888][INFO ][sys-#22250%grid-1%][GridClusterStateProcessor] Successfully performed final activation steps [nodeId=104175b5-80ef-4f12-adf3-882ed73df001, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,892][INFO ][exchange-worker-#22139%grid-0%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], crd=true, evt=DISCOVERY_CUSTOM_EVT, evtNode=007663dd-64dd-4ed1-b5f4-5f2426572000, customEvt=DynamicCacheChangeBatch [id=bd78d593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqs=ArrayList [DynamicCacheChangeRequest [cacheName=encrypted, hasCfg=true, nodeId=007663dd-64dd-4ed1-b5f4-5f2426572000, clientStartOnly=false, stop=false, destroy=false, disabledAfterStart=false]], exchangeActions=ExchangeActions [startCaches=[encrypted], stopCaches=null, startGrps=[encrypted], stopGrps=[], resetParts=null, stateChangeRequest=null], startCaches=false], allowMerge=false, exchangeFreeSwitch=false] [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,892][INFO ][exchange-worker-#22262%grid-1%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], crd=false, evt=DISCOVERY_CUSTOM_EVT, evtNode=007663dd-64dd-4ed1-b5f4-5f2426572000, customEvt=DynamicCacheChangeBatch [id=bd78d593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqs=ArrayList [DynamicCacheChangeRequest [cacheName=encrypted, hasCfg=true, nodeId=007663dd-64dd-4ed1-b5f4-5f2426572000, clientStartOnly=false, stop=false, destroy=false, disabledAfterStart=false]], exchangeActions=ExchangeActions [startCaches=[encrypted], stopCaches=null, startGrps=[encrypted], stopGrps=[], resetParts=null, stateChangeRequest=null], startCaches=false], allowMerge=false, exchangeFreeSwitch=false] [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,894][INFO ][exchange-worker-#22139%grid-0%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,895][INFO ][exchange-worker-#22262%grid-1%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,900][INFO ][exchange-worker-#22262%grid-1%][GridCacheProcessor] Started cache [name=encrypted, id=1613773252, dataRegionName=default, mode=PARTITIONED, atomicity=ATOMIC, backups=0, mvcc=false] [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,900][INFO ][exchange-worker-#22139%grid-0%][GridCacheProcessor] Started cache [name=encrypted, id=1613773252, dataRegionName=default, mode=PARTITIONED, atomicity=ATOMIC, backups=0, mvcc=false] [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,900][INFO ][exchange-worker-#22139%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], waitTime=0ms, futInfo=NA, mode=DISTRIBUTED] [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,900][INFO ][exchange-worker-#22262%grid-1%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], waitTime=0ms, futInfo=NA, mode=DISTRIBUTED] [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,902][INFO ][exchange-worker-#22139%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partitions release latch: ServerLatch [permits=0, pendingAcks=HashSet [], super=CompletableLatch [id=CompletableLatchUid [id=exchange, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2]]]] [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,902][INFO ][exchange-worker-#22262%grid-1%][GridDhtPartitionsExchangeFuture] Finished waiting for partitions release latch: ClientLatch [coordinator=TcpDiscoveryNode [id=007663dd-64dd-4ed1-b5f4-5f2426572000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345462767, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], ackSent=true, super=CompletableLatch [id=CompletableLatchUid [id=exchange, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2]]]] [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,903][INFO ][exchange-worker-#22262%grid-1%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,902][INFO ][exchange-worker-#22139%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,904][INFO ][exchange-worker-#22139%grid-0%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], crd=true] [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,904][INFO ][exchange-worker-#22262%grid-1%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], crd=false] [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,905][INFO ][sys-#22115%grid-0%][GridDhtPartitionsExchangeFuture] Coordinator received single message [ver=AffinityTopologyVersion [topVer=2, minorTopVer=2], node=104175b5-80ef-4f12-adf3-882ed73df001, allReceived=true] [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,905][INFO ][sys-#22115%grid-0%][GridDhtPartitionsExchangeFuture] finishExchangeOnCoordinator [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2]] [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,909][INFO ][sys-#22115%grid-0%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], err=null, rebalanced=true, wasRebalanced=true] [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,909][INFO ][sys-#22242%grid-1%][GridDhtPartitionsExchangeFuture] Received full message, will finish exchange [node=007663dd-64dd-4ed1-b5f4-5f2426572000, resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2]] [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,910][INFO ][sys-#22115%grid-0%][GridCacheProcessor] Finish proxy initialization, cacheName=encrypted, localNodeId=007663dd-64dd-4ed1-b5f4-5f2426572000 [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,911][INFO ][sys-#22242%grid-1%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], err=null, rebalanced=true, wasRebalanced=true] [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,911][INFO ][exchange-worker-#22139%grid-0%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=2, minorTopVer=2], force=false, evt=DISCOVERY_CUSTOM_EVT, node=007663dd-64dd-4ed1-b5f4-5f2426572000] [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,911][INFO ][sys-#22115%grid-0%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=007663dd-64dd-4ed1-b5f4-5f2426572000, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=007663dd-64dd-4ed1-b5f4-5f2426572000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345462882, loc=true, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2]] [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,911][INFO ][sys-#22242%grid-1%][GridCacheProcessor] Finish proxy initialization, cacheName=encrypted, localNodeId=104175b5-80ef-4f12-adf3-882ed73df001 [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,914][INFO ][sys-#22115%grid-0%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (1 ms), stage="Update caches registry" (0 ms), stage="Start caches" (6 ms), stage="Affinity initialization on cache group start" (0 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Wait partitions release latch [latch=exchange]" (1 ms), stage="Wait partitions release [latch=exchange]" (1 ms), stage="Restore partition states" (0 ms), stage="After states restored callback" (0 ms), stage="WAL history reservation" (0 ms), stage="Waiting for all single messages" (1 ms), stage="Affinity recalculation (crd)" (0 ms), stage="Collect update counters and create affinity messages" (0 ms), stage="Assign partitions states" (0 ms), stage="Validate partitions states" (0 ms), stage="Apply update counters" (0 ms), stage="Full message preparing" (2 ms), stage="Full message sending" (0 ms), stage="Exchange done" (4 ms), stage="Total time" (16 ms)] [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,916][INFO ][sys-#22115%grid-0%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], stage="Affinity initialization on cache group start [grp=encrypted]" (0 ms) (parent=Affinity initialization on cache group start), stage="Restore partition states [grp=ignite-sys-cache]" (0 ms) (parent=Restore partition states), stage="Restore partition states [grp=encrypted]" (0 ms) (parent=Restore partition states)] [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,914][INFO ][exchange-worker-#22262%grid-1%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=2, minorTopVer=2], force=false, evt=DISCOVERY_CUSTOM_EVT, node=007663dd-64dd-4ed1-b5f4-5f2426572000] [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,914][INFO ][sys-#22242%grid-1%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=104175b5-80ef-4f12-adf3-882ed73df001, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=007663dd-64dd-4ed1-b5f4-5f2426572000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345462767, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2]] [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,919][INFO ][sys-#22242%grid-1%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (1 ms), stage="Update caches registry" (0 ms), stage="Start caches" (5 ms), stage="Affinity initialization on cache group start" (0 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Wait partitions release latch [latch=exchange]" (1 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Restore partition states" (0 ms), stage="After states restored callback" (0 ms), stage="WAL history reservation" (0 ms), stage="Waiting for Full message" (5 ms), stage="Affinity recalculation" (0 ms), stage="Full map updating" (0 ms), stage="Exchange done" (8 ms), stage="Total time" (20 ms)] [21:11:02] : [Step 4/5] [2021-11-19 21:11:02,921][INFO ][sys-#22242%grid-1%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], stage="Affinity initialization on cache group start [grp=encrypted]" (0 ms) (parent=Affinity initialization on cache group start), stage="Restore partition states [grp=ignite-sys-cache]" (0 ms) (parent=Restore partition states), stage="Restore partition states [grp=encrypted]" (0 ms) (parent=Restore partition states)] [21:11:03] : [Step 4/5] [2021-11-19 21:11:03,243][INFO ][test-runner-#22022%encryption.CacheGroupKeyChangeTest%][root] awaitPartitionMapExchange finished [21:11:03] : [Step 4/5] [2021-11-19 21:11:03,247][INFO ][disco-notifier-worker-#22253%grid-1%][IgniteTestResources] Block message [node=007663dd-64dd-4ed1-b5f4-5f2426572000, order=1, msg=org.apache.ignite.internal.util.distributed.SingleNodeMessage@6b8c98f8] [21:11:03]W: [org.apache.ignite:ignite-core] [2021-11-19 21:11:03,252][WARN ][test-runner-#22022%encryption.CacheGroupKeyChangeTest%][G] Ignite work directory is not provided, automatically resolved to: /opt/buildagent/work/7bc1c54bc719b67c/work [21:11:03] : [Step 4/5] [2021-11-19 21:11:03,253][INFO ][test-runner-#22022%encryption.CacheGroupKeyChangeTest%][IgniteKernal%client] [21:11:03] : [Step 4/5] [21:11:03] : [Step 4/5] >>> __________ ________________ [21:11:03] : [Step 4/5] >>> / _/ ___/ |/ / _/_ __/ __/ [21:11:03] : [Step 4/5] >>> _/ // (7 7 // / / / / _/ [21:11:03] : [Step 4/5] >>> /___/\___/_/|_/___/ /_/ /___/ [21:11:03] : [Step 4/5] >>> [21:11:03] : [Step 4/5] >>> ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:11:03] : [Step 4/5] >>> 2021 Copyright(C) Apache Software Foundation [21:11:03] : [Step 4/5] >>> [21:11:03] : [Step 4/5] >>> Ignite documentation: http://ignite.apache.org [21:11:03] : [Step 4/5] [21:11:03] : [Step 4/5] [2021-11-19 21:11:03,254][INFO ][test-runner-#22022%encryption.CacheGroupKeyChangeTest%][IgniteKernal%client] Config URL: n/a [21:11:03] : [Step 4/5] [2021-11-19 21:11:03,255][INFO ][test-runner-#22022%encryption.CacheGroupKeyChangeTest%][IgniteKernal%client] IgniteConfiguration [igniteInstanceName=client, pubPoolSize=24, svcPoolSize=24, callbackPoolSize=24, stripedPoolSize=24, sysPoolSize=24, mgmtPoolSize=4, dataStreamerPoolSize=24, utilityCachePoolSize=24, utilityCacheKeepAliveTime=60000, p2pPoolSize=2, qryPoolSize=24, buildIdxPoolSize=4, igniteHome=/opt/buildagent/work/7bc1c54bc719b67c, igniteWorkDir=/opt/buildagent/work/7bc1c54bc719b67c/work, mbeanSrv=com.sun.jmx.mbeanserver.JmxMBeanServer@6fe85038, nodeId=2d18d8d9-5d37-4dd6-9bf0-5422dda2a08c, marsh=BinaryMarshaller [], marshLocJobs=false, daemon=false, p2pEnabled=true, netTimeout=10000, netCompressionLevel=1, sndRetryDelay=1000, sndRetryCnt=3, metricsHistSize=10000, metricsUpdateFreq=1000, metricsExpTime=9223372036854775807, discoSpi=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=0, ackTimeout=0, marsh=null, reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], segPlc=STOP, segResolveAttempts=2, waitForSegOnStart=true, allResolversPassReq=true, segChkFreq=10000, commSpi=TcpCommunicationSpi [connectGate=org.apache.ignite.spi.communication.tcp.internal.ConnectGateway@60bd25cf, ctxInitLatch=java.util.concurrent.CountDownLatch@28eb4e3b[Count = 1], stopping=false, clientPool=null, nioSrvWrapper=null, stateProvider=null], evtSpi=MemoryEventStorageSpi [expireAgeMs=9223372036854775807, expireCnt=10000, filter=null], colSpi=NoopCollisionSpi [], deploySpi=LocalDeploymentSpi [], indexingSpi=org.apache.ignite.spi.indexing.noop.NoopIndexingSpi@72f67b8, addrRslvr=null, encryptionSpi=org.apache.ignite.spi.encryption.keystore.KeystoreEncryptionSpi@50193c66, tracingSpi=org.apache.ignite.spi.tracing.NoopTracingSpi@41f0da55, clientMode=true, rebalanceThreadPoolSize=4, rebalanceTimeout=10000, rebalanceBatchesPrefetchCnt=3, rebalanceThrottle=0, rebalanceBatchSize=524288, txCfg=TransactionConfiguration [txSerEnabled=false, dfltIsolation=REPEATABLE_READ, dfltConcurrency=PESSIMISTIC, dfltTxTimeout=0, txTimeoutOnPartitionMapExchange=0, deadlockTimeout=10000, pessimisticTxLogSize=0, pessimisticTxLogLinger=10000, tmLookupClsName=null, txManagerFactory=null, useJtaSync=false], cacheSanityCheckEnabled=true, discoStartupDelay=60000, deployMode=SHARED, p2pMissedCacheSize=100, locHost=127.0.0.1, timeSrvPortBase=31100, timeSrvPortRange=100, failureDetectionTimeout=10000, sysWorkerBlockedTimeout=null, clientFailureDetectionTimeout=10000, metricsLogFreq=0, connectorCfg=null, odbcCfg=null, warmupClos=null, atomicCfg=AtomicConfiguration [seqReserveSize=1000, cacheMode=PARTITIONED, backups=1, aff=null, grpName=null], classLdr=null, sslCtxFactory=null, platformCfg=null, binaryCfg=null, memCfg=null, pstCfg=null, dsCfg=DataStorageConfiguration [sysRegionInitSize=41943040, sysRegionMaxSize=104857600, pageSize=4096, concLvl=0, dfltDataRegConf=DataRegionConfiguration [name=default, maxSize=104857600, initSize=268435456, swapPath=null, pageEvictionMode=DISABLED, pageReplacementMode=CLOCK, evictionThreshold=0.9, emptyPagesPoolSize=100, metricsEnabled=false, metricsSubIntervalCount=5, metricsRateTimeInterval=60000, persistenceEnabled=true, checkpointPageBufSize=0, lazyMemoryAllocation=true, warmUpCfg=null], dataRegions=null, storagePath=null, checkpointFreq=30000, lockWaitTime=10000, checkpointThreads=4, checkpointWriteOrder=SEQUENTIAL, walHistSize=20, maxWalArchiveSize=20971520, walSegments=10, walSegmentSize=1048576, walPath=db/wal, walArchivePath=db/wal/archive, cdcWalPath=db/wal/cdc, cdcEnabled=false, metricsEnabled=false, walMode=LOG_ONLY, walTlbSize=131072, walBuffSize=0, walFlushFreq=2000, walFsyncDelay=1000, walRecordIterBuffSize=67108864, alwaysWriteFullPages=false, fileIOFactory=org.apache.ignite.internal.processors.cache.persistence.file.AsyncFileIOFactory@1490121, metricsSubIntervalCnt=5, metricsRateTimeInterval=60000, walAutoArchiveAfterInactivity=-1, walForceArchiveTimeout=-1, writeThrottlingEnabled=false, walCompactionEnabled=false, walCompactionLevel=1, checkpointReadLockTimeout=null, walPageCompression=DISABLED, walPageCompressionLevel=null, dfltWarmUpCfg=null, encCfg=org.apache.ignite.configuration.EncryptionConfiguration@499fd38b, defragmentationThreadPoolSize=4, minWalArchiveSize=-1], snapshotPath=snapshots, activeOnStart=true, activeOnStartPropSetFlag=false, autoActivation=true, autoActivationPropSetFlag=false, clusterStateOnStart=null, sqlConnCfg=null, cliConnCfg=ClientConnectorConfiguration [host=null, port=10800, portRange=100, sockSndBufSize=0, sockRcvBufSize=0, tcpNoDelay=true, maxOpenCursorsPerConn=128, threadPoolSize=24, selectorCnt=12, idleTimeout=0, handshakeTimeout=10000, jdbcEnabled=true, odbcEnabled=true, thinCliEnabled=true, sslEnabled=false, useIgniteSslCtxFactory=true, sslClientAuth=false, sslCtxFactory=null, thinCliCfg=ThinClientConfiguration [maxActiveTxPerConn=100, maxActiveComputeTasksPerConn=0]], mvccVacuumThreadCnt=2, mvccVacuumFreq=5000, authEnabled=false, failureHnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]], commFailureRslvr=null, sqlCfg=SqlConfiguration [longQryWarnTimeout=3000, dfltQryTimeout=0, sqlQryHistSize=1000, validationEnabled=false], asyncContinuationExecutor=null] [21:11:03] : [Step 4/5] [2021-11-19 21:11:03,264][INFO ][test-runner-#22022%encryption.CacheGroupKeyChangeTest%][IgniteKernal%client] Daemon mode: off [21:11:03] : [Step 4/5] [2021-11-19 21:11:03,265][INFO ][test-runner-#22022%encryption.CacheGroupKeyChangeTest%][IgniteKernal%client] OS: Linux 4.15.0-151-generic amd64 [21:11:03] : [Step 4/5] [2021-11-19 21:11:03,265][INFO ][test-runner-#22022%encryption.CacheGroupKeyChangeTest%][IgniteKernal%client] OS user: teamcity [21:11:03] : [Step 4/5] [2021-11-19 21:11:03,265][INFO ][test-runner-#22022%encryption.CacheGroupKeyChangeTest%][IgniteKernal%client] PID: 16724 [21:11:03] : [Step 4/5] [2021-11-19 21:11:03,266][INFO ][test-runner-#22022%encryption.CacheGroupKeyChangeTest%][IgniteKernal%client] Language runtime: Java Platform API Specification ver. 1.8 [21:11:03] : [Step 4/5] [2021-11-19 21:11:03,266][INFO ][test-runner-#22022%encryption.CacheGroupKeyChangeTest%][IgniteKernal%client] VM information: Java(TM) SE Runtime Environment 1.8.0_261-b12 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 25.261-b12 [21:11:03] : [Step 4/5] [2021-11-19 21:11:03,266][INFO ][test-runner-#22022%encryption.CacheGroupKeyChangeTest%][IgniteKernal%client] VM total memory: 1.9GB [21:11:03] : [Step 4/5] [2021-11-19 21:11:03,267][INFO ][test-runner-#22022%encryption.CacheGroupKeyChangeTest%][IgniteKernal%client] Remote Management [restart: off, REST: off, JMX (remote: off)] [21:11:03] : [Step 4/5] [2021-11-19 21:11:03,267][INFO ][test-runner-#22022%encryption.CacheGroupKeyChangeTest%][IgniteKernal%client] Logger: GridTestLog4jLogger [quiet=false, config=null] [21:11:03] : [Step 4/5] [2021-11-19 21:11:03,267][INFO ][test-runner-#22022%encryption.CacheGroupKeyChangeTest%][IgniteKernal%client] IGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c [21:11:03] : [Step 4/5] [2021-11-19 21:11:03,268][INFO ][test-runner-#22022%encryption.CacheGroupKeyChangeTest%][IgniteKernal%client] VM arguments: [-DIGNITE_DUMP_THREADS_ON_FAILURE=false, -DMono=/usr/bin/mono-sgen, -DMono4.0_x64=/usr/lib/mono/4.0, -DMono4.5_x64=/usr/lib/mono/4.5, -DMonoVersion=6.12.0.90, -DSKIP_BUILD=false, -Dagent.home.dir=/opt/buildagent, -Dagent.name=aitc-lin02_03, -Dagent.ownPort=9090, -Dagent.work.dir=/opt/buildagent/work, -Dbuild.number=95, -Dbuild.vcs.number=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.1=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.GitHubApacheIgnite=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dclassworlds.conf=/opt/buildagent/temp/buildTmp/teamcity.m2.conf, -Dcom.jetbrains.maven.watcher.report.file=/opt/buildagent/temp/buildTmp/maven-build-info.xml, -Djava.io.tmpdir=/opt/buildagent/temp/buildTmp, -Dmaven.home=/opt/buildagent/tools/maven3_6, -Dmaven.multiModuleProjectDirectory=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.agent.cpuBenchmark=457, -Dteamcity.agent.dotnet.agent_url=http://localhost:9090/RPC2, -Dteamcity.agent.dotnet.build_id=6278078, -Dteamcity.auth.password=*******, -Dteamcity.auth.userId=TeamCityBuildId=6278078, -Dteamcity.build.changedFiles.file=/opt/buildagent/temp/buildTmp/changedFiles6342607772318147725.txt, -Dteamcity.build.checkoutDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.build.id=6278078, -Dteamcity.build.properties.file=/opt/buildagent/temp/buildTmp/teamcity.build5164517880467851002.properties, -Dteamcity.build.tempDir=/opt/buildagent/temp/buildTmp, -Dteamcity.build.workingDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.buildConfName=Basic 3, -Dteamcity.buildType.id=IgniteTests24Java8_Basic3, -Dteamcity.configuration.properties.file=/opt/buildagent/temp/buildTmp/teamcity.config5591980786735343870.properties, -Dteamcity.maven.userSettings.path=/opt/buildagent/temp/buildTmp/maven_settings_585072866407032347.xml, -Dteamcity.maven.watcher.home=/opt/buildagent/plugins/mavenPlugin/maven-watcher-jdk16, -Dteamcity.projectName=Ignite Tests 2.x (JDK 8/11), -Dteamcity.runner.properties.file=/opt/buildagent/temp/buildTmp/teamcity.runner9098465561618137420.properties, -Dteamcity.tests.recentlyFailedTests.file=/opt/buildagent/temp/buildTmp/testsToRunFirst3891775683130404069.txt, -Dteamcity.version=2021.2 (build 99542), -ea, -Xms2g, -Xmx2g, -XX:+HeapDumpOnOutOfMemoryError, -DIGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_TEST_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_UPDATE_NOTIFIER=false, -DIGNITE_NO_DISCO_ORDER=true, -DIGNITE_PERFORMANCE_SUGGESTIONS_DISABLED=true, -Djava.net.preferIPv4Stack=true, -DTEST_SCALE_FACTOR=1.0, -DIGNITE_TEST_PROP_LOG4J_FILE=log4j-tc-test.xml, -DIGNITE_QUIET=false, -DIGNITE_MARSHAL_BUFFERS_RECHECK=1000, -Dmaven.repo.local=/opt/buildagent/.m2/repository] [21:11:03] : [Step 4/5] [2021-11-19 21:11:03,273][INFO ][test-runner-#22022%encryption.CacheGroupKeyChangeTest%][IgniteKernal%client] System cache's DataRegion size is configured to 40 MB. Use DataStorageConfiguration.systemRegionInitialSize property to change the setting. [21:11:03] : [Step 4/5] [2021-11-19 21:11:03,273][INFO ][test-runner-#22022%encryption.CacheGroupKeyChangeTest%][IgniteKernal%client] Configured caches [in 'sysMemPlc' dataRegion: ['ignite-sys-cache']] [21:11:03]W: [org.apache.ignite:ignite-core] [2021-11-19 21:11:03,274][WARN ][test-runner-#22022%encryption.CacheGroupKeyChangeTest%][IgniteKernal%client] Peer class loading is enabled (disable it in production for performance and deployment consistency reasons) [21:11:03] : [Step 4/5] [2021-11-19 21:11:03,274][INFO ][test-runner-#22022%encryption.CacheGroupKeyChangeTest%][IgniteKernal%client] 3-rd party licenses can be found at: /opt/buildagent/work/7bc1c54bc719b67c/libs/licenses [21:11:03] : [Step 4/5] [2021-11-19 21:11:03,279][INFO ][test-runner-#22022%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] Configured plugins: [21:11:03] : [Step 4/5] [2021-11-19 21:11:03,279][INFO ][test-runner-#22022%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- StanByClusterTestProvider 1.0 [21:11:03] : [Step 4/5] [2021-11-19 21:11:03,280][INFO ][test-runner-#22022%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:11:03] : [Step 4/5] [2021-11-19 21:11:03,280][INFO ][test-runner-#22022%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] [21:11:03] : [Step 4/5] [2021-11-19 21:11:03,280][INFO ][test-runner-#22022%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- PageMemory tracker plugin 1.0 [21:11:03] : [Step 4/5] [2021-11-19 21:11:03,281][INFO ][test-runner-#22022%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:11:03] : [Step 4/5] [2021-11-19 21:11:03,281][INFO ][test-runner-#22022%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] [21:11:03] : [Step 4/5] [2021-11-19 21:11:03,281][INFO ][test-runner-#22022%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- TestDistibutedConfigurationPlugin 1.0 [21:11:03] : [Step 4/5] [2021-11-19 21:11:03,281][INFO ][test-runner-#22022%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:11:03] : [Step 4/5] [2021-11-19 21:11:03,281][INFO ][test-runner-#22022%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] [21:11:03] : [Step 4/5] [2021-11-19 21:11:03,281][INFO ][test-runner-#22022%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- NodeValidationPluginProvider 1.0 [21:11:03] : [Step 4/5] [2021-11-19 21:11:03,282][INFO ][test-runner-#22022%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:11:03] : [Step 4/5] [2021-11-19 21:11:03,282][INFO ][test-runner-#22022%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] [21:11:03] : [Step 4/5] [2021-11-19 21:11:03,282][INFO ][test-runner-#22022%encryption.CacheGroupKeyChangeTest%][FailureProcessor] Configured failure handler: [hnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]]] [21:11:03] : [Step 4/5] [2021-11-19 21:11:03,322][INFO ][test-runner-#22022%encryption.CacheGroupKeyChangeTest%][TestRecordingCommunicationSpi] Successfully bound communication NIO server to TCP port [port=47102, locHost=/127.0.0.1, selectorsCnt=12, selectorSpins=0, pairedConn=false] [21:11:03]W: [org.apache.ignite:ignite-core] [2021-11-19 21:11:03,323][WARN ][test-runner-#22022%encryption.CacheGroupKeyChangeTest%][TestRecordingCommunicationSpi] Message queue limit is set to 0 which may lead to potential OOMEs when running cache operations in FULL_ASYNC or PRIMARY_SYNC modes due to message queues growth on sender and receiver sides. [21:11:03] : [Step 4/5] [2021-11-19 21:11:03,334][INFO ][test-runner-#22022%encryption.CacheGroupKeyChangeTest%][GridCollisionManager] Collision resolution is disabled (all jobs will be activated upon arrival). [21:11:03] : [Step 4/5] [2021-11-19 21:11:03,334][INFO ][test-runner-#22022%encryption.CacheGroupKeyChangeTest%][IgniteKernal%client] Security status [authentication=off, sandbox=off, tls/ssl=off] [21:11:03] : [Step 4/5] [2021-11-19 21:11:03,388][INFO ][test-runner-#22022%encryption.CacheGroupKeyChangeTest%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:03]W: [org.apache.ignite:ignite-core] [2021-11-19 21:11:03,472][WARN ][test-runner-#22022%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Persistent Store is not supported on client nodes (Persistent Store's configuration will be ignored). [21:11:03] : [Step 4/5] [2021-11-19 21:11:03,474][INFO ][test-runner-#22022%encryption.CacheGroupKeyChangeTest%][IgniteCacheDatabaseSharedManager] Configured data regions initialized successfully [total=4] [21:11:03] : [Step 4/5] [2021-11-19 21:11:03,477][INFO ][test-runner-#22022%encryption.CacheGroupKeyChangeTest%][ClientListenerProcessor] Client connector processor has started on TCP port 10802 [21:11:03] : [Step 4/5] [2021-11-19 21:11:03,479][INFO ][test-runner-#22022%encryption.CacheGroupKeyChangeTest%][IgniteKernal%client] Non-loopback local IPs: 172.17.0.4 [21:11:03] : [Step 4/5] [2021-11-19 21:11:03,479][INFO ][test-runner-#22022%encryption.CacheGroupKeyChangeTest%][IgniteKernal%client] Enabled local MACs: 0242AC110004 [21:11:03] : [Step 4/5] [2021-11-19 21:11:03,479][INFO ][test-runner-#22022%encryption.CacheGroupKeyChangeTest%][ClusterProcessor] Cluster ID and tag has been read from metastorage: null [21:11:03] : [Step 4/5] [2021-11-19 21:11:03,480][INFO ][test-runner-#22022%encryption.CacheGroupKeyChangeTest%][IgniteClusterImpl] Shutdown policy was updated [oldVal=null, newVal=null] [21:11:03] : [Step 4/5] [2021-11-19 21:11:03,484][INFO ][tcp-disco-srvr-[:47500]-#1162%grid-0%-#22136%grid-0%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=49941] [21:11:03] : [Step 4/5] [2021-11-19 21:11:03,484][INFO ][tcp-disco-srvr-[:47500]-#1162%grid-0%-#22136%grid-0%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=49941] [21:11:03] : [Step 4/5] [2021-11-19 21:11:03,485][INFO ][tcp-disco-sock-reader-[]-#1178%grid-0%-#22374%grid-0%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:49941, rmtPort=49941] [21:11:03] : [Step 4/5] [2021-11-19 21:11:03,486][INFO ][tcp-disco-sock-reader-[2d18d8d9 127.0.0.1:49941 client]-#1178%grid-0%-#22374%grid-0%][TestTcpDiscoverySpi] Initialized connection with remote client node [nodeId=2d18d8d9-5d37-4dd6-9bf0-5422dda2a08c, rmtAddr=/127.0.0.1:49941] [21:11:03] : [Step 4/5] [2021-11-19 21:11:03,501][INFO ][disco-event-worker-#22138%grid-0%][GridDiscoveryManager] Added new node to topology: TcpDiscoveryNode [id=2d18d8d9-5d37-4dd6-9bf0-5422dda2a08c, consistentId=client, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:0], discPort=0, order=3, intOrder=3, lastExchangeTime=1637345463480, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=true] [21:11:03] : [Step 4/5] [2021-11-19 21:11:03,501][INFO ][tcp-client-disco-msg-worker-#1177%client%-#22372%client%][TestTcpDiscoverySpi] Router node: TcpDiscoveryNode [id=007663dd-64dd-4ed1-b5f4-5f2426572000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345463490, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false] [21:11:03] : [Step 4/5] [2021-11-19 21:11:03,502][INFO ][disco-event-worker-#22138%grid-0%][GridDiscoveryManager] Topology snapshot [ver=3, locNode=007663dd, servers=2, clients=1, state=ACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=007663dd-64dd-4ed1-b5f4-5f2426572000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=104175b5-80ef-4f12-adf3-882ed73df001, consistentId=grid-1, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=2d18d8d9-5d37-4dd6-9bf0-5422dda2a08c, consistentId=client, isClient=true, ver=2.13.0#20211119-sha1:00000000]]] [21:11:03] : [Step 4/5] [2021-11-19 21:11:03,502][INFO ][disco-event-worker-#22261%grid-1%][GridDiscoveryManager] Added new node to topology: TcpDiscoveryNode [id=2d18d8d9-5d37-4dd6-9bf0-5422dda2a08c, consistentId=client, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:0], discPort=0, order=3, intOrder=3, lastExchangeTime=1637345463490, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=true] [21:11:03] : [Step 4/5] [2021-11-19 21:11:03,503][INFO ][disco-event-worker-#22138%grid-0%][GridDiscoveryManager] ^-- Baseline [id=0, size=2, online=2, offline=0] [21:11:03] : [Step 4/5] [2021-11-19 21:11:03,503][INFO ][disco-event-worker-#22261%grid-1%][GridDiscoveryManager] Topology snapshot [ver=3, locNode=104175b5, servers=2, clients=1, state=ACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=007663dd-64dd-4ed1-b5f4-5f2426572000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=104175b5-80ef-4f12-adf3-882ed73df001, consistentId=grid-1, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=2d18d8d9-5d37-4dd6-9bf0-5422dda2a08c, consistentId=client, isClient=true, ver=2.13.0#20211119-sha1:00000000]]] [21:11:03] : [Step 4/5] [2021-11-19 21:11:03,504][INFO ][disco-event-worker-#22261%grid-1%][GridDiscoveryManager] ^-- Baseline [id=0, size=2, online=2, offline=0] [21:11:03] : [Step 4/5] [2021-11-19 21:11:03,504][INFO ][exchange-worker-#22139%grid-0%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], crd=true, evt=NODE_JOINED, evtNode=2d18d8d9-5d37-4dd6-9bf0-5422dda2a08c, customEvt=null, allowMerge=true, exchangeFreeSwitch=false] [21:11:03] : [Step 4/5] [2021-11-19 21:11:03,505][INFO ][exchange-worker-#22262%grid-1%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], crd=false, evt=NODE_JOINED, evtNode=2d18d8d9-5d37-4dd6-9bf0-5422dda2a08c, customEvt=null, allowMerge=true, exchangeFreeSwitch=false] [21:11:03] : [Step 4/5] [2021-11-19 21:11:03,505][INFO ][exchange-worker-#22139%grid-0%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], err=null, rebalanced=true, wasRebalanced=true] [21:11:03] : [Step 4/5] [2021-11-19 21:11:03,506][INFO ][exchange-worker-#22262%grid-1%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], err=null, rebalanced=true, wasRebalanced=true] [21:11:03] : [Step 4/5] [2021-11-19 21:11:03,506][INFO ][tcp-client-disco-msg-worker-#1177%client%-#22372%client%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustEnabled' was changed from 'null' to 'false' [21:11:03] : [Step 4/5] [2021-11-19 21:11:03,508][INFO ][exchange-worker-#22262%grid-1%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=104175b5-80ef-4f12-adf3-882ed73df001, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], evt=NODE_JOINED, evtNode=TcpDiscoveryNode [id=2d18d8d9-5d37-4dd6-9bf0-5422dda2a08c, consistentId=client, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:0], discPort=0, order=3, intOrder=3, lastExchangeTime=1637345463490, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=true], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0]] [21:11:03] : [Step 4/5] [2021-11-19 21:11:03,510][INFO ][exchange-worker-#22262%grid-1%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (1 ms), stage="Determine exchange type" (0 ms), stage="Exchange done" (3 ms), stage="Total time" (4 ms)] [21:11:03] : [Step 4/5] [2021-11-19 21:11:03,508][INFO ][exchange-worker-#22139%grid-0%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=007663dd-64dd-4ed1-b5f4-5f2426572000, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], evt=NODE_JOINED, evtNode=TcpDiscoveryNode [id=2d18d8d9-5d37-4dd6-9bf0-5422dda2a08c, consistentId=client, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:0], discPort=0, order=3, intOrder=3, lastExchangeTime=1637345463480, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=true], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0]] [21:11:03] : [Step 4/5] [2021-11-19 21:11:03,511][INFO ][exchange-worker-#22262%grid-1%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=0]] [21:11:03] : [Step 4/5] [2021-11-19 21:11:03,513][INFO ][exchange-worker-#22262%grid-1%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], crd=false] [21:11:03] : [Step 4/5] [2021-11-19 21:11:03,509][INFO ][tcp-client-disco-msg-worker-#1177%client%-#22372%client%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustTimeout' was changed from 'null' to '300000' [21:11:03] : [Step 4/5] [2021-11-19 21:11:03,513][INFO ][exchange-worker-#22262%grid-1%][GridCachePartitionExchangeManager] AffinityTopologyVersion [topVer=3, minorTopVer=0], evt=NODE_JOINED, evtNode=2d18d8d9-5d37-4dd6-9bf0-5422dda2a08c, client=false] [21:11:03] : [Step 4/5] [2021-11-19 21:11:03,512][INFO ][exchange-worker-#22139%grid-0%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (1 ms), stage="Determine exchange type" (0 ms), stage="Exchange done" (6 ms), stage="Total time" (7 ms)] [21:11:03] : [Step 4/5] [2021-11-19 21:11:03,513][INFO ][tcp-client-disco-msg-worker-#1177%client%-#22372%client%][IgniteTxManager] Transactions parameter 'collisionsDumpInterval' was changed from 'null' to '1000' [21:11:03] : [Step 4/5] [2021-11-19 21:11:03,515][INFO ][exchange-worker-#22139%grid-0%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=0]] [21:11:03] : [Step 4/5] [2021-11-19 21:11:03,515][INFO ][exchange-worker-#22139%grid-0%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], crd=true] [21:11:03] : [Step 4/5] [2021-11-19 21:11:03,515][INFO ][tcp-client-disco-msg-worker-#1177%client%-#22372%client%][IgniteTxManager] Transactions parameter 'longOperationsDumpTimeout' was changed from 'null' to '60000' [21:11:03] : [Step 4/5] [2021-11-19 21:11:03,516][INFO ][exchange-worker-#22139%grid-0%][GridCachePartitionExchangeManager] AffinityTopologyVersion [topVer=3, minorTopVer=0], evt=NODE_JOINED, evtNode=2d18d8d9-5d37-4dd6-9bf0-5422dda2a08c, client=false] [21:11:03] : [Step 4/5] [2021-11-19 21:11:03,516][INFO ][tcp-client-disco-msg-worker-#1177%client%-#22372%client%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpSamplesPerSecondLimit' was changed from 'null' to '5' [21:11:03] : [Step 4/5] [2021-11-19 21:11:03,517][INFO ][tcp-client-disco-msg-worker-#1177%client%-#22372%client%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpThreshold' was changed from 'null' to '0' [21:11:03] : [Step 4/5] [2021-11-19 21:11:03,517][INFO ][tcp-client-disco-msg-worker-#1177%client%-#22372%client%][IgniteTxManager] Transactions parameter 'transactionTimeDumpSamplesCoefficient' was changed from 'null' to '0.0' [21:11:03] : [Step 4/5] [2021-11-19 21:11:03,518][INFO ][tcp-client-disco-msg-worker-#1177%client%-#22372%client%][IgniteTxManager] Transactions parameter 'txOwnerDumpRequestsAllowed' was changed from 'null' to 'true' [21:11:03] : [Step 4/5] [2021-11-19 21:11:03,518][INFO ][tcp-client-disco-msg-worker-#1177%client%-#22372%client%][ClusterProcessor] affectionate_joliot [21:11:03] : [Step 4/5] [2021-11-19 21:11:03,519][INFO ][disco-notifier-worker-#22369%client%][MvccProcessorImpl] Assigned mvcc coordinator [crd=MvccCoordinator [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], nodeId=007663dd-64dd-4ed1-b5f4-5f2426572000, ver=1637345462407, local=false, initialized=false]] [21:11:03] : [Step 4/5] [2021-11-19 21:11:03,521][INFO ][sys-#22376%client%][ClusterProcessor] Writing cluster ID and tag to metastorage on ready for write ClusterIdAndTag [id=3c6dd018-e9fc-4e74-96a2-0d6bc471c93b, tag=affectionate_joliot] [21:11:03] : [Step 4/5] [2021-11-19 21:11:03,534][INFO ][exchange-worker-#22378%client%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], crd=false, evt=NODE_JOINED, evtNode=2d18d8d9-5d37-4dd6-9bf0-5422dda2a08c, customEvt=null, allowMerge=true, exchangeFreeSwitch=false] [21:11:03] : [Step 4/5] [2021-11-19 21:11:03,535][INFO ][exchange-worker-#22378%client%][IgniteCacheDatabaseSharedManager] Data Regions Started: 4 [21:11:03] : [Step 4/5] [2021-11-19 21:11:03,536][INFO ][exchange-worker-#22378%client%][IgniteCacheDatabaseSharedManager] ^-- sysMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:11:03] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB, allocTotal=0MB] [21:11:03] : [Step 4/5] ^-- default region [type=default, persistence=true, lazyAlloc=true, [21:11:03] : [Step 4/5] ... initCfg=100MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB, allocTotal=0MB] [21:11:03] : [Step 4/5] ^-- TxLog region [type=internal, persistence=true, lazyAlloc=false, [21:11:03] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB, allocTotal=0MB] [21:11:03] : [Step 4/5] ^-- volatileDsMemPlc region [type=user, persistence=false, lazyAlloc=true, [21:11:03] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB] [21:11:03] : [Step 4/5] ^-- Ignite persistence [used=0MB] [21:11:03] : [Step 4/5] [21:11:03] : [Step 4/5] [2021-11-19 21:11:03,537][INFO ][exchange-worker-#22378%client%][msg] Components activation performed in 2 ms. [21:11:03] : [Step 4/5] [2021-11-19 21:11:03,538][INFO ][exchange-worker-#22378%client%][GridCacheProcessor] Started cache [name=ignite-sys-cache, id=-2100569601, dataRegionName=sysMemPlc, mode=REPLICATED, atomicity=TRANSACTIONAL, backups=2147483647, mvcc=false] [21:11:03] : [Step 4/5] [2021-11-19 21:11:03,538][INFO ][exchange-worker-#22378%client%][GridCacheProcessor] Starting caches on local join performed in 0 ms. [21:11:03] : [Step 4/5] [2021-11-19 21:11:03,541][INFO ][grid-nio-worker-tcp-comm-1-#22078%TestRecordingCommunicationSpi%][TestRecordingCommunicationSpi] Accepted incoming communication connection [locAddr=/127.0.0.1:47100, rmtAddr=/127.0.0.1:33466] [21:11:03] : [Step 4/5] [2021-11-19 21:11:03,542][INFO ][grid-nio-worker-tcp-comm-0-#22340%TestRecordingCommunicationSpi%][TestRecordingCommunicationSpi] Established outgoing communication connection [locAddr=/127.0.0.1:33466, rmtAddr=/127.0.0.1:47100] [21:11:03] : [Step 4/5] [2021-11-19 21:11:03,543][INFO ][exchange-worker-#22378%client%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], crd=false] [21:11:03] : [Step 4/5] [2021-11-19 21:11:03,547][INFO ][sys-#22127%grid-0%][GridCachePartitionExchangeManager] Fast replied to single message [exchId=GridDhtPartitionExchangeId [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], discoEvt=null, nodeId=2d18d8d9, evt=NODE_JOINED], nodeId=2d18d8d9-5d37-4dd6-9bf0-5422dda2a08c] [21:11:03] : [Step 4/5] [2021-11-19 21:11:03,549][INFO ][sys-#22382%client%][GridDhtPartitionsExchangeFuture] Received full message, will finish exchange [node=007663dd-64dd-4ed1-b5f4-5f2426572000, resVer=AffinityTopologyVersion [topVer=3, minorTopVer=0]] [21:11:03] : [Step 4/5] [2021-11-19 21:11:03,550][INFO ][sys-#22382%client%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], err=null, rebalanced=true, wasRebalanced=false] [21:11:03] : [Step 4/5] [2021-11-19 21:11:03,551][INFO ][sys-#22382%client%][GridCacheProcessor] Finish proxy initialization, cacheName=ignite-sys-cache, localNodeId=2d18d8d9-5d37-4dd6-9bf0-5422dda2a08c [21:11:03] : [Step 4/5] [2021-11-19 21:11:03,551][INFO ][sys-#22382%client%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=2d18d8d9-5d37-4dd6-9bf0-5422dda2a08c, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], evt=NODE_JOINED, evtNode=TcpDiscoveryNode [id=2d18d8d9-5d37-4dd6-9bf0-5422dda2a08c, consistentId=client, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:0], discPort=0, order=3, intOrder=0, lastExchangeTime=1637345463480, loc=true, ver=2.13.0#20211119-sha1:00000000, isClient=true], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0]] [21:11:03] : [Step 4/5] [2021-11-19 21:11:03,552][INFO ][sys-#22382%client%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], stage="Waiting in exchange queue" (14 ms), stage="Exchange parameters initialization" (0 ms), stage="Components activation" (2 ms), stage="Determine exchange type" (2 ms), stage="Waiting for Full message" (8 ms), stage="Affinity recalculation" (0 ms), stage="Full map updating" (0 ms), stage="Exchange done" (1 ms), stage="Total time" (27 ms)] [21:11:03] : [Step 4/5] [2021-11-19 21:11:03,551][INFO ][exchange-worker-#22378%client%][GridCachePartitionExchangeManager] AffinityTopologyVersion [topVer=3, minorTopVer=0], evt=NODE_JOINED, evtNode=2d18d8d9-5d37-4dd6-9bf0-5422dda2a08c, client=true] [21:11:03] : [Step 4/5] [2021-11-19 21:11:03,553][INFO ][sys-#22382%client%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], stage="Affinity initialization (local join) [grp=ignite-sys-cache]" (0 ms) (parent=Affinity recalculation), stage="Affinity initialization (local join) [grp=encrypted]" (0 ms) (parent=Affinity recalculation)] [21:11:03] : [Step 4/5] [2021-11-19 21:11:03,553][INFO ][test-runner-#22022%encryption.CacheGroupKeyChangeTest%][IgniteKernal%client] To start Console Management & Monitoring run ignitevisorcmd.{sh|bat} [21:11:03] : [Step 4/5] [2021-11-19 21:11:03,554][INFO ][test-runner-#22022%encryption.CacheGroupKeyChangeTest%][IgniteKernal%client] [21:11:03] : [Step 4/5] [21:11:03] : [Step 4/5] >>> +-------------------------------------------+ [21:11:03] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:11:03] : [Step 4/5] >>> +-------------------------------------------+ [21:11:03] : [Step 4/5] >>> OS name: Linux 4.15.0-151-generic amd64 [21:11:03] : [Step 4/5] >>> CPU(s): 24 [21:11:03] : [Step 4/5] >>> Heap: 2.0GB [21:11:03] : [Step 4/5] >>> VM name: 16724@c4dfe9a430b2 [21:11:03] : [Step 4/5] >>> Ignite instance name: client [21:11:03] : [Step 4/5] >>> Local node [ID=2D18D8D9-5D37-4DD6-9BF0-5422DDA2A08C, order=3, clientMode=true] [21:11:03] : [Step 4/5] >>> Local node addresses: [127.0.0.1] [21:11:03] : [Step 4/5] >>> Local ports: TCP:10802 TCP:47102 [21:11:03] : [Step 4/5] [21:11:03] : [Step 4/5] [2021-11-19 21:11:03,555][INFO ][test-runner-#22022%encryption.CacheGroupKeyChangeTest%][GridDiscoveryManager] Topology snapshot [ver=3, locNode=2d18d8d9, servers=2, clients=1, state=ACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=2d18d8d9-5d37-4dd6-9bf0-5422dda2a08c, consistentId=client, isClient=true, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=007663dd-64dd-4ed1-b5f4-5f2426572000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=104175b5-80ef-4f12-adf3-882ed73df001, consistentId=grid-1, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:11:03] : [Step 4/5] [2021-11-19 21:11:03,556][INFO ][test-runner-#22022%encryption.CacheGroupKeyChangeTest%][GridDiscoveryManager] ^-- Baseline [id=0, size=2, online=2, offline=0] [21:11:03] : [Step 4/5] [2021-11-19 21:11:03,556][INFO ][test-runner-#22022%encryption.CacheGroupKeyChangeTest%][G] Node started : [stage="Configure system pool" (0 ms),stage="Start managers" (217 ms),stage="Configure binary metadata" (1 ms),stage="Start processors" (7 ms),stage="Start 'StanByClusterTestProvider' plugin" (0 ms),stage="Start 'PageMemory tracker plugin' plugin" (0 ms),stage="Start 'TestDistibutedConfigurationPlugin' plugin" (0 ms),stage="Start 'NodeValidationPluginProvider' plugin" (0 ms),stage="Init metastore" (1 ms),stage="Finish recovery" (0 ms),stage="Join topology" (41 ms),stage="Await transition" (1 ms),stage="Await exchange" (32 ms),stage="Total time" (300 ms)] [21:11:03] : [Step 4/5] [2021-11-19 21:11:03,557][INFO ][test-runner-#22022%encryption.CacheGroupKeyChangeTest%][root] Node started with the following configuration [id=2d18d8d9-5d37-4dd6-9bf0-5422dda2a08c, marshaller=BinaryMarshaller [], discovery=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=5000, ackTimeout=5000, marsh=JdkMarshaller [clsFilter=org.apache.ignite.marshaller.MarshallerUtils$1@2659f978], reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], binaryCfg=null, lateAff=true] [21:11:03] : [Step 4/5] [2021-11-19 21:11:03,558][INFO ][test-runner-#22022%encryption.CacheGroupKeyChangeTest%][IgniteTestResources] Send blocked message [node=007663dd-64dd-4ed1-b5f4-5f2426572000, order=1, msg=org.apache.ignite.internal.util.distributed.SingleNodeMessage@6b8c98f8] [21:11:03]W: [org.apache.ignite:ignite-core] [2021-11-19 21:11:03,560][WARN ][disco-notifier-worker-#22369%client%][DistributedProcess] Received the finish distributed process message for an uninitialized process (possible cause is message's double delivering) [msg=FullMessage [id=fe88d593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, processId=176b2c60-7a6a-4dd9-b416-be6070bbf703, type=5]] [21:11:03] : [Step 4/5] [2021-11-19 21:11:03,561][INFO ][disco-notifier-worker-#22134%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=1] [21:11:03] : [Step 4/5] [2021-11-19 21:11:03,561][INFO ][disco-notifier-worker-#22253%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=1] [21:11:03] : [Step 4/5] [2021-11-19 21:11:03,562][INFO ][reencrypt-#22393%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:11:03] : [Step 4/5] [2021-11-19 21:11:03,562][INFO ][reencrypt-#22394%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:11:03] : [Step 4/5] [2021-11-19 21:11:03,566][INFO ][exchange-worker-#22378%client%][GridCacheProcessor] Started cache [name=encrypted, id=1613773252, dataRegionName=default, mode=PARTITIONED, atomicity=ATOMIC, backups=0, mvcc=false] [21:11:03] : [Step 4/5] [2021-11-19 21:11:03,568][INFO ][exchange-worker-#22378%client%][GridCacheProcessor] Finish proxy initialization, cacheName=encrypted, localNodeId=2d18d8d9-5d37-4dd6-9bf0-5422dda2a08c [21:11:03] : [Step 4/5] [2021-11-19 21:11:03,611][INFO ][test-runner-#22022%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=104175b5-80ef-4f12-adf3-882ed73df001, grp=1613773252] [21:11:03] : [Step 4/5] [2021-11-19 21:11:03,686][INFO ][db-checkpoint-thread-#22273%grid-0%][Checkpointer] Checkpoint started [checkpointId=ae030e9f-45a5-451f-bbbf-a119dfbcdbdd, startPtr=WALPointer [idx=0, fileOff=86681, len=1963], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=316ms, writeCheckpointEntryDuration=512ms, splitAndSortCpPagesDuration=0ms, pages=18, reason='node started'] [21:11:03] : [Step 4/5] [2021-11-19 21:11:03,686][INFO ][db-checkpoint-thread-#22278%grid-1%][Checkpointer] Checkpoint started [checkpointId=ce461adf-ffb6-4889-b294-16e60dd69736, startPtr=WALPointer [idx=0, fileOff=86681, len=1963], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=313ms, writeCheckpointEntryDuration=513ms, splitAndSortCpPagesDuration=0ms, pages=18, reason='node started'] [21:11:03] : [Step 4/5] [2021-11-19 21:11:03,781][INFO ][db-checkpoint-thread-#22278%grid-1%][Checkpointer] Checkpoint finished [cpId=ce461adf-ffb6-4889-b294-16e60dd69736, pages=18, markPos=WALPointer [idx=0, fileOff=86681, len=1963], walSegmentsCovered=[], markDuration=828ms, pagesWrite=0ms, fsync=93ms, total=922ms] [21:11:03] : [Step 4/5] [2021-11-19 21:11:03,781][INFO ][db-checkpoint-thread-#22273%grid-0%][Checkpointer] Checkpoint finished [cpId=ae030e9f-45a5-451f-bbbf-a119dfbcdbdd, pages=18, markPos=WALPointer [idx=0, fileOff=86681, len=1963], walSegmentsCovered=[], markDuration=830ms, pagesWrite=1ms, fsync=93ms, total=925ms] [21:11:03] : [Step 4/5] [2021-11-19 21:11:03,827][INFO ][db-checkpoint-thread-#22278%grid-1%][Checkpointer] Checkpoint started [checkpointId=33f7b30a-8cbe-4fc4-af66-9b85d2008dd3, startPtr=WALPointer [idx=0, fileOff=186509, len=2048], checkpointBeforeLockTime=3ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=21ms, writeCheckpointEntryDuration=22ms, splitAndSortCpPagesDuration=0ms, pages=62, reason='test'] [21:11:03] : [Step 4/5] [2021-11-19 21:11:03,896][INFO ][db-checkpoint-thread-#22278%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:11:03] : [Step 4/5] [2021-11-19 21:11:03,896][INFO ][db-checkpoint-thread-#22278%grid-1%][Checkpointer] Checkpoint finished [cpId=33f7b30a-8cbe-4fc4-af66-9b85d2008dd3, pages=62, markPos=WALPointer [idx=0, fileOff=186509, len=2048], walSegmentsCovered=[], markDuration=44ms, pagesWrite=3ms, fsync=65ms, total=115ms] [21:11:03] : [Step 4/5] [2021-11-19 21:11:03,897][INFO ][test-runner-#22022%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=007663dd-64dd-4ed1-b5f4-5f2426572000, grp=1613773252] [21:11:03] : [Step 4/5] [2021-11-19 21:11:03,904][INFO ][db-checkpoint-thread-#22273%grid-0%][Checkpointer] Checkpoint started [checkpointId=71f5189a-cc37-4ce8-b700-05b349faf71b, startPtr=WALPointer [idx=0, fileOff=158489, len=2010], checkpointBeforeLockTime=2ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=1ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=3ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=0ms, pages=42, reason='test'] [21:11:04] : [Step 4/5] [2021-11-19 21:11:04,495][INFO ][db-checkpoint-thread-#22273%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:11:04] : [Step 4/5] [2021-11-19 21:11:04,496][INFO ][db-checkpoint-thread-#22273%grid-0%][Checkpointer] Checkpoint finished [cpId=71f5189a-cc37-4ce8-b700-05b349faf71b, pages=42, markPos=WALPointer [idx=0, fileOff=158489, len=2010], walSegmentsCovered=[], markDuration=6ms, pagesWrite=2ms, fsync=588ms, total=598ms] [21:11:04] : [Step 4/5] [21:11:04] >>> Stopping test: CacheGroupKeyChangeTest#testClientJoinDuringRotation in 2504 ms <<< [21:11:04] : [Step 4/5] [2021-11-19 21:11:04,497][INFO ][main][root] >>> Stopping test: CacheGroupKeyChangeTest#testClientJoinDuringRotation in 2504 ms <<< [21:11:04] : [Step 4/5] [21:11:04] >>> Heap: 367 MB used / 1938 MB commited / 1938 MB max <<< [21:11:04] : [Step 4/5] [2021-11-19 21:11:04,497][INFO ][main][root] >>> Heap: 367 MB used / 1938 MB commited / 1938 MB max <<< [21:11:04] : [Step 4/5] [21:11:04] >>> Non-Heap: 161 MB used / 184 MB commited / 0 MB max <<< [21:11:04] : [Step 4/5] [2021-11-19 21:11:04,498][INFO ][main][root] >>> Non-Heap: 161 MB used / 184 MB commited / 0 MB max <<< [21:11:04] : [Step 4/5] [2021-11-19 21:11:04,498][INFO ][main][root] >>> Stopping grid [name=client, id=2d18d8d9-5d37-4dd6-9bf0-5422dda2a08c] [21:11:04] : [Step 4/5] [2021-11-19 21:11:04,509][INFO ][disco-event-worker-#22138%grid-0%][GridDiscoveryManager] Node left topology: TcpDiscoveryNode [id=2d18d8d9-5d37-4dd6-9bf0-5422dda2a08c, consistentId=client, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:0], discPort=0, order=3, intOrder=3, lastExchangeTime=1637345463480, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=true] [21:11:04] : [Step 4/5] [2021-11-19 21:11:04,514][INFO ][main][GridCacheProcessor] Stopped cache [cacheName=ignite-sys-cache] [21:11:04] : [Step 4/5] [2021-11-19 21:11:04,510][INFO ][tcp-disco-sock-reader-[2d18d8d9 127.0.0.1:49941 client]-#1178%grid-0%-#22374%grid-0%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:49941, rmtPort=49941, rmtNodeId=2d18d8d9-5d37-4dd6-9bf0-5422dda2a08c] [21:11:04] : [Step 4/5] [2021-11-19 21:11:04,510][INFO ][disco-event-worker-#22261%grid-1%][GridDiscoveryManager] Node left topology: TcpDiscoveryNode [id=2d18d8d9-5d37-4dd6-9bf0-5422dda2a08c, consistentId=client, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:0], discPort=0, order=3, intOrder=3, lastExchangeTime=1637345463490, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=true] [21:11:04] : [Step 4/5] [2021-11-19 21:11:04,514][INFO ][disco-event-worker-#22138%grid-0%][GridDiscoveryManager] Topology snapshot [ver=4, locNode=007663dd, servers=2, clients=0, state=ACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=007663dd-64dd-4ed1-b5f4-5f2426572000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=104175b5-80ef-4f12-adf3-882ed73df001, consistentId=grid-1, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:11:04] : [Step 4/5] [2021-11-19 21:11:04,515][INFO ][main][GridCacheProcessor] Stopped cache [cacheName=encrypted] [21:11:04] : [Step 4/5] [2021-11-19 21:11:04,517][INFO ][disco-event-worker-#22138%grid-0%][GridDiscoveryManager] ^-- Baseline [id=0, size=2, online=2, offline=0] [21:11:04] : [Step 4/5] [2021-11-19 21:11:04,516][INFO ][disco-event-worker-#22261%grid-1%][GridDiscoveryManager] Topology snapshot [ver=4, locNode=104175b5, servers=2, clients=0, state=ACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=007663dd-64dd-4ed1-b5f4-5f2426572000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=104175b5-80ef-4f12-adf3-882ed73df001, consistentId=grid-1, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:11:04] : [Step 4/5] [2021-11-19 21:11:04,526][INFO ][main][GridDeploymentLocalStore] Removed undeployed class: GridDeployment [ts=1637345463540, depMode=SHARED, clsLdr=IsolatedClassLoader{roleName='test'}, clsLdrId=ce88d593d71-2d18d8d9-5d37-4dd6-9bf0-5422dda2a08c, userVer=0, loc=true, sampleClsName=org.apache.ignite.internal.processors.cache.distributed.dht.preloader.GridDhtPartitionFullMap, pendingUndeploy=false, undeployed=true, usage=0] [21:11:04]W: [org.apache.ignite:ignite-core] [2021-11-19 21:11:04,517][WARN ][grid-nio-worker-tcp-comm-1-#22078%TestRecordingCommunicationSpi%][TestRecordingCommunicationSpi] Failed to shutdown socket [21:11:04]W: [org.apache.ignite:ignite-core] java.nio.channels.ClosedChannelException [21:11:04]W: [org.apache.ignite:ignite-core] at sun.nio.ch.SocketChannelImpl.shutdownOutput(SocketChannelImpl.java:795) [21:11:04]W: [org.apache.ignite:ignite-core] at sun.nio.ch.SocketAdaptor.shutdownOutput(SocketAdaptor.java:407) [21:11:04]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.close(IgniteUtils.java:4247) [21:11:04]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.closeKey(GridNioServer.java:2784) [21:11:04]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.close(GridNioServer.java:2835) [21:11:04]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.close(GridNioServer.java:2794) [21:11:04]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.bodyInternal(GridNioServer.java:2157) [21:11:04]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.body(GridNioServer.java:1910) [21:11:04]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:125) [21:11:04]W: [org.apache.ignite:ignite-core] at java.lang.Thread.run(Thread.java:748) [21:11:04] : [Step 4/5] [2021-11-19 21:11:04,526][INFO ][exchange-worker-#22139%grid-0%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], crd=true, evt=NODE_LEFT, evtNode=2d18d8d9-5d37-4dd6-9bf0-5422dda2a08c, customEvt=null, allowMerge=true, exchangeFreeSwitch=false] [21:11:04] : [Step 4/5] [2021-11-19 21:11:04,526][INFO ][disco-event-worker-#22261%grid-1%][GridDiscoveryManager] ^-- Baseline [id=0, size=2, online=2, offline=0] [21:11:04] : [Step 4/5] [2021-11-19 21:11:04,531][INFO ][exchange-worker-#22139%grid-0%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], err=null, rebalanced=true, wasRebalanced=true] [21:11:04] : [Step 4/5] [2021-11-19 21:11:04,532][INFO ][exchange-worker-#22139%grid-0%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=007663dd-64dd-4ed1-b5f4-5f2426572000, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], evt=NODE_LEFT, evtNode=TcpDiscoveryNode [id=2d18d8d9-5d37-4dd6-9bf0-5422dda2a08c, consistentId=client, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:0], discPort=0, order=3, intOrder=3, lastExchangeTime=1637345463480, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=true], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0]] [21:11:04] : [Step 4/5] [2021-11-19 21:11:04,534][INFO ][exchange-worker-#22262%grid-1%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], crd=false, evt=NODE_LEFT, evtNode=2d18d8d9-5d37-4dd6-9bf0-5422dda2a08c, customEvt=null, allowMerge=true, exchangeFreeSwitch=false] [21:11:04] : [Step 4/5] [2021-11-19 21:11:04,534][INFO ][exchange-worker-#22139%grid-0%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (4 ms), stage="Determine exchange type" (0 ms), stage="Exchange done" (3 ms), stage="Total time" (7 ms)] [21:11:04] : [Step 4/5] [2021-11-19 21:11:04,535][INFO ][exchange-worker-#22262%grid-1%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], err=null, rebalanced=true, wasRebalanced=true] [21:11:04] : [Step 4/5] [2021-11-19 21:11:04,536][INFO ][exchange-worker-#22139%grid-0%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=0]] [21:11:04] : [Step 4/5] [2021-11-19 21:11:04,537][INFO ][exchange-worker-#22262%grid-1%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=104175b5-80ef-4f12-adf3-882ed73df001, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], evt=NODE_LEFT, evtNode=TcpDiscoveryNode [id=2d18d8d9-5d37-4dd6-9bf0-5422dda2a08c, consistentId=client, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:0], discPort=0, order=3, intOrder=3, lastExchangeTime=1637345463490, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=true], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0]] [21:11:04] : [Step 4/5] [2021-11-19 21:11:04,537][INFO ][exchange-worker-#22139%grid-0%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], crd=true] [21:11:04] : [Step 4/5] [2021-11-19 21:11:04,539][INFO ][exchange-worker-#22262%grid-1%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (1 ms), stage="Determine exchange type" (0 ms), stage="Exchange done" (3 ms), stage="Total time" (4 ms)] [21:11:04] : [Step 4/5] [2021-11-19 21:11:04,541][INFO ][exchange-worker-#22139%grid-0%][GridCachePartitionExchangeManager] AffinityTopologyVersion [topVer=4, minorTopVer=0], evt=NODE_LEFT, evtNode=2d18d8d9-5d37-4dd6-9bf0-5422dda2a08c, client=false] [21:11:04] : [Step 4/5] [2021-11-19 21:11:04,541][INFO ][exchange-worker-#22262%grid-1%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=0]] [21:11:04] : [Step 4/5] [2021-11-19 21:11:04,542][INFO ][exchange-worker-#22262%grid-1%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], crd=false] [21:11:04] : [Step 4/5] [2021-11-19 21:11:04,543][INFO ][exchange-worker-#22262%grid-1%][GridCachePartitionExchangeManager] AffinityTopologyVersion [topVer=4, minorTopVer=0], evt=NODE_LEFT, evtNode=2d18d8d9-5d37-4dd6-9bf0-5422dda2a08c, client=false] [21:11:04] : [Step 4/5] [2021-11-19 21:11:04,544][INFO ][main][IgniteKernal%client] [21:11:04] : [Step 4/5] [21:11:04] : [Step 4/5] >>> +------------------------------------------------------+ [21:11:04] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV stopped OK [21:11:04] : [Step 4/5] >>> +------------------------------------------------------+ [21:11:04] : [Step 4/5] >>> Ignite instance name: client [21:11:04] : [Step 4/5] >>> Grid uptime: 00:00:00.984 [21:11:04] : [Step 4/5] [21:11:04] : [Step 4/5] [21:11:04] : [Step 4/5] [2021-11-19 21:11:04,545][INFO ][main][root] >>> Stopping grid [name=grid-1, id=104175b5-80ef-4f12-adf3-882ed73df001] [21:11:04] : [Step 4/5] [2021-11-19 21:11:04,553][INFO ][db-checkpoint-thread-#22278%grid-1%][Checkpointer] Skipping checkpoint (no pages were modified) [checkpointBeforeLockTime=0ms, checkpointLockWait=1ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=1ms, reason='timeout'] [21:11:04] : [Step 4/5] [2021-11-19 21:11:04,560][INFO ][tcp-disco-sock-reader-[007663dd 127.0.0.1:33771]-#1170%grid-1%-#22258%grid-1%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:33771, rmtPort=33771, rmtNodeId=007663dd-64dd-4ed1-b5f4-5f2426572000] [21:11:04] : [Step 4/5] [2021-11-19 21:11:04,563][INFO ][main][GridCacheProcessor] Stopped cache [cacheName=ignite-sys-cache] [21:11:04] : [Step 4/5] [2021-11-19 21:11:04,564][INFO ][main][GridCacheProcessor] Stopped cache [cacheName=encrypted] [21:11:04] : [Step 4/5] [2021-11-19 21:11:04,566][INFO ][disco-event-worker-#22138%grid-0%][GridDiscoveryManager] Node left topology: TcpDiscoveryNode [id=104175b5-80ef-4f12-adf3-882ed73df001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637345462746, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false] [21:11:04] : [Step 4/5] [2021-11-19 21:11:04,567][INFO ][disco-event-worker-#22138%grid-0%][GridDiscoveryManager] Topology snapshot [ver=5, locNode=007663dd, servers=1, clients=0, state=ACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=007663dd-64dd-4ed1-b5f4-5f2426572000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:11:04] : [Step 4/5] [2021-11-19 21:11:04,567][INFO ][disco-event-worker-#22138%grid-0%][GridDiscoveryManager] ^-- Baseline [id=0, size=2, online=1, offline=1] [21:11:04] : [Step 4/5] [2021-11-19 21:11:04,568][INFO ][main][FilePageStoreManager] Cleanup cache stores [total=4, left=0, cleanFiles=false] [21:11:04] : [Step 4/5] [2021-11-19 21:11:04,570][INFO ][exchange-worker-#22139%grid-0%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], crd=true, evt=NODE_LEFT, evtNode=104175b5-80ef-4f12-adf3-882ed73df001, customEvt=null, allowMerge=false, exchangeFreeSwitch=true] [21:11:04] : [Step 4/5] [2021-11-19 21:11:04,570][INFO ][main][GridDeploymentLocalStore] Removed undeployed class: GridDeployment [ts=1637345462872, depMode=SHARED, clsLdr=IsolatedClassLoader{roleName='test'}, clsLdrId=5c78d593d71-104175b5-80ef-4f12-adf3-882ed73df001, userVer=0, loc=true, sampleClsName=org.apache.ignite.internal.processors.cache.distributed.dht.preloader.GridDhtPartitionFullMap, pendingUndeploy=false, undeployed=true, usage=0] [21:11:04] : [Step 4/5] [2021-11-19 21:11:04,570][INFO ][exchange-worker-#22139%grid-0%][GridAffinityAssignmentCache] Local node affinity assignment distribution is not ideal [cache=encrypted, expectedPrimary=8.00, actualPrimary=3, expectedBackups=0.00, actualBackups=0, warningThreshold=50.00%] [21:11:04] : [Step 4/5] [2021-11-19 21:11:04,572][INFO ][exchange-worker-#22139%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:11:04] : [Step 4/5] [2021-11-19 21:11:04,573][INFO ][exchange-worker-#22139%grid-0%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], err=null, rebalanced=true, wasRebalanced=true] [21:11:04]W: [org.apache.ignite:ignite-core] [2021-11-19 21:11:04,577][WARN ][sys-#22122%grid-0%][GridDhtPartitionTopologyImpl] Detected lost partitions [grp=encrypted, parts=[0, 2, 4, 6-7], topVer=AffinityTopologyVersion [topVer=5, minorTopVer=0]] [21:11:04] : [Step 4/5] [2021-11-19 21:11:04,577][INFO ][exchange-worker-#22139%grid-0%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=007663dd-64dd-4ed1-b5f4-5f2426572000, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], evt=NODE_LEFT, evtNode=TcpDiscoveryNode [id=104175b5-80ef-4f12-adf3-882ed73df001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637345462746, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=5, minorTopVer=0]] [21:11:04] : [Step 4/5] [2021-11-19 21:11:04,578][INFO ][main][IgniteKernal%grid-1] [21:11:04] : [Step 4/5] [21:11:04] : [Step 4/5] >>> +------------------------------------------------------+ [21:11:04] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV stopped OK [21:11:04] : [Step 4/5] >>> +------------------------------------------------------+ [21:11:04] : [Step 4/5] >>> Ignite instance name: grid-1 [21:11:04] : [Step 4/5] >>> Grid uptime: 00:00:01.779 [21:11:04] : [Step 4/5] [21:11:04] : [Step 4/5] [21:11:04] : [Step 4/5] [2021-11-19 21:11:04,579][INFO ][exchange-worker-#22139%grid-0%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (0 ms), stage="Determine exchange type" (1 ms), stage="Preloading notification" (0 ms), stage="After states restored callback" (0 ms), stage="WAL history reservation" (0 ms), stage="Finalize update counters" (0 ms), stage="Detect lost partitions" (4 ms), stage="Exchange done" (1 ms), stage="Total time" (6 ms)] [21:11:04] : [Step 4/5] [2021-11-19 21:11:04,579][INFO ][main][root] >>> Stopping grid [name=grid-0, id=007663dd-64dd-4ed1-b5f4-5f2426572000] [21:11:04] : [Step 4/5] [2021-11-19 21:11:04,580][INFO ][exchange-worker-#22139%grid-0%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], stage="Affinity initialization (exchange-free switch on fully-rebalanced topology) [grp=encrypted]" (1 ms) (parent=Determine exchange type), stage="Affinity initialization (exchange-free switch on fully-rebalanced topology) [grp=ignite-sys-cache]" (0 ms) (parent=Determine exchange type)] [21:11:04] : [Step 4/5] [2021-11-19 21:11:04,583][INFO ][exchange-worker-#22139%grid-0%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], crd=true] [21:11:04] : [Step 4/5] [2021-11-19 21:11:04,583][INFO ][exchange-worker-#22139%grid-0%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=5, minorTopVer=0], force=false, evt=NODE_LEFT, node=104175b5-80ef-4f12-adf3-882ed73df001] [21:11:04] : [Step 4/5] [2021-11-19 21:11:04,586][INFO ][db-checkpoint-thread-#22273%grid-0%][Checkpointer] Skipping checkpoint (no pages were modified) [checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, reason='timeout'] [21:11:04]W: [org.apache.ignite:ignite-core] [2021-11-19 21:11:04,590][WARN ][tcp-disco-sock-reader-[104175b5 127.0.0.1:40997]-#1171%grid-0%-#22259%grid-0%][TestTcpDiscoverySpi] Failed to shutdown socket [21:11:04]W: [org.apache.ignite:ignite-core] java.net.SocketException: Socket is closed [21:11:04]W: [org.apache.ignite:ignite-core] at java.net.Socket.shutdownOutput(Socket.java:1568) [21:11:04]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.close(IgniteUtils.java:4247) [21:11:04]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.discovery.tcp.ServerImpl$SocketReader.body(ServerImpl.java:7370) [21:11:04]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.IgniteSpiThread.run(IgniteSpiThread.java:58) [21:11:04] : [Step 4/5] [2021-11-19 21:11:04,591][INFO ][tcp-disco-sock-reader-[104175b5 127.0.0.1:40997]-#1171%grid-0%-#22259%grid-0%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:40997, rmtPort=40997, rmtNodeId=104175b5-80ef-4f12-adf3-882ed73df001] [21:11:04] : [Step 4/5] [2021-11-19 21:11:04,592][INFO ][main][GridCacheProcessor] Stopped cache [cacheName=ignite-sys-cache] [21:11:04] : [Step 4/5] [2021-11-19 21:11:04,593][INFO ][main][GridCacheProcessor] Stopped cache [cacheName=encrypted] [21:11:04] : [Step 4/5] [2021-11-19 21:11:04,596][INFO ][main][FilePageStoreManager] Cleanup cache stores [total=4, left=0, cleanFiles=false] [21:11:04] : [Step 4/5] [2021-11-19 21:11:04,598][INFO ][main][GridDeploymentLocalStore] Removed undeployed class: GridDeployment [ts=1637345462862, depMode=SHARED, clsLdr=IsolatedClassLoader{roleName='test'}, clsLdrId=3c78d593d71-007663dd-64dd-4ed1-b5f4-5f2426572000, userVer=0, loc=true, sampleClsName=org.apache.ignite.internal.processors.cache.distributed.dht.preloader.GridDhtPartitionMap, pendingUndeploy=false, undeployed=true, usage=0] [21:11:04] : [Step 4/5] [2021-11-19 21:11:04,604][INFO ][main][IgniteKernal%grid-0] [21:11:04] : [Step 4/5] [21:11:04] : [Step 4/5] >>> +------------------------------------------------------+ [21:11:04] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV stopped OK [21:11:04] : [Step 4/5] >>> +------------------------------------------------------+ [21:11:04] : [Step 4/5] >>> Ignite instance name: grid-0 [21:11:04] : [Step 4/5] >>> Grid uptime: 00:00:02.153 [21:11:04] : [Step 4/5] [21:11:04] : [Step 4/5] [21:11:04] : [Step 4/5] [21:11:04] >>> Starting test: CacheGroupKeyChangeTest#testCacheStartDuringRotation <<< [21:11:04] : [Step 4/5] [2021-11-19 21:11:04,616][INFO ][main][root] >>> Starting test: CacheGroupKeyChangeTest#testCacheStartDuringRotation <<< [21:11:04] : [Step 4/5] [21:11:04] >>> Heap: 373 MB used / 1938 MB commited / 1938 MB max <<< [21:11:04] : [Step 4/5] [2021-11-19 21:11:04,616][INFO ][main][root] >>> Heap: 373 MB used / 1938 MB commited / 1938 MB max <<< [21:11:04] : [Step 4/5] [21:11:04] >>> Non-Heap: 162 MB used / 184 MB commited / 0 MB max <<< [21:11:04] : [Step 4/5] [2021-11-19 21:11:04,616][INFO ][main][root] >>> Non-Heap: 162 MB used / 184 MB commited / 0 MB max <<< [21:11:04]W: [org.apache.ignite:ignite-core] [2021-11-19 21:11:04,622][WARN ][test-runner-#22415%encryption.CacheGroupKeyChangeTest%][G] Ignite work directory is not provided, automatically resolved to: /opt/buildagent/work/7bc1c54bc719b67c/work [21:11:04] : [Step 4/5] [2021-11-19 21:11:04,624][INFO ][test-runner-#22415%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] [21:11:04] : [Step 4/5] [21:11:04] : [Step 4/5] >>> __________ ________________ [21:11:04] : [Step 4/5] >>> / _/ ___/ |/ / _/_ __/ __/ [21:11:04] : [Step 4/5] >>> _/ // (7 7 // / / / / _/ [21:11:04] : [Step 4/5] >>> /___/\___/_/|_/___/ /_/ /___/ [21:11:04] : [Step 4/5] >>> [21:11:04] : [Step 4/5] >>> ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:11:04] : [Step 4/5] >>> 2021 Copyright(C) Apache Software Foundation [21:11:04] : [Step 4/5] >>> [21:11:04] : [Step 4/5] >>> Ignite documentation: http://ignite.apache.org [21:11:04] : [Step 4/5] [21:11:04] : [Step 4/5] [2021-11-19 21:11:04,625][INFO ][test-runner-#22415%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] Config URL: n/a [21:11:04] : [Step 4/5] [2021-11-19 21:11:04,625][INFO ][test-runner-#22415%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] IgniteConfiguration [igniteInstanceName=grid-0, pubPoolSize=24, svcPoolSize=24, callbackPoolSize=24, stripedPoolSize=24, sysPoolSize=24, mgmtPoolSize=4, dataStreamerPoolSize=24, utilityCachePoolSize=24, utilityCacheKeepAliveTime=60000, p2pPoolSize=2, qryPoolSize=24, buildIdxPoolSize=4, igniteHome=/opt/buildagent/work/7bc1c54bc719b67c, igniteWorkDir=/opt/buildagent/work/7bc1c54bc719b67c/work, mbeanSrv=com.sun.jmx.mbeanserver.JmxMBeanServer@6fe85038, nodeId=00cc6e6a-4c24-4160-839c-0647b4274000, marsh=BinaryMarshaller [], marshLocJobs=false, daemon=false, p2pEnabled=true, netTimeout=10000, netCompressionLevel=1, sndRetryDelay=1000, sndRetryCnt=3, metricsHistSize=10000, metricsUpdateFreq=1000, metricsExpTime=9223372036854775807, discoSpi=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=0, ackTimeout=0, marsh=null, reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], segPlc=STOP, segResolveAttempts=2, waitForSegOnStart=true, allResolversPassReq=true, segChkFreq=10000, commSpi=TcpCommunicationSpi [connectGate=org.apache.ignite.spi.communication.tcp.internal.ConnectGateway@3d17a20, ctxInitLatch=java.util.concurrent.CountDownLatch@6fde8c2c[Count = 1], stopping=false, clientPool=null, nioSrvWrapper=null, stateProvider=null], evtSpi=MemoryEventStorageSpi [expireAgeMs=9223372036854775807, expireCnt=10000, filter=null], colSpi=NoopCollisionSpi [], deploySpi=LocalDeploymentSpi [], indexingSpi=org.apache.ignite.spi.indexing.noop.NoopIndexingSpi@4e324e1b, addrRslvr=null, encryptionSpi=org.apache.ignite.spi.encryption.keystore.KeystoreEncryptionSpi@1f7caa9c, tracingSpi=org.apache.ignite.spi.tracing.NoopTracingSpi@31786515, clientMode=false, rebalanceThreadPoolSize=4, rebalanceTimeout=10000, rebalanceBatchesPrefetchCnt=3, rebalanceThrottle=0, rebalanceBatchSize=524288, txCfg=TransactionConfiguration [txSerEnabled=false, dfltIsolation=REPEATABLE_READ, dfltConcurrency=PESSIMISTIC, dfltTxTimeout=0, txTimeoutOnPartitionMapExchange=0, deadlockTimeout=10000, pessimisticTxLogSize=0, pessimisticTxLogLinger=10000, tmLookupClsName=null, txManagerFactory=null, useJtaSync=false], cacheSanityCheckEnabled=true, discoStartupDelay=60000, deployMode=SHARED, p2pMissedCacheSize=100, locHost=127.0.0.1, timeSrvPortBase=31100, timeSrvPortRange=100, failureDetectionTimeout=10000, sysWorkerBlockedTimeout=null, clientFailureDetectionTimeout=10000, metricsLogFreq=0, connectorCfg=null, odbcCfg=null, warmupClos=null, atomicCfg=AtomicConfiguration [seqReserveSize=1000, cacheMode=PARTITIONED, backups=1, aff=null, grpName=null], classLdr=null, sslCtxFactory=null, platformCfg=null, binaryCfg=null, memCfg=null, pstCfg=null, dsCfg=DataStorageConfiguration [sysRegionInitSize=41943040, sysRegionMaxSize=104857600, pageSize=4096, concLvl=0, dfltDataRegConf=DataRegionConfiguration [name=default, maxSize=104857600, initSize=268435456, swapPath=null, pageEvictionMode=DISABLED, pageReplacementMode=CLOCK, evictionThreshold=0.9, emptyPagesPoolSize=100, metricsEnabled=false, metricsSubIntervalCount=5, metricsRateTimeInterval=60000, persistenceEnabled=true, checkpointPageBufSize=0, lazyMemoryAllocation=true, warmUpCfg=null], dataRegions=null, storagePath=null, checkpointFreq=30000, lockWaitTime=10000, checkpointThreads=4, checkpointWriteOrder=SEQUENTIAL, walHistSize=20, maxWalArchiveSize=20971520, walSegments=10, walSegmentSize=1048576, walPath=db/wal, walArchivePath=db/wal/archive, cdcWalPath=db/wal/cdc, cdcEnabled=false, metricsEnabled=false, walMode=LOG_ONLY, walTlbSize=131072, walBuffSize=0, walFlushFreq=2000, walFsyncDelay=1000, walRecordIterBuffSize=67108864, alwaysWriteFullPages=false, fileIOFactory=org.apache.ignite.internal.processors.cache.persistence.file.AsyncFileIOFactory@3d134a58, metricsSubIntervalCnt=5, metricsRateTimeInterval=60000, walAutoArchiveAfterInactivity=-1, walForceArchiveTimeout=-1, writeThrottlingEnabled=false, walCompactionEnabled=false, walCompactionLevel=1, checkpointReadLockTimeout=null, walPageCompression=DISABLED, walPageCompressionLevel=null, dfltWarmUpCfg=null, encCfg=org.apache.ignite.configuration.EncryptionConfiguration@4cc2da9e, defragmentationThreadPoolSize=4, minWalArchiveSize=-1], snapshotPath=snapshots, activeOnStart=true, activeOnStartPropSetFlag=false, autoActivation=true, autoActivationPropSetFlag=false, clusterStateOnStart=null, sqlConnCfg=null, cliConnCfg=ClientConnectorConfiguration [host=null, port=10800, portRange=100, sockSndBufSize=0, sockRcvBufSize=0, tcpNoDelay=true, maxOpenCursorsPerConn=128, threadPoolSize=24, selectorCnt=12, idleTimeout=0, handshakeTimeout=10000, jdbcEnabled=true, odbcEnabled=true, thinCliEnabled=true, sslEnabled=false, useIgniteSslCtxFactory=true, sslClientAuth=false, sslCtxFactory=null, thinCliCfg=ThinClientConfiguration [maxActiveTxPerConn=100, maxActiveComputeTasksPerConn=0]], mvccVacuumThreadCnt=2, mvccVacuumFreq=5000, authEnabled=false, failureHnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]], commFailureRslvr=null, sqlCfg=SqlConfiguration [longQryWarnTimeout=3000, dfltQryTimeout=0, sqlQryHistSize=1000, validationEnabled=false], asyncContinuationExecutor=null] [21:11:04] : [Step 4/5] [2021-11-19 21:11:04,634][INFO ][test-runner-#22415%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] Daemon mode: off [21:11:04] : [Step 4/5] [2021-11-19 21:11:04,634][INFO ][test-runner-#22415%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] OS: Linux 4.15.0-151-generic amd64 [21:11:04] : [Step 4/5] [2021-11-19 21:11:04,634][INFO ][test-runner-#22415%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] OS user: teamcity [21:11:04] : [Step 4/5] [2021-11-19 21:11:04,635][INFO ][test-runner-#22415%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] PID: 16724 [21:11:04] : [Step 4/5] [2021-11-19 21:11:04,635][INFO ][test-runner-#22415%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] Language runtime: Java Platform API Specification ver. 1.8 [21:11:04] : [Step 4/5] [2021-11-19 21:11:04,635][INFO ][test-runner-#22415%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] VM information: Java(TM) SE Runtime Environment 1.8.0_261-b12 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 25.261-b12 [21:11:04] : [Step 4/5] [2021-11-19 21:11:04,636][INFO ][test-runner-#22415%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] VM total memory: 1.9GB [21:11:04] : [Step 4/5] [2021-11-19 21:11:04,636][INFO ][test-runner-#22415%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] Remote Management [restart: off, REST: off, JMX (remote: off)] [21:11:04] : [Step 4/5] [2021-11-19 21:11:04,636][INFO ][test-runner-#22415%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] Logger: GridTestLog4jLogger [quiet=false, config=null] [21:11:04] : [Step 4/5] [2021-11-19 21:11:04,636][INFO ][test-runner-#22415%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] IGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c [21:11:04] : [Step 4/5] [2021-11-19 21:11:04,637][INFO ][test-runner-#22415%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] VM arguments: [-DIGNITE_DUMP_THREADS_ON_FAILURE=false, -DMono=/usr/bin/mono-sgen, -DMono4.0_x64=/usr/lib/mono/4.0, -DMono4.5_x64=/usr/lib/mono/4.5, -DMonoVersion=6.12.0.90, -DSKIP_BUILD=false, -Dagent.home.dir=/opt/buildagent, -Dagent.name=aitc-lin02_03, -Dagent.ownPort=9090, -Dagent.work.dir=/opt/buildagent/work, -Dbuild.number=95, -Dbuild.vcs.number=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.1=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.GitHubApacheIgnite=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dclassworlds.conf=/opt/buildagent/temp/buildTmp/teamcity.m2.conf, -Dcom.jetbrains.maven.watcher.report.file=/opt/buildagent/temp/buildTmp/maven-build-info.xml, -Djava.io.tmpdir=/opt/buildagent/temp/buildTmp, -Dmaven.home=/opt/buildagent/tools/maven3_6, -Dmaven.multiModuleProjectDirectory=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.agent.cpuBenchmark=457, -Dteamcity.agent.dotnet.agent_url=http://localhost:9090/RPC2, -Dteamcity.agent.dotnet.build_id=6278078, -Dteamcity.auth.password=*******, -Dteamcity.auth.userId=TeamCityBuildId=6278078, -Dteamcity.build.changedFiles.file=/opt/buildagent/temp/buildTmp/changedFiles6342607772318147725.txt, -Dteamcity.build.checkoutDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.build.id=6278078, -Dteamcity.build.properties.file=/opt/buildagent/temp/buildTmp/teamcity.build5164517880467851002.properties, -Dteamcity.build.tempDir=/opt/buildagent/temp/buildTmp, -Dteamcity.build.workingDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.buildConfName=Basic 3, -Dteamcity.buildType.id=IgniteTests24Java8_Basic3, -Dteamcity.configuration.properties.file=/opt/buildagent/temp/buildTmp/teamcity.config5591980786735343870.properties, -Dteamcity.maven.userSettings.path=/opt/buildagent/temp/buildTmp/maven_settings_585072866407032347.xml, -Dteamcity.maven.watcher.home=/opt/buildagent/plugins/mavenPlugin/maven-watcher-jdk16, -Dteamcity.projectName=Ignite Tests 2.x (JDK 8/11), -Dteamcity.runner.properties.file=/opt/buildagent/temp/buildTmp/teamcity.runner9098465561618137420.properties, -Dteamcity.tests.recentlyFailedTests.file=/opt/buildagent/temp/buildTmp/testsToRunFirst3891775683130404069.txt, -Dteamcity.version=2021.2 (build 99542), -ea, -Xms2g, -Xmx2g, -XX:+HeapDumpOnOutOfMemoryError, -DIGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_TEST_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_UPDATE_NOTIFIER=false, -DIGNITE_NO_DISCO_ORDER=true, -DIGNITE_PERFORMANCE_SUGGESTIONS_DISABLED=true, -Djava.net.preferIPv4Stack=true, -DTEST_SCALE_FACTOR=1.0, -DIGNITE_TEST_PROP_LOG4J_FILE=log4j-tc-test.xml, -DIGNITE_QUIET=false, -DIGNITE_MARSHAL_BUFFERS_RECHECK=1000, -Dmaven.repo.local=/opt/buildagent/.m2/repository] [21:11:04] : [Step 4/5] [2021-11-19 21:11:04,641][INFO ][test-runner-#22415%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] System cache's DataRegion size is configured to 40 MB. Use DataStorageConfiguration.systemRegionInitialSize property to change the setting. [21:11:04] : [Step 4/5] [2021-11-19 21:11:04,641][INFO ][test-runner-#22415%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] Configured caches [in 'sysMemPlc' dataRegion: ['ignite-sys-cache']] [21:11:04]W: [org.apache.ignite:ignite-core] [2021-11-19 21:11:04,641][WARN ][test-runner-#22415%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] Peer class loading is enabled (disable it in production for performance and deployment consistency reasons) [21:11:04] : [Step 4/5] [2021-11-19 21:11:04,642][INFO ][test-runner-#22415%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] 3-rd party licenses can be found at: /opt/buildagent/work/7bc1c54bc719b67c/libs/licenses [21:11:04] : [Step 4/5] [2021-11-19 21:11:04,645][INFO ][test-runner-#22415%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] Configured plugins: [21:11:04] : [Step 4/5] [2021-11-19 21:11:04,646][INFO ][test-runner-#22415%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- StanByClusterTestProvider 1.0 [21:11:04] : [Step 4/5] [2021-11-19 21:11:04,646][INFO ][test-runner-#22415%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:11:04] : [Step 4/5] [2021-11-19 21:11:04,646][INFO ][test-runner-#22415%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] [21:11:04] : [Step 4/5] [2021-11-19 21:11:04,646][INFO ][test-runner-#22415%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- PageMemory tracker plugin 1.0 [21:11:04] : [Step 4/5] [2021-11-19 21:11:04,646][INFO ][test-runner-#22415%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:11:04] : [Step 4/5] [2021-11-19 21:11:04,646][INFO ][test-runner-#22415%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] [21:11:04] : [Step 4/5] [2021-11-19 21:11:04,647][INFO ][test-runner-#22415%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- TestDistibutedConfigurationPlugin 1.0 [21:11:04] : [Step 4/5] [2021-11-19 21:11:04,647][INFO ][test-runner-#22415%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:11:04] : [Step 4/5] [2021-11-19 21:11:04,647][INFO ][test-runner-#22415%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] [21:11:04] : [Step 4/5] [2021-11-19 21:11:04,647][INFO ][test-runner-#22415%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- NodeValidationPluginProvider 1.0 [21:11:04] : [Step 4/5] [2021-11-19 21:11:04,648][INFO ][test-runner-#22415%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:11:04] : [Step 4/5] [2021-11-19 21:11:04,648][INFO ][test-runner-#22415%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] [21:11:04] : [Step 4/5] [2021-11-19 21:11:04,648][INFO ][test-runner-#22415%encryption.CacheGroupKeyChangeTest%][FailureProcessor] Configured failure handler: [hnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]]] [21:11:04] : [Step 4/5] [2021-11-19 21:11:04,661][INFO ][test-runner-#22415%encryption.CacheGroupKeyChangeTest%][TestRecordingCommunicationSpi] Successfully bound communication NIO server to TCP port [port=47100, locHost=/127.0.0.1, selectorsCnt=12, selectorSpins=0, pairedConn=false] [21:11:04]W: [org.apache.ignite:ignite-core] [2021-11-19 21:11:04,661][WARN ][test-runner-#22415%encryption.CacheGroupKeyChangeTest%][TestRecordingCommunicationSpi] Message queue limit is set to 0 which may lead to potential OOMEs when running cache operations in FULL_ASYNC or PRIMARY_SYNC modes due to message queues growth on sender and receiver sides. [21:11:04] : [Step 4/5] [2021-11-19 21:11:04,666][INFO ][test-runner-#22415%encryption.CacheGroupKeyChangeTest%][GridCollisionManager] Collision resolution is disabled (all jobs will be activated upon arrival). [21:11:04] : [Step 4/5] [2021-11-19 21:11:04,666][INFO ][test-runner-#22415%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] Security status [authentication=off, sandbox=off, tls/ssl=off] [21:11:04] : [Step 4/5] [2021-11-19 21:11:04,722][INFO ][test-runner-#22415%encryption.CacheGroupKeyChangeTest%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:04] : [Step 4/5] [2021-11-19 21:11:04,811][INFO ][test-runner-#22415%encryption.CacheGroupKeyChangeTest%][MaintenanceProcessor] Resolved store directory for node persistent data: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0 [21:11:04] : [Step 4/5] [2021-11-19 21:11:04,814][INFO ][test-runner-#22415%encryption.CacheGroupKeyChangeTest%][CacheObjectBinaryProcessorImpl] Resolved directory for serialized binary metadata: /opt/buildagent/work/7bc1c54bc719b67c/work/db/binary_meta/grid_0 [21:11:04] : [Step 4/5] [2021-11-19 21:11:04,819][INFO ][test-runner-#22415%encryption.CacheGroupKeyChangeTest%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0 [21:11:04] : [Step 4/5] [2021-11-19 21:11:04,820][INFO ][test-runner-#22415%encryption.CacheGroupKeyChangeTest%][FileWriteAheadLogManager] Resolved write ahead log work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0 [21:11:04] : [Step 4/5] [2021-11-19 21:11:04,820][INFO ][test-runner-#22415%encryption.CacheGroupKeyChangeTest%][FileWriteAheadLogManager] Resolved write ahead log archive directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0 [21:11:05] : [Step 4/5] [2021-11-19 21:11:05,214][INFO ][test-runner-#22415%encryption.CacheGroupKeyChangeTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000000.wal [21:11:05] : [Step 4/5] [2021-11-19 21:11:05,214][INFO ][test-runner-#22415%encryption.CacheGroupKeyChangeTest%][FileHandleManagerImpl] Initialized write-ahead log manager [mode=LOG_ONLY] [21:11:05]W: [org.apache.ignite:ignite-core] [2021-11-19 21:11:05,215][WARN ][test-runner-#22415%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] DataRegion maxSize=104.9 MB is smaller than defaultInitialSize=268.4 MB, setting initialSize to 104.9 MB [21:11:05] : [Step 4/5] [2021-11-19 21:11:05,222][INFO ][test-runner-#22415%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Configured data regions initialized successfully [total=5] [21:11:05] : [Step 4/5] [2021-11-19 21:11:05,224][INFO ][test-runner-#22415%encryption.CacheGroupKeyChangeTest%][IgniteSnapshotManager] Resolved snapshot work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/snapshots [21:11:05] : [Step 4/5] [2021-11-19 21:11:05,225][INFO ][test-runner-#22415%encryption.CacheGroupKeyChangeTest%][IgniteSnapshotManager] Resolved temp directory for snapshot creation: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0/snp [21:11:05] : [Step 4/5] [2021-11-19 21:11:05,228][INFO ][test-runner-#22415%encryption.CacheGroupKeyChangeTest%][ClientListenerProcessor] Client connector processor has started on TCP port 10800 [21:11:05] : [Step 4/5] [2021-11-19 21:11:05,234][INFO ][test-runner-#22415%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] Non-loopback local IPs: 172.17.0.4 [21:11:05] : [Step 4/5] [2021-11-19 21:11:05,234][INFO ][test-runner-#22415%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] Enabled local MACs: 0242AC110004 [21:11:05] : [Step 4/5] [2021-11-19 21:11:05,237][INFO ][test-runner-#22415%encryption.CacheGroupKeyChangeTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:11:05] : [Step 4/5] [2021-11-19 21:11:05,238][INFO ][test-runner-#22415%encryption.CacheGroupKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:11:05] : [Step 4/5] [2021-11-19 21:11:05,239][INFO ][test-runner-#22415%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:11:05] : [Step 4/5] [2021-11-19 21:11:05,241][INFO ][test-runner-#22415%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Applying lost metastore updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:11:05] : [Step 4/5] [2021-11-19 21:11:05,242][INFO ][test-runner-#22415%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=0 ms] [21:11:05] : [Step 4/5] [2021-11-19 21:11:05,242][INFO ][test-runner-#22415%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Restoring partition state for local groups. [21:11:05] : [Step 4/5] [2021-11-19 21:11:05,243][INFO ][test-runner-#22415%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=0, partitionsProcessed=0, time=0ms] [21:11:05] : [Step 4/5] [2021-11-19 21:11:05,243][INFO ][test-runner-#22415%encryption.CacheGroupKeyChangeTest%][GridEncryptionManager] Encryption keys loaded from metastore. [grps=, masterKeyName=ignite.master.key] [21:11:05] : [Step 4/5] [2021-11-19 21:11:05,249][INFO ][test-runner-#22415%encryption.CacheGroupKeyChangeTest%][ClusterProcessor] Cluster ID and tag has been read from metastorage: null [21:11:05] : [Step 4/5] [2021-11-19 21:11:05,249][INFO ][test-runner-#22415%encryption.CacheGroupKeyChangeTest%][IgniteClusterImpl] Shutdown policy was updated [oldVal=null, newVal=null] [21:11:05] : [Step 4/5] [2021-11-19 21:11:05,250][INFO ][test-runner-#22415%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Checkpoint frequency deviation changed [oldVal=null, newVal=null] [21:11:05] : [Step 4/5] [2021-11-19 21:11:05,259][INFO ][test-runner-#22415%encryption.CacheGroupKeyChangeTest%][FilePageStoreManager] Cleanup cache stores [total=1, left=0, cleanFiles=false] [21:11:05] : [Step 4/5] [2021-11-19 21:11:05,261][INFO ][test-runner-#22415%encryption.CacheGroupKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:11:05] : [Step 4/5] [2021-11-19 21:11:05,262][INFO ][test-runner-#22415%encryption.CacheGroupKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:11:05] : [Step 4/5] [2021-11-19 21:11:05,263][INFO ][test-runner-#22415%encryption.CacheGroupKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:11:05] : [Step 4/5] [2021-11-19 21:11:05,264][INFO ][test-runner-#22415%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Data Regions Started: 5 [21:11:05] : [Step 4/5] [2021-11-19 21:11:05,264][INFO ][test-runner-#22415%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] ^-- sysMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:11:05] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:11:05] : [Step 4/5] ^-- default region [type=default, persistence=true, lazyAlloc=true, [21:11:05] : [Step 4/5] ... initCfg=100MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB, allocTotal=0MB] [21:11:05] : [Step 4/5] ^-- metastoreMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:11:05] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:11:05] : [Step 4/5] ^-- TxLog region [type=internal, persistence=true, lazyAlloc=false, [21:11:05] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:11:05] : [Step 4/5] ^-- volatileDsMemPlc region [type=user, persistence=false, lazyAlloc=true, [21:11:05] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB] [21:11:05] : [Step 4/5] ^-- Ignite persistence [used=0MB] [21:11:05] : [Step 4/5] [21:11:05] : [Step 4/5] [2021-11-19 21:11:05,266][INFO ][test-runner-#22415%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Starting binary memory restore for: [-2100569601] [21:11:05] : [Step 4/5] [2021-11-19 21:11:05,276][INFO ][test-runner-#22415%encryption.CacheGroupKeyChangeTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:11:05] : [Step 4/5] [2021-11-19 21:11:05,276][INFO ][test-runner-#22415%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:11:05] : [Step 4/5] [2021-11-19 21:11:05,280][INFO ][test-runner-#22415%encryption.CacheGroupKeyChangeTest%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000000.wal, offset=0, ver=2] [21:11:05] : [Step 4/5] [2021-11-19 21:11:05,284][INFO ][test-runner-#22415%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Started cache in recovery mode [name=ignite-sys-cache, id=-2100569601, dataRegionName=sysMemPlc, mode=REPLICATED, atomicity=TRANSACTIONAL, backups=2147483647, mvcc=false] [21:11:05] : [Step 4/5] [2021-11-19 21:11:05,285][INFO ][test-runner-#22415%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Binary recovery performed in 19 ms. [21:11:05] : [Step 4/5] [2021-11-19 21:11:05,285][INFO ][test-runner-#22415%encryption.CacheGroupKeyChangeTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:11:05] : [Step 4/5] [2021-11-19 21:11:05,285][INFO ][test-runner-#22415%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Applying lost cache updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:11:05] : [Step 4/5] [2021-11-19 21:11:05,288][INFO ][test-runner-#22415%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=10 ms] [21:11:05] : [Step 4/5] [2021-11-19 21:11:05,288][INFO ][test-runner-#22415%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Restoring partition state for local groups. [21:11:05] : [Step 4/5] [2021-11-19 21:11:05,306][INFO ][test-runner-#22415%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=1, partitionsProcessed=100, time=10ms] [21:11:05] : [Step 4/5] [2021-11-19 21:11:05,337][INFO ][test-runner-#22415%encryption.CacheGroupKeyChangeTest%][TestTcpDiscoverySpi] Successfully bound to TCP port [port=47500, localHost=localhost/127.0.0.1, locNodeId=00cc6e6a-4c24-4160-839c-0647b4274000] [21:11:05] : [Step 4/5] [2021-11-19 21:11:05,348][INFO ][disco-notifier-worker-#22527%grid-0%][MvccProcessorImpl] Assigned mvcc coordinator [crd=MvccCoordinator [topVer=AffinityTopologyVersion [topVer=1, minorTopVer=0], nodeId=00cc6e6a-4c24-4160-839c-0647b4274000, ver=1637345465348, local=true, initialized=false]] [21:11:05] : [Step 4/5] [2021-11-19 21:11:05,349][INFO ][sys-#22509%grid-0%][ClusterProcessor] Writing cluster ID and tag to metastorage on ready for write ClusterIdAndTag [id=c30adc47-a0de-4f18-a4d4-ceb16642f57a, tag=relaxed_cartwright] [21:11:05] : [Step 4/5] [2021-11-19 21:11:05,352][INFO ][disco-notifier-worker-#22527%grid-0%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustEnabled' was changed from 'null' to 'false' [21:11:05] : [Step 4/5] [2021-11-19 21:11:05,353][INFO ][disco-notifier-worker-#22527%grid-0%][ClusterProcessor] relaxed_cartwright [21:11:05] : [Step 4/5] [2021-11-19 21:11:05,353][INFO ][disco-notifier-worker-#22527%grid-0%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustTimeout' was changed from 'null' to '300000' [21:11:05] : [Step 4/5] [2021-11-19 21:11:05,354][INFO ][disco-notifier-worker-#22527%grid-0%][IgniteTxManager] Transactions parameter 'longOperationsDumpTimeout' was changed from 'null' to '60000' [21:11:05] : [Step 4/5] [2021-11-19 21:11:05,354][INFO ][disco-notifier-worker-#22527%grid-0%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpThreshold' was changed from 'null' to '0' [21:11:05] : [Step 4/5] [2021-11-19 21:11:05,355][INFO ][disco-notifier-worker-#22527%grid-0%][IgniteTxManager] Transactions parameter 'transactionTimeDumpSamplesCoefficient' was changed from 'null' to '0.0' [21:11:05] : [Step 4/5] [2021-11-19 21:11:05,355][INFO ][disco-notifier-worker-#22527%grid-0%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpSamplesPerSecondLimit' was changed from 'null' to '5' [21:11:05] : [Step 4/5] [2021-11-19 21:11:05,356][INFO ][disco-notifier-worker-#22527%grid-0%][IgniteTxManager] Transactions parameter 'collisionsDumpInterval' was changed from 'null' to '1000' [21:11:05] : [Step 4/5] [2021-11-19 21:11:05,356][INFO ][disco-notifier-worker-#22527%grid-0%][IgniteTxManager] Transactions parameter 'txOwnerDumpRequestsAllowed' was changed from 'null' to 'true' [21:11:05] : [Step 4/5] [2021-11-19 21:11:05,357][INFO ][disco-notifier-worker-#22527%grid-0%][GridCacheDatabaseSharedManager] Historical rebalance WAL threshold changed [property=historical.rebalance.threshold, oldVal=null, newVal=500] [21:11:05] : [Step 4/5] [2021-11-19 21:11:05,359][INFO ][test-runner-#22415%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] To start Console Management & Monitoring run ignitevisorcmd.{sh|bat} [21:11:05] : [Step 4/5] [2021-11-19 21:11:05,360][INFO ][test-runner-#22415%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] [21:11:05] : [Step 4/5] [21:11:05] : [Step 4/5] >>> +-------------------------------------------+ [21:11:05] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:11:05] : [Step 4/5] >>> +-------------------------------------------+ [21:11:05] : [Step 4/5] >>> OS name: Linux 4.15.0-151-generic amd64 [21:11:05] : [Step 4/5] >>> CPU(s): 24 [21:11:05] : [Step 4/5] >>> Heap: 2.0GB [21:11:05] : [Step 4/5] >>> VM name: 16724@c4dfe9a430b2 [21:11:05] : [Step 4/5] >>> Ignite instance name: grid-0 [21:11:05] : [Step 4/5] >>> Local node [ID=00CC6E6A-4C24-4160-839C-0647B4274000, order=1, clientMode=false] [21:11:05] : [Step 4/5] >>> Local node addresses: [127.0.0.1] [21:11:05] : [Step 4/5] >>> Local ports: TCP:10800 TCP:47100 TCP:47500 [21:11:05] : [Step 4/5] [21:11:05] : [Step 4/5] [2021-11-19 21:11:05,361][INFO ][test-runner-#22415%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] >>> Ignite cluster is in INACTIVE state (limited functionality available). Use control.(sh|bat) script or IgniteCluster.state(ClusterState.ACTIVE) to change the state. [21:11:05] : [Step 4/5] [2021-11-19 21:11:05,362][INFO ][test-runner-#22415%encryption.CacheGroupKeyChangeTest%][GridDiscoveryManager] Topology snapshot [ver=1, locNode=00cc6e6a, servers=1, clients=0, state=INACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=00cc6e6a-4c24-4160-839c-0647b4274000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:11:05] : [Step 4/5] [2021-11-19 21:11:05,362][INFO ][test-runner-#22415%encryption.CacheGroupKeyChangeTest%][G] Node started : [stage="Configure system pool" (0 ms),stage="Start managers" (189 ms),stage="Configure binary metadata" (3 ms),stage="Start processors" (416 ms),stage="Start 'StanByClusterTestProvider' plugin" (0 ms),stage="Start 'PageMemory tracker plugin' plugin" (0 ms),stage="Start 'TestDistibutedConfigurationPlugin' plugin" (0 ms),stage="Start 'NodeValidationPluginProvider' plugin" (0 ms),stage="Init metastore" (26 ms),stage="Init and start regions" (6 ms),stage="Restore binary memory" (18 ms),stage="Restore logical state" (21 ms),stage="Finish recovery" (29 ms),stage="Join topology" (11 ms),stage="Await transition" (1 ms),stage="Await exchange" (12 ms),stage="Total time" (732 ms)] [21:11:05] : [Step 4/5] [2021-11-19 21:11:05,363][INFO ][test-runner-#22415%encryption.CacheGroupKeyChangeTest%][root] Node started with the following configuration [id=00cc6e6a-4c24-4160-839c-0647b4274000, marshaller=BinaryMarshaller [], discovery=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=5000, ackTimeout=5000, marsh=JdkMarshaller [clsFilter=org.apache.ignite.marshaller.MarshallerUtils$1@590aa653], reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], binaryCfg=null, lateAff=true] [21:11:05]W: [org.apache.ignite:ignite-core] [2021-11-19 21:11:05,369][WARN ][test-runner-#22415%encryption.CacheGroupKeyChangeTest%][G] Ignite work directory is not provided, automatically resolved to: /opt/buildagent/work/7bc1c54bc719b67c/work [21:11:05] : [Step 4/5] [2021-11-19 21:11:05,370][INFO ][test-runner-#22415%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] [21:11:05] : [Step 4/5] [21:11:05] : [Step 4/5] >>> __________ ________________ [21:11:05] : [Step 4/5] >>> / _/ ___/ |/ / _/_ __/ __/ [21:11:05] : [Step 4/5] >>> _/ // (7 7 // / / / / _/ [21:11:05] : [Step 4/5] >>> /___/\___/_/|_/___/ /_/ /___/ [21:11:05] : [Step 4/5] >>> [21:11:05] : [Step 4/5] >>> ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:11:05] : [Step 4/5] >>> 2021 Copyright(C) Apache Software Foundation [21:11:05] : [Step 4/5] >>> [21:11:05] : [Step 4/5] >>> Ignite documentation: http://ignite.apache.org [21:11:05] : [Step 4/5] [21:11:05] : [Step 4/5] [2021-11-19 21:11:05,370][INFO ][test-runner-#22415%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] Config URL: n/a [21:11:05] : [Step 4/5] [2021-11-19 21:11:05,371][INFO ][test-runner-#22415%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] IgniteConfiguration [igniteInstanceName=grid-1, pubPoolSize=24, svcPoolSize=24, callbackPoolSize=24, stripedPoolSize=24, sysPoolSize=24, mgmtPoolSize=4, dataStreamerPoolSize=24, utilityCachePoolSize=24, utilityCacheKeepAliveTime=60000, p2pPoolSize=2, qryPoolSize=24, buildIdxPoolSize=4, igniteHome=/opt/buildagent/work/7bc1c54bc719b67c, igniteWorkDir=/opt/buildagent/work/7bc1c54bc719b67c/work, mbeanSrv=com.sun.jmx.mbeanserver.JmxMBeanServer@6fe85038, nodeId=10964d2c-60a6-4a30-b458-2fe584a63001, marsh=BinaryMarshaller [], marshLocJobs=false, daemon=false, p2pEnabled=true, netTimeout=10000, netCompressionLevel=1, sndRetryDelay=1000, sndRetryCnt=3, metricsHistSize=10000, metricsUpdateFreq=1000, metricsExpTime=9223372036854775807, discoSpi=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=0, ackTimeout=0, marsh=null, reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], segPlc=STOP, segResolveAttempts=2, waitForSegOnStart=true, allResolversPassReq=true, segChkFreq=10000, commSpi=TcpCommunicationSpi [connectGate=org.apache.ignite.spi.communication.tcp.internal.ConnectGateway@3e0ee346, ctxInitLatch=java.util.concurrent.CountDownLatch@7e1f6226[Count = 1], stopping=false, clientPool=null, nioSrvWrapper=null, stateProvider=null], evtSpi=MemoryEventStorageSpi [expireAgeMs=9223372036854775807, expireCnt=10000, filter=null], colSpi=NoopCollisionSpi [], deploySpi=LocalDeploymentSpi [], indexingSpi=org.apache.ignite.spi.indexing.noop.NoopIndexingSpi@272ee829, addrRslvr=null, encryptionSpi=org.apache.ignite.spi.encryption.keystore.KeystoreEncryptionSpi@26c17836, tracingSpi=org.apache.ignite.spi.tracing.NoopTracingSpi@e46b1ef, clientMode=false, rebalanceThreadPoolSize=4, rebalanceTimeout=10000, rebalanceBatchesPrefetchCnt=3, rebalanceThrottle=0, rebalanceBatchSize=524288, txCfg=TransactionConfiguration [txSerEnabled=false, dfltIsolation=REPEATABLE_READ, dfltConcurrency=PESSIMISTIC, dfltTxTimeout=0, txTimeoutOnPartitionMapExchange=0, deadlockTimeout=10000, pessimisticTxLogSize=0, pessimisticTxLogLinger=10000, tmLookupClsName=null, txManagerFactory=null, useJtaSync=false], cacheSanityCheckEnabled=true, discoStartupDelay=60000, deployMode=SHARED, p2pMissedCacheSize=100, locHost=127.0.0.1, timeSrvPortBase=31100, timeSrvPortRange=100, failureDetectionTimeout=10000, sysWorkerBlockedTimeout=null, clientFailureDetectionTimeout=10000, metricsLogFreq=0, connectorCfg=null, odbcCfg=null, warmupClos=null, atomicCfg=AtomicConfiguration [seqReserveSize=1000, cacheMode=PARTITIONED, backups=1, aff=null, grpName=null], classLdr=null, sslCtxFactory=null, platformCfg=null, binaryCfg=null, memCfg=null, pstCfg=null, dsCfg=DataStorageConfiguration [sysRegionInitSize=41943040, sysRegionMaxSize=104857600, pageSize=4096, concLvl=0, dfltDataRegConf=DataRegionConfiguration [name=default, maxSize=104857600, initSize=268435456, swapPath=null, pageEvictionMode=DISABLED, pageReplacementMode=CLOCK, evictionThreshold=0.9, emptyPagesPoolSize=100, metricsEnabled=false, metricsSubIntervalCount=5, metricsRateTimeInterval=60000, persistenceEnabled=true, checkpointPageBufSize=0, lazyMemoryAllocation=true, warmUpCfg=null], dataRegions=null, storagePath=null, checkpointFreq=30000, lockWaitTime=10000, checkpointThreads=4, checkpointWriteOrder=SEQUENTIAL, walHistSize=20, maxWalArchiveSize=20971520, walSegments=10, walSegmentSize=1048576, walPath=db/wal, walArchivePath=db/wal/archive, cdcWalPath=db/wal/cdc, cdcEnabled=false, metricsEnabled=false, walMode=LOG_ONLY, walTlbSize=131072, walBuffSize=0, walFlushFreq=2000, walFsyncDelay=1000, walRecordIterBuffSize=67108864, alwaysWriteFullPages=false, fileIOFactory=org.apache.ignite.internal.processors.cache.persistence.file.AsyncFileIOFactory@6290f842, metricsSubIntervalCnt=5, metricsRateTimeInterval=60000, walAutoArchiveAfterInactivity=-1, walForceArchiveTimeout=-1, writeThrottlingEnabled=false, walCompactionEnabled=false, walCompactionLevel=1, checkpointReadLockTimeout=null, walPageCompression=DISABLED, walPageCompressionLevel=null, dfltWarmUpCfg=null, encCfg=org.apache.ignite.configuration.EncryptionConfiguration@42448798, defragmentationThreadPoolSize=4, minWalArchiveSize=-1], snapshotPath=snapshots, activeOnStart=true, activeOnStartPropSetFlag=false, autoActivation=true, autoActivationPropSetFlag=false, clusterStateOnStart=null, sqlConnCfg=null, cliConnCfg=ClientConnectorConfiguration [host=null, port=10800, portRange=100, sockSndBufSize=0, sockRcvBufSize=0, tcpNoDelay=true, maxOpenCursorsPerConn=128, threadPoolSize=24, selectorCnt=12, idleTimeout=0, handshakeTimeout=10000, jdbcEnabled=true, odbcEnabled=true, thinCliEnabled=true, sslEnabled=false, useIgniteSslCtxFactory=true, sslClientAuth=false, sslCtxFactory=null, thinCliCfg=ThinClientConfiguration [maxActiveTxPerConn=100, maxActiveComputeTasksPerConn=0]], mvccVacuumThreadCnt=2, mvccVacuumFreq=5000, authEnabled=false, failureHnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]], commFailureRslvr=null, sqlCfg=SqlConfiguration [longQryWarnTimeout=3000, dfltQryTimeout=0, sqlQryHistSize=1000, validationEnabled=false], asyncContinuationExecutor=null] [21:11:05] : [Step 4/5] [2021-11-19 21:11:05,378][INFO ][test-runner-#22415%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] Daemon mode: off [21:11:05] : [Step 4/5] [2021-11-19 21:11:05,378][INFO ][test-runner-#22415%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] OS: Linux 4.15.0-151-generic amd64 [21:11:05] : [Step 4/5] [2021-11-19 21:11:05,378][INFO ][test-runner-#22415%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] OS user: teamcity [21:11:05] : [Step 4/5] [2021-11-19 21:11:05,378][INFO ][test-runner-#22415%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] PID: 16724 [21:11:05] : [Step 4/5] [2021-11-19 21:11:05,378][INFO ][test-runner-#22415%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] Language runtime: Java Platform API Specification ver. 1.8 [21:11:05] : [Step 4/5] [2021-11-19 21:11:05,379][INFO ][test-runner-#22415%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] VM information: Java(TM) SE Runtime Environment 1.8.0_261-b12 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 25.261-b12 [21:11:05] : [Step 4/5] [2021-11-19 21:11:05,379][INFO ][test-runner-#22415%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] VM total memory: 1.9GB [21:11:05] : [Step 4/5] [2021-11-19 21:11:05,379][INFO ][test-runner-#22415%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] Remote Management [restart: off, REST: off, JMX (remote: off)] [21:11:05] : [Step 4/5] [2021-11-19 21:11:05,379][INFO ][test-runner-#22415%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] Logger: GridTestLog4jLogger [quiet=false, config=null] [21:11:05] : [Step 4/5] [2021-11-19 21:11:05,380][INFO ][test-runner-#22415%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] IGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c [21:11:05] : [Step 4/5] [2021-11-19 21:11:05,380][INFO ][test-runner-#22415%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] VM arguments: [-DIGNITE_DUMP_THREADS_ON_FAILURE=false, -DMono=/usr/bin/mono-sgen, -DMono4.0_x64=/usr/lib/mono/4.0, -DMono4.5_x64=/usr/lib/mono/4.5, -DMonoVersion=6.12.0.90, -DSKIP_BUILD=false, -Dagent.home.dir=/opt/buildagent, -Dagent.name=aitc-lin02_03, -Dagent.ownPort=9090, -Dagent.work.dir=/opt/buildagent/work, -Dbuild.number=95, -Dbuild.vcs.number=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.1=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.GitHubApacheIgnite=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dclassworlds.conf=/opt/buildagent/temp/buildTmp/teamcity.m2.conf, -Dcom.jetbrains.maven.watcher.report.file=/opt/buildagent/temp/buildTmp/maven-build-info.xml, -Djava.io.tmpdir=/opt/buildagent/temp/buildTmp, -Dmaven.home=/opt/buildagent/tools/maven3_6, -Dmaven.multiModuleProjectDirectory=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.agent.cpuBenchmark=457, -Dteamcity.agent.dotnet.agent_url=http://localhost:9090/RPC2, -Dteamcity.agent.dotnet.build_id=6278078, -Dteamcity.auth.password=*******, -Dteamcity.auth.userId=TeamCityBuildId=6278078, -Dteamcity.build.changedFiles.file=/opt/buildagent/temp/buildTmp/changedFiles6342607772318147725.txt, -Dteamcity.build.checkoutDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.build.id=6278078, -Dteamcity.build.properties.file=/opt/buildagent/temp/buildTmp/teamcity.build5164517880467851002.properties, -Dteamcity.build.tempDir=/opt/buildagent/temp/buildTmp, -Dteamcity.build.workingDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.buildConfName=Basic 3, -Dteamcity.buildType.id=IgniteTests24Java8_Basic3, -Dteamcity.configuration.properties.file=/opt/buildagent/temp/buildTmp/teamcity.config5591980786735343870.properties, -Dteamcity.maven.userSettings.path=/opt/buildagent/temp/buildTmp/maven_settings_585072866407032347.xml, -Dteamcity.maven.watcher.home=/opt/buildagent/plugins/mavenPlugin/maven-watcher-jdk16, -Dteamcity.projectName=Ignite Tests 2.x (JDK 8/11), -Dteamcity.runner.properties.file=/opt/buildagent/temp/buildTmp/teamcity.runner9098465561618137420.properties, -Dteamcity.tests.recentlyFailedTests.file=/opt/buildagent/temp/buildTmp/testsToRunFirst3891775683130404069.txt, -Dteamcity.version=2021.2 (build 99542), -ea, -Xms2g, -Xmx2g, -XX:+HeapDumpOnOutOfMemoryError, -DIGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_TEST_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_UPDATE_NOTIFIER=false, -DIGNITE_NO_DISCO_ORDER=true, -DIGNITE_PERFORMANCE_SUGGESTIONS_DISABLED=true, -Djava.net.preferIPv4Stack=true, -DTEST_SCALE_FACTOR=1.0, -DIGNITE_TEST_PROP_LOG4J_FILE=log4j-tc-test.xml, -DIGNITE_QUIET=false, -DIGNITE_MARSHAL_BUFFERS_RECHECK=1000, -Dmaven.repo.local=/opt/buildagent/.m2/repository] [21:11:05] : [Step 4/5] [2021-11-19 21:11:05,384][INFO ][test-runner-#22415%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] System cache's DataRegion size is configured to 40 MB. Use DataStorageConfiguration.systemRegionInitialSize property to change the setting. [21:11:05] : [Step 4/5] [2021-11-19 21:11:05,385][INFO ][test-runner-#22415%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] Configured caches [in 'sysMemPlc' dataRegion: ['ignite-sys-cache']] [21:11:05]W: [org.apache.ignite:ignite-core] [2021-11-19 21:11:05,385][WARN ][test-runner-#22415%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] Peer class loading is enabled (disable it in production for performance and deployment consistency reasons) [21:11:05] : [Step 4/5] [2021-11-19 21:11:05,385][INFO ][test-runner-#22415%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] 3-rd party licenses can be found at: /opt/buildagent/work/7bc1c54bc719b67c/libs/licenses [21:11:05] : [Step 4/5] [2021-11-19 21:11:05,389][INFO ][test-runner-#22415%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] Configured plugins: [21:11:05] : [Step 4/5] [2021-11-19 21:11:05,389][INFO ][test-runner-#22415%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- StanByClusterTestProvider 1.0 [21:11:05] : [Step 4/5] [2021-11-19 21:11:05,389][INFO ][test-runner-#22415%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:11:05] : [Step 4/5] [2021-11-19 21:11:05,390][INFO ][test-runner-#22415%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] [21:11:05] : [Step 4/5] [2021-11-19 21:11:05,390][INFO ][test-runner-#22415%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- PageMemory tracker plugin 1.0 [21:11:05] : [Step 4/5] [2021-11-19 21:11:05,390][INFO ][test-runner-#22415%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:11:05] : [Step 4/5] [2021-11-19 21:11:05,390][INFO ][test-runner-#22415%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] [21:11:05] : [Step 4/5] [2021-11-19 21:11:05,390][INFO ][test-runner-#22415%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- TestDistibutedConfigurationPlugin 1.0 [21:11:05] : [Step 4/5] [2021-11-19 21:11:05,391][INFO ][test-runner-#22415%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:11:05] : [Step 4/5] [2021-11-19 21:11:05,391][INFO ][test-runner-#22415%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] [21:11:05] : [Step 4/5] [2021-11-19 21:11:05,391][INFO ][test-runner-#22415%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- NodeValidationPluginProvider 1.0 [21:11:05] : [Step 4/5] [2021-11-19 21:11:05,391][INFO ][test-runner-#22415%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:11:05] : [Step 4/5] [2021-11-19 21:11:05,391][INFO ][test-runner-#22415%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] [21:11:05] : [Step 4/5] [2021-11-19 21:11:05,392][INFO ][test-runner-#22415%encryption.CacheGroupKeyChangeTest%][FailureProcessor] Configured failure handler: [hnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]]] [21:11:05] : [Step 4/5] [2021-11-19 21:11:05,403][INFO ][test-runner-#22415%encryption.CacheGroupKeyChangeTest%][TestRecordingCommunicationSpi] Successfully bound communication NIO server to TCP port [port=47101, locHost=/127.0.0.1, selectorsCnt=12, selectorSpins=0, pairedConn=false] [21:11:05]W: [org.apache.ignite:ignite-core] [2021-11-19 21:11:05,404][WARN ][test-runner-#22415%encryption.CacheGroupKeyChangeTest%][TestRecordingCommunicationSpi] Message queue limit is set to 0 which may lead to potential OOMEs when running cache operations in FULL_ASYNC or PRIMARY_SYNC modes due to message queues growth on sender and receiver sides. [21:11:05] : [Step 4/5] [2021-11-19 21:11:05,408][INFO ][test-runner-#22415%encryption.CacheGroupKeyChangeTest%][GridCollisionManager] Collision resolution is disabled (all jobs will be activated upon arrival). [21:11:05] : [Step 4/5] [2021-11-19 21:11:05,409][INFO ][test-runner-#22415%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] Security status [authentication=off, sandbox=off, tls/ssl=off] [21:11:05] : [Step 4/5] [2021-11-19 21:11:05,466][INFO ][test-runner-#22415%encryption.CacheGroupKeyChangeTest%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:05] : [Step 4/5] [2021-11-19 21:11:05,550][INFO ][test-runner-#22415%encryption.CacheGroupKeyChangeTest%][MaintenanceProcessor] Resolved store directory for node persistent data: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1 [21:11:05] : [Step 4/5] [2021-11-19 21:11:05,551][INFO ][test-runner-#22415%encryption.CacheGroupKeyChangeTest%][CacheObjectBinaryProcessorImpl] Resolved directory for serialized binary metadata: /opt/buildagent/work/7bc1c54bc719b67c/work/db/binary_meta/grid_1 [21:11:05] : [Step 4/5] [2021-11-19 21:11:05,555][INFO ][test-runner-#22415%encryption.CacheGroupKeyChangeTest%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1 [21:11:05] : [Step 4/5] [2021-11-19 21:11:05,556][INFO ][test-runner-#22415%encryption.CacheGroupKeyChangeTest%][FileWriteAheadLogManager] Resolved write ahead log work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1 [21:11:05] : [Step 4/5] [2021-11-19 21:11:05,556][INFO ][test-runner-#22415%encryption.CacheGroupKeyChangeTest%][FileWriteAheadLogManager] Resolved write ahead log archive directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1 [21:11:06] : [Step 4/5] [2021-11-19 21:11:06,347][INFO ][test-runner-#22415%encryption.CacheGroupKeyChangeTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000000.wal [21:11:06] : [Step 4/5] [2021-11-19 21:11:06,348][INFO ][test-runner-#22415%encryption.CacheGroupKeyChangeTest%][FileHandleManagerImpl] Initialized write-ahead log manager [mode=LOG_ONLY] [21:11:06] : [Step 4/5] [2021-11-19 21:11:06,353][INFO ][test-runner-#22415%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Configured data regions initialized successfully [total=5] [21:11:06] : [Step 4/5] [2021-11-19 21:11:06,355][INFO ][test-runner-#22415%encryption.CacheGroupKeyChangeTest%][IgniteSnapshotManager] Resolved snapshot work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/snapshots [21:11:06] : [Step 4/5] [2021-11-19 21:11:06,356][INFO ][test-runner-#22415%encryption.CacheGroupKeyChangeTest%][IgniteSnapshotManager] Resolved temp directory for snapshot creation: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1/snp [21:11:06] : [Step 4/5] [2021-11-19 21:11:06,358][INFO ][test-runner-#22415%encryption.CacheGroupKeyChangeTest%][ClientListenerProcessor] Client connector processor has started on TCP port 10801 [21:11:06] : [Step 4/5] [2021-11-19 21:11:06,360][INFO ][test-runner-#22415%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] Non-loopback local IPs: 172.17.0.4 [21:11:06] : [Step 4/5] [2021-11-19 21:11:06,361][INFO ][test-runner-#22415%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] Enabled local MACs: 0242AC110004 [21:11:06] : [Step 4/5] [2021-11-19 21:11:06,361][INFO ][test-runner-#22415%encryption.CacheGroupKeyChangeTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:11:06] : [Step 4/5] [2021-11-19 21:11:06,362][INFO ][test-runner-#22415%encryption.CacheGroupKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:11:06] : [Step 4/5] [2021-11-19 21:11:06,363][INFO ][test-runner-#22415%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:11:06] : [Step 4/5] [2021-11-19 21:11:06,365][INFO ][test-runner-#22415%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Applying lost metastore updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:11:06] : [Step 4/5] [2021-11-19 21:11:06,366][INFO ][test-runner-#22415%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=0 ms] [21:11:06] : [Step 4/5] [2021-11-19 21:11:06,366][INFO ][test-runner-#22415%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Restoring partition state for local groups. [21:11:06] : [Step 4/5] [2021-11-19 21:11:06,366][INFO ][test-runner-#22415%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=0, partitionsProcessed=0, time=0ms] [21:11:06] : [Step 4/5] [2021-11-19 21:11:06,367][INFO ][test-runner-#22415%encryption.CacheGroupKeyChangeTest%][GridEncryptionManager] Encryption keys loaded from metastore. [grps=, masterKeyName=ignite.master.key] [21:11:06] : [Step 4/5] [2021-11-19 21:11:06,368][INFO ][test-runner-#22415%encryption.CacheGroupKeyChangeTest%][ClusterProcessor] Cluster ID and tag has been read from metastorage: null [21:11:06] : [Step 4/5] [2021-11-19 21:11:06,368][INFO ][test-runner-#22415%encryption.CacheGroupKeyChangeTest%][IgniteClusterImpl] Shutdown policy was updated [oldVal=null, newVal=null] [21:11:06] : [Step 4/5] [2021-11-19 21:11:06,369][INFO ][test-runner-#22415%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Checkpoint frequency deviation changed [oldVal=null, newVal=null] [21:11:06] : [Step 4/5] [2021-11-19 21:11:06,378][INFO ][test-runner-#22415%encryption.CacheGroupKeyChangeTest%][FilePageStoreManager] Cleanup cache stores [total=1, left=0, cleanFiles=false] [21:11:06] : [Step 4/5] [2021-11-19 21:11:06,381][INFO ][test-runner-#22415%encryption.CacheGroupKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:11:06] : [Step 4/5] [2021-11-19 21:11:06,381][INFO ][test-runner-#22415%encryption.CacheGroupKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:11:06] : [Step 4/5] [2021-11-19 21:11:06,382][INFO ][test-runner-#22415%encryption.CacheGroupKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:11:06] : [Step 4/5] [2021-11-19 21:11:06,383][INFO ][test-runner-#22415%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Data Regions Started: 5 [21:11:06] : [Step 4/5] [2021-11-19 21:11:06,383][INFO ][test-runner-#22415%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] ^-- sysMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:11:06] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:11:06] : [Step 4/5] ^-- default region [type=default, persistence=true, lazyAlloc=true, [21:11:06] : [Step 4/5] ... initCfg=100MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB, allocTotal=0MB] [21:11:06] : [Step 4/5] ^-- metastoreMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:11:06] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:11:06] : [Step 4/5] ^-- TxLog region [type=internal, persistence=true, lazyAlloc=false, [21:11:06] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:11:06] : [Step 4/5] ^-- volatileDsMemPlc region [type=user, persistence=false, lazyAlloc=true, [21:11:06] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB] [21:11:06] : [Step 4/5] ^-- Ignite persistence [used=0MB] [21:11:06] : [Step 4/5] [21:11:06] : [Step 4/5] [2021-11-19 21:11:06,385][INFO ][test-runner-#22415%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Starting binary memory restore for: [-2100569601] [21:11:06] : [Step 4/5] [2021-11-19 21:11:06,393][INFO ][test-runner-#22415%encryption.CacheGroupKeyChangeTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:11:06] : [Step 4/5] [2021-11-19 21:11:06,393][INFO ][test-runner-#22415%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:11:06] : [Step 4/5] [2021-11-19 21:11:06,395][INFO ][test-runner-#22415%encryption.CacheGroupKeyChangeTest%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000000.wal, offset=0, ver=2] [21:11:06] : [Step 4/5] [2021-11-19 21:11:06,398][INFO ][test-runner-#22415%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Started cache in recovery mode [name=ignite-sys-cache, id=-2100569601, dataRegionName=sysMemPlc, mode=REPLICATED, atomicity=TRANSACTIONAL, backups=2147483647, mvcc=false] [21:11:06] : [Step 4/5] [2021-11-19 21:11:06,399][INFO ][test-runner-#22415%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Binary recovery performed in 14 ms. [21:11:06] : [Step 4/5] [2021-11-19 21:11:06,399][INFO ][test-runner-#22415%encryption.CacheGroupKeyChangeTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:11:06] : [Step 4/5] [2021-11-19 21:11:06,399][INFO ][test-runner-#22415%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Applying lost cache updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:11:06] : [Step 4/5] [2021-11-19 21:11:06,401][INFO ][test-runner-#22415%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=0 ms] [21:11:06] : [Step 4/5] [2021-11-19 21:11:06,402][INFO ][test-runner-#22415%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Restoring partition state for local groups. [21:11:06] : [Step 4/5] [2021-11-19 21:11:06,412][INFO ][test-runner-#22415%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=1, partitionsProcessed=100, time=11ms] [21:11:06] : [Step 4/5] [2021-11-19 21:11:06,434][INFO ][test-runner-#22415%encryption.CacheGroupKeyChangeTest%][TestTcpDiscoverySpi] Successfully bound to TCP port [port=47501, localHost=localhost/127.0.0.1, locNodeId=10964d2c-60a6-4a30-b458-2fe584a63001] [21:11:06] : [Step 4/5] [2021-11-19 21:11:06,438][INFO ][tcp-disco-srvr-[:47500]-#1183%grid-0%-#22529%grid-0%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=48287] [21:11:06] : [Step 4/5] [2021-11-19 21:11:06,438][INFO ][tcp-disco-srvr-[:47500]-#1183%grid-0%-#22529%grid-0%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=48287] [21:11:06] : [Step 4/5] [2021-11-19 21:11:06,440][INFO ][tcp-disco-sock-reader-[]-#1189%grid-0%-#22649%grid-0%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:48287, rmtPort=48287] [21:11:06] : [Step 4/5] [2021-11-19 21:11:06,441][INFO ][tcp-disco-sock-reader-[10964d2c 127.0.0.1:48287]-#1189%grid-0%-#22649%grid-0%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=10964d2c-60a6-4a30-b458-2fe584a63001, rmtAddr=/127.0.0.1:48287] [21:11:06] : [Step 4/5] [2021-11-19 21:11:06,446][INFO ][tcp-disco-srvr-[:47501]-#1188%grid-1%-#22648%grid-1%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=39443] [21:11:06] : [Step 4/5] [2021-11-19 21:11:06,446][INFO ][tcp-disco-srvr-[:47501]-#1188%grid-1%-#22648%grid-1%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=39443] [21:11:06] : [Step 4/5] [2021-11-19 21:11:06,446][INFO ][tcp-disco-sock-reader-[]-#1190%grid-1%-#22650%grid-1%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:39443, rmtPort=39443] [21:11:06] : [Step 4/5] [2021-11-19 21:11:06,447][INFO ][tcp-disco-sock-reader-[]-#1190%grid-1%-#22650%grid-1%][TestTcpDiscoverySpi] Received ping request from the remote node [rmtNodeId=00cc6e6a-4c24-4160-839c-0647b4274000, rmtAddr=/127.0.0.1:39443, rmtPort=39443] [21:11:06] : [Step 4/5] [2021-11-19 21:11:06,448][INFO ][tcp-disco-sock-reader-[]-#1190%grid-1%-#22650%grid-1%][TestTcpDiscoverySpi] Finished writing ping response [rmtNodeId=00cc6e6a-4c24-4160-839c-0647b4274000, rmtAddr=/127.0.0.1:39443, rmtPort=39443] [21:11:06] : [Step 4/5] [2021-11-19 21:11:06,448][INFO ][tcp-disco-sock-reader-[10964d2c 127.0.0.1:48287]-#1189%grid-0%-#22649%grid-0%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:48287, rmtPort=48287, rmtNodeId=10964d2c-60a6-4a30-b458-2fe584a63001] [21:11:06]W: [org.apache.ignite:ignite-core] [2021-11-19 21:11:06,449][WARN ][tcp-disco-sock-reader-[]-#1190%grid-1%-#22650%grid-1%][TestTcpDiscoverySpi] Failed to shutdown socket [21:11:06]W: [org.apache.ignite:ignite-core] java.net.SocketException: Socket output is already shutdown [21:11:06]W: [org.apache.ignite:ignite-core] at java.net.Socket.shutdownOutput(Socket.java:1572) [21:11:06]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.close(IgniteUtils.java:4247) [21:11:06]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.discovery.tcp.ServerImpl$SocketReader.body(ServerImpl.java:7370) [21:11:06]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.IgniteSpiThread.run(IgniteSpiThread.java:58) [21:11:06] : [Step 4/5] [2021-11-19 21:11:06,452][INFO ][tcp-disco-sock-reader-[]-#1190%grid-1%-#22650%grid-1%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:39443, rmtPort=39443, rmtNodeId=null] [21:11:06] : [Step 4/5] [2021-11-19 21:11:06,453][INFO ][tcp-disco-msg-worker-[crd]-#1182%grid-0%-#22528%grid-0%][GridEncryptionManager] Joining node doesn't have stored group keys [node=10964d2c-60a6-4a30-b458-2fe584a63001] [21:11:06] : [Step 4/5] [2021-11-19 21:11:06,460][INFO ][tcp-disco-msg-worker-[crd]-#1182%grid-0%-#22528%grid-0%][TestTcpDiscoverySpi] New next node [newNext=TcpDiscoveryNode [id=10964d2c-60a6-4a30-b458-2fe584a63001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=0, intOrder=2, lastExchangeTime=1637345466438, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false]] [21:11:06] : [Step 4/5] [2021-11-19 21:11:06,461][INFO ][tcp-disco-srvr-[:47501]-#1188%grid-1%-#22648%grid-1%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=49749] [21:11:06] : [Step 4/5] [2021-11-19 21:11:06,461][INFO ][tcp-disco-srvr-[:47501]-#1188%grid-1%-#22648%grid-1%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=49749] [21:11:06] : [Step 4/5] [2021-11-19 21:11:06,462][INFO ][tcp-disco-sock-reader-[]-#1191%grid-1%-#22651%grid-1%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:49749, rmtPort=49749] [21:11:06] : [Step 4/5] [2021-11-19 21:11:06,463][INFO ][tcp-disco-sock-reader-[00cc6e6a 127.0.0.1:49749]-#1191%grid-1%-#22651%grid-1%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=00cc6e6a-4c24-4160-839c-0647b4274000, rmtAddr=/127.0.0.1:49749] [21:11:06] : [Step 4/5] [2021-11-19 21:11:06,467][INFO ][tcp-disco-msg-worker-[]-#1187%grid-1%-#22647%grid-1%][TestTcpDiscoverySpi] New next node [newNext=TcpDiscoveryNode [id=00cc6e6a-4c24-4160-839c-0647b4274000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345466458, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false]] [21:11:06] : [Step 4/5] [2021-11-19 21:11:06,468][INFO ][tcp-disco-srvr-[:47500]-#1183%grid-0%-#22529%grid-0%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=60947] [21:11:06] : [Step 4/5] [2021-11-19 21:11:06,469][INFO ][tcp-disco-srvr-[:47500]-#1183%grid-0%-#22529%grid-0%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=60947] [21:11:06] : [Step 4/5] [2021-11-19 21:11:06,470][INFO ][tcp-disco-sock-reader-[]-#1192%grid-0%-#22652%grid-0%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:60947, rmtPort=60947] [21:11:06] : [Step 4/5] [2021-11-19 21:11:06,470][INFO ][tcp-disco-sock-reader-[10964d2c 127.0.0.1:60947]-#1192%grid-0%-#22652%grid-0%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=10964d2c-60a6-4a30-b458-2fe584a63001, rmtAddr=/127.0.0.1:60947] [21:11:06] : [Step 4/5] [2021-11-19 21:11:06,472][INFO ][disco-event-worker-#22531%grid-0%][GridDiscoveryManager] Added new node to topology: TcpDiscoveryNode [id=10964d2c-60a6-4a30-b458-2fe584a63001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637345466438, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false] [21:11:06] : [Step 4/5] [2021-11-19 21:11:06,474][INFO ][disco-event-worker-#22531%grid-0%][GridDiscoveryManager] Topology snapshot [ver=2, locNode=00cc6e6a, servers=2, clients=0, state=INACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=00cc6e6a-4c24-4160-839c-0647b4274000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=10964d2c-60a6-4a30-b458-2fe584a63001, consistentId=grid-1, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:11:06] : [Step 4/5] [2021-11-19 21:11:06,477][INFO ][tcp-disco-msg-worker-[00cc6e6a 127.0.0.1:47500]-#1187%grid-1%-#22647%grid-1%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustEnabled' was changed from 'null' to 'false' [21:11:06] : [Step 4/5] [2021-11-19 21:11:06,478][INFO ][tcp-disco-msg-worker-[00cc6e6a 127.0.0.1:47500]-#1187%grid-1%-#22647%grid-1%][ClusterProcessor] relaxed_cartwright [21:11:06] : [Step 4/5] [2021-11-19 21:11:06,478][INFO ][tcp-disco-msg-worker-[00cc6e6a 127.0.0.1:47500]-#1187%grid-1%-#22647%grid-1%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustTimeout' was changed from 'null' to '300000' [21:11:06] : [Step 4/5] [2021-11-19 21:11:06,478][INFO ][tcp-disco-msg-worker-[00cc6e6a 127.0.0.1:47500]-#1187%grid-1%-#22647%grid-1%][IgniteTxManager] Transactions parameter 'longOperationsDumpTimeout' was changed from 'null' to '60000' [21:11:06] : [Step 4/5] [2021-11-19 21:11:06,479][INFO ][tcp-disco-msg-worker-[00cc6e6a 127.0.0.1:47500]-#1187%grid-1%-#22647%grid-1%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpThreshold' was changed from 'null' to '0' [21:11:06] : [Step 4/5] [2021-11-19 21:11:06,479][INFO ][tcp-disco-msg-worker-[00cc6e6a 127.0.0.1:47500]-#1187%grid-1%-#22647%grid-1%][IgniteTxManager] Transactions parameter 'transactionTimeDumpSamplesCoefficient' was changed from 'null' to '0.0' [21:11:06] : [Step 4/5] [2021-11-19 21:11:06,480][INFO ][tcp-disco-msg-worker-[00cc6e6a 127.0.0.1:47500]-#1187%grid-1%-#22647%grid-1%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpSamplesPerSecondLimit' was changed from 'null' to '5' [21:11:06] : [Step 4/5] [2021-11-19 21:11:06,480][INFO ][tcp-disco-msg-worker-[00cc6e6a 127.0.0.1:47500]-#1187%grid-1%-#22647%grid-1%][IgniteTxManager] Transactions parameter 'collisionsDumpInterval' was changed from 'null' to '1000' [21:11:06] : [Step 4/5] [2021-11-19 21:11:06,481][INFO ][tcp-disco-msg-worker-[00cc6e6a 127.0.0.1:47500]-#1187%grid-1%-#22647%grid-1%][IgniteTxManager] Transactions parameter 'txOwnerDumpRequestsAllowed' was changed from 'null' to 'true' [21:11:06] : [Step 4/5] [2021-11-19 21:11:06,481][INFO ][tcp-disco-msg-worker-[00cc6e6a 127.0.0.1:47500]-#1187%grid-1%-#22647%grid-1%][GridCacheDatabaseSharedManager] Historical rebalance WAL threshold changed [property=historical.rebalance.threshold, oldVal=null, newVal=500] [21:11:06] : [Step 4/5] [2021-11-19 21:11:06,483][INFO ][disco-notifier-worker-#22646%grid-1%][MvccProcessorImpl] Assigned mvcc coordinator [crd=MvccCoordinator [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=0], nodeId=00cc6e6a-4c24-4160-839c-0647b4274000, ver=1637345465348, local=false, initialized=false]] [21:11:06] : [Step 4/5] [2021-11-19 21:11:06,484][INFO ][sys-#22633%grid-1%][ClusterProcessor] Writing cluster ID and tag to metastorage on ready for write ClusterIdAndTag [id=c30adc47-a0de-4f18-a4d4-ceb16642f57a, tag=relaxed_cartwright] [21:11:06] : [Step 4/5] [2021-11-19 21:11:06,496][INFO ][test-runner-#22415%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] To start Console Management & Monitoring run ignitevisorcmd.{sh|bat} [21:11:06] : [Step 4/5] [2021-11-19 21:11:06,496][INFO ][test-runner-#22415%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] [21:11:06] : [Step 4/5] [21:11:06] : [Step 4/5] >>> +-------------------------------------------+ [21:11:06] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:11:06] : [Step 4/5] >>> +-------------------------------------------+ [21:11:06] : [Step 4/5] >>> OS name: Linux 4.15.0-151-generic amd64 [21:11:06] : [Step 4/5] >>> CPU(s): 24 [21:11:06] : [Step 4/5] >>> Heap: 2.0GB [21:11:06] : [Step 4/5] >>> VM name: 16724@c4dfe9a430b2 [21:11:06] : [Step 4/5] >>> Ignite instance name: grid-1 [21:11:06] : [Step 4/5] >>> Local node [ID=10964D2C-60A6-4A30-B458-2FE584A63001, order=2, clientMode=false] [21:11:06] : [Step 4/5] >>> Local node addresses: [127.0.0.1] [21:11:06] : [Step 4/5] >>> Local ports: TCP:10801 TCP:47101 TCP:47501 [21:11:06] : [Step 4/5] [21:11:06] : [Step 4/5] [2021-11-19 21:11:06,497][INFO ][test-runner-#22415%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] >>> Ignite cluster is in INACTIVE state (limited functionality available). Use control.(sh|bat) script or IgniteCluster.state(ClusterState.ACTIVE) to change the state. [21:11:06] : [Step 4/5] [2021-11-19 21:11:06,498][INFO ][test-runner-#22415%encryption.CacheGroupKeyChangeTest%][GridDiscoveryManager] Topology snapshot [ver=2, locNode=10964d2c, servers=2, clients=0, state=INACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=00cc6e6a-4c24-4160-839c-0647b4274000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=10964d2c-60a6-4a30-b458-2fe584a63001, consistentId=grid-1, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:11:06] : [Step 4/5] [2021-11-19 21:11:06,498][INFO ][test-runner-#22415%encryption.CacheGroupKeyChangeTest%][G] Node started : [stage="Configure system pool" (0 ms),stage="Start managers" (182 ms),stage="Configure binary metadata" (1 ms),stage="Start processors" (806 ms),stage="Start 'StanByClusterTestProvider' plugin" (0 ms),stage="Start 'PageMemory tracker plugin' plugin" (0 ms),stage="Start 'TestDistibutedConfigurationPlugin' plugin" (0 ms),stage="Start 'NodeValidationPluginProvider' plugin" (0 ms),stage="Init metastore" (18 ms),stage="Init and start regions" (6 ms),stage="Restore binary memory" (13 ms),stage="Restore logical state" (12 ms),stage="Finish recovery" (21 ms),stage="Join topology" (49 ms),stage="Await transition" (2 ms),stage="Await exchange" (13 ms),stage="Total time" (1123 ms)] [21:11:06] : [Step 4/5] [2021-11-19 21:11:06,499][INFO ][test-runner-#22415%encryption.CacheGroupKeyChangeTest%][root] Node started with the following configuration [id=10964d2c-60a6-4a30-b458-2fe584a63001, marshaller=BinaryMarshaller [], discovery=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=5000, ackTimeout=5000, marsh=JdkMarshaller [clsFilter=org.apache.ignite.marshaller.MarshallerUtils$1@2c15da77], reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], binaryCfg=null, lateAff=true] [21:11:06] : [Step 4/5] [2021-11-19 21:11:06,501][INFO ][test-runner-#22415%encryption.CacheGroupKeyChangeTest%][GridClusterStateProcessor] Sending activate cluster request with BaselineTopology BaselineTopology [id=0, branchingHash=-2475315501, branchingType='New BaselineTopology', baselineNodes=[grid-1, grid-0]] [21:11:06] : [Step 4/5] [2021-11-19 21:11:06,505][INFO ][disco-notifier-worker-#22527%grid-0%][GridClusterStateProcessor] Received activate cluster request with BaselineTopology[id=0] initiator node ID: 00cc6e6a-4c24-4160-839c-0647b4274000 [21:11:06] : [Step 4/5] [2021-11-19 21:11:06,505][INFO ][disco-notifier-worker-#22527%grid-0%][GridClusterStateProcessor] Started state transition: activate cluster [21:11:06] : [Step 4/5] [2021-11-19 21:11:06,506][INFO ][exchange-worker-#22532%grid-0%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], crd=true, evt=DISCOVERY_CUSTOM_EVT, evtNode=00cc6e6a-4c24-4160-839c-0647b4274000, customEvt=ChangeGlobalStateMessage [id=0aa8d593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqId=8a4ddf2e-739b-45f5-afeb-2c6d5ace5b4d, initiatingNodeId=00cc6e6a-4c24-4160-839c-0647b4274000, state=ACTIVE, baselineTopology=BaselineTopology [id=0, branchingHash=-2475315501, branchingType='New BaselineTopology', baselineNodes=[grid-1, grid-0]], forceChangeBaselineTopology=false, timestamp=1637345466501, forceDeactivation=true], allowMerge=false, exchangeFreeSwitch=false] [21:11:06] : [Step 4/5] [2021-11-19 21:11:06,507][INFO ][disco-notifier-worker-#22646%grid-1%][GridClusterStateProcessor] Received activate cluster request with BaselineTopology[id=0] initiator node ID: 00cc6e6a-4c24-4160-839c-0647b4274000 [21:11:06] : [Step 4/5] [2021-11-19 21:11:06,507][INFO ][exchange-worker-#22532%grid-0%][GridDhtPartitionsExchangeFuture] Start activation process [nodeId=00cc6e6a-4c24-4160-839c-0647b4274000, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]]. New state: ACTIVE [21:11:06] : [Step 4/5] [2021-11-19 21:11:06,508][INFO ][disco-notifier-worker-#22646%grid-1%][GridClusterStateProcessor] Started state transition: activate cluster [21:11:06] : [Step 4/5] [2021-11-19 21:11:06,508][INFO ][exchange-worker-#22532%grid-0%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0 [21:11:06] : [Step 4/5] [2021-11-19 21:11:06,509][INFO ][exchange-worker-#22655%grid-1%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], crd=false, evt=DISCOVERY_CUSTOM_EVT, evtNode=00cc6e6a-4c24-4160-839c-0647b4274000, customEvt=ChangeGlobalStateMessage [id=0aa8d593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqId=8a4ddf2e-739b-45f5-afeb-2c6d5ace5b4d, initiatingNodeId=00cc6e6a-4c24-4160-839c-0647b4274000, state=ACTIVE, baselineTopology=BaselineTopology [id=0, branchingHash=-2475315501, branchingType='New BaselineTopology', baselineNodes=[grid-1, grid-0]], forceChangeBaselineTopology=false, timestamp=1637345466501, forceDeactivation=true], allowMerge=false, exchangeFreeSwitch=false] [21:11:06] : [Step 4/5] [2021-11-19 21:11:06,511][INFO ][exchange-worker-#22655%grid-1%][GridDhtPartitionsExchangeFuture] Start activation process [nodeId=10964d2c-60a6-4a30-b458-2fe584a63001, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]]. New state: ACTIVE [21:11:06] : [Step 4/5] [2021-11-19 21:11:06,511][INFO ][exchange-worker-#22655%grid-1%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1 [21:11:06] : [Step 4/5] [2021-11-19 21:11:06,516][INFO ][exchange-worker-#22532%grid-0%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000000.wal, offset=8795, ver=2] [21:11:06] : [Step 4/5] [2021-11-19 21:11:06,517][INFO ][exchange-worker-#22655%grid-1%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000000.wal, offset=8795, ver=2] [21:11:06] : [Step 4/5] [2021-11-19 21:11:06,517][INFO ][exchange-worker-#22532%grid-0%][GridClusterStateProcessor] Writing BaselineTopology[id=0] [21:11:06] : [Step 4/5] [2021-11-19 21:11:06,519][INFO ][exchange-worker-#22655%grid-1%][GridClusterStateProcessor] Writing BaselineTopology[id=0] [21:11:06] : [Step 4/5] [2021-11-19 21:11:06,521][INFO ][exchange-worker-#22532%grid-0%][GridCacheDatabaseSharedManager] Finish recovery performed in 12 ms. [21:11:06] : [Step 4/5] [2021-11-19 21:11:06,523][INFO ][exchange-worker-#22532%grid-0%][msg] Components activation performed in 15 ms. [21:11:06] : [Step 4/5] [2021-11-19 21:11:06,523][INFO ][exchange-worker-#22655%grid-1%][GridCacheDatabaseSharedManager] Finish recovery performed in 11 ms. [21:11:06] : [Step 4/5] [2021-11-19 21:11:06,524][INFO ][exchange-worker-#22655%grid-1%][msg] Components activation performed in 13 ms. [21:11:06] : [Step 4/5] [2021-11-19 21:11:06,524][INFO ][exchange-worker-#22532%grid-0%][GridCacheProcessor] Finished recovery for cache [cache=ignite-sys-cache, grp=ignite-sys-cache, startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:11:06] : [Step 4/5] [2021-11-19 21:11:06,524][INFO ][exchange-worker-#22655%grid-1%][GridCacheProcessor] Finished recovery for cache [cache=ignite-sys-cache, grp=ignite-sys-cache, startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:11:06] : [Step 4/5] [2021-11-19 21:11:06,525][INFO ][exchange-worker-#22532%grid-0%][GridDhtPartitionsExchangeFuture] Successfully activated caches [nodeId=00cc6e6a-4c24-4160-839c-0647b4274000, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], newState=ACTIVE] [21:11:06] : [Step 4/5] [2021-11-19 21:11:06,526][INFO ][exchange-worker-#22655%grid-1%][GridDhtPartitionsExchangeFuture] Successfully activated caches [nodeId=10964d2c-60a6-4a30-b458-2fe584a63001, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], newState=ACTIVE] [21:11:06] : [Step 4/5] [2021-11-19 21:11:06,526][INFO ][exchange-worker-#22532%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:11:06] : [Step 4/5] [2021-11-19 21:11:06,527][INFO ][exchange-worker-#22655%grid-1%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:11:06] : [Step 4/5] [2021-11-19 21:11:06,559][INFO ][exchange-worker-#22532%grid-0%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], crd=true] [21:11:06] : [Step 4/5] [2021-11-19 21:11:06,561][INFO ][grid-nio-worker-tcp-comm-0-#22470%TestRecordingCommunicationSpi%][TestRecordingCommunicationSpi] Accepted incoming communication connection [locAddr=/127.0.0.1:47100, rmtAddr=/127.0.0.1:33562] [21:11:06] : [Step 4/5] [2021-11-19 21:11:06,563][INFO ][grid-nio-worker-tcp-comm-0-#22589%TestRecordingCommunicationSpi%][TestRecordingCommunicationSpi] Established outgoing communication connection [locAddr=/127.0.0.1:33562, rmtAddr=/127.0.0.1:47100] [21:11:06] : [Step 4/5] [2021-11-19 21:11:06,564][INFO ][exchange-worker-#22655%grid-1%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], crd=false] [21:11:06] : [Step 4/5] [2021-11-19 21:11:06,567][INFO ][sys-#22514%grid-0%][GridDhtPartitionsExchangeFuture] Coordinator received single message [ver=AffinityTopologyVersion [topVer=2, minorTopVer=1], node=10964d2c-60a6-4a30-b458-2fe584a63001, allReceived=true] [21:11:06] : [Step 4/5] [2021-11-19 21:11:06,568][INFO ][sys-#22514%grid-0%][GridDhtPartitionsExchangeFuture] finishExchangeOnCoordinator [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:11:06] : [Step 4/5] [2021-11-19 21:11:06,572][INFO ][sys-#22514%grid-0%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], err=null, rebalanced=true, wasRebalanced=false] [21:11:06] : [Step 4/5] [2021-11-19 21:11:06,573][INFO ][disco-notifier-worker-#22527%grid-0%][GridClusterStateProcessor] Received state change finish message: ACTIVE [21:11:06] : [Step 4/5] [2021-11-19 21:11:06,575][INFO ][disco-notifier-worker-#22646%grid-1%][GridClusterStateProcessor] Received state change finish message: ACTIVE [21:11:06] : [Step 4/5] [2021-11-19 21:11:06,575][INFO ][sys-#22623%grid-1%][GridDhtPartitionsExchangeFuture] Received full message, will finish exchange [node=00cc6e6a-4c24-4160-839c-0647b4274000, resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:11:06] : [Step 4/5] [2021-11-19 21:11:06,577][INFO ][sys-#22514%grid-0%][GridCacheProcessor] Finish proxy initialization, cacheName=ignite-sys-cache, localNodeId=00cc6e6a-4c24-4160-839c-0647b4274000 [21:11:06] : [Step 4/5] [2021-11-19 21:11:06,576][INFO ][sys-#22641%grid-1%][GridCachePartitionExchangeManager] Delay process full message without exchange id (there is exchange in progress) [nodeId=00cc6e6a-4c24-4160-839c-0647b4274000] [21:11:06] : [Step 4/5] [2021-11-19 21:11:06,576][INFO ][disco-notifier-worker-#22646%grid-1%][GridClusterStateProcessor] Cluster state was changed from INACTIVE to ACTIVE [21:11:06] : [Step 4/5] [2021-11-19 21:11:06,576][INFO ][disco-notifier-worker-#22527%grid-0%][GridClusterStateProcessor] Cluster state was changed from INACTIVE to ACTIVE [21:11:06] : [Step 4/5] [2021-11-19 21:11:06,579][INFO ][sys-#22505%grid-0%][DistributedBaselineConfiguration] Baseline auto-adjust is 'disabled' with timeout='300000' ms [21:11:06] : [Step 4/5] [2021-11-19 21:11:06,579][INFO ][sys-#22623%grid-1%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], err=null, rebalanced=true, wasRebalanced=false] [21:11:06] : [Step 4/5] [2021-11-19 21:11:06,580][INFO ][sys-#22505%grid-0%][GridClusterStateProcessor] Successfully performed final activation steps [nodeId=00cc6e6a-4c24-4160-839c-0647b4274000, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:11:06] : [Step 4/5] [2021-11-19 21:11:06,586][INFO ][sys-#22623%grid-1%][GridCacheProcessor] Finish proxy initialization, cacheName=ignite-sys-cache, localNodeId=10964d2c-60a6-4a30-b458-2fe584a63001 [21:11:06] : [Step 4/5] [2021-11-19 21:11:06,584][INFO ][exchange-worker-#22532%grid-0%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=2, minorTopVer=1], force=false, evt=DISCOVERY_CUSTOM_EVT, node=00cc6e6a-4c24-4160-839c-0647b4274000] [21:11:06] : [Step 4/5] [2021-11-19 21:11:06,580][INFO ][sys-#22514%grid-0%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=00cc6e6a-4c24-4160-839c-0647b4274000, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=00cc6e6a-4c24-4160-839c-0647b4274000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345466570, loc=true, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:11:06] : [Step 4/5] [2021-11-19 21:11:06,603][INFO ][test-runner-#22415%encryption.CacheGroupKeyChangeTest%][root] awaitPartitionMapExchange finished [21:11:06] : [Step 4/5] [2021-11-19 21:11:06,603][INFO ][sys-#22623%grid-1%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=10964d2c-60a6-4a30-b458-2fe584a63001, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=00cc6e6a-4c24-4160-839c-0647b4274000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345466458, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:11:06] : [Step 4/5] [2021-11-19 21:11:06,603][INFO ][exchange-worker-#22655%grid-1%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=2, minorTopVer=1], force=false, evt=DISCOVERY_CUSTOM_EVT, node=00cc6e6a-4c24-4160-839c-0647b4274000] [21:11:06] : [Step 4/5] [2021-11-19 21:11:06,603][INFO ][db-checkpoint-thread-#22667%grid-1%][Checkpointer] Checkpoint started [checkpointId=57db2bf3-239c-4e43-8b94-1803c27d9879, startPtr=WALPointer [idx=0, fileOff=86677, len=1963], checkpointBeforeLockTime=22ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=6ms, writeCheckpointEntryDuration=37ms, splitAndSortCpPagesDuration=0ms, pages=18, reason='node started'] [21:11:06] : [Step 4/5] [2021-11-19 21:11:06,603][INFO ][db-checkpoint-thread-#22666%grid-0%][Checkpointer] Checkpoint started [checkpointId=755908ec-a66c-4187-bcd4-dbd6683f8fa2, startPtr=WALPointer [idx=0, fileOff=86677, len=1963], checkpointBeforeLockTime=22ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=6ms, writeCheckpointEntryDuration=37ms, splitAndSortCpPagesDuration=0ms, pages=18, reason='node started'] [21:11:06] : [Step 4/5] [2021-11-19 21:11:06,602][INFO ][sys-#22625%grid-1%][DistributedBaselineConfiguration] Baseline auto-adjust is 'disabled' with timeout='300000' ms [21:11:06] : [Step 4/5] [2021-11-19 21:11:06,606][INFO ][sys-#22623%grid-1%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (1 ms), stage="Update caches registry" (13 ms), stage="Start caches" (1 ms), stage="Affinity initialization on cache group start" (0 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Restore partition states" (0 ms), stage="After states restored callback" (31 ms), stage="WAL history reservation" (0 ms), stage="Waiting for Full message" (16 ms), stage="Affinity recalculation" (2 ms), stage="Full map updating" (1 ms), stage="Detect lost partitions" (5 ms), stage="Exchange done" (21 ms), stage="Total time" (91 ms)] [21:11:06] : [Step 4/5] [2021-11-19 21:11:06,604][INFO ][sys-#22514%grid-0%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (1 ms), stage="Update caches registry" (16 ms), stage="Start caches" (1 ms), stage="Affinity initialization on cache group start" (0 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Restore partition states" (0 ms), stage="After states restored callback" (31 ms), stage="WAL history reservation" (0 ms), stage="Waiting for all single messages" (8 ms), stage="Affinity recalculation (crd)" (0 ms), stage="Collect update counters and create affinity messages" (0 ms), stage="Assign partitions states" (0 ms), stage="Validate partitions states" (0 ms), stage="Ideal affinity diff calculation (enforced)" (0 ms), stage="Apply update counters" (0 ms), stage="Full message preparing" (2 ms), stage="Full message sending" (0 ms), stage="State finish message sending" (0 ms), stage="Detect lost partitions" (3 ms), stage="Exchange done" (28 ms), stage="Total time" (90 ms), Discovery lag=3 ms, Latest started node id=10964d2c-60a6-4a30-b458-2fe584a63001] [21:11:06] : [Step 4/5] [2021-11-19 21:11:06,610][INFO ][sys-#22623%grid-1%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], stage="Affinity initialization on cache group start [grp=ignite-sys-cache]" (0 ms) (parent=Affinity initialization on cache group start), stage="Affinity centralized initialization (crd) [grp=ignite-sys-cache, crd=false]" (0 ms) (parent=Determine exchange type), stage="Restore partition states [grp=ignite-sys-cache]" (0 ms) (parent=Restore partition states), stage="Affinity applying from full message [grp=ignite-sys-cache]" (2 ms) (parent=Affinity recalculation)] [21:11:06] : [Step 4/5] [2021-11-19 21:11:06,608][INFO ][sys-#22625%grid-1%][GridClusterStateProcessor] Successfully performed final activation steps [nodeId=10964d2c-60a6-4a30-b458-2fe584a63001, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:11:06] : [Step 4/5] [2021-11-19 21:11:06,612][INFO ][exchange-worker-#22655%grid-1%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], crd=false, evt=DISCOVERY_CUSTOM_EVT, evtNode=00cc6e6a-4c24-4160-839c-0647b4274000, customEvt=DynamicCacheChangeBatch [id=4ca8d593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqs=ArrayList [DynamicCacheChangeRequest [cacheName=encrypted, hasCfg=true, nodeId=00cc6e6a-4c24-4160-839c-0647b4274000, clientStartOnly=false, stop=false, destroy=false, disabledAfterStart=false]], exchangeActions=ExchangeActions [startCaches=[encrypted], stopCaches=null, startGrps=[encrypted], stopGrps=[], resetParts=null, stateChangeRequest=null], startCaches=false], allowMerge=false, exchangeFreeSwitch=false] [21:11:06] : [Step 4/5] [2021-11-19 21:11:06,612][INFO ][exchange-worker-#22532%grid-0%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], crd=true, evt=DISCOVERY_CUSTOM_EVT, evtNode=00cc6e6a-4c24-4160-839c-0647b4274000, customEvt=DynamicCacheChangeBatch [id=4ca8d593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqs=ArrayList [DynamicCacheChangeRequest [cacheName=encrypted, hasCfg=true, nodeId=00cc6e6a-4c24-4160-839c-0647b4274000, clientStartOnly=false, stop=false, destroy=false, disabledAfterStart=false]], exchangeActions=ExchangeActions [startCaches=[encrypted], stopCaches=null, startGrps=[encrypted], stopGrps=[], resetParts=null, stateChangeRequest=null], startCaches=false], allowMerge=false, exchangeFreeSwitch=false] [21:11:06] : [Step 4/5] [2021-11-19 21:11:06,611][INFO ][sys-#22514%grid-0%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], stage="Affinity initialization on cache group start [grp=ignite-sys-cache]" (0 ms) (parent=Affinity initialization on cache group start), stage="Affinity centralized initialization (crd) [grp=ignite-sys-cache, crd=true]" (0 ms) (parent=Determine exchange type), stage="Restore partition states [grp=ignite-sys-cache]" (0 ms) (parent=Restore partition states), stage="Affinity recalculation (partitions availability) [grp=ignite-sys-cache]" (0 ms) (parent=Ideal affinity diff calculation (enforced))] [21:11:06] : [Step 4/5] [2021-11-19 21:11:06,615][INFO ][exchange-worker-#22655%grid-1%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:11:06] : [Step 4/5] [2021-11-19 21:11:06,617][INFO ][exchange-worker-#22532%grid-0%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:11:06] : [Step 4/5] [2021-11-19 21:11:06,622][INFO ][exchange-worker-#22655%grid-1%][GridCacheProcessor] Started cache [name=encrypted, id=1613773252, dataRegionName=default, mode=PARTITIONED, atomicity=ATOMIC, backups=0, mvcc=false] [21:11:06] : [Step 4/5] [2021-11-19 21:11:06,623][INFO ][exchange-worker-#22532%grid-0%][GridCacheProcessor] Started cache [name=encrypted, id=1613773252, dataRegionName=default, mode=PARTITIONED, atomicity=ATOMIC, backups=0, mvcc=false] [21:11:06] : [Step 4/5] [2021-11-19 21:11:06,623][INFO ][exchange-worker-#22655%grid-1%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], waitTime=0ms, futInfo=NA, mode=DISTRIBUTED] [21:11:06] : [Step 4/5] [2021-11-19 21:11:06,623][INFO ][exchange-worker-#22532%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], waitTime=0ms, futInfo=NA, mode=DISTRIBUTED] [21:11:06] : [Step 4/5] [2021-11-19 21:11:06,624][INFO ][exchange-worker-#22532%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partitions release latch: ServerLatch [permits=0, pendingAcks=HashSet [], super=CompletableLatch [id=CompletableLatchUid [id=exchange, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2]]]] [21:11:06] : [Step 4/5] [2021-11-19 21:11:06,624][INFO ][exchange-worker-#22655%grid-1%][GridDhtPartitionsExchangeFuture] Finished waiting for partitions release latch: ClientLatch [coordinator=TcpDiscoveryNode [id=00cc6e6a-4c24-4160-839c-0647b4274000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345466458, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], ackSent=true, super=CompletableLatch [id=CompletableLatchUid [id=exchange, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2]]]] [21:11:06] : [Step 4/5] [2021-11-19 21:11:06,647][INFO ][exchange-worker-#22532%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:11:06] : [Step 4/5] [2021-11-19 21:11:06,648][INFO ][exchange-worker-#22655%grid-1%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:11:06] : [Step 4/5] [2021-11-19 21:11:06,649][INFO ][exchange-worker-#22532%grid-0%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], crd=true] [21:11:06] : [Step 4/5] [2021-11-19 21:11:06,650][INFO ][exchange-worker-#22655%grid-1%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], crd=false] [21:11:06] : [Step 4/5] [2021-11-19 21:11:06,650][INFO ][sys-#22512%grid-0%][GridDhtPartitionsExchangeFuture] Coordinator received single message [ver=AffinityTopologyVersion [topVer=2, minorTopVer=2], node=10964d2c-60a6-4a30-b458-2fe584a63001, allReceived=true] [21:11:06] : [Step 4/5] [2021-11-19 21:11:06,651][INFO ][sys-#22512%grid-0%][GridDhtPartitionsExchangeFuture] finishExchangeOnCoordinator [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2]] [21:11:06] : [Step 4/5] [2021-11-19 21:11:06,653][INFO ][sys-#22512%grid-0%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], err=null, rebalanced=true, wasRebalanced=true] [21:11:06] : [Step 4/5] [2021-11-19 21:11:06,654][INFO ][sys-#22512%grid-0%][GridCacheProcessor] Finish proxy initialization, cacheName=encrypted, localNodeId=00cc6e6a-4c24-4160-839c-0647b4274000 [21:11:06] : [Step 4/5] [2021-11-19 21:11:06,654][INFO ][sys-#22629%grid-1%][GridDhtPartitionsExchangeFuture] Received full message, will finish exchange [node=00cc6e6a-4c24-4160-839c-0647b4274000, resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2]] [21:11:06] : [Step 4/5] [2021-11-19 21:11:06,654][INFO ][exchange-worker-#22532%grid-0%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=2, minorTopVer=2], force=false, evt=DISCOVERY_CUSTOM_EVT, node=00cc6e6a-4c24-4160-839c-0647b4274000] [21:11:06] : [Step 4/5] [2021-11-19 21:11:06,654][INFO ][sys-#22512%grid-0%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=00cc6e6a-4c24-4160-839c-0647b4274000, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=00cc6e6a-4c24-4160-839c-0647b4274000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345466604, loc=true, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2]] [21:11:06] : [Step 4/5] [2021-11-19 21:11:06,656][INFO ][sys-#22629%grid-1%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], err=null, rebalanced=true, wasRebalanced=true] [21:11:06] : [Step 4/5] [2021-11-19 21:11:06,657][INFO ][sys-#22512%grid-0%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (3 ms), stage="Update caches registry" (0 ms), stage="Start caches" (7 ms), stage="Affinity initialization on cache group start" (0 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Wait partitions release latch [latch=exchange]" (22 ms), stage="Wait partitions release [latch=exchange]" (1 ms), stage="Restore partition states" (0 ms), stage="After states restored callback" (0 ms), stage="WAL history reservation" (0 ms), stage="Waiting for all single messages" (1 ms), stage="Affinity recalculation (crd)" (0 ms), stage="Collect update counters and create affinity messages" (0 ms), stage="Assign partitions states" (0 ms), stage="Validate partitions states" (0 ms), stage="Apply update counters" (0 ms), stage="Full message preparing" (1 ms), stage="Full message sending" (0 ms), stage="Exchange done" (4 ms), stage="Total time" (39 ms)] [21:11:06] : [Step 4/5] [2021-11-19 21:11:06,658][INFO ][sys-#22629%grid-1%][GridCacheProcessor] Finish proxy initialization, cacheName=encrypted, localNodeId=10964d2c-60a6-4a30-b458-2fe584a63001 [21:11:06] : [Step 4/5] [2021-11-19 21:11:06,660][INFO ][sys-#22512%grid-0%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], stage="Affinity initialization on cache group start [grp=encrypted]" (0 ms) (parent=Affinity initialization on cache group start), stage="Restore partition states [grp=ignite-sys-cache]" (0 ms) (parent=Restore partition states), stage="Restore partition states [grp=encrypted]" (0 ms) (parent=Restore partition states)] [21:11:06] : [Step 4/5] [2021-11-19 21:11:06,660][INFO ][exchange-worker-#22655%grid-1%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=2, minorTopVer=2], force=false, evt=DISCOVERY_CUSTOM_EVT, node=00cc6e6a-4c24-4160-839c-0647b4274000] [21:11:06] : [Step 4/5] [2021-11-19 21:11:06,660][INFO ][sys-#22629%grid-1%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=10964d2c-60a6-4a30-b458-2fe584a63001, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=00cc6e6a-4c24-4160-839c-0647b4274000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345466458, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2]] [21:11:06] : [Step 4/5] [2021-11-19 21:11:06,663][INFO ][sys-#22629%grid-1%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (1 ms), stage="Update caches registry" (0 ms), stage="Start caches" (8 ms), stage="Affinity initialization on cache group start" (0 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Wait partitions release latch [latch=exchange]" (24 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Restore partition states" (0 ms), stage="After states restored callback" (0 ms), stage="WAL history reservation" (0 ms), stage="Waiting for Full message" (4 ms), stage="Affinity recalculation" (0 ms), stage="Full map updating" (1 ms), stage="Exchange done" (6 ms), stage="Total time" (44 ms)] [21:11:06] : [Step 4/5] [2021-11-19 21:11:06,665][INFO ][sys-#22629%grid-1%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], stage="Affinity initialization on cache group start [grp=encrypted]" (0 ms) (parent=Affinity initialization on cache group start), stage="Restore partition states [grp=ignite-sys-cache]" (0 ms) (parent=Restore partition states), stage="Restore partition states [grp=encrypted]" (0 ms) (parent=Restore partition states)] [21:11:06] : [Step 4/5] [2021-11-19 21:11:06,935][INFO ][disco-notifier-worker-#22646%grid-1%][IgniteTestResources] Block message [node=00cc6e6a-4c24-4160-839c-0647b4274000, order=1, msg=org.apache.ignite.internal.util.distributed.SingleNodeMessage@5db8cfb4] [21:11:06] : [Step 4/5] [2021-11-19 21:11:06,938][INFO ][exchange-worker-#22532%grid-0%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=3], crd=true, evt=DISCOVERY_CUSTOM_EVT, evtNode=00cc6e6a-4c24-4160-839c-0647b4274000, customEvt=DynamicCacheChangeBatch [id=38b8d593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqs=ArrayList [DynamicCacheChangeRequest [cacheName=cache1, hasCfg=true, nodeId=00cc6e6a-4c24-4160-839c-0647b4274000, clientStartOnly=false, stop=false, destroy=false, disabledAfterStart=false]], exchangeActions=ExchangeActions [startCaches=[cache1], stopCaches=null, startGrps=[cache1], stopGrps=[], resetParts=null, stateChangeRequest=null], startCaches=false], allowMerge=false, exchangeFreeSwitch=false] [21:11:06] : [Step 4/5] [2021-11-19 21:11:06,938][INFO ][exchange-worker-#22655%grid-1%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=3], crd=false, evt=DISCOVERY_CUSTOM_EVT, evtNode=00cc6e6a-4c24-4160-839c-0647b4274000, customEvt=DynamicCacheChangeBatch [id=38b8d593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqs=ArrayList [DynamicCacheChangeRequest [cacheName=cache1, hasCfg=true, nodeId=00cc6e6a-4c24-4160-839c-0647b4274000, clientStartOnly=false, stop=false, destroy=false, disabledAfterStart=false]], exchangeActions=ExchangeActions [startCaches=[cache1], stopCaches=null, startGrps=[cache1], stopGrps=[], resetParts=null, stateChangeRequest=null], startCaches=false], allowMerge=false, exchangeFreeSwitch=false] [21:11:06] : [Step 4/5] [2021-11-19 21:11:06,943][INFO ][exchange-worker-#22532%grid-0%][GridCacheProcessor] Started cache [name=cache1, id=-1368047377, dataRegionName=default, mode=PARTITIONED, atomicity=ATOMIC, backups=0, mvcc=false] [21:11:06] : [Step 4/5] [2021-11-19 21:11:06,943][INFO ][exchange-worker-#22655%grid-1%][GridCacheProcessor] Started cache [name=cache1, id=-1368047377, dataRegionName=default, mode=PARTITIONED, atomicity=ATOMIC, backups=0, mvcc=false] [21:11:06] : [Step 4/5] [2021-11-19 21:11:06,944][INFO ][exchange-worker-#22532%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=3], waitTime=0ms, futInfo=NA, mode=DISTRIBUTED] [21:11:06] : [Step 4/5] [2021-11-19 21:11:06,944][INFO ][exchange-worker-#22655%grid-1%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=3], waitTime=0ms, futInfo=NA, mode=DISTRIBUTED] [21:11:06] : [Step 4/5] [2021-11-19 21:11:06,945][INFO ][exchange-worker-#22532%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partitions release latch: ServerLatch [permits=0, pendingAcks=HashSet [], super=CompletableLatch [id=CompletableLatchUid [id=exchange, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=3]]]] [21:11:06] : [Step 4/5] [2021-11-19 21:11:06,946][INFO ][exchange-worker-#22655%grid-1%][GridDhtPartitionsExchangeFuture] Finished waiting for partitions release latch: ClientLatch [coordinator=TcpDiscoveryNode [id=00cc6e6a-4c24-4160-839c-0647b4274000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345466458, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], ackSent=true, super=CompletableLatch [id=CompletableLatchUid [id=exchange, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=3]]]] [21:11:06] : [Step 4/5] [2021-11-19 21:11:06,946][INFO ][exchange-worker-#22532%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=3], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:11:06] : [Step 4/5] [2021-11-19 21:11:06,946][INFO ][exchange-worker-#22655%grid-1%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=3], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:11:06] : [Step 4/5] [2021-11-19 21:11:06,948][INFO ][exchange-worker-#22532%grid-0%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=3], crd=true] [21:11:06] : [Step 4/5] [2021-11-19 21:11:06,949][INFO ][exchange-worker-#22655%grid-1%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=3], crd=false] [21:11:06] : [Step 4/5] [2021-11-19 21:11:06,950][INFO ][sys-#22508%grid-0%][GridDhtPartitionsExchangeFuture] Coordinator received single message [ver=AffinityTopologyVersion [topVer=2, minorTopVer=3], node=10964d2c-60a6-4a30-b458-2fe584a63001, allReceived=true] [21:11:06] : [Step 4/5] [2021-11-19 21:11:06,950][INFO ][sys-#22508%grid-0%][GridDhtPartitionsExchangeFuture] finishExchangeOnCoordinator [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=3], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=3]] [21:11:06] : [Step 4/5] [2021-11-19 21:11:06,952][INFO ][sys-#22508%grid-0%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=3], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=3], err=null, rebalanced=true, wasRebalanced=true] [21:11:06] : [Step 4/5] [2021-11-19 21:11:06,954][INFO ][sys-#22508%grid-0%][GridCacheProcessor] Finish proxy initialization, cacheName=cache1, localNodeId=00cc6e6a-4c24-4160-839c-0647b4274000 [21:11:06] : [Step 4/5] [2021-11-19 21:11:06,955][INFO ][sys-#22508%grid-0%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=00cc6e6a-4c24-4160-839c-0647b4274000, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=3], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=00cc6e6a-4c24-4160-839c-0647b4274000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345466937, loc=true, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=2, minorTopVer=3]] [21:11:06] : [Step 4/5] [2021-11-19 21:11:06,957][INFO ][sys-#22508%grid-0%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=3], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=3], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (1 ms), stage="Update caches registry" (0 ms), stage="Start caches" (3 ms), stage="Affinity initialization on cache group start" (0 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Wait partitions release latch [latch=exchange]" (1 ms), stage="Wait partitions release [latch=exchange]" (1 ms), stage="Restore partition states" (0 ms), stage="After states restored callback" (0 ms), stage="WAL history reservation" (0 ms), stage="Waiting for all single messages" (2 ms), stage="Affinity recalculation (crd)" (0 ms), stage="Collect update counters and create affinity messages" (0 ms), stage="Assign partitions states" (0 ms), stage="Validate partitions states" (0 ms), stage="Apply update counters" (0 ms), stage="Full message preparing" (0 ms), stage="Full message sending" (0 ms), stage="Exchange done" (4 ms), stage="Total time" (12 ms)] [21:11:06] : [Step 4/5] [2021-11-19 21:11:06,955][INFO ][sys-#22645%grid-1%][GridDhtPartitionsExchangeFuture] Received full message, will finish exchange [node=00cc6e6a-4c24-4160-839c-0647b4274000, resVer=AffinityTopologyVersion [topVer=2, minorTopVer=3]] [21:11:06] : [Step 4/5] [2021-11-19 21:11:06,955][INFO ][exchange-worker-#22532%grid-0%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=2, minorTopVer=3], force=false, evt=DISCOVERY_CUSTOM_EVT, node=00cc6e6a-4c24-4160-839c-0647b4274000] [21:11:06] : [Step 4/5] [2021-11-19 21:11:06,959][INFO ][sys-#22508%grid-0%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=3], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=3], stage="Affinity initialization on cache group start [grp=cache1]" (0 ms) (parent=Affinity initialization on cache group start), stage="Restore partition states [grp=ignite-sys-cache]" (0 ms) (parent=Restore partition states), stage="Restore partition states [grp=encrypted]" (0 ms) (parent=Restore partition states), stage="Restore partition states [grp=cache1]" (0 ms) (parent=Restore partition states)] [21:11:06] : [Step 4/5] [2021-11-19 21:11:06,962][INFO ][sys-#22645%grid-1%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=3], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=3], err=null, rebalanced=true, wasRebalanced=true] [21:11:06] : [Step 4/5] [2021-11-19 21:11:06,963][INFO ][sys-#22645%grid-1%][GridCacheProcessor] Finish proxy initialization, cacheName=cache1, localNodeId=10964d2c-60a6-4a30-b458-2fe584a63001 [21:11:06] : [Step 4/5] [2021-11-19 21:11:06,964][INFO ][sys-#22645%grid-1%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=10964d2c-60a6-4a30-b458-2fe584a63001, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=3], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=00cc6e6a-4c24-4160-839c-0647b4274000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345466458, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=2, minorTopVer=3]] [21:11:06] : [Step 4/5] [2021-11-19 21:11:06,964][INFO ][exchange-worker-#22655%grid-1%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=2, minorTopVer=3], force=false, evt=DISCOVERY_CUSTOM_EVT, node=00cc6e6a-4c24-4160-839c-0647b4274000] [21:11:06] : [Step 4/5] [2021-11-19 21:11:06,965][INFO ][sys-#22645%grid-1%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=3], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=3], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (2 ms), stage="Update caches registry" (0 ms), stage="Start caches" (3 ms), stage="Affinity initialization on cache group start" (0 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Wait partitions release latch [latch=exchange]" (1 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Restore partition states" (0 ms), stage="After states restored callback" (0 ms), stage="WAL history reservation" (0 ms), stage="Waiting for Full message" (7 ms), stage="Affinity recalculation" (4 ms), stage="Full map updating" (1 ms), stage="Exchange done" (3 ms), stage="Total time" (21 ms)] [21:11:06] : [Step 4/5] [2021-11-19 21:11:06,967][INFO ][sys-#22645%grid-1%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=3], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=3], stage="Affinity initialization on cache group start [grp=cache1]" (0 ms) (parent=Affinity initialization on cache group start), stage="Restore partition states [grp=ignite-sys-cache]" (0 ms) (parent=Restore partition states), stage="Restore partition states [grp=encrypted]" (0 ms) (parent=Restore partition states), stage="Restore partition states [grp=cache1]" (0 ms) (parent=Restore partition states)] [21:11:07] : [Step 4/5] [2021-11-19 21:11:07,015][INFO ][test-runner-#22415%encryption.CacheGroupKeyChangeTest%][IgniteTestResources] Send blocked message [node=00cc6e6a-4c24-4160-839c-0647b4274000, order=1, msg=org.apache.ignite.internal.util.distributed.SingleNodeMessage@5db8cfb4] [21:11:07] : [Step 4/5] [2021-11-19 21:11:07,019][INFO ][disco-notifier-worker-#22527%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=1] [21:11:07] : [Step 4/5] [2021-11-19 21:11:07,019][INFO ][disco-notifier-worker-#22646%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=1] [21:11:07] : [Step 4/5] [2021-11-19 21:11:07,019][INFO ][reencrypt-#22687%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:11:07] : [Step 4/5] [2021-11-19 21:11:07,020][INFO ][reencrypt-#22688%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:11:07] : [Step 4/5] [2021-11-19 21:11:07,022][INFO ][test-runner-#22415%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10964d2c-60a6-4a30-b458-2fe584a63001, grp=1613773252] [21:11:07] : [Step 4/5] [2021-11-19 21:11:07,761][INFO ][db-checkpoint-thread-#22667%grid-1%][Checkpointer] Checkpoint finished [cpId=57db2bf3-239c-4e43-8b94-1803c27d9879, pages=18, markPos=WALPointer [idx=0, fileOff=86677, len=1963], walSegmentsCovered=[], markDuration=49ms, pagesWrite=3ms, fsync=1151ms, total=1225ms] [21:11:07] : [Step 4/5] [2021-11-19 21:11:07,761][INFO ][db-checkpoint-thread-#22666%grid-0%][Checkpointer] Checkpoint finished [cpId=755908ec-a66c-4187-bcd4-dbd6683f8fa2, pages=18, markPos=WALPointer [idx=0, fileOff=86677, len=1963], walSegmentsCovered=[], markDuration=50ms, pagesWrite=5ms, fsync=1148ms, total=1225ms] [21:11:07] : [Step 4/5] [2021-11-19 21:11:07,946][INFO ][db-checkpoint-thread-#22667%grid-1%][Checkpointer] Checkpoint started [checkpointId=458693a5-c7f2-41ce-81e9-ff30b5a5cd4d, startPtr=WALPointer [idx=0, fileOff=266234, len=2149], checkpointBeforeLockTime=2ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=163ms, writeCheckpointEntryDuration=18ms, splitAndSortCpPagesDuration=0ms, pages=117, reason='test'] [21:11:08] : [Step 4/5] [2021-11-19 21:11:08,933][INFO ][db-checkpoint-thread-#22667%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:11:08] : [Step 4/5] [2021-11-19 21:11:08,933][INFO ][db-checkpoint-thread-#22667%grid-1%][Checkpointer] Checkpoint finished [cpId=458693a5-c7f2-41ce-81e9-ff30b5a5cd4d, pages=117, markPos=WALPointer [idx=0, fileOff=266234, len=2149], walSegmentsCovered=[], markDuration=183ms, pagesWrite=5ms, fsync=981ms, total=1171ms] [21:11:08] : [Step 4/5] [2021-11-19 21:11:08,935][INFO ][test-runner-#22415%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00cc6e6a-4c24-4160-839c-0647b4274000, grp=1613773252] [21:11:08] : [Step 4/5] [2021-11-19 21:11:08,951][INFO ][db-checkpoint-thread-#22666%grid-0%][Checkpointer] Checkpoint started [checkpointId=ec8bcd12-0831-47e8-9ec2-7735ca4851b9, startPtr=WALPointer [idx=0, fileOff=210578, len=2073], checkpointBeforeLockTime=2ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=3ms, writeCheckpointEntryDuration=9ms, splitAndSortCpPagesDuration=1ms, pages=77, reason='test'] [21:11:10] : [Step 4/5] [2021-11-19 21:11:10,702][INFO ][db-checkpoint-thread-#22666%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:11:10] : [Step 4/5] [2021-11-19 21:11:10,702][INFO ][db-checkpoint-thread-#22666%grid-0%][Checkpointer] Checkpoint finished [cpId=ec8bcd12-0831-47e8-9ec2-7735ca4851b9, pages=77, markPos=WALPointer [idx=0, fileOff=210578, len=2073], walSegmentsCovered=[], markDuration=14ms, pagesWrite=4ms, fsync=1747ms, total=1767ms] [21:11:10] : [Step 4/5] [2021-11-19 21:11:10,705][INFO ][test-runner-#22415%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10964d2c-60a6-4a30-b458-2fe584a63001, grp=-1368047377] [21:11:10] : [Step 4/5] [2021-11-19 21:11:10,707][INFO ][test-runner-#22415%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00cc6e6a-4c24-4160-839c-0647b4274000, grp=-1368047377] [21:11:10] : [Step 4/5] [21:11:10] >>> Stopping test: CacheGroupKeyChangeTest#testCacheStartDuringRotation in 6091 ms <<< [21:11:10] : [Step 4/5] [2021-11-19 21:11:10,708][INFO ][main][root] >>> Stopping test: CacheGroupKeyChangeTest#testCacheStartDuringRotation in 6091 ms <<< [21:11:10] : [Step 4/5] [21:11:10] >>> Heap: 468 MB used / 1938 MB commited / 1938 MB max <<< [21:11:10] : [Step 4/5] [2021-11-19 21:11:10,708][INFO ][main][root] >>> Heap: 468 MB used / 1938 MB commited / 1938 MB max <<< [21:11:10] : [Step 4/5] [21:11:10] >>> Non-Heap: 163 MB used / 184 MB commited / 0 MB max <<< [21:11:10] : [Step 4/5] [2021-11-19 21:11:10,709][INFO ][main][root] >>> Non-Heap: 163 MB used / 184 MB commited / 0 MB max <<< [21:11:10] : [Step 4/5] [2021-11-19 21:11:10,709][INFO ][main][root] >>> Stopping grid [name=grid-1, id=10964d2c-60a6-4a30-b458-2fe584a63001] [21:11:10] : [Step 4/5] [2021-11-19 21:11:10,718][INFO ][db-checkpoint-thread-#22667%grid-1%][Checkpointer] Skipping checkpoint (no pages were modified) [checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, reason='timeout'] [21:11:10] : [Step 4/5] [2021-11-19 21:11:10,723][INFO ][tcp-disco-sock-reader-[00cc6e6a 127.0.0.1:49749]-#1191%grid-1%-#22651%grid-1%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:49749, rmtPort=49749, rmtNodeId=00cc6e6a-4c24-4160-839c-0647b4274000] [21:11:10] : [Step 4/5] [2021-11-19 21:11:10,724][INFO ][disco-event-worker-#22531%grid-0%][GridDiscoveryManager] Node left topology: TcpDiscoveryNode [id=10964d2c-60a6-4a30-b458-2fe584a63001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637345466438, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false] [21:11:10] : [Step 4/5] [2021-11-19 21:11:10,725][INFO ][main][GridCacheProcessor] Stopped cache [cacheName=ignite-sys-cache] [21:11:10] : [Step 4/5] [2021-11-19 21:11:10,726][INFO ][main][GridCacheProcessor] Stopped cache [cacheName=encrypted] [21:11:10] : [Step 4/5] [2021-11-19 21:11:10,726][INFO ][disco-event-worker-#22531%grid-0%][GridDiscoveryManager] Topology snapshot [ver=3, locNode=00cc6e6a, servers=1, clients=0, state=ACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=00cc6e6a-4c24-4160-839c-0647b4274000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:11:10] : [Step 4/5] [2021-11-19 21:11:10,726][INFO ][main][GridCacheProcessor] Stopped cache [cacheName=cache1] [21:11:10] : [Step 4/5] [2021-11-19 21:11:10,726][INFO ][disco-event-worker-#22531%grid-0%][GridDiscoveryManager] ^-- Baseline [id=0, size=2, online=1, offline=1] [21:11:10]W: [org.apache.ignite:ignite-core] [2021-11-19 21:11:10,727][WARN ][grid-nio-worker-tcp-comm-0-#22470%TestRecordingCommunicationSpi%][TestRecordingCommunicationSpi] Failed to shutdown socket [21:11:10]W: [org.apache.ignite:ignite-core] java.nio.channels.ClosedChannelException [21:11:10]W: [org.apache.ignite:ignite-core] at sun.nio.ch.SocketChannelImpl.shutdownOutput(SocketChannelImpl.java:795) [21:11:10]W: [org.apache.ignite:ignite-core] at sun.nio.ch.SocketAdaptor.shutdownOutput(SocketAdaptor.java:407) [21:11:10]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.close(IgniteUtils.java:4247) [21:11:10]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.closeKey(GridNioServer.java:2784) [21:11:10]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.close(GridNioServer.java:2835) [21:11:10]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.close(GridNioServer.java:2794) [21:11:10]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.bodyInternal(GridNioServer.java:2157) [21:11:10]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.body(GridNioServer.java:1910) [21:11:10] : [Step 4/5] [2021-11-19 21:11:10,731][INFO ][main][FilePageStoreManager] Cleanup cache stores [total=5, left=0, cleanFiles=false] [21:11:10]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:125) [21:11:10]W: [org.apache.ignite:ignite-core] at java.lang.Thread.run(Thread.java:748) [21:11:10] : [Step 4/5] [2021-11-19 21:11:10,730][INFO ][exchange-worker-#22532%grid-0%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], crd=true, evt=NODE_LEFT, evtNode=10964d2c-60a6-4a30-b458-2fe584a63001, customEvt=null, allowMerge=false, exchangeFreeSwitch=true] [21:11:10] : [Step 4/5] [2021-11-19 21:11:10,733][INFO ][main][GridDeploymentLocalStore] Removed undeployed class: GridDeployment [ts=1637345466570, depMode=SHARED, clsLdr=IsolatedClassLoader{roleName='test'}, clsLdrId=faa8d593d71-10964d2c-60a6-4a30-b458-2fe584a63001, userVer=0, loc=true, sampleClsName=org.apache.ignite.internal.processors.cache.distributed.dht.preloader.IgniteDhtPartitionCountersMap2, pendingUndeploy=false, undeployed=true, usage=0] [21:11:10] : [Step 4/5] [2021-11-19 21:11:10,733][INFO ][sys-#22503%grid-0%][GridAffinityAssignmentCache] Local node affinity assignment distribution is not ideal [cache=encrypted, expectedPrimary=8.00, actualPrimary=3, expectedBackups=0.00, actualBackups=0, warningThreshold=50.00%] [21:11:10] : [Step 4/5] [2021-11-19 21:11:10,733][INFO ][exchange-worker-#22532%grid-0%][GridAffinityAssignmentCache] Local node affinity assignment distribution is not ideal [cache=cache1, expectedPrimary=8.00, actualPrimary=3, expectedBackups=0.00, actualBackups=0, warningThreshold=50.00%] [21:11:10] : [Step 4/5] [2021-11-19 21:11:10,736][INFO ][exchange-worker-#22532%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:11:10] : [Step 4/5] [2021-11-19 21:11:10,738][INFO ][exchange-worker-#22532%grid-0%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], err=null, rebalanced=true, wasRebalanced=true] [21:11:10] : [Step 4/5] [2021-11-19 21:11:10,739][INFO ][main][IgniteKernal%grid-1] [21:11:10] : [Step 4/5] [21:11:10] : [Step 4/5] >>> +------------------------------------------------------+ [21:11:10] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV stopped OK [21:11:10] : [Step 4/5] >>> +------------------------------------------------------+ [21:11:10] : [Step 4/5] >>> Ignite instance name: grid-1 [21:11:10] : [Step 4/5] >>> Grid uptime: 00:00:04.244 [21:11:10] : [Step 4/5] [21:11:10] : [Step 4/5] [21:11:10] : [Step 4/5] [2021-11-19 21:11:10,740][INFO ][main][root] >>> Stopping grid [name=grid-0, id=00cc6e6a-4c24-4160-839c-0647b4274000] [21:11:10]W: [org.apache.ignite:ignite-core] [2021-11-19 21:11:10,745][WARN ][sys-#22510%grid-0%][GridDhtPartitionTopologyImpl] Detected lost partitions [grp=encrypted, parts=[0, 2, 4, 6-7], topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0]] [21:11:10]W: [org.apache.ignite:ignite-core] [2021-11-19 21:11:10,745][WARN ][sys-#22516%grid-0%][GridDhtPartitionTopologyImpl] Detected lost partitions [grp=cache1, parts=[0, 2, 4, 6-7], topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0]] [21:11:10] : [Step 4/5] [2021-11-19 21:11:10,745][INFO ][exchange-worker-#22532%grid-0%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=00cc6e6a-4c24-4160-839c-0647b4274000, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], evt=NODE_LEFT, evtNode=TcpDiscoveryNode [id=10964d2c-60a6-4a30-b458-2fe584a63001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637345466438, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0]] [21:11:10] : [Step 4/5] [2021-11-19 21:11:10,746][INFO ][exchange-worker-#22532%grid-0%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (3 ms), stage="Determine exchange type" (2 ms), stage="Preloading notification" (0 ms), stage="After states restored callback" (1 ms), stage="WAL history reservation" (0 ms), stage="Finalize update counters" (0 ms), stage="Detect lost partitions" (7 ms), stage="Exchange done" (1 ms), stage="Total time" (14 ms)] [21:11:10] : [Step 4/5] [2021-11-19 21:11:10,747][INFO ][exchange-worker-#22532%grid-0%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], stage="Affinity initialization (exchange-free switch on fully-rebalanced topology) [grp=cache1]" (2 ms) (parent=Determine exchange type), stage="Affinity initialization (exchange-free switch on fully-rebalanced topology) [grp=encrypted]" (1 ms) (parent=Determine exchange type), stage="Affinity initialization (exchange-free switch on fully-rebalanced topology) [grp=ignite-sys-cache]" (0 ms) (parent=Determine exchange type)] [21:11:10] : [Step 4/5] [2021-11-19 21:11:10,748][INFO ][exchange-worker-#22532%grid-0%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], crd=true] [21:11:10] : [Step 4/5] [2021-11-19 21:11:10,749][INFO ][exchange-worker-#22532%grid-0%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=3, minorTopVer=0], force=false, evt=NODE_LEFT, node=10964d2c-60a6-4a30-b458-2fe584a63001] [21:11:10] : [Step 4/5] [2021-11-19 21:11:10,752][INFO ][db-checkpoint-thread-#22666%grid-0%][Checkpointer] Skipping checkpoint (no pages were modified) [checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=1ms, checkpointLockHoldTime=1ms, reason='timeout'] [21:11:10]W: [org.apache.ignite:ignite-core] [2021-11-19 21:11:10,756][WARN ][tcp-disco-sock-reader-[10964d2c 127.0.0.1:60947]-#1192%grid-0%-#22652%grid-0%][TestTcpDiscoverySpi] Failed to shutdown socket [21:11:10]W: [org.apache.ignite:ignite-core] java.net.SocketException: Socket is closed [21:11:10]W: [org.apache.ignite:ignite-core] at java.net.Socket.shutdownOutput(Socket.java:1568) [21:11:10]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.close(IgniteUtils.java:4247) [21:11:10]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.discovery.tcp.ServerImpl$SocketReader.body(ServerImpl.java:7370) [21:11:10]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.IgniteSpiThread.run(IgniteSpiThread.java:58) [21:11:10] : [Step 4/5] [2021-11-19 21:11:10,756][INFO ][tcp-disco-sock-reader-[10964d2c 127.0.0.1:60947]-#1192%grid-0%-#22652%grid-0%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:60947, rmtPort=60947, rmtNodeId=10964d2c-60a6-4a30-b458-2fe584a63001] [21:11:10] : [Step 4/5] [2021-11-19 21:11:10,758][INFO ][main][GridCacheProcessor] Stopped cache [cacheName=ignite-sys-cache] [21:11:10] : [Step 4/5] [2021-11-19 21:11:10,758][INFO ][main][GridCacheProcessor] Stopped cache [cacheName=encrypted] [21:11:10] : [Step 4/5] [2021-11-19 21:11:10,758][INFO ][main][GridCacheProcessor] Stopped cache [cacheName=cache1] [21:11:10] : [Step 4/5] [2021-11-19 21:11:10,763][INFO ][main][FilePageStoreManager] Cleanup cache stores [total=5, left=0, cleanFiles=false] [21:11:10] : [Step 4/5] [2021-11-19 21:11:10,764][INFO ][main][GridDeploymentLocalStore] Removed undeployed class: GridDeployment [ts=1637345466560, depMode=SHARED, clsLdr=IsolatedClassLoader{roleName='test'}, clsLdrId=caa8d593d71-00cc6e6a-4c24-4160-839c-0647b4274000, userVer=0, loc=true, sampleClsName=org.apache.ignite.internal.processors.cache.distributed.dht.preloader.GridDhtPartitionMap, pendingUndeploy=false, undeployed=true, usage=0] [21:11:10] : [Step 4/5] [2021-11-19 21:11:10,770][INFO ][main][IgniteKernal%grid-0] [21:11:10] : [Step 4/5] [21:11:10] : [Step 4/5] >>> +------------------------------------------------------+ [21:11:10] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV stopped OK [21:11:10] : [Step 4/5] >>> +------------------------------------------------------+ [21:11:10] : [Step 4/5] >>> Ignite instance name: grid-0 [21:11:10] : [Step 4/5] >>> Grid uptime: 00:00:05.405 [21:11:10] : [Step 4/5] [21:11:10] : [Step 4/5] [21:11:10] : [Step 4/5] [21:11:10] >>> Starting test: CacheGroupKeyChangeTest#testMasterAndCacheGroupKeySimultaneousChange <<< [21:11:10] : [Step 4/5] [2021-11-19 21:11:10,782][INFO ][main][root] >>> Starting test: CacheGroupKeyChangeTest#testMasterAndCacheGroupKeySimultaneousChange <<< [21:11:10] : [Step 4/5] [21:11:10] >>> Heap: 471 MB used / 1938 MB commited / 1938 MB max <<< [21:11:10] : [Step 4/5] [2021-11-19 21:11:10,783][INFO ][main][root] >>> Heap: 471 MB used / 1938 MB commited / 1938 MB max <<< [21:11:10] : [Step 4/5] [21:11:10] >>> Non-Heap: 163 MB used / 184 MB commited / 0 MB max <<< [21:11:10] : [Step 4/5] [2021-11-19 21:11:10,783][INFO ][main][root] >>> Non-Heap: 163 MB used / 184 MB commited / 0 MB max <<< [21:11:10]W: [org.apache.ignite:ignite-core] [2021-11-19 21:11:10,789][WARN ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][G] Ignite work directory is not provided, automatically resolved to: /opt/buildagent/work/7bc1c54bc719b67c/work [21:11:10] : [Step 4/5] [2021-11-19 21:11:10,790][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] [21:11:10] : [Step 4/5] [21:11:10] : [Step 4/5] >>> __________ ________________ [21:11:10] : [Step 4/5] >>> / _/ ___/ |/ / _/_ __/ __/ [21:11:10] : [Step 4/5] >>> _/ // (7 7 // / / / / _/ [21:11:10] : [Step 4/5] >>> /___/\___/_/|_/___/ /_/ /___/ [21:11:10] : [Step 4/5] >>> [21:11:10] : [Step 4/5] >>> ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:11:10] : [Step 4/5] >>> 2021 Copyright(C) Apache Software Foundation [21:11:10] : [Step 4/5] >>> [21:11:10] : [Step 4/5] >>> Ignite documentation: http://ignite.apache.org [21:11:10] : [Step 4/5] [21:11:10] : [Step 4/5] [2021-11-19 21:11:10,791][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] Config URL: n/a [21:11:10] : [Step 4/5] [2021-11-19 21:11:10,792][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] IgniteConfiguration [igniteInstanceName=grid-0, pubPoolSize=24, svcPoolSize=24, callbackPoolSize=24, stripedPoolSize=24, sysPoolSize=24, mgmtPoolSize=4, dataStreamerPoolSize=24, utilityCachePoolSize=24, utilityCacheKeepAliveTime=60000, p2pPoolSize=2, qryPoolSize=24, buildIdxPoolSize=4, igniteHome=/opt/buildagent/work/7bc1c54bc719b67c, igniteWorkDir=/opt/buildagent/work/7bc1c54bc719b67c/work, mbeanSrv=com.sun.jmx.mbeanserver.JmxMBeanServer@6fe85038, nodeId=00a4fdec-fb9a-4106-96a3-cca8453c6000, marsh=BinaryMarshaller [], marshLocJobs=false, daemon=false, p2pEnabled=true, netTimeout=10000, netCompressionLevel=1, sndRetryDelay=1000, sndRetryCnt=3, metricsHistSize=10000, metricsUpdateFreq=1000, metricsExpTime=9223372036854775807, discoSpi=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=0, ackTimeout=0, marsh=null, reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], segPlc=STOP, segResolveAttempts=2, waitForSegOnStart=true, allResolversPassReq=true, segChkFreq=10000, commSpi=TcpCommunicationSpi [connectGate=org.apache.ignite.spi.communication.tcp.internal.ConnectGateway@4aea4aab, ctxInitLatch=java.util.concurrent.CountDownLatch@3981054e[Count = 1], stopping=false, clientPool=null, nioSrvWrapper=null, stateProvider=null], evtSpi=MemoryEventStorageSpi [expireAgeMs=9223372036854775807, expireCnt=10000, filter=null], colSpi=NoopCollisionSpi [], deploySpi=LocalDeploymentSpi [], indexingSpi=org.apache.ignite.spi.indexing.noop.NoopIndexingSpi@50602613, addrRslvr=null, encryptionSpi=org.apache.ignite.spi.encryption.keystore.KeystoreEncryptionSpi@4eccbaec, tracingSpi=org.apache.ignite.spi.tracing.NoopTracingSpi@5d36a4ce, clientMode=false, rebalanceThreadPoolSize=4, rebalanceTimeout=10000, rebalanceBatchesPrefetchCnt=3, rebalanceThrottle=0, rebalanceBatchSize=524288, txCfg=TransactionConfiguration [txSerEnabled=false, dfltIsolation=REPEATABLE_READ, dfltConcurrency=PESSIMISTIC, dfltTxTimeout=0, txTimeoutOnPartitionMapExchange=0, deadlockTimeout=10000, pessimisticTxLogSize=0, pessimisticTxLogLinger=10000, tmLookupClsName=null, txManagerFactory=null, useJtaSync=false], cacheSanityCheckEnabled=true, discoStartupDelay=60000, deployMode=SHARED, p2pMissedCacheSize=100, locHost=127.0.0.1, timeSrvPortBase=31100, timeSrvPortRange=100, failureDetectionTimeout=10000, sysWorkerBlockedTimeout=null, clientFailureDetectionTimeout=10000, metricsLogFreq=0, connectorCfg=null, odbcCfg=null, warmupClos=null, atomicCfg=AtomicConfiguration [seqReserveSize=1000, cacheMode=PARTITIONED, backups=1, aff=null, grpName=null], classLdr=null, sslCtxFactory=null, platformCfg=null, binaryCfg=null, memCfg=null, pstCfg=null, dsCfg=DataStorageConfiguration [sysRegionInitSize=41943040, sysRegionMaxSize=104857600, pageSize=4096, concLvl=0, dfltDataRegConf=DataRegionConfiguration [name=default, maxSize=104857600, initSize=268435456, swapPath=null, pageEvictionMode=DISABLED, pageReplacementMode=CLOCK, evictionThreshold=0.9, emptyPagesPoolSize=100, metricsEnabled=false, metricsSubIntervalCount=5, metricsRateTimeInterval=60000, persistenceEnabled=true, checkpointPageBufSize=0, lazyMemoryAllocation=true, warmUpCfg=null], dataRegions=null, storagePath=null, checkpointFreq=30000, lockWaitTime=10000, checkpointThreads=4, checkpointWriteOrder=SEQUENTIAL, walHistSize=20, maxWalArchiveSize=20971520, walSegments=10, walSegmentSize=1048576, walPath=db/wal, walArchivePath=db/wal/archive, cdcWalPath=db/wal/cdc, cdcEnabled=false, metricsEnabled=false, walMode=LOG_ONLY, walTlbSize=131072, walBuffSize=0, walFlushFreq=2000, walFsyncDelay=1000, walRecordIterBuffSize=67108864, alwaysWriteFullPages=false, fileIOFactory=org.apache.ignite.internal.processors.cache.persistence.file.AsyncFileIOFactory@6a14c2c1, metricsSubIntervalCnt=5, metricsRateTimeInterval=60000, walAutoArchiveAfterInactivity=-1, walForceArchiveTimeout=-1, writeThrottlingEnabled=false, walCompactionEnabled=false, walCompactionLevel=1, checkpointReadLockTimeout=null, walPageCompression=DISABLED, walPageCompressionLevel=null, dfltWarmUpCfg=null, encCfg=org.apache.ignite.configuration.EncryptionConfiguration@9b52f9e, defragmentationThreadPoolSize=4, minWalArchiveSize=-1], snapshotPath=snapshots, activeOnStart=true, activeOnStartPropSetFlag=false, autoActivation=true, autoActivationPropSetFlag=false, clusterStateOnStart=null, sqlConnCfg=null, cliConnCfg=ClientConnectorConfiguration [host=null, port=10800, portRange=100, sockSndBufSize=0, sockRcvBufSize=0, tcpNoDelay=true, maxOpenCursorsPerConn=128, threadPoolSize=24, selectorCnt=12, idleTimeout=0, handshakeTimeout=10000, jdbcEnabled=true, odbcEnabled=true, thinCliEnabled=true, sslEnabled=false, useIgniteSslCtxFactory=true, sslClientAuth=false, sslCtxFactory=null, thinCliCfg=ThinClientConfiguration [maxActiveTxPerConn=100, maxActiveComputeTasksPerConn=0]], mvccVacuumThreadCnt=2, mvccVacuumFreq=5000, authEnabled=false, failureHnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]], commFailureRslvr=null, sqlCfg=SqlConfiguration [longQryWarnTimeout=3000, dfltQryTimeout=0, sqlQryHistSize=1000, validationEnabled=false], asyncContinuationExecutor=null] [21:11:10] : [Step 4/5] [2021-11-19 21:11:10,799][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] Daemon mode: off [21:11:10] : [Step 4/5] [2021-11-19 21:11:10,799][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] OS: Linux 4.15.0-151-generic amd64 [21:11:10] : [Step 4/5] [2021-11-19 21:11:10,799][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] OS user: teamcity [21:11:10] : [Step 4/5] [2021-11-19 21:11:10,799][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] PID: 16724 [21:11:10] : [Step 4/5] [2021-11-19 21:11:10,800][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] Language runtime: Java Platform API Specification ver. 1.8 [21:11:10] : [Step 4/5] [2021-11-19 21:11:10,800][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] VM information: Java(TM) SE Runtime Environment 1.8.0_261-b12 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 25.261-b12 [21:11:10] : [Step 4/5] [2021-11-19 21:11:10,800][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] VM total memory: 1.9GB [21:11:10] : [Step 4/5] [2021-11-19 21:11:10,800][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] Remote Management [restart: off, REST: off, JMX (remote: off)] [21:11:10] : [Step 4/5] [2021-11-19 21:11:10,801][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] Logger: GridTestLog4jLogger [quiet=false, config=null] [21:11:10] : [Step 4/5] [2021-11-19 21:11:10,801][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] IGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c [21:11:10] : [Step 4/5] [2021-11-19 21:11:10,801][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] VM arguments: [-DIGNITE_DUMP_THREADS_ON_FAILURE=false, -DMono=/usr/bin/mono-sgen, -DMono4.0_x64=/usr/lib/mono/4.0, -DMono4.5_x64=/usr/lib/mono/4.5, -DMonoVersion=6.12.0.90, -DSKIP_BUILD=false, -Dagent.home.dir=/opt/buildagent, -Dagent.name=aitc-lin02_03, -Dagent.ownPort=9090, -Dagent.work.dir=/opt/buildagent/work, -Dbuild.number=95, -Dbuild.vcs.number=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.1=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.GitHubApacheIgnite=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dclassworlds.conf=/opt/buildagent/temp/buildTmp/teamcity.m2.conf, -Dcom.jetbrains.maven.watcher.report.file=/opt/buildagent/temp/buildTmp/maven-build-info.xml, -Djava.io.tmpdir=/opt/buildagent/temp/buildTmp, -Dmaven.home=/opt/buildagent/tools/maven3_6, -Dmaven.multiModuleProjectDirectory=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.agent.cpuBenchmark=457, -Dteamcity.agent.dotnet.agent_url=http://localhost:9090/RPC2, -Dteamcity.agent.dotnet.build_id=6278078, -Dteamcity.auth.password=*******, -Dteamcity.auth.userId=TeamCityBuildId=6278078, -Dteamcity.build.changedFiles.file=/opt/buildagent/temp/buildTmp/changedFiles6342607772318147725.txt, -Dteamcity.build.checkoutDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.build.id=6278078, -Dteamcity.build.properties.file=/opt/buildagent/temp/buildTmp/teamcity.build5164517880467851002.properties, -Dteamcity.build.tempDir=/opt/buildagent/temp/buildTmp, -Dteamcity.build.workingDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.buildConfName=Basic 3, -Dteamcity.buildType.id=IgniteTests24Java8_Basic3, -Dteamcity.configuration.properties.file=/opt/buildagent/temp/buildTmp/teamcity.config5591980786735343870.properties, -Dteamcity.maven.userSettings.path=/opt/buildagent/temp/buildTmp/maven_settings_585072866407032347.xml, -Dteamcity.maven.watcher.home=/opt/buildagent/plugins/mavenPlugin/maven-watcher-jdk16, -Dteamcity.projectName=Ignite Tests 2.x (JDK 8/11), -Dteamcity.runner.properties.file=/opt/buildagent/temp/buildTmp/teamcity.runner9098465561618137420.properties, -Dteamcity.tests.recentlyFailedTests.file=/opt/buildagent/temp/buildTmp/testsToRunFirst3891775683130404069.txt, -Dteamcity.version=2021.2 (build 99542), -ea, -Xms2g, -Xmx2g, -XX:+HeapDumpOnOutOfMemoryError, -DIGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_TEST_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_UPDATE_NOTIFIER=false, -DIGNITE_NO_DISCO_ORDER=true, -DIGNITE_PERFORMANCE_SUGGESTIONS_DISABLED=true, -Djava.net.preferIPv4Stack=true, -DTEST_SCALE_FACTOR=1.0, -DIGNITE_TEST_PROP_LOG4J_FILE=log4j-tc-test.xml, -DIGNITE_QUIET=false, -DIGNITE_MARSHAL_BUFFERS_RECHECK=1000, -Dmaven.repo.local=/opt/buildagent/.m2/repository] [21:11:10] : [Step 4/5] [2021-11-19 21:11:10,805][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] System cache's DataRegion size is configured to 40 MB. Use DataStorageConfiguration.systemRegionInitialSize property to change the setting. [21:11:10] : [Step 4/5] [2021-11-19 21:11:10,805][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] Configured caches [in 'sysMemPlc' dataRegion: ['ignite-sys-cache']] [21:11:10]W: [org.apache.ignite:ignite-core] [2021-11-19 21:11:10,805][WARN ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] Peer class loading is enabled (disable it in production for performance and deployment consistency reasons) [21:11:10] : [Step 4/5] [2021-11-19 21:11:10,806][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] 3-rd party licenses can be found at: /opt/buildagent/work/7bc1c54bc719b67c/libs/licenses [21:11:10] : [Step 4/5] [2021-11-19 21:11:10,809][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] Configured plugins: [21:11:10] : [Step 4/5] [2021-11-19 21:11:10,809][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- StanByClusterTestProvider 1.0 [21:11:10] : [Step 4/5] [2021-11-19 21:11:10,809][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:11:10] : [Step 4/5] [2021-11-19 21:11:10,809][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] [21:11:10] : [Step 4/5] [2021-11-19 21:11:10,809][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- PageMemory tracker plugin 1.0 [21:11:10] : [Step 4/5] [2021-11-19 21:11:10,810][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:11:10] : [Step 4/5] [2021-11-19 21:11:10,810][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] [21:11:10] : [Step 4/5] [2021-11-19 21:11:10,810][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- TestDistibutedConfigurationPlugin 1.0 [21:11:10] : [Step 4/5] [2021-11-19 21:11:10,810][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:11:10] : [Step 4/5] [2021-11-19 21:11:10,810][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] [21:11:10] : [Step 4/5] [2021-11-19 21:11:10,810][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- NodeValidationPluginProvider 1.0 [21:11:10] : [Step 4/5] [2021-11-19 21:11:10,811][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:11:10] : [Step 4/5] [2021-11-19 21:11:10,811][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] [21:11:10] : [Step 4/5] [2021-11-19 21:11:10,811][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][FailureProcessor] Configured failure handler: [hnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]]] [21:11:10] : [Step 4/5] [2021-11-19 21:11:10,820][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][TestRecordingCommunicationSpi] Successfully bound communication NIO server to TCP port [port=47100, locHost=/127.0.0.1, selectorsCnt=12, selectorSpins=0, pairedConn=false] [21:11:10]W: [org.apache.ignite:ignite-core] [2021-11-19 21:11:10,820][WARN ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][TestRecordingCommunicationSpi] Message queue limit is set to 0 which may lead to potential OOMEs when running cache operations in FULL_ASYNC or PRIMARY_SYNC modes due to message queues growth on sender and receiver sides. [21:11:10] : [Step 4/5] [2021-11-19 21:11:10,824][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][GridCollisionManager] Collision resolution is disabled (all jobs will be activated upon arrival). [21:11:10] : [Step 4/5] [2021-11-19 21:11:10,824][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] Security status [authentication=off, sandbox=off, tls/ssl=off] [21:11:10] : [Step 4/5] [2021-11-19 21:11:10,881][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:10] : [Step 4/5] [2021-11-19 21:11:10,979][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][MaintenanceProcessor] Resolved store directory for node persistent data: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0 [21:11:10] : [Step 4/5] [2021-11-19 21:11:10,981][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][CacheObjectBinaryProcessorImpl] Resolved directory for serialized binary metadata: /opt/buildagent/work/7bc1c54bc719b67c/work/db/binary_meta/grid_0 [21:11:10] : [Step 4/5] [2021-11-19 21:11:10,986][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0 [21:11:10] : [Step 4/5] [2021-11-19 21:11:10,986][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][FileWriteAheadLogManager] Resolved write ahead log work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0 [21:11:10] : [Step 4/5] [2021-11-19 21:11:10,987][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][FileWriteAheadLogManager] Resolved write ahead log archive directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0 [21:11:11] : [Step 4/5] [2021-11-19 21:11:11,465][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000000.wal [21:11:11] : [Step 4/5] [2021-11-19 21:11:11,466][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][FileHandleManagerImpl] Initialized write-ahead log manager [mode=LOG_ONLY] [21:11:11]W: [org.apache.ignite:ignite-core] [2021-11-19 21:11:11,466][WARN ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] DataRegion maxSize=104.9 MB is smaller than defaultInitialSize=268.4 MB, setting initialSize to 104.9 MB [21:11:11] : [Step 4/5] [2021-11-19 21:11:11,470][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Configured data regions initialized successfully [total=5] [21:11:12] : [Step 4/5] [2021-11-19 21:11:12,000][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][IgniteSnapshotManager] Resolved snapshot work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/snapshots [21:11:12] : [Step 4/5] [2021-11-19 21:11:12,000][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][IgniteSnapshotManager] Resolved temp directory for snapshot creation: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0/snp [21:11:12] : [Step 4/5] [2021-11-19 21:11:12,003][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][ClientListenerProcessor] Client connector processor has started on TCP port 10800 [21:11:12] : [Step 4/5] [2021-11-19 21:11:12,008][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] Non-loopback local IPs: 172.17.0.4 [21:11:12] : [Step 4/5] [2021-11-19 21:11:12,008][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] Enabled local MACs: 0242AC110004 [21:11:12] : [Step 4/5] [2021-11-19 21:11:12,010][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:11:12] : [Step 4/5] [2021-11-19 21:11:12,011][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:11:12] : [Step 4/5] [2021-11-19 21:11:12,011][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:11:12] : [Step 4/5] [2021-11-19 21:11:12,013][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Applying lost metastore updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:11:12] : [Step 4/5] [2021-11-19 21:11:12,014][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=0 ms] [21:11:12] : [Step 4/5] [2021-11-19 21:11:12,014][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Restoring partition state for local groups. [21:11:12] : [Step 4/5] [2021-11-19 21:11:12,014][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=0, partitionsProcessed=0, time=10ms] [21:11:12] : [Step 4/5] [2021-11-19 21:11:12,015][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][GridEncryptionManager] Encryption keys loaded from metastore. [grps=, masterKeyName=ignite.master.key] [21:11:12] : [Step 4/5] [2021-11-19 21:11:12,018][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][ClusterProcessor] Cluster ID and tag has been read from metastorage: null [21:11:12] : [Step 4/5] [2021-11-19 21:11:12,018][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][IgniteClusterImpl] Shutdown policy was updated [oldVal=null, newVal=null] [21:11:12] : [Step 4/5] [2021-11-19 21:11:12,019][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Checkpoint frequency deviation changed [oldVal=null, newVal=null] [21:11:12] : [Step 4/5] [2021-11-19 21:11:12,369][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][FilePageStoreManager] Cleanup cache stores [total=1, left=0, cleanFiles=false] [21:11:12] : [Step 4/5] [2021-11-19 21:11:12,371][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:11:12] : [Step 4/5] [2021-11-19 21:11:12,372][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:11:12] : [Step 4/5] [2021-11-19 21:11:12,372][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:11:12] : [Step 4/5] [2021-11-19 21:11:12,373][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Data Regions Started: 5 [21:11:12] : [Step 4/5] [2021-11-19 21:11:12,373][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] ^-- sysMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:11:12] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:11:12] : [Step 4/5] ^-- default region [type=default, persistence=true, lazyAlloc=true, [21:11:12] : [Step 4/5] ... initCfg=100MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB, allocTotal=0MB] [21:11:12] : [Step 4/5] ^-- metastoreMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:11:12] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:11:12] : [Step 4/5] ^-- TxLog region [type=internal, persistence=true, lazyAlloc=false, [21:11:12] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:11:12] : [Step 4/5] ^-- volatileDsMemPlc region [type=user, persistence=false, lazyAlloc=true, [21:11:12] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB] [21:11:12] : [Step 4/5] ^-- Ignite persistence [used=0MB] [21:11:12] : [Step 4/5] [21:11:12] : [Step 4/5] [2021-11-19 21:11:12,375][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Starting binary memory restore for: [-2100569601] [21:11:12] : [Step 4/5] [2021-11-19 21:11:12,383][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:11:12] : [Step 4/5] [2021-11-19 21:11:12,383][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:11:12] : [Step 4/5] [2021-11-19 21:11:12,385][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000000.wal, offset=0, ver=2] [21:11:12] : [Step 4/5] [2021-11-19 21:11:12,388][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Started cache in recovery mode [name=ignite-sys-cache, id=-2100569601, dataRegionName=sysMemPlc, mode=REPLICATED, atomicity=TRANSACTIONAL, backups=2147483647, mvcc=false] [21:11:12] : [Step 4/5] [2021-11-19 21:11:12,389][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Binary recovery performed in 14 ms. [21:11:12] : [Step 4/5] [2021-11-19 21:11:12,390][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:11:12] : [Step 4/5] [2021-11-19 21:11:12,390][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Applying lost cache updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:11:12] : [Step 4/5] [2021-11-19 21:11:12,391][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=0 ms] [21:11:12] : [Step 4/5] [2021-11-19 21:11:12,392][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Restoring partition state for local groups. [21:11:12] : [Step 4/5] [2021-11-19 21:11:12,397][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=1, partitionsProcessed=100, time=0ms] [21:11:12] : [Step 4/5] [2021-11-19 21:11:12,417][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][TestTcpDiscoverySpi] Successfully bound to TCP port [port=47500, localHost=localhost/127.0.0.1, locNodeId=00a4fdec-fb9a-4106-96a3-cca8453c6000] [21:11:12] : [Step 4/5] [2021-11-19 21:11:12,429][INFO ][disco-notifier-worker-#22803%grid-0%][MvccProcessorImpl] Assigned mvcc coordinator [crd=MvccCoordinator [topVer=AffinityTopologyVersion [topVer=1, minorTopVer=0], nodeId=00a4fdec-fb9a-4106-96a3-cca8453c6000, ver=1637345472419, local=true, initialized=false]] [21:11:12] : [Step 4/5] [2021-11-19 21:11:12,430][INFO ][sys-#22791%grid-0%][ClusterProcessor] Writing cluster ID and tag to metastorage on ready for write ClusterIdAndTag [id=02690bee-7e9f-4e87-a1f5-de8a9ffd50f7, tag=xenodochial_visvesvaraya] [21:11:12] : [Step 4/5] [2021-11-19 21:11:12,433][INFO ][disco-notifier-worker-#22803%grid-0%][ClusterProcessor] xenodochial_visvesvaraya [21:11:12] : [Step 4/5] [2021-11-19 21:11:12,434][INFO ][disco-notifier-worker-#22803%grid-0%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustEnabled' was changed from 'null' to 'false' [21:11:12] : [Step 4/5] [2021-11-19 21:11:12,435][INFO ][disco-notifier-worker-#22803%grid-0%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustTimeout' was changed from 'null' to '300000' [21:11:12] : [Step 4/5] [2021-11-19 21:11:12,436][INFO ][disco-notifier-worker-#22803%grid-0%][IgniteTxManager] Transactions parameter 'longOperationsDumpTimeout' was changed from 'null' to '60000' [21:11:12] : [Step 4/5] [2021-11-19 21:11:12,436][INFO ][disco-notifier-worker-#22803%grid-0%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpThreshold' was changed from 'null' to '0' [21:11:12] : [Step 4/5] [2021-11-19 21:11:12,437][INFO ][disco-notifier-worker-#22803%grid-0%][IgniteTxManager] Transactions parameter 'transactionTimeDumpSamplesCoefficient' was changed from 'null' to '0.0' [21:11:12] : [Step 4/5] [2021-11-19 21:11:12,437][INFO ][disco-notifier-worker-#22803%grid-0%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpSamplesPerSecondLimit' was changed from 'null' to '5' [21:11:12] : [Step 4/5] [2021-11-19 21:11:12,438][INFO ][disco-notifier-worker-#22803%grid-0%][IgniteTxManager] Transactions parameter 'collisionsDumpInterval' was changed from 'null' to '1000' [21:11:12] : [Step 4/5] [2021-11-19 21:11:12,438][INFO ][disco-notifier-worker-#22803%grid-0%][IgniteTxManager] Transactions parameter 'txOwnerDumpRequestsAllowed' was changed from 'null' to 'true' [21:11:12] : [Step 4/5] [2021-11-19 21:11:12,441][INFO ][disco-notifier-worker-#22803%grid-0%][GridCacheDatabaseSharedManager] Historical rebalance WAL threshold changed [property=historical.rebalance.threshold, oldVal=null, newVal=500] [21:11:12] : [Step 4/5] [2021-11-19 21:11:12,442][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] To start Console Management & Monitoring run ignitevisorcmd.{sh|bat} [21:11:12] : [Step 4/5] [2021-11-19 21:11:12,443][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] [21:11:12] : [Step 4/5] [21:11:12] : [Step 4/5] >>> +-------------------------------------------+ [21:11:12] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:11:12] : [Step 4/5] >>> +-------------------------------------------+ [21:11:12] : [Step 4/5] >>> OS name: Linux 4.15.0-151-generic amd64 [21:11:12] : [Step 4/5] >>> CPU(s): 24 [21:11:12] : [Step 4/5] >>> Heap: 2.0GB [21:11:12] : [Step 4/5] >>> VM name: 16724@c4dfe9a430b2 [21:11:12] : [Step 4/5] >>> Ignite instance name: grid-0 [21:11:12] : [Step 4/5] >>> Local node [ID=00A4FDEC-FB9A-4106-96A3-CCA8453C6000, order=1, clientMode=false] [21:11:12] : [Step 4/5] >>> Local node addresses: [127.0.0.1] [21:11:12] : [Step 4/5] >>> Local ports: TCP:10800 TCP:47100 TCP:47500 [21:11:12] : [Step 4/5] [21:11:12] : [Step 4/5] [2021-11-19 21:11:12,444][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] >>> Ignite cluster is in INACTIVE state (limited functionality available). Use control.(sh|bat) script or IgniteCluster.state(ClusterState.ACTIVE) to change the state. [21:11:12] : [Step 4/5] [2021-11-19 21:11:12,445][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][GridDiscoveryManager] Topology snapshot [ver=1, locNode=00a4fdec, servers=1, clients=0, state=INACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=00a4fdec-fb9a-4106-96a3-cca8453c6000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:11:12] : [Step 4/5] [2021-11-19 21:11:12,446][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][G] Node started : [stage="Configure system pool" (0 ms),stage="Start managers" (190 ms),stage="Configure binary metadata" (2 ms),stage="Start processors" (1024 ms),stage="Start 'StanByClusterTestProvider' plugin" (0 ms),stage="Start 'PageMemory tracker plugin' plugin" (0 ms),stage="Start 'TestDistibutedConfigurationPlugin' plugin" (0 ms),stage="Start 'NodeValidationPluginProvider' plugin" (0 ms),stage="Init metastore" (361 ms),stage="Init and start regions" (5 ms),stage="Restore binary memory" (14 ms),stage="Restore logical state" (7 ms),stage="Finish recovery" (18 ms),stage="Join topology" (15 ms),stage="Await transition" (1 ms),stage="Await exchange" (13 ms),stage="Total time" (1650 ms)] [21:11:12] : [Step 4/5] [2021-11-19 21:11:12,448][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][root] Node started with the following configuration [id=00a4fdec-fb9a-4106-96a3-cca8453c6000, marshaller=BinaryMarshaller [], discovery=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=5000, ackTimeout=5000, marsh=JdkMarshaller [clsFilter=org.apache.ignite.marshaller.MarshallerUtils$1@67fd5281], reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], binaryCfg=null, lateAff=true] [21:11:12]W: [org.apache.ignite:ignite-core] [2021-11-19 21:11:12,456][WARN ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][G] Ignite work directory is not provided, automatically resolved to: /opt/buildagent/work/7bc1c54bc719b67c/work [21:11:12] : [Step 4/5] [2021-11-19 21:11:12,457][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] [21:11:12] : [Step 4/5] [21:11:12] : [Step 4/5] >>> __________ ________________ [21:11:12] : [Step 4/5] >>> / _/ ___/ |/ / _/_ __/ __/ [21:11:12] : [Step 4/5] >>> _/ // (7 7 // / / / / _/ [21:11:12] : [Step 4/5] >>> /___/\___/_/|_/___/ /_/ /___/ [21:11:12] : [Step 4/5] >>> [21:11:12] : [Step 4/5] >>> ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:11:12] : [Step 4/5] >>> 2021 Copyright(C) Apache Software Foundation [21:11:12] : [Step 4/5] >>> [21:11:12] : [Step 4/5] >>> Ignite documentation: http://ignite.apache.org [21:11:12] : [Step 4/5] [21:11:12] : [Step 4/5] [2021-11-19 21:11:12,458][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] Config URL: n/a [21:11:12] : [Step 4/5] [2021-11-19 21:11:12,459][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] IgniteConfiguration [igniteInstanceName=grid-1, pubPoolSize=24, svcPoolSize=24, callbackPoolSize=24, stripedPoolSize=24, sysPoolSize=24, mgmtPoolSize=4, dataStreamerPoolSize=24, utilityCachePoolSize=24, utilityCacheKeepAliveTime=60000, p2pPoolSize=2, qryPoolSize=24, buildIdxPoolSize=4, igniteHome=/opt/buildagent/work/7bc1c54bc719b67c, igniteWorkDir=/opt/buildagent/work/7bc1c54bc719b67c/work, mbeanSrv=com.sun.jmx.mbeanserver.JmxMBeanServer@6fe85038, nodeId=10ca909b-1957-42c9-93b4-147fa476d001, marsh=BinaryMarshaller [], marshLocJobs=false, daemon=false, p2pEnabled=true, netTimeout=10000, netCompressionLevel=1, sndRetryDelay=1000, sndRetryCnt=3, metricsHistSize=10000, metricsUpdateFreq=1000, metricsExpTime=9223372036854775807, discoSpi=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=0, ackTimeout=0, marsh=null, reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], segPlc=STOP, segResolveAttempts=2, waitForSegOnStart=true, allResolversPassReq=true, segChkFreq=10000, commSpi=TcpCommunicationSpi [connectGate=org.apache.ignite.spi.communication.tcp.internal.ConnectGateway@41593423, ctxInitLatch=java.util.concurrent.CountDownLatch@1603947e[Count = 1], stopping=false, clientPool=null, nioSrvWrapper=null, stateProvider=null], evtSpi=MemoryEventStorageSpi [expireAgeMs=9223372036854775807, expireCnt=10000, filter=null], colSpi=NoopCollisionSpi [], deploySpi=LocalDeploymentSpi [], indexingSpi=org.apache.ignite.spi.indexing.noop.NoopIndexingSpi@54591106, addrRslvr=null, encryptionSpi=org.apache.ignite.spi.encryption.keystore.KeystoreEncryptionSpi@70b11736, tracingSpi=org.apache.ignite.spi.tracing.NoopTracingSpi@3efc7245, clientMode=false, rebalanceThreadPoolSize=4, rebalanceTimeout=10000, rebalanceBatchesPrefetchCnt=3, rebalanceThrottle=0, rebalanceBatchSize=524288, txCfg=TransactionConfiguration [txSerEnabled=false, dfltIsolation=REPEATABLE_READ, dfltConcurrency=PESSIMISTIC, dfltTxTimeout=0, txTimeoutOnPartitionMapExchange=0, deadlockTimeout=10000, pessimisticTxLogSize=0, pessimisticTxLogLinger=10000, tmLookupClsName=null, txManagerFactory=null, useJtaSync=false], cacheSanityCheckEnabled=true, discoStartupDelay=60000, deployMode=SHARED, p2pMissedCacheSize=100, locHost=127.0.0.1, timeSrvPortBase=31100, timeSrvPortRange=100, failureDetectionTimeout=10000, sysWorkerBlockedTimeout=null, clientFailureDetectionTimeout=10000, metricsLogFreq=0, connectorCfg=null, odbcCfg=null, warmupClos=null, atomicCfg=AtomicConfiguration [seqReserveSize=1000, cacheMode=PARTITIONED, backups=1, aff=null, grpName=null], classLdr=null, sslCtxFactory=null, platformCfg=null, binaryCfg=null, memCfg=null, pstCfg=null, dsCfg=DataStorageConfiguration [sysRegionInitSize=41943040, sysRegionMaxSize=104857600, pageSize=4096, concLvl=0, dfltDataRegConf=DataRegionConfiguration [name=default, maxSize=104857600, initSize=268435456, swapPath=null, pageEvictionMode=DISABLED, pageReplacementMode=CLOCK, evictionThreshold=0.9, emptyPagesPoolSize=100, metricsEnabled=false, metricsSubIntervalCount=5, metricsRateTimeInterval=60000, persistenceEnabled=true, checkpointPageBufSize=0, lazyMemoryAllocation=true, warmUpCfg=null], dataRegions=null, storagePath=null, checkpointFreq=30000, lockWaitTime=10000, checkpointThreads=4, checkpointWriteOrder=SEQUENTIAL, walHistSize=20, maxWalArchiveSize=20971520, walSegments=10, walSegmentSize=1048576, walPath=db/wal, walArchivePath=db/wal/archive, cdcWalPath=db/wal/cdc, cdcEnabled=false, metricsEnabled=false, walMode=LOG_ONLY, walTlbSize=131072, walBuffSize=0, walFlushFreq=2000, walFsyncDelay=1000, walRecordIterBuffSize=67108864, alwaysWriteFullPages=false, fileIOFactory=org.apache.ignite.internal.processors.cache.persistence.file.AsyncFileIOFactory@95ab31b, metricsSubIntervalCnt=5, metricsRateTimeInterval=60000, walAutoArchiveAfterInactivity=-1, walForceArchiveTimeout=-1, writeThrottlingEnabled=false, walCompactionEnabled=false, walCompactionLevel=1, checkpointReadLockTimeout=null, walPageCompression=DISABLED, walPageCompressionLevel=null, dfltWarmUpCfg=null, encCfg=org.apache.ignite.configuration.EncryptionConfiguration@703bcf33, defragmentationThreadPoolSize=4, minWalArchiveSize=-1], snapshotPath=snapshots, activeOnStart=true, activeOnStartPropSetFlag=false, autoActivation=true, autoActivationPropSetFlag=false, clusterStateOnStart=null, sqlConnCfg=null, cliConnCfg=ClientConnectorConfiguration [host=null, port=10800, portRange=100, sockSndBufSize=0, sockRcvBufSize=0, tcpNoDelay=true, maxOpenCursorsPerConn=128, threadPoolSize=24, selectorCnt=12, idleTimeout=0, handshakeTimeout=10000, jdbcEnabled=true, odbcEnabled=true, thinCliEnabled=true, sslEnabled=false, useIgniteSslCtxFactory=true, sslClientAuth=false, sslCtxFactory=null, thinCliCfg=ThinClientConfiguration [maxActiveTxPerConn=100, maxActiveComputeTasksPerConn=0]], mvccVacuumThreadCnt=2, mvccVacuumFreq=5000, authEnabled=false, failureHnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]], commFailureRslvr=null, sqlCfg=SqlConfiguration [longQryWarnTimeout=3000, dfltQryTimeout=0, sqlQryHistSize=1000, validationEnabled=false], asyncContinuationExecutor=null] [21:11:12] : [Step 4/5] [2021-11-19 21:11:12,467][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] Daemon mode: off [21:11:12] : [Step 4/5] [2021-11-19 21:11:12,467][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] OS: Linux 4.15.0-151-generic amd64 [21:11:12] : [Step 4/5] [2021-11-19 21:11:12,467][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] OS user: teamcity [21:11:12] : [Step 4/5] [2021-11-19 21:11:12,468][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] PID: 16724 [21:11:12] : [Step 4/5] [2021-11-19 21:11:12,468][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] Language runtime: Java Platform API Specification ver. 1.8 [21:11:12] : [Step 4/5] [2021-11-19 21:11:12,468][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] VM information: Java(TM) SE Runtime Environment 1.8.0_261-b12 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 25.261-b12 [21:11:12] : [Step 4/5] [2021-11-19 21:11:12,469][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] VM total memory: 1.9GB [21:11:12] : [Step 4/5] [2021-11-19 21:11:12,469][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] Remote Management [restart: off, REST: off, JMX (remote: off)] [21:11:12] : [Step 4/5] [2021-11-19 21:11:12,469][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] Logger: GridTestLog4jLogger [quiet=false, config=null] [21:11:12] : [Step 4/5] [2021-11-19 21:11:12,469][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] IGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c [21:11:12] : [Step 4/5] [2021-11-19 21:11:12,470][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] VM arguments: [-DIGNITE_DUMP_THREADS_ON_FAILURE=false, -DMono=/usr/bin/mono-sgen, -DMono4.0_x64=/usr/lib/mono/4.0, -DMono4.5_x64=/usr/lib/mono/4.5, -DMonoVersion=6.12.0.90, -DSKIP_BUILD=false, -Dagent.home.dir=/opt/buildagent, -Dagent.name=aitc-lin02_03, -Dagent.ownPort=9090, -Dagent.work.dir=/opt/buildagent/work, -Dbuild.number=95, -Dbuild.vcs.number=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.1=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.GitHubApacheIgnite=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dclassworlds.conf=/opt/buildagent/temp/buildTmp/teamcity.m2.conf, -Dcom.jetbrains.maven.watcher.report.file=/opt/buildagent/temp/buildTmp/maven-build-info.xml, -Djava.io.tmpdir=/opt/buildagent/temp/buildTmp, -Dmaven.home=/opt/buildagent/tools/maven3_6, -Dmaven.multiModuleProjectDirectory=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.agent.cpuBenchmark=457, -Dteamcity.agent.dotnet.agent_url=http://localhost:9090/RPC2, -Dteamcity.agent.dotnet.build_id=6278078, -Dteamcity.auth.password=*******, -Dteamcity.auth.userId=TeamCityBuildId=6278078, -Dteamcity.build.changedFiles.file=/opt/buildagent/temp/buildTmp/changedFiles6342607772318147725.txt, -Dteamcity.build.checkoutDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.build.id=6278078, -Dteamcity.build.properties.file=/opt/buildagent/temp/buildTmp/teamcity.build5164517880467851002.properties, -Dteamcity.build.tempDir=/opt/buildagent/temp/buildTmp, -Dteamcity.build.workingDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.buildConfName=Basic 3, -Dteamcity.buildType.id=IgniteTests24Java8_Basic3, -Dteamcity.configuration.properties.file=/opt/buildagent/temp/buildTmp/teamcity.config5591980786735343870.properties, -Dteamcity.maven.userSettings.path=/opt/buildagent/temp/buildTmp/maven_settings_585072866407032347.xml, -Dteamcity.maven.watcher.home=/opt/buildagent/plugins/mavenPlugin/maven-watcher-jdk16, -Dteamcity.projectName=Ignite Tests 2.x (JDK 8/11), -Dteamcity.runner.properties.file=/opt/buildagent/temp/buildTmp/teamcity.runner9098465561618137420.properties, -Dteamcity.tests.recentlyFailedTests.file=/opt/buildagent/temp/buildTmp/testsToRunFirst3891775683130404069.txt, -Dteamcity.version=2021.2 (build 99542), -ea, -Xms2g, -Xmx2g, -XX:+HeapDumpOnOutOfMemoryError, -DIGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_TEST_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_UPDATE_NOTIFIER=false, -DIGNITE_NO_DISCO_ORDER=true, -DIGNITE_PERFORMANCE_SUGGESTIONS_DISABLED=true, -Djava.net.preferIPv4Stack=true, -DTEST_SCALE_FACTOR=1.0, -DIGNITE_TEST_PROP_LOG4J_FILE=log4j-tc-test.xml, -DIGNITE_QUIET=false, -DIGNITE_MARSHAL_BUFFERS_RECHECK=1000, -Dmaven.repo.local=/opt/buildagent/.m2/repository] [21:11:12] : [Step 4/5] [2021-11-19 21:11:12,474][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] System cache's DataRegion size is configured to 40 MB. Use DataStorageConfiguration.systemRegionInitialSize property to change the setting. [21:11:12] : [Step 4/5] [2021-11-19 21:11:12,475][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] Configured caches [in 'sysMemPlc' dataRegion: ['ignite-sys-cache']] [21:11:12]W: [org.apache.ignite:ignite-core] [2021-11-19 21:11:12,475][WARN ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] Peer class loading is enabled (disable it in production for performance and deployment consistency reasons) [21:11:12] : [Step 4/5] [2021-11-19 21:11:12,475][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] 3-rd party licenses can be found at: /opt/buildagent/work/7bc1c54bc719b67c/libs/licenses [21:11:12] : [Step 4/5] [2021-11-19 21:11:12,480][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] Configured plugins: [21:11:12] : [Step 4/5] [2021-11-19 21:11:12,480][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- StanByClusterTestProvider 1.0 [21:11:12] : [Step 4/5] [2021-11-19 21:11:12,481][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:11:12] : [Step 4/5] [2021-11-19 21:11:12,481][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] [21:11:12] : [Step 4/5] [2021-11-19 21:11:12,481][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- PageMemory tracker plugin 1.0 [21:11:12] : [Step 4/5] [2021-11-19 21:11:12,482][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:11:12] : [Step 4/5] [2021-11-19 21:11:12,482][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] [21:11:12] : [Step 4/5] [2021-11-19 21:11:12,482][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- TestDistibutedConfigurationPlugin 1.0 [21:11:12] : [Step 4/5] [2021-11-19 21:11:12,482][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:11:12] : [Step 4/5] [2021-11-19 21:11:12,483][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] [21:11:12] : [Step 4/5] [2021-11-19 21:11:12,483][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- NodeValidationPluginProvider 1.0 [21:11:12] : [Step 4/5] [2021-11-19 21:11:12,483][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:11:12] : [Step 4/5] [2021-11-19 21:11:12,483][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] [21:11:12] : [Step 4/5] [2021-11-19 21:11:12,484][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][FailureProcessor] Configured failure handler: [hnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]]] [21:11:12] : [Step 4/5] [2021-11-19 21:11:12,496][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][TestRecordingCommunicationSpi] Successfully bound communication NIO server to TCP port [port=47101, locHost=/127.0.0.1, selectorsCnt=12, selectorSpins=0, pairedConn=false] [21:11:12]W: [org.apache.ignite:ignite-core] [2021-11-19 21:11:12,496][WARN ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][TestRecordingCommunicationSpi] Message queue limit is set to 0 which may lead to potential OOMEs when running cache operations in FULL_ASYNC or PRIMARY_SYNC modes due to message queues growth on sender and receiver sides. [21:11:12] : [Step 4/5] [2021-11-19 21:11:12,499][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][GridCollisionManager] Collision resolution is disabled (all jobs will be activated upon arrival). [21:11:12] : [Step 4/5] [2021-11-19 21:11:12,500][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] Security status [authentication=off, sandbox=off, tls/ssl=off] [21:11:12] : [Step 4/5] [2021-11-19 21:11:12,560][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:12] : [Step 4/5] [2021-11-19 21:11:12,653][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][MaintenanceProcessor] Resolved store directory for node persistent data: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1 [21:11:12] : [Step 4/5] [2021-11-19 21:11:12,655][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][CacheObjectBinaryProcessorImpl] Resolved directory for serialized binary metadata: /opt/buildagent/work/7bc1c54bc719b67c/work/db/binary_meta/grid_1 [21:11:12] : [Step 4/5] [2021-11-19 21:11:12,659][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1 [21:11:12] : [Step 4/5] [2021-11-19 21:11:12,659][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][FileWriteAheadLogManager] Resolved write ahead log work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1 [21:11:12] : [Step 4/5] [2021-11-19 21:11:12,660][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][FileWriteAheadLogManager] Resolved write ahead log archive directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1 [21:11:12] : [Step 4/5] [2021-11-19 21:11:12,990][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000000.wal [21:11:12] : [Step 4/5] [2021-11-19 21:11:12,993][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][FileHandleManagerImpl] Initialized write-ahead log manager [mode=LOG_ONLY] [21:11:13] : [Step 4/5] [2021-11-19 21:11:12,999][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Configured data regions initialized successfully [total=5] [21:11:13] : [Step 4/5] [2021-11-19 21:11:13,216][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][IgniteSnapshotManager] Resolved snapshot work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/snapshots [21:11:13] : [Step 4/5] [2021-11-19 21:11:13,217][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][IgniteSnapshotManager] Resolved temp directory for snapshot creation: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1/snp [21:11:13] : [Step 4/5] [2021-11-19 21:11:13,219][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][ClientListenerProcessor] Client connector processor has started on TCP port 10801 [21:11:13] : [Step 4/5] [2021-11-19 21:11:13,222][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] Non-loopback local IPs: 172.17.0.4 [21:11:13] : [Step 4/5] [2021-11-19 21:11:13,222][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] Enabled local MACs: 0242AC110004 [21:11:13] : [Step 4/5] [2021-11-19 21:11:13,223][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:11:13] : [Step 4/5] [2021-11-19 21:11:13,224][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:11:13] : [Step 4/5] [2021-11-19 21:11:13,224][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:11:13] : [Step 4/5] [2021-11-19 21:11:13,229][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Applying lost metastore updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:11:13] : [Step 4/5] [2021-11-19 21:11:13,229][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=0 ms] [21:11:13] : [Step 4/5] [2021-11-19 21:11:13,230][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Restoring partition state for local groups. [21:11:13] : [Step 4/5] [2021-11-19 21:11:13,230][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=0, partitionsProcessed=0, time=0ms] [21:11:13] : [Step 4/5] [2021-11-19 21:11:13,231][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][GridEncryptionManager] Encryption keys loaded from metastore. [grps=, masterKeyName=ignite.master.key] [21:11:13] : [Step 4/5] [2021-11-19 21:11:13,232][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][ClusterProcessor] Cluster ID and tag has been read from metastorage: null [21:11:13] : [Step 4/5] [2021-11-19 21:11:13,233][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][IgniteClusterImpl] Shutdown policy was updated [oldVal=null, newVal=null] [21:11:13] : [Step 4/5] [2021-11-19 21:11:13,233][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Checkpoint frequency deviation changed [oldVal=null, newVal=null] [21:11:13] : [Step 4/5] [2021-11-19 21:11:13,249][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][FilePageStoreManager] Cleanup cache stores [total=1, left=0, cleanFiles=false] [21:11:13] : [Step 4/5] [2021-11-19 21:11:13,252][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:11:13] : [Step 4/5] [2021-11-19 21:11:13,252][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:11:13] : [Step 4/5] [2021-11-19 21:11:13,253][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:11:13] : [Step 4/5] [2021-11-19 21:11:13,254][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Data Regions Started: 5 [21:11:13] : [Step 4/5] [2021-11-19 21:11:13,254][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] ^-- sysMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:11:13] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:11:13] : [Step 4/5] ^-- default region [type=default, persistence=true, lazyAlloc=true, [21:11:13] : [Step 4/5] ... initCfg=100MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB, allocTotal=0MB] [21:11:13] : [Step 4/5] ^-- metastoreMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:11:13] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:11:13] : [Step 4/5] ^-- TxLog region [type=internal, persistence=true, lazyAlloc=false, [21:11:13] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:11:13] : [Step 4/5] ^-- volatileDsMemPlc region [type=user, persistence=false, lazyAlloc=true, [21:11:13] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB] [21:11:13] : [Step 4/5] ^-- Ignite persistence [used=0MB] [21:11:13] : [Step 4/5] [21:11:13] : [Step 4/5] [2021-11-19 21:11:13,256][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Starting binary memory restore for: [-2100569601] [21:11:13] : [Step 4/5] [2021-11-19 21:11:13,263][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:11:13] : [Step 4/5] [2021-11-19 21:11:13,263][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:11:13] : [Step 4/5] [2021-11-19 21:11:13,265][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000000.wal, offset=0, ver=2] [21:11:13] : [Step 4/5] [2021-11-19 21:11:13,272][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Started cache in recovery mode [name=ignite-sys-cache, id=-2100569601, dataRegionName=sysMemPlc, mode=REPLICATED, atomicity=TRANSACTIONAL, backups=2147483647, mvcc=false] [21:11:13] : [Step 4/5] [2021-11-19 21:11:13,273][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Binary recovery performed in 17 ms. [21:11:13] : [Step 4/5] [2021-11-19 21:11:13,273][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:11:13] : [Step 4/5] [2021-11-19 21:11:13,273][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Applying lost cache updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:11:13] : [Step 4/5] [2021-11-19 21:11:13,276][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=10 ms] [21:11:13] : [Step 4/5] [2021-11-19 21:11:13,276][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Restoring partition state for local groups. [21:11:13] : [Step 4/5] [2021-11-19 21:11:13,286][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=1, partitionsProcessed=100, time=10ms] [21:11:13] : [Step 4/5] [2021-11-19 21:11:13,294][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][TestTcpDiscoverySpi] Successfully bound to TCP port [port=47501, localHost=localhost/127.0.0.1, locNodeId=10ca909b-1957-42c9-93b4-147fa476d001] [21:11:13] : [Step 4/5] [2021-11-19 21:11:13,297][INFO ][tcp-disco-srvr-[:47500]-#1197%grid-0%-#22805%grid-0%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=37385] [21:11:13] : [Step 4/5] [2021-11-19 21:11:13,298][INFO ][tcp-disco-srvr-[:47500]-#1197%grid-0%-#22805%grid-0%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=37385] [21:11:13] : [Step 4/5] [2021-11-19 21:11:13,298][INFO ][tcp-disco-sock-reader-[]-#1203%grid-0%-#22925%grid-0%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:37385, rmtPort=37385] [21:11:13] : [Step 4/5] [2021-11-19 21:11:13,300][INFO ][tcp-disco-sock-reader-[10ca909b 127.0.0.1:37385]-#1203%grid-0%-#22925%grid-0%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=10ca909b-1957-42c9-93b4-147fa476d001, rmtAddr=/127.0.0.1:37385] [21:11:13] : [Step 4/5] [2021-11-19 21:11:13,306][INFO ][tcp-disco-srvr-[:47501]-#1202%grid-1%-#22924%grid-1%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=49747] [21:11:13] : [Step 4/5] [2021-11-19 21:11:13,307][INFO ][tcp-disco-srvr-[:47501]-#1202%grid-1%-#22924%grid-1%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=49747] [21:11:13] : [Step 4/5] [2021-11-19 21:11:13,307][INFO ][tcp-disco-sock-reader-[]-#1204%grid-1%-#22926%grid-1%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:49747, rmtPort=49747] [21:11:13] : [Step 4/5] [2021-11-19 21:11:13,308][INFO ][tcp-disco-sock-reader-[]-#1204%grid-1%-#22926%grid-1%][TestTcpDiscoverySpi] Received ping request from the remote node [rmtNodeId=00a4fdec-fb9a-4106-96a3-cca8453c6000, rmtAddr=/127.0.0.1:49747, rmtPort=49747] [21:11:13] : [Step 4/5] [2021-11-19 21:11:13,309][INFO ][tcp-disco-sock-reader-[]-#1204%grid-1%-#22926%grid-1%][TestTcpDiscoverySpi] Finished writing ping response [rmtNodeId=00a4fdec-fb9a-4106-96a3-cca8453c6000, rmtAddr=/127.0.0.1:49747, rmtPort=49747] [21:11:13]W: [org.apache.ignite:ignite-core] [2021-11-19 21:11:13,309][WARN ][tcp-disco-sock-reader-[]-#1204%grid-1%-#22926%grid-1%][TestTcpDiscoverySpi] Failed to shutdown socket [21:11:13]W: [org.apache.ignite:ignite-core] java.net.SocketException: Socket output is already shutdown [21:11:13]W: [org.apache.ignite:ignite-core] at java.net.Socket.shutdownOutput(Socket.java:1572) [21:11:13]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.close(IgniteUtils.java:4247) [21:11:13]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.discovery.tcp.ServerImpl$SocketReader.body(ServerImpl.java:7370) [21:11:13]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.IgniteSpiThread.run(IgniteSpiThread.java:58) [21:11:13] : [Step 4/5] [2021-11-19 21:11:13,309][INFO ][tcp-disco-sock-reader-[10ca909b 127.0.0.1:37385]-#1203%grid-0%-#22925%grid-0%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:37385, rmtPort=37385, rmtNodeId=10ca909b-1957-42c9-93b4-147fa476d001] [21:11:13] : [Step 4/5] [2021-11-19 21:11:13,311][INFO ][tcp-disco-sock-reader-[]-#1204%grid-1%-#22926%grid-1%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:49747, rmtPort=49747, rmtNodeId=null] [21:11:13] : [Step 4/5] [2021-11-19 21:11:13,313][INFO ][tcp-disco-msg-worker-[crd]-#1196%grid-0%-#22804%grid-0%][GridEncryptionManager] Joining node doesn't have stored group keys [node=10ca909b-1957-42c9-93b4-147fa476d001] [21:11:13] : [Step 4/5] [2021-11-19 21:11:13,325][INFO ][tcp-disco-msg-worker-[crd]-#1196%grid-0%-#22804%grid-0%][TestTcpDiscoverySpi] New next node [newNext=TcpDiscoveryNode [id=10ca909b-1957-42c9-93b4-147fa476d001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=0, intOrder=2, lastExchangeTime=1637345473295, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false]] [21:11:13] : [Step 4/5] [2021-11-19 21:11:13,326][INFO ][tcp-disco-srvr-[:47501]-#1202%grid-1%-#22924%grid-1%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=51965] [21:11:13] : [Step 4/5] [2021-11-19 21:11:13,326][INFO ][tcp-disco-srvr-[:47501]-#1202%grid-1%-#22924%grid-1%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=51965] [21:11:13] : [Step 4/5] [2021-11-19 21:11:13,327][INFO ][tcp-disco-sock-reader-[]-#1205%grid-1%-#22927%grid-1%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:51965, rmtPort=51965] [21:11:13] : [Step 4/5] [2021-11-19 21:11:13,327][INFO ][tcp-disco-sock-reader-[00a4fdec 127.0.0.1:51965]-#1205%grid-1%-#22927%grid-1%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=00a4fdec-fb9a-4106-96a3-cca8453c6000, rmtAddr=/127.0.0.1:51965] [21:11:13] : [Step 4/5] [2021-11-19 21:11:13,331][INFO ][tcp-disco-msg-worker-[]-#1201%grid-1%-#22923%grid-1%][TestTcpDiscoverySpi] New next node [newNext=TcpDiscoveryNode [id=00a4fdec-fb9a-4106-96a3-cca8453c6000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345473326, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false]] [21:11:13] : [Step 4/5] [2021-11-19 21:11:13,332][INFO ][tcp-disco-srvr-[:47500]-#1197%grid-0%-#22805%grid-0%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=48067] [21:11:13] : [Step 4/5] [2021-11-19 21:11:13,333][INFO ][tcp-disco-srvr-[:47500]-#1197%grid-0%-#22805%grid-0%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=48067] [21:11:13] : [Step 4/5] [2021-11-19 21:11:13,333][INFO ][tcp-disco-sock-reader-[]-#1206%grid-0%-#22928%grid-0%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:48067, rmtPort=48067] [21:11:13] : [Step 4/5] [2021-11-19 21:11:13,334][INFO ][tcp-disco-sock-reader-[10ca909b 127.0.0.1:48067]-#1206%grid-0%-#22928%grid-0%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=10ca909b-1957-42c9-93b4-147fa476d001, rmtAddr=/127.0.0.1:48067] [21:11:13] : [Step 4/5] [2021-11-19 21:11:13,336][INFO ][disco-event-worker-#22807%grid-0%][GridDiscoveryManager] Added new node to topology: TcpDiscoveryNode [id=10ca909b-1957-42c9-93b4-147fa476d001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637345473295, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false] [21:11:13] : [Step 4/5] [2021-11-19 21:11:13,337][INFO ][disco-event-worker-#22807%grid-0%][GridDiscoveryManager] Topology snapshot [ver=2, locNode=00a4fdec, servers=2, clients=0, state=INACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=00a4fdec-fb9a-4106-96a3-cca8453c6000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=10ca909b-1957-42c9-93b4-147fa476d001, consistentId=grid-1, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:11:13] : [Step 4/5] [2021-11-19 21:11:13,339][INFO ][tcp-disco-msg-worker-[00a4fdec 127.0.0.1:47500]-#1201%grid-1%-#22923%grid-1%][ClusterProcessor] xenodochial_visvesvaraya [21:11:13] : [Step 4/5] [2021-11-19 21:11:13,340][INFO ][tcp-disco-msg-worker-[00a4fdec 127.0.0.1:47500]-#1201%grid-1%-#22923%grid-1%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustEnabled' was changed from 'null' to 'false' [21:11:13] : [Step 4/5] [2021-11-19 21:11:13,340][INFO ][tcp-disco-msg-worker-[00a4fdec 127.0.0.1:47500]-#1201%grid-1%-#22923%grid-1%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustTimeout' was changed from 'null' to '300000' [21:11:13] : [Step 4/5] [2021-11-19 21:11:13,340][INFO ][tcp-disco-msg-worker-[00a4fdec 127.0.0.1:47500]-#1201%grid-1%-#22923%grid-1%][IgniteTxManager] Transactions parameter 'longOperationsDumpTimeout' was changed from 'null' to '60000' [21:11:13] : [Step 4/5] [2021-11-19 21:11:13,341][INFO ][tcp-disco-msg-worker-[00a4fdec 127.0.0.1:47500]-#1201%grid-1%-#22923%grid-1%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpThreshold' was changed from 'null' to '0' [21:11:13] : [Step 4/5] [2021-11-19 21:11:13,341][INFO ][tcp-disco-msg-worker-[00a4fdec 127.0.0.1:47500]-#1201%grid-1%-#22923%grid-1%][IgniteTxManager] Transactions parameter 'transactionTimeDumpSamplesCoefficient' was changed from 'null' to '0.0' [21:11:13] : [Step 4/5] [2021-11-19 21:11:13,342][INFO ][tcp-disco-msg-worker-[00a4fdec 127.0.0.1:47500]-#1201%grid-1%-#22923%grid-1%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpSamplesPerSecondLimit' was changed from 'null' to '5' [21:11:13] : [Step 4/5] [2021-11-19 21:11:13,342][INFO ][tcp-disco-msg-worker-[00a4fdec 127.0.0.1:47500]-#1201%grid-1%-#22923%grid-1%][IgniteTxManager] Transactions parameter 'collisionsDumpInterval' was changed from 'null' to '1000' [21:11:13] : [Step 4/5] [2021-11-19 21:11:13,342][INFO ][tcp-disco-msg-worker-[00a4fdec 127.0.0.1:47500]-#1201%grid-1%-#22923%grid-1%][IgniteTxManager] Transactions parameter 'txOwnerDumpRequestsAllowed' was changed from 'null' to 'true' [21:11:13] : [Step 4/5] [2021-11-19 21:11:13,343][INFO ][tcp-disco-msg-worker-[00a4fdec 127.0.0.1:47500]-#1201%grid-1%-#22923%grid-1%][GridCacheDatabaseSharedManager] Historical rebalance WAL threshold changed [property=historical.rebalance.threshold, oldVal=null, newVal=500] [21:11:13] : [Step 4/5] [2021-11-19 21:11:13,343][INFO ][disco-notifier-worker-#22922%grid-1%][MvccProcessorImpl] Assigned mvcc coordinator [crd=MvccCoordinator [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=0], nodeId=00a4fdec-fb9a-4106-96a3-cca8453c6000, ver=1637345472419, local=false, initialized=false]] [21:11:13] : [Step 4/5] [2021-11-19 21:11:13,345][INFO ][sys-#22907%grid-1%][ClusterProcessor] Writing cluster ID and tag to metastorage on ready for write ClusterIdAndTag [id=02690bee-7e9f-4e87-a1f5-de8a9ffd50f7, tag=xenodochial_visvesvaraya] [21:11:13] : [Step 4/5] [2021-11-19 21:11:13,355][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] To start Console Management & Monitoring run ignitevisorcmd.{sh|bat} [21:11:13] : [Step 4/5] [2021-11-19 21:11:13,355][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] [21:11:13] : [Step 4/5] [21:11:13] : [Step 4/5] >>> +-------------------------------------------+ [21:11:13] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:11:13] : [Step 4/5] >>> +-------------------------------------------+ [21:11:13] : [Step 4/5] >>> OS name: Linux 4.15.0-151-generic amd64 [21:11:13] : [Step 4/5] >>> CPU(s): 24 [21:11:13] : [Step 4/5] >>> Heap: 2.0GB [21:11:13] : [Step 4/5] >>> VM name: 16724@c4dfe9a430b2 [21:11:13] : [Step 4/5] >>> Ignite instance name: grid-1 [21:11:13] : [Step 4/5] >>> Local node [ID=10CA909B-1957-42C9-93B4-147FA476D001, order=2, clientMode=false] [21:11:13] : [Step 4/5] >>> Local node addresses: [127.0.0.1] [21:11:13] : [Step 4/5] >>> Local ports: TCP:10801 TCP:47101 TCP:47501 [21:11:13] : [Step 4/5] [21:11:13] : [Step 4/5] [2021-11-19 21:11:13,356][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] >>> Ignite cluster is in INACTIVE state (limited functionality available). Use control.(sh|bat) script or IgniteCluster.state(ClusterState.ACTIVE) to change the state. [21:11:13] : [Step 4/5] [2021-11-19 21:11:13,357][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][GridDiscoveryManager] Topology snapshot [ver=2, locNode=10ca909b, servers=2, clients=0, state=INACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=00a4fdec-fb9a-4106-96a3-cca8453c6000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=10ca909b-1957-42c9-93b4-147fa476d001, consistentId=grid-1, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:11:13] : [Step 4/5] [2021-11-19 21:11:13,357][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][G] Node started : [stage="Configure system pool" (0 ms),stage="Start managers" (197 ms),stage="Configure binary metadata" (2 ms),stage="Start processors" (564 ms),stage="Start 'StanByClusterTestProvider' plugin" (0 ms),stage="Start 'PageMemory tracker plugin' plugin" (0 ms),stage="Start 'TestDistibutedConfigurationPlugin' plugin" (0 ms),stage="Start 'NodeValidationPluginProvider' plugin" (0 ms),stage="Init metastore" (28 ms),stage="Init and start regions" (6 ms),stage="Restore binary memory" (17 ms),stage="Restore logical state" (13 ms),stage="Finish recovery" (6 ms),stage="Join topology" (51 ms),stage="Await transition" (2 ms),stage="Await exchange" (11 ms),stage="Total time" (897 ms)] [21:11:13] : [Step 4/5] [2021-11-19 21:11:13,358][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][root] Node started with the following configuration [id=10ca909b-1957-42c9-93b4-147fa476d001, marshaller=BinaryMarshaller [], discovery=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=5000, ackTimeout=5000, marsh=JdkMarshaller [clsFilter=org.apache.ignite.marshaller.MarshallerUtils$1@344e0201], reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], binaryCfg=null, lateAff=true] [21:11:13] : [Step 4/5] [2021-11-19 21:11:13,360][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][GridClusterStateProcessor] Sending activate cluster request with BaselineTopology BaselineTopology [id=0, branchingHash=-2475315501, branchingType='New BaselineTopology', baselineNodes=[grid-1, grid-0]] [21:11:13] : [Step 4/5] [2021-11-19 21:11:13,363][INFO ][disco-notifier-worker-#22803%grid-0%][GridClusterStateProcessor] Received activate cluster request with BaselineTopology[id=0] initiator node ID: 00a4fdec-fb9a-4106-96a3-cca8453c6000 [21:11:13] : [Step 4/5] [2021-11-19 21:11:13,364][INFO ][disco-notifier-worker-#22803%grid-0%][GridClusterStateProcessor] Started state transition: activate cluster [21:11:13] : [Step 4/5] [2021-11-19 21:11:13,364][INFO ][exchange-worker-#22808%grid-0%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], crd=true, evt=DISCOVERY_CUSTOM_EVT, evtNode=00a4fdec-fb9a-4106-96a3-cca8453c6000, customEvt=ChangeGlobalStateMessage [id=3bc8d593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqId=d2014991-ce74-4290-a080-e1442e5bb7ba, initiatingNodeId=00a4fdec-fb9a-4106-96a3-cca8453c6000, state=ACTIVE, baselineTopology=BaselineTopology [id=0, branchingHash=-2475315501, branchingType='New BaselineTopology', baselineNodes=[grid-1, grid-0]], forceChangeBaselineTopology=false, timestamp=1637345473360, forceDeactivation=true], allowMerge=false, exchangeFreeSwitch=false] [21:11:13] : [Step 4/5] [2021-11-19 21:11:13,365][INFO ][disco-notifier-worker-#22922%grid-1%][GridClusterStateProcessor] Received activate cluster request with BaselineTopology[id=0] initiator node ID: 00a4fdec-fb9a-4106-96a3-cca8453c6000 [21:11:13] : [Step 4/5] [2021-11-19 21:11:13,365][INFO ][disco-notifier-worker-#22922%grid-1%][GridClusterStateProcessor] Started state transition: activate cluster [21:11:13] : [Step 4/5] [2021-11-19 21:11:13,365][INFO ][exchange-worker-#22808%grid-0%][GridDhtPartitionsExchangeFuture] Start activation process [nodeId=00a4fdec-fb9a-4106-96a3-cca8453c6000, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]]. New state: ACTIVE [21:11:13] : [Step 4/5] [2021-11-19 21:11:13,366][INFO ][exchange-worker-#22931%grid-1%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], crd=false, evt=DISCOVERY_CUSTOM_EVT, evtNode=00a4fdec-fb9a-4106-96a3-cca8453c6000, customEvt=ChangeGlobalStateMessage [id=3bc8d593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqId=d2014991-ce74-4290-a080-e1442e5bb7ba, initiatingNodeId=00a4fdec-fb9a-4106-96a3-cca8453c6000, state=ACTIVE, baselineTopology=BaselineTopology [id=0, branchingHash=-2475315501, branchingType='New BaselineTopology', baselineNodes=[grid-1, grid-0]], forceChangeBaselineTopology=false, timestamp=1637345473360, forceDeactivation=true], allowMerge=false, exchangeFreeSwitch=false] [21:11:13] : [Step 4/5] [2021-11-19 21:11:13,366][INFO ][exchange-worker-#22808%grid-0%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0 [21:11:13] : [Step 4/5] [2021-11-19 21:11:13,367][INFO ][exchange-worker-#22931%grid-1%][GridDhtPartitionsExchangeFuture] Start activation process [nodeId=10ca909b-1957-42c9-93b4-147fa476d001, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]]. New state: ACTIVE [21:11:13] : [Step 4/5] [2021-11-19 21:11:13,369][INFO ][exchange-worker-#22931%grid-1%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1 [21:11:13] : [Step 4/5] [2021-11-19 21:11:13,369][INFO ][exchange-worker-#22808%grid-0%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000000.wal, offset=8795, ver=2] [21:11:13] : [Step 4/5] [2021-11-19 21:11:13,371][INFO ][exchange-worker-#22808%grid-0%][GridClusterStateProcessor] Writing BaselineTopology[id=0] [21:11:13] : [Step 4/5] [2021-11-19 21:11:13,371][INFO ][exchange-worker-#22931%grid-1%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000000.wal, offset=8795, ver=2] [21:11:13] : [Step 4/5] [2021-11-19 21:11:13,372][INFO ][exchange-worker-#22931%grid-1%][GridClusterStateProcessor] Writing BaselineTopology[id=0] [21:11:13] : [Step 4/5] [2021-11-19 21:11:13,373][INFO ][exchange-worker-#22808%grid-0%][GridCacheDatabaseSharedManager] Finish recovery performed in 5 ms. [21:11:13] : [Step 4/5] [2021-11-19 21:11:13,374][INFO ][exchange-worker-#22808%grid-0%][msg] Components activation performed in 8 ms. [21:11:13] : [Step 4/5] [2021-11-19 21:11:13,374][INFO ][exchange-worker-#22931%grid-1%][GridCacheDatabaseSharedManager] Finish recovery performed in 5 ms. [21:11:13] : [Step 4/5] [2021-11-19 21:11:13,375][INFO ][exchange-worker-#22931%grid-1%][msg] Components activation performed in 6 ms. [21:11:13] : [Step 4/5] [2021-11-19 21:11:13,376][INFO ][exchange-worker-#22808%grid-0%][GridCacheProcessor] Finished recovery for cache [cache=ignite-sys-cache, grp=ignite-sys-cache, startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:11:13] : [Step 4/5] [2021-11-19 21:11:13,376][INFO ][exchange-worker-#22931%grid-1%][GridCacheProcessor] Finished recovery for cache [cache=ignite-sys-cache, grp=ignite-sys-cache, startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:11:13] : [Step 4/5] [2021-11-19 21:11:13,376][INFO ][exchange-worker-#22808%grid-0%][GridDhtPartitionsExchangeFuture] Successfully activated caches [nodeId=00a4fdec-fb9a-4106-96a3-cca8453c6000, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], newState=ACTIVE] [21:11:13] : [Step 4/5] [2021-11-19 21:11:13,376][INFO ][exchange-worker-#22931%grid-1%][GridDhtPartitionsExchangeFuture] Successfully activated caches [nodeId=10ca909b-1957-42c9-93b4-147fa476d001, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], newState=ACTIVE] [21:11:13] : [Step 4/5] [2021-11-19 21:11:13,377][INFO ][exchange-worker-#22808%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:11:13] : [Step 4/5] [2021-11-19 21:11:13,377][INFO ][exchange-worker-#22931%grid-1%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:11:13] : [Step 4/5] [2021-11-19 21:11:13,384][INFO ][exchange-worker-#22808%grid-0%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], crd=true] [21:11:13] : [Step 4/5] [2021-11-19 21:11:13,386][INFO ][grid-nio-worker-tcp-comm-0-#22746%TestRecordingCommunicationSpi%][TestRecordingCommunicationSpi] Accepted incoming communication connection [locAddr=/127.0.0.1:47100, rmtAddr=/127.0.0.1:33662] [21:11:13] : [Step 4/5] [2021-11-19 21:11:13,388][INFO ][grid-nio-worker-tcp-comm-0-#22865%TestRecordingCommunicationSpi%][TestRecordingCommunicationSpi] Established outgoing communication connection [locAddr=/127.0.0.1:33662, rmtAddr=/127.0.0.1:47100] [21:11:13] : [Step 4/5] [2021-11-19 21:11:13,388][INFO ][exchange-worker-#22931%grid-1%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], crd=false] [21:11:13] : [Step 4/5] [2021-11-19 21:11:13,390][INFO ][sys-#22790%grid-0%][GridDhtPartitionsExchangeFuture] Coordinator received single message [ver=AffinityTopologyVersion [topVer=2, minorTopVer=1], node=10ca909b-1957-42c9-93b4-147fa476d001, allReceived=true] [21:11:13] : [Step 4/5] [2021-11-19 21:11:13,390][INFO ][sys-#22790%grid-0%][GridDhtPartitionsExchangeFuture] finishExchangeOnCoordinator [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:11:13] : [Step 4/5] [2021-11-19 21:11:13,394][INFO ][sys-#22790%grid-0%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], err=null, rebalanced=true, wasRebalanced=false] [21:11:13] : [Step 4/5] [2021-11-19 21:11:13,395][INFO ][sys-#22911%grid-1%][GridDhtPartitionsExchangeFuture] Received full message, will finish exchange [node=00a4fdec-fb9a-4106-96a3-cca8453c6000, resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:11:13] : [Step 4/5] [2021-11-19 21:11:13,396][INFO ][disco-notifier-worker-#22922%grid-1%][GridClusterStateProcessor] Received state change finish message: ACTIVE [21:11:13] : [Step 4/5] [2021-11-19 21:11:13,394][INFO ][disco-notifier-worker-#22803%grid-0%][GridClusterStateProcessor] Received state change finish message: ACTIVE [21:11:13] : [Step 4/5] [2021-11-19 21:11:13,399][INFO ][disco-notifier-worker-#22803%grid-0%][GridClusterStateProcessor] Cluster state was changed from INACTIVE to ACTIVE [21:11:13] : [Step 4/5] [2021-11-19 21:11:13,399][INFO ][sys-#22790%grid-0%][GridCacheProcessor] Finish proxy initialization, cacheName=ignite-sys-cache, localNodeId=00a4fdec-fb9a-4106-96a3-cca8453c6000 [21:11:13] : [Step 4/5] [2021-11-19 21:11:13,399][INFO ][sys-#22911%grid-1%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], err=null, rebalanced=true, wasRebalanced=false] [21:11:13] : [Step 4/5] [2021-11-19 21:11:13,399][INFO ][sys-#22917%grid-1%][GridCachePartitionExchangeManager] Delay process full message without exchange id (there is exchange in progress) [nodeId=00a4fdec-fb9a-4106-96a3-cca8453c6000] [21:11:13] : [Step 4/5] [2021-11-19 21:11:13,396][INFO ][disco-notifier-worker-#22922%grid-1%][GridClusterStateProcessor] Cluster state was changed from INACTIVE to ACTIVE [21:11:13] : [Step 4/5] [2021-11-19 21:11:13,400][INFO ][sys-#22911%grid-1%][GridCacheProcessor] Finish proxy initialization, cacheName=ignite-sys-cache, localNodeId=10ca909b-1957-42c9-93b4-147fa476d001 [21:11:13] : [Step 4/5] [2021-11-19 21:11:13,400][INFO ][sys-#22790%grid-0%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=00a4fdec-fb9a-4106-96a3-cca8453c6000, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=00a4fdec-fb9a-4106-96a3-cca8453c6000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345473398, loc=true, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:11:13] : [Step 4/5] [2021-11-19 21:11:13,399][INFO ][exchange-worker-#22808%grid-0%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=2, minorTopVer=1], force=false, evt=DISCOVERY_CUSTOM_EVT, node=00a4fdec-fb9a-4106-96a3-cca8453c6000] [21:11:13] : [Step 4/5] [2021-11-19 21:11:13,399][INFO ][sys-#22779%grid-0%][DistributedBaselineConfiguration] Baseline auto-adjust is 'disabled' with timeout='300000' ms [21:11:13] : [Step 4/5] [2021-11-19 21:11:13,404][INFO ][sys-#22790%grid-0%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (0 ms), stage="Update caches registry" (9 ms), stage="Start caches" (1 ms), stage="Affinity initialization on cache group start" (0 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Restore partition states" (0 ms), stage="After states restored callback" (6 ms), stage="WAL history reservation" (0 ms), stage="Waiting for all single messages" (5 ms), stage="Affinity recalculation (crd)" (0 ms), stage="Collect update counters and create affinity messages" (0 ms), stage="Assign partitions states" (0 ms), stage="Validate partitions states" (0 ms), stage="Ideal affinity diff calculation (enforced)" (0 ms), stage="Apply update counters" (0 ms), stage="Full message preparing" (2 ms), stage="Full message sending" (0 ms), stage="State finish message sending" (0 ms), stage="Detect lost partitions" (1 ms), stage="Exchange done" (8 ms), stage="Total time" (32 ms), Discovery lag=2 ms, Latest started node id=10ca909b-1957-42c9-93b4-147fa476d001] [21:11:13] : [Step 4/5] [2021-11-19 21:11:13,404][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][root] awaitPartitionMapExchange finished [21:11:13] : [Step 4/5] [2021-11-19 21:11:13,404][INFO ][sys-#22911%grid-1%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=10ca909b-1957-42c9-93b4-147fa476d001, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=00a4fdec-fb9a-4106-96a3-cca8453c6000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345473326, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:11:13] : [Step 4/5] [2021-11-19 21:11:13,404][INFO ][exchange-worker-#22931%grid-1%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=2, minorTopVer=1], force=false, evt=DISCOVERY_CUSTOM_EVT, node=00a4fdec-fb9a-4106-96a3-cca8453c6000] [21:11:13] : [Step 4/5] [2021-11-19 21:11:13,403][INFO ][sys-#22920%grid-1%][DistributedBaselineConfiguration] Baseline auto-adjust is 'disabled' with timeout='300000' ms [21:11:13] : [Step 4/5] [2021-11-19 21:11:13,410][INFO ][sys-#22920%grid-1%][GridClusterStateProcessor] Successfully performed final activation steps [nodeId=10ca909b-1957-42c9-93b4-147fa476d001, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:11:13] : [Step 4/5] [2021-11-19 21:11:13,409][INFO ][sys-#22911%grid-1%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (1 ms), stage="Update caches registry" (8 ms), stage="Start caches" (0 ms), stage="Affinity initialization on cache group start" (0 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Restore partition states" (0 ms), stage="After states restored callback" (6 ms), stage="WAL history reservation" (0 ms), stage="Waiting for Full message" (10 ms), stage="Affinity recalculation" (0 ms), stage="Full map updating" (2 ms), stage="Detect lost partitions" (1 ms), stage="Exchange done" (8 ms), stage="Total time" (36 ms)] [21:11:13] : [Step 4/5] [2021-11-19 21:11:13,408][INFO ][sys-#22790%grid-0%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], stage="Affinity initialization on cache group start [grp=ignite-sys-cache]" (0 ms) (parent=Affinity initialization on cache group start), stage="Affinity centralized initialization (crd) [grp=ignite-sys-cache, crd=true]" (0 ms) (parent=Determine exchange type), stage="Restore partition states [grp=ignite-sys-cache]" (0 ms) (parent=Restore partition states), stage="Affinity recalculation (partitions availability) [grp=ignite-sys-cache]" (0 ms) (parent=Ideal affinity diff calculation (enforced))] [21:11:13] : [Step 4/5] [2021-11-19 21:11:13,405][INFO ][sys-#22779%grid-0%][GridClusterStateProcessor] Successfully performed final activation steps [nodeId=00a4fdec-fb9a-4106-96a3-cca8453c6000, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:11:13] : [Step 4/5] [2021-11-19 21:11:13,413][INFO ][exchange-worker-#22931%grid-1%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], crd=false, evt=DISCOVERY_CUSTOM_EVT, evtNode=00a4fdec-fb9a-4106-96a3-cca8453c6000, customEvt=DynamicCacheChangeBatch [id=7dc8d593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqs=ArrayList [DynamicCacheChangeRequest [cacheName=encrypted, hasCfg=true, nodeId=00a4fdec-fb9a-4106-96a3-cca8453c6000, clientStartOnly=false, stop=false, destroy=false, disabledAfterStart=false]], exchangeActions=ExchangeActions [startCaches=[encrypted], stopCaches=null, startGrps=[encrypted], stopGrps=[], resetParts=null, stateChangeRequest=null], startCaches=false], allowMerge=false, exchangeFreeSwitch=false] [21:11:13] : [Step 4/5] [2021-11-19 21:11:13,412][INFO ][exchange-worker-#22808%grid-0%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], crd=true, evt=DISCOVERY_CUSTOM_EVT, evtNode=00a4fdec-fb9a-4106-96a3-cca8453c6000, customEvt=DynamicCacheChangeBatch [id=7dc8d593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqs=ArrayList [DynamicCacheChangeRequest [cacheName=encrypted, hasCfg=true, nodeId=00a4fdec-fb9a-4106-96a3-cca8453c6000, clientStartOnly=false, stop=false, destroy=false, disabledAfterStart=false]], exchangeActions=ExchangeActions [startCaches=[encrypted], stopCaches=null, startGrps=[encrypted], stopGrps=[], resetParts=null, stateChangeRequest=null], startCaches=false], allowMerge=false, exchangeFreeSwitch=false] [21:11:13] : [Step 4/5] [2021-11-19 21:11:13,411][INFO ][sys-#22911%grid-1%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], stage="Affinity initialization on cache group start [grp=ignite-sys-cache]" (0 ms) (parent=Affinity initialization on cache group start), stage="Affinity centralized initialization (crd) [grp=ignite-sys-cache, crd=false]" (0 ms) (parent=Determine exchange type), stage="Restore partition states [grp=ignite-sys-cache]" (0 ms) (parent=Restore partition states), stage="Affinity applying from full message [grp=ignite-sys-cache]" (0 ms) (parent=Affinity recalculation)] [21:11:13] : [Step 4/5] [2021-11-19 21:11:13,418][INFO ][exchange-worker-#22808%grid-0%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:11:13] : [Step 4/5] [2021-11-19 21:11:13,416][INFO ][exchange-worker-#22931%grid-1%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:11:13] : [Step 4/5] [2021-11-19 21:11:13,425][INFO ][exchange-worker-#22808%grid-0%][GridCacheProcessor] Started cache [name=encrypted, id=1613773252, dataRegionName=default, mode=PARTITIONED, atomicity=ATOMIC, backups=0, mvcc=false] [21:11:13] : [Step 4/5] [2021-11-19 21:11:13,426][INFO ][exchange-worker-#22808%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], waitTime=0ms, futInfo=NA, mode=DISTRIBUTED] [21:11:13] : [Step 4/5] [2021-11-19 21:11:13,427][INFO ][exchange-worker-#22931%grid-1%][GridCacheProcessor] Started cache [name=encrypted, id=1613773252, dataRegionName=default, mode=PARTITIONED, atomicity=ATOMIC, backups=0, mvcc=false] [21:11:13] : [Step 4/5] [2021-11-19 21:11:13,428][INFO ][exchange-worker-#22931%grid-1%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], waitTime=0ms, futInfo=NA, mode=DISTRIBUTED] [21:11:13] : [Step 4/5] [2021-11-19 21:11:13,429][INFO ][exchange-worker-#22808%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partitions release latch: ServerLatch [permits=0, pendingAcks=HashSet [], super=CompletableLatch [id=CompletableLatchUid [id=exchange, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2]]]] [21:11:13] : [Step 4/5] [2021-11-19 21:11:13,429][INFO ][exchange-worker-#22931%grid-1%][GridDhtPartitionsExchangeFuture] Finished waiting for partitions release latch: ClientLatch [coordinator=TcpDiscoveryNode [id=00a4fdec-fb9a-4106-96a3-cca8453c6000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345473326, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], ackSent=true, super=CompletableLatch [id=CompletableLatchUid [id=exchange, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2]]]] [21:11:13] : [Step 4/5] [2021-11-19 21:11:13,429][INFO ][exchange-worker-#22808%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:11:13] : [Step 4/5] [2021-11-19 21:11:13,431][INFO ][exchange-worker-#22931%grid-1%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:11:13] : [Step 4/5] [2021-11-19 21:11:13,433][INFO ][exchange-worker-#22808%grid-0%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], crd=true] [21:11:13] : [Step 4/5] [2021-11-19 21:11:13,436][INFO ][exchange-worker-#22931%grid-1%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], crd=false] [21:11:13] : [Step 4/5] [2021-11-19 21:11:13,436][INFO ][sys-#22788%grid-0%][GridDhtPartitionsExchangeFuture] Coordinator received single message [ver=AffinityTopologyVersion [topVer=2, minorTopVer=2], node=10ca909b-1957-42c9-93b4-147fa476d001, allReceived=true] [21:11:13] : [Step 4/5] [2021-11-19 21:11:13,437][INFO ][sys-#22788%grid-0%][GridDhtPartitionsExchangeFuture] finishExchangeOnCoordinator [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2]] [21:11:13] : [Step 4/5] [2021-11-19 21:11:13,438][INFO ][sys-#22788%grid-0%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], err=null, rebalanced=true, wasRebalanced=true] [21:11:13] : [Step 4/5] [2021-11-19 21:11:13,439][INFO ][sys-#22898%grid-1%][GridDhtPartitionsExchangeFuture] Received full message, will finish exchange [node=00a4fdec-fb9a-4106-96a3-cca8453c6000, resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2]] [21:11:13] : [Step 4/5] [2021-11-19 21:11:13,439][INFO ][sys-#22788%grid-0%][GridCacheProcessor] Finish proxy initialization, cacheName=encrypted, localNodeId=00a4fdec-fb9a-4106-96a3-cca8453c6000 [21:11:13] : [Step 4/5] [2021-11-19 21:11:13,441][INFO ][sys-#22898%grid-1%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], err=null, rebalanced=true, wasRebalanced=true] [21:11:13] : [Step 4/5] [2021-11-19 21:11:13,441][INFO ][exchange-worker-#22808%grid-0%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=2, minorTopVer=2], force=false, evt=DISCOVERY_CUSTOM_EVT, node=00a4fdec-fb9a-4106-96a3-cca8453c6000] [21:11:13] : [Step 4/5] [2021-11-19 21:11:13,441][INFO ][sys-#22788%grid-0%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=00a4fdec-fb9a-4106-96a3-cca8453c6000, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=00a4fdec-fb9a-4106-96a3-cca8453c6000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345473429, loc=true, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2]] [21:11:13] : [Step 4/5] [2021-11-19 21:11:13,443][INFO ][sys-#22788%grid-0%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (3 ms), stage="Update caches registry" (0 ms), stage="Start caches" (8 ms), stage="Affinity initialization on cache group start" (0 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Wait partitions release latch [latch=exchange]" (3 ms), stage="Wait partitions release [latch=exchange]" (1 ms), stage="Restore partition states" (0 ms), stage="After states restored callback" (0 ms), stage="WAL history reservation" (0 ms), stage="Waiting for all single messages" (4 ms), stage="Affinity recalculation (crd)" (0 ms), stage="Collect update counters and create affinity messages" (0 ms), stage="Assign partitions states" (0 ms), stage="Validate partitions states" (0 ms), stage="Apply update counters" (0 ms), stage="Full message preparing" (0 ms), stage="Full message sending" (0 ms), stage="Exchange done" (4 ms), stage="Total time" (23 ms), Discovery lag=1 ms, Latest started node id=10ca909b-1957-42c9-93b4-147fa476d001] [21:11:13] : [Step 4/5] [2021-11-19 21:11:13,442][INFO ][sys-#22898%grid-1%][GridCacheProcessor] Finish proxy initialization, cacheName=encrypted, localNodeId=10ca909b-1957-42c9-93b4-147fa476d001 [21:11:13] : [Step 4/5] [2021-11-19 21:11:13,445][INFO ][sys-#22788%grid-0%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], stage="Affinity initialization on cache group start [grp=encrypted]" (0 ms) (parent=Affinity initialization on cache group start), stage="Restore partition states [grp=ignite-sys-cache]" (0 ms) (parent=Restore partition states), stage="Restore partition states [grp=encrypted]" (0 ms) (parent=Restore partition states)] [21:11:13] : [Step 4/5] [2021-11-19 21:11:13,445][INFO ][exchange-worker-#22931%grid-1%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=2, minorTopVer=2], force=false, evt=DISCOVERY_CUSTOM_EVT, node=00a4fdec-fb9a-4106-96a3-cca8453c6000] [21:11:13] : [Step 4/5] [2021-11-19 21:11:13,445][INFO ][sys-#22898%grid-1%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=10ca909b-1957-42c9-93b4-147fa476d001, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=00a4fdec-fb9a-4106-96a3-cca8453c6000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345473326, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2]] [21:11:13] : [Step 4/5] [2021-11-19 21:11:13,448][INFO ][sys-#22898%grid-1%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (1 ms), stage="Update caches registry" (0 ms), stage="Start caches" (12 ms), stage="Affinity initialization on cache group start" (0 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Wait partitions release latch [latch=exchange]" (2 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Restore partition states" (1 ms), stage="After states restored callback" (0 ms), stage="WAL history reservation" (0 ms), stage="Waiting for Full message" (4 ms), stage="Affinity recalculation" (0 ms), stage="Full map updating" (1 ms), stage="Exchange done" (6 ms), stage="Total time" (27 ms)] [21:11:13] : [Step 4/5] [2021-11-19 21:11:13,449][INFO ][sys-#22898%grid-1%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], stage="Affinity initialization on cache group start [grp=encrypted]" (0 ms) (parent=Affinity initialization on cache group start), stage="Restore partition states [grp=encrypted]" (1 ms) (parent=Restore partition states), stage="Restore partition states [grp=ignite-sys-cache]" (0 ms) (parent=Restore partition states)] [21:11:13] : [Step 4/5] [2021-11-19 21:11:13,878][INFO ][db-checkpoint-thread-#22945%grid-1%][Checkpointer] Checkpoint started [checkpointId=8dcdf888-24dc-48bc-b9aa-d881367b5e9b, startPtr=WALPointer [idx=0, fileOff=86701, len=1963], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=217ms, writeCheckpointEntryDuration=276ms, splitAndSortCpPagesDuration=0ms, pages=18, reason='node started'] [21:11:13] : [Step 4/5] [2021-11-19 21:11:13,878][INFO ][db-checkpoint-thread-#22942%grid-0%][Checkpointer] Checkpoint started [checkpointId=2e38d6df-9fbd-4d39-b1d5-641158c5f02e, startPtr=WALPointer [idx=0, fileOff=86701, len=1963], checkpointBeforeLockTime=2ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=217ms, writeCheckpointEntryDuration=276ms, splitAndSortCpPagesDuration=0ms, pages=18, reason='node started'] [21:11:13] : [Step 4/5] [2021-11-19 21:11:13,882][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:14] : [Step 4/5] [2021-11-19 21:11:14,052][INFO ][disco-notifier-worker-#22803%grid-0%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:14] : [Step 4/5] [2021-11-19 21:11:14,057][INFO ][disco-notifier-worker-#22922%grid-1%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:14] : [Step 4/5] [2021-11-19 21:11:14,138][INFO ][db-checkpoint-thread-#22942%grid-0%][Checkpointer] Checkpoint finished [cpId=2e38d6df-9fbd-4d39-b1d5-641158c5f02e, pages=18, markPos=WALPointer [idx=0, fileOff=86701, len=1963], walSegmentsCovered=[], markDuration=495ms, pagesWrite=1ms, fsync=258ms, total=756ms] [21:11:14] : [Step 4/5] [2021-11-19 21:11:14,138][INFO ][db-checkpoint-thread-#22945%grid-1%][Checkpointer] Checkpoint finished [cpId=8dcdf888-24dc-48bc-b9aa-d881367b5e9b, pages=18, markPos=WALPointer [idx=0, fileOff=86701, len=1963], walSegmentsCovered=[], markDuration=494ms, pagesWrite=1ms, fsync=259ms, total=755ms] [21:11:14] : [Step 4/5] [2021-11-19 21:11:14,250][INFO ][disco-notifier-worker-#22803%grid-0%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:14] : [Step 4/5] [2021-11-19 21:11:14,253][INFO ][disco-notifier-worker-#22922%grid-1%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:14] : [Step 4/5] [2021-11-19 21:11:14,356][INFO ][disco-notifier-worker-#22803%grid-0%][GridEncryptionManager] Start master key change [masterKeyName=ignite.master.key2] [21:11:14] : [Step 4/5] [2021-11-19 21:11:14,357][INFO ][disco-notifier-worker-#22922%grid-1%][GridEncryptionManager] Start master key change [masterKeyName=ignite.master.key2] [21:11:14] : [Step 4/5] [2021-11-19 21:11:14,421][INFO ][disco-notifier-worker-#22803%grid-0%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:14] : [Step 4/5] [2021-11-19 21:11:14,431][INFO ][disco-notifier-worker-#22922%grid-1%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:14] : [Step 4/5] [2021-11-19 21:11:14,524][INFO ][disco-notifier-worker-#22803%grid-0%][GridEncryptionManager] Master key successfully changed [masterKeyName=ignite.master.key2] [21:11:14] : [Step 4/5] [2021-11-19 21:11:14,526][INFO ][disco-notifier-worker-#22803%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=1] [21:11:14] : [Step 4/5] [2021-11-19 21:11:14,526][INFO ][reencrypt-#22963%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:11:14] : [Step 4/5] [2021-11-19 21:11:14,537][INFO ][disco-notifier-worker-#22922%grid-1%][GridEncryptionManager] Master key successfully changed [masterKeyName=ignite.master.key2] [21:11:14] : [Step 4/5] [2021-11-19 21:11:14,538][INFO ][disco-notifier-worker-#22922%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=1] [21:11:14] : [Step 4/5] [2021-11-19 21:11:14,539][INFO ][reencrypt-#22964%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:11:14] : [Step 4/5] [2021-11-19 21:11:14,541][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10ca909b-1957-42c9-93b4-147fa476d001, grp=1613773252] [21:11:14] : [Step 4/5] [2021-11-19 21:11:14,683][INFO ][db-checkpoint-thread-#22945%grid-1%][Checkpointer] Checkpoint started [checkpointId=aecef27d-57d4-4351-abc9-74e25dab7c0e, startPtr=WALPointer [idx=0, fileOff=198037, len=2048], checkpointBeforeLockTime=3ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=129ms, writeCheckpointEntryDuration=8ms, splitAndSortCpPagesDuration=0ms, pages=65, reason='test'] [21:11:14] : [Step 4/5] [2021-11-19 21:11:14,752][INFO ][db-checkpoint-thread-#22945%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:11:14] : [Step 4/5] [2021-11-19 21:11:14,752][INFO ][db-checkpoint-thread-#22945%grid-1%][Checkpointer] Checkpoint finished [cpId=aecef27d-57d4-4351-abc9-74e25dab7c0e, pages=65, markPos=WALPointer [idx=0, fileOff=198037, len=2048], walSegmentsCovered=[], markDuration=139ms, pagesWrite=3ms, fsync=65ms, total=210ms] [21:11:14] : [Step 4/5] [2021-11-19 21:11:14,753][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00a4fdec-fb9a-4106-96a3-cca8453c6000, grp=1613773252] [21:11:15] : [Step 4/5] [2021-11-19 21:11:15,139][INFO ][db-checkpoint-thread-#22942%grid-0%][Checkpointer] Checkpoint started [checkpointId=9f48b885-ab1a-4fe6-a3ae-6e56b37e5e3e, startPtr=WALPointer [idx=0, fileOff=170017, len=2010], checkpointBeforeLockTime=2ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=85ms, writeCheckpointEntryDuration=297ms, splitAndSortCpPagesDuration=0ms, pages=45, reason='test'] [21:11:15] : [Step 4/5] [2021-11-19 21:11:15,191][INFO ][db-checkpoint-thread-#22942%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:11:15] : [Step 4/5] [2021-11-19 21:11:15,191][INFO ][db-checkpoint-thread-#22942%grid-0%][Checkpointer] Checkpoint finished [cpId=9f48b885-ab1a-4fe6-a3ae-6e56b37e5e3e, pages=45, markPos=WALPointer [idx=0, fileOff=170017, len=2010], walSegmentsCovered=[], markDuration=384ms, pagesWrite=2ms, fsync=49ms, total=437ms] [21:11:15] : [Step 4/5] [2021-11-19 21:11:15,250][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:15] : [Step 4/5] [2021-11-19 21:11:15,387][INFO ][disco-notifier-worker-#22803%grid-0%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:15] : [Step 4/5] [2021-11-19 21:11:15,390][INFO ][disco-notifier-worker-#22922%grid-1%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:15] : [Step 4/5] [2021-11-19 21:11:15,521][INFO ][disco-notifier-worker-#22803%grid-0%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:15] : [Step 4/5] [2021-11-19 21:11:15,523][INFO ][disco-notifier-worker-#22922%grid-1%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:15] : [Step 4/5] [2021-11-19 21:11:15,603][INFO ][disco-notifier-worker-#22803%grid-0%][GridEncryptionManager] Start master key change [masterKeyName=ignite.master.key3] [21:11:15] : [Step 4/5] [2021-11-19 21:11:15,604][INFO ][disco-notifier-worker-#22922%grid-1%][GridEncryptionManager] Start master key change [masterKeyName=ignite.master.key3] [21:11:15] : [Step 4/5] [2021-11-19 21:11:15,739][INFO ][disco-notifier-worker-#22922%grid-1%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:15] : [Step 4/5] [2021-11-19 21:11:15,742][INFO ][disco-notifier-worker-#22803%grid-0%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:15] : [Step 4/5] [2021-11-19 21:11:15,823][INFO ][disco-notifier-worker-#22803%grid-0%][GridEncryptionManager] Master key successfully changed [masterKeyName=ignite.master.key3] [21:11:15] : [Step 4/5] [2021-11-19 21:11:15,824][INFO ][disco-notifier-worker-#22803%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=2] [21:11:15] : [Step 4/5] [2021-11-19 21:11:15,825][INFO ][reencrypt-#22963%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:11:15] : [Step 4/5] [2021-11-19 21:11:15,825][INFO ][disco-notifier-worker-#22922%grid-1%][GridEncryptionManager] Master key successfully changed [masterKeyName=ignite.master.key3] [21:11:15] : [Step 4/5] [2021-11-19 21:11:15,826][INFO ][disco-notifier-worker-#22922%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=2] [21:11:15] : [Step 4/5] [2021-11-19 21:11:15,826][INFO ][reencrypt-#22964%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:11:16] : [Step 4/5] [2021-11-19 21:11:16,031][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10ca909b-1957-42c9-93b4-147fa476d001, grp=1613773252] [21:11:16] : [Step 4/5] [2021-11-19 21:11:16,320][INFO ][db-checkpoint-thread-#22945%grid-1%][Checkpointer] Checkpoint started [checkpointId=85f1b05c-ca53-43f9-bbbe-45d7ec7bbef5, startPtr=WALPointer [idx=0, fileOff=475781, len=2048], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=278ms, writeCheckpointEntryDuration=9ms, splitAndSortCpPagesDuration=0ms, pages=66, reason='test'] [21:11:16] : [Step 4/5] [2021-11-19 21:11:16,349][INFO ][db-checkpoint-thread-#22945%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:11:16] : [Step 4/5] [2021-11-19 21:11:16,349][INFO ][db-checkpoint-thread-#22945%grid-1%][Checkpointer] Checkpoint finished [cpId=85f1b05c-ca53-43f9-bbbe-45d7ec7bbef5, pages=66, markPos=WALPointer [idx=0, fileOff=475781, len=2048], walSegmentsCovered=[], markDuration=289ms, pagesWrite=2ms, fsync=26ms, total=318ms] [21:11:16] : [Step 4/5] [2021-11-19 21:11:16,350][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00a4fdec-fb9a-4106-96a3-cca8453c6000, grp=1613773252] [21:11:16] : [Step 4/5] [2021-11-19 21:11:16,358][INFO ][db-checkpoint-thread-#22942%grid-0%][Checkpointer] Checkpoint started [checkpointId=2123d112-e205-4afb-b964-1c41a99e4854, startPtr=WALPointer [idx=0, fileOff=364543, len=2010], checkpointBeforeLockTime=3ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=2ms, writeCheckpointEntryDuration=2ms, splitAndSortCpPagesDuration=0ms, pages=46, reason='test'] [21:11:16] : [Step 4/5] [2021-11-19 21:11:16,377][INFO ][db-checkpoint-thread-#22942%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:11:16] : [Step 4/5] [2021-11-19 21:11:16,377][INFO ][db-checkpoint-thread-#22942%grid-0%][Checkpointer] Checkpoint finished [cpId=2123d112-e205-4afb-b964-1c41a99e4854, pages=46, markPos=WALPointer [idx=0, fileOff=364543, len=2010], walSegmentsCovered=[], markDuration=6ms, pagesWrite=1ms, fsync=17ms, total=27ms] [21:11:16] : [Step 4/5] [2021-11-19 21:11:16,440][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:16] : [Step 4/5] [2021-11-19 21:11:16,579][INFO ][disco-notifier-worker-#22803%grid-0%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:16] : [Step 4/5] [2021-11-19 21:11:16,584][INFO ][disco-notifier-worker-#22922%grid-1%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:16] : [Step 4/5] [2021-11-19 21:11:16,718][INFO ][disco-notifier-worker-#22803%grid-0%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:16] : [Step 4/5] [2021-11-19 21:11:16,729][INFO ][disco-notifier-worker-#22922%grid-1%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:16] : [Step 4/5] [2021-11-19 21:11:16,815][INFO ][disco-notifier-worker-#22803%grid-0%][GridEncryptionManager] Start master key change [masterKeyName=ignite.master.key2] [21:11:16] : [Step 4/5] [2021-11-19 21:11:16,815][INFO ][disco-notifier-worker-#22922%grid-1%][GridEncryptionManager] Start master key change [masterKeyName=ignite.master.key2] [21:11:16] : [Step 4/5] [2021-11-19 21:11:16,871][INFO ][disco-notifier-worker-#22803%grid-0%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:16] : [Step 4/5] [2021-11-19 21:11:16,871][INFO ][disco-notifier-worker-#22922%grid-1%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:16] : [Step 4/5] [2021-11-19 21:11:16,954][INFO ][disco-notifier-worker-#22922%grid-1%][GridEncryptionManager] Master key successfully changed [masterKeyName=ignite.master.key2] [21:11:16] : [Step 4/5] [2021-11-19 21:11:16,955][INFO ][disco-notifier-worker-#22803%grid-0%][GridEncryptionManager] Master key successfully changed [masterKeyName=ignite.master.key2] [21:11:16] : [Step 4/5] [2021-11-19 21:11:16,956][INFO ][disco-notifier-worker-#22803%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=3] [21:11:16] : [Step 4/5] [2021-11-19 21:11:16,956][INFO ][disco-notifier-worker-#22922%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=3] [21:11:16] : [Step 4/5] [2021-11-19 21:11:16,956][INFO ][reencrypt-#22963%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:11:16] : [Step 4/5] [2021-11-19 21:11:16,956][INFO ][reencrypt-#22964%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:11:17] : [Step 4/5] [2021-11-19 21:11:17,157][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10ca909b-1957-42c9-93b4-147fa476d001, grp=1613773252] [21:11:17] : [Step 4/5] [2021-11-19 21:11:17,164][INFO ][db-checkpoint-thread-#22945%grid-1%][Checkpointer] Checkpoint started [checkpointId=94b5b215-23cb-4e4d-9fec-0836e47ae0e0, startPtr=WALPointer [idx=0, fileOff=755841, len=2048], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=2ms, walCpRecordFsyncDuration=1ms, writeCheckpointEntryDuration=2ms, splitAndSortCpPagesDuration=0ms, pages=65, reason='test'] [21:11:17] : [Step 4/5] [2021-11-19 21:11:17,184][INFO ][db-checkpoint-thread-#22945%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:11:17] : [Step 4/5] [2021-11-19 21:11:17,184][INFO ][db-checkpoint-thread-#22945%grid-1%][Checkpointer] Checkpoint finished [cpId=94b5b215-23cb-4e4d-9fec-0836e47ae0e0, pages=65, markPos=WALPointer [idx=0, fileOff=755841, len=2048], walSegmentsCovered=[], markDuration=5ms, pagesWrite=3ms, fsync=17ms, total=26ms] [21:11:17] : [Step 4/5] [2021-11-19 21:11:17,185][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00a4fdec-fb9a-4106-96a3-cca8453c6000, grp=1613773252] [21:11:17] : [Step 4/5] [2021-11-19 21:11:17,193][INFO ][db-checkpoint-thread-#22942%grid-0%][Checkpointer] Checkpoint started [checkpointId=4d4ec563-d014-4cba-bfd7-ff28bd83e45b, startPtr=WALPointer [idx=0, fileOff=561385, len=2010], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=5ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=0ms, pages=45, reason='test'] [21:11:17] : [Step 4/5] [2021-11-19 21:11:17,212][INFO ][db-checkpoint-thread-#22942%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:11:17] : [Step 4/5] [2021-11-19 21:11:17,212][INFO ][db-checkpoint-thread-#22942%grid-0%][Checkpointer] Checkpoint finished [cpId=4d4ec563-d014-4cba-bfd7-ff28bd83e45b, pages=45, markPos=WALPointer [idx=0, fileOff=561385, len=2010], walSegmentsCovered=[], markDuration=7ms, pagesWrite=2ms, fsync=16ms, total=26ms] [21:11:17] : [Step 4/5] [2021-11-19 21:11:17,270][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:17] : [Step 4/5] [2021-11-19 21:11:17,430][INFO ][disco-notifier-worker-#22803%grid-0%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:17] : [Step 4/5] [2021-11-19 21:11:17,430][INFO ][disco-notifier-worker-#22922%grid-1%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:17] : [Step 4/5] [2021-11-19 21:11:17,564][INFO ][disco-notifier-worker-#22803%grid-0%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:17] : [Step 4/5] [2021-11-19 21:11:17,564][INFO ][disco-notifier-worker-#22922%grid-1%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:17] : [Step 4/5] [2021-11-19 21:11:17,647][INFO ][disco-notifier-worker-#22803%grid-0%][GridEncryptionManager] Start master key change [masterKeyName=ignite.master.key3] [21:11:17] : [Step 4/5] [2021-11-19 21:11:17,647][INFO ][disco-notifier-worker-#22922%grid-1%][GridEncryptionManager] Start master key change [masterKeyName=ignite.master.key3] [21:11:17] : [Step 4/5] [2021-11-19 21:11:17,701][INFO ][disco-notifier-worker-#22922%grid-1%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:17] : [Step 4/5] [2021-11-19 21:11:17,701][INFO ][disco-notifier-worker-#22803%grid-0%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:17] : [Step 4/5] [2021-11-19 21:11:17,782][INFO ][disco-notifier-worker-#22922%grid-1%][GridEncryptionManager] Master key successfully changed [masterKeyName=ignite.master.key3] [21:11:17] : [Step 4/5] [2021-11-19 21:11:17,784][INFO ][disco-notifier-worker-#22803%grid-0%][GridEncryptionManager] Master key successfully changed [masterKeyName=ignite.master.key3] [21:11:17] : [Step 4/5] [2021-11-19 21:11:17,785][INFO ][disco-notifier-worker-#22803%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=4] [21:11:17] : [Step 4/5] [2021-11-19 21:11:17,786][INFO ][disco-notifier-worker-#22922%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=4] [21:11:17] : [Step 4/5] [2021-11-19 21:11:17,786][INFO ][reencrypt-#22963%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:11:17] : [Step 4/5] [2021-11-19 21:11:17,786][INFO ][reencrypt-#22964%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:11:17] : [Step 4/5] [2021-11-19 21:11:17,987][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10ca909b-1957-42c9-93b4-147fa476d001, grp=1613773252] [21:11:18] : [Step 4/5] [2021-11-19 21:11:18,170][INFO ][db-checkpoint-thread-#22945%grid-1%][Checkpointer] Checkpoint started [checkpointId=78905be0-2629-42b5-9672-db2cd6e0bac7, startPtr=WALPointer [idx=0, fileOff=1038688, len=2048], checkpointBeforeLockTime=2ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=93ms, writeCheckpointEntryDuration=86ms, splitAndSortCpPagesDuration=0ms, pages=67, reason='test'] [21:11:18] : [Step 4/5] [2021-11-19 21:11:18,190][INFO ][db-checkpoint-thread-#22945%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:11:18] : [Step 4/5] [2021-11-19 21:11:18,190][INFO ][db-checkpoint-thread-#22945%grid-1%][Checkpointer] Checkpoint finished [cpId=78905be0-2629-42b5-9672-db2cd6e0bac7, pages=67, markPos=WALPointer [idx=0, fileOff=1038688, len=2048], walSegmentsCovered=[], markDuration=180ms, pagesWrite=4ms, fsync=16ms, total=202ms] [21:11:18] : [Step 4/5] [2021-11-19 21:11:18,191][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00a4fdec-fb9a-4106-96a3-cca8453c6000, grp=1613773252] [21:11:18] : [Step 4/5] [2021-11-19 21:11:18,199][INFO ][db-checkpoint-thread-#22942%grid-0%][Checkpointer] Checkpoint started [checkpointId=68e4c275-a083-4d6d-a6d1-6e89dbb611eb, startPtr=WALPointer [idx=0, fileOff=761014, len=2010], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=3ms, writeCheckpointEntryDuration=2ms, splitAndSortCpPagesDuration=0ms, pages=47, reason='test'] [21:11:18] : [Step 4/5] [2021-11-19 21:11:18,218][INFO ][db-checkpoint-thread-#22942%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:11:18] : [Step 4/5] [2021-11-19 21:11:18,218][INFO ][db-checkpoint-thread-#22942%grid-0%][Checkpointer] Checkpoint finished [cpId=68e4c275-a083-4d6d-a6d1-6e89dbb611eb, pages=47, markPos=WALPointer [idx=0, fileOff=761014, len=2010], walSegmentsCovered=[], markDuration=7ms, pagesWrite=1ms, fsync=17ms, total=26ms] [21:11:18] : [Step 4/5] [2021-11-19 21:11:18,273][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:18] : [Step 4/5] [2021-11-19 21:11:18,409][INFO ][disco-notifier-worker-#22803%grid-0%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:18] : [Step 4/5] [2021-11-19 21:11:18,411][INFO ][disco-notifier-worker-#22922%grid-1%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:18] : [Step 4/5] [2021-11-19 21:11:18,545][INFO ][disco-notifier-worker-#22803%grid-0%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:18] : [Step 4/5] [2021-11-19 21:11:18,546][INFO ][disco-notifier-worker-#22922%grid-1%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:18] : [Step 4/5] [2021-11-19 21:11:18,629][INFO ][disco-notifier-worker-#22803%grid-0%][GridEncryptionManager] Start master key change [masterKeyName=ignite.master.key2] [21:11:18] : [Step 4/5] [2021-11-19 21:11:18,672][INFO ][wal-file-archiver%grid-1-#22937%grid-1%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=0, segIdx=0, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000000.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000000.wal] [21:11:18] : [Step 4/5] [2021-11-19 21:11:18,673][INFO ][disco-notifier-worker-#22922%grid-1%][GridEncryptionManager] Start master key change [masterKeyName=ignite.master.key2] [21:11:18] : [Step 4/5] [2021-11-19 21:11:18,682][INFO ][wal-file-archiver%grid-1-#22937%grid-1%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000000.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000000.wal] [21:11:18] : [Step 4/5] [2021-11-19 21:11:18,684][INFO ][disco-notifier-worker-#22803%grid-0%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:18] : [Step 4/5] [2021-11-19 21:11:18,729][INFO ][disco-notifier-worker-#22922%grid-1%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:18] : [Step 4/5] [2021-11-19 21:11:18,766][INFO ][disco-notifier-worker-#22803%grid-0%][GridEncryptionManager] Master key successfully changed [masterKeyName=ignite.master.key2] [21:11:18] : [Step 4/5] [2021-11-19 21:11:18,767][INFO ][disco-notifier-worker-#22803%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=5] [21:11:18] : [Step 4/5] [2021-11-19 21:11:18,768][INFO ][reencrypt-#22963%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:11:18] : [Step 4/5] [2021-11-19 21:11:18,813][INFO ][disco-notifier-worker-#22922%grid-1%][GridEncryptionManager] Master key successfully changed [masterKeyName=ignite.master.key2] [21:11:18] : [Step 4/5] [2021-11-19 21:11:18,814][INFO ][disco-notifier-worker-#22922%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=5] [21:11:18] : [Step 4/5] [2021-11-19 21:11:18,815][INFO ][reencrypt-#22964%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:11:19] : [Step 4/5] [2021-11-19 21:11:19,016][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10ca909b-1957-42c9-93b4-147fa476d001, grp=1613773252] [21:11:19] : [Step 4/5] [2021-11-19 21:11:19,182][INFO ][db-checkpoint-thread-#22945%grid-1%][Checkpointer] Checkpoint started [checkpointId=84bbe27a-7032-413c-bfb3-2182ccb52f98, startPtr=WALPointer [idx=1, fileOff=284874, len=2048], checkpointBeforeLockTime=2ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=1ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=142ms, writeCheckpointEntryDuration=21ms, splitAndSortCpPagesDuration=0ms, pages=67, reason='test'] [21:11:19] : [Step 4/5] [2021-11-19 21:11:19,202][INFO ][db-checkpoint-thread-#22945%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:11:19] : [Step 4/5] [2021-11-19 21:11:19,202][INFO ][db-checkpoint-thread-#22945%grid-1%][Checkpointer] Checkpoint finished [cpId=84bbe27a-7032-413c-bfb3-2182ccb52f98, pages=67, markPos=WALPointer [idx=1, fileOff=284874, len=2048], walSegmentsCovered=[0], markDuration=165ms, pagesWrite=3ms, fsync=16ms, total=186ms] [21:11:19] : [Step 4/5] [2021-11-19 21:11:19,203][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00a4fdec-fb9a-4106-96a3-cca8453c6000, grp=1613773252] [21:11:19] : [Step 4/5] [2021-11-19 21:11:19,210][INFO ][db-checkpoint-thread-#22942%grid-0%][Checkpointer] Checkpoint started [checkpointId=d1a6ff0f-6720-402a-b8cd-e131b2b41348, startPtr=WALPointer [idx=0, fileOff=969812, len=2010], checkpointBeforeLockTime=2ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=3ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=0ms, pages=47, reason='test'] [21:11:19] : [Step 4/5] [2021-11-19 21:11:19,229][INFO ][db-checkpoint-thread-#22942%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:11:19] : [Step 4/5] [2021-11-19 21:11:19,229][INFO ][db-checkpoint-thread-#22942%grid-0%][Checkpointer] Checkpoint finished [cpId=d1a6ff0f-6720-402a-b8cd-e131b2b41348, pages=47, markPos=WALPointer [idx=0, fileOff=969812, len=2010], walSegmentsCovered=[], markDuration=5ms, pagesWrite=2ms, fsync=16ms, total=25ms] [21:11:19] : [Step 4/5] [2021-11-19 21:11:19,233][INFO ][disco-notifier-worker-#22922%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=6] [21:11:19] : [Step 4/5] [2021-11-19 21:11:19,233][INFO ][disco-notifier-worker-#22803%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=6] [21:11:19] : [Step 4/5] [2021-11-19 21:11:19,234][INFO ][reencrypt-#22964%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:11:19] : [Step 4/5] [2021-11-19 21:11:19,234][INFO ][reencrypt-#22963%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:11:19] : [Step 4/5] [2021-11-19 21:11:19,237][INFO ][wal-file-archiver%grid-0-#22934%grid-0%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=0, segIdx=0, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000000.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000000.wal] [21:11:19] : [Step 4/5] [2021-11-19 21:11:19,247][INFO ][wal-file-archiver%grid-0-#22934%grid-0%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000000.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000000.wal] [21:11:19] : [Step 4/5] [2021-11-19 21:11:19,307][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:19] : [Step 4/5] [2021-11-19 21:11:19,475][INFO ][disco-notifier-worker-#22803%grid-0%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:19] : [Step 4/5] [2021-11-19 21:11:19,479][INFO ][disco-notifier-worker-#22922%grid-1%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:19] : [Step 4/5] [2021-11-19 21:11:19,624][INFO ][disco-notifier-worker-#22803%grid-0%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:19] : [Step 4/5] [2021-11-19 21:11:19,640][INFO ][disco-notifier-worker-#22922%grid-1%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:19] : [Step 4/5] [2021-11-19 21:11:19,734][INFO ][disco-notifier-worker-#22803%grid-0%][GridEncryptionManager] Start master key change [masterKeyName=ignite.master.key3] [21:11:19] : [Step 4/5] [2021-11-19 21:11:19,735][INFO ][disco-notifier-worker-#22922%grid-1%][GridEncryptionManager] Start master key change [masterKeyName=ignite.master.key3] [21:11:19] : [Step 4/5] [2021-11-19 21:11:19,789][INFO ][disco-notifier-worker-#22803%grid-0%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:19] : [Step 4/5] [2021-11-19 21:11:19,791][INFO ][disco-notifier-worker-#22922%grid-1%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:19] : [Step 4/5] [2021-11-19 21:11:19,872][INFO ][disco-notifier-worker-#22922%grid-1%][GridEncryptionManager] Master key successfully changed [masterKeyName=ignite.master.key3] [21:11:19] : [Step 4/5] [2021-11-19 21:11:19,872][INFO ][disco-notifier-worker-#22803%grid-0%][GridEncryptionManager] Master key successfully changed [masterKeyName=ignite.master.key3] [21:11:19] : [Step 4/5] [2021-11-19 21:11:19,875][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10ca909b-1957-42c9-93b4-147fa476d001, grp=1613773252] [21:11:20] : [Step 4/5] [2021-11-19 21:11:20,065][INFO ][db-checkpoint-thread-#22945%grid-1%][Checkpointer] Checkpoint started [checkpointId=e075f6e0-9951-4cc2-b945-62edc6f53500, startPtr=WALPointer [idx=1, fileOff=579255, len=2048], checkpointBeforeLockTime=3ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=66ms, writeCheckpointEntryDuration=120ms, splitAndSortCpPagesDuration=0ms, pages=67, reason='test'] [21:11:20] : [Step 4/5] [2021-11-19 21:11:20,292][INFO ][db-checkpoint-thread-#22945%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:11:20] : [Step 4/5] [2021-11-19 21:11:20,293][INFO ][db-checkpoint-thread-#22945%grid-1%][Checkpointer] Checkpoint finished [cpId=e075f6e0-9951-4cc2-b945-62edc6f53500, pages=67, markPos=WALPointer [idx=1, fileOff=579255, len=2048], walSegmentsCovered=[], markDuration=188ms, pagesWrite=3ms, fsync=224ms, total=418ms] [21:11:20] : [Step 4/5] [2021-11-19 21:11:20,294][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00a4fdec-fb9a-4106-96a3-cca8453c6000, grp=1613773252] [21:11:20] : [Step 4/5] [2021-11-19 21:11:20,302][INFO ][db-checkpoint-thread-#22942%grid-0%][Checkpointer] Checkpoint started [checkpointId=f4e8298b-c3e2-49c2-bc84-e7306d61ddd8, startPtr=WALPointer [idx=1, fileOff=134236, len=2010], checkpointBeforeLockTime=2ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=4ms, walCpRecordFsyncDuration=0ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=1ms, pages=47, reason='test'] [21:11:20] : [Step 4/5] [2021-11-19 21:11:20,320][INFO ][db-checkpoint-thread-#22942%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:11:20] : [Step 4/5] [2021-11-19 21:11:20,321][INFO ][db-checkpoint-thread-#22942%grid-0%][Checkpointer] Checkpoint finished [cpId=f4e8298b-c3e2-49c2-bc84-e7306d61ddd8, pages=47, markPos=WALPointer [idx=1, fileOff=134236, len=2010], walSegmentsCovered=[0], markDuration=6ms, pagesWrite=2ms, fsync=17ms, total=27ms] [21:11:20] : [Step 4/5] [2021-11-19 21:11:20,378][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:20] : [Step 4/5] [2021-11-19 21:11:20,525][INFO ][disco-notifier-worker-#22922%grid-1%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:20] : [Step 4/5] [2021-11-19 21:11:20,526][INFO ][disco-notifier-worker-#22803%grid-0%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:20] : [Step 4/5] [2021-11-19 21:11:20,676][INFO ][disco-notifier-worker-#22922%grid-1%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:20] : [Step 4/5] [2021-11-19 21:11:20,676][INFO ][disco-notifier-worker-#22803%grid-0%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:20] : [Step 4/5] [2021-11-19 21:11:20,764][INFO ][disco-notifier-worker-#22803%grid-0%][GridEncryptionManager] Start master key change [masterKeyName=ignite.master.key2] [21:11:20] : [Step 4/5] [2021-11-19 21:11:20,764][INFO ][disco-notifier-worker-#22922%grid-1%][GridEncryptionManager] Start master key change [masterKeyName=ignite.master.key2] [21:11:20] : [Step 4/5] [2021-11-19 21:11:20,817][INFO ][disco-notifier-worker-#22803%grid-0%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:20] : [Step 4/5] [2021-11-19 21:11:20,818][INFO ][disco-notifier-worker-#22922%grid-1%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:20] : [Step 4/5] [2021-11-19 21:11:20,900][INFO ][disco-notifier-worker-#22803%grid-0%][GridEncryptionManager] Master key successfully changed [masterKeyName=ignite.master.key2] [21:11:20] : [Step 4/5] [2021-11-19 21:11:20,902][INFO ][disco-notifier-worker-#22803%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=7] [21:11:20] : [Step 4/5] [2021-11-19 21:11:20,902][INFO ][disco-notifier-worker-#22922%grid-1%][GridEncryptionManager] Master key successfully changed [masterKeyName=ignite.master.key2] [21:11:20] : [Step 4/5] [2021-11-19 21:11:20,902][INFO ][reencrypt-#22963%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:11:20] : [Step 4/5] [2021-11-19 21:11:20,903][INFO ][disco-notifier-worker-#22922%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=7] [21:11:20] : [Step 4/5] [2021-11-19 21:11:20,903][INFO ][reencrypt-#22964%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:11:21] : [Step 4/5] [2021-11-19 21:11:21,107][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10ca909b-1957-42c9-93b4-147fa476d001, grp=1613773252] [21:11:21] : [Step 4/5] [2021-11-19 21:11:21,112][INFO ][db-checkpoint-thread-#22945%grid-1%][Checkpointer] Checkpoint started [checkpointId=8fd17ef1-9a3b-48b6-b340-e0d9a3fab5c5, startPtr=WALPointer [idx=1, fileOff=876769, len=2048], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=1ms, writeCheckpointEntryDuration=2ms, splitAndSortCpPagesDuration=0ms, pages=67, reason='test'] [21:11:21] : [Step 4/5] [2021-11-19 21:11:21,131][INFO ][db-checkpoint-thread-#22945%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:11:21] : [Step 4/5] [2021-11-19 21:11:21,131][INFO ][db-checkpoint-thread-#22945%grid-1%][Checkpointer] Checkpoint finished [cpId=8fd17ef1-9a3b-48b6-b340-e0d9a3fab5c5, pages=67, markPos=WALPointer [idx=1, fileOff=876769, len=2048], walSegmentsCovered=[], markDuration=4ms, pagesWrite=3ms, fsync=16ms, total=24ms] [21:11:21] : [Step 4/5] [2021-11-19 21:11:21,133][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00a4fdec-fb9a-4106-96a3-cca8453c6000, grp=1613773252] [21:11:21] : [Step 4/5] [2021-11-19 21:11:21,141][INFO ][db-checkpoint-thread-#22942%grid-0%][Checkpointer] Checkpoint started [checkpointId=fd34982e-f5db-4ddb-883e-5f44171882f8, startPtr=WALPointer [idx=1, fileOff=348532, len=2010], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=4ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=1ms, pages=47, reason='test'] [21:11:21] : [Step 4/5] [2021-11-19 21:11:21,513][INFO ][db-checkpoint-thread-#22942%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:11:21] : [Step 4/5] [2021-11-19 21:11:21,513][INFO ][db-checkpoint-thread-#22942%grid-0%][Checkpointer] Checkpoint finished [cpId=fd34982e-f5db-4ddb-883e-5f44171882f8, pages=47, markPos=WALPointer [idx=1, fileOff=348532, len=2010], walSegmentsCovered=[], markDuration=7ms, pagesWrite=2ms, fsync=369ms, total=379ms] [21:11:21] : [Step 4/5] [2021-11-19 21:11:21,572][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:21] : [Step 4/5] [2021-11-19 21:11:21,709][INFO ][disco-notifier-worker-#22803%grid-0%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:21] : [Step 4/5] [2021-11-19 21:11:21,712][INFO ][disco-notifier-worker-#22922%grid-1%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:21] : [Step 4/5] [2021-11-19 21:11:21,849][INFO ][disco-notifier-worker-#22803%grid-0%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:21] : [Step 4/5] [2021-11-19 21:11:21,850][INFO ][disco-notifier-worker-#22922%grid-1%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:21] : [Step 4/5] [2021-11-19 21:11:21,932][INFO ][disco-notifier-worker-#22803%grid-0%][GridEncryptionManager] Start master key change [masterKeyName=ignite.master.key3] [21:11:21] : [Step 4/5] [2021-11-19 21:11:21,932][INFO ][disco-notifier-worker-#22922%grid-1%][GridEncryptionManager] Start master key change [masterKeyName=ignite.master.key3] [21:11:21] : [Step 4/5] [2021-11-19 21:11:21,986][INFO ][disco-notifier-worker-#22803%grid-0%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:21] : [Step 4/5] [2021-11-19 21:11:21,987][INFO ][disco-notifier-worker-#22922%grid-1%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:22] : [Step 4/5] [2021-11-19 21:11:22,067][INFO ][disco-notifier-worker-#22803%grid-0%][GridEncryptionManager] Master key successfully changed [masterKeyName=ignite.master.key3] [21:11:22] : [Step 4/5] [2021-11-19 21:11:22,068][INFO ][disco-notifier-worker-#22803%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=8] [21:11:22] : [Step 4/5] [2021-11-19 21:11:22,068][INFO ][disco-notifier-worker-#22922%grid-1%][GridEncryptionManager] Master key successfully changed [masterKeyName=ignite.master.key3] [21:11:22] : [Step 4/5] [2021-11-19 21:11:22,069][INFO ][reencrypt-#22963%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:11:22] : [Step 4/5] [2021-11-19 21:11:22,069][INFO ][disco-notifier-worker-#22922%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=8] [21:11:22] : [Step 4/5] [2021-11-19 21:11:22,070][INFO ][reencrypt-#22964%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:11:22] : [Step 4/5] [2021-11-19 21:11:22,178][INFO ][wal-file-archiver%grid-1-#22937%grid-1%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=1, segIdx=1, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000001.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000001.wal] [21:11:22] : [Step 4/5] [2021-11-19 21:11:22,213][INFO ][wal-file-archiver%grid-1-#22937%grid-1%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000001.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000001.wal] [21:11:22] : [Step 4/5] [2021-11-19 21:11:22,271][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10ca909b-1957-42c9-93b4-147fa476d001, grp=1613773252] [21:11:22] : [Step 4/5] [2021-11-19 21:11:22,280][INFO ][db-checkpoint-thread-#22945%grid-1%][Checkpointer] Checkpoint started [checkpointId=93c91261-c3d5-404c-ad6d-38339c545fc6, startPtr=WALPointer [idx=2, fileOff=133318, len=2048], checkpointBeforeLockTime=2ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=5ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=1ms, pages=67, reason='test'] [21:11:22] : [Step 4/5] [2021-11-19 21:11:22,299][INFO ][db-checkpoint-thread-#22945%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:11:22] : [Step 4/5] [2021-11-19 21:11:22,300][INFO ][db-checkpoint-thread-#22945%grid-1%][Checkpointer] Checkpoint finished [cpId=93c91261-c3d5-404c-ad6d-38339c545fc6, pages=67, markPos=WALPointer [idx=2, fileOff=133318, len=2048], walSegmentsCovered=[1], markDuration=7ms, pagesWrite=3ms, fsync=17ms, total=29ms] [21:11:22] : [Step 4/5] [2021-11-19 21:11:22,301][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00a4fdec-fb9a-4106-96a3-cca8453c6000, grp=1613773252] [21:11:22] : [Step 4/5] [2021-11-19 21:11:22,309][INFO ][db-checkpoint-thread-#22942%grid-0%][Checkpointer] Checkpoint started [checkpointId=c6874efa-8a40-4d02-ae73-f073a93dc541, startPtr=WALPointer [idx=1, fileOff=568990, len=2010], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=1ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=5ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=0ms, pages=47, reason='test'] [21:11:22] : [Step 4/5] [2021-11-19 21:11:22,328][INFO ][db-checkpoint-thread-#22942%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:11:22] : [Step 4/5] [2021-11-19 21:11:22,329][INFO ][db-checkpoint-thread-#22942%grid-0%][Checkpointer] Checkpoint finished [cpId=c6874efa-8a40-4d02-ae73-f073a93dc541, pages=47, markPos=WALPointer [idx=1, fileOff=568990, len=2010], walSegmentsCovered=[], markDuration=8ms, pagesWrite=2ms, fsync=17ms, total=28ms] [21:11:22] : [Step 4/5] [2021-11-19 21:11:22,333][INFO ][disco-notifier-worker-#22803%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=9] [21:11:22] : [Step 4/5] [2021-11-19 21:11:22,333][INFO ][disco-notifier-worker-#22922%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=9] [21:11:22] : [Step 4/5] [2021-11-19 21:11:22,333][INFO ][reencrypt-#22963%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:11:22] : [Step 4/5] [2021-11-19 21:11:22,333][INFO ][reencrypt-#22964%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:11:22] : [Step 4/5] [2021-11-19 21:11:22,410][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:22] : [Step 4/5] [2021-11-19 21:11:22,545][INFO ][disco-notifier-worker-#22803%grid-0%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:22] : [Step 4/5] [2021-11-19 21:11:22,546][INFO ][disco-notifier-worker-#22922%grid-1%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:22] : [Step 4/5] [2021-11-19 21:11:22,680][INFO ][disco-notifier-worker-#22803%grid-0%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:22] : [Step 4/5] [2021-11-19 21:11:22,680][INFO ][disco-notifier-worker-#22922%grid-1%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:22] : [Step 4/5] [2021-11-19 21:11:22,764][INFO ][disco-notifier-worker-#22803%grid-0%][GridEncryptionManager] Start master key change [masterKeyName=ignite.master.key2] [21:11:22] : [Step 4/5] [2021-11-19 21:11:22,765][INFO ][disco-notifier-worker-#22922%grid-1%][GridEncryptionManager] Start master key change [masterKeyName=ignite.master.key2] [21:11:22] : [Step 4/5] [2021-11-19 21:11:22,821][INFO ][disco-notifier-worker-#22922%grid-1%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:22] : [Step 4/5] [2021-11-19 21:11:22,837][INFO ][disco-notifier-worker-#22803%grid-0%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:22] : [Step 4/5] [2021-11-19 21:11:22,902][INFO ][disco-notifier-worker-#22922%grid-1%][GridEncryptionManager] Master key successfully changed [masterKeyName=ignite.master.key2] [21:11:22] : [Step 4/5] [2021-11-19 21:11:22,928][INFO ][disco-notifier-worker-#22803%grid-0%][GridEncryptionManager] Master key successfully changed [masterKeyName=ignite.master.key2] [21:11:22] : [Step 4/5] [2021-11-19 21:11:22,929][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10ca909b-1957-42c9-93b4-147fa476d001, grp=1613773252] [21:11:23] : [Step 4/5] [2021-11-19 21:11:23,286][INFO ][db-checkpoint-thread-#22945%grid-1%][Checkpointer] Checkpoint started [checkpointId=d5ce01b0-abb1-4cbe-8bd7-5b3a4722924c, startPtr=WALPointer [idx=2, fileOff=436389, len=2048], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=118ms, writeCheckpointEntryDuration=237ms, splitAndSortCpPagesDuration=0ms, pages=68, reason='test'] [21:11:23] : [Step 4/5] [2021-11-19 21:11:23,310][INFO ][db-checkpoint-thread-#22945%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:11:23] : [Step 4/5] [2021-11-19 21:11:23,310][INFO ][db-checkpoint-thread-#22945%grid-1%][Checkpointer] Checkpoint finished [cpId=d5ce01b0-abb1-4cbe-8bd7-5b3a4722924c, pages=68, markPos=WALPointer [idx=2, fileOff=436389, len=2048], walSegmentsCovered=[], markDuration=356ms, pagesWrite=3ms, fsync=20ms, total=380ms] [21:11:23] : [Step 4/5] [2021-11-19 21:11:23,312][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00a4fdec-fb9a-4106-96a3-cca8453c6000, grp=1613773252] [21:11:23] : [Step 4/5] [2021-11-19 21:11:23,319][INFO ][db-checkpoint-thread-#22942%grid-0%][Checkpointer] Checkpoint started [checkpointId=ad0e5410-ed8d-49c9-879e-f107fe2e16ba, startPtr=WALPointer [idx=1, fileOff=788843, len=2010], checkpointBeforeLockTime=2ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=4ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=0ms, pages=48, reason='test'] [21:11:23] : [Step 4/5] [2021-11-19 21:11:23,338][INFO ][db-checkpoint-thread-#22942%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:11:23] : [Step 4/5] [2021-11-19 21:11:23,339][INFO ][db-checkpoint-thread-#22942%grid-0%][Checkpointer] Checkpoint finished [cpId=ad0e5410-ed8d-49c9-879e-f107fe2e16ba, pages=48, markPos=WALPointer [idx=1, fileOff=788843, len=2010], walSegmentsCovered=[], markDuration=6ms, pagesWrite=2ms, fsync=17ms, total=27ms] [21:11:23] : [Step 4/5] [2021-11-19 21:11:23,396][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:23] : [Step 4/5] [2021-11-19 21:11:23,533][INFO ][disco-notifier-worker-#22922%grid-1%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:23] : [Step 4/5] [2021-11-19 21:11:23,548][INFO ][disco-notifier-worker-#22803%grid-0%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:23] : [Step 4/5] [2021-11-19 21:11:23,667][INFO ][disco-notifier-worker-#22922%grid-1%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:23] : [Step 4/5] [2021-11-19 21:11:23,682][INFO ][disco-notifier-worker-#22803%grid-0%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:23] : [Step 4/5] [2021-11-19 21:11:23,764][INFO ][disco-notifier-worker-#22803%grid-0%][GridEncryptionManager] Start master key change [masterKeyName=ignite.master.key3] [21:11:23] : [Step 4/5] [2021-11-19 21:11:23,764][INFO ][disco-notifier-worker-#22922%grid-1%][GridEncryptionManager] Start master key change [masterKeyName=ignite.master.key3] [21:11:23] : [Step 4/5] [2021-11-19 21:11:23,819][INFO ][disco-notifier-worker-#22922%grid-1%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:23] : [Step 4/5] [2021-11-19 21:11:23,827][INFO ][disco-notifier-worker-#22803%grid-0%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:23] : [Step 4/5] [2021-11-19 21:11:23,901][INFO ][disco-notifier-worker-#22922%grid-1%][GridEncryptionManager] Master key successfully changed [masterKeyName=ignite.master.key3] [21:11:23] : [Step 4/5] [2021-11-19 21:11:23,902][INFO ][disco-notifier-worker-#22922%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=10] [21:11:23] : [Step 4/5] [2021-11-19 21:11:23,902][INFO ][reencrypt-#22964%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:11:23] : [Step 4/5] [2021-11-19 21:11:23,910][INFO ][disco-notifier-worker-#22803%grid-0%][GridEncryptionManager] Master key successfully changed [masterKeyName=ignite.master.key3] [21:11:23] : [Step 4/5] [2021-11-19 21:11:23,912][INFO ][disco-notifier-worker-#22803%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=10] [21:11:23] : [Step 4/5] [2021-11-19 21:11:23,912][INFO ][reencrypt-#22963%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:11:24] : [Step 4/5] [2021-11-19 21:11:24,113][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10ca909b-1957-42c9-93b4-147fa476d001, grp=1613773252] [21:11:24] : [Step 4/5] [2021-11-19 21:11:24,316][INFO ][db-checkpoint-thread-#22945%grid-1%][Checkpointer] Checkpoint started [checkpointId=0225670a-15f1-44be-b049-53672297c07d, startPtr=WALPointer [idx=2, fileOff=749668, len=2048], checkpointBeforeLockTime=2ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=25ms, writeCheckpointEntryDuration=176ms, splitAndSortCpPagesDuration=0ms, pages=68, reason='test'] [21:11:24] : [Step 4/5] [2021-11-19 21:11:24,417][INFO ][db-checkpoint-thread-#22945%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:11:24] : [Step 4/5] [2021-11-19 21:11:24,418][INFO ][db-checkpoint-thread-#22945%grid-1%][Checkpointer] Checkpoint finished [cpId=0225670a-15f1-44be-b049-53672297c07d, pages=68, markPos=WALPointer [idx=2, fileOff=749668, len=2048], walSegmentsCovered=[], markDuration=202ms, pagesWrite=3ms, fsync=98ms, total=305ms] [21:11:24] : [Step 4/5] [2021-11-19 21:11:24,419][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00a4fdec-fb9a-4106-96a3-cca8453c6000, grp=1613773252] [21:11:24] : [Step 4/5] [2021-11-19 21:11:24,427][INFO ][db-checkpoint-thread-#22942%grid-0%][Checkpointer] Checkpoint started [checkpointId=829a584f-c243-4a53-9ab5-f1973274b20e, startPtr=WALPointer [idx=1, fileOff=1018904, len=2010], checkpointBeforeLockTime=2ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=2ms, checkpointLockHoldTime=2ms, walCpRecordFsyncDuration=2ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=0ms, pages=48, reason='test'] [21:11:24] : [Step 4/5] [2021-11-19 21:11:24,458][INFO ][db-checkpoint-thread-#22942%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:11:24] : [Step 4/5] [2021-11-19 21:11:24,459][INFO ][db-checkpoint-thread-#22942%grid-0%][Checkpointer] Checkpoint finished [cpId=829a584f-c243-4a53-9ab5-f1973274b20e, pages=48, markPos=WALPointer [idx=1, fileOff=1018904, len=2010], walSegmentsCovered=[], markDuration=6ms, pagesWrite=6ms, fsync=26ms, total=40ms] [21:11:24] : [Step 4/5] [2021-11-19 21:11:24,467][INFO ][wal-file-archiver%grid-0-#22934%grid-0%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=1, segIdx=1, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000001.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000001.wal] [21:11:24] : [Step 4/5] [2021-11-19 21:11:24,469][INFO ][disco-notifier-worker-#22803%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=11] [21:11:24] : [Step 4/5] [2021-11-19 21:11:24,469][INFO ][reencrypt-#22963%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:11:24] : [Step 4/5] [2021-11-19 21:11:24,469][INFO ][disco-notifier-worker-#22922%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=11] [21:11:24] : [Step 4/5] [2021-11-19 21:11:24,470][INFO ][reencrypt-#22964%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:11:24] : [Step 4/5] [2021-11-19 21:11:24,485][INFO ][wal-file-archiver%grid-0-#22934%grid-0%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000001.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000001.wal] [21:11:24] : [Step 4/5] [2021-11-19 21:11:24,518][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:24] : [Step 4/5] [2021-11-19 21:11:24,655][INFO ][disco-notifier-worker-#22803%grid-0%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:24] : [Step 4/5] [2021-11-19 21:11:24,655][INFO ][disco-notifier-worker-#22922%grid-1%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:24] : [Step 4/5] [2021-11-19 21:11:24,788][INFO ][disco-notifier-worker-#22803%grid-0%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:24] : [Step 4/5] [2021-11-19 21:11:24,789][INFO ][disco-notifier-worker-#22922%grid-1%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:24] : [Step 4/5] [2021-11-19 21:11:24,870][INFO ][disco-notifier-worker-#22803%grid-0%][GridEncryptionManager] Start master key change [masterKeyName=ignite.master.key2] [21:11:24] : [Step 4/5] [2021-11-19 21:11:24,870][INFO ][disco-notifier-worker-#22922%grid-1%][GridEncryptionManager] Start master key change [masterKeyName=ignite.master.key2] [21:11:24] : [Step 4/5] [2021-11-19 21:11:24,925][INFO ][disco-notifier-worker-#22922%grid-1%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:24] : [Step 4/5] [2021-11-19 21:11:24,927][INFO ][disco-notifier-worker-#22803%grid-0%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:25] : [Step 4/5] [2021-11-19 21:11:25,009][INFO ][wal-file-archiver%grid-1-#22937%grid-1%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=2, segIdx=2, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000002.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000002.wal] [21:11:25] : [Step 4/5] [2021-11-19 21:11:25,010][INFO ][disco-notifier-worker-#22803%grid-0%][GridEncryptionManager] Master key successfully changed [masterKeyName=ignite.master.key2] [21:11:25] : [Step 4/5] [2021-11-19 21:11:25,010][INFO ][disco-notifier-worker-#22922%grid-1%][GridEncryptionManager] Master key successfully changed [masterKeyName=ignite.master.key2] [21:11:25] : [Step 4/5] [2021-11-19 21:11:25,012][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10ca909b-1957-42c9-93b4-147fa476d001, grp=1613773252] [21:11:25] : [Step 4/5] [2021-11-19 21:11:25,019][INFO ][wal-file-archiver%grid-1-#22937%grid-1%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000002.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000002.wal] [21:11:25] : [Step 4/5] [2021-11-19 21:11:25,028][INFO ][db-checkpoint-thread-#22945%grid-1%][Checkpointer] Checkpoint started [checkpointId=d00da7db-6f09-4e79-ac09-735582f319f9, startPtr=WALPointer [idx=3, fileOff=21877, len=2048], checkpointBeforeLockTime=2ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=4ms, writeCheckpointEntryDuration=9ms, splitAndSortCpPagesDuration=1ms, pages=69, reason='test'] [21:11:25] : [Step 4/5] [2021-11-19 21:11:25,047][INFO ][db-checkpoint-thread-#22945%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:11:25] : [Step 4/5] [2021-11-19 21:11:25,047][INFO ][db-checkpoint-thread-#22945%grid-1%][Checkpointer] Checkpoint finished [cpId=d00da7db-6f09-4e79-ac09-735582f319f9, pages=69, markPos=WALPointer [idx=3, fileOff=21877, len=2048], walSegmentsCovered=[2], markDuration=14ms, pagesWrite=3ms, fsync=16ms, total=35ms] [21:11:25] : [Step 4/5] [2021-11-19 21:11:25,049][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00a4fdec-fb9a-4106-96a3-cca8453c6000, grp=1613773252] [21:11:25] : [Step 4/5] [2021-11-19 21:11:25,056][INFO ][db-checkpoint-thread-#22942%grid-0%][Checkpointer] Checkpoint started [checkpointId=59f9aa73-7a19-4dc3-a6f8-6e2edbf1186f, startPtr=WALPointer [idx=2, fileOff=209361, len=2010], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=3ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=0ms, pages=49, reason='test'] [21:11:25] : [Step 4/5] [2021-11-19 21:11:25,075][INFO ][db-checkpoint-thread-#22942%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:11:25] : [Step 4/5] [2021-11-19 21:11:25,075][INFO ][db-checkpoint-thread-#22942%grid-0%][Checkpointer] Checkpoint finished [cpId=59f9aa73-7a19-4dc3-a6f8-6e2edbf1186f, pages=49, markPos=WALPointer [idx=2, fileOff=209361, len=2010], walSegmentsCovered=[1], markDuration=6ms, pagesWrite=2ms, fsync=16ms, total=25ms] [21:11:25] : [Step 4/5] [2021-11-19 21:11:25,079][INFO ][disco-notifier-worker-#22803%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=12] [21:11:25] : [Step 4/5] [2021-11-19 21:11:25,080][INFO ][disco-notifier-worker-#22922%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=12] [21:11:25] : [Step 4/5] [2021-11-19 21:11:25,080][INFO ][reencrypt-#22963%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:11:25] : [Step 4/5] [2021-11-19 21:11:25,080][INFO ][reencrypt-#22964%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:11:25] : [Step 4/5] [2021-11-19 21:11:25,131][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:25] : [Step 4/5] [2021-11-19 21:11:25,270][INFO ][disco-notifier-worker-#22922%grid-1%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:25] : [Step 4/5] [2021-11-19 21:11:25,271][INFO ][disco-notifier-worker-#22803%grid-0%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:25] : [Step 4/5] [2021-11-19 21:11:25,409][INFO ][disco-notifier-worker-#22922%grid-1%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:25] : [Step 4/5] [2021-11-19 21:11:25,416][INFO ][disco-notifier-worker-#22803%grid-0%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:25] : [Step 4/5] [2021-11-19 21:11:25,499][INFO ][disco-notifier-worker-#22803%grid-0%][GridEncryptionManager] Start master key change [masterKeyName=ignite.master.key3] [21:11:25] : [Step 4/5] [2021-11-19 21:11:25,499][INFO ][disco-notifier-worker-#22922%grid-1%][GridEncryptionManager] Start master key change [masterKeyName=ignite.master.key3] [21:11:25] : [Step 4/5] [2021-11-19 21:11:25,554][INFO ][disco-notifier-worker-#22803%grid-0%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:25] : [Step 4/5] [2021-11-19 21:11:25,564][INFO ][disco-notifier-worker-#22922%grid-1%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:25] : [Step 4/5] [2021-11-19 21:11:25,641][INFO ][disco-notifier-worker-#22803%grid-0%][GridEncryptionManager] Master key successfully changed [masterKeyName=ignite.master.key3] [21:11:25] : [Step 4/5] [2021-11-19 21:11:25,655][INFO ][disco-notifier-worker-#22922%grid-1%][GridEncryptionManager] Master key successfully changed [masterKeyName=ignite.master.key3] [21:11:25] : [Step 4/5] [2021-11-19 21:11:25,656][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10ca909b-1957-42c9-93b4-147fa476d001, grp=1613773252] [21:11:25] : [Step 4/5] [2021-11-19 21:11:25,660][INFO ][db-checkpoint-thread-#22945%grid-1%][Checkpointer] Checkpoint started [checkpointId=5862d13f-f6a6-4511-ac42-c650388f83ec, startPtr=WALPointer [idx=3, fileOff=339950, len=2048], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=1ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=0ms, pages=68, reason='test'] [21:11:25] : [Step 4/5] [2021-11-19 21:11:25,679][INFO ][db-checkpoint-thread-#22945%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:11:25] : [Step 4/5] [2021-11-19 21:11:25,680][INFO ][db-checkpoint-thread-#22945%grid-1%][Checkpointer] Checkpoint finished [cpId=5862d13f-f6a6-4511-ac42-c650388f83ec, pages=68, markPos=WALPointer [idx=3, fileOff=339950, len=2048], walSegmentsCovered=[], markDuration=3ms, pagesWrite=3ms, fsync=16ms, total=23ms] [21:11:25] : [Step 4/5] [2021-11-19 21:11:25,682][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00a4fdec-fb9a-4106-96a3-cca8453c6000, grp=1613773252] [21:11:25] : [Step 4/5] [2021-11-19 21:11:25,688][INFO ][db-checkpoint-thread-#22942%grid-0%][Checkpointer] Checkpoint started [checkpointId=89c026a7-90bc-4e68-bfac-9790ac5378cc, startPtr=WALPointer [idx=2, fileOff=444216, len=2010], checkpointBeforeLockTime=4ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=1ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=0ms, pages=48, reason='test'] [21:11:25] : [Step 4/5] [2021-11-19 21:11:25,707][INFO ][db-checkpoint-thread-#22942%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:11:25] : [Step 4/5] [2021-11-19 21:11:25,708][INFO ][db-checkpoint-thread-#22942%grid-0%][Checkpointer] Checkpoint finished [cpId=89c026a7-90bc-4e68-bfac-9790ac5378cc, pages=48, markPos=WALPointer [idx=2, fileOff=444216, len=2010], walSegmentsCovered=[], markDuration=3ms, pagesWrite=2ms, fsync=17ms, total=26ms] [21:11:25] : [Step 4/5] [2021-11-19 21:11:25,767][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:25] : [Step 4/5] [2021-11-19 21:11:25,935][INFO ][disco-notifier-worker-#22803%grid-0%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:25] : [Step 4/5] [2021-11-19 21:11:25,938][INFO ][disco-notifier-worker-#22922%grid-1%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:26] : [Step 4/5] [2021-11-19 21:11:26,095][INFO ][disco-notifier-worker-#22803%grid-0%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:26] : [Step 4/5] [2021-11-19 21:11:26,102][INFO ][disco-notifier-worker-#22922%grid-1%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:26] : [Step 4/5] [2021-11-19 21:11:26,188][INFO ][disco-notifier-worker-#22803%grid-0%][GridEncryptionManager] Start master key change [masterKeyName=ignite.master.key2] [21:11:26] : [Step 4/5] [2021-11-19 21:11:26,188][INFO ][disco-notifier-worker-#22922%grid-1%][GridEncryptionManager] Start master key change [masterKeyName=ignite.master.key2] [21:11:26] : [Step 4/5] [2021-11-19 21:11:26,244][INFO ][disco-notifier-worker-#22803%grid-0%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:26] : [Step 4/5] [2021-11-19 21:11:26,248][INFO ][disco-notifier-worker-#22922%grid-1%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:26] : [Step 4/5] [2021-11-19 21:11:26,329][INFO ][disco-notifier-worker-#22803%grid-0%][GridEncryptionManager] Master key successfully changed [masterKeyName=ignite.master.key2] [21:11:26] : [Step 4/5] [2021-11-19 21:11:26,331][INFO ][disco-notifier-worker-#22803%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=13] [21:11:26] : [Step 4/5] [2021-11-19 21:11:26,331][INFO ][disco-notifier-worker-#22922%grid-1%][GridEncryptionManager] Master key successfully changed [masterKeyName=ignite.master.key2] [21:11:26] : [Step 4/5] [2021-11-19 21:11:26,331][INFO ][reencrypt-#22963%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:11:26] : [Step 4/5] [2021-11-19 21:11:26,333][INFO ][disco-notifier-worker-#22922%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=13] [21:11:26] : [Step 4/5] [2021-11-19 21:11:26,333][INFO ][reencrypt-#22964%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:11:26] : [Step 4/5] [2021-11-19 21:11:26,343][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10ca909b-1957-42c9-93b4-147fa476d001, grp=1613773252] [21:11:26] : [Step 4/5] [2021-11-19 21:11:26,350][INFO ][db-checkpoint-thread-#22945%grid-1%][Checkpointer] Checkpoint started [checkpointId=efa42cb1-34bd-4577-9d3c-be6e39043965, startPtr=WALPointer [idx=3, fileOff=660784, len=2048], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=4ms, writeCheckpointEntryDuration=2ms, splitAndSortCpPagesDuration=0ms, pages=68, reason='test'] [21:11:26] : [Step 4/5] [2021-11-19 21:11:26,373][INFO ][db-checkpoint-thread-#22945%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:11:26] : [Step 4/5] [2021-11-19 21:11:26,373][INFO ][db-checkpoint-thread-#22945%grid-1%][Checkpointer] Checkpoint finished [cpId=efa42cb1-34bd-4577-9d3c-be6e39043965, pages=68, markPos=WALPointer [idx=3, fileOff=660784, len=2048], walSegmentsCovered=[], markDuration=7ms, pagesWrite=6ms, fsync=16ms, total=30ms] [21:11:26] : [Step 4/5] [2021-11-19 21:11:26,375][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00a4fdec-fb9a-4106-96a3-cca8453c6000, grp=1613773252] [21:11:26] : [Step 4/5] [2021-11-19 21:11:26,386][INFO ][db-checkpoint-thread-#22942%grid-0%][Checkpointer] Checkpoint started [checkpointId=5b6202c8-2e5d-4f06-bfe6-75c27eb5b949, startPtr=WALPointer [idx=2, fileOff=681832, len=2010], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=6ms, writeCheckpointEntryDuration=3ms, splitAndSortCpPagesDuration=1ms, pages=48, reason='test'] [21:11:26] : [Step 4/5] [2021-11-19 21:11:26,405][INFO ][db-checkpoint-thread-#22942%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:11:26] : [Step 4/5] [2021-11-19 21:11:26,405][INFO ][db-checkpoint-thread-#22942%grid-0%][Checkpointer] Checkpoint finished [cpId=5b6202c8-2e5d-4f06-bfe6-75c27eb5b949, pages=48, markPos=WALPointer [idx=2, fileOff=681832, len=2010], walSegmentsCovered=[], markDuration=11ms, pagesWrite=2ms, fsync=16ms, total=30ms] [21:11:26] : [Step 4/5] [2021-11-19 21:11:26,469][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:26] : [Step 4/5] [2021-11-19 21:11:26,634][INFO ][disco-notifier-worker-#22803%grid-0%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:26] : [Step 4/5] [2021-11-19 21:11:26,640][INFO ][disco-notifier-worker-#22922%grid-1%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:26] : [Step 4/5] [2021-11-19 21:11:26,788][INFO ][disco-notifier-worker-#22922%grid-1%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:26] : [Step 4/5] [2021-11-19 21:11:26,789][INFO ][disco-notifier-worker-#22803%grid-0%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:26] : [Step 4/5] [2021-11-19 21:11:26,891][INFO ][disco-notifier-worker-#22803%grid-0%][GridEncryptionManager] Start master key change [masterKeyName=ignite.master.key3] [21:11:26] : [Step 4/5] [2021-11-19 21:11:26,892][INFO ][disco-notifier-worker-#22922%grid-1%][GridEncryptionManager] Start master key change [masterKeyName=ignite.master.key3] [21:11:26] : [Step 4/5] [2021-11-19 21:11:26,947][INFO ][disco-notifier-worker-#22922%grid-1%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:26] : [Step 4/5] [2021-11-19 21:11:26,947][INFO ][disco-notifier-worker-#22803%grid-0%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:27] : [Step 4/5] [2021-11-19 21:11:27,028][INFO ][disco-notifier-worker-#22922%grid-1%][GridEncryptionManager] Master key successfully changed [masterKeyName=ignite.master.key3] [21:11:27] : [Step 4/5] [2021-11-19 21:11:27,029][INFO ][disco-notifier-worker-#22803%grid-0%][GridEncryptionManager] Master key successfully changed [masterKeyName=ignite.master.key3] [21:11:27] : [Step 4/5] [2021-11-19 21:11:27,031][INFO ][disco-notifier-worker-#22803%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=14] [21:11:27] : [Step 4/5] [2021-11-19 21:11:27,031][INFO ][reencrypt-#22963%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:11:27] : [Step 4/5] [2021-11-19 21:11:27,031][INFO ][disco-notifier-worker-#22922%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=14] [21:11:27] : [Step 4/5] [2021-11-19 21:11:27,032][INFO ][reencrypt-#22964%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:11:27] : [Step 4/5] [2021-11-19 21:11:27,233][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10ca909b-1957-42c9-93b4-147fa476d001, grp=1613773252] [21:11:27] : [Step 4/5] [2021-11-19 21:11:27,362][INFO ][db-checkpoint-thread-#22945%grid-1%][Checkpointer] Checkpoint started [checkpointId=2ceabe81-9a0a-4afd-91b4-4aa09777efd4, startPtr=WALPointer [idx=3, fileOff=982112, len=2048], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=63ms, writeCheckpointEntryDuration=65ms, splitAndSortCpPagesDuration=0ms, pages=68, reason='test'] [21:11:27] : [Step 4/5] [2021-11-19 21:11:27,806][INFO ][db-checkpoint-thread-#22945%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:11:27] : [Step 4/5] [2021-11-19 21:11:27,807][INFO ][db-checkpoint-thread-#22945%grid-1%][Checkpointer] Checkpoint finished [cpId=2ceabe81-9a0a-4afd-91b4-4aa09777efd4, pages=68, markPos=WALPointer [idx=3, fileOff=982112, len=2048], walSegmentsCovered=[], markDuration=129ms, pagesWrite=3ms, fsync=441ms, total=574ms] [21:11:27] : [Step 4/5] [2021-11-19 21:11:27,808][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00a4fdec-fb9a-4106-96a3-cca8453c6000, grp=1613773252] [21:11:27] : [Step 4/5] [2021-11-19 21:11:27,817][INFO ][db-checkpoint-thread-#22942%grid-0%][Checkpointer] Checkpoint started [checkpointId=d8d82eb9-4b0f-41e4-938b-05abb4e2e93f, startPtr=WALPointer [idx=2, fileOff=919942, len=2010], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=5ms, writeCheckpointEntryDuration=2ms, splitAndSortCpPagesDuration=0ms, pages=48, reason='test'] [21:11:27] : [Step 4/5] [2021-11-19 21:11:27,847][INFO ][db-checkpoint-thread-#22942%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:11:27] : [Step 4/5] [2021-11-19 21:11:27,847][INFO ][db-checkpoint-thread-#22942%grid-0%][Checkpointer] Checkpoint finished [cpId=d8d82eb9-4b0f-41e4-938b-05abb4e2e93f, pages=48, markPos=WALPointer [idx=2, fileOff=919942, len=2010], walSegmentsCovered=[], markDuration=8ms, pagesWrite=2ms, fsync=27ms, total=38ms] [21:11:27] : [Step 4/5] [2021-11-19 21:11:27,905][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:28] : [Step 4/5] [2021-11-19 21:11:28,053][INFO ][disco-notifier-worker-#22922%grid-1%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:28] : [Step 4/5] [2021-11-19 21:11:28,058][INFO ][disco-notifier-worker-#22803%grid-0%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:28] : [Step 4/5] [2021-11-19 21:11:28,222][INFO ][disco-notifier-worker-#22922%grid-1%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:28] : [Step 4/5] [2021-11-19 21:11:28,228][INFO ][disco-notifier-worker-#22803%grid-0%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:28] : [Step 4/5] [2021-11-19 21:11:28,315][INFO ][disco-notifier-worker-#22803%grid-0%][GridEncryptionManager] Start master key change [masterKeyName=ignite.master.key2] [21:11:28] : [Step 4/5] [2021-11-19 21:11:28,316][INFO ][disco-notifier-worker-#22922%grid-1%][GridEncryptionManager] Start master key change [masterKeyName=ignite.master.key2] [21:11:28] : [Step 4/5] [2021-11-19 21:11:28,375][INFO ][disco-notifier-worker-#22803%grid-0%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:28] : [Step 4/5] [2021-11-19 21:11:28,375][INFO ][disco-notifier-worker-#22922%grid-1%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:28] : [Step 4/5] [2021-11-19 21:11:28,483][INFO ][disco-notifier-worker-#22803%grid-0%][GridEncryptionManager] Master key successfully changed [masterKeyName=ignite.master.key2] [21:11:28] : [Step 4/5] [2021-11-19 21:11:28,485][INFO ][disco-notifier-worker-#22803%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=15] [21:11:28] : [Step 4/5] [2021-11-19 21:11:28,488][INFO ][reencrypt-#22963%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:11:28] : [Step 4/5] [2021-11-19 21:11:28,523][INFO ][wal-file-archiver%grid-0-#22934%grid-0%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=2, segIdx=2, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000002.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000002.wal] [21:11:28] : [Step 4/5] [2021-11-19 21:11:28,524][INFO ][disco-notifier-worker-#22922%grid-1%][GridEncryptionManager] Master key successfully changed [masterKeyName=ignite.master.key2] [21:11:28] : [Step 4/5] [2021-11-19 21:11:28,524][INFO ][wal-file-archiver%grid-1-#22937%grid-1%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=3, segIdx=3, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000003.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000003.wal] [21:11:28] : [Step 4/5] [2021-11-19 21:11:28,526][INFO ][disco-notifier-worker-#22922%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=15] [21:11:28] : [Step 4/5] [2021-11-19 21:11:28,527][INFO ][reencrypt-#22964%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:11:28] : [Step 4/5] [2021-11-19 21:11:28,710][INFO ][wal-file-archiver%grid-0-#22934%grid-0%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000002.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000002.wal] [21:11:28] : [Step 4/5] [2021-11-19 21:11:28,710][INFO ][wal-file-archiver%grid-1-#22937%grid-1%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000003.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000003.wal] [21:11:28] : [Step 4/5] [2021-11-19 21:11:28,729][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10ca909b-1957-42c9-93b4-147fa476d001, grp=1613773252] [21:11:29] : [Step 4/5] [2021-11-19 21:11:29,001][INFO ][db-checkpoint-thread-#22945%grid-1%][Checkpointer] Checkpoint started [checkpointId=c745ff2e-280c-4ec4-9dab-af71d369fe93, startPtr=WALPointer [idx=4, fileOff=263410, len=2048], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=78ms, writeCheckpointEntryDuration=193ms, splitAndSortCpPagesDuration=0ms, pages=69, reason='test'] [21:11:29] : [Step 4/5] [2021-11-19 21:11:29,363][INFO ][db-checkpoint-thread-#22945%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:11:29] : [Step 4/5] [2021-11-19 21:11:29,364][INFO ][db-checkpoint-thread-#22945%grid-1%][Checkpointer] Checkpoint finished [cpId=c745ff2e-280c-4ec4-9dab-af71d369fe93, pages=69, markPos=WALPointer [idx=4, fileOff=263410, len=2048], walSegmentsCovered=[3], markDuration=272ms, pagesWrite=3ms, fsync=359ms, total=635ms] [21:11:29] : [Step 4/5] [2021-11-19 21:11:29,365][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00a4fdec-fb9a-4106-96a3-cca8453c6000, grp=1613773252] [21:11:29] : [Step 4/5] [2021-11-19 21:11:29,380][INFO ][db-checkpoint-thread-#22942%grid-0%][Checkpointer] Checkpoint started [checkpointId=2d2b5329-7a87-4d82-ad03-6b37ddde739c, startPtr=WALPointer [idx=3, fileOff=116682, len=2010], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=1ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=4ms, writeCheckpointEntryDuration=9ms, splitAndSortCpPagesDuration=0ms, pages=49, reason='test'] [21:11:29] : [Step 4/5] [2021-11-19 21:11:29,400][INFO ][db-checkpoint-thread-#22942%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:11:29] : [Step 4/5] [2021-11-19 21:11:29,401][INFO ][db-checkpoint-thread-#22942%grid-0%][Checkpointer] Checkpoint finished [cpId=2d2b5329-7a87-4d82-ad03-6b37ddde739c, pages=49, markPos=WALPointer [idx=3, fileOff=116682, len=2010], walSegmentsCovered=[2], markDuration=15ms, pagesWrite=3ms, fsync=16ms, total=34ms] [21:11:29] : [Step 4/5] [2021-11-19 21:11:29,406][INFO ][disco-notifier-worker-#22803%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=16] [21:11:29] : [Step 4/5] [2021-11-19 21:11:29,406][INFO ][reencrypt-#22963%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:11:29] : [Step 4/5] [2021-11-19 21:11:29,406][INFO ][disco-notifier-worker-#22922%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=16] [21:11:29] : [Step 4/5] [2021-11-19 21:11:29,407][INFO ][reencrypt-#22964%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:11:29] : [Step 4/5] [2021-11-19 21:11:29,461][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:29] : [Step 4/5] [2021-11-19 21:11:29,612][INFO ][disco-notifier-worker-#22922%grid-1%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:29] : [Step 4/5] [2021-11-19 21:11:29,613][INFO ][disco-notifier-worker-#22803%grid-0%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:29] : [Step 4/5] [2021-11-19 21:11:29,783][INFO ][disco-notifier-worker-#22922%grid-1%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:29] : [Step 4/5] [2021-11-19 21:11:29,789][INFO ][disco-notifier-worker-#22803%grid-0%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:29] : [Step 4/5] [2021-11-19 21:11:29,897][INFO ][disco-notifier-worker-#22803%grid-0%][GridEncryptionManager] Start master key change [masterKeyName=ignite.master.key3] [21:11:29] : [Step 4/5] [2021-11-19 21:11:29,897][INFO ][disco-notifier-worker-#22922%grid-1%][GridEncryptionManager] Start master key change [masterKeyName=ignite.master.key3] [21:11:29] : [Step 4/5] [2021-11-19 21:11:29,969][INFO ][disco-notifier-worker-#22922%grid-1%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:29] : [Step 4/5] [2021-11-19 21:11:29,970][INFO ][disco-notifier-worker-#22803%grid-0%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:30] : [Step 4/5] [2021-11-19 21:11:30,078][INFO ][disco-notifier-worker-#22922%grid-1%][GridEncryptionManager] Master key successfully changed [masterKeyName=ignite.master.key3] [21:11:30] : [Step 4/5] [2021-11-19 21:11:30,080][INFO ][disco-notifier-worker-#22803%grid-0%][GridEncryptionManager] Master key successfully changed [masterKeyName=ignite.master.key3] [21:11:30] : [Step 4/5] [2021-11-19 21:11:30,083][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10ca909b-1957-42c9-93b4-147fa476d001, grp=1613773252] [21:11:30] : [Step 4/5] [2021-11-19 21:11:30,554][INFO ][db-checkpoint-thread-#22945%grid-1%][Checkpointer] Checkpoint started [checkpointId=c02c5d8b-20cf-4a7a-b5ce-77af3333453a, startPtr=WALPointer [idx=4, fileOff=586239, len=2048], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=239ms, writeCheckpointEntryDuration=230ms, splitAndSortCpPagesDuration=0ms, pages=67, reason='test'] [21:11:31] : [Step 4/5] [2021-11-19 21:11:31,076][INFO ][db-checkpoint-thread-#22945%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:11:31] : [Step 4/5] [2021-11-19 21:11:31,077][INFO ][db-checkpoint-thread-#22945%grid-1%][Checkpointer] Checkpoint finished [cpId=c02c5d8b-20cf-4a7a-b5ce-77af3333453a, pages=67, markPos=WALPointer [idx=4, fileOff=586239, len=2048], walSegmentsCovered=[], markDuration=471ms, pagesWrite=4ms, fsync=518ms, total=994ms] [21:11:31] : [Step 4/5] [2021-11-19 21:11:31,078][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00a4fdec-fb9a-4106-96a3-cca8453c6000, grp=1613773252] [21:11:31] : [Step 4/5] [2021-11-19 21:11:31,085][INFO ][db-checkpoint-thread-#22942%grid-0%][Checkpointer] Checkpoint started [checkpointId=3b543bb2-8a9b-4fca-a245-d3100b01316c, startPtr=WALPointer [idx=3, fileOff=356293, len=2010], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=5ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=0ms, pages=47, reason='test'] [21:11:31] : [Step 4/5] [2021-11-19 21:11:31,104][INFO ][db-checkpoint-thread-#22942%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:11:31] : [Step 4/5] [2021-11-19 21:11:31,104][INFO ][db-checkpoint-thread-#22942%grid-0%][Checkpointer] Checkpoint finished [cpId=3b543bb2-8a9b-4fca-a245-d3100b01316c, pages=47, markPos=WALPointer [idx=3, fileOff=356293, len=2010], walSegmentsCovered=[], markDuration=7ms, pagesWrite=2ms, fsync=16ms, total=25ms] [21:11:31] : [Step 4/5] [2021-11-19 21:11:31,163][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:31] : [Step 4/5] [2021-11-19 21:11:31,309][INFO ][disco-notifier-worker-#22803%grid-0%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:31] : [Step 4/5] [2021-11-19 21:11:31,311][INFO ][disco-notifier-worker-#22922%grid-1%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:31] : [Step 4/5] [2021-11-19 21:11:31,447][INFO ][disco-notifier-worker-#22803%grid-0%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:31] : [Step 4/5] [2021-11-19 21:11:31,451][INFO ][disco-notifier-worker-#22922%grid-1%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:31] : [Step 4/5] [2021-11-19 21:11:31,544][INFO ][disco-notifier-worker-#22803%grid-0%][GridEncryptionManager] Start master key change [masterKeyName=ignite.master.key2] [21:11:31] : [Step 4/5] [2021-11-19 21:11:31,544][INFO ][disco-notifier-worker-#22922%grid-1%][GridEncryptionManager] Start master key change [masterKeyName=ignite.master.key2] [21:11:31] : [Step 4/5] [2021-11-19 21:11:31,601][INFO ][disco-notifier-worker-#22803%grid-0%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:31] : [Step 4/5] [2021-11-19 21:11:31,605][INFO ][disco-notifier-worker-#22922%grid-1%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:31] : [Step 4/5] [2021-11-19 21:11:31,685][INFO ][disco-notifier-worker-#22803%grid-0%][GridEncryptionManager] Master key successfully changed [masterKeyName=ignite.master.key2] [21:11:31] : [Step 4/5] [2021-11-19 21:11:31,686][INFO ][disco-notifier-worker-#22803%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=17] [21:11:31] : [Step 4/5] [2021-11-19 21:11:31,686][INFO ][reencrypt-#22963%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:11:31] : [Step 4/5] [2021-11-19 21:11:31,690][INFO ][disco-notifier-worker-#22922%grid-1%][GridEncryptionManager] Master key successfully changed [masterKeyName=ignite.master.key2] [21:11:31] : [Step 4/5] [2021-11-19 21:11:31,691][INFO ][disco-notifier-worker-#22922%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=17] [21:11:31] : [Step 4/5] [2021-11-19 21:11:31,691][INFO ][reencrypt-#22964%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:11:31] : [Step 4/5] [2021-11-19 21:11:31,893][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10ca909b-1957-42c9-93b4-147fa476d001, grp=1613773252] [21:11:32] : [Step 4/5] [2021-11-19 21:11:32,172][INFO ][db-checkpoint-thread-#22945%grid-1%][Checkpointer] Checkpoint started [checkpointId=6838e365-843a-42b2-b04e-a84577c75ae3, startPtr=WALPointer [idx=4, fileOff=924321, len=2048], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=0ms, writeCheckpointEntryDuration=277ms, splitAndSortCpPagesDuration=1ms, pages=70, reason='test'] [21:11:32] : [Step 4/5] [2021-11-19 21:11:32,312][INFO ][db-checkpoint-thread-#22945%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:11:32] : [Step 4/5] [2021-11-19 21:11:32,312][INFO ][db-checkpoint-thread-#22945%grid-1%][Checkpointer] Checkpoint finished [cpId=6838e365-843a-42b2-b04e-a84577c75ae3, pages=70, markPos=WALPointer [idx=4, fileOff=924321, len=2048], walSegmentsCovered=[], markDuration=278ms, pagesWrite=3ms, fsync=137ms, total=419ms] [21:11:32] : [Step 4/5] [2021-11-19 21:11:32,314][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00a4fdec-fb9a-4106-96a3-cca8453c6000, grp=1613773252] [21:11:32] : [Step 4/5] [2021-11-19 21:11:32,321][INFO ][db-checkpoint-thread-#22942%grid-0%][Checkpointer] Checkpoint started [checkpointId=dedf4b73-19d1-4c23-8ca4-fd0892cbf648, startPtr=WALPointer [idx=3, fileOff=611157, len=2010], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=5ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=0ms, pages=50, reason='test'] [21:11:32] : [Step 4/5] [2021-11-19 21:11:32,340][INFO ][db-checkpoint-thread-#22942%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:11:32] : [Step 4/5] [2021-11-19 21:11:32,340][INFO ][db-checkpoint-thread-#22942%grid-0%][Checkpointer] Checkpoint finished [cpId=dedf4b73-19d1-4c23-8ca4-fd0892cbf648, pages=50, markPos=WALPointer [idx=3, fileOff=611157, len=2010], walSegmentsCovered=[], markDuration=7ms, pagesWrite=2ms, fsync=17ms, total=26ms] [21:11:32] : [Step 4/5] [2021-11-19 21:11:32,345][INFO ][disco-notifier-worker-#22803%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=18] [21:11:32] : [Step 4/5] [2021-11-19 21:11:32,346][INFO ][disco-notifier-worker-#22922%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=18] [21:11:32] : [Step 4/5] [2021-11-19 21:11:32,346][INFO ][reencrypt-#22963%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:11:32] : [Step 4/5] [2021-11-19 21:11:32,346][INFO ][reencrypt-#22964%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:11:32] : [Step 4/5] [2021-11-19 21:11:32,351][INFO ][wal-file-archiver%grid-1-#22937%grid-1%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=4, segIdx=4, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000004.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000004.wal] [21:11:32] : [Step 4/5] [2021-11-19 21:11:32,363][INFO ][wal-file-archiver%grid-1-#22937%grid-1%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000004.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000004.wal] [21:11:32] : [Step 4/5] [2021-11-19 21:11:32,414][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:32] : [Step 4/5] [2021-11-19 21:11:32,560][INFO ][disco-notifier-worker-#22803%grid-0%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:32] : [Step 4/5] [2021-11-19 21:11:32,562][INFO ][disco-notifier-worker-#22922%grid-1%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:32] : [Step 4/5] [2021-11-19 21:11:32,698][INFO ][disco-notifier-worker-#22803%grid-0%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:32] : [Step 4/5] [2021-11-19 21:11:32,700][INFO ][disco-notifier-worker-#22922%grid-1%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:32] : [Step 4/5] [2021-11-19 21:11:32,785][INFO ][disco-notifier-worker-#22803%grid-0%][GridEncryptionManager] Start master key change [masterKeyName=ignite.master.key3] [21:11:32] : [Step 4/5] [2021-11-19 21:11:32,785][INFO ][disco-notifier-worker-#22922%grid-1%][GridEncryptionManager] Start master key change [masterKeyName=ignite.master.key3] [21:11:32] : [Step 4/5] [2021-11-19 21:11:32,842][INFO ][disco-notifier-worker-#22922%grid-1%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:32] : [Step 4/5] [2021-11-19 21:11:32,843][INFO ][disco-notifier-worker-#22803%grid-0%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:32] : [Step 4/5] [2021-11-19 21:11:32,926][INFO ][disco-notifier-worker-#22922%grid-1%][GridEncryptionManager] Master key successfully changed [masterKeyName=ignite.master.key3] [21:11:32] : [Step 4/5] [2021-11-19 21:11:32,931][INFO ][disco-notifier-worker-#22803%grid-0%][GridEncryptionManager] Master key successfully changed [masterKeyName=ignite.master.key3] [21:11:32] : [Step 4/5] [2021-11-19 21:11:32,933][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10ca909b-1957-42c9-93b4-147fa476d001, grp=1613773252] [21:11:33] : [Step 4/5] [2021-11-19 21:11:33,165][INFO ][db-checkpoint-thread-#22945%grid-1%][Checkpointer] Checkpoint started [checkpointId=a617bbe5-f915-42f0-8ce4-ed3e34c2d897, startPtr=WALPointer [idx=5, fileOff=223090, len=2048], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=221ms, writeCheckpointEntryDuration=9ms, splitAndSortCpPagesDuration=0ms, pages=72, reason='test'] [21:11:33] : [Step 4/5] [2021-11-19 21:11:33,185][INFO ][db-checkpoint-thread-#22945%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:11:33] : [Step 4/5] [2021-11-19 21:11:33,185][INFO ][db-checkpoint-thread-#22945%grid-1%][Checkpointer] Checkpoint finished [cpId=a617bbe5-f915-42f0-8ce4-ed3e34c2d897, pages=72, markPos=WALPointer [idx=5, fileOff=223090, len=2048], walSegmentsCovered=[4], markDuration=232ms, pagesWrite=3ms, fsync=16ms, total=252ms] [21:11:33] : [Step 4/5] [2021-11-19 21:11:33,187][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00a4fdec-fb9a-4106-96a3-cca8453c6000, grp=1613773252] [21:11:33] : [Step 4/5] [2021-11-19 21:11:33,194][INFO ][db-checkpoint-thread-#22942%grid-0%][Checkpointer] Checkpoint started [checkpointId=07824f41-943a-412a-9575-29001b37f3e2, startPtr=WALPointer [idx=3, fileOff=873036, len=2010], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=4ms, writeCheckpointEntryDuration=2ms, splitAndSortCpPagesDuration=0ms, pages=52, reason='test'] [21:11:33] : [Step 4/5] [2021-11-19 21:11:33,212][INFO ][db-checkpoint-thread-#22942%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:11:33] : [Step 4/5] [2021-11-19 21:11:33,213][INFO ][db-checkpoint-thread-#22942%grid-0%][Checkpointer] Checkpoint finished [cpId=07824f41-943a-412a-9575-29001b37f3e2, pages=52, markPos=WALPointer [idx=3, fileOff=873036, len=2010], walSegmentsCovered=[], markDuration=6ms, pagesWrite=2ms, fsync=17ms, total=26ms] [21:11:33] : [Step 4/5] [2021-11-19 21:11:33,218][INFO ][disco-notifier-worker-#22803%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=19] [21:11:33] : [Step 4/5] [2021-11-19 21:11:33,218][INFO ][disco-notifier-worker-#22922%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=19] [21:11:33] : [Step 4/5] [2021-11-19 21:11:33,218][INFO ][reencrypt-#22963%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:11:33] : [Step 4/5] [2021-11-19 21:11:33,219][INFO ][reencrypt-#22964%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:11:33] : [Step 4/5] [2021-11-19 21:11:33,223][INFO ][wal-file-archiver%grid-0-#22934%grid-0%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=3, segIdx=3, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000003.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000003.wal] [21:11:33] : [Step 4/5] [2021-11-19 21:11:33,232][INFO ][wal-file-archiver%grid-0-#22934%grid-0%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000003.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000003.wal] [21:11:33] : [Step 4/5] [2021-11-19 21:11:33,271][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:33] : [Step 4/5] [2021-11-19 21:11:33,414][INFO ][disco-notifier-worker-#22803%grid-0%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:33] : [Step 4/5] [2021-11-19 21:11:33,415][INFO ][disco-notifier-worker-#22922%grid-1%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:33] : [Step 4/5] [2021-11-19 21:11:33,559][INFO ][disco-notifier-worker-#22803%grid-0%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:33] : [Step 4/5] [2021-11-19 21:11:33,560][INFO ][disco-notifier-worker-#22922%grid-1%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:33] : [Step 4/5] [2021-11-19 21:11:33,645][INFO ][disco-notifier-worker-#22803%grid-0%][GridEncryptionManager] Start master key change [masterKeyName=ignite.master.key2] [21:11:33] : [Step 4/5] [2021-11-19 21:11:33,646][INFO ][disco-notifier-worker-#22922%grid-1%][GridEncryptionManager] Start master key change [masterKeyName=ignite.master.key2] [21:11:33] : [Step 4/5] [2021-11-19 21:11:33,702][INFO ][disco-notifier-worker-#22803%grid-0%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:33] : [Step 4/5] [2021-11-19 21:11:33,704][INFO ][disco-notifier-worker-#22922%grid-1%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:33] : [Step 4/5] [2021-11-19 21:11:33,786][INFO ][disco-notifier-worker-#22803%grid-0%][GridEncryptionManager] Master key successfully changed [masterKeyName=ignite.master.key2] [21:11:33] : [Step 4/5] [2021-11-19 21:11:33,788][INFO ][disco-notifier-worker-#22922%grid-1%][GridEncryptionManager] Master key successfully changed [masterKeyName=ignite.master.key2] [21:11:33] : [Step 4/5] [2021-11-19 21:11:33,789][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10ca909b-1957-42c9-93b4-147fa476d001, grp=1613773252] [21:11:33] : [Step 4/5] [2021-11-19 21:11:33,793][INFO ][db-checkpoint-thread-#22945%grid-1%][Checkpointer] Checkpoint started [checkpointId=6fdd1c1f-13ae-467b-9208-311822049382, startPtr=WALPointer [idx=5, fileOff=570390, len=2048], checkpointBeforeLockTime=0ms, checkpointLockWait=1ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=1ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=0ms, pages=71, reason='test'] [21:11:33] : [Step 4/5] [2021-11-19 21:11:33,813][INFO ][db-checkpoint-thread-#22945%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:11:33] : [Step 4/5] [2021-11-19 21:11:33,813][INFO ][db-checkpoint-thread-#22945%grid-1%][Checkpointer] Checkpoint finished [cpId=6fdd1c1f-13ae-467b-9208-311822049382, pages=71, markPos=WALPointer [idx=5, fileOff=570390, len=2048], walSegmentsCovered=[], markDuration=2ms, pagesWrite=3ms, fsync=17ms, total=23ms] [21:11:33] : [Step 4/5] [2021-11-19 21:11:33,815][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00a4fdec-fb9a-4106-96a3-cca8453c6000, grp=1613773252] [21:11:33] : [Step 4/5] [2021-11-19 21:11:33,822][INFO ][db-checkpoint-thread-#22942%grid-0%][Checkpointer] Checkpoint started [checkpointId=ddfc1e69-349b-471e-ae48-a4345d53f68c, startPtr=WALPointer [idx=4, fileOff=91492, len=2010], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=5ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=0ms, pages=51, reason='test'] [21:11:33] : [Step 4/5] [2021-11-19 21:11:33,841][INFO ][db-checkpoint-thread-#22942%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:11:33] : [Step 4/5] [2021-11-19 21:11:33,842][INFO ][db-checkpoint-thread-#22942%grid-0%][Checkpointer] Checkpoint finished [cpId=ddfc1e69-349b-471e-ae48-a4345d53f68c, pages=51, markPos=WALPointer [idx=4, fileOff=91492, len=2010], walSegmentsCovered=[3], markDuration=8ms, pagesWrite=2ms, fsync=16ms, total=26ms] [21:11:33] : [Step 4/5] [2021-11-19 21:11:33,846][INFO ][disco-notifier-worker-#22803%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=20] [21:11:33] : [Step 4/5] [2021-11-19 21:11:33,846][INFO ][disco-notifier-worker-#22922%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=20] [21:11:33] : [Step 4/5] [2021-11-19 21:11:33,846][INFO ][reencrypt-#22963%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:11:33] : [Step 4/5] [2021-11-19 21:11:33,846][INFO ][reencrypt-#22964%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:11:33] : [Step 4/5] [2021-11-19 21:11:33,898][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:34] : [Step 4/5] [2021-11-19 21:11:34,037][INFO ][disco-notifier-worker-#22803%grid-0%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:34] : [Step 4/5] [2021-11-19 21:11:34,037][INFO ][disco-notifier-worker-#22922%grid-1%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:34] : [Step 4/5] [2021-11-19 21:11:34,182][INFO ][disco-notifier-worker-#22922%grid-1%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:34] : [Step 4/5] [2021-11-19 21:11:34,186][INFO ][disco-notifier-worker-#22803%grid-0%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:34] : [Step 4/5] [2021-11-19 21:11:34,270][INFO ][disco-notifier-worker-#22803%grid-0%][GridEncryptionManager] Start master key change [masterKeyName=ignite.master.key3] [21:11:34] : [Step 4/5] [2021-11-19 21:11:34,270][INFO ][disco-notifier-worker-#22922%grid-1%][GridEncryptionManager] Start master key change [masterKeyName=ignite.master.key3] [21:11:34] : [Step 4/5] [2021-11-19 21:11:34,326][INFO ][disco-notifier-worker-#22803%grid-0%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:34] : [Step 4/5] [2021-11-19 21:11:34,326][INFO ][disco-notifier-worker-#22922%grid-1%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:34] : [Step 4/5] [2021-11-19 21:11:34,411][INFO ][disco-notifier-worker-#22803%grid-0%][GridEncryptionManager] Master key successfully changed [masterKeyName=ignite.master.key3] [21:11:34] : [Step 4/5] [2021-11-19 21:11:34,414][INFO ][disco-notifier-worker-#22922%grid-1%][GridEncryptionManager] Master key successfully changed [masterKeyName=ignite.master.key3] [21:11:34] : [Step 4/5] [2021-11-19 21:11:34,416][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10ca909b-1957-42c9-93b4-147fa476d001, grp=1613773252] [21:11:34] : [Step 4/5] [2021-11-19 21:11:34,451][INFO ][db-checkpoint-thread-#22945%grid-1%][Checkpointer] Checkpoint started [checkpointId=4e2b08b7-02dd-433c-b55a-37e4c254e14d, startPtr=WALPointer [idx=5, fileOff=913046, len=2048], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=32ms, writeCheckpointEntryDuration=2ms, splitAndSortCpPagesDuration=0ms, pages=69, reason='test'] [21:11:34] : [Step 4/5] [2021-11-19 21:11:34,471][INFO ][db-checkpoint-thread-#22945%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:11:34] : [Step 4/5] [2021-11-19 21:11:34,471][INFO ][db-checkpoint-thread-#22945%grid-1%][Checkpointer] Checkpoint finished [cpId=4e2b08b7-02dd-433c-b55a-37e4c254e14d, pages=69, markPos=WALPointer [idx=5, fileOff=913046, len=2048], walSegmentsCovered=[], markDuration=35ms, pagesWrite=3ms, fsync=16ms, total=55ms] [21:11:34] : [Step 4/5] [2021-11-19 21:11:34,472][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00a4fdec-fb9a-4106-96a3-cca8453c6000, grp=1613773252] [21:11:34] : [Step 4/5] [2021-11-19 21:11:34,480][INFO ][db-checkpoint-thread-#22942%grid-0%][Checkpointer] Checkpoint started [checkpointId=736881da-921c-4182-90fa-d7b496916b29, startPtr=WALPointer [idx=4, fileOff=350930, len=2010], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=6ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=0ms, pages=49, reason='test'] [21:11:34] : [Step 4/5] [2021-11-19 21:11:34,499][INFO ][db-checkpoint-thread-#22942%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:11:34] : [Step 4/5] [2021-11-19 21:11:34,499][INFO ][db-checkpoint-thread-#22942%grid-0%][Checkpointer] Checkpoint finished [cpId=736881da-921c-4182-90fa-d7b496916b29, pages=49, markPos=WALPointer [idx=4, fileOff=350930, len=2010], walSegmentsCovered=[], markDuration=8ms, pagesWrite=2ms, fsync=16ms, total=26ms] [21:11:34] : [Step 4/5] [2021-11-19 21:11:34,555][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:34] : [Step 4/5] [2021-11-19 21:11:34,697][INFO ][disco-notifier-worker-#22922%grid-1%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:34] : [Step 4/5] [2021-11-19 21:11:34,697][INFO ][disco-notifier-worker-#22803%grid-0%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:34] : [Step 4/5] [2021-11-19 21:11:34,836][INFO ][disco-notifier-worker-#22922%grid-1%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:34] : [Step 4/5] [2021-11-19 21:11:34,840][INFO ][disco-notifier-worker-#22803%grid-0%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:34] : [Step 4/5] [2021-11-19 21:11:34,962][INFO ][disco-notifier-worker-#22803%grid-0%][GridEncryptionManager] Start master key change [masterKeyName=ignite.master.key2] [21:11:34] : [Step 4/5] [2021-11-19 21:11:34,962][INFO ][disco-notifier-worker-#22922%grid-1%][GridEncryptionManager] Start master key change [masterKeyName=ignite.master.key2] [21:11:35] : [Step 4/5] [2021-11-19 21:11:35,019][INFO ][disco-notifier-worker-#22803%grid-0%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:35] : [Step 4/5] [2021-11-19 21:11:35,020][INFO ][disco-notifier-worker-#22922%grid-1%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:35] : [Step 4/5] [2021-11-19 21:11:35,105][INFO ][disco-notifier-worker-#22803%grid-0%][GridEncryptionManager] Master key successfully changed [masterKeyName=ignite.master.key2] [21:11:35] : [Step 4/5] [2021-11-19 21:11:35,106][INFO ][disco-notifier-worker-#22803%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=21] [21:11:35] : [Step 4/5] [2021-11-19 21:11:35,106][INFO ][reencrypt-#22963%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:11:35] : [Step 4/5] [2021-11-19 21:11:35,114][INFO ][disco-notifier-worker-#22922%grid-1%][GridEncryptionManager] Master key successfully changed [masterKeyName=ignite.master.key2] [21:11:35] : [Step 4/5] [2021-11-19 21:11:35,115][INFO ][disco-notifier-worker-#22922%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=21] [21:11:35] : [Step 4/5] [2021-11-19 21:11:35,115][INFO ][reencrypt-#22964%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:11:35] : [Step 4/5] [2021-11-19 21:11:35,117][INFO ][wal-file-archiver%grid-1-#22937%grid-1%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=5, segIdx=5, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000005.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000005.wal] [21:11:35] : [Step 4/5] [2021-11-19 21:11:35,126][INFO ][wal-file-archiver%grid-1-#22937%grid-1%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000005.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000005.wal] [21:11:35] : [Step 4/5] [2021-11-19 21:11:35,316][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10ca909b-1957-42c9-93b4-147fa476d001, grp=1613773252] [21:11:35] : [Step 4/5] [2021-11-19 21:11:35,497][INFO ][db-checkpoint-thread-#22945%grid-1%][Checkpointer] Checkpoint started [checkpointId=d8dd7188-15b3-401c-b29c-d220a1155fc6, startPtr=WALPointer [idx=6, fileOff=212537, len=2048], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=64ms, writeCheckpointEntryDuration=116ms, splitAndSortCpPagesDuration=0ms, pages=69, reason='test'] [21:11:35] : [Step 4/5] [2021-11-19 21:11:35,516][INFO ][db-checkpoint-thread-#22945%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:11:35] : [Step 4/5] [2021-11-19 21:11:35,517][INFO ][db-checkpoint-thread-#22945%grid-1%][Checkpointer] Checkpoint finished [cpId=d8dd7188-15b3-401c-b29c-d220a1155fc6, pages=69, markPos=WALPointer [idx=6, fileOff=212537, len=2048], walSegmentsCovered=[5], markDuration=181ms, pagesWrite=3ms, fsync=16ms, total=200ms] [21:11:35] : [Step 4/5] [2021-11-19 21:11:35,518][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00a4fdec-fb9a-4106-96a3-cca8453c6000, grp=1613773252] [21:11:35] : [Step 4/5] [2021-11-19 21:11:35,525][INFO ][db-checkpoint-thread-#22942%grid-0%][Checkpointer] Checkpoint started [checkpointId=5c6005dd-9a4c-42cf-928d-87a3d66f8690, startPtr=WALPointer [idx=4, fileOff=612318, len=2010], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=5ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=0ms, pages=49, reason='test'] [21:11:35] : [Step 4/5] [2021-11-19 21:11:35,544][INFO ][db-checkpoint-thread-#22942%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:11:35] : [Step 4/5] [2021-11-19 21:11:35,544][INFO ][db-checkpoint-thread-#22942%grid-0%][Checkpointer] Checkpoint finished [cpId=5c6005dd-9a4c-42cf-928d-87a3d66f8690, pages=49, markPos=WALPointer [idx=4, fileOff=612318, len=2010], walSegmentsCovered=[], markDuration=7ms, pagesWrite=2ms, fsync=16ms, total=25ms] [21:11:35] : [Step 4/5] [2021-11-19 21:11:35,603][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:35] : [Step 4/5] [2021-11-19 21:11:35,745][INFO ][disco-notifier-worker-#22803%grid-0%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:35] : [Step 4/5] [2021-11-19 21:11:35,745][INFO ][disco-notifier-worker-#22922%grid-1%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:35] : [Step 4/5] [2021-11-19 21:11:35,885][INFO ][disco-notifier-worker-#22803%grid-0%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:35] : [Step 4/5] [2021-11-19 21:11:35,886][INFO ][disco-notifier-worker-#22922%grid-1%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:35] : [Step 4/5] [2021-11-19 21:11:35,976][INFO ][disco-notifier-worker-#22803%grid-0%][GridEncryptionManager] Start master key change [masterKeyName=ignite.master.key3] [21:11:35] : [Step 4/5] [2021-11-19 21:11:35,977][INFO ][disco-notifier-worker-#22922%grid-1%][GridEncryptionManager] Start master key change [masterKeyName=ignite.master.key3] [21:11:36] : [Step 4/5] [2021-11-19 21:11:36,036][INFO ][disco-notifier-worker-#22922%grid-1%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:36] : [Step 4/5] [2021-11-19 21:11:36,038][INFO ][disco-notifier-worker-#22803%grid-0%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:36] : [Step 4/5] [2021-11-19 21:11:36,121][INFO ][disco-notifier-worker-#22922%grid-1%][GridEncryptionManager] Master key successfully changed [masterKeyName=ignite.master.key3] [21:11:36] : [Step 4/5] [2021-11-19 21:11:36,124][INFO ][disco-notifier-worker-#22803%grid-0%][GridEncryptionManager] Master key successfully changed [masterKeyName=ignite.master.key3] [21:11:36] : [Step 4/5] [2021-11-19 21:11:36,126][INFO ][disco-notifier-worker-#22803%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=22] [21:11:36] : [Step 4/5] [2021-11-19 21:11:36,126][INFO ][disco-notifier-worker-#22922%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=22] [21:11:36] : [Step 4/5] [2021-11-19 21:11:36,126][INFO ][reencrypt-#22963%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:11:36] : [Step 4/5] [2021-11-19 21:11:36,126][INFO ][reencrypt-#22964%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:11:36] : [Step 4/5] [2021-11-19 21:11:36,327][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10ca909b-1957-42c9-93b4-147fa476d001, grp=1613773252] [21:11:36] : [Step 4/5] [2021-11-19 21:11:36,574][INFO ][db-checkpoint-thread-#22945%grid-1%][Checkpointer] Checkpoint started [checkpointId=a0818d29-e3aa-431b-8460-abc0dff00045, startPtr=WALPointer [idx=6, fileOff=559504, len=2048], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=1ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=182ms, writeCheckpointEntryDuration=63ms, splitAndSortCpPagesDuration=0ms, pages=69, reason='test'] [21:11:36] : [Step 4/5] [2021-11-19 21:11:36,593][INFO ][db-checkpoint-thread-#22945%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:11:36] : [Step 4/5] [2021-11-19 21:11:36,594][INFO ][db-checkpoint-thread-#22945%grid-1%][Checkpointer] Checkpoint finished [cpId=a0818d29-e3aa-431b-8460-abc0dff00045, pages=69, markPos=WALPointer [idx=6, fileOff=559504, len=2048], walSegmentsCovered=[], markDuration=247ms, pagesWrite=2ms, fsync=17ms, total=266ms] [21:11:36] : [Step 4/5] [2021-11-19 21:11:36,595][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00a4fdec-fb9a-4106-96a3-cca8453c6000, grp=1613773252] [21:11:36] : [Step 4/5] [2021-11-19 21:11:36,602][INFO ][db-checkpoint-thread-#22942%grid-0%][Checkpointer] Checkpoint started [checkpointId=6633ff64-85c7-43cc-930f-a2e46550d2b5, startPtr=WALPointer [idx=4, fileOff=876067, len=2010], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=1ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=4ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=0ms, pages=49, reason='test'] [21:11:36] : [Step 4/5] [2021-11-19 21:11:36,622][INFO ][db-checkpoint-thread-#22942%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:11:36] : [Step 4/5] [2021-11-19 21:11:36,622][INFO ][db-checkpoint-thread-#22942%grid-0%][Checkpointer] Checkpoint finished [cpId=6633ff64-85c7-43cc-930f-a2e46550d2b5, pages=49, markPos=WALPointer [idx=4, fileOff=876067, len=2010], walSegmentsCovered=[], markDuration=7ms, pagesWrite=2ms, fsync=17ms, total=26ms] [21:11:36] : [Step 4/5] [2021-11-19 21:11:36,627][INFO ][disco-notifier-worker-#22803%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=23] [21:11:36] : [Step 4/5] [2021-11-19 21:11:36,627][INFO ][reencrypt-#22963%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:11:36] : [Step 4/5] [2021-11-19 21:11:36,627][INFO ][disco-notifier-worker-#22922%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=23] [21:11:36] : [Step 4/5] [2021-11-19 21:11:36,628][INFO ][reencrypt-#22964%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:11:36] : [Step 4/5] [2021-11-19 21:11:36,632][INFO ][wal-file-archiver%grid-0-#22934%grid-0%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=4, segIdx=4, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000004.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000004.wal] [21:11:36] : [Step 4/5] [2021-11-19 21:11:36,642][INFO ][wal-file-archiver%grid-0-#22934%grid-0%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000004.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000004.wal] [21:11:36] : [Step 4/5] [2021-11-19 21:11:36,681][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:36] : [Step 4/5] [2021-11-19 21:11:36,821][INFO ][disco-notifier-worker-#22803%grid-0%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:36] : [Step 4/5] [2021-11-19 21:11:36,822][INFO ][disco-notifier-worker-#22922%grid-1%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:36] : [Step 4/5] [2021-11-19 21:11:36,988][INFO ][disco-notifier-worker-#22803%grid-0%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:36] : [Step 4/5] [2021-11-19 21:11:36,994][INFO ][disco-notifier-worker-#22922%grid-1%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:37] : [Step 4/5] [2021-11-19 21:11:37,103][INFO ][disco-notifier-worker-#22803%grid-0%][GridEncryptionManager] Start master key change [masterKeyName=ignite.master.key2] [21:11:37] : [Step 4/5] [2021-11-19 21:11:37,103][INFO ][disco-notifier-worker-#22922%grid-1%][GridEncryptionManager] Start master key change [masterKeyName=ignite.master.key2] [21:11:37] : [Step 4/5] [2021-11-19 21:11:37,159][INFO ][disco-notifier-worker-#22922%grid-1%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:37] : [Step 4/5] [2021-11-19 21:11:37,162][INFO ][disco-notifier-worker-#22803%grid-0%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:37] : [Step 4/5] [2021-11-19 21:11:37,246][INFO ][disco-notifier-worker-#22922%grid-1%][GridEncryptionManager] Master key successfully changed [masterKeyName=ignite.master.key2] [21:11:37] : [Step 4/5] [2021-11-19 21:11:37,247][INFO ][disco-notifier-worker-#22803%grid-0%][GridEncryptionManager] Master key successfully changed [masterKeyName=ignite.master.key2] [21:11:37] : [Step 4/5] [2021-11-19 21:11:37,248][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10ca909b-1957-42c9-93b4-147fa476d001, grp=1613773252] [21:11:37] : [Step 4/5] [2021-11-19 21:11:37,602][INFO ][db-checkpoint-thread-#22945%grid-1%][Checkpointer] Checkpoint started [checkpointId=84843e25-4db7-417b-9fac-9a10b520589b, startPtr=WALPointer [idx=6, fileOff=908044, len=2048], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=78ms, writeCheckpointEntryDuration=275ms, splitAndSortCpPagesDuration=0ms, pages=69, reason='test'] [21:11:37] : [Step 4/5] [2021-11-19 21:11:37,618][INFO ][db-checkpoint-thread-#22945%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:11:37] : [Step 4/5] [2021-11-19 21:11:37,618][INFO ][db-checkpoint-thread-#22945%grid-1%][Checkpointer] Checkpoint finished [cpId=84843e25-4db7-417b-9fac-9a10b520589b, pages=69, markPos=WALPointer [idx=6, fileOff=908044, len=2048], walSegmentsCovered=[], markDuration=354ms, pagesWrite=3ms, fsync=12ms, total=369ms] [21:11:37] : [Step 4/5] [2021-11-19 21:11:37,620][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00a4fdec-fb9a-4106-96a3-cca8453c6000, grp=1613773252] [21:11:37] : [Step 4/5] [2021-11-19 21:11:37,627][INFO ][db-checkpoint-thread-#22942%grid-0%][Checkpointer] Checkpoint started [checkpointId=cadae168-4e3a-4adb-b240-e8467f6d7dbd, startPtr=WALPointer [idx=5, fileOff=96067, len=2010], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=4ms, writeCheckpointEntryDuration=2ms, splitAndSortCpPagesDuration=0ms, pages=49, reason='test'] [21:11:37] : [Step 4/5] [2021-11-19 21:11:37,646][INFO ][db-checkpoint-thread-#22942%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:11:37] : [Step 4/5] [2021-11-19 21:11:37,646][INFO ][db-checkpoint-thread-#22942%grid-0%][Checkpointer] Checkpoint finished [cpId=cadae168-4e3a-4adb-b240-e8467f6d7dbd, pages=49, markPos=WALPointer [idx=5, fileOff=96067, len=2010], walSegmentsCovered=[4], markDuration=7ms, pagesWrite=2ms, fsync=16ms, total=25ms] [21:11:37] : [Step 4/5] [2021-11-19 21:11:37,726][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:37] : [Step 4/5] [2021-11-19 21:11:37,879][INFO ][disco-notifier-worker-#22922%grid-1%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:37] : [Step 4/5] [2021-11-19 21:11:37,880][INFO ][disco-notifier-worker-#22803%grid-0%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:38] : [Step 4/5] [2021-11-19 21:11:38,021][INFO ][disco-notifier-worker-#22922%grid-1%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:38] : [Step 4/5] [2021-11-19 21:11:38,023][INFO ][disco-notifier-worker-#22803%grid-0%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:38] : [Step 4/5] [2021-11-19 21:11:38,110][INFO ][disco-notifier-worker-#22803%grid-0%][GridEncryptionManager] Start master key change [masterKeyName=ignite.master.key3] [21:11:38] : [Step 4/5] [2021-11-19 21:11:38,110][INFO ][disco-notifier-worker-#22922%grid-1%][GridEncryptionManager] Start master key change [masterKeyName=ignite.master.key3] [21:11:38] : [Step 4/5] [2021-11-19 21:11:38,172][INFO ][disco-notifier-worker-#22922%grid-1%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:38] : [Step 4/5] [2021-11-19 21:11:38,172][INFO ][disco-notifier-worker-#22803%grid-0%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:38] : [Step 4/5] [2021-11-19 21:11:38,287][INFO ][disco-notifier-worker-#22803%grid-0%][GridEncryptionManager] Master key successfully changed [masterKeyName=ignite.master.key3] [21:11:38] : [Step 4/5] [2021-11-19 21:11:38,288][INFO ][disco-notifier-worker-#22922%grid-1%][GridEncryptionManager] Master key successfully changed [masterKeyName=ignite.master.key3] [21:11:38] : [Step 4/5] [2021-11-19 21:11:38,288][INFO ][disco-notifier-worker-#22803%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=24] [21:11:38] : [Step 4/5] [2021-11-19 21:11:38,289][INFO ][reencrypt-#22963%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:11:38] : [Step 4/5] [2021-11-19 21:11:38,290][INFO ][disco-notifier-worker-#22922%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=24] [21:11:38] : [Step 4/5] [2021-11-19 21:11:38,291][INFO ][reencrypt-#22964%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:11:38] : [Step 4/5] [2021-11-19 21:11:38,346][INFO ][wal-file-archiver%grid-1-#22937%grid-1%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=6, segIdx=6, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000006.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000006.wal] [21:11:38] : [Step 4/5] [2021-11-19 21:11:38,492][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10ca909b-1957-42c9-93b4-147fa476d001, grp=1613773252] [21:11:38] : [Step 4/5] [2021-11-19 21:11:38,514][INFO ][wal-file-archiver%grid-1-#22937%grid-1%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000006.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000006.wal] [21:11:38] : [Step 4/5] [2021-11-19 21:11:38,524][INFO ][db-checkpoint-thread-#22945%grid-1%][Checkpointer] Checkpoint started [checkpointId=9528a4cb-f545-4de3-8879-0eba95873989, startPtr=WALPointer [idx=7, fileOff=216498, len=2048], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=30ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=0ms, pages=70, reason='test'] [21:11:38] : [Step 4/5] [2021-11-19 21:11:38,543][INFO ][db-checkpoint-thread-#22945%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:11:38] : [Step 4/5] [2021-11-19 21:11:38,544][INFO ][db-checkpoint-thread-#22945%grid-1%][Checkpointer] Checkpoint finished [cpId=9528a4cb-f545-4de3-8879-0eba95873989, pages=70, markPos=WALPointer [idx=7, fileOff=216498, len=2048], walSegmentsCovered=[6], markDuration=32ms, pagesWrite=4ms, fsync=15ms, total=52ms] [21:11:38] : [Step 4/5] [2021-11-19 21:11:38,546][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00a4fdec-fb9a-4106-96a3-cca8453c6000, grp=1613773252] [21:11:38] : [Step 4/5] [2021-11-19 21:11:38,553][INFO ][db-checkpoint-thread-#22942%grid-0%][Checkpointer] Checkpoint started [checkpointId=bfd3abca-fced-4c2d-9b7a-769a69964422, startPtr=WALPointer [idx=5, fileOff=368499, len=2010], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=5ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=0ms, pages=50, reason='test'] [21:11:38] : [Step 4/5] [2021-11-19 21:11:38,572][INFO ][db-checkpoint-thread-#22942%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:11:38] : [Step 4/5] [2021-11-19 21:11:38,573][INFO ][db-checkpoint-thread-#22942%grid-0%][Checkpointer] Checkpoint finished [cpId=bfd3abca-fced-4c2d-9b7a-769a69964422, pages=50, markPos=WALPointer [idx=5, fileOff=368499, len=2010], walSegmentsCovered=[], markDuration=7ms, pagesWrite=2ms, fsync=17ms, total=27ms] [21:11:38] : [Step 4/5] [2021-11-19 21:11:38,648][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:38] : [Step 4/5] [2021-11-19 21:11:38,795][INFO ][disco-notifier-worker-#22922%grid-1%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:38] : [Step 4/5] [2021-11-19 21:11:38,802][INFO ][disco-notifier-worker-#22803%grid-0%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:38] : [Step 4/5] [2021-11-19 21:11:38,934][INFO ][disco-notifier-worker-#22922%grid-1%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:38] : [Step 4/5] [2021-11-19 21:11:38,945][INFO ][disco-notifier-worker-#22803%grid-0%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:39] : [Step 4/5] [2021-11-19 21:11:39,051][INFO ][disco-notifier-worker-#22803%grid-0%][GridEncryptionManager] Start master key change [masterKeyName=ignite.master.key2] [21:11:39] : [Step 4/5] [2021-11-19 21:11:39,051][INFO ][disco-notifier-worker-#22922%grid-1%][GridEncryptionManager] Start master key change [masterKeyName=ignite.master.key2] [21:11:39] : [Step 4/5] [2021-11-19 21:11:39,115][INFO ][disco-notifier-worker-#22803%grid-0%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:39] : [Step 4/5] [2021-11-19 21:11:39,117][INFO ][disco-notifier-worker-#22922%grid-1%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:39] : [Step 4/5] [2021-11-19 21:11:39,212][INFO ][disco-notifier-worker-#22803%grid-0%][GridEncryptionManager] Master key successfully changed [masterKeyName=ignite.master.key2] [21:11:39] : [Step 4/5] [2021-11-19 21:11:39,214][INFO ][disco-notifier-worker-#22803%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=25] [21:11:39] : [Step 4/5] [2021-11-19 21:11:39,214][INFO ][reencrypt-#22963%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:11:39] : [Step 4/5] [2021-11-19 21:11:39,231][INFO ][disco-notifier-worker-#22922%grid-1%][GridEncryptionManager] Master key successfully changed [masterKeyName=ignite.master.key2] [21:11:39] : [Step 4/5] [2021-11-19 21:11:39,233][INFO ][disco-notifier-worker-#22922%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=25] [21:11:39] : [Step 4/5] [2021-11-19 21:11:39,233][INFO ][reencrypt-#22964%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:11:39] : [Step 4/5] [2021-11-19 21:11:39,434][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10ca909b-1957-42c9-93b4-147fa476d001, grp=1613773252] [21:11:39] : [Step 4/5] [2021-11-19 21:11:39,583][INFO ][db-checkpoint-thread-#22945%grid-1%][Checkpointer] Checkpoint started [checkpointId=f8e9fb2e-5fc5-46e0-8c31-4f7ca3539546, startPtr=WALPointer [idx=7, fileOff=577282, len=2048], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=88ms, writeCheckpointEntryDuration=60ms, splitAndSortCpPagesDuration=0ms, pages=70, reason='test'] [21:11:39] : [Step 4/5] [2021-11-19 21:11:39,603][INFO ][db-checkpoint-thread-#22945%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:11:39] : [Step 4/5] [2021-11-19 21:11:39,603][INFO ][db-checkpoint-thread-#22945%grid-1%][Checkpointer] Checkpoint finished [cpId=f8e9fb2e-5fc5-46e0-8c31-4f7ca3539546, pages=70, markPos=WALPointer [idx=7, fileOff=577282, len=2048], walSegmentsCovered=[], markDuration=148ms, pagesWrite=3ms, fsync=17ms, total=169ms] [21:11:39] : [Step 4/5] [2021-11-19 21:11:39,604][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00a4fdec-fb9a-4106-96a3-cca8453c6000, grp=1613773252] [21:11:39] : [Step 4/5] [2021-11-19 21:11:39,612][INFO ][db-checkpoint-thread-#22942%grid-0%][Checkpointer] Checkpoint started [checkpointId=e3c3235a-0681-4ec0-9671-19b947e921e7, startPtr=WALPointer [idx=5, fileOff=646065, len=2010], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=5ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=0ms, pages=50, reason='test'] [21:11:39] : [Step 4/5] [2021-11-19 21:11:39,631][INFO ][db-checkpoint-thread-#22942%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:11:39] : [Step 4/5] [2021-11-19 21:11:39,632][INFO ][db-checkpoint-thread-#22942%grid-0%][Checkpointer] Checkpoint finished [cpId=e3c3235a-0681-4ec0-9671-19b947e921e7, pages=50, markPos=WALPointer [idx=5, fileOff=646065, len=2010], walSegmentsCovered=[], markDuration=8ms, pagesWrite=2ms, fsync=17ms, total=28ms] [21:11:39] : [Step 4/5] [2021-11-19 21:11:39,688][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:39] : [Step 4/5] [2021-11-19 21:11:39,843][INFO ][disco-notifier-worker-#22922%grid-1%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:39] : [Step 4/5] [2021-11-19 21:11:39,850][INFO ][disco-notifier-worker-#22803%grid-0%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:39] : [Step 4/5] [2021-11-19 21:11:39,982][INFO ][disco-notifier-worker-#22922%grid-1%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:39] : [Step 4/5] [2021-11-19 21:11:39,988][INFO ][disco-notifier-worker-#22803%grid-0%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:40] : [Step 4/5] [2021-11-19 21:11:40,072][INFO ][disco-notifier-worker-#22803%grid-0%][GridEncryptionManager] Start master key change [masterKeyName=ignite.master.key3] [21:11:40] : [Step 4/5] [2021-11-19 21:11:40,073][INFO ][disco-notifier-worker-#22922%grid-1%][GridEncryptionManager] Start master key change [masterKeyName=ignite.master.key3] [21:11:40] : [Step 4/5] [2021-11-19 21:11:40,128][INFO ][disco-notifier-worker-#22922%grid-1%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:40] : [Step 4/5] [2021-11-19 21:11:40,129][INFO ][disco-notifier-worker-#22803%grid-0%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:40] : [Step 4/5] [2021-11-19 21:11:40,211][INFO ][disco-notifier-worker-#22803%grid-0%][GridEncryptionManager] Master key successfully changed [masterKeyName=ignite.master.key3] [21:11:40] : [Step 4/5] [2021-11-19 21:11:40,212][INFO ][disco-notifier-worker-#22922%grid-1%][GridEncryptionManager] Master key successfully changed [masterKeyName=ignite.master.key3] [21:11:40] : [Step 4/5] [2021-11-19 21:11:40,213][INFO ][disco-notifier-worker-#22803%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=26] [21:11:40] : [Step 4/5] [2021-11-19 21:11:40,213][INFO ][disco-notifier-worker-#22922%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=26] [21:11:40] : [Step 4/5] [2021-11-19 21:11:40,213][INFO ][reencrypt-#22963%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:11:40] : [Step 4/5] [2021-11-19 21:11:40,214][INFO ][reencrypt-#22964%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:11:40] : [Step 4/5] [2021-11-19 21:11:40,415][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10ca909b-1957-42c9-93b4-147fa476d001, grp=1613773252] [21:11:40] : [Step 4/5] [2021-11-19 21:11:40,677][INFO ][db-checkpoint-thread-#22945%grid-1%][Checkpointer] Checkpoint started [checkpointId=6a1b3f2a-1d04-4e58-8fe7-1b2e885c4ded, startPtr=WALPointer [idx=7, fileOff=944971, len=2048], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=258ms, writeCheckpointEntryDuration=3ms, splitAndSortCpPagesDuration=0ms, pages=71, reason='test'] [21:11:40] : [Step 4/5] [2021-11-19 21:11:40,697][INFO ][db-checkpoint-thread-#22945%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:11:40] : [Step 4/5] [2021-11-19 21:11:40,697][INFO ][db-checkpoint-thread-#22945%grid-1%][Checkpointer] Checkpoint finished [cpId=6a1b3f2a-1d04-4e58-8fe7-1b2e885c4ded, pages=71, markPos=WALPointer [idx=7, fileOff=944971, len=2048], walSegmentsCovered=[], markDuration=262ms, pagesWrite=3ms, fsync=16ms, total=282ms] [21:11:40] : [Step 4/5] [2021-11-19 21:11:40,699][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00a4fdec-fb9a-4106-96a3-cca8453c6000, grp=1613773252] [21:11:40] : [Step 4/5] [2021-11-19 21:11:40,706][INFO ][db-checkpoint-thread-#22942%grid-0%][Checkpointer] Checkpoint started [checkpointId=3510e377-6676-455a-9153-b398dead9037, startPtr=WALPointer [idx=5, fileOff=930536, len=2010], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=4ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=0ms, pages=51, reason='test'] [21:11:40] : [Step 4/5] [2021-11-19 21:11:40,725][INFO ][db-checkpoint-thread-#22942%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:11:40] : [Step 4/5] [2021-11-19 21:11:40,726][INFO ][db-checkpoint-thread-#22942%grid-0%][Checkpointer] Checkpoint finished [cpId=3510e377-6676-455a-9153-b398dead9037, pages=51, markPos=WALPointer [idx=5, fileOff=930536, len=2010], walSegmentsCovered=[], markDuration=7ms, pagesWrite=2ms, fsync=17ms, total=26ms] [21:11:40] : [Step 4/5] [2021-11-19 21:11:40,791][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:40] : [Step 4/5] [2021-11-19 21:11:40,972][INFO ][disco-notifier-worker-#22922%grid-1%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:40] : [Step 4/5] [2021-11-19 21:11:40,972][INFO ][disco-notifier-worker-#22803%grid-0%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:41] : [Step 4/5] [2021-11-19 21:11:41,176][INFO ][disco-notifier-worker-#22922%grid-1%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:41] : [Step 4/5] [2021-11-19 21:11:41,176][INFO ][disco-notifier-worker-#22803%grid-0%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:41] : [Step 4/5] [2021-11-19 21:11:41,282][INFO ][disco-notifier-worker-#22803%grid-0%][GridEncryptionManager] Start master key change [masterKeyName=ignite.master.key2] [21:11:41] : [Step 4/5] [2021-11-19 21:11:41,282][INFO ][disco-notifier-worker-#22922%grid-1%][GridEncryptionManager] Start master key change [masterKeyName=ignite.master.key2] [21:11:41] : [Step 4/5] [2021-11-19 21:11:41,370][INFO ][disco-notifier-worker-#22922%grid-1%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:41] : [Step 4/5] [2021-11-19 21:11:41,370][INFO ][disco-notifier-worker-#22803%grid-0%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:41] : [Step 4/5] [2021-11-19 21:11:41,461][INFO ][disco-notifier-worker-#22803%grid-0%][GridEncryptionManager] Master key successfully changed [masterKeyName=ignite.master.key2] [21:11:41] : [Step 4/5] [2021-11-19 21:11:41,641][INFO ][wal-file-archiver%grid-0-#22934%grid-0%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=5, segIdx=5, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000005.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000005.wal] [21:11:41] : [Step 4/5] [2021-11-19 21:11:41,644][INFO ][wal-file-archiver%grid-1-#22937%grid-1%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=7, segIdx=7, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000007.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000007.wal] [21:11:41] : [Step 4/5] [2021-11-19 21:11:41,644][INFO ][disco-notifier-worker-#22922%grid-1%][GridEncryptionManager] Master key successfully changed [masterKeyName=ignite.master.key2] [21:11:41] : [Step 4/5] [2021-11-19 21:11:41,645][INFO ][disco-notifier-worker-#22803%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=27] [21:11:41] : [Step 4/5] [2021-11-19 21:11:41,645][INFO ][reencrypt-#22963%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:11:41] : [Step 4/5] [2021-11-19 21:11:41,646][INFO ][disco-notifier-worker-#22922%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=27] [21:11:41] : [Step 4/5] [2021-11-19 21:11:41,647][INFO ][reencrypt-#22964%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:11:41] : [Step 4/5] [2021-11-19 21:11:41,848][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10ca909b-1957-42c9-93b4-147fa476d001, grp=1613773252] [21:11:41] : [Step 4/5] [2021-11-19 21:11:41,989][INFO ][wal-file-archiver%grid-0-#22934%grid-0%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000005.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000005.wal] [21:11:41] : [Step 4/5] [2021-11-19 21:11:41,990][INFO ][wal-file-archiver%grid-1-#22937%grid-1%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000007.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000007.wal] [21:11:42] : [Step 4/5] [2021-11-19 21:11:42,157][INFO ][db-checkpoint-thread-#22945%grid-1%][Checkpointer] Checkpoint started [checkpointId=67140c0f-e359-4f36-9daa-d9d4defeb7eb, startPtr=WALPointer [idx=8, fileOff=270167, len=2048], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=141ms, writeCheckpointEntryDuration=149ms, splitAndSortCpPagesDuration=0ms, pages=70, reason='test'] [21:11:42] : [Step 4/5] [2021-11-19 21:11:42,177][INFO ][db-checkpoint-thread-#22945%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:11:42] : [Step 4/5] [2021-11-19 21:11:42,177][INFO ][db-checkpoint-thread-#22945%grid-1%][Checkpointer] Checkpoint finished [cpId=67140c0f-e359-4f36-9daa-d9d4defeb7eb, pages=70, markPos=WALPointer [idx=8, fileOff=270167, len=2048], walSegmentsCovered=[7], markDuration=291ms, pagesWrite=4ms, fsync=15ms, total=311ms] [21:11:42] : [Step 4/5] [2021-11-19 21:11:42,179][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00a4fdec-fb9a-4106-96a3-cca8453c6000, grp=1613773252] [21:11:42] : [Step 4/5] [2021-11-19 21:11:42,186][INFO ][db-checkpoint-thread-#22942%grid-0%][Checkpointer] Checkpoint started [checkpointId=47a1e58f-3f7d-42bc-8a4d-f65e22288134, startPtr=WALPointer [idx=6, fileOff=179338, len=2010], checkpointBeforeLockTime=0ms, checkpointLockWait=1ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=3ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=0ms, pages=50, reason='test'] [21:11:42] : [Step 4/5] [2021-11-19 21:11:42,204][INFO ][db-checkpoint-thread-#22942%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:11:42] : [Step 4/5] [2021-11-19 21:11:42,205][INFO ][db-checkpoint-thread-#22942%grid-0%][Checkpointer] Checkpoint finished [cpId=47a1e58f-3f7d-42bc-8a4d-f65e22288134, pages=50, markPos=WALPointer [idx=6, fileOff=179338, len=2010], walSegmentsCovered=[5], markDuration=5ms, pagesWrite=4ms, fsync=15ms, total=25ms] [21:11:42] : [Step 4/5] [2021-11-19 21:11:42,270][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:42] : [Step 4/5] [2021-11-19 21:11:42,407][INFO ][disco-notifier-worker-#22803%grid-0%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:42] : [Step 4/5] [2021-11-19 21:11:42,411][INFO ][disco-notifier-worker-#22922%grid-1%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:42] : [Step 4/5] [2021-11-19 21:11:42,542][INFO ][disco-notifier-worker-#22803%grid-0%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:42] : [Step 4/5] [2021-11-19 21:11:42,548][INFO ][disco-notifier-worker-#22922%grid-1%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:42] : [Step 4/5] [2021-11-19 21:11:42,630][INFO ][disco-notifier-worker-#22803%grid-0%][GridEncryptionManager] Start master key change [masterKeyName=ignite.master.key3] [21:11:42] : [Step 4/5] [2021-11-19 21:11:42,630][INFO ][disco-notifier-worker-#22922%grid-1%][GridEncryptionManager] Start master key change [masterKeyName=ignite.master.key3] [21:11:42] : [Step 4/5] [2021-11-19 21:11:42,684][INFO ][disco-notifier-worker-#22803%grid-0%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:42] : [Step 4/5] [2021-11-19 21:11:42,695][INFO ][disco-notifier-worker-#22922%grid-1%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:42] : [Step 4/5] [2021-11-19 21:11:42,767][INFO ][disco-notifier-worker-#22803%grid-0%][GridEncryptionManager] Master key successfully changed [masterKeyName=ignite.master.key3] [21:11:42] : [Step 4/5] [2021-11-19 21:11:42,768][INFO ][disco-notifier-worker-#22803%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=28] [21:11:42] : [Step 4/5] [2021-11-19 21:11:42,769][INFO ][reencrypt-#22963%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:11:42] : [Step 4/5] [2021-11-19 21:11:42,777][INFO ][disco-notifier-worker-#22922%grid-1%][GridEncryptionManager] Master key successfully changed [masterKeyName=ignite.master.key3] [21:11:42] : [Step 4/5] [2021-11-19 21:11:42,778][INFO ][disco-notifier-worker-#22922%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=28] [21:11:42] : [Step 4/5] [2021-11-19 21:11:42,778][INFO ][reencrypt-#22964%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:11:42] : [Step 4/5] [2021-11-19 21:11:42,979][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10ca909b-1957-42c9-93b4-147fa476d001, grp=1613773252] [21:11:42] : [Step 4/5] [2021-11-19 21:11:42,983][INFO ][db-checkpoint-thread-#22945%grid-1%][Checkpointer] Checkpoint started [checkpointId=f464b2c1-00a2-4cd6-a974-062f50b5246f, startPtr=WALPointer [idx=8, fileOff=643754, len=2048], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=1ms, writeCheckpointEntryDuration=2ms, splitAndSortCpPagesDuration=0ms, pages=70, reason='test'] [21:11:43] : [Step 4/5] [2021-11-19 21:11:43,002][INFO ][db-checkpoint-thread-#22945%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:11:43] : [Step 4/5] [2021-11-19 21:11:43,002][INFO ][db-checkpoint-thread-#22945%grid-1%][Checkpointer] Checkpoint finished [cpId=f464b2c1-00a2-4cd6-a974-062f50b5246f, pages=70, markPos=WALPointer [idx=8, fileOff=643754, len=2048], walSegmentsCovered=[], markDuration=3ms, pagesWrite=3ms, fsync=16ms, total=23ms] [21:11:43] : [Step 4/5] [2021-11-19 21:11:43,004][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00a4fdec-fb9a-4106-96a3-cca8453c6000, grp=1613773252] [21:11:43] : [Step 4/5] [2021-11-19 21:11:43,011][INFO ][db-checkpoint-thread-#22942%grid-0%][Checkpointer] Checkpoint started [checkpointId=80ecda1a-8e0c-4129-b371-7d0845916ebb, startPtr=WALPointer [idx=6, fileOff=469707, len=2010], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=5ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=0ms, pages=50, reason='test'] [21:11:43] : [Step 4/5] [2021-11-19 21:11:43,030][INFO ][db-checkpoint-thread-#22942%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:11:43] : [Step 4/5] [2021-11-19 21:11:43,031][INFO ][db-checkpoint-thread-#22942%grid-0%][Checkpointer] Checkpoint finished [cpId=80ecda1a-8e0c-4129-b371-7d0845916ebb, pages=50, markPos=WALPointer [idx=6, fileOff=469707, len=2010], walSegmentsCovered=[], markDuration=7ms, pagesWrite=2ms, fsync=17ms, total=27ms] [21:11:43] : [Step 4/5] [2021-11-19 21:11:43,085][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:43] : [Step 4/5] [2021-11-19 21:11:43,221][INFO ][disco-notifier-worker-#22803%grid-0%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:43] : [Step 4/5] [2021-11-19 21:11:43,222][INFO ][disco-notifier-worker-#22922%grid-1%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:43] : [Step 4/5] [2021-11-19 21:11:43,355][INFO ][disco-notifier-worker-#22803%grid-0%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:43] : [Step 4/5] [2021-11-19 21:11:43,355][INFO ][disco-notifier-worker-#22922%grid-1%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:43] : [Step 4/5] [2021-11-19 21:11:43,438][INFO ][disco-notifier-worker-#22803%grid-0%][GridEncryptionManager] Start master key change [masterKeyName=ignite.master.key2] [21:11:43] : [Step 4/5] [2021-11-19 21:11:43,438][INFO ][disco-notifier-worker-#22922%grid-1%][GridEncryptionManager] Start master key change [masterKeyName=ignite.master.key2] [21:11:43] : [Step 4/5] [2021-11-19 21:11:43,495][INFO ][disco-notifier-worker-#22803%grid-0%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:43] : [Step 4/5] [2021-11-19 21:11:43,495][INFO ][disco-notifier-worker-#22922%grid-1%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:43] : [Step 4/5] [2021-11-19 21:11:43,579][INFO ][disco-notifier-worker-#22803%grid-0%][GridEncryptionManager] Master key successfully changed [masterKeyName=ignite.master.key2] [21:11:43] : [Step 4/5] [2021-11-19 21:11:43,579][INFO ][disco-notifier-worker-#22922%grid-1%][GridEncryptionManager] Master key successfully changed [masterKeyName=ignite.master.key2] [21:11:43] : [Step 4/5] [2021-11-19 21:11:43,581][INFO ][disco-notifier-worker-#22803%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=29] [21:11:43] : [Step 4/5] [2021-11-19 21:11:43,581][INFO ][disco-notifier-worker-#22922%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=29] [21:11:43] : [Step 4/5] [2021-11-19 21:11:43,581][INFO ][reencrypt-#22963%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:11:43] : [Step 4/5] [2021-11-19 21:11:43,581][INFO ][reencrypt-#22964%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:11:43] : [Step 4/5] [2021-11-19 21:11:43,783][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10ca909b-1957-42c9-93b4-147fa476d001, grp=1613773252] [21:11:43] : [Step 4/5] [2021-11-19 21:11:43,788][INFO ][db-checkpoint-thread-#22945%grid-1%][Checkpointer] Checkpoint started [checkpointId=87b6e463-98d5-44ed-904c-a8a797d1272b, startPtr=WALPointer [idx=8, fileOff=1022962, len=2048], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=2ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=0ms, pages=73, reason='test'] [21:11:43] : [Step 4/5] [2021-11-19 21:11:43,807][INFO ][db-checkpoint-thread-#22945%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:11:43] : [Step 4/5] [2021-11-19 21:11:43,808][INFO ][db-checkpoint-thread-#22945%grid-1%][Checkpointer] Checkpoint finished [cpId=87b6e463-98d5-44ed-904c-a8a797d1272b, pages=73, markPos=WALPointer [idx=8, fileOff=1022962, len=2048], walSegmentsCovered=[], markDuration=4ms, pagesWrite=3ms, fsync=17ms, total=25ms] [21:11:43] : [Step 4/5] [2021-11-19 21:11:43,809][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00a4fdec-fb9a-4106-96a3-cca8453c6000, grp=1613773252] [21:11:43] : [Step 4/5] [2021-11-19 21:11:43,818][INFO ][db-checkpoint-thread-#22942%grid-0%][Checkpointer] Checkpoint started [checkpointId=18cf962b-6a2b-41ba-818f-a2fa0f3a2a00, startPtr=WALPointer [idx=6, fileOff=765697, len=2010], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=6ms, writeCheckpointEntryDuration=2ms, splitAndSortCpPagesDuration=0ms, pages=53, reason='test'] [21:11:43] : [Step 4/5] [2021-11-19 21:11:43,837][INFO ][db-checkpoint-thread-#22942%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:11:43] : [Step 4/5] [2021-11-19 21:11:43,837][INFO ][db-checkpoint-thread-#22942%grid-0%][Checkpointer] Checkpoint finished [cpId=18cf962b-6a2b-41ba-818f-a2fa0f3a2a00, pages=53, markPos=WALPointer [idx=6, fileOff=765697, len=2010], walSegmentsCovered=[], markDuration=9ms, pagesWrite=1ms, fsync=17ms, total=28ms] [21:11:43] : [Step 4/5] [2021-11-19 21:11:43,845][INFO ][wal-file-archiver%grid-1-#22937%grid-1%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=8, segIdx=8, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000008.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000008.wal] [21:11:43] : [Step 4/5] [2021-11-19 21:11:43,847][INFO ][disco-notifier-worker-#22803%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=30] [21:11:43] : [Step 4/5] [2021-11-19 21:11:43,847][INFO ][disco-notifier-worker-#22922%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=30] [21:11:43] : [Step 4/5] [2021-11-19 21:11:43,847][INFO ][reencrypt-#22963%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:11:43] : [Step 4/5] [2021-11-19 21:11:43,848][INFO ][reencrypt-#22964%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:11:43] : [Step 4/5] [2021-11-19 21:11:43,893][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:43] : [Step 4/5] [2021-11-19 21:11:43,951][INFO ][wal-file-archiver%grid-1-#22937%grid-1%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000008.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000008.wal] [21:11:44] : [Step 4/5] [2021-11-19 21:11:44,084][INFO ][disco-notifier-worker-#22803%grid-0%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:44] : [Step 4/5] [2021-11-19 21:11:44,084][INFO ][disco-notifier-worker-#22922%grid-1%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:44] : [Step 4/5] [2021-11-19 21:11:44,220][INFO ][disco-notifier-worker-#22803%grid-0%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:44] : [Step 4/5] [2021-11-19 21:11:44,220][INFO ][disco-notifier-worker-#22922%grid-1%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:44] : [Step 4/5] [2021-11-19 21:11:44,302][INFO ][disco-notifier-worker-#22803%grid-0%][GridEncryptionManager] Start master key change [masterKeyName=ignite.master.key3] [21:11:44] : [Step 4/5] [2021-11-19 21:11:44,302][INFO ][disco-notifier-worker-#22922%grid-1%][GridEncryptionManager] Start master key change [masterKeyName=ignite.master.key3] [21:11:44] : [Step 4/5] [2021-11-19 21:11:44,358][INFO ][disco-notifier-worker-#22803%grid-0%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:44] : [Step 4/5] [2021-11-19 21:11:44,360][INFO ][disco-notifier-worker-#22922%grid-1%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:44] : [Step 4/5] [2021-11-19 21:11:44,445][INFO ][disco-notifier-worker-#22922%grid-1%][GridEncryptionManager] Master key successfully changed [masterKeyName=ignite.master.key3] [21:11:44] : [Step 4/5] [2021-11-19 21:11:44,575][INFO ][wal-file-archiver%grid-0-#22934%grid-0%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=6, segIdx=6, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000006.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000006.wal] [21:11:44] : [Step 4/5] [2021-11-19 21:11:44,576][INFO ][disco-notifier-worker-#22803%grid-0%][GridEncryptionManager] Master key successfully changed [masterKeyName=ignite.master.key3] [21:11:44] : [Step 4/5] [2021-11-19 21:11:44,577][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10ca909b-1957-42c9-93b4-147fa476d001, grp=1613773252] [21:11:44] : [Step 4/5] [2021-11-19 21:11:44,605][INFO ][wal-file-archiver%grid-0-#22934%grid-0%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000006.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000006.wal] [21:11:44] : [Step 4/5] [2021-11-19 21:11:44,613][INFO ][db-checkpoint-thread-#22945%grid-1%][Checkpointer] Checkpoint started [checkpointId=20b9d540-e58d-4c4c-8b41-42a6b8657bec, startPtr=WALPointer [idx=9, fileOff=363410, len=2048], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=25ms, writeCheckpointEntryDuration=10ms, splitAndSortCpPagesDuration=0ms, pages=74, reason='test'] [21:11:44] : [Step 4/5] [2021-11-19 21:11:44,634][INFO ][db-checkpoint-thread-#22945%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:11:44] : [Step 4/5] [2021-11-19 21:11:44,634][INFO ][db-checkpoint-thread-#22945%grid-1%][Checkpointer] Checkpoint finished [cpId=20b9d540-e58d-4c4c-8b41-42a6b8657bec, pages=74, markPos=WALPointer [idx=9, fileOff=363410, len=2048], walSegmentsCovered=[8], markDuration=36ms, pagesWrite=2ms, fsync=18ms, total=56ms] [21:11:44] : [Step 4/5] [2021-11-19 21:11:44,635][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00a4fdec-fb9a-4106-96a3-cca8453c6000, grp=1613773252] [21:11:44] : [Step 4/5] [2021-11-19 21:11:44,643][INFO ][db-checkpoint-thread-#22942%grid-0%][Checkpointer] Checkpoint started [checkpointId=5880f495-c12a-4917-a2b1-5e3b7511c260, startPtr=WALPointer [idx=7, fileOff=21689, len=2010], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=6ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=0ms, pages=54, reason='test'] [21:11:44] : [Step 4/5] [2021-11-19 21:11:44,663][INFO ][db-checkpoint-thread-#22942%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:11:44] : [Step 4/5] [2021-11-19 21:11:44,663][INFO ][db-checkpoint-thread-#22942%grid-0%][Checkpointer] Checkpoint finished [cpId=5880f495-c12a-4917-a2b1-5e3b7511c260, pages=54, markPos=WALPointer [idx=7, fileOff=21689, len=2010], walSegmentsCovered=[6], markDuration=8ms, pagesWrite=2ms, fsync=17ms, total=28ms] [21:11:44] : [Step 4/5] [2021-11-19 21:11:44,668][INFO ][disco-notifier-worker-#22803%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=31] [21:11:44] : [Step 4/5] [2021-11-19 21:11:44,668][INFO ][disco-notifier-worker-#22922%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=31] [21:11:44] : [Step 4/5] [2021-11-19 21:11:44,668][INFO ][reencrypt-#22963%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:11:44] : [Step 4/5] [2021-11-19 21:11:44,669][INFO ][reencrypt-#22964%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:11:44] : [Step 4/5] [2021-11-19 21:11:44,720][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:44] : [Step 4/5] [2021-11-19 21:11:44,856][INFO ][disco-notifier-worker-#22803%grid-0%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:44] : [Step 4/5] [2021-11-19 21:11:44,858][INFO ][disco-notifier-worker-#22922%grid-1%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:44] : [Step 4/5] [2021-11-19 21:11:44,992][INFO ][disco-notifier-worker-#22803%grid-0%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:44] : [Step 4/5] [2021-11-19 21:11:44,993][INFO ][disco-notifier-worker-#22922%grid-1%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:45] : [Step 4/5] [2021-11-19 21:11:45,077][INFO ][disco-notifier-worker-#22803%grid-0%][GridEncryptionManager] Start master key change [masterKeyName=ignite.master.key2] [21:11:45] : [Step 4/5] [2021-11-19 21:11:45,078][INFO ][disco-notifier-worker-#22922%grid-1%][GridEncryptionManager] Start master key change [masterKeyName=ignite.master.key2] [21:11:45] : [Step 4/5] [2021-11-19 21:11:45,132][INFO ][disco-notifier-worker-#22803%grid-0%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:45] : [Step 4/5] [2021-11-19 21:11:45,132][INFO ][disco-notifier-worker-#22922%grid-1%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:45] : [Step 4/5] [2021-11-19 21:11:45,214][INFO ][disco-notifier-worker-#22922%grid-1%][GridEncryptionManager] Master key successfully changed [masterKeyName=ignite.master.key2] [21:11:45] : [Step 4/5] [2021-11-19 21:11:45,215][INFO ][disco-notifier-worker-#22803%grid-0%][GridEncryptionManager] Master key successfully changed [masterKeyName=ignite.master.key2] [21:11:45] : [Step 4/5] [2021-11-19 21:11:45,216][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10ca909b-1957-42c9-93b4-147fa476d001, grp=1613773252] [21:11:45] : [Step 4/5] [2021-11-19 21:11:45,425][INFO ][db-checkpoint-thread-#22945%grid-1%][Checkpointer] Checkpoint started [checkpointId=0e8087c8-736b-45f6-b0c9-dab7b757cf77, startPtr=WALPointer [idx=9, fileOff=752527, len=2048], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=160ms, writeCheckpointEntryDuration=48ms, splitAndSortCpPagesDuration=0ms, pages=71, reason='test'] [21:11:45] : [Step 4/5] [2021-11-19 21:11:45,438][INFO ][db-checkpoint-thread-#22945%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:11:45] : [Step 4/5] [2021-11-19 21:11:45,439][INFO ][db-checkpoint-thread-#22945%grid-1%][Checkpointer] Checkpoint finished [cpId=0e8087c8-736b-45f6-b0c9-dab7b757cf77, pages=71, markPos=WALPointer [idx=9, fileOff=752527, len=2048], walSegmentsCovered=[], markDuration=209ms, pagesWrite=2ms, fsync=11ms, total=222ms] [21:11:45] : [Step 4/5] [2021-11-19 21:11:45,440][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00a4fdec-fb9a-4106-96a3-cca8453c6000, grp=1613773252] [21:11:45] : [Step 4/5] [2021-11-19 21:11:45,448][INFO ][db-checkpoint-thread-#22942%grid-0%][Checkpointer] Checkpoint started [checkpointId=235a3ca3-ec50-4655-b70f-48a4e6487635, startPtr=WALPointer [idx=7, fileOff=327588, len=2010], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=5ms, writeCheckpointEntryDuration=2ms, splitAndSortCpPagesDuration=0ms, pages=51, reason='test'] [21:11:45] : [Step 4/5] [2021-11-19 21:11:45,459][INFO ][db-checkpoint-thread-#22942%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:11:45] : [Step 4/5] [2021-11-19 21:11:45,459][INFO ][db-checkpoint-thread-#22942%grid-0%][Checkpointer] Checkpoint finished [cpId=235a3ca3-ec50-4655-b70f-48a4e6487635, pages=51, markPos=WALPointer [idx=7, fileOff=327588, len=2010], walSegmentsCovered=[], markDuration=8ms, pagesWrite=2ms, fsync=8ms, total=18ms] [21:11:45] : [Step 4/5] [2021-11-19 21:11:45,464][INFO ][disco-notifier-worker-#22803%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=32] [21:11:45] : [Step 4/5] [2021-11-19 21:11:45,465][INFO ][reencrypt-#22963%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:11:45] : [Step 4/5] [2021-11-19 21:11:45,468][INFO ][disco-notifier-worker-#22922%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=32] [21:11:45] : [Step 4/5] [2021-11-19 21:11:45,469][INFO ][reencrypt-#22964%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:11:45] : [Step 4/5] [2021-11-19 21:11:45,477][INFO ][wal-file-archiver%grid-1-#22937%grid-1%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=9, segIdx=9, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000009.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000009.wal] [21:11:45] : [Step 4/5] [2021-11-19 21:11:45,488][INFO ][wal-file-archiver%grid-1-#22937%grid-1%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000009.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000009.wal] [21:11:45] : [Step 4/5] [2021-11-19 21:11:45,528][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:45] : [Step 4/5] [2021-11-19 21:11:45,667][INFO ][disco-notifier-worker-#22803%grid-0%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:45] : [Step 4/5] [2021-11-19 21:11:45,669][INFO ][disco-notifier-worker-#22922%grid-1%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:45] : [Step 4/5] [2021-11-19 21:11:45,805][INFO ][disco-notifier-worker-#22922%grid-1%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:45] : [Step 4/5] [2021-11-19 21:11:45,806][INFO ][disco-notifier-worker-#22803%grid-0%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:45] : [Step 4/5] [2021-11-19 21:11:45,887][INFO ][disco-notifier-worker-#22803%grid-0%][GridEncryptionManager] Start master key change [masterKeyName=ignite.master.key3] [21:11:45] : [Step 4/5] [2021-11-19 21:11:45,887][INFO ][disco-notifier-worker-#22922%grid-1%][GridEncryptionManager] Start master key change [masterKeyName=ignite.master.key3] [21:11:45] : [Step 4/5] [2021-11-19 21:11:45,940][INFO ][disco-notifier-worker-#22803%grid-0%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:45] : [Step 4/5] [2021-11-19 21:11:45,941][INFO ][disco-notifier-worker-#22922%grid-1%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:46] : [Step 4/5] [2021-11-19 21:11:46,021][INFO ][disco-notifier-worker-#22803%grid-0%][GridEncryptionManager] Master key successfully changed [masterKeyName=ignite.master.key3] [21:11:46] : [Step 4/5] [2021-11-19 21:11:46,022][INFO ][disco-notifier-worker-#22922%grid-1%][GridEncryptionManager] Master key successfully changed [masterKeyName=ignite.master.key3] [21:11:46] : [Step 4/5] [2021-11-19 21:11:46,024][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10ca909b-1957-42c9-93b4-147fa476d001, grp=1613773252] [21:11:46] : [Step 4/5] [2021-11-19 21:11:46,227][INFO ][db-checkpoint-thread-#22945%grid-1%][Checkpointer] Checkpoint started [checkpointId=998a674d-aee6-4383-bf2a-85383c7c94de, startPtr=WALPointer [idx=10, fileOff=94114, len=2048], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=83ms, writeCheckpointEntryDuration=119ms, splitAndSortCpPagesDuration=0ms, pages=72, reason='test'] [21:11:46] : [Step 4/5] [2021-11-19 21:11:46,248][INFO ][db-checkpoint-thread-#22945%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:11:46] : [Step 4/5] [2021-11-19 21:11:46,249][INFO ][db-checkpoint-thread-#22945%grid-1%][Checkpointer] Checkpoint finished [cpId=998a674d-aee6-4383-bf2a-85383c7c94de, pages=72, markPos=WALPointer [idx=10, fileOff=94114, len=2048], walSegmentsCovered=[9], markDuration=203ms, pagesWrite=2ms, fsync=19ms, total=225ms] [21:11:46] : [Step 4/5] [2021-11-19 21:11:46,250][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00a4fdec-fb9a-4106-96a3-cca8453c6000, grp=1613773252] [21:11:46] : [Step 4/5] [2021-11-19 21:11:46,258][INFO ][db-checkpoint-thread-#22942%grid-0%][Checkpointer] Checkpoint started [checkpointId=cc5ab08b-b158-40c1-b2c1-639f91374e25, startPtr=WALPointer [idx=7, fileOff=632024, len=2010], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=4ms, writeCheckpointEntryDuration=2ms, splitAndSortCpPagesDuration=0ms, pages=52, reason='test'] [21:11:46] : [Step 4/5] [2021-11-19 21:11:46,278][INFO ][db-checkpoint-thread-#22942%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:11:46] : [Step 4/5] [2021-11-19 21:11:46,278][INFO ][db-checkpoint-thread-#22942%grid-0%][Checkpointer] Checkpoint finished [cpId=cc5ab08b-b158-40c1-b2c1-639f91374e25, pages=52, markPos=WALPointer [idx=7, fileOff=632024, len=2010], walSegmentsCovered=[], markDuration=7ms, pagesWrite=2ms, fsync=18ms, total=27ms] [21:11:46] : [Step 4/5] [2021-11-19 21:11:46,283][INFO ][disco-notifier-worker-#22803%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=33] [21:11:46] : [Step 4/5] [2021-11-19 21:11:46,283][INFO ][reencrypt-#22963%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:11:46] : [Step 4/5] [2021-11-19 21:11:46,284][INFO ][disco-notifier-worker-#22922%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=33] [21:11:46] : [Step 4/5] [2021-11-19 21:11:46,284][INFO ][reencrypt-#22964%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:11:46] : [Step 4/5] [2021-11-19 21:11:46,340][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:46] : [Step 4/5] [2021-11-19 21:11:46,485][INFO ][disco-notifier-worker-#22803%grid-0%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:46] : [Step 4/5] [2021-11-19 21:11:46,485][INFO ][disco-notifier-worker-#22922%grid-1%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:46] : [Step 4/5] [2021-11-19 21:11:46,622][INFO ][disco-notifier-worker-#22922%grid-1%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:46] : [Step 4/5] [2021-11-19 21:11:46,630][INFO ][disco-notifier-worker-#22803%grid-0%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:46] : [Step 4/5] [2021-11-19 21:11:46,721][INFO ][disco-notifier-worker-#22803%grid-0%][GridEncryptionManager] Start master key change [masterKeyName=ignite.master.key2] [21:11:46] : [Step 4/5] [2021-11-19 21:11:46,721][INFO ][disco-notifier-worker-#22922%grid-1%][GridEncryptionManager] Start master key change [masterKeyName=ignite.master.key2] [21:11:46] : [Step 4/5] [2021-11-19 21:11:46,794][INFO ][disco-notifier-worker-#22803%grid-0%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:46] : [Step 4/5] [2021-11-19 21:11:46,794][INFO ][disco-notifier-worker-#22922%grid-1%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:46] : [Step 4/5] [2021-11-19 21:11:46,883][INFO ][disco-notifier-worker-#22803%grid-0%][GridEncryptionManager] Master key successfully changed [masterKeyName=ignite.master.key2] [21:11:46] : [Step 4/5] [2021-11-19 21:11:46,884][INFO ][disco-notifier-worker-#22922%grid-1%][GridEncryptionManager] Master key successfully changed [masterKeyName=ignite.master.key2] [21:11:46] : [Step 4/5] [2021-11-19 21:11:46,886][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10ca909b-1957-42c9-93b4-147fa476d001, grp=1613773252] [21:11:47] : [Step 4/5] [2021-11-19 21:11:47,044][INFO ][db-checkpoint-thread-#22945%grid-1%][Checkpointer] Checkpoint started [checkpointId=fabfc4f3-38e2-46ee-8bf8-acbedfdd0ff2, startPtr=WALPointer [idx=10, fileOff=488258, len=2048], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=155ms, writeCheckpointEntryDuration=2ms, splitAndSortCpPagesDuration=0ms, pages=72, reason='test'] [21:11:47] : [Step 4/5] [2021-11-19 21:11:47,064][INFO ][db-checkpoint-thread-#22945%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:11:47] : [Step 4/5] [2021-11-19 21:11:47,065][INFO ][db-checkpoint-thread-#22945%grid-1%][Checkpointer] Checkpoint finished [cpId=fabfc4f3-38e2-46ee-8bf8-acbedfdd0ff2, pages=72, markPos=WALPointer [idx=10, fileOff=488258, len=2048], walSegmentsCovered=[], markDuration=158ms, pagesWrite=2ms, fsync=18ms, total=178ms] [21:11:47] : [Step 4/5] [2021-11-19 21:11:47,066][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00a4fdec-fb9a-4106-96a3-cca8453c6000, grp=1613773252] [21:11:47] : [Step 4/5] [2021-11-19 21:11:47,074][INFO ][db-checkpoint-thread-#22942%grid-0%][Checkpointer] Checkpoint started [checkpointId=920c0496-112e-4eb3-a0a9-ff0e49385e95, startPtr=WALPointer [idx=7, fileOff=942950, len=2010], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=1ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=5ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=1ms, pages=52, reason='test'] [21:11:47] : [Step 4/5] [2021-11-19 21:11:47,094][INFO ][db-checkpoint-thread-#22942%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:11:47] : [Step 4/5] [2021-11-19 21:11:47,094][INFO ][db-checkpoint-thread-#22942%grid-0%][Checkpointer] Checkpoint finished [cpId=920c0496-112e-4eb3-a0a9-ff0e49385e95, pages=52, markPos=WALPointer [idx=7, fileOff=942950, len=2010], walSegmentsCovered=[], markDuration=8ms, pagesWrite=2ms, fsync=18ms, total=28ms] [21:11:47] : [Step 4/5] [2021-11-19 21:11:47,099][INFO ][disco-notifier-worker-#22803%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=34] [21:11:47] : [Step 4/5] [2021-11-19 21:11:47,099][INFO ][disco-notifier-worker-#22922%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=34] [21:11:47] : [Step 4/5] [2021-11-19 21:11:47,099][INFO ][reencrypt-#22963%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:11:47] : [Step 4/5] [2021-11-19 21:11:47,099][INFO ][reencrypt-#22964%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:11:47] : [Step 4/5] [2021-11-19 21:11:47,102][INFO ][wal-file-archiver%grid-0-#22934%grid-0%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=7, segIdx=7, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000007.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000007.wal] [21:11:47] : [Step 4/5] [2021-11-19 21:11:47,111][INFO ][wal-file-archiver%grid-0-#22934%grid-0%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000007.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000007.wal] [21:11:47] : [Step 4/5] [2021-11-19 21:11:47,152][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:47] : [Step 4/5] [2021-11-19 21:11:47,290][INFO ][disco-notifier-worker-#22803%grid-0%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:47] : [Step 4/5] [2021-11-19 21:11:47,296][INFO ][disco-notifier-worker-#22922%grid-1%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:47] : [Step 4/5] [2021-11-19 21:11:47,454][INFO ][disco-notifier-worker-#22803%grid-0%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:47] : [Step 4/5] [2021-11-19 21:11:47,464][INFO ][disco-notifier-worker-#22922%grid-1%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:47] : [Step 4/5] [2021-11-19 21:11:47,562][INFO ][disco-notifier-worker-#22803%grid-0%][GridEncryptionManager] Start master key change [masterKeyName=ignite.master.key3] [21:11:47] : [Step 4/5] [2021-11-19 21:11:47,562][INFO ][disco-notifier-worker-#22922%grid-1%][GridEncryptionManager] Start master key change [masterKeyName=ignite.master.key3] [21:11:47] : [Step 4/5] [2021-11-19 21:11:47,618][INFO ][disco-notifier-worker-#22803%grid-0%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:47] : [Step 4/5] [2021-11-19 21:11:47,618][INFO ][disco-notifier-worker-#22922%grid-1%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:47] : [Step 4/5] [2021-11-19 21:11:47,705][INFO ][disco-notifier-worker-#22922%grid-1%][GridEncryptionManager] Master key successfully changed [masterKeyName=ignite.master.key3] [21:11:47] : [Step 4/5] [2021-11-19 21:11:47,705][INFO ][disco-notifier-worker-#22803%grid-0%][GridEncryptionManager] Master key successfully changed [masterKeyName=ignite.master.key3] [21:11:47] : [Step 4/5] [2021-11-19 21:11:47,707][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10ca909b-1957-42c9-93b4-147fa476d001, grp=1613773252] [21:11:47] : [Step 4/5] [2021-11-19 21:11:47,860][INFO ][db-checkpoint-thread-#22945%grid-1%][Checkpointer] Checkpoint started [checkpointId=3ec1dce0-6b8c-4a47-8071-f4e11992ac75, startPtr=WALPointer [idx=10, fileOff=885253, len=2048], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=49ms, writeCheckpointEntryDuration=103ms, splitAndSortCpPagesDuration=0ms, pages=73, reason='test'] [21:11:47] : [Step 4/5] [2021-11-19 21:11:47,878][INFO ][db-checkpoint-thread-#22945%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:11:47] : [Step 4/5] [2021-11-19 21:11:47,878][INFO ][db-checkpoint-thread-#22945%grid-1%][Checkpointer] Checkpoint finished [cpId=3ec1dce0-6b8c-4a47-8071-f4e11992ac75, pages=73, markPos=WALPointer [idx=10, fileOff=885253, len=2048], walSegmentsCovered=[], markDuration=153ms, pagesWrite=3ms, fsync=14ms, total=171ms] [21:11:47] : [Step 4/5] [2021-11-19 21:11:47,879][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00a4fdec-fb9a-4106-96a3-cca8453c6000, grp=1613773252] [21:11:47] : [Step 4/5] [2021-11-19 21:11:47,887][INFO ][db-checkpoint-thread-#22942%grid-0%][Checkpointer] Checkpoint started [checkpointId=d1d053f1-9f67-4413-bda0-84d3e1e309ee, startPtr=WALPointer [idx=8, fileOff=208918, len=2010], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=5ms, writeCheckpointEntryDuration=2ms, splitAndSortCpPagesDuration=0ms, pages=53, reason='test'] [21:11:47] : [Step 4/5] [2021-11-19 21:11:47,907][INFO ][db-checkpoint-thread-#22942%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:11:47] : [Step 4/5] [2021-11-19 21:11:47,907][INFO ][db-checkpoint-thread-#22942%grid-0%][Checkpointer] Checkpoint finished [cpId=d1d053f1-9f67-4413-bda0-84d3e1e309ee, pages=53, markPos=WALPointer [idx=8, fileOff=208918, len=2010], walSegmentsCovered=[7], markDuration=7ms, pagesWrite=2ms, fsync=18ms, total=28ms] [21:11:47] : [Step 4/5] [2021-11-19 21:11:47,911][INFO ][disco-notifier-worker-#22803%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=35] [21:11:47] : [Step 4/5] [2021-11-19 21:11:47,911][INFO ][reencrypt-#22963%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:11:47] : [Step 4/5] [2021-11-19 21:11:47,911][INFO ][disco-notifier-worker-#22922%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=35] [21:11:47] : [Step 4/5] [2021-11-19 21:11:47,912][INFO ][reencrypt-#22964%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:11:47] : [Step 4/5] [2021-11-19 21:11:47,924][INFO ][wal-file-archiver%grid-1-#22937%grid-1%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=10, segIdx=0, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000000.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000010.wal] [21:11:47] : [Step 4/5] [2021-11-19 21:11:47,925][INFO ][wal-file-cleaner%grid-1-#22938%grid-1%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=1, currSize=10.0 MB, maxSize=20.0 MB] [21:11:47] : [Step 4/5] [2021-11-19 21:11:47,931][INFO ][wal-file-cleaner%grid-1-#22938%grid-1%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:11:47] : [Step 4/5] [2021-11-19 21:11:47,935][INFO ][wal-file-archiver%grid-1-#22937%grid-1%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000000.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000010.wal] [21:11:47] : [Step 4/5] [2021-11-19 21:11:47,963][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:48] : [Step 4/5] [2021-11-19 21:11:48,099][INFO ][disco-notifier-worker-#22922%grid-1%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:48] : [Step 4/5] [2021-11-19 21:11:48,100][INFO ][disco-notifier-worker-#22803%grid-0%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:48] : [Step 4/5] [2021-11-19 21:11:48,236][INFO ][disco-notifier-worker-#22803%grid-0%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:48] : [Step 4/5] [2021-11-19 21:11:48,238][INFO ][disco-notifier-worker-#22922%grid-1%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:48] : [Step 4/5] [2021-11-19 21:11:48,322][INFO ][disco-notifier-worker-#22803%grid-0%][GridEncryptionManager] Start master key change [masterKeyName=ignite.master.key2] [21:11:48] : [Step 4/5] [2021-11-19 21:11:48,322][INFO ][disco-notifier-worker-#22922%grid-1%][GridEncryptionManager] Start master key change [masterKeyName=ignite.master.key2] [21:11:48] : [Step 4/5] [2021-11-19 21:11:48,377][INFO ][disco-notifier-worker-#22922%grid-1%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:48] : [Step 4/5] [2021-11-19 21:11:48,383][INFO ][disco-notifier-worker-#22803%grid-0%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:48] : [Step 4/5] [2021-11-19 21:11:48,466][INFO ][disco-notifier-worker-#22922%grid-1%][GridEncryptionManager] Master key successfully changed [masterKeyName=ignite.master.key2] [21:11:48] : [Step 4/5] [2021-11-19 21:11:48,466][INFO ][disco-notifier-worker-#22803%grid-0%][GridEncryptionManager] Master key successfully changed [masterKeyName=ignite.master.key2] [21:11:48] : [Step 4/5] [2021-11-19 21:11:48,467][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10ca909b-1957-42c9-93b4-147fa476d001, grp=1613773252] [21:11:48] : [Step 4/5] [2021-11-19 21:11:48,471][INFO ][db-checkpoint-thread-#22945%grid-1%][Checkpointer] Checkpoint started [checkpointId=5fcb7ed6-5e48-422d-93c4-59df3651e8c7, startPtr=WALPointer [idx=11, fileOff=245418, len=2048], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=1ms, writeCheckpointEntryDuration=2ms, splitAndSortCpPagesDuration=0ms, pages=75, reason='test'] [21:11:48] : [Step 4/5] [2021-11-19 21:11:48,492][INFO ][db-checkpoint-thread-#22945%grid-1%][GridEncryptionManager] Previous encryption keys were removed [grpId=1613773252, keyIds=[0, 1, 2, 3]] [21:11:48] : [Step 4/5] [2021-11-19 21:11:48,492][INFO ][db-checkpoint-thread-#22945%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:11:48] : [Step 4/5] [2021-11-19 21:11:48,492][INFO ][db-checkpoint-thread-#22945%grid-1%][Checkpointer] Checkpoint finished [cpId=5fcb7ed6-5e48-422d-93c4-59df3651e8c7, pages=75, markPos=WALPointer [idx=11, fileOff=245418, len=2048], walSegmentsCovered=[10], markDuration=3ms, pagesWrite=3ms, fsync=18ms, total=24ms] [21:11:48] : [Step 4/5] [2021-11-19 21:11:48,493][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00a4fdec-fb9a-4106-96a3-cca8453c6000, grp=1613773252] [21:11:48] : [Step 4/5] [2021-11-19 21:11:48,500][INFO ][db-checkpoint-thread-#22942%grid-0%][Checkpointer] Checkpoint started [checkpointId=e6a51ceb-cf1b-43e3-8ab5-0d42b4f4d0b5, startPtr=WALPointer [idx=8, fileOff=526767, len=2010], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=4ms, writeCheckpointEntryDuration=2ms, splitAndSortCpPagesDuration=0ms, pages=54, reason='test'] [21:11:48] : [Step 4/5] [2021-11-19 21:11:48,519][INFO ][db-checkpoint-thread-#22942%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:11:48] : [Step 4/5] [2021-11-19 21:11:48,519][INFO ][db-checkpoint-thread-#22942%grid-0%][Checkpointer] Checkpoint finished [cpId=e6a51ceb-cf1b-43e3-8ab5-0d42b4f4d0b5, pages=54, markPos=WALPointer [idx=8, fileOff=526767, len=2010], walSegmentsCovered=[], markDuration=6ms, pagesWrite=3ms, fsync=16ms, total=26ms] [21:11:48] : [Step 4/5] [2021-11-19 21:11:48,577][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:48] : [Step 4/5] [2021-11-19 21:11:48,715][INFO ][disco-notifier-worker-#22922%grid-1%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:48] : [Step 4/5] [2021-11-19 21:11:48,715][INFO ][disco-notifier-worker-#22803%grid-0%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:48] : [Step 4/5] [2021-11-19 21:11:48,851][INFO ][disco-notifier-worker-#22922%grid-1%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:48] : [Step 4/5] [2021-11-19 21:11:48,851][INFO ][disco-notifier-worker-#22803%grid-0%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:48] : [Step 4/5] [2021-11-19 21:11:48,939][INFO ][disco-notifier-worker-#22803%grid-0%][GridEncryptionManager] Start master key change [masterKeyName=ignite.master.key3] [21:11:48] : [Step 4/5] [2021-11-19 21:11:48,939][INFO ][disco-notifier-worker-#22922%grid-1%][GridEncryptionManager] Start master key change [masterKeyName=ignite.master.key3] [21:11:48] : [Step 4/5] [2021-11-19 21:11:48,992][INFO ][disco-notifier-worker-#22803%grid-0%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:48] : [Step 4/5] [2021-11-19 21:11:48,994][INFO ][disco-notifier-worker-#22922%grid-1%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:49] : [Step 4/5] [2021-11-19 21:11:49,074][INFO ][disco-notifier-worker-#22803%grid-0%][GridEncryptionManager] Master key successfully changed [masterKeyName=ignite.master.key3] [21:11:49] : [Step 4/5] [2021-11-19 21:11:49,075][INFO ][disco-notifier-worker-#22803%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=36] [21:11:49] : [Step 4/5] [2021-11-19 21:11:49,075][INFO ][reencrypt-#22963%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:11:49] : [Step 4/5] [2021-11-19 21:11:49,075][INFO ][disco-notifier-worker-#22922%grid-1%][GridEncryptionManager] Master key successfully changed [masterKeyName=ignite.master.key3] [21:11:49] : [Step 4/5] [2021-11-19 21:11:49,077][INFO ][disco-notifier-worker-#22922%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=36] [21:11:49] : [Step 4/5] [2021-11-19 21:11:49,077][INFO ][reencrypt-#22964%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:11:49] : [Step 4/5] [2021-11-19 21:11:49,278][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10ca909b-1957-42c9-93b4-147fa476d001, grp=1613773252] [21:11:49] : [Step 4/5] [2021-11-19 21:11:49,283][INFO ][db-checkpoint-thread-#22945%grid-1%][Checkpointer] Checkpoint started [checkpointId=3e2f68e0-c893-4326-8101-81efd7999296, startPtr=WALPointer [idx=11, fileOff=675310, len=2048], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=2ms, writeCheckpointEntryDuration=2ms, splitAndSortCpPagesDuration=0ms, pages=75, reason='test'] [21:11:49] : [Step 4/5] [2021-11-19 21:11:49,303][INFO ][db-checkpoint-thread-#22945%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:11:49] : [Step 4/5] [2021-11-19 21:11:49,304][INFO ][db-checkpoint-thread-#22945%grid-1%][Checkpointer] Checkpoint finished [cpId=3e2f68e0-c893-4326-8101-81efd7999296, pages=75, markPos=WALPointer [idx=11, fileOff=675310, len=2048], walSegmentsCovered=[], markDuration=4ms, pagesWrite=3ms, fsync=17ms, total=24ms] [21:11:49] : [Step 4/5] [2021-11-19 21:11:49,305][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00a4fdec-fb9a-4106-96a3-cca8453c6000, grp=1613773252] [21:11:49] : [Step 4/5] [2021-11-19 21:11:49,313][INFO ][db-checkpoint-thread-#22942%grid-0%][Checkpointer] Checkpoint started [checkpointId=80762b52-4a3d-415a-9f9d-fe698f899676, startPtr=WALPointer [idx=8, fileOff=855773, len=2010], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=6ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=0ms, pages=53, reason='test'] [21:11:49] : [Step 4/5] [2021-11-19 21:11:49,324][INFO ][db-checkpoint-thread-#22942%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:11:49] : [Step 4/5] [2021-11-19 21:11:49,325][INFO ][db-checkpoint-thread-#22942%grid-0%][Checkpointer] Checkpoint finished [cpId=80762b52-4a3d-415a-9f9d-fe698f899676, pages=53, markPos=WALPointer [idx=8, fileOff=855773, len=2010], walSegmentsCovered=[], markDuration=8ms, pagesWrite=3ms, fsync=7ms, total=19ms] [21:11:49] : [Step 4/5] [2021-11-19 21:11:49,330][INFO ][disco-notifier-worker-#22803%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=37] [21:11:49] : [Step 4/5] [2021-11-19 21:11:49,330][INFO ][disco-notifier-worker-#22922%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=37] [21:11:49] : [Step 4/5] [2021-11-19 21:11:49,330][INFO ][reencrypt-#22963%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:11:49] : [Step 4/5] [2021-11-19 21:11:49,330][INFO ][reencrypt-#22964%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:11:49] : [Step 4/5] [2021-11-19 21:11:49,334][INFO ][wal-file-archiver%grid-0-#22934%grid-0%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=8, segIdx=8, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000008.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000008.wal] [21:11:49] : [Step 4/5] [2021-11-19 21:11:49,346][INFO ][wal-file-archiver%grid-0-#22934%grid-0%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000008.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000008.wal] [21:11:49] : [Step 4/5] [2021-11-19 21:11:49,388][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:49] : [Step 4/5] [2021-11-19 21:11:49,525][INFO ][disco-notifier-worker-#22922%grid-1%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:49] : [Step 4/5] [2021-11-19 21:11:49,525][INFO ][disco-notifier-worker-#22803%grid-0%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:49] : [Step 4/5] [2021-11-19 21:11:49,660][INFO ][disco-notifier-worker-#22922%grid-1%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:49] : [Step 4/5] [2021-11-19 21:11:49,660][INFO ][disco-notifier-worker-#22803%grid-0%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:49] : [Step 4/5] [2021-11-19 21:11:49,741][INFO ][disco-notifier-worker-#22803%grid-0%][GridEncryptionManager] Start master key change [masterKeyName=ignite.master.key2] [21:11:49] : [Step 4/5] [2021-11-19 21:11:49,742][INFO ][disco-notifier-worker-#22922%grid-1%][GridEncryptionManager] Start master key change [masterKeyName=ignite.master.key2] [21:11:49] : [Step 4/5] [2021-11-19 21:11:49,796][INFO ][disco-notifier-worker-#22803%grid-0%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:49] : [Step 4/5] [2021-11-19 21:11:49,798][INFO ][disco-notifier-worker-#22922%grid-1%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:49] : [Step 4/5] [2021-11-19 21:11:49,880][INFO ][disco-notifier-worker-#22803%grid-0%][GridEncryptionManager] Master key successfully changed [masterKeyName=ignite.master.key2] [21:11:49] : [Step 4/5] [2021-11-19 21:11:49,895][INFO ][wal-file-archiver%grid-1-#22937%grid-1%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=11, segIdx=1, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000001.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000011.wal] [21:11:49] : [Step 4/5] [2021-11-19 21:11:49,896][INFO ][disco-notifier-worker-#22922%grid-1%][GridEncryptionManager] Master key successfully changed [masterKeyName=ignite.master.key2] [21:11:49] : [Step 4/5] [2021-11-19 21:11:49,896][INFO ][wal-file-cleaner%grid-1-#22938%grid-1%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=2, currSize=10.0 MB, maxSize=20.0 MB] [21:11:49] : [Step 4/5] [2021-11-19 21:11:49,898][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10ca909b-1957-42c9-93b4-147fa476d001, grp=1613773252] [21:11:49] : [Step 4/5] [2021-11-19 21:11:49,898][INFO ][wal-file-cleaner%grid-1-#22938%grid-1%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:11:49] : [Step 4/5] [2021-11-19 21:11:49,906][INFO ][wal-file-archiver%grid-1-#22937%grid-1%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000001.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000011.wal] [21:11:49] : [Step 4/5] [2021-11-19 21:11:49,914][INFO ][db-checkpoint-thread-#22945%grid-1%][Checkpointer] Checkpoint started [checkpointId=c078430a-afbc-4548-9c19-5c591002842d, startPtr=WALPointer [idx=12, fileOff=33112, len=2048], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=6ms, writeCheckpointEntryDuration=9ms, splitAndSortCpPagesDuration=0ms, pages=73, reason='test'] [21:11:49] : [Step 4/5] [2021-11-19 21:11:49,928][INFO ][db-checkpoint-thread-#22945%grid-1%][GridEncryptionManager] Previous encryption keys were removed [grpId=1613773252, keyIds=[4, 5, 6, 7]] [21:11:49] : [Step 4/5] [2021-11-19 21:11:49,928][INFO ][db-checkpoint-thread-#22945%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:11:49] : [Step 4/5] [2021-11-19 21:11:49,929][INFO ][db-checkpoint-thread-#22945%grid-1%][Checkpointer] Checkpoint finished [cpId=c078430a-afbc-4548-9c19-5c591002842d, pages=73, markPos=WALPointer [idx=12, fileOff=33112, len=2048], walSegmentsCovered=[11], markDuration=16ms, pagesWrite=3ms, fsync=11ms, total=31ms] [21:11:49] : [Step 4/5] [2021-11-19 21:11:49,930][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00a4fdec-fb9a-4106-96a3-cca8453c6000, grp=1613773252] [21:11:49] : [Step 4/5] [2021-11-19 21:11:49,937][INFO ][db-checkpoint-thread-#22942%grid-0%][Checkpointer] Checkpoint started [checkpointId=18e46738-cb11-4d9c-b61e-d344de099da8, startPtr=WALPointer [idx=9, fileOff=141461, len=2010], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=4ms, writeCheckpointEntryDuration=2ms, splitAndSortCpPagesDuration=0ms, pages=53, reason='test'] [21:11:49] : [Step 4/5] [2021-11-19 21:11:49,949][INFO ][db-checkpoint-thread-#22942%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:11:49] : [Step 4/5] [2021-11-19 21:11:49,949][INFO ][db-checkpoint-thread-#22942%grid-0%][Checkpointer] Checkpoint finished [cpId=18e46738-cb11-4d9c-b61e-d344de099da8, pages=53, markPos=WALPointer [idx=9, fileOff=141461, len=2010], walSegmentsCovered=[8], markDuration=7ms, pagesWrite=2ms, fsync=9ms, total=19ms] [21:11:49] : [Step 4/5] [2021-11-19 21:11:49,953][INFO ][disco-notifier-worker-#22803%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=38] [21:11:49] : [Step 4/5] [2021-11-19 21:11:49,954][INFO ][disco-notifier-worker-#22922%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=38] [21:11:49] : [Step 4/5] [2021-11-19 21:11:49,954][INFO ][reencrypt-#22963%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:11:49] : [Step 4/5] [2021-11-19 21:11:49,954][INFO ][reencrypt-#22964%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:11:50] : [Step 4/5] [2021-11-19 21:11:50,006][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:50] : [Step 4/5] [2021-11-19 21:11:50,147][INFO ][disco-notifier-worker-#22803%grid-0%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:50] : [Step 4/5] [2021-11-19 21:11:50,149][INFO ][disco-notifier-worker-#22922%grid-1%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:50] : [Step 4/5] [2021-11-19 21:11:50,282][INFO ][disco-notifier-worker-#22803%grid-0%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:50] : [Step 4/5] [2021-11-19 21:11:50,283][INFO ][disco-notifier-worker-#22922%grid-1%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:50] : [Step 4/5] [2021-11-19 21:11:50,366][INFO ][disco-notifier-worker-#22803%grid-0%][GridEncryptionManager] Start master key change [masterKeyName=ignite.master.key3] [21:11:50] : [Step 4/5] [2021-11-19 21:11:50,366][INFO ][disco-notifier-worker-#22922%grid-1%][GridEncryptionManager] Start master key change [masterKeyName=ignite.master.key3] [21:11:50] : [Step 4/5] [2021-11-19 21:11:50,421][INFO ][disco-notifier-worker-#22803%grid-0%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:50] : [Step 4/5] [2021-11-19 21:11:50,424][INFO ][disco-notifier-worker-#22922%grid-1%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:50] : [Step 4/5] [2021-11-19 21:11:50,503][INFO ][disco-notifier-worker-#22803%grid-0%][GridEncryptionManager] Master key successfully changed [masterKeyName=ignite.master.key3] [21:11:50] : [Step 4/5] [2021-11-19 21:11:50,509][INFO ][disco-notifier-worker-#22922%grid-1%][GridEncryptionManager] Master key successfully changed [masterKeyName=ignite.master.key3] [21:11:50] : [Step 4/5] [2021-11-19 21:11:50,511][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10ca909b-1957-42c9-93b4-147fa476d001, grp=1613773252] [21:11:50] : [Step 4/5] [2021-11-19 21:11:50,514][INFO ][db-checkpoint-thread-#22945%grid-1%][Checkpointer] Checkpoint started [checkpointId=2c07a80d-cb31-4bcf-bb8a-03cdee379041, startPtr=WALPointer [idx=12, fileOff=457098, len=2048], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=1ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=1ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=0ms, pages=74, reason='test'] [21:11:50] : [Step 4/5] [2021-11-19 21:11:50,527][INFO ][db-checkpoint-thread-#22945%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:11:50] : [Step 4/5] [2021-11-19 21:11:50,527][INFO ][db-checkpoint-thread-#22945%grid-1%][Checkpointer] Checkpoint finished [cpId=2c07a80d-cb31-4bcf-bb8a-03cdee379041, pages=74, markPos=WALPointer [idx=12, fileOff=457098, len=2048], walSegmentsCovered=[], markDuration=4ms, pagesWrite=3ms, fsync=9ms, total=16ms] [21:11:50] : [Step 4/5] [2021-11-19 21:11:50,528][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00a4fdec-fb9a-4106-96a3-cca8453c6000, grp=1613773252] [21:11:50] : [Step 4/5] [2021-11-19 21:11:50,536][INFO ][db-checkpoint-thread-#22942%grid-0%][Checkpointer] Checkpoint started [checkpointId=901274f4-7124-48e1-8629-4cf0ef1e1d70, startPtr=WALPointer [idx=9, fileOff=463877, len=2010], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=6ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=0ms, pages=52, reason='test'] [21:11:50] : [Step 4/5] [2021-11-19 21:11:50,555][INFO ][db-checkpoint-thread-#22942%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:11:50] : [Step 4/5] [2021-11-19 21:11:50,555][INFO ][db-checkpoint-thread-#22942%grid-0%][Checkpointer] Checkpoint finished [cpId=901274f4-7124-48e1-8629-4cf0ef1e1d70, pages=52, markPos=WALPointer [idx=9, fileOff=463877, len=2010], walSegmentsCovered=[], markDuration=8ms, pagesWrite=2ms, fsync=16ms, total=26ms] [21:11:50] : [Step 4/5] [2021-11-19 21:11:50,617][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:50] : [Step 4/5] [2021-11-19 21:11:50,753][INFO ][disco-notifier-worker-#22922%grid-1%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:50] : [Step 4/5] [2021-11-19 21:11:50,754][INFO ][disco-notifier-worker-#22803%grid-0%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:50] : [Step 4/5] [2021-11-19 21:11:50,889][INFO ][disco-notifier-worker-#22803%grid-0%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:50] : [Step 4/5] [2021-11-19 21:11:50,889][INFO ][disco-notifier-worker-#22922%grid-1%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:50] : [Step 4/5] [2021-11-19 21:11:50,971][INFO ][disco-notifier-worker-#22803%grid-0%][GridEncryptionManager] Start master key change [masterKeyName=ignite.master.key2] [21:11:50] : [Step 4/5] [2021-11-19 21:11:50,971][INFO ][disco-notifier-worker-#22922%grid-1%][GridEncryptionManager] Start master key change [masterKeyName=ignite.master.key2] [21:11:51] : [Step 4/5] [2021-11-19 21:11:51,025][INFO ][disco-notifier-worker-#22922%grid-1%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:51] : [Step 4/5] [2021-11-19 21:11:51,026][INFO ][disco-notifier-worker-#22803%grid-0%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:51] : [Step 4/5] [2021-11-19 21:11:51,128][INFO ][disco-notifier-worker-#22922%grid-1%][GridEncryptionManager] Master key successfully changed [masterKeyName=ignite.master.key2] [21:11:51] : [Step 4/5] [2021-11-19 21:11:51,129][INFO ][disco-notifier-worker-#22803%grid-0%][GridEncryptionManager] Master key successfully changed [masterKeyName=ignite.master.key2] [21:11:51] : [Step 4/5] [2021-11-19 21:11:51,131][INFO ][disco-notifier-worker-#22803%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=39] [21:11:51] : [Step 4/5] [2021-11-19 21:11:51,131][INFO ][disco-notifier-worker-#22922%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=39] [21:11:51] : [Step 4/5] [2021-11-19 21:11:51,131][INFO ][reencrypt-#22963%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:11:51] : [Step 4/5] [2021-11-19 21:11:51,132][INFO ][reencrypt-#22964%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:11:51] : [Step 4/5] [2021-11-19 21:11:51,333][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10ca909b-1957-42c9-93b4-147fa476d001, grp=1613773252] [21:11:51] : [Step 4/5] [2021-11-19 21:11:51,338][INFO ][db-checkpoint-thread-#22945%grid-1%][Checkpointer] Checkpoint started [checkpointId=cc2e1bff-44ca-4485-b7b4-486ac8dde768, startPtr=WALPointer [idx=12, fileOff=850008, len=2048], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=2ms, writeCheckpointEntryDuration=2ms, splitAndSortCpPagesDuration=0ms, pages=72, reason='test'] [21:11:51] : [Step 4/5] [2021-11-19 21:11:51,350][INFO ][db-checkpoint-thread-#22945%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:11:51] : [Step 4/5] [2021-11-19 21:11:51,351][INFO ][db-checkpoint-thread-#22945%grid-1%][Checkpointer] Checkpoint finished [cpId=cc2e1bff-44ca-4485-b7b4-486ac8dde768, pages=72, markPos=WALPointer [idx=12, fileOff=850008, len=2048], walSegmentsCovered=[], markDuration=5ms, pagesWrite=2ms, fsync=10ms, total=17ms] [21:11:51] : [Step 4/5] [2021-11-19 21:11:51,352][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00a4fdec-fb9a-4106-96a3-cca8453c6000, grp=1613773252] [21:11:51] : [Step 4/5] [2021-11-19 21:11:51,361][INFO ][db-checkpoint-thread-#22942%grid-0%][Checkpointer] Checkpoint started [checkpointId=3f9c2227-4a58-40d2-a722-93c99f2f9a9f, startPtr=WALPointer [idx=9, fileOff=792373, len=2010], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=6ms, writeCheckpointEntryDuration=2ms, splitAndSortCpPagesDuration=0ms, pages=54, reason='test'] [21:11:51] : [Step 4/5] [2021-11-19 21:11:51,380][INFO ][db-checkpoint-thread-#22942%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:11:51] : [Step 4/5] [2021-11-19 21:11:51,380][INFO ][db-checkpoint-thread-#22942%grid-0%][Checkpointer] Checkpoint finished [cpId=3f9c2227-4a58-40d2-a722-93c99f2f9a9f, pages=54, markPos=WALPointer [idx=9, fileOff=792373, len=2010], walSegmentsCovered=[], markDuration=9ms, pagesWrite=2ms, fsync=16ms, total=28ms] [21:11:51] : [Step 4/5] [2021-11-19 21:11:51,385][INFO ][disco-notifier-worker-#22803%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=40] [21:11:51] : [Step 4/5] [2021-11-19 21:11:51,385][INFO ][disco-notifier-worker-#22922%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=40] [21:11:51] : [Step 4/5] [2021-11-19 21:11:51,386][INFO ][reencrypt-#22963%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:11:51] : [Step 4/5] [2021-11-19 21:11:51,386][INFO ][reencrypt-#22964%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:11:51] : [Step 4/5] [2021-11-19 21:11:51,390][INFO ][wal-file-archiver%grid-1-#22937%grid-1%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=12, segIdx=2, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000002.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000012.wal] [21:11:51] : [Step 4/5] [2021-11-19 21:11:51,391][INFO ][wal-file-cleaner%grid-1-#22938%grid-1%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=3, currSize=10.0 MB, maxSize=20.0 MB] [21:11:51] : [Step 4/5] [2021-11-19 21:11:51,393][INFO ][wal-file-cleaner%grid-1-#22938%grid-1%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:11:51] : [Step 4/5] [2021-11-19 21:11:51,393][INFO ][wal-file-archiver%grid-0-#22934%grid-0%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=9, segIdx=9, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000009.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000009.wal] [21:11:51] : [Step 4/5] [2021-11-19 21:11:51,418][INFO ][wal-file-archiver%grid-1-#22937%grid-1%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000002.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000012.wal] [21:11:51] : [Step 4/5] [2021-11-19 21:11:51,418][INFO ][wal-file-archiver%grid-0-#22934%grid-0%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000009.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000009.wal] [21:11:51] : [Step 4/5] [2021-11-19 21:11:51,438][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:51] : [Step 4/5] [2021-11-19 21:11:51,574][INFO ][disco-notifier-worker-#22803%grid-0%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:51] : [Step 4/5] [2021-11-19 21:11:51,574][INFO ][disco-notifier-worker-#22922%grid-1%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:51] : [Step 4/5] [2021-11-19 21:11:51,709][INFO ][disco-notifier-worker-#22803%grid-0%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:51] : [Step 4/5] [2021-11-19 21:11:51,709][INFO ][disco-notifier-worker-#22922%grid-1%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:51] : [Step 4/5] [2021-11-19 21:11:51,791][INFO ][disco-notifier-worker-#22803%grid-0%][GridEncryptionManager] Start master key change [masterKeyName=ignite.master.key3] [21:11:51] : [Step 4/5] [2021-11-19 21:11:51,791][INFO ][disco-notifier-worker-#22922%grid-1%][GridEncryptionManager] Start master key change [masterKeyName=ignite.master.key3] [21:11:51] : [Step 4/5] [2021-11-19 21:11:51,845][INFO ][disco-notifier-worker-#22803%grid-0%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:51] : [Step 4/5] [2021-11-19 21:11:51,846][INFO ][disco-notifier-worker-#22922%grid-1%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:51] : [Step 4/5] [2021-11-19 21:11:51,929][INFO ][disco-notifier-worker-#22803%grid-0%][GridEncryptionManager] Master key successfully changed [masterKeyName=ignite.master.key3] [21:11:51] : [Step 4/5] [2021-11-19 21:11:51,947][INFO ][disco-notifier-worker-#22922%grid-1%][GridEncryptionManager] Master key successfully changed [masterKeyName=ignite.master.key3] [21:11:51] : [Step 4/5] [2021-11-19 21:11:51,949][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10ca909b-1957-42c9-93b4-147fa476d001, grp=1613773252] [21:11:51] : [Step 4/5] [2021-11-19 21:11:51,953][INFO ][db-checkpoint-thread-#22945%grid-1%][Checkpointer] Checkpoint started [checkpointId=43f7ac38-7175-4f48-8756-1217767126e6, startPtr=WALPointer [idx=13, fileOff=204119, len=2048], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=2ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=0ms, pages=73, reason='test'] [21:11:51] : [Step 4/5] [2021-11-19 21:11:51,966][INFO ][db-checkpoint-thread-#22945%grid-1%][GridEncryptionManager] Previous encryption keys were removed [grpId=1613773252, keyIds=[8, 9, 10]] [21:11:51] : [Step 4/5] [2021-11-19 21:11:51,967][INFO ][db-checkpoint-thread-#22945%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:11:51] : [Step 4/5] [2021-11-19 21:11:51,967][INFO ][db-checkpoint-thread-#22945%grid-1%][Checkpointer] Checkpoint finished [cpId=43f7ac38-7175-4f48-8756-1217767126e6, pages=73, markPos=WALPointer [idx=13, fileOff=204119, len=2048], walSegmentsCovered=[12], markDuration=4ms, pagesWrite=2ms, fsync=11ms, total=18ms] [21:11:51] : [Step 4/5] [2021-11-19 21:11:51,968][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00a4fdec-fb9a-4106-96a3-cca8453c6000, grp=1613773252] [21:11:51] : [Step 4/5] [2021-11-19 21:11:51,975][INFO ][db-checkpoint-thread-#22942%grid-0%][Checkpointer] Checkpoint started [checkpointId=19784adb-31f7-4b81-98bf-b18653ba91fa, startPtr=WALPointer [idx=10, fileOff=82745, len=2010], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=4ms, writeCheckpointEntryDuration=2ms, splitAndSortCpPagesDuration=0ms, pages=53, reason='test'] [21:11:51] : [Step 4/5] [2021-11-19 21:11:51,995][INFO ][db-checkpoint-thread-#22942%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:11:51] : [Step 4/5] [2021-11-19 21:11:51,995][INFO ][db-checkpoint-thread-#22942%grid-0%][Checkpointer] Checkpoint finished [cpId=19784adb-31f7-4b81-98bf-b18653ba91fa, pages=53, markPos=WALPointer [idx=10, fileOff=82745, len=2010], walSegmentsCovered=[9], markDuration=7ms, pagesWrite=2ms, fsync=17ms, total=27ms] [21:11:52] : [Step 4/5] [2021-11-19 21:11:52,000][INFO ][disco-notifier-worker-#22922%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=41] [21:11:52] : [Step 4/5] [2021-11-19 21:11:52,000][INFO ][disco-notifier-worker-#22803%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=41] [21:11:52] : [Step 4/5] [2021-11-19 21:11:52,000][INFO ][reencrypt-#22964%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:11:52] : [Step 4/5] [2021-11-19 21:11:52,000][INFO ][reencrypt-#22963%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:11:52] : [Step 4/5] [2021-11-19 21:11:52,050][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:52] : [Step 4/5] [2021-11-19 21:11:52,187][INFO ][disco-notifier-worker-#22922%grid-1%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:52] : [Step 4/5] [2021-11-19 21:11:52,197][INFO ][disco-notifier-worker-#22803%grid-0%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:52] : [Step 4/5] [2021-11-19 21:11:52,321][INFO ][disco-notifier-worker-#22922%grid-1%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:52] : [Step 4/5] [2021-11-19 21:11:52,330][INFO ][disco-notifier-worker-#22803%grid-0%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:52] : [Step 4/5] [2021-11-19 21:11:52,414][INFO ][disco-notifier-worker-#22803%grid-0%][GridEncryptionManager] Start master key change [masterKeyName=ignite.master.key2] [21:11:52] : [Step 4/5] [2021-11-19 21:11:52,414][INFO ][disco-notifier-worker-#22922%grid-1%][GridEncryptionManager] Start master key change [masterKeyName=ignite.master.key2] [21:11:52] : [Step 4/5] [2021-11-19 21:11:52,467][INFO ][disco-notifier-worker-#22803%grid-0%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:52] : [Step 4/5] [2021-11-19 21:11:52,469][INFO ][disco-notifier-worker-#22922%grid-1%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:52] : [Step 4/5] [2021-11-19 21:11:52,551][INFO ][disco-notifier-worker-#22922%grid-1%][GridEncryptionManager] Master key successfully changed [masterKeyName=ignite.master.key2] [21:11:52] : [Step 4/5] [2021-11-19 21:11:52,552][INFO ][disco-notifier-worker-#22803%grid-0%][GridEncryptionManager] Master key successfully changed [masterKeyName=ignite.master.key2] [21:11:52] : [Step 4/5] [2021-11-19 21:11:52,554][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10ca909b-1957-42c9-93b4-147fa476d001, grp=1613773252] [21:11:52] : [Step 4/5] [2021-11-19 21:11:52,860][INFO ][db-checkpoint-thread-#22945%grid-1%][Checkpointer] Checkpoint started [checkpointId=373334c7-a127-4aa1-96ee-bb6140fb5aac, startPtr=WALPointer [idx=13, fileOff=624114, len=2048], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=132ms, writeCheckpointEntryDuration=173ms, splitAndSortCpPagesDuration=0ms, pages=73, reason='test'] [21:11:52] : [Step 4/5] [2021-11-19 21:11:52,874][INFO ][db-checkpoint-thread-#22945%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:11:52] : [Step 4/5] [2021-11-19 21:11:52,875][INFO ][db-checkpoint-thread-#22945%grid-1%][Checkpointer] Checkpoint finished [cpId=373334c7-a127-4aa1-96ee-bb6140fb5aac, pages=73, markPos=WALPointer [idx=13, fileOff=624114, len=2048], walSegmentsCovered=[], markDuration=305ms, pagesWrite=3ms, fsync=11ms, total=320ms] [21:11:52] : [Step 4/5] [2021-11-19 21:11:52,875][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00a4fdec-fb9a-4106-96a3-cca8453c6000, grp=1613773252] [21:11:52] : [Step 4/5] [2021-11-19 21:11:52,883][INFO ][db-checkpoint-thread-#22942%grid-0%][Checkpointer] Checkpoint started [checkpointId=b61c86ff-7360-4bf2-a10e-9e29fbc2098c, startPtr=WALPointer [idx=10, fileOff=432494, len=2010], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=5ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=0ms, pages=57, reason='test'] [21:11:52] : [Step 4/5] [2021-11-19 21:11:52,902][INFO ][db-checkpoint-thread-#22942%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:11:52] : [Step 4/5] [2021-11-19 21:11:52,903][INFO ][db-checkpoint-thread-#22942%grid-0%][Checkpointer] Checkpoint finished [cpId=b61c86ff-7360-4bf2-a10e-9e29fbc2098c, pages=57, markPos=WALPointer [idx=10, fileOff=432494, len=2010], walSegmentsCovered=[], markDuration=8ms, pagesWrite=2ms, fsync=17ms, total=27ms] [21:11:52] : [Step 4/5] [2021-11-19 21:11:52,907][INFO ][disco-notifier-worker-#22922%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=42] [21:11:52] : [Step 4/5] [2021-11-19 21:11:52,907][INFO ][disco-notifier-worker-#22803%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=42] [21:11:52] : [Step 4/5] [2021-11-19 21:11:52,908][INFO ][reencrypt-#22964%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:11:52] : [Step 4/5] [2021-11-19 21:11:52,908][INFO ][reencrypt-#22963%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:11:52] : [Step 4/5] [2021-11-19 21:11:52,964][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:53] : [Step 4/5] [2021-11-19 21:11:53,105][INFO ][disco-notifier-worker-#22803%grid-0%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:53] : [Step 4/5] [2021-11-19 21:11:53,106][INFO ][disco-notifier-worker-#22922%grid-1%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:53] : [Step 4/5] [2021-11-19 21:11:53,240][INFO ][disco-notifier-worker-#22922%grid-1%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:53] : [Step 4/5] [2021-11-19 21:11:53,247][INFO ][disco-notifier-worker-#22803%grid-0%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:53] : [Step 4/5] [2021-11-19 21:11:53,330][INFO ][disco-notifier-worker-#22803%grid-0%][GridEncryptionManager] Start master key change [masterKeyName=ignite.master.key3] [21:11:53] : [Step 4/5] [2021-11-19 21:11:53,331][INFO ][disco-notifier-worker-#22922%grid-1%][GridEncryptionManager] Start master key change [masterKeyName=ignite.master.key3] [21:11:53] : [Step 4/5] [2021-11-19 21:11:53,388][INFO ][disco-notifier-worker-#22922%grid-1%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:53] : [Step 4/5] [2021-11-19 21:11:53,388][INFO ][disco-notifier-worker-#22803%grid-0%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:53] : [Step 4/5] [2021-11-19 21:11:53,483][INFO ][disco-notifier-worker-#22922%grid-1%][GridEncryptionManager] Master key successfully changed [masterKeyName=ignite.master.key3] [21:11:53] : [Step 4/5] [2021-11-19 21:11:53,494][INFO ][disco-notifier-worker-#22803%grid-0%][GridEncryptionManager] Master key successfully changed [masterKeyName=ignite.master.key3] [21:11:53] : [Step 4/5] [2021-11-19 21:11:53,496][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10ca909b-1957-42c9-93b4-147fa476d001, grp=1613773252] [21:11:53] : [Step 4/5] [2021-11-19 21:11:53,499][INFO ][db-checkpoint-thread-#22945%grid-1%][Checkpointer] Checkpoint started [checkpointId=5f593f82-3155-4697-ad8f-c932042cdf9a, startPtr=WALPointer [idx=13, fileOff=1017222, len=2048], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=1ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=0ms, writeCheckpointEntryDuration=2ms, splitAndSortCpPagesDuration=0ms, pages=72, reason='test'] [21:11:53] : [Step 4/5] [2021-11-19 21:11:53,512][INFO ][db-checkpoint-thread-#22945%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:11:53] : [Step 4/5] [2021-11-19 21:11:53,512][INFO ][db-checkpoint-thread-#22945%grid-1%][Checkpointer] Checkpoint finished [cpId=5f593f82-3155-4697-ad8f-c932042cdf9a, pages=72, markPos=WALPointer [idx=13, fileOff=1017222, len=2048], walSegmentsCovered=[], markDuration=4ms, pagesWrite=3ms, fsync=9ms, total=16ms] [21:11:53] : [Step 4/5] [2021-11-19 21:11:53,713][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00a4fdec-fb9a-4106-96a3-cca8453c6000, grp=1613773252] [21:11:53] : [Step 4/5] [2021-11-19 21:11:53,988][INFO ][db-checkpoint-thread-#22942%grid-0%][Checkpointer] Checkpoint started [checkpointId=75f6a712-f99d-4b6f-89d8-67854b40d4f9, startPtr=WALPointer [idx=10, fileOff=781903, len=2010], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=1ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=138ms, writeCheckpointEntryDuration=135ms, splitAndSortCpPagesDuration=0ms, pages=54, reason='test'] [21:11:54] : [Step 4/5] [2021-11-19 21:11:53,999][INFO ][db-checkpoint-thread-#22942%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:11:54] : [Step 4/5] [2021-11-19 21:11:53,999][INFO ][db-checkpoint-thread-#22942%grid-0%][Checkpointer] Checkpoint finished [cpId=75f6a712-f99d-4b6f-89d8-67854b40d4f9, pages=54, markPos=WALPointer [idx=10, fileOff=781903, len=2010], walSegmentsCovered=[], markDuration=275ms, pagesWrite=2ms, fsync=8ms, total=285ms] [21:11:54] : [Step 4/5] [2021-11-19 21:11:54,007][INFO ][wal-file-archiver%grid-1-#22937%grid-1%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=13, segIdx=3, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000003.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000013.wal] [21:11:54] : [Step 4/5] [2021-11-19 21:11:54,008][INFO ][wal-file-cleaner%grid-1-#22938%grid-1%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=4, currSize=10.0 MB, maxSize=20.0 MB] [21:11:54] : [Step 4/5] [2021-11-19 21:11:54,010][INFO ][wal-file-cleaner%grid-1-#22938%grid-1%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:11:54] : [Step 4/5] [2021-11-19 21:11:54,012][INFO ][sys-#22920%grid-1%][GridEncryptionManager] Previous encryption keys have been removed [grpId=1613773252, keyIds=[11, 12, 13]] [21:11:54] : [Step 4/5] [2021-11-19 21:11:54,013][INFO ][disco-notifier-worker-#22803%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=43] [21:11:54] : [Step 4/5] [2021-11-19 21:11:54,013][INFO ][reencrypt-#22963%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:11:54] : [Step 4/5] [2021-11-19 21:11:54,013][INFO ][disco-notifier-worker-#22922%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=43] [21:11:54] : [Step 4/5] [2021-11-19 21:11:54,014][INFO ][reencrypt-#22964%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:11:54] : [Step 4/5] [2021-11-19 21:11:54,019][INFO ][wal-file-archiver%grid-1-#22937%grid-1%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000003.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000013.wal] [21:11:54] : [Step 4/5] [2021-11-19 21:11:54,027][INFO ][wal-file-archiver%grid-0-#22934%grid-0%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=10, segIdx=0, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000000.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000010.wal] [21:11:54] : [Step 4/5] [2021-11-19 21:11:54,028][INFO ][wal-file-cleaner%grid-0-#22935%grid-0%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=1, currSize=10.0 MB, maxSize=20.0 MB] [21:11:54] : [Step 4/5] [2021-11-19 21:11:54,031][INFO ][wal-file-cleaner%grid-0-#22935%grid-0%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:11:54] : [Step 4/5] [2021-11-19 21:11:54,038][INFO ][wal-file-archiver%grid-0-#22934%grid-0%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000000.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000010.wal] [21:11:54] : [Step 4/5] [2021-11-19 21:11:54,066][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:54] : [Step 4/5] [2021-11-19 21:11:54,226][INFO ][disco-notifier-worker-#22922%grid-1%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:54] : [Step 4/5] [2021-11-19 21:11:54,233][INFO ][disco-notifier-worker-#22803%grid-0%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:54] : [Step 4/5] [2021-11-19 21:11:54,391][INFO ][disco-notifier-worker-#22922%grid-1%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:54] : [Step 4/5] [2021-11-19 21:11:54,397][INFO ][disco-notifier-worker-#22803%grid-0%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:54] : [Step 4/5] [2021-11-19 21:11:54,492][INFO ][disco-notifier-worker-#22803%grid-0%][GridEncryptionManager] Start master key change [masterKeyName=ignite.master.key2] [21:11:54] : [Step 4/5] [2021-11-19 21:11:54,492][INFO ][disco-notifier-worker-#22922%grid-1%][GridEncryptionManager] Start master key change [masterKeyName=ignite.master.key2] [21:11:54] : [Step 4/5] [2021-11-19 21:11:54,554][INFO ][disco-notifier-worker-#22922%grid-1%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:54] : [Step 4/5] [2021-11-19 21:11:54,554][INFO ][disco-notifier-worker-#22803%grid-0%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:54] : [Step 4/5] [2021-11-19 21:11:54,635][INFO ][disco-notifier-worker-#22922%grid-1%][GridEncryptionManager] Master key successfully changed [masterKeyName=ignite.master.key2] [21:11:54] : [Step 4/5] [2021-11-19 21:11:54,638][INFO ][disco-notifier-worker-#22803%grid-0%][GridEncryptionManager] Master key successfully changed [masterKeyName=ignite.master.key2] [21:11:54] : [Step 4/5] [2021-11-19 21:11:54,640][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10ca909b-1957-42c9-93b4-147fa476d001, grp=1613773252] [21:11:54] : [Step 4/5] [2021-11-19 21:11:54,643][INFO ][db-checkpoint-thread-#22945%grid-1%][Checkpointer] Checkpoint started [checkpointId=6c71f3df-451a-4949-90cd-a184b922bc69, startPtr=WALPointer [idx=14, fileOff=393203, len=2048], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=1ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=0ms, pages=74, reason='test'] [21:11:54] : [Step 4/5] [2021-11-19 21:11:54,656][INFO ][db-checkpoint-thread-#22945%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:11:54] : [Step 4/5] [2021-11-19 21:11:54,656][INFO ][db-checkpoint-thread-#22945%grid-1%][Checkpointer] Checkpoint finished [cpId=6c71f3df-451a-4949-90cd-a184b922bc69, pages=74, markPos=WALPointer [idx=14, fileOff=393203, len=2048], walSegmentsCovered=[13], markDuration=3ms, pagesWrite=3ms, fsync=9ms, total=16ms] [21:11:54] : [Step 4/5] [2021-11-19 21:11:54,657][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00a4fdec-fb9a-4106-96a3-cca8453c6000, grp=1613773252] [21:11:54] : [Step 4/5] [2021-11-19 21:11:54,674][INFO ][db-checkpoint-thread-#22942%grid-0%][Checkpointer] Checkpoint started [checkpointId=4136fa53-8ee6-46c0-9822-6c2e7bb8771e, startPtr=WALPointer [idx=11, fileOff=88614, len=2010], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=7ms, writeCheckpointEntryDuration=9ms, splitAndSortCpPagesDuration=0ms, pages=54, reason='test'] [21:11:54] : [Step 4/5] [2021-11-19 21:11:54,697][INFO ][db-checkpoint-thread-#22942%grid-0%][GridEncryptionManager] Previous encryption keys were removed [grpId=1613773252, keyIds=[0, 1, 2, 3, 4, 5]] [21:11:54] : [Step 4/5] [2021-11-19 21:11:54,697][INFO ][db-checkpoint-thread-#22942%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:11:54] : [Step 4/5] [2021-11-19 21:11:54,697][INFO ][db-checkpoint-thread-#22942%grid-0%][Checkpointer] Checkpoint finished [cpId=4136fa53-8ee6-46c0-9822-6c2e7bb8771e, pages=54, markPos=WALPointer [idx=11, fileOff=88614, len=2010], walSegmentsCovered=[10], markDuration=17ms, pagesWrite=2ms, fsync=20ms, total=39ms] [21:11:54] : [Step 4/5] [2021-11-19 21:11:54,703][INFO ][disco-notifier-worker-#22803%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=44] [21:11:54] : [Step 4/5] [2021-11-19 21:11:54,703][INFO ][reencrypt-#22963%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:11:54] : [Step 4/5] [2021-11-19 21:11:54,704][INFO ][disco-notifier-worker-#22922%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=44] [21:11:54] : [Step 4/5] [2021-11-19 21:11:54,704][INFO ][reencrypt-#22964%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:11:54] : [Step 4/5] [2021-11-19 21:11:54,755][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:54] : [Step 4/5] [2021-11-19 21:11:54,895][INFO ][disco-notifier-worker-#22922%grid-1%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:54] : [Step 4/5] [2021-11-19 21:11:54,895][INFO ][disco-notifier-worker-#22803%grid-0%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:55] : [Step 4/5] [2021-11-19 21:11:55,029][INFO ][disco-notifier-worker-#22922%grid-1%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:55] : [Step 4/5] [2021-11-19 21:11:55,030][INFO ][disco-notifier-worker-#22803%grid-0%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:55] : [Step 4/5] [2021-11-19 21:11:55,113][INFO ][disco-notifier-worker-#22803%grid-0%][GridEncryptionManager] Start master key change [masterKeyName=ignite.master.key3] [21:11:55] : [Step 4/5] [2021-11-19 21:11:55,113][INFO ][disco-notifier-worker-#22922%grid-1%][GridEncryptionManager] Start master key change [masterKeyName=ignite.master.key3] [21:11:55] : [Step 4/5] [2021-11-19 21:11:55,167][INFO ][disco-notifier-worker-#22803%grid-0%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:55] : [Step 4/5] [2021-11-19 21:11:55,168][INFO ][disco-notifier-worker-#22922%grid-1%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:55] : [Step 4/5] [2021-11-19 21:11:55,249][INFO ][disco-notifier-worker-#22922%grid-1%][GridEncryptionManager] Master key successfully changed [masterKeyName=ignite.master.key3] [21:11:55] : [Step 4/5] [2021-11-19 21:11:55,249][INFO ][disco-notifier-worker-#22803%grid-0%][GridEncryptionManager] Master key successfully changed [masterKeyName=ignite.master.key3] [21:11:55] : [Step 4/5] [2021-11-19 21:11:55,251][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10ca909b-1957-42c9-93b4-147fa476d001, grp=1613773252] [21:11:55] : [Step 4/5] [2021-11-19 21:11:55,691][INFO ][db-checkpoint-thread-#22945%grid-1%][Checkpointer] Checkpoint started [checkpointId=f7dbf160-1741-446f-9e4f-49a3661fe2d9, startPtr=WALPointer [idx=14, fileOff=791418, len=2048], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=99ms, writeCheckpointEntryDuration=340ms, splitAndSortCpPagesDuration=0ms, pages=75, reason='test'] [21:11:55] : [Step 4/5] [2021-11-19 21:11:55,711][INFO ][db-checkpoint-thread-#22945%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:11:55] : [Step 4/5] [2021-11-19 21:11:55,711][INFO ][db-checkpoint-thread-#22945%grid-1%][Checkpointer] Checkpoint finished [cpId=f7dbf160-1741-446f-9e4f-49a3661fe2d9, pages=75, markPos=WALPointer [idx=14, fileOff=791418, len=2048], walSegmentsCovered=[], markDuration=440ms, pagesWrite=4ms, fsync=15ms, total=460ms] [21:11:55] : [Step 4/5] [2021-11-19 21:11:55,712][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00a4fdec-fb9a-4106-96a3-cca8453c6000, grp=1613773252] [21:11:55] : [Step 4/5] [2021-11-19 21:11:55,720][INFO ][db-checkpoint-thread-#22942%grid-0%][Checkpointer] Checkpoint started [checkpointId=9ae69440-9c70-4716-b326-2d541f89b35a, startPtr=WALPointer [idx=11, fileOff=454445, len=2010], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=5ms, writeCheckpointEntryDuration=2ms, splitAndSortCpPagesDuration=0ms, pages=54, reason='test'] [21:11:55] : [Step 4/5] [2021-11-19 21:11:55,739][INFO ][db-checkpoint-thread-#22942%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:11:55] : [Step 4/5] [2021-11-19 21:11:55,739][INFO ][db-checkpoint-thread-#22942%grid-0%][Checkpointer] Checkpoint finished [cpId=9ae69440-9c70-4716-b326-2d541f89b35a, pages=54, markPos=WALPointer [idx=11, fileOff=454445, len=2010], walSegmentsCovered=[], markDuration=8ms, pagesWrite=2ms, fsync=16ms, total=27ms] [21:11:55] : [Step 4/5] [2021-11-19 21:11:55,796][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:55] : [Step 4/5] [2021-11-19 21:11:55,934][INFO ][disco-notifier-worker-#22803%grid-0%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:55] : [Step 4/5] [2021-11-19 21:11:55,936][INFO ][disco-notifier-worker-#22922%grid-1%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:56] : [Step 4/5] [2021-11-19 21:11:56,067][INFO ][disco-notifier-worker-#22803%grid-0%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:56] : [Step 4/5] [2021-11-19 21:11:56,073][INFO ][disco-notifier-worker-#22922%grid-1%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:56] : [Step 4/5] [2021-11-19 21:11:56,156][INFO ][disco-notifier-worker-#22803%grid-0%][GridEncryptionManager] Start master key change [masterKeyName=ignite.master.key2] [21:11:56] : [Step 4/5] [2021-11-19 21:11:56,156][INFO ][disco-notifier-worker-#22922%grid-1%][GridEncryptionManager] Start master key change [masterKeyName=ignite.master.key2] [21:11:56] : [Step 4/5] [2021-11-19 21:11:56,210][INFO ][disco-notifier-worker-#22803%grid-0%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:56] : [Step 4/5] [2021-11-19 21:11:56,211][INFO ][disco-notifier-worker-#22922%grid-1%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:56] : [Step 4/5] [2021-11-19 21:11:56,292][INFO ][disco-notifier-worker-#22803%grid-0%][GridEncryptionManager] Master key successfully changed [masterKeyName=ignite.master.key2] [21:11:56] : [Step 4/5] [2021-11-19 21:11:56,294][INFO ][disco-notifier-worker-#22803%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=45] [21:11:56] : [Step 4/5] [2021-11-19 21:11:56,294][INFO ][reencrypt-#22963%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:11:56] : [Step 4/5] [2021-11-19 21:11:56,295][INFO ][disco-notifier-worker-#22922%grid-1%][GridEncryptionManager] Master key successfully changed [masterKeyName=ignite.master.key2] [21:11:56] : [Step 4/5] [2021-11-19 21:11:56,296][INFO ][disco-notifier-worker-#22922%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=45] [21:11:56] : [Step 4/5] [2021-11-19 21:11:56,296][INFO ][reencrypt-#22964%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:11:56] : [Step 4/5] [2021-11-19 21:11:56,323][INFO ][wal-file-archiver%grid-1-#22937%grid-1%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=14, segIdx=4, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000004.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000014.wal] [21:11:56] : [Step 4/5] [2021-11-19 21:11:56,343][INFO ][wal-file-cleaner%grid-1-#22938%grid-1%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=5, currSize=10.0 MB, maxSize=20.0 MB] [21:11:56] : [Step 4/5] [2021-11-19 21:11:56,344][INFO ][wal-file-cleaner%grid-1-#22938%grid-1%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:11:56] : [Step 4/5] [2021-11-19 21:11:56,497][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10ca909b-1957-42c9-93b4-147fa476d001, grp=1613773252] [21:11:56] : [Step 4/5] [2021-11-19 21:11:56,499][INFO ][wal-file-archiver%grid-1-#22937%grid-1%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000004.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000014.wal] [21:11:56] : [Step 4/5] [2021-11-19 21:11:56,508][INFO ][db-checkpoint-thread-#22945%grid-1%][Checkpointer] Checkpoint started [checkpointId=f443bc45-c64b-4cbc-84e5-99e5e74efb86, startPtr=WALPointer [idx=15, fileOff=139458, len=2048], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=1ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=8ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=0ms, pages=72, reason='test'] [21:11:56] : [Step 4/5] [2021-11-19 21:11:56,520][INFO ][db-checkpoint-thread-#22945%grid-1%][GridEncryptionManager] Previous encryption keys were removed [grpId=1613773252, keyIds=[14, 15, 16, 17]] [21:11:56] : [Step 4/5] [2021-11-19 21:11:56,520][INFO ][db-checkpoint-thread-#22945%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:11:56] : [Step 4/5] [2021-11-19 21:11:56,521][INFO ][db-checkpoint-thread-#22945%grid-1%][Checkpointer] Checkpoint finished [cpId=f443bc45-c64b-4cbc-84e5-99e5e74efb86, pages=72, markPos=WALPointer [idx=15, fileOff=139458, len=2048], walSegmentsCovered=[14], markDuration=11ms, pagesWrite=3ms, fsync=9ms, total=23ms] [21:11:56] : [Step 4/5] [2021-11-19 21:11:56,522][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00a4fdec-fb9a-4106-96a3-cca8453c6000, grp=1613773252] [21:11:56] : [Step 4/5] [2021-11-19 21:11:56,529][INFO ][db-checkpoint-thread-#22942%grid-0%][Checkpointer] Checkpoint started [checkpointId=45c0fd63-a8cd-44eb-87ce-ce254e7f3c90, startPtr=WALPointer [idx=11, fileOff=795254, len=2010], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=5ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=0ms, pages=55, reason='test'] [21:11:56] : [Step 4/5] [2021-11-19 21:11:56,540][INFO ][db-checkpoint-thread-#22942%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:11:56] : [Step 4/5] [2021-11-19 21:11:56,540][INFO ][db-checkpoint-thread-#22942%grid-0%][Checkpointer] Checkpoint finished [cpId=45c0fd63-a8cd-44eb-87ce-ce254e7f3c90, pages=55, markPos=WALPointer [idx=11, fileOff=795254, len=2010], walSegmentsCovered=[], markDuration=7ms, pagesWrite=2ms, fsync=8ms, total=18ms] [21:11:56] : [Step 4/5] [2021-11-19 21:11:56,596][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:56] : [Step 4/5] [2021-11-19 21:11:56,731][INFO ][disco-notifier-worker-#22922%grid-1%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:56] : [Step 4/5] [2021-11-19 21:11:56,731][INFO ][disco-notifier-worker-#22803%grid-0%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:56] : [Step 4/5] [2021-11-19 21:11:56,865][INFO ][disco-notifier-worker-#22922%grid-1%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:56] : [Step 4/5] [2021-11-19 21:11:56,866][INFO ][disco-notifier-worker-#22803%grid-0%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:56] : [Step 4/5] [2021-11-19 21:11:56,948][INFO ][disco-notifier-worker-#22803%grid-0%][GridEncryptionManager] Start master key change [masterKeyName=ignite.master.key3] [21:11:56] : [Step 4/5] [2021-11-19 21:11:56,949][INFO ][disco-notifier-worker-#22922%grid-1%][GridEncryptionManager] Start master key change [masterKeyName=ignite.master.key3] [21:11:57] : [Step 4/5] [2021-11-19 21:11:57,002][INFO ][disco-notifier-worker-#22803%grid-0%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:57] : [Step 4/5] [2021-11-19 21:11:57,003][INFO ][disco-notifier-worker-#22922%grid-1%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:57] : [Step 4/5] [2021-11-19 21:11:57,086][INFO ][disco-notifier-worker-#22922%grid-1%][GridEncryptionManager] Master key successfully changed [masterKeyName=ignite.master.key3] [21:11:57] : [Step 4/5] [2021-11-19 21:11:57,087][INFO ][disco-notifier-worker-#22922%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=46] [21:11:57] : [Step 4/5] [2021-11-19 21:11:57,087][INFO ][reencrypt-#22964%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:11:57] : [Step 4/5] [2021-11-19 21:11:57,101][INFO ][disco-notifier-worker-#22803%grid-0%][GridEncryptionManager] Master key successfully changed [masterKeyName=ignite.master.key3] [21:11:57] : [Step 4/5] [2021-11-19 21:11:57,102][INFO ][disco-notifier-worker-#22803%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=46] [21:11:57] : [Step 4/5] [2021-11-19 21:11:57,103][INFO ][reencrypt-#22963%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:11:57] : [Step 4/5] [2021-11-19 21:11:57,379][INFO ][wal-file-archiver%grid-0-#22934%grid-0%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=11, segIdx=1, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000001.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000011.wal] [21:11:57] : [Step 4/5] [2021-11-19 21:11:57,379][INFO ][wal-file-cleaner%grid-0-#22935%grid-0%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=2, currSize=10.0 MB, maxSize=20.0 MB] [21:11:57] : [Step 4/5] [2021-11-19 21:11:57,381][INFO ][wal-file-cleaner%grid-0-#22935%grid-0%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:11:57] : [Step 4/5] [2021-11-19 21:11:57,394][INFO ][wal-file-archiver%grid-0-#22934%grid-0%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000001.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000011.wal] [21:11:57] : [Step 4/5] [2021-11-19 21:11:57,504][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10ca909b-1957-42c9-93b4-147fa476d001, grp=1613773252] [21:11:57] : [Step 4/5] [2021-11-19 21:11:57,713][INFO ][db-checkpoint-thread-#22945%grid-1%][Checkpointer] Checkpoint started [checkpointId=1bac3af6-8a7b-422e-a4ff-6b2a648f5848, startPtr=WALPointer [idx=15, fileOff=544924, len=2048], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=1ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=53ms, writeCheckpointEntryDuration=155ms, splitAndSortCpPagesDuration=0ms, pages=72, reason='test'] [21:11:58] : [Step 4/5] [2021-11-19 21:11:58,208][INFO ][db-checkpoint-thread-#22945%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:11:58] : [Step 4/5] [2021-11-19 21:11:58,208][INFO ][db-checkpoint-thread-#22945%grid-1%][Checkpointer] Checkpoint finished [cpId=1bac3af6-8a7b-422e-a4ff-6b2a648f5848, pages=72, markPos=WALPointer [idx=15, fileOff=544924, len=2048], walSegmentsCovered=[], markDuration=210ms, pagesWrite=3ms, fsync=491ms, total=704ms] [21:11:58] : [Step 4/5] [2021-11-19 21:11:58,210][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00a4fdec-fb9a-4106-96a3-cca8453c6000, grp=1613773252] [21:11:58] : [Step 4/5] [2021-11-19 21:11:58,226][INFO ][db-checkpoint-thread-#22942%grid-0%][Checkpointer] Checkpoint started [checkpointId=1ca5f04f-7d9b-47b2-a772-97a9eec7c743, startPtr=WALPointer [idx=12, fileOff=90028, len=2010], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=5ms, writeCheckpointEntryDuration=9ms, splitAndSortCpPagesDuration=1ms, pages=54, reason='test'] [21:11:58] : [Step 4/5] [2021-11-19 21:11:58,247][INFO ][db-checkpoint-thread-#22942%grid-0%][GridEncryptionManager] Previous encryption keys were removed [grpId=1613773252, keyIds=[6, 7, 8, 9]] [21:11:58] : [Step 4/5] [2021-11-19 21:11:58,247][INFO ][db-checkpoint-thread-#22942%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:11:58] : [Step 4/5] [2021-11-19 21:11:58,247][INFO ][db-checkpoint-thread-#22942%grid-0%][Checkpointer] Checkpoint finished [cpId=1ca5f04f-7d9b-47b2-a772-97a9eec7c743, pages=54, markPos=WALPointer [idx=12, fileOff=90028, len=2010], walSegmentsCovered=[11], markDuration=15ms, pagesWrite=3ms, fsync=18ms, total=37ms] [21:11:58] : [Step 4/5] [2021-11-19 21:11:58,320][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:58] : [Step 4/5] [2021-11-19 21:11:58,480][INFO ][disco-notifier-worker-#22803%grid-0%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:58] : [Step 4/5] [2021-11-19 21:11:58,482][INFO ][disco-notifier-worker-#22922%grid-1%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:58] : [Step 4/5] [2021-11-19 21:11:58,636][INFO ][disco-notifier-worker-#22922%grid-1%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:58] : [Step 4/5] [2021-11-19 21:11:58,637][INFO ][disco-notifier-worker-#22803%grid-0%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:58] : [Step 4/5] [2021-11-19 21:11:58,741][INFO ][disco-notifier-worker-#22922%grid-1%][GridEncryptionManager] Start master key change [masterKeyName=ignite.master.key2] [21:11:58] : [Step 4/5] [2021-11-19 21:11:58,741][INFO ][disco-notifier-worker-#22803%grid-0%][GridEncryptionManager] Start master key change [masterKeyName=ignite.master.key2] [21:11:58] : [Step 4/5] [2021-11-19 21:11:58,809][INFO ][disco-notifier-worker-#22803%grid-0%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:58] : [Step 4/5] [2021-11-19 21:11:58,810][INFO ][disco-notifier-worker-#22922%grid-1%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:58] : [Step 4/5] [2021-11-19 21:11:58,902][INFO ][disco-notifier-worker-#22922%grid-1%][GridEncryptionManager] Master key successfully changed [masterKeyName=ignite.master.key2] [21:11:58] : [Step 4/5] [2021-11-19 21:11:58,903][INFO ][disco-notifier-worker-#22803%grid-0%][GridEncryptionManager] Master key successfully changed [masterKeyName=ignite.master.key2] [21:11:58] : [Step 4/5] [2021-11-19 21:11:58,903][INFO ][disco-notifier-worker-#22922%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=47] [21:11:58] : [Step 4/5] [2021-11-19 21:11:58,903][INFO ][reencrypt-#22964%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:11:58] : [Step 4/5] [2021-11-19 21:11:58,904][INFO ][disco-notifier-worker-#22803%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=47] [21:11:58] : [Step 4/5] [2021-11-19 21:11:58,904][INFO ][reencrypt-#22963%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:11:59] : [Step 4/5] [2021-11-19 21:11:59,105][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10ca909b-1957-42c9-93b4-147fa476d001, grp=1613773252] [21:11:59] : [Step 4/5] [2021-11-19 21:11:59,427][INFO ][db-checkpoint-thread-#22945%grid-1%][Checkpointer] Checkpoint started [checkpointId=0c15637b-76ee-448c-bd95-9916067e4f48, startPtr=WALPointer [idx=15, fileOff=937504, len=2048], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=135ms, writeCheckpointEntryDuration=186ms, splitAndSortCpPagesDuration=0ms, pages=73, reason='test'] [21:11:59] : [Step 4/5] [2021-11-19 21:11:59,440][INFO ][db-checkpoint-thread-#22945%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:11:59] : [Step 4/5] [2021-11-19 21:11:59,440][INFO ][db-checkpoint-thread-#22945%grid-1%][Checkpointer] Checkpoint finished [cpId=0c15637b-76ee-448c-bd95-9916067e4f48, pages=73, markPos=WALPointer [idx=15, fileOff=937504, len=2048], walSegmentsCovered=[], markDuration=322ms, pagesWrite=3ms, fsync=9ms, total=335ms] [21:11:59] : [Step 4/5] [2021-11-19 21:11:59,441][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00a4fdec-fb9a-4106-96a3-cca8453c6000, grp=1613773252] [21:11:59] : [Step 4/5] [2021-11-19 21:11:59,449][INFO ][db-checkpoint-thread-#22942%grid-0%][Checkpointer] Checkpoint started [checkpointId=92f825a8-70e9-49de-87a0-a3991c5d3005, startPtr=WALPointer [idx=12, fileOff=442541, len=2010], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=6ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=0ms, pages=52, reason='test'] [21:11:59] : [Step 4/5] [2021-11-19 21:11:59,461][INFO ][db-checkpoint-thread-#22942%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:11:59] : [Step 4/5] [2021-11-19 21:11:59,461][INFO ][db-checkpoint-thread-#22942%grid-0%][Checkpointer] Checkpoint finished [cpId=92f825a8-70e9-49de-87a0-a3991c5d3005, pages=52, markPos=WALPointer [idx=12, fileOff=442541, len=2010], walSegmentsCovered=[], markDuration=8ms, pagesWrite=3ms, fsync=8ms, total=19ms] [21:11:59] : [Step 4/5] [2021-11-19 21:11:59,467][INFO ][disco-notifier-worker-#22803%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=48] [21:11:59] : [Step 4/5] [2021-11-19 21:11:59,467][INFO ][disco-notifier-worker-#22922%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=48] [21:11:59] : [Step 4/5] [2021-11-19 21:11:59,467][INFO ][reencrypt-#22963%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:11:59] : [Step 4/5] [2021-11-19 21:11:59,467][INFO ][reencrypt-#22964%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:11:59] : [Step 4/5] [2021-11-19 21:11:59,477][INFO ][wal-file-archiver%grid-1-#22937%grid-1%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=15, segIdx=5, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000005.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000015.wal] [21:11:59] : [Step 4/5] [2021-11-19 21:11:59,478][INFO ][wal-file-cleaner%grid-1-#22938%grid-1%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=6, currSize=10.0 MB, maxSize=20.0 MB] [21:11:59] : [Step 4/5] [2021-11-19 21:11:59,481][INFO ][wal-file-cleaner%grid-1-#22938%grid-1%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:11:59] : [Step 4/5] [2021-11-19 21:11:59,496][INFO ][wal-file-archiver%grid-1-#22937%grid-1%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000005.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000015.wal] [21:11:59] : [Step 4/5] [2021-11-19 21:11:59,527][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:59] : [Step 4/5] [2021-11-19 21:11:59,691][INFO ][disco-notifier-worker-#22803%grid-0%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:59] : [Step 4/5] [2021-11-19 21:11:59,699][INFO ][disco-notifier-worker-#22922%grid-1%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:59] : [Step 4/5] [2021-11-19 21:11:59,850][INFO ][disco-notifier-worker-#22803%grid-0%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:59] : [Step 4/5] [2021-11-19 21:11:59,864][INFO ][disco-notifier-worker-#22922%grid-1%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:11:59] : [Step 4/5] [2021-11-19 21:11:59,964][INFO ][disco-notifier-worker-#22803%grid-0%][GridEncryptionManager] Start master key change [masterKeyName=ignite.master.key3] [21:11:59] : [Step 4/5] [2021-11-19 21:11:59,965][INFO ][disco-notifier-worker-#22922%grid-1%][GridEncryptionManager] Start master key change [masterKeyName=ignite.master.key3] [21:12:00] : [Step 4/5] [2021-11-19 21:12:00,020][INFO ][disco-notifier-worker-#22922%grid-1%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:12:00] : [Step 4/5] [2021-11-19 21:12:00,042][INFO ][disco-notifier-worker-#22803%grid-0%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:12:00] : [Step 4/5] [2021-11-19 21:12:00,112][INFO ][disco-notifier-worker-#22922%grid-1%][GridEncryptionManager] Master key successfully changed [masterKeyName=ignite.master.key3] [21:12:00] : [Step 4/5] [2021-11-19 21:12:00,140][INFO ][disco-notifier-worker-#22803%grid-0%][GridEncryptionManager] Master key successfully changed [masterKeyName=ignite.master.key3] [21:12:00] : [Step 4/5] [2021-11-19 21:12:00,148][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10ca909b-1957-42c9-93b4-147fa476d001, grp=1613773252] [21:12:00] : [Step 4/5] [2021-11-19 21:12:00,519][INFO ][db-checkpoint-thread-#22945%grid-1%][Checkpointer] Checkpoint started [checkpointId=8e40bb0a-32f0-4d88-a9d9-02ed664c09d4, startPtr=WALPointer [idx=16, fileOff=289030, len=2048], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=151ms, writeCheckpointEntryDuration=219ms, splitAndSortCpPagesDuration=0ms, pages=75, reason='test'] [21:12:00] : [Step 4/5] [2021-11-19 21:12:00,676][INFO ][db-checkpoint-thread-#22945%grid-1%][GridEncryptionManager] Previous encryption keys were removed [grpId=1613773252, keyIds=[18, 19, 20]] [21:12:00] : [Step 4/5] [2021-11-19 21:12:00,676][INFO ][db-checkpoint-thread-#22945%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:12:00] : [Step 4/5] [2021-11-19 21:12:00,677][INFO ][db-checkpoint-thread-#22945%grid-1%][Checkpointer] Checkpoint finished [cpId=8e40bb0a-32f0-4d88-a9d9-02ed664c09d4, pages=75, markPos=WALPointer [idx=16, fileOff=289030, len=2048], walSegmentsCovered=[15], markDuration=371ms, pagesWrite=3ms, fsync=153ms, total=527ms] [21:12:00] : [Step 4/5] [2021-11-19 21:12:00,678][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00a4fdec-fb9a-4106-96a3-cca8453c6000, grp=1613773252] [21:12:00] : [Step 4/5] [2021-11-19 21:12:00,683][INFO ][db-checkpoint-thread-#22942%grid-0%][Checkpointer] Checkpoint started [checkpointId=9f314e9f-e23b-4983-b781-68814c8aee77, startPtr=WALPointer [idx=12, fileOff=781163, len=2010], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=2ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=0ms, pages=54, reason='test'] [21:12:00] : [Step 4/5] [2021-11-19 21:12:00,695][INFO ][db-checkpoint-thread-#22942%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:12:00] : [Step 4/5] [2021-11-19 21:12:00,695][INFO ][db-checkpoint-thread-#22942%grid-0%][Checkpointer] Checkpoint finished [cpId=9f314e9f-e23b-4983-b781-68814c8aee77, pages=54, markPos=WALPointer [idx=12, fileOff=781163, len=2010], walSegmentsCovered=[], markDuration=5ms, pagesWrite=2ms, fsync=9ms, total=16ms] [21:12:00] : [Step 4/5] [2021-11-19 21:12:00,701][INFO ][disco-notifier-worker-#22922%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=49] [21:12:00] : [Step 4/5] [2021-11-19 21:12:00,701][INFO ][disco-notifier-worker-#22803%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=49] [21:12:00] : [Step 4/5] [2021-11-19 21:12:00,702][INFO ][reencrypt-#22964%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:12:00] : [Step 4/5] [2021-11-19 21:12:00,702][INFO ][reencrypt-#22963%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:12:00] : [Step 4/5] [2021-11-19 21:12:00,712][INFO ][wal-file-archiver%grid-0-#22934%grid-0%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=12, segIdx=2, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000002.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000012.wal] [21:12:00] : [Step 4/5] [2021-11-19 21:12:00,713][INFO ][wal-file-cleaner%grid-0-#22935%grid-0%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=3, currSize=10.0 MB, maxSize=20.0 MB] [21:12:00] : [Step 4/5] [2021-11-19 21:12:00,715][INFO ][wal-file-cleaner%grid-0-#22935%grid-0%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:12:00] : [Step 4/5] [2021-11-19 21:12:00,725][INFO ][wal-file-archiver%grid-0-#22934%grid-0%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000002.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000012.wal] [21:12:00] : [Step 4/5] [2021-11-19 21:12:00,771][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:12:00] : [Step 4/5] [2021-11-19 21:12:00,924][INFO ][disco-notifier-worker-#22922%grid-1%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:12:00] : [Step 4/5] [2021-11-19 21:12:00,941][INFO ][disco-notifier-worker-#22803%grid-0%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:12:01] : [Step 4/5] [2021-11-19 21:12:01,069][INFO ][disco-notifier-worker-#22922%grid-1%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:12:01] : [Step 4/5] [2021-11-19 21:12:01,120][INFO ][disco-notifier-worker-#22803%grid-0%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:12:01] : [Step 4/5] [2021-11-19 21:12:01,217][INFO ][disco-notifier-worker-#22803%grid-0%][GridEncryptionManager] Start master key change [masterKeyName=ignite.master.key2] [21:12:01] : [Step 4/5] [2021-11-19 21:12:01,218][INFO ][disco-notifier-worker-#22922%grid-1%][GridEncryptionManager] Start master key change [masterKeyName=ignite.master.key2] [21:12:01] : [Step 4/5] [2021-11-19 21:12:01,277][INFO ][disco-notifier-worker-#22803%grid-0%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:12:01] : [Step 4/5] [2021-11-19 21:12:01,283][INFO ][disco-notifier-worker-#22922%grid-1%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:12:01] : [Step 4/5] [2021-11-19 21:12:01,384][INFO ][disco-notifier-worker-#22803%grid-0%][GridEncryptionManager] Master key successfully changed [masterKeyName=ignite.master.key2] [21:12:01] : [Step 4/5] [2021-11-19 21:12:01,405][INFO ][disco-notifier-worker-#22922%grid-1%][GridEncryptionManager] Master key successfully changed [masterKeyName=ignite.master.key2] [21:12:01] : [Step 4/5] [2021-11-19 21:12:01,406][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10ca909b-1957-42c9-93b4-147fa476d001, grp=1613773252] [21:12:01] : [Step 4/5] [2021-11-19 21:12:01,549][INFO ][db-checkpoint-thread-#22945%grid-1%][Checkpointer] Checkpoint started [checkpointId=1885494b-30af-4d7f-bcdc-1a4186a09fed, startPtr=WALPointer [idx=16, fileOff=702751, len=2048], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=132ms, writeCheckpointEntryDuration=9ms, splitAndSortCpPagesDuration=0ms, pages=74, reason='test'] [21:12:01] : [Step 4/5] [2021-11-19 21:12:01,570][INFO ][db-checkpoint-thread-#22945%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:12:01] : [Step 4/5] [2021-11-19 21:12:01,570][INFO ][db-checkpoint-thread-#22945%grid-1%][Checkpointer] Checkpoint finished [cpId=1885494b-30af-4d7f-bcdc-1a4186a09fed, pages=74, markPos=WALPointer [idx=16, fileOff=702751, len=2048], walSegmentsCovered=[], markDuration=142ms, pagesWrite=4ms, fsync=16ms, total=163ms] [21:12:01] : [Step 4/5] [2021-11-19 21:12:01,571][INFO ][test-runner-#22691%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00a4fdec-fb9a-4106-96a3-cca8453c6000, grp=1613773252] [21:12:01] : [Step 4/5] [2021-11-19 21:12:01,579][INFO ][db-checkpoint-thread-#22942%grid-0%][Checkpointer] Checkpoint started [checkpointId=59d8815b-58a9-44c0-92ad-5ec2002b5b6d, startPtr=WALPointer [idx=13, fileOff=79644, len=2010], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=1ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=5ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=0ms, pages=55, reason='test'] [21:12:01] : [Step 4/5] [2021-11-19 21:12:01,592][INFO ][db-checkpoint-thread-#22942%grid-0%][GridEncryptionManager] Previous encryption keys were removed [grpId=1613773252, keyIds=[10, 11, 12, 13, 14]] [21:12:01] : [Step 4/5] [2021-11-19 21:12:01,592][INFO ][db-checkpoint-thread-#22942%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:12:01] : [Step 4/5] [2021-11-19 21:12:01,592][INFO ][db-checkpoint-thread-#22942%grid-0%][Checkpointer] Checkpoint finished [cpId=59d8815b-58a9-44c0-92ad-5ec2002b5b6d, pages=55, markPos=WALPointer [idx=13, fileOff=79644, len=2010], walSegmentsCovered=[12], markDuration=8ms, pagesWrite=2ms, fsync=10ms, total=20ms] [21:12:01] : [Step 4/5] [21:12:01] >>> Stopping test: CacheGroupKeyChangeTest#testMasterAndCacheGroupKeySimultaneousChange in 50810 ms <<< [21:12:01] : [Step 4/5] [2021-11-19 21:12:01,594][INFO ][main][root] >>> Stopping test: CacheGroupKeyChangeTest#testMasterAndCacheGroupKeySimultaneousChange in 50810 ms <<< [21:12:01] : [Step 4/5] [21:12:01] >>> Heap: 469 MB used / 1937 MB commited / 1937 MB max <<< [21:12:01] : [Step 4/5] [2021-11-19 21:12:01,595][INFO ][main][root] >>> Heap: 469 MB used / 1937 MB commited / 1937 MB max <<< [21:12:01] : [Step 4/5] [21:12:01] >>> Non-Heap: 165 MB used / 187 MB commited / 0 MB max <<< [21:12:01] : [Step 4/5] [2021-11-19 21:12:01,595][INFO ][main][root] >>> Non-Heap: 165 MB used / 187 MB commited / 0 MB max <<< [21:12:01] : [Step 4/5] [2021-11-19 21:12:01,595][INFO ][main][root] >>> Stopping grid [name=grid-1, id=10ca909b-1957-42c9-93b4-147fa476d001] [21:12:01] : [Step 4/5] [2021-11-19 21:12:01,606][INFO ][db-checkpoint-thread-#22945%grid-1%][Checkpointer] Skipping checkpoint (no pages were modified) [checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=1ms, checkpointLockHoldTime=1ms, reason='timeout'] [21:12:01] : [Step 4/5] [2021-11-19 21:12:01,616][INFO ][tcp-disco-sock-reader-[00a4fdec 127.0.0.1:51965]-#1205%grid-1%-#22927%grid-1%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:51965, rmtPort=51965, rmtNodeId=00a4fdec-fb9a-4106-96a3-cca8453c6000] [21:12:01] : [Step 4/5] [2021-11-19 21:12:01,619][INFO ][disco-event-worker-#22807%grid-0%][GridDiscoveryManager] Node left topology: TcpDiscoveryNode [id=10ca909b-1957-42c9-93b4-147fa476d001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637345473295, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false] [21:12:01] : [Step 4/5] [2021-11-19 21:12:01,620][INFO ][main][GridCacheProcessor] Stopped cache [cacheName=ignite-sys-cache] [21:12:01] : [Step 4/5] [2021-11-19 21:12:01,620][INFO ][main][GridCacheProcessor] Stopped cache [cacheName=encrypted] [21:12:01] : [Step 4/5] [2021-11-19 21:12:01,620][INFO ][disco-event-worker-#22807%grid-0%][GridDiscoveryManager] Topology snapshot [ver=3, locNode=00a4fdec, servers=1, clients=0, state=ACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=00a4fdec-fb9a-4106-96a3-cca8453c6000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:12:01] : [Step 4/5] [2021-11-19 21:12:01,621][INFO ][disco-event-worker-#22807%grid-0%][GridDiscoveryManager] ^-- Baseline [id=0, size=2, online=1, offline=1] [21:12:01] : [Step 4/5] [2021-11-19 21:12:01,627][INFO ][main][FilePageStoreManager] Cleanup cache stores [total=4, left=0, cleanFiles=false] [21:12:01]W: [org.apache.ignite:ignite-core] [2021-11-19 21:12:01,627][WARN ][grid-nio-worker-tcp-comm-0-#22746%TestRecordingCommunicationSpi%][TestRecordingCommunicationSpi] Failed to shutdown socket [21:12:01]W: [org.apache.ignite:ignite-core] java.nio.channels.ClosedChannelException [21:12:01]W: [org.apache.ignite:ignite-core] at sun.nio.ch.SocketChannelImpl.shutdownOutput(SocketChannelImpl.java:795) [21:12:01]W: [org.apache.ignite:ignite-core] at sun.nio.ch.SocketAdaptor.shutdownOutput(SocketAdaptor.java:407) [21:12:01]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.close(IgniteUtils.java:4247) [21:12:01]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.closeKey(GridNioServer.java:2784) [21:12:01]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.close(GridNioServer.java:2835) [21:12:01]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.close(GridNioServer.java:2794) [21:12:01]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.bodyInternal(GridNioServer.java:2157) [21:12:01]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.body(GridNioServer.java:1910) [21:12:01] : [Step 4/5] [2021-11-19 21:12:01,627][INFO ][exchange-worker-#22808%grid-0%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], crd=true, evt=NODE_LEFT, evtNode=10ca909b-1957-42c9-93b4-147fa476d001, customEvt=null, allowMerge=false, exchangeFreeSwitch=true] [21:12:01]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:125) [21:12:01]W: [org.apache.ignite:ignite-core] at java.lang.Thread.run(Thread.java:748) [21:12:01] : [Step 4/5] [2021-11-19 21:12:01,631][INFO ][main][GridDeploymentLocalStore] Removed undeployed class: GridDeployment [ts=1637345473386, depMode=SHARED, clsLdr=IsolatedClassLoader{roleName='test'}, clsLdrId=1cc8d593d71-10ca909b-1957-42c9-93b4-147fa476d001, userVer=0, loc=true, sampleClsName=org.apache.ignite.internal.processors.cache.distributed.dht.preloader.IgniteDhtPartitionsToReloadMap, pendingUndeploy=false, undeployed=true, usage=0] [21:12:01] : [Step 4/5] [2021-11-19 21:12:01,632][INFO ][sys-#22794%grid-0%][GridAffinityAssignmentCache] Local node affinity assignment distribution is not ideal [cache=encrypted, expectedPrimary=8.00, actualPrimary=3, expectedBackups=0.00, actualBackups=0, warningThreshold=50.00%] [21:12:01] : [Step 4/5] [2021-11-19 21:12:01,633][INFO ][exchange-worker-#22808%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:12:01] : [Step 4/5] [2021-11-19 21:12:01,635][INFO ][exchange-worker-#22808%grid-0%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], err=null, rebalanced=true, wasRebalanced=true] [21:12:01]W: [org.apache.ignite:ignite-core] [2021-11-19 21:12:01,642][WARN ][sys-#22801%grid-0%][GridDhtPartitionTopologyImpl] Detected lost partitions [grp=encrypted, parts=[0, 2, 4, 6-7], topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0]] [21:12:01] : [Step 4/5] [2021-11-19 21:12:01,644][INFO ][exchange-worker-#22808%grid-0%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=00a4fdec-fb9a-4106-96a3-cca8453c6000, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], evt=NODE_LEFT, evtNode=TcpDiscoveryNode [id=10ca909b-1957-42c9-93b4-147fa476d001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637345473295, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0]] [21:12:01] : [Step 4/5] [2021-11-19 21:12:01,645][INFO ][exchange-worker-#22808%grid-0%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (5 ms), stage="Determine exchange type" (1 ms), stage="Preloading notification" (0 ms), stage="After states restored callback" (1 ms), stage="WAL history reservation" (0 ms), stage="Finalize update counters" (0 ms), stage="Detect lost partitions" (7 ms), stage="Exchange done" (2 ms), stage="Total time" (16 ms)] [21:12:01] : [Step 4/5] [2021-11-19 21:12:01,646][INFO ][exchange-worker-#22808%grid-0%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], stage="Affinity initialization (exchange-free switch on fully-rebalanced topology) [grp=encrypted]" (1 ms) (parent=Determine exchange type), stage="Affinity initialization (exchange-free switch on fully-rebalanced topology) [grp=ignite-sys-cache]" (0 ms) (parent=Determine exchange type)] [21:12:01] : [Step 4/5] [2021-11-19 21:12:01,647][INFO ][exchange-worker-#22808%grid-0%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], crd=true] [21:12:01] : [Step 4/5] [2021-11-19 21:12:01,648][INFO ][exchange-worker-#22808%grid-0%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=3, minorTopVer=0], force=false, evt=NODE_LEFT, node=10ca909b-1957-42c9-93b4-147fa476d001] [21:12:01] : [Step 4/5] [2021-11-19 21:12:01,661][INFO ][main][IgniteKernal%grid-1] [21:12:01] : [Step 4/5] [21:12:01] : [Step 4/5] >>> +------------------------------------------------------+ [21:12:01] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV stopped OK [21:12:01] : [Step 4/5] >>> +------------------------------------------------------+ [21:12:01] : [Step 4/5] >>> Ignite instance name: grid-1 [21:12:01] : [Step 4/5] >>> Grid uptime: 00:00:48.309 [21:12:01] : [Step 4/5] [21:12:01] : [Step 4/5] [21:12:01] : [Step 4/5] [2021-11-19 21:12:01,662][INFO ][main][root] >>> Stopping grid [name=grid-0, id=00a4fdec-fb9a-4106-96a3-cca8453c6000] [21:12:01] : [Step 4/5] [2021-11-19 21:12:01,884][INFO ][db-checkpoint-thread-#22942%grid-0%][Checkpointer] Checkpoint started [checkpointId=0e47efe5-8a47-4a0f-87d0-a99042c04d4b, startPtr=WALPointer [idx=13, fileOff=161847, len=2010], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=78ms, writeCheckpointEntryDuration=136ms, splitAndSortCpPagesDuration=0ms, pages=13, reason='timeout'] [21:12:01] : [Step 4/5] [2021-11-19 21:12:01,889][INFO ][tcp-disco-sock-reader-[10ca909b 127.0.0.1:48067]-#1206%grid-0%-#22928%grid-0%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:48067, rmtPort=48067, rmtNodeId=10ca909b-1957-42c9-93b4-147fa476d001] [21:12:01] : [Step 4/5] [2021-11-19 21:12:01,891][INFO ][main][GridCacheProcessor] Stopped cache [cacheName=ignite-sys-cache] [21:12:01] : [Step 4/5] [2021-11-19 21:12:01,891][INFO ][main][GridCacheProcessor] Stopped cache [cacheName=encrypted] [21:12:02] : [Step 4/5] [2021-11-19 21:12:02,246][INFO ][main][FilePageStoreManager] Cleanup cache stores [total=4, left=0, cleanFiles=false] [21:12:02] : [Step 4/5] [2021-11-19 21:12:02,248][INFO ][main][GridDeploymentLocalStore] Removed undeployed class: GridDeployment [ts=1637345473386, depMode=SHARED, clsLdr=IsolatedClassLoader{roleName='test'}, clsLdrId=fbc8d593d71-00a4fdec-fb9a-4106-96a3-cca8453c6000, userVer=0, loc=true, sampleClsName=org.apache.ignite.internal.processors.cache.distributed.dht.preloader.GridDhtPartitionMap, pendingUndeploy=false, undeployed=true, usage=0] [21:12:02] : [Step 4/5] [2021-11-19 21:12:02,256][INFO ][main][IgniteKernal%grid-0] [21:12:02] : [Step 4/5] [21:12:02] : [Step 4/5] >>> +------------------------------------------------------+ [21:12:02] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV stopped OK [21:12:02] : [Step 4/5] >>> +------------------------------------------------------+ [21:12:02] : [Step 4/5] >>> Ignite instance name: grid-0 [21:12:02] : [Step 4/5] >>> Grid uptime: 00:00:49.811 [21:12:02] : [Step 4/5] [21:12:02] : [Step 4/5] [21:12:02] : [Step 4/5] [21:12:02] >>> Starting test: CacheGroupKeyChangeTest#testKeyChangeWithNodeFilter <<< [21:12:02] : [Step 4/5] [2021-11-19 21:12:02,282][INFO ][main][root] >>> Starting test: CacheGroupKeyChangeTest#testKeyChangeWithNodeFilter <<< [21:12:02] : [Step 4/5] [21:12:02] >>> Heap: 475 MB used / 1937 MB commited / 1937 MB max <<< [21:12:02] : [Step 4/5] [2021-11-19 21:12:02,283][INFO ][main][root] >>> Heap: 475 MB used / 1937 MB commited / 1937 MB max <<< [21:12:02] : [Step 4/5] [21:12:02] >>> Non-Heap: 165 MB used / 187 MB commited / 0 MB max <<< [21:12:02] : [Step 4/5] [2021-11-19 21:12:02,283][INFO ][main][root] >>> Non-Heap: 165 MB used / 187 MB commited / 0 MB max <<< [21:12:02]W: [org.apache.ignite:ignite-core] [2021-11-19 21:12:02,291][WARN ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][G] Ignite work directory is not provided, automatically resolved to: /opt/buildagent/work/7bc1c54bc719b67c/work [21:12:02] : [Step 4/5] [2021-11-19 21:12:02,293][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] [21:12:02] : [Step 4/5] [21:12:02] : [Step 4/5] >>> __________ ________________ [21:12:02] : [Step 4/5] >>> / _/ ___/ |/ / _/_ __/ __/ [21:12:02] : [Step 4/5] >>> _/ // (7 7 // / / / / _/ [21:12:02] : [Step 4/5] >>> /___/\___/_/|_/___/ /_/ /___/ [21:12:02] : [Step 4/5] >>> [21:12:02] : [Step 4/5] >>> ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:12:02] : [Step 4/5] >>> 2021 Copyright(C) Apache Software Foundation [21:12:02] : [Step 4/5] >>> [21:12:02] : [Step 4/5] >>> Ignite documentation: http://ignite.apache.org [21:12:02] : [Step 4/5] [21:12:02] : [Step 4/5] [2021-11-19 21:12:02,294][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] Config URL: n/a [21:12:02] : [Step 4/5] [2021-11-19 21:12:02,295][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] IgniteConfiguration [igniteInstanceName=grid-0, pubPoolSize=24, svcPoolSize=24, callbackPoolSize=24, stripedPoolSize=24, sysPoolSize=24, mgmtPoolSize=4, dataStreamerPoolSize=24, utilityCachePoolSize=24, utilityCacheKeepAliveTime=60000, p2pPoolSize=2, qryPoolSize=24, buildIdxPoolSize=4, igniteHome=/opt/buildagent/work/7bc1c54bc719b67c, igniteWorkDir=/opt/buildagent/work/7bc1c54bc719b67c/work, mbeanSrv=com.sun.jmx.mbeanserver.JmxMBeanServer@6fe85038, nodeId=00b082f3-da49-47e4-b5f4-83c3167a5000, marsh=BinaryMarshaller [], marshLocJobs=false, daemon=false, p2pEnabled=true, netTimeout=10000, netCompressionLevel=1, sndRetryDelay=1000, sndRetryCnt=3, metricsHistSize=10000, metricsUpdateFreq=1000, metricsExpTime=9223372036854775807, discoSpi=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=0, ackTimeout=0, marsh=null, reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], segPlc=STOP, segResolveAttempts=2, waitForSegOnStart=true, allResolversPassReq=true, segChkFreq=10000, commSpi=TcpCommunicationSpi [connectGate=org.apache.ignite.spi.communication.tcp.internal.ConnectGateway@f50b3b6, ctxInitLatch=java.util.concurrent.CountDownLatch@f036e68[Count = 1], stopping=false, clientPool=null, nioSrvWrapper=null, stateProvider=null], evtSpi=MemoryEventStorageSpi [expireAgeMs=9223372036854775807, expireCnt=10000, filter=null], colSpi=NoopCollisionSpi [], deploySpi=LocalDeploymentSpi [], indexingSpi=org.apache.ignite.spi.indexing.noop.NoopIndexingSpi@3da1b154, addrRslvr=null, encryptionSpi=org.apache.ignite.spi.encryption.keystore.KeystoreEncryptionSpi@6e1d7ef3, tracingSpi=org.apache.ignite.spi.tracing.NoopTracingSpi@5c2a2e17, clientMode=false, rebalanceThreadPoolSize=4, rebalanceTimeout=10000, rebalanceBatchesPrefetchCnt=3, rebalanceThrottle=0, rebalanceBatchSize=524288, txCfg=TransactionConfiguration [txSerEnabled=false, dfltIsolation=REPEATABLE_READ, dfltConcurrency=PESSIMISTIC, dfltTxTimeout=0, txTimeoutOnPartitionMapExchange=0, deadlockTimeout=10000, pessimisticTxLogSize=0, pessimisticTxLogLinger=10000, tmLookupClsName=null, txManagerFactory=null, useJtaSync=false], cacheSanityCheckEnabled=true, discoStartupDelay=60000, deployMode=SHARED, p2pMissedCacheSize=100, locHost=127.0.0.1, timeSrvPortBase=31100, timeSrvPortRange=100, failureDetectionTimeout=10000, sysWorkerBlockedTimeout=null, clientFailureDetectionTimeout=10000, metricsLogFreq=0, connectorCfg=null, odbcCfg=null, warmupClos=null, atomicCfg=AtomicConfiguration [seqReserveSize=1000, cacheMode=PARTITIONED, backups=1, aff=null, grpName=null], classLdr=null, sslCtxFactory=null, platformCfg=null, binaryCfg=null, memCfg=null, pstCfg=null, dsCfg=DataStorageConfiguration [sysRegionInitSize=41943040, sysRegionMaxSize=104857600, pageSize=4096, concLvl=0, dfltDataRegConf=DataRegionConfiguration [name=default, maxSize=104857600, initSize=268435456, swapPath=null, pageEvictionMode=DISABLED, pageReplacementMode=CLOCK, evictionThreshold=0.9, emptyPagesPoolSize=100, metricsEnabled=false, metricsSubIntervalCount=5, metricsRateTimeInterval=60000, persistenceEnabled=true, checkpointPageBufSize=0, lazyMemoryAllocation=true, warmUpCfg=null], dataRegions=null, storagePath=null, checkpointFreq=30000, lockWaitTime=10000, checkpointThreads=4, checkpointWriteOrder=SEQUENTIAL, walHistSize=20, maxWalArchiveSize=20971520, walSegments=10, walSegmentSize=1048576, walPath=db/wal, walArchivePath=db/wal/archive, cdcWalPath=db/wal/cdc, cdcEnabled=false, metricsEnabled=false, walMode=LOG_ONLY, walTlbSize=131072, walBuffSize=0, walFlushFreq=2000, walFsyncDelay=1000, walRecordIterBuffSize=67108864, alwaysWriteFullPages=false, fileIOFactory=org.apache.ignite.internal.processors.cache.persistence.file.AsyncFileIOFactory@1f97bdb, metricsSubIntervalCnt=5, metricsRateTimeInterval=60000, walAutoArchiveAfterInactivity=-1, walForceArchiveTimeout=-1, writeThrottlingEnabled=false, walCompactionEnabled=false, walCompactionLevel=1, checkpointReadLockTimeout=null, walPageCompression=DISABLED, walPageCompressionLevel=null, dfltWarmUpCfg=null, encCfg=org.apache.ignite.configuration.EncryptionConfiguration@388e17ff, defragmentationThreadPoolSize=4, minWalArchiveSize=-1], snapshotPath=snapshots, activeOnStart=true, activeOnStartPropSetFlag=false, autoActivation=true, autoActivationPropSetFlag=false, clusterStateOnStart=null, sqlConnCfg=null, cliConnCfg=ClientConnectorConfiguration [host=null, port=10800, portRange=100, sockSndBufSize=0, sockRcvBufSize=0, tcpNoDelay=true, maxOpenCursorsPerConn=128, threadPoolSize=24, selectorCnt=12, idleTimeout=0, handshakeTimeout=10000, jdbcEnabled=true, odbcEnabled=true, thinCliEnabled=true, sslEnabled=false, useIgniteSslCtxFactory=true, sslClientAuth=false, sslCtxFactory=null, thinCliCfg=ThinClientConfiguration [maxActiveTxPerConn=100, maxActiveComputeTasksPerConn=0]], mvccVacuumThreadCnt=2, mvccVacuumFreq=5000, authEnabled=false, failureHnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]], commFailureRslvr=null, sqlCfg=SqlConfiguration [longQryWarnTimeout=3000, dfltQryTimeout=0, sqlQryHistSize=1000, validationEnabled=false], asyncContinuationExecutor=null] [21:12:02] : [Step 4/5] [2021-11-19 21:12:02,304][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] Daemon mode: off [21:12:02] : [Step 4/5] [2021-11-19 21:12:02,305][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] OS: Linux 4.15.0-151-generic amd64 [21:12:02] : [Step 4/5] [2021-11-19 21:12:02,305][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] OS user: teamcity [21:12:02] : [Step 4/5] [2021-11-19 21:12:02,305][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] PID: 16724 [21:12:02] : [Step 4/5] [2021-11-19 21:12:02,306][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] Language runtime: Java Platform API Specification ver. 1.8 [21:12:02] : [Step 4/5] [2021-11-19 21:12:02,306][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] VM information: Java(TM) SE Runtime Environment 1.8.0_261-b12 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 25.261-b12 [21:12:02] : [Step 4/5] [2021-11-19 21:12:02,307][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] VM total memory: 1.9GB [21:12:02] : [Step 4/5] [2021-11-19 21:12:02,307][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] Remote Management [restart: off, REST: off, JMX (remote: off)] [21:12:02] : [Step 4/5] [2021-11-19 21:12:02,307][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] Logger: GridTestLog4jLogger [quiet=false, config=null] [21:12:02] : [Step 4/5] [2021-11-19 21:12:02,308][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] IGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c [21:12:02] : [Step 4/5] [2021-11-19 21:12:02,308][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] VM arguments: [-DIGNITE_DUMP_THREADS_ON_FAILURE=false, -DMono=/usr/bin/mono-sgen, -DMono4.0_x64=/usr/lib/mono/4.0, -DMono4.5_x64=/usr/lib/mono/4.5, -DMonoVersion=6.12.0.90, -DSKIP_BUILD=false, -Dagent.home.dir=/opt/buildagent, -Dagent.name=aitc-lin02_03, -Dagent.ownPort=9090, -Dagent.work.dir=/opt/buildagent/work, -Dbuild.number=95, -Dbuild.vcs.number=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.1=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.GitHubApacheIgnite=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dclassworlds.conf=/opt/buildagent/temp/buildTmp/teamcity.m2.conf, -Dcom.jetbrains.maven.watcher.report.file=/opt/buildagent/temp/buildTmp/maven-build-info.xml, -Djava.io.tmpdir=/opt/buildagent/temp/buildTmp, -Dmaven.home=/opt/buildagent/tools/maven3_6, -Dmaven.multiModuleProjectDirectory=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.agent.cpuBenchmark=457, -Dteamcity.agent.dotnet.agent_url=http://localhost:9090/RPC2, -Dteamcity.agent.dotnet.build_id=6278078, -Dteamcity.auth.password=*******, -Dteamcity.auth.userId=TeamCityBuildId=6278078, -Dteamcity.build.changedFiles.file=/opt/buildagent/temp/buildTmp/changedFiles6342607772318147725.txt, -Dteamcity.build.checkoutDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.build.id=6278078, -Dteamcity.build.properties.file=/opt/buildagent/temp/buildTmp/teamcity.build5164517880467851002.properties, -Dteamcity.build.tempDir=/opt/buildagent/temp/buildTmp, -Dteamcity.build.workingDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.buildConfName=Basic 3, -Dteamcity.buildType.id=IgniteTests24Java8_Basic3, -Dteamcity.configuration.properties.file=/opt/buildagent/temp/buildTmp/teamcity.config5591980786735343870.properties, -Dteamcity.maven.userSettings.path=/opt/buildagent/temp/buildTmp/maven_settings_585072866407032347.xml, -Dteamcity.maven.watcher.home=/opt/buildagent/plugins/mavenPlugin/maven-watcher-jdk16, -Dteamcity.projectName=Ignite Tests 2.x (JDK 8/11), -Dteamcity.runner.properties.file=/opt/buildagent/temp/buildTmp/teamcity.runner9098465561618137420.properties, -Dteamcity.tests.recentlyFailedTests.file=/opt/buildagent/temp/buildTmp/testsToRunFirst3891775683130404069.txt, -Dteamcity.version=2021.2 (build 99542), -ea, -Xms2g, -Xmx2g, -XX:+HeapDumpOnOutOfMemoryError, -DIGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_TEST_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_UPDATE_NOTIFIER=false, -DIGNITE_NO_DISCO_ORDER=true, -DIGNITE_PERFORMANCE_SUGGESTIONS_DISABLED=true, -Djava.net.preferIPv4Stack=true, -DTEST_SCALE_FACTOR=1.0, -DIGNITE_TEST_PROP_LOG4J_FILE=log4j-tc-test.xml, -DIGNITE_QUIET=false, -DIGNITE_MARSHAL_BUFFERS_RECHECK=1000, -Dmaven.repo.local=/opt/buildagent/.m2/repository] [21:12:02] : [Step 4/5] [2021-11-19 21:12:02,313][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] System cache's DataRegion size is configured to 40 MB. Use DataStorageConfiguration.systemRegionInitialSize property to change the setting. [21:12:02] : [Step 4/5] [2021-11-19 21:12:02,313][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] Configured caches [in 'sysMemPlc' dataRegion: ['ignite-sys-cache']] [21:12:02]W: [org.apache.ignite:ignite-core] [2021-11-19 21:12:02,314][WARN ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] Peer class loading is enabled (disable it in production for performance and deployment consistency reasons) [21:12:02] : [Step 4/5] [2021-11-19 21:12:02,314][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] 3-rd party licenses can be found at: /opt/buildagent/work/7bc1c54bc719b67c/libs/licenses [21:12:02] : [Step 4/5] [2021-11-19 21:12:02,319][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] Configured plugins: [21:12:02] : [Step 4/5] [2021-11-19 21:12:02,319][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- StanByClusterTestProvider 1.0 [21:12:02] : [Step 4/5] [2021-11-19 21:12:02,319][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:12:02] : [Step 4/5] [2021-11-19 21:12:02,320][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] [21:12:02] : [Step 4/5] [2021-11-19 21:12:02,320][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- PageMemory tracker plugin 1.0 [21:12:02] : [Step 4/5] [2021-11-19 21:12:02,320][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:12:02] : [Step 4/5] [2021-11-19 21:12:02,320][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] [21:12:02] : [Step 4/5] [2021-11-19 21:12:02,320][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- TestDistibutedConfigurationPlugin 1.0 [21:12:02] : [Step 4/5] [2021-11-19 21:12:02,321][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:12:02] : [Step 4/5] [2021-11-19 21:12:02,321][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] [21:12:02] : [Step 4/5] [2021-11-19 21:12:02,321][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- NodeValidationPluginProvider 1.0 [21:12:02] : [Step 4/5] [2021-11-19 21:12:02,321][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:12:02] : [Step 4/5] [2021-11-19 21:12:02,322][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] [21:12:02] : [Step 4/5] [2021-11-19 21:12:02,322][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][FailureProcessor] Configured failure handler: [hnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]]] [21:12:02] : [Step 4/5] [2021-11-19 21:12:02,363][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][TestRecordingCommunicationSpi] Successfully bound communication NIO server to TCP port [port=47100, locHost=/127.0.0.1, selectorsCnt=12, selectorSpins=0, pairedConn=false] [21:12:02]W: [org.apache.ignite:ignite-core] [2021-11-19 21:12:02,364][WARN ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][TestRecordingCommunicationSpi] Message queue limit is set to 0 which may lead to potential OOMEs when running cache operations in FULL_ASYNC or PRIMARY_SYNC modes due to message queues growth on sender and receiver sides. [21:12:02] : [Step 4/5] [2021-11-19 21:12:02,371][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][GridCollisionManager] Collision resolution is disabled (all jobs will be activated upon arrival). [21:12:02] : [Step 4/5] [2021-11-19 21:12:02,371][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] Security status [authentication=off, sandbox=off, tls/ssl=off] [21:12:02] : [Step 4/5] [2021-11-19 21:12:02,429][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:12:02] : [Step 4/5] [2021-11-19 21:12:02,518][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][MaintenanceProcessor] Resolved store directory for node persistent data: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0 [21:12:02] : [Step 4/5] [2021-11-19 21:12:02,519][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][CacheObjectBinaryProcessorImpl] Resolved directory for serialized binary metadata: /opt/buildagent/work/7bc1c54bc719b67c/work/db/binary_meta/grid_0 [21:12:02] : [Step 4/5] [2021-11-19 21:12:02,525][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0 [21:12:02] : [Step 4/5] [2021-11-19 21:12:02,526][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][FileWriteAheadLogManager] Resolved write ahead log work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0 [21:12:02] : [Step 4/5] [2021-11-19 21:12:02,526][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][FileWriteAheadLogManager] Resolved write ahead log archive directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0 [21:12:02] : [Step 4/5] [2021-11-19 21:12:02,539][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000000.wal [21:12:02] : [Step 4/5] [2021-11-19 21:12:02,540][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][FileHandleManagerImpl] Initialized write-ahead log manager [mode=LOG_ONLY] [21:12:02]W: [org.apache.ignite:ignite-core] [2021-11-19 21:12:02,540][WARN ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] DataRegion maxSize=104.9 MB is smaller than defaultInitialSize=268.4 MB, setting initialSize to 104.9 MB [21:12:02] : [Step 4/5] [2021-11-19 21:12:02,545][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Configured data regions initialized successfully [total=5] [21:12:02] : [Step 4/5] [2021-11-19 21:12:02,547][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][IgniteSnapshotManager] Resolved snapshot work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/snapshots [21:12:02] : [Step 4/5] [2021-11-19 21:12:02,548][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][IgniteSnapshotManager] Resolved temp directory for snapshot creation: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0/snp [21:12:02] : [Step 4/5] [2021-11-19 21:12:02,551][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][ClientListenerProcessor] Client connector processor has started on TCP port 10800 [21:12:02] : [Step 4/5] [2021-11-19 21:12:02,557][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] Non-loopback local IPs: 172.17.0.4 [21:12:02] : [Step 4/5] [2021-11-19 21:12:02,557][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] Enabled local MACs: 0242AC110004 [21:12:02] : [Step 4/5] [2021-11-19 21:12:02,559][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:12:02] : [Step 4/5] [2021-11-19 21:12:02,561][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:12:02] : [Step 4/5] [2021-11-19 21:12:02,561][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:12:02] : [Step 4/5] [2021-11-19 21:12:02,564][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Applying lost metastore updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:12:02] : [Step 4/5] [2021-11-19 21:12:02,564][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=0 ms] [21:12:02] : [Step 4/5] [2021-11-19 21:12:02,565][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Restoring partition state for local groups. [21:12:02] : [Step 4/5] [2021-11-19 21:12:02,565][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=0, partitionsProcessed=0, time=0ms] [21:12:02] : [Step 4/5] [2021-11-19 21:12:02,566][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][GridEncryptionManager] Encryption keys loaded from metastore. [grps=, masterKeyName=ignite.master.key] [21:12:02] : [Step 4/5] [2021-11-19 21:12:02,571][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][ClusterProcessor] Cluster ID and tag has been read from metastorage: null [21:12:02] : [Step 4/5] [2021-11-19 21:12:02,571][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][IgniteClusterImpl] Shutdown policy was updated [oldVal=null, newVal=null] [21:12:02] : [Step 4/5] [2021-11-19 21:12:02,572][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Checkpoint frequency deviation changed [oldVal=null, newVal=null] [21:12:02] : [Step 4/5] [2021-11-19 21:12:02,581][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][FilePageStoreManager] Cleanup cache stores [total=1, left=0, cleanFiles=false] [21:12:02] : [Step 4/5] [2021-11-19 21:12:02,584][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:12:02] : [Step 4/5] [2021-11-19 21:12:02,585][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:12:02] : [Step 4/5] [2021-11-19 21:12:02,587][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:12:02] : [Step 4/5] [2021-11-19 21:12:02,587][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Data Regions Started: 5 [21:12:02] : [Step 4/5] [2021-11-19 21:12:02,588][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] ^-- sysMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:12:02] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:12:02] : [Step 4/5] ^-- default region [type=default, persistence=true, lazyAlloc=true, [21:12:02] : [Step 4/5] ... initCfg=100MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB, allocTotal=0MB] [21:12:02] : [Step 4/5] ^-- metastoreMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:12:02] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:12:02] : [Step 4/5] ^-- TxLog region [type=internal, persistence=true, lazyAlloc=false, [21:12:02] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:12:02] : [Step 4/5] ^-- volatileDsMemPlc region [type=user, persistence=false, lazyAlloc=true, [21:12:02] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB] [21:12:02] : [Step 4/5] ^-- Ignite persistence [used=0MB] [21:12:02] : [Step 4/5] [21:12:02] : [Step 4/5] [2021-11-19 21:12:02,590][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Starting binary memory restore for: [-2100569601] [21:12:02] : [Step 4/5] [2021-11-19 21:12:02,598][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:12:02] : [Step 4/5] [2021-11-19 21:12:02,599][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:12:02] : [Step 4/5] [2021-11-19 21:12:02,602][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000000.wal, offset=0, ver=2] [21:12:02] : [Step 4/5] [2021-11-19 21:12:02,606][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Started cache in recovery mode [name=ignite-sys-cache, id=-2100569601, dataRegionName=sysMemPlc, mode=REPLICATED, atomicity=TRANSACTIONAL, backups=2147483647, mvcc=false] [21:12:02] : [Step 4/5] [2021-11-19 21:12:02,606][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Binary recovery performed in 16 ms. [21:12:02] : [Step 4/5] [2021-11-19 21:12:02,607][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:12:02] : [Step 4/5] [2021-11-19 21:12:02,607][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Applying lost cache updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:12:02] : [Step 4/5] [2021-11-19 21:12:02,609][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=0 ms] [21:12:02] : [Step 4/5] [2021-11-19 21:12:02,609][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Restoring partition state for local groups. [21:12:02] : [Step 4/5] [2021-11-19 21:12:02,619][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=1, partitionsProcessed=100, time=10ms] [21:12:02] : [Step 4/5] [2021-11-19 21:12:02,643][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][TestTcpDiscoverySpi] Successfully bound to TCP port [port=47500, localHost=localhost/127.0.0.1, locNodeId=00b082f3-da49-47e4-b5f4-83c3167a5000] [21:12:02] : [Step 4/5] [2021-11-19 21:12:02,653][INFO ][disco-notifier-worker-#23079%grid-0%][MvccProcessorImpl] Assigned mvcc coordinator [crd=MvccCoordinator [topVer=AffinityTopologyVersion [topVer=1, minorTopVer=0], nodeId=00b082f3-da49-47e4-b5f4-83c3167a5000, ver=1637345522643, local=true, initialized=false]] [21:12:02] : [Step 4/5] [2021-11-19 21:12:02,654][INFO ][sys-#23062%grid-0%][ClusterProcessor] Writing cluster ID and tag to metastorage on ready for write ClusterIdAndTag [id=3db7b4a7-4406-4d31-aef1-c8efa56d8f47, tag=zealous_brahmagupta] [21:12:02] : [Step 4/5] [2021-11-19 21:12:02,663][INFO ][disco-notifier-worker-#23079%grid-0%][ClusterProcessor] zealous_brahmagupta [21:12:02] : [Step 4/5] [2021-11-19 21:12:02,664][INFO ][disco-notifier-worker-#23079%grid-0%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustEnabled' was changed from 'null' to 'false' [21:12:02] : [Step 4/5] [2021-11-19 21:12:02,665][INFO ][disco-notifier-worker-#23079%grid-0%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustTimeout' was changed from 'null' to '300000' [21:12:02] : [Step 4/5] [2021-11-19 21:12:02,666][INFO ][disco-notifier-worker-#23079%grid-0%][IgniteTxManager] Transactions parameter 'longOperationsDumpTimeout' was changed from 'null' to '60000' [21:12:02] : [Step 4/5] [2021-11-19 21:12:02,666][INFO ][disco-notifier-worker-#23079%grid-0%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpThreshold' was changed from 'null' to '0' [21:12:02] : [Step 4/5] [2021-11-19 21:12:02,667][INFO ][disco-notifier-worker-#23079%grid-0%][IgniteTxManager] Transactions parameter 'transactionTimeDumpSamplesCoefficient' was changed from 'null' to '0.0' [21:12:02] : [Step 4/5] [2021-11-19 21:12:02,667][INFO ][disco-notifier-worker-#23079%grid-0%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpSamplesPerSecondLimit' was changed from 'null' to '5' [21:12:02] : [Step 4/5] [2021-11-19 21:12:02,668][INFO ][disco-notifier-worker-#23079%grid-0%][IgniteTxManager] Transactions parameter 'collisionsDumpInterval' was changed from 'null' to '1000' [21:12:02] : [Step 4/5] [2021-11-19 21:12:02,668][INFO ][disco-notifier-worker-#23079%grid-0%][IgniteTxManager] Transactions parameter 'txOwnerDumpRequestsAllowed' was changed from 'null' to 'true' [21:12:02] : [Step 4/5] [2021-11-19 21:12:02,669][INFO ][disco-notifier-worker-#23079%grid-0%][GridCacheDatabaseSharedManager] Historical rebalance WAL threshold changed [property=historical.rebalance.threshold, oldVal=null, newVal=500] [21:12:02] : [Step 4/5] [2021-11-19 21:12:02,678][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] To start Console Management & Monitoring run ignitevisorcmd.{sh|bat} [21:12:02] : [Step 4/5] [2021-11-19 21:12:02,678][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] [21:12:02] : [Step 4/5] [21:12:02] : [Step 4/5] >>> +-------------------------------------------+ [21:12:02] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:12:02] : [Step 4/5] >>> +-------------------------------------------+ [21:12:02] : [Step 4/5] >>> OS name: Linux 4.15.0-151-generic amd64 [21:12:02] : [Step 4/5] >>> CPU(s): 24 [21:12:02] : [Step 4/5] >>> Heap: 2.0GB [21:12:02] : [Step 4/5] >>> VM name: 16724@c4dfe9a430b2 [21:12:02] : [Step 4/5] >>> Ignite instance name: grid-0 [21:12:02] : [Step 4/5] >>> Local node [ID=00B082F3-DA49-47E4-B5F4-83C3167A5000, order=1, clientMode=false] [21:12:02] : [Step 4/5] >>> Local node addresses: [127.0.0.1] [21:12:02] : [Step 4/5] >>> Local ports: TCP:10800 TCP:47100 TCP:47500 [21:12:02] : [Step 4/5] [21:12:02] : [Step 4/5] [2021-11-19 21:12:02,679][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] >>> Ignite cluster is in INACTIVE state (limited functionality available). Use control.(sh|bat) script or IgniteCluster.state(ClusterState.ACTIVE) to change the state. [21:12:02] : [Step 4/5] [2021-11-19 21:12:02,680][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][GridDiscoveryManager] Topology snapshot [ver=1, locNode=00b082f3, servers=1, clients=0, state=INACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=00b082f3-da49-47e4-b5f4-83c3167a5000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:12:02] : [Step 4/5] [2021-11-19 21:12:02,681][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][G] Node started : [stage="Configure system pool" (0 ms),stage="Start managers" (226 ms),stage="Configure binary metadata" (2 ms),stage="Start processors" (34 ms),stage="Start 'StanByClusterTestProvider' plugin" (0 ms),stage="Start 'PageMemory tracker plugin' plugin" (0 ms),stage="Start 'TestDistibutedConfigurationPlugin' plugin" (0 ms),stage="Start 'NodeValidationPluginProvider' plugin" (0 ms),stage="Init metastore" (25 ms),stage="Init and start regions" (7 ms),stage="Restore binary memory" (17 ms),stage="Restore logical state" (12 ms),stage="Finish recovery" (22 ms),stage="Join topology" (13 ms),stage="Await transition" (5 ms),stage="Await exchange" (19 ms),stage="Total time" (382 ms)] [21:12:02] : [Step 4/5] [2021-11-19 21:12:02,682][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][root] Node started with the following configuration [id=00b082f3-da49-47e4-b5f4-83c3167a5000, marshaller=BinaryMarshaller [], discovery=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=5000, ackTimeout=5000, marsh=JdkMarshaller [clsFilter=org.apache.ignite.marshaller.MarshallerUtils$1@99b8dfa], reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], binaryCfg=null, lateAff=true] [21:12:02]W: [org.apache.ignite:ignite-core] [2021-11-19 21:12:02,688][WARN ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][G] Ignite work directory is not provided, automatically resolved to: /opt/buildagent/work/7bc1c54bc719b67c/work [21:12:02] : [Step 4/5] [2021-11-19 21:12:02,689][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] [21:12:02] : [Step 4/5] [21:12:02] : [Step 4/5] >>> __________ ________________ [21:12:02] : [Step 4/5] >>> / _/ ___/ |/ / _/_ __/ __/ [21:12:02] : [Step 4/5] >>> _/ // (7 7 // / / / / _/ [21:12:02] : [Step 4/5] >>> /___/\___/_/|_/___/ /_/ /___/ [21:12:02] : [Step 4/5] >>> [21:12:02] : [Step 4/5] >>> ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:12:02] : [Step 4/5] >>> 2021 Copyright(C) Apache Software Foundation [21:12:02] : [Step 4/5] >>> [21:12:02] : [Step 4/5] >>> Ignite documentation: http://ignite.apache.org [21:12:02] : [Step 4/5] [21:12:02] : [Step 4/5] [2021-11-19 21:12:02,690][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] Config URL: n/a [21:12:02] : [Step 4/5] [2021-11-19 21:12:02,691][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] IgniteConfiguration [igniteInstanceName=grid-1, pubPoolSize=24, svcPoolSize=24, callbackPoolSize=24, stripedPoolSize=24, sysPoolSize=24, mgmtPoolSize=4, dataStreamerPoolSize=24, utilityCachePoolSize=24, utilityCacheKeepAliveTime=60000, p2pPoolSize=2, qryPoolSize=24, buildIdxPoolSize=4, igniteHome=/opt/buildagent/work/7bc1c54bc719b67c, igniteWorkDir=/opt/buildagent/work/7bc1c54bc719b67c/work, mbeanSrv=com.sun.jmx.mbeanserver.JmxMBeanServer@6fe85038, nodeId=10403f25-63b7-4565-961b-2e17fa74f001, marsh=BinaryMarshaller [], marshLocJobs=false, daemon=false, p2pEnabled=true, netTimeout=10000, netCompressionLevel=1, sndRetryDelay=1000, sndRetryCnt=3, metricsHistSize=10000, metricsUpdateFreq=1000, metricsExpTime=9223372036854775807, discoSpi=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=0, ackTimeout=0, marsh=null, reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], segPlc=STOP, segResolveAttempts=2, waitForSegOnStart=true, allResolversPassReq=true, segChkFreq=10000, commSpi=TcpCommunicationSpi [connectGate=org.apache.ignite.spi.communication.tcp.internal.ConnectGateway@266bf7f9, ctxInitLatch=java.util.concurrent.CountDownLatch@4a46dd17[Count = 1], stopping=false, clientPool=null, nioSrvWrapper=null, stateProvider=null], evtSpi=MemoryEventStorageSpi [expireAgeMs=9223372036854775807, expireCnt=10000, filter=null], colSpi=NoopCollisionSpi [], deploySpi=LocalDeploymentSpi [], indexingSpi=org.apache.ignite.spi.indexing.noop.NoopIndexingSpi@2b75ff99, addrRslvr=null, encryptionSpi=org.apache.ignite.spi.encryption.keystore.KeystoreEncryptionSpi@2e155761, tracingSpi=org.apache.ignite.spi.tracing.NoopTracingSpi@56e748ab, clientMode=false, rebalanceThreadPoolSize=4, rebalanceTimeout=10000, rebalanceBatchesPrefetchCnt=3, rebalanceThrottle=0, rebalanceBatchSize=524288, txCfg=TransactionConfiguration [txSerEnabled=false, dfltIsolation=REPEATABLE_READ, dfltConcurrency=PESSIMISTIC, dfltTxTimeout=0, txTimeoutOnPartitionMapExchange=0, deadlockTimeout=10000, pessimisticTxLogSize=0, pessimisticTxLogLinger=10000, tmLookupClsName=null, txManagerFactory=null, useJtaSync=false], cacheSanityCheckEnabled=true, discoStartupDelay=60000, deployMode=SHARED, p2pMissedCacheSize=100, locHost=127.0.0.1, timeSrvPortBase=31100, timeSrvPortRange=100, failureDetectionTimeout=10000, sysWorkerBlockedTimeout=null, clientFailureDetectionTimeout=10000, metricsLogFreq=0, connectorCfg=null, odbcCfg=null, warmupClos=null, atomicCfg=AtomicConfiguration [seqReserveSize=1000, cacheMode=PARTITIONED, backups=1, aff=null, grpName=null], classLdr=null, sslCtxFactory=null, platformCfg=null, binaryCfg=null, memCfg=null, pstCfg=null, dsCfg=DataStorageConfiguration [sysRegionInitSize=41943040, sysRegionMaxSize=104857600, pageSize=4096, concLvl=0, dfltDataRegConf=DataRegionConfiguration [name=default, maxSize=104857600, initSize=268435456, swapPath=null, pageEvictionMode=DISABLED, pageReplacementMode=CLOCK, evictionThreshold=0.9, emptyPagesPoolSize=100, metricsEnabled=false, metricsSubIntervalCount=5, metricsRateTimeInterval=60000, persistenceEnabled=true, checkpointPageBufSize=0, lazyMemoryAllocation=true, warmUpCfg=null], dataRegions=null, storagePath=null, checkpointFreq=30000, lockWaitTime=10000, checkpointThreads=4, checkpointWriteOrder=SEQUENTIAL, walHistSize=20, maxWalArchiveSize=20971520, walSegments=10, walSegmentSize=1048576, walPath=db/wal, walArchivePath=db/wal/archive, cdcWalPath=db/wal/cdc, cdcEnabled=false, metricsEnabled=false, walMode=LOG_ONLY, walTlbSize=131072, walBuffSize=0, walFlushFreq=2000, walFsyncDelay=1000, walRecordIterBuffSize=67108864, alwaysWriteFullPages=false, fileIOFactory=org.apache.ignite.internal.processors.cache.persistence.file.AsyncFileIOFactory@4df61a96, metricsSubIntervalCnt=5, metricsRateTimeInterval=60000, walAutoArchiveAfterInactivity=-1, walForceArchiveTimeout=-1, writeThrottlingEnabled=false, walCompactionEnabled=false, walCompactionLevel=1, checkpointReadLockTimeout=null, walPageCompression=DISABLED, walPageCompressionLevel=null, dfltWarmUpCfg=null, encCfg=org.apache.ignite.configuration.EncryptionConfiguration@24641942, defragmentationThreadPoolSize=4, minWalArchiveSize=-1], snapshotPath=snapshots, activeOnStart=true, activeOnStartPropSetFlag=false, autoActivation=true, autoActivationPropSetFlag=false, clusterStateOnStart=null, sqlConnCfg=null, cliConnCfg=ClientConnectorConfiguration [host=null, port=10800, portRange=100, sockSndBufSize=0, sockRcvBufSize=0, tcpNoDelay=true, maxOpenCursorsPerConn=128, threadPoolSize=24, selectorCnt=12, idleTimeout=0, handshakeTimeout=10000, jdbcEnabled=true, odbcEnabled=true, thinCliEnabled=true, sslEnabled=false, useIgniteSslCtxFactory=true, sslClientAuth=false, sslCtxFactory=null, thinCliCfg=ThinClientConfiguration [maxActiveTxPerConn=100, maxActiveComputeTasksPerConn=0]], mvccVacuumThreadCnt=2, mvccVacuumFreq=5000, authEnabled=false, failureHnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]], commFailureRslvr=null, sqlCfg=SqlConfiguration [longQryWarnTimeout=3000, dfltQryTimeout=0, sqlQryHistSize=1000, validationEnabled=false], asyncContinuationExecutor=null] [21:12:02] : [Step 4/5] [2021-11-19 21:12:02,700][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] Daemon mode: off [21:12:02] : [Step 4/5] [2021-11-19 21:12:02,700][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] OS: Linux 4.15.0-151-generic amd64 [21:12:02] : [Step 4/5] [2021-11-19 21:12:02,701][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] OS user: teamcity [21:12:02] : [Step 4/5] [2021-11-19 21:12:02,701][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] PID: 16724 [21:12:02] : [Step 4/5] [2021-11-19 21:12:02,701][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] Language runtime: Java Platform API Specification ver. 1.8 [21:12:02] : [Step 4/5] [2021-11-19 21:12:02,702][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] VM information: Java(TM) SE Runtime Environment 1.8.0_261-b12 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 25.261-b12 [21:12:02] : [Step 4/5] [2021-11-19 21:12:02,702][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] VM total memory: 1.9GB [21:12:02] : [Step 4/5] [2021-11-19 21:12:02,702][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] Remote Management [restart: off, REST: off, JMX (remote: off)] [21:12:02] : [Step 4/5] [2021-11-19 21:12:02,703][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] Logger: GridTestLog4jLogger [quiet=false, config=null] [21:12:02] : [Step 4/5] [2021-11-19 21:12:02,703][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] IGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c [21:12:02] : [Step 4/5] [2021-11-19 21:12:02,703][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] VM arguments: [-DIGNITE_DUMP_THREADS_ON_FAILURE=false, -DMono=/usr/bin/mono-sgen, -DMono4.0_x64=/usr/lib/mono/4.0, -DMono4.5_x64=/usr/lib/mono/4.5, -DMonoVersion=6.12.0.90, -DSKIP_BUILD=false, -Dagent.home.dir=/opt/buildagent, -Dagent.name=aitc-lin02_03, -Dagent.ownPort=9090, -Dagent.work.dir=/opt/buildagent/work, -Dbuild.number=95, -Dbuild.vcs.number=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.1=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.GitHubApacheIgnite=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dclassworlds.conf=/opt/buildagent/temp/buildTmp/teamcity.m2.conf, -Dcom.jetbrains.maven.watcher.report.file=/opt/buildagent/temp/buildTmp/maven-build-info.xml, -Djava.io.tmpdir=/opt/buildagent/temp/buildTmp, -Dmaven.home=/opt/buildagent/tools/maven3_6, -Dmaven.multiModuleProjectDirectory=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.agent.cpuBenchmark=457, -Dteamcity.agent.dotnet.agent_url=http://localhost:9090/RPC2, -Dteamcity.agent.dotnet.build_id=6278078, -Dteamcity.auth.password=*******, -Dteamcity.auth.userId=TeamCityBuildId=6278078, -Dteamcity.build.changedFiles.file=/opt/buildagent/temp/buildTmp/changedFiles6342607772318147725.txt, -Dteamcity.build.checkoutDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.build.id=6278078, -Dteamcity.build.properties.file=/opt/buildagent/temp/buildTmp/teamcity.build5164517880467851002.properties, -Dteamcity.build.tempDir=/opt/buildagent/temp/buildTmp, -Dteamcity.build.workingDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.buildConfName=Basic 3, -Dteamcity.buildType.id=IgniteTests24Java8_Basic3, -Dteamcity.configuration.properties.file=/opt/buildagent/temp/buildTmp/teamcity.config5591980786735343870.properties, -Dteamcity.maven.userSettings.path=/opt/buildagent/temp/buildTmp/maven_settings_585072866407032347.xml, -Dteamcity.maven.watcher.home=/opt/buildagent/plugins/mavenPlugin/maven-watcher-jdk16, -Dteamcity.projectName=Ignite Tests 2.x (JDK 8/11), -Dteamcity.runner.properties.file=/opt/buildagent/temp/buildTmp/teamcity.runner9098465561618137420.properties, -Dteamcity.tests.recentlyFailedTests.file=/opt/buildagent/temp/buildTmp/testsToRunFirst3891775683130404069.txt, -Dteamcity.version=2021.2 (build 99542), -ea, -Xms2g, -Xmx2g, -XX:+HeapDumpOnOutOfMemoryError, -DIGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_TEST_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_UPDATE_NOTIFIER=false, -DIGNITE_NO_DISCO_ORDER=true, -DIGNITE_PERFORMANCE_SUGGESTIONS_DISABLED=true, -Djava.net.preferIPv4Stack=true, -DTEST_SCALE_FACTOR=1.0, -DIGNITE_TEST_PROP_LOG4J_FILE=log4j-tc-test.xml, -DIGNITE_QUIET=false, -DIGNITE_MARSHAL_BUFFERS_RECHECK=1000, -Dmaven.repo.local=/opt/buildagent/.m2/repository] [21:12:02] : [Step 4/5] [2021-11-19 21:12:02,708][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] System cache's DataRegion size is configured to 40 MB. Use DataStorageConfiguration.systemRegionInitialSize property to change the setting. [21:12:02] : [Step 4/5] [2021-11-19 21:12:02,708][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] Configured caches [in 'sysMemPlc' dataRegion: ['ignite-sys-cache']] [21:12:02]W: [org.apache.ignite:ignite-core] [2021-11-19 21:12:02,709][WARN ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] Peer class loading is enabled (disable it in production for performance and deployment consistency reasons) [21:12:02] : [Step 4/5] [2021-11-19 21:12:02,709][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] 3-rd party licenses can be found at: /opt/buildagent/work/7bc1c54bc719b67c/libs/licenses [21:12:02] : [Step 4/5] [2021-11-19 21:12:02,713][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] Configured plugins: [21:12:02] : [Step 4/5] [2021-11-19 21:12:02,713][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- StanByClusterTestProvider 1.0 [21:12:02] : [Step 4/5] [2021-11-19 21:12:02,714][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:12:02] : [Step 4/5] [2021-11-19 21:12:02,714][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] [21:12:02] : [Step 4/5] [2021-11-19 21:12:02,714][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- PageMemory tracker plugin 1.0 [21:12:02] : [Step 4/5] [2021-11-19 21:12:02,714][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:12:02] : [Step 4/5] [2021-11-19 21:12:02,714][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] [21:12:02] : [Step 4/5] [2021-11-19 21:12:02,715][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- TestDistibutedConfigurationPlugin 1.0 [21:12:02] : [Step 4/5] [2021-11-19 21:12:02,715][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:12:02] : [Step 4/5] [2021-11-19 21:12:02,715][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] [21:12:02] : [Step 4/5] [2021-11-19 21:12:02,715][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- NodeValidationPluginProvider 1.0 [21:12:02] : [Step 4/5] [2021-11-19 21:12:02,715][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:12:02] : [Step 4/5] [2021-11-19 21:12:02,716][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] [21:12:02] : [Step 4/5] [2021-11-19 21:12:02,716][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][FailureProcessor] Configured failure handler: [hnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]]] [21:12:02] : [Step 4/5] [2021-11-19 21:12:02,760][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][TestRecordingCommunicationSpi] Successfully bound communication NIO server to TCP port [port=47101, locHost=/127.0.0.1, selectorsCnt=12, selectorSpins=0, pairedConn=false] [21:12:02]W: [org.apache.ignite:ignite-core] [2021-11-19 21:12:02,760][WARN ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][TestRecordingCommunicationSpi] Message queue limit is set to 0 which may lead to potential OOMEs when running cache operations in FULL_ASYNC or PRIMARY_SYNC modes due to message queues growth on sender and receiver sides. [21:12:02] : [Step 4/5] [2021-11-19 21:12:02,774][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][GridCollisionManager] Collision resolution is disabled (all jobs will be activated upon arrival). [21:12:02] : [Step 4/5] [2021-11-19 21:12:02,774][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] Security status [authentication=off, sandbox=off, tls/ssl=off] [21:12:02] : [Step 4/5] [2021-11-19 21:12:02,831][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:12:02] : [Step 4/5] [2021-11-19 21:12:02,918][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][MaintenanceProcessor] Resolved store directory for node persistent data: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1 [21:12:02] : [Step 4/5] [2021-11-19 21:12:02,919][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][CacheObjectBinaryProcessorImpl] Resolved directory for serialized binary metadata: /opt/buildagent/work/7bc1c54bc719b67c/work/db/binary_meta/grid_1 [21:12:02] : [Step 4/5] [2021-11-19 21:12:02,924][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1 [21:12:02] : [Step 4/5] [2021-11-19 21:12:02,924][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][FileWriteAheadLogManager] Resolved write ahead log work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1 [21:12:02] : [Step 4/5] [2021-11-19 21:12:02,925][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][FileWriteAheadLogManager] Resolved write ahead log archive directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1 [21:12:02] : [Step 4/5] [2021-11-19 21:12:02,936][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000000.wal [21:12:02] : [Step 4/5] [2021-11-19 21:12:02,936][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][FileHandleManagerImpl] Initialized write-ahead log manager [mode=LOG_ONLY] [21:12:02] : [Step 4/5] [2021-11-19 21:12:02,943][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Configured data regions initialized successfully [total=5] [21:12:02] : [Step 4/5] [2021-11-19 21:12:02,945][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][IgniteSnapshotManager] Resolved snapshot work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/snapshots [21:12:02] : [Step 4/5] [2021-11-19 21:12:02,945][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][IgniteSnapshotManager] Resolved temp directory for snapshot creation: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1/snp [21:12:02] : [Step 4/5] [2021-11-19 21:12:02,948][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][ClientListenerProcessor] Client connector processor has started on TCP port 10801 [21:12:02] : [Step 4/5] [2021-11-19 21:12:02,950][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] Non-loopback local IPs: 172.17.0.4 [21:12:02] : [Step 4/5] [2021-11-19 21:12:02,950][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] Enabled local MACs: 0242AC110004 [21:12:02] : [Step 4/5] [2021-11-19 21:12:02,951][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:12:02] : [Step 4/5] [2021-11-19 21:12:02,952][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:12:02] : [Step 4/5] [2021-11-19 21:12:02,953][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:12:02] : [Step 4/5] [2021-11-19 21:12:02,955][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Applying lost metastore updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:12:02] : [Step 4/5] [2021-11-19 21:12:02,955][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=0 ms] [21:12:02] : [Step 4/5] [2021-11-19 21:12:02,956][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Restoring partition state for local groups. [21:12:02] : [Step 4/5] [2021-11-19 21:12:02,956][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=0, partitionsProcessed=0, time=0ms] [21:12:02] : [Step 4/5] [2021-11-19 21:12:02,957][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][GridEncryptionManager] Encryption keys loaded from metastore. [grps=, masterKeyName=ignite.master.key] [21:12:02] : [Step 4/5] [2021-11-19 21:12:02,959][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][ClusterProcessor] Cluster ID and tag has been read from metastorage: null [21:12:02] : [Step 4/5] [2021-11-19 21:12:02,959][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][IgniteClusterImpl] Shutdown policy was updated [oldVal=null, newVal=null] [21:12:02] : [Step 4/5] [2021-11-19 21:12:02,959][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Checkpoint frequency deviation changed [oldVal=null, newVal=null] [21:12:02] : [Step 4/5] [2021-11-19 21:12:02,969][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][FilePageStoreManager] Cleanup cache stores [total=1, left=0, cleanFiles=false] [21:12:02] : [Step 4/5] [2021-11-19 21:12:02,971][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:12:02] : [Step 4/5] [2021-11-19 21:12:02,972][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:12:02] : [Step 4/5] [2021-11-19 21:12:02,974][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:12:02] : [Step 4/5] [2021-11-19 21:12:02,975][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Data Regions Started: 5 [21:12:02] : [Step 4/5] [2021-11-19 21:12:02,975][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] ^-- sysMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:12:02] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:12:02] : [Step 4/5] ^-- default region [type=default, persistence=true, lazyAlloc=true, [21:12:02] : [Step 4/5] ... initCfg=100MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB, allocTotal=0MB] [21:12:02] : [Step 4/5] ^-- metastoreMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:12:02] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:12:02] : [Step 4/5] ^-- TxLog region [type=internal, persistence=true, lazyAlloc=false, [21:12:02] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:12:02] : [Step 4/5] ^-- volatileDsMemPlc region [type=user, persistence=false, lazyAlloc=true, [21:12:02] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB] [21:12:02] : [Step 4/5] ^-- Ignite persistence [used=0MB] [21:12:02] : [Step 4/5] [21:12:02] : [Step 4/5] [2021-11-19 21:12:02,977][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Starting binary memory restore for: [-2100569601] [21:12:02] : [Step 4/5] [2021-11-19 21:12:02,985][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:12:02] : [Step 4/5] [2021-11-19 21:12:02,985][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:12:02] : [Step 4/5] [2021-11-19 21:12:02,989][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000000.wal, offset=0, ver=2] [21:12:02] : [Step 4/5] [2021-11-19 21:12:02,992][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Started cache in recovery mode [name=ignite-sys-cache, id=-2100569601, dataRegionName=sysMemPlc, mode=REPLICATED, atomicity=TRANSACTIONAL, backups=2147483647, mvcc=false] [21:12:02] : [Step 4/5] [2021-11-19 21:12:02,992][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Binary recovery performed in 15 ms. [21:12:02] : [Step 4/5] [2021-11-19 21:12:02,993][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:12:02] : [Step 4/5] [2021-11-19 21:12:02,993][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Applying lost cache updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:12:02] : [Step 4/5] [2021-11-19 21:12:02,995][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=10 ms] [21:12:02] : [Step 4/5] [2021-11-19 21:12:02,995][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Restoring partition state for local groups. [21:12:03] : [Step 4/5] [2021-11-19 21:12:03,000][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=1, partitionsProcessed=100, time=0ms] [21:12:03] : [Step 4/5] [2021-11-19 21:12:03,023][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][TestTcpDiscoverySpi] Successfully bound to TCP port [port=47501, localHost=localhost/127.0.0.1, locNodeId=10403f25-63b7-4565-961b-2e17fa74f001] [21:12:03] : [Step 4/5] [2021-11-19 21:12:03,026][INFO ][tcp-disco-srvr-[:47500]-#1211%grid-0%-#23081%grid-0%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=47449] [21:12:03] : [Step 4/5] [2021-11-19 21:12:03,026][INFO ][tcp-disco-srvr-[:47500]-#1211%grid-0%-#23081%grid-0%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=47449] [21:12:03] : [Step 4/5] [2021-11-19 21:12:03,027][INFO ][tcp-disco-sock-reader-[]-#1217%grid-0%-#23201%grid-0%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:47449, rmtPort=47449] [21:12:03] : [Step 4/5] [2021-11-19 21:12:03,029][INFO ][tcp-disco-sock-reader-[10403f25 127.0.0.1:47449]-#1217%grid-0%-#23201%grid-0%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=10403f25-63b7-4565-961b-2e17fa74f001, rmtAddr=/127.0.0.1:47449] [21:12:03] : [Step 4/5] [2021-11-19 21:12:03,034][INFO ][tcp-disco-srvr-[:47501]-#1216%grid-1%-#23200%grid-1%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=34621] [21:12:03] : [Step 4/5] [2021-11-19 21:12:03,034][INFO ][tcp-disco-srvr-[:47501]-#1216%grid-1%-#23200%grid-1%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=34621] [21:12:03] : [Step 4/5] [2021-11-19 21:12:03,034][INFO ][tcp-disco-sock-reader-[]-#1218%grid-1%-#23202%grid-1%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:34621, rmtPort=34621] [21:12:03] : [Step 4/5] [2021-11-19 21:12:03,035][INFO ][tcp-disco-sock-reader-[]-#1218%grid-1%-#23202%grid-1%][TestTcpDiscoverySpi] Received ping request from the remote node [rmtNodeId=00b082f3-da49-47e4-b5f4-83c3167a5000, rmtAddr=/127.0.0.1:34621, rmtPort=34621] [21:12:03] : [Step 4/5] [2021-11-19 21:12:03,036][INFO ][tcp-disco-sock-reader-[]-#1218%grid-1%-#23202%grid-1%][TestTcpDiscoverySpi] Finished writing ping response [rmtNodeId=00b082f3-da49-47e4-b5f4-83c3167a5000, rmtAddr=/127.0.0.1:34621, rmtPort=34621] [21:12:03]W: [org.apache.ignite:ignite-core] [2021-11-19 21:12:03,036][WARN ][tcp-disco-sock-reader-[]-#1218%grid-1%-#23202%grid-1%][TestTcpDiscoverySpi] Failed to shutdown socket [21:12:03]W: [org.apache.ignite:ignite-core] java.net.SocketException: Socket output is already shutdown [21:12:03]W: [org.apache.ignite:ignite-core] at java.net.Socket.shutdownOutput(Socket.java:1572) [21:12:03]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.close(IgniteUtils.java:4247) [21:12:03]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.discovery.tcp.ServerImpl$SocketReader.body(ServerImpl.java:7370) [21:12:03] : [Step 4/5] [2021-11-19 21:12:03,036][INFO ][tcp-disco-sock-reader-[10403f25 127.0.0.1:47449]-#1217%grid-0%-#23201%grid-0%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:47449, rmtPort=47449, rmtNodeId=10403f25-63b7-4565-961b-2e17fa74f001] [21:12:03]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.IgniteSpiThread.run(IgniteSpiThread.java:58) [21:12:03] : [Step 4/5] [2021-11-19 21:12:03,038][INFO ][tcp-disco-sock-reader-[]-#1218%grid-1%-#23202%grid-1%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:34621, rmtPort=34621, rmtNodeId=null] [21:12:03] : [Step 4/5] [2021-11-19 21:12:03,039][INFO ][tcp-disco-msg-worker-[crd]-#1210%grid-0%-#23080%grid-0%][GridEncryptionManager] Joining node doesn't have stored group keys [node=10403f25-63b7-4565-961b-2e17fa74f001] [21:12:03] : [Step 4/5] [2021-11-19 21:12:03,047][INFO ][tcp-disco-msg-worker-[crd]-#1210%grid-0%-#23080%grid-0%][TestTcpDiscoverySpi] New next node [newNext=TcpDiscoveryNode [id=10403f25-63b7-4565-961b-2e17fa74f001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=0, intOrder=2, lastExchangeTime=1637345523025, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false]] [21:12:03] : [Step 4/5] [2021-11-19 21:12:03,048][INFO ][tcp-disco-srvr-[:47501]-#1216%grid-1%-#23200%grid-1%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=56801] [21:12:03] : [Step 4/5] [2021-11-19 21:12:03,049][INFO ][tcp-disco-srvr-[:47501]-#1216%grid-1%-#23200%grid-1%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=56801] [21:12:03] : [Step 4/5] [2021-11-19 21:12:03,049][INFO ][tcp-disco-sock-reader-[]-#1219%grid-1%-#23203%grid-1%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:56801, rmtPort=56801] [21:12:03] : [Step 4/5] [2021-11-19 21:12:03,050][INFO ][tcp-disco-sock-reader-[00b082f3 127.0.0.1:56801]-#1219%grid-1%-#23203%grid-1%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=00b082f3-da49-47e4-b5f4-83c3167a5000, rmtAddr=/127.0.0.1:56801] [21:12:03] : [Step 4/5] [2021-11-19 21:12:03,054][INFO ][tcp-disco-msg-worker-[]-#1215%grid-1%-#23199%grid-1%][TestTcpDiscoverySpi] New next node [newNext=TcpDiscoveryNode [id=00b082f3-da49-47e4-b5f4-83c3167a5000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345523045, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false]] [21:12:03] : [Step 4/5] [2021-11-19 21:12:03,055][INFO ][tcp-disco-srvr-[:47500]-#1211%grid-0%-#23081%grid-0%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=38863] [21:12:03] : [Step 4/5] [2021-11-19 21:12:03,055][INFO ][tcp-disco-srvr-[:47500]-#1211%grid-0%-#23081%grid-0%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=38863] [21:12:03] : [Step 4/5] [2021-11-19 21:12:03,056][INFO ][tcp-disco-sock-reader-[]-#1220%grid-0%-#23204%grid-0%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:38863, rmtPort=38863] [21:12:03] : [Step 4/5] [2021-11-19 21:12:03,057][INFO ][tcp-disco-sock-reader-[10403f25 127.0.0.1:38863]-#1220%grid-0%-#23204%grid-0%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=10403f25-63b7-4565-961b-2e17fa74f001, rmtAddr=/127.0.0.1:38863] [21:12:03] : [Step 4/5] [2021-11-19 21:12:03,059][INFO ][disco-event-worker-#23083%grid-0%][GridDiscoveryManager] Added new node to topology: TcpDiscoveryNode [id=10403f25-63b7-4565-961b-2e17fa74f001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637345523025, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false] [21:12:03] : [Step 4/5] [2021-11-19 21:12:03,060][INFO ][disco-event-worker-#23083%grid-0%][GridDiscoveryManager] Topology snapshot [ver=2, locNode=00b082f3, servers=2, clients=0, state=INACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=00b082f3-da49-47e4-b5f4-83c3167a5000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=10403f25-63b7-4565-961b-2e17fa74f001, consistentId=grid-1, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:12:03] : [Step 4/5] [2021-11-19 21:12:03,063][INFO ][tcp-disco-msg-worker-[00b082f3 127.0.0.1:47500]-#1215%grid-1%-#23199%grid-1%][ClusterProcessor] zealous_brahmagupta [21:12:03] : [Step 4/5] [2021-11-19 21:12:03,063][INFO ][tcp-disco-msg-worker-[00b082f3 127.0.0.1:47500]-#1215%grid-1%-#23199%grid-1%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustEnabled' was changed from 'null' to 'false' [21:12:03] : [Step 4/5] [2021-11-19 21:12:03,063][INFO ][tcp-disco-msg-worker-[00b082f3 127.0.0.1:47500]-#1215%grid-1%-#23199%grid-1%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustTimeout' was changed from 'null' to '300000' [21:12:03] : [Step 4/5] [2021-11-19 21:12:03,064][INFO ][tcp-disco-msg-worker-[00b082f3 127.0.0.1:47500]-#1215%grid-1%-#23199%grid-1%][IgniteTxManager] Transactions parameter 'longOperationsDumpTimeout' was changed from 'null' to '60000' [21:12:03] : [Step 4/5] [2021-11-19 21:12:03,064][INFO ][tcp-disco-msg-worker-[00b082f3 127.0.0.1:47500]-#1215%grid-1%-#23199%grid-1%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpThreshold' was changed from 'null' to '0' [21:12:03] : [Step 4/5] [2021-11-19 21:12:03,065][INFO ][tcp-disco-msg-worker-[00b082f3 127.0.0.1:47500]-#1215%grid-1%-#23199%grid-1%][IgniteTxManager] Transactions parameter 'transactionTimeDumpSamplesCoefficient' was changed from 'null' to '0.0' [21:12:03] : [Step 4/5] [2021-11-19 21:12:03,065][INFO ][tcp-disco-msg-worker-[00b082f3 127.0.0.1:47500]-#1215%grid-1%-#23199%grid-1%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpSamplesPerSecondLimit' was changed from 'null' to '5' [21:12:03] : [Step 4/5] [2021-11-19 21:12:03,065][INFO ][tcp-disco-msg-worker-[00b082f3 127.0.0.1:47500]-#1215%grid-1%-#23199%grid-1%][IgniteTxManager] Transactions parameter 'collisionsDumpInterval' was changed from 'null' to '1000' [21:12:03] : [Step 4/5] [2021-11-19 21:12:03,066][INFO ][tcp-disco-msg-worker-[00b082f3 127.0.0.1:47500]-#1215%grid-1%-#23199%grid-1%][IgniteTxManager] Transactions parameter 'txOwnerDumpRequestsAllowed' was changed from 'null' to 'true' [21:12:03] : [Step 4/5] [2021-11-19 21:12:03,066][INFO ][tcp-disco-msg-worker-[00b082f3 127.0.0.1:47500]-#1215%grid-1%-#23199%grid-1%][GridCacheDatabaseSharedManager] Historical rebalance WAL threshold changed [property=historical.rebalance.threshold, oldVal=null, newVal=500] [21:12:03] : [Step 4/5] [2021-11-19 21:12:03,067][INFO ][disco-notifier-worker-#23198%grid-1%][MvccProcessorImpl] Assigned mvcc coordinator [crd=MvccCoordinator [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=0], nodeId=00b082f3-da49-47e4-b5f4-83c3167a5000, ver=1637345522643, local=false, initialized=false]] [21:12:03] : [Step 4/5] [2021-11-19 21:12:03,068][INFO ][sys-#23181%grid-1%][ClusterProcessor] Writing cluster ID and tag to metastorage on ready for write ClusterIdAndTag [id=3db7b4a7-4406-4d31-aef1-c8efa56d8f47, tag=zealous_brahmagupta] [21:12:03] : [Step 4/5] [2021-11-19 21:12:03,080][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] To start Console Management & Monitoring run ignitevisorcmd.{sh|bat} [21:12:03] : [Step 4/5] [2021-11-19 21:12:03,080][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] [21:12:03] : [Step 4/5] [21:12:03] : [Step 4/5] >>> +-------------------------------------------+ [21:12:03] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:12:03] : [Step 4/5] >>> +-------------------------------------------+ [21:12:03] : [Step 4/5] >>> OS name: Linux 4.15.0-151-generic amd64 [21:12:03] : [Step 4/5] >>> CPU(s): 24 [21:12:03] : [Step 4/5] >>> Heap: 2.0GB [21:12:03] : [Step 4/5] >>> VM name: 16724@c4dfe9a430b2 [21:12:03] : [Step 4/5] >>> Ignite instance name: grid-1 [21:12:03] : [Step 4/5] >>> Local node [ID=10403F25-63B7-4565-961B-2E17FA74F001, order=2, clientMode=false] [21:12:03] : [Step 4/5] >>> Local node addresses: [127.0.0.1] [21:12:03] : [Step 4/5] >>> Local ports: TCP:10801 TCP:47101 TCP:47501 [21:12:03] : [Step 4/5] [21:12:03] : [Step 4/5] [2021-11-19 21:12:03,081][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] >>> Ignite cluster is in INACTIVE state (limited functionality available). Use control.(sh|bat) script or IgniteCluster.state(ClusterState.ACTIVE) to change the state. [21:12:03] : [Step 4/5] [2021-11-19 21:12:03,082][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][GridDiscoveryManager] Topology snapshot [ver=2, locNode=10403f25, servers=2, clients=0, state=INACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=00b082f3-da49-47e4-b5f4-83c3167a5000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=10403f25-63b7-4565-961b-2e17fa74f001, consistentId=grid-1, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:12:03] : [Step 4/5] [2021-11-19 21:12:03,083][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][G] Node started : [stage="Configure system pool" (0 ms),stage="Start managers" (230 ms),stage="Configure binary metadata" (2 ms),stage="Start processors" (28 ms),stage="Start 'StanByClusterTestProvider' plugin" (0 ms),stage="Start 'PageMemory tracker plugin' plugin" (0 ms),stage="Start 'TestDistibutedConfigurationPlugin' plugin" (0 ms),stage="Start 'NodeValidationPluginProvider' plugin" (0 ms),stage="Init metastore" (19 ms),stage="Init and start regions" (7 ms),stage="Restore binary memory" (15 ms),stage="Restore logical state" (7 ms),stage="Finish recovery" (21 ms),stage="Join topology" (45 ms),stage="Await transition" (2 ms),stage="Await exchange" (13 ms),stage="Total time" (389 ms)] [21:12:03] : [Step 4/5] [2021-11-19 21:12:03,084][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][root] Node started with the following configuration [id=10403f25-63b7-4565-961b-2e17fa74f001, marshaller=BinaryMarshaller [], discovery=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=5000, ackTimeout=5000, marsh=JdkMarshaller [clsFilter=org.apache.ignite.marshaller.MarshallerUtils$1@52b3db74], reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], binaryCfg=null, lateAff=true] [21:12:03] : [Step 4/5] [2021-11-19 21:12:03,086][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][GridClusterStateProcessor] Sending activate cluster request with BaselineTopology BaselineTopology [id=0, branchingHash=-2475315501, branchingType='New BaselineTopology', baselineNodes=[grid-1, grid-0]] [21:12:03] : [Step 4/5] [2021-11-19 21:12:03,090][INFO ][disco-notifier-worker-#23079%grid-0%][GridClusterStateProcessor] Received activate cluster request with BaselineTopology[id=0] initiator node ID: 00b082f3-da49-47e4-b5f4-83c3167a5000 [21:12:03] : [Step 4/5] [2021-11-19 21:12:03,091][INFO ][disco-notifier-worker-#23079%grid-0%][GridClusterStateProcessor] Started state transition: activate cluster [21:12:03] : [Step 4/5] [2021-11-19 21:12:03,091][INFO ][exchange-worker-#23084%grid-0%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], crd=true, evt=DISCOVERY_CUSTOM_EVT, evtNode=00b082f3-da49-47e4-b5f4-83c3167a5000, customEvt=ChangeGlobalStateMessage [id=8f4ad593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqId=56577880-6d67-41ab-b116-7373780ea06d, initiatingNodeId=00b082f3-da49-47e4-b5f4-83c3167a5000, state=ACTIVE, baselineTopology=BaselineTopology [id=0, branchingHash=-2475315501, branchingType='New BaselineTopology', baselineNodes=[grid-1, grid-0]], forceChangeBaselineTopology=false, timestamp=1637345523086, forceDeactivation=true], allowMerge=false, exchangeFreeSwitch=false] [21:12:03] : [Step 4/5] [2021-11-19 21:12:03,092][INFO ][disco-notifier-worker-#23198%grid-1%][GridClusterStateProcessor] Received activate cluster request with BaselineTopology[id=0] initiator node ID: 00b082f3-da49-47e4-b5f4-83c3167a5000 [21:12:03] : [Step 4/5] [2021-11-19 21:12:03,092][INFO ][exchange-worker-#23084%grid-0%][GridDhtPartitionsExchangeFuture] Start activation process [nodeId=00b082f3-da49-47e4-b5f4-83c3167a5000, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]]. New state: ACTIVE [21:12:03] : [Step 4/5] [2021-11-19 21:12:03,093][INFO ][disco-notifier-worker-#23198%grid-1%][GridClusterStateProcessor] Started state transition: activate cluster [21:12:03] : [Step 4/5] [2021-11-19 21:12:03,094][INFO ][exchange-worker-#23084%grid-0%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0 [21:12:03] : [Step 4/5] [2021-11-19 21:12:03,094][INFO ][exchange-worker-#23207%grid-1%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], crd=false, evt=DISCOVERY_CUSTOM_EVT, evtNode=00b082f3-da49-47e4-b5f4-83c3167a5000, customEvt=ChangeGlobalStateMessage [id=8f4ad593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqId=56577880-6d67-41ab-b116-7373780ea06d, initiatingNodeId=00b082f3-da49-47e4-b5f4-83c3167a5000, state=ACTIVE, baselineTopology=BaselineTopology [id=0, branchingHash=-2475315501, branchingType='New BaselineTopology', baselineNodes=[grid-1, grid-0]], forceChangeBaselineTopology=false, timestamp=1637345523086, forceDeactivation=true], allowMerge=false, exchangeFreeSwitch=false] [21:12:03] : [Step 4/5] [2021-11-19 21:12:03,096][INFO ][exchange-worker-#23084%grid-0%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000000.wal, offset=8795, ver=2] [21:12:03] : [Step 4/5] [2021-11-19 21:12:03,098][INFO ][exchange-worker-#23207%grid-1%][GridDhtPartitionsExchangeFuture] Start activation process [nodeId=10403f25-63b7-4565-961b-2e17fa74f001, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]]. New state: ACTIVE [21:12:03] : [Step 4/5] [2021-11-19 21:12:03,098][INFO ][exchange-worker-#23084%grid-0%][GridClusterStateProcessor] Writing BaselineTopology[id=0] [21:12:03] : [Step 4/5] [2021-11-19 21:12:03,101][INFO ][exchange-worker-#23207%grid-1%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1 [21:12:03] : [Step 4/5] [2021-11-19 21:12:03,102][INFO ][exchange-worker-#23084%grid-0%][GridCacheDatabaseSharedManager] Finish recovery performed in 8 ms. [21:12:03] : [Step 4/5] [2021-11-19 21:12:03,103][INFO ][exchange-worker-#23084%grid-0%][msg] Components activation performed in 10 ms. [21:12:03] : [Step 4/5] [2021-11-19 21:12:03,104][INFO ][exchange-worker-#23207%grid-1%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000000.wal, offset=8795, ver=2] [21:12:03] : [Step 4/5] [2021-11-19 21:12:03,104][INFO ][exchange-worker-#23084%grid-0%][GridCacheProcessor] Finished recovery for cache [cache=ignite-sys-cache, grp=ignite-sys-cache, startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:12:03] : [Step 4/5] [2021-11-19 21:12:03,106][INFO ][exchange-worker-#23207%grid-1%][GridClusterStateProcessor] Writing BaselineTopology[id=0] [21:12:03] : [Step 4/5] [2021-11-19 21:12:03,106][INFO ][exchange-worker-#23084%grid-0%][GridDhtPartitionsExchangeFuture] Successfully activated caches [nodeId=00b082f3-da49-47e4-b5f4-83c3167a5000, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], newState=ACTIVE] [21:12:03] : [Step 4/5] [2021-11-19 21:12:03,109][INFO ][exchange-worker-#23084%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:12:03] : [Step 4/5] [2021-11-19 21:12:03,115][INFO ][exchange-worker-#23207%grid-1%][GridCacheDatabaseSharedManager] Finish recovery performed in 14 ms. [21:12:03] : [Step 4/5] [2021-11-19 21:12:03,120][INFO ][exchange-worker-#23207%grid-1%][msg] Components activation performed in 20 ms. [21:12:03] : [Step 4/5] [2021-11-19 21:12:03,121][INFO ][exchange-worker-#23207%grid-1%][GridCacheProcessor] Finished recovery for cache [cache=ignite-sys-cache, grp=ignite-sys-cache, startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:12:03] : [Step 4/5] [2021-11-19 21:12:03,122][INFO ][exchange-worker-#23207%grid-1%][GridDhtPartitionsExchangeFuture] Successfully activated caches [nodeId=10403f25-63b7-4565-961b-2e17fa74f001, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], newState=ACTIVE] [21:12:03] : [Step 4/5] [2021-11-19 21:12:03,123][INFO ][exchange-worker-#23207%grid-1%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:12:03] : [Step 4/5] [2021-11-19 21:12:03,125][INFO ][exchange-worker-#23084%grid-0%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], crd=true] [21:12:03] : [Step 4/5] [2021-11-19 21:12:03,134][INFO ][grid-nio-worker-tcp-comm-0-#23022%TestRecordingCommunicationSpi%][TestRecordingCommunicationSpi] Accepted incoming communication connection [locAddr=/127.0.0.1:47100, rmtAddr=/127.0.0.1:34244] [21:12:03] : [Step 4/5] [2021-11-19 21:12:03,140][INFO ][grid-nio-worker-tcp-comm-0-#23141%TestRecordingCommunicationSpi%][TestRecordingCommunicationSpi] Established outgoing communication connection [locAddr=/127.0.0.1:34244, rmtAddr=/127.0.0.1:47100] [21:12:03] : [Step 4/5] [2021-11-19 21:12:03,140][INFO ][db-checkpoint-thread-#23223%grid-1%][Checkpointer] Checkpoint started [checkpointId=ad67caf4-651b-4ee3-b6ee-7734a8fee4ae, startPtr=WALPointer [idx=0, fileOff=86681, len=1963], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=7ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=0ms, pages=18, reason='node started'] [21:12:03] : [Step 4/5] [2021-11-19 21:12:03,141][INFO ][exchange-worker-#23207%grid-1%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], crd=false] [21:12:03] : [Step 4/5] [2021-11-19 21:12:03,143][INFO ][sys-#23067%grid-0%][GridDhtPartitionsExchangeFuture] Coordinator received single message [ver=AffinityTopologyVersion [topVer=2, minorTopVer=1], node=10403f25-63b7-4565-961b-2e17fa74f001, allReceived=true] [21:12:03] : [Step 4/5] [2021-11-19 21:12:03,144][INFO ][sys-#23067%grid-0%][GridDhtPartitionsExchangeFuture] finishExchangeOnCoordinator [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:12:03] : [Step 4/5] [2021-11-19 21:12:03,147][INFO ][sys-#23067%grid-0%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], err=null, rebalanced=true, wasRebalanced=false] [21:12:03] : [Step 4/5] [2021-11-19 21:12:03,149][INFO ][disco-notifier-worker-#23198%grid-1%][GridClusterStateProcessor] Received state change finish message: ACTIVE [21:12:03] : [Step 4/5] [2021-11-19 21:12:03,149][INFO ][sys-#23182%grid-1%][GridDhtPartitionsExchangeFuture] Received full message, will finish exchange [node=00b082f3-da49-47e4-b5f4-83c3167a5000, resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:12:03] : [Step 4/5] [2021-11-19 21:12:03,147][INFO ][disco-notifier-worker-#23079%grid-0%][GridClusterStateProcessor] Received state change finish message: ACTIVE [21:12:03] : [Step 4/5] [2021-11-19 21:12:03,152][INFO ][sys-#23179%grid-1%][GridCachePartitionExchangeManager] Delay process full message without exchange id (there is exchange in progress) [nodeId=00b082f3-da49-47e4-b5f4-83c3167a5000] [21:12:03] : [Step 4/5] [2021-11-19 21:12:03,152][INFO ][sys-#23067%grid-0%][GridCacheProcessor] Finish proxy initialization, cacheName=ignite-sys-cache, localNodeId=00b082f3-da49-47e4-b5f4-83c3167a5000 [21:12:03] : [Step 4/5] [2021-11-19 21:12:03,149][INFO ][disco-notifier-worker-#23198%grid-1%][GridClusterStateProcessor] Cluster state was changed from INACTIVE to ACTIVE [21:12:03] : [Step 4/5] [2021-11-19 21:12:03,153][INFO ][exchange-worker-#23084%grid-0%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=2, minorTopVer=1], force=false, evt=DISCOVERY_CUSTOM_EVT, node=00b082f3-da49-47e4-b5f4-83c3167a5000] [21:12:03] : [Step 4/5] [2021-11-19 21:12:03,153][INFO ][sys-#23077%grid-0%][DistributedBaselineConfiguration] Baseline auto-adjust is 'disabled' with timeout='300000' ms [21:12:03] : [Step 4/5] [2021-11-19 21:12:03,153][INFO ][sys-#23182%grid-1%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], err=null, rebalanced=true, wasRebalanced=false] [21:12:03] : [Step 4/5] [2021-11-19 21:12:03,152][INFO ][disco-notifier-worker-#23079%grid-0%][GridClusterStateProcessor] Cluster state was changed from INACTIVE to ACTIVE [21:12:03] : [Step 4/5] [2021-11-19 21:12:03,154][INFO ][sys-#23077%grid-0%][GridClusterStateProcessor] Successfully performed final activation steps [nodeId=00b082f3-da49-47e4-b5f4-83c3167a5000, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:12:03] : [Step 4/5] [2021-11-19 21:12:03,153][INFO ][sys-#23067%grid-0%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=00b082f3-da49-47e4-b5f4-83c3167a5000, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=00b082f3-da49-47e4-b5f4-83c3167a5000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345523147, loc=true, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:12:03] : [Step 4/5] [2021-11-19 21:12:03,157][INFO ][sys-#23182%grid-1%][GridCacheProcessor] Finish proxy initialization, cacheName=ignite-sys-cache, localNodeId=10403f25-63b7-4565-961b-2e17fa74f001 [21:12:03] : [Step 4/5] [2021-11-19 21:12:03,158][INFO ][sys-#23067%grid-0%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (1 ms), stage="Update caches registry" (11 ms), stage="Start caches" (1 ms), stage="Affinity initialization on cache group start" (0 ms), stage="Determine exchange type" (3 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (5 ms), stage="Restore partition states" (0 ms), stage="After states restored callback" (9 ms), stage="WAL history reservation" (0 ms), stage="Waiting for all single messages" (18 ms), stage="Affinity recalculation (crd)" (0 ms), stage="Collect update counters and create affinity messages" (0 ms), stage="Assign partitions states" (0 ms), stage="Validate partitions states" (0 ms), stage="Ideal affinity diff calculation (enforced)" (0 ms), stage="Apply update counters" (0 ms), stage="Full message preparing" (1 ms), stage="Full message sending" (0 ms), stage="State finish message sending" (0 ms), stage="Detect lost partitions" (2 ms), stage="Exchange done" (8 ms), stage="Total time" (59 ms), Discovery lag=3 ms, Latest started node id=10403f25-63b7-4565-961b-2e17fa74f001] [21:12:03] : [Step 4/5] [2021-11-19 21:12:03,169][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][root] awaitPartitionMapExchange finished [21:12:03] : [Step 4/5] [2021-11-19 21:12:03,169][INFO ][sys-#23182%grid-1%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=10403f25-63b7-4565-961b-2e17fa74f001, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=00b082f3-da49-47e4-b5f4-83c3167a5000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345523045, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:12:03] : [Step 4/5] [2021-11-19 21:12:03,164][INFO ][exchange-worker-#23207%grid-1%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=2, minorTopVer=1], force=false, evt=DISCOVERY_CUSTOM_EVT, node=00b082f3-da49-47e4-b5f4-83c3167a5000] [21:12:03] : [Step 4/5] [2021-11-19 21:12:03,164][INFO ][db-checkpoint-thread-#23218%grid-0%][Checkpointer] Checkpoint started [checkpointId=dc2b2e66-d34a-4b84-802f-b5e3bfe7e9dd, startPtr=WALPointer [idx=0, fileOff=86681, len=1963], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=14ms, writeCheckpointEntryDuration=25ms, splitAndSortCpPagesDuration=0ms, pages=18, reason='node started'] [21:12:03] : [Step 4/5] [2021-11-19 21:12:03,163][INFO ][sys-#23174%grid-1%][DistributedBaselineConfiguration] Baseline auto-adjust is 'disabled' with timeout='300000' ms [21:12:03] : [Step 4/5] [2021-11-19 21:12:03,172][INFO ][sys-#23182%grid-1%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (3 ms), stage="Update caches registry" (23 ms), stage="Start caches" (0 ms), stage="Affinity initialization on cache group start" (0 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Restore partition states" (0 ms), stage="After states restored callback" (8 ms), stage="WAL history reservation" (0 ms), stage="Waiting for Full message" (17 ms), stage="Affinity recalculation" (2 ms), stage="Full map updating" (0 ms), stage="Detect lost partitions" (2 ms), stage="Exchange done" (16 ms), stage="Total time" (71 ms)] [21:12:03] : [Step 4/5] [2021-11-19 21:12:03,170][INFO ][sys-#23067%grid-0%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], stage="Affinity initialization on cache group start [grp=ignite-sys-cache]" (0 ms) (parent=Affinity initialization on cache group start), stage="Affinity centralized initialization (crd) [grp=ignite-sys-cache, crd=true]" (0 ms) (parent=Determine exchange type), stage="Restore partition states [grp=ignite-sys-cache]" (0 ms) (parent=Restore partition states), stage="Affinity recalculation (partitions availability) [grp=ignite-sys-cache]" (0 ms) (parent=Ideal affinity diff calculation (enforced))] [21:12:03] : [Step 4/5] [2021-11-19 21:12:03,175][INFO ][sys-#23182%grid-1%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], stage="Affinity initialization on cache group start [grp=ignite-sys-cache]" (0 ms) (parent=Affinity initialization on cache group start), stage="Affinity centralized initialization (crd) [grp=ignite-sys-cache, crd=false]" (0 ms) (parent=Determine exchange type), stage="Restore partition states [grp=ignite-sys-cache]" (0 ms) (parent=Restore partition states), stage="Affinity applying from full message [grp=ignite-sys-cache]" (2 ms) (parent=Affinity recalculation)] [21:12:03] : [Step 4/5] [2021-11-19 21:12:03,173][INFO ][sys-#23174%grid-1%][GridClusterStateProcessor] Successfully performed final activation steps [nodeId=10403f25-63b7-4565-961b-2e17fa74f001, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:12:03] : [Step 4/5] [2021-11-19 21:12:03,180][INFO ][exchange-worker-#23207%grid-1%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], crd=false, evt=DISCOVERY_CUSTOM_EVT, evtNode=00b082f3-da49-47e4-b5f4-83c3167a5000, customEvt=DynamicCacheChangeBatch [id=c15ad593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqs=ArrayList [DynamicCacheChangeRequest [cacheName=encrypted, hasCfg=true, nodeId=00b082f3-da49-47e4-b5f4-83c3167a5000, clientStartOnly=false, stop=false, destroy=false, disabledAfterStart=false]], exchangeActions=ExchangeActions [startCaches=[encrypted], stopCaches=null, startGrps=[encrypted], stopGrps=[], resetParts=null, stateChangeRequest=null], startCaches=false], allowMerge=false, exchangeFreeSwitch=false] [21:12:03] : [Step 4/5] [2021-11-19 21:12:03,180][INFO ][exchange-worker-#23084%grid-0%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], crd=true, evt=DISCOVERY_CUSTOM_EVT, evtNode=00b082f3-da49-47e4-b5f4-83c3167a5000, customEvt=DynamicCacheChangeBatch [id=c15ad593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqs=ArrayList [DynamicCacheChangeRequest [cacheName=encrypted, hasCfg=true, nodeId=00b082f3-da49-47e4-b5f4-83c3167a5000, clientStartOnly=false, stop=false, destroy=false, disabledAfterStart=false]], exchangeActions=ExchangeActions [startCaches=[encrypted], stopCaches=null, startGrps=[encrypted], stopGrps=[], resetParts=null, stateChangeRequest=null], startCaches=false], allowMerge=false, exchangeFreeSwitch=false] [21:12:03] : [Step 4/5] [2021-11-19 21:12:03,183][INFO ][exchange-worker-#23207%grid-1%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:12:03] : [Step 4/5] [2021-11-19 21:12:03,189][INFO ][exchange-worker-#23084%grid-0%][GridCacheProcessor] Started cache [name=encrypted, id=1613773252, dataRegionName=default, mode=PARTITIONED, atomicity=ATOMIC, backups=0, mvcc=false] [21:12:03] : [Step 4/5] [2021-11-19 21:12:03,194][INFO ][exchange-worker-#23084%grid-0%][GridAffinityAssignmentCache] Local node affinity assignment distribution is not ideal [cache=encrypted, expectedPrimary=8.00, actualPrimary=0, expectedBackups=0.00, actualBackups=0, warningThreshold=50.00%] [21:12:03] : [Step 4/5] [2021-11-19 21:12:03,194][INFO ][db-checkpoint-thread-#23223%grid-1%][Checkpointer] Checkpoint finished [cpId=ad67caf4-651b-4ee3-b6ee-7734a8fee4ae, pages=18, markPos=WALPointer [idx=0, fileOff=86681, len=1963], walSegmentsCovered=[], markDuration=10ms, pagesWrite=2ms, fsync=51ms, total=63ms] [21:12:03] : [Step 4/5] [2021-11-19 21:12:03,195][INFO ][exchange-worker-#23084%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], waitTime=0ms, futInfo=NA, mode=DISTRIBUTED] [21:12:03] : [Step 4/5] [2021-11-19 21:12:03,197][INFO ][exchange-worker-#23207%grid-1%][GridCacheProcessor] Started cache [name=encrypted, id=1613773252, dataRegionName=default, mode=PARTITIONED, atomicity=ATOMIC, backups=0, mvcc=false] [21:12:03] : [Step 4/5] [2021-11-19 21:12:03,198][INFO ][exchange-worker-#23207%grid-1%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], waitTime=0ms, futInfo=NA, mode=DISTRIBUTED] [21:12:03] : [Step 4/5] [2021-11-19 21:12:03,199][INFO ][exchange-worker-#23084%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partitions release latch: ServerLatch [permits=0, pendingAcks=HashSet [], super=CompletableLatch [id=CompletableLatchUid [id=exchange, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2]]]] [21:12:03] : [Step 4/5] [2021-11-19 21:12:03,199][INFO ][exchange-worker-#23207%grid-1%][GridDhtPartitionsExchangeFuture] Finished waiting for partitions release latch: ClientLatch [coordinator=TcpDiscoveryNode [id=00b082f3-da49-47e4-b5f4-83c3167a5000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345523045, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], ackSent=true, super=CompletableLatch [id=CompletableLatchUid [id=exchange, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2]]]] [21:12:03] : [Step 4/5] [2021-11-19 21:12:03,199][INFO ][exchange-worker-#23084%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:12:03] : [Step 4/5] [2021-11-19 21:12:03,200][INFO ][exchange-worker-#23207%grid-1%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:12:03] : [Step 4/5] [2021-11-19 21:12:03,201][INFO ][exchange-worker-#23084%grid-0%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], crd=true] [21:12:03] : [Step 4/5] [2021-11-19 21:12:03,202][INFO ][exchange-worker-#23207%grid-1%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], crd=false] [21:12:03] : [Step 4/5] [2021-11-19 21:12:03,202][INFO ][sys-#23063%grid-0%][GridDhtPartitionsExchangeFuture] Coordinator received single message [ver=AffinityTopologyVersion [topVer=2, minorTopVer=2], node=10403f25-63b7-4565-961b-2e17fa74f001, allReceived=true] [21:12:03] : [Step 4/5] [2021-11-19 21:12:03,218][INFO ][sys-#23063%grid-0%][GridDhtPartitionsExchangeFuture] finishExchangeOnCoordinator [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2]] [21:12:03] : [Step 4/5] [2021-11-19 21:12:03,221][INFO ][sys-#23063%grid-0%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], err=null, rebalanced=true, wasRebalanced=true] [21:12:03] : [Step 4/5] [2021-11-19 21:12:03,222][INFO ][sys-#23175%grid-1%][GridDhtPartitionsExchangeFuture] Received full message, will finish exchange [node=00b082f3-da49-47e4-b5f4-83c3167a5000, resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2]] [21:12:03] : [Step 4/5] [2021-11-19 21:12:03,222][INFO ][sys-#23063%grid-0%][GridCacheProcessor] Finish proxy initialization, cacheName=encrypted, localNodeId=00b082f3-da49-47e4-b5f4-83c3167a5000 [21:12:03] : [Step 4/5] [2021-11-19 21:12:03,223][INFO ][sys-#23063%grid-0%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=00b082f3-da49-47e4-b5f4-83c3167a5000, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=00b082f3-da49-47e4-b5f4-83c3167a5000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345523179, loc=true, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2]] [21:12:03] : [Step 4/5] [2021-11-19 21:12:03,224][INFO ][sys-#23175%grid-1%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], err=null, rebalanced=true, wasRebalanced=true] [21:12:03] : [Step 4/5] [2021-11-19 21:12:03,223][INFO ][exchange-worker-#23084%grid-0%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=2, minorTopVer=2], force=false, evt=DISCOVERY_CUSTOM_EVT, node=00b082f3-da49-47e4-b5f4-83c3167a5000] [21:12:03] : [Step 4/5] [2021-11-19 21:12:03,226][INFO ][sys-#23175%grid-1%][GridCacheProcessor] Finish proxy initialization, cacheName=encrypted, localNodeId=10403f25-63b7-4565-961b-2e17fa74f001 [21:12:03] : [Step 4/5] [2021-11-19 21:12:03,225][INFO ][sys-#23063%grid-0%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (2 ms), stage="Update caches registry" (0 ms), stage="Start caches" (10 ms), stage="Affinity initialization on cache group start" (0 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Wait partitions release latch [latch=exchange]" (3 ms), stage="Wait partitions release [latch=exchange]" (1 ms), stage="Restore partition states" (0 ms), stage="After states restored callback" (0 ms), stage="WAL history reservation" (0 ms), stage="Waiting for all single messages" (17 ms), stage="Affinity recalculation (crd)" (0 ms), stage="Collect update counters and create affinity messages" (0 ms), stage="Assign partitions states" (0 ms), stage="Validate partitions states" (0 ms), stage="Apply update counters" (0 ms), stage="Full message preparing" (1 ms), stage="Full message sending" (0 ms), stage="Exchange done" (3 ms), stage="Total time" (37 ms)] [21:12:03] : [Step 4/5] [2021-11-19 21:12:03,226][INFO ][exchange-worker-#23207%grid-1%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=2, minorTopVer=2], force=false, evt=DISCOVERY_CUSTOM_EVT, node=00b082f3-da49-47e4-b5f4-83c3167a5000] [21:12:03] : [Step 4/5] [2021-11-19 21:12:03,226][INFO ][sys-#23175%grid-1%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=10403f25-63b7-4565-961b-2e17fa74f001, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=00b082f3-da49-47e4-b5f4-83c3167a5000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345523045, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2]] [21:12:03] : [Step 4/5] [2021-11-19 21:12:03,229][INFO ][exchange-worker-#23207%grid-1%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=3], crd=false, evt=DISCOVERY_CUSTOM_EVT, evtNode=00b082f3-da49-47e4-b5f4-83c3167a5000, customEvt=DynamicCacheChangeBatch [id=b25ad593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqs=ArrayList [DynamicCacheChangeRequest [cacheName=cache2, hasCfg=true, nodeId=00b082f3-da49-47e4-b5f4-83c3167a5000, clientStartOnly=false, stop=false, destroy=false, disabledAfterStart=false]], exchangeActions=ExchangeActions [startCaches=[cache2], stopCaches=null, startGrps=[cache2], stopGrps=[], resetParts=null, stateChangeRequest=null], startCaches=false], allowMerge=false, exchangeFreeSwitch=false] [21:12:03] : [Step 4/5] [2021-11-19 21:12:03,229][INFO ][sys-#23063%grid-0%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], stage="Affinity initialization on cache group start [grp=encrypted]" (0 ms) (parent=Affinity initialization on cache group start), stage="Restore partition states [grp=ignite-sys-cache]" (0 ms) (parent=Restore partition states), stage="Restore partition states [grp=encrypted]" (0 ms) (parent=Restore partition states)] [21:12:03] : [Step 4/5] [2021-11-19 21:12:03,232][INFO ][exchange-worker-#23207%grid-1%][GridAffinityAssignmentCache] Local node affinity assignment distribution is not ideal [cache=cache2, expectedPrimary=8.00, actualPrimary=0, expectedBackups=0.00, actualBackups=0, warningThreshold=50.00%] [21:12:03] : [Step 4/5] [2021-11-19 21:12:03,233][INFO ][exchange-worker-#23084%grid-0%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=3], crd=true, evt=DISCOVERY_CUSTOM_EVT, evtNode=00b082f3-da49-47e4-b5f4-83c3167a5000, customEvt=DynamicCacheChangeBatch [id=b25ad593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqs=ArrayList [DynamicCacheChangeRequest [cacheName=cache2, hasCfg=true, nodeId=00b082f3-da49-47e4-b5f4-83c3167a5000, clientStartOnly=false, stop=false, destroy=false, disabledAfterStart=false]], exchangeActions=ExchangeActions [startCaches=[cache2], stopCaches=null, startGrps=[cache2], stopGrps=[], resetParts=null, stateChangeRequest=null], startCaches=false], allowMerge=false, exchangeFreeSwitch=false] [21:12:03] : [Step 4/5] [2021-11-19 21:12:03,230][INFO ][sys-#23175%grid-1%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (1 ms), stage="Update caches registry" (0 ms), stage="Start caches" (16 ms), stage="Affinity initialization on cache group start" (0 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Wait partitions release latch [latch=exchange]" (1 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Restore partition states" (0 ms), stage="After states restored callback" (0 ms), stage="WAL history reservation" (0 ms), stage="Waiting for Full message" (20 ms), stage="Affinity recalculation" (0 ms), stage="Full map updating" (1 ms), stage="Exchange done" (6 ms), stage="Total time" (45 ms)] [21:12:03] : [Step 4/5] [2021-11-19 21:12:03,241][INFO ][exchange-worker-#23084%grid-0%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:12:03] : [Step 4/5] [2021-11-19 21:12:03,239][INFO ][db-checkpoint-thread-#23218%grid-0%][Checkpointer] Checkpoint finished [cpId=dc2b2e66-d34a-4b84-802f-b5e3bfe7e9dd, pages=18, markPos=WALPointer [idx=0, fileOff=86681, len=1963], walSegmentsCovered=[], markDuration=48ms, pagesWrite=1ms, fsync=65ms, total=115ms] [21:12:03] : [Step 4/5] [2021-11-19 21:12:03,233][INFO ][exchange-worker-#23207%grid-1%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=3], waitTime=0ms, futInfo=NA, mode=DISTRIBUTED] [21:12:03] : [Step 4/5] [2021-11-19 21:12:03,241][INFO ][sys-#23175%grid-1%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], stage="Affinity initialization on cache group start [grp=encrypted]" (0 ms) (parent=Affinity initialization on cache group start), stage="Restore partition states [grp=ignite-sys-cache]" (0 ms) (parent=Restore partition states), stage="Restore partition states [grp=encrypted]" (0 ms) (parent=Restore partition states)] [21:12:03] : [Step 4/5] [2021-11-19 21:12:03,246][INFO ][exchange-worker-#23084%grid-0%][GridCacheProcessor] Started cache [name=cache2, id=-1368047376, dataRegionName=default, mode=PARTITIONED, atomicity=ATOMIC, backups=0, mvcc=false] [21:12:03] : [Step 4/5] [2021-11-19 21:12:03,247][INFO ][exchange-worker-#23084%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=3], waitTime=0ms, futInfo=NA, mode=DISTRIBUTED] [21:12:03] : [Step 4/5] [2021-11-19 21:12:03,248][INFO ][exchange-worker-#23084%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partitions release latch: ServerLatch [permits=0, pendingAcks=HashSet [], super=CompletableLatch [id=CompletableLatchUid [id=exchange, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=3]]]] [21:12:03] : [Step 4/5] [2021-11-19 21:12:03,248][INFO ][exchange-worker-#23207%grid-1%][GridDhtPartitionsExchangeFuture] Finished waiting for partitions release latch: ClientLatch [coordinator=TcpDiscoveryNode [id=00b082f3-da49-47e4-b5f4-83c3167a5000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345523045, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], ackSent=true, super=CompletableLatch [id=CompletableLatchUid [id=exchange, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=3]]]] [21:12:03] : [Step 4/5] [2021-11-19 21:12:03,248][INFO ][exchange-worker-#23084%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=3], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:12:03] : [Step 4/5] [2021-11-19 21:12:03,249][INFO ][exchange-worker-#23207%grid-1%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=3], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:12:03] : [Step 4/5] [2021-11-19 21:12:03,251][INFO ][exchange-worker-#23084%grid-0%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=3], crd=true] [21:12:03] : [Step 4/5] [2021-11-19 21:12:03,251][INFO ][exchange-worker-#23207%grid-1%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=3], crd=false] [21:12:03] : [Step 4/5] [2021-11-19 21:12:03,251][INFO ][sys-#23060%grid-0%][GridDhtPartitionsExchangeFuture] Coordinator received single message [ver=AffinityTopologyVersion [topVer=2, minorTopVer=3], node=10403f25-63b7-4565-961b-2e17fa74f001, allReceived=true] [21:12:03] : [Step 4/5] [2021-11-19 21:12:03,252][INFO ][sys-#23060%grid-0%][GridDhtPartitionsExchangeFuture] finishExchangeOnCoordinator [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=3], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=3]] [21:12:03] : [Step 4/5] [2021-11-19 21:12:03,255][INFO ][sys-#23060%grid-0%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=3], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=3], err=null, rebalanced=true, wasRebalanced=true] [21:12:03] : [Step 4/5] [2021-11-19 21:12:03,256][INFO ][sys-#23176%grid-1%][GridDhtPartitionsExchangeFuture] Received full message, will finish exchange [node=00b082f3-da49-47e4-b5f4-83c3167a5000, resVer=AffinityTopologyVersion [topVer=2, minorTopVer=3]] [21:12:03] : [Step 4/5] [2021-11-19 21:12:03,257][INFO ][sys-#23060%grid-0%][GridCacheProcessor] Finish proxy initialization, cacheName=cache2, localNodeId=00b082f3-da49-47e4-b5f4-83c3167a5000 [21:12:03] : [Step 4/5] [2021-11-19 21:12:03,257][INFO ][sys-#23176%grid-1%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=3], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=3], err=null, rebalanced=true, wasRebalanced=true] [21:12:03] : [Step 4/5] [2021-11-19 21:12:03,258][INFO ][exchange-worker-#23084%grid-0%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=2, minorTopVer=3], force=false, evt=DISCOVERY_CUSTOM_EVT, node=00b082f3-da49-47e4-b5f4-83c3167a5000] [21:12:03] : [Step 4/5] [2021-11-19 21:12:03,258][INFO ][sys-#23060%grid-0%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=00b082f3-da49-47e4-b5f4-83c3167a5000, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=3], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=00b082f3-da49-47e4-b5f4-83c3167a5000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345523219, loc=true, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=2, minorTopVer=3]] [21:12:03] : [Step 4/5] [2021-11-19 21:12:03,258][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][root] Loading 10000 entries into encrypted [21:12:03] : [Step 4/5] [2021-11-19 21:12:03,260][INFO ][sys-#23060%grid-0%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=3], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=3], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (1 ms), stage="Update caches registry" (4 ms), stage="Start caches" (7 ms), stage="Affinity initialization on cache group start" (0 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Wait partitions release latch [latch=exchange]" (0 ms), stage="Wait partitions release [latch=exchange]" (1 ms), stage="Restore partition states" (0 ms), stage="After states restored callback" (0 ms), stage="WAL history reservation" (0 ms), stage="Waiting for all single messages" (0 ms), stage="Affinity recalculation (crd)" (0 ms), stage="Collect update counters and create affinity messages" (0 ms), stage="Assign partitions states" (0 ms), stage="Validate partitions states" (1 ms), stage="Apply update counters" (0 ms), stage="Full message preparing" (1 ms), stage="Full message sending" (0 ms), stage="Exchange done" (4 ms), stage="Total time" (19 ms), Discovery lag=4 ms, Latest started node id=00b082f3-da49-47e4-b5f4-83c3167a5000] [21:12:03] : [Step 4/5] [2021-11-19 21:12:03,258][INFO ][exchange-worker-#23207%grid-1%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=2, minorTopVer=3], force=false, evt=DISCOVERY_CUSTOM_EVT, node=00b082f3-da49-47e4-b5f4-83c3167a5000] [21:12:03] : [Step 4/5] [2021-11-19 21:12:03,258][INFO ][sys-#23176%grid-1%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=10403f25-63b7-4565-961b-2e17fa74f001, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=3], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=00b082f3-da49-47e4-b5f4-83c3167a5000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345523045, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=2, minorTopVer=3]] [21:12:03] : [Step 4/5] [2021-11-19 21:12:03,263][INFO ][sys-#23060%grid-0%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=3], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=3], stage="Affinity initialization on cache group start [grp=cache2]" (0 ms) (parent=Affinity initialization on cache group start), stage="Restore partition states [grp=ignite-sys-cache]" (0 ms) (parent=Restore partition states), stage="Restore partition states [grp=encrypted]" (0 ms) (parent=Restore partition states), stage="Restore partition states [grp=cache2]" (0 ms) (parent=Restore partition states)] [21:12:03] : [Step 4/5] [2021-11-19 21:12:03,264][INFO ][sys-#23176%grid-1%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=3], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=3], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (1 ms), stage="Update caches registry" (0 ms), stage="Start caches" (0 ms), stage="Affinity initialization on cache group start" (1 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (9 ms), stage="Wait partitions release latch [latch=exchange]" (6 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Restore partition states" (0 ms), stage="After states restored callback" (0 ms), stage="WAL history reservation" (0 ms), stage="Waiting for Full message" (5 ms), stage="Affinity recalculation" (1 ms), stage="Full map updating" (0 ms), stage="Exchange done" (6 ms), stage="Total time" (29 ms)] [21:12:03] : [Step 4/5] [2021-11-19 21:12:03,268][INFO ][sys-#23176%grid-1%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=3], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=3], stage="Affinity initialization on cache group start [grp=cache2]" (1 ms) (parent=Affinity initialization on cache group start), stage="Restore partition states [grp=ignite-sys-cache]" (0 ms) (parent=Restore partition states), stage="Restore partition states [grp=encrypted]" (0 ms) (parent=Restore partition states)] [21:12:03] : [Step 4/5] [2021-11-19 21:12:03,377][INFO ][wal-file-archiver%grid-1-#23214%grid-1%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=0, segIdx=0, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000000.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000000.wal] [21:12:03] : [Step 4/5] [2021-11-19 21:12:03,388][INFO ][wal-file-archiver%grid-1-#23214%grid-1%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000000.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000000.wal] [21:12:03] : [Step 4/5] [2021-11-19 21:12:03,442][INFO ][wal-file-archiver%grid-1-#23214%grid-1%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=1, segIdx=1, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000001.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000001.wal] [21:12:03] : [Step 4/5] [2021-11-19 21:12:03,459][INFO ][wal-file-archiver%grid-1-#23214%grid-1%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000001.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000001.wal] [21:12:03] : [Step 4/5] [2021-11-19 21:12:03,494][INFO ][wal-file-archiver%grid-1-#23214%grid-1%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=2, segIdx=2, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000002.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000002.wal] [21:12:03] : [Step 4/5] [2021-11-19 21:12:03,505][INFO ][wal-file-archiver%grid-1-#23214%grid-1%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000002.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000002.wal] [21:12:03] : [Step 4/5] [2021-11-19 21:12:03,538][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][root] Load data finished [21:12:03] : [Step 4/5] [2021-11-19 21:12:03,547][INFO ][db-checkpoint-thread-#23223%grid-1%][Checkpointer] Checkpoint started [checkpointId=51f7fb05-6c2b-4001-a89a-c9c91e977882, startPtr=WALPointer [idx=3, fileOff=872652, len=2105], checkpointBeforeLockTime=2ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=5ms, writeCheckpointEntryDuration=2ms, splitAndSortCpPagesDuration=0ms, pages=300, reason='test'] [21:12:03] : [Step 4/5] [2021-11-19 21:12:03,654][INFO ][db-checkpoint-thread-#23223%grid-1%][Checkpointer] Checkpoint finished [cpId=51f7fb05-6c2b-4001-a89a-c9c91e977882, pages=300, markPos=WALPointer [idx=3, fileOff=872652, len=2105], walSegmentsCovered=[0 - 2], markDuration=8ms, pagesWrite=16ms, fsync=90ms, total=116ms] [21:12:03] : [Step 4/5] [2021-11-19 21:12:03,663][INFO ][db-checkpoint-thread-#23218%grid-0%][Checkpointer] Checkpoint started [checkpointId=b87efa0e-a3d5-48fc-8139-e89b3338ea2f, startPtr=WALPointer [idx=0, fileOff=113238, len=2111], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=1ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=6ms, writeCheckpointEntryDuration=2ms, splitAndSortCpPagesDuration=0ms, pages=12, reason='test'] [21:12:03] : [Step 4/5] [2021-11-19 21:12:03,688][INFO ][db-checkpoint-thread-#23218%grid-0%][Checkpointer] Checkpoint finished [cpId=b87efa0e-a3d5-48fc-8139-e89b3338ea2f, pages=12, markPos=WALPointer [idx=0, fileOff=113238, len=2111], walSegmentsCovered=[], markDuration=10ms, pagesWrite=1ms, fsync=23ms, total=34ms] [21:12:03] : [Step 4/5] [2021-11-19 21:12:03,695][INFO ][disco-notifier-worker-#23079%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=1] [21:12:03] : [Step 4/5] [2021-11-19 21:12:03,695][INFO ][disco-notifier-worker-#23198%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=1] [21:12:03] : [Step 4/5] [2021-11-19 21:12:03,695][INFO ][disco-notifier-worker-#23079%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=-1368047376, keyId=1] [21:12:03] : [Step 4/5] [2021-11-19 21:12:03,696][INFO ][disco-notifier-worker-#23198%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=-1368047376, keyId=1] [21:12:03] : [Step 4/5] [2021-11-19 21:12:03,696][INFO ][disco-notifier-worker-#23079%grid-0%][CacheGroupPageScanner] Skip reencryption, cache group doesn't exist on the local node [grp=1613773252] [21:12:03] : [Step 4/5] [2021-11-19 21:12:03,696][INFO ][disco-notifier-worker-#23198%grid-1%][CacheGroupPageScanner] Skip reencryption, cache group doesn't exist on the local node [grp=-1368047376] [21:12:03] : [Step 4/5] [2021-11-19 21:12:03,696][INFO ][reencrypt-#23241%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:12:03] : [Step 4/5] [2021-11-19 21:12:03,704][INFO ][reencrypt-#23242%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=cache2] [21:12:03] : [Step 4/5] [2021-11-19 21:12:03,705][INFO ][wal-file-archiver%grid-1-#23214%grid-1%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=3, segIdx=3, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000003.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000003.wal] [21:12:03] : [Step 4/5] [2021-11-19 21:12:03,770][INFO ][wal-file-archiver%grid-1-#23214%grid-1%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000003.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000003.wal] [21:12:03] : [Step 4/5] [2021-11-19 21:12:03,801][INFO ][wal-file-archiver%grid-1-#23214%grid-1%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=4, segIdx=4, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000004.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000004.wal] [21:12:03] : [Step 4/5] [2021-11-19 21:12:03,812][INFO ][wal-file-archiver%grid-1-#23214%grid-1%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000004.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000004.wal] [21:12:03] : [Step 4/5] [2021-11-19 21:12:03,905][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10403f25-63b7-4565-961b-2e17fa74f001, grp=1613773252] [21:12:03] : [Step 4/5] [2021-11-19 21:12:03,915][INFO ][db-checkpoint-thread-#23223%grid-1%][Checkpointer] Checkpoint started [checkpointId=d8c39cdb-069d-471a-9eac-fa0bf8513870, startPtr=WALPointer [idx=5, fileOff=33525, len=2105], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=1ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=6ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=1ms, pages=301, reason='test'] [21:12:03] : [Step 4/5] [2021-11-19 21:12:03,948][INFO ][db-checkpoint-thread-#23223%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:12:03] : [Step 4/5] [2021-11-19 21:12:03,948][INFO ][db-checkpoint-thread-#23223%grid-1%][Checkpointer] Checkpoint finished [cpId=d8c39cdb-069d-471a-9eac-fa0bf8513870, pages=301, markPos=WALPointer [idx=5, fileOff=33525, len=2105], walSegmentsCovered=[3 - 4], markDuration=9ms, pagesWrite=12ms, fsync=21ms, total=42ms] [21:12:03] : [Step 4/5] [2021-11-19 21:12:03,952][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00b082f3-da49-47e4-b5f4-83c3167a5000, grp=1613773252] [21:12:03] : [Step 4/5] [2021-11-19 21:12:03,953][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][root] Context doesn't exits on 00b082f3-da49-47e4-b5f4-83c3167a5000 [21:12:03] : [Step 4/5] [2021-11-19 21:12:03,956][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10403f25-63b7-4565-961b-2e17fa74f001, grp=-1368047376] [21:12:03] : [Step 4/5] [2021-11-19 21:12:03,956][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][root] Context doesn't exits on 10403f25-63b7-4565-961b-2e17fa74f001 [21:12:03] : [Step 4/5] [2021-11-19 21:12:03,957][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00b082f3-da49-47e4-b5f4-83c3167a5000, grp=-1368047376] [21:12:03] : [Step 4/5] [2021-11-19 21:12:03,965][INFO ][db-checkpoint-thread-#23218%grid-0%][Checkpointer] Checkpoint started [checkpointId=156caa49-ca9d-41eb-aa0d-261a49b96150, startPtr=WALPointer [idx=0, fileOff=170261, len=2111], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=1ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=6ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=0ms, pages=13, reason='test'] [21:12:03] : [Step 4/5] [2021-11-19 21:12:03,983][INFO ][db-checkpoint-thread-#23218%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=cache2] [21:12:03] : [Step 4/5] [2021-11-19 21:12:03,984][INFO ][db-checkpoint-thread-#23218%grid-0%][Checkpointer] Checkpoint finished [cpId=156caa49-ca9d-41eb-aa0d-261a49b96150, pages=13, markPos=WALPointer [idx=0, fileOff=170261, len=2111], walSegmentsCovered=[], markDuration=9ms, pagesWrite=1ms, fsync=17ms, total=27ms] [21:12:03] : [Step 4/5] [2021-11-19 21:12:03,984][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][root] >>> Stopping grid [name=grid-1, id=10403f25-63b7-4565-961b-2e17fa74f001] [21:12:03] : [Step 4/5] [2021-11-19 21:12:03,989][INFO ][db-checkpoint-thread-#23223%grid-1%][Checkpointer] Skipping checkpoint (no pages were modified) [checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, reason='timeout'] [21:12:03] : [Step 4/5] [2021-11-19 21:12:03,994][INFO ][tcp-disco-sock-reader-[00b082f3 127.0.0.1:56801]-#1219%grid-1%-#23203%grid-1%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:56801, rmtPort=56801, rmtNodeId=00b082f3-da49-47e4-b5f4-83c3167a5000] [21:12:03] : [Step 4/5] [2021-11-19 21:12:03,994][INFO ][disco-event-worker-#23083%grid-0%][GridDiscoveryManager] Node left topology: TcpDiscoveryNode [id=10403f25-63b7-4565-961b-2e17fa74f001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637345523025, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false] [21:12:03] : [Step 4/5] [2021-11-19 21:12:03,996][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Stopped cache [cacheName=ignite-sys-cache] [21:12:03] : [Step 4/5] [2021-11-19 21:12:03,996][INFO ][disco-event-worker-#23083%grid-0%][GridDiscoveryManager] Topology snapshot [ver=3, locNode=00b082f3, servers=1, clients=0, state=ACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=00b082f3-da49-47e4-b5f4-83c3167a5000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:12:03] : [Step 4/5] [2021-11-19 21:12:03,996][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Stopped cache [cacheName=encrypted] [21:12:03] : [Step 4/5] [2021-11-19 21:12:03,996][INFO ][disco-event-worker-#23083%grid-0%][GridDiscoveryManager] ^-- Baseline [id=0, size=2, online=1, offline=1] [21:12:03]W: [org.apache.ignite:ignite-core] [2021-11-19 21:12:03,997][WARN ][grid-nio-worker-tcp-comm-0-#23022%TestRecordingCommunicationSpi%][TestRecordingCommunicationSpi] Failed to shutdown socket [21:12:03]W: [org.apache.ignite:ignite-core] java.nio.channels.ClosedChannelException [21:12:03]W: [org.apache.ignite:ignite-core] at sun.nio.ch.SocketChannelImpl.shutdownOutput(SocketChannelImpl.java:795) [21:12:03]W: [org.apache.ignite:ignite-core] at sun.nio.ch.SocketAdaptor.shutdownOutput(SocketAdaptor.java:407) [21:12:04]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.close(IgniteUtils.java:4247) [21:12:04]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.closeKey(GridNioServer.java:2784) [21:12:04]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.close(GridNioServer.java:2835) [21:12:04]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.close(GridNioServer.java:2794) [21:12:04]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.bodyInternal(GridNioServer.java:2157) [21:12:04]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.body(GridNioServer.java:1910) [21:12:04]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:125) [21:12:04]W: [org.apache.ignite:ignite-core] at java.lang.Thread.run(Thread.java:748) [21:12:04] : [Step 4/5] [2021-11-19 21:12:03,999][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][FilePageStoreManager] Cleanup cache stores [total=4, left=0, cleanFiles=false] [21:12:04] : [Step 4/5] [2021-11-19 21:12:03,998][INFO ][exchange-worker-#23084%grid-0%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], crd=true, evt=NODE_LEFT, evtNode=10403f25-63b7-4565-961b-2e17fa74f001, customEvt=null, allowMerge=false, exchangeFreeSwitch=true] [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,001][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][GridDeploymentLocalStore] Removed undeployed class: GridDeployment [ts=1637345523137, depMode=SHARED, clsLdr=IsolatedClassLoader{roleName='test'}, clsLdrId=605ad593d71-10403f25-63b7-4565-961b-2e17fa74f001, userVer=0, loc=true, sampleClsName=org.apache.ignite.internal.processors.cache.distributed.dht.preloader.GridDhtPartitionFullMap, pendingUndeploy=false, undeployed=true, usage=0] [21:12:04]W: [org.apache.ignite:ignite-core] [2021-11-19 21:12:04,001][WARN ][exchange-worker-#23084%grid-0%][ExchangeDiscoveryEvents] All server nodes for the following caches have left the cluster: 'encrypted' [21:12:04]W: [org.apache.ignite:ignite-core] [2021-11-19 21:12:04,002][WARN ][exchange-worker-#23084%grid-0%][ExchangeDiscoveryEvents] Must have server nodes for caches to operate. [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,003][INFO ][sys-#23056%grid-0%][GridAffinityAssignmentCache] Local node affinity assignment distribution is not ideal [cache=encrypted, expectedPrimary=Infinity, actualPrimary=0, expectedBackups=NaN, actualBackups=0, warningThreshold=50.00%] [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,004][INFO ][exchange-worker-#23084%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,005][INFO ][exchange-worker-#23084%grid-0%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], err=null, rebalanced=true, wasRebalanced=true] [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,010][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] [21:12:04] : [Step 4/5] [21:12:04] : [Step 4/5] >>> +------------------------------------------------------+ [21:12:04] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV stopped OK [21:12:04] : [Step 4/5] >>> +------------------------------------------------------+ [21:12:04] : [Step 4/5] >>> Ignite instance name: grid-1 [21:12:04] : [Step 4/5] >>> Grid uptime: 00:00:00.926 [21:12:04] : [Step 4/5] [21:12:04] : [Step 4/5] [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,011][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][root] >>> Stopping grid [name=grid-0, id=00b082f3-da49-47e4-b5f4-83c3167a5000] [21:12:04]W: [org.apache.ignite:ignite-core] [2021-11-19 21:12:04,010][WARN ][sys-#23059%grid-0%][GridDhtPartitionTopologyImpl] Detected lost partitions [grp=encrypted, parts=[0-7], topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0]] [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,011][INFO ][exchange-worker-#23084%grid-0%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=00b082f3-da49-47e4-b5f4-83c3167a5000, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], evt=NODE_LEFT, evtNode=TcpDiscoveryNode [id=10403f25-63b7-4565-961b-2e17fa74f001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637345523025, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0]] [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,012][INFO ][exchange-worker-#23084%grid-0%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (3 ms), stage="Determine exchange type" (2 ms), stage="Preloading notification" (0 ms), stage="After states restored callback" (0 ms), stage="WAL history reservation" (0 ms), stage="Finalize update counters" (0 ms), stage="Detect lost partitions" (6 ms), stage="Exchange done" (1 ms), stage="Total time" (12 ms)] [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,013][INFO ][exchange-worker-#23084%grid-0%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], stage="Affinity initialization (exchange-free switch on fully-rebalanced topology) [grp=encrypted]" (2 ms) (parent=Determine exchange type), stage="Affinity initialization (exchange-free switch on fully-rebalanced topology) [grp=ignite-sys-cache]" (1 ms) (parent=Determine exchange type), stage="Affinity initialization (exchange-free switch on fully-rebalanced topology) [grp=cache2]" (1 ms) (parent=Determine exchange type)] [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,014][INFO ][exchange-worker-#23084%grid-0%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], crd=true] [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,015][INFO ][exchange-worker-#23084%grid-0%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=3, minorTopVer=0], force=false, evt=NODE_LEFT, node=10403f25-63b7-4565-961b-2e17fa74f001] [21:12:04]W: [org.apache.ignite:ignite-core] [2021-11-19 21:12:04,021][WARN ][tcp-disco-sock-reader-[10403f25 127.0.0.1:38863]-#1220%grid-0%-#23204%grid-0%][TestTcpDiscoverySpi] Failed to shutdown socket [21:12:04]W: [org.apache.ignite:ignite-core] java.net.SocketException: Socket is closed [21:12:04]W: [org.apache.ignite:ignite-core] at java.net.Socket.shutdownOutput(Socket.java:1568) [21:12:04]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.close(IgniteUtils.java:4247) [21:12:04]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.discovery.tcp.ServerImpl$SocketReader.body(ServerImpl.java:7370) [21:12:04]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.IgniteSpiThread.run(IgniteSpiThread.java:58) [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,022][INFO ][tcp-disco-sock-reader-[10403f25 127.0.0.1:38863]-#1220%grid-0%-#23204%grid-0%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:38863, rmtPort=38863, rmtNodeId=10403f25-63b7-4565-961b-2e17fa74f001] [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,023][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Stopped cache [cacheName=ignite-sys-cache] [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,023][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Stopped cache [cacheName=encrypted] [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,024][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Stopped cache [cacheName=cache2] [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,034][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][FilePageStoreManager] Cleanup cache stores [total=4, left=0, cleanFiles=false] [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,035][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][GridDeploymentLocalStore] Removed undeployed class: GridDeployment [ts=1637345523137, depMode=SHARED, clsLdr=IsolatedClassLoader{roleName='test'}, clsLdrId=405ad593d71-00b082f3-da49-47e4-b5f4-83c3167a5000, userVer=0, loc=true, sampleClsName=org.apache.ignite.internal.processors.cache.distributed.dht.preloader.GridDhtPartitionMap, pendingUndeploy=false, undeployed=true, usage=0] [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,042][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] [21:12:04] : [Step 4/5] [21:12:04] : [Step 4/5] >>> +------------------------------------------------------+ [21:12:04] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV stopped OK [21:12:04] : [Step 4/5] >>> +------------------------------------------------------+ [21:12:04] : [Step 4/5] >>> Ignite instance name: grid-0 [21:12:04] : [Step 4/5] >>> Grid uptime: 00:00:01.369 [21:12:04] : [Step 4/5] [21:12:04] : [Step 4/5] [21:12:04]W: [org.apache.ignite:ignite-core] [2021-11-19 21:12:04,047][WARN ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][G] Ignite work directory is not provided, automatically resolved to: /opt/buildagent/work/7bc1c54bc719b67c/work [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,050][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] [21:12:04] : [Step 4/5] [21:12:04] : [Step 4/5] >>> __________ ________________ [21:12:04] : [Step 4/5] >>> / _/ ___/ |/ / _/_ __/ __/ [21:12:04] : [Step 4/5] >>> _/ // (7 7 // / / / / _/ [21:12:04] : [Step 4/5] >>> /___/\___/_/|_/___/ /_/ /___/ [21:12:04] : [Step 4/5] >>> [21:12:04] : [Step 4/5] >>> ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:12:04] : [Step 4/5] >>> 2021 Copyright(C) Apache Software Foundation [21:12:04] : [Step 4/5] >>> [21:12:04] : [Step 4/5] >>> Ignite documentation: http://ignite.apache.org [21:12:04] : [Step 4/5] [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,050][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] Config URL: n/a [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,051][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] IgniteConfiguration [igniteInstanceName=grid-0, pubPoolSize=24, svcPoolSize=24, callbackPoolSize=24, stripedPoolSize=24, sysPoolSize=24, mgmtPoolSize=4, dataStreamerPoolSize=24, utilityCachePoolSize=24, utilityCacheKeepAliveTime=60000, p2pPoolSize=2, qryPoolSize=24, buildIdxPoolSize=4, igniteHome=/opt/buildagent/work/7bc1c54bc719b67c, igniteWorkDir=/opt/buildagent/work/7bc1c54bc719b67c/work, mbeanSrv=com.sun.jmx.mbeanserver.JmxMBeanServer@6fe85038, nodeId=009c7514-21ea-4393-97e5-afa0f35d8000, marsh=BinaryMarshaller [], marshLocJobs=false, daemon=false, p2pEnabled=true, netTimeout=10000, netCompressionLevel=1, sndRetryDelay=1000, sndRetryCnt=3, metricsHistSize=10000, metricsUpdateFreq=1000, metricsExpTime=9223372036854775807, discoSpi=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=0, ackTimeout=0, marsh=null, reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], segPlc=STOP, segResolveAttempts=2, waitForSegOnStart=true, allResolversPassReq=true, segChkFreq=10000, commSpi=TcpCommunicationSpi [connectGate=org.apache.ignite.spi.communication.tcp.internal.ConnectGateway@78446f40, ctxInitLatch=java.util.concurrent.CountDownLatch@19b65cc1[Count = 1], stopping=false, clientPool=null, nioSrvWrapper=null, stateProvider=null], evtSpi=MemoryEventStorageSpi [expireAgeMs=9223372036854775807, expireCnt=10000, filter=null], colSpi=NoopCollisionSpi [], deploySpi=LocalDeploymentSpi [], indexingSpi=org.apache.ignite.spi.indexing.noop.NoopIndexingSpi@20e1047a, addrRslvr=null, encryptionSpi=org.apache.ignite.spi.encryption.keystore.KeystoreEncryptionSpi@7b9440fa, tracingSpi=org.apache.ignite.spi.tracing.NoopTracingSpi@51144f9e, clientMode=false, rebalanceThreadPoolSize=4, rebalanceTimeout=10000, rebalanceBatchesPrefetchCnt=3, rebalanceThrottle=0, rebalanceBatchSize=524288, txCfg=TransactionConfiguration [txSerEnabled=false, dfltIsolation=REPEATABLE_READ, dfltConcurrency=PESSIMISTIC, dfltTxTimeout=0, txTimeoutOnPartitionMapExchange=0, deadlockTimeout=10000, pessimisticTxLogSize=0, pessimisticTxLogLinger=10000, tmLookupClsName=null, txManagerFactory=null, useJtaSync=false], cacheSanityCheckEnabled=true, discoStartupDelay=60000, deployMode=SHARED, p2pMissedCacheSize=100, locHost=127.0.0.1, timeSrvPortBase=31100, timeSrvPortRange=100, failureDetectionTimeout=10000, sysWorkerBlockedTimeout=null, clientFailureDetectionTimeout=10000, metricsLogFreq=0, connectorCfg=null, odbcCfg=null, warmupClos=null, atomicCfg=AtomicConfiguration [seqReserveSize=1000, cacheMode=PARTITIONED, backups=1, aff=null, grpName=null], classLdr=null, sslCtxFactory=null, platformCfg=null, binaryCfg=null, memCfg=null, pstCfg=null, dsCfg=DataStorageConfiguration [sysRegionInitSize=41943040, sysRegionMaxSize=104857600, pageSize=4096, concLvl=0, dfltDataRegConf=DataRegionConfiguration [name=default, maxSize=104857600, initSize=268435456, swapPath=null, pageEvictionMode=DISABLED, pageReplacementMode=CLOCK, evictionThreshold=0.9, emptyPagesPoolSize=100, metricsEnabled=false, metricsSubIntervalCount=5, metricsRateTimeInterval=60000, persistenceEnabled=true, checkpointPageBufSize=0, lazyMemoryAllocation=true, warmUpCfg=null], dataRegions=null, storagePath=null, checkpointFreq=30000, lockWaitTime=10000, checkpointThreads=4, checkpointWriteOrder=SEQUENTIAL, walHistSize=20, maxWalArchiveSize=20971520, walSegments=10, walSegmentSize=1048576, walPath=db/wal, walArchivePath=db/wal/archive, cdcWalPath=db/wal/cdc, cdcEnabled=false, metricsEnabled=false, walMode=LOG_ONLY, walTlbSize=131072, walBuffSize=0, walFlushFreq=2000, walFsyncDelay=1000, walRecordIterBuffSize=67108864, alwaysWriteFullPages=false, fileIOFactory=org.apache.ignite.internal.processors.cache.persistence.file.AsyncFileIOFactory@4290898e, metricsSubIntervalCnt=5, metricsRateTimeInterval=60000, walAutoArchiveAfterInactivity=-1, walForceArchiveTimeout=-1, writeThrottlingEnabled=false, walCompactionEnabled=false, walCompactionLevel=1, checkpointReadLockTimeout=null, walPageCompression=DISABLED, walPageCompressionLevel=null, dfltWarmUpCfg=null, encCfg=org.apache.ignite.configuration.EncryptionConfiguration@5d3befd0, defragmentationThreadPoolSize=4, minWalArchiveSize=-1], snapshotPath=snapshots, activeOnStart=true, activeOnStartPropSetFlag=false, autoActivation=true, autoActivationPropSetFlag=false, clusterStateOnStart=null, sqlConnCfg=null, cliConnCfg=ClientConnectorConfiguration [host=null, port=10800, portRange=100, sockSndBufSize=0, sockRcvBufSize=0, tcpNoDelay=true, maxOpenCursorsPerConn=128, threadPoolSize=24, selectorCnt=12, idleTimeout=0, handshakeTimeout=10000, jdbcEnabled=true, odbcEnabled=true, thinCliEnabled=true, sslEnabled=false, useIgniteSslCtxFactory=true, sslClientAuth=false, sslCtxFactory=null, thinCliCfg=ThinClientConfiguration [maxActiveTxPerConn=100, maxActiveComputeTasksPerConn=0]], mvccVacuumThreadCnt=2, mvccVacuumFreq=5000, authEnabled=false, failureHnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]], commFailureRslvr=null, sqlCfg=SqlConfiguration [longQryWarnTimeout=3000, dfltQryTimeout=0, sqlQryHistSize=1000, validationEnabled=false], asyncContinuationExecutor=null] [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,060][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] Daemon mode: off [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,061][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] OS: Linux 4.15.0-151-generic amd64 [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,061][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] OS user: teamcity [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,061][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] PID: 16724 [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,062][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] Language runtime: Java Platform API Specification ver. 1.8 [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,062][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] VM information: Java(TM) SE Runtime Environment 1.8.0_261-b12 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 25.261-b12 [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,062][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] VM total memory: 1.9GB [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,063][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] Remote Management [restart: off, REST: off, JMX (remote: off)] [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,063][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] Logger: GridTestLog4jLogger [quiet=false, config=null] [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,063][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] IGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,064][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] VM arguments: [-DIGNITE_DUMP_THREADS_ON_FAILURE=false, -DMono=/usr/bin/mono-sgen, -DMono4.0_x64=/usr/lib/mono/4.0, -DMono4.5_x64=/usr/lib/mono/4.5, -DMonoVersion=6.12.0.90, -DSKIP_BUILD=false, -Dagent.home.dir=/opt/buildagent, -Dagent.name=aitc-lin02_03, -Dagent.ownPort=9090, -Dagent.work.dir=/opt/buildagent/work, -Dbuild.number=95, -Dbuild.vcs.number=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.1=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.GitHubApacheIgnite=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dclassworlds.conf=/opt/buildagent/temp/buildTmp/teamcity.m2.conf, -Dcom.jetbrains.maven.watcher.report.file=/opt/buildagent/temp/buildTmp/maven-build-info.xml, -Djava.io.tmpdir=/opt/buildagent/temp/buildTmp, -Dmaven.home=/opt/buildagent/tools/maven3_6, -Dmaven.multiModuleProjectDirectory=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.agent.cpuBenchmark=457, -Dteamcity.agent.dotnet.agent_url=http://localhost:9090/RPC2, -Dteamcity.agent.dotnet.build_id=6278078, -Dteamcity.auth.password=*******, -Dteamcity.auth.userId=TeamCityBuildId=6278078, -Dteamcity.build.changedFiles.file=/opt/buildagent/temp/buildTmp/changedFiles6342607772318147725.txt, -Dteamcity.build.checkoutDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.build.id=6278078, -Dteamcity.build.properties.file=/opt/buildagent/temp/buildTmp/teamcity.build5164517880467851002.properties, -Dteamcity.build.tempDir=/opt/buildagent/temp/buildTmp, -Dteamcity.build.workingDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.buildConfName=Basic 3, -Dteamcity.buildType.id=IgniteTests24Java8_Basic3, -Dteamcity.configuration.properties.file=/opt/buildagent/temp/buildTmp/teamcity.config5591980786735343870.properties, -Dteamcity.maven.userSettings.path=/opt/buildagent/temp/buildTmp/maven_settings_585072866407032347.xml, -Dteamcity.maven.watcher.home=/opt/buildagent/plugins/mavenPlugin/maven-watcher-jdk16, -Dteamcity.projectName=Ignite Tests 2.x (JDK 8/11), -Dteamcity.runner.properties.file=/opt/buildagent/temp/buildTmp/teamcity.runner9098465561618137420.properties, -Dteamcity.tests.recentlyFailedTests.file=/opt/buildagent/temp/buildTmp/testsToRunFirst3891775683130404069.txt, -Dteamcity.version=2021.2 (build 99542), -ea, -Xms2g, -Xmx2g, -XX:+HeapDumpOnOutOfMemoryError, -DIGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_TEST_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_UPDATE_NOTIFIER=false, -DIGNITE_NO_DISCO_ORDER=true, -DIGNITE_PERFORMANCE_SUGGESTIONS_DISABLED=true, -Djava.net.preferIPv4Stack=true, -DTEST_SCALE_FACTOR=1.0, -DIGNITE_TEST_PROP_LOG4J_FILE=log4j-tc-test.xml, -DIGNITE_QUIET=false, -DIGNITE_MARSHAL_BUFFERS_RECHECK=1000, -Dmaven.repo.local=/opt/buildagent/.m2/repository] [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,069][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] System cache's DataRegion size is configured to 40 MB. Use DataStorageConfiguration.systemRegionInitialSize property to change the setting. [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,069][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] Configured caches [in 'sysMemPlc' dataRegion: ['ignite-sys-cache']] [21:12:04]W: [org.apache.ignite:ignite-core] [2021-11-19 21:12:04,069][WARN ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] Peer class loading is enabled (disable it in production for performance and deployment consistency reasons) [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,070][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] 3-rd party licenses can be found at: /opt/buildagent/work/7bc1c54bc719b67c/libs/licenses [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,074][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] Configured plugins: [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,074][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- StanByClusterTestProvider 1.0 [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,074][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,074][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,074][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- PageMemory tracker plugin 1.0 [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,074][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,075][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,075][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- TestDistibutedConfigurationPlugin 1.0 [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,075][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,075][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,075][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- NodeValidationPluginProvider 1.0 [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,076][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,076][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,076][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][FailureProcessor] Configured failure handler: [hnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]]] [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,138][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][TestRecordingCommunicationSpi] Successfully bound communication NIO server to TCP port [port=47100, locHost=/127.0.0.1, selectorsCnt=12, selectorSpins=0, pairedConn=false] [21:12:04]W: [org.apache.ignite:ignite-core] [2021-11-19 21:12:04,139][WARN ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][TestRecordingCommunicationSpi] Message queue limit is set to 0 which may lead to potential OOMEs when running cache operations in FULL_ASYNC or PRIMARY_SYNC modes due to message queues growth on sender and receiver sides. [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,158][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][GridCollisionManager] Collision resolution is disabled (all jobs will be activated upon arrival). [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,158][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] Security status [authentication=off, sandbox=off, tls/ssl=off] [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,217][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,309][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][MaintenanceProcessor] Resolved store directory for node persistent data: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0 [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,311][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][CacheObjectBinaryProcessorImpl] Resolved directory for serialized binary metadata: /opt/buildagent/work/7bc1c54bc719b67c/work/db/binary_meta/grid_0 [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,316][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0 [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,317][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][FileWriteAheadLogManager] Resolved write ahead log work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0 [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,317][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][FileWriteAheadLogManager] Resolved write ahead log archive directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0 [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,319][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000005.wal [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,319][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000006.wal [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,320][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000008.wal [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,320][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000004.wal [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,320][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000003.wal [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,321][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000002.wal [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,321][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000007.wal [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,322][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000001.wal [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,322][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000009.wal [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,323][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][FileHandleManagerImpl] Initialized write-ahead log manager [mode=LOG_ONLY] [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,328][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Configured data regions initialized successfully [total=5] [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,329][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][IgniteSnapshotManager] Resolved snapshot work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/snapshots [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,330][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][IgniteSnapshotManager] Resolved temp directory for snapshot creation: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0/snp [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,332][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][ClientListenerProcessor] Client connector processor has started on TCP port 10800 [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,338][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] Non-loopback local IPs: 172.17.0.4 [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,338][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] Enabled local MACs: 0242AC110004 [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,341][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=/opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0/cp/1637345523957-156caa49-ca9d-41eb-aa0d-261a49b96150-START.bin, endMarker=/opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0/cp/1637345523957-156caa49-ca9d-41eb-aa0d-261a49b96150-END.bin] [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,342][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,343][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=170261, len=2111], lastMarked=WALPointer [idx=0, fileOff=170261, len=2111], lastCheckpointId=156caa49-ca9d-41eb-aa0d-261a49b96150] [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,345][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Found last checkpoint marker [cpId=156caa49-ca9d-41eb-aa0d-261a49b96150, pos=WALPointer [idx=0, fileOff=170261, len=2111]] [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,347][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Applying lost metastore updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=170261, len=2111], lastCheckpointId=156caa49-ca9d-41eb-aa0d-261a49b96150] [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,349][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=0 ms] [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,349][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Restoring partition state for local groups. [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,350][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=0, partitionsProcessed=0, time=0ms] [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,365][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][GridClusterStateProcessor] Restoring history for BaselineTopology[id=0] [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,376][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][ClusterProcessor] Cluster ID and tag has been read from metastorage: ClusterIdAndTag [id=3db7b4a7-4406-4d31-aef1-c8efa56d8f47, tag=zealous_brahmagupta] [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,377][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][IgniteClusterImpl] Shutdown policy was updated [oldVal=null, newVal=null] [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,377][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustEnabled' was changed from 'null' to 'false' [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,377][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustTimeout' was changed from 'null' to '300000' [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,378][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][IgniteTxManager] Transactions parameter 'txOwnerDumpRequestsAllowed' was changed from 'null' to 'true' [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,378][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][IgniteTxManager] Transactions parameter 'longOperationsDumpTimeout' was changed from 'null' to '60000' [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,378][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpThreshold' was changed from 'null' to '0' [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,379][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][IgniteTxManager] Transactions parameter 'transactionTimeDumpSamplesCoefficient' was changed from 'null' to '0.0' [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,380][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpSamplesPerSecondLimit' was changed from 'null' to '5' [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,382][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][IgniteTxManager] Transactions parameter 'collisionsDumpInterval' was changed from 'null' to '1000' [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,383][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Historical rebalance WAL threshold changed [property=historical.rebalance.threshold, oldVal=null, newVal=500] [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,383][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Checkpoint frequency deviation changed [oldVal=null, newVal=null] [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,384][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][FilePageStoreManager] Cleanup cache stores [total=1, left=0, cleanFiles=false] [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,387][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,388][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,388][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,389][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Data Regions Started: 5 [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,389][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] ^-- sysMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:12:04] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:12:04] : [Step 4/5] ^-- default region [type=default, persistence=true, lazyAlloc=true, [21:12:04] : [Step 4/5] ... initCfg=100MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB, allocTotal=0MB] [21:12:04] : [Step 4/5] ^-- metastoreMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:12:04] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:12:04] : [Step 4/5] ^-- TxLog region [type=internal, persistence=true, lazyAlloc=false, [21:12:04] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:12:04] : [Step 4/5] ^-- volatileDsMemPlc region [type=user, persistence=false, lazyAlloc=true, [21:12:04] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB] [21:12:04] : [Step 4/5] ^-- Ignite persistence [used=0MB] [21:12:04] : [Step 4/5] [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,391][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Starting binary memory restore for: [-2100569601, 1613773252, -1368047376] [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,402][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=/opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0/cp/1637345523957-156caa49-ca9d-41eb-aa0d-261a49b96150-START.bin, endMarker=/opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0/cp/1637345523957-156caa49-ca9d-41eb-aa0d-261a49b96150-END.bin] [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,402][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=170261, len=2111], lastMarked=WALPointer [idx=0, fileOff=170261, len=2111], lastCheckpointId=156caa49-ca9d-41eb-aa0d-261a49b96150] [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,404][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Found last checkpoint marker [cpId=156caa49-ca9d-41eb-aa0d-261a49b96150, pos=WALPointer [idx=0, fileOff=170261, len=2111]] [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,405][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Binary memory state restored at node startup [restoredPtr=WALPointer [idx=0, fileOff=172407, len=0]] [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,406][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000000.wal, offset=172407, ver=2] [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,409][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Started cache in recovery mode [name=ignite-sys-cache, id=-2100569601, dataRegionName=sysMemPlc, mode=REPLICATED, atomicity=TRANSACTIONAL, backups=2147483647, mvcc=false] [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,410][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,413][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Started cache in recovery mode [name=cache2, id=-1368047376, dataRegionName=default, mode=PARTITIONED, atomicity=ATOMIC, backups=0, mvcc=false] [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,414][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Binary recovery performed in 23 ms. [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,414][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=/opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0/cp/1637345523957-156caa49-ca9d-41eb-aa0d-261a49b96150-START.bin, endMarker=/opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0/cp/1637345523957-156caa49-ca9d-41eb-aa0d-261a49b96150-END.bin] [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,415][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Applying lost cache updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=170261, len=2111], lastCheckpointId=156caa49-ca9d-41eb-aa0d-261a49b96150] [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,417][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=0 ms] [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,417][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Restoring partition state for local groups. [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,431][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=2, partitionsProcessed=108, time=10ms] [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,434][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][TestTcpDiscoverySpi] Successfully bound to TCP port [port=47500, localHost=localhost/127.0.0.1, locNodeId=009c7514-21ea-4393-97e5-afa0f35d8000] [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,436][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][GridEncryptionManager] Sending stored group keys to coordinator [grps=1613773252,-1368047376] [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,446][INFO ][disco-notifier-worker-#23357%grid-0%][MvccProcessorImpl] Assigned mvcc coordinator [crd=MvccCoordinator [topVer=AffinityTopologyVersion [topVer=1, minorTopVer=0], nodeId=009c7514-21ea-4393-97e5-afa0f35d8000, ver=1637345524438, local=true, initialized=false]] [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,447][INFO ][sys-#23352%grid-0%][ClusterProcessor] Writing cluster ID and tag to metastorage on ready for write ClusterIdAndTag [id=3db7b4a7-4406-4d31-aef1-c8efa56d8f47, tag=zealous_brahmagupta] [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,463][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] To start Console Management & Monitoring run ignitevisorcmd.{sh|bat} [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,464][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] [21:12:04] : [Step 4/5] [21:12:04] : [Step 4/5] >>> +-------------------------------------------+ [21:12:04] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:12:04] : [Step 4/5] >>> +-------------------------------------------+ [21:12:04] : [Step 4/5] >>> OS name: Linux 4.15.0-151-generic amd64 [21:12:04] : [Step 4/5] >>> CPU(s): 24 [21:12:04] : [Step 4/5] >>> Heap: 2.0GB [21:12:04] : [Step 4/5] >>> VM name: 16724@c4dfe9a430b2 [21:12:04] : [Step 4/5] >>> Ignite instance name: grid-0 [21:12:04] : [Step 4/5] >>> Local node [ID=009C7514-21EA-4393-97E5-AFA0F35D8000, order=1, clientMode=false] [21:12:04] : [Step 4/5] >>> Local node addresses: [127.0.0.1] [21:12:04] : [Step 4/5] >>> Local ports: TCP:10800 TCP:47100 TCP:47500 [21:12:04] : [Step 4/5] [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,465][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] >>> Ignite cluster is in INACTIVE state (limited functionality available). Use control.(sh|bat) script or IgniteCluster.state(ClusterState.ACTIVE) to change the state. [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,465][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][GridDiscoveryManager] Topology snapshot [ver=1, locNode=009c7514, servers=1, clients=0, state=INACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=009c7514-21ea-4393-97e5-afa0f35d8000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,466][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][GridDiscoveryManager] ^-- Baseline [id=0, size=2, online=1, offline=1] [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,466][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][GridDiscoveryManager] ^-- 1 nodes left for auto-activation [grid-1] [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,467][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][G] Node started : [stage="Configure system pool" (0 ms),stage="Start managers" (262 ms),stage="Configure binary metadata" (3 ms),stage="Start processors" (24 ms),stage="Start 'StanByClusterTestProvider' plugin" (0 ms),stage="Start 'PageMemory tracker plugin' plugin" (0 ms),stage="Start 'TestDistibutedConfigurationPlugin' plugin" (0 ms),stage="Start 'NodeValidationPluginProvider' plugin" (0 ms),stage="Init metastore" (46 ms),stage="Init and start regions" (6 ms),stage="Restore binary memory" (23 ms),stage="Restore logical state" (17 ms),stage="Finish recovery" (1 ms),stage="Join topology" (13 ms),stage="Await transition" (2 ms),stage="Await exchange" (18 ms),stage="Total time" (415 ms)] [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,468][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][root] Node started with the following configuration [id=009c7514-21ea-4393-97e5-afa0f35d8000, marshaller=BinaryMarshaller [], discovery=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=5000, ackTimeout=5000, marsh=JdkMarshaller [clsFilter=org.apache.ignite.marshaller.MarshallerUtils$1@4ef7c412], reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], binaryCfg=null, lateAff=true] [21:12:04]W: [org.apache.ignite:ignite-core] [2021-11-19 21:12:04,474][WARN ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][G] Ignite work directory is not provided, automatically resolved to: /opt/buildagent/work/7bc1c54bc719b67c/work [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,475][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] [21:12:04] : [Step 4/5] [21:12:04] : [Step 4/5] >>> __________ ________________ [21:12:04] : [Step 4/5] >>> / _/ ___/ |/ / _/_ __/ __/ [21:12:04] : [Step 4/5] >>> _/ // (7 7 // / / / / _/ [21:12:04] : [Step 4/5] >>> /___/\___/_/|_/___/ /_/ /___/ [21:12:04] : [Step 4/5] >>> [21:12:04] : [Step 4/5] >>> ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:12:04] : [Step 4/5] >>> 2021 Copyright(C) Apache Software Foundation [21:12:04] : [Step 4/5] >>> [21:12:04] : [Step 4/5] >>> Ignite documentation: http://ignite.apache.org [21:12:04] : [Step 4/5] [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,476][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] Config URL: n/a [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,476][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] IgniteConfiguration [igniteInstanceName=grid-1, pubPoolSize=24, svcPoolSize=24, callbackPoolSize=24, stripedPoolSize=24, sysPoolSize=24, mgmtPoolSize=4, dataStreamerPoolSize=24, utilityCachePoolSize=24, utilityCacheKeepAliveTime=60000, p2pPoolSize=2, qryPoolSize=24, buildIdxPoolSize=4, igniteHome=/opt/buildagent/work/7bc1c54bc719b67c, igniteWorkDir=/opt/buildagent/work/7bc1c54bc719b67c/work, mbeanSrv=com.sun.jmx.mbeanserver.JmxMBeanServer@6fe85038, nodeId=1087f160-5e44-4f1a-9728-b1c507c3f001, marsh=BinaryMarshaller [], marshLocJobs=false, daemon=false, p2pEnabled=true, netTimeout=10000, netCompressionLevel=1, sndRetryDelay=1000, sndRetryCnt=3, metricsHistSize=10000, metricsUpdateFreq=1000, metricsExpTime=9223372036854775807, discoSpi=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=0, ackTimeout=0, marsh=null, reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], segPlc=STOP, segResolveAttempts=2, waitForSegOnStart=true, allResolversPassReq=true, segChkFreq=10000, commSpi=TcpCommunicationSpi [connectGate=org.apache.ignite.spi.communication.tcp.internal.ConnectGateway@7b772d36, ctxInitLatch=java.util.concurrent.CountDownLatch@7e13dfa3[Count = 1], stopping=false, clientPool=null, nioSrvWrapper=null, stateProvider=null], evtSpi=MemoryEventStorageSpi [expireAgeMs=9223372036854775807, expireCnt=10000, filter=null], colSpi=NoopCollisionSpi [], deploySpi=LocalDeploymentSpi [], indexingSpi=org.apache.ignite.spi.indexing.noop.NoopIndexingSpi@33b113a1, addrRslvr=null, encryptionSpi=org.apache.ignite.spi.encryption.keystore.KeystoreEncryptionSpi@76220a65, tracingSpi=org.apache.ignite.spi.tracing.NoopTracingSpi@7ac4f79d, clientMode=false, rebalanceThreadPoolSize=4, rebalanceTimeout=10000, rebalanceBatchesPrefetchCnt=3, rebalanceThrottle=0, rebalanceBatchSize=524288, txCfg=TransactionConfiguration [txSerEnabled=false, dfltIsolation=REPEATABLE_READ, dfltConcurrency=PESSIMISTIC, dfltTxTimeout=0, txTimeoutOnPartitionMapExchange=0, deadlockTimeout=10000, pessimisticTxLogSize=0, pessimisticTxLogLinger=10000, tmLookupClsName=null, txManagerFactory=null, useJtaSync=false], cacheSanityCheckEnabled=true, discoStartupDelay=60000, deployMode=SHARED, p2pMissedCacheSize=100, locHost=127.0.0.1, timeSrvPortBase=31100, timeSrvPortRange=100, failureDetectionTimeout=10000, sysWorkerBlockedTimeout=null, clientFailureDetectionTimeout=10000, metricsLogFreq=0, connectorCfg=null, odbcCfg=null, warmupClos=null, atomicCfg=AtomicConfiguration [seqReserveSize=1000, cacheMode=PARTITIONED, backups=1, aff=null, grpName=null], classLdr=null, sslCtxFactory=null, platformCfg=null, binaryCfg=null, memCfg=null, pstCfg=null, dsCfg=DataStorageConfiguration [sysRegionInitSize=41943040, sysRegionMaxSize=104857600, pageSize=4096, concLvl=0, dfltDataRegConf=DataRegionConfiguration [name=default, maxSize=104857600, initSize=268435456, swapPath=null, pageEvictionMode=DISABLED, pageReplacementMode=CLOCK, evictionThreshold=0.9, emptyPagesPoolSize=100, metricsEnabled=false, metricsSubIntervalCount=5, metricsRateTimeInterval=60000, persistenceEnabled=true, checkpointPageBufSize=0, lazyMemoryAllocation=true, warmUpCfg=null], dataRegions=null, storagePath=null, checkpointFreq=30000, lockWaitTime=10000, checkpointThreads=4, checkpointWriteOrder=SEQUENTIAL, walHistSize=20, maxWalArchiveSize=20971520, walSegments=10, walSegmentSize=1048576, walPath=db/wal, walArchivePath=db/wal/archive, cdcWalPath=db/wal/cdc, cdcEnabled=false, metricsEnabled=false, walMode=LOG_ONLY, walTlbSize=131072, walBuffSize=0, walFlushFreq=2000, walFsyncDelay=1000, walRecordIterBuffSize=67108864, alwaysWriteFullPages=false, fileIOFactory=org.apache.ignite.internal.processors.cache.persistence.file.AsyncFileIOFactory@7bfa2fd3, metricsSubIntervalCnt=5, metricsRateTimeInterval=60000, walAutoArchiveAfterInactivity=-1, walForceArchiveTimeout=-1, writeThrottlingEnabled=false, walCompactionEnabled=false, walCompactionLevel=1, checkpointReadLockTimeout=null, walPageCompression=DISABLED, walPageCompressionLevel=null, dfltWarmUpCfg=null, encCfg=org.apache.ignite.configuration.EncryptionConfiguration@246b19ab, defragmentationThreadPoolSize=4, minWalArchiveSize=-1], snapshotPath=snapshots, activeOnStart=true, activeOnStartPropSetFlag=false, autoActivation=true, autoActivationPropSetFlag=false, clusterStateOnStart=null, sqlConnCfg=null, cliConnCfg=ClientConnectorConfiguration [host=null, port=10800, portRange=100, sockSndBufSize=0, sockRcvBufSize=0, tcpNoDelay=true, maxOpenCursorsPerConn=128, threadPoolSize=24, selectorCnt=12, idleTimeout=0, handshakeTimeout=10000, jdbcEnabled=true, odbcEnabled=true, thinCliEnabled=true, sslEnabled=false, useIgniteSslCtxFactory=true, sslClientAuth=false, sslCtxFactory=null, thinCliCfg=ThinClientConfiguration [maxActiveTxPerConn=100, maxActiveComputeTasksPerConn=0]], mvccVacuumThreadCnt=2, mvccVacuumFreq=5000, authEnabled=false, failureHnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]], commFailureRslvr=null, sqlCfg=SqlConfiguration [longQryWarnTimeout=3000, dfltQryTimeout=0, sqlQryHistSize=1000, validationEnabled=false], asyncContinuationExecutor=null] [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,486][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] Daemon mode: off [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,486][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] OS: Linux 4.15.0-151-generic amd64 [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,486][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] OS user: teamcity [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,486][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] PID: 16724 [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,487][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] Language runtime: Java Platform API Specification ver. 1.8 [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,487][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] VM information: Java(TM) SE Runtime Environment 1.8.0_261-b12 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 25.261-b12 [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,487][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] VM total memory: 1.9GB [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,488][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] Remote Management [restart: off, REST: off, JMX (remote: off)] [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,488][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] Logger: GridTestLog4jLogger [quiet=false, config=null] [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,488][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] IGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,489][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] VM arguments: [-DIGNITE_DUMP_THREADS_ON_FAILURE=false, -DMono=/usr/bin/mono-sgen, -DMono4.0_x64=/usr/lib/mono/4.0, -DMono4.5_x64=/usr/lib/mono/4.5, -DMonoVersion=6.12.0.90, -DSKIP_BUILD=false, -Dagent.home.dir=/opt/buildagent, -Dagent.name=aitc-lin02_03, -Dagent.ownPort=9090, -Dagent.work.dir=/opt/buildagent/work, -Dbuild.number=95, -Dbuild.vcs.number=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.1=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.GitHubApacheIgnite=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dclassworlds.conf=/opt/buildagent/temp/buildTmp/teamcity.m2.conf, -Dcom.jetbrains.maven.watcher.report.file=/opt/buildagent/temp/buildTmp/maven-build-info.xml, -Djava.io.tmpdir=/opt/buildagent/temp/buildTmp, -Dmaven.home=/opt/buildagent/tools/maven3_6, -Dmaven.multiModuleProjectDirectory=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.agent.cpuBenchmark=457, -Dteamcity.agent.dotnet.agent_url=http://localhost:9090/RPC2, -Dteamcity.agent.dotnet.build_id=6278078, -Dteamcity.auth.password=*******, -Dteamcity.auth.userId=TeamCityBuildId=6278078, -Dteamcity.build.changedFiles.file=/opt/buildagent/temp/buildTmp/changedFiles6342607772318147725.txt, -Dteamcity.build.checkoutDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.build.id=6278078, -Dteamcity.build.properties.file=/opt/buildagent/temp/buildTmp/teamcity.build5164517880467851002.properties, -Dteamcity.build.tempDir=/opt/buildagent/temp/buildTmp, -Dteamcity.build.workingDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.buildConfName=Basic 3, -Dteamcity.buildType.id=IgniteTests24Java8_Basic3, -Dteamcity.configuration.properties.file=/opt/buildagent/temp/buildTmp/teamcity.config5591980786735343870.properties, -Dteamcity.maven.userSettings.path=/opt/buildagent/temp/buildTmp/maven_settings_585072866407032347.xml, -Dteamcity.maven.watcher.home=/opt/buildagent/plugins/mavenPlugin/maven-watcher-jdk16, -Dteamcity.projectName=Ignite Tests 2.x (JDK 8/11), -Dteamcity.runner.properties.file=/opt/buildagent/temp/buildTmp/teamcity.runner9098465561618137420.properties, -Dteamcity.tests.recentlyFailedTests.file=/opt/buildagent/temp/buildTmp/testsToRunFirst3891775683130404069.txt, -Dteamcity.version=2021.2 (build 99542), -ea, -Xms2g, -Xmx2g, -XX:+HeapDumpOnOutOfMemoryError, -DIGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_TEST_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_UPDATE_NOTIFIER=false, -DIGNITE_NO_DISCO_ORDER=true, -DIGNITE_PERFORMANCE_SUGGESTIONS_DISABLED=true, -Djava.net.preferIPv4Stack=true, -DTEST_SCALE_FACTOR=1.0, -DIGNITE_TEST_PROP_LOG4J_FILE=log4j-tc-test.xml, -DIGNITE_QUIET=false, -DIGNITE_MARSHAL_BUFFERS_RECHECK=1000, -Dmaven.repo.local=/opt/buildagent/.m2/repository] [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,493][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] System cache's DataRegion size is configured to 40 MB. Use DataStorageConfiguration.systemRegionInitialSize property to change the setting. [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,494][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] Configured caches [in 'sysMemPlc' dataRegion: ['ignite-sys-cache']] [21:12:04]W: [org.apache.ignite:ignite-core] [2021-11-19 21:12:04,494][WARN ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] Peer class loading is enabled (disable it in production for performance and deployment consistency reasons) [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,494][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] 3-rd party licenses can be found at: /opt/buildagent/work/7bc1c54bc719b67c/libs/licenses [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,498][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] Configured plugins: [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,498][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- StanByClusterTestProvider 1.0 [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,499][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,499][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,499][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- PageMemory tracker plugin 1.0 [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,499][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,499][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,500][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- TestDistibutedConfigurationPlugin 1.0 [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,500][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,500][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,500][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- NodeValidationPluginProvider 1.0 [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,501][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,501][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,501][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][FailureProcessor] Configured failure handler: [hnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]]] [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,511][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][TestRecordingCommunicationSpi] Successfully bound communication NIO server to TCP port [port=47101, locHost=/127.0.0.1, selectorsCnt=12, selectorSpins=0, pairedConn=false] [21:12:04]W: [org.apache.ignite:ignite-core] [2021-11-19 21:12:04,512][WARN ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][TestRecordingCommunicationSpi] Message queue limit is set to 0 which may lead to potential OOMEs when running cache operations in FULL_ASYNC or PRIMARY_SYNC modes due to message queues growth on sender and receiver sides. [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,516][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][GridCollisionManager] Collision resolution is disabled (all jobs will be activated upon arrival). [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,516][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] Security status [authentication=off, sandbox=off, tls/ssl=off] [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,577][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,668][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][MaintenanceProcessor] Resolved store directory for node persistent data: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1 [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,670][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][CacheObjectBinaryProcessorImpl] Resolved directory for serialized binary metadata: /opt/buildagent/work/7bc1c54bc719b67c/work/db/binary_meta/grid_1 [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,676][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1 [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,677][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][FileWriteAheadLogManager] Resolved write ahead log work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1 [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,677][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][FileWriteAheadLogManager] Resolved write ahead log archive directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1 [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,681][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][FileHandleManagerImpl] Initialized write-ahead log manager [mode=LOG_ONLY] [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,692][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Configured data regions initialized successfully [total=5] [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,695][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][IgniteSnapshotManager] Resolved snapshot work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/snapshots [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,695][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][IgniteSnapshotManager] Resolved temp directory for snapshot creation: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1/snp [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,702][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][ClientListenerProcessor] Client connector processor has started on TCP port 10801 [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,709][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] Non-loopback local IPs: 172.17.0.4 [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,709][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] Enabled local MACs: 0242AC110004 [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,711][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=/opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1/cp/1637345523906-d8c39cdb-069d-471a-9eac-fa0bf8513870-START.bin, endMarker=/opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1/cp/1637345523906-d8c39cdb-069d-471a-9eac-fa0bf8513870-END.bin] [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,712][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,713][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=5, fileOff=33525, len=2105], lastMarked=WALPointer [idx=5, fileOff=33525, len=2105], lastCheckpointId=d8c39cdb-069d-471a-9eac-fa0bf8513870] [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,716][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Found last checkpoint marker [cpId=d8c39cdb-069d-471a-9eac-fa0bf8513870, pos=WALPointer [idx=5, fileOff=33525, len=2105]] [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,718][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Applying lost metastore updates since last checkpoint record [lastMarked=WALPointer [idx=5, fileOff=33525, len=2105], lastCheckpointId=d8c39cdb-069d-471a-9eac-fa0bf8513870] [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,720][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=10 ms] [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,720][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Restoring partition state for local groups. [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,720][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=0, partitionsProcessed=0, time=0ms] [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,727][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][GridClusterStateProcessor] Restoring history for BaselineTopology[id=0] [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,730][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][ClusterProcessor] Cluster ID and tag has been read from metastorage: ClusterIdAndTag [id=3db7b4a7-4406-4d31-aef1-c8efa56d8f47, tag=zealous_brahmagupta] [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,730][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][IgniteClusterImpl] Shutdown policy was updated [oldVal=null, newVal=null] [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,730][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustEnabled' was changed from 'null' to 'false' [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,731][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustTimeout' was changed from 'null' to '300000' [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,731][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][IgniteTxManager] Transactions parameter 'txOwnerDumpRequestsAllowed' was changed from 'null' to 'true' [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,731][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][IgniteTxManager] Transactions parameter 'longOperationsDumpTimeout' was changed from 'null' to '60000' [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,732][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpThreshold' was changed from 'null' to '0' [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,732][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][IgniteTxManager] Transactions parameter 'transactionTimeDumpSamplesCoefficient' was changed from 'null' to '0.0' [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,732][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpSamplesPerSecondLimit' was changed from 'null' to '5' [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,733][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][IgniteTxManager] Transactions parameter 'collisionsDumpInterval' was changed from 'null' to '1000' [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,733][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Historical rebalance WAL threshold changed [property=historical.rebalance.threshold, oldVal=null, newVal=500] [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,733][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Checkpoint frequency deviation changed [oldVal=null, newVal=null] [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,734][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][FilePageStoreManager] Cleanup cache stores [total=1, left=0, cleanFiles=false] [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,737][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,738][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,740][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,741][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Data Regions Started: 5 [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,742][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] ^-- sysMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:12:04] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:12:04] : [Step 4/5] ^-- default region [type=default, persistence=true, lazyAlloc=true, [21:12:04] : [Step 4/5] ... initCfg=100MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB, allocTotal=0MB] [21:12:04] : [Step 4/5] ^-- metastoreMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:12:04] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:12:04] : [Step 4/5] ^-- TxLog region [type=internal, persistence=true, lazyAlloc=false, [21:12:04] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:12:04] : [Step 4/5] ^-- volatileDsMemPlc region [type=user, persistence=false, lazyAlloc=true, [21:12:04] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB] [21:12:04] : [Step 4/5] ^-- Ignite persistence [used=0MB] [21:12:04] : [Step 4/5] [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,743][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Starting binary memory restore for: [-2100569601, 1613773252, -1368047376] [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,754][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=/opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1/cp/1637345523906-d8c39cdb-069d-471a-9eac-fa0bf8513870-START.bin, endMarker=/opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1/cp/1637345523906-d8c39cdb-069d-471a-9eac-fa0bf8513870-END.bin] [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,755][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=5, fileOff=33525, len=2105], lastMarked=WALPointer [idx=5, fileOff=33525, len=2105], lastCheckpointId=d8c39cdb-069d-471a-9eac-fa0bf8513870] [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,759][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Found last checkpoint marker [cpId=d8c39cdb-069d-471a-9eac-fa0bf8513870, pos=WALPointer [idx=5, fileOff=33525, len=2105]] [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,759][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Binary memory state restored at node startup [restoredPtr=WALPointer [idx=5, fileOff=35630, len=0]] [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,761][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000005.wal, offset=35630, ver=2] [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,765][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Started cache in recovery mode [name=ignite-sys-cache, id=-2100569601, dataRegionName=sysMemPlc, mode=REPLICATED, atomicity=TRANSACTIONAL, backups=2147483647, mvcc=false] [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,768][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,771][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Started cache in recovery mode [name=encrypted, id=1613773252, dataRegionName=default, mode=PARTITIONED, atomicity=ATOMIC, backups=0, mvcc=false] [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,773][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Binary recovery performed in 30 ms. [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,774][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=/opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1/cp/1637345523906-d8c39cdb-069d-471a-9eac-fa0bf8513870-START.bin, endMarker=/opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1/cp/1637345523906-d8c39cdb-069d-471a-9eac-fa0bf8513870-END.bin] [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,774][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Applying lost cache updates since last checkpoint record [lastMarked=WALPointer [idx=5, fileOff=33525, len=2105], lastCheckpointId=d8c39cdb-069d-471a-9eac-fa0bf8513870] [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,777][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=0 ms] [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,778][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Restoring partition state for local groups. [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,801][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=2, partitionsProcessed=108, time=30ms] [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,805][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][TestTcpDiscoverySpi] Successfully bound to TCP port [port=47501, localHost=localhost/127.0.0.1, locNodeId=1087f160-5e44-4f1a-9728-b1c507c3f001] [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,817][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][GridEncryptionManager] Sending stored group keys to coordinator [grps=1613773252,-1368047376] [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,820][INFO ][tcp-disco-srvr-[:47500]-#1225%grid-0%-#23359%grid-0%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=35175] [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,820][INFO ][tcp-disco-srvr-[:47500]-#1225%grid-0%-#23359%grid-0%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=35175] [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,821][INFO ][tcp-disco-sock-reader-[]-#1231%grid-0%-#23480%grid-0%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:35175, rmtPort=35175] [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,822][INFO ][tcp-disco-sock-reader-[1087f160 127.0.0.1:35175]-#1231%grid-0%-#23480%grid-0%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=1087f160-5e44-4f1a-9728-b1c507c3f001, rmtAddr=/127.0.0.1:35175] [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,827][INFO ][tcp-disco-srvr-[:47501]-#1230%grid-1%-#23479%grid-1%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=50727] [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,827][INFO ][tcp-disco-srvr-[:47501]-#1230%grid-1%-#23479%grid-1%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=50727] [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,828][INFO ][tcp-disco-sock-reader-[]-#1232%grid-1%-#23481%grid-1%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:50727, rmtPort=50727] [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,829][INFO ][tcp-disco-sock-reader-[]-#1232%grid-1%-#23481%grid-1%][TestTcpDiscoverySpi] Received ping request from the remote node [rmtNodeId=009c7514-21ea-4393-97e5-afa0f35d8000, rmtAddr=/127.0.0.1:50727, rmtPort=50727] [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,830][INFO ][tcp-disco-sock-reader-[]-#1232%grid-1%-#23481%grid-1%][TestTcpDiscoverySpi] Finished writing ping response [rmtNodeId=009c7514-21ea-4393-97e5-afa0f35d8000, rmtAddr=/127.0.0.1:50727, rmtPort=50727] [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,830][INFO ][tcp-disco-sock-reader-[1087f160 127.0.0.1:35175]-#1231%grid-0%-#23480%grid-0%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:35175, rmtPort=35175, rmtNodeId=1087f160-5e44-4f1a-9728-b1c507c3f001] [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,830][INFO ][tcp-disco-sock-reader-[]-#1232%grid-1%-#23481%grid-1%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:50727, rmtPort=50727, rmtNodeId=null] [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,847][INFO ][tcp-disco-msg-worker-[crd]-#1224%grid-0%-#23358%grid-0%][TestTcpDiscoverySpi] New next node [newNext=TcpDiscoveryNode [id=1087f160-5e44-4f1a-9728-b1c507c3f001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=0, intOrder=2, lastExchangeTime=1637345524820, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false]] [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,848][INFO ][tcp-disco-srvr-[:47501]-#1230%grid-1%-#23479%grid-1%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=40369] [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,848][INFO ][tcp-disco-srvr-[:47501]-#1230%grid-1%-#23479%grid-1%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=40369] [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,849][INFO ][tcp-disco-sock-reader-[]-#1233%grid-1%-#23482%grid-1%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:40369, rmtPort=40369] [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,849][INFO ][tcp-disco-sock-reader-[009c7514 127.0.0.1:40369]-#1233%grid-1%-#23482%grid-1%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=009c7514-21ea-4393-97e5-afa0f35d8000, rmtAddr=/127.0.0.1:40369] [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,853][INFO ][tcp-disco-msg-worker-[]-#1229%grid-1%-#23478%grid-1%][TestTcpDiscoverySpi] New next node [newNext=TcpDiscoveryNode [id=009c7514-21ea-4393-97e5-afa0f35d8000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345524850, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false]] [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,854][INFO ][tcp-disco-srvr-[:47500]-#1225%grid-0%-#23359%grid-0%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=52493] [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,854][INFO ][tcp-disco-srvr-[:47500]-#1225%grid-0%-#23359%grid-0%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=52493] [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,855][INFO ][tcp-disco-sock-reader-[]-#1234%grid-0%-#23483%grid-0%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:52493, rmtPort=52493] [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,855][INFO ][tcp-disco-sock-reader-[1087f160 127.0.0.1:52493]-#1234%grid-0%-#23483%grid-0%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=1087f160-5e44-4f1a-9728-b1c507c3f001, rmtAddr=/127.0.0.1:52493] [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,858][INFO ][disco-event-worker-#23361%grid-0%][GridDiscoveryManager] Added new node to topology: TcpDiscoveryNode [id=1087f160-5e44-4f1a-9728-b1c507c3f001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637345524820, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false] [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,859][INFO ][disco-event-worker-#23361%grid-0%][GridDiscoveryManager] Topology snapshot [ver=2, locNode=009c7514, servers=2, clients=0, state=INACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=009c7514-21ea-4393-97e5-afa0f35d8000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=1087f160-5e44-4f1a-9728-b1c507c3f001, consistentId=grid-1, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,859][INFO ][disco-event-worker-#23361%grid-0%][GridDiscoveryManager] ^-- Baseline [id=0, size=2, online=2, offline=0] [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,860][INFO ][disco-event-worker-#23361%grid-0%][GridDiscoveryManager] ^-- All baseline nodes are online, will start auto-activation [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,864][INFO ][tcp-disco-msg-worker-[009c7514 127.0.0.1:47500]-#1229%grid-1%-#23478%grid-1%][GridEncryptionManager] Skip group key received from coordinator. Already exists. [grp=1613773252, keyId=1] [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,864][INFO ][tcp-disco-msg-worker-[009c7514 127.0.0.1:47500]-#1229%grid-1%-#23478%grid-1%][GridEncryptionManager] Skip group key received from coordinator. Already exists. [grp=-1368047376, keyId=1] [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,865][INFO ][disco-notifier-worker-#23477%grid-1%][MvccProcessorImpl] Assigned mvcc coordinator [crd=MvccCoordinator [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=0], nodeId=009c7514-21ea-4393-97e5-afa0f35d8000, ver=1637345524438, local=false, initialized=false]] [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,867][INFO ][disco-notifier-worker-#23477%grid-1%][GridClusterStateProcessor] Sending activate cluster request with BaselineTopology BaselineTopology [id=0, branchingHash=-2475315501, branchingType='Cluster activation', baselineNodes=[grid-1, grid-0]] [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,869][INFO ][sys-#23462%grid-1%][ClusterProcessor] Writing cluster ID and tag to metastorage on ready for write ClusterIdAndTag [id=3db7b4a7-4406-4d31-aef1-c8efa56d8f47, tag=zealous_brahmagupta] [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,871][INFO ][disco-notifier-worker-#23357%grid-0%][GridClusterStateProcessor] Received activate cluster request with BaselineTopology[id=0] initiator node ID: 1087f160-5e44-4f1a-9728-b1c507c3f001 [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,871][INFO ][disco-notifier-worker-#23357%grid-0%][GridClusterStateProcessor] Started state transition: activate cluster [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,872][INFO ][exchange-worker-#23362%grid-0%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], crd=true, evt=DISCOVERY_CUSTOM_EVT, evtNode=1087f160-5e44-4f1a-9728-b1c507c3f001, customEvt=ChangeGlobalStateMessage [id=cc5ad593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqId=c7e55c17-a118-4eb1-b28d-f108f89fc177, initiatingNodeId=1087f160-5e44-4f1a-9728-b1c507c3f001, state=ACTIVE, baselineTopology=BaselineTopology [id=0, branchingHash=-2475315501, branchingType='Cluster activation', baselineNodes=[grid-1, grid-0]], forceChangeBaselineTopology=false, timestamp=1637345524867, forceDeactivation=true], allowMerge=false, exchangeFreeSwitch=false] [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,872][INFO ][disco-notifier-worker-#23477%grid-1%][GridClusterStateProcessor] Received activate cluster request with BaselineTopology[id=0] initiator node ID: 1087f160-5e44-4f1a-9728-b1c507c3f001 [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,873][INFO ][exchange-worker-#23362%grid-0%][GridDhtPartitionsExchangeFuture] Start activation process [nodeId=009c7514-21ea-4393-97e5-afa0f35d8000, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]]. New state: ACTIVE [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,874][INFO ][disco-notifier-worker-#23477%grid-1%][GridClusterStateProcessor] Started state transition: activate cluster [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,874][INFO ][exchange-worker-#23362%grid-0%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0 [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,876][INFO ][exchange-worker-#23362%grid-0%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000000.wal, offset=172436, ver=2] [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,880][INFO ][exchange-worker-#23362%grid-0%][GridClusterStateProcessor] Writing BaselineTopology[id=0] [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,883][INFO ][exchange-worker-#23362%grid-0%][GridCacheDatabaseSharedManager] Finish recovery performed in 8 ms. [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,884][INFO ][exchange-worker-#23362%grid-0%][msg] Components activation performed in 10 ms. [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,886][INFO ][exchange-worker-#23490%grid-1%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], crd=false, evt=DISCOVERY_CUSTOM_EVT, evtNode=1087f160-5e44-4f1a-9728-b1c507c3f001, customEvt=ChangeGlobalStateMessage [id=cc5ad593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqId=c7e55c17-a118-4eb1-b28d-f108f89fc177, initiatingNodeId=1087f160-5e44-4f1a-9728-b1c507c3f001, state=ACTIVE, baselineTopology=BaselineTopology [id=0, branchingHash=-2475315501, branchingType='Cluster activation', baselineNodes=[grid-1, grid-0]], forceChangeBaselineTopology=false, timestamp=1637345524867, forceDeactivation=true], allowMerge=false, exchangeFreeSwitch=false] [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,888][INFO ][exchange-worker-#23490%grid-1%][GridDhtPartitionsExchangeFuture] Start activation process [nodeId=1087f160-5e44-4f1a-9728-b1c507c3f001, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]]. New state: ACTIVE [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,888][INFO ][exchange-worker-#23490%grid-1%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1 [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,889][INFO ][exchange-worker-#23362%grid-0%][GridCacheProcessor] Finished recovery for cache [cache=cache2, grp=cache2, startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,889][INFO ][sys-#23334%grid-0%][GridCacheProcessor] Finished recovery for cache [cache=ignite-sys-cache, grp=ignite-sys-cache, startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,889][INFO ][sys-#23350%grid-0%][GridCacheProcessor] Started cache [name=encrypted, id=1613773252, dataRegionName=default, mode=PARTITIONED, atomicity=ATOMIC, backups=0, mvcc=false] [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,891][INFO ][sys-#23336%grid-0%][GridAffinityAssignmentCache] Local node affinity assignment distribution is not ideal [cache=encrypted, expectedPrimary=8.00, actualPrimary=0, expectedBackups=0.00, actualBackups=0, warningThreshold=50.00%] [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,891][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] To start Console Management & Monitoring run ignitevisorcmd.{sh|bat} [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,892][INFO ][exchange-worker-#23490%grid-1%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000005.wal, offset=35659, ver=2] [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,892][INFO ][exchange-worker-#23362%grid-0%][GridDhtPartitionsExchangeFuture] Successfully activated caches [nodeId=009c7514-21ea-4393-97e5-afa0f35d8000, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], newState=ACTIVE] [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,893][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] [21:12:04] : [Step 4/5] [21:12:04] : [Step 4/5] >>> +-------------------------------------------+ [21:12:04] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:12:04] : [Step 4/5] >>> +-------------------------------------------+ [21:12:04] : [Step 4/5] >>> OS name: Linux 4.15.0-151-generic amd64 [21:12:04] : [Step 4/5] >>> CPU(s): 24 [21:12:04] : [Step 4/5] >>> Heap: 2.0GB [21:12:04] : [Step 4/5] >>> VM name: 16724@c4dfe9a430b2 [21:12:04] : [Step 4/5] >>> Ignite instance name: grid-1 [21:12:04] : [Step 4/5] >>> Local node [ID=1087F160-5E44-4F1A-9728-B1C507C3F001, order=2, clientMode=false] [21:12:04] : [Step 4/5] >>> Local node addresses: [127.0.0.1] [21:12:04] : [Step 4/5] >>> Local ports: TCP:10801 TCP:47101 TCP:47501 [21:12:04] : [Step 4/5] [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,893][INFO ][exchange-worker-#23490%grid-1%][GridClusterStateProcessor] Writing BaselineTopology[id=0] [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,893][INFO ][exchange-worker-#23362%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,894][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][GridDiscoveryManager] Topology snapshot [ver=2, locNode=1087f160, servers=2, clients=0, state=INACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=009c7514-21ea-4393-97e5-afa0f35d8000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=1087f160-5e44-4f1a-9728-b1c507c3f001, consistentId=grid-1, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,896][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][GridDiscoveryManager] ^-- Baseline [id=0, size=2, online=2, offline=0] [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,896][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][GridDiscoveryManager] ^-- All baseline nodes are online, will start auto-activation [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,896][INFO ][exchange-worker-#23490%grid-1%][GridCacheDatabaseSharedManager] Finish recovery performed in 7 ms. [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,897][INFO ][exchange-worker-#23362%grid-0%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], crd=true] [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,896][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][G] Node started : [stage="Configure system pool" (0 ms),stage="Start managers" (195 ms),stage="Configure binary metadata" (2 ms),stage="Start processors" (35 ms),stage="Start 'StanByClusterTestProvider' plugin" (0 ms),stage="Start 'PageMemory tracker plugin' plugin" (0 ms),stage="Start 'TestDistibutedConfigurationPlugin' plugin" (0 ms),stage="Start 'NodeValidationPluginProvider' plugin" (0 ms),stage="Init metastore" (26 ms),stage="Init and start regions" (8 ms),stage="Restore binary memory" (29 ms),stage="Restore logical state" (28 ms),stage="Finish recovery" (0 ms),stage="Join topology" (62 ms),stage="Await transition" (4 ms),stage="Await exchange" (26 ms),stage="Total time" (415 ms)] [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,899][INFO ][db-checkpoint-thread-#23496%grid-0%][Checkpointer] Checkpoint started [checkpointId=73a9fd3b-d070-4340-bb76-af31ff7ad02c, startPtr=WALPointer [idx=0, fileOff=255851, len=2127], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=2ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=0ms, pages=15, reason='node started'] [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,898][INFO ][exchange-worker-#23490%grid-1%][msg] Components activation performed in 10 ms. [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,900][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][root] Node started with the following configuration [id=1087f160-5e44-4f1a-9728-b1c507c3f001, marshaller=BinaryMarshaller [], discovery=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=5000, ackTimeout=5000, marsh=JdkMarshaller [clsFilter=org.apache.ignite.marshaller.MarshallerUtils$1@4a181a61], reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], binaryCfg=null, lateAff=true] [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,902][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][GridClusterStateProcessor] Sending activate cluster request with BaselineTopology BaselineTopology [id=0, branchingHash=-2475315501, branchingType='Cluster activation', baselineNodes=[grid-1, grid-0]] [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,905][INFO ][disco-notifier-worker-#23357%grid-0%][GridClusterStateProcessor] Received activate cluster request with BaselineTopology[id=0] initiator node ID: 009c7514-21ea-4393-97e5-afa0f35d8000 [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,906][INFO ][disco-notifier-worker-#23477%grid-1%][GridClusterStateProcessor] Received activate cluster request with BaselineTopology[id=0] initiator node ID: 009c7514-21ea-4393-97e5-afa0f35d8000 [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,907][INFO ][sys-#23473%grid-1%][GridCacheProcessor] Started cache [name=cache2, id=-1368047376, dataRegionName=default, mode=PARTITIONED, atomicity=ATOMIC, backups=0, mvcc=false] [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,907][INFO ][exchange-worker-#23490%grid-1%][GridCacheProcessor] Finished recovery for cache [cache=ignite-sys-cache, grp=ignite-sys-cache, startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,907][INFO ][sys-#23472%grid-1%][GridCacheProcessor] Finished recovery for cache [cache=encrypted, grp=encrypted, startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,908][INFO ][sys-#23467%grid-1%][GridAffinityAssignmentCache] Local node affinity assignment distribution is not ideal [cache=cache2, expectedPrimary=8.00, actualPrimary=0, expectedBackups=0.00, actualBackups=0, warningThreshold=50.00%] [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,909][INFO ][exchange-worker-#23490%grid-1%][GridDhtPartitionsExchangeFuture] Successfully activated caches [nodeId=1087f160-5e44-4f1a-9728-b1c507c3f001, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], newState=ACTIVE] [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,910][INFO ][exchange-worker-#23490%grid-1%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,916][INFO ][db-checkpoint-thread-#23496%grid-0%][Checkpointer] Checkpoint finished [cpId=73a9fd3b-d070-4340-bb76-af31ff7ad02c, pages=15, markPos=WALPointer [idx=0, fileOff=255851, len=2127], walSegmentsCovered=[], markDuration=4ms, pagesWrite=5ms, fsync=11ms, total=21ms] [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,928][INFO ][db-checkpoint-thread-#23506%grid-1%][Checkpointer] Checkpoint started [checkpointId=fab5f11f-f11b-44b3-97ef-448fb1e9db9d, startPtr=WALPointer [idx=5, fileOff=152346, len=2127], checkpointBeforeLockTime=15ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=1ms, writeCheckpointEntryDuration=2ms, splitAndSortCpPagesDuration=0ms, pages=23, reason='node started'] [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,939][INFO ][exchange-worker-#23490%grid-1%][GridCacheDatabaseSharedManager] Cache groups with earliest reserved checkpoint and a reason why a previous checkpoint was inapplicable: [[[grpId=1613773252, grpName=encrypted, cp=(51f7fb05-6c2b-4001-a89a-c9c91e977882, 11/19/2021 21:12:03)], reason=Checkpoint was marked as inapplicable for historical rebalancing]] [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,944][INFO ][grid-nio-worker-tcp-comm-0-#23299%TestRecordingCommunicationSpi%][TestRecordingCommunicationSpi] Accepted incoming communication connection [locAddr=/127.0.0.1:47100, rmtAddr=/127.0.0.1:34260] [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,946][INFO ][grid-nio-worker-tcp-comm-0-#23419%TestRecordingCommunicationSpi%][TestRecordingCommunicationSpi] Established outgoing communication connection [locAddr=/127.0.0.1:34260, rmtAddr=/127.0.0.1:47100] [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,946][INFO ][exchange-worker-#23490%grid-1%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], crd=false] [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,948][INFO ][sys-#23344%grid-0%][GridDhtPartitionsExchangeFuture] Coordinator received single message [ver=AffinityTopologyVersion [topVer=2, minorTopVer=1], node=1087f160-5e44-4f1a-9728-b1c507c3f001, allReceived=true] [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,949][INFO ][sys-#23344%grid-0%][GridDhtPartitionsExchangeFuture] finishExchangeOnCoordinator [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,954][INFO ][sys-#23344%grid-0%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], err=null, rebalanced=true, wasRebalanced=false] [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,955][INFO ][disco-notifier-worker-#23477%grid-1%][GridClusterStateProcessor] Received state change finish message: ACTIVE [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,955][INFO ][sys-#23457%grid-1%][GridDhtPartitionsExchangeFuture] Received full message, will finish exchange [node=009c7514-21ea-4393-97e5-afa0f35d8000, resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,954][INFO ][disco-notifier-worker-#23357%grid-0%][GridClusterStateProcessor] Received state change finish message: ACTIVE [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,956][INFO ][sys-#23464%grid-1%][GridCachePartitionExchangeManager] Delay process full message without exchange id (there is exchange in progress) [nodeId=009c7514-21ea-4393-97e5-afa0f35d8000] [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,956][INFO ][disco-notifier-worker-#23477%grid-1%][GridClusterStateProcessor] Cluster state was changed from INACTIVE to ACTIVE [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,958][INFO ][db-checkpoint-thread-#23506%grid-1%][Checkpointer] Checkpoint finished [cpId=fab5f11f-f11b-44b3-97ef-448fb1e9db9d, pages=23, markPos=WALPointer [idx=5, fileOff=152346, len=2127], walSegmentsCovered=[], markDuration=4ms, pagesWrite=10ms, fsync=19ms, total=48ms] [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,958][INFO ][sys-#23457%grid-1%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], err=null, rebalanced=true, wasRebalanced=false] [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,958][INFO ][sys-#23344%grid-0%][GridCacheProcessor] Finish proxy initialization, cacheName=ignite-sys-cache, localNodeId=009c7514-21ea-4393-97e5-afa0f35d8000 [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,956][INFO ][disco-notifier-worker-#23357%grid-0%][GridClusterStateProcessor] Cluster state was changed from INACTIVE to ACTIVE [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,960][INFO ][sys-#23344%grid-0%][GridCacheProcessor] Finish proxy initialization, cacheName=encrypted, localNodeId=009c7514-21ea-4393-97e5-afa0f35d8000 [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,961][INFO ][sys-#23344%grid-0%][GridCacheProcessor] Finish proxy initialization, cacheName=cache2, localNodeId=009c7514-21ea-4393-97e5-afa0f35d8000 [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,962][INFO ][sys-#23457%grid-1%][GridCacheProcessor] Finish proxy initialization, cacheName=ignite-sys-cache, localNodeId=1087f160-5e44-4f1a-9728-b1c507c3f001 [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,962][INFO ][sys-#23354%grid-0%][DistributedBaselineConfiguration] Baseline auto-adjust is 'disabled' with timeout='300000' ms [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,962][INFO ][sys-#23457%grid-1%][GridCacheProcessor] Finish proxy initialization, cacheName=encrypted, localNodeId=1087f160-5e44-4f1a-9728-b1c507c3f001 [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,962][INFO ][exchange-worker-#23362%grid-0%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=2, minorTopVer=1], force=false, evt=DISCOVERY_CUSTOM_EVT, node=1087f160-5e44-4f1a-9728-b1c507c3f001] [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,962][INFO ][sys-#23344%grid-0%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=009c7514-21ea-4393-97e5-afa0f35d8000, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=1087f160-5e44-4f1a-9728-b1c507c3f001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637345524820, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,963][INFO ][sys-#23457%grid-1%][GridCacheProcessor] Finish proxy initialization, cacheName=cache2, localNodeId=1087f160-5e44-4f1a-9728-b1c507c3f001 [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,962][INFO ][sys-#23354%grid-0%][GridClusterStateProcessor] Successfully performed final activation steps [nodeId=009c7514-21ea-4393-97e5-afa0f35d8000, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,966][INFO ][exchange-worker-#23490%grid-1%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=2, minorTopVer=1], force=false, evt=DISCOVERY_CUSTOM_EVT, node=1087f160-5e44-4f1a-9728-b1c507c3f001] [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,966][INFO ][sys-#23469%grid-1%][DistributedBaselineConfiguration] Baseline auto-adjust is 'disabled' with timeout='300000' ms [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,964][INFO ][sys-#23344%grid-0%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (1 ms), stage="Update caches registry" (11 ms), stage="Start caches" (5 ms), stage="Affinity initialization on cache group start" (1 ms), stage="Determine exchange type" (1 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (1 ms), stage="Restore partition states" (0 ms), stage="After states restored callback" (1 ms), stage="WAL history reservation" (0 ms), stage="Waiting for all single messages" (52 ms), stage="Affinity recalculation (crd)" (0 ms), stage="Collect update counters and create affinity messages" (0 ms), stage="Assign partitions states" (0 ms), stage="Validate partitions states" (0 ms), stage="Ideal affinity diff calculation (enforced)" (0 ms), stage="Apply update counters" (0 ms), stage="Full message preparing" (2 ms), stage="Full message sending" (0 ms), stage="State finish message sending" (0 ms), stage="Detect lost partitions" (2 ms), stage="Exchange done" (8 ms), stage="Total time" (85 ms), Discovery lag=2 ms, Latest started node id=1087f160-5e44-4f1a-9728-b1c507c3f001] [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,967][INFO ][sys-#23469%grid-1%][GridClusterStateProcessor] Successfully performed final activation steps [nodeId=1087f160-5e44-4f1a-9728-b1c507c3f001, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,966][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][root] awaitPartitionMapExchange finished [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,966][INFO ][sys-#23457%grid-1%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=1087f160-5e44-4f1a-9728-b1c507c3f001, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=1087f160-5e44-4f1a-9728-b1c507c3f001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637345524953, loc=true, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,969][INFO ][sys-#23344%grid-0%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], stage="Affinity initialization on cache group start [grp=ignite-sys-cache]" (1 ms) (parent=Affinity initialization on cache group start), stage="Affinity initialization on cache group start [grp=encrypted]" (1 ms) (parent=Affinity initialization on cache group start), stage="Affinity initialization on cache group start [grp=cache2]" (1 ms) (parent=Affinity initialization on cache group start), stage="Affinity centralized initialization (crd) [grp=ignite-sys-cache, crd=true]" (1 ms) (parent=Determine exchange type), stage="Affinity centralized initialization (crd) [grp=encrypted, crd=true]" (1 ms) (parent=Determine exchange type), stage="Affinity centralized initialization (crd) [grp=cache2, crd=true]" (0 ms) (parent=Determine exchange type), stage="Restore partition states [grp=ignite-sys-cache]" (0 ms) (parent=Restore partition states), stage="Restore partition states [grp=encrypted]" (0 ms) (parent=Restore partition states), stage="Restore partition states [grp=cache2]" (0 ms) (parent=Restore partition states), stage="Affinity recalculation (partitions availability) [grp=ignite-sys-cache]" (0 ms) (parent=Ideal affinity diff calculation (enforced)), stage="Affinity recalculation (partitions availability) [grp=encrypted]" (0 ms) (parent=Ideal affinity diff calculation (enforced)), stage="Affinity recalculation (partitions availability) [grp=cache2]" (0 ms) (parent=Ideal affinity diff calculation (enforced))] [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,972][INFO ][exchange-worker-#23490%grid-1%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], crd=false, evt=DISCOVERY_CUSTOM_EVT, evtNode=009c7514-21ea-4393-97e5-afa0f35d8000, customEvt=DynamicCacheChangeBatch [id=c16ad593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqs=ArrayList [DynamicCacheChangeRequest [cacheName=cacheX, hasCfg=true, nodeId=009c7514-21ea-4393-97e5-afa0f35d8000, clientStartOnly=false, stop=false, destroy=false, disabledAfterStart=false]], exchangeActions=ExchangeActions [startCaches=[cacheX], stopCaches=null, startGrps=[cacheX], stopGrps=[], resetParts=null, stateChangeRequest=null], startCaches=false], allowMerge=false, exchangeFreeSwitch=false] [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,972][INFO ][exchange-worker-#23362%grid-0%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], crd=true, evt=DISCOVERY_CUSTOM_EVT, evtNode=009c7514-21ea-4393-97e5-afa0f35d8000, customEvt=DynamicCacheChangeBatch [id=c16ad593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqs=ArrayList [DynamicCacheChangeRequest [cacheName=cacheX, hasCfg=true, nodeId=009c7514-21ea-4393-97e5-afa0f35d8000, clientStartOnly=false, stop=false, destroy=false, disabledAfterStart=false]], exchangeActions=ExchangeActions [startCaches=[cacheX], stopCaches=null, startGrps=[cacheX], stopGrps=[], resetParts=null, stateChangeRequest=null], startCaches=false], allowMerge=false, exchangeFreeSwitch=false] [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,970][INFO ][sys-#23457%grid-1%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], stage="Waiting in exchange queue" (11 ms), stage="Exchange parameters initialization" (1 ms), stage="Update caches registry" (13 ms), stage="Start caches" (6 ms), stage="Affinity initialization on cache group start" (0 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Restore partition states" (0 ms), stage="After states restored callback" (14 ms), stage="WAL history reservation" (14 ms), stage="Waiting for Full message" (15 ms), stage="Affinity recalculation" (1 ms), stage="Full map updating" (1 ms), stage="Detect lost partitions" (2 ms), stage="Exchange done" (10 ms), stage="Total time" (88 ms)] [21:12:04] : [Step 4/5] [2021-11-19 21:12:04,978][INFO ][sys-#23457%grid-1%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], stage="Affinity initialization on cache group start [grp=ignite-sys-cache]" (0 ms) (parent=Affinity initialization on cache group start), stage="Affinity initialization on cache group start [grp=encrypted]" (0 ms) (parent=Affinity initialization on cache group start), stage="Affinity initialization on cache group start [grp=cache2]" (0 ms) (parent=Affinity initialization on cache group start), stage="Affinity centralized initialization (crd) [grp=ignite-sys-cache, crd=false]" (0 ms) (parent=Determine exchange type), stage="Affinity centralized initialization (crd) [grp=encrypted, crd=false]" (0 ms) (parent=Determine exchange type), stage="Affinity centralized initialization (crd) [grp=cache2, crd=false]" (0 ms) (parent=Determine exchange type), stage="Restore partition states [grp=ignite-sys-cache]" (0 ms) (parent=Restore partition states), stage="Restore partition states [grp=encrypted]" (0 ms) (parent=Restore partition states), stage="Restore partition states [grp=cache2]" (0 ms) (parent=Restore partition states), stage="Affinity applying from full message [grp=ignite-sys-cache]" (1 ms) (parent=Affinity recalculation), stage="Affinity applying from full message [grp=encrypted]" (1 ms) (parent=Affinity recalculation), stage="Affinity applying from full message [grp=cache2]" (1 ms) (parent=Affinity recalculation)] [21:12:05] : [Step 4/5] [2021-11-19 21:12:05,059][INFO ][exchange-worker-#23490%grid-1%][GridCacheProcessor] Started cache [name=cacheX, id=-1368047338, dataRegionName=default, mode=PARTITIONED, atomicity=ATOMIC, backups=0, mvcc=false] [21:12:05] : [Step 4/5] [2021-11-19 21:12:05,059][INFO ][exchange-worker-#23362%grid-0%][GridCacheProcessor] Started cache [name=cacheX, id=-1368047338, dataRegionName=default, mode=PARTITIONED, atomicity=ATOMIC, backups=0, mvcc=false] [21:12:05] : [Step 4/5] [2021-11-19 21:12:05,061][INFO ][exchange-worker-#23490%grid-1%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], waitTime=0ms, futInfo=NA, mode=DISTRIBUTED] [21:12:05] : [Step 4/5] [2021-11-19 21:12:05,061][INFO ][exchange-worker-#23362%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], waitTime=0ms, futInfo=NA, mode=DISTRIBUTED] [21:12:05] : [Step 4/5] [2021-11-19 21:12:05,062][INFO ][exchange-worker-#23362%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partitions release latch: ServerLatch [permits=0, pendingAcks=HashSet [], super=CompletableLatch [id=CompletableLatchUid [id=exchange, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2]]]] [21:12:05] : [Step 4/5] [2021-11-19 21:12:05,062][INFO ][exchange-worker-#23490%grid-1%][GridDhtPartitionsExchangeFuture] Finished waiting for partitions release latch: ClientLatch [coordinator=TcpDiscoveryNode [id=009c7514-21ea-4393-97e5-afa0f35d8000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345524850, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], ackSent=true, super=CompletableLatch [id=CompletableLatchUid [id=exchange, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2]]]] [21:12:05] : [Step 4/5] [2021-11-19 21:12:05,063][INFO ][exchange-worker-#23362%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:12:05] : [Step 4/5] [2021-11-19 21:12:05,064][INFO ][exchange-worker-#23490%grid-1%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:12:05] : [Step 4/5] [2021-11-19 21:12:05,108][INFO ][exchange-worker-#23362%grid-0%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], crd=true] [21:12:05] : [Step 4/5] [2021-11-19 21:12:05,116][INFO ][exchange-worker-#23490%grid-1%][GridCacheDatabaseSharedManager] Cache groups with earliest reserved checkpoint and a reason why a previous checkpoint was inapplicable: [[[grpId=1613773252, grpName=encrypted, cp=(51f7fb05-6c2b-4001-a89a-c9c91e977882, 11/19/2021 21:12:03)], reason=Checkpoint was marked as inapplicable for historical rebalancing]] [21:12:05] : [Step 4/5] [2021-11-19 21:12:05,117][INFO ][exchange-worker-#23490%grid-1%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], crd=false] [21:12:05] : [Step 4/5] [2021-11-19 21:12:05,118][INFO ][sys-#23351%grid-0%][GridDhtPartitionsExchangeFuture] Coordinator received single message [ver=AffinityTopologyVersion [topVer=2, minorTopVer=2], node=1087f160-5e44-4f1a-9728-b1c507c3f001, allReceived=true] [21:12:05] : [Step 4/5] [2021-11-19 21:12:05,119][INFO ][sys-#23351%grid-0%][GridDhtPartitionsExchangeFuture] finishExchangeOnCoordinator [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2]] [21:12:05] : [Step 4/5] [2021-11-19 21:12:05,123][INFO ][sys-#23351%grid-0%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], err=null, rebalanced=true, wasRebalanced=true] [21:12:05] : [Step 4/5] [2021-11-19 21:12:05,124][INFO ][sys-#23465%grid-1%][GridDhtPartitionsExchangeFuture] Received full message, will finish exchange [node=009c7514-21ea-4393-97e5-afa0f35d8000, resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2]] [21:12:05] : [Step 4/5] [2021-11-19 21:12:05,124][INFO ][sys-#23351%grid-0%][GridCacheProcessor] Finish proxy initialization, cacheName=cacheX, localNodeId=009c7514-21ea-4393-97e5-afa0f35d8000 [21:12:05] : [Step 4/5] [2021-11-19 21:12:05,126][INFO ][sys-#23351%grid-0%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=009c7514-21ea-4393-97e5-afa0f35d8000, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=009c7514-21ea-4393-97e5-afa0f35d8000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345524963, loc=true, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2]] [21:12:05] : [Step 4/5] [2021-11-19 21:12:05,126][INFO ][exchange-worker-#23362%grid-0%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=2, minorTopVer=2], force=false, evt=DISCOVERY_CUSTOM_EVT, node=009c7514-21ea-4393-97e5-afa0f35d8000] [21:12:05] : [Step 4/5] [2021-11-19 21:12:05,126][INFO ][sys-#23465%grid-1%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], err=null, rebalanced=true, wasRebalanced=true] [21:12:05] : [Step 4/5] [2021-11-19 21:12:05,127][INFO ][sys-#23351%grid-0%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (4 ms), stage="Update caches registry" (0 ms), stage="Start caches" (83 ms), stage="Affinity initialization on cache group start" (1 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Wait partitions release latch [latch=exchange]" (0 ms), stage="Wait partitions release [latch=exchange]" (1 ms), stage="Restore partition states" (13 ms), stage="After states restored callback" (29 ms), stage="WAL history reservation" (0 ms), stage="Waiting for all single messages" (10 ms), stage="Affinity recalculation (crd)" (0 ms), stage="Collect update counters and create affinity messages" (0 ms), stage="Assign partitions states" (1 ms), stage="Validate partitions states" (0 ms), stage="Apply update counters" (0 ms), stage="Full message preparing" (2 ms), stage="Full message sending" (0 ms), stage="Exchange done" (3 ms), stage="Total time" (147 ms), Discovery lag=1 ms, Latest started node id=1087f160-5e44-4f1a-9728-b1c507c3f001] [21:12:05] : [Step 4/5] [2021-11-19 21:12:05,128][INFO ][sys-#23465%grid-1%][GridCacheProcessor] Finish proxy initialization, cacheName=cacheX, localNodeId=1087f160-5e44-4f1a-9728-b1c507c3f001 [21:12:05] : [Step 4/5] [2021-11-19 21:12:05,131][INFO ][sys-#23351%grid-0%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], stage="Affinity initialization on cache group start [grp=cacheX]" (1 ms) (parent=Affinity initialization on cache group start), stage="Restore partition states [grp=cacheX]" (13 ms) (parent=Restore partition states), stage="Restore partition states [grp=ignite-sys-cache]" (0 ms) (parent=Restore partition states), stage="Restore partition states [grp=encrypted]" (0 ms) (parent=Restore partition states)] [21:12:05] : [Step 4/5] [2021-11-19 21:12:05,132][INFO ][exchange-worker-#23490%grid-1%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=2, minorTopVer=2], force=false, evt=DISCOVERY_CUSTOM_EVT, node=009c7514-21ea-4393-97e5-afa0f35d8000] [21:12:05] : [Step 4/5] [2021-11-19 21:12:05,131][INFO ][sys-#23465%grid-1%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=1087f160-5e44-4f1a-9728-b1c507c3f001, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=009c7514-21ea-4393-97e5-afa0f35d8000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345524850, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2]] [21:12:05] : [Step 4/5] [2021-11-19 21:12:05,134][INFO ][sys-#23465%grid-1%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (2 ms), stage="Update caches registry" (0 ms), stage="Start caches" (84 ms), stage="Affinity initialization on cache group start" (1 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Wait partitions release latch [latch=exchange]" (2 ms), stage="Wait partitions release [latch=exchange]" (1 ms), stage="Restore partition states" (17 ms), stage="After states restored callback" (32 ms), stage="WAL history reservation" (2 ms), stage="Waiting for Full message" (7 ms), stage="Affinity recalculation" (0 ms), stage="Full map updating" (1 ms), stage="Exchange done" (8 ms), stage="Total time" (157 ms)] [21:12:05] : [Step 4/5] [2021-11-19 21:12:05,136][INFO ][sys-#23465%grid-1%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], stage="Affinity initialization on cache group start [grp=cacheX]" (1 ms) (parent=Affinity initialization on cache group start), stage="Restore partition states [grp=cacheX]" (17 ms) (parent=Restore partition states), stage="Restore partition states [grp=ignite-sys-cache]" (0 ms) (parent=Restore partition states), stage="Restore partition states [grp=encrypted]" (0 ms) (parent=Restore partition states)] [21:12:05] : [Step 4/5] [2021-11-19 21:12:05,346][INFO ][wal-file-archiver%grid-0-#23486%grid-0%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=0, segIdx=0, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000000.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000000.wal] [21:12:05] : [Step 4/5] [2021-11-19 21:12:05,357][INFO ][wal-file-archiver%grid-0-#23486%grid-0%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000000.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000000.wal] [21:12:05] : [Step 4/5] [2021-11-19 21:12:05,406][INFO ][wal-file-archiver%grid-1-#23493%grid-1%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=5, segIdx=5, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000005.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000005.wal] [21:12:05] : [Step 4/5] [2021-11-19 21:12:05,417][INFO ][wal-file-archiver%grid-1-#23493%grid-1%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000005.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000005.wal] [21:12:05] : [Step 4/5] [2021-11-19 21:12:05,679][INFO ][wal-file-archiver%grid-1-#23493%grid-1%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=6, segIdx=6, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000006.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000006.wal] [21:12:05] : [Step 4/5] [2021-11-19 21:12:05,694][INFO ][wal-file-archiver%grid-0-#23486%grid-0%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=1, segIdx=1, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000001.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000001.wal] [21:12:05] : [Step 4/5] [2021-11-19 21:12:05,695][INFO ][wal-file-archiver%grid-1-#23493%grid-1%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000006.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000006.wal] [21:12:05] : [Step 4/5] [2021-11-19 21:12:05,710][INFO ][wal-file-archiver%grid-0-#23486%grid-0%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000001.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000001.wal] [21:12:06] : [Step 4/5] [2021-11-19 21:12:06,734][INFO ][wal-file-archiver%grid-1-#23493%grid-1%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=7, segIdx=7, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000007.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000007.wal] [21:12:06] : [Step 4/5] [2021-11-19 21:12:06,743][INFO ][wal-file-archiver%grid-1-#23493%grid-1%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000007.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000007.wal] [21:12:06] : [Step 4/5] [2021-11-19 21:12:06,752][INFO ][wal-file-archiver%grid-0-#23486%grid-0%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=2, segIdx=2, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000002.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000002.wal] [21:12:06] : [Step 4/5] [2021-11-19 21:12:06,764][INFO ][wal-file-archiver%grid-0-#23486%grid-0%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000002.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000002.wal] [21:12:08] : [Step 4/5] [2021-11-19 21:12:08,571][INFO ][wal-file-archiver%grid-1-#23493%grid-1%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=8, segIdx=8, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000008.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000008.wal] [21:12:08] : [Step 4/5] [2021-11-19 21:12:08,586][INFO ][wal-file-archiver%grid-1-#23493%grid-1%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000008.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000008.wal] [21:12:08] : [Step 4/5] [2021-11-19 21:12:08,660][INFO ][wal-file-archiver%grid-0-#23486%grid-0%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=3, segIdx=3, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000003.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000003.wal] [21:12:08] : [Step 4/5] [2021-11-19 21:12:08,674][INFO ][wal-file-archiver%grid-0-#23486%grid-0%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000003.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000003.wal] [21:12:10] : [Step 4/5] [2021-11-19 21:12:10,241][INFO ][wal-file-archiver%grid-1-#23493%grid-1%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=9, segIdx=9, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000009.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000009.wal] [21:12:10] : [Step 4/5] [2021-11-19 21:12:10,597][INFO ][wal-file-archiver%grid-1-#23493%grid-1%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000009.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000009.wal] [21:12:10] : [Step 4/5] [2021-11-19 21:12:10,597][INFO ][wal-file-archiver%grid-1-#23493%grid-1%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=10, segIdx=0, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000000.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000010.wal] [21:12:10] : [Step 4/5] [2021-11-19 21:12:10,598][INFO ][wal-file-cleaner%grid-1-#23494%grid-1%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=1, currSize=10.0 MB, maxSize=20.0 MB] [21:12:10] : [Step 4/5] [2021-11-19 21:12:10,601][INFO ][wal-file-cleaner%grid-1-#23494%grid-1%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:12:10] : [Step 4/5] [2021-11-19 21:12:10,609][INFO ][wal-file-archiver%grid-1-#23493%grid-1%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000000.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000010.wal] [21:12:10] : [Step 4/5] [2021-11-19 21:12:10,609][INFO ][wal-file-archiver%grid-1-#23493%grid-1%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=11, segIdx=1, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000001.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000011.wal] [21:12:10] : [Step 4/5] [2021-11-19 21:12:10,610][INFO ][wal-file-cleaner%grid-1-#23494%grid-1%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=2, currSize=10.0 MB, maxSize=20.0 MB] [21:12:10] : [Step 4/5] [2021-11-19 21:12:10,612][INFO ][wal-file-cleaner%grid-1-#23494%grid-1%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:12:10] : [Step 4/5] [2021-11-19 21:12:10,622][INFO ][wal-file-archiver%grid-1-#23493%grid-1%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000001.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000011.wal] [21:12:10] : [Step 4/5] [2021-11-19 21:12:10,627][INFO ][db-checkpoint-thread-#23506%grid-1%][Checkpointer] Checkpoint started [checkpointId=4c91689d-fd8c-4618-8f4a-f036f1cc1f1a, startPtr=WALPointer [idx=12, fileOff=221878, len=12035], checkpointBeforeLockTime=356ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=2ms, checkpointLockHoldTime=3ms, walCpRecordFsyncDuration=7ms, writeCheckpointEntryDuration=14ms, splitAndSortCpPagesDuration=5ms, pages=5235, reason='too big size of WAL without checkpoint'] [21:12:10] : [Step 4/5] [2021-11-19 21:12:10,645][INFO ][wal-file-archiver%grid-1-#23493%grid-1%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=12, segIdx=2, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000002.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000012.wal] [21:12:10] : [Step 4/5] [2021-11-19 21:12:10,646][INFO ][wal-file-cleaner%grid-1-#23494%grid-1%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=3, currSize=10.0 MB, maxSize=20.0 MB] [21:12:10] : [Step 4/5] [2021-11-19 21:12:10,647][INFO ][wal-file-cleaner%grid-1-#23494%grid-1%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:12:10] : [Step 4/5] [2021-11-19 21:12:10,655][INFO ][wal-file-archiver%grid-1-#23493%grid-1%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000002.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000012.wal] [21:12:10] : [Step 4/5] [2021-11-19 21:12:10,712][INFO ][wal-file-archiver%grid-1-#23493%grid-1%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=13, segIdx=3, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000003.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000013.wal] [21:12:10] : [Step 4/5] [2021-11-19 21:12:10,713][INFO ][wal-file-cleaner%grid-1-#23494%grid-1%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=4, currSize=10.0 MB, maxSize=20.0 MB] [21:12:10] : [Step 4/5] [2021-11-19 21:12:10,717][INFO ][wal-file-cleaner%grid-1-#23494%grid-1%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:12:10] : [Step 4/5] [2021-11-19 21:12:10,717][INFO ][sys-#23467%grid-1%][GridEncryptionManager] Previous encryption keys have been removed [grpId=1613773252, keyIds=[0]] [21:12:10] : [Step 4/5] [2021-11-19 21:12:10,718][INFO ][sys-#23467%grid-1%][GridEncryptionManager] Previous encryption keys have been removed [grpId=-1368047376, keyIds=[0]] [21:12:10] : [Step 4/5] [2021-11-19 21:12:10,726][INFO ][wal-file-archiver%grid-1-#23493%grid-1%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000003.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000013.wal] [21:12:10]W: [org.apache.ignite:ignite-core] [2021-11-19 21:12:10,738][WARN ][checkpoint-runner-IO-#23513%grid-1%][CheckpointPagesWriterFactory] 1 checkpoint pages were not written yet due to unsuccessful page write lock acquisition and will be retried [21:12:10] : [Step 4/5] [2021-11-19 21:12:10,772][INFO ][wal-file-archiver%grid-1-#23493%grid-1%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=14, segIdx=4, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000004.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000014.wal] [21:12:10] : [Step 4/5] [2021-11-19 21:12:10,773][INFO ][wal-file-cleaner%grid-1-#23494%grid-1%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=5, currSize=10.0 MB, maxSize=20.0 MB] [21:12:10] : [Step 4/5] [2021-11-19 21:12:10,774][INFO ][wal-file-cleaner%grid-1-#23494%grid-1%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:12:10] : [Step 4/5] [2021-11-19 21:12:10,786][INFO ][wal-file-archiver%grid-1-#23493%grid-1%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000004.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000014.wal] [21:12:10] : [Step 4/5] [2021-11-19 21:12:10,897][INFO ][wal-file-archiver%grid-1-#23493%grid-1%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=15, segIdx=5, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000005.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000015.wal] [21:12:11] : [Step 4/5] [2021-11-19 21:12:10,989][INFO ][wal-file-archiver%grid-0-#23486%grid-0%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=4, segIdx=4, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000004.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000004.wal] [21:12:11] : [Step 4/5] [2021-11-19 21:12:11,221][INFO ][wal-file-archiver%grid-1-#23493%grid-1%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000005.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000015.wal] [21:12:11] : [Step 4/5] [2021-11-19 21:12:11,221][INFO ][wal-file-archiver%grid-0-#23486%grid-0%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000004.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000004.wal] [21:12:11] : [Step 4/5] [2021-11-19 21:12:11,229][INFO ][wal-file-archiver%grid-0-#23486%grid-0%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=5, segIdx=5, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000005.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000005.wal] [21:12:11] : [Step 4/5] [2021-11-19 21:12:11,250][INFO ][wal-file-archiver%grid-0-#23486%grid-0%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000005.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000005.wal] [21:12:11] : [Step 4/5] [2021-11-19 21:12:11,251][INFO ][wal-file-archiver%grid-0-#23486%grid-0%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=6, segIdx=6, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000006.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000006.wal] [21:12:11] : [Step 4/5] [2021-11-19 21:12:11,266][INFO ][wal-file-archiver%grid-0-#23486%grid-0%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000006.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000006.wal] [21:12:11] : [Step 4/5] [2021-11-19 21:12:11,280][INFO ][db-checkpoint-thread-#23496%grid-0%][Checkpointer] Checkpoint started [checkpointId=5869b02a-cd3e-4352-9507-b4cfa306c0db, startPtr=WALPointer [idx=7, fileOff=139370, len=11655], checkpointBeforeLockTime=158ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=2ms, checkpointLockHoldTime=2ms, walCpRecordFsyncDuration=14ms, writeCheckpointEntryDuration=9ms, splitAndSortCpPagesDuration=5ms, pages=5037, reason='too big size of WAL without checkpoint'] [21:12:11] : [Step 4/5] [2021-11-19 21:12:11,285][INFO ][wal-file-archiver%grid-1-#23493%grid-1%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=16, segIdx=6, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000006.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000016.wal] [21:12:11] : [Step 4/5] [2021-11-19 21:12:11,300][INFO ][wal-file-archiver%grid-1-#23493%grid-1%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000006.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000016.wal] [21:12:11] : [Step 4/5] [2021-11-19 21:12:11,329][INFO ][wal-file-archiver%grid-0-#23486%grid-0%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=7, segIdx=7, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000007.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000007.wal] [21:12:11] : [Step 4/5] [2021-11-19 21:12:11,345][INFO ][wal-file-archiver%grid-0-#23486%grid-0%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000007.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000007.wal] [21:12:11] : [Step 4/5] [2021-11-19 21:12:11,357][INFO ][wal-file-archiver%grid-1-#23493%grid-1%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=17, segIdx=7, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000007.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000017.wal] [21:12:11] : [Step 4/5] [2021-11-19 21:12:11,372][INFO ][wal-file-archiver%grid-1-#23493%grid-1%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000007.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000017.wal] [21:12:11] : [Step 4/5] [2021-11-19 21:12:11,394][INFO ][wal-file-archiver%grid-0-#23486%grid-0%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=8, segIdx=8, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000008.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000008.wal] [21:12:11] : [Step 4/5] [2021-11-19 21:12:11,408][INFO ][wal-file-archiver%grid-0-#23486%grid-0%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000008.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000008.wal] [21:12:11] : [Step 4/5] [2021-11-19 21:12:11,659][INFO ][wal-file-archiver%grid-0-#23486%grid-0%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=9, segIdx=9, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000009.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000009.wal] [21:12:11] : [Step 4/5] [2021-11-19 21:12:11,804][INFO ][wal-file-archiver%grid-0-#23486%grid-0%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000009.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000009.wal] [21:12:11] : [Step 4/5] [2021-11-19 21:12:11,804][INFO ][wal-file-archiver%grid-0-#23486%grid-0%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=10, segIdx=0, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000000.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000010.wal] [21:12:11] : [Step 4/5] [2021-11-19 21:12:11,818][INFO ][wal-file-archiver%grid-0-#23486%grid-0%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000000.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000010.wal] [21:12:11] : [Step 4/5] [2021-11-19 21:12:11,856][INFO ][wal-file-archiver%grid-0-#23486%grid-0%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=11, segIdx=1, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000001.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000011.wal] [21:12:11] : [Step 4/5] [2021-11-19 21:12:11,872][INFO ][wal-file-archiver%grid-0-#23486%grid-0%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000001.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000011.wal] [21:12:11] : [Step 4/5] [2021-11-19 21:12:11,903][INFO ][wal-file-archiver%grid-0-#23486%grid-0%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=12, segIdx=2, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000002.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000012.wal] [21:12:11] : [Step 4/5] [2021-11-19 21:12:11,919][INFO ][wal-file-archiver%grid-0-#23486%grid-0%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000002.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000012.wal] [21:12:12] : [Step 4/5] [2021-11-19 21:12:12,965][INFO ][wal-file-archiver%grid-1-#23493%grid-1%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=18, segIdx=8, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000008.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000018.wal] [21:12:12] : [Step 4/5] [2021-11-19 21:12:12,979][INFO ][wal-file-archiver%grid-1-#23493%grid-1%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000008.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000018.wal] [21:12:13] : [Step 4/5] [2021-11-19 21:12:13,918][INFO ][wal-file-archiver%grid-0-#23486%grid-0%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=13, segIdx=3, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000003.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000013.wal] [21:12:13] : [Step 4/5] [2021-11-19 21:12:13,933][INFO ][wal-file-archiver%grid-0-#23486%grid-0%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000003.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000013.wal] [21:12:15] : [Step 4/5] [2021-11-19 21:12:15,078][INFO ][wal-file-archiver%grid-1-#23493%grid-1%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=19, segIdx=9, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000009.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000019.wal] [21:12:15] : [Step 4/5] [2021-11-19 21:12:15,092][INFO ][wal-file-archiver%grid-1-#23493%grid-1%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000009.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000019.wal] [21:12:16] : [Step 4/5] [2021-11-19 21:12:16,231][INFO ][wal-file-archiver%grid-0-#23486%grid-0%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=14, segIdx=4, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000004.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000014.wal] [21:12:16] : [Step 4/5] [2021-11-19 21:12:16,343][INFO ][wal-file-archiver%grid-0-#23486%grid-0%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000004.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000014.wal] [21:12:17] : [Step 4/5] [2021-11-19 21:12:17,320][INFO ][wal-file-archiver%grid-1-#23493%grid-1%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=20, segIdx=0, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000000.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000020.wal] [21:12:17] : [Step 4/5] [2021-11-19 21:12:17,444][INFO ][wal-file-archiver%grid-1-#23493%grid-1%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000000.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000020.wal] [21:12:18] : [Step 4/5] [2021-11-19 21:12:18,438][INFO ][wal-file-archiver%grid-0-#23486%grid-0%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=15, segIdx=5, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000005.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000015.wal] [21:12:18] : [Step 4/5] [2021-11-19 21:12:18,543][INFO ][wal-file-archiver%grid-0-#23486%grid-0%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000005.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000015.wal] [21:12:19] : [Step 4/5] [2021-11-19 21:12:19,771][INFO ][wal-file-archiver%grid-1-#23493%grid-1%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=21, segIdx=1, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000001.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000021.wal] [21:12:19] : [Step 4/5] [2021-11-19 21:12:19,848][INFO ][wal-file-archiver%grid-1-#23493%grid-1%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000001.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000021.wal] [21:12:20] : [Step 4/5] [2021-11-19 21:12:20,998][INFO ][wal-file-archiver%grid-0-#23486%grid-0%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=16, segIdx=6, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000006.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000016.wal] [21:12:21] : [Step 4/5] [2021-11-19 21:12:21,012][INFO ][wal-file-archiver%grid-0-#23486%grid-0%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000006.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000016.wal] [21:12:21] : [Step 4/5] [2021-11-19 21:12:21,913][INFO ][wal-file-archiver%grid-1-#23493%grid-1%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=22, segIdx=2, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000002.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000022.wal] [21:12:22] : [Step 4/5] [2021-11-19 21:12:22,038][INFO ][wal-file-archiver%grid-1-#23493%grid-1%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000002.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000022.wal] [21:12:23] : [Step 4/5] [2021-11-19 21:12:23,407][INFO ][wal-file-archiver%grid-0-#23486%grid-0%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=17, segIdx=7, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000007.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000017.wal] [21:12:23] : [Step 4/5] [2021-11-19 21:12:23,424][INFO ][wal-file-archiver%grid-0-#23486%grid-0%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000007.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000017.wal] [21:12:24] : [Step 4/5] [2021-11-19 21:12:24,322][INFO ][wal-file-archiver%grid-1-#23493%grid-1%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=23, segIdx=3, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000003.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000023.wal] [21:12:24] : [Step 4/5] [2021-11-19 21:12:24,337][INFO ][wal-file-archiver%grid-1-#23493%grid-1%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000003.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000023.wal] [21:12:25] : [Step 4/5] [2021-11-19 21:12:25,141][INFO ][wal-file-cleaner%grid-1-#23494%grid-1%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=12, currSize=19.0 MB, maxSize=20.0 MB] [21:12:25] : [Step 4/5] [2021-11-19 21:12:25,141][INFO ][db-checkpoint-thread-#23506%grid-1%][Checkpointer] Checkpoint finished [cpId=4c91689d-fd8c-4618-8f4a-f036f1cc1f1a, pages=5235, markPos=WALPointer [idx=12, fileOff=221878, len=12035], walSegmentsCovered=[5 - 11], markDuration=30ms, pagesWrite=112ms, fsync=14401ms, total=14899ms] [21:12:25] : [Step 4/5] [2021-11-19 21:12:25,146][INFO ][wal-file-cleaner%grid-1-#23494%grid-1%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=7, currSize=12.0 MB, maxSize=20.0 MB] [21:12:25] : [Step 4/5] [2021-11-19 21:12:25,152][INFO ][wal-file-archiver%grid-1-#23493%grid-1%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=24, segIdx=4, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000004.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000024.wal] [21:12:25] : [Step 4/5] [2021-11-19 21:12:25,155][INFO ][wal-file-cleaner%grid-0-#23487%grid-0%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=7, currSize=18.0 MB, maxSize=20.0 MB] [21:12:25] : [Step 4/5] [2021-11-19 21:12:25,155][INFO ][db-checkpoint-thread-#23496%grid-0%][Checkpointer] Checkpoint finished [cpId=5869b02a-cd3e-4352-9507-b4cfa306c0db, pages=5037, markPos=WALPointer [idx=7, fileOff=139370, len=11655], walSegmentsCovered=[0 - 6], markDuration=31ms, pagesWrite=70ms, fsync=13804ms, total=14063ms] [21:12:25] : [Step 4/5] [2021-11-19 21:12:25,160][INFO ][wal-file-cleaner%grid-0-#23487%grid-0%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=7, currSize=11.0 MB, maxSize=20.0 MB] [21:12:25] : [Step 4/5] [2021-11-19 21:12:25,172][INFO ][wal-file-archiver%grid-0-#23486%grid-0%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=18, segIdx=8, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000008.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000018.wal] [21:12:25] : [Step 4/5] [2021-11-19 21:12:25,173][INFO ][wal-file-archiver%grid-1-#23493%grid-1%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000004.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000024.wal] [21:12:25] : [Step 4/5] [2021-11-19 21:12:25,174][INFO ][wal-file-archiver%grid-1-#23493%grid-1%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=25, segIdx=5, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000005.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000025.wal] [21:12:25] : [Step 4/5] [2021-11-19 21:12:25,173][INFO ][sys-#23349%grid-0%][GridEncryptionManager] Previous encryption keys have been removed [grpId=1613773252, keyIds=[0]] [21:12:25] : [Step 4/5] [2021-11-19 21:12:25,175][INFO ][sys-#23349%grid-0%][GridEncryptionManager] Previous encryption keys have been removed [grpId=-1368047376, keyIds=[0]] [21:12:25] : [Step 4/5] [2021-11-19 21:12:25,178][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=1087f160-5e44-4f1a-9728-b1c507c3f001, grp=1613773252] [21:12:25] : [Step 4/5] [2021-11-19 21:12:25,184][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=009c7514-21ea-4393-97e5-afa0f35d8000, grp=1613773252] [21:12:25] : [Step 4/5] [2021-11-19 21:12:25,202][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][root] Context doesn't exits on 009c7514-21ea-4393-97e5-afa0f35d8000 [21:12:25] : [Step 4/5] [2021-11-19 21:12:25,203][INFO ][wal-file-archiver%grid-1-#23493%grid-1%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000005.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000025.wal] [21:12:25] : [Step 4/5] [2021-11-19 21:12:25,204][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=1087f160-5e44-4f1a-9728-b1c507c3f001, grp=-1368047376] [21:12:25] : [Step 4/5] [2021-11-19 21:12:25,203][INFO ][wal-file-archiver%grid-0-#23486%grid-0%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000008.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000018.wal] [21:12:25] : [Step 4/5] [2021-11-19 21:12:25,204][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][root] Context doesn't exits on 1087f160-5e44-4f1a-9728-b1c507c3f001 [21:12:25] : [Step 4/5] [2021-11-19 21:12:25,204][INFO ][wal-file-archiver%grid-1-#23493%grid-1%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=26, segIdx=6, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000006.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000026.wal] [21:12:25] : [Step 4/5] [2021-11-19 21:12:25,205][INFO ][test-runner-#22967%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=009c7514-21ea-4393-97e5-afa0f35d8000, grp=-1368047376] [21:12:25] : [Step 4/5] [2021-11-19 21:12:25,205][INFO ][wal-file-archiver%grid-0-#23486%grid-0%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=19, segIdx=9, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000009.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000019.wal] [21:12:25] : [Step 4/5] [2021-11-19 21:12:25,232][INFO ][wal-file-archiver%grid-0-#23486%grid-0%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000009.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000019.wal] [21:12:25] : [Step 4/5] [2021-11-19 21:12:25,232][INFO ][wal-file-archiver%grid-1-#23493%grid-1%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000006.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000026.wal] [21:12:25] : [Step 4/5] [2021-11-19 21:12:25,233][INFO ][wal-file-archiver%grid-0-#23486%grid-0%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=20, segIdx=0, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000000.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000020.wal] [21:12:25] : [Step 4/5] [2021-11-19 21:12:25,234][INFO ][wal-file-archiver%grid-1-#23493%grid-1%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=27, segIdx=7, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000007.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000027.wal] [21:12:25] : [Step 4/5] [2021-11-19 21:12:25,259][INFO ][wal-file-archiver%grid-1-#23493%grid-1%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000007.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000027.wal] [21:12:25] : [Step 4/5] [2021-11-19 21:12:25,259][INFO ][wal-file-archiver%grid-0-#23486%grid-0%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000000.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000020.wal] [21:12:25] : [Step 4/5] [2021-11-19 21:12:25,261][INFO ][wal-file-archiver%grid-0-#23486%grid-0%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=21, segIdx=1, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000001.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000021.wal] [21:12:25] : [Step 4/5] [2021-11-19 21:12:25,276][INFO ][wal-file-archiver%grid-0-#23486%grid-0%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000001.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000021.wal] [21:12:25] : [Step 4/5] [2021-11-19 21:12:25,278][INFO ][db-checkpoint-thread-#23506%grid-1%][Checkpointer] Checkpoint started [checkpointId=34b94f1c-1abc-49f2-8b3a-bc1883f60303, startPtr=WALPointer [idx=28, fileOff=718584, len=12035], checkpointBeforeLockTime=93ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=2ms, checkpointLockHoldTime=3ms, walCpRecordFsyncDuration=21ms, writeCheckpointEntryDuration=17ms, splitAndSortCpPagesDuration=2ms, pages=3155, reason='too big size of WAL without checkpoint'] [21:12:25] : [Step 4/5] [2021-11-19 21:12:25,287][INFO ][db-checkpoint-thread-#23496%grid-0%][Checkpointer] Checkpoint started [checkpointId=2caab287-3bd6-4525-93cc-aeb23acf21f1, startPtr=WALPointer [idx=22, fileOff=884452, len=11655], checkpointBeforeLockTime=106ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=1ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=13ms, writeCheckpointEntryDuration=9ms, splitAndSortCpPagesDuration=2ms, pages=3022, reason='too big size of WAL without checkpoint'] [21:12:28] : [Step 4/5] [21:12:28] >>> Stopping test: CacheGroupKeyChangeTest#testKeyChangeWithNodeFilter in 25825 ms <<< [21:12:28] : [Step 4/5] [2021-11-19 21:12:28,109][INFO ][main][root] >>> Stopping test: CacheGroupKeyChangeTest#testKeyChangeWithNodeFilter in 25825 ms <<< [21:12:28] : [Step 4/5] [21:12:28] >>> Heap: 361 MB used / 1941 MB commited / 1941 MB max <<< [21:12:28] : [Step 4/5] [2021-11-19 21:12:28,110][INFO ][main][root] >>> Heap: 361 MB used / 1941 MB commited / 1941 MB max <<< [21:12:28] : [Step 4/5] [21:12:28] >>> Non-Heap: 168 MB used / 188 MB commited / 0 MB max <<< [21:12:28] : [Step 4/5] [2021-11-19 21:12:28,110][INFO ][main][root] >>> Non-Heap: 168 MB used / 188 MB commited / 0 MB max <<< [21:12:28] : [Step 4/5] [2021-11-19 21:12:28,111][INFO ][main][root] >>> Stopping grid [name=grid-1, id=1087f160-5e44-4f1a-9728-b1c507c3f001] [21:12:28] : [Step 4/5] [2021-11-19 21:12:28,417][INFO ][tcp-disco-sock-reader-[009c7514 127.0.0.1:40369]-#1233%grid-1%-#23482%grid-1%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:40369, rmtPort=40369, rmtNodeId=009c7514-21ea-4393-97e5-afa0f35d8000] [21:12:28] : [Step 4/5] [2021-11-19 21:12:28,418][INFO ][disco-event-worker-#23361%grid-0%][GridDiscoveryManager] Node left topology: TcpDiscoveryNode [id=1087f160-5e44-4f1a-9728-b1c507c3f001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637345524820, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false] [21:12:28] : [Step 4/5] [2021-11-19 21:12:28,419][INFO ][main][GridCacheProcessor] Stopped cache [cacheName=cache2] [21:12:28] : [Step 4/5] [2021-11-19 21:12:28,420][INFO ][main][GridCacheProcessor] Stopped cache [cacheName=encrypted] [21:12:28] : [Step 4/5] [2021-11-19 21:12:28,420][INFO ][disco-event-worker-#23361%grid-0%][GridDiscoveryManager] Topology snapshot [ver=3, locNode=009c7514, servers=1, clients=0, state=ACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=009c7514-21ea-4393-97e5-afa0f35d8000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:12:28] : [Step 4/5] [2021-11-19 21:12:28,420][INFO ][main][GridCacheProcessor] Stopped cache [cacheName=ignite-sys-cache] [21:12:28] : [Step 4/5] [2021-11-19 21:12:28,421][INFO ][disco-event-worker-#23361%grid-0%][GridDiscoveryManager] ^-- Baseline [id=0, size=2, online=1, offline=1] [21:12:28] : [Step 4/5] [2021-11-19 21:12:28,421][INFO ][main][GridCacheProcessor] Stopped cache [cacheName=cacheX] [21:12:28] : [Step 4/5] [2021-11-19 21:12:28,426][INFO ][exchange-worker-#23362%grid-0%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], crd=true, evt=NODE_LEFT, evtNode=1087f160-5e44-4f1a-9728-b1c507c3f001, customEvt=null, allowMerge=false, exchangeFreeSwitch=true] [21:12:28]W: [org.apache.ignite:ignite-core] [2021-11-19 21:12:28,429][WARN ][exchange-worker-#23362%grid-0%][ExchangeDiscoveryEvents] All server nodes for the following caches have left the cluster: 'encrypted' [21:12:28]W: [org.apache.ignite:ignite-core] [2021-11-19 21:12:28,430][WARN ][exchange-worker-#23362%grid-0%][ExchangeDiscoveryEvents] Must have server nodes for caches to operate. [21:12:28] : [Step 4/5] [2021-11-19 21:12:28,430][INFO ][exchange-worker-#23362%grid-0%][GridAffinityAssignmentCache] Local node affinity assignment distribution is not ideal [cache=encrypted, expectedPrimary=Infinity, actualPrimary=0, expectedBackups=NaN, actualBackups=0, warningThreshold=50.00%] [21:12:28] : [Step 4/5] [2021-11-19 21:12:28,430][INFO ][sys-#23333%grid-0%][GridAffinityAssignmentCache] Local node affinity assignment distribution is not ideal [cache=cacheX, expectedPrimary=1024.00, actualPrimary=502, expectedBackups=0.00, actualBackups=0, warningThreshold=50.00%] [21:12:28] : [Step 4/5] [2021-11-19 21:12:28,431][INFO ][exchange-worker-#23362%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:12:28] : [Step 4/5] [2021-11-19 21:12:28,433][INFO ][exchange-worker-#23362%grid-0%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], err=null, rebalanced=true, wasRebalanced=true] [21:12:28]W: [org.apache.ignite:ignite-core] [2021-11-19 21:12:28,434][WARN ][exchange-worker-#23362%grid-0%][GridDhtPartitionTopologyImpl] Detected lost partitions [grp=encrypted, parts=[0-7], topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0]] [21:12:28]W: [org.apache.ignite:ignite-core] [2021-11-19 21:12:28,434][WARN ][sys-#23354%grid-0%][GridDhtPartitionTopologyImpl] Detected lost partitions [grp=cacheX, parts=[0, 2, 4, 6-7, 10-11, 14, 17, 21, 24-30, 32, 37, 40, 44, 47-52, 54, 57, 59, 62-64, 67-68, 74-75, 78, 81, 87-88, 91, 97, 99, 101-102, 104-107, 113-114, 116, 118, 120, 122, 124, 135-136, 138, 140-145, 147, 149-152, 154-156, 159-160, 162-164, 169, 172, 175-177, 180, 184-187, 190-191, 194, 196-202, 204-205, 209-210, 212, 214, 216, 219-224, 226, 229-232, 237, 239, 241, 243-245, 247, 249-251, 255, 257, 261, 265, 269, 272-273, 276-277, 281-282, 285, 287, 289-291, 293-297, 299, 301-304, 306, 308-309, 311-312, 315-317, 319, 322, 325-326, 328-330, 336, 339, 341, 344-346, 350, 352-354, 357-361, 363, 366-367, 371-373, 376-380, 383, 385, 387-388, 390, 392, 395-397, 400, 402, 405, 408-411, 416, 420, 422, 424-425, 429, 433, 435-438, 440-441, 445-446, 450, 452-453, 455-456, 458, 460, 462-463, 465-468, 470, 474-475, 480, 488, 490-492, 495, 497, 499-512, 516, 525, 527-531, 535, 537-538, 541-542, 545-546, 548-552, 554-555, 558, 562-564, 567-569, 572, 574, 579-580, 582-585, 587, 590-591, 594, 596, 600, 602, 604, 607-614, 617-620, 623-624, 627-629, 632-633, 636, 638, 640-642, 645-646, 648-649, 657-662, 664-665, 668-672, 677-678, 682-684, 686, 689, 692-693, 695-697, 699, 706-707, 709-710, 712-714, 716-717, 719-721, 723-728, 730-732, 734-735, 739, 742, 746, 749-750, 752, 754, 756, 762, 768-770, 772-775, 778, 780, 783-787, 789-791, 793, 796, 798-801, 803, 806, 809-812, 814, 816-817, 819, 822-825, 827-829, 832-833, 836-837, 839-840, 846, 848-851, 853-854, 857-858, 860, 863-864, 866, 868-871, 873-875, 877-878, 884, 888-889, 896-897, 900, 905-907, 914-915, 917, 919-920, 923-925, 931-933, 936, 940, 942, 944-945, 948, 950-951, 954, 956-958, 962, 965-970, 972, 975-976, 978-980, 983, 985, 988, 990, 993-994, 997-998, 1000, 1003-1004, 1007, 1009, 1014, 1016, 1018-1019], topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0]] [21:12:28] : [Step 4/5] [2021-11-19 21:12:28,439][INFO ][exchange-worker-#23362%grid-0%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=009c7514-21ea-4393-97e5-afa0f35d8000, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], evt=NODE_LEFT, evtNode=TcpDiscoveryNode [id=1087f160-5e44-4f1a-9728-b1c507c3f001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637345524820, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0]] [21:12:28] : [Step 4/5] [2021-11-19 21:12:28,441][INFO ][exchange-worker-#23362%grid-0%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (3 ms), stage="Determine exchange type" (1 ms), stage="Preloading notification" (0 ms), stage="After states restored callback" (0 ms), stage="WAL history reservation" (0 ms), stage="Finalize update counters" (0 ms), stage="Detect lost partitions" (5 ms), stage="Exchange done" (2 ms), stage="Total time" (11 ms)] [21:12:28] : [Step 4/5] [2021-11-19 21:12:28,442][INFO ][exchange-worker-#23362%grid-0%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], stage="Affinity initialization (exchange-free switch on fully-rebalanced topology) [grp=encrypted]" (1 ms) (parent=Determine exchange type), stage="Affinity initialization (exchange-free switch on fully-rebalanced topology) [grp=cacheX]" (1 ms) (parent=Determine exchange type), stage="Affinity initialization (exchange-free switch on fully-rebalanced topology) [grp=ignite-sys-cache]" (0 ms) (parent=Determine exchange type)] [21:12:28] : [Step 4/5] [2021-11-19 21:12:28,443][INFO ][exchange-worker-#23362%grid-0%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], crd=true] [21:12:28] : [Step 4/5] [2021-11-19 21:12:28,444][INFO ][exchange-worker-#23362%grid-0%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=3, minorTopVer=0], force=false, evt=NODE_LEFT, node=1087f160-5e44-4f1a-9728-b1c507c3f001] [21:12:36] : [Step 4/5] [2021-11-19 21:12:36,845][INFO ][main][FilePageStoreManager] Cleanup cache stores [total=6, left=0, cleanFiles=false] [21:12:36] : [Step 4/5] [2021-11-19 21:12:36,845][INFO ][wal-file-cleaner%grid-0-#23487%grid-0%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=12, currSize=15.0 MB, maxSize=20.0 MB] [21:12:36] : [Step 4/5] [2021-11-19 21:12:36,846][INFO ][db-checkpoint-thread-#23496%grid-0%][Checkpointer] Checkpoint finished [cpId=2caab287-3bd6-4525-93cc-aeb23acf21f1, pages=3022, markPos=WALPointer [idx=22, fileOff=884452, len=11655], walSegmentsCovered=[7 - 21], markDuration=26ms, pagesWrite=46ms, fsync=11512ms, total=11690ms] [21:12:36] : [Step 4/5] [2021-11-19 21:12:36,848][INFO ][main][GridDeploymentLocalStore] Removed undeployed class: GridDeployment [ts=1637345524953, depMode=SHARED, clsLdr=IsolatedClassLoader{roleName='test'}, clsLdrId=806ad593d71-1087f160-5e44-4f1a-9728-b1c507c3f001, userVer=0, loc=true, sampleClsName=org.apache.ignite.internal.processors.cache.distributed.dht.preloader.IgniteDhtPartitionHistorySuppliersMap, pendingUndeploy=false, undeployed=true, usage=0] [21:12:36] : [Step 4/5] [2021-11-19 21:12:36,851][INFO ][wal-file-cleaner%grid-0-#23487%grid-0%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=5, currSize=10.0 MB, maxSize=20.0 MB] [21:12:36] : [Step 4/5] [2021-11-19 21:12:36,858][INFO ][main][IgniteKernal%grid-1] [21:12:36] : [Step 4/5] [21:12:36] : [Step 4/5] >>> +------------------------------------------------------+ [21:12:36] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV stopped OK [21:12:36] : [Step 4/5] >>> +------------------------------------------------------+ [21:12:36] : [Step 4/5] >>> Ignite instance name: grid-1 [21:12:36] : [Step 4/5] >>> Grid uptime: 00:00:31.963 [21:12:36] : [Step 4/5] [21:12:36] : [Step 4/5] [21:12:36] : [Step 4/5] [2021-11-19 21:12:36,859][INFO ][main][root] >>> Stopping grid [name=grid-0, id=009c7514-21ea-4393-97e5-afa0f35d8000] [21:12:36] : [Step 4/5] [2021-11-19 21:12:36,868][INFO ][db-checkpoint-thread-#23496%grid-0%][Checkpointer] Skipping checkpoint (no pages were modified) [checkpointBeforeLockTime=2ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=1ms, reason='timeout'] [21:12:36] : [Step 4/5] [2021-11-19 21:12:36,873][INFO ][tcp-disco-sock-reader-[1087f160 127.0.0.1:52493]-#1234%grid-0%-#23483%grid-0%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:52493, rmtPort=52493, rmtNodeId=1087f160-5e44-4f1a-9728-b1c507c3f001] [21:12:36] : [Step 4/5] [2021-11-19 21:12:36,875][INFO ][main][GridCacheProcessor] Stopped cache [cacheName=cache2] [21:12:36] : [Step 4/5] [2021-11-19 21:12:36,876][INFO ][main][GridCacheProcessor] Stopped cache [cacheName=encrypted] [21:12:36] : [Step 4/5] [2021-11-19 21:12:36,876][INFO ][main][GridCacheProcessor] Stopped cache [cacheName=ignite-sys-cache] [21:12:36] : [Step 4/5] [2021-11-19 21:12:36,876][INFO ][main][GridCacheProcessor] Stopped cache [cacheName=cacheX] [21:12:38] : [Step 4/5] [2021-11-19 21:12:38,012][INFO ][main][FilePageStoreManager] Cleanup cache stores [total=6, left=0, cleanFiles=false] [21:12:38] : [Step 4/5] [2021-11-19 21:12:38,014][INFO ][main][GridDeploymentLocalStore] Removed undeployed class: GridDeployment [ts=1637345524942, depMode=SHARED, clsLdr=IsolatedClassLoader{roleName='test'}, clsLdrId=606ad593d71-009c7514-21ea-4393-97e5-afa0f35d8000, userVer=0, loc=true, sampleClsName=org.apache.ignite.internal.processors.cache.distributed.dht.preloader.GridDhtPartitionMap, pendingUndeploy=false, undeployed=true, usage=0] [21:12:38] : [Step 4/5] [2021-11-19 21:12:38,023][INFO ][main][IgniteKernal%grid-0] [21:12:38] : [Step 4/5] [21:12:38] : [Step 4/5] >>> +------------------------------------------------------+ [21:12:38] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV stopped OK [21:12:38] : [Step 4/5] >>> +------------------------------------------------------+ [21:12:38] : [Step 4/5] >>> Ignite instance name: grid-0 [21:12:38] : [Step 4/5] >>> Grid uptime: 00:00:33.565 [21:12:38] : [Step 4/5] [21:12:38] : [Step 4/5] [21:12:38] : [Step 4/5] [21:12:38] >>> Starting test: CacheGroupKeyChangeTest#testRejectNodeJoinDuringRotation <<< [21:12:38] : [Step 4/5] [2021-11-19 21:12:38,109][INFO ][main][root] >>> Starting test: CacheGroupKeyChangeTest#testRejectNodeJoinDuringRotation <<< [21:12:38] : [Step 4/5] [21:12:38] >>> Heap: 369 MB used / 1941 MB commited / 1941 MB max <<< [21:12:38] : [Step 4/5] [2021-11-19 21:12:38,109][INFO ][main][root] >>> Heap: 369 MB used / 1941 MB commited / 1941 MB max <<< [21:12:38] : [Step 4/5] [21:12:38] >>> Non-Heap: 168 MB used / 188 MB commited / 0 MB max <<< [21:12:38] : [Step 4/5] [2021-11-19 21:12:38,109][INFO ][main][root] >>> Non-Heap: 168 MB used / 188 MB commited / 0 MB max <<< [21:12:38]W: [org.apache.ignite:ignite-core] [2021-11-19 21:12:38,117][WARN ][test-runner-#23520%encryption.CacheGroupKeyChangeTest%][G] Ignite work directory is not provided, automatically resolved to: /opt/buildagent/work/7bc1c54bc719b67c/work [21:12:38] : [Step 4/5] [2021-11-19 21:12:38,119][INFO ][test-runner-#23520%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] [21:12:38] : [Step 4/5] [21:12:38] : [Step 4/5] >>> __________ ________________ [21:12:38] : [Step 4/5] >>> / _/ ___/ |/ / _/_ __/ __/ [21:12:38] : [Step 4/5] >>> _/ // (7 7 // / / / / _/ [21:12:38] : [Step 4/5] >>> /___/\___/_/|_/___/ /_/ /___/ [21:12:38] : [Step 4/5] >>> [21:12:38] : [Step 4/5] >>> ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:12:38] : [Step 4/5] >>> 2021 Copyright(C) Apache Software Foundation [21:12:38] : [Step 4/5] >>> [21:12:38] : [Step 4/5] >>> Ignite documentation: http://ignite.apache.org [21:12:38] : [Step 4/5] [21:12:38] : [Step 4/5] [2021-11-19 21:12:38,120][INFO ][test-runner-#23520%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] Config URL: n/a [21:12:38] : [Step 4/5] [2021-11-19 21:12:38,121][INFO ][test-runner-#23520%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] IgniteConfiguration [igniteInstanceName=grid-0, pubPoolSize=24, svcPoolSize=24, callbackPoolSize=24, stripedPoolSize=24, sysPoolSize=24, mgmtPoolSize=4, dataStreamerPoolSize=24, utilityCachePoolSize=24, utilityCacheKeepAliveTime=60000, p2pPoolSize=2, qryPoolSize=24, buildIdxPoolSize=4, igniteHome=/opt/buildagent/work/7bc1c54bc719b67c, igniteWorkDir=/opt/buildagent/work/7bc1c54bc719b67c/work, mbeanSrv=com.sun.jmx.mbeanserver.JmxMBeanServer@6fe85038, nodeId=001abc23-c1d6-4b40-b2c7-02fda8a62000, marsh=BinaryMarshaller [], marshLocJobs=false, daemon=false, p2pEnabled=true, netTimeout=10000, netCompressionLevel=1, sndRetryDelay=1000, sndRetryCnt=3, metricsHistSize=10000, metricsUpdateFreq=1000, metricsExpTime=9223372036854775807, discoSpi=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=0, ackTimeout=0, marsh=null, reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], segPlc=STOP, segResolveAttempts=2, waitForSegOnStart=true, allResolversPassReq=true, segChkFreq=10000, commSpi=TcpCommunicationSpi [connectGate=org.apache.ignite.spi.communication.tcp.internal.ConnectGateway@5b881212, ctxInitLatch=java.util.concurrent.CountDownLatch@2e499ea4[Count = 1], stopping=false, clientPool=null, nioSrvWrapper=null, stateProvider=null], evtSpi=MemoryEventStorageSpi [expireAgeMs=9223372036854775807, expireCnt=10000, filter=null], colSpi=NoopCollisionSpi [], deploySpi=LocalDeploymentSpi [], indexingSpi=org.apache.ignite.spi.indexing.noop.NoopIndexingSpi@21e555c0, addrRslvr=null, encryptionSpi=org.apache.ignite.spi.encryption.keystore.KeystoreEncryptionSpi@4498344, tracingSpi=org.apache.ignite.spi.tracing.NoopTracingSpi@1a1ed479, clientMode=false, rebalanceThreadPoolSize=4, rebalanceTimeout=10000, rebalanceBatchesPrefetchCnt=3, rebalanceThrottle=0, rebalanceBatchSize=524288, txCfg=TransactionConfiguration [txSerEnabled=false, dfltIsolation=REPEATABLE_READ, dfltConcurrency=PESSIMISTIC, dfltTxTimeout=0, txTimeoutOnPartitionMapExchange=0, deadlockTimeout=10000, pessimisticTxLogSize=0, pessimisticTxLogLinger=10000, tmLookupClsName=null, txManagerFactory=null, useJtaSync=false], cacheSanityCheckEnabled=true, discoStartupDelay=60000, deployMode=SHARED, p2pMissedCacheSize=100, locHost=127.0.0.1, timeSrvPortBase=31100, timeSrvPortRange=100, failureDetectionTimeout=10000, sysWorkerBlockedTimeout=null, clientFailureDetectionTimeout=10000, metricsLogFreq=0, connectorCfg=null, odbcCfg=null, warmupClos=null, atomicCfg=AtomicConfiguration [seqReserveSize=1000, cacheMode=PARTITIONED, backups=1, aff=null, grpName=null], classLdr=null, sslCtxFactory=null, platformCfg=null, binaryCfg=null, memCfg=null, pstCfg=null, dsCfg=DataStorageConfiguration [sysRegionInitSize=41943040, sysRegionMaxSize=104857600, pageSize=4096, concLvl=0, dfltDataRegConf=DataRegionConfiguration [name=default, maxSize=104857600, initSize=268435456, swapPath=null, pageEvictionMode=DISABLED, pageReplacementMode=CLOCK, evictionThreshold=0.9, emptyPagesPoolSize=100, metricsEnabled=false, metricsSubIntervalCount=5, metricsRateTimeInterval=60000, persistenceEnabled=true, checkpointPageBufSize=0, lazyMemoryAllocation=true, warmUpCfg=null], dataRegions=null, storagePath=null, checkpointFreq=30000, lockWaitTime=10000, checkpointThreads=4, checkpointWriteOrder=SEQUENTIAL, walHistSize=20, maxWalArchiveSize=20971520, walSegments=10, walSegmentSize=1048576, walPath=db/wal, walArchivePath=db/wal/archive, cdcWalPath=db/wal/cdc, cdcEnabled=false, metricsEnabled=false, walMode=LOG_ONLY, walTlbSize=131072, walBuffSize=0, walFlushFreq=2000, walFsyncDelay=1000, walRecordIterBuffSize=67108864, alwaysWriteFullPages=false, fileIOFactory=org.apache.ignite.internal.processors.cache.persistence.file.AsyncFileIOFactory@3532fac5, metricsSubIntervalCnt=5, metricsRateTimeInterval=60000, walAutoArchiveAfterInactivity=-1, walForceArchiveTimeout=-1, writeThrottlingEnabled=false, walCompactionEnabled=false, walCompactionLevel=1, checkpointReadLockTimeout=null, walPageCompression=DISABLED, walPageCompressionLevel=null, dfltWarmUpCfg=null, encCfg=org.apache.ignite.configuration.EncryptionConfiguration@468c213f, defragmentationThreadPoolSize=4, minWalArchiveSize=-1], snapshotPath=snapshots, activeOnStart=true, activeOnStartPropSetFlag=false, autoActivation=true, autoActivationPropSetFlag=false, clusterStateOnStart=null, sqlConnCfg=null, cliConnCfg=ClientConnectorConfiguration [host=null, port=10800, portRange=100, sockSndBufSize=0, sockRcvBufSize=0, tcpNoDelay=true, maxOpenCursorsPerConn=128, threadPoolSize=24, selectorCnt=12, idleTimeout=0, handshakeTimeout=10000, jdbcEnabled=true, odbcEnabled=true, thinCliEnabled=true, sslEnabled=false, useIgniteSslCtxFactory=true, sslClientAuth=false, sslCtxFactory=null, thinCliCfg=ThinClientConfiguration [maxActiveTxPerConn=100, maxActiveComputeTasksPerConn=0]], mvccVacuumThreadCnt=2, mvccVacuumFreq=5000, authEnabled=false, failureHnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]], commFailureRslvr=null, sqlCfg=SqlConfiguration [longQryWarnTimeout=3000, dfltQryTimeout=0, sqlQryHistSize=1000, validationEnabled=false], asyncContinuationExecutor=null] [21:12:38] : [Step 4/5] [2021-11-19 21:12:38,130][INFO ][test-runner-#23520%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] Daemon mode: off [21:12:38] : [Step 4/5] [2021-11-19 21:12:38,130][INFO ][test-runner-#23520%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] OS: Linux 4.15.0-151-generic amd64 [21:12:38] : [Step 4/5] [2021-11-19 21:12:38,130][INFO ][test-runner-#23520%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] OS user: teamcity [21:12:38] : [Step 4/5] [2021-11-19 21:12:38,131][INFO ][test-runner-#23520%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] PID: 16724 [21:12:38] : [Step 4/5] [2021-11-19 21:12:38,131][INFO ][test-runner-#23520%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] Language runtime: Java Platform API Specification ver. 1.8 [21:12:38] : [Step 4/5] [2021-11-19 21:12:38,131][INFO ][test-runner-#23520%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] VM information: Java(TM) SE Runtime Environment 1.8.0_261-b12 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 25.261-b12 [21:12:38] : [Step 4/5] [2021-11-19 21:12:38,132][INFO ][test-runner-#23520%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] VM total memory: 1.9GB [21:12:38] : [Step 4/5] [2021-11-19 21:12:38,132][INFO ][test-runner-#23520%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] Remote Management [restart: off, REST: off, JMX (remote: off)] [21:12:38] : [Step 4/5] [2021-11-19 21:12:38,132][INFO ][test-runner-#23520%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] Logger: GridTestLog4jLogger [quiet=false, config=null] [21:12:38] : [Step 4/5] [2021-11-19 21:12:38,132][INFO ][test-runner-#23520%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] IGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c [21:12:38] : [Step 4/5] [2021-11-19 21:12:38,133][INFO ][test-runner-#23520%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] VM arguments: [-DIGNITE_DUMP_THREADS_ON_FAILURE=false, -DMono=/usr/bin/mono-sgen, -DMono4.0_x64=/usr/lib/mono/4.0, -DMono4.5_x64=/usr/lib/mono/4.5, -DMonoVersion=6.12.0.90, -DSKIP_BUILD=false, -Dagent.home.dir=/opt/buildagent, -Dagent.name=aitc-lin02_03, -Dagent.ownPort=9090, -Dagent.work.dir=/opt/buildagent/work, -Dbuild.number=95, -Dbuild.vcs.number=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.1=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.GitHubApacheIgnite=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dclassworlds.conf=/opt/buildagent/temp/buildTmp/teamcity.m2.conf, -Dcom.jetbrains.maven.watcher.report.file=/opt/buildagent/temp/buildTmp/maven-build-info.xml, -Djava.io.tmpdir=/opt/buildagent/temp/buildTmp, -Dmaven.home=/opt/buildagent/tools/maven3_6, -Dmaven.multiModuleProjectDirectory=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.agent.cpuBenchmark=457, -Dteamcity.agent.dotnet.agent_url=http://localhost:9090/RPC2, -Dteamcity.agent.dotnet.build_id=6278078, -Dteamcity.auth.password=*******, -Dteamcity.auth.userId=TeamCityBuildId=6278078, -Dteamcity.build.changedFiles.file=/opt/buildagent/temp/buildTmp/changedFiles6342607772318147725.txt, -Dteamcity.build.checkoutDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.build.id=6278078, -Dteamcity.build.properties.file=/opt/buildagent/temp/buildTmp/teamcity.build5164517880467851002.properties, -Dteamcity.build.tempDir=/opt/buildagent/temp/buildTmp, -Dteamcity.build.workingDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.buildConfName=Basic 3, -Dteamcity.buildType.id=IgniteTests24Java8_Basic3, -Dteamcity.configuration.properties.file=/opt/buildagent/temp/buildTmp/teamcity.config5591980786735343870.properties, -Dteamcity.maven.userSettings.path=/opt/buildagent/temp/buildTmp/maven_settings_585072866407032347.xml, -Dteamcity.maven.watcher.home=/opt/buildagent/plugins/mavenPlugin/maven-watcher-jdk16, -Dteamcity.projectName=Ignite Tests 2.x (JDK 8/11), -Dteamcity.runner.properties.file=/opt/buildagent/temp/buildTmp/teamcity.runner9098465561618137420.properties, -Dteamcity.tests.recentlyFailedTests.file=/opt/buildagent/temp/buildTmp/testsToRunFirst3891775683130404069.txt, -Dteamcity.version=2021.2 (build 99542), -ea, -Xms2g, -Xmx2g, -XX:+HeapDumpOnOutOfMemoryError, -DIGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_TEST_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_UPDATE_NOTIFIER=false, -DIGNITE_NO_DISCO_ORDER=true, -DIGNITE_PERFORMANCE_SUGGESTIONS_DISABLED=true, -Djava.net.preferIPv4Stack=true, -DTEST_SCALE_FACTOR=1.0, -DIGNITE_TEST_PROP_LOG4J_FILE=log4j-tc-test.xml, -DIGNITE_QUIET=false, -DIGNITE_MARSHAL_BUFFERS_RECHECK=1000, -Dmaven.repo.local=/opt/buildagent/.m2/repository] [21:12:38] : [Step 4/5] [2021-11-19 21:12:38,138][INFO ][test-runner-#23520%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] System cache's DataRegion size is configured to 40 MB. Use DataStorageConfiguration.systemRegionInitialSize property to change the setting. [21:12:38] : [Step 4/5] [2021-11-19 21:12:38,138][INFO ][test-runner-#23520%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] Configured caches [in 'sysMemPlc' dataRegion: ['ignite-sys-cache']] [21:12:38]W: [org.apache.ignite:ignite-core] [2021-11-19 21:12:38,138][WARN ][test-runner-#23520%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] Peer class loading is enabled (disable it in production for performance and deployment consistency reasons) [21:12:38] : [Step 4/5] [2021-11-19 21:12:38,139][INFO ][test-runner-#23520%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] 3-rd party licenses can be found at: /opt/buildagent/work/7bc1c54bc719b67c/libs/licenses [21:12:38] : [Step 4/5] [2021-11-19 21:12:38,143][INFO ][test-runner-#23520%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] Configured plugins: [21:12:38] : [Step 4/5] [2021-11-19 21:12:38,143][INFO ][test-runner-#23520%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- StanByClusterTestProvider 1.0 [21:12:38] : [Step 4/5] [2021-11-19 21:12:38,143][INFO ][test-runner-#23520%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:12:38] : [Step 4/5] [2021-11-19 21:12:38,143][INFO ][test-runner-#23520%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] [21:12:38] : [Step 4/5] [2021-11-19 21:12:38,143][INFO ][test-runner-#23520%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- PageMemory tracker plugin 1.0 [21:12:38] : [Step 4/5] [2021-11-19 21:12:38,144][INFO ][test-runner-#23520%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:12:38] : [Step 4/5] [2021-11-19 21:12:38,144][INFO ][test-runner-#23520%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] [21:12:38] : [Step 4/5] [2021-11-19 21:12:38,144][INFO ][test-runner-#23520%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- TestDistibutedConfigurationPlugin 1.0 [21:12:38] : [Step 4/5] [2021-11-19 21:12:38,144][INFO ][test-runner-#23520%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:12:38] : [Step 4/5] [2021-11-19 21:12:38,145][INFO ][test-runner-#23520%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] [21:12:38] : [Step 4/5] [2021-11-19 21:12:38,145][INFO ][test-runner-#23520%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- NodeValidationPluginProvider 1.0 [21:12:38] : [Step 4/5] [2021-11-19 21:12:38,145][INFO ][test-runner-#23520%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:12:38] : [Step 4/5] [2021-11-19 21:12:38,145][INFO ][test-runner-#23520%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] [21:12:38] : [Step 4/5] [2021-11-19 21:12:38,145][INFO ][test-runner-#23520%encryption.CacheGroupKeyChangeTest%][FailureProcessor] Configured failure handler: [hnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]]] [21:12:38] : [Step 4/5] [2021-11-19 21:12:38,155][INFO ][test-runner-#23520%encryption.CacheGroupKeyChangeTest%][TestRecordingCommunicationSpi] Successfully bound communication NIO server to TCP port [port=47100, locHost=/127.0.0.1, selectorsCnt=12, selectorSpins=0, pairedConn=false] [21:12:38]W: [org.apache.ignite:ignite-core] [2021-11-19 21:12:38,156][WARN ][test-runner-#23520%encryption.CacheGroupKeyChangeTest%][TestRecordingCommunicationSpi] Message queue limit is set to 0 which may lead to potential OOMEs when running cache operations in FULL_ASYNC or PRIMARY_SYNC modes due to message queues growth on sender and receiver sides. [21:12:38] : [Step 4/5] [2021-11-19 21:12:38,160][INFO ][test-runner-#23520%encryption.CacheGroupKeyChangeTest%][GridCollisionManager] Collision resolution is disabled (all jobs will be activated upon arrival). [21:12:38] : [Step 4/5] [2021-11-19 21:12:38,160][INFO ][test-runner-#23520%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] Security status [authentication=off, sandbox=off, tls/ssl=off] [21:12:38] : [Step 4/5] [2021-11-19 21:12:38,221][INFO ][test-runner-#23520%encryption.CacheGroupKeyChangeTest%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:12:38] : [Step 4/5] [2021-11-19 21:12:38,308][INFO ][test-runner-#23520%encryption.CacheGroupKeyChangeTest%][MaintenanceProcessor] Resolved store directory for node persistent data: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0 [21:12:38] : [Step 4/5] [2021-11-19 21:12:38,310][INFO ][test-runner-#23520%encryption.CacheGroupKeyChangeTest%][CacheObjectBinaryProcessorImpl] Resolved directory for serialized binary metadata: /opt/buildagent/work/7bc1c54bc719b67c/work/db/binary_meta/grid_0 [21:12:38] : [Step 4/5] [2021-11-19 21:12:38,314][INFO ][test-runner-#23520%encryption.CacheGroupKeyChangeTest%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0 [21:12:38] : [Step 4/5] [2021-11-19 21:12:38,315][INFO ][test-runner-#23520%encryption.CacheGroupKeyChangeTest%][FileWriteAheadLogManager] Resolved write ahead log work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0 [21:12:38] : [Step 4/5] [2021-11-19 21:12:38,315][INFO ][test-runner-#23520%encryption.CacheGroupKeyChangeTest%][FileWriteAheadLogManager] Resolved write ahead log archive directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0 [21:12:38] : [Step 4/5] [2021-11-19 21:12:38,510][INFO ][test-runner-#23520%encryption.CacheGroupKeyChangeTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000000.wal [21:12:38] : [Step 4/5] [2021-11-19 21:12:38,510][INFO ][test-runner-#23520%encryption.CacheGroupKeyChangeTest%][FileHandleManagerImpl] Initialized write-ahead log manager [mode=LOG_ONLY] [21:12:38]W: [org.apache.ignite:ignite-core] [2021-11-19 21:12:38,511][WARN ][test-runner-#23520%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] DataRegion maxSize=104.9 MB is smaller than defaultInitialSize=268.4 MB, setting initialSize to 104.9 MB [21:12:38] : [Step 4/5] [2021-11-19 21:12:38,516][INFO ][test-runner-#23520%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Configured data regions initialized successfully [total=5] [21:12:38] : [Step 4/5] [2021-11-19 21:12:38,574][INFO ][test-runner-#23520%encryption.CacheGroupKeyChangeTest%][IgniteSnapshotManager] Resolved snapshot work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/snapshots [21:12:38] : [Step 4/5] [2021-11-19 21:12:38,574][INFO ][test-runner-#23520%encryption.CacheGroupKeyChangeTest%][IgniteSnapshotManager] Resolved temp directory for snapshot creation: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0/snp [21:12:38] : [Step 4/5] [2021-11-19 21:12:38,577][INFO ][test-runner-#23520%encryption.CacheGroupKeyChangeTest%][ClientListenerProcessor] Client connector processor has started on TCP port 10800 [21:12:38] : [Step 4/5] [2021-11-19 21:12:38,583][INFO ][test-runner-#23520%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] Non-loopback local IPs: 172.17.0.4 [21:12:38] : [Step 4/5] [2021-11-19 21:12:38,584][INFO ][test-runner-#23520%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] Enabled local MACs: 0242AC110004 [21:12:38] : [Step 4/5] [2021-11-19 21:12:38,586][INFO ][test-runner-#23520%encryption.CacheGroupKeyChangeTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:12:38] : [Step 4/5] [2021-11-19 21:12:38,588][INFO ][test-runner-#23520%encryption.CacheGroupKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:12:38] : [Step 4/5] [2021-11-19 21:12:38,588][INFO ][test-runner-#23520%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:12:38] : [Step 4/5] [2021-11-19 21:12:38,590][INFO ][test-runner-#23520%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Applying lost metastore updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:12:38] : [Step 4/5] [2021-11-19 21:12:38,591][INFO ][test-runner-#23520%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=0 ms] [21:12:38] : [Step 4/5] [2021-11-19 21:12:38,591][INFO ][test-runner-#23520%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Restoring partition state for local groups. [21:12:38] : [Step 4/5] [2021-11-19 21:12:38,592][INFO ][test-runner-#23520%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=0, partitionsProcessed=0, time=0ms] [21:12:38] : [Step 4/5] [2021-11-19 21:12:38,592][INFO ][test-runner-#23520%encryption.CacheGroupKeyChangeTest%][GridEncryptionManager] Encryption keys loaded from metastore. [grps=, masterKeyName=ignite.master.key] [21:12:38] : [Step 4/5] [2021-11-19 21:12:38,597][INFO ][test-runner-#23520%encryption.CacheGroupKeyChangeTest%][ClusterProcessor] Cluster ID and tag has been read from metastorage: null [21:12:38] : [Step 4/5] [2021-11-19 21:12:38,597][INFO ][test-runner-#23520%encryption.CacheGroupKeyChangeTest%][IgniteClusterImpl] Shutdown policy was updated [oldVal=null, newVal=null] [21:12:38] : [Step 4/5] [2021-11-19 21:12:38,598][INFO ][test-runner-#23520%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Checkpoint frequency deviation changed [oldVal=null, newVal=null] [21:12:38] : [Step 4/5] [2021-11-19 21:12:38,834][INFO ][test-runner-#23520%encryption.CacheGroupKeyChangeTest%][FilePageStoreManager] Cleanup cache stores [total=1, left=0, cleanFiles=false] [21:12:38] : [Step 4/5] [2021-11-19 21:12:38,837][INFO ][test-runner-#23520%encryption.CacheGroupKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:12:38] : [Step 4/5] [2021-11-19 21:12:38,837][INFO ][test-runner-#23520%encryption.CacheGroupKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:12:38] : [Step 4/5] [2021-11-19 21:12:38,839][INFO ][test-runner-#23520%encryption.CacheGroupKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:12:38] : [Step 4/5] [2021-11-19 21:12:38,839][INFO ][test-runner-#23520%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Data Regions Started: 5 [21:12:38] : [Step 4/5] [2021-11-19 21:12:38,840][INFO ][test-runner-#23520%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] ^-- sysMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:12:38] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:12:38] : [Step 4/5] ^-- default region [type=default, persistence=true, lazyAlloc=true, [21:12:38] : [Step 4/5] ... initCfg=100MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB, allocTotal=0MB] [21:12:38] : [Step 4/5] ^-- metastoreMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:12:38] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:12:38] : [Step 4/5] ^-- TxLog region [type=internal, persistence=true, lazyAlloc=false, [21:12:38] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:12:38] : [Step 4/5] ^-- volatileDsMemPlc region [type=user, persistence=false, lazyAlloc=true, [21:12:38] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB] [21:12:38] : [Step 4/5] ^-- Ignite persistence [used=0MB] [21:12:38] : [Step 4/5] [21:12:38] : [Step 4/5] [2021-11-19 21:12:38,842][INFO ][test-runner-#23520%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Starting binary memory restore for: [-2100569601] [21:12:38] : [Step 4/5] [2021-11-19 21:12:38,850][INFO ][test-runner-#23520%encryption.CacheGroupKeyChangeTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:12:38] : [Step 4/5] [2021-11-19 21:12:38,850][INFO ][test-runner-#23520%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:12:38] : [Step 4/5] [2021-11-19 21:12:38,853][INFO ][test-runner-#23520%encryption.CacheGroupKeyChangeTest%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000000.wal, offset=0, ver=2] [21:12:38] : [Step 4/5] [2021-11-19 21:12:38,855][INFO ][test-runner-#23520%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Started cache in recovery mode [name=ignite-sys-cache, id=-2100569601, dataRegionName=sysMemPlc, mode=REPLICATED, atomicity=TRANSACTIONAL, backups=2147483647, mvcc=false] [21:12:38] : [Step 4/5] [2021-11-19 21:12:38,856][INFO ][test-runner-#23520%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Binary recovery performed in 14 ms. [21:12:38] : [Step 4/5] [2021-11-19 21:12:38,856][INFO ][test-runner-#23520%encryption.CacheGroupKeyChangeTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:12:38] : [Step 4/5] [2021-11-19 21:12:38,856][INFO ][test-runner-#23520%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Applying lost cache updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:12:38] : [Step 4/5] [2021-11-19 21:12:38,858][INFO ][test-runner-#23520%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=10 ms] [21:12:38] : [Step 4/5] [2021-11-19 21:12:38,859][INFO ][test-runner-#23520%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Restoring partition state for local groups. [21:12:38] : [Step 4/5] [2021-11-19 21:12:38,862][INFO ][test-runner-#23520%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=1, partitionsProcessed=100, time=0ms] [21:12:38] : [Step 4/5] [2021-11-19 21:12:38,912][INFO ][test-runner-#23520%encryption.CacheGroupKeyChangeTest%][TestTcpDiscoverySpi] Successfully bound to TCP port [port=47500, localHost=localhost/127.0.0.1, locNodeId=001abc23-c1d6-4b40-b2c7-02fda8a62000] [21:12:38] : [Step 4/5] [2021-11-19 21:12:38,923][INFO ][disco-notifier-worker-#23632%grid-0%][MvccProcessorImpl] Assigned mvcc coordinator [crd=MvccCoordinator [topVer=AffinityTopologyVersion [topVer=1, minorTopVer=0], nodeId=001abc23-c1d6-4b40-b2c7-02fda8a62000, ver=1637345558919, local=true, initialized=false]] [21:12:38] : [Step 4/5] [2021-11-19 21:12:38,924][INFO ][sys-#23612%grid-0%][ClusterProcessor] Writing cluster ID and tag to metastorage on ready for write ClusterIdAndTag [id=3ff14275-ca47-43bf-9021-bcbf2cf87db8, tag=sharp_agnesi] [21:12:38] : [Step 4/5] [2021-11-19 21:12:38,928][INFO ][disco-notifier-worker-#23632%grid-0%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustEnabled' was changed from 'null' to 'false' [21:12:38] : [Step 4/5] [2021-11-19 21:12:38,930][INFO ][disco-notifier-worker-#23632%grid-0%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustTimeout' was changed from 'null' to '300000' [21:12:38] : [Step 4/5] [2021-11-19 21:12:38,930][INFO ][disco-notifier-worker-#23632%grid-0%][IgniteTxManager] Transactions parameter 'longOperationsDumpTimeout' was changed from 'null' to '60000' [21:12:38] : [Step 4/5] [2021-11-19 21:12:38,931][INFO ][disco-notifier-worker-#23632%grid-0%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpThreshold' was changed from 'null' to '0' [21:12:38] : [Step 4/5] [2021-11-19 21:12:38,931][INFO ][disco-notifier-worker-#23632%grid-0%][IgniteTxManager] Transactions parameter 'transactionTimeDumpSamplesCoefficient' was changed from 'null' to '0.0' [21:12:38] : [Step 4/5] [2021-11-19 21:12:38,932][INFO ][disco-notifier-worker-#23632%grid-0%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpSamplesPerSecondLimit' was changed from 'null' to '5' [21:12:38] : [Step 4/5] [2021-11-19 21:12:38,932][INFO ][disco-notifier-worker-#23632%grid-0%][IgniteTxManager] Transactions parameter 'collisionsDumpInterval' was changed from 'null' to '1000' [21:12:38] : [Step 4/5] [2021-11-19 21:12:38,933][INFO ][disco-notifier-worker-#23632%grid-0%][IgniteTxManager] Transactions parameter 'txOwnerDumpRequestsAllowed' was changed from 'null' to 'true' [21:12:38] : [Step 4/5] [2021-11-19 21:12:38,933][INFO ][disco-notifier-worker-#23632%grid-0%][GridCacheDatabaseSharedManager] Historical rebalance WAL threshold changed [property=historical.rebalance.threshold, oldVal=null, newVal=500] [21:12:38] : [Step 4/5] [2021-11-19 21:12:38,934][INFO ][disco-notifier-worker-#23632%grid-0%][ClusterProcessor] sharp_agnesi [21:12:38] : [Step 4/5] [2021-11-19 21:12:38,939][INFO ][test-runner-#23520%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] To start Console Management & Monitoring run ignitevisorcmd.{sh|bat} [21:12:38] : [Step 4/5] [2021-11-19 21:12:38,940][INFO ][test-runner-#23520%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] [21:12:38] : [Step 4/5] [21:12:38] : [Step 4/5] >>> +-------------------------------------------+ [21:12:38] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:12:38] : [Step 4/5] >>> +-------------------------------------------+ [21:12:38] : [Step 4/5] >>> OS name: Linux 4.15.0-151-generic amd64 [21:12:38] : [Step 4/5] >>> CPU(s): 24 [21:12:38] : [Step 4/5] >>> Heap: 2.0GB [21:12:38] : [Step 4/5] >>> VM name: 16724@c4dfe9a430b2 [21:12:38] : [Step 4/5] >>> Ignite instance name: grid-0 [21:12:38] : [Step 4/5] >>> Local node [ID=001ABC23-C1D6-4B40-B2C7-02FDA8A62000, order=1, clientMode=false] [21:12:38] : [Step 4/5] >>> Local node addresses: [127.0.0.1] [21:12:38] : [Step 4/5] >>> Local ports: TCP:10800 TCP:47100 TCP:47500 [21:12:38] : [Step 4/5] [21:12:38] : [Step 4/5] [2021-11-19 21:12:38,941][INFO ][test-runner-#23520%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] >>> Ignite cluster is in INACTIVE state (limited functionality available). Use control.(sh|bat) script or IgniteCluster.state(ClusterState.ACTIVE) to change the state. [21:12:38] : [Step 4/5] [2021-11-19 21:12:38,942][INFO ][test-runner-#23520%encryption.CacheGroupKeyChangeTest%][GridDiscoveryManager] Topology snapshot [ver=1, locNode=001abc23, servers=1, clients=0, state=INACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=001abc23-c1d6-4b40-b2c7-02fda8a62000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:12:38] : [Step 4/5] [2021-11-19 21:12:38,943][INFO ][test-runner-#23520%encryption.CacheGroupKeyChangeTest%][G] Node started : [stage="Configure system pool" (0 ms),stage="Start managers" (191 ms),stage="Configure binary metadata" (2 ms),stage="Start processors" (270 ms),stage="Start 'StanByClusterTestProvider' plugin" (0 ms),stage="Start 'PageMemory tracker plugin' plugin" (0 ms),stage="Start 'TestDistibutedConfigurationPlugin' plugin" (0 ms),stage="Start 'NodeValidationPluginProvider' plugin" (0 ms),stage="Init metastore" (251 ms),stage="Init and start regions" (7 ms),stage="Restore binary memory" (14 ms),stage="Restore logical state" (6 ms),stage="Finish recovery" (48 ms),stage="Join topology" (12 ms),stage="Await transition" (2 ms),stage="Await exchange" (17 ms),stage="Total time" (820 ms)] [21:12:38] : [Step 4/5] [2021-11-19 21:12:38,944][INFO ][test-runner-#23520%encryption.CacheGroupKeyChangeTest%][root] Node started with the following configuration [id=001abc23-c1d6-4b40-b2c7-02fda8a62000, marshaller=BinaryMarshaller [], discovery=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=5000, ackTimeout=5000, marsh=JdkMarshaller [clsFilter=org.apache.ignite.marshaller.MarshallerUtils$1@679cdd3a], reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], binaryCfg=null, lateAff=true] [21:12:38]W: [org.apache.ignite:ignite-core] [2021-11-19 21:12:38,950][WARN ][test-runner-#23520%encryption.CacheGroupKeyChangeTest%][G] Ignite work directory is not provided, automatically resolved to: /opt/buildagent/work/7bc1c54bc719b67c/work [21:12:38] : [Step 4/5] [2021-11-19 21:12:38,951][INFO ][test-runner-#23520%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] [21:12:38] : [Step 4/5] [21:12:38] : [Step 4/5] >>> __________ ________________ [21:12:38] : [Step 4/5] >>> / _/ ___/ |/ / _/_ __/ __/ [21:12:38] : [Step 4/5] >>> _/ // (7 7 // / / / / _/ [21:12:38] : [Step 4/5] >>> /___/\___/_/|_/___/ /_/ /___/ [21:12:38] : [Step 4/5] >>> [21:12:38] : [Step 4/5] >>> ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:12:38] : [Step 4/5] >>> 2021 Copyright(C) Apache Software Foundation [21:12:38] : [Step 4/5] >>> [21:12:38] : [Step 4/5] >>> Ignite documentation: http://ignite.apache.org [21:12:38] : [Step 4/5] [21:12:38] : [Step 4/5] [2021-11-19 21:12:38,952][INFO ][test-runner-#23520%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] Config URL: n/a [21:12:38] : [Step 4/5] [2021-11-19 21:12:38,952][INFO ][test-runner-#23520%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] IgniteConfiguration [igniteInstanceName=grid-1, pubPoolSize=24, svcPoolSize=24, callbackPoolSize=24, stripedPoolSize=24, sysPoolSize=24, mgmtPoolSize=4, dataStreamerPoolSize=24, utilityCachePoolSize=24, utilityCacheKeepAliveTime=60000, p2pPoolSize=2, qryPoolSize=24, buildIdxPoolSize=4, igniteHome=/opt/buildagent/work/7bc1c54bc719b67c, igniteWorkDir=/opt/buildagent/work/7bc1c54bc719b67c/work, mbeanSrv=com.sun.jmx.mbeanserver.JmxMBeanServer@6fe85038, nodeId=10d9af81-6091-44df-aa06-9b312eb8a001, marsh=BinaryMarshaller [], marshLocJobs=false, daemon=false, p2pEnabled=true, netTimeout=10000, netCompressionLevel=1, sndRetryDelay=1000, sndRetryCnt=3, metricsHistSize=10000, metricsUpdateFreq=1000, metricsExpTime=9223372036854775807, discoSpi=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=0, ackTimeout=0, marsh=null, reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], segPlc=STOP, segResolveAttempts=2, waitForSegOnStart=true, allResolversPassReq=true, segChkFreq=10000, commSpi=TcpCommunicationSpi [connectGate=org.apache.ignite.spi.communication.tcp.internal.ConnectGateway@224ed8be, ctxInitLatch=java.util.concurrent.CountDownLatch@73d148b6[Count = 1], stopping=false, clientPool=null, nioSrvWrapper=null, stateProvider=null], evtSpi=MemoryEventStorageSpi [expireAgeMs=9223372036854775807, expireCnt=10000, filter=null], colSpi=NoopCollisionSpi [], deploySpi=LocalDeploymentSpi [], indexingSpi=org.apache.ignite.spi.indexing.noop.NoopIndexingSpi@630d65df, addrRslvr=null, encryptionSpi=org.apache.ignite.spi.encryption.keystore.KeystoreEncryptionSpi@4da3b189, tracingSpi=org.apache.ignite.spi.tracing.NoopTracingSpi@7eab5361, clientMode=false, rebalanceThreadPoolSize=4, rebalanceTimeout=10000, rebalanceBatchesPrefetchCnt=3, rebalanceThrottle=0, rebalanceBatchSize=524288, txCfg=TransactionConfiguration [txSerEnabled=false, dfltIsolation=REPEATABLE_READ, dfltConcurrency=PESSIMISTIC, dfltTxTimeout=0, txTimeoutOnPartitionMapExchange=0, deadlockTimeout=10000, pessimisticTxLogSize=0, pessimisticTxLogLinger=10000, tmLookupClsName=null, txManagerFactory=null, useJtaSync=false], cacheSanityCheckEnabled=true, discoStartupDelay=60000, deployMode=SHARED, p2pMissedCacheSize=100, locHost=127.0.0.1, timeSrvPortBase=31100, timeSrvPortRange=100, failureDetectionTimeout=10000, sysWorkerBlockedTimeout=null, clientFailureDetectionTimeout=10000, metricsLogFreq=0, connectorCfg=null, odbcCfg=null, warmupClos=null, atomicCfg=AtomicConfiguration [seqReserveSize=1000, cacheMode=PARTITIONED, backups=1, aff=null, grpName=null], classLdr=null, sslCtxFactory=null, platformCfg=null, binaryCfg=null, memCfg=null, pstCfg=null, dsCfg=DataStorageConfiguration [sysRegionInitSize=41943040, sysRegionMaxSize=104857600, pageSize=4096, concLvl=0, dfltDataRegConf=DataRegionConfiguration [name=default, maxSize=104857600, initSize=268435456, swapPath=null, pageEvictionMode=DISABLED, pageReplacementMode=CLOCK, evictionThreshold=0.9, emptyPagesPoolSize=100, metricsEnabled=false, metricsSubIntervalCount=5, metricsRateTimeInterval=60000, persistenceEnabled=true, checkpointPageBufSize=0, lazyMemoryAllocation=true, warmUpCfg=null], dataRegions=null, storagePath=null, checkpointFreq=30000, lockWaitTime=10000, checkpointThreads=4, checkpointWriteOrder=SEQUENTIAL, walHistSize=20, maxWalArchiveSize=20971520, walSegments=10, walSegmentSize=1048576, walPath=db/wal, walArchivePath=db/wal/archive, cdcWalPath=db/wal/cdc, cdcEnabled=false, metricsEnabled=false, walMode=LOG_ONLY, walTlbSize=131072, walBuffSize=0, walFlushFreq=2000, walFsyncDelay=1000, walRecordIterBuffSize=67108864, alwaysWriteFullPages=false, fileIOFactory=org.apache.ignite.internal.processors.cache.persistence.file.AsyncFileIOFactory@6e564be7, metricsSubIntervalCnt=5, metricsRateTimeInterval=60000, walAutoArchiveAfterInactivity=-1, walForceArchiveTimeout=-1, writeThrottlingEnabled=false, walCompactionEnabled=false, walCompactionLevel=1, checkpointReadLockTimeout=null, walPageCompression=DISABLED, walPageCompressionLevel=null, dfltWarmUpCfg=null, encCfg=org.apache.ignite.configuration.EncryptionConfiguration@4a5910dc, defragmentationThreadPoolSize=4, minWalArchiveSize=-1], snapshotPath=snapshots, activeOnStart=true, activeOnStartPropSetFlag=false, autoActivation=true, autoActivationPropSetFlag=false, clusterStateOnStart=null, sqlConnCfg=null, cliConnCfg=ClientConnectorConfiguration [host=null, port=10800, portRange=100, sockSndBufSize=0, sockRcvBufSize=0, tcpNoDelay=true, maxOpenCursorsPerConn=128, threadPoolSize=24, selectorCnt=12, idleTimeout=0, handshakeTimeout=10000, jdbcEnabled=true, odbcEnabled=true, thinCliEnabled=true, sslEnabled=false, useIgniteSslCtxFactory=true, sslClientAuth=false, sslCtxFactory=null, thinCliCfg=ThinClientConfiguration [maxActiveTxPerConn=100, maxActiveComputeTasksPerConn=0]], mvccVacuumThreadCnt=2, mvccVacuumFreq=5000, authEnabled=false, failureHnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]], commFailureRslvr=null, sqlCfg=SqlConfiguration [longQryWarnTimeout=3000, dfltQryTimeout=0, sqlQryHistSize=1000, validationEnabled=false], asyncContinuationExecutor=null] [21:12:38] : [Step 4/5] [2021-11-19 21:12:38,960][INFO ][test-runner-#23520%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] Daemon mode: off [21:12:38] : [Step 4/5] [2021-11-19 21:12:38,961][INFO ][test-runner-#23520%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] OS: Linux 4.15.0-151-generic amd64 [21:12:38] : [Step 4/5] [2021-11-19 21:12:38,961][INFO ][test-runner-#23520%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] OS user: teamcity [21:12:38] : [Step 4/5] [2021-11-19 21:12:38,961][INFO ][test-runner-#23520%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] PID: 16724 [21:12:38] : [Step 4/5] [2021-11-19 21:12:38,961][INFO ][test-runner-#23520%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] Language runtime: Java Platform API Specification ver. 1.8 [21:12:38] : [Step 4/5] [2021-11-19 21:12:38,962][INFO ][test-runner-#23520%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] VM information: Java(TM) SE Runtime Environment 1.8.0_261-b12 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 25.261-b12 [21:12:38] : [Step 4/5] [2021-11-19 21:12:38,962][INFO ][test-runner-#23520%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] VM total memory: 1.9GB [21:12:38] : [Step 4/5] [2021-11-19 21:12:38,962][INFO ][test-runner-#23520%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] Remote Management [restart: off, REST: off, JMX (remote: off)] [21:12:38] : [Step 4/5] [2021-11-19 21:12:38,962][INFO ][test-runner-#23520%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] Logger: GridTestLog4jLogger [quiet=false, config=null] [21:12:38] : [Step 4/5] [2021-11-19 21:12:38,963][INFO ][test-runner-#23520%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] IGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c [21:12:38] : [Step 4/5] [2021-11-19 21:12:38,963][INFO ][test-runner-#23520%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] VM arguments: [-DIGNITE_DUMP_THREADS_ON_FAILURE=false, -DMono=/usr/bin/mono-sgen, -DMono4.0_x64=/usr/lib/mono/4.0, -DMono4.5_x64=/usr/lib/mono/4.5, -DMonoVersion=6.12.0.90, -DSKIP_BUILD=false, -Dagent.home.dir=/opt/buildagent, -Dagent.name=aitc-lin02_03, -Dagent.ownPort=9090, -Dagent.work.dir=/opt/buildagent/work, -Dbuild.number=95, -Dbuild.vcs.number=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.1=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.GitHubApacheIgnite=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dclassworlds.conf=/opt/buildagent/temp/buildTmp/teamcity.m2.conf, -Dcom.jetbrains.maven.watcher.report.file=/opt/buildagent/temp/buildTmp/maven-build-info.xml, -Djava.io.tmpdir=/opt/buildagent/temp/buildTmp, -Dmaven.home=/opt/buildagent/tools/maven3_6, -Dmaven.multiModuleProjectDirectory=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.agent.cpuBenchmark=457, -Dteamcity.agent.dotnet.agent_url=http://localhost:9090/RPC2, -Dteamcity.agent.dotnet.build_id=6278078, -Dteamcity.auth.password=*******, -Dteamcity.auth.userId=TeamCityBuildId=6278078, -Dteamcity.build.changedFiles.file=/opt/buildagent/temp/buildTmp/changedFiles6342607772318147725.txt, -Dteamcity.build.checkoutDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.build.id=6278078, -Dteamcity.build.properties.file=/opt/buildagent/temp/buildTmp/teamcity.build5164517880467851002.properties, -Dteamcity.build.tempDir=/opt/buildagent/temp/buildTmp, -Dteamcity.build.workingDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.buildConfName=Basic 3, -Dteamcity.buildType.id=IgniteTests24Java8_Basic3, -Dteamcity.configuration.properties.file=/opt/buildagent/temp/buildTmp/teamcity.config5591980786735343870.properties, -Dteamcity.maven.userSettings.path=/opt/buildagent/temp/buildTmp/maven_settings_585072866407032347.xml, -Dteamcity.maven.watcher.home=/opt/buildagent/plugins/mavenPlugin/maven-watcher-jdk16, -Dteamcity.projectName=Ignite Tests 2.x (JDK 8/11), -Dteamcity.runner.properties.file=/opt/buildagent/temp/buildTmp/teamcity.runner9098465561618137420.properties, -Dteamcity.tests.recentlyFailedTests.file=/opt/buildagent/temp/buildTmp/testsToRunFirst3891775683130404069.txt, -Dteamcity.version=2021.2 (build 99542), -ea, -Xms2g, -Xmx2g, -XX:+HeapDumpOnOutOfMemoryError, -DIGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_TEST_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_UPDATE_NOTIFIER=false, -DIGNITE_NO_DISCO_ORDER=true, -DIGNITE_PERFORMANCE_SUGGESTIONS_DISABLED=true, -Djava.net.preferIPv4Stack=true, -DTEST_SCALE_FACTOR=1.0, -DIGNITE_TEST_PROP_LOG4J_FILE=log4j-tc-test.xml, -DIGNITE_QUIET=false, -DIGNITE_MARSHAL_BUFFERS_RECHECK=1000, -Dmaven.repo.local=/opt/buildagent/.m2/repository] [21:12:38] : [Step 4/5] [2021-11-19 21:12:38,967][INFO ][test-runner-#23520%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] System cache's DataRegion size is configured to 40 MB. Use DataStorageConfiguration.systemRegionInitialSize property to change the setting. [21:12:38] : [Step 4/5] [2021-11-19 21:12:38,968][INFO ][test-runner-#23520%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] Configured caches [in 'sysMemPlc' dataRegion: ['ignite-sys-cache']] [21:12:38]W: [org.apache.ignite:ignite-core] [2021-11-19 21:12:38,968][WARN ][test-runner-#23520%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] Peer class loading is enabled (disable it in production for performance and deployment consistency reasons) [21:12:38] : [Step 4/5] [2021-11-19 21:12:38,968][INFO ][test-runner-#23520%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] 3-rd party licenses can be found at: /opt/buildagent/work/7bc1c54bc719b67c/libs/licenses [21:12:38] : [Step 4/5] [2021-11-19 21:12:38,973][INFO ][test-runner-#23520%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] Configured plugins: [21:12:38] : [Step 4/5] [2021-11-19 21:12:38,973][INFO ][test-runner-#23520%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- StanByClusterTestProvider 1.0 [21:12:38] : [Step 4/5] [2021-11-19 21:12:38,973][INFO ][test-runner-#23520%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:12:38] : [Step 4/5] [2021-11-19 21:12:38,973][INFO ][test-runner-#23520%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] [21:12:38] : [Step 4/5] [2021-11-19 21:12:38,973][INFO ][test-runner-#23520%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- PageMemory tracker plugin 1.0 [21:12:38] : [Step 4/5] [2021-11-19 21:12:38,974][INFO ][test-runner-#23520%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:12:38] : [Step 4/5] [2021-11-19 21:12:38,974][INFO ][test-runner-#23520%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] [21:12:38] : [Step 4/5] [2021-11-19 21:12:38,974][INFO ][test-runner-#23520%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- TestDistibutedConfigurationPlugin 1.0 [21:12:38] : [Step 4/5] [2021-11-19 21:12:38,974][INFO ][test-runner-#23520%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:12:38] : [Step 4/5] [2021-11-19 21:12:38,974][INFO ][test-runner-#23520%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] [21:12:38] : [Step 4/5] [2021-11-19 21:12:38,975][INFO ][test-runner-#23520%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- NodeValidationPluginProvider 1.0 [21:12:38] : [Step 4/5] [2021-11-19 21:12:38,975][INFO ][test-runner-#23520%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:12:38] : [Step 4/5] [2021-11-19 21:12:38,975][INFO ][test-runner-#23520%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] [21:12:38] : [Step 4/5] [2021-11-19 21:12:38,975][INFO ][test-runner-#23520%encryption.CacheGroupKeyChangeTest%][FailureProcessor] Configured failure handler: [hnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]]] [21:12:38] : [Step 4/5] [2021-11-19 21:12:38,987][INFO ][test-runner-#23520%encryption.CacheGroupKeyChangeTest%][TestRecordingCommunicationSpi] Successfully bound communication NIO server to TCP port [port=47101, locHost=/127.0.0.1, selectorsCnt=12, selectorSpins=0, pairedConn=false] [21:12:38]W: [org.apache.ignite:ignite-core] [2021-11-19 21:12:38,987][WARN ][test-runner-#23520%encryption.CacheGroupKeyChangeTest%][TestRecordingCommunicationSpi] Message queue limit is set to 0 which may lead to potential OOMEs when running cache operations in FULL_ASYNC or PRIMARY_SYNC modes due to message queues growth on sender and receiver sides. [21:12:38] : [Step 4/5] [2021-11-19 21:12:38,991][INFO ][test-runner-#23520%encryption.CacheGroupKeyChangeTest%][GridCollisionManager] Collision resolution is disabled (all jobs will be activated upon arrival). [21:12:38] : [Step 4/5] [2021-11-19 21:12:38,991][INFO ][test-runner-#23520%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] Security status [authentication=off, sandbox=off, tls/ssl=off] [21:12:39] : [Step 4/5] [2021-11-19 21:12:39,052][INFO ][test-runner-#23520%encryption.CacheGroupKeyChangeTest%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:12:39] : [Step 4/5] [2021-11-19 21:12:39,139][INFO ][test-runner-#23520%encryption.CacheGroupKeyChangeTest%][MaintenanceProcessor] Resolved store directory for node persistent data: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1 [21:12:39] : [Step 4/5] [2021-11-19 21:12:39,140][INFO ][test-runner-#23520%encryption.CacheGroupKeyChangeTest%][CacheObjectBinaryProcessorImpl] Resolved directory for serialized binary metadata: /opt/buildagent/work/7bc1c54bc719b67c/work/db/binary_meta/grid_1 [21:12:39] : [Step 4/5] [2021-11-19 21:12:39,144][INFO ][test-runner-#23520%encryption.CacheGroupKeyChangeTest%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1 [21:12:39] : [Step 4/5] [2021-11-19 21:12:39,144][INFO ][test-runner-#23520%encryption.CacheGroupKeyChangeTest%][FileWriteAheadLogManager] Resolved write ahead log work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1 [21:12:39] : [Step 4/5] [2021-11-19 21:12:39,144][INFO ][test-runner-#23520%encryption.CacheGroupKeyChangeTest%][FileWriteAheadLogManager] Resolved write ahead log archive directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1 [21:12:39] : [Step 4/5] [2021-11-19 21:12:39,398][INFO ][test-runner-#23520%encryption.CacheGroupKeyChangeTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000000.wal [21:12:39] : [Step 4/5] [2021-11-19 21:12:39,399][INFO ][test-runner-#23520%encryption.CacheGroupKeyChangeTest%][FileHandleManagerImpl] Initialized write-ahead log manager [mode=LOG_ONLY] [21:12:39] : [Step 4/5] [2021-11-19 21:12:39,404][INFO ][test-runner-#23520%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Configured data regions initialized successfully [total=5] [21:12:39] : [Step 4/5] [2021-11-19 21:12:39,406][INFO ][test-runner-#23520%encryption.CacheGroupKeyChangeTest%][IgniteSnapshotManager] Resolved snapshot work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/snapshots [21:12:39] : [Step 4/5] [2021-11-19 21:12:39,406][INFO ][test-runner-#23520%encryption.CacheGroupKeyChangeTest%][IgniteSnapshotManager] Resolved temp directory for snapshot creation: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1/snp [21:12:39] : [Step 4/5] [2021-11-19 21:12:39,409][INFO ][test-runner-#23520%encryption.CacheGroupKeyChangeTest%][ClientListenerProcessor] Client connector processor has started on TCP port 10801 [21:12:39] : [Step 4/5] [2021-11-19 21:12:39,411][INFO ][test-runner-#23520%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] Non-loopback local IPs: 172.17.0.4 [21:12:39] : [Step 4/5] [2021-11-19 21:12:39,411][INFO ][test-runner-#23520%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] Enabled local MACs: 0242AC110004 [21:12:39] : [Step 4/5] [2021-11-19 21:12:39,411][INFO ][test-runner-#23520%encryption.CacheGroupKeyChangeTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:12:39] : [Step 4/5] [2021-11-19 21:12:39,413][INFO ][test-runner-#23520%encryption.CacheGroupKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:12:39] : [Step 4/5] [2021-11-19 21:12:39,413][INFO ][test-runner-#23520%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:12:39] : [Step 4/5] [2021-11-19 21:12:39,415][INFO ][test-runner-#23520%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Applying lost metastore updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:12:39] : [Step 4/5] [2021-11-19 21:12:39,415][INFO ][test-runner-#23520%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=0 ms] [21:12:39] : [Step 4/5] [2021-11-19 21:12:39,416][INFO ][test-runner-#23520%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Restoring partition state for local groups. [21:12:39] : [Step 4/5] [2021-11-19 21:12:39,416][INFO ][test-runner-#23520%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=0, partitionsProcessed=0, time=0ms] [21:12:39] : [Step 4/5] [2021-11-19 21:12:39,416][INFO ][test-runner-#23520%encryption.CacheGroupKeyChangeTest%][GridEncryptionManager] Encryption keys loaded from metastore. [grps=, masterKeyName=ignite.master.key] [21:12:39] : [Step 4/5] [2021-11-19 21:12:39,418][INFO ][test-runner-#23520%encryption.CacheGroupKeyChangeTest%][ClusterProcessor] Cluster ID and tag has been read from metastorage: null [21:12:39] : [Step 4/5] [2021-11-19 21:12:39,418][INFO ][test-runner-#23520%encryption.CacheGroupKeyChangeTest%][IgniteClusterImpl] Shutdown policy was updated [oldVal=null, newVal=null] [21:12:39] : [Step 4/5] [2021-11-19 21:12:39,418][INFO ][test-runner-#23520%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Checkpoint frequency deviation changed [oldVal=null, newVal=null] [21:12:39] : [Step 4/5] [2021-11-19 21:12:39,427][INFO ][test-runner-#23520%encryption.CacheGroupKeyChangeTest%][FilePageStoreManager] Cleanup cache stores [total=1, left=0, cleanFiles=false] [21:12:39] : [Step 4/5] [2021-11-19 21:12:39,430][INFO ][test-runner-#23520%encryption.CacheGroupKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:12:39] : [Step 4/5] [2021-11-19 21:12:39,431][INFO ][test-runner-#23520%encryption.CacheGroupKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:12:39] : [Step 4/5] [2021-11-19 21:12:39,432][INFO ][test-runner-#23520%encryption.CacheGroupKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:12:39] : [Step 4/5] [2021-11-19 21:12:39,433][INFO ][test-runner-#23520%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Data Regions Started: 5 [21:12:39] : [Step 4/5] [2021-11-19 21:12:39,433][INFO ][test-runner-#23520%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] ^-- sysMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:12:39] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:12:39] : [Step 4/5] ^-- default region [type=default, persistence=true, lazyAlloc=true, [21:12:39] : [Step 4/5] ... initCfg=100MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB, allocTotal=0MB] [21:12:39] : [Step 4/5] ^-- metastoreMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:12:39] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:12:39] : [Step 4/5] ^-- TxLog region [type=internal, persistence=true, lazyAlloc=false, [21:12:39] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:12:39] : [Step 4/5] ^-- volatileDsMemPlc region [type=user, persistence=false, lazyAlloc=true, [21:12:39] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB] [21:12:39] : [Step 4/5] ^-- Ignite persistence [used=0MB] [21:12:39] : [Step 4/5] [21:12:39] : [Step 4/5] [2021-11-19 21:12:39,435][INFO ][test-runner-#23520%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Starting binary memory restore for: [-2100569601] [21:12:39] : [Step 4/5] [2021-11-19 21:12:39,443][INFO ][test-runner-#23520%encryption.CacheGroupKeyChangeTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:12:39] : [Step 4/5] [2021-11-19 21:12:39,444][INFO ][test-runner-#23520%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:12:39] : [Step 4/5] [2021-11-19 21:12:39,446][INFO ][test-runner-#23520%encryption.CacheGroupKeyChangeTest%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000000.wal, offset=0, ver=2] [21:12:39] : [Step 4/5] [2021-11-19 21:12:39,448][INFO ][test-runner-#23520%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Started cache in recovery mode [name=ignite-sys-cache, id=-2100569601, dataRegionName=sysMemPlc, mode=REPLICATED, atomicity=TRANSACTIONAL, backups=2147483647, mvcc=false] [21:12:39] : [Step 4/5] [2021-11-19 21:12:39,449][INFO ][test-runner-#23520%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Binary recovery performed in 14 ms. [21:12:39] : [Step 4/5] [2021-11-19 21:12:39,449][INFO ][test-runner-#23520%encryption.CacheGroupKeyChangeTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:12:39] : [Step 4/5] [2021-11-19 21:12:39,449][INFO ][test-runner-#23520%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Applying lost cache updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:12:39] : [Step 4/5] [2021-11-19 21:12:39,452][INFO ][test-runner-#23520%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=10 ms] [21:12:39] : [Step 4/5] [2021-11-19 21:12:39,452][INFO ][test-runner-#23520%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Restoring partition state for local groups. [21:12:39] : [Step 4/5] [2021-11-19 21:12:39,456][INFO ][test-runner-#23520%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=1, partitionsProcessed=100, time=0ms] [21:12:39] : [Step 4/5] [2021-11-19 21:12:39,466][INFO ][test-runner-#23520%encryption.CacheGroupKeyChangeTest%][TestTcpDiscoverySpi] Successfully bound to TCP port [port=47501, localHost=localhost/127.0.0.1, locNodeId=10d9af81-6091-44df-aa06-9b312eb8a001] [21:12:39] : [Step 4/5] [2021-11-19 21:12:39,470][INFO ][tcp-disco-srvr-[:47500]-#1239%grid-0%-#23634%grid-0%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=41357] [21:12:39] : [Step 4/5] [2021-11-19 21:12:39,470][INFO ][tcp-disco-srvr-[:47500]-#1239%grid-0%-#23634%grid-0%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=41357] [21:12:39] : [Step 4/5] [2021-11-19 21:12:39,471][INFO ][tcp-disco-sock-reader-[]-#1245%grid-0%-#23754%grid-0%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:41357, rmtPort=41357] [21:12:39] : [Step 4/5] [2021-11-19 21:12:39,473][INFO ][tcp-disco-sock-reader-[10d9af81 127.0.0.1:41357]-#1245%grid-0%-#23754%grid-0%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=10d9af81-6091-44df-aa06-9b312eb8a001, rmtAddr=/127.0.0.1:41357] [21:12:39] : [Step 4/5] [2021-11-19 21:12:39,479][INFO ][tcp-disco-srvr-[:47501]-#1244%grid-1%-#23753%grid-1%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=42029] [21:12:39] : [Step 4/5] [2021-11-19 21:12:39,479][INFO ][tcp-disco-srvr-[:47501]-#1244%grid-1%-#23753%grid-1%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=42029] [21:12:39] : [Step 4/5] [2021-11-19 21:12:39,480][INFO ][tcp-disco-sock-reader-[]-#1246%grid-1%-#23755%grid-1%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:42029, rmtPort=42029] [21:12:39] : [Step 4/5] [2021-11-19 21:12:39,480][INFO ][tcp-disco-sock-reader-[]-#1246%grid-1%-#23755%grid-1%][TestTcpDiscoverySpi] Received ping request from the remote node [rmtNodeId=001abc23-c1d6-4b40-b2c7-02fda8a62000, rmtAddr=/127.0.0.1:42029, rmtPort=42029] [21:12:39] : [Step 4/5] [2021-11-19 21:12:39,482][INFO ][tcp-disco-sock-reader-[]-#1246%grid-1%-#23755%grid-1%][TestTcpDiscoverySpi] Finished writing ping response [rmtNodeId=001abc23-c1d6-4b40-b2c7-02fda8a62000, rmtAddr=/127.0.0.1:42029, rmtPort=42029] [21:12:39]W: [org.apache.ignite:ignite-core] [2021-11-19 21:12:39,482][WARN ][tcp-disco-sock-reader-[]-#1246%grid-1%-#23755%grid-1%][TestTcpDiscoverySpi] Failed to shutdown socket [21:12:39]W: [org.apache.ignite:ignite-core] java.net.SocketException: Socket output is already shutdown [21:12:39]W: [org.apache.ignite:ignite-core] at java.net.Socket.shutdownOutput(Socket.java:1572) [21:12:39]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.close(IgniteUtils.java:4247) [21:12:39]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.discovery.tcp.ServerImpl$SocketReader.body(ServerImpl.java:7370) [21:12:39]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.IgniteSpiThread.run(IgniteSpiThread.java:58) [21:12:39] : [Step 4/5] [2021-11-19 21:12:39,482][INFO ][tcp-disco-sock-reader-[10d9af81 127.0.0.1:41357]-#1245%grid-0%-#23754%grid-0%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:41357, rmtPort=41357, rmtNodeId=10d9af81-6091-44df-aa06-9b312eb8a001] [21:12:39] : [Step 4/5] [2021-11-19 21:12:39,483][INFO ][tcp-disco-sock-reader-[]-#1246%grid-1%-#23755%grid-1%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:42029, rmtPort=42029, rmtNodeId=null] [21:12:39] : [Step 4/5] [2021-11-19 21:12:39,485][INFO ][tcp-disco-msg-worker-[crd]-#1238%grid-0%-#23633%grid-0%][GridEncryptionManager] Joining node doesn't have stored group keys [node=10d9af81-6091-44df-aa06-9b312eb8a001] [21:12:39] : [Step 4/5] [2021-11-19 21:12:39,493][INFO ][tcp-disco-msg-worker-[crd]-#1238%grid-0%-#23633%grid-0%][TestTcpDiscoverySpi] New next node [newNext=TcpDiscoveryNode [id=10d9af81-6091-44df-aa06-9b312eb8a001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=0, intOrder=2, lastExchangeTime=1637345559472, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false]] [21:12:39] : [Step 4/5] [2021-11-19 21:12:39,494][INFO ][tcp-disco-srvr-[:47501]-#1244%grid-1%-#23753%grid-1%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=43021] [21:12:39] : [Step 4/5] [2021-11-19 21:12:39,495][INFO ][tcp-disco-srvr-[:47501]-#1244%grid-1%-#23753%grid-1%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=43021] [21:12:39] : [Step 4/5] [2021-11-19 21:12:39,495][INFO ][tcp-disco-sock-reader-[]-#1247%grid-1%-#23756%grid-1%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:43021, rmtPort=43021] [21:12:39] : [Step 4/5] [2021-11-19 21:12:39,496][INFO ][tcp-disco-sock-reader-[001abc23 127.0.0.1:43021]-#1247%grid-1%-#23756%grid-1%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=001abc23-c1d6-4b40-b2c7-02fda8a62000, rmtAddr=/127.0.0.1:43021] [21:12:39] : [Step 4/5] [2021-11-19 21:12:39,499][INFO ][tcp-disco-msg-worker-[]-#1243%grid-1%-#23752%grid-1%][TestTcpDiscoverySpi] New next node [newNext=TcpDiscoveryNode [id=001abc23-c1d6-4b40-b2c7-02fda8a62000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345559492, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false]] [21:12:39] : [Step 4/5] [2021-11-19 21:12:39,500][INFO ][tcp-disco-srvr-[:47500]-#1239%grid-0%-#23634%grid-0%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=33771] [21:12:39] : [Step 4/5] [2021-11-19 21:12:39,500][INFO ][tcp-disco-srvr-[:47500]-#1239%grid-0%-#23634%grid-0%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=33771] [21:12:39] : [Step 4/5] [2021-11-19 21:12:39,501][INFO ][tcp-disco-sock-reader-[]-#1248%grid-0%-#23757%grid-0%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:33771, rmtPort=33771] [21:12:39] : [Step 4/5] [2021-11-19 21:12:39,502][INFO ][tcp-disco-sock-reader-[10d9af81 127.0.0.1:33771]-#1248%grid-0%-#23757%grid-0%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=10d9af81-6091-44df-aa06-9b312eb8a001, rmtAddr=/127.0.0.1:33771] [21:12:39] : [Step 4/5] [2021-11-19 21:12:39,504][INFO ][disco-event-worker-#23636%grid-0%][GridDiscoveryManager] Added new node to topology: TcpDiscoveryNode [id=10d9af81-6091-44df-aa06-9b312eb8a001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637345559472, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false] [21:12:39] : [Step 4/5] [2021-11-19 21:12:39,505][INFO ][disco-event-worker-#23636%grid-0%][GridDiscoveryManager] Topology snapshot [ver=2, locNode=001abc23, servers=2, clients=0, state=INACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=001abc23-c1d6-4b40-b2c7-02fda8a62000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=10d9af81-6091-44df-aa06-9b312eb8a001, consistentId=grid-1, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:12:39] : [Step 4/5] [2021-11-19 21:12:39,507][INFO ][tcp-disco-msg-worker-[001abc23 127.0.0.1:47500]-#1243%grid-1%-#23752%grid-1%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustEnabled' was changed from 'null' to 'false' [21:12:39] : [Step 4/5] [2021-11-19 21:12:39,508][INFO ][tcp-disco-msg-worker-[001abc23 127.0.0.1:47500]-#1243%grid-1%-#23752%grid-1%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustTimeout' was changed from 'null' to '300000' [21:12:39] : [Step 4/5] [2021-11-19 21:12:39,508][INFO ][tcp-disco-msg-worker-[001abc23 127.0.0.1:47500]-#1243%grid-1%-#23752%grid-1%][IgniteTxManager] Transactions parameter 'longOperationsDumpTimeout' was changed from 'null' to '60000' [21:12:39] : [Step 4/5] [2021-11-19 21:12:39,508][INFO ][tcp-disco-msg-worker-[001abc23 127.0.0.1:47500]-#1243%grid-1%-#23752%grid-1%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpThreshold' was changed from 'null' to '0' [21:12:39] : [Step 4/5] [2021-11-19 21:12:39,509][INFO ][tcp-disco-msg-worker-[001abc23 127.0.0.1:47500]-#1243%grid-1%-#23752%grid-1%][IgniteTxManager] Transactions parameter 'transactionTimeDumpSamplesCoefficient' was changed from 'null' to '0.0' [21:12:39] : [Step 4/5] [2021-11-19 21:12:39,509][INFO ][tcp-disco-msg-worker-[001abc23 127.0.0.1:47500]-#1243%grid-1%-#23752%grid-1%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpSamplesPerSecondLimit' was changed from 'null' to '5' [21:12:39] : [Step 4/5] [2021-11-19 21:12:39,510][INFO ][tcp-disco-msg-worker-[001abc23 127.0.0.1:47500]-#1243%grid-1%-#23752%grid-1%][IgniteTxManager] Transactions parameter 'collisionsDumpInterval' was changed from 'null' to '1000' [21:12:39] : [Step 4/5] [2021-11-19 21:12:39,510][INFO ][tcp-disco-msg-worker-[001abc23 127.0.0.1:47500]-#1243%grid-1%-#23752%grid-1%][IgniteTxManager] Transactions parameter 'txOwnerDumpRequestsAllowed' was changed from 'null' to 'true' [21:12:39] : [Step 4/5] [2021-11-19 21:12:39,510][INFO ][tcp-disco-msg-worker-[001abc23 127.0.0.1:47500]-#1243%grid-1%-#23752%grid-1%][GridCacheDatabaseSharedManager] Historical rebalance WAL threshold changed [property=historical.rebalance.threshold, oldVal=null, newVal=500] [21:12:39] : [Step 4/5] [2021-11-19 21:12:39,511][INFO ][tcp-disco-msg-worker-[001abc23 127.0.0.1:47500]-#1243%grid-1%-#23752%grid-1%][ClusterProcessor] sharp_agnesi [21:12:39] : [Step 4/5] [2021-11-19 21:12:39,512][INFO ][disco-notifier-worker-#23751%grid-1%][MvccProcessorImpl] Assigned mvcc coordinator [crd=MvccCoordinator [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=0], nodeId=001abc23-c1d6-4b40-b2c7-02fda8a62000, ver=1637345558919, local=false, initialized=false]] [21:12:39] : [Step 4/5] [2021-11-19 21:12:39,512][INFO ][sys-#23727%grid-1%][ClusterProcessor] Writing cluster ID and tag to metastorage on ready for write ClusterIdAndTag [id=3ff14275-ca47-43bf-9021-bcbf2cf87db8, tag=sharp_agnesi] [21:12:39] : [Step 4/5] [2021-11-19 21:12:39,538][INFO ][test-runner-#23520%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] To start Console Management & Monitoring run ignitevisorcmd.{sh|bat} [21:12:39] : [Step 4/5] [2021-11-19 21:12:39,539][INFO ][test-runner-#23520%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] [21:12:39] : [Step 4/5] [21:12:39] : [Step 4/5] >>> +-------------------------------------------+ [21:12:39] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:12:39] : [Step 4/5] >>> +-------------------------------------------+ [21:12:39] : [Step 4/5] >>> OS name: Linux 4.15.0-151-generic amd64 [21:12:39] : [Step 4/5] >>> CPU(s): 24 [21:12:39] : [Step 4/5] >>> Heap: 2.0GB [21:12:39] : [Step 4/5] >>> VM name: 16724@c4dfe9a430b2 [21:12:39] : [Step 4/5] >>> Ignite instance name: grid-1 [21:12:39] : [Step 4/5] >>> Local node [ID=10D9AF81-6091-44DF-AA06-9B312EB8A001, order=2, clientMode=false] [21:12:39] : [Step 4/5] >>> Local node addresses: [127.0.0.1] [21:12:39] : [Step 4/5] >>> Local ports: TCP:10801 TCP:47101 TCP:47501 [21:12:39] : [Step 4/5] [21:12:39] : [Step 4/5] [2021-11-19 21:12:39,540][INFO ][test-runner-#23520%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] >>> Ignite cluster is in INACTIVE state (limited functionality available). Use control.(sh|bat) script or IgniteCluster.state(ClusterState.ACTIVE) to change the state. [21:12:39] : [Step 4/5] [2021-11-19 21:12:39,540][INFO ][test-runner-#23520%encryption.CacheGroupKeyChangeTest%][GridDiscoveryManager] Topology snapshot [ver=2, locNode=10d9af81, servers=2, clients=0, state=INACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=001abc23-c1d6-4b40-b2c7-02fda8a62000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=10d9af81-6091-44df-aa06-9b312eb8a001, consistentId=grid-1, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:12:39] : [Step 4/5] [2021-11-19 21:12:39,541][INFO ][test-runner-#23520%encryption.CacheGroupKeyChangeTest%][G] Node started : [stage="Configure system pool" (0 ms),stage="Start managers" (189 ms),stage="Configure binary metadata" (1 ms),stage="Start processors" (268 ms),stage="Start 'StanByClusterTestProvider' plugin" (0 ms),stage="Start 'PageMemory tracker plugin' plugin" (0 ms),stage="Start 'TestDistibutedConfigurationPlugin' plugin" (0 ms),stage="Start 'NodeValidationPluginProvider' plugin" (0 ms),stage="Init metastore" (17 ms),stage="Init and start regions" (6 ms),stage="Restore binary memory" (14 ms),stage="Restore logical state" (7 ms),stage="Finish recovery" (8 ms),stage="Join topology" (46 ms),stage="Await transition" (2 ms),stage="Await exchange" (27 ms),stage="Total time" (585 ms)] [21:12:39] : [Step 4/5] [2021-11-19 21:12:39,543][INFO ][test-runner-#23520%encryption.CacheGroupKeyChangeTest%][root] Node started with the following configuration [id=10d9af81-6091-44df-aa06-9b312eb8a001, marshaller=BinaryMarshaller [], discovery=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=5000, ackTimeout=5000, marsh=JdkMarshaller [clsFilter=org.apache.ignite.marshaller.MarshallerUtils$1@2d17070a], reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], binaryCfg=null, lateAff=true] [21:12:39] : [Step 4/5] [2021-11-19 21:12:39,545][INFO ][test-runner-#23520%encryption.CacheGroupKeyChangeTest%][GridClusterStateProcessor] Sending activate cluster request with BaselineTopology BaselineTopology [id=0, branchingHash=-2475315501, branchingType='New BaselineTopology', baselineNodes=[grid-1, grid-0]] [21:12:39] : [Step 4/5] [2021-11-19 21:12:39,549][INFO ][disco-notifier-worker-#23632%grid-0%][GridClusterStateProcessor] Received activate cluster request with BaselineTopology[id=0] initiator node ID: 001abc23-c1d6-4b40-b2c7-02fda8a62000 [21:12:39] : [Step 4/5] [2021-11-19 21:12:39,549][INFO ][disco-notifier-worker-#23632%grid-0%][GridClusterStateProcessor] Started state transition: activate cluster [21:12:39] : [Step 4/5] [2021-11-19 21:12:39,550][INFO ][exchange-worker-#23637%grid-0%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], crd=true, evt=DISCOVERY_CUSTOM_EVT, evtNode=001abc23-c1d6-4b40-b2c7-02fda8a62000, customEvt=ChangeGlobalStateMessage [id=d37fd593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqId=58e8f2bf-7803-4485-8b97-031ce1888ef0, initiatingNodeId=001abc23-c1d6-4b40-b2c7-02fda8a62000, state=ACTIVE, baselineTopology=BaselineTopology [id=0, branchingHash=-2475315501, branchingType='New BaselineTopology', baselineNodes=[grid-1, grid-0]], forceChangeBaselineTopology=false, timestamp=1637345559545, forceDeactivation=true], allowMerge=false, exchangeFreeSwitch=false] [21:12:39] : [Step 4/5] [2021-11-19 21:12:39,550][INFO ][disco-notifier-worker-#23751%grid-1%][GridClusterStateProcessor] Received activate cluster request with BaselineTopology[id=0] initiator node ID: 001abc23-c1d6-4b40-b2c7-02fda8a62000 [21:12:39] : [Step 4/5] [2021-11-19 21:12:39,551][INFO ][exchange-worker-#23637%grid-0%][GridDhtPartitionsExchangeFuture] Start activation process [nodeId=001abc23-c1d6-4b40-b2c7-02fda8a62000, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]]. New state: ACTIVE [21:12:39] : [Step 4/5] [2021-11-19 21:12:39,552][INFO ][disco-notifier-worker-#23751%grid-1%][GridClusterStateProcessor] Started state transition: activate cluster [21:12:39] : [Step 4/5] [2021-11-19 21:12:39,552][INFO ][exchange-worker-#23637%grid-0%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0 [21:12:39] : [Step 4/5] [2021-11-19 21:12:39,552][INFO ][exchange-worker-#23760%grid-1%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], crd=false, evt=DISCOVERY_CUSTOM_EVT, evtNode=001abc23-c1d6-4b40-b2c7-02fda8a62000, customEvt=ChangeGlobalStateMessage [id=d37fd593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqId=58e8f2bf-7803-4485-8b97-031ce1888ef0, initiatingNodeId=001abc23-c1d6-4b40-b2c7-02fda8a62000, state=ACTIVE, baselineTopology=BaselineTopology [id=0, branchingHash=-2475315501, branchingType='New BaselineTopology', baselineNodes=[grid-1, grid-0]], forceChangeBaselineTopology=false, timestamp=1637345559545, forceDeactivation=true], allowMerge=false, exchangeFreeSwitch=false] [21:12:39] : [Step 4/5] [2021-11-19 21:12:39,554][INFO ][exchange-worker-#23760%grid-1%][GridDhtPartitionsExchangeFuture] Start activation process [nodeId=10d9af81-6091-44df-aa06-9b312eb8a001, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]]. New state: ACTIVE [21:12:39] : [Step 4/5] [2021-11-19 21:12:39,555][INFO ][exchange-worker-#23760%grid-1%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1 [21:12:39] : [Step 4/5] [2021-11-19 21:12:39,559][INFO ][exchange-worker-#23637%grid-0%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000000.wal, offset=8795, ver=2] [21:12:39] : [Step 4/5] [2021-11-19 21:12:39,559][INFO ][exchange-worker-#23760%grid-1%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000000.wal, offset=8795, ver=2] [21:12:39] : [Step 4/5] [2021-11-19 21:12:39,560][INFO ][exchange-worker-#23637%grid-0%][GridClusterStateProcessor] Writing BaselineTopology[id=0] [21:12:39] : [Step 4/5] [2021-11-19 21:12:39,561][INFO ][exchange-worker-#23760%grid-1%][GridClusterStateProcessor] Writing BaselineTopology[id=0] [21:12:39] : [Step 4/5] [2021-11-19 21:12:39,567][INFO ][exchange-worker-#23637%grid-0%][GridCacheDatabaseSharedManager] Finish recovery performed in 14 ms. [21:12:39] : [Step 4/5] [2021-11-19 21:12:39,568][INFO ][exchange-worker-#23637%grid-0%][msg] Components activation performed in 16 ms. [21:12:39] : [Step 4/5] [2021-11-19 21:12:39,568][INFO ][exchange-worker-#23760%grid-1%][GridCacheDatabaseSharedManager] Finish recovery performed in 13 ms. [21:12:39] : [Step 4/5] [2021-11-19 21:12:39,569][INFO ][exchange-worker-#23760%grid-1%][msg] Components activation performed in 14 ms. [21:12:39] : [Step 4/5] [2021-11-19 21:12:39,569][INFO ][exchange-worker-#23637%grid-0%][GridCacheProcessor] Finished recovery for cache [cache=ignite-sys-cache, grp=ignite-sys-cache, startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:12:39] : [Step 4/5] [2021-11-19 21:12:39,570][INFO ][exchange-worker-#23760%grid-1%][GridCacheProcessor] Finished recovery for cache [cache=ignite-sys-cache, grp=ignite-sys-cache, startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:12:39] : [Step 4/5] [2021-11-19 21:12:39,570][INFO ][exchange-worker-#23637%grid-0%][GridDhtPartitionsExchangeFuture] Successfully activated caches [nodeId=001abc23-c1d6-4b40-b2c7-02fda8a62000, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], newState=ACTIVE] [21:12:39] : [Step 4/5] [2021-11-19 21:12:39,571][INFO ][exchange-worker-#23760%grid-1%][GridDhtPartitionsExchangeFuture] Successfully activated caches [nodeId=10d9af81-6091-44df-aa06-9b312eb8a001, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], newState=ACTIVE] [21:12:39] : [Step 4/5] [2021-11-19 21:12:39,571][INFO ][exchange-worker-#23637%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:12:39] : [Step 4/5] [2021-11-19 21:12:39,571][INFO ][exchange-worker-#23760%grid-1%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:12:39] : [Step 4/5] [2021-11-19 21:12:39,578][INFO ][exchange-worker-#23637%grid-0%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], crd=true] [21:12:39] : [Step 4/5] [2021-11-19 21:12:39,582][INFO ][grid-nio-worker-tcp-comm-0-#23575%TestRecordingCommunicationSpi%][TestRecordingCommunicationSpi] Accepted incoming communication connection [locAddr=/127.0.0.1:47100, rmtAddr=/127.0.0.1:34448] [21:12:39] : [Step 4/5] [2021-11-19 21:12:39,583][INFO ][grid-nio-worker-tcp-comm-0-#23694%TestRecordingCommunicationSpi%][TestRecordingCommunicationSpi] Established outgoing communication connection [locAddr=/127.0.0.1:34448, rmtAddr=/127.0.0.1:47100] [21:12:39] : [Step 4/5] [2021-11-19 21:12:39,584][INFO ][exchange-worker-#23760%grid-1%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], crd=false] [21:12:39] : [Step 4/5] [2021-11-19 21:12:39,586][INFO ][sys-#23622%grid-0%][GridDhtPartitionsExchangeFuture] Coordinator received single message [ver=AffinityTopologyVersion [topVer=2, minorTopVer=1], node=10d9af81-6091-44df-aa06-9b312eb8a001, allReceived=true] [21:12:39] : [Step 4/5] [2021-11-19 21:12:39,586][INFO ][sys-#23622%grid-0%][GridDhtPartitionsExchangeFuture] finishExchangeOnCoordinator [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:12:39] : [Step 4/5] [2021-11-19 21:12:39,591][INFO ][sys-#23622%grid-0%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], err=null, rebalanced=true, wasRebalanced=false] [21:12:39] : [Step 4/5] [2021-11-19 21:12:39,592][INFO ][disco-notifier-worker-#23751%grid-1%][GridClusterStateProcessor] Received state change finish message: ACTIVE [21:12:39] : [Step 4/5] [2021-11-19 21:12:39,592][INFO ][disco-notifier-worker-#23751%grid-1%][GridClusterStateProcessor] Cluster state was changed from INACTIVE to ACTIVE [21:12:39] : [Step 4/5] [2021-11-19 21:12:39,592][INFO ][sys-#23738%grid-1%][GridDhtPartitionsExchangeFuture] Received full message, will finish exchange [node=001abc23-c1d6-4b40-b2c7-02fda8a62000, resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:12:39] : [Step 4/5] [2021-11-19 21:12:39,591][INFO ][disco-notifier-worker-#23632%grid-0%][GridClusterStateProcessor] Received state change finish message: ACTIVE [21:12:39] : [Step 4/5] [2021-11-19 21:12:39,594][INFO ][sys-#23622%grid-0%][GridCacheProcessor] Finish proxy initialization, cacheName=ignite-sys-cache, localNodeId=001abc23-c1d6-4b40-b2c7-02fda8a62000 [21:12:39] : [Step 4/5] [2021-11-19 21:12:39,593][INFO ][sys-#23742%grid-1%][GridCachePartitionExchangeManager] Delay process full message without exchange id (there is exchange in progress) [nodeId=001abc23-c1d6-4b40-b2c7-02fda8a62000] [21:12:39] : [Step 4/5] [2021-11-19 21:12:39,595][INFO ][sys-#23622%grid-0%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=001abc23-c1d6-4b40-b2c7-02fda8a62000, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=001abc23-c1d6-4b40-b2c7-02fda8a62000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345559582, loc=true, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:12:39] : [Step 4/5] [2021-11-19 21:12:39,594][INFO ][exchange-worker-#23637%grid-0%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=2, minorTopVer=1], force=false, evt=DISCOVERY_CUSTOM_EVT, node=001abc23-c1d6-4b40-b2c7-02fda8a62000] [21:12:39] : [Step 4/5] [2021-11-19 21:12:39,594][INFO ][sys-#23610%grid-0%][DistributedBaselineConfiguration] Baseline auto-adjust is 'disabled' with timeout='300000' ms [21:12:39] : [Step 4/5] [2021-11-19 21:12:39,594][INFO ][sys-#23738%grid-1%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], err=null, rebalanced=true, wasRebalanced=false] [21:12:39] : [Step 4/5] [2021-11-19 21:12:39,594][INFO ][disco-notifier-worker-#23632%grid-0%][GridClusterStateProcessor] Cluster state was changed from INACTIVE to ACTIVE [21:12:39] : [Step 4/5] [2021-11-19 21:12:39,603][INFO ][sys-#23610%grid-0%][GridClusterStateProcessor] Successfully performed final activation steps [nodeId=001abc23-c1d6-4b40-b2c7-02fda8a62000, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:12:39] : [Step 4/5] [2021-11-19 21:12:39,602][INFO ][sys-#23622%grid-0%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (1 ms), stage="Update caches registry" (17 ms), stage="Start caches" (1 ms), stage="Affinity initialization on cache group start" (0 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Restore partition states" (0 ms), stage="After states restored callback" (6 ms), stage="WAL history reservation" (0 ms), stage="Waiting for all single messages" (7 ms), stage="Affinity recalculation (crd)" (0 ms), stage="Collect update counters and create affinity messages" (0 ms), stage="Assign partitions states" (0 ms), stage="Validate partitions states" (0 ms), stage="Ideal affinity diff calculation (enforced)" (0 ms), stage="Apply update counters" (0 ms), stage="Full message preparing" (2 ms), stage="Full message sending" (0 ms), stage="State finish message sending" (0 ms), stage="Detect lost partitions" (2 ms), stage="Exchange done" (8 ms), stage="Total time" (44 ms), Discovery lag=2 ms, Latest started node id=10d9af81-6091-44df-aa06-9b312eb8a001] [21:12:39] : [Step 4/5] [2021-11-19 21:12:39,605][INFO ][sys-#23738%grid-1%][GridCacheProcessor] Finish proxy initialization, cacheName=ignite-sys-cache, localNodeId=10d9af81-6091-44df-aa06-9b312eb8a001 [21:12:39] : [Step 4/5] [2021-11-19 21:12:39,607][INFO ][sys-#23622%grid-0%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], stage="Affinity initialization on cache group start [grp=ignite-sys-cache]" (0 ms) (parent=Affinity initialization on cache group start), stage="Affinity centralized initialization (crd) [grp=ignite-sys-cache, crd=true]" (0 ms) (parent=Determine exchange type), stage="Restore partition states [grp=ignite-sys-cache]" (0 ms) (parent=Restore partition states), stage="Affinity recalculation (partitions availability) [grp=ignite-sys-cache]" (0 ms) (parent=Ideal affinity diff calculation (enforced))] [21:12:39] : [Step 4/5] [2021-11-19 21:12:39,609][INFO ][test-runner-#23520%encryption.CacheGroupKeyChangeTest%][root] awaitPartitionMapExchange finished [21:12:39] : [Step 4/5] [2021-11-19 21:12:39,608][INFO ][sys-#23738%grid-1%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=10d9af81-6091-44df-aa06-9b312eb8a001, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=001abc23-c1d6-4b40-b2c7-02fda8a62000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345559492, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:12:39] : [Step 4/5] [2021-11-19 21:12:39,608][INFO ][exchange-worker-#23760%grid-1%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=2, minorTopVer=1], force=false, evt=DISCOVERY_CUSTOM_EVT, node=001abc23-c1d6-4b40-b2c7-02fda8a62000] [21:12:39] : [Step 4/5] [2021-11-19 21:12:39,608][INFO ][sys-#23746%grid-1%][DistributedBaselineConfiguration] Baseline auto-adjust is 'disabled' with timeout='300000' ms [21:12:39] : [Step 4/5] [2021-11-19 21:12:39,619][INFO ][exchange-worker-#23760%grid-1%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], crd=false, evt=DISCOVERY_CUSTOM_EVT, evtNode=001abc23-c1d6-4b40-b2c7-02fda8a62000, customEvt=DynamicCacheChangeBatch [id=167fd593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqs=ArrayList [DynamicCacheChangeRequest [cacheName=encrypted, hasCfg=true, nodeId=001abc23-c1d6-4b40-b2c7-02fda8a62000, clientStartOnly=false, stop=false, destroy=false, disabledAfterStart=false]], exchangeActions=ExchangeActions [startCaches=[encrypted], stopCaches=null, startGrps=[encrypted], stopGrps=[], resetParts=null, stateChangeRequest=null], startCaches=false], allowMerge=false, exchangeFreeSwitch=false] [21:12:39] : [Step 4/5] [2021-11-19 21:12:39,619][INFO ][sys-#23738%grid-1%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (1 ms), stage="Update caches registry" (15 ms), stage="Start caches" (0 ms), stage="Affinity initialization on cache group start" (0 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Restore partition states" (0 ms), stage="After states restored callback" (7 ms), stage="WAL history reservation" (0 ms), stage="Waiting for Full message" (12 ms), stage="Affinity recalculation" (2 ms), stage="Full map updating" (0 ms), stage="Detect lost partitions" (9 ms), stage="Exchange done" (14 ms), stage="Total time" (60 ms)] [21:12:39] : [Step 4/5] [2021-11-19 21:12:39,618][INFO ][db-checkpoint-thread-#23775%grid-1%][Checkpointer] Checkpoint started [checkpointId=0892d073-a5b5-4e06-97fb-f1c5dcec59bf, startPtr=WALPointer [idx=0, fileOff=86526, len=1963], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=22ms, writeCheckpointEntryDuration=17ms, splitAndSortCpPagesDuration=0ms, pages=17, reason='node started'] [21:12:39] : [Step 4/5] [2021-11-19 21:12:39,618][INFO ][db-checkpoint-thread-#23771%grid-0%][Checkpointer] Checkpoint started [checkpointId=c8430178-a58b-4def-86b0-b2819b884c40, startPtr=WALPointer [idx=0, fileOff=86526, len=1963], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=23ms, writeCheckpointEntryDuration=17ms, splitAndSortCpPagesDuration=0ms, pages=17, reason='node started'] [21:12:39] : [Step 4/5] [2021-11-19 21:12:39,618][INFO ][exchange-worker-#23637%grid-0%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], crd=true, evt=DISCOVERY_CUSTOM_EVT, evtNode=001abc23-c1d6-4b40-b2c7-02fda8a62000, customEvt=DynamicCacheChangeBatch [id=167fd593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqs=ArrayList [DynamicCacheChangeRequest [cacheName=encrypted, hasCfg=true, nodeId=001abc23-c1d6-4b40-b2c7-02fda8a62000, clientStartOnly=false, stop=false, destroy=false, disabledAfterStart=false]], exchangeActions=ExchangeActions [startCaches=[encrypted], stopCaches=null, startGrps=[encrypted], stopGrps=[], resetParts=null, stateChangeRequest=null], startCaches=false], allowMerge=false, exchangeFreeSwitch=false] [21:12:39] : [Step 4/5] [2021-11-19 21:12:39,623][INFO ][exchange-worker-#23760%grid-1%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:12:39] : [Step 4/5] [2021-11-19 21:12:39,622][INFO ][sys-#23738%grid-1%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], stage="Affinity initialization on cache group start [grp=ignite-sys-cache]" (0 ms) (parent=Affinity initialization on cache group start), stage="Affinity centralized initialization (crd) [grp=ignite-sys-cache, crd=false]" (0 ms) (parent=Determine exchange type), stage="Restore partition states [grp=ignite-sys-cache]" (0 ms) (parent=Restore partition states), stage="Affinity applying from full message [grp=ignite-sys-cache]" (2 ms) (parent=Affinity recalculation)] [21:12:39] : [Step 4/5] [2021-11-19 21:12:39,619][INFO ][sys-#23746%grid-1%][GridClusterStateProcessor] Successfully performed final activation steps [nodeId=10d9af81-6091-44df-aa06-9b312eb8a001, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:12:39] : [Step 4/5] [2021-11-19 21:12:39,627][INFO ][exchange-worker-#23637%grid-0%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:12:39] : [Step 4/5] [2021-11-19 21:12:39,633][INFO ][exchange-worker-#23760%grid-1%][GridCacheProcessor] Started cache [name=encrypted, id=1613773252, dataRegionName=default, mode=PARTITIONED, atomicity=ATOMIC, backups=0, mvcc=false] [21:12:39] : [Step 4/5] [2021-11-19 21:12:39,644][INFO ][exchange-worker-#23760%grid-1%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], waitTime=0ms, futInfo=NA, mode=DISTRIBUTED] [21:12:39] : [Step 4/5] [2021-11-19 21:12:39,645][INFO ][exchange-worker-#23637%grid-0%][GridCacheProcessor] Started cache [name=encrypted, id=1613773252, dataRegionName=default, mode=PARTITIONED, atomicity=ATOMIC, backups=0, mvcc=false] [21:12:39] : [Step 4/5] [2021-11-19 21:12:39,646][INFO ][exchange-worker-#23637%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], waitTime=0ms, futInfo=NA, mode=DISTRIBUTED] [21:12:39] : [Step 4/5] [2021-11-19 21:12:39,647][INFO ][exchange-worker-#23637%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partitions release latch: ServerLatch [permits=0, pendingAcks=HashSet [], super=CompletableLatch [id=CompletableLatchUid [id=exchange, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2]]]] [21:12:39] : [Step 4/5] [2021-11-19 21:12:39,647][INFO ][exchange-worker-#23760%grid-1%][GridDhtPartitionsExchangeFuture] Finished waiting for partitions release latch: ClientLatch [coordinator=TcpDiscoveryNode [id=001abc23-c1d6-4b40-b2c7-02fda8a62000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345559492, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], ackSent=true, super=CompletableLatch [id=CompletableLatchUid [id=exchange, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2]]]] [21:12:39] : [Step 4/5] [2021-11-19 21:12:39,648][INFO ][exchange-worker-#23637%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:12:39] : [Step 4/5] [2021-11-19 21:12:39,649][INFO ][exchange-worker-#23760%grid-1%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:12:39] : [Step 4/5] [2021-11-19 21:12:39,650][INFO ][exchange-worker-#23637%grid-0%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], crd=true] [21:12:39] : [Step 4/5] [2021-11-19 21:12:39,651][INFO ][exchange-worker-#23760%grid-1%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], crd=false] [21:12:39] : [Step 4/5] [2021-11-19 21:12:39,652][INFO ][sys-#23614%grid-0%][GridDhtPartitionsExchangeFuture] Coordinator received single message [ver=AffinityTopologyVersion [topVer=2, minorTopVer=2], node=10d9af81-6091-44df-aa06-9b312eb8a001, allReceived=true] [21:12:39] : [Step 4/5] [2021-11-19 21:12:39,660][INFO ][sys-#23614%grid-0%][GridDhtPartitionsExchangeFuture] finishExchangeOnCoordinator [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2]] [21:12:39] : [Step 4/5] [2021-11-19 21:12:39,662][INFO ][sys-#23614%grid-0%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], err=null, rebalanced=true, wasRebalanced=true] [21:12:39] : [Step 4/5] [2021-11-19 21:12:39,662][INFO ][sys-#23614%grid-0%][GridCacheProcessor] Finish proxy initialization, cacheName=encrypted, localNodeId=001abc23-c1d6-4b40-b2c7-02fda8a62000 [21:12:39] : [Step 4/5] [2021-11-19 21:12:39,662][INFO ][sys-#23737%grid-1%][GridDhtPartitionsExchangeFuture] Received full message, will finish exchange [node=001abc23-c1d6-4b40-b2c7-02fda8a62000, resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2]] [21:12:39] : [Step 4/5] [2021-11-19 21:12:39,663][INFO ][exchange-worker-#23637%grid-0%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=2, minorTopVer=2], force=false, evt=DISCOVERY_CUSTOM_EVT, node=001abc23-c1d6-4b40-b2c7-02fda8a62000] [21:12:39] : [Step 4/5] [2021-11-19 21:12:39,663][INFO ][sys-#23614%grid-0%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=001abc23-c1d6-4b40-b2c7-02fda8a62000, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=001abc23-c1d6-4b40-b2c7-02fda8a62000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345559613, loc=true, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2]] [21:12:39] : [Step 4/5] [2021-11-19 21:12:39,664][INFO ][sys-#23737%grid-1%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], err=null, rebalanced=true, wasRebalanced=true] [21:12:39] : [Step 4/5] [2021-11-19 21:12:39,666][INFO ][sys-#23614%grid-0%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (7 ms), stage="Update caches registry" (0 ms), stage="Start caches" (20 ms), stage="Affinity initialization on cache group start" (0 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Wait partitions release latch [latch=exchange]" (0 ms), stage="Wait partitions release [latch=exchange]" (1 ms), stage="Restore partition states" (0 ms), stage="After states restored callback" (0 ms), stage="WAL history reservation" (0 ms), stage="Waiting for all single messages" (9 ms), stage="Affinity recalculation (crd)" (0 ms), stage="Collect update counters and create affinity messages" (0 ms), stage="Assign partitions states" (0 ms), stage="Validate partitions states" (0 ms), stage="Apply update counters" (0 ms), stage="Full message preparing" (0 ms), stage="Full message sending" (0 ms), stage="Exchange done" (4 ms), stage="Total time" (41 ms)] [21:12:39] : [Step 4/5] [2021-11-19 21:12:39,666][INFO ][sys-#23737%grid-1%][GridCacheProcessor] Finish proxy initialization, cacheName=encrypted, localNodeId=10d9af81-6091-44df-aa06-9b312eb8a001 [21:12:39] : [Step 4/5] [2021-11-19 21:12:39,669][INFO ][sys-#23614%grid-0%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], stage="Affinity initialization on cache group start [grp=encrypted]" (0 ms) (parent=Affinity initialization on cache group start), stage="Restore partition states [grp=ignite-sys-cache]" (0 ms) (parent=Restore partition states), stage="Restore partition states [grp=encrypted]" (0 ms) (parent=Restore partition states)] [21:12:39] : [Step 4/5] [2021-11-19 21:12:39,676][INFO ][db-checkpoint-thread-#23771%grid-0%][Checkpointer] Checkpoint finished [cpId=c8430178-a58b-4def-86b0-b2819b884c40, pages=17, markPos=WALPointer [idx=0, fileOff=86526, len=1963], walSegmentsCovered=[], markDuration=46ms, pagesWrite=4ms, fsync=48ms, total=99ms] [21:12:39] : [Step 4/5] [2021-11-19 21:12:39,676][INFO ][db-checkpoint-thread-#23775%grid-1%][Checkpointer] Checkpoint finished [cpId=0892d073-a5b5-4e06-97fb-f1c5dcec59bf, pages=17, markPos=WALPointer [idx=0, fileOff=86526, len=1963], walSegmentsCovered=[], markDuration=44ms, pagesWrite=1ms, fsync=52ms, total=98ms] [21:12:39] : [Step 4/5] [2021-11-19 21:12:39,676][INFO ][exchange-worker-#23760%grid-1%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=2, minorTopVer=2], force=false, evt=DISCOVERY_CUSTOM_EVT, node=001abc23-c1d6-4b40-b2c7-02fda8a62000] [21:12:39] : [Step 4/5] [2021-11-19 21:12:39,676][INFO ][sys-#23737%grid-1%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=10d9af81-6091-44df-aa06-9b312eb8a001, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=001abc23-c1d6-4b40-b2c7-02fda8a62000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345559492, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2]] [21:12:39] : [Step 4/5] [2021-11-19 21:12:39,679][INFO ][sys-#23737%grid-1%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], stage="Waiting in exchange queue" (1 ms), stage="Exchange parameters initialization" (1 ms), stage="Update caches registry" (0 ms), stage="Start caches" (21 ms), stage="Affinity initialization on cache group start" (0 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Wait partitions release latch [latch=exchange]" (4 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Restore partition states" (0 ms), stage="After states restored callback" (0 ms), stage="WAL history reservation" (0 ms), stage="Waiting for Full message" (11 ms), stage="Affinity recalculation" (0 ms), stage="Full map updating" (1 ms), stage="Exchange done" (14 ms), stage="Total time" (53 ms)] [21:12:39] : [Step 4/5] [2021-11-19 21:12:39,680][INFO ][sys-#23737%grid-1%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], stage="Affinity initialization on cache group start [grp=encrypted]" (0 ms) (parent=Affinity initialization on cache group start), stage="Restore partition states [grp=ignite-sys-cache]" (0 ms) (parent=Restore partition states), stage="Restore partition states [grp=encrypted]" (0 ms) (parent=Restore partition states)] [21:12:39] : [Step 4/5] [2021-11-19 21:12:39,914][INFO ][disco-notifier-worker-#23751%grid-1%][IgniteTestResources] Block message [node=001abc23-c1d6-4b40-b2c7-02fda8a62000, order=1, msg=org.apache.ignite.internal.util.distributed.SingleNodeMessage@3acedb79] [21:12:39]W: [org.apache.ignite:ignite-core] [2021-11-19 21:12:39,919][WARN ][test-runner-#23520%encryption.CacheGroupKeyChangeTest%][G] Ignite work directory is not provided, automatically resolved to: /opt/buildagent/work/7bc1c54bc719b67c/work [21:12:39] : [Step 4/5] [2021-11-19 21:12:39,920][INFO ][test-runner-#23520%encryption.CacheGroupKeyChangeTest%][CacheGroupKeyChangeTest3] [21:12:39] : [Step 4/5] [21:12:39] : [Step 4/5] >>> __________ ________________ [21:12:39] : [Step 4/5] >>> / _/ ___/ |/ / _/_ __/ __/ [21:12:39] : [Step 4/5] >>> _/ // (7 7 // / / / / _/ [21:12:39] : [Step 4/5] >>> /___/\___/_/|_/___/ /_/ /___/ [21:12:39] : [Step 4/5] >>> [21:12:39] : [Step 4/5] >>> ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:12:39] : [Step 4/5] >>> 2021 Copyright(C) Apache Software Foundation [21:12:39] : [Step 4/5] >>> [21:12:39] : [Step 4/5] >>> Ignite documentation: http://ignite.apache.org [21:12:39] : [Step 4/5] [21:12:39] : [Step 4/5] [2021-11-19 21:12:39,921][INFO ][test-runner-#23520%encryption.CacheGroupKeyChangeTest%][CacheGroupKeyChangeTest3] Config URL: n/a [21:12:39] : [Step 4/5] [2021-11-19 21:12:39,921][INFO ][test-runner-#23520%encryption.CacheGroupKeyChangeTest%][CacheGroupKeyChangeTest3] IgniteConfiguration [igniteInstanceName=encryption.CacheGroupKeyChangeTest3, pubPoolSize=24, svcPoolSize=24, callbackPoolSize=24, stripedPoolSize=24, sysPoolSize=24, mgmtPoolSize=4, dataStreamerPoolSize=24, utilityCachePoolSize=24, utilityCacheKeepAliveTime=60000, p2pPoolSize=2, qryPoolSize=24, buildIdxPoolSize=4, igniteHome=/opt/buildagent/work/7bc1c54bc719b67c, igniteWorkDir=/opt/buildagent/work/7bc1c54bc719b67c/work, mbeanSrv=com.sun.jmx.mbeanserver.JmxMBeanServer@6fe85038, nodeId=0559c181-9e61-472c-bba5-6f3f21200003, marsh=BinaryMarshaller [], marshLocJobs=false, daemon=false, p2pEnabled=true, netTimeout=10000, netCompressionLevel=1, sndRetryDelay=1000, sndRetryCnt=3, metricsHistSize=10000, metricsUpdateFreq=1000, metricsExpTime=9223372036854775807, discoSpi=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=0, ackTimeout=0, marsh=null, reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], segPlc=STOP, segResolveAttempts=2, waitForSegOnStart=true, allResolversPassReq=true, segChkFreq=10000, commSpi=TcpCommunicationSpi [connectGate=org.apache.ignite.spi.communication.tcp.internal.ConnectGateway@52a0a900, ctxInitLatch=java.util.concurrent.CountDownLatch@641ce91[Count = 1], stopping=false, clientPool=null, nioSrvWrapper=null, stateProvider=null], evtSpi=MemoryEventStorageSpi [expireAgeMs=9223372036854775807, expireCnt=10000, filter=null], colSpi=NoopCollisionSpi [], deploySpi=LocalDeploymentSpi [], indexingSpi=org.apache.ignite.spi.indexing.noop.NoopIndexingSpi@17eef1cb, addrRslvr=null, encryptionSpi=org.apache.ignite.spi.encryption.keystore.KeystoreEncryptionSpi@603abe39, tracingSpi=org.apache.ignite.spi.tracing.NoopTracingSpi@4eb2cd25, clientMode=false, rebalanceThreadPoolSize=4, rebalanceTimeout=10000, rebalanceBatchesPrefetchCnt=3, rebalanceThrottle=0, rebalanceBatchSize=524288, txCfg=TransactionConfiguration [txSerEnabled=false, dfltIsolation=REPEATABLE_READ, dfltConcurrency=PESSIMISTIC, dfltTxTimeout=0, txTimeoutOnPartitionMapExchange=0, deadlockTimeout=10000, pessimisticTxLogSize=0, pessimisticTxLogLinger=10000, tmLookupClsName=null, txManagerFactory=null, useJtaSync=false], cacheSanityCheckEnabled=true, discoStartupDelay=60000, deployMode=SHARED, p2pMissedCacheSize=100, locHost=127.0.0.1, timeSrvPortBase=31100, timeSrvPortRange=100, failureDetectionTimeout=10000, sysWorkerBlockedTimeout=null, clientFailureDetectionTimeout=10000, metricsLogFreq=0, connectorCfg=null, odbcCfg=null, warmupClos=null, atomicCfg=AtomicConfiguration [seqReserveSize=1000, cacheMode=PARTITIONED, backups=1, aff=null, grpName=null], classLdr=null, sslCtxFactory=null, platformCfg=null, binaryCfg=null, memCfg=null, pstCfg=null, dsCfg=DataStorageConfiguration [sysRegionInitSize=41943040, sysRegionMaxSize=104857600, pageSize=4096, concLvl=0, dfltDataRegConf=DataRegionConfiguration [name=default, maxSize=104857600, initSize=268435456, swapPath=null, pageEvictionMode=DISABLED, pageReplacementMode=CLOCK, evictionThreshold=0.9, emptyPagesPoolSize=100, metricsEnabled=false, metricsSubIntervalCount=5, metricsRateTimeInterval=60000, persistenceEnabled=true, checkpointPageBufSize=0, lazyMemoryAllocation=true, warmUpCfg=null], dataRegions=null, storagePath=null, checkpointFreq=30000, lockWaitTime=10000, checkpointThreads=4, checkpointWriteOrder=SEQUENTIAL, walHistSize=20, maxWalArchiveSize=20971520, walSegments=10, walSegmentSize=1048576, walPath=db/wal, walArchivePath=db/wal/archive, cdcWalPath=db/wal/cdc, cdcEnabled=false, metricsEnabled=false, walMode=LOG_ONLY, walTlbSize=131072, walBuffSize=0, walFlushFreq=2000, walFsyncDelay=1000, walRecordIterBuffSize=67108864, alwaysWriteFullPages=false, fileIOFactory=org.apache.ignite.internal.processors.cache.persistence.file.AsyncFileIOFactory@20694472, metricsSubIntervalCnt=5, metricsRateTimeInterval=60000, walAutoArchiveAfterInactivity=-1, walForceArchiveTimeout=-1, writeThrottlingEnabled=false, walCompactionEnabled=false, walCompactionLevel=1, checkpointReadLockTimeout=null, walPageCompression=DISABLED, walPageCompressionLevel=null, dfltWarmUpCfg=null, encCfg=org.apache.ignite.configuration.EncryptionConfiguration@675c1690, defragmentationThreadPoolSize=4, minWalArchiveSize=-1], snapshotPath=snapshots, activeOnStart=true, activeOnStartPropSetFlag=false, autoActivation=true, autoActivationPropSetFlag=false, clusterStateOnStart=null, sqlConnCfg=null, cliConnCfg=ClientConnectorConfiguration [host=null, port=10800, portRange=100, sockSndBufSize=0, sockRcvBufSize=0, tcpNoDelay=true, maxOpenCursorsPerConn=128, threadPoolSize=24, selectorCnt=12, idleTimeout=0, handshakeTimeout=10000, jdbcEnabled=true, odbcEnabled=true, thinCliEnabled=true, sslEnabled=false, useIgniteSslCtxFactory=true, sslClientAuth=false, sslCtxFactory=null, thinCliCfg=ThinClientConfiguration [maxActiveTxPerConn=100, maxActiveComputeTasksPerConn=0]], mvccVacuumThreadCnt=2, mvccVacuumFreq=5000, authEnabled=false, failureHnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]], commFailureRslvr=null, sqlCfg=SqlConfiguration [longQryWarnTimeout=3000, dfltQryTimeout=0, sqlQryHistSize=1000, validationEnabled=false], asyncContinuationExecutor=null] [21:12:39] : [Step 4/5] [2021-11-19 21:12:39,930][INFO ][test-runner-#23520%encryption.CacheGroupKeyChangeTest%][CacheGroupKeyChangeTest3] Daemon mode: off [21:12:39] : [Step 4/5] [2021-11-19 21:12:39,930][INFO ][test-runner-#23520%encryption.CacheGroupKeyChangeTest%][CacheGroupKeyChangeTest3] OS: Linux 4.15.0-151-generic amd64 [21:12:39] : [Step 4/5] [2021-11-19 21:12:39,931][INFO ][test-runner-#23520%encryption.CacheGroupKeyChangeTest%][CacheGroupKeyChangeTest3] OS user: teamcity [21:12:39] : [Step 4/5] [2021-11-19 21:12:39,931][INFO ][test-runner-#23520%encryption.CacheGroupKeyChangeTest%][CacheGroupKeyChangeTest3] PID: 16724 [21:12:39] : [Step 4/5] [2021-11-19 21:12:39,931][INFO ][test-runner-#23520%encryption.CacheGroupKeyChangeTest%][CacheGroupKeyChangeTest3] Language runtime: Java Platform API Specification ver. 1.8 [21:12:39] : [Step 4/5] [2021-11-19 21:12:39,932][INFO ][test-runner-#23520%encryption.CacheGroupKeyChangeTest%][CacheGroupKeyChangeTest3] VM information: Java(TM) SE Runtime Environment 1.8.0_261-b12 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 25.261-b12 [21:12:39] : [Step 4/5] [2021-11-19 21:12:39,932][INFO ][test-runner-#23520%encryption.CacheGroupKeyChangeTest%][CacheGroupKeyChangeTest3] VM total memory: 1.9GB [21:12:39] : [Step 4/5] [2021-11-19 21:12:39,932][INFO ][test-runner-#23520%encryption.CacheGroupKeyChangeTest%][CacheGroupKeyChangeTest3] Remote Management [restart: off, REST: off, JMX (remote: off)] [21:12:39] : [Step 4/5] [2021-11-19 21:12:39,933][INFO ][test-runner-#23520%encryption.CacheGroupKeyChangeTest%][CacheGroupKeyChangeTest3] Logger: GridTestLog4jLogger [quiet=false, config=null] [21:12:39] : [Step 4/5] [2021-11-19 21:12:39,933][INFO ][test-runner-#23520%encryption.CacheGroupKeyChangeTest%][CacheGroupKeyChangeTest3] IGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c [21:12:39] : [Step 4/5] [2021-11-19 21:12:39,933][INFO ][test-runner-#23520%encryption.CacheGroupKeyChangeTest%][CacheGroupKeyChangeTest3] VM arguments: [-DIGNITE_DUMP_THREADS_ON_FAILURE=false, -DMono=/usr/bin/mono-sgen, -DMono4.0_x64=/usr/lib/mono/4.0, -DMono4.5_x64=/usr/lib/mono/4.5, -DMonoVersion=6.12.0.90, -DSKIP_BUILD=false, -Dagent.home.dir=/opt/buildagent, -Dagent.name=aitc-lin02_03, -Dagent.ownPort=9090, -Dagent.work.dir=/opt/buildagent/work, -Dbuild.number=95, -Dbuild.vcs.number=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.1=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.GitHubApacheIgnite=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dclassworlds.conf=/opt/buildagent/temp/buildTmp/teamcity.m2.conf, -Dcom.jetbrains.maven.watcher.report.file=/opt/buildagent/temp/buildTmp/maven-build-info.xml, -Djava.io.tmpdir=/opt/buildagent/temp/buildTmp, -Dmaven.home=/opt/buildagent/tools/maven3_6, -Dmaven.multiModuleProjectDirectory=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.agent.cpuBenchmark=457, -Dteamcity.agent.dotnet.agent_url=http://localhost:9090/RPC2, -Dteamcity.agent.dotnet.build_id=6278078, -Dteamcity.auth.password=*******, -Dteamcity.auth.userId=TeamCityBuildId=6278078, -Dteamcity.build.changedFiles.file=/opt/buildagent/temp/buildTmp/changedFiles6342607772318147725.txt, -Dteamcity.build.checkoutDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.build.id=6278078, -Dteamcity.build.properties.file=/opt/buildagent/temp/buildTmp/teamcity.build5164517880467851002.properties, -Dteamcity.build.tempDir=/opt/buildagent/temp/buildTmp, -Dteamcity.build.workingDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.buildConfName=Basic 3, -Dteamcity.buildType.id=IgniteTests24Java8_Basic3, -Dteamcity.configuration.properties.file=/opt/buildagent/temp/buildTmp/teamcity.config5591980786735343870.properties, -Dteamcity.maven.userSettings.path=/opt/buildagent/temp/buildTmp/maven_settings_585072866407032347.xml, -Dteamcity.maven.watcher.home=/opt/buildagent/plugins/mavenPlugin/maven-watcher-jdk16, -Dteamcity.projectName=Ignite Tests 2.x (JDK 8/11), -Dteamcity.runner.properties.file=/opt/buildagent/temp/buildTmp/teamcity.runner9098465561618137420.properties, -Dteamcity.tests.recentlyFailedTests.file=/opt/buildagent/temp/buildTmp/testsToRunFirst3891775683130404069.txt, -Dteamcity.version=2021.2 (build 99542), -ea, -Xms2g, -Xmx2g, -XX:+HeapDumpOnOutOfMemoryError, -DIGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_TEST_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_UPDATE_NOTIFIER=false, -DIGNITE_NO_DISCO_ORDER=true, -DIGNITE_PERFORMANCE_SUGGESTIONS_DISABLED=true, -Djava.net.preferIPv4Stack=true, -DTEST_SCALE_FACTOR=1.0, -DIGNITE_TEST_PROP_LOG4J_FILE=log4j-tc-test.xml, -DIGNITE_QUIET=false, -DIGNITE_MARSHAL_BUFFERS_RECHECK=1000, -Dmaven.repo.local=/opt/buildagent/.m2/repository] [21:12:39] : [Step 4/5] [2021-11-19 21:12:39,937][INFO ][test-runner-#23520%encryption.CacheGroupKeyChangeTest%][CacheGroupKeyChangeTest3] System cache's DataRegion size is configured to 40 MB. Use DataStorageConfiguration.systemRegionInitialSize property to change the setting. [21:12:39] : [Step 4/5] [2021-11-19 21:12:39,938][INFO ][test-runner-#23520%encryption.CacheGroupKeyChangeTest%][CacheGroupKeyChangeTest3] Configured caches [in 'sysMemPlc' dataRegion: ['ignite-sys-cache']] [21:12:39]W: [org.apache.ignite:ignite-core] [2021-11-19 21:12:39,938][WARN ][test-runner-#23520%encryption.CacheGroupKeyChangeTest%][CacheGroupKeyChangeTest3] Peer class loading is enabled (disable it in production for performance and deployment consistency reasons) [21:12:39] : [Step 4/5] [2021-11-19 21:12:39,938][INFO ][test-runner-#23520%encryption.CacheGroupKeyChangeTest%][CacheGroupKeyChangeTest3] 3-rd party licenses can be found at: /opt/buildagent/work/7bc1c54bc719b67c/libs/licenses [21:12:39] : [Step 4/5] [2021-11-19 21:12:39,943][INFO ][test-runner-#23520%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] Configured plugins: [21:12:39] : [Step 4/5] [2021-11-19 21:12:39,943][INFO ][test-runner-#23520%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- StanByClusterTestProvider 1.0 [21:12:39] : [Step 4/5] [2021-11-19 21:12:39,943][INFO ][test-runner-#23520%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:12:39] : [Step 4/5] [2021-11-19 21:12:39,943][INFO ][test-runner-#23520%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] [21:12:39] : [Step 4/5] [2021-11-19 21:12:39,943][INFO ][test-runner-#23520%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- PageMemory tracker plugin 1.0 [21:12:39] : [Step 4/5] [2021-11-19 21:12:39,943][INFO ][test-runner-#23520%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:12:39] : [Step 4/5] [2021-11-19 21:12:39,944][INFO ][test-runner-#23520%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] [21:12:39] : [Step 4/5] [2021-11-19 21:12:39,944][INFO ][test-runner-#23520%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- TestDistibutedConfigurationPlugin 1.0 [21:12:39] : [Step 4/5] [2021-11-19 21:12:39,944][INFO ][test-runner-#23520%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:12:39] : [Step 4/5] [2021-11-19 21:12:39,944][INFO ][test-runner-#23520%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] [21:12:39] : [Step 4/5] [2021-11-19 21:12:39,944][INFO ][test-runner-#23520%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- NodeValidationPluginProvider 1.0 [21:12:39] : [Step 4/5] [2021-11-19 21:12:39,945][INFO ][test-runner-#23520%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:12:39] : [Step 4/5] [2021-11-19 21:12:39,945][INFO ][test-runner-#23520%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] [21:12:39] : [Step 4/5] [2021-11-19 21:12:39,945][INFO ][test-runner-#23520%encryption.CacheGroupKeyChangeTest%][FailureProcessor] Configured failure handler: [hnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]]] [21:12:39] : [Step 4/5] [2021-11-19 21:12:39,968][INFO ][test-runner-#23520%encryption.CacheGroupKeyChangeTest%][TestRecordingCommunicationSpi] Successfully bound communication NIO server to TCP port [port=47102, locHost=/127.0.0.1, selectorsCnt=12, selectorSpins=0, pairedConn=false] [21:12:39]W: [org.apache.ignite:ignite-core] [2021-11-19 21:12:39,968][WARN ][test-runner-#23520%encryption.CacheGroupKeyChangeTest%][TestRecordingCommunicationSpi] Message queue limit is set to 0 which may lead to potential OOMEs when running cache operations in FULL_ASYNC or PRIMARY_SYNC modes due to message queues growth on sender and receiver sides. [21:12:39] : [Step 4/5] [2021-11-19 21:12:39,976][INFO ][test-runner-#23520%encryption.CacheGroupKeyChangeTest%][GridCollisionManager] Collision resolution is disabled (all jobs will be activated upon arrival). [21:12:39] : [Step 4/5] [2021-11-19 21:12:39,976][INFO ][test-runner-#23520%encryption.CacheGroupKeyChangeTest%][CacheGroupKeyChangeTest3] Security status [authentication=off, sandbox=off, tls/ssl=off] [21:12:40] : [Step 4/5] [2021-11-19 21:12:40,053][INFO ][test-runner-#23520%encryption.CacheGroupKeyChangeTest%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:12:40] : [Step 4/5] [2021-11-19 21:12:40,153][INFO ][test-runner-#23520%encryption.CacheGroupKeyChangeTest%][MaintenanceProcessor] Resolved store directory for node persistent data: /opt/buildagent/work/7bc1c54bc719b67c/work/db/encryption_CacheGroupKeyChangeTest3 [21:12:40] : [Step 4/5] [2021-11-19 21:12:40,155][INFO ][test-runner-#23520%encryption.CacheGroupKeyChangeTest%][CacheObjectBinaryProcessorImpl] Resolved directory for serialized binary metadata: /opt/buildagent/work/7bc1c54bc719b67c/work/db/binary_meta/encryption_CacheGroupKeyChangeTest3 [21:12:40] : [Step 4/5] [2021-11-19 21:12:40,159][INFO ][test-runner-#23520%encryption.CacheGroupKeyChangeTest%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/encryption_CacheGroupKeyChangeTest3 [21:12:40] : [Step 4/5] [2021-11-19 21:12:40,159][INFO ][test-runner-#23520%encryption.CacheGroupKeyChangeTest%][FileWriteAheadLogManager] Resolved write ahead log work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/encryption_CacheGroupKeyChangeTest3 [21:12:40] : [Step 4/5] [2021-11-19 21:12:40,160][INFO ][test-runner-#23520%encryption.CacheGroupKeyChangeTest%][FileWriteAheadLogManager] Resolved write ahead log archive directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/encryption_CacheGroupKeyChangeTest3 [21:12:40] : [Step 4/5] [2021-11-19 21:12:40,186][INFO ][test-runner-#23520%encryption.CacheGroupKeyChangeTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/encryption_CacheGroupKeyChangeTest3/0000000000000000.wal [21:12:40] : [Step 4/5] [2021-11-19 21:12:40,186][INFO ][test-runner-#23520%encryption.CacheGroupKeyChangeTest%][FileHandleManagerImpl] Initialized write-ahead log manager [mode=LOG_ONLY] [21:12:40] : [Step 4/5] [2021-11-19 21:12:40,191][INFO ][test-runner-#23520%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Configured data regions initialized successfully [total=5] [21:12:40] : [Step 4/5] [2021-11-19 21:12:40,194][INFO ][test-runner-#23520%encryption.CacheGroupKeyChangeTest%][IgniteSnapshotManager] Resolved snapshot work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/snapshots [21:12:40] : [Step 4/5] [2021-11-19 21:12:40,194][INFO ][test-runner-#23520%encryption.CacheGroupKeyChangeTest%][IgniteSnapshotManager] Resolved temp directory for snapshot creation: /opt/buildagent/work/7bc1c54bc719b67c/work/db/encryption_CacheGroupKeyChangeTest3/snp [21:12:40] : [Step 4/5] [2021-11-19 21:12:40,197][INFO ][test-runner-#23520%encryption.CacheGroupKeyChangeTest%][ClientListenerProcessor] Client connector processor has started on TCP port 10802 [21:12:40] : [Step 4/5] [2021-11-19 21:12:40,199][INFO ][test-runner-#23520%encryption.CacheGroupKeyChangeTest%][CacheGroupKeyChangeTest3] Non-loopback local IPs: 172.17.0.4 [21:12:40] : [Step 4/5] [2021-11-19 21:12:40,199][INFO ][test-runner-#23520%encryption.CacheGroupKeyChangeTest%][CacheGroupKeyChangeTest3] Enabled local MACs: 0242AC110004 [21:12:40] : [Step 4/5] [2021-11-19 21:12:40,200][INFO ][test-runner-#23520%encryption.CacheGroupKeyChangeTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:12:40] : [Step 4/5] [2021-11-19 21:12:40,201][INFO ][test-runner-#23520%encryption.CacheGroupKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:12:40] : [Step 4/5] [2021-11-19 21:12:40,201][INFO ][test-runner-#23520%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:12:40] : [Step 4/5] [2021-11-19 21:12:40,203][INFO ][test-runner-#23520%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Applying lost metastore updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:12:40] : [Step 4/5] [2021-11-19 21:12:40,204][INFO ][test-runner-#23520%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=0 ms] [21:12:40] : [Step 4/5] [2021-11-19 21:12:40,204][INFO ][test-runner-#23520%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Restoring partition state for local groups. [21:12:40] : [Step 4/5] [2021-11-19 21:12:40,204][INFO ][test-runner-#23520%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=0, partitionsProcessed=0, time=0ms] [21:12:40] : [Step 4/5] [2021-11-19 21:12:40,205][INFO ][test-runner-#23520%encryption.CacheGroupKeyChangeTest%][GridEncryptionManager] Encryption keys loaded from metastore. [grps=, masterKeyName=ignite.master.key] [21:12:40] : [Step 4/5] [2021-11-19 21:12:40,206][INFO ][test-runner-#23520%encryption.CacheGroupKeyChangeTest%][ClusterProcessor] Cluster ID and tag has been read from metastorage: null [21:12:40] : [Step 4/5] [2021-11-19 21:12:40,206][INFO ][test-runner-#23520%encryption.CacheGroupKeyChangeTest%][IgniteClusterImpl] Shutdown policy was updated [oldVal=null, newVal=null] [21:12:40] : [Step 4/5] [2021-11-19 21:12:40,207][INFO ][test-runner-#23520%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Checkpoint frequency deviation changed [oldVal=null, newVal=null] [21:12:40] : [Step 4/5] [2021-11-19 21:12:40,216][INFO ][test-runner-#23520%encryption.CacheGroupKeyChangeTest%][FilePageStoreManager] Cleanup cache stores [total=1, left=0, cleanFiles=false] [21:12:40] : [Step 4/5] [2021-11-19 21:12:40,219][INFO ][test-runner-#23520%encryption.CacheGroupKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:12:40] : [Step 4/5] [2021-11-19 21:12:40,220][INFO ][test-runner-#23520%encryption.CacheGroupKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:12:40] : [Step 4/5] [2021-11-19 21:12:40,222][INFO ][test-runner-#23520%encryption.CacheGroupKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:12:40] : [Step 4/5] [2021-11-19 21:12:40,222][INFO ][test-runner-#23520%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Data Regions Started: 5 [21:12:40] : [Step 4/5] [2021-11-19 21:12:40,223][INFO ][test-runner-#23520%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] ^-- sysMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:12:40] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:12:40] : [Step 4/5] ^-- default region [type=default, persistence=true, lazyAlloc=true, [21:12:40] : [Step 4/5] ... initCfg=100MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB, allocTotal=0MB] [21:12:40] : [Step 4/5] ^-- metastoreMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:12:40] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:12:40] : [Step 4/5] ^-- TxLog region [type=internal, persistence=true, lazyAlloc=false, [21:12:40] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:12:40] : [Step 4/5] ^-- volatileDsMemPlc region [type=user, persistence=false, lazyAlloc=true, [21:12:40] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB] [21:12:40] : [Step 4/5] ^-- Ignite persistence [used=0MB] [21:12:40] : [Step 4/5] [21:12:40] : [Step 4/5] [2021-11-19 21:12:40,224][INFO ][test-runner-#23520%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Starting binary memory restore for: [-2100569601] [21:12:40] : [Step 4/5] [2021-11-19 21:12:40,233][INFO ][test-runner-#23520%encryption.CacheGroupKeyChangeTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:12:40] : [Step 4/5] [2021-11-19 21:12:40,233][INFO ][test-runner-#23520%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:12:40] : [Step 4/5] [2021-11-19 21:12:40,236][INFO ][test-runner-#23520%encryption.CacheGroupKeyChangeTest%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/encryption_CacheGroupKeyChangeTest3/0000000000000000.wal, offset=0, ver=2] [21:12:40] : [Step 4/5] [2021-11-19 21:12:40,238][INFO ][test-runner-#23520%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Started cache in recovery mode [name=ignite-sys-cache, id=-2100569601, dataRegionName=sysMemPlc, mode=REPLICATED, atomicity=TRANSACTIONAL, backups=2147483647, mvcc=false] [21:12:40] : [Step 4/5] [2021-11-19 21:12:40,239][INFO ][test-runner-#23520%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Binary recovery performed in 15 ms. [21:12:40] : [Step 4/5] [2021-11-19 21:12:40,239][INFO ][test-runner-#23520%encryption.CacheGroupKeyChangeTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:12:40] : [Step 4/5] [2021-11-19 21:12:40,239][INFO ][test-runner-#23520%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Applying lost cache updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:12:40] : [Step 4/5] [2021-11-19 21:12:40,241][INFO ][test-runner-#23520%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=0 ms] [21:12:40] : [Step 4/5] [2021-11-19 21:12:40,242][INFO ][test-runner-#23520%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Restoring partition state for local groups. [21:12:40] : [Step 4/5] [2021-11-19 21:12:40,246][INFO ][test-runner-#23520%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=1, partitionsProcessed=100, time=0ms] [21:12:40] : [Step 4/5] [2021-11-19 21:12:40,259][INFO ][test-runner-#23520%encryption.CacheGroupKeyChangeTest%][TestTcpDiscoverySpi] Successfully bound to TCP port [port=47502, localHost=localhost/127.0.0.1, locNodeId=0559c181-9e61-472c-bba5-6f3f21200003] [21:12:40] : [Step 4/5] [2021-11-19 21:12:40,263][INFO ][tcp-disco-srvr-[:47500]-#1239%grid-0%-#23634%grid-0%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=43565] [21:12:40] : [Step 4/5] [2021-11-19 21:12:40,264][INFO ][tcp-disco-srvr-[:47500]-#1239%grid-0%-#23634%grid-0%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=43565] [21:12:40] : [Step 4/5] [2021-11-19 21:12:40,264][INFO ][tcp-disco-sock-reader-[]-#1254%grid-0%-#23906%grid-0%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:43565, rmtPort=43565] [21:12:40] : [Step 4/5] [2021-11-19 21:12:40,265][INFO ][tcp-disco-sock-reader-[0559c181 127.0.0.1:43565]-#1254%grid-0%-#23906%grid-0%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=0559c181-9e61-472c-bba5-6f3f21200003, rmtAddr=/127.0.0.1:43565] [21:12:40] : [Step 4/5] [2021-11-19 21:12:40,267][INFO ][tcp-disco-srvr-[:47502]-#1253%encryption.CacheGroupKeyChangeTest3%-#23905%encryption.CacheGroupKeyChangeTest3%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=40667] [21:12:40] : [Step 4/5] [2021-11-19 21:12:40,267][INFO ][tcp-disco-srvr-[:47502]-#1253%encryption.CacheGroupKeyChangeTest3%-#23905%encryption.CacheGroupKeyChangeTest3%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=40667] [21:12:40] : [Step 4/5] [2021-11-19 21:12:40,268][INFO ][tcp-disco-sock-reader-[]-#1255%encryption.CacheGroupKeyChangeTest3%-#23907%encryption.CacheGroupKeyChangeTest3%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:40667, rmtPort=40667] [21:12:40] : [Step 4/5] [2021-11-19 21:12:40,269][INFO ][tcp-disco-sock-reader-[]-#1255%encryption.CacheGroupKeyChangeTest3%-#23907%encryption.CacheGroupKeyChangeTest3%][TestTcpDiscoverySpi] Received ping request from the remote node [rmtNodeId=001abc23-c1d6-4b40-b2c7-02fda8a62000, rmtAddr=/127.0.0.1:40667, rmtPort=40667] [21:12:40] : [Step 4/5] [2021-11-19 21:12:40,270][INFO ][tcp-disco-sock-reader-[]-#1255%encryption.CacheGroupKeyChangeTest3%-#23907%encryption.CacheGroupKeyChangeTest3%][TestTcpDiscoverySpi] Finished writing ping response [rmtNodeId=001abc23-c1d6-4b40-b2c7-02fda8a62000, rmtAddr=/127.0.0.1:40667, rmtPort=40667] [21:12:40] : [Step 4/5] [2021-11-19 21:12:40,270][INFO ][tcp-disco-sock-reader-[0559c181 127.0.0.1:43565]-#1254%grid-0%-#23906%grid-0%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:43565, rmtPort=43565, rmtNodeId=0559c181-9e61-472c-bba5-6f3f21200003] [21:12:40] : [Step 4/5] [2021-11-19 21:12:40,270][INFO ][tcp-disco-sock-reader-[]-#1255%encryption.CacheGroupKeyChangeTest3%-#23907%encryption.CacheGroupKeyChangeTest3%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:40667, rmtPort=40667, rmtNodeId=null] [21:12:40]W: [org.apache.ignite:ignite-core] [2021-11-19 21:12:40,272][WARN ][disco-pool-#23908%grid-0%][TestTcpDiscoverySpi] Cache group key change is in progress! Node join is rejected. [node=0559c181-9e61-472c-bba5-6f3f21200003] [21:12:40] : [Step 4/5] [2021-11-19 21:12:40,273][INFO ][tcp-disco-srvr-[:47502]-#1253%encryption.CacheGroupKeyChangeTest3%-#23905%encryption.CacheGroupKeyChangeTest3%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=47327] [21:12:40] : [Step 4/5] [2021-11-19 21:12:40,274][INFO ][tcp-disco-srvr-[:47502]-#1253%encryption.CacheGroupKeyChangeTest3%-#23905%encryption.CacheGroupKeyChangeTest3%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=47327] [21:12:40] : [Step 4/5] [2021-11-19 21:12:40,275][INFO ][tcp-disco-sock-reader-[]-#1256%encryption.CacheGroupKeyChangeTest3%-#23909%encryption.CacheGroupKeyChangeTest3%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:47327, rmtPort=47327] [21:12:40] : [Step 4/5] [2021-11-19 21:12:40,276][INFO ][tcp-disco-sock-reader-[001abc23 127.0.0.1:47327]-#1256%encryption.CacheGroupKeyChangeTest3%-#23909%encryption.CacheGroupKeyChangeTest3%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=001abc23-c1d6-4b40-b2c7-02fda8a62000, rmtAddr=/127.0.0.1:47327] [21:12:40]W: [org.apache.ignite:ignite-core] [2021-11-19 21:12:40,282][ERROR][test-runner-#23520%encryption.CacheGroupKeyChangeTest%][CacheGroupKeyChangeTest3] Failed to start manager: GridManagerAdapter [enabled=true, name=o.a.i.i.managers.discovery.GridDiscoveryManager] [21:12:40]W: [org.apache.ignite:ignite-core] class org.apache.ignite.IgniteCheckedException: Failed to start SPI: TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=5000, ackTimeout=5000, marsh=JdkMarshaller [clsFilter=org.apache.ignite.marshaller.MarshallerUtils$1@2071942f], reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false] [21:12:40]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.managers.GridManagerAdapter.startSpi(GridManagerAdapter.java:281) [21:12:40]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.managers.discovery.GridDiscoveryManager.start(GridDiscoveryManager.java:1091) [21:12:40]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.IgniteKernal.startManager(IgniteKernal.java:1953) [21:12:40]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.IgniteKernal.start(IgniteKernal.java:1300) [21:12:40]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.IgnitionEx$IgniteNamedInstance.start0(IgnitionEx.java:1798) [21:12:40]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.IgnitionEx$IgniteNamedInstance.start(IgnitionEx.java:1720) [21:12:40]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.IgnitionEx.start0(IgnitionEx.java:1159) [21:12:40]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.IgnitionEx.start(IgnitionEx.java:629) [21:12:40]W: [org.apache.ignite:ignite-core] at org.apache.ignite.testframework.junits.GridAbstractTest.startGrid(GridAbstractTest.java:1252) [21:12:40]W: [org.apache.ignite:ignite-core] at org.apache.ignite.testframework.junits.GridAbstractTest.startGrid(GridAbstractTest.java:1169) [21:12:40]W: [org.apache.ignite:ignite-core] at org.apache.ignite.testframework.junits.GridAbstractTest.startGrid(GridAbstractTest.java:1145) [21:12:40]W: [org.apache.ignite:ignite-core] at org.apache.ignite.testframework.junits.GridAbstractTest.startGrid(GridAbstractTest.java:998) [21:12:40]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.encryption.CacheGroupKeyChangeTest.lambda$testRejectNodeJoinDuringRotation$0(CacheGroupKeyChangeTest.java:169) [21:12:40]W: [org.apache.ignite:ignite-core] at org.apache.ignite.testframework.GridTestUtils.assertThrowsWithCause(GridTestUtils.java:636) [21:12:40]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.encryption.CacheGroupKeyChangeTest.testRejectNodeJoinDuringRotation(CacheGroupKeyChangeTest.java:169) [21:12:40]W: [org.apache.ignite:ignite-core] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) [21:12:40]W: [org.apache.ignite:ignite-core] at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) [21:12:40]W: [org.apache.ignite:ignite-core] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [21:12:40]W: [org.apache.ignite:ignite-core] at java.lang.reflect.Method.invoke(Method.java:498) [21:12:40]W: [org.apache.ignite:ignite-core] at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50) [21:12:40]W: [org.apache.ignite:ignite-core] at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) [21:12:40]W: [org.apache.ignite:ignite-core] at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47) [21:12:40]W: [org.apache.ignite:ignite-core] at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) [21:12:40]W: [org.apache.ignite:ignite-core] at org.apache.ignite.testframework.junits.GridAbstractTest$7.run(GridAbstractTest.java:2432) [21:12:40]W: [org.apache.ignite:ignite-core] at java.lang.Thread.run(Thread.java:748) [21:12:40]W: [org.apache.ignite:ignite-core] Caused by: class org.apache.ignite.spi.IgniteSpiException: Cache group key change is in progress! Node join is rejected. [21:12:40]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.discovery.tcp.TcpDiscoverySpi.checkFailedError(TcpDiscoverySpi.java:2108) [21:12:40]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.discovery.tcp.ServerImpl.joinTopology(ServerImpl.java:1206) [21:12:40]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.discovery.tcp.ServerImpl.spiStart(ServerImpl.java:474) [21:12:40]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.discovery.tcp.TcpDiscoverySpi.spiStart(TcpDiscoverySpi.java:2210) [21:12:40] : [Step 4/5] [2021-11-19 21:12:40,282][INFO ][tcp-disco-sock-reader-[001abc23 127.0.0.1:47327]-#1256%encryption.CacheGroupKeyChangeTest3%-#23909%encryption.CacheGroupKeyChangeTest3%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:47327, rmtPort=47327, rmtNodeId=001abc23-c1d6-4b40-b2c7-02fda8a62000] [21:12:40]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.managers.GridManagerAdapter.startSpi(GridManagerAdapter.java:278) [21:12:40]W: [org.apache.ignite:ignite-core] ... 24 more [21:12:40]W: [org.apache.ignite:ignite-core] [2021-11-19 21:12:40,287][ERROR][test-runner-#23520%encryption.CacheGroupKeyChangeTest%][CacheGroupKeyChangeTest3] Got exception while starting (will rollback startup routine). [21:12:40]W: [org.apache.ignite:ignite-core] class org.apache.ignite.IgniteCheckedException: Failed to start manager: GridManagerAdapter [enabled=true, name=org.apache.ignite.internal.managers.discovery.GridDiscoveryManager] [21:12:40]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.IgniteKernal.startManager(IgniteKernal.java:1958) [21:12:40]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.IgniteKernal.start(IgniteKernal.java:1300) [21:12:40]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.IgnitionEx$IgniteNamedInstance.start0(IgnitionEx.java:1798) [21:12:40]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.IgnitionEx$IgniteNamedInstance.start(IgnitionEx.java:1720) [21:12:40]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.IgnitionEx.start0(IgnitionEx.java:1159) [21:12:40]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.IgnitionEx.start(IgnitionEx.java:629) [21:12:40]W: [org.apache.ignite:ignite-core] at org.apache.ignite.testframework.junits.GridAbstractTest.startGrid(GridAbstractTest.java:1252) [21:12:40]W: [org.apache.ignite:ignite-core] at org.apache.ignite.testframework.junits.GridAbstractTest.startGrid(GridAbstractTest.java:1169) [21:12:40]W: [org.apache.ignite:ignite-core] at org.apache.ignite.testframework.junits.GridAbstractTest.startGrid(GridAbstractTest.java:1145) [21:12:40]W: [org.apache.ignite:ignite-core] at org.apache.ignite.testframework.junits.GridAbstractTest.startGrid(GridAbstractTest.java:998) [21:12:40]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.encryption.CacheGroupKeyChangeTest.lambda$testRejectNodeJoinDuringRotation$0(CacheGroupKeyChangeTest.java:169) [21:12:40]W: [org.apache.ignite:ignite-core] at org.apache.ignite.testframework.GridTestUtils.assertThrowsWithCause(GridTestUtils.java:636) [21:12:40]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.encryption.CacheGroupKeyChangeTest.testRejectNodeJoinDuringRotation(CacheGroupKeyChangeTest.java:169) [21:12:40]W: [org.apache.ignite:ignite-core] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) [21:12:40]W: [org.apache.ignite:ignite-core] at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) [21:12:40]W: [org.apache.ignite:ignite-core] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [21:12:40]W: [org.apache.ignite:ignite-core] at java.lang.reflect.Method.invoke(Method.java:498) [21:12:40]W: [org.apache.ignite:ignite-core] at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50) [21:12:40]W: [org.apache.ignite:ignite-core] at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) [21:12:40]W: [org.apache.ignite:ignite-core] at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47) [21:12:40]W: [org.apache.ignite:ignite-core] at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) [21:12:40]W: [org.apache.ignite:ignite-core] at org.apache.ignite.testframework.junits.GridAbstractTest$7.run(GridAbstractTest.java:2432) [21:12:40]W: [org.apache.ignite:ignite-core] at java.lang.Thread.run(Thread.java:748) [21:12:40]W: [org.apache.ignite:ignite-core] Caused by: class org.apache.ignite.IgniteCheckedException: Failed to start SPI: TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=5000, ackTimeout=5000, marsh=JdkMarshaller [clsFilter=org.apache.ignite.marshaller.MarshallerUtils$1@2071942f], reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false] [21:12:40]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.managers.GridManagerAdapter.startSpi(GridManagerAdapter.java:281) [21:12:40]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.managers.discovery.GridDiscoveryManager.start(GridDiscoveryManager.java:1091) [21:12:40]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.IgniteKernal.startManager(IgniteKernal.java:1953) [21:12:40]W: [org.apache.ignite:ignite-core] ... 22 more [21:12:40]W: [org.apache.ignite:ignite-core] Caused by: class org.apache.ignite.spi.IgniteSpiException: Cache group key change is in progress! Node join is rejected. [21:12:40]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.discovery.tcp.TcpDiscoverySpi.checkFailedError(TcpDiscoverySpi.java:2108) [21:12:40]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.discovery.tcp.ServerImpl.joinTopology(ServerImpl.java:1206) [21:12:40]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.discovery.tcp.ServerImpl.spiStart(ServerImpl.java:474) [21:12:40]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.discovery.tcp.TcpDiscoverySpi.spiStart(TcpDiscoverySpi.java:2210) [21:12:40]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.managers.GridManagerAdapter.startSpi(GridManagerAdapter.java:278) [21:12:40]W: [org.apache.ignite:ignite-core] ... 24 more [21:12:45] : [Step 4/5] [2021-11-19 21:12:45,299][INFO ][test-runner-#23520%encryption.CacheGroupKeyChangeTest%][TestTcpDiscoverySpi] No verification for local node leave has been received from coordinator (will stop node anyway). [21:12:45] : [Step 4/5] [2021-11-19 21:12:45,302][INFO ][test-runner-#23520%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Stopped cache [cacheName=ignite-sys-cache] [21:12:45] : [Step 4/5] [2021-11-19 21:12:45,308][INFO ][test-runner-#23520%encryption.CacheGroupKeyChangeTest%][FilePageStoreManager] Cleanup cache stores [total=3, left=0, cleanFiles=false] [21:12:45] : [Step 4/5] [2021-11-19 21:12:45,314][INFO ][test-runner-#23520%encryption.CacheGroupKeyChangeTest%][CacheGroupKeyChangeTest3] [21:12:45] : [Step 4/5] [21:12:45] : [Step 4/5] >>> +------------------------------------------------------+ [21:12:45] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV stopped OK [21:12:45] : [Step 4/5] >>> +------------------------------------------------------+ [21:12:45] : [Step 4/5] >>> Ignite instance name: encryption.CacheGroupKeyChangeTest3 [21:12:45] : [Step 4/5] >>> Grid uptime: 00:00:05.388 [21:12:45] : [Step 4/5] [21:12:45] : [Step 4/5] [21:12:45] : [Step 4/5] [2021-11-19 21:12:45,315][INFO ][test-runner-#23520%encryption.CacheGroupKeyChangeTest%][IgniteTestResources] Send blocked message [node=001abc23-c1d6-4b40-b2c7-02fda8a62000, order=1, msg=org.apache.ignite.internal.util.distributed.SingleNodeMessage@3acedb79] [21:12:45] : [Step 4/5] [2021-11-19 21:12:45,319][INFO ][disco-notifier-worker-#23632%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=1] [21:12:45] : [Step 4/5] [2021-11-19 21:12:45,319][INFO ][disco-notifier-worker-#23751%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=1] [21:12:45] : [Step 4/5] [2021-11-19 21:12:45,319][INFO ][reencrypt-#23910%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:12:45] : [Step 4/5] [2021-11-19 21:12:45,320][INFO ][reencrypt-#23911%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:12:45] : [Step 4/5] [2021-11-19 21:12:45,320][INFO ][test-runner-#23520%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10d9af81-6091-44df-aa06-9b312eb8a001, grp=1613773252] [21:12:45] : [Step 4/5] [2021-11-19 21:12:45,324][INFO ][db-checkpoint-thread-#23775%grid-1%][Checkpointer] Checkpoint started [checkpointId=691d0bb3-7bd5-43cf-b51f-6262b4de0a59, startPtr=WALPointer [idx=0, fileOff=186526, len=2048], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=1ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=0ms, pages=63, reason='test'] [21:12:45] : [Step 4/5] [2021-11-19 21:12:45,391][INFO ][db-checkpoint-thread-#23775%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:12:45] : [Step 4/5] [2021-11-19 21:12:45,392][INFO ][db-checkpoint-thread-#23775%grid-1%][Checkpointer] Checkpoint finished [cpId=691d0bb3-7bd5-43cf-b51f-6262b4de0a59, pages=63, markPos=WALPointer [idx=0, fileOff=186526, len=2048], walSegmentsCovered=[], markDuration=2ms, pagesWrite=3ms, fsync=65ms, total=71ms] [21:12:45] : [Step 4/5] [2021-11-19 21:12:45,393][INFO ][test-runner-#23520%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=001abc23-c1d6-4b40-b2c7-02fda8a62000, grp=1613773252] [21:12:45] : [Step 4/5] [2021-11-19 21:12:45,400][INFO ][db-checkpoint-thread-#23771%grid-0%][Checkpointer] Checkpoint started [checkpointId=9c85287f-8cde-437d-95c1-ad826f9927d0, startPtr=WALPointer [idx=0, fileOff=158506, len=2010], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=1ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=4ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=0ms, pages=43, reason='test'] [21:12:45] : [Step 4/5] [2021-11-19 21:12:45,451][INFO ][db-checkpoint-thread-#23771%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:12:45] : [Step 4/5] [2021-11-19 21:12:45,451][INFO ][db-checkpoint-thread-#23771%grid-0%][Checkpointer] Checkpoint finished [cpId=9c85287f-8cde-437d-95c1-ad826f9927d0, pages=43, markPos=WALPointer [idx=0, fileOff=158506, len=2010], walSegmentsCovered=[], markDuration=7ms, pagesWrite=2ms, fsync=48ms, total=57ms] [21:12:45] : [Step 4/5] [21:12:45] >>> Stopping test: CacheGroupKeyChangeTest#testRejectNodeJoinDuringRotation in 7365 ms <<< [21:12:45] : [Step 4/5] [2021-11-19 21:12:45,476][INFO ][main][root] >>> Stopping test: CacheGroupKeyChangeTest#testRejectNodeJoinDuringRotation in 7365 ms <<< [21:12:45] : [Step 4/5] [21:12:45] >>> Heap: 499 MB used / 1941 MB commited / 1941 MB max <<< [21:12:45] : [Step 4/5] [2021-11-19 21:12:45,476][INFO ][main][root] >>> Heap: 499 MB used / 1941 MB commited / 1941 MB max <<< [21:12:45] : [Step 4/5] [21:12:45] >>> Non-Heap: 168 MB used / 188 MB commited / 0 MB max <<< [21:12:45] : [Step 4/5] [2021-11-19 21:12:45,476][INFO ][main][root] >>> Non-Heap: 168 MB used / 188 MB commited / 0 MB max <<< [21:12:45] : [Step 4/5] [2021-11-19 21:12:45,477][INFO ][main][root] >>> Stopping grid [name=grid-1, id=10d9af81-6091-44df-aa06-9b312eb8a001] [21:12:45] : [Step 4/5] [2021-11-19 21:12:45,488][INFO ][db-checkpoint-thread-#23775%grid-1%][Checkpointer] Skipping checkpoint (no pages were modified) [checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, reason='timeout'] [21:12:45]W: [org.apache.ignite:ignite-core] [2021-11-19 21:12:45,494][WARN ][tcp-disco-sock-reader-[001abc23 127.0.0.1:43021]-#1247%grid-1%-#23756%grid-1%][TestTcpDiscoverySpi] Failed to shutdown socket [21:12:45]W: [org.apache.ignite:ignite-core] java.net.SocketException: Socket is closed [21:12:45]W: [org.apache.ignite:ignite-core] at java.net.Socket.shutdownOutput(Socket.java:1568) [21:12:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.close(IgniteUtils.java:4247) [21:12:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.discovery.tcp.ServerImpl$SocketReader.body(ServerImpl.java:7370) [21:12:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.IgniteSpiThread.run(IgniteSpiThread.java:58) [21:12:45] : [Step 4/5] [2021-11-19 21:12:45,494][INFO ][disco-event-worker-#23636%grid-0%][GridDiscoveryManager] Node left topology: TcpDiscoveryNode [id=10d9af81-6091-44df-aa06-9b312eb8a001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637345559472, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false] [21:12:45] : [Step 4/5] [2021-11-19 21:12:45,495][INFO ][tcp-disco-sock-reader-[001abc23 127.0.0.1:43021]-#1247%grid-1%-#23756%grid-1%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:43021, rmtPort=43021, rmtNodeId=001abc23-c1d6-4b40-b2c7-02fda8a62000] [21:12:45] : [Step 4/5] [2021-11-19 21:12:45,496][INFO ][disco-event-worker-#23636%grid-0%][GridDiscoveryManager] Topology snapshot [ver=3, locNode=001abc23, servers=1, clients=0, state=ACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=001abc23-c1d6-4b40-b2c7-02fda8a62000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:12:45] : [Step 4/5] [2021-11-19 21:12:45,497][INFO ][main][GridCacheProcessor] Stopped cache [cacheName=ignite-sys-cache] [21:12:45] : [Step 4/5] [2021-11-19 21:12:45,497][INFO ][main][GridCacheProcessor] Stopped cache [cacheName=encrypted] [21:12:45] : [Step 4/5] [2021-11-19 21:12:45,497][INFO ][disco-event-worker-#23636%grid-0%][GridDiscoveryManager] ^-- Baseline [id=0, size=2, online=1, offline=1] [21:12:45]W: [org.apache.ignite:ignite-core] [2021-11-19 21:12:45,498][WARN ][grid-nio-worker-tcp-comm-0-#23575%TestRecordingCommunicationSpi%][TestRecordingCommunicationSpi] Failed to shutdown socket [21:12:45]W: [org.apache.ignite:ignite-core] java.nio.channels.ClosedChannelException [21:12:45]W: [org.apache.ignite:ignite-core] at sun.nio.ch.SocketChannelImpl.shutdownOutput(SocketChannelImpl.java:795) [21:12:45]W: [org.apache.ignite:ignite-core] at sun.nio.ch.SocketAdaptor.shutdownOutput(SocketAdaptor.java:407) [21:12:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.close(IgniteUtils.java:4247) [21:12:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.closeKey(GridNioServer.java:2784) [21:12:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.close(GridNioServer.java:2835) [21:12:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.close(GridNioServer.java:2794) [21:12:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.bodyInternal(GridNioServer.java:2157) [21:12:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.body(GridNioServer.java:1910) [21:12:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:125) [21:12:45]W: [org.apache.ignite:ignite-core] at java.lang.Thread.run(Thread.java:748) [21:12:45] : [Step 4/5] [2021-11-19 21:12:45,501][INFO ][exchange-worker-#23637%grid-0%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], crd=true, evt=NODE_LEFT, evtNode=10d9af81-6091-44df-aa06-9b312eb8a001, customEvt=null, allowMerge=false, exchangeFreeSwitch=true] [21:12:45] : [Step 4/5] [2021-11-19 21:12:45,501][INFO ][main][FilePageStoreManager] Cleanup cache stores [total=4, left=0, cleanFiles=false] [21:12:45] : [Step 4/5] [2021-11-19 21:12:45,502][INFO ][sys-#23622%grid-0%][GridAffinityAssignmentCache] Local node affinity assignment distribution is not ideal [cache=encrypted, expectedPrimary=8.00, actualPrimary=3, expectedBackups=0.00, actualBackups=0, warningThreshold=50.00%] [21:12:45] : [Step 4/5] [2021-11-19 21:12:45,503][INFO ][exchange-worker-#23637%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:12:45] : [Step 4/5] [2021-11-19 21:12:45,505][INFO ][exchange-worker-#23637%grid-0%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], err=null, rebalanced=true, wasRebalanced=true] [21:12:45] : [Step 4/5] [2021-11-19 21:12:45,505][INFO ][main][GridDeploymentLocalStore] Removed undeployed class: GridDeployment [ts=1637345559582, depMode=SHARED, clsLdr=IsolatedClassLoader{roleName='test'}, clsLdrId=b47fd593d71-10d9af81-6091-44df-aa06-9b312eb8a001, userVer=0, loc=true, sampleClsName=org.apache.ignite.internal.processors.cache.distributed.dht.preloader.IgniteDhtPartitionsToReloadMap, pendingUndeploy=false, undeployed=true, usage=0] [21:12:45]W: [org.apache.ignite:ignite-core] [2021-11-19 21:12:45,505][WARN ][exchange-worker-#23637%grid-0%][GridDhtPartitionTopologyImpl] Detected lost partitions [grp=encrypted, parts=[0, 2, 4, 6-7], topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0]] [21:12:45] : [Step 4/5] [2021-11-19 21:12:45,508][INFO ][exchange-worker-#23637%grid-0%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=001abc23-c1d6-4b40-b2c7-02fda8a62000, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], evt=NODE_LEFT, evtNode=TcpDiscoveryNode [id=10d9af81-6091-44df-aa06-9b312eb8a001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637345559472, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0]] [21:12:45] : [Step 4/5] [2021-11-19 21:12:45,510][INFO ][exchange-worker-#23637%grid-0%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (1 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="After states restored callback" (0 ms), stage="WAL history reservation" (0 ms), stage="Finalize update counters" (0 ms), stage="Detect lost partitions" (2 ms), stage="Exchange done" (2 ms), stage="Total time" (5 ms)] [21:12:45] : [Step 4/5] [2021-11-19 21:12:45,511][INFO ][exchange-worker-#23637%grid-0%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], stage="Affinity initialization (exchange-free switch on fully-rebalanced topology) [grp=ignite-sys-cache]" (0 ms) (parent=Determine exchange type), stage="Affinity initialization (exchange-free switch on fully-rebalanced topology) [grp=encrypted]" (0 ms) (parent=Determine exchange type)] [21:12:45] : [Step 4/5] [2021-11-19 21:12:45,512][INFO ][exchange-worker-#23637%grid-0%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], crd=true] [21:12:45] : [Step 4/5] [2021-11-19 21:12:45,513][INFO ][exchange-worker-#23637%grid-0%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=3, minorTopVer=0], force=false, evt=NODE_LEFT, node=10d9af81-6091-44df-aa06-9b312eb8a001] [21:12:45] : [Step 4/5] [2021-11-19 21:12:45,515][INFO ][main][IgniteKernal%grid-1] [21:12:45] : [Step 4/5] [21:12:45] : [Step 4/5] >>> +------------------------------------------------------+ [21:12:45] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV stopped OK [21:12:45] : [Step 4/5] >>> +------------------------------------------------------+ [21:12:45] : [Step 4/5] >>> Ignite instance name: grid-1 [21:12:45] : [Step 4/5] >>> Grid uptime: 00:00:05.974 [21:12:45] : [Step 4/5] [21:12:45] : [Step 4/5] [21:12:45] : [Step 4/5] [2021-11-19 21:12:45,516][INFO ][main][root] >>> Stopping grid [name=grid-0, id=001abc23-c1d6-4b40-b2c7-02fda8a62000] [21:12:45] : [Step 4/5] [2021-11-19 21:12:45,521][INFO ][db-checkpoint-thread-#23771%grid-0%][Checkpointer] Skipping checkpoint (no pages were modified) [checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=1ms, checkpointLockHoldTime=1ms, reason='timeout'] [21:12:45] : [Step 4/5] [2021-11-19 21:12:45,524][INFO ][tcp-disco-sock-reader-[10d9af81 127.0.0.1:33771]-#1248%grid-0%-#23757%grid-0%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:33771, rmtPort=33771, rmtNodeId=10d9af81-6091-44df-aa06-9b312eb8a001] [21:12:45] : [Step 4/5] [2021-11-19 21:12:45,526][INFO ][main][GridCacheProcessor] Stopped cache [cacheName=ignite-sys-cache] [21:12:45] : [Step 4/5] [2021-11-19 21:12:45,526][INFO ][main][GridCacheProcessor] Stopped cache [cacheName=encrypted] [21:12:45] : [Step 4/5] [2021-11-19 21:12:45,529][INFO ][main][FilePageStoreManager] Cleanup cache stores [total=4, left=0, cleanFiles=false] [21:12:45] : [Step 4/5] [2021-11-19 21:12:45,530][INFO ][main][GridDeploymentLocalStore] Removed undeployed class: GridDeployment [ts=1637345559582, depMode=SHARED, clsLdr=IsolatedClassLoader{roleName='test'}, clsLdrId=947fd593d71-001abc23-c1d6-4b40-b2c7-02fda8a62000, userVer=0, loc=true, sampleClsName=org.apache.ignite.internal.processors.cache.distributed.dht.preloader.GridDhtPartitionMap, pendingUndeploy=false, undeployed=true, usage=0] [21:12:45] : [Step 4/5] [2021-11-19 21:12:45,538][INFO ][main][IgniteKernal%grid-0] [21:12:45] : [Step 4/5] [21:12:45] : [Step 4/5] >>> +------------------------------------------------------+ [21:12:45] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV stopped OK [21:12:45] : [Step 4/5] >>> +------------------------------------------------------+ [21:12:45] : [Step 4/5] >>> Ignite instance name: grid-0 [21:12:45] : [Step 4/5] >>> Grid uptime: 00:00:06.598 [21:12:45] : [Step 4/5] [21:12:45] : [Step 4/5] [21:12:45] : [Step 4/5] [21:12:45] >>> Starting test: CacheGroupKeyChangeTest#testWrongCacheGroupSpecified <<< [21:12:45] : [Step 4/5] [2021-11-19 21:12:45,558][INFO ][main][root] >>> Starting test: CacheGroupKeyChangeTest#testWrongCacheGroupSpecified <<< [21:12:45] : [Step 4/5] [21:12:45] >>> Heap: 502 MB used / 1941 MB commited / 1941 MB max <<< [21:12:45] : [Step 4/5] [2021-11-19 21:12:45,559][INFO ][main][root] >>> Heap: 502 MB used / 1941 MB commited / 1941 MB max <<< [21:12:45] : [Step 4/5] [21:12:45] >>> Non-Heap: 168 MB used / 188 MB commited / 0 MB max <<< [21:12:45] : [Step 4/5] [2021-11-19 21:12:45,559][INFO ][main][root] >>> Non-Heap: 168 MB used / 188 MB commited / 0 MB max <<< [21:12:45]W: [org.apache.ignite:ignite-core] [2021-11-19 21:12:45,567][WARN ][test-runner-#23916%encryption.CacheGroupKeyChangeTest%][G] Ignite work directory is not provided, automatically resolved to: /opt/buildagent/work/7bc1c54bc719b67c/work [21:12:45] : [Step 4/5] [2021-11-19 21:12:45,569][INFO ][test-runner-#23916%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] [21:12:45] : [Step 4/5] [21:12:45] : [Step 4/5] >>> __________ ________________ [21:12:45] : [Step 4/5] >>> / _/ ___/ |/ / _/_ __/ __/ [21:12:45] : [Step 4/5] >>> _/ // (7 7 // / / / / _/ [21:12:45] : [Step 4/5] >>> /___/\___/_/|_/___/ /_/ /___/ [21:12:45] : [Step 4/5] >>> [21:12:45] : [Step 4/5] >>> ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:12:45] : [Step 4/5] >>> 2021 Copyright(C) Apache Software Foundation [21:12:45] : [Step 4/5] >>> [21:12:45] : [Step 4/5] >>> Ignite documentation: http://ignite.apache.org [21:12:45] : [Step 4/5] [21:12:45] : [Step 4/5] [2021-11-19 21:12:45,570][INFO ][test-runner-#23916%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] Config URL: n/a [21:12:45] : [Step 4/5] [2021-11-19 21:12:45,570][INFO ][test-runner-#23916%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] IgniteConfiguration [igniteInstanceName=grid-0, pubPoolSize=24, svcPoolSize=24, callbackPoolSize=24, stripedPoolSize=24, sysPoolSize=24, mgmtPoolSize=4, dataStreamerPoolSize=24, utilityCachePoolSize=24, utilityCacheKeepAliveTime=60000, p2pPoolSize=2, qryPoolSize=24, buildIdxPoolSize=4, igniteHome=/opt/buildagent/work/7bc1c54bc719b67c, igniteWorkDir=/opt/buildagent/work/7bc1c54bc719b67c/work, mbeanSrv=com.sun.jmx.mbeanserver.JmxMBeanServer@6fe85038, nodeId=0021223b-d470-4a41-b54f-6489314a0000, marsh=BinaryMarshaller [], marshLocJobs=false, daemon=false, p2pEnabled=true, netTimeout=10000, netCompressionLevel=1, sndRetryDelay=1000, sndRetryCnt=3, metricsHistSize=10000, metricsUpdateFreq=1000, metricsExpTime=9223372036854775807, discoSpi=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=0, ackTimeout=0, marsh=null, reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], segPlc=STOP, segResolveAttempts=2, waitForSegOnStart=true, allResolversPassReq=true, segChkFreq=10000, commSpi=TcpCommunicationSpi [connectGate=org.apache.ignite.spi.communication.tcp.internal.ConnectGateway@7b6d9d95, ctxInitLatch=java.util.concurrent.CountDownLatch@63980fdd[Count = 1], stopping=false, clientPool=null, nioSrvWrapper=null, stateProvider=null], evtSpi=MemoryEventStorageSpi [expireAgeMs=9223372036854775807, expireCnt=10000, filter=null], colSpi=NoopCollisionSpi [], deploySpi=LocalDeploymentSpi [], indexingSpi=org.apache.ignite.spi.indexing.noop.NoopIndexingSpi@384dd25, addrRslvr=null, encryptionSpi=org.apache.ignite.spi.encryption.keystore.KeystoreEncryptionSpi@16c87c63, tracingSpi=org.apache.ignite.spi.tracing.NoopTracingSpi@1a417975, clientMode=false, rebalanceThreadPoolSize=4, rebalanceTimeout=10000, rebalanceBatchesPrefetchCnt=3, rebalanceThrottle=0, rebalanceBatchSize=524288, txCfg=TransactionConfiguration [txSerEnabled=false, dfltIsolation=REPEATABLE_READ, dfltConcurrency=PESSIMISTIC, dfltTxTimeout=0, txTimeoutOnPartitionMapExchange=0, deadlockTimeout=10000, pessimisticTxLogSize=0, pessimisticTxLogLinger=10000, tmLookupClsName=null, txManagerFactory=null, useJtaSync=false], cacheSanityCheckEnabled=true, discoStartupDelay=60000, deployMode=SHARED, p2pMissedCacheSize=100, locHost=127.0.0.1, timeSrvPortBase=31100, timeSrvPortRange=100, failureDetectionTimeout=10000, sysWorkerBlockedTimeout=null, clientFailureDetectionTimeout=10000, metricsLogFreq=0, connectorCfg=null, odbcCfg=null, warmupClos=null, atomicCfg=AtomicConfiguration [seqReserveSize=1000, cacheMode=PARTITIONED, backups=1, aff=null, grpName=null], classLdr=null, sslCtxFactory=null, platformCfg=null, binaryCfg=null, memCfg=null, pstCfg=null, dsCfg=DataStorageConfiguration [sysRegionInitSize=41943040, sysRegionMaxSize=104857600, pageSize=4096, concLvl=0, dfltDataRegConf=DataRegionConfiguration [name=default, maxSize=104857600, initSize=268435456, swapPath=null, pageEvictionMode=DISABLED, pageReplacementMode=CLOCK, evictionThreshold=0.9, emptyPagesPoolSize=100, metricsEnabled=false, metricsSubIntervalCount=5, metricsRateTimeInterval=60000, persistenceEnabled=true, checkpointPageBufSize=0, lazyMemoryAllocation=true, warmUpCfg=null], dataRegions=null, storagePath=null, checkpointFreq=30000, lockWaitTime=10000, checkpointThreads=4, checkpointWriteOrder=SEQUENTIAL, walHistSize=20, maxWalArchiveSize=20971520, walSegments=10, walSegmentSize=1048576, walPath=db/wal, walArchivePath=db/wal/archive, cdcWalPath=db/wal/cdc, cdcEnabled=false, metricsEnabled=false, walMode=LOG_ONLY, walTlbSize=131072, walBuffSize=0, walFlushFreq=2000, walFsyncDelay=1000, walRecordIterBuffSize=67108864, alwaysWriteFullPages=false, fileIOFactory=org.apache.ignite.internal.processors.cache.persistence.file.AsyncFileIOFactory@3207b8f1, metricsSubIntervalCnt=5, metricsRateTimeInterval=60000, walAutoArchiveAfterInactivity=-1, walForceArchiveTimeout=-1, writeThrottlingEnabled=false, walCompactionEnabled=false, walCompactionLevel=1, checkpointReadLockTimeout=null, walPageCompression=DISABLED, walPageCompressionLevel=null, dfltWarmUpCfg=null, encCfg=org.apache.ignite.configuration.EncryptionConfiguration@7fd17679, defragmentationThreadPoolSize=4, minWalArchiveSize=-1], snapshotPath=snapshots, activeOnStart=true, activeOnStartPropSetFlag=false, autoActivation=true, autoActivationPropSetFlag=false, clusterStateOnStart=null, sqlConnCfg=null, cliConnCfg=ClientConnectorConfiguration [host=null, port=10800, portRange=100, sockSndBufSize=0, sockRcvBufSize=0, tcpNoDelay=true, maxOpenCursorsPerConn=128, threadPoolSize=24, selectorCnt=12, idleTimeout=0, handshakeTimeout=10000, jdbcEnabled=true, odbcEnabled=true, thinCliEnabled=true, sslEnabled=false, useIgniteSslCtxFactory=true, sslClientAuth=false, sslCtxFactory=null, thinCliCfg=ThinClientConfiguration [maxActiveTxPerConn=100, maxActiveComputeTasksPerConn=0]], mvccVacuumThreadCnt=2, mvccVacuumFreq=5000, authEnabled=false, failureHnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]], commFailureRslvr=null, sqlCfg=SqlConfiguration [longQryWarnTimeout=3000, dfltQryTimeout=0, sqlQryHistSize=1000, validationEnabled=false], asyncContinuationExecutor=null] [21:12:45] : [Step 4/5] [2021-11-19 21:12:45,579][INFO ][test-runner-#23916%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] Daemon mode: off [21:12:45] : [Step 4/5] [2021-11-19 21:12:45,579][INFO ][test-runner-#23916%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] OS: Linux 4.15.0-151-generic amd64 [21:12:45] : [Step 4/5] [2021-11-19 21:12:45,580][INFO ][test-runner-#23916%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] OS user: teamcity [21:12:45] : [Step 4/5] [2021-11-19 21:12:45,580][INFO ][test-runner-#23916%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] PID: 16724 [21:12:45] : [Step 4/5] [2021-11-19 21:12:45,581][INFO ][test-runner-#23916%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] Language runtime: Java Platform API Specification ver. 1.8 [21:12:45] : [Step 4/5] [2021-11-19 21:12:45,581][INFO ][test-runner-#23916%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] VM information: Java(TM) SE Runtime Environment 1.8.0_261-b12 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 25.261-b12 [21:12:45] : [Step 4/5] [2021-11-19 21:12:45,581][INFO ][test-runner-#23916%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] VM total memory: 1.9GB [21:12:45] : [Step 4/5] [2021-11-19 21:12:45,581][INFO ][test-runner-#23916%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] Remote Management [restart: off, REST: off, JMX (remote: off)] [21:12:45] : [Step 4/5] [2021-11-19 21:12:45,582][INFO ][test-runner-#23916%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] Logger: GridTestLog4jLogger [quiet=false, config=null] [21:12:45] : [Step 4/5] [2021-11-19 21:12:45,582][INFO ][test-runner-#23916%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] IGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c [21:12:45] : [Step 4/5] [2021-11-19 21:12:45,582][INFO ][test-runner-#23916%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] VM arguments: [-DIGNITE_DUMP_THREADS_ON_FAILURE=false, -DMono=/usr/bin/mono-sgen, -DMono4.0_x64=/usr/lib/mono/4.0, -DMono4.5_x64=/usr/lib/mono/4.5, -DMonoVersion=6.12.0.90, -DSKIP_BUILD=false, -Dagent.home.dir=/opt/buildagent, -Dagent.name=aitc-lin02_03, -Dagent.ownPort=9090, -Dagent.work.dir=/opt/buildagent/work, -Dbuild.number=95, -Dbuild.vcs.number=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.1=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.GitHubApacheIgnite=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dclassworlds.conf=/opt/buildagent/temp/buildTmp/teamcity.m2.conf, -Dcom.jetbrains.maven.watcher.report.file=/opt/buildagent/temp/buildTmp/maven-build-info.xml, -Djava.io.tmpdir=/opt/buildagent/temp/buildTmp, -Dmaven.home=/opt/buildagent/tools/maven3_6, -Dmaven.multiModuleProjectDirectory=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.agent.cpuBenchmark=457, -Dteamcity.agent.dotnet.agent_url=http://localhost:9090/RPC2, -Dteamcity.agent.dotnet.build_id=6278078, -Dteamcity.auth.password=*******, -Dteamcity.auth.userId=TeamCityBuildId=6278078, -Dteamcity.build.changedFiles.file=/opt/buildagent/temp/buildTmp/changedFiles6342607772318147725.txt, -Dteamcity.build.checkoutDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.build.id=6278078, -Dteamcity.build.properties.file=/opt/buildagent/temp/buildTmp/teamcity.build5164517880467851002.properties, -Dteamcity.build.tempDir=/opt/buildagent/temp/buildTmp, -Dteamcity.build.workingDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.buildConfName=Basic 3, -Dteamcity.buildType.id=IgniteTests24Java8_Basic3, -Dteamcity.configuration.properties.file=/opt/buildagent/temp/buildTmp/teamcity.config5591980786735343870.properties, -Dteamcity.maven.userSettings.path=/opt/buildagent/temp/buildTmp/maven_settings_585072866407032347.xml, -Dteamcity.maven.watcher.home=/opt/buildagent/plugins/mavenPlugin/maven-watcher-jdk16, -Dteamcity.projectName=Ignite Tests 2.x (JDK 8/11), -Dteamcity.runner.properties.file=/opt/buildagent/temp/buildTmp/teamcity.runner9098465561618137420.properties, -Dteamcity.tests.recentlyFailedTests.file=/opt/buildagent/temp/buildTmp/testsToRunFirst3891775683130404069.txt, -Dteamcity.version=2021.2 (build 99542), -ea, -Xms2g, -Xmx2g, -XX:+HeapDumpOnOutOfMemoryError, -DIGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_TEST_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_UPDATE_NOTIFIER=false, -DIGNITE_NO_DISCO_ORDER=true, -DIGNITE_PERFORMANCE_SUGGESTIONS_DISABLED=true, -Djava.net.preferIPv4Stack=true, -DTEST_SCALE_FACTOR=1.0, -DIGNITE_TEST_PROP_LOG4J_FILE=log4j-tc-test.xml, -DIGNITE_QUIET=false, -DIGNITE_MARSHAL_BUFFERS_RECHECK=1000, -Dmaven.repo.local=/opt/buildagent/.m2/repository] [21:12:45] : [Step 4/5] [2021-11-19 21:12:45,587][INFO ][test-runner-#23916%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] System cache's DataRegion size is configured to 40 MB. Use DataStorageConfiguration.systemRegionInitialSize property to change the setting. [21:12:45] : [Step 4/5] [2021-11-19 21:12:45,588][INFO ][test-runner-#23916%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] Configured caches [in 'sysMemPlc' dataRegion: ['ignite-sys-cache']] [21:12:45]W: [org.apache.ignite:ignite-core] [2021-11-19 21:12:45,588][WARN ][test-runner-#23916%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] Peer class loading is enabled (disable it in production for performance and deployment consistency reasons) [21:12:45] : [Step 4/5] [2021-11-19 21:12:45,588][INFO ][test-runner-#23916%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] 3-rd party licenses can be found at: /opt/buildagent/work/7bc1c54bc719b67c/libs/licenses [21:12:45] : [Step 4/5] [2021-11-19 21:12:45,593][INFO ][test-runner-#23916%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] Configured plugins: [21:12:45] : [Step 4/5] [2021-11-19 21:12:45,594][INFO ][test-runner-#23916%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- StanByClusterTestProvider 1.0 [21:12:45] : [Step 4/5] [2021-11-19 21:12:45,594][INFO ][test-runner-#23916%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:12:45] : [Step 4/5] [2021-11-19 21:12:45,594][INFO ][test-runner-#23916%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] [21:12:45] : [Step 4/5] [2021-11-19 21:12:45,594][INFO ][test-runner-#23916%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- PageMemory tracker plugin 1.0 [21:12:45] : [Step 4/5] [2021-11-19 21:12:45,595][INFO ][test-runner-#23916%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:12:45] : [Step 4/5] [2021-11-19 21:12:45,595][INFO ][test-runner-#23916%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] [21:12:45] : [Step 4/5] [2021-11-19 21:12:45,595][INFO ][test-runner-#23916%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- TestDistibutedConfigurationPlugin 1.0 [21:12:45] : [Step 4/5] [2021-11-19 21:12:45,595][INFO ][test-runner-#23916%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:12:45] : [Step 4/5] [2021-11-19 21:12:45,595][INFO ][test-runner-#23916%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] [21:12:45] : [Step 4/5] [2021-11-19 21:12:45,596][INFO ][test-runner-#23916%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- NodeValidationPluginProvider 1.0 [21:12:45] : [Step 4/5] [2021-11-19 21:12:45,596][INFO ][test-runner-#23916%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:12:45] : [Step 4/5] [2021-11-19 21:12:45,596][INFO ][test-runner-#23916%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] [21:12:45] : [Step 4/5] [2021-11-19 21:12:45,597][INFO ][test-runner-#23916%encryption.CacheGroupKeyChangeTest%][FailureProcessor] Configured failure handler: [hnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]]] [21:12:45] : [Step 4/5] [2021-11-19 21:12:45,609][INFO ][test-runner-#23916%encryption.CacheGroupKeyChangeTest%][TestRecordingCommunicationSpi] Successfully bound communication NIO server to TCP port [port=47100, locHost=/127.0.0.1, selectorsCnt=12, selectorSpins=0, pairedConn=false] [21:12:45]W: [org.apache.ignite:ignite-core] [2021-11-19 21:12:45,610][WARN ][test-runner-#23916%encryption.CacheGroupKeyChangeTest%][TestRecordingCommunicationSpi] Message queue limit is set to 0 which may lead to potential OOMEs when running cache operations in FULL_ASYNC or PRIMARY_SYNC modes due to message queues growth on sender and receiver sides. [21:12:45] : [Step 4/5] [2021-11-19 21:12:45,614][INFO ][test-runner-#23916%encryption.CacheGroupKeyChangeTest%][GridCollisionManager] Collision resolution is disabled (all jobs will be activated upon arrival). [21:12:45] : [Step 4/5] [2021-11-19 21:12:45,614][INFO ][test-runner-#23916%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] Security status [authentication=off, sandbox=off, tls/ssl=off] [21:12:45] : [Step 4/5] [2021-11-19 21:12:45,677][INFO ][test-runner-#23916%encryption.CacheGroupKeyChangeTest%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:12:45] : [Step 4/5] [2021-11-19 21:12:45,764][INFO ][test-runner-#23916%encryption.CacheGroupKeyChangeTest%][MaintenanceProcessor] Resolved store directory for node persistent data: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0 [21:12:45] : [Step 4/5] [2021-11-19 21:12:45,766][INFO ][test-runner-#23916%encryption.CacheGroupKeyChangeTest%][CacheObjectBinaryProcessorImpl] Resolved directory for serialized binary metadata: /opt/buildagent/work/7bc1c54bc719b67c/work/db/binary_meta/grid_0 [21:12:45] : [Step 4/5] [2021-11-19 21:12:45,770][INFO ][test-runner-#23916%encryption.CacheGroupKeyChangeTest%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0 [21:12:45] : [Step 4/5] [2021-11-19 21:12:45,770][INFO ][test-runner-#23916%encryption.CacheGroupKeyChangeTest%][FileWriteAheadLogManager] Resolved write ahead log work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0 [21:12:45] : [Step 4/5] [2021-11-19 21:12:45,771][INFO ][test-runner-#23916%encryption.CacheGroupKeyChangeTest%][FileWriteAheadLogManager] Resolved write ahead log archive directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0 [21:12:45] : [Step 4/5] [2021-11-19 21:12:45,779][INFO ][test-runner-#23916%encryption.CacheGroupKeyChangeTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000000.wal [21:12:45] : [Step 4/5] [2021-11-19 21:12:45,779][INFO ][test-runner-#23916%encryption.CacheGroupKeyChangeTest%][FileHandleManagerImpl] Initialized write-ahead log manager [mode=LOG_ONLY] [21:12:45]W: [org.apache.ignite:ignite-core] [2021-11-19 21:12:45,780][WARN ][test-runner-#23916%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] DataRegion maxSize=104.9 MB is smaller than defaultInitialSize=268.4 MB, setting initialSize to 104.9 MB [21:12:45] : [Step 4/5] [2021-11-19 21:12:45,784][INFO ][test-runner-#23916%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Configured data regions initialized successfully [total=5] [21:12:45] : [Step 4/5] [2021-11-19 21:12:45,787][INFO ][test-runner-#23916%encryption.CacheGroupKeyChangeTest%][IgniteSnapshotManager] Resolved snapshot work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/snapshots [21:12:45] : [Step 4/5] [2021-11-19 21:12:45,787][INFO ][test-runner-#23916%encryption.CacheGroupKeyChangeTest%][IgniteSnapshotManager] Resolved temp directory for snapshot creation: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0/snp [21:12:45] : [Step 4/5] [2021-11-19 21:12:45,789][INFO ][test-runner-#23916%encryption.CacheGroupKeyChangeTest%][ClientListenerProcessor] Client connector processor has started on TCP port 10800 [21:12:45] : [Step 4/5] [2021-11-19 21:12:45,795][INFO ][test-runner-#23916%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] Non-loopback local IPs: 172.17.0.4 [21:12:45] : [Step 4/5] [2021-11-19 21:12:45,795][INFO ][test-runner-#23916%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] Enabled local MACs: 0242AC110004 [21:12:45] : [Step 4/5] [2021-11-19 21:12:45,797][INFO ][test-runner-#23916%encryption.CacheGroupKeyChangeTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:12:45] : [Step 4/5] [2021-11-19 21:12:45,799][INFO ][test-runner-#23916%encryption.CacheGroupKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:12:45] : [Step 4/5] [2021-11-19 21:12:45,799][INFO ][test-runner-#23916%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:12:45] : [Step 4/5] [2021-11-19 21:12:45,801][INFO ][test-runner-#23916%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Applying lost metastore updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:12:45] : [Step 4/5] [2021-11-19 21:12:45,802][INFO ][test-runner-#23916%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=0 ms] [21:12:45] : [Step 4/5] [2021-11-19 21:12:45,802][INFO ][test-runner-#23916%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Restoring partition state for local groups. [21:12:45] : [Step 4/5] [2021-11-19 21:12:45,802][INFO ][test-runner-#23916%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=0, partitionsProcessed=0, time=0ms] [21:12:45] : [Step 4/5] [2021-11-19 21:12:45,803][INFO ][test-runner-#23916%encryption.CacheGroupKeyChangeTest%][GridEncryptionManager] Encryption keys loaded from metastore. [grps=, masterKeyName=ignite.master.key] [21:12:45] : [Step 4/5] [2021-11-19 21:12:45,807][INFO ][test-runner-#23916%encryption.CacheGroupKeyChangeTest%][ClusterProcessor] Cluster ID and tag has been read from metastorage: null [21:12:45] : [Step 4/5] [2021-11-19 21:12:45,808][INFO ][test-runner-#23916%encryption.CacheGroupKeyChangeTest%][IgniteClusterImpl] Shutdown policy was updated [oldVal=null, newVal=null] [21:12:45] : [Step 4/5] [2021-11-19 21:12:45,808][INFO ][test-runner-#23916%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Checkpoint frequency deviation changed [oldVal=null, newVal=null] [21:12:45] : [Step 4/5] [2021-11-19 21:12:45,817][INFO ][test-runner-#23916%encryption.CacheGroupKeyChangeTest%][FilePageStoreManager] Cleanup cache stores [total=1, left=0, cleanFiles=false] [21:12:45] : [Step 4/5] [2021-11-19 21:12:45,820][INFO ][test-runner-#23916%encryption.CacheGroupKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:12:45] : [Step 4/5] [2021-11-19 21:12:45,821][INFO ][test-runner-#23916%encryption.CacheGroupKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:12:45] : [Step 4/5] [2021-11-19 21:12:45,822][INFO ][test-runner-#23916%encryption.CacheGroupKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:12:45] : [Step 4/5] [2021-11-19 21:12:45,822][INFO ][test-runner-#23916%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Data Regions Started: 5 [21:12:45] : [Step 4/5] [2021-11-19 21:12:45,823][INFO ][test-runner-#23916%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] ^-- sysMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:12:45] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:12:45] : [Step 4/5] ^-- default region [type=default, persistence=true, lazyAlloc=true, [21:12:45] : [Step 4/5] ... initCfg=100MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB, allocTotal=0MB] [21:12:45] : [Step 4/5] ^-- metastoreMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:12:45] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:12:45] : [Step 4/5] ^-- TxLog region [type=internal, persistence=true, lazyAlloc=false, [21:12:45] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:12:45] : [Step 4/5] ^-- volatileDsMemPlc region [type=user, persistence=false, lazyAlloc=true, [21:12:45] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB] [21:12:45] : [Step 4/5] ^-- Ignite persistence [used=0MB] [21:12:45] : [Step 4/5] [21:12:45] : [Step 4/5] [2021-11-19 21:12:45,824][INFO ][test-runner-#23916%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Starting binary memory restore for: [-2100569601] [21:12:45] : [Step 4/5] [2021-11-19 21:12:45,832][INFO ][test-runner-#23916%encryption.CacheGroupKeyChangeTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:12:45] : [Step 4/5] [2021-11-19 21:12:45,832][INFO ][test-runner-#23916%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:12:45] : [Step 4/5] [2021-11-19 21:12:45,834][INFO ][test-runner-#23916%encryption.CacheGroupKeyChangeTest%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000000.wal, offset=0, ver=2] [21:12:45] : [Step 4/5] [2021-11-19 21:12:45,837][INFO ][test-runner-#23916%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Started cache in recovery mode [name=ignite-sys-cache, id=-2100569601, dataRegionName=sysMemPlc, mode=REPLICATED, atomicity=TRANSACTIONAL, backups=2147483647, mvcc=false] [21:12:45] : [Step 4/5] [2021-11-19 21:12:45,838][INFO ][test-runner-#23916%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Binary recovery performed in 14 ms. [21:12:45] : [Step 4/5] [2021-11-19 21:12:45,838][INFO ][test-runner-#23916%encryption.CacheGroupKeyChangeTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:12:45] : [Step 4/5] [2021-11-19 21:12:45,839][INFO ][test-runner-#23916%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Applying lost cache updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:12:45] : [Step 4/5] [2021-11-19 21:12:45,840][INFO ][test-runner-#23916%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=0 ms] [21:12:45] : [Step 4/5] [2021-11-19 21:12:45,841][INFO ][test-runner-#23916%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Restoring partition state for local groups. [21:12:45] : [Step 4/5] [2021-11-19 21:12:45,845][INFO ][test-runner-#23916%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=1, partitionsProcessed=100, time=0ms] [21:12:45] : [Step 4/5] [2021-11-19 21:12:45,857][INFO ][test-runner-#23916%encryption.CacheGroupKeyChangeTest%][TestTcpDiscoverySpi] Successfully bound to TCP port [port=47500, localHost=localhost/127.0.0.1, locNodeId=0021223b-d470-4a41-b54f-6489314a0000] [21:12:45] : [Step 4/5] [2021-11-19 21:12:45,866][INFO ][disco-notifier-worker-#24028%grid-0%][MvccProcessorImpl] Assigned mvcc coordinator [crd=MvccCoordinator [topVer=AffinityTopologyVersion [topVer=1, minorTopVer=0], nodeId=0021223b-d470-4a41-b54f-6489314a0000, ver=1637345565859, local=true, initialized=false]] [21:12:45] : [Step 4/5] [2021-11-19 21:12:45,868][INFO ][sys-#24010%grid-0%][ClusterProcessor] Writing cluster ID and tag to metastorage on ready for write ClusterIdAndTag [id=27882488-9c93-4c7b-bc3d-a1879d3bf806, tag=charming_wu] [21:12:45] : [Step 4/5] [2021-11-19 21:12:45,871][INFO ][disco-notifier-worker-#24028%grid-0%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustEnabled' was changed from 'null' to 'false' [21:12:45] : [Step 4/5] [2021-11-19 21:12:45,872][INFO ][disco-notifier-worker-#24028%grid-0%][ClusterProcessor] charming_wu [21:12:45] : [Step 4/5] [2021-11-19 21:12:45,872][INFO ][disco-notifier-worker-#24028%grid-0%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustTimeout' was changed from 'null' to '300000' [21:12:45] : [Step 4/5] [2021-11-19 21:12:45,873][INFO ][disco-notifier-worker-#24028%grid-0%][IgniteTxManager] Transactions parameter 'longOperationsDumpTimeout' was changed from 'null' to '60000' [21:12:45] : [Step 4/5] [2021-11-19 21:12:45,873][INFO ][disco-notifier-worker-#24028%grid-0%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpThreshold' was changed from 'null' to '0' [21:12:45] : [Step 4/5] [2021-11-19 21:12:45,873][INFO ][disco-notifier-worker-#24028%grid-0%][IgniteTxManager] Transactions parameter 'transactionTimeDumpSamplesCoefficient' was changed from 'null' to '0.0' [21:12:45] : [Step 4/5] [2021-11-19 21:12:45,874][INFO ][disco-notifier-worker-#24028%grid-0%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpSamplesPerSecondLimit' was changed from 'null' to '5' [21:12:45] : [Step 4/5] [2021-11-19 21:12:45,874][INFO ][disco-notifier-worker-#24028%grid-0%][IgniteTxManager] Transactions parameter 'collisionsDumpInterval' was changed from 'null' to '1000' [21:12:45] : [Step 4/5] [2021-11-19 21:12:45,875][INFO ][disco-notifier-worker-#24028%grid-0%][IgniteTxManager] Transactions parameter 'txOwnerDumpRequestsAllowed' was changed from 'null' to 'true' [21:12:45] : [Step 4/5] [2021-11-19 21:12:45,875][INFO ][disco-notifier-worker-#24028%grid-0%][GridCacheDatabaseSharedManager] Historical rebalance WAL threshold changed [property=historical.rebalance.threshold, oldVal=null, newVal=500] [21:12:45] : [Step 4/5] [2021-11-19 21:12:45,880][INFO ][test-runner-#23916%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] To start Console Management & Monitoring run ignitevisorcmd.{sh|bat} [21:12:45] : [Step 4/5] [2021-11-19 21:12:45,880][INFO ][test-runner-#23916%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] [21:12:45] : [Step 4/5] [21:12:45] : [Step 4/5] >>> +-------------------------------------------+ [21:12:45] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:12:45] : [Step 4/5] >>> +-------------------------------------------+ [21:12:45] : [Step 4/5] >>> OS name: Linux 4.15.0-151-generic amd64 [21:12:45] : [Step 4/5] >>> CPU(s): 24 [21:12:45] : [Step 4/5] >>> Heap: 2.0GB [21:12:45] : [Step 4/5] >>> VM name: 16724@c4dfe9a430b2 [21:12:45] : [Step 4/5] >>> Ignite instance name: grid-0 [21:12:45] : [Step 4/5] >>> Local node [ID=0021223B-D470-4A41-B54F-6489314A0000, order=1, clientMode=false] [21:12:45] : [Step 4/5] >>> Local node addresses: [127.0.0.1] [21:12:45] : [Step 4/5] >>> Local ports: TCP:10800 TCP:47100 TCP:47500 [21:12:45] : [Step 4/5] [21:12:45] : [Step 4/5] [2021-11-19 21:12:45,881][INFO ][test-runner-#23916%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] >>> Ignite cluster is in INACTIVE state (limited functionality available). Use control.(sh|bat) script or IgniteCluster.state(ClusterState.ACTIVE) to change the state. [21:12:45] : [Step 4/5] [2021-11-19 21:12:45,882][INFO ][test-runner-#23916%encryption.CacheGroupKeyChangeTest%][GridDiscoveryManager] Topology snapshot [ver=1, locNode=0021223b, servers=1, clients=0, state=INACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=0021223b-d470-4a41-b54f-6489314a0000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:12:45] : [Step 4/5] [2021-11-19 21:12:45,883][INFO ][test-runner-#23916%encryption.CacheGroupKeyChangeTest%][G] Node started : [stage="Configure system pool" (0 ms),stage="Start managers" (197 ms),stage="Configure binary metadata" (2 ms),stage="Start processors" (27 ms),stage="Start 'StanByClusterTestProvider' plugin" (0 ms),stage="Start 'PageMemory tracker plugin' plugin" (0 ms),stage="Start 'TestDistibutedConfigurationPlugin' plugin" (0 ms),stage="Start 'NodeValidationPluginProvider' plugin" (0 ms),stage="Init metastore" (23 ms),stage="Init and start regions" (6 ms),stage="Restore binary memory" (14 ms),stage="Restore logical state" (6 ms),stage="Finish recovery" (11 ms),stage="Join topology" (10 ms),stage="Await transition" (2 ms),stage="Await exchange" (14 ms),stage="Total time" (312 ms)] [21:12:45] : [Step 4/5] [2021-11-19 21:12:45,884][INFO ][test-runner-#23916%encryption.CacheGroupKeyChangeTest%][root] Node started with the following configuration [id=0021223b-d470-4a41-b54f-6489314a0000, marshaller=BinaryMarshaller [], discovery=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=5000, ackTimeout=5000, marsh=JdkMarshaller [clsFilter=org.apache.ignite.marshaller.MarshallerUtils$1@45cd9a30], reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], binaryCfg=null, lateAff=true] [21:12:45]W: [org.apache.ignite:ignite-core] [2021-11-19 21:12:45,890][WARN ][test-runner-#23916%encryption.CacheGroupKeyChangeTest%][G] Ignite work directory is not provided, automatically resolved to: /opt/buildagent/work/7bc1c54bc719b67c/work [21:12:45] : [Step 4/5] [2021-11-19 21:12:45,891][INFO ][test-runner-#23916%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] [21:12:45] : [Step 4/5] [21:12:45] : [Step 4/5] >>> __________ ________________ [21:12:45] : [Step 4/5] >>> / _/ ___/ |/ / _/_ __/ __/ [21:12:45] : [Step 4/5] >>> _/ // (7 7 // / / / / _/ [21:12:45] : [Step 4/5] >>> /___/\___/_/|_/___/ /_/ /___/ [21:12:45] : [Step 4/5] >>> [21:12:45] : [Step 4/5] >>> ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:12:45] : [Step 4/5] >>> 2021 Copyright(C) Apache Software Foundation [21:12:45] : [Step 4/5] >>> [21:12:45] : [Step 4/5] >>> Ignite documentation: http://ignite.apache.org [21:12:45] : [Step 4/5] [21:12:45] : [Step 4/5] [2021-11-19 21:12:45,892][INFO ][test-runner-#23916%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] Config URL: n/a [21:12:45] : [Step 4/5] [2021-11-19 21:12:45,892][INFO ][test-runner-#23916%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] IgniteConfiguration [igniteInstanceName=grid-1, pubPoolSize=24, svcPoolSize=24, callbackPoolSize=24, stripedPoolSize=24, sysPoolSize=24, mgmtPoolSize=4, dataStreamerPoolSize=24, utilityCachePoolSize=24, utilityCacheKeepAliveTime=60000, p2pPoolSize=2, qryPoolSize=24, buildIdxPoolSize=4, igniteHome=/opt/buildagent/work/7bc1c54bc719b67c, igniteWorkDir=/opt/buildagent/work/7bc1c54bc719b67c/work, mbeanSrv=com.sun.jmx.mbeanserver.JmxMBeanServer@6fe85038, nodeId=10b2a0df-6371-4882-836b-64b1d160d001, marsh=BinaryMarshaller [], marshLocJobs=false, daemon=false, p2pEnabled=true, netTimeout=10000, netCompressionLevel=1, sndRetryDelay=1000, sndRetryCnt=3, metricsHistSize=10000, metricsUpdateFreq=1000, metricsExpTime=9223372036854775807, discoSpi=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=0, ackTimeout=0, marsh=null, reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], segPlc=STOP, segResolveAttempts=2, waitForSegOnStart=true, allResolversPassReq=true, segChkFreq=10000, commSpi=TcpCommunicationSpi [connectGate=org.apache.ignite.spi.communication.tcp.internal.ConnectGateway@2e645562, ctxInitLatch=java.util.concurrent.CountDownLatch@2f87a87d[Count = 1], stopping=false, clientPool=null, nioSrvWrapper=null, stateProvider=null], evtSpi=MemoryEventStorageSpi [expireAgeMs=9223372036854775807, expireCnt=10000, filter=null], colSpi=NoopCollisionSpi [], deploySpi=LocalDeploymentSpi [], indexingSpi=org.apache.ignite.spi.indexing.noop.NoopIndexingSpi@58b4f144, addrRslvr=null, encryptionSpi=org.apache.ignite.spi.encryption.keystore.KeystoreEncryptionSpi@2d6d856a, tracingSpi=org.apache.ignite.spi.tracing.NoopTracingSpi@647319cf, clientMode=false, rebalanceThreadPoolSize=4, rebalanceTimeout=10000, rebalanceBatchesPrefetchCnt=3, rebalanceThrottle=0, rebalanceBatchSize=524288, txCfg=TransactionConfiguration [txSerEnabled=false, dfltIsolation=REPEATABLE_READ, dfltConcurrency=PESSIMISTIC, dfltTxTimeout=0, txTimeoutOnPartitionMapExchange=0, deadlockTimeout=10000, pessimisticTxLogSize=0, pessimisticTxLogLinger=10000, tmLookupClsName=null, txManagerFactory=null, useJtaSync=false], cacheSanityCheckEnabled=true, discoStartupDelay=60000, deployMode=SHARED, p2pMissedCacheSize=100, locHost=127.0.0.1, timeSrvPortBase=31100, timeSrvPortRange=100, failureDetectionTimeout=10000, sysWorkerBlockedTimeout=null, clientFailureDetectionTimeout=10000, metricsLogFreq=0, connectorCfg=null, odbcCfg=null, warmupClos=null, atomicCfg=AtomicConfiguration [seqReserveSize=1000, cacheMode=PARTITIONED, backups=1, aff=null, grpName=null], classLdr=null, sslCtxFactory=null, platformCfg=null, binaryCfg=null, memCfg=null, pstCfg=null, dsCfg=DataStorageConfiguration [sysRegionInitSize=41943040, sysRegionMaxSize=104857600, pageSize=4096, concLvl=0, dfltDataRegConf=DataRegionConfiguration [name=default, maxSize=104857600, initSize=268435456, swapPath=null, pageEvictionMode=DISABLED, pageReplacementMode=CLOCK, evictionThreshold=0.9, emptyPagesPoolSize=100, metricsEnabled=false, metricsSubIntervalCount=5, metricsRateTimeInterval=60000, persistenceEnabled=true, checkpointPageBufSize=0, lazyMemoryAllocation=true, warmUpCfg=null], dataRegions=null, storagePath=null, checkpointFreq=30000, lockWaitTime=10000, checkpointThreads=4, checkpointWriteOrder=SEQUENTIAL, walHistSize=20, maxWalArchiveSize=20971520, walSegments=10, walSegmentSize=1048576, walPath=db/wal, walArchivePath=db/wal/archive, cdcWalPath=db/wal/cdc, cdcEnabled=false, metricsEnabled=false, walMode=LOG_ONLY, walTlbSize=131072, walBuffSize=0, walFlushFreq=2000, walFsyncDelay=1000, walRecordIterBuffSize=67108864, alwaysWriteFullPages=false, fileIOFactory=org.apache.ignite.internal.processors.cache.persistence.file.AsyncFileIOFactory@75c04fa8, metricsSubIntervalCnt=5, metricsRateTimeInterval=60000, walAutoArchiveAfterInactivity=-1, walForceArchiveTimeout=-1, writeThrottlingEnabled=false, walCompactionEnabled=false, walCompactionLevel=1, checkpointReadLockTimeout=null, walPageCompression=DISABLED, walPageCompressionLevel=null, dfltWarmUpCfg=null, encCfg=org.apache.ignite.configuration.EncryptionConfiguration@7d8b67c4, defragmentationThreadPoolSize=4, minWalArchiveSize=-1], snapshotPath=snapshots, activeOnStart=true, activeOnStartPropSetFlag=false, autoActivation=true, autoActivationPropSetFlag=false, clusterStateOnStart=null, sqlConnCfg=null, cliConnCfg=ClientConnectorConfiguration [host=null, port=10800, portRange=100, sockSndBufSize=0, sockRcvBufSize=0, tcpNoDelay=true, maxOpenCursorsPerConn=128, threadPoolSize=24, selectorCnt=12, idleTimeout=0, handshakeTimeout=10000, jdbcEnabled=true, odbcEnabled=true, thinCliEnabled=true, sslEnabled=false, useIgniteSslCtxFactory=true, sslClientAuth=false, sslCtxFactory=null, thinCliCfg=ThinClientConfiguration [maxActiveTxPerConn=100, maxActiveComputeTasksPerConn=0]], mvccVacuumThreadCnt=2, mvccVacuumFreq=5000, authEnabled=false, failureHnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]], commFailureRslvr=null, sqlCfg=SqlConfiguration [longQryWarnTimeout=3000, dfltQryTimeout=0, sqlQryHistSize=1000, validationEnabled=false], asyncContinuationExecutor=null] [21:12:45] : [Step 4/5] [2021-11-19 21:12:45,900][INFO ][test-runner-#23916%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] Daemon mode: off [21:12:45] : [Step 4/5] [2021-11-19 21:12:45,900][INFO ][test-runner-#23916%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] OS: Linux 4.15.0-151-generic amd64 [21:12:45] : [Step 4/5] [2021-11-19 21:12:45,901][INFO ][test-runner-#23916%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] OS user: teamcity [21:12:45] : [Step 4/5] [2021-11-19 21:12:45,901][INFO ][test-runner-#23916%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] PID: 16724 [21:12:45] : [Step 4/5] [2021-11-19 21:12:45,901][INFO ][test-runner-#23916%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] Language runtime: Java Platform API Specification ver. 1.8 [21:12:45] : [Step 4/5] [2021-11-19 21:12:45,901][INFO ][test-runner-#23916%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] VM information: Java(TM) SE Runtime Environment 1.8.0_261-b12 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 25.261-b12 [21:12:45] : [Step 4/5] [2021-11-19 21:12:45,902][INFO ][test-runner-#23916%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] VM total memory: 1.9GB [21:12:45] : [Step 4/5] [2021-11-19 21:12:45,902][INFO ][test-runner-#23916%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] Remote Management [restart: off, REST: off, JMX (remote: off)] [21:12:45] : [Step 4/5] [2021-11-19 21:12:45,902][INFO ][test-runner-#23916%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] Logger: GridTestLog4jLogger [quiet=false, config=null] [21:12:45] : [Step 4/5] [2021-11-19 21:12:45,902][INFO ][test-runner-#23916%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] IGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c [21:12:45] : [Step 4/5] [2021-11-19 21:12:45,903][INFO ][test-runner-#23916%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] VM arguments: [-DIGNITE_DUMP_THREADS_ON_FAILURE=false, -DMono=/usr/bin/mono-sgen, -DMono4.0_x64=/usr/lib/mono/4.0, -DMono4.5_x64=/usr/lib/mono/4.5, -DMonoVersion=6.12.0.90, -DSKIP_BUILD=false, -Dagent.home.dir=/opt/buildagent, -Dagent.name=aitc-lin02_03, -Dagent.ownPort=9090, -Dagent.work.dir=/opt/buildagent/work, -Dbuild.number=95, -Dbuild.vcs.number=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.1=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.GitHubApacheIgnite=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dclassworlds.conf=/opt/buildagent/temp/buildTmp/teamcity.m2.conf, -Dcom.jetbrains.maven.watcher.report.file=/opt/buildagent/temp/buildTmp/maven-build-info.xml, -Djava.io.tmpdir=/opt/buildagent/temp/buildTmp, -Dmaven.home=/opt/buildagent/tools/maven3_6, -Dmaven.multiModuleProjectDirectory=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.agent.cpuBenchmark=457, -Dteamcity.agent.dotnet.agent_url=http://localhost:9090/RPC2, -Dteamcity.agent.dotnet.build_id=6278078, -Dteamcity.auth.password=*******, -Dteamcity.auth.userId=TeamCityBuildId=6278078, -Dteamcity.build.changedFiles.file=/opt/buildagent/temp/buildTmp/changedFiles6342607772318147725.txt, -Dteamcity.build.checkoutDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.build.id=6278078, -Dteamcity.build.properties.file=/opt/buildagent/temp/buildTmp/teamcity.build5164517880467851002.properties, -Dteamcity.build.tempDir=/opt/buildagent/temp/buildTmp, -Dteamcity.build.workingDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.buildConfName=Basic 3, -Dteamcity.buildType.id=IgniteTests24Java8_Basic3, -Dteamcity.configuration.properties.file=/opt/buildagent/temp/buildTmp/teamcity.config5591980786735343870.properties, -Dteamcity.maven.userSettings.path=/opt/buildagent/temp/buildTmp/maven_settings_585072866407032347.xml, -Dteamcity.maven.watcher.home=/opt/buildagent/plugins/mavenPlugin/maven-watcher-jdk16, -Dteamcity.projectName=Ignite Tests 2.x (JDK 8/11), -Dteamcity.runner.properties.file=/opt/buildagent/temp/buildTmp/teamcity.runner9098465561618137420.properties, -Dteamcity.tests.recentlyFailedTests.file=/opt/buildagent/temp/buildTmp/testsToRunFirst3891775683130404069.txt, -Dteamcity.version=2021.2 (build 99542), -ea, -Xms2g, -Xmx2g, -XX:+HeapDumpOnOutOfMemoryError, -DIGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_TEST_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_UPDATE_NOTIFIER=false, -DIGNITE_NO_DISCO_ORDER=true, -DIGNITE_PERFORMANCE_SUGGESTIONS_DISABLED=true, -Djava.net.preferIPv4Stack=true, -DTEST_SCALE_FACTOR=1.0, -DIGNITE_TEST_PROP_LOG4J_FILE=log4j-tc-test.xml, -DIGNITE_QUIET=false, -DIGNITE_MARSHAL_BUFFERS_RECHECK=1000, -Dmaven.repo.local=/opt/buildagent/.m2/repository] [21:12:45] : [Step 4/5] [2021-11-19 21:12:45,907][INFO ][test-runner-#23916%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] System cache's DataRegion size is configured to 40 MB. Use DataStorageConfiguration.systemRegionInitialSize property to change the setting. [21:12:45] : [Step 4/5] [2021-11-19 21:12:45,907][INFO ][test-runner-#23916%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] Configured caches [in 'sysMemPlc' dataRegion: ['ignite-sys-cache']] [21:12:45]W: [org.apache.ignite:ignite-core] [2021-11-19 21:12:45,907][WARN ][test-runner-#23916%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] Peer class loading is enabled (disable it in production for performance and deployment consistency reasons) [21:12:45] : [Step 4/5] [2021-11-19 21:12:45,908][INFO ][test-runner-#23916%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] 3-rd party licenses can be found at: /opt/buildagent/work/7bc1c54bc719b67c/libs/licenses [21:12:45] : [Step 4/5] [2021-11-19 21:12:45,912][INFO ][test-runner-#23916%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] Configured plugins: [21:12:45] : [Step 4/5] [2021-11-19 21:12:45,912][INFO ][test-runner-#23916%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- StanByClusterTestProvider 1.0 [21:12:45] : [Step 4/5] [2021-11-19 21:12:45,912][INFO ][test-runner-#23916%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:12:45] : [Step 4/5] [2021-11-19 21:12:45,912][INFO ][test-runner-#23916%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] [21:12:45] : [Step 4/5] [2021-11-19 21:12:45,913][INFO ][test-runner-#23916%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- PageMemory tracker plugin 1.0 [21:12:45] : [Step 4/5] [2021-11-19 21:12:45,913][INFO ][test-runner-#23916%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:12:45] : [Step 4/5] [2021-11-19 21:12:45,913][INFO ][test-runner-#23916%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] [21:12:45] : [Step 4/5] [2021-11-19 21:12:45,913][INFO ][test-runner-#23916%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- TestDistibutedConfigurationPlugin 1.0 [21:12:45] : [Step 4/5] [2021-11-19 21:12:45,914][INFO ][test-runner-#23916%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:12:45] : [Step 4/5] [2021-11-19 21:12:45,914][INFO ][test-runner-#23916%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] [21:12:45] : [Step 4/5] [2021-11-19 21:12:45,914][INFO ][test-runner-#23916%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- NodeValidationPluginProvider 1.0 [21:12:45] : [Step 4/5] [2021-11-19 21:12:45,914][INFO ][test-runner-#23916%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:12:45] : [Step 4/5] [2021-11-19 21:12:45,914][INFO ][test-runner-#23916%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] [21:12:45] : [Step 4/5] [2021-11-19 21:12:45,915][INFO ][test-runner-#23916%encryption.CacheGroupKeyChangeTest%][FailureProcessor] Configured failure handler: [hnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]]] [21:12:45] : [Step 4/5] [2021-11-19 21:12:45,924][INFO ][test-runner-#23916%encryption.CacheGroupKeyChangeTest%][TestRecordingCommunicationSpi] Successfully bound communication NIO server to TCP port [port=47101, locHost=/127.0.0.1, selectorsCnt=12, selectorSpins=0, pairedConn=false] [21:12:45]W: [org.apache.ignite:ignite-core] [2021-11-19 21:12:45,924][WARN ][test-runner-#23916%encryption.CacheGroupKeyChangeTest%][TestRecordingCommunicationSpi] Message queue limit is set to 0 which may lead to potential OOMEs when running cache operations in FULL_ASYNC or PRIMARY_SYNC modes due to message queues growth on sender and receiver sides. [21:12:45] : [Step 4/5] [2021-11-19 21:12:45,929][INFO ][test-runner-#23916%encryption.CacheGroupKeyChangeTest%][GridCollisionManager] Collision resolution is disabled (all jobs will be activated upon arrival). [21:12:45] : [Step 4/5] [2021-11-19 21:12:45,929][INFO ][test-runner-#23916%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] Security status [authentication=off, sandbox=off, tls/ssl=off] [21:12:45] : [Step 4/5] [2021-11-19 21:12:45,988][INFO ][test-runner-#23916%encryption.CacheGroupKeyChangeTest%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:12:46] : [Step 4/5] [2021-11-19 21:12:46,079][INFO ][test-runner-#23916%encryption.CacheGroupKeyChangeTest%][MaintenanceProcessor] Resolved store directory for node persistent data: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1 [21:12:46] : [Step 4/5] [2021-11-19 21:12:46,080][INFO ][test-runner-#23916%encryption.CacheGroupKeyChangeTest%][CacheObjectBinaryProcessorImpl] Resolved directory for serialized binary metadata: /opt/buildagent/work/7bc1c54bc719b67c/work/db/binary_meta/grid_1 [21:12:46] : [Step 4/5] [2021-11-19 21:12:46,085][INFO ][test-runner-#23916%encryption.CacheGroupKeyChangeTest%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1 [21:12:46] : [Step 4/5] [2021-11-19 21:12:46,086][INFO ][test-runner-#23916%encryption.CacheGroupKeyChangeTest%][FileWriteAheadLogManager] Resolved write ahead log work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1 [21:12:46] : [Step 4/5] [2021-11-19 21:12:46,087][INFO ][test-runner-#23916%encryption.CacheGroupKeyChangeTest%][FileWriteAheadLogManager] Resolved write ahead log archive directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1 [21:12:46] : [Step 4/5] [2021-11-19 21:12:46,095][INFO ][test-runner-#23916%encryption.CacheGroupKeyChangeTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000000.wal [21:12:46] : [Step 4/5] [2021-11-19 21:12:46,095][INFO ][test-runner-#23916%encryption.CacheGroupKeyChangeTest%][FileHandleManagerImpl] Initialized write-ahead log manager [mode=LOG_ONLY] [21:12:46] : [Step 4/5] [2021-11-19 21:12:46,100][INFO ][test-runner-#23916%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Configured data regions initialized successfully [total=5] [21:12:46] : [Step 4/5] [2021-11-19 21:12:46,103][INFO ][test-runner-#23916%encryption.CacheGroupKeyChangeTest%][IgniteSnapshotManager] Resolved snapshot work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/snapshots [21:12:46] : [Step 4/5] [2021-11-19 21:12:46,103][INFO ][test-runner-#23916%encryption.CacheGroupKeyChangeTest%][IgniteSnapshotManager] Resolved temp directory for snapshot creation: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1/snp [21:12:46] : [Step 4/5] [2021-11-19 21:12:46,106][INFO ][test-runner-#23916%encryption.CacheGroupKeyChangeTest%][ClientListenerProcessor] Client connector processor has started on TCP port 10801 [21:12:46] : [Step 4/5] [2021-11-19 21:12:46,108][INFO ][test-runner-#23916%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] Non-loopback local IPs: 172.17.0.4 [21:12:46] : [Step 4/5] [2021-11-19 21:12:46,108][INFO ][test-runner-#23916%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] Enabled local MACs: 0242AC110004 [21:12:46] : [Step 4/5] [2021-11-19 21:12:46,109][INFO ][test-runner-#23916%encryption.CacheGroupKeyChangeTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:12:46] : [Step 4/5] [2021-11-19 21:12:46,110][INFO ][test-runner-#23916%encryption.CacheGroupKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:12:46] : [Step 4/5] [2021-11-19 21:12:46,110][INFO ][test-runner-#23916%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:12:46] : [Step 4/5] [2021-11-19 21:12:46,112][INFO ][test-runner-#23916%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Applying lost metastore updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:12:46] : [Step 4/5] [2021-11-19 21:12:46,113][INFO ][test-runner-#23916%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=0 ms] [21:12:46] : [Step 4/5] [2021-11-19 21:12:46,113][INFO ][test-runner-#23916%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Restoring partition state for local groups. [21:12:46] : [Step 4/5] [2021-11-19 21:12:46,114][INFO ][test-runner-#23916%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=0, partitionsProcessed=0, time=0ms] [21:12:46] : [Step 4/5] [2021-11-19 21:12:46,114][INFO ][test-runner-#23916%encryption.CacheGroupKeyChangeTest%][GridEncryptionManager] Encryption keys loaded from metastore. [grps=, masterKeyName=ignite.master.key] [21:12:46] : [Step 4/5] [2021-11-19 21:12:46,115][INFO ][test-runner-#23916%encryption.CacheGroupKeyChangeTest%][ClusterProcessor] Cluster ID and tag has been read from metastorage: null [21:12:46] : [Step 4/5] [2021-11-19 21:12:46,116][INFO ][test-runner-#23916%encryption.CacheGroupKeyChangeTest%][IgniteClusterImpl] Shutdown policy was updated [oldVal=null, newVal=null] [21:12:46] : [Step 4/5] [2021-11-19 21:12:46,116][INFO ][test-runner-#23916%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Checkpoint frequency deviation changed [oldVal=null, newVal=null] [21:12:46] : [Step 4/5] [2021-11-19 21:12:46,126][INFO ][test-runner-#23916%encryption.CacheGroupKeyChangeTest%][FilePageStoreManager] Cleanup cache stores [total=1, left=0, cleanFiles=false] [21:12:46] : [Step 4/5] [2021-11-19 21:12:46,129][INFO ][test-runner-#23916%encryption.CacheGroupKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:12:46] : [Step 4/5] [2021-11-19 21:12:46,130][INFO ][test-runner-#23916%encryption.CacheGroupKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:12:46] : [Step 4/5] [2021-11-19 21:12:46,132][INFO ][test-runner-#23916%encryption.CacheGroupKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:12:46] : [Step 4/5] [2021-11-19 21:12:46,133][INFO ][test-runner-#23916%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Data Regions Started: 5 [21:12:46] : [Step 4/5] [2021-11-19 21:12:46,134][INFO ][test-runner-#23916%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] ^-- sysMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:12:46] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:12:46] : [Step 4/5] ^-- default region [type=default, persistence=true, lazyAlloc=true, [21:12:46] : [Step 4/5] ... initCfg=100MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB, allocTotal=0MB] [21:12:46] : [Step 4/5] ^-- metastoreMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:12:46] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:12:46] : [Step 4/5] ^-- TxLog region [type=internal, persistence=true, lazyAlloc=false, [21:12:46] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:12:46] : [Step 4/5] ^-- volatileDsMemPlc region [type=user, persistence=false, lazyAlloc=true, [21:12:46] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB] [21:12:46] : [Step 4/5] ^-- Ignite persistence [used=0MB] [21:12:46] : [Step 4/5] [21:12:46] : [Step 4/5] [2021-11-19 21:12:46,135][INFO ][test-runner-#23916%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Starting binary memory restore for: [-2100569601] [21:12:46] : [Step 4/5] [2021-11-19 21:12:46,145][INFO ][test-runner-#23916%encryption.CacheGroupKeyChangeTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:12:46] : [Step 4/5] [2021-11-19 21:12:46,146][INFO ][test-runner-#23916%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:12:46] : [Step 4/5] [2021-11-19 21:12:46,148][INFO ][test-runner-#23916%encryption.CacheGroupKeyChangeTest%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000000.wal, offset=0, ver=2] [21:12:46] : [Step 4/5] [2021-11-19 21:12:46,151][INFO ][test-runner-#23916%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Started cache in recovery mode [name=ignite-sys-cache, id=-2100569601, dataRegionName=sysMemPlc, mode=REPLICATED, atomicity=TRANSACTIONAL, backups=2147483647, mvcc=false] [21:12:46] : [Step 4/5] [2021-11-19 21:12:46,152][INFO ][test-runner-#23916%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Binary recovery performed in 17 ms. [21:12:46] : [Step 4/5] [2021-11-19 21:12:46,152][INFO ][test-runner-#23916%encryption.CacheGroupKeyChangeTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:12:46] : [Step 4/5] [2021-11-19 21:12:46,152][INFO ][test-runner-#23916%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Applying lost cache updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:12:46] : [Step 4/5] [2021-11-19 21:12:46,154][INFO ][test-runner-#23916%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=0 ms] [21:12:46] : [Step 4/5] [2021-11-19 21:12:46,155][INFO ][test-runner-#23916%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Restoring partition state for local groups. [21:12:46] : [Step 4/5] [2021-11-19 21:12:46,159][INFO ][test-runner-#23916%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=1, partitionsProcessed=100, time=0ms] [21:12:46] : [Step 4/5] [2021-11-19 21:12:46,173][INFO ][test-runner-#23916%encryption.CacheGroupKeyChangeTest%][TestTcpDiscoverySpi] Successfully bound to TCP port [port=47501, localHost=localhost/127.0.0.1, locNodeId=10b2a0df-6371-4882-836b-64b1d160d001] [21:12:46] : [Step 4/5] [2021-11-19 21:12:46,176][INFO ][tcp-disco-srvr-[:47500]-#1260%grid-0%-#24030%grid-0%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=41639] [21:12:46] : [Step 4/5] [2021-11-19 21:12:46,177][INFO ][tcp-disco-srvr-[:47500]-#1260%grid-0%-#24030%grid-0%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=41639] [21:12:46] : [Step 4/5] [2021-11-19 21:12:46,177][INFO ][tcp-disco-sock-reader-[]-#1266%grid-0%-#24150%grid-0%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:41639, rmtPort=41639] [21:12:46] : [Step 4/5] [2021-11-19 21:12:46,178][INFO ][tcp-disco-sock-reader-[10b2a0df 127.0.0.1:41639]-#1266%grid-0%-#24150%grid-0%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=10b2a0df-6371-4882-836b-64b1d160d001, rmtAddr=/127.0.0.1:41639] [21:12:46] : [Step 4/5] [2021-11-19 21:12:46,183][INFO ][tcp-disco-srvr-[:47501]-#1265%grid-1%-#24149%grid-1%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=54533] [21:12:46] : [Step 4/5] [2021-11-19 21:12:46,184][INFO ][tcp-disco-srvr-[:47501]-#1265%grid-1%-#24149%grid-1%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=54533] [21:12:46] : [Step 4/5] [2021-11-19 21:12:46,184][INFO ][tcp-disco-sock-reader-[]-#1267%grid-1%-#24151%grid-1%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:54533, rmtPort=54533] [21:12:46] : [Step 4/5] [2021-11-19 21:12:46,185][INFO ][tcp-disco-sock-reader-[]-#1267%grid-1%-#24151%grid-1%][TestTcpDiscoverySpi] Received ping request from the remote node [rmtNodeId=0021223b-d470-4a41-b54f-6489314a0000, rmtAddr=/127.0.0.1:54533, rmtPort=54533] [21:12:46] : [Step 4/5] [2021-11-19 21:12:46,186][INFO ][tcp-disco-sock-reader-[]-#1267%grid-1%-#24151%grid-1%][TestTcpDiscoverySpi] Finished writing ping response [rmtNodeId=0021223b-d470-4a41-b54f-6489314a0000, rmtAddr=/127.0.0.1:54533, rmtPort=54533] [21:12:46] : [Step 4/5] [2021-11-19 21:12:46,186][INFO ][tcp-disco-sock-reader-[10b2a0df 127.0.0.1:41639]-#1266%grid-0%-#24150%grid-0%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:41639, rmtPort=41639, rmtNodeId=10b2a0df-6371-4882-836b-64b1d160d001] [21:12:46]W: [org.apache.ignite:ignite-core] [2021-11-19 21:12:46,186][WARN ][tcp-disco-sock-reader-[]-#1267%grid-1%-#24151%grid-1%][TestTcpDiscoverySpi] Failed to shutdown socket [21:12:46]W: [org.apache.ignite:ignite-core] java.net.SocketException: Socket output is already shutdown [21:12:46]W: [org.apache.ignite:ignite-core] at java.net.Socket.shutdownOutput(Socket.java:1572) [21:12:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.close(IgniteUtils.java:4247) [21:12:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.discovery.tcp.ServerImpl$SocketReader.body(ServerImpl.java:7370) [21:12:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.IgniteSpiThread.run(IgniteSpiThread.java:58) [21:12:46] : [Step 4/5] [2021-11-19 21:12:46,189][INFO ][tcp-disco-sock-reader-[]-#1267%grid-1%-#24151%grid-1%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:54533, rmtPort=54533, rmtNodeId=null] [21:12:46] : [Step 4/5] [2021-11-19 21:12:46,190][INFO ][tcp-disco-msg-worker-[crd]-#1259%grid-0%-#24029%grid-0%][GridEncryptionManager] Joining node doesn't have stored group keys [node=10b2a0df-6371-4882-836b-64b1d160d001] [21:12:46] : [Step 4/5] [2021-11-19 21:12:46,198][INFO ][tcp-disco-msg-worker-[crd]-#1259%grid-0%-#24029%grid-0%][TestTcpDiscoverySpi] New next node [newNext=TcpDiscoveryNode [id=10b2a0df-6371-4882-836b-64b1d160d001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=0, intOrder=2, lastExchangeTime=1637345566180, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false]] [21:12:46] : [Step 4/5] [2021-11-19 21:12:46,199][INFO ][tcp-disco-srvr-[:47501]-#1265%grid-1%-#24149%grid-1%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=52951] [21:12:46] : [Step 4/5] [2021-11-19 21:12:46,199][INFO ][tcp-disco-srvr-[:47501]-#1265%grid-1%-#24149%grid-1%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=52951] [21:12:46] : [Step 4/5] [2021-11-19 21:12:46,200][INFO ][tcp-disco-sock-reader-[]-#1268%grid-1%-#24152%grid-1%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:52951, rmtPort=52951] [21:12:46] : [Step 4/5] [2021-11-19 21:12:46,201][INFO ][tcp-disco-sock-reader-[0021223b 127.0.0.1:52951]-#1268%grid-1%-#24152%grid-1%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=0021223b-d470-4a41-b54f-6489314a0000, rmtAddr=/127.0.0.1:52951] [21:12:46] : [Step 4/5] [2021-11-19 21:12:46,204][INFO ][tcp-disco-msg-worker-[]-#1264%grid-1%-#24148%grid-1%][TestTcpDiscoverySpi] New next node [newNext=TcpDiscoveryNode [id=0021223b-d470-4a41-b54f-6489314a0000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345566201, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false]] [21:12:46] : [Step 4/5] [2021-11-19 21:12:46,205][INFO ][tcp-disco-srvr-[:47500]-#1260%grid-0%-#24030%grid-0%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=41261] [21:12:46] : [Step 4/5] [2021-11-19 21:12:46,205][INFO ][tcp-disco-srvr-[:47500]-#1260%grid-0%-#24030%grid-0%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=41261] [21:12:46] : [Step 4/5] [2021-11-19 21:12:46,206][INFO ][tcp-disco-sock-reader-[]-#1269%grid-0%-#24153%grid-0%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:41261, rmtPort=41261] [21:12:46] : [Step 4/5] [2021-11-19 21:12:46,206][INFO ][tcp-disco-sock-reader-[10b2a0df 127.0.0.1:41261]-#1269%grid-0%-#24153%grid-0%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=10b2a0df-6371-4882-836b-64b1d160d001, rmtAddr=/127.0.0.1:41261] [21:12:46] : [Step 4/5] [2021-11-19 21:12:46,209][INFO ][disco-event-worker-#24032%grid-0%][GridDiscoveryManager] Added new node to topology: TcpDiscoveryNode [id=10b2a0df-6371-4882-836b-64b1d160d001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637345566180, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false] [21:12:46] : [Step 4/5] [2021-11-19 21:12:46,210][INFO ][disco-event-worker-#24032%grid-0%][GridDiscoveryManager] Topology snapshot [ver=2, locNode=0021223b, servers=2, clients=0, state=INACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=0021223b-d470-4a41-b54f-6489314a0000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=10b2a0df-6371-4882-836b-64b1d160d001, consistentId=grid-1, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:12:46] : [Step 4/5] [2021-11-19 21:12:46,212][INFO ][tcp-disco-msg-worker-[0021223b 127.0.0.1:47500]-#1264%grid-1%-#24148%grid-1%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustEnabled' was changed from 'null' to 'false' [21:12:46] : [Step 4/5] [2021-11-19 21:12:46,212][INFO ][tcp-disco-msg-worker-[0021223b 127.0.0.1:47500]-#1264%grid-1%-#24148%grid-1%][ClusterProcessor] charming_wu [21:12:46] : [Step 4/5] [2021-11-19 21:12:46,213][INFO ][tcp-disco-msg-worker-[0021223b 127.0.0.1:47500]-#1264%grid-1%-#24148%grid-1%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustTimeout' was changed from 'null' to '300000' [21:12:46] : [Step 4/5] [2021-11-19 21:12:46,213][INFO ][tcp-disco-msg-worker-[0021223b 127.0.0.1:47500]-#1264%grid-1%-#24148%grid-1%][IgniteTxManager] Transactions parameter 'longOperationsDumpTimeout' was changed from 'null' to '60000' [21:12:46] : [Step 4/5] [2021-11-19 21:12:46,214][INFO ][tcp-disco-msg-worker-[0021223b 127.0.0.1:47500]-#1264%grid-1%-#24148%grid-1%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpThreshold' was changed from 'null' to '0' [21:12:46] : [Step 4/5] [2021-11-19 21:12:46,214][INFO ][tcp-disco-msg-worker-[0021223b 127.0.0.1:47500]-#1264%grid-1%-#24148%grid-1%][IgniteTxManager] Transactions parameter 'transactionTimeDumpSamplesCoefficient' was changed from 'null' to '0.0' [21:12:46] : [Step 4/5] [2021-11-19 21:12:46,215][INFO ][tcp-disco-msg-worker-[0021223b 127.0.0.1:47500]-#1264%grid-1%-#24148%grid-1%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpSamplesPerSecondLimit' was changed from 'null' to '5' [21:12:46] : [Step 4/5] [2021-11-19 21:12:46,215][INFO ][tcp-disco-msg-worker-[0021223b 127.0.0.1:47500]-#1264%grid-1%-#24148%grid-1%][IgniteTxManager] Transactions parameter 'collisionsDumpInterval' was changed from 'null' to '1000' [21:12:46] : [Step 4/5] [2021-11-19 21:12:46,215][INFO ][tcp-disco-msg-worker-[0021223b 127.0.0.1:47500]-#1264%grid-1%-#24148%grid-1%][IgniteTxManager] Transactions parameter 'txOwnerDumpRequestsAllowed' was changed from 'null' to 'true' [21:12:46] : [Step 4/5] [2021-11-19 21:12:46,216][INFO ][tcp-disco-msg-worker-[0021223b 127.0.0.1:47500]-#1264%grid-1%-#24148%grid-1%][GridCacheDatabaseSharedManager] Historical rebalance WAL threshold changed [property=historical.rebalance.threshold, oldVal=null, newVal=500] [21:12:46] : [Step 4/5] [2021-11-19 21:12:46,217][INFO ][disco-notifier-worker-#24147%grid-1%][MvccProcessorImpl] Assigned mvcc coordinator [crd=MvccCoordinator [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=0], nodeId=0021223b-d470-4a41-b54f-6489314a0000, ver=1637345565859, local=false, initialized=false]] [21:12:46] : [Step 4/5] [2021-11-19 21:12:46,218][INFO ][sys-#24124%grid-1%][ClusterProcessor] Writing cluster ID and tag to metastorage on ready for write ClusterIdAndTag [id=27882488-9c93-4c7b-bc3d-a1879d3bf806, tag=charming_wu] [21:12:46] : [Step 4/5] [2021-11-19 21:12:46,236][INFO ][test-runner-#23916%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] To start Console Management & Monitoring run ignitevisorcmd.{sh|bat} [21:12:46] : [Step 4/5] [2021-11-19 21:12:46,237][INFO ][test-runner-#23916%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] [21:12:46] : [Step 4/5] [21:12:46] : [Step 4/5] >>> +-------------------------------------------+ [21:12:46] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:12:46] : [Step 4/5] >>> +-------------------------------------------+ [21:12:46] : [Step 4/5] >>> OS name: Linux 4.15.0-151-generic amd64 [21:12:46] : [Step 4/5] >>> CPU(s): 24 [21:12:46] : [Step 4/5] >>> Heap: 2.0GB [21:12:46] : [Step 4/5] >>> VM name: 16724@c4dfe9a430b2 [21:12:46] : [Step 4/5] >>> Ignite instance name: grid-1 [21:12:46] : [Step 4/5] >>> Local node [ID=10B2A0DF-6371-4882-836B-64B1D160D001, order=2, clientMode=false] [21:12:46] : [Step 4/5] >>> Local node addresses: [127.0.0.1] [21:12:46] : [Step 4/5] >>> Local ports: TCP:10801 TCP:47101 TCP:47501 [21:12:46] : [Step 4/5] [21:12:46] : [Step 4/5] [2021-11-19 21:12:46,238][INFO ][test-runner-#23916%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] >>> Ignite cluster is in INACTIVE state (limited functionality available). Use control.(sh|bat) script or IgniteCluster.state(ClusterState.ACTIVE) to change the state. [21:12:46] : [Step 4/5] [2021-11-19 21:12:46,238][INFO ][test-runner-#23916%encryption.CacheGroupKeyChangeTest%][GridDiscoveryManager] Topology snapshot [ver=2, locNode=10b2a0df, servers=2, clients=0, state=INACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=0021223b-d470-4a41-b54f-6489314a0000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=10b2a0df-6371-4882-836b-64b1d160d001, consistentId=grid-1, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:12:46] : [Step 4/5] [2021-11-19 21:12:46,239][INFO ][test-runner-#23916%encryption.CacheGroupKeyChangeTest%][G] Node started : [stage="Configure system pool" (0 ms),stage="Start managers" (189 ms),stage="Configure binary metadata" (2 ms),stage="Start processors" (25 ms),stage="Start 'StanByClusterTestProvider' plugin" (0 ms),stage="Start 'PageMemory tracker plugin' plugin" (0 ms),stage="Start 'TestDistibutedConfigurationPlugin' plugin" (0 ms),stage="Start 'NodeValidationPluginProvider' plugin" (0 ms),stage="Init metastore" (18 ms),stage="Init and start regions" (9 ms),stage="Restore binary memory" (16 ms),stage="Restore logical state" (7 ms),stage="Finish recovery" (11 ms),stage="Join topology" (45 ms),stage="Await transition" (2 ms),stage="Await exchange" (20 ms),stage="Total time" (344 ms)] [21:12:46] : [Step 4/5] [2021-11-19 21:12:46,241][INFO ][test-runner-#23916%encryption.CacheGroupKeyChangeTest%][root] Node started with the following configuration [id=10b2a0df-6371-4882-836b-64b1d160d001, marshaller=BinaryMarshaller [], discovery=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=5000, ackTimeout=5000, marsh=JdkMarshaller [clsFilter=org.apache.ignite.marshaller.MarshallerUtils$1@75895e9d], reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], binaryCfg=null, lateAff=true] [21:12:46] : [Step 4/5] [2021-11-19 21:12:46,243][INFO ][test-runner-#23916%encryption.CacheGroupKeyChangeTest%][GridClusterStateProcessor] Sending activate cluster request with BaselineTopology BaselineTopology [id=0, branchingHash=-2475315501, branchingType='New BaselineTopology', baselineNodes=[grid-1, grid-0]] [21:12:46] : [Step 4/5] [2021-11-19 21:12:46,247][INFO ][disco-notifier-worker-#24028%grid-0%][GridClusterStateProcessor] Received activate cluster request with BaselineTopology[id=0] initiator node ID: 0021223b-d470-4a41-b54f-6489314a0000 [21:12:46] : [Step 4/5] [2021-11-19 21:12:46,247][INFO ][disco-notifier-worker-#24028%grid-0%][GridClusterStateProcessor] Started state transition: activate cluster [21:12:46] : [Step 4/5] [2021-11-19 21:12:46,248][INFO ][exchange-worker-#24033%grid-0%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], crd=true, evt=DISCOVERY_CUSTOM_EVT, evtNode=0021223b-d470-4a41-b54f-6489314a0000, customEvt=ChangeGlobalStateMessage [id=b3afd593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqId=264d1283-9e8b-4c59-822a-82da4f9e58f6, initiatingNodeId=0021223b-d470-4a41-b54f-6489314a0000, state=ACTIVE, baselineTopology=BaselineTopology [id=0, branchingHash=-2475315501, branchingType='New BaselineTopology', baselineNodes=[grid-1, grid-0]], forceChangeBaselineTopology=false, timestamp=1637345566243, forceDeactivation=true], allowMerge=false, exchangeFreeSwitch=false] [21:12:46] : [Step 4/5] [2021-11-19 21:12:46,248][INFO ][disco-notifier-worker-#24147%grid-1%][GridClusterStateProcessor] Received activate cluster request with BaselineTopology[id=0] initiator node ID: 0021223b-d470-4a41-b54f-6489314a0000 [21:12:46] : [Step 4/5] [2021-11-19 21:12:46,249][INFO ][exchange-worker-#24033%grid-0%][GridDhtPartitionsExchangeFuture] Start activation process [nodeId=0021223b-d470-4a41-b54f-6489314a0000, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]]. New state: ACTIVE [21:12:46] : [Step 4/5] [2021-11-19 21:12:46,249][INFO ][disco-notifier-worker-#24147%grid-1%][GridClusterStateProcessor] Started state transition: activate cluster [21:12:46] : [Step 4/5] [2021-11-19 21:12:46,250][INFO ][exchange-worker-#24033%grid-0%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0 [21:12:46] : [Step 4/5] [2021-11-19 21:12:46,250][INFO ][exchange-worker-#24156%grid-1%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], crd=false, evt=DISCOVERY_CUSTOM_EVT, evtNode=0021223b-d470-4a41-b54f-6489314a0000, customEvt=ChangeGlobalStateMessage [id=b3afd593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqId=264d1283-9e8b-4c59-822a-82da4f9e58f6, initiatingNodeId=0021223b-d470-4a41-b54f-6489314a0000, state=ACTIVE, baselineTopology=BaselineTopology [id=0, branchingHash=-2475315501, branchingType='New BaselineTopology', baselineNodes=[grid-1, grid-0]], forceChangeBaselineTopology=false, timestamp=1637345566243, forceDeactivation=true], allowMerge=false, exchangeFreeSwitch=false] [21:12:46] : [Step 4/5] [2021-11-19 21:12:46,252][INFO ][exchange-worker-#24033%grid-0%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000000.wal, offset=8795, ver=2] [21:12:46] : [Step 4/5] [2021-11-19 21:12:46,253][INFO ][exchange-worker-#24156%grid-1%][GridDhtPartitionsExchangeFuture] Start activation process [nodeId=10b2a0df-6371-4882-836b-64b1d160d001, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]]. New state: ACTIVE [21:12:46] : [Step 4/5] [2021-11-19 21:12:46,254][INFO ][exchange-worker-#24033%grid-0%][GridClusterStateProcessor] Writing BaselineTopology[id=0] [21:12:46] : [Step 4/5] [2021-11-19 21:12:46,254][INFO ][exchange-worker-#24156%grid-1%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1 [21:12:46] : [Step 4/5] [2021-11-19 21:12:46,256][INFO ][exchange-worker-#24033%grid-0%][GridCacheDatabaseSharedManager] Finish recovery performed in 5 ms. [21:12:46] : [Step 4/5] [2021-11-19 21:12:46,259][INFO ][exchange-worker-#24033%grid-0%][msg] Components activation performed in 9 ms. [21:12:46] : [Step 4/5] [2021-11-19 21:12:46,259][INFO ][exchange-worker-#24156%grid-1%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000000.wal, offset=8795, ver=2] [21:12:46] : [Step 4/5] [2021-11-19 21:12:46,260][INFO ][exchange-worker-#24033%grid-0%][GridCacheProcessor] Finished recovery for cache [cache=ignite-sys-cache, grp=ignite-sys-cache, startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:12:46] : [Step 4/5] [2021-11-19 21:12:46,261][INFO ][exchange-worker-#24156%grid-1%][GridClusterStateProcessor] Writing BaselineTopology[id=0] [21:12:46] : [Step 4/5] [2021-11-19 21:12:46,261][INFO ][exchange-worker-#24033%grid-0%][GridDhtPartitionsExchangeFuture] Successfully activated caches [nodeId=0021223b-d470-4a41-b54f-6489314a0000, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], newState=ACTIVE] [21:12:46] : [Step 4/5] [2021-11-19 21:12:46,263][INFO ][exchange-worker-#24033%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:12:46] : [Step 4/5] [2021-11-19 21:12:46,263][INFO ][exchange-worker-#24156%grid-1%][GridCacheDatabaseSharedManager] Finish recovery performed in 8 ms. [21:12:46] : [Step 4/5] [2021-11-19 21:12:46,264][INFO ][exchange-worker-#24156%grid-1%][msg] Components activation performed in 10 ms. [21:12:46] : [Step 4/5] [2021-11-19 21:12:46,265][INFO ][exchange-worker-#24156%grid-1%][GridCacheProcessor] Finished recovery for cache [cache=ignite-sys-cache, grp=ignite-sys-cache, startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:12:46] : [Step 4/5] [2021-11-19 21:12:46,266][INFO ][exchange-worker-#24156%grid-1%][GridDhtPartitionsExchangeFuture] Successfully activated caches [nodeId=10b2a0df-6371-4882-836b-64b1d160d001, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], newState=ACTIVE] [21:12:46] : [Step 4/5] [2021-11-19 21:12:46,267][INFO ][exchange-worker-#24156%grid-1%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:12:46] : [Step 4/5] [2021-11-19 21:12:46,271][INFO ][exchange-worker-#24033%grid-0%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], crd=true] [21:12:46] : [Step 4/5] [2021-11-19 21:12:46,277][INFO ][grid-nio-worker-tcp-comm-0-#23971%TestRecordingCommunicationSpi%][TestRecordingCommunicationSpi] Accepted incoming communication connection [locAddr=/127.0.0.1:47100, rmtAddr=/127.0.0.1:34488] [21:12:46] : [Step 4/5] [2021-11-19 21:12:46,282][INFO ][grid-nio-worker-tcp-comm-0-#24090%TestRecordingCommunicationSpi%][TestRecordingCommunicationSpi] Established outgoing communication connection [locAddr=/127.0.0.1:34488, rmtAddr=/127.0.0.1:47100] [21:12:46] : [Step 4/5] [2021-11-19 21:12:46,282][INFO ][db-checkpoint-thread-#24167%grid-0%][Checkpointer] Checkpoint started [checkpointId=c3852394-ddc6-4fb6-b7b1-72974bb89830, startPtr=WALPointer [idx=0, fileOff=86649, len=1963], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=9ms, writeCheckpointEntryDuration=2ms, splitAndSortCpPagesDuration=0ms, pages=18, reason='node started'] [21:12:46] : [Step 4/5] [2021-11-19 21:12:46,282][INFO ][db-checkpoint-thread-#24172%grid-1%][Checkpointer] Checkpoint started [checkpointId=ae7d4e54-6b37-457c-9474-eabcac054e48, startPtr=WALPointer [idx=0, fileOff=86649, len=1963], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=5ms, writeCheckpointEntryDuration=2ms, splitAndSortCpPagesDuration=0ms, pages=18, reason='node started'] [21:12:46] : [Step 4/5] [2021-11-19 21:12:46,284][INFO ][sys-#24014%grid-0%][GridDhtPartitionsExchangeFuture] Coordinator received single message [ver=AffinityTopologyVersion [topVer=2, minorTopVer=1], node=10b2a0df-6371-4882-836b-64b1d160d001, allReceived=true] [21:12:46] : [Step 4/5] [2021-11-19 21:12:46,282][INFO ][exchange-worker-#24156%grid-1%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], crd=false] [21:12:46] : [Step 4/5] [2021-11-19 21:12:46,285][INFO ][sys-#24014%grid-0%][GridDhtPartitionsExchangeFuture] finishExchangeOnCoordinator [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:12:46] : [Step 4/5] [2021-11-19 21:12:46,293][INFO ][sys-#24014%grid-0%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], err=null, rebalanced=true, wasRebalanced=false] [21:12:46] : [Step 4/5] [2021-11-19 21:12:46,294][INFO ][disco-notifier-worker-#24147%grid-1%][GridClusterStateProcessor] Received state change finish message: ACTIVE [21:12:46] : [Step 4/5] [2021-11-19 21:12:46,294][INFO ][sys-#24131%grid-1%][GridDhtPartitionsExchangeFuture] Received full message, will finish exchange [node=0021223b-d470-4a41-b54f-6489314a0000, resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:12:46] : [Step 4/5] [2021-11-19 21:12:46,293][INFO ][disco-notifier-worker-#24028%grid-0%][GridClusterStateProcessor] Received state change finish message: ACTIVE [21:12:46] : [Step 4/5] [2021-11-19 21:12:46,300][INFO ][sys-#24014%grid-0%][GridCacheProcessor] Finish proxy initialization, cacheName=ignite-sys-cache, localNodeId=0021223b-d470-4a41-b54f-6489314a0000 [21:12:46] : [Step 4/5] [2021-11-19 21:12:46,300][INFO ][sys-#24135%grid-1%][GridCachePartitionExchangeManager] Delay process full message without exchange id (there is exchange in progress) [nodeId=0021223b-d470-4a41-b54f-6489314a0000] [21:12:46] : [Step 4/5] [2021-11-19 21:12:46,298][INFO ][disco-notifier-worker-#24147%grid-1%][GridClusterStateProcessor] Cluster state was changed from INACTIVE to ACTIVE [21:12:46] : [Step 4/5] [2021-11-19 21:12:46,301][INFO ][exchange-worker-#24033%grid-0%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=2, minorTopVer=1], force=false, evt=DISCOVERY_CUSTOM_EVT, node=0021223b-d470-4a41-b54f-6489314a0000] [21:12:46] : [Step 4/5] [2021-11-19 21:12:46,301][INFO ][sys-#24014%grid-0%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=0021223b-d470-4a41-b54f-6489314a0000, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=0021223b-d470-4a41-b54f-6489314a0000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345566293, loc=true, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:12:46] : [Step 4/5] [2021-11-19 21:12:46,301][INFO ][sys-#24005%grid-0%][DistributedBaselineConfiguration] Baseline auto-adjust is 'disabled' with timeout='300000' ms [21:12:46] : [Step 4/5] [2021-11-19 21:12:46,300][INFO ][sys-#24131%grid-1%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], err=null, rebalanced=true, wasRebalanced=false] [21:12:46] : [Step 4/5] [2021-11-19 21:12:46,300][INFO ][disco-notifier-worker-#24028%grid-0%][GridClusterStateProcessor] Cluster state was changed from INACTIVE to ACTIVE [21:12:46] : [Step 4/5] [2021-11-19 21:12:46,303][INFO ][sys-#24005%grid-0%][GridClusterStateProcessor] Successfully performed final activation steps [nodeId=0021223b-d470-4a41-b54f-6489314a0000, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:12:46] : [Step 4/5] [2021-11-19 21:12:46,303][INFO ][sys-#24014%grid-0%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (1 ms), stage="Update caches registry" (10 ms), stage="Start caches" (1 ms), stage="Affinity initialization on cache group start" (0 ms), stage="Determine exchange type" (1 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Restore partition states" (0 ms), stage="After states restored callback" (7 ms), stage="WAL history reservation" (0 ms), stage="Waiting for all single messages" (14 ms), stage="Affinity recalculation (crd)" (0 ms), stage="Collect update counters and create affinity messages" (0 ms), stage="Assign partitions states" (0 ms), stage="Validate partitions states" (0 ms), stage="Ideal affinity diff calculation (enforced)" (0 ms), stage="Apply update counters" (0 ms), stage="Full message preparing" (5 ms), stage="Full message sending" (0 ms), stage="State finish message sending" (0 ms), stage="Detect lost partitions" (5 ms), stage="Exchange done" (3 ms), stage="Total time" (47 ms), Discovery lag=2 ms, Latest started node id=10b2a0df-6371-4882-836b-64b1d160d001] [21:12:46] : [Step 4/5] [2021-11-19 21:12:46,305][INFO ][sys-#24131%grid-1%][GridCacheProcessor] Finish proxy initialization, cacheName=ignite-sys-cache, localNodeId=10b2a0df-6371-4882-836b-64b1d160d001 [21:12:46] : [Step 4/5] [2021-11-19 21:12:46,307][INFO ][sys-#24014%grid-0%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], stage="Affinity initialization on cache group start [grp=ignite-sys-cache]" (0 ms) (parent=Affinity initialization on cache group start), stage="Affinity centralized initialization (crd) [grp=ignite-sys-cache, crd=true]" (0 ms) (parent=Determine exchange type), stage="Restore partition states [grp=ignite-sys-cache]" (0 ms) (parent=Restore partition states), stage="Affinity recalculation (partitions availability) [grp=ignite-sys-cache]" (0 ms) (parent=Ideal affinity diff calculation (enforced))] [21:12:46] : [Step 4/5] [2021-11-19 21:12:46,319][INFO ][test-runner-#23916%encryption.CacheGroupKeyChangeTest%][root] awaitPartitionMapExchange finished [21:12:46] : [Step 4/5] [2021-11-19 21:12:46,319][INFO ][sys-#24131%grid-1%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=10b2a0df-6371-4882-836b-64b1d160d001, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=0021223b-d470-4a41-b54f-6489314a0000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345566201, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:12:46] : [Step 4/5] [2021-11-19 21:12:46,318][INFO ][exchange-worker-#24156%grid-1%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=2, minorTopVer=1], force=false, evt=DISCOVERY_CUSTOM_EVT, node=0021223b-d470-4a41-b54f-6489314a0000] [21:12:46] : [Step 4/5] [2021-11-19 21:12:46,318][INFO ][sys-#24140%grid-1%][DistributedBaselineConfiguration] Baseline auto-adjust is 'disabled' with timeout='300000' ms [21:12:46] : [Step 4/5] [2021-11-19 21:12:46,321][INFO ][sys-#24131%grid-1%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (2 ms), stage="Update caches registry" (12 ms), stage="Start caches" (0 ms), stage="Affinity initialization on cache group start" (0 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Restore partition states" (0 ms), stage="After states restored callback" (7 ms), stage="WAL history reservation" (0 ms), stage="Waiting for Full message" (19 ms), stage="Affinity recalculation" (4 ms), stage="Full map updating" (1 ms), stage="Detect lost partitions" (3 ms), stage="Exchange done" (16 ms), stage="Total time" (64 ms)] [21:12:46] : [Step 4/5] [2021-11-19 21:12:46,321][INFO ][test-runner-#23916%encryption.CacheGroupKeyChangeTest%][root] Caught expected exception: Cache group key change was rejected. Cache or group "encrypted" doesn't exists [21:12:46] : [Step 4/5] [2021-11-19 21:12:46,323][INFO ][sys-#24131%grid-1%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], stage="Affinity initialization on cache group start [grp=ignite-sys-cache]" (0 ms) (parent=Affinity initialization on cache group start), stage="Affinity centralized initialization (crd) [grp=ignite-sys-cache, crd=false]" (0 ms) (parent=Determine exchange type), stage="Restore partition states [grp=ignite-sys-cache]" (0 ms) (parent=Restore partition states), stage="Affinity applying from full message [grp=ignite-sys-cache]" (4 ms) (parent=Affinity recalculation)] [21:12:46] : [Step 4/5] [2021-11-19 21:12:46,322][INFO ][sys-#24140%grid-1%][GridClusterStateProcessor] Successfully performed final activation steps [nodeId=10b2a0df-6371-4882-836b-64b1d160d001, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:12:46] : [Step 4/5] [2021-11-19 21:12:46,329][INFO ][exchange-worker-#24033%grid-0%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], crd=true, evt=DISCOVERY_CUSTOM_EVT, evtNode=0021223b-d470-4a41-b54f-6489314a0000, customEvt=DynamicCacheChangeBatch [id=f5afd593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqs=ArrayList [DynamicCacheChangeRequest [cacheName=encrypted, hasCfg=true, nodeId=0021223b-d470-4a41-b54f-6489314a0000, clientStartOnly=false, stop=false, destroy=false, disabledAfterStart=false]], exchangeActions=ExchangeActions [startCaches=[encrypted], stopCaches=null, startGrps=[encrypted], stopGrps=[], resetParts=null, stateChangeRequest=null], startCaches=false], allowMerge=false, exchangeFreeSwitch=false] [21:12:46] : [Step 4/5] [2021-11-19 21:12:46,338][INFO ][db-checkpoint-thread-#24172%grid-1%][Checkpointer] Checkpoint finished [cpId=ae7d4e54-6b37-457c-9474-eabcac054e48, pages=18, markPos=WALPointer [idx=0, fileOff=86649, len=1963], walSegmentsCovered=[], markDuration=11ms, pagesWrite=3ms, fsync=50ms, total=65ms] [21:12:46] : [Step 4/5] [2021-11-19 21:12:46,338][INFO ][db-checkpoint-thread-#24167%grid-0%][Checkpointer] Checkpoint finished [cpId=c3852394-ddc6-4fb6-b7b1-72974bb89830, pages=18, markPos=WALPointer [idx=0, fileOff=86649, len=1963], walSegmentsCovered=[], markDuration=12ms, pagesWrite=2ms, fsync=53ms, total=68ms] [21:12:46] : [Step 4/5] [2021-11-19 21:12:46,330][INFO ][exchange-worker-#24156%grid-1%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], crd=false, evt=DISCOVERY_CUSTOM_EVT, evtNode=0021223b-d470-4a41-b54f-6489314a0000, customEvt=DynamicCacheChangeBatch [id=f5afd593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqs=ArrayList [DynamicCacheChangeRequest [cacheName=encrypted, hasCfg=true, nodeId=0021223b-d470-4a41-b54f-6489314a0000, clientStartOnly=false, stop=false, destroy=false, disabledAfterStart=false]], exchangeActions=ExchangeActions [startCaches=[encrypted], stopCaches=null, startGrps=[encrypted], stopGrps=[], resetParts=null, stateChangeRequest=null], startCaches=false], allowMerge=false, exchangeFreeSwitch=false] [21:12:46] : [Step 4/5] [2021-11-19 21:12:46,340][INFO ][exchange-worker-#24033%grid-0%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:12:46] : [Step 4/5] [2021-11-19 21:12:46,342][INFO ][exchange-worker-#24156%grid-1%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:12:46] : [Step 4/5] [2021-11-19 21:12:46,415][INFO ][exchange-worker-#24033%grid-0%][GridCacheProcessor] Started cache [name=encrypted, id=1613773252, dataRegionName=default, mode=PARTITIONED, atomicity=ATOMIC, backups=0, mvcc=false] [21:12:46] : [Step 4/5] [2021-11-19 21:12:46,417][INFO ][exchange-worker-#24033%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], waitTime=0ms, futInfo=NA, mode=DISTRIBUTED] [21:12:46] : [Step 4/5] [2021-11-19 21:12:46,420][INFO ][exchange-worker-#24156%grid-1%][GridCacheProcessor] Started cache [name=encrypted, id=1613773252, dataRegionName=default, mode=PARTITIONED, atomicity=ATOMIC, backups=0, mvcc=false] [21:12:46] : [Step 4/5] [2021-11-19 21:12:46,422][INFO ][exchange-worker-#24156%grid-1%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], waitTime=0ms, futInfo=NA, mode=DISTRIBUTED] [21:12:46] : [Step 4/5] [2021-11-19 21:12:46,424][INFO ][exchange-worker-#24033%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partitions release latch: ServerLatch [permits=0, pendingAcks=HashSet [], super=CompletableLatch [id=CompletableLatchUid [id=exchange, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2]]]] [21:12:46] : [Step 4/5] [2021-11-19 21:12:46,424][INFO ][exchange-worker-#24156%grid-1%][GridDhtPartitionsExchangeFuture] Finished waiting for partitions release latch: ClientLatch [coordinator=TcpDiscoveryNode [id=0021223b-d470-4a41-b54f-6489314a0000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345566201, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], ackSent=true, super=CompletableLatch [id=CompletableLatchUid [id=exchange, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2]]]] [21:12:46] : [Step 4/5] [2021-11-19 21:12:46,425][INFO ][exchange-worker-#24033%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:12:46] : [Step 4/5] [2021-11-19 21:12:46,426][INFO ][exchange-worker-#24156%grid-1%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:12:46] : [Step 4/5] [2021-11-19 21:12:46,513][INFO ][exchange-worker-#24033%grid-0%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], crd=true] [21:12:46] : [Step 4/5] [2021-11-19 21:12:46,516][INFO ][exchange-worker-#24156%grid-1%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], crd=false] [21:12:46] : [Step 4/5] [2021-11-19 21:12:46,517][INFO ][sys-#24013%grid-0%][GridDhtPartitionsExchangeFuture] Coordinator received single message [ver=AffinityTopologyVersion [topVer=2, minorTopVer=2], node=10b2a0df-6371-4882-836b-64b1d160d001, allReceived=true] [21:12:46] : [Step 4/5] [2021-11-19 21:12:46,517][INFO ][sys-#24013%grid-0%][GridDhtPartitionsExchangeFuture] finishExchangeOnCoordinator [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2]] [21:12:46] : [Step 4/5] [2021-11-19 21:12:46,524][INFO ][sys-#24013%grid-0%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], err=null, rebalanced=true, wasRebalanced=true] [21:12:46] : [Step 4/5] [2021-11-19 21:12:46,524][INFO ][sys-#24127%grid-1%][GridDhtPartitionsExchangeFuture] Received full message, will finish exchange [node=0021223b-d470-4a41-b54f-6489314a0000, resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2]] [21:12:46] : [Step 4/5] [2021-11-19 21:12:46,526][INFO ][sys-#24127%grid-1%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], err=null, rebalanced=true, wasRebalanced=true] [21:12:46] : [Step 4/5] [2021-11-19 21:12:46,528][INFO ][sys-#24013%grid-0%][GridCacheProcessor] Finish proxy initialization, cacheName=encrypted, localNodeId=0021223b-d470-4a41-b54f-6489314a0000 [21:12:46] : [Step 4/5] [2021-11-19 21:12:46,528][INFO ][sys-#24013%grid-0%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=0021223b-d470-4a41-b54f-6489314a0000, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=0021223b-d470-4a41-b54f-6489314a0000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345566323, loc=true, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2]] [21:12:46] : [Step 4/5] [2021-11-19 21:12:46,529][INFO ][sys-#24127%grid-1%][GridCacheProcessor] Finish proxy initialization, cacheName=encrypted, localNodeId=10b2a0df-6371-4882-836b-64b1d160d001 [21:12:46] : [Step 4/5] [2021-11-19 21:12:46,529][INFO ][exchange-worker-#24033%grid-0%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=2, minorTopVer=2], force=false, evt=DISCOVERY_CUSTOM_EVT, node=0021223b-d470-4a41-b54f-6489314a0000] [21:12:46] : [Step 4/5] [2021-11-19 21:12:46,529][INFO ][test-runner-#23916%encryption.CacheGroupKeyChangeTest%][root] Caught expected exception: Cache group key change was rejected. Cache or group "encrypted" is not encrypted. [21:12:46] : [Step 4/5] [2021-11-19 21:12:46,530][INFO ][exchange-worker-#24156%grid-1%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=2, minorTopVer=2], force=false, evt=DISCOVERY_CUSTOM_EVT, node=0021223b-d470-4a41-b54f-6489314a0000] [21:12:46] : [Step 4/5] [2021-11-19 21:12:46,530][INFO ][sys-#24127%grid-1%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=10b2a0df-6371-4882-836b-64b1d160d001, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=0021223b-d470-4a41-b54f-6489314a0000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345566201, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2]] [21:12:46] : [Step 4/5] [2021-11-19 21:12:46,529][INFO ][sys-#24013%grid-0%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (8 ms), stage="Update caches registry" (0 ms), stage="Start caches" (77 ms), stage="Affinity initialization on cache group start" (1 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Wait partitions release latch [latch=exchange]" (7 ms), stage="Wait partitions release [latch=exchange]" (1 ms), stage="Restore partition states" (12 ms), stage="After states restored callback" (74 ms), stage="WAL history reservation" (0 ms), stage="Waiting for all single messages" (4 ms), stage="Affinity recalculation (crd)" (0 ms), stage="Collect update counters and create affinity messages" (0 ms), stage="Assign partitions states" (2 ms), stage="Validate partitions states" (0 ms), stage="Apply update counters" (0 ms), stage="Full message preparing" (2 ms), stage="Full message sending" (0 ms), stage="Exchange done" (5 ms), stage="Total time" (193 ms)] [21:12:46] : [Step 4/5] [2021-11-19 21:12:46,533][INFO ][sys-#24127%grid-1%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (10 ms), stage="Update caches registry" (0 ms), stage="Start caches" (79 ms), stage="Affinity initialization on cache group start" (1 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Wait partitions release latch [latch=exchange]" (3 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Restore partition states" (16 ms), stage="After states restored callback" (72 ms), stage="WAL history reservation" (0 ms), stage="Waiting for Full message" (9 ms), stage="Affinity recalculation" (0 ms), stage="Full map updating" (1 ms), stage="Exchange done" (6 ms), stage="Total time" (197 ms)] [21:12:46] : [Step 4/5] [2021-11-19 21:12:46,532][INFO ][exchange-worker-#24156%grid-1%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=3], crd=false, evt=DISCOVERY_CUSTOM_EVT, evtNode=0021223b-d470-4a41-b54f-6489314a0000, customEvt=DynamicCacheChangeBatch [id=e6afd593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqs=ArrayList [DynamicCacheChangeRequest [cacheName=encrypted, hasCfg=false, nodeId=0021223b-d470-4a41-b54f-6489314a0000, clientStartOnly=false, stop=true, destroy=false, disabledAfterStart=false]], exchangeActions=ExchangeActions [startCaches=null, stopCaches=[encrypted], startGrps=[], stopGrps=[encrypted, destroy=true], resetParts=null, stateChangeRequest=null], startCaches=false], allowMerge=false, exchangeFreeSwitch=false] [21:12:46] : [Step 4/5] [2021-11-19 21:12:46,531][INFO ][exchange-worker-#24033%grid-0%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=3], crd=true, evt=DISCOVERY_CUSTOM_EVT, evtNode=0021223b-d470-4a41-b54f-6489314a0000, customEvt=DynamicCacheChangeBatch [id=e6afd593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqs=ArrayList [DynamicCacheChangeRequest [cacheName=encrypted, hasCfg=false, nodeId=0021223b-d470-4a41-b54f-6489314a0000, clientStartOnly=false, stop=true, destroy=false, disabledAfterStart=false]], exchangeActions=ExchangeActions [startCaches=null, stopCaches=[encrypted], startGrps=[], stopGrps=[encrypted, destroy=true], resetParts=null, stateChangeRequest=null], startCaches=false], allowMerge=false, exchangeFreeSwitch=false] [21:12:46] : [Step 4/5] [2021-11-19 21:12:46,539][INFO ][exchange-worker-#24156%grid-1%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=3], waitTime=0ms, futInfo=NA, mode=DISTRIBUTED] [21:12:46] : [Step 4/5] [2021-11-19 21:12:46,537][INFO ][sys-#24127%grid-1%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], stage="Affinity initialization on cache group start [grp=encrypted]" (1 ms) (parent=Affinity initialization on cache group start), stage="Restore partition states [grp=encrypted]" (16 ms) (parent=Restore partition states), stage="Restore partition states [grp=ignite-sys-cache]" (0 ms) (parent=Restore partition states)] [21:12:46] : [Step 4/5] [2021-11-19 21:12:46,535][INFO ][sys-#24013%grid-0%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], stage="Affinity initialization on cache group start [grp=encrypted]" (1 ms) (parent=Affinity initialization on cache group start), stage="Restore partition states [grp=encrypted]" (12 ms) (parent=Restore partition states), stage="Restore partition states [grp=ignite-sys-cache]" (0 ms) (parent=Restore partition states)] [21:12:46] : [Step 4/5] [2021-11-19 21:12:46,540][INFO ][exchange-worker-#24033%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=3], waitTime=0ms, futInfo=NA, mode=DISTRIBUTED] [21:12:46] : [Step 4/5] [2021-11-19 21:12:46,543][INFO ][exchange-worker-#24033%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partitions release latch: ServerLatch [permits=0, pendingAcks=HashSet [], super=CompletableLatch [id=CompletableLatchUid [id=exchange, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=3]]]] [21:12:46] : [Step 4/5] [2021-11-19 21:12:46,546][INFO ][exchange-worker-#24033%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=3], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:12:46] : [Step 4/5] [2021-11-19 21:12:46,546][INFO ][exchange-worker-#24156%grid-1%][GridDhtPartitionsExchangeFuture] Finished waiting for partitions release latch: ClientLatch [coordinator=TcpDiscoveryNode [id=0021223b-d470-4a41-b54f-6489314a0000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345566201, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], ackSent=true, super=CompletableLatch [id=CompletableLatchUid [id=exchange, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=3]]]] [21:12:46] : [Step 4/5] [2021-11-19 21:12:46,547][INFO ][exchange-worker-#24156%grid-1%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=3], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:12:46] : [Step 4/5] [2021-11-19 21:12:46,547][INFO ][exchange-worker-#24033%grid-0%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=3], crd=true] [21:12:46] : [Step 4/5] [2021-11-19 21:12:46,549][INFO ][exchange-worker-#24156%grid-1%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=3], crd=false] [21:12:46] : [Step 4/5] [2021-11-19 21:12:46,549][INFO ][sys-#24025%grid-0%][GridDhtPartitionsExchangeFuture] Coordinator received single message [ver=AffinityTopologyVersion [topVer=2, minorTopVer=3], node=10b2a0df-6371-4882-836b-64b1d160d001, allReceived=true] [21:12:46] : [Step 4/5] [2021-11-19 21:12:46,550][INFO ][sys-#24025%grid-0%][GridDhtPartitionsExchangeFuture] finishExchangeOnCoordinator [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=3], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=3]] [21:12:46] : [Step 4/5] [2021-11-19 21:12:46,552][INFO ][sys-#24025%grid-0%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=3], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=3], err=null, rebalanced=true, wasRebalanced=true] [21:12:46] : [Step 4/5] [2021-11-19 21:12:46,553][INFO ][sys-#24136%grid-1%][GridDhtPartitionsExchangeFuture] Received full message, will finish exchange [node=0021223b-d470-4a41-b54f-6489314a0000, resVer=AffinityTopologyVersion [topVer=2, minorTopVer=3]] [21:12:46] : [Step 4/5] [2021-11-19 21:12:46,555][INFO ][sys-#24136%grid-1%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=3], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=3], err=null, rebalanced=true, wasRebalanced=true] [21:12:46] : [Step 4/5] [2021-11-19 21:12:46,558][INFO ][db-checkpoint-thread-#24167%grid-0%][Checkpointer] Checkpoint started [checkpointId=cb39b4bf-d310-4886-9e44-8d4bb1041558, startPtr=WALPointer [idx=0, fileOff=170827, len=21409], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=1ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=0ms, pages=5, reason='caches stop'] [21:12:46] : [Step 4/5] [2021-11-19 21:12:46,575][INFO ][db-checkpoint-thread-#24172%grid-1%][Checkpointer] Checkpoint started [checkpointId=5f5b9136-d56e-4c8b-a0ec-b0b3f62694c5, startPtr=WALPointer [idx=0, fileOff=170827, len=21409], checkpointBeforeLockTime=2ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=1ms, checkpointLockHoldTime=2ms, walCpRecordFsyncDuration=7ms, writeCheckpointEntryDuration=9ms, splitAndSortCpPagesDuration=0ms, pages=5, reason='caches stop'] [21:12:46] : [Step 4/5] [2021-11-19 21:12:46,575][INFO ][db-checkpoint-thread-#24167%grid-0%][Checkpointer] Checkpoint finished [cpId=cb39b4bf-d310-4886-9e44-8d4bb1041558, pages=5, markPos=WALPointer [idx=0, fileOff=170827, len=21409], walSegmentsCovered=[], markDuration=4ms, pagesWrite=0ms, fsync=16ms, total=21ms] [21:12:46] : [Step 4/5] [2021-11-19 21:12:46,576][INFO ][sys-#24025%grid-0%][GridCacheProcessor] Stopped cache [cacheName=encrypted] [21:12:46] : [Step 4/5] [2021-11-19 21:12:46,585][INFO ][sys-#24025%grid-0%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=0021223b-d470-4a41-b54f-6489314a0000, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=3], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=0021223b-d470-4a41-b54f-6489314a0000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345566524, loc=true, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=2, minorTopVer=3]] [21:12:46] : [Step 4/5] [2021-11-19 21:12:46,585][INFO ][exchange-worker-#24033%grid-0%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=2, minorTopVer=3], force=false, evt=DISCOVERY_CUSTOM_EVT, node=0021223b-d470-4a41-b54f-6489314a0000] [21:12:46] : [Step 4/5] [2021-11-19 21:12:46,586][INFO ][sys-#24025%grid-0%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=3], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=3], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (8 ms), stage="Update caches registry" (0 ms), stage="Start caches" (0 ms), stage="Affinity initialization on cache group start" (0 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (2 ms), stage="Wait partitions release latch [latch=exchange]" (3 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="After states restored callback" (0 ms), stage="WAL history reservation" (0 ms), stage="Waiting for all single messages" (2 ms), stage="Affinity recalculation (crd)" (0 ms), stage="Collect update counters and create affinity messages" (0 ms), stage="Assign partitions states" (0 ms), stage="Validate partitions states" (0 ms), stage="Apply update counters" (0 ms), stage="Full message preparing" (1 ms), stage="Full message sending" (0 ms), stage="Exchange done" (33 ms), stage="Total time" (49 ms)] [21:12:46] : [Step 4/5] [2021-11-19 21:12:46,589][INFO ][sys-#24025%grid-0%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=3], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=3]] [21:12:46] : [Step 4/5] [2021-11-19 21:12:46,592][INFO ][db-checkpoint-thread-#24172%grid-1%][Checkpointer] Checkpoint finished [cpId=5f5b9136-d56e-4c8b-a0ec-b0b3f62694c5, pages=5, markPos=WALPointer [idx=0, fileOff=170827, len=21409], walSegmentsCovered=[], markDuration=19ms, pagesWrite=0ms, fsync=16ms, total=37ms] [21:12:46] : [Step 4/5] [2021-11-19 21:12:46,593][INFO ][sys-#24136%grid-1%][GridCacheProcessor] Stopped cache [cacheName=encrypted] [21:12:46] : [Step 4/5] [2021-11-19 21:12:46,601][INFO ][sys-#24136%grid-1%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=10b2a0df-6371-4882-836b-64b1d160d001, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=3], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=0021223b-d470-4a41-b54f-6489314a0000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345566201, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=2, minorTopVer=3]] [21:12:46] : [Step 4/5] [2021-11-19 21:12:46,601][INFO ][exchange-worker-#24156%grid-1%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=2, minorTopVer=3], force=false, evt=DISCOVERY_CUSTOM_EVT, node=0021223b-d470-4a41-b54f-6489314a0000] [21:12:46] : [Step 4/5] [2021-11-19 21:12:46,601][INFO ][test-runner-#23916%encryption.CacheGroupKeyChangeTest%][root] awaitPartitionMapExchange finished [21:12:46] : [Step 4/5] [2021-11-19 21:12:46,602][INFO ][sys-#24136%grid-1%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=3], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=3], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (6 ms), stage="Update caches registry" (0 ms), stage="Start caches" (0 ms), stage="Affinity initialization on cache group start" (0 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (1 ms), stage="Wait partitions release latch [latch=exchange]" (7 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="After states restored callback" (0 ms), stage="WAL history reservation" (0 ms), stage="Waiting for Full message" (4 ms), stage="Affinity recalculation" (0 ms), stage="Full map updating" (0 ms), stage="Exchange done" (47 ms), stage="Total time" (65 ms)] [21:12:46] : [Step 4/5] [2021-11-19 21:12:46,605][INFO ][sys-#24136%grid-1%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=3], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=3]] [21:12:46] : [Step 4/5] [2021-11-19 21:12:46,606][INFO ][exchange-worker-#24156%grid-1%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=4], crd=false, evt=DISCOVERY_CUSTOM_EVT, evtNode=0021223b-d470-4a41-b54f-6489314a0000, customEvt=DynamicCacheChangeBatch [id=c7afd593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqs=ArrayList [DynamicCacheChangeRequest [cacheName=encrypted, hasCfg=true, nodeId=0021223b-d470-4a41-b54f-6489314a0000, clientStartOnly=false, stop=false, destroy=false, disabledAfterStart=false]], exchangeActions=ExchangeActions [startCaches=[encrypted], stopCaches=null, startGrps=[cacheGroup1], stopGrps=[], resetParts=null, stateChangeRequest=null], startCaches=false], allowMerge=false, exchangeFreeSwitch=false] [21:12:46] : [Step 4/5] [2021-11-19 21:12:46,606][INFO ][exchange-worker-#24033%grid-0%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=4], crd=true, evt=DISCOVERY_CUSTOM_EVT, evtNode=0021223b-d470-4a41-b54f-6489314a0000, customEvt=DynamicCacheChangeBatch [id=c7afd593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqs=ArrayList [DynamicCacheChangeRequest [cacheName=encrypted, hasCfg=true, nodeId=0021223b-d470-4a41-b54f-6489314a0000, clientStartOnly=false, stop=false, destroy=false, disabledAfterStart=false]], exchangeActions=ExchangeActions [startCaches=[encrypted], stopCaches=null, startGrps=[cacheGroup1], stopGrps=[], resetParts=null, stateChangeRequest=null], startCaches=false], allowMerge=false, exchangeFreeSwitch=false] [21:12:46] : [Step 4/5] [2021-11-19 21:12:46,611][INFO ][exchange-worker-#24033%grid-0%][GridCacheProcessor] Started cache [name=encrypted, id=1613773252, group=cacheGroup1, dataRegionName=default, mode=PARTITIONED, atomicity=ATOMIC, backups=0, mvcc=false] [21:12:46] : [Step 4/5] [2021-11-19 21:12:46,611][INFO ][exchange-worker-#24156%grid-1%][GridCacheProcessor] Started cache [name=encrypted, id=1613773252, group=cacheGroup1, dataRegionName=default, mode=PARTITIONED, atomicity=ATOMIC, backups=0, mvcc=false] [21:12:46] : [Step 4/5] [2021-11-19 21:12:46,612][INFO ][exchange-worker-#24033%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=4], waitTime=0ms, futInfo=NA, mode=DISTRIBUTED] [21:12:46] : [Step 4/5] [2021-11-19 21:12:46,612][INFO ][exchange-worker-#24156%grid-1%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=4], waitTime=0ms, futInfo=NA, mode=DISTRIBUTED] [21:12:46] : [Step 4/5] [2021-11-19 21:12:46,614][INFO ][exchange-worker-#24033%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partitions release latch: ServerLatch [permits=0, pendingAcks=HashSet [], super=CompletableLatch [id=CompletableLatchUid [id=exchange, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=4]]]] [21:12:46] : [Step 4/5] [2021-11-19 21:12:46,614][INFO ][exchange-worker-#24033%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=4], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:12:46] : [Step 4/5] [2021-11-19 21:12:46,614][INFO ][exchange-worker-#24156%grid-1%][GridDhtPartitionsExchangeFuture] Finished waiting for partitions release latch: ClientLatch [coordinator=TcpDiscoveryNode [id=0021223b-d470-4a41-b54f-6489314a0000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345566201, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], ackSent=true, super=CompletableLatch [id=CompletableLatchUid [id=exchange, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=4]]]] [21:12:46] : [Step 4/5] [2021-11-19 21:12:46,615][INFO ][exchange-worker-#24033%grid-0%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=4], crd=true] [21:12:46] : [Step 4/5] [2021-11-19 21:12:46,615][INFO ][exchange-worker-#24156%grid-1%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=4], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:12:46] : [Step 4/5] [2021-11-19 21:12:46,617][INFO ][exchange-worker-#24156%grid-1%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=4], crd=false] [21:12:46] : [Step 4/5] [2021-11-19 21:12:46,617][INFO ][sys-#24017%grid-0%][GridDhtPartitionsExchangeFuture] Coordinator received single message [ver=AffinityTopologyVersion [topVer=2, minorTopVer=4], node=10b2a0df-6371-4882-836b-64b1d160d001, allReceived=true] [21:12:46] : [Step 4/5] [2021-11-19 21:12:46,618][INFO ][sys-#24017%grid-0%][GridDhtPartitionsExchangeFuture] finishExchangeOnCoordinator [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=4], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=4]] [21:12:46] : [Step 4/5] [2021-11-19 21:12:46,621][INFO ][sys-#24017%grid-0%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=4], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=4], err=null, rebalanced=true, wasRebalanced=true] [21:12:46] : [Step 4/5] [2021-11-19 21:12:46,621][INFO ][sys-#24125%grid-1%][GridDhtPartitionsExchangeFuture] Received full message, will finish exchange [node=0021223b-d470-4a41-b54f-6489314a0000, resVer=AffinityTopologyVersion [topVer=2, minorTopVer=4]] [21:12:46] : [Step 4/5] [2021-11-19 21:12:46,623][INFO ][sys-#24125%grid-1%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=4], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=4], err=null, rebalanced=true, wasRebalanced=true] [21:12:46] : [Step 4/5] [2021-11-19 21:12:46,623][INFO ][sys-#24017%grid-0%][GridCacheProcessor] Finish proxy initialization, cacheName=encrypted, localNodeId=0021223b-d470-4a41-b54f-6489314a0000 [21:12:46] : [Step 4/5] [2021-11-19 21:12:46,623][INFO ][sys-#24125%grid-1%][GridCacheProcessor] Finish proxy initialization, cacheName=encrypted, localNodeId=10b2a0df-6371-4882-836b-64b1d160d001 [21:12:46] : [Step 4/5] [2021-11-19 21:12:46,624][INFO ][exchange-worker-#24033%grid-0%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=2, minorTopVer=4], force=false, evt=DISCOVERY_CUSTOM_EVT, node=0021223b-d470-4a41-b54f-6489314a0000] [21:12:46] : [Step 4/5] [2021-11-19 21:12:46,623][INFO ][sys-#24017%grid-0%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=0021223b-d470-4a41-b54f-6489314a0000, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=4], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=0021223b-d470-4a41-b54f-6489314a0000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345566596, loc=true, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=2, minorTopVer=4]] [21:12:46] : [Step 4/5] [2021-11-19 21:12:46,624][INFO ][exchange-worker-#24156%grid-1%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=2, minorTopVer=4], force=false, evt=DISCOVERY_CUSTOM_EVT, node=0021223b-d470-4a41-b54f-6489314a0000] [21:12:46] : [Step 4/5] [2021-11-19 21:12:46,624][INFO ][test-runner-#23916%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Failed to wait proxy initialization, cache=encrypted, localNodeId=10b2a0df-6371-4882-836b-64b1d160d001 [21:12:46] : [Step 4/5] [2021-11-19 21:12:46,624][INFO ][sys-#24125%grid-1%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=10b2a0df-6371-4882-836b-64b1d160d001, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=4], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=0021223b-d470-4a41-b54f-6489314a0000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345566201, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=2, minorTopVer=4]] [21:12:46] : [Step 4/5] [2021-11-19 21:12:46,625][INFO ][sys-#24017%grid-0%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=4], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=4], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (2 ms), stage="Update caches registry" (0 ms), stage="Start caches" (3 ms), stage="Affinity initialization on cache group start" (0 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Wait partitions release latch [latch=exchange]" (1 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Restore partition states" (0 ms), stage="After states restored callback" (0 ms), stage="WAL history reservation" (0 ms), stage="Waiting for all single messages" (2 ms), stage="Affinity recalculation (crd)" (0 ms), stage="Collect update counters and create affinity messages" (0 ms), stage="Assign partitions states" (0 ms), stage="Validate partitions states" (0 ms), stage="Apply update counters" (0 ms), stage="Full message preparing" (1 ms), stage="Full message sending" (0 ms), stage="Exchange done" (4 ms), stage="Total time" (13 ms)] [21:12:46] : [Step 4/5] [2021-11-19 21:12:46,627][INFO ][sys-#24125%grid-1%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=4], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=4], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (1 ms), stage="Update caches registry" (0 ms), stage="Start caches" (4 ms), stage="Affinity initialization on cache group start" (0 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Wait partitions release latch [latch=exchange]" (2 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Restore partition states" (0 ms), stage="After states restored callback" (0 ms), stage="WAL history reservation" (0 ms), stage="Waiting for Full message" (5 ms), stage="Affinity recalculation" (0 ms), stage="Full map updating" (0 ms), stage="Exchange done" (4 ms), stage="Total time" (16 ms)] [21:12:46] : [Step 4/5] [2021-11-19 21:12:46,629][INFO ][sys-#24017%grid-0%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=4], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=4], stage="Affinity initialization on cache group start [grp=cacheGroup1]" (0 ms) (parent=Affinity initialization on cache group start), stage="Restore partition states [grp=ignite-sys-cache]" (0 ms) (parent=Restore partition states), stage="Restore partition states [grp=cacheGroup1]" (0 ms) (parent=Restore partition states)] [21:12:46] : [Step 4/5] [2021-11-19 21:12:46,631][INFO ][sys-#24125%grid-1%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=4], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=4], stage="Affinity initialization on cache group start [grp=cacheGroup1]" (0 ms) (parent=Affinity initialization on cache group start), stage="Restore partition states [grp=ignite-sys-cache]" (0 ms) (parent=Restore partition states), stage="Restore partition states [grp=cacheGroup1]" (0 ms) (parent=Restore partition states)] [21:12:46] : [Step 4/5] [2021-11-19 21:12:46,672][INFO ][test-runner-#23916%encryption.CacheGroupKeyChangeTest%][root] Caught expected exception: Cache group key change was rejected. Cache or group "encrypted" is a part of group "cacheGroup1". Provide group name instead of cache name for shared groups. [21:12:46] : [Step 4/5] [21:12:46] >>> Stopping test: CacheGroupKeyChangeTest#testWrongCacheGroupSpecified in 1112 ms <<< [21:12:46] : [Step 4/5] [2021-11-19 21:12:46,673][INFO ][main][root] >>> Stopping test: CacheGroupKeyChangeTest#testWrongCacheGroupSpecified in 1112 ms <<< [21:12:46] : [Step 4/5] [21:12:46] >>> Heap: 619 MB used / 1941 MB commited / 1941 MB max <<< [21:12:46] : [Step 4/5] [2021-11-19 21:12:46,674][INFO ][main][root] >>> Heap: 619 MB used / 1941 MB commited / 1941 MB max <<< [21:12:46] : [Step 4/5] [21:12:46] >>> Non-Heap: 168 MB used / 188 MB commited / 0 MB max <<< [21:12:46] : [Step 4/5] [2021-11-19 21:12:46,674][INFO ][main][root] >>> Non-Heap: 168 MB used / 188 MB commited / 0 MB max <<< [21:12:46] : [Step 4/5] [2021-11-19 21:12:46,674][INFO ][main][root] >>> Stopping grid [name=grid-1, id=10b2a0df-6371-4882-836b-64b1d160d001] [21:12:46] : [Step 4/5] [2021-11-19 21:12:46,684][INFO ][db-checkpoint-thread-#24172%grid-1%][Checkpointer] Checkpoint started [checkpointId=2a1561a5-237f-47b0-a10f-976cfaa68853, startPtr=WALPointer [idx=0, fileOff=305640, len=2048], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=1ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=1ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=0ms, pages=65, reason='timeout'] [21:12:46] : [Step 4/5] [2021-11-19 21:12:46,690][INFO ][tcp-disco-sock-reader-[0021223b 127.0.0.1:52951]-#1268%grid-1%-#24152%grid-1%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:52951, rmtPort=52951, rmtNodeId=0021223b-d470-4a41-b54f-6489314a0000] [21:12:46] : [Step 4/5] [2021-11-19 21:12:46,691][INFO ][disco-event-worker-#24032%grid-0%][GridDiscoveryManager] Node left topology: TcpDiscoveryNode [id=10b2a0df-6371-4882-836b-64b1d160d001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637345566180, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false] [21:12:46] : [Step 4/5] [2021-11-19 21:12:46,692][INFO ][main][GridCacheProcessor] Stopped cache [cacheName=ignite-sys-cache] [21:12:46] : [Step 4/5] [2021-11-19 21:12:46,693][INFO ][main][GridCacheProcessor] Stopped cache [cacheName=encrypted, group=cacheGroup1] [21:12:46] : [Step 4/5] [2021-11-19 21:12:46,693][INFO ][disco-event-worker-#24032%grid-0%][GridDiscoveryManager] Topology snapshot [ver=3, locNode=0021223b, servers=1, clients=0, state=ACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=0021223b-d470-4a41-b54f-6489314a0000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:12:46] : [Step 4/5] [2021-11-19 21:12:46,693][INFO ][disco-event-worker-#24032%grid-0%][GridDiscoveryManager] ^-- Baseline [id=0, size=2, online=1, offline=1] [21:12:46]W: [org.apache.ignite:ignite-core] [2021-11-19 21:12:46,695][WARN ][grid-nio-worker-tcp-comm-0-#23971%TestRecordingCommunicationSpi%][TestRecordingCommunicationSpi] Failed to shutdown socket [21:12:46]W: [org.apache.ignite:ignite-core] java.nio.channels.ClosedChannelException [21:12:46]W: [org.apache.ignite:ignite-core] at sun.nio.ch.SocketChannelImpl.shutdownOutput(SocketChannelImpl.java:795) [21:12:46]W: [org.apache.ignite:ignite-core] at sun.nio.ch.SocketAdaptor.shutdownOutput(SocketAdaptor.java:407) [21:12:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.close(IgniteUtils.java:4247) [21:12:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.closeKey(GridNioServer.java:2784) [21:12:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.close(GridNioServer.java:2835) [21:12:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.close(GridNioServer.java:2794) [21:12:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.bodyInternal(GridNioServer.java:2157) [21:12:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.body(GridNioServer.java:1910) [21:12:46]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:125) [21:12:46]W: [org.apache.ignite:ignite-core] at java.lang.Thread.run(Thread.java:748) [21:12:46] : [Step 4/5] [2021-11-19 21:12:46,696][INFO ][exchange-worker-#24033%grid-0%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], crd=true, evt=NODE_LEFT, evtNode=10b2a0df-6371-4882-836b-64b1d160d001, customEvt=null, allowMerge=false, exchangeFreeSwitch=true] [21:12:46] : [Step 4/5] [2021-11-19 21:12:46,698][INFO ][exchange-worker-#24033%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:12:46] : [Step 4/5] [2021-11-19 21:12:46,699][INFO ][exchange-worker-#24033%grid-0%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], err=null, rebalanced=true, wasRebalanced=true] [21:12:46]W: [org.apache.ignite:ignite-core] [2021-11-19 21:12:46,700][WARN ][exchange-worker-#24033%grid-0%][GridDhtPartitionTopologyImpl] Detected lost partitions [grp=cacheGroup1, parts=[0, 2, 4, 6-7], topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0]] [21:12:46] : [Step 4/5] [2021-11-19 21:12:46,700][INFO ][exchange-worker-#24033%grid-0%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=0021223b-d470-4a41-b54f-6489314a0000, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], evt=NODE_LEFT, evtNode=TcpDiscoveryNode [id=10b2a0df-6371-4882-836b-64b1d160d001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637345566180, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0]] [21:12:46] : [Step 4/5] [2021-11-19 21:12:46,701][INFO ][exchange-worker-#24033%grid-0%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (1 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="After states restored callback" (0 ms), stage="WAL history reservation" (0 ms), stage="Finalize update counters" (0 ms), stage="Detect lost partitions" (1 ms), stage="Exchange done" (1 ms), stage="Total time" (3 ms)] [21:12:46] : [Step 4/5] [2021-11-19 21:12:46,702][INFO ][exchange-worker-#24033%grid-0%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], stage="Affinity initialization (exchange-free switch on fully-rebalanced topology) [grp=ignite-sys-cache]" (0 ms) (parent=Determine exchange type), stage="Affinity initialization (exchange-free switch on fully-rebalanced topology) [grp=cacheGroup1]" (0 ms) (parent=Determine exchange type)] [21:12:46] : [Step 4/5] [2021-11-19 21:12:46,703][INFO ][exchange-worker-#24033%grid-0%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], crd=true] [21:12:46] : [Step 4/5] [2021-11-19 21:12:46,704][INFO ][exchange-worker-#24033%grid-0%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=3, minorTopVer=0], force=false, evt=NODE_LEFT, node=10b2a0df-6371-4882-836b-64b1d160d001] [21:12:47] : [Step 4/5] [2021-11-19 21:12:47,156][INFO ][main][FilePageStoreManager] Cleanup cache stores [total=4, left=0, cleanFiles=false] [21:12:47] : [Step 4/5] [2021-11-19 21:12:47,159][INFO ][main][GridDeploymentLocalStore] Removed undeployed class: GridDeployment [ts=1637345566293, depMode=SHARED, clsLdr=IsolatedClassLoader{roleName='test'}, clsLdrId=94afd593d71-10b2a0df-6371-4882-836b-64b1d160d001, userVer=0, loc=true, sampleClsName=org.apache.ignite.internal.processors.cache.distributed.dht.preloader.IgniteDhtPartitionHistorySuppliersMap, pendingUndeploy=false, undeployed=true, usage=0] [21:12:47] : [Step 4/5] [2021-11-19 21:12:47,165][INFO ][main][IgniteKernal%grid-1] [21:12:47] : [Step 4/5] [21:12:47] : [Step 4/5] >>> +------------------------------------------------------+ [21:12:47] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV stopped OK [21:12:47] : [Step 4/5] >>> +------------------------------------------------------+ [21:12:47] : [Step 4/5] >>> Ignite instance name: grid-1 [21:12:47] : [Step 4/5] >>> Grid uptime: 00:00:00.929 [21:12:47] : [Step 4/5] [21:12:47] : [Step 4/5] [21:12:47] : [Step 4/5] [2021-11-19 21:12:47,166][INFO ][main][root] >>> Stopping grid [name=grid-0, id=0021223b-d470-4a41-b54f-6489314a0000] [21:12:47] : [Step 4/5] [2021-11-19 21:12:47,173][INFO ][db-checkpoint-thread-#24167%grid-0%][Checkpointer] Checkpoint started [checkpointId=5709d9d0-9e9d-43e8-af81-739c269eac78, startPtr=WALPointer [idx=0, fileOff=269337, len=2010], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=1ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=0ms, pages=43, reason='timeout'] [21:12:47]W: [org.apache.ignite:ignite-core] [2021-11-19 21:12:47,176][WARN ][tcp-disco-sock-reader-[10b2a0df 127.0.0.1:41261]-#1269%grid-0%-#24153%grid-0%][TestTcpDiscoverySpi] Failed to shutdown socket [21:12:47]W: [org.apache.ignite:ignite-core] java.net.SocketException: Socket is closed [21:12:47]W: [org.apache.ignite:ignite-core] at java.net.Socket.shutdownOutput(Socket.java:1568) [21:12:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.close(IgniteUtils.java:4247) [21:12:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.discovery.tcp.ServerImpl$SocketReader.body(ServerImpl.java:7370) [21:12:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.IgniteSpiThread.run(IgniteSpiThread.java:58) [21:12:47] : [Step 4/5] [2021-11-19 21:12:47,177][INFO ][tcp-disco-sock-reader-[10b2a0df 127.0.0.1:41261]-#1269%grid-0%-#24153%grid-0%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:41261, rmtPort=41261, rmtNodeId=10b2a0df-6371-4882-836b-64b1d160d001] [21:12:47] : [Step 4/5] [2021-11-19 21:12:47,178][INFO ][main][GridCacheProcessor] Stopped cache [cacheName=ignite-sys-cache] [21:12:47] : [Step 4/5] [2021-11-19 21:12:47,178][INFO ][main][GridCacheProcessor] Stopped cache [cacheName=encrypted, group=cacheGroup1] [21:12:47] : [Step 4/5] [2021-11-19 21:12:47,214][INFO ][main][FilePageStoreManager] Cleanup cache stores [total=4, left=0, cleanFiles=false] [21:12:47] : [Step 4/5] [2021-11-19 21:12:47,216][INFO ][main][GridDeploymentLocalStore] Removed undeployed class: GridDeployment [ts=1637345566283, depMode=SHARED, clsLdr=IsolatedClassLoader{roleName='test'}, clsLdrId=74afd593d71-0021223b-d470-4a41-b54f-6489314a0000, userVer=0, loc=true, sampleClsName=org.apache.ignite.internal.processors.cache.distributed.dht.preloader.GridDhtPartitionMap, pendingUndeploy=false, undeployed=true, usage=0] [21:12:47] : [Step 4/5] [2021-11-19 21:12:47,222][INFO ][main][IgniteKernal%grid-0] [21:12:47] : [Step 4/5] [21:12:47] : [Step 4/5] >>> +------------------------------------------------------+ [21:12:47] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV stopped OK [21:12:47] : [Step 4/5] >>> +------------------------------------------------------+ [21:12:47] : [Step 4/5] >>> Ignite instance name: grid-0 [21:12:47] : [Step 4/5] >>> Grid uptime: 00:00:01.343 [21:12:47] : [Step 4/5] [21:12:47] : [Step 4/5] [21:12:47] : [Step 4/5] [21:12:47] >>> Starting test: CacheGroupKeyChangeTest#testKeyIdentifierOverflow <<< [21:12:47] : [Step 4/5] [2021-11-19 21:12:47,236][INFO ][main][root] >>> Starting test: CacheGroupKeyChangeTest#testKeyIdentifierOverflow <<< [21:12:47] : [Step 4/5] [21:12:47] >>> Heap: 622 MB used / 1941 MB commited / 1941 MB max <<< [21:12:47] : [Step 4/5] [2021-11-19 21:12:47,236][INFO ][main][root] >>> Heap: 622 MB used / 1941 MB commited / 1941 MB max <<< [21:12:47] : [Step 4/5] [21:12:47] >>> Non-Heap: 168 MB used / 188 MB commited / 0 MB max <<< [21:12:47] : [Step 4/5] [2021-11-19 21:12:47,237][INFO ][main][root] >>> Non-Heap: 168 MB used / 188 MB commited / 0 MB max <<< [21:12:47]W: [org.apache.ignite:ignite-core] [2021-11-19 21:12:47,243][WARN ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][G] Ignite work directory is not provided, automatically resolved to: /opt/buildagent/work/7bc1c54bc719b67c/work [21:12:47] : [Step 4/5] [2021-11-19 21:12:47,245][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] [21:12:47] : [Step 4/5] [21:12:47] : [Step 4/5] >>> __________ ________________ [21:12:47] : [Step 4/5] >>> / _/ ___/ |/ / _/_ __/ __/ [21:12:47] : [Step 4/5] >>> _/ // (7 7 // / / / / _/ [21:12:47] : [Step 4/5] >>> /___/\___/_/|_/___/ /_/ /___/ [21:12:47] : [Step 4/5] >>> [21:12:47] : [Step 4/5] >>> ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:12:47] : [Step 4/5] >>> 2021 Copyright(C) Apache Software Foundation [21:12:47] : [Step 4/5] >>> [21:12:47] : [Step 4/5] >>> Ignite documentation: http://ignite.apache.org [21:12:47] : [Step 4/5] [21:12:47] : [Step 4/5] [2021-11-19 21:12:47,246][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] Config URL: n/a [21:12:47] : [Step 4/5] [2021-11-19 21:12:47,247][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] IgniteConfiguration [igniteInstanceName=grid-0, pubPoolSize=24, svcPoolSize=24, callbackPoolSize=24, stripedPoolSize=24, sysPoolSize=24, mgmtPoolSize=4, dataStreamerPoolSize=24, utilityCachePoolSize=24, utilityCacheKeepAliveTime=60000, p2pPoolSize=2, qryPoolSize=24, buildIdxPoolSize=4, igniteHome=/opt/buildagent/work/7bc1c54bc719b67c, igniteWorkDir=/opt/buildagent/work/7bc1c54bc719b67c/work, mbeanSrv=com.sun.jmx.mbeanserver.JmxMBeanServer@6fe85038, nodeId=00cce8f9-a2b3-4d32-a95a-7f6eb6335000, marsh=BinaryMarshaller [], marshLocJobs=false, daemon=false, p2pEnabled=true, netTimeout=10000, netCompressionLevel=1, sndRetryDelay=1000, sndRetryCnt=3, metricsHistSize=10000, metricsUpdateFreq=1000, metricsExpTime=9223372036854775807, discoSpi=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=0, ackTimeout=0, marsh=null, reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], segPlc=STOP, segResolveAttempts=2, waitForSegOnStart=true, allResolversPassReq=true, segChkFreq=10000, commSpi=TcpCommunicationSpi [connectGate=org.apache.ignite.spi.communication.tcp.internal.ConnectGateway@219cdaf3, ctxInitLatch=java.util.concurrent.CountDownLatch@1391b0a3[Count = 1], stopping=false, clientPool=null, nioSrvWrapper=null, stateProvider=null], evtSpi=MemoryEventStorageSpi [expireAgeMs=9223372036854775807, expireCnt=10000, filter=null], colSpi=NoopCollisionSpi [], deploySpi=LocalDeploymentSpi [], indexingSpi=org.apache.ignite.spi.indexing.noop.NoopIndexingSpi@82e3975, addrRslvr=null, encryptionSpi=org.apache.ignite.spi.encryption.keystore.KeystoreEncryptionSpi@120133c4, tracingSpi=org.apache.ignite.spi.tracing.NoopTracingSpi@79dccde, clientMode=false, rebalanceThreadPoolSize=4, rebalanceTimeout=10000, rebalanceBatchesPrefetchCnt=3, rebalanceThrottle=0, rebalanceBatchSize=524288, txCfg=TransactionConfiguration [txSerEnabled=false, dfltIsolation=REPEATABLE_READ, dfltConcurrency=PESSIMISTIC, dfltTxTimeout=0, txTimeoutOnPartitionMapExchange=0, deadlockTimeout=10000, pessimisticTxLogSize=0, pessimisticTxLogLinger=10000, tmLookupClsName=null, txManagerFactory=null, useJtaSync=false], cacheSanityCheckEnabled=true, discoStartupDelay=60000, deployMode=SHARED, p2pMissedCacheSize=100, locHost=127.0.0.1, timeSrvPortBase=31100, timeSrvPortRange=100, failureDetectionTimeout=10000, sysWorkerBlockedTimeout=null, clientFailureDetectionTimeout=10000, metricsLogFreq=0, connectorCfg=null, odbcCfg=null, warmupClos=null, atomicCfg=AtomicConfiguration [seqReserveSize=1000, cacheMode=PARTITIONED, backups=1, aff=null, grpName=null], classLdr=null, sslCtxFactory=null, platformCfg=null, binaryCfg=null, memCfg=null, pstCfg=null, dsCfg=DataStorageConfiguration [sysRegionInitSize=41943040, sysRegionMaxSize=104857600, pageSize=4096, concLvl=0, dfltDataRegConf=DataRegionConfiguration [name=default, maxSize=104857600, initSize=268435456, swapPath=null, pageEvictionMode=DISABLED, pageReplacementMode=CLOCK, evictionThreshold=0.9, emptyPagesPoolSize=100, metricsEnabled=false, metricsSubIntervalCount=5, metricsRateTimeInterval=60000, persistenceEnabled=true, checkpointPageBufSize=0, lazyMemoryAllocation=true, warmUpCfg=null], dataRegions=null, storagePath=null, checkpointFreq=30000, lockWaitTime=10000, checkpointThreads=4, checkpointWriteOrder=SEQUENTIAL, walHistSize=20, maxWalArchiveSize=20971520, walSegments=10, walSegmentSize=1048576, walPath=db/wal, walArchivePath=db/wal/archive, cdcWalPath=db/wal/cdc, cdcEnabled=false, metricsEnabled=false, walMode=LOG_ONLY, walTlbSize=131072, walBuffSize=0, walFlushFreq=2000, walFsyncDelay=1000, walRecordIterBuffSize=67108864, alwaysWriteFullPages=false, fileIOFactory=org.apache.ignite.internal.processors.cache.persistence.file.AsyncFileIOFactory@40ca1e3, metricsSubIntervalCnt=5, metricsRateTimeInterval=60000, walAutoArchiveAfterInactivity=-1, walForceArchiveTimeout=-1, writeThrottlingEnabled=false, walCompactionEnabled=false, walCompactionLevel=1, checkpointReadLockTimeout=null, walPageCompression=DISABLED, walPageCompressionLevel=null, dfltWarmUpCfg=null, encCfg=org.apache.ignite.configuration.EncryptionConfiguration@5b2d5fa5, defragmentationThreadPoolSize=4, minWalArchiveSize=-1], snapshotPath=snapshots, activeOnStart=true, activeOnStartPropSetFlag=false, autoActivation=true, autoActivationPropSetFlag=false, clusterStateOnStart=null, sqlConnCfg=null, cliConnCfg=ClientConnectorConfiguration [host=null, port=10800, portRange=100, sockSndBufSize=0, sockRcvBufSize=0, tcpNoDelay=true, maxOpenCursorsPerConn=128, threadPoolSize=24, selectorCnt=12, idleTimeout=0, handshakeTimeout=10000, jdbcEnabled=true, odbcEnabled=true, thinCliEnabled=true, sslEnabled=false, useIgniteSslCtxFactory=true, sslClientAuth=false, sslCtxFactory=null, thinCliCfg=ThinClientConfiguration [maxActiveTxPerConn=100, maxActiveComputeTasksPerConn=0]], mvccVacuumThreadCnt=2, mvccVacuumFreq=5000, authEnabled=false, failureHnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]], commFailureRslvr=null, sqlCfg=SqlConfiguration [longQryWarnTimeout=3000, dfltQryTimeout=0, sqlQryHistSize=1000, validationEnabled=false], asyncContinuationExecutor=null] [21:12:47] : [Step 4/5] [2021-11-19 21:12:47,255][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] Daemon mode: off [21:12:47] : [Step 4/5] [2021-11-19 21:12:47,255][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] OS: Linux 4.15.0-151-generic amd64 [21:12:47] : [Step 4/5] [2021-11-19 21:12:47,256][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] OS user: teamcity [21:12:47] : [Step 4/5] [2021-11-19 21:12:47,256][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] PID: 16724 [21:12:47] : [Step 4/5] [2021-11-19 21:12:47,256][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] Language runtime: Java Platform API Specification ver. 1.8 [21:12:47] : [Step 4/5] [2021-11-19 21:12:47,257][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] VM information: Java(TM) SE Runtime Environment 1.8.0_261-b12 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 25.261-b12 [21:12:47] : [Step 4/5] [2021-11-19 21:12:47,257][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] VM total memory: 1.9GB [21:12:47] : [Step 4/5] [2021-11-19 21:12:47,257][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] Remote Management [restart: off, REST: off, JMX (remote: off)] [21:12:47] : [Step 4/5] [2021-11-19 21:12:47,258][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] Logger: GridTestLog4jLogger [quiet=false, config=null] [21:12:47] : [Step 4/5] [2021-11-19 21:12:47,258][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] IGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c [21:12:47] : [Step 4/5] [2021-11-19 21:12:47,258][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] VM arguments: [-DIGNITE_DUMP_THREADS_ON_FAILURE=false, -DMono=/usr/bin/mono-sgen, -DMono4.0_x64=/usr/lib/mono/4.0, -DMono4.5_x64=/usr/lib/mono/4.5, -DMonoVersion=6.12.0.90, -DSKIP_BUILD=false, -Dagent.home.dir=/opt/buildagent, -Dagent.name=aitc-lin02_03, -Dagent.ownPort=9090, -Dagent.work.dir=/opt/buildagent/work, -Dbuild.number=95, -Dbuild.vcs.number=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.1=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.GitHubApacheIgnite=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dclassworlds.conf=/opt/buildagent/temp/buildTmp/teamcity.m2.conf, -Dcom.jetbrains.maven.watcher.report.file=/opt/buildagent/temp/buildTmp/maven-build-info.xml, -Djava.io.tmpdir=/opt/buildagent/temp/buildTmp, -Dmaven.home=/opt/buildagent/tools/maven3_6, -Dmaven.multiModuleProjectDirectory=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.agent.cpuBenchmark=457, -Dteamcity.agent.dotnet.agent_url=http://localhost:9090/RPC2, -Dteamcity.agent.dotnet.build_id=6278078, -Dteamcity.auth.password=*******, -Dteamcity.auth.userId=TeamCityBuildId=6278078, -Dteamcity.build.changedFiles.file=/opt/buildagent/temp/buildTmp/changedFiles6342607772318147725.txt, -Dteamcity.build.checkoutDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.build.id=6278078, -Dteamcity.build.properties.file=/opt/buildagent/temp/buildTmp/teamcity.build5164517880467851002.properties, -Dteamcity.build.tempDir=/opt/buildagent/temp/buildTmp, -Dteamcity.build.workingDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.buildConfName=Basic 3, -Dteamcity.buildType.id=IgniteTests24Java8_Basic3, -Dteamcity.configuration.properties.file=/opt/buildagent/temp/buildTmp/teamcity.config5591980786735343870.properties, -Dteamcity.maven.userSettings.path=/opt/buildagent/temp/buildTmp/maven_settings_585072866407032347.xml, -Dteamcity.maven.watcher.home=/opt/buildagent/plugins/mavenPlugin/maven-watcher-jdk16, -Dteamcity.projectName=Ignite Tests 2.x (JDK 8/11), -Dteamcity.runner.properties.file=/opt/buildagent/temp/buildTmp/teamcity.runner9098465561618137420.properties, -Dteamcity.tests.recentlyFailedTests.file=/opt/buildagent/temp/buildTmp/testsToRunFirst3891775683130404069.txt, -Dteamcity.version=2021.2 (build 99542), -ea, -Xms2g, -Xmx2g, -XX:+HeapDumpOnOutOfMemoryError, -DIGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_TEST_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_UPDATE_NOTIFIER=false, -DIGNITE_NO_DISCO_ORDER=true, -DIGNITE_PERFORMANCE_SUGGESTIONS_DISABLED=true, -Djava.net.preferIPv4Stack=true, -DTEST_SCALE_FACTOR=1.0, -DIGNITE_TEST_PROP_LOG4J_FILE=log4j-tc-test.xml, -DIGNITE_QUIET=false, -DIGNITE_MARSHAL_BUFFERS_RECHECK=1000, -Dmaven.repo.local=/opt/buildagent/.m2/repository] [21:12:47] : [Step 4/5] [2021-11-19 21:12:47,262][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] System cache's DataRegion size is configured to 40 MB. Use DataStorageConfiguration.systemRegionInitialSize property to change the setting. [21:12:47] : [Step 4/5] [2021-11-19 21:12:47,263][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] Configured caches [in 'sysMemPlc' dataRegion: ['ignite-sys-cache']] [21:12:47]W: [org.apache.ignite:ignite-core] [2021-11-19 21:12:47,263][WARN ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] Peer class loading is enabled (disable it in production for performance and deployment consistency reasons) [21:12:47] : [Step 4/5] [2021-11-19 21:12:47,263][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] 3-rd party licenses can be found at: /opt/buildagent/work/7bc1c54bc719b67c/libs/licenses [21:12:47] : [Step 4/5] [2021-11-19 21:12:47,267][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] Configured plugins: [21:12:47] : [Step 4/5] [2021-11-19 21:12:47,267][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- StanByClusterTestProvider 1.0 [21:12:47] : [Step 4/5] [2021-11-19 21:12:47,267][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:12:47] : [Step 4/5] [2021-11-19 21:12:47,268][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] [21:12:47] : [Step 4/5] [2021-11-19 21:12:47,268][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- PageMemory tracker plugin 1.0 [21:12:47] : [Step 4/5] [2021-11-19 21:12:47,268][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:12:47] : [Step 4/5] [2021-11-19 21:12:47,268][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] [21:12:47] : [Step 4/5] [2021-11-19 21:12:47,268][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- TestDistibutedConfigurationPlugin 1.0 [21:12:47] : [Step 4/5] [2021-11-19 21:12:47,269][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:12:47] : [Step 4/5] [2021-11-19 21:12:47,269][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] [21:12:47] : [Step 4/5] [2021-11-19 21:12:47,269][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- NodeValidationPluginProvider 1.0 [21:12:47] : [Step 4/5] [2021-11-19 21:12:47,269][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:12:47] : [Step 4/5] [2021-11-19 21:12:47,269][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] [21:12:47] : [Step 4/5] [2021-11-19 21:12:47,270][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][FailureProcessor] Configured failure handler: [hnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]]] [21:12:47] : [Step 4/5] [2021-11-19 21:12:47,284][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][TestRecordingCommunicationSpi] Successfully bound communication NIO server to TCP port [port=47100, locHost=/127.0.0.1, selectorsCnt=12, selectorSpins=0, pairedConn=false] [21:12:47]W: [org.apache.ignite:ignite-core] [2021-11-19 21:12:47,285][WARN ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][TestRecordingCommunicationSpi] Message queue limit is set to 0 which may lead to potential OOMEs when running cache operations in FULL_ASYNC or PRIMARY_SYNC modes due to message queues growth on sender and receiver sides. [21:12:47] : [Step 4/5] [2021-11-19 21:12:47,289][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][GridCollisionManager] Collision resolution is disabled (all jobs will be activated upon arrival). [21:12:47] : [Step 4/5] [2021-11-19 21:12:47,289][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] Security status [authentication=off, sandbox=off, tls/ssl=off] [21:12:47] : [Step 4/5] [2021-11-19 21:12:47,352][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:12:47] : [Step 4/5] [2021-11-19 21:12:47,444][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][MaintenanceProcessor] Resolved store directory for node persistent data: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0 [21:12:47] : [Step 4/5] [2021-11-19 21:12:47,446][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][CacheObjectBinaryProcessorImpl] Resolved directory for serialized binary metadata: /opt/buildagent/work/7bc1c54bc719b67c/work/db/binary_meta/grid_0 [21:12:47] : [Step 4/5] [2021-11-19 21:12:47,451][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0 [21:12:47] : [Step 4/5] [2021-11-19 21:12:47,451][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][FileWriteAheadLogManager] Resolved write ahead log work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0 [21:12:47] : [Step 4/5] [2021-11-19 21:12:47,452][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][FileWriteAheadLogManager] Resolved write ahead log archive directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0 [21:12:47] : [Step 4/5] [2021-11-19 21:12:47,612][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000000.wal [21:12:47] : [Step 4/5] [2021-11-19 21:12:47,613][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][FileHandleManagerImpl] Initialized write-ahead log manager [mode=LOG_ONLY] [21:12:47]W: [org.apache.ignite:ignite-core] [2021-11-19 21:12:47,613][WARN ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] DataRegion maxSize=104.9 MB is smaller than defaultInitialSize=268.4 MB, setting initialSize to 104.9 MB [21:12:47] : [Step 4/5] [2021-11-19 21:12:47,619][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Configured data regions initialized successfully [total=5] [21:12:47] : [Step 4/5] [2021-11-19 21:12:47,621][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][IgniteSnapshotManager] Resolved snapshot work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/snapshots [21:12:47] : [Step 4/5] [2021-11-19 21:12:47,622][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][IgniteSnapshotManager] Resolved temp directory for snapshot creation: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0/snp [21:12:47] : [Step 4/5] [2021-11-19 21:12:47,625][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][ClientListenerProcessor] Client connector processor has started on TCP port 10800 [21:12:47] : [Step 4/5] [2021-11-19 21:12:47,631][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] Non-loopback local IPs: 172.17.0.4 [21:12:47] : [Step 4/5] [2021-11-19 21:12:47,632][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] Enabled local MACs: 0242AC110004 [21:12:47] : [Step 4/5] [2021-11-19 21:12:47,635][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:12:47] : [Step 4/5] [2021-11-19 21:12:47,636][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:12:47] : [Step 4/5] [2021-11-19 21:12:47,636][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:12:47] : [Step 4/5] [2021-11-19 21:12:47,639][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Applying lost metastore updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:12:47] : [Step 4/5] [2021-11-19 21:12:47,640][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=0 ms] [21:12:47] : [Step 4/5] [2021-11-19 21:12:47,640][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Restoring partition state for local groups. [21:12:47] : [Step 4/5] [2021-11-19 21:12:47,641][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=0, partitionsProcessed=0, time=0ms] [21:12:47] : [Step 4/5] [2021-11-19 21:12:47,641][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][GridEncryptionManager] Encryption keys loaded from metastore. [grps=, masterKeyName=ignite.master.key] [21:12:47] : [Step 4/5] [2021-11-19 21:12:47,648][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][ClusterProcessor] Cluster ID and tag has been read from metastorage: null [21:12:47] : [Step 4/5] [2021-11-19 21:12:47,648][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][IgniteClusterImpl] Shutdown policy was updated [oldVal=null, newVal=null] [21:12:47] : [Step 4/5] [2021-11-19 21:12:47,649][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Checkpoint frequency deviation changed [oldVal=null, newVal=null] [21:12:47] : [Step 4/5] [2021-11-19 21:12:47,659][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][FilePageStoreManager] Cleanup cache stores [total=1, left=0, cleanFiles=false] [21:12:47] : [Step 4/5] [2021-11-19 21:12:47,661][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:12:47] : [Step 4/5] [2021-11-19 21:12:47,663][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:12:47] : [Step 4/5] [2021-11-19 21:12:47,664][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:12:47] : [Step 4/5] [2021-11-19 21:12:47,664][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Data Regions Started: 5 [21:12:47] : [Step 4/5] [2021-11-19 21:12:47,665][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] ^-- sysMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:12:47] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:12:47] : [Step 4/5] ^-- default region [type=default, persistence=true, lazyAlloc=true, [21:12:47] : [Step 4/5] ... initCfg=100MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB, allocTotal=0MB] [21:12:47] : [Step 4/5] ^-- metastoreMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:12:47] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:12:47] : [Step 4/5] ^-- TxLog region [type=internal, persistence=true, lazyAlloc=false, [21:12:47] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:12:47] : [Step 4/5] ^-- volatileDsMemPlc region [type=user, persistence=false, lazyAlloc=true, [21:12:47] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB] [21:12:47] : [Step 4/5] ^-- Ignite persistence [used=0MB] [21:12:47] : [Step 4/5] [21:12:47] : [Step 4/5] [2021-11-19 21:12:47,667][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Starting binary memory restore for: [-2100569601] [21:12:47] : [Step 4/5] [2021-11-19 21:12:47,678][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:12:47] : [Step 4/5] [2021-11-19 21:12:47,679][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:12:47] : [Step 4/5] [2021-11-19 21:12:47,684][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000000.wal, offset=0, ver=2] [21:12:47] : [Step 4/5] [2021-11-19 21:12:47,687][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Started cache in recovery mode [name=ignite-sys-cache, id=-2100569601, dataRegionName=sysMemPlc, mode=REPLICATED, atomicity=TRANSACTIONAL, backups=2147483647, mvcc=false] [21:12:47] : [Step 4/5] [2021-11-19 21:12:47,689][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Binary recovery performed in 21 ms. [21:12:47] : [Step 4/5] [2021-11-19 21:12:47,689][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:12:47] : [Step 4/5] [2021-11-19 21:12:47,689][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Applying lost cache updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:12:47] : [Step 4/5] [2021-11-19 21:12:47,692][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=0 ms] [21:12:47] : [Step 4/5] [2021-11-19 21:12:47,692][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Restoring partition state for local groups. [21:12:47] : [Step 4/5] [2021-11-19 21:12:47,704][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=1, partitionsProcessed=100, time=20ms] [21:12:47] : [Step 4/5] [2021-11-19 21:12:47,714][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][TestTcpDiscoverySpi] Successfully bound to TCP port [port=47500, localHost=localhost/127.0.0.1, locNodeId=00cce8f9-a2b3-4d32-a95a-7f6eb6335000] [21:12:47] : [Step 4/5] [2021-11-19 21:12:47,723][INFO ][disco-notifier-worker-#24306%grid-0%][MvccProcessorImpl] Assigned mvcc coordinator [crd=MvccCoordinator [topVer=AffinityTopologyVersion [topVer=1, minorTopVer=0], nodeId=00cce8f9-a2b3-4d32-a95a-7f6eb6335000, ver=1637345567715, local=true, initialized=false]] [21:12:47] : [Step 4/5] [2021-11-19 21:12:47,723][INFO ][sys-#24284%grid-0%][ClusterProcessor] Writing cluster ID and tag to metastorage on ready for write ClusterIdAndTag [id=a94ee374-4ab2-4d81-a9e6-7f19a9a7f0f7, tag=fervent_solomon] [21:12:47] : [Step 4/5] [2021-11-19 21:12:47,727][INFO ][disco-notifier-worker-#24306%grid-0%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustEnabled' was changed from 'null' to 'false' [21:12:47] : [Step 4/5] [2021-11-19 21:12:47,729][INFO ][disco-notifier-worker-#24306%grid-0%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustTimeout' was changed from 'null' to '300000' [21:12:47] : [Step 4/5] [2021-11-19 21:12:47,729][INFO ][disco-notifier-worker-#24306%grid-0%][IgniteTxManager] Transactions parameter 'longOperationsDumpTimeout' was changed from 'null' to '60000' [21:12:47] : [Step 4/5] [2021-11-19 21:12:47,730][INFO ][disco-notifier-worker-#24306%grid-0%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpThreshold' was changed from 'null' to '0' [21:12:47] : [Step 4/5] [2021-11-19 21:12:47,730][INFO ][disco-notifier-worker-#24306%grid-0%][IgniteTxManager] Transactions parameter 'transactionTimeDumpSamplesCoefficient' was changed from 'null' to '0.0' [21:12:47] : [Step 4/5] [2021-11-19 21:12:47,731][INFO ][disco-notifier-worker-#24306%grid-0%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpSamplesPerSecondLimit' was changed from 'null' to '5' [21:12:47] : [Step 4/5] [2021-11-19 21:12:47,731][INFO ][disco-notifier-worker-#24306%grid-0%][IgniteTxManager] Transactions parameter 'collisionsDumpInterval' was changed from 'null' to '1000' [21:12:47] : [Step 4/5] [2021-11-19 21:12:47,732][INFO ][disco-notifier-worker-#24306%grid-0%][IgniteTxManager] Transactions parameter 'txOwnerDumpRequestsAllowed' was changed from 'null' to 'true' [21:12:47] : [Step 4/5] [2021-11-19 21:12:47,732][INFO ][disco-notifier-worker-#24306%grid-0%][GridCacheDatabaseSharedManager] Historical rebalance WAL threshold changed [property=historical.rebalance.threshold, oldVal=null, newVal=500] [21:12:47] : [Step 4/5] [2021-11-19 21:12:47,733][INFO ][disco-notifier-worker-#24306%grid-0%][ClusterProcessor] fervent_solomon [21:12:47] : [Step 4/5] [2021-11-19 21:12:47,743][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] To start Console Management & Monitoring run ignitevisorcmd.{sh|bat} [21:12:47] : [Step 4/5] [2021-11-19 21:12:47,743][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] [21:12:47] : [Step 4/5] [21:12:47] : [Step 4/5] >>> +-------------------------------------------+ [21:12:47] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:12:47] : [Step 4/5] >>> +-------------------------------------------+ [21:12:47] : [Step 4/5] >>> OS name: Linux 4.15.0-151-generic amd64 [21:12:47] : [Step 4/5] >>> CPU(s): 24 [21:12:47] : [Step 4/5] >>> Heap: 2.0GB [21:12:47] : [Step 4/5] >>> VM name: 16724@c4dfe9a430b2 [21:12:47] : [Step 4/5] >>> Ignite instance name: grid-0 [21:12:47] : [Step 4/5] >>> Local node [ID=00CCE8F9-A2B3-4D32-A95A-7F6EB6335000, order=1, clientMode=false] [21:12:47] : [Step 4/5] >>> Local node addresses: [127.0.0.1] [21:12:47] : [Step 4/5] >>> Local ports: TCP:10800 TCP:47100 TCP:47500 [21:12:47] : [Step 4/5] [21:12:47] : [Step 4/5] [2021-11-19 21:12:47,744][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] >>> Ignite cluster is in INACTIVE state (limited functionality available). Use control.(sh|bat) script or IgniteCluster.state(ClusterState.ACTIVE) to change the state. [21:12:47] : [Step 4/5] [2021-11-19 21:12:47,745][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][GridDiscoveryManager] Topology snapshot [ver=1, locNode=00cce8f9, servers=1, clients=0, state=INACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=00cce8f9-a2b3-4d32-a95a-7f6eb6335000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:12:47] : [Step 4/5] [2021-11-19 21:12:47,746][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][G] Node started : [stage="Configure system pool" (0 ms),stage="Start managers" (201 ms),stage="Configure binary metadata" (2 ms),stage="Start processors" (182 ms),stage="Start 'StanByClusterTestProvider' plugin" (0 ms),stage="Start 'PageMemory tracker plugin' plugin" (0 ms),stage="Start 'TestDistibutedConfigurationPlugin' plugin" (0 ms),stage="Start 'NodeValidationPluginProvider' plugin" (0 ms),stage="Init metastore" (28 ms),stage="Init and start regions" (8 ms),stage="Restore binary memory" (21 ms),stage="Restore logical state" (15 ms),stage="Finish recovery" (9 ms),stage="Join topology" (10 ms),stage="Await transition" (1 ms),stage="Await exchange" (20 ms),stage="Total time" (497 ms)] [21:12:47] : [Step 4/5] [2021-11-19 21:12:47,747][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Node started with the following configuration [id=00cce8f9-a2b3-4d32-a95a-7f6eb6335000, marshaller=BinaryMarshaller [], discovery=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=5000, ackTimeout=5000, marsh=JdkMarshaller [clsFilter=org.apache.ignite.marshaller.MarshallerUtils$1@16d104ac], reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], binaryCfg=null, lateAff=true] [21:12:47]W: [org.apache.ignite:ignite-core] [2021-11-19 21:12:47,752][WARN ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][G] Ignite work directory is not provided, automatically resolved to: /opt/buildagent/work/7bc1c54bc719b67c/work [21:12:47] : [Step 4/5] [2021-11-19 21:12:47,753][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] [21:12:47] : [Step 4/5] [21:12:47] : [Step 4/5] >>> __________ ________________ [21:12:47] : [Step 4/5] >>> / _/ ___/ |/ / _/_ __/ __/ [21:12:47] : [Step 4/5] >>> _/ // (7 7 // / / / / _/ [21:12:47] : [Step 4/5] >>> /___/\___/_/|_/___/ /_/ /___/ [21:12:47] : [Step 4/5] >>> [21:12:47] : [Step 4/5] >>> ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:12:47] : [Step 4/5] >>> 2021 Copyright(C) Apache Software Foundation [21:12:47] : [Step 4/5] >>> [21:12:47] : [Step 4/5] >>> Ignite documentation: http://ignite.apache.org [21:12:47] : [Step 4/5] [21:12:47] : [Step 4/5] [2021-11-19 21:12:47,753][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] Config URL: n/a [21:12:47] : [Step 4/5] [2021-11-19 21:12:47,754][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] IgniteConfiguration [igniteInstanceName=grid-1, pubPoolSize=24, svcPoolSize=24, callbackPoolSize=24, stripedPoolSize=24, sysPoolSize=24, mgmtPoolSize=4, dataStreamerPoolSize=24, utilityCachePoolSize=24, utilityCacheKeepAliveTime=60000, p2pPoolSize=2, qryPoolSize=24, buildIdxPoolSize=4, igniteHome=/opt/buildagent/work/7bc1c54bc719b67c, igniteWorkDir=/opt/buildagent/work/7bc1c54bc719b67c/work, mbeanSrv=com.sun.jmx.mbeanserver.JmxMBeanServer@6fe85038, nodeId=10b6f63c-e31c-4573-a225-9f76f500c001, marsh=BinaryMarshaller [], marshLocJobs=false, daemon=false, p2pEnabled=true, netTimeout=10000, netCompressionLevel=1, sndRetryDelay=1000, sndRetryCnt=3, metricsHistSize=10000, metricsUpdateFreq=1000, metricsExpTime=9223372036854775807, discoSpi=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=0, ackTimeout=0, marsh=null, reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], segPlc=STOP, segResolveAttempts=2, waitForSegOnStart=true, allResolversPassReq=true, segChkFreq=10000, commSpi=TcpCommunicationSpi [connectGate=org.apache.ignite.spi.communication.tcp.internal.ConnectGateway@7f351891, ctxInitLatch=java.util.concurrent.CountDownLatch@26e77458[Count = 1], stopping=false, clientPool=null, nioSrvWrapper=null, stateProvider=null], evtSpi=MemoryEventStorageSpi [expireAgeMs=9223372036854775807, expireCnt=10000, filter=null], colSpi=NoopCollisionSpi [], deploySpi=LocalDeploymentSpi [], indexingSpi=org.apache.ignite.spi.indexing.noop.NoopIndexingSpi@5a1174fc, addrRslvr=null, encryptionSpi=org.apache.ignite.spi.encryption.keystore.KeystoreEncryptionSpi@75a84ba, tracingSpi=org.apache.ignite.spi.tracing.NoopTracingSpi@68ad4a72, clientMode=false, rebalanceThreadPoolSize=4, rebalanceTimeout=10000, rebalanceBatchesPrefetchCnt=3, rebalanceThrottle=0, rebalanceBatchSize=524288, txCfg=TransactionConfiguration [txSerEnabled=false, dfltIsolation=REPEATABLE_READ, dfltConcurrency=PESSIMISTIC, dfltTxTimeout=0, txTimeoutOnPartitionMapExchange=0, deadlockTimeout=10000, pessimisticTxLogSize=0, pessimisticTxLogLinger=10000, tmLookupClsName=null, txManagerFactory=null, useJtaSync=false], cacheSanityCheckEnabled=true, discoStartupDelay=60000, deployMode=SHARED, p2pMissedCacheSize=100, locHost=127.0.0.1, timeSrvPortBase=31100, timeSrvPortRange=100, failureDetectionTimeout=10000, sysWorkerBlockedTimeout=null, clientFailureDetectionTimeout=10000, metricsLogFreq=0, connectorCfg=null, odbcCfg=null, warmupClos=null, atomicCfg=AtomicConfiguration [seqReserveSize=1000, cacheMode=PARTITIONED, backups=1, aff=null, grpName=null], classLdr=null, sslCtxFactory=null, platformCfg=null, binaryCfg=null, memCfg=null, pstCfg=null, dsCfg=DataStorageConfiguration [sysRegionInitSize=41943040, sysRegionMaxSize=104857600, pageSize=4096, concLvl=0, dfltDataRegConf=DataRegionConfiguration [name=default, maxSize=104857600, initSize=268435456, swapPath=null, pageEvictionMode=DISABLED, pageReplacementMode=CLOCK, evictionThreshold=0.9, emptyPagesPoolSize=100, metricsEnabled=false, metricsSubIntervalCount=5, metricsRateTimeInterval=60000, persistenceEnabled=true, checkpointPageBufSize=0, lazyMemoryAllocation=true, warmUpCfg=null], dataRegions=null, storagePath=null, checkpointFreq=30000, lockWaitTime=10000, checkpointThreads=4, checkpointWriteOrder=SEQUENTIAL, walHistSize=20, maxWalArchiveSize=20971520, walSegments=10, walSegmentSize=1048576, walPath=db/wal, walArchivePath=db/wal/archive, cdcWalPath=db/wal/cdc, cdcEnabled=false, metricsEnabled=false, walMode=LOG_ONLY, walTlbSize=131072, walBuffSize=0, walFlushFreq=2000, walFsyncDelay=1000, walRecordIterBuffSize=67108864, alwaysWriteFullPages=false, fileIOFactory=org.apache.ignite.internal.processors.cache.persistence.file.AsyncFileIOFactory@37803069, metricsSubIntervalCnt=5, metricsRateTimeInterval=60000, walAutoArchiveAfterInactivity=-1, walForceArchiveTimeout=-1, writeThrottlingEnabled=false, walCompactionEnabled=false, walCompactionLevel=1, checkpointReadLockTimeout=null, walPageCompression=DISABLED, walPageCompressionLevel=null, dfltWarmUpCfg=null, encCfg=org.apache.ignite.configuration.EncryptionConfiguration@6893e5e6, defragmentationThreadPoolSize=4, minWalArchiveSize=-1], snapshotPath=snapshots, activeOnStart=true, activeOnStartPropSetFlag=false, autoActivation=true, autoActivationPropSetFlag=false, clusterStateOnStart=null, sqlConnCfg=null, cliConnCfg=ClientConnectorConfiguration [host=null, port=10800, portRange=100, sockSndBufSize=0, sockRcvBufSize=0, tcpNoDelay=true, maxOpenCursorsPerConn=128, threadPoolSize=24, selectorCnt=12, idleTimeout=0, handshakeTimeout=10000, jdbcEnabled=true, odbcEnabled=true, thinCliEnabled=true, sslEnabled=false, useIgniteSslCtxFactory=true, sslClientAuth=false, sslCtxFactory=null, thinCliCfg=ThinClientConfiguration [maxActiveTxPerConn=100, maxActiveComputeTasksPerConn=0]], mvccVacuumThreadCnt=2, mvccVacuumFreq=5000, authEnabled=false, failureHnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]], commFailureRslvr=null, sqlCfg=SqlConfiguration [longQryWarnTimeout=3000, dfltQryTimeout=0, sqlQryHistSize=1000, validationEnabled=false], asyncContinuationExecutor=null] [21:12:47] : [Step 4/5] [2021-11-19 21:12:47,761][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] Daemon mode: off [21:12:47] : [Step 4/5] [2021-11-19 21:12:47,761][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] OS: Linux 4.15.0-151-generic amd64 [21:12:47] : [Step 4/5] [2021-11-19 21:12:47,761][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] OS user: teamcity [21:12:47] : [Step 4/5] [2021-11-19 21:12:47,762][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] PID: 16724 [21:12:47] : [Step 4/5] [2021-11-19 21:12:47,762][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] Language runtime: Java Platform API Specification ver. 1.8 [21:12:47] : [Step 4/5] [2021-11-19 21:12:47,762][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] VM information: Java(TM) SE Runtime Environment 1.8.0_261-b12 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 25.261-b12 [21:12:47] : [Step 4/5] [2021-11-19 21:12:47,763][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] VM total memory: 1.9GB [21:12:47] : [Step 4/5] [2021-11-19 21:12:47,763][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] Remote Management [restart: off, REST: off, JMX (remote: off)] [21:12:47] : [Step 4/5] [2021-11-19 21:12:47,763][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] Logger: GridTestLog4jLogger [quiet=false, config=null] [21:12:47] : [Step 4/5] [2021-11-19 21:12:47,764][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] IGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c [21:12:47] : [Step 4/5] [2021-11-19 21:12:47,764][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] VM arguments: [-DIGNITE_DUMP_THREADS_ON_FAILURE=false, -DMono=/usr/bin/mono-sgen, -DMono4.0_x64=/usr/lib/mono/4.0, -DMono4.5_x64=/usr/lib/mono/4.5, -DMonoVersion=6.12.0.90, -DSKIP_BUILD=false, -Dagent.home.dir=/opt/buildagent, -Dagent.name=aitc-lin02_03, -Dagent.ownPort=9090, -Dagent.work.dir=/opt/buildagent/work, -Dbuild.number=95, -Dbuild.vcs.number=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.1=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.GitHubApacheIgnite=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dclassworlds.conf=/opt/buildagent/temp/buildTmp/teamcity.m2.conf, -Dcom.jetbrains.maven.watcher.report.file=/opt/buildagent/temp/buildTmp/maven-build-info.xml, -Djava.io.tmpdir=/opt/buildagent/temp/buildTmp, -Dmaven.home=/opt/buildagent/tools/maven3_6, -Dmaven.multiModuleProjectDirectory=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.agent.cpuBenchmark=457, -Dteamcity.agent.dotnet.agent_url=http://localhost:9090/RPC2, -Dteamcity.agent.dotnet.build_id=6278078, -Dteamcity.auth.password=*******, -Dteamcity.auth.userId=TeamCityBuildId=6278078, -Dteamcity.build.changedFiles.file=/opt/buildagent/temp/buildTmp/changedFiles6342607772318147725.txt, -Dteamcity.build.checkoutDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.build.id=6278078, -Dteamcity.build.properties.file=/opt/buildagent/temp/buildTmp/teamcity.build5164517880467851002.properties, -Dteamcity.build.tempDir=/opt/buildagent/temp/buildTmp, -Dteamcity.build.workingDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.buildConfName=Basic 3, -Dteamcity.buildType.id=IgniteTests24Java8_Basic3, -Dteamcity.configuration.properties.file=/opt/buildagent/temp/buildTmp/teamcity.config5591980786735343870.properties, -Dteamcity.maven.userSettings.path=/opt/buildagent/temp/buildTmp/maven_settings_585072866407032347.xml, -Dteamcity.maven.watcher.home=/opt/buildagent/plugins/mavenPlugin/maven-watcher-jdk16, -Dteamcity.projectName=Ignite Tests 2.x (JDK 8/11), -Dteamcity.runner.properties.file=/opt/buildagent/temp/buildTmp/teamcity.runner9098465561618137420.properties, -Dteamcity.tests.recentlyFailedTests.file=/opt/buildagent/temp/buildTmp/testsToRunFirst3891775683130404069.txt, -Dteamcity.version=2021.2 (build 99542), -ea, -Xms2g, -Xmx2g, -XX:+HeapDumpOnOutOfMemoryError, -DIGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_TEST_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_UPDATE_NOTIFIER=false, -DIGNITE_NO_DISCO_ORDER=true, -DIGNITE_PERFORMANCE_SUGGESTIONS_DISABLED=true, -Djava.net.preferIPv4Stack=true, -DTEST_SCALE_FACTOR=1.0, -DIGNITE_TEST_PROP_LOG4J_FILE=log4j-tc-test.xml, -DIGNITE_QUIET=false, -DIGNITE_MARSHAL_BUFFERS_RECHECK=1000, -Dmaven.repo.local=/opt/buildagent/.m2/repository] [21:12:47] : [Step 4/5] [2021-11-19 21:12:47,767][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] System cache's DataRegion size is configured to 40 MB. Use DataStorageConfiguration.systemRegionInitialSize property to change the setting. [21:12:47] : [Step 4/5] [2021-11-19 21:12:47,768][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] Configured caches [in 'sysMemPlc' dataRegion: ['ignite-sys-cache']] [21:12:47] : [Step 4/5] [2021-11-19 21:12:47,768][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] 3-rd party licenses can be found at: /opt/buildagent/work/7bc1c54bc719b67c/libs/licenses [21:12:47]W: [org.apache.ignite:ignite-core] [2021-11-19 21:12:47,768][WARN ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] Peer class loading is enabled (disable it in production for performance and deployment consistency reasons) [21:12:47] : [Step 4/5] [2021-11-19 21:12:47,772][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] Configured plugins: [21:12:47] : [Step 4/5] [2021-11-19 21:12:47,772][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- StanByClusterTestProvider 1.0 [21:12:47] : [Step 4/5] [2021-11-19 21:12:47,772][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:12:47] : [Step 4/5] [2021-11-19 21:12:47,773][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] [21:12:47] : [Step 4/5] [2021-11-19 21:12:47,773][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- PageMemory tracker plugin 1.0 [21:12:47] : [Step 4/5] [2021-11-19 21:12:47,773][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:12:47] : [Step 4/5] [2021-11-19 21:12:47,773][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] [21:12:47] : [Step 4/5] [2021-11-19 21:12:47,773][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- TestDistibutedConfigurationPlugin 1.0 [21:12:47] : [Step 4/5] [2021-11-19 21:12:47,774][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:12:47] : [Step 4/5] [2021-11-19 21:12:47,774][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] [21:12:47] : [Step 4/5] [2021-11-19 21:12:47,774][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- NodeValidationPluginProvider 1.0 [21:12:47] : [Step 4/5] [2021-11-19 21:12:47,774][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:12:47] : [Step 4/5] [2021-11-19 21:12:47,774][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] [21:12:47] : [Step 4/5] [2021-11-19 21:12:47,775][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][FailureProcessor] Configured failure handler: [hnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]]] [21:12:47] : [Step 4/5] [2021-11-19 21:12:47,790][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][TestRecordingCommunicationSpi] Successfully bound communication NIO server to TCP port [port=47101, locHost=/127.0.0.1, selectorsCnt=12, selectorSpins=0, pairedConn=false] [21:12:47]W: [org.apache.ignite:ignite-core] [2021-11-19 21:12:47,791][WARN ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][TestRecordingCommunicationSpi] Message queue limit is set to 0 which may lead to potential OOMEs when running cache operations in FULL_ASYNC or PRIMARY_SYNC modes due to message queues growth on sender and receiver sides. [21:12:47] : [Step 4/5] [2021-11-19 21:12:47,805][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][GridCollisionManager] Collision resolution is disabled (all jobs will be activated upon arrival). [21:12:47] : [Step 4/5] [2021-11-19 21:12:47,805][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] Security status [authentication=off, sandbox=off, tls/ssl=off] [21:12:47] : [Step 4/5] [2021-11-19 21:12:47,864][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:12:47] : [Step 4/5] [2021-11-19 21:12:47,950][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][MaintenanceProcessor] Resolved store directory for node persistent data: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1 [21:12:47] : [Step 4/5] [2021-11-19 21:12:47,951][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][CacheObjectBinaryProcessorImpl] Resolved directory for serialized binary metadata: /opt/buildagent/work/7bc1c54bc719b67c/work/db/binary_meta/grid_1 [21:12:47] : [Step 4/5] [2021-11-19 21:12:47,954][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1 [21:12:47] : [Step 4/5] [2021-11-19 21:12:47,955][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][FileWriteAheadLogManager] Resolved write ahead log work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1 [21:12:47] : [Step 4/5] [2021-11-19 21:12:47,955][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][FileWriteAheadLogManager] Resolved write ahead log archive directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1 [21:12:48] : [Step 4/5] [2021-11-19 21:12:48,033][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000000.wal [21:12:48] : [Step 4/5] [2021-11-19 21:12:48,033][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][FileHandleManagerImpl] Initialized write-ahead log manager [mode=LOG_ONLY] [21:12:48] : [Step 4/5] [2021-11-19 21:12:48,038][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Configured data regions initialized successfully [total=5] [21:12:48] : [Step 4/5] [2021-11-19 21:12:48,041][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][IgniteSnapshotManager] Resolved snapshot work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/snapshots [21:12:48] : [Step 4/5] [2021-11-19 21:12:48,042][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][IgniteSnapshotManager] Resolved temp directory for snapshot creation: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1/snp [21:12:48] : [Step 4/5] [2021-11-19 21:12:48,045][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][ClientListenerProcessor] Client connector processor has started on TCP port 10801 [21:12:48] : [Step 4/5] [2021-11-19 21:12:48,048][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] Non-loopback local IPs: 172.17.0.4 [21:12:48] : [Step 4/5] [2021-11-19 21:12:48,048][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] Enabled local MACs: 0242AC110004 [21:12:48] : [Step 4/5] [2021-11-19 21:12:48,049][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:12:48] : [Step 4/5] [2021-11-19 21:12:48,050][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:12:48] : [Step 4/5] [2021-11-19 21:12:48,050][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:12:48] : [Step 4/5] [2021-11-19 21:12:48,052][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Applying lost metastore updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:12:48] : [Step 4/5] [2021-11-19 21:12:48,056][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=0 ms] [21:12:48] : [Step 4/5] [2021-11-19 21:12:48,056][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Restoring partition state for local groups. [21:12:48] : [Step 4/5] [2021-11-19 21:12:48,056][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=0, partitionsProcessed=0, time=0ms] [21:12:48] : [Step 4/5] [2021-11-19 21:12:48,057][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][GridEncryptionManager] Encryption keys loaded from metastore. [grps=, masterKeyName=ignite.master.key] [21:12:48] : [Step 4/5] [2021-11-19 21:12:48,059][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][ClusterProcessor] Cluster ID and tag has been read from metastorage: null [21:12:48] : [Step 4/5] [2021-11-19 21:12:48,059][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][IgniteClusterImpl] Shutdown policy was updated [oldVal=null, newVal=null] [21:12:48] : [Step 4/5] [2021-11-19 21:12:48,059][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Checkpoint frequency deviation changed [oldVal=null, newVal=null] [21:12:48] : [Step 4/5] [2021-11-19 21:12:48,069][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][FilePageStoreManager] Cleanup cache stores [total=1, left=0, cleanFiles=false] [21:12:48] : [Step 4/5] [2021-11-19 21:12:48,071][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:12:48] : [Step 4/5] [2021-11-19 21:12:48,072][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:12:48] : [Step 4/5] [2021-11-19 21:12:48,073][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:12:48] : [Step 4/5] [2021-11-19 21:12:48,073][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Data Regions Started: 5 [21:12:48] : [Step 4/5] [2021-11-19 21:12:48,073][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] ^-- sysMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:12:48] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:12:48] : [Step 4/5] ^-- default region [type=default, persistence=true, lazyAlloc=true, [21:12:48] : [Step 4/5] ... initCfg=100MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB, allocTotal=0MB] [21:12:48] : [Step 4/5] ^-- metastoreMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:12:48] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:12:48] : [Step 4/5] ^-- TxLog region [type=internal, persistence=true, lazyAlloc=false, [21:12:48] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:12:48] : [Step 4/5] ^-- volatileDsMemPlc region [type=user, persistence=false, lazyAlloc=true, [21:12:48] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB] [21:12:48] : [Step 4/5] ^-- Ignite persistence [used=0MB] [21:12:48] : [Step 4/5] [21:12:48] : [Step 4/5] [2021-11-19 21:12:48,075][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Starting binary memory restore for: [-2100569601] [21:12:48] : [Step 4/5] [2021-11-19 21:12:48,084][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:12:48] : [Step 4/5] [2021-11-19 21:12:48,084][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:12:48] : [Step 4/5] [2021-11-19 21:12:48,087][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000000.wal, offset=0, ver=2] [21:12:48] : [Step 4/5] [2021-11-19 21:12:48,090][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Started cache in recovery mode [name=ignite-sys-cache, id=-2100569601, dataRegionName=sysMemPlc, mode=REPLICATED, atomicity=TRANSACTIONAL, backups=2147483647, mvcc=false] [21:12:48] : [Step 4/5] [2021-11-19 21:12:48,091][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Binary recovery performed in 16 ms. [21:12:48] : [Step 4/5] [2021-11-19 21:12:48,092][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:12:48] : [Step 4/5] [2021-11-19 21:12:48,092][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Applying lost cache updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:12:48] : [Step 4/5] [2021-11-19 21:12:48,094][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=10 ms] [21:12:48] : [Step 4/5] [2021-11-19 21:12:48,094][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Restoring partition state for local groups. [21:12:48] : [Step 4/5] [2021-11-19 21:12:48,099][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=1, partitionsProcessed=100, time=0ms] [21:12:48] : [Step 4/5] [2021-11-19 21:12:48,121][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][TestTcpDiscoverySpi] Successfully bound to TCP port [port=47501, localHost=localhost/127.0.0.1, locNodeId=10b6f63c-e31c-4573-a225-9f76f500c001] [21:12:48] : [Step 4/5] [2021-11-19 21:12:48,125][INFO ][tcp-disco-srvr-[:47500]-#1274%grid-0%-#24308%grid-0%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=48827] [21:12:48] : [Step 4/5] [2021-11-19 21:12:48,125][INFO ][tcp-disco-srvr-[:47500]-#1274%grid-0%-#24308%grid-0%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=48827] [21:12:48] : [Step 4/5] [2021-11-19 21:12:48,125][INFO ][tcp-disco-sock-reader-[]-#1280%grid-0%-#24428%grid-0%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:48827, rmtPort=48827] [21:12:48] : [Step 4/5] [2021-11-19 21:12:48,127][INFO ][tcp-disco-sock-reader-[10b6f63c 127.0.0.1:48827]-#1280%grid-0%-#24428%grid-0%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=10b6f63c-e31c-4573-a225-9f76f500c001, rmtAddr=/127.0.0.1:48827] [21:12:48] : [Step 4/5] [2021-11-19 21:12:48,310][INFO ][tcp-disco-srvr-[:47501]-#1279%grid-1%-#24427%grid-1%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=45485] [21:12:48] : [Step 4/5] [2021-11-19 21:12:48,311][INFO ][tcp-disco-srvr-[:47501]-#1279%grid-1%-#24427%grid-1%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=45485] [21:12:48] : [Step 4/5] [2021-11-19 21:12:48,311][INFO ][tcp-disco-sock-reader-[]-#1281%grid-1%-#24429%grid-1%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:45485, rmtPort=45485] [21:12:48] : [Step 4/5] [2021-11-19 21:12:48,312][INFO ][tcp-disco-sock-reader-[]-#1281%grid-1%-#24429%grid-1%][TestTcpDiscoverySpi] Received ping request from the remote node [rmtNodeId=00cce8f9-a2b3-4d32-a95a-7f6eb6335000, rmtAddr=/127.0.0.1:45485, rmtPort=45485] [21:12:48] : [Step 4/5] [2021-11-19 21:12:48,313][INFO ][tcp-disco-sock-reader-[]-#1281%grid-1%-#24429%grid-1%][TestTcpDiscoverySpi] Finished writing ping response [rmtNodeId=00cce8f9-a2b3-4d32-a95a-7f6eb6335000, rmtAddr=/127.0.0.1:45485, rmtPort=45485] [21:12:48]W: [org.apache.ignite:ignite-core] [2021-11-19 21:12:48,313][WARN ][tcp-disco-sock-reader-[]-#1281%grid-1%-#24429%grid-1%][TestTcpDiscoverySpi] Failed to shutdown socket [21:12:48]W: [org.apache.ignite:ignite-core] java.net.SocketException: Socket output is already shutdown [21:12:48]W: [org.apache.ignite:ignite-core] at java.net.Socket.shutdownOutput(Socket.java:1572) [21:12:48]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.close(IgniteUtils.java:4247) [21:12:48]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.discovery.tcp.ServerImpl$SocketReader.body(ServerImpl.java:7370) [21:12:48] : [Step 4/5] [2021-11-19 21:12:48,314][INFO ][tcp-disco-sock-reader-[10b6f63c 127.0.0.1:48827]-#1280%grid-0%-#24428%grid-0%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:48827, rmtPort=48827, rmtNodeId=10b6f63c-e31c-4573-a225-9f76f500c001] [21:12:48]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.IgniteSpiThread.run(IgniteSpiThread.java:58) [21:12:48] : [Step 4/5] [2021-11-19 21:12:48,315][INFO ][tcp-disco-sock-reader-[]-#1281%grid-1%-#24429%grid-1%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:45485, rmtPort=45485, rmtNodeId=null] [21:12:48] : [Step 4/5] [2021-11-19 21:12:48,316][INFO ][tcp-disco-msg-worker-[crd]-#1273%grid-0%-#24307%grid-0%][GridEncryptionManager] Joining node doesn't have stored group keys [node=10b6f63c-e31c-4573-a225-9f76f500c001] [21:12:48] : [Step 4/5] [2021-11-19 21:12:48,325][INFO ][tcp-disco-msg-worker-[crd]-#1273%grid-0%-#24307%grid-0%][TestTcpDiscoverySpi] New next node [newNext=TcpDiscoveryNode [id=10b6f63c-e31c-4573-a225-9f76f500c001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=0, intOrder=2, lastExchangeTime=1637345568305, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false]] [21:12:48] : [Step 4/5] [2021-11-19 21:12:48,325][INFO ][tcp-disco-srvr-[:47501]-#1279%grid-1%-#24427%grid-1%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=52609] [21:12:48] : [Step 4/5] [2021-11-19 21:12:48,326][INFO ][tcp-disco-srvr-[:47501]-#1279%grid-1%-#24427%grid-1%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=52609] [21:12:48] : [Step 4/5] [2021-11-19 21:12:48,326][INFO ][tcp-disco-sock-reader-[]-#1282%grid-1%-#24430%grid-1%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:52609, rmtPort=52609] [21:12:48] : [Step 4/5] [2021-11-19 21:12:48,327][INFO ][tcp-disco-sock-reader-[00cce8f9 127.0.0.1:52609]-#1282%grid-1%-#24430%grid-1%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=00cce8f9-a2b3-4d32-a95a-7f6eb6335000, rmtAddr=/127.0.0.1:52609] [21:12:48] : [Step 4/5] [2021-11-19 21:12:48,330][INFO ][tcp-disco-msg-worker-[]-#1278%grid-1%-#24426%grid-1%][TestTcpDiscoverySpi] New next node [newNext=TcpDiscoveryNode [id=00cce8f9-a2b3-4d32-a95a-7f6eb6335000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345568325, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false]] [21:12:48] : [Step 4/5] [2021-11-19 21:12:48,331][INFO ][tcp-disco-srvr-[:47500]-#1274%grid-0%-#24308%grid-0%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=48535] [21:12:48] : [Step 4/5] [2021-11-19 21:12:48,331][INFO ][tcp-disco-srvr-[:47500]-#1274%grid-0%-#24308%grid-0%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=48535] [21:12:48] : [Step 4/5] [2021-11-19 21:12:48,332][INFO ][tcp-disco-sock-reader-[]-#1283%grid-0%-#24431%grid-0%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:48535, rmtPort=48535] [21:12:48] : [Step 4/5] [2021-11-19 21:12:48,332][INFO ][tcp-disco-sock-reader-[10b6f63c 127.0.0.1:48535]-#1283%grid-0%-#24431%grid-0%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=10b6f63c-e31c-4573-a225-9f76f500c001, rmtAddr=/127.0.0.1:48535] [21:12:48] : [Step 4/5] [2021-11-19 21:12:48,334][INFO ][disco-event-worker-#24310%grid-0%][GridDiscoveryManager] Added new node to topology: TcpDiscoveryNode [id=10b6f63c-e31c-4573-a225-9f76f500c001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637345568305, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false] [21:12:48] : [Step 4/5] [2021-11-19 21:12:48,335][INFO ][disco-event-worker-#24310%grid-0%][GridDiscoveryManager] Topology snapshot [ver=2, locNode=00cce8f9, servers=2, clients=0, state=INACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=00cce8f9-a2b3-4d32-a95a-7f6eb6335000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=10b6f63c-e31c-4573-a225-9f76f500c001, consistentId=grid-1, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:12:48] : [Step 4/5] [2021-11-19 21:12:48,337][INFO ][tcp-disco-msg-worker-[00cce8f9 127.0.0.1:47500]-#1278%grid-1%-#24426%grid-1%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustEnabled' was changed from 'null' to 'false' [21:12:48] : [Step 4/5] [2021-11-19 21:12:48,338][INFO ][tcp-disco-msg-worker-[00cce8f9 127.0.0.1:47500]-#1278%grid-1%-#24426%grid-1%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustTimeout' was changed from 'null' to '300000' [21:12:48] : [Step 4/5] [2021-11-19 21:12:48,338][INFO ][tcp-disco-msg-worker-[00cce8f9 127.0.0.1:47500]-#1278%grid-1%-#24426%grid-1%][IgniteTxManager] Transactions parameter 'longOperationsDumpTimeout' was changed from 'null' to '60000' [21:12:48] : [Step 4/5] [2021-11-19 21:12:48,338][INFO ][tcp-disco-msg-worker-[00cce8f9 127.0.0.1:47500]-#1278%grid-1%-#24426%grid-1%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpThreshold' was changed from 'null' to '0' [21:12:48] : [Step 4/5] [2021-11-19 21:12:48,339][INFO ][tcp-disco-msg-worker-[00cce8f9 127.0.0.1:47500]-#1278%grid-1%-#24426%grid-1%][IgniteTxManager] Transactions parameter 'transactionTimeDumpSamplesCoefficient' was changed from 'null' to '0.0' [21:12:48] : [Step 4/5] [2021-11-19 21:12:48,339][INFO ][tcp-disco-msg-worker-[00cce8f9 127.0.0.1:47500]-#1278%grid-1%-#24426%grid-1%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpSamplesPerSecondLimit' was changed from 'null' to '5' [21:12:48] : [Step 4/5] [2021-11-19 21:12:48,340][INFO ][tcp-disco-msg-worker-[00cce8f9 127.0.0.1:47500]-#1278%grid-1%-#24426%grid-1%][IgniteTxManager] Transactions parameter 'collisionsDumpInterval' was changed from 'null' to '1000' [21:12:48] : [Step 4/5] [2021-11-19 21:12:48,340][INFO ][tcp-disco-msg-worker-[00cce8f9 127.0.0.1:47500]-#1278%grid-1%-#24426%grid-1%][IgniteTxManager] Transactions parameter 'txOwnerDumpRequestsAllowed' was changed from 'null' to 'true' [21:12:48] : [Step 4/5] [2021-11-19 21:12:48,340][INFO ][tcp-disco-msg-worker-[00cce8f9 127.0.0.1:47500]-#1278%grid-1%-#24426%grid-1%][GridCacheDatabaseSharedManager] Historical rebalance WAL threshold changed [property=historical.rebalance.threshold, oldVal=null, newVal=500] [21:12:48] : [Step 4/5] [2021-11-19 21:12:48,341][INFO ][tcp-disco-msg-worker-[00cce8f9 127.0.0.1:47500]-#1278%grid-1%-#24426%grid-1%][ClusterProcessor] fervent_solomon [21:12:48] : [Step 4/5] [2021-11-19 21:12:48,342][INFO ][disco-notifier-worker-#24425%grid-1%][MvccProcessorImpl] Assigned mvcc coordinator [crd=MvccCoordinator [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=0], nodeId=00cce8f9-a2b3-4d32-a95a-7f6eb6335000, ver=1637345567715, local=false, initialized=false]] [21:12:48] : [Step 4/5] [2021-11-19 21:12:48,343][INFO ][sys-#24406%grid-1%][ClusterProcessor] Writing cluster ID and tag to metastorage on ready for write ClusterIdAndTag [id=a94ee374-4ab2-4d81-a9e6-7f19a9a7f0f7, tag=fervent_solomon] [21:12:48] : [Step 4/5] [2021-11-19 21:12:48,355][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] To start Console Management & Monitoring run ignitevisorcmd.{sh|bat} [21:12:48] : [Step 4/5] [2021-11-19 21:12:48,355][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] [21:12:48] : [Step 4/5] [21:12:48] : [Step 4/5] >>> +-------------------------------------------+ [21:12:48] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:12:48] : [Step 4/5] >>> +-------------------------------------------+ [21:12:48] : [Step 4/5] >>> OS name: Linux 4.15.0-151-generic amd64 [21:12:48] : [Step 4/5] >>> CPU(s): 24 [21:12:48] : [Step 4/5] >>> Heap: 2.0GB [21:12:48] : [Step 4/5] >>> VM name: 16724@c4dfe9a430b2 [21:12:48] : [Step 4/5] >>> Ignite instance name: grid-1 [21:12:48] : [Step 4/5] >>> Local node [ID=10B6F63C-E31C-4573-A225-9F76F500C001, order=2, clientMode=false] [21:12:48] : [Step 4/5] >>> Local node addresses: [127.0.0.1] [21:12:48] : [Step 4/5] >>> Local ports: TCP:10801 TCP:47101 TCP:47501 [21:12:48] : [Step 4/5] [21:12:48] : [Step 4/5] [2021-11-19 21:12:48,356][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] >>> Ignite cluster is in INACTIVE state (limited functionality available). Use control.(sh|bat) script or IgniteCluster.state(ClusterState.ACTIVE) to change the state. [21:12:48] : [Step 4/5] [2021-11-19 21:12:48,357][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][GridDiscoveryManager] Topology snapshot [ver=2, locNode=10b6f63c, servers=2, clients=0, state=INACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=00cce8f9-a2b3-4d32-a95a-7f6eb6335000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=10b6f63c-e31c-4573-a225-9f76f500c001, consistentId=grid-1, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:12:48] : [Step 4/5] [2021-11-19 21:12:48,358][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][G] Node started : [stage="Configure system pool" (0 ms),stage="Start managers" (198 ms),stage="Configure binary metadata" (1 ms),stage="Start processors" (94 ms),stage="Start 'StanByClusterTestProvider' plugin" (0 ms),stage="Start 'PageMemory tracker plugin' plugin" (0 ms),stage="Start 'TestDistibutedConfigurationPlugin' plugin" (0 ms),stage="Start 'NodeValidationPluginProvider' plugin" (0 ms),stage="Init metastore" (21 ms),stage="Init and start regions" (5 ms),stage="Restore binary memory" (16 ms),stage="Restore logical state" (8 ms),stage="Finish recovery" (20 ms),stage="Join topology" (221 ms),stage="Await transition" (2 ms),stage="Await exchange" (13 ms),stage="Total time" (599 ms)] [21:12:48] : [Step 4/5] [2021-11-19 21:12:48,359][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Node started with the following configuration [id=10b6f63c-e31c-4573-a225-9f76f500c001, marshaller=BinaryMarshaller [], discovery=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=5000, ackTimeout=5000, marsh=JdkMarshaller [clsFilter=org.apache.ignite.marshaller.MarshallerUtils$1@18089186], reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], binaryCfg=null, lateAff=true] [21:12:48] : [Step 4/5] [2021-11-19 21:12:48,361][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][GridClusterStateProcessor] Sending activate cluster request with BaselineTopology BaselineTopology [id=0, branchingHash=-2475315501, branchingType='New BaselineTopology', baselineNodes=[grid-1, grid-0]] [21:12:48] : [Step 4/5] [2021-11-19 21:12:48,364][INFO ][disco-notifier-worker-#24306%grid-0%][GridClusterStateProcessor] Received activate cluster request with BaselineTopology[id=0] initiator node ID: 00cce8f9-a2b3-4d32-a95a-7f6eb6335000 [21:12:48] : [Step 4/5] [2021-11-19 21:12:48,365][INFO ][disco-notifier-worker-#24306%grid-0%][GridClusterStateProcessor] Started state transition: activate cluster [21:12:48] : [Step 4/5] [2021-11-19 21:12:48,365][INFO ][exchange-worker-#24311%grid-0%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], crd=true, evt=DISCOVERY_CUSTOM_EVT, evtNode=00cce8f9-a2b3-4d32-a95a-7f6eb6335000, customEvt=ChangeGlobalStateMessage [id=3ebfd593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqId=176db150-9a7a-4d7a-a20d-bca8ee07a079, initiatingNodeId=00cce8f9-a2b3-4d32-a95a-7f6eb6335000, state=ACTIVE, baselineTopology=BaselineTopology [id=0, branchingHash=-2475315501, branchingType='New BaselineTopology', baselineNodes=[grid-1, grid-0]], forceChangeBaselineTopology=false, timestamp=1637345568360, forceDeactivation=true], allowMerge=false, exchangeFreeSwitch=false] [21:12:48] : [Step 4/5] [2021-11-19 21:12:48,366][INFO ][disco-notifier-worker-#24425%grid-1%][GridClusterStateProcessor] Received activate cluster request with BaselineTopology[id=0] initiator node ID: 00cce8f9-a2b3-4d32-a95a-7f6eb6335000 [21:12:48] : [Step 4/5] [2021-11-19 21:12:48,367][INFO ][exchange-worker-#24311%grid-0%][GridDhtPartitionsExchangeFuture] Start activation process [nodeId=00cce8f9-a2b3-4d32-a95a-7f6eb6335000, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]]. New state: ACTIVE [21:12:48] : [Step 4/5] [2021-11-19 21:12:48,367][INFO ][disco-notifier-worker-#24425%grid-1%][GridClusterStateProcessor] Started state transition: activate cluster [21:12:48] : [Step 4/5] [2021-11-19 21:12:48,367][INFO ][exchange-worker-#24311%grid-0%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0 [21:12:48] : [Step 4/5] [2021-11-19 21:12:48,368][INFO ][exchange-worker-#24434%grid-1%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], crd=false, evt=DISCOVERY_CUSTOM_EVT, evtNode=00cce8f9-a2b3-4d32-a95a-7f6eb6335000, customEvt=ChangeGlobalStateMessage [id=3ebfd593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqId=176db150-9a7a-4d7a-a20d-bca8ee07a079, initiatingNodeId=00cce8f9-a2b3-4d32-a95a-7f6eb6335000, state=ACTIVE, baselineTopology=BaselineTopology [id=0, branchingHash=-2475315501, branchingType='New BaselineTopology', baselineNodes=[grid-1, grid-0]], forceChangeBaselineTopology=false, timestamp=1637345568360, forceDeactivation=true], allowMerge=false, exchangeFreeSwitch=false] [21:12:48] : [Step 4/5] [2021-11-19 21:12:48,370][INFO ][exchange-worker-#24311%grid-0%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000000.wal, offset=8795, ver=2] [21:12:48] : [Step 4/5] [2021-11-19 21:12:48,370][INFO ][exchange-worker-#24434%grid-1%][GridDhtPartitionsExchangeFuture] Start activation process [nodeId=10b6f63c-e31c-4573-a225-9f76f500c001, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]]. New state: ACTIVE [21:12:48] : [Step 4/5] [2021-11-19 21:12:48,371][INFO ][exchange-worker-#24311%grid-0%][GridClusterStateProcessor] Writing BaselineTopology[id=0] [21:12:48] : [Step 4/5] [2021-11-19 21:12:48,371][INFO ][exchange-worker-#24434%grid-1%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1 [21:12:48] : [Step 4/5] [2021-11-19 21:12:48,374][INFO ][exchange-worker-#24311%grid-0%][GridCacheDatabaseSharedManager] Finish recovery performed in 6 ms. [21:12:48] : [Step 4/5] [2021-11-19 21:12:48,374][INFO ][exchange-worker-#24434%grid-1%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000000.wal, offset=8795, ver=2] [21:12:48] : [Step 4/5] [2021-11-19 21:12:48,375][INFO ][exchange-worker-#24311%grid-0%][msg] Components activation performed in 8 ms. [21:12:48] : [Step 4/5] [2021-11-19 21:12:48,376][INFO ][exchange-worker-#24434%grid-1%][GridClusterStateProcessor] Writing BaselineTopology[id=0] [21:12:48] : [Step 4/5] [2021-11-19 21:12:48,376][INFO ][exchange-worker-#24311%grid-0%][GridCacheProcessor] Finished recovery for cache [cache=ignite-sys-cache, grp=ignite-sys-cache, startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:12:48] : [Step 4/5] [2021-11-19 21:12:48,378][INFO ][exchange-worker-#24434%grid-1%][GridCacheDatabaseSharedManager] Finish recovery performed in 5 ms. [21:12:48] : [Step 4/5] [2021-11-19 21:12:48,378][INFO ][exchange-worker-#24311%grid-0%][GridDhtPartitionsExchangeFuture] Successfully activated caches [nodeId=00cce8f9-a2b3-4d32-a95a-7f6eb6335000, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], newState=ACTIVE] [21:12:48] : [Step 4/5] [2021-11-19 21:12:48,378][INFO ][exchange-worker-#24434%grid-1%][msg] Components activation performed in 7 ms. [21:12:48] : [Step 4/5] [2021-11-19 21:12:48,379][INFO ][exchange-worker-#24311%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:12:48] : [Step 4/5] [2021-11-19 21:12:48,379][INFO ][exchange-worker-#24434%grid-1%][GridCacheProcessor] Finished recovery for cache [cache=ignite-sys-cache, grp=ignite-sys-cache, startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:12:48] : [Step 4/5] [2021-11-19 21:12:48,380][INFO ][exchange-worker-#24434%grid-1%][GridDhtPartitionsExchangeFuture] Successfully activated caches [nodeId=10b6f63c-e31c-4573-a225-9f76f500c001, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], newState=ACTIVE] [21:12:48] : [Step 4/5] [2021-11-19 21:12:48,380][INFO ][exchange-worker-#24434%grid-1%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:12:48] : [Step 4/5] [2021-11-19 21:12:48,386][INFO ][exchange-worker-#24311%grid-0%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], crd=true] [21:12:48] : [Step 4/5] [2021-11-19 21:12:48,390][INFO ][grid-nio-worker-tcp-comm-0-#24249%TestRecordingCommunicationSpi%][TestRecordingCommunicationSpi] Accepted incoming communication connection [locAddr=/127.0.0.1:47100, rmtAddr=/127.0.0.1:34504] [21:12:48] : [Step 4/5] [2021-11-19 21:12:48,391][INFO ][grid-nio-worker-tcp-comm-0-#24368%TestRecordingCommunicationSpi%][TestRecordingCommunicationSpi] Established outgoing communication connection [locAddr=/127.0.0.1:34504, rmtAddr=/127.0.0.1:47100] [21:12:48] : [Step 4/5] [2021-11-19 21:12:48,391][INFO ][exchange-worker-#24434%grid-1%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], crd=false] [21:12:48] : [Step 4/5] [2021-11-19 21:12:48,393][INFO ][sys-#24292%grid-0%][GridDhtPartitionsExchangeFuture] Coordinator received single message [ver=AffinityTopologyVersion [topVer=2, minorTopVer=1], node=10b6f63c-e31c-4573-a225-9f76f500c001, allReceived=true] [21:12:48] : [Step 4/5] [2021-11-19 21:12:48,393][INFO ][sys-#24292%grid-0%][GridDhtPartitionsExchangeFuture] finishExchangeOnCoordinator [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:12:48] : [Step 4/5] [2021-11-19 21:12:48,398][INFO ][sys-#24292%grid-0%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], err=null, rebalanced=true, wasRebalanced=false] [21:12:48] : [Step 4/5] [2021-11-19 21:12:48,398][INFO ][disco-notifier-worker-#24306%grid-0%][GridClusterStateProcessor] Received state change finish message: ACTIVE [21:12:48] : [Step 4/5] [2021-11-19 21:12:48,399][INFO ][disco-notifier-worker-#24306%grid-0%][GridClusterStateProcessor] Cluster state was changed from INACTIVE to ACTIVE [21:12:48] : [Step 4/5] [2021-11-19 21:12:48,398][INFO ][sys-#24413%grid-1%][GridDhtPartitionsExchangeFuture] Received full message, will finish exchange [node=00cce8f9-a2b3-4d32-a95a-7f6eb6335000, resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:12:48] : [Step 4/5] [2021-11-19 21:12:48,401][INFO ][sys-#24292%grid-0%][GridCacheProcessor] Finish proxy initialization, cacheName=ignite-sys-cache, localNodeId=00cce8f9-a2b3-4d32-a95a-7f6eb6335000 [21:12:48] : [Step 4/5] [2021-11-19 21:12:48,400][INFO ][sys-#24403%grid-1%][GridCachePartitionExchangeManager] Delay process full message without exchange id (there is exchange in progress) [nodeId=00cce8f9-a2b3-4d32-a95a-7f6eb6335000] [21:12:48] : [Step 4/5] [2021-11-19 21:12:48,407][INFO ][sys-#24304%grid-0%][DistributedBaselineConfiguration] Baseline auto-adjust is 'disabled' with timeout='300000' ms [21:12:48] : [Step 4/5] [2021-11-19 21:12:48,399][INFO ][disco-notifier-worker-#24425%grid-1%][GridClusterStateProcessor] Received state change finish message: ACTIVE [21:12:48] : [Step 4/5] [2021-11-19 21:12:48,407][INFO ][disco-notifier-worker-#24425%grid-1%][GridClusterStateProcessor] Cluster state was changed from INACTIVE to ACTIVE [21:12:48] : [Step 4/5] [2021-11-19 21:12:48,407][INFO ][sys-#24304%grid-0%][GridClusterStateProcessor] Successfully performed final activation steps [nodeId=00cce8f9-a2b3-4d32-a95a-7f6eb6335000, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:12:48] : [Step 4/5] [2021-11-19 21:12:48,407][INFO ][sys-#24292%grid-0%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=00cce8f9-a2b3-4d32-a95a-7f6eb6335000, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=00cce8f9-a2b3-4d32-a95a-7f6eb6335000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345568395, loc=true, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:12:48] : [Step 4/5] [2021-11-19 21:12:48,407][INFO ][exchange-worker-#24311%grid-0%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=2, minorTopVer=1], force=false, evt=DISCOVERY_CUSTOM_EVT, node=00cce8f9-a2b3-4d32-a95a-7f6eb6335000] [21:12:48] : [Step 4/5] [2021-11-19 21:12:48,401][INFO ][sys-#24413%grid-1%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], err=null, rebalanced=true, wasRebalanced=false] [21:12:48] : [Step 4/5] [2021-11-19 21:12:48,409][INFO ][sys-#24292%grid-0%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (1 ms), stage="Update caches registry" (9 ms), stage="Start caches" (1 ms), stage="Affinity initialization on cache group start" (0 ms), stage="Determine exchange type" (1 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Restore partition states" (0 ms), stage="After states restored callback" (6 ms), stage="WAL history reservation" (0 ms), stage="Waiting for all single messages" (6 ms), stage="Affinity recalculation (crd)" (0 ms), stage="Collect update counters and create affinity messages" (0 ms), stage="Assign partitions states" (0 ms), stage="Validate partitions states" (0 ms), stage="Ideal affinity diff calculation (enforced)" (0 ms), stage="Apply update counters" (0 ms), stage="Full message preparing" (2 ms), stage="Full message sending" (0 ms), stage="State finish message sending" (0 ms), stage="Detect lost partitions" (1 ms), stage="Exchange done" (9 ms), stage="Total time" (36 ms), Discovery lag=3 ms, Latest started node id=10b6f63c-e31c-4573-a225-9f76f500c001] [21:12:48] : [Step 4/5] [2021-11-19 21:12:48,412][INFO ][sys-#24413%grid-1%][GridCacheProcessor] Finish proxy initialization, cacheName=ignite-sys-cache, localNodeId=10b6f63c-e31c-4573-a225-9f76f500c001 [21:12:48] : [Step 4/5] [2021-11-19 21:12:48,413][INFO ][sys-#24292%grid-0%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], stage="Affinity initialization on cache group start [grp=ignite-sys-cache]" (0 ms) (parent=Affinity initialization on cache group start), stage="Affinity centralized initialization (crd) [grp=ignite-sys-cache, crd=true]" (1 ms) (parent=Determine exchange type), stage="Restore partition states [grp=ignite-sys-cache]" (0 ms) (parent=Restore partition states), stage="Affinity recalculation (partitions availability) [grp=ignite-sys-cache]" (0 ms) (parent=Ideal affinity diff calculation (enforced))] [21:12:48] : [Step 4/5] [2021-11-19 21:12:48,415][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] awaitPartitionMapExchange finished [21:12:48] : [Step 4/5] [2021-11-19 21:12:48,415][INFO ][sys-#24413%grid-1%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=10b6f63c-e31c-4573-a225-9f76f500c001, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=00cce8f9-a2b3-4d32-a95a-7f6eb6335000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345568325, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:12:48] : [Step 4/5] [2021-11-19 21:12:48,415][INFO ][exchange-worker-#24434%grid-1%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=2, minorTopVer=1], force=false, evt=DISCOVERY_CUSTOM_EVT, node=00cce8f9-a2b3-4d32-a95a-7f6eb6335000] [21:12:48] : [Step 4/5] [2021-11-19 21:12:48,414][INFO ][sys-#24404%grid-1%][DistributedBaselineConfiguration] Baseline auto-adjust is 'disabled' with timeout='300000' ms [21:12:48] : [Step 4/5] [2021-11-19 21:12:48,424][INFO ][sys-#24413%grid-1%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (1 ms), stage="Update caches registry" (9 ms), stage="Start caches" (0 ms), stage="Affinity initialization on cache group start" (0 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Restore partition states" (0 ms), stage="After states restored callback" (6 ms), stage="WAL history reservation" (0 ms), stage="Waiting for Full message" (11 ms), stage="Affinity recalculation" (2 ms), stage="Full map updating" (0 ms), stage="Detect lost partitions" (9 ms), stage="Exchange done" (13 ms), stage="Total time" (51 ms)] [21:12:48] : [Step 4/5] [2021-11-19 21:12:48,423][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint started [checkpointId=9ed3f23a-98ba-487d-ae37-5b49364dbf9f, startPtr=WALPointer [idx=0, fileOff=86538, len=1963], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=19ms, writeCheckpointEntryDuration=17ms, splitAndSortCpPagesDuration=0ms, pages=17, reason='node started'] [21:12:48] : [Step 4/5] [2021-11-19 21:12:48,423][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint started [checkpointId=4ee5046e-5051-44b7-9312-59e0efc7b551, startPtr=WALPointer [idx=0, fileOff=86538, len=1963], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=20ms, writeCheckpointEntryDuration=17ms, splitAndSortCpPagesDuration=0ms, pages=17, reason='node started'] [21:12:48] : [Step 4/5] [2021-11-19 21:12:48,428][INFO ][exchange-worker-#24311%grid-0%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], crd=true, evt=DISCOVERY_CUSTOM_EVT, evtNode=00cce8f9-a2b3-4d32-a95a-7f6eb6335000, customEvt=DynamicCacheChangeBatch [id=70cfd593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqs=ArrayList [DynamicCacheChangeRequest [cacheName=encrypted, hasCfg=true, nodeId=00cce8f9-a2b3-4d32-a95a-7f6eb6335000, clientStartOnly=false, stop=false, destroy=false, disabledAfterStart=false]], exchangeActions=ExchangeActions [startCaches=[encrypted], stopCaches=null, startGrps=[encrypted], stopGrps=[], resetParts=null, stateChangeRequest=null], startCaches=false], allowMerge=false, exchangeFreeSwitch=false] [21:12:48] : [Step 4/5] [2021-11-19 21:12:48,428][INFO ][exchange-worker-#24434%grid-1%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], crd=false, evt=DISCOVERY_CUSTOM_EVT, evtNode=00cce8f9-a2b3-4d32-a95a-7f6eb6335000, customEvt=DynamicCacheChangeBatch [id=70cfd593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqs=ArrayList [DynamicCacheChangeRequest [cacheName=encrypted, hasCfg=true, nodeId=00cce8f9-a2b3-4d32-a95a-7f6eb6335000, clientStartOnly=false, stop=false, destroy=false, disabledAfterStart=false]], exchangeActions=ExchangeActions [startCaches=[encrypted], stopCaches=null, startGrps=[encrypted], stopGrps=[], resetParts=null, stateChangeRequest=null], startCaches=false], allowMerge=false, exchangeFreeSwitch=false] [21:12:48] : [Step 4/5] [2021-11-19 21:12:48,426][INFO ][sys-#24413%grid-1%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], stage="Affinity initialization on cache group start [grp=ignite-sys-cache]" (0 ms) (parent=Affinity initialization on cache group start), stage="Affinity centralized initialization (crd) [grp=ignite-sys-cache, crd=false]" (0 ms) (parent=Determine exchange type), stage="Restore partition states [grp=ignite-sys-cache]" (0 ms) (parent=Restore partition states), stage="Affinity applying from full message [grp=ignite-sys-cache]" (2 ms) (parent=Affinity recalculation)] [21:12:48] : [Step 4/5] [2021-11-19 21:12:48,425][INFO ][sys-#24404%grid-1%][GridClusterStateProcessor] Successfully performed final activation steps [nodeId=10b6f63c-e31c-4573-a225-9f76f500c001, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:12:48] : [Step 4/5] [2021-11-19 21:12:48,432][INFO ][exchange-worker-#24434%grid-1%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:12:48] : [Step 4/5] [2021-11-19 21:12:48,431][INFO ][exchange-worker-#24311%grid-0%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:12:48] : [Step 4/5] [2021-11-19 21:12:48,437][INFO ][exchange-worker-#24434%grid-1%][GridCacheProcessor] Started cache [name=encrypted, id=1613773252, dataRegionName=default, mode=PARTITIONED, atomicity=ATOMIC, backups=0, mvcc=false] [21:12:48] : [Step 4/5] [2021-11-19 21:12:48,437][INFO ][exchange-worker-#24311%grid-0%][GridCacheProcessor] Started cache [name=encrypted, id=1613773252, dataRegionName=default, mode=PARTITIONED, atomicity=ATOMIC, backups=0, mvcc=false] [21:12:48] : [Step 4/5] [2021-11-19 21:12:48,441][INFO ][exchange-worker-#24311%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], waitTime=0ms, futInfo=NA, mode=DISTRIBUTED] [21:12:48] : [Step 4/5] [2021-11-19 21:12:48,441][INFO ][exchange-worker-#24434%grid-1%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], waitTime=0ms, futInfo=NA, mode=DISTRIBUTED] [21:12:48] : [Step 4/5] [2021-11-19 21:12:48,442][INFO ][exchange-worker-#24311%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partitions release latch: ServerLatch [permits=0, pendingAcks=HashSet [], super=CompletableLatch [id=CompletableLatchUid [id=exchange, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2]]]] [21:12:48] : [Step 4/5] [2021-11-19 21:12:48,443][INFO ][exchange-worker-#24434%grid-1%][GridDhtPartitionsExchangeFuture] Finished waiting for partitions release latch: ClientLatch [coordinator=TcpDiscoveryNode [id=00cce8f9-a2b3-4d32-a95a-7f6eb6335000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345568325, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], ackSent=true, super=CompletableLatch [id=CompletableLatchUid [id=exchange, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2]]]] [21:12:48] : [Step 4/5] [2021-11-19 21:12:48,443][INFO ][exchange-worker-#24311%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:12:48] : [Step 4/5] [2021-11-19 21:12:48,444][INFO ][exchange-worker-#24434%grid-1%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:12:48] : [Step 4/5] [2021-11-19 21:12:48,445][INFO ][exchange-worker-#24311%grid-0%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], crd=true] [21:12:48] : [Step 4/5] [2021-11-19 21:12:48,446][INFO ][exchange-worker-#24434%grid-1%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], crd=false] [21:12:48] : [Step 4/5] [2021-11-19 21:12:48,447][INFO ][sys-#24290%grid-0%][GridDhtPartitionsExchangeFuture] Coordinator received single message [ver=AffinityTopologyVersion [topVer=2, minorTopVer=2], node=10b6f63c-e31c-4573-a225-9f76f500c001, allReceived=true] [21:12:48] : [Step 4/5] [2021-11-19 21:12:48,447][INFO ][sys-#24290%grid-0%][GridDhtPartitionsExchangeFuture] finishExchangeOnCoordinator [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2]] [21:12:48] : [Step 4/5] [2021-11-19 21:12:48,450][INFO ][sys-#24290%grid-0%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], err=null, rebalanced=true, wasRebalanced=true] [21:12:48] : [Step 4/5] [2021-11-19 21:12:48,451][INFO ][sys-#24407%grid-1%][GridDhtPartitionsExchangeFuture] Received full message, will finish exchange [node=00cce8f9-a2b3-4d32-a95a-7f6eb6335000, resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2]] [21:12:48] : [Step 4/5] [2021-11-19 21:12:48,458][INFO ][sys-#24290%grid-0%][GridCacheProcessor] Finish proxy initialization, cacheName=encrypted, localNodeId=00cce8f9-a2b3-4d32-a95a-7f6eb6335000 [21:12:48] : [Step 4/5] [2021-11-19 21:12:48,459][INFO ][sys-#24407%grid-1%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], err=null, rebalanced=true, wasRebalanced=true] [21:12:48] : [Step 4/5] [2021-11-19 21:12:48,460][INFO ][exchange-worker-#24311%grid-0%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=2, minorTopVer=2], force=false, evt=DISCOVERY_CUSTOM_EVT, node=00cce8f9-a2b3-4d32-a95a-7f6eb6335000] [21:12:48] : [Step 4/5] [2021-11-19 21:12:48,460][INFO ][sys-#24290%grid-0%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=00cce8f9-a2b3-4d32-a95a-7f6eb6335000, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=00cce8f9-a2b3-4d32-a95a-7f6eb6335000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345568425, loc=true, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2]] [21:12:48] : [Step 4/5] [2021-11-19 21:12:48,460][INFO ][sys-#24407%grid-1%][GridCacheProcessor] Finish proxy initialization, cacheName=encrypted, localNodeId=10b6f63c-e31c-4573-a225-9f76f500c001 [21:12:48] : [Step 4/5] [2021-11-19 21:12:48,462][INFO ][sys-#24407%grid-1%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=10b6f63c-e31c-4573-a225-9f76f500c001, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=00cce8f9-a2b3-4d32-a95a-7f6eb6335000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345568325, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2]] [21:12:48] : [Step 4/5] [2021-11-19 21:12:48,463][INFO ][sys-#24407%grid-1%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (2 ms), stage="Update caches registry" (0 ms), stage="Start caches" (9 ms), stage="Affinity initialization on cache group start" (0 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Wait partitions release latch [latch=exchange]" (1 ms), stage="Wait partitions release [latch=exchange]" (1 ms), stage="Restore partition states" (0 ms), stage="After states restored callback" (0 ms), stage="WAL history reservation" (0 ms), stage="Waiting for Full message" (5 ms), stage="Affinity recalculation" (7 ms), stage="Full map updating" (1 ms), stage="Exchange done" (3 ms), stage="Total time" (29 ms)] [21:12:48] : [Step 4/5] [2021-11-19 21:12:48,465][INFO ][sys-#24407%grid-1%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], stage="Affinity initialization on cache group start [grp=encrypted]" (0 ms) (parent=Affinity initialization on cache group start), stage="Restore partition states [grp=ignite-sys-cache]" (0 ms) (parent=Restore partition states), stage="Restore partition states [grp=encrypted]" (0 ms) (parent=Restore partition states)] [21:12:48] : [Step 4/5] [2021-11-19 21:12:48,462][INFO ][sys-#24290%grid-0%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (1 ms), stage="Update caches registry" (0 ms), stage="Start caches" (10 ms), stage="Affinity initialization on cache group start" (0 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Wait partitions release latch [latch=exchange]" (1 ms), stage="Wait partitions release [latch=exchange]" (1 ms), stage="Restore partition states" (0 ms), stage="After states restored callback" (0 ms), stage="WAL history reservation" (0 ms), stage="Waiting for all single messages" (1 ms), stage="Affinity recalculation (crd)" (0 ms), stage="Collect update counters and create affinity messages" (0 ms), stage="Assign partitions states" (0 ms), stage="Validate partitions states" (0 ms), stage="Apply update counters" (0 ms), stage="Full message preparing" (1 ms), stage="Full message sending" (0 ms), stage="Exchange done" (11 ms), stage="Total time" (26 ms)] [21:12:48] : [Step 4/5] [2021-11-19 21:12:48,474][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint finished [cpId=4ee5046e-5051-44b7-9312-59e0efc7b551, pages=17, markPos=WALPointer [idx=0, fileOff=86538, len=1963], walSegmentsCovered=[], markDuration=42ms, pagesWrite=3ms, fsync=43ms, total=89ms] [21:12:48] : [Step 4/5] [2021-11-19 21:12:48,474][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint finished [cpId=9ed3f23a-98ba-487d-ae37-5b49364dbf9f, pages=17, markPos=WALPointer [idx=0, fileOff=86538, len=1963], walSegmentsCovered=[], markDuration=40ms, pagesWrite=3ms, fsync=44ms, total=87ms] [21:12:48] : [Step 4/5] [2021-11-19 21:12:48,465][INFO ][disco-notifier-worker-#24425%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=1] [21:12:48] : [Step 4/5] [2021-11-19 21:12:48,465][INFO ][disco-notifier-worker-#24306%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=1] [21:12:48] : [Step 4/5] [2021-11-19 21:12:48,462][INFO ][exchange-worker-#24434%grid-1%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=2, minorTopVer=2], force=false, evt=DISCOVERY_CUSTOM_EVT, node=00cce8f9-a2b3-4d32-a95a-7f6eb6335000] [21:12:48] : [Step 4/5] [2021-11-19 21:12:48,477][INFO ][reencrypt-#24467%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:12:48] : [Step 4/5] [2021-11-19 21:12:48,477][INFO ][reencrypt-#24466%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:12:48] : [Step 4/5] [2021-11-19 21:12:48,475][INFO ][sys-#24290%grid-0%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], stage="Affinity initialization on cache group start [grp=encrypted]" (0 ms) (parent=Affinity initialization on cache group start), stage="Restore partition states [grp=ignite-sys-cache]" (0 ms) (parent=Restore partition states), stage="Restore partition states [grp=encrypted]" (0 ms) (parent=Restore partition states)] [21:12:48] : [Step 4/5] [2021-11-19 21:12:48,678][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10b6f63c-e31c-4573-a225-9f76f500c001, grp=1613773252] [21:12:48] : [Step 4/5] [2021-11-19 21:12:48,769][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint started [checkpointId=8bd7042a-5b04-4961-ad53-b5eefb91df97, startPtr=WALPointer [idx=0, fileOff=116556, len=2048], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=80ms, writeCheckpointEntryDuration=9ms, splitAndSortCpPagesDuration=0ms, pages=13, reason='test'] [21:12:48] : [Step 4/5] [2021-11-19 21:12:48,794][INFO ][db-checkpoint-thread-#24450%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:12:48] : [Step 4/5] [2021-11-19 21:12:48,795][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint finished [cpId=8bd7042a-5b04-4961-ad53-b5eefb91df97, pages=13, markPos=WALPointer [idx=0, fileOff=116556, len=2048], walSegmentsCovered=[], markDuration=90ms, pagesWrite=1ms, fsync=25ms, total=116ms] [21:12:48] : [Step 4/5] [2021-11-19 21:12:48,795][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00cce8f9-a2b3-4d32-a95a-7f6eb6335000, grp=1613773252] [21:12:48] : [Step 4/5] [2021-11-19 21:12:48,803][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint started [checkpointId=0fe9abdb-62f0-4552-a9b5-a781b61764af, startPtr=WALPointer [idx=0, fileOff=116240, len=2010], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=6ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=0ms, pages=13, reason='test'] [21:12:48] : [Step 4/5] [2021-11-19 21:12:48,830][INFO ][db-checkpoint-thread-#24445%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:12:48] : [Step 4/5] [2021-11-19 21:12:48,830][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint finished [cpId=0fe9abdb-62f0-4552-a9b5-a781b61764af, pages=13, markPos=WALPointer [idx=0, fileOff=116240, len=2010], walSegmentsCovered=[], markDuration=8ms, pagesWrite=3ms, fsync=23ms, total=34ms] [21:12:48] : [Step 4/5] [2021-11-19 21:12:48,832][INFO ][disco-notifier-worker-#24306%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=2] [21:12:48] : [Step 4/5] [2021-11-19 21:12:48,833][INFO ][reencrypt-#24467%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:12:48] : [Step 4/5] [2021-11-19 21:12:48,833][INFO ][disco-notifier-worker-#24425%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=2] [21:12:48] : [Step 4/5] [2021-11-19 21:12:48,833][INFO ][reencrypt-#24466%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:12:49] : [Step 4/5] [2021-11-19 21:12:49,034][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10b6f63c-e31c-4573-a225-9f76f500c001, grp=1613773252] [21:12:49] : [Step 4/5] [2021-11-19 21:12:49,181][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint started [checkpointId=6a540611-fa90-4957-9c0f-a1d570a07f0b, startPtr=WALPointer [idx=0, fileOff=169620, len=2048], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=145ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=0ms, pages=13, reason='test'] [21:12:49] : [Step 4/5] [2021-11-19 21:12:49,199][INFO ][db-checkpoint-thread-#24450%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:12:49] : [Step 4/5] [2021-11-19 21:12:49,199][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint finished [cpId=6a540611-fa90-4957-9c0f-a1d570a07f0b, pages=13, markPos=WALPointer [idx=0, fileOff=169620, len=2048], walSegmentsCovered=[], markDuration=147ms, pagesWrite=0ms, fsync=17ms, total=164ms] [21:12:49] : [Step 4/5] [2021-11-19 21:12:49,200][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00cce8f9-a2b3-4d32-a95a-7f6eb6335000, grp=1613773252] [21:12:49] : [Step 4/5] [2021-11-19 21:12:49,208][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint started [checkpointId=6054d19d-a99b-45e7-b7a8-f9432f6be4ca, startPtr=WALPointer [idx=0, fileOff=169266, len=2010], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=6ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=0ms, pages=13, reason='test'] [21:12:49] : [Step 4/5] [2021-11-19 21:12:49,225][INFO ][db-checkpoint-thread-#24445%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:12:49] : [Step 4/5] [2021-11-19 21:12:49,226][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint finished [cpId=6054d19d-a99b-45e7-b7a8-f9432f6be4ca, pages=13, markPos=WALPointer [idx=0, fileOff=169266, len=2010], walSegmentsCovered=[], markDuration=7ms, pagesWrite=1ms, fsync=17ms, total=25ms] [21:12:49] : [Step 4/5] [2021-11-19 21:12:49,228][INFO ][disco-notifier-worker-#24306%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=3] [21:12:49] : [Step 4/5] [2021-11-19 21:12:49,228][INFO ][disco-notifier-worker-#24425%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=3] [21:12:49] : [Step 4/5] [2021-11-19 21:12:49,228][INFO ][reencrypt-#24467%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:12:49] : [Step 4/5] [2021-11-19 21:12:49,229][INFO ][reencrypt-#24466%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:12:49] : [Step 4/5] [2021-11-19 21:12:49,430][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10b6f63c-e31c-4573-a225-9f76f500c001, grp=1613773252] [21:12:49] : [Step 4/5] [2021-11-19 21:12:49,433][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint started [checkpointId=086ee440-25d0-42a2-98f0-f0457a7d16ce, startPtr=WALPointer [idx=0, fileOff=223544, len=2048], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=1ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=0ms, writeCheckpointEntryDuration=2ms, splitAndSortCpPagesDuration=0ms, pages=13, reason='test'] [21:12:49] : [Step 4/5] [2021-11-19 21:12:49,450][INFO ][db-checkpoint-thread-#24450%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:12:49] : [Step 4/5] [2021-11-19 21:12:49,451][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint finished [cpId=086ee440-25d0-42a2-98f0-f0457a7d16ce, pages=13, markPos=WALPointer [idx=0, fileOff=223544, len=2048], walSegmentsCovered=[], markDuration=3ms, pagesWrite=1ms, fsync=17ms, total=21ms] [21:12:49] : [Step 4/5] [2021-11-19 21:12:49,451][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00cce8f9-a2b3-4d32-a95a-7f6eb6335000, grp=1613773252] [21:12:49] : [Step 4/5] [2021-11-19 21:12:49,459][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint started [checkpointId=7634130d-708b-422e-928d-9ef83cc8c5ed, startPtr=WALPointer [idx=0, fileOff=223152, len=2010], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=6ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=0ms, pages=13, reason='test'] [21:12:49] : [Step 4/5] [2021-11-19 21:12:49,477][INFO ][db-checkpoint-thread-#24445%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:12:49] : [Step 4/5] [2021-11-19 21:12:49,477][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint finished [cpId=7634130d-708b-422e-928d-9ef83cc8c5ed, pages=13, markPos=WALPointer [idx=0, fileOff=223152, len=2010], walSegmentsCovered=[], markDuration=9ms, pagesWrite=1ms, fsync=15ms, total=25ms] [21:12:49] : [Step 4/5] [2021-11-19 21:12:49,479][INFO ][disco-notifier-worker-#24306%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=4] [21:12:49] : [Step 4/5] [2021-11-19 21:12:49,480][INFO ][disco-notifier-worker-#24425%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=4] [21:12:49] : [Step 4/5] [2021-11-19 21:12:49,480][INFO ][reencrypt-#24467%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:12:49] : [Step 4/5] [2021-11-19 21:12:49,480][INFO ][reencrypt-#24466%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:12:49] : [Step 4/5] [2021-11-19 21:12:49,681][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10b6f63c-e31c-4573-a225-9f76f500c001, grp=1613773252] [21:12:49] : [Step 4/5] [2021-11-19 21:12:49,818][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint started [checkpointId=45cf7eae-c334-4d00-af4e-82934a0d4171, startPtr=WALPointer [idx=0, fileOff=282951, len=2048], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=134ms, writeCheckpointEntryDuration=2ms, splitAndSortCpPagesDuration=0ms, pages=14, reason='test'] [21:12:49] : [Step 4/5] [2021-11-19 21:12:49,835][INFO ][db-checkpoint-thread-#24450%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:12:49] : [Step 4/5] [2021-11-19 21:12:49,836][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint finished [cpId=45cf7eae-c334-4d00-af4e-82934a0d4171, pages=14, markPos=WALPointer [idx=0, fileOff=282951, len=2048], walSegmentsCovered=[], markDuration=136ms, pagesWrite=1ms, fsync=17ms, total=155ms] [21:12:49] : [Step 4/5] [2021-11-19 21:12:49,836][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00cce8f9-a2b3-4d32-a95a-7f6eb6335000, grp=1613773252] [21:12:49] : [Step 4/5] [2021-11-19 21:12:49,844][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint started [checkpointId=434701a0-1b3e-4889-9def-615dc4c06388, startPtr=WALPointer [idx=0, fileOff=282521, len=2010], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=6ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=0ms, pages=14, reason='test'] [21:12:49] : [Step 4/5] [2021-11-19 21:12:49,862][INFO ][db-checkpoint-thread-#24445%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:12:49] : [Step 4/5] [2021-11-19 21:12:49,862][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint finished [cpId=434701a0-1b3e-4889-9def-615dc4c06388, pages=14, markPos=WALPointer [idx=0, fileOff=282521, len=2010], walSegmentsCovered=[], markDuration=8ms, pagesWrite=1ms, fsync=16ms, total=25ms] [21:12:49] : [Step 4/5] [2021-11-19 21:12:49,866][INFO ][disco-notifier-worker-#24306%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=5] [21:12:49] : [Step 4/5] [2021-11-19 21:12:49,866][INFO ][disco-notifier-worker-#24425%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=5] [21:12:49] : [Step 4/5] [2021-11-19 21:12:49,866][INFO ][reencrypt-#24467%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:12:49] : [Step 4/5] [2021-11-19 21:12:49,866][INFO ][reencrypt-#24466%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:12:50] : [Step 4/5] [2021-11-19 21:12:50,067][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10b6f63c-e31c-4573-a225-9f76f500c001, grp=1613773252] [21:12:50] : [Step 4/5] [2021-11-19 21:12:50,268][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint started [checkpointId=3745ab54-3dd4-407f-8d6f-50f6c5079135, startPtr=WALPointer [idx=0, fileOff=346200, len=2048], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=43ms, writeCheckpointEntryDuration=157ms, splitAndSortCpPagesDuration=0ms, pages=14, reason='test'] [21:12:50] : [Step 4/5] [2021-11-19 21:12:50,286][INFO ][db-checkpoint-thread-#24450%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:12:50] : [Step 4/5] [2021-11-19 21:12:50,286][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint finished [cpId=3745ab54-3dd4-407f-8d6f-50f6c5079135, pages=14, markPos=WALPointer [idx=0, fileOff=346200, len=2048], walSegmentsCovered=[], markDuration=201ms, pagesWrite=1ms, fsync=16ms, total=218ms] [21:12:50] : [Step 4/5] [2021-11-19 21:12:50,287][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00cce8f9-a2b3-4d32-a95a-7f6eb6335000, grp=1613773252] [21:12:50] : [Step 4/5] [2021-11-19 21:12:50,295][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint started [checkpointId=b174d3e0-f707-44a9-9ab8-f1939d56a148, startPtr=WALPointer [idx=0, fileOff=345732, len=2010], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=5ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=0ms, pages=14, reason='test'] [21:12:50] : [Step 4/5] [2021-11-19 21:12:50,312][INFO ][db-checkpoint-thread-#24445%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:12:50] : [Step 4/5] [2021-11-19 21:12:50,312][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint finished [cpId=b174d3e0-f707-44a9-9ab8-f1939d56a148, pages=14, markPos=WALPointer [idx=0, fileOff=345732, len=2010], walSegmentsCovered=[], markDuration=7ms, pagesWrite=1ms, fsync=16ms, total=25ms] [21:12:50] : [Step 4/5] [2021-11-19 21:12:50,315][INFO ][disco-notifier-worker-#24306%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=6] [21:12:50] : [Step 4/5] [2021-11-19 21:12:50,315][INFO ][disco-notifier-worker-#24425%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=6] [21:12:50] : [Step 4/5] [2021-11-19 21:12:50,316][INFO ][reencrypt-#24467%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:12:50] : [Step 4/5] [2021-11-19 21:12:50,316][INFO ][reencrypt-#24466%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:12:50] : [Step 4/5] [2021-11-19 21:12:50,517][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10b6f63c-e31c-4573-a225-9f76f500c001, grp=1613773252] [21:12:50] : [Step 4/5] [2021-11-19 21:12:50,811][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint started [checkpointId=8389b877-3465-4ad6-acad-5999ea0b4aa9, startPtr=WALPointer [idx=0, fileOff=411023, len=2048], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=112ms, writeCheckpointEntryDuration=181ms, splitAndSortCpPagesDuration=0ms, pages=14, reason='test'] [21:12:51] : [Step 4/5] [2021-11-19 21:12:51,005][INFO ][db-checkpoint-thread-#24450%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:12:51] : [Step 4/5] [2021-11-19 21:12:51,006][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint finished [cpId=8389b877-3465-4ad6-acad-5999ea0b4aa9, pages=14, markPos=WALPointer [idx=0, fileOff=411023, len=2048], walSegmentsCovered=[], markDuration=294ms, pagesWrite=0ms, fsync=194ms, total=489ms] [21:12:51] : [Step 4/5] [2021-11-19 21:12:51,006][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00cce8f9-a2b3-4d32-a95a-7f6eb6335000, grp=1613773252] [21:12:51] : [Step 4/5] [2021-11-19 21:12:51,014][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint started [checkpointId=d35bfb13-c025-4e76-961a-23f058a3410e, startPtr=WALPointer [idx=0, fileOff=410517, len=2010], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=5ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=0ms, pages=14, reason='test'] [21:12:51] : [Step 4/5] [2021-11-19 21:12:51,032][INFO ][db-checkpoint-thread-#24445%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:12:51] : [Step 4/5] [2021-11-19 21:12:51,032][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint finished [cpId=d35bfb13-c025-4e76-961a-23f058a3410e, pages=14, markPos=WALPointer [idx=0, fileOff=410517, len=2010], walSegmentsCovered=[], markDuration=8ms, pagesWrite=0ms, fsync=17ms, total=25ms] [21:12:51] : [Step 4/5] [2021-11-19 21:12:51,035][INFO ][disco-notifier-worker-#24306%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=7] [21:12:51] : [Step 4/5] [2021-11-19 21:12:51,035][INFO ][disco-notifier-worker-#24425%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=7] [21:12:51] : [Step 4/5] [2021-11-19 21:12:51,035][INFO ][reencrypt-#24467%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:12:51] : [Step 4/5] [2021-11-19 21:12:51,036][INFO ][reencrypt-#24466%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:12:51] : [Step 4/5] [2021-11-19 21:12:51,237][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10b6f63c-e31c-4573-a225-9f76f500c001, grp=1613773252] [21:12:51] : [Step 4/5] [2021-11-19 21:12:51,421][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint started [checkpointId=fce5d3bc-fcd6-4bbf-b6f5-3752f4814faa, startPtr=WALPointer [idx=0, fileOff=477420, len=2048], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=67ms, writeCheckpointEntryDuration=115ms, splitAndSortCpPagesDuration=0ms, pages=14, reason='test'] [21:12:51] : [Step 4/5] [2021-11-19 21:12:51,919][INFO ][db-checkpoint-thread-#24450%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:12:51] : [Step 4/5] [2021-11-19 21:12:51,919][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint finished [cpId=fce5d3bc-fcd6-4bbf-b6f5-3752f4814faa, pages=14, markPos=WALPointer [idx=0, fileOff=477420, len=2048], walSegmentsCovered=[], markDuration=183ms, pagesWrite=1ms, fsync=497ms, total=682ms] [21:12:51] : [Step 4/5] [2021-11-19 21:12:51,919][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00cce8f9-a2b3-4d32-a95a-7f6eb6335000, grp=1613773252] [21:12:51] : [Step 4/5] [2021-11-19 21:12:51,923][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint started [checkpointId=9763e6da-cd49-4826-bea2-f39a020660c1, startPtr=WALPointer [idx=0, fileOff=476876, len=2010], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=1ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=0ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=0ms, pages=14, reason='test'] [21:12:51] : [Step 4/5] [2021-11-19 21:12:51,940][INFO ][db-checkpoint-thread-#24445%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:12:51] : [Step 4/5] [2021-11-19 21:12:51,940][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint finished [cpId=9763e6da-cd49-4826-bea2-f39a020660c1, pages=14, markPos=WALPointer [idx=0, fileOff=476876, len=2010], walSegmentsCovered=[], markDuration=4ms, pagesWrite=0ms, fsync=16ms, total=20ms] [21:12:51] : [Step 4/5] [2021-11-19 21:12:51,943][INFO ][disco-notifier-worker-#24306%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=8] [21:12:51] : [Step 4/5] [2021-11-19 21:12:51,944][INFO ][disco-notifier-worker-#24425%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=8] [21:12:51] : [Step 4/5] [2021-11-19 21:12:51,944][INFO ][reencrypt-#24467%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:12:51] : [Step 4/5] [2021-11-19 21:12:51,944][INFO ][reencrypt-#24466%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:12:52] : [Step 4/5] [2021-11-19 21:12:52,145][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10b6f63c-e31c-4573-a225-9f76f500c001, grp=1613773252] [21:12:52] : [Step 4/5] [2021-11-19 21:12:52,345][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint started [checkpointId=c63bd8a0-bb8b-401c-ba2e-d604d04cf960, startPtr=WALPointer [idx=0, fileOff=545391, len=2048], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=137ms, writeCheckpointEntryDuration=62ms, splitAndSortCpPagesDuration=0ms, pages=14, reason='test'] [21:12:52] : [Step 4/5] [2021-11-19 21:12:52,616][INFO ][db-checkpoint-thread-#24450%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:12:52] : [Step 4/5] [2021-11-19 21:12:52,616][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint finished [cpId=c63bd8a0-bb8b-401c-ba2e-d604d04cf960, pages=14, markPos=WALPointer [idx=0, fileOff=545391, len=2048], walSegmentsCovered=[], markDuration=200ms, pagesWrite=1ms, fsync=269ms, total=470ms] [21:12:52] : [Step 4/5] [2021-11-19 21:12:52,617][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00cce8f9-a2b3-4d32-a95a-7f6eb6335000, grp=1613773252] [21:12:52] : [Step 4/5] [2021-11-19 21:12:52,626][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint started [checkpointId=ddaf90c6-4c62-4cfb-a3fb-0dc4c8e82bf8, startPtr=WALPointer [idx=0, fileOff=544809, len=2010], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=6ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=1ms, pages=14, reason='test'] [21:12:52] : [Step 4/5] [2021-11-19 21:12:52,644][INFO ][db-checkpoint-thread-#24445%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:12:52] : [Step 4/5] [2021-11-19 21:12:52,645][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint finished [cpId=ddaf90c6-4c62-4cfb-a3fb-0dc4c8e82bf8, pages=14, markPos=WALPointer [idx=0, fileOff=544809, len=2010], walSegmentsCovered=[], markDuration=9ms, pagesWrite=0ms, fsync=18ms, total=28ms] [21:12:52] : [Step 4/5] [2021-11-19 21:12:52,648][INFO ][disco-notifier-worker-#24306%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=9] [21:12:52] : [Step 4/5] [2021-11-19 21:12:52,649][INFO ][disco-notifier-worker-#24425%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=9] [21:12:52] : [Step 4/5] [2021-11-19 21:12:52,649][INFO ][reencrypt-#24467%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:12:52] : [Step 4/5] [2021-11-19 21:12:52,649][INFO ][reencrypt-#24466%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:12:52] : [Step 4/5] [2021-11-19 21:12:52,850][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10b6f63c-e31c-4573-a225-9f76f500c001, grp=1613773252] [21:12:53] : [Step 4/5] [2021-11-19 21:12:53,073][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint started [checkpointId=bd980738-c531-44b5-a2c4-07b277fda2d2, startPtr=WALPointer [idx=0, fileOff=615338, len=2048], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=1ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=34ms, writeCheckpointEntryDuration=187ms, splitAndSortCpPagesDuration=0ms, pages=14, reason='test'] [21:12:53] : [Step 4/5] [2021-11-19 21:12:53,348][INFO ][db-checkpoint-thread-#24450%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:12:53] : [Step 4/5] [2021-11-19 21:12:53,348][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint finished [cpId=bd980738-c531-44b5-a2c4-07b277fda2d2, pages=14, markPos=WALPointer [idx=0, fileOff=615338, len=2048], walSegmentsCovered=[], markDuration=223ms, pagesWrite=0ms, fsync=274ms, total=497ms] [21:12:53] : [Step 4/5] [2021-11-19 21:12:53,349][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00cce8f9-a2b3-4d32-a95a-7f6eb6335000, grp=1613773252] [21:12:53] : [Step 4/5] [2021-11-19 21:12:53,357][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint started [checkpointId=2b61c896-6817-4a81-af22-407f72b45da4, startPtr=WALPointer [idx=0, fileOff=614718, len=2010], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=6ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=0ms, pages=14, reason='test'] [21:12:53] : [Step 4/5] [2021-11-19 21:12:53,375][INFO ][db-checkpoint-thread-#24445%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:12:53] : [Step 4/5] [2021-11-19 21:12:53,375][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint finished [cpId=2b61c896-6817-4a81-af22-407f72b45da4, pages=14, markPos=WALPointer [idx=0, fileOff=614718, len=2010], walSegmentsCovered=[], markDuration=8ms, pagesWrite=0ms, fsync=17ms, total=25ms] [21:12:53] : [Step 4/5] [2021-11-19 21:12:53,378][INFO ][disco-notifier-worker-#24306%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=10] [21:12:53] : [Step 4/5] [2021-11-19 21:12:53,379][INFO ][disco-notifier-worker-#24425%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=10] [21:12:53] : [Step 4/5] [2021-11-19 21:12:53,379][INFO ][reencrypt-#24467%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:12:53] : [Step 4/5] [2021-11-19 21:12:53,379][INFO ][reencrypt-#24466%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:12:53] : [Step 4/5] [2021-11-19 21:12:53,580][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10b6f63c-e31c-4573-a225-9f76f500c001, grp=1613773252] [21:12:53] : [Step 4/5] [2021-11-19 21:12:53,928][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint started [checkpointId=366670c0-0d8c-4457-bb5a-9b5acd101a1f, startPtr=WALPointer [idx=0, fileOff=690840, len=2048], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=1ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=145ms, writeCheckpointEntryDuration=201ms, splitAndSortCpPagesDuration=0ms, pages=14, reason='test'] [21:12:54] : [Step 4/5] [2021-11-19 21:12:54,284][INFO ][db-checkpoint-thread-#24450%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:12:54] : [Step 4/5] [2021-11-19 21:12:54,285][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint finished [cpId=366670c0-0d8c-4457-bb5a-9b5acd101a1f, pages=14, markPos=WALPointer [idx=0, fileOff=690840, len=2048], walSegmentsCovered=[], markDuration=348ms, pagesWrite=0ms, fsync=356ms, total=704ms] [21:12:54] : [Step 4/5] [2021-11-19 21:12:54,285][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00cce8f9-a2b3-4d32-a95a-7f6eb6335000, grp=1613773252] [21:12:54] : [Step 4/5] [2021-11-19 21:12:54,301][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint started [checkpointId=bd1fc77f-4bd8-423a-a037-03a03b356b31, startPtr=WALPointer [idx=0, fileOff=690182, len=2010], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=5ms, writeCheckpointEntryDuration=9ms, splitAndSortCpPagesDuration=0ms, pages=14, reason='test'] [21:12:54] : [Step 4/5] [2021-11-19 21:12:54,319][INFO ][db-checkpoint-thread-#24445%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:12:54] : [Step 4/5] [2021-11-19 21:12:54,319][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint finished [cpId=bd1fc77f-4bd8-423a-a037-03a03b356b31, pages=14, markPos=WALPointer [idx=0, fileOff=690182, len=2010], walSegmentsCovered=[], markDuration=16ms, pagesWrite=1ms, fsync=16ms, total=33ms] [21:12:54] : [Step 4/5] [2021-11-19 21:12:54,323][INFO ][disco-notifier-worker-#24306%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=11] [21:12:54] : [Step 4/5] [2021-11-19 21:12:54,323][INFO ][reencrypt-#24467%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:12:54] : [Step 4/5] [2021-11-19 21:12:54,323][INFO ][disco-notifier-worker-#24425%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=11] [21:12:54] : [Step 4/5] [2021-11-19 21:12:54,324][INFO ][reencrypt-#24466%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:12:54] : [Step 4/5] [2021-11-19 21:12:54,328][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10b6f63c-e31c-4573-a225-9f76f500c001, grp=1613773252] [21:12:54] : [Step 4/5] [2021-11-19 21:12:54,332][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint started [checkpointId=8714371c-39f0-42cf-99ea-b5c612c2668c, startPtr=WALPointer [idx=0, fileOff=767527, len=2048], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=1ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=0ms, writeCheckpointEntryDuration=2ms, splitAndSortCpPagesDuration=0ms, pages=15, reason='test'] [21:12:54] : [Step 4/5] [2021-11-19 21:12:54,349][INFO ][db-checkpoint-thread-#24450%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:12:54] : [Step 4/5] [2021-11-19 21:12:54,350][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint finished [cpId=8714371c-39f0-42cf-99ea-b5c612c2668c, pages=15, markPos=WALPointer [idx=0, fileOff=767527, len=2048], walSegmentsCovered=[], markDuration=4ms, pagesWrite=1ms, fsync=16ms, total=21ms] [21:12:54] : [Step 4/5] [2021-11-19 21:12:54,350][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00cce8f9-a2b3-4d32-a95a-7f6eb6335000, grp=1613773252] [21:12:54] : [Step 4/5] [2021-11-19 21:12:54,359][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint started [checkpointId=4630d631-fd5d-4359-a706-36e2eec6d28a, startPtr=WALPointer [idx=0, fileOff=766831, len=2010], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=6ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=0ms, pages=15, reason='test'] [21:12:54] : [Step 4/5] [2021-11-19 21:12:54,376][INFO ][db-checkpoint-thread-#24445%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:12:54] : [Step 4/5] [2021-11-19 21:12:54,376][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint finished [cpId=4630d631-fd5d-4359-a706-36e2eec6d28a, pages=15, markPos=WALPointer [idx=0, fileOff=766831, len=2010], walSegmentsCovered=[], markDuration=8ms, pagesWrite=1ms, fsync=16ms, total=26ms] [21:12:54] : [Step 4/5] [2021-11-19 21:12:54,386][INFO ][disco-notifier-worker-#24425%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=12] [21:12:54] : [Step 4/5] [2021-11-19 21:12:54,386][INFO ][disco-notifier-worker-#24306%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=12] [21:12:54] : [Step 4/5] [2021-11-19 21:12:54,386][INFO ][reencrypt-#24466%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:12:54] : [Step 4/5] [2021-11-19 21:12:54,387][INFO ][reencrypt-#24467%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:12:54] : [Step 4/5] [2021-11-19 21:12:54,588][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10b6f63c-e31c-4573-a225-9f76f500c001, grp=1613773252] [21:12:54] : [Step 4/5] [2021-11-19 21:12:54,765][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint started [checkpointId=8b01b723-e275-42a2-8e09-cdc2ddb66da4, startPtr=WALPointer [idx=0, fileOff=849465, len=2048], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=122ms, writeCheckpointEntryDuration=54ms, splitAndSortCpPagesDuration=0ms, pages=15, reason='test'] [21:12:55] : [Step 4/5] [2021-11-19 21:12:55,377][INFO ][db-checkpoint-thread-#24450%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:12:55] : [Step 4/5] [2021-11-19 21:12:55,377][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint finished [cpId=8b01b723-e275-42a2-8e09-cdc2ddb66da4, pages=15, markPos=WALPointer [idx=0, fileOff=849465, len=2048], walSegmentsCovered=[], markDuration=177ms, pagesWrite=1ms, fsync=610ms, total=789ms] [21:12:55] : [Step 4/5] [2021-11-19 21:12:55,378][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00cce8f9-a2b3-4d32-a95a-7f6eb6335000, grp=1613773252] [21:12:55] : [Step 4/5] [2021-11-19 21:12:55,385][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint started [checkpointId=dd7fe983-6c8b-4a11-9a32-6ffc238cf131, startPtr=WALPointer [idx=0, fileOff=848731, len=2010], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=4ms, writeCheckpointEntryDuration=2ms, splitAndSortCpPagesDuration=0ms, pages=15, reason='test'] [21:12:55] : [Step 4/5] [2021-11-19 21:12:55,403][INFO ][db-checkpoint-thread-#24445%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:12:55] : [Step 4/5] [2021-11-19 21:12:55,403][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint finished [cpId=dd7fe983-6c8b-4a11-9a32-6ffc238cf131, pages=15, markPos=WALPointer [idx=0, fileOff=848731, len=2010], walSegmentsCovered=[], markDuration=7ms, pagesWrite=1ms, fsync=16ms, total=24ms] [21:12:55] : [Step 4/5] [2021-11-19 21:12:55,406][INFO ][disco-notifier-worker-#24306%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=13] [21:12:55] : [Step 4/5] [2021-11-19 21:12:55,407][INFO ][disco-notifier-worker-#24425%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=13] [21:12:55] : [Step 4/5] [2021-11-19 21:12:55,407][INFO ][reencrypt-#24467%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:12:55] : [Step 4/5] [2021-11-19 21:12:55,407][INFO ][reencrypt-#24466%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:12:55] : [Step 4/5] [2021-11-19 21:12:55,608][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10b6f63c-e31c-4573-a225-9f76f500c001, grp=1613773252] [21:12:55] : [Step 4/5] [2021-11-19 21:12:55,824][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint started [checkpointId=5f6b9d4a-502d-4c1c-ad2a-ed747808a2d6, startPtr=WALPointer [idx=0, fileOff=928000, len=2048], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=73ms, writeCheckpointEntryDuration=142ms, splitAndSortCpPagesDuration=0ms, pages=15, reason='test'] [21:12:56] : [Step 4/5] [2021-11-19 21:12:56,449][INFO ][db-checkpoint-thread-#24450%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:12:56] : [Step 4/5] [2021-11-19 21:12:56,450][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint finished [cpId=5f6b9d4a-502d-4c1c-ad2a-ed747808a2d6, pages=15, markPos=WALPointer [idx=0, fileOff=928000, len=2048], walSegmentsCovered=[], markDuration=216ms, pagesWrite=0ms, fsync=625ms, total=841ms] [21:12:56] : [Step 4/5] [2021-11-19 21:12:56,450][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00cce8f9-a2b3-4d32-a95a-7f6eb6335000, grp=1613773252] [21:12:56] : [Step 4/5] [2021-11-19 21:12:56,458][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint started [checkpointId=44abc59d-1270-4477-94ad-ab2cb06f6745, startPtr=WALPointer [idx=0, fileOff=927228, len=2010], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=5ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=0ms, pages=15, reason='test'] [21:12:56] : [Step 4/5] [2021-11-19 21:12:56,476][INFO ][db-checkpoint-thread-#24445%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:12:56] : [Step 4/5] [2021-11-19 21:12:56,476][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint finished [cpId=44abc59d-1270-4477-94ad-ab2cb06f6745, pages=15, markPos=WALPointer [idx=0, fileOff=927228, len=2010], walSegmentsCovered=[], markDuration=7ms, pagesWrite=1ms, fsync=16ms, total=25ms] [21:12:56] : [Step 4/5] [2021-11-19 21:12:56,479][INFO ][disco-notifier-worker-#24306%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=14] [21:12:56] : [Step 4/5] [2021-11-19 21:12:56,479][INFO ][disco-notifier-worker-#24425%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=14] [21:12:56] : [Step 4/5] [2021-11-19 21:12:56,480][INFO ][reencrypt-#24467%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:12:56] : [Step 4/5] [2021-11-19 21:12:56,480][INFO ][reencrypt-#24466%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:12:56] : [Step 4/5] [2021-11-19 21:12:56,681][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10b6f63c-e31c-4573-a225-9f76f500c001, grp=1613773252] [21:12:57] : [Step 4/5] [2021-11-19 21:12:57,030][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint started [checkpointId=0e87acac-30c3-4396-a38b-37b13f6219c5, startPtr=WALPointer [idx=0, fileOff=1012354, len=2048], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=108ms, writeCheckpointEntryDuration=240ms, splitAndSortCpPagesDuration=0ms, pages=15, reason='test'] [21:12:57] : [Step 4/5] [2021-11-19 21:12:57,610][INFO ][db-checkpoint-thread-#24450%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:12:57] : [Step 4/5] [2021-11-19 21:12:57,611][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint finished [cpId=0e87acac-30c3-4396-a38b-37b13f6219c5, pages=15, markPos=WALPointer [idx=0, fileOff=1012354, len=2048], walSegmentsCovered=[], markDuration=349ms, pagesWrite=1ms, fsync=578ms, total=928ms] [21:12:57] : [Step 4/5] [2021-11-19 21:12:57,611][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00cce8f9-a2b3-4d32-a95a-7f6eb6335000, grp=1613773252] [21:12:57] : [Step 4/5] [2021-11-19 21:12:57,614][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint started [checkpointId=5f308b75-7218-4731-87f3-fd7bb58d5d21, startPtr=WALPointer [idx=0, fileOff=1011544, len=2010], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=1ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=0ms, pages=15, reason='test'] [21:12:57] : [Step 4/5] [2021-11-19 21:12:57,631][INFO ][db-checkpoint-thread-#24445%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:12:57] : [Step 4/5] [2021-11-19 21:12:57,632][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint finished [cpId=5f308b75-7218-4731-87f3-fd7bb58d5d21, pages=15, markPos=WALPointer [idx=0, fileOff=1011544, len=2010], walSegmentsCovered=[], markDuration=3ms, pagesWrite=0ms, fsync=17ms, total=20ms] [21:12:57] : [Step 4/5] [2021-11-19 21:12:57,640][INFO ][wal-file-archiver%grid-0-#24437%grid-0%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=0, segIdx=0, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000000.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000000.wal] [21:12:57] : [Step 4/5] [2021-11-19 21:12:57,640][INFO ][wal-file-archiver%grid-1-#24440%grid-1%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=0, segIdx=0, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000000.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000000.wal] [21:12:57] : [Step 4/5] [2021-11-19 21:12:57,641][INFO ][disco-notifier-worker-#24306%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=15] [21:12:57] : [Step 4/5] [2021-11-19 21:12:57,641][INFO ][disco-notifier-worker-#24425%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=15] [21:12:57] : [Step 4/5] [2021-11-19 21:12:57,641][INFO ][reencrypt-#24467%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:12:57] : [Step 4/5] [2021-11-19 21:12:57,642][INFO ][reencrypt-#24466%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:12:57] : [Step 4/5] [2021-11-19 21:12:57,657][INFO ][wal-file-archiver%grid-0-#24437%grid-0%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000000.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000000.wal] [21:12:57] : [Step 4/5] [2021-11-19 21:12:57,657][INFO ][wal-file-archiver%grid-1-#24440%grid-1%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000000.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000000.wal] [21:12:57] : [Step 4/5] [2021-11-19 21:12:57,843][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10b6f63c-e31c-4573-a225-9f76f500c001, grp=1613773252] [21:12:58] : [Step 4/5] [2021-11-19 21:12:58,076][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint started [checkpointId=3c47e180-a147-4303-9007-59dbbf2a9024, startPtr=WALPointer [idx=1, fileOff=51755, len=2048], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=4ms, writeCheckpointEntryDuration=228ms, splitAndSortCpPagesDuration=0ms, pages=16, reason='test'] [21:12:58] : [Step 4/5] [2021-11-19 21:12:58,530][INFO ][db-checkpoint-thread-#24450%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:12:58] : [Step 4/5] [2021-11-19 21:12:58,530][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint finished [cpId=3c47e180-a147-4303-9007-59dbbf2a9024, pages=16, markPos=WALPointer [idx=1, fileOff=51755, len=2048], walSegmentsCovered=[0], markDuration=233ms, pagesWrite=1ms, fsync=452ms, total=687ms] [21:12:58] : [Step 4/5] [2021-11-19 21:12:58,530][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00cce8f9-a2b3-4d32-a95a-7f6eb6335000, grp=1613773252] [21:12:58] : [Step 4/5] [2021-11-19 21:12:58,547][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint started [checkpointId=eb88b51e-3785-4935-8027-6699202098e0, startPtr=WALPointer [idx=1, fileOff=51755, len=2010], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=1ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=6ms, writeCheckpointEntryDuration=9ms, splitAndSortCpPagesDuration=0ms, pages=16, reason='test'] [21:12:58] : [Step 4/5] [2021-11-19 21:12:58,564][INFO ][db-checkpoint-thread-#24445%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:12:58] : [Step 4/5] [2021-11-19 21:12:58,564][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint finished [cpId=eb88b51e-3785-4935-8027-6699202098e0, pages=16, markPos=WALPointer [idx=1, fileOff=51755, len=2010], walSegmentsCovered=[0], markDuration=16ms, pagesWrite=1ms, fsync=16ms, total=33ms] [21:12:58] : [Step 4/5] [2021-11-19 21:12:58,568][INFO ][disco-notifier-worker-#24306%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=16] [21:12:58] : [Step 4/5] [2021-11-19 21:12:58,568][INFO ][disco-notifier-worker-#24425%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=16] [21:12:58] : [Step 4/5] [2021-11-19 21:12:58,568][INFO ][reencrypt-#24467%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:12:58] : [Step 4/5] [2021-11-19 21:12:58,569][INFO ][reencrypt-#24466%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:12:58] : [Step 4/5] [2021-11-19 21:12:58,770][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10b6f63c-e31c-4573-a225-9f76f500c001, grp=1613773252] [21:12:58] : [Step 4/5] [2021-11-19 21:12:58,976][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint started [checkpointId=6da3be95-30f5-4b91-9b73-5eda7030ab06, startPtr=WALPointer [idx=1, fileOff=145715, len=2048], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=100ms, writeCheckpointEntryDuration=105ms, splitAndSortCpPagesDuration=0ms, pages=16, reason='test'] [21:12:59] : [Step 4/5] [2021-11-19 21:12:59,300][INFO ][db-checkpoint-thread-#24450%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:12:59] : [Step 4/5] [2021-11-19 21:12:59,300][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint finished [cpId=6da3be95-30f5-4b91-9b73-5eda7030ab06, pages=16, markPos=WALPointer [idx=1, fileOff=145715, len=2048], walSegmentsCovered=[], markDuration=206ms, pagesWrite=0ms, fsync=323ms, total=530ms] [21:12:59] : [Step 4/5] [2021-11-19 21:12:59,300][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00cce8f9-a2b3-4d32-a95a-7f6eb6335000, grp=1613773252] [21:12:59] : [Step 4/5] [2021-11-19 21:12:59,310][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint started [checkpointId=72e1ee49-3299-44a8-97a7-d54c6c9995ce, startPtr=WALPointer [idx=1, fileOff=145677, len=2010], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=6ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=0ms, pages=16, reason='test'] [21:12:59] : [Step 4/5] [2021-11-19 21:12:59,326][INFO ][db-checkpoint-thread-#24445%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:12:59] : [Step 4/5] [2021-11-19 21:12:59,327][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint finished [cpId=72e1ee49-3299-44a8-97a7-d54c6c9995ce, pages=16, markPos=WALPointer [idx=1, fileOff=145677, len=2010], walSegmentsCovered=[], markDuration=8ms, pagesWrite=1ms, fsync=16ms, total=26ms] [21:12:59] : [Step 4/5] [2021-11-19 21:12:59,330][INFO ][disco-notifier-worker-#24306%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=17] [21:12:59] : [Step 4/5] [2021-11-19 21:12:59,330][INFO ][reencrypt-#24467%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:12:59] : [Step 4/5] [2021-11-19 21:12:59,331][INFO ][disco-notifier-worker-#24425%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=17] [21:12:59] : [Step 4/5] [2021-11-19 21:12:59,331][INFO ][reencrypt-#24466%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:12:59] : [Step 4/5] [2021-11-19 21:12:59,532][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10b6f63c-e31c-4573-a225-9f76f500c001, grp=1613773252] [21:12:59] : [Step 4/5] [2021-11-19 21:12:59,726][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint started [checkpointId=004406dc-5bc5-446e-a378-c70c34ffa6b3, startPtr=WALPointer [idx=1, fileOff=236493, len=2048], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=121ms, writeCheckpointEntryDuration=71ms, splitAndSortCpPagesDuration=1ms, pages=15, reason='test'] [21:12:59] : [Step 4/5] [2021-11-19 21:12:59,742][INFO ][db-checkpoint-thread-#24450%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:12:59] : [Step 4/5] [2021-11-19 21:12:59,743][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint finished [cpId=004406dc-5bc5-446e-a378-c70c34ffa6b3, pages=15, markPos=WALPointer [idx=1, fileOff=236493, len=2048], walSegmentsCovered=[], markDuration=193ms, pagesWrite=1ms, fsync=16ms, total=211ms] [21:12:59] : [Step 4/5] [2021-11-19 21:12:59,743][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00cce8f9-a2b3-4d32-a95a-7f6eb6335000, grp=1613773252] [21:12:59] : [Step 4/5] [2021-11-19 21:12:59,751][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint started [checkpointId=02b2862c-f241-4acd-9cc5-36ff1bfd16f6, startPtr=WALPointer [idx=1, fileOff=236417, len=2010], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=6ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=0ms, pages=15, reason='test'] [21:12:59] : [Step 4/5] [2021-11-19 21:12:59,769][INFO ][db-checkpoint-thread-#24445%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:12:59] : [Step 4/5] [2021-11-19 21:12:59,769][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint finished [cpId=02b2862c-f241-4acd-9cc5-36ff1bfd16f6, pages=15, markPos=WALPointer [idx=1, fileOff=236417, len=2010], walSegmentsCovered=[], markDuration=8ms, pagesWrite=0ms, fsync=17ms, total=25ms] [21:12:59] : [Step 4/5] [2021-11-19 21:12:59,773][INFO ][disco-notifier-worker-#24306%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=18] [21:12:59] : [Step 4/5] [2021-11-19 21:12:59,773][INFO ][disco-notifier-worker-#24425%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=18] [21:12:59] : [Step 4/5] [2021-11-19 21:12:59,773][INFO ][reencrypt-#24467%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:12:59] : [Step 4/5] [2021-11-19 21:12:59,774][INFO ][reencrypt-#24466%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:12:59] : [Step 4/5] [2021-11-19 21:12:59,975][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10b6f63c-e31c-4573-a225-9f76f500c001, grp=1613773252] [21:13:00] : [Step 4/5] [2021-11-19 21:13:00,206][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint started [checkpointId=536102e8-3513-4d50-ada0-c60d9a219992, startPtr=WALPointer [idx=1, fileOff=329692, len=2048], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=69ms, writeCheckpointEntryDuration=161ms, splitAndSortCpPagesDuration=0ms, pages=17, reason='test'] [21:13:00] : [Step 4/5] [2021-11-19 21:13:00,224][INFO ][db-checkpoint-thread-#24450%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:13:00] : [Step 4/5] [2021-11-19 21:13:00,225][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint finished [cpId=536102e8-3513-4d50-ada0-c60d9a219992, pages=17, markPos=WALPointer [idx=1, fileOff=329692, len=2048], walSegmentsCovered=[], markDuration=231ms, pagesWrite=1ms, fsync=17ms, total=250ms] [21:13:00] : [Step 4/5] [2021-11-19 21:13:00,225][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00cce8f9-a2b3-4d32-a95a-7f6eb6335000, grp=1613773252] [21:13:00] : [Step 4/5] [2021-11-19 21:13:00,233][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint started [checkpointId=fd168b3f-600c-48e7-b1a2-da196fcc094f, startPtr=WALPointer [idx=1, fileOff=329578, len=2010], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=1ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=5ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=0ms, pages=17, reason='test'] [21:13:00] : [Step 4/5] [2021-11-19 21:13:00,250][INFO ][db-checkpoint-thread-#24445%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:13:00] : [Step 4/5] [2021-11-19 21:13:00,251][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint finished [cpId=fd168b3f-600c-48e7-b1a2-da196fcc094f, pages=17, markPos=WALPointer [idx=1, fileOff=329578, len=2010], walSegmentsCovered=[], markDuration=8ms, pagesWrite=0ms, fsync=16ms, total=24ms] [21:13:00] : [Step 4/5] [2021-11-19 21:13:00,254][INFO ][disco-notifier-worker-#24306%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=19] [21:13:00] : [Step 4/5] [2021-11-19 21:13:00,254][INFO ][disco-notifier-worker-#24425%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=19] [21:13:00] : [Step 4/5] [2021-11-19 21:13:00,254][INFO ][reencrypt-#24467%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:13:00] : [Step 4/5] [2021-11-19 21:13:00,254][INFO ][reencrypt-#24466%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:13:00] : [Step 4/5] [2021-11-19 21:13:00,455][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10b6f63c-e31c-4573-a225-9f76f500c001, grp=1613773252] [21:13:00] : [Step 4/5] [2021-11-19 21:13:00,631][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint started [checkpointId=3a3903fe-4b10-4a6c-8f3d-3edb231b0bca, startPtr=WALPointer [idx=1, fileOff=427844, len=2048], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=169ms, writeCheckpointEntryDuration=6ms, splitAndSortCpPagesDuration=0ms, pages=17, reason='test'] [21:13:00] : [Step 4/5] [2021-11-19 21:13:00,649][INFO ][db-checkpoint-thread-#24450%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:13:00] : [Step 4/5] [2021-11-19 21:13:00,650][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint finished [cpId=3a3903fe-4b10-4a6c-8f3d-3edb231b0bca, pages=17, markPos=WALPointer [idx=1, fileOff=427844, len=2048], walSegmentsCovered=[], markDuration=176ms, pagesWrite=1ms, fsync=17ms, total=194ms] [21:13:00] : [Step 4/5] [2021-11-19 21:13:00,650][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00cce8f9-a2b3-4d32-a95a-7f6eb6335000, grp=1613773252] [21:13:00] : [Step 4/5] [2021-11-19 21:13:00,658][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint started [checkpointId=ed859dfb-490f-4af0-a01e-d16ef9535375, startPtr=WALPointer [idx=1, fileOff=427692, len=2010], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=6ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=0ms, pages=17, reason='test'] [21:13:00] : [Step 4/5] [2021-11-19 21:13:00,675][INFO ][db-checkpoint-thread-#24445%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:13:00] : [Step 4/5] [2021-11-19 21:13:00,676][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint finished [cpId=ed859dfb-490f-4af0-a01e-d16ef9535375, pages=17, markPos=WALPointer [idx=1, fileOff=427692, len=2010], walSegmentsCovered=[], markDuration=8ms, pagesWrite=0ms, fsync=17ms, total=25ms] [21:13:00] : [Step 4/5] [2021-11-19 21:13:00,679][INFO ][disco-notifier-worker-#24306%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=20] [21:13:00] : [Step 4/5] [2021-11-19 21:13:00,679][INFO ][disco-notifier-worker-#24425%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=20] [21:13:00] : [Step 4/5] [2021-11-19 21:13:00,680][INFO ][reencrypt-#24467%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:13:00] : [Step 4/5] [2021-11-19 21:13:00,680][INFO ][reencrypt-#24466%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:13:00] : [Step 4/5] [2021-11-19 21:13:00,881][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10b6f63c-e31c-4573-a225-9f76f500c001, grp=1613773252] [21:13:01] : [Step 4/5] [2021-11-19 21:13:01,047][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint started [checkpointId=3bb54856-6037-4bc3-ab6f-ab446ce8f049, startPtr=WALPointer [idx=1, fileOff=528092, len=2048], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=160ms, writeCheckpointEntryDuration=5ms, splitAndSortCpPagesDuration=0ms, pages=17, reason='test'] [21:13:01] : [Step 4/5] [2021-11-19 21:13:01,065][INFO ][db-checkpoint-thread-#24450%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:13:01] : [Step 4/5] [2021-11-19 21:13:01,065][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint finished [cpId=3bb54856-6037-4bc3-ab6f-ab446ce8f049, pages=17, markPos=WALPointer [idx=1, fileOff=528092, len=2048], walSegmentsCovered=[], markDuration=166ms, pagesWrite=1ms, fsync=16ms, total=183ms] [21:13:01] : [Step 4/5] [2021-11-19 21:13:01,066][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00cce8f9-a2b3-4d32-a95a-7f6eb6335000, grp=1613773252] [21:13:01] : [Step 4/5] [2021-11-19 21:13:01,074][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint started [checkpointId=de190f7c-7be3-4200-81de-2f8e3c88b1f2, startPtr=WALPointer [idx=1, fileOff=527902, len=2010], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=6ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=0ms, pages=17, reason='test'] [21:13:01] : [Step 4/5] [2021-11-19 21:13:01,093][INFO ][db-checkpoint-thread-#24445%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:13:01] : [Step 4/5] [2021-11-19 21:13:01,093][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint finished [cpId=de190f7c-7be3-4200-81de-2f8e3c88b1f2, pages=17, markPos=WALPointer [idx=1, fileOff=527902, len=2010], walSegmentsCovered=[], markDuration=8ms, pagesWrite=0ms, fsync=18ms, total=27ms] [21:13:01] : [Step 4/5] [2021-11-19 21:13:01,097][INFO ][disco-notifier-worker-#24306%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=21] [21:13:01] : [Step 4/5] [2021-11-19 21:13:01,097][INFO ][disco-notifier-worker-#24425%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=21] [21:13:01] : [Step 4/5] [2021-11-19 21:13:01,097][INFO ][reencrypt-#24467%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:13:01] : [Step 4/5] [2021-11-19 21:13:01,097][INFO ][reencrypt-#24466%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:13:01] : [Step 4/5] [2021-11-19 21:13:01,298][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10b6f63c-e31c-4573-a225-9f76f500c001, grp=1613773252] [21:13:01] : [Step 4/5] [2021-11-19 21:13:01,474][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint started [checkpointId=02364be6-5b49-4f34-b904-f56d4670da28, startPtr=WALPointer [idx=1, fileOff=629671, len=2048], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=163ms, writeCheckpointEntryDuration=12ms, splitAndSortCpPagesDuration=0ms, pages=16, reason='test'] [21:13:01] : [Step 4/5] [2021-11-19 21:13:01,491][INFO ][db-checkpoint-thread-#24450%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:13:01] : [Step 4/5] [2021-11-19 21:13:01,491][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint finished [cpId=02364be6-5b49-4f34-b904-f56d4670da28, pages=16, markPos=WALPointer [idx=1, fileOff=629671, len=2048], walSegmentsCovered=[], markDuration=176ms, pagesWrite=0ms, fsync=16ms, total=192ms] [21:13:01] : [Step 4/5] [2021-11-19 21:13:01,491][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00cce8f9-a2b3-4d32-a95a-7f6eb6335000, grp=1613773252] [21:13:01] : [Step 4/5] [2021-11-19 21:13:01,500][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint started [checkpointId=a13aae39-b518-4c81-bb70-3bd61d3edef3, startPtr=WALPointer [idx=1, fileOff=629443, len=2010], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=1ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=5ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=1ms, pages=16, reason='test'] [21:13:01] : [Step 4/5] [2021-11-19 21:13:01,517][INFO ][db-checkpoint-thread-#24445%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:13:01] : [Step 4/5] [2021-11-19 21:13:01,517][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint finished [cpId=a13aae39-b518-4c81-bb70-3bd61d3edef3, pages=16, markPos=WALPointer [idx=1, fileOff=629443, len=2010], walSegmentsCovered=[], markDuration=8ms, pagesWrite=1ms, fsync=16ms, total=25ms] [21:13:01] : [Step 4/5] [2021-11-19 21:13:01,520][INFO ][disco-notifier-worker-#24306%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=22] [21:13:01] : [Step 4/5] [2021-11-19 21:13:01,521][INFO ][reencrypt-#24467%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:13:01] : [Step 4/5] [2021-11-19 21:13:01,521][INFO ][disco-notifier-worker-#24425%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=22] [21:13:01] : [Step 4/5] [2021-11-19 21:13:01,521][INFO ][reencrypt-#24466%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:13:01] : [Step 4/5] [2021-11-19 21:13:01,722][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10b6f63c-e31c-4573-a225-9f76f500c001, grp=1613773252] [21:13:01] : [Step 4/5] [2021-11-19 21:13:01,726][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint started [checkpointId=ec7df457-2148-4e3b-ba42-69c6bd67456f, startPtr=WALPointer [idx=1, fileOff=732219, len=2048], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=1ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=1ms, pages=17, reason='test'] [21:13:01] : [Step 4/5] [2021-11-19 21:13:01,744][INFO ][db-checkpoint-thread-#24450%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:13:01] : [Step 4/5] [2021-11-19 21:13:01,744][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint finished [cpId=ec7df457-2148-4e3b-ba42-69c6bd67456f, pages=17, markPos=WALPointer [idx=1, fileOff=732219, len=2048], walSegmentsCovered=[], markDuration=4ms, pagesWrite=0ms, fsync=17ms, total=22ms] [21:13:01] : [Step 4/5] [2021-11-19 21:13:01,744][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00cce8f9-a2b3-4d32-a95a-7f6eb6335000, grp=1613773252] [21:13:01] : [Step 4/5] [2021-11-19 21:13:01,752][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint started [checkpointId=7f62dc98-8d6e-4fa9-b54a-4fd3b5a34f02, startPtr=WALPointer [idx=1, fileOff=731953, len=2010], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=5ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=0ms, pages=17, reason='test'] [21:13:01] : [Step 4/5] [2021-11-19 21:13:01,770][INFO ][db-checkpoint-thread-#24445%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:13:01] : [Step 4/5] [2021-11-19 21:13:01,770][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint finished [cpId=7f62dc98-8d6e-4fa9-b54a-4fd3b5a34f02, pages=17, markPos=WALPointer [idx=1, fileOff=731953, len=2010], walSegmentsCovered=[], markDuration=7ms, pagesWrite=1ms, fsync=16ms, total=25ms] [21:13:01] : [Step 4/5] [2021-11-19 21:13:01,774][INFO ][disco-notifier-worker-#24425%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=23] [21:13:01] : [Step 4/5] [2021-11-19 21:13:01,774][INFO ][disco-notifier-worker-#24306%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=23] [21:13:01] : [Step 4/5] [2021-11-19 21:13:01,775][INFO ][reencrypt-#24466%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:13:01] : [Step 4/5] [2021-11-19 21:13:01,775][INFO ][reencrypt-#24467%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:13:01] : [Step 4/5] [2021-11-19 21:13:01,976][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10b6f63c-e31c-4573-a225-9f76f500c001, grp=1613773252] [21:13:01] : [Step 4/5] [2021-11-19 21:13:01,979][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint started [checkpointId=ac30d0bc-d89a-48c1-89da-f70803468d47, startPtr=WALPointer [idx=1, fileOff=835426, len=2048], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=1ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=0ms, pages=16, reason='test'] [21:13:01] : [Step 4/5] [2021-11-19 21:13:01,997][INFO ][db-checkpoint-thread-#24450%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:13:01] : [Step 4/5] [2021-11-19 21:13:01,997][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint finished [cpId=ac30d0bc-d89a-48c1-89da-f70803468d47, pages=16, markPos=WALPointer [idx=1, fileOff=835426, len=2048], walSegmentsCovered=[], markDuration=3ms, pagesWrite=0ms, fsync=17ms, total=21ms] [21:13:01] : [Step 4/5] [2021-11-19 21:13:01,997][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00cce8f9-a2b3-4d32-a95a-7f6eb6335000, grp=1613773252] [21:13:02] : [Step 4/5] [2021-11-19 21:13:02,006][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint started [checkpointId=0bb994e6-cb39-4655-93dc-b9092d30ec47, startPtr=WALPointer [idx=1, fileOff=835122, len=2010], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=7ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=0ms, pages=16, reason='test'] [21:13:02] : [Step 4/5] [2021-11-19 21:13:02,023][INFO ][db-checkpoint-thread-#24445%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:13:02] : [Step 4/5] [2021-11-19 21:13:02,024][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint finished [cpId=0bb994e6-cb39-4655-93dc-b9092d30ec47, pages=16, markPos=WALPointer [idx=1, fileOff=835122, len=2010], walSegmentsCovered=[], markDuration=9ms, pagesWrite=0ms, fsync=17ms, total=26ms] [21:13:02] : [Step 4/5] [2021-11-19 21:13:02,027][INFO ][disco-notifier-worker-#24306%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=24] [21:13:02] : [Step 4/5] [2021-11-19 21:13:02,027][INFO ][disco-notifier-worker-#24425%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=24] [21:13:02] : [Step 4/5] [2021-11-19 21:13:02,027][INFO ][reencrypt-#24467%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:13:02] : [Step 4/5] [2021-11-19 21:13:02,028][INFO ][reencrypt-#24466%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:13:02] : [Step 4/5] [2021-11-19 21:13:02,229][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10b6f63c-e31c-4573-a225-9f76f500c001, grp=1613773252] [21:13:02] : [Step 4/5] [2021-11-19 21:13:02,471][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint started [checkpointId=bebde45a-4746-491d-a85b-0e62dcdb4796, startPtr=WALPointer [idx=1, fileOff=940390, len=2048], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=9ms, writeCheckpointEntryDuration=232ms, splitAndSortCpPagesDuration=0ms, pages=17, reason='test'] [21:13:02] : [Step 4/5] [2021-11-19 21:13:02,490][INFO ][db-checkpoint-thread-#24450%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:13:02] : [Step 4/5] [2021-11-19 21:13:02,490][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint finished [cpId=bebde45a-4746-491d-a85b-0e62dcdb4796, pages=17, markPos=WALPointer [idx=1, fileOff=940390, len=2048], walSegmentsCovered=[], markDuration=242ms, pagesWrite=1ms, fsync=17ms, total=261ms] [21:13:02] : [Step 4/5] [2021-11-19 21:13:02,490][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00cce8f9-a2b3-4d32-a95a-7f6eb6335000, grp=1613773252] [21:13:02] : [Step 4/5] [2021-11-19 21:13:02,499][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint started [checkpointId=eb2df41f-aa30-4ca9-b56c-8904822eaee1, startPtr=WALPointer [idx=1, fileOff=940048, len=2010], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=1ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=6ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=0ms, pages=17, reason='test'] [21:13:02] : [Step 4/5] [2021-11-19 21:13:02,516][INFO ][db-checkpoint-thread-#24445%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:13:02] : [Step 4/5] [2021-11-19 21:13:02,516][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint finished [cpId=eb2df41f-aa30-4ca9-b56c-8904822eaee1, pages=17, markPos=WALPointer [idx=1, fileOff=940048, len=2010], walSegmentsCovered=[], markDuration=8ms, pagesWrite=1ms, fsync=16ms, total=25ms] [21:13:02] : [Step 4/5] [2021-11-19 21:13:02,520][INFO ][disco-notifier-worker-#24306%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=25] [21:13:02] : [Step 4/5] [2021-11-19 21:13:02,520][INFO ][disco-notifier-worker-#24425%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=25] [21:13:02] : [Step 4/5] [2021-11-19 21:13:02,520][INFO ][reencrypt-#24467%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:13:02] : [Step 4/5] [2021-11-19 21:13:02,521][INFO ][reencrypt-#24466%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:13:02] : [Step 4/5] [2021-11-19 21:13:02,721][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10b6f63c-e31c-4573-a225-9f76f500c001, grp=1613773252] [21:13:02] : [Step 4/5] [2021-11-19 21:13:02,816][INFO ][wal-file-archiver%grid-1-#24440%grid-1%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=1, segIdx=1, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000001.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000001.wal] [21:13:02] : [Step 4/5] [2021-11-19 21:13:02,987][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint started [checkpointId=711d4208-0039-4ae2-bdbe-77082c271066, startPtr=WALPointer [idx=2, fileOff=29, len=2048], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=94ms, walCpRecordFsyncDuration=1ms, writeCheckpointEntryDuration=170ms, splitAndSortCpPagesDuration=0ms, pages=17, reason='test'] [21:13:02] : [Step 4/5] [2021-11-19 21:13:02,987][INFO ][wal-file-archiver%grid-1-#24440%grid-1%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000001.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000001.wal] [21:13:03] : [Step 4/5] [2021-11-19 21:13:03,004][INFO ][db-checkpoint-thread-#24450%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:13:03] : [Step 4/5] [2021-11-19 21:13:03,005][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint finished [cpId=711d4208-0039-4ae2-bdbe-77082c271066, pages=17, markPos=WALPointer [idx=2, fileOff=29, len=2048], walSegmentsCovered=[1], markDuration=266ms, pagesWrite=0ms, fsync=17ms, total=283ms] [21:13:03] : [Step 4/5] [2021-11-19 21:13:03,005][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00cce8f9-a2b3-4d32-a95a-7f6eb6335000, grp=1613773252] [21:13:03] : [Step 4/5] [2021-11-19 21:13:03,012][INFO ][wal-file-archiver%grid-0-#24437%grid-0%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=1, segIdx=1, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000001.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000001.wal] [21:13:03] : [Step 4/5] [2021-11-19 21:13:03,014][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint started [checkpointId=e633c441-9d79-4d5c-a0dd-bd0c6cae9b5c, startPtr=WALPointer [idx=2, fileOff=29, len=2010], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=1ms, checkpointLockHoldTime=6ms, walCpRecordFsyncDuration=0ms, writeCheckpointEntryDuration=2ms, splitAndSortCpPagesDuration=0ms, pages=17, reason='test'] [21:13:03] : [Step 4/5] [2021-11-19 21:13:03,027][INFO ][wal-file-archiver%grid-0-#24437%grid-0%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000001.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000001.wal] [21:13:03] : [Step 4/5] [2021-11-19 21:13:03,036][INFO ][db-checkpoint-thread-#24445%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:13:03] : [Step 4/5] [2021-11-19 21:13:03,036][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint finished [cpId=e633c441-9d79-4d5c-a0dd-bd0c6cae9b5c, pages=17, markPos=WALPointer [idx=2, fileOff=29, len=2010], walSegmentsCovered=[1], markDuration=9ms, pagesWrite=0ms, fsync=21ms, total=30ms] [21:13:03] : [Step 4/5] [2021-11-19 21:13:03,040][INFO ][disco-notifier-worker-#24306%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=26] [21:13:03] : [Step 4/5] [2021-11-19 21:13:03,040][INFO ][disco-notifier-worker-#24425%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=26] [21:13:03] : [Step 4/5] [2021-11-19 21:13:03,040][INFO ][reencrypt-#24467%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:13:03] : [Step 4/5] [2021-11-19 21:13:03,040][INFO ][reencrypt-#24466%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:13:03] : [Step 4/5] [2021-11-19 21:13:03,241][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10b6f63c-e31c-4573-a225-9f76f500c001, grp=1613773252] [21:13:03] : [Step 4/5] [2021-11-19 21:13:03,513][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint started [checkpointId=b85ee63d-07e3-4a24-8674-aa13d0d2d94d, startPtr=WALPointer [idx=2, fileOff=118451, len=2048], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=113ms, writeCheckpointEntryDuration=157ms, splitAndSortCpPagesDuration=1ms, pages=19, reason='test'] [21:13:03] : [Step 4/5] [2021-11-19 21:13:03,530][INFO ][db-checkpoint-thread-#24450%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:13:03] : [Step 4/5] [2021-11-19 21:13:03,531][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint finished [cpId=b85ee63d-07e3-4a24-8674-aa13d0d2d94d, pages=19, markPos=WALPointer [idx=2, fileOff=118451, len=2048], walSegmentsCovered=[], markDuration=271ms, pagesWrite=1ms, fsync=17ms, total=289ms] [21:13:03] : [Step 4/5] [2021-11-19 21:13:03,531][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00cce8f9-a2b3-4d32-a95a-7f6eb6335000, grp=1613773252] [21:13:03] : [Step 4/5] [2021-11-19 21:13:03,539][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint started [checkpointId=73528e86-38d7-492c-ae1a-11fe6af07d73, startPtr=WALPointer [idx=2, fileOff=118413, len=2010], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=6ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=0ms, pages=19, reason='test'] [21:13:03] : [Step 4/5] [2021-11-19 21:13:03,556][INFO ][db-checkpoint-thread-#24445%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:13:03] : [Step 4/5] [2021-11-19 21:13:03,557][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint finished [cpId=73528e86-38d7-492c-ae1a-11fe6af07d73, pages=19, markPos=WALPointer [idx=2, fileOff=118413, len=2010], walSegmentsCovered=[], markDuration=8ms, pagesWrite=0ms, fsync=17ms, total=25ms] [21:13:03] : [Step 4/5] [2021-11-19 21:13:03,560][INFO ][disco-notifier-worker-#24306%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=27] [21:13:03] : [Step 4/5] [2021-11-19 21:13:03,560][INFO ][disco-notifier-worker-#24425%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=27] [21:13:03] : [Step 4/5] [2021-11-19 21:13:03,560][INFO ][reencrypt-#24467%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:13:03] : [Step 4/5] [2021-11-19 21:13:03,561][INFO ][reencrypt-#24466%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:13:03] : [Step 4/5] [2021-11-19 21:13:03,762][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10b6f63c-e31c-4573-a225-9f76f500c001, grp=1613773252] [21:13:03] : [Step 4/5] [2021-11-19 21:13:03,927][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint started [checkpointId=3b58b7b8-bce5-4960-b502-f1a95e89da1c, startPtr=WALPointer [idx=2, fileOff=237828, len=2048], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=1ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=85ms, writeCheckpointEntryDuration=78ms, splitAndSortCpPagesDuration=1ms, pages=17, reason='test'] [21:13:04] : [Step 4/5] [2021-11-19 21:13:04,050][INFO ][db-checkpoint-thread-#24450%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:13:04] : [Step 4/5] [2021-11-19 21:13:04,050][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint finished [cpId=3b58b7b8-bce5-4960-b502-f1a95e89da1c, pages=17, markPos=WALPointer [idx=2, fileOff=237828, len=2048], walSegmentsCovered=[], markDuration=166ms, pagesWrite=0ms, fsync=122ms, total=288ms] [21:13:04] : [Step 4/5] [2021-11-19 21:13:04,050][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00cce8f9-a2b3-4d32-a95a-7f6eb6335000, grp=1613773252] [21:13:04] : [Step 4/5] [2021-11-19 21:13:04,060][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint started [checkpointId=ff91cf1f-720e-4276-ae5e-49698af69f9e, startPtr=WALPointer [idx=2, fileOff=237752, len=2010], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=7ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=0ms, pages=17, reason='test'] [21:13:04] : [Step 4/5] [2021-11-19 21:13:04,069][INFO ][db-checkpoint-thread-#24445%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:13:04] : [Step 4/5] [2021-11-19 21:13:04,070][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint finished [cpId=ff91cf1f-720e-4276-ae5e-49698af69f9e, pages=17, markPos=WALPointer [idx=2, fileOff=237752, len=2010], walSegmentsCovered=[], markDuration=10ms, pagesWrite=0ms, fsync=9ms, total=19ms] [21:13:04] : [Step 4/5] [2021-11-19 21:13:04,073][INFO ][disco-notifier-worker-#24306%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=28] [21:13:04] : [Step 4/5] [2021-11-19 21:13:04,074][INFO ][disco-notifier-worker-#24425%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=28] [21:13:04] : [Step 4/5] [2021-11-19 21:13:04,074][INFO ][reencrypt-#24467%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:13:04] : [Step 4/5] [2021-11-19 21:13:04,074][INFO ][reencrypt-#24466%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:13:04] : [Step 4/5] [2021-11-19 21:13:04,075][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10b6f63c-e31c-4573-a225-9f76f500c001, grp=1613773252] [21:13:04] : [Step 4/5] [2021-11-19 21:13:04,079][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint started [checkpointId=9834f348-cb4f-441e-add3-95821840141b, startPtr=WALPointer [idx=2, fileOff=359771, len=2048], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=2ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=0ms, pages=19, reason='test'] [21:13:04] : [Step 4/5] [2021-11-19 21:13:04,097][INFO ][db-checkpoint-thread-#24450%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:13:04] : [Step 4/5] [2021-11-19 21:13:04,098][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint finished [cpId=9834f348-cb4f-441e-add3-95821840141b, pages=19, markPos=WALPointer [idx=2, fileOff=359771, len=2048], walSegmentsCovered=[], markDuration=4ms, pagesWrite=0ms, fsync=18ms, total=22ms] [21:13:04] : [Step 4/5] [2021-11-19 21:13:04,098][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00cce8f9-a2b3-4d32-a95a-7f6eb6335000, grp=1613773252] [21:13:04] : [Step 4/5] [2021-11-19 21:13:04,107][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint started [checkpointId=b7f3c4d9-8675-48f4-99d2-208f8cc7c012, startPtr=WALPointer [idx=2, fileOff=359657, len=2010], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=6ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=0ms, pages=19, reason='test'] [21:13:04] : [Step 4/5] [2021-11-19 21:13:04,124][INFO ][db-checkpoint-thread-#24445%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:13:04] : [Step 4/5] [2021-11-19 21:13:04,125][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint finished [cpId=b7f3c4d9-8675-48f4-99d2-208f8cc7c012, pages=19, markPos=WALPointer [idx=2, fileOff=359657, len=2010], walSegmentsCovered=[], markDuration=8ms, pagesWrite=1ms, fsync=17ms, total=27ms] [21:13:04] : [Step 4/5] [2021-11-19 21:13:04,129][INFO ][disco-notifier-worker-#24306%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=29] [21:13:04] : [Step 4/5] [2021-11-19 21:13:04,129][INFO ][disco-notifier-worker-#24425%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=29] [21:13:04] : [Step 4/5] [2021-11-19 21:13:04,129][INFO ][reencrypt-#24467%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:13:04] : [Step 4/5] [2021-11-19 21:13:04,129][INFO ][reencrypt-#24466%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:13:04] : [Step 4/5] [2021-11-19 21:13:04,330][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10b6f63c-e31c-4573-a225-9f76f500c001, grp=1613773252] [21:13:04] : [Step 4/5] [2021-11-19 21:13:04,560][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint started [checkpointId=df312082-fb5d-4c97-800f-a28de476457b, startPtr=WALPointer [idx=2, fileOff=486365, len=2048], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=100ms, writeCheckpointEntryDuration=128ms, splitAndSortCpPagesDuration=0ms, pages=20, reason='test'] [21:13:04] : [Step 4/5] [2021-11-19 21:13:04,573][INFO ][db-checkpoint-thread-#24450%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:13:04] : [Step 4/5] [2021-11-19 21:13:04,573][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint finished [cpId=df312082-fb5d-4c97-800f-a28de476457b, pages=20, markPos=WALPointer [idx=2, fileOff=486365, len=2048], walSegmentsCovered=[], markDuration=230ms, pagesWrite=1ms, fsync=11ms, total=242ms] [21:13:04] : [Step 4/5] [2021-11-19 21:13:04,574][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00cce8f9-a2b3-4d32-a95a-7f6eb6335000, grp=1613773252] [21:13:04] : [Step 4/5] [2021-11-19 21:13:04,581][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint started [checkpointId=7949ed9f-1ad1-431b-a056-2aa489ad56c5, startPtr=WALPointer [idx=2, fileOff=486213, len=2010], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=5ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=0ms, pages=20, reason='test'] [21:13:04] : [Step 4/5] [2021-11-19 21:13:04,599][INFO ][db-checkpoint-thread-#24445%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:13:04] : [Step 4/5] [2021-11-19 21:13:04,599][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint finished [cpId=7949ed9f-1ad1-431b-a056-2aa489ad56c5, pages=20, markPos=WALPointer [idx=2, fileOff=486213, len=2010], walSegmentsCovered=[], markDuration=7ms, pagesWrite=1ms, fsync=16ms, total=25ms] [21:13:04] : [Step 4/5] [2021-11-19 21:13:04,604][INFO ][disco-notifier-worker-#24306%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=30] [21:13:04] : [Step 4/5] [2021-11-19 21:13:04,604][INFO ][disco-notifier-worker-#24425%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=30] [21:13:04] : [Step 4/5] [2021-11-19 21:13:04,604][INFO ][reencrypt-#24467%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:13:04] : [Step 4/5] [2021-11-19 21:13:04,604][INFO ][reencrypt-#24466%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:13:04] : [Step 4/5] [2021-11-19 21:13:04,805][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10b6f63c-e31c-4573-a225-9f76f500c001, grp=1613773252] [21:13:05] : [Step 4/5] [2021-11-19 21:13:05,055][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint started [checkpointId=f3533400-3090-471a-b01a-5ab2c012c7ae, startPtr=WALPointer [idx=2, fileOff=615421, len=2048], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=165ms, writeCheckpointEntryDuration=84ms, splitAndSortCpPagesDuration=0ms, pages=19, reason='test'] [21:13:05] : [Step 4/5] [2021-11-19 21:13:05,073][INFO ][db-checkpoint-thread-#24450%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:13:05] : [Step 4/5] [2021-11-19 21:13:05,073][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint finished [cpId=f3533400-3090-471a-b01a-5ab2c012c7ae, pages=19, markPos=WALPointer [idx=2, fileOff=615421, len=2048], walSegmentsCovered=[], markDuration=250ms, pagesWrite=0ms, fsync=17ms, total=267ms] [21:13:05] : [Step 4/5] [2021-11-19 21:13:05,073][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00cce8f9-a2b3-4d32-a95a-7f6eb6335000, grp=1613773252] [21:13:05] : [Step 4/5] [2021-11-19 21:13:05,081][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint started [checkpointId=963a2f80-9669-4f31-9e7b-f5e708218fb4, startPtr=WALPointer [idx=2, fileOff=615231, len=2010], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=6ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=0ms, pages=19, reason='test'] [21:13:05] : [Step 4/5] [2021-11-19 21:13:05,099][INFO ][db-checkpoint-thread-#24445%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:13:05] : [Step 4/5] [2021-11-19 21:13:05,099][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint finished [cpId=963a2f80-9669-4f31-9e7b-f5e708218fb4, pages=19, markPos=WALPointer [idx=2, fileOff=615231, len=2010], walSegmentsCovered=[], markDuration=8ms, pagesWrite=1ms, fsync=16ms, total=25ms] [21:13:05] : [Step 4/5] [2021-11-19 21:13:05,103][INFO ][disco-notifier-worker-#24306%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=31] [21:13:05] : [Step 4/5] [2021-11-19 21:13:05,104][INFO ][disco-notifier-worker-#24425%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=31] [21:13:05] : [Step 4/5] [2021-11-19 21:13:05,104][INFO ][reencrypt-#24467%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:13:05] : [Step 4/5] [2021-11-19 21:13:05,104][INFO ][reencrypt-#24466%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:13:05] : [Step 4/5] [2021-11-19 21:13:05,305][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10b6f63c-e31c-4573-a225-9f76f500c001, grp=1613773252] [21:13:05] : [Step 4/5] [2021-11-19 21:13:05,501][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint started [checkpointId=1e9ab062-80cd-4a85-98f7-e63fd46776b9, startPtr=WALPointer [idx=2, fileOff=741810, len=2048], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=120ms, writeCheckpointEntryDuration=75ms, splitAndSortCpPagesDuration=0ms, pages=18, reason='test'] [21:13:05] : [Step 4/5] [2021-11-19 21:13:05,586][INFO ][db-checkpoint-thread-#24450%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:13:05] : [Step 4/5] [2021-11-19 21:13:05,587][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint finished [cpId=1e9ab062-80cd-4a85-98f7-e63fd46776b9, pages=18, markPos=WALPointer [idx=2, fileOff=741810, len=2048], walSegmentsCovered=[], markDuration=196ms, pagesWrite=0ms, fsync=85ms, total=282ms] [21:13:05] : [Step 4/5] [2021-11-19 21:13:05,587][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00cce8f9-a2b3-4d32-a95a-7f6eb6335000, grp=1613773252] [21:13:05] : [Step 4/5] [2021-11-19 21:13:05,595][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint started [checkpointId=4120e163-ae6a-413a-8427-fe2eba6071e5, startPtr=WALPointer [idx=2, fileOff=741582, len=2010], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=6ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=0ms, pages=18, reason='test'] [21:13:05] : [Step 4/5] [2021-11-19 21:13:05,613][INFO ][db-checkpoint-thread-#24445%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:13:05] : [Step 4/5] [2021-11-19 21:13:05,613][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint finished [cpId=4120e163-ae6a-413a-8427-fe2eba6071e5, pages=18, markPos=WALPointer [idx=2, fileOff=741582, len=2010], walSegmentsCovered=[], markDuration=8ms, pagesWrite=0ms, fsync=17ms, total=26ms] [21:13:05] : [Step 4/5] [2021-11-19 21:13:05,617][INFO ][disco-notifier-worker-#24306%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=32] [21:13:05] : [Step 4/5] [2021-11-19 21:13:05,617][INFO ][disco-notifier-worker-#24425%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=32] [21:13:05] : [Step 4/5] [2021-11-19 21:13:05,617][INFO ][reencrypt-#24467%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:13:05] : [Step 4/5] [2021-11-19 21:13:05,617][INFO ][reencrypt-#24466%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:13:05] : [Step 4/5] [2021-11-19 21:13:05,819][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10b6f63c-e31c-4573-a225-9f76f500c001, grp=1613773252] [21:13:05] : [Step 4/5] [2021-11-19 21:13:05,969][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint started [checkpointId=7065d484-3728-4642-b6ee-b5e8b594986f, startPtr=WALPointer [idx=2, fileOff=869209, len=2048], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=1ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=91ms, writeCheckpointEntryDuration=58ms, splitAndSortCpPagesDuration=0ms, pages=19, reason='test'] [21:13:06] : [Step 4/5] [2021-11-19 21:13:06,496][INFO ][db-checkpoint-thread-#24450%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:13:06] : [Step 4/5] [2021-11-19 21:13:06,496][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint finished [cpId=7065d484-3728-4642-b6ee-b5e8b594986f, pages=19, markPos=WALPointer [idx=2, fileOff=869209, len=2048], walSegmentsCovered=[], markDuration=151ms, pagesWrite=0ms, fsync=526ms, total=677ms] [21:13:06] : [Step 4/5] [2021-11-19 21:13:06,496][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00cce8f9-a2b3-4d32-a95a-7f6eb6335000, grp=1613773252] [21:13:06] : [Step 4/5] [2021-11-19 21:13:06,505][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint started [checkpointId=505a9451-76e9-45b5-bde5-af80caf21844, startPtr=WALPointer [idx=2, fileOff=868943, len=2010], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=6ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=0ms, pages=19, reason='test'] [21:13:06] : [Step 4/5] [2021-11-19 21:13:06,524][INFO ][db-checkpoint-thread-#24445%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:13:06] : [Step 4/5] [2021-11-19 21:13:06,524][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint finished [cpId=505a9451-76e9-45b5-bde5-af80caf21844, pages=19, markPos=WALPointer [idx=2, fileOff=868943, len=2010], walSegmentsCovered=[], markDuration=8ms, pagesWrite=1ms, fsync=17ms, total=27ms] [21:13:06] : [Step 4/5] [2021-11-19 21:13:06,528][INFO ][disco-notifier-worker-#24425%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=33] [21:13:06] : [Step 4/5] [2021-11-19 21:13:06,528][INFO ][disco-notifier-worker-#24306%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=33] [21:13:06] : [Step 4/5] [2021-11-19 21:13:06,528][INFO ][reencrypt-#24466%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:13:06] : [Step 4/5] [2021-11-19 21:13:06,528][INFO ][reencrypt-#24467%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:13:06] : [Step 4/5] [2021-11-19 21:13:06,729][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10b6f63c-e31c-4573-a225-9f76f500c001, grp=1613773252] [21:13:06] : [Step 4/5] [2021-11-19 21:13:06,918][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint started [checkpointId=722f022c-ac7b-45cc-9c90-0b39ebc74dc3, startPtr=WALPointer [idx=2, fileOff=989581, len=2048], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=24ms, writeCheckpointEntryDuration=163ms, splitAndSortCpPagesDuration=0ms, pages=16, reason='test'] [21:13:07] : [Step 4/5] [2021-11-19 21:13:07,292][INFO ][db-checkpoint-thread-#24450%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:13:07] : [Step 4/5] [2021-11-19 21:13:07,292][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint finished [cpId=722f022c-ac7b-45cc-9c90-0b39ebc74dc3, pages=16, markPos=WALPointer [idx=2, fileOff=989581, len=2048], walSegmentsCovered=[], markDuration=188ms, pagesWrite=1ms, fsync=373ms, total=562ms] [21:13:07] : [Step 4/5] [2021-11-19 21:13:07,292][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00cce8f9-a2b3-4d32-a95a-7f6eb6335000, grp=1613773252] [21:13:07] : [Step 4/5] [2021-11-19 21:13:07,309][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint started [checkpointId=22899f34-e216-4ec7-b2ef-84c6c560025b, startPtr=WALPointer [idx=2, fileOff=989277, len=2010], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=6ms, writeCheckpointEntryDuration=10ms, splitAndSortCpPagesDuration=0ms, pages=16, reason='test'] [21:13:07] : [Step 4/5] [2021-11-19 21:13:07,327][INFO ][db-checkpoint-thread-#24445%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:13:07] : [Step 4/5] [2021-11-19 21:13:07,327][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint finished [cpId=22899f34-e216-4ec7-b2ef-84c6c560025b, pages=16, markPos=WALPointer [idx=2, fileOff=989277, len=2010], walSegmentsCovered=[], markDuration=17ms, pagesWrite=0ms, fsync=17ms, total=34ms] [21:13:07] : [Step 4/5] [2021-11-19 21:13:07,336][INFO ][wal-file-archiver%grid-0-#24437%grid-0%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=2, segIdx=2, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000002.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000002.wal] [21:13:07] : [Step 4/5] [2021-11-19 21:13:07,336][INFO ][wal-file-archiver%grid-1-#24440%grid-1%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=2, segIdx=2, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000002.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000002.wal] [21:13:07] : [Step 4/5] [2021-11-19 21:13:07,338][INFO ][disco-notifier-worker-#24306%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=34] [21:13:07] : [Step 4/5] [2021-11-19 21:13:07,338][INFO ][disco-notifier-worker-#24425%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=34] [21:13:07] : [Step 4/5] [2021-11-19 21:13:07,338][INFO ][reencrypt-#24467%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:13:07] : [Step 4/5] [2021-11-19 21:13:07,339][INFO ][reencrypt-#24466%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:13:07] : [Step 4/5] [2021-11-19 21:13:07,356][INFO ][wal-file-archiver%grid-1-#24440%grid-1%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000002.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000002.wal] [21:13:07] : [Step 4/5] [2021-11-19 21:13:07,356][INFO ][wal-file-archiver%grid-0-#24437%grid-0%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000002.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000002.wal] [21:13:07] : [Step 4/5] [2021-11-19 21:13:07,539][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10b6f63c-e31c-4573-a225-9f76f500c001, grp=1613773252] [21:13:07] : [Step 4/5] [2021-11-19 21:13:07,707][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint started [checkpointId=af2d1c18-0e7f-4c52-84c9-374eeb19c9e0, startPtr=WALPointer [idx=3, fileOff=64673, len=2048], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=20ms, writeCheckpointEntryDuration=147ms, splitAndSortCpPagesDuration=0ms, pages=17, reason='test'] [21:13:08] : [Step 4/5] [2021-11-19 21:13:08,080][INFO ][db-checkpoint-thread-#24450%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:13:08] : [Step 4/5] [2021-11-19 21:13:08,081][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint finished [cpId=af2d1c18-0e7f-4c52-84c9-374eeb19c9e0, pages=17, markPos=WALPointer [idx=3, fileOff=64673, len=2048], walSegmentsCovered=[2], markDuration=168ms, pagesWrite=0ms, fsync=373ms, total=541ms] [21:13:08] : [Step 4/5] [2021-11-19 21:13:08,081][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00cce8f9-a2b3-4d32-a95a-7f6eb6335000, grp=1613773252] [21:13:08] : [Step 4/5] [2021-11-19 21:13:08,098][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint started [checkpointId=6d419044-860f-42e1-ac1d-21b438723312, startPtr=WALPointer [idx=3, fileOff=64673, len=2010], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=6ms, writeCheckpointEntryDuration=10ms, splitAndSortCpPagesDuration=0ms, pages=17, reason='test'] [21:13:08] : [Step 4/5] [2021-11-19 21:13:08,125][INFO ][db-checkpoint-thread-#24445%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:13:08] : [Step 4/5] [2021-11-19 21:13:08,125][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint finished [cpId=6d419044-860f-42e1-ac1d-21b438723312, pages=17, markPos=WALPointer [idx=3, fileOff=64673, len=2010], walSegmentsCovered=[2], markDuration=16ms, pagesWrite=1ms, fsync=26ms, total=44ms] [21:13:08] : [Step 4/5] [2021-11-19 21:13:08,129][INFO ][disco-notifier-worker-#24306%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=35] [21:13:08] : [Step 4/5] [2021-11-19 21:13:08,129][INFO ][disco-notifier-worker-#24425%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=35] [21:13:08] : [Step 4/5] [2021-11-19 21:13:08,129][INFO ][reencrypt-#24467%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:13:08] : [Step 4/5] [2021-11-19 21:13:08,129][INFO ][reencrypt-#24466%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:13:08] : [Step 4/5] [2021-11-19 21:13:08,330][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10b6f63c-e31c-4573-a225-9f76f500c001, grp=1613773252] [21:13:08] : [Step 4/5] [2021-11-19 21:13:08,552][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint started [checkpointId=ad3b0f07-19a4-445c-81c1-b524484e5cbb, startPtr=WALPointer [idx=3, fileOff=198092, len=2048], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=62ms, writeCheckpointEntryDuration=158ms, splitAndSortCpPagesDuration=1ms, pages=18, reason='test'] [21:13:08] : [Step 4/5] [2021-11-19 21:13:08,850][INFO ][db-checkpoint-thread-#24450%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:13:08] : [Step 4/5] [2021-11-19 21:13:08,850][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint finished [cpId=ad3b0f07-19a4-445c-81c1-b524484e5cbb, pages=18, markPos=WALPointer [idx=3, fileOff=198092, len=2048], walSegmentsCovered=[], markDuration=221ms, pagesWrite=1ms, fsync=297ms, total=519ms] [21:13:08] : [Step 4/5] [2021-11-19 21:13:08,851][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00cce8f9-a2b3-4d32-a95a-7f6eb6335000, grp=1613773252] [21:13:08] : [Step 4/5] [2021-11-19 21:13:08,867][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint started [checkpointId=2b69b335-9fe1-49ee-b038-fb509e5e1dbf, startPtr=WALPointer [idx=3, fileOff=198054, len=2010], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=6ms, writeCheckpointEntryDuration=9ms, splitAndSortCpPagesDuration=0ms, pages=18, reason='test'] [21:13:08] : [Step 4/5] [2021-11-19 21:13:08,886][INFO ][db-checkpoint-thread-#24445%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:13:08] : [Step 4/5] [2021-11-19 21:13:08,886][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint finished [cpId=2b69b335-9fe1-49ee-b038-fb509e5e1dbf, pages=18, markPos=WALPointer [idx=3, fileOff=198054, len=2010], walSegmentsCovered=[], markDuration=16ms, pagesWrite=0ms, fsync=18ms, total=35ms] [21:13:08] : [Step 4/5] [2021-11-19 21:13:08,890][INFO ][disco-notifier-worker-#24306%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=36] [21:13:08] : [Step 4/5] [2021-11-19 21:13:08,890][INFO ][disco-notifier-worker-#24425%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=36] [21:13:08] : [Step 4/5] [2021-11-19 21:13:08,890][INFO ][reencrypt-#24467%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:13:08] : [Step 4/5] [2021-11-19 21:13:08,890][INFO ][reencrypt-#24466%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:13:09] : [Step 4/5] [2021-11-19 21:13:09,091][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10b6f63c-e31c-4573-a225-9f76f500c001, grp=1613773252] [21:13:09] : [Step 4/5] [2021-11-19 21:13:09,386][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint started [checkpointId=bc1f0f3f-fd6a-428f-a4e2-182370a6ad3e, startPtr=WALPointer [idx=3, fileOff=334550, len=2048], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=39ms, writeCheckpointEntryDuration=255ms, splitAndSortCpPagesDuration=0ms, pages=19, reason='test'] [21:13:09] : [Step 4/5] [2021-11-19 21:13:09,995][INFO ][db-checkpoint-thread-#24450%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:13:09] : [Step 4/5] [2021-11-19 21:13:09,995][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint finished [cpId=bc1f0f3f-fd6a-428f-a4e2-182370a6ad3e, pages=19, markPos=WALPointer [idx=3, fileOff=334550, len=2048], walSegmentsCovered=[], markDuration=295ms, pagesWrite=0ms, fsync=608ms, total=903ms] [21:13:09] : [Step 4/5] [2021-11-19 21:13:09,996][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00cce8f9-a2b3-4d32-a95a-7f6eb6335000, grp=1613773252] [21:13:10] : [Step 4/5] [2021-11-19 21:13:10,012][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint started [checkpointId=1bc8a187-26c7-479a-a507-acb7b37711d7, startPtr=WALPointer [idx=3, fileOff=334474, len=2010], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=6ms, writeCheckpointEntryDuration=9ms, splitAndSortCpPagesDuration=0ms, pages=19, reason='test'] [21:13:10] : [Step 4/5] [2021-11-19 21:13:10,030][INFO ][db-checkpoint-thread-#24445%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:13:10] : [Step 4/5] [2021-11-19 21:13:10,030][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint finished [cpId=1bc8a187-26c7-479a-a507-acb7b37711d7, pages=19, markPos=WALPointer [idx=3, fileOff=334474, len=2010], walSegmentsCovered=[], markDuration=16ms, pagesWrite=0ms, fsync=17ms, total=34ms] [21:13:10] : [Step 4/5] [2021-11-19 21:13:10,034][INFO ][disco-notifier-worker-#24306%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=37] [21:13:10] : [Step 4/5] [2021-11-19 21:13:10,034][INFO ][reencrypt-#24467%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:13:10] : [Step 4/5] [2021-11-19 21:13:10,034][INFO ][disco-notifier-worker-#24425%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=37] [21:13:10] : [Step 4/5] [2021-11-19 21:13:10,034][INFO ][reencrypt-#24466%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:13:10] : [Step 4/5] [2021-11-19 21:13:10,235][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10b6f63c-e31c-4573-a225-9f76f500c001, grp=1613773252] [21:13:10] : [Step 4/5] [2021-11-19 21:13:10,424][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint started [checkpointId=b2e91c32-defc-40d6-adb8-7b32da005572, startPtr=WALPointer [idx=3, fileOff=471359, len=2048], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=38ms, writeCheckpointEntryDuration=149ms, splitAndSortCpPagesDuration=0ms, pages=17, reason='test'] [21:13:10] : [Step 4/5] [2021-11-19 21:13:10,691][INFO ][db-checkpoint-thread-#24450%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:13:10] : [Step 4/5] [2021-11-19 21:13:10,691][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint finished [cpId=b2e91c32-defc-40d6-adb8-7b32da005572, pages=17, markPos=WALPointer [idx=3, fileOff=471359, len=2048], walSegmentsCovered=[], markDuration=189ms, pagesWrite=1ms, fsync=265ms, total=455ms] [21:13:10] : [Step 4/5] [2021-11-19 21:13:10,691][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00cce8f9-a2b3-4d32-a95a-7f6eb6335000, grp=1613773252] [21:13:11] : [Step 4/5] [2021-11-19 21:13:11,058][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint started [checkpointId=161cf24f-b619-4558-a55a-7dd3b57b7f15, startPtr=WALPointer [idx=3, fileOff=471245, len=2010], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=1ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=47ms, writeCheckpointEntryDuration=318ms, splitAndSortCpPagesDuration=0ms, pages=17, reason='test'] [21:13:11] : [Step 4/5] [2021-11-19 21:13:11,242][INFO ][db-checkpoint-thread-#24445%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:13:11] : [Step 4/5] [2021-11-19 21:13:11,243][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint finished [cpId=161cf24f-b619-4558-a55a-7dd3b57b7f15, pages=17, markPos=WALPointer [idx=3, fileOff=471245, len=2010], walSegmentsCovered=[], markDuration=367ms, pagesWrite=1ms, fsync=183ms, total=551ms] [21:13:11] : [Step 4/5] [2021-11-19 21:13:11,247][INFO ][disco-notifier-worker-#24306%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=38] [21:13:11] : [Step 4/5] [2021-11-19 21:13:11,247][INFO ][reencrypt-#24467%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:13:11] : [Step 4/5] [2021-11-19 21:13:11,247][INFO ][disco-notifier-worker-#24425%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=38] [21:13:11] : [Step 4/5] [2021-11-19 21:13:11,248][INFO ][reencrypt-#24466%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:13:11] : [Step 4/5] [2021-11-19 21:13:11,449][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10b6f63c-e31c-4573-a225-9f76f500c001, grp=1613773252] [21:13:11] : [Step 4/5] [2021-11-19 21:13:11,763][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint started [checkpointId=e814dc21-0dcb-49ba-b110-2718539b1479, startPtr=WALPointer [idx=3, fileOff=604434, len=2048], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=107ms, writeCheckpointEntryDuration=206ms, splitAndSortCpPagesDuration=0ms, pages=19, reason='test'] [21:13:12] : [Step 4/5] [2021-11-19 21:13:12,309][INFO ][db-checkpoint-thread-#24450%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:13:12] : [Step 4/5] [2021-11-19 21:13:12,309][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint finished [cpId=e814dc21-0dcb-49ba-b110-2718539b1479, pages=19, markPos=WALPointer [idx=3, fileOff=604434, len=2048], walSegmentsCovered=[], markDuration=314ms, pagesWrite=0ms, fsync=545ms, total=860ms] [21:13:12] : [Step 4/5] [2021-11-19 21:13:12,309][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00cce8f9-a2b3-4d32-a95a-7f6eb6335000, grp=1613773252] [21:13:12] : [Step 4/5] [2021-11-19 21:13:12,470][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint started [checkpointId=b7ca5e3f-1129-47b4-b37e-38383a8e8dcc, startPtr=WALPointer [idx=3, fileOff=604282, len=2010], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=125ms, writeCheckpointEntryDuration=34ms, splitAndSortCpPagesDuration=0ms, pages=19, reason='test'] [21:13:12] : [Step 4/5] [2021-11-19 21:13:12,497][INFO ][db-checkpoint-thread-#24445%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:13:12] : [Step 4/5] [2021-11-19 21:13:12,498][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint finished [cpId=b7ca5e3f-1129-47b4-b37e-38383a8e8dcc, pages=19, markPos=WALPointer [idx=3, fileOff=604282, len=2010], walSegmentsCovered=[], markDuration=160ms, pagesWrite=1ms, fsync=26ms, total=188ms] [21:13:12] : [Step 4/5] [2021-11-19 21:13:12,502][INFO ][disco-notifier-worker-#24306%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=39] [21:13:12] : [Step 4/5] [2021-11-19 21:13:12,502][INFO ][disco-notifier-worker-#24425%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=39] [21:13:12] : [Step 4/5] [2021-11-19 21:13:12,502][INFO ][reencrypt-#24467%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:13:12] : [Step 4/5] [2021-11-19 21:13:12,503][INFO ][reencrypt-#24466%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:13:12] : [Step 4/5] [2021-11-19 21:13:12,703][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10b6f63c-e31c-4573-a225-9f76f500c001, grp=1613773252] [21:13:12] : [Step 4/5] [2021-11-19 21:13:12,798][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint started [checkpointId=aa41e583-8c19-4742-a366-839abe2db040, startPtr=WALPointer [idx=3, fileOff=747203, len=2048], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=27ms, writeCheckpointEntryDuration=66ms, splitAndSortCpPagesDuration=1ms, pages=20, reason='test'] [21:13:13] : [Step 4/5] [2021-11-19 21:13:13,165][INFO ][db-checkpoint-thread-#24450%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:13:13] : [Step 4/5] [2021-11-19 21:13:13,165][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint finished [cpId=aa41e583-8c19-4742-a366-839abe2db040, pages=20, markPos=WALPointer [idx=3, fileOff=747203, len=2048], walSegmentsCovered=[], markDuration=94ms, pagesWrite=1ms, fsync=366ms, total=461ms] [21:13:13] : [Step 4/5] [2021-11-19 21:13:13,165][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00cce8f9-a2b3-4d32-a95a-7f6eb6335000, grp=1613773252] [21:13:13] : [Step 4/5] [2021-11-19 21:13:13,371][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint started [checkpointId=bf3a11b1-b31c-457e-ba37-3c35e053c85b, startPtr=WALPointer [idx=3, fileOff=747013, len=2010], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=1ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=33ms, writeCheckpointEntryDuration=171ms, splitAndSortCpPagesDuration=0ms, pages=20, reason='test'] [21:13:13] : [Step 4/5] [2021-11-19 21:13:13,640][INFO ][db-checkpoint-thread-#24445%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:13:13] : [Step 4/5] [2021-11-19 21:13:13,640][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint finished [cpId=bf3a11b1-b31c-457e-ba37-3c35e053c85b, pages=20, markPos=WALPointer [idx=3, fileOff=747013, len=2010], walSegmentsCovered=[], markDuration=206ms, pagesWrite=0ms, fsync=268ms, total=474ms] [21:13:13] : [Step 4/5] [2021-11-19 21:13:13,645][INFO ][disco-notifier-worker-#24306%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=40] [21:13:13] : [Step 4/5] [2021-11-19 21:13:13,645][INFO ][reencrypt-#24467%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:13:13] : [Step 4/5] [2021-11-19 21:13:13,646][INFO ][disco-notifier-worker-#24425%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=40] [21:13:13] : [Step 4/5] [2021-11-19 21:13:13,646][INFO ][reencrypt-#24466%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:13:13] : [Step 4/5] [2021-11-19 21:13:13,648][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10b6f63c-e31c-4573-a225-9f76f500c001, grp=1613773252] [21:13:13] : [Step 4/5] [2021-11-19 21:13:13,667][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint started [checkpointId=1d88696e-da00-4358-a6d7-a13067b28bdf, startPtr=WALPointer [idx=3, fileOff=895705, len=2048], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=1ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=5ms, writeCheckpointEntryDuration=10ms, splitAndSortCpPagesDuration=0ms, pages=20, reason='test'] [21:13:13] : [Step 4/5] [2021-11-19 21:13:13,693][INFO ][db-checkpoint-thread-#24450%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:13:13] : [Step 4/5] [2021-11-19 21:13:13,693][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint finished [cpId=1d88696e-da00-4358-a6d7-a13067b28bdf, pages=20, markPos=WALPointer [idx=3, fileOff=895705, len=2048], walSegmentsCovered=[], markDuration=16ms, pagesWrite=1ms, fsync=25ms, total=42ms] [21:13:13] : [Step 4/5] [2021-11-19 21:13:13,693][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00cce8f9-a2b3-4d32-a95a-7f6eb6335000, grp=1613773252] [21:13:13] : [Step 4/5] [2021-11-19 21:13:13,703][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint started [checkpointId=02f09624-af0b-4ce5-9979-1216958bff99, startPtr=WALPointer [idx=3, fileOff=895477, len=2010], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=6ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=1ms, pages=20, reason='test'] [21:13:13] : [Step 4/5] [2021-11-19 21:13:13,721][INFO ][db-checkpoint-thread-#24445%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:13:13] : [Step 4/5] [2021-11-19 21:13:13,721][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint finished [cpId=02f09624-af0b-4ce5-9979-1216958bff99, pages=20, markPos=WALPointer [idx=3, fileOff=895477, len=2010], walSegmentsCovered=[], markDuration=8ms, pagesWrite=1ms, fsync=17ms, total=27ms] [21:13:13] : [Step 4/5] [2021-11-19 21:13:13,726][INFO ][disco-notifier-worker-#24306%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=41] [21:13:13] : [Step 4/5] [2021-11-19 21:13:13,726][INFO ][disco-notifier-worker-#24425%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=41] [21:13:13] : [Step 4/5] [2021-11-19 21:13:13,726][INFO ][reencrypt-#24467%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:13:13] : [Step 4/5] [2021-11-19 21:13:13,727][INFO ][reencrypt-#24466%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:13:13] : [Step 4/5] [2021-11-19 21:13:13,928][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10b6f63c-e31c-4573-a225-9f76f500c001, grp=1613773252] [21:13:14] : [Step 4/5] [2021-11-19 21:13:14,040][INFO ][wal-file-archiver%grid-1-#24440%grid-1%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=3, segIdx=3, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000003.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000003.wal] [21:13:14] : [Step 4/5] [2021-11-19 21:13:14,093][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint started [checkpointId=9961da7a-61ff-46ec-87d5-a20dbcb95a4e, startPtr=WALPointer [idx=4, fileOff=8496, len=2048], checkpointBeforeLockTime=113ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=0ms, writeCheckpointEntryDuration=51ms, splitAndSortCpPagesDuration=0ms, pages=22, reason='test'] [21:13:14] : [Step 4/5] [2021-11-19 21:13:14,107][INFO ][wal-file-archiver%grid-1-#24440%grid-1%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000003.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000003.wal] [21:13:14] : [Step 4/5] [2021-11-19 21:13:14,116][INFO ][db-checkpoint-thread-#24450%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:13:14] : [Step 4/5] [2021-11-19 21:13:14,117][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint finished [cpId=9961da7a-61ff-46ec-87d5-a20dbcb95a4e, pages=22, markPos=WALPointer [idx=4, fileOff=8496, len=2048], walSegmentsCovered=[3], markDuration=53ms, pagesWrite=1ms, fsync=22ms, total=189ms] [21:13:14] : [Step 4/5] [2021-11-19 21:13:14,117][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00cce8f9-a2b3-4d32-a95a-7f6eb6335000, grp=1613773252] [21:13:14] : [Step 4/5] [2021-11-19 21:13:14,124][INFO ][wal-file-archiver%grid-0-#24437%grid-0%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=3, segIdx=3, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000003.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000003.wal] [21:13:14] : [Step 4/5] [2021-11-19 21:13:14,126][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint started [checkpointId=4fc52248-6830-479d-a6c2-a0db74a6a05c, startPtr=WALPointer [idx=4, fileOff=8496, len=2010], checkpointBeforeLockTime=6ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=0ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=0ms, pages=22, reason='test'] [21:13:14] : [Step 4/5] [2021-11-19 21:13:14,140][INFO ][wal-file-archiver%grid-0-#24437%grid-0%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000003.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000003.wal] [21:13:14] : [Step 4/5] [2021-11-19 21:13:14,149][INFO ][db-checkpoint-thread-#24445%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:13:14] : [Step 4/5] [2021-11-19 21:13:14,150][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint finished [cpId=4fc52248-6830-479d-a6c2-a0db74a6a05c, pages=22, markPos=WALPointer [idx=4, fileOff=8496, len=2010], walSegmentsCovered=[3], markDuration=3ms, pagesWrite=1ms, fsync=22ms, total=32ms] [21:13:14] : [Step 4/5] [2021-11-19 21:13:14,154][INFO ][disco-notifier-worker-#24306%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=42] [21:13:14] : [Step 4/5] [2021-11-19 21:13:14,155][INFO ][reencrypt-#24467%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:13:14] : [Step 4/5] [2021-11-19 21:13:14,155][INFO ][disco-notifier-worker-#24425%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=42] [21:13:14] : [Step 4/5] [2021-11-19 21:13:14,155][INFO ][reencrypt-#24466%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:13:14] : [Step 4/5] [2021-11-19 21:13:14,157][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10b6f63c-e31c-4573-a225-9f76f500c001, grp=1613773252] [21:13:14] : [Step 4/5] [2021-11-19 21:13:14,160][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint started [checkpointId=50b2d604-516e-4493-8b23-5e52b3b165c7, startPtr=WALPointer [idx=4, fileOff=164864, len=2048], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=1ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=1ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=0ms, pages=21, reason='test'] [21:13:14] : [Step 4/5] [2021-11-19 21:13:14,178][INFO ][db-checkpoint-thread-#24450%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:13:14] : [Step 4/5] [2021-11-19 21:13:14,179][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint finished [cpId=50b2d604-516e-4493-8b23-5e52b3b165c7, pages=21, markPos=WALPointer [idx=4, fileOff=164864, len=2048], walSegmentsCovered=[], markDuration=4ms, pagesWrite=0ms, fsync=18ms, total=22ms] [21:13:14] : [Step 4/5] [2021-11-19 21:13:14,179][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00cce8f9-a2b3-4d32-a95a-7f6eb6335000, grp=1613773252] [21:13:14] : [Step 4/5] [2021-11-19 21:13:14,188][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint started [checkpointId=48ba6813-cdf1-453e-9587-83af6324e82c, startPtr=WALPointer [idx=4, fileOff=164826, len=2010], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=7ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=0ms, pages=21, reason='test'] [21:13:14] : [Step 4/5] [2021-11-19 21:13:14,206][INFO ][db-checkpoint-thread-#24445%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:13:14] : [Step 4/5] [2021-11-19 21:13:14,207][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint finished [cpId=48ba6813-cdf1-453e-9587-83af6324e82c, pages=21, markPos=WALPointer [idx=4, fileOff=164826, len=2010], walSegmentsCovered=[], markDuration=9ms, pagesWrite=1ms, fsync=17ms, total=28ms] [21:13:14] : [Step 4/5] [2021-11-19 21:13:14,211][INFO ][disco-notifier-worker-#24306%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=43] [21:13:14] : [Step 4/5] [2021-11-19 21:13:14,211][INFO ][disco-notifier-worker-#24425%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=43] [21:13:14] : [Step 4/5] [2021-11-19 21:13:14,211][INFO ][reencrypt-#24467%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:13:14] : [Step 4/5] [2021-11-19 21:13:14,211][INFO ][reencrypt-#24466%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:13:14] : [Step 4/5] [2021-11-19 21:13:14,412][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10b6f63c-e31c-4573-a225-9f76f500c001, grp=1613773252] [21:13:14] : [Step 4/5] [2021-11-19 21:13:14,562][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint started [checkpointId=e1afc5c5-5190-427c-9ed2-643fd20f9308, startPtr=WALPointer [idx=4, fileOff=326401, len=2048], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=31ms, writeCheckpointEntryDuration=117ms, splitAndSortCpPagesDuration=0ms, pages=22, reason='test'] [21:13:14] : [Step 4/5] [2021-11-19 21:13:14,617][INFO ][db-checkpoint-thread-#24450%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:13:14] : [Step 4/5] [2021-11-19 21:13:14,618][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint finished [cpId=e1afc5c5-5190-427c-9ed2-643fd20f9308, pages=22, markPos=WALPointer [idx=4, fileOff=326401, len=2048], walSegmentsCovered=[], markDuration=149ms, pagesWrite=1ms, fsync=54ms, total=204ms] [21:13:14] : [Step 4/5] [2021-11-19 21:13:14,618][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00cce8f9-a2b3-4d32-a95a-7f6eb6335000, grp=1613773252] [21:13:14] : [Step 4/5] [2021-11-19 21:13:14,670][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint started [checkpointId=e58bfd79-4ac5-4e5a-81db-360e2e6d40c0, startPtr=WALPointer [idx=4, fileOff=326325, len=2010], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=2ms, writeCheckpointEntryDuration=48ms, splitAndSortCpPagesDuration=1ms, pages=22, reason='test'] [21:13:15] : [Step 4/5] [2021-11-19 21:13:15,081][INFO ][db-checkpoint-thread-#24445%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:13:15] : [Step 4/5] [2021-11-19 21:13:15,082][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint finished [cpId=e58bfd79-4ac5-4e5a-81db-360e2e6d40c0, pages=22, markPos=WALPointer [idx=4, fileOff=326325, len=2010], walSegmentsCovered=[], markDuration=51ms, pagesWrite=1ms, fsync=411ms, total=464ms] [21:13:15] : [Step 4/5] [2021-11-19 21:13:15,086][INFO ][disco-notifier-worker-#24306%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=44] [21:13:15] : [Step 4/5] [2021-11-19 21:13:15,086][INFO ][reencrypt-#24467%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:13:15] : [Step 4/5] [2021-11-19 21:13:15,086][INFO ][disco-notifier-worker-#24425%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=44] [21:13:15] : [Step 4/5] [2021-11-19 21:13:15,087][INFO ][reencrypt-#24466%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:13:15] : [Step 4/5] [2021-11-19 21:13:15,288][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10b6f63c-e31c-4573-a225-9f76f500c001, grp=1613773252] [21:13:15] : [Step 4/5] [2021-11-19 21:13:15,291][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint started [checkpointId=dc17f102-103f-4756-82fb-ed28d5ceed15, startPtr=WALPointer [idx=4, fileOff=477111, len=2048], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=1ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=0ms, pages=19, reason='test'] [21:13:15] : [Step 4/5] [2021-11-19 21:13:15,309][INFO ][db-checkpoint-thread-#24450%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:13:15] : [Step 4/5] [2021-11-19 21:13:15,310][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint finished [cpId=dc17f102-103f-4756-82fb-ed28d5ceed15, pages=19, markPos=WALPointer [idx=4, fileOff=477111, len=2048], walSegmentsCovered=[], markDuration=3ms, pagesWrite=1ms, fsync=16ms, total=21ms] [21:13:15] : [Step 4/5] [2021-11-19 21:13:15,310][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00cce8f9-a2b3-4d32-a95a-7f6eb6335000, grp=1613773252] [21:13:15] : [Step 4/5] [2021-11-19 21:13:15,319][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint started [checkpointId=86cc072c-7c46-41ab-80f8-c404089f7086, startPtr=WALPointer [idx=4, fileOff=476997, len=2010], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=7ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=0ms, pages=19, reason='test'] [21:13:15] : [Step 4/5] [2021-11-19 21:13:15,336][INFO ][db-checkpoint-thread-#24445%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:13:15] : [Step 4/5] [2021-11-19 21:13:15,337][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint finished [cpId=86cc072c-7c46-41ab-80f8-c404089f7086, pages=19, markPos=WALPointer [idx=4, fileOff=476997, len=2010], walSegmentsCovered=[], markDuration=8ms, pagesWrite=1ms, fsync=17ms, total=27ms] [21:13:15] : [Step 4/5] [2021-11-19 21:13:15,341][INFO ][disco-notifier-worker-#24306%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=45] [21:13:15] : [Step 4/5] [2021-11-19 21:13:15,341][INFO ][disco-notifier-worker-#24425%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=45] [21:13:15] : [Step 4/5] [2021-11-19 21:13:15,341][INFO ][reencrypt-#24467%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:13:15] : [Step 4/5] [2021-11-19 21:13:15,342][INFO ][reencrypt-#24466%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:13:15] : [Step 4/5] [2021-11-19 21:13:15,543][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10b6f63c-e31c-4573-a225-9f76f500c001, grp=1613773252] [21:13:15] : [Step 4/5] [2021-11-19 21:13:15,546][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint started [checkpointId=2bc5521f-c3b7-4e9f-bba1-5c6312417df6, startPtr=WALPointer [idx=4, fileOff=630900, len=2048], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=1ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=0ms, pages=19, reason='test'] [21:13:15] : [Step 4/5] [2021-11-19 21:13:15,564][INFO ][db-checkpoint-thread-#24450%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:13:15] : [Step 4/5] [2021-11-19 21:13:15,564][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint finished [cpId=2bc5521f-c3b7-4e9f-bba1-5c6312417df6, pages=19, markPos=WALPointer [idx=4, fileOff=630900, len=2048], walSegmentsCovered=[], markDuration=3ms, pagesWrite=1ms, fsync=16ms, total=21ms] [21:13:15] : [Step 4/5] [2021-11-19 21:13:15,564][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00cce8f9-a2b3-4d32-a95a-7f6eb6335000, grp=1613773252] [21:13:15] : [Step 4/5] [2021-11-19 21:13:15,574][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint started [checkpointId=12c65fd3-8bda-4ad3-b422-be8b36a101a8, startPtr=WALPointer [idx=4, fileOff=630748, len=2010], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=1ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=6ms, writeCheckpointEntryDuration=2ms, splitAndSortCpPagesDuration=0ms, pages=19, reason='test'] [21:13:15] : [Step 4/5] [2021-11-19 21:13:15,592][INFO ][db-checkpoint-thread-#24445%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:13:15] : [Step 4/5] [2021-11-19 21:13:15,592][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint finished [cpId=12c65fd3-8bda-4ad3-b422-be8b36a101a8, pages=19, markPos=WALPointer [idx=4, fileOff=630748, len=2010], walSegmentsCovered=[], markDuration=10ms, pagesWrite=0ms, fsync=17ms, total=27ms] [21:13:15] : [Step 4/5] [2021-11-19 21:13:15,597][INFO ][disco-notifier-worker-#24306%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=46] [21:13:15] : [Step 4/5] [2021-11-19 21:13:15,597][INFO ][disco-notifier-worker-#24425%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=46] [21:13:15] : [Step 4/5] [2021-11-19 21:13:15,597][INFO ][reencrypt-#24467%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:13:15] : [Step 4/5] [2021-11-19 21:13:15,597][INFO ][reencrypt-#24466%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:13:15] : [Step 4/5] [2021-11-19 21:13:15,798][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10b6f63c-e31c-4573-a225-9f76f500c001, grp=1613773252] [21:13:15] : [Step 4/5] [2021-11-19 21:13:15,953][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint started [checkpointId=4476639f-8619-4104-b5d7-846607c637cd, startPtr=WALPointer [idx=4, fileOff=790575, len=2048], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=86ms, writeCheckpointEntryDuration=67ms, splitAndSortCpPagesDuration=0ms, pages=20, reason='test'] [21:13:15] : [Step 4/5] [2021-11-19 21:13:15,971][INFO ][db-checkpoint-thread-#24450%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:13:15] : [Step 4/5] [2021-11-19 21:13:15,971][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint finished [cpId=4476639f-8619-4104-b5d7-846607c637cd, pages=20, markPos=WALPointer [idx=4, fileOff=790575, len=2048], walSegmentsCovered=[], markDuration=155ms, pagesWrite=0ms, fsync=17ms, total=172ms] [21:13:15] : [Step 4/5] [2021-11-19 21:13:15,971][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00cce8f9-a2b3-4d32-a95a-7f6eb6335000, grp=1613773252] [21:13:15] : [Step 4/5] [2021-11-19 21:13:15,979][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint started [checkpointId=f84ae88b-1181-44b5-94f2-e72422ee3587, startPtr=WALPointer [idx=4, fileOff=790385, len=2010], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=6ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=0ms, pages=20, reason='test'] [21:13:15] : [Step 4/5] [2021-11-19 21:13:15,998][INFO ][db-checkpoint-thread-#24445%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:13:15] : [Step 4/5] [2021-11-19 21:13:15,998][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint finished [cpId=f84ae88b-1181-44b5-94f2-e72422ee3587, pages=20, markPos=WALPointer [idx=4, fileOff=790385, len=2010], walSegmentsCovered=[], markDuration=8ms, pagesWrite=0ms, fsync=18ms, total=26ms] [21:13:16] : [Step 4/5] [2021-11-19 21:13:16,003][INFO ][disco-notifier-worker-#24306%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=47] [21:13:16] : [Step 4/5] [2021-11-19 21:13:16,003][INFO ][disco-notifier-worker-#24425%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=47] [21:13:16] : [Step 4/5] [2021-11-19 21:13:16,003][INFO ][reencrypt-#24467%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:13:16] : [Step 4/5] [2021-11-19 21:13:16,003][INFO ][reencrypt-#24466%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:13:16] : [Step 4/5] [2021-11-19 21:13:16,204][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10b6f63c-e31c-4573-a225-9f76f500c001, grp=1613773252] [21:13:16] : [Step 4/5] [2021-11-19 21:13:16,453][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint started [checkpointId=637e39e6-8464-4612-ada1-b4bedfb59590, startPtr=WALPointer [idx=4, fileOff=953051, len=2048], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=86ms, writeCheckpointEntryDuration=161ms, splitAndSortCpPagesDuration=0ms, pages=21, reason='test'] [21:13:16] : [Step 4/5] [2021-11-19 21:13:16,478][INFO ][db-checkpoint-thread-#24450%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:13:16] : [Step 4/5] [2021-11-19 21:13:16,478][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint finished [cpId=637e39e6-8464-4612-ada1-b4bedfb59590, pages=21, markPos=WALPointer [idx=4, fileOff=953051, len=2048], walSegmentsCovered=[], markDuration=249ms, pagesWrite=1ms, fsync=23ms, total=273ms] [21:13:16] : [Step 4/5] [2021-11-19 21:13:16,479][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00cce8f9-a2b3-4d32-a95a-7f6eb6335000, grp=1613773252] [21:13:16] : [Step 4/5] [2021-11-19 21:13:16,487][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint started [checkpointId=9a0417f7-7519-42f4-bdc1-31b2f3f743f0, startPtr=WALPointer [idx=4, fileOff=952823, len=2010], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=5ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=1ms, pages=21, reason='test'] [21:13:16] : [Step 4/5] [2021-11-19 21:13:16,504][INFO ][db-checkpoint-thread-#24445%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:13:16] : [Step 4/5] [2021-11-19 21:13:16,504][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint finished [cpId=9a0417f7-7519-42f4-bdc1-31b2f3f743f0, pages=21, markPos=WALPointer [idx=4, fileOff=952823, len=2010], walSegmentsCovered=[], markDuration=7ms, pagesWrite=1ms, fsync=16ms, total=25ms] [21:13:16] : [Step 4/5] [2021-11-19 21:13:16,512][INFO ][wal-file-archiver%grid-0-#24437%grid-0%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=4, segIdx=4, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000004.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000004.wal] [21:13:16] : [Step 4/5] [2021-11-19 21:13:16,512][INFO ][wal-file-archiver%grid-1-#24440%grid-1%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=4, segIdx=4, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000004.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000004.wal] [21:13:16] : [Step 4/5] [2021-11-19 21:13:16,513][INFO ][disco-notifier-worker-#24425%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=48] [21:13:16] : [Step 4/5] [2021-11-19 21:13:16,513][INFO ][disco-notifier-worker-#24306%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=48] [21:13:16] : [Step 4/5] [2021-11-19 21:13:16,514][INFO ][reencrypt-#24466%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:13:16] : [Step 4/5] [2021-11-19 21:13:16,514][INFO ][reencrypt-#24467%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:13:16] : [Step 4/5] [2021-11-19 21:13:16,528][INFO ][wal-file-archiver%grid-0-#24437%grid-0%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000004.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000004.wal] [21:13:16] : [Step 4/5] [2021-11-19 21:13:16,528][INFO ][wal-file-archiver%grid-1-#24440%grid-1%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000004.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000004.wal] [21:13:16] : [Step 4/5] [2021-11-19 21:13:16,715][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10b6f63c-e31c-4573-a225-9f76f500c001, grp=1613773252] [21:13:16] : [Step 4/5] [2021-11-19 21:13:16,963][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint started [checkpointId=d95a71a1-b8bd-4caa-85a6-117002c7f328, startPtr=WALPointer [idx=5, fileOff=72261, len=2048], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=84ms, writeCheckpointEntryDuration=162ms, splitAndSortCpPagesDuration=0ms, pages=21, reason='test'] [21:13:16] : [Step 4/5] [2021-11-19 21:13:16,975][INFO ][db-checkpoint-thread-#24450%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:13:16] : [Step 4/5] [2021-11-19 21:13:16,975][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint finished [cpId=d95a71a1-b8bd-4caa-85a6-117002c7f328, pages=21, markPos=WALPointer [idx=5, fileOff=72261, len=2048], walSegmentsCovered=[4], markDuration=247ms, pagesWrite=1ms, fsync=11ms, total=259ms] [21:13:16] : [Step 4/5] [2021-11-19 21:13:16,976][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00cce8f9-a2b3-4d32-a95a-7f6eb6335000, grp=1613773252] [21:13:16] : [Step 4/5] [2021-11-19 21:13:16,984][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint started [checkpointId=754cd4df-c988-4aff-967b-1359656960d9, startPtr=WALPointer [idx=5, fileOff=72261, len=2010], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=6ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=0ms, pages=21, reason='test'] [21:13:17] : [Step 4/5] [2021-11-19 21:13:17,002][INFO ][db-checkpoint-thread-#24445%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:13:17] : [Step 4/5] [2021-11-19 21:13:17,002][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint finished [cpId=754cd4df-c988-4aff-967b-1359656960d9, pages=21, markPos=WALPointer [idx=5, fileOff=72261, len=2010], walSegmentsCovered=[4], markDuration=8ms, pagesWrite=0ms, fsync=17ms, total=26ms] [21:13:17] : [Step 4/5] [2021-11-19 21:13:17,007][INFO ][disco-notifier-worker-#24306%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=49] [21:13:17] : [Step 4/5] [2021-11-19 21:13:17,007][INFO ][disco-notifier-worker-#24425%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=49] [21:13:17] : [Step 4/5] [2021-11-19 21:13:17,007][INFO ][reencrypt-#24466%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:13:17] : [Step 4/5] [2021-11-19 21:13:17,007][INFO ][reencrypt-#24467%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:13:17] : [Step 4/5] [2021-11-19 21:13:17,208][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10b6f63c-e31c-4573-a225-9f76f500c001, grp=1613773252] [21:13:17] : [Step 4/5] [2021-11-19 21:13:17,416][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint started [checkpointId=63d6f1a5-92f5-4d31-88d1-321f63525c65, startPtr=WALPointer [idx=5, fileOff=243629, len=2048], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=114ms, writeCheckpointEntryDuration=93ms, splitAndSortCpPagesDuration=0ms, pages=22, reason='test'] [21:13:17] : [Step 4/5] [2021-11-19 21:13:17,434][INFO ][db-checkpoint-thread-#24450%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:13:17] : [Step 4/5] [2021-11-19 21:13:17,435][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint finished [cpId=63d6f1a5-92f5-4d31-88d1-321f63525c65, pages=22, markPos=WALPointer [idx=5, fileOff=243629, len=2048], walSegmentsCovered=[], markDuration=208ms, pagesWrite=1ms, fsync=17ms, total=226ms] [21:13:17] : [Step 4/5] [2021-11-19 21:13:17,435][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00cce8f9-a2b3-4d32-a95a-7f6eb6335000, grp=1613773252] [21:13:17] : [Step 4/5] [2021-11-19 21:13:17,444][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint started [checkpointId=e78aa1a2-e878-450a-a359-a21543b44a0f, startPtr=WALPointer [idx=5, fileOff=243591, len=2010], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=5ms, writeCheckpointEntryDuration=2ms, splitAndSortCpPagesDuration=0ms, pages=22, reason='test'] [21:13:17] : [Step 4/5] [2021-11-19 21:13:17,461][INFO ][db-checkpoint-thread-#24445%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:13:17] : [Step 4/5] [2021-11-19 21:13:17,462][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint finished [cpId=e78aa1a2-e878-450a-a359-a21543b44a0f, pages=22, markPos=WALPointer [idx=5, fileOff=243591, len=2010], walSegmentsCovered=[], markDuration=9ms, pagesWrite=0ms, fsync=16ms, total=25ms] [21:13:17] : [Step 4/5] [2021-11-19 21:13:17,466][INFO ][disco-notifier-worker-#24306%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=50] [21:13:17] : [Step 4/5] [2021-11-19 21:13:17,467][INFO ][disco-notifier-worker-#24425%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=50] [21:13:17] : [Step 4/5] [2021-11-19 21:13:17,467][INFO ][reencrypt-#24467%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:13:17] : [Step 4/5] [2021-11-19 21:13:17,467][INFO ][reencrypt-#24466%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:13:17] : [Step 4/5] [2021-11-19 21:13:17,668][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10b6f63c-e31c-4573-a225-9f76f500c001, grp=1613773252] [21:13:17] : [Step 4/5] [2021-11-19 21:13:17,818][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint started [checkpointId=c108ba6a-49eb-42e7-8582-fb4d53917b5b, startPtr=WALPointer [idx=5, fileOff=412610, len=2048], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=38ms, writeCheckpointEntryDuration=110ms, splitAndSortCpPagesDuration=0ms, pages=21, reason='test'] [21:13:17] : [Step 4/5] [2021-11-19 21:13:17,942][INFO ][db-checkpoint-thread-#24450%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:13:17] : [Step 4/5] [2021-11-19 21:13:17,943][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint finished [cpId=c108ba6a-49eb-42e7-8582-fb4d53917b5b, pages=21, markPos=WALPointer [idx=5, fileOff=412610, len=2048], walSegmentsCovered=[], markDuration=150ms, pagesWrite=0ms, fsync=124ms, total=275ms] [21:13:17] : [Step 4/5] [2021-11-19 21:13:17,943][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00cce8f9-a2b3-4d32-a95a-7f6eb6335000, grp=1613773252] [21:13:17] : [Step 4/5] [2021-11-19 21:13:17,971][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint started [checkpointId=9fc77c93-310c-4b0b-84e2-ef83e1a7ec3e, startPtr=WALPointer [idx=5, fileOff=412534, len=2010], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=22ms, writeCheckpointEntryDuration=5ms, splitAndSortCpPagesDuration=0ms, pages=21, reason='test'] [21:13:18] : [Step 4/5] [2021-11-19 21:13:18,161][INFO ][db-checkpoint-thread-#24445%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:13:18] : [Step 4/5] [2021-11-19 21:13:18,161][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint finished [cpId=9fc77c93-310c-4b0b-84e2-ef83e1a7ec3e, pages=21, markPos=WALPointer [idx=5, fileOff=412534, len=2010], walSegmentsCovered=[], markDuration=28ms, pagesWrite=1ms, fsync=188ms, total=218ms] [21:13:18] : [Step 4/5] [2021-11-19 21:13:18,166][INFO ][disco-notifier-worker-#24306%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=51] [21:13:18] : [Step 4/5] [2021-11-19 21:13:18,167][INFO ][reencrypt-#24467%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:13:18] : [Step 4/5] [2021-11-19 21:13:18,167][INFO ][disco-notifier-worker-#24425%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=51] [21:13:18] : [Step 4/5] [2021-11-19 21:13:18,167][INFO ][reencrypt-#24466%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:13:18] : [Step 4/5] [2021-11-19 21:13:18,368][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10b6f63c-e31c-4573-a225-9f76f500c001, grp=1613773252] [21:13:18] : [Step 4/5] [2021-11-19 21:13:18,577][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint started [checkpointId=66c4cf44-767f-4c0a-9249-41e479034415, startPtr=WALPointer [idx=5, fileOff=587151, len=2048], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=1ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=135ms, writeCheckpointEntryDuration=72ms, splitAndSortCpPagesDuration=0ms, pages=23, reason='test'] [21:13:18] : [Step 4/5] [2021-11-19 21:13:18,956][INFO ][db-checkpoint-thread-#24450%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:13:18] : [Step 4/5] [2021-11-19 21:13:18,957][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint finished [cpId=66c4cf44-767f-4c0a-9249-41e479034415, pages=23, markPos=WALPointer [idx=5, fileOff=587151, len=2048], walSegmentsCovered=[], markDuration=209ms, pagesWrite=1ms, fsync=378ms, total=588ms] [21:13:18] : [Step 4/5] [2021-11-19 21:13:18,957][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00cce8f9-a2b3-4d32-a95a-7f6eb6335000, grp=1613773252] [21:13:18] : [Step 4/5] [2021-11-19 21:13:18,967][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint started [checkpointId=5e8e4e7a-37f5-452e-84be-b99c84b23565, startPtr=WALPointer [idx=5, fileOff=587037, len=2010], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=7ms, writeCheckpointEntryDuration=2ms, splitAndSortCpPagesDuration=0ms, pages=23, reason='test'] [21:13:18] : [Step 4/5] [2021-11-19 21:13:18,985][INFO ][db-checkpoint-thread-#24445%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:13:18] : [Step 4/5] [2021-11-19 21:13:18,985][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint finished [cpId=5e8e4e7a-37f5-452e-84be-b99c84b23565, pages=23, markPos=WALPointer [idx=5, fileOff=587037, len=2010], walSegmentsCovered=[], markDuration=10ms, pagesWrite=2ms, fsync=15ms, total=27ms] [21:13:18] : [Step 4/5] [2021-11-19 21:13:18,992][INFO ][disco-notifier-worker-#24306%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=52] [21:13:18] : [Step 4/5] [2021-11-19 21:13:18,992][INFO ][reencrypt-#24467%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:13:18] : [Step 4/5] [2021-11-19 21:13:18,994][INFO ][disco-notifier-worker-#24425%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=52] [21:13:18] : [Step 4/5] [2021-11-19 21:13:18,995][INFO ][reencrypt-#24466%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:13:18] : [Step 4/5] [2021-11-19 21:13:18,996][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10b6f63c-e31c-4573-a225-9f76f500c001, grp=1613773252] [21:13:19] : [Step 4/5] [2021-11-19 21:13:19,000][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint started [checkpointId=3c81cbde-78c5-4d6b-8386-7acf9465fcac, startPtr=WALPointer [idx=5, fileOff=763579, len=2048], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=2ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=0ms, pages=23, reason='test'] [21:13:19] : [Step 4/5] [2021-11-19 21:13:19,018][INFO ][db-checkpoint-thread-#24450%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:13:19] : [Step 4/5] [2021-11-19 21:13:19,019][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint finished [cpId=3c81cbde-78c5-4d6b-8386-7acf9465fcac, pages=23, markPos=WALPointer [idx=5, fileOff=763579, len=2048], walSegmentsCovered=[], markDuration=4ms, pagesWrite=0ms, fsync=18ms, total=22ms] [21:13:19] : [Step 4/5] [2021-11-19 21:13:19,019][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00cce8f9-a2b3-4d32-a95a-7f6eb6335000, grp=1613773252] [21:13:19] : [Step 4/5] [2021-11-19 21:13:19,030][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint started [checkpointId=2199ad26-7a93-4cf2-ae4b-062b539963b1, startPtr=WALPointer [idx=5, fileOff=763427, len=2010], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=4ms, checkpointLockHoldTime=8ms, walCpRecordFsyncDuration=1ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=0ms, pages=23, reason='test'] [21:13:19] : [Step 4/5] [2021-11-19 21:13:19,348][INFO ][db-checkpoint-thread-#24445%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:13:19] : [Step 4/5] [2021-11-19 21:13:19,348][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint finished [cpId=2199ad26-7a93-4cf2-ae4b-062b539963b1, pages=23, markPos=WALPointer [idx=5, fileOff=763427, len=2010], walSegmentsCovered=[], markDuration=11ms, pagesWrite=1ms, fsync=316ms, total=329ms] [21:13:19] : [Step 4/5] [2021-11-19 21:13:19,354][INFO ][disco-notifier-worker-#24306%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=53] [21:13:19] : [Step 4/5] [2021-11-19 21:13:19,355][INFO ][disco-notifier-worker-#24425%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=53] [21:13:19] : [Step 4/5] [2021-11-19 21:13:19,355][INFO ][reencrypt-#24467%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:13:19] : [Step 4/5] [2021-11-19 21:13:19,355][INFO ][reencrypt-#24466%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:13:19] : [Step 4/5] [2021-11-19 21:13:19,357][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10b6f63c-e31c-4573-a225-9f76f500c001, grp=1613773252] [21:13:19] : [Step 4/5] [2021-11-19 21:13:19,361][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint started [checkpointId=557a9dfc-9ab0-4c7c-af8d-c81687599505, startPtr=WALPointer [idx=5, fileOff=941918, len=2048], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=1ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=1ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=0ms, pages=22, reason='test'] [21:13:19] : [Step 4/5] [2021-11-19 21:13:19,379][INFO ][db-checkpoint-thread-#24450%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:13:19] : [Step 4/5] [2021-11-19 21:13:19,379][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint finished [cpId=557a9dfc-9ab0-4c7c-af8d-c81687599505, pages=22, markPos=WALPointer [idx=5, fileOff=941918, len=2048], walSegmentsCovered=[], markDuration=4ms, pagesWrite=1ms, fsync=16ms, total=21ms] [21:13:19] : [Step 4/5] [2021-11-19 21:13:19,380][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00cce8f9-a2b3-4d32-a95a-7f6eb6335000, grp=1613773252] [21:13:19] : [Step 4/5] [2021-11-19 21:13:19,389][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint started [checkpointId=fcfc564e-22e4-47d2-ab68-22e4d37dece0, startPtr=WALPointer [idx=5, fileOff=941728, len=2010], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=6ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=1ms, pages=22, reason='test'] [21:13:19] : [Step 4/5] [2021-11-19 21:13:19,406][INFO ][db-checkpoint-thread-#24445%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:13:19] : [Step 4/5] [2021-11-19 21:13:19,406][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint finished [cpId=fcfc564e-22e4-47d2-ab68-22e4d37dece0, pages=22, markPos=WALPointer [idx=5, fileOff=941728, len=2010], walSegmentsCovered=[], markDuration=8ms, pagesWrite=1ms, fsync=16ms, total=26ms] [21:13:19] : [Step 4/5] [2021-11-19 21:13:19,415][INFO ][wal-file-archiver%grid-1-#24440%grid-1%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=5, segIdx=5, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000005.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000005.wal] [21:13:19] : [Step 4/5] [2021-11-19 21:13:19,415][INFO ][wal-file-archiver%grid-0-#24437%grid-0%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=5, segIdx=5, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000005.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000005.wal] [21:13:19] : [Step 4/5] [2021-11-19 21:13:19,415][INFO ][disco-notifier-worker-#24306%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=54] [21:13:19] : [Step 4/5] [2021-11-19 21:13:19,415][INFO ][disco-notifier-worker-#24425%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=54] [21:13:19] : [Step 4/5] [2021-11-19 21:13:19,416][INFO ][reencrypt-#24467%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:13:19] : [Step 4/5] [2021-11-19 21:13:19,417][INFO ][reencrypt-#24466%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:13:19] : [Step 4/5] [2021-11-19 21:13:19,420][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10b6f63c-e31c-4573-a225-9f76f500c001, grp=1613773252] [21:13:19] : [Step 4/5] [2021-11-19 21:13:19,431][INFO ][wal-file-archiver%grid-0-#24437%grid-0%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000005.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000005.wal] [21:13:19] : [Step 4/5] [2021-11-19 21:13:19,431][INFO ][wal-file-archiver%grid-1-#24440%grid-1%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000005.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000005.wal] [21:13:19] : [Step 4/5] [2021-11-19 21:13:19,439][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint started [checkpointId=5291fbce-225e-4343-8fa6-264e230b1aae, startPtr=WALPointer [idx=6, fileOff=77346, len=2048], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=9ms, writeCheckpointEntryDuration=9ms, splitAndSortCpPagesDuration=0ms, pages=22, reason='test'] [21:13:19] : [Step 4/5] [2021-11-19 21:13:19,457][INFO ][db-checkpoint-thread-#24450%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:13:19] : [Step 4/5] [2021-11-19 21:13:19,458][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint finished [cpId=5291fbce-225e-4343-8fa6-264e230b1aae, pages=22, markPos=WALPointer [idx=6, fileOff=77346, len=2048], walSegmentsCovered=[5], markDuration=19ms, pagesWrite=1ms, fsync=17ms, total=38ms] [21:13:19] : [Step 4/5] [2021-11-19 21:13:19,458][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00cce8f9-a2b3-4d32-a95a-7f6eb6335000, grp=1613773252] [21:13:19] : [Step 4/5] [2021-11-19 21:13:19,467][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint started [checkpointId=42915eed-7bcf-4559-bec1-60029a21a698, startPtr=WALPointer [idx=6, fileOff=77346, len=2010], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=6ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=0ms, pages=22, reason='test'] [21:13:19] : [Step 4/5] [2021-11-19 21:13:19,484][INFO ][db-checkpoint-thread-#24445%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:13:19] : [Step 4/5] [2021-11-19 21:13:19,484][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint finished [cpId=42915eed-7bcf-4559-bec1-60029a21a698, pages=22, markPos=WALPointer [idx=6, fileOff=77346, len=2010], walSegmentsCovered=[5], markDuration=8ms, pagesWrite=1ms, fsync=16ms, total=26ms] [21:13:19] : [Step 4/5] [2021-11-19 21:13:19,489][INFO ][disco-notifier-worker-#24425%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=55] [21:13:19] : [Step 4/5] [2021-11-19 21:13:19,489][INFO ][disco-notifier-worker-#24306%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=55] [21:13:19] : [Step 4/5] [2021-11-19 21:13:19,490][INFO ][reencrypt-#24466%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:13:19] : [Step 4/5] [2021-11-19 21:13:19,490][INFO ][reencrypt-#24467%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:13:19] : [Step 4/5] [2021-11-19 21:13:19,691][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10b6f63c-e31c-4573-a225-9f76f500c001, grp=1613773252] [21:13:19] : [Step 4/5] [2021-11-19 21:13:19,821][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint started [checkpointId=efa6d9e8-476a-46cf-a4e3-4507d4d73877, startPtr=WALPointer [idx=6, fileOff=262216, len=2048], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=62ms, writeCheckpointEntryDuration=67ms, splitAndSortCpPagesDuration=0ms, pages=23, reason='test'] [21:13:19] : [Step 4/5] [2021-11-19 21:13:19,955][INFO ][db-checkpoint-thread-#24450%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:13:19] : [Step 4/5] [2021-11-19 21:13:19,955][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint finished [cpId=efa6d9e8-476a-46cf-a4e3-4507d4d73877, pages=23, markPos=WALPointer [idx=6, fileOff=262216, len=2048], walSegmentsCovered=[], markDuration=130ms, pagesWrite=0ms, fsync=133ms, total=264ms] [21:13:19] : [Step 4/5] [2021-11-19 21:13:19,955][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00cce8f9-a2b3-4d32-a95a-7f6eb6335000, grp=1613773252] [21:13:19] : [Step 4/5] [2021-11-19 21:13:19,963][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint started [checkpointId=89815fea-3c3c-4a4d-a515-f65d7eea79fd, startPtr=WALPointer [idx=6, fileOff=262178, len=2010], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=5ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=0ms, pages=23, reason='test'] [21:13:19] : [Step 4/5] [2021-11-19 21:13:19,981][INFO ][db-checkpoint-thread-#24445%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:13:19] : [Step 4/5] [2021-11-19 21:13:19,981][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint finished [cpId=89815fea-3c3c-4a4d-a515-f65d7eea79fd, pages=23, markPos=WALPointer [idx=6, fileOff=262178, len=2010], walSegmentsCovered=[], markDuration=8ms, pagesWrite=1ms, fsync=16ms, total=25ms] [21:13:19] : [Step 4/5] [2021-11-19 21:13:19,986][INFO ][disco-notifier-worker-#24306%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=56] [21:13:19] : [Step 4/5] [2021-11-19 21:13:19,986][INFO ][disco-notifier-worker-#24425%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=56] [21:13:19] : [Step 4/5] [2021-11-19 21:13:19,986][INFO ][reencrypt-#24467%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:13:19] : [Step 4/5] [2021-11-19 21:13:19,987][INFO ][reencrypt-#24466%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:13:19] : [Step 4/5] [2021-11-19 21:13:19,988][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10b6f63c-e31c-4573-a225-9f76f500c001, grp=1613773252] [21:13:20] : [Step 4/5] [2021-11-19 21:13:20,007][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint started [checkpointId=486a00ee-1754-4cd8-8484-71bd1fe8ba1a, startPtr=WALPointer [idx=6, fileOff=446749, len=2048], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=1ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=8ms, writeCheckpointEntryDuration=8ms, splitAndSortCpPagesDuration=1ms, pages=21, reason='test'] [21:13:20] : [Step 4/5] [2021-11-19 21:13:20,017][INFO ][db-checkpoint-thread-#24450%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:13:20] : [Step 4/5] [2021-11-19 21:13:20,017][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint finished [cpId=486a00ee-1754-4cd8-8484-71bd1fe8ba1a, pages=21, markPos=WALPointer [idx=6, fileOff=446749, len=2048], walSegmentsCovered=[], markDuration=18ms, pagesWrite=1ms, fsync=9ms, total=28ms] [21:13:20] : [Step 4/5] [2021-11-19 21:13:20,018][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00cce8f9-a2b3-4d32-a95a-7f6eb6335000, grp=1613773252] [21:13:20] : [Step 4/5] [2021-11-19 21:13:20,026][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint started [checkpointId=5205386a-db72-444b-a111-bde0b54ade31, startPtr=WALPointer [idx=6, fileOff=446673, len=2010], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=6ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=0ms, pages=21, reason='test'] [21:13:20] : [Step 4/5] [2021-11-19 21:13:20,036][INFO ][db-checkpoint-thread-#24445%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:13:20] : [Step 4/5] [2021-11-19 21:13:20,036][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint finished [cpId=5205386a-db72-444b-a111-bde0b54ade31, pages=21, markPos=WALPointer [idx=6, fileOff=446673, len=2010], walSegmentsCovered=[], markDuration=8ms, pagesWrite=1ms, fsync=8ms, total=17ms] [21:13:20] : [Step 4/5] [2021-11-19 21:13:20,041][INFO ][disco-notifier-worker-#24306%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=57] [21:13:20] : [Step 4/5] [2021-11-19 21:13:20,041][INFO ][disco-notifier-worker-#24425%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=57] [21:13:20] : [Step 4/5] [2021-11-19 21:13:20,042][INFO ][reencrypt-#24467%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:13:20] : [Step 4/5] [2021-11-19 21:13:20,042][INFO ][reencrypt-#24466%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:13:20] : [Step 4/5] [2021-11-19 21:13:20,243][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10b6f63c-e31c-4573-a225-9f76f500c001, grp=1613773252] [21:13:20] : [Step 4/5] [2021-11-19 21:13:20,435][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint started [checkpointId=3b680815-8125-4ac4-bdda-68310d074441, startPtr=WALPointer [idx=6, fileOff=627130, len=2048], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=90ms, writeCheckpointEntryDuration=101ms, splitAndSortCpPagesDuration=0ms, pages=23, reason='test'] [21:13:20] : [Step 4/5] [2021-11-19 21:13:20,452][INFO ][db-checkpoint-thread-#24450%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:13:20] : [Step 4/5] [2021-11-19 21:13:20,453][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint finished [cpId=3b680815-8125-4ac4-bdda-68310d074441, pages=23, markPos=WALPointer [idx=6, fileOff=627130, len=2048], walSegmentsCovered=[], markDuration=192ms, pagesWrite=0ms, fsync=17ms, total=209ms] [21:13:20] : [Step 4/5] [2021-11-19 21:13:20,453][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00cce8f9-a2b3-4d32-a95a-7f6eb6335000, grp=1613773252] [21:13:20] : [Step 4/5] [2021-11-19 21:13:20,462][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint started [checkpointId=c2595d37-31c3-4c8b-b63c-04545a8036bb, startPtr=WALPointer [idx=6, fileOff=627016, len=2010], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=7ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=0ms, pages=23, reason='test'] [21:13:20] : [Step 4/5] [2021-11-19 21:13:20,480][INFO ][db-checkpoint-thread-#24445%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:13:20] : [Step 4/5] [2021-11-19 21:13:20,480][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint finished [cpId=c2595d37-31c3-4c8b-b63c-04545a8036bb, pages=23, markPos=WALPointer [idx=6, fileOff=627016, len=2010], walSegmentsCovered=[], markDuration=9ms, pagesWrite=0ms, fsync=17ms, total=26ms] [21:13:20] : [Step 4/5] [2021-11-19 21:13:20,485][INFO ][disco-notifier-worker-#24306%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=58] [21:13:20] : [Step 4/5] [2021-11-19 21:13:20,486][INFO ][reencrypt-#24467%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:13:20] : [Step 4/5] [2021-11-19 21:13:20,486][INFO ][disco-notifier-worker-#24425%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=58] [21:13:20] : [Step 4/5] [2021-11-19 21:13:20,486][INFO ][reencrypt-#24466%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:13:20] : [Step 4/5] [2021-11-19 21:13:20,687][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10b6f63c-e31c-4573-a225-9f76f500c001, grp=1613773252] [21:13:20] : [Step 4/5] [2021-11-19 21:13:20,690][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint started [checkpointId=9f8fba1f-26ef-4707-81c5-f49974b9a8f9, startPtr=WALPointer [idx=6, fileOff=813244, len=2048], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=1ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=0ms, pages=23, reason='test'] [21:13:20] : [Step 4/5] [2021-11-19 21:13:20,708][INFO ][db-checkpoint-thread-#24450%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:13:20] : [Step 4/5] [2021-11-19 21:13:20,708][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint finished [cpId=9f8fba1f-26ef-4707-81c5-f49974b9a8f9, pages=23, markPos=WALPointer [idx=6, fileOff=813244, len=2048], walSegmentsCovered=[], markDuration=3ms, pagesWrite=1ms, fsync=16ms, total=20ms] [21:13:20] : [Step 4/5] [2021-11-19 21:13:20,708][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00cce8f9-a2b3-4d32-a95a-7f6eb6335000, grp=1613773252] [21:13:20] : [Step 4/5] [2021-11-19 21:13:20,717][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint started [checkpointId=26bf913a-b85f-435c-ad09-4897c36a6d26, startPtr=WALPointer [idx=6, fileOff=813092, len=2010], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=5ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=0ms, pages=23, reason='test'] [21:13:20] : [Step 4/5] [2021-11-19 21:13:20,734][INFO ][db-checkpoint-thread-#24445%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:13:20] : [Step 4/5] [2021-11-19 21:13:20,735][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint finished [cpId=26bf913a-b85f-435c-ad09-4897c36a6d26, pages=23, markPos=WALPointer [idx=6, fileOff=813092, len=2010], walSegmentsCovered=[], markDuration=7ms, pagesWrite=1ms, fsync=17ms, total=26ms] [21:13:20] : [Step 4/5] [2021-11-19 21:13:20,739][INFO ][disco-notifier-worker-#24306%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=59] [21:13:20] : [Step 4/5] [2021-11-19 21:13:20,739][INFO ][disco-notifier-worker-#24425%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=59] [21:13:20] : [Step 4/5] [2021-11-19 21:13:20,739][INFO ][reencrypt-#24467%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:13:20] : [Step 4/5] [2021-11-19 21:13:20,740][INFO ][reencrypt-#24466%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:13:20] : [Step 4/5] [2021-11-19 21:13:20,941][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10b6f63c-e31c-4573-a225-9f76f500c001, grp=1613773252] [21:13:21] : [Step 4/5] [2021-11-19 21:13:21,108][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint started [checkpointId=16a2f785-acea-4494-82fc-a3d60612c78b, startPtr=WALPointer [idx=6, fileOff=1000932, len=2048], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=1ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=164ms, writeCheckpointEntryDuration=2ms, splitAndSortCpPagesDuration=0ms, pages=23, reason='test'] [21:13:21] : [Step 4/5] [2021-11-19 21:13:21,126][INFO ][db-checkpoint-thread-#24450%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:13:21] : [Step 4/5] [2021-11-19 21:13:21,126][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint finished [cpId=16a2f785-acea-4494-82fc-a3d60612c78b, pages=23, markPos=WALPointer [idx=6, fileOff=1000932, len=2048], walSegmentsCovered=[], markDuration=167ms, pagesWrite=1ms, fsync=17ms, total=185ms] [21:13:21] : [Step 4/5] [2021-11-19 21:13:21,126][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00cce8f9-a2b3-4d32-a95a-7f6eb6335000, grp=1613773252] [21:13:21] : [Step 4/5] [2021-11-19 21:13:21,135][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint started [checkpointId=5398f4d6-13e4-44c5-b1db-a3892f5c47f0, startPtr=WALPointer [idx=6, fileOff=1000742, len=2010], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=5ms, writeCheckpointEntryDuration=2ms, splitAndSortCpPagesDuration=0ms, pages=23, reason='test'] [21:13:21] : [Step 4/5] [2021-11-19 21:13:21,153][INFO ][db-checkpoint-thread-#24445%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:13:21] : [Step 4/5] [2021-11-19 21:13:21,154][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint finished [cpId=5398f4d6-13e4-44c5-b1db-a3892f5c47f0, pages=23, markPos=WALPointer [idx=6, fileOff=1000742, len=2010], walSegmentsCovered=[], markDuration=8ms, pagesWrite=1ms, fsync=17ms, total=26ms] [21:13:21] : [Step 4/5] [2021-11-19 21:13:21,161][INFO ][wal-file-archiver%grid-1-#24440%grid-1%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=6, segIdx=6, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000006.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000006.wal] [21:13:21] : [Step 4/5] [2021-11-19 21:13:21,161][INFO ][wal-file-archiver%grid-0-#24437%grid-0%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=6, segIdx=6, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000006.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000006.wal] [21:13:21] : [Step 4/5] [2021-11-19 21:13:21,165][INFO ][disco-notifier-worker-#24425%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=60] [21:13:21] : [Step 4/5] [2021-11-19 21:13:21,165][INFO ][disco-notifier-worker-#24306%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=60] [21:13:21] : [Step 4/5] [2021-11-19 21:13:21,166][INFO ][reencrypt-#24466%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:13:21] : [Step 4/5] [2021-11-19 21:13:21,166][INFO ][reencrypt-#24467%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:13:21] : [Step 4/5] [2021-11-19 21:13:21,176][INFO ][wal-file-archiver%grid-1-#24440%grid-1%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000006.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000006.wal] [21:13:21] : [Step 4/5] [2021-11-19 21:13:21,176][INFO ][wal-file-archiver%grid-0-#24437%grid-0%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000006.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000006.wal] [21:13:21] : [Step 4/5] [2021-11-19 21:13:21,367][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10b6f63c-e31c-4573-a225-9f76f500c001, grp=1613773252] [21:13:21] : [Step 4/5] [2021-11-19 21:13:21,604][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint started [checkpointId=1d578834-4da9-44d8-a429-55b2ea0a3bd3, startPtr=WALPointer [idx=7, fileOff=146696, len=2048], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=175ms, writeCheckpointEntryDuration=61ms, splitAndSortCpPagesDuration=0ms, pages=24, reason='test'] [21:13:21] : [Step 4/5] [2021-11-19 21:13:21,622][INFO ][db-checkpoint-thread-#24450%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:13:21] : [Step 4/5] [2021-11-19 21:13:21,623][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint finished [cpId=1d578834-4da9-44d8-a429-55b2ea0a3bd3, pages=24, markPos=WALPointer [idx=7, fileOff=146696, len=2048], walSegmentsCovered=[6], markDuration=237ms, pagesWrite=1ms, fsync=16ms, total=255ms] [21:13:21] : [Step 4/5] [2021-11-19 21:13:21,623][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00cce8f9-a2b3-4d32-a95a-7f6eb6335000, grp=1613773252] [21:13:21] : [Step 4/5] [2021-11-19 21:13:21,631][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint started [checkpointId=825bd3e2-4d31-4ee8-9cce-630ebddd69ca, startPtr=WALPointer [idx=7, fileOff=146696, len=2010], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=6ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=0ms, pages=24, reason='test'] [21:13:21] : [Step 4/5] [2021-11-19 21:13:21,649][INFO ][db-checkpoint-thread-#24445%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:13:21] : [Step 4/5] [2021-11-19 21:13:21,649][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint finished [cpId=825bd3e2-4d31-4ee8-9cce-630ebddd69ca, pages=24, markPos=WALPointer [idx=7, fileOff=146696, len=2010], walSegmentsCovered=[6], markDuration=8ms, pagesWrite=0ms, fsync=17ms, total=26ms] [21:13:21] : [Step 4/5] [2021-11-19 21:13:21,654][INFO ][disco-notifier-worker-#24306%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=61] [21:13:21] : [Step 4/5] [2021-11-19 21:13:21,654][INFO ][disco-notifier-worker-#24425%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=61] [21:13:21] : [Step 4/5] [2021-11-19 21:13:21,654][INFO ][reencrypt-#24467%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:13:21] : [Step 4/5] [2021-11-19 21:13:21,654][INFO ][reencrypt-#24466%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:13:21] : [Step 4/5] [2021-11-19 21:13:21,855][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10b6f63c-e31c-4573-a225-9f76f500c001, grp=1613773252] [21:13:22] : [Step 4/5] [2021-11-19 21:13:22,132][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint started [checkpointId=b6672b72-bb70-42e7-a2f8-a4e0098f5ddb, startPtr=WALPointer [idx=7, fileOff=349933, len=2048], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=109ms, writeCheckpointEntryDuration=167ms, splitAndSortCpPagesDuration=0ms, pages=26, reason='test'] [21:13:22] : [Step 4/5] [2021-11-19 21:13:22,483][INFO ][db-checkpoint-thread-#24450%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:13:22] : [Step 4/5] [2021-11-19 21:13:22,483][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint finished [cpId=b6672b72-bb70-42e7-a2f8-a4e0098f5ddb, pages=26, markPos=WALPointer [idx=7, fileOff=349933, len=2048], walSegmentsCovered=[], markDuration=276ms, pagesWrite=1ms, fsync=350ms, total=627ms] [21:13:22] : [Step 4/5] [2021-11-19 21:13:22,484][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00cce8f9-a2b3-4d32-a95a-7f6eb6335000, grp=1613773252] [21:13:22] : [Step 4/5] [2021-11-19 21:13:22,492][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint started [checkpointId=b6f4294b-5be4-4255-8997-493ceba6f82a, startPtr=WALPointer [idx=7, fileOff=349895, len=2010], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=5ms, writeCheckpointEntryDuration=2ms, splitAndSortCpPagesDuration=0ms, pages=26, reason='test'] [21:13:22] : [Step 4/5] [2021-11-19 21:13:22,510][INFO ][db-checkpoint-thread-#24445%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:13:22] : [Step 4/5] [2021-11-19 21:13:22,510][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint finished [cpId=b6f4294b-5be4-4255-8997-493ceba6f82a, pages=26, markPos=WALPointer [idx=7, fileOff=349895, len=2010], walSegmentsCovered=[], markDuration=8ms, pagesWrite=0ms, fsync=17ms, total=26ms] [21:13:22] : [Step 4/5] [2021-11-19 21:13:22,516][INFO ][disco-notifier-worker-#24425%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=62] [21:13:22] : [Step 4/5] [2021-11-19 21:13:22,516][INFO ][disco-notifier-worker-#24306%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=62] [21:13:22] : [Step 4/5] [2021-11-19 21:13:22,516][INFO ][reencrypt-#24466%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:13:22] : [Step 4/5] [2021-11-19 21:13:22,516][INFO ][reencrypt-#24467%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:13:22] : [Step 4/5] [2021-11-19 21:13:22,718][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10b6f63c-e31c-4573-a225-9f76f500c001, grp=1613773252] [21:13:22] : [Step 4/5] [2021-11-19 21:13:22,935][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint started [checkpointId=b2117136-eec1-4137-ae7b-7293d3333679, startPtr=WALPointer [idx=7, fileOff=554275, len=2048], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=80ms, writeCheckpointEntryDuration=136ms, splitAndSortCpPagesDuration=0ms, pages=25, reason='test'] [21:13:23] : [Step 4/5] [2021-11-19 21:13:23,193][INFO ][db-checkpoint-thread-#24450%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:13:23] : [Step 4/5] [2021-11-19 21:13:23,194][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint finished [cpId=b2117136-eec1-4137-ae7b-7293d3333679, pages=25, markPos=WALPointer [idx=7, fileOff=554275, len=2048], walSegmentsCovered=[], markDuration=217ms, pagesWrite=1ms, fsync=257ms, total=476ms] [21:13:23] : [Step 4/5] [2021-11-19 21:13:23,194][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00cce8f9-a2b3-4d32-a95a-7f6eb6335000, grp=1613773252] [21:13:23] : [Step 4/5] [2021-11-19 21:13:23,282][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint started [checkpointId=c868cbbe-d2a0-4449-87ea-da6458f5f579, startPtr=WALPointer [idx=7, fileOff=554199, len=2010], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=63ms, writeCheckpointEntryDuration=24ms, splitAndSortCpPagesDuration=0ms, pages=25, reason='test'] [21:13:23] : [Step 4/5] [2021-11-19 21:13:23,309][INFO ][db-checkpoint-thread-#24445%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:13:23] : [Step 4/5] [2021-11-19 21:13:23,309][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint finished [cpId=c868cbbe-d2a0-4449-87ea-da6458f5f579, pages=25, markPos=WALPointer [idx=7, fileOff=554199, len=2010], walSegmentsCovered=[], markDuration=88ms, pagesWrite=1ms, fsync=25ms, total=114ms] [21:13:23] : [Step 4/5] [2021-11-19 21:13:23,315][INFO ][disco-notifier-worker-#24306%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=63] [21:13:23] : [Step 4/5] [2021-11-19 21:13:23,315][INFO ][disco-notifier-worker-#24425%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=63] [21:13:23] : [Step 4/5] [2021-11-19 21:13:23,315][INFO ][reencrypt-#24467%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:13:23] : [Step 4/5] [2021-11-19 21:13:23,315][INFO ][reencrypt-#24466%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:13:23] : [Step 4/5] [2021-11-19 21:13:23,516][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10b6f63c-e31c-4573-a225-9f76f500c001, grp=1613773252] [21:13:24] : [Step 4/5] [2021-11-19 21:13:24,120][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint started [checkpointId=592325f8-6ea4-44a8-ae14-51043f97f4e7, startPtr=WALPointer [idx=7, fileOff=761471, len=2048], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=249ms, writeCheckpointEntryDuration=354ms, splitAndSortCpPagesDuration=0ms, pages=25, reason='test'] [21:13:24] : [Step 4/5] [2021-11-19 21:13:24,148][INFO ][db-checkpoint-thread-#24450%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:13:24] : [Step 4/5] [2021-11-19 21:13:24,148][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint finished [cpId=592325f8-6ea4-44a8-ae14-51043f97f4e7, pages=25, markPos=WALPointer [idx=7, fileOff=761471, len=2048], walSegmentsCovered=[], markDuration=604ms, pagesWrite=0ms, fsync=27ms, total=631ms] [21:13:24] : [Step 4/5] [2021-11-19 21:13:24,148][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00cce8f9-a2b3-4d32-a95a-7f6eb6335000, grp=1613773252] [21:13:24] : [Step 4/5] [2021-11-19 21:13:24,157][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint started [checkpointId=0dc47914-16d0-4a08-a41a-6508bc2b179d, startPtr=WALPointer [idx=7, fileOff=761357, len=2010], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=6ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=0ms, pages=25, reason='test'] [21:13:24] : [Step 4/5] [2021-11-19 21:13:24,182][INFO ][db-checkpoint-thread-#24445%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:13:24] : [Step 4/5] [2021-11-19 21:13:24,182][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint finished [cpId=0dc47914-16d0-4a08-a41a-6508bc2b179d, pages=25, markPos=WALPointer [idx=7, fileOff=761357, len=2010], walSegmentsCovered=[], markDuration=9ms, pagesWrite=1ms, fsync=23ms, total=33ms] [21:13:24] : [Step 4/5] [2021-11-19 21:13:24,188][INFO ][disco-notifier-worker-#24306%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=64] [21:13:24] : [Step 4/5] [2021-11-19 21:13:24,188][INFO ][reencrypt-#24467%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:13:24] : [Step 4/5] [2021-11-19 21:13:24,188][INFO ][disco-notifier-worker-#24425%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=64] [21:13:24] : [Step 4/5] [2021-11-19 21:13:24,189][INFO ][reencrypt-#24466%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:13:24] : [Step 4/5] [2021-11-19 21:13:24,190][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10b6f63c-e31c-4573-a225-9f76f500c001, grp=1613773252] [21:13:24] : [Step 4/5] [2021-11-19 21:13:24,194][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint started [checkpointId=092fc4d8-ef49-43a5-9b3e-5ddbb2d3ded5, startPtr=WALPointer [idx=7, fileOff=970129, len=2048], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=2ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=0ms, pages=26, reason='test'] [21:13:24] : [Step 4/5] [2021-11-19 21:13:24,621][INFO ][db-checkpoint-thread-#24450%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:13:24] : [Step 4/5] [2021-11-19 21:13:24,621][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint finished [cpId=092fc4d8-ef49-43a5-9b3e-5ddbb2d3ded5, pages=26, markPos=WALPointer [idx=7, fileOff=970129, len=2048], walSegmentsCovered=[], markDuration=4ms, pagesWrite=1ms, fsync=425ms, total=430ms] [21:13:24] : [Step 4/5] [2021-11-19 21:13:24,621][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00cce8f9-a2b3-4d32-a95a-7f6eb6335000, grp=1613773252] [21:13:24] : [Step 4/5] [2021-11-19 21:13:24,760][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint started [checkpointId=bc419459-9e6a-44f6-9f8b-1622e12103e4, startPtr=WALPointer [idx=7, fileOff=969977, len=2010], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=0ms, writeCheckpointEntryDuration=137ms, splitAndSortCpPagesDuration=0ms, pages=26, reason='test'] [21:13:24] : [Step 4/5] [2021-11-19 21:13:24,934][INFO ][db-checkpoint-thread-#24445%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:13:24] : [Step 4/5] [2021-11-19 21:13:24,935][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint finished [cpId=bc419459-9e6a-44f6-9f8b-1622e12103e4, pages=26, markPos=WALPointer [idx=7, fileOff=969977, len=2010], walSegmentsCovered=[], markDuration=139ms, pagesWrite=1ms, fsync=173ms, total=313ms] [21:13:24] : [Step 4/5] [2021-11-19 21:13:24,943][INFO ][wal-file-archiver%grid-0-#24437%grid-0%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=7, segIdx=7, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000007.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000007.wal] [21:13:24] : [Step 4/5] [2021-11-19 21:13:24,943][INFO ][wal-file-archiver%grid-1-#24440%grid-1%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=7, segIdx=7, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000007.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000007.wal] [21:13:24] : [Step 4/5] [2021-11-19 21:13:24,946][INFO ][disco-notifier-worker-#24306%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=65] [21:13:24] : [Step 4/5] [2021-11-19 21:13:24,946][INFO ][disco-notifier-worker-#24425%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=65] [21:13:24] : [Step 4/5] [2021-11-19 21:13:24,946][INFO ][reencrypt-#24467%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:13:24] : [Step 4/5] [2021-11-19 21:13:24,946][INFO ][reencrypt-#24466%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:13:24] : [Step 4/5] [2021-11-19 21:13:24,959][INFO ][wal-file-archiver%grid-1-#24440%grid-1%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000007.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000007.wal] [21:13:24] : [Step 4/5] [2021-11-19 21:13:24,959][INFO ][wal-file-archiver%grid-0-#24437%grid-0%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000007.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000007.wal] [21:13:25] : [Step 4/5] [2021-11-19 21:13:25,148][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10b6f63c-e31c-4573-a225-9f76f500c001, grp=1613773252] [21:13:25] : [Step 4/5] [2021-11-19 21:13:25,229][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint started [checkpointId=f3a90200-49ca-4cd6-8df1-94f0e74fe6e4, startPtr=WALPointer [idx=8, fileOff=132290, len=2048], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=1ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=15ms, writeCheckpointEntryDuration=64ms, splitAndSortCpPagesDuration=1ms, pages=26, reason='test'] [21:13:25] : [Step 4/5] [2021-11-19 21:13:25,748][INFO ][db-checkpoint-thread-#24450%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:13:25] : [Step 4/5] [2021-11-19 21:13:25,748][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint finished [cpId=f3a90200-49ca-4cd6-8df1-94f0e74fe6e4, pages=26, markPos=WALPointer [idx=8, fileOff=132290, len=2048], walSegmentsCovered=[7], markDuration=81ms, pagesWrite=1ms, fsync=518ms, total=600ms] [21:13:25] : [Step 4/5] [2021-11-19 21:13:25,748][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00cce8f9-a2b3-4d32-a95a-7f6eb6335000, grp=1613773252] [21:13:25] : [Step 4/5] [2021-11-19 21:13:25,758][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint started [checkpointId=bdb71449-1fcf-4e6b-b7d5-0516ff700cff, startPtr=WALPointer [idx=8, fileOff=132290, len=2010], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=6ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=0ms, pages=26, reason='test'] [21:13:25] : [Step 4/5] [2021-11-19 21:13:25,770][INFO ][db-checkpoint-thread-#24445%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:13:25] : [Step 4/5] [2021-11-19 21:13:25,770][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint finished [cpId=bdb71449-1fcf-4e6b-b7d5-0516ff700cff, pages=26, markPos=WALPointer [idx=8, fileOff=132290, len=2010], walSegmentsCovered=[7], markDuration=9ms, pagesWrite=1ms, fsync=11ms, total=21ms] [21:13:25] : [Step 4/5] [2021-11-19 21:13:25,775][INFO ][disco-notifier-worker-#24306%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=66] [21:13:25] : [Step 4/5] [2021-11-19 21:13:25,776][INFO ][disco-notifier-worker-#24425%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=66] [21:13:25] : [Step 4/5] [2021-11-19 21:13:25,776][INFO ][reencrypt-#24467%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:13:25] : [Step 4/5] [2021-11-19 21:13:25,776][INFO ][reencrypt-#24466%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:13:25] : [Step 4/5] [2021-11-19 21:13:25,977][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10b6f63c-e31c-4573-a225-9f76f500c001, grp=1613773252] [21:13:26] : [Step 4/5] [2021-11-19 21:13:26,240][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint started [checkpointId=31431913-b23c-40d8-9442-1d19dbd1fa0e, startPtr=WALPointer [idx=8, fileOff=343376, len=2048], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=99ms, writeCheckpointEntryDuration=162ms, splitAndSortCpPagesDuration=0ms, pages=24, reason='test'] [21:13:26] : [Step 4/5] [2021-11-19 21:13:26,406][INFO ][db-checkpoint-thread-#24450%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:13:26] : [Step 4/5] [2021-11-19 21:13:26,406][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint finished [cpId=31431913-b23c-40d8-9442-1d19dbd1fa0e, pages=24, markPos=WALPointer [idx=8, fileOff=343376, len=2048], walSegmentsCovered=[], markDuration=262ms, pagesWrite=1ms, fsync=165ms, total=429ms] [21:13:26] : [Step 4/5] [2021-11-19 21:13:26,407][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00cce8f9-a2b3-4d32-a95a-7f6eb6335000, grp=1613773252] [21:13:26] : [Step 4/5] [2021-11-19 21:13:26,578][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint started [checkpointId=7ddda1b1-b683-4775-8eee-1d6afe79eef7, startPtr=WALPointer [idx=8, fileOff=343338, len=2010], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=39ms, writeCheckpointEntryDuration=131ms, splitAndSortCpPagesDuration=0ms, pages=24, reason='test'] [21:13:26] : [Step 4/5] [2021-11-19 21:13:26,589][INFO ][db-checkpoint-thread-#24445%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:13:26] : [Step 4/5] [2021-11-19 21:13:26,589][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint finished [cpId=7ddda1b1-b683-4775-8eee-1d6afe79eef7, pages=24, markPos=WALPointer [idx=8, fileOff=343338, len=2010], walSegmentsCovered=[], markDuration=171ms, pagesWrite=1ms, fsync=9ms, total=182ms] [21:13:26] : [Step 4/5] [2021-11-19 21:13:26,595][INFO ][disco-notifier-worker-#24306%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=67] [21:13:26] : [Step 4/5] [2021-11-19 21:13:26,595][INFO ][disco-notifier-worker-#24425%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=67] [21:13:26] : [Step 4/5] [2021-11-19 21:13:26,595][INFO ][reencrypt-#24467%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:13:26] : [Step 4/5] [2021-11-19 21:13:26,596][INFO ][reencrypt-#24466%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:13:26] : [Step 4/5] [2021-11-19 21:13:26,803][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10b6f63c-e31c-4573-a225-9f76f500c001, grp=1613773252] [21:13:26] : [Step 4/5] [2021-11-19 21:13:26,886][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint started [checkpointId=e130a121-338c-4ee4-a097-325a280f5690, startPtr=WALPointer [idx=8, fileOff=549931, len=2048], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=0ms, writeCheckpointEntryDuration=81ms, splitAndSortCpPagesDuration=0ms, pages=24, reason='test'] [21:13:27] : [Step 4/5] [2021-11-19 21:13:27,319][INFO ][db-checkpoint-thread-#24450%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:13:27] : [Step 4/5] [2021-11-19 21:13:27,320][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint finished [cpId=e130a121-338c-4ee4-a097-325a280f5690, pages=24, markPos=WALPointer [idx=8, fileOff=549931, len=2048], walSegmentsCovered=[], markDuration=83ms, pagesWrite=1ms, fsync=432ms, total=516ms] [21:13:27] : [Step 4/5] [2021-11-19 21:13:27,320][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00cce8f9-a2b3-4d32-a95a-7f6eb6335000, grp=1613773252] [21:13:27] : [Step 4/5] [2021-11-19 21:13:27,356][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint started [checkpointId=0b9a4e7e-4b4c-4aa8-a96a-66bd45f63ee8, startPtr=WALPointer [idx=8, fileOff=549855, len=2010], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=26ms, writeCheckpointEntryDuration=9ms, splitAndSortCpPagesDuration=0ms, pages=24, reason='test'] [21:13:27] : [Step 4/5] [2021-11-19 21:13:27,383][INFO ][db-checkpoint-thread-#24445%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:13:27] : [Step 4/5] [2021-11-19 21:13:27,384][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint finished [cpId=0b9a4e7e-4b4c-4aa8-a96a-66bd45f63ee8, pages=24, markPos=WALPointer [idx=8, fileOff=549855, len=2010], walSegmentsCovered=[], markDuration=36ms, pagesWrite=1ms, fsync=26ms, total=63ms] [21:13:27] : [Step 4/5] [2021-11-19 21:13:27,391][INFO ][disco-notifier-worker-#24306%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=68] [21:13:27] : [Step 4/5] [2021-11-19 21:13:27,391][INFO ][disco-notifier-worker-#24425%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=68] [21:13:27] : [Step 4/5] [2021-11-19 21:13:27,391][INFO ][reencrypt-#24467%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:13:27] : [Step 4/5] [2021-11-19 21:13:27,391][INFO ][reencrypt-#24466%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:13:27] : [Step 4/5] [2021-11-19 21:13:27,592][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10b6f63c-e31c-4573-a225-9f76f500c001, grp=1613773252] [21:13:27] : [Step 4/5] [2021-11-19 21:13:27,725][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint started [checkpointId=67c66ed9-94dd-4ef8-a991-5ee9c9f98ef0, startPtr=WALPointer [idx=8, fileOff=764446, len=2048], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=25ms, writeCheckpointEntryDuration=107ms, splitAndSortCpPagesDuration=0ms, pages=26, reason='test'] [21:13:28] : [Step 4/5] [2021-11-19 21:13:28,150][INFO ][db-checkpoint-thread-#24450%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:13:28] : [Step 4/5] [2021-11-19 21:13:28,150][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint finished [cpId=67c66ed9-94dd-4ef8-a991-5ee9c9f98ef0, pages=26, markPos=WALPointer [idx=8, fileOff=764446, len=2048], walSegmentsCovered=[], markDuration=132ms, pagesWrite=1ms, fsync=424ms, total=557ms] [21:13:28] : [Step 4/5] [2021-11-19 21:13:28,150][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00cce8f9-a2b3-4d32-a95a-7f6eb6335000, grp=1613773252] [21:13:28] : [Step 4/5] [2021-11-19 21:13:28,168][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint started [checkpointId=9fea9c1d-ab71-4322-b557-c6a73328e57d, startPtr=WALPointer [idx=8, fileOff=764332, len=2010], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=7ms, writeCheckpointEntryDuration=9ms, splitAndSortCpPagesDuration=0ms, pages=26, reason='test'] [21:13:28] : [Step 4/5] [2021-11-19 21:13:28,186][INFO ][db-checkpoint-thread-#24445%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:13:28] : [Step 4/5] [2021-11-19 21:13:28,187][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint finished [cpId=9fea9c1d-ab71-4322-b557-c6a73328e57d, pages=26, markPos=WALPointer [idx=8, fileOff=764332, len=2010], walSegmentsCovered=[], markDuration=18ms, pagesWrite=1ms, fsync=17ms, total=36ms] [21:13:28] : [Step 4/5] [2021-11-19 21:13:28,194][INFO ][disco-notifier-worker-#24306%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=69] [21:13:28] : [Step 4/5] [2021-11-19 21:13:28,194][INFO ][disco-notifier-worker-#24425%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=69] [21:13:28] : [Step 4/5] [2021-11-19 21:13:28,194][INFO ][reencrypt-#24467%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:13:28] : [Step 4/5] [2021-11-19 21:13:28,195][INFO ][reencrypt-#24466%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:13:28] : [Step 4/5] [2021-11-19 21:13:28,396][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10b6f63c-e31c-4573-a225-9f76f500c001, grp=1613773252] [21:13:28] : [Step 4/5] [2021-11-19 21:13:28,399][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint started [checkpointId=3bd28208-86f5-41d9-8beb-fd3a62ccfe45, startPtr=WALPointer [idx=8, fileOff=980733, len=2048], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=1ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=0ms, pages=25, reason='test'] [21:13:28] : [Step 4/5] [2021-11-19 21:13:28,417][INFO ][db-checkpoint-thread-#24450%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:13:28] : [Step 4/5] [2021-11-19 21:13:28,418][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint finished [cpId=3bd28208-86f5-41d9-8beb-fd3a62ccfe45, pages=25, markPos=WALPointer [idx=8, fileOff=980733, len=2048], walSegmentsCovered=[], markDuration=3ms, pagesWrite=1ms, fsync=16ms, total=21ms] [21:13:28] : [Step 4/5] [2021-11-19 21:13:28,418][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00cce8f9-a2b3-4d32-a95a-7f6eb6335000, grp=1613773252] [21:13:28] : [Step 4/5] [2021-11-19 21:13:28,426][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint started [checkpointId=414228f0-e9aa-4d94-bf8d-69818588a3a2, startPtr=WALPointer [idx=8, fileOff=980581, len=2010], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=4ms, writeCheckpointEntryDuration=2ms, splitAndSortCpPagesDuration=0ms, pages=25, reason='test'] [21:13:28] : [Step 4/5] [2021-11-19 21:13:28,444][INFO ][db-checkpoint-thread-#24445%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:13:28] : [Step 4/5] [2021-11-19 21:13:28,445][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint finished [cpId=414228f0-e9aa-4d94-bf8d-69818588a3a2, pages=25, markPos=WALPointer [idx=8, fileOff=980581, len=2010], walSegmentsCovered=[], markDuration=8ms, pagesWrite=0ms, fsync=18ms, total=26ms] [21:13:28] : [Step 4/5] [2021-11-19 21:13:28,452][INFO ][wal-file-archiver%grid-0-#24437%grid-0%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=8, segIdx=8, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000008.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000008.wal] [21:13:28] : [Step 4/5] [2021-11-19 21:13:28,452][INFO ][wal-file-archiver%grid-1-#24440%grid-1%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=8, segIdx=8, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000008.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000008.wal] [21:13:28] : [Step 4/5] [2021-11-19 21:13:28,457][INFO ][disco-notifier-worker-#24306%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=70] [21:13:28] : [Step 4/5] [2021-11-19 21:13:28,457][INFO ][disco-notifier-worker-#24425%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=70] [21:13:28] : [Step 4/5] [2021-11-19 21:13:28,458][INFO ][reencrypt-#24467%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:13:28] : [Step 4/5] [2021-11-19 21:13:28,458][INFO ][reencrypt-#24466%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:13:28] : [Step 4/5] [2021-11-19 21:13:28,469][INFO ][wal-file-archiver%grid-1-#24440%grid-1%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000008.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000008.wal] [21:13:28] : [Step 4/5] [2021-11-19 21:13:28,469][INFO ][wal-file-archiver%grid-0-#24437%grid-0%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000008.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000008.wal] [21:13:28] : [Step 4/5] [2021-11-19 21:13:28,659][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10b6f63c-e31c-4573-a225-9f76f500c001, grp=1613773252] [21:13:28] : [Step 4/5] [2021-11-19 21:13:28,663][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint started [checkpointId=e3b77287-4e8b-4d90-bc5e-cec75351a097, startPtr=WALPointer [idx=9, fileOff=146805, len=2048], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=1ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=0ms, pages=25, reason='test'] [21:13:28] : [Step 4/5] [2021-11-19 21:13:28,681][INFO ][db-checkpoint-thread-#24450%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:13:28] : [Step 4/5] [2021-11-19 21:13:28,682][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint finished [cpId=e3b77287-4e8b-4d90-bc5e-cec75351a097, pages=25, markPos=WALPointer [idx=9, fileOff=146805, len=2048], walSegmentsCovered=[8], markDuration=4ms, pagesWrite=1ms, fsync=17ms, total=22ms] [21:13:28] : [Step 4/5] [2021-11-19 21:13:28,682][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00cce8f9-a2b3-4d32-a95a-7f6eb6335000, grp=1613773252] [21:13:28] : [Step 4/5] [2021-11-19 21:13:28,691][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint started [checkpointId=ec64339e-4e54-410a-accc-b32038f8b5b1, startPtr=WALPointer [idx=9, fileOff=146805, len=2010], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=5ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=0ms, pages=25, reason='test'] [21:13:28] : [Step 4/5] [2021-11-19 21:13:28,708][INFO ][db-checkpoint-thread-#24445%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:13:28] : [Step 4/5] [2021-11-19 21:13:28,709][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint finished [cpId=ec64339e-4e54-410a-accc-b32038f8b5b1, pages=25, markPos=WALPointer [idx=9, fileOff=146805, len=2010], walSegmentsCovered=[8], markDuration=7ms, pagesWrite=1ms, fsync=16ms, total=25ms] [21:13:28] : [Step 4/5] [2021-11-19 21:13:28,719][INFO ][disco-notifier-worker-#24306%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=71] [21:13:28] : [Step 4/5] [2021-11-19 21:13:28,719][INFO ][reencrypt-#24467%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:13:28] : [Step 4/5] [2021-11-19 21:13:28,720][INFO ][disco-notifier-worker-#24425%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=71] [21:13:28] : [Step 4/5] [2021-11-19 21:13:28,720][INFO ][reencrypt-#24466%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:13:28] : [Step 4/5] [2021-11-19 21:13:28,922][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10b6f63c-e31c-4573-a225-9f76f500c001, grp=1613773252] [21:13:28] : [Step 4/5] [2021-11-19 21:13:28,924][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint started [checkpointId=26ec86b5-b6cd-4e8e-af7d-c84621a80ab0, startPtr=WALPointer [idx=9, fileOff=366042, len=2048], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=0ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=0ms, pages=26, reason='test'] [21:13:28] : [Step 4/5] [2021-11-19 21:13:28,942][INFO ][db-checkpoint-thread-#24450%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:13:28] : [Step 4/5] [2021-11-19 21:13:28,943][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint finished [cpId=26ec86b5-b6cd-4e8e-af7d-c84621a80ab0, pages=26, markPos=WALPointer [idx=9, fileOff=366042, len=2048], walSegmentsCovered=[], markDuration=3ms, pagesWrite=0ms, fsync=18ms, total=21ms] [21:13:28] : [Step 4/5] [2021-11-19 21:13:28,943][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00cce8f9-a2b3-4d32-a95a-7f6eb6335000, grp=1613773252] [21:13:28] : [Step 4/5] [2021-11-19 21:13:28,951][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint started [checkpointId=1ec7b1d7-1bfc-4e76-b361-fc3a565c2f38, startPtr=WALPointer [idx=9, fileOff=366004, len=2010], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=6ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=0ms, pages=26, reason='test'] [21:13:28] : [Step 4/5] [2021-11-19 21:13:28,969][INFO ][db-checkpoint-thread-#24445%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:13:28] : [Step 4/5] [2021-11-19 21:13:28,969][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint finished [cpId=1ec7b1d7-1bfc-4e76-b361-fc3a565c2f38, pages=26, markPos=WALPointer [idx=9, fileOff=366004, len=2010], walSegmentsCovered=[], markDuration=8ms, pagesWrite=1ms, fsync=16ms, total=26ms] [21:13:28] : [Step 4/5] [2021-11-19 21:13:28,976][INFO ][disco-notifier-worker-#24306%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=72] [21:13:28] : [Step 4/5] [2021-11-19 21:13:28,976][INFO ][reencrypt-#24467%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:13:28] : [Step 4/5] [2021-11-19 21:13:28,977][INFO ][disco-notifier-worker-#24425%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=72] [21:13:28] : [Step 4/5] [2021-11-19 21:13:28,977][INFO ][reencrypt-#24466%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:13:28] : [Step 4/5] [2021-11-19 21:13:28,980][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10b6f63c-e31c-4573-a225-9f76f500c001, grp=1613773252] [21:13:28] : [Step 4/5] [2021-11-19 21:13:28,984][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint started [checkpointId=0368b0d6-64d4-42a6-9446-186e22b1b14b, startPtr=WALPointer [idx=9, fileOff=599069, len=2048], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=1ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=1ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=0ms, pages=28, reason='test'] [21:13:29] : [Step 4/5] [2021-11-19 21:13:29,002][INFO ][db-checkpoint-thread-#24450%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:13:29] : [Step 4/5] [2021-11-19 21:13:29,003][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint finished [cpId=0368b0d6-64d4-42a6-9446-186e22b1b14b, pages=28, markPos=WALPointer [idx=9, fileOff=599069, len=2048], walSegmentsCovered=[], markDuration=4ms, pagesWrite=1ms, fsync=16ms, total=21ms] [21:13:29] : [Step 4/5] [2021-11-19 21:13:29,003][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00cce8f9-a2b3-4d32-a95a-7f6eb6335000, grp=1613773252] [21:13:29] : [Step 4/5] [2021-11-19 21:13:29,012][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint started [checkpointId=00a33bb6-2eb7-49e1-bad8-d7baca8a977b, startPtr=WALPointer [idx=9, fileOff=598993, len=2010], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=7ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=0ms, pages=28, reason='test'] [21:13:29] : [Step 4/5] [2021-11-19 21:13:29,030][INFO ][db-checkpoint-thread-#24445%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:13:29] : [Step 4/5] [2021-11-19 21:13:29,030][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint finished [cpId=00a33bb6-2eb7-49e1-bad8-d7baca8a977b, pages=28, markPos=WALPointer [idx=9, fileOff=598993, len=2010], walSegmentsCovered=[], markDuration=9ms, pagesWrite=1ms, fsync=16ms, total=27ms] [21:13:29] : [Step 4/5] [2021-11-19 21:13:29,038][INFO ][disco-notifier-worker-#24306%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=73] [21:13:29] : [Step 4/5] [2021-11-19 21:13:29,039][INFO ][disco-notifier-worker-#24425%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=73] [21:13:29] : [Step 4/5] [2021-11-19 21:13:29,039][INFO ][reencrypt-#24467%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:13:29] : [Step 4/5] [2021-11-19 21:13:29,039][INFO ][reencrypt-#24466%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:13:29] : [Step 4/5] [2021-11-19 21:13:29,240][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10b6f63c-e31c-4573-a225-9f76f500c001, grp=1613773252] [21:13:29] : [Step 4/5] [2021-11-19 21:13:29,245][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint started [checkpointId=7ea57739-18a1-4830-a7f4-bbe28df542e5, startPtr=WALPointer [idx=9, fileOff=834686, len=2048], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=1ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=0ms, pages=28, reason='test'] [21:13:29] : [Step 4/5] [2021-11-19 21:13:29,263][INFO ][db-checkpoint-thread-#24450%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:13:29] : [Step 4/5] [2021-11-19 21:13:29,263][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint finished [cpId=7ea57739-18a1-4830-a7f4-bbe28df542e5, pages=28, markPos=WALPointer [idx=9, fileOff=834686, len=2048], walSegmentsCovered=[], markDuration=4ms, pagesWrite=1ms, fsync=17ms, total=22ms] [21:13:29] : [Step 4/5] [2021-11-19 21:13:29,263][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00cce8f9-a2b3-4d32-a95a-7f6eb6335000, grp=1613773252] [21:13:29] : [Step 4/5] [2021-11-19 21:13:29,273][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint started [checkpointId=67700837-077c-46a8-bd6f-b94370fcac4a, startPtr=WALPointer [idx=9, fileOff=834572, len=2010], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=6ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=1ms, pages=28, reason='test'] [21:13:29] : [Step 4/5] [2021-11-19 21:13:29,292][INFO ][db-checkpoint-thread-#24445%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:13:29] : [Step 4/5] [2021-11-19 21:13:29,292][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint finished [cpId=67700837-077c-46a8-bd6f-b94370fcac4a, pages=28, markPos=WALPointer [idx=9, fileOff=834572, len=2010], walSegmentsCovered=[], markDuration=9ms, pagesWrite=1ms, fsync=18ms, total=28ms] [21:13:29] : [Step 4/5] [2021-11-19 21:13:29,298][INFO ][disco-notifier-worker-#24306%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=74] [21:13:29] : [Step 4/5] [2021-11-19 21:13:29,298][INFO ][disco-notifier-worker-#24425%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=74] [21:13:29] : [Step 4/5] [2021-11-19 21:13:29,298][INFO ][reencrypt-#24467%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:13:29] : [Step 4/5] [2021-11-19 21:13:29,298][INFO ][reencrypt-#24466%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:13:29] : [Step 4/5] [2021-11-19 21:13:29,302][INFO ][wal-file-archiver%grid-0-#24437%grid-0%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=9, segIdx=9, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000009.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000009.wal] [21:13:29] : [Step 4/5] [2021-11-19 21:13:29,302][INFO ][wal-file-archiver%grid-1-#24440%grid-1%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=9, segIdx=9, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000009.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000009.wal] [21:13:29] : [Step 4/5] [2021-11-19 21:13:29,340][INFO ][wal-file-archiver%grid-0-#24437%grid-0%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000009.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000009.wal] [21:13:29] : [Step 4/5] [2021-11-19 21:13:29,340][INFO ][wal-file-archiver%grid-1-#24440%grid-1%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000009.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000009.wal] [21:13:29] : [Step 4/5] [2021-11-19 21:13:29,499][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10b6f63c-e31c-4573-a225-9f76f500c001, grp=1613773252] [21:13:29] : [Step 4/5] [2021-11-19 21:13:29,503][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint started [checkpointId=28fd9dae-1109-496f-93cf-0ef1ec473da6, startPtr=WALPointer [idx=10, fileOff=16855, len=2048], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=1ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=0ms, pages=27, reason='test'] [21:13:29] : [Step 4/5] [2021-11-19 21:13:29,521][INFO ][db-checkpoint-thread-#24450%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:13:29] : [Step 4/5] [2021-11-19 21:13:29,522][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint finished [cpId=28fd9dae-1109-496f-93cf-0ef1ec473da6, pages=27, markPos=WALPointer [idx=10, fileOff=16855, len=2048], walSegmentsCovered=[9], markDuration=3ms, pagesWrite=1ms, fsync=17ms, total=21ms] [21:13:29] : [Step 4/5] [2021-11-19 21:13:29,522][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00cce8f9-a2b3-4d32-a95a-7f6eb6335000, grp=1613773252] [21:13:29] : [Step 4/5] [2021-11-19 21:13:29,531][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint started [checkpointId=12e2d154-3f4f-4878-8265-5e8dbbe7557b, startPtr=WALPointer [idx=10, fileOff=16855, len=2010], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=6ms, writeCheckpointEntryDuration=2ms, splitAndSortCpPagesDuration=0ms, pages=27, reason='test'] [21:13:29] : [Step 4/5] [2021-11-19 21:13:29,549][INFO ][db-checkpoint-thread-#24445%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:13:29] : [Step 4/5] [2021-11-19 21:13:29,550][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint finished [cpId=12e2d154-3f4f-4878-8265-5e8dbbe7557b, pages=27, markPos=WALPointer [idx=10, fileOff=16855, len=2010], walSegmentsCovered=[9], markDuration=9ms, pagesWrite=0ms, fsync=18ms, total=27ms] [21:13:29] : [Step 4/5] [2021-11-19 21:13:29,556][INFO ][disco-notifier-worker-#24425%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=75] [21:13:29] : [Step 4/5] [2021-11-19 21:13:29,556][INFO ][reencrypt-#24466%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:13:29] : [Step 4/5] [2021-11-19 21:13:29,557][INFO ][disco-notifier-worker-#24306%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=75] [21:13:29] : [Step 4/5] [2021-11-19 21:13:29,557][INFO ][reencrypt-#24467%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:13:29] : [Step 4/5] [2021-11-19 21:13:29,758][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10b6f63c-e31c-4573-a225-9f76f500c001, grp=1613773252] [21:13:29] : [Step 4/5] [2021-11-19 21:13:29,762][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint started [checkpointId=3490bd25-ff2a-4ea4-bf7a-786c98bdc6bd, startPtr=WALPointer [idx=10, fileOff=247477, len=2048], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=1ms, writeCheckpointEntryDuration=2ms, splitAndSortCpPagesDuration=0ms, pages=26, reason='test'] [21:13:29] : [Step 4/5] [2021-11-19 21:13:29,780][INFO ][db-checkpoint-thread-#24450%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:13:29] : [Step 4/5] [2021-11-19 21:13:29,781][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint finished [cpId=3490bd25-ff2a-4ea4-bf7a-786c98bdc6bd, pages=26, markPos=WALPointer [idx=10, fileOff=247477, len=2048], walSegmentsCovered=[], markDuration=4ms, pagesWrite=1ms, fsync=16ms, total=22ms] [21:13:29] : [Step 4/5] [2021-11-19 21:13:29,781][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00cce8f9-a2b3-4d32-a95a-7f6eb6335000, grp=1613773252] [21:13:29] : [Step 4/5] [2021-11-19 21:13:29,790][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint started [checkpointId=655b35cc-98ff-4eca-809c-308aaa1f8a5f, startPtr=WALPointer [idx=10, fileOff=247439, len=2010], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=7ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=0ms, pages=26, reason='test'] [21:13:29] : [Step 4/5] [2021-11-19 21:13:29,808][INFO ][db-checkpoint-thread-#24445%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:13:29] : [Step 4/5] [2021-11-19 21:13:29,808][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint finished [cpId=655b35cc-98ff-4eca-809c-308aaa1f8a5f, pages=26, markPos=WALPointer [idx=10, fileOff=247439, len=2010], walSegmentsCovered=[], markDuration=9ms, pagesWrite=1ms, fsync=16ms, total=27ms] [21:13:29] : [Step 4/5] [2021-11-19 21:13:29,815][INFO ][disco-notifier-worker-#24306%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=76] [21:13:29] : [Step 4/5] [2021-11-19 21:13:29,815][INFO ][reencrypt-#24467%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:13:29] : [Step 4/5] [2021-11-19 21:13:29,816][INFO ][disco-notifier-worker-#24425%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=76] [21:13:29] : [Step 4/5] [2021-11-19 21:13:29,817][INFO ][reencrypt-#24466%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:13:30] : [Step 4/5] [2021-11-19 21:13:30,018][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10b6f63c-e31c-4573-a225-9f76f500c001, grp=1613773252] [21:13:30] : [Step 4/5] [2021-11-19 21:13:30,022][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint started [checkpointId=a4fe83a1-5166-4ae3-962c-c4a3b25aeb9f, startPtr=WALPointer [idx=10, fileOff=479109, len=2048], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=1ms, writeCheckpointEntryDuration=2ms, splitAndSortCpPagesDuration=0ms, pages=27, reason='test'] [21:13:30] : [Step 4/5] [2021-11-19 21:13:30,040][INFO ][db-checkpoint-thread-#24450%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:13:30] : [Step 4/5] [2021-11-19 21:13:30,040][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint finished [cpId=a4fe83a1-5166-4ae3-962c-c4a3b25aeb9f, pages=27, markPos=WALPointer [idx=10, fileOff=479109, len=2048], walSegmentsCovered=[], markDuration=4ms, pagesWrite=1ms, fsync=16ms, total=22ms] [21:13:30] : [Step 4/5] [2021-11-19 21:13:30,040][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00cce8f9-a2b3-4d32-a95a-7f6eb6335000, grp=1613773252] [21:13:30] : [Step 4/5] [2021-11-19 21:13:30,049][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint started [checkpointId=bf324142-fe11-46ee-94fe-c011f5c90b61, startPtr=WALPointer [idx=10, fileOff=479033, len=2010], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=6ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=0ms, pages=27, reason='test'] [21:13:30] : [Step 4/5] [2021-11-19 21:13:30,075][INFO ][db-checkpoint-thread-#24445%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:13:30] : [Step 4/5] [2021-11-19 21:13:30,075][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint finished [cpId=bf324142-fe11-46ee-94fe-c011f5c90b61, pages=27, markPos=WALPointer [idx=10, fileOff=479033, len=2010], walSegmentsCovered=[], markDuration=8ms, pagesWrite=1ms, fsync=24ms, total=34ms] [21:13:30] : [Step 4/5] [2021-11-19 21:13:30,081][INFO ][disco-notifier-worker-#24306%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=77] [21:13:30] : [Step 4/5] [2021-11-19 21:13:30,082][INFO ][disco-notifier-worker-#24425%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=77] [21:13:30] : [Step 4/5] [2021-11-19 21:13:30,082][INFO ][reencrypt-#24467%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:13:30] : [Step 4/5] [2021-11-19 21:13:30,082][INFO ][reencrypt-#24466%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:13:30] : [Step 4/5] [2021-11-19 21:13:30,283][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10b6f63c-e31c-4573-a225-9f76f500c001, grp=1613773252] [21:13:30] : [Step 4/5] [2021-11-19 21:13:30,289][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint started [checkpointId=e59e3a57-d5ca-4c82-bc6a-2efc39cb3d7c, startPtr=WALPointer [idx=10, fileOff=712529, len=2048], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=3ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=0ms, pages=27, reason='test'] [21:13:30] : [Step 4/5] [2021-11-19 21:13:30,307][INFO ][db-checkpoint-thread-#24450%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:13:30] : [Step 4/5] [2021-11-19 21:13:30,307][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint finished [cpId=e59e3a57-d5ca-4c82-bc6a-2efc39cb3d7c, pages=27, markPos=WALPointer [idx=10, fileOff=712529, len=2048], walSegmentsCovered=[], markDuration=5ms, pagesWrite=1ms, fsync=17ms, total=23ms] [21:13:30] : [Step 4/5] [2021-11-19 21:13:30,307][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00cce8f9-a2b3-4d32-a95a-7f6eb6335000, grp=1613773252] [21:13:30] : [Step 4/5] [2021-11-19 21:13:30,316][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint started [checkpointId=b1450720-2780-4fff-9a2e-9057fe27e854, startPtr=WALPointer [idx=10, fileOff=712415, len=2010], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=6ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=0ms, pages=27, reason='test'] [21:13:30] : [Step 4/5] [2021-11-19 21:13:30,334][INFO ][db-checkpoint-thread-#24445%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:13:30] : [Step 4/5] [2021-11-19 21:13:30,334][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint finished [cpId=b1450720-2780-4fff-9a2e-9057fe27e854, pages=27, markPos=WALPointer [idx=10, fileOff=712415, len=2010], walSegmentsCovered=[], markDuration=9ms, pagesWrite=1ms, fsync=16ms, total=26ms] [21:13:30] : [Step 4/5] [2021-11-19 21:13:30,341][INFO ][disco-notifier-worker-#24306%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=78] [21:13:30] : [Step 4/5] [2021-11-19 21:13:30,341][INFO ][disco-notifier-worker-#24425%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=78] [21:13:30] : [Step 4/5] [2021-11-19 21:13:30,341][INFO ][reencrypt-#24467%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:13:30] : [Step 4/5] [2021-11-19 21:13:30,341][INFO ][reencrypt-#24466%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:13:30] : [Step 4/5] [2021-11-19 21:13:30,543][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10b6f63c-e31c-4573-a225-9f76f500c001, grp=1613773252] [21:13:30] : [Step 4/5] [2021-11-19 21:13:30,546][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint started [checkpointId=5b52ff58-5a45-416d-b8f7-12c19d6e1880, startPtr=WALPointer [idx=10, fileOff=947523, len=2048], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=1ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=1ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=0ms, pages=27, reason='test'] [21:13:30] : [Step 4/5] [2021-11-19 21:13:30,564][INFO ][db-checkpoint-thread-#24450%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:13:30] : [Step 4/5] [2021-11-19 21:13:30,565][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint finished [cpId=5b52ff58-5a45-416d-b8f7-12c19d6e1880, pages=27, markPos=WALPointer [idx=10, fileOff=947523, len=2048], walSegmentsCovered=[], markDuration=4ms, pagesWrite=1ms, fsync=17ms, total=22ms] [21:13:30] : [Step 4/5] [2021-11-19 21:13:30,565][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00cce8f9-a2b3-4d32-a95a-7f6eb6335000, grp=1613773252] [21:13:30] : [Step 4/5] [2021-11-19 21:13:30,573][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint started [checkpointId=de637574-f854-42aa-9461-16a03dfe075c, startPtr=WALPointer [idx=10, fileOff=947371, len=2010], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=6ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=0ms, pages=27, reason='test'] [21:13:30] : [Step 4/5] [2021-11-19 21:13:30,591][INFO ][db-checkpoint-thread-#24445%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:13:30] : [Step 4/5] [2021-11-19 21:13:30,592][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint finished [cpId=de637574-f854-42aa-9461-16a03dfe075c, pages=27, markPos=WALPointer [idx=10, fileOff=947371, len=2010], walSegmentsCovered=[], markDuration=8ms, pagesWrite=1ms, fsync=17ms, total=26ms] [21:13:30] : [Step 4/5] [2021-11-19 21:13:30,600][INFO ][wal-file-archiver%grid-1-#24440%grid-1%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=10, segIdx=0, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000000.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000010.wal] [21:13:30] : [Step 4/5] [2021-11-19 21:13:30,600][INFO ][wal-file-archiver%grid-0-#24437%grid-0%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=10, segIdx=0, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000000.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000010.wal] [21:13:30] : [Step 4/5] [2021-11-19 21:13:30,601][INFO ][wal-file-cleaner%grid-1-#24441%grid-1%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=1, currSize=10.0 MB, maxSize=20.0 MB] [21:13:30] : [Step 4/5] [2021-11-19 21:13:30,602][INFO ][wal-file-cleaner%grid-0-#24438%grid-0%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=1, currSize=10.0 MB, maxSize=20.0 MB] [21:13:30] : [Step 4/5] [2021-11-19 21:13:30,605][INFO ][disco-notifier-worker-#24306%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=79] [21:13:30] : [Step 4/5] [2021-11-19 21:13:30,605][INFO ][reencrypt-#24467%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:13:30] : [Step 4/5] [2021-11-19 21:13:30,606][INFO ][disco-notifier-worker-#24425%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=79] [21:13:30] : [Step 4/5] [2021-11-19 21:13:30,606][INFO ][reencrypt-#24466%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:13:30] : [Step 4/5] [2021-11-19 21:13:30,606][INFO ][wal-file-cleaner%grid-0-#24438%grid-0%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:13:30] : [Step 4/5] [2021-11-19 21:13:30,606][INFO ][wal-file-cleaner%grid-1-#24441%grid-1%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:13:30] : [Step 4/5] [2021-11-19 21:13:30,608][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10b6f63c-e31c-4573-a225-9f76f500c001, grp=1613773252] [21:13:30] : [Step 4/5] [2021-11-19 21:13:30,617][INFO ][wal-file-archiver%grid-0-#24437%grid-0%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000000.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000010.wal] [21:13:30] : [Step 4/5] [2021-11-19 21:13:30,617][INFO ][wal-file-archiver%grid-1-#24440%grid-1%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000000.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000010.wal] [21:13:30] : [Step 4/5] [2021-11-19 21:13:30,625][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint started [checkpointId=799ef7e3-99f2-495c-89c7-24b66aee235c, startPtr=WALPointer [idx=11, fileOff=148190, len=2048], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=7ms, writeCheckpointEntryDuration=9ms, splitAndSortCpPagesDuration=0ms, pages=28, reason='test'] [21:13:30] : [Step 4/5] [2021-11-19 21:13:30,646][INFO ][db-checkpoint-thread-#24450%grid-1%][GridEncryptionManager] Previous encryption keys were removed [grpId=1613773252, keyIds=[0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13]] [21:13:30] : [Step 4/5] [2021-11-19 21:13:30,646][INFO ][db-checkpoint-thread-#24450%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:13:30] : [Step 4/5] [2021-11-19 21:13:30,647][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint finished [cpId=799ef7e3-99f2-495c-89c7-24b66aee235c, pages=28, markPos=WALPointer [idx=11, fileOff=148190, len=2048], walSegmentsCovered=[10], markDuration=17ms, pagesWrite=1ms, fsync=20ms, total=39ms] [21:13:30] : [Step 4/5] [2021-11-19 21:13:30,647][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00cce8f9-a2b3-4d32-a95a-7f6eb6335000, grp=1613773252] [21:13:30] : [Step 4/5] [2021-11-19 21:13:30,653][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint started [checkpointId=7a935e10-74c0-47ea-af5d-350fef58080c, startPtr=WALPointer [idx=11, fileOff=148190, len=2010], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=2ms, writeCheckpointEntryDuration=2ms, splitAndSortCpPagesDuration=0ms, pages=28, reason='test'] [21:13:30] : [Step 4/5] [2021-11-19 21:13:30,672][INFO ][db-checkpoint-thread-#24445%grid-0%][GridEncryptionManager] Previous encryption keys were removed [grpId=1613773252, keyIds=[0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13]] [21:13:30] : [Step 4/5] [2021-11-19 21:13:30,673][INFO ][db-checkpoint-thread-#24445%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:13:30] : [Step 4/5] [2021-11-19 21:13:30,673][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint finished [cpId=7a935e10-74c0-47ea-af5d-350fef58080c, pages=28, markPos=WALPointer [idx=11, fileOff=148190, len=2010], walSegmentsCovered=[10], markDuration=6ms, pagesWrite=0ms, fsync=19ms, total=25ms] [21:13:30] : [Step 4/5] [2021-11-19 21:13:30,679][INFO ][disco-notifier-worker-#24425%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=80] [21:13:30] : [Step 4/5] [2021-11-19 21:13:30,679][INFO ][reencrypt-#24466%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:13:30] : [Step 4/5] [2021-11-19 21:13:30,679][INFO ][disco-notifier-worker-#24306%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=80] [21:13:30] : [Step 4/5] [2021-11-19 21:13:30,680][INFO ][reencrypt-#24467%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:13:30] : [Step 4/5] [2021-11-19 21:13:30,880][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10b6f63c-e31c-4573-a225-9f76f500c001, grp=1613773252] [21:13:30] : [Step 4/5] [2021-11-19 21:13:30,883][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint started [checkpointId=e0ab5389-f93d-4aa9-9a19-289ecf98eac7, startPtr=WALPointer [idx=11, fileOff=421480, len=2048], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=1ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=0ms, pages=26, reason='test'] [21:13:30] : [Step 4/5] [2021-11-19 21:13:30,893][INFO ][db-checkpoint-thread-#24450%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:13:30] : [Step 4/5] [2021-11-19 21:13:30,893][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint finished [cpId=e0ab5389-f93d-4aa9-9a19-289ecf98eac7, pages=26, markPos=WALPointer [idx=11, fileOff=421480, len=2048], walSegmentsCovered=[], markDuration=3ms, pagesWrite=1ms, fsync=8ms, total=12ms] [21:13:30] : [Step 4/5] [2021-11-19 21:13:30,893][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00cce8f9-a2b3-4d32-a95a-7f6eb6335000, grp=1613773252] [21:13:30] : [Step 4/5] [2021-11-19 21:13:30,902][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint started [checkpointId=1a4aab5c-9a61-465a-bb29-f0b3eeb57088, startPtr=WALPointer [idx=11, fileOff=421442, len=2010], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=1ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=6ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=0ms, pages=26, reason='test'] [21:13:30] : [Step 4/5] [2021-11-19 21:13:30,911][INFO ][db-checkpoint-thread-#24445%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:13:30] : [Step 4/5] [2021-11-19 21:13:30,912][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint finished [cpId=1a4aab5c-9a61-465a-bb29-f0b3eeb57088, pages=26, markPos=WALPointer [idx=11, fileOff=421442, len=2010], walSegmentsCovered=[], markDuration=9ms, pagesWrite=0ms, fsync=9ms, total=18ms] [21:13:30] : [Step 4/5] [2021-11-19 21:13:30,918][INFO ][disco-notifier-worker-#24306%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=81] [21:13:30] : [Step 4/5] [2021-11-19 21:13:30,918][INFO ][disco-notifier-worker-#24425%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=81] [21:13:30] : [Step 4/5] [2021-11-19 21:13:30,918][INFO ][reencrypt-#24467%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:13:30] : [Step 4/5] [2021-11-19 21:13:30,918][INFO ][reencrypt-#24466%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:13:31] : [Step 4/5] [2021-11-19 21:13:31,119][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10b6f63c-e31c-4573-a225-9f76f500c001, grp=1613773252] [21:13:31] : [Step 4/5] [2021-11-19 21:13:31,124][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint started [checkpointId=beea526b-f0f2-41f4-aefd-96e3785685b8, startPtr=WALPointer [idx=11, fileOff=644241, len=2048], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=1ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=1ms, pages=26, reason='test'] [21:13:31] : [Step 4/5] [2021-11-19 21:13:31,133][INFO ][db-checkpoint-thread-#24450%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:13:31] : [Step 4/5] [2021-11-19 21:13:31,134][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint finished [cpId=beea526b-f0f2-41f4-aefd-96e3785685b8, pages=26, markPos=WALPointer [idx=11, fileOff=644241, len=2048], walSegmentsCovered=[], markDuration=4ms, pagesWrite=1ms, fsync=9ms, total=14ms] [21:13:31] : [Step 4/5] [2021-11-19 21:13:31,134][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00cce8f9-a2b3-4d32-a95a-7f6eb6335000, grp=1613773252] [21:13:31] : [Step 4/5] [2021-11-19 21:13:31,143][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint started [checkpointId=49611ead-260d-49e3-b0a3-bb28489a5912, startPtr=WALPointer [idx=11, fileOff=644165, len=2010], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=7ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=0ms, pages=26, reason='test'] [21:13:31] : [Step 4/5] [2021-11-19 21:13:31,153][INFO ][db-checkpoint-thread-#24445%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:13:31] : [Step 4/5] [2021-11-19 21:13:31,153][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint finished [cpId=49611ead-260d-49e3-b0a3-bb28489a5912, pages=26, markPos=WALPointer [idx=11, fileOff=644165, len=2010], walSegmentsCovered=[], markDuration=9ms, pagesWrite=0ms, fsync=9ms, total=18ms] [21:13:31] : [Step 4/5] [2021-11-19 21:13:31,159][INFO ][disco-notifier-worker-#24306%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=82] [21:13:31] : [Step 4/5] [2021-11-19 21:13:31,159][INFO ][disco-notifier-worker-#24425%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=82] [21:13:31] : [Step 4/5] [2021-11-19 21:13:31,159][INFO ][reencrypt-#24466%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:13:31] : [Step 4/5] [2021-11-19 21:13:31,159][INFO ][reencrypt-#24467%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:13:31] : [Step 4/5] [2021-11-19 21:13:31,360][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10b6f63c-e31c-4573-a225-9f76f500c001, grp=1613773252] [21:13:31] : [Step 4/5] [2021-11-19 21:13:31,364][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint started [checkpointId=ff55913f-0f63-44e4-8729-5ceacdf4281b, startPtr=WALPointer [idx=11, fileOff=871035, len=2048], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=1ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=0ms, pages=27, reason='test'] [21:13:31] : [Step 4/5] [2021-11-19 21:13:31,664][INFO ][db-checkpoint-thread-#24450%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:13:31] : [Step 4/5] [2021-11-19 21:13:31,664][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint finished [cpId=ff55913f-0f63-44e4-8729-5ceacdf4281b, pages=27, markPos=WALPointer [idx=11, fileOff=871035, len=2048], walSegmentsCovered=[], markDuration=3ms, pagesWrite=1ms, fsync=299ms, total=303ms] [21:13:31] : [Step 4/5] [2021-11-19 21:13:31,664][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00cce8f9-a2b3-4d32-a95a-7f6eb6335000, grp=1613773252] [21:13:31] : [Step 4/5] [2021-11-19 21:13:31,756][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint started [checkpointId=382c2b3d-aa87-47e3-bcb5-b185beb1f492, startPtr=WALPointer [idx=11, fileOff=870921, len=2010], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=83ms, writeCheckpointEntryDuration=7ms, splitAndSortCpPagesDuration=0ms, pages=27, reason='test'] [21:13:31] : [Step 4/5] [2021-11-19 21:13:31,772][INFO ][db-checkpoint-thread-#24445%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:13:31] : [Step 4/5] [2021-11-19 21:13:31,772][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint finished [cpId=382c2b3d-aa87-47e3-bcb5-b185beb1f492, pages=27, markPos=WALPointer [idx=11, fileOff=870921, len=2010], walSegmentsCovered=[], markDuration=90ms, pagesWrite=1ms, fsync=15ms, total=107ms] [21:13:31] : [Step 4/5] [2021-11-19 21:13:31,781][INFO ][wal-file-archiver%grid-1-#24440%grid-1%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=11, segIdx=1, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000001.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000011.wal] [21:13:31] : [Step 4/5] [2021-11-19 21:13:31,782][INFO ][disco-notifier-worker-#24306%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=83] [21:13:31] : [Step 4/5] [2021-11-19 21:13:31,782][INFO ][disco-notifier-worker-#24425%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=83] [21:13:31] : [Step 4/5] [2021-11-19 21:13:31,781][INFO ][wal-file-archiver%grid-0-#24437%grid-0%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=11, segIdx=1, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000001.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000011.wal] [21:13:31] : [Step 4/5] [2021-11-19 21:13:31,782][INFO ][reencrypt-#24466%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:13:31] : [Step 4/5] [2021-11-19 21:13:31,782][INFO ][wal-file-cleaner%grid-1-#24441%grid-1%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=2, currSize=10.0 MB, maxSize=20.0 MB] [21:13:31] : [Step 4/5] [2021-11-19 21:13:31,782][INFO ][reencrypt-#24467%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:13:31] : [Step 4/5] [2021-11-19 21:13:31,784][INFO ][wal-file-cleaner%grid-0-#24438%grid-0%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=2, currSize=10.0 MB, maxSize=20.0 MB] [21:13:31] : [Step 4/5] [2021-11-19 21:13:31,786][INFO ][wal-file-cleaner%grid-1-#24441%grid-1%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:13:31] : [Step 4/5] [2021-11-19 21:13:31,786][INFO ][wal-file-cleaner%grid-0-#24438%grid-0%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:13:31] : [Step 4/5] [2021-11-19 21:13:31,810][INFO ][wal-file-archiver%grid-0-#24437%grid-0%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000001.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000011.wal] [21:13:31] : [Step 4/5] [2021-11-19 21:13:31,810][INFO ][wal-file-archiver%grid-1-#24440%grid-1%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000001.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000011.wal] [21:13:31] : [Step 4/5] [2021-11-19 21:13:31,984][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10b6f63c-e31c-4573-a225-9f76f500c001, grp=1613773252] [21:13:32] : [Step 4/5] [2021-11-19 21:13:32,161][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint started [checkpointId=0a555323-d3c6-40fc-868c-2156a8110c7b, startPtr=WALPointer [idx=12, fileOff=55440, len=2048], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=90ms, writeCheckpointEntryDuration=86ms, splitAndSortCpPagesDuration=0ms, pages=27, reason='test'] [21:13:32] : [Step 4/5] [2021-11-19 21:13:32,574][INFO ][db-checkpoint-thread-#24450%grid-1%][GridEncryptionManager] Previous encryption keys were removed [grpId=1613773252, keyIds=[14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24]] [21:13:32] : [Step 4/5] [2021-11-19 21:13:32,574][INFO ][db-checkpoint-thread-#24450%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:13:32] : [Step 4/5] [2021-11-19 21:13:32,575][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint finished [cpId=0a555323-d3c6-40fc-868c-2156a8110c7b, pages=27, markPos=WALPointer [idx=12, fileOff=55440, len=2048], walSegmentsCovered=[11], markDuration=177ms, pagesWrite=1ms, fsync=412ms, total=591ms] [21:13:32] : [Step 4/5] [2021-11-19 21:13:32,575][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00cce8f9-a2b3-4d32-a95a-7f6eb6335000, grp=1613773252] [21:13:32] : [Step 4/5] [2021-11-19 21:13:32,676][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint started [checkpointId=5c4fa481-4ca1-4846-9e90-c0d093f4c817, startPtr=WALPointer [idx=12, fileOff=55440, len=2010], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=89ms, writeCheckpointEntryDuration=11ms, splitAndSortCpPagesDuration=0ms, pages=27, reason='test'] [21:13:32] : [Step 4/5] [2021-11-19 21:13:32,742][INFO ][db-checkpoint-thread-#24445%grid-0%][GridEncryptionManager] Previous encryption keys were removed [grpId=1613773252, keyIds=[14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24]] [21:13:32] : [Step 4/5] [2021-11-19 21:13:32,742][INFO ][db-checkpoint-thread-#24445%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:13:32] : [Step 4/5] [2021-11-19 21:13:32,742][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint finished [cpId=5c4fa481-4ca1-4846-9e90-c0d093f4c817, pages=27, markPos=WALPointer [idx=12, fileOff=55440, len=2010], walSegmentsCovered=[11], markDuration=101ms, pagesWrite=1ms, fsync=64ms, total=166ms] [21:13:32] : [Step 4/5] [2021-11-19 21:13:32,747][INFO ][disco-notifier-worker-#24306%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=84] [21:13:32] : [Step 4/5] [2021-11-19 21:13:32,748][INFO ][reencrypt-#24467%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:13:32] : [Step 4/5] [2021-11-19 21:13:32,748][INFO ][disco-notifier-worker-#24425%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=84] [21:13:32] : [Step 4/5] [2021-11-19 21:13:32,748][INFO ][reencrypt-#24466%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:13:32] : [Step 4/5] [2021-11-19 21:13:32,949][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10b6f63c-e31c-4573-a225-9f76f500c001, grp=1613773252] [21:13:33] : [Step 4/5] [2021-11-19 21:13:33,476][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint started [checkpointId=834bd01b-a79f-4cf3-99f6-819c0572a5e7, startPtr=WALPointer [idx=12, fileOff=311712, len=2048], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=138ms, writeCheckpointEntryDuration=388ms, splitAndSortCpPagesDuration=0ms, pages=26, reason='test'] [21:13:33] : [Step 4/5] [2021-11-19 21:13:33,487][INFO ][db-checkpoint-thread-#24450%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:13:33] : [Step 4/5] [2021-11-19 21:13:33,487][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint finished [cpId=834bd01b-a79f-4cf3-99f6-819c0572a5e7, pages=26, markPos=WALPointer [idx=12, fileOff=311712, len=2048], walSegmentsCovered=[], markDuration=527ms, pagesWrite=1ms, fsync=9ms, total=537ms] [21:13:33] : [Step 4/5] [2021-11-19 21:13:33,487][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00cce8f9-a2b3-4d32-a95a-7f6eb6335000, grp=1613773252] [21:13:33] : [Step 4/5] [2021-11-19 21:13:33,496][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint started [checkpointId=f338498b-57fa-4b30-a7d0-e09b850a220b, startPtr=WALPointer [idx=12, fileOff=311674, len=2010], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=7ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=0ms, pages=26, reason='test'] [21:13:33] : [Step 4/5] [2021-11-19 21:13:33,505][INFO ][db-checkpoint-thread-#24445%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:13:33] : [Step 4/5] [2021-11-19 21:13:33,506][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint finished [cpId=f338498b-57fa-4b30-a7d0-e09b850a220b, pages=26, markPos=WALPointer [idx=12, fileOff=311674, len=2010], walSegmentsCovered=[], markDuration=9ms, pagesWrite=0ms, fsync=9ms, total=18ms] [21:13:33] : [Step 4/5] [2021-11-19 21:13:33,512][INFO ][disco-notifier-worker-#24306%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=85] [21:13:33] : [Step 4/5] [2021-11-19 21:13:33,512][INFO ][reencrypt-#24467%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:13:33] : [Step 4/5] [2021-11-19 21:13:33,513][INFO ][disco-notifier-worker-#24425%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=85] [21:13:33] : [Step 4/5] [2021-11-19 21:13:33,514][INFO ][reencrypt-#24466%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:13:33] : [Step 4/5] [2021-11-19 21:13:33,515][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10b6f63c-e31c-4573-a225-9f76f500c001, grp=1613773252] [21:13:33] : [Step 4/5] [2021-11-19 21:13:33,532][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint started [checkpointId=83251cad-e1d4-43e2-b304-5e18956be325, startPtr=WALPointer [idx=12, fileOff=517214, len=2048], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=6ms, writeCheckpointEntryDuration=9ms, splitAndSortCpPagesDuration=0ms, pages=25, reason='test'] [21:13:33] : [Step 4/5] [2021-11-19 21:13:33,541][INFO ][db-checkpoint-thread-#24450%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:13:33] : [Step 4/5] [2021-11-19 21:13:33,542][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint finished [cpId=83251cad-e1d4-43e2-b304-5e18956be325, pages=25, markPos=WALPointer [idx=12, fileOff=517214, len=2048], walSegmentsCovered=[], markDuration=16ms, pagesWrite=1ms, fsync=9ms, total=27ms] [21:13:33] : [Step 4/5] [2021-11-19 21:13:33,542][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00cce8f9-a2b3-4d32-a95a-7f6eb6335000, grp=1613773252] [21:13:33] : [Step 4/5] [2021-11-19 21:13:33,551][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint started [checkpointId=3a9417e4-84dc-4ba8-bfa8-79ec4232908b, startPtr=WALPointer [idx=12, fileOff=517138, len=2010], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=6ms, writeCheckpointEntryDuration=2ms, splitAndSortCpPagesDuration=0ms, pages=25, reason='test'] [21:13:33] : [Step 4/5] [2021-11-19 21:13:33,561][INFO ][db-checkpoint-thread-#24445%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:13:33] : [Step 4/5] [2021-11-19 21:13:33,561][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint finished [cpId=3a9417e4-84dc-4ba8-bfa8-79ec4232908b, pages=25, markPos=WALPointer [idx=12, fileOff=517138, len=2010], walSegmentsCovered=[], markDuration=9ms, pagesWrite=1ms, fsync=8ms, total=18ms] [21:13:33] : [Step 4/5] [2021-11-19 21:13:33,567][INFO ][disco-notifier-worker-#24306%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=86] [21:13:33] : [Step 4/5] [2021-11-19 21:13:33,567][INFO ][reencrypt-#24467%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:13:33] : [Step 4/5] [2021-11-19 21:13:33,568][INFO ][disco-notifier-worker-#24425%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=86] [21:13:33] : [Step 4/5] [2021-11-19 21:13:33,569][INFO ][reencrypt-#24466%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:13:33] : [Step 4/5] [2021-11-19 21:13:33,570][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10b6f63c-e31c-4573-a225-9f76f500c001, grp=1613773252] [21:13:33] : [Step 4/5] [2021-11-19 21:13:33,574][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint started [checkpointId=1abddecd-cced-4520-a4af-4b49170992d6, startPtr=WALPointer [idx=12, fileOff=732528, len=2048], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=1ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=1ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=1ms, pages=27, reason='test'] [21:13:33] : [Step 4/5] [2021-11-19 21:13:33,583][INFO ][db-checkpoint-thread-#24450%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:13:33] : [Step 4/5] [2021-11-19 21:13:33,584][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint finished [cpId=1abddecd-cced-4520-a4af-4b49170992d6, pages=27, markPos=WALPointer [idx=12, fileOff=732528, len=2048], walSegmentsCovered=[], markDuration=4ms, pagesWrite=1ms, fsync=9ms, total=14ms] [21:13:33] : [Step 4/5] [2021-11-19 21:13:33,584][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00cce8f9-a2b3-4d32-a95a-7f6eb6335000, grp=1613773252] [21:13:33] : [Step 4/5] [2021-11-19 21:13:33,593][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint started [checkpointId=4f39cfee-15c6-4832-8891-b6d774a2dc61, startPtr=WALPointer [idx=12, fileOff=732414, len=2010], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=7ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=0ms, pages=27, reason='test'] [21:13:33] : [Step 4/5] [2021-11-19 21:13:33,603][INFO ][db-checkpoint-thread-#24445%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:13:33] : [Step 4/5] [2021-11-19 21:13:33,603][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint finished [cpId=4f39cfee-15c6-4832-8891-b6d774a2dc61, pages=27, markPos=WALPointer [idx=12, fileOff=732414, len=2010], walSegmentsCovered=[], markDuration=9ms, pagesWrite=1ms, fsync=8ms, total=18ms] [21:13:33] : [Step 4/5] [2021-11-19 21:13:33,610][INFO ][disco-notifier-worker-#24306%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=87] [21:13:33] : [Step 4/5] [2021-11-19 21:13:33,610][INFO ][reencrypt-#24467%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:13:33] : [Step 4/5] [2021-11-19 21:13:33,611][INFO ][disco-notifier-worker-#24425%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=87] [21:13:33] : [Step 4/5] [2021-11-19 21:13:33,611][INFO ][reencrypt-#24466%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:13:33] : [Step 4/5] [2021-11-19 21:13:33,812][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10b6f63c-e31c-4573-a225-9f76f500c001, grp=1613773252] [21:13:33] : [Step 4/5] [2021-11-19 21:13:33,974][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint started [checkpointId=07954aa9-f1de-4f05-8716-f45ce0ab6603, startPtr=WALPointer [idx=12, fileOff=940861, len=2048], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=159ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=0ms, pages=25, reason='test'] [21:13:33] : [Step 4/5] [2021-11-19 21:13:33,984][INFO ][db-checkpoint-thread-#24450%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:13:33] : [Step 4/5] [2021-11-19 21:13:33,984][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint finished [cpId=07954aa9-f1de-4f05-8716-f45ce0ab6603, pages=25, markPos=WALPointer [idx=12, fileOff=940861, len=2048], walSegmentsCovered=[], markDuration=162ms, pagesWrite=1ms, fsync=8ms, total=171ms] [21:13:33] : [Step 4/5] [2021-11-19 21:13:33,985][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00cce8f9-a2b3-4d32-a95a-7f6eb6335000, grp=1613773252] [21:13:33] : [Step 4/5] [2021-11-19 21:13:33,993][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint started [checkpointId=000ffc53-9d30-47b9-a4a0-b28dd3e0b861, startPtr=WALPointer [idx=12, fileOff=940709, len=2010], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=6ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=0ms, pages=25, reason='test'] [21:13:34] : [Step 4/5] [2021-11-19 21:13:34,003][INFO ][db-checkpoint-thread-#24445%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:13:34] : [Step 4/5] [2021-11-19 21:13:34,003][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint finished [cpId=000ffc53-9d30-47b9-a4a0-b28dd3e0b861, pages=25, markPos=WALPointer [idx=12, fileOff=940709, len=2010], walSegmentsCovered=[], markDuration=8ms, pagesWrite=1ms, fsync=8ms, total=18ms] [21:13:34] : [Step 4/5] [2021-11-19 21:13:34,011][INFO ][wal-file-archiver%grid-1-#24440%grid-1%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=12, segIdx=2, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000002.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000012.wal] [21:13:34] : [Step 4/5] [2021-11-19 21:13:34,012][INFO ][wal-file-archiver%grid-0-#24437%grid-0%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=12, segIdx=2, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000002.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000012.wal] [21:13:34] : [Step 4/5] [2021-11-19 21:13:34,013][INFO ][wal-file-cleaner%grid-1-#24441%grid-1%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=3, currSize=10.0 MB, maxSize=20.0 MB] [21:13:34] : [Step 4/5] [2021-11-19 21:13:34,013][INFO ][wal-file-cleaner%grid-0-#24438%grid-0%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=3, currSize=10.0 MB, maxSize=20.0 MB] [21:13:34] : [Step 4/5] [2021-11-19 21:13:34,015][INFO ][disco-notifier-worker-#24306%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=88] [21:13:34] : [Step 4/5] [2021-11-19 21:13:34,015][INFO ][reencrypt-#24467%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:13:34] : [Step 4/5] [2021-11-19 21:13:34,016][INFO ][disco-notifier-worker-#24425%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=88] [21:13:34] : [Step 4/5] [2021-11-19 21:13:34,016][INFO ][wal-file-cleaner%grid-1-#24441%grid-1%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:13:34] : [Step 4/5] [2021-11-19 21:13:34,016][INFO ][wal-file-cleaner%grid-0-#24438%grid-0%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:13:34] : [Step 4/5] [2021-11-19 21:13:34,016][INFO ][reencrypt-#24466%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:13:34] : [Step 4/5] [2021-11-19 21:13:34,029][INFO ][wal-file-archiver%grid-1-#24440%grid-1%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000002.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000012.wal] [21:13:34] : [Step 4/5] [2021-11-19 21:13:34,029][INFO ][wal-file-archiver%grid-0-#24437%grid-0%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000002.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000012.wal] [21:13:34] : [Step 4/5] [2021-11-19 21:13:34,217][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10b6f63c-e31c-4573-a225-9f76f500c001, grp=1613773252] [21:13:34] : [Step 4/5] [2021-11-19 21:13:34,221][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint started [checkpointId=e46e9ac7-1713-4e12-add1-e0ac2574d020, startPtr=WALPointer [idx=13, fileOff=109164, len=2048], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=1ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=1ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=0ms, pages=25, reason='test'] [21:13:34] : [Step 4/5] [2021-11-19 21:13:34,233][INFO ][db-checkpoint-thread-#24450%grid-1%][GridEncryptionManager] Previous encryption keys were removed [grpId=1613773252, keyIds=[25, 26, 27, 28, 29, 30, 31, 32]] [21:13:34] : [Step 4/5] [2021-11-19 21:13:34,234][INFO ][db-checkpoint-thread-#24450%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:13:34] : [Step 4/5] [2021-11-19 21:13:34,234][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint finished [cpId=e46e9ac7-1713-4e12-add1-e0ac2574d020, pages=25, markPos=WALPointer [idx=13, fileOff=109164, len=2048], walSegmentsCovered=[12], markDuration=4ms, pagesWrite=1ms, fsync=11ms, total=16ms] [21:13:34] : [Step 4/5] [2021-11-19 21:13:34,234][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00cce8f9-a2b3-4d32-a95a-7f6eb6335000, grp=1613773252] [21:13:34] : [Step 4/5] [2021-11-19 21:13:34,240][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint started [checkpointId=921b6743-7ad8-4b4e-87a2-e844fb1c984a, startPtr=WALPointer [idx=13, fileOff=109164, len=2010], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=4ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=0ms, pages=25, reason='test'] [21:13:34] : [Step 4/5] [2021-11-19 21:13:34,252][INFO ][db-checkpoint-thread-#24445%grid-0%][GridEncryptionManager] Previous encryption keys were removed [grpId=1613773252, keyIds=[25, 26, 27, 28, 29, 30, 31, 32]] [21:13:34] : [Step 4/5] [2021-11-19 21:13:34,252][INFO ][db-checkpoint-thread-#24445%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:13:34] : [Step 4/5] [2021-11-19 21:13:34,253][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint finished [cpId=921b6743-7ad8-4b4e-87a2-e844fb1c984a, pages=25, markPos=WALPointer [idx=13, fileOff=109164, len=2010], walSegmentsCovered=[12], markDuration=6ms, pagesWrite=1ms, fsync=10ms, total=17ms] [21:13:34] : [Step 4/5] [2021-11-19 21:13:34,258][INFO ][disco-notifier-worker-#24306%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=89] [21:13:34] : [Step 4/5] [2021-11-19 21:13:34,258][INFO ][disco-notifier-worker-#24425%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=89] [21:13:34] : [Step 4/5] [2021-11-19 21:13:34,258][INFO ][reencrypt-#24467%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:13:34] : [Step 4/5] [2021-11-19 21:13:34,259][INFO ][reencrypt-#24466%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:13:34] : [Step 4/5] [2021-11-19 21:13:34,460][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10b6f63c-e31c-4573-a225-9f76f500c001, grp=1613773252] [21:13:34] : [Step 4/5] [2021-11-19 21:13:34,464][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint started [checkpointId=e9738a27-a6b1-40b7-a6d3-c502541c172c, startPtr=WALPointer [idx=13, fileOff=357988, len=2048], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=2ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=0ms, pages=26, reason='test'] [21:13:34] : [Step 4/5] [2021-11-19 21:13:34,473][INFO ][db-checkpoint-thread-#24450%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:13:34] : [Step 4/5] [2021-11-19 21:13:34,474][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint finished [cpId=e9738a27-a6b1-40b7-a6d3-c502541c172c, pages=26, markPos=WALPointer [idx=13, fileOff=357988, len=2048], walSegmentsCovered=[], markDuration=4ms, pagesWrite=0ms, fsync=9ms, total=14ms] [21:13:34] : [Step 4/5] [2021-11-19 21:13:34,474][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00cce8f9-a2b3-4d32-a95a-7f6eb6335000, grp=1613773252] [21:13:34] : [Step 4/5] [2021-11-19 21:13:34,483][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint started [checkpointId=6a42b801-8e75-4d98-91e1-b01389247078, startPtr=WALPointer [idx=13, fileOff=357950, len=2010], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=7ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=0ms, pages=26, reason='test'] [21:13:34] : [Step 4/5] [2021-11-19 21:13:34,493][INFO ][db-checkpoint-thread-#24445%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:13:34] : [Step 4/5] [2021-11-19 21:13:34,493][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint finished [cpId=6a42b801-8e75-4d98-91e1-b01389247078, pages=26, markPos=WALPointer [idx=13, fileOff=357950, len=2010], walSegmentsCovered=[], markDuration=9ms, pagesWrite=1ms, fsync=8ms, total=18ms] [21:13:34] : [Step 4/5] [2021-11-19 21:13:34,499][INFO ][disco-notifier-worker-#24306%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=90] [21:13:34] : [Step 4/5] [2021-11-19 21:13:34,499][INFO ][disco-notifier-worker-#24425%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=90] [21:13:34] : [Step 4/5] [2021-11-19 21:13:34,499][INFO ][reencrypt-#24467%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:13:34] : [Step 4/5] [2021-11-19 21:13:34,499][INFO ][reencrypt-#24466%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:13:34] : [Step 4/5] [2021-11-19 21:13:34,701][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10b6f63c-e31c-4573-a225-9f76f500c001, grp=1613773252] [21:13:34] : [Step 4/5] [2021-11-19 21:13:34,935][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint started [checkpointId=a7eacb06-a62b-4d62-a9b2-4ab2755ec79e, startPtr=WALPointer [idx=13, fileOff=558768, len=2048], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=100ms, writeCheckpointEntryDuration=132ms, splitAndSortCpPagesDuration=1ms, pages=25, reason='test'] [21:13:35] : [Step 4/5] [2021-11-19 21:13:35,236][INFO ][db-checkpoint-thread-#24450%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:13:35] : [Step 4/5] [2021-11-19 21:13:35,236][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint finished [cpId=a7eacb06-a62b-4d62-a9b2-4ab2755ec79e, pages=25, markPos=WALPointer [idx=13, fileOff=558768, len=2048], walSegmentsCovered=[], markDuration=233ms, pagesWrite=1ms, fsync=300ms, total=535ms] [21:13:35] : [Step 4/5] [2021-11-19 21:13:35,237][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00cce8f9-a2b3-4d32-a95a-7f6eb6335000, grp=1613773252] [21:13:35] : [Step 4/5] [2021-11-19 21:13:35,423][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint started [checkpointId=1aaf31cc-ff59-4156-aba6-da607765db23, startPtr=WALPointer [idx=13, fileOff=558692, len=2010], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=101ms, writeCheckpointEntryDuration=84ms, splitAndSortCpPagesDuration=0ms, pages=25, reason='test'] [21:13:35] : [Step 4/5] [2021-11-19 21:13:35,634][INFO ][db-checkpoint-thread-#24445%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:13:35] : [Step 4/5] [2021-11-19 21:13:35,634][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint finished [cpId=1aaf31cc-ff59-4156-aba6-da607765db23, pages=25, markPos=WALPointer [idx=13, fileOff=558692, len=2010], walSegmentsCovered=[], markDuration=185ms, pagesWrite=1ms, fsync=210ms, total=397ms] [21:13:35] : [Step 4/5] [2021-11-19 21:13:35,640][INFO ][disco-notifier-worker-#24306%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=91] [21:13:35] : [Step 4/5] [2021-11-19 21:13:35,641][INFO ][reencrypt-#24467%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:13:35] : [Step 4/5] [2021-11-19 21:13:35,641][INFO ][disco-notifier-worker-#24425%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=91] [21:13:35] : [Step 4/5] [2021-11-19 21:13:35,641][INFO ][reencrypt-#24466%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:13:35] : [Step 4/5] [2021-11-19 21:13:35,842][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10b6f63c-e31c-4573-a225-9f76f500c001, grp=1613773252] [21:13:36] : [Step 4/5] [2021-11-19 21:13:35,998][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint started [checkpointId=573a737f-dbf0-46ba-a1db-d694abd7a460, startPtr=WALPointer [idx=13, fileOff=761122, len=2048], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=34ms, writeCheckpointEntryDuration=121ms, splitAndSortCpPagesDuration=0ms, pages=25, reason='test'] [21:13:36] : [Step 4/5] [2021-11-19 21:13:36,384][INFO ][db-checkpoint-thread-#24450%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:13:36] : [Step 4/5] [2021-11-19 21:13:36,384][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint finished [cpId=573a737f-dbf0-46ba-a1db-d694abd7a460, pages=25, markPos=WALPointer [idx=13, fileOff=761122, len=2048], walSegmentsCovered=[], markDuration=156ms, pagesWrite=1ms, fsync=384ms, total=541ms] [21:13:36] : [Step 4/5] [2021-11-19 21:13:36,384][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00cce8f9-a2b3-4d32-a95a-7f6eb6335000, grp=1613773252] [21:13:36] : [Step 4/5] [2021-11-19 21:13:36,741][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint started [checkpointId=526b5e41-a478-425d-97e4-30baff1c8026, startPtr=WALPointer [idx=13, fileOff=761008, len=2010], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=36ms, writeCheckpointEntryDuration=319ms, splitAndSortCpPagesDuration=0ms, pages=25, reason='test'] [21:13:36] : [Step 4/5] [2021-11-19 21:13:36,803][INFO ][db-checkpoint-thread-#24445%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:13:36] : [Step 4/5] [2021-11-19 21:13:36,804][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint finished [cpId=526b5e41-a478-425d-97e4-30baff1c8026, pages=25, markPos=WALPointer [idx=13, fileOff=761008, len=2010], walSegmentsCovered=[], markDuration=356ms, pagesWrite=1ms, fsync=60ms, total=418ms] [21:13:36] : [Step 4/5] [2021-11-19 21:13:36,809][INFO ][disco-notifier-worker-#24425%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=92] [21:13:36] : [Step 4/5] [2021-11-19 21:13:36,809][INFO ][disco-notifier-worker-#24306%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=92] [21:13:36] : [Step 4/5] [2021-11-19 21:13:36,809][INFO ][reencrypt-#24466%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:13:36] : [Step 4/5] [2021-11-19 21:13:36,810][INFO ][reencrypt-#24467%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:13:37] : [Step 4/5] [2021-11-19 21:13:37,014][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10b6f63c-e31c-4573-a225-9f76f500c001, grp=1613773252] [21:13:37] : [Step 4/5] [2021-11-19 21:13:37,380][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint started [checkpointId=5986bdbe-9b3a-4b63-888f-21f64277a9d8, startPtr=WALPointer [idx=13, fileOff=965050, len=2048], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=216ms, writeCheckpointEntryDuration=149ms, splitAndSortCpPagesDuration=0ms, pages=25, reason='test'] [21:13:37] : [Step 4/5] [2021-11-19 21:13:37,595][INFO ][db-checkpoint-thread-#24450%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:13:37] : [Step 4/5] [2021-11-19 21:13:37,596][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint finished [cpId=5986bdbe-9b3a-4b63-888f-21f64277a9d8, pages=25, markPos=WALPointer [idx=13, fileOff=965050, len=2048], walSegmentsCovered=[], markDuration=366ms, pagesWrite=1ms, fsync=214ms, total=581ms] [21:13:37] : [Step 4/5] [2021-11-19 21:13:37,596][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00cce8f9-a2b3-4d32-a95a-7f6eb6335000, grp=1613773252] [21:13:37] : [Step 4/5] [2021-11-19 21:13:37,613][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint started [checkpointId=f6219184-4345-4131-ab7f-3e0b152b7eef, startPtr=WALPointer [idx=13, fileOff=964898, len=2010], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=5ms, writeCheckpointEntryDuration=9ms, splitAndSortCpPagesDuration=1ms, pages=25, reason='test'] [21:13:37] : [Step 4/5] [2021-11-19 21:13:37,631][INFO ][db-checkpoint-thread-#24445%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:13:37] : [Step 4/5] [2021-11-19 21:13:37,631][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint finished [cpId=f6219184-4345-4131-ab7f-3e0b152b7eef, pages=25, markPos=WALPointer [idx=13, fileOff=964898, len=2010], walSegmentsCovered=[], markDuration=16ms, pagesWrite=1ms, fsync=17ms, total=34ms] [21:13:37] : [Step 4/5] [2021-11-19 21:13:37,640][INFO ][wal-file-archiver%grid-1-#24440%grid-1%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=13, segIdx=3, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000003.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000013.wal] [21:13:37] : [Step 4/5] [2021-11-19 21:13:37,640][INFO ][wal-file-archiver%grid-0-#24437%grid-0%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=13, segIdx=3, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000003.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000013.wal] [21:13:37] : [Step 4/5] [2021-11-19 21:13:37,641][INFO ][wal-file-cleaner%grid-1-#24441%grid-1%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=4, currSize=10.0 MB, maxSize=20.0 MB] [21:13:37] : [Step 4/5] [2021-11-19 21:13:37,642][INFO ][wal-file-cleaner%grid-0-#24438%grid-0%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=4, currSize=10.0 MB, maxSize=20.0 MB] [21:13:37] : [Step 4/5] [2021-11-19 21:13:37,644][INFO ][disco-notifier-worker-#24425%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=93] [21:13:37] : [Step 4/5] [2021-11-19 21:13:37,644][INFO ][wal-file-cleaner%grid-1-#24441%grid-1%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:13:37] : [Step 4/5] [2021-11-19 21:13:37,644][INFO ][disco-notifier-worker-#24306%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=93] [21:13:37] : [Step 4/5] [2021-11-19 21:13:37,644][INFO ][reencrypt-#24466%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:13:37] : [Step 4/5] [2021-11-19 21:13:37,645][INFO ][reencrypt-#24467%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:13:37] : [Step 4/5] [2021-11-19 21:13:37,644][INFO ][wal-file-cleaner%grid-0-#24438%grid-0%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:13:37] : [Step 4/5] [2021-11-19 21:13:37,660][INFO ][wal-file-archiver%grid-1-#24440%grid-1%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000003.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000013.wal] [21:13:37] : [Step 4/5] [2021-11-19 21:13:37,660][INFO ][wal-file-archiver%grid-0-#24437%grid-0%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000003.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000013.wal] [21:13:37] : [Step 4/5] [2021-11-19 21:13:37,845][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10b6f63c-e31c-4573-a225-9f76f500c001, grp=1613773252] [21:13:38] : [Step 4/5] [2021-11-19 21:13:38,027][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint started [checkpointId=448ddcc0-4652-4227-b91c-fa29c436cdce, startPtr=WALPointer [idx=14, fileOff=125334, len=2048], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=26ms, writeCheckpointEntryDuration=155ms, splitAndSortCpPagesDuration=0ms, pages=25, reason='test'] [21:13:38] : [Step 4/5] [2021-11-19 21:13:38,399][INFO ][db-checkpoint-thread-#24450%grid-1%][GridEncryptionManager] Previous encryption keys were removed [grpId=1613773252, keyIds=[33, 34, 35, 36, 37, 38, 39, 40]] [21:13:38] : [Step 4/5] [2021-11-19 21:13:38,400][INFO ][db-checkpoint-thread-#24450%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:13:38] : [Step 4/5] [2021-11-19 21:13:38,400][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint finished [cpId=448ddcc0-4652-4227-b91c-fa29c436cdce, pages=25, markPos=WALPointer [idx=14, fileOff=125334, len=2048], walSegmentsCovered=[13], markDuration=182ms, pagesWrite=1ms, fsync=371ms, total=554ms] [21:13:38] : [Step 4/5] [2021-11-19 21:13:38,400][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00cce8f9-a2b3-4d32-a95a-7f6eb6335000, grp=1613773252] [21:13:38] : [Step 4/5] [2021-11-19 21:13:38,414][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint started [checkpointId=fc3663fd-e32a-43e7-bd61-9b301341e9fa, startPtr=WALPointer [idx=14, fileOff=125334, len=2010], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=2ms, writeCheckpointEntryDuration=10ms, splitAndSortCpPagesDuration=0ms, pages=25, reason='test'] [21:13:38] : [Step 4/5] [2021-11-19 21:13:38,437][INFO ][db-checkpoint-thread-#24445%grid-0%][GridEncryptionManager] Previous encryption keys were removed [grpId=1613773252, keyIds=[33, 34, 35, 36, 37, 38, 39, 40]] [21:13:38] : [Step 4/5] [2021-11-19 21:13:38,438][INFO ][db-checkpoint-thread-#24445%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:13:38] : [Step 4/5] [2021-11-19 21:13:38,438][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint finished [cpId=fc3663fd-e32a-43e7-bd61-9b301341e9fa, pages=25, markPos=WALPointer [idx=14, fileOff=125334, len=2010], walSegmentsCovered=[13], markDuration=12ms, pagesWrite=1ms, fsync=23ms, total=37ms] [21:13:38] : [Step 4/5] [2021-11-19 21:13:38,442][INFO ][disco-notifier-worker-#24306%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=94] [21:13:38] : [Step 4/5] [2021-11-19 21:13:38,442][INFO ][reencrypt-#24467%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:13:38] : [Step 4/5] [2021-11-19 21:13:38,443][INFO ][disco-notifier-worker-#24425%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=94] [21:13:38] : [Step 4/5] [2021-11-19 21:13:38,443][INFO ][reencrypt-#24466%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:13:38] : [Step 4/5] [2021-11-19 21:13:38,644][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10b6f63c-e31c-4573-a225-9f76f500c001, grp=1613773252] [21:13:38] : [Step 4/5] [2021-11-19 21:13:38,764][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint started [checkpointId=d20ab162-df69-4893-ae27-3f354c96ac03, startPtr=WALPointer [idx=14, fileOff=358665, len=2048], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=35ms, writeCheckpointEntryDuration=84ms, splitAndSortCpPagesDuration=0ms, pages=24, reason='test'] [21:13:39] : [Step 4/5] [2021-11-19 21:13:39,190][INFO ][db-checkpoint-thread-#24450%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:13:39] : [Step 4/5] [2021-11-19 21:13:39,190][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint finished [cpId=d20ab162-df69-4893-ae27-3f354c96ac03, pages=24, markPos=WALPointer [idx=14, fileOff=358665, len=2048], walSegmentsCovered=[], markDuration=120ms, pagesWrite=1ms, fsync=424ms, total=546ms] [21:13:39] : [Step 4/5] [2021-11-19 21:13:39,191][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00cce8f9-a2b3-4d32-a95a-7f6eb6335000, grp=1613773252] [21:13:39] : [Step 4/5] [2021-11-19 21:13:39,209][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint started [checkpointId=003e2b44-7711-438d-9989-0ebb68b47d65, startPtr=WALPointer [idx=14, fileOff=358627, len=2010], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=8ms, writeCheckpointEntryDuration=9ms, splitAndSortCpPagesDuration=0ms, pages=24, reason='test'] [21:13:39] : [Step 4/5] [2021-11-19 21:13:39,219][INFO ][db-checkpoint-thread-#24445%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:13:39] : [Step 4/5] [2021-11-19 21:13:39,219][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint finished [cpId=003e2b44-7711-438d-9989-0ebb68b47d65, pages=24, markPos=WALPointer [idx=14, fileOff=358627, len=2010], walSegmentsCovered=[], markDuration=17ms, pagesWrite=1ms, fsync=9ms, total=28ms] [21:13:39] : [Step 4/5] [2021-11-19 21:13:39,224][INFO ][disco-notifier-worker-#24306%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=95] [21:13:39] : [Step 4/5] [2021-11-19 21:13:39,224][INFO ][reencrypt-#24467%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:13:39] : [Step 4/5] [2021-11-19 21:13:39,225][INFO ][disco-notifier-worker-#24425%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=95] [21:13:39] : [Step 4/5] [2021-11-19 21:13:39,225][INFO ][reencrypt-#24466%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:13:39] : [Step 4/5] [2021-11-19 21:13:39,426][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10b6f63c-e31c-4573-a225-9f76f500c001, grp=1613773252] [21:13:39] : [Step 4/5] [2021-11-19 21:13:39,626][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint started [checkpointId=6fdd9ec7-1749-452f-b8e3-1a170f6f83f4, startPtr=WALPointer [idx=14, fileOff=550461, len=2048], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=39ms, writeCheckpointEntryDuration=160ms, splitAndSortCpPagesDuration=0ms, pages=24, reason='test'] [21:13:39] : [Step 4/5] [2021-11-19 21:13:39,938][INFO ][db-checkpoint-thread-#24450%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:13:39] : [Step 4/5] [2021-11-19 21:13:39,938][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint finished [cpId=6fdd9ec7-1749-452f-b8e3-1a170f6f83f4, pages=24, markPos=WALPointer [idx=14, fileOff=550461, len=2048], walSegmentsCovered=[], markDuration=200ms, pagesWrite=1ms, fsync=310ms, total=512ms] [21:13:39] : [Step 4/5] [2021-11-19 21:13:39,939][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00cce8f9-a2b3-4d32-a95a-7f6eb6335000, grp=1613773252] [21:13:39] : [Step 4/5] [2021-11-19 21:13:39,994][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint started [checkpointId=4d554642-b04e-4b81-b845-0b316184452e, startPtr=WALPointer [idx=14, fileOff=550385, len=2010], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=1ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=53ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=0ms, pages=24, reason='test'] [21:13:40] : [Step 4/5] [2021-11-19 21:13:40,004][INFO ][db-checkpoint-thread-#24445%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:13:40] : [Step 4/5] [2021-11-19 21:13:40,004][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint finished [cpId=4d554642-b04e-4b81-b845-0b316184452e, pages=24, markPos=WALPointer [idx=14, fileOff=550385, len=2010], walSegmentsCovered=[], markDuration=56ms, pagesWrite=1ms, fsync=8ms, total=65ms] [21:13:40] : [Step 4/5] [2021-11-19 21:13:40,010][INFO ][disco-notifier-worker-#24306%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=96] [21:13:40] : [Step 4/5] [2021-11-19 21:13:40,010][INFO ][reencrypt-#24467%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:13:40] : [Step 4/5] [2021-11-19 21:13:40,011][INFO ][disco-notifier-worker-#24425%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=96] [21:13:40] : [Step 4/5] [2021-11-19 21:13:40,011][INFO ][reencrypt-#24466%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:13:40] : [Step 4/5] [2021-11-19 21:13:40,212][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10b6f63c-e31c-4573-a225-9f76f500c001, grp=1613773252] [21:13:40] : [Step 4/5] [2021-11-19 21:13:40,448][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint started [checkpointId=53b748df-e48e-4fb4-b57f-7f29734ef326, startPtr=WALPointer [idx=14, fileOff=739490, len=2048], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=169ms, writeCheckpointEntryDuration=66ms, splitAndSortCpPagesDuration=0ms, pages=23, reason='test'] [21:13:40] : [Step 4/5] [2021-11-19 21:13:40,457][INFO ][db-checkpoint-thread-#24450%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:13:40] : [Step 4/5] [2021-11-19 21:13:40,458][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint finished [cpId=53b748df-e48e-4fb4-b57f-7f29734ef326, pages=23, markPos=WALPointer [idx=14, fileOff=739490, len=2048], walSegmentsCovered=[], markDuration=235ms, pagesWrite=1ms, fsync=9ms, total=245ms] [21:13:40] : [Step 4/5] [2021-11-19 21:13:40,458][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00cce8f9-a2b3-4d32-a95a-7f6eb6335000, grp=1613773252] [21:13:40] : [Step 4/5] [2021-11-19 21:13:40,467][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint started [checkpointId=8cbe430a-9791-48a5-bd9b-05ddf70f47fe, startPtr=WALPointer [idx=14, fileOff=739376, len=2010], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=7ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=0ms, pages=23, reason='test'] [21:13:40] : [Step 4/5] [2021-11-19 21:13:40,476][INFO ][db-checkpoint-thread-#24445%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:13:40] : [Step 4/5] [2021-11-19 21:13:40,477][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint finished [cpId=8cbe430a-9791-48a5-bd9b-05ddf70f47fe, pages=23, markPos=WALPointer [idx=14, fileOff=739376, len=2010], walSegmentsCovered=[], markDuration=9ms, pagesWrite=0ms, fsync=9ms, total=19ms] [21:13:40] : [Step 4/5] [2021-11-19 21:13:40,482][INFO ][disco-notifier-worker-#24306%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=97] [21:13:40] : [Step 4/5] [2021-11-19 21:13:40,483][INFO ][reencrypt-#24467%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:13:40] : [Step 4/5] [2021-11-19 21:13:40,483][INFO ][disco-notifier-worker-#24425%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=97] [21:13:40] : [Step 4/5] [2021-11-19 21:13:40,483][INFO ][reencrypt-#24466%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:13:40] : [Step 4/5] [2021-11-19 21:13:40,684][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10b6f63c-e31c-4573-a225-9f76f500c001, grp=1613773252] [21:13:40] : [Step 4/5] [2021-11-19 21:13:40,688][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint started [checkpointId=ec88874f-bff9-44bf-b9fe-8b85d528872d, startPtr=WALPointer [idx=14, fileOff=931945, len=2048], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=1ms, writeCheckpointEntryDuration=2ms, splitAndSortCpPagesDuration=0ms, pages=23, reason='test'] [21:13:40] : [Step 4/5] [2021-11-19 21:13:40,697][INFO ][db-checkpoint-thread-#24450%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:13:40] : [Step 4/5] [2021-11-19 21:13:40,698][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint finished [cpId=ec88874f-bff9-44bf-b9fe-8b85d528872d, pages=23, markPos=WALPointer [idx=14, fileOff=931945, len=2048], walSegmentsCovered=[], markDuration=3ms, pagesWrite=1ms, fsync=9ms, total=13ms] [21:13:40] : [Step 4/5] [2021-11-19 21:13:40,698][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00cce8f9-a2b3-4d32-a95a-7f6eb6335000, grp=1613773252] [21:13:40] : [Step 4/5] [2021-11-19 21:13:40,706][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint started [checkpointId=18d5efe8-a3b4-4b6b-9fba-8aa3fdd8b922, startPtr=WALPointer [idx=14, fileOff=931793, len=2010], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=5ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=0ms, pages=23, reason='test'] [21:13:40] : [Step 4/5] [2021-11-19 21:13:40,716][INFO ][db-checkpoint-thread-#24445%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:13:40] : [Step 4/5] [2021-11-19 21:13:40,716][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint finished [cpId=18d5efe8-a3b4-4b6b-9fba-8aa3fdd8b922, pages=23, markPos=WALPointer [idx=14, fileOff=931793, len=2010], walSegmentsCovered=[], markDuration=8ms, pagesWrite=1ms, fsync=8ms, total=17ms] [21:13:40] : [Step 4/5] [2021-11-19 21:13:40,725][INFO ][wal-file-archiver%grid-0-#24437%grid-0%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=14, segIdx=4, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000004.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000014.wal] [21:13:40] : [Step 4/5] [2021-11-19 21:13:40,725][INFO ][disco-notifier-worker-#24425%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=98] [21:13:40] : [Step 4/5] [2021-11-19 21:13:40,725][INFO ][disco-notifier-worker-#24306%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=98] [21:13:40] : [Step 4/5] [2021-11-19 21:13:40,725][INFO ][wal-file-archiver%grid-1-#24440%grid-1%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=14, segIdx=4, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000004.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000014.wal] [21:13:40] : [Step 4/5] [2021-11-19 21:13:40,726][INFO ][reencrypt-#24467%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:13:40] : [Step 4/5] [2021-11-19 21:13:40,726][INFO ][wal-file-cleaner%grid-0-#24438%grid-0%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=5, currSize=10.0 MB, maxSize=20.0 MB] [21:13:40] : [Step 4/5] [2021-11-19 21:13:40,726][INFO ][reencrypt-#24466%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:13:40] : [Step 4/5] [2021-11-19 21:13:40,727][INFO ][wal-file-cleaner%grid-1-#24441%grid-1%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=5, currSize=10.0 MB, maxSize=20.0 MB] [21:13:40] : [Step 4/5] [2021-11-19 21:13:40,729][INFO ][wal-file-cleaner%grid-0-#24438%grid-0%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:13:40] : [Step 4/5] [2021-11-19 21:13:40,730][INFO ][wal-file-cleaner%grid-1-#24441%grid-1%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:13:40] : [Step 4/5] [2021-11-19 21:13:40,741][INFO ][wal-file-archiver%grid-1-#24440%grid-1%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000004.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000014.wal] [21:13:40] : [Step 4/5] [2021-11-19 21:13:40,741][INFO ][wal-file-archiver%grid-0-#24437%grid-0%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000004.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000014.wal] [21:13:40] : [Step 4/5] [2021-11-19 21:13:40,927][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10b6f63c-e31c-4573-a225-9f76f500c001, grp=1613773252] [21:13:40] : [Step 4/5] [2021-11-19 21:13:40,932][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint started [checkpointId=aa7f0347-876d-407c-b66c-73eb10c52557, startPtr=WALPointer [idx=15, fileOff=85702, len=2048], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=2ms, checkpointLockHoldTime=2ms, walCpRecordFsyncDuration=1ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=0ms, pages=23, reason='test'] [21:13:40] : [Step 4/5] [2021-11-19 21:13:40,944][INFO ][db-checkpoint-thread-#24450%grid-1%][GridEncryptionManager] Previous encryption keys were removed [grpId=1613773252, keyIds=[41, 42, 43, 44, 45, 46]] [21:13:40] : [Step 4/5] [2021-11-19 21:13:40,944][INFO ][db-checkpoint-thread-#24450%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:13:40] : [Step 4/5] [2021-11-19 21:13:40,945][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint finished [cpId=aa7f0347-876d-407c-b66c-73eb10c52557, pages=23, markPos=WALPointer [idx=15, fileOff=85702, len=2048], walSegmentsCovered=[14], markDuration=5ms, pagesWrite=1ms, fsync=11ms, total=18ms] [21:13:40] : [Step 4/5] [2021-11-19 21:13:40,945][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00cce8f9-a2b3-4d32-a95a-7f6eb6335000, grp=1613773252] [21:13:40] : [Step 4/5] [2021-11-19 21:13:40,952][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint started [checkpointId=68570c4a-cf4f-4e79-9405-785e6c2e1308, startPtr=WALPointer [idx=15, fileOff=85702, len=2010], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=4ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=0ms, pages=23, reason='test'] [21:13:41] : [Step 4/5] [2021-11-19 21:13:41,272][INFO ][db-checkpoint-thread-#24445%grid-0%][GridEncryptionManager] Previous encryption keys were removed [grpId=1613773252, keyIds=[41, 42, 43, 44, 45, 46]] [21:13:41] : [Step 4/5] [2021-11-19 21:13:41,272][INFO ][db-checkpoint-thread-#24445%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:13:41] : [Step 4/5] [2021-11-19 21:13:41,272][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint finished [cpId=68570c4a-cf4f-4e79-9405-785e6c2e1308, pages=23, markPos=WALPointer [idx=15, fileOff=85702, len=2010], walSegmentsCovered=[14], markDuration=6ms, pagesWrite=1ms, fsync=319ms, total=326ms] [21:13:41] : [Step 4/5] [2021-11-19 21:13:41,277][INFO ][disco-notifier-worker-#24306%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=99] [21:13:41] : [Step 4/5] [2021-11-19 21:13:41,278][INFO ][reencrypt-#24467%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:13:41] : [Step 4/5] [2021-11-19 21:13:41,278][INFO ][disco-notifier-worker-#24425%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=99] [21:13:41] : [Step 4/5] [2021-11-19 21:13:41,278][INFO ][reencrypt-#24466%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:13:41] : [Step 4/5] [2021-11-19 21:13:41,479][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10b6f63c-e31c-4573-a225-9f76f500c001, grp=1613773252] [21:13:41] : [Step 4/5] [2021-11-19 21:13:41,819][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint started [checkpointId=c57029f6-21b3-44c7-bb10-e149cfb6aa3c, startPtr=WALPointer [idx=15, fileOff=313806, len=2048], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=103ms, writeCheckpointEntryDuration=236ms, splitAndSortCpPagesDuration=0ms, pages=23, reason='test'] [21:13:41] : [Step 4/5] [2021-11-19 21:13:41,829][INFO ][db-checkpoint-thread-#24450%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:13:41] : [Step 4/5] [2021-11-19 21:13:41,830][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint finished [cpId=c57029f6-21b3-44c7-bb10-e149cfb6aa3c, pages=23, markPos=WALPointer [idx=15, fileOff=313806, len=2048], walSegmentsCovered=[], markDuration=340ms, pagesWrite=1ms, fsync=9ms, total=350ms] [21:13:41] : [Step 4/5] [2021-11-19 21:13:41,830][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00cce8f9-a2b3-4d32-a95a-7f6eb6335000, grp=1613773252] [21:13:41] : [Step 4/5] [2021-11-19 21:13:41,838][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint started [checkpointId=48b86ead-8e94-4c68-b965-a3fe2ae90b9c, startPtr=WALPointer [idx=15, fileOff=313768, len=2010], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=6ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=0ms, pages=23, reason='test'] [21:13:41] : [Step 4/5] [2021-11-19 21:13:41,848][INFO ][db-checkpoint-thread-#24445%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:13:41] : [Step 4/5] [2021-11-19 21:13:41,848][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint finished [cpId=48b86ead-8e94-4c68-b965-a3fe2ae90b9c, pages=23, markPos=WALPointer [idx=15, fileOff=313768, len=2010], walSegmentsCovered=[], markDuration=8ms, pagesWrite=1ms, fsync=8ms, total=17ms] [21:13:41] : [Step 4/5] [2021-11-19 21:13:41,853][INFO ][disco-notifier-worker-#24306%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=100] [21:13:41] : [Step 4/5] [2021-11-19 21:13:41,854][INFO ][reencrypt-#24467%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:13:41] : [Step 4/5] [2021-11-19 21:13:41,854][INFO ][disco-notifier-worker-#24425%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=100] [21:13:41] : [Step 4/5] [2021-11-19 21:13:41,854][INFO ][reencrypt-#24466%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:13:42] : [Step 4/5] [2021-11-19 21:13:42,055][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10b6f63c-e31c-4573-a225-9f76f500c001, grp=1613773252] [21:13:42] : [Step 4/5] [2021-11-19 21:13:42,059][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint started [checkpointId=41a1fa66-ff64-4d29-99ff-2c62115bd360, startPtr=WALPointer [idx=15, fileOff=500265, len=2048], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=1ms, writeCheckpointEntryDuration=2ms, splitAndSortCpPagesDuration=0ms, pages=23, reason='test'] [21:13:42] : [Step 4/5] [2021-11-19 21:13:42,068][INFO ][db-checkpoint-thread-#24450%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:13:42] : [Step 4/5] [2021-11-19 21:13:42,069][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint finished [cpId=41a1fa66-ff64-4d29-99ff-2c62115bd360, pages=23, markPos=WALPointer [idx=15, fileOff=500265, len=2048], walSegmentsCovered=[], markDuration=3ms, pagesWrite=1ms, fsync=9ms, total=13ms] [21:13:42] : [Step 4/5] [2021-11-19 21:13:42,069][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00cce8f9-a2b3-4d32-a95a-7f6eb6335000, grp=1613773252] [21:13:42] : [Step 4/5] [2021-11-19 21:13:42,078][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint started [checkpointId=0b047867-0023-437e-a72d-7aff9190f1aa, startPtr=WALPointer [idx=15, fileOff=500189, len=2010], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=7ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=0ms, pages=23, reason='test'] [21:13:42] : [Step 4/5] [2021-11-19 21:13:42,088][INFO ][db-checkpoint-thread-#24445%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:13:42] : [Step 4/5] [2021-11-19 21:13:42,088][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint finished [cpId=0b047867-0023-437e-a72d-7aff9190f1aa, pages=23, markPos=WALPointer [idx=15, fileOff=500189, len=2010], walSegmentsCovered=[], markDuration=9ms, pagesWrite=0ms, fsync=9ms, total=19ms] [21:13:42] : [Step 4/5] [2021-11-19 21:13:42,092][INFO ][disco-notifier-worker-#24306%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=101] [21:13:42] : [Step 4/5] [2021-11-19 21:13:42,093][INFO ][reencrypt-#24467%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:13:42] : [Step 4/5] [2021-11-19 21:13:42,093][INFO ][disco-notifier-worker-#24425%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=101] [21:13:42] : [Step 4/5] [2021-11-19 21:13:42,093][INFO ][reencrypt-#24466%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:13:42] : [Step 4/5] [2021-11-19 21:13:42,094][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10b6f63c-e31c-4573-a225-9f76f500c001, grp=1613773252] [21:13:42] : [Step 4/5] [2021-11-19 21:13:42,097][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint started [checkpointId=4109fb5a-52d4-4d08-bfd9-4a759f61c966, startPtr=WALPointer [idx=15, fileOff=683796, len=2048], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=1ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=0ms, pages=22, reason='test'] [21:13:42] : [Step 4/5] [2021-11-19 21:13:42,455][INFO ][db-checkpoint-thread-#24450%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:13:42] : [Step 4/5] [2021-11-19 21:13:42,456][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint finished [cpId=4109fb5a-52d4-4d08-bfd9-4a759f61c966, pages=22, markPos=WALPointer [idx=15, fileOff=683796, len=2048], walSegmentsCovered=[], markDuration=3ms, pagesWrite=1ms, fsync=357ms, total=361ms] [21:13:42] : [Step 4/5] [2021-11-19 21:13:42,456][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00cce8f9-a2b3-4d32-a95a-7f6eb6335000, grp=1613773252] [21:13:42] : [Step 4/5] [2021-11-19 21:13:42,466][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint started [checkpointId=5d85cc38-eb95-4da3-a755-71d272e7eb28, startPtr=WALPointer [idx=15, fileOff=683682, len=2010], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=7ms, writeCheckpointEntryDuration=2ms, splitAndSortCpPagesDuration=0ms, pages=22, reason='test'] [21:13:42] : [Step 4/5] [2021-11-19 21:13:42,475][INFO ][db-checkpoint-thread-#24445%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:13:42] : [Step 4/5] [2021-11-19 21:13:42,476][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint finished [cpId=5d85cc38-eb95-4da3-a755-71d272e7eb28, pages=22, markPos=WALPointer [idx=15, fileOff=683682, len=2010], walSegmentsCovered=[], markDuration=9ms, pagesWrite=1ms, fsync=9ms, total=20ms] [21:13:42] : [Step 4/5] [2021-11-19 21:13:42,480][INFO ][disco-notifier-worker-#24306%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=102] [21:13:42] : [Step 4/5] [2021-11-19 21:13:42,480][INFO ][disco-notifier-worker-#24425%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=102] [21:13:42] : [Step 4/5] [2021-11-19 21:13:42,481][INFO ][reencrypt-#24466%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:13:42] : [Step 4/5] [2021-11-19 21:13:42,481][INFO ][reencrypt-#24467%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:13:42] : [Step 4/5] [2021-11-19 21:13:42,682][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10b6f63c-e31c-4573-a225-9f76f500c001, grp=1613773252] [21:13:42] : [Step 4/5] [2021-11-19 21:13:42,891][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint started [checkpointId=9a986ebc-98ea-49d1-a7b7-9905b8156d09, startPtr=WALPointer [idx=15, fileOff=872825, len=2048], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=75ms, writeCheckpointEntryDuration=133ms, splitAndSortCpPagesDuration=0ms, pages=23, reason='test'] [21:13:42] : [Step 4/5] [2021-11-19 21:13:42,901][INFO ][db-checkpoint-thread-#24450%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:13:42] : [Step 4/5] [2021-11-19 21:13:42,901][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint finished [cpId=9a986ebc-98ea-49d1-a7b7-9905b8156d09, pages=23, markPos=WALPointer [idx=15, fileOff=872825, len=2048], walSegmentsCovered=[], markDuration=208ms, pagesWrite=1ms, fsync=9ms, total=219ms] [21:13:42] : [Step 4/5] [2021-11-19 21:13:42,901][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00cce8f9-a2b3-4d32-a95a-7f6eb6335000, grp=1613773252] [21:13:42] : [Step 4/5] [2021-11-19 21:13:42,909][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint started [checkpointId=891ca344-cbba-42db-b29e-c8cb9079a7b0, startPtr=WALPointer [idx=15, fileOff=872673, len=2010], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=5ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=0ms, pages=23, reason='test'] [21:13:42] : [Step 4/5] [2021-11-19 21:13:42,919][INFO ][db-checkpoint-thread-#24445%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:13:42] : [Step 4/5] [2021-11-19 21:13:42,919][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint finished [cpId=891ca344-cbba-42db-b29e-c8cb9079a7b0, pages=23, markPos=WALPointer [idx=15, fileOff=872673, len=2010], walSegmentsCovered=[], markDuration=8ms, pagesWrite=1ms, fsync=8ms, total=17ms] [21:13:42] : [Step 4/5] [2021-11-19 21:13:42,924][INFO ][disco-notifier-worker-#24306%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=103] [21:13:42] : [Step 4/5] [2021-11-19 21:13:42,925][INFO ][reencrypt-#24467%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:13:42] : [Step 4/5] [2021-11-19 21:13:42,925][INFO ][disco-notifier-worker-#24425%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=103] [21:13:42] : [Step 4/5] [2021-11-19 21:13:42,925][INFO ][reencrypt-#24466%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:13:42] : [Step 4/5] [2021-11-19 21:13:42,928][INFO ][wal-file-archiver%grid-0-#24437%grid-0%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=15, segIdx=5, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000005.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000015.wal] [21:13:42] : [Step 4/5] [2021-11-19 21:13:42,928][INFO ][wal-file-archiver%grid-1-#24440%grid-1%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=15, segIdx=5, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000005.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000015.wal] [21:13:42] : [Step 4/5] [2021-11-19 21:13:42,929][INFO ][wal-file-cleaner%grid-0-#24438%grid-0%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=6, currSize=10.0 MB, maxSize=20.0 MB] [21:13:42] : [Step 4/5] [2021-11-19 21:13:42,930][INFO ][wal-file-cleaner%grid-1-#24441%grid-1%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=6, currSize=10.0 MB, maxSize=20.0 MB] [21:13:42] : [Step 4/5] [2021-11-19 21:13:42,932][INFO ][wal-file-cleaner%grid-1-#24441%grid-1%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:13:42] : [Step 4/5] [2021-11-19 21:13:42,932][INFO ][wal-file-cleaner%grid-0-#24438%grid-0%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:13:42] : [Step 4/5] [2021-11-19 21:13:42,943][INFO ][wal-file-archiver%grid-1-#24440%grid-1%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000005.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000015.wal] [21:13:42] : [Step 4/5] [2021-11-19 21:13:42,943][INFO ][wal-file-archiver%grid-0-#24437%grid-0%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000005.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000015.wal] [21:13:43] : [Step 4/5] [2021-11-19 21:13:43,126][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10b6f63c-e31c-4573-a225-9f76f500c001, grp=1613773252] [21:13:43] : [Step 4/5] [2021-11-19 21:13:43,441][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint started [checkpointId=d098946b-71e4-4169-9304-a598269c246c, startPtr=WALPointer [idx=16, fileOff=19755, len=2048], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=107ms, writeCheckpointEntryDuration=207ms, splitAndSortCpPagesDuration=0ms, pages=22, reason='test'] [21:13:43] : [Step 4/5] [2021-11-19 21:13:43,608][INFO ][db-checkpoint-thread-#24450%grid-1%][GridEncryptionManager] Previous encryption keys were removed [grpId=1613773252, keyIds=[47, 48, 49, 50, 51, 52]] [21:13:43] : [Step 4/5] [2021-11-19 21:13:43,609][INFO ][db-checkpoint-thread-#24450%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:13:43] : [Step 4/5] [2021-11-19 21:13:43,609][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint finished [cpId=d098946b-71e4-4169-9304-a598269c246c, pages=22, markPos=WALPointer [idx=16, fileOff=19755, len=2048], walSegmentsCovered=[15], markDuration=314ms, pagesWrite=1ms, fsync=167ms, total=482ms] [21:13:43] : [Step 4/5] [2021-11-19 21:13:43,609][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00cce8f9-a2b3-4d32-a95a-7f6eb6335000, grp=1613773252] [21:13:43] : [Step 4/5] [2021-11-19 21:13:43,751][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint started [checkpointId=76a867d1-f0ae-4df3-a901-e9786b9b22ae, startPtr=WALPointer [idx=16, fileOff=15596, len=2010], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=64ms, writeCheckpointEntryDuration=76ms, splitAndSortCpPagesDuration=0ms, pages=22, reason='test'] [21:13:43] : [Step 4/5] [2021-11-19 21:13:43,764][INFO ][db-checkpoint-thread-#24445%grid-0%][GridEncryptionManager] Previous encryption keys were removed [grpId=1613773252, keyIds=[47, 48, 49, 50, 51, 52]] [21:13:43] : [Step 4/5] [2021-11-19 21:13:43,765][INFO ][db-checkpoint-thread-#24445%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:13:43] : [Step 4/5] [2021-11-19 21:13:43,765][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint finished [cpId=76a867d1-f0ae-4df3-a901-e9786b9b22ae, pages=22, markPos=WALPointer [idx=16, fileOff=15596, len=2010], walSegmentsCovered=[15], markDuration=141ms, pagesWrite=1ms, fsync=12ms, total=155ms] [21:13:43] : [Step 4/5] [2021-11-19 21:13:43,770][INFO ][disco-notifier-worker-#24306%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=104] [21:13:43] : [Step 4/5] [2021-11-19 21:13:43,771][INFO ][reencrypt-#24467%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:13:43] : [Step 4/5] [2021-11-19 21:13:43,771][INFO ][disco-notifier-worker-#24425%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=104] [21:13:43] : [Step 4/5] [2021-11-19 21:13:43,772][INFO ][reencrypt-#24466%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:13:43] : [Step 4/5] [2021-11-19 21:13:43,773][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10b6f63c-e31c-4573-a225-9f76f500c001, grp=1613773252] [21:13:43] : [Step 4/5] [2021-11-19 21:13:43,777][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint started [checkpointId=c6dc5ffa-be98-404e-b18e-9dac9373a20f, startPtr=WALPointer [idx=16, fileOff=249496, len=2048], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=0ms, writeCheckpointEntryDuration=2ms, splitAndSortCpPagesDuration=0ms, pages=24, reason='test'] [21:13:43] : [Step 4/5] [2021-11-19 21:13:43,786][INFO ][db-checkpoint-thread-#24450%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:13:43] : [Step 4/5] [2021-11-19 21:13:43,787][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint finished [cpId=c6dc5ffa-be98-404e-b18e-9dac9373a20f, pages=24, markPos=WALPointer [idx=16, fileOff=249496, len=2048], walSegmentsCovered=[], markDuration=4ms, pagesWrite=0ms, fsync=9ms, total=13ms] [21:13:43] : [Step 4/5] [2021-11-19 21:13:43,787][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00cce8f9-a2b3-4d32-a95a-7f6eb6335000, grp=1613773252] [21:13:43] : [Step 4/5] [2021-11-19 21:13:43,796][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint started [checkpointId=a12c7dd6-488c-4dff-802e-60ed382417b8, startPtr=WALPointer [idx=16, fileOff=245299, len=2010], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=6ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=0ms, pages=24, reason='test'] [21:13:43] : [Step 4/5] [2021-11-19 21:13:43,806][INFO ][db-checkpoint-thread-#24445%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:13:43] : [Step 4/5] [2021-11-19 21:13:43,806][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint finished [cpId=a12c7dd6-488c-4dff-802e-60ed382417b8, pages=24, markPos=WALPointer [idx=16, fileOff=245299, len=2010], walSegmentsCovered=[], markDuration=9ms, pagesWrite=1ms, fsync=8ms, total=18ms] [21:13:43] : [Step 4/5] [2021-11-19 21:13:43,813][INFO ][disco-notifier-worker-#24306%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=105] [21:13:43] : [Step 4/5] [2021-11-19 21:13:43,813][INFO ][disco-notifier-worker-#24425%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=105] [21:13:43] : [Step 4/5] [2021-11-19 21:13:43,813][INFO ][reencrypt-#24467%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:13:43] : [Step 4/5] [2021-11-19 21:13:43,813][INFO ][reencrypt-#24466%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:13:44] : [Step 4/5] [2021-11-19 21:13:44,015][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10b6f63c-e31c-4573-a225-9f76f500c001, grp=1613773252] [21:13:44] : [Step 4/5] [2021-11-19 21:13:44,195][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint started [checkpointId=c314b0be-47e3-480b-a9bd-ba7ef5bd34a1, startPtr=WALPointer [idx=16, fileOff=434074, len=2048], checkpointBeforeLockTime=0ms, checkpointLockWait=1ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=80ms, writeCheckpointEntryDuration=99ms, splitAndSortCpPagesDuration=0ms, pages=23, reason='test'] [21:13:44] : [Step 4/5] [2021-11-19 21:13:44,432][INFO ][db-checkpoint-thread-#24450%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:13:44] : [Step 4/5] [2021-11-19 21:13:44,433][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint finished [cpId=c314b0be-47e3-480b-a9bd-ba7ef5bd34a1, pages=23, markPos=WALPointer [idx=16, fileOff=434074, len=2048], walSegmentsCovered=[], markDuration=180ms, pagesWrite=1ms, fsync=235ms, total=417ms] [21:13:44] : [Step 4/5] [2021-11-19 21:13:44,433][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00cce8f9-a2b3-4d32-a95a-7f6eb6335000, grp=1613773252] [21:13:44] : [Step 4/5] [2021-11-19 21:13:44,441][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint started [checkpointId=38fda251-2aea-423d-8f77-3edfa92d2904, startPtr=WALPointer [idx=16, fileOff=429839, len=2010], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=6ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=0ms, pages=23, reason='test'] [21:13:44] : [Step 4/5] [2021-11-19 21:13:44,451][INFO ][db-checkpoint-thread-#24445%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:13:44] : [Step 4/5] [2021-11-19 21:13:44,451][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint finished [cpId=38fda251-2aea-423d-8f77-3edfa92d2904, pages=23, markPos=WALPointer [idx=16, fileOff=429839, len=2010], walSegmentsCovered=[], markDuration=8ms, pagesWrite=1ms, fsync=8ms, total=18ms] [21:13:44] : [Step 4/5] [2021-11-19 21:13:44,459][INFO ][disco-notifier-worker-#24306%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=106] [21:13:44] : [Step 4/5] [2021-11-19 21:13:44,459][INFO ][reencrypt-#24467%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:13:44] : [Step 4/5] [2021-11-19 21:13:44,459][INFO ][disco-notifier-worker-#24425%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=106] [21:13:44] : [Step 4/5] [2021-11-19 21:13:44,460][INFO ][reencrypt-#24466%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:13:44] : [Step 4/5] [2021-11-19 21:13:44,462][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10b6f63c-e31c-4573-a225-9f76f500c001, grp=1613773252] [21:13:44] : [Step 4/5] [2021-11-19 21:13:44,466][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint started [checkpointId=5f48d099-0c17-45e7-a706-d0a448612f02, startPtr=WALPointer [idx=16, fileOff=620533, len=2048], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=1ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=1ms, pages=23, reason='test'] [21:13:44] : [Step 4/5] [2021-11-19 21:13:44,475][INFO ][db-checkpoint-thread-#24450%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:13:44] : [Step 4/5] [2021-11-19 21:13:44,476][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint finished [cpId=5f48d099-0c17-45e7-a706-d0a448612f02, pages=23, markPos=WALPointer [idx=16, fileOff=620533, len=2048], walSegmentsCovered=[], markDuration=4ms, pagesWrite=0ms, fsync=9ms, total=14ms] [21:13:44] : [Step 4/5] [2021-11-19 21:13:44,476][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00cce8f9-a2b3-4d32-a95a-7f6eb6335000, grp=1613773252] [21:13:44] : [Step 4/5] [2021-11-19 21:13:44,485][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint started [checkpointId=eb88568e-3fc6-4a4e-a654-7ad417b738fb, startPtr=WALPointer [idx=16, fileOff=616260, len=2010], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=7ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=0ms, pages=23, reason='test'] [21:13:44] : [Step 4/5] [2021-11-19 21:13:44,495][INFO ][db-checkpoint-thread-#24445%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:13:44] : [Step 4/5] [2021-11-19 21:13:44,495][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint finished [cpId=eb88568e-3fc6-4a4e-a654-7ad417b738fb, pages=23, markPos=WALPointer [idx=16, fileOff=616260, len=2010], walSegmentsCovered=[], markDuration=9ms, pagesWrite=1ms, fsync=8ms, total=18ms] [21:13:44] : [Step 4/5] [2021-11-19 21:13:44,501][INFO ][disco-notifier-worker-#24306%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=107] [21:13:44] : [Step 4/5] [2021-11-19 21:13:44,502][INFO ][disco-notifier-worker-#24425%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=107] [21:13:44] : [Step 4/5] [2021-11-19 21:13:44,502][INFO ][reencrypt-#24467%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:13:44] : [Step 4/5] [2021-11-19 21:13:44,502][INFO ][reencrypt-#24466%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:13:44] : [Step 4/5] [2021-11-19 21:13:44,505][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10b6f63c-e31c-4573-a225-9f76f500c001, grp=1613773252] [21:13:44] : [Step 4/5] [2021-11-19 21:13:44,509][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint started [checkpointId=19f1d9fa-614c-4293-b464-ed370179de7e, startPtr=WALPointer [idx=16, fileOff=804064, len=2048], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=1ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=1ms, pages=22, reason='test'] [21:13:44] : [Step 4/5] [2021-11-19 21:13:44,518][INFO ][db-checkpoint-thread-#24450%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:13:44] : [Step 4/5] [2021-11-19 21:13:44,519][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint finished [cpId=19f1d9fa-614c-4293-b464-ed370179de7e, pages=22, markPos=WALPointer [idx=16, fileOff=804064, len=2048], walSegmentsCovered=[], markDuration=4ms, pagesWrite=0ms, fsync=9ms, total=14ms] [21:13:44] : [Step 4/5] [2021-11-19 21:13:44,519][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00cce8f9-a2b3-4d32-a95a-7f6eb6335000, grp=1613773252] [21:13:44] : [Step 4/5] [2021-11-19 21:13:44,528][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint started [checkpointId=96b0886b-a72b-4128-a7b3-ce9bcbef036d, startPtr=WALPointer [idx=16, fileOff=799753, len=2010], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=6ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=0ms, pages=22, reason='test'] [21:13:44] : [Step 4/5] [2021-11-19 21:13:44,634][INFO ][db-checkpoint-thread-#24445%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:13:44] : [Step 4/5] [2021-11-19 21:13:44,635][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint finished [cpId=96b0886b-a72b-4128-a7b3-ce9bcbef036d, pages=22, markPos=WALPointer [idx=16, fileOff=799753, len=2010], walSegmentsCovered=[], markDuration=9ms, pagesWrite=1ms, fsync=105ms, total=115ms] [21:13:44] : [Step 4/5] [2021-11-19 21:13:44,641][INFO ][disco-notifier-worker-#24306%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=108] [21:13:44] : [Step 4/5] [2021-11-19 21:13:44,641][INFO ][disco-notifier-worker-#24425%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=108] [21:13:44] : [Step 4/5] [2021-11-19 21:13:44,642][INFO ][reencrypt-#24467%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:13:44] : [Step 4/5] [2021-11-19 21:13:44,642][INFO ][reencrypt-#24466%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:13:44] : [Step 4/5] [2021-11-19 21:13:44,843][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10b6f63c-e31c-4573-a225-9f76f500c001, grp=1613773252] [21:13:44] : [Step 4/5] [2021-11-19 21:13:44,983][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint started [checkpointId=96e1ab84-6861-4f00-993e-021d8cd8deac, startPtr=WALPointer [idx=16, fileOff=993093, len=2048], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=21ms, writeCheckpointEntryDuration=117ms, splitAndSortCpPagesDuration=0ms, pages=23, reason='test'] [21:13:45] : [Step 4/5] [2021-11-19 21:13:45,228][INFO ][db-checkpoint-thread-#24450%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:13:45] : [Step 4/5] [2021-11-19 21:13:45,229][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint finished [cpId=96e1ab84-6861-4f00-993e-021d8cd8deac, pages=23, markPos=WALPointer [idx=16, fileOff=993093, len=2048], walSegmentsCovered=[], markDuration=140ms, pagesWrite=0ms, fsync=245ms, total=385ms] [21:13:45] : [Step 4/5] [2021-11-19 21:13:45,229][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00cce8f9-a2b3-4d32-a95a-7f6eb6335000, grp=1613773252] [21:13:45] : [Step 4/5] [2021-11-19 21:13:45,237][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint started [checkpointId=97730be3-39e4-4518-b9ff-73d1dfe507b2, startPtr=WALPointer [idx=16, fileOff=988744, len=2010], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=5ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=0ms, pages=23, reason='test'] [21:13:45] : [Step 4/5] [2021-11-19 21:13:45,247][INFO ][db-checkpoint-thread-#24445%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:13:45] : [Step 4/5] [2021-11-19 21:13:45,247][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint finished [cpId=97730be3-39e4-4518-b9ff-73d1dfe507b2, pages=23, markPos=WALPointer [idx=16, fileOff=988744, len=2010], walSegmentsCovered=[], markDuration=8ms, pagesWrite=1ms, fsync=8ms, total=17ms] [21:13:45] : [Step 4/5] [2021-11-19 21:13:45,255][INFO ][wal-file-archiver%grid-1-#24440%grid-1%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=16, segIdx=6, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000006.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000016.wal] [21:13:45] : [Step 4/5] [2021-11-19 21:13:45,255][INFO ][wal-file-archiver%grid-0-#24437%grid-0%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=16, segIdx=6, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000006.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000016.wal] [21:13:45] : [Step 4/5] [2021-11-19 21:13:45,256][INFO ][wal-file-cleaner%grid-1-#24441%grid-1%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=7, currSize=10.0 MB, maxSize=20.0 MB] [21:13:45] : [Step 4/5] [2021-11-19 21:13:45,257][INFO ][wal-file-cleaner%grid-0-#24438%grid-0%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=7, currSize=10.0 MB, maxSize=20.0 MB] [21:13:45] : [Step 4/5] [2021-11-19 21:13:45,259][INFO ][disco-notifier-worker-#24306%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=109] [21:13:45] : [Step 4/5] [2021-11-19 21:13:45,259][INFO ][reencrypt-#24467%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:13:45] : [Step 4/5] [2021-11-19 21:13:45,259][INFO ][wal-file-cleaner%grid-1-#24441%grid-1%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:13:45] : [Step 4/5] [2021-11-19 21:13:45,259][INFO ][disco-notifier-worker-#24425%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=109] [21:13:45] : [Step 4/5] [2021-11-19 21:13:45,259][INFO ][wal-file-cleaner%grid-0-#24438%grid-0%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:13:45] : [Step 4/5] [2021-11-19 21:13:45,260][INFO ][reencrypt-#24466%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:13:45] : [Step 4/5] [2021-11-19 21:13:45,272][INFO ][wal-file-archiver%grid-1-#24440%grid-1%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000006.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000016.wal] [21:13:45] : [Step 4/5] [2021-11-19 21:13:45,272][INFO ][wal-file-archiver%grid-0-#24437%grid-0%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000006.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000016.wal] [21:13:45] : [Step 4/5] [2021-11-19 21:13:45,461][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10b6f63c-e31c-4573-a225-9f76f500c001, grp=1613773252] [21:13:45] : [Step 4/5] [2021-11-19 21:13:45,703][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint started [checkpointId=ee51f4f9-c41c-4b7c-86af-550f204ddebb, startPtr=WALPointer [idx=17, fileOff=138174, len=2048], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=68ms, writeCheckpointEntryDuration=173ms, splitAndSortCpPagesDuration=0ms, pages=22, reason='test'] [21:13:46] : [Step 4/5] [2021-11-19 21:13:46,028][INFO ][db-checkpoint-thread-#24450%grid-1%][GridEncryptionManager] Previous encryption keys were removed [grpId=1613773252, keyIds=[53, 54, 55, 56, 57, 58]] [21:13:46] : [Step 4/5] [2021-11-19 21:13:46,029][INFO ][db-checkpoint-thread-#24450%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:13:46] : [Step 4/5] [2021-11-19 21:13:46,029][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint finished [cpId=ee51f4f9-c41c-4b7c-86af-550f204ddebb, pages=22, markPos=WALPointer [idx=17, fileOff=138174, len=2048], walSegmentsCovered=[16], markDuration=242ms, pagesWrite=1ms, fsync=324ms, total=568ms] [21:13:46] : [Step 4/5] [2021-11-19 21:13:46,029][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00cce8f9-a2b3-4d32-a95a-7f6eb6335000, grp=1613773252] [21:13:46] : [Step 4/5] [2021-11-19 21:13:46,036][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint started [checkpointId=9a33b449-dd9d-47e3-9397-4923337102d1, startPtr=WALPointer [idx=17, fileOff=134045, len=2010], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=3ms, writeCheckpointEntryDuration=2ms, splitAndSortCpPagesDuration=0ms, pages=22, reason='test'] [21:13:46] : [Step 4/5] [2021-11-19 21:13:46,048][INFO ][db-checkpoint-thread-#24445%grid-0%][GridEncryptionManager] Previous encryption keys were removed [grpId=1613773252, keyIds=[53, 54, 55, 56, 57, 58]] [21:13:46] : [Step 4/5] [2021-11-19 21:13:46,049][INFO ][db-checkpoint-thread-#24445%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:13:46] : [Step 4/5] [2021-11-19 21:13:46,049][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint finished [cpId=9a33b449-dd9d-47e3-9397-4923337102d1, pages=22, markPos=WALPointer [idx=17, fileOff=134045, len=2010], walSegmentsCovered=[16], markDuration=5ms, pagesWrite=1ms, fsync=12ms, total=19ms] [21:13:46] : [Step 4/5] [2021-11-19 21:13:46,055][INFO ][disco-notifier-worker-#24306%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=110] [21:13:46] : [Step 4/5] [2021-11-19 21:13:46,055][INFO ][disco-notifier-worker-#24425%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=110] [21:13:46] : [Step 4/5] [2021-11-19 21:13:46,055][INFO ][reencrypt-#24467%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:13:46] : [Step 4/5] [2021-11-19 21:13:46,055][INFO ][reencrypt-#24466%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:13:46] : [Step 4/5] [2021-11-19 21:13:46,257][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10b6f63c-e31c-4573-a225-9f76f500c001, grp=1613773252] [21:13:46] : [Step 4/5] [2021-11-19 21:13:46,474][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint started [checkpointId=84ee7634-1a1e-4946-911c-655d174ec990, startPtr=WALPointer [idx=17, fileOff=367915, len=2048], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=111ms, writeCheckpointEntryDuration=104ms, splitAndSortCpPagesDuration=0ms, pages=24, reason='test'] [21:13:46] : [Step 4/5] [2021-11-19 21:13:46,515][INFO ][db-checkpoint-thread-#24450%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:13:46] : [Step 4/5] [2021-11-19 21:13:46,516][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint finished [cpId=84ee7634-1a1e-4946-911c-655d174ec990, pages=24, markPos=WALPointer [idx=17, fileOff=367915, len=2048], walSegmentsCovered=[], markDuration=217ms, pagesWrite=1ms, fsync=41ms, total=259ms] [21:13:46] : [Step 4/5] [2021-11-19 21:13:46,516][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00cce8f9-a2b3-4d32-a95a-7f6eb6335000, grp=1613773252] [21:13:46] : [Step 4/5] [2021-11-19 21:13:46,809][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint started [checkpointId=f6aa1200-d557-4d99-b5eb-c08a61f04d3c, startPtr=WALPointer [idx=17, fileOff=363748, len=2010], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=66ms, writeCheckpointEntryDuration=226ms, splitAndSortCpPagesDuration=0ms, pages=24, reason='test'] [21:13:46] : [Step 4/5] [2021-11-19 21:13:46,843][INFO ][db-checkpoint-thread-#24445%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:13:46] : [Step 4/5] [2021-11-19 21:13:46,843][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint finished [cpId=f6aa1200-d557-4d99-b5eb-c08a61f04d3c, pages=24, markPos=WALPointer [idx=17, fileOff=363748, len=2010], walSegmentsCovered=[], markDuration=293ms, pagesWrite=0ms, fsync=33ms, total=326ms] [21:13:46] : [Step 4/5] [2021-11-19 21:13:46,848][INFO ][disco-notifier-worker-#24425%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=111] [21:13:46] : [Step 4/5] [2021-11-19 21:13:46,848][INFO ][disco-notifier-worker-#24306%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=111] [21:13:46] : [Step 4/5] [2021-11-19 21:13:46,848][INFO ][reencrypt-#24466%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:13:46] : [Step 4/5] [2021-11-19 21:13:46,849][INFO ][reencrypt-#24467%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:13:47] : [Step 4/5] [2021-11-19 21:13:47,050][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10b6f63c-e31c-4573-a225-9f76f500c001, grp=1613773252] [21:13:47] : [Step 4/5] [2021-11-19 21:13:47,158][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint started [checkpointId=5334048e-0324-4a45-9ecc-bfb68abed283, startPtr=WALPointer [idx=17, fileOff=552493, len=2048], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=1ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=0ms, writeCheckpointEntryDuration=107ms, splitAndSortCpPagesDuration=0ms, pages=23, reason='test'] [21:13:47] : [Step 4/5] [2021-11-19 21:13:47,395][INFO ][db-checkpoint-thread-#24450%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:13:47] : [Step 4/5] [2021-11-19 21:13:47,396][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint finished [cpId=5334048e-0324-4a45-9ecc-bfb68abed283, pages=23, markPos=WALPointer [idx=17, fileOff=552493, len=2048], walSegmentsCovered=[], markDuration=109ms, pagesWrite=1ms, fsync=236ms, total=346ms] [21:13:47] : [Step 4/5] [2021-11-19 21:13:47,396][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00cce8f9-a2b3-4d32-a95a-7f6eb6335000, grp=1613773252] [21:13:47] : [Step 4/5] [2021-11-19 21:13:47,641][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint started [checkpointId=8de527bd-1eb7-4952-a4a4-b68aa553eaf0, startPtr=WALPointer [idx=17, fileOff=548288, len=2010], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=93ms, writeCheckpointEntryDuration=151ms, splitAndSortCpPagesDuration=0ms, pages=23, reason='test'] [21:13:47] : [Step 4/5] [2021-11-19 21:13:47,668][INFO ][db-checkpoint-thread-#24445%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:13:47] : [Step 4/5] [2021-11-19 21:13:47,668][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint finished [cpId=8de527bd-1eb7-4952-a4a4-b68aa553eaf0, pages=23, markPos=WALPointer [idx=17, fileOff=548288, len=2010], walSegmentsCovered=[], markDuration=245ms, pagesWrite=0ms, fsync=26ms, total=271ms] [21:13:47] : [Step 4/5] [2021-11-19 21:13:47,673][INFO ][disco-notifier-worker-#24306%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=112] [21:13:47] : [Step 4/5] [2021-11-19 21:13:47,673][INFO ][reencrypt-#24467%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:13:47] : [Step 4/5] [2021-11-19 21:13:47,674][INFO ][disco-notifier-worker-#24425%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=112] [21:13:47] : [Step 4/5] [2021-11-19 21:13:47,674][INFO ][reencrypt-#24466%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:13:47]W: [org.apache.ignite:ignite-core] [2021-11-19 21:13:47,726][WARN ][tcp-disco-ip-finder-cleaner-#1275%grid-0%-#24309%grid-0%][TestTcpDiscoverySpi] Failed to ping node [nodeId=null]. Reached the timeout 10000ms. Cause: Connection refused (Connection refused) [21:13:47] : [Step 4/5] [2021-11-19 21:13:47,875][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10b6f63c-e31c-4573-a225-9f76f500c001, grp=1613773252] [21:13:48] : [Step 4/5] [2021-11-19 21:13:48,087][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint started [checkpointId=5bbad407-738f-4c70-a049-d648c39f26fd, startPtr=WALPointer [idx=17, fileOff=738952, len=2048], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=1ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=204ms, writeCheckpointEntryDuration=6ms, splitAndSortCpPagesDuration=0ms, pages=23, reason='test'] [21:13:48] : [Step 4/5] [2021-11-19 21:13:48,098][INFO ][db-checkpoint-thread-#24450%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:13:48] : [Step 4/5] [2021-11-19 21:13:48,098][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint finished [cpId=5bbad407-738f-4c70-a049-d648c39f26fd, pages=23, markPos=WALPointer [idx=17, fileOff=738952, len=2048], walSegmentsCovered=[], markDuration=212ms, pagesWrite=1ms, fsync=9ms, total=222ms] [21:13:48] : [Step 4/5] [2021-11-19 21:13:48,098][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00cce8f9-a2b3-4d32-a95a-7f6eb6335000, grp=1613773252] [21:13:48] : [Step 4/5] [2021-11-19 21:13:48,107][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint started [checkpointId=5ec3c04e-37f1-4e1d-8357-6ccb62acd819, startPtr=WALPointer [idx=17, fileOff=734709, len=2010], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=6ms, writeCheckpointEntryDuration=2ms, splitAndSortCpPagesDuration=0ms, pages=23, reason='test'] [21:13:48] : [Step 4/5] [2021-11-19 21:13:48,116][INFO ][db-checkpoint-thread-#24445%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:13:48] : [Step 4/5] [2021-11-19 21:13:48,117][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint finished [cpId=5ec3c04e-37f1-4e1d-8357-6ccb62acd819, pages=23, markPos=WALPointer [idx=17, fileOff=734709, len=2010], walSegmentsCovered=[], markDuration=8ms, pagesWrite=1ms, fsync=8ms, total=17ms] [21:13:48] : [Step 4/5] [2021-11-19 21:13:48,121][INFO ][disco-notifier-worker-#24425%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=113] [21:13:48] : [Step 4/5] [2021-11-19 21:13:48,121][INFO ][disco-notifier-worker-#24306%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=113] [21:13:48] : [Step 4/5] [2021-11-19 21:13:48,121][INFO ][reencrypt-#24466%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:13:48] : [Step 4/5] [2021-11-19 21:13:48,122][INFO ][reencrypt-#24467%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:13:48] : [Step 4/5] [2021-11-19 21:13:48,323][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10b6f63c-e31c-4573-a225-9f76f500c001, grp=1613773252] [21:13:48] : [Step 4/5] [2021-11-19 21:13:48,531][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint started [checkpointId=a1c90e1e-5bdd-4e7b-b60e-a22514df1e2f, startPtr=WALPointer [idx=17, fileOff=922483, len=2048], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=1ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=113ms, writeCheckpointEntryDuration=93ms, splitAndSortCpPagesDuration=1ms, pages=22, reason='test'] [21:13:48] : [Step 4/5] [2021-11-19 21:13:48,540][INFO ][db-checkpoint-thread-#24450%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:13:48] : [Step 4/5] [2021-11-19 21:13:48,541][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint finished [cpId=a1c90e1e-5bdd-4e7b-b60e-a22514df1e2f, pages=22, markPos=WALPointer [idx=17, fileOff=922483, len=2048], walSegmentsCovered=[], markDuration=208ms, pagesWrite=1ms, fsync=9ms, total=218ms] [21:13:48] : [Step 4/5] [2021-11-19 21:13:48,541][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00cce8f9-a2b3-4d32-a95a-7f6eb6335000, grp=1613773252] [21:13:48] : [Step 4/5] [2021-11-19 21:13:48,550][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint started [checkpointId=84536aa7-9b08-4a65-8799-b01f58d6d700, startPtr=WALPointer [idx=17, fileOff=918202, len=2010], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=7ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=0ms, pages=22, reason='test'] [21:13:48] : [Step 4/5] [2021-11-19 21:13:48,560][INFO ][db-checkpoint-thread-#24445%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:13:48] : [Step 4/5] [2021-11-19 21:13:48,560][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint finished [cpId=84536aa7-9b08-4a65-8799-b01f58d6d700, pages=22, markPos=WALPointer [idx=17, fileOff=918202, len=2010], walSegmentsCovered=[], markDuration=9ms, pagesWrite=1ms, fsync=8ms, total=18ms] [21:13:48] : [Step 4/5] [2021-11-19 21:13:48,569][INFO ][wal-file-archiver%grid-1-#24440%grid-1%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=17, segIdx=7, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000007.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000017.wal] [21:13:48] : [Step 4/5] [2021-11-19 21:13:48,569][INFO ][wal-file-archiver%grid-0-#24437%grid-0%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=17, segIdx=7, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000007.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000017.wal] [21:13:48] : [Step 4/5] [2021-11-19 21:13:48,570][INFO ][wal-file-cleaner%grid-1-#24441%grid-1%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=8, currSize=10.0 MB, maxSize=20.0 MB] [21:13:48] : [Step 4/5] [2021-11-19 21:13:48,571][INFO ][wal-file-cleaner%grid-0-#24438%grid-0%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=8, currSize=10.0 MB, maxSize=20.0 MB] [21:13:48] : [Step 4/5] [2021-11-19 21:13:48,570][INFO ][disco-notifier-worker-#24425%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=114] [21:13:48] : [Step 4/5] [2021-11-19 21:13:48,570][INFO ][disco-notifier-worker-#24306%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=114] [21:13:48] : [Step 4/5] [2021-11-19 21:13:48,572][INFO ][reencrypt-#24466%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:13:48] : [Step 4/5] [2021-11-19 21:13:48,572][INFO ][reencrypt-#24467%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:13:48] : [Step 4/5] [2021-11-19 21:13:48,573][INFO ][wal-file-cleaner%grid-0-#24438%grid-0%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:13:48] : [Step 4/5] [2021-11-19 21:13:48,573][INFO ][wal-file-cleaner%grid-1-#24441%grid-1%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:13:48] : [Step 4/5] [2021-11-19 21:13:48,596][INFO ][wal-file-archiver%grid-0-#24437%grid-0%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000007.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000017.wal] [21:13:48] : [Step 4/5] [2021-11-19 21:13:48,596][INFO ][wal-file-archiver%grid-1-#24440%grid-1%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000007.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000017.wal] [21:13:48] : [Step 4/5] [2021-11-19 21:13:48,773][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10b6f63c-e31c-4573-a225-9f76f500c001, grp=1613773252] [21:13:48] : [Step 4/5] [2021-11-19 21:13:48,780][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint started [checkpointId=364adc8d-e77a-45ec-ba3b-2f522cd662ee, startPtr=WALPointer [idx=18, fileOff=81504, len=2048], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=5ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=0ms, pages=23, reason='test'] [21:13:48] : [Step 4/5] [2021-11-19 21:13:48,792][INFO ][db-checkpoint-thread-#24450%grid-1%][GridEncryptionManager] Previous encryption keys were removed [grpId=1613773252, keyIds=[59, 60, 61, 62, 63]] [21:13:48] : [Step 4/5] [2021-11-19 21:13:48,792][INFO ][db-checkpoint-thread-#24450%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:13:48] : [Step 4/5] [2021-11-19 21:13:48,792][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint finished [cpId=364adc8d-e77a-45ec-ba3b-2f522cd662ee, pages=23, markPos=WALPointer [idx=18, fileOff=81504, len=2048], walSegmentsCovered=[17], markDuration=7ms, pagesWrite=0ms, fsync=11ms, total=19ms] [21:13:48] : [Step 4/5] [2021-11-19 21:13:48,793][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00cce8f9-a2b3-4d32-a95a-7f6eb6335000, grp=1613773252] [21:13:48] : [Step 4/5] [2021-11-19 21:13:48,799][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint started [checkpointId=d1f41bba-b394-4d5b-84b7-306aa4aecfce, startPtr=WALPointer [idx=18, fileOff=81504, len=2010], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=4ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=0ms, pages=23, reason='test'] [21:13:48] : [Step 4/5] [2021-11-19 21:13:48,811][INFO ][db-checkpoint-thread-#24445%grid-0%][GridEncryptionManager] Previous encryption keys were removed [grpId=1613773252, keyIds=[59, 60, 61, 62, 63]] [21:13:48] : [Step 4/5] [2021-11-19 21:13:48,811][INFO ][db-checkpoint-thread-#24445%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:13:48] : [Step 4/5] [2021-11-19 21:13:48,811][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint finished [cpId=d1f41bba-b394-4d5b-84b7-306aa4aecfce, pages=23, markPos=WALPointer [idx=18, fileOff=81504, len=2010], walSegmentsCovered=[17], markDuration=6ms, pagesWrite=1ms, fsync=10ms, total=18ms] [21:13:48] : [Step 4/5] [2021-11-19 21:13:48,816][INFO ][disco-notifier-worker-#24306%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=115] [21:13:48] : [Step 4/5] [2021-11-19 21:13:48,816][INFO ][reencrypt-#24467%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:13:48] : [Step 4/5] [2021-11-19 21:13:48,816][INFO ][disco-notifier-worker-#24425%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=115] [21:13:48] : [Step 4/5] [2021-11-19 21:13:48,817][INFO ][reencrypt-#24466%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:13:49] : [Step 4/5] [2021-11-19 21:13:49,018][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10b6f63c-e31c-4573-a225-9f76f500c001, grp=1613773252] [21:13:49] : [Step 4/5] [2021-11-19 21:13:49,022][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint started [checkpointId=ec3a741f-64ee-4e9e-8b95-83b487935974, startPtr=WALPointer [idx=18, fileOff=318106, len=2048], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=1ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=0ms, pages=26, reason='test'] [21:13:49] : [Step 4/5] [2021-11-19 21:13:49,031][INFO ][db-checkpoint-thread-#24450%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:13:49] : [Step 4/5] [2021-11-19 21:13:49,031][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint finished [cpId=ec3a741f-64ee-4e9e-8b95-83b487935974, pages=26, markPos=WALPointer [idx=18, fileOff=318106, len=2048], walSegmentsCovered=[], markDuration=3ms, pagesWrite=1ms, fsync=8ms, total=13ms] [21:13:49] : [Step 4/5] [2021-11-19 21:13:49,032][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00cce8f9-a2b3-4d32-a95a-7f6eb6335000, grp=1613773252] [21:13:49] : [Step 4/5] [2021-11-19 21:13:49,041][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint started [checkpointId=216c3a2a-1ffd-4b57-b036-f32f3fb76133, startPtr=WALPointer [idx=18, fileOff=318068, len=2010], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=7ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=0ms, pages=26, reason='test'] [21:13:49] : [Step 4/5] [2021-11-19 21:13:49,051][INFO ][db-checkpoint-thread-#24445%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:13:49] : [Step 4/5] [2021-11-19 21:13:49,051][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint finished [cpId=216c3a2a-1ffd-4b57-b036-f32f3fb76133, pages=26, markPos=WALPointer [idx=18, fileOff=318068, len=2010], walSegmentsCovered=[], markDuration=8ms, pagesWrite=1ms, fsync=9ms, total=19ms] [21:13:49] : [Step 4/5] [2021-11-19 21:13:49,056][INFO ][disco-notifier-worker-#24306%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=116] [21:13:49] : [Step 4/5] [2021-11-19 21:13:49,057][INFO ][reencrypt-#24467%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:13:49] : [Step 4/5] [2021-11-19 21:13:49,057][INFO ][disco-notifier-worker-#24425%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=116] [21:13:49] : [Step 4/5] [2021-11-19 21:13:49,057][INFO ][reencrypt-#24466%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:13:49] : [Step 4/5] [2021-11-19 21:13:49,258][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10b6f63c-e31c-4573-a225-9f76f500c001, grp=1613773252] [21:13:49] : [Step 4/5] [2021-11-19 21:13:49,261][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint started [checkpointId=2a0e9638-d4ab-494e-9b29-531e76a2d03e, startPtr=WALPointer [idx=18, fileOff=502684, len=2048], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=1ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=0ms, pages=23, reason='test'] [21:13:49] : [Step 4/5] [2021-11-19 21:13:49,270][INFO ][db-checkpoint-thread-#24450%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:13:49] : [Step 4/5] [2021-11-19 21:13:49,271][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint finished [cpId=2a0e9638-d4ab-494e-9b29-531e76a2d03e, pages=23, markPos=WALPointer [idx=18, fileOff=502684, len=2048], walSegmentsCovered=[], markDuration=2ms, pagesWrite=1ms, fsync=9ms, total=12ms] [21:13:49] : [Step 4/5] [2021-11-19 21:13:49,271][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00cce8f9-a2b3-4d32-a95a-7f6eb6335000, grp=1613773252] [21:13:49] : [Step 4/5] [2021-11-19 21:13:49,279][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint started [checkpointId=74bdbeee-ea7f-49ac-90c4-f14a28023714, startPtr=WALPointer [idx=18, fileOff=502608, len=2010], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=6ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=0ms, pages=23, reason='test'] [21:13:49] : [Step 4/5] [2021-11-19 21:13:49,289][INFO ][db-checkpoint-thread-#24445%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:13:49] : [Step 4/5] [2021-11-19 21:13:49,289][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint finished [cpId=74bdbeee-ea7f-49ac-90c4-f14a28023714, pages=23, markPos=WALPointer [idx=18, fileOff=502608, len=2010], walSegmentsCovered=[], markDuration=8ms, pagesWrite=1ms, fsync=8ms, total=17ms] [21:13:49] : [Step 4/5] [2021-11-19 21:13:49,294][INFO ][disco-notifier-worker-#24306%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=117] [21:13:49] : [Step 4/5] [2021-11-19 21:13:49,294][INFO ][reencrypt-#24467%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:13:49] : [Step 4/5] [2021-11-19 21:13:49,294][INFO ][disco-notifier-worker-#24425%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=117] [21:13:49] : [Step 4/5] [2021-11-19 21:13:49,294][INFO ][reencrypt-#24466%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:13:49] : [Step 4/5] [2021-11-19 21:13:49,495][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10b6f63c-e31c-4573-a225-9f76f500c001, grp=1613773252] [21:13:49] : [Step 4/5] [2021-11-19 21:13:49,717][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint started [checkpointId=4c25d73b-effe-4a4f-a7e2-f333a0007aea, startPtr=WALPointer [idx=18, fileOff=689143, len=2048], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=93ms, writeCheckpointEntryDuration=127ms, splitAndSortCpPagesDuration=0ms, pages=23, reason='test'] [21:13:49] : [Step 4/5] [2021-11-19 21:13:49,728][INFO ][db-checkpoint-thread-#24450%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:13:49] : [Step 4/5] [2021-11-19 21:13:49,728][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint finished [cpId=4c25d73b-effe-4a4f-a7e2-f333a0007aea, pages=23, markPos=WALPointer [idx=18, fileOff=689143, len=2048], walSegmentsCovered=[], markDuration=222ms, pagesWrite=0ms, fsync=10ms, total=232ms] [21:13:49] : [Step 4/5] [2021-11-19 21:13:49,728][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00cce8f9-a2b3-4d32-a95a-7f6eb6335000, grp=1613773252] [21:13:49] : [Step 4/5] [2021-11-19 21:13:49,737][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint started [checkpointId=2870001d-6ec0-4ac5-b4d8-99fd827d4cd2, startPtr=WALPointer [idx=18, fileOff=689029, len=2010], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=6ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=0ms, pages=23, reason='test'] [21:13:49] : [Step 4/5] [2021-11-19 21:13:49,746][INFO ][db-checkpoint-thread-#24445%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:13:49] : [Step 4/5] [2021-11-19 21:13:49,747][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint finished [cpId=2870001d-6ec0-4ac5-b4d8-99fd827d4cd2, pages=23, markPos=WALPointer [idx=18, fileOff=689029, len=2010], walSegmentsCovered=[], markDuration=9ms, pagesWrite=0ms, fsync=9ms, total=18ms] [21:13:49] : [Step 4/5] [2021-11-19 21:13:49,752][INFO ][disco-notifier-worker-#24306%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=118] [21:13:49] : [Step 4/5] [2021-11-19 21:13:49,752][INFO ][reencrypt-#24467%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:13:49] : [Step 4/5] [2021-11-19 21:13:49,752][INFO ][disco-notifier-worker-#24425%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=118] [21:13:49] : [Step 4/5] [2021-11-19 21:13:49,753][INFO ][reencrypt-#24466%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:13:49] : [Step 4/5] [2021-11-19 21:13:49,954][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10b6f63c-e31c-4573-a225-9f76f500c001, grp=1613773252] [21:13:50] : [Step 4/5] [2021-11-19 21:13:50,122][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint started [checkpointId=da6b0898-423f-4616-892e-1f72cf542990, startPtr=WALPointer [idx=18, fileOff=872674, len=2048], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=90ms, writeCheckpointEntryDuration=77ms, splitAndSortCpPagesDuration=0ms, pages=22, reason='test'] [21:13:50] : [Step 4/5] [2021-11-19 21:13:50,247][INFO ][db-checkpoint-thread-#24450%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:13:50] : [Step 4/5] [2021-11-19 21:13:50,248][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint finished [cpId=da6b0898-423f-4616-892e-1f72cf542990, pages=22, markPos=WALPointer [idx=18, fileOff=872674, len=2048], walSegmentsCovered=[], markDuration=168ms, pagesWrite=1ms, fsync=124ms, total=294ms] [21:13:50] : [Step 4/5] [2021-11-19 21:13:50,248][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00cce8f9-a2b3-4d32-a95a-7f6eb6335000, grp=1613773252] [21:13:50] : [Step 4/5] [2021-11-19 21:13:50,256][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint started [checkpointId=95884fc4-9c31-4951-996b-e0268d81f150, startPtr=WALPointer [idx=18, fileOff=872522, len=2010], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=1ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=5ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=0ms, pages=22, reason='test'] [21:13:50] : [Step 4/5] [2021-11-19 21:13:50,266][INFO ][db-checkpoint-thread-#24445%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:13:50] : [Step 4/5] [2021-11-19 21:13:50,266][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint finished [cpId=95884fc4-9c31-4951-996b-e0268d81f150, pages=22, markPos=WALPointer [idx=18, fileOff=872522, len=2010], walSegmentsCovered=[], markDuration=8ms, pagesWrite=1ms, fsync=8ms, total=17ms] [21:13:50] : [Step 4/5] [2021-11-19 21:13:50,271][INFO ][disco-notifier-worker-#24306%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=119] [21:13:50] : [Step 4/5] [2021-11-19 21:13:50,272][INFO ][reencrypt-#24467%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:13:50] : [Step 4/5] [2021-11-19 21:13:50,272][INFO ][disco-notifier-worker-#24425%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=119] [21:13:50] : [Step 4/5] [2021-11-19 21:13:50,272][INFO ][reencrypt-#24466%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:13:50] : [Step 4/5] [2021-11-19 21:13:50,275][INFO ][wal-file-archiver%grid-1-#24440%grid-1%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=18, segIdx=8, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000008.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000018.wal] [21:13:50] : [Step 4/5] [2021-11-19 21:13:50,276][INFO ][wal-file-archiver%grid-0-#24437%grid-0%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=18, segIdx=8, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000008.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000018.wal] [21:13:50] : [Step 4/5] [2021-11-19 21:13:50,276][INFO ][wal-file-cleaner%grid-1-#24441%grid-1%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=9, currSize=10.0 MB, maxSize=20.0 MB] [21:13:50] : [Step 4/5] [2021-11-19 21:13:50,277][INFO ][wal-file-cleaner%grid-0-#24438%grid-0%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=9, currSize=10.0 MB, maxSize=20.0 MB] [21:13:50] : [Step 4/5] [2021-11-19 21:13:50,279][INFO ][wal-file-cleaner%grid-1-#24441%grid-1%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:13:50] : [Step 4/5] [2021-11-19 21:13:50,279][INFO ][wal-file-cleaner%grid-0-#24438%grid-0%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:13:50] : [Step 4/5] [2021-11-19 21:13:50,290][INFO ][wal-file-archiver%grid-1-#24440%grid-1%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000008.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000018.wal] [21:13:50] : [Step 4/5] [2021-11-19 21:13:50,290][INFO ][wal-file-archiver%grid-0-#24437%grid-0%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000008.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000018.wal] [21:13:50] : [Step 4/5] [2021-11-19 21:13:50,473][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10b6f63c-e31c-4573-a225-9f76f500c001, grp=1613773252] [21:13:50] : [Step 4/5] [2021-11-19 21:13:50,477][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint started [checkpointId=ab0c735d-2307-48c0-9dac-7812047e457e, startPtr=WALPointer [idx=19, fileOff=23929, len=2048], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=0ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=1ms, pages=24, reason='test'] [21:13:50] : [Step 4/5] [2021-11-19 21:13:50,488][INFO ][db-checkpoint-thread-#24450%grid-1%][GridEncryptionManager] Previous encryption keys were removed [grpId=1613773252, keyIds=[64, 65, 66, 67, 68]] [21:13:50] : [Step 4/5] [2021-11-19 21:13:50,488][INFO ][db-checkpoint-thread-#24450%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:13:50] : [Step 4/5] [2021-11-19 21:13:50,488][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint finished [cpId=ab0c735d-2307-48c0-9dac-7812047e457e, pages=24, markPos=WALPointer [idx=19, fileOff=23929, len=2048], walSegmentsCovered=[18], markDuration=2ms, pagesWrite=1ms, fsync=10ms, total=14ms] [21:13:50] : [Step 4/5] [2021-11-19 21:13:50,488][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00cce8f9-a2b3-4d32-a95a-7f6eb6335000, grp=1613773252] [21:13:50] : [Step 4/5] [2021-11-19 21:13:50,495][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint started [checkpointId=97556504-5e53-4878-aab3-b2f16a38f191, startPtr=WALPointer [idx=19, fileOff=23929, len=2010], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=1ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=4ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=0ms, pages=24, reason='test'] [21:13:50] : [Step 4/5] [2021-11-19 21:13:50,656][INFO ][db-checkpoint-thread-#24445%grid-0%][GridEncryptionManager] Previous encryption keys were removed [grpId=1613773252, keyIds=[64, 65, 66, 67, 68]] [21:13:50] : [Step 4/5] [2021-11-19 21:13:50,656][INFO ][db-checkpoint-thread-#24445%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:13:50] : [Step 4/5] [2021-11-19 21:13:50,657][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint finished [cpId=97556504-5e53-4878-aab3-b2f16a38f191, pages=24, markPos=WALPointer [idx=19, fileOff=23929, len=2010], walSegmentsCovered=[18], markDuration=7ms, pagesWrite=1ms, fsync=160ms, total=168ms] [21:13:50] : [Step 4/5] [2021-11-19 21:13:50,661][INFO ][disco-notifier-worker-#24306%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=120] [21:13:50] : [Step 4/5] [2021-11-19 21:13:50,661][INFO ][reencrypt-#24467%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:13:50] : [Step 4/5] [2021-11-19 21:13:50,662][INFO ][disco-notifier-worker-#24425%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=120] [21:13:50] : [Step 4/5] [2021-11-19 21:13:50,662][INFO ][reencrypt-#24466%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:13:50] : [Step 4/5] [2021-11-19 21:13:50,863][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10b6f63c-e31c-4573-a225-9f76f500c001, grp=1613773252] [21:13:51] : [Step 4/5] [2021-11-19 21:13:51,067][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint started [checkpointId=68cb0c71-7759-4179-9bea-83eb50116c97, startPtr=WALPointer [idx=19, fileOff=260531, len=2048], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=85ms, writeCheckpointEntryDuration=118ms, splitAndSortCpPagesDuration=0ms, pages=26, reason='test'] [21:13:51] : [Step 4/5] [2021-11-19 21:13:51,327][INFO ][db-checkpoint-thread-#24450%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:13:51] : [Step 4/5] [2021-11-19 21:13:51,328][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint finished [cpId=68cb0c71-7759-4179-9bea-83eb50116c97, pages=26, markPos=WALPointer [idx=19, fileOff=260531, len=2048], walSegmentsCovered=[], markDuration=204ms, pagesWrite=0ms, fsync=260ms, total=465ms] [21:13:51] : [Step 4/5] [2021-11-19 21:13:51,328][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00cce8f9-a2b3-4d32-a95a-7f6eb6335000, grp=1613773252] [21:13:51] : [Step 4/5] [2021-11-19 21:13:51,336][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint started [checkpointId=8a13875a-dfed-47cb-8865-dc957284e51c, startPtr=WALPointer [idx=19, fileOff=260493, len=2010], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=1ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=5ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=0ms, pages=26, reason='test'] [21:13:51] : [Step 4/5] [2021-11-19 21:13:51,346][INFO ][db-checkpoint-thread-#24445%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:13:51] : [Step 4/5] [2021-11-19 21:13:51,346][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint finished [cpId=8a13875a-dfed-47cb-8865-dc957284e51c, pages=26, markPos=WALPointer [idx=19, fileOff=260493, len=2010], walSegmentsCovered=[], markDuration=8ms, pagesWrite=1ms, fsync=8ms, total=17ms] [21:13:51] : [Step 4/5] [2021-11-19 21:13:51,352][INFO ][disco-notifier-worker-#24306%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=121] [21:13:51] : [Step 4/5] [2021-11-19 21:13:51,352][INFO ][disco-notifier-worker-#24425%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=121] [21:13:51] : [Step 4/5] [2021-11-19 21:13:51,353][INFO ][reencrypt-#24467%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:13:51] : [Step 4/5] [2021-11-19 21:13:51,353][INFO ][reencrypt-#24466%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:13:51] : [Step 4/5] [2021-11-19 21:13:51,554][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10b6f63c-e31c-4573-a225-9f76f500c001, grp=1613773252] [21:13:51] : [Step 4/5] [2021-11-19 21:13:51,793][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint started [checkpointId=e9f2be21-3e5e-47ad-b33f-6109b8e7bee0, startPtr=WALPointer [idx=19, fileOff=445109, len=2048], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=85ms, writeCheckpointEntryDuration=153ms, splitAndSortCpPagesDuration=0ms, pages=23, reason='test'] [21:13:52] : [Step 4/5] [2021-11-19 21:13:52,079][INFO ][db-checkpoint-thread-#24450%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:13:52] : [Step 4/5] [2021-11-19 21:13:52,079][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint finished [cpId=e9f2be21-3e5e-47ad-b33f-6109b8e7bee0, pages=23, markPos=WALPointer [idx=19, fileOff=445109, len=2048], walSegmentsCovered=[], markDuration=239ms, pagesWrite=0ms, fsync=285ms, total=525ms] [21:13:52] : [Step 4/5] [2021-11-19 21:13:52,080][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00cce8f9-a2b3-4d32-a95a-7f6eb6335000, grp=1613773252] [21:13:52] : [Step 4/5] [2021-11-19 21:13:52,083][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint started [checkpointId=c56c4b6d-b1f7-45d0-a1cd-a0bef970d939, startPtr=WALPointer [idx=19, fileOff=445033, len=2010], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=0ms, writeCheckpointEntryDuration=2ms, splitAndSortCpPagesDuration=0ms, pages=23, reason='test'] [21:13:52] : [Step 4/5] [2021-11-19 21:13:52,092][INFO ][db-checkpoint-thread-#24445%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:13:52] : [Step 4/5] [2021-11-19 21:13:52,093][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint finished [cpId=c56c4b6d-b1f7-45d0-a1cd-a0bef970d939, pages=23, markPos=WALPointer [idx=19, fileOff=445033, len=2010], walSegmentsCovered=[], markDuration=2ms, pagesWrite=1ms, fsync=9ms, total=13ms] [21:13:52] : [Step 4/5] [2021-11-19 21:13:52,098][INFO ][disco-notifier-worker-#24306%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=122] [21:13:52] : [Step 4/5] [2021-11-19 21:13:52,098][INFO ][disco-notifier-worker-#24425%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=122] [21:13:52] : [Step 4/5] [2021-11-19 21:13:52,098][INFO ][reencrypt-#24467%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:13:52] : [Step 4/5] [2021-11-19 21:13:52,098][INFO ][reencrypt-#24466%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:13:52] : [Step 4/5] [2021-11-19 21:13:52,299][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10b6f63c-e31c-4573-a225-9f76f500c001, grp=1613773252] [21:13:52] : [Step 4/5] [2021-11-19 21:13:52,486][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint started [checkpointId=5ab38005-5bba-47f6-9ba3-f575480e90c3, startPtr=WALPointer [idx=19, fileOff=631568, len=2048], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=59ms, writeCheckpointEntryDuration=126ms, splitAndSortCpPagesDuration=0ms, pages=23, reason='test'] [21:13:52] : [Step 4/5] [2021-11-19 21:13:52,905][INFO ][db-checkpoint-thread-#24450%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:13:52] : [Step 4/5] [2021-11-19 21:13:52,905][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint finished [cpId=5ab38005-5bba-47f6-9ba3-f575480e90c3, pages=23, markPos=WALPointer [idx=19, fileOff=631568, len=2048], walSegmentsCovered=[], markDuration=187ms, pagesWrite=1ms, fsync=417ms, total=605ms] [21:13:52] : [Step 4/5] [2021-11-19 21:13:52,905][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00cce8f9-a2b3-4d32-a95a-7f6eb6335000, grp=1613773252] [21:13:52] : [Step 4/5] [2021-11-19 21:13:52,923][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint started [checkpointId=d264cbf4-b529-4b9e-82e8-c5cb7829f602, startPtr=WALPointer [idx=19, fileOff=631454, len=2010], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=7ms, writeCheckpointEntryDuration=9ms, splitAndSortCpPagesDuration=0ms, pages=23, reason='test'] [21:13:52] : [Step 4/5] [2021-11-19 21:13:52,933][INFO ][db-checkpoint-thread-#24445%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:13:52] : [Step 4/5] [2021-11-19 21:13:52,934][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint finished [cpId=d264cbf4-b529-4b9e-82e8-c5cb7829f602, pages=23, markPos=WALPointer [idx=19, fileOff=631454, len=2010], walSegmentsCovered=[], markDuration=17ms, pagesWrite=1ms, fsync=10ms, total=28ms] [21:13:52] : [Step 4/5] [2021-11-19 21:13:52,940][INFO ][disco-notifier-worker-#24425%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=123] [21:13:52] : [Step 4/5] [2021-11-19 21:13:52,940][INFO ][disco-notifier-worker-#24306%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=123] [21:13:52] : [Step 4/5] [2021-11-19 21:13:52,941][INFO ][reencrypt-#24466%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:13:52] : [Step 4/5] [2021-11-19 21:13:52,941][INFO ][reencrypt-#24467%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:13:53] : [Step 4/5] [2021-11-19 21:13:53,142][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10b6f63c-e31c-4573-a225-9f76f500c001, grp=1613773252] [21:13:53] : [Step 4/5] [2021-11-19 21:13:53,318][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint started [checkpointId=ad995d6f-fd31-4561-9e67-46a7583ca8dc, startPtr=WALPointer [idx=19, fileOff=815099, len=2048], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=42ms, writeCheckpointEntryDuration=133ms, splitAndSortCpPagesDuration=0ms, pages=22, reason='test'] [21:13:53] : [Step 4/5] [2021-11-19 21:13:53,605][INFO ][db-checkpoint-thread-#24450%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:13:53] : [Step 4/5] [2021-11-19 21:13:53,606][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint finished [cpId=ad995d6f-fd31-4561-9e67-46a7583ca8dc, pages=22, markPos=WALPointer [idx=19, fileOff=815099, len=2048], walSegmentsCovered=[], markDuration=176ms, pagesWrite=0ms, fsync=287ms, total=463ms] [21:13:53] : [Step 4/5] [2021-11-19 21:13:53,606][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00cce8f9-a2b3-4d32-a95a-7f6eb6335000, grp=1613773252] [21:13:53] : [Step 4/5] [2021-11-19 21:13:53,785][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint started [checkpointId=a0f9fa0a-155e-4cf3-a14c-4bf7cd3316c4, startPtr=WALPointer [idx=19, fileOff=814947, len=2010], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=176ms, writeCheckpointEntryDuration=2ms, splitAndSortCpPagesDuration=0ms, pages=22, reason='test'] [21:13:53] : [Step 4/5] [2021-11-19 21:13:53,794][INFO ][db-checkpoint-thread-#24445%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:13:53] : [Step 4/5] [2021-11-19 21:13:53,794][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint finished [cpId=a0f9fa0a-155e-4cf3-a14c-4bf7cd3316c4, pages=22, markPos=WALPointer [idx=19, fileOff=814947, len=2010], walSegmentsCovered=[], markDuration=178ms, pagesWrite=1ms, fsync=8ms, total=188ms] [21:13:53] : [Step 4/5] [2021-11-19 21:13:53,800][INFO ][disco-notifier-worker-#24306%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=124] [21:13:53] : [Step 4/5] [2021-11-19 21:13:53,800][INFO ][reencrypt-#24467%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:13:53] : [Step 4/5] [2021-11-19 21:13:53,800][INFO ][disco-notifier-worker-#24425%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=124] [21:13:53] : [Step 4/5] [2021-11-19 21:13:53,845][INFO ][reencrypt-#24466%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:13:54] : [Step 4/5] [2021-11-19 21:13:54,046][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10b6f63c-e31c-4573-a225-9f76f500c001, grp=1613773252] [21:13:54] : [Step 4/5] [2021-11-19 21:13:54,119][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint started [checkpointId=e34db510-c3b9-4171-961e-21d416ed6e5c, startPtr=WALPointer [idx=19, fileOff=1004128, len=2048], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=70ms, writeCheckpointEntryDuration=2ms, splitAndSortCpPagesDuration=0ms, pages=23, reason='test'] [21:13:54] : [Step 4/5] [2021-11-19 21:13:54,210][INFO ][db-checkpoint-thread-#24450%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:13:54] : [Step 4/5] [2021-11-19 21:13:54,210][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint finished [cpId=e34db510-c3b9-4171-961e-21d416ed6e5c, pages=23, markPos=WALPointer [idx=19, fileOff=1004128, len=2048], walSegmentsCovered=[], markDuration=73ms, pagesWrite=0ms, fsync=90ms, total=164ms] [21:13:54] : [Step 4/5] [2021-11-19 21:13:54,210][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00cce8f9-a2b3-4d32-a95a-7f6eb6335000, grp=1613773252] [21:13:54] : [Step 4/5] [2021-11-19 21:13:54,331][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint started [checkpointId=8c805022-b385-4d50-9ee1-67286e7b1e77, startPtr=WALPointer [idx=19, fileOff=1003938, len=2010], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=88ms, writeCheckpointEntryDuration=31ms, splitAndSortCpPagesDuration=0ms, pages=23, reason='test'] [21:13:54] : [Step 4/5] [2021-11-19 21:13:54,451][INFO ][db-checkpoint-thread-#24445%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:13:54] : [Step 4/5] [2021-11-19 21:13:54,451][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint finished [cpId=8c805022-b385-4d50-9ee1-67286e7b1e77, pages=23, markPos=WALPointer [idx=19, fileOff=1003938, len=2010], walSegmentsCovered=[], markDuration=120ms, pagesWrite=0ms, fsync=119ms, total=240ms] [21:13:54] : [Step 4/5] [2021-11-19 21:13:54,497][INFO ][wal-file-archiver%grid-0-#24437%grid-0%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=19, segIdx=9, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000009.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000019.wal] [21:13:54] : [Step 4/5] [2021-11-19 21:13:54,497][INFO ][wal-file-archiver%grid-1-#24440%grid-1%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=19, segIdx=9, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000009.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000019.wal] [21:13:54] : [Step 4/5] [2021-11-19 21:13:54,498][INFO ][wal-file-cleaner%grid-0-#24438%grid-0%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=10, currSize=10.0 MB, maxSize=20.0 MB] [21:13:54] : [Step 4/5] [2021-11-19 21:13:54,499][INFO ][wal-file-cleaner%grid-1-#24441%grid-1%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=10, currSize=10.0 MB, maxSize=20.0 MB] [21:13:54] : [Step 4/5] [2021-11-19 21:13:54,501][INFO ][wal-file-cleaner%grid-0-#24438%grid-0%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:13:54] : [Step 4/5] [2021-11-19 21:13:54,501][INFO ][wal-file-cleaner%grid-1-#24441%grid-1%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:13:54] : [Step 4/5] [2021-11-19 21:13:54,501][INFO ][disco-notifier-worker-#24306%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=125] [21:13:54] : [Step 4/5] [2021-11-19 21:13:54,502][INFO ][reencrypt-#24467%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:13:54] : [Step 4/5] [2021-11-19 21:13:54,502][INFO ][disco-notifier-worker-#24425%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=125] [21:13:54] : [Step 4/5] [2021-11-19 21:13:54,502][INFO ][reencrypt-#24466%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:13:54] : [Step 4/5] [2021-11-19 21:13:54,516][INFO ][wal-file-archiver%grid-0-#24437%grid-0%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000009.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000019.wal] [21:13:54] : [Step 4/5] [2021-11-19 21:13:54,516][INFO ][wal-file-archiver%grid-1-#24440%grid-1%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000009.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000019.wal] [21:13:54] : [Step 4/5] [2021-11-19 21:13:54,703][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10b6f63c-e31c-4573-a225-9f76f500c001, grp=1613773252] [21:13:54] : [Step 4/5] [2021-11-19 21:13:54,712][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint started [checkpointId=1d4eff3b-9929-4b8d-88b3-4dfed3e1ca67, startPtr=WALPointer [idx=20, fileOff=150579, len=2048], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=7ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=0ms, pages=22, reason='test'] [21:13:54] : [Step 4/5] [2021-11-19 21:13:54,723][INFO ][db-checkpoint-thread-#24450%grid-1%][GridEncryptionManager] Previous encryption keys were removed [grpId=1613773252, keyIds=[69, 70, 71, 72, 73]] [21:13:54] : [Step 4/5] [2021-11-19 21:13:54,723][INFO ][db-checkpoint-thread-#24450%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:13:54] : [Step 4/5] [2021-11-19 21:13:54,723][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint finished [cpId=1d4eff3b-9929-4b8d-88b3-4dfed3e1ca67, pages=22, markPos=WALPointer [idx=20, fileOff=150579, len=2048], walSegmentsCovered=[19], markDuration=9ms, pagesWrite=0ms, fsync=10ms, total=19ms] [21:13:54] : [Step 4/5] [2021-11-19 21:13:54,723][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00cce8f9-a2b3-4d32-a95a-7f6eb6335000, grp=1613773252] [21:13:54] : [Step 4/5] [2021-11-19 21:13:54,730][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint started [checkpointId=49d4be04-6eb7-4215-9ff9-c944b1533a6d, startPtr=WALPointer [idx=20, fileOff=150579, len=2010], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=1ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=4ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=0ms, pages=22, reason='test'] [21:13:54] : [Step 4/5] [2021-11-19 21:13:54,741][INFO ][db-checkpoint-thread-#24445%grid-0%][GridEncryptionManager] Previous encryption keys were removed [grpId=1613773252, keyIds=[69, 70, 71, 72, 73]] [21:13:54] : [Step 4/5] [2021-11-19 21:13:54,742][INFO ][db-checkpoint-thread-#24445%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:13:54] : [Step 4/5] [2021-11-19 21:13:54,742][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint finished [cpId=49d4be04-6eb7-4215-9ff9-c944b1533a6d, pages=22, markPos=WALPointer [idx=20, fileOff=150579, len=2010], walSegmentsCovered=[19], markDuration=7ms, pagesWrite=5ms, fsync=6ms, total=18ms] [21:13:54] : [Step 4/5] [2021-11-19 21:13:54,747][INFO ][disco-notifier-worker-#24425%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=126] [21:13:54] : [Step 4/5] [2021-11-19 21:13:54,747][INFO ][disco-notifier-worker-#24306%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=126] [21:13:54] : [Step 4/5] [2021-11-19 21:13:54,747][INFO ][reencrypt-#24466%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:13:54] : [Step 4/5] [2021-11-19 21:13:54,748][INFO ][reencrypt-#24467%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:13:54] : [Step 4/5] [2021-11-19 21:13:54,949][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10b6f63c-e31c-4573-a225-9f76f500c001, grp=1613773252] [21:13:55] : [Step 4/5] [2021-11-19 21:13:55,179][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint started [checkpointId=508b2a3d-9e12-4a91-b383-c413a140cd2a, startPtr=WALPointer [idx=20, fileOff=373963, len=2048], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=104ms, writeCheckpointEntryDuration=125ms, splitAndSortCpPagesDuration=0ms, pages=22, reason='test'] [21:13:55] : [Step 4/5] [2021-11-19 21:13:55,190][INFO ][db-checkpoint-thread-#24450%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:13:55] : [Step 4/5] [2021-11-19 21:13:55,190][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint finished [cpId=508b2a3d-9e12-4a91-b383-c413a140cd2a, pages=22, markPos=WALPointer [idx=20, fileOff=373963, len=2048], walSegmentsCovered=[], markDuration=231ms, pagesWrite=0ms, fsync=10ms, total=241ms] [21:13:55] : [Step 4/5] [2021-11-19 21:13:55,191][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00cce8f9-a2b3-4d32-a95a-7f6eb6335000, grp=1613773252] [21:13:55] : [Step 4/5] [2021-11-19 21:13:55,199][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint started [checkpointId=32257abd-cfde-4d3d-95dd-3ee6eae66aa5, startPtr=WALPointer [idx=20, fileOff=373925, len=2010], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=6ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=0ms, pages=22, reason='test'] [21:13:55] : [Step 4/5] [2021-11-19 21:13:55,209][INFO ][db-checkpoint-thread-#24445%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:13:55] : [Step 4/5] [2021-11-19 21:13:55,209][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint finished [cpId=32257abd-cfde-4d3d-95dd-3ee6eae66aa5, pages=22, markPos=WALPointer [idx=20, fileOff=373925, len=2010], walSegmentsCovered=[], markDuration=8ms, pagesWrite=0ms, fsync=9ms, total=18ms] [21:13:55] : [Step 4/5] [2021-11-19 21:13:55,215][INFO ][disco-notifier-worker-#24306%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=127] [21:13:55] : [Step 4/5] [2021-11-19 21:13:55,215][INFO ][disco-notifier-worker-#24425%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=127] [21:13:55] : [Step 4/5] [2021-11-19 21:13:55,215][INFO ][reencrypt-#24467%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:13:55] : [Step 4/5] [2021-11-19 21:13:55,216][INFO ][reencrypt-#24466%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:13:55] : [Step 4/5] [2021-11-19 21:13:55,417][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10b6f63c-e31c-4573-a225-9f76f500c001, grp=1613773252] [21:13:55] : [Step 4/5] [2021-11-19 21:13:55,580][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint started [checkpointId=47a6a67d-5fc0-4e97-b16e-2645b571959c, startPtr=WALPointer [idx=20, fileOff=560422, len=2048], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=85ms, writeCheckpointEntryDuration=77ms, splitAndSortCpPagesDuration=0ms, pages=23, reason='test'] [21:13:55] : [Step 4/5] [2021-11-19 21:13:55,734][INFO ][db-checkpoint-thread-#24450%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:13:55] : [Step 4/5] [2021-11-19 21:13:55,735][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint finished [cpId=47a6a67d-5fc0-4e97-b16e-2645b571959c, pages=23, markPos=WALPointer [idx=20, fileOff=560422, len=2048], walSegmentsCovered=[], markDuration=162ms, pagesWrite=1ms, fsync=154ms, total=318ms] [21:13:55] : [Step 4/5] [2021-11-19 21:13:55,735][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00cce8f9-a2b3-4d32-a95a-7f6eb6335000, grp=1613773252] [21:13:55] : [Step 4/5] [2021-11-19 21:13:55,744][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint started [checkpointId=3b88bde1-c9ab-4ac1-a565-f71426ac0f33, startPtr=WALPointer [idx=20, fileOff=560346, len=2010], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=7ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=0ms, pages=23, reason='test'] [21:13:55] : [Step 4/5] [2021-11-19 21:13:55,754][INFO ][db-checkpoint-thread-#24445%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:13:55] : [Step 4/5] [2021-11-19 21:13:55,754][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint finished [cpId=3b88bde1-c9ab-4ac1-a565-f71426ac0f33, pages=23, markPos=WALPointer [idx=20, fileOff=560346, len=2010], walSegmentsCovered=[], markDuration=8ms, pagesWrite=1ms, fsync=9ms, total=18ms] [21:13:55] : [Step 4/5] [2021-11-19 21:13:55,760][INFO ][disco-notifier-worker-#24306%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=128] [21:13:55] : [Step 4/5] [2021-11-19 21:13:55,760][INFO ][reencrypt-#24467%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:13:55] : [Step 4/5] [2021-11-19 21:13:55,760][INFO ][disco-notifier-worker-#24425%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=128] [21:13:55] : [Step 4/5] [2021-11-19 21:13:55,761][INFO ][reencrypt-#24466%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:13:55] : [Step 4/5] [2021-11-19 21:13:55,962][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10b6f63c-e31c-4573-a225-9f76f500c001, grp=1613773252] [21:13:56] : [Step 4/5] [2021-11-19 21:13:56,248][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint started [checkpointId=5231d416-91e1-4a6c-90f3-037e6c2a82bf, startPtr=WALPointer [idx=20, fileOff=743953, len=2048], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=152ms, writeCheckpointEntryDuration=132ms, splitAndSortCpPagesDuration=0ms, pages=22, reason='test'] [21:13:56] : [Step 4/5] [2021-11-19 21:13:56,632][INFO ][db-checkpoint-thread-#24450%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:13:56] : [Step 4/5] [2021-11-19 21:13:56,632][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint finished [cpId=5231d416-91e1-4a6c-90f3-037e6c2a82bf, pages=22, markPos=WALPointer [idx=20, fileOff=743953, len=2048], walSegmentsCovered=[], markDuration=285ms, pagesWrite=1ms, fsync=383ms, total=670ms] [21:13:56] : [Step 4/5] [2021-11-19 21:13:56,632][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00cce8f9-a2b3-4d32-a95a-7f6eb6335000, grp=1613773252] [21:13:56] : [Step 4/5] [2021-11-19 21:13:56,640][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint started [checkpointId=145fae1a-b1ea-4001-933a-1060cb0eabd1, startPtr=WALPointer [idx=20, fileOff=743839, len=2010], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=1ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=5ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=0ms, pages=22, reason='test'] [21:13:56] : [Step 4/5] [2021-11-19 21:13:56,650][INFO ][db-checkpoint-thread-#24445%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:13:56] : [Step 4/5] [2021-11-19 21:13:56,650][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint finished [cpId=145fae1a-b1ea-4001-933a-1060cb0eabd1, pages=22, markPos=WALPointer [idx=20, fileOff=743839, len=2010], walSegmentsCovered=[], markDuration=8ms, pagesWrite=1ms, fsync=8ms, total=17ms] [21:13:56] : [Step 4/5] [2021-11-19 21:13:56,655][INFO ][disco-notifier-worker-#24306%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=129] [21:13:56] : [Step 4/5] [2021-11-19 21:13:56,656][INFO ][reencrypt-#24467%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:13:56] : [Step 4/5] [2021-11-19 21:13:56,656][INFO ][disco-notifier-worker-#24425%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=129] [21:13:56] : [Step 4/5] [2021-11-19 21:13:56,656][INFO ][reencrypt-#24466%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:13:56] : [Step 4/5] [2021-11-19 21:13:56,858][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10b6f63c-e31c-4573-a225-9f76f500c001, grp=1613773252] [21:13:57] : [Step 4/5] [2021-11-19 21:13:57,279][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint started [checkpointId=274ce418-9b9c-4920-8b96-4a4ce5da8851, startPtr=WALPointer [idx=20, fileOff=932982, len=2048], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=147ms, writeCheckpointEntryDuration=273ms, splitAndSortCpPagesDuration=0ms, pages=23, reason='test'] [21:13:57] : [Step 4/5] [2021-11-19 21:13:57,433][INFO ][db-checkpoint-thread-#24450%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:13:57] : [Step 4/5] [2021-11-19 21:13:57,434][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint finished [cpId=274ce418-9b9c-4920-8b96-4a4ce5da8851, pages=23, markPos=WALPointer [idx=20, fileOff=932982, len=2048], walSegmentsCovered=[], markDuration=421ms, pagesWrite=1ms, fsync=153ms, total=576ms] [21:13:57] : [Step 4/5] [2021-11-19 21:13:57,434][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00cce8f9-a2b3-4d32-a95a-7f6eb6335000, grp=1613773252] [21:13:57] : [Step 4/5] [2021-11-19 21:13:57,437][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint started [checkpointId=550a0967-bda1-4829-acdd-b1a128049187, startPtr=WALPointer [idx=20, fileOff=932830, len=2010], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=0ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=0ms, pages=23, reason='test'] [21:13:57] : [Step 4/5] [2021-11-19 21:13:57,447][INFO ][db-checkpoint-thread-#24445%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:13:57] : [Step 4/5] [2021-11-19 21:13:57,447][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint finished [cpId=550a0967-bda1-4829-acdd-b1a128049187, pages=23, markPos=WALPointer [idx=20, fileOff=932830, len=2010], walSegmentsCovered=[], markDuration=3ms, pagesWrite=1ms, fsync=8ms, total=12ms] [21:13:57] : [Step 4/5] [2021-11-19 21:13:57,456][INFO ][wal-file-archiver%grid-1-#24440%grid-1%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=20, segIdx=0, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000000.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000020.wal] [21:13:57] : [Step 4/5] [2021-11-19 21:13:57,456][INFO ][disco-notifier-worker-#24425%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=130] [21:13:57] : [Step 4/5] [2021-11-19 21:13:57,456][INFO ][disco-notifier-worker-#24306%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=130] [21:13:57] : [Step 4/5] [2021-11-19 21:13:57,456][INFO ][wal-file-archiver%grid-0-#24437%grid-0%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=20, segIdx=0, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000000.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000020.wal] [21:13:57] : [Step 4/5] [2021-11-19 21:13:57,457][INFO ][reencrypt-#24467%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:13:57] : [Step 4/5] [2021-11-19 21:13:57,457][INFO ][wal-file-cleaner%grid-1-#24441%grid-1%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=11, currSize=10.0 MB, maxSize=20.0 MB] [21:13:57] : [Step 4/5] [2021-11-19 21:13:57,457][INFO ][reencrypt-#24466%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:13:57] : [Step 4/5] [2021-11-19 21:13:57,459][INFO ][wal-file-cleaner%grid-0-#24438%grid-0%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=11, currSize=10.0 MB, maxSize=20.0 MB] [21:13:57] : [Step 4/5] [2021-11-19 21:13:57,461][INFO ][wal-file-cleaner%grid-1-#24441%grid-1%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:13:57] : [Step 4/5] [2021-11-19 21:13:57,461][INFO ][wal-file-cleaner%grid-0-#24438%grid-0%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:13:57] : [Step 4/5] [2021-11-19 21:13:57,472][INFO ][wal-file-archiver%grid-1-#24440%grid-1%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000000.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000020.wal] [21:13:57] : [Step 4/5] [2021-11-19 21:13:57,472][INFO ][wal-file-archiver%grid-0-#24437%grid-0%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000000.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000020.wal] [21:13:57] : [Step 4/5] [2021-11-19 21:13:57,658][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10b6f63c-e31c-4573-a225-9f76f500c001, grp=1613773252] [21:13:57] : [Step 4/5] [2021-11-19 21:13:57,877][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint started [checkpointId=9ea66da7-398c-40a5-ab08-119f69da94be, startPtr=WALPointer [idx=21, fileOff=82199, len=2048], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=121ms, writeCheckpointEntryDuration=96ms, splitAndSortCpPagesDuration=1ms, pages=22, reason='test'] [21:13:57] : [Step 4/5] [2021-11-19 21:13:57,980][INFO ][db-checkpoint-thread-#24450%grid-1%][GridEncryptionManager] Previous encryption keys were removed [grpId=1613773252, keyIds=[74, 75, 76, 77]] [21:13:57] : [Step 4/5] [2021-11-19 21:13:57,980][INFO ][db-checkpoint-thread-#24450%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:13:57] : [Step 4/5] [2021-11-19 21:13:57,981][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint finished [cpId=9ea66da7-398c-40a5-ab08-119f69da94be, pages=22, markPos=WALPointer [idx=21, fileOff=82199, len=2048], walSegmentsCovered=[20], markDuration=218ms, pagesWrite=1ms, fsync=103ms, total=323ms] [21:13:57] : [Step 4/5] [2021-11-19 21:13:57,981][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00cce8f9-a2b3-4d32-a95a-7f6eb6335000, grp=1613773252] [21:13:58] : [Step 4/5] [2021-11-19 21:13:58,271][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint started [checkpointId=4042cac4-1b08-4a09-8046-ebab328a5cdc, startPtr=WALPointer [idx=21, fileOff=82199, len=2010], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=47ms, writeCheckpointEntryDuration=242ms, splitAndSortCpPagesDuration=0ms, pages=22, reason='test'] [21:13:58] : [Step 4/5] [2021-11-19 21:13:58,277][INFO ][db-checkpoint-thread-#24445%grid-0%][GridEncryptionManager] Previous encryption keys were removed [grpId=1613773252, keyIds=[74, 75, 76, 77]] [21:13:58] : [Step 4/5] [2021-11-19 21:13:58,278][INFO ][db-checkpoint-thread-#24445%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:13:58] : [Step 4/5] [2021-11-19 21:13:58,278][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint finished [cpId=4042cac4-1b08-4a09-8046-ebab328a5cdc, pages=22, markPos=WALPointer [idx=21, fileOff=82199, len=2010], walSegmentsCovered=[20], markDuration=290ms, pagesWrite=0ms, fsync=6ms, total=297ms] [21:13:58] : [Step 4/5] [2021-11-19 21:13:58,282][INFO ][disco-notifier-worker-#24306%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=131] [21:13:58] : [Step 4/5] [2021-11-19 21:13:58,283][INFO ][reencrypt-#24467%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:13:58] : [Step 4/5] [2021-11-19 21:13:58,283][INFO ][disco-notifier-worker-#24425%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=131] [21:13:58] : [Step 4/5] [2021-11-19 21:13:58,283][INFO ][reencrypt-#24466%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:13:58] : [Step 4/5] [2021-11-19 21:13:58,484][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10b6f63c-e31c-4573-a225-9f76f500c001, grp=1613773252] [21:13:58] : [Step 4/5] [2021-11-19 21:13:58,844][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint started [checkpointId=143b59ae-7058-4545-9988-517137f61f6f, startPtr=WALPointer [idx=21, fileOff=312205, len=2048], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=193ms, writeCheckpointEntryDuration=164ms, splitAndSortCpPagesDuration=0ms, pages=23, reason='test'] [21:13:59] : [Step 4/5] [2021-11-19 21:13:59,047][INFO ][db-checkpoint-thread-#24450%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:13:59] : [Step 4/5] [2021-11-19 21:13:59,047][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint finished [cpId=143b59ae-7058-4545-9988-517137f61f6f, pages=23, markPos=WALPointer [idx=21, fileOff=312205, len=2048], walSegmentsCovered=[], markDuration=359ms, pagesWrite=1ms, fsync=202ms, total=562ms] [21:13:59] : [Step 4/5] [2021-11-19 21:13:59,047][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00cce8f9-a2b3-4d32-a95a-7f6eb6335000, grp=1613773252] [21:13:59] : [Step 4/5] [2021-11-19 21:13:59,056][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint started [checkpointId=c406b64c-0f7b-4943-b8e9-c958529d19ea, startPtr=WALPointer [idx=21, fileOff=312167, len=2010], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=6ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=0ms, pages=23, reason='test'] [21:13:59] : [Step 4/5] [2021-11-19 21:13:59,066][INFO ][db-checkpoint-thread-#24445%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:13:59] : [Step 4/5] [2021-11-19 21:13:59,066][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint finished [cpId=c406b64c-0f7b-4943-b8e9-c958529d19ea, pages=23, markPos=WALPointer [idx=21, fileOff=312167, len=2010], walSegmentsCovered=[], markDuration=9ms, pagesWrite=1ms, fsync=8ms, total=18ms] [21:13:59] : [Step 4/5] [2021-11-19 21:13:59,071][INFO ][disco-notifier-worker-#24306%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=132] [21:13:59] : [Step 4/5] [2021-11-19 21:13:59,071][INFO ][reencrypt-#24467%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:13:59] : [Step 4/5] [2021-11-19 21:13:59,072][INFO ][disco-notifier-worker-#24425%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=132] [21:13:59] : [Step 4/5] [2021-11-19 21:13:59,072][INFO ][reencrypt-#24466%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:13:59] : [Step 4/5] [2021-11-19 21:13:59,273][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10b6f63c-e31c-4573-a225-9f76f500c001, grp=1613773252] [21:13:59] : [Step 4/5] [2021-11-19 21:13:59,502][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint started [checkpointId=b3953976-8e39-4090-8f6b-c28d56fd3f60, startPtr=WALPointer [idx=21, fileOff=504001, len=2048], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=178ms, writeCheckpointEntryDuration=50ms, splitAndSortCpPagesDuration=0ms, pages=24, reason='test'] [21:13:59] : [Step 4/5] [2021-11-19 21:13:59,578][INFO ][db-checkpoint-thread-#24450%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:13:59] : [Step 4/5] [2021-11-19 21:13:59,578][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint finished [cpId=b3953976-8e39-4090-8f6b-c28d56fd3f60, pages=24, markPos=WALPointer [idx=21, fileOff=504001, len=2048], walSegmentsCovered=[], markDuration=229ms, pagesWrite=0ms, fsync=75ms, total=305ms] [21:13:59] : [Step 4/5] [2021-11-19 21:13:59,578][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00cce8f9-a2b3-4d32-a95a-7f6eb6335000, grp=1613773252] [21:13:59] : [Step 4/5] [2021-11-19 21:13:59,619][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint started [checkpointId=1613a63a-f5d7-4894-bed5-e3e192c6810d, startPtr=WALPointer [idx=21, fileOff=503925, len=2010], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=1ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=4ms, writeCheckpointEntryDuration=35ms, splitAndSortCpPagesDuration=0ms, pages=24, reason='test'] [21:13:59] : [Step 4/5] [2021-11-19 21:13:59,668][INFO ][db-checkpoint-thread-#24445%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:13:59] : [Step 4/5] [2021-11-19 21:13:59,669][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint finished [cpId=1613a63a-f5d7-4894-bed5-e3e192c6810d, pages=24, markPos=WALPointer [idx=21, fileOff=503925, len=2010], walSegmentsCovered=[], markDuration=41ms, pagesWrite=0ms, fsync=49ms, total=90ms] [21:13:59] : [Step 4/5] [2021-11-19 21:13:59,675][INFO ][disco-notifier-worker-#24306%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=133] [21:13:59] : [Step 4/5] [2021-11-19 21:13:59,676][INFO ][reencrypt-#24467%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:13:59] : [Step 4/5] [2021-11-19 21:13:59,676][INFO ][disco-notifier-worker-#24425%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=133] [21:13:59] : [Step 4/5] [2021-11-19 21:13:59,677][INFO ][reencrypt-#24466%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:13:59] : [Step 4/5] [2021-11-19 21:13:59,878][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10b6f63c-e31c-4573-a225-9f76f500c001, grp=1613773252] [21:13:59] : [Step 4/5] [2021-11-19 21:13:59,958][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint started [checkpointId=5cf6f89d-486c-480e-a81d-9049752762dd, startPtr=WALPointer [idx=21, fileOff=693030, len=2048], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=13ms, writeCheckpointEntryDuration=66ms, splitAndSortCpPagesDuration=0ms, pages=23, reason='test'] [21:14:00] : [Step 4/5] [2021-11-19 21:14:00,510][INFO ][db-checkpoint-thread-#24450%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:14:00] : [Step 4/5] [2021-11-19 21:14:00,510][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint finished [cpId=5cf6f89d-486c-480e-a81d-9049752762dd, pages=23, markPos=WALPointer [idx=21, fileOff=693030, len=2048], walSegmentsCovered=[], markDuration=80ms, pagesWrite=1ms, fsync=550ms, total=632ms] [21:14:00] : [Step 4/5] [2021-11-19 21:14:00,511][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00cce8f9-a2b3-4d32-a95a-7f6eb6335000, grp=1613773252] [21:14:00] : [Step 4/5] [2021-11-19 21:14:00,702][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint started [checkpointId=63850f14-ca67-4e6f-b779-32096884b1be, startPtr=WALPointer [idx=21, fileOff=692916, len=2010], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=180ms, writeCheckpointEntryDuration=10ms, splitAndSortCpPagesDuration=0ms, pages=23, reason='test'] [21:14:00] : [Step 4/5] [2021-11-19 21:14:00,712][INFO ][db-checkpoint-thread-#24445%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:14:00] : [Step 4/5] [2021-11-19 21:14:00,712][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint finished [cpId=63850f14-ca67-4e6f-b779-32096884b1be, pages=23, markPos=WALPointer [idx=21, fileOff=692916, len=2010], walSegmentsCovered=[], markDuration=191ms, pagesWrite=1ms, fsync=8ms, total=201ms] [21:14:00] : [Step 4/5] [2021-11-19 21:14:00,718][INFO ][disco-notifier-worker-#24306%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=134] [21:14:00] : [Step 4/5] [2021-11-19 21:14:00,718][INFO ][disco-notifier-worker-#24425%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=134] [21:14:00] : [Step 4/5] [2021-11-19 21:14:00,718][INFO ][reencrypt-#24467%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:14:00] : [Step 4/5] [2021-11-19 21:14:00,718][INFO ][reencrypt-#24466%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:14:00] : [Step 4/5] [2021-11-19 21:14:00,919][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10b6f63c-e31c-4573-a225-9f76f500c001, grp=1613773252] [21:14:01] : [Step 4/5] [2021-11-19 21:14:01,102][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint started [checkpointId=7ec767ff-eefd-49e1-b2d9-266687fd8989, startPtr=WALPointer [idx=21, fileOff=885485, len=2048], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=104ms, writeCheckpointEntryDuration=77ms, splitAndSortCpPagesDuration=0ms, pages=23, reason='test'] [21:14:01] : [Step 4/5] [2021-11-19 21:14:01,275][INFO ][db-checkpoint-thread-#24450%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:14:01] : [Step 4/5] [2021-11-19 21:14:01,276][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint finished [cpId=7ec767ff-eefd-49e1-b2d9-266687fd8989, pages=23, markPos=WALPointer [idx=21, fileOff=885485, len=2048], walSegmentsCovered=[], markDuration=182ms, pagesWrite=1ms, fsync=171ms, total=355ms] [21:14:01] : [Step 4/5] [2021-11-19 21:14:01,276][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00cce8f9-a2b3-4d32-a95a-7f6eb6335000, grp=1613773252] [21:14:01] : [Step 4/5] [2021-11-19 21:14:01,284][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint started [checkpointId=b8ecb732-801e-4a9a-b276-07ab74327463, startPtr=WALPointer [idx=21, fileOff=885333, len=2010], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=6ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=0ms, pages=23, reason='test'] [21:14:01] : [Step 4/5] [2021-11-19 21:14:01,294][INFO ][db-checkpoint-thread-#24445%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:14:01] : [Step 4/5] [2021-11-19 21:14:01,294][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint finished [cpId=b8ecb732-801e-4a9a-b276-07ab74327463, pages=23, markPos=WALPointer [idx=21, fileOff=885333, len=2010], walSegmentsCovered=[], markDuration=8ms, pagesWrite=1ms, fsync=8ms, total=17ms] [21:14:01] : [Step 4/5] [2021-11-19 21:14:01,303][INFO ][wal-file-archiver%grid-0-#24437%grid-0%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=21, segIdx=1, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000001.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000021.wal] [21:14:01] : [Step 4/5] [2021-11-19 21:14:01,303][INFO ][disco-notifier-worker-#24425%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=135] [21:14:01] : [Step 4/5] [2021-11-19 21:14:01,303][INFO ][disco-notifier-worker-#24306%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=135] [21:14:01] : [Step 4/5] [2021-11-19 21:14:01,303][INFO ][wal-file-archiver%grid-1-#24440%grid-1%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=21, segIdx=1, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000001.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000021.wal] [21:14:01] : [Step 4/5] [2021-11-19 21:14:01,304][INFO ][reencrypt-#24467%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:14:01] : [Step 4/5] [2021-11-19 21:14:01,304][INFO ][wal-file-cleaner%grid-0-#24438%grid-0%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=12, currSize=10.0 MB, maxSize=20.0 MB] [21:14:01] : [Step 4/5] [2021-11-19 21:14:01,304][INFO ][reencrypt-#24466%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:14:01] : [Step 4/5] [2021-11-19 21:14:01,309][INFO ][wal-file-cleaner%grid-1-#24441%grid-1%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=12, currSize=10.0 MB, maxSize=20.0 MB] [21:14:01] : [Step 4/5] [2021-11-19 21:14:01,310][INFO ][wal-file-cleaner%grid-0-#24438%grid-0%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:14:01] : [Step 4/5] [2021-11-19 21:14:01,315][INFO ][wal-file-cleaner%grid-1-#24441%grid-1%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:14:01] : [Step 4/5] [2021-11-19 21:14:01,316][INFO ][wal-file-archiver%grid-0-#24437%grid-0%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000001.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000021.wal] [21:14:01] : [Step 4/5] [2021-11-19 21:14:01,329][INFO ][wal-file-archiver%grid-1-#24440%grid-1%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000001.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000021.wal] [21:14:01] : [Step 4/5] [2021-11-19 21:14:01,508][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10b6f63c-e31c-4573-a225-9f76f500c001, grp=1613773252] [21:14:01] : [Step 4/5] [2021-11-19 21:14:01,511][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint started [checkpointId=2fd796cf-e998-4f74-b406-14e022ae9508, startPtr=WALPointer [idx=22, fileOff=36640, len=2048], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=1ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=0ms, pages=24, reason='test'] [21:14:01] : [Step 4/5] [2021-11-19 21:14:01,871][INFO ][db-checkpoint-thread-#24450%grid-1%][GridEncryptionManager] Previous encryption keys were removed [grpId=1613773252, keyIds=[78, 79, 80, 81]] [21:14:01] : [Step 4/5] [2021-11-19 21:14:01,872][INFO ][db-checkpoint-thread-#24450%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:14:01] : [Step 4/5] [2021-11-19 21:14:01,872][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint finished [cpId=2fd796cf-e998-4f74-b406-14e022ae9508, pages=24, markPos=WALPointer [idx=22, fileOff=36640, len=2048], walSegmentsCovered=[21], markDuration=3ms, pagesWrite=1ms, fsync=359ms, total=363ms] [21:14:01] : [Step 4/5] [2021-11-19 21:14:01,872][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00cce8f9-a2b3-4d32-a95a-7f6eb6335000, grp=1613773252] [21:14:01] : [Step 4/5] [2021-11-19 21:14:01,879][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint started [checkpointId=1af2c967-2d87-47de-b322-c19fc9ca2830, startPtr=WALPointer [idx=22, fileOff=32511, len=2010], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=3ms, writeCheckpointEntryDuration=2ms, splitAndSortCpPagesDuration=0ms, pages=24, reason='test'] [21:14:01] : [Step 4/5] [2021-11-19 21:14:01,898][INFO ][db-checkpoint-thread-#24445%grid-0%][GridEncryptionManager] Previous encryption keys were removed [grpId=1613773252, keyIds=[78, 79, 80, 81]] [21:14:01] : [Step 4/5] [2021-11-19 21:14:01,898][INFO ][db-checkpoint-thread-#24445%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:14:01] : [Step 4/5] [2021-11-19 21:14:01,898][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint finished [cpId=1af2c967-2d87-47de-b322-c19fc9ca2830, pages=24, markPos=WALPointer [idx=22, fileOff=32511, len=2010], walSegmentsCovered=[21], markDuration=6ms, pagesWrite=0ms, fsync=18ms, total=25ms] [21:14:01] : [Step 4/5] [2021-11-19 21:14:01,904][INFO ][disco-notifier-worker-#24306%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=136] [21:14:01] : [Step 4/5] [2021-11-19 21:14:01,905][INFO ][disco-notifier-worker-#24425%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=136] [21:14:01] : [Step 4/5] [2021-11-19 21:14:01,905][INFO ][reencrypt-#24467%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:14:01] : [Step 4/5] [2021-11-19 21:14:01,905][INFO ][reencrypt-#24466%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:14:02] : [Step 4/5] [2021-11-19 21:14:02,106][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10b6f63c-e31c-4573-a225-9f76f500c001, grp=1613773252] [21:14:02] : [Step 4/5] [2021-11-19 21:14:02,411][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint started [checkpointId=e2205f34-36b8-45ac-8c9b-94091fee6c15, startPtr=WALPointer [idx=22, fileOff=277093, len=2048], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=173ms, writeCheckpointEntryDuration=131ms, splitAndSortCpPagesDuration=0ms, pages=25, reason='test'] [21:14:02] : [Step 4/5] [2021-11-19 21:14:02,415][INFO ][db-checkpoint-thread-#24450%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:14:02] : [Step 4/5] [2021-11-19 21:14:02,415][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint finished [cpId=e2205f34-36b8-45ac-8c9b-94091fee6c15, pages=25, markPos=WALPointer [idx=22, fileOff=277093, len=2048], walSegmentsCovered=[], markDuration=305ms, pagesWrite=1ms, fsync=2ms, total=308ms] [21:14:02] : [Step 4/5] [2021-11-19 21:14:02,416][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00cce8f9-a2b3-4d32-a95a-7f6eb6335000, grp=1613773252] [21:14:02] : [Step 4/5] [2021-11-19 21:14:02,424][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint started [checkpointId=5dbe0831-155d-4e9a-a77c-a8bfd7e4c395, startPtr=WALPointer [idx=22, fileOff=272926, len=2010], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=6ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=0ms, pages=25, reason='test'] [21:14:02] : [Step 4/5] [2021-11-19 21:14:02,434][INFO ][db-checkpoint-thread-#24445%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:14:02] : [Step 4/5] [2021-11-19 21:14:02,434][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint finished [cpId=5dbe0831-155d-4e9a-a77c-a8bfd7e4c395, pages=25, markPos=WALPointer [idx=22, fileOff=272926, len=2010], walSegmentsCovered=[], markDuration=8ms, pagesWrite=1ms, fsync=8ms, total=18ms] [21:14:02] : [Step 4/5] [2021-11-19 21:14:02,440][INFO ][disco-notifier-worker-#24306%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=137] [21:14:02] : [Step 4/5] [2021-11-19 21:14:02,440][INFO ][disco-notifier-worker-#24425%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=137] [21:14:02] : [Step 4/5] [2021-11-19 21:14:02,440][INFO ][reencrypt-#24467%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:14:02] : [Step 4/5] [2021-11-19 21:14:02,441][INFO ][reencrypt-#24466%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:14:02] : [Step 4/5] [2021-11-19 21:14:02,642][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10b6f63c-e31c-4573-a225-9f76f500c001, grp=1613773252] [21:14:02] : [Step 4/5] [2021-11-19 21:14:02,823][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint started [checkpointId=6ff65d98-e5d5-43da-aaf3-21649163c343, startPtr=WALPointer [idx=22, fileOff=466122, len=2048], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=116ms, writeCheckpointEntryDuration=63ms, splitAndSortCpPagesDuration=0ms, pages=23, reason='test'] [21:14:02] : [Step 4/5] [2021-11-19 21:14:02,959][INFO ][db-checkpoint-thread-#24450%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:14:02] : [Step 4/5] [2021-11-19 21:14:02,960][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint finished [cpId=6ff65d98-e5d5-43da-aaf3-21649163c343, pages=23, markPos=WALPointer [idx=22, fileOff=466122, len=2048], walSegmentsCovered=[], markDuration=180ms, pagesWrite=1ms, fsync=136ms, total=318ms] [21:14:02] : [Step 4/5] [2021-11-19 21:14:02,960][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00cce8f9-a2b3-4d32-a95a-7f6eb6335000, grp=1613773252] [21:14:03] : [Step 4/5] [2021-11-19 21:14:03,130][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint started [checkpointId=50df436d-583a-4fea-8271-036551324e29, startPtr=WALPointer [idx=22, fileOff=461917, len=2010], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=1ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=70ms, writeCheckpointEntryDuration=98ms, splitAndSortCpPagesDuration=0ms, pages=23, reason='test'] [21:14:03] : [Step 4/5] [2021-11-19 21:14:03,367][INFO ][db-checkpoint-thread-#24445%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:14:03] : [Step 4/5] [2021-11-19 21:14:03,367][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint finished [cpId=50df436d-583a-4fea-8271-036551324e29, pages=23, markPos=WALPointer [idx=22, fileOff=461917, len=2010], walSegmentsCovered=[], markDuration=170ms, pagesWrite=1ms, fsync=235ms, total=406ms] [21:14:03] : [Step 4/5] [2021-11-19 21:14:03,372][INFO ][disco-notifier-worker-#24306%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=138] [21:14:03] : [Step 4/5] [2021-11-19 21:14:03,372][INFO ][disco-notifier-worker-#24425%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=138] [21:14:03] : [Step 4/5] [2021-11-19 21:14:03,373][INFO ][reencrypt-#24467%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:14:03] : [Step 4/5] [2021-11-19 21:14:03,373][INFO ][reencrypt-#24466%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:14:03] : [Step 4/5] [2021-11-19 21:14:03,574][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10b6f63c-e31c-4573-a225-9f76f500c001, grp=1613773252] [21:14:04] : [Step 4/5] [2021-11-19 21:14:04,142][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint started [checkpointId=12497318-8f01-41e7-b40d-13ab1797f653, startPtr=WALPointer [idx=22, fileOff=658577, len=2048], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=148ms, writeCheckpointEntryDuration=419ms, splitAndSortCpPagesDuration=0ms, pages=23, reason='test'] [21:14:04] : [Step 4/5] [2021-11-19 21:14:04,224][INFO ][db-checkpoint-thread-#24450%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:14:04] : [Step 4/5] [2021-11-19 21:14:04,224][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint finished [cpId=12497318-8f01-41e7-b40d-13ab1797f653, pages=23, markPos=WALPointer [idx=22, fileOff=658577, len=2048], walSegmentsCovered=[], markDuration=568ms, pagesWrite=1ms, fsync=80ms, total=650ms] [21:14:04] : [Step 4/5] [2021-11-19 21:14:04,224][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00cce8f9-a2b3-4d32-a95a-7f6eb6335000, grp=1613773252] [21:14:04] : [Step 4/5] [2021-11-19 21:14:04,233][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint started [checkpointId=2ac67d88-72f6-4141-9d2b-c4c5669646a6, startPtr=WALPointer [idx=22, fileOff=654334, len=2010], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=5ms, writeCheckpointEntryDuration=2ms, splitAndSortCpPagesDuration=0ms, pages=23, reason='test'] [21:14:04] : [Step 4/5] [2021-11-19 21:14:04,243][INFO ][db-checkpoint-thread-#24445%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:14:04] : [Step 4/5] [2021-11-19 21:14:04,243][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint finished [cpId=2ac67d88-72f6-4141-9d2b-c4c5669646a6, pages=23, markPos=WALPointer [idx=22, fileOff=654334, len=2010], walSegmentsCovered=[], markDuration=8ms, pagesWrite=1ms, fsync=8ms, total=18ms] [21:14:04] : [Step 4/5] [2021-11-19 21:14:04,249][INFO ][disco-notifier-worker-#24306%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=139] [21:14:04] : [Step 4/5] [2021-11-19 21:14:04,249][INFO ][reencrypt-#24467%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:14:04] : [Step 4/5] [2021-11-19 21:14:04,249][INFO ][disco-notifier-worker-#24425%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=139] [21:14:04] : [Step 4/5] [2021-11-19 21:14:04,250][INFO ][reencrypt-#24466%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:14:04] : [Step 4/5] [2021-11-19 21:14:04,451][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10b6f63c-e31c-4573-a225-9f76f500c001, grp=1613773252] [21:14:04] : [Step 4/5] [2021-11-19 21:14:04,800][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint started [checkpointId=7a82a61f-c815-4d7c-96f4-e01da6bb035e, startPtr=WALPointer [idx=22, fileOff=859357, len=2048], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=208ms, writeCheckpointEntryDuration=139ms, splitAndSortCpPagesDuration=1ms, pages=25, reason='test'] [21:14:05] : [Step 4/5] [2021-11-19 21:14:05,082][INFO ][db-checkpoint-thread-#24450%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:14:05] : [Step 4/5] [2021-11-19 21:14:05,083][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint finished [cpId=7a82a61f-c815-4d7c-96f4-e01da6bb035e, pages=25, markPos=WALPointer [idx=22, fileOff=859357, len=2048], walSegmentsCovered=[], markDuration=348ms, pagesWrite=1ms, fsync=282ms, total=632ms] [21:14:05] : [Step 4/5] [2021-11-19 21:14:05,083][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00cce8f9-a2b3-4d32-a95a-7f6eb6335000, grp=1613773252] [21:14:05] : [Step 4/5] [2021-11-19 21:14:05,091][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint started [checkpointId=b555984a-47b5-4a97-85c2-c996d598667e, startPtr=WALPointer [idx=22, fileOff=855076, len=2010], checkpointBeforeLockTime=5ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=2ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=0ms, pages=25, reason='test'] [21:14:05] : [Step 4/5] [2021-11-19 21:14:05,101][INFO ][db-checkpoint-thread-#24445%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:14:05] : [Step 4/5] [2021-11-19 21:14:05,101][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint finished [cpId=b555984a-47b5-4a97-85c2-c996d598667e, pages=25, markPos=WALPointer [idx=22, fileOff=855076, len=2010], walSegmentsCovered=[], markDuration=4ms, pagesWrite=1ms, fsync=8ms, total=18ms] [21:14:05] : [Step 4/5] [2021-11-19 21:14:05,106][INFO ][disco-notifier-worker-#24306%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=140] [21:14:05] : [Step 4/5] [2021-11-19 21:14:05,106][INFO ][disco-notifier-worker-#24425%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=140] [21:14:05] : [Step 4/5] [2021-11-19 21:14:05,106][INFO ][reencrypt-#24467%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:14:05] : [Step 4/5] [2021-11-19 21:14:05,107][INFO ][reencrypt-#24466%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:14:05] : [Step 4/5] [2021-11-19 21:14:05,109][INFO ][wal-file-archiver%grid-1-#24440%grid-1%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=22, segIdx=2, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000002.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000022.wal] [21:14:05] : [Step 4/5] [2021-11-19 21:14:05,110][INFO ][wal-file-cleaner%grid-1-#24441%grid-1%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=13, currSize=10.0 MB, maxSize=20.0 MB] [21:14:05] : [Step 4/5] [2021-11-19 21:14:05,114][INFO ][wal-file-cleaner%grid-1-#24441%grid-1%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:14:05] : [Step 4/5] [2021-11-19 21:14:05,118][INFO ][wal-file-archiver%grid-1-#24440%grid-1%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000002.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000022.wal] [21:14:05] : [Step 4/5] [2021-11-19 21:14:05,308][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10b6f63c-e31c-4573-a225-9f76f500c001, grp=1613773252] [21:14:05] : [Step 4/5] [2021-11-19 21:14:05,533][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint started [checkpointId=3b008bc3-8cbd-4032-a5c1-b78c52df32b7, startPtr=WALPointer [idx=23, fileOff=19782, len=2048], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=48ms, writeCheckpointEntryDuration=176ms, splitAndSortCpPagesDuration=0ms, pages=25, reason='test'] [21:14:05] : [Step 4/5] [2021-11-19 21:14:05,789][INFO ][db-checkpoint-thread-#24450%grid-1%][GridEncryptionManager] Previous encryption keys were removed [grpId=1613773252, keyIds=[82, 83, 84, 85, 86]] [21:14:05] : [Step 4/5] [2021-11-19 21:14:05,790][INFO ][db-checkpoint-thread-#24450%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:14:05] : [Step 4/5] [2021-11-19 21:14:05,790][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint finished [cpId=3b008bc3-8cbd-4032-a5c1-b78c52df32b7, pages=25, markPos=WALPointer [idx=23, fileOff=19782, len=2048], walSegmentsCovered=[22], markDuration=225ms, pagesWrite=0ms, fsync=256ms, total=482ms] [21:14:05] : [Step 4/5] [2021-11-19 21:14:05,790][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00cce8f9-a2b3-4d32-a95a-7f6eb6335000, grp=1613773252] [21:14:05] : [Step 4/5] [2021-11-19 21:14:05,945][INFO ][wal-file-archiver%grid-0-#24437%grid-0%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=22, segIdx=2, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000002.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000022.wal] [21:14:05] : [Step 4/5] [2021-11-19 21:14:05,947][INFO ][wal-file-cleaner%grid-0-#24438%grid-0%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=13, currSize=10.0 MB, maxSize=20.0 MB] [21:14:05] : [Step 4/5] [2021-11-19 21:14:05,949][INFO ][wal-file-cleaner%grid-0-#24438%grid-0%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:14:05] : [Step 4/5] [2021-11-19 21:14:05,963][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint started [checkpointId=cccd2bb7-f3ff-4710-bcf7-c14bab16357e, startPtr=WALPointer [idx=23, fileOff=12457, len=2010], checkpointBeforeLockTime=155ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=0ms, writeCheckpointEntryDuration=17ms, splitAndSortCpPagesDuration=0ms, pages=25, reason='test'] [21:14:05] : [Step 4/5] [2021-11-19 21:14:05,979][INFO ][wal-file-archiver%grid-0-#24437%grid-0%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000002.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000022.wal] [21:14:05] : [Step 4/5] [2021-11-19 21:14:05,991][INFO ][db-checkpoint-thread-#24445%grid-0%][GridEncryptionManager] Previous encryption keys were removed [grpId=1613773252, keyIds=[82, 83, 84, 85, 86]] [21:14:05] : [Step 4/5] [2021-11-19 21:14:05,991][INFO ][db-checkpoint-thread-#24445%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:14:05] : [Step 4/5] [2021-11-19 21:14:05,992][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint finished [cpId=cccd2bb7-f3ff-4710-bcf7-c14bab16357e, pages=25, markPos=WALPointer [idx=23, fileOff=12457, len=2010], walSegmentsCovered=[22], markDuration=18ms, pagesWrite=1ms, fsync=27ms, total=201ms] [21:14:05] : [Step 4/5] [2021-11-19 21:14:05,996][INFO ][disco-notifier-worker-#24306%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=141] [21:14:05] : [Step 4/5] [2021-11-19 21:14:05,997][INFO ][disco-notifier-worker-#24425%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=141] [21:14:05] : [Step 4/5] [2021-11-19 21:14:05,997][INFO ][reencrypt-#24467%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:14:05] : [Step 4/5] [2021-11-19 21:14:05,997][INFO ][reencrypt-#24466%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:14:06] : [Step 4/5] [2021-11-19 21:14:06,198][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10b6f63c-e31c-4573-a225-9f76f500c001, grp=1613773252] [21:14:06] : [Step 4/5] [2021-11-19 21:14:06,669][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint started [checkpointId=917bb168-69d9-483b-8469-24e0d94162e4, startPtr=WALPointer [idx=23, fileOff=263083, len=2048], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=155ms, writeCheckpointEntryDuration=315ms, splitAndSortCpPagesDuration=0ms, pages=26, reason='test'] [21:14:06] : [Step 4/5] [2021-11-19 21:14:06,730][INFO ][db-checkpoint-thread-#24450%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:14:06] : [Step 4/5] [2021-11-19 21:14:06,730][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint finished [cpId=917bb168-69d9-483b-8469-24e0d94162e4, pages=26, markPos=WALPointer [idx=23, fileOff=263083, len=2048], walSegmentsCovered=[], markDuration=471ms, pagesWrite=1ms, fsync=59ms, total=532ms] [21:14:06] : [Step 4/5] [2021-11-19 21:14:06,731][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00cce8f9-a2b3-4d32-a95a-7f6eb6335000, grp=1613773252] [21:14:06] : [Step 4/5] [2021-11-19 21:14:06,739][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint started [checkpointId=26514cb9-0c9c-4872-9836-817a61cf2301, startPtr=WALPointer [idx=23, fileOff=258764, len=2010], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=6ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=0ms, pages=26, reason='test'] [21:14:06] : [Step 4/5] [2021-11-19 21:14:06,748][INFO ][db-checkpoint-thread-#24445%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:14:06] : [Step 4/5] [2021-11-19 21:14:06,749][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint finished [cpId=26514cb9-0c9c-4872-9836-817a61cf2301, pages=26, markPos=WALPointer [idx=23, fileOff=258764, len=2010], walSegmentsCovered=[], markDuration=8ms, pagesWrite=1ms, fsync=8ms, total=17ms] [21:14:06] : [Step 4/5] [2021-11-19 21:14:06,754][INFO ][disco-notifier-worker-#24306%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=142] [21:14:06] : [Step 4/5] [2021-11-19 21:14:06,754][INFO ][disco-notifier-worker-#24425%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=142] [21:14:06] : [Step 4/5] [2021-11-19 21:14:06,754][INFO ][reencrypt-#24467%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:14:06] : [Step 4/5] [2021-11-19 21:14:06,755][INFO ][reencrypt-#24466%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:14:06] : [Step 4/5] [2021-11-19 21:14:06,956][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10b6f63c-e31c-4573-a225-9f76f500c001, grp=1613773252] [21:14:07] : [Step 4/5] [2021-11-19 21:14:07,110][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint started [checkpointId=2a9d2667-8180-4d59-818b-cef82cac6f60, startPtr=WALPointer [idx=23, fileOff=452112, len=2048], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=1ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=78ms, writeCheckpointEntryDuration=75ms, splitAndSortCpPagesDuration=0ms, pages=23, reason='test'] [21:14:07] : [Step 4/5] [2021-11-19 21:14:07,252][INFO ][db-checkpoint-thread-#24450%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:14:07] : [Step 4/5] [2021-11-19 21:14:07,252][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint finished [cpId=2a9d2667-8180-4d59-818b-cef82cac6f60, pages=23, markPos=WALPointer [idx=23, fileOff=452112, len=2048], walSegmentsCovered=[], markDuration=155ms, pagesWrite=0ms, fsync=141ms, total=296ms] [21:14:07] : [Step 4/5] [2021-11-19 21:14:07,253][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00cce8f9-a2b3-4d32-a95a-7f6eb6335000, grp=1613773252] [21:14:07] : [Step 4/5] [2021-11-19 21:14:07,582][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint started [checkpointId=736a90c8-6371-4432-a7e0-34a18b7fd6ab, startPtr=WALPointer [idx=23, fileOff=447755, len=2010], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=112ms, writeCheckpointEntryDuration=216ms, splitAndSortCpPagesDuration=0ms, pages=23, reason='test'] [21:14:07] : [Step 4/5] [2021-11-19 21:14:07,592][INFO ][db-checkpoint-thread-#24445%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:14:07] : [Step 4/5] [2021-11-19 21:14:07,593][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint finished [cpId=736a90c8-6371-4432-a7e0-34a18b7fd6ab, pages=23, markPos=WALPointer [idx=23, fileOff=447755, len=2010], walSegmentsCovered=[], markDuration=329ms, pagesWrite=1ms, fsync=9ms, total=339ms] [21:14:07] : [Step 4/5] [2021-11-19 21:14:07,597][INFO ][disco-notifier-worker-#24425%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=143] [21:14:07] : [Step 4/5] [2021-11-19 21:14:07,598][INFO ][disco-notifier-worker-#24306%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=143] [21:14:07] : [Step 4/5] [2021-11-19 21:14:07,598][INFO ][reencrypt-#24466%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:14:07] : [Step 4/5] [2021-11-19 21:14:07,598][INFO ][reencrypt-#24467%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:14:07] : [Step 4/5] [2021-11-19 21:14:07,799][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10b6f63c-e31c-4573-a225-9f76f500c001, grp=1613773252] [21:14:08] : [Step 4/5] [2021-11-19 21:14:08,389][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint started [checkpointId=a065ecaa-eb3f-414b-8d31-70faf96e2d4f, startPtr=WALPointer [idx=23, fileOff=644567, len=2048], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=1ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=178ms, writeCheckpointEntryDuration=411ms, splitAndSortCpPagesDuration=0ms, pages=23, reason='test'] [21:14:08] : [Step 4/5] [2021-11-19 21:14:08,399][INFO ][db-checkpoint-thread-#24450%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:14:08] : [Step 4/5] [2021-11-19 21:14:08,399][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint finished [cpId=a065ecaa-eb3f-414b-8d31-70faf96e2d4f, pages=23, markPos=WALPointer [idx=23, fileOff=644567, len=2048], walSegmentsCovered=[], markDuration=591ms, pagesWrite=1ms, fsync=8ms, total=600ms] [21:14:08] : [Step 4/5] [2021-11-19 21:14:08,400][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00cce8f9-a2b3-4d32-a95a-7f6eb6335000, grp=1613773252] [21:14:08] : [Step 4/5] [2021-11-19 21:14:08,408][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint started [checkpointId=32b7def9-ed0d-408a-a68e-9e853b0f2f67, startPtr=WALPointer [idx=23, fileOff=640172, len=2010], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=6ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=0ms, pages=23, reason='test'] [21:14:08] : [Step 4/5] [2021-11-19 21:14:08,418][INFO ][db-checkpoint-thread-#24445%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:14:08] : [Step 4/5] [2021-11-19 21:14:08,418][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint finished [cpId=32b7def9-ed0d-408a-a68e-9e853b0f2f67, pages=23, markPos=WALPointer [idx=23, fileOff=640172, len=2010], walSegmentsCovered=[], markDuration=8ms, pagesWrite=1ms, fsync=8ms, total=18ms] [21:14:08] : [Step 4/5] [2021-11-19 21:14:08,425][INFO ][disco-notifier-worker-#24306%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=144] [21:14:08] : [Step 4/5] [2021-11-19 21:14:08,425][INFO ][reencrypt-#24467%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:14:08] : [Step 4/5] [2021-11-19 21:14:08,426][INFO ][disco-notifier-worker-#24425%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=144] [21:14:08] : [Step 4/5] [2021-11-19 21:14:08,427][INFO ][reencrypt-#24466%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:14:08] : [Step 4/5] [2021-11-19 21:14:08,628][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10b6f63c-e31c-4573-a225-9f76f500c001, grp=1613773252] [21:14:09] : [Step 4/5] [2021-11-19 21:14:09,118][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint started [checkpointId=63cb4097-4975-48a0-ab44-900ffb60918c, startPtr=WALPointer [idx=23, fileOff=845347, len=2048], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=67ms, writeCheckpointEntryDuration=422ms, splitAndSortCpPagesDuration=0ms, pages=25, reason='test'] [21:14:09] : [Step 4/5] [2021-11-19 21:14:09,588][INFO ][db-checkpoint-thread-#24450%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:14:09] : [Step 4/5] [2021-11-19 21:14:09,589][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint finished [cpId=63cb4097-4975-48a0-ab44-900ffb60918c, pages=25, markPos=WALPointer [idx=23, fileOff=845347, len=2048], walSegmentsCovered=[], markDuration=490ms, pagesWrite=1ms, fsync=469ms, total=961ms] [21:14:09] : [Step 4/5] [2021-11-19 21:14:09,589][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00cce8f9-a2b3-4d32-a95a-7f6eb6335000, grp=1613773252] [21:14:09] : [Step 4/5] [2021-11-19 21:14:09,605][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint started [checkpointId=2afdf44d-a6ab-4b5b-9d25-58f494334db2, startPtr=WALPointer [idx=23, fileOff=840914, len=2010], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=6ms, writeCheckpointEntryDuration=9ms, splitAndSortCpPagesDuration=0ms, pages=25, reason='test'] [21:14:09] : [Step 4/5] [2021-11-19 21:14:09,615][INFO ][db-checkpoint-thread-#24445%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:14:09] : [Step 4/5] [2021-11-19 21:14:09,615][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint finished [cpId=2afdf44d-a6ab-4b5b-9d25-58f494334db2, pages=25, markPos=WALPointer [idx=23, fileOff=840914, len=2010], walSegmentsCovered=[], markDuration=16ms, pagesWrite=1ms, fsync=8ms, total=25ms] [21:14:09] : [Step 4/5] [2021-11-19 21:14:09,621][INFO ][disco-notifier-worker-#24425%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=145] [21:14:09] : [Step 4/5] [2021-11-19 21:14:09,621][INFO ][disco-notifier-worker-#24306%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=145] [21:14:09] : [Step 4/5] [2021-11-19 21:14:09,622][INFO ][reencrypt-#24466%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:14:09] : [Step 4/5] [2021-11-19 21:14:09,622][INFO ][reencrypt-#24467%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:14:09] : [Step 4/5] [2021-11-19 21:14:09,623][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10b6f63c-e31c-4573-a225-9f76f500c001, grp=1613773252] [21:14:09] : [Step 4/5] [2021-11-19 21:14:09,626][INFO ][wal-file-archiver%grid-1-#24440%grid-1%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=23, segIdx=3, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000003.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000023.wal] [21:14:09] : [Step 4/5] [2021-11-19 21:14:09,627][INFO ][wal-file-cleaner%grid-1-#24441%grid-1%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=14, currSize=10.0 MB, maxSize=20.0 MB] [21:14:09] : [Step 4/5] [2021-11-19 21:14:09,628][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint started [checkpointId=3befe09a-7612-4150-8734-fd00ff8e08ae, startPtr=WALPointer [idx=24, fileOff=29, len=2048], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=2ms, walCpRecordFsyncDuration=0ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=1ms, pages=25, reason='test'] [21:14:09] : [Step 4/5] [2021-11-19 21:14:09,630][INFO ][wal-file-cleaner%grid-1-#24441%grid-1%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:14:09] : [Step 4/5] [2021-11-19 21:14:09,642][INFO ][wal-file-archiver%grid-1-#24440%grid-1%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000003.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000023.wal] [21:14:09] : [Step 4/5] [2021-11-19 21:14:09,653][INFO ][db-checkpoint-thread-#24450%grid-1%][GridEncryptionManager] Previous encryption keys were removed [grpId=1613773252, keyIds=[87, 88, 89, 90, 91]] [21:14:09] : [Step 4/5] [2021-11-19 21:14:09,653][INFO ][db-checkpoint-thread-#24450%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:14:09] : [Step 4/5] [2021-11-19 21:14:09,653][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint finished [cpId=3befe09a-7612-4150-8734-fd00ff8e08ae, pages=25, markPos=WALPointer [idx=24, fileOff=29, len=2048], walSegmentsCovered=[23], markDuration=5ms, pagesWrite=0ms, fsync=24ms, total=29ms] [21:14:09] : [Step 4/5] [2021-11-19 21:14:09,654][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00cce8f9-a2b3-4d32-a95a-7f6eb6335000, grp=1613773252] [21:14:09] : [Step 4/5] [2021-11-19 21:14:09,661][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint started [checkpointId=ea0e1fca-a83e-480c-a9c5-94e8d6303efc, startPtr=WALPointer [idx=23, fileOff=1043230, len=2010], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=4ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=0ms, pages=25, reason='test'] [21:14:09] : [Step 4/5] [2021-11-19 21:14:09,670][INFO ][db-checkpoint-thread-#24445%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:14:09] : [Step 4/5] [2021-11-19 21:14:09,671][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint finished [cpId=ea0e1fca-a83e-480c-a9c5-94e8d6303efc, pages=25, markPos=WALPointer [idx=23, fileOff=1043230, len=2010], walSegmentsCovered=[], markDuration=7ms, pagesWrite=1ms, fsync=7ms, total=16ms] [21:14:09] : [Step 4/5] [2021-11-19 21:14:09,679][INFO ][wal-file-archiver%grid-0-#24437%grid-0%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=23, segIdx=3, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000003.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000023.wal] [21:14:09] : [Step 4/5] [2021-11-19 21:14:09,680][INFO ][wal-file-cleaner%grid-0-#24438%grid-0%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=14, currSize=10.0 MB, maxSize=20.0 MB] [21:14:09] : [Step 4/5] [2021-11-19 21:14:09,682][INFO ][wal-file-cleaner%grid-0-#24438%grid-0%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:14:09] : [Step 4/5] [2021-11-19 21:14:09,683][INFO ][disco-notifier-worker-#24306%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=146] [21:14:09] : [Step 4/5] [2021-11-19 21:14:09,683][INFO ][disco-notifier-worker-#24425%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=146] [21:14:09] : [Step 4/5] [2021-11-19 21:14:09,683][INFO ][reencrypt-#24467%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:14:09] : [Step 4/5] [2021-11-19 21:14:09,684][INFO ][reencrypt-#24466%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:14:09] : [Step 4/5] [2021-11-19 21:14:09,690][INFO ][wal-file-archiver%grid-0-#24437%grid-0%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000003.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000023.wal] [21:14:09] : [Step 4/5] [2021-11-19 21:14:09,700][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10b6f63c-e31c-4573-a225-9f76f500c001, grp=1613773252] [21:14:09] : [Step 4/5] [2021-11-19 21:14:09,710][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint started [checkpointId=ef1e3d71-12c8-4b33-b8b5-831eb8844905, startPtr=WALPointer [idx=24, fileOff=246374, len=2048], checkpointBeforeLockTime=3ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=1ms, checkpointLockHoldTime=4ms, walCpRecordFsyncDuration=0ms, writeCheckpointEntryDuration=2ms, splitAndSortCpPagesDuration=0ms, pages=26, reason='test'] [21:14:09] : [Step 4/5] [2021-11-19 21:14:09,720][INFO ][db-checkpoint-thread-#24450%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:14:09] : [Step 4/5] [2021-11-19 21:14:09,720][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint finished [cpId=ef1e3d71-12c8-4b33-b8b5-831eb8844905, pages=26, markPos=WALPointer [idx=24, fileOff=246374, len=2048], walSegmentsCovered=[], markDuration=7ms, pagesWrite=1ms, fsync=8ms, total=19ms] [21:14:09] : [Step 4/5] [2021-11-19 21:14:09,720][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00cce8f9-a2b3-4d32-a95a-7f6eb6335000, grp=1613773252] [21:14:09] : [Step 4/5] [2021-11-19 21:14:09,729][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint started [checkpointId=c5cbc432-ba86-4b83-9e0d-d90eda242a5e, startPtr=WALPointer [idx=24, fileOff=205078, len=2010], checkpointBeforeLockTime=3ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=1ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=3ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=0ms, pages=25, reason='test'] [21:14:09] : [Step 4/5] [2021-11-19 21:14:09,741][INFO ][db-checkpoint-thread-#24445%grid-0%][GridEncryptionManager] Previous encryption keys were removed [grpId=1613773252, keyIds=[87, 88, 89, 90, 91]] [21:14:09] : [Step 4/5] [2021-11-19 21:14:09,741][INFO ][db-checkpoint-thread-#24445%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:14:09] : [Step 4/5] [2021-11-19 21:14:09,742][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint finished [cpId=c5cbc432-ba86-4b83-9e0d-d90eda242a5e, pages=25, markPos=WALPointer [idx=24, fileOff=205078, len=2010], walSegmentsCovered=[23], markDuration=6ms, pagesWrite=0ms, fsync=12ms, total=21ms] [21:14:09] : [Step 4/5] [2021-11-19 21:14:09,749][INFO ][disco-notifier-worker-#24306%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=147] [21:14:09] : [Step 4/5] [2021-11-19 21:14:09,749][INFO ][disco-notifier-worker-#24425%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=147] [21:14:09] : [Step 4/5] [2021-11-19 21:14:09,749][INFO ][reencrypt-#24467%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:14:09] : [Step 4/5] [2021-11-19 21:14:09,750][INFO ][reencrypt-#24466%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:14:09] : [Step 4/5] [2021-11-19 21:14:09,951][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10b6f63c-e31c-4573-a225-9f76f500c001, grp=1613773252] [21:14:10] : [Step 4/5] [2021-11-19 21:14:10,155][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint started [checkpointId=6e71dbd3-04f2-4d53-8574-6f9182d5dc30, startPtr=WALPointer [idx=24, fileOff=435403, len=2048], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=86ms, writeCheckpointEntryDuration=117ms, splitAndSortCpPagesDuration=0ms, pages=23, reason='test'] [21:14:10] : [Step 4/5] [2021-11-19 21:14:10,165][INFO ][db-checkpoint-thread-#24450%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:14:10] : [Step 4/5] [2021-11-19 21:14:10,165][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint finished [cpId=6e71dbd3-04f2-4d53-8574-6f9182d5dc30, pages=23, markPos=WALPointer [idx=24, fileOff=435403, len=2048], walSegmentsCovered=[], markDuration=204ms, pagesWrite=0ms, fsync=9ms, total=214ms] [21:14:10] : [Step 4/5] [2021-11-19 21:14:10,165][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00cce8f9-a2b3-4d32-a95a-7f6eb6335000, grp=1613773252] [21:14:10] : [Step 4/5] [2021-11-19 21:14:10,174][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint started [checkpointId=bddfe47d-9221-4896-89ac-dc174390b8b3, startPtr=WALPointer [idx=24, fileOff=439291, len=2010], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=7ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=0ms, pages=23, reason='test'] [21:14:10] : [Step 4/5] [2021-11-19 21:14:10,184][INFO ][db-checkpoint-thread-#24445%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:14:10] : [Step 4/5] [2021-11-19 21:14:10,184][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint finished [cpId=bddfe47d-9221-4896-89ac-dc174390b8b3, pages=23, markPos=WALPointer [idx=24, fileOff=439291, len=2010], walSegmentsCovered=[], markDuration=9ms, pagesWrite=1ms, fsync=8ms, total=18ms] [21:14:10] : [Step 4/5] [2021-11-19 21:14:10,190][INFO ][disco-notifier-worker-#24306%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=148] [21:14:10] : [Step 4/5] [2021-11-19 21:14:10,190][INFO ][disco-notifier-worker-#24425%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=148] [21:14:10] : [Step 4/5] [2021-11-19 21:14:10,190][INFO ][reencrypt-#24467%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:14:10] : [Step 4/5] [2021-11-19 21:14:10,190][INFO ][reencrypt-#24466%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:14:10] : [Step 4/5] [2021-11-19 21:14:10,391][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10b6f63c-e31c-4573-a225-9f76f500c001, grp=1613773252] [21:14:10] : [Step 4/5] [2021-11-19 21:14:10,545][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint started [checkpointId=57d441b0-6918-4a47-9a54-a2654f4c87e0, startPtr=WALPointer [idx=24, fileOff=627858, len=2048], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=53ms, writeCheckpointEntryDuration=100ms, splitAndSortCpPagesDuration=0ms, pages=23, reason='test'] [21:14:10] : [Step 4/5] [2021-11-19 21:14:10,775][INFO ][db-checkpoint-thread-#24450%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:14:10] : [Step 4/5] [2021-11-19 21:14:10,776][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint finished [cpId=57d441b0-6918-4a47-9a54-a2654f4c87e0, pages=23, markPos=WALPointer [idx=24, fileOff=627858, len=2048], walSegmentsCovered=[], markDuration=154ms, pagesWrite=0ms, fsync=230ms, total=384ms] [21:14:10] : [Step 4/5] [2021-11-19 21:14:10,776][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00cce8f9-a2b3-4d32-a95a-7f6eb6335000, grp=1613773252] [21:14:11] : [Step 4/5] [2021-11-19 21:14:11,066][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint started [checkpointId=b39d6647-f312-46e2-8af4-c34aea8aeea9, startPtr=WALPointer [idx=24, fileOff=631708, len=2010], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=148ms, writeCheckpointEntryDuration=141ms, splitAndSortCpPagesDuration=0ms, pages=23, reason='test'] [21:14:11] : [Step 4/5] [2021-11-19 21:14:11,115][INFO ][db-checkpoint-thread-#24445%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:14:11] : [Step 4/5] [2021-11-19 21:14:11,115][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint finished [cpId=b39d6647-f312-46e2-8af4-c34aea8aeea9, pages=23, markPos=WALPointer [idx=24, fileOff=631708, len=2010], walSegmentsCovered=[], markDuration=290ms, pagesWrite=0ms, fsync=48ms, total=338ms] [21:14:11] : [Step 4/5] [2021-11-19 21:14:11,121][INFO ][disco-notifier-worker-#24306%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=149] [21:14:11] : [Step 4/5] [2021-11-19 21:14:11,121][INFO ][disco-notifier-worker-#24425%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=149] [21:14:11] : [Step 4/5] [2021-11-19 21:14:11,121][INFO ][reencrypt-#24467%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:14:11] : [Step 4/5] [2021-11-19 21:14:11,121][INFO ][reencrypt-#24466%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:14:11] : [Step 4/5] [2021-11-19 21:14:11,322][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10b6f63c-e31c-4573-a225-9f76f500c001, grp=1613773252] [21:14:12] : [Step 4/5] [2021-11-19 21:14:12,649][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint started [checkpointId=2ff210a9-bfc9-4d95-9191-42f50f507dc3, startPtr=WALPointer [idx=24, fileOff=828638, len=2048], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=167ms, writeCheckpointEntryDuration=1159ms, splitAndSortCpPagesDuration=0ms, pages=25, reason='test'] [21:14:12] : [Step 4/5] [2021-11-19 21:14:12,753][INFO ][db-checkpoint-thread-#24450%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:14:12] : [Step 4/5] [2021-11-19 21:14:12,753][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint finished [cpId=2ff210a9-bfc9-4d95-9191-42f50f507dc3, pages=25, markPos=WALPointer [idx=24, fileOff=828638, len=2048], walSegmentsCovered=[], markDuration=1327ms, pagesWrite=1ms, fsync=102ms, total=1430ms] [21:14:12] : [Step 4/5] [2021-11-19 21:14:12,753][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00cce8f9-a2b3-4d32-a95a-7f6eb6335000, grp=1613773252] [21:14:12] : [Step 4/5] [2021-11-19 21:14:12,762][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint started [checkpointId=4245a524-d5e7-4ad5-b2f1-2a1bad1c7ac9, startPtr=WALPointer [idx=24, fileOff=832450, len=2010], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=5ms, writeCheckpointEntryDuration=2ms, splitAndSortCpPagesDuration=0ms, pages=25, reason='test'] [21:14:12] : [Step 4/5] [2021-11-19 21:14:12,771][INFO ][db-checkpoint-thread-#24445%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:14:12] : [Step 4/5] [2021-11-19 21:14:12,771][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint finished [cpId=4245a524-d5e7-4ad5-b2f1-2a1bad1c7ac9, pages=25, markPos=WALPointer [idx=24, fileOff=832450, len=2010], walSegmentsCovered=[], markDuration=7ms, pagesWrite=1ms, fsync=8ms, total=17ms] [21:14:12] : [Step 4/5] [2021-11-19 21:14:12,777][INFO ][disco-notifier-worker-#24306%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=150] [21:14:12] : [Step 4/5] [2021-11-19 21:14:12,777][INFO ][reencrypt-#24467%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:14:12] : [Step 4/5] [2021-11-19 21:14:12,777][INFO ][disco-notifier-worker-#24425%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=150] [21:14:12] : [Step 4/5] [2021-11-19 21:14:12,778][INFO ][reencrypt-#24466%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:14:12] : [Step 4/5] [2021-11-19 21:14:12,978][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10b6f63c-e31c-4573-a225-9f76f500c001, grp=1613773252] [21:14:13] : [Step 4/5] [2021-11-19 21:14:13,344][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint started [checkpointId=b0dba77d-95c6-428f-9a78-00673556ae99, startPtr=WALPointer [idx=24, fileOff=1030992, len=2048], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=251ms, writeCheckpointEntryDuration=113ms, splitAndSortCpPagesDuration=0ms, pages=25, reason='test'] [21:14:13] : [Step 4/5] [2021-11-19 21:14:13,353][INFO ][db-checkpoint-thread-#24450%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:14:13] : [Step 4/5] [2021-11-19 21:14:13,353][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint finished [cpId=b0dba77d-95c6-428f-9a78-00673556ae99, pages=25, markPos=WALPointer [idx=24, fileOff=1030992, len=2048], walSegmentsCovered=[], markDuration=366ms, pagesWrite=1ms, fsync=7ms, total=374ms] [21:14:13] : [Step 4/5] [2021-11-19 21:14:13,353][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00cce8f9-a2b3-4d32-a95a-7f6eb6335000, grp=1613773252] [21:14:13] : [Step 4/5] [2021-11-19 21:14:13,362][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint started [checkpointId=98147143-cd0d-4675-859f-7a646295c295, startPtr=WALPointer [idx=24, fileOff=1034766, len=2010], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=1ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=6ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=0ms, pages=25, reason='test'] [21:14:13] : [Step 4/5] [2021-11-19 21:14:13,372][INFO ][db-checkpoint-thread-#24445%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:14:13] : [Step 4/5] [2021-11-19 21:14:13,372][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint finished [cpId=98147143-cd0d-4675-859f-7a646295c295, pages=25, markPos=WALPointer [idx=24, fileOff=1034766, len=2010], walSegmentsCovered=[], markDuration=9ms, pagesWrite=1ms, fsync=8ms, total=18ms] [21:14:13] : [Step 4/5] [2021-11-19 21:14:13,380][INFO ][wal-file-archiver%grid-0-#24437%grid-0%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=24, segIdx=4, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000004.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000024.wal] [21:14:13] : [Step 4/5] [2021-11-19 21:14:13,380][INFO ][wal-file-archiver%grid-1-#24440%grid-1%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=24, segIdx=4, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000004.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000024.wal] [21:14:13] : [Step 4/5] [2021-11-19 21:14:13,382][INFO ][wal-file-cleaner%grid-1-#24441%grid-1%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=15, currSize=10.0 MB, maxSize=20.0 MB] [21:14:13] : [Step 4/5] [2021-11-19 21:14:13,383][INFO ][disco-notifier-worker-#24306%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=151] [21:14:13] : [Step 4/5] [2021-11-19 21:14:13,384][INFO ][disco-notifier-worker-#24425%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=151] [21:14:13] : [Step 4/5] [2021-11-19 21:14:13,384][INFO ][reencrypt-#24467%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:14:13] : [Step 4/5] [2021-11-19 21:14:13,384][INFO ][reencrypt-#24466%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:14:13] : [Step 4/5] [2021-11-19 21:14:13,384][INFO ][wal-file-cleaner%grid-0-#24438%grid-0%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=15, currSize=10.0 MB, maxSize=20.0 MB] [21:14:13] : [Step 4/5] [2021-11-19 21:14:13,385][INFO ][wal-file-cleaner%grid-1-#24441%grid-1%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:14:13] : [Step 4/5] [2021-11-19 21:14:13,387][INFO ][wal-file-cleaner%grid-0-#24438%grid-0%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:14:13] : [Step 4/5] [2021-11-19 21:14:13,390][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10b6f63c-e31c-4573-a225-9f76f500c001, grp=1613773252] [21:14:13] : [Step 4/5] [2021-11-19 21:14:13,394][INFO ][wal-file-archiver%grid-0-#24437%grid-0%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000004.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000024.wal] [21:14:13] : [Step 4/5] [2021-11-19 21:14:13,394][INFO ][wal-file-archiver%grid-1-#24440%grid-1%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000004.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000024.wal] [21:14:13] : [Step 4/5] [2021-11-19 21:14:13,404][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint started [checkpointId=bd792a01-8813-4fe9-bd89-be13e026abf2, startPtr=WALPointer [idx=25, fileOff=205078, len=2048], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=8ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=0ms, pages=25, reason='test'] [21:14:13] : [Step 4/5] [2021-11-19 21:14:13,416][INFO ][db-checkpoint-thread-#24450%grid-1%][GridEncryptionManager] Previous encryption keys were removed [grpId=1613773252, keyIds=[92, 93, 94, 95, 96]] [21:14:13] : [Step 4/5] [2021-11-19 21:14:13,416][INFO ][db-checkpoint-thread-#24450%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:14:13] : [Step 4/5] [2021-11-19 21:14:13,417][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint finished [cpId=bd792a01-8813-4fe9-bd89-be13e026abf2, pages=25, markPos=WALPointer [idx=25, fileOff=205078, len=2048], walSegmentsCovered=[24], markDuration=11ms, pagesWrite=1ms, fsync=11ms, total=23ms] [21:14:13] : [Step 4/5] [2021-11-19 21:14:13,417][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00cce8f9-a2b3-4d32-a95a-7f6eb6335000, grp=1613773252] [21:14:13] : [Step 4/5] [2021-11-19 21:14:13,423][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint started [checkpointId=150b70aa-a3d0-4ea3-b9bc-22a12b8dd730, startPtr=WALPointer [idx=25, fileOff=205078, len=2010], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=4ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=0ms, pages=25, reason='test'] [21:14:13] : [Step 4/5] [2021-11-19 21:14:13,435][INFO ][db-checkpoint-thread-#24445%grid-0%][GridEncryptionManager] Previous encryption keys were removed [grpId=1613773252, keyIds=[92, 93, 94, 95, 96]] [21:14:13] : [Step 4/5] [2021-11-19 21:14:13,435][INFO ][db-checkpoint-thread-#24445%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:14:13] : [Step 4/5] [2021-11-19 21:14:13,435][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint finished [cpId=150b70aa-a3d0-4ea3-b9bc-22a12b8dd730, pages=25, markPos=WALPointer [idx=25, fileOff=205078, len=2010], walSegmentsCovered=[24], markDuration=6ms, pagesWrite=1ms, fsync=10ms, total=18ms] [21:14:13] : [Step 4/5] [2021-11-19 21:14:13,441][INFO ][disco-notifier-worker-#24306%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=152] [21:14:13] : [Step 4/5] [2021-11-19 21:14:13,441][INFO ][reencrypt-#24467%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:14:13] : [Step 4/5] [2021-11-19 21:14:13,441][INFO ][disco-notifier-worker-#24425%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=152] [21:14:13] : [Step 4/5] [2021-11-19 21:14:13,442][INFO ][reencrypt-#24466%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:14:13] : [Step 4/5] [2021-11-19 21:14:13,643][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10b6f63c-e31c-4573-a225-9f76f500c001, grp=1613773252] [21:14:13] : [Step 4/5] [2021-11-19 21:14:13,815][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint started [checkpointId=7104f05b-1703-48ea-8342-3fcb986ffa6f, startPtr=WALPointer [idx=25, fileOff=439329, len=2048], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=101ms, writeCheckpointEntryDuration=70ms, splitAndSortCpPagesDuration=0ms, pages=23, reason='test'] [21:14:13] : [Step 4/5] [2021-11-19 21:14:13,825][INFO ][db-checkpoint-thread-#24450%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:14:13] : [Step 4/5] [2021-11-19 21:14:13,825][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint finished [cpId=7104f05b-1703-48ea-8342-3fcb986ffa6f, pages=23, markPos=WALPointer [idx=25, fileOff=439329, len=2048], walSegmentsCovered=[], markDuration=172ms, pagesWrite=1ms, fsync=8ms, total=182ms] [21:14:13] : [Step 4/5] [2021-11-19 21:14:13,826][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00cce8f9-a2b3-4d32-a95a-7f6eb6335000, grp=1613773252] [21:14:13] : [Step 4/5] [2021-11-19 21:14:13,834][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint started [checkpointId=81cbf8e2-7d28-4c1a-9d24-9b3edfb9d261, startPtr=WALPointer [idx=25, fileOff=439291, len=2010], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=6ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=0ms, pages=23, reason='test'] [21:14:13] : [Step 4/5] [2021-11-19 21:14:13,844][INFO ][db-checkpoint-thread-#24445%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:14:13] : [Step 4/5] [2021-11-19 21:14:13,845][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint finished [cpId=81cbf8e2-7d28-4c1a-9d24-9b3edfb9d261, pages=23, markPos=WALPointer [idx=25, fileOff=439291, len=2010], walSegmentsCovered=[], markDuration=8ms, pagesWrite=1ms, fsync=8ms, total=18ms] [21:14:13] : [Step 4/5] [2021-11-19 21:14:13,851][INFO ][disco-notifier-worker-#24306%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=153] [21:14:13] : [Step 4/5] [2021-11-19 21:14:13,851][INFO ][disco-notifier-worker-#24425%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=153] [21:14:13] : [Step 4/5] [2021-11-19 21:14:13,851][INFO ][reencrypt-#24467%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:14:13] : [Step 4/5] [2021-11-19 21:14:13,853][INFO ][reencrypt-#24466%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:14:13] : [Step 4/5] [2021-11-19 21:14:13,854][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10b6f63c-e31c-4573-a225-9f76f500c001, grp=1613773252] [21:14:13] : [Step 4/5] [2021-11-19 21:14:13,858][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint started [checkpointId=039ef1d7-793b-4c5e-bb25-5a5b8f42f175, startPtr=WALPointer [idx=25, fileOff=631784, len=2048], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=1ms, writeCheckpointEntryDuration=2ms, splitAndSortCpPagesDuration=0ms, pages=23, reason='test'] [21:14:13] : [Step 4/5] [2021-11-19 21:14:13,867][INFO ][db-checkpoint-thread-#24450%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:14:13] : [Step 4/5] [2021-11-19 21:14:13,868][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint finished [cpId=039ef1d7-793b-4c5e-bb25-5a5b8f42f175, pages=23, markPos=WALPointer [idx=25, fileOff=631784, len=2048], walSegmentsCovered=[], markDuration=4ms, pagesWrite=1ms, fsync=8ms, total=14ms] [21:14:13] : [Step 4/5] [2021-11-19 21:14:13,868][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00cce8f9-a2b3-4d32-a95a-7f6eb6335000, grp=1613773252] [21:14:13] : [Step 4/5] [2021-11-19 21:14:13,877][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint started [checkpointId=d239f0ab-1ce3-4ab7-a14d-bb398a8893a7, startPtr=WALPointer [idx=25, fileOff=631708, len=2010], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=6ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=0ms, pages=23, reason='test'] [21:14:13] : [Step 4/5] [2021-11-19 21:14:13,890][INFO ][db-checkpoint-thread-#24445%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:14:13] : [Step 4/5] [2021-11-19 21:14:13,890][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint finished [cpId=d239f0ab-1ce3-4ab7-a14d-bb398a8893a7, pages=23, markPos=WALPointer [idx=25, fileOff=631708, len=2010], walSegmentsCovered=[], markDuration=9ms, pagesWrite=1ms, fsync=11ms, total=21ms] [21:14:13] : [Step 4/5] [2021-11-19 21:14:13,898][INFO ][disco-notifier-worker-#24306%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=154] [21:14:13] : [Step 4/5] [2021-11-19 21:14:13,899][INFO ][reencrypt-#24467%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:14:13] : [Step 4/5] [2021-11-19 21:14:13,899][INFO ][disco-notifier-worker-#24425%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=154] [21:14:13] : [Step 4/5] [2021-11-19 21:14:13,904][INFO ][reencrypt-#24466%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:14:13] : [Step 4/5] [2021-11-19 21:14:13,912][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10b6f63c-e31c-4573-a225-9f76f500c001, grp=1613773252] [21:14:13] : [Step 4/5] [2021-11-19 21:14:13,923][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint started [checkpointId=89da12ff-86f4-4880-aeb3-db5c77cb40b2, startPtr=WALPointer [idx=25, fileOff=832564, len=2048], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=7ms, checkpointLockHoldTime=7ms, walCpRecordFsyncDuration=1ms, writeCheckpointEntryDuration=2ms, splitAndSortCpPagesDuration=0ms, pages=25, reason='test'] [21:14:13] : [Step 4/5] [2021-11-19 21:14:13,933][INFO ][db-checkpoint-thread-#24450%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:14:13] : [Step 4/5] [2021-11-19 21:14:13,933][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint finished [cpId=89da12ff-86f4-4880-aeb3-db5c77cb40b2, pages=25, markPos=WALPointer [idx=25, fileOff=832564, len=2048], walSegmentsCovered=[], markDuration=11ms, pagesWrite=1ms, fsync=8ms, total=20ms] [21:14:13] : [Step 4/5] [2021-11-19 21:14:13,933][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00cce8f9-a2b3-4d32-a95a-7f6eb6335000, grp=1613773252] [21:14:13] : [Step 4/5] [2021-11-19 21:14:13,943][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint started [checkpointId=5960fbe3-e422-4adc-a04d-6634e05978f6, startPtr=WALPointer [idx=25, fileOff=832450, len=2010], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=5ms, checkpointLockHoldTime=5ms, walCpRecordFsyncDuration=1ms, writeCheckpointEntryDuration=2ms, splitAndSortCpPagesDuration=0ms, pages=25, reason='test'] [21:14:14] : [Step 4/5] [2021-11-19 21:14:14,438][INFO ][db-checkpoint-thread-#24445%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:14:14] : [Step 4/5] [2021-11-19 21:14:14,438][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint finished [cpId=5960fbe3-e422-4adc-a04d-6634e05978f6, pages=25, markPos=WALPointer [idx=25, fileOff=832450, len=2010], walSegmentsCovered=[], markDuration=9ms, pagesWrite=1ms, fsync=493ms, total=504ms] [21:14:14] : [Step 4/5] [2021-11-19 21:14:14,446][INFO ][disco-notifier-worker-#24306%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=155] [21:14:14] : [Step 4/5] [2021-11-19 21:14:14,446][INFO ][disco-notifier-worker-#24425%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=155] [21:14:14] : [Step 4/5] [2021-11-19 21:14:14,447][INFO ][reencrypt-#24467%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:14:14] : [Step 4/5] [2021-11-19 21:14:14,447][INFO ][reencrypt-#24466%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:14:14] : [Step 4/5] [2021-11-19 21:14:14,649][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10b6f63c-e31c-4573-a225-9f76f500c001, grp=1613773252] [21:14:14] : [Step 4/5] [2021-11-19 21:14:14,847][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint started [checkpointId=3f0e9222-929d-401b-898f-459686250dc1, startPtr=WALPointer [idx=25, fileOff=1034918, len=2048], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=129ms, writeCheckpointEntryDuration=68ms, splitAndSortCpPagesDuration=0ms, pages=25, reason='test'] [21:14:14] : [Step 4/5] [2021-11-19 21:14:14,965][INFO ][db-checkpoint-thread-#24450%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:14:14] : [Step 4/5] [2021-11-19 21:14:14,965][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint finished [cpId=3f0e9222-929d-401b-898f-459686250dc1, pages=25, markPos=WALPointer [idx=25, fileOff=1034918, len=2048], walSegmentsCovered=[], markDuration=198ms, pagesWrite=2ms, fsync=115ms, total=316ms] [21:14:14] : [Step 4/5] [2021-11-19 21:14:14,965][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00cce8f9-a2b3-4d32-a95a-7f6eb6335000, grp=1613773252] [21:14:14] : [Step 4/5] [2021-11-19 21:14:14,974][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint started [checkpointId=5446ddeb-5ec1-4180-9b4e-64617c1c19d0, startPtr=WALPointer [idx=25, fileOff=1034766, len=2010], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=6ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=0ms, pages=25, reason='test'] [21:14:14] : [Step 4/5] [2021-11-19 21:14:14,984][INFO ][db-checkpoint-thread-#24445%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:14:14] : [Step 4/5] [2021-11-19 21:14:14,985][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint finished [cpId=5446ddeb-5ec1-4180-9b4e-64617c1c19d0, pages=25, markPos=WALPointer [idx=25, fileOff=1034766, len=2010], walSegmentsCovered=[], markDuration=9ms, pagesWrite=1ms, fsync=9ms, total=19ms] [21:14:14] : [Step 4/5] [2021-11-19 21:14:14,992][INFO ][wal-file-archiver%grid-0-#24437%grid-0%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=25, segIdx=5, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000005.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000025.wal] [21:14:14] : [Step 4/5] [2021-11-19 21:14:14,992][INFO ][wal-file-archiver%grid-1-#24440%grid-1%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=25, segIdx=5, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000005.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000025.wal] [21:14:14] : [Step 4/5] [2021-11-19 21:14:14,993][INFO ][wal-file-cleaner%grid-0-#24438%grid-0%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=16, currSize=9.9 MB, maxSize=20.0 MB] [21:14:14] : [Step 4/5] [2021-11-19 21:14:14,994][INFO ][wal-file-cleaner%grid-1-#24441%grid-1%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=16, currSize=9.9 MB, maxSize=20.0 MB] [21:14:14] : [Step 4/5] [2021-11-19 21:14:14,996][INFO ][wal-file-cleaner%grid-0-#24438%grid-0%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=8.9 MB, maxSize=20.0 MB] [21:14:14] : [Step 4/5] [2021-11-19 21:14:14,996][INFO ][wal-file-cleaner%grid-1-#24441%grid-1%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=8.9 MB, maxSize=20.0 MB] [21:14:14] : [Step 4/5] [2021-11-19 21:14:14,997][INFO ][disco-notifier-worker-#24306%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=156] [21:14:14] : [Step 4/5] [2021-11-19 21:14:14,999][INFO ][disco-notifier-worker-#24425%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=156] [21:14:14] : [Step 4/5] [2021-11-19 21:14:14,999][INFO ][reencrypt-#24467%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:14:15] : [Step 4/5] [2021-11-19 21:14:14,999][INFO ][reencrypt-#24466%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:14:15] : [Step 4/5] [2021-11-19 21:14:15,011][INFO ][wal-file-archiver%grid-0-#24437%grid-0%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000005.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000025.wal] [21:14:15] : [Step 4/5] [2021-11-19 21:14:15,011][INFO ][wal-file-archiver%grid-1-#24440%grid-1%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000005.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000025.wal] [21:14:15] : [Step 4/5] [2021-11-19 21:14:15,200][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10b6f63c-e31c-4573-a225-9f76f500c001, grp=1613773252] [21:14:15] : [Step 4/5] [2021-11-19 21:14:15,444][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint started [checkpointId=d92af5e1-0bbe-44a9-b6b8-af3fb13a15b8, startPtr=WALPointer [idx=26, fileOff=205034, len=2048], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=27ms, writeCheckpointEntryDuration=215ms, splitAndSortCpPagesDuration=0ms, pages=25, reason='test'] [21:14:15] : [Step 4/5] [2021-11-19 21:14:15,456][INFO ][db-checkpoint-thread-#24450%grid-1%][GridEncryptionManager] Previous encryption keys were removed [grpId=1613773252, keyIds=[97, 98, 99, 100, 101, 102]] [21:14:15] : [Step 4/5] [2021-11-19 21:14:15,456][INFO ][db-checkpoint-thread-#24450%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:14:15] : [Step 4/5] [2021-11-19 21:14:15,456][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint finished [cpId=d92af5e1-0bbe-44a9-b6b8-af3fb13a15b8, pages=25, markPos=WALPointer [idx=26, fileOff=205034, len=2048], walSegmentsCovered=[25], markDuration=243ms, pagesWrite=1ms, fsync=11ms, total=255ms] [21:14:15] : [Step 4/5] [2021-11-19 21:14:15,456][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00cce8f9-a2b3-4d32-a95a-7f6eb6335000, grp=1613773252] [21:14:15] : [Step 4/5] [2021-11-19 21:14:15,496][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint started [checkpointId=627a5c0b-38a7-46b5-b3e6-1dadcebaf4b0, startPtr=WALPointer [idx=26, fileOff=205034, len=2010], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=1ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=36ms, writeCheckpointEntryDuration=2ms, splitAndSortCpPagesDuration=0ms, pages=25, reason='test'] [21:14:15] : [Step 4/5] [2021-11-19 21:14:15,508][INFO ][db-checkpoint-thread-#24445%grid-0%][GridEncryptionManager] Previous encryption keys were removed [grpId=1613773252, keyIds=[97, 98, 99, 100, 101, 102]] [21:14:15] : [Step 4/5] [2021-11-19 21:14:15,508][INFO ][db-checkpoint-thread-#24445%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:14:15] : [Step 4/5] [2021-11-19 21:14:15,509][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint finished [cpId=627a5c0b-38a7-46b5-b3e6-1dadcebaf4b0, pages=25, markPos=WALPointer [idx=26, fileOff=205034, len=2010], walSegmentsCovered=[25], markDuration=40ms, pagesWrite=1ms, fsync=11ms, total=52ms] [21:14:15] : [Step 4/5] [2021-11-19 21:14:15,514][INFO ][disco-notifier-worker-#24306%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=157] [21:14:15] : [Step 4/5] [2021-11-19 21:14:15,514][INFO ][disco-notifier-worker-#24425%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=157] [21:14:15] : [Step 4/5] [2021-11-19 21:14:15,514][INFO ][reencrypt-#24467%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:14:15] : [Step 4/5] [2021-11-19 21:14:15,515][INFO ][reencrypt-#24466%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:14:15] : [Step 4/5] [2021-11-19 21:14:15,716][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10b6f63c-e31c-4573-a225-9f76f500c001, grp=1613773252] [21:14:15] : [Step 4/5] [2021-11-19 21:14:15,720][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint started [checkpointId=f8c33e30-3e8a-404e-89b3-6edcc06e87c1, startPtr=WALPointer [idx=26, fileOff=448335, len=2048], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=1ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=1ms, pages=26, reason='test'] [21:14:15] : [Step 4/5] [2021-11-19 21:14:15,729][INFO ][db-checkpoint-thread-#24450%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:14:15] : [Step 4/5] [2021-11-19 21:14:15,730][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint finished [cpId=f8c33e30-3e8a-404e-89b3-6edcc06e87c1, pages=26, markPos=WALPointer [idx=26, fileOff=448335, len=2048], walSegmentsCovered=[], markDuration=3ms, pagesWrite=1ms, fsync=9ms, total=14ms] [21:14:15] : [Step 4/5] [2021-11-19 21:14:15,730][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00cce8f9-a2b3-4d32-a95a-7f6eb6335000, grp=1613773252] [21:14:15] : [Step 4/5] [2021-11-19 21:14:15,739][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint started [checkpointId=b71e195d-fa81-4364-93a3-ff0eda6b9bd6, startPtr=WALPointer [idx=26, fileOff=448297, len=2010], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=7ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=0ms, pages=26, reason='test'] [21:14:15] : [Step 4/5] [2021-11-19 21:14:15,749][INFO ][db-checkpoint-thread-#24445%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:14:15] : [Step 4/5] [2021-11-19 21:14:15,749][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint finished [cpId=b71e195d-fa81-4364-93a3-ff0eda6b9bd6, pages=26, markPos=WALPointer [idx=26, fileOff=448297, len=2010], walSegmentsCovered=[], markDuration=9ms, pagesWrite=1ms, fsync=8ms, total=19ms] [21:14:15] : [Step 4/5] [2021-11-19 21:14:15,754][INFO ][disco-notifier-worker-#24306%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=158] [21:14:15] : [Step 4/5] [2021-11-19 21:14:15,754][INFO ][disco-notifier-worker-#24425%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=158] [21:14:15] : [Step 4/5] [2021-11-19 21:14:15,755][INFO ][reencrypt-#24467%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:14:15] : [Step 4/5] [2021-11-19 21:14:15,755][INFO ][reencrypt-#24466%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:14:15] : [Step 4/5] [2021-11-19 21:14:15,956][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10b6f63c-e31c-4573-a225-9f76f500c001, grp=1613773252] [21:14:15] : [Step 4/5] [2021-11-19 21:14:15,959][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint started [checkpointId=5a34c1d5-45a1-4470-a939-5bd4b394e19f, startPtr=WALPointer [idx=26, fileOff=637364, len=2048], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=0ms, writeCheckpointEntryDuration=2ms, splitAndSortCpPagesDuration=0ms, pages=23, reason='test'] [21:14:15] : [Step 4/5] [2021-11-19 21:14:15,969][INFO ][db-checkpoint-thread-#24450%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:14:15] : [Step 4/5] [2021-11-19 21:14:15,969][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint finished [cpId=5a34c1d5-45a1-4470-a939-5bd4b394e19f, pages=23, markPos=WALPointer [idx=26, fileOff=637364, len=2048], walSegmentsCovered=[], markDuration=3ms, pagesWrite=0ms, fsync=9ms, total=13ms] [21:14:15] : [Step 4/5] [2021-11-19 21:14:15,969][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00cce8f9-a2b3-4d32-a95a-7f6eb6335000, grp=1613773252] [21:14:15] : [Step 4/5] [2021-11-19 21:14:15,977][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint started [checkpointId=177fff0d-0358-418d-8956-b54a473b66d0, startPtr=WALPointer [idx=26, fileOff=637288, len=2010], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=6ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=0ms, pages=23, reason='test'] [21:14:15] : [Step 4/5] [2021-11-19 21:14:15,987][INFO ][db-checkpoint-thread-#24445%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:14:15] : [Step 4/5] [2021-11-19 21:14:15,987][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint finished [cpId=177fff0d-0358-418d-8956-b54a473b66d0, pages=23, markPos=WALPointer [idx=26, fileOff=637288, len=2010], walSegmentsCovered=[], markDuration=8ms, pagesWrite=1ms, fsync=8ms, total=17ms] [21:14:15] : [Step 4/5] [2021-11-19 21:14:15,992][INFO ][disco-notifier-worker-#24306%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=159] [21:14:15] : [Step 4/5] [2021-11-19 21:14:15,993][INFO ][reencrypt-#24467%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:14:15] : [Step 4/5] [2021-11-19 21:14:15,993][INFO ][disco-notifier-worker-#24425%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=159] [21:14:15] : [Step 4/5] [2021-11-19 21:14:15,993][INFO ][reencrypt-#24466%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:14:15] : [Step 4/5] [2021-11-19 21:14:15,994][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10b6f63c-e31c-4573-a225-9f76f500c001, grp=1613773252] [21:14:15] : [Step 4/5] [2021-11-19 21:14:15,998][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint started [checkpointId=3ad6098d-1dff-4958-970d-ea347fda330f, startPtr=WALPointer [idx=26, fileOff=829819, len=2048], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=1ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=0ms, pages=23, reason='test'] [21:14:16] : [Step 4/5] [2021-11-19 21:14:16,007][INFO ][db-checkpoint-thread-#24450%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:14:16] : [Step 4/5] [2021-11-19 21:14:16,008][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint finished [cpId=3ad6098d-1dff-4958-970d-ea347fda330f, pages=23, markPos=WALPointer [idx=26, fileOff=829819, len=2048], walSegmentsCovered=[], markDuration=3ms, pagesWrite=1ms, fsync=8ms, total=12ms] [21:14:16] : [Step 4/5] [2021-11-19 21:14:16,008][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00cce8f9-a2b3-4d32-a95a-7f6eb6335000, grp=1613773252] [21:14:16] : [Step 4/5] [2021-11-19 21:14:16,017][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint started [checkpointId=1300bdd7-110e-4d6f-9b2d-c2cbc6145077, startPtr=WALPointer [idx=26, fileOff=829705, len=2010], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=7ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=0ms, pages=23, reason='test'] [21:14:16] : [Step 4/5] [2021-11-19 21:14:16,027][INFO ][db-checkpoint-thread-#24445%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:14:16] : [Step 4/5] [2021-11-19 21:14:16,027][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint finished [cpId=1300bdd7-110e-4d6f-9b2d-c2cbc6145077, pages=23, markPos=WALPointer [idx=26, fileOff=829705, len=2010], walSegmentsCovered=[], markDuration=9ms, pagesWrite=1ms, fsync=8ms, total=18ms] [21:14:16] : [Step 4/5] [2021-11-19 21:14:16,032][INFO ][disco-notifier-worker-#24306%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=160] [21:14:16] : [Step 4/5] [2021-11-19 21:14:16,032][INFO ][reencrypt-#24467%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:14:16] : [Step 4/5] [2021-11-19 21:14:16,032][INFO ][disco-notifier-worker-#24425%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=160] [21:14:16] : [Step 4/5] [2021-11-19 21:14:16,033][INFO ][reencrypt-#24466%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:14:16] : [Step 4/5] [2021-11-19 21:14:16,234][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10b6f63c-e31c-4573-a225-9f76f500c001, grp=1613773252] [21:14:16] : [Step 4/5] [2021-11-19 21:14:16,495][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint started [checkpointId=fa2fce01-cf3d-42d4-8f59-b9ba18c862a7, startPtr=WALPointer [idx=26, fileOff=1030599, len=2048], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=1ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=86ms, writeCheckpointEntryDuration=174ms, splitAndSortCpPagesDuration=0ms, pages=25, reason='test'] [21:14:16] : [Step 4/5] [2021-11-19 21:14:16,510][INFO ][db-checkpoint-thread-#24450%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:14:16] : [Step 4/5] [2021-11-19 21:14:16,511][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint finished [cpId=fa2fce01-cf3d-42d4-8f59-b9ba18c862a7, pages=25, markPos=WALPointer [idx=26, fileOff=1030599, len=2048], walSegmentsCovered=[], markDuration=262ms, pagesWrite=3ms, fsync=12ms, total=277ms] [21:14:16] : [Step 4/5] [2021-11-19 21:14:16,511][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00cce8f9-a2b3-4d32-a95a-7f6eb6335000, grp=1613773252] [21:14:16] : [Step 4/5] [2021-11-19 21:14:16,527][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint started [checkpointId=13ea0c5c-c3ca-4b04-9838-e134ba7bec54, startPtr=WALPointer [idx=26, fileOff=1030447, len=2010], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=6ms, writeCheckpointEntryDuration=9ms, splitAndSortCpPagesDuration=0ms, pages=25, reason='test'] [21:14:16] : [Step 4/5] [2021-11-19 21:14:16,537][INFO ][db-checkpoint-thread-#24445%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:14:16] : [Step 4/5] [2021-11-19 21:14:16,537][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint finished [cpId=13ea0c5c-c3ca-4b04-9838-e134ba7bec54, pages=25, markPos=WALPointer [idx=26, fileOff=1030447, len=2010], walSegmentsCovered=[], markDuration=16ms, pagesWrite=1ms, fsync=8ms, total=25ms] [21:14:16] : [Step 4/5] [2021-11-19 21:14:16,545][INFO ][wal-file-archiver%grid-1-#24440%grid-1%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=26, segIdx=6, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000006.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000026.wal] [21:14:16] : [Step 4/5] [2021-11-19 21:14:16,545][INFO ][wal-file-archiver%grid-0-#24437%grid-0%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=26, segIdx=6, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000006.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000026.wal] [21:14:16] : [Step 4/5] [2021-11-19 21:14:16,546][INFO ][wal-file-cleaner%grid-1-#24441%grid-1%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=17, currSize=9.9 MB, maxSize=20.0 MB] [21:14:16] : [Step 4/5] [2021-11-19 21:14:16,547][INFO ][wal-file-cleaner%grid-0-#24438%grid-0%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=17, currSize=9.9 MB, maxSize=20.0 MB] [21:14:16] : [Step 4/5] [2021-11-19 21:14:16,549][INFO ][disco-notifier-worker-#24306%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=161] [21:14:16] : [Step 4/5] [2021-11-19 21:14:16,549][INFO ][reencrypt-#24467%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:14:16] : [Step 4/5] [2021-11-19 21:14:16,549][INFO ][wal-file-cleaner%grid-1-#24441%grid-1%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=8.9 MB, maxSize=20.0 MB] [21:14:16] : [Step 4/5] [2021-11-19 21:14:16,550][INFO ][wal-file-cleaner%grid-0-#24438%grid-0%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=8.9 MB, maxSize=20.0 MB] [21:14:16] : [Step 4/5] [2021-11-19 21:14:16,551][INFO ][sys-#24481%grid-1%][GridEncryptionManager] Previous encryption keys have been removed [grpId=1613773252, keyIds=[103, 104, 105, 106, 107]] [21:14:16] : [Step 4/5] [2021-11-19 21:14:16,554][INFO ][disco-notifier-worker-#24425%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=161] [21:14:16] : [Step 4/5] [2021-11-19 21:14:16,554][INFO ][reencrypt-#24466%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:14:16] : [Step 4/5] [2021-11-19 21:14:16,556][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10b6f63c-e31c-4573-a225-9f76f500c001, grp=1613773252] [21:14:16] : [Step 4/5] [2021-11-19 21:14:16,562][INFO ][wal-file-archiver%grid-0-#24437%grid-0%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000006.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000026.wal] [21:14:16] : [Step 4/5] [2021-11-19 21:14:16,562][INFO ][wal-file-archiver%grid-1-#24440%grid-1%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000006.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000026.wal] [21:14:16] : [Step 4/5] [2021-11-19 21:14:16,572][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint started [checkpointId=419824a0-bb67-4d7c-954e-70763ccb8538, startPtr=WALPointer [idx=27, fileOff=246584, len=2048], checkpointBeforeLockTime=2ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=7ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=0ms, pages=26, reason='test'] [21:14:16] : [Step 4/5] [2021-11-19 21:14:16,582][INFO ][db-checkpoint-thread-#24450%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:14:16] : [Step 4/5] [2021-11-19 21:14:16,582][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint finished [cpId=419824a0-bb67-4d7c-954e-70763ccb8538, pages=26, markPos=WALPointer [idx=27, fileOff=246584, len=2048], walSegmentsCovered=[26], markDuration=9ms, pagesWrite=1ms, fsync=8ms, total=20ms] [21:14:16] : [Step 4/5] [2021-11-19 21:14:16,582][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00cce8f9-a2b3-4d32-a95a-7f6eb6335000, grp=1613773252] [21:14:16] : [Step 4/5] [2021-11-19 21:14:16,592][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint started [checkpointId=9d5a371d-0870-42c9-a5bf-7447ce2b8e05, startPtr=WALPointer [idx=27, fileOff=203460, len=2010], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=6ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=0ms, pages=25, reason='test'] [21:14:16] : [Step 4/5] [2021-11-19 21:14:16,604][INFO ][db-checkpoint-thread-#24445%grid-0%][GridEncryptionManager] Previous encryption keys were removed [grpId=1613773252, keyIds=[103, 104, 105, 106, 107]] [21:14:16] : [Step 4/5] [2021-11-19 21:14:16,604][INFO ][db-checkpoint-thread-#24445%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:14:16] : [Step 4/5] [2021-11-19 21:14:16,605][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint finished [cpId=9d5a371d-0870-42c9-a5bf-7447ce2b8e05, pages=25, markPos=WALPointer [idx=27, fileOff=203460, len=2010], walSegmentsCovered=[26], markDuration=8ms, pagesWrite=1ms, fsync=12ms, total=22ms] [21:14:16] : [Step 4/5] [2021-11-19 21:14:16,611][INFO ][disco-notifier-worker-#24306%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=162] [21:14:16] : [Step 4/5] [2021-11-19 21:14:16,611][INFO ][reencrypt-#24467%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:14:16] : [Step 4/5] [2021-11-19 21:14:16,612][INFO ][disco-notifier-worker-#24425%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=162] [21:14:16] : [Step 4/5] [2021-11-19 21:14:16,612][INFO ][reencrypt-#24466%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:14:16] : [Step 4/5] [2021-11-19 21:14:16,813][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10b6f63c-e31c-4573-a225-9f76f500c001, grp=1613773252] [21:14:17] : [Step 4/5] [2021-11-19 21:14:17,063][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint started [checkpointId=688bd0a9-323f-4887-9893-23ae82d9a4e9, startPtr=WALPointer [idx=27, fileOff=430115, len=2048], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=2ms, checkpointLockHoldTime=2ms, walCpRecordFsyncDuration=87ms, writeCheckpointEntryDuration=160ms, splitAndSortCpPagesDuration=0ms, pages=22, reason='test'] [21:14:17] : [Step 4/5] [2021-11-19 21:14:17,104][INFO ][db-checkpoint-thread-#24450%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:14:17] : [Step 4/5] [2021-11-19 21:14:17,105][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint finished [cpId=688bd0a9-323f-4887-9893-23ae82d9a4e9, pages=22, markPos=WALPointer [idx=27, fileOff=430115, len=2048], walSegmentsCovered=[], markDuration=250ms, pagesWrite=1ms, fsync=40ms, total=291ms] [21:14:17] : [Step 4/5] [2021-11-19 21:14:17,105][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00cce8f9-a2b3-4d32-a95a-7f6eb6335000, grp=1613773252] [21:14:17] : [Step 4/5] [2021-11-19 21:14:17,184][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint started [checkpointId=9fb6a239-2cff-404d-91cb-24c51f5a7b21, startPtr=WALPointer [idx=27, fileOff=446723, len=2010], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=3ms, writeCheckpointEntryDuration=75ms, splitAndSortCpPagesDuration=0ms, pages=26, reason='test'] [21:14:17] : [Step 4/5] [2021-11-19 21:14:17,208][INFO ][db-checkpoint-thread-#24445%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:14:17] : [Step 4/5] [2021-11-19 21:14:17,208][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint finished [cpId=9fb6a239-2cff-404d-91cb-24c51f5a7b21, pages=26, markPos=WALPointer [idx=27, fileOff=446723, len=2010], walSegmentsCovered=[], markDuration=79ms, pagesWrite=0ms, fsync=23ms, total=102ms] [21:14:17] : [Step 4/5] [2021-11-19 21:14:17,214][INFO ][disco-notifier-worker-#24306%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=163] [21:14:17] : [Step 4/5] [2021-11-19 21:14:17,214][INFO ][reencrypt-#24467%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:14:17] : [Step 4/5] [2021-11-19 21:14:17,214][INFO ][disco-notifier-worker-#24425%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=163] [21:14:17] : [Step 4/5] [2021-11-19 21:14:17,215][INFO ][reencrypt-#24466%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:14:17] : [Step 4/5] [2021-11-19 21:14:17,416][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10b6f63c-e31c-4573-a225-9f76f500c001, grp=1613773252] [21:14:17] : [Step 4/5] [2021-11-19 21:14:17,781][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint started [checkpointId=c35a3fc8-59fd-497c-8551-ce6e456479fa, startPtr=WALPointer [idx=27, fileOff=619144, len=2048], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=1ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=212ms, writeCheckpointEntryDuration=152ms, splitAndSortCpPagesDuration=0ms, pages=23, reason='test'] [21:14:18] : [Step 4/5] [2021-11-19 21:14:18,379][INFO ][db-checkpoint-thread-#24450%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:14:18] : [Step 4/5] [2021-11-19 21:14:18,379][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint finished [cpId=c35a3fc8-59fd-497c-8551-ce6e456479fa, pages=23, markPos=WALPointer [idx=27, fileOff=619144, len=2048], walSegmentsCovered=[], markDuration=366ms, pagesWrite=2ms, fsync=595ms, total=963ms] [21:14:18] : [Step 4/5] [2021-11-19 21:14:18,379][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00cce8f9-a2b3-4d32-a95a-7f6eb6335000, grp=1613773252] [21:14:18] : [Step 4/5] [2021-11-19 21:14:18,485][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint started [checkpointId=28ade265-8a08-451c-826f-543acc969381, startPtr=WALPointer [idx=27, fileOff=635714, len=2010], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=91ms, writeCheckpointEntryDuration=13ms, splitAndSortCpPagesDuration=0ms, pages=23, reason='test'] [21:14:18] : [Step 4/5] [2021-11-19 21:14:18,544][INFO ][db-checkpoint-thread-#24445%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:14:18] : [Step 4/5] [2021-11-19 21:14:18,544][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint finished [cpId=28ade265-8a08-451c-826f-543acc969381, pages=23, markPos=WALPointer [idx=27, fileOff=635714, len=2010], walSegmentsCovered=[], markDuration=105ms, pagesWrite=0ms, fsync=58ms, total=164ms] [21:14:18] : [Step 4/5] [2021-11-19 21:14:18,550][INFO ][disco-notifier-worker-#24306%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=164] [21:14:18] : [Step 4/5] [2021-11-19 21:14:18,550][INFO ][reencrypt-#24467%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:14:18] : [Step 4/5] [2021-11-19 21:14:18,552][INFO ][disco-notifier-worker-#24425%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=164] [21:14:18] : [Step 4/5] [2021-11-19 21:14:18,552][INFO ][reencrypt-#24466%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:14:18] : [Step 4/5] [2021-11-19 21:14:18,554][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10b6f63c-e31c-4573-a225-9f76f500c001, grp=1613773252] [21:14:18] : [Step 4/5] [2021-11-19 21:14:18,599][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint started [checkpointId=54a9505a-48cf-4e05-934f-8a7cc014d774, startPtr=WALPointer [idx=27, fileOff=811599, len=2048], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=3ms, writeCheckpointEntryDuration=42ms, splitAndSortCpPagesDuration=0ms, pages=23, reason='test'] [21:14:18] : [Step 4/5] [2021-11-19 21:14:18,621][INFO ][db-checkpoint-thread-#24450%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:14:18] : [Step 4/5] [2021-11-19 21:14:18,621][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint finished [cpId=54a9505a-48cf-4e05-934f-8a7cc014d774, pages=23, markPos=WALPointer [idx=27, fileOff=811599, len=2048], walSegmentsCovered=[], markDuration=46ms, pagesWrite=1ms, fsync=20ms, total=67ms] [21:14:18] : [Step 4/5] [2021-11-19 21:14:18,622][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00cce8f9-a2b3-4d32-a95a-7f6eb6335000, grp=1613773252] [21:14:18] : [Step 4/5] [2021-11-19 21:14:18,638][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint started [checkpointId=011f8215-639b-41af-9b19-4a0091cd9a8d, startPtr=WALPointer [idx=27, fileOff=828131, len=2010], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=5ms, writeCheckpointEntryDuration=10ms, splitAndSortCpPagesDuration=0ms, pages=23, reason='test'] [21:14:18] : [Step 4/5] [2021-11-19 21:14:18,727][INFO ][db-checkpoint-thread-#24445%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:14:18] : [Step 4/5] [2021-11-19 21:14:18,728][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint finished [cpId=011f8215-639b-41af-9b19-4a0091cd9a8d, pages=23, markPos=WALPointer [idx=27, fileOff=828131, len=2010], walSegmentsCovered=[], markDuration=16ms, pagesWrite=1ms, fsync=88ms, total=106ms] [21:14:18] : [Step 4/5] [2021-11-19 21:14:18,733][INFO ][disco-notifier-worker-#24425%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=165] [21:14:18] : [Step 4/5] [2021-11-19 21:14:18,733][INFO ][disco-notifier-worker-#24306%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=165] [21:14:18] : [Step 4/5] [2021-11-19 21:14:18,733][INFO ][reencrypt-#24466%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:14:18] : [Step 4/5] [2021-11-19 21:14:18,733][INFO ][reencrypt-#24467%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:14:18] : [Step 4/5] [2021-11-19 21:14:18,934][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10b6f63c-e31c-4573-a225-9f76f500c001, grp=1613773252] [21:14:19] : [Step 4/5] [2021-11-19 21:14:19,067][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint started [checkpointId=c32092e6-dcd7-427b-9100-8c2b2e94314a, startPtr=WALPointer [idx=27, fileOff=1012379, len=2048], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=127ms, writeCheckpointEntryDuration=5ms, splitAndSortCpPagesDuration=0ms, pages=25, reason='test'] [21:14:19] : [Step 4/5] [2021-11-19 21:14:19,203][INFO ][db-checkpoint-thread-#24450%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:14:19] : [Step 4/5] [2021-11-19 21:14:19,204][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint finished [cpId=c32092e6-dcd7-427b-9100-8c2b2e94314a, pages=25, markPos=WALPointer [idx=27, fileOff=1012379, len=2048], walSegmentsCovered=[], markDuration=133ms, pagesWrite=0ms, fsync=136ms, total=270ms] [21:14:19] : [Step 4/5] [2021-11-19 21:14:19,204][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00cce8f9-a2b3-4d32-a95a-7f6eb6335000, grp=1613773252] [21:14:19] : [Step 4/5] [2021-11-19 21:14:19,375][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint started [checkpointId=f82a1006-ace6-4b5b-bac1-fc46c44c8531, startPtr=WALPointer [idx=27, fileOff=1028873, len=2010], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=138ms, writeCheckpointEntryDuration=31ms, splitAndSortCpPagesDuration=1ms, pages=25, reason='test'] [21:14:19] : [Step 4/5] [2021-11-19 21:14:19,847][INFO ][db-checkpoint-thread-#24445%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:14:19] : [Step 4/5] [2021-11-19 21:14:19,848][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint finished [cpId=f82a1006-ace6-4b5b-bac1-fc46c44c8531, pages=25, markPos=WALPointer [idx=27, fileOff=1028873, len=2010], walSegmentsCovered=[], markDuration=170ms, pagesWrite=1ms, fsync=472ms, total=643ms] [21:14:19] : [Step 4/5] [2021-11-19 21:14:19,852][INFO ][wal-file-archiver%grid-0-#24437%grid-0%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=27, segIdx=7, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000007.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000027.wal] [21:14:19] : [Step 4/5] [2021-11-19 21:14:19,854][INFO ][wal-file-cleaner%grid-0-#24438%grid-0%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=18, currSize=9.9 MB, maxSize=20.0 MB] [21:14:19] : [Step 4/5] [2021-11-19 21:14:19,856][INFO ][wal-file-archiver%grid-1-#24440%grid-1%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=27, segIdx=7, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000007.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000027.wal] [21:14:19] : [Step 4/5] [2021-11-19 21:14:19,856][INFO ][wal-file-cleaner%grid-0-#24438%grid-0%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=8.9 MB, maxSize=20.0 MB] [21:14:19] : [Step 4/5] [2021-11-19 21:14:19,857][INFO ][wal-file-cleaner%grid-1-#24441%grid-1%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=18, currSize=9.9 MB, maxSize=20.0 MB] [21:14:19] : [Step 4/5] [2021-11-19 21:14:19,858][INFO ][sys-#24298%grid-0%][GridEncryptionManager] Previous encryption keys have been removed [grpId=1613773252, keyIds=[112, 108, 109, 110, 111]] [21:14:19] : [Step 4/5] [2021-11-19 21:14:19,860][INFO ][wal-file-cleaner%grid-1-#24441%grid-1%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=8.9 MB, maxSize=20.0 MB] [21:14:19] : [Step 4/5] [2021-11-19 21:14:19,860][INFO ][disco-notifier-worker-#24306%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=166] [21:14:19] : [Step 4/5] [2021-11-19 21:14:19,860][INFO ][reencrypt-#24467%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:14:19] : [Step 4/5] [2021-11-19 21:14:19,861][INFO ][disco-notifier-worker-#24425%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=166] [21:14:19] : [Step 4/5] [2021-11-19 21:14:19,861][INFO ][reencrypt-#24466%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:14:19] : [Step 4/5] [2021-11-19 21:14:19,885][INFO ][wal-file-archiver%grid-0-#24437%grid-0%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000007.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000027.wal] [21:14:19] : [Step 4/5] [2021-11-19 21:14:19,885][INFO ][wal-file-archiver%grid-1-#24440%grid-1%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000007.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000027.wal] [21:14:20] : [Step 4/5] [2021-11-19 21:14:20,062][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10b6f63c-e31c-4573-a225-9f76f500c001, grp=1613773252] [21:14:20] : [Step 4/5] [2021-11-19 21:14:20,084][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint started [checkpointId=bf7c1e8a-646f-47c7-8455-a2fa4221f751, startPtr=WALPointer [idx=28, fileOff=172089, len=2048], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=1ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=11ms, writeCheckpointEntryDuration=8ms, splitAndSortCpPagesDuration=1ms, pages=25, reason='test'] [21:14:20] : [Step 4/5] [2021-11-19 21:14:20,094][INFO ][db-checkpoint-thread-#24450%grid-1%][GridEncryptionManager] Previous encryption keys were removed [grpId=1613773252, keyIds=[108, 109, 110, 111, 112]] [21:14:20] : [Step 4/5] [2021-11-19 21:14:20,094][INFO ][db-checkpoint-thread-#24450%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:14:20] : [Step 4/5] [2021-11-19 21:14:20,095][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint finished [cpId=bf7c1e8a-646f-47c7-8455-a2fa4221f751, pages=25, markPos=WALPointer [idx=28, fileOff=172089, len=2048], walSegmentsCovered=[27], markDuration=22ms, pagesWrite=0ms, fsync=10ms, total=32ms] [21:14:20] : [Step 4/5] [2021-11-19 21:14:20,095][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00cce8f9-a2b3-4d32-a95a-7f6eb6335000, grp=1613773252] [21:14:20] : [Step 4/5] [2021-11-19 21:14:20,101][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint started [checkpointId=3e984a0d-8ea4-4745-990e-1d80b33a49f9, startPtr=WALPointer [idx=28, fileOff=246584, len=2010], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=2ms, writeCheckpointEntryDuration=2ms, splitAndSortCpPagesDuration=0ms, pages=26, reason='test'] [21:14:20] : [Step 4/5] [2021-11-19 21:14:20,111][INFO ][db-checkpoint-thread-#24445%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:14:20] : [Step 4/5] [2021-11-19 21:14:20,111][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint finished [cpId=3e984a0d-8ea4-4745-990e-1d80b33a49f9, pages=26, markPos=WALPointer [idx=28, fileOff=246584, len=2010], walSegmentsCovered=[27], markDuration=5ms, pagesWrite=1ms, fsync=9ms, total=15ms] [21:14:20] : [Step 4/5] [2021-11-19 21:14:20,117][INFO ][disco-notifier-worker-#24306%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=167] [21:14:20] : [Step 4/5] [2021-11-19 21:14:20,118][INFO ][reencrypt-#24467%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:14:20] : [Step 4/5] [2021-11-19 21:14:20,118][INFO ][disco-notifier-worker-#24425%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=167] [21:14:20] : [Step 4/5] [2021-11-19 21:14:20,118][INFO ][reencrypt-#24466%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:14:20] : [Step 4/5] [2021-11-19 21:14:20,319][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10b6f63c-e31c-4573-a225-9f76f500c001, grp=1613773252] [21:14:20] : [Step 4/5] [2021-11-19 21:14:20,323][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint started [checkpointId=90d4c33c-eb64-42a3-b034-21b2065b4c6c, startPtr=WALPointer [idx=28, fileOff=415390, len=2048], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=1ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=0ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=0ms, pages=26, reason='test'] [21:14:20] : [Step 4/5] [2021-11-19 21:14:20,333][INFO ][db-checkpoint-thread-#24450%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:14:20] : [Step 4/5] [2021-11-19 21:14:20,333][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint finished [cpId=90d4c33c-eb64-42a3-b034-21b2065b4c6c, pages=26, markPos=WALPointer [idx=28, fileOff=415390, len=2048], walSegmentsCovered=[], markDuration=4ms, pagesWrite=0ms, fsync=9ms, total=13ms] [21:14:20] : [Step 4/5] [2021-11-19 21:14:20,333][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00cce8f9-a2b3-4d32-a95a-7f6eb6335000, grp=1613773252] [21:14:20] : [Step 4/5] [2021-11-19 21:14:20,342][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint started [checkpointId=90982df1-6834-454f-800c-ade749cb2027, startPtr=WALPointer [idx=28, fileOff=430077, len=2010], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=5ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=0ms, pages=22, reason='test'] [21:14:20] : [Step 4/5] [2021-11-19 21:14:20,351][INFO ][db-checkpoint-thread-#24445%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:14:20] : [Step 4/5] [2021-11-19 21:14:20,352][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint finished [cpId=90982df1-6834-454f-800c-ade749cb2027, pages=22, markPos=WALPointer [idx=28, fileOff=430077, len=2010], walSegmentsCovered=[], markDuration=8ms, pagesWrite=0ms, fsync=9ms, total=18ms] [21:14:20] : [Step 4/5] [2021-11-19 21:14:20,359][INFO ][disco-notifier-worker-#24306%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=168] [21:14:20] : [Step 4/5] [2021-11-19 21:14:20,359][INFO ][reencrypt-#24467%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:14:20] : [Step 4/5] [2021-11-19 21:14:20,360][INFO ][disco-notifier-worker-#24425%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=168] [21:14:20] : [Step 4/5] [2021-11-19 21:14:20,360][INFO ][reencrypt-#24466%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:14:20] : [Step 4/5] [2021-11-19 21:14:20,561][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10b6f63c-e31c-4573-a225-9f76f500c001, grp=1613773252] [21:14:20] : [Step 4/5] [2021-11-19 21:14:20,734][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint started [checkpointId=97eeec74-d14f-4395-81f8-0e6fd0a3abcf, startPtr=WALPointer [idx=28, fileOff=604419, len=2048], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=94ms, writeCheckpointEntryDuration=78ms, splitAndSortCpPagesDuration=0ms, pages=23, reason='test'] [21:14:20] : [Step 4/5] [2021-11-19 21:14:20,871][INFO ][db-checkpoint-thread-#24450%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:14:20] : [Step 4/5] [2021-11-19 21:14:20,872][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint finished [cpId=97eeec74-d14f-4395-81f8-0e6fd0a3abcf, pages=23, markPos=WALPointer [idx=28, fileOff=604419, len=2048], walSegmentsCovered=[], markDuration=173ms, pagesWrite=1ms, fsync=135ms, total=309ms] [21:14:20] : [Step 4/5] [2021-11-19 21:14:20,872][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00cce8f9-a2b3-4d32-a95a-7f6eb6335000, grp=1613773252] [21:14:20] : [Step 4/5] [2021-11-19 21:14:20,881][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint started [checkpointId=dd15d1d5-11b7-4680-b2e2-f2cfef44d9c0, startPtr=WALPointer [idx=28, fileOff=619068, len=2010], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=6ms, writeCheckpointEntryDuration=2ms, splitAndSortCpPagesDuration=0ms, pages=23, reason='test'] [21:14:20] : [Step 4/5] [2021-11-19 21:14:20,891][INFO ][db-checkpoint-thread-#24445%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:14:20] : [Step 4/5] [2021-11-19 21:14:20,892][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint finished [cpId=dd15d1d5-11b7-4680-b2e2-f2cfef44d9c0, pages=23, markPos=WALPointer [idx=28, fileOff=619068, len=2010], walSegmentsCovered=[], markDuration=9ms, pagesWrite=0ms, fsync=10ms, total=20ms] [21:14:20] : [Step 4/5] [2021-11-19 21:14:20,897][INFO ][disco-notifier-worker-#24425%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=169] [21:14:20] : [Step 4/5] [2021-11-19 21:14:20,897][INFO ][disco-notifier-worker-#24306%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=169] [21:14:20] : [Step 4/5] [2021-11-19 21:14:20,898][INFO ][reencrypt-#24466%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:14:20] : [Step 4/5] [2021-11-19 21:14:20,898][INFO ][reencrypt-#24467%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:14:21] : [Step 4/5] [2021-11-19 21:14:21,099][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10b6f63c-e31c-4573-a225-9f76f500c001, grp=1613773252] [21:14:21] : [Step 4/5] [2021-11-19 21:14:21,291][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint started [checkpointId=4801fd47-1ed2-43e2-9b63-fd40ce659eba, startPtr=WALPointer [idx=28, fileOff=796874, len=2048], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=1ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=109ms, writeCheckpointEntryDuration=81ms, splitAndSortCpPagesDuration=1ms, pages=23, reason='test'] [21:14:21] : [Step 4/5] [2021-11-19 21:14:21,488][INFO ][db-checkpoint-thread-#24450%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:14:21] : [Step 4/5] [2021-11-19 21:14:21,488][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint finished [cpId=4801fd47-1ed2-43e2-9b63-fd40ce659eba, pages=23, markPos=WALPointer [idx=28, fileOff=796874, len=2048], walSegmentsCovered=[], markDuration=192ms, pagesWrite=1ms, fsync=196ms, total=389ms] [21:14:21] : [Step 4/5] [2021-11-19 21:14:21,489][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00cce8f9-a2b3-4d32-a95a-7f6eb6335000, grp=1613773252] [21:14:21] : [Step 4/5] [2021-11-19 21:14:21,498][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint started [checkpointId=ff8f4f0a-a22e-48b9-adc2-d5245b6506b9, startPtr=WALPointer [idx=28, fileOff=811485, len=2010], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=7ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=0ms, pages=23, reason='test'] [21:14:21] : [Step 4/5] [2021-11-19 21:14:21,508][INFO ][db-checkpoint-thread-#24445%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:14:21] : [Step 4/5] [2021-11-19 21:14:21,508][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint finished [cpId=ff8f4f0a-a22e-48b9-adc2-d5245b6506b9, pages=23, markPos=WALPointer [idx=28, fileOff=811485, len=2010], walSegmentsCovered=[], markDuration=9ms, pagesWrite=1ms, fsync=8ms, total=19ms] [21:14:21] : [Step 4/5] [2021-11-19 21:14:21,514][INFO ][disco-notifier-worker-#24306%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=170] [21:14:21] : [Step 4/5] [2021-11-19 21:14:21,515][INFO ][disco-notifier-worker-#24425%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=170] [21:14:21] : [Step 4/5] [2021-11-19 21:14:21,515][INFO ][reencrypt-#24467%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:14:21] : [Step 4/5] [2021-11-19 21:14:21,515][INFO ][reencrypt-#24466%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:14:21] : [Step 4/5] [2021-11-19 21:14:21,716][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10b6f63c-e31c-4573-a225-9f76f500c001, grp=1613773252] [21:14:21] : [Step 4/5] [2021-11-19 21:14:21,720][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint started [checkpointId=9ccae1ec-b587-4628-9d9a-6ca09c86564e, startPtr=WALPointer [idx=28, fileOff=997654, len=2048], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=1ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=1ms, pages=25, reason='test'] [21:14:21] : [Step 4/5] [2021-11-19 21:14:21,730][INFO ][db-checkpoint-thread-#24450%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:14:21] : [Step 4/5] [2021-11-19 21:14:21,731][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint finished [cpId=9ccae1ec-b587-4628-9d9a-6ca09c86564e, pages=25, markPos=WALPointer [idx=28, fileOff=997654, len=2048], walSegmentsCovered=[], markDuration=3ms, pagesWrite=2ms, fsync=9ms, total=14ms] [21:14:21] : [Step 4/5] [2021-11-19 21:14:21,731][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00cce8f9-a2b3-4d32-a95a-7f6eb6335000, grp=1613773252] [21:14:21] : [Step 4/5] [2021-11-19 21:14:21,741][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint started [checkpointId=ca978090-5a38-465c-9024-f8f1d7fae9db, startPtr=WALPointer [idx=28, fileOff=1012227, len=2010], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=7ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=0ms, pages=25, reason='test'] [21:14:21] : [Step 4/5] [2021-11-19 21:14:21,751][INFO ][db-checkpoint-thread-#24445%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:14:21] : [Step 4/5] [2021-11-19 21:14:21,751][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint finished [cpId=ca978090-5a38-465c-9024-f8f1d7fae9db, pages=25, markPos=WALPointer [idx=28, fileOff=1012227, len=2010], walSegmentsCovered=[], markDuration=10ms, pagesWrite=1ms, fsync=8ms, total=19ms] [21:14:21] : [Step 4/5] [2021-11-19 21:14:21,759][INFO ][wal-file-archiver%grid-0-#24437%grid-0%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=28, segIdx=8, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000008.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000028.wal] [21:14:21] : [Step 4/5] [2021-11-19 21:14:21,759][INFO ][wal-file-archiver%grid-1-#24440%grid-1%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=28, segIdx=8, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000008.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000028.wal] [21:14:21] : [Step 4/5] [2021-11-19 21:14:21,761][INFO ][wal-file-cleaner%grid-0-#24438%grid-0%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=19, currSize=9.9 MB, maxSize=20.0 MB] [21:14:21] : [Step 4/5] [2021-11-19 21:14:21,762][INFO ][wal-file-cleaner%grid-1-#24441%grid-1%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=19, currSize=9.9 MB, maxSize=20.0 MB] [21:14:21] : [Step 4/5] [2021-11-19 21:14:21,764][INFO ][wal-file-cleaner%grid-0-#24438%grid-0%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=8.9 MB, maxSize=20.0 MB] [21:14:21] : [Step 4/5] [2021-11-19 21:14:21,764][INFO ][wal-file-cleaner%grid-1-#24441%grid-1%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=8.9 MB, maxSize=20.0 MB] [21:14:21] : [Step 4/5] [2021-11-19 21:14:21,765][INFO ][disco-notifier-worker-#24306%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=171] [21:14:21] : [Step 4/5] [2021-11-19 21:14:21,765][INFO ][reencrypt-#24467%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:14:21] : [Step 4/5] [2021-11-19 21:14:21,767][INFO ][disco-notifier-worker-#24425%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=171] [21:14:21] : [Step 4/5] [2021-11-19 21:14:21,767][INFO ][reencrypt-#24466%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:14:21] : [Step 4/5] [2021-11-19 21:14:21,772][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10b6f63c-e31c-4573-a225-9f76f500c001, grp=1613773252] [21:14:21] : [Step 4/5] [2021-11-19 21:14:21,854][INFO ][wal-file-archiver%grid-0-#24437%grid-0%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000008.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000028.wal] [21:14:21] : [Step 4/5] [2021-11-19 21:14:21,854][INFO ][wal-file-archiver%grid-1-#24440%grid-1%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000008.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000028.wal] [21:14:21] : [Step 4/5] [2021-11-19 21:14:21,888][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint started [checkpointId=cbb9b0de-a423-4129-ab94-44410a6502aa, startPtr=WALPointer [idx=29, fileOff=155555, len=2048], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=2ms, writeCheckpointEntryDuration=35ms, splitAndSortCpPagesDuration=0ms, pages=25, reason='test'] [21:14:21] : [Step 4/5] [2021-11-19 21:14:21,982][INFO ][db-checkpoint-thread-#24450%grid-1%][GridEncryptionManager] Previous encryption keys were removed [grpId=1613773252, keyIds=[113, 114, 115, 116, 117, 118]] [21:14:21] : [Step 4/5] [2021-11-19 21:14:21,982][INFO ][db-checkpoint-thread-#24450%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:14:21] : [Step 4/5] [2021-11-19 21:14:21,983][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint finished [cpId=cbb9b0de-a423-4129-ab94-44410a6502aa, pages=25, markPos=WALPointer [idx=29, fileOff=155555, len=2048], walSegmentsCovered=[28], markDuration=38ms, pagesWrite=0ms, fsync=94ms, total=132ms] [21:14:21] : [Step 4/5] [2021-11-19 21:14:21,983][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00cce8f9-a2b3-4d32-a95a-7f6eb6335000, grp=1613773252] [21:14:22] : [Step 4/5] [2021-11-19 21:14:22,047][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint started [checkpointId=9209035d-8687-457f-888a-41fb83ab7f08, startPtr=WALPointer [idx=29, fileOff=172045, len=2010], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=33ms, writeCheckpointEntryDuration=29ms, splitAndSortCpPagesDuration=0ms, pages=25, reason='test'] [21:14:22] : [Step 4/5] [2021-11-19 21:14:22,359][INFO ][db-checkpoint-thread-#24445%grid-0%][GridEncryptionManager] Previous encryption keys were removed [grpId=1613773252, keyIds=[113, 114, 115, 116, 117, 118]] [21:14:22] : [Step 4/5] [2021-11-19 21:14:22,360][INFO ][db-checkpoint-thread-#24445%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:14:22] : [Step 4/5] [2021-11-19 21:14:22,360][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint finished [cpId=9209035d-8687-457f-888a-41fb83ab7f08, pages=25, markPos=WALPointer [idx=29, fileOff=172045, len=2010], walSegmentsCovered=[28], markDuration=63ms, pagesWrite=1ms, fsync=312ms, total=377ms] [21:14:22] : [Step 4/5] [2021-11-19 21:14:22,367][INFO ][disco-notifier-worker-#24306%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=172] [21:14:22] : [Step 4/5] [2021-11-19 21:14:22,368][INFO ][reencrypt-#24467%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:14:22] : [Step 4/5] [2021-11-19 21:14:22,369][INFO ][disco-notifier-worker-#24425%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=172] [21:14:22] : [Step 4/5] [2021-11-19 21:14:22,370][INFO ][reencrypt-#24466%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:14:22] : [Step 4/5] [2021-11-19 21:14:22,571][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10b6f63c-e31c-4573-a225-9f76f500c001, grp=1613773252] [21:14:22] : [Step 4/5] [2021-11-19 21:14:22,773][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint started [checkpointId=dc8ad256-3fc5-4246-b378-32b9c815f386, startPtr=WALPointer [idx=29, fileOff=392847, len=2048], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=92ms, writeCheckpointEntryDuration=109ms, splitAndSortCpPagesDuration=0ms, pages=25, reason='test'] [21:14:22] : [Step 4/5] [2021-11-19 21:14:22,801][INFO ][db-checkpoint-thread-#24450%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:14:22] : [Step 4/5] [2021-11-19 21:14:22,801][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint finished [cpId=dc8ad256-3fc5-4246-b378-32b9c815f386, pages=25, markPos=WALPointer [idx=29, fileOff=392847, len=2048], walSegmentsCovered=[], markDuration=202ms, pagesWrite=1ms, fsync=26ms, total=230ms] [21:14:22] : [Step 4/5] [2021-11-19 21:14:22,802][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00cce8f9-a2b3-4d32-a95a-7f6eb6335000, grp=1613773252] [21:14:23] : [Step 4/5] [2021-11-19 21:14:23,028][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint started [checkpointId=40fb3bbc-7157-42c0-91e2-417038c33714, startPtr=WALPointer [idx=29, fileOff=409299, len=2010], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=6ms, writeCheckpointEntryDuration=219ms, splitAndSortCpPagesDuration=0ms, pages=25, reason='test'] [21:14:23] : [Step 4/5] [2021-11-19 21:14:23,393][INFO ][db-checkpoint-thread-#24445%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:14:23] : [Step 4/5] [2021-11-19 21:14:23,394][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint finished [cpId=40fb3bbc-7157-42c0-91e2-417038c33714, pages=25, markPos=WALPointer [idx=29, fileOff=409299, len=2010], walSegmentsCovered=[], markDuration=226ms, pagesWrite=0ms, fsync=365ms, total=592ms] [21:14:23] : [Step 4/5] [2021-11-19 21:14:23,399][INFO ][disco-notifier-worker-#24306%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=173] [21:14:23] : [Step 4/5] [2021-11-19 21:14:23,399][INFO ][reencrypt-#24467%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:14:23] : [Step 4/5] [2021-11-19 21:14:23,400][INFO ][disco-notifier-worker-#24425%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=173] [21:14:23] : [Step 4/5] [2021-11-19 21:14:23,400][INFO ][reencrypt-#24466%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:14:23] : [Step 4/5] [2021-11-19 21:14:23,601][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10b6f63c-e31c-4573-a225-9f76f500c001, grp=1613773252] [21:14:24] : [Step 4/5] [2021-11-19 21:14:24,171][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint started [checkpointId=1aba5ac1-1539-41f3-80d6-68b3a784d247, startPtr=WALPointer [idx=29, fileOff=584643, len=2048], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=155ms, writeCheckpointEntryDuration=414ms, splitAndSortCpPagesDuration=0ms, pages=24, reason='test'] [21:14:24] : [Step 4/5] [2021-11-19 21:14:24,401][INFO ][db-checkpoint-thread-#24450%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:14:24] : [Step 4/5] [2021-11-19 21:14:24,402][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint finished [cpId=1aba5ac1-1539-41f3-80d6-68b3a784d247, pages=24, markPos=WALPointer [idx=29, fileOff=584643, len=2048], walSegmentsCovered=[], markDuration=570ms, pagesWrite=1ms, fsync=229ms, total=801ms] [21:14:24] : [Step 4/5] [2021-11-19 21:14:24,402][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00cce8f9-a2b3-4d32-a95a-7f6eb6335000, grp=1613773252] [21:14:24] : [Step 4/5] [2021-11-19 21:14:24,410][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint started [checkpointId=5318c8b7-a0fd-4629-9b53-9c155bfcfa5c, startPtr=WALPointer [idx=29, fileOff=601057, len=2010], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=6ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=0ms, pages=24, reason='test'] [21:14:24] : [Step 4/5] [2021-11-19 21:14:24,420][INFO ][db-checkpoint-thread-#24445%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:14:24] : [Step 4/5] [2021-11-19 21:14:24,421][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint finished [cpId=5318c8b7-a0fd-4629-9b53-9c155bfcfa5c, pages=24, markPos=WALPointer [idx=29, fileOff=601057, len=2010], walSegmentsCovered=[], markDuration=8ms, pagesWrite=1ms, fsync=9ms, total=18ms] [21:14:24] : [Step 4/5] [2021-11-19 21:14:24,427][INFO ][disco-notifier-worker-#24306%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=174] [21:14:24] : [Step 4/5] [2021-11-19 21:14:24,427][INFO ][disco-notifier-worker-#24425%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=174] [21:14:24] : [Step 4/5] [2021-11-19 21:14:24,428][INFO ][reencrypt-#24467%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:14:24] : [Step 4/5] [2021-11-19 21:14:24,428][INFO ][reencrypt-#24466%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:14:24] : [Step 4/5] [2021-11-19 21:14:24,629][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10b6f63c-e31c-4573-a225-9f76f500c001, grp=1613773252] [21:14:24] : [Step 4/5] [2021-11-19 21:14:24,825][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint started [checkpointId=598bea40-ec45-4fe3-92e1-7ba60b61b9ac, startPtr=WALPointer [idx=29, fileOff=773672, len=2048], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=107ms, writeCheckpointEntryDuration=88ms, splitAndSortCpPagesDuration=0ms, pages=23, reason='test'] [21:14:24] : [Step 4/5] [2021-11-19 21:14:24,835][INFO ][db-checkpoint-thread-#24450%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:14:24] : [Step 4/5] [2021-11-19 21:14:24,835][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint finished [cpId=598bea40-ec45-4fe3-92e1-7ba60b61b9ac, pages=23, markPos=WALPointer [idx=29, fileOff=773672, len=2048], walSegmentsCovered=[], markDuration=196ms, pagesWrite=1ms, fsync=8ms, total=205ms] [21:14:24] : [Step 4/5] [2021-11-19 21:14:24,836][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00cce8f9-a2b3-4d32-a95a-7f6eb6335000, grp=1613773252] [21:14:24] : [Step 4/5] [2021-11-19 21:14:24,844][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint started [checkpointId=aa2eb769-2a96-4211-91ce-035bdd0c07ba, startPtr=WALPointer [idx=29, fileOff=790048, len=2010], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=6ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=0ms, pages=23, reason='test'] [21:14:24] : [Step 4/5] [2021-11-19 21:14:24,854][INFO ][db-checkpoint-thread-#24445%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:14:24] : [Step 4/5] [2021-11-19 21:14:24,854][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint finished [cpId=aa2eb769-2a96-4211-91ce-035bdd0c07ba, pages=23, markPos=WALPointer [idx=29, fileOff=790048, len=2010], walSegmentsCovered=[], markDuration=8ms, pagesWrite=1ms, fsync=8ms, total=17ms] [21:14:24] : [Step 4/5] [2021-11-19 21:14:24,859][INFO ][disco-notifier-worker-#24306%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=175] [21:14:24] : [Step 4/5] [2021-11-19 21:14:24,859][INFO ][disco-notifier-worker-#24425%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=175] [21:14:24] : [Step 4/5] [2021-11-19 21:14:24,859][INFO ][reencrypt-#24467%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:14:24] : [Step 4/5] [2021-11-19 21:14:24,860][INFO ][reencrypt-#24466%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:14:25] : [Step 4/5] [2021-11-19 21:14:25,061][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10b6f63c-e31c-4573-a225-9f76f500c001, grp=1613773252] [21:14:25] : [Step 4/5] [2021-11-19 21:14:25,064][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint started [checkpointId=aeb47826-8499-466f-8cae-ccd06316a37d, startPtr=WALPointer [idx=29, fileOff=966127, len=2048], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=1ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=0ms, pages=23, reason='test'] [21:14:25] : [Step 4/5] [2021-11-19 21:14:25,074][INFO ][db-checkpoint-thread-#24450%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:14:25] : [Step 4/5] [2021-11-19 21:14:25,074][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint finished [cpId=aeb47826-8499-466f-8cae-ccd06316a37d, pages=23, markPos=WALPointer [idx=29, fileOff=966127, len=2048], walSegmentsCovered=[], markDuration=3ms, pagesWrite=1ms, fsync=8ms, total=13ms] [21:14:25] : [Step 4/5] [2021-11-19 21:14:25,075][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00cce8f9-a2b3-4d32-a95a-7f6eb6335000, grp=1613773252] [21:14:25] : [Step 4/5] [2021-11-19 21:14:25,083][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint started [checkpointId=b43e659e-afe2-4442-9c81-c2d0590209c5, startPtr=WALPointer [idx=29, fileOff=982465, len=2010], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=6ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=0ms, pages=23, reason='test'] [21:14:25] : [Step 4/5] [2021-11-19 21:14:25,093][INFO ][db-checkpoint-thread-#24445%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:14:25] : [Step 4/5] [2021-11-19 21:14:25,093][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint finished [cpId=b43e659e-afe2-4442-9c81-c2d0590209c5, pages=23, markPos=WALPointer [idx=29, fileOff=982465, len=2010], walSegmentsCovered=[], markDuration=8ms, pagesWrite=1ms, fsync=8ms, total=18ms] [21:14:25] : [Step 4/5] [2021-11-19 21:14:25,101][INFO ][wal-file-archiver%grid-1-#24440%grid-1%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=29, segIdx=9, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000009.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000029.wal] [21:14:25] : [Step 4/5] [2021-11-19 21:14:25,102][INFO ][wal-file-archiver%grid-0-#24437%grid-0%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=29, segIdx=9, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000009.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000029.wal] [21:14:25] : [Step 4/5] [2021-11-19 21:14:25,102][INFO ][wal-file-cleaner%grid-1-#24441%grid-1%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=20, currSize=9.9 MB, maxSize=20.0 MB] [21:14:25] : [Step 4/5] [2021-11-19 21:14:25,103][INFO ][wal-file-cleaner%grid-0-#24438%grid-0%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=20, currSize=9.9 MB, maxSize=20.0 MB] [21:14:25] : [Step 4/5] [2021-11-19 21:14:25,104][INFO ][disco-notifier-worker-#24306%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=176] [21:14:25] : [Step 4/5] [2021-11-19 21:14:25,104][INFO ][reencrypt-#24467%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:14:25] : [Step 4/5] [2021-11-19 21:14:25,104][INFO ][disco-notifier-worker-#24425%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=176] [21:14:25] : [Step 4/5] [2021-11-19 21:14:25,105][INFO ][reencrypt-#24466%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:14:25] : [Step 4/5] [2021-11-19 21:14:25,105][INFO ][wal-file-cleaner%grid-1-#24441%grid-1%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=8.9 MB, maxSize=20.0 MB] [21:14:25] : [Step 4/5] [2021-11-19 21:14:25,107][INFO ][wal-file-cleaner%grid-0-#24438%grid-0%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=8.9 MB, maxSize=20.0 MB] [21:14:25] : [Step 4/5] [2021-11-19 21:14:25,114][INFO ][wal-file-archiver%grid-0-#24437%grid-0%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000009.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000029.wal] [21:14:25] : [Step 4/5] [2021-11-19 21:14:25,114][INFO ][wal-file-archiver%grid-1-#24440%grid-1%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000009.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000029.wal] [21:14:25] : [Step 4/5] [2021-11-19 21:14:25,306][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10b6f63c-e31c-4573-a225-9f76f500c001, grp=1613773252] [21:14:25] : [Step 4/5] [2021-11-19 21:14:25,420][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint started [checkpointId=80709597-662f-477c-a6cf-8704727698bc, startPtr=WALPointer [idx=30, fileOff=118886, len=2048], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=43ms, writeCheckpointEntryDuration=69ms, splitAndSortCpPagesDuration=1ms, pages=24, reason='test'] [21:14:25] : [Step 4/5] [2021-11-19 21:14:25,556][INFO ][db-checkpoint-thread-#24450%grid-1%][GridEncryptionManager] Previous encryption keys were removed [grpId=1613773252, keyIds=[119, 120, 121, 122, 123]] [21:14:25] : [Step 4/5] [2021-11-19 21:14:25,556][INFO ][db-checkpoint-thread-#24450%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:14:25] : [Step 4/5] [2021-11-19 21:14:25,556][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint finished [cpId=80709597-662f-477c-a6cf-8704727698bc, pages=24, markPos=WALPointer [idx=30, fileOff=118886, len=2048], walSegmentsCovered=[29], markDuration=114ms, pagesWrite=1ms, fsync=135ms, total=250ms] [21:14:25] : [Step 4/5] [2021-11-19 21:14:25,557][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00cce8f9-a2b3-4d32-a95a-7f6eb6335000, grp=1613773252] [21:14:25] : [Step 4/5] [2021-11-19 21:14:25,566][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint started [checkpointId=e5a77427-b495-4a4c-afdd-245f1fd54add, startPtr=WALPointer [idx=30, fileOff=133825, len=2010], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=6ms, writeCheckpointEntryDuration=2ms, splitAndSortCpPagesDuration=0ms, pages=24, reason='test'] [21:14:25] : [Step 4/5] [2021-11-19 21:14:25,578][INFO ][db-checkpoint-thread-#24445%grid-0%][GridEncryptionManager] Previous encryption keys were removed [grpId=1613773252, keyIds=[119, 120, 121, 122, 123]] [21:14:25] : [Step 4/5] [2021-11-19 21:14:25,578][INFO ][db-checkpoint-thread-#24445%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:14:25] : [Step 4/5] [2021-11-19 21:14:25,579][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint finished [cpId=e5a77427-b495-4a4c-afdd-245f1fd54add, pages=24, markPos=WALPointer [idx=30, fileOff=133825, len=2010], walSegmentsCovered=[29], markDuration=9ms, pagesWrite=1ms, fsync=11ms, total=21ms] [21:14:25] : [Step 4/5] [2021-11-19 21:14:25,583][INFO ][disco-notifier-worker-#24306%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=177] [21:14:25] : [Step 4/5] [2021-11-19 21:14:25,584][INFO ][disco-notifier-worker-#24425%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=177] [21:14:25] : [Step 4/5] [2021-11-19 21:14:25,584][INFO ][reencrypt-#24467%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:14:25] : [Step 4/5] [2021-11-19 21:14:25,584][INFO ][reencrypt-#24466%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:14:25] : [Step 4/5] [2021-11-19 21:14:25,785][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10b6f63c-e31c-4573-a225-9f76f500c001, grp=1613773252] [21:14:26] : [Step 4/5] [2021-11-19 21:14:26,035][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint started [checkpointId=ade6ce26-533e-4acc-a186-8d5aa387450c, startPtr=WALPointer [idx=30, fileOff=348892, len=2048], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=104ms, writeCheckpointEntryDuration=145ms, splitAndSortCpPagesDuration=0ms, pages=23, reason='test'] [21:14:26] : [Step 4/5] [2021-11-19 21:14:26,073][INFO ][db-checkpoint-thread-#24450%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:14:26] : [Step 4/5] [2021-11-19 21:14:26,074][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint finished [cpId=ade6ce26-533e-4acc-a186-8d5aa387450c, pages=23, markPos=WALPointer [idx=30, fileOff=348892, len=2048], walSegmentsCovered=[], markDuration=250ms, pagesWrite=0ms, fsync=38ms, total=289ms] [21:14:26] : [Step 4/5] [2021-11-19 21:14:26,074][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00cce8f9-a2b3-4d32-a95a-7f6eb6335000, grp=1613773252] [21:14:26] : [Step 4/5] [2021-11-19 21:14:26,082][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint started [checkpointId=c3193821-d19b-4b12-9ae1-18c7188c2088, startPtr=WALPointer [idx=30, fileOff=363793, len=2010], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=6ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=0ms, pages=23, reason='test'] [21:14:26] : [Step 4/5] [2021-11-19 21:14:26,092][INFO ][db-checkpoint-thread-#24445%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:14:26] : [Step 4/5] [2021-11-19 21:14:26,092][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint finished [cpId=c3193821-d19b-4b12-9ae1-18c7188c2088, pages=23, markPos=WALPointer [idx=30, fileOff=363793, len=2010], walSegmentsCovered=[], markDuration=8ms, pagesWrite=0ms, fsync=9ms, total=17ms] [21:14:26] : [Step 4/5] [2021-11-19 21:14:26,097][INFO ][disco-notifier-worker-#24306%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=178] [21:14:26] : [Step 4/5] [2021-11-19 21:14:26,097][INFO ][reencrypt-#24467%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:14:26] : [Step 4/5] [2021-11-19 21:14:26,097][INFO ][disco-notifier-worker-#24425%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=178] [21:14:26] : [Step 4/5] [2021-11-19 21:14:26,097][INFO ][reencrypt-#24466%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:14:26] : [Step 4/5] [2021-11-19 21:14:26,298][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10b6f63c-e31c-4573-a225-9f76f500c001, grp=1613773252] [21:14:26] : [Step 4/5] [2021-11-19 21:14:26,302][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint started [checkpointId=62a20cbf-7c1c-4674-9aeb-93c285e0a356, startPtr=WALPointer [idx=30, fileOff=540688, len=2048], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=2ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=0ms, pages=24, reason='test'] [21:14:26] : [Step 4/5] [2021-11-19 21:14:26,312][INFO ][db-checkpoint-thread-#24450%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:14:26] : [Step 4/5] [2021-11-19 21:14:26,312][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint finished [cpId=62a20cbf-7c1c-4674-9aeb-93c285e0a356, pages=24, markPos=WALPointer [idx=30, fileOff=540688, len=2048], walSegmentsCovered=[], markDuration=4ms, pagesWrite=0ms, fsync=9ms, total=13ms] [21:14:26] : [Step 4/5] [2021-11-19 21:14:26,312][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00cce8f9-a2b3-4d32-a95a-7f6eb6335000, grp=1613773252] [21:14:26] : [Step 4/5] [2021-11-19 21:14:26,321][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint started [checkpointId=9ae974a3-5058-4744-9a8c-b649f2d881c2, startPtr=WALPointer [idx=30, fileOff=555551, len=2010], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=5ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=0ms, pages=24, reason='test'] [21:14:26] : [Step 4/5] [2021-11-19 21:14:26,331][INFO ][db-checkpoint-thread-#24445%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:14:26] : [Step 4/5] [2021-11-19 21:14:26,331][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint finished [cpId=9ae974a3-5058-4744-9a8c-b649f2d881c2, pages=24, markPos=WALPointer [idx=30, fileOff=555551, len=2010], walSegmentsCovered=[], markDuration=7ms, pagesWrite=1ms, fsync=8ms, total=16ms] [21:14:26] : [Step 4/5] [2021-11-19 21:14:26,336][INFO ][disco-notifier-worker-#24306%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=179] [21:14:26] : [Step 4/5] [2021-11-19 21:14:26,336][INFO ][reencrypt-#24467%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:14:26] : [Step 4/5] [2021-11-19 21:14:26,336][INFO ][disco-notifier-worker-#24425%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=179] [21:14:26] : [Step 4/5] [2021-11-19 21:14:26,337][INFO ][reencrypt-#24466%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:14:26] : [Step 4/5] [2021-11-19 21:14:26,538][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10b6f63c-e31c-4573-a225-9f76f500c001, grp=1613773252] [21:14:26] : [Step 4/5] [2021-11-19 21:14:26,667][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint started [checkpointId=738a58bf-b355-40fc-a60e-651316c80ab2, startPtr=WALPointer [idx=30, fileOff=729717, len=2048], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=1ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=72ms, writeCheckpointEntryDuration=56ms, splitAndSortCpPagesDuration=0ms, pages=23, reason='test'] [21:14:26] : [Step 4/5] [2021-11-19 21:14:26,677][INFO ][db-checkpoint-thread-#24450%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:14:26] : [Step 4/5] [2021-11-19 21:14:26,678][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint finished [cpId=738a58bf-b355-40fc-a60e-651316c80ab2, pages=23, markPos=WALPointer [idx=30, fileOff=729717, len=2048], walSegmentsCovered=[], markDuration=130ms, pagesWrite=1ms, fsync=8ms, total=139ms] [21:14:26] : [Step 4/5] [2021-11-19 21:14:26,678][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00cce8f9-a2b3-4d32-a95a-7f6eb6335000, grp=1613773252] [21:14:26] : [Step 4/5] [2021-11-19 21:14:26,686][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint started [checkpointId=0b91feeb-2055-48d1-8e1a-0792d3adea24, startPtr=WALPointer [idx=30, fileOff=744542, len=2010], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=6ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=0ms, pages=23, reason='test'] [21:14:26] : [Step 4/5] [2021-11-19 21:14:26,696][INFO ][db-checkpoint-thread-#24445%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:14:26] : [Step 4/5] [2021-11-19 21:14:26,696][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint finished [cpId=0b91feeb-2055-48d1-8e1a-0792d3adea24, pages=23, markPos=WALPointer [idx=30, fileOff=744542, len=2010], walSegmentsCovered=[], markDuration=8ms, pagesWrite=0ms, fsync=9ms, total=17ms] [21:14:26] : [Step 4/5] [2021-11-19 21:14:26,702][INFO ][disco-notifier-worker-#24306%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=180] [21:14:26] : [Step 4/5] [2021-11-19 21:14:26,702][INFO ][disco-notifier-worker-#24425%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=180] [21:14:26] : [Step 4/5] [2021-11-19 21:14:26,702][INFO ][reencrypt-#24467%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:14:26] : [Step 4/5] [2021-11-19 21:14:26,703][INFO ][reencrypt-#24466%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:14:26] : [Step 4/5] [2021-11-19 21:14:26,904][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10b6f63c-e31c-4573-a225-9f76f500c001, grp=1613773252] [21:14:27] : [Step 4/5] [2021-11-19 21:14:27,134][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint started [checkpointId=14152aa1-da4a-46de-96f0-2fd2b246739f, startPtr=WALPointer [idx=30, fileOff=922172, len=2048], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=1ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=73ms, writeCheckpointEntryDuration=156ms, splitAndSortCpPagesDuration=0ms, pages=23, reason='test'] [21:14:27] : [Step 4/5] [2021-11-19 21:14:27,150][INFO ][db-checkpoint-thread-#24450%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:14:27] : [Step 4/5] [2021-11-19 21:14:27,150][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint finished [cpId=14152aa1-da4a-46de-96f0-2fd2b246739f, pages=23, markPos=WALPointer [idx=30, fileOff=922172, len=2048], walSegmentsCovered=[], markDuration=231ms, pagesWrite=1ms, fsync=14ms, total=246ms] [21:14:27] : [Step 4/5] [2021-11-19 21:14:27,151][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00cce8f9-a2b3-4d32-a95a-7f6eb6335000, grp=1613773252] [21:14:27] : [Step 4/5] [2021-11-19 21:14:27,159][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint started [checkpointId=2ca45306-4eff-40a3-aed3-bd4d289e801e, startPtr=WALPointer [idx=30, fileOff=936959, len=2010], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=6ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=0ms, pages=23, reason='test'] [21:14:27] : [Step 4/5] [2021-11-19 21:14:27,169][INFO ][db-checkpoint-thread-#24445%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:14:27] : [Step 4/5] [2021-11-19 21:14:27,169][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint finished [cpId=2ca45306-4eff-40a3-aed3-bd4d289e801e, pages=23, markPos=WALPointer [idx=30, fileOff=936959, len=2010], walSegmentsCovered=[], markDuration=8ms, pagesWrite=2ms, fsync=7ms, total=18ms] [21:14:27] : [Step 4/5] [2021-11-19 21:14:27,177][INFO ][wal-file-archiver%grid-0-#24437%grid-0%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=30, segIdx=0, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000000.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000030.wal] [21:14:27] : [Step 4/5] [2021-11-19 21:14:27,177][INFO ][wal-file-archiver%grid-1-#24440%grid-1%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=30, segIdx=0, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000000.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000030.wal] [21:14:27] : [Step 4/5] [2021-11-19 21:14:27,179][INFO ][wal-file-cleaner%grid-0-#24438%grid-0%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=21, currSize=9.9 MB, maxSize=20.0 MB] [21:14:27] : [Step 4/5] [2021-11-19 21:14:27,178][INFO ][disco-notifier-worker-#24306%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=181] [21:14:27] : [Step 4/5] [2021-11-19 21:14:27,178][INFO ][disco-notifier-worker-#24425%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=181] [21:14:27] : [Step 4/5] [2021-11-19 21:14:27,179][INFO ][reencrypt-#24467%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:14:27] : [Step 4/5] [2021-11-19 21:14:27,179][INFO ][wal-file-cleaner%grid-1-#24441%grid-1%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=21, currSize=9.9 MB, maxSize=20.0 MB] [21:14:27] : [Step 4/5] [2021-11-19 21:14:27,180][INFO ][reencrypt-#24466%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:14:27] : [Step 4/5] [2021-11-19 21:14:27,181][INFO ][wal-file-cleaner%grid-0-#24438%grid-0%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=8.9 MB, maxSize=20.0 MB] [21:14:27] : [Step 4/5] [2021-11-19 21:14:27,182][INFO ][wal-file-cleaner%grid-1-#24441%grid-1%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=8.9 MB, maxSize=20.0 MB] [21:14:27] : [Step 4/5] [2021-11-19 21:14:27,191][INFO ][wal-file-archiver%grid-0-#24437%grid-0%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000000.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000030.wal] [21:14:27] : [Step 4/5] [2021-11-19 21:14:27,191][INFO ][wal-file-archiver%grid-1-#24440%grid-1%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000000.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000030.wal] [21:14:27] : [Step 4/5] [2021-11-19 21:14:27,381][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10b6f63c-e31c-4573-a225-9f76f500c001, grp=1613773252] [21:14:27] : [Step 4/5] [2021-11-19 21:14:27,575][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint started [checkpointId=8729b33a-6979-4d8d-9aca-98b88c3660d3, startPtr=WALPointer [idx=31, fileOff=89707, len=2048], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=95ms, writeCheckpointEntryDuration=98ms, splitAndSortCpPagesDuration=0ms, pages=24, reason='test'] [21:14:27] : [Step 4/5] [2021-11-19 21:14:27,738][INFO ][db-checkpoint-thread-#24450%grid-1%][GridEncryptionManager] Previous encryption keys were removed [grpId=1613773252, keyIds=[128, 124, 125, 126, 127]] [21:14:27] : [Step 4/5] [2021-11-19 21:14:27,739][INFO ][db-checkpoint-thread-#24450%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:14:27] : [Step 4/5] [2021-11-19 21:14:27,739][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint finished [cpId=8729b33a-6979-4d8d-9aca-98b88c3660d3, pages=24, markPos=WALPointer [idx=31, fileOff=89707, len=2048], walSegmentsCovered=[30], markDuration=194ms, pagesWrite=1ms, fsync=162ms, total=358ms] [21:14:27] : [Step 4/5] [2021-11-19 21:14:27,739][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00cce8f9-a2b3-4d32-a95a-7f6eb6335000, grp=1613773252] [21:14:27] : [Step 4/5] [2021-11-19 21:14:27,850][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint started [checkpointId=2579508e-0ac7-43d8-9d41-dcb1a240ee5b, startPtr=WALPointer [idx=31, fileOff=89707, len=2010], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=21ms, writeCheckpointEntryDuration=89ms, splitAndSortCpPagesDuration=0ms, pages=24, reason='test'] [21:14:27] : [Step 4/5] [2021-11-19 21:14:27,966][INFO ][db-checkpoint-thread-#24445%grid-0%][GridEncryptionManager] Previous encryption keys were removed [grpId=1613773252, keyIds=[128, 124, 125, 126, 127]] [21:14:27] : [Step 4/5] [2021-11-19 21:14:27,966][INFO ][db-checkpoint-thread-#24445%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:14:27] : [Step 4/5] [2021-11-19 21:14:27,967][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint finished [cpId=2579508e-0ac7-43d8-9d41-dcb1a240ee5b, pages=24, markPos=WALPointer [idx=31, fileOff=89707, len=2010], walSegmentsCovered=[30], markDuration=111ms, pagesWrite=1ms, fsync=114ms, total=226ms] [21:14:27] : [Step 4/5] [2021-11-19 21:14:27,973][INFO ][disco-notifier-worker-#24306%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=182] [21:14:27] : [Step 4/5] [2021-11-19 21:14:27,973][INFO ][disco-notifier-worker-#24425%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=182] [21:14:27] : [Step 4/5] [2021-11-19 21:14:27,973][INFO ][reencrypt-#24467%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:14:27] : [Step 4/5] [2021-11-19 21:14:27,974][INFO ][reencrypt-#24466%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:14:28] : [Step 4/5] [2021-11-19 21:14:28,175][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10b6f63c-e31c-4573-a225-9f76f500c001, grp=1613773252] [21:14:28] : [Step 4/5] [2021-11-19 21:14:28,295][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint started [checkpointId=5a146cb3-2b09-4f51-a439-35900bf39878, startPtr=WALPointer [idx=31, fileOff=319713, len=2048], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=18ms, writeCheckpointEntryDuration=101ms, splitAndSortCpPagesDuration=0ms, pages=23, reason='test'] [21:14:28] : [Step 4/5] [2021-11-19 21:14:28,543][INFO ][db-checkpoint-thread-#24450%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:14:28] : [Step 4/5] [2021-11-19 21:14:28,544][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint finished [cpId=5a146cb3-2b09-4f51-a439-35900bf39878, pages=23, markPos=WALPointer [idx=31, fileOff=319713, len=2048], walSegmentsCovered=[], markDuration=120ms, pagesWrite=1ms, fsync=247ms, total=369ms] [21:14:28] : [Step 4/5] [2021-11-19 21:14:28,544][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00cce8f9-a2b3-4d32-a95a-7f6eb6335000, grp=1613773252] [21:14:28] : [Step 4/5] [2021-11-19 21:14:28,654][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint started [checkpointId=258a22dc-1c24-4b01-8587-c28546078ad2, startPtr=WALPointer [idx=31, fileOff=319675, len=2010], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=31ms, writeCheckpointEntryDuration=78ms, splitAndSortCpPagesDuration=0ms, pages=23, reason='test'] [21:14:28] : [Step 4/5] [2021-11-19 21:14:28,664][INFO ][db-checkpoint-thread-#24445%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:14:28] : [Step 4/5] [2021-11-19 21:14:28,664][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint finished [cpId=258a22dc-1c24-4b01-8587-c28546078ad2, pages=23, markPos=WALPointer [idx=31, fileOff=319675, len=2010], walSegmentsCovered=[], markDuration=110ms, pagesWrite=1ms, fsync=8ms, total=119ms] [21:14:28] : [Step 4/5] [2021-11-19 21:14:28,669][INFO ][disco-notifier-worker-#24306%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=183] [21:14:28] : [Step 4/5] [2021-11-19 21:14:28,669][INFO ][disco-notifier-worker-#24425%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=183] [21:14:28] : [Step 4/5] [2021-11-19 21:14:28,669][INFO ][reencrypt-#24467%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:14:28] : [Step 4/5] [2021-11-19 21:14:28,669][INFO ][reencrypt-#24466%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:14:28] : [Step 4/5] [2021-11-19 21:14:28,870][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10b6f63c-e31c-4573-a225-9f76f500c001, grp=1613773252] [21:14:29] : [Step 4/5] [2021-11-19 21:14:29,151][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint started [checkpointId=7d229976-704c-490b-9a94-916b5bddba8c, startPtr=WALPointer [idx=31, fileOff=511509, len=2048], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=119ms, writeCheckpointEntryDuration=160ms, splitAndSortCpPagesDuration=0ms, pages=24, reason='test'] [21:14:29] : [Step 4/5] [2021-11-19 21:14:29,346][INFO ][db-checkpoint-thread-#24450%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:14:29] : [Step 4/5] [2021-11-19 21:14:29,347][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint finished [cpId=7d229976-704c-490b-9a94-916b5bddba8c, pages=24, markPos=WALPointer [idx=31, fileOff=511509, len=2048], walSegmentsCovered=[], markDuration=281ms, pagesWrite=0ms, fsync=195ms, total=476ms] [21:14:29] : [Step 4/5] [2021-11-19 21:14:29,347][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00cce8f9-a2b3-4d32-a95a-7f6eb6335000, grp=1613773252] [21:14:29] : [Step 4/5] [2021-11-19 21:14:29,355][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint started [checkpointId=cf397cff-a731-4271-8fbd-21afc856691a, startPtr=WALPointer [idx=31, fileOff=511433, len=2010], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=1ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=5ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=0ms, pages=24, reason='test'] [21:14:29] : [Step 4/5] [2021-11-19 21:14:29,365][INFO ][db-checkpoint-thread-#24445%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:14:29] : [Step 4/5] [2021-11-19 21:14:29,366][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint finished [cpId=cf397cff-a731-4271-8fbd-21afc856691a, pages=24, markPos=WALPointer [idx=31, fileOff=511433, len=2010], walSegmentsCovered=[], markDuration=8ms, pagesWrite=1ms, fsync=9ms, total=18ms] [21:14:29] : [Step 4/5] [2021-11-19 21:14:29,370][INFO ][disco-notifier-worker-#24306%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=184] [21:14:29] : [Step 4/5] [2021-11-19 21:14:29,371][INFO ][reencrypt-#24467%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:14:29] : [Step 4/5] [2021-11-19 21:14:29,372][INFO ][disco-notifier-worker-#24425%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=184] [21:14:29] : [Step 4/5] [2021-11-19 21:14:29,373][INFO ][reencrypt-#24466%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:14:29] : [Step 4/5] [2021-11-19 21:14:29,574][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10b6f63c-e31c-4573-a225-9f76f500c001, grp=1613773252] [21:14:29] : [Step 4/5] [2021-11-19 21:14:29,693][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint started [checkpointId=52c39401-5320-4a6c-b375-4fc769e4a0fe, startPtr=WALPointer [idx=31, fileOff=700538, len=2048], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=20ms, writeCheckpointEntryDuration=98ms, splitAndSortCpPagesDuration=0ms, pages=23, reason='test'] [21:14:29] : [Step 4/5] [2021-11-19 21:14:29,819][INFO ][db-checkpoint-thread-#24450%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:14:29] : [Step 4/5] [2021-11-19 21:14:29,820][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint finished [cpId=52c39401-5320-4a6c-b375-4fc769e4a0fe, pages=23, markPos=WALPointer [idx=31, fileOff=700538, len=2048], walSegmentsCovered=[], markDuration=118ms, pagesWrite=1ms, fsync=126ms, total=246ms] [21:14:29] : [Step 4/5] [2021-11-19 21:14:29,820][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00cce8f9-a2b3-4d32-a95a-7f6eb6335000, grp=1613773252] [21:14:29] : [Step 4/5] [2021-11-19 21:14:29,963][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint started [checkpointId=085bff99-cb78-4404-bad8-156ff61a9554, startPtr=WALPointer [idx=31, fileOff=700424, len=2010], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=112ms, writeCheckpointEntryDuration=30ms, splitAndSortCpPagesDuration=0ms, pages=23, reason='test'] [21:14:30] : [Step 4/5] [2021-11-19 21:14:30,079][INFO ][db-checkpoint-thread-#24445%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:14:30] : [Step 4/5] [2021-11-19 21:14:30,080][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint finished [cpId=085bff99-cb78-4404-bad8-156ff61a9554, pages=23, markPos=WALPointer [idx=31, fileOff=700424, len=2010], walSegmentsCovered=[], markDuration=143ms, pagesWrite=1ms, fsync=115ms, total=259ms] [21:14:30] : [Step 4/5] [2021-11-19 21:14:30,084][INFO ][disco-notifier-worker-#24425%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=185] [21:14:30] : [Step 4/5] [2021-11-19 21:14:30,084][INFO ][disco-notifier-worker-#24306%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=185] [21:14:30] : [Step 4/5] [2021-11-19 21:14:30,085][INFO ][reencrypt-#24466%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:14:30] : [Step 4/5] [2021-11-19 21:14:30,085][INFO ][reencrypt-#24467%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:14:30] : [Step 4/5] [2021-11-19 21:14:30,286][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10b6f63c-e31c-4573-a225-9f76f500c001, grp=1613773252] [21:14:30] : [Step 4/5] [2021-11-19 21:14:30,466][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint started [checkpointId=4f05647e-4ddf-4123-8121-bbabe7e8f5bb, startPtr=WALPointer [idx=31, fileOff=892993, len=2048], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=1ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=46ms, writeCheckpointEntryDuration=133ms, splitAndSortCpPagesDuration=0ms, pages=23, reason='test'] [21:14:30] : [Step 4/5] [2021-11-19 21:14:30,790][INFO ][db-checkpoint-thread-#24450%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:14:30] : [Step 4/5] [2021-11-19 21:14:30,790][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint finished [cpId=4f05647e-4ddf-4123-8121-bbabe7e8f5bb, pages=23, markPos=WALPointer [idx=31, fileOff=892993, len=2048], walSegmentsCovered=[], markDuration=181ms, pagesWrite=1ms, fsync=322ms, total=504ms] [21:14:30] : [Step 4/5] [2021-11-19 21:14:30,790][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00cce8f9-a2b3-4d32-a95a-7f6eb6335000, grp=1613773252] [21:14:30] : [Step 4/5] [2021-11-19 21:14:30,799][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint started [checkpointId=85ef39ea-2506-4c1f-9efe-04e92deedcbd, startPtr=WALPointer [idx=31, fileOff=892841, len=2010], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=5ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=0ms, pages=23, reason='test'] [21:14:30] : [Step 4/5] [2021-11-19 21:14:30,808][INFO ][db-checkpoint-thread-#24445%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:14:30] : [Step 4/5] [2021-11-19 21:14:30,809][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint finished [cpId=85ef39ea-2506-4c1f-9efe-04e92deedcbd, pages=23, markPos=WALPointer [idx=31, fileOff=892841, len=2010], walSegmentsCovered=[], markDuration=8ms, pagesWrite=1ms, fsync=9ms, total=18ms] [21:14:30] : [Step 4/5] [2021-11-19 21:14:30,817][INFO ][wal-file-archiver%grid-1-#24440%grid-1%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=31, segIdx=1, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000001.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000031.wal] [21:14:30] : [Step 4/5] [2021-11-19 21:14:30,818][INFO ][disco-notifier-worker-#24425%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=186] [21:14:30] : [Step 4/5] [2021-11-19 21:14:30,818][INFO ][disco-notifier-worker-#24306%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=186] [21:14:30] : [Step 4/5] [2021-11-19 21:14:30,817][INFO ][wal-file-archiver%grid-0-#24437%grid-0%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=31, segIdx=1, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000001.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000031.wal] [21:14:30] : [Step 4/5] [2021-11-19 21:14:30,819][INFO ][reencrypt-#24467%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:14:30] : [Step 4/5] [2021-11-19 21:14:30,819][INFO ][wal-file-cleaner%grid-1-#24441%grid-1%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=22, currSize=9.9 MB, maxSize=20.0 MB] [21:14:30] : [Step 4/5] [2021-11-19 21:14:30,818][INFO ][reencrypt-#24466%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:14:30] : [Step 4/5] [2021-11-19 21:14:30,820][INFO ][wal-file-cleaner%grid-0-#24438%grid-0%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=22, currSize=9.9 MB, maxSize=20.0 MB] [21:14:30] : [Step 4/5] [2021-11-19 21:14:30,822][INFO ][wal-file-cleaner%grid-1-#24441%grid-1%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=8.9 MB, maxSize=20.0 MB] [21:14:30] : [Step 4/5] [2021-11-19 21:14:30,823][INFO ][wal-file-cleaner%grid-0-#24438%grid-0%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=8.9 MB, maxSize=20.0 MB] [21:14:30] : [Step 4/5] [2021-11-19 21:14:30,831][INFO ][wal-file-archiver%grid-0-#24437%grid-0%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000001.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000031.wal] [21:14:30] : [Step 4/5] [2021-11-19 21:14:30,831][INFO ][wal-file-archiver%grid-1-#24440%grid-1%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000001.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000031.wal] [21:14:31] : [Step 4/5] [2021-11-19 21:14:31,020][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10b6f63c-e31c-4573-a225-9f76f500c001, grp=1613773252] [21:14:31] : [Step 4/5] [2021-11-19 21:14:31,188][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint started [checkpointId=4303eb6f-fb50-434f-9d03-d12884961fe6, startPtr=WALPointer [idx=32, fileOff=45843, len=2048], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=68ms, writeCheckpointEntryDuration=99ms, splitAndSortCpPagesDuration=0ms, pages=24, reason='test'] [21:14:31] : [Step 4/5] [2021-11-19 21:14:31,258][INFO ][db-checkpoint-thread-#24450%grid-1%][GridEncryptionManager] Previous encryption keys were removed [grpId=1613773252, keyIds=[129, 130, 131, 132, 133, 134]] [21:14:31] : [Step 4/5] [2021-11-19 21:14:31,259][INFO ][db-checkpoint-thread-#24450%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:14:31] : [Step 4/5] [2021-11-19 21:14:31,259][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint finished [cpId=4303eb6f-fb50-434f-9d03-d12884961fe6, pages=24, markPos=WALPointer [idx=32, fileOff=45843, len=2048], walSegmentsCovered=[31], markDuration=168ms, pagesWrite=0ms, fsync=70ms, total=238ms] [21:14:31] : [Step 4/5] [2021-11-19 21:14:31,259][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00cce8f9-a2b3-4d32-a95a-7f6eb6335000, grp=1613773252] [21:14:31] : [Step 4/5] [2021-11-19 21:14:31,585][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint started [checkpointId=5c8b34e6-1cf0-4149-a86c-c7d73750a359, startPtr=WALPointer [idx=32, fileOff=45843, len=2010], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=152ms, writeCheckpointEntryDuration=173ms, splitAndSortCpPagesDuration=0ms, pages=24, reason='test'] [21:14:31] : [Step 4/5] [2021-11-19 21:14:31,656][INFO ][db-checkpoint-thread-#24445%grid-0%][GridEncryptionManager] Previous encryption keys were removed [grpId=1613773252, keyIds=[129, 130, 131, 132, 133, 134]] [21:14:31] : [Step 4/5] [2021-11-19 21:14:31,656][INFO ][db-checkpoint-thread-#24445%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:14:31] : [Step 4/5] [2021-11-19 21:14:31,656][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint finished [cpId=5c8b34e6-1cf0-4149-a86c-c7d73750a359, pages=24, markPos=WALPointer [idx=32, fileOff=45843, len=2010], walSegmentsCovered=[31], markDuration=326ms, pagesWrite=0ms, fsync=70ms, total=396ms] [21:14:31] : [Step 4/5] [2021-11-19 21:14:31,660][INFO ][disco-notifier-worker-#24306%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=187] [21:14:31] : [Step 4/5] [2021-11-19 21:14:31,661][INFO ][disco-notifier-worker-#24425%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=187] [21:14:31] : [Step 4/5] [2021-11-19 21:14:31,661][INFO ][reencrypt-#24467%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:14:31] : [Step 4/5] [2021-11-19 21:14:31,661][INFO ][reencrypt-#24466%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:14:31] : [Step 4/5] [2021-11-19 21:14:31,862][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10b6f63c-e31c-4573-a225-9f76f500c001, grp=1613773252] [21:14:32] : [Step 4/5] [2021-11-19 21:14:32,104][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint started [checkpointId=3b77a665-16be-4766-9d28-84ac22bd51b8, startPtr=WALPointer [idx=32, fileOff=273947, len=2048], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=89ms, writeCheckpointEntryDuration=152ms, splitAndSortCpPagesDuration=0ms, pages=23, reason='test'] [21:14:32] : [Step 4/5] [2021-11-19 21:14:32,332][INFO ][db-checkpoint-thread-#24450%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:14:32] : [Step 4/5] [2021-11-19 21:14:32,333][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint finished [cpId=3b77a665-16be-4766-9d28-84ac22bd51b8, pages=23, markPos=WALPointer [idx=32, fileOff=273947, len=2048], walSegmentsCovered=[], markDuration=242ms, pagesWrite=1ms, fsync=227ms, total=470ms] [21:14:32] : [Step 4/5] [2021-11-19 21:14:32,333][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00cce8f9-a2b3-4d32-a95a-7f6eb6335000, grp=1613773252] [21:14:32] : [Step 4/5] [2021-11-19 21:14:32,351][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint started [checkpointId=b4a4c56d-ab5b-4030-91cd-93c413aa3b2e, startPtr=WALPointer [idx=32, fileOff=273909, len=2010], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=7ms, writeCheckpointEntryDuration=10ms, splitAndSortCpPagesDuration=0ms, pages=23, reason='test'] [21:14:32] : [Step 4/5] [2021-11-19 21:14:32,361][INFO ][db-checkpoint-thread-#24445%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:14:32] : [Step 4/5] [2021-11-19 21:14:32,361][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint finished [cpId=b4a4c56d-ab5b-4030-91cd-93c413aa3b2e, pages=23, markPos=WALPointer [idx=32, fileOff=273909, len=2010], walSegmentsCovered=[], markDuration=18ms, pagesWrite=4ms, fsync=5ms, total=27ms] [21:14:32] : [Step 4/5] [2021-11-19 21:14:32,366][INFO ][disco-notifier-worker-#24306%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=188] [21:14:32] : [Step 4/5] [2021-11-19 21:14:32,367][INFO ][reencrypt-#24467%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:14:32] : [Step 4/5] [2021-11-19 21:14:32,367][INFO ][disco-notifier-worker-#24425%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=188] [21:14:32] : [Step 4/5] [2021-11-19 21:14:32,367][INFO ][reencrypt-#24466%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:14:32] : [Step 4/5] [2021-11-19 21:14:32,568][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10b6f63c-e31c-4573-a225-9f76f500c001, grp=1613773252] [21:14:32] : [Step 4/5] [2021-11-19 21:14:32,732][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint started [checkpointId=438cac4e-459f-4fef-a85f-d72c8dff36eb, startPtr=WALPointer [idx=32, fileOff=460406, len=2048], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=46ms, writeCheckpointEntryDuration=117ms, splitAndSortCpPagesDuration=0ms, pages=23, reason='test'] [21:14:32] : [Step 4/5] [2021-11-19 21:14:32,987][INFO ][db-checkpoint-thread-#24450%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:14:32] : [Step 4/5] [2021-11-19 21:14:32,988][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint finished [cpId=438cac4e-459f-4fef-a85f-d72c8dff36eb, pages=23, markPos=WALPointer [idx=32, fileOff=460406, len=2048], walSegmentsCovered=[], markDuration=164ms, pagesWrite=1ms, fsync=254ms, total=420ms] [21:14:32] : [Step 4/5] [2021-11-19 21:14:32,988][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00cce8f9-a2b3-4d32-a95a-7f6eb6335000, grp=1613773252] [21:14:33] : [Step 4/5] [2021-11-19 21:14:33,005][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint started [checkpointId=e9e0c519-e801-47c3-a998-c23d67a75977, startPtr=WALPointer [idx=32, fileOff=460330, len=2010], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=7ms, writeCheckpointEntryDuration=9ms, splitAndSortCpPagesDuration=0ms, pages=23, reason='test'] [21:14:33] : [Step 4/5] [2021-11-19 21:14:33,024][INFO ][db-checkpoint-thread-#24445%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:14:33] : [Step 4/5] [2021-11-19 21:14:33,024][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint finished [cpId=e9e0c519-e801-47c3-a998-c23d67a75977, pages=23, markPos=WALPointer [idx=32, fileOff=460330, len=2010], walSegmentsCovered=[], markDuration=17ms, pagesWrite=0ms, fsync=18ms, total=35ms] [21:14:33] : [Step 4/5] [2021-11-19 21:14:33,028][INFO ][disco-notifier-worker-#24425%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=189] [21:14:33] : [Step 4/5] [2021-11-19 21:14:33,029][INFO ][disco-notifier-worker-#24306%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=189] [21:14:33] : [Step 4/5] [2021-11-19 21:14:33,029][INFO ][reencrypt-#24466%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:14:33] : [Step 4/5] [2021-11-19 21:14:33,029][INFO ][reencrypt-#24467%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:14:33] : [Step 4/5] [2021-11-19 21:14:33,230][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10b6f63c-e31c-4573-a225-9f76f500c001, grp=1613773252] [21:14:33] : [Step 4/5] [2021-11-19 21:14:33,233][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint started [checkpointId=4458f328-d780-42c9-830d-81fc7b2f9e33, startPtr=WALPointer [idx=32, fileOff=643937, len=2048], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=1ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=0ms, pages=22, reason='test'] [21:14:33] : [Step 4/5] [2021-11-19 21:14:33,242][INFO ][db-checkpoint-thread-#24450%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:14:33] : [Step 4/5] [2021-11-19 21:14:33,243][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint finished [cpId=4458f328-d780-42c9-830d-81fc7b2f9e33, pages=22, markPos=WALPointer [idx=32, fileOff=643937, len=2048], walSegmentsCovered=[], markDuration=3ms, pagesWrite=0ms, fsync=9ms, total=13ms] [21:14:33] : [Step 4/5] [2021-11-19 21:14:33,243][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00cce8f9-a2b3-4d32-a95a-7f6eb6335000, grp=1613773252] [21:14:33] : [Step 4/5] [2021-11-19 21:14:33,252][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint started [checkpointId=537238ae-2e1d-49d4-b9ba-e3d67a02f090, startPtr=WALPointer [idx=32, fileOff=643823, len=2010], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=7ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=0ms, pages=22, reason='test'] [21:14:33] : [Step 4/5] [2021-11-19 21:14:33,262][INFO ][db-checkpoint-thread-#24445%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:14:33] : [Step 4/5] [2021-11-19 21:14:33,262][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint finished [cpId=537238ae-2e1d-49d4-b9ba-e3d67a02f090, pages=22, markPos=WALPointer [idx=32, fileOff=643823, len=2010], walSegmentsCovered=[], markDuration=9ms, pagesWrite=1ms, fsync=8ms, total=18ms] [21:14:33] : [Step 4/5] [2021-11-19 21:14:33,267][INFO ][disco-notifier-worker-#24306%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=190] [21:14:33] : [Step 4/5] [2021-11-19 21:14:33,267][INFO ][disco-notifier-worker-#24425%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=190] [21:14:33] : [Step 4/5] [2021-11-19 21:14:33,267][INFO ][reencrypt-#24467%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:14:33] : [Step 4/5] [2021-11-19 21:14:33,268][INFO ][reencrypt-#24466%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:14:33] : [Step 4/5] [2021-11-19 21:14:33,469][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10b6f63c-e31c-4573-a225-9f76f500c001, grp=1613773252] [21:14:33] : [Step 4/5] [2021-11-19 21:14:33,472][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint started [checkpointId=91bf883a-4f87-4297-971f-59fdf48f589d, startPtr=WALPointer [idx=32, fileOff=832966, len=2048], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=1ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=1ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=0ms, pages=23, reason='test'] [21:14:33] : [Step 4/5] [2021-11-19 21:14:33,482][INFO ][db-checkpoint-thread-#24450%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:14:33] : [Step 4/5] [2021-11-19 21:14:33,482][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint finished [cpId=91bf883a-4f87-4297-971f-59fdf48f589d, pages=23, markPos=WALPointer [idx=32, fileOff=832966, len=2048], walSegmentsCovered=[], markDuration=4ms, pagesWrite=0ms, fsync=9ms, total=13ms] [21:14:33] : [Step 4/5] [2021-11-19 21:14:33,482][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00cce8f9-a2b3-4d32-a95a-7f6eb6335000, grp=1613773252] [21:14:33] : [Step 4/5] [2021-11-19 21:14:33,491][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint started [checkpointId=ed412106-d207-4fb4-bf88-8fed45fb5d29, startPtr=WALPointer [idx=32, fileOff=832814, len=2010], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=6ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=0ms, pages=23, reason='test'] [21:14:33] : [Step 4/5] [2021-11-19 21:14:33,501][INFO ][db-checkpoint-thread-#24445%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:14:33] : [Step 4/5] [2021-11-19 21:14:33,501][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint finished [cpId=ed412106-d207-4fb4-bf88-8fed45fb5d29, pages=23, markPos=WALPointer [idx=32, fileOff=832814, len=2010], walSegmentsCovered=[], markDuration=9ms, pagesWrite=1ms, fsync=8ms, total=18ms] [21:14:33] : [Step 4/5] [2021-11-19 21:14:33,506][INFO ][disco-notifier-worker-#24425%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=191] [21:14:33] : [Step 4/5] [2021-11-19 21:14:33,506][INFO ][disco-notifier-worker-#24306%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=191] [21:14:33] : [Step 4/5] [2021-11-19 21:14:33,507][INFO ][reencrypt-#24466%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:14:33] : [Step 4/5] [2021-11-19 21:14:33,507][INFO ][reencrypt-#24467%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:14:33] : [Step 4/5] [2021-11-19 21:14:33,708][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10b6f63c-e31c-4573-a225-9f76f500c001, grp=1613773252] [21:14:33] : [Step 4/5] [2021-11-19 21:14:33,711][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint started [checkpointId=05d0bf42-94d1-4552-99f4-234be063a5ad, startPtr=WALPointer [idx=32, fileOff=1025421, len=2048], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=0ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=1ms, pages=23, reason='test'] [21:14:33] : [Step 4/5] [2021-11-19 21:14:33,720][INFO ][db-checkpoint-thread-#24450%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:14:33] : [Step 4/5] [2021-11-19 21:14:33,721][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint finished [cpId=05d0bf42-94d1-4552-99f4-234be063a5ad, pages=23, markPos=WALPointer [idx=32, fileOff=1025421, len=2048], walSegmentsCovered=[], markDuration=2ms, pagesWrite=1ms, fsync=8ms, total=12ms] [21:14:33] : [Step 4/5] [2021-11-19 21:14:33,721][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00cce8f9-a2b3-4d32-a95a-7f6eb6335000, grp=1613773252] [21:14:33] : [Step 4/5] [2021-11-19 21:14:33,730][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint started [checkpointId=96e6cbe7-6605-41bf-a8b2-03a973fbb47c, startPtr=WALPointer [idx=32, fileOff=1025231, len=2010], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=2ms, checkpointLockHoldTime=2ms, walCpRecordFsyncDuration=5ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=0ms, pages=23, reason='test'] [21:14:33] : [Step 4/5] [2021-11-19 21:14:33,739][INFO ][db-checkpoint-thread-#24445%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:14:33] : [Step 4/5] [2021-11-19 21:14:33,740][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint finished [cpId=96e6cbe7-6605-41bf-a8b2-03a973fbb47c, pages=23, markPos=WALPointer [idx=32, fileOff=1025231, len=2010], walSegmentsCovered=[], markDuration=9ms, pagesWrite=0ms, fsync=9ms, total=19ms] [21:14:33] : [Step 4/5] [2021-11-19 21:14:33,747][INFO ][wal-file-archiver%grid-0-#24437%grid-0%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=32, segIdx=2, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000002.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000032.wal] [21:14:33] : [Step 4/5] [2021-11-19 21:14:33,747][INFO ][wal-file-archiver%grid-1-#24440%grid-1%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=32, segIdx=2, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000002.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000032.wal] [21:14:33] : [Step 4/5] [2021-11-19 21:14:33,748][INFO ][wal-file-cleaner%grid-0-#24438%grid-0%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=23, currSize=9.9 MB, maxSize=20.0 MB] [21:14:33] : [Step 4/5] [2021-11-19 21:14:33,749][INFO ][wal-file-cleaner%grid-1-#24441%grid-1%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=23, currSize=9.9 MB, maxSize=20.0 MB] [21:14:33] : [Step 4/5] [2021-11-19 21:14:33,750][INFO ][disco-notifier-worker-#24306%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=192] [21:14:33] : [Step 4/5] [2021-11-19 21:14:33,750][INFO ][reencrypt-#24467%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:14:33] : [Step 4/5] [2021-11-19 21:14:33,751][INFO ][wal-file-cleaner%grid-0-#24438%grid-0%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=8.9 MB, maxSize=20.0 MB] [21:14:33] : [Step 4/5] [2021-11-19 21:14:33,751][INFO ][wal-file-cleaner%grid-1-#24441%grid-1%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=8.9 MB, maxSize=20.0 MB] [21:14:33] : [Step 4/5] [2021-11-19 21:14:33,751][INFO ][disco-notifier-worker-#24425%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=192] [21:14:33] : [Step 4/5] [2021-11-19 21:14:33,752][INFO ][reencrypt-#24466%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:14:33] : [Step 4/5] [2021-11-19 21:14:33,760][INFO ][wal-file-archiver%grid-0-#24437%grid-0%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000002.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000032.wal] [21:14:33] : [Step 4/5] [2021-11-19 21:14:33,760][INFO ][wal-file-archiver%grid-1-#24440%grid-1%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000002.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000032.wal] [21:14:33] : [Step 4/5] [2021-11-19 21:14:33,952][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10b6f63c-e31c-4573-a225-9f76f500c001, grp=1613773252] [21:14:33] : [Step 4/5] [2021-11-19 21:14:33,956][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint started [checkpointId=9796e220-44be-46a7-ac46-089ebc570773, startPtr=WALPointer [idx=33, fileOff=197788, len=2048], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=1ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=0ms, pages=24, reason='test'] [21:14:33] : [Step 4/5] [2021-11-19 21:14:33,967][INFO ][db-checkpoint-thread-#24450%grid-1%][GridEncryptionManager] Previous encryption keys were removed [grpId=1613773252, keyIds=[135, 136, 137, 138, 139]] [21:14:33] : [Step 4/5] [2021-11-19 21:14:33,967][INFO ][db-checkpoint-thread-#24450%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:14:33] : [Step 4/5] [2021-11-19 21:14:33,968][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint finished [cpId=9796e220-44be-46a7-ac46-089ebc570773, pages=24, markPos=WALPointer [idx=33, fileOff=197788, len=2048], walSegmentsCovered=[32], markDuration=4ms, pagesWrite=1ms, fsync=10ms, total=15ms] [21:14:33] : [Step 4/5] [2021-11-19 21:14:33,968][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00cce8f9-a2b3-4d32-a95a-7f6eb6335000, grp=1613773252] [21:14:33] : [Step 4/5] [2021-11-19 21:14:33,975][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint started [checkpointId=80ba68f5-ec27-4d0d-a3d0-f860fea11056, startPtr=WALPointer [idx=33, fileOff=197788, len=2010], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=5ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=0ms, pages=24, reason='test'] [21:14:33] : [Step 4/5] [2021-11-19 21:14:33,987][INFO ][db-checkpoint-thread-#24445%grid-0%][GridEncryptionManager] Previous encryption keys were removed [grpId=1613773252, keyIds=[135, 136, 137, 138, 139]] [21:14:33] : [Step 4/5] [2021-11-19 21:14:33,987][INFO ][db-checkpoint-thread-#24445%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:14:33] : [Step 4/5] [2021-11-19 21:14:33,987][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint finished [cpId=80ba68f5-ec27-4d0d-a3d0-f860fea11056, pages=24, markPos=WALPointer [idx=33, fileOff=197788, len=2010], walSegmentsCovered=[32], markDuration=7ms, pagesWrite=1ms, fsync=10ms, total=18ms] [21:14:33] : [Step 4/5] [2021-11-19 21:14:33,992][INFO ][disco-notifier-worker-#24306%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=193] [21:14:33] : [Step 4/5] [2021-11-19 21:14:33,992][INFO ][reencrypt-#24467%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:14:33] : [Step 4/5] [2021-11-19 21:14:33,992][INFO ][disco-notifier-worker-#24425%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=193] [21:14:33] : [Step 4/5] [2021-11-19 21:14:33,993][INFO ][reencrypt-#24466%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:14:34] : [Step 4/5] [2021-11-19 21:14:34,194][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10b6f63c-e31c-4573-a225-9f76f500c001, grp=1613773252] [21:14:34] : [Step 4/5] [2021-11-19 21:14:34,197][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint started [checkpointId=8fdaf8a0-c126-4932-839c-b3a0eabf44a0, startPtr=WALPointer [idx=33, fileOff=427794, len=2048], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=0ms, writeCheckpointEntryDuration=2ms, splitAndSortCpPagesDuration=0ms, pages=23, reason='test'] [21:14:34] : [Step 4/5] [2021-11-19 21:14:34,206][INFO ][db-checkpoint-thread-#24450%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:14:34] : [Step 4/5] [2021-11-19 21:14:34,207][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint finished [cpId=8fdaf8a0-c126-4932-839c-b3a0eabf44a0, pages=23, markPos=WALPointer [idx=33, fileOff=427794, len=2048], walSegmentsCovered=[], markDuration=3ms, pagesWrite=0ms, fsync=9ms, total=13ms] [21:14:34] : [Step 4/5] [2021-11-19 21:14:34,207][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00cce8f9-a2b3-4d32-a95a-7f6eb6335000, grp=1613773252] [21:14:34] : [Step 4/5] [2021-11-19 21:14:34,215][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint started [checkpointId=a5de97fd-09ba-4a1c-b0d3-40fcfd5c810b, startPtr=WALPointer [idx=33, fileOff=427756, len=2010], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=6ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=0ms, pages=23, reason='test'] [21:14:34] : [Step 4/5] [2021-11-19 21:14:34,225][INFO ][db-checkpoint-thread-#24445%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:14:34] : [Step 4/5] [2021-11-19 21:14:34,226][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint finished [cpId=a5de97fd-09ba-4a1c-b0d3-40fcfd5c810b, pages=23, markPos=WALPointer [idx=33, fileOff=427756, len=2010], walSegmentsCovered=[], markDuration=8ms, pagesWrite=1ms, fsync=9ms, total=18ms] [21:14:34] : [Step 4/5] [2021-11-19 21:14:34,231][INFO ][disco-notifier-worker-#24306%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=194] [21:14:34] : [Step 4/5] [2021-11-19 21:14:34,231][INFO ][reencrypt-#24467%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:14:34] : [Step 4/5] [2021-11-19 21:14:34,231][INFO ][disco-notifier-worker-#24425%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=194] [21:14:34] : [Step 4/5] [2021-11-19 21:14:34,231][INFO ][reencrypt-#24466%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:14:34] : [Step 4/5] [2021-11-19 21:14:34,432][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10b6f63c-e31c-4573-a225-9f76f500c001, grp=1613773252] [21:14:34] : [Step 4/5] [2021-11-19 21:14:34,598][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint started [checkpointId=f567236b-b872-4d62-b346-bde7edf818de, startPtr=WALPointer [idx=33, fileOff=619590, len=2048], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=67ms, writeCheckpointEntryDuration=98ms, splitAndSortCpPagesDuration=0ms, pages=24, reason='test'] [21:14:34] : [Step 4/5] [2021-11-19 21:14:34,610][INFO ][db-checkpoint-thread-#24450%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:14:34] : [Step 4/5] [2021-11-19 21:14:34,610][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint finished [cpId=f567236b-b872-4d62-b346-bde7edf818de, pages=24, markPos=WALPointer [idx=33, fileOff=619590, len=2048], walSegmentsCovered=[], markDuration=166ms, pagesWrite=2ms, fsync=9ms, total=177ms] [21:14:34] : [Step 4/5] [2021-11-19 21:14:34,610][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00cce8f9-a2b3-4d32-a95a-7f6eb6335000, grp=1613773252] [21:14:34] : [Step 4/5] [2021-11-19 21:14:34,619][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint started [checkpointId=bbe31177-ebc9-49c9-af71-b5b995342274, startPtr=WALPointer [idx=33, fileOff=619514, len=2010], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=5ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=0ms, pages=24, reason='test'] [21:14:34] : [Step 4/5] [2021-11-19 21:14:34,628][INFO ][db-checkpoint-thread-#24445%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:14:34] : [Step 4/5] [2021-11-19 21:14:34,628][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint finished [cpId=bbe31177-ebc9-49c9-af71-b5b995342274, pages=24, markPos=WALPointer [idx=33, fileOff=619514, len=2010], walSegmentsCovered=[], markDuration=8ms, pagesWrite=1ms, fsync=8ms, total=17ms] [21:14:34] : [Step 4/5] [2021-11-19 21:14:34,633][INFO ][disco-notifier-worker-#24306%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=195] [21:14:34] : [Step 4/5] [2021-11-19 21:14:34,634][INFO ][disco-notifier-worker-#24425%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=195] [21:14:34] : [Step 4/5] [2021-11-19 21:14:34,634][INFO ][reencrypt-#24467%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:14:34] : [Step 4/5] [2021-11-19 21:14:34,634][INFO ][reencrypt-#24466%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:14:34] : [Step 4/5] [2021-11-19 21:14:34,835][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10b6f63c-e31c-4573-a225-9f76f500c001, grp=1613773252] [21:14:35] : [Step 4/5] [2021-11-19 21:14:35,046][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint started [checkpointId=fe85af0f-1f3e-4b02-a6ea-8057440e7b6d, startPtr=WALPointer [idx=33, fileOff=808619, len=2048], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=70ms, writeCheckpointEntryDuration=140ms, splitAndSortCpPagesDuration=0ms, pages=23, reason='test'] [21:14:35] : [Step 4/5] [2021-11-19 21:14:35,052][INFO ][db-checkpoint-thread-#24450%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:14:35] : [Step 4/5] [2021-11-19 21:14:35,052][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint finished [cpId=fe85af0f-1f3e-4b02-a6ea-8057440e7b6d, pages=23, markPos=WALPointer [idx=33, fileOff=808619, len=2048], walSegmentsCovered=[], markDuration=211ms, pagesWrite=0ms, fsync=5ms, total=217ms] [21:14:35] : [Step 4/5] [2021-11-19 21:14:35,052][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00cce8f9-a2b3-4d32-a95a-7f6eb6335000, grp=1613773252] [21:14:35] : [Step 4/5] [2021-11-19 21:14:35,061][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint started [checkpointId=c7b79e64-4ff5-49bb-90ac-2301feb5cd1a, startPtr=WALPointer [idx=33, fileOff=808505, len=2010], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=5ms, writeCheckpointEntryDuration=2ms, splitAndSortCpPagesDuration=0ms, pages=23, reason='test'] [21:14:35] : [Step 4/5] [2021-11-19 21:14:35,070][INFO ][db-checkpoint-thread-#24445%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:14:35] : [Step 4/5] [2021-11-19 21:14:35,071][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint finished [cpId=c7b79e64-4ff5-49bb-90ac-2301feb5cd1a, pages=23, markPos=WALPointer [idx=33, fileOff=808505, len=2010], walSegmentsCovered=[], markDuration=7ms, pagesWrite=1ms, fsync=9ms, total=18ms] [21:14:35] : [Step 4/5] [2021-11-19 21:14:35,075][INFO ][disco-notifier-worker-#24306%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=196] [21:14:35] : [Step 4/5] [2021-11-19 21:14:35,075][INFO ][disco-notifier-worker-#24425%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=196] [21:14:35] : [Step 4/5] [2021-11-19 21:14:35,075][INFO ][reencrypt-#24467%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:14:35] : [Step 4/5] [2021-11-19 21:14:35,076][INFO ][reencrypt-#24466%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:14:35] : [Step 4/5] [2021-11-19 21:14:35,276][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10b6f63c-e31c-4573-a225-9f76f500c001, grp=1613773252] [21:14:35] : [Step 4/5] [2021-11-19 21:14:35,466][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint started [checkpointId=1b6c2eee-64cf-4834-8a00-83f3235ce199, startPtr=WALPointer [idx=33, fileOff=1001074, len=2048], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=65ms, writeCheckpointEntryDuration=123ms, splitAndSortCpPagesDuration=0ms, pages=23, reason='test'] [21:14:35] : [Step 4/5] [2021-11-19 21:14:35,476][INFO ][db-checkpoint-thread-#24450%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:14:35] : [Step 4/5] [2021-11-19 21:14:35,477][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint finished [cpId=1b6c2eee-64cf-4834-8a00-83f3235ce199, pages=23, markPos=WALPointer [idx=33, fileOff=1001074, len=2048], walSegmentsCovered=[], markDuration=190ms, pagesWrite=1ms, fsync=9ms, total=200ms] [21:14:35] : [Step 4/5] [2021-11-19 21:14:35,477][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00cce8f9-a2b3-4d32-a95a-7f6eb6335000, grp=1613773252] [21:14:35] : [Step 4/5] [2021-11-19 21:14:35,486][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint started [checkpointId=edc428dc-d57b-4255-9c2b-48f565ff7b8f, startPtr=WALPointer [idx=33, fileOff=1000922, len=2010], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=7ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=0ms, pages=23, reason='test'] [21:14:35] : [Step 4/5] [2021-11-19 21:14:35,496][INFO ][db-checkpoint-thread-#24445%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:14:35] : [Step 4/5] [2021-11-19 21:14:35,496][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint finished [cpId=edc428dc-d57b-4255-9c2b-48f565ff7b8f, pages=23, markPos=WALPointer [idx=33, fileOff=1000922, len=2010], walSegmentsCovered=[], markDuration=9ms, pagesWrite=1ms, fsync=8ms, total=18ms] [21:14:35] : [Step 4/5] [2021-11-19 21:14:35,504][INFO ][wal-file-archiver%grid-1-#24440%grid-1%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=33, segIdx=3, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000003.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000033.wal] [21:14:35] : [Step 4/5] [2021-11-19 21:14:35,504][INFO ][wal-file-archiver%grid-0-#24437%grid-0%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=33, segIdx=3, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000003.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000033.wal] [21:14:35] : [Step 4/5] [2021-11-19 21:14:35,505][INFO ][wal-file-cleaner%grid-1-#24441%grid-1%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=24, currSize=9.9 MB, maxSize=20.0 MB] [21:14:35] : [Step 4/5] [2021-11-19 21:14:35,506][INFO ][wal-file-cleaner%grid-0-#24438%grid-0%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=24, currSize=9.9 MB, maxSize=20.0 MB] [21:14:35] : [Step 4/5] [2021-11-19 21:14:35,507][INFO ][wal-file-cleaner%grid-1-#24441%grid-1%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=8.9 MB, maxSize=20.0 MB] [21:14:35] : [Step 4/5] [2021-11-19 21:14:35,508][INFO ][wal-file-cleaner%grid-0-#24438%grid-0%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=8.9 MB, maxSize=20.0 MB] [21:14:35] : [Step 4/5] [2021-11-19 21:14:35,509][INFO ][sys-#24404%grid-1%][GridEncryptionManager] Previous encryption keys have been removed [grpId=1613773252, keyIds=[144, 140, 141, 142, 143]] [21:14:35] : [Step 4/5] [2021-11-19 21:14:35,509][INFO ][sys-#24296%grid-0%][GridEncryptionManager] Previous encryption keys have been removed [grpId=1613773252, keyIds=[144, 140, 141, 142, 143]] [21:14:35] : [Step 4/5] [2021-11-19 21:14:35,511][INFO ][disco-notifier-worker-#24306%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=197] [21:14:35] : [Step 4/5] [2021-11-19 21:14:35,511][INFO ][reencrypt-#24467%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:14:35] : [Step 4/5] [2021-11-19 21:14:35,512][INFO ][disco-notifier-worker-#24425%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=197] [21:14:35] : [Step 4/5] [2021-11-19 21:14:35,512][INFO ][reencrypt-#24466%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:14:35] : [Step 4/5] [2021-11-19 21:14:35,517][INFO ][wal-file-archiver%grid-1-#24440%grid-1%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000003.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000033.wal] [21:14:35] : [Step 4/5] [2021-11-19 21:14:35,518][INFO ][wal-file-archiver%grid-0-#24437%grid-0%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000003.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000033.wal] [21:14:35] : [Step 4/5] [2021-11-19 21:14:35,717][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10b6f63c-e31c-4573-a225-9f76f500c001, grp=1613773252] [21:14:35] : [Step 4/5] [2021-11-19 21:14:35,980][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint started [checkpointId=35d8f65c-bf80-4251-8709-2a5e24249fd8, startPtr=WALPointer [idx=34, fileOff=202522, len=2048], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=58ms, writeCheckpointEntryDuration=204ms, splitAndSortCpPagesDuration=0ms, pages=26, reason='test'] [21:14:35] : [Step 4/5] [2021-11-19 21:14:35,990][INFO ][db-checkpoint-thread-#24450%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:14:35] : [Step 4/5] [2021-11-19 21:14:35,991][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint finished [cpId=35d8f65c-bf80-4251-8709-2a5e24249fd8, pages=26, markPos=WALPointer [idx=34, fileOff=202522, len=2048], walSegmentsCovered=[33], markDuration=263ms, pagesWrite=1ms, fsync=9ms, total=274ms] [21:14:35] : [Step 4/5] [2021-11-19 21:14:35,991][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00cce8f9-a2b3-4d32-a95a-7f6eb6335000, grp=1613773252] [21:14:36] : [Step 4/5] [2021-11-19 21:14:35,999][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint started [checkpointId=0bab171b-f57b-4ee3-8990-c697034a7364, startPtr=WALPointer [idx=34, fileOff=202522, len=2010], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=6ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=0ms, pages=26, reason='test'] [21:14:36] : [Step 4/5] [2021-11-19 21:14:36,009][INFO ][db-checkpoint-thread-#24445%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:14:36] : [Step 4/5] [2021-11-19 21:14:36,009][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint finished [cpId=0bab171b-f57b-4ee3-8990-c697034a7364, pages=26, markPos=WALPointer [idx=34, fileOff=202522, len=2010], walSegmentsCovered=[33], markDuration=8ms, pagesWrite=2ms, fsync=7ms, total=18ms] [21:14:36] : [Step 4/5] [2021-11-19 21:14:36,014][INFO ][disco-notifier-worker-#24306%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=198] [21:14:36] : [Step 4/5] [2021-11-19 21:14:36,014][INFO ][reencrypt-#24467%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:14:36] : [Step 4/5] [2021-11-19 21:14:36,014][INFO ][disco-notifier-worker-#24425%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=198] [21:14:36] : [Step 4/5] [2021-11-19 21:14:36,015][INFO ][reencrypt-#24466%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:14:36] : [Step 4/5] [2021-11-19 21:14:36,016][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10b6f63c-e31c-4573-a225-9f76f500c001, grp=1613773252] [21:14:36] : [Step 4/5] [2021-11-19 21:14:36,020][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint started [checkpointId=7fba728f-8056-439b-8bfd-027880f63537, startPtr=WALPointer [idx=34, fileOff=388981, len=2048], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=1ms, writeCheckpointEntryDuration=2ms, splitAndSortCpPagesDuration=0ms, pages=23, reason='test'] [21:14:36] : [Step 4/5] [2021-11-19 21:14:36,029][INFO ][db-checkpoint-thread-#24450%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:14:36] : [Step 4/5] [2021-11-19 21:14:36,030][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint finished [cpId=7fba728f-8056-439b-8bfd-027880f63537, pages=23, markPos=WALPointer [idx=34, fileOff=388981, len=2048], walSegmentsCovered=[], markDuration=4ms, pagesWrite=0ms, fsync=9ms, total=13ms] [21:14:36] : [Step 4/5] [2021-11-19 21:14:36,030][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00cce8f9-a2b3-4d32-a95a-7f6eb6335000, grp=1613773252] [21:14:36] : [Step 4/5] [2021-11-19 21:14:36,039][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint started [checkpointId=b7c5c127-5311-4173-afa2-f81124a90386, startPtr=WALPointer [idx=34, fileOff=388943, len=2010], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=7ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=0ms, pages=23, reason='test'] [21:14:36] : [Step 4/5] [2021-11-19 21:14:36,049][INFO ][db-checkpoint-thread-#24445%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:14:36] : [Step 4/5] [2021-11-19 21:14:36,049][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint finished [cpId=b7c5c127-5311-4173-afa2-f81124a90386, pages=23, markPos=WALPointer [idx=34, fileOff=388943, len=2010], walSegmentsCovered=[], markDuration=9ms, pagesWrite=0ms, fsync=9ms, total=19ms] [21:14:36] : [Step 4/5] [2021-11-19 21:14:36,053][INFO ][disco-notifier-worker-#24306%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=199] [21:14:36] : [Step 4/5] [2021-11-19 21:14:36,054][INFO ][disco-notifier-worker-#24425%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=199] [21:14:36] : [Step 4/5] [2021-11-19 21:14:36,054][INFO ][reencrypt-#24467%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:14:36] : [Step 4/5] [2021-11-19 21:14:36,054][INFO ][reencrypt-#24466%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:14:36] : [Step 4/5] [2021-11-19 21:14:36,255][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10b6f63c-e31c-4573-a225-9f76f500c001, grp=1613773252] [21:14:36] : [Step 4/5] [2021-11-19 21:14:36,462][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint started [checkpointId=adc16d09-2500-4b97-84e5-a4e679c47860, startPtr=WALPointer [idx=34, fileOff=572512, len=2048], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=67ms, writeCheckpointEntryDuration=139ms, splitAndSortCpPagesDuration=0ms, pages=22, reason='test'] [21:14:36] : [Step 4/5] [2021-11-19 21:14:36,473][INFO ][db-checkpoint-thread-#24450%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:14:36] : [Step 4/5] [2021-11-19 21:14:36,473][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint finished [cpId=adc16d09-2500-4b97-84e5-a4e679c47860, pages=22, markPos=WALPointer [idx=34, fileOff=572512, len=2048], walSegmentsCovered=[], markDuration=207ms, pagesWrite=1ms, fsync=9ms, total=217ms] [21:14:36] : [Step 4/5] [2021-11-19 21:14:36,473][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00cce8f9-a2b3-4d32-a95a-7f6eb6335000, grp=1613773252] [21:14:36] : [Step 4/5] [2021-11-19 21:14:36,490][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint started [checkpointId=b047b9cf-86b0-43df-aac8-02166eb7eae1, startPtr=WALPointer [idx=34, fileOff=572436, len=2010], checkpointBeforeLockTime=2ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=5ms, writeCheckpointEntryDuration=9ms, splitAndSortCpPagesDuration=0ms, pages=22, reason='test'] [21:14:36] : [Step 4/5] [2021-11-19 21:14:36,500][INFO ][db-checkpoint-thread-#24445%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:14:36] : [Step 4/5] [2021-11-19 21:14:36,500][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint finished [cpId=b047b9cf-86b0-43df-aac8-02166eb7eae1, pages=22, markPos=WALPointer [idx=34, fileOff=572436, len=2010], walSegmentsCovered=[], markDuration=15ms, pagesWrite=0ms, fsync=9ms, total=26ms] [21:14:36] : [Step 4/5] [2021-11-19 21:14:36,505][INFO ][disco-notifier-worker-#24306%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=200] [21:14:36] : [Step 4/5] [2021-11-19 21:14:36,505][INFO ][reencrypt-#24467%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:14:36] : [Step 4/5] [2021-11-19 21:14:36,505][INFO ][disco-notifier-worker-#24425%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=200] [21:14:36] : [Step 4/5] [2021-11-19 21:14:36,506][INFO ][reencrypt-#24466%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:14:36] : [Step 4/5] [2021-11-19 21:14:36,707][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10b6f63c-e31c-4573-a225-9f76f500c001, grp=1613773252] [21:14:36] : [Step 4/5] [2021-11-19 21:14:36,895][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint started [checkpointId=23385203-ff4f-4b4f-a92b-a15e89e42812, startPtr=WALPointer [idx=34, fileOff=761541, len=2048], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=1ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=64ms, writeCheckpointEntryDuration=123ms, splitAndSortCpPagesDuration=0ms, pages=23, reason='test'] [21:14:36] : [Step 4/5] [2021-11-19 21:14:36,905][INFO ][db-checkpoint-thread-#24450%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:14:36] : [Step 4/5] [2021-11-19 21:14:36,905][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint finished [cpId=23385203-ff4f-4b4f-a92b-a15e89e42812, pages=23, markPos=WALPointer [idx=34, fileOff=761541, len=2048], walSegmentsCovered=[], markDuration=189ms, pagesWrite=4ms, fsync=5ms, total=198ms] [21:14:36] : [Step 4/5] [2021-11-19 21:14:36,905][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00cce8f9-a2b3-4d32-a95a-7f6eb6335000, grp=1613773252] [21:14:36] : [Step 4/5] [2021-11-19 21:14:36,914][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint started [checkpointId=5688d09e-2b33-415f-b12a-56114417f761, startPtr=WALPointer [idx=34, fileOff=761427, len=2010], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=5ms, writeCheckpointEntryDuration=2ms, splitAndSortCpPagesDuration=0ms, pages=23, reason='test'] [21:14:36] : [Step 4/5] [2021-11-19 21:14:36,924][INFO ][db-checkpoint-thread-#24445%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:14:36] : [Step 4/5] [2021-11-19 21:14:36,924][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint finished [cpId=5688d09e-2b33-415f-b12a-56114417f761, pages=23, markPos=WALPointer [idx=34, fileOff=761427, len=2010], walSegmentsCovered=[], markDuration=8ms, pagesWrite=0ms, fsync=9ms, total=18ms] [21:14:36] : [Step 4/5] [2021-11-19 21:14:36,929][INFO ][disco-notifier-worker-#24306%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=201] [21:14:36] : [Step 4/5] [2021-11-19 21:14:36,929][INFO ][disco-notifier-worker-#24425%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=201] [21:14:36] : [Step 4/5] [2021-11-19 21:14:36,929][INFO ][reencrypt-#24467%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:14:36] : [Step 4/5] [2021-11-19 21:14:36,930][INFO ][reencrypt-#24466%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:14:37] : [Step 4/5] [2021-11-19 21:14:37,131][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10b6f63c-e31c-4573-a225-9f76f500c001, grp=1613773252] [21:14:37] : [Step 4/5] [2021-11-19 21:14:37,135][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint started [checkpointId=65a7c08c-6f11-48ad-ab94-4a7cea7284b7, startPtr=WALPointer [idx=34, fileOff=953996, len=2048], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=1ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=0ms, pages=23, reason='test'] [21:14:37] : [Step 4/5] [2021-11-19 21:14:37,145][INFO ][db-checkpoint-thread-#24450%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:14:37] : [Step 4/5] [2021-11-19 21:14:37,145][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint finished [cpId=65a7c08c-6f11-48ad-ab94-4a7cea7284b7, pages=23, markPos=WALPointer [idx=34, fileOff=953996, len=2048], walSegmentsCovered=[], markDuration=4ms, pagesWrite=1ms, fsync=8ms, total=13ms] [21:14:37] : [Step 4/5] [2021-11-19 21:14:37,145][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00cce8f9-a2b3-4d32-a95a-7f6eb6335000, grp=1613773252] [21:14:37] : [Step 4/5] [2021-11-19 21:14:37,154][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint started [checkpointId=b8dcc525-59e5-49a6-bd27-f4bdb0bd20b0, startPtr=WALPointer [idx=34, fileOff=953844, len=2010], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=5ms, writeCheckpointEntryDuration=2ms, splitAndSortCpPagesDuration=0ms, pages=23, reason='test'] [21:14:37] : [Step 4/5] [2021-11-19 21:14:37,163][INFO ][db-checkpoint-thread-#24445%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:14:37] : [Step 4/5] [2021-11-19 21:14:37,164][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint finished [cpId=b8dcc525-59e5-49a6-bd27-f4bdb0bd20b0, pages=23, markPos=WALPointer [idx=34, fileOff=953844, len=2010], walSegmentsCovered=[], markDuration=8ms, pagesWrite=0ms, fsync=9ms, total=18ms] [21:14:37] : [Step 4/5] [2021-11-19 21:14:37,172][INFO ][wal-file-archiver%grid-0-#24437%grid-0%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=34, segIdx=4, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000004.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000034.wal] [21:14:37] : [Step 4/5] [2021-11-19 21:14:37,172][INFO ][wal-file-archiver%grid-1-#24440%grid-1%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=34, segIdx=4, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000004.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000034.wal] [21:14:37] : [Step 4/5] [2021-11-19 21:14:37,173][INFO ][wal-file-cleaner%grid-0-#24438%grid-0%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=25, currSize=9.9 MB, maxSize=20.0 MB] [21:14:37] : [Step 4/5] [2021-11-19 21:14:37,174][INFO ][wal-file-cleaner%grid-1-#24441%grid-1%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=25, currSize=9.9 MB, maxSize=20.0 MB] [21:14:37] : [Step 4/5] [2021-11-19 21:14:37,175][INFO ][wal-file-cleaner%grid-0-#24438%grid-0%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=8.9 MB, maxSize=20.0 MB] [21:14:37] : [Step 4/5] [2021-11-19 21:14:37,176][INFO ][wal-file-cleaner%grid-1-#24441%grid-1%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=8.9 MB, maxSize=20.0 MB] [21:14:37] : [Step 4/5] [2021-11-19 21:14:37,176][INFO ][disco-notifier-worker-#24425%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=202] [21:14:37] : [Step 4/5] [2021-11-19 21:14:37,176][INFO ][disco-notifier-worker-#24306%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=202] [21:14:37] : [Step 4/5] [2021-11-19 21:14:37,176][INFO ][reencrypt-#24467%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:14:37] : [Step 4/5] [2021-11-19 21:14:37,176][INFO ][reencrypt-#24466%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:14:37] : [Step 4/5] [2021-11-19 21:14:37,186][INFO ][wal-file-archiver%grid-0-#24437%grid-0%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000004.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000034.wal] [21:14:37] : [Step 4/5] [2021-11-19 21:14:37,186][INFO ][wal-file-archiver%grid-1-#24440%grid-1%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000004.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000034.wal] [21:14:37] : [Step 4/5] [2021-11-19 21:14:37,378][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10b6f63c-e31c-4573-a225-9f76f500c001, grp=1613773252] [21:14:37] : [Step 4/5] [2021-11-19 21:14:37,452][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint started [checkpointId=77935768-3603-480f-a3ef-7f265e4203c9, startPtr=WALPointer [idx=35, fileOff=106499, len=2048], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=9ms, writeCheckpointEntryDuration=63ms, splitAndSortCpPagesDuration=1ms, pages=24, reason='test'] [21:14:37] : [Step 4/5] [2021-11-19 21:14:37,463][INFO ][db-checkpoint-thread-#24450%grid-1%][GridEncryptionManager] Previous encryption keys were removed [grpId=1613773252, keyIds=[145, 146, 147, 148, 149]] [21:14:37] : [Step 4/5] [2021-11-19 21:14:37,463][INFO ][db-checkpoint-thread-#24450%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:14:37] : [Step 4/5] [2021-11-19 21:14:37,463][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint finished [cpId=77935768-3603-480f-a3ef-7f265e4203c9, pages=24, markPos=WALPointer [idx=35, fileOff=106499, len=2048], walSegmentsCovered=[34], markDuration=74ms, pagesWrite=0ms, fsync=10ms, total=85ms] [21:14:37] : [Step 4/5] [2021-11-19 21:14:37,463][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00cce8f9-a2b3-4d32-a95a-7f6eb6335000, grp=1613773252] [21:14:37] : [Step 4/5] [2021-11-19 21:14:37,471][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint started [checkpointId=07bd4a2b-f503-4695-be0a-034e7404f6e9, startPtr=WALPointer [idx=35, fileOff=106499, len=2010], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=1ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=4ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=1ms, pages=24, reason='test'] [21:14:37] : [Step 4/5] [2021-11-19 21:14:37,482][INFO ][db-checkpoint-thread-#24445%grid-0%][GridEncryptionManager] Previous encryption keys were removed [grpId=1613773252, keyIds=[145, 146, 147, 148, 149]] [21:14:37] : [Step 4/5] [2021-11-19 21:14:37,482][INFO ][db-checkpoint-thread-#24445%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:14:37] : [Step 4/5] [2021-11-19 21:14:37,483][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint finished [cpId=07bd4a2b-f503-4695-be0a-034e7404f6e9, pages=24, markPos=WALPointer [idx=35, fileOff=106499, len=2010], walSegmentsCovered=[34], markDuration=8ms, pagesWrite=0ms, fsync=11ms, total=19ms] [21:14:37] : [Step 4/5] [2021-11-19 21:14:37,488][INFO ][disco-notifier-worker-#24306%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=203] [21:14:37] : [Step 4/5] [2021-11-19 21:14:37,488][INFO ][reencrypt-#24467%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:14:37] : [Step 4/5] [2021-11-19 21:14:37,488][INFO ][disco-notifier-worker-#24425%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=203] [21:14:37] : [Step 4/5] [2021-11-19 21:14:37,489][INFO ][reencrypt-#24466%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:14:37] : [Step 4/5] [2021-11-19 21:14:37,492][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10b6f63c-e31c-4573-a225-9f76f500c001, grp=1613773252] [21:14:37] : [Step 4/5] [2021-11-19 21:14:37,499][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint started [checkpointId=9f2dfad9-c5e5-4f07-80c2-d8334aa5a701, startPtr=WALPointer [idx=35, fileOff=336505, len=2048], checkpointBeforeLockTime=3ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=2ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=0ms, pages=23, reason='test'] [21:14:37] : [Step 4/5] [2021-11-19 21:14:37,509][INFO ][db-checkpoint-thread-#24450%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:14:37] : [Step 4/5] [2021-11-19 21:14:37,510][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint finished [cpId=9f2dfad9-c5e5-4f07-80c2-d8334aa5a701, pages=23, markPos=WALPointer [idx=35, fileOff=336505, len=2048], walSegmentsCovered=[], markDuration=4ms, pagesWrite=1ms, fsync=9ms, total=17ms] [21:14:37] : [Step 4/5] [2021-11-19 21:14:37,510][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00cce8f9-a2b3-4d32-a95a-7f6eb6335000, grp=1613773252] [21:14:37] : [Step 4/5] [2021-11-19 21:14:37,519][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint started [checkpointId=4c08a5a5-3868-4853-a41a-e23b9f23e6e3, startPtr=WALPointer [idx=35, fileOff=336467, len=2010], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=5ms, checkpointLockHoldTime=5ms, walCpRecordFsyncDuration=2ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=0ms, pages=23, reason='test'] [21:14:37] : [Step 4/5] [2021-11-19 21:14:37,529][INFO ][db-checkpoint-thread-#24445%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:14:37] : [Step 4/5] [2021-11-19 21:14:37,529][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint finished [cpId=4c08a5a5-3868-4853-a41a-e23b9f23e6e3, pages=23, markPos=WALPointer [idx=35, fileOff=336467, len=2010], walSegmentsCovered=[], markDuration=9ms, pagesWrite=1ms, fsync=8ms, total=18ms] [21:14:37] : [Step 4/5] [2021-11-19 21:14:37,538][INFO ][disco-notifier-worker-#24306%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=204] [21:14:37] : [Step 4/5] [2021-11-19 21:14:37,538][INFO ][disco-notifier-worker-#24425%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=204] [21:14:37] : [Step 4/5] [2021-11-19 21:14:37,539][INFO ][reencrypt-#24467%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:14:37] : [Step 4/5] [2021-11-19 21:14:37,539][INFO ][reencrypt-#24466%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:14:37] : [Step 4/5] [2021-11-19 21:14:37,544][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10b6f63c-e31c-4573-a225-9f76f500c001, grp=1613773252] [21:14:37] : [Step 4/5] [2021-11-19 21:14:37,548][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint started [checkpointId=4399396b-8917-4ca3-9527-4908312cfe07, startPtr=WALPointer [idx=35, fileOff=528301, len=2048], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=1ms, writeCheckpointEntryDuration=2ms, splitAndSortCpPagesDuration=0ms, pages=24, reason='test'] [21:14:37] : [Step 4/5] [2021-11-19 21:14:37,558][INFO ][db-checkpoint-thread-#24450%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:14:37] : [Step 4/5] [2021-11-19 21:14:37,558][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint finished [cpId=4399396b-8917-4ca3-9527-4908312cfe07, pages=24, markPos=WALPointer [idx=35, fileOff=528301, len=2048], walSegmentsCovered=[], markDuration=4ms, pagesWrite=1ms, fsync=8ms, total=14ms] [21:14:37] : [Step 4/5] [2021-11-19 21:14:37,559][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00cce8f9-a2b3-4d32-a95a-7f6eb6335000, grp=1613773252] [21:14:37] : [Step 4/5] [2021-11-19 21:14:37,568][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint started [checkpointId=aa512528-7f42-4ddc-9f55-8663b3798d6a, startPtr=WALPointer [idx=35, fileOff=528225, len=2010], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=6ms, writeCheckpointEntryDuration=2ms, splitAndSortCpPagesDuration=0ms, pages=24, reason='test'] [21:14:37] : [Step 4/5] [2021-11-19 21:14:37,578][INFO ][db-checkpoint-thread-#24445%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:14:37] : [Step 4/5] [2021-11-19 21:14:37,578][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint finished [cpId=aa512528-7f42-4ddc-9f55-8663b3798d6a, pages=24, markPos=WALPointer [idx=35, fileOff=528225, len=2010], walSegmentsCovered=[], markDuration=9ms, pagesWrite=1ms, fsync=8ms, total=18ms] [21:14:37] : [Step 4/5] [2021-11-19 21:14:37,584][INFO ][disco-notifier-worker-#24306%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=205] [21:14:37] : [Step 4/5] [2021-11-19 21:14:37,584][INFO ][reencrypt-#24467%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:14:37] : [Step 4/5] [2021-11-19 21:14:37,585][INFO ][disco-notifier-worker-#24425%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=205] [21:14:37] : [Step 4/5] [2021-11-19 21:14:37,586][INFO ][reencrypt-#24466%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:14:37] : [Step 4/5] [2021-11-19 21:14:37,587][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10b6f63c-e31c-4573-a225-9f76f500c001, grp=1613773252] [21:14:37] : [Step 4/5] [2021-11-19 21:14:37,590][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint started [checkpointId=c7c2cc78-0783-46ca-badd-dde3ee82de3d, startPtr=WALPointer [idx=35, fileOff=717330, len=2048], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=1ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=0ms, pages=23, reason='test'] [21:14:37] : [Step 4/5] [2021-11-19 21:14:37,600][INFO ][db-checkpoint-thread-#24450%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:14:37] : [Step 4/5] [2021-11-19 21:14:37,600][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint finished [cpId=c7c2cc78-0783-46ca-badd-dde3ee82de3d, pages=23, markPos=WALPointer [idx=35, fileOff=717330, len=2048], walSegmentsCovered=[], markDuration=3ms, pagesWrite=1ms, fsync=8ms, total=13ms] [21:14:37] : [Step 4/5] [2021-11-19 21:14:37,601][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00cce8f9-a2b3-4d32-a95a-7f6eb6335000, grp=1613773252] [21:14:37] : [Step 4/5] [2021-11-19 21:14:37,610][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint started [checkpointId=554b438c-23bf-4cef-845f-b65a0cba7d6c, startPtr=WALPointer [idx=35, fileOff=717216, len=2010], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=1ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=6ms, writeCheckpointEntryDuration=2ms, splitAndSortCpPagesDuration=0ms, pages=23, reason='test'] [21:14:37] : [Step 4/5] [2021-11-19 21:14:37,619][INFO ][db-checkpoint-thread-#24445%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:14:37] : [Step 4/5] [2021-11-19 21:14:37,620][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint finished [cpId=554b438c-23bf-4cef-845f-b65a0cba7d6c, pages=23, markPos=WALPointer [idx=35, fileOff=717216, len=2010], walSegmentsCovered=[], markDuration=9ms, pagesWrite=1ms, fsync=9ms, total=19ms] [21:14:37] : [Step 4/5] [2021-11-19 21:14:37,624][INFO ][disco-notifier-worker-#24306%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=206] [21:14:37] : [Step 4/5] [2021-11-19 21:14:37,625][INFO ][reencrypt-#24467%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:14:37] : [Step 4/5] [2021-11-19 21:14:37,625][INFO ][disco-notifier-worker-#24425%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=206] [21:14:37] : [Step 4/5] [2021-11-19 21:14:37,625][INFO ][reencrypt-#24466%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:14:37] : [Step 4/5] [2021-11-19 21:14:37,826][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10b6f63c-e31c-4573-a225-9f76f500c001, grp=1613773252] [21:14:37] : [Step 4/5] [2021-11-19 21:14:37,905][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint started [checkpointId=0cfa87e2-d754-4cf5-8043-34cae80d836a, startPtr=WALPointer [idx=35, fileOff=909785, len=2048], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=65ms, writeCheckpointEntryDuration=13ms, splitAndSortCpPagesDuration=0ms, pages=23, reason='test'] [21:14:37] : [Step 4/5] [2021-11-19 21:14:37,914][INFO ][db-checkpoint-thread-#24450%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:14:37] : [Step 4/5] [2021-11-19 21:14:37,915][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint finished [cpId=0cfa87e2-d754-4cf5-8043-34cae80d836a, pages=23, markPos=WALPointer [idx=35, fileOff=909785, len=2048], walSegmentsCovered=[], markDuration=79ms, pagesWrite=0ms, fsync=8ms, total=87ms] [21:14:37] : [Step 4/5] [2021-11-19 21:14:37,915][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00cce8f9-a2b3-4d32-a95a-7f6eb6335000, grp=1613773252] [21:14:37] : [Step 4/5] [2021-11-19 21:14:37,926][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint started [checkpointId=b2ee94ec-73a2-4212-9749-dfbc13567e77, startPtr=WALPointer [idx=35, fileOff=909633, len=2010], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=8ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=0ms, pages=23, reason='test'] [21:14:37] : [Step 4/5] [2021-11-19 21:14:37,936][INFO ][db-checkpoint-thread-#24445%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:14:37] : [Step 4/5] [2021-11-19 21:14:37,936][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint finished [cpId=b2ee94ec-73a2-4212-9749-dfbc13567e77, pages=23, markPos=WALPointer [idx=35, fileOff=909633, len=2010], walSegmentsCovered=[], markDuration=10ms, pagesWrite=1ms, fsync=8ms, total=20ms] [21:14:37] : [Step 4/5] [2021-11-19 21:14:37,945][INFO ][wal-file-archiver%grid-1-#24440%grid-1%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=35, segIdx=5, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000005.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000035.wal] [21:14:37] : [Step 4/5] [2021-11-19 21:14:37,945][INFO ][disco-notifier-worker-#24306%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=207] [21:14:37] : [Step 4/5] [2021-11-19 21:14:37,946][INFO ][reencrypt-#24467%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:14:37] : [Step 4/5] [2021-11-19 21:14:37,945][INFO ][disco-notifier-worker-#24425%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=207] [21:14:37] : [Step 4/5] [2021-11-19 21:14:37,945][INFO ][wal-file-archiver%grid-0-#24437%grid-0%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=35, segIdx=5, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000005.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000035.wal] [21:14:37] : [Step 4/5] [2021-11-19 21:14:37,947][INFO ][reencrypt-#24466%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:14:37] : [Step 4/5] [2021-11-19 21:14:37,946][INFO ][wal-file-cleaner%grid-1-#24441%grid-1%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=26, currSize=9.9 MB, maxSize=20.0 MB] [21:14:37] : [Step 4/5] [2021-11-19 21:14:37,947][INFO ][wal-file-cleaner%grid-0-#24438%grid-0%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=26, currSize=9.9 MB, maxSize=20.0 MB] [21:14:37] : [Step 4/5] [2021-11-19 21:14:37,950][INFO ][wal-file-cleaner%grid-1-#24441%grid-1%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=8.9 MB, maxSize=20.0 MB] [21:14:37] : [Step 4/5] [2021-11-19 21:14:37,950][INFO ][wal-file-cleaner%grid-0-#24438%grid-0%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=8.9 MB, maxSize=20.0 MB] [21:14:37] : [Step 4/5] [2021-11-19 21:14:37,958][INFO ][wal-file-archiver%grid-0-#24437%grid-0%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000005.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000035.wal] [21:14:37] : [Step 4/5] [2021-11-19 21:14:37,958][INFO ][wal-file-archiver%grid-1-#24440%grid-1%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000005.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000035.wal] [21:14:38] : [Step 4/5] [2021-11-19 21:14:38,147][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10b6f63c-e31c-4573-a225-9f76f500c001, grp=1613773252] [21:14:38] : [Step 4/5] [2021-11-19 21:14:38,350][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint started [checkpointId=c9a20808-c1d3-41f2-88c7-92f052b135be, startPtr=WALPointer [idx=36, fileOff=62667, len=2048], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=1ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=107ms, writeCheckpointEntryDuration=94ms, splitAndSortCpPagesDuration=0ms, pages=24, reason='test'] [21:14:38] : [Step 4/5] [2021-11-19 21:14:38,471][INFO ][db-checkpoint-thread-#24450%grid-1%][GridEncryptionManager] Previous encryption keys were removed [grpId=1613773252, keyIds=[150, 151, 152, 153, 154]] [21:14:38] : [Step 4/5] [2021-11-19 21:14:38,471][INFO ][db-checkpoint-thread-#24450%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:14:38] : [Step 4/5] [2021-11-19 21:14:38,472][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint finished [cpId=c9a20808-c1d3-41f2-88c7-92f052b135be, pages=24, markPos=WALPointer [idx=36, fileOff=62667, len=2048], walSegmentsCovered=[35], markDuration=203ms, pagesWrite=1ms, fsync=120ms, total=324ms] [21:14:38] : [Step 4/5] [2021-11-19 21:14:38,472][INFO ][test-runner-#24194%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00cce8f9-a2b3-4d32-a95a-7f6eb6335000, grp=1613773252] [21:14:38] : [Step 4/5] [2021-11-19 21:14:38,589][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint started [checkpointId=74ccb859-6fbc-41c8-940f-b890566d41bb, startPtr=WALPointer [idx=36, fileOff=62667, len=2010], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=21ms, writeCheckpointEntryDuration=94ms, splitAndSortCpPagesDuration=0ms, pages=24, reason='test'] [21:14:38]W: [org.apache.ignite:ignite-core] [2021-11-19 21:14:38,669][ERROR][main][root] Test failed [test=CacheGroupKeyChangeTest#testKeyIdentifierOverflow, duration=111431] [21:14:38]W: [org.apache.ignite:ignite-core] class org.apache.ignite.IgniteException: Cache group key change was rejected. Cache group reencryption is in progress [grp=encrypted] [21:14:38]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.managers.encryption.GroupKeyChangeProcess.start(GroupKeyChangeProcess.java:159) [21:14:38]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.managers.encryption.GridEncryptionManager.changeCacheGroupKey(GridEncryptionManager.java:744) [21:14:38]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.encryption.CacheGroupKeyChangeTest.testKeyIdentifierOverflow(CacheGroupKeyChangeTest.java:333) [21:14:38]W: [org.apache.ignite:ignite-core] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) [21:14:38]W: [org.apache.ignite:ignite-core] at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) [21:14:38]W: [org.apache.ignite:ignite-core] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [21:14:38]W: [org.apache.ignite:ignite-core] at java.lang.reflect.Method.invoke(Method.java:498) [21:14:38]W: [org.apache.ignite:ignite-core] at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50) [21:14:38]W: [org.apache.ignite:ignite-core] at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) [21:14:38]W: [org.apache.ignite:ignite-core] at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47) [21:14:38]W: [org.apache.ignite:ignite-core] at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) [21:14:38]W: [org.apache.ignite:ignite-core] at org.apache.ignite.testframework.junits.GridAbstractTest$7.run(GridAbstractTest.java:2432) [21:14:38]W: [org.apache.ignite:ignite-core] at java.lang.Thread.run(Thread.java:748) [21:14:38] : [Step 4/5] [21:14:3[2028] >>> Stopping 1-11-test: CacheGrou19 21:14:38,670pKeyChang][INFO ][db-checeTkpoest#testKeyIdentifint-thread-#2444ierOv5%grid-0%][GridEncryptionManager] Previous encryption keys were removed [gerflow in 111433 ms <<< [21:14:38] : [Step 4/5] rpId=1613773252, keyIds=[150, 151, 152, 153, 154]] [21:14:38] : [Step 4/5] [2021-11-19 21:14:38,672][INFO ][main][root] >>> Stopping test: CacheGroupKeyChangeTest#testKeyIdentifierOverflow in 111433 ms <<< [21:14:38] : [Step 4/5] [21:14:38] >>> Heap: 503 MB used / 1931 MB commited / 1931 MB max <<< [21:14:38] : [Step 4/5] [2021-11-19 21:14:38,672][INFO ][db-checkpoint-thread-#24445%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:14:38] : [Step 4/5] [2021-11-19 21:14:38,673][INFO ][main][root] >>> Heap: 503 MB used / 1931 MB commited / 1931 MB max <<< [21:14:38] : [Step 4/5] [[2021-11-19 21:14:38,673][INFO ][db-checkp21:14:38] >>> Non-Heap: 168 MB used / 189 MB commited / 0 MB max <<< [21:14:38] : [Step 4/5] oint-thread-#24445%grid-0%][Checkpointer] Checkpoint finished [cpId=74ccb859-6fbc-41c8-940f-b890566d41bb, pages=24, markPos=WALPointer [idx=36, fileOff=62667, len=2010], walSegmentsCovered=[35], markDuration=117ms, pagesWrite=1ms, fsync=82ms, total=200ms] [21:14:38] : [Step 4/5] [2021-11-19 21:14:38,674][INFO ][main][root] >>> Non-Heap: 168 MB used / 189 MB commited / 0 MB max <<< [21:14:38] : [Step 4/5] [2021-11-19 21:14:38,674][INFO ][main][root] >>> Stopping grid [name=grid-1, id=10b6f63c-e31c-4573-a225-9f76f500c001] [21:14:38] : [Step 4/5] [2021-11-19 21:14:38,686][INFO ][db-checkpoint-thread-#24450%grid-1%][Checkpointer] Checkpoint started [checkpointId=34767d7d-423f-445b-af05-c8b6e9a33e7b, startPtr=WALPointer [idx=36, fileOff=180816, len=2048], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=1ms, writeCheckpointEntryDuration=2ms, splitAndSortCpPagesDuration=0ms, pages=18, reason='timeout'] [21:14:38] : [Step 4/5] [2021-11-19 21:14:38,693][INFO ][tcp-disco-sock-reader-[00cce8f9 127.0.0.1:52609]-#1282%grid-1%-#24430%grid-1%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:52609, rmtPort=52609, rmtNodeId=00cce8f9-a2b3-4d32-a95a-7f6eb6335000] [21:14:38] : [Step 4/5] [2021-11-19 21:14:38,695][INFO ][disco-event-worker-#24310%grid-0%][GridDiscoveryManager] Node left topology: TcpDiscoveryNode [id=10b6f63c-e31c-4573-a225-9f76f500c001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637345568305, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false] [21:14:38] : [Step 4/5] [2021-11-19 21:14:38,696][INFO ][main][GridCacheProcessor] Stopped cache [cacheName=ignite-sys-cache] [21:14:38] : [Step 4/5] [2021-11-19 21:14:38,696][INFO ][main][GridCacheProcessor] Stopped cache [cacheName=encrypted] [21:14:38] : [Step 4/5] [2021-11-19 21:14:38,696][INFO ][disco-event-worker-#24310%grid-0%][GridDiscoveryManager] Topology snapshot [ver=3, locNode=00cce8f9, servers=1, clients=0, state=ACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=00cce8f9-a2b3-4d32-a95a-7f6eb6335000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:14:38] : [Step 4/5] [2021-11-19 21:14:38,697][INFO ][disco-event-worker-#24310%grid-0%][GridDiscoveryManager] ^-- Baseline [id=0, size=2, online=1, offline=1] [21:14:38]W: [org.apache.ignite:ignite-core] [2021-11-19 21:14:38,699][WARN ][grid-nio-worker-tcp-comm-0-#24249%TestRecordingCommunicationSpi%][TestRecordingCommunicationSpi] Failed to shutdown socket [21:14:38]W: [org.apache.ignite:ignite-core] java.nio.channels.ClosedChannelException [21:14:38]W: [org.apache.ignite:ignite-core] at sun.nio.ch.SocketChannelImpl.shutdownOutput(SocketChannelImpl.java:795) [21:14:38]W: [org.apache.ignite:ignite-core] at sun.nio.ch.SocketAdaptor.shutdownOutput(SocketAdaptor.java:407) [21:14:38] : [Step 4/5] [2021-11-19 21:14:38,701][INFO ][main][FilePageStoreManager] Cleanup cache stores [total=4, left=0, cleanFiles=false] [21:14:38]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.close(IgniteUtils.java:4247) [21:14:38]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.closeKey(GridNioServer.java:2784) [21:14:38]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.close(GridNioServer.java:2835) [21:14:38]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.close(GridNioServer.java:2794) [21:14:38]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.bodyInternal(GridNioServer.java:2157) [21:14:38]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.body(GridNioServer.java:1910) [21:14:38]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:125) [21:14:38]W: [org.apache.ignite:ignite-core] at java.lang.Thread.run(Thread.java:748) [21:14:38] : [Step 4/5] [2021-11-19 21:14:38,701][INFO ][exchange-worker-#24311%grid-0%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], crd=true, evt=NODE_LEFT, evtNode=10b6f63c-e31c-4573-a225-9f76f500c001, customEvt=null, allowMerge=false, exchangeFreeSwitch=true] [21:14:38] : [Step 4/5] [2021-11-19 21:14:38,705][INFO ][sys-#24290%grid-0%][GridAffinityAssignmentCache] Local node affinity assignment distribution is not ideal [cache=encrypted, expectedPrimary=8.00, actualPrimary=3, expectedBackups=0.00, actualBackups=0, warningThreshold=50.00%] [21:14:38] : [Step 4/5] [2021-11-19 21:14:38,705][INFO ][main][GridDeploymentLocalStore] Removed undeployed class: GridDeployment [ts=1637345568395, depMode=SHARED, clsLdr=IsolatedClassLoader{roleName='test'}, clsLdrId=1fbfd593d71-10b6f63c-e31c-4573-a225-9f76f500c001, userVer=0, loc=true, sampleClsName=org.apache.ignite.internal.processors.cache.distributed.dht.preloader.IgniteDhtPartitionCountersMap2, pendingUndeploy=false, undeployed=true, usage=0] [21:14:38] : [Step 4/5] [2021-11-19 21:14:38,706][INFO ][exchange-worker-#24311%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:14:38] : [Step 4/5] [2021-11-19 21:14:38,708][INFO ][exchange-worker-#24311%grid-0%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], err=null, rebalanced=true, wasRebalanced=true] [21:14:38]W: [org.apache.ignite:ignite-core] [2021-11-19 21:14:38,711][WARN ][sys-#24292%grid-0%][GridDhtPartitionTopologyImpl] Detected lost partitions [grp=encrypted, parts=[0, 2, 4, 6-7], topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0]] [21:14:38] : [Step 4/5] [2021-11-19 21:14:38,713][INFO ][exchange-worker-#24311%grid-0%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=00cce8f9-a2b3-4d32-a95a-7f6eb6335000, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], evt=NODE_LEFT, evtNode=TcpDiscoveryNode [id=10b6f63c-e31c-4573-a225-9f76f500c001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637345568305, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0]] [21:14:38] : [Step 4/5] [2021-11-19 21:14:38,721][INFO ][exchange-worker-#24311%grid-0%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (2 ms), stage="Determine exchange type" (2 ms), stage="Preloading notification" (0 ms), stage="After states restored callback" (1 ms), stage="WAL history reservation" (0 ms), stage="Finalize update counters" (0 ms), stage="Detect lost partitions" (3 ms), stage="Exchange done" (5 ms), stage="Total time" (13 ms)] [21:14:38] : [Step 4/5] [2021-11-19 21:14:38,734][INFO ][exchange-worker-#24311%grid-0%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], stage="Affinity initialization (exchange-free switch on fully-rebalanced topology) [grp=encrypted]" (1 ms) (parent=Determine exchange type), stage="Affinity initialization (exchange-free switch on fully-rebalanced topology) [grp=ignite-sys-cache]" (0 ms) (parent=Determine exchange type)] [21:14:38] : [Step 4/5] [2021-11-19 21:14:38,744][INFO ][exchange-worker-#24311%grid-0%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], crd=true] [21:14:38] : [Step 4/5] [2021-11-19 21:14:38,749][INFO ][exchange-worker-#24311%grid-0%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=3, minorTopVer=0], force=false, evt=NODE_LEFT, node=10b6f63c-e31c-4573-a225-9f76f500c001] [21:14:38] : [Step 4/5] [2021-11-19 21:14:38,768][INFO ][main][IgniteKernal%grid-1] [21:14:38] : [Step 4/5] [21:14:38] : [Step 4/5] >>> +------------------------------------------------------+ [21:14:38] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV stopped OK [21:14:38] : [Step 4/5] >>> +------------------------------------------------------+ [21:14:38] : [Step 4/5] >>> Ignite instance name: grid-1 [21:14:38] : [Step 4/5] >>> Grid uptime: 00:01:50.417 [21:14:38] : [Step 4/5] [21:14:38] : [Step 4/5] [21:14:38] : [Step 4/5] [2021-11-19 21:14:38,769][INFO ][main][root] >>> Stopping grid [name=grid-0, id=00cce8f9-a2b3-4d32-a95a-7f6eb6335000] [21:14:39] : [Step 4/5] [2021-11-19 21:14:39,163][INFO ][db-checkpoint-thread-#24445%grid-0%][Checkpointer] Checkpoint started [checkpointId=245142ea-82df-4654-972e-7c0f77fd11c8, startPtr=WALPointer [idx=36, fileOff=180813, len=2010], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=167ms, writeCheckpointEntryDuration=213ms, splitAndSortCpPagesDuration=0ms, pages=18, reason='timeout'] [21:14:39]W: [org.apache.ignite:ignite-core] [2021-11-19 21:14:39,169][WARN ][tcp-disco-sock-reader-[10b6f63c 127.0.0.1:48535]-#1283%grid-0%-#24431%grid-0%][TestTcpDiscoverySpi] Failed to shutdown socket [21:14:39]W: [org.apache.ignite:ignite-core] java.net.SocketException: Socket is closed [21:14:39]W: [org.apache.ignite:ignite-core] at java.net.Socket.shutdownOutput(Socket.java:1568) [21:14:39]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.close(IgniteUtils.java:4247) [21:14:39]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.discovery.tcp.ServerImpl$SocketReader.body(ServerImpl.java:7370) [21:14:39]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.IgniteSpiThread.run(IgniteSpiThread.java:58) [21:14:39] : [Step 4/5] [2021-11-19 21:14:39,171][INFO ][tcp-disco-sock-reader-[10b6f63c 127.0.0.1:48535]-#1283%grid-0%-#24431%grid-0%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:48535, rmtPort=48535, rmtNodeId=10b6f63c-e31c-4573-a225-9f76f500c001] [21:14:39] : [Step 4/5] [2021-11-19 21:14:39,174][INFO ][main][GridCacheProcessor] Stopped cache [cacheName=ignite-sys-cache] [21:14:39] : [Step 4/5] [2021-11-19 21:14:39,174][INFO ][main][GridCacheProcessor] Stopped cache [cacheName=encrypted] [21:14:39] : [Step 4/5] [2021-11-19 21:14:39,238][INFO ][main][FilePageStoreManager] Cleanup cache stores [total=4, left=0, cleanFiles=false] [21:14:39] : [Step 4/5] [2021-11-19 21:14:39,240][INFO ][main][GridDeploymentLocalStore] Removed undeployed class: GridDeployment [ts=1637345568385, depMode=SHARED, clsLdr=IsolatedClassLoader{roleName='test'}, clsLdrId=febfd593d71-00cce8f9-a2b3-4d32-a95a-7f6eb6335000, userVer=0, loc=true, sampleClsName=org.apache.ignite.internal.processors.cache.distributed.dht.preloader.GridDhtPartitionMap, pendingUndeploy=false, undeployed=true, usage=0] [21:14:39] : [Step 4/5] [2021-11-19 21:14:39,248][INFO ][main][IgniteKernal%grid-0] [21:14:39] : [Step 4/5] [21:14:39] : [Step 4/5] >>> +------------------------------------------------------+ [21:14:39] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV stopped OK [21:14:39] : [Step 4/5] >>> +------------------------------------------------------+ [21:14:39] : [Step 4/5] >>> Ignite instance name: grid-0 [21:14:39] : [Step 4/5] >>> Grid uptime: 00:01:51.508 [21:14:39] : [Step 4/5] [21:14:39] : [Step 4/5] [21:14:39] : [Step 4/5] [21:14:39] >>> Starting test: CacheGroupKeyChangeTest#testNodeJoinRejectedIfKeyCannotBeReplaced <<< [21:14:39] : [Step 4/5] [2021-11-19 21:14:39,299][INFO ][main][root] >>> Starting test: CacheGroupKeyChangeTest#testNodeJoinRejectedIfKeyCannotBeReplaced <<< [21:14:39] : [Step 4/5] [21:14:39] >>> Heap: 507 MB used / 1931 MB commited / 1931 MB max <<< [21:14:39] : [Step 4/5] [2021-11-19 21:14:39,299][INFO ][main][root] >>> Heap: 507 MB used / 1931 MB commited / 1931 MB max <<< [21:14:39] : [Step 4/5] [21:14:39] >>> Non-Heap: 168 MB used / 189 MB commited / 0 MB max <<< [21:14:39] : [Step 4/5] [2021-11-19 21:14:39,300][INFO ][main][root] >>> Non-Heap: 168 MB used / 189 MB commited / 0 MB max <<< [21:14:39]W: [org.apache.ignite:ignite-core] [2021-11-19 21:14:39,308][WARN ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][G] Ignite work directory is not provided, automatically resolved to: /opt/buildagent/work/7bc1c54bc719b67c/work [21:14:39] : [Step 4/5] [2021-11-19 21:14:39,311][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] [21:14:39] : [Step 4/5] [21:14:39] : [Step 4/5] >>> __________ ________________ [21:14:39] : [Step 4/5] >>> / _/ ___/ |/ / _/_ __/ __/ [21:14:39] : [Step 4/5] >>> _/ // (7 7 // / / / / _/ [21:14:39] : [Step 4/5] >>> /___/\___/_/|_/___/ /_/ /___/ [21:14:39] : [Step 4/5] >>> [21:14:39] : [Step 4/5] >>> ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:14:39] : [Step 4/5] >>> 2021 Copyright(C) Apache Software Foundation [21:14:39] : [Step 4/5] >>> [21:14:39] : [Step 4/5] >>> Ignite documentation: http://ignite.apache.org [21:14:39] : [Step 4/5] [21:14:39] : [Step 4/5] [2021-11-19 21:14:39,312][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] Config URL: n/a [21:14:39] : [Step 4/5] [2021-11-19 21:14:39,313][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] IgniteConfiguration [igniteInstanceName=grid-0, pubPoolSize=24, svcPoolSize=24, callbackPoolSize=24, stripedPoolSize=24, sysPoolSize=24, mgmtPoolSize=4, dataStreamerPoolSize=24, utilityCachePoolSize=24, utilityCacheKeepAliveTime=60000, p2pPoolSize=2, qryPoolSize=24, buildIdxPoolSize=4, igniteHome=/opt/buildagent/work/7bc1c54bc719b67c, igniteWorkDir=/opt/buildagent/work/7bc1c54bc719b67c/work, mbeanSrv=com.sun.jmx.mbeanserver.JmxMBeanServer@6fe85038, nodeId=007e61a0-a40a-4876-9e77-e092fe5c2000, marsh=BinaryMarshaller [], marshLocJobs=false, daemon=false, p2pEnabled=true, netTimeout=10000, netCompressionLevel=1, sndRetryDelay=1000, sndRetryCnt=3, metricsHistSize=10000, metricsUpdateFreq=1000, metricsExpTime=9223372036854775807, discoSpi=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=0, ackTimeout=0, marsh=null, reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], segPlc=STOP, segResolveAttempts=2, waitForSegOnStart=true, allResolversPassReq=true, segChkFreq=10000, commSpi=TcpCommunicationSpi [connectGate=org.apache.ignite.spi.communication.tcp.internal.ConnectGateway@4a86c063, ctxInitLatch=java.util.concurrent.CountDownLatch@8432978[Count = 1], stopping=false, clientPool=null, nioSrvWrapper=null, stateProvider=null], evtSpi=MemoryEventStorageSpi [expireAgeMs=9223372036854775807, expireCnt=10000, filter=null], colSpi=NoopCollisionSpi [], deploySpi=LocalDeploymentSpi [], indexingSpi=org.apache.ignite.spi.indexing.noop.NoopIndexingSpi@ef253c5, addrRslvr=null, encryptionSpi=org.apache.ignite.spi.encryption.keystore.KeystoreEncryptionSpi@5ccc21c0, tracingSpi=org.apache.ignite.spi.tracing.NoopTracingSpi@28a95bc9, clientMode=false, rebalanceThreadPoolSize=4, rebalanceTimeout=10000, rebalanceBatchesPrefetchCnt=3, rebalanceThrottle=0, rebalanceBatchSize=524288, txCfg=TransactionConfiguration [txSerEnabled=false, dfltIsolation=REPEATABLE_READ, dfltConcurrency=PESSIMISTIC, dfltTxTimeout=0, txTimeoutOnPartitionMapExchange=0, deadlockTimeout=10000, pessimisticTxLogSize=0, pessimisticTxLogLinger=10000, tmLookupClsName=null, txManagerFactory=null, useJtaSync=false], cacheSanityCheckEnabled=true, discoStartupDelay=60000, deployMode=SHARED, p2pMissedCacheSize=100, locHost=127.0.0.1, timeSrvPortBase=31100, timeSrvPortRange=100, failureDetectionTimeout=10000, sysWorkerBlockedTimeout=null, clientFailureDetectionTimeout=10000, metricsLogFreq=0, connectorCfg=null, odbcCfg=null, warmupClos=null, atomicCfg=AtomicConfiguration [seqReserveSize=1000, cacheMode=PARTITIONED, backups=1, aff=null, grpName=null], classLdr=null, sslCtxFactory=null, platformCfg=null, binaryCfg=null, memCfg=null, pstCfg=null, dsCfg=DataStorageConfiguration [sysRegionInitSize=41943040, sysRegionMaxSize=104857600, pageSize=4096, concLvl=0, dfltDataRegConf=DataRegionConfiguration [name=default, maxSize=104857600, initSize=268435456, swapPath=null, pageEvictionMode=DISABLED, pageReplacementMode=CLOCK, evictionThreshold=0.9, emptyPagesPoolSize=100, metricsEnabled=false, metricsSubIntervalCount=5, metricsRateTimeInterval=60000, persistenceEnabled=true, checkpointPageBufSize=0, lazyMemoryAllocation=true, warmUpCfg=null], dataRegions=null, storagePath=null, checkpointFreq=30000, lockWaitTime=10000, checkpointThreads=4, checkpointWriteOrder=SEQUENTIAL, walHistSize=20, maxWalArchiveSize=20971520, walSegments=10, walSegmentSize=1048576, walPath=db/wal, walArchivePath=db/wal/archive, cdcWalPath=db/wal/cdc, cdcEnabled=false, metricsEnabled=false, walMode=LOG_ONLY, walTlbSize=131072, walBuffSize=0, walFlushFreq=2000, walFsyncDelay=1000, walRecordIterBuffSize=67108864, alwaysWriteFullPages=false, fileIOFactory=org.apache.ignite.internal.processors.cache.persistence.file.AsyncFileIOFactory@6bc672dc, metricsSubIntervalCnt=5, metricsRateTimeInterval=60000, walAutoArchiveAfterInactivity=-1, walForceArchiveTimeout=-1, writeThrottlingEnabled=false, walCompactionEnabled=false, walCompactionLevel=1, checkpointReadLockTimeout=null, walPageCompression=DISABLED, walPageCompressionLevel=null, dfltWarmUpCfg=null, encCfg=org.apache.ignite.configuration.EncryptionConfiguration@7c1d4030, defragmentationThreadPoolSize=4, minWalArchiveSize=-1], snapshotPath=snapshots, activeOnStart=true, activeOnStartPropSetFlag=false, autoActivation=true, autoActivationPropSetFlag=false, clusterStateOnStart=null, sqlConnCfg=null, cliConnCfg=ClientConnectorConfiguration [host=null, port=10800, portRange=100, sockSndBufSize=0, sockRcvBufSize=0, tcpNoDelay=true, maxOpenCursorsPerConn=128, threadPoolSize=24, selectorCnt=12, idleTimeout=0, handshakeTimeout=10000, jdbcEnabled=true, odbcEnabled=true, thinCliEnabled=true, sslEnabled=false, useIgniteSslCtxFactory=true, sslClientAuth=false, sslCtxFactory=null, thinCliCfg=ThinClientConfiguration [maxActiveTxPerConn=100, maxActiveComputeTasksPerConn=0]], mvccVacuumThreadCnt=2, mvccVacuumFreq=5000, authEnabled=false, failureHnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]], commFailureRslvr=null, sqlCfg=SqlConfiguration [longQryWarnTimeout=3000, dfltQryTimeout=0, sqlQryHistSize=1000, validationEnabled=false], asyncContinuationExecutor=null] [21:14:39] : [Step 4/5] [2021-11-19 21:14:39,322][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] Daemon mode: off [21:14:39] : [Step 4/5] [2021-11-19 21:14:39,322][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] OS: Linux 4.15.0-151-generic amd64 [21:14:39] : [Step 4/5] [2021-11-19 21:14:39,322][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] OS user: teamcity [21:14:39] : [Step 4/5] [2021-11-19 21:14:39,323][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] PID: 16724 [21:14:39] : [Step 4/5] [2021-11-19 21:14:39,323][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] Language runtime: Java Platform API Specification ver. 1.8 [21:14:39] : [Step 4/5] [2021-11-19 21:14:39,323][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] VM information: Java(TM) SE Runtime Environment 1.8.0_261-b12 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 25.261-b12 [21:14:39] : [Step 4/5] [2021-11-19 21:14:39,324][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] VM total memory: 1.9GB [21:14:39] : [Step 4/5] [2021-11-19 21:14:39,324][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] Remote Management [restart: off, REST: off, JMX (remote: off)] [21:14:39] : [Step 4/5] [2021-11-19 21:14:39,325][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] Logger: GridTestLog4jLogger [quiet=false, config=null] [21:14:39] : [Step 4/5] [2021-11-19 21:14:39,325][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] IGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c [21:14:39]W: [org.apache.ignite:ignite-core] [2021-11-19 21:14:39,331][WARN ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] Peer class loading is enabled (disable it in production for performance and deployment consistency reasons) [21:14:39] : [Step 4/5] [2021-11-19 21:14:39,325][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] VM arguments: [-DIGNITE_DUMP_THREADS_ON_FAILURE=false, -DMono=/usr/bin/mono-sgen, -DMono4.0_x64=/usr/lib/mono/4.0, -DMono4.5_x64=/usr/lib/mono/4.5, -DMonoVersion=6.12.0.90, -DSKIP_BUILD=false, -Dagent.home.dir=/opt/buildagent, -Dagent.name=aitc-lin02_03, -Dagent.ownPort=9090, -Dagent.work.dir=/opt/buildagent/work, -Dbuild.number=95, -Dbuild.vcs.number=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.1=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.GitHubApacheIgnite=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dclassworlds.conf=/opt/buildagent/temp/buildTmp/teamcity.m2.conf, -Dcom.jetbrains.maven.watcher.report.file=/opt/buildagent/temp/buildTmp/maven-build-info.xml, -Djava.io.tmpdir=/opt/buildagent/temp/buildTmp, -Dmaven.home=/opt/buildagent/tools/maven3_6, -Dmaven.multiModuleProjectDirectory=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.agent.cpuBenchmark=457, -Dteamcity.agent.dotnet.agent_url=http://localhost:9090/RPC2, -Dteamcity.agent.dotnet.build_id=6278078, -Dteamcity.auth.password=*******, -Dteamcity.auth.userId=TeamCityBuildId=6278078, -Dteamcity.build.changedFiles.file=/opt/buildagent/temp/buildTmp/changedFiles6342607772318147725.txt, -Dteamcity.build.checkoutDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.build.id=6278078, -Dteamcity.build.properties.file=/opt/buildagent/temp/buildTmp/teamcity.build5164517880467851002.properties, -Dteamcity.build.tempDir=/opt/buildagent/temp/buildTmp, -Dteamcity.build.workingDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.buildConfName=Basic 3, -Dteamcity.buildType.id=IgniteTests24Java8_Basic3, -Dteamcity.configuration.properties.file=/opt/buildagent/temp/buildTmp/teamcity.config5591980786735343870.properties, -Dteamcity.maven.userSettings.path=/opt/buildagent/temp/buildTmp/maven_settings_585072866407032347.xml, -Dteamcity.maven.watcher.home=/opt/buildagent/plugins/mavenPlugin/maven-watcher-jdk16, -Dteamcity.projectName=Ignite Tests 2.x (JDK 8/11), -Dteamcity.runner.properties.file=/opt/buildagent/temp/buildTmp/teamcity.runner9098465561618137420.properties, -Dteamcity.tests.recentlyFailedTests.file=/opt/buildagent/temp/buildTmp/testsToRunFirst3891775683130404069.txt, -Dteamcity.version=2021.2 (build 99542), -ea, -Xms2g, -Xmx2g, -XX:+HeapDumpOnOutOfMemoryError, -DIGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_TEST_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_UPDATE_NOTIFIER=false, -DIGNITE_NO_DISCO_ORDER=true, -DIGNITE_PERFORMANCE_SUGGESTIONS_DISABLED=true, -Djava.net.preferIPv4Stack=true, -DTEST_SCALE_FACTOR=1.0, -DIGNITE_TEST_PROP_LOG4J_FILE=log4j-tc-test.xml, -DIGNITE_QUIET=false, -DIGNITE_MARSHAL_BUFFERS_RECHECK=1000, -Dmaven.repo.local=/opt/buildagent/.m2/repository] [21:14:39] : [Step 4/5] [2021-11-19 21:14:39,330][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] System cache's DataRegion size is configured to 40 MB. Use DataStorageConfiguration.systemRegionInitialSize property to change the setting. [21:14:39] : [Step 4/5] [2021-11-19 21:14:39,331][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] Configured caches [in 'sysMemPlc' dataRegion: ['ignite-sys-cache']] [21:14:39] : [Step 4/5] [2021-11-19 21:14:39,332][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] 3-rd party licenses can be found at: /opt/buildagent/work/7bc1c54bc719b67c/libs/licenses [21:14:39] : [Step 4/5] [2021-11-19 21:14:39,336][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] Configured plugins: [21:14:39] : [Step 4/5] [2021-11-19 21:14:39,337][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- StanByClusterTestProvider 1.0 [21:14:39] : [Step 4/5] [2021-11-19 21:14:39,337][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:14:39] : [Step 4/5] [2021-11-19 21:14:39,337][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] [21:14:39] : [Step 4/5] [2021-11-19 21:14:39,337][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- PageMemory tracker plugin 1.0 [21:14:39] : [Step 4/5] [2021-11-19 21:14:39,338][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:14:39] : [Step 4/5] [2021-11-19 21:14:39,338][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] [21:14:39] : [Step 4/5] [2021-11-19 21:14:39,338][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- TestDistibutedConfigurationPlugin 1.0 [21:14:39] : [Step 4/5] [2021-11-19 21:14:39,338][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:14:39] : [Step 4/5] [2021-11-19 21:14:39,339][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] [21:14:39] : [Step 4/5] [2021-11-19 21:14:39,339][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- NodeValidationPluginProvider 1.0 [21:14:39] : [Step 4/5] [2021-11-19 21:14:39,339][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:14:39] : [Step 4/5] [2021-11-19 21:14:39,339][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] [21:14:39] : [Step 4/5] [2021-11-19 21:14:39,340][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][FailureProcessor] Configured failure handler: [hnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]]] [21:14:39] : [Step 4/5] [2021-11-19 21:14:39,363][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][TestRecordingCommunicationSpi] Successfully bound communication NIO server to TCP port [port=47100, locHost=/127.0.0.1, selectorsCnt=12, selectorSpins=0, pairedConn=false] [21:14:39]W: [org.apache.ignite:ignite-core] [2021-11-19 21:14:39,363][WARN ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][TestRecordingCommunicationSpi] Message queue limit is set to 0 which may lead to potential OOMEs when running cache operations in FULL_ASYNC or PRIMARY_SYNC modes due to message queues growth on sender and receiver sides. [21:14:39] : [Step 4/5] [2021-11-19 21:14:39,370][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][GridCollisionManager] Collision resolution is disabled (all jobs will be activated upon arrival). [21:14:39] : [Step 4/5] [2021-11-19 21:14:39,370][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] Security status [authentication=off, sandbox=off, tls/ssl=off] [21:14:39] : [Step 4/5] [2021-11-19 21:14:39,442][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:14:39] : [Step 4/5] [2021-11-19 21:14:39,537][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][MaintenanceProcessor] Resolved store directory for node persistent data: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0 [21:14:39] : [Step 4/5] [2021-11-19 21:14:39,539][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][CacheObjectBinaryProcessorImpl] Resolved directory for serialized binary metadata: /opt/buildagent/work/7bc1c54bc719b67c/work/db/binary_meta/grid_0 [21:14:39] : [Step 4/5] [2021-11-19 21:14:39,543][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0 [21:14:39] : [Step 4/5] [2021-11-19 21:14:39,544][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][FileWriteAheadLogManager] Resolved write ahead log work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0 [21:14:39] : [Step 4/5] [2021-11-19 21:14:39,544][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][FileWriteAheadLogManager] Resolved write ahead log archive directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0 [21:14:39] : [Step 4/5] [2021-11-19 21:14:39,700][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000000.wal [21:14:39] : [Step 4/5] [2021-11-19 21:14:39,701][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][FileHandleManagerImpl] Initialized write-ahead log manager [mode=LOG_ONLY] [21:14:39]W: [org.apache.ignite:ignite-core] [2021-11-19 21:14:39,701][WARN ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] DataRegion maxSize=104.9 MB is smaller than defaultInitialSize=268.4 MB, setting initialSize to 104.9 MB [21:14:39] : [Step 4/5] [2021-11-19 21:14:39,707][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Configured data regions initialized successfully [total=5] [21:14:39] : [Step 4/5] [2021-11-19 21:14:39,852][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][IgniteSnapshotManager] Resolved snapshot work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/snapshots [21:14:39] : [Step 4/5] [2021-11-19 21:14:39,853][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][IgniteSnapshotManager] Resolved temp directory for snapshot creation: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0/snp [21:14:39] : [Step 4/5] [2021-11-19 21:14:39,855][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][ClientListenerProcessor] Client connector processor has started on TCP port 10800 [21:14:39] : [Step 4/5] [2021-11-19 21:14:39,861][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] Non-loopback local IPs: 172.17.0.4 [21:14:39] : [Step 4/5] [2021-11-19 21:14:39,862][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] Enabled local MACs: 0242AC110004 [21:14:39] : [Step 4/5] [2021-11-19 21:14:39,864][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:14:39] : [Step 4/5] [2021-11-19 21:14:39,865][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:14:39] : [Step 4/5] [2021-11-19 21:14:39,866][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:14:39] : [Step 4/5] [2021-11-19 21:14:39,868][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Applying lost metastore updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:14:39] : [Step 4/5] [2021-11-19 21:14:39,869][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=0 ms] [21:14:39] : [Step 4/5] [2021-11-19 21:14:39,870][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Restoring partition state for local groups. [21:14:39] : [Step 4/5] [2021-11-19 21:14:39,870][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=0, partitionsProcessed=0, time=0ms] [21:14:39] : [Step 4/5] [2021-11-19 21:14:39,871][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][GridEncryptionManager] Encryption keys loaded from metastore. [grps=, masterKeyName=ignite.master.key] [21:14:39] : [Step 4/5] [2021-11-19 21:14:39,875][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][ClusterProcessor] Cluster ID and tag has been read from metastorage: null [21:14:39] : [Step 4/5] [2021-11-19 21:14:39,876][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][IgniteClusterImpl] Shutdown policy was updated [oldVal=null, newVal=null] [21:14:39] : [Step 4/5] [2021-11-19 21:14:39,876][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Checkpoint frequency deviation changed [oldVal=null, newVal=null] [21:14:39] : [Step 4/5] [2021-11-19 21:14:39,955][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][FilePageStoreManager] Cleanup cache stores [total=1, left=0, cleanFiles=false] [21:14:39] : [Step 4/5] [2021-11-19 21:14:39,958][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:14:39] : [Step 4/5] [2021-11-19 21:14:39,959][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:14:39] : [Step 4/5] [2021-11-19 21:14:39,960][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:14:39] : [Step 4/5] [2021-11-19 21:14:39,961][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Data Regions Started: 5 [21:14:39] : [Step 4/5] [2021-11-19 21:14:39,961][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] ^-- sysMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:14:39] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:14:39] : [Step 4/5] ^-- default region [type=default, persistence=true, lazyAlloc=true, [21:14:39] : [Step 4/5] ... initCfg=100MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB, allocTotal=0MB] [21:14:39] : [Step 4/5] ^-- metastoreMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:14:39] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:14:39] : [Step 4/5] ^-- TxLog region [type=internal, persistence=true, lazyAlloc=false, [21:14:39] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:14:39] : [Step 4/5] ^-- volatileDsMemPlc region [type=user, persistence=false, lazyAlloc=true, [21:14:39] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB] [21:14:39] : [Step 4/5] ^-- Ignite persistence [used=0MB] [21:14:39] : [Step 4/5] [21:14:39] : [Step 4/5] [2021-11-19 21:14:39,963][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Starting binary memory restore for: [-2100569601] [21:14:39] : [Step 4/5] [2021-11-19 21:14:39,975][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:14:39] : [Step 4/5] [2021-11-19 21:14:39,975][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:14:39] : [Step 4/5] [2021-11-19 21:14:39,986][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000000.wal, offset=0, ver=2] [21:14:39] : [Step 4/5] [2021-11-19 21:14:39,990][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Started cache in recovery mode [name=ignite-sys-cache, id=-2100569601, dataRegionName=sysMemPlc, mode=REPLICATED, atomicity=TRANSACTIONAL, backups=2147483647, mvcc=false] [21:14:39] : [Step 4/5] [2021-11-19 21:14:39,992][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Binary recovery performed in 29 ms. [21:14:39] : [Step 4/5] [2021-11-19 21:14:39,993][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:14:39] : [Step 4/5] [2021-11-19 21:14:39,993][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Applying lost cache updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:14:40] : [Step 4/5] [2021-11-19 21:14:40,000][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=10 ms] [21:14:40] : [Step 4/5] [2021-11-19 21:14:40,000][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Restoring partition state for local groups. [21:14:40] : [Step 4/5] [2021-11-19 21:14:40,025][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=1, partitionsProcessed=100, time=20ms] [21:14:40] : [Step 4/5] [2021-11-19 21:14:40,033][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][TestTcpDiscoverySpi] Successfully bound to TCP port [port=47500, localHost=localhost/127.0.0.1, locNodeId=007e61a0-a40a-4876-9e77-e092fe5c2000] [21:14:40] : [Step 4/5] [2021-11-19 21:14:40,044][INFO ][disco-notifier-worker-#24597%grid-0%][MvccProcessorImpl] Assigned mvcc coordinator [crd=MvccCoordinator [topVer=AffinityTopologyVersion [topVer=1, minorTopVer=0], nodeId=007e61a0-a40a-4876-9e77-e092fe5c2000, ver=1637345680040, local=true, initialized=false]] [21:14:40] : [Step 4/5] [2021-11-19 21:14:40,046][INFO ][sys-#24573%grid-0%][ClusterProcessor] Writing cluster ID and tag to metastorage on ready for write ClusterIdAndTag [id=b67f5159-9231-44d3-a424-19e9051439ca, tag=cranky_darwin] [21:14:40] : [Step 4/5] [2021-11-19 21:14:40,049][INFO ][disco-notifier-worker-#24597%grid-0%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustEnabled' was changed from 'null' to 'false' [21:14:40] : [Step 4/5] [2021-11-19 21:14:40,050][INFO ][disco-notifier-worker-#24597%grid-0%][ClusterProcessor] cranky_darwin [21:14:40] : [Step 4/5] [2021-11-19 21:14:40,051][INFO ][disco-notifier-worker-#24597%grid-0%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustTimeout' was changed from 'null' to '300000' [21:14:40] : [Step 4/5] [2021-11-19 21:14:40,051][INFO ][disco-notifier-worker-#24597%grid-0%][IgniteTxManager] Transactions parameter 'longOperationsDumpTimeout' was changed from 'null' to '60000' [21:14:40] : [Step 4/5] [2021-11-19 21:14:40,052][INFO ][disco-notifier-worker-#24597%grid-0%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpThreshold' was changed from 'null' to '0' [21:14:40] : [Step 4/5] [2021-11-19 21:14:40,052][INFO ][disco-notifier-worker-#24597%grid-0%][IgniteTxManager] Transactions parameter 'transactionTimeDumpSamplesCoefficient' was changed from 'null' to '0.0' [21:14:40] : [Step 4/5] [2021-11-19 21:14:40,053][INFO ][disco-notifier-worker-#24597%grid-0%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpSamplesPerSecondLimit' was changed from 'null' to '5' [21:14:40] : [Step 4/5] [2021-11-19 21:14:40,053][INFO ][disco-notifier-worker-#24597%grid-0%][IgniteTxManager] Transactions parameter 'collisionsDumpInterval' was changed from 'null' to '1000' [21:14:40] : [Step 4/5] [2021-11-19 21:14:40,054][INFO ][disco-notifier-worker-#24597%grid-0%][IgniteTxManager] Transactions parameter 'txOwnerDumpRequestsAllowed' was changed from 'null' to 'true' [21:14:40] : [Step 4/5] [2021-11-19 21:14:40,054][INFO ][disco-notifier-worker-#24597%grid-0%][GridCacheDatabaseSharedManager] Historical rebalance WAL threshold changed [property=historical.rebalance.threshold, oldVal=null, newVal=500] [21:14:40] : [Step 4/5] [2021-11-19 21:14:40,059][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] To start Console Management & Monitoring run ignitevisorcmd.{sh|bat} [21:14:40] : [Step 4/5] [2021-11-19 21:14:40,060][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] [21:14:40] : [Step 4/5] [21:14:40] : [Step 4/5] >>> +-------------------------------------------+ [21:14:40] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:14:40] : [Step 4/5] >>> +-------------------------------------------+ [21:14:40] : [Step 4/5] >>> OS name: Linux 4.15.0-151-generic amd64 [21:14:40] : [Step 4/5] >>> CPU(s): 24 [21:14:40] : [Step 4/5] >>> Heap: 2.0GB [21:14:40] : [Step 4/5] >>> VM name: 16724@c4dfe9a430b2 [21:14:40] : [Step 4/5] >>> Ignite instance name: grid-0 [21:14:40] : [Step 4/5] >>> Local node [ID=007E61A0-A40A-4876-9E77-E092FE5C2000, order=1, clientMode=false] [21:14:40] : [Step 4/5] >>> Local node addresses: [127.0.0.1] [21:14:40] : [Step 4/5] >>> Local ports: TCP:10800 TCP:47100 TCP:47500 [21:14:40] : [Step 4/5] [21:14:40] : [Step 4/5] [2021-11-19 21:14:40,060][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] >>> Ignite cluster is in INACTIVE state (limited functionality available). Use control.(sh|bat) script or IgniteCluster.state(ClusterState.ACTIVE) to change the state. [21:14:40] : [Step 4/5] [2021-11-19 21:14:40,061][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][GridDiscoveryManager] Topology snapshot [ver=1, locNode=007e61a0, servers=1, clients=0, state=INACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=007e61a0-a40a-4876-9e77-e092fe5c2000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:14:40] : [Step 4/5] [2021-11-19 21:14:40,062][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][G] Node started : [stage="Configure system pool" (0 ms),stage="Start managers" (227 ms),stage="Configure binary metadata" (2 ms),stage="Start processors" (320 ms),stage="Start 'StanByClusterTestProvider' plugin" (0 ms),stage="Start 'PageMemory tracker plugin' plugin" (0 ms),stage="Start 'TestDistibutedConfigurationPlugin' plugin" (0 ms),stage="Start 'NodeValidationPluginProvider' plugin" (0 ms),stage="Init metastore" (94 ms),stage="Init and start regions" (7 ms),stage="Restore binary memory" (29 ms),stage="Restore logical state" (33 ms),stage="Finish recovery" (6 ms),stage="Join topology" (11 ms),stage="Await transition" (2 ms),stage="Await exchange" (15 ms),stage="Total time" (746 ms)] [21:14:40] : [Step 4/5] [2021-11-19 21:14:40,063][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][root] Node started with the following configuration [id=007e61a0-a40a-4876-9e77-e092fe5c2000, marshaller=BinaryMarshaller [], discovery=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=5000, ackTimeout=5000, marsh=JdkMarshaller [clsFilter=org.apache.ignite.marshaller.MarshallerUtils$1@248fa8b6], reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], binaryCfg=null, lateAff=true] [21:14:40]W: [org.apache.ignite:ignite-core] [2021-11-19 21:14:40,069][WARN ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][G] Ignite work directory is not provided, automatically resolved to: /opt/buildagent/work/7bc1c54bc719b67c/work [21:14:40] : [Step 4/5] [2021-11-19 21:14:40,070][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] [21:14:40] : [Step 4/5] [21:14:40] : [Step 4/5] >>> __________ ________________ [21:14:40] : [Step 4/5] >>> / _/ ___/ |/ / _/_ __/ __/ [21:14:40] : [Step 4/5] >>> _/ // (7 7 // / / / / _/ [21:14:40] : [Step 4/5] >>> /___/\___/_/|_/___/ /_/ /___/ [21:14:40] : [Step 4/5] >>> [21:14:40] : [Step 4/5] >>> ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:14:40] : [Step 4/5] >>> 2021 Copyright(C) Apache Software Foundation [21:14:40] : [Step 4/5] >>> [21:14:40] : [Step 4/5] >>> Ignite documentation: http://ignite.apache.org [21:14:40] : [Step 4/5] [21:14:40] : [Step 4/5] [2021-11-19 21:14:40,070][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] Config URL: n/a [21:14:40] : [Step 4/5] [2021-11-19 21:14:40,071][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] IgniteConfiguration [igniteInstanceName=grid-1, pubPoolSize=24, svcPoolSize=24, callbackPoolSize=24, stripedPoolSize=24, sysPoolSize=24, mgmtPoolSize=4, dataStreamerPoolSize=24, utilityCachePoolSize=24, utilityCacheKeepAliveTime=60000, p2pPoolSize=2, qryPoolSize=24, buildIdxPoolSize=4, igniteHome=/opt/buildagent/work/7bc1c54bc719b67c, igniteWorkDir=/opt/buildagent/work/7bc1c54bc719b67c/work, mbeanSrv=com.sun.jmx.mbeanserver.JmxMBeanServer@6fe85038, nodeId=101bb674-658f-4b57-86e7-a6f4cb062001, marsh=BinaryMarshaller [], marshLocJobs=false, daemon=false, p2pEnabled=true, netTimeout=10000, netCompressionLevel=1, sndRetryDelay=1000, sndRetryCnt=3, metricsHistSize=10000, metricsUpdateFreq=1000, metricsExpTime=9223372036854775807, discoSpi=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=0, ackTimeout=0, marsh=null, reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], segPlc=STOP, segResolveAttempts=2, waitForSegOnStart=true, allResolversPassReq=true, segChkFreq=10000, commSpi=TcpCommunicationSpi [connectGate=org.apache.ignite.spi.communication.tcp.internal.ConnectGateway@5f454660, ctxInitLatch=java.util.concurrent.CountDownLatch@4c5ce924[Count = 1], stopping=false, clientPool=null, nioSrvWrapper=null, stateProvider=null], evtSpi=MemoryEventStorageSpi [expireAgeMs=9223372036854775807, expireCnt=10000, filter=null], colSpi=NoopCollisionSpi [], deploySpi=LocalDeploymentSpi [], indexingSpi=org.apache.ignite.spi.indexing.noop.NoopIndexingSpi@6dd7b59a, addrRslvr=null, encryptionSpi=org.apache.ignite.spi.encryption.keystore.KeystoreEncryptionSpi@38e14cdd, tracingSpi=org.apache.ignite.spi.tracing.NoopTracingSpi@595541ef, clientMode=false, rebalanceThreadPoolSize=4, rebalanceTimeout=10000, rebalanceBatchesPrefetchCnt=3, rebalanceThrottle=0, rebalanceBatchSize=524288, txCfg=TransactionConfiguration [txSerEnabled=false, dfltIsolation=REPEATABLE_READ, dfltConcurrency=PESSIMISTIC, dfltTxTimeout=0, txTimeoutOnPartitionMapExchange=0, deadlockTimeout=10000, pessimisticTxLogSize=0, pessimisticTxLogLinger=10000, tmLookupClsName=null, txManagerFactory=null, useJtaSync=false], cacheSanityCheckEnabled=true, discoStartupDelay=60000, deployMode=SHARED, p2pMissedCacheSize=100, locHost=127.0.0.1, timeSrvPortBase=31100, timeSrvPortRange=100, failureDetectionTimeout=10000, sysWorkerBlockedTimeout=null, clientFailureDetectionTimeout=10000, metricsLogFreq=0, connectorCfg=null, odbcCfg=null, warmupClos=null, atomicCfg=AtomicConfiguration [seqReserveSize=1000, cacheMode=PARTITIONED, backups=1, aff=null, grpName=null], classLdr=null, sslCtxFactory=null, platformCfg=null, binaryCfg=null, memCfg=null, pstCfg=null, dsCfg=DataStorageConfiguration [sysRegionInitSize=41943040, sysRegionMaxSize=104857600, pageSize=4096, concLvl=0, dfltDataRegConf=DataRegionConfiguration [name=default, maxSize=104857600, initSize=268435456, swapPath=null, pageEvictionMode=DISABLED, pageReplacementMode=CLOCK, evictionThreshold=0.9, emptyPagesPoolSize=100, metricsEnabled=false, metricsSubIntervalCount=5, metricsRateTimeInterval=60000, persistenceEnabled=true, checkpointPageBufSize=0, lazyMemoryAllocation=true, warmUpCfg=null], dataRegions=null, storagePath=null, checkpointFreq=30000, lockWaitTime=10000, checkpointThreads=4, checkpointWriteOrder=SEQUENTIAL, walHistSize=20, maxWalArchiveSize=20971520, walSegments=10, walSegmentSize=1048576, walPath=db/wal, walArchivePath=db/wal/archive, cdcWalPath=db/wal/cdc, cdcEnabled=false, metricsEnabled=false, walMode=LOG_ONLY, walTlbSize=131072, walBuffSize=0, walFlushFreq=2000, walFsyncDelay=1000, walRecordIterBuffSize=67108864, alwaysWriteFullPages=false, fileIOFactory=org.apache.ignite.internal.processors.cache.persistence.file.AsyncFileIOFactory@6e48bed1, metricsSubIntervalCnt=5, metricsRateTimeInterval=60000, walAutoArchiveAfterInactivity=-1, walForceArchiveTimeout=-1, writeThrottlingEnabled=false, walCompactionEnabled=false, walCompactionLevel=1, checkpointReadLockTimeout=null, walPageCompression=DISABLED, walPageCompressionLevel=null, dfltWarmUpCfg=null, encCfg=org.apache.ignite.configuration.EncryptionConfiguration@75b277e2, defragmentationThreadPoolSize=4, minWalArchiveSize=-1], snapshotPath=snapshots, activeOnStart=true, activeOnStartPropSetFlag=false, autoActivation=true, autoActivationPropSetFlag=false, clusterStateOnStart=null, sqlConnCfg=null, cliConnCfg=ClientConnectorConfiguration [host=null, port=10800, portRange=100, sockSndBufSize=0, sockRcvBufSize=0, tcpNoDelay=true, maxOpenCursorsPerConn=128, threadPoolSize=24, selectorCnt=12, idleTimeout=0, handshakeTimeout=10000, jdbcEnabled=true, odbcEnabled=true, thinCliEnabled=true, sslEnabled=false, useIgniteSslCtxFactory=true, sslClientAuth=false, sslCtxFactory=null, thinCliCfg=ThinClientConfiguration [maxActiveTxPerConn=100, maxActiveComputeTasksPerConn=0]], mvccVacuumThreadCnt=2, mvccVacuumFreq=5000, authEnabled=false, failureHnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]], commFailureRslvr=null, sqlCfg=SqlConfiguration [longQryWarnTimeout=3000, dfltQryTimeout=0, sqlQryHistSize=1000, validationEnabled=false], asyncContinuationExecutor=null] [21:14:40] : [Step 4/5] [2021-11-19 21:14:40,079][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] Daemon mode: off [21:14:40] : [Step 4/5] [2021-11-19 21:14:40,079][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] OS: Linux 4.15.0-151-generic amd64 [21:14:40] : [Step 4/5] [2021-11-19 21:14:40,080][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] OS user: teamcity [21:14:40] : [Step 4/5] [2021-11-19 21:14:40,080][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] PID: 16724 [21:14:40] : [Step 4/5] [2021-11-19 21:14:40,080][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] Language runtime: Java Platform API Specification ver. 1.8 [21:14:40] : [Step 4/5] [2021-11-19 21:14:40,080][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] VM information: Java(TM) SE Runtime Environment 1.8.0_261-b12 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 25.261-b12 [21:14:40] : [Step 4/5] [2021-11-19 21:14:40,081][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] VM total memory: 1.9GB [21:14:40] : [Step 4/5] [2021-11-19 21:14:40,081][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] Remote Management [restart: off, REST: off, JMX (remote: off)] [21:14:40] : [Step 4/5] [2021-11-19 21:14:40,081][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] Logger: GridTestLog4jLogger [quiet=false, config=null] [21:14:40] : [Step 4/5] [2021-11-19 21:14:40,082][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] IGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c [21:14:40] : [Step 4/5] [2021-11-19 21:14:40,082][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] VM arguments: [-DIGNITE_DUMP_THREADS_ON_FAILURE=false, -DMono=/usr/bin/mono-sgen, -DMono4.0_x64=/usr/lib/mono/4.0, -DMono4.5_x64=/usr/lib/mono/4.5, -DMonoVersion=6.12.0.90, -DSKIP_BUILD=false, -Dagent.home.dir=/opt/buildagent, -Dagent.name=aitc-lin02_03, -Dagent.ownPort=9090, -Dagent.work.dir=/opt/buildagent/work, -Dbuild.number=95, -Dbuild.vcs.number=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.1=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.GitHubApacheIgnite=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dclassworlds.conf=/opt/buildagent/temp/buildTmp/teamcity.m2.conf, -Dcom.jetbrains.maven.watcher.report.file=/opt/buildagent/temp/buildTmp/maven-build-info.xml, -Djava.io.tmpdir=/opt/buildagent/temp/buildTmp, -Dmaven.home=/opt/buildagent/tools/maven3_6, -Dmaven.multiModuleProjectDirectory=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.agent.cpuBenchmark=457, -Dteamcity.agent.dotnet.agent_url=http://localhost:9090/RPC2, -Dteamcity.agent.dotnet.build_id=6278078, -Dteamcity.auth.password=*******, -Dteamcity.auth.userId=TeamCityBuildId=6278078, -Dteamcity.build.changedFiles.file=/opt/buildagent/temp/buildTmp/changedFiles6342607772318147725.txt, -Dteamcity.build.checkoutDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.build.id=6278078, -Dteamcity.build.properties.file=/opt/buildagent/temp/buildTmp/teamcity.build5164517880467851002.properties, -Dteamcity.build.tempDir=/opt/buildagent/temp/buildTmp, -Dteamcity.build.workingDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.buildConfName=Basic 3, -Dteamcity.buildType.id=IgniteTests24Java8_Basic3, -Dteamcity.configuration.properties.file=/opt/buildagent/temp/buildTmp/teamcity.config5591980786735343870.properties, -Dteamcity.maven.userSettings.path=/opt/buildagent/temp/buildTmp/maven_settings_585072866407032347.xml, -Dteamcity.maven.watcher.home=/opt/buildagent/plugins/mavenPlugin/maven-watcher-jdk16, -Dteamcity.projectName=Ignite Tests 2.x (JDK 8/11), -Dteamcity.runner.properties.file=/opt/buildagent/temp/buildTmp/teamcity.runner9098465561618137420.properties, -Dteamcity.tests.recentlyFailedTests.file=/opt/buildagent/temp/buildTmp/testsToRunFirst3891775683130404069.txt, -Dteamcity.version=2021.2 (build 99542), -ea, -Xms2g, -Xmx2g, -XX:+HeapDumpOnOutOfMemoryError, -DIGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_TEST_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_UPDATE_NOTIFIER=false, -DIGNITE_NO_DISCO_ORDER=true, -DIGNITE_PERFORMANCE_SUGGESTIONS_DISABLED=true, -Djava.net.preferIPv4Stack=true, -DTEST_SCALE_FACTOR=1.0, -DIGNITE_TEST_PROP_LOG4J_FILE=log4j-tc-test.xml, -DIGNITE_QUIET=false, -DIGNITE_MARSHAL_BUFFERS_RECHECK=1000, -Dmaven.repo.local=/opt/buildagent/.m2/repository] [21:14:40] : [Step 4/5] [2021-11-19 21:14:40,086][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] System cache's DataRegion size is configured to 40 MB. Use DataStorageConfiguration.systemRegionInitialSize property to change the setting. [21:14:40] : [Step 4/5] [2021-11-19 21:14:40,087][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] Configured caches [in 'sysMemPlc' dataRegion: ['ignite-sys-cache']] [21:14:40]W: [org.apache.ignite:ignite-core] [2021-11-19 21:14:40,087][WARN ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] Peer class loading is enabled (disable it in production for performance and deployment consistency reasons) [21:14:40] : [Step 4/5] [2021-11-19 21:14:40,087][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] 3-rd party licenses can be found at: /opt/buildagent/work/7bc1c54bc719b67c/libs/licenses [21:14:40] : [Step 4/5] [2021-11-19 21:14:40,091][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] Configured plugins: [21:14:40] : [Step 4/5] [2021-11-19 21:14:40,092][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- StanByClusterTestProvider 1.0 [21:14:40] : [Step 4/5] [2021-11-19 21:14:40,092][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:14:40] : [Step 4/5] [2021-11-19 21:14:40,092][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] [21:14:40] : [Step 4/5] [2021-11-19 21:14:40,092][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- PageMemory tracker plugin 1.0 [21:14:40] : [Step 4/5] [2021-11-19 21:14:40,092][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:14:40] : [Step 4/5] [2021-11-19 21:14:40,093][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] [21:14:40] : [Step 4/5] [2021-11-19 21:14:40,093][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- TestDistibutedConfigurationPlugin 1.0 [21:14:40] : [Step 4/5] [2021-11-19 21:14:40,093][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:14:40] : [Step 4/5] [2021-11-19 21:14:40,093][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] [21:14:40] : [Step 4/5] [2021-11-19 21:14:40,093][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- NodeValidationPluginProvider 1.0 [21:14:40] : [Step 4/5] [2021-11-19 21:14:40,094][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:14:40] : [Step 4/5] [2021-11-19 21:14:40,094][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] [21:14:40] : [Step 4/5] [2021-11-19 21:14:40,094][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][FailureProcessor] Configured failure handler: [hnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]]] [21:14:40] : [Step 4/5] [2021-11-19 21:14:40,139][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][TestRecordingCommunicationSpi] Successfully bound communication NIO server to TCP port [port=47101, locHost=/127.0.0.1, selectorsCnt=12, selectorSpins=0, pairedConn=false] [21:14:40]W: [org.apache.ignite:ignite-core] [2021-11-19 21:14:40,140][WARN ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][TestRecordingCommunicationSpi] Message queue limit is set to 0 which may lead to potential OOMEs when running cache operations in FULL_ASYNC or PRIMARY_SYNC modes due to message queues growth on sender and receiver sides. [21:14:40] : [Step 4/5] [2021-11-19 21:14:40,143][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][GridCollisionManager] Collision resolution is disabled (all jobs will be activated upon arrival). [21:14:40] : [Step 4/5] [2021-11-19 21:14:40,144][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] Security status [authentication=off, sandbox=off, tls/ssl=off] [21:14:40] : [Step 4/5] [2021-11-19 21:14:40,205][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:14:40] : [Step 4/5] [2021-11-19 21:14:40,294][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][MaintenanceProcessor] Resolved store directory for node persistent data: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1 [21:14:40] : [Step 4/5] [2021-11-19 21:14:40,295][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][CacheObjectBinaryProcessorImpl] Resolved directory for serialized binary metadata: /opt/buildagent/work/7bc1c54bc719b67c/work/db/binary_meta/grid_1 [21:14:40] : [Step 4/5] [2021-11-19 21:14:40,299][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1 [21:14:40] : [Step 4/5] [2021-11-19 21:14:40,299][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][FileWriteAheadLogManager] Resolved write ahead log work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1 [21:14:40] : [Step 4/5] [2021-11-19 21:14:40,299][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][FileWriteAheadLogManager] Resolved write ahead log archive directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1 [21:14:40] : [Step 4/5] [2021-11-19 21:14:40,610][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000000.wal [21:14:40] : [Step 4/5] [2021-11-19 21:14:40,611][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][FileHandleManagerImpl] Initialized write-ahead log manager [mode=LOG_ONLY] [21:14:40] : [Step 4/5] [2021-11-19 21:14:40,616][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Configured data regions initialized successfully [total=5] [21:14:40] : [Step 4/5] [2021-11-19 21:14:40,793][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][IgniteSnapshotManager] Resolved snapshot work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/snapshots [21:14:40] : [Step 4/5] [2021-11-19 21:14:40,793][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][IgniteSnapshotManager] Resolved temp directory for snapshot creation: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1/snp [21:14:40] : [Step 4/5] [2021-11-19 21:14:40,796][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][ClientListenerProcessor] Client connector processor has started on TCP port 10801 [21:14:40] : [Step 4/5] [2021-11-19 21:14:40,798][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] Non-loopback local IPs: 172.17.0.4 [21:14:40] : [Step 4/5] [2021-11-19 21:14:40,798][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] Enabled local MACs: 0242AC110004 [21:14:40] : [Step 4/5] [2021-11-19 21:14:40,799][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:14:40] : [Step 4/5] [2021-11-19 21:14:40,799][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:14:40] : [Step 4/5] [2021-11-19 21:14:40,800][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:14:40] : [Step 4/5] [2021-11-19 21:14:40,802][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Applying lost metastore updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:14:40] : [Step 4/5] [2021-11-19 21:14:40,803][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=0 ms] [21:14:40] : [Step 4/5] [2021-11-19 21:14:40,803][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Restoring partition state for local groups. [21:14:40] : [Step 4/5] [2021-11-19 21:14:40,803][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=0, partitionsProcessed=0, time=0ms] [21:14:40] : [Step 4/5] [2021-11-19 21:14:40,804][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][GridEncryptionManager] Encryption keys loaded from metastore. [grps=, masterKeyName=ignite.master.key] [21:14:40] : [Step 4/5] [2021-11-19 21:14:40,805][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][ClusterProcessor] Cluster ID and tag has been read from metastorage: null [21:14:40] : [Step 4/5] [2021-11-19 21:14:40,805][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][IgniteClusterImpl] Shutdown policy was updated [oldVal=null, newVal=null] [21:14:40] : [Step 4/5] [2021-11-19 21:14:40,806][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Checkpoint frequency deviation changed [oldVal=null, newVal=null] [21:14:41] : [Step 4/5] [2021-11-19 21:14:41,559][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][FilePageStoreManager] Cleanup cache stores [total=1, left=0, cleanFiles=false] [21:14:41] : [Step 4/5] [2021-11-19 21:14:41,561][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:14:41] : [Step 4/5] [2021-11-19 21:14:41,563][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:14:41] : [Step 4/5] [2021-11-19 21:14:41,564][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:14:41] : [Step 4/5] [2021-11-19 21:14:41,564][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Data Regions Started: 5 [21:14:41] : [Step 4/5] [2021-11-19 21:14:41,565][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] ^-- sysMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:14:41] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:14:41] : [Step 4/5] ^-- default region [type=default, persistence=true, lazyAlloc=true, [21:14:41] : [Step 4/5] ... initCfg=100MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB, allocTotal=0MB] [21:14:41] : [Step 4/5] ^-- metastoreMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:14:41] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:14:41] : [Step 4/5] ^-- TxLog region [type=internal, persistence=true, lazyAlloc=false, [21:14:41] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:14:41] : [Step 4/5] ^-- volatileDsMemPlc region [type=user, persistence=false, lazyAlloc=true, [21:14:41] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB] [21:14:41] : [Step 4/5] ^-- Ignite persistence [used=0MB] [21:14:41] : [Step 4/5] [21:14:41] : [Step 4/5] [2021-11-19 21:14:41,566][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Starting binary memory restore for: [-2100569601] [21:14:41] : [Step 4/5] [2021-11-19 21:14:41,576][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:14:41] : [Step 4/5] [2021-11-19 21:14:41,577][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:14:41] : [Step 4/5] [2021-11-19 21:14:41,579][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000000.wal, offset=0, ver=2] [21:14:41] : [Step 4/5] [2021-11-19 21:14:41,583][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Started cache in recovery mode [name=ignite-sys-cache, id=-2100569601, dataRegionName=sysMemPlc, mode=REPLICATED, atomicity=TRANSACTIONAL, backups=2147483647, mvcc=false] [21:14:41] : [Step 4/5] [2021-11-19 21:14:41,584][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Binary recovery performed in 18 ms. [21:14:41] : [Step 4/5] [2021-11-19 21:14:41,584][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:14:41] : [Step 4/5] [2021-11-19 21:14:41,585][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Applying lost cache updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:14:41] : [Step 4/5] [2021-11-19 21:14:41,587][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=0 ms] [21:14:41] : [Step 4/5] [2021-11-19 21:14:41,587][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Restoring partition state for local groups. [21:14:41] : [Step 4/5] [2021-11-19 21:14:41,596][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=1, partitionsProcessed=100, time=10ms] [21:14:41] : [Step 4/5] [2021-11-19 21:14:41,617][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][TestTcpDiscoverySpi] Successfully bound to TCP port [port=47501, localHost=localhost/127.0.0.1, locNodeId=101bb674-658f-4b57-86e7-a6f4cb062001] [21:14:41] : [Step 4/5] [2021-11-19 21:14:41,621][INFO ][tcp-disco-srvr-[:47500]-#1288%grid-0%-#24599%grid-0%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=56915] [21:14:41] : [Step 4/5] [2021-11-19 21:14:41,621][INFO ][tcp-disco-srvr-[:47500]-#1288%grid-0%-#24599%grid-0%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=56915] [21:14:41] : [Step 4/5] [2021-11-19 21:14:41,622][INFO ][tcp-disco-sock-reader-[]-#1294%grid-0%-#24719%grid-0%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:56915, rmtPort=56915] [21:14:41] : [Step 4/5] [2021-11-19 21:14:41,623][INFO ][tcp-disco-sock-reader-[101bb674 127.0.0.1:56915]-#1294%grid-0%-#24719%grid-0%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=101bb674-658f-4b57-86e7-a6f4cb062001, rmtAddr=/127.0.0.1:56915] [21:14:41] : [Step 4/5] [2021-11-19 21:14:41,630][INFO ][tcp-disco-srvr-[:47501]-#1293%grid-1%-#24718%grid-1%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=52891] [21:14:41] : [Step 4/5] [2021-11-19 21:14:41,631][INFO ][tcp-disco-srvr-[:47501]-#1293%grid-1%-#24718%grid-1%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=52891] [21:14:41] : [Step 4/5] [2021-11-19 21:14:41,632][INFO ][tcp-disco-sock-reader-[]-#1295%grid-1%-#24720%grid-1%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:52891, rmtPort=52891] [21:14:41] : [Step 4/5] [2021-11-19 21:14:41,633][INFO ][tcp-disco-sock-reader-[]-#1295%grid-1%-#24720%grid-1%][TestTcpDiscoverySpi] Received ping request from the remote node [rmtNodeId=007e61a0-a40a-4876-9e77-e092fe5c2000, rmtAddr=/127.0.0.1:52891, rmtPort=52891] [21:14:41] : [Step 4/5] [2021-11-19 21:14:41,634][INFO ][tcp-disco-sock-reader-[]-#1295%grid-1%-#24720%grid-1%][TestTcpDiscoverySpi] Finished writing ping response [rmtNodeId=007e61a0-a40a-4876-9e77-e092fe5c2000, rmtAddr=/127.0.0.1:52891, rmtPort=52891] [21:14:41]W: [org.apache.ignite:ignite-core] [2021-11-19 21:14:41,634][WARN ][tcp-disco-sock-reader-[]-#1295%grid-1%-#24720%grid-1%][TestTcpDiscoverySpi] Failed to shutdown socket [21:14:41]W: [org.apache.ignite:ignite-core] java.net.SocketException: Socket output is already shutdown [21:14:41]W: [org.apache.ignite:ignite-core] at java.net.Socket.shutdownOutput(Socket.java:1572) [21:14:41]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.close(IgniteUtils.java:4247) [21:14:41]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.discovery.tcp.ServerImpl$SocketReader.body(ServerImpl.java:7370) [21:14:41]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.IgniteSpiThread.run(IgniteSpiThread.java:58) [21:14:41] : [Step 4/5] [2021-11-19 21:14:41,634][INFO ][tcp-disco-sock-reader-[101bb674 127.0.0.1:56915]-#1294%grid-0%-#24719%grid-0%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:56915, rmtPort=56915, rmtNodeId=101bb674-658f-4b57-86e7-a6f4cb062001] [21:14:41] : [Step 4/5] [2021-11-19 21:14:41,636][INFO ][tcp-disco-sock-reader-[]-#1295%grid-1%-#24720%grid-1%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:52891, rmtPort=52891, rmtNodeId=null] [21:14:41] : [Step 4/5] [2021-11-19 21:14:41,639][INFO ][tcp-disco-msg-worker-[crd]-#1287%grid-0%-#24598%grid-0%][GridEncryptionManager] Joining node doesn't have stored group keys [node=101bb674-658f-4b57-86e7-a6f4cb062001] [21:14:41] : [Step 4/5] [2021-11-19 21:14:41,649][INFO ][tcp-disco-msg-worker-[crd]-#1287%grid-0%-#24598%grid-0%][TestTcpDiscoverySpi] New next node [newNext=TcpDiscoveryNode [id=101bb674-658f-4b57-86e7-a6f4cb062001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=0, intOrder=2, lastExchangeTime=1637345681620, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false]] [21:14:41] : [Step 4/5] [2021-11-19 21:14:41,650][INFO ][tcp-disco-srvr-[:47501]-#1293%grid-1%-#24718%grid-1%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=48819] [21:14:41] : [Step 4/5] [2021-11-19 21:14:41,650][INFO ][tcp-disco-srvr-[:47501]-#1293%grid-1%-#24718%grid-1%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=48819] [21:14:41] : [Step 4/5] [2021-11-19 21:14:41,650][INFO ][tcp-disco-sock-reader-[]-#1296%grid-1%-#24721%grid-1%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:48819, rmtPort=48819] [21:14:41] : [Step 4/5] [2021-11-19 21:14:41,651][INFO ][tcp-disco-sock-reader-[007e61a0 127.0.0.1:48819]-#1296%grid-1%-#24721%grid-1%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=007e61a0-a40a-4876-9e77-e092fe5c2000, rmtAddr=/127.0.0.1:48819] [21:14:41] : [Step 4/5] [2021-11-19 21:14:41,655][INFO ][tcp-disco-msg-worker-[]-#1292%grid-1%-#24717%grid-1%][TestTcpDiscoverySpi] New next node [newNext=TcpDiscoveryNode [id=007e61a0-a40a-4876-9e77-e092fe5c2000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345681650, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false]] [21:14:41] : [Step 4/5] [2021-11-19 21:14:41,656][INFO ][tcp-disco-srvr-[:47500]-#1288%grid-0%-#24599%grid-0%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=40739] [21:14:41] : [Step 4/5] [2021-11-19 21:14:41,657][INFO ][tcp-disco-srvr-[:47500]-#1288%grid-0%-#24599%grid-0%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=40739] [21:14:41] : [Step 4/5] [2021-11-19 21:14:41,657][INFO ][tcp-disco-sock-reader-[]-#1297%grid-0%-#24722%grid-0%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:40739, rmtPort=40739] [21:14:41] : [Step 4/5] [2021-11-19 21:14:41,659][INFO ][tcp-disco-sock-reader-[101bb674 127.0.0.1:40739]-#1297%grid-0%-#24722%grid-0%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=101bb674-658f-4b57-86e7-a6f4cb062001, rmtAddr=/127.0.0.1:40739] [21:14:41] : [Step 4/5] [2021-11-19 21:14:41,661][INFO ][disco-event-worker-#24601%grid-0%][GridDiscoveryManager] Added new node to topology: TcpDiscoveryNode [id=101bb674-658f-4b57-86e7-a6f4cb062001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637345681620, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false] [21:14:41] : [Step 4/5] [2021-11-19 21:14:41,662][INFO ][disco-event-worker-#24601%grid-0%][GridDiscoveryManager] Topology snapshot [ver=2, locNode=007e61a0, servers=2, clients=0, state=INACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=007e61a0-a40a-4876-9e77-e092fe5c2000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=101bb674-658f-4b57-86e7-a6f4cb062001, consistentId=grid-1, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:14:41] : [Step 4/5] [2021-11-19 21:14:41,665][INFO ][tcp-disco-msg-worker-[007e61a0 127.0.0.1:47500]-#1292%grid-1%-#24717%grid-1%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustEnabled' was changed from 'null' to 'false' [21:14:41] : [Step 4/5] [2021-11-19 21:14:41,665][INFO ][tcp-disco-msg-worker-[007e61a0 127.0.0.1:47500]-#1292%grid-1%-#24717%grid-1%][ClusterProcessor] cranky_darwin [21:14:41] : [Step 4/5] [2021-11-19 21:14:41,665][INFO ][tcp-disco-msg-worker-[007e61a0 127.0.0.1:47500]-#1292%grid-1%-#24717%grid-1%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustTimeout' was changed from 'null' to '300000' [21:14:41] : [Step 4/5] [2021-11-19 21:14:41,666][INFO ][tcp-disco-msg-worker-[007e61a0 127.0.0.1:47500]-#1292%grid-1%-#24717%grid-1%][IgniteTxManager] Transactions parameter 'longOperationsDumpTimeout' was changed from 'null' to '60000' [21:14:41] : [Step 4/5] [2021-11-19 21:14:41,666][INFO ][tcp-disco-msg-worker-[007e61a0 127.0.0.1:47500]-#1292%grid-1%-#24717%grid-1%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpThreshold' was changed from 'null' to '0' [21:14:41] : [Step 4/5] [2021-11-19 21:14:41,667][INFO ][tcp-disco-msg-worker-[007e61a0 127.0.0.1:47500]-#1292%grid-1%-#24717%grid-1%][IgniteTxManager] Transactions parameter 'transactionTimeDumpSamplesCoefficient' was changed from 'null' to '0.0' [21:14:41] : [Step 4/5] [2021-11-19 21:14:41,667][INFO ][tcp-disco-msg-worker-[007e61a0 127.0.0.1:47500]-#1292%grid-1%-#24717%grid-1%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpSamplesPerSecondLimit' was changed from 'null' to '5' [21:14:41] : [Step 4/5] [2021-11-19 21:14:41,668][INFO ][tcp-disco-msg-worker-[007e61a0 127.0.0.1:47500]-#1292%grid-1%-#24717%grid-1%][IgniteTxManager] Transactions parameter 'collisionsDumpInterval' was changed from 'null' to '1000' [21:14:41] : [Step 4/5] [2021-11-19 21:14:41,668][INFO ][tcp-disco-msg-worker-[007e61a0 127.0.0.1:47500]-#1292%grid-1%-#24717%grid-1%][IgniteTxManager] Transactions parameter 'txOwnerDumpRequestsAllowed' was changed from 'null' to 'true' [21:14:41] : [Step 4/5] [2021-11-19 21:14:41,669][INFO ][tcp-disco-msg-worker-[007e61a0 127.0.0.1:47500]-#1292%grid-1%-#24717%grid-1%][GridCacheDatabaseSharedManager] Historical rebalance WAL threshold changed [property=historical.rebalance.threshold, oldVal=null, newVal=500] [21:14:41] : [Step 4/5] [2021-11-19 21:14:41,670][INFO ][disco-notifier-worker-#24716%grid-1%][MvccProcessorImpl] Assigned mvcc coordinator [crd=MvccCoordinator [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=0], nodeId=007e61a0-a40a-4876-9e77-e092fe5c2000, ver=1637345680040, local=false, initialized=false]] [21:14:41] : [Step 4/5] [2021-11-19 21:14:41,671][INFO ][sys-#24699%grid-1%][ClusterProcessor] Writing cluster ID and tag to metastorage on ready for write ClusterIdAndTag [id=b67f5159-9231-44d3-a424-19e9051439ca, tag=cranky_darwin] [21:14:41] : [Step 4/5] [2021-11-19 21:14:41,693][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] To start Console Management & Monitoring run ignitevisorcmd.{sh|bat} [21:14:41] : [Step 4/5] [2021-11-19 21:14:41,693][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] [21:14:41] : [Step 4/5] [21:14:41] : [Step 4/5] >>> +-------------------------------------------+ [21:14:41] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:14:41] : [Step 4/5] >>> +-------------------------------------------+ [21:14:41] : [Step 4/5] >>> OS name: Linux 4.15.0-151-generic amd64 [21:14:41] : [Step 4/5] >>> CPU(s): 24 [21:14:41] : [Step 4/5] >>> Heap: 2.0GB [21:14:41] : [Step 4/5] >>> VM name: 16724@c4dfe9a430b2 [21:14:41] : [Step 4/5] >>> Ignite instance name: grid-1 [21:14:41] : [Step 4/5] >>> Local node [ID=101BB674-658F-4B57-86E7-A6F4CB062001, order=2, clientMode=false] [21:14:41] : [Step 4/5] >>> Local node addresses: [127.0.0.1] [21:14:41] : [Step 4/5] >>> Local ports: TCP:10801 TCP:47101 TCP:47501 [21:14:41] : [Step 4/5] [21:14:41] : [Step 4/5] [2021-11-19 21:14:41,694][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] >>> Ignite cluster is in INACTIVE state (limited functionality available). Use control.(sh|bat) script or IgniteCluster.state(ClusterState.ACTIVE) to change the state. [21:14:41] : [Step 4/5] [2021-11-19 21:14:41,695][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][GridDiscoveryManager] Topology snapshot [ver=2, locNode=101bb674, servers=2, clients=0, state=INACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=007e61a0-a40a-4876-9e77-e092fe5c2000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=101bb674-658f-4b57-86e7-a6f4cb062001, consistentId=grid-1, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:14:41] : [Step 4/5] [2021-11-19 21:14:41,696][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][G] Node started : [stage="Configure system pool" (0 ms),stage="Start managers" (225 ms),stage="Configure binary metadata" (1 ms),stage="Start processors" (500 ms),stage="Start 'StanByClusterTestProvider' plugin" (0 ms),stage="Start 'PageMemory tracker plugin' plugin" (0 ms),stage="Start 'TestDistibutedConfigurationPlugin' plugin" (0 ms),stage="Start 'NodeValidationPluginProvider' plugin" (0 ms),stage="Init metastore" (762 ms),stage="Init and start regions" (6 ms),stage="Restore binary memory" (17 ms),stage="Restore logical state" (11 ms),stage="Finish recovery" (19 ms),stage="Join topology" (54 ms),stage="Await transition" (2 ms),stage="Await exchange" (23 ms),stage="Total time" (1620 ms)] [21:14:41] : [Step 4/5] [2021-11-19 21:14:41,698][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][root] Node started with the following configuration [id=101bb674-658f-4b57-86e7-a6f4cb062001, marshaller=BinaryMarshaller [], discovery=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=5000, ackTimeout=5000, marsh=JdkMarshaller [clsFilter=org.apache.ignite.marshaller.MarshallerUtils$1@1eda6e6e], reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], binaryCfg=null, lateAff=true] [21:14:41] : [Step 4/5] [2021-11-19 21:14:41,699][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][GridClusterStateProcessor] Sending activate cluster request with BaselineTopology BaselineTopology [id=0, branchingHash=-2475315501, branchingType='New BaselineTopology', baselineNodes=[grid-1, grid-0]] [21:14:41] : [Step 4/5] [2021-11-19 21:14:41,703][INFO ][disco-notifier-worker-#24597%grid-0%][GridClusterStateProcessor] Received activate cluster request with BaselineTopology[id=0] initiator node ID: 007e61a0-a40a-4876-9e77-e092fe5c2000 [21:14:41] : [Step 4/5] [2021-11-19 21:14:41,704][INFO ][disco-notifier-worker-#24597%grid-0%][GridClusterStateProcessor] Started state transition: activate cluster [21:14:41] : [Step 4/5] [2021-11-19 21:14:41,705][INFO ][exchange-worker-#24602%grid-0%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], crd=true, evt=DISCOVERY_CUSTOM_EVT, evtNode=007e61a0-a40a-4876-9e77-e092fe5c2000, customEvt=ChangeGlobalStateMessage [id=04e2e593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqId=1ccd633a-d95f-4a79-a47d-75f798225a1e, initiatingNodeId=007e61a0-a40a-4876-9e77-e092fe5c2000, state=ACTIVE, baselineTopology=BaselineTopology [id=0, branchingHash=-2475315501, branchingType='New BaselineTopology', baselineNodes=[grid-1, grid-0]], forceChangeBaselineTopology=false, timestamp=1637345681699, forceDeactivation=true], allowMerge=false, exchangeFreeSwitch=false] [21:14:41] : [Step 4/5] [2021-11-19 21:14:41,705][INFO ][disco-notifier-worker-#24716%grid-1%][GridClusterStateProcessor] Received activate cluster request with BaselineTopology[id=0] initiator node ID: 007e61a0-a40a-4876-9e77-e092fe5c2000 [21:14:41] : [Step 4/5] [2021-11-19 21:14:41,706][INFO ][exchange-worker-#24602%grid-0%][GridDhtPartitionsExchangeFuture] Start activation process [nodeId=007e61a0-a40a-4876-9e77-e092fe5c2000, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]]. New state: ACTIVE [21:14:41] : [Step 4/5] [2021-11-19 21:14:41,706][INFO ][disco-notifier-worker-#24716%grid-1%][GridClusterStateProcessor] Started state transition: activate cluster [21:14:41] : [Step 4/5] [2021-11-19 21:14:41,707][INFO ][exchange-worker-#24602%grid-0%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0 [21:14:41] : [Step 4/5] [2021-11-19 21:14:41,707][INFO ][exchange-worker-#24725%grid-1%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], crd=false, evt=DISCOVERY_CUSTOM_EVT, evtNode=007e61a0-a40a-4876-9e77-e092fe5c2000, customEvt=ChangeGlobalStateMessage [id=04e2e593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqId=1ccd633a-d95f-4a79-a47d-75f798225a1e, initiatingNodeId=007e61a0-a40a-4876-9e77-e092fe5c2000, state=ACTIVE, baselineTopology=BaselineTopology [id=0, branchingHash=-2475315501, branchingType='New BaselineTopology', baselineNodes=[grid-1, grid-0]], forceChangeBaselineTopology=false, timestamp=1637345681699, forceDeactivation=true], allowMerge=false, exchangeFreeSwitch=false] [21:14:41] : [Step 4/5] [2021-11-19 21:14:41,709][INFO ][exchange-worker-#24602%grid-0%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000000.wal, offset=8795, ver=2] [21:14:41] : [Step 4/5] [2021-11-19 21:14:41,709][INFO ][exchange-worker-#24725%grid-1%][GridDhtPartitionsExchangeFuture] Start activation process [nodeId=101bb674-658f-4b57-86e7-a6f4cb062001, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]]. New state: ACTIVE [21:14:41] : [Step 4/5] [2021-11-19 21:14:41,710][INFO ][exchange-worker-#24602%grid-0%][GridClusterStateProcessor] Writing BaselineTopology[id=0] [21:14:41] : [Step 4/5] [2021-11-19 21:14:41,710][INFO ][exchange-worker-#24725%grid-1%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1 [21:14:41] : [Step 4/5] [2021-11-19 21:14:41,716][INFO ][exchange-worker-#24602%grid-0%][GridCacheDatabaseSharedManager] Finish recovery performed in 9 ms. [21:14:41] : [Step 4/5] [2021-11-19 21:14:41,716][INFO ][exchange-worker-#24725%grid-1%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000000.wal, offset=8795, ver=2] [21:14:41] : [Step 4/5] [2021-11-19 21:14:41,717][INFO ][exchange-worker-#24602%grid-0%][msg] Components activation performed in 11 ms. [21:14:41] : [Step 4/5] [2021-11-19 21:14:41,719][INFO ][exchange-worker-#24725%grid-1%][GridClusterStateProcessor] Writing BaselineTopology[id=0] [21:14:41] : [Step 4/5] [2021-11-19 21:14:41,719][INFO ][exchange-worker-#24602%grid-0%][GridCacheProcessor] Finished recovery for cache [cache=ignite-sys-cache, grp=ignite-sys-cache, startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:14:41] : [Step 4/5] [2021-11-19 21:14:41,721][INFO ][exchange-worker-#24725%grid-1%][GridCacheDatabaseSharedManager] Finish recovery performed in 9 ms. [21:14:41] : [Step 4/5] [2021-11-19 21:14:41,721][INFO ][exchange-worker-#24602%grid-0%][GridDhtPartitionsExchangeFuture] Successfully activated caches [nodeId=007e61a0-a40a-4876-9e77-e092fe5c2000, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], newState=ACTIVE] [21:14:41] : [Step 4/5] [2021-11-19 21:14:41,723][INFO ][exchange-worker-#24602%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:14:41] : [Step 4/5] [2021-11-19 21:14:41,722][INFO ][exchange-worker-#24725%grid-1%][msg] Components activation performed in 12 ms. [21:14:41] : [Step 4/5] [2021-11-19 21:14:41,730][INFO ][exchange-worker-#24725%grid-1%][GridCacheProcessor] Finished recovery for cache [cache=ignite-sys-cache, grp=ignite-sys-cache, startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:14:41] : [Step 4/5] [2021-11-19 21:14:41,731][INFO ][exchange-worker-#24725%grid-1%][GridDhtPartitionsExchangeFuture] Successfully activated caches [nodeId=101bb674-658f-4b57-86e7-a6f4cb062001, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], newState=ACTIVE] [21:14:41] : [Step 4/5] [2021-11-19 21:14:41,731][INFO ][exchange-worker-#24725%grid-1%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:14:41] : [Step 4/5] [2021-11-19 21:14:41,740][INFO ][exchange-worker-#24602%grid-0%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], crd=true] [21:14:41] : [Step 4/5] [2021-11-19 21:14:41,742][INFO ][grid-nio-worker-tcp-comm-0-#24540%TestRecordingCommunicationSpi%][TestRecordingCommunicationSpi] Accepted incoming communication connection [locAddr=/127.0.0.1:47100, rmtAddr=/127.0.0.1:35272] [21:14:41] : [Step 4/5] [2021-11-19 21:14:41,745][INFO ][grid-nio-worker-tcp-comm-0-#24659%TestRecordingCommunicationSpi%][TestRecordingCommunicationSpi] Established outgoing communication connection [locAddr=/127.0.0.1:35272, rmtAddr=/127.0.0.1:47100] [21:14:41] : [Step 4/5] [2021-11-19 21:14:41,745][INFO ][exchange-worker-#24725%grid-1%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], crd=false] [21:14:41] : [Step 4/5] [2021-11-19 21:14:41,747][INFO ][sys-#24579%grid-0%][GridDhtPartitionsExchangeFuture] Coordinator received single message [ver=AffinityTopologyVersion [topVer=2, minorTopVer=1], node=101bb674-658f-4b57-86e7-a6f4cb062001, allReceived=true] [21:14:41] : [Step 4/5] [2021-11-19 21:14:41,748][INFO ][sys-#24579%grid-0%][GridDhtPartitionsExchangeFuture] finishExchangeOnCoordinator [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:14:41] : [Step 4/5] [2021-11-19 21:14:41,752][INFO ][sys-#24579%grid-0%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], err=null, rebalanced=true, wasRebalanced=false] [21:14:41] : [Step 4/5] [2021-11-19 21:14:41,753][INFO ][disco-notifier-worker-#24716%grid-1%][GridClusterStateProcessor] Received state change finish message: ACTIVE [21:14:41] : [Step 4/5] [2021-11-19 21:14:41,754][INFO ][disco-notifier-worker-#24716%grid-1%][GridClusterStateProcessor] Cluster state was changed from INACTIVE to ACTIVE [21:14:41] : [Step 4/5] [2021-11-19 21:14:41,752][INFO ][disco-notifier-worker-#24597%grid-0%][GridClusterStateProcessor] Received state change finish message: ACTIVE [21:14:41] : [Step 4/5] [2021-11-19 21:14:41,755][INFO ][sys-#24704%grid-1%][GridCachePartitionExchangeManager] Delay process full message without exchange id (there is exchange in progress) [nodeId=007e61a0-a40a-4876-9e77-e092fe5c2000] [21:14:41] : [Step 4/5] [2021-11-19 21:14:41,754][INFO ][sys-#24692%grid-1%][GridDhtPartitionsExchangeFuture] Received full message, will finish exchange [node=007e61a0-a40a-4876-9e77-e092fe5c2000, resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:14:41] : [Step 4/5] [2021-11-19 21:14:41,755][INFO ][sys-#24579%grid-0%][GridCacheProcessor] Finish proxy initialization, cacheName=ignite-sys-cache, localNodeId=007e61a0-a40a-4876-9e77-e092fe5c2000 [21:14:41] : [Step 4/5] [2021-11-19 21:14:41,755][INFO ][disco-notifier-worker-#24597%grid-0%][GridClusterStateProcessor] Cluster state was changed from INACTIVE to ACTIVE [21:14:41] : [Step 4/5] [2021-11-19 21:14:41,756][INFO ][sys-#24692%grid-1%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], err=null, rebalanced=true, wasRebalanced=false] [21:14:41] : [Step 4/5] [2021-11-19 21:14:41,756][INFO ][exchange-worker-#24602%grid-0%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=2, minorTopVer=1], force=false, evt=DISCOVERY_CUSTOM_EVT, node=007e61a0-a40a-4876-9e77-e092fe5c2000] [21:14:41] : [Step 4/5] [2021-11-19 21:14:41,756][INFO ][sys-#24591%grid-0%][DistributedBaselineConfiguration] Baseline auto-adjust is 'disabled' with timeout='300000' ms [21:14:41] : [Step 4/5] [2021-11-19 21:14:41,758][INFO ][sys-#24692%grid-1%][GridCacheProcessor] Finish proxy initialization, cacheName=ignite-sys-cache, localNodeId=101bb674-658f-4b57-86e7-a6f4cb062001 [21:14:41] : [Step 4/5] [2021-11-19 21:14:41,756][INFO ][sys-#24579%grid-0%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=007e61a0-a40a-4876-9e77-e092fe5c2000, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=007e61a0-a40a-4876-9e77-e092fe5c2000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345681752, loc=true, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:14:41] : [Step 4/5] [2021-11-19 21:14:41,760][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][root] awaitPartitionMapExchange finished [21:14:41] : [Step 4/5] [2021-11-19 21:14:41,760][INFO ][exchange-worker-#24725%grid-1%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=2, minorTopVer=1], force=false, evt=DISCOVERY_CUSTOM_EVT, node=007e61a0-a40a-4876-9e77-e092fe5c2000] [21:14:41] : [Step 4/5] [2021-11-19 21:14:41,760][INFO ][sys-#24692%grid-1%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=101bb674-658f-4b57-86e7-a6f4cb062001, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=007e61a0-a40a-4876-9e77-e092fe5c2000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345681650, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:14:41] : [Step 4/5] [2021-11-19 21:14:41,759][INFO ][sys-#24709%grid-1%][DistributedBaselineConfiguration] Baseline auto-adjust is 'disabled' with timeout='300000' ms [21:14:41] : [Step 4/5] [2021-11-19 21:14:41,758][INFO ][sys-#24591%grid-0%][GridClusterStateProcessor] Successfully performed final activation steps [nodeId=007e61a0-a40a-4876-9e77-e092fe5c2000, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:14:41] : [Step 4/5] [2021-11-19 21:14:41,763][INFO ][sys-#24709%grid-1%][GridClusterStateProcessor] Successfully performed final activation steps [nodeId=101bb674-658f-4b57-86e7-a6f4cb062001, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:14:41] : [Step 4/5] [2021-11-19 21:14:41,762][INFO ][sys-#24692%grid-1%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (1 ms), stage="Update caches registry" (20 ms), stage="Start caches" (0 ms), stage="Affinity initialization on cache group start" (0 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Restore partition states" (0 ms), stage="After states restored callback" (8 ms), stage="WAL history reservation" (0 ms), stage="Waiting for Full message" (13 ms), stage="Affinity recalculation" (2 ms), stage="Full map updating" (0 ms), stage="Detect lost partitions" (1 ms), stage="Exchange done" (4 ms), stage="Total time" (49 ms)] [21:14:41] : [Step 4/5] [2021-11-19 21:14:41,760][INFO ][sys-#24579%grid-0%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (1 ms), stage="Update caches registry" (13 ms), stage="Start caches" (1 ms), stage="Affinity initialization on cache group start" (0 ms), stage="Determine exchange type" (1 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Restore partition states" (0 ms), stage="After states restored callback" (16 ms), stage="WAL history reservation" (0 ms), stage="Waiting for all single messages" (7 ms), stage="Affinity recalculation (crd)" (0 ms), stage="Collect update counters and create affinity messages" (0 ms), stage="Assign partitions states" (0 ms), stage="Validate partitions states" (0 ms), stage="Ideal affinity diff calculation (enforced)" (0 ms), stage="Apply update counters" (0 ms), stage="Full message preparing" (2 ms), stage="Full message sending" (0 ms), stage="State finish message sending" (0 ms), stage="Detect lost partitions" (2 ms), stage="Exchange done" (6 ms), stage="Total time" (49 ms), Discovery lag=3 ms, Latest started node id=101bb674-658f-4b57-86e7-a6f4cb062001] [21:14:41]W: [org.apache.ignite:ignite-core] [2021-11-19 21:14:41,765][WARN ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][G] Ignite work directory is not provided, automatically resolved to: /opt/buildagent/work/7bc1c54bc719b67c/work [21:14:41] : [Step 4/5] [2021-11-19 21:14:41,765][INFO ][sys-#24692%grid-1%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], stage="Affinity initialization on cache group start [grp=ignite-sys-cache]" (0 ms) (parent=Affinity initialization on cache group start), stage="Affinity centralized initialization (crd) [grp=ignite-sys-cache, crd=false]" (0 ms) (parent=Determine exchange type), stage="Restore partition states [grp=ignite-sys-cache]" (0 ms) (parent=Restore partition states), stage="Affinity applying from full message [grp=ignite-sys-cache]" (2 ms) (parent=Affinity recalculation)] [21:14:41] : [Step 4/5] [2021-11-19 21:14:41,768][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-2] [21:14:41] : [Step 4/5] [21:14:41] : [Step 4/5] >>> __________ ________________ [21:14:41] : [Step 4/5] >>> / _/ ___/ |/ / _/_ __/ __/ [21:14:41] : [Step 4/5] >>> _/ // (7 7 // / / / / _/ [21:14:41] : [Step 4/5] >>> /___/\___/_/|_/___/ /_/ /___/ [21:14:41] : [Step 4/5] >>> [21:14:41] : [Step 4/5] >>> ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:14:41] : [Step 4/5] >>> 2021 Copyright(C) Apache Software Foundation [21:14:41] : [Step 4/5] >>> [21:14:41] : [Step 4/5] >>> Ignite documentation: http://ignite.apache.org [21:14:41] : [Step 4/5] [21:14:41] : [Step 4/5] [2021-11-19 21:14:41,767][INFO ][sys-#24579%grid-0%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], stage="Affinity initialization on cache group start [grp=ignite-sys-cache]" (0 ms) (parent=Affinity initialization on cache group start), stage="Affinity centralized initialization (crd) [grp=ignite-sys-cache, crd=true]" (1 ms) (parent=Determine exchange type), stage="Restore partition states [grp=ignite-sys-cache]" (0 ms) (parent=Restore partition states), stage="Affinity recalculation (partitions availability) [grp=ignite-sys-cache]" (0 ms) (parent=Ideal affinity diff calculation (enforced))] [21:14:41] : [Step 4/5] [2021-11-19 21:14:41,769][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-2] Config URL: n/a [21:14:41] : [Step 4/5] [2021-11-19 21:14:41,771][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-2] IgniteConfiguration [igniteInstanceName=grid-2, pubPoolSize=24, svcPoolSize=24, callbackPoolSize=24, stripedPoolSize=24, sysPoolSize=24, mgmtPoolSize=4, dataStreamerPoolSize=24, utilityCachePoolSize=24, utilityCacheKeepAliveTime=60000, p2pPoolSize=2, qryPoolSize=24, buildIdxPoolSize=4, igniteHome=/opt/buildagent/work/7bc1c54bc719b67c, igniteWorkDir=/opt/buildagent/work/7bc1c54bc719b67c/work, mbeanSrv=com.sun.jmx.mbeanserver.JmxMBeanServer@6fe85038, nodeId=20f7c8ec-4982-4877-b5fe-1a8056d0a002, marsh=BinaryMarshaller [], marshLocJobs=false, daemon=false, p2pEnabled=true, netTimeout=10000, netCompressionLevel=1, sndRetryDelay=1000, sndRetryCnt=3, metricsHistSize=10000, metricsUpdateFreq=1000, metricsExpTime=9223372036854775807, discoSpi=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=0, ackTimeout=0, marsh=null, reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], segPlc=STOP, segResolveAttempts=2, waitForSegOnStart=true, allResolversPassReq=true, segChkFreq=10000, commSpi=TcpCommunicationSpi [connectGate=org.apache.ignite.spi.communication.tcp.internal.ConnectGateway@1887c6ba, ctxInitLatch=java.util.concurrent.CountDownLatch@c81fe89[Count = 1], stopping=false, clientPool=null, nioSrvWrapper=null, stateProvider=null], evtSpi=MemoryEventStorageSpi [expireAgeMs=9223372036854775807, expireCnt=10000, filter=null], colSpi=NoopCollisionSpi [], deploySpi=LocalDeploymentSpi [], indexingSpi=org.apache.ignite.spi.indexing.noop.NoopIndexingSpi@29acd7cb, addrRslvr=null, encryptionSpi=org.apache.ignite.spi.encryption.keystore.KeystoreEncryptionSpi@ab710c8, tracingSpi=org.apache.ignite.spi.tracing.NoopTracingSpi@73a48ff0, clientMode=false, rebalanceThreadPoolSize=4, rebalanceTimeout=10000, rebalanceBatchesPrefetchCnt=3, rebalanceThrottle=0, rebalanceBatchSize=524288, txCfg=TransactionConfiguration [txSerEnabled=false, dfltIsolation=REPEATABLE_READ, dfltConcurrency=PESSIMISTIC, dfltTxTimeout=0, txTimeoutOnPartitionMapExchange=0, deadlockTimeout=10000, pessimisticTxLogSize=0, pessimisticTxLogLinger=10000, tmLookupClsName=null, txManagerFactory=null, useJtaSync=false], cacheSanityCheckEnabled=true, discoStartupDelay=60000, deployMode=SHARED, p2pMissedCacheSize=100, locHost=127.0.0.1, timeSrvPortBase=31100, timeSrvPortRange=100, failureDetectionTimeout=10000, sysWorkerBlockedTimeout=null, clientFailureDetectionTimeout=10000, metricsLogFreq=0, connectorCfg=null, odbcCfg=null, warmupClos=null, atomicCfg=AtomicConfiguration [seqReserveSize=1000, cacheMode=PARTITIONED, backups=1, aff=null, grpName=null], classLdr=null, sslCtxFactory=null, platformCfg=null, binaryCfg=null, memCfg=null, pstCfg=null, dsCfg=DataStorageConfiguration [sysRegionInitSize=41943040, sysRegionMaxSize=104857600, pageSize=4096, concLvl=0, dfltDataRegConf=DataRegionConfiguration [name=default, maxSize=104857600, initSize=268435456, swapPath=null, pageEvictionMode=DISABLED, pageReplacementMode=CLOCK, evictionThreshold=0.9, emptyPagesPoolSize=100, metricsEnabled=false, metricsSubIntervalCount=5, metricsRateTimeInterval=60000, persistenceEnabled=true, checkpointPageBufSize=0, lazyMemoryAllocation=true, warmUpCfg=null], dataRegions=null, storagePath=null, checkpointFreq=30000, lockWaitTime=10000, checkpointThreads=4, checkpointWriteOrder=SEQUENTIAL, walHistSize=20, maxWalArchiveSize=20971520, walSegments=10, walSegmentSize=1048576, walPath=db/wal, walArchivePath=db/wal/archive, cdcWalPath=db/wal/cdc, cdcEnabled=false, metricsEnabled=false, walMode=LOG_ONLY, walTlbSize=131072, walBuffSize=0, walFlushFreq=2000, walFsyncDelay=1000, walRecordIterBuffSize=67108864, alwaysWriteFullPages=false, fileIOFactory=org.apache.ignite.internal.processors.cache.persistence.file.AsyncFileIOFactory@4e086048, metricsSubIntervalCnt=5, metricsRateTimeInterval=60000, walAutoArchiveAfterInactivity=-1, walForceArchiveTimeout=-1, writeThrottlingEnabled=false, walCompactionEnabled=false, walCompactionLevel=1, checkpointReadLockTimeout=null, walPageCompression=DISABLED, walPageCompressionLevel=null, dfltWarmUpCfg=null, encCfg=org.apache.ignite.configuration.EncryptionConfiguration@31a8b689, defragmentationThreadPoolSize=4, minWalArchiveSize=-1], snapshotPath=snapshots, activeOnStart=true, activeOnStartPropSetFlag=false, autoActivation=true, autoActivationPropSetFlag=false, clusterStateOnStart=null, sqlConnCfg=null, cliConnCfg=ClientConnectorConfiguration [host=null, port=10800, portRange=100, sockSndBufSize=0, sockRcvBufSize=0, tcpNoDelay=true, maxOpenCursorsPerConn=128, threadPoolSize=24, selectorCnt=12, idleTimeout=0, handshakeTimeout=10000, jdbcEnabled=true, odbcEnabled=true, thinCliEnabled=true, sslEnabled=false, useIgniteSslCtxFactory=true, sslClientAuth=false, sslCtxFactory=null, thinCliCfg=ThinClientConfiguration [maxActiveTxPerConn=100, maxActiveComputeTasksPerConn=0]], mvccVacuumThreadCnt=2, mvccVacuumFreq=5000, authEnabled=false, failureHnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]], commFailureRslvr=null, sqlCfg=SqlConfiguration [longQryWarnTimeout=3000, dfltQryTimeout=0, sqlQryHistSize=1000, validationEnabled=false], asyncContinuationExecutor=null] [21:14:41] : [Step 4/5] [2021-11-19 21:14:41,780][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-2] Daemon mode: off [21:14:41] : [Step 4/5] [2021-11-19 21:14:41,780][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-2] OS: Linux 4.15.0-151-generic amd64 [21:14:41] : [Step 4/5] [2021-11-19 21:14:41,780][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-2] OS user: teamcity [21:14:41] : [Step 4/5] [2021-11-19 21:14:41,781][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-2] PID: 16724 [21:14:41] : [Step 4/5] [2021-11-19 21:14:41,781][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-2] Language runtime: Java Platform API Specification ver. 1.8 [21:14:41] : [Step 4/5] [2021-11-19 21:14:41,781][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-2] VM information: Java(TM) SE Runtime Environment 1.8.0_261-b12 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 25.261-b12 [21:14:41] : [Step 4/5] [2021-11-19 21:14:41,782][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-2] VM total memory: 1.9GB [21:14:41] : [Step 4/5] [2021-11-19 21:14:41,782][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-2] Remote Management [restart: off, REST: off, JMX (remote: off)] [21:14:41] : [Step 4/5] [2021-11-19 21:14:41,782][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-2] Logger: GridTestLog4jLogger [quiet=false, config=null] [21:14:41] : [Step 4/5] [2021-11-19 21:14:41,783][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-2] IGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c [21:14:41] : [Step 4/5] [2021-11-19 21:14:41,783][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-2] VM arguments: [-DIGNITE_DUMP_THREADS_ON_FAILURE=false, -DMono=/usr/bin/mono-sgen, -DMono4.0_x64=/usr/lib/mono/4.0, -DMono4.5_x64=/usr/lib/mono/4.5, -DMonoVersion=6.12.0.90, -DSKIP_BUILD=false, -Dagent.home.dir=/opt/buildagent, -Dagent.name=aitc-lin02_03, -Dagent.ownPort=9090, -Dagent.work.dir=/opt/buildagent/work, -Dbuild.number=95, -Dbuild.vcs.number=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.1=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.GitHubApacheIgnite=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dclassworlds.conf=/opt/buildagent/temp/buildTmp/teamcity.m2.conf, -Dcom.jetbrains.maven.watcher.report.file=/opt/buildagent/temp/buildTmp/maven-build-info.xml, -Djava.io.tmpdir=/opt/buildagent/temp/buildTmp, -Dmaven.home=/opt/buildagent/tools/maven3_6, -Dmaven.multiModuleProjectDirectory=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.agent.cpuBenchmark=457, -Dteamcity.agent.dotnet.agent_url=http://localhost:9090/RPC2, -Dteamcity.agent.dotnet.build_id=6278078, -Dteamcity.auth.password=*******, -Dteamcity.auth.userId=TeamCityBuildId=6278078, -Dteamcity.build.changedFiles.file=/opt/buildagent/temp/buildTmp/changedFiles6342607772318147725.txt, -Dteamcity.build.checkoutDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.build.id=6278078, -Dteamcity.build.properties.file=/opt/buildagent/temp/buildTmp/teamcity.build5164517880467851002.properties, -Dteamcity.build.tempDir=/opt/buildagent/temp/buildTmp, -Dteamcity.build.workingDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.buildConfName=Basic 3, -Dteamcity.buildType.id=IgniteTests24Java8_Basic3, -Dteamcity.configuration.properties.file=/opt/buildagent/temp/buildTmp/teamcity.config5591980786735343870.properties, -Dteamcity.maven.userSettings.path=/opt/buildagent/temp/buildTmp/maven_settings_585072866407032347.xml, -Dteamcity.maven.watcher.home=/opt/buildagent/plugins/mavenPlugin/maven-watcher-jdk16, -Dteamcity.projectName=Ignite Tests 2.x (JDK 8/11), -Dteamcity.runner.properties.file=/opt/buildagent/temp/buildTmp/teamcity.runner9098465561618137420.properties, -Dteamcity.tests.recentlyFailedTests.file=/opt/buildagent/temp/buildTmp/testsToRunFirst3891775683130404069.txt, -Dteamcity.version=2021.2 (build 99542), -ea, -Xms2g, -Xmx2g, -XX:+HeapDumpOnOutOfMemoryError, -DIGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_TEST_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_UPDATE_NOTIFIER=false, -DIGNITE_NO_DISCO_ORDER=true, -DIGNITE_PERFORMANCE_SUGGESTIONS_DISABLED=true, -Djava.net.preferIPv4Stack=true, -DTEST_SCALE_FACTOR=1.0, -DIGNITE_TEST_PROP_LOG4J_FILE=log4j-tc-test.xml, -DIGNITE_QUIET=false, -DIGNITE_MARSHAL_BUFFERS_RECHECK=1000, -Dmaven.repo.local=/opt/buildagent/.m2/repository] [21:14:41] : [Step 4/5] [2021-11-19 21:14:41,788][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-2] System cache's DataRegion size is configured to 40 MB. Use DataStorageConfiguration.systemRegionInitialSize property to change the setting. [21:14:41] : [Step 4/5] [2021-11-19 21:14:41,788][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-2] Configured caches [in 'sysMemPlc' dataRegion: ['ignite-sys-cache']] [21:14:41]W: [org.apache.ignite:ignite-core] [2021-11-19 21:14:41,788][WARN ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-2] Peer class loading is enabled (disable it in production for performance and deployment consistency reasons) [21:14:41] : [Step 4/5] [2021-11-19 21:14:41,789][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-2] 3-rd party licenses can be found at: /opt/buildagent/work/7bc1c54bc719b67c/libs/licenses [21:14:41] : [Step 4/5] [2021-11-19 21:14:41,793][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] Configured plugins: [21:14:41] : [Step 4/5] [2021-11-19 21:14:41,794][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- StanByClusterTestProvider 1.0 [21:14:41] : [Step 4/5] [2021-11-19 21:14:41,794][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:14:41] : [Step 4/5] [2021-11-19 21:14:41,794][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] [21:14:41] : [Step 4/5] [2021-11-19 21:14:41,794][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- PageMemory tracker plugin 1.0 [21:14:41] : [Step 4/5] [2021-11-19 21:14:41,795][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:14:41] : [Step 4/5] [2021-11-19 21:14:41,795][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] [21:14:41] : [Step 4/5] [2021-11-19 21:14:41,795][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- TestDistibutedConfigurationPlugin 1.0 [21:14:41] : [Step 4/5] [2021-11-19 21:14:41,795][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:14:41] : [Step 4/5] [2021-11-19 21:14:41,795][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] [21:14:41] : [Step 4/5] [2021-11-19 21:14:41,796][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- NodeValidationPluginProvider 1.0 [21:14:41] : [Step 4/5] [2021-11-19 21:14:41,796][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:14:41] : [Step 4/5] [2021-11-19 21:14:41,796][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] [21:14:41] : [Step 4/5] [2021-11-19 21:14:41,796][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][FailureProcessor] Configured failure handler: [hnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]]] [21:14:41] : [Step 4/5] [2021-11-19 21:14:41,847][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][TestRecordingCommunicationSpi] Successfully bound communication NIO server to TCP port [port=47102, locHost=/127.0.0.1, selectorsCnt=12, selectorSpins=0, pairedConn=false] [21:14:41]W: [org.apache.ignite:ignite-core] [2021-11-19 21:14:41,995][WARN ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][TestRecordingCommunicationSpi] Message queue limit is set to 0 which may lead to potential OOMEs when running cache operations in FULL_ASYNC or PRIMARY_SYNC modes due to message queues growth on sender and receiver sides. [21:14:42] : [Step 4/5] [2021-11-19 21:14:42,010][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][GridCollisionManager] Collision resolution is disabled (all jobs will be activated upon arrival). [21:14:42] : [Step 4/5] [2021-11-19 21:14:42,010][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-2] Security status [authentication=off, sandbox=off, tls/ssl=off] [21:14:42] : [Step 4/5] [2021-11-19 21:14:42,073][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:14:42] : [Step 4/5] [2021-11-19 21:14:42,228][INFO ][db-checkpoint-thread-#24738%grid-1%][Checkpointer] Checkpoint started [checkpointId=5fa5dc22-2040-4296-9766-01617ecf3f24, startPtr=WALPointer [idx=0, fileOff=86657, len=1963], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=130ms, writeCheckpointEntryDuration=358ms, splitAndSortCpPagesDuration=0ms, pages=18, reason='node started'] [21:14:42] : [Step 4/5] [2021-11-19 21:14:42,228][INFO ][db-checkpoint-thread-#24736%grid-0%][Checkpointer] Checkpoint started [checkpointId=f43ec8c1-8f66-468d-858b-8f7c121dd4db, startPtr=WALPointer [idx=0, fileOff=86657, len=1963], checkpointBeforeLockTime=10ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=1ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=130ms, writeCheckpointEntryDuration=358ms, splitAndSortCpPagesDuration=0ms, pages=18, reason='node started'] [21:14:42] : [Step 4/5] [2021-11-19 21:14:42,358][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][MaintenanceProcessor] Resolved store directory for node persistent data: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_2 [21:14:42] : [Step 4/5] [2021-11-19 21:14:42,360][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][CacheObjectBinaryProcessorImpl] Resolved directory for serialized binary metadata: /opt/buildagent/work/7bc1c54bc719b67c/work/db/binary_meta/grid_2 [21:14:42] : [Step 4/5] [2021-11-19 21:14:42,365][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_2 [21:14:42] : [Step 4/5] [2021-11-19 21:14:42,365][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][FileWriteAheadLogManager] Resolved write ahead log work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_2 [21:14:42] : [Step 4/5] [2021-11-19 21:14:42,366][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][FileWriteAheadLogManager] Resolved write ahead log archive directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_2 [21:14:42] : [Step 4/5] [2021-11-19 21:14:42,560][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_2/0000000000000000.wal [21:14:42] : [Step 4/5] [2021-11-19 21:14:42,561][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][FileHandleManagerImpl] Initialized write-ahead log manager [mode=LOG_ONLY] [21:14:42] : [Step 4/5] [2021-11-19 21:14:42,567][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Configured data regions initialized successfully [total=5] [21:14:42] : [Step 4/5] [2021-11-19 21:14:42,977][INFO ][db-checkpoint-thread-#24738%grid-1%][Checkpointer] Checkpoint finished [cpId=5fa5dc22-2040-4296-9766-01617ecf3f24, pages=18, markPos=WALPointer [idx=0, fileOff=86657, len=1963], walSegmentsCovered=[], markDuration=489ms, pagesWrite=7ms, fsync=741ms, total=1238ms] [21:14:42] : [Step 4/5] [2021-11-19 21:14:42,977][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][IgniteSnapshotManager] Resolved snapshot work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/snapshots [21:14:42] : [Step 4/5] [2021-11-19 21:14:42,977][INFO ][db-checkpoint-thread-#24736%grid-0%][Checkpointer] Checkpoint finished [cpId=f43ec8c1-8f66-468d-858b-8f7c121dd4db, pages=18, markPos=WALPointer [idx=0, fileOff=86657, len=1963], walSegmentsCovered=[], markDuration=491ms, pagesWrite=6ms, fsync=741ms, total=1248ms] [21:14:42] : [Step 4/5] [2021-11-19 21:14:42,978][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][IgniteSnapshotManager] Resolved temp directory for snapshot creation: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_2/snp [21:14:42] : [Step 4/5] [2021-11-19 21:14:42,982][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][ClientListenerProcessor] Client connector processor has started on TCP port 10802 [21:14:42] : [Step 4/5] [2021-11-19 21:14:42,985][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-2] Non-loopback local IPs: 172.17.0.4 [21:14:42] : [Step 4/5] [2021-11-19 21:14:42,985][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-2] Enabled local MACs: 0242AC110004 [21:14:42] : [Step 4/5] [2021-11-19 21:14:42,986][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:14:42] : [Step 4/5] [2021-11-19 21:14:42,987][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:14:42] : [Step 4/5] [2021-11-19 21:14:42,988][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:14:42] : [Step 4/5] [2021-11-19 21:14:42,991][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Applying lost metastore updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:14:42] : [Step 4/5] [2021-11-19 21:14:42,993][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=0 ms] [21:14:42] : [Step 4/5] [2021-11-19 21:14:42,993][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Restoring partition state for local groups. [21:14:42] : [Step 4/5] [2021-11-19 21:14:42,993][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=0, partitionsProcessed=0, time=0ms] [21:14:42] : [Step 4/5] [2021-11-19 21:14:42,994][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][GridEncryptionManager] Encryption keys loaded from metastore. [grps=, masterKeyName=ignite.master.key] [21:14:42] : [Step 4/5] [2021-11-19 21:14:42,995][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][ClusterProcessor] Cluster ID and tag has been read from metastorage: null [21:14:42] : [Step 4/5] [2021-11-19 21:14:42,995][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][IgniteClusterImpl] Shutdown policy was updated [oldVal=null, newVal=null] [21:14:42] : [Step 4/5] [2021-11-19 21:14:42,996][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Checkpoint frequency deviation changed [oldVal=null, newVal=null] [21:14:43] : [Step 4/5] [2021-11-19 21:14:43,397][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][FilePageStoreManager] Cleanup cache stores [total=1, left=0, cleanFiles=false] [21:14:43] : [Step 4/5] [2021-11-19 21:14:43,399][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:14:43] : [Step 4/5] [2021-11-19 21:14:43,400][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:14:43] : [Step 4/5] [2021-11-19 21:14:43,402][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:14:43] : [Step 4/5] [2021-11-19 21:14:43,403][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Data Regions Started: 5 [21:14:43] : [Step 4/5] [2021-11-19 21:14:43,403][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] ^-- sysMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:14:43] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:14:43] : [Step 4/5] ^-- default region [type=default, persistence=true, lazyAlloc=true, [21:14:43] : [Step 4/5] ... initCfg=100MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB, allocTotal=0MB] [21:14:43] : [Step 4/5] ^-- metastoreMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:14:43] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:14:43] : [Step 4/5] ^-- TxLog region [type=internal, persistence=true, lazyAlloc=false, [21:14:43] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:14:43] : [Step 4/5] ^-- volatileDsMemPlc region [type=user, persistence=false, lazyAlloc=true, [21:14:43] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB] [21:14:43] : [Step 4/5] ^-- Ignite persistence [used=0MB] [21:14:43] : [Step 4/5] [21:14:43] : [Step 4/5] [2021-11-19 21:14:43,405][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Starting binary memory restore for: [-2100569601] [21:14:43] : [Step 4/5] [2021-11-19 21:14:43,476][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:14:43] : [Step 4/5] [2021-11-19 21:14:43,476][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:14:43] : [Step 4/5] [2021-11-19 21:14:43,481][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_2/0000000000000000.wal, offset=0, ver=2] [21:14:43] : [Step 4/5] [2021-11-19 21:14:43,489][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Started cache in recovery mode [name=ignite-sys-cache, id=-2100569601, dataRegionName=sysMemPlc, mode=REPLICATED, atomicity=TRANSACTIONAL, backups=2147483647, mvcc=false] [21:14:43] : [Step 4/5] [2021-11-19 21:14:43,490][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Binary recovery performed in 85 ms. [21:14:43] : [Step 4/5] [2021-11-19 21:14:43,491][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:14:43] : [Step 4/5] [2021-11-19 21:14:43,491][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Applying lost cache updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:14:43] : [Step 4/5] [2021-11-19 21:14:43,494][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=10 ms] [21:14:43] : [Step 4/5] [2021-11-19 21:14:43,494][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Restoring partition state for local groups. [21:14:43] : [Step 4/5] [2021-11-19 21:14:43,514][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=1, partitionsProcessed=100, time=20ms] [21:14:43] : [Step 4/5] [2021-11-19 21:14:43,539][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][TestTcpDiscoverySpi] Successfully bound to TCP port [port=47502, localHost=localhost/127.0.0.1, locNodeId=20f7c8ec-4982-4877-b5fe-1a8056d0a002] [21:14:43] : [Step 4/5] [2021-11-19 21:14:43,543][INFO ][tcp-disco-srvr-[:47501]-#1293%grid-1%-#24718%grid-1%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=33953] [21:14:43] : [Step 4/5] [2021-11-19 21:14:43,544][INFO ][tcp-disco-srvr-[:47501]-#1293%grid-1%-#24718%grid-1%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=33953] [21:14:43] : [Step 4/5] [2021-11-19 21:14:43,544][INFO ][tcp-disco-sock-reader-[]-#1303%grid-1%-#24869%grid-1%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:33953, rmtPort=33953] [21:14:43] : [Step 4/5] [2021-11-19 21:14:43,545][INFO ][tcp-disco-sock-reader-[20f7c8ec 127.0.0.1:33953]-#1303%grid-1%-#24869%grid-1%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=20f7c8ec-4982-4877-b5fe-1a8056d0a002, rmtAddr=/127.0.0.1:33953] [21:14:43] : [Step 4/5] [2021-11-19 21:14:43,547][INFO ][tcp-disco-srvr-[:47502]-#1302%grid-2%-#24868%grid-2%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=57055] [21:14:43] : [Step 4/5] [2021-11-19 21:14:43,548][INFO ][tcp-disco-srvr-[:47502]-#1302%grid-2%-#24868%grid-2%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=57055] [21:14:43] : [Step 4/5] [2021-11-19 21:14:43,549][INFO ][tcp-disco-sock-reader-[]-#1304%grid-2%-#24870%grid-2%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:57055, rmtPort=57055] [21:14:43] : [Step 4/5] [2021-11-19 21:14:43,549][INFO ][tcp-disco-sock-reader-[]-#1304%grid-2%-#24870%grid-2%][TestTcpDiscoverySpi] Received ping request from the remote node [rmtNodeId=101bb674-658f-4b57-86e7-a6f4cb062001, rmtAddr=/127.0.0.1:57055, rmtPort=57055] [21:14:43] : [Step 4/5] [2021-11-19 21:14:43,550][INFO ][tcp-disco-sock-reader-[]-#1304%grid-2%-#24870%grid-2%][TestTcpDiscoverySpi] Finished writing ping response [rmtNodeId=101bb674-658f-4b57-86e7-a6f4cb062001, rmtAddr=/127.0.0.1:57055, rmtPort=57055] [21:14:43] : [Step 4/5] [2021-11-19 21:14:43,550][INFO ][tcp-disco-sock-reader-[20f7c8ec 127.0.0.1:33953]-#1303%grid-1%-#24869%grid-1%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:33953, rmtPort=33953, rmtNodeId=20f7c8ec-4982-4877-b5fe-1a8056d0a002] [21:14:43] : [Step 4/5] [2021-11-19 21:14:43,551][INFO ][tcp-disco-sock-reader-[]-#1304%grid-2%-#24870%grid-2%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:57055, rmtPort=57055, rmtNodeId=null] [21:14:43] : [Step 4/5] [2021-11-19 21:14:43,553][INFO ][tcp-disco-msg-worker-[101bb674 127.0.0.1:47501 crd]-#1287%grid-0%-#24598%grid-0%][GridEncryptionManager] Joining node doesn't have stored group keys [node=20f7c8ec-4982-4877-b5fe-1a8056d0a002] [21:14:43] : [Step 4/5] [2021-11-19 21:14:43,563][INFO ][tcp-disco-msg-worker-[007e61a0 127.0.0.1:47500]-#1292%grid-1%-#24717%grid-1%][TestTcpDiscoverySpi] New next node [newNext=TcpDiscoveryNode [id=20f7c8ec-4982-4877-b5fe-1a8056d0a002, consistentId=grid-2, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47502], discPort=47502, order=0, intOrder=3, lastExchangeTime=1637345683553, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false]] [21:14:43] : [Step 4/5] [2021-11-19 21:14:43,564][INFO ][tcp-disco-sock-reader-[101bb674 127.0.0.1:40739]-#1297%grid-0%-#24722%grid-0%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:40739, rmtPort=40739, rmtNodeId=101bb674-658f-4b57-86e7-a6f4cb062001] [21:14:43] : [Step 4/5] [2021-11-19 21:14:43,564][INFO ][tcp-disco-srvr-[:47502]-#1302%grid-2%-#24868%grid-2%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=42097] [21:14:43] : [Step 4/5] [2021-11-19 21:14:43,565][INFO ][tcp-disco-srvr-[:47502]-#1302%grid-2%-#24868%grid-2%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=42097] [21:14:43] : [Step 4/5] [2021-11-19 21:14:43,566][INFO ][tcp-disco-sock-reader-[]-#1305%grid-2%-#24871%grid-2%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:42097, rmtPort=42097] [21:14:43] : [Step 4/5] [2021-11-19 21:14:43,567][INFO ][tcp-disco-sock-reader-[101bb674 127.0.0.1:42097]-#1305%grid-2%-#24871%grid-2%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=101bb674-658f-4b57-86e7-a6f4cb062001, rmtAddr=/127.0.0.1:42097] [21:14:43] : [Step 4/5] [2021-11-19 21:14:43,570][INFO ][tcp-disco-msg-worker-[]-#1301%grid-2%-#24867%grid-2%][TestTcpDiscoverySpi] New next node [newNext=TcpDiscoveryNode [id=007e61a0-a40a-4876-9e77-e092fe5c2000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345683563, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false]] [21:14:43] : [Step 4/5] [2021-11-19 21:14:43,572][INFO ][tcp-disco-srvr-[:47500]-#1288%grid-0%-#24599%grid-0%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=38145] [21:14:43] : [Step 4/5] [2021-11-19 21:14:43,572][INFO ][tcp-disco-srvr-[:47500]-#1288%grid-0%-#24599%grid-0%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=38145] [21:14:43] : [Step 4/5] [2021-11-19 21:14:43,573][INFO ][tcp-disco-sock-reader-[]-#1306%grid-0%-#24872%grid-0%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:38145, rmtPort=38145] [21:14:43] : [Step 4/5] [2021-11-19 21:14:43,574][INFO ][tcp-disco-sock-reader-[20f7c8ec 127.0.0.1:38145]-#1306%grid-0%-#24872%grid-0%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=20f7c8ec-4982-4877-b5fe-1a8056d0a002, rmtAddr=/127.0.0.1:38145] [21:14:43] : [Step 4/5] [2021-11-19 21:14:43,577][INFO ][disco-event-worker-#24601%grid-0%][GridDiscoveryManager] Added new node to topology: TcpDiscoveryNode [id=20f7c8ec-4982-4877-b5fe-1a8056d0a002, consistentId=grid-2, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47502], discPort=47502, order=3, intOrder=3, lastExchangeTime=1637345683543, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false] [21:14:43] : [Step 4/5] [2021-11-19 21:14:43,578][INFO ][disco-event-worker-#24724%grid-1%][GridDiscoveryManager] Added new node to topology: TcpDiscoveryNode [id=20f7c8ec-4982-4877-b5fe-1a8056d0a002, consistentId=grid-2, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47502], discPort=47502, order=3, intOrder=3, lastExchangeTime=1637345683553, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false] [21:14:43] : [Step 4/5] [2021-11-19 21:14:43,578][INFO ][disco-event-worker-#24601%grid-0%][GridDiscoveryManager] Topology snapshot [ver=3, locNode=007e61a0, servers=3, clients=0, state=ACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=007e61a0-a40a-4876-9e77-e092fe5c2000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=101bb674-658f-4b57-86e7-a6f4cb062001, consistentId=grid-1, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=20f7c8ec-4982-4877-b5fe-1a8056d0a002, consistentId=grid-2, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:14:43] : [Step 4/5] [2021-11-19 21:14:43,579][INFO ][disco-event-worker-#24724%grid-1%][GridDiscoveryManager] Topology snapshot [ver=3, locNode=101bb674, servers=3, clients=0, state=ACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=007e61a0-a40a-4876-9e77-e092fe5c2000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=101bb674-658f-4b57-86e7-a6f4cb062001, consistentId=grid-1, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=20f7c8ec-4982-4877-b5fe-1a8056d0a002, consistentId=grid-2, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:14:43] : [Step 4/5] [2021-11-19 21:14:43,580][INFO ][disco-event-worker-#24601%grid-0%][GridDiscoveryManager] ^-- Baseline [id=0, size=2, online=2, offline=0] [21:14:43] : [Step 4/5] [2021-11-19 21:14:43,581][INFO ][disco-event-worker-#24724%grid-1%][GridDiscoveryManager] ^-- Baseline [id=0, size=2, online=2, offline=0] [21:14:43] : [Step 4/5] [2021-11-19 21:14:43,582][INFO ][exchange-worker-#24602%grid-0%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], crd=true, evt=NODE_JOINED, evtNode=20f7c8ec-4982-4877-b5fe-1a8056d0a002, customEvt=null, allowMerge=true, exchangeFreeSwitch=false] [21:14:43] : [Step 4/5] [2021-11-19 21:14:43,582][INFO ][exchange-worker-#24725%grid-1%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], crd=false, evt=NODE_JOINED, evtNode=20f7c8ec-4982-4877-b5fe-1a8056d0a002, customEvt=null, allowMerge=true, exchangeFreeSwitch=false] [21:14:43] : [Step 4/5] [2021-11-19 21:14:43,582][INFO ][exchange-worker-#24602%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], waitTime=0ms, futInfo=NA, mode=DISTRIBUTED] [21:14:43] : [Step 4/5] [2021-11-19 21:14:43,583][INFO ][exchange-worker-#24725%grid-1%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], waitTime=0ms, futInfo=NA, mode=DISTRIBUTED] [21:14:43] : [Step 4/5] [2021-11-19 21:14:43,584][INFO ][exchange-worker-#24602%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partitions release latch: ServerLatch [permits=0, pendingAcks=HashSet [], super=CompletableLatch [id=CompletableLatchUid [id=exchange, topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0]]]] [21:14:43] : [Step 4/5] [2021-11-19 21:14:43,585][INFO ][exchange-worker-#24602%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:14:43] : [Step 4/5] [2021-11-19 21:14:43,583][INFO ][tcp-disco-msg-worker-[007e61a0 127.0.0.1:47500]-#1301%grid-2%-#24867%grid-2%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustEnabled' was changed from 'null' to 'false' [21:14:43] : [Step 4/5] [2021-11-19 21:14:43,586][INFO ][exchange-worker-#24602%grid-0%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], crd=true] [21:14:43] : [Step 4/5] [2021-11-19 21:14:43,585][INFO ][exchange-worker-#24725%grid-1%][GridDhtPartitionsExchangeFuture] Finished waiting for partitions release latch: ClientLatch [coordinator=TcpDiscoveryNode [id=007e61a0-a40a-4876-9e77-e092fe5c2000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345681650, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], ackSent=true, super=CompletableLatch [id=CompletableLatchUid [id=exchange, topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0]]]] [21:14:43] : [Step 4/5] [2021-11-19 21:14:43,586][INFO ][tcp-disco-msg-worker-[007e61a0 127.0.0.1:47500]-#1301%grid-2%-#24867%grid-2%][ClusterProcessor] cranky_darwin [21:14:43] : [Step 4/5] [2021-11-19 21:14:43,588][INFO ][tcp-disco-msg-worker-[007e61a0 127.0.0.1:47500]-#1301%grid-2%-#24867%grid-2%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustTimeout' was changed from 'null' to '300000' [21:14:43] : [Step 4/5] [2021-11-19 21:14:43,587][INFO ][exchange-worker-#24725%grid-1%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:14:43] : [Step 4/5] [2021-11-19 21:14:43,588][INFO ][tcp-disco-msg-worker-[007e61a0 127.0.0.1:47500]-#1301%grid-2%-#24867%grid-2%][IgniteTxManager] Transactions parameter 'longOperationsDumpTimeout' was changed from 'null' to '60000' [21:14:43] : [Step 4/5] [2021-11-19 21:14:43,589][INFO ][tcp-disco-msg-worker-[007e61a0 127.0.0.1:47500]-#1301%grid-2%-#24867%grid-2%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpThreshold' was changed from 'null' to '0' [21:14:43] : [Step 4/5] [2021-11-19 21:14:43,589][INFO ][exchange-worker-#24725%grid-1%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], crd=false] [21:14:43] : [Step 4/5] [2021-11-19 21:14:43,590][INFO ][sys-#24596%grid-0%][GridDhtPartitionsExchangeFuture] Coordinator received single message [ver=AffinityTopologyVersion [topVer=3, minorTopVer=0], node=101bb674-658f-4b57-86e7-a6f4cb062001, remainingNodes=1, allReceived=false] [21:14:43] : [Step 4/5] [2021-11-19 21:14:43,590][INFO ][tcp-disco-msg-worker-[007e61a0 127.0.0.1:47500]-#1301%grid-2%-#24867%grid-2%][IgniteTxManager] Transactions parameter 'transactionTimeDumpSamplesCoefficient' was changed from 'null' to '0.0' [21:14:43] : [Step 4/5] [2021-11-19 21:14:43,591][INFO ][tcp-disco-msg-worker-[007e61a0 127.0.0.1:47500]-#1301%grid-2%-#24867%grid-2%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpSamplesPerSecondLimit' was changed from 'null' to '5' [21:14:43] : [Step 4/5] [2021-11-19 21:14:43,591][INFO ][tcp-disco-msg-worker-[007e61a0 127.0.0.1:47500]-#1301%grid-2%-#24867%grid-2%][IgniteTxManager] Transactions parameter 'collisionsDumpInterval' was changed from 'null' to '1000' [21:14:43] : [Step 4/5] [2021-11-19 21:14:43,592][INFO ][tcp-disco-msg-worker-[007e61a0 127.0.0.1:47500]-#1301%grid-2%-#24867%grid-2%][IgniteTxManager] Transactions parameter 'txOwnerDumpRequestsAllowed' was changed from 'null' to 'true' [21:14:43] : [Step 4/5] [2021-11-19 21:14:43,593][INFO ][tcp-disco-msg-worker-[007e61a0 127.0.0.1:47500]-#1301%grid-2%-#24867%grid-2%][GridCacheDatabaseSharedManager] Historical rebalance WAL threshold changed [property=historical.rebalance.threshold, oldVal=null, newVal=500] [21:14:43] : [Step 4/5] [2021-11-19 21:14:43,594][INFO ][disco-notifier-worker-#24866%grid-2%][MvccProcessorImpl] Assigned mvcc coordinator [crd=MvccCoordinator [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], nodeId=007e61a0-a40a-4876-9e77-e092fe5c2000, ver=1637345680040, local=false, initialized=false]] [21:14:43] : [Step 4/5] [2021-11-19 21:14:43,594][INFO ][disco-notifier-worker-#24866%grid-2%][GridClusterStateProcessor] Local node is not included in Baseline Topology and will not be used for data storage. Use control.(sh|bat) script or IgniteCluster interface to include the node to Baseline Topology. [21:14:43] : [Step 4/5] [2021-11-19 21:14:43,597][INFO ][sys-#24865%grid-2%][ClusterProcessor] Writing cluster ID and tag to metastorage on ready for write ClusterIdAndTag [id=b67f5159-9231-44d3-a424-19e9051439ca, tag=cranky_darwin] [21:14:43] : [Step 4/5] [2021-11-19 21:14:43,612][INFO ][exchange-worker-#24875%grid-2%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], crd=false, evt=NODE_JOINED, evtNode=20f7c8ec-4982-4877-b5fe-1a8056d0a002, customEvt=null, allowMerge=true, exchangeFreeSwitch=false] [21:14:43] : [Step 4/5] [2021-11-19 21:14:43,613][INFO ][exchange-worker-#24875%grid-2%][GridCacheProcessor] Stopped cache [cacheName=ignite-sys-cache] [21:14:43] : [Step 4/5] [2021-11-19 21:14:43,613][INFO ][exchange-worker-#24875%grid-2%][GridCacheDatabaseSharedManager] Page memory sysMemPlc for CacheGroupDescriptor [grpId=-2100569601, grpName=null, startTopVer=null, rcvdFrom=007e61a0-a40a-4876-9e77-e092fe5c2000, deploymentId=29d2e593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, caches=SingletonMap {ignite-sys-cache=-2100569601}, rcvdFromVer=null, persistenceEnabled=true, walEnabled=true, cacheCfgEnrichment=CacheConfigurationEnrichment [fieldClassNames=HashMap {storeFactory=null, storeSesLsnrs=null, evictFilter=null, interceptor=null, evictPlcFactory=null}], cacheCfgEnriched=false, cacheName=ignite-sys-cache] has invalidated. [21:14:43] : [Step 4/5] [2021-11-19 21:14:43,616][INFO ][exchange-worker-#24875%grid-2%][FilePageStoreManager] Cache stores cleanup started asynchronously [21:14:43] : [Step 4/5] [2021-11-19 21:14:43,616][INFO ][exchange-worker-#24875%grid-2%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_2 [21:14:43] : [Step 4/5] [2021-11-19 21:14:43,962][INFO ][async-file-store-cleanup-task-3-#24876%grid-2%][FilePageStoreManager] Cleanup cache stores [total=2, left=1, cleanFiles=true] [21:14:43] : [Step 4/5] [2021-11-19 21:14:43,969][INFO ][exchange-worker-#24875%grid-2%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_2/0000000000000000.wal, offset=8795, ver=2] [21:14:43] : [Step 4/5] [2021-11-19 21:14:43,971][INFO ][exchange-worker-#24875%grid-2%][GridClusterStateProcessor] Writing BaselineTopology[id=0] [21:14:43] : [Step 4/5] [2021-11-19 21:14:43,973][INFO ][exchange-worker-#24875%grid-2%][GridCacheDatabaseSharedManager] Finish recovery performed in 356 ms. [21:14:43] : [Step 4/5] [2021-11-19 21:14:43,975][INFO ][exchange-worker-#24875%grid-2%][msg] Components activation performed in 359 ms. [21:14:43] : [Step 4/5] [2021-11-19 21:14:43,986][INFO ][exchange-worker-#24875%grid-2%][GridCacheProcessor] Started cache [name=ignite-sys-cache, id=-2100569601, dataRegionName=sysMemPlc, mode=REPLICATED, atomicity=TRANSACTIONAL, backups=2147483647, mvcc=false] [21:14:43] : [Step 4/5] [2021-11-19 21:14:43,986][INFO ][exchange-worker-#24875%grid-2%][GridCacheProcessor] Starting caches on local join performed in 10 ms. [21:14:43] : [Step 4/5] [2021-11-19 21:14:43,987][INFO ][exchange-worker-#24875%grid-2%][GridDhtPartitionsExchangeFuture] Skipped waiting for partitions release future (local node is joining) [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0]] [21:14:43] : [Step 4/5] [2021-11-19 21:14:43,995][INFO ][grid-nio-worker-tcp-comm-1-#24541%TestRecordingCommunicationSpi%][TestRecordingCommunicationSpi] Accepted incoming communication connection [locAddr=/127.0.0.1:47100, rmtAddr=/127.0.0.1:35310] [21:14:43] : [Step 4/5] [2021-11-19 21:14:43,998][INFO ][grid-nio-worker-tcp-comm-0-#24801%TestRecordingCommunicationSpi%][TestRecordingCommunicationSpi] Established outgoing communication connection [locAddr=/127.0.0.1:35310, rmtAddr=/127.0.0.1:47100] [21:14:43] : [Step 4/5] [2021-11-19 21:14:43,998][INFO ][exchange-worker-#24875%grid-2%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], crd=false] [21:14:44] : [Step 4/5] [2021-11-19 21:14:43,999][INFO ][sys-#24575%grid-0%][GridDhtPartitionsExchangeFuture] Coordinator received single message [ver=AffinityTopologyVersion [topVer=3, minorTopVer=0], node=20f7c8ec-4982-4877-b5fe-1a8056d0a002, allReceived=true] [21:14:44] : [Step 4/5] [2021-11-19 21:14:43,999][INFO ][sys-#24575%grid-0%][GridDhtPartitionsExchangeFuture] Coordinator received all messages, try merge [ver=AffinityTopologyVersion [topVer=3, minorTopVer=0]] [21:14:44] : [Step 4/5] [2021-11-19 21:14:43,999][INFO ][sys-#24575%grid-0%][GridDhtPartitionsExchangeFuture] finishExchangeOnCoordinator [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=0]] [21:14:44] : [Step 4/5] [2021-11-19 21:14:44,004][INFO ][sys-#24575%grid-0%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], err=null, rebalanced=true, wasRebalanced=true] [21:14:44] : [Step 4/5] [2021-11-19 21:14:44,004][INFO ][sys-#24713%grid-1%][GridDhtPartitionsExchangeFuture] Received full message, will finish exchange [node=007e61a0-a40a-4876-9e77-e092fe5c2000, resVer=AffinityTopologyVersion [topVer=3, minorTopVer=0]] [21:14:44] : [Step 4/5] [2021-11-19 21:14:44,005][INFO ][sys-#24575%grid-0%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=007e61a0-a40a-4876-9e77-e092fe5c2000, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], evt=NODE_JOINED, evtNode=TcpDiscoveryNode [id=20f7c8ec-4982-4877-b5fe-1a8056d0a002, consistentId=grid-2, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47502], discPort=47502, order=3, intOrder=3, lastExchangeTime=1637345683543, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0]] [21:14:44] : [Step 4/5] [2021-11-19 21:14:44,005][INFO ][exchange-worker-#24602%grid-0%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=3, minorTopVer=0], force=false, evt=NODE_JOINED, node=20f7c8ec-4982-4877-b5fe-1a8056d0a002] [21:14:44] : [Step 4/5] [2021-11-19 21:14:44,006][INFO ][sys-#24575%grid-0%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (0 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Wait partitions release latch [latch=exchange]" (1 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="After states restored callback" (0 ms), stage="WAL history reservation" (0 ms), stage="Waiting for all single messages" (413 ms), stage="Exchanges merge" (0 ms), stage="Affinity recalculation (crd)" (1 ms), stage="Collect update counters and create affinity messages" (0 ms), stage="Assign partitions states" (0 ms), stage="Validate partitions states" (0 ms), stage="Apply update counters" (0 ms), stage="Full message preparing" (2 ms), stage="Full message sending" (0 ms), stage="Exchange done" (2 ms), stage="Total time" (419 ms), Discovery lag=13 ms, Latest started node id=20f7c8ec-4982-4877-b5fe-1a8056d0a002] [21:14:44] : [Step 4/5] [2021-11-19 21:14:44,006][INFO ][sys-#24713%grid-1%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], err=null, rebalanced=true, wasRebalanced=true] [21:14:44] : [Step 4/5] [2021-11-19 21:14:44,010][INFO ][sys-#24713%grid-1%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=101bb674-658f-4b57-86e7-a6f4cb062001, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], evt=NODE_JOINED, evtNode=TcpDiscoveryNode [id=20f7c8ec-4982-4877-b5fe-1a8056d0a002, consistentId=grid-2, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47502], discPort=47502, order=3, intOrder=3, lastExchangeTime=1637345683553, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0]] [21:14:44] : [Step 4/5] [2021-11-19 21:14:44,011][INFO ][sys-#24713%grid-1%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (1 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (1 ms), stage="Wait partitions release latch [latch=exchange]" (3 ms), stage="Wait partitions release [latch=exchange]" (1 ms), stage="After states restored callback" (0 ms), stage="WAL history reservation" (0 ms), stage="Waiting for Full message" (415 ms), stage="Affinity recalculation" (0 ms), stage="Full map updating" (0 ms), stage="Exchange done" (5 ms), stage="Total time" (426 ms)] [21:14:44] : [Step 4/5] [2021-11-19 21:14:44,005][INFO ][sys-#24848%grid-2%][GridDhtPartitionsExchangeFuture] Received full message, will finish exchange [node=007e61a0-a40a-4876-9e77-e092fe5c2000, resVer=AffinityTopologyVersion [topVer=3, minorTopVer=0]] [21:14:44] : [Step 4/5] [2021-11-19 21:14:44,013][INFO ][sys-#24713%grid-1%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], stage="Affinity initialization (node join) [grp=ignite-sys-cache, crd=false]" (0 ms) (parent=Affinity recalculation)] [21:14:44] : [Step 4/5] [2021-11-19 21:14:44,010][INFO ][exchange-worker-#24725%grid-1%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=3, minorTopVer=0], force=false, evt=NODE_JOINED, node=20f7c8ec-4982-4877-b5fe-1a8056d0a002] [21:14:44] : [Step 4/5] [2021-11-19 21:14:44,009][INFO ][sys-#24575%grid-0%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], stage="Affinity initialization (node join) [grp=ignite-sys-cache, crd=true]" (0 ms) (parent=Affinity recalculation (crd))] [21:14:44] : [Step 4/5] [2021-11-19 21:14:44,016][INFO ][sys-#24848%grid-2%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], err=null, rebalanced=true, wasRebalanced=false] [21:14:44] : [Step 4/5] [2021-11-19 21:14:44,018][INFO ][sys-#24848%grid-2%][GridCacheProcessor] Finish proxy initialization, cacheName=ignite-sys-cache, localNodeId=20f7c8ec-4982-4877-b5fe-1a8056d0a002 [21:14:44] : [Step 4/5] [2021-11-19 21:14:44,019][INFO ][sys-#24848%grid-2%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=20f7c8ec-4982-4877-b5fe-1a8056d0a002, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], evt=NODE_JOINED, evtNode=TcpDiscoveryNode [id=20f7c8ec-4982-4877-b5fe-1a8056d0a002, consistentId=grid-2, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47502], discPort=47502, order=3, intOrder=3, lastExchangeTime=1637345683593, loc=true, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0]] [21:14:44] : [Step 4/5] [2021-11-19 21:14:44,019][INFO ][exchange-worker-#24875%grid-2%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=3, minorTopVer=0], force=false, evt=NODE_JOINED, node=20f7c8ec-4982-4877-b5fe-1a8056d0a002] [21:14:44] : [Step 4/5] [2021-11-19 21:14:44,020][INFO ][sys-#24848%grid-2%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], stage="Waiting in exchange queue" (17 ms), stage="Exchange parameters initialization" (0 ms), stage="Baseline change callback" (3 ms), stage="Components activation" (358 ms), stage="Determine exchange type" (11 ms), stage="Preloading notification" (0 ms), stage="Restore partition states" (2 ms), stage="After states restored callback" (3 ms), stage="WAL history reservation" (0 ms), stage="Waiting for Full message" (12 ms), stage="Affinity recalculation" (10 ms), stage="Full map updating" (0 ms), stage="Exchange done" (4 ms), stage="Total time" (420 ms)] [21:14:44] : [Step 4/5] [2021-11-19 21:14:44,022][INFO ][sys-#24848%grid-2%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], stage="Affinity fetch" (11 ms) (parent=Determine exchange type), stage="Restore partition states [grp=ignite-sys-cache]" (2 ms) (parent=Restore partition states), stage="Affinity initialization (local join) [grp=ignite-sys-cache]" (10 ms) (parent=Affinity recalculation)] [21:14:44] : [Step 4/5] [2021-11-19 21:14:44,025][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-2] To start Console Management & Monitoring run ignitevisorcmd.{sh|bat} [21:14:44] : [Step 4/5] [2021-11-19 21:14:44,026][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-2] [21:14:44] : [Step 4/5] [21:14:44] : [Step 4/5] >>> +-------------------------------------------+ [21:14:44] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:14:44] : [Step 4/5] >>> +-------------------------------------------+ [21:14:44] : [Step 4/5] >>> OS name: Linux 4.15.0-151-generic amd64 [21:14:44] : [Step 4/5] >>> CPU(s): 24 [21:14:44] : [Step 4/5] >>> Heap: 2.0GB [21:14:44] : [Step 4/5] >>> VM name: 16724@c4dfe9a430b2 [21:14:44] : [Step 4/5] >>> Ignite instance name: grid-2 [21:14:44] : [Step 4/5] >>> Local node [ID=20F7C8EC-4982-4877-B5FE-1A8056D0A002, order=3, clientMode=false] [21:14:44] : [Step 4/5] >>> Local node addresses: [127.0.0.1] [21:14:44] : [Step 4/5] >>> Local ports: TCP:10802 TCP:47102 TCP:47502 [21:14:44] : [Step 4/5] [21:14:44] : [Step 4/5] [2021-11-19 21:14:44,027][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][GridDiscoveryManager] Topology snapshot [ver=3, locNode=20f7c8ec, servers=3, clients=0, state=ACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=007e61a0-a40a-4876-9e77-e092fe5c2000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=101bb674-658f-4b57-86e7-a6f4cb062001, consistentId=grid-1, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=20f7c8ec-4982-4877-b5fe-1a8056d0a002, consistentId=grid-2, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:14:44] : [Step 4/5] [2021-11-19 21:14:44,028][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][GridDiscoveryManager] ^-- Baseline [id=0, size=2, online=2, offline=0] [21:14:44] : [Step 4/5] [2021-11-19 21:14:44,029][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][G] Node started : [stage="Configure system pool" (0 ms),stage="Start managers" (591 ms),stage="Configure binary metadata" (2 ms),stage="Start processors" (622 ms),stage="Start 'StanByClusterTestProvider' plugin" (0 ms),stage="Start 'PageMemory tracker plugin' plugin" (0 ms),stage="Start 'TestDistibutedConfigurationPlugin' plugin" (0 ms),stage="Start 'NodeValidationPluginProvider' plugin" (0 ms),stage="Init metastore" (413 ms),stage="Init and start regions" (7 ms),stage="Restore binary memory" (85 ms),stage="Restore logical state" (24 ms),stage="Finish recovery" (22 ms),stage="Join topology" (56 ms),stage="Await transition" (3 ms),stage="Await exchange" (430 ms),stage="Total time" (2255 ms)] [21:14:44] : [Step 4/5] [2021-11-19 21:14:44,030][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][root] Node started with the following configuration [id=20f7c8ec-4982-4877-b5fe-1a8056d0a002, marshaller=BinaryMarshaller [], discovery=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=5000, ackTimeout=5000, marsh=JdkMarshaller [clsFilter=org.apache.ignite.marshaller.MarshallerUtils$1@779439a1], reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], binaryCfg=null, lateAff=true] [21:14:44] : [Step 4/5] [2021-11-19 21:14:44,032][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][GridClusterStateProcessor] Sending activate cluster request with BaselineTopology BaselineTopology [id=1, branchingHash=-3712973250, branchingType='New BaselineTopology', baselineNodes=[grid-1, grid-2, grid-0]] [21:14:44] : [Step 4/5] [2021-11-19 21:14:44,034][INFO ][disco-notifier-worker-#24597%grid-0%][GridClusterStateProcessor] Received activate cluster request with BaselineTopology[id=1] initiator node ID: 101bb674-658f-4b57-86e7-a6f4cb062001 [21:14:44] : [Step 4/5] [2021-11-19 21:14:44,035][INFO ][disco-notifier-worker-#24597%grid-0%][GridClusterStateProcessor] Started state transition: activate cluster [21:14:44] : [Step 4/5] [2021-11-19 21:14:44,035][INFO ][exchange-worker-#24602%grid-0%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], crd=true, evt=DISCOVERY_CUSTOM_EVT, evtNode=101bb674-658f-4b57-86e7-a6f4cb062001, customEvt=ChangeGlobalStateMessage [id=bee2e593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqId=82a41e68-8b99-4739-96da-e0c9d10afc25, initiatingNodeId=101bb674-658f-4b57-86e7-a6f4cb062001, state=ACTIVE, baselineTopology=BaselineTopology [id=1, branchingHash=-3712973250, branchingType='New BaselineTopology', baselineNodes=[grid-1, grid-2, grid-0]], forceChangeBaselineTopology=true, timestamp=1637345684032, forceDeactivation=false], allowMerge=false, exchangeFreeSwitch=false] [21:14:44] : [Step 4/5] [2021-11-19 21:14:44,036][INFO ][disco-notifier-worker-#24716%grid-1%][GridClusterStateProcessor] Received activate cluster request with BaselineTopology[id=1] initiator node ID: 101bb674-658f-4b57-86e7-a6f4cb062001 [21:14:44] : [Step 4/5] [2021-11-19 21:14:44,037][INFO ][disco-notifier-worker-#24866%grid-2%][GridClusterStateProcessor] Received activate cluster request with BaselineTopology[id=1] initiator node ID: 101bb674-658f-4b57-86e7-a6f4cb062001 [21:14:44] : [Step 4/5] [2021-11-19 21:14:44,037][INFO ][exchange-worker-#24602%grid-0%][GridClusterStateProcessor] Writing BaselineTopology[id=1] [21:14:44] : [Step 4/5] [2021-11-19 21:14:44,038][INFO ][disco-notifier-worker-#24866%grid-2%][GridClusterStateProcessor] Started state transition: activate cluster [21:14:44] : [Step 4/5] [2021-11-19 21:14:44,037][INFO ][disco-notifier-worker-#24716%grid-1%][GridClusterStateProcessor] Started state transition: activate cluster [21:14:44] : [Step 4/5] [2021-11-19 21:14:44,038][INFO ][exchange-worker-#24875%grid-2%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], crd=false, evt=DISCOVERY_CUSTOM_EVT, evtNode=101bb674-658f-4b57-86e7-a6f4cb062001, customEvt=ChangeGlobalStateMessage [id=bee2e593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqId=82a41e68-8b99-4739-96da-e0c9d10afc25, initiatingNodeId=101bb674-658f-4b57-86e7-a6f4cb062001, state=ACTIVE, baselineTopology=BaselineTopology [id=1, branchingHash=-3712973250, branchingType='New BaselineTopology', baselineNodes=[grid-1, grid-2, grid-0]], forceChangeBaselineTopology=true, timestamp=1637345684032, forceDeactivation=false], allowMerge=false, exchangeFreeSwitch=false] [21:14:44] : [Step 4/5] [2021-11-19 21:14:44,038][INFO ][exchange-worker-#24602%grid-0%][GridClusterStateProcessor] Writing BaselineTopologyHistoryItem[id=0] [21:14:44] : [Step 4/5] [2021-11-19 21:14:44,040][INFO ][exchange-worker-#24875%grid-2%][GridClusterStateProcessor] Writing BaselineTopology[id=1] [21:14:44] : [Step 4/5] [2021-11-19 21:14:44,040][INFO ][exchange-worker-#24725%grid-1%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], crd=false, evt=DISCOVERY_CUSTOM_EVT, evtNode=101bb674-658f-4b57-86e7-a6f4cb062001, customEvt=ChangeGlobalStateMessage [id=bee2e593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqId=82a41e68-8b99-4739-96da-e0c9d10afc25, initiatingNodeId=101bb674-658f-4b57-86e7-a6f4cb062001, state=ACTIVE, baselineTopology=BaselineTopology [id=1, branchingHash=-3712973250, branchingType='New BaselineTopology', baselineNodes=[grid-1, grid-2, grid-0]], forceChangeBaselineTopology=true, timestamp=1637345684032, forceDeactivation=false], allowMerge=false, exchangeFreeSwitch=false] [21:14:44] : [Step 4/5] [2021-11-19 21:14:44,042][INFO ][exchange-worker-#24725%grid-1%][GridClusterStateProcessor] Writing BaselineTopology[id=1] [21:14:44] : [Step 4/5] [2021-11-19 21:14:44,042][INFO ][exchange-worker-#24725%grid-1%][GridClusterStateProcessor] Writing BaselineTopologyHistoryItem[id=0] [21:14:44] : [Step 4/5] [2021-11-19 21:14:44,043][INFO ][exchange-worker-#24602%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], waitTime=0ms, futInfo=NA, mode=DISTRIBUTED] [21:14:44] : [Step 4/5] [2021-11-19 21:14:44,043][INFO ][exchange-worker-#24725%grid-1%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], waitTime=0ms, futInfo=NA, mode=DISTRIBUTED] [21:14:44] : [Step 4/5] [2021-11-19 21:14:44,044][INFO ][exchange-worker-#24875%grid-2%][GridClusterStateProcessor] Writing BaselineTopologyHistoryItem[id=0] [21:14:44] : [Step 4/5] [2021-11-19 21:14:44,046][INFO ][exchange-worker-#24875%grid-2%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], waitTime=0ms, futInfo=NA, mode=DISTRIBUTED] [21:14:44] : [Step 4/5] [2021-11-19 21:14:44,047][INFO ][exchange-worker-#24602%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partitions release latch: ServerLatch [permits=0, pendingAcks=HashSet [], super=CompletableLatch [id=CompletableLatchUid [id=exchange, topVer=AffinityTopologyVersion [topVer=3, minorTopVer=1]]]] [21:14:44] : [Step 4/5] [2021-11-19 21:14:44,047][INFO ][exchange-worker-#24875%grid-2%][GridDhtPartitionsExchangeFuture] Finished waiting for partitions release latch: ClientLatch [coordinator=TcpDiscoveryNode [id=007e61a0-a40a-4876-9e77-e092fe5c2000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345683563, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], ackSent=true, super=CompletableLatch [id=CompletableLatchUid [id=exchange, topVer=AffinityTopologyVersion [topVer=3, minorTopVer=1]]]] [21:14:44] : [Step 4/5] [2021-11-19 21:14:44,047][INFO ][exchange-worker-#24725%grid-1%][GridDhtPartitionsExchangeFuture] Finished waiting for partitions release latch: ClientLatch [coordinator=TcpDiscoveryNode [id=007e61a0-a40a-4876-9e77-e092fe5c2000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345681650, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], ackSent=true, super=CompletableLatch [id=CompletableLatchUid [id=exchange, topVer=AffinityTopologyVersion [topVer=3, minorTopVer=1]]]] [21:14:44] : [Step 4/5] [2021-11-19 21:14:44,049][INFO ][exchange-worker-#24875%grid-2%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:14:44] : [Step 4/5] [2021-11-19 21:14:44,048][INFO ][exchange-worker-#24602%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:14:44] : [Step 4/5] [2021-11-19 21:14:44,050][INFO ][exchange-worker-#24725%grid-1%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:14:44] : [Step 4/5] [2021-11-19 21:14:44,051][INFO ][exchange-worker-#24602%grid-0%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], crd=true] [21:14:44] : [Step 4/5] [2021-11-19 21:14:44,052][INFO ][exchange-worker-#24725%grid-1%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], crd=false] [21:14:44] : [Step 4/5] [2021-11-19 21:14:44,053][INFO ][sys-#24589%grid-0%][GridDhtPartitionsExchangeFuture] Coordinator received single message [ver=AffinityTopologyVersion [topVer=3, minorTopVer=1], node=101bb674-658f-4b57-86e7-a6f4cb062001, remainingNodes=1, allReceived=false] [21:14:44] : [Step 4/5] [2021-11-19 21:14:44,057][INFO ][exchange-worker-#24875%grid-2%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], crd=false] [21:14:44] : [Step 4/5] [2021-11-19 21:14:44,058][INFO ][sys-#24590%grid-0%][GridDhtPartitionsExchangeFuture] Coordinator received single message [ver=AffinityTopologyVersion [topVer=3, minorTopVer=1], node=20f7c8ec-4982-4877-b5fe-1a8056d0a002, allReceived=true] [21:14:44] : [Step 4/5] [2021-11-19 21:14:44,059][INFO ][sys-#24590%grid-0%][GridDhtPartitionsExchangeFuture] finishExchangeOnCoordinator [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=1]] [21:14:44] : [Step 4/5] [2021-11-19 21:14:44,062][INFO ][sys-#24590%grid-0%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], err=null, rebalanced=false, wasRebalanced=true] [21:14:44] : [Step 4/5] [2021-11-19 21:14:44,062][INFO ][disco-notifier-worker-#24716%grid-1%][GridClusterStateProcessor] Received state change finish message: ACTIVE [21:14:44] : [Step 4/5] [2021-11-19 21:14:44,064][INFO ][disco-notifier-worker-#24716%grid-1%][GridClusterStateProcessor] Cluster state was changed from ACTIVE to ACTIVE [21:14:44] : [Step 4/5] [2021-11-19 21:14:44,065][INFO ][sys-#24590%grid-0%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=007e61a0-a40a-4876-9e77-e092fe5c2000, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=101bb674-658f-4b57-86e7-a6f4cb062001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637345681620, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=false, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=3, minorTopVer=1]] [21:14:44] : [Step 4/5] [2021-11-19 21:14:44,062][INFO ][disco-notifier-worker-#24597%grid-0%][GridClusterStateProcessor] Received state change finish message: ACTIVE [21:14:44] : [Step 4/5] [2021-11-19 21:14:44,066][INFO ][sys-#24590%grid-0%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (1 ms), stage="Determine exchange type" (5 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Wait partitions release latch [latch=exchange]" (4 ms), stage="Wait partitions release [latch=exchange]" (3 ms), stage="After states restored callback" (0 ms), stage="WAL history reservation" (0 ms), stage="Waiting for all single messages" (7 ms), stage="Affinity recalculation (crd)" (0 ms), stage="Collect update counters and create affinity messages" (0 ms), stage="Assign partitions states" (0 ms), stage="Validate partitions states" (0 ms), stage="Ideal affinity diff calculation (enforced)" (1 ms), stage="Apply update counters" (0 ms), stage="Full message preparing" (0 ms), stage="Full message sending" (0 ms), stage="State finish message sending" (0 ms), stage="Exchange done" (4 ms), stage="Total time" (25 ms), Discovery lag=3 ms, Latest started node id=101bb674-658f-4b57-86e7-a6f4cb062001] [21:14:44] : [Step 4/5] [2021-11-19 21:14:44,065][INFO ][exchange-worker-#24602%grid-0%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=3, minorTopVer=1], force=false, evt=DISCOVERY_CUSTOM_EVT, node=101bb674-658f-4b57-86e7-a6f4cb062001] [21:14:44] : [Step 4/5] [2021-11-19 21:14:44,062][INFO ][sys-#24856%grid-2%][GridDhtPartitionsExchangeFuture] Received full message, will finish exchange [node=007e61a0-a40a-4876-9e77-e092fe5c2000, resVer=AffinityTopologyVersion [topVer=3, minorTopVer=1]] [21:14:44] : [Step 4/5] [2021-11-19 21:14:44,062][INFO ][disco-notifier-worker-#24866%grid-2%][GridClusterStateProcessor] Received state change finish message: ACTIVE [21:14:44] : [Step 4/5] [2021-11-19 21:14:44,207][INFO ][disco-notifier-worker-#24866%grid-2%][GridClusterStateProcessor] Cluster state was changed from ACTIVE to ACTIVE [21:14:44] : [Step 4/5] [2021-11-19 21:14:44,062][INFO ][sys-#24700%grid-1%][GridDhtPartitionsExchangeFuture] Received full message, will finish exchange [node=007e61a0-a40a-4876-9e77-e092fe5c2000, resVer=AffinityTopologyVersion [topVer=3, minorTopVer=1]] [21:14:44] : [Step 4/5] [2021-11-19 21:14:44,069][INFO ][sys-#24590%grid-0%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], stage="Affinity centralized initialization (crd) [grp=ignite-sys-cache, crd=true]" (5 ms) (parent=Determine exchange type), stage="Affinity recalculation (partitions availability) [grp=ignite-sys-cache]" (1 ms) (parent=Ideal affinity diff calculation (enforced)), stage="Affinity initialization (enforced) [grp=ignite-sys-cache]" (0 ms) (parent=Ideal affinity diff calculation (enforced))] [21:14:44] : [Step 4/5] [2021-11-19 21:14:44,066][INFO ][disco-notifier-worker-#24597%grid-0%][GridClusterStateProcessor] Cluster state was changed from ACTIVE to ACTIVE [21:14:44] : [Step 4/5] [2021-11-19 21:14:44,208][INFO ][sys-#24856%grid-2%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], err=null, rebalanced=false, wasRebalanced=true] [21:14:44] : [Step 4/5] [2021-11-19 21:14:44,208][INFO ][sys-#24700%grid-1%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], err=null, rebalanced=false, wasRebalanced=true] [21:14:44] : [Step 4/5] [2021-11-19 21:14:44,211][INFO ][sys-#24856%grid-2%][CacheGroupContext] Local state for group durability has changed [name=ignite-sys-cache, enabled=false] [21:14:44] : [Step 4/5] [2021-11-19 21:14:44,211][INFO ][sys-#24856%grid-2%][CacheGroupContext] Local state for group durability has been logged to WAL [name=ignite-sys-cache, enabled=false] [21:14:44] : [Step 4/5] [2021-11-19 21:14:44,211][INFO ][exchange-worker-#24725%grid-1%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=3, minorTopVer=1], force=false, evt=DISCOVERY_CUSTOM_EVT, node=101bb674-658f-4b57-86e7-a6f4cb062001] [21:14:44] : [Step 4/5] [2021-11-19 21:14:44,211][INFO ][sys-#24700%grid-1%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=101bb674-658f-4b57-86e7-a6f4cb062001, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=101bb674-658f-4b57-86e7-a6f4cb062001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637345684059, loc=true, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=false, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=3, minorTopVer=1]] [21:14:44] : [Step 4/5] [2021-11-19 21:14:44,214][INFO ][grid-nio-worker-tcp-comm-1-#24660%TestRecordingCommunicationSpi%][TestRecordingCommunicationSpi] Accepted incoming communication connection [locAddr=/127.0.0.1:47101, rmtAddr=/127.0.0.1:40844] [21:14:44] : [Step 4/5] [2021-11-19 21:14:44,215][INFO ][sys-#24700%grid-1%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], stage="Waiting in exchange queue" (1 ms), stage="Exchange parameters initialization" (1 ms), stage="Determine exchange type" (1 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Wait partitions release latch [latch=exchange]" (6 ms), stage="Wait partitions release [latch=exchange]" (1 ms), stage="After states restored callback" (0 ms), stage="WAL history reservation" (0 ms), stage="Waiting for Full message" (10 ms), stage="Affinity recalculation" (145 ms), stage="Full map updating" (0 ms), stage="Exchange done" (6 ms), stage="Total time" (171 ms)] [21:14:44] : [Step 4/5] [2021-11-19 21:14:44,224][INFO ][grid-nio-worker-tcp-comm-1-#24802%TestRecordingCommunicationSpi%][TestRecordingCommunicationSpi] Established outgoing communication connection [locAddr=/127.0.0.1:40844, rmtAddr=/127.0.0.1:47101] [21:14:44] : [Step 4/5] [2021-11-19 21:14:44,225][INFO ][sys-#24700%grid-1%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], stage="Affinity centralized initialization (crd) [grp=ignite-sys-cache, crd=false]" (1 ms) (parent=Determine exchange type), stage="Affinity applying from full message [grp=ignite-sys-cache]" (145 ms) (parent=Affinity recalculation)] [21:14:44] : [Step 4/5] [2021-11-19 21:14:44,225][INFO ][sys-#24856%grid-2%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=20f7c8ec-4982-4877-b5fe-1a8056d0a002, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=101bb674-658f-4b57-86e7-a6f4cb062001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637345683563, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=false, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=3, minorTopVer=1]] [21:14:44] : [Step 4/5] [2021-11-19 21:14:44,229][INFO ][sys-#24856%grid-2%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (1 ms), stage="Determine exchange type" (6 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Wait partitions release latch [latch=exchange]" (2 ms), stage="Wait partitions release [latch=exchange]" (1 ms), stage="After states restored callback" (6 ms), stage="WAL history reservation" (0 ms), stage="Waiting for Full message" (5 ms), stage="Affinity recalculation" (144 ms), stage="Full map updating" (0 ms), stage="Exchange done" (20 ms), stage="Total time" (185 ms)] [21:14:44] : [Step 4/5] [2021-11-19 21:14:44,230][INFO ][sys-#24856%grid-2%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], stage="Affinity centralized initialization (crd) [grp=ignite-sys-cache, crd=false]" (6 ms) (parent=Determine exchange type), stage="Affinity applying from full message [grp=ignite-sys-cache]" (144 ms) (parent=Affinity recalculation)] [21:14:44] : [Step 4/5] [2021-11-19 21:14:44,235][INFO ][exchange-worker-#24725%grid-1%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=2], crd=false, evt=DISCOVERY_CUSTOM_EVT, evtNode=007e61a0-a40a-4876-9e77-e092fe5c2000, customEvt=DynamicCacheChangeBatch [id=e2f2e593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqs=ArrayList [DynamicCacheChangeRequest [cacheName=encrypted, hasCfg=true, nodeId=007e61a0-a40a-4876-9e77-e092fe5c2000, clientStartOnly=false, stop=false, destroy=false, disabledAfterStart=false]], exchangeActions=ExchangeActions [startCaches=[encrypted], stopCaches=null, startGrps=[encrypted], stopGrps=[], resetParts=null, stateChangeRequest=null], startCaches=false], allowMerge=false, exchangeFreeSwitch=false] [21:14:44] : [Step 4/5] [2021-11-19 21:14:44,236][INFO ][exchange-worker-#24875%grid-2%][GridCachePartitionExchangeManager] Rebalancing scheduled [order=[ignite-sys-cache], top=AffinityTopologyVersion [topVer=3, minorTopVer=1], rebalanceId=2, evt=DISCOVERY_CUSTOM_EVT, node=101bb674-658f-4b57-86e7-a6f4cb062001] [21:14:44] : [Step 4/5] [2021-11-19 21:14:44,235][INFO ][exchange-worker-#24602%grid-0%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=2], crd=true, evt=DISCOVERY_CUSTOM_EVT, evtNode=007e61a0-a40a-4876-9e77-e092fe5c2000, customEvt=DynamicCacheChangeBatch [id=e2f2e593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqs=ArrayList [DynamicCacheChangeRequest [cacheName=encrypted, hasCfg=true, nodeId=007e61a0-a40a-4876-9e77-e092fe5c2000, clientStartOnly=false, stop=false, destroy=false, disabledAfterStart=false]], exchangeActions=ExchangeActions [startCaches=[encrypted], stopCaches=null, startGrps=[encrypted], stopGrps=[], resetParts=null, stateChangeRequest=null], startCaches=false], allowMerge=false, exchangeFreeSwitch=false] [21:14:44] : [Step 4/5] [2021-11-19 21:14:44,242][INFO ][exchange-worker-#24602%grid-0%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:14:44] : [Step 4/5] [2021-11-19 21:14:44,239][INFO ][exchange-worker-#24875%grid-2%][GridDhtPartitionDemander] Prepared rebalancing [grp=ignite-sys-cache, mode=SYNC, supplier=101bb674-658f-4b57-86e7-a6f4cb062001, partitionsCount=50, topVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], rebalanceId=2] [21:14:44] : [Step 4/5] [2021-11-19 21:14:44,239][INFO ][exchange-worker-#24725%grid-1%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:14:44] : [Step 4/5] [2021-11-19 21:14:44,250][INFO ][exchange-worker-#24875%grid-2%][PartitionsEvictManager] Eviction in progress [groups=1, remainingPartsToEvict=0] [21:14:44] : [Step 4/5] [2021-11-19 21:14:44,250][INFO ][exchange-worker-#24875%grid-2%][PartitionsEvictManager] Group eviction in progress [grpName=ignite-sys-cache, grpId=-2100569601, remainingPartsToEvict=1, partsEvictInProgress=0, totalParts=100] [21:14:44] : [Step 4/5] [2021-11-19 21:14:44,251][INFO ][exchange-worker-#24875%grid-2%][PartitionsEvictManager] Partitions have been scheduled for eviction: [grpId=-2100569601, grpName=ignite-sys-cache, clearing=[1]] [21:14:44] : [Step 4/5] [2021-11-19 21:14:44,255][INFO ][exchange-worker-#24602%grid-0%][GridCacheProcessor] Started cache [name=encrypted, id=1613773252, dataRegionName=default, mode=PARTITIONED, atomicity=ATOMIC, backups=2, mvcc=false] [21:14:44] : [Step 4/5] [2021-11-19 21:14:44,256][INFO ][exchange-worker-#24602%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=2], waitTime=0ms, futInfo=NA, mode=DISTRIBUTED] [21:14:44] : [Step 4/5] [2021-11-19 21:14:44,257][INFO ][exchange-worker-#24725%grid-1%][GridCacheProcessor] Started cache [name=encrypted, id=1613773252, dataRegionName=default, mode=PARTITIONED, atomicity=ATOMIC, backups=2, mvcc=false] [21:14:44] : [Step 4/5] [2021-11-19 21:14:44,257][INFO ][exchange-worker-#24875%grid-2%][GridDhtPartitionDemander] Prepared rebalancing [grp=ignite-sys-cache, mode=SYNC, supplier=007e61a0-a40a-4876-9e77-e092fe5c2000, partitionsCount=50, topVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], rebalanceId=2] [21:14:44] : [Step 4/5] [2021-11-19 21:14:44,258][INFO ][exchange-worker-#24725%grid-1%][GridAffinityAssignmentCache] Local node affinity assignment distribution is not ideal [cache=encrypted, expectedPrimary=2.67, actualPrimary=5, expectedBackups=5.33, actualBackups=3, warningThreshold=50.00%] [21:14:44] : [Step 4/5] [2021-11-19 21:14:44,259][INFO ][exchange-worker-#24875%grid-2%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=2], crd=false, evt=DISCOVERY_CUSTOM_EVT, evtNode=007e61a0-a40a-4876-9e77-e092fe5c2000, customEvt=DynamicCacheChangeBatch [id=e2f2e593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqs=ArrayList [DynamicCacheChangeRequest [cacheName=encrypted, hasCfg=true, nodeId=007e61a0-a40a-4876-9e77-e092fe5c2000, clientStartOnly=false, stop=false, destroy=false, disabledAfterStart=false]], exchangeActions=ExchangeActions [startCaches=[encrypted], stopCaches=null, startGrps=[encrypted], stopGrps=[], resetParts=null, stateChangeRequest=null], startCaches=false], allowMerge=false, exchangeFreeSwitch=false] [21:14:44] : [Step 4/5] [2021-11-19 21:14:44,260][INFO ][sys-#24863%grid-2%][GridDhtPartitionDemander] Starting rebalance routine [ignite-sys-cache, topVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], supplier=007e61a0-a40a-4876-9e77-e092fe5c2000, fullPartitions=[0, 2, 4, 6, 8, 10, 12, 14, 16, 18, 20, 22, 24, 26, 28, 30, 32, 34, 36, 38, 40, 42, 44, 46, 48, 50, 52, 54, 56, 58, 60, 62, 64, 66, 68, 70, 72, 74, 76, 78, 80, 82, 84, 86, 88, 90, 92, 94, 96, 98], histPartitions=[], rebalanceId=2] [21:14:44] : [Step 4/5] [2021-11-19 21:14:44,259][INFO ][exchange-worker-#24725%grid-1%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=2], waitTime=0ms, futInfo=NA, mode=DISTRIBUTED] [21:14:44] : [Step 4/5] [2021-11-19 21:14:44,263][INFO ][sys-#24865%grid-2%][GridDhtPartitionDemander] Starting rebalance routine [ignite-sys-cache, topVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], supplier=101bb674-658f-4b57-86e7-a6f4cb062001, fullPartitions=[1, 3, 5, 7, 9, 11, 13, 15, 17, 19, 21, 23, 25, 27, 29, 31, 33, 35, 37, 39, 41, 43, 45, 47, 49, 51, 53, 55, 57, 59, 61, 63, 65, 67, 69, 71, 73, 75, 77, 79, 81, 83, 85, 87, 89, 91, 93, 95, 97, 99], histPartitions=[], rebalanceId=2] [21:14:44] : [Step 4/5] [2021-11-19 21:14:44,264][INFO ][exchange-worker-#24875%grid-2%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:14:44] : [Step 4/5] [2021-11-19 21:14:44,268][INFO ][rebalance-striped-#24896%grid-0%][GridDhtPartitionSupplier] Finished supplying rebalancing [grp=ignite-sys-cache, demander=20f7c8ec-4982-4877-b5fe-1a8056d0a002, topVer=AffinityTopologyVersion [topVer=3, minorTopVer=1]] [21:14:44] : [Step 4/5] [2021-11-19 21:14:44,270][INFO ][rebalance-striped-#24898%grid-1%][GridDhtPartitionSupplier] Finished supplying rebalancing [grp=ignite-sys-cache, demander=20f7c8ec-4982-4877-b5fe-1a8056d0a002, topVer=AffinityTopologyVersion [topVer=3, minorTopVer=1]] [21:14:44] : [Step 4/5] [2021-11-19 21:14:44,275][INFO ][rebalance-#24892%grid-2%][GridDhtPartitionDemander] Completed rebalancing [rebalanceId=2, grp=ignite-sys-cache, supplier=101bb674-658f-4b57-86e7-a6f4cb062001, partitions=50, entries=0, duration=36ms, bytesRcvd=0.0 B, bandwidth=0.0 B/sec, histPartitions=0, histEntries=0, histBytesRcvd=0.0 B, fullPartitions=50, fullEntries=0, fullBytesRcvd=0.0 B, topVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], progress=1/2] [21:14:44] : [Step 4/5] [2021-11-19 21:14:44,283][INFO ][exchange-worker-#24875%grid-2%][GridCacheProcessor] Started cache [name=encrypted, id=1613773252, dataRegionName=default, mode=PARTITIONED, atomicity=ATOMIC, backups=2, mvcc=false] [21:14:44] : [Step 4/5] [2021-11-19 21:14:44,285][INFO ][rebalance-#24890%grid-2%][GridDhtPartitionDemander] Completed (final) rebalancing [rebalanceId=2, grp=ignite-sys-cache, supplier=007e61a0-a40a-4876-9e77-e092fe5c2000, partitions=50, entries=0, duration=46ms, bytesRcvd=0.0 B, bandwidth=0.0 B/sec, histPartitions=0, histEntries=0, histBytesRcvd=0.0 B, fullPartitions=50, fullEntries=0, fullBytesRcvd=0.0 B, topVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], progress=2/2] [21:14:44] : [Step 4/5] [2021-11-19 21:14:44,285][INFO ][exchange-worker-#24875%grid-2%][GridAffinityAssignmentCache] Local node affinity assignment distribution is not ideal [cache=encrypted, expectedPrimary=2.67, actualPrimary=0, expectedBackups=5.33, actualBackups=8, warningThreshold=50.00%] [21:14:44] : [Step 4/5] [2021-11-19 21:14:44,287][INFO ][exchange-worker-#24875%grid-2%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=2], waitTime=0ms, futInfo=NA, mode=DISTRIBUTED] [21:14:44] : [Step 4/5] [2021-11-19 21:14:44,287][INFO ][exchange-worker-#24602%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partitions release latch: ServerLatch [permits=0, pendingAcks=HashSet [], super=CompletableLatch [id=CompletableLatchUid [id=exchange, topVer=AffinityTopologyVersion [topVer=3, minorTopVer=2]]]] [21:14:44] : [Step 4/5] [2021-11-19 21:14:44,288][INFO ][exchange-worker-#24725%grid-1%][GridDhtPartitionsExchangeFuture] Finished waiting for partitions release latch: ClientLatch [coordinator=TcpDiscoveryNode [id=007e61a0-a40a-4876-9e77-e092fe5c2000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345681650, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], ackSent=true, super=CompletableLatch [id=CompletableLatchUid [id=exchange, topVer=AffinityTopologyVersion [topVer=3, minorTopVer=2]]]] [21:14:44] : [Step 4/5] [2021-11-19 21:14:44,288][INFO ][exchange-worker-#24602%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=2], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:14:44] : [Step 4/5] [2021-11-19 21:14:44,289][INFO ][exchange-worker-#24875%grid-2%][GridDhtPartitionsExchangeFuture] Finished waiting for partitions release latch: ClientLatch [coordinator=TcpDiscoveryNode [id=007e61a0-a40a-4876-9e77-e092fe5c2000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345683563, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], ackSent=true, super=CompletableLatch [id=CompletableLatchUid [id=exchange, topVer=AffinityTopologyVersion [topVer=3, minorTopVer=2]]]] [21:14:44] : [Step 4/5] [2021-11-19 21:14:44,289][INFO ][exchange-worker-#24725%grid-1%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=2], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:14:44] : [Step 4/5] [2021-11-19 21:14:44,291][INFO ][exchange-worker-#24602%grid-0%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=2], crd=true] [21:14:44] : [Step 4/5] [2021-11-19 21:14:44,291][INFO ][exchange-worker-#24875%grid-2%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=2], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:14:44] : [Step 4/5] [2021-11-19 21:14:44,363][INFO ][exchange-worker-#24725%grid-1%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=2], crd=false] [21:14:44] : [Step 4/5] [2021-11-19 21:14:44,363][INFO ][exchange-worker-#24875%grid-2%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=2], crd=false] [21:14:44] : [Step 4/5] [2021-11-19 21:14:44,363][INFO ][sys-#24586%grid-0%][GridDhtPartitionsExchangeFuture] Coordinator received single message [ver=AffinityTopologyVersion [topVer=3, minorTopVer=2], node=101bb674-658f-4b57-86e7-a6f4cb062001, remainingNodes=1, allReceived=false] [21:14:44] : [Step 4/5] [2021-11-19 21:14:44,364][INFO ][sys-#24575%grid-0%][GridDhtPartitionsExchangeFuture] Coordinator received single message [ver=AffinityTopologyVersion [topVer=3, minorTopVer=2], node=20f7c8ec-4982-4877-b5fe-1a8056d0a002, allReceived=true] [21:14:44] : [Step 4/5] [2021-11-19 21:14:44,364][INFO ][sys-#24575%grid-0%][GridDhtPartitionsExchangeFuture] finishExchangeOnCoordinator [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=2]] [21:14:44] : [Step 4/5] [2021-11-19 21:14:44,372][INFO ][sys-#24575%grid-0%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=2], err=null, rebalanced=false, wasRebalanced=false] [21:14:44] : [Step 4/5] [2021-11-19 21:14:44,373][INFO ][sys-#24711%grid-1%][GridDhtPartitionsExchangeFuture] Received full message, will finish exchange [node=007e61a0-a40a-4876-9e77-e092fe5c2000, resVer=AffinityTopologyVersion [topVer=3, minorTopVer=2]] [21:14:44] : [Step 4/5] [2021-11-19 21:14:44,373][INFO ][sys-#24575%grid-0%][GridCacheProcessor] Finish proxy initialization, cacheName=encrypted, localNodeId=007e61a0-a40a-4876-9e77-e092fe5c2000 [21:14:44] : [Step 4/5] [2021-11-19 21:14:44,373][INFO ][sys-#24849%grid-2%][GridDhtPartitionsExchangeFuture] Received full message, will finish exchange [node=007e61a0-a40a-4876-9e77-e092fe5c2000, resVer=AffinityTopologyVersion [topVer=3, minorTopVer=2]] [21:14:44] : [Step 4/5] [2021-11-19 21:14:44,376][INFO ][sys-#24575%grid-0%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=007e61a0-a40a-4876-9e77-e092fe5c2000, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=2], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=007e61a0-a40a-4876-9e77-e092fe5c2000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345684233, loc=true, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=false, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=3, minorTopVer=2]] [21:14:44] : [Step 4/5] [2021-11-19 21:14:44,376][INFO ][sys-#24711%grid-1%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=2], err=null, rebalanced=false, wasRebalanced=false] [21:14:44] : [Step 4/5] [2021-11-19 21:14:44,379][INFO ][sys-#24575%grid-0%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=2], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (5 ms), stage="Update caches registry" (0 ms), stage="Start caches" (14 ms), stage="Affinity initialization on cache group start" (0 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Wait partitions release latch [latch=exchange]" (31 ms), stage="Wait partitions release [latch=exchange]" (1 ms), stage="Restore partition states" (0 ms), stage="After states restored callback" (0 ms), stage="WAL history reservation" (0 ms), stage="Waiting for all single messages" (73 ms), stage="Affinity recalculation (crd)" (0 ms), stage="Collect update counters and create affinity messages" (0 ms), stage="Assign partitions states" (0 ms), stage="Validate partitions states" (0 ms), stage="Apply update counters" (0 ms), stage="Full message preparing" (6 ms), stage="Full message sending" (0 ms), stage="Exchange done" (6 ms), stage="Total time" (136 ms)] [21:14:44] : [Step 4/5] [2021-11-19 21:14:44,378][INFO ][sys-#24849%grid-2%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=2], err=null, rebalanced=false, wasRebalanced=false] [21:14:44] : [Step 4/5] [2021-11-19 21:14:44,376][INFO ][exchange-worker-#24602%grid-0%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=3, minorTopVer=2], force=false, evt=DISCOVERY_CUSTOM_EVT, node=007e61a0-a40a-4876-9e77-e092fe5c2000] [21:14:44] : [Step 4/5] [2021-11-19 21:14:44,382][INFO ][sys-#24849%grid-2%][GridCacheProcessor] Finish proxy initialization, cacheName=encrypted, localNodeId=20f7c8ec-4982-4877-b5fe-1a8056d0a002 [21:14:44] : [Step 4/5] [2021-11-19 21:14:44,382][INFO ][sys-#24575%grid-0%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=2], stage="Affinity initialization on cache group start [grp=encrypted]" (0 ms) (parent=Affinity initialization on cache group start), stage="Restore partition states [grp=ignite-sys-cache]" (0 ms) (parent=Restore partition states), stage="Restore partition states [grp=encrypted]" (0 ms) (parent=Restore partition states)] [21:14:44] : [Step 4/5] [2021-11-19 21:14:44,380][INFO ][sys-#24711%grid-1%][GridCacheProcessor] Finish proxy initialization, cacheName=encrypted, localNodeId=101bb674-658f-4b57-86e7-a6f4cb062001 [21:14:44] : [Step 4/5] [2021-11-19 21:14:44,383][INFO ][sys-#24849%grid-2%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=20f7c8ec-4982-4877-b5fe-1a8056d0a002, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=2], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=007e61a0-a40a-4876-9e77-e092fe5c2000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345683563, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=false, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=3, minorTopVer=2]] [21:14:44] : [Step 4/5] [2021-11-19 21:14:44,387][INFO ][sys-#24849%grid-2%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=2], stage="Waiting in exchange queue" (23 ms), stage="Exchange parameters initialization" (1 ms), stage="Update caches registry" (0 ms), stage="Start caches" (23 ms), stage="Affinity initialization on cache group start" (1 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Wait partitions release latch [latch=exchange]" (3 ms), stage="Wait partitions release [latch=exchange]" (70 ms), stage="Restore partition states" (0 ms), stage="After states restored callback" (0 ms), stage="WAL history reservation" (0 ms), stage="Waiting for Full message" (10 ms), stage="Affinity recalculation" (3 ms), stage="Full map updating" (1 ms), stage="Exchange done" (9 ms), stage="Total time" (144 ms)] [21:14:44] : [Step 4/5] [2021-11-19 21:14:44,395][INFO ][sys-#24849%grid-2%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=2], stage="Affinity initialization on cache group start [grp=encrypted]" (1 ms) (parent=Affinity initialization on cache group start), stage="Restore partition states [grp=ignite-sys-cache]" (0 ms) (parent=Restore partition states), stage="Restore partition states [grp=encrypted]" (0 ms) (parent=Restore partition states)] [21:14:44] : [Step 4/5] [2021-11-19 21:14:44,387][INFO ][exchange-worker-#24725%grid-1%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=3, minorTopVer=2], force=false, evt=DISCOVERY_CUSTOM_EVT, node=007e61a0-a40a-4876-9e77-e092fe5c2000] [21:14:44] : [Step 4/5] [2021-11-19 21:14:44,386][INFO ][sys-#24711%grid-1%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=101bb674-658f-4b57-86e7-a6f4cb062001, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=2], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=007e61a0-a40a-4876-9e77-e092fe5c2000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345681650, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=false, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=3, minorTopVer=2]] [21:14:44] : [Step 4/5] [2021-11-19 21:14:44,393][INFO ][exchange-worker-#24875%grid-2%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=3, minorTopVer=2], force=false, evt=DISCOVERY_CUSTOM_EVT, node=007e61a0-a40a-4876-9e77-e092fe5c2000] [21:14:44] : [Step 4/5] [2021-11-19 21:14:44,398][INFO ][sys-#24711%grid-1%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=2], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (1 ms), stage="Update caches registry" (0 ms), stage="Start caches" (20 ms), stage="Affinity initialization on cache group start" (1 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (4 ms), stage="Wait partitions release latch [latch=exchange]" (24 ms), stage="Wait partitions release [latch=exchange]" (71 ms), stage="Restore partition states" (0 ms), stage="After states restored callback" (1 ms), stage="WAL history reservation" (0 ms), stage="Waiting for Full message" (10 ms), stage="Affinity recalculation" (0 ms), stage="Full map updating" (2 ms), stage="Exchange done" (22 ms), stage="Total time" (156 ms)] [21:14:44] : [Step 4/5] [2021-11-19 21:14:44,401][INFO ][sys-#24711%grid-1%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=2], stage="Affinity initialization on cache group start [grp=encrypted]" (1 ms) (parent=Affinity initialization on cache group start), stage="Restore partition states [grp=ignite-sys-cache]" (0 ms) (parent=Restore partition states), stage="Restore partition states [grp=encrypted]" (0 ms) (parent=Restore partition states)] [21:14:44] : [Step 4/5] [2021-11-19 21:14:44,421][INFO ][db-checkpoint-thread-#24881%grid-2%][Checkpointer] Checkpoint started [checkpointId=a1c23567-ed38-4822-8515-5b5d47c027e2, startPtr=WALPointer [idx=0, fileOff=83448, len=63], checkpointBeforeLockTime=3ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=1ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=122ms, writeCheckpointEntryDuration=306ms, splitAndSortCpPagesDuration=0ms, pages=18, reason='node started'] [21:14:44] : [Step 4/5] [2021-11-19 21:14:44,759][INFO ][db-checkpoint-thread-#24738%grid-1%][Checkpointer] Checkpoint started [checkpointId=e4db14a0-165f-4528-b45c-2bb0a61a18d1, startPtr=WALPointer [idx=0, fileOff=320559, len=2105], checkpointBeforeLockTime=2ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=17ms, writeCheckpointEntryDuration=18ms, splitAndSortCpPagesDuration=0ms, pages=104, reason='test'] [21:14:44] : [Step 4/5] [2021-11-19 21:14:44,759][INFO ][db-checkpoint-thread-#24881%grid-2%][Checkpointer] Checkpoint finished [cpId=a1c23567-ed38-4822-8515-5b5d47c027e2, pages=18, markPos=WALPointer [idx=0, fileOff=83448, len=63], walSegmentsCovered=[], markDuration=430ms, pagesWrite=1ms, fsync=336ms, total=770ms] [21:14:44] : [Step 4/5] [2021-11-19 21:14:44,763][INFO ][db-checkpoint-thread-#24881%grid-2%][CacheGroupContext] Local state for group durability has changed [name=ignite-sys-cache, enabled=true] [21:14:44] : [Step 4/5] [2021-11-19 21:14:44,782][INFO ][db-checkpoint-thread-#24881%grid-2%][Checkpointer] Checkpoint started [checkpointId=c55a740f-d4a5-4a55-9c85-5a1f2bc51ca7, startPtr=WALPointer [idx=0, fileOff=320633, len=199], checkpointBeforeLockTime=2ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=2ms, walCpRecordFsyncDuration=8ms, writeCheckpointEntryDuration=9ms, splitAndSortCpPagesDuration=0ms, pages=104, reason='enable-durability-rebalance-finished--2100569601-AffinityTopologyVersion [topVer=3, minorTopVer=1]'] [21:14:45] : [Step 4/5] [2021-11-19 21:14:45,232][INFO ][db-checkpoint-thread-#24738%grid-1%][Checkpointer] Checkpoint finished [cpId=e4db14a0-165f-4528-b45c-2bb0a61a18d1, pages=104, markPos=WALPointer [idx=0, fileOff=320559, len=2105], walSegmentsCovered=[], markDuration=36ms, pagesWrite=8ms, fsync=464ms, total=510ms] [21:14:45] : [Step 4/5] [2021-11-19 21:14:45,523][INFO ][db-checkpoint-thread-#24881%grid-2%][Checkpointer] Checkpoint finished [cpId=c55a740f-d4a5-4a55-9c85-5a1f2bc51ca7, pages=104, markPos=WALPointer [idx=0, fileOff=320633, len=199], walSegmentsCovered=[], markDuration=20ms, pagesWrite=5ms, fsync=735ms, total=762ms] [21:14:45] : [Step 4/5] [2021-11-19 21:14:45,523][INFO ][exchange-worker-#24875%grid-2%][GridDhtPartitionDemander] Completed rebalance future: RebalanceFuture [state=STARTED, grp=CacheGroupContext [grp=ignite-sys-cache], topVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], rebalanceId=2, routines=2, receivedBytes=1200, receivedKeys=0, partitionsLeft=0, partitionsTotal=100, startTime=1637345684239, endTime=1637345685523, lastCancelledTime=-1, result=true] [21:14:45] : [Step 4/5] [2021-11-19 21:14:45,524][INFO ][db-checkpoint-thread-#24881%grid-2%][Checkpointer] Skipping checkpoint (no pages were modified) [checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, reason='test'] [21:14:45] : [Step 4/5] [2021-11-19 21:14:45,525][INFO ][exchange-worker-#24875%grid-2%][GridDhtPartitionDemander] Completed rebalance chain: [rebalanceId=2, partitions=100, entries=0, duration=1s, bytesRcvd=0.0 B] [21:14:45] : [Step 4/5] [2021-11-19 21:14:45,525][INFO ][exchange-worker-#24875%grid-2%][CacheGroupContext] Local state for group durability has been logged to WAL [name=ignite-sys-cache, enabled=true] [21:14:45] : [Step 4/5] [2021-11-19 21:14:45,531][INFO ][db-checkpoint-thread-#24736%grid-0%][Checkpointer] Checkpoint started [checkpointId=2f711341-d5cf-49ba-8f7e-0d0e42607c25, startPtr=WALPointer [idx=0, fileOff=320559, len=2105], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=1ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=1ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=0ms, pages=104, reason='test'] [21:14:45] : [Step 4/5] [2021-11-19 21:14:45,534][INFO ][exchange-worker-#24602%grid-0%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=3], crd=true, evt=DISCOVERY_CUSTOM_EVT, evtNode=007e61a0-a40a-4876-9e77-e092fe5c2000, customEvt=CacheAffinityChangeMessage [id=bdf2e593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, topVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], exchId=null, partsMsg=null, exchangeNeeded=true], allowMerge=false, exchangeFreeSwitch=false] [21:14:45] : [Step 4/5] [2021-11-19 21:14:45,535][INFO ][exchange-worker-#24875%grid-2%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=3], crd=false, evt=DISCOVERY_CUSTOM_EVT, evtNode=007e61a0-a40a-4876-9e77-e092fe5c2000, customEvt=CacheAffinityChangeMessage [id=bdf2e593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, topVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], exchId=null, partsMsg=null, exchangeNeeded=true], allowMerge=false, exchangeFreeSwitch=false] [21:14:45] : [Step 4/5] [2021-11-19 21:14:45,535][INFO ][exchange-worker-#24602%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=3], waitTime=0ms, futInfo=NA, mode=DISTRIBUTED] [21:14:45] : [Step 4/5] [2021-11-19 21:14:45,536][INFO ][exchange-worker-#24875%grid-2%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=3], waitTime=0ms, futInfo=NA, mode=DISTRIBUTED] [21:14:45] : [Step 4/5] [2021-11-19 21:14:45,536][INFO ][exchange-worker-#24725%grid-1%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=3], crd=false, evt=DISCOVERY_CUSTOM_EVT, evtNode=007e61a0-a40a-4876-9e77-e092fe5c2000, customEvt=CacheAffinityChangeMessage [id=bdf2e593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, topVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], exchId=null, partsMsg=null, exchangeNeeded=true], allowMerge=false, exchangeFreeSwitch=false] [21:14:45] : [Step 4/5] [2021-11-19 21:14:45,538][INFO ][exchange-worker-#24725%grid-1%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=3], waitTime=0ms, futInfo=NA, mode=DISTRIBUTED] [21:14:45] : [Step 4/5] [2021-11-19 21:14:45,539][INFO ][exchange-worker-#24602%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partitions release latch: ServerLatch [permits=0, pendingAcks=HashSet [], super=CompletableLatch [id=CompletableLatchUid [id=exchange, topVer=AffinityTopologyVersion [topVer=3, minorTopVer=3]]]] [21:14:45] : [Step 4/5] [2021-11-19 21:14:45,539][INFO ][exchange-worker-#24875%grid-2%][GridDhtPartitionsExchangeFuture] Finished waiting for partitions release latch: ClientLatch [coordinator=TcpDiscoveryNode [id=007e61a0-a40a-4876-9e77-e092fe5c2000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345683563, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], ackSent=true, super=CompletableLatch [id=CompletableLatchUid [id=exchange, topVer=AffinityTopologyVersion [topVer=3, minorTopVer=3]]]] [21:14:45] : [Step 4/5] [2021-11-19 21:14:45,539][INFO ][exchange-worker-#24725%grid-1%][GridDhtPartitionsExchangeFuture] Finished waiting for partitions release latch: ClientLatch [coordinator=TcpDiscoveryNode [id=007e61a0-a40a-4876-9e77-e092fe5c2000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345681650, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], ackSent=true, super=CompletableLatch [id=CompletableLatchUid [id=exchange, topVer=AffinityTopologyVersion [topVer=3, minorTopVer=3]]]] [21:14:45] : [Step 4/5] [2021-11-19 21:14:45,541][INFO ][exchange-worker-#24875%grid-2%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=3], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:14:45] : [Step 4/5] [2021-11-19 21:14:45,540][INFO ][exchange-worker-#24602%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=3], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:14:45] : [Step 4/5] [2021-11-19 21:14:45,542][INFO ][exchange-worker-#24725%grid-1%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=3], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:14:45] : [Step 4/5] [2021-11-19 21:14:45,543][INFO ][exchange-worker-#24875%grid-2%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=3], crd=false] [21:14:45] : [Step 4/5] [2021-11-19 21:14:45,543][INFO ][exchange-worker-#24602%grid-0%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=3], crd=true] [21:14:45] : [Step 4/5] [2021-11-19 21:14:45,544][INFO ][sys-#24580%grid-0%][GridDhtPartitionsExchangeFuture] Coordinator received single message [ver=AffinityTopologyVersion [topVer=3, minorTopVer=3], node=20f7c8ec-4982-4877-b5fe-1a8056d0a002, remainingNodes=1, allReceived=false] [21:14:45] : [Step 4/5] [2021-11-19 21:14:45,544][INFO ][exchange-worker-#24725%grid-1%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=3], crd=false] [21:14:45] : [Step 4/5] [2021-11-19 21:14:45,544][INFO ][sys-#24578%grid-0%][GridDhtPartitionsExchangeFuture] Coordinator received single message [ver=AffinityTopologyVersion [topVer=3, minorTopVer=3], node=101bb674-658f-4b57-86e7-a6f4cb062001, allReceived=true] [21:14:45] : [Step 4/5] [2021-11-19 21:14:45,545][INFO ][sys-#24578%grid-0%][GridDhtPartitionsExchangeFuture] finishExchangeOnCoordinator [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=3], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=3]] [21:14:45] : [Step 4/5] [2021-11-19 21:14:45,552][INFO ][sys-#24578%grid-0%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=3], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=3], err=null, rebalanced=true, wasRebalanced=false] [21:14:45] : [Step 4/5] [2021-11-19 21:14:45,552][INFO ][sys-#24694%grid-1%][GridDhtPartitionsExchangeFuture] Received full message, will finish exchange [node=007e61a0-a40a-4876-9e77-e092fe5c2000, resVer=AffinityTopologyVersion [topVer=3, minorTopVer=3]] [21:14:45] : [Step 4/5] [2021-11-19 21:14:45,553][INFO ][sys-#24858%grid-2%][GridDhtPartitionsExchangeFuture] Received full message, will finish exchange [node=007e61a0-a40a-4876-9e77-e092fe5c2000, resVer=AffinityTopologyVersion [topVer=3, minorTopVer=3]] [21:14:45] : [Step 4/5] [2021-11-19 21:14:45,553][INFO ][sys-#24578%grid-0%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=007e61a0-a40a-4876-9e77-e092fe5c2000, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=3], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=007e61a0-a40a-4876-9e77-e092fe5c2000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345685536, loc=true, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=3, minorTopVer=3]] [21:14:45] : [Step 4/5] [2021-11-19 21:14:45,557][INFO ][sys-#24858%grid-2%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=3], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=3], err=null, rebalanced=true, wasRebalanced=false] [21:14:45] : [Step 4/5] [2021-11-19 21:14:45,555][INFO ][exchange-worker-#24602%grid-0%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=3, minorTopVer=3], force=false, evt=DISCOVERY_CUSTOM_EVT, node=007e61a0-a40a-4876-9e77-e092fe5c2000] [21:14:45] : [Step 4/5] [2021-11-19 21:14:45,555][INFO ][sys-#24694%grid-1%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=3], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=3], err=null, rebalanced=true, wasRebalanced=false] [21:14:45] : [Step 4/5] [2021-11-19 21:14:45,560][INFO ][sys-#24694%grid-1%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=101bb674-658f-4b57-86e7-a6f4cb062001, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=3], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=007e61a0-a40a-4876-9e77-e092fe5c2000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345681650, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=3, minorTopVer=3]] [21:14:45] : [Step 4/5] [2021-11-19 21:14:45,561][INFO ][sys-#24694%grid-1%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=3], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=3], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (1 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Wait partitions release latch [latch=exchange]" (3 ms), stage="Wait partitions release [latch=exchange]" (1 ms), stage="After states restored callback" (0 ms), stage="WAL history reservation" (0 ms), stage="Waiting for Full message" (8 ms), stage="Affinity recalculation" (0 ms), stage="Full map updating" (1 ms), stage="Exchange done" (6 ms), stage="Total time" (20 ms)] [21:14:45] : [Step 4/5] [2021-11-19 21:14:45,563][INFO ][sys-#24694%grid-1%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=3], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=3], stage="Affinity change by custom message [grp=ignite-sys-cache]" (0 ms) (parent=Determine exchange type)] [21:14:45] : [Step 4/5] [2021-11-19 21:14:45,559][INFO ][exchange-worker-#24875%grid-2%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=3, minorTopVer=3], force=false, evt=DISCOVERY_CUSTOM_EVT, node=007e61a0-a40a-4876-9e77-e092fe5c2000] [21:14:45] : [Step 4/5] [2021-11-19 21:14:45,559][INFO ][sys-#24858%grid-2%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=20f7c8ec-4982-4877-b5fe-1a8056d0a002, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=3], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=007e61a0-a40a-4876-9e77-e092fe5c2000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345683563, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=3, minorTopVer=3]] [21:14:45] : [Step 4/5] [2021-11-19 21:14:45,558][INFO ][sys-#24578%grid-0%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=3], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=3], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (1 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (1 ms), stage="Wait partitions release latch [latch=exchange]" (3 ms), stage="Wait partitions release [latch=exchange]" (3 ms), stage="After states restored callback" (0 ms), stage="WAL history reservation" (0 ms), stage="Waiting for all single messages" (2 ms), stage="Affinity recalculation (crd)" (0 ms), stage="Collect update counters and create affinity messages" (0 ms), stage="Validate partitions states" (0 ms), stage="Apply update counters" (0 ms), stage="Full message preparing" (5 ms), stage="Full message sending" (0 ms), stage="Exchange done" (6 ms), stage="Total time" (21 ms), Discovery lag=2 ms, Latest started node id=101bb674-658f-4b57-86e7-a6f4cb062001] [21:14:45] : [Step 4/5] [2021-11-19 21:14:45,566][INFO ][sys-#24858%grid-2%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=3], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=3], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (1 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Wait partitions release latch [latch=exchange]" (3 ms), stage="Wait partitions release [latch=exchange]" (1 ms), stage="After states restored callback" (0 ms), stage="WAL history reservation" (0 ms), stage="Waiting for Full message" (9 ms), stage="Affinity recalculation" (2 ms), stage="Full map updating" (1 ms), stage="Exchange done" (8 ms), stage="Total time" (25 ms)] [21:14:45] : [Step 4/5] [2021-11-19 21:14:45,560][INFO ][exchange-worker-#24725%grid-1%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=3, minorTopVer=3], force=false, evt=DISCOVERY_CUSTOM_EVT, node=007e61a0-a40a-4876-9e77-e092fe5c2000] [21:14:45] : [Step 4/5] [2021-11-19 21:14:45,569][INFO ][sys-#24858%grid-2%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=3], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=3], stage="Affinity change by custom message [grp=ignite-sys-cache]" (0 ms) (parent=Determine exchange type)] [21:14:45] : [Step 4/5] [2021-11-19 21:14:45,568][INFO ][sys-#24578%grid-0%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=3], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=3], stage="Affinity change by custom message [grp=ignite-sys-cache]" (0 ms) (parent=Determine exchange type)] [21:14:45] : [Step 4/5] [2021-11-19 21:14:45,625][INFO ][db-checkpoint-thread-#24736%grid-0%][Checkpointer] Checkpoint finished [cpId=2f711341-d5cf-49ba-8f7e-0d0e42607c25, pages=104, markPos=WALPointer [idx=0, fileOff=320559, len=2105], walSegmentsCovered=[], markDuration=4ms, pagesWrite=5ms, fsync=88ms, total=98ms] [21:14:45] : [Step 4/5] [2021-11-19 21:14:45,625][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][root] >>> Stopping grid [name=grid-0, id=007e61a0-a40a-4876-9e77-e092fe5c2000] [21:14:45] : [Step 4/5] [2021-11-19 21:14:45,630][INFO ][db-checkpoint-thread-#24736%grid-0%][Checkpointer] Skipping checkpoint (no pages were modified) [checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, reason='timeout'] [21:14:45] : [Step 4/5] [2021-11-19 21:14:45,637][INFO ][tcp-disco-msg-worker-[007e61a0 127.0.0.1:47500]-#1301%grid-2%-#24867%grid-2%][TestTcpDiscoverySpi] New next node [newNext=TcpDiscoveryNode [id=101bb674-658f-4b57-86e7-a6f4cb062001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637345683563, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false]] [21:14:45] : [Step 4/5] [2021-11-19 21:14:45,638][INFO ][disco-event-worker-#24874%grid-2%][GridDiscoveryManager] Node left topology: TcpDiscoveryNode [id=007e61a0-a40a-4876-9e77-e092fe5c2000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345683563, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false] [21:14:45] : [Step 4/5] [2021-11-19 21:14:45,637][INFO ][disco-event-worker-#24724%grid-1%][GridDiscoveryManager] Node left topology: TcpDiscoveryNode [id=007e61a0-a40a-4876-9e77-e092fe5c2000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345681650, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false] [21:14:45] : [Step 4/5] [2021-11-19 21:14:45,640][INFO ][tcp-disco-sock-reader-[20f7c8ec 127.0.0.1:38145]-#1306%grid-0%-#24872%grid-0%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:38145, rmtPort=38145, rmtNodeId=20f7c8ec-4982-4877-b5fe-1a8056d0a002] [21:14:45] : [Step 4/5] [2021-11-19 21:14:45,639][INFO ][disco-event-worker-#24874%grid-2%][GridDiscoveryManager] Topology snapshot [ver=4, locNode=20f7c8ec, servers=2, clients=0, state=ACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=101bb674-658f-4b57-86e7-a6f4cb062001, consistentId=grid-1, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=20f7c8ec-4982-4877-b5fe-1a8056d0a002, consistentId=grid-2, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:14:45] : [Step 4/5] [2021-11-19 21:14:45,639][INFO ][tcp-disco-srvr-[:47501]-#1293%grid-1%-#24718%grid-1%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=42397] [21:14:45] : [Step 4/5] [2021-11-19 21:14:45,642][INFO ][disco-event-worker-#24874%grid-2%][GridDiscoveryManager] Coordinator changed [prev=TcpDiscoveryNode [id=007e61a0-a40a-4876-9e77-e092fe5c2000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345683563, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], cur=TcpDiscoveryNode [id=101bb674-658f-4b57-86e7-a6f4cb062001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637345683563, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false]] [21:14:45] : [Step 4/5] [2021-11-19 21:14:45,644][INFO ][disco-event-worker-#24874%grid-2%][GridDiscoveryManager] ^-- Baseline [id=1, size=3, online=2, offline=1] [21:14:45] : [Step 4/5] [2021-11-19 21:14:45,642][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Stopped cache [cacheName=ignite-sys-cache] [21:14:45] : [Step 4/5] [2021-11-19 21:14:45,641][INFO ][disco-event-worker-#24724%grid-1%][GridDiscoveryManager] Topology snapshot [ver=4, locNode=101bb674, servers=2, clients=0, state=ACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=101bb674-658f-4b57-86e7-a6f4cb062001, consistentId=grid-1, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=20f7c8ec-4982-4877-b5fe-1a8056d0a002, consistentId=grid-2, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:14:45]W: [org.apache.ignite:ignite-core] [2021-11-19 21:14:45,645][WARN ][grid-nio-worker-tcp-comm-0-#24801%TestRecordingCommunicationSpi%][TestRecordingCommunicationSpi] Failed to shutdown socket [21:14:45]W: [org.apache.ignite:ignite-core] java.nio.channels.ClosedChannelException [21:14:45]W: [org.apache.ignite:ignite-core] at sun.nio.ch.SocketChannelImpl.shutdownOutput(SocketChannelImpl.java:795) [21:14:45]W: [org.apache.ignite:ignite-core] at sun.nio.ch.SocketAdaptor.shutdownOutput(SocketAdaptor.java:407) [21:14:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.close(IgniteUtils.java:4247) [21:14:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.closeKey(GridNioServer.java:2784) [21:14:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.close(GridNioServer.java:2835) [21:14:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.close(GridNioServer.java:2794) [21:14:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.bodyInternal(GridNioServer.java:2157) [21:14:45] : [Step 4/5] [2021-11-19 21:14:45,645][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Stopped cache [cacheName=encrypted] [21:14:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.body(GridNioServer.java:1910) [21:14:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:125) [21:14:45] : [Step 4/5] [2021-11-19 21:14:45,645][INFO ][disco-event-worker-#24874%grid-2%][MvccProcessorImpl] Assigned mvcc coordinator [crd=MvccCoordinator [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], nodeId=101bb674-658f-4b57-86e7-a6f4cb062001, ver=1637345680041, local=false, initialized=false]] [21:14:45]W: [org.apache.ignite:ignite-core] at java.lang.Thread.run(Thread.java:748) [21:14:45] : [Step 4/5] [2021-11-19 21:14:45,643][INFO ][tcp-disco-srvr-[:47501]-#1293%grid-1%-#24718%grid-1%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=42397] [21:14:45] : [Step 4/5] [2021-11-19 21:14:45,646][INFO ][disco-event-worker-#24724%grid-1%][GridDiscoveryManager] Coordinator changed [prev=TcpDiscoveryNode [id=007e61a0-a40a-4876-9e77-e092fe5c2000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345681650, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], cur=TcpDiscoveryNode [id=101bb674-658f-4b57-86e7-a6f4cb062001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637345685627, loc=true, ver=2.13.0#20211119-sha1:00000000, isClient=false]] [21:14:45] : [Step 4/5] [2021-11-19 21:14:45,649][INFO ][exchange-worker-#24875%grid-2%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], crd=false, evt=NODE_LEFT, evtNode=007e61a0-a40a-4876-9e77-e092fe5c2000, customEvt=null, allowMerge=false, exchangeFreeSwitch=true] [21:14:45] : [Step 4/5] [2021-11-19 21:14:45,649][INFO ][tcp-disco-sock-reader-[]-#1308%grid-1%-#24908%grid-1%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:42397, rmtPort=42397] [21:14:45] : [Step 4/5] [2021-11-19 21:14:45,651][INFO ][disco-event-worker-#24724%grid-1%][GridDiscoveryManager] ^-- Baseline [id=1, size=3, online=2, offline=1] [21:14:45] : [Step 4/5] [2021-11-19 21:14:45,652][INFO ][exchange-worker-#24875%grid-2%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:14:45] : [Step 4/5] [2021-11-19 21:14:45,653][INFO ][tcp-disco-sock-reader-[20f7c8ec 127.0.0.1:42397]-#1308%grid-1%-#24908%grid-1%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=20f7c8ec-4982-4877-b5fe-1a8056d0a002, rmtAddr=/127.0.0.1:42397] [21:14:45] : [Step 4/5] [2021-11-19 21:14:45,652][INFO ][disco-event-worker-#24724%grid-1%][MvccProcessorImpl] Assigned mvcc coordinator [crd=MvccCoordinator [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], nodeId=101bb674-658f-4b57-86e7-a6f4cb062001, ver=1637345680041, local=true, initialized=false]] [21:14:45] : [Step 4/5] [2021-11-19 21:14:45,653][INFO ][exchange-worker-#24875%grid-2%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], err=null, rebalanced=true, wasRebalanced=true] [21:14:45] : [Step 4/5] [2021-11-19 21:14:45,656][INFO ][sys-#24707%grid-1%][ExchangeLatchManager] Become new coordinator 101bb674-658f-4b57-86e7-a6f4cb062001 [21:14:45] : [Step 4/5] [2021-11-19 21:14:45,656][INFO ][exchange-worker-#24875%grid-2%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=20f7c8ec-4982-4877-b5fe-1a8056d0a002, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], evt=NODE_LEFT, evtNode=TcpDiscoveryNode [id=007e61a0-a40a-4876-9e77-e092fe5c2000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345683563, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0]] [21:14:45] : [Step 4/5] [2021-11-19 21:14:45,656][INFO ][exchange-worker-#24725%grid-1%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], crd=true, evt=NODE_LEFT, evtNode=007e61a0-a40a-4876-9e77-e092fe5c2000, customEvt=null, allowMerge=false, exchangeFreeSwitch=true] [21:14:45] : [Step 4/5] [2021-11-19 21:14:45,658][INFO ][exchange-worker-#24875%grid-2%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (2 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="After states restored callback" (0 ms), stage="WAL history reservation" (0 ms), stage="Finalize update counters" (0 ms), stage="Detect lost partitions" (2 ms), stage="Exchange done" (2 ms), stage="Total time" (6 ms)] [21:14:45] : [Step 4/5] [2021-11-19 21:14:45,659][INFO ][sys-#24697%grid-1%][GridAffinityAssignmentCache] Local node affinity assignment distribution is not ideal [cache=encrypted, expectedPrimary=4.00, actualPrimary=6, expectedBackups=8.00, actualBackups=2, warningThreshold=50.00%] [21:14:45] : [Step 4/5] [2021-11-19 21:14:45,660][INFO ][exchange-worker-#24875%grid-2%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], stage="Affinity initialization (exchange-free switch on fully-rebalanced topology) [grp=ignite-sys-cache]" (0 ms) (parent=Determine exchange type), stage="Affinity initialization (exchange-free switch on fully-rebalanced topology) [grp=encrypted]" (0 ms) (parent=Determine exchange type)] [21:14:45] : [Step 4/5] [2021-11-19 21:14:45,661][INFO ][exchange-worker-#24725%grid-1%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:14:45] : [Step 4/5] [2021-11-19 21:14:45,662][INFO ][exchange-worker-#24875%grid-2%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], crd=false] [21:14:45] : [Step 4/5] [2021-11-19 21:14:45,663][INFO ][exchange-worker-#24725%grid-1%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], err=null, rebalanced=true, wasRebalanced=true] [21:14:45] : [Step 4/5] [2021-11-19 21:14:45,663][INFO ][exchange-worker-#24875%grid-2%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=4, minorTopVer=0], force=false, evt=NODE_LEFT, node=007e61a0-a40a-4876-9e77-e092fe5c2000] [21:14:45] : [Step 4/5] [2021-11-19 21:14:45,664][INFO ][exchange-worker-#24725%grid-1%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=101bb674-658f-4b57-86e7-a6f4cb062001, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], evt=NODE_LEFT, evtNode=TcpDiscoveryNode [id=007e61a0-a40a-4876-9e77-e092fe5c2000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345681650, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0]] [21:14:45] : [Step 4/5] [2021-11-19 21:14:45,666][INFO ][exchange-worker-#24725%grid-1%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (2 ms), stage="Determine exchange type" (1 ms), stage="Preloading notification" (0 ms), stage="After states restored callback" (1 ms), stage="WAL history reservation" (0 ms), stage="Finalize update counters" (0 ms), stage="Detect lost partitions" (1 ms), stage="Exchange done" (2 ms), stage="Total time" (7 ms)] [21:14:45] : [Step 4/5] [2021-11-19 21:14:45,668][INFO ][exchange-worker-#24725%grid-1%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], stage="Affinity initialization (exchange-free switch on fully-rebalanced topology) [grp=encrypted]" (1 ms) (parent=Determine exchange type), stage="Affinity initialization (exchange-free switch on fully-rebalanced topology) [grp=ignite-sys-cache]" (0 ms) (parent=Determine exchange type)] [21:14:45] : [Step 4/5] [2021-11-19 21:14:45,669][INFO ][exchange-worker-#24725%grid-1%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], crd=true] [21:14:45] : [Step 4/5] [2021-11-19 21:14:45,669][INFO ][exchange-worker-#24725%grid-1%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=4, minorTopVer=0], force=false, evt=NODE_LEFT, node=007e61a0-a40a-4876-9e77-e092fe5c2000] [21:14:45] : [Step 4/5] [2021-11-19 21:14:45,932][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][FilePageStoreManager] Cleanup cache stores [total=4, left=0, cleanFiles=false] [21:14:45] : [Step 4/5] [2021-11-19 21:14:45,934][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][GridDeploymentLocalStore] Removed undeployed class: GridDeployment [ts=1637345681742, depMode=SHARED, clsLdr=IsolatedClassLoader{roleName='test'}, clsLdrId=c4e2e593d71-007e61a0-a40a-4876-9e77-e092fe5c2000, userVer=0, loc=true, sampleClsName=org.apache.ignite.internal.processors.cache.distributed.dht.preloader.GridDhtPartitionMap, pendingUndeploy=false, undeployed=true, usage=0] [21:14:45] : [Step 4/5] [2021-11-19 21:14:45,942][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] [21:14:45] : [Step 4/5] [21:14:45] : [Step 4/5] >>> +------------------------------------------------------+ [21:14:45] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV stopped OK [21:14:45] : [Step 4/5] >>> +------------------------------------------------------+ [21:14:45] : [Step 4/5] >>> Ignite instance name: grid-0 [21:14:45] : [Step 4/5] >>> Grid uptime: 00:00:05.891 [21:14:45] : [Step 4/5] [21:14:45] : [Step 4/5] [21:14:45] : [Step 4/5] [2021-11-19 21:14:45,943][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][root] >>> Stopping grid [name=grid-1, id=101bb674-658f-4b57-86e7-a6f4cb062001] [21:14:45] : [Step 4/5] [2021-11-19 21:14:45,948][INFO ][db-checkpoint-thread-#24738%grid-1%][Checkpointer] Skipping checkpoint (no pages were modified) [checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=1ms, reason='timeout'] [21:14:45] : [Step 4/5] [2021-11-19 21:14:45,955][INFO ][tcp-disco-sock-reader-[20f7c8ec 127.0.0.1:42397]-#1308%grid-1%-#24908%grid-1%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:42397, rmtPort=42397, rmtNodeId=20f7c8ec-4982-4877-b5fe-1a8056d0a002] [21:14:45]W: [org.apache.ignite:ignite-core] [2021-11-19 21:14:45,956][WARN ][tcp-disco-sock-reader-[007e61a0 127.0.0.1:48819]-#1296%grid-1%-#24721%grid-1%][TestTcpDiscoverySpi] Failed to shutdown socket [21:14:45]W: [org.apache.ignite:ignite-core] java.net.SocketException: Socket is closed [21:14:45]W: [org.apache.ignite:ignite-core] at java.net.Socket.shutdownOutput(Socket.java:1568) [21:14:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.close(IgniteUtils.java:4247) [21:14:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.discovery.tcp.ServerImpl$SocketReader.body(ServerImpl.java:7370) [21:14:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.IgniteSpiThread.run(IgniteSpiThread.java:58) [21:14:45] : [Step 4/5] [2021-11-19 21:14:45,957][INFO ][tcp-disco-sock-reader-[007e61a0 127.0.0.1:48819]-#1296%grid-1%-#24721%grid-1%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:48819, rmtPort=48819, rmtNodeId=007e61a0-a40a-4876-9e77-e092fe5c2000] [21:14:45] : [Step 4/5] [2021-11-19 21:14:45,958][INFO ][disco-event-worker-#24874%grid-2%][GridDiscoveryManager] Node left topology: TcpDiscoveryNode [id=101bb674-658f-4b57-86e7-a6f4cb062001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637345683563, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false] [21:14:45] : [Step 4/5] [2021-11-19 21:14:45,958][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Stopped cache [cacheName=ignite-sys-cache] [21:14:45] : [Step 4/5] [2021-11-19 21:14:45,959][INFO ][disco-event-worker-#24874%grid-2%][GridDiscoveryManager] Topology snapshot [ver=5, locNode=20f7c8ec, servers=1, clients=0, state=ACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=20f7c8ec-4982-4877-b5fe-1a8056d0a002, consistentId=grid-2, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:14:45] : [Step 4/5] [2021-11-19 21:14:45,959][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Stopped cache [cacheName=encrypted] [21:14:45] : [Step 4/5] [2021-11-19 21:14:45,960][INFO ][disco-event-worker-#24874%grid-2%][GridDiscoveryManager] Coordinator changed [prev=TcpDiscoveryNode [id=101bb674-658f-4b57-86e7-a6f4cb062001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637345683563, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], cur=TcpDiscoveryNode [id=20f7c8ec-4982-4877-b5fe-1a8056d0a002, consistentId=grid-2, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47502], discPort=47502, order=3, intOrder=3, lastExchangeTime=1637345685950, loc=true, ver=2.13.0#20211119-sha1:00000000, isClient=false]] [21:14:45] : [Step 4/5] [2021-11-19 21:14:45,961][INFO ][disco-event-worker-#24874%grid-2%][GridDiscoveryManager] ^-- Baseline [id=1, size=3, online=1, offline=2] [21:14:45] : [Step 4/5] [2021-11-19 21:14:45,962][INFO ][disco-event-worker-#24874%grid-2%][MvccProcessorImpl] Assigned mvcc coordinator [crd=MvccCoordinator [topVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], nodeId=20f7c8ec-4982-4877-b5fe-1a8056d0a002, ver=1637345680042, local=true, initialized=false]] [21:14:45] : [Step 4/5] [2021-11-19 21:14:45,963][INFO ][sys-#24854%grid-2%][ExchangeLatchManager] Become new coordinator 20f7c8ec-4982-4877-b5fe-1a8056d0a002 [21:14:45] : [Step 4/5] [2021-11-19 21:14:45,963][INFO ][exchange-worker-#24875%grid-2%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], crd=true, evt=NODE_LEFT, evtNode=101bb674-658f-4b57-86e7-a6f4cb062001, customEvt=null, allowMerge=false, exchangeFreeSwitch=true] [21:14:45] : [Step 4/5] [2021-11-19 21:14:45,964][INFO ][sys-#24857%grid-2%][GridAffinityAssignmentCache] Local node affinity assignment distribution is not ideal [cache=encrypted, expectedPrimary=8.00, actualPrimary=8, expectedBackups=16.00, actualBackups=0, warningThreshold=50.00%] [21:14:45] : [Step 4/5] [2021-11-19 21:14:45,965][INFO ][exchange-worker-#24875%grid-2%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:14:45] : [Step 4/5] [2021-11-19 21:14:45,966][INFO ][exchange-worker-#24875%grid-2%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], err=null, rebalanced=true, wasRebalanced=true] [21:14:45] : [Step 4/5] [2021-11-19 21:14:45,967][INFO ][exchange-worker-#24875%grid-2%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=20f7c8ec-4982-4877-b5fe-1a8056d0a002, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], evt=NODE_LEFT, evtNode=TcpDiscoveryNode [id=101bb674-658f-4b57-86e7-a6f4cb062001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637345683563, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=5, minorTopVer=0]] [21:14:45] : [Step 4/5] [2021-11-19 21:14:45,968][INFO ][exchange-worker-#24875%grid-2%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (0 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="After states restored callback" (0 ms), stage="WAL history reservation" (0 ms), stage="Finalize update counters" (0 ms), stage="Detect lost partitions" (1 ms), stage="Exchange done" (1 ms), stage="Total time" (2 ms)] [21:14:45] : [Step 4/5] [2021-11-19 21:14:45,970][INFO ][exchange-worker-#24875%grid-2%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], stage="Affinity initialization (exchange-free switch on fully-rebalanced topology) [grp=ignite-sys-cache]" (0 ms) (parent=Determine exchange type), stage="Affinity initialization (exchange-free switch on fully-rebalanced topology) [grp=encrypted]" (0 ms) (parent=Determine exchange type)] [21:14:45] : [Step 4/5] [2021-11-19 21:14:45,971][INFO ][exchange-worker-#24875%grid-2%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], crd=true] [21:14:45] : [Step 4/5] [2021-11-19 21:14:45,970][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][FilePageStoreManager] Cleanup cache stores [total=4, left=0, cleanFiles=false] [21:14:45] : [Step 4/5] [2021-11-19 21:14:45,973][INFO ][exchange-worker-#24875%grid-2%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=5, minorTopVer=0], force=false, evt=NODE_LEFT, node=101bb674-658f-4b57-86e7-a6f4cb062001] [21:14:45] : [Step 4/5] [2021-11-19 21:14:45,974][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][GridDeploymentLocalStore] Removed undeployed class: GridDeployment [ts=1637345681742, depMode=SHARED, clsLdr=IsolatedClassLoader{roleName='test'}, clsLdrId=e4e2e593d71-101bb674-658f-4b57-86e7-a6f4cb062001, userVer=0, loc=true, sampleClsName=org.apache.ignite.internal.processors.cache.distributed.dht.preloader.IgniteDhtPartitionHistorySuppliersMap, pendingUndeploy=false, undeployed=true, usage=0] [21:14:45] : [Step 4/5] [2021-11-19 21:14:45,982][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] [21:14:45] : [Step 4/5] [21:14:45] : [Step 4/5] >>> +------------------------------------------------------+ [21:14:45] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV stopped OK [21:14:45] : [Step 4/5] >>> +------------------------------------------------------+ [21:14:45] : [Step 4/5] >>> Ignite instance name: grid-1 [21:14:45] : [Step 4/5] >>> Grid uptime: 00:00:04.289 [21:14:45] : [Step 4/5] [21:14:45] : [Step 4/5] [21:14:45] : [Step 4/5] [2021-11-19 21:14:45,992][INFO ][disco-notifier-worker-#24866%grid-2%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=1] [21:14:45] : [Step 4/5] [2021-11-19 21:14:45,992][INFO ][reencrypt-#24915%grid-2%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:14:46] : [Step 4/5] [2021-11-19 21:14:46,193][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=20f7c8ec-4982-4877-b5fe-1a8056d0a002, grp=1613773252] [21:14:46] : [Step 4/5] [2021-11-19 21:14:46,196][INFO ][db-checkpoint-thread-#24881%grid-2%][Checkpointer] Checkpoint started [checkpointId=49e59c40-fdca-4065-80ba-64c791cd217f, startPtr=WALPointer [idx=0, fileOff=719842, len=2105], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=1ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=0ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=0ms, pages=94, reason='test'] [21:14:46] : [Step 4/5] [2021-11-19 21:14:46,207][INFO ][db-checkpoint-thread-#24881%grid-2%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:14:46] : [Step 4/5] [2021-11-19 21:14:46,208][INFO ][db-checkpoint-thread-#24881%grid-2%][Checkpointer] Checkpoint finished [cpId=49e59c40-fdca-4065-80ba-64c791cd217f, pages=94, markPos=WALPointer [idx=0, fileOff=719842, len=2105], walSegmentsCovered=[], markDuration=3ms, pagesWrite=5ms, fsync=7ms, total=15ms] [21:14:46] : [Step 4/5] [2021-11-19 21:14:46,211][INFO ][disco-notifier-worker-#24866%grid-2%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=2] [21:14:46] : [Step 4/5] [2021-11-19 21:14:46,211][INFO ][reencrypt-#24915%grid-2%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:14:46] : [Step 4/5] [2021-11-19 21:14:46,223][INFO ][wal-file-archiver%grid-2-#24877%grid-2%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=0, segIdx=0, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_2/0000000000000000.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_2/0000000000000000.wal] [21:14:46] : [Step 4/5] [2021-11-19 21:14:46,234][INFO ][wal-file-archiver%grid-2-#24877%grid-2%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_2/0000000000000000.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_2/0000000000000000.wal] [21:14:46] : [Step 4/5] [2021-11-19 21:14:46,412][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=20f7c8ec-4982-4877-b5fe-1a8056d0a002, grp=1613773252] [21:14:46] : [Step 4/5] [2021-11-19 21:14:46,415][INFO ][db-checkpoint-thread-#24881%grid-2%][Checkpointer] Checkpoint started [checkpointId=f1605990-ff6f-4840-9596-1c7b752e4ea1, startPtr=WALPointer [idx=1, fileOff=58434, len=2105], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=1ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=0ms, pages=91, reason='test'] [21:14:46] : [Step 4/5] [2021-11-19 21:14:46,435][INFO ][db-checkpoint-thread-#24881%grid-2%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:14:46] : [Step 4/5] [2021-11-19 21:14:46,435][INFO ][db-checkpoint-thread-#24881%grid-2%][Checkpointer] Checkpoint finished [cpId=f1605990-ff6f-4840-9596-1c7b752e4ea1, pages=91, markPos=WALPointer [idx=1, fileOff=58434, len=2105], walSegmentsCovered=[0], markDuration=3ms, pagesWrite=4ms, fsync=15ms, total=23ms] [21:14:46] : [Step 4/5] [2021-11-19 21:14:46,437][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][root] >>> Stopping grid [name=grid-2, id=20f7c8ec-4982-4877-b5fe-1a8056d0a002] [21:14:46] : [Step 4/5] [2021-11-19 21:14:46,448][INFO ][tcp-disco-sock-reader-[101bb674 127.0.0.1:42097]-#1305%grid-2%-#24871%grid-2%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:42097, rmtPort=42097, rmtNodeId=101bb674-658f-4b57-86e7-a6f4cb062001] [21:14:46] : [Step 4/5] [2021-11-19 21:14:46,449][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Stopped cache [cacheName=ignite-sys-cache] [21:14:46] : [Step 4/5] [2021-11-19 21:14:46,450][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Stopped cache [cacheName=encrypted] [21:14:46] : [Step 4/5] [2021-11-19 21:14:46,453][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][FilePageStoreManager] Cleanup cache stores [total=4, left=0, cleanFiles=false] [21:14:46] : [Step 4/5] [2021-11-19 21:14:46,454][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][GridDeploymentLocalStore] Removed undeployed class: GridDeployment [ts=1637345683998, depMode=SHARED, clsLdr=IsolatedClassLoader{roleName='test'}, clsLdrId=7ee2e593d71-20f7c8ec-4982-4877-b5fe-1a8056d0a002, userVer=0, loc=true, sampleClsName=org.apache.ignite.internal.processors.cache.distributed.dht.preloader.IgniteDhtPartitionsToReloadMap, pendingUndeploy=false, undeployed=true, usage=0] [21:14:46] : [Step 4/5] [2021-11-19 21:14:46,461][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-2] [21:14:46] : [Step 4/5] [21:14:46] : [Step 4/5] >>> +------------------------------------------------------+ [21:14:46] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV stopped OK [21:14:46] : [Step 4/5] >>> +------------------------------------------------------+ [21:14:46] : [Step 4/5] >>> Ignite instance name: grid-2 [21:14:46] : [Step 4/5] >>> Grid uptime: 00:00:02.440 [21:14:46] : [Step 4/5] [21:14:46] : [Step 4/5] [21:14:46]W: [org.apache.ignite:ignite-core] [2021-11-19 21:14:46,468][WARN ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][G] Ignite work directory is not provided, automatically resolved to: /opt/buildagent/work/7bc1c54bc719b67c/work [21:14:46] : [Step 4/5] [2021-11-19 21:14:46,469][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] [21:14:46] : [Step 4/5] [21:14:46] : [Step 4/5] >>> __________ ________________ [21:14:46] : [Step 4/5] >>> / _/ ___/ |/ / _/_ __/ __/ [21:14:46] : [Step 4/5] >>> _/ // (7 7 // / / / / _/ [21:14:46] : [Step 4/5] >>> /___/\___/_/|_/___/ /_/ /___/ [21:14:46] : [Step 4/5] >>> [21:14:46] : [Step 4/5] >>> ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:14:46] : [Step 4/5] >>> 2021 Copyright(C) Apache Software Foundation [21:14:46] : [Step 4/5] >>> [21:14:46] : [Step 4/5] >>> Ignite documentation: http://ignite.apache.org [21:14:46] : [Step 4/5] [21:14:46] : [Step 4/5] [2021-11-19 21:14:46,470][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] Config URL: n/a [21:14:46] : [Step 4/5] [2021-11-19 21:14:46,471][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] IgniteConfiguration [igniteInstanceName=grid-0, pubPoolSize=24, svcPoolSize=24, callbackPoolSize=24, stripedPoolSize=24, sysPoolSize=24, mgmtPoolSize=4, dataStreamerPoolSize=24, utilityCachePoolSize=24, utilityCacheKeepAliveTime=60000, p2pPoolSize=2, qryPoolSize=24, buildIdxPoolSize=4, igniteHome=/opt/buildagent/work/7bc1c54bc719b67c, igniteWorkDir=/opt/buildagent/work/7bc1c54bc719b67c/work, mbeanSrv=com.sun.jmx.mbeanserver.JmxMBeanServer@6fe85038, nodeId=001453bf-3a34-4024-94a8-b650d7354000, marsh=BinaryMarshaller [], marshLocJobs=false, daemon=false, p2pEnabled=true, netTimeout=10000, netCompressionLevel=1, sndRetryDelay=1000, sndRetryCnt=3, metricsHistSize=10000, metricsUpdateFreq=1000, metricsExpTime=9223372036854775807, discoSpi=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=0, ackTimeout=0, marsh=null, reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], segPlc=STOP, segResolveAttempts=2, waitForSegOnStart=true, allResolversPassReq=true, segChkFreq=10000, commSpi=TcpCommunicationSpi [connectGate=org.apache.ignite.spi.communication.tcp.internal.ConnectGateway@632cd387, ctxInitLatch=java.util.concurrent.CountDownLatch@1a72b94e[Count = 1], stopping=false, clientPool=null, nioSrvWrapper=null, stateProvider=null], evtSpi=MemoryEventStorageSpi [expireAgeMs=9223372036854775807, expireCnt=10000, filter=null], colSpi=NoopCollisionSpi [], deploySpi=LocalDeploymentSpi [], indexingSpi=org.apache.ignite.spi.indexing.noop.NoopIndexingSpi@1c5b9d45, addrRslvr=null, encryptionSpi=org.apache.ignite.spi.encryption.keystore.KeystoreEncryptionSpi@23c5b88c, tracingSpi=org.apache.ignite.spi.tracing.NoopTracingSpi@78ffba1b, clientMode=false, rebalanceThreadPoolSize=4, rebalanceTimeout=10000, rebalanceBatchesPrefetchCnt=3, rebalanceThrottle=0, rebalanceBatchSize=524288, txCfg=TransactionConfiguration [txSerEnabled=false, dfltIsolation=REPEATABLE_READ, dfltConcurrency=PESSIMISTIC, dfltTxTimeout=0, txTimeoutOnPartitionMapExchange=0, deadlockTimeout=10000, pessimisticTxLogSize=0, pessimisticTxLogLinger=10000, tmLookupClsName=null, txManagerFactory=null, useJtaSync=false], cacheSanityCheckEnabled=true, discoStartupDelay=60000, deployMode=SHARED, p2pMissedCacheSize=100, locHost=127.0.0.1, timeSrvPortBase=31100, timeSrvPortRange=100, failureDetectionTimeout=10000, sysWorkerBlockedTimeout=null, clientFailureDetectionTimeout=10000, metricsLogFreq=0, connectorCfg=null, odbcCfg=null, warmupClos=null, atomicCfg=AtomicConfiguration [seqReserveSize=1000, cacheMode=PARTITIONED, backups=1, aff=null, grpName=null], classLdr=null, sslCtxFactory=null, platformCfg=null, binaryCfg=null, memCfg=null, pstCfg=null, dsCfg=DataStorageConfiguration [sysRegionInitSize=41943040, sysRegionMaxSize=104857600, pageSize=4096, concLvl=0, dfltDataRegConf=DataRegionConfiguration [name=default, maxSize=104857600, initSize=268435456, swapPath=null, pageEvictionMode=DISABLED, pageReplacementMode=CLOCK, evictionThreshold=0.9, emptyPagesPoolSize=100, metricsEnabled=false, metricsSubIntervalCount=5, metricsRateTimeInterval=60000, persistenceEnabled=true, checkpointPageBufSize=0, lazyMemoryAllocation=true, warmUpCfg=null], dataRegions=null, storagePath=null, checkpointFreq=30000, lockWaitTime=10000, checkpointThreads=4, checkpointWriteOrder=SEQUENTIAL, walHistSize=20, maxWalArchiveSize=20971520, walSegments=10, walSegmentSize=1048576, walPath=db/wal, walArchivePath=db/wal/archive, cdcWalPath=db/wal/cdc, cdcEnabled=false, metricsEnabled=false, walMode=LOG_ONLY, walTlbSize=131072, walBuffSize=0, walFlushFreq=2000, walFsyncDelay=1000, walRecordIterBuffSize=67108864, alwaysWriteFullPages=false, fileIOFactory=org.apache.ignite.internal.processors.cache.persistence.file.AsyncFileIOFactory@2e61a445, metricsSubIntervalCnt=5, metricsRateTimeInterval=60000, walAutoArchiveAfterInactivity=-1, walForceArchiveTimeout=-1, writeThrottlingEnabled=false, walCompactionEnabled=false, walCompactionLevel=1, checkpointReadLockTimeout=null, walPageCompression=DISABLED, walPageCompressionLevel=null, dfltWarmUpCfg=null, encCfg=org.apache.ignite.configuration.EncryptionConfiguration@58801498, defragmentationThreadPoolSize=4, minWalArchiveSize=-1], snapshotPath=snapshots, activeOnStart=true, activeOnStartPropSetFlag=false, autoActivation=true, autoActivationPropSetFlag=false, clusterStateOnStart=null, sqlConnCfg=null, cliConnCfg=ClientConnectorConfiguration [host=null, port=10800, portRange=100, sockSndBufSize=0, sockRcvBufSize=0, tcpNoDelay=true, maxOpenCursorsPerConn=128, threadPoolSize=24, selectorCnt=12, idleTimeout=0, handshakeTimeout=10000, jdbcEnabled=true, odbcEnabled=true, thinCliEnabled=true, sslEnabled=false, useIgniteSslCtxFactory=true, sslClientAuth=false, sslCtxFactory=null, thinCliCfg=ThinClientConfiguration [maxActiveTxPerConn=100, maxActiveComputeTasksPerConn=0]], mvccVacuumThreadCnt=2, mvccVacuumFreq=5000, authEnabled=false, failureHnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]], commFailureRslvr=null, sqlCfg=SqlConfiguration [longQryWarnTimeout=3000, dfltQryTimeout=0, sqlQryHistSize=1000, validationEnabled=false], asyncContinuationExecutor=null] [21:14:46] : [Step 4/5] [2021-11-19 21:14:46,483][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] Daemon mode: off [21:14:46] : [Step 4/5] [2021-11-19 21:14:46,483][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] OS: Linux 4.15.0-151-generic amd64 [21:14:46] : [Step 4/5] [2021-11-19 21:14:46,484][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] OS user: teamcity [21:14:46] : [Step 4/5] [2021-11-19 21:14:46,484][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] PID: 16724 [21:14:46] : [Step 4/5] [2021-11-19 21:14:46,485][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] Language runtime: Java Platform API Specification ver. 1.8 [21:14:46] : [Step 4/5] [2021-11-19 21:14:46,485][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] VM information: Java(TM) SE Runtime Environment 1.8.0_261-b12 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 25.261-b12 [21:14:46] : [Step 4/5] [2021-11-19 21:14:46,486][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] VM total memory: 1.9GB [21:14:46] : [Step 4/5] [2021-11-19 21:14:46,486][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] Remote Management [restart: off, REST: off, JMX (remote: off)] [21:14:46] : [Step 4/5] [2021-11-19 21:14:46,486][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] Logger: GridTestLog4jLogger [quiet=false, config=null] [21:14:46] : [Step 4/5] [2021-11-19 21:14:46,487][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] IGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c [21:14:46] : [Step 4/5] [2021-11-19 21:14:46,487][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] VM arguments: [-DIGNITE_DUMP_THREADS_ON_FAILURE=false, -DMono=/usr/bin/mono-sgen, -DMono4.0_x64=/usr/lib/mono/4.0, -DMono4.5_x64=/usr/lib/mono/4.5, -DMonoVersion=6.12.0.90, -DSKIP_BUILD=false, -Dagent.home.dir=/opt/buildagent, -Dagent.name=aitc-lin02_03, -Dagent.ownPort=9090, -Dagent.work.dir=/opt/buildagent/work, -Dbuild.number=95, -Dbuild.vcs.number=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.1=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.GitHubApacheIgnite=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dclassworlds.conf=/opt/buildagent/temp/buildTmp/teamcity.m2.conf, -Dcom.jetbrains.maven.watcher.report.file=/opt/buildagent/temp/buildTmp/maven-build-info.xml, -Djava.io.tmpdir=/opt/buildagent/temp/buildTmp, -Dmaven.home=/opt/buildagent/tools/maven3_6, -Dmaven.multiModuleProjectDirectory=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.agent.cpuBenchmark=457, -Dteamcity.agent.dotnet.agent_url=http://localhost:9090/RPC2, -Dteamcity.agent.dotnet.build_id=6278078, -Dteamcity.auth.password=*******, -Dteamcity.auth.userId=TeamCityBuildId=6278078, -Dteamcity.build.changedFiles.file=/opt/buildagent/temp/buildTmp/changedFiles6342607772318147725.txt, -Dteamcity.build.checkoutDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.build.id=6278078, -Dteamcity.build.properties.file=/opt/buildagent/temp/buildTmp/teamcity.build5164517880467851002.properties, -Dteamcity.build.tempDir=/opt/buildagent/temp/buildTmp, -Dteamcity.build.workingDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.buildConfName=Basic 3, -Dteamcity.buildType.id=IgniteTests24Java8_Basic3, -Dteamcity.configuration.properties.file=/opt/buildagent/temp/buildTmp/teamcity.config5591980786735343870.properties, -Dteamcity.maven.userSettings.path=/opt/buildagent/temp/buildTmp/maven_settings_585072866407032347.xml, -Dteamcity.maven.watcher.home=/opt/buildagent/plugins/mavenPlugin/maven-watcher-jdk16, -Dteamcity.projectName=Ignite Tests 2.x (JDK 8/11), -Dteamcity.runner.properties.file=/opt/buildagent/temp/buildTmp/teamcity.runner9098465561618137420.properties, -Dteamcity.tests.recentlyFailedTests.file=/opt/buildagent/temp/buildTmp/testsToRunFirst3891775683130404069.txt, -Dteamcity.version=2021.2 (build 99542), -ea, -Xms2g, -Xmx2g, -XX:+HeapDumpOnOutOfMemoryError, -DIGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_TEST_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_UPDATE_NOTIFIER=false, -DIGNITE_NO_DISCO_ORDER=true, -DIGNITE_PERFORMANCE_SUGGESTIONS_DISABLED=true, -Djava.net.preferIPv4Stack=true, -DTEST_SCALE_FACTOR=1.0, -DIGNITE_TEST_PROP_LOG4J_FILE=log4j-tc-test.xml, -DIGNITE_QUIET=false, -DIGNITE_MARSHAL_BUFFERS_RECHECK=1000, -Dmaven.repo.local=/opt/buildagent/.m2/repository] [21:14:46] : [Step 4/5] [2021-11-19 21:14:46,493][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] System cache's DataRegion size is configured to 40 MB. Use DataStorageConfiguration.systemRegionInitialSize property to change the setting. [21:14:46] : [Step 4/5] [2021-11-19 21:14:46,494][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] Configured caches [in 'sysMemPlc' dataRegion: ['ignite-sys-cache']] [21:14:46]W: [org.apache.ignite:ignite-core] [2021-11-19 21:14:46,494][WARN ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] Peer class loading is enabled (disable it in production for performance and deployment consistency reasons) [21:14:46] : [Step 4/5] [2021-11-19 21:14:46,494][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] 3-rd party licenses can be found at: /opt/buildagent/work/7bc1c54bc719b67c/libs/licenses [21:14:46] : [Step 4/5] [2021-11-19 21:14:46,500][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] Configured plugins: [21:14:46] : [Step 4/5] [2021-11-19 21:14:46,500][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- StanByClusterTestProvider 1.0 [21:14:46] : [Step 4/5] [2021-11-19 21:14:46,500][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:14:46] : [Step 4/5] [2021-11-19 21:14:46,501][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] [21:14:46] : [Step 4/5] [2021-11-19 21:14:46,501][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- PageMemory tracker plugin 1.0 [21:14:46] : [Step 4/5] [2021-11-19 21:14:46,501][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:14:46] : [Step 4/5] [2021-11-19 21:14:46,501][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] [21:14:46] : [Step 4/5] [2021-11-19 21:14:46,502][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- TestDistibutedConfigurationPlugin 1.0 [21:14:46] : [Step 4/5] [2021-11-19 21:14:46,502][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:14:46] : [Step 4/5] [2021-11-19 21:14:46,502][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] [21:14:46] : [Step 4/5] [2021-11-19 21:14:46,503][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- NodeValidationPluginProvider 1.0 [21:14:46] : [Step 4/5] [2021-11-19 21:14:46,503][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:14:46] : [Step 4/5] [2021-11-19 21:14:46,503][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] [21:14:46] : [Step 4/5] [2021-11-19 21:14:46,503][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][FailureProcessor] Configured failure handler: [hnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]]] [21:14:46] : [Step 4/5] [2021-11-19 21:14:46,532][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][TestRecordingCommunicationSpi] Successfully bound communication NIO server to TCP port [port=47100, locHost=/127.0.0.1, selectorsCnt=12, selectorSpins=0, pairedConn=false] [21:14:46]W: [org.apache.ignite:ignite-core] [2021-11-19 21:14:46,533][WARN ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][TestRecordingCommunicationSpi] Message queue limit is set to 0 which may lead to potential OOMEs when running cache operations in FULL_ASYNC or PRIMARY_SYNC modes due to message queues growth on sender and receiver sides. [21:14:46] : [Step 4/5] [2021-11-19 21:14:46,542][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][GridCollisionManager] Collision resolution is disabled (all jobs will be activated upon arrival). [21:14:46] : [Step 4/5] [2021-11-19 21:14:46,542][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] Security status [authentication=off, sandbox=off, tls/ssl=off] [21:14:46] : [Step 4/5] [2021-11-19 21:14:46,606][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:14:46] : [Step 4/5] [2021-11-19 21:14:46,702][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][MaintenanceProcessor] Resolved store directory for node persistent data: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0 [21:14:46] : [Step 4/5] [2021-11-19 21:14:46,703][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][CacheObjectBinaryProcessorImpl] Resolved directory for serialized binary metadata: /opt/buildagent/work/7bc1c54bc719b67c/work/db/binary_meta/grid_0 [21:14:46] : [Step 4/5] [2021-11-19 21:14:46,708][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0 [21:14:46] : [Step 4/5] [2021-11-19 21:14:46,709][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][FileWriteAheadLogManager] Resolved write ahead log work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0 [21:14:46] : [Step 4/5] [2021-11-19 21:14:46,709][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][FileWriteAheadLogManager] Resolved write ahead log archive directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0 [21:14:46] : [Step 4/5] [2021-11-19 21:14:46,711][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000005.wal [21:14:46] : [Step 4/5] [2021-11-19 21:14:46,711][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000006.wal [21:14:46] : [Step 4/5] [2021-11-19 21:14:46,712][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000008.wal [21:14:46] : [Step 4/5] [2021-11-19 21:14:46,713][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000004.wal [21:14:46] : [Step 4/5] [2021-11-19 21:14:46,713][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000003.wal [21:14:46] : [Step 4/5] [2021-11-19 21:14:46,714][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000002.wal [21:14:46] : [Step 4/5] [2021-11-19 21:14:46,714][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000007.wal [21:14:46] : [Step 4/5] [2021-11-19 21:14:46,715][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000001.wal [21:14:46] : [Step 4/5] [2021-11-19 21:14:46,715][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000009.wal [21:14:46] : [Step 4/5] [2021-11-19 21:14:46,716][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][FileHandleManagerImpl] Initialized write-ahead log manager [mode=LOG_ONLY] [21:14:46] : [Step 4/5] [2021-11-19 21:14:46,721][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Configured data regions initialized successfully [total=5] [21:14:46] : [Step 4/5] [2021-11-19 21:14:46,806][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][IgniteSnapshotManager] Resolved snapshot work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/snapshots [21:14:46] : [Step 4/5] [2021-11-19 21:14:46,806][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][IgniteSnapshotManager] Resolved temp directory for snapshot creation: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0/snp [21:14:46] : [Step 4/5] [2021-11-19 21:14:46,809][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][ClientListenerProcessor] Client connector processor has started on TCP port 10800 [21:14:46] : [Step 4/5] [2021-11-19 21:14:46,814][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] Non-loopback local IPs: 172.17.0.4 [21:14:46] : [Step 4/5] [2021-11-19 21:14:46,815][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] Enabled local MACs: 0242AC110004 [21:14:46] : [Step 4/5] [2021-11-19 21:14:46,817][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=/opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0/cp/1637345685527-2f711341-d5cf-49ba-8f7e-0d0e42607c25-START.bin, endMarker=/opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0/cp/1637345685527-2f711341-d5cf-49ba-8f7e-0d0e42607c25-END.bin] [21:14:46] : [Step 4/5] [2021-11-19 21:14:46,819][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:14:46] : [Step 4/5] [2021-11-19 21:14:46,819][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=320559, len=2105], lastMarked=WALPointer [idx=0, fileOff=320559, len=2105], lastCheckpointId=2f711341-d5cf-49ba-8f7e-0d0e42607c25] [21:14:46] : [Step 4/5] [2021-11-19 21:14:46,822][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Found last checkpoint marker [cpId=2f711341-d5cf-49ba-8f7e-0d0e42607c25, pos=WALPointer [idx=0, fileOff=320559, len=2105]] [21:14:46] : [Step 4/5] [2021-11-19 21:14:46,824][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Applying lost metastore updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=320559, len=2105], lastCheckpointId=2f711341-d5cf-49ba-8f7e-0d0e42607c25] [21:14:46] : [Step 4/5] [2021-11-19 21:14:46,826][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=0 ms] [21:14:46] : [Step 4/5] [2021-11-19 21:14:46,827][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Restoring partition state for local groups. [21:14:46] : [Step 4/5] [2021-11-19 21:14:46,827][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=0, partitionsProcessed=0, time=0ms] [21:14:46] : [Step 4/5] [2021-11-19 21:14:46,839][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][GridClusterStateProcessor] Restoring history for BaselineTopology[id=1] [21:14:46] : [Step 4/5] [2021-11-19 21:14:46,848][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][ClusterProcessor] Cluster ID and tag has been read from metastorage: ClusterIdAndTag [id=b67f5159-9231-44d3-a424-19e9051439ca, tag=cranky_darwin] [21:14:46] : [Step 4/5] [2021-11-19 21:14:46,849][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][IgniteClusterImpl] Shutdown policy was updated [oldVal=null, newVal=null] [21:14:46] : [Step 4/5] [2021-11-19 21:14:46,849][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustEnabled' was changed from 'null' to 'false' [21:14:46] : [Step 4/5] [2021-11-19 21:14:46,850][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustTimeout' was changed from 'null' to '300000' [21:14:46] : [Step 4/5] [2021-11-19 21:14:46,850][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][IgniteTxManager] Transactions parameter 'txOwnerDumpRequestsAllowed' was changed from 'null' to 'true' [21:14:46] : [Step 4/5] [2021-11-19 21:14:46,850][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][IgniteTxManager] Transactions parameter 'longOperationsDumpTimeout' was changed from 'null' to '60000' [21:14:46] : [Step 4/5] [2021-11-19 21:14:46,851][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpThreshold' was changed from 'null' to '0' [21:14:46] : [Step 4/5] [2021-11-19 21:14:46,851][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][IgniteTxManager] Transactions parameter 'transactionTimeDumpSamplesCoefficient' was changed from 'null' to '0.0' [21:14:46] : [Step 4/5] [2021-11-19 21:14:46,852][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpSamplesPerSecondLimit' was changed from 'null' to '5' [21:14:46] : [Step 4/5] [2021-11-19 21:14:46,852][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][IgniteTxManager] Transactions parameter 'collisionsDumpInterval' was changed from 'null' to '1000' [21:14:46] : [Step 4/5] [2021-11-19 21:14:46,853][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Historical rebalance WAL threshold changed [property=historical.rebalance.threshold, oldVal=null, newVal=500] [21:14:46] : [Step 4/5] [2021-11-19 21:14:46,853][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Checkpoint frequency deviation changed [oldVal=null, newVal=null] [21:14:46] : [Step 4/5] [2021-11-19 21:14:46,854][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][FilePageStoreManager] Cleanup cache stores [total=1, left=0, cleanFiles=false] [21:14:46] : [Step 4/5] [2021-11-19 21:14:46,856][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:14:46] : [Step 4/5] [2021-11-19 21:14:46,858][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:14:46] : [Step 4/5] [2021-11-19 21:14:46,859][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:14:46] : [Step 4/5] [2021-11-19 21:14:46,860][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Data Regions Started: 5 [21:14:46] : [Step 4/5] [2021-11-19 21:14:46,860][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] ^-- sysMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:14:46] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:14:46] : [Step 4/5] ^-- default region [type=default, persistence=true, lazyAlloc=true, [21:14:46] : [Step 4/5] ... initCfg=100MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB, allocTotal=0MB] [21:14:46] : [Step 4/5] ^-- metastoreMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:14:46] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:14:46] : [Step 4/5] ^-- TxLog region [type=internal, persistence=true, lazyAlloc=false, [21:14:46] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:14:46] : [Step 4/5] ^-- volatileDsMemPlc region [type=user, persistence=false, lazyAlloc=true, [21:14:46] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB] [21:14:46] : [Step 4/5] ^-- Ignite persistence [used=0MB] [21:14:46] : [Step 4/5] [21:14:46] : [Step 4/5] [2021-11-19 21:14:46,862][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Starting binary memory restore for: [-2100569601, 1613773252] [21:14:46] : [Step 4/5] [2021-11-19 21:14:46,871][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=/opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0/cp/1637345685527-2f711341-d5cf-49ba-8f7e-0d0e42607c25-START.bin, endMarker=/opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0/cp/1637345685527-2f711341-d5cf-49ba-8f7e-0d0e42607c25-END.bin] [21:14:46] : [Step 4/5] [2021-11-19 21:14:46,872][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=320559, len=2105], lastMarked=WALPointer [idx=0, fileOff=320559, len=2105], lastCheckpointId=2f711341-d5cf-49ba-8f7e-0d0e42607c25] [21:14:46] : [Step 4/5] [2021-11-19 21:14:46,875][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Found last checkpoint marker [cpId=2f711341-d5cf-49ba-8f7e-0d0e42607c25, pos=WALPointer [idx=0, fileOff=320559, len=2105]] [21:14:46] : [Step 4/5] [2021-11-19 21:14:46,875][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Binary memory state restored at node startup [restoredPtr=WALPointer [idx=0, fileOff=322664, len=0]] [21:14:46] : [Step 4/5] [2021-11-19 21:14:46,877][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000000.wal, offset=322664, ver=2] [21:14:46] : [Step 4/5] [2021-11-19 21:14:46,879][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Started cache in recovery mode [name=ignite-sys-cache, id=-2100569601, dataRegionName=sysMemPlc, mode=REPLICATED, atomicity=TRANSACTIONAL, backups=2147483647, mvcc=false] [21:14:46] : [Step 4/5] [2021-11-19 21:14:46,881][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:14:46] : [Step 4/5] [2021-11-19 21:14:46,884][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Started cache in recovery mode [name=encrypted, id=1613773252, dataRegionName=default, mode=PARTITIONED, atomicity=ATOMIC, backups=2, mvcc=false] [21:14:46] : [Step 4/5] [2021-11-19 21:14:46,885][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Binary recovery performed in 23 ms. [21:14:46] : [Step 4/5] [2021-11-19 21:14:46,886][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=/opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0/cp/1637345685527-2f711341-d5cf-49ba-8f7e-0d0e42607c25-START.bin, endMarker=/opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0/cp/1637345685527-2f711341-d5cf-49ba-8f7e-0d0e42607c25-END.bin] [21:14:46] : [Step 4/5] [2021-11-19 21:14:46,887][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Applying lost cache updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=320559, len=2105], lastCheckpointId=2f711341-d5cf-49ba-8f7e-0d0e42607c25] [21:14:46] : [Step 4/5] [2021-11-19 21:14:46,891][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=10 ms] [21:14:46] : [Step 4/5] [2021-11-19 21:14:46,892][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Restoring partition state for local groups. [21:14:46] : [Step 4/5] [2021-11-19 21:14:46,905][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=2, partitionsProcessed=108, time=10ms] [21:14:46] : [Step 4/5] [2021-11-19 21:14:46,908][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][TestTcpDiscoverySpi] Successfully bound to TCP port [port=47500, localHost=localhost/127.0.0.1, locNodeId=001453bf-3a34-4024-94a8-b650d7354000] [21:14:46] : [Step 4/5] [2021-11-19 21:14:46,911][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][GridEncryptionManager] Sending stored group keys to coordinator [grps=1613773252] [21:14:46] : [Step 4/5] [2021-11-19 21:14:46,918][INFO ][disco-notifier-worker-#25028%grid-0%][MvccProcessorImpl] Assigned mvcc coordinator [crd=MvccCoordinator [topVer=AffinityTopologyVersion [topVer=1, minorTopVer=0], nodeId=001453bf-3a34-4024-94a8-b650d7354000, ver=1637345686912, local=true, initialized=false]] [21:14:46] : [Step 4/5] [2021-11-19 21:14:46,920][INFO ][sys-#25024%grid-0%][ClusterProcessor] Writing cluster ID and tag to metastorage on ready for write ClusterIdAndTag [id=b67f5159-9231-44d3-a424-19e9051439ca, tag=cranky_darwin] [21:14:46] : [Step 4/5] [2021-11-19 21:14:46,932][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] To start Console Management & Monitoring run ignitevisorcmd.{sh|bat} [21:14:46] : [Step 4/5] [2021-11-19 21:14:46,933][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] [21:14:46] : [Step 4/5] [21:14:46] : [Step 4/5] >>> +-------------------------------------------+ [21:14:46] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:14:46] : [Step 4/5] >>> +-------------------------------------------+ [21:14:46] : [Step 4/5] >>> OS name: Linux 4.15.0-151-generic amd64 [21:14:46] : [Step 4/5] >>> CPU(s): 24 [21:14:46] : [Step 4/5] >>> Heap: 2.0GB [21:14:46] : [Step 4/5] >>> VM name: 16724@c4dfe9a430b2 [21:14:46] : [Step 4/5] >>> Ignite instance name: grid-0 [21:14:46] : [Step 4/5] >>> Local node [ID=001453BF-3A34-4024-94A8-B650D7354000, order=1, clientMode=false] [21:14:46] : [Step 4/5] >>> Local node addresses: [127.0.0.1] [21:14:46] : [Step 4/5] >>> Local ports: TCP:10800 TCP:47100 TCP:47500 [21:14:46] : [Step 4/5] [21:14:46] : [Step 4/5] [2021-11-19 21:14:46,934][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] >>> Ignite cluster is in INACTIVE state (limited functionality available). Use control.(sh|bat) script or IgniteCluster.state(ClusterState.ACTIVE) to change the state. [21:14:46] : [Step 4/5] [2021-11-19 21:14:46,934][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][GridDiscoveryManager] Topology snapshot [ver=1, locNode=001453bf, servers=1, clients=0, state=INACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=001453bf-3a34-4024-94a8-b650d7354000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:14:46] : [Step 4/5] [2021-11-19 21:14:46,935][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][GridDiscoveryManager] ^-- Baseline [id=1, size=3, online=1, offline=2] [21:14:46] : [Step 4/5] [2021-11-19 21:14:46,935][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][GridDiscoveryManager] ^-- 2 nodes left for auto-activation [grid-2, grid-1] [21:14:46] : [Step 4/5] [2021-11-19 21:14:46,936][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][G] Node started : [stage="Configure system pool" (0 ms),stage="Start managers" (234 ms),stage="Configure binary metadata" (2 ms),stage="Start processors" (108 ms),stage="Start 'StanByClusterTestProvider' plugin" (0 ms),stage="Start 'PageMemory tracker plugin' plugin" (0 ms),stage="Start 'TestDistibutedConfigurationPlugin' plugin" (0 ms),stage="Start 'NodeValidationPluginProvider' plugin" (0 ms),stage="Init metastore" (40 ms),stage="Init and start regions" (7 ms),stage="Restore binary memory" (23 ms),stage="Restore logical state" (20 ms),stage="Finish recovery" (0 ms),stage="Join topology" (12 ms),stage="Await transition" (2 ms),stage="Await exchange" (14 ms),stage="Total time" (462 ms)] [21:14:46] : [Step 4/5] [2021-11-19 21:14:46,937][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][root] Node started with the following configuration [id=001453bf-3a34-4024-94a8-b650d7354000, marshaller=BinaryMarshaller [], discovery=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=5000, ackTimeout=5000, marsh=JdkMarshaller [clsFilter=org.apache.ignite.marshaller.MarshallerUtils$1@7eb2979f], reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], binaryCfg=null, lateAff=true] [21:14:46]W: [org.apache.ignite:ignite-core] [2021-11-19 21:14:46,943][WARN ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][G] Ignite work directory is not provided, automatically resolved to: /opt/buildagent/work/7bc1c54bc719b67c/work [21:14:46] : [Step 4/5] [2021-11-19 21:14:46,944][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] [21:14:46] : [Step 4/5] [21:14:46] : [Step 4/5] >>> __________ ________________ [21:14:46] : [Step 4/5] >>> / _/ ___/ |/ / _/_ __/ __/ [21:14:46] : [Step 4/5] >>> _/ // (7 7 // / / / / _/ [21:14:46] : [Step 4/5] >>> /___/\___/_/|_/___/ /_/ /___/ [21:14:46] : [Step 4/5] >>> [21:14:46] : [Step 4/5] >>> ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:14:46] : [Step 4/5] >>> 2021 Copyright(C) Apache Software Foundation [21:14:46] : [Step 4/5] >>> [21:14:46] : [Step 4/5] >>> Ignite documentation: http://ignite.apache.org [21:14:46] : [Step 4/5] [21:14:46] : [Step 4/5] [2021-11-19 21:14:46,944][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] Config URL: n/a [21:14:46] : [Step 4/5] [2021-11-19 21:14:46,945][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] IgniteConfiguration [igniteInstanceName=grid-1, pubPoolSize=24, svcPoolSize=24, callbackPoolSize=24, stripedPoolSize=24, sysPoolSize=24, mgmtPoolSize=4, dataStreamerPoolSize=24, utilityCachePoolSize=24, utilityCacheKeepAliveTime=60000, p2pPoolSize=2, qryPoolSize=24, buildIdxPoolSize=4, igniteHome=/opt/buildagent/work/7bc1c54bc719b67c, igniteWorkDir=/opt/buildagent/work/7bc1c54bc719b67c/work, mbeanSrv=com.sun.jmx.mbeanserver.JmxMBeanServer@6fe85038, nodeId=10d49353-9c6c-48fe-93a8-85c33fc9b001, marsh=BinaryMarshaller [], marshLocJobs=false, daemon=false, p2pEnabled=true, netTimeout=10000, netCompressionLevel=1, sndRetryDelay=1000, sndRetryCnt=3, metricsHistSize=10000, metricsUpdateFreq=1000, metricsExpTime=9223372036854775807, discoSpi=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=0, ackTimeout=0, marsh=null, reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], segPlc=STOP, segResolveAttempts=2, waitForSegOnStart=true, allResolversPassReq=true, segChkFreq=10000, commSpi=TcpCommunicationSpi [connectGate=org.apache.ignite.spi.communication.tcp.internal.ConnectGateway@46c73607, ctxInitLatch=java.util.concurrent.CountDownLatch@7ac18db5[Count = 1], stopping=false, clientPool=null, nioSrvWrapper=null, stateProvider=null], evtSpi=MemoryEventStorageSpi [expireAgeMs=9223372036854775807, expireCnt=10000, filter=null], colSpi=NoopCollisionSpi [], deploySpi=LocalDeploymentSpi [], indexingSpi=org.apache.ignite.spi.indexing.noop.NoopIndexingSpi@6e04725b, addrRslvr=null, encryptionSpi=org.apache.ignite.spi.encryption.keystore.KeystoreEncryptionSpi@505a3485, tracingSpi=org.apache.ignite.spi.tracing.NoopTracingSpi@3b68438, clientMode=false, rebalanceThreadPoolSize=4, rebalanceTimeout=10000, rebalanceBatchesPrefetchCnt=3, rebalanceThrottle=0, rebalanceBatchSize=524288, txCfg=TransactionConfiguration [txSerEnabled=false, dfltIsolation=REPEATABLE_READ, dfltConcurrency=PESSIMISTIC, dfltTxTimeout=0, txTimeoutOnPartitionMapExchange=0, deadlockTimeout=10000, pessimisticTxLogSize=0, pessimisticTxLogLinger=10000, tmLookupClsName=null, txManagerFactory=null, useJtaSync=false], cacheSanityCheckEnabled=true, discoStartupDelay=60000, deployMode=SHARED, p2pMissedCacheSize=100, locHost=127.0.0.1, timeSrvPortBase=31100, timeSrvPortRange=100, failureDetectionTimeout=10000, sysWorkerBlockedTimeout=null, clientFailureDetectionTimeout=10000, metricsLogFreq=0, connectorCfg=null, odbcCfg=null, warmupClos=null, atomicCfg=AtomicConfiguration [seqReserveSize=1000, cacheMode=PARTITIONED, backups=1, aff=null, grpName=null], classLdr=null, sslCtxFactory=null, platformCfg=null, binaryCfg=null, memCfg=null, pstCfg=null, dsCfg=DataStorageConfiguration [sysRegionInitSize=41943040, sysRegionMaxSize=104857600, pageSize=4096, concLvl=0, dfltDataRegConf=DataRegionConfiguration [name=default, maxSize=104857600, initSize=268435456, swapPath=null, pageEvictionMode=DISABLED, pageReplacementMode=CLOCK, evictionThreshold=0.9, emptyPagesPoolSize=100, metricsEnabled=false, metricsSubIntervalCount=5, metricsRateTimeInterval=60000, persistenceEnabled=true, checkpointPageBufSize=0, lazyMemoryAllocation=true, warmUpCfg=null], dataRegions=null, storagePath=null, checkpointFreq=30000, lockWaitTime=10000, checkpointThreads=4, checkpointWriteOrder=SEQUENTIAL, walHistSize=20, maxWalArchiveSize=20971520, walSegments=10, walSegmentSize=1048576, walPath=db/wal, walArchivePath=db/wal/archive, cdcWalPath=db/wal/cdc, cdcEnabled=false, metricsEnabled=false, walMode=LOG_ONLY, walTlbSize=131072, walBuffSize=0, walFlushFreq=2000, walFsyncDelay=1000, walRecordIterBuffSize=67108864, alwaysWriteFullPages=false, fileIOFactory=org.apache.ignite.internal.processors.cache.persistence.file.AsyncFileIOFactory@a7032fb, metricsSubIntervalCnt=5, metricsRateTimeInterval=60000, walAutoArchiveAfterInactivity=-1, walForceArchiveTimeout=-1, writeThrottlingEnabled=false, walCompactionEnabled=false, walCompactionLevel=1, checkpointReadLockTimeout=null, walPageCompression=DISABLED, walPageCompressionLevel=null, dfltWarmUpCfg=null, encCfg=org.apache.ignite.configuration.EncryptionConfiguration@322b1cac, defragmentationThreadPoolSize=4, minWalArchiveSize=-1], snapshotPath=snapshots, activeOnStart=true, activeOnStartPropSetFlag=false, autoActivation=true, autoActivationPropSetFlag=false, clusterStateOnStart=null, sqlConnCfg=null, cliConnCfg=ClientConnectorConfiguration [host=null, port=10800, portRange=100, sockSndBufSize=0, sockRcvBufSize=0, tcpNoDelay=true, maxOpenCursorsPerConn=128, threadPoolSize=24, selectorCnt=12, idleTimeout=0, handshakeTimeout=10000, jdbcEnabled=true, odbcEnabled=true, thinCliEnabled=true, sslEnabled=false, useIgniteSslCtxFactory=true, sslClientAuth=false, sslCtxFactory=null, thinCliCfg=ThinClientConfiguration [maxActiveTxPerConn=100, maxActiveComputeTasksPerConn=0]], mvccVacuumThreadCnt=2, mvccVacuumFreq=5000, authEnabled=false, failureHnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]], commFailureRslvr=null, sqlCfg=SqlConfiguration [longQryWarnTimeout=3000, dfltQryTimeout=0, sqlQryHistSize=1000, validationEnabled=false], asyncContinuationExecutor=null] [21:14:46] : [Step 4/5] [2021-11-19 21:14:46,954][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] Daemon mode: off [21:14:46] : [Step 4/5] [2021-11-19 21:14:46,955][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] OS: Linux 4.15.0-151-generic amd64 [21:14:46] : [Step 4/5] [2021-11-19 21:14:46,955][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] OS user: teamcity [21:14:46] : [Step 4/5] [2021-11-19 21:14:46,955][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] PID: 16724 [21:14:46] : [Step 4/5] [2021-11-19 21:14:46,956][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] Language runtime: Java Platform API Specification ver. 1.8 [21:14:46] : [Step 4/5] [2021-11-19 21:14:46,956][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] VM information: Java(TM) SE Runtime Environment 1.8.0_261-b12 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 25.261-b12 [21:14:46] : [Step 4/5] [2021-11-19 21:14:46,956][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] VM total memory: 1.9GB [21:14:46] : [Step 4/5] [2021-11-19 21:14:46,957][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] Remote Management [restart: off, REST: off, JMX (remote: off)] [21:14:46] : [Step 4/5] [2021-11-19 21:14:46,957][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] Logger: GridTestLog4jLogger [quiet=false, config=null] [21:14:46] : [Step 4/5] [2021-11-19 21:14:46,957][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] IGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c [21:14:46] : [Step 4/5] [2021-11-19 21:14:46,958][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] VM arguments: [-DIGNITE_DUMP_THREADS_ON_FAILURE=false, -DMono=/usr/bin/mono-sgen, -DMono4.0_x64=/usr/lib/mono/4.0, -DMono4.5_x64=/usr/lib/mono/4.5, -DMonoVersion=6.12.0.90, -DSKIP_BUILD=false, -Dagent.home.dir=/opt/buildagent, -Dagent.name=aitc-lin02_03, -Dagent.ownPort=9090, -Dagent.work.dir=/opt/buildagent/work, -Dbuild.number=95, -Dbuild.vcs.number=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.1=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.GitHubApacheIgnite=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dclassworlds.conf=/opt/buildagent/temp/buildTmp/teamcity.m2.conf, -Dcom.jetbrains.maven.watcher.report.file=/opt/buildagent/temp/buildTmp/maven-build-info.xml, -Djava.io.tmpdir=/opt/buildagent/temp/buildTmp, -Dmaven.home=/opt/buildagent/tools/maven3_6, -Dmaven.multiModuleProjectDirectory=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.agent.cpuBenchmark=457, -Dteamcity.agent.dotnet.agent_url=http://localhost:9090/RPC2, -Dteamcity.agent.dotnet.build_id=6278078, -Dteamcity.auth.password=*******, -Dteamcity.auth.userId=TeamCityBuildId=6278078, -Dteamcity.build.changedFiles.file=/opt/buildagent/temp/buildTmp/changedFiles6342607772318147725.txt, -Dteamcity.build.checkoutDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.build.id=6278078, -Dteamcity.build.properties.file=/opt/buildagent/temp/buildTmp/teamcity.build5164517880467851002.properties, -Dteamcity.build.tempDir=/opt/buildagent/temp/buildTmp, -Dteamcity.build.workingDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.buildConfName=Basic 3, -Dteamcity.buildType.id=IgniteTests24Java8_Basic3, -Dteamcity.configuration.properties.file=/opt/buildagent/temp/buildTmp/teamcity.config5591980786735343870.properties, -Dteamcity.maven.userSettings.path=/opt/buildagent/temp/buildTmp/maven_settings_585072866407032347.xml, -Dteamcity.maven.watcher.home=/opt/buildagent/plugins/mavenPlugin/maven-watcher-jdk16, -Dteamcity.projectName=Ignite Tests 2.x (JDK 8/11), -Dteamcity.runner.properties.file=/opt/buildagent/temp/buildTmp/teamcity.runner9098465561618137420.properties, -Dteamcity.tests.recentlyFailedTests.file=/opt/buildagent/temp/buildTmp/testsToRunFirst3891775683130404069.txt, -Dteamcity.version=2021.2 (build 99542), -ea, -Xms2g, -Xmx2g, -XX:+HeapDumpOnOutOfMemoryError, -DIGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_TEST_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_UPDATE_NOTIFIER=false, -DIGNITE_NO_DISCO_ORDER=true, -DIGNITE_PERFORMANCE_SUGGESTIONS_DISABLED=true, -Djava.net.preferIPv4Stack=true, -DTEST_SCALE_FACTOR=1.0, -DIGNITE_TEST_PROP_LOG4J_FILE=log4j-tc-test.xml, -DIGNITE_QUIET=false, -DIGNITE_MARSHAL_BUFFERS_RECHECK=1000, -Dmaven.repo.local=/opt/buildagent/.m2/repository] [21:14:46] : [Step 4/5] [2021-11-19 21:14:46,963][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] System cache's DataRegion size is configured to 40 MB. Use DataStorageConfiguration.systemRegionInitialSize property to change the setting. [21:14:46] : [Step 4/5] [2021-11-19 21:14:46,964][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] Configured caches [in 'sysMemPlc' dataRegion: ['ignite-sys-cache']] [21:14:46]W: [org.apache.ignite:ignite-core] [2021-11-19 21:14:46,964][WARN ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] Peer class loading is enabled (disable it in production for performance and deployment consistency reasons) [21:14:46] : [Step 4/5] [2021-11-19 21:14:46,964][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] 3-rd party licenses can be found at: /opt/buildagent/work/7bc1c54bc719b67c/libs/licenses [21:14:46] : [Step 4/5] [2021-11-19 21:14:46,969][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] Configured plugins: [21:14:46] : [Step 4/5] [2021-11-19 21:14:46,969][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- StanByClusterTestProvider 1.0 [21:14:46] : [Step 4/5] [2021-11-19 21:14:46,970][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:14:46] : [Step 4/5] [2021-11-19 21:14:46,970][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] [21:14:46] : [Step 4/5] [2021-11-19 21:14:46,970][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- PageMemory tracker plugin 1.0 [21:14:46] : [Step 4/5] [2021-11-19 21:14:46,970][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:14:46] : [Step 4/5] [2021-11-19 21:14:46,971][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] [21:14:46] : [Step 4/5] [2021-11-19 21:14:46,971][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- TestDistibutedConfigurationPlugin 1.0 [21:14:46] : [Step 4/5] [2021-11-19 21:14:46,971][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:14:46] : [Step 4/5] [2021-11-19 21:14:46,971][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] [21:14:46] : [Step 4/5] [2021-11-19 21:14:46,972][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- NodeValidationPluginProvider 1.0 [21:14:46] : [Step 4/5] [2021-11-19 21:14:46,972][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:14:46] : [Step 4/5] [2021-11-19 21:14:46,972][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] [21:14:46] : [Step 4/5] [2021-11-19 21:14:46,973][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][FailureProcessor] Configured failure handler: [hnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]]] [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,052][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][TestRecordingCommunicationSpi] Successfully bound communication NIO server to TCP port [port=47101, locHost=/127.0.0.1, selectorsCnt=12, selectorSpins=0, pairedConn=false] [21:14:47]W: [org.apache.ignite:ignite-core] [2021-11-19 21:14:47,052][WARN ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][TestRecordingCommunicationSpi] Message queue limit is set to 0 which may lead to potential OOMEs when running cache operations in FULL_ASYNC or PRIMARY_SYNC modes due to message queues growth on sender and receiver sides. [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,062][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][GridCollisionManager] Collision resolution is disabled (all jobs will be activated upon arrival). [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,062][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] Security status [authentication=off, sandbox=off, tls/ssl=off] [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,122][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,210][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][MaintenanceProcessor] Resolved store directory for node persistent data: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1 [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,211][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][CacheObjectBinaryProcessorImpl] Resolved directory for serialized binary metadata: /opt/buildagent/work/7bc1c54bc719b67c/work/db/binary_meta/grid_1 [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,215][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1 [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,215][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][FileWriteAheadLogManager] Resolved write ahead log work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1 [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,216][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][FileWriteAheadLogManager] Resolved write ahead log archive directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1 [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,218][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000005.wal [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,219][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000006.wal [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,219][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000008.wal [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,219][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000004.wal [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,220][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000003.wal [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,220][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000002.wal [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,221][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000007.wal [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,221][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000001.wal [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,222][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000009.wal [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,222][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][FileHandleManagerImpl] Initialized write-ahead log manager [mode=LOG_ONLY] [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,226][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Configured data regions initialized successfully [total=5] [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,283][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][IgniteSnapshotManager] Resolved snapshot work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/snapshots [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,283][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][IgniteSnapshotManager] Resolved temp directory for snapshot creation: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1/snp [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,286][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][ClientListenerProcessor] Client connector processor has started on TCP port 10801 [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,288][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] Non-loopback local IPs: 172.17.0.4 [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,288][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] Enabled local MACs: 0242AC110004 [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,289][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=/opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1/cp/1637345684722-e4db14a0-165f-4528-b45c-2bb0a61a18d1-START.bin, endMarker=/opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1/cp/1637345684722-e4db14a0-165f-4528-b45c-2bb0a61a18d1-END.bin] [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,290][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,291][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=320559, len=2105], lastMarked=WALPointer [idx=0, fileOff=320559, len=2105], lastCheckpointId=e4db14a0-165f-4528-b45c-2bb0a61a18d1] [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,294][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Found last checkpoint marker [cpId=e4db14a0-165f-4528-b45c-2bb0a61a18d1, pos=WALPointer [idx=0, fileOff=320559, len=2105]] [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,296][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Applying lost metastore updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=320559, len=2105], lastCheckpointId=e4db14a0-165f-4528-b45c-2bb0a61a18d1] [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,297][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=0 ms] [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,298][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Restoring partition state for local groups. [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,298][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=0, partitionsProcessed=0, time=0ms] [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,303][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][GridClusterStateProcessor] Restoring history for BaselineTopology[id=1] [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,306][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][ClusterProcessor] Cluster ID and tag has been read from metastorage: ClusterIdAndTag [id=b67f5159-9231-44d3-a424-19e9051439ca, tag=cranky_darwin] [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,306][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][IgniteClusterImpl] Shutdown policy was updated [oldVal=null, newVal=null] [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,307][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustEnabled' was changed from 'null' to 'false' [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,307][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustTimeout' was changed from 'null' to '300000' [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,308][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][IgniteTxManager] Transactions parameter 'txOwnerDumpRequestsAllowed' was changed from 'null' to 'true' [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,308][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][IgniteTxManager] Transactions parameter 'longOperationsDumpTimeout' was changed from 'null' to '60000' [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,308][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpThreshold' was changed from 'null' to '0' [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,309][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][IgniteTxManager] Transactions parameter 'transactionTimeDumpSamplesCoefficient' was changed from 'null' to '0.0' [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,309][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpSamplesPerSecondLimit' was changed from 'null' to '5' [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,310][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][IgniteTxManager] Transactions parameter 'collisionsDumpInterval' was changed from 'null' to '1000' [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,310][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Historical rebalance WAL threshold changed [property=historical.rebalance.threshold, oldVal=null, newVal=500] [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,311][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Checkpoint frequency deviation changed [oldVal=null, newVal=null] [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,312][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][FilePageStoreManager] Cleanup cache stores [total=1, left=0, cleanFiles=false] [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,314][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,315][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,317][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,318][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Data Regions Started: 5 [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,318][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] ^-- sysMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:14:47] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:14:47] : [Step 4/5] ^-- default region [type=default, persistence=true, lazyAlloc=true, [21:14:47] : [Step 4/5] ... initCfg=100MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB, allocTotal=0MB] [21:14:47] : [Step 4/5] ^-- metastoreMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:14:47] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:14:47] : [Step 4/5] ^-- TxLog region [type=internal, persistence=true, lazyAlloc=false, [21:14:47] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:14:47] : [Step 4/5] ^-- volatileDsMemPlc region [type=user, persistence=false, lazyAlloc=true, [21:14:47] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB] [21:14:47] : [Step 4/5] ^-- Ignite persistence [used=0MB] [21:14:47] : [Step 4/5] [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,320][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Starting binary memory restore for: [-2100569601, 1613773252] [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,330][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=/opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1/cp/1637345684722-e4db14a0-165f-4528-b45c-2bb0a61a18d1-START.bin, endMarker=/opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1/cp/1637345684722-e4db14a0-165f-4528-b45c-2bb0a61a18d1-END.bin] [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,331][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=320559, len=2105], lastMarked=WALPointer [idx=0, fileOff=320559, len=2105], lastCheckpointId=e4db14a0-165f-4528-b45c-2bb0a61a18d1] [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,334][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Found last checkpoint marker [cpId=e4db14a0-165f-4528-b45c-2bb0a61a18d1, pos=WALPointer [idx=0, fileOff=320559, len=2105]] [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,334][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Binary memory state restored at node startup [restoredPtr=WALPointer [idx=0, fileOff=322699, len=0]] [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,337][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000000.wal, offset=322699, ver=2] [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,339][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Started cache in recovery mode [name=ignite-sys-cache, id=-2100569601, dataRegionName=sysMemPlc, mode=REPLICATED, atomicity=TRANSACTIONAL, backups=2147483647, mvcc=false] [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,341][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,344][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Started cache in recovery mode [name=encrypted, id=1613773252, dataRegionName=default, mode=PARTITIONED, atomicity=ATOMIC, backups=2, mvcc=false] [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,345][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Binary recovery performed in 25 ms. [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,346][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=/opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1/cp/1637345684722-e4db14a0-165f-4528-b45c-2bb0a61a18d1-START.bin, endMarker=/opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1/cp/1637345684722-e4db14a0-165f-4528-b45c-2bb0a61a18d1-END.bin] [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,347][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Applying lost cache updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=320559, len=2105], lastCheckpointId=e4db14a0-165f-4528-b45c-2bb0a61a18d1] [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,352][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=0 ms] [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,352][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Restoring partition state for local groups. [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,367][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=2, partitionsProcessed=108, time=21ms] [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,370][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][TestTcpDiscoverySpi] Successfully bound to TCP port [port=47501, localHost=localhost/127.0.0.1, locNodeId=10d49353-9c6c-48fe-93a8-85c33fc9b001] [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,371][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][GridEncryptionManager] Sending stored group keys to coordinator [grps=1613773252] [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,375][INFO ][tcp-disco-srvr-[:47500]-#1312%grid-0%-#25030%grid-0%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=60005] [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,375][INFO ][tcp-disco-srvr-[:47500]-#1312%grid-0%-#25030%grid-0%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=60005] [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,376][INFO ][tcp-disco-sock-reader-[]-#1318%grid-0%-#25151%grid-0%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:60005, rmtPort=60005] [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,378][INFO ][tcp-disco-sock-reader-[10d49353 127.0.0.1:60005]-#1318%grid-0%-#25151%grid-0%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=10d49353-9c6c-48fe-93a8-85c33fc9b001, rmtAddr=/127.0.0.1:60005] [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,383][INFO ][tcp-disco-srvr-[:47501]-#1317%grid-1%-#25150%grid-1%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=51499] [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,383][INFO ][tcp-disco-srvr-[:47501]-#1317%grid-1%-#25150%grid-1%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=51499] [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,384][INFO ][tcp-disco-sock-reader-[]-#1319%grid-1%-#25152%grid-1%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:51499, rmtPort=51499] [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,384][INFO ][tcp-disco-sock-reader-[]-#1319%grid-1%-#25152%grid-1%][TestTcpDiscoverySpi] Received ping request from the remote node [rmtNodeId=001453bf-3a34-4024-94a8-b650d7354000, rmtAddr=/127.0.0.1:51499, rmtPort=51499] [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,385][INFO ][tcp-disco-sock-reader-[]-#1319%grid-1%-#25152%grid-1%][TestTcpDiscoverySpi] Finished writing ping response [rmtNodeId=001453bf-3a34-4024-94a8-b650d7354000, rmtAddr=/127.0.0.1:51499, rmtPort=51499] [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,386][INFO ][tcp-disco-sock-reader-[10d49353 127.0.0.1:60005]-#1318%grid-0%-#25151%grid-0%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:60005, rmtPort=60005, rmtNodeId=10d49353-9c6c-48fe-93a8-85c33fc9b001] [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,386][INFO ][tcp-disco-sock-reader-[]-#1319%grid-1%-#25152%grid-1%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:51499, rmtPort=51499, rmtNodeId=null] [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,402][INFO ][tcp-disco-msg-worker-[crd]-#1311%grid-0%-#25029%grid-0%][TestTcpDiscoverySpi] New next node [newNext=TcpDiscoveryNode [id=10d49353-9c6c-48fe-93a8-85c33fc9b001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=0, intOrder=2, lastExchangeTime=1637345687375, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false]] [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,402][INFO ][tcp-disco-srvr-[:47501]-#1317%grid-1%-#25150%grid-1%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=39085] [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,403][INFO ][tcp-disco-srvr-[:47501]-#1317%grid-1%-#25150%grid-1%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=39085] [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,403][INFO ][tcp-disco-sock-reader-[]-#1320%grid-1%-#25153%grid-1%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:39085, rmtPort=39085] [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,404][INFO ][tcp-disco-sock-reader-[001453bf 127.0.0.1:39085]-#1320%grid-1%-#25153%grid-1%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=001453bf-3a34-4024-94a8-b650d7354000, rmtAddr=/127.0.0.1:39085] [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,407][INFO ][tcp-disco-msg-worker-[]-#1316%grid-1%-#25149%grid-1%][TestTcpDiscoverySpi] New next node [newNext=TcpDiscoveryNode [id=001453bf-3a34-4024-94a8-b650d7354000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345687405, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false]] [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,408][INFO ][tcp-disco-srvr-[:47500]-#1312%grid-0%-#25030%grid-0%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=41567] [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,408][INFO ][tcp-disco-srvr-[:47500]-#1312%grid-0%-#25030%grid-0%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=41567] [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,409][INFO ][tcp-disco-sock-reader-[]-#1321%grid-0%-#25154%grid-0%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:41567, rmtPort=41567] [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,409][INFO ][tcp-disco-sock-reader-[10d49353 127.0.0.1:41567]-#1321%grid-0%-#25154%grid-0%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=10d49353-9c6c-48fe-93a8-85c33fc9b001, rmtAddr=/127.0.0.1:41567] [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,412][INFO ][disco-event-worker-#25032%grid-0%][GridDiscoveryManager] Added new node to topology: TcpDiscoveryNode [id=10d49353-9c6c-48fe-93a8-85c33fc9b001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637345687375, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false] [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,413][INFO ][disco-event-worker-#25032%grid-0%][GridDiscoveryManager] Topology snapshot [ver=2, locNode=001453bf, servers=2, clients=0, state=INACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=001453bf-3a34-4024-94a8-b650d7354000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=10d49353-9c6c-48fe-93a8-85c33fc9b001, consistentId=grid-1, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,414][INFO ][disco-event-worker-#25032%grid-0%][GridDiscoveryManager] ^-- Baseline [id=1, size=3, online=2, offline=1] [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,414][INFO ][disco-event-worker-#25032%grid-0%][GridDiscoveryManager] ^-- 1 nodes left for auto-activation [grid-2] [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,417][INFO ][tcp-disco-msg-worker-[001453bf 127.0.0.1:47500]-#1316%grid-1%-#25149%grid-1%][GridEncryptionManager] Skip group key received from coordinator. Already exists. [grp=1613773252, keyId=0] [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,418][INFO ][disco-notifier-worker-#25148%grid-1%][MvccProcessorImpl] Assigned mvcc coordinator [crd=MvccCoordinator [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=0], nodeId=001453bf-3a34-4024-94a8-b650d7354000, ver=1637345686912, local=false, initialized=false]] [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,419][INFO ][sys-#25147%grid-1%][ClusterProcessor] Writing cluster ID and tag to metastorage on ready for write ClusterIdAndTag [id=b67f5159-9231-44d3-a424-19e9051439ca, tag=cranky_darwin] [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,431][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] To start Console Management & Monitoring run ignitevisorcmd.{sh|bat} [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,431][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] [21:14:47] : [Step 4/5] [21:14:47] : [Step 4/5] >>> +-------------------------------------------+ [21:14:47] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:14:47] : [Step 4/5] >>> +-------------------------------------------+ [21:14:47] : [Step 4/5] >>> OS name: Linux 4.15.0-151-generic amd64 [21:14:47] : [Step 4/5] >>> CPU(s): 24 [21:14:47] : [Step 4/5] >>> Heap: 2.0GB [21:14:47] : [Step 4/5] >>> VM name: 16724@c4dfe9a430b2 [21:14:47] : [Step 4/5] >>> Ignite instance name: grid-1 [21:14:47] : [Step 4/5] >>> Local node [ID=10D49353-9C6C-48FE-93A8-85C33FC9B001, order=2, clientMode=false] [21:14:47] : [Step 4/5] >>> Local node addresses: [127.0.0.1] [21:14:47] : [Step 4/5] >>> Local ports: TCP:10801 TCP:47101 TCP:47501 [21:14:47] : [Step 4/5] [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,432][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] >>> Ignite cluster is in INACTIVE state (limited functionality available). Use control.(sh|bat) script or IgniteCluster.state(ClusterState.ACTIVE) to change the state. [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,433][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][GridDiscoveryManager] Topology snapshot [ver=2, locNode=10d49353, servers=2, clients=0, state=INACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=001453bf-3a34-4024-94a8-b650d7354000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=10d49353-9c6c-48fe-93a8-85c33fc9b001, consistentId=grid-1, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,433][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][GridDiscoveryManager] ^-- Baseline [id=1, size=3, online=2, offline=1] [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,434][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][GridDiscoveryManager] ^-- 1 nodes left for auto-activation [grid-2] [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,434][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][G] Node started : [stage="Configure system pool" (0 ms),stage="Start managers" (267 ms),stage="Configure binary metadata" (1 ms),stage="Start processors" (74 ms),stage="Start 'StanByClusterTestProvider' plugin" (0 ms),stage="Start 'PageMemory tracker plugin' plugin" (0 ms),stage="Start 'TestDistibutedConfigurationPlugin' plugin" (0 ms),stage="Start 'NodeValidationPluginProvider' plugin" (0 ms),stage="Init metastore" (24 ms),stage="Init and start regions" (8 ms),stage="Restore binary memory" (25 ms),stage="Restore logical state" (21 ms),stage="Finish recovery" (0 ms),stage="Join topology" (49 ms),stage="Await transition" (2 ms),stage="Await exchange" (13 ms),stage="Total time" (484 ms)] [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,435][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][root] Node started with the following configuration [id=10d49353-9c6c-48fe-93a8-85c33fc9b001, marshaller=BinaryMarshaller [], discovery=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=5000, ackTimeout=5000, marsh=JdkMarshaller [clsFilter=org.apache.ignite.marshaller.MarshallerUtils$1@70532e51], reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], binaryCfg=null, lateAff=true] [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,438][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][GridClusterStateProcessor] Sending activate cluster request with BaselineTopology BaselineTopology [id=1, branchingHash=-2475315501, branchingType='Cluster activation', baselineNodes=[grid-1, grid-2, grid-0]] [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,440][INFO ][disco-notifier-worker-#25028%grid-0%][GridClusterStateProcessor] Received activate cluster request with BaselineTopology[id=1] initiator node ID: 001453bf-3a34-4024-94a8-b650d7354000 [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,440][INFO ][disco-notifier-worker-#25028%grid-0%][GridClusterStateProcessor] Started state transition: activate cluster [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,441][INFO ][exchange-worker-#25033%grid-0%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], crd=true, evt=DISCOVERY_CUSTOM_EVT, evtNode=001453bf-3a34-4024-94a8-b650d7354000, customEvt=ChangeGlobalStateMessage [id=e903e593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqId=fedb15da-a065-4140-98eb-ee696b46efd1, initiatingNodeId=001453bf-3a34-4024-94a8-b650d7354000, state=ACTIVE, baselineTopology=BaselineTopology [id=1, branchingHash=-2475315501, branchingType='Cluster activation', baselineNodes=[grid-1, grid-2, grid-0]], forceChangeBaselineTopology=false, timestamp=1637345687438, forceDeactivation=true], allowMerge=false, exchangeFreeSwitch=false] [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,441][INFO ][disco-notifier-worker-#25148%grid-1%][GridClusterStateProcessor] Received activate cluster request with BaselineTopology[id=1] initiator node ID: 001453bf-3a34-4024-94a8-b650d7354000 [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,442][INFO ][exchange-worker-#25033%grid-0%][GridDhtPartitionsExchangeFuture] Start activation process [nodeId=001453bf-3a34-4024-94a8-b650d7354000, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]]. New state: ACTIVE [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,443][INFO ][disco-notifier-worker-#25148%grid-1%][GridClusterStateProcessor] Started state transition: activate cluster [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,443][INFO ][exchange-worker-#25033%grid-0%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0 [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,444][INFO ][exchange-worker-#25157%grid-1%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], crd=false, evt=DISCOVERY_CUSTOM_EVT, evtNode=001453bf-3a34-4024-94a8-b650d7354000, customEvt=ChangeGlobalStateMessage [id=e903e593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqId=fedb15da-a065-4140-98eb-ee696b46efd1, initiatingNodeId=001453bf-3a34-4024-94a8-b650d7354000, state=ACTIVE, baselineTopology=BaselineTopology [id=1, branchingHash=-2475315501, branchingType='Cluster activation', baselineNodes=[grid-1, grid-2, grid-0]], forceChangeBaselineTopology=false, timestamp=1637345687438, forceDeactivation=true], allowMerge=false, exchangeFreeSwitch=false] [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,446][INFO ][exchange-worker-#25033%grid-0%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000000.wal, offset=322693, ver=2] [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,446][INFO ][exchange-worker-#25157%grid-1%][GridDhtPartitionsExchangeFuture] Start activation process [nodeId=10d49353-9c6c-48fe-93a8-85c33fc9b001, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]]. New state: ACTIVE [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,448][INFO ][exchange-worker-#25157%grid-1%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1 [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,448][INFO ][exchange-worker-#25033%grid-0%][GridClusterStateProcessor] Writing BaselineTopology[id=1] [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,450][INFO ][exchange-worker-#25157%grid-1%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000000.wal, offset=322728, ver=2] [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,451][INFO ][exchange-worker-#25157%grid-1%][GridClusterStateProcessor] Writing BaselineTopology[id=1] [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,452][INFO ][exchange-worker-#25033%grid-0%][GridCacheDatabaseSharedManager] Finish recovery performed in 8 ms. [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,453][INFO ][exchange-worker-#25033%grid-0%][msg] Components activation performed in 10 ms. [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,454][INFO ][exchange-worker-#25157%grid-1%][GridCacheDatabaseSharedManager] Finish recovery performed in 6 ms. [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,454][INFO ][exchange-worker-#25033%grid-0%][GridCacheProcessor] Finished recovery for cache [cache=ignite-sys-cache, grp=ignite-sys-cache, startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,455][INFO ][exchange-worker-#25157%grid-1%][msg] Components activation performed in 7 ms. [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,455][INFO ][sys-#25022%grid-0%][GridCacheProcessor] Finished recovery for cache [cache=encrypted, grp=encrypted, startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,456][INFO ][exchange-worker-#25157%grid-1%][GridCacheProcessor] Finished recovery for cache [cache=ignite-sys-cache, grp=ignite-sys-cache, startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,456][INFO ][sys-#25137%grid-1%][GridCacheProcessor] Finished recovery for cache [cache=encrypted, grp=encrypted, startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,456][INFO ][exchange-worker-#25033%grid-0%][GridDhtPartitionsExchangeFuture] Successfully activated caches [nodeId=001453bf-3a34-4024-94a8-b650d7354000, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], newState=ACTIVE] [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,457][INFO ][exchange-worker-#25157%grid-1%][GridAffinityAssignmentCache] Local node affinity assignment distribution is not ideal [cache=encrypted, expectedPrimary=4.00, actualPrimary=5, expectedBackups=8.00, actualBackups=3, warningThreshold=50.00%] [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,457][INFO ][exchange-worker-#25033%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,458][INFO ][exchange-worker-#25157%grid-1%][GridDhtPartitionsExchangeFuture] Successfully activated caches [nodeId=10d49353-9c6c-48fe-93a8-85c33fc9b001, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], newState=ACTIVE] [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,459][INFO ][exchange-worker-#25157%grid-1%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,461][INFO ][exchange-worker-#25033%grid-0%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], crd=true] [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,464][INFO ][db-checkpoint-thread-#25168%grid-0%][Checkpointer] Checkpoint started [checkpointId=053b2206-7f27-4b4b-bb3d-61fef63ddde2, startPtr=WALPointer [idx=0, fileOff=492428, len=2121], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=1ms, writeCheckpointEntryDuration=2ms, splitAndSortCpPagesDuration=0ms, pages=31, reason='node started'] [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,465][INFO ][db-checkpoint-thread-#25173%grid-1%][Checkpointer] Checkpoint started [checkpointId=55c74154-c642-42f3-8ea1-96c0ec3d4ecc, startPtr=WALPointer [idx=0, fileOff=492463, len=2121], checkpointBeforeLockTime=2ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=2ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=0ms, pages=31, reason='node started'] [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,465][INFO ][grid-nio-worker-tcp-comm-0-#24970%TestRecordingCommunicationSpi%][TestRecordingCommunicationSpi] Accepted incoming communication connection [locAddr=/127.0.0.1:47100, rmtAddr=/127.0.0.1:35376] [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,472][INFO ][grid-nio-worker-tcp-comm-0-#25090%TestRecordingCommunicationSpi%][TestRecordingCommunicationSpi] Established outgoing communication connection [locAddr=/127.0.0.1:35376, rmtAddr=/127.0.0.1:47100] [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,474][INFO ][exchange-worker-#25157%grid-1%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], crd=false] [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,479][INFO ][sys-#25005%grid-0%][GridDhtPartitionsExchangeFuture] Coordinator received single message [ver=AffinityTopologyVersion [topVer=2, minorTopVer=1], node=10d49353-9c6c-48fe-93a8-85c33fc9b001, allReceived=true] [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,479][INFO ][sys-#25005%grid-0%][GridDhtPartitionsExchangeFuture] finishExchangeOnCoordinator [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,483][INFO ][sys-#25005%grid-0%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], err=null, rebalanced=true, wasRebalanced=false] [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,484][INFO ][disco-notifier-worker-#25148%grid-1%][GridClusterStateProcessor] Received state change finish message: ACTIVE [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,483][INFO ][disco-notifier-worker-#25028%grid-0%][GridClusterStateProcessor] Received state change finish message: ACTIVE [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,485][INFO ][sys-#25136%grid-1%][GridDhtPartitionsExchangeFuture] Received full message, will finish exchange [node=001453bf-3a34-4024-94a8-b650d7354000, resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,484][INFO ][disco-notifier-worker-#25148%grid-1%][GridClusterStateProcessor] Cluster state was changed from INACTIVE to ACTIVE [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,486][INFO ][sys-#25005%grid-0%][GridCacheProcessor] Finish proxy initialization, cacheName=ignite-sys-cache, localNodeId=001453bf-3a34-4024-94a8-b650d7354000 [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,486][INFO ][sys-#25143%grid-1%][GridCachePartitionExchangeManager] Delay process full message without exchange id (there is exchange in progress) [nodeId=001453bf-3a34-4024-94a8-b650d7354000] [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,485][INFO ][disco-notifier-worker-#25028%grid-0%][GridClusterStateProcessor] Cluster state was changed from INACTIVE to ACTIVE [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,488][INFO ][sys-#25136%grid-1%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], err=null, rebalanced=true, wasRebalanced=false] [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,487][INFO ][sys-#25005%grid-0%][GridCacheProcessor] Finish proxy initialization, cacheName=encrypted, localNodeId=001453bf-3a34-4024-94a8-b650d7354000 [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,489][INFO ][sys-#25005%grid-0%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=001453bf-3a34-4024-94a8-b650d7354000, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=001453bf-3a34-4024-94a8-b650d7354000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345687476, loc=true, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,490][INFO ][sys-#25136%grid-1%][GridCacheProcessor] Finish proxy initialization, cacheName=ignite-sys-cache, localNodeId=10d49353-9c6c-48fe-93a8-85c33fc9b001 [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,489][INFO ][sys-#25026%grid-0%][DistributedBaselineConfiguration] Baseline auto-adjust is 'disabled' with timeout='300000' ms [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,489][INFO ][exchange-worker-#25033%grid-0%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=2, minorTopVer=1], force=false, evt=DISCOVERY_CUSTOM_EVT, node=001453bf-3a34-4024-94a8-b650d7354000] [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,562][INFO ][sys-#25026%grid-0%][GridClusterStateProcessor] Successfully performed final activation steps [nodeId=001453bf-3a34-4024-94a8-b650d7354000, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,562][INFO ][sys-#25136%grid-1%][GridCacheProcessor] Finish proxy initialization, cacheName=encrypted, localNodeId=10d49353-9c6c-48fe-93a8-85c33fc9b001 [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,561][INFO ][sys-#25005%grid-0%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (1 ms), stage="Update caches registry" (11 ms), stage="Start caches" (2 ms), stage="Affinity initialization on cache group start" (0 ms), stage="Determine exchange type" (1 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (1 ms), stage="Restore partition states" (0 ms), stage="After states restored callback" (1 ms), stage="WAL history reservation" (0 ms), stage="Waiting for all single messages" (18 ms), stage="Affinity recalculation (crd)" (0 ms), stage="Collect update counters and create affinity messages" (0 ms), stage="Assign partitions states" (0 ms), stage="Validate partitions states" (0 ms), stage="Ideal affinity diff calculation (enforced)" (0 ms), stage="Apply update counters" (0 ms), stage="Full message preparing" (1 ms), stage="Full message sending" (0 ms), stage="State finish message sending" (0 ms), stage="Detect lost partitions" (2 ms), stage="Exchange done" (75 ms), stage="Total time" (113 ms), Discovery lag=3 ms, Latest started node id=10d49353-9c6c-48fe-93a8-85c33fc9b001] [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,565][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][root] awaitPartitionMapExchange finished [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,565][INFO ][sys-#25136%grid-1%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=10d49353-9c6c-48fe-93a8-85c33fc9b001, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=001453bf-3a34-4024-94a8-b650d7354000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345687405, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,565][INFO ][exchange-worker-#25157%grid-1%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=2, minorTopVer=1], force=false, evt=DISCOVERY_CUSTOM_EVT, node=001453bf-3a34-4024-94a8-b650d7354000] [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,564][INFO ][sys-#25135%grid-1%][DistributedBaselineConfiguration] Baseline auto-adjust is 'disabled' with timeout='300000' ms [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,568][INFO ][sys-#25136%grid-1%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (2 ms), stage="Update caches registry" (9 ms), stage="Start caches" (1 ms), stage="Affinity initialization on cache group start" (1 ms), stage="Determine exchange type" (1 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Restore partition states" (0 ms), stage="After states restored callback" (2 ms), stage="WAL history reservation" (0 ms), stage="Waiting for Full message" (22 ms), stage="Affinity recalculation" (1 ms), stage="Full map updating" (1 ms), stage="Detect lost partitions" (1 ms), stage="Exchange done" (78 ms), stage="Total time" (119 ms)] [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,567][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10d49353-9c6c-48fe-93a8-85c33fc9b001, grp=1613773252] [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,566][INFO ][sys-#25005%grid-0%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], stage="Affinity initialization on cache group start [grp=ignite-sys-cache]" (0 ms) (parent=Affinity initialization on cache group start), stage="Affinity initialization on cache group start [grp=encrypted]" (0 ms) (parent=Affinity initialization on cache group start), stage="Affinity centralized initialization (crd) [grp=ignite-sys-cache, crd=true]" (1 ms) (parent=Determine exchange type), stage="Affinity centralized initialization (crd) [grp=encrypted, crd=true]" (1 ms) (parent=Determine exchange type), stage="Restore partition states [grp=ignite-sys-cache]" (0 ms) (parent=Restore partition states), stage="Restore partition states [grp=encrypted]" (0 ms) (parent=Restore partition states), stage="Affinity recalculation (partitions availability) [grp=ignite-sys-cache]" (0 ms) (parent=Ideal affinity diff calculation (enforced)), stage="Affinity recalculation (partitions availability) [grp=encrypted]" (0 ms) (parent=Ideal affinity diff calculation (enforced))] [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,572][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=001453bf-3a34-4024-94a8-b650d7354000, grp=1613773252] [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,570][INFO ][sys-#25136%grid-1%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], stage="Affinity initialization on cache group start [grp=encrypted]" (1 ms) (parent=Affinity initialization on cache group start), stage="Affinity initialization on cache group start [grp=ignite-sys-cache]" (0 ms) (parent=Affinity initialization on cache group start), stage="Affinity centralized initialization (crd) [grp=ignite-sys-cache, crd=false]" (1 ms) (parent=Determine exchange type), stage="Affinity centralized initialization (crd) [grp=encrypted, crd=false]" (1 ms) (parent=Determine exchange type), stage="Restore partition states [grp=ignite-sys-cache]" (0 ms) (parent=Restore partition states), stage="Restore partition states [grp=encrypted]" (0 ms) (parent=Restore partition states), stage="Affinity applying from full message [grp=ignite-sys-cache]" (1 ms) (parent=Affinity recalculation), stage="Affinity applying from full message [grp=encrypted]" (1 ms) (parent=Affinity recalculation)] [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,569][INFO ][sys-#25135%grid-1%][GridClusterStateProcessor] Successfully performed final activation steps [nodeId=10d49353-9c6c-48fe-93a8-85c33fc9b001, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,579][INFO ][disco-notifier-worker-#25028%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=1] [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,579][INFO ][disco-notifier-worker-#25148%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=1] [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,580][INFO ][reencrypt-#25187%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,580][INFO ][reencrypt-#25188%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:14:47]W: [org.apache.ignite:ignite-core] [2021-11-19 21:14:47,585][WARN ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][G] Ignite work directory is not provided, automatically resolved to: /opt/buildagent/work/7bc1c54bc719b67c/work [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,586][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-2] [21:14:47] : [Step 4/5] [21:14:47] : [Step 4/5] >>> __________ ________________ [21:14:47] : [Step 4/5] >>> / _/ ___/ |/ / _/_ __/ __/ [21:14:47] : [Step 4/5] >>> _/ // (7 7 // / / / / _/ [21:14:47] : [Step 4/5] >>> /___/\___/_/|_/___/ /_/ /___/ [21:14:47] : [Step 4/5] >>> [21:14:47] : [Step 4/5] >>> ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:14:47] : [Step 4/5] >>> 2021 Copyright(C) Apache Software Foundation [21:14:47] : [Step 4/5] >>> [21:14:47] : [Step 4/5] >>> Ignite documentation: http://ignite.apache.org [21:14:47] : [Step 4/5] [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,586][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-2] Config URL: n/a [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,587][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-2] IgniteConfiguration [igniteInstanceName=grid-2, pubPoolSize=24, svcPoolSize=24, callbackPoolSize=24, stripedPoolSize=24, sysPoolSize=24, mgmtPoolSize=4, dataStreamerPoolSize=24, utilityCachePoolSize=24, utilityCacheKeepAliveTime=60000, p2pPoolSize=2, qryPoolSize=24, buildIdxPoolSize=4, igniteHome=/opt/buildagent/work/7bc1c54bc719b67c, igniteWorkDir=/opt/buildagent/work/7bc1c54bc719b67c/work, mbeanSrv=com.sun.jmx.mbeanserver.JmxMBeanServer@6fe85038, nodeId=20c1c79e-1db1-4503-9f95-a128e7d43002, marsh=BinaryMarshaller [], marshLocJobs=false, daemon=false, p2pEnabled=true, netTimeout=10000, netCompressionLevel=1, sndRetryDelay=1000, sndRetryCnt=3, metricsHistSize=10000, metricsUpdateFreq=1000, metricsExpTime=9223372036854775807, discoSpi=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=0, ackTimeout=0, marsh=null, reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], segPlc=STOP, segResolveAttempts=2, waitForSegOnStart=true, allResolversPassReq=true, segChkFreq=10000, commSpi=TcpCommunicationSpi [connectGate=org.apache.ignite.spi.communication.tcp.internal.ConnectGateway@29bec4e9, ctxInitLatch=java.util.concurrent.CountDownLatch@3fefdad0[Count = 1], stopping=false, clientPool=null, nioSrvWrapper=null, stateProvider=null], evtSpi=MemoryEventStorageSpi [expireAgeMs=9223372036854775807, expireCnt=10000, filter=null], colSpi=NoopCollisionSpi [], deploySpi=LocalDeploymentSpi [], indexingSpi=org.apache.ignite.spi.indexing.noop.NoopIndexingSpi@27867cd3, addrRslvr=null, encryptionSpi=org.apache.ignite.spi.encryption.keystore.KeystoreEncryptionSpi@5314c7d9, tracingSpi=org.apache.ignite.spi.tracing.NoopTracingSpi@2adb4a5e, clientMode=false, rebalanceThreadPoolSize=4, rebalanceTimeout=10000, rebalanceBatchesPrefetchCnt=3, rebalanceThrottle=0, rebalanceBatchSize=524288, txCfg=TransactionConfiguration [txSerEnabled=false, dfltIsolation=REPEATABLE_READ, dfltConcurrency=PESSIMISTIC, dfltTxTimeout=0, txTimeoutOnPartitionMapExchange=0, deadlockTimeout=10000, pessimisticTxLogSize=0, pessimisticTxLogLinger=10000, tmLookupClsName=null, txManagerFactory=null, useJtaSync=false], cacheSanityCheckEnabled=true, discoStartupDelay=60000, deployMode=SHARED, p2pMissedCacheSize=100, locHost=127.0.0.1, timeSrvPortBase=31100, timeSrvPortRange=100, failureDetectionTimeout=10000, sysWorkerBlockedTimeout=null, clientFailureDetectionTimeout=10000, metricsLogFreq=0, connectorCfg=null, odbcCfg=null, warmupClos=null, atomicCfg=AtomicConfiguration [seqReserveSize=1000, cacheMode=PARTITIONED, backups=1, aff=null, grpName=null], classLdr=null, sslCtxFactory=null, platformCfg=null, binaryCfg=null, memCfg=null, pstCfg=null, dsCfg=DataStorageConfiguration [sysRegionInitSize=41943040, sysRegionMaxSize=104857600, pageSize=4096, concLvl=0, dfltDataRegConf=DataRegionConfiguration [name=default, maxSize=104857600, initSize=268435456, swapPath=null, pageEvictionMode=DISABLED, pageReplacementMode=CLOCK, evictionThreshold=0.9, emptyPagesPoolSize=100, metricsEnabled=false, metricsSubIntervalCount=5, metricsRateTimeInterval=60000, persistenceEnabled=true, checkpointPageBufSize=0, lazyMemoryAllocation=true, warmUpCfg=null], dataRegions=null, storagePath=null, checkpointFreq=30000, lockWaitTime=10000, checkpointThreads=4, checkpointWriteOrder=SEQUENTIAL, walHistSize=20, maxWalArchiveSize=20971520, walSegments=10, walSegmentSize=1048576, walPath=db/wal, walArchivePath=db/wal/archive, cdcWalPath=db/wal/cdc, cdcEnabled=false, metricsEnabled=false, walMode=LOG_ONLY, walTlbSize=131072, walBuffSize=0, walFlushFreq=2000, walFsyncDelay=1000, walRecordIterBuffSize=67108864, alwaysWriteFullPages=false, fileIOFactory=org.apache.ignite.internal.processors.cache.persistence.file.AsyncFileIOFactory@6136cf87, metricsSubIntervalCnt=5, metricsRateTimeInterval=60000, walAutoArchiveAfterInactivity=-1, walForceArchiveTimeout=-1, writeThrottlingEnabled=false, walCompactionEnabled=false, walCompactionLevel=1, checkpointReadLockTimeout=null, walPageCompression=DISABLED, walPageCompressionLevel=null, dfltWarmUpCfg=null, encCfg=org.apache.ignite.configuration.EncryptionConfiguration@24265b67, defragmentationThreadPoolSize=4, minWalArchiveSize=-1], snapshotPath=snapshots, activeOnStart=true, activeOnStartPropSetFlag=false, autoActivation=true, autoActivationPropSetFlag=false, clusterStateOnStart=null, sqlConnCfg=null, cliConnCfg=ClientConnectorConfiguration [host=null, port=10800, portRange=100, sockSndBufSize=0, sockRcvBufSize=0, tcpNoDelay=true, maxOpenCursorsPerConn=128, threadPoolSize=24, selectorCnt=12, idleTimeout=0, handshakeTimeout=10000, jdbcEnabled=true, odbcEnabled=true, thinCliEnabled=true, sslEnabled=false, useIgniteSslCtxFactory=true, sslClientAuth=false, sslCtxFactory=null, thinCliCfg=ThinClientConfiguration [maxActiveTxPerConn=100, maxActiveComputeTasksPerConn=0]], mvccVacuumThreadCnt=2, mvccVacuumFreq=5000, authEnabled=false, failureHnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]], commFailureRslvr=null, sqlCfg=SqlConfiguration [longQryWarnTimeout=3000, dfltQryTimeout=0, sqlQryHistSize=1000, validationEnabled=false], asyncContinuationExecutor=null] [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,595][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-2] Daemon mode: off [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,595][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-2] OS: Linux 4.15.0-151-generic amd64 [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,596][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-2] OS user: teamcity [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,597][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-2] PID: 16724 [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,597][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-2] Language runtime: Java Platform API Specification ver. 1.8 [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,597][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-2] VM information: Java(TM) SE Runtime Environment 1.8.0_261-b12 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 25.261-b12 [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,598][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-2] VM total memory: 1.9GB [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,598][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-2] Remote Management [restart: off, REST: off, JMX (remote: off)] [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,598][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-2] Logger: GridTestLog4jLogger [quiet=false, config=null] [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,599][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-2] IGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,599][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-2] VM arguments: [-DIGNITE_DUMP_THREADS_ON_FAILURE=false, -DMono=/usr/bin/mono-sgen, -DMono4.0_x64=/usr/lib/mono/4.0, -DMono4.5_x64=/usr/lib/mono/4.5, -DMonoVersion=6.12.0.90, -DSKIP_BUILD=false, -Dagent.home.dir=/opt/buildagent, -Dagent.name=aitc-lin02_03, -Dagent.ownPort=9090, -Dagent.work.dir=/opt/buildagent/work, -Dbuild.number=95, -Dbuild.vcs.number=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.1=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.GitHubApacheIgnite=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dclassworlds.conf=/opt/buildagent/temp/buildTmp/teamcity.m2.conf, -Dcom.jetbrains.maven.watcher.report.file=/opt/buildagent/temp/buildTmp/maven-build-info.xml, -Djava.io.tmpdir=/opt/buildagent/temp/buildTmp, -Dmaven.home=/opt/buildagent/tools/maven3_6, -Dmaven.multiModuleProjectDirectory=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.agent.cpuBenchmark=457, -Dteamcity.agent.dotnet.agent_url=http://localhost:9090/RPC2, -Dteamcity.agent.dotnet.build_id=6278078, -Dteamcity.auth.password=*******, -Dteamcity.auth.userId=TeamCityBuildId=6278078, -Dteamcity.build.changedFiles.file=/opt/buildagent/temp/buildTmp/changedFiles6342607772318147725.txt, -Dteamcity.build.checkoutDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.build.id=6278078, -Dteamcity.build.properties.file=/opt/buildagent/temp/buildTmp/teamcity.build5164517880467851002.properties, -Dteamcity.build.tempDir=/opt/buildagent/temp/buildTmp, -Dteamcity.build.workingDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.buildConfName=Basic 3, -Dteamcity.buildType.id=IgniteTests24Java8_Basic3, -Dteamcity.configuration.properties.file=/opt/buildagent/temp/buildTmp/teamcity.config5591980786735343870.properties, -Dteamcity.maven.userSettings.path=/opt/buildagent/temp/buildTmp/maven_settings_585072866407032347.xml, -Dteamcity.maven.watcher.home=/opt/buildagent/plugins/mavenPlugin/maven-watcher-jdk16, -Dteamcity.projectName=Ignite Tests 2.x (JDK 8/11), -Dteamcity.runner.properties.file=/opt/buildagent/temp/buildTmp/teamcity.runner9098465561618137420.properties, -Dteamcity.tests.recentlyFailedTests.file=/opt/buildagent/temp/buildTmp/testsToRunFirst3891775683130404069.txt, -Dteamcity.version=2021.2 (build 99542), -ea, -Xms2g, -Xmx2g, -XX:+HeapDumpOnOutOfMemoryError, -DIGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_TEST_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_UPDATE_NOTIFIER=false, -DIGNITE_NO_DISCO_ORDER=true, -DIGNITE_PERFORMANCE_SUGGESTIONS_DISABLED=true, -Djava.net.preferIPv4Stack=true, -DTEST_SCALE_FACTOR=1.0, -DIGNITE_TEST_PROP_LOG4J_FILE=log4j-tc-test.xml, -DIGNITE_QUIET=false, -DIGNITE_MARSHAL_BUFFERS_RECHECK=1000, -Dmaven.repo.local=/opt/buildagent/.m2/repository] [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,603][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-2] System cache's DataRegion size is configured to 40 MB. Use DataStorageConfiguration.systemRegionInitialSize property to change the setting. [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,603][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-2] Configured caches [in 'sysMemPlc' dataRegion: ['ignite-sys-cache']] [21:14:47]W: [org.apache.ignite:ignite-core] [2021-11-19 21:14:47,604][WARN ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-2] Peer class loading is enabled (disable it in production for performance and deployment consistency reasons) [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,604][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-2] 3-rd party licenses can be found at: /opt/buildagent/work/7bc1c54bc719b67c/libs/licenses [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,607][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] Configured plugins: [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,608][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- StanByClusterTestProvider 1.0 [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,608][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,608][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,608][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- PageMemory tracker plugin 1.0 [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,608][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,608][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,609][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- TestDistibutedConfigurationPlugin 1.0 [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,609][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,609][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,609][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- NodeValidationPluginProvider 1.0 [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,609][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,610][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,610][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][FailureProcessor] Configured failure handler: [hnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]]] [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,620][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][TestRecordingCommunicationSpi] Successfully bound communication NIO server to TCP port [port=47102, locHost=/127.0.0.1, selectorsCnt=12, selectorSpins=0, pairedConn=false] [21:14:47]W: [org.apache.ignite:ignite-core] [2021-11-19 21:14:47,621][WARN ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][TestRecordingCommunicationSpi] Message queue limit is set to 0 which may lead to potential OOMEs when running cache operations in FULL_ASYNC or PRIMARY_SYNC modes due to message queues growth on sender and receiver sides. [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,624][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][GridCollisionManager] Collision resolution is disabled (all jobs will be activated upon arrival). [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,625][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-2] Security status [authentication=off, sandbox=off, tls/ssl=off] [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,690][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,704][INFO ][db-checkpoint-thread-#25168%grid-0%][Checkpointer] Checkpoint finished [cpId=053b2206-7f27-4b4b-bb3d-61fef63ddde2, pages=31, markPos=WALPointer [idx=0, fileOff=492428, len=2121], walSegmentsCovered=[], markDuration=5ms, pagesWrite=12ms, fsync=227ms, total=245ms] [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,704][INFO ][db-checkpoint-thread-#25173%grid-1%][Checkpointer] Checkpoint finished [cpId=55c74154-c642-42f3-8ea1-96c0ec3d4ecc, pages=31, markPos=WALPointer [idx=0, fileOff=492463, len=2121], walSegmentsCovered=[], markDuration=4ms, pagesWrite=11ms, fsync=227ms, total=244ms] [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,783][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][MaintenanceProcessor] Resolved store directory for node persistent data: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_2 [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,784][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][CacheObjectBinaryProcessorImpl] Resolved directory for serialized binary metadata: /opt/buildagent/work/7bc1c54bc719b67c/work/db/binary_meta/grid_2 [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,788][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_2 [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,789][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][FileWriteAheadLogManager] Resolved write ahead log work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_2 [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,789][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][FileWriteAheadLogManager] Resolved write ahead log archive directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_2 [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,791][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][FileHandleManagerImpl] Initialized write-ahead log manager [mode=LOG_ONLY] [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,797][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Configured data regions initialized successfully [total=5] [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,800][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][IgniteSnapshotManager] Resolved snapshot work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/snapshots [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,800][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][IgniteSnapshotManager] Resolved temp directory for snapshot creation: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_2/snp [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,803][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][ClientListenerProcessor] Client connector processor has started on TCP port 10802 [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,805][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-2] Non-loopback local IPs: 172.17.0.4 [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,805][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-2] Enabled local MACs: 0242AC110004 [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,806][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=/opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_2/cp/1637345686412-f1605990-ff6f-4840-9596-1c7b752e4ea1-START.bin, endMarker=/opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_2/cp/1637345686412-f1605990-ff6f-4840-9596-1c7b752e4ea1-END.bin] [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,808][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,808][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=1, fileOff=58434, len=2105], lastMarked=WALPointer [idx=1, fileOff=58434, len=2105], lastCheckpointId=f1605990-ff6f-4840-9596-1c7b752e4ea1] [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,812][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Found last checkpoint marker [cpId=f1605990-ff6f-4840-9596-1c7b752e4ea1, pos=WALPointer [idx=1, fileOff=58434, len=2105]] [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,814][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Applying lost metastore updates since last checkpoint record [lastMarked=WALPointer [idx=1, fileOff=58434, len=2105], lastCheckpointId=f1605990-ff6f-4840-9596-1c7b752e4ea1] [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,817][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=0 ms] [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,817][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Restoring partition state for local groups. [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,817][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=0, partitionsProcessed=0, time=0ms] [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,826][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][GridClusterStateProcessor] Restoring history for BaselineTopology[id=1] [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,828][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][ClusterProcessor] Cluster ID and tag has been read from metastorage: ClusterIdAndTag [id=b67f5159-9231-44d3-a424-19e9051439ca, tag=cranky_darwin] [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,828][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][IgniteClusterImpl] Shutdown policy was updated [oldVal=null, newVal=null] [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,829][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustEnabled' was changed from 'null' to 'false' [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,829][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustTimeout' was changed from 'null' to '300000' [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,830][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][IgniteTxManager] Transactions parameter 'txOwnerDumpRequestsAllowed' was changed from 'null' to 'true' [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,830][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][IgniteTxManager] Transactions parameter 'longOperationsDumpTimeout' was changed from 'null' to '60000' [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,830][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpThreshold' was changed from 'null' to '0' [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,831][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][IgniteTxManager] Transactions parameter 'transactionTimeDumpSamplesCoefficient' was changed from 'null' to '0.0' [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,831][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpSamplesPerSecondLimit' was changed from 'null' to '5' [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,832][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][IgniteTxManager] Transactions parameter 'collisionsDumpInterval' was changed from 'null' to '1000' [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,832][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Historical rebalance WAL threshold changed [property=historical.rebalance.threshold, oldVal=null, newVal=500] [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,833][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Checkpoint frequency deviation changed [oldVal=null, newVal=null] [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,834][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][FilePageStoreManager] Cleanup cache stores [total=1, left=0, cleanFiles=false] [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,837][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,838][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,840][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,841][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Data Regions Started: 5 [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,841][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] ^-- sysMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:14:47] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:14:47] : [Step 4/5] ^-- default region [type=default, persistence=true, lazyAlloc=true, [21:14:47] : [Step 4/5] ... initCfg=100MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB, allocTotal=0MB] [21:14:47] : [Step 4/5] ^-- metastoreMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:14:47] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:14:47] : [Step 4/5] ^-- TxLog region [type=internal, persistence=true, lazyAlloc=false, [21:14:47] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:14:47] : [Step 4/5] ^-- volatileDsMemPlc region [type=user, persistence=false, lazyAlloc=true, [21:14:47] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB] [21:14:47] : [Step 4/5] ^-- Ignite persistence [used=0MB] [21:14:47] : [Step 4/5] [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,843][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Starting binary memory restore for: [-2100569601, 1613773252] [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,855][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=/opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_2/cp/1637345686412-f1605990-ff6f-4840-9596-1c7b752e4ea1-START.bin, endMarker=/opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_2/cp/1637345686412-f1605990-ff6f-4840-9596-1c7b752e4ea1-END.bin] [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,855][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=1, fileOff=58434, len=2105], lastMarked=WALPointer [idx=1, fileOff=58434, len=2105], lastCheckpointId=f1605990-ff6f-4840-9596-1c7b752e4ea1] [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,859][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Found last checkpoint marker [cpId=f1605990-ff6f-4840-9596-1c7b752e4ea1, pos=WALPointer [idx=1, fileOff=58434, len=2105]] [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,860][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Binary memory state restored at node startup [restoredPtr=WALPointer [idx=1, fileOff=60539, len=0]] [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,861][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_2/0000000000000001.wal, offset=60539, ver=2] [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,863][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Started cache in recovery mode [name=ignite-sys-cache, id=-2100569601, dataRegionName=sysMemPlc, mode=REPLICATED, atomicity=TRANSACTIONAL, backups=2147483647, mvcc=false] [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,866][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,870][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Started cache in recovery mode [name=encrypted, id=1613773252, dataRegionName=default, mode=PARTITIONED, atomicity=ATOMIC, backups=2, mvcc=false] [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,871][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Binary recovery performed in 28 ms. [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,872][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=/opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_2/cp/1637345686412-f1605990-ff6f-4840-9596-1c7b752e4ea1-START.bin, endMarker=/opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_2/cp/1637345686412-f1605990-ff6f-4840-9596-1c7b752e4ea1-END.bin] [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,873][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Applying lost cache updates since last checkpoint record [lastMarked=WALPointer [idx=1, fileOff=58434, len=2105], lastCheckpointId=f1605990-ff6f-4840-9596-1c7b752e4ea1] [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,875][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=0 ms] [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,875][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Restoring partition state for local groups. [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,889][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=2, partitionsProcessed=108, time=20ms] [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,892][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][TestTcpDiscoverySpi] Successfully bound to TCP port [port=47502, localHost=localhost/127.0.0.1, locNodeId=20c1c79e-1db1-4503-9f95-a128e7d43002] [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,894][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][GridEncryptionManager] Sending stored group keys to coordinator [grps=1613773252] [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,897][INFO ][tcp-disco-srvr-[:47500]-#1312%grid-0%-#25030%grid-0%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=48087] [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,897][INFO ][tcp-disco-srvr-[:47500]-#1312%grid-0%-#25030%grid-0%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=48087] [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,898][INFO ][tcp-disco-sock-reader-[]-#1327%grid-0%-#25304%grid-0%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:48087, rmtPort=48087] [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,899][INFO ][tcp-disco-sock-reader-[20c1c79e 127.0.0.1:48087]-#1327%grid-0%-#25304%grid-0%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=20c1c79e-1db1-4503-9f95-a128e7d43002, rmtAddr=/127.0.0.1:48087] [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,900][INFO ][tcp-disco-srvr-[:47502]-#1326%grid-2%-#25303%grid-2%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=56693] [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,901][INFO ][tcp-disco-srvr-[:47502]-#1326%grid-2%-#25303%grid-2%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=56693] [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,901][INFO ][tcp-disco-sock-reader-[]-#1328%grid-2%-#25305%grid-2%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:56693, rmtPort=56693] [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,902][INFO ][tcp-disco-sock-reader-[]-#1328%grid-2%-#25305%grid-2%][TestTcpDiscoverySpi] Received ping request from the remote node [rmtNodeId=001453bf-3a34-4024-94a8-b650d7354000, rmtAddr=/127.0.0.1:56693, rmtPort=56693] [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,902][INFO ][tcp-disco-sock-reader-[]-#1328%grid-2%-#25305%grid-2%][TestTcpDiscoverySpi] Finished writing ping response [rmtNodeId=001453bf-3a34-4024-94a8-b650d7354000, rmtAddr=/127.0.0.1:56693, rmtPort=56693] [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,903][INFO ][tcp-disco-sock-reader-[20c1c79e 127.0.0.1:48087]-#1327%grid-0%-#25304%grid-0%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:48087, rmtPort=48087, rmtNodeId=20c1c79e-1db1-4503-9f95-a128e7d43002] [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,903][INFO ][tcp-disco-sock-reader-[]-#1328%grid-2%-#25305%grid-2%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:56693, rmtPort=56693, rmtNodeId=null] [21:14:47]W: [org.apache.ignite:ignite-core] [2021-11-19 21:14:47,905][WARN ][disco-pool-#25306%grid-0%][TestTcpDiscoverySpi] Cache key differs! Node join is rejected. [node=20c1c79e-1db1-4503-9f95-a128e7d43002, grp=1613773252] [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,906][INFO ][tcp-disco-srvr-[:47502]-#1326%grid-2%-#25303%grid-2%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=39059] [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,906][INFO ][tcp-disco-srvr-[:47502]-#1326%grid-2%-#25303%grid-2%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=39059] [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,907][INFO ][tcp-disco-sock-reader-[]-#1329%grid-2%-#25307%grid-2%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:39059, rmtPort=39059] [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,908][INFO ][tcp-disco-sock-reader-[001453bf 127.0.0.1:39059]-#1329%grid-2%-#25307%grid-2%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=001453bf-3a34-4024-94a8-b650d7354000, rmtAddr=/127.0.0.1:39059] [21:14:47]W: [org.apache.ignite:ignite-core] [2021-11-19 21:14:47,910][ERROR][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-2] Failed to start manager: GridManagerAdapter [enabled=true, name=o.a.i.i.managers.discovery.GridDiscoveryManager] [21:14:47]W: [org.apache.ignite:ignite-core] class org.apache.ignite.IgniteCheckedException: Failed to start SPI: TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=5000, ackTimeout=5000, marsh=JdkMarshaller [clsFilter=org.apache.ignite.marshaller.MarshallerUtils$1@7dad3ed3], reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false] [21:14:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.managers.GridManagerAdapter.startSpi(GridManagerAdapter.java:281) [21:14:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.managers.discovery.GridDiscoveryManager.start(GridDiscoveryManager.java:1091) [21:14:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.IgniteKernal.startManager(IgniteKernal.java:1953) [21:14:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.IgniteKernal.start(IgniteKernal.java:1300) [21:14:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.IgnitionEx$IgniteNamedInstance.start0(IgnitionEx.java:1798) [21:14:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.IgnitionEx$IgniteNamedInstance.start(IgnitionEx.java:1720) [21:14:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.IgnitionEx.start0(IgnitionEx.java:1159) [21:14:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.IgnitionEx.start(IgnitionEx.java:629) [21:14:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.testframework.junits.GridAbstractTest.startGrid(GridAbstractTest.java:1252) [21:14:47] : [Step 4/5] [2021-11-19 21:14:47,910][INFO ][tcp-disco-sock-reader-[001453bf 127.0.0.1:39059]-#1329%grid-2%-#25307%grid-2%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:39059, rmtPort=39059, rmtNodeId=001453bf-3a34-4024-94a8-b650d7354000] [21:14:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.testframework.junits.GridAbstractTest.startGrid(GridAbstractTest.java:1169) [21:14:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.testframework.junits.GridAbstractTest.startGrid(GridAbstractTest.java:1145) [21:14:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.encryption.CacheGroupKeyChangeTest.lambda$testNodeJoinRejectedIfKeyCannotBeReplaced$3(CacheGroupKeyChangeTest.java:593) [21:14:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.testframework.GridTestUtils.assertThrowsAnyCause(GridTestUtils.java:545) [21:14:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.encryption.CacheGroupKeyChangeTest.testNodeJoinRejectedIfKeyCannotBeReplaced(CacheGroupKeyChangeTest.java:592) [21:14:47]W: [org.apache.ignite:ignite-core] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) [21:14:47]W: [org.apache.ignite:ignite-core] at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) [21:14:47]W: [org.apache.ignite:ignite-core] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [21:14:47]W: [org.apache.ignite:ignite-core] at java.lang.reflect.Method.invoke(Method.java:498) [21:14:47]W: [org.apache.ignite:ignite-core] at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50) [21:14:47]W: [org.apache.ignite:ignite-core] at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) [21:14:47]W: [org.apache.ignite:ignite-core] at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47) [21:14:47]W: [org.apache.ignite:ignite-core] at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) [21:14:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.testframework.junits.GridAbstractTest$7.run(GridAbstractTest.java:2432) [21:14:47]W: [org.apache.ignite:ignite-core] at java.lang.Thread.run(Thread.java:748) [21:14:47]W: [org.apache.ignite:ignite-core] Caused by: class org.apache.ignite.spi.IgniteSpiException: Cache key differs! Node join is rejected. [21:14:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.discovery.tcp.TcpDiscoverySpi.checkFailedError(TcpDiscoverySpi.java:2108) [21:14:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.discovery.tcp.ServerImpl.joinTopology(ServerImpl.java:1206) [21:14:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.discovery.tcp.ServerImpl.spiStart(ServerImpl.java:474) [21:14:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.discovery.tcp.TcpDiscoverySpi.spiStart(TcpDiscoverySpi.java:2210) [21:14:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.managers.GridManagerAdapter.startSpi(GridManagerAdapter.java:278) [21:14:47]W: [org.apache.ignite:ignite-core] ... 23 more [21:14:47]W: [org.apache.ignite:ignite-core] [2021-11-19 21:14:47,915][ERROR][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-2] Got exception while starting (will rollback startup routine). [21:14:47]W: [org.apache.ignite:ignite-core] class org.apache.ignite.IgniteCheckedException: Failed to start manager: GridManagerAdapter [enabled=true, name=org.apache.ignite.internal.managers.discovery.GridDiscoveryManager] [21:14:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.IgniteKernal.startManager(IgniteKernal.java:1958) [21:14:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.IgniteKernal.start(IgniteKernal.java:1300) [21:14:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.IgnitionEx$IgniteNamedInstance.start0(IgnitionEx.java:1798) [21:14:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.IgnitionEx$IgniteNamedInstance.start(IgnitionEx.java:1720) [21:14:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.IgnitionEx.start0(IgnitionEx.java:1159) [21:14:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.IgnitionEx.start(IgnitionEx.java:629) [21:14:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.testframework.junits.GridAbstractTest.startGrid(GridAbstractTest.java:1252) [21:14:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.testframework.junits.GridAbstractTest.startGrid(GridAbstractTest.java:1169) [21:14:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.testframework.junits.GridAbstractTest.startGrid(GridAbstractTest.java:1145) [21:14:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.encryption.CacheGroupKeyChangeTest.lambda$testNodeJoinRejectedIfKeyCannotBeReplaced$3(CacheGroupKeyChangeTest.java:593) [21:14:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.testframework.GridTestUtils.assertThrowsAnyCause(GridTestUtils.java:545) [21:14:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.encryption.CacheGroupKeyChangeTest.testNodeJoinRejectedIfKeyCannotBeReplaced(CacheGroupKeyChangeTest.java:592) [21:14:47]W: [org.apache.ignite:ignite-core] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) [21:14:47]W: [org.apache.ignite:ignite-core] at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) [21:14:47]W: [org.apache.ignite:ignite-core] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [21:14:47]W: [org.apache.ignite:ignite-core] at java.lang.reflect.Method.invoke(Method.java:498) [21:14:47]W: [org.apache.ignite:ignite-core] at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50) [21:14:47]W: [org.apache.ignite:ignite-core] at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) [21:14:47]W: [org.apache.ignite:ignite-core] at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47) [21:14:47]W: [org.apache.ignite:ignite-core] at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) [21:14:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.testframework.junits.GridAbstractTest$7.run(GridAbstractTest.java:2432) [21:14:47]W: [org.apache.ignite:ignite-core] at java.lang.Thread.run(Thread.java:748) [21:14:47]W: [org.apache.ignite:ignite-core] Caused by: class org.apache.ignite.IgniteCheckedException: Failed to start SPI: TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=5000, ackTimeout=5000, marsh=JdkMarshaller [clsFilter=org.apache.ignite.marshaller.MarshallerUtils$1@7dad3ed3], reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false] [21:14:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.managers.GridManagerAdapter.startSpi(GridManagerAdapter.java:281) [21:14:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.managers.discovery.GridDiscoveryManager.start(GridDiscoveryManager.java:1091) [21:14:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.IgniteKernal.startManager(IgniteKernal.java:1953) [21:14:47]W: [org.apache.ignite:ignite-core] ... 21 more [21:14:47]W: [org.apache.ignite:ignite-core] Caused by: class org.apache.ignite.spi.IgniteSpiException: Cache key differs! Node join is rejected. [21:14:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.discovery.tcp.TcpDiscoverySpi.checkFailedError(TcpDiscoverySpi.java:2108) [21:14:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.discovery.tcp.ServerImpl.joinTopology(ServerImpl.java:1206) [21:14:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.discovery.tcp.ServerImpl.spiStart(ServerImpl.java:474) [21:14:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.discovery.tcp.TcpDiscoverySpi.spiStart(TcpDiscoverySpi.java:2210) [21:14:47]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.managers.GridManagerAdapter.startSpi(GridManagerAdapter.java:278) [21:14:47]W: [org.apache.ignite:ignite-core] ... 23 more [21:14:52] : [Step 4/5] [2021-11-19 21:14:52,926][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][TestTcpDiscoverySpi] No verification for local node leave has been received from coordinator (will stop node anyway). [21:14:52] : [Step 4/5] [2021-11-19 21:14:52,975][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Stopped cache [cacheName=encrypted] [21:14:52] : [Step 4/5] [2021-11-19 21:14:52,976][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Stopped cache [cacheName=ignite-sys-cache] [21:14:53] : [Step 4/5] [2021-11-19 21:14:53,120][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][FilePageStoreManager] Cleanup cache stores [total=4, left=0, cleanFiles=false] [21:14:53] : [Step 4/5] [2021-11-19 21:14:53,133][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-2] [21:14:53] : [Step 4/5] [21:14:53] : [Step 4/5] >>> +------------------------------------------------------+ [21:14:53] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV stopped OK [21:14:53] : [Step 4/5] >>> +------------------------------------------------------+ [21:14:53] : [Step 4/5] >>> Ignite instance name: grid-2 [21:14:53] : [Step 4/5] >>> Grid uptime: 00:00:05.547 [21:14:53] : [Step 4/5] [21:14:53] : [Step 4/5] [21:14:53] : [Step 4/5] [2021-11-19 21:14:53,133][INFO ][test-runner-#24485%encryption.CacheGroupKeyChangeTest%][root] Caught expected exception: Cache key differs! Node join is rejected. [21:14:53] : [Step 4/5] [21:14:53] >>> Stopping test: CacheGroupKeyChangeTest#testNodeJoinRejectedIfKeyCannotBeReplaced in 13833 ms <<< [21:14:53] : [Step 4/5] [2021-11-19 21:14:53,134][INFO ][main][root] >>> Stopping test: CacheGroupKeyChangeTest#testNodeJoinRejectedIfKeyCannotBeReplaced in 13833 ms <<< [21:14:53] : [Step 4/5] [21:14:53] >>> Heap: 390 MB used / 1937 MB commited / 1937 MB max <<< [21:14:53] : [Step 4/5] [2021-11-19 21:14:53,135][INFO ][main][root] >>> Heap: 390 MB used / 1937 MB commited / 1937 MB max <<< [21:14:53] : [Step 4/5] [21:14:53] >>> Non-Heap: 170 MB used / 189 MB commited / 0 MB max <<< [21:14:53] : [Step 4/5] [2021-11-19 21:14:53,135][INFO ][main][root] >>> Non-Heap: 170 MB used / 189 MB commited / 0 MB max <<< [21:14:53] : [Step 4/5] [2021-11-19 21:14:53,135][INFO ][main][root] >>> Stopping grid [name=grid-1, id=10d49353-9c6c-48fe-93a8-85c33fc9b001] [21:14:53] : [Step 4/5] [2021-11-19 21:14:53,323][INFO ][db-checkpoint-thread-#25173%grid-1%][Checkpointer] Checkpoint started [checkpointId=5e244cea-ce02-448b-8418-309a3bdb91ba, startPtr=WALPointer [idx=0, fileOff=889210, len=2105], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=44ms, writeCheckpointEntryDuration=133ms, splitAndSortCpPagesDuration=0ms, pages=94, reason='timeout'] [21:14:53] : [Step 4/5] [2021-11-19 21:14:53,334][INFO ][tcp-disco-sock-reader-[001453bf 127.0.0.1:39085]-#1320%grid-1%-#25153%grid-1%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:39085, rmtPort=39085, rmtNodeId=001453bf-3a34-4024-94a8-b650d7354000] [21:14:53] : [Step 4/5] [2021-11-19 21:14:53,335][INFO ][disco-event-worker-#25032%grid-0%][GridDiscoveryManager] Node left topology: TcpDiscoveryNode [id=10d49353-9c6c-48fe-93a8-85c33fc9b001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637345687375, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false] [21:14:53] : [Step 4/5] [2021-11-19 21:14:53,336][INFO ][main][GridCacheProcessor] Stopped cache [cacheName=encrypted] [21:14:53] : [Step 4/5] [2021-11-19 21:14:53,337][INFO ][disco-event-worker-#25032%grid-0%][GridDiscoveryManager] Topology snapshot [ver=3, locNode=001453bf, servers=1, clients=0, state=ACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=001453bf-3a34-4024-94a8-b650d7354000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:14:53] : [Step 4/5] [2021-11-19 21:14:53,337][INFO ][main][GridCacheProcessor] Stopped cache [cacheName=ignite-sys-cache] [21:14:53] : [Step 4/5] [2021-11-19 21:14:53,337][INFO ][disco-event-worker-#25032%grid-0%][GridDiscoveryManager] ^-- Baseline [id=1, size=3, online=1, offline=2] [21:14:53] : [Step 4/5] [2021-11-19 21:14:53,340][INFO ][exchange-worker-#25033%grid-0%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], crd=true, evt=NODE_LEFT, evtNode=10d49353-9c6c-48fe-93a8-85c33fc9b001, customEvt=null, allowMerge=false, exchangeFreeSwitch=true] [21:14:53] : [Step 4/5] [2021-11-19 21:14:53,341][INFO ][sys-#25009%grid-0%][GridAffinityAssignmentCache] Local node affinity assignment distribution is not ideal [cache=encrypted, expectedPrimary=8.00, actualPrimary=8, expectedBackups=16.00, actualBackups=0, warningThreshold=50.00%] [21:14:53] : [Step 4/5] [2021-11-19 21:14:53,342][INFO ][exchange-worker-#25033%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:14:53] : [Step 4/5] [2021-11-19 21:14:53,343][INFO ][exchange-worker-#25033%grid-0%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], err=null, rebalanced=true, wasRebalanced=true] [21:14:53] : [Step 4/5] [2021-11-19 21:14:53,344][INFO ][exchange-worker-#25033%grid-0%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=001453bf-3a34-4024-94a8-b650d7354000, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], evt=NODE_LEFT, evtNode=TcpDiscoveryNode [id=10d49353-9c6c-48fe-93a8-85c33fc9b001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637345687375, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0]] [21:14:53] : [Step 4/5] [2021-11-19 21:14:53,345][INFO ][exchange-worker-#25033%grid-0%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (0 ms), stage="Determine exchange type" (1 ms), stage="Preloading notification" (0 ms), stage="After states restored callback" (0 ms), stage="WAL history reservation" (0 ms), stage="Finalize update counters" (0 ms), stage="Detect lost partitions" (1 ms), stage="Exchange done" (1 ms), stage="Total time" (3 ms)] [21:14:53] : [Step 4/5] [2021-11-19 21:14:53,346][INFO ][exchange-worker-#25033%grid-0%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], stage="Affinity initialization (exchange-free switch on fully-rebalanced topology) [grp=encrypted]" (1 ms) (parent=Determine exchange type), stage="Affinity initialization (exchange-free switch on fully-rebalanced topology) [grp=ignite-sys-cache]" (0 ms) (parent=Determine exchange type)] [21:14:53] : [Step 4/5] [2021-11-19 21:14:53,348][INFO ][exchange-worker-#25033%grid-0%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], crd=true] [21:14:53] : [Step 4/5] [2021-11-19 21:14:53,349][INFO ][exchange-worker-#25033%grid-0%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=3, minorTopVer=0], force=false, evt=NODE_LEFT, node=10d49353-9c6c-48fe-93a8-85c33fc9b001] [21:14:53] : [Step 4/5] [2021-11-19 21:14:53,487][INFO ][main][FilePageStoreManager] Cleanup cache stores [total=4, left=0, cleanFiles=false] [21:14:53]W: [org.apache.ignite:ignite-core] [2021-11-19 21:14:53,491][WARN ][main][GridEncryptionManager] Reencryption cancelled [grp=1613773252] [21:14:53] : [Step 4/5] [2021-11-19 21:14:53,492][INFO ][main][GridDeploymentLocalStore] Removed undeployed class: GridDeployment [ts=1637345687476, depMode=SHARED, clsLdr=IsolatedClassLoader{roleName='test'}, clsLdrId=ca03e593d71-10d49353-9c6c-48fe-93a8-85c33fc9b001, userVer=0, loc=true, sampleClsName=org.apache.ignite.internal.processors.cache.distributed.dht.preloader.IgniteDhtPartitionCountersMap2, pendingUndeploy=false, undeployed=true, usage=0] [21:14:53] : [Step 4/5] [2021-11-19 21:14:53,503][INFO ][main][IgniteKernal%grid-1] [21:14:53] : [Step 4/5] [21:14:53] : [Step 4/5] >>> +------------------------------------------------------+ [21:14:53] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV stopped OK [21:14:53] : [Step 4/5] >>> +------------------------------------------------------+ [21:14:53] : [Step 4/5] >>> Ignite instance name: grid-1 [21:14:53] : [Step 4/5] >>> Grid uptime: 00:00:06.072 [21:14:53] : [Step 4/5] [21:14:53] : [Step 4/5] [21:14:53] : [Step 4/5] [2021-11-19 21:14:53,504][INFO ][main][root] >>> Stopping grid [name=grid-0, id=001453bf-3a34-4024-94a8-b650d7354000] [21:14:53] : [Step 4/5] [2021-11-19 21:14:53,656][INFO ][db-checkpoint-thread-#25168%grid-0%][Checkpointer] Checkpoint started [checkpointId=d8c4d380-80b4-4ee3-9b93-e6459f62ea0b, startPtr=WALPointer [idx=0, fileOff=889210, len=2105], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=69ms, writeCheckpointEntryDuration=76ms, splitAndSortCpPagesDuration=0ms, pages=94, reason='timeout'] [21:14:53] : [Step 4/5] [2021-11-19 21:14:53,660][INFO ][tcp-disco-sock-reader-[10d49353 127.0.0.1:41567]-#1321%grid-0%-#25154%grid-0%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:41567, rmtPort=41567, rmtNodeId=10d49353-9c6c-48fe-93a8-85c33fc9b001] [21:14:53] : [Step 4/5] [2021-11-19 21:14:53,661][INFO ][main][GridCacheProcessor] Stopped cache [cacheName=encrypted] [21:14:53] : [Step 4/5] [2021-11-19 21:14:53,661][INFO ][main][GridCacheProcessor] Stopped cache [cacheName=ignite-sys-cache] [21:14:53] : [Step 4/5] [2021-11-19 21:14:53,779][INFO ][main][FilePageStoreManager] Cleanup cache stores [total=4, left=0, cleanFiles=false] [21:14:53] : [Step 4/5] [2021-11-19 21:14:53,781][INFO ][main][GridDeploymentLocalStore] Removed undeployed class: GridDeployment [ts=1637345687476, depMode=SHARED, clsLdr=IsolatedClassLoader{roleName='test'}, clsLdrId=aa03e593d71-001453bf-3a34-4024-94a8-b650d7354000, userVer=0, loc=true, sampleClsName=org.apache.ignite.internal.processors.cache.distributed.dht.preloader.GridDhtPartitionMap, pendingUndeploy=false, undeployed=true, usage=0] [21:14:53]W: [org.apache.ignite:ignite-core] [2021-11-19 21:14:53,781][WARN ][main][GridEncryptionManager] Reencryption cancelled [grp=1613773252] [21:14:53] : [Step 4/5] [2021-11-19 21:14:53,794][INFO ][main][IgniteKernal%grid-0] [21:14:53] : [Step 4/5] [21:14:53] : [Step 4/5] >>> +------------------------------------------------------+ [21:14:53] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV stopped OK [21:14:53] : [Step 4/5] >>> +------------------------------------------------------+ [21:14:53] : [Step 4/5] >>> Ignite instance name: grid-0 [21:14:53] : [Step 4/5] >>> Grid uptime: 00:00:06.859 [21:14:53] : [Step 4/5] [21:14:53] : [Step 4/5] [21:14:53] : [Step 4/5] [21:14:53] >>> Starting test: CacheGroupKeyChangeTest#testNodeFailsBeforePerform <<< [21:14:53] : [Step 4/5] [2021-11-19 21:14:53,815][INFO ][main][root] >>> Starting test: CacheGroupKeyChangeTest#testNodeFailsBeforePerform <<< [21:14:53] : [Step 4/5] [21:14:53] >>> Heap: 392 MB used / 1937 MB commited / 1937 MB max <<< [21:14:53] : [Step 4/5] [2021-11-19 21:14:53,816][INFO ][main][root] >>> Heap: 392 MB used / 1937 MB commited / 1937 MB max <<< [21:14:53] : [Step 4/5] [21:14:53] >>> Non-Heap: 170 MB used / 189 MB commited / 0 MB max <<< [21:14:53] : [Step 4/5] [2021-11-19 21:14:53,816][INFO ][main][root] >>> Non-Heap: 170 MB used / 189 MB commited / 0 MB max <<< [21:14:53]W: [org.apache.ignite:ignite-core] [2021-11-19 21:14:53,823][WARN ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][G] Ignite work directory is not provided, automatically resolved to: /opt/buildagent/work/7bc1c54bc719b67c/work [21:14:53] : [Step 4/5] [2021-11-19 21:14:53,825][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] [21:14:53] : [Step 4/5] [21:14:53] : [Step 4/5] >>> __________ ________________ [21:14:53] : [Step 4/5] >>> / _/ ___/ |/ / _/_ __/ __/ [21:14:53] : [Step 4/5] >>> _/ // (7 7 // / / / / _/ [21:14:53] : [Step 4/5] >>> /___/\___/_/|_/___/ /_/ /___/ [21:14:53] : [Step 4/5] >>> [21:14:53] : [Step 4/5] >>> ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:14:53] : [Step 4/5] >>> 2021 Copyright(C) Apache Software Foundation [21:14:53] : [Step 4/5] >>> [21:14:53] : [Step 4/5] >>> Ignite documentation: http://ignite.apache.org [21:14:53] : [Step 4/5] [21:14:53] : [Step 4/5] [2021-11-19 21:14:53,827][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] Config URL: n/a [21:14:53] : [Step 4/5] [2021-11-19 21:14:53,827][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] IgniteConfiguration [igniteInstanceName=grid-0, pubPoolSize=24, svcPoolSize=24, callbackPoolSize=24, stripedPoolSize=24, sysPoolSize=24, mgmtPoolSize=4, dataStreamerPoolSize=24, utilityCachePoolSize=24, utilityCacheKeepAliveTime=60000, p2pPoolSize=2, qryPoolSize=24, buildIdxPoolSize=4, igniteHome=/opt/buildagent/work/7bc1c54bc719b67c, igniteWorkDir=/opt/buildagent/work/7bc1c54bc719b67c/work, mbeanSrv=com.sun.jmx.mbeanserver.JmxMBeanServer@6fe85038, nodeId=002379ee-6a1a-434d-99e5-6da3bf448000, marsh=BinaryMarshaller [], marshLocJobs=false, daemon=false, p2pEnabled=true, netTimeout=10000, netCompressionLevel=1, sndRetryDelay=1000, sndRetryCnt=3, metricsHistSize=10000, metricsUpdateFreq=1000, metricsExpTime=9223372036854775807, discoSpi=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=0, ackTimeout=0, marsh=null, reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], segPlc=STOP, segResolveAttempts=2, waitForSegOnStart=true, allResolversPassReq=true, segChkFreq=10000, commSpi=TcpCommunicationSpi [connectGate=org.apache.ignite.spi.communication.tcp.internal.ConnectGateway@14a3c50, ctxInitLatch=java.util.concurrent.CountDownLatch@99a7ca0[Count = 1], stopping=false, clientPool=null, nioSrvWrapper=null, stateProvider=null], evtSpi=MemoryEventStorageSpi [expireAgeMs=9223372036854775807, expireCnt=10000, filter=null], colSpi=NoopCollisionSpi [], deploySpi=LocalDeploymentSpi [], indexingSpi=org.apache.ignite.spi.indexing.noop.NoopIndexingSpi@27e144cc, addrRslvr=null, encryptionSpi=org.apache.ignite.spi.encryption.keystore.KeystoreEncryptionSpi@1f102c1, tracingSpi=org.apache.ignite.spi.tracing.NoopTracingSpi@4e4db05d, clientMode=false, rebalanceThreadPoolSize=4, rebalanceTimeout=10000, rebalanceBatchesPrefetchCnt=3, rebalanceThrottle=0, rebalanceBatchSize=524288, txCfg=TransactionConfiguration [txSerEnabled=false, dfltIsolation=REPEATABLE_READ, dfltConcurrency=PESSIMISTIC, dfltTxTimeout=0, txTimeoutOnPartitionMapExchange=0, deadlockTimeout=10000, pessimisticTxLogSize=0, pessimisticTxLogLinger=10000, tmLookupClsName=null, txManagerFactory=null, useJtaSync=false], cacheSanityCheckEnabled=true, discoStartupDelay=60000, deployMode=SHARED, p2pMissedCacheSize=100, locHost=127.0.0.1, timeSrvPortBase=31100, timeSrvPortRange=100, failureDetectionTimeout=10000, sysWorkerBlockedTimeout=null, clientFailureDetectionTimeout=10000, metricsLogFreq=0, connectorCfg=null, odbcCfg=null, warmupClos=null, atomicCfg=AtomicConfiguration [seqReserveSize=1000, cacheMode=PARTITIONED, backups=1, aff=null, grpName=null], classLdr=null, sslCtxFactory=null, platformCfg=null, binaryCfg=null, memCfg=null, pstCfg=null, dsCfg=DataStorageConfiguration [sysRegionInitSize=41943040, sysRegionMaxSize=104857600, pageSize=4096, concLvl=0, dfltDataRegConf=DataRegionConfiguration [name=default, maxSize=104857600, initSize=268435456, swapPath=null, pageEvictionMode=DISABLED, pageReplacementMode=CLOCK, evictionThreshold=0.9, emptyPagesPoolSize=100, metricsEnabled=false, metricsSubIntervalCount=5, metricsRateTimeInterval=60000, persistenceEnabled=true, checkpointPageBufSize=0, lazyMemoryAllocation=true, warmUpCfg=null], dataRegions=null, storagePath=null, checkpointFreq=30000, lockWaitTime=10000, checkpointThreads=4, checkpointWriteOrder=SEQUENTIAL, walHistSize=20, maxWalArchiveSize=20971520, walSegments=10, walSegmentSize=1048576, walPath=db/wal, walArchivePath=db/wal/archive, cdcWalPath=db/wal/cdc, cdcEnabled=false, metricsEnabled=false, walMode=LOG_ONLY, walTlbSize=131072, walBuffSize=0, walFlushFreq=2000, walFsyncDelay=1000, walRecordIterBuffSize=67108864, alwaysWriteFullPages=false, fileIOFactory=org.apache.ignite.internal.processors.cache.persistence.file.AsyncFileIOFactory@642752b8, metricsSubIntervalCnt=5, metricsRateTimeInterval=60000, walAutoArchiveAfterInactivity=-1, walForceArchiveTimeout=-1, writeThrottlingEnabled=false, walCompactionEnabled=false, walCompactionLevel=1, checkpointReadLockTimeout=null, walPageCompression=DISABLED, walPageCompressionLevel=null, dfltWarmUpCfg=null, encCfg=org.apache.ignite.configuration.EncryptionConfiguration@2bc327f3, defragmentationThreadPoolSize=4, minWalArchiveSize=-1], snapshotPath=snapshots, activeOnStart=true, activeOnStartPropSetFlag=false, autoActivation=true, autoActivationPropSetFlag=false, clusterStateOnStart=null, sqlConnCfg=null, cliConnCfg=ClientConnectorConfiguration [host=null, port=10800, portRange=100, sockSndBufSize=0, sockRcvBufSize=0, tcpNoDelay=true, maxOpenCursorsPerConn=128, threadPoolSize=24, selectorCnt=12, idleTimeout=0, handshakeTimeout=10000, jdbcEnabled=true, odbcEnabled=true, thinCliEnabled=true, sslEnabled=false, useIgniteSslCtxFactory=true, sslClientAuth=false, sslCtxFactory=null, thinCliCfg=ThinClientConfiguration [maxActiveTxPerConn=100, maxActiveComputeTasksPerConn=0]], mvccVacuumThreadCnt=2, mvccVacuumFreq=5000, authEnabled=false, failureHnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]], commFailureRslvr=null, sqlCfg=SqlConfiguration [longQryWarnTimeout=3000, dfltQryTimeout=0, sqlQryHistSize=1000, validationEnabled=false], asyncContinuationExecutor=null] [21:14:53] : [Step 4/5] [2021-11-19 21:14:53,836][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] Daemon mode: off [21:14:53] : [Step 4/5] [2021-11-19 21:14:53,836][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] OS: Linux 4.15.0-151-generic amd64 [21:14:53] : [Step 4/5] [2021-11-19 21:14:53,836][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] OS user: teamcity [21:14:53] : [Step 4/5] [2021-11-19 21:14:53,837][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] PID: 16724 [21:14:53] : [Step 4/5] [2021-11-19 21:14:53,837][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] Language runtime: Java Platform API Specification ver. 1.8 [21:14:53] : [Step 4/5] [2021-11-19 21:14:53,837][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] VM information: Java(TM) SE Runtime Environment 1.8.0_261-b12 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 25.261-b12 [21:14:53] : [Step 4/5] [2021-11-19 21:14:53,838][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] VM total memory: 1.9GB [21:14:53] : [Step 4/5] [2021-11-19 21:14:53,838][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] Remote Management [restart: off, REST: off, JMX (remote: off)] [21:14:53] : [Step 4/5] [2021-11-19 21:14:53,838][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] Logger: GridTestLog4jLogger [quiet=false, config=null] [21:14:53] : [Step 4/5] [2021-11-19 21:14:53,838][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] IGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c [21:14:53] : [Step 4/5] [2021-11-19 21:14:53,839][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] VM arguments: [-DIGNITE_DUMP_THREADS_ON_FAILURE=false, -DMono=/usr/bin/mono-sgen, -DMono4.0_x64=/usr/lib/mono/4.0, -DMono4.5_x64=/usr/lib/mono/4.5, -DMonoVersion=6.12.0.90, -DSKIP_BUILD=false, -Dagent.home.dir=/opt/buildagent, -Dagent.name=aitc-lin02_03, -Dagent.ownPort=9090, -Dagent.work.dir=/opt/buildagent/work, -Dbuild.number=95, -Dbuild.vcs.number=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.1=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.GitHubApacheIgnite=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dclassworlds.conf=/opt/buildagent/temp/buildTmp/teamcity.m2.conf, -Dcom.jetbrains.maven.watcher.report.file=/opt/buildagent/temp/buildTmp/maven-build-info.xml, -Djava.io.tmpdir=/opt/buildagent/temp/buildTmp, -Dmaven.home=/opt/buildagent/tools/maven3_6, -Dmaven.multiModuleProjectDirectory=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.agent.cpuBenchmark=457, -Dteamcity.agent.dotnet.agent_url=http://localhost:9090/RPC2, -Dteamcity.agent.dotnet.build_id=6278078, -Dteamcity.auth.password=*******, -Dteamcity.auth.userId=TeamCityBuildId=6278078, -Dteamcity.build.changedFiles.file=/opt/buildagent/temp/buildTmp/changedFiles6342607772318147725.txt, -Dteamcity.build.checkoutDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.build.id=6278078, -Dteamcity.build.properties.file=/opt/buildagent/temp/buildTmp/teamcity.build5164517880467851002.properties, -Dteamcity.build.tempDir=/opt/buildagent/temp/buildTmp, -Dteamcity.build.workingDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.buildConfName=Basic 3, -Dteamcity.buildType.id=IgniteTests24Java8_Basic3, -Dteamcity.configuration.properties.file=/opt/buildagent/temp/buildTmp/teamcity.config5591980786735343870.properties, -Dteamcity.maven.userSettings.path=/opt/buildagent/temp/buildTmp/maven_settings_585072866407032347.xml, -Dteamcity.maven.watcher.home=/opt/buildagent/plugins/mavenPlugin/maven-watcher-jdk16, -Dteamcity.projectName=Ignite Tests 2.x (JDK 8/11), -Dteamcity.runner.properties.file=/opt/buildagent/temp/buildTmp/teamcity.runner9098465561618137420.properties, -Dteamcity.tests.recentlyFailedTests.file=/opt/buildagent/temp/buildTmp/testsToRunFirst3891775683130404069.txt, -Dteamcity.version=2021.2 (build 99542), -ea, -Xms2g, -Xmx2g, -XX:+HeapDumpOnOutOfMemoryError, -DIGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_TEST_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_UPDATE_NOTIFIER=false, -DIGNITE_NO_DISCO_ORDER=true, -DIGNITE_PERFORMANCE_SUGGESTIONS_DISABLED=true, -Djava.net.preferIPv4Stack=true, -DTEST_SCALE_FACTOR=1.0, -DIGNITE_TEST_PROP_LOG4J_FILE=log4j-tc-test.xml, -DIGNITE_QUIET=false, -DIGNITE_MARSHAL_BUFFERS_RECHECK=1000, -Dmaven.repo.local=/opt/buildagent/.m2/repository] [21:14:53] : [Step 4/5] [2021-11-19 21:14:53,843][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] System cache's DataRegion size is configured to 40 MB. Use DataStorageConfiguration.systemRegionInitialSize property to change the setting. [21:14:53] : [Step 4/5] [2021-11-19 21:14:53,844][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] Configured caches [in 'sysMemPlc' dataRegion: ['ignite-sys-cache']] [21:14:53]W: [org.apache.ignite:ignite-core] [2021-11-19 21:14:53,844][WARN ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] Peer class loading is enabled (disable it in production for performance and deployment consistency reasons) [21:14:53] : [Step 4/5] [2021-11-19 21:14:53,844][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] 3-rd party licenses can be found at: /opt/buildagent/work/7bc1c54bc719b67c/libs/licenses [21:14:53] : [Step 4/5] [2021-11-19 21:14:53,849][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] Configured plugins: [21:14:53] : [Step 4/5] [2021-11-19 21:14:53,849][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- StanByClusterTestProvider 1.0 [21:14:53] : [Step 4/5] [2021-11-19 21:14:53,849][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:14:53] : [Step 4/5] [2021-11-19 21:14:53,849][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] [21:14:53] : [Step 4/5] [2021-11-19 21:14:53,850][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- PageMemory tracker plugin 1.0 [21:14:53] : [Step 4/5] [2021-11-19 21:14:53,850][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:14:53] : [Step 4/5] [2021-11-19 21:14:53,850][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] [21:14:53] : [Step 4/5] [2021-11-19 21:14:53,850][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- TestDistibutedConfigurationPlugin 1.0 [21:14:53] : [Step 4/5] [2021-11-19 21:14:53,850][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:14:53] : [Step 4/5] [2021-11-19 21:14:53,851][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] [21:14:53] : [Step 4/5] [2021-11-19 21:14:53,851][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- NodeValidationPluginProvider 1.0 [21:14:53] : [Step 4/5] [2021-11-19 21:14:53,851][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:14:53] : [Step 4/5] [2021-11-19 21:14:53,851][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] [21:14:53] : [Step 4/5] [2021-11-19 21:14:53,851][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][FailureProcessor] Configured failure handler: [hnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]]] [21:14:53] : [Step 4/5] [2021-11-19 21:14:53,864][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][TestRecordingCommunicationSpi] Successfully bound communication NIO server to TCP port [port=47100, locHost=/127.0.0.1, selectorsCnt=12, selectorSpins=0, pairedConn=false] [21:14:53]W: [org.apache.ignite:ignite-core] [2021-11-19 21:14:53,865][WARN ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][TestRecordingCommunicationSpi] Message queue limit is set to 0 which may lead to potential OOMEs when running cache operations in FULL_ASYNC or PRIMARY_SYNC modes due to message queues growth on sender and receiver sides. [21:14:53] : [Step 4/5] [2021-11-19 21:14:53,869][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][GridCollisionManager] Collision resolution is disabled (all jobs will be activated upon arrival). [21:14:53] : [Step 4/5] [2021-11-19 21:14:53,869][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] Security status [authentication=off, sandbox=off, tls/ssl=off] [21:14:53] : [Step 4/5] [2021-11-19 21:14:53,931][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:14:54] : [Step 4/5] [2021-11-19 21:14:54,024][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][MaintenanceProcessor] Resolved store directory for node persistent data: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0 [21:14:54] : [Step 4/5] [2021-11-19 21:14:54,025][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][CacheObjectBinaryProcessorImpl] Resolved directory for serialized binary metadata: /opt/buildagent/work/7bc1c54bc719b67c/work/db/binary_meta/grid_0 [21:14:54] : [Step 4/5] [2021-11-19 21:14:54,029][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0 [21:14:54] : [Step 4/5] [2021-11-19 21:14:54,030][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][FileWriteAheadLogManager] Resolved write ahead log work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0 [21:14:54] : [Step 4/5] [2021-11-19 21:14:54,030][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][FileWriteAheadLogManager] Resolved write ahead log archive directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0 [21:14:54] : [Step 4/5] [2021-11-19 21:14:54,176][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000000.wal [21:14:54] : [Step 4/5] [2021-11-19 21:14:54,176][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][FileHandleManagerImpl] Initialized write-ahead log manager [mode=LOG_ONLY] [21:14:54]W: [org.apache.ignite:ignite-core] [2021-11-19 21:14:54,177][WARN ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] DataRegion maxSize=104.9 MB is smaller than defaultInitialSize=268.4 MB, setting initialSize to 104.9 MB [21:14:54] : [Step 4/5] [2021-11-19 21:14:54,183][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Configured data regions initialized successfully [total=5] [21:14:54] : [Step 4/5] [2021-11-19 21:14:54,322][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][IgniteSnapshotManager] Resolved snapshot work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/snapshots [21:14:54] : [Step 4/5] [2021-11-19 21:14:54,323][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][IgniteSnapshotManager] Resolved temp directory for snapshot creation: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0/snp [21:14:54] : [Step 4/5] [2021-11-19 21:14:54,325][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][ClientListenerProcessor] Client connector processor has started on TCP port 10800 [21:14:54] : [Step 4/5] [2021-11-19 21:14:54,331][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] Non-loopback local IPs: 172.17.0.4 [21:14:54] : [Step 4/5] [2021-11-19 21:14:54,331][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] Enabled local MACs: 0242AC110004 [21:14:54] : [Step 4/5] [2021-11-19 21:14:54,333][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:14:54] : [Step 4/5] [2021-11-19 21:14:54,335][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:14:54] : [Step 4/5] [2021-11-19 21:14:54,335][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:14:54] : [Step 4/5] [2021-11-19 21:14:54,338][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Applying lost metastore updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:14:54] : [Step 4/5] [2021-11-19 21:14:54,339][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=0 ms] [21:14:54] : [Step 4/5] [2021-11-19 21:14:54,339][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Restoring partition state for local groups. [21:14:54] : [Step 4/5] [2021-11-19 21:14:54,340][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=0, partitionsProcessed=0, time=0ms] [21:14:54] : [Step 4/5] [2021-11-19 21:14:54,340][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][GridEncryptionManager] Encryption keys loaded from metastore. [grps=, masterKeyName=ignite.master.key] [21:14:54] : [Step 4/5] [2021-11-19 21:14:54,345][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][ClusterProcessor] Cluster ID and tag has been read from metastorage: null [21:14:54] : [Step 4/5] [2021-11-19 21:14:54,345][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][IgniteClusterImpl] Shutdown policy was updated [oldVal=null, newVal=null] [21:14:54] : [Step 4/5] [2021-11-19 21:14:54,346][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Checkpoint frequency deviation changed [oldVal=null, newVal=null] [21:14:54] : [Step 4/5] [2021-11-19 21:14:54,524][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][FilePageStoreManager] Cleanup cache stores [total=1, left=0, cleanFiles=false] [21:14:54] : [Step 4/5] [2021-11-19 21:14:54,527][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:14:54] : [Step 4/5] [2021-11-19 21:14:54,528][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:14:54] : [Step 4/5] [2021-11-19 21:14:54,529][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:14:54] : [Step 4/5] [2021-11-19 21:14:54,530][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Data Regions Started: 5 [21:14:54] : [Step 4/5] [2021-11-19 21:14:54,531][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] ^-- sysMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:14:54] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:14:54] : [Step 4/5] ^-- default region [type=default, persistence=true, lazyAlloc=true, [21:14:54] : [Step 4/5] ... initCfg=100MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB, allocTotal=0MB] [21:14:54] : [Step 4/5] ^-- metastoreMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:14:54] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:14:54] : [Step 4/5] ^-- TxLog region [type=internal, persistence=true, lazyAlloc=false, [21:14:54] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:14:54] : [Step 4/5] ^-- volatileDsMemPlc region [type=user, persistence=false, lazyAlloc=true, [21:14:54] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB] [21:14:54] : [Step 4/5] ^-- Ignite persistence [used=0MB] [21:14:54] : [Step 4/5] [21:14:54] : [Step 4/5] [2021-11-19 21:14:54,532][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Starting binary memory restore for: [-2100569601] [21:14:54] : [Step 4/5] [2021-11-19 21:14:54,540][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:14:54] : [Step 4/5] [2021-11-19 21:14:54,540][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:14:54] : [Step 4/5] [2021-11-19 21:14:54,542][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000000.wal, offset=0, ver=2] [21:14:54] : [Step 4/5] [2021-11-19 21:14:54,545][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Started cache in recovery mode [name=ignite-sys-cache, id=-2100569601, dataRegionName=sysMemPlc, mode=REPLICATED, atomicity=TRANSACTIONAL, backups=2147483647, mvcc=false] [21:14:54] : [Step 4/5] [2021-11-19 21:14:54,546][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Binary recovery performed in 14 ms. [21:14:54] : [Step 4/5] [2021-11-19 21:14:54,547][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:14:54] : [Step 4/5] [2021-11-19 21:14:54,547][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Applying lost cache updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:14:54] : [Step 4/5] [2021-11-19 21:14:54,549][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=0 ms] [21:14:54] : [Step 4/5] [2021-11-19 21:14:54,550][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Restoring partition state for local groups. [21:14:54] : [Step 4/5] [2021-11-19 21:14:54,554][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=1, partitionsProcessed=100, time=0ms] [21:14:54] : [Step 4/5] [2021-11-19 21:14:54,571][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][TestTcpDiscoverySpi] Successfully bound to TCP port [port=47500, localHost=localhost/127.0.0.1, locNodeId=002379ee-6a1a-434d-99e5-6da3bf448000] [21:14:54] : [Step 4/5] [2021-11-19 21:14:54,581][INFO ][disco-notifier-worker-#25422%grid-0%][MvccProcessorImpl] Assigned mvcc coordinator [crd=MvccCoordinator [topVer=AffinityTopologyVersion [topVer=1, minorTopVer=0], nodeId=002379ee-6a1a-434d-99e5-6da3bf448000, ver=1637345694577, local=true, initialized=false]] [21:14:54] : [Step 4/5] [2021-11-19 21:14:54,582][INFO ][sys-#25399%grid-0%][ClusterProcessor] Writing cluster ID and tag to metastorage on ready for write ClusterIdAndTag [id=647b2dee-102c-403f-99a7-7cf41c4afc06, tag=nervous_murdock] [21:14:54] : [Step 4/5] [2021-11-19 21:14:54,586][INFO ][disco-notifier-worker-#25422%grid-0%][ClusterProcessor] nervous_murdock [21:14:54] : [Step 4/5] [2021-11-19 21:14:54,587][INFO ][disco-notifier-worker-#25422%grid-0%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustEnabled' was changed from 'null' to 'false' [21:14:54] : [Step 4/5] [2021-11-19 21:14:54,587][INFO ][disco-notifier-worker-#25422%grid-0%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustTimeout' was changed from 'null' to '300000' [21:14:54] : [Step 4/5] [2021-11-19 21:14:54,588][INFO ][disco-notifier-worker-#25422%grid-0%][IgniteTxManager] Transactions parameter 'longOperationsDumpTimeout' was changed from 'null' to '60000' [21:14:54] : [Step 4/5] [2021-11-19 21:14:54,589][INFO ][disco-notifier-worker-#25422%grid-0%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpThreshold' was changed from 'null' to '0' [21:14:54] : [Step 4/5] [2021-11-19 21:14:54,589][INFO ][disco-notifier-worker-#25422%grid-0%][IgniteTxManager] Transactions parameter 'transactionTimeDumpSamplesCoefficient' was changed from 'null' to '0.0' [21:14:54] : [Step 4/5] [2021-11-19 21:14:54,590][INFO ][disco-notifier-worker-#25422%grid-0%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpSamplesPerSecondLimit' was changed from 'null' to '5' [21:14:54] : [Step 4/5] [2021-11-19 21:14:54,590][INFO ][disco-notifier-worker-#25422%grid-0%][IgniteTxManager] Transactions parameter 'collisionsDumpInterval' was changed from 'null' to '1000' [21:14:54] : [Step 4/5] [2021-11-19 21:14:54,591][INFO ][disco-notifier-worker-#25422%grid-0%][IgniteTxManager] Transactions parameter 'txOwnerDumpRequestsAllowed' was changed from 'null' to 'true' [21:14:54] : [Step 4/5] [2021-11-19 21:14:54,591][INFO ][disco-notifier-worker-#25422%grid-0%][GridCacheDatabaseSharedManager] Historical rebalance WAL threshold changed [property=historical.rebalance.threshold, oldVal=null, newVal=500] [21:14:54] : [Step 4/5] [2021-11-19 21:14:54,593][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] To start Console Management & Monitoring run ignitevisorcmd.{sh|bat} [21:14:54] : [Step 4/5] [2021-11-19 21:14:54,594][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] [21:14:54] : [Step 4/5] [21:14:54] : [Step 4/5] >>> +-------------------------------------------+ [21:14:54] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:14:54] : [Step 4/5] >>> +-------------------------------------------+ [21:14:54] : [Step 4/5] >>> OS name: Linux 4.15.0-151-generic amd64 [21:14:54] : [Step 4/5] >>> CPU(s): 24 [21:14:54] : [Step 4/5] >>> Heap: 2.0GB [21:14:54] : [Step 4/5] >>> VM name: 16724@c4dfe9a430b2 [21:14:54] : [Step 4/5] >>> Ignite instance name: grid-0 [21:14:54] : [Step 4/5] >>> Local node [ID=002379EE-6A1A-434D-99E5-6DA3BF448000, order=1, clientMode=false] [21:14:54] : [Step 4/5] >>> Local node addresses: [127.0.0.1] [21:14:54] : [Step 4/5] >>> Local ports: TCP:10800 TCP:47100 TCP:47500 [21:14:54] : [Step 4/5] [21:14:54] : [Step 4/5] [2021-11-19 21:14:54,595][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] >>> Ignite cluster is in INACTIVE state (limited functionality available). Use control.(sh|bat) script or IgniteCluster.state(ClusterState.ACTIVE) to change the state. [21:14:54] : [Step 4/5] [2021-11-19 21:14:54,595][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][GridDiscoveryManager] Topology snapshot [ver=1, locNode=002379ee, servers=1, clients=0, state=INACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=002379ee-6a1a-434d-99e5-6da3bf448000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:14:54] : [Step 4/5] [2021-11-19 21:14:54,596][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][G] Node started : [stage="Configure system pool" (0 ms),stage="Start managers" (200 ms),stage="Configure binary metadata" (2 ms),stage="Start processors" (303 ms),stage="Start 'StanByClusterTestProvider' plugin" (0 ms),stage="Start 'PageMemory tracker plugin' plugin" (0 ms),stage="Start 'TestDistibutedConfigurationPlugin' plugin" (0 ms),stage="Start 'NodeValidationPluginProvider' plugin" (0 ms),stage="Init metastore" (194 ms),stage="Init and start regions" (7 ms),stage="Restore binary memory" (14 ms),stage="Restore logical state" (7 ms),stage="Finish recovery" (15 ms),stage="Join topology" (10 ms),stage="Await transition" (2 ms),stage="Await exchange" (12 ms),stage="Total time" (766 ms)] [21:14:54] : [Step 4/5] [2021-11-19 21:14:54,597][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][root] Node started with the following configuration [id=002379ee-6a1a-434d-99e5-6da3bf448000, marshaller=BinaryMarshaller [], discovery=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=5000, ackTimeout=5000, marsh=JdkMarshaller [clsFilter=org.apache.ignite.marshaller.MarshallerUtils$1@4667ff51], reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], binaryCfg=null, lateAff=true] [21:14:54]W: [org.apache.ignite:ignite-core] [2021-11-19 21:14:54,602][WARN ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][G] Ignite work directory is not provided, automatically resolved to: /opt/buildagent/work/7bc1c54bc719b67c/work [21:14:54] : [Step 4/5] [2021-11-19 21:14:54,603][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] [21:14:54] : [Step 4/5] [21:14:54] : [Step 4/5] >>> __________ ________________ [21:14:54] : [Step 4/5] >>> / _/ ___/ |/ / _/_ __/ __/ [21:14:54] : [Step 4/5] >>> _/ // (7 7 // / / / / _/ [21:14:54] : [Step 4/5] >>> /___/\___/_/|_/___/ /_/ /___/ [21:14:54] : [Step 4/5] >>> [21:14:54] : [Step 4/5] >>> ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:14:54] : [Step 4/5] >>> 2021 Copyright(C) Apache Software Foundation [21:14:54] : [Step 4/5] >>> [21:14:54] : [Step 4/5] >>> Ignite documentation: http://ignite.apache.org [21:14:54] : [Step 4/5] [21:14:54] : [Step 4/5] [2021-11-19 21:14:54,604][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] Config URL: n/a [21:14:54] : [Step 4/5] [2021-11-19 21:14:54,605][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] IgniteConfiguration [igniteInstanceName=grid-1, pubPoolSize=24, svcPoolSize=24, callbackPoolSize=24, stripedPoolSize=24, sysPoolSize=24, mgmtPoolSize=4, dataStreamerPoolSize=24, utilityCachePoolSize=24, utilityCacheKeepAliveTime=60000, p2pPoolSize=2, qryPoolSize=24, buildIdxPoolSize=4, igniteHome=/opt/buildagent/work/7bc1c54bc719b67c, igniteWorkDir=/opt/buildagent/work/7bc1c54bc719b67c/work, mbeanSrv=com.sun.jmx.mbeanserver.JmxMBeanServer@6fe85038, nodeId=10ab0e92-dbb6-4839-bb03-4b3ab0c64001, marsh=BinaryMarshaller [], marshLocJobs=false, daemon=false, p2pEnabled=true, netTimeout=10000, netCompressionLevel=1, sndRetryDelay=1000, sndRetryCnt=3, metricsHistSize=10000, metricsUpdateFreq=1000, metricsExpTime=9223372036854775807, discoSpi=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=0, ackTimeout=0, marsh=null, reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], segPlc=STOP, segResolveAttempts=2, waitForSegOnStart=true, allResolversPassReq=true, segChkFreq=10000, commSpi=TcpCommunicationSpi [connectGate=org.apache.ignite.spi.communication.tcp.internal.ConnectGateway@452565f1, ctxInitLatch=java.util.concurrent.CountDownLatch@37290240[Count = 1], stopping=false, clientPool=null, nioSrvWrapper=null, stateProvider=null], evtSpi=MemoryEventStorageSpi [expireAgeMs=9223372036854775807, expireCnt=10000, filter=null], colSpi=NoopCollisionSpi [], deploySpi=LocalDeploymentSpi [], indexingSpi=org.apache.ignite.spi.indexing.noop.NoopIndexingSpi@59bf341a, addrRslvr=null, encryptionSpi=org.apache.ignite.spi.encryption.keystore.KeystoreEncryptionSpi@51c91599, tracingSpi=org.apache.ignite.spi.tracing.NoopTracingSpi@66dd1b0f, clientMode=false, rebalanceThreadPoolSize=4, rebalanceTimeout=10000, rebalanceBatchesPrefetchCnt=3, rebalanceThrottle=0, rebalanceBatchSize=524288, txCfg=TransactionConfiguration [txSerEnabled=false, dfltIsolation=REPEATABLE_READ, dfltConcurrency=PESSIMISTIC, dfltTxTimeout=0, txTimeoutOnPartitionMapExchange=0, deadlockTimeout=10000, pessimisticTxLogSize=0, pessimisticTxLogLinger=10000, tmLookupClsName=null, txManagerFactory=null, useJtaSync=false], cacheSanityCheckEnabled=true, discoStartupDelay=60000, deployMode=SHARED, p2pMissedCacheSize=100, locHost=127.0.0.1, timeSrvPortBase=31100, timeSrvPortRange=100, failureDetectionTimeout=10000, sysWorkerBlockedTimeout=null, clientFailureDetectionTimeout=10000, metricsLogFreq=0, connectorCfg=null, odbcCfg=null, warmupClos=null, atomicCfg=AtomicConfiguration [seqReserveSize=1000, cacheMode=PARTITIONED, backups=1, aff=null, grpName=null], classLdr=null, sslCtxFactory=null, platformCfg=null, binaryCfg=null, memCfg=null, pstCfg=null, dsCfg=DataStorageConfiguration [sysRegionInitSize=41943040, sysRegionMaxSize=104857600, pageSize=4096, concLvl=0, dfltDataRegConf=DataRegionConfiguration [name=default, maxSize=104857600, initSize=268435456, swapPath=null, pageEvictionMode=DISABLED, pageReplacementMode=CLOCK, evictionThreshold=0.9, emptyPagesPoolSize=100, metricsEnabled=false, metricsSubIntervalCount=5, metricsRateTimeInterval=60000, persistenceEnabled=true, checkpointPageBufSize=0, lazyMemoryAllocation=true, warmUpCfg=null], dataRegions=null, storagePath=null, checkpointFreq=30000, lockWaitTime=10000, checkpointThreads=4, checkpointWriteOrder=SEQUENTIAL, walHistSize=20, maxWalArchiveSize=20971520, walSegments=10, walSegmentSize=1048576, walPath=db/wal, walArchivePath=db/wal/archive, cdcWalPath=db/wal/cdc, cdcEnabled=false, metricsEnabled=false, walMode=LOG_ONLY, walTlbSize=131072, walBuffSize=0, walFlushFreq=2000, walFsyncDelay=1000, walRecordIterBuffSize=67108864, alwaysWriteFullPages=false, fileIOFactory=org.apache.ignite.internal.processors.cache.persistence.file.AsyncFileIOFactory@6f011687, metricsSubIntervalCnt=5, metricsRateTimeInterval=60000, walAutoArchiveAfterInactivity=-1, walForceArchiveTimeout=-1, writeThrottlingEnabled=false, walCompactionEnabled=false, walCompactionLevel=1, checkpointReadLockTimeout=null, walPageCompression=DISABLED, walPageCompressionLevel=null, dfltWarmUpCfg=null, encCfg=org.apache.ignite.configuration.EncryptionConfiguration@25371b02, defragmentationThreadPoolSize=4, minWalArchiveSize=-1], snapshotPath=snapshots, activeOnStart=true, activeOnStartPropSetFlag=false, autoActivation=true, autoActivationPropSetFlag=false, clusterStateOnStart=null, sqlConnCfg=null, cliConnCfg=ClientConnectorConfiguration [host=null, port=10800, portRange=100, sockSndBufSize=0, sockRcvBufSize=0, tcpNoDelay=true, maxOpenCursorsPerConn=128, threadPoolSize=24, selectorCnt=12, idleTimeout=0, handshakeTimeout=10000, jdbcEnabled=true, odbcEnabled=true, thinCliEnabled=true, sslEnabled=false, useIgniteSslCtxFactory=true, sslClientAuth=false, sslCtxFactory=null, thinCliCfg=ThinClientConfiguration [maxActiveTxPerConn=100, maxActiveComputeTasksPerConn=0]], mvccVacuumThreadCnt=2, mvccVacuumFreq=5000, authEnabled=false, failureHnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]], commFailureRslvr=null, sqlCfg=SqlConfiguration [longQryWarnTimeout=3000, dfltQryTimeout=0, sqlQryHistSize=1000, validationEnabled=false], asyncContinuationExecutor=null] [21:14:54] : [Step 4/5] [2021-11-19 21:14:54,613][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] Daemon mode: off [21:14:54] : [Step 4/5] [2021-11-19 21:14:54,613][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] OS: Linux 4.15.0-151-generic amd64 [21:14:54] : [Step 4/5] [2021-11-19 21:14:54,613][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] OS user: teamcity [21:14:54] : [Step 4/5] [2021-11-19 21:14:54,614][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] PID: 16724 [21:14:54] : [Step 4/5] [2021-11-19 21:14:54,614][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] Language runtime: Java Platform API Specification ver. 1.8 [21:14:54] : [Step 4/5] [2021-11-19 21:14:54,614][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] VM information: Java(TM) SE Runtime Environment 1.8.0_261-b12 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 25.261-b12 [21:14:54] : [Step 4/5] [2021-11-19 21:14:54,615][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] VM total memory: 1.9GB [21:14:54] : [Step 4/5] [2021-11-19 21:14:54,615][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] Remote Management [restart: off, REST: off, JMX (remote: off)] [21:14:54] : [Step 4/5] [2021-11-19 21:14:54,615][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] Logger: GridTestLog4jLogger [quiet=false, config=null] [21:14:54] : [Step 4/5] [2021-11-19 21:14:54,615][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] IGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c [21:14:54] : [Step 4/5] [2021-11-19 21:14:54,615][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] VM arguments: [-DIGNITE_DUMP_THREADS_ON_FAILURE=false, -DMono=/usr/bin/mono-sgen, -DMono4.0_x64=/usr/lib/mono/4.0, -DMono4.5_x64=/usr/lib/mono/4.5, -DMonoVersion=6.12.0.90, -DSKIP_BUILD=false, -Dagent.home.dir=/opt/buildagent, -Dagent.name=aitc-lin02_03, -Dagent.ownPort=9090, -Dagent.work.dir=/opt/buildagent/work, -Dbuild.number=95, -Dbuild.vcs.number=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.1=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.GitHubApacheIgnite=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dclassworlds.conf=/opt/buildagent/temp/buildTmp/teamcity.m2.conf, -Dcom.jetbrains.maven.watcher.report.file=/opt/buildagent/temp/buildTmp/maven-build-info.xml, -Djava.io.tmpdir=/opt/buildagent/temp/buildTmp, -Dmaven.home=/opt/buildagent/tools/maven3_6, -Dmaven.multiModuleProjectDirectory=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.agent.cpuBenchmark=457, -Dteamcity.agent.dotnet.agent_url=http://localhost:9090/RPC2, -Dteamcity.agent.dotnet.build_id=6278078, -Dteamcity.auth.password=*******, -Dteamcity.auth.userId=TeamCityBuildId=6278078, -Dteamcity.build.changedFiles.file=/opt/buildagent/temp/buildTmp/changedFiles6342607772318147725.txt, -Dteamcity.build.checkoutDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.build.id=6278078, -Dteamcity.build.properties.file=/opt/buildagent/temp/buildTmp/teamcity.build5164517880467851002.properties, -Dteamcity.build.tempDir=/opt/buildagent/temp/buildTmp, -Dteamcity.build.workingDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.buildConfName=Basic 3, -Dteamcity.buildType.id=IgniteTests24Java8_Basic3, -Dteamcity.configuration.properties.file=/opt/buildagent/temp/buildTmp/teamcity.config5591980786735343870.properties, -Dteamcity.maven.userSettings.path=/opt/buildagent/temp/buildTmp/maven_settings_585072866407032347.xml, -Dteamcity.maven.watcher.home=/opt/buildagent/plugins/mavenPlugin/maven-watcher-jdk16, -Dteamcity.projectName=Ignite Tests 2.x (JDK 8/11), -Dteamcity.runner.properties.file=/opt/buildagent/temp/buildTmp/teamcity.runner9098465561618137420.properties, -Dteamcity.tests.recentlyFailedTests.file=/opt/buildagent/temp/buildTmp/testsToRunFirst3891775683130404069.txt, -Dteamcity.version=2021.2 (build 99542), -ea, -Xms2g, -Xmx2g, -XX:+HeapDumpOnOutOfMemoryError, -DIGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_TEST_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_UPDATE_NOTIFIER=false, -DIGNITE_NO_DISCO_ORDER=true, -DIGNITE_PERFORMANCE_SUGGESTIONS_DISABLED=true, -Djava.net.preferIPv4Stack=true, -DTEST_SCALE_FACTOR=1.0, -DIGNITE_TEST_PROP_LOG4J_FILE=log4j-tc-test.xml, -DIGNITE_QUIET=false, -DIGNITE_MARSHAL_BUFFERS_RECHECK=1000, -Dmaven.repo.local=/opt/buildagent/.m2/repository] [21:14:54] : [Step 4/5] [2021-11-19 21:14:54,620][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] System cache's DataRegion size is configured to 40 MB. Use DataStorageConfiguration.systemRegionInitialSize property to change the setting. [21:14:54] : [Step 4/5] [2021-11-19 21:14:54,620][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] Configured caches [in 'sysMemPlc' dataRegion: ['ignite-sys-cache']] [21:14:54]W: [org.apache.ignite:ignite-core] [2021-11-19 21:14:54,620][WARN ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] Peer class loading is enabled (disable it in production for performance and deployment consistency reasons) [21:14:54] : [Step 4/5] [2021-11-19 21:14:54,621][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] 3-rd party licenses can be found at: /opt/buildagent/work/7bc1c54bc719b67c/libs/licenses [21:14:54] : [Step 4/5] [2021-11-19 21:14:54,625][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] Configured plugins: [21:14:54] : [Step 4/5] [2021-11-19 21:14:54,625][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- StanByClusterTestProvider 1.0 [21:14:54] : [Step 4/5] [2021-11-19 21:14:54,626][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:14:54] : [Step 4/5] [2021-11-19 21:14:54,626][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] [21:14:54] : [Step 4/5] [2021-11-19 21:14:54,626][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- PageMemory tracker plugin 1.0 [21:14:54] : [Step 4/5] [2021-11-19 21:14:54,626][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:14:54] : [Step 4/5] [2021-11-19 21:14:54,626][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] [21:14:54] : [Step 4/5] [2021-11-19 21:14:54,627][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- TestDistibutedConfigurationPlugin 1.0 [21:14:54] : [Step 4/5] [2021-11-19 21:14:54,627][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:14:54] : [Step 4/5] [2021-11-19 21:14:54,627][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] [21:14:54] : [Step 4/5] [2021-11-19 21:14:54,627][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- NodeValidationPluginProvider 1.0 [21:14:54] : [Step 4/5] [2021-11-19 21:14:54,627][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:14:54] : [Step 4/5] [2021-11-19 21:14:54,627][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] [21:14:54] : [Step 4/5] [2021-11-19 21:14:54,628][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][FailureProcessor] Configured failure handler: [hnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]]] [21:14:54] : [Step 4/5] [2021-11-19 21:14:54,639][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][TestRecordingCommunicationSpi] Successfully bound communication NIO server to TCP port [port=47101, locHost=/127.0.0.1, selectorsCnt=12, selectorSpins=0, pairedConn=false] [21:14:54]W: [org.apache.ignite:ignite-core] [2021-11-19 21:14:54,639][WARN ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][TestRecordingCommunicationSpi] Message queue limit is set to 0 which may lead to potential OOMEs when running cache operations in FULL_ASYNC or PRIMARY_SYNC modes due to message queues growth on sender and receiver sides. [21:14:54] : [Step 4/5] [2021-11-19 21:14:54,643][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][GridCollisionManager] Collision resolution is disabled (all jobs will be activated upon arrival). [21:14:54] : [Step 4/5] [2021-11-19 21:14:54,644][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] Security status [authentication=off, sandbox=off, tls/ssl=off] [21:14:54] : [Step 4/5] [2021-11-19 21:14:54,704][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:14:54] : [Step 4/5] [2021-11-19 21:14:54,798][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][MaintenanceProcessor] Resolved store directory for node persistent data: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1 [21:14:54] : [Step 4/5] [2021-11-19 21:14:54,800][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][CacheObjectBinaryProcessorImpl] Resolved directory for serialized binary metadata: /opt/buildagent/work/7bc1c54bc719b67c/work/db/binary_meta/grid_1 [21:14:54] : [Step 4/5] [2021-11-19 21:14:54,806][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1 [21:14:54] : [Step 4/5] [2021-11-19 21:14:54,806][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][FileWriteAheadLogManager] Resolved write ahead log work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1 [21:14:54] : [Step 4/5] [2021-11-19 21:14:54,807][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][FileWriteAheadLogManager] Resolved write ahead log archive directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1 [21:14:54] : [Step 4/5] [2021-11-19 21:14:54,983][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000000.wal [21:14:54] : [Step 4/5] [2021-11-19 21:14:54,983][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][FileHandleManagerImpl] Initialized write-ahead log manager [mode=LOG_ONLY] [21:14:54] : [Step 4/5] [2021-11-19 21:14:54,989][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Configured data regions initialized successfully [total=5] [21:14:55] : [Step 4/5] [2021-11-19 21:14:55,119][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][IgniteSnapshotManager] Resolved snapshot work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/snapshots [21:14:55] : [Step 4/5] [2021-11-19 21:14:55,119][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][IgniteSnapshotManager] Resolved temp directory for snapshot creation: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1/snp [21:14:55] : [Step 4/5] [2021-11-19 21:14:55,122][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][ClientListenerProcessor] Client connector processor has started on TCP port 10801 [21:14:55] : [Step 4/5] [2021-11-19 21:14:55,124][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] Non-loopback local IPs: 172.17.0.4 [21:14:55] : [Step 4/5] [2021-11-19 21:14:55,124][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] Enabled local MACs: 0242AC110004 [21:14:55] : [Step 4/5] [2021-11-19 21:14:55,125][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:14:55] : [Step 4/5] [2021-11-19 21:14:55,126][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:14:55] : [Step 4/5] [2021-11-19 21:14:55,126][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:14:55] : [Step 4/5] [2021-11-19 21:14:55,129][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Applying lost metastore updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:14:55] : [Step 4/5] [2021-11-19 21:14:55,130][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=0 ms] [21:14:55] : [Step 4/5] [2021-11-19 21:14:55,130][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Restoring partition state for local groups. [21:14:55] : [Step 4/5] [2021-11-19 21:14:55,130][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=0, partitionsProcessed=0, time=0ms] [21:14:55] : [Step 4/5] [2021-11-19 21:14:55,131][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][GridEncryptionManager] Encryption keys loaded from metastore. [grps=, masterKeyName=ignite.master.key] [21:14:55] : [Step 4/5] [2021-11-19 21:14:55,132][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][ClusterProcessor] Cluster ID and tag has been read from metastorage: null [21:14:55] : [Step 4/5] [2021-11-19 21:14:55,133][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][IgniteClusterImpl] Shutdown policy was updated [oldVal=null, newVal=null] [21:14:55] : [Step 4/5] [2021-11-19 21:14:55,133][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Checkpoint frequency deviation changed [oldVal=null, newVal=null] [21:14:55] : [Step 4/5] [2021-11-19 21:14:55,433][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][FilePageStoreManager] Cleanup cache stores [total=1, left=0, cleanFiles=false] [21:14:55] : [Step 4/5] [2021-11-19 21:14:55,436][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:14:55] : [Step 4/5] [2021-11-19 21:14:55,437][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:14:55] : [Step 4/5] [2021-11-19 21:14:55,438][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:14:55] : [Step 4/5] [2021-11-19 21:14:55,439][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Data Regions Started: 5 [21:14:55] : [Step 4/5] [2021-11-19 21:14:55,439][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] ^-- sysMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:14:55] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:14:55] : [Step 4/5] ^-- default region [type=default, persistence=true, lazyAlloc=true, [21:14:55] : [Step 4/5] ... initCfg=100MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB, allocTotal=0MB] [21:14:55] : [Step 4/5] ^-- metastoreMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:14:55] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:14:55] : [Step 4/5] ^-- TxLog region [type=internal, persistence=true, lazyAlloc=false, [21:14:55] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:14:55] : [Step 4/5] ^-- volatileDsMemPlc region [type=user, persistence=false, lazyAlloc=true, [21:14:55] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB] [21:14:55] : [Step 4/5] ^-- Ignite persistence [used=0MB] [21:14:55] : [Step 4/5] [21:14:55] : [Step 4/5] [2021-11-19 21:14:55,441][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Starting binary memory restore for: [-2100569601] [21:14:55] : [Step 4/5] [2021-11-19 21:14:55,451][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:14:55] : [Step 4/5] [2021-11-19 21:14:55,451][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:14:55] : [Step 4/5] [2021-11-19 21:14:55,454][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000000.wal, offset=0, ver=2] [21:14:55] : [Step 4/5] [2021-11-19 21:14:55,457][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Started cache in recovery mode [name=ignite-sys-cache, id=-2100569601, dataRegionName=sysMemPlc, mode=REPLICATED, atomicity=TRANSACTIONAL, backups=2147483647, mvcc=false] [21:14:55] : [Step 4/5] [2021-11-19 21:14:55,458][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Binary recovery performed in 17 ms. [21:14:55] : [Step 4/5] [2021-11-19 21:14:55,458][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:14:55] : [Step 4/5] [2021-11-19 21:14:55,459][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Applying lost cache updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:14:55] : [Step 4/5] [2021-11-19 21:14:55,464][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=0 ms] [21:14:55] : [Step 4/5] [2021-11-19 21:14:55,464][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Restoring partition state for local groups. [21:14:55] : [Step 4/5] [2021-11-19 21:14:55,485][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=1, partitionsProcessed=100, time=20ms] [21:14:55] : [Step 4/5] [2021-11-19 21:14:55,606][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][TestTcpDiscoverySpi] Successfully bound to TCP port [port=47501, localHost=localhost/127.0.0.1, locNodeId=10ab0e92-dbb6-4839-bb03-4b3ab0c64001] [21:14:55] : [Step 4/5] [2021-11-19 21:14:55,609][INFO ][tcp-disco-srvr-[:47500]-#1333%grid-0%-#25424%grid-0%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=34717] [21:14:55] : [Step 4/5] [2021-11-19 21:14:55,610][INFO ][tcp-disco-srvr-[:47500]-#1333%grid-0%-#25424%grid-0%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=34717] [21:14:55] : [Step 4/5] [2021-11-19 21:14:55,610][INFO ][tcp-disco-sock-reader-[]-#1339%grid-0%-#25544%grid-0%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:34717, rmtPort=34717] [21:14:55] : [Step 4/5] [2021-11-19 21:14:55,611][INFO ][tcp-disco-sock-reader-[10ab0e92 127.0.0.1:34717]-#1339%grid-0%-#25544%grid-0%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=10ab0e92-dbb6-4839-bb03-4b3ab0c64001, rmtAddr=/127.0.0.1:34717] [21:14:55] : [Step 4/5] [2021-11-19 21:14:55,616][INFO ][tcp-disco-srvr-[:47501]-#1338%grid-1%-#25543%grid-1%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=55969] [21:14:55] : [Step 4/5] [2021-11-19 21:14:55,617][INFO ][tcp-disco-srvr-[:47501]-#1338%grid-1%-#25543%grid-1%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=55969] [21:14:55] : [Step 4/5] [2021-11-19 21:14:55,617][INFO ][tcp-disco-sock-reader-[]-#1340%grid-1%-#25545%grid-1%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:55969, rmtPort=55969] [21:14:55] : [Step 4/5] [2021-11-19 21:14:55,618][INFO ][tcp-disco-sock-reader-[]-#1340%grid-1%-#25545%grid-1%][TestTcpDiscoverySpi] Received ping request from the remote node [rmtNodeId=002379ee-6a1a-434d-99e5-6da3bf448000, rmtAddr=/127.0.0.1:55969, rmtPort=55969] [21:14:55] : [Step 4/5] [2021-11-19 21:14:55,619][INFO ][tcp-disco-sock-reader-[]-#1340%grid-1%-#25545%grid-1%][TestTcpDiscoverySpi] Finished writing ping response [rmtNodeId=002379ee-6a1a-434d-99e5-6da3bf448000, rmtAddr=/127.0.0.1:55969, rmtPort=55969] [21:14:55]W: [org.apache.ignite:ignite-core] [2021-11-19 21:14:55,619][WARN ][tcp-disco-sock-reader-[]-#1340%grid-1%-#25545%grid-1%][TestTcpDiscoverySpi] Failed to shutdown socket [21:14:55]W: [org.apache.ignite:ignite-core] java.net.SocketException: Socket output is already shutdown [21:14:55]W: [org.apache.ignite:ignite-core] at java.net.Socket.shutdownOutput(Socket.java:1572) [21:14:55]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.close(IgniteUtils.java:4247) [21:14:55]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.discovery.tcp.ServerImpl$SocketReader.body(ServerImpl.java:7370) [21:14:55]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.IgniteSpiThread.run(IgniteSpiThread.java:58) [21:14:55] : [Step 4/5] [2021-11-19 21:14:55,622][INFO ][tcp-disco-msg-worker-[crd]-#1332%grid-0%-#25423%grid-0%][GridEncryptionManager] Joining node doesn't have stored group keys [node=10ab0e92-dbb6-4839-bb03-4b3ab0c64001] [21:14:55] : [Step 4/5] [2021-11-19 21:14:55,619][INFO ][tcp-disco-sock-reader-[10ab0e92 127.0.0.1:34717]-#1339%grid-0%-#25544%grid-0%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:34717, rmtPort=34717, rmtNodeId=10ab0e92-dbb6-4839-bb03-4b3ab0c64001] [21:14:55] : [Step 4/5] [2021-11-19 21:14:55,626][INFO ][tcp-disco-sock-reader-[]-#1340%grid-1%-#25545%grid-1%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:55969, rmtPort=55969, rmtNodeId=null] [21:14:55] : [Step 4/5] [2021-11-19 21:14:55,635][INFO ][tcp-disco-msg-worker-[crd]-#1332%grid-0%-#25423%grid-0%][TestTcpDiscoverySpi] New next node [newNext=TcpDiscoveryNode [id=10ab0e92-dbb6-4839-bb03-4b3ab0c64001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=0, intOrder=2, lastExchangeTime=1637345695608, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false]] [21:14:55] : [Step 4/5] [2021-11-19 21:14:55,636][INFO ][tcp-disco-srvr-[:47501]-#1338%grid-1%-#25543%grid-1%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=41603] [21:14:55] : [Step 4/5] [2021-11-19 21:14:55,636][INFO ][tcp-disco-srvr-[:47501]-#1338%grid-1%-#25543%grid-1%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=41603] [21:14:55] : [Step 4/5] [2021-11-19 21:14:55,637][INFO ][tcp-disco-sock-reader-[]-#1341%grid-1%-#25546%grid-1%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:41603, rmtPort=41603] [21:14:55] : [Step 4/5] [2021-11-19 21:14:55,638][INFO ][tcp-disco-sock-reader-[002379ee 127.0.0.1:41603]-#1341%grid-1%-#25546%grid-1%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=002379ee-6a1a-434d-99e5-6da3bf448000, rmtAddr=/127.0.0.1:41603] [21:14:55] : [Step 4/5] [2021-11-19 21:14:55,642][INFO ][tcp-disco-msg-worker-[]-#1337%grid-1%-#25542%grid-1%][TestTcpDiscoverySpi] New next node [newNext=TcpDiscoveryNode [id=002379ee-6a1a-434d-99e5-6da3bf448000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345695638, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false]] [21:14:55] : [Step 4/5] [2021-11-19 21:14:55,643][INFO ][tcp-disco-srvr-[:47500]-#1333%grid-0%-#25424%grid-0%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=37725] [21:14:55] : [Step 4/5] [2021-11-19 21:14:55,643][INFO ][tcp-disco-srvr-[:47500]-#1333%grid-0%-#25424%grid-0%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=37725] [21:14:55] : [Step 4/5] [2021-11-19 21:14:55,644][INFO ][tcp-disco-sock-reader-[]-#1342%grid-0%-#25547%grid-0%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:37725, rmtPort=37725] [21:14:55] : [Step 4/5] [2021-11-19 21:14:55,645][INFO ][tcp-disco-sock-reader-[10ab0e92 127.0.0.1:37725]-#1342%grid-0%-#25547%grid-0%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=10ab0e92-dbb6-4839-bb03-4b3ab0c64001, rmtAddr=/127.0.0.1:37725] [21:14:55] : [Step 4/5] [2021-11-19 21:14:55,647][INFO ][disco-event-worker-#25426%grid-0%][GridDiscoveryManager] Added new node to topology: TcpDiscoveryNode [id=10ab0e92-dbb6-4839-bb03-4b3ab0c64001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637345695608, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false] [21:14:55] : [Step 4/5] [2021-11-19 21:14:55,649][INFO ][disco-event-worker-#25426%grid-0%][GridDiscoveryManager] Topology snapshot [ver=2, locNode=002379ee, servers=2, clients=0, state=INACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=002379ee-6a1a-434d-99e5-6da3bf448000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=10ab0e92-dbb6-4839-bb03-4b3ab0c64001, consistentId=grid-1, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:14:55] : [Step 4/5] [2021-11-19 21:14:55,651][INFO ][tcp-disco-msg-worker-[002379ee 127.0.0.1:47500]-#1337%grid-1%-#25542%grid-1%][ClusterProcessor] nervous_murdock [21:14:55] : [Step 4/5] [2021-11-19 21:14:55,651][INFO ][tcp-disco-msg-worker-[002379ee 127.0.0.1:47500]-#1337%grid-1%-#25542%grid-1%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustEnabled' was changed from 'null' to 'false' [21:14:55] : [Step 4/5] [2021-11-19 21:14:55,652][INFO ][tcp-disco-msg-worker-[002379ee 127.0.0.1:47500]-#1337%grid-1%-#25542%grid-1%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustTimeout' was changed from 'null' to '300000' [21:14:55] : [Step 4/5] [2021-11-19 21:14:55,652][INFO ][tcp-disco-msg-worker-[002379ee 127.0.0.1:47500]-#1337%grid-1%-#25542%grid-1%][IgniteTxManager] Transactions parameter 'longOperationsDumpTimeout' was changed from 'null' to '60000' [21:14:55] : [Step 4/5] [2021-11-19 21:14:55,652][INFO ][tcp-disco-msg-worker-[002379ee 127.0.0.1:47500]-#1337%grid-1%-#25542%grid-1%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpThreshold' was changed from 'null' to '0' [21:14:55] : [Step 4/5] [2021-11-19 21:14:55,653][INFO ][tcp-disco-msg-worker-[002379ee 127.0.0.1:47500]-#1337%grid-1%-#25542%grid-1%][IgniteTxManager] Transactions parameter 'transactionTimeDumpSamplesCoefficient' was changed from 'null' to '0.0' [21:14:55] : [Step 4/5] [2021-11-19 21:14:55,653][INFO ][tcp-disco-msg-worker-[002379ee 127.0.0.1:47500]-#1337%grid-1%-#25542%grid-1%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpSamplesPerSecondLimit' was changed from 'null' to '5' [21:14:55] : [Step 4/5] [2021-11-19 21:14:55,654][INFO ][tcp-disco-msg-worker-[002379ee 127.0.0.1:47500]-#1337%grid-1%-#25542%grid-1%][IgniteTxManager] Transactions parameter 'collisionsDumpInterval' was changed from 'null' to '1000' [21:14:55] : [Step 4/5] [2021-11-19 21:14:55,654][INFO ][tcp-disco-msg-worker-[002379ee 127.0.0.1:47500]-#1337%grid-1%-#25542%grid-1%][IgniteTxManager] Transactions parameter 'txOwnerDumpRequestsAllowed' was changed from 'null' to 'true' [21:14:55] : [Step 4/5] [2021-11-19 21:14:55,654][INFO ][tcp-disco-msg-worker-[002379ee 127.0.0.1:47500]-#1337%grid-1%-#25542%grid-1%][GridCacheDatabaseSharedManager] Historical rebalance WAL threshold changed [property=historical.rebalance.threshold, oldVal=null, newVal=500] [21:14:55] : [Step 4/5] [2021-11-19 21:14:55,655][INFO ][disco-notifier-worker-#25541%grid-1%][MvccProcessorImpl] Assigned mvcc coordinator [crd=MvccCoordinator [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=0], nodeId=002379ee-6a1a-434d-99e5-6da3bf448000, ver=1637345694577, local=false, initialized=false]] [21:14:55] : [Step 4/5] [2021-11-19 21:14:55,657][INFO ][sys-#25520%grid-1%][ClusterProcessor] Writing cluster ID and tag to metastorage on ready for write ClusterIdAndTag [id=647b2dee-102c-403f-99a7-7cf41c4afc06, tag=nervous_murdock] [21:14:55] : [Step 4/5] [2021-11-19 21:14:55,674][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] To start Console Management & Monitoring run ignitevisorcmd.{sh|bat} [21:14:55] : [Step 4/5] [2021-11-19 21:14:55,675][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] [21:14:55] : [Step 4/5] [21:14:55] : [Step 4/5] >>> +-------------------------------------------+ [21:14:55] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:14:55] : [Step 4/5] >>> +-------------------------------------------+ [21:14:55] : [Step 4/5] >>> OS name: Linux 4.15.0-151-generic amd64 [21:14:55] : [Step 4/5] >>> CPU(s): 24 [21:14:55] : [Step 4/5] >>> Heap: 2.0GB [21:14:55] : [Step 4/5] >>> VM name: 16724@c4dfe9a430b2 [21:14:55] : [Step 4/5] >>> Ignite instance name: grid-1 [21:14:55] : [Step 4/5] >>> Local node [ID=10AB0E92-DBB6-4839-BB03-4B3AB0C64001, order=2, clientMode=false] [21:14:55] : [Step 4/5] >>> Local node addresses: [127.0.0.1] [21:14:55] : [Step 4/5] >>> Local ports: TCP:10801 TCP:47101 TCP:47501 [21:14:55] : [Step 4/5] [21:14:55] : [Step 4/5] [2021-11-19 21:14:55,676][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] >>> Ignite cluster is in INACTIVE state (limited functionality available). Use control.(sh|bat) script or IgniteCluster.state(ClusterState.ACTIVE) to change the state. [21:14:55] : [Step 4/5] [2021-11-19 21:14:55,676][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][GridDiscoveryManager] Topology snapshot [ver=2, locNode=10ab0e92, servers=2, clients=0, state=INACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=002379ee-6a1a-434d-99e5-6da3bf448000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=10ab0e92-dbb6-4839-bb03-4b3ab0c64001, consistentId=grid-1, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:14:55] : [Step 4/5] [2021-11-19 21:14:55,677][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][G] Node started : [stage="Configure system pool" (0 ms),stage="Start managers" (196 ms),stage="Configure binary metadata" (2 ms),stage="Start processors" (320 ms),stage="Start 'StanByClusterTestProvider' plugin" (0 ms),stage="Start 'PageMemory tracker plugin' plugin" (0 ms),stage="Start 'TestDistibutedConfigurationPlugin' plugin" (0 ms),stage="Start 'NodeValidationPluginProvider' plugin" (0 ms),stage="Init metastore" (309 ms),stage="Init and start regions" (7 ms),stage="Restore binary memory" (17 ms),stage="Restore logical state" (27 ms),stage="Finish recovery" (115 ms),stage="Join topology" (54 ms),stage="Await transition" (2 ms),stage="Await exchange" (18 ms),stage="Total time" (1067 ms)] [21:14:55] : [Step 4/5] [2021-11-19 21:14:55,678][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][root] Node started with the following configuration [id=10ab0e92-dbb6-4839-bb03-4b3ab0c64001, marshaller=BinaryMarshaller [], discovery=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=5000, ackTimeout=5000, marsh=JdkMarshaller [clsFilter=org.apache.ignite.marshaller.MarshallerUtils$1@7bff5c58], reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], binaryCfg=null, lateAff=true] [21:14:55] : [Step 4/5] [2021-11-19 21:14:55,680][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][GridClusterStateProcessor] Sending activate cluster request with BaselineTopology BaselineTopology [id=0, branchingHash=-2475315501, branchingType='New BaselineTopology', baselineNodes=[grid-1, grid-0]] [21:14:55] : [Step 4/5] [2021-11-19 21:14:55,684][INFO ][disco-notifier-worker-#25422%grid-0%][GridClusterStateProcessor] Received activate cluster request with BaselineTopology[id=0] initiator node ID: 002379ee-6a1a-434d-99e5-6da3bf448000 [21:14:55] : [Step 4/5] [2021-11-19 21:14:55,684][INFO ][disco-notifier-worker-#25422%grid-0%][GridClusterStateProcessor] Started state transition: activate cluster [21:14:55] : [Step 4/5] [2021-11-19 21:14:55,685][INFO ][exchange-worker-#25427%grid-0%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], crd=true, evt=DISCOVERY_CUSTOM_EVT, evtNode=002379ee-6a1a-434d-99e5-6da3bf448000, customEvt=ChangeGlobalStateMessage [id=3323e593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqId=eb3cb2d7-2e8f-43a4-9de8-36f1309b160b, initiatingNodeId=002379ee-6a1a-434d-99e5-6da3bf448000, state=ACTIVE, baselineTopology=BaselineTopology [id=0, branchingHash=-2475315501, branchingType='New BaselineTopology', baselineNodes=[grid-1, grid-0]], forceChangeBaselineTopology=false, timestamp=1637345695680, forceDeactivation=true], allowMerge=false, exchangeFreeSwitch=false] [21:14:55] : [Step 4/5] [2021-11-19 21:14:55,686][INFO ][exchange-worker-#25427%grid-0%][GridDhtPartitionsExchangeFuture] Start activation process [nodeId=002379ee-6a1a-434d-99e5-6da3bf448000, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]]. New state: ACTIVE [21:14:55] : [Step 4/5] [2021-11-19 21:14:55,686][INFO ][exchange-worker-#25427%grid-0%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0 [21:14:55] : [Step 4/5] [2021-11-19 21:14:55,685][INFO ][disco-notifier-worker-#25541%grid-1%][GridClusterStateProcessor] Received activate cluster request with BaselineTopology[id=0] initiator node ID: 002379ee-6a1a-434d-99e5-6da3bf448000 [21:14:55] : [Step 4/5] [2021-11-19 21:14:55,687][INFO ][disco-notifier-worker-#25541%grid-1%][GridClusterStateProcessor] Started state transition: activate cluster [21:14:55] : [Step 4/5] [2021-11-19 21:14:55,688][INFO ][exchange-worker-#25550%grid-1%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], crd=false, evt=DISCOVERY_CUSTOM_EVT, evtNode=002379ee-6a1a-434d-99e5-6da3bf448000, customEvt=ChangeGlobalStateMessage [id=3323e593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqId=eb3cb2d7-2e8f-43a4-9de8-36f1309b160b, initiatingNodeId=002379ee-6a1a-434d-99e5-6da3bf448000, state=ACTIVE, baselineTopology=BaselineTopology [id=0, branchingHash=-2475315501, branchingType='New BaselineTopology', baselineNodes=[grid-1, grid-0]], forceChangeBaselineTopology=false, timestamp=1637345695680, forceDeactivation=true], allowMerge=false, exchangeFreeSwitch=false] [21:14:55] : [Step 4/5] [2021-11-19 21:14:55,688][INFO ][exchange-worker-#25427%grid-0%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000000.wal, offset=8795, ver=2] [21:14:55] : [Step 4/5] [2021-11-19 21:14:55,689][INFO ][exchange-worker-#25550%grid-1%][GridDhtPartitionsExchangeFuture] Start activation process [nodeId=10ab0e92-dbb6-4839-bb03-4b3ab0c64001, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]]. New state: ACTIVE [21:14:55] : [Step 4/5] [2021-11-19 21:14:55,691][INFO ][exchange-worker-#25427%grid-0%][GridClusterStateProcessor] Writing BaselineTopology[id=0] [21:14:55] : [Step 4/5] [2021-11-19 21:14:55,691][INFO ][exchange-worker-#25550%grid-1%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1 [21:14:55] : [Step 4/5] [2021-11-19 21:14:55,693][INFO ][exchange-worker-#25550%grid-1%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000000.wal, offset=8795, ver=2] [21:14:55] : [Step 4/5] [2021-11-19 21:14:55,693][INFO ][exchange-worker-#25427%grid-0%][GridCacheDatabaseSharedManager] Finish recovery performed in 6 ms. [21:14:55] : [Step 4/5] [2021-11-19 21:14:55,695][INFO ][exchange-worker-#25550%grid-1%][GridClusterStateProcessor] Writing BaselineTopology[id=0] [21:14:55] : [Step 4/5] [2021-11-19 21:14:55,696][INFO ][exchange-worker-#25427%grid-0%][msg] Components activation performed in 10 ms. [21:14:55] : [Step 4/5] [2021-11-19 21:14:55,698][INFO ][exchange-worker-#25427%grid-0%][GridCacheProcessor] Finished recovery for cache [cache=ignite-sys-cache, grp=ignite-sys-cache, startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:14:55] : [Step 4/5] [2021-11-19 21:14:55,698][INFO ][exchange-worker-#25550%grid-1%][GridCacheDatabaseSharedManager] Finish recovery performed in 7 ms. [21:14:55] : [Step 4/5] [2021-11-19 21:14:55,699][INFO ][exchange-worker-#25550%grid-1%][msg] Components activation performed in 8 ms. [21:14:55] : [Step 4/5] [2021-11-19 21:14:55,699][INFO ][exchange-worker-#25427%grid-0%][GridDhtPartitionsExchangeFuture] Successfully activated caches [nodeId=002379ee-6a1a-434d-99e5-6da3bf448000, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], newState=ACTIVE] [21:14:55] : [Step 4/5] [2021-11-19 21:14:55,700][INFO ][exchange-worker-#25550%grid-1%][GridCacheProcessor] Finished recovery for cache [cache=ignite-sys-cache, grp=ignite-sys-cache, startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:14:55] : [Step 4/5] [2021-11-19 21:14:55,700][INFO ][exchange-worker-#25427%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:14:55] : [Step 4/5] [2021-11-19 21:14:55,700][INFO ][exchange-worker-#25550%grid-1%][GridDhtPartitionsExchangeFuture] Successfully activated caches [nodeId=10ab0e92-dbb6-4839-bb03-4b3ab0c64001, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], newState=ACTIVE] [21:14:55] : [Step 4/5] [2021-11-19 21:14:55,701][INFO ][exchange-worker-#25550%grid-1%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:14:55] : [Step 4/5] [2021-11-19 21:14:55,708][INFO ][exchange-worker-#25427%grid-0%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], crd=true] [21:14:55] : [Step 4/5] [2021-11-19 21:14:55,711][INFO ][grid-nio-worker-tcp-comm-0-#25365%TestRecordingCommunicationSpi%][TestRecordingCommunicationSpi] Accepted incoming communication connection [locAddr=/127.0.0.1:47100, rmtAddr=/127.0.0.1:35466] [21:14:55] : [Step 4/5] [2021-11-19 21:14:55,713][INFO ][grid-nio-worker-tcp-comm-0-#25484%TestRecordingCommunicationSpi%][TestRecordingCommunicationSpi] Established outgoing communication connection [locAddr=/127.0.0.1:35466, rmtAddr=/127.0.0.1:47100] [21:14:55] : [Step 4/5] [2021-11-19 21:14:55,713][INFO ][exchange-worker-#25550%grid-1%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], crd=false] [21:14:55] : [Step 4/5] [2021-11-19 21:14:55,715][INFO ][sys-#25406%grid-0%][GridDhtPartitionsExchangeFuture] Coordinator received single message [ver=AffinityTopologyVersion [topVer=2, minorTopVer=1], node=10ab0e92-dbb6-4839-bb03-4b3ab0c64001, allReceived=true] [21:14:55] : [Step 4/5] [2021-11-19 21:14:55,715][INFO ][sys-#25406%grid-0%][GridDhtPartitionsExchangeFuture] finishExchangeOnCoordinator [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:14:55] : [Step 4/5] [2021-11-19 21:14:55,719][INFO ][sys-#25406%grid-0%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], err=null, rebalanced=true, wasRebalanced=false] [21:14:55] : [Step 4/5] [2021-11-19 21:14:55,719][INFO ][disco-notifier-worker-#25422%grid-0%][GridClusterStateProcessor] Received state change finish message: ACTIVE [21:14:55] : [Step 4/5] [2021-11-19 21:14:55,720][INFO ][disco-notifier-worker-#25541%grid-1%][GridClusterStateProcessor] Received state change finish message: ACTIVE [21:14:55] : [Step 4/5] [2021-11-19 21:14:55,720][INFO ][disco-notifier-worker-#25541%grid-1%][GridClusterStateProcessor] Cluster state was changed from INACTIVE to ACTIVE [21:14:55] : [Step 4/5] [2021-11-19 21:14:55,720][INFO ][disco-notifier-worker-#25422%grid-0%][GridClusterStateProcessor] Cluster state was changed from INACTIVE to ACTIVE [21:14:55] : [Step 4/5] [2021-11-19 21:14:55,721][INFO ][sys-#25406%grid-0%][GridCacheProcessor] Finish proxy initialization, cacheName=ignite-sys-cache, localNodeId=002379ee-6a1a-434d-99e5-6da3bf448000 [21:14:55] : [Step 4/5] [2021-11-19 21:14:55,722][INFO ][sys-#25417%grid-0%][DistributedBaselineConfiguration] Baseline auto-adjust is 'disabled' with timeout='300000' ms [21:14:55] : [Step 4/5] [2021-11-19 21:14:55,722][INFO ][sys-#25406%grid-0%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=002379ee-6a1a-434d-99e5-6da3bf448000, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=002379ee-6a1a-434d-99e5-6da3bf448000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345695720, loc=true, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:14:55] : [Step 4/5] [2021-11-19 21:14:55,722][INFO ][exchange-worker-#25427%grid-0%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=2, minorTopVer=1], force=false, evt=DISCOVERY_CUSTOM_EVT, node=002379ee-6a1a-434d-99e5-6da3bf448000] [21:14:55] : [Step 4/5] [2021-11-19 21:14:55,723][INFO ][sys-#25406%grid-0%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (1 ms), stage="Update caches registry" (11 ms), stage="Start caches" (0 ms), stage="Affinity initialization on cache group start" (0 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Restore partition states" (0 ms), stage="After states restored callback" (7 ms), stage="WAL history reservation" (0 ms), stage="Waiting for all single messages" (6 ms), stage="Affinity recalculation (crd)" (0 ms), stage="Collect update counters and create affinity messages" (0 ms), stage="Assign partitions states" (0 ms), stage="Validate partitions states" (0 ms), stage="Ideal affinity diff calculation (enforced)" (0 ms), stage="Apply update counters" (0 ms), stage="Full message preparing" (2 ms), stage="Full message sending" (0 ms), stage="State finish message sending" (0 ms), stage="Detect lost partitions" (1 ms), stage="Exchange done" (2 ms), stage="Total time" (30 ms), Discovery lag=4 ms, Latest started node id=10ab0e92-dbb6-4839-bb03-4b3ab0c64001] [21:14:55] : [Step 4/5] [2021-11-19 21:14:55,722][INFO ][sys-#25417%grid-0%][GridClusterStateProcessor] Successfully performed final activation steps [nodeId=002379ee-6a1a-434d-99e5-6da3bf448000, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:14:55] : [Step 4/5] [2021-11-19 21:14:55,726][INFO ][sys-#25406%grid-0%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], stage="Affinity initialization on cache group start [grp=ignite-sys-cache]" (0 ms) (parent=Affinity initialization on cache group start), stage="Affinity centralized initialization (crd) [grp=ignite-sys-cache, crd=true]" (0 ms) (parent=Determine exchange type), stage="Restore partition states [grp=ignite-sys-cache]" (0 ms) (parent=Restore partition states), stage="Affinity recalculation (partitions availability) [grp=ignite-sys-cache]" (0 ms) (parent=Ideal affinity diff calculation (enforced))] [21:14:55] : [Step 4/5] [2021-11-19 21:14:55,726][INFO ][sys-#25526%grid-1%][GridCachePartitionExchangeManager] Delay process full message without exchange id (there is exchange in progress) [nodeId=002379ee-6a1a-434d-99e5-6da3bf448000] [21:14:55] : [Step 4/5] [2021-11-19 21:14:55,726][INFO ][sys-#25525%grid-1%][GridDhtPartitionsExchangeFuture] Received full message, will finish exchange [node=002379ee-6a1a-434d-99e5-6da3bf448000, resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:14:55] : [Step 4/5] [2021-11-19 21:14:55,730][INFO ][sys-#25525%grid-1%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], err=null, rebalanced=true, wasRebalanced=false] [21:14:55] : [Step 4/5] [2021-11-19 21:14:55,732][INFO ][sys-#25525%grid-1%][GridCacheProcessor] Finish proxy initialization, cacheName=ignite-sys-cache, localNodeId=10ab0e92-dbb6-4839-bb03-4b3ab0c64001 [21:14:55] : [Step 4/5] [2021-11-19 21:14:55,733][INFO ][sys-#25517%grid-1%][DistributedBaselineConfiguration] Baseline auto-adjust is 'disabled' with timeout='300000' ms [21:14:55] : [Step 4/5] [2021-11-19 21:14:55,734][INFO ][sys-#25517%grid-1%][GridClusterStateProcessor] Successfully performed final activation steps [nodeId=10ab0e92-dbb6-4839-bb03-4b3ab0c64001, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:14:55] : [Step 4/5] [2021-11-19 21:14:55,734][INFO ][sys-#25525%grid-1%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=10ab0e92-dbb6-4839-bb03-4b3ab0c64001, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=002379ee-6a1a-434d-99e5-6da3bf448000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345695638, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:14:55] : [Step 4/5] [2021-11-19 21:14:55,734][INFO ][exchange-worker-#25550%grid-1%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=2, minorTopVer=1], force=false, evt=DISCOVERY_CUSTOM_EVT, node=002379ee-6a1a-434d-99e5-6da3bf448000] [21:14:55] : [Step 4/5] [2021-11-19 21:14:55,735][INFO ][sys-#25525%grid-1%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (1 ms), stage="Update caches registry" (10 ms), stage="Start caches" (0 ms), stage="Affinity initialization on cache group start" (0 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Restore partition states" (0 ms), stage="After states restored callback" (7 ms), stage="WAL history reservation" (0 ms), stage="Waiting for Full message" (17 ms), stage="Affinity recalculation" (3 ms), stage="Full map updating" (0 ms), stage="Detect lost partitions" (1 ms), stage="Exchange done" (4 ms), stage="Total time" (43 ms)] [21:14:55] : [Step 4/5] [2021-11-19 21:14:55,737][INFO ][sys-#25525%grid-1%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], stage="Affinity initialization on cache group start [grp=ignite-sys-cache]" (0 ms) (parent=Affinity initialization on cache group start), stage="Affinity centralized initialization (crd) [grp=ignite-sys-cache, crd=false]" (0 ms) (parent=Determine exchange type), stage="Restore partition states [grp=ignite-sys-cache]" (0 ms) (parent=Restore partition states), stage="Affinity applying from full message [grp=ignite-sys-cache]" (3 ms) (parent=Affinity recalculation)] [21:14:55] : [Step 4/5] [2021-11-19 21:14:55,775][INFO ][exchange-worker-#25550%grid-1%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], crd=false, evt=DISCOVERY_CUSTOM_EVT, evtNode=002379ee-6a1a-434d-99e5-6da3bf448000, customEvt=DynamicCacheChangeBatch [id=7523e593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqs=ArrayList [DynamicCacheChangeRequest [cacheName=encrypted, hasCfg=true, nodeId=002379ee-6a1a-434d-99e5-6da3bf448000, clientStartOnly=false, stop=false, destroy=false, disabledAfterStart=false]], exchangeActions=ExchangeActions [startCaches=[encrypted], stopCaches=null, startGrps=[encrypted], stopGrps=[], resetParts=null, stateChangeRequest=null], startCaches=false], allowMerge=false, exchangeFreeSwitch=false] [21:14:55] : [Step 4/5] [2021-11-19 21:14:55,775][INFO ][exchange-worker-#25427%grid-0%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], crd=true, evt=DISCOVERY_CUSTOM_EVT, evtNode=002379ee-6a1a-434d-99e5-6da3bf448000, customEvt=DynamicCacheChangeBatch [id=7523e593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqs=ArrayList [DynamicCacheChangeRequest [cacheName=encrypted, hasCfg=true, nodeId=002379ee-6a1a-434d-99e5-6da3bf448000, clientStartOnly=false, stop=false, destroy=false, disabledAfterStart=false]], exchangeActions=ExchangeActions [startCaches=[encrypted], stopCaches=null, startGrps=[encrypted], stopGrps=[], resetParts=null, stateChangeRequest=null], startCaches=false], allowMerge=false, exchangeFreeSwitch=false] [21:14:55] : [Step 4/5] [2021-11-19 21:14:55,778][INFO ][exchange-worker-#25550%grid-1%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:14:55] : [Step 4/5] [2021-11-19 21:14:55,779][INFO ][exchange-worker-#25427%grid-0%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:14:55] : [Step 4/5] [2021-11-19 21:14:55,783][INFO ][exchange-worker-#25550%grid-1%][GridCacheProcessor] Started cache [name=encrypted, id=1613773252, dataRegionName=default, mode=PARTITIONED, atomicity=ATOMIC, backups=0, mvcc=false] [21:14:55] : [Step 4/5] [2021-11-19 21:14:55,784][INFO ][exchange-worker-#25550%grid-1%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], waitTime=0ms, futInfo=NA, mode=DISTRIBUTED] [21:14:55] : [Step 4/5] [2021-11-19 21:14:55,788][INFO ][exchange-worker-#25427%grid-0%][GridCacheProcessor] Started cache [name=encrypted, id=1613773252, dataRegionName=default, mode=PARTITIONED, atomicity=ATOMIC, backups=0, mvcc=false] [21:14:55] : [Step 4/5] [2021-11-19 21:14:55,789][INFO ][exchange-worker-#25427%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], waitTime=0ms, futInfo=NA, mode=DISTRIBUTED] [21:14:55] : [Step 4/5] [2021-11-19 21:14:55,790][INFO ][exchange-worker-#25427%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partitions release latch: ServerLatch [permits=0, pendingAcks=HashSet [], super=CompletableLatch [id=CompletableLatchUid [id=exchange, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2]]]] [21:14:55] : [Step 4/5] [2021-11-19 21:14:55,790][INFO ][exchange-worker-#25550%grid-1%][GridDhtPartitionsExchangeFuture] Finished waiting for partitions release latch: ClientLatch [coordinator=TcpDiscoveryNode [id=002379ee-6a1a-434d-99e5-6da3bf448000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345695638, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], ackSent=true, super=CompletableLatch [id=CompletableLatchUid [id=exchange, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2]]]] [21:14:55] : [Step 4/5] [2021-11-19 21:14:55,790][INFO ][exchange-worker-#25427%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:14:55] : [Step 4/5] [2021-11-19 21:14:55,791][INFO ][exchange-worker-#25550%grid-1%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:14:55] : [Step 4/5] [2021-11-19 21:14:55,792][INFO ][exchange-worker-#25427%grid-0%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], crd=true] [21:14:55] : [Step 4/5] [2021-11-19 21:14:55,794][INFO ][exchange-worker-#25550%grid-1%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], crd=false] [21:14:55] : [Step 4/5] [2021-11-19 21:14:55,794][INFO ][sys-#25404%grid-0%][GridDhtPartitionsExchangeFuture] Coordinator received single message [ver=AffinityTopologyVersion [topVer=2, minorTopVer=2], node=10ab0e92-dbb6-4839-bb03-4b3ab0c64001, allReceived=true] [21:14:55] : [Step 4/5] [2021-11-19 21:14:55,795][INFO ][sys-#25404%grid-0%][GridDhtPartitionsExchangeFuture] finishExchangeOnCoordinator [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2]] [21:14:55] : [Step 4/5] [2021-11-19 21:14:55,797][INFO ][sys-#25404%grid-0%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], err=null, rebalanced=true, wasRebalanced=true] [21:14:55] : [Step 4/5] [2021-11-19 21:14:55,798][INFO ][sys-#25519%grid-1%][GridDhtPartitionsExchangeFuture] Received full message, will finish exchange [node=002379ee-6a1a-434d-99e5-6da3bf448000, resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2]] [21:14:55] : [Step 4/5] [2021-11-19 21:14:55,798][INFO ][sys-#25404%grid-0%][GridCacheProcessor] Finish proxy initialization, cacheName=encrypted, localNodeId=002379ee-6a1a-434d-99e5-6da3bf448000 [21:14:55] : [Step 4/5] [2021-11-19 21:14:55,799][INFO ][sys-#25519%grid-1%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], err=null, rebalanced=true, wasRebalanced=true] [21:14:55] : [Step 4/5] [2021-11-19 21:14:55,799][INFO ][exchange-worker-#25427%grid-0%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=2, minorTopVer=2], force=false, evt=DISCOVERY_CUSTOM_EVT, node=002379ee-6a1a-434d-99e5-6da3bf448000] [21:14:55] : [Step 4/5] [2021-11-19 21:14:55,799][INFO ][sys-#25404%grid-0%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=002379ee-6a1a-434d-99e5-6da3bf448000, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=002379ee-6a1a-434d-99e5-6da3bf448000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345695730, loc=true, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2]] [21:14:55] : [Step 4/5] [2021-11-19 21:14:55,800][INFO ][sys-#25519%grid-1%][GridCacheProcessor] Finish proxy initialization, cacheName=encrypted, localNodeId=10ab0e92-dbb6-4839-bb03-4b3ab0c64001 [21:14:55] : [Step 4/5] [2021-11-19 21:14:55,801][INFO ][sys-#25404%grid-0%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (3 ms), stage="Update caches registry" (0 ms), stage="Start caches" (10 ms), stage="Affinity initialization on cache group start" (0 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Wait partitions release latch [latch=exchange]" (0 ms), stage="Wait partitions release [latch=exchange]" (1 ms), stage="Restore partition states" (0 ms), stage="After states restored callback" (0 ms), stage="WAL history reservation" (0 ms), stage="Waiting for all single messages" (2 ms), stage="Affinity recalculation (crd)" (0 ms), stage="Collect update counters and create affinity messages" (0 ms), stage="Assign partitions states" (0 ms), stage="Validate partitions states" (0 ms), stage="Apply update counters" (0 ms), stage="Full message preparing" (1 ms), stage="Full message sending" (0 ms), stage="Exchange done" (4 ms), stage="Total time" (21 ms)] [21:14:55] : [Step 4/5] [2021-11-19 21:14:55,802][INFO ][exchange-worker-#25550%grid-1%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=2, minorTopVer=2], force=false, evt=DISCOVERY_CUSTOM_EVT, node=002379ee-6a1a-434d-99e5-6da3bf448000] [21:14:55] : [Step 4/5] [2021-11-19 21:14:55,802][INFO ][sys-#25519%grid-1%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=10ab0e92-dbb6-4839-bb03-4b3ab0c64001, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=002379ee-6a1a-434d-99e5-6da3bf448000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345695638, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2]] [21:14:55] : [Step 4/5] [2021-11-19 21:14:55,803][INFO ][sys-#25404%grid-0%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], stage="Affinity initialization on cache group start [grp=encrypted]" (0 ms) (parent=Affinity initialization on cache group start), stage="Restore partition states [grp=ignite-sys-cache]" (0 ms) (parent=Restore partition states), stage="Restore partition states [grp=encrypted]" (0 ms) (parent=Restore partition states)] [21:14:55] : [Step 4/5] [2021-11-19 21:14:55,805][INFO ][sys-#25519%grid-1%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (1 ms), stage="Update caches registry" (0 ms), stage="Start caches" (6 ms), stage="Affinity initialization on cache group start" (0 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Wait partitions release latch [latch=exchange]" (6 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Restore partition states" (0 ms), stage="After states restored callback" (0 ms), stage="WAL history reservation" (0 ms), stage="Waiting for Full message" (4 ms), stage="Affinity recalculation" (0 ms), stage="Full map updating" (0 ms), stage="Exchange done" (6 ms), stage="Total time" (23 ms)] [21:14:55] : [Step 4/5] [2021-11-19 21:14:55,808][INFO ][sys-#25519%grid-1%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], stage="Affinity initialization on cache group start [grp=encrypted]" (0 ms) (parent=Affinity initialization on cache group start), stage="Restore partition states [grp=ignite-sys-cache]" (0 ms) (parent=Restore partition states), stage="Restore partition states [grp=encrypted]" (0 ms) (parent=Restore partition states)] [21:14:55] : [Step 4/5] [2021-11-19 21:14:55,897][INFO ][db-checkpoint-thread-#25561%grid-0%][Checkpointer] Checkpoint started [checkpointId=e8ef9d3d-b93d-4275-b373-a2b635744565, startPtr=WALPointer [idx=0, fileOff=86665, len=1963], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=41ms, writeCheckpointEntryDuration=148ms, splitAndSortCpPagesDuration=0ms, pages=18, reason='node started'] [21:14:55] : [Step 4/5] [2021-11-19 21:14:55,897][INFO ][db-checkpoint-thread-#25563%grid-1%][Checkpointer] Checkpoint started [checkpointId=1312dfe5-e736-430c-b28b-d0f83ff8772c, startPtr=WALPointer [idx=0, fileOff=86665, len=1963], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=40ms, writeCheckpointEntryDuration=148ms, splitAndSortCpPagesDuration=0ms, pages=18, reason='node started'] [21:14:56] : [Step 4/5] [2021-11-19 21:14:56,062][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10ab0e92-dbb6-4839-bb03-4b3ab0c64001, grp=1613773252] [21:14:56] : [Step 4/5] [2021-11-19 21:14:56,063][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=002379ee-6a1a-434d-99e5-6da3bf448000, grp=1613773252] [21:14:56] : [Step 4/5] [2021-11-19 21:14:56,068][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][root] >>> Stopping grid [name=grid-1, id=10ab0e92-dbb6-4839-bb03-4b3ab0c64001] [21:14:56] : [Step 4/5] [2021-11-19 21:14:56,069][INFO ][disco-notifier-worker-#25422%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=1] [21:14:56] : [Step 4/5] [2021-11-19 21:14:56,070][INFO ][reencrypt-#25582%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:14:56] : [Step 4/5] [2021-11-19 21:14:56,243][INFO ][db-checkpoint-thread-#25563%grid-1%][Checkpointer] Checkpoint finished [cpId=1312dfe5-e736-430c-b28b-d0f83ff8772c, pages=18, markPos=WALPointer [idx=0, fileOff=86665, len=1963], walSegmentsCovered=[], markDuration=191ms, pagesWrite=1ms, fsync=343ms, total=536ms] [21:14:56] : [Step 4/5] [2021-11-19 21:14:56,243][INFO ][db-checkpoint-thread-#25561%grid-0%][Checkpointer] Checkpoint finished [cpId=e8ef9d3d-b93d-4275-b373-a2b635744565, pages=18, markPos=WALPointer [idx=0, fileOff=86665, len=1963], walSegmentsCovered=[], markDuration=190ms, pagesWrite=2ms, fsync=343ms, total=536ms] [21:15:01] : [Step 4/5] [2021-11-19 21:15:01,247][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][TestTcpDiscoverySpi] No verification for local node leave has been received from coordinator (will stop node anyway). [21:15:01]W: [org.apache.ignite:ignite-core] [2021-11-19 21:15:01,248][WARN ][tcp-disco-sock-reader-[002379ee 127.0.0.1:41603]-#1341%grid-1%-#25546%grid-1%][TestTcpDiscoverySpi] Failed to shutdown socket [21:15:01]W: [org.apache.ignite:ignite-core] java.net.SocketException: Socket is closed [21:15:01]W: [org.apache.ignite:ignite-core] at java.net.Socket.shutdownOutput(Socket.java:1568) [21:15:01]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.close(IgniteUtils.java:4247) [21:15:01]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.discovery.tcp.ServerImpl$SocketReader.body(ServerImpl.java:7370) [21:15:01]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.IgniteSpiThread.run(IgniteSpiThread.java:58) [21:15:01] : [Step 4/5] [2021-11-19 21:15:01,249][INFO ][tcp-disco-sock-reader-[002379ee 127.0.0.1:41603]-#1341%grid-1%-#25546%grid-1%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:41603, rmtPort=41603, rmtNodeId=002379ee-6a1a-434d-99e5-6da3bf448000] [21:15:01] : [Step 4/5] [2021-11-19 21:15:01,251][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Stopped cache [cacheName=ignite-sys-cache] [21:15:01] : [Step 4/5] [2021-11-19 21:15:01,251][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Stopped cache [cacheName=encrypted] [21:15:01]W: [org.apache.ignite:ignite-core] [2021-11-19 21:15:01,253][WARN ][tcp-disco-msg-worker-[10ab0e92 127.0.0.1:47501 crd]-#1332%grid-0%-#25423%grid-0%][TestTcpDiscoverySpi] Failed to send message to next node [msg=TcpDiscoveryDiscardMessage [msgId=8133e593d71-002379ee-6a1a-434d-99e5-6da3bf448000, customMsgDiscard=true, super=TcpDiscoveryAbstractMessage [sndNodeId=null, id=b433e593d71-002379ee-6a1a-434d-99e5-6da3bf448000, verifierNodeId=002379ee-6a1a-434d-99e5-6da3bf448000, topVer=0, pendingIdx=0, failedNodes=null, isClient=false]], next=TcpDiscoveryNode [id=10ab0e92-dbb6-4839-bb03-4b3ab0c64001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637345695608, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], errMsg=Failed to send message to next node [msg=TcpDiscoveryDiscardMessage [msgId=8133e593d71-002379ee-6a1a-434d-99e5-6da3bf448000, customMsgDiscard=true, super=TcpDiscoveryAbstractMessage [sndNodeId=null, id=b433e593d71-002379ee-6a1a-434d-99e5-6da3bf448000, verifierNodeId=002379ee-6a1a-434d-99e5-6da3bf448000, topVer=0, pendingIdx=0, failedNodes=null, isClient=false]], next=ClusterNode [id=10ab0e92-dbb6-4839-bb03-4b3ab0c64001, order=2, addr=[127.0.0.1], daemon=false]]] [21:15:01]W: [org.apache.ignite:ignite-core] [2021-11-19 21:15:01,256][WARN ][tcp-disco-msg-worker-[10ab0e92 127.0.0.1:47501 crd]-#1332%grid-0%-#25423%grid-0%][TestTcpDiscoverySpi] Local node has detected failed nodes and started cluster-wide procedure. To speed up failure detection please see 'Failure Detection' section under javadoc for 'TcpDiscoverySpi' [21:15:01]W: [org.apache.ignite:ignite-core] [2021-11-19 21:15:01,257][WARN ][disco-event-worker-#25426%grid-0%][GridDiscoveryManager] Node FAILED: TcpDiscoveryNode [id=10ab0e92-dbb6-4839-bb03-4b3ab0c64001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637345695608, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false] [21:15:01] : [Step 4/5] [2021-11-19 21:15:01,258][INFO ][disco-event-worker-#25426%grid-0%][GridDiscoveryManager] Topology snapshot [ver=3, locNode=002379ee, servers=1, clients=0, state=ACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=002379ee-6a1a-434d-99e5-6da3bf448000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:15:01] : [Step 4/5] [2021-11-19 21:15:01,259][INFO ][disco-event-worker-#25426%grid-0%][GridDiscoveryManager] ^-- Baseline [id=0, size=2, online=1, offline=1] [21:15:01]W: [org.apache.ignite:ignite-core] [2021-11-19 21:15:01,260][WARN ][grid-nio-worker-tcp-comm-0-#25365%TestRecordingCommunicationSpi%][TestRecordingCommunicationSpi] Failed to shutdown socket [21:15:01]W: [org.apache.ignite:ignite-core] java.nio.channels.ClosedChannelException [21:15:01]W: [org.apache.ignite:ignite-core] at sun.nio.ch.SocketChannelImpl.shutdownOutput(SocketChannelImpl.java:795) [21:15:01]W: [org.apache.ignite:ignite-core] at sun.nio.ch.SocketAdaptor.shutdownOutput(SocketAdaptor.java:407) [21:15:01]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.close(IgniteUtils.java:4247) [21:15:01]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.closeKey(GridNioServer.java:2784) [21:15:01]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.close(GridNioServer.java:2835) [21:15:01]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.close(GridNioServer.java:2794) [21:15:01]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.bodyInternal(GridNioServer.java:2157) [21:15:01]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.body(GridNioServer.java:1910) [21:15:01]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:125) [21:15:01]W: [org.apache.ignite:ignite-core] at java.lang.Thread.run(Thread.java:748) [21:15:01] : [Step 4/5] [2021-11-19 21:15:01,261][INFO ][exchange-worker-#25427%grid-0%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], crd=true, evt=NODE_FAILED, evtNode=10ab0e92-dbb6-4839-bb03-4b3ab0c64001, customEvt=null, allowMerge=false, exchangeFreeSwitch=true] [21:15:01] : [Step 4/5] [2021-11-19 21:15:01,263][INFO ][sys-#25406%grid-0%][GridAffinityAssignmentCache] Local node affinity assignment distribution is not ideal [cache=encrypted, expectedPrimary=8.00, actualPrimary=3, expectedBackups=0.00, actualBackups=0, warningThreshold=50.00%] [21:15:01] : [Step 4/5] [2021-11-19 21:15:01,264][INFO ][exchange-worker-#25427%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:15:01] : [Step 4/5] [2021-11-19 21:15:01,265][INFO ][exchange-worker-#25427%grid-0%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], err=null, rebalanced=true, wasRebalanced=true] [21:15:01]W: [org.apache.ignite:ignite-core] [2021-11-19 21:15:01,266][WARN ][sys-#25402%grid-0%][GridDhtPartitionTopologyImpl] Detected lost partitions [grp=encrypted, parts=[0, 2, 4, 6-7], topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0]] [21:15:01] : [Step 4/5] [2021-11-19 21:15:01,267][INFO ][exchange-worker-#25427%grid-0%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=002379ee-6a1a-434d-99e5-6da3bf448000, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], evt=NODE_FAILED, evtNode=TcpDiscoveryNode [id=10ab0e92-dbb6-4839-bb03-4b3ab0c64001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637345695608, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0]] [21:15:01] : [Step 4/5] [2021-11-19 21:15:01,269][INFO ][exchange-worker-#25427%grid-0%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (2 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="After states restored callback" (0 ms), stage="WAL history reservation" (0 ms), stage="Finalize update counters" (0 ms), stage="Detect lost partitions" (1 ms), stage="Exchange done" (2 ms), stage="Total time" (5 ms)] [21:15:01] : [Step 4/5] [2021-11-19 21:15:01,270][INFO ][exchange-worker-#25427%grid-0%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], stage="Affinity initialization (exchange-free switch on fully-rebalanced topology) [grp=ignite-sys-cache]" (0 ms) (parent=Determine exchange type), stage="Affinity initialization (exchange-free switch on fully-rebalanced topology) [grp=encrypted]" (0 ms) (parent=Determine exchange type)] [21:15:01] : [Step 4/5] [2021-11-19 21:15:01,271][INFO ][exchange-worker-#25427%grid-0%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], crd=true] [21:15:01] : [Step 4/5] [2021-11-19 21:15:01,271][INFO ][exchange-worker-#25427%grid-0%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=3, minorTopVer=0], force=false, evt=NODE_FAILED, node=10ab0e92-dbb6-4839-bb03-4b3ab0c64001] [21:15:01] : [Step 4/5] [2021-11-19 21:15:01,551][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][FilePageStoreManager] Cleanup cache stores [total=4, left=0, cleanFiles=false] [21:15:01] : [Step 4/5] [2021-11-19 21:15:01,553][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][GridDeploymentLocalStore] Removed undeployed class: GridDeployment [ts=1637345695720, depMode=SHARED, clsLdr=IsolatedClassLoader{roleName='test'}, clsLdrId=0523e593d71-10ab0e92-dbb6-4839-bb03-4b3ab0c64001, userVer=0, loc=true, sampleClsName=org.apache.ignite.internal.processors.cache.distributed.dht.preloader.GridDhtPartitionFullMap, pendingUndeploy=false, undeployed=true, usage=0] [21:15:01] : [Step 4/5] [2021-11-19 21:15:01,560][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] [21:15:01] : [Step 4/5] [21:15:01] : [Step 4/5] >>> +------------------------------------------------------+ [21:15:01] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV stopped OK [21:15:01] : [Step 4/5] >>> +------------------------------------------------------+ [21:15:01] : [Step 4/5] >>> Ignite instance name: grid-1 [21:15:01] : [Step 4/5] >>> Grid uptime: 00:00:05.890 [21:15:01] : [Step 4/5] [21:15:01] : [Step 4/5] [21:15:01] : [Step 4/5] [2021-11-19 21:15:01,564][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=002379ee-6a1a-434d-99e5-6da3bf448000, grp=1613773252] [21:15:01] : [Step 4/5] [2021-11-19 21:15:01,567][INFO ][db-checkpoint-thread-#25561%grid-0%][Checkpointer] Checkpoint started [checkpointId=84517e44-98ed-4213-90c3-a37a86953b3c, startPtr=WALPointer [idx=0, fileOff=158680, len=2010], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=1ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=0ms, pages=43, reason='test'] [21:15:01] : [Step 4/5] [2021-11-19 21:15:01,618][INFO ][db-checkpoint-thread-#25561%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:15:01] : [Step 4/5] [2021-11-19 21:15:01,618][INFO ][db-checkpoint-thread-#25561%grid-0%][Checkpointer] Checkpoint finished [cpId=84517e44-98ed-4213-90c3-a37a86953b3c, pages=43, markPos=WALPointer [idx=0, fileOff=158680, len=2010], walSegmentsCovered=[], markDuration=3ms, pagesWrite=2ms, fsync=48ms, total=54ms] [21:15:01]W: [org.apache.ignite:ignite-core] [2021-11-19 21:15:01,626][WARN ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][G] Ignite work directory is not provided, automatically resolved to: /opt/buildagent/work/7bc1c54bc719b67c/work [21:15:01] : [Step 4/5] [2021-11-19 21:15:01,627][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] [21:15:01] : [Step 4/5] [21:15:01] : [Step 4/5] >>> __________ ________________ [21:15:01] : [Step 4/5] >>> / _/ ___/ |/ / _/_ __/ __/ [21:15:01] : [Step 4/5] >>> _/ // (7 7 // / / / / _/ [21:15:01] : [Step 4/5] >>> /___/\___/_/|_/___/ /_/ /___/ [21:15:01] : [Step 4/5] >>> [21:15:01] : [Step 4/5] >>> ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:15:01] : [Step 4/5] >>> 2021 Copyright(C) Apache Software Foundation [21:15:01] : [Step 4/5] >>> [21:15:01] : [Step 4/5] >>> Ignite documentation: http://ignite.apache.org [21:15:01] : [Step 4/5] [21:15:01] : [Step 4/5] [2021-11-19 21:15:01,628][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] Config URL: n/a [21:15:01] : [Step 4/5] [2021-11-19 21:15:01,628][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] IgniteConfiguration [igniteInstanceName=grid-1, pubPoolSize=24, svcPoolSize=24, callbackPoolSize=24, stripedPoolSize=24, sysPoolSize=24, mgmtPoolSize=4, dataStreamerPoolSize=24, utilityCachePoolSize=24, utilityCacheKeepAliveTime=60000, p2pPoolSize=2, qryPoolSize=24, buildIdxPoolSize=4, igniteHome=/opt/buildagent/work/7bc1c54bc719b67c, igniteWorkDir=/opt/buildagent/work/7bc1c54bc719b67c/work, mbeanSrv=com.sun.jmx.mbeanserver.JmxMBeanServer@6fe85038, nodeId=10792948-15d6-4aab-9ceb-082ae5349001, marsh=BinaryMarshaller [], marshLocJobs=false, daemon=false, p2pEnabled=true, netTimeout=10000, netCompressionLevel=1, sndRetryDelay=1000, sndRetryCnt=3, metricsHistSize=10000, metricsUpdateFreq=1000, metricsExpTime=9223372036854775807, discoSpi=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=0, ackTimeout=0, marsh=null, reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], segPlc=STOP, segResolveAttempts=2, waitForSegOnStart=true, allResolversPassReq=true, segChkFreq=10000, commSpi=TcpCommunicationSpi [connectGate=org.apache.ignite.spi.communication.tcp.internal.ConnectGateway@7d6d0297, ctxInitLatch=java.util.concurrent.CountDownLatch@69cb8f14[Count = 1], stopping=false, clientPool=null, nioSrvWrapper=null, stateProvider=null], evtSpi=MemoryEventStorageSpi [expireAgeMs=9223372036854775807, expireCnt=10000, filter=null], colSpi=NoopCollisionSpi [], deploySpi=LocalDeploymentSpi [], indexingSpi=org.apache.ignite.spi.indexing.noop.NoopIndexingSpi@2e7eaef2, addrRslvr=null, encryptionSpi=org.apache.ignite.spi.encryption.keystore.KeystoreEncryptionSpi@43a7e1f3, tracingSpi=org.apache.ignite.spi.tracing.NoopTracingSpi@6a00cc75, clientMode=false, rebalanceThreadPoolSize=4, rebalanceTimeout=10000, rebalanceBatchesPrefetchCnt=3, rebalanceThrottle=0, rebalanceBatchSize=524288, txCfg=TransactionConfiguration [txSerEnabled=false, dfltIsolation=REPEATABLE_READ, dfltConcurrency=PESSIMISTIC, dfltTxTimeout=0, txTimeoutOnPartitionMapExchange=0, deadlockTimeout=10000, pessimisticTxLogSize=0, pessimisticTxLogLinger=10000, tmLookupClsName=null, txManagerFactory=null, useJtaSync=false], cacheSanityCheckEnabled=true, discoStartupDelay=60000, deployMode=SHARED, p2pMissedCacheSize=100, locHost=127.0.0.1, timeSrvPortBase=31100, timeSrvPortRange=100, failureDetectionTimeout=10000, sysWorkerBlockedTimeout=null, clientFailureDetectionTimeout=10000, metricsLogFreq=0, connectorCfg=null, odbcCfg=null, warmupClos=null, atomicCfg=AtomicConfiguration [seqReserveSize=1000, cacheMode=PARTITIONED, backups=1, aff=null, grpName=null], classLdr=null, sslCtxFactory=null, platformCfg=null, binaryCfg=null, memCfg=null, pstCfg=null, dsCfg=DataStorageConfiguration [sysRegionInitSize=41943040, sysRegionMaxSize=104857600, pageSize=4096, concLvl=0, dfltDataRegConf=DataRegionConfiguration [name=default, maxSize=104857600, initSize=268435456, swapPath=null, pageEvictionMode=DISABLED, pageReplacementMode=CLOCK, evictionThreshold=0.9, emptyPagesPoolSize=100, metricsEnabled=false, metricsSubIntervalCount=5, metricsRateTimeInterval=60000, persistenceEnabled=true, checkpointPageBufSize=0, lazyMemoryAllocation=true, warmUpCfg=null], dataRegions=null, storagePath=null, checkpointFreq=30000, lockWaitTime=10000, checkpointThreads=4, checkpointWriteOrder=SEQUENTIAL, walHistSize=20, maxWalArchiveSize=20971520, walSegments=10, walSegmentSize=1048576, walPath=db/wal, walArchivePath=db/wal/archive, cdcWalPath=db/wal/cdc, cdcEnabled=false, metricsEnabled=false, walMode=LOG_ONLY, walTlbSize=131072, walBuffSize=0, walFlushFreq=2000, walFsyncDelay=1000, walRecordIterBuffSize=67108864, alwaysWriteFullPages=false, fileIOFactory=org.apache.ignite.internal.processors.cache.persistence.file.AsyncFileIOFactory@6c81a363, metricsSubIntervalCnt=5, metricsRateTimeInterval=60000, walAutoArchiveAfterInactivity=-1, walForceArchiveTimeout=-1, writeThrottlingEnabled=false, walCompactionEnabled=false, walCompactionLevel=1, checkpointReadLockTimeout=null, walPageCompression=DISABLED, walPageCompressionLevel=null, dfltWarmUpCfg=null, encCfg=org.apache.ignite.configuration.EncryptionConfiguration@2504ff24, defragmentationThreadPoolSize=4, minWalArchiveSize=-1], snapshotPath=snapshots, activeOnStart=true, activeOnStartPropSetFlag=false, autoActivation=true, autoActivationPropSetFlag=false, clusterStateOnStart=null, sqlConnCfg=null, cliConnCfg=ClientConnectorConfiguration [host=null, port=10800, portRange=100, sockSndBufSize=0, sockRcvBufSize=0, tcpNoDelay=true, maxOpenCursorsPerConn=128, threadPoolSize=24, selectorCnt=12, idleTimeout=0, handshakeTimeout=10000, jdbcEnabled=true, odbcEnabled=true, thinCliEnabled=true, sslEnabled=false, useIgniteSslCtxFactory=true, sslClientAuth=false, sslCtxFactory=null, thinCliCfg=ThinClientConfiguration [maxActiveTxPerConn=100, maxActiveComputeTasksPerConn=0]], mvccVacuumThreadCnt=2, mvccVacuumFreq=5000, authEnabled=false, failureHnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]], commFailureRslvr=null, sqlCfg=SqlConfiguration [longQryWarnTimeout=3000, dfltQryTimeout=0, sqlQryHistSize=1000, validationEnabled=false], asyncContinuationExecutor=null] [21:15:01] : [Step 4/5] [2021-11-19 21:15:01,638][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] Daemon mode: off [21:15:01] : [Step 4/5] [2021-11-19 21:15:01,638][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] OS: Linux 4.15.0-151-generic amd64 [21:15:01] : [Step 4/5] [2021-11-19 21:15:01,638][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] OS user: teamcity [21:15:01] : [Step 4/5] [2021-11-19 21:15:01,639][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] PID: 16724 [21:15:01] : [Step 4/5] [2021-11-19 21:15:01,639][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] Language runtime: Java Platform API Specification ver. 1.8 [21:15:01] : [Step 4/5] [2021-11-19 21:15:01,639][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] VM information: Java(TM) SE Runtime Environment 1.8.0_261-b12 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 25.261-b12 [21:15:01] : [Step 4/5] [2021-11-19 21:15:01,640][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] VM total memory: 1.9GB [21:15:01] : [Step 4/5] [2021-11-19 21:15:01,640][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] Remote Management [restart: off, REST: off, JMX (remote: off)] [21:15:01] : [Step 4/5] [2021-11-19 21:15:01,640][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] Logger: GridTestLog4jLogger [quiet=false, config=null] [21:15:01] : [Step 4/5] [2021-11-19 21:15:01,640][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] IGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c [21:15:01] : [Step 4/5] [2021-11-19 21:15:01,641][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] VM arguments: [-DIGNITE_DUMP_THREADS_ON_FAILURE=false, -DMono=/usr/bin/mono-sgen, -DMono4.0_x64=/usr/lib/mono/4.0, -DMono4.5_x64=/usr/lib/mono/4.5, -DMonoVersion=6.12.0.90, -DSKIP_BUILD=false, -Dagent.home.dir=/opt/buildagent, -Dagent.name=aitc-lin02_03, -Dagent.ownPort=9090, -Dagent.work.dir=/opt/buildagent/work, -Dbuild.number=95, -Dbuild.vcs.number=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.1=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.GitHubApacheIgnite=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dclassworlds.conf=/opt/buildagent/temp/buildTmp/teamcity.m2.conf, -Dcom.jetbrains.maven.watcher.report.file=/opt/buildagent/temp/buildTmp/maven-build-info.xml, -Djava.io.tmpdir=/opt/buildagent/temp/buildTmp, -Dmaven.home=/opt/buildagent/tools/maven3_6, -Dmaven.multiModuleProjectDirectory=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.agent.cpuBenchmark=457, -Dteamcity.agent.dotnet.agent_url=http://localhost:9090/RPC2, -Dteamcity.agent.dotnet.build_id=6278078, -Dteamcity.auth.password=*******, -Dteamcity.auth.userId=TeamCityBuildId=6278078, -Dteamcity.build.changedFiles.file=/opt/buildagent/temp/buildTmp/changedFiles6342607772318147725.txt, -Dteamcity.build.checkoutDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.build.id=6278078, -Dteamcity.build.properties.file=/opt/buildagent/temp/buildTmp/teamcity.build5164517880467851002.properties, -Dteamcity.build.tempDir=/opt/buildagent/temp/buildTmp, -Dteamcity.build.workingDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.buildConfName=Basic 3, -Dteamcity.buildType.id=IgniteTests24Java8_Basic3, -Dteamcity.configuration.properties.file=/opt/buildagent/temp/buildTmp/teamcity.config5591980786735343870.properties, -Dteamcity.maven.userSettings.path=/opt/buildagent/temp/buildTmp/maven_settings_585072866407032347.xml, -Dteamcity.maven.watcher.home=/opt/buildagent/plugins/mavenPlugin/maven-watcher-jdk16, -Dteamcity.projectName=Ignite Tests 2.x (JDK 8/11), -Dteamcity.runner.properties.file=/opt/buildagent/temp/buildTmp/teamcity.runner9098465561618137420.properties, -Dteamcity.tests.recentlyFailedTests.file=/opt/buildagent/temp/buildTmp/testsToRunFirst3891775683130404069.txt, -Dteamcity.version=2021.2 (build 99542), -ea, -Xms2g, -Xmx2g, -XX:+HeapDumpOnOutOfMemoryError, -DIGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_TEST_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_UPDATE_NOTIFIER=false, -DIGNITE_NO_DISCO_ORDER=true, -DIGNITE_PERFORMANCE_SUGGESTIONS_DISABLED=true, -Djava.net.preferIPv4Stack=true, -DTEST_SCALE_FACTOR=1.0, -DIGNITE_TEST_PROP_LOG4J_FILE=log4j-tc-test.xml, -DIGNITE_QUIET=false, -DIGNITE_MARSHAL_BUFFERS_RECHECK=1000, -Dmaven.repo.local=/opt/buildagent/.m2/repository] [21:15:01] : [Step 4/5] [2021-11-19 21:15:01,646][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] System cache's DataRegion size is configured to 40 MB. Use DataStorageConfiguration.systemRegionInitialSize property to change the setting. [21:15:01] : [Step 4/5] [2021-11-19 21:15:01,646][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] Configured caches [in 'sysMemPlc' dataRegion: ['ignite-sys-cache']] [21:15:01]W: [org.apache.ignite:ignite-core] [2021-11-19 21:15:01,647][WARN ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] Peer class loading is enabled (disable it in production for performance and deployment consistency reasons) [21:15:01] : [Step 4/5] [2021-11-19 21:15:01,647][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] 3-rd party licenses can be found at: /opt/buildagent/work/7bc1c54bc719b67c/libs/licenses [21:15:01] : [Step 4/5] [2021-11-19 21:15:01,651][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] Configured plugins: [21:15:01] : [Step 4/5] [2021-11-19 21:15:01,652][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- StanByClusterTestProvider 1.0 [21:15:01] : [Step 4/5] [2021-11-19 21:15:01,652][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:15:01] : [Step 4/5] [2021-11-19 21:15:01,652][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] [21:15:01] : [Step 4/5] [2021-11-19 21:15:01,652][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- PageMemory tracker plugin 1.0 [21:15:01] : [Step 4/5] [2021-11-19 21:15:01,652][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:15:01] : [Step 4/5] [2021-11-19 21:15:01,653][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] [21:15:01] : [Step 4/5] [2021-11-19 21:15:01,653][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- TestDistibutedConfigurationPlugin 1.0 [21:15:01] : [Step 4/5] [2021-11-19 21:15:01,653][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:15:01] : [Step 4/5] [2021-11-19 21:15:01,653][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] [21:15:01] : [Step 4/5] [2021-11-19 21:15:01,654][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- NodeValidationPluginProvider 1.0 [21:15:01] : [Step 4/5] [2021-11-19 21:15:01,654][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:15:01] : [Step 4/5] [2021-11-19 21:15:01,654][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] [21:15:01] : [Step 4/5] [2021-11-19 21:15:01,654][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][FailureProcessor] Configured failure handler: [hnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]]] [21:15:01] : [Step 4/5] [2021-11-19 21:15:01,666][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][TestRecordingCommunicationSpi] Successfully bound communication NIO server to TCP port [port=47101, locHost=/127.0.0.1, selectorsCnt=12, selectorSpins=0, pairedConn=false] [21:15:01]W: [org.apache.ignite:ignite-core] [2021-11-19 21:15:01,666][WARN ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][TestRecordingCommunicationSpi] Message queue limit is set to 0 which may lead to potential OOMEs when running cache operations in FULL_ASYNC or PRIMARY_SYNC modes due to message queues growth on sender and receiver sides. [21:15:01] : [Step 4/5] [2021-11-19 21:15:01,671][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][GridCollisionManager] Collision resolution is disabled (all jobs will be activated upon arrival). [21:15:01] : [Step 4/5] [2021-11-19 21:15:01,671][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] Security status [authentication=off, sandbox=off, tls/ssl=off] [21:15:01] : [Step 4/5] [2021-11-19 21:15:01,751][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:15:01] : [Step 4/5] [2021-11-19 21:15:01,865][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][MaintenanceProcessor] Resolved store directory for node persistent data: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1 [21:15:01] : [Step 4/5] [2021-11-19 21:15:01,867][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][CacheObjectBinaryProcessorImpl] Resolved directory for serialized binary metadata: /opt/buildagent/work/7bc1c54bc719b67c/work/db/binary_meta/grid_1 [21:15:01] : [Step 4/5] [2021-11-19 21:15:01,873][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1 [21:15:01] : [Step 4/5] [2021-11-19 21:15:01,874][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][FileWriteAheadLogManager] Resolved write ahead log work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1 [21:15:01] : [Step 4/5] [2021-11-19 21:15:01,874][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][FileWriteAheadLogManager] Resolved write ahead log archive directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1 [21:15:01] : [Step 4/5] [2021-11-19 21:15:01,876][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000005.wal [21:15:01] : [Step 4/5] [2021-11-19 21:15:01,877][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000006.wal [21:15:01] : [Step 4/5] [2021-11-19 21:15:01,877][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000008.wal [21:15:01] : [Step 4/5] [2021-11-19 21:15:01,878][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000004.wal [21:15:01] : [Step 4/5] [2021-11-19 21:15:01,878][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000003.wal [21:15:01] : [Step 4/5] [2021-11-19 21:15:01,879][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000002.wal [21:15:01] : [Step 4/5] [2021-11-19 21:15:01,879][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000007.wal [21:15:01] : [Step 4/5] [2021-11-19 21:15:01,880][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000001.wal [21:15:01] : [Step 4/5] [2021-11-19 21:15:01,880][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000009.wal [21:15:01] : [Step 4/5] [2021-11-19 21:15:01,885][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][FileHandleManagerImpl] Initialized write-ahead log manager [mode=LOG_ONLY] [21:15:01] : [Step 4/5] [2021-11-19 21:15:01,890][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Configured data regions initialized successfully [total=5] [21:15:01] : [Step 4/5] [2021-11-19 21:15:01,892][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][IgniteSnapshotManager] Resolved snapshot work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/snapshots [21:15:01] : [Step 4/5] [2021-11-19 21:15:01,892][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][IgniteSnapshotManager] Resolved temp directory for snapshot creation: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1/snp [21:15:01] : [Step 4/5] [2021-11-19 21:15:01,896][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][ClientListenerProcessor] Client connector processor has started on TCP port 10801 [21:15:01] : [Step 4/5] [2021-11-19 21:15:01,903][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] Non-loopback local IPs: 172.17.0.4 [21:15:01] : [Step 4/5] [2021-11-19 21:15:01,903][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] Enabled local MACs: 0242AC110004 [21:15:01] : [Step 4/5] [2021-11-19 21:15:01,906][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=/opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1/cp/1637345695707-1312dfe5-e736-430c-b28b-d0f83ff8772c-START.bin, endMarker=/opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1/cp/1637345695707-1312dfe5-e736-430c-b28b-d0f83ff8772c-END.bin] [21:15:01] : [Step 4/5] [2021-11-19 21:15:01,907][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:15:01] : [Step 4/5] [2021-11-19 21:15:01,908][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=86665, len=1963], lastMarked=WALPointer [idx=0, fileOff=86665, len=1963], lastCheckpointId=1312dfe5-e736-430c-b28b-d0f83ff8772c] [21:15:01] : [Step 4/5] [2021-11-19 21:15:01,913][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Found last checkpoint marker [cpId=1312dfe5-e736-430c-b28b-d0f83ff8772c, pos=WALPointer [idx=0, fileOff=86665, len=1963]] [21:15:01] : [Step 4/5] [2021-11-19 21:15:01,917][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Applying lost metastore updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=86665, len=1963], lastCheckpointId=1312dfe5-e736-430c-b28b-d0f83ff8772c] [21:15:01] : [Step 4/5] [2021-11-19 21:15:01,919][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=0 ms] [21:15:01] : [Step 4/5] [2021-11-19 21:15:01,920][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Restoring partition state for local groups. [21:15:01] : [Step 4/5] [2021-11-19 21:15:01,920][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=0, partitionsProcessed=0, time=0ms] [21:15:01] : [Step 4/5] [2021-11-19 21:15:01,931][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][GridClusterStateProcessor] Restoring history for BaselineTopology[id=0] [21:15:01] : [Step 4/5] [2021-11-19 21:15:01,941][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][ClusterProcessor] Cluster ID and tag has been read from metastorage: ClusterIdAndTag [id=647b2dee-102c-403f-99a7-7cf41c4afc06, tag=nervous_murdock] [21:15:01] : [Step 4/5] [2021-11-19 21:15:01,941][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][IgniteClusterImpl] Shutdown policy was updated [oldVal=null, newVal=null] [21:15:01] : [Step 4/5] [2021-11-19 21:15:01,942][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustEnabled' was changed from 'null' to 'false' [21:15:01] : [Step 4/5] [2021-11-19 21:15:01,942][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustTimeout' was changed from 'null' to '300000' [21:15:01] : [Step 4/5] [2021-11-19 21:15:01,943][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][IgniteTxManager] Transactions parameter 'txOwnerDumpRequestsAllowed' was changed from 'null' to 'true' [21:15:01] : [Step 4/5] [2021-11-19 21:15:01,943][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][IgniteTxManager] Transactions parameter 'longOperationsDumpTimeout' was changed from 'null' to '60000' [21:15:01] : [Step 4/5] [2021-11-19 21:15:01,944][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpThreshold' was changed from 'null' to '0' [21:15:01] : [Step 4/5] [2021-11-19 21:15:01,945][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][IgniteTxManager] Transactions parameter 'transactionTimeDumpSamplesCoefficient' was changed from 'null' to '0.0' [21:15:01] : [Step 4/5] [2021-11-19 21:15:01,945][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpSamplesPerSecondLimit' was changed from 'null' to '5' [21:15:01] : [Step 4/5] [2021-11-19 21:15:01,946][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][IgniteTxManager] Transactions parameter 'collisionsDumpInterval' was changed from 'null' to '1000' [21:15:01] : [Step 4/5] [2021-11-19 21:15:01,946][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Historical rebalance WAL threshold changed [property=historical.rebalance.threshold, oldVal=null, newVal=500] [21:15:01] : [Step 4/5] [2021-11-19 21:15:01,947][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Checkpoint frequency deviation changed [oldVal=null, newVal=null] [21:15:01] : [Step 4/5] [2021-11-19 21:15:01,947][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][FilePageStoreManager] Cleanup cache stores [total=1, left=0, cleanFiles=false] [21:15:01] : [Step 4/5] [2021-11-19 21:15:01,949][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:15:01] : [Step 4/5] [2021-11-19 21:15:01,950][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:15:01] : [Step 4/5] [2021-11-19 21:15:01,951][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:15:01] : [Step 4/5] [2021-11-19 21:15:01,952][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Data Regions Started: 5 [21:15:01] : [Step 4/5] [2021-11-19 21:15:01,952][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] ^-- sysMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:15:01] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:15:01] : [Step 4/5] ^-- default region [type=default, persistence=true, lazyAlloc=true, [21:15:01] : [Step 4/5] ... initCfg=100MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB, allocTotal=0MB] [21:15:01] : [Step 4/5] ^-- metastoreMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:15:01] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:15:01] : [Step 4/5] ^-- TxLog region [type=internal, persistence=true, lazyAlloc=false, [21:15:01] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:15:01] : [Step 4/5] ^-- volatileDsMemPlc region [type=user, persistence=false, lazyAlloc=true, [21:15:01] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB] [21:15:01] : [Step 4/5] ^-- Ignite persistence [used=0MB] [21:15:01] : [Step 4/5] [21:15:01] : [Step 4/5] [2021-11-19 21:15:01,954][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Starting binary memory restore for: [-2100569601, 1613773252] [21:15:01] : [Step 4/5] [2021-11-19 21:15:01,966][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=/opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1/cp/1637345695707-1312dfe5-e736-430c-b28b-d0f83ff8772c-START.bin, endMarker=/opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1/cp/1637345695707-1312dfe5-e736-430c-b28b-d0f83ff8772c-END.bin] [21:15:01] : [Step 4/5] [2021-11-19 21:15:01,966][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=86665, len=1963], lastMarked=WALPointer [idx=0, fileOff=86665, len=1963], lastCheckpointId=1312dfe5-e736-430c-b28b-d0f83ff8772c] [21:15:01] : [Step 4/5] [2021-11-19 21:15:01,970][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Found last checkpoint marker [cpId=1312dfe5-e736-430c-b28b-d0f83ff8772c, pos=WALPointer [idx=0, fileOff=86665, len=1963]] [21:15:01] : [Step 4/5] [2021-11-19 21:15:01,974][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Binary memory state restored at node startup [restoredPtr=WALPointer [idx=0, fileOff=156613, len=0]] [21:15:01] : [Step 4/5] [2021-11-19 21:15:01,976][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000000.wal, offset=156613, ver=2] [21:15:01] : [Step 4/5] [2021-11-19 21:15:01,979][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Started cache in recovery mode [name=ignite-sys-cache, id=-2100569601, dataRegionName=sysMemPlc, mode=REPLICATED, atomicity=TRANSACTIONAL, backups=2147483647, mvcc=false] [21:15:01] : [Step 4/5] [2021-11-19 21:15:01,981][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:15:01] : [Step 4/5] [2021-11-19 21:15:01,984][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Started cache in recovery mode [name=encrypted, id=1613773252, dataRegionName=default, mode=PARTITIONED, atomicity=ATOMIC, backups=0, mvcc=false] [21:15:01] : [Step 4/5] [2021-11-19 21:15:01,985][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Binary recovery performed in 31 ms. [21:15:01] : [Step 4/5] [2021-11-19 21:15:01,986][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=/opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1/cp/1637345695707-1312dfe5-e736-430c-b28b-d0f83ff8772c-START.bin, endMarker=/opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1/cp/1637345695707-1312dfe5-e736-430c-b28b-d0f83ff8772c-END.bin] [21:15:01] : [Step 4/5] [2021-11-19 21:15:01,986][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Applying lost cache updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=86665, len=1963], lastCheckpointId=1312dfe5-e736-430c-b28b-d0f83ff8772c] [21:15:01] : [Step 4/5] [2021-11-19 21:15:01,995][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=62, time=0 ms] [21:15:01] : [Step 4/5] [2021-11-19 21:15:01,996][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Restoring partition state for local groups. [21:15:02] : [Step 4/5] [2021-11-19 21:15:02,015][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=2, partitionsProcessed=108, time=20ms] [21:15:02] : [Step 4/5] [2021-11-19 21:15:02,018][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][TestTcpDiscoverySpi] Successfully bound to TCP port [port=47501, localHost=localhost/127.0.0.1, locNodeId=10792948-15d6-4aab-9ceb-082ae5349001] [21:15:02] : [Step 4/5] [2021-11-19 21:15:02,022][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][GridEncryptionManager] Sending stored group keys to coordinator [grps=1613773252] [21:15:02] : [Step 4/5] [2021-11-19 21:15:02,028][INFO ][tcp-disco-srvr-[:47500]-#1333%grid-0%-#25424%grid-0%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=45085] [21:15:02] : [Step 4/5] [2021-11-19 21:15:02,029][INFO ][tcp-disco-srvr-[:47500]-#1333%grid-0%-#25424%grid-0%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=45085] [21:15:02] : [Step 4/5] [2021-11-19 21:15:02,030][INFO ][tcp-disco-sock-reader-[]-#1348%grid-0%-#25700%grid-0%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:45085, rmtPort=45085] [21:15:02] : [Step 4/5] [2021-11-19 21:15:02,031][INFO ][tcp-disco-sock-reader-[10792948 127.0.0.1:45085]-#1348%grid-0%-#25700%grid-0%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=10792948-15d6-4aab-9ceb-082ae5349001, rmtAddr=/127.0.0.1:45085] [21:15:02] : [Step 4/5] [2021-11-19 21:15:02,035][INFO ][tcp-disco-srvr-[:47501]-#1347%grid-1%-#25699%grid-1%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=39171] [21:15:02] : [Step 4/5] [2021-11-19 21:15:02,036][INFO ][tcp-disco-srvr-[:47501]-#1347%grid-1%-#25699%grid-1%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=39171] [21:15:02] : [Step 4/5] [2021-11-19 21:15:02,036][INFO ][tcp-disco-sock-reader-[]-#1349%grid-1%-#25701%grid-1%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:39171, rmtPort=39171] [21:15:02] : [Step 4/5] [2021-11-19 21:15:02,037][INFO ][tcp-disco-sock-reader-[]-#1349%grid-1%-#25701%grid-1%][TestTcpDiscoverySpi] Received ping request from the remote node [rmtNodeId=002379ee-6a1a-434d-99e5-6da3bf448000, rmtAddr=/127.0.0.1:39171, rmtPort=39171] [21:15:02] : [Step 4/5] [2021-11-19 21:15:02,038][INFO ][tcp-disco-sock-reader-[]-#1349%grid-1%-#25701%grid-1%][TestTcpDiscoverySpi] Finished writing ping response [rmtNodeId=002379ee-6a1a-434d-99e5-6da3bf448000, rmtAddr=/127.0.0.1:39171, rmtPort=39171] [21:15:02] : [Step 4/5] [2021-11-19 21:15:02,039][INFO ][tcp-disco-sock-reader-[]-#1349%grid-1%-#25701%grid-1%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:39171, rmtPort=39171, rmtNodeId=null] [21:15:02] : [Step 4/5] [2021-11-19 21:15:02,039][INFO ][tcp-disco-sock-reader-[10792948 127.0.0.1:45085]-#1348%grid-0%-#25700%grid-0%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:45085, rmtPort=45085, rmtNodeId=10792948-15d6-4aab-9ceb-082ae5349001] [21:15:02] : [Step 4/5] [2021-11-19 21:15:02,054][INFO ][tcp-disco-msg-worker-[crd]-#1332%grid-0%-#25423%grid-0%][TestTcpDiscoverySpi] New next node [newNext=TcpDiscoveryNode [id=10792948-15d6-4aab-9ceb-082ae5349001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=0, intOrder=3, lastExchangeTime=1637345702026, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false]] [21:15:02] : [Step 4/5] [2021-11-19 21:15:02,055][INFO ][tcp-disco-srvr-[:47501]-#1347%grid-1%-#25699%grid-1%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=60745] [21:15:02] : [Step 4/5] [2021-11-19 21:15:02,055][INFO ][tcp-disco-srvr-[:47501]-#1347%grid-1%-#25699%grid-1%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=60745] [21:15:02] : [Step 4/5] [2021-11-19 21:15:02,056][INFO ][tcp-disco-sock-reader-[]-#1350%grid-1%-#25702%grid-1%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:60745, rmtPort=60745] [21:15:02] : [Step 4/5] [2021-11-19 21:15:02,057][INFO ][tcp-disco-sock-reader-[002379ee 127.0.0.1:60745]-#1350%grid-1%-#25702%grid-1%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=002379ee-6a1a-434d-99e5-6da3bf448000, rmtAddr=/127.0.0.1:60745] [21:15:02] : [Step 4/5] [2021-11-19 21:15:02,061][INFO ][tcp-disco-msg-worker-[]-#1346%grid-1%-#25698%grid-1%][TestTcpDiscoverySpi] New next node [newNext=TcpDiscoveryNode [id=002379ee-6a1a-434d-99e5-6da3bf448000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345702056, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false]] [21:15:02] : [Step 4/5] [2021-11-19 21:15:02,062][INFO ][tcp-disco-srvr-[:47500]-#1333%grid-0%-#25424%grid-0%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=59931] [21:15:02] : [Step 4/5] [2021-11-19 21:15:02,062][INFO ][tcp-disco-srvr-[:47500]-#1333%grid-0%-#25424%grid-0%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=59931] [21:15:02] : [Step 4/5] [2021-11-19 21:15:02,063][INFO ][tcp-disco-sock-reader-[]-#1351%grid-0%-#25703%grid-0%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:59931, rmtPort=59931] [21:15:02] : [Step 4/5] [2021-11-19 21:15:02,064][INFO ][tcp-disco-sock-reader-[10792948 127.0.0.1:59931]-#1351%grid-0%-#25703%grid-0%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=10792948-15d6-4aab-9ceb-082ae5349001, rmtAddr=/127.0.0.1:59931] [21:15:02] : [Step 4/5] [2021-11-19 21:15:02,068][INFO ][disco-event-worker-#25426%grid-0%][GridDiscoveryManager] Added new node to topology: TcpDiscoveryNode [id=10792948-15d6-4aab-9ceb-082ae5349001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=4, intOrder=3, lastExchangeTime=1637345702026, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false] [21:15:02] : [Step 4/5] [2021-11-19 21:15:02,069][INFO ][disco-event-worker-#25426%grid-0%][GridDiscoveryManager] Topology snapshot [ver=4, locNode=002379ee, servers=2, clients=0, state=ACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=002379ee-6a1a-434d-99e5-6da3bf448000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=10792948-15d6-4aab-9ceb-082ae5349001, consistentId=grid-1, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:15:02] : [Step 4/5] [2021-11-19 21:15:02,070][INFO ][disco-event-worker-#25426%grid-0%][GridDiscoveryManager] ^-- Baseline [id=0, size=2, online=2, offline=0] [21:15:02] : [Step 4/5] [2021-11-19 21:15:02,071][INFO ][exchange-worker-#25427%grid-0%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], crd=true, evt=NODE_JOINED, evtNode=10792948-15d6-4aab-9ceb-082ae5349001, customEvt=null, allowMerge=true, exchangeFreeSwitch=false] [21:15:02] : [Step 4/5] [2021-11-19 21:15:02,072][INFO ][exchange-worker-#25427%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], waitTime=0ms, futInfo=NA, mode=DISTRIBUTED] [21:15:02] : [Step 4/5] [2021-11-19 21:15:02,072][INFO ][exchange-worker-#25427%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partitions release latch: ServerLatch [permits=0, pendingAcks=HashSet [], super=CompletableLatch [id=CompletableLatchUid [id=exchange, topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0]]]] [21:15:02] : [Step 4/5] [2021-11-19 21:15:02,073][INFO ][exchange-worker-#25427%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:15:02] : [Step 4/5] [2021-11-19 21:15:02,074][INFO ][exchange-worker-#25427%grid-0%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], crd=true] [21:15:02] : [Step 4/5] [2021-11-19 21:15:02,074][INFO ][tcp-disco-msg-worker-[002379ee 127.0.0.1:47500]-#1346%grid-1%-#25698%grid-1%][GridEncryptionManager] Store group key received from coordinator [grp=1613773252, keyId=1] [21:15:02] : [Step 4/5] [2021-11-19 21:15:02,076][INFO ][disco-notifier-worker-#25697%grid-1%][MvccProcessorImpl] Assigned mvcc coordinator [crd=MvccCoordinator [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], nodeId=002379ee-6a1a-434d-99e5-6da3bf448000, ver=1637345694577, local=false, initialized=false]] [21:15:02] : [Step 4/5] [2021-11-19 21:15:02,081][INFO ][sys-#25686%grid-1%][ClusterProcessor] Writing cluster ID and tag to metastorage on ready for write ClusterIdAndTag [id=647b2dee-102c-403f-99a7-7cf41c4afc06, tag=nervous_murdock] [21:15:02] : [Step 4/5] [2021-11-19 21:15:02,120][INFO ][exchange-worker-#25706%grid-1%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], crd=false, evt=NODE_JOINED, evtNode=10792948-15d6-4aab-9ceb-082ae5349001, customEvt=null, allowMerge=true, exchangeFreeSwitch=false] [21:15:02] : [Step 4/5] [2021-11-19 21:15:02,120][INFO ][exchange-worker-#25706%grid-1%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1 [21:15:02] : [Step 4/5] [2021-11-19 21:15:02,123][INFO ][exchange-worker-#25706%grid-1%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000000.wal, offset=213613, ver=2] [21:15:02] : [Step 4/5] [2021-11-19 21:15:02,126][INFO ][exchange-worker-#25706%grid-1%][GridClusterStateProcessor] Writing BaselineTopology[id=0] [21:15:02] : [Step 4/5] [2021-11-19 21:15:02,128][INFO ][exchange-worker-#25706%grid-1%][GridCacheDatabaseSharedManager] Finish recovery performed in 7 ms. [21:15:02] : [Step 4/5] [2021-11-19 21:15:02,129][INFO ][exchange-worker-#25706%grid-1%][msg] Components activation performed in 9 ms. [21:15:02] : [Step 4/5] [2021-11-19 21:15:02,130][INFO ][sys-#25689%grid-1%][GridCacheProcessor] Finished recovery for cache [cache=ignite-sys-cache, grp=ignite-sys-cache, startVer=AffinityTopologyVersion [topVer=4, minorTopVer=0]] [21:15:02] : [Step 4/5] [2021-11-19 21:15:02,130][INFO ][exchange-worker-#25706%grid-1%][GridCacheProcessor] Finished recovery for cache [cache=encrypted, grp=encrypted, startVer=AffinityTopologyVersion [topVer=4, minorTopVer=0]] [21:15:02] : [Step 4/5] [2021-11-19 21:15:02,131][INFO ][exchange-worker-#25706%grid-1%][GridCacheProcessor] Starting caches on local join performed in 10 ms. [21:15:02] : [Step 4/5] [2021-11-19 21:15:02,134][INFO ][exchange-worker-#25706%grid-1%][GridDhtPartitionsExchangeFuture] Skipped waiting for partitions release future (local node is joining) [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0]] [21:15:02] : [Step 4/5] [2021-11-19 21:15:02,141][INFO ][db-checkpoint-thread-#25711%grid-1%][Checkpointer] Checkpoint started [checkpointId=e7185d0c-36f2-48fd-ba50-848adb834c25, startPtr=WALPointer [idx=0, fileOff=318728, len=2064], checkpointBeforeLockTime=2ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=1ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=1ms, writeCheckpointEntryDuration=2ms, splitAndSortCpPagesDuration=0ms, pages=72, reason='node started'] [21:15:02] : [Step 4/5] [2021-11-19 21:15:02,141][INFO ][grid-nio-worker-tcp-comm-1-#25366%TestRecordingCommunicationSpi%][TestRecordingCommunicationSpi] Accepted incoming communication connection [locAddr=/127.0.0.1:47100, rmtAddr=/127.0.0.1:35500] [21:15:02] : [Step 4/5] [2021-11-19 21:15:02,145][INFO ][grid-nio-worker-tcp-comm-0-#25639%TestRecordingCommunicationSpi%][TestRecordingCommunicationSpi] Established outgoing communication connection [locAddr=/127.0.0.1:35500, rmtAddr=/127.0.0.1:47100] [21:15:02] : [Step 4/5] [2021-11-19 21:15:02,148][INFO ][exchange-worker-#25706%grid-1%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], crd=false] [21:15:02] : [Step 4/5] [2021-11-19 21:15:02,149][INFO ][sys-#25405%grid-0%][GridDhtPartitionsExchangeFuture] Coordinator received single message [ver=AffinityTopologyVersion [topVer=4, minorTopVer=0], node=10792948-15d6-4aab-9ceb-082ae5349001, allReceived=true] [21:15:02] : [Step 4/5] [2021-11-19 21:15:02,149][INFO ][sys-#25405%grid-0%][GridDhtPartitionsExchangeFuture] Coordinator received all messages, try merge [ver=AffinityTopologyVersion [topVer=4, minorTopVer=0]] [21:15:02] : [Step 4/5] [2021-11-19 21:15:02,150][INFO ][sys-#25405%grid-0%][GridDhtPartitionsExchangeFuture] finishExchangeOnCoordinator [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=0]] [21:15:02] : [Step 4/5] [2021-11-19 21:15:02,154][INFO ][sys-#25405%grid-0%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], err=null, rebalanced=false, wasRebalanced=true] [21:15:02] : [Step 4/5] [2021-11-19 21:15:02,155][INFO ][sys-#25405%grid-0%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=002379ee-6a1a-434d-99e5-6da3bf448000, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], evt=NODE_JOINED, evtNode=TcpDiscoveryNode [id=10792948-15d6-4aab-9ceb-082ae5349001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=4, intOrder=3, lastExchangeTime=1637345702026, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=false, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0]] [21:15:02] : [Step 4/5] [2021-11-19 21:15:02,157][INFO ][sys-#25405%grid-0%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (0 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Wait partitions release latch [latch=exchange]" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="After states restored callback" (0 ms), stage="WAL history reservation" (0 ms), stage="Waiting for all single messages" (75 ms), stage="Exchanges merge" (0 ms), stage="Affinity recalculation (crd)" (1 ms), stage="Collect update counters and create affinity messages" (0 ms), stage="Assign partitions states" (0 ms), stage="Validate partitions states" (0 ms), stage="Apply update counters" (0 ms), stage="Full message preparing" (2 ms), stage="Full message sending" (0 ms), stage="Exchange done" (2 ms), stage="Total time" (80 ms), Discovery lag=10 ms, Latest started node id=10792948-15d6-4aab-9ceb-082ae5349001] [21:15:02] : [Step 4/5] [2021-11-19 21:15:02,159][INFO ][sys-#25405%grid-0%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], stage="Affinity initialization (node join) [grp=ignite-sys-cache, crd=true]" (1 ms) (parent=Affinity recalculation (crd)), stage="Affinity initialization (node join) [grp=encrypted, crd=true]" (0 ms) (parent=Affinity recalculation (crd))] [21:15:02] : [Step 4/5] [2021-11-19 21:15:02,156][INFO ][sys-#25695%grid-1%][GridDhtPartitionsExchangeFuture] Received full message, will finish exchange [node=002379ee-6a1a-434d-99e5-6da3bf448000, resVer=AffinityTopologyVersion [topVer=4, minorTopVer=0]] [21:15:02] : [Step 4/5] [2021-11-19 21:15:02,155][INFO ][exchange-worker-#25427%grid-0%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=4, minorTopVer=0], force=false, evt=NODE_JOINED, node=10792948-15d6-4aab-9ceb-082ae5349001] [21:15:02] : [Step 4/5] [2021-11-19 21:15:02,164][INFO ][sys-#25695%grid-1%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], err=null, rebalanced=false, wasRebalanced=false] [21:15:02] : [Step 4/5] [2021-11-19 21:15:02,165][INFO ][sys-#25695%grid-1%][GridCacheProcessor] Finish proxy initialization, cacheName=ignite-sys-cache, localNodeId=10792948-15d6-4aab-9ceb-082ae5349001 [21:15:02] : [Step 4/5] [2021-11-19 21:15:02,165][INFO ][sys-#25695%grid-1%][GridCacheProcessor] Finish proxy initialization, cacheName=encrypted, localNodeId=10792948-15d6-4aab-9ceb-082ae5349001 [21:15:02] : [Step 4/5] [2021-11-19 21:15:02,166][INFO ][exchange-worker-#25706%grid-1%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=4, minorTopVer=0], force=false, evt=NODE_JOINED, node=10792948-15d6-4aab-9ceb-082ae5349001] [21:15:02] : [Step 4/5] [2021-11-19 21:15:02,166][INFO ][sys-#25695%grid-1%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=10792948-15d6-4aab-9ceb-082ae5349001, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], evt=NODE_JOINED, evtNode=TcpDiscoveryNode [id=10792948-15d6-4aab-9ceb-082ae5349001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=4, intOrder=3, lastExchangeTime=1637345702111, loc=true, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=false, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0]] [21:15:02] : [Step 4/5] [2021-11-19 21:15:02,167][INFO ][sys-#25695%grid-1%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], stage="Waiting in exchange queue" (39 ms), stage="Exchange parameters initialization" (0 ms), stage="Components activation" (8 ms), stage="Determine exchange type" (5 ms), stage="Preloading notification" (0 ms), stage="Restore partition states" (0 ms), stage="After states restored callback" (2 ms), stage="WAL history reservation" (0 ms), stage="Waiting for Full message" (18 ms), stage="Affinity recalculation" (5 ms), stage="Full map updating" (1 ms), stage="Exchange done" (3 ms), stage="Total time" (81 ms)] [21:15:02] : [Step 4/5] [2021-11-19 21:15:02,168][INFO ][sys-#25695%grid-1%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], stage="Affinity fetch" (5 ms) (parent=Determine exchange type), stage="Restore partition states [grp=ignite-sys-cache]" (0 ms) (parent=Restore partition states), stage="Restore partition states [grp=encrypted]" (0 ms) (parent=Restore partition states), stage="Affinity initialization (local join) [grp=ignite-sys-cache]" (5 ms) (parent=Affinity recalculation), stage="Affinity initialization (local join) [grp=encrypted]" (5 ms) (parent=Affinity recalculation)] [21:15:02] : [Step 4/5] [2021-11-19 21:15:02,169][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] To start Console Management & Monitoring run ignitevisorcmd.{sh|bat} [21:15:02] : [Step 4/5] [2021-11-19 21:15:02,170][INFO ][exchange-worker-#25427%grid-0%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], crd=true, evt=DISCOVERY_CUSTOM_EVT, evtNode=002379ee-6a1a-434d-99e5-6da3bf448000, customEvt=CacheAffinityChangeMessage [id=fa33e593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], exchId=null, partsMsg=null, exchangeNeeded=true], allowMerge=false, exchangeFreeSwitch=false] [21:15:02] : [Step 4/5] [2021-11-19 21:15:02,170][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] [21:15:02] : [Step 4/5] [21:15:02] : [Step 4/5] >>> +-------------------------------------------+ [21:15:02] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:15:02] : [Step 4/5] >>> +-------------------------------------------+ [21:15:02] : [Step 4/5] >>> OS name: Linux 4.15.0-151-generic amd64 [21:15:02] : [Step 4/5] >>> CPU(s): 24 [21:15:02] : [Step 4/5] >>> Heap: 2.0GB [21:15:02] : [Step 4/5] >>> VM name: 16724@c4dfe9a430b2 [21:15:02] : [Step 4/5] >>> Ignite instance name: grid-1 [21:15:02] : [Step 4/5] >>> Local node [ID=10792948-15D6-4AAB-9CEB-082AE5349001, order=4, clientMode=false] [21:15:02] : [Step 4/5] >>> Local node addresses: [127.0.0.1] [21:15:02] : [Step 4/5] >>> Local ports: TCP:10801 TCP:47101 TCP:47501 [21:15:02] : [Step 4/5] [21:15:02] : [Step 4/5] [2021-11-19 21:15:02,171][INFO ][exchange-worker-#25427%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], waitTime=0ms, futInfo=NA, mode=DISTRIBUTED] [21:15:02] : [Step 4/5] [2021-11-19 21:15:02,172][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][GridDiscoveryManager] Topology snapshot [ver=4, locNode=10792948, servers=2, clients=0, state=ACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=002379ee-6a1a-434d-99e5-6da3bf448000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=10792948-15d6-4aab-9ceb-082ae5349001, consistentId=grid-1, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:15:02] : [Step 4/5] [2021-11-19 21:15:02,172][INFO ][exchange-worker-#25706%grid-1%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], crd=false, evt=DISCOVERY_CUSTOM_EVT, evtNode=002379ee-6a1a-434d-99e5-6da3bf448000, customEvt=CacheAffinityChangeMessage [id=fa33e593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], exchId=null, partsMsg=null, exchangeNeeded=true], allowMerge=false, exchangeFreeSwitch=false] [21:15:02] : [Step 4/5] [2021-11-19 21:15:02,173][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][GridDiscoveryManager] ^-- Baseline [id=0, size=2, online=2, offline=0] [21:15:02] : [Step 4/5] [2021-11-19 21:15:02,174][INFO ][exchange-worker-#25706%grid-1%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], waitTime=0ms, futInfo=NA, mode=DISTRIBUTED] [21:15:02] : [Step 4/5] [2021-11-19 21:15:02,174][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][G] Node started : [stage="Configure system pool" (0 ms),stage="Start managers" (239 ms),stage="Configure binary metadata" (2 ms),stage="Start processors" (32 ms),stage="Start 'StanByClusterTestProvider' plugin" (0 ms),stage="Start 'PageMemory tracker plugin' plugin" (0 ms),stage="Start 'TestDistibutedConfigurationPlugin' plugin" (0 ms),stage="Start 'NodeValidationPluginProvider' plugin" (0 ms),stage="Init metastore" (45 ms),stage="Init and start regions" (6 ms),stage="Restore binary memory" (30 ms),stage="Restore logical state" (30 ms),stage="Finish recovery" (1 ms),stage="Join topology" (58 ms),stage="Await transition" (6 ms),stage="Await exchange" (92 ms),stage="Total time" (541 ms)] [21:15:02] : [Step 4/5] [2021-11-19 21:15:02,176][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][root] Node started with the following configuration [id=10792948-15d6-4aab-9ceb-082ae5349001, marshaller=BinaryMarshaller [], discovery=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=5000, ackTimeout=5000, marsh=JdkMarshaller [clsFilter=org.apache.ignite.marshaller.MarshallerUtils$1@75162b87], reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], binaryCfg=null, lateAff=true] [21:15:02] : [Step 4/5] [2021-11-19 21:15:02,177][INFO ][exchange-worker-#25706%grid-1%][GridDhtPartitionsExchangeFuture] Finished waiting for partitions release latch: ClientLatch [coordinator=TcpDiscoveryNode [id=002379ee-6a1a-434d-99e5-6da3bf448000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345702056, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], ackSent=true, super=CompletableLatch [id=CompletableLatchUid [id=exchange, topVer=AffinityTopologyVersion [topVer=4, minorTopVer=1]]]] [21:15:02] : [Step 4/5] [2021-11-19 21:15:02,176][INFO ][reencrypt-#25723%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:15:02] : [Step 4/5] [2021-11-19 21:15:02,179][INFO ][exchange-worker-#25706%grid-1%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:15:02] : [Step 4/5] [2021-11-19 21:15:02,177][INFO ][exchange-worker-#25427%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partitions release latch: ServerLatch [permits=0, pendingAcks=HashSet [], super=CompletableLatch [id=CompletableLatchUid [id=exchange, topVer=AffinityTopologyVersion [topVer=4, minorTopVer=1]]]] [21:15:02] : [Step 4/5] [2021-11-19 21:15:02,180][INFO ][exchange-worker-#25427%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:15:02] : [Step 4/5] [2021-11-19 21:15:02,180][INFO ][exchange-worker-#25706%grid-1%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], crd=false] [21:15:02] : [Step 4/5] [2021-11-19 21:15:02,181][INFO ][exchange-worker-#25427%grid-0%][GridDhtPartitionsExchangeFuture] Coordinator received single message [ver=AffinityTopologyVersion [topVer=4, minorTopVer=1], node=10792948-15d6-4aab-9ceb-082ae5349001, allReceived=true] [21:15:02] : [Step 4/5] [2021-11-19 21:15:02,181][INFO ][exchange-worker-#25427%grid-0%][GridDhtPartitionsExchangeFuture] finishExchangeOnCoordinator [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=1]] [21:15:02] : [Step 4/5] [2021-11-19 21:15:02,183][INFO ][exchange-worker-#25427%grid-0%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], err=null, rebalanced=true, wasRebalanced=false] [21:15:02] : [Step 4/5] [2021-11-19 21:15:02,184][INFO ][sys-#25686%grid-1%][GridDhtPartitionsExchangeFuture] Received full message, will finish exchange [node=002379ee-6a1a-434d-99e5-6da3bf448000, resVer=AffinityTopologyVersion [topVer=4, minorTopVer=1]] [21:15:02] : [Step 4/5] [2021-11-19 21:15:02,185][INFO ][sys-#25686%grid-1%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], err=null, rebalanced=true, wasRebalanced=false] [21:15:02] : [Step 4/5] [2021-11-19 21:15:02,185][INFO ][sys-#25686%grid-1%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=10792948-15d6-4aab-9ceb-082ae5349001, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=002379ee-6a1a-434d-99e5-6da3bf448000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345702056, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=4, minorTopVer=1]] [21:15:02] : [Step 4/5] [2021-11-19 21:15:02,184][INFO ][exchange-worker-#25427%grid-0%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=002379ee-6a1a-434d-99e5-6da3bf448000, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=002379ee-6a1a-434d-99e5-6da3bf448000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345702181, loc=true, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=4, minorTopVer=1]] [21:15:02] : [Step 4/5] [2021-11-19 21:15:02,187][INFO ][sys-#25686%grid-1%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (1 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Wait partitions release latch [latch=exchange]" (4 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="After states restored callback" (0 ms), stage="WAL history reservation" (0 ms), stage="Waiting for Full message" (4 ms), stage="Affinity recalculation" (0 ms), stage="Full map updating" (0 ms), stage="Exchange done" (2 ms), stage="Total time" (11 ms)] [21:15:02] : [Step 4/5] [2021-11-19 21:15:02,185][INFO ][exchange-worker-#25706%grid-1%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=4, minorTopVer=1], force=false, evt=DISCOVERY_CUSTOM_EVT, node=002379ee-6a1a-434d-99e5-6da3bf448000] [21:15:02] : [Step 4/5] [2021-11-19 21:15:02,190][INFO ][sys-#25686%grid-1%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], stage="Affinity change by custom message [grp=ignite-sys-cache]" (0 ms) (parent=Determine exchange type)] [21:15:02] : [Step 4/5] [2021-11-19 21:15:02,188][INFO ][exchange-worker-#25427%grid-0%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (1 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (1 ms), stage="Wait partitions release latch [latch=exchange]" (7 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="After states restored callback" (0 ms), stage="WAL history reservation" (0 ms), stage="Waiting for all single messages" (0 ms), stage="Affinity recalculation (crd)" (0 ms), stage="Collect update counters and create affinity messages" (0 ms), stage="Validate partitions states" (0 ms), stage="Apply update counters" (0 ms), stage="Full message preparing" (0 ms), stage="Full message sending" (0 ms), stage="Exchange done" (4 ms), stage="Total time" (13 ms), Discovery lag=3 ms, Latest started node id=10792948-15d6-4aab-9ceb-082ae5349001] [21:15:02] : [Step 4/5] [2021-11-19 21:15:02,191][INFO ][exchange-worker-#25706%grid-1%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=2], crd=false, evt=DISCOVERY_CUSTOM_EVT, evtNode=10792948-15d6-4aab-9ceb-082ae5349001, customEvt=DynamicCacheChangeBatch [id=0c33e593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqs=ArrayList [DynamicCacheChangeRequest [cacheName=encrypted, hasCfg=false, nodeId=10792948-15d6-4aab-9ceb-082ae5349001, clientStartOnly=false, stop=false, destroy=false, disabledAfterStart=false]], exchangeActions=ExchangeActions [startCaches=null, stopCaches=null, startGrps=[], stopGrps=[], resetParts=[encrypted], stateChangeRequest=null], startCaches=false], allowMerge=false, exchangeFreeSwitch=false] [21:15:02] : [Step 4/5] [2021-11-19 21:15:02,193][INFO ][exchange-worker-#25427%grid-0%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], stage="Affinity change by custom message [grp=ignite-sys-cache]" (0 ms) (parent=Determine exchange type)] [21:15:02] : [Step 4/5] [2021-11-19 21:15:02,195][INFO ][exchange-worker-#25706%grid-1%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=2], waitTime=0ms, futInfo=NA, mode=DISTRIBUTED] [21:15:02] : [Step 4/5] [2021-11-19 21:15:02,195][INFO ][exchange-worker-#25427%grid-0%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], crd=true] [21:15:02] : [Step 4/5] [2021-11-19 21:15:02,196][INFO ][exchange-worker-#25427%grid-0%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=4, minorTopVer=1], force=false, evt=DISCOVERY_CUSTOM_EVT, node=002379ee-6a1a-434d-99e5-6da3bf448000] [21:15:02] : [Step 4/5] [2021-11-19 21:15:02,197][INFO ][exchange-worker-#25427%grid-0%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=2], crd=true, evt=DISCOVERY_CUSTOM_EVT, evtNode=10792948-15d6-4aab-9ceb-082ae5349001, customEvt=DynamicCacheChangeBatch [id=0c33e593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqs=ArrayList [DynamicCacheChangeRequest [cacheName=encrypted, hasCfg=false, nodeId=10792948-15d6-4aab-9ceb-082ae5349001, clientStartOnly=false, stop=false, destroy=false, disabledAfterStart=false]], exchangeActions=ExchangeActions [startCaches=null, stopCaches=null, startGrps=[], stopGrps=[], resetParts=[encrypted], stateChangeRequest=null], startCaches=false], allowMerge=false, exchangeFreeSwitch=false] [21:15:02] : [Step 4/5] [2021-11-19 21:15:02,198][INFO ][exchange-worker-#25427%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=2], waitTime=0ms, futInfo=NA, mode=DISTRIBUTED] [21:15:02] : [Step 4/5] [2021-11-19 21:15:02,199][INFO ][exchange-worker-#25427%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partitions release latch: ServerLatch [permits=0, pendingAcks=HashSet [], super=CompletableLatch [id=CompletableLatchUid [id=exchange, topVer=AffinityTopologyVersion [topVer=4, minorTopVer=2]]]] [21:15:02] : [Step 4/5] [2021-11-19 21:15:02,199][INFO ][exchange-worker-#25706%grid-1%][GridDhtPartitionsExchangeFuture] Finished waiting for partitions release latch: ClientLatch [coordinator=TcpDiscoveryNode [id=002379ee-6a1a-434d-99e5-6da3bf448000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345702056, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], ackSent=true, super=CompletableLatch [id=CompletableLatchUid [id=exchange, topVer=AffinityTopologyVersion [topVer=4, minorTopVer=2]]]] [21:15:02] : [Step 4/5] [2021-11-19 21:15:02,199][INFO ][exchange-worker-#25427%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=2], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:15:02] : [Step 4/5] [2021-11-19 21:15:02,200][INFO ][exchange-worker-#25706%grid-1%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=2], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:15:02] : [Step 4/5] [2021-11-19 21:15:02,201][INFO ][exchange-worker-#25427%grid-0%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=2], crd=true] [21:15:02] : [Step 4/5] [2021-11-19 21:15:02,202][INFO ][exchange-worker-#25706%grid-1%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=2], crd=false] [21:15:02] : [Step 4/5] [2021-11-19 21:15:02,202][INFO ][sys-#25413%grid-0%][GridDhtPartitionsExchangeFuture] Coordinator received single message [ver=AffinityTopologyVersion [topVer=4, minorTopVer=2], node=10792948-15d6-4aab-9ceb-082ae5349001, allReceived=true] [21:15:02] : [Step 4/5] [2021-11-19 21:15:02,203][INFO ][sys-#25413%grid-0%][GridDhtPartitionsExchangeFuture] finishExchangeOnCoordinator [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=2]] [21:15:02] : [Step 4/5] [2021-11-19 21:15:02,205][INFO ][sys-#25413%grid-0%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=4, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=2], err=null, rebalanced=true, wasRebalanced=true] [21:15:02] : [Step 4/5] [2021-11-19 21:15:02,206][INFO ][sys-#25413%grid-0%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=002379ee-6a1a-434d-99e5-6da3bf448000, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=2], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=10792948-15d6-4aab-9ceb-082ae5349001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=4, intOrder=3, lastExchangeTime=1637345702026, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=4, minorTopVer=2]] [21:15:02] : [Step 4/5] [2021-11-19 21:15:02,208][INFO ][sys-#25678%grid-1%][GridDhtPartitionsExchangeFuture] Received full message, will finish exchange [node=002379ee-6a1a-434d-99e5-6da3bf448000, resVer=AffinityTopologyVersion [topVer=4, minorTopVer=2]] [21:15:02] : [Step 4/5] [2021-11-19 21:15:02,206][INFO ][exchange-worker-#25427%grid-0%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=4, minorTopVer=2], force=false, evt=DISCOVERY_CUSTOM_EVT, node=10792948-15d6-4aab-9ceb-082ae5349001] [21:15:02] : [Step 4/5] [2021-11-19 21:15:02,210][INFO ][sys-#25678%grid-1%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=4, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=2], err=null, rebalanced=true, wasRebalanced=true] [21:15:02] : [Step 4/5] [2021-11-19 21:15:02,208][INFO ][sys-#25413%grid-0%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=4, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=2], stage="Waiting in exchange queue" (17 ms), stage="Exchange parameters initialization" (1 ms), stage="Update caches registry" (0 ms), stage="Start caches" (0 ms), stage="Affinity initialization on cache group start" (0 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Wait partitions release latch [latch=exchange]" (0 ms), stage="Wait partitions release [latch=exchange]" (1 ms), stage="After states restored callback" (0 ms), stage="WAL history reservation" (0 ms), stage="Waiting for all single messages" (2 ms), stage="Affinity recalculation (crd)" (0 ms), stage="Collect update counters and create affinity messages" (0 ms), stage="Assign partitions states" (0 ms), stage="Validate partitions states" (0 ms), stage="Ideal affinity diff calculation (enforced)" (0 ms), stage="Apply update counters" (0 ms), stage="Full message preparing" (0 ms), stage="Full message sending" (0 ms), stage="Exchange done" (2 ms), stage="Total time" (23 ms)] [21:15:02] : [Step 4/5] [2021-11-19 21:15:02,212][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][root] awaitPartitionMapExchange finished [21:15:02] : [Step 4/5] [2021-11-19 21:15:02,211][INFO ][db-checkpoint-thread-#25711%grid-1%][Checkpointer] Checkpoint finished [cpId=e7185d0c-36f2-48fd-ba50-848adb834c25, pages=72, markPos=WALPointer [idx=0, fileOff=318728, len=2064], walSegmentsCovered=[], markDuration=5ms, pagesWrite=8ms, fsync=61ms, total=76ms] [21:15:02] : [Step 4/5] [2021-11-19 21:15:02,211][INFO ][exchange-worker-#25706%grid-1%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=4, minorTopVer=2], force=false, evt=DISCOVERY_CUSTOM_EVT, node=10792948-15d6-4aab-9ceb-082ae5349001] [21:15:02] : [Step 4/5] [2021-11-19 21:15:02,211][INFO ][sys-#25678%grid-1%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=10792948-15d6-4aab-9ceb-082ae5349001, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=2], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=10792948-15d6-4aab-9ceb-082ae5349001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=4, intOrder=3, lastExchangeTime=1637345702181, loc=true, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=4, minorTopVer=2]] [21:15:02] : [Step 4/5] [2021-11-19 21:15:02,213][INFO ][sys-#25413%grid-0%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=4, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=2], stage="Affinity centralized initialization (crd) [grp=ignite-sys-cache, crd=true]" (0 ms) (parent=Determine exchange type), stage="Affinity centralized initialization (crd) [grp=encrypted, crd=true]" (0 ms) (parent=Determine exchange type), stage="Affinity recalculation (partitions availability) [grp=ignite-sys-cache]" (0 ms) (parent=Ideal affinity diff calculation (enforced)), stage="Affinity recalculation (partitions availability) [grp=encrypted]" (0 ms) (parent=Ideal affinity diff calculation (enforced))] [21:15:02] : [Step 4/5] [2021-11-19 21:15:02,216][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10792948-15d6-4aab-9ceb-082ae5349001, grp=1613773252] [21:15:02] : [Step 4/5] [2021-11-19 21:15:02,216][INFO ][sys-#25678%grid-1%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=4, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=2], stage="Waiting in exchange queue" (11 ms), stage="Exchange parameters initialization" (3 ms), stage="Update caches registry" (0 ms), stage="Start caches" (0 ms), stage="Affinity initialization on cache group start" (0 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Wait partitions release latch [latch=exchange]" (4 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="After states restored callback" (0 ms), stage="WAL history reservation" (0 ms), stage="Waiting for Full message" (6 ms), stage="Affinity recalculation" (0 ms), stage="Full map updating" (1 ms), stage="Exchange done" (5 ms), stage="Total time" (30 ms)] [21:15:02] : [Step 4/5] [2021-11-19 21:15:02,219][INFO ][sys-#25678%grid-1%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=4, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=2], stage="Affinity centralized initialization (crd) [grp=ignite-sys-cache, crd=false]" (0 ms) (parent=Determine exchange type), stage="Affinity centralized initialization (crd) [grp=encrypted, crd=false]" (0 ms) (parent=Determine exchange type), stage="Affinity applying from full message [grp=ignite-sys-cache]" (0 ms) (parent=Affinity recalculation), stage="Affinity applying from full message [grp=encrypted]" (0 ms) (parent=Affinity recalculation)] [21:15:02] : [Step 4/5] [2021-11-19 21:15:02,221][INFO ][db-checkpoint-thread-#25711%grid-1%][Checkpointer] Checkpoint started [checkpointId=193d94fe-3b5d-48ab-9086-55e21eff106a, startPtr=WALPointer [idx=0, fileOff=530201, len=2048], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=2ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=0ms, pages=50, reason='test'] [21:15:02] : [Step 4/5] [2021-11-19 21:15:02,233][INFO ][db-checkpoint-thread-#25711%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:15:02] : [Step 4/5] [2021-11-19 21:15:02,234][INFO ][db-checkpoint-thread-#25711%grid-1%][Checkpointer] Checkpoint finished [cpId=193d94fe-3b5d-48ab-9086-55e21eff106a, pages=50, markPos=WALPointer [idx=0, fileOff=530201, len=2048], walSegmentsCovered=[], markDuration=4ms, pagesWrite=2ms, fsync=10ms, total=16ms] [21:15:02] : [Step 4/5] [2021-11-19 21:15:02,235][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=002379ee-6a1a-434d-99e5-6da3bf448000, grp=1613773252] [21:15:02] : [Step 4/5] [2021-11-19 21:15:02,252][INFO ][disco-notifier-worker-#25422%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=2] [21:15:02] : [Step 4/5] [2021-11-19 21:15:02,253][INFO ][disco-notifier-worker-#25697%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=2] [21:15:02] : [Step 4/5] [2021-11-19 21:15:02,253][INFO ][reencrypt-#25582%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:15:02] : [Step 4/5] [2021-11-19 21:15:02,253][INFO ][reencrypt-#25723%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:15:02] : [Step 4/5] [2021-11-19 21:15:02,455][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10792948-15d6-4aab-9ceb-082ae5349001, grp=1613773252] [21:15:02] : [Step 4/5] [2021-11-19 21:15:02,657][INFO ][db-checkpoint-thread-#25711%grid-1%][Checkpointer] Checkpoint started [checkpointId=30498735-5cc0-49c9-8982-80111262e9ac, startPtr=WALPointer [idx=0, fileOff=807453, len=2048], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=1ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=73ms, writeCheckpointEntryDuration=127ms, splitAndSortCpPagesDuration=0ms, pages=66, reason='test'] [21:15:02] : [Step 4/5] [2021-11-19 21:15:02,678][INFO ][db-checkpoint-thread-#25711%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:15:02] : [Step 4/5] [2021-11-19 21:15:02,679][INFO ][db-checkpoint-thread-#25711%grid-1%][Checkpointer] Checkpoint finished [cpId=30498735-5cc0-49c9-8982-80111262e9ac, pages=66, markPos=WALPointer [idx=0, fileOff=807453, len=2048], walSegmentsCovered=[], markDuration=202ms, pagesWrite=3ms, fsync=18ms, total=223ms] [21:15:02] : [Step 4/5] [2021-11-19 21:15:02,680][INFO ][test-runner-#25310%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=002379ee-6a1a-434d-99e5-6da3bf448000, grp=1613773252] [21:15:02] : [Step 4/5] [2021-11-19 21:15:02,688][INFO ][db-checkpoint-thread-#25561%grid-0%][Checkpointer] Checkpoint started [checkpointId=fda4a1ba-1b04-4c81-8a84-74dd98c37741, startPtr=WALPointer [idx=0, fileOff=336511, len=2010], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=4ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=0ms, pages=43, reason='test'] [21:15:02] : [Step 4/5] [2021-11-19 21:15:02,706][INFO ][db-checkpoint-thread-#25561%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:15:02] : [Step 4/5] [2021-11-19 21:15:02,707][INFO ][db-checkpoint-thread-#25561%grid-0%][Checkpointer] Checkpoint finished [cpId=fda4a1ba-1b04-4c81-8a84-74dd98c37741, pages=43, markPos=WALPointer [idx=0, fileOff=336511, len=2010], walSegmentsCovered=[], markDuration=7ms, pagesWrite=2ms, fsync=16ms, total=25ms] [21:15:02] : [Step 4/5] [21:15:02] >>> Stopping test: CacheGroupKeyChangeTest#testNodeFailsBeforePerform in 8891 ms <<< [21:15:02] : [Step 4/5] [2021-11-19 21:15:02,708][INFO ][main][root] >>> Stopping test: CacheGroupKeyChangeTest#testNodeFailsBeforePerform in 8891 ms <<< [21:15:02] : [Step 4/5] [21:15:02] >>> Heap: 544 MB used / 1937 MB commited / 1937 MB max <<< [21:15:02] : [Step 4/5] [2021-11-19 21:15:02,708][INFO ][main][root] >>> Heap: 544 MB used / 1937 MB commited / 1937 MB max <<< [21:15:02] : [Step 4/5] [21:15:02] >>> Non-Heap: 171 MB used / 189 MB commited / 0 MB max <<< [21:15:02] : [Step 4/5] [2021-11-19 21:15:02,709][INFO ][main][root] >>> Non-Heap: 171 MB used / 189 MB commited / 0 MB max <<< [21:15:02] : [Step 4/5] [2021-11-19 21:15:02,709][INFO ][main][root] >>> Stopping grid [name=grid-1, id=10792948-15d6-4aab-9ceb-082ae5349001] [21:15:02] : [Step 4/5] [2021-11-19 21:15:02,717][INFO ][db-checkpoint-thread-#25711%grid-1%][Checkpointer] Skipping checkpoint (no pages were modified) [checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, reason='timeout'] [21:15:02] : [Step 4/5] [2021-11-19 21:15:02,723][INFO ][tcp-disco-sock-reader-[002379ee 127.0.0.1:60745]-#1350%grid-1%-#25702%grid-1%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:60745, rmtPort=60745, rmtNodeId=002379ee-6a1a-434d-99e5-6da3bf448000] [21:15:02] : [Step 4/5] [2021-11-19 21:15:02,724][INFO ][disco-event-worker-#25426%grid-0%][GridDiscoveryManager] Node left topology: TcpDiscoveryNode [id=10792948-15d6-4aab-9ceb-082ae5349001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=4, intOrder=3, lastExchangeTime=1637345702026, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false] [21:15:02] : [Step 4/5] [2021-11-19 21:15:02,729][INFO ][main][GridCacheProcessor] Stopped cache [cacheName=encrypted] [21:15:02] : [Step 4/5] [2021-11-19 21:15:02,729][INFO ][disco-event-worker-#25426%grid-0%][GridDiscoveryManager] Topology snapshot [ver=5, locNode=002379ee, servers=1, clients=0, state=ACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=002379ee-6a1a-434d-99e5-6da3bf448000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:15:02] : [Step 4/5] [2021-11-19 21:15:02,729][INFO ][main][GridCacheProcessor] Stopped cache [cacheName=ignite-sys-cache] [21:15:02] : [Step 4/5] [2021-11-19 21:15:02,730][INFO ][disco-event-worker-#25426%grid-0%][GridDiscoveryManager] ^-- Baseline [id=0, size=2, online=1, offline=1] [21:15:02] : [Step 4/5] [2021-11-19 21:15:02,733][INFO ][exchange-worker-#25427%grid-0%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], crd=true, evt=NODE_LEFT, evtNode=10792948-15d6-4aab-9ceb-082ae5349001, customEvt=null, allowMerge=false, exchangeFreeSwitch=true] [21:15:02] : [Step 4/5] [2021-11-19 21:15:02,734][INFO ][exchange-worker-#25427%grid-0%][GridAffinityAssignmentCache] Local node affinity assignment distribution is not ideal [cache=encrypted, expectedPrimary=8.00, actualPrimary=3, expectedBackups=0.00, actualBackups=0, warningThreshold=50.00%] [21:15:02] : [Step 4/5] [2021-11-19 21:15:02,735][INFO ][exchange-worker-#25427%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:15:02] : [Step 4/5] [2021-11-19 21:15:02,736][INFO ][exchange-worker-#25427%grid-0%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], err=null, rebalanced=true, wasRebalanced=true] [21:15:02]W: [org.apache.ignite:ignite-core] [2021-11-19 21:15:02,737][WARN ][sys-#25415%grid-0%][GridDhtPartitionTopologyImpl] Detected lost partitions [grp=encrypted, parts=[0, 2, 4, 6-7], topVer=AffinityTopologyVersion [topVer=5, minorTopVer=0]] [21:15:02] : [Step 4/5] [2021-11-19 21:15:02,737][INFO ][main][FilePageStoreManager] Cleanup cache stores [total=4, left=0, cleanFiles=false] [21:15:02] : [Step 4/5] [2021-11-19 21:15:02,738][INFO ][exchange-worker-#25427%grid-0%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=002379ee-6a1a-434d-99e5-6da3bf448000, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], evt=NODE_LEFT, evtNode=TcpDiscoveryNode [id=10792948-15d6-4aab-9ceb-082ae5349001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=4, intOrder=3, lastExchangeTime=1637345702026, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=5, minorTopVer=0]] [21:15:02] : [Step 4/5] [2021-11-19 21:15:02,739][INFO ][exchange-worker-#25427%grid-0%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (1 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="After states restored callback" (0 ms), stage="WAL history reservation" (0 ms), stage="Finalize update counters" (0 ms), stage="Detect lost partitions" (1 ms), stage="Exchange done" (1 ms), stage="Total time" (3 ms)] [21:15:02] : [Step 4/5] [2021-11-19 21:15:02,740][INFO ][exchange-worker-#25427%grid-0%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], stage="Affinity initialization (exchange-free switch on fully-rebalanced topology) [grp=ignite-sys-cache]" (0 ms) (parent=Determine exchange type), stage="Affinity initialization (exchange-free switch on fully-rebalanced topology) [grp=encrypted]" (0 ms) (parent=Determine exchange type)] [21:15:02] : [Step 4/5] [2021-11-19 21:15:02,741][INFO ][main][GridDeploymentLocalStore] Removed undeployed class: GridDeployment [ts=1637345702151, depMode=SHARED, clsLdr=IsolatedClassLoader{roleName='test'}, clsLdrId=da33e593d71-10792948-15d6-4aab-9ceb-082ae5349001, userVer=0, loc=true, sampleClsName=org.apache.ignite.internal.processors.cache.distributed.dht.preloader.GridDhtPartitionFullMap, pendingUndeploy=false, undeployed=true, usage=0] [21:15:02] : [Step 4/5] [2021-11-19 21:15:02,741][INFO ][exchange-worker-#25427%grid-0%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], crd=true] [21:15:02] : [Step 4/5] [2021-11-19 21:15:02,745][INFO ][exchange-worker-#25427%grid-0%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=5, minorTopVer=0], force=false, evt=NODE_LEFT, node=10792948-15d6-4aab-9ceb-082ae5349001] [21:15:02] : [Step 4/5] [2021-11-19 21:15:02,781][INFO ][main][IgniteKernal%grid-1] [21:15:02] : [Step 4/5] [21:15:02] : [Step 4/5] >>> +------------------------------------------------------+ [21:15:02] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV stopped OK [21:15:02] : [Step 4/5] >>> +------------------------------------------------------+ [21:15:02] : [Step 4/5] >>> Ignite instance name: grid-1 [21:15:02] : [Step 4/5] >>> Grid uptime: 00:00:00.618 [21:15:02] : [Step 4/5] [21:15:02] : [Step 4/5] [21:15:02] : [Step 4/5] [2021-11-19 21:15:02,781][INFO ][main][root] >>> Stopping grid [name=grid-0, id=002379ee-6a1a-434d-99e5-6da3bf448000] [21:15:02] : [Step 4/5] [2021-11-19 21:15:02,802][INFO ][tcp-disco-sock-reader-[10ab0e92 127.0.0.1:37725]-#1342%grid-0%-#25547%grid-0%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:37725, rmtPort=37725, rmtNodeId=10ab0e92-dbb6-4839-bb03-4b3ab0c64001] [21:15:02] : [Step 4/5] [2021-11-19 21:15:02,802][INFO ][tcp-disco-sock-reader-[10792948 127.0.0.1:59931]-#1351%grid-0%-#25703%grid-0%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:59931, rmtPort=59931, rmtNodeId=10792948-15d6-4aab-9ceb-082ae5349001] [21:15:02] : [Step 4/5] [2021-11-19 21:15:02,804][INFO ][main][GridCacheProcessor] Stopped cache [cacheName=ignite-sys-cache] [21:15:02] : [Step 4/5] [2021-11-19 21:15:02,805][INFO ][main][GridCacheProcessor] Stopped cache [cacheName=encrypted] [21:15:02] : [Step 4/5] [2021-11-19 21:15:02,811][INFO ][main][FilePageStoreManager] Cleanup cache stores [total=4, left=0, cleanFiles=false] [21:15:02] : [Step 4/5] [2021-11-19 21:15:02,815][INFO ][main][GridDeploymentLocalStore] Removed undeployed class: GridDeployment [ts=1637345695710, depMode=SHARED, clsLdr=IsolatedClassLoader{roleName='test'}, clsLdrId=f323e593d71-002379ee-6a1a-434d-99e5-6da3bf448000, userVer=0, loc=true, sampleClsName=org.apache.ignite.internal.processors.cache.distributed.dht.preloader.GridDhtPartitionMap, pendingUndeploy=false, undeployed=true, usage=0] [21:15:02] : [Step 4/5] [2021-11-19 21:15:02,837][INFO ][main][IgniteKernal%grid-0] [21:15:02] : [Step 4/5] [21:15:02] : [Step 4/5] >>> +------------------------------------------------------+ [21:15:02] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV stopped OK [21:15:02] : [Step 4/5] >>> +------------------------------------------------------+ [21:15:02] : [Step 4/5] >>> Ignite instance name: grid-0 [21:15:02] : [Step 4/5] >>> Grid uptime: 00:00:08.244 [21:15:02] : [Step 4/5] [21:15:02] : [Step 4/5] [21:15:02] : [Step 4/5] [21:15:02] >>> Starting test: CacheGroupKeyChangeTest#testNodeFailsBeforePrepare <<< [21:15:02] : [Step 4/5] [2021-11-19 21:15:02,854][INFO ][main][root] >>> Starting test: CacheGroupKeyChangeTest#testNodeFailsBeforePrepare <<< [21:15:02] : [Step 4/5] [21:15:02] >>> Heap: 547 MB used / 1937 MB commited / 1937 MB max <<< [21:15:02] : [Step 4/5] [2021-11-19 21:15:02,854][INFO ][main][root] >>> Heap: 547 MB used / 1937 MB commited / 1937 MB max <<< [21:15:02] : [Step 4/5] [21:15:02] >>> Non-Heap: 171 MB used / 189 MB commited / 0 MB max <<< [21:15:02] : [Step 4/5] [2021-11-19 21:15:02,855][INFO ][main][root] >>> Non-Heap: 171 MB used / 189 MB commited / 0 MB max <<< [21:15:02]W: [org.apache.ignite:ignite-core] [2021-11-19 21:15:02,864][WARN ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][G] Ignite work directory is not provided, automatically resolved to: /opt/buildagent/work/7bc1c54bc719b67c/work [21:15:02] : [Step 4/5] [2021-11-19 21:15:02,866][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] [21:15:02] : [Step 4/5] [21:15:02] : [Step 4/5] >>> __________ ________________ [21:15:02] : [Step 4/5] >>> / _/ ___/ |/ / _/_ __/ __/ [21:15:02] : [Step 4/5] >>> _/ // (7 7 // / / / / _/ [21:15:02] : [Step 4/5] >>> /___/\___/_/|_/___/ /_/ /___/ [21:15:02] : [Step 4/5] >>> [21:15:02] : [Step 4/5] >>> ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:15:02] : [Step 4/5] >>> 2021 Copyright(C) Apache Software Foundation [21:15:02] : [Step 4/5] >>> [21:15:02] : [Step 4/5] >>> Ignite documentation: http://ignite.apache.org [21:15:02] : [Step 4/5] [21:15:02] : [Step 4/5] [2021-11-19 21:15:02,868][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] Config URL: n/a [21:15:02] : [Step 4/5] [2021-11-19 21:15:02,868][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] IgniteConfiguration [igniteInstanceName=grid-0, pubPoolSize=24, svcPoolSize=24, callbackPoolSize=24, stripedPoolSize=24, sysPoolSize=24, mgmtPoolSize=4, dataStreamerPoolSize=24, utilityCachePoolSize=24, utilityCacheKeepAliveTime=60000, p2pPoolSize=2, qryPoolSize=24, buildIdxPoolSize=4, igniteHome=/opt/buildagent/work/7bc1c54bc719b67c, igniteWorkDir=/opt/buildagent/work/7bc1c54bc719b67c/work, mbeanSrv=com.sun.jmx.mbeanserver.JmxMBeanServer@6fe85038, nodeId=0061f6c1-e5b0-456b-b001-a59f68b46000, marsh=BinaryMarshaller [], marshLocJobs=false, daemon=false, p2pEnabled=true, netTimeout=10000, netCompressionLevel=1, sndRetryDelay=1000, sndRetryCnt=3, metricsHistSize=10000, metricsUpdateFreq=1000, metricsExpTime=9223372036854775807, discoSpi=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=0, ackTimeout=0, marsh=null, reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], segPlc=STOP, segResolveAttempts=2, waitForSegOnStart=true, allResolversPassReq=true, segChkFreq=10000, commSpi=TcpCommunicationSpi [connectGate=org.apache.ignite.spi.communication.tcp.internal.ConnectGateway@62fe193, ctxInitLatch=java.util.concurrent.CountDownLatch@640097c5[Count = 1], stopping=false, clientPool=null, nioSrvWrapper=null, stateProvider=null], evtSpi=MemoryEventStorageSpi [expireAgeMs=9223372036854775807, expireCnt=10000, filter=null], colSpi=NoopCollisionSpi [], deploySpi=LocalDeploymentSpi [], indexingSpi=org.apache.ignite.spi.indexing.noop.NoopIndexingSpi@9cf199f, addrRslvr=null, encryptionSpi=org.apache.ignite.spi.encryption.keystore.KeystoreEncryptionSpi@7a66d28c, tracingSpi=org.apache.ignite.spi.tracing.NoopTracingSpi@300e1289, clientMode=false, rebalanceThreadPoolSize=4, rebalanceTimeout=10000, rebalanceBatchesPrefetchCnt=3, rebalanceThrottle=0, rebalanceBatchSize=524288, txCfg=TransactionConfiguration [txSerEnabled=false, dfltIsolation=REPEATABLE_READ, dfltConcurrency=PESSIMISTIC, dfltTxTimeout=0, txTimeoutOnPartitionMapExchange=0, deadlockTimeout=10000, pessimisticTxLogSize=0, pessimisticTxLogLinger=10000, tmLookupClsName=null, txManagerFactory=null, useJtaSync=false], cacheSanityCheckEnabled=true, discoStartupDelay=60000, deployMode=SHARED, p2pMissedCacheSize=100, locHost=127.0.0.1, timeSrvPortBase=31100, timeSrvPortRange=100, failureDetectionTimeout=10000, sysWorkerBlockedTimeout=null, clientFailureDetectionTimeout=10000, metricsLogFreq=0, connectorCfg=null, odbcCfg=null, warmupClos=null, atomicCfg=AtomicConfiguration [seqReserveSize=1000, cacheMode=PARTITIONED, backups=1, aff=null, grpName=null], classLdr=null, sslCtxFactory=null, platformCfg=null, binaryCfg=null, memCfg=null, pstCfg=null, dsCfg=DataStorageConfiguration [sysRegionInitSize=41943040, sysRegionMaxSize=104857600, pageSize=4096, concLvl=0, dfltDataRegConf=DataRegionConfiguration [name=default, maxSize=104857600, initSize=268435456, swapPath=null, pageEvictionMode=DISABLED, pageReplacementMode=CLOCK, evictionThreshold=0.9, emptyPagesPoolSize=100, metricsEnabled=false, metricsSubIntervalCount=5, metricsRateTimeInterval=60000, persistenceEnabled=true, checkpointPageBufSize=0, lazyMemoryAllocation=true, warmUpCfg=null], dataRegions=null, storagePath=null, checkpointFreq=30000, lockWaitTime=10000, checkpointThreads=4, checkpointWriteOrder=SEQUENTIAL, walHistSize=20, maxWalArchiveSize=20971520, walSegments=10, walSegmentSize=1048576, walPath=db/wal, walArchivePath=db/wal/archive, cdcWalPath=db/wal/cdc, cdcEnabled=false, metricsEnabled=false, walMode=LOG_ONLY, walTlbSize=131072, walBuffSize=0, walFlushFreq=2000, walFsyncDelay=1000, walRecordIterBuffSize=67108864, alwaysWriteFullPages=false, fileIOFactory=org.apache.ignite.internal.processors.cache.persistence.file.AsyncFileIOFactory@43518e72, metricsSubIntervalCnt=5, metricsRateTimeInterval=60000, walAutoArchiveAfterInactivity=-1, walForceArchiveTimeout=-1, writeThrottlingEnabled=false, walCompactionEnabled=false, walCompactionLevel=1, checkpointReadLockTimeout=null, walPageCompression=DISABLED, walPageCompressionLevel=null, dfltWarmUpCfg=null, encCfg=org.apache.ignite.configuration.EncryptionConfiguration@5cb6f953, defragmentationThreadPoolSize=4, minWalArchiveSize=-1], snapshotPath=snapshots, activeOnStart=true, activeOnStartPropSetFlag=false, autoActivation=true, autoActivationPropSetFlag=false, clusterStateOnStart=null, sqlConnCfg=null, cliConnCfg=ClientConnectorConfiguration [host=null, port=10800, portRange=100, sockSndBufSize=0, sockRcvBufSize=0, tcpNoDelay=true, maxOpenCursorsPerConn=128, threadPoolSize=24, selectorCnt=12, idleTimeout=0, handshakeTimeout=10000, jdbcEnabled=true, odbcEnabled=true, thinCliEnabled=true, sslEnabled=false, useIgniteSslCtxFactory=true, sslClientAuth=false, sslCtxFactory=null, thinCliCfg=ThinClientConfiguration [maxActiveTxPerConn=100, maxActiveComputeTasksPerConn=0]], mvccVacuumThreadCnt=2, mvccVacuumFreq=5000, authEnabled=false, failureHnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]], commFailureRslvr=null, sqlCfg=SqlConfiguration [longQryWarnTimeout=3000, dfltQryTimeout=0, sqlQryHistSize=1000, validationEnabled=false], asyncContinuationExecutor=null] [21:15:02] : [Step 4/5] [2021-11-19 21:15:02,879][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] Daemon mode: off [21:15:02] : [Step 4/5] [2021-11-19 21:15:02,879][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] OS: Linux 4.15.0-151-generic amd64 [21:15:02] : [Step 4/5] [2021-11-19 21:15:02,879][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] OS user: teamcity [21:15:02] : [Step 4/5] [2021-11-19 21:15:02,880][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] PID: 16724 [21:15:02] : [Step 4/5] [2021-11-19 21:15:02,881][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] Language runtime: Java Platform API Specification ver. 1.8 [21:15:02] : [Step 4/5] [2021-11-19 21:15:02,881][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] VM information: Java(TM) SE Runtime Environment 1.8.0_261-b12 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 25.261-b12 [21:15:02] : [Step 4/5] [2021-11-19 21:15:02,881][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] VM total memory: 1.9GB [21:15:02] : [Step 4/5] [2021-11-19 21:15:02,882][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] Remote Management [restart: off, REST: off, JMX (remote: off)] [21:15:02] : [Step 4/5] [2021-11-19 21:15:02,882][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] Logger: GridTestLog4jLogger [quiet=false, config=null] [21:15:02] : [Step 4/5] [2021-11-19 21:15:02,883][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] IGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c [21:15:02] : [Step 4/5] [2021-11-19 21:15:02,883][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] VM arguments: [-DIGNITE_DUMP_THREADS_ON_FAILURE=false, -DMono=/usr/bin/mono-sgen, -DMono4.0_x64=/usr/lib/mono/4.0, -DMono4.5_x64=/usr/lib/mono/4.5, -DMonoVersion=6.12.0.90, -DSKIP_BUILD=false, -Dagent.home.dir=/opt/buildagent, -Dagent.name=aitc-lin02_03, -Dagent.ownPort=9090, -Dagent.work.dir=/opt/buildagent/work, -Dbuild.number=95, -Dbuild.vcs.number=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.1=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.GitHubApacheIgnite=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dclassworlds.conf=/opt/buildagent/temp/buildTmp/teamcity.m2.conf, -Dcom.jetbrains.maven.watcher.report.file=/opt/buildagent/temp/buildTmp/maven-build-info.xml, -Djava.io.tmpdir=/opt/buildagent/temp/buildTmp, -Dmaven.home=/opt/buildagent/tools/maven3_6, -Dmaven.multiModuleProjectDirectory=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.agent.cpuBenchmark=457, -Dteamcity.agent.dotnet.agent_url=http://localhost:9090/RPC2, -Dteamcity.agent.dotnet.build_id=6278078, -Dteamcity.auth.password=*******, -Dteamcity.auth.userId=TeamCityBuildId=6278078, -Dteamcity.build.changedFiles.file=/opt/buildagent/temp/buildTmp/changedFiles6342607772318147725.txt, -Dteamcity.build.checkoutDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.build.id=6278078, -Dteamcity.build.properties.file=/opt/buildagent/temp/buildTmp/teamcity.build5164517880467851002.properties, -Dteamcity.build.tempDir=/opt/buildagent/temp/buildTmp, -Dteamcity.build.workingDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.buildConfName=Basic 3, -Dteamcity.buildType.id=IgniteTests24Java8_Basic3, -Dteamcity.configuration.properties.file=/opt/buildagent/temp/buildTmp/teamcity.config5591980786735343870.properties, -Dteamcity.maven.userSettings.path=/opt/buildagent/temp/buildTmp/maven_settings_585072866407032347.xml, -Dteamcity.maven.watcher.home=/opt/buildagent/plugins/mavenPlugin/maven-watcher-jdk16, -Dteamcity.projectName=Ignite Tests 2.x (JDK 8/11), -Dteamcity.runner.properties.file=/opt/buildagent/temp/buildTmp/teamcity.runner9098465561618137420.properties, -Dteamcity.tests.recentlyFailedTests.file=/opt/buildagent/temp/buildTmp/testsToRunFirst3891775683130404069.txt, -Dteamcity.version=2021.2 (build 99542), -ea, -Xms2g, -Xmx2g, -XX:+HeapDumpOnOutOfMemoryError, -DIGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_TEST_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_UPDATE_NOTIFIER=false, -DIGNITE_NO_DISCO_ORDER=true, -DIGNITE_PERFORMANCE_SUGGESTIONS_DISABLED=true, -Djava.net.preferIPv4Stack=true, -DTEST_SCALE_FACTOR=1.0, -DIGNITE_TEST_PROP_LOG4J_FILE=log4j-tc-test.xml, -DIGNITE_QUIET=false, -DIGNITE_MARSHAL_BUFFERS_RECHECK=1000, -Dmaven.repo.local=/opt/buildagent/.m2/repository] [21:15:02] : [Step 4/5] [2021-11-19 21:15:02,889][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] System cache's DataRegion size is configured to 40 MB. Use DataStorageConfiguration.systemRegionInitialSize property to change the setting. [21:15:02] : [Step 4/5] [2021-11-19 21:15:02,889][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] Configured caches [in 'sysMemPlc' dataRegion: ['ignite-sys-cache']] [21:15:02]W: [org.apache.ignite:ignite-core] [2021-11-19 21:15:02,890][WARN ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] Peer class loading is enabled (disable it in production for performance and deployment consistency reasons) [21:15:02] : [Step 4/5] [2021-11-19 21:15:02,890][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] 3-rd party licenses can be found at: /opt/buildagent/work/7bc1c54bc719b67c/libs/licenses [21:15:02] : [Step 4/5] [2021-11-19 21:15:02,896][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] Configured plugins: [21:15:02] : [Step 4/5] [2021-11-19 21:15:02,897][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- StanByClusterTestProvider 1.0 [21:15:02] : [Step 4/5] [2021-11-19 21:15:02,897][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:15:02] : [Step 4/5] [2021-11-19 21:15:02,897][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] [21:15:02] : [Step 4/5] [2021-11-19 21:15:02,897][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- PageMemory tracker plugin 1.0 [21:15:02] : [Step 4/5] [2021-11-19 21:15:02,897][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:15:02] : [Step 4/5] [2021-11-19 21:15:02,898][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] [21:15:02] : [Step 4/5] [2021-11-19 21:15:02,898][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- TestDistibutedConfigurationPlugin 1.0 [21:15:02] : [Step 4/5] [2021-11-19 21:15:02,898][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:15:02] : [Step 4/5] [2021-11-19 21:15:02,898][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] [21:15:02] : [Step 4/5] [2021-11-19 21:15:02,898][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- NodeValidationPluginProvider 1.0 [21:15:02] : [Step 4/5] [2021-11-19 21:15:02,899][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:15:02] : [Step 4/5] [2021-11-19 21:15:02,899][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] [21:15:02] : [Step 4/5] [2021-11-19 21:15:02,899][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][FailureProcessor] Configured failure handler: [hnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]]] [21:15:02] : [Step 4/5] [2021-11-19 21:15:02,920][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][TestRecordingCommunicationSpi] Successfully bound communication NIO server to TCP port [port=47100, locHost=/127.0.0.1, selectorsCnt=12, selectorSpins=0, pairedConn=false] [21:15:02]W: [org.apache.ignite:ignite-core] [2021-11-19 21:15:02,921][WARN ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][TestRecordingCommunicationSpi] Message queue limit is set to 0 which may lead to potential OOMEs when running cache operations in FULL_ASYNC or PRIMARY_SYNC modes due to message queues growth on sender and receiver sides. [21:15:02] : [Step 4/5] [2021-11-19 21:15:02,928][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][GridCollisionManager] Collision resolution is disabled (all jobs will be activated upon arrival). [21:15:02] : [Step 4/5] [2021-11-19 21:15:02,928][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] Security status [authentication=off, sandbox=off, tls/ssl=off] [21:15:02] : [Step 4/5] [2021-11-19 21:15:02,989][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:15:03] : [Step 4/5] [2021-11-19 21:15:03,085][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][MaintenanceProcessor] Resolved store directory for node persistent data: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0 [21:15:03] : [Step 4/5] [2021-11-19 21:15:03,086][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][CacheObjectBinaryProcessorImpl] Resolved directory for serialized binary metadata: /opt/buildagent/work/7bc1c54bc719b67c/work/db/binary_meta/grid_0 [21:15:03] : [Step 4/5] [2021-11-19 21:15:03,092][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0 [21:15:03] : [Step 4/5] [2021-11-19 21:15:03,093][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][FileWriteAheadLogManager] Resolved write ahead log work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0 [21:15:03] : [Step 4/5] [2021-11-19 21:15:03,094][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][FileWriteAheadLogManager] Resolved write ahead log archive directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0 [21:15:03] : [Step 4/5] [2021-11-19 21:15:03,192][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000000.wal [21:15:03] : [Step 4/5] [2021-11-19 21:15:03,192][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][FileHandleManagerImpl] Initialized write-ahead log manager [mode=LOG_ONLY] [21:15:03]W: [org.apache.ignite:ignite-core] [2021-11-19 21:15:03,193][WARN ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] DataRegion maxSize=104.9 MB is smaller than defaultInitialSize=268.4 MB, setting initialSize to 104.9 MB [21:15:03] : [Step 4/5] [2021-11-19 21:15:03,200][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Configured data regions initialized successfully [total=5] [21:15:03] : [Step 4/5] [2021-11-19 21:15:03,204][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][IgniteSnapshotManager] Resolved snapshot work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/snapshots [21:15:03] : [Step 4/5] [2021-11-19 21:15:03,204][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][IgniteSnapshotManager] Resolved temp directory for snapshot creation: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0/snp [21:15:03] : [Step 4/5] [2021-11-19 21:15:03,207][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][ClientListenerProcessor] Client connector processor has started on TCP port 10800 [21:15:03] : [Step 4/5] [2021-11-19 21:15:03,216][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] Non-loopback local IPs: 172.17.0.4 [21:15:03] : [Step 4/5] [2021-11-19 21:15:03,216][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] Enabled local MACs: 0242AC110004 [21:15:03] : [Step 4/5] [2021-11-19 21:15:03,219][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:15:03] : [Step 4/5] [2021-11-19 21:15:03,220][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:15:03] : [Step 4/5] [2021-11-19 21:15:03,221][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:15:03] : [Step 4/5] [2021-11-19 21:15:03,224][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Applying lost metastore updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:15:03] : [Step 4/5] [2021-11-19 21:15:03,225][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=0 ms] [21:15:03] : [Step 4/5] [2021-11-19 21:15:03,225][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Restoring partition state for local groups. [21:15:03] : [Step 4/5] [2021-11-19 21:15:03,226][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=0, partitionsProcessed=0, time=0ms] [21:15:03] : [Step 4/5] [2021-11-19 21:15:03,226][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][GridEncryptionManager] Encryption keys loaded from metastore. [grps=, masterKeyName=ignite.master.key] [21:15:03] : [Step 4/5] [2021-11-19 21:15:03,232][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][ClusterProcessor] Cluster ID and tag has been read from metastorage: null [21:15:03] : [Step 4/5] [2021-11-19 21:15:03,232][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][IgniteClusterImpl] Shutdown policy was updated [oldVal=null, newVal=null] [21:15:03] : [Step 4/5] [2021-11-19 21:15:03,233][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Checkpoint frequency deviation changed [oldVal=null, newVal=null] [21:15:03] : [Step 4/5] [2021-11-19 21:15:03,243][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][FilePageStoreManager] Cleanup cache stores [total=1, left=0, cleanFiles=false] [21:15:03] : [Step 4/5] [2021-11-19 21:15:03,246][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:15:03] : [Step 4/5] [2021-11-19 21:15:03,247][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:15:03] : [Step 4/5] [2021-11-19 21:15:03,249][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:15:03] : [Step 4/5] [2021-11-19 21:15:03,250][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Data Regions Started: 5 [21:15:03] : [Step 4/5] [2021-11-19 21:15:03,250][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] ^-- sysMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:15:03] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:15:03] : [Step 4/5] ^-- default region [type=default, persistence=true, lazyAlloc=true, [21:15:03] : [Step 4/5] ... initCfg=100MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB, allocTotal=0MB] [21:15:03] : [Step 4/5] ^-- metastoreMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:15:03] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:15:03] : [Step 4/5] ^-- TxLog region [type=internal, persistence=true, lazyAlloc=false, [21:15:03] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:15:03] : [Step 4/5] ^-- volatileDsMemPlc region [type=user, persistence=false, lazyAlloc=true, [21:15:03] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB] [21:15:03] : [Step 4/5] ^-- Ignite persistence [used=0MB] [21:15:03] : [Step 4/5] [21:15:03] : [Step 4/5] [2021-11-19 21:15:03,253][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Starting binary memory restore for: [-2100569601] [21:15:03] : [Step 4/5] [2021-11-19 21:15:03,263][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:15:03] : [Step 4/5] [2021-11-19 21:15:03,263][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:15:03] : [Step 4/5] [2021-11-19 21:15:03,268][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000000.wal, offset=0, ver=2] [21:15:03] : [Step 4/5] [2021-11-19 21:15:03,272][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Started cache in recovery mode [name=ignite-sys-cache, id=-2100569601, dataRegionName=sysMemPlc, mode=REPLICATED, atomicity=TRANSACTIONAL, backups=2147483647, mvcc=false] [21:15:03] : [Step 4/5] [2021-11-19 21:15:03,275][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Binary recovery performed in 22 ms. [21:15:03] : [Step 4/5] [2021-11-19 21:15:03,275][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:15:03] : [Step 4/5] [2021-11-19 21:15:03,276][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Applying lost cache updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:15:03] : [Step 4/5] [2021-11-19 21:15:03,288][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=10 ms] [21:15:03] : [Step 4/5] [2021-11-19 21:15:03,288][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Restoring partition state for local groups. [21:15:03] : [Step 4/5] [2021-11-19 21:15:03,317][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=1, partitionsProcessed=100, time=30ms] [21:15:03] : [Step 4/5] [2021-11-19 21:15:03,334][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][TestTcpDiscoverySpi] Successfully bound to TCP port [port=47500, localHost=localhost/127.0.0.1, locNodeId=0061f6c1-e5b0-456b-b001-a59f68b46000] [21:15:03] : [Step 4/5] [2021-11-19 21:15:03,345][INFO ][disco-notifier-worker-#25838%grid-0%][MvccProcessorImpl] Assigned mvcc coordinator [crd=MvccCoordinator [topVer=AffinityTopologyVersion [topVer=1, minorTopVer=0], nodeId=0061f6c1-e5b0-456b-b001-a59f68b46000, ver=1637345703338, local=true, initialized=false]] [21:15:03] : [Step 4/5] [2021-11-19 21:15:03,347][INFO ][sys-#25837%grid-0%][ClusterProcessor] Writing cluster ID and tag to metastorage on ready for write ClusterIdAndTag [id=75323fd9-934f-4dbd-a543-7321879bb66e, tag=friendly_mirzakhani] [21:15:03] : [Step 4/5] [2021-11-19 21:15:03,350][INFO ][disco-notifier-worker-#25838%grid-0%][ClusterProcessor] friendly_mirzakhani [21:15:03] : [Step 4/5] [2021-11-19 21:15:03,351][INFO ][disco-notifier-worker-#25838%grid-0%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustEnabled' was changed from 'null' to 'false' [21:15:03] : [Step 4/5] [2021-11-19 21:15:03,352][INFO ][disco-notifier-worker-#25838%grid-0%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustTimeout' was changed from 'null' to '300000' [21:15:03] : [Step 4/5] [2021-11-19 21:15:03,353][INFO ][disco-notifier-worker-#25838%grid-0%][IgniteTxManager] Transactions parameter 'longOperationsDumpTimeout' was changed from 'null' to '60000' [21:15:03] : [Step 4/5] [2021-11-19 21:15:03,354][INFO ][disco-notifier-worker-#25838%grid-0%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpThreshold' was changed from 'null' to '0' [21:15:03] : [Step 4/5] [2021-11-19 21:15:03,354][INFO ][disco-notifier-worker-#25838%grid-0%][IgniteTxManager] Transactions parameter 'transactionTimeDumpSamplesCoefficient' was changed from 'null' to '0.0' [21:15:03] : [Step 4/5] [2021-11-19 21:15:03,355][INFO ][disco-notifier-worker-#25838%grid-0%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpSamplesPerSecondLimit' was changed from 'null' to '5' [21:15:03] : [Step 4/5] [2021-11-19 21:15:03,355][INFO ][disco-notifier-worker-#25838%grid-0%][IgniteTxManager] Transactions parameter 'collisionsDumpInterval' was changed from 'null' to '1000' [21:15:03] : [Step 4/5] [2021-11-19 21:15:03,356][INFO ][disco-notifier-worker-#25838%grid-0%][IgniteTxManager] Transactions parameter 'txOwnerDumpRequestsAllowed' was changed from 'null' to 'true' [21:15:03] : [Step 4/5] [2021-11-19 21:15:03,363][INFO ][disco-notifier-worker-#25838%grid-0%][GridCacheDatabaseSharedManager] Historical rebalance WAL threshold changed [property=historical.rebalance.threshold, oldVal=null, newVal=500] [21:15:03] : [Step 4/5] [2021-11-19 21:15:03,380][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] To start Console Management & Monitoring run ignitevisorcmd.{sh|bat} [21:15:03] : [Step 4/5] [2021-11-19 21:15:03,381][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] [21:15:03] : [Step 4/5] [21:15:03] : [Step 4/5] >>> +-------------------------------------------+ [21:15:03] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:15:03] : [Step 4/5] >>> +-------------------------------------------+ [21:15:03] : [Step 4/5] >>> OS name: Linux 4.15.0-151-generic amd64 [21:15:03] : [Step 4/5] >>> CPU(s): 24 [21:15:03] : [Step 4/5] >>> Heap: 2.0GB [21:15:03] : [Step 4/5] >>> VM name: 16724@c4dfe9a430b2 [21:15:03] : [Step 4/5] >>> Ignite instance name: grid-0 [21:15:03] : [Step 4/5] >>> Local node [ID=0061F6C1-E5B0-456B-B001-A59F68B46000, order=1, clientMode=false] [21:15:03] : [Step 4/5] >>> Local node addresses: [127.0.0.1] [21:15:03] : [Step 4/5] >>> Local ports: TCP:10800 TCP:47100 TCP:47500 [21:15:03] : [Step 4/5] [21:15:03] : [Step 4/5] [2021-11-19 21:15:03,382][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] >>> Ignite cluster is in INACTIVE state (limited functionality available). Use control.(sh|bat) script or IgniteCluster.state(ClusterState.ACTIVE) to change the state. [21:15:03] : [Step 4/5] [2021-11-19 21:15:03,383][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][GridDiscoveryManager] Topology snapshot [ver=1, locNode=0061f6c1, servers=1, clients=0, state=INACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=0061f6c1-e5b0-456b-b001-a59f68b46000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:15:03] : [Step 4/5] [2021-11-19 21:15:03,383][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][G] Node started : [stage="Configure system pool" (0 ms),stage="Start managers" (220 ms),stage="Configure binary metadata" (3 ms),stage="Start processors" (125 ms),stage="Start 'StanByClusterTestProvider' plugin" (0 ms),stage="Start 'PageMemory tracker plugin' plugin" (0 ms),stage="Start 'TestDistibutedConfigurationPlugin' plugin" (0 ms),stage="Start 'NodeValidationPluginProvider' plugin" (0 ms),stage="Init metastore" (27 ms),stage="Init and start regions" (9 ms),stage="Restore binary memory" (22 ms),stage="Restore logical state" (42 ms),stage="Finish recovery" (14 ms),stage="Join topology" (13 ms),stage="Await transition" (1 ms),stage="Await exchange" (35 ms),stage="Total time" (511 ms)] [21:15:03] : [Step 4/5] [2021-11-19 21:15:03,384][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][root] Node started with the following configuration [id=0061f6c1-e5b0-456b-b001-a59f68b46000, marshaller=BinaryMarshaller [], discovery=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=5000, ackTimeout=5000, marsh=JdkMarshaller [clsFilter=org.apache.ignite.marshaller.MarshallerUtils$1@2596df6c], reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], binaryCfg=null, lateAff=true] [21:15:03]W: [org.apache.ignite:ignite-core] [2021-11-19 21:15:03,389][WARN ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][G] Ignite work directory is not provided, automatically resolved to: /opt/buildagent/work/7bc1c54bc719b67c/work [21:15:03] : [Step 4/5] [2021-11-19 21:15:03,392][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] [21:15:03] : [Step 4/5] [21:15:03] : [Step 4/5] >>> __________ ________________ [21:15:03] : [Step 4/5] >>> / _/ ___/ |/ / _/_ __/ __/ [21:15:03] : [Step 4/5] >>> _/ // (7 7 // / / / / _/ [21:15:03] : [Step 4/5] >>> /___/\___/_/|_/___/ /_/ /___/ [21:15:03] : [Step 4/5] >>> [21:15:03] : [Step 4/5] >>> ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:15:03] : [Step 4/5] >>> 2021 Copyright(C) Apache Software Foundation [21:15:03] : [Step 4/5] >>> [21:15:03] : [Step 4/5] >>> Ignite documentation: http://ignite.apache.org [21:15:03] : [Step 4/5] [21:15:03] : [Step 4/5] [2021-11-19 21:15:03,392][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] Config URL: n/a [21:15:03] : [Step 4/5] [2021-11-19 21:15:03,393][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] IgniteConfiguration [igniteInstanceName=grid-1, pubPoolSize=24, svcPoolSize=24, callbackPoolSize=24, stripedPoolSize=24, sysPoolSize=24, mgmtPoolSize=4, dataStreamerPoolSize=24, utilityCachePoolSize=24, utilityCacheKeepAliveTime=60000, p2pPoolSize=2, qryPoolSize=24, buildIdxPoolSize=4, igniteHome=/opt/buildagent/work/7bc1c54bc719b67c, igniteWorkDir=/opt/buildagent/work/7bc1c54bc719b67c/work, mbeanSrv=com.sun.jmx.mbeanserver.JmxMBeanServer@6fe85038, nodeId=10170880-e32c-4da6-9d06-465492fc0001, marsh=BinaryMarshaller [], marshLocJobs=false, daemon=false, p2pEnabled=true, netTimeout=10000, netCompressionLevel=1, sndRetryDelay=1000, sndRetryCnt=3, metricsHistSize=10000, metricsUpdateFreq=1000, metricsExpTime=9223372036854775807, discoSpi=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=0, ackTimeout=0, marsh=null, reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], segPlc=STOP, segResolveAttempts=2, waitForSegOnStart=true, allResolversPassReq=true, segChkFreq=10000, commSpi=TcpCommunicationSpi [connectGate=org.apache.ignite.spi.communication.tcp.internal.ConnectGateway@21cb4e3f, ctxInitLatch=java.util.concurrent.CountDownLatch@7af58d89[Count = 1], stopping=false, clientPool=null, nioSrvWrapper=null, stateProvider=null], evtSpi=MemoryEventStorageSpi [expireAgeMs=9223372036854775807, expireCnt=10000, filter=null], colSpi=NoopCollisionSpi [], deploySpi=LocalDeploymentSpi [], indexingSpi=org.apache.ignite.spi.indexing.noop.NoopIndexingSpi@712dbdda, addrRslvr=null, encryptionSpi=org.apache.ignite.spi.encryption.keystore.KeystoreEncryptionSpi@15ba7a7, tracingSpi=org.apache.ignite.spi.tracing.NoopTracingSpi@42284db1, clientMode=false, rebalanceThreadPoolSize=4, rebalanceTimeout=10000, rebalanceBatchesPrefetchCnt=3, rebalanceThrottle=0, rebalanceBatchSize=524288, txCfg=TransactionConfiguration [txSerEnabled=false, dfltIsolation=REPEATABLE_READ, dfltConcurrency=PESSIMISTIC, dfltTxTimeout=0, txTimeoutOnPartitionMapExchange=0, deadlockTimeout=10000, pessimisticTxLogSize=0, pessimisticTxLogLinger=10000, tmLookupClsName=null, txManagerFactory=null, useJtaSync=false], cacheSanityCheckEnabled=true, discoStartupDelay=60000, deployMode=SHARED, p2pMissedCacheSize=100, locHost=127.0.0.1, timeSrvPortBase=31100, timeSrvPortRange=100, failureDetectionTimeout=10000, sysWorkerBlockedTimeout=null, clientFailureDetectionTimeout=10000, metricsLogFreq=0, connectorCfg=null, odbcCfg=null, warmupClos=null, atomicCfg=AtomicConfiguration [seqReserveSize=1000, cacheMode=PARTITIONED, backups=1, aff=null, grpName=null], classLdr=null, sslCtxFactory=null, platformCfg=null, binaryCfg=null, memCfg=null, pstCfg=null, dsCfg=DataStorageConfiguration [sysRegionInitSize=41943040, sysRegionMaxSize=104857600, pageSize=4096, concLvl=0, dfltDataRegConf=DataRegionConfiguration [name=default, maxSize=104857600, initSize=268435456, swapPath=null, pageEvictionMode=DISABLED, pageReplacementMode=CLOCK, evictionThreshold=0.9, emptyPagesPoolSize=100, metricsEnabled=false, metricsSubIntervalCount=5, metricsRateTimeInterval=60000, persistenceEnabled=true, checkpointPageBufSize=0, lazyMemoryAllocation=true, warmUpCfg=null], dataRegions=null, storagePath=null, checkpointFreq=30000, lockWaitTime=10000, checkpointThreads=4, checkpointWriteOrder=SEQUENTIAL, walHistSize=20, maxWalArchiveSize=20971520, walSegments=10, walSegmentSize=1048576, walPath=db/wal, walArchivePath=db/wal/archive, cdcWalPath=db/wal/cdc, cdcEnabled=false, metricsEnabled=false, walMode=LOG_ONLY, walTlbSize=131072, walBuffSize=0, walFlushFreq=2000, walFsyncDelay=1000, walRecordIterBuffSize=67108864, alwaysWriteFullPages=false, fileIOFactory=org.apache.ignite.internal.processors.cache.persistence.file.AsyncFileIOFactory@4280a207, metricsSubIntervalCnt=5, metricsRateTimeInterval=60000, walAutoArchiveAfterInactivity=-1, walForceArchiveTimeout=-1, writeThrottlingEnabled=false, walCompactionEnabled=false, walCompactionLevel=1, checkpointReadLockTimeout=null, walPageCompression=DISABLED, walPageCompressionLevel=null, dfltWarmUpCfg=null, encCfg=org.apache.ignite.configuration.EncryptionConfiguration@7f901459, defragmentationThreadPoolSize=4, minWalArchiveSize=-1], snapshotPath=snapshots, activeOnStart=true, activeOnStartPropSetFlag=false, autoActivation=true, autoActivationPropSetFlag=false, clusterStateOnStart=null, sqlConnCfg=null, cliConnCfg=ClientConnectorConfiguration [host=null, port=10800, portRange=100, sockSndBufSize=0, sockRcvBufSize=0, tcpNoDelay=true, maxOpenCursorsPerConn=128, threadPoolSize=24, selectorCnt=12, idleTimeout=0, handshakeTimeout=10000, jdbcEnabled=true, odbcEnabled=true, thinCliEnabled=true, sslEnabled=false, useIgniteSslCtxFactory=true, sslClientAuth=false, sslCtxFactory=null, thinCliCfg=ThinClientConfiguration [maxActiveTxPerConn=100, maxActiveComputeTasksPerConn=0]], mvccVacuumThreadCnt=2, mvccVacuumFreq=5000, authEnabled=false, failureHnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]], commFailureRslvr=null, sqlCfg=SqlConfiguration [longQryWarnTimeout=3000, dfltQryTimeout=0, sqlQryHistSize=1000, validationEnabled=false], asyncContinuationExecutor=null] [21:15:03] : [Step 4/5] [2021-11-19 21:15:03,400][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] Daemon mode: off [21:15:03] : [Step 4/5] [2021-11-19 21:15:03,401][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] OS: Linux 4.15.0-151-generic amd64 [21:15:03] : [Step 4/5] [2021-11-19 21:15:03,401][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] OS user: teamcity [21:15:03] : [Step 4/5] [2021-11-19 21:15:03,401][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] PID: 16724 [21:15:03] : [Step 4/5] [2021-11-19 21:15:03,401][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] Language runtime: Java Platform API Specification ver. 1.8 [21:15:03] : [Step 4/5] [2021-11-19 21:15:03,402][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] VM information: Java(TM) SE Runtime Environment 1.8.0_261-b12 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 25.261-b12 [21:15:03] : [Step 4/5] [2021-11-19 21:15:03,402][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] VM total memory: 1.9GB [21:15:03] : [Step 4/5] [2021-11-19 21:15:03,402][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] Remote Management [restart: off, REST: off, JMX (remote: off)] [21:15:03] : [Step 4/5] [2021-11-19 21:15:03,402][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] Logger: GridTestLog4jLogger [quiet=false, config=null] [21:15:03] : [Step 4/5] [2021-11-19 21:15:03,403][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] IGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c [21:15:03] : [Step 4/5] [2021-11-19 21:15:03,403][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] VM arguments: [-DIGNITE_DUMP_THREADS_ON_FAILURE=false, -DMono=/usr/bin/mono-sgen, -DMono4.0_x64=/usr/lib/mono/4.0, -DMono4.5_x64=/usr/lib/mono/4.5, -DMonoVersion=6.12.0.90, -DSKIP_BUILD=false, -Dagent.home.dir=/opt/buildagent, -Dagent.name=aitc-lin02_03, -Dagent.ownPort=9090, -Dagent.work.dir=/opt/buildagent/work, -Dbuild.number=95, -Dbuild.vcs.number=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.1=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.GitHubApacheIgnite=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dclassworlds.conf=/opt/buildagent/temp/buildTmp/teamcity.m2.conf, -Dcom.jetbrains.maven.watcher.report.file=/opt/buildagent/temp/buildTmp/maven-build-info.xml, -Djava.io.tmpdir=/opt/buildagent/temp/buildTmp, -Dmaven.home=/opt/buildagent/tools/maven3_6, -Dmaven.multiModuleProjectDirectory=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.agent.cpuBenchmark=457, -Dteamcity.agent.dotnet.agent_url=http://localhost:9090/RPC2, -Dteamcity.agent.dotnet.build_id=6278078, -Dteamcity.auth.password=*******, -Dteamcity.auth.userId=TeamCityBuildId=6278078, -Dteamcity.build.changedFiles.file=/opt/buildagent/temp/buildTmp/changedFiles6342607772318147725.txt, -Dteamcity.build.checkoutDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.build.id=6278078, -Dteamcity.build.properties.file=/opt/buildagent/temp/buildTmp/teamcity.build5164517880467851002.properties, -Dteamcity.build.tempDir=/opt/buildagent/temp/buildTmp, -Dteamcity.build.workingDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.buildConfName=Basic 3, -Dteamcity.buildType.id=IgniteTests24Java8_Basic3, -Dteamcity.configuration.properties.file=/opt/buildagent/temp/buildTmp/teamcity.config5591980786735343870.properties, -Dteamcity.maven.userSettings.path=/opt/buildagent/temp/buildTmp/maven_settings_585072866407032347.xml, -Dteamcity.maven.watcher.home=/opt/buildagent/plugins/mavenPlugin/maven-watcher-jdk16, -Dteamcity.projectName=Ignite Tests 2.x (JDK 8/11), -Dteamcity.runner.properties.file=/opt/buildagent/temp/buildTmp/teamcity.runner9098465561618137420.properties, -Dteamcity.tests.recentlyFailedTests.file=/opt/buildagent/temp/buildTmp/testsToRunFirst3891775683130404069.txt, -Dteamcity.version=2021.2 (build 99542), -ea, -Xms2g, -Xmx2g, -XX:+HeapDumpOnOutOfMemoryError, -DIGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_TEST_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_UPDATE_NOTIFIER=false, -DIGNITE_NO_DISCO_ORDER=true, -DIGNITE_PERFORMANCE_SUGGESTIONS_DISABLED=true, -Djava.net.preferIPv4Stack=true, -DTEST_SCALE_FACTOR=1.0, -DIGNITE_TEST_PROP_LOG4J_FILE=log4j-tc-test.xml, -DIGNITE_QUIET=false, -DIGNITE_MARSHAL_BUFFERS_RECHECK=1000, -Dmaven.repo.local=/opt/buildagent/.m2/repository] [21:15:03] : [Step 4/5] [2021-11-19 21:15:03,407][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] System cache's DataRegion size is configured to 40 MB. Use DataStorageConfiguration.systemRegionInitialSize property to change the setting. [21:15:03] : [Step 4/5] [2021-11-19 21:15:03,408][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] Configured caches [in 'sysMemPlc' dataRegion: ['ignite-sys-cache']] [21:15:03]W: [org.apache.ignite:ignite-core] [2021-11-19 21:15:03,408][WARN ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] Peer class loading is enabled (disable it in production for performance and deployment consistency reasons) [21:15:03] : [Step 4/5] [2021-11-19 21:15:03,408][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] 3-rd party licenses can be found at: /opt/buildagent/work/7bc1c54bc719b67c/libs/licenses [21:15:03] : [Step 4/5] [2021-11-19 21:15:03,413][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] Configured plugins: [21:15:03] : [Step 4/5] [2021-11-19 21:15:03,413][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- StanByClusterTestProvider 1.0 [21:15:03] : [Step 4/5] [2021-11-19 21:15:03,414][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:15:03] : [Step 4/5] [2021-11-19 21:15:03,414][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] [21:15:03] : [Step 4/5] [2021-11-19 21:15:03,414][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- PageMemory tracker plugin 1.0 [21:15:03] : [Step 4/5] [2021-11-19 21:15:03,414][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:15:03] : [Step 4/5] [2021-11-19 21:15:03,415][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] [21:15:03] : [Step 4/5] [2021-11-19 21:15:03,415][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- TestDistibutedConfigurationPlugin 1.0 [21:15:03] : [Step 4/5] [2021-11-19 21:15:03,415][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:15:03] : [Step 4/5] [2021-11-19 21:15:03,415][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] [21:15:03] : [Step 4/5] [2021-11-19 21:15:03,415][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- NodeValidationPluginProvider 1.0 [21:15:03] : [Step 4/5] [2021-11-19 21:15:03,416][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:15:03] : [Step 4/5] [2021-11-19 21:15:03,416][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] [21:15:03] : [Step 4/5] [2021-11-19 21:15:03,416][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][FailureProcessor] Configured failure handler: [hnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]]] [21:15:03] : [Step 4/5] [2021-11-19 21:15:03,429][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][TestRecordingCommunicationSpi] Successfully bound communication NIO server to TCP port [port=47101, locHost=/127.0.0.1, selectorsCnt=12, selectorSpins=0, pairedConn=false] [21:15:03]W: [org.apache.ignite:ignite-core] [2021-11-19 21:15:03,429][WARN ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][TestRecordingCommunicationSpi] Message queue limit is set to 0 which may lead to potential OOMEs when running cache operations in FULL_ASYNC or PRIMARY_SYNC modes due to message queues growth on sender and receiver sides. [21:15:03] : [Step 4/5] [2021-11-19 21:15:03,438][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][GridCollisionManager] Collision resolution is disabled (all jobs will be activated upon arrival). [21:15:03] : [Step 4/5] [2021-11-19 21:15:03,439][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] Security status [authentication=off, sandbox=off, tls/ssl=off] [21:15:03] : [Step 4/5] [2021-11-19 21:15:03,498][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:15:03] : [Step 4/5] [2021-11-19 21:15:03,589][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][MaintenanceProcessor] Resolved store directory for node persistent data: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1 [21:15:03] : [Step 4/5] [2021-11-19 21:15:03,590][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][CacheObjectBinaryProcessorImpl] Resolved directory for serialized binary metadata: /opt/buildagent/work/7bc1c54bc719b67c/work/db/binary_meta/grid_1 [21:15:03] : [Step 4/5] [2021-11-19 21:15:03,594][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1 [21:15:03] : [Step 4/5] [2021-11-19 21:15:03,594][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][FileWriteAheadLogManager] Resolved write ahead log work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1 [21:15:03] : [Step 4/5] [2021-11-19 21:15:03,595][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][FileWriteAheadLogManager] Resolved write ahead log archive directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1 [21:15:03] : [Step 4/5] [2021-11-19 21:15:03,696][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000000.wal [21:15:03] : [Step 4/5] [2021-11-19 21:15:03,696][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][FileHandleManagerImpl] Initialized write-ahead log manager [mode=LOG_ONLY] [21:15:03] : [Step 4/5] [2021-11-19 21:15:03,702][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Configured data regions initialized successfully [total=5] [21:15:03] : [Step 4/5] [2021-11-19 21:15:03,704][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][IgniteSnapshotManager] Resolved snapshot work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/snapshots [21:15:03] : [Step 4/5] [2021-11-19 21:15:03,705][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][IgniteSnapshotManager] Resolved temp directory for snapshot creation: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1/snp [21:15:03] : [Step 4/5] [2021-11-19 21:15:03,710][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][ClientListenerProcessor] Client connector processor has started on TCP port 10801 [21:15:03] : [Step 4/5] [2021-11-19 21:15:03,712][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] Non-loopback local IPs: 172.17.0.4 [21:15:03] : [Step 4/5] [2021-11-19 21:15:03,713][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] Enabled local MACs: 0242AC110004 [21:15:03] : [Step 4/5] [2021-11-19 21:15:03,714][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:15:03] : [Step 4/5] [2021-11-19 21:15:03,715][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:15:03] : [Step 4/5] [2021-11-19 21:15:03,715][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:15:03] : [Step 4/5] [2021-11-19 21:15:03,721][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Applying lost metastore updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:15:03] : [Step 4/5] [2021-11-19 21:15:03,724][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=0 ms] [21:15:03] : [Step 4/5] [2021-11-19 21:15:03,724][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Restoring partition state for local groups. [21:15:03] : [Step 4/5] [2021-11-19 21:15:03,725][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=0, partitionsProcessed=0, time=0ms] [21:15:03] : [Step 4/5] [2021-11-19 21:15:03,726][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][GridEncryptionManager] Encryption keys loaded from metastore. [grps=, masterKeyName=ignite.master.key] [21:15:03] : [Step 4/5] [2021-11-19 21:15:03,727][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][ClusterProcessor] Cluster ID and tag has been read from metastorage: null [21:15:03] : [Step 4/5] [2021-11-19 21:15:03,728][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][IgniteClusterImpl] Shutdown policy was updated [oldVal=null, newVal=null] [21:15:03] : [Step 4/5] [2021-11-19 21:15:03,728][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Checkpoint frequency deviation changed [oldVal=null, newVal=null] [21:15:03] : [Step 4/5] [2021-11-19 21:15:03,743][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][FilePageStoreManager] Cleanup cache stores [total=1, left=0, cleanFiles=false] [21:15:03] : [Step 4/5] [2021-11-19 21:15:03,745][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:15:03] : [Step 4/5] [2021-11-19 21:15:03,746][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:15:03] : [Step 4/5] [2021-11-19 21:15:03,747][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:15:03] : [Step 4/5] [2021-11-19 21:15:03,748][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Data Regions Started: 5 [21:15:03] : [Step 4/5] [2021-11-19 21:15:03,748][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] ^-- sysMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:15:03] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:15:03] : [Step 4/5] ^-- default region [type=default, persistence=true, lazyAlloc=true, [21:15:03] : [Step 4/5] ... initCfg=100MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB, allocTotal=0MB] [21:15:03] : [Step 4/5] ^-- metastoreMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:15:03] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:15:03] : [Step 4/5] ^-- TxLog region [type=internal, persistence=true, lazyAlloc=false, [21:15:03] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:15:03] : [Step 4/5] ^-- volatileDsMemPlc region [type=user, persistence=false, lazyAlloc=true, [21:15:03] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB] [21:15:03] : [Step 4/5] ^-- Ignite persistence [used=0MB] [21:15:03] : [Step 4/5] [21:15:03] : [Step 4/5] [2021-11-19 21:15:03,750][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Starting binary memory restore for: [-2100569601] [21:15:03] : [Step 4/5] [2021-11-19 21:15:03,759][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:15:03] : [Step 4/5] [2021-11-19 21:15:03,759][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:15:03] : [Step 4/5] [2021-11-19 21:15:03,761][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000000.wal, offset=0, ver=2] [21:15:03] : [Step 4/5] [2021-11-19 21:15:03,765][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Started cache in recovery mode [name=ignite-sys-cache, id=-2100569601, dataRegionName=sysMemPlc, mode=REPLICATED, atomicity=TRANSACTIONAL, backups=2147483647, mvcc=false] [21:15:03] : [Step 4/5] [2021-11-19 21:15:03,766][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Binary recovery performed in 16 ms. [21:15:03] : [Step 4/5] [2021-11-19 21:15:03,766][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:15:03] : [Step 4/5] [2021-11-19 21:15:03,767][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Applying lost cache updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:15:03] : [Step 4/5] [2021-11-19 21:15:03,769][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=0 ms] [21:15:03] : [Step 4/5] [2021-11-19 21:15:03,769][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Restoring partition state for local groups. [21:15:03] : [Step 4/5] [2021-11-19 21:15:03,780][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=1, partitionsProcessed=100, time=10ms] [21:15:03] : [Step 4/5] [2021-11-19 21:15:03,801][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][TestTcpDiscoverySpi] Successfully bound to TCP port [port=47501, localHost=localhost/127.0.0.1, locNodeId=10170880-e32c-4da6-9d06-465492fc0001] [21:15:03] : [Step 4/5] [2021-11-19 21:15:03,805][INFO ][tcp-disco-srvr-[:47500]-#1356%grid-0%-#25840%grid-0%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=42653] [21:15:03] : [Step 4/5] [2021-11-19 21:15:03,806][INFO ][tcp-disco-srvr-[:47500]-#1356%grid-0%-#25840%grid-0%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=42653] [21:15:03] : [Step 4/5] [2021-11-19 21:15:03,806][INFO ][tcp-disco-sock-reader-[]-#1362%grid-0%-#25960%grid-0%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:42653, rmtPort=42653] [21:15:03] : [Step 4/5] [2021-11-19 21:15:03,807][INFO ][tcp-disco-sock-reader-[10170880 127.0.0.1:42653]-#1362%grid-0%-#25960%grid-0%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=10170880-e32c-4da6-9d06-465492fc0001, rmtAddr=/127.0.0.1:42653] [21:15:03] : [Step 4/5] [2021-11-19 21:15:03,813][INFO ][tcp-disco-srvr-[:47501]-#1361%grid-1%-#25959%grid-1%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=60251] [21:15:03] : [Step 4/5] [2021-11-19 21:15:03,813][INFO ][tcp-disco-srvr-[:47501]-#1361%grid-1%-#25959%grid-1%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=60251] [21:15:03] : [Step 4/5] [2021-11-19 21:15:03,816][INFO ][tcp-disco-sock-reader-[]-#1363%grid-1%-#25961%grid-1%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:60251, rmtPort=60251] [21:15:03] : [Step 4/5] [2021-11-19 21:15:03,817][INFO ][tcp-disco-sock-reader-[]-#1363%grid-1%-#25961%grid-1%][TestTcpDiscoverySpi] Received ping request from the remote node [rmtNodeId=0061f6c1-e5b0-456b-b001-a59f68b46000, rmtAddr=/127.0.0.1:60251, rmtPort=60251] [21:15:03] : [Step 4/5] [2021-11-19 21:15:03,818][INFO ][tcp-disco-sock-reader-[]-#1363%grid-1%-#25961%grid-1%][TestTcpDiscoverySpi] Finished writing ping response [rmtNodeId=0061f6c1-e5b0-456b-b001-a59f68b46000, rmtAddr=/127.0.0.1:60251, rmtPort=60251] [21:15:03]W: [org.apache.ignite:ignite-core] [2021-11-19 21:15:03,818][WARN ][tcp-disco-sock-reader-[]-#1363%grid-1%-#25961%grid-1%][TestTcpDiscoverySpi] Failed to shutdown socket [21:15:03]W: [org.apache.ignite:ignite-core] java.net.SocketException: Socket output is already shutdown [21:15:03]W: [org.apache.ignite:ignite-core] at java.net.Socket.shutdownOutput(Socket.java:1572) [21:15:03]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.close(IgniteUtils.java:4247) [21:15:03]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.discovery.tcp.ServerImpl$SocketReader.body(ServerImpl.java:7370) [21:15:03]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.IgniteSpiThread.run(IgniteSpiThread.java:58) [21:15:03] : [Step 4/5] [2021-11-19 21:15:03,818][INFO ][tcp-disco-sock-reader-[10170880 127.0.0.1:42653]-#1362%grid-0%-#25960%grid-0%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:42653, rmtPort=42653, rmtNodeId=10170880-e32c-4da6-9d06-465492fc0001] [21:15:03] : [Step 4/5] [2021-11-19 21:15:03,820][INFO ][tcp-disco-sock-reader-[]-#1363%grid-1%-#25961%grid-1%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:60251, rmtPort=60251, rmtNodeId=null] [21:15:03] : [Step 4/5] [2021-11-19 21:15:03,822][INFO ][tcp-disco-msg-worker-[crd]-#1355%grid-0%-#25839%grid-0%][GridEncryptionManager] Joining node doesn't have stored group keys [node=10170880-e32c-4da6-9d06-465492fc0001] [21:15:03] : [Step 4/5] [2021-11-19 21:15:03,832][INFO ][tcp-disco-msg-worker-[crd]-#1355%grid-0%-#25839%grid-0%][TestTcpDiscoverySpi] New next node [newNext=TcpDiscoveryNode [id=10170880-e32c-4da6-9d06-465492fc0001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=0, intOrder=2, lastExchangeTime=1637345703801, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false]] [21:15:03] : [Step 4/5] [2021-11-19 21:15:03,833][INFO ][tcp-disco-srvr-[:47501]-#1361%grid-1%-#25959%grid-1%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=48915] [21:15:03] : [Step 4/5] [2021-11-19 21:15:03,833][INFO ][tcp-disco-srvr-[:47501]-#1361%grid-1%-#25959%grid-1%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=48915] [21:15:03] : [Step 4/5] [2021-11-19 21:15:03,834][INFO ][tcp-disco-sock-reader-[]-#1364%grid-1%-#25962%grid-1%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:48915, rmtPort=48915] [21:15:03] : [Step 4/5] [2021-11-19 21:15:03,836][INFO ][tcp-disco-sock-reader-[0061f6c1 127.0.0.1:48915]-#1364%grid-1%-#25962%grid-1%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=0061f6c1-e5b0-456b-b001-a59f68b46000, rmtAddr=/127.0.0.1:48915] [21:15:03] : [Step 4/5] [2021-11-19 21:15:03,839][INFO ][tcp-disco-msg-worker-[]-#1360%grid-1%-#25958%grid-1%][TestTcpDiscoverySpi] New next node [newNext=TcpDiscoveryNode [id=0061f6c1-e5b0-456b-b001-a59f68b46000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345703836, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false]] [21:15:03] : [Step 4/5] [2021-11-19 21:15:03,840][INFO ][tcp-disco-srvr-[:47500]-#1356%grid-0%-#25840%grid-0%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=57059] [21:15:03] : [Step 4/5] [2021-11-19 21:15:03,840][INFO ][tcp-disco-srvr-[:47500]-#1356%grid-0%-#25840%grid-0%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=57059] [21:15:03] : [Step 4/5] [2021-11-19 21:15:03,841][INFO ][tcp-disco-sock-reader-[]-#1365%grid-0%-#25963%grid-0%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:57059, rmtPort=57059] [21:15:03] : [Step 4/5] [2021-11-19 21:15:03,841][INFO ][tcp-disco-sock-reader-[10170880 127.0.0.1:57059]-#1365%grid-0%-#25963%grid-0%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=10170880-e32c-4da6-9d06-465492fc0001, rmtAddr=/127.0.0.1:57059] [21:15:03] : [Step 4/5] [2021-11-19 21:15:03,844][INFO ][disco-event-worker-#25842%grid-0%][GridDiscoveryManager] Added new node to topology: TcpDiscoveryNode [id=10170880-e32c-4da6-9d06-465492fc0001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637345703801, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false] [21:15:03] : [Step 4/5] [2021-11-19 21:15:03,845][INFO ][disco-event-worker-#25842%grid-0%][GridDiscoveryManager] Topology snapshot [ver=2, locNode=0061f6c1, servers=2, clients=0, state=INACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=0061f6c1-e5b0-456b-b001-a59f68b46000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=10170880-e32c-4da6-9d06-465492fc0001, consistentId=grid-1, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:15:03] : [Step 4/5] [2021-11-19 21:15:03,847][INFO ][tcp-disco-msg-worker-[0061f6c1 127.0.0.1:47500]-#1360%grid-1%-#25958%grid-1%][ClusterProcessor] friendly_mirzakhani [21:15:03] : [Step 4/5] [2021-11-19 21:15:03,848][INFO ][tcp-disco-msg-worker-[0061f6c1 127.0.0.1:47500]-#1360%grid-1%-#25958%grid-1%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustEnabled' was changed from 'null' to 'false' [21:15:03] : [Step 4/5] [2021-11-19 21:15:03,848][INFO ][tcp-disco-msg-worker-[0061f6c1 127.0.0.1:47500]-#1360%grid-1%-#25958%grid-1%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustTimeout' was changed from 'null' to '300000' [21:15:03] : [Step 4/5] [2021-11-19 21:15:03,849][INFO ][tcp-disco-msg-worker-[0061f6c1 127.0.0.1:47500]-#1360%grid-1%-#25958%grid-1%][IgniteTxManager] Transactions parameter 'longOperationsDumpTimeout' was changed from 'null' to '60000' [21:15:03] : [Step 4/5] [2021-11-19 21:15:03,849][INFO ][tcp-disco-msg-worker-[0061f6c1 127.0.0.1:47500]-#1360%grid-1%-#25958%grid-1%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpThreshold' was changed from 'null' to '0' [21:15:03] : [Step 4/5] [2021-11-19 21:15:03,849][INFO ][tcp-disco-msg-worker-[0061f6c1 127.0.0.1:47500]-#1360%grid-1%-#25958%grid-1%][IgniteTxManager] Transactions parameter 'transactionTimeDumpSamplesCoefficient' was changed from 'null' to '0.0' [21:15:03] : [Step 4/5] [2021-11-19 21:15:03,850][INFO ][tcp-disco-msg-worker-[0061f6c1 127.0.0.1:47500]-#1360%grid-1%-#25958%grid-1%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpSamplesPerSecondLimit' was changed from 'null' to '5' [21:15:03] : [Step 4/5] [2021-11-19 21:15:03,850][INFO ][tcp-disco-msg-worker-[0061f6c1 127.0.0.1:47500]-#1360%grid-1%-#25958%grid-1%][IgniteTxManager] Transactions parameter 'collisionsDumpInterval' was changed from 'null' to '1000' [21:15:03] : [Step 4/5] [2021-11-19 21:15:03,851][INFO ][tcp-disco-msg-worker-[0061f6c1 127.0.0.1:47500]-#1360%grid-1%-#25958%grid-1%][IgniteTxManager] Transactions parameter 'txOwnerDumpRequestsAllowed' was changed from 'null' to 'true' [21:15:03] : [Step 4/5] [2021-11-19 21:15:03,851][INFO ][tcp-disco-msg-worker-[0061f6c1 127.0.0.1:47500]-#1360%grid-1%-#25958%grid-1%][GridCacheDatabaseSharedManager] Historical rebalance WAL threshold changed [property=historical.rebalance.threshold, oldVal=null, newVal=500] [21:15:03] : [Step 4/5] [2021-11-19 21:15:03,852][INFO ][disco-notifier-worker-#25957%grid-1%][MvccProcessorImpl] Assigned mvcc coordinator [crd=MvccCoordinator [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=0], nodeId=0061f6c1-e5b0-456b-b001-a59f68b46000, ver=1637345703338, local=false, initialized=false]] [21:15:03] : [Step 4/5] [2021-11-19 21:15:03,853][INFO ][sys-#25936%grid-1%][ClusterProcessor] Writing cluster ID and tag to metastorage on ready for write ClusterIdAndTag [id=75323fd9-934f-4dbd-a543-7321879bb66e, tag=friendly_mirzakhani] [21:15:03] : [Step 4/5] [2021-11-19 21:15:03,917][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] To start Console Management & Monitoring run ignitevisorcmd.{sh|bat} [21:15:03] : [Step 4/5] [2021-11-19 21:15:03,918][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] [21:15:03] : [Step 4/5] [21:15:03] : [Step 4/5] >>> +-------------------------------------------+ [21:15:03] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:15:03] : [Step 4/5] >>> +-------------------------------------------+ [21:15:03] : [Step 4/5] >>> OS name: Linux 4.15.0-151-generic amd64 [21:15:03] : [Step 4/5] >>> CPU(s): 24 [21:15:03] : [Step 4/5] >>> Heap: 2.0GB [21:15:03] : [Step 4/5] >>> VM name: 16724@c4dfe9a430b2 [21:15:03] : [Step 4/5] >>> Ignite instance name: grid-1 [21:15:03] : [Step 4/5] >>> Local node [ID=10170880-E32C-4DA6-9D06-465492FC0001, order=2, clientMode=false] [21:15:03] : [Step 4/5] >>> Local node addresses: [127.0.0.1] [21:15:03] : [Step 4/5] >>> Local ports: TCP:10801 TCP:47101 TCP:47501 [21:15:03] : [Step 4/5] [21:15:03] : [Step 4/5] [2021-11-19 21:15:03,920][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] >>> Ignite cluster is in INACTIVE state (limited functionality available). Use control.(sh|bat) script or IgniteCluster.state(ClusterState.ACTIVE) to change the state. [21:15:03] : [Step 4/5] [2021-11-19 21:15:03,920][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][GridDiscoveryManager] Topology snapshot [ver=2, locNode=10170880, servers=2, clients=0, state=INACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=0061f6c1-e5b0-456b-b001-a59f68b46000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=10170880-e32c-4da6-9d06-465492fc0001, consistentId=grid-1, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:15:03] : [Step 4/5] [2021-11-19 21:15:03,922][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][G] Node started : [stage="Configure system pool" (0 ms),stage="Start managers" (200 ms),stage="Configure binary metadata" (2 ms),stage="Start processors" (120 ms),stage="Start 'StanByClusterTestProvider' plugin" (0 ms),stage="Start 'PageMemory tracker plugin' plugin" (0 ms),stage="Start 'TestDistibutedConfigurationPlugin' plugin" (0 ms),stage="Start 'NodeValidationPluginProvider' plugin" (0 ms),stage="Init metastore" (31 ms),stage="Init and start regions" (6 ms),stage="Restore binary memory" (16 ms),stage="Restore logical state" (14 ms),stage="Finish recovery" (19 ms),stage="Join topology" (52 ms),stage="Await transition" (4 ms),stage="Await exchange" (64 ms),stage="Total time" (528 ms)] [21:15:03] : [Step 4/5] [2021-11-19 21:15:03,923][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][root] Node started with the following configuration [id=10170880-e32c-4da6-9d06-465492fc0001, marshaller=BinaryMarshaller [], discovery=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=5000, ackTimeout=5000, marsh=JdkMarshaller [clsFilter=org.apache.ignite.marshaller.MarshallerUtils$1@75472ea3], reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], binaryCfg=null, lateAff=true] [21:15:03] : [Step 4/5] [2021-11-19 21:15:03,926][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][GridClusterStateProcessor] Sending activate cluster request with BaselineTopology BaselineTopology [id=0, branchingHash=-2475315501, branchingType='New BaselineTopology', baselineNodes=[grid-1, grid-0]] [21:15:03] : [Step 4/5] [2021-11-19 21:15:03,932][INFO ][disco-notifier-worker-#25838%grid-0%][GridClusterStateProcessor] Received activate cluster request with BaselineTopology[id=0] initiator node ID: 0061f6c1-e5b0-456b-b001-a59f68b46000 [21:15:03] : [Step 4/5] [2021-11-19 21:15:03,932][INFO ][disco-notifier-worker-#25838%grid-0%][GridClusterStateProcessor] Started state transition: activate cluster [21:15:03] : [Step 4/5] [2021-11-19 21:15:03,933][INFO ][exchange-worker-#25843%grid-0%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], crd=true, evt=DISCOVERY_CUSTOM_EVT, evtNode=0061f6c1-e5b0-456b-b001-a59f68b46000, customEvt=ChangeGlobalStateMessage [id=6c43e593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqId=b4700011-f6fe-4d31-bc12-9a136902d62f, initiatingNodeId=0061f6c1-e5b0-456b-b001-a59f68b46000, state=ACTIVE, baselineTopology=BaselineTopology [id=0, branchingHash=-2475315501, branchingType='New BaselineTopology', baselineNodes=[grid-1, grid-0]], forceChangeBaselineTopology=false, timestamp=1637345703926, forceDeactivation=true], allowMerge=false, exchangeFreeSwitch=false] [21:15:03] : [Step 4/5] [2021-11-19 21:15:03,934][INFO ][disco-notifier-worker-#25957%grid-1%][GridClusterStateProcessor] Received activate cluster request with BaselineTopology[id=0] initiator node ID: 0061f6c1-e5b0-456b-b001-a59f68b46000 [21:15:03] : [Step 4/5] [2021-11-19 21:15:03,934][INFO ][exchange-worker-#25843%grid-0%][GridDhtPartitionsExchangeFuture] Start activation process [nodeId=0061f6c1-e5b0-456b-b001-a59f68b46000, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]]. New state: ACTIVE [21:15:03] : [Step 4/5] [2021-11-19 21:15:03,935][INFO ][disco-notifier-worker-#25957%grid-1%][GridClusterStateProcessor] Started state transition: activate cluster [21:15:03] : [Step 4/5] [2021-11-19 21:15:03,935][INFO ][exchange-worker-#25843%grid-0%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0 [21:15:03] : [Step 4/5] [2021-11-19 21:15:03,936][INFO ][exchange-worker-#25966%grid-1%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], crd=false, evt=DISCOVERY_CUSTOM_EVT, evtNode=0061f6c1-e5b0-456b-b001-a59f68b46000, customEvt=ChangeGlobalStateMessage [id=6c43e593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqId=b4700011-f6fe-4d31-bc12-9a136902d62f, initiatingNodeId=0061f6c1-e5b0-456b-b001-a59f68b46000, state=ACTIVE, baselineTopology=BaselineTopology [id=0, branchingHash=-2475315501, branchingType='New BaselineTopology', baselineNodes=[grid-1, grid-0]], forceChangeBaselineTopology=false, timestamp=1637345703926, forceDeactivation=true], allowMerge=false, exchangeFreeSwitch=false] [21:15:03] : [Step 4/5] [2021-11-19 21:15:03,941][INFO ][exchange-worker-#25966%grid-1%][GridDhtPartitionsExchangeFuture] Start activation process [nodeId=10170880-e32c-4da6-9d06-465492fc0001, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]]. New state: ACTIVE [21:15:03] : [Step 4/5] [2021-11-19 21:15:03,941][INFO ][exchange-worker-#25966%grid-1%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1 [21:15:03] : [Step 4/5] [2021-11-19 21:15:03,961][INFO ][exchange-worker-#25843%grid-0%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000000.wal, offset=8795, ver=2] [21:15:03] : [Step 4/5] [2021-11-19 21:15:03,973][INFO ][exchange-worker-#25966%grid-1%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000000.wal, offset=8795, ver=2] [21:15:03] : [Step 4/5] [2021-11-19 21:15:03,973][INFO ][exchange-worker-#25843%grid-0%][GridClusterStateProcessor] Writing BaselineTopology[id=0] [21:15:03] : [Step 4/5] [2021-11-19 21:15:03,974][INFO ][exchange-worker-#25966%grid-1%][GridClusterStateProcessor] Writing BaselineTopology[id=0] [21:15:03] : [Step 4/5] [2021-11-19 21:15:03,977][INFO ][exchange-worker-#25966%grid-1%][GridCacheDatabaseSharedManager] Finish recovery performed in 35 ms. [21:15:03] : [Step 4/5] [2021-11-19 21:15:03,977][INFO ][exchange-worker-#25843%grid-0%][GridCacheDatabaseSharedManager] Finish recovery performed in 41 ms. [21:15:03] : [Step 4/5] [2021-11-19 21:15:03,978][INFO ][exchange-worker-#25966%grid-1%][msg] Components activation performed in 37 ms. [21:15:04] : [Step 4/5] [2021-11-19 21:15:03,984][INFO ][exchange-worker-#25843%grid-0%][msg] Components activation performed in 49 ms. [21:15:04] : [Step 4/5] [2021-11-19 21:15:04,041][INFO ][exchange-worker-#25966%grid-1%][GridCacheProcessor] Finished recovery for cache [cache=ignite-sys-cache, grp=ignite-sys-cache, startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:15:04] : [Step 4/5] [2021-11-19 21:15:04,042][INFO ][exchange-worker-#25843%grid-0%][GridCacheProcessor] Finished recovery for cache [cache=ignite-sys-cache, grp=ignite-sys-cache, startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:15:04] : [Step 4/5] [2021-11-19 21:15:04,042][INFO ][exchange-worker-#25966%grid-1%][GridDhtPartitionsExchangeFuture] Successfully activated caches [nodeId=10170880-e32c-4da6-9d06-465492fc0001, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], newState=ACTIVE] [21:15:04] : [Step 4/5] [2021-11-19 21:15:04,043][INFO ][exchange-worker-#25843%grid-0%][GridDhtPartitionsExchangeFuture] Successfully activated caches [nodeId=0061f6c1-e5b0-456b-b001-a59f68b46000, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], newState=ACTIVE] [21:15:04] : [Step 4/5] [2021-11-19 21:15:04,044][INFO ][exchange-worker-#25843%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:15:04] : [Step 4/5] [2021-11-19 21:15:04,043][INFO ][exchange-worker-#25966%grid-1%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:15:04] : [Step 4/5] [2021-11-19 21:15:04,053][INFO ][exchange-worker-#25843%grid-0%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], crd=true] [21:15:04] : [Step 4/5] [2021-11-19 21:15:04,059][INFO ][grid-nio-worker-tcp-comm-0-#25781%TestRecordingCommunicationSpi%][TestRecordingCommunicationSpi] Accepted incoming communication connection [locAddr=/127.0.0.1:47100, rmtAddr=/127.0.0.1:35516] [21:15:04] : [Step 4/5] [2021-11-19 21:15:04,062][INFO ][grid-nio-worker-tcp-comm-0-#25900%TestRecordingCommunicationSpi%][TestRecordingCommunicationSpi] Established outgoing communication connection [locAddr=/127.0.0.1:35516, rmtAddr=/127.0.0.1:47100] [21:15:04] : [Step 4/5] [2021-11-19 21:15:04,062][INFO ][exchange-worker-#25966%grid-1%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], crd=false] [21:15:04] : [Step 4/5] [2021-11-19 21:15:04,065][INFO ][sys-#25819%grid-0%][GridDhtPartitionsExchangeFuture] Coordinator received single message [ver=AffinityTopologyVersion [topVer=2, minorTopVer=1], node=10170880-e32c-4da6-9d06-465492fc0001, allReceived=true] [21:15:04] : [Step 4/5] [2021-11-19 21:15:04,065][INFO ][sys-#25819%grid-0%][GridDhtPartitionsExchangeFuture] finishExchangeOnCoordinator [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:15:04] : [Step 4/5] [2021-11-19 21:15:04,069][INFO ][sys-#25819%grid-0%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], err=null, rebalanced=true, wasRebalanced=false] [21:15:04] : [Step 4/5] [2021-11-19 21:15:04,070][INFO ][disco-notifier-worker-#25838%grid-0%][GridClusterStateProcessor] Received state change finish message: ACTIVE [21:15:04] : [Step 4/5] [2021-11-19 21:15:04,074][INFO ][disco-notifier-worker-#25957%grid-1%][GridClusterStateProcessor] Received state change finish message: ACTIVE [21:15:04] : [Step 4/5] [2021-11-19 21:15:04,073][INFO ][sys-#25940%grid-1%][GridDhtPartitionsExchangeFuture] Received full message, will finish exchange [node=0061f6c1-e5b0-456b-b001-a59f68b46000, resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:15:04] : [Step 4/5] [2021-11-19 21:15:04,074][INFO ][disco-notifier-worker-#25957%grid-1%][GridClusterStateProcessor] Cluster state was changed from INACTIVE to ACTIVE [21:15:04] : [Step 4/5] [2021-11-19 21:15:04,074][INFO ][disco-notifier-worker-#25838%grid-0%][GridClusterStateProcessor] Cluster state was changed from INACTIVE to ACTIVE [21:15:04] : [Step 4/5] [2021-11-19 21:15:04,076][INFO ][sys-#25940%grid-1%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], err=null, rebalanced=true, wasRebalanced=false] [21:15:04] : [Step 4/5] [2021-11-19 21:15:04,076][INFO ][sys-#25945%grid-1%][GridCachePartitionExchangeManager] Delay process full message without exchange id (there is exchange in progress) [nodeId=0061f6c1-e5b0-456b-b001-a59f68b46000] [21:15:04] : [Step 4/5] [2021-11-19 21:15:04,076][INFO ][sys-#25819%grid-0%][GridCacheProcessor] Finish proxy initialization, cacheName=ignite-sys-cache, localNodeId=0061f6c1-e5b0-456b-b001-a59f68b46000 [21:15:04] : [Step 4/5] [2021-11-19 21:15:04,080][INFO ][sys-#25940%grid-1%][GridCacheProcessor] Finish proxy initialization, cacheName=ignite-sys-cache, localNodeId=10170880-e32c-4da6-9d06-465492fc0001 [21:15:04] : [Step 4/5] [2021-11-19 21:15:04,080][INFO ][exchange-worker-#25843%grid-0%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=2, minorTopVer=1], force=false, evt=DISCOVERY_CUSTOM_EVT, node=0061f6c1-e5b0-456b-b001-a59f68b46000] [21:15:04] : [Step 4/5] [2021-11-19 21:15:04,080][INFO ][sys-#25833%grid-0%][DistributedBaselineConfiguration] Baseline auto-adjust is 'disabled' with timeout='300000' ms [21:15:04] : [Step 4/5] [2021-11-19 21:15:04,082][INFO ][sys-#25833%grid-0%][GridClusterStateProcessor] Successfully performed final activation steps [nodeId=0061f6c1-e5b0-456b-b001-a59f68b46000, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:15:04] : [Step 4/5] [2021-11-19 21:15:04,082][INFO ][sys-#25940%grid-1%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=10170880-e32c-4da6-9d06-465492fc0001, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=0061f6c1-e5b0-456b-b001-a59f68b46000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345703836, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:15:04] : [Step 4/5] [2021-11-19 21:15:04,084][INFO ][sys-#25940%grid-1%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (4 ms), stage="Update caches registry" (43 ms), stage="Start caches" (57 ms), stage="Affinity initialization on cache group start" (0 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (5 ms), stage="Restore partition states" (0 ms), stage="After states restored callback" (8 ms), stage="WAL history reservation" (0 ms), stage="Waiting for Full message" (16 ms), stage="Affinity recalculation" (2 ms), stage="Full map updating" (0 ms), stage="Detect lost partitions" (1 ms), stage="Exchange done" (6 ms), stage="Total time" (142 ms)] [21:15:04] : [Step 4/5] [2021-11-19 21:15:04,086][INFO ][sys-#25940%grid-1%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], stage="Affinity initialization on cache group start [grp=ignite-sys-cache]" (0 ms) (parent=Affinity initialization on cache group start), stage="Affinity centralized initialization (crd) [grp=ignite-sys-cache, crd=false]" (0 ms) (parent=Determine exchange type), stage="Restore partition states [grp=ignite-sys-cache]" (0 ms) (parent=Restore partition states), stage="Affinity applying from full message [grp=ignite-sys-cache]" (2 ms) (parent=Affinity recalculation)] [21:15:04] : [Step 4/5] [2021-11-19 21:15:04,082][INFO ][exchange-worker-#25966%grid-1%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=2, minorTopVer=1], force=false, evt=DISCOVERY_CUSTOM_EVT, node=0061f6c1-e5b0-456b-b001-a59f68b46000] [21:15:04] : [Step 4/5] [2021-11-19 21:15:04,081][INFO ][sys-#25950%grid-1%][DistributedBaselineConfiguration] Baseline auto-adjust is 'disabled' with timeout='300000' ms [21:15:04] : [Step 4/5] [2021-11-19 21:15:04,089][INFO ][sys-#25950%grid-1%][GridClusterStateProcessor] Successfully performed final activation steps [nodeId=10170880-e32c-4da6-9d06-465492fc0001, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:15:04] : [Step 4/5] [2021-11-19 21:15:04,081][INFO ][sys-#25819%grid-0%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=0061f6c1-e5b0-456b-b001-a59f68b46000, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=0061f6c1-e5b0-456b-b001-a59f68b46000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345704065, loc=true, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:15:04] : [Step 4/5] [2021-11-19 21:15:04,089][INFO ][exchange-worker-#25966%grid-1%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], crd=false, evt=DISCOVERY_CUSTOM_EVT, evtNode=0061f6c1-e5b0-456b-b001-a59f68b46000, customEvt=DynamicCacheChangeBatch [id=ae43e593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqs=ArrayList [DynamicCacheChangeRequest [cacheName=encrypted, hasCfg=true, nodeId=0061f6c1-e5b0-456b-b001-a59f68b46000, clientStartOnly=false, stop=false, destroy=false, disabledAfterStart=false]], exchangeActions=ExchangeActions [startCaches=[encrypted], stopCaches=null, startGrps=[encrypted], stopGrps=[], resetParts=null, stateChangeRequest=null], startCaches=false], allowMerge=false, exchangeFreeSwitch=false] [21:15:04] : [Step 4/5] [2021-11-19 21:15:04,087][INFO ][exchange-worker-#25843%grid-0%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], crd=true, evt=DISCOVERY_CUSTOM_EVT, evtNode=0061f6c1-e5b0-456b-b001-a59f68b46000, customEvt=DynamicCacheChangeBatch [id=ae43e593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqs=ArrayList [DynamicCacheChangeRequest [cacheName=encrypted, hasCfg=true, nodeId=0061f6c1-e5b0-456b-b001-a59f68b46000, clientStartOnly=false, stop=false, destroy=false, disabledAfterStart=false]], exchangeActions=ExchangeActions [startCaches=[encrypted], stopCaches=null, startGrps=[encrypted], stopGrps=[], resetParts=null, stateChangeRequest=null], startCaches=false], allowMerge=false, exchangeFreeSwitch=false] [21:15:04] : [Step 4/5] [2021-11-19 21:15:04,093][INFO ][exchange-worker-#25966%grid-1%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:15:04] : [Step 4/5] [2021-11-19 21:15:04,090][INFO ][sys-#25819%grid-0%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (1 ms), stage="Update caches registry" (107 ms), stage="Start caches" (0 ms), stage="Affinity initialization on cache group start" (0 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Restore partition states" (0 ms), stage="After states restored callback" (8 ms), stage="WAL history reservation" (0 ms), stage="Waiting for all single messages" (12 ms), stage="Affinity recalculation (crd)" (0 ms), stage="Collect update counters and create affinity messages" (0 ms), stage="Assign partitions states" (0 ms), stage="Validate partitions states" (0 ms), stage="Ideal affinity diff calculation (enforced)" (0 ms), stage="Apply update counters" (0 ms), stage="Full message preparing" (2 ms), stage="Full message sending" (0 ms), stage="State finish message sending" (0 ms), stage="Detect lost partitions" (5 ms), stage="Exchange done" (15 ms), stage="Total time" (150 ms), Discovery lag=3 ms, Latest started node id=10170880-e32c-4da6-9d06-465492fc0001] [21:15:04] : [Step 4/5] [2021-11-19 21:15:04,095][INFO ][sys-#25819%grid-0%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], stage="Affinity initialization on cache group start [grp=ignite-sys-cache]" (0 ms) (parent=Affinity initialization on cache group start), stage="Affinity centralized initialization (crd) [grp=ignite-sys-cache, crd=true]" (0 ms) (parent=Determine exchange type), stage="Restore partition states [grp=ignite-sys-cache]" (0 ms) (parent=Restore partition states), stage="Affinity recalculation (partitions availability) [grp=ignite-sys-cache]" (0 ms) (parent=Ideal affinity diff calculation (enforced))] [21:15:04] : [Step 4/5] [2021-11-19 21:15:04,094][INFO ][exchange-worker-#25843%grid-0%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:15:04] : [Step 4/5] [2021-11-19 21:15:04,098][INFO ][exchange-worker-#25966%grid-1%][GridCacheProcessor] Started cache [name=encrypted, id=1613773252, dataRegionName=default, mode=PARTITIONED, atomicity=ATOMIC, backups=0, mvcc=false] [21:15:04] : [Step 4/5] [2021-11-19 21:15:04,099][INFO ][exchange-worker-#25966%grid-1%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], waitTime=0ms, futInfo=NA, mode=DISTRIBUTED] [21:15:04] : [Step 4/5] [2021-11-19 21:15:04,103][INFO ][exchange-worker-#25843%grid-0%][GridCacheProcessor] Started cache [name=encrypted, id=1613773252, dataRegionName=default, mode=PARTITIONED, atomicity=ATOMIC, backups=0, mvcc=false] [21:15:04] : [Step 4/5] [2021-11-19 21:15:04,104][INFO ][exchange-worker-#25843%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], waitTime=0ms, futInfo=NA, mode=DISTRIBUTED] [21:15:04] : [Step 4/5] [2021-11-19 21:15:04,105][INFO ][exchange-worker-#25843%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partitions release latch: ServerLatch [permits=0, pendingAcks=HashSet [], super=CompletableLatch [id=CompletableLatchUid [id=exchange, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2]]]] [21:15:04] : [Step 4/5] [2021-11-19 21:15:04,105][INFO ][exchange-worker-#25966%grid-1%][GridDhtPartitionsExchangeFuture] Finished waiting for partitions release latch: ClientLatch [coordinator=TcpDiscoveryNode [id=0061f6c1-e5b0-456b-b001-a59f68b46000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345703836, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], ackSent=true, super=CompletableLatch [id=CompletableLatchUid [id=exchange, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2]]]] [21:15:04] : [Step 4/5] [2021-11-19 21:15:04,105][INFO ][exchange-worker-#25843%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:15:04] : [Step 4/5] [2021-11-19 21:15:04,106][INFO ][exchange-worker-#25966%grid-1%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:15:04] : [Step 4/5] [2021-11-19 21:15:04,107][INFO ][exchange-worker-#25843%grid-0%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], crd=true] [21:15:04] : [Step 4/5] [2021-11-19 21:15:04,109][INFO ][exchange-worker-#25966%grid-1%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], crd=false] [21:15:04] : [Step 4/5] [2021-11-19 21:15:04,110][INFO ][sys-#25817%grid-0%][GridDhtPartitionsExchangeFuture] Coordinator received single message [ver=AffinityTopologyVersion [topVer=2, minorTopVer=2], node=10170880-e32c-4da6-9d06-465492fc0001, allReceived=true] [21:15:04] : [Step 4/5] [2021-11-19 21:15:04,110][INFO ][sys-#25817%grid-0%][GridDhtPartitionsExchangeFuture] finishExchangeOnCoordinator [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2]] [21:15:04] : [Step 4/5] [2021-11-19 21:15:04,112][INFO ][sys-#25817%grid-0%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], err=null, rebalanced=true, wasRebalanced=true] [21:15:04] : [Step 4/5] [2021-11-19 21:15:04,112][INFO ][sys-#25956%grid-1%][GridDhtPartitionsExchangeFuture] Received full message, will finish exchange [node=0061f6c1-e5b0-456b-b001-a59f68b46000, resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2]] [21:15:04] : [Step 4/5] [2021-11-19 21:15:04,113][INFO ][sys-#25817%grid-0%][GridCacheProcessor] Finish proxy initialization, cacheName=encrypted, localNodeId=0061f6c1-e5b0-456b-b001-a59f68b46000 [21:15:04] : [Step 4/5] [2021-11-19 21:15:04,114][INFO ][sys-#25956%grid-1%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], err=null, rebalanced=true, wasRebalanced=true] [21:15:04] : [Step 4/5] [2021-11-19 21:15:04,114][INFO ][exchange-worker-#25843%grid-0%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=2, minorTopVer=2], force=false, evt=DISCOVERY_CUSTOM_EVT, node=0061f6c1-e5b0-456b-b001-a59f68b46000] [21:15:04] : [Step 4/5] [2021-11-19 21:15:04,114][INFO ][sys-#25817%grid-0%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=0061f6c1-e5b0-456b-b001-a59f68b46000, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=0061f6c1-e5b0-456b-b001-a59f68b46000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345704086, loc=true, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2]] [21:15:04] : [Step 4/5] [2021-11-19 21:15:04,114][INFO ][sys-#25956%grid-1%][GridCacheProcessor] Finish proxy initialization, cacheName=encrypted, localNodeId=10170880-e32c-4da6-9d06-465492fc0001 [21:15:04] : [Step 4/5] [2021-11-19 21:15:04,116][INFO ][sys-#25817%grid-0%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (6 ms), stage="Update caches registry" (0 ms), stage="Start caches" (10 ms), stage="Affinity initialization on cache group start" (0 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Wait partitions release latch [latch=exchange]" (0 ms), stage="Wait partitions release [latch=exchange]" (1 ms), stage="Restore partition states" (0 ms), stage="After states restored callback" (0 ms), stage="WAL history reservation" (0 ms), stage="Waiting for all single messages" (2 ms), stage="Affinity recalculation (crd)" (0 ms), stage="Collect update counters and create affinity messages" (0 ms), stage="Assign partitions states" (0 ms), stage="Validate partitions states" (0 ms), stage="Apply update counters" (0 ms), stage="Full message preparing" (1 ms), stage="Full message sending" (0 ms), stage="Exchange done" (4 ms), stage="Total time" (24 ms)] [21:15:04] : [Step 4/5] [2021-11-19 21:15:04,117][INFO ][exchange-worker-#25966%grid-1%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=2, minorTopVer=2], force=false, evt=DISCOVERY_CUSTOM_EVT, node=0061f6c1-e5b0-456b-b001-a59f68b46000] [21:15:04] : [Step 4/5] [2021-11-19 21:15:04,117][INFO ][sys-#25956%grid-1%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=10170880-e32c-4da6-9d06-465492fc0001, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=0061f6c1-e5b0-456b-b001-a59f68b46000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345703836, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2]] [21:15:04] : [Step 4/5] [2021-11-19 21:15:04,119][INFO ][sys-#25817%grid-0%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], stage="Affinity initialization on cache group start [grp=encrypted]" (0 ms) (parent=Affinity initialization on cache group start), stage="Restore partition states [grp=ignite-sys-cache]" (0 ms) (parent=Restore partition states), stage="Restore partition states [grp=encrypted]" (0 ms) (parent=Restore partition states)] [21:15:04] : [Step 4/5] [2021-11-19 21:15:04,121][INFO ][sys-#25956%grid-1%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], stage="Waiting in exchange queue" (2 ms), stage="Exchange parameters initialization" (2 ms), stage="Update caches registry" (0 ms), stage="Start caches" (7 ms), stage="Affinity initialization on cache group start" (0 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Wait partitions release latch [latch=exchange]" (6 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Restore partition states" (0 ms), stage="After states restored callback" (0 ms), stage="WAL history reservation" (0 ms), stage="Waiting for Full message" (3 ms), stage="Affinity recalculation" (0 ms), stage="Full map updating" (0 ms), stage="Exchange done" (6 ms), stage="Total time" (26 ms)] [21:15:04] : [Step 4/5] [2021-11-19 21:15:04,123][INFO ][sys-#25956%grid-1%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], stage="Affinity initialization on cache group start [grp=encrypted]" (0 ms) (parent=Affinity initialization on cache group start), stage="Restore partition states [grp=ignite-sys-cache]" (0 ms) (parent=Restore partition states), stage="Restore partition states [grp=encrypted]" (0 ms) (parent=Restore partition states)] [21:15:04] : [Step 4/5] [2021-11-19 21:15:04,143][INFO ][db-checkpoint-thread-#25982%grid-1%][Checkpointer] Checkpoint started [checkpointId=e1975210-641d-40b1-9912-2e2e3d00a83b, startPtr=WALPointer [idx=0, fileOff=86681, len=1963], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=57ms, writeCheckpointEntryDuration=28ms, splitAndSortCpPagesDuration=1ms, pages=18, reason='node started'] [21:15:04] : [Step 4/5] [2021-11-19 21:15:04,143][INFO ][db-checkpoint-thread-#25977%grid-0%][Checkpointer] Checkpoint started [checkpointId=513fc8ea-6383-4f73-b7e6-5974257048db, startPtr=WALPointer [idx=0, fileOff=86681, len=1963], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=1ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=62ms, writeCheckpointEntryDuration=28ms, splitAndSortCpPagesDuration=0ms, pages=18, reason='node started'] [21:15:04] : [Step 4/5] [2021-11-19 21:15:04,190][INFO ][db-checkpoint-thread-#25977%grid-0%][Checkpointer] Checkpoint finished [cpId=513fc8ea-6383-4f73-b7e6-5974257048db, pages=18, markPos=WALPointer [idx=0, fileOff=86681, len=1963], walSegmentsCovered=[], markDuration=92ms, pagesWrite=1ms, fsync=45ms, total=139ms] [21:15:04] : [Step 4/5] [2021-11-19 21:15:04,190][INFO ][db-checkpoint-thread-#25982%grid-1%][Checkpointer] Checkpoint finished [cpId=e1975210-641d-40b1-9912-2e2e3d00a83b, pages=18, markPos=WALPointer [idx=0, fileOff=86681, len=1963], walSegmentsCovered=[], markDuration=86ms, pagesWrite=5ms, fsync=42ms, total=134ms] [21:15:04] : [Step 4/5] [2021-11-19 21:15:04,398][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10170880-e32c-4da6-9d06-465492fc0001, grp=1613773252] [21:15:04] : [Step 4/5] [2021-11-19 21:15:04,399][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=0061f6c1-e5b0-456b-b001-a59f68b46000, grp=1613773252] [21:15:04] : [Step 4/5] [2021-11-19 21:15:04,403][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][root] >>> Stopping grid [name=grid-1, id=10170880-e32c-4da6-9d06-465492fc0001] [21:15:04] : [Step 4/5] [2021-11-19 21:15:04,584][INFO ][db-checkpoint-thread-#25982%grid-1%][Checkpointer] Checkpoint started [checkpointId=e799f340-16ee-4457-87b0-306922d72c59, startPtr=WALPointer [idx=0, fileOff=181254, len=2048], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=109ms, writeCheckpointEntryDuration=67ms, splitAndSortCpPagesDuration=0ms, pages=60, reason='timeout'] [21:15:09] : [Step 4/5] [2021-11-19 21:15:09,591][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][TestTcpDiscoverySpi] No verification for local node leave has been received from coordinator (will stop node anyway). [21:15:09]W: [org.apache.ignite:ignite-core] [2021-11-19 21:15:09,593][WARN ][tcp-disco-sock-reader-[0061f6c1 127.0.0.1:48915]-#1364%grid-1%-#25962%grid-1%][TestTcpDiscoverySpi] Failed to shutdown socket [21:15:09]W: [org.apache.ignite:ignite-core] java.net.SocketException: Socket is closed [21:15:09]W: [org.apache.ignite:ignite-core] at java.net.Socket.shutdownOutput(Socket.java:1568) [21:15:09]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.close(IgniteUtils.java:4247) [21:15:09]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.discovery.tcp.ServerImpl$SocketReader.body(ServerImpl.java:7370) [21:15:09]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.IgniteSpiThread.run(IgniteSpiThread.java:58) [21:15:09] : [Step 4/5] [2021-11-19 21:15:09,664][INFO ][tcp-disco-sock-reader-[0061f6c1 127.0.0.1:48915]-#1364%grid-1%-#25962%grid-1%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:48915, rmtPort=48915, rmtNodeId=0061f6c1-e5b0-456b-b001-a59f68b46000] [21:15:09] : [Step 4/5] [2021-11-19 21:15:09,666][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Stopped cache [cacheName=ignite-sys-cache] [21:15:09] : [Step 4/5] [2021-11-19 21:15:09,666][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Stopped cache [cacheName=encrypted] [21:15:09]W: [org.apache.ignite:ignite-core] [2021-11-19 21:15:09,667][WARN ][tcp-disco-msg-worker-[10170880 127.0.0.1:47501 crd]-#1355%grid-0%-#25839%grid-0%][TestTcpDiscoverySpi] Failed to send message to next node [msg=TcpDiscoveryDiscardMessage [msgId=8a53e593d71-0061f6c1-e5b0-456b-b001-a59f68b46000, customMsgDiscard=true, super=TcpDiscoveryAbstractMessage [sndNodeId=null, id=3d53e593d71-0061f6c1-e5b0-456b-b001-a59f68b46000, verifierNodeId=0061f6c1-e5b0-456b-b001-a59f68b46000, topVer=0, pendingIdx=0, failedNodes=null, isClient=false]], next=TcpDiscoveryNode [id=10170880-e32c-4da6-9d06-465492fc0001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637345703801, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], errMsg=Failed to send message to next node [msg=TcpDiscoveryDiscardMessage [msgId=8a53e593d71-0061f6c1-e5b0-456b-b001-a59f68b46000, customMsgDiscard=true, super=TcpDiscoveryAbstractMessage [sndNodeId=null, id=3d53e593d71-0061f6c1-e5b0-456b-b001-a59f68b46000, verifierNodeId=0061f6c1-e5b0-456b-b001-a59f68b46000, topVer=0, pendingIdx=0, failedNodes=null, isClient=false]], next=ClusterNode [id=10170880-e32c-4da6-9d06-465492fc0001, order=2, addr=[127.0.0.1], daemon=false]]] [21:15:09]W: [org.apache.ignite:ignite-core] [2021-11-19 21:15:09,669][WARN ][tcp-disco-msg-worker-[10170880 127.0.0.1:47501 crd]-#1355%grid-0%-#25839%grid-0%][TestTcpDiscoverySpi] Local node has detected failed nodes and started cluster-wide procedure. To speed up failure detection please see 'Failure Detection' section under javadoc for 'TcpDiscoverySpi' [21:15:09]W: [org.apache.ignite:ignite-core] [2021-11-19 21:15:09,671][WARN ][disco-event-worker-#25842%grid-0%][GridDiscoveryManager] Node FAILED: TcpDiscoveryNode [id=10170880-e32c-4da6-9d06-465492fc0001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637345703801, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false] [21:15:09] : [Step 4/5] [2021-11-19 21:15:09,672][INFO ][disco-event-worker-#25842%grid-0%][GridDiscoveryManager] Topology snapshot [ver=3, locNode=0061f6c1, servers=1, clients=0, state=ACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=0061f6c1-e5b0-456b-b001-a59f68b46000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:15:09] : [Step 4/5] [2021-11-19 21:15:09,673][INFO ][disco-event-worker-#25842%grid-0%][GridDiscoveryManager] ^-- Baseline [id=0, size=2, online=1, offline=1] [21:15:09]W: [org.apache.ignite:ignite-core] [2021-11-19 21:15:09,673][WARN ][grid-nio-worker-tcp-comm-0-#25781%TestRecordingCommunicationSpi%][TestRecordingCommunicationSpi] Failed to shutdown socket [21:15:09]W: [org.apache.ignite:ignite-core] java.nio.channels.ClosedChannelException [21:15:09]W: [org.apache.ignite:ignite-core] at sun.nio.ch.SocketChannelImpl.shutdownOutput(SocketChannelImpl.java:795) [21:15:09]W: [org.apache.ignite:ignite-core] at sun.nio.ch.SocketAdaptor.shutdownOutput(SocketAdaptor.java:407) [21:15:09]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.close(IgniteUtils.java:4247) [21:15:09] : [Step 4/5] [2021-11-19 21:15:09,675][INFO ][disco-notifier-worker-#25838%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=1] [21:15:09]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.closeKey(GridNioServer.java:2784) [21:15:09]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.close(GridNioServer.java:2835) [21:15:09]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.close(GridNioServer.java:2794) [21:15:09]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.bodyInternal(GridNioServer.java:2157) [21:15:09]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.body(GridNioServer.java:1910) [21:15:09]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:125) [21:15:09] : [Step 4/5] [2021-11-19 21:15:09,675][INFO ][exchange-worker-#25843%grid-0%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], crd=true, evt=NODE_FAILED, evtNode=10170880-e32c-4da6-9d06-465492fc0001, customEvt=null, allowMerge=false, exchangeFreeSwitch=true] [21:15:09]W: [org.apache.ignite:ignite-core] at java.lang.Thread.run(Thread.java:748) [21:15:09] : [Step 4/5] [2021-11-19 21:15:09,676][INFO ][reencrypt-#26000%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:15:09] : [Step 4/5] [2021-11-19 21:15:09,677][INFO ][exchange-worker-#25843%grid-0%][GridAffinityAssignmentCache] Local node affinity assignment distribution is not ideal [cache=encrypted, expectedPrimary=8.00, actualPrimary=3, expectedBackups=0.00, actualBackups=0, warningThreshold=50.00%] [21:15:09] : [Step 4/5] [2021-11-19 21:15:09,677][INFO ][exchange-worker-#25843%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:15:09] : [Step 4/5] [2021-11-19 21:15:09,678][INFO ][exchange-worker-#25843%grid-0%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], err=null, rebalanced=true, wasRebalanced=true] [21:15:09]W: [org.apache.ignite:ignite-core] [2021-11-19 21:15:09,679][WARN ][exchange-worker-#25843%grid-0%][GridDhtPartitionTopologyImpl] Detected lost partitions [grp=encrypted, parts=[0, 2, 4, 6-7], topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0]] [21:15:09] : [Step 4/5] [2021-11-19 21:15:09,681][INFO ][exchange-worker-#25843%grid-0%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=0061f6c1-e5b0-456b-b001-a59f68b46000, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], evt=NODE_FAILED, evtNode=TcpDiscoveryNode [id=10170880-e32c-4da6-9d06-465492fc0001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637345703801, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0]] [21:15:09] : [Step 4/5] [2021-11-19 21:15:09,682][INFO ][exchange-worker-#25843%grid-0%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (1 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="After states restored callback" (0 ms), stage="WAL history reservation" (0 ms), stage="Finalize update counters" (0 ms), stage="Detect lost partitions" (1 ms), stage="Exchange done" (2 ms), stage="Total time" (4 ms)] [21:15:09] : [Step 4/5] [2021-11-19 21:15:09,683][INFO ][exchange-worker-#25843%grid-0%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], stage="Affinity initialization (exchange-free switch on fully-rebalanced topology) [grp=ignite-sys-cache]" (0 ms) (parent=Determine exchange type), stage="Affinity initialization (exchange-free switch on fully-rebalanced topology) [grp=encrypted]" (0 ms) (parent=Determine exchange type)] [21:15:09] : [Step 4/5] [2021-11-19 21:15:09,684][INFO ][exchange-worker-#25843%grid-0%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], crd=true] [21:15:09] : [Step 4/5] [2021-11-19 21:15:09,685][INFO ][exchange-worker-#25843%grid-0%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=3, minorTopVer=0], force=false, evt=NODE_FAILED, node=10170880-e32c-4da6-9d06-465492fc0001] [21:15:09] : [Step 4/5] [2021-11-19 21:15:09,743][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][FilePageStoreManager] Cleanup cache stores [total=4, left=0, cleanFiles=false] [21:15:09] : [Step 4/5] [2021-11-19 21:15:09,745][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][GridDeploymentLocalStore] Removed undeployed class: GridDeployment [ts=1637345704065, depMode=SHARED, clsLdr=IsolatedClassLoader{roleName='test'}, clsLdrId=5d43e593d71-10170880-e32c-4da6-9d06-465492fc0001, userVer=0, loc=true, sampleClsName=org.apache.ignite.internal.processors.cache.distributed.dht.preloader.IgniteDhtPartitionCountersMap2, pendingUndeploy=false, undeployed=true, usage=0] [21:15:09] : [Step 4/5] [2021-11-19 21:15:09,756][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] [21:15:09] : [Step 4/5] [21:15:09] : [Step 4/5] >>> +------------------------------------------------------+ [21:15:09] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV stopped OK [21:15:09] : [Step 4/5] >>> +------------------------------------------------------+ [21:15:09] : [Step 4/5] >>> Ignite instance name: grid-1 [21:15:09] : [Step 4/5] >>> Grid uptime: 00:00:05.832 [21:15:09] : [Step 4/5] [21:15:09] : [Step 4/5] [21:15:09] : [Step 4/5] [2021-11-19 21:15:09,757][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=0061f6c1-e5b0-456b-b001-a59f68b46000, grp=1613773252] [21:15:09] : [Step 4/5] [2021-11-19 21:15:09,760][INFO ][db-checkpoint-thread-#25977%grid-0%][Checkpointer] Checkpoint started [checkpointId=86b3c21f-e60d-4659-bb65-a4c1ef5be9b8, startPtr=WALPointer [idx=0, fileOff=158524, len=2010], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=0ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=0ms, pages=42, reason='test'] [21:15:09] : [Step 4/5] [2021-11-19 21:15:09,811][INFO ][db-checkpoint-thread-#25977%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:15:09] : [Step 4/5] [2021-11-19 21:15:09,811][INFO ][db-checkpoint-thread-#25977%grid-0%][Checkpointer] Checkpoint finished [cpId=86b3c21f-e60d-4659-bb65-a4c1ef5be9b8, pages=42, markPos=WALPointer [idx=0, fileOff=158524, len=2010], walSegmentsCovered=[], markDuration=3ms, pagesWrite=2ms, fsync=48ms, total=53ms] [21:15:09]W: [org.apache.ignite:ignite-core] [2021-11-19 21:15:09,817][WARN ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][G] Ignite work directory is not provided, automatically resolved to: /opt/buildagent/work/7bc1c54bc719b67c/work [21:15:09] : [Step 4/5] [2021-11-19 21:15:09,818][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] [21:15:09] : [Step 4/5] [21:15:09] : [Step 4/5] >>> __________ ________________ [21:15:09] : [Step 4/5] >>> / _/ ___/ |/ / _/_ __/ __/ [21:15:09] : [Step 4/5] >>> _/ // (7 7 // / / / / _/ [21:15:09] : [Step 4/5] >>> /___/\___/_/|_/___/ /_/ /___/ [21:15:09] : [Step 4/5] >>> [21:15:09] : [Step 4/5] >>> ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:15:09] : [Step 4/5] >>> 2021 Copyright(C) Apache Software Foundation [21:15:09] : [Step 4/5] >>> [21:15:09] : [Step 4/5] >>> Ignite documentation: http://ignite.apache.org [21:15:09] : [Step 4/5] [21:15:09] : [Step 4/5] [2021-11-19 21:15:09,819][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] Config URL: n/a [21:15:09] : [Step 4/5] [2021-11-19 21:15:09,819][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] IgniteConfiguration [igniteInstanceName=grid-1, pubPoolSize=24, svcPoolSize=24, callbackPoolSize=24, stripedPoolSize=24, sysPoolSize=24, mgmtPoolSize=4, dataStreamerPoolSize=24, utilityCachePoolSize=24, utilityCacheKeepAliveTime=60000, p2pPoolSize=2, qryPoolSize=24, buildIdxPoolSize=4, igniteHome=/opt/buildagent/work/7bc1c54bc719b67c, igniteWorkDir=/opt/buildagent/work/7bc1c54bc719b67c/work, mbeanSrv=com.sun.jmx.mbeanserver.JmxMBeanServer@6fe85038, nodeId=10418dd0-2319-4ea6-b44f-f023219dd001, marsh=BinaryMarshaller [], marshLocJobs=false, daemon=false, p2pEnabled=true, netTimeout=10000, netCompressionLevel=1, sndRetryDelay=1000, sndRetryCnt=3, metricsHistSize=10000, metricsUpdateFreq=1000, metricsExpTime=9223372036854775807, discoSpi=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=0, ackTimeout=0, marsh=null, reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], segPlc=STOP, segResolveAttempts=2, waitForSegOnStart=true, allResolversPassReq=true, segChkFreq=10000, commSpi=TcpCommunicationSpi [connectGate=org.apache.ignite.spi.communication.tcp.internal.ConnectGateway@1d236dc4, ctxInitLatch=java.util.concurrent.CountDownLatch@53bda5d6[Count = 1], stopping=false, clientPool=null, nioSrvWrapper=null, stateProvider=null], evtSpi=MemoryEventStorageSpi [expireAgeMs=9223372036854775807, expireCnt=10000, filter=null], colSpi=NoopCollisionSpi [], deploySpi=LocalDeploymentSpi [], indexingSpi=org.apache.ignite.spi.indexing.noop.NoopIndexingSpi@51f69810, addrRslvr=null, encryptionSpi=org.apache.ignite.spi.encryption.keystore.KeystoreEncryptionSpi@26ef9b88, tracingSpi=org.apache.ignite.spi.tracing.NoopTracingSpi@4fe2ed40, clientMode=false, rebalanceThreadPoolSize=4, rebalanceTimeout=10000, rebalanceBatchesPrefetchCnt=3, rebalanceThrottle=0, rebalanceBatchSize=524288, txCfg=TransactionConfiguration [txSerEnabled=false, dfltIsolation=REPEATABLE_READ, dfltConcurrency=PESSIMISTIC, dfltTxTimeout=0, txTimeoutOnPartitionMapExchange=0, deadlockTimeout=10000, pessimisticTxLogSize=0, pessimisticTxLogLinger=10000, tmLookupClsName=null, txManagerFactory=null, useJtaSync=false], cacheSanityCheckEnabled=true, discoStartupDelay=60000, deployMode=SHARED, p2pMissedCacheSize=100, locHost=127.0.0.1, timeSrvPortBase=31100, timeSrvPortRange=100, failureDetectionTimeout=10000, sysWorkerBlockedTimeout=null, clientFailureDetectionTimeout=10000, metricsLogFreq=0, connectorCfg=null, odbcCfg=null, warmupClos=null, atomicCfg=AtomicConfiguration [seqReserveSize=1000, cacheMode=PARTITIONED, backups=1, aff=null, grpName=null], classLdr=null, sslCtxFactory=null, platformCfg=null, binaryCfg=null, memCfg=null, pstCfg=null, dsCfg=DataStorageConfiguration [sysRegionInitSize=41943040, sysRegionMaxSize=104857600, pageSize=4096, concLvl=0, dfltDataRegConf=DataRegionConfiguration [name=default, maxSize=104857600, initSize=268435456, swapPath=null, pageEvictionMode=DISABLED, pageReplacementMode=CLOCK, evictionThreshold=0.9, emptyPagesPoolSize=100, metricsEnabled=false, metricsSubIntervalCount=5, metricsRateTimeInterval=60000, persistenceEnabled=true, checkpointPageBufSize=0, lazyMemoryAllocation=true, warmUpCfg=null], dataRegions=null, storagePath=null, checkpointFreq=30000, lockWaitTime=10000, checkpointThreads=4, checkpointWriteOrder=SEQUENTIAL, walHistSize=20, maxWalArchiveSize=20971520, walSegments=10, walSegmentSize=1048576, walPath=db/wal, walArchivePath=db/wal/archive, cdcWalPath=db/wal/cdc, cdcEnabled=false, metricsEnabled=false, walMode=LOG_ONLY, walTlbSize=131072, walBuffSize=0, walFlushFreq=2000, walFsyncDelay=1000, walRecordIterBuffSize=67108864, alwaysWriteFullPages=false, fileIOFactory=org.apache.ignite.internal.processors.cache.persistence.file.AsyncFileIOFactory@4d24b3b8, metricsSubIntervalCnt=5, metricsRateTimeInterval=60000, walAutoArchiveAfterInactivity=-1, walForceArchiveTimeout=-1, writeThrottlingEnabled=false, walCompactionEnabled=false, walCompactionLevel=1, checkpointReadLockTimeout=null, walPageCompression=DISABLED, walPageCompressionLevel=null, dfltWarmUpCfg=null, encCfg=org.apache.ignite.configuration.EncryptionConfiguration@38bb72d0, defragmentationThreadPoolSize=4, minWalArchiveSize=-1], snapshotPath=snapshots, activeOnStart=true, activeOnStartPropSetFlag=false, autoActivation=true, autoActivationPropSetFlag=false, clusterStateOnStart=null, sqlConnCfg=null, cliConnCfg=ClientConnectorConfiguration [host=null, port=10800, portRange=100, sockSndBufSize=0, sockRcvBufSize=0, tcpNoDelay=true, maxOpenCursorsPerConn=128, threadPoolSize=24, selectorCnt=12, idleTimeout=0, handshakeTimeout=10000, jdbcEnabled=true, odbcEnabled=true, thinCliEnabled=true, sslEnabled=false, useIgniteSslCtxFactory=true, sslClientAuth=false, sslCtxFactory=null, thinCliCfg=ThinClientConfiguration [maxActiveTxPerConn=100, maxActiveComputeTasksPerConn=0]], mvccVacuumThreadCnt=2, mvccVacuumFreq=5000, authEnabled=false, failureHnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]], commFailureRslvr=null, sqlCfg=SqlConfiguration [longQryWarnTimeout=3000, dfltQryTimeout=0, sqlQryHistSize=1000, validationEnabled=false], asyncContinuationExecutor=null] [21:15:09] : [Step 4/5] [2021-11-19 21:15:09,829][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] Daemon mode: off [21:15:09] : [Step 4/5] [2021-11-19 21:15:09,829][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] OS: Linux 4.15.0-151-generic amd64 [21:15:09] : [Step 4/5] [2021-11-19 21:15:09,829][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] OS user: teamcity [21:15:09] : [Step 4/5] [2021-11-19 21:15:09,830][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] PID: 16724 [21:15:09] : [Step 4/5] [2021-11-19 21:15:09,830][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] Language runtime: Java Platform API Specification ver. 1.8 [21:15:09] : [Step 4/5] [2021-11-19 21:15:09,831][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] VM information: Java(TM) SE Runtime Environment 1.8.0_261-b12 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 25.261-b12 [21:15:09] : [Step 4/5] [2021-11-19 21:15:09,831][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] VM total memory: 1.9GB [21:15:09] : [Step 4/5] [2021-11-19 21:15:09,831][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] Remote Management [restart: off, REST: off, JMX (remote: off)] [21:15:09] : [Step 4/5] [2021-11-19 21:15:09,832][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] Logger: GridTestLog4jLogger [quiet=false, config=null] [21:15:09] : [Step 4/5] [2021-11-19 21:15:09,832][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] IGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c [21:15:09] : [Step 4/5] [2021-11-19 21:15:09,832][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] VM arguments: [-DIGNITE_DUMP_THREADS_ON_FAILURE=false, -DMono=/usr/bin/mono-sgen, -DMono4.0_x64=/usr/lib/mono/4.0, -DMono4.5_x64=/usr/lib/mono/4.5, -DMonoVersion=6.12.0.90, -DSKIP_BUILD=false, -Dagent.home.dir=/opt/buildagent, -Dagent.name=aitc-lin02_03, -Dagent.ownPort=9090, -Dagent.work.dir=/opt/buildagent/work, -Dbuild.number=95, -Dbuild.vcs.number=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.1=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.GitHubApacheIgnite=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dclassworlds.conf=/opt/buildagent/temp/buildTmp/teamcity.m2.conf, -Dcom.jetbrains.maven.watcher.report.file=/opt/buildagent/temp/buildTmp/maven-build-info.xml, -Djava.io.tmpdir=/opt/buildagent/temp/buildTmp, -Dmaven.home=/opt/buildagent/tools/maven3_6, -Dmaven.multiModuleProjectDirectory=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.agent.cpuBenchmark=457, -Dteamcity.agent.dotnet.agent_url=http://localhost:9090/RPC2, -Dteamcity.agent.dotnet.build_id=6278078, -Dteamcity.auth.password=*******, -Dteamcity.auth.userId=TeamCityBuildId=6278078, -Dteamcity.build.changedFiles.file=/opt/buildagent/temp/buildTmp/changedFiles6342607772318147725.txt, -Dteamcity.build.checkoutDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.build.id=6278078, -Dteamcity.build.properties.file=/opt/buildagent/temp/buildTmp/teamcity.build5164517880467851002.properties, -Dteamcity.build.tempDir=/opt/buildagent/temp/buildTmp, -Dteamcity.build.workingDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.buildConfName=Basic 3, -Dteamcity.buildType.id=IgniteTests24Java8_Basic3, -Dteamcity.configuration.properties.file=/opt/buildagent/temp/buildTmp/teamcity.config5591980786735343870.properties, -Dteamcity.maven.userSettings.path=/opt/buildagent/temp/buildTmp/maven_settings_585072866407032347.xml, -Dteamcity.maven.watcher.home=/opt/buildagent/plugins/mavenPlugin/maven-watcher-jdk16, -Dteamcity.projectName=Ignite Tests 2.x (JDK 8/11), -Dteamcity.runner.properties.file=/opt/buildagent/temp/buildTmp/teamcity.runner9098465561618137420.properties, -Dteamcity.tests.recentlyFailedTests.file=/opt/buildagent/temp/buildTmp/testsToRunFirst3891775683130404069.txt, -Dteamcity.version=2021.2 (build 99542), -ea, -Xms2g, -Xmx2g, -XX:+HeapDumpOnOutOfMemoryError, -DIGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_TEST_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_UPDATE_NOTIFIER=false, -DIGNITE_NO_DISCO_ORDER=true, -DIGNITE_PERFORMANCE_SUGGESTIONS_DISABLED=true, -Djava.net.preferIPv4Stack=true, -DTEST_SCALE_FACTOR=1.0, -DIGNITE_TEST_PROP_LOG4J_FILE=log4j-tc-test.xml, -DIGNITE_QUIET=false, -DIGNITE_MARSHAL_BUFFERS_RECHECK=1000, -Dmaven.repo.local=/opt/buildagent/.m2/repository] [21:15:09] : [Step 4/5] [2021-11-19 21:15:09,837][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] System cache's DataRegion size is configured to 40 MB. Use DataStorageConfiguration.systemRegionInitialSize property to change the setting. [21:15:09] : [Step 4/5] [2021-11-19 21:15:09,838][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] Configured caches [in 'sysMemPlc' dataRegion: ['ignite-sys-cache']] [21:15:09]W: [org.apache.ignite:ignite-core] [2021-11-19 21:15:09,838][WARN ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] Peer class loading is enabled (disable it in production for performance and deployment consistency reasons) [21:15:09] : [Step 4/5] [2021-11-19 21:15:09,838][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] 3-rd party licenses can be found at: /opt/buildagent/work/7bc1c54bc719b67c/libs/licenses [21:15:09] : [Step 4/5] [2021-11-19 21:15:09,843][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] Configured plugins: [21:15:09] : [Step 4/5] [2021-11-19 21:15:09,843][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- StanByClusterTestProvider 1.0 [21:15:09] : [Step 4/5] [2021-11-19 21:15:09,843][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:15:09] : [Step 4/5] [2021-11-19 21:15:09,843][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] [21:15:09] : [Step 4/5] [2021-11-19 21:15:09,844][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- PageMemory tracker plugin 1.0 [21:15:09] : [Step 4/5] [2021-11-19 21:15:09,845][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:15:09] : [Step 4/5] [2021-11-19 21:15:09,845][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] [21:15:09] : [Step 4/5] [2021-11-19 21:15:09,846][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- TestDistibutedConfigurationPlugin 1.0 [21:15:09] : [Step 4/5] [2021-11-19 21:15:09,846][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:15:09] : [Step 4/5] [2021-11-19 21:15:09,846][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] [21:15:09] : [Step 4/5] [2021-11-19 21:15:09,846][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- NodeValidationPluginProvider 1.0 [21:15:09] : [Step 4/5] [2021-11-19 21:15:09,847][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:15:09] : [Step 4/5] [2021-11-19 21:15:09,847][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] [21:15:09] : [Step 4/5] [2021-11-19 21:15:09,847][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][FailureProcessor] Configured failure handler: [hnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]]] [21:15:10] : [Step 4/5] [2021-11-19 21:15:10,045][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][TestRecordingCommunicationSpi] Successfully bound communication NIO server to TCP port [port=47101, locHost=/127.0.0.1, selectorsCnt=12, selectorSpins=0, pairedConn=false] [21:15:10]W: [org.apache.ignite:ignite-core] [2021-11-19 21:15:10,045][WARN ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][TestRecordingCommunicationSpi] Message queue limit is set to 0 which may lead to potential OOMEs when running cache operations in FULL_ASYNC or PRIMARY_SYNC modes due to message queues growth on sender and receiver sides. [21:15:10] : [Step 4/5] [2021-11-19 21:15:10,058][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][GridCollisionManager] Collision resolution is disabled (all jobs will be activated upon arrival). [21:15:10] : [Step 4/5] [2021-11-19 21:15:10,059][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] Security status [authentication=off, sandbox=off, tls/ssl=off] [21:15:10] : [Step 4/5] [2021-11-19 21:15:10,117][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:15:10] : [Step 4/5] [2021-11-19 21:15:10,220][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][MaintenanceProcessor] Resolved store directory for node persistent data: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1 [21:15:10] : [Step 4/5] [2021-11-19 21:15:10,222][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][CacheObjectBinaryProcessorImpl] Resolved directory for serialized binary metadata: /opt/buildagent/work/7bc1c54bc719b67c/work/db/binary_meta/grid_1 [21:15:10] : [Step 4/5] [2021-11-19 21:15:10,232][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1 [21:15:10] : [Step 4/5] [2021-11-19 21:15:10,233][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][FileWriteAheadLogManager] Resolved write ahead log work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1 [21:15:10] : [Step 4/5] [2021-11-19 21:15:10,234][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][FileWriteAheadLogManager] Resolved write ahead log archive directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1 [21:15:10] : [Step 4/5] [2021-11-19 21:15:10,237][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000005.wal [21:15:10] : [Step 4/5] [2021-11-19 21:15:10,237][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000006.wal [21:15:10] : [Step 4/5] [2021-11-19 21:15:10,238][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000008.wal [21:15:10] : [Step 4/5] [2021-11-19 21:15:10,238][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000004.wal [21:15:10] : [Step 4/5] [2021-11-19 21:15:10,239][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000003.wal [21:15:10] : [Step 4/5] [2021-11-19 21:15:10,239][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000002.wal [21:15:10] : [Step 4/5] [2021-11-19 21:15:10,240][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000007.wal [21:15:10] : [Step 4/5] [2021-11-19 21:15:10,241][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000001.wal [21:15:10] : [Step 4/5] [2021-11-19 21:15:10,241][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000009.wal [21:15:10] : [Step 4/5] [2021-11-19 21:15:10,242][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][FileHandleManagerImpl] Initialized write-ahead log manager [mode=LOG_ONLY] [21:15:10] : [Step 4/5] [2021-11-19 21:15:10,252][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Configured data regions initialized successfully [total=5] [21:15:10] : [Step 4/5] [2021-11-19 21:15:10,290][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][IgniteSnapshotManager] Resolved snapshot work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/snapshots [21:15:10] : [Step 4/5] [2021-11-19 21:15:10,290][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][IgniteSnapshotManager] Resolved temp directory for snapshot creation: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1/snp [21:15:10] : [Step 4/5] [2021-11-19 21:15:10,292][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][ClientListenerProcessor] Client connector processor has started on TCP port 10801 [21:15:10] : [Step 4/5] [2021-11-19 21:15:10,298][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] Non-loopback local IPs: 172.17.0.4 [21:15:10] : [Step 4/5] [2021-11-19 21:15:10,298][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] Enabled local MACs: 0242AC110004 [21:15:10] : [Step 4/5] [2021-11-19 21:15:10,300][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=/opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1/cp/1637345704407-e799f340-16ee-4457-87b0-306922d72c59-START.bin, endMarker=/opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1/cp/1637345704056-e1975210-641d-40b1-9912-2e2e3d00a83b-END.bin] [21:15:10] : [Step 4/5] [2021-11-19 21:15:10,302][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:15:10] : [Step 4/5] [2021-11-19 21:15:10,302][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=86681, len=1963], lastMarked=WALPointer [idx=0, fileOff=181254, len=2048], lastCheckpointId=e799f340-16ee-4457-87b0-306922d72c59] [21:15:10] : [Step 4/5] [2021-11-19 21:15:10,306][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Found last checkpoint marker [cpId=e799f340-16ee-4457-87b0-306922d72c59, pos=WALPointer [idx=0, fileOff=181254, len=2048]] [21:15:10] : [Step 4/5] [2021-11-19 21:15:10,309][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Applying lost metastore updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=181254, len=2048], lastCheckpointId=e799f340-16ee-4457-87b0-306922d72c59] [21:15:10] : [Step 4/5] [2021-11-19 21:15:10,312][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=0 ms] [21:15:10] : [Step 4/5] [2021-11-19 21:15:10,312][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Restoring partition state for local groups. [21:15:10] : [Step 4/5] [2021-11-19 21:15:10,313][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=0, partitionsProcessed=0, time=0ms] [21:15:10] : [Step 4/5] [2021-11-19 21:15:10,325][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][GridClusterStateProcessor] Restoring history for BaselineTopology[id=0] [21:15:10] : [Step 4/5] [2021-11-19 21:15:10,333][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][ClusterProcessor] Cluster ID and tag has been read from metastorage: ClusterIdAndTag [id=75323fd9-934f-4dbd-a543-7321879bb66e, tag=friendly_mirzakhani] [21:15:10] : [Step 4/5] [2021-11-19 21:15:10,333][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][IgniteClusterImpl] Shutdown policy was updated [oldVal=null, newVal=null] [21:15:10] : [Step 4/5] [2021-11-19 21:15:10,333][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustEnabled' was changed from 'null' to 'false' [21:15:10] : [Step 4/5] [2021-11-19 21:15:10,334][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustTimeout' was changed from 'null' to '300000' [21:15:10] : [Step 4/5] [2021-11-19 21:15:10,334][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][IgniteTxManager] Transactions parameter 'txOwnerDumpRequestsAllowed' was changed from 'null' to 'true' [21:15:10] : [Step 4/5] [2021-11-19 21:15:10,334][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][IgniteTxManager] Transactions parameter 'longOperationsDumpTimeout' was changed from 'null' to '60000' [21:15:10] : [Step 4/5] [2021-11-19 21:15:10,335][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpThreshold' was changed from 'null' to '0' [21:15:10] : [Step 4/5] [2021-11-19 21:15:10,336][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][IgniteTxManager] Transactions parameter 'transactionTimeDumpSamplesCoefficient' was changed from 'null' to '0.0' [21:15:10] : [Step 4/5] [2021-11-19 21:15:10,336][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpSamplesPerSecondLimit' was changed from 'null' to '5' [21:15:10] : [Step 4/5] [2021-11-19 21:15:10,337][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][IgniteTxManager] Transactions parameter 'collisionsDumpInterval' was changed from 'null' to '1000' [21:15:10] : [Step 4/5] [2021-11-19 21:15:10,337][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Historical rebalance WAL threshold changed [property=historical.rebalance.threshold, oldVal=null, newVal=500] [21:15:10] : [Step 4/5] [2021-11-19 21:15:10,338][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Checkpoint frequency deviation changed [oldVal=null, newVal=null] [21:15:10] : [Step 4/5] [2021-11-19 21:15:10,338][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][FilePageStoreManager] Cleanup cache stores [total=1, left=0, cleanFiles=false] [21:15:10] : [Step 4/5] [2021-11-19 21:15:10,340][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:15:10] : [Step 4/5] [2021-11-19 21:15:10,341][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:15:10] : [Step 4/5] [2021-11-19 21:15:10,342][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:15:10] : [Step 4/5] [2021-11-19 21:15:10,343][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Data Regions Started: 5 [21:15:10] : [Step 4/5] [2021-11-19 21:15:10,343][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] ^-- sysMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:15:10] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:15:10] : [Step 4/5] ^-- default region [type=default, persistence=true, lazyAlloc=true, [21:15:10] : [Step 4/5] ... initCfg=100MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB, allocTotal=0MB] [21:15:10] : [Step 4/5] ^-- metastoreMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:15:10] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:15:10] : [Step 4/5] ^-- TxLog region [type=internal, persistence=true, lazyAlloc=false, [21:15:10] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:15:10] : [Step 4/5] ^-- volatileDsMemPlc region [type=user, persistence=false, lazyAlloc=true, [21:15:10] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB] [21:15:10] : [Step 4/5] ^-- Ignite persistence [used=0MB] [21:15:10] : [Step 4/5] [21:15:10] : [Step 4/5] [2021-11-19 21:15:10,345][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Starting binary memory restore for: [-2100569601, 1613773252] [21:15:10] : [Step 4/5] [2021-11-19 21:15:10,354][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=/opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1/cp/1637345704407-e799f340-16ee-4457-87b0-306922d72c59-START.bin, endMarker=/opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1/cp/1637345704056-e1975210-641d-40b1-9912-2e2e3d00a83b-END.bin] [21:15:10] : [Step 4/5] [2021-11-19 21:15:10,355][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=86681, len=1963], lastMarked=WALPointer [idx=0, fileOff=181254, len=2048], lastCheckpointId=e799f340-16ee-4457-87b0-306922d72c59] [21:15:10]W: [org.apache.ignite:ignite-core] [2021-11-19 21:15:10,356][WARN ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Ignite node stopped in the middle of checkpoint. Will restore memory state and finish checkpoint on node start. [21:15:10] : [Step 4/5] [2021-11-19 21:15:10,357][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:15:10] : [Step 4/5] [2021-11-19 21:15:10,362][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Found last checkpoint marker [cpId=e799f340-16ee-4457-87b0-306922d72c59, pos=WALPointer [idx=0, fileOff=181254, len=2048]] [21:15:10] : [Step 4/5] [2021-11-19 21:15:10,364][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Finished applying memory changes [changesApplied=217, time=0 ms] [21:15:10] : [Step 4/5] [2021-11-19 21:15:10,433][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][CheckpointWorkflow] Checkpoint finished [cpId=e799f340-16ee-4457-87b0-306922d72c59, pages=60, markPos=WALPointer [idx=0, fileOff=181254, len=2048], pagesWrite=4ms, fsync=50ms, total=54ms] [21:15:10] : [Step 4/5] [2021-11-19 21:15:10,434][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Binary memory state restored at node startup [restoredPtr=WALPointer [idx=0, fileOff=183302, len=0]] [21:15:10] : [Step 4/5] [2021-11-19 21:15:10,435][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000000.wal, offset=183302, ver=2] [21:15:10] : [Step 4/5] [2021-11-19 21:15:10,437][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Started cache in recovery mode [name=ignite-sys-cache, id=-2100569601, dataRegionName=sysMemPlc, mode=REPLICATED, atomicity=TRANSACTIONAL, backups=2147483647, mvcc=false] [21:15:10] : [Step 4/5] [2021-11-19 21:15:10,440][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Started cache in recovery mode [name=encrypted, id=1613773252, dataRegionName=default, mode=PARTITIONED, atomicity=ATOMIC, backups=0, mvcc=false] [21:15:10] : [Step 4/5] [2021-11-19 21:15:10,440][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Binary recovery performed in 95 ms. [21:15:10] : [Step 4/5] [2021-11-19 21:15:10,441][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=/opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1/cp/1637345704407-e799f340-16ee-4457-87b0-306922d72c59-START.bin, endMarker=/opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1/cp/1637345704407-e799f340-16ee-4457-87b0-306922d72c59-END.bin] [21:15:10] : [Step 4/5] [2021-11-19 21:15:10,441][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Applying lost cache updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=181254, len=2048], lastCheckpointId=e799f340-16ee-4457-87b0-306922d72c59] [21:15:10] : [Step 4/5] [2021-11-19 21:15:10,443][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=0 ms] [21:15:10] : [Step 4/5] [2021-11-19 21:15:10,444][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Restoring partition state for local groups. [21:15:10] : [Step 4/5] [2021-11-19 21:15:10,464][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=2, partitionsProcessed=108, time=20ms] [21:15:10] : [Step 4/5] [2021-11-19 21:15:10,467][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][TestTcpDiscoverySpi] Successfully bound to TCP port [port=47501, localHost=localhost/127.0.0.1, locNodeId=10418dd0-2319-4ea6-b44f-f023219dd001] [21:15:10] : [Step 4/5] [2021-11-19 21:15:10,469][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][GridEncryptionManager] Sending stored group keys to coordinator [grps=1613773252] [21:15:10] : [Step 4/5] [2021-11-19 21:15:10,476][INFO ][tcp-disco-srvr-[:47500]-#1356%grid-0%-#25840%grid-0%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=35627] [21:15:10] : [Step 4/5] [2021-11-19 21:15:10,476][INFO ][tcp-disco-srvr-[:47500]-#1356%grid-0%-#25840%grid-0%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=35627] [21:15:10] : [Step 4/5] [2021-11-19 21:15:10,477][INFO ][tcp-disco-sock-reader-[]-#1371%grid-0%-#26116%grid-0%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:35627, rmtPort=35627] [21:15:10] : [Step 4/5] [2021-11-19 21:15:10,478][INFO ][tcp-disco-sock-reader-[10418dd0 127.0.0.1:35627]-#1371%grid-0%-#26116%grid-0%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=10418dd0-2319-4ea6-b44f-f023219dd001, rmtAddr=/127.0.0.1:35627] [21:15:10] : [Step 4/5] [2021-11-19 21:15:10,482][INFO ][tcp-disco-srvr-[:47501]-#1370%grid-1%-#26115%grid-1%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=47471] [21:15:10] : [Step 4/5] [2021-11-19 21:15:10,482][INFO ][tcp-disco-srvr-[:47501]-#1370%grid-1%-#26115%grid-1%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=47471] [21:15:10] : [Step 4/5] [2021-11-19 21:15:10,484][INFO ][tcp-disco-sock-reader-[]-#1372%grid-1%-#26117%grid-1%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:47471, rmtPort=47471] [21:15:10] : [Step 4/5] [2021-11-19 21:15:10,485][INFO ][tcp-disco-sock-reader-[]-#1372%grid-1%-#26117%grid-1%][TestTcpDiscoverySpi] Received ping request from the remote node [rmtNodeId=0061f6c1-e5b0-456b-b001-a59f68b46000, rmtAddr=/127.0.0.1:47471, rmtPort=47471] [21:15:10] : [Step 4/5] [2021-11-19 21:15:10,486][INFO ][tcp-disco-sock-reader-[]-#1372%grid-1%-#26117%grid-1%][TestTcpDiscoverySpi] Finished writing ping response [rmtNodeId=0061f6c1-e5b0-456b-b001-a59f68b46000, rmtAddr=/127.0.0.1:47471, rmtPort=47471] [21:15:10] : [Step 4/5] [2021-11-19 21:15:10,487][INFO ][tcp-disco-sock-reader-[]-#1372%grid-1%-#26117%grid-1%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:47471, rmtPort=47471, rmtNodeId=null] [21:15:10] : [Step 4/5] [2021-11-19 21:15:10,487][INFO ][tcp-disco-sock-reader-[10418dd0 127.0.0.1:35627]-#1371%grid-0%-#26116%grid-0%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:35627, rmtPort=35627, rmtNodeId=10418dd0-2319-4ea6-b44f-f023219dd001] [21:15:10] : [Step 4/5] [2021-11-19 21:15:10,500][INFO ][tcp-disco-msg-worker-[crd]-#1355%grid-0%-#25839%grid-0%][TestTcpDiscoverySpi] New next node [newNext=TcpDiscoveryNode [id=10418dd0-2319-4ea6-b44f-f023219dd001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=0, intOrder=3, lastExchangeTime=1637345710479, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false]] [21:15:10] : [Step 4/5] [2021-11-19 21:15:10,501][INFO ][tcp-disco-srvr-[:47501]-#1370%grid-1%-#26115%grid-1%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=37425] [21:15:10] : [Step 4/5] [2021-11-19 21:15:10,501][INFO ][tcp-disco-srvr-[:47501]-#1370%grid-1%-#26115%grid-1%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=37425] [21:15:10] : [Step 4/5] [2021-11-19 21:15:10,502][INFO ][tcp-disco-sock-reader-[]-#1373%grid-1%-#26118%grid-1%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:37425, rmtPort=37425] [21:15:10] : [Step 4/5] [2021-11-19 21:15:10,502][INFO ][tcp-disco-sock-reader-[0061f6c1 127.0.0.1:37425]-#1373%grid-1%-#26118%grid-1%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=0061f6c1-e5b0-456b-b001-a59f68b46000, rmtAddr=/127.0.0.1:37425] [21:15:10] : [Step 4/5] [2021-11-19 21:15:10,507][INFO ][tcp-disco-msg-worker-[]-#1369%grid-1%-#26114%grid-1%][TestTcpDiscoverySpi] New next node [newNext=TcpDiscoveryNode [id=0061f6c1-e5b0-456b-b001-a59f68b46000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345710499, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false]] [21:15:10] : [Step 4/5] [2021-11-19 21:15:10,508][INFO ][tcp-disco-srvr-[:47500]-#1356%grid-0%-#25840%grid-0%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=35423] [21:15:10] : [Step 4/5] [2021-11-19 21:15:10,509][INFO ][tcp-disco-srvr-[:47500]-#1356%grid-0%-#25840%grid-0%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=35423] [21:15:10] : [Step 4/5] [2021-11-19 21:15:10,509][INFO ][tcp-disco-sock-reader-[]-#1374%grid-0%-#26119%grid-0%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:35423, rmtPort=35423] [21:15:10] : [Step 4/5] [2021-11-19 21:15:10,510][INFO ][tcp-disco-sock-reader-[10418dd0 127.0.0.1:35423]-#1374%grid-0%-#26119%grid-0%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=10418dd0-2319-4ea6-b44f-f023219dd001, rmtAddr=/127.0.0.1:35423] [21:15:10] : [Step 4/5] [2021-11-19 21:15:10,514][INFO ][disco-event-worker-#25842%grid-0%][GridDiscoveryManager] Added new node to topology: TcpDiscoveryNode [id=10418dd0-2319-4ea6-b44f-f023219dd001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=4, intOrder=3, lastExchangeTime=1637345710479, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false] [21:15:10] : [Step 4/5] [2021-11-19 21:15:10,515][INFO ][disco-event-worker-#25842%grid-0%][GridDiscoveryManager] Topology snapshot [ver=4, locNode=0061f6c1, servers=2, clients=0, state=ACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=0061f6c1-e5b0-456b-b001-a59f68b46000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=10418dd0-2319-4ea6-b44f-f023219dd001, consistentId=grid-1, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:15:10] : [Step 4/5] [2021-11-19 21:15:10,516][INFO ][disco-event-worker-#25842%grid-0%][GridDiscoveryManager] ^-- Baseline [id=0, size=2, online=2, offline=0] [21:15:10] : [Step 4/5] [2021-11-19 21:15:10,517][INFO ][exchange-worker-#25843%grid-0%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], crd=true, evt=NODE_JOINED, evtNode=10418dd0-2319-4ea6-b44f-f023219dd001, customEvt=null, allowMerge=true, exchangeFreeSwitch=false] [21:15:10] : [Step 4/5] [2021-11-19 21:15:10,517][INFO ][exchange-worker-#25843%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], waitTime=0ms, futInfo=NA, mode=DISTRIBUTED] [21:15:10] : [Step 4/5] [2021-11-19 21:15:10,518][INFO ][exchange-worker-#25843%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partitions release latch: ServerLatch [permits=0, pendingAcks=HashSet [], super=CompletableLatch [id=CompletableLatchUid [id=exchange, topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0]]]] [21:15:10] : [Step 4/5] [2021-11-19 21:15:10,518][INFO ][exchange-worker-#25843%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:15:10] : [Step 4/5] [2021-11-19 21:15:10,519][INFO ][tcp-disco-msg-worker-[0061f6c1 127.0.0.1:47500]-#1369%grid-1%-#26114%grid-1%][GridEncryptionManager] Store group key received from coordinator [grp=1613773252, keyId=1] [21:15:10] : [Step 4/5] [2021-11-19 21:15:10,519][INFO ][exchange-worker-#25843%grid-0%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], crd=true] [21:15:10] : [Step 4/5] [2021-11-19 21:15:10,520][INFO ][disco-notifier-worker-#26113%grid-1%][MvccProcessorImpl] Assigned mvcc coordinator [crd=MvccCoordinator [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], nodeId=0061f6c1-e5b0-456b-b001-a59f68b46000, ver=1637345703338, local=false, initialized=false]] [21:15:10] : [Step 4/5] [2021-11-19 21:15:10,522][INFO ][sys-#26104%grid-1%][ClusterProcessor] Writing cluster ID and tag to metastorage on ready for write ClusterIdAndTag [id=75323fd9-934f-4dbd-a543-7321879bb66e, tag=friendly_mirzakhani] [21:15:10] : [Step 4/5] [2021-11-19 21:15:10,540][INFO ][exchange-worker-#26122%grid-1%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], crd=false, evt=NODE_JOINED, evtNode=10418dd0-2319-4ea6-b44f-f023219dd001, customEvt=null, allowMerge=true, exchangeFreeSwitch=false] [21:15:10] : [Step 4/5] [2021-11-19 21:15:10,541][INFO ][exchange-worker-#26122%grid-1%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1 [21:15:10] : [Step 4/5] [2021-11-19 21:15:10,548][INFO ][exchange-worker-#26122%grid-1%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000000.wal, offset=183331, ver=2] [21:15:10] : [Step 4/5] [2021-11-19 21:15:10,552][INFO ][exchange-worker-#26122%grid-1%][GridClusterStateProcessor] Writing BaselineTopology[id=0] [21:15:10] : [Step 4/5] [2021-11-19 21:15:10,554][INFO ][exchange-worker-#26122%grid-1%][GridCacheDatabaseSharedManager] Finish recovery performed in 12 ms. [21:15:10] : [Step 4/5] [2021-11-19 21:15:10,555][INFO ][exchange-worker-#26122%grid-1%][msg] Components activation performed in 14 ms. [21:15:10] : [Step 4/5] [2021-11-19 21:15:10,556][INFO ][exchange-worker-#26122%grid-1%][GridCacheProcessor] Finished recovery for cache [cache=ignite-sys-cache, grp=ignite-sys-cache, startVer=AffinityTopologyVersion [topVer=4, minorTopVer=0]] [21:15:10] : [Step 4/5] [2021-11-19 21:15:10,556][INFO ][sys-#26109%grid-1%][GridCacheProcessor] Finished recovery for cache [cache=encrypted, grp=encrypted, startVer=AffinityTopologyVersion [topVer=4, minorTopVer=0]] [21:15:10] : [Step 4/5] [2021-11-19 21:15:10,556][INFO ][exchange-worker-#26122%grid-1%][GridCacheProcessor] Starting caches on local join performed in 0 ms. [21:15:10] : [Step 4/5] [2021-11-19 21:15:10,557][INFO ][exchange-worker-#26122%grid-1%][GridDhtPartitionsExchangeFuture] Skipped waiting for partitions release future (local node is joining) [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0]] [21:15:10] : [Step 4/5] [2021-11-19 21:15:10,564][INFO ][grid-nio-worker-tcp-comm-1-#25782%TestRecordingCommunicationSpi%][TestRecordingCommunicationSpi] Accepted incoming communication connection [locAddr=/127.0.0.1:47100, rmtAddr=/127.0.0.1:35558] [21:15:10] : [Step 4/5] [2021-11-19 21:15:10,566][INFO ][grid-nio-worker-tcp-comm-0-#26055%TestRecordingCommunicationSpi%][TestRecordingCommunicationSpi] Established outgoing communication connection [locAddr=/127.0.0.1:35558, rmtAddr=/127.0.0.1:47100] [21:15:10] : [Step 4/5] [2021-11-19 21:15:10,567][INFO ][exchange-worker-#26122%grid-1%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], crd=false] [21:15:10] : [Step 4/5] [2021-11-19 21:15:10,568][INFO ][sys-#25816%grid-0%][GridDhtPartitionsExchangeFuture] Coordinator received single message [ver=AffinityTopologyVersion [topVer=4, minorTopVer=0], node=10418dd0-2319-4ea6-b44f-f023219dd001, allReceived=true] [21:15:10] : [Step 4/5] [2021-11-19 21:15:10,568][INFO ][sys-#25816%grid-0%][GridDhtPartitionsExchangeFuture] Coordinator received all messages, try merge [ver=AffinityTopologyVersion [topVer=4, minorTopVer=0]] [21:15:10] : [Step 4/5] [2021-11-19 21:15:10,568][INFO ][sys-#25816%grid-0%][GridDhtPartitionsExchangeFuture] finishExchangeOnCoordinator [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=0]] [21:15:10] : [Step 4/5] [2021-11-19 21:15:10,571][INFO ][sys-#25816%grid-0%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], err=null, rebalanced=false, wasRebalanced=true] [21:15:10] : [Step 4/5] [2021-11-19 21:15:10,572][INFO ][sys-#25816%grid-0%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=0061f6c1-e5b0-456b-b001-a59f68b46000, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], evt=NODE_JOINED, evtNode=TcpDiscoveryNode [id=10418dd0-2319-4ea6-b44f-f023219dd001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=4, intOrder=3, lastExchangeTime=1637345710479, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=false, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0]] [21:15:10] : [Step 4/5] [2021-11-19 21:15:10,572][INFO ][exchange-worker-#25843%grid-0%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=4, minorTopVer=0], force=false, evt=NODE_JOINED, node=10418dd0-2319-4ea6-b44f-f023219dd001] [21:15:10] : [Step 4/5] [2021-11-19 21:15:10,573][INFO ][sys-#26093%grid-1%][GridDhtPartitionsExchangeFuture] Received full message, will finish exchange [node=0061f6c1-e5b0-456b-b001-a59f68b46000, resVer=AffinityTopologyVersion [topVer=4, minorTopVer=0]] [21:15:10] : [Step 4/5] [2021-11-19 21:15:10,573][INFO ][sys-#25816%grid-0%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (0 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Wait partitions release latch [latch=exchange]" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="After states restored callback" (0 ms), stage="WAL history reservation" (0 ms), stage="Waiting for all single messages" (49 ms), stage="Exchanges merge" (0 ms), stage="Affinity recalculation (crd)" (1 ms), stage="Collect update counters and create affinity messages" (0 ms), stage="Assign partitions states" (0 ms), stage="Validate partitions states" (0 ms), stage="Apply update counters" (0 ms), stage="Full message preparing" (0 ms), stage="Full message sending" (0 ms), stage="Exchange done" (1 ms), stage="Total time" (51 ms), Discovery lag=5 ms, Latest started node id=10418dd0-2319-4ea6-b44f-f023219dd001] [21:15:10] : [Step 4/5] [2021-11-19 21:15:10,577][INFO ][sys-#26093%grid-1%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], err=null, rebalanced=false, wasRebalanced=false] [21:15:10] : [Step 4/5] [2021-11-19 21:15:10,578][INFO ][sys-#25816%grid-0%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], stage="Affinity initialization (node join) [grp=ignite-sys-cache, crd=true]" (1 ms) (parent=Affinity recalculation (crd)), stage="Affinity initialization (node join) [grp=encrypted, crd=true]" (0 ms) (parent=Affinity recalculation (crd))] [21:15:10] : [Step 4/5] [2021-11-19 21:15:10,579][INFO ][sys-#26093%grid-1%][GridCacheProcessor] Finish proxy initialization, cacheName=ignite-sys-cache, localNodeId=10418dd0-2319-4ea6-b44f-f023219dd001 [21:15:10] : [Step 4/5] [2021-11-19 21:15:10,580][INFO ][sys-#26093%grid-1%][GridCacheProcessor] Finish proxy initialization, cacheName=encrypted, localNodeId=10418dd0-2319-4ea6-b44f-f023219dd001 [21:15:10] : [Step 4/5] [2021-11-19 21:15:10,580][INFO ][sys-#26093%grid-1%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=10418dd0-2319-4ea6-b44f-f023219dd001, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], evt=NODE_JOINED, evtNode=TcpDiscoveryNode [id=10418dd0-2319-4ea6-b44f-f023219dd001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=4, intOrder=3, lastExchangeTime=1637345710540, loc=true, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=false, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0]] [21:15:10] : [Step 4/5] [2021-11-19 21:15:10,581][INFO ][exchange-worker-#26122%grid-1%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=4, minorTopVer=0], force=false, evt=NODE_JOINED, node=10418dd0-2319-4ea6-b44f-f023219dd001] [21:15:10] : [Step 4/5] [2021-11-19 21:15:10,582][INFO ][sys-#26093%grid-1%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], stage="Waiting in exchange queue" (19 ms), stage="Exchange parameters initialization" (0 ms), stage="Components activation" (13 ms), stage="Determine exchange type" (1 ms), stage="Preloading notification" (0 ms), stage="Restore partition states" (0 ms), stage="After states restored callback" (1 ms), stage="WAL history reservation" (0 ms), stage="Waiting for Full message" (14 ms), stage="Affinity recalculation" (2 ms), stage="Full map updating" (1 ms), stage="Exchange done" (4 ms), stage="Total time" (55 ms)] [21:15:10] : [Step 4/5] [2021-11-19 21:15:10,584][INFO ][sys-#26093%grid-1%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], stage="Affinity fetch" (1 ms) (parent=Determine exchange type), stage="Restore partition states [grp=ignite-sys-cache]" (0 ms) (parent=Restore partition states), stage="Restore partition states [grp=encrypted]" (0 ms) (parent=Restore partition states), stage="Affinity initialization (local join) [grp=ignite-sys-cache]" (2 ms) (parent=Affinity recalculation), stage="Affinity initialization (local join) [grp=encrypted]" (2 ms) (parent=Affinity recalculation)] [21:15:10] : [Step 4/5] [2021-11-19 21:15:10,584][INFO ][exchange-worker-#25843%grid-0%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], crd=true, evt=DISCOVERY_CUSTOM_EVT, evtNode=0061f6c1-e5b0-456b-b001-a59f68b46000, customEvt=CacheAffinityChangeMessage [id=f363e593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], exchId=null, partsMsg=null, exchangeNeeded=true], allowMerge=false, exchangeFreeSwitch=false] [21:15:10] : [Step 4/5] [2021-11-19 21:15:10,586][INFO ][exchange-worker-#25843%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], waitTime=0ms, futInfo=NA, mode=DISTRIBUTED] [21:15:10] : [Step 4/5] [2021-11-19 21:15:10,593][INFO ][exchange-worker-#26122%grid-1%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], crd=false, evt=DISCOVERY_CUSTOM_EVT, evtNode=0061f6c1-e5b0-456b-b001-a59f68b46000, customEvt=CacheAffinityChangeMessage [id=f363e593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], exchId=null, partsMsg=null, exchangeNeeded=true], allowMerge=false, exchangeFreeSwitch=false] [21:15:10] : [Step 4/5] [2021-11-19 21:15:10,593][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] To start Console Management & Monitoring run ignitevisorcmd.{sh|bat} [21:15:10] : [Step 4/5] [2021-11-19 21:15:10,594][INFO ][exchange-worker-#26122%grid-1%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], waitTime=0ms, futInfo=NA, mode=DISTRIBUTED] [21:15:10] : [Step 4/5] [2021-11-19 21:15:10,593][INFO ][reencrypt-#26134%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:15:10] : [Step 4/5] [2021-11-19 21:15:10,594][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] [21:15:10] : [Step 4/5] [21:15:10] : [Step 4/5] >>> +-------------------------------------------+ [21:15:10] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:15:10] : [Step 4/5] >>> +-------------------------------------------+ [21:15:10] : [Step 4/5] >>> OS name: Linux 4.15.0-151-generic amd64 [21:15:10] : [Step 4/5] >>> CPU(s): 24 [21:15:10] : [Step 4/5] >>> Heap: 2.0GB [21:15:10] : [Step 4/5] >>> VM name: 16724@c4dfe9a430b2 [21:15:10] : [Step 4/5] >>> Ignite instance name: grid-1 [21:15:10] : [Step 4/5] >>> Local node [ID=10418DD0-2319-4EA6-B44F-F023219DD001, order=4, clientMode=false] [21:15:10] : [Step 4/5] >>> Local node addresses: [127.0.0.1] [21:15:10] : [Step 4/5] >>> Local ports: TCP:10801 TCP:47101 TCP:47501 [21:15:10] : [Step 4/5] [21:15:10] : [Step 4/5] [2021-11-19 21:15:10,595][INFO ][exchange-worker-#26122%grid-1%][GridDhtPartitionsExchangeFuture] Finished waiting for partitions release latch: ClientLatch [coordinator=TcpDiscoveryNode [id=0061f6c1-e5b0-456b-b001-a59f68b46000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345710499, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], ackSent=true, super=CompletableLatch [id=CompletableLatchUid [id=exchange, topVer=AffinityTopologyVersion [topVer=4, minorTopVer=1]]]] [21:15:10] : [Step 4/5] [2021-11-19 21:15:10,595][INFO ][exchange-worker-#25843%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partitions release latch: ServerLatch [permits=0, pendingAcks=HashSet [], super=CompletableLatch [id=CompletableLatchUid [id=exchange, topVer=AffinityTopologyVersion [topVer=4, minorTopVer=1]]]] [21:15:10] : [Step 4/5] [2021-11-19 21:15:10,597][INFO ][exchange-worker-#26122%grid-1%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:15:10] : [Step 4/5] [2021-11-19 21:15:10,596][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][GridDiscoveryManager] Topology snapshot [ver=4, locNode=10418dd0, servers=2, clients=0, state=ACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=0061f6c1-e5b0-456b-b001-a59f68b46000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=10418dd0-2319-4ea6-b44f-f023219dd001, consistentId=grid-1, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:15:10] : [Step 4/5] [2021-11-19 21:15:10,598][INFO ][exchange-worker-#26122%grid-1%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], crd=false] [21:15:10] : [Step 4/5] [2021-11-19 21:15:10,597][INFO ][exchange-worker-#25843%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:15:10] : [Step 4/5] [2021-11-19 21:15:10,599][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][GridDiscoveryManager] ^-- Baseline [id=0, size=2, online=2, offline=0] [21:15:10] : [Step 4/5] [2021-11-19 21:15:10,600][INFO ][exchange-worker-#25843%grid-0%][GridDhtPartitionsExchangeFuture] Coordinator received single message [ver=AffinityTopologyVersion [topVer=4, minorTopVer=1], node=10418dd0-2319-4ea6-b44f-f023219dd001, allReceived=true] [21:15:10] : [Step 4/5] [2021-11-19 21:15:10,600][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][G] Node started : [stage="Configure system pool" (0 ms),stage="Start managers" (403 ms),stage="Configure binary metadata" (2 ms),stage="Start processors" (73 ms),stage="Start 'StanByClusterTestProvider' plugin" (0 ms),stage="Start 'PageMemory tracker plugin' plugin" (0 ms),stage="Start 'TestDistibutedConfigurationPlugin' plugin" (0 ms),stage="Start 'NodeValidationPluginProvider' plugin" (0 ms),stage="Init metastore" (41 ms),stage="Init and start regions" (6 ms),stage="Restore binary memory" (95 ms),stage="Restore logical state" (24 ms),stage="Finish recovery" (0 ms),stage="Join topology" (54 ms),stage="Await transition" (4 ms),stage="Await exchange" (74 ms),stage="Total time" (776 ms)] [21:15:10] : [Step 4/5] [2021-11-19 21:15:10,600][INFO ][exchange-worker-#25843%grid-0%][GridDhtPartitionsExchangeFuture] finishExchangeOnCoordinator [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=1]] [21:15:10] : [Step 4/5] [2021-11-19 21:15:10,602][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][root] Node started with the following configuration [id=10418dd0-2319-4ea6-b44f-f023219dd001, marshaller=BinaryMarshaller [], discovery=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=5000, ackTimeout=5000, marsh=JdkMarshaller [clsFilter=org.apache.ignite.marshaller.MarshallerUtils$1@6ea1628a], reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], binaryCfg=null, lateAff=true] [21:15:10] : [Step 4/5] [2021-11-19 21:15:10,605][INFO ][exchange-worker-#25843%grid-0%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], err=null, rebalanced=true, wasRebalanced=false] [21:15:10] : [Step 4/5] [2021-11-19 21:15:10,605][INFO ][sys-#26104%grid-1%][GridDhtPartitionsExchangeFuture] Received full message, will finish exchange [node=0061f6c1-e5b0-456b-b001-a59f68b46000, resVer=AffinityTopologyVersion [topVer=4, minorTopVer=1]] [21:15:10] : [Step 4/5] [2021-11-19 21:15:10,605][INFO ][exchange-worker-#25843%grid-0%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=0061f6c1-e5b0-456b-b001-a59f68b46000, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=0061f6c1-e5b0-456b-b001-a59f68b46000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345710584, loc=true, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=4, minorTopVer=1]] [21:15:10] : [Step 4/5] [2021-11-19 21:15:10,606][INFO ][sys-#26104%grid-1%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], err=null, rebalanced=true, wasRebalanced=false] [21:15:10] : [Step 4/5] [2021-11-19 21:15:10,607][INFO ][exchange-worker-#25843%grid-0%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (1 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Wait partitions release latch [latch=exchange]" (10 ms), stage="Wait partitions release [latch=exchange]" (2 ms), stage="After states restored callback" (0 ms), stage="WAL history reservation" (0 ms), stage="Waiting for all single messages" (0 ms), stage="Affinity recalculation (crd)" (1 ms), stage="Collect update counters and create affinity messages" (0 ms), stage="Validate partitions states" (0 ms), stage="Apply update counters" (0 ms), stage="Full message preparing" (1 ms), stage="Full message sending" (0 ms), stage="Exchange done" (2 ms), stage="Total time" (17 ms), Discovery lag=8 ms, Latest started node id=10418dd0-2319-4ea6-b44f-f023219dd001] [21:15:10] : [Step 4/5] [2021-11-19 21:15:10,608][INFO ][exchange-worker-#26122%grid-1%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=4, minorTopVer=1], force=false, evt=DISCOVERY_CUSTOM_EVT, node=0061f6c1-e5b0-456b-b001-a59f68b46000] [21:15:10] : [Step 4/5] [2021-11-19 21:15:10,608][INFO ][sys-#26104%grid-1%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=10418dd0-2319-4ea6-b44f-f023219dd001, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=0061f6c1-e5b0-456b-b001-a59f68b46000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345710499, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=4, minorTopVer=1]] [21:15:10] : [Step 4/5] [2021-11-19 21:15:10,611][INFO ][exchange-worker-#26122%grid-1%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=2], crd=false, evt=DISCOVERY_CUSTOM_EVT, evtNode=10418dd0-2319-4ea6-b44f-f023219dd001, customEvt=DynamicCacheChangeBatch [id=0563e593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqs=ArrayList [DynamicCacheChangeRequest [cacheName=encrypted, hasCfg=false, nodeId=10418dd0-2319-4ea6-b44f-f023219dd001, clientStartOnly=false, stop=false, destroy=false, disabledAfterStart=false]], exchangeActions=ExchangeActions [startCaches=null, stopCaches=null, startGrps=[], stopGrps=[], resetParts=[encrypted], stateChangeRequest=null], startCaches=false], allowMerge=false, exchangeFreeSwitch=false] [21:15:10] : [Step 4/5] [2021-11-19 21:15:10,610][INFO ][exchange-worker-#25843%grid-0%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], stage="Affinity change by custom message [grp=ignite-sys-cache]" (0 ms) (parent=Determine exchange type)] [21:15:10] : [Step 4/5] [2021-11-19 21:15:10,614][INFO ][exchange-worker-#25843%grid-0%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], crd=true] [21:15:10] : [Step 4/5] [2021-11-19 21:15:10,614][INFO ][exchange-worker-#25843%grid-0%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=4, minorTopVer=1], force=false, evt=DISCOVERY_CUSTOM_EVT, node=0061f6c1-e5b0-456b-b001-a59f68b46000] [21:15:10] : [Step 4/5] [2021-11-19 21:15:10,615][INFO ][exchange-worker-#25843%grid-0%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=2], crd=true, evt=DISCOVERY_CUSTOM_EVT, evtNode=10418dd0-2319-4ea6-b44f-f023219dd001, customEvt=DynamicCacheChangeBatch [id=0563e593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqs=ArrayList [DynamicCacheChangeRequest [cacheName=encrypted, hasCfg=false, nodeId=10418dd0-2319-4ea6-b44f-f023219dd001, clientStartOnly=false, stop=false, destroy=false, disabledAfterStart=false]], exchangeActions=ExchangeActions [startCaches=null, stopCaches=null, startGrps=[], stopGrps=[], resetParts=[encrypted], stateChangeRequest=null], startCaches=false], allowMerge=false, exchangeFreeSwitch=false] [21:15:10] : [Step 4/5] [2021-11-19 21:15:10,612][INFO ][sys-#26104%grid-1%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (0 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Wait partitions release latch [latch=exchange]" (2 ms), stage="Wait partitions release [latch=exchange]" (1 ms), stage="After states restored callback" (0 ms), stage="WAL history reservation" (0 ms), stage="Waiting for Full message" (7 ms), stage="Affinity recalculation" (0 ms), stage="Full map updating" (0 ms), stage="Exchange done" (5 ms), stage="Total time" (15 ms)] [21:15:10] : [Step 4/5] [2021-11-19 21:15:10,614][INFO ][exchange-worker-#26122%grid-1%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=2], waitTime=0ms, futInfo=NA, mode=DISTRIBUTED] [21:15:10] : [Step 4/5] [2021-11-19 21:15:10,618][INFO ][sys-#26104%grid-1%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], stage="Affinity change by custom message [grp=ignite-sys-cache]" (0 ms) (parent=Determine exchange type)] [21:15:10] : [Step 4/5] [2021-11-19 21:15:10,619][INFO ][exchange-worker-#25843%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=2], waitTime=0ms, futInfo=NA, mode=DISTRIBUTED] [21:15:10] : [Step 4/5] [2021-11-19 21:15:10,620][INFO ][exchange-worker-#25843%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partitions release latch: ServerLatch [permits=0, pendingAcks=HashSet [], super=CompletableLatch [id=CompletableLatchUid [id=exchange, topVer=AffinityTopologyVersion [topVer=4, minorTopVer=2]]]] [21:15:10] : [Step 4/5] [2021-11-19 21:15:10,621][INFO ][exchange-worker-#25843%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=2], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:15:10] : [Step 4/5] [2021-11-19 21:15:10,621][INFO ][exchange-worker-#25843%grid-0%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=2], crd=true] [21:15:10] : [Step 4/5] [2021-11-19 21:15:10,624][INFO ][exchange-worker-#26122%grid-1%][GridDhtPartitionsExchangeFuture] Finished waiting for partitions release latch: ClientLatch [coordinator=TcpDiscoveryNode [id=0061f6c1-e5b0-456b-b001-a59f68b46000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345710499, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], ackSent=true, super=CompletableLatch [id=CompletableLatchUid [id=exchange, topVer=AffinityTopologyVersion [topVer=4, minorTopVer=2]]]] [21:15:10] : [Step 4/5] [2021-11-19 21:15:10,625][INFO ][exchange-worker-#26122%grid-1%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=2], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:15:10] : [Step 4/5] [2021-11-19 21:15:10,627][INFO ][exchange-worker-#26122%grid-1%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=2], crd=false] [21:15:10] : [Step 4/5] [2021-11-19 21:15:10,627][INFO ][sys-#25826%grid-0%][GridDhtPartitionsExchangeFuture] Coordinator received single message [ver=AffinityTopologyVersion [topVer=4, minorTopVer=2], node=10418dd0-2319-4ea6-b44f-f023219dd001, allReceived=true] [21:15:10] : [Step 4/5] [2021-11-19 21:15:10,628][INFO ][sys-#25826%grid-0%][GridDhtPartitionsExchangeFuture] finishExchangeOnCoordinator [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=2]] [21:15:10] : [Step 4/5] [2021-11-19 21:15:10,632][INFO ][sys-#25826%grid-0%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=4, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=2], err=null, rebalanced=true, wasRebalanced=true] [21:15:10] : [Step 4/5] [2021-11-19 21:15:10,719][INFO ][sys-#25826%grid-0%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=0061f6c1-e5b0-456b-b001-a59f68b46000, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=2], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=10418dd0-2319-4ea6-b44f-f023219dd001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=4, intOrder=3, lastExchangeTime=1637345710479, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=4, minorTopVer=2]] [21:15:10] : [Step 4/5] [2021-11-19 21:15:10,633][INFO ][sys-#26095%grid-1%][GridDhtPartitionsExchangeFuture] Received full message, will finish exchange [node=0061f6c1-e5b0-456b-b001-a59f68b46000, resVer=AffinityTopologyVersion [topVer=4, minorTopVer=2]] [21:15:10] : [Step 4/5] [2021-11-19 21:15:10,721][INFO ][sys-#26095%grid-1%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=4, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=2], err=null, rebalanced=true, wasRebalanced=true] [21:15:10] : [Step 4/5] [2021-11-19 21:15:10,722][INFO ][sys-#26095%grid-1%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=10418dd0-2319-4ea6-b44f-f023219dd001, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=2], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=10418dd0-2319-4ea6-b44f-f023219dd001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=4, intOrder=3, lastExchangeTime=1637345710604, loc=true, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=4, minorTopVer=2]] [21:15:10] : [Step 4/5] [2021-11-19 21:15:10,723][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][root] awaitPartitionMapExchange finished [21:15:10] : [Step 4/5] [2021-11-19 21:15:10,724][INFO ][exchange-worker-#26122%grid-1%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=4, minorTopVer=2], force=false, evt=DISCOVERY_CUSTOM_EVT, node=10418dd0-2319-4ea6-b44f-f023219dd001] [21:15:10] : [Step 4/5] [2021-11-19 21:15:10,724][INFO ][sys-#25826%grid-0%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=4, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=2], stage="Waiting in exchange queue" (8 ms), stage="Exchange parameters initialization" (1 ms), stage="Update caches registry" (2 ms), stage="Start caches" (0 ms), stage="Affinity initialization on cache group start" (0 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Wait partitions release latch [latch=exchange]" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="After states restored callback" (0 ms), stage="WAL history reservation" (0 ms), stage="Waiting for all single messages" (6 ms), stage="Affinity recalculation (crd)" (0 ms), stage="Collect update counters and create affinity messages" (0 ms), stage="Assign partitions states" (0 ms), stage="Validate partitions states" (0 ms), stage="Ideal affinity diff calculation (enforced)" (0 ms), stage="Apply update counters" (0 ms), stage="Full message preparing" (3 ms), stage="Full message sending" (0 ms), stage="Exchange done" (91 ms), stage="Total time" (111 ms), Discovery lag=1 ms, Latest started node id=10418dd0-2319-4ea6-b44f-f023219dd001] [21:15:10] : [Step 4/5] [2021-11-19 21:15:10,724][INFO ][sys-#26095%grid-1%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=4, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=2], stage="Waiting in exchange queue" (3 ms), stage="Exchange parameters initialization" (2 ms), stage="Update caches registry" (0 ms), stage="Start caches" (0 ms), stage="Affinity initialization on cache group start" (0 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (4 ms), stage="Wait partitions release latch [latch=exchange]" (6 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="After states restored callback" (0 ms), stage="WAL history reservation" (0 ms), stage="Waiting for Full message" (7 ms), stage="Affinity recalculation" (88 ms), stage="Full map updating" (0 ms), stage="Exchange done" (2 ms), stage="Total time" (112 ms)] [21:15:10] : [Step 4/5] [2021-11-19 21:15:10,727][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10418dd0-2319-4ea6-b44f-f023219dd001, grp=1613773252] [21:15:10] : [Step 4/5] [2021-11-19 21:15:10,724][INFO ][exchange-worker-#25843%grid-0%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=4, minorTopVer=2], force=false, evt=DISCOVERY_CUSTOM_EVT, node=10418dd0-2319-4ea6-b44f-f023219dd001] [21:15:10] : [Step 4/5] [2021-11-19 21:15:10,729][INFO ][sys-#25826%grid-0%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=4, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=2], stage="Affinity centralized initialization (crd) [grp=ignite-sys-cache, crd=true]" (0 ms) (parent=Determine exchange type), stage="Affinity centralized initialization (crd) [grp=encrypted, crd=true]" (0 ms) (parent=Determine exchange type), stage="Affinity recalculation (partitions availability) [grp=ignite-sys-cache]" (0 ms) (parent=Ideal affinity diff calculation (enforced)), stage="Affinity recalculation (partitions availability) [grp=encrypted]" (0 ms) (parent=Ideal affinity diff calculation (enforced))] [21:15:10] : [Step 4/5] [2021-11-19 21:15:10,729][INFO ][sys-#26095%grid-1%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=4, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=2], stage="Affinity centralized initialization (crd) [grp=ignite-sys-cache, crd=false]" (0 ms) (parent=Determine exchange type), stage="Affinity centralized initialization (crd) [grp=encrypted, crd=false]" (0 ms) (parent=Determine exchange type), stage="Affinity applying from full message [grp=encrypted]" (88 ms) (parent=Affinity recalculation), stage="Affinity applying from full message [grp=ignite-sys-cache]" (0 ms) (parent=Affinity recalculation)] [21:15:10] : [Step 4/5] [2021-11-19 21:15:10,797][INFO ][db-checkpoint-thread-#26127%grid-1%][Checkpointer] Checkpoint started [checkpointId=0252e3fc-5246-4d96-82e4-ebd4d6fd493a, startPtr=WALPointer [idx=0, fileOff=302759, len=2064], checkpointBeforeLockTime=2ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=73ms, writeCheckpointEntryDuration=165ms, splitAndSortCpPagesDuration=0ms, pages=23, reason='node started'] [21:15:10] : [Step 4/5] [2021-11-19 21:15:10,816][INFO ][db-checkpoint-thread-#26127%grid-1%][Checkpointer] Checkpoint finished [cpId=0252e3fc-5246-4d96-82e4-ebd4d6fd493a, pages=23, markPos=WALPointer [idx=0, fileOff=302759, len=2064], walSegmentsCovered=[], markDuration=239ms, pagesWrite=6ms, fsync=12ms, total=259ms] [21:15:10] : [Step 4/5] [2021-11-19 21:15:10,829][INFO ][db-checkpoint-thread-#26127%grid-1%][Checkpointer] Checkpoint started [checkpointId=c15371d6-c9fb-4552-a8c7-5199b65ddcef, startPtr=WALPointer [idx=0, fileOff=533998, len=2048], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=6ms, writeCheckpointEntryDuration=5ms, splitAndSortCpPagesDuration=0ms, pages=55, reason='test'] [21:15:10] : [Step 4/5] [2021-11-19 21:15:10,840][INFO ][db-checkpoint-thread-#26127%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:15:10] : [Step 4/5] [2021-11-19 21:15:10,840][INFO ][db-checkpoint-thread-#26127%grid-1%][Checkpointer] Checkpoint finished [cpId=c15371d6-c9fb-4552-a8c7-5199b65ddcef, pages=55, markPos=WALPointer [idx=0, fileOff=533998, len=2048], walSegmentsCovered=[], markDuration=13ms, pagesWrite=4ms, fsync=6ms, total=24ms] [21:15:10] : [Step 4/5] [2021-11-19 21:15:10,841][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=0061f6c1-e5b0-456b-b001-a59f68b46000, grp=1613773252] [21:15:10] : [Step 4/5] [2021-11-19 21:15:10,848][INFO ][disco-notifier-worker-#25838%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=2] [21:15:10] : [Step 4/5] [2021-11-19 21:15:10,848][INFO ][disco-notifier-worker-#26113%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=2] [21:15:10] : [Step 4/5] [2021-11-19 21:15:10,848][INFO ][reencrypt-#26000%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:15:10] : [Step 4/5] [2021-11-19 21:15:10,848][INFO ][reencrypt-#26134%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:15:11] : [Step 4/5] [2021-11-19 21:15:11,050][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=10418dd0-2319-4ea6-b44f-f023219dd001, grp=1613773252] [21:15:11] : [Step 4/5] [2021-11-19 21:15:11,296][INFO ][db-checkpoint-thread-#26127%grid-1%][Checkpointer] Checkpoint started [checkpointId=483e819e-40c2-4359-b590-6812e95d1386, startPtr=WALPointer [idx=0, fileOff=811250, len=2048], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=23ms, writeCheckpointEntryDuration=222ms, splitAndSortCpPagesDuration=0ms, pages=66, reason='test'] [21:15:11] : [Step 4/5] [2021-11-19 21:15:11,407][INFO ][db-checkpoint-thread-#26127%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:15:11] : [Step 4/5] [2021-11-19 21:15:11,408][INFO ][db-checkpoint-thread-#26127%grid-1%][Checkpointer] Checkpoint finished [cpId=483e819e-40c2-4359-b590-6812e95d1386, pages=66, markPos=WALPointer [idx=0, fileOff=811250, len=2048], walSegmentsCovered=[], markDuration=246ms, pagesWrite=3ms, fsync=108ms, total=358ms] [21:15:11] : [Step 4/5] [2021-11-19 21:15:11,408][INFO ][test-runner-#25726%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=0061f6c1-e5b0-456b-b001-a59f68b46000, grp=1613773252] [21:15:11] : [Step 4/5] [2021-11-19 21:15:11,416][INFO ][db-checkpoint-thread-#25977%grid-0%][Checkpointer] Checkpoint started [checkpointId=54de87d3-5fb3-47d7-bbb8-0dcb972718ec, startPtr=WALPointer [idx=0, fileOff=336029, len=2010], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=6ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=0ms, pages=43, reason='test'] [21:15:11] : [Step 4/5] [2021-11-19 21:15:11,435][INFO ][db-checkpoint-thread-#25977%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:15:11] : [Step 4/5] [2021-11-19 21:15:11,435][INFO ][db-checkpoint-thread-#25977%grid-0%][Checkpointer] Checkpoint finished [cpId=54de87d3-5fb3-47d7-bbb8-0dcb972718ec, pages=43, markPos=WALPointer [idx=0, fileOff=336029, len=2010], walSegmentsCovered=[], markDuration=8ms, pagesWrite=2ms, fsync=16ms, total=26ms] [21:15:11] : [Step 4/5] [21:15:11] >>> Stopping test: CacheGroupKeyChangeTest#testNodeFailsBeforePrepare in 8580 ms <<< [21:15:11] : [Step 4/5] [2021-11-19 21:15:11,436][INFO ][main][root] >>> Stopping test: CacheGroupKeyChangeTest#testNodeFailsBeforePrepare in 8580 ms <<< [21:15:11] : [Step 4/5] [21:15:11] >>> Heap: 282 MB used / 1932 MB commited / 1932 MB max <<< [21:15:11] : [Step 4/5] [2021-11-19 21:15:11,436][INFO ][main][root] >>> Heap: 282 MB used / 1932 MB commited / 1932 MB max <<< [21:15:11] : [Step 4/5] [21:15:11] >>> Non-Heap: 172 MB used / 189 MB commited / 0 MB max <<< [21:15:11] : [Step 4/5] [2021-11-19 21:15:11,437][INFO ][main][root] >>> Non-Heap: 172 MB used / 189 MB commited / 0 MB max <<< [21:15:11] : [Step 4/5] [2021-11-19 21:15:11,437][INFO ][main][root] >>> Stopping grid [name=grid-1, id=10418dd0-2319-4ea6-b44f-f023219dd001] [21:15:11] : [Step 4/5] [2021-11-19 21:15:11,442][INFO ][db-checkpoint-thread-#26127%grid-1%][Checkpointer] Skipping checkpoint (no pages were modified) [checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, reason='timeout'] [21:15:11] : [Step 4/5] [2021-11-19 21:15:11,446][INFO ][tcp-disco-sock-reader-[0061f6c1 127.0.0.1:37425]-#1373%grid-1%-#26118%grid-1%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:37425, rmtPort=37425, rmtNodeId=0061f6c1-e5b0-456b-b001-a59f68b46000] [21:15:11] : [Step 4/5] [2021-11-19 21:15:11,447][INFO ][disco-event-worker-#25842%grid-0%][GridDiscoveryManager] Node left topology: TcpDiscoveryNode [id=10418dd0-2319-4ea6-b44f-f023219dd001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=4, intOrder=3, lastExchangeTime=1637345710479, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false] [21:15:11] : [Step 4/5] [2021-11-19 21:15:11,448][INFO ][main][GridCacheProcessor] Stopped cache [cacheName=encrypted] [21:15:11] : [Step 4/5] [2021-11-19 21:15:11,449][INFO ][main][GridCacheProcessor] Stopped cache [cacheName=ignite-sys-cache] [21:15:11] : [Step 4/5] [2021-11-19 21:15:11,449][INFO ][disco-event-worker-#25842%grid-0%][GridDiscoveryManager] Topology snapshot [ver=5, locNode=0061f6c1, servers=1, clients=0, state=ACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=0061f6c1-e5b0-456b-b001-a59f68b46000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:15:11] : [Step 4/5] [2021-11-19 21:15:11,450][INFO ][disco-event-worker-#25842%grid-0%][GridDiscoveryManager] ^-- Baseline [id=0, size=2, online=1, offline=1] [21:15:11] : [Step 4/5] [2021-11-19 21:15:11,452][INFO ][main][FilePageStoreManager] Cleanup cache stores [total=4, left=0, cleanFiles=false] [21:15:11] : [Step 4/5] [2021-11-19 21:15:11,452][INFO ][exchange-worker-#25843%grid-0%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], crd=true, evt=NODE_LEFT, evtNode=10418dd0-2319-4ea6-b44f-f023219dd001, customEvt=null, allowMerge=false, exchangeFreeSwitch=true] [21:15:11] : [Step 4/5] [2021-11-19 21:15:11,454][INFO ][main][GridDeploymentLocalStore] Removed undeployed class: GridDeployment [ts=1637345710570, depMode=SHARED, clsLdr=IsolatedClassLoader{roleName='test'}, clsLdrId=d363e593d71-10418dd0-2319-4ea6-b44f-f023219dd001, userVer=0, loc=true, sampleClsName=org.apache.ignite.internal.processors.cache.distributed.dht.preloader.GridDhtPartitionFullMap, pendingUndeploy=false, undeployed=true, usage=0] [21:15:11] : [Step 4/5] [2021-11-19 21:15:11,454][INFO ][exchange-worker-#25843%grid-0%][GridAffinityAssignmentCache] Local node affinity assignment distribution is not ideal [cache=encrypted, expectedPrimary=8.00, actualPrimary=3, expectedBackups=0.00, actualBackups=0, warningThreshold=50.00%] [21:15:11] : [Step 4/5] [2021-11-19 21:15:11,456][INFO ][exchange-worker-#25843%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:15:11] : [Step 4/5] [2021-11-19 21:15:11,458][INFO ][exchange-worker-#25843%grid-0%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], err=null, rebalanced=true, wasRebalanced=true] [21:15:11] : [Step 4/5] [2021-11-19 21:15:11,460][INFO ][main][IgniteKernal%grid-1] [21:15:11] : [Step 4/5] [21:15:11] : [Step 4/5] >>> +------------------------------------------------------+ [21:15:11] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV stopped OK [21:15:11] : [Step 4/5] >>> +------------------------------------------------------+ [21:15:11] : [Step 4/5] >>> Ignite instance name: grid-1 [21:15:11] : [Step 4/5] >>> Grid uptime: 00:00:00.871 [21:15:11] : [Step 4/5] [21:15:11] : [Step 4/5] [21:15:11] : [Step 4/5] [2021-11-19 21:15:11,461][INFO ][main][root] >>> Stopping grid [name=grid-0, id=0061f6c1-e5b0-456b-b001-a59f68b46000] [21:15:11]W: [org.apache.ignite:ignite-core] [2021-11-19 21:15:11,464][WARN ][sys-#25830%grid-0%][GridDhtPartitionTopologyImpl] Detected lost partitions [grp=encrypted, parts=[0, 2, 4, 6-7], topVer=AffinityTopologyVersion [topVer=5, minorTopVer=0]] [21:15:11] : [Step 4/5] [2021-11-19 21:15:11,464][INFO ][exchange-worker-#25843%grid-0%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=0061f6c1-e5b0-456b-b001-a59f68b46000, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], evt=NODE_LEFT, evtNode=TcpDiscoveryNode [id=10418dd0-2319-4ea6-b44f-f023219dd001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=4, intOrder=3, lastExchangeTime=1637345710479, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=5, minorTopVer=0]] [21:15:11] : [Step 4/5] [2021-11-19 21:15:11,465][INFO ][exchange-worker-#25843%grid-0%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (1 ms), stage="Determine exchange type" (2 ms), stage="Preloading notification" (0 ms), stage="After states restored callback" (0 ms), stage="WAL history reservation" (0 ms), stage="Finalize update counters" (0 ms), stage="Detect lost partitions" (6 ms), stage="Exchange done" (1 ms), stage="Total time" (10 ms)] [21:15:11] : [Step 4/5] [2021-11-19 21:15:11,466][INFO ][exchange-worker-#25843%grid-0%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], stage="Affinity initialization (exchange-free switch on fully-rebalanced topology) [grp=encrypted]" (2 ms) (parent=Determine exchange type), stage="Affinity initialization (exchange-free switch on fully-rebalanced topology) [grp=ignite-sys-cache]" (0 ms) (parent=Determine exchange type)] [21:15:11] : [Step 4/5] [2021-11-19 21:15:11,467][INFO ][exchange-worker-#25843%grid-0%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], crd=true] [21:15:11] : [Step 4/5] [2021-11-19 21:15:11,468][INFO ][exchange-worker-#25843%grid-0%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=5, minorTopVer=0], force=false, evt=NODE_LEFT, node=10418dd0-2319-4ea6-b44f-f023219dd001] [21:15:11] : [Step 4/5] [2021-11-19 21:15:11,474][INFO ][tcp-disco-sock-reader-[10170880 127.0.0.1:57059]-#1365%grid-0%-#25963%grid-0%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:57059, rmtPort=57059, rmtNodeId=10170880-e32c-4da6-9d06-465492fc0001] [21:15:11] : [Step 4/5] [2021-11-19 21:15:11,474][INFO ][tcp-disco-sock-reader-[10418dd0 127.0.0.1:35423]-#1374%grid-0%-#26119%grid-0%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:35423, rmtPort=35423, rmtNodeId=10418dd0-2319-4ea6-b44f-f023219dd001] [21:15:11] : [Step 4/5] [2021-11-19 21:15:11,481][INFO ][main][GridCacheProcessor] Stopped cache [cacheName=ignite-sys-cache] [21:15:11] : [Step 4/5] [2021-11-19 21:15:11,481][INFO ][main][GridCacheProcessor] Stopped cache [cacheName=encrypted] [21:15:11] : [Step 4/5] [2021-11-19 21:15:11,484][INFO ][main][FilePageStoreManager] Cleanup cache stores [total=4, left=0, cleanFiles=false] [21:15:11] : [Step 4/5] [2021-11-19 21:15:11,486][INFO ][main][GridDeploymentLocalStore] Removed undeployed class: GridDeployment [ts=1637345704055, depMode=SHARED, clsLdr=IsolatedClassLoader{roleName='test'}, clsLdrId=2d43e593d71-0061f6c1-e5b0-456b-b001-a59f68b46000, userVer=0, loc=true, sampleClsName=org.apache.ignite.internal.processors.cache.distributed.dht.preloader.GridDhtPartitionMap, pendingUndeploy=false, undeployed=true, usage=0] [21:15:11] : [Step 4/5] [2021-11-19 21:15:11,492][INFO ][main][IgniteKernal%grid-0] [21:15:11] : [Step 4/5] [21:15:11] : [Step 4/5] >>> +------------------------------------------------------+ [21:15:11] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV stopped OK [21:15:11] : [Step 4/5] >>> +------------------------------------------------------+ [21:15:11] : [Step 4/5] >>> Ignite instance name: grid-0 [21:15:11] : [Step 4/5] >>> Grid uptime: 00:00:08.105 [21:15:11] : [Step 4/5] [21:15:11] : [Step 4/5] [21:15:11] : [Step 4/5] [21:15:11] >>> Starting test: CacheGroupKeyChangeTest#testCacheStartOnClientDuringRotation <<< [21:15:11] : [Step 4/5] [2021-11-19 21:15:11,505][INFO ][main][root] >>> Starting test: CacheGroupKeyChangeTest#testCacheStartOnClientDuringRotation <<< [21:15:11] : [Step 4/5] [21:15:11] >>> Heap: 286 MB used / 1932 MB commited / 1932 MB max <<< [21:15:11] : [Step 4/5] [2021-11-19 21:15:11,505][INFO ][main][root] >>> Heap: 286 MB used / 1932 MB commited / 1932 MB max <<< [21:15:11] : [Step 4/5] [21:15:11] >>> Non-Heap: 172 MB used / 189 MB commited / 0 MB max <<< [21:15:11] : [Step 4/5] [2021-11-19 21:15:11,505][INFO ][main][root] >>> Non-Heap: 172 MB used / 189 MB commited / 0 MB max <<< [21:15:11]W: [org.apache.ignite:ignite-core] [2021-11-19 21:15:11,511][WARN ][test-runner-#26142%encryption.CacheGroupKeyChangeTest%][G] Ignite work directory is not provided, automatically resolved to: /opt/buildagent/work/7bc1c54bc719b67c/work [21:15:11] : [Step 4/5] [2021-11-19 21:15:11,513][INFO ][test-runner-#26142%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] [21:15:11] : [Step 4/5] [21:15:11] : [Step 4/5] >>> __________ ________________ [21:15:11] : [Step 4/5] >>> / _/ ___/ |/ / _/_ __/ __/ [21:15:11] : [Step 4/5] >>> _/ // (7 7 // / / / / _/ [21:15:11] : [Step 4/5] >>> /___/\___/_/|_/___/ /_/ /___/ [21:15:11] : [Step 4/5] >>> [21:15:11] : [Step 4/5] >>> ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:15:11] : [Step 4/5] >>> 2021 Copyright(C) Apache Software Foundation [21:15:11] : [Step 4/5] >>> [21:15:11] : [Step 4/5] >>> Ignite documentation: http://ignite.apache.org [21:15:11] : [Step 4/5] [21:15:11] : [Step 4/5] [2021-11-19 21:15:11,514][INFO ][test-runner-#26142%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] Config URL: n/a [21:15:11] : [Step 4/5] [2021-11-19 21:15:11,515][INFO ][test-runner-#26142%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] IgniteConfiguration [igniteInstanceName=grid-0, pubPoolSize=24, svcPoolSize=24, callbackPoolSize=24, stripedPoolSize=24, sysPoolSize=24, mgmtPoolSize=4, dataStreamerPoolSize=24, utilityCachePoolSize=24, utilityCacheKeepAliveTime=60000, p2pPoolSize=2, qryPoolSize=24, buildIdxPoolSize=4, igniteHome=/opt/buildagent/work/7bc1c54bc719b67c, igniteWorkDir=/opt/buildagent/work/7bc1c54bc719b67c/work, mbeanSrv=com.sun.jmx.mbeanserver.JmxMBeanServer@6fe85038, nodeId=00bad9b2-ce92-47f0-af24-2b5fe059d000, marsh=BinaryMarshaller [], marshLocJobs=false, daemon=false, p2pEnabled=true, netTimeout=10000, netCompressionLevel=1, sndRetryDelay=1000, sndRetryCnt=3, metricsHistSize=10000, metricsUpdateFreq=1000, metricsExpTime=9223372036854775807, discoSpi=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=0, ackTimeout=0, marsh=null, reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], segPlc=STOP, segResolveAttempts=2, waitForSegOnStart=true, allResolversPassReq=true, segChkFreq=10000, commSpi=TcpCommunicationSpi [connectGate=org.apache.ignite.spi.communication.tcp.internal.ConnectGateway@10cadcf2, ctxInitLatch=java.util.concurrent.CountDownLatch@8a0f1a8[Count = 1], stopping=false, clientPool=null, nioSrvWrapper=null, stateProvider=null], evtSpi=MemoryEventStorageSpi [expireAgeMs=9223372036854775807, expireCnt=10000, filter=null], colSpi=NoopCollisionSpi [], deploySpi=LocalDeploymentSpi [], indexingSpi=org.apache.ignite.spi.indexing.noop.NoopIndexingSpi@51046039, addrRslvr=null, encryptionSpi=org.apache.ignite.spi.encryption.keystore.KeystoreEncryptionSpi@787020e5, tracingSpi=org.apache.ignite.spi.tracing.NoopTracingSpi@ce3d5b5, clientMode=false, rebalanceThreadPoolSize=4, rebalanceTimeout=10000, rebalanceBatchesPrefetchCnt=3, rebalanceThrottle=0, rebalanceBatchSize=524288, txCfg=TransactionConfiguration [txSerEnabled=false, dfltIsolation=REPEATABLE_READ, dfltConcurrency=PESSIMISTIC, dfltTxTimeout=0, txTimeoutOnPartitionMapExchange=0, deadlockTimeout=10000, pessimisticTxLogSize=0, pessimisticTxLogLinger=10000, tmLookupClsName=null, txManagerFactory=null, useJtaSync=false], cacheSanityCheckEnabled=true, discoStartupDelay=60000, deployMode=SHARED, p2pMissedCacheSize=100, locHost=127.0.0.1, timeSrvPortBase=31100, timeSrvPortRange=100, failureDetectionTimeout=10000, sysWorkerBlockedTimeout=null, clientFailureDetectionTimeout=10000, metricsLogFreq=0, connectorCfg=null, odbcCfg=null, warmupClos=null, atomicCfg=AtomicConfiguration [seqReserveSize=1000, cacheMode=PARTITIONED, backups=1, aff=null, grpName=null], classLdr=null, sslCtxFactory=null, platformCfg=null, binaryCfg=null, memCfg=null, pstCfg=null, dsCfg=DataStorageConfiguration [sysRegionInitSize=41943040, sysRegionMaxSize=104857600, pageSize=4096, concLvl=0, dfltDataRegConf=DataRegionConfiguration [name=default, maxSize=104857600, initSize=268435456, swapPath=null, pageEvictionMode=DISABLED, pageReplacementMode=CLOCK, evictionThreshold=0.9, emptyPagesPoolSize=100, metricsEnabled=false, metricsSubIntervalCount=5, metricsRateTimeInterval=60000, persistenceEnabled=true, checkpointPageBufSize=0, lazyMemoryAllocation=true, warmUpCfg=null], dataRegions=null, storagePath=null, checkpointFreq=30000, lockWaitTime=10000, checkpointThreads=4, checkpointWriteOrder=SEQUENTIAL, walHistSize=20, maxWalArchiveSize=20971520, walSegments=10, walSegmentSize=1048576, walPath=db/wal, walArchivePath=db/wal/archive, cdcWalPath=db/wal/cdc, cdcEnabled=false, metricsEnabled=false, walMode=LOG_ONLY, walTlbSize=131072, walBuffSize=0, walFlushFreq=2000, walFsyncDelay=1000, walRecordIterBuffSize=67108864, alwaysWriteFullPages=false, fileIOFactory=org.apache.ignite.internal.processors.cache.persistence.file.AsyncFileIOFactory@fe07b5e, metricsSubIntervalCnt=5, metricsRateTimeInterval=60000, walAutoArchiveAfterInactivity=-1, walForceArchiveTimeout=-1, writeThrottlingEnabled=false, walCompactionEnabled=false, walCompactionLevel=1, checkpointReadLockTimeout=null, walPageCompression=DISABLED, walPageCompressionLevel=null, dfltWarmUpCfg=null, encCfg=org.apache.ignite.configuration.EncryptionConfiguration@40581d9f, defragmentationThreadPoolSize=4, minWalArchiveSize=-1], snapshotPath=snapshots, activeOnStart=true, activeOnStartPropSetFlag=false, autoActivation=true, autoActivationPropSetFlag=false, clusterStateOnStart=null, sqlConnCfg=null, cliConnCfg=ClientConnectorConfiguration [host=null, port=10800, portRange=100, sockSndBufSize=0, sockRcvBufSize=0, tcpNoDelay=true, maxOpenCursorsPerConn=128, threadPoolSize=24, selectorCnt=12, idleTimeout=0, handshakeTimeout=10000, jdbcEnabled=true, odbcEnabled=true, thinCliEnabled=true, sslEnabled=false, useIgniteSslCtxFactory=true, sslClientAuth=false, sslCtxFactory=null, thinCliCfg=ThinClientConfiguration [maxActiveTxPerConn=100, maxActiveComputeTasksPerConn=0]], mvccVacuumThreadCnt=2, mvccVacuumFreq=5000, authEnabled=false, failureHnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]], commFailureRslvr=null, sqlCfg=SqlConfiguration [longQryWarnTimeout=3000, dfltQryTimeout=0, sqlQryHistSize=1000, validationEnabled=false], asyncContinuationExecutor=null] [21:15:11] : [Step 4/5] [2021-11-19 21:15:11,522][INFO ][test-runner-#26142%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] Daemon mode: off [21:15:11] : [Step 4/5] [2021-11-19 21:15:11,522][INFO ][test-runner-#26142%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] OS: Linux 4.15.0-151-generic amd64 [21:15:11] : [Step 4/5] [2021-11-19 21:15:11,523][INFO ][test-runner-#26142%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] OS user: teamcity [21:15:11] : [Step 4/5] [2021-11-19 21:15:11,523][INFO ][test-runner-#26142%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] PID: 16724 [21:15:11] : [Step 4/5] [2021-11-19 21:15:11,523][INFO ][test-runner-#26142%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] Language runtime: Java Platform API Specification ver. 1.8 [21:15:11] : [Step 4/5] [2021-11-19 21:15:11,523][INFO ][test-runner-#26142%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] VM information: Java(TM) SE Runtime Environment 1.8.0_261-b12 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 25.261-b12 [21:15:11] : [Step 4/5] [2021-11-19 21:15:11,524][INFO ][test-runner-#26142%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] VM total memory: 1.9GB [21:15:11] : [Step 4/5] [2021-11-19 21:15:11,524][INFO ][test-runner-#26142%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] Remote Management [restart: off, REST: off, JMX (remote: off)] [21:15:11] : [Step 4/5] [2021-11-19 21:15:11,524][INFO ][test-runner-#26142%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] Logger: GridTestLog4jLogger [quiet=false, config=null] [21:15:11] : [Step 4/5] [2021-11-19 21:15:11,524][INFO ][test-runner-#26142%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] IGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c [21:15:11] : [Step 4/5] [2021-11-19 21:15:11,525][INFO ][test-runner-#26142%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] VM arguments: [-DIGNITE_DUMP_THREADS_ON_FAILURE=false, -DMono=/usr/bin/mono-sgen, -DMono4.0_x64=/usr/lib/mono/4.0, -DMono4.5_x64=/usr/lib/mono/4.5, -DMonoVersion=6.12.0.90, -DSKIP_BUILD=false, -Dagent.home.dir=/opt/buildagent, -Dagent.name=aitc-lin02_03, -Dagent.ownPort=9090, -Dagent.work.dir=/opt/buildagent/work, -Dbuild.number=95, -Dbuild.vcs.number=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.1=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.GitHubApacheIgnite=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dclassworlds.conf=/opt/buildagent/temp/buildTmp/teamcity.m2.conf, -Dcom.jetbrains.maven.watcher.report.file=/opt/buildagent/temp/buildTmp/maven-build-info.xml, -Djava.io.tmpdir=/opt/buildagent/temp/buildTmp, -Dmaven.home=/opt/buildagent/tools/maven3_6, -Dmaven.multiModuleProjectDirectory=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.agent.cpuBenchmark=457, -Dteamcity.agent.dotnet.agent_url=http://localhost:9090/RPC2, -Dteamcity.agent.dotnet.build_id=6278078, -Dteamcity.auth.password=*******, -Dteamcity.auth.userId=TeamCityBuildId=6278078, -Dteamcity.build.changedFiles.file=/opt/buildagent/temp/buildTmp/changedFiles6342607772318147725.txt, -Dteamcity.build.checkoutDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.build.id=6278078, -Dteamcity.build.properties.file=/opt/buildagent/temp/buildTmp/teamcity.build5164517880467851002.properties, -Dteamcity.build.tempDir=/opt/buildagent/temp/buildTmp, -Dteamcity.build.workingDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.buildConfName=Basic 3, -Dteamcity.buildType.id=IgniteTests24Java8_Basic3, -Dteamcity.configuration.properties.file=/opt/buildagent/temp/buildTmp/teamcity.config5591980786735343870.properties, -Dteamcity.maven.userSettings.path=/opt/buildagent/temp/buildTmp/maven_settings_585072866407032347.xml, -Dteamcity.maven.watcher.home=/opt/buildagent/plugins/mavenPlugin/maven-watcher-jdk16, -Dteamcity.projectName=Ignite Tests 2.x (JDK 8/11), -Dteamcity.runner.properties.file=/opt/buildagent/temp/buildTmp/teamcity.runner9098465561618137420.properties, -Dteamcity.tests.recentlyFailedTests.file=/opt/buildagent/temp/buildTmp/testsToRunFirst3891775683130404069.txt, -Dteamcity.version=2021.2 (build 99542), -ea, -Xms2g, -Xmx2g, -XX:+HeapDumpOnOutOfMemoryError, -DIGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_TEST_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_UPDATE_NOTIFIER=false, -DIGNITE_NO_DISCO_ORDER=true, -DIGNITE_PERFORMANCE_SUGGESTIONS_DISABLED=true, -Djava.net.preferIPv4Stack=true, -DTEST_SCALE_FACTOR=1.0, -DIGNITE_TEST_PROP_LOG4J_FILE=log4j-tc-test.xml, -DIGNITE_QUIET=false, -DIGNITE_MARSHAL_BUFFERS_RECHECK=1000, -Dmaven.repo.local=/opt/buildagent/.m2/repository] [21:15:11] : [Step 4/5] [2021-11-19 21:15:11,529][INFO ][test-runner-#26142%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] System cache's DataRegion size is configured to 40 MB. Use DataStorageConfiguration.systemRegionInitialSize property to change the setting. [21:15:11] : [Step 4/5] [2021-11-19 21:15:11,529][INFO ][test-runner-#26142%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] Configured caches [in 'sysMemPlc' dataRegion: ['ignite-sys-cache']] [21:15:11]W: [org.apache.ignite:ignite-core] [2021-11-19 21:15:11,529][WARN ][test-runner-#26142%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] Peer class loading is enabled (disable it in production for performance and deployment consistency reasons) [21:15:11] : [Step 4/5] [2021-11-19 21:15:11,530][INFO ][test-runner-#26142%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] 3-rd party licenses can be found at: /opt/buildagent/work/7bc1c54bc719b67c/libs/licenses [21:15:11] : [Step 4/5] [2021-11-19 21:15:11,533][INFO ][test-runner-#26142%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] Configured plugins: [21:15:11] : [Step 4/5] [2021-11-19 21:15:11,534][INFO ][test-runner-#26142%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- StanByClusterTestProvider 1.0 [21:15:11] : [Step 4/5] [2021-11-19 21:15:11,534][INFO ][test-runner-#26142%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:15:11] : [Step 4/5] [2021-11-19 21:15:11,534][INFO ][test-runner-#26142%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] [21:15:11] : [Step 4/5] [2021-11-19 21:15:11,534][INFO ][test-runner-#26142%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- PageMemory tracker plugin 1.0 [21:15:11] : [Step 4/5] [2021-11-19 21:15:11,534][INFO ][test-runner-#26142%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:15:11] : [Step 4/5] [2021-11-19 21:15:11,534][INFO ][test-runner-#26142%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] [21:15:11] : [Step 4/5] [2021-11-19 21:15:11,535][INFO ][test-runner-#26142%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- TestDistibutedConfigurationPlugin 1.0 [21:15:11] : [Step 4/5] [2021-11-19 21:15:11,535][INFO ][test-runner-#26142%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:15:11] : [Step 4/5] [2021-11-19 21:15:11,535][INFO ][test-runner-#26142%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] [21:15:11] : [Step 4/5] [2021-11-19 21:15:11,535][INFO ][test-runner-#26142%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- NodeValidationPluginProvider 1.0 [21:15:11] : [Step 4/5] [2021-11-19 21:15:11,535][INFO ][test-runner-#26142%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:15:11] : [Step 4/5] [2021-11-19 21:15:11,536][INFO ][test-runner-#26142%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] [21:15:11] : [Step 4/5] [2021-11-19 21:15:11,536][INFO ][test-runner-#26142%encryption.CacheGroupKeyChangeTest%][FailureProcessor] Configured failure handler: [hnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]]] [21:15:11] : [Step 4/5] [2021-11-19 21:15:11,575][INFO ][test-runner-#26142%encryption.CacheGroupKeyChangeTest%][TestRecordingCommunicationSpi] Successfully bound communication NIO server to TCP port [port=47100, locHost=/127.0.0.1, selectorsCnt=12, selectorSpins=0, pairedConn=false] [21:15:11]W: [org.apache.ignite:ignite-core] [2021-11-19 21:15:11,576][WARN ][test-runner-#26142%encryption.CacheGroupKeyChangeTest%][TestRecordingCommunicationSpi] Message queue limit is set to 0 which may lead to potential OOMEs when running cache operations in FULL_ASYNC or PRIMARY_SYNC modes due to message queues growth on sender and receiver sides. [21:15:11] : [Step 4/5] [2021-11-19 21:15:11,586][INFO ][test-runner-#26142%encryption.CacheGroupKeyChangeTest%][GridCollisionManager] Collision resolution is disabled (all jobs will be activated upon arrival). [21:15:11] : [Step 4/5] [2021-11-19 21:15:11,587][INFO ][test-runner-#26142%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] Security status [authentication=off, sandbox=off, tls/ssl=off] [21:15:11] : [Step 4/5] [2021-11-19 21:15:11,658][INFO ][test-runner-#26142%encryption.CacheGroupKeyChangeTest%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:15:11] : [Step 4/5] [2021-11-19 21:15:11,742][INFO ][test-runner-#26142%encryption.CacheGroupKeyChangeTest%][MaintenanceProcessor] Resolved store directory for node persistent data: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0 [21:15:11] : [Step 4/5] [2021-11-19 21:15:11,743][INFO ][test-runner-#26142%encryption.CacheGroupKeyChangeTest%][CacheObjectBinaryProcessorImpl] Resolved directory for serialized binary metadata: /opt/buildagent/work/7bc1c54bc719b67c/work/db/binary_meta/grid_0 [21:15:11] : [Step 4/5] [2021-11-19 21:15:11,747][INFO ][test-runner-#26142%encryption.CacheGroupKeyChangeTest%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0 [21:15:11] : [Step 4/5] [2021-11-19 21:15:11,747][INFO ][test-runner-#26142%encryption.CacheGroupKeyChangeTest%][FileWriteAheadLogManager] Resolved write ahead log work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0 [21:15:11] : [Step 4/5] [2021-11-19 21:15:11,748][INFO ][test-runner-#26142%encryption.CacheGroupKeyChangeTest%][FileWriteAheadLogManager] Resolved write ahead log archive directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0 [21:15:11] : [Step 4/5] [2021-11-19 21:15:11,860][INFO ][test-runner-#26142%encryption.CacheGroupKeyChangeTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000000.wal [21:15:11] : [Step 4/5] [2021-11-19 21:15:11,861][INFO ][test-runner-#26142%encryption.CacheGroupKeyChangeTest%][FileHandleManagerImpl] Initialized write-ahead log manager [mode=LOG_ONLY] [21:15:11]W: [org.apache.ignite:ignite-core] [2021-11-19 21:15:11,861][WARN ][test-runner-#26142%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] DataRegion maxSize=104.9 MB is smaller than defaultInitialSize=268.4 MB, setting initialSize to 104.9 MB [21:15:11] : [Step 4/5] [2021-11-19 21:15:11,867][INFO ][test-runner-#26142%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Configured data regions initialized successfully [total=5] [21:15:11] : [Step 4/5] [2021-11-19 21:15:11,869][INFO ][test-runner-#26142%encryption.CacheGroupKeyChangeTest%][IgniteSnapshotManager] Resolved snapshot work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/snapshots [21:15:11] : [Step 4/5] [2021-11-19 21:15:11,869][INFO ][test-runner-#26142%encryption.CacheGroupKeyChangeTest%][IgniteSnapshotManager] Resolved temp directory for snapshot creation: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0/snp [21:15:11] : [Step 4/5] [2021-11-19 21:15:11,872][INFO ][test-runner-#26142%encryption.CacheGroupKeyChangeTest%][ClientListenerProcessor] Client connector processor has started on TCP port 10800 [21:15:11] : [Step 4/5] [2021-11-19 21:15:11,877][INFO ][test-runner-#26142%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] Non-loopback local IPs: 172.17.0.4 [21:15:11] : [Step 4/5] [2021-11-19 21:15:11,878][INFO ][test-runner-#26142%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] Enabled local MACs: 0242AC110004 [21:15:11] : [Step 4/5] [2021-11-19 21:15:11,880][INFO ][test-runner-#26142%encryption.CacheGroupKeyChangeTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:15:11] : [Step 4/5] [2021-11-19 21:15:11,881][INFO ][test-runner-#26142%encryption.CacheGroupKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:15:11] : [Step 4/5] [2021-11-19 21:15:11,881][INFO ][test-runner-#26142%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:15:11] : [Step 4/5] [2021-11-19 21:15:11,883][INFO ][test-runner-#26142%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Applying lost metastore updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:15:11] : [Step 4/5] [2021-11-19 21:15:11,884][INFO ][test-runner-#26142%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=0 ms] [21:15:11] : [Step 4/5] [2021-11-19 21:15:11,884][INFO ][test-runner-#26142%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Restoring partition state for local groups. [21:15:11] : [Step 4/5] [2021-11-19 21:15:11,885][INFO ][test-runner-#26142%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=0, partitionsProcessed=0, time=0ms] [21:15:11] : [Step 4/5] [2021-11-19 21:15:11,885][INFO ][test-runner-#26142%encryption.CacheGroupKeyChangeTest%][GridEncryptionManager] Encryption keys loaded from metastore. [grps=, masterKeyName=ignite.master.key] [21:15:11] : [Step 4/5] [2021-11-19 21:15:11,890][INFO ][test-runner-#26142%encryption.CacheGroupKeyChangeTest%][ClusterProcessor] Cluster ID and tag has been read from metastorage: null [21:15:11] : [Step 4/5] [2021-11-19 21:15:11,891][INFO ][test-runner-#26142%encryption.CacheGroupKeyChangeTest%][IgniteClusterImpl] Shutdown policy was updated [oldVal=null, newVal=null] [21:15:11] : [Step 4/5] [2021-11-19 21:15:11,891][INFO ][test-runner-#26142%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Checkpoint frequency deviation changed [oldVal=null, newVal=null] [21:15:11] : [Step 4/5] [2021-11-19 21:15:11,901][INFO ][test-runner-#26142%encryption.CacheGroupKeyChangeTest%][FilePageStoreManager] Cleanup cache stores [total=1, left=0, cleanFiles=false] [21:15:11] : [Step 4/5] [2021-11-19 21:15:11,903][INFO ][test-runner-#26142%encryption.CacheGroupKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:15:11] : [Step 4/5] [2021-11-19 21:15:11,904][INFO ][test-runner-#26142%encryption.CacheGroupKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:15:11] : [Step 4/5] [2021-11-19 21:15:11,905][INFO ][test-runner-#26142%encryption.CacheGroupKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:15:11] : [Step 4/5] [2021-11-19 21:15:11,905][INFO ][test-runner-#26142%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Data Regions Started: 5 [21:15:11] : [Step 4/5] [2021-11-19 21:15:11,906][INFO ][test-runner-#26142%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] ^-- sysMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:15:11] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:15:11] : [Step 4/5] ^-- default region [type=default, persistence=true, lazyAlloc=true, [21:15:11] : [Step 4/5] ... initCfg=100MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB, allocTotal=0MB] [21:15:11] : [Step 4/5] ^-- metastoreMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:15:11] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:15:11] : [Step 4/5] ^-- TxLog region [type=internal, persistence=true, lazyAlloc=false, [21:15:11] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:15:11] : [Step 4/5] ^-- volatileDsMemPlc region [type=user, persistence=false, lazyAlloc=true, [21:15:11] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB] [21:15:11] : [Step 4/5] ^-- Ignite persistence [used=0MB] [21:15:11] : [Step 4/5] [21:15:11] : [Step 4/5] [2021-11-19 21:15:11,907][INFO ][test-runner-#26142%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Starting binary memory restore for: [-2100569601] [21:15:11] : [Step 4/5] [2021-11-19 21:15:11,916][INFO ][test-runner-#26142%encryption.CacheGroupKeyChangeTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:15:11] : [Step 4/5] [2021-11-19 21:15:11,916][INFO ][test-runner-#26142%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:15:11] : [Step 4/5] [2021-11-19 21:15:11,921][INFO ][test-runner-#26142%encryption.CacheGroupKeyChangeTest%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000000.wal, offset=0, ver=2] [21:15:11] : [Step 4/5] [2021-11-19 21:15:11,925][INFO ][test-runner-#26142%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Started cache in recovery mode [name=ignite-sys-cache, id=-2100569601, dataRegionName=sysMemPlc, mode=REPLICATED, atomicity=TRANSACTIONAL, backups=2147483647, mvcc=false] [21:15:11] : [Step 4/5] [2021-11-19 21:15:11,926][INFO ][test-runner-#26142%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Binary recovery performed in 19 ms. [21:15:11] : [Step 4/5] [2021-11-19 21:15:11,927][INFO ][test-runner-#26142%encryption.CacheGroupKeyChangeTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:15:11] : [Step 4/5] [2021-11-19 21:15:11,927][INFO ][test-runner-#26142%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Applying lost cache updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:15:11] : [Step 4/5] [2021-11-19 21:15:11,932][INFO ][test-runner-#26142%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=10 ms] [21:15:11] : [Step 4/5] [2021-11-19 21:15:11,932][INFO ][test-runner-#26142%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Restoring partition state for local groups. [21:15:11] : [Step 4/5] [2021-11-19 21:15:11,943][INFO ][test-runner-#26142%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=1, partitionsProcessed=100, time=11ms] [21:15:11] : [Step 4/5] [2021-11-19 21:15:11,956][INFO ][test-runner-#26142%encryption.CacheGroupKeyChangeTest%][TestTcpDiscoverySpi] Successfully bound to TCP port [port=47500, localHost=localhost/127.0.0.1, locNodeId=00bad9b2-ce92-47f0-af24-2b5fe059d000] [21:15:11] : [Step 4/5] [2021-11-19 21:15:11,966][INFO ][disco-notifier-worker-#26254%grid-0%][MvccProcessorImpl] Assigned mvcc coordinator [crd=MvccCoordinator [topVer=AffinityTopologyVersion [topVer=1, minorTopVer=0], nodeId=00bad9b2-ce92-47f0-af24-2b5fe059d000, ver=1637345711960, local=true, initialized=false]] [21:15:11] : [Step 4/5] [2021-11-19 21:15:11,968][INFO ][sys-#26253%grid-0%][ClusterProcessor] Writing cluster ID and tag to metastorage on ready for write ClusterIdAndTag [id=5bff0be8-7b75-4d20-ad86-5a53d27ee5f4, tag=epic_lederberg] [21:15:11] : [Step 4/5] [2021-11-19 21:15:11,970][INFO ][disco-notifier-worker-#26254%grid-0%][ClusterProcessor] epic_lederberg [21:15:11] : [Step 4/5] [2021-11-19 21:15:11,971][INFO ][disco-notifier-worker-#26254%grid-0%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustEnabled' was changed from 'null' to 'false' [21:15:11] : [Step 4/5] [2021-11-19 21:15:11,972][INFO ][disco-notifier-worker-#26254%grid-0%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustTimeout' was changed from 'null' to '300000' [21:15:11] : [Step 4/5] [2021-11-19 21:15:11,973][INFO ][disco-notifier-worker-#26254%grid-0%][IgniteTxManager] Transactions parameter 'longOperationsDumpTimeout' was changed from 'null' to '60000' [21:15:11] : [Step 4/5] [2021-11-19 21:15:11,973][INFO ][disco-notifier-worker-#26254%grid-0%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpThreshold' was changed from 'null' to '0' [21:15:11] : [Step 4/5] [2021-11-19 21:15:11,973][INFO ][disco-notifier-worker-#26254%grid-0%][IgniteTxManager] Transactions parameter 'transactionTimeDumpSamplesCoefficient' was changed from 'null' to '0.0' [21:15:11] : [Step 4/5] [2021-11-19 21:15:11,974][INFO ][disco-notifier-worker-#26254%grid-0%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpSamplesPerSecondLimit' was changed from 'null' to '5' [21:15:11] : [Step 4/5] [2021-11-19 21:15:11,974][INFO ][disco-notifier-worker-#26254%grid-0%][IgniteTxManager] Transactions parameter 'collisionsDumpInterval' was changed from 'null' to '1000' [21:15:11] : [Step 4/5] [2021-11-19 21:15:11,975][INFO ][disco-notifier-worker-#26254%grid-0%][IgniteTxManager] Transactions parameter 'txOwnerDumpRequestsAllowed' was changed from 'null' to 'true' [21:15:11] : [Step 4/5] [2021-11-19 21:15:11,975][INFO ][disco-notifier-worker-#26254%grid-0%][GridCacheDatabaseSharedManager] Historical rebalance WAL threshold changed [property=historical.rebalance.threshold, oldVal=null, newVal=500] [21:15:11] : [Step 4/5] [2021-11-19 21:15:11,985][INFO ][test-runner-#26142%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] To start Console Management & Monitoring run ignitevisorcmd.{sh|bat} [21:15:11] : [Step 4/5] [2021-11-19 21:15:11,986][INFO ][test-runner-#26142%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] [21:15:11] : [Step 4/5] [21:15:11] : [Step 4/5] >>> +-------------------------------------------+ [21:15:11] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:15:11] : [Step 4/5] >>> +-------------------------------------------+ [21:15:11] : [Step 4/5] >>> OS name: Linux 4.15.0-151-generic amd64 [21:15:11] : [Step 4/5] >>> CPU(s): 24 [21:15:11] : [Step 4/5] >>> Heap: 2.0GB [21:15:11] : [Step 4/5] >>> VM name: 16724@c4dfe9a430b2 [21:15:11] : [Step 4/5] >>> Ignite instance name: grid-0 [21:15:11] : [Step 4/5] >>> Local node [ID=00BAD9B2-CE92-47F0-AF24-2B5FE059D000, order=1, clientMode=false] [21:15:11] : [Step 4/5] >>> Local node addresses: [127.0.0.1] [21:15:11] : [Step 4/5] >>> Local ports: TCP:10800 TCP:47100 TCP:47500 [21:15:11] : [Step 4/5] [21:15:11] : [Step 4/5] [2021-11-19 21:15:11,986][INFO ][test-runner-#26142%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] >>> Ignite cluster is in INACTIVE state (limited functionality available). Use control.(sh|bat) script or IgniteCluster.state(ClusterState.ACTIVE) to change the state. [21:15:11] : [Step 4/5] [2021-11-19 21:15:11,987][INFO ][test-runner-#26142%encryption.CacheGroupKeyChangeTest%][GridDiscoveryManager] Topology snapshot [ver=1, locNode=00bad9b2, servers=1, clients=0, state=INACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=00bad9b2-ce92-47f0-af24-2b5fe059d000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:15:11] : [Step 4/5] [2021-11-19 21:15:11,988][INFO ][test-runner-#26142%encryption.CacheGroupKeyChangeTest%][G] Node started : [stage="Configure system pool" (0 ms),stage="Start managers" (230 ms),stage="Configure binary metadata" (2 ms),stage="Start processors" (131 ms),stage="Start 'StanByClusterTestProvider' plugin" (0 ms),stage="Start 'PageMemory tracker plugin' plugin" (0 ms),stage="Start 'TestDistibutedConfigurationPlugin' plugin" (0 ms),stage="Start 'NodeValidationPluginProvider' plugin" (0 ms),stage="Init metastore" (24 ms),stage="Init and start regions" (6 ms),stage="Restore binary memory" (19 ms),stage="Restore logical state" (16 ms),stage="Finish recovery" (10 ms),stage="Join topology" (11 ms),stage="Await transition" (1 ms),stage="Await exchange" (19 ms),stage="Total time" (469 ms)] [21:15:11] : [Step 4/5] [2021-11-19 21:15:11,989][INFO ][test-runner-#26142%encryption.CacheGroupKeyChangeTest%][root] Node started with the following configuration [id=00bad9b2-ce92-47f0-af24-2b5fe059d000, marshaller=BinaryMarshaller [], discovery=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=5000, ackTimeout=5000, marsh=JdkMarshaller [clsFilter=org.apache.ignite.marshaller.MarshallerUtils$1@3131046c], reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], binaryCfg=null, lateAff=true] [21:15:11]W: [org.apache.ignite:ignite-core] [2021-11-19 21:15:11,993][WARN ][test-runner-#26142%encryption.CacheGroupKeyChangeTest%][G] Ignite work directory is not provided, automatically resolved to: /opt/buildagent/work/7bc1c54bc719b67c/work [21:15:11] : [Step 4/5] [2021-11-19 21:15:11,996][INFO ][test-runner-#26142%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] [21:15:11] : [Step 4/5] [21:15:11] : [Step 4/5] >>> __________ ________________ [21:15:11] : [Step 4/5] >>> / _/ ___/ |/ / _/_ __/ __/ [21:15:11] : [Step 4/5] >>> _/ // (7 7 // / / / / _/ [21:15:11] : [Step 4/5] >>> /___/\___/_/|_/___/ /_/ /___/ [21:15:11] : [Step 4/5] >>> [21:15:11] : [Step 4/5] >>> ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:15:11] : [Step 4/5] >>> 2021 Copyright(C) Apache Software Foundation [21:15:11] : [Step 4/5] >>> [21:15:11] : [Step 4/5] >>> Ignite documentation: http://ignite.apache.org [21:15:11] : [Step 4/5] [21:15:11] : [Step 4/5] [2021-11-19 21:15:11,997][INFO ][test-runner-#26142%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] Config URL: n/a [21:15:12] : [Step 4/5] [2021-11-19 21:15:11,997][INFO ][test-runner-#26142%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] IgniteConfiguration [igniteInstanceName=grid-1, pubPoolSize=24, svcPoolSize=24, callbackPoolSize=24, stripedPoolSize=24, sysPoolSize=24, mgmtPoolSize=4, dataStreamerPoolSize=24, utilityCachePoolSize=24, utilityCacheKeepAliveTime=60000, p2pPoolSize=2, qryPoolSize=24, buildIdxPoolSize=4, igniteHome=/opt/buildagent/work/7bc1c54bc719b67c, igniteWorkDir=/opt/buildagent/work/7bc1c54bc719b67c/work, mbeanSrv=com.sun.jmx.mbeanserver.JmxMBeanServer@6fe85038, nodeId=1052a2c5-c72c-401d-95d8-7080cbcd9001, marsh=BinaryMarshaller [], marshLocJobs=false, daemon=false, p2pEnabled=true, netTimeout=10000, netCompressionLevel=1, sndRetryDelay=1000, sndRetryCnt=3, metricsHistSize=10000, metricsUpdateFreq=1000, metricsExpTime=9223372036854775807, discoSpi=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=0, ackTimeout=0, marsh=null, reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], segPlc=STOP, segResolveAttempts=2, waitForSegOnStart=true, allResolversPassReq=true, segChkFreq=10000, commSpi=TcpCommunicationSpi [connectGate=org.apache.ignite.spi.communication.tcp.internal.ConnectGateway@1ae3b1e6, ctxInitLatch=java.util.concurrent.CountDownLatch@b1609b3[Count = 1], stopping=false, clientPool=null, nioSrvWrapper=null, stateProvider=null], evtSpi=MemoryEventStorageSpi [expireAgeMs=9223372036854775807, expireCnt=10000, filter=null], colSpi=NoopCollisionSpi [], deploySpi=LocalDeploymentSpi [], indexingSpi=org.apache.ignite.spi.indexing.noop.NoopIndexingSpi@25a23f7d, addrRslvr=null, encryptionSpi=org.apache.ignite.spi.encryption.keystore.KeystoreEncryptionSpi@7fd7fa96, tracingSpi=org.apache.ignite.spi.tracing.NoopTracingSpi@2e69aa89, clientMode=false, rebalanceThreadPoolSize=4, rebalanceTimeout=10000, rebalanceBatchesPrefetchCnt=3, rebalanceThrottle=0, rebalanceBatchSize=524288, txCfg=TransactionConfiguration [txSerEnabled=false, dfltIsolation=REPEATABLE_READ, dfltConcurrency=PESSIMISTIC, dfltTxTimeout=0, txTimeoutOnPartitionMapExchange=0, deadlockTimeout=10000, pessimisticTxLogSize=0, pessimisticTxLogLinger=10000, tmLookupClsName=null, txManagerFactory=null, useJtaSync=false], cacheSanityCheckEnabled=true, discoStartupDelay=60000, deployMode=SHARED, p2pMissedCacheSize=100, locHost=127.0.0.1, timeSrvPortBase=31100, timeSrvPortRange=100, failureDetectionTimeout=10000, sysWorkerBlockedTimeout=null, clientFailureDetectionTimeout=10000, metricsLogFreq=0, connectorCfg=null, odbcCfg=null, warmupClos=null, atomicCfg=AtomicConfiguration [seqReserveSize=1000, cacheMode=PARTITIONED, backups=1, aff=null, grpName=null], classLdr=null, sslCtxFactory=null, platformCfg=null, binaryCfg=null, memCfg=null, pstCfg=null, dsCfg=DataStorageConfiguration [sysRegionInitSize=41943040, sysRegionMaxSize=104857600, pageSize=4096, concLvl=0, dfltDataRegConf=DataRegionConfiguration [name=default, maxSize=104857600, initSize=268435456, swapPath=null, pageEvictionMode=DISABLED, pageReplacementMode=CLOCK, evictionThreshold=0.9, emptyPagesPoolSize=100, metricsEnabled=false, metricsSubIntervalCount=5, metricsRateTimeInterval=60000, persistenceEnabled=true, checkpointPageBufSize=0, lazyMemoryAllocation=true, warmUpCfg=null], dataRegions=null, storagePath=null, checkpointFreq=30000, lockWaitTime=10000, checkpointThreads=4, checkpointWriteOrder=SEQUENTIAL, walHistSize=20, maxWalArchiveSize=20971520, walSegments=10, walSegmentSize=1048576, walPath=db/wal, walArchivePath=db/wal/archive, cdcWalPath=db/wal/cdc, cdcEnabled=false, metricsEnabled=false, walMode=LOG_ONLY, walTlbSize=131072, walBuffSize=0, walFlushFreq=2000, walFsyncDelay=1000, walRecordIterBuffSize=67108864, alwaysWriteFullPages=false, fileIOFactory=org.apache.ignite.internal.processors.cache.persistence.file.AsyncFileIOFactory@7d1b000f, metricsSubIntervalCnt=5, metricsRateTimeInterval=60000, walAutoArchiveAfterInactivity=-1, walForceArchiveTimeout=-1, writeThrottlingEnabled=false, walCompactionEnabled=false, walCompactionLevel=1, checkpointReadLockTimeout=null, walPageCompression=DISABLED, walPageCompressionLevel=null, dfltWarmUpCfg=null, encCfg=org.apache.ignite.configuration.EncryptionConfiguration@7d62b585, defragmentationThreadPoolSize=4, minWalArchiveSize=-1], snapshotPath=snapshots, activeOnStart=true, activeOnStartPropSetFlag=false, autoActivation=true, autoActivationPropSetFlag=false, clusterStateOnStart=null, sqlConnCfg=null, cliConnCfg=ClientConnectorConfiguration [host=null, port=10800, portRange=100, sockSndBufSize=0, sockRcvBufSize=0, tcpNoDelay=true, maxOpenCursorsPerConn=128, threadPoolSize=24, selectorCnt=12, idleTimeout=0, handshakeTimeout=10000, jdbcEnabled=true, odbcEnabled=true, thinCliEnabled=true, sslEnabled=false, useIgniteSslCtxFactory=true, sslClientAuth=false, sslCtxFactory=null, thinCliCfg=ThinClientConfiguration [maxActiveTxPerConn=100, maxActiveComputeTasksPerConn=0]], mvccVacuumThreadCnt=2, mvccVacuumFreq=5000, authEnabled=false, failureHnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]], commFailureRslvr=null, sqlCfg=SqlConfiguration [longQryWarnTimeout=3000, dfltQryTimeout=0, sqlQryHistSize=1000, validationEnabled=false], asyncContinuationExecutor=null] [21:15:12] : [Step 4/5] [2021-11-19 21:15:12,005][INFO ][test-runner-#26142%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] Daemon mode: off [21:15:12] : [Step 4/5] [2021-11-19 21:15:12,005][INFO ][test-runner-#26142%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] OS: Linux 4.15.0-151-generic amd64 [21:15:12] : [Step 4/5] [2021-11-19 21:15:12,005][INFO ][test-runner-#26142%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] OS user: teamcity [21:15:12] : [Step 4/5] [2021-11-19 21:15:12,005][INFO ][test-runner-#26142%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] PID: 16724 [21:15:12] : [Step 4/5] [2021-11-19 21:15:12,006][INFO ][test-runner-#26142%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] Language runtime: Java Platform API Specification ver. 1.8 [21:15:12] : [Step 4/5] [2021-11-19 21:15:12,006][INFO ][test-runner-#26142%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] VM information: Java(TM) SE Runtime Environment 1.8.0_261-b12 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 25.261-b12 [21:15:12] : [Step 4/5] [2021-11-19 21:15:12,006][INFO ][test-runner-#26142%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] VM total memory: 1.9GB [21:15:12] : [Step 4/5] [2021-11-19 21:15:12,006][INFO ][test-runner-#26142%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] Remote Management [restart: off, REST: off, JMX (remote: off)] [21:15:12] : [Step 4/5] [2021-11-19 21:15:12,007][INFO ][test-runner-#26142%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] Logger: GridTestLog4jLogger [quiet=false, config=null] [21:15:12] : [Step 4/5] [2021-11-19 21:15:12,007][INFO ][test-runner-#26142%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] IGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c [21:15:12] : [Step 4/5] [2021-11-19 21:15:12,007][INFO ][test-runner-#26142%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] VM arguments: [-DIGNITE_DUMP_THREADS_ON_FAILURE=false, -DMono=/usr/bin/mono-sgen, -DMono4.0_x64=/usr/lib/mono/4.0, -DMono4.5_x64=/usr/lib/mono/4.5, -DMonoVersion=6.12.0.90, -DSKIP_BUILD=false, -Dagent.home.dir=/opt/buildagent, -Dagent.name=aitc-lin02_03, -Dagent.ownPort=9090, -Dagent.work.dir=/opt/buildagent/work, -Dbuild.number=95, -Dbuild.vcs.number=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.1=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.GitHubApacheIgnite=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dclassworlds.conf=/opt/buildagent/temp/buildTmp/teamcity.m2.conf, -Dcom.jetbrains.maven.watcher.report.file=/opt/buildagent/temp/buildTmp/maven-build-info.xml, -Djava.io.tmpdir=/opt/buildagent/temp/buildTmp, -Dmaven.home=/opt/buildagent/tools/maven3_6, -Dmaven.multiModuleProjectDirectory=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.agent.cpuBenchmark=457, -Dteamcity.agent.dotnet.agent_url=http://localhost:9090/RPC2, -Dteamcity.agent.dotnet.build_id=6278078, -Dteamcity.auth.password=*******, -Dteamcity.auth.userId=TeamCityBuildId=6278078, -Dteamcity.build.changedFiles.file=/opt/buildagent/temp/buildTmp/changedFiles6342607772318147725.txt, -Dteamcity.build.checkoutDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.build.id=6278078, -Dteamcity.build.properties.file=/opt/buildagent/temp/buildTmp/teamcity.build5164517880467851002.properties, -Dteamcity.build.tempDir=/opt/buildagent/temp/buildTmp, -Dteamcity.build.workingDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.buildConfName=Basic 3, -Dteamcity.buildType.id=IgniteTests24Java8_Basic3, -Dteamcity.configuration.properties.file=/opt/buildagent/temp/buildTmp/teamcity.config5591980786735343870.properties, -Dteamcity.maven.userSettings.path=/opt/buildagent/temp/buildTmp/maven_settings_585072866407032347.xml, -Dteamcity.maven.watcher.home=/opt/buildagent/plugins/mavenPlugin/maven-watcher-jdk16, -Dteamcity.projectName=Ignite Tests 2.x (JDK 8/11), -Dteamcity.runner.properties.file=/opt/buildagent/temp/buildTmp/teamcity.runner9098465561618137420.properties, -Dteamcity.tests.recentlyFailedTests.file=/opt/buildagent/temp/buildTmp/testsToRunFirst3891775683130404069.txt, -Dteamcity.version=2021.2 (build 99542), -ea, -Xms2g, -Xmx2g, -XX:+HeapDumpOnOutOfMemoryError, -DIGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_TEST_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_UPDATE_NOTIFIER=false, -DIGNITE_NO_DISCO_ORDER=true, -DIGNITE_PERFORMANCE_SUGGESTIONS_DISABLED=true, -Djava.net.preferIPv4Stack=true, -DTEST_SCALE_FACTOR=1.0, -DIGNITE_TEST_PROP_LOG4J_FILE=log4j-tc-test.xml, -DIGNITE_QUIET=false, -DIGNITE_MARSHAL_BUFFERS_RECHECK=1000, -Dmaven.repo.local=/opt/buildagent/.m2/repository] [21:15:12] : [Step 4/5] [2021-11-19 21:15:12,011][INFO ][test-runner-#26142%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] System cache's DataRegion size is configured to 40 MB. Use DataStorageConfiguration.systemRegionInitialSize property to change the setting. [21:15:12] : [Step 4/5] [2021-11-19 21:15:12,011][INFO ][test-runner-#26142%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] Configured caches [in 'sysMemPlc' dataRegion: ['ignite-sys-cache']] [21:15:12]W: [org.apache.ignite:ignite-core] [2021-11-19 21:15:12,012][WARN ][test-runner-#26142%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] Peer class loading is enabled (disable it in production for performance and deployment consistency reasons) [21:15:12] : [Step 4/5] [2021-11-19 21:15:12,012][INFO ][test-runner-#26142%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] 3-rd party licenses can be found at: /opt/buildagent/work/7bc1c54bc719b67c/libs/licenses [21:15:12] : [Step 4/5] [2021-11-19 21:15:12,015][INFO ][test-runner-#26142%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] Configured plugins: [21:15:12] : [Step 4/5] [2021-11-19 21:15:12,015][INFO ][test-runner-#26142%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- StanByClusterTestProvider 1.0 [21:15:12] : [Step 4/5] [2021-11-19 21:15:12,016][INFO ][test-runner-#26142%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:15:12] : [Step 4/5] [2021-11-19 21:15:12,016][INFO ][test-runner-#26142%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] [21:15:12] : [Step 4/5] [2021-11-19 21:15:12,016][INFO ][test-runner-#26142%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- PageMemory tracker plugin 1.0 [21:15:12] : [Step 4/5] [2021-11-19 21:15:12,016][INFO ][test-runner-#26142%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:15:12] : [Step 4/5] [2021-11-19 21:15:12,016][INFO ][test-runner-#26142%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] [21:15:12] : [Step 4/5] [2021-11-19 21:15:12,017][INFO ][test-runner-#26142%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- TestDistibutedConfigurationPlugin 1.0 [21:15:12] : [Step 4/5] [2021-11-19 21:15:12,017][INFO ][test-runner-#26142%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:15:12] : [Step 4/5] [2021-11-19 21:15:12,017][INFO ][test-runner-#26142%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] [21:15:12] : [Step 4/5] [2021-11-19 21:15:12,017][INFO ][test-runner-#26142%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- NodeValidationPluginProvider 1.0 [21:15:12] : [Step 4/5] [2021-11-19 21:15:12,017][INFO ][test-runner-#26142%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:15:12] : [Step 4/5] [2021-11-19 21:15:12,018][INFO ][test-runner-#26142%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] [21:15:12] : [Step 4/5] [2021-11-19 21:15:12,018][INFO ][test-runner-#26142%encryption.CacheGroupKeyChangeTest%][FailureProcessor] Configured failure handler: [hnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]]] [21:15:12] : [Step 4/5] [2021-11-19 21:15:12,039][INFO ][test-runner-#26142%encryption.CacheGroupKeyChangeTest%][TestRecordingCommunicationSpi] Successfully bound communication NIO server to TCP port [port=47101, locHost=/127.0.0.1, selectorsCnt=12, selectorSpins=0, pairedConn=false] [21:15:12]W: [org.apache.ignite:ignite-core] [2021-11-19 21:15:12,040][WARN ][test-runner-#26142%encryption.CacheGroupKeyChangeTest%][TestRecordingCommunicationSpi] Message queue limit is set to 0 which may lead to potential OOMEs when running cache operations in FULL_ASYNC or PRIMARY_SYNC modes due to message queues growth on sender and receiver sides. [21:15:12] : [Step 4/5] [2021-11-19 21:15:12,046][INFO ][test-runner-#26142%encryption.CacheGroupKeyChangeTest%][GridCollisionManager] Collision resolution is disabled (all jobs will be activated upon arrival). [21:15:12] : [Step 4/5] [2021-11-19 21:15:12,046][INFO ][test-runner-#26142%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] Security status [authentication=off, sandbox=off, tls/ssl=off] [21:15:12] : [Step 4/5] [2021-11-19 21:15:12,102][INFO ][test-runner-#26142%encryption.CacheGroupKeyChangeTest%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:15:12] : [Step 4/5] [2021-11-19 21:15:12,192][INFO ][test-runner-#26142%encryption.CacheGroupKeyChangeTest%][MaintenanceProcessor] Resolved store directory for node persistent data: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1 [21:15:12] : [Step 4/5] [2021-11-19 21:15:12,193][INFO ][test-runner-#26142%encryption.CacheGroupKeyChangeTest%][CacheObjectBinaryProcessorImpl] Resolved directory for serialized binary metadata: /opt/buildagent/work/7bc1c54bc719b67c/work/db/binary_meta/grid_1 [21:15:12] : [Step 4/5] [2021-11-19 21:15:12,196][INFO ][test-runner-#26142%encryption.CacheGroupKeyChangeTest%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1 [21:15:12] : [Step 4/5] [2021-11-19 21:15:12,197][INFO ][test-runner-#26142%encryption.CacheGroupKeyChangeTest%][FileWriteAheadLogManager] Resolved write ahead log work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1 [21:15:12] : [Step 4/5] [2021-11-19 21:15:12,197][INFO ][test-runner-#26142%encryption.CacheGroupKeyChangeTest%][FileWriteAheadLogManager] Resolved write ahead log archive directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1 [21:15:12] : [Step 4/5] [2021-11-19 21:15:12,374][INFO ][test-runner-#26142%encryption.CacheGroupKeyChangeTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000000.wal [21:15:12] : [Step 4/5] [2021-11-19 21:15:12,374][INFO ][test-runner-#26142%encryption.CacheGroupKeyChangeTest%][FileHandleManagerImpl] Initialized write-ahead log manager [mode=LOG_ONLY] [21:15:12] : [Step 4/5] [2021-11-19 21:15:12,380][INFO ][test-runner-#26142%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Configured data regions initialized successfully [total=5] [21:15:12] : [Step 4/5] [2021-11-19 21:15:12,382][INFO ][test-runner-#26142%encryption.CacheGroupKeyChangeTest%][IgniteSnapshotManager] Resolved snapshot work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/snapshots [21:15:12] : [Step 4/5] [2021-11-19 21:15:12,383][INFO ][test-runner-#26142%encryption.CacheGroupKeyChangeTest%][IgniteSnapshotManager] Resolved temp directory for snapshot creation: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1/snp [21:15:12] : [Step 4/5] [2021-11-19 21:15:12,385][INFO ][test-runner-#26142%encryption.CacheGroupKeyChangeTest%][ClientListenerProcessor] Client connector processor has started on TCP port 10801 [21:15:12] : [Step 4/5] [2021-11-19 21:15:12,387][INFO ][test-runner-#26142%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] Non-loopback local IPs: 172.17.0.4 [21:15:12] : [Step 4/5] [2021-11-19 21:15:12,387][INFO ][test-runner-#26142%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] Enabled local MACs: 0242AC110004 [21:15:12] : [Step 4/5] [2021-11-19 21:15:12,387][INFO ][test-runner-#26142%encryption.CacheGroupKeyChangeTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:15:12] : [Step 4/5] [2021-11-19 21:15:12,388][INFO ][test-runner-#26142%encryption.CacheGroupKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:15:12] : [Step 4/5] [2021-11-19 21:15:12,389][INFO ][test-runner-#26142%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:15:12] : [Step 4/5] [2021-11-19 21:15:12,391][INFO ][test-runner-#26142%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Applying lost metastore updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:15:12] : [Step 4/5] [2021-11-19 21:15:12,391][INFO ][test-runner-#26142%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=0 ms] [21:15:12] : [Step 4/5] [2021-11-19 21:15:12,391][INFO ][test-runner-#26142%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Restoring partition state for local groups. [21:15:12] : [Step 4/5] [2021-11-19 21:15:12,392][INFO ][test-runner-#26142%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=0, partitionsProcessed=0, time=10ms] [21:15:12] : [Step 4/5] [2021-11-19 21:15:12,392][INFO ][test-runner-#26142%encryption.CacheGroupKeyChangeTest%][GridEncryptionManager] Encryption keys loaded from metastore. [grps=, masterKeyName=ignite.master.key] [21:15:12] : [Step 4/5] [2021-11-19 21:15:12,393][INFO ][test-runner-#26142%encryption.CacheGroupKeyChangeTest%][ClusterProcessor] Cluster ID and tag has been read from metastorage: null [21:15:12] : [Step 4/5] [2021-11-19 21:15:12,394][INFO ][test-runner-#26142%encryption.CacheGroupKeyChangeTest%][IgniteClusterImpl] Shutdown policy was updated [oldVal=null, newVal=null] [21:15:12] : [Step 4/5] [2021-11-19 21:15:12,394][INFO ][test-runner-#26142%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Checkpoint frequency deviation changed [oldVal=null, newVal=null] [21:15:12] : [Step 4/5] [2021-11-19 21:15:12,404][INFO ][test-runner-#26142%encryption.CacheGroupKeyChangeTest%][FilePageStoreManager] Cleanup cache stores [total=1, left=0, cleanFiles=false] [21:15:12] : [Step 4/5] [2021-11-19 21:15:12,406][INFO ][test-runner-#26142%encryption.CacheGroupKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:15:12] : [Step 4/5] [2021-11-19 21:15:12,407][INFO ][test-runner-#26142%encryption.CacheGroupKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:15:12] : [Step 4/5] [2021-11-19 21:15:12,408][INFO ][test-runner-#26142%encryption.CacheGroupKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:15:12] : [Step 4/5] [2021-11-19 21:15:12,408][INFO ][test-runner-#26142%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Data Regions Started: 5 [21:15:12] : [Step 4/5] [2021-11-19 21:15:12,409][INFO ][test-runner-#26142%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] ^-- sysMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:15:12] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:15:12] : [Step 4/5] ^-- default region [type=default, persistence=true, lazyAlloc=true, [21:15:12] : [Step 4/5] ... initCfg=100MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB, allocTotal=0MB] [21:15:12] : [Step 4/5] ^-- metastoreMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:15:12] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:15:12] : [Step 4/5] ^-- TxLog region [type=internal, persistence=true, lazyAlloc=false, [21:15:12] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:15:12] : [Step 4/5] ^-- volatileDsMemPlc region [type=user, persistence=false, lazyAlloc=true, [21:15:12] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB] [21:15:12] : [Step 4/5] ^-- Ignite persistence [used=0MB] [21:15:12] : [Step 4/5] [21:15:12] : [Step 4/5] [2021-11-19 21:15:12,410][INFO ][test-runner-#26142%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Starting binary memory restore for: [-2100569601] [21:15:12] : [Step 4/5] [2021-11-19 21:15:12,419][INFO ][test-runner-#26142%encryption.CacheGroupKeyChangeTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:15:12] : [Step 4/5] [2021-11-19 21:15:12,419][INFO ][test-runner-#26142%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:15:12] : [Step 4/5] [2021-11-19 21:15:12,422][INFO ][test-runner-#26142%encryption.CacheGroupKeyChangeTest%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000000.wal, offset=0, ver=2] [21:15:12] : [Step 4/5] [2021-11-19 21:15:12,425][INFO ][test-runner-#26142%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Started cache in recovery mode [name=ignite-sys-cache, id=-2100569601, dataRegionName=sysMemPlc, mode=REPLICATED, atomicity=TRANSACTIONAL, backups=2147483647, mvcc=false] [21:15:12] : [Step 4/5] [2021-11-19 21:15:12,426][INFO ][test-runner-#26142%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Binary recovery performed in 16 ms. [21:15:12] : [Step 4/5] [2021-11-19 21:15:12,426][INFO ][test-runner-#26142%encryption.CacheGroupKeyChangeTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:15:12] : [Step 4/5] [2021-11-19 21:15:12,426][INFO ][test-runner-#26142%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Applying lost cache updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:15:12] : [Step 4/5] [2021-11-19 21:15:12,428][INFO ][test-runner-#26142%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=0 ms] [21:15:12] : [Step 4/5] [2021-11-19 21:15:12,429][INFO ][test-runner-#26142%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Restoring partition state for local groups. [21:15:12] : [Step 4/5] [2021-11-19 21:15:12,433][INFO ][test-runner-#26142%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=1, partitionsProcessed=100, time=0ms] [21:15:12] : [Step 4/5] [2021-11-19 21:15:12,437][INFO ][test-runner-#26142%encryption.CacheGroupKeyChangeTest%][TestTcpDiscoverySpi] Successfully bound to TCP port [port=47501, localHost=localhost/127.0.0.1, locNodeId=1052a2c5-c72c-401d-95d8-7080cbcd9001] [21:15:12] : [Step 4/5] [2021-11-19 21:15:12,441][INFO ][tcp-disco-srvr-[:47500]-#1379%grid-0%-#26256%grid-0%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=43725] [21:15:12] : [Step 4/5] [2021-11-19 21:15:12,442][INFO ][tcp-disco-srvr-[:47500]-#1379%grid-0%-#26256%grid-0%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=43725] [21:15:12] : [Step 4/5] [2021-11-19 21:15:12,443][INFO ][tcp-disco-sock-reader-[]-#1385%grid-0%-#26376%grid-0%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:43725, rmtPort=43725] [21:15:12] : [Step 4/5] [2021-11-19 21:15:12,444][INFO ][tcp-disco-sock-reader-[1052a2c5 127.0.0.1:43725]-#1385%grid-0%-#26376%grid-0%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=1052a2c5-c72c-401d-95d8-7080cbcd9001, rmtAddr=/127.0.0.1:43725] [21:15:12] : [Step 4/5] [2021-11-19 21:15:12,450][INFO ][tcp-disco-srvr-[:47501]-#1384%grid-1%-#26375%grid-1%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=50529] [21:15:12] : [Step 4/5] [2021-11-19 21:15:12,450][INFO ][tcp-disco-srvr-[:47501]-#1384%grid-1%-#26375%grid-1%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=50529] [21:15:12] : [Step 4/5] [2021-11-19 21:15:12,451][INFO ][tcp-disco-sock-reader-[]-#1386%grid-1%-#26377%grid-1%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:50529, rmtPort=50529] [21:15:12] : [Step 4/5] [2021-11-19 21:15:12,452][INFO ][tcp-disco-sock-reader-[]-#1386%grid-1%-#26377%grid-1%][TestTcpDiscoverySpi] Received ping request from the remote node [rmtNodeId=00bad9b2-ce92-47f0-af24-2b5fe059d000, rmtAddr=/127.0.0.1:50529, rmtPort=50529] [21:15:12] : [Step 4/5] [2021-11-19 21:15:12,453][INFO ][tcp-disco-sock-reader-[]-#1386%grid-1%-#26377%grid-1%][TestTcpDiscoverySpi] Finished writing ping response [rmtNodeId=00bad9b2-ce92-47f0-af24-2b5fe059d000, rmtAddr=/127.0.0.1:50529, rmtPort=50529] [21:15:12]W: [org.apache.ignite:ignite-core] [2021-11-19 21:15:12,453][WARN ][tcp-disco-sock-reader-[]-#1386%grid-1%-#26377%grid-1%][TestTcpDiscoverySpi] Failed to shutdown socket [21:15:12]W: [org.apache.ignite:ignite-core] java.net.SocketException: Socket output is already shutdown [21:15:12] : [Step 4/5] [2021-11-19 21:15:12,453][INFO ][tcp-disco-sock-reader-[1052a2c5 127.0.0.1:43725]-#1385%grid-0%-#26376%grid-0%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:43725, rmtPort=43725, rmtNodeId=1052a2c5-c72c-401d-95d8-7080cbcd9001] [21:15:12]W: [org.apache.ignite:ignite-core] at java.net.Socket.shutdownOutput(Socket.java:1572) [21:15:12]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.close(IgniteUtils.java:4247) [21:15:12]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.discovery.tcp.ServerImpl$SocketReader.body(ServerImpl.java:7370) [21:15:12]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.IgniteSpiThread.run(IgniteSpiThread.java:58) [21:15:12] : [Step 4/5] [2021-11-19 21:15:12,456][INFO ][tcp-disco-sock-reader-[]-#1386%grid-1%-#26377%grid-1%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:50529, rmtPort=50529, rmtNodeId=null] [21:15:12] : [Step 4/5] [2021-11-19 21:15:12,458][INFO ][tcp-disco-msg-worker-[crd]-#1378%grid-0%-#26255%grid-0%][GridEncryptionManager] Joining node doesn't have stored group keys [node=1052a2c5-c72c-401d-95d8-7080cbcd9001] [21:15:12] : [Step 4/5] [2021-11-19 21:15:12,467][INFO ][tcp-disco-msg-worker-[crd]-#1378%grid-0%-#26255%grid-0%][TestTcpDiscoverySpi] New next node [newNext=TcpDiscoveryNode [id=1052a2c5-c72c-401d-95d8-7080cbcd9001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=0, intOrder=2, lastExchangeTime=1637345712443, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false]] [21:15:12] : [Step 4/5] [2021-11-19 21:15:12,468][INFO ][tcp-disco-srvr-[:47501]-#1384%grid-1%-#26375%grid-1%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=56143] [21:15:12] : [Step 4/5] [2021-11-19 21:15:12,468][INFO ][tcp-disco-srvr-[:47501]-#1384%grid-1%-#26375%grid-1%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=56143] [21:15:12] : [Step 4/5] [2021-11-19 21:15:12,469][INFO ][tcp-disco-sock-reader-[]-#1387%grid-1%-#26378%grid-1%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:56143, rmtPort=56143] [21:15:12] : [Step 4/5] [2021-11-19 21:15:12,470][INFO ][tcp-disco-sock-reader-[00bad9b2 127.0.0.1:56143]-#1387%grid-1%-#26378%grid-1%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=00bad9b2-ce92-47f0-af24-2b5fe059d000, rmtAddr=/127.0.0.1:56143] [21:15:12] : [Step 4/5] [2021-11-19 21:15:12,474][INFO ][tcp-disco-msg-worker-[]-#1383%grid-1%-#26374%grid-1%][TestTcpDiscoverySpi] New next node [newNext=TcpDiscoveryNode [id=00bad9b2-ce92-47f0-af24-2b5fe059d000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345712463, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false]] [21:15:12] : [Step 4/5] [2021-11-19 21:15:12,474][INFO ][tcp-disco-srvr-[:47500]-#1379%grid-0%-#26256%grid-0%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=43367] [21:15:12] : [Step 4/5] [2021-11-19 21:15:12,475][INFO ][tcp-disco-srvr-[:47500]-#1379%grid-0%-#26256%grid-0%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=43367] [21:15:12] : [Step 4/5] [2021-11-19 21:15:12,475][INFO ][tcp-disco-sock-reader-[]-#1388%grid-0%-#26379%grid-0%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:43367, rmtPort=43367] [21:15:12] : [Step 4/5] [2021-11-19 21:15:12,476][INFO ][tcp-disco-sock-reader-[1052a2c5 127.0.0.1:43367]-#1388%grid-0%-#26379%grid-0%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=1052a2c5-c72c-401d-95d8-7080cbcd9001, rmtAddr=/127.0.0.1:43367] [21:15:12] : [Step 4/5] [2021-11-19 21:15:12,478][INFO ][disco-event-worker-#26258%grid-0%][GridDiscoveryManager] Added new node to topology: TcpDiscoveryNode [id=1052a2c5-c72c-401d-95d8-7080cbcd9001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637345712443, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false] [21:15:12] : [Step 4/5] [2021-11-19 21:15:12,479][INFO ][disco-event-worker-#26258%grid-0%][GridDiscoveryManager] Topology snapshot [ver=2, locNode=00bad9b2, servers=2, clients=0, state=INACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=00bad9b2-ce92-47f0-af24-2b5fe059d000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=1052a2c5-c72c-401d-95d8-7080cbcd9001, consistentId=grid-1, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:15:12] : [Step 4/5] [2021-11-19 21:15:12,481][INFO ][tcp-disco-msg-worker-[00bad9b2 127.0.0.1:47500]-#1383%grid-1%-#26374%grid-1%][ClusterProcessor] epic_lederberg [21:15:12] : [Step 4/5] [2021-11-19 21:15:12,481][INFO ][tcp-disco-msg-worker-[00bad9b2 127.0.0.1:47500]-#1383%grid-1%-#26374%grid-1%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustEnabled' was changed from 'null' to 'false' [21:15:12] : [Step 4/5] [2021-11-19 21:15:12,482][INFO ][tcp-disco-msg-worker-[00bad9b2 127.0.0.1:47500]-#1383%grid-1%-#26374%grid-1%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustTimeout' was changed from 'null' to '300000' [21:15:12] : [Step 4/5] [2021-11-19 21:15:12,482][INFO ][tcp-disco-msg-worker-[00bad9b2 127.0.0.1:47500]-#1383%grid-1%-#26374%grid-1%][IgniteTxManager] Transactions parameter 'longOperationsDumpTimeout' was changed from 'null' to '60000' [21:15:12] : [Step 4/5] [2021-11-19 21:15:12,483][INFO ][tcp-disco-msg-worker-[00bad9b2 127.0.0.1:47500]-#1383%grid-1%-#26374%grid-1%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpThreshold' was changed from 'null' to '0' [21:15:12] : [Step 4/5] [2021-11-19 21:15:12,483][INFO ][tcp-disco-msg-worker-[00bad9b2 127.0.0.1:47500]-#1383%grid-1%-#26374%grid-1%][IgniteTxManager] Transactions parameter 'transactionTimeDumpSamplesCoefficient' was changed from 'null' to '0.0' [21:15:12] : [Step 4/5] [2021-11-19 21:15:12,483][INFO ][tcp-disco-msg-worker-[00bad9b2 127.0.0.1:47500]-#1383%grid-1%-#26374%grid-1%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpSamplesPerSecondLimit' was changed from 'null' to '5' [21:15:12] : [Step 4/5] [2021-11-19 21:15:12,484][INFO ][tcp-disco-msg-worker-[00bad9b2 127.0.0.1:47500]-#1383%grid-1%-#26374%grid-1%][IgniteTxManager] Transactions parameter 'collisionsDumpInterval' was changed from 'null' to '1000' [21:15:12] : [Step 4/5] [2021-11-19 21:15:12,484][INFO ][tcp-disco-msg-worker-[00bad9b2 127.0.0.1:47500]-#1383%grid-1%-#26374%grid-1%][IgniteTxManager] Transactions parameter 'txOwnerDumpRequestsAllowed' was changed from 'null' to 'true' [21:15:12] : [Step 4/5] [2021-11-19 21:15:12,484][INFO ][tcp-disco-msg-worker-[00bad9b2 127.0.0.1:47500]-#1383%grid-1%-#26374%grid-1%][GridCacheDatabaseSharedManager] Historical rebalance WAL threshold changed [property=historical.rebalance.threshold, oldVal=null, newVal=500] [21:15:12] : [Step 4/5] [2021-11-19 21:15:12,486][INFO ][disco-notifier-worker-#26373%grid-1%][MvccProcessorImpl] Assigned mvcc coordinator [crd=MvccCoordinator [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=0], nodeId=00bad9b2-ce92-47f0-af24-2b5fe059d000, ver=1637345711960, local=false, initialized=false]] [21:15:12] : [Step 4/5] [2021-11-19 21:15:12,487][INFO ][sys-#26360%grid-1%][ClusterProcessor] Writing cluster ID and tag to metastorage on ready for write ClusterIdAndTag [id=5bff0be8-7b75-4d20-ad86-5a53d27ee5f4, tag=epic_lederberg] [21:15:12] : [Step 4/5] [2021-11-19 21:15:12,514][INFO ][test-runner-#26142%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] To start Console Management & Monitoring run ignitevisorcmd.{sh|bat} [21:15:12] : [Step 4/5] [2021-11-19 21:15:12,515][INFO ][test-runner-#26142%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] [21:15:12] : [Step 4/5] [21:15:12] : [Step 4/5] >>> +-------------------------------------------+ [21:15:12] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:15:12] : [Step 4/5] >>> +-------------------------------------------+ [21:15:12] : [Step 4/5] >>> OS name: Linux 4.15.0-151-generic amd64 [21:15:12] : [Step 4/5] >>> CPU(s): 24 [21:15:12] : [Step 4/5] >>> Heap: 2.0GB [21:15:12] : [Step 4/5] >>> VM name: 16724@c4dfe9a430b2 [21:15:12] : [Step 4/5] >>> Ignite instance name: grid-1 [21:15:12] : [Step 4/5] >>> Local node [ID=1052A2C5-C72C-401D-95D8-7080CBCD9001, order=2, clientMode=false] [21:15:12] : [Step 4/5] >>> Local node addresses: [127.0.0.1] [21:15:12] : [Step 4/5] >>> Local ports: TCP:10801 TCP:47101 TCP:47501 [21:15:12] : [Step 4/5] [21:15:12] : [Step 4/5] [2021-11-19 21:15:12,516][INFO ][test-runner-#26142%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] >>> Ignite cluster is in INACTIVE state (limited functionality available). Use control.(sh|bat) script or IgniteCluster.state(ClusterState.ACTIVE) to change the state. [21:15:12] : [Step 4/5] [2021-11-19 21:15:12,516][INFO ][test-runner-#26142%encryption.CacheGroupKeyChangeTest%][GridDiscoveryManager] Topology snapshot [ver=2, locNode=1052a2c5, servers=2, clients=0, state=INACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=00bad9b2-ce92-47f0-af24-2b5fe059d000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=1052a2c5-c72c-401d-95d8-7080cbcd9001, consistentId=grid-1, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:15:12] : [Step 4/5] [2021-11-19 21:15:12,517][INFO ][test-runner-#26142%encryption.CacheGroupKeyChangeTest%][G] Node started : [stage="Configure system pool" (0 ms),stage="Start managers" (198 ms),stage="Configure binary metadata" (1 ms),stage="Start processors" (191 ms),stage="Start 'StanByClusterTestProvider' plugin" (0 ms),stage="Start 'PageMemory tracker plugin' plugin" (0 ms),stage="Start 'TestDistibutedConfigurationPlugin' plugin" (0 ms),stage="Start 'NodeValidationPluginProvider' plugin" (0 ms),stage="Init metastore" (17 ms),stage="Init and start regions" (6 ms),stage="Restore binary memory" (15 ms),stage="Restore logical state" (7 ms),stage="Finish recovery" (3 ms),stage="Join topology" (49 ms),stage="Await transition" (2 ms),stage="Await exchange" (28 ms),stage="Total time" (517 ms)] [21:15:12] : [Step 4/5] [2021-11-19 21:15:12,518][INFO ][test-runner-#26142%encryption.CacheGroupKeyChangeTest%][root] Node started with the following configuration [id=1052a2c5-c72c-401d-95d8-7080cbcd9001, marshaller=BinaryMarshaller [], discovery=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=5000, ackTimeout=5000, marsh=JdkMarshaller [clsFilter=org.apache.ignite.marshaller.MarshallerUtils$1@124e74dd], reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], binaryCfg=null, lateAff=true] [21:15:12] : [Step 4/5] [2021-11-19 21:15:12,521][INFO ][test-runner-#26142%encryption.CacheGroupKeyChangeTest%][GridClusterStateProcessor] Sending activate cluster request with BaselineTopology BaselineTopology [id=0, branchingHash=-2475315501, branchingType='New BaselineTopology', baselineNodes=[grid-1, grid-0]] [21:15:12] : [Step 4/5] [2021-11-19 21:15:12,526][INFO ][disco-notifier-worker-#26254%grid-0%][GridClusterStateProcessor] Received activate cluster request with BaselineTopology[id=0] initiator node ID: 00bad9b2-ce92-47f0-af24-2b5fe059d000 [21:15:12] : [Step 4/5] [2021-11-19 21:15:12,526][INFO ][disco-notifier-worker-#26254%grid-0%][GridClusterStateProcessor] Started state transition: activate cluster [21:15:12] : [Step 4/5] [2021-11-19 21:15:12,527][INFO ][exchange-worker-#26259%grid-0%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], crd=true, evt=DISCOVERY_CUSTOM_EVT, evtNode=00bad9b2-ce92-47f0-af24-2b5fe059d000, customEvt=ChangeGlobalStateMessage [id=c573e593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqId=0e0351b8-552a-4196-8a8c-1e82aa465d30, initiatingNodeId=00bad9b2-ce92-47f0-af24-2b5fe059d000, state=ACTIVE, baselineTopology=BaselineTopology [id=0, branchingHash=-2475315501, branchingType='New BaselineTopology', baselineNodes=[grid-1, grid-0]], forceChangeBaselineTopology=false, timestamp=1637345712521, forceDeactivation=true], allowMerge=false, exchangeFreeSwitch=false] [21:15:12] : [Step 4/5] [2021-11-19 21:15:12,527][INFO ][disco-notifier-worker-#26373%grid-1%][GridClusterStateProcessor] Received activate cluster request with BaselineTopology[id=0] initiator node ID: 00bad9b2-ce92-47f0-af24-2b5fe059d000 [21:15:12] : [Step 4/5] [2021-11-19 21:15:12,528][INFO ][exchange-worker-#26259%grid-0%][GridDhtPartitionsExchangeFuture] Start activation process [nodeId=00bad9b2-ce92-47f0-af24-2b5fe059d000, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]]. New state: ACTIVE [21:15:12] : [Step 4/5] [2021-11-19 21:15:12,528][INFO ][disco-notifier-worker-#26373%grid-1%][GridClusterStateProcessor] Started state transition: activate cluster [21:15:12] : [Step 4/5] [2021-11-19 21:15:12,529][INFO ][exchange-worker-#26259%grid-0%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0 [21:15:12] : [Step 4/5] [2021-11-19 21:15:12,529][INFO ][exchange-worker-#26382%grid-1%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], crd=false, evt=DISCOVERY_CUSTOM_EVT, evtNode=00bad9b2-ce92-47f0-af24-2b5fe059d000, customEvt=ChangeGlobalStateMessage [id=c573e593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqId=0e0351b8-552a-4196-8a8c-1e82aa465d30, initiatingNodeId=00bad9b2-ce92-47f0-af24-2b5fe059d000, state=ACTIVE, baselineTopology=BaselineTopology [id=0, branchingHash=-2475315501, branchingType='New BaselineTopology', baselineNodes=[grid-1, grid-0]], forceChangeBaselineTopology=false, timestamp=1637345712521, forceDeactivation=true], allowMerge=false, exchangeFreeSwitch=false] [21:15:12] : [Step 4/5] [2021-11-19 21:15:12,532][INFO ][exchange-worker-#26382%grid-1%][GridDhtPartitionsExchangeFuture] Start activation process [nodeId=1052a2c5-c72c-401d-95d8-7080cbcd9001, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]]. New state: ACTIVE [21:15:12] : [Step 4/5] [2021-11-19 21:15:12,532][INFO ][exchange-worker-#26382%grid-1%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1 [21:15:12] : [Step 4/5] [2021-11-19 21:15:12,537][INFO ][exchange-worker-#26259%grid-0%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000000.wal, offset=8795, ver=2] [21:15:12] : [Step 4/5] [2021-11-19 21:15:12,549][INFO ][exchange-worker-#26259%grid-0%][GridClusterStateProcessor] Writing BaselineTopology[id=0] [21:15:12] : [Step 4/5] [2021-11-19 21:15:12,549][INFO ][exchange-worker-#26382%grid-1%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000000.wal, offset=8795, ver=2] [21:15:12] : [Step 4/5] [2021-11-19 21:15:12,550][INFO ][exchange-worker-#26382%grid-1%][GridClusterStateProcessor] Writing BaselineTopology[id=0] [21:15:12] : [Step 4/5] [2021-11-19 21:15:12,625][INFO ][exchange-worker-#26259%grid-0%][GridCacheDatabaseSharedManager] Finish recovery performed in 95 ms. [21:15:12] : [Step 4/5] [2021-11-19 21:15:12,634][INFO ][exchange-worker-#26382%grid-1%][GridCacheDatabaseSharedManager] Finish recovery performed in 101 ms. [21:15:12] : [Step 4/5] [2021-11-19 21:15:12,635][INFO ][exchange-worker-#26259%grid-0%][msg] Components activation performed in 106 ms. [21:15:12] : [Step 4/5] [2021-11-19 21:15:12,635][INFO ][exchange-worker-#26382%grid-1%][msg] Components activation performed in 103 ms. [21:15:12] : [Step 4/5] [2021-11-19 21:15:12,636][INFO ][exchange-worker-#26259%grid-0%][GridCacheProcessor] Finished recovery for cache [cache=ignite-sys-cache, grp=ignite-sys-cache, startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:15:12] : [Step 4/5] [2021-11-19 21:15:12,636][INFO ][exchange-worker-#26382%grid-1%][GridCacheProcessor] Finished recovery for cache [cache=ignite-sys-cache, grp=ignite-sys-cache, startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:15:12] : [Step 4/5] [2021-11-19 21:15:12,637][INFO ][exchange-worker-#26259%grid-0%][GridDhtPartitionsExchangeFuture] Successfully activated caches [nodeId=00bad9b2-ce92-47f0-af24-2b5fe059d000, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], newState=ACTIVE] [21:15:12] : [Step 4/5] [2021-11-19 21:15:12,637][INFO ][exchange-worker-#26382%grid-1%][GridDhtPartitionsExchangeFuture] Successfully activated caches [nodeId=1052a2c5-c72c-401d-95d8-7080cbcd9001, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], newState=ACTIVE] [21:15:12] : [Step 4/5] [2021-11-19 21:15:12,637][INFO ][exchange-worker-#26259%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:15:12] : [Step 4/5] [2021-11-19 21:15:12,638][INFO ][exchange-worker-#26382%grid-1%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:15:12] : [Step 4/5] [2021-11-19 21:15:12,657][INFO ][exchange-worker-#26259%grid-0%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], crd=true] [21:15:12] : [Step 4/5] [2021-11-19 21:15:12,659][INFO ][grid-nio-worker-tcp-comm-0-#26197%TestRecordingCommunicationSpi%][TestRecordingCommunicationSpi] Accepted incoming communication connection [locAddr=/127.0.0.1:47100, rmtAddr=/127.0.0.1:35580] [21:15:12] : [Step 4/5] [2021-11-19 21:15:12,661][INFO ][grid-nio-worker-tcp-comm-0-#26316%TestRecordingCommunicationSpi%][TestRecordingCommunicationSpi] Established outgoing communication connection [locAddr=/127.0.0.1:35580, rmtAddr=/127.0.0.1:47100] [21:15:12] : [Step 4/5] [2021-11-19 21:15:12,662][INFO ][exchange-worker-#26382%grid-1%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], crd=false] [21:15:12] : [Step 4/5] [2021-11-19 21:15:12,663][INFO ][sys-#26243%grid-0%][GridDhtPartitionsExchangeFuture] Coordinator received single message [ver=AffinityTopologyVersion [topVer=2, minorTopVer=1], node=1052a2c5-c72c-401d-95d8-7080cbcd9001, allReceived=true] [21:15:12] : [Step 4/5] [2021-11-19 21:15:12,664][INFO ][sys-#26243%grid-0%][GridDhtPartitionsExchangeFuture] finishExchangeOnCoordinator [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:15:12] : [Step 4/5] [2021-11-19 21:15:12,669][INFO ][sys-#26243%grid-0%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], err=null, rebalanced=true, wasRebalanced=false] [21:15:12] : [Step 4/5] [2021-11-19 21:15:12,670][INFO ][sys-#26362%grid-1%][GridDhtPartitionsExchangeFuture] Received full message, will finish exchange [node=00bad9b2-ce92-47f0-af24-2b5fe059d000, resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:15:12] : [Step 4/5] [2021-11-19 21:15:12,670][INFO ][disco-notifier-worker-#26254%grid-0%][GridClusterStateProcessor] Received state change finish message: ACTIVE [21:15:12] : [Step 4/5] [2021-11-19 21:15:12,671][INFO ][disco-notifier-worker-#26373%grid-1%][GridClusterStateProcessor] Received state change finish message: ACTIVE [21:15:12] : [Step 4/5] [2021-11-19 21:15:12,671][INFO ][disco-notifier-worker-#26254%grid-0%][GridClusterStateProcessor] Cluster state was changed from INACTIVE to ACTIVE [21:15:12] : [Step 4/5] [2021-11-19 21:15:12,673][INFO ][sys-#26243%grid-0%][GridCacheProcessor] Finish proxy initialization, cacheName=ignite-sys-cache, localNodeId=00bad9b2-ce92-47f0-af24-2b5fe059d000 [21:15:12] : [Step 4/5] [2021-11-19 21:15:12,672][INFO ][sys-#26362%grid-1%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], err=null, rebalanced=true, wasRebalanced=false] [21:15:12] : [Step 4/5] [2021-11-19 21:15:12,672][INFO ][disco-notifier-worker-#26373%grid-1%][GridClusterStateProcessor] Cluster state was changed from INACTIVE to ACTIVE [21:15:12] : [Step 4/5] [2021-11-19 21:15:12,673][INFO ][sys-#26243%grid-0%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=00bad9b2-ce92-47f0-af24-2b5fe059d000, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=00bad9b2-ce92-47f0-af24-2b5fe059d000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345712665, loc=true, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:15:12] : [Step 4/5] [2021-11-19 21:15:12,673][INFO ][exchange-worker-#26259%grid-0%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=2, minorTopVer=1], force=false, evt=DISCOVERY_CUSTOM_EVT, node=00bad9b2-ce92-47f0-af24-2b5fe059d000] [21:15:12] : [Step 4/5] [2021-11-19 21:15:12,673][INFO ][sys-#26251%grid-0%][DistributedBaselineConfiguration] Baseline auto-adjust is 'disabled' with timeout='300000' ms [21:15:12] : [Step 4/5] [2021-11-19 21:15:12,673][INFO ][sys-#26368%grid-1%][GridCachePartitionExchangeManager] Delay process full message without exchange id (there is exchange in progress) [nodeId=00bad9b2-ce92-47f0-af24-2b5fe059d000] [21:15:12] : [Step 4/5] [2021-11-19 21:15:12,677][INFO ][sys-#26251%grid-0%][GridClusterStateProcessor] Successfully performed final activation steps [nodeId=00bad9b2-ce92-47f0-af24-2b5fe059d000, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:15:12] : [Step 4/5] [2021-11-19 21:15:12,676][INFO ][sys-#26243%grid-0%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (1 ms), stage="Update caches registry" (108 ms), stage="Start caches" (0 ms), stage="Affinity initialization on cache group start" (0 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Restore partition states" (0 ms), stage="After states restored callback" (18 ms), stage="WAL history reservation" (0 ms), stage="Waiting for all single messages" (6 ms), stage="Affinity recalculation (crd)" (0 ms), stage="Collect update counters and create affinity messages" (0 ms), stage="Assign partitions states" (0 ms), stage="Validate partitions states" (0 ms), stage="Ideal affinity diff calculation (enforced)" (0 ms), stage="Apply update counters" (0 ms), stage="Full message preparing" (3 ms), stage="Full message sending" (0 ms), stage="State finish message sending" (0 ms), stage="Detect lost partitions" (2 ms), stage="Exchange done" (4 ms), stage="Total time" (142 ms), Discovery lag=3 ms, Latest started node id=1052a2c5-c72c-401d-95d8-7080cbcd9001] [21:15:12] : [Step 4/5] [2021-11-19 21:15:12,675][INFO ][sys-#26362%grid-1%][GridCacheProcessor] Finish proxy initialization, cacheName=ignite-sys-cache, localNodeId=1052a2c5-c72c-401d-95d8-7080cbcd9001 [21:15:12] : [Step 4/5] [2021-11-19 21:15:12,680][INFO ][sys-#26243%grid-0%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], stage="Affinity initialization on cache group start [grp=ignite-sys-cache]" (0 ms) (parent=Affinity initialization on cache group start), stage="Affinity centralized initialization (crd) [grp=ignite-sys-cache, crd=true]" (0 ms) (parent=Determine exchange type), stage="Restore partition states [grp=ignite-sys-cache]" (0 ms) (parent=Restore partition states), stage="Affinity recalculation (partitions availability) [grp=ignite-sys-cache]" (0 ms) (parent=Ideal affinity diff calculation (enforced))] [21:15:12] : [Step 4/5] [2021-11-19 21:15:12,682][INFO ][test-runner-#26142%encryption.CacheGroupKeyChangeTest%][root] awaitPartitionMapExchange finished [21:15:12] : [Step 4/5] [2021-11-19 21:15:12,681][INFO ][exchange-worker-#26382%grid-1%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=2, minorTopVer=1], force=false, evt=DISCOVERY_CUSTOM_EVT, node=00bad9b2-ce92-47f0-af24-2b5fe059d000] [21:15:12] : [Step 4/5] [2021-11-19 21:15:12,681][INFO ][sys-#26362%grid-1%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=1052a2c5-c72c-401d-95d8-7080cbcd9001, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=00bad9b2-ce92-47f0-af24-2b5fe059d000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345712463, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:15:12] : [Step 4/5] [2021-11-19 21:15:12,681][INFO ][sys-#26371%grid-1%][DistributedBaselineConfiguration] Baseline auto-adjust is 'disabled' with timeout='300000' ms [21:15:12] : [Step 4/5] [2021-11-19 21:15:12,685][INFO ][sys-#26371%grid-1%][GridClusterStateProcessor] Successfully performed final activation steps [nodeId=1052a2c5-c72c-401d-95d8-7080cbcd9001, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:15:12] : [Step 4/5] [2021-11-19 21:15:12,684][INFO ][sys-#26362%grid-1%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (2 ms), stage="Update caches registry" (104 ms), stage="Start caches" (0 ms), stage="Affinity initialization on cache group start" (0 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Restore partition states" (0 ms), stage="After states restored callback" (18 ms), stage="WAL history reservation" (0 ms), stage="Waiting for Full message" (13 ms), stage="Affinity recalculation" (1 ms), stage="Full map updating" (0 ms), stage="Detect lost partitions" (2 ms), stage="Exchange done" (10 ms), stage="Total time" (150 ms)] [21:15:12]W: [org.apache.ignite:ignite-core] [2021-11-19 21:15:12,687][WARN ][test-runner-#26142%encryption.CacheGroupKeyChangeTest%][G] Ignite work directory is not provided, automatically resolved to: /opt/buildagent/work/7bc1c54bc719b67c/work [21:15:12] : [Step 4/5] [2021-11-19 21:15:12,687][INFO ][sys-#26362%grid-1%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], stage="Affinity initialization on cache group start [grp=ignite-sys-cache]" (0 ms) (parent=Affinity initialization on cache group start), stage="Affinity centralized initialization (crd) [grp=ignite-sys-cache, crd=false]" (0 ms) (parent=Determine exchange type), stage="Restore partition states [grp=ignite-sys-cache]" (0 ms) (parent=Restore partition states), stage="Affinity applying from full message [grp=ignite-sys-cache]" (1 ms) (parent=Affinity recalculation)] [21:15:12] : [Step 4/5] [2021-11-19 21:15:12,688][INFO ][test-runner-#26142%encryption.CacheGroupKeyChangeTest%][IgniteKernal%client] [21:15:12] : [Step 4/5] [21:15:12] : [Step 4/5] >>> __________ ________________ [21:15:12] : [Step 4/5] >>> / _/ ___/ |/ / _/_ __/ __/ [21:15:12] : [Step 4/5] >>> _/ // (7 7 // / / / / _/ [21:15:12] : [Step 4/5] >>> /___/\___/_/|_/___/ /_/ /___/ [21:15:12] : [Step 4/5] >>> [21:15:12] : [Step 4/5] >>> ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:15:12] : [Step 4/5] >>> 2021 Copyright(C) Apache Software Foundation [21:15:12] : [Step 4/5] >>> [21:15:12] : [Step 4/5] >>> Ignite documentation: http://ignite.apache.org [21:15:12] : [Step 4/5] [21:15:12] : [Step 4/5] [2021-11-19 21:15:12,689][INFO ][test-runner-#26142%encryption.CacheGroupKeyChangeTest%][IgniteKernal%client] Config URL: n/a [21:15:12] : [Step 4/5] [2021-11-19 21:15:12,689][INFO ][test-runner-#26142%encryption.CacheGroupKeyChangeTest%][IgniteKernal%client] IgniteConfiguration [igniteInstanceName=client, pubPoolSize=24, svcPoolSize=24, callbackPoolSize=24, stripedPoolSize=24, sysPoolSize=24, mgmtPoolSize=4, dataStreamerPoolSize=24, utilityCachePoolSize=24, utilityCacheKeepAliveTime=60000, p2pPoolSize=2, qryPoolSize=24, buildIdxPoolSize=4, igniteHome=/opt/buildagent/work/7bc1c54bc719b67c, igniteWorkDir=/opt/buildagent/work/7bc1c54bc719b67c/work, mbeanSrv=com.sun.jmx.mbeanserver.JmxMBeanServer@6fe85038, nodeId=f1163f0c-f906-4318-aeb9-1e15a84f1931, marsh=BinaryMarshaller [], marshLocJobs=false, daemon=false, p2pEnabled=true, netTimeout=10000, netCompressionLevel=1, sndRetryDelay=1000, sndRetryCnt=3, metricsHistSize=10000, metricsUpdateFreq=1000, metricsExpTime=9223372036854775807, discoSpi=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=0, ackTimeout=0, marsh=null, reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], segPlc=STOP, segResolveAttempts=2, waitForSegOnStart=true, allResolversPassReq=true, segChkFreq=10000, commSpi=TcpCommunicationSpi [connectGate=org.apache.ignite.spi.communication.tcp.internal.ConnectGateway@20ac142a, ctxInitLatch=java.util.concurrent.CountDownLatch@55fc4b2e[Count = 1], stopping=false, clientPool=null, nioSrvWrapper=null, stateProvider=null], evtSpi=MemoryEventStorageSpi [expireAgeMs=9223372036854775807, expireCnt=10000, filter=null], colSpi=NoopCollisionSpi [], deploySpi=LocalDeploymentSpi [], indexingSpi=org.apache.ignite.spi.indexing.noop.NoopIndexingSpi@51a2902, addrRslvr=null, encryptionSpi=org.apache.ignite.spi.encryption.keystore.KeystoreEncryptionSpi@26e56e82, tracingSpi=org.apache.ignite.spi.tracing.NoopTracingSpi@7b4eea58, clientMode=true, rebalanceThreadPoolSize=4, rebalanceTimeout=10000, rebalanceBatchesPrefetchCnt=3, rebalanceThrottle=0, rebalanceBatchSize=524288, txCfg=TransactionConfiguration [txSerEnabled=false, dfltIsolation=REPEATABLE_READ, dfltConcurrency=PESSIMISTIC, dfltTxTimeout=0, txTimeoutOnPartitionMapExchange=0, deadlockTimeout=10000, pessimisticTxLogSize=0, pessimisticTxLogLinger=10000, tmLookupClsName=null, txManagerFactory=null, useJtaSync=false], cacheSanityCheckEnabled=true, discoStartupDelay=60000, deployMode=SHARED, p2pMissedCacheSize=100, locHost=127.0.0.1, timeSrvPortBase=31100, timeSrvPortRange=100, failureDetectionTimeout=10000, sysWorkerBlockedTimeout=null, clientFailureDetectionTimeout=10000, metricsLogFreq=0, connectorCfg=null, odbcCfg=null, warmupClos=null, atomicCfg=AtomicConfiguration [seqReserveSize=1000, cacheMode=PARTITIONED, backups=1, aff=null, grpName=null], classLdr=null, sslCtxFactory=null, platformCfg=null, binaryCfg=null, memCfg=null, pstCfg=null, dsCfg=DataStorageConfiguration [sysRegionInitSize=41943040, sysRegionMaxSize=104857600, pageSize=4096, concLvl=0, dfltDataRegConf=DataRegionConfiguration [name=default, maxSize=104857600, initSize=268435456, swapPath=null, pageEvictionMode=DISABLED, pageReplacementMode=CLOCK, evictionThreshold=0.9, emptyPagesPoolSize=100, metricsEnabled=false, metricsSubIntervalCount=5, metricsRateTimeInterval=60000, persistenceEnabled=true, checkpointPageBufSize=0, lazyMemoryAllocation=true, warmUpCfg=null], dataRegions=null, storagePath=null, checkpointFreq=30000, lockWaitTime=10000, checkpointThreads=4, checkpointWriteOrder=SEQUENTIAL, walHistSize=20, maxWalArchiveSize=20971520, walSegments=10, walSegmentSize=1048576, walPath=db/wal, walArchivePath=db/wal/archive, cdcWalPath=db/wal/cdc, cdcEnabled=false, metricsEnabled=false, walMode=LOG_ONLY, walTlbSize=131072, walBuffSize=0, walFlushFreq=2000, walFsyncDelay=1000, walRecordIterBuffSize=67108864, alwaysWriteFullPages=false, fileIOFactory=org.apache.ignite.internal.processors.cache.persistence.file.AsyncFileIOFactory@643f10bb, metricsSubIntervalCnt=5, metricsRateTimeInterval=60000, walAutoArchiveAfterInactivity=-1, walForceArchiveTimeout=-1, writeThrottlingEnabled=false, walCompactionEnabled=false, walCompactionLevel=1, checkpointReadLockTimeout=null, walPageCompression=DISABLED, walPageCompressionLevel=null, dfltWarmUpCfg=null, encCfg=org.apache.ignite.configuration.EncryptionConfiguration@337ee6a7, defragmentationThreadPoolSize=4, minWalArchiveSize=-1], snapshotPath=snapshots, activeOnStart=true, activeOnStartPropSetFlag=false, autoActivation=true, autoActivationPropSetFlag=false, clusterStateOnStart=null, sqlConnCfg=null, cliConnCfg=ClientConnectorConfiguration [host=null, port=10800, portRange=100, sockSndBufSize=0, sockRcvBufSize=0, tcpNoDelay=true, maxOpenCursorsPerConn=128, threadPoolSize=24, selectorCnt=12, idleTimeout=0, handshakeTimeout=10000, jdbcEnabled=true, odbcEnabled=true, thinCliEnabled=true, sslEnabled=false, useIgniteSslCtxFactory=true, sslClientAuth=false, sslCtxFactory=null, thinCliCfg=ThinClientConfiguration [maxActiveTxPerConn=100, maxActiveComputeTasksPerConn=0]], mvccVacuumThreadCnt=2, mvccVacuumFreq=5000, authEnabled=false, failureHnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]], commFailureRslvr=null, sqlCfg=SqlConfiguration [longQryWarnTimeout=3000, dfltQryTimeout=0, sqlQryHistSize=1000, validationEnabled=false], asyncContinuationExecutor=null] [21:15:12] : [Step 4/5] [2021-11-19 21:15:12,698][INFO ][test-runner-#26142%encryption.CacheGroupKeyChangeTest%][IgniteKernal%client] Daemon mode: off [21:15:12] : [Step 4/5] [2021-11-19 21:15:12,698][INFO ][test-runner-#26142%encryption.CacheGroupKeyChangeTest%][IgniteKernal%client] OS: Linux 4.15.0-151-generic amd64 [21:15:12] : [Step 4/5] [2021-11-19 21:15:12,699][INFO ][test-runner-#26142%encryption.CacheGroupKeyChangeTest%][IgniteKernal%client] OS user: teamcity [21:15:12] : [Step 4/5] [2021-11-19 21:15:12,699][INFO ][test-runner-#26142%encryption.CacheGroupKeyChangeTest%][IgniteKernal%client] PID: 16724 [21:15:12] : [Step 4/5] [2021-11-19 21:15:12,699][INFO ][test-runner-#26142%encryption.CacheGroupKeyChangeTest%][IgniteKernal%client] Language runtime: Java Platform API Specification ver. 1.8 [21:15:12] : [Step 4/5] [2021-11-19 21:15:12,700][INFO ][test-runner-#26142%encryption.CacheGroupKeyChangeTest%][IgniteKernal%client] VM information: Java(TM) SE Runtime Environment 1.8.0_261-b12 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 25.261-b12 [21:15:12] : [Step 4/5] [2021-11-19 21:15:12,700][INFO ][test-runner-#26142%encryption.CacheGroupKeyChangeTest%][IgniteKernal%client] VM total memory: 1.9GB [21:15:12] : [Step 4/5] [2021-11-19 21:15:12,700][INFO ][test-runner-#26142%encryption.CacheGroupKeyChangeTest%][IgniteKernal%client] Remote Management [restart: off, REST: off, JMX (remote: off)] [21:15:12] : [Step 4/5] [2021-11-19 21:15:12,701][INFO ][test-runner-#26142%encryption.CacheGroupKeyChangeTest%][IgniteKernal%client] Logger: GridTestLog4jLogger [quiet=false, config=null] [21:15:12] : [Step 4/5] [2021-11-19 21:15:12,701][INFO ][test-runner-#26142%encryption.CacheGroupKeyChangeTest%][IgniteKernal%client] IGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c [21:15:12] : [Step 4/5] [2021-11-19 21:15:12,701][INFO ][test-runner-#26142%encryption.CacheGroupKeyChangeTest%][IgniteKernal%client] VM arguments: [-DIGNITE_DUMP_THREADS_ON_FAILURE=false, -DMono=/usr/bin/mono-sgen, -DMono4.0_x64=/usr/lib/mono/4.0, -DMono4.5_x64=/usr/lib/mono/4.5, -DMonoVersion=6.12.0.90, -DSKIP_BUILD=false, -Dagent.home.dir=/opt/buildagent, -Dagent.name=aitc-lin02_03, -Dagent.ownPort=9090, -Dagent.work.dir=/opt/buildagent/work, -Dbuild.number=95, -Dbuild.vcs.number=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.1=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.GitHubApacheIgnite=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dclassworlds.conf=/opt/buildagent/temp/buildTmp/teamcity.m2.conf, -Dcom.jetbrains.maven.watcher.report.file=/opt/buildagent/temp/buildTmp/maven-build-info.xml, -Djava.io.tmpdir=/opt/buildagent/temp/buildTmp, -Dmaven.home=/opt/buildagent/tools/maven3_6, -Dmaven.multiModuleProjectDirectory=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.agent.cpuBenchmark=457, -Dteamcity.agent.dotnet.agent_url=http://localhost:9090/RPC2, -Dteamcity.agent.dotnet.build_id=6278078, -Dteamcity.auth.password=*******, -Dteamcity.auth.userId=TeamCityBuildId=6278078, -Dteamcity.build.changedFiles.file=/opt/buildagent/temp/buildTmp/changedFiles6342607772318147725.txt, -Dteamcity.build.checkoutDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.build.id=6278078, -Dteamcity.build.properties.file=/opt/buildagent/temp/buildTmp/teamcity.build5164517880467851002.properties, -Dteamcity.build.tempDir=/opt/buildagent/temp/buildTmp, -Dteamcity.build.workingDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.buildConfName=Basic 3, -Dteamcity.buildType.id=IgniteTests24Java8_Basic3, -Dteamcity.configuration.properties.file=/opt/buildagent/temp/buildTmp/teamcity.config5591980786735343870.properties, -Dteamcity.maven.userSettings.path=/opt/buildagent/temp/buildTmp/maven_settings_585072866407032347.xml, -Dteamcity.maven.watcher.home=/opt/buildagent/plugins/mavenPlugin/maven-watcher-jdk16, -Dteamcity.projectName=Ignite Tests 2.x (JDK 8/11), -Dteamcity.runner.properties.file=/opt/buildagent/temp/buildTmp/teamcity.runner9098465561618137420.properties, -Dteamcity.tests.recentlyFailedTests.file=/opt/buildagent/temp/buildTmp/testsToRunFirst3891775683130404069.txt, -Dteamcity.version=2021.2 (build 99542), -ea, -Xms2g, -Xmx2g, -XX:+HeapDumpOnOutOfMemoryError, -DIGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_TEST_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_UPDATE_NOTIFIER=false, -DIGNITE_NO_DISCO_ORDER=true, -DIGNITE_PERFORMANCE_SUGGESTIONS_DISABLED=true, -Djava.net.preferIPv4Stack=true, -DTEST_SCALE_FACTOR=1.0, -DIGNITE_TEST_PROP_LOG4J_FILE=log4j-tc-test.xml, -DIGNITE_QUIET=false, -DIGNITE_MARSHAL_BUFFERS_RECHECK=1000, -Dmaven.repo.local=/opt/buildagent/.m2/repository] [21:15:12] : [Step 4/5] [2021-11-19 21:15:12,706][INFO ][test-runner-#26142%encryption.CacheGroupKeyChangeTest%][IgniteKernal%client] System cache's DataRegion size is configured to 40 MB. Use DataStorageConfiguration.systemRegionInitialSize property to change the setting. [21:15:12] : [Step 4/5] [2021-11-19 21:15:12,707][INFO ][test-runner-#26142%encryption.CacheGroupKeyChangeTest%][IgniteKernal%client] Configured caches [in 'sysMemPlc' dataRegion: ['ignite-sys-cache']] [21:15:12]W: [org.apache.ignite:ignite-core] [2021-11-19 21:15:12,707][WARN ][test-runner-#26142%encryption.CacheGroupKeyChangeTest%][IgniteKernal%client] Peer class loading is enabled (disable it in production for performance and deployment consistency reasons) [21:15:12] : [Step 4/5] [2021-11-19 21:15:12,708][INFO ][test-runner-#26142%encryption.CacheGroupKeyChangeTest%][IgniteKernal%client] 3-rd party licenses can be found at: /opt/buildagent/work/7bc1c54bc719b67c/libs/licenses [21:15:12] : [Step 4/5] [2021-11-19 21:15:12,712][INFO ][test-runner-#26142%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] Configured plugins: [21:15:12] : [Step 4/5] [2021-11-19 21:15:12,712][INFO ][test-runner-#26142%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- StanByClusterTestProvider 1.0 [21:15:12] : [Step 4/5] [2021-11-19 21:15:12,713][INFO ][test-runner-#26142%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:15:12] : [Step 4/5] [2021-11-19 21:15:12,713][INFO ][test-runner-#26142%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] [21:15:12] : [Step 4/5] [2021-11-19 21:15:12,713][INFO ][test-runner-#26142%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- PageMemory tracker plugin 1.0 [21:15:12] : [Step 4/5] [2021-11-19 21:15:12,714][INFO ][test-runner-#26142%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:15:12] : [Step 4/5] [2021-11-19 21:15:12,714][INFO ][test-runner-#26142%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] [21:15:12] : [Step 4/5] [2021-11-19 21:15:12,714][INFO ][test-runner-#26142%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- TestDistibutedConfigurationPlugin 1.0 [21:15:12] : [Step 4/5] [2021-11-19 21:15:12,714][INFO ][test-runner-#26142%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:15:12] : [Step 4/5] [2021-11-19 21:15:12,714][INFO ][test-runner-#26142%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] [21:15:12] : [Step 4/5] [2021-11-19 21:15:12,715][INFO ][test-runner-#26142%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- NodeValidationPluginProvider 1.0 [21:15:12] : [Step 4/5] [2021-11-19 21:15:12,715][INFO ][test-runner-#26142%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:15:12] : [Step 4/5] [2021-11-19 21:15:12,715][INFO ][test-runner-#26142%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] [21:15:12] : [Step 4/5] [2021-11-19 21:15:12,715][INFO ][test-runner-#26142%encryption.CacheGroupKeyChangeTest%][FailureProcessor] Configured failure handler: [hnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]]] [21:15:12] : [Step 4/5] [2021-11-19 21:15:12,742][INFO ][test-runner-#26142%encryption.CacheGroupKeyChangeTest%][TestRecordingCommunicationSpi] Successfully bound communication NIO server to TCP port [port=47102, locHost=/127.0.0.1, selectorsCnt=12, selectorSpins=0, pairedConn=false] [21:15:12]W: [org.apache.ignite:ignite-core] [2021-11-19 21:15:12,742][WARN ][test-runner-#26142%encryption.CacheGroupKeyChangeTest%][TestRecordingCommunicationSpi] Message queue limit is set to 0 which may lead to potential OOMEs when running cache operations in FULL_ASYNC or PRIMARY_SYNC modes due to message queues growth on sender and receiver sides. [21:15:12] : [Step 4/5] [2021-11-19 21:15:12,745][INFO ][test-runner-#26142%encryption.CacheGroupKeyChangeTest%][GridCollisionManager] Collision resolution is disabled (all jobs will be activated upon arrival). [21:15:12] : [Step 4/5] [2021-11-19 21:15:12,746][INFO ][test-runner-#26142%encryption.CacheGroupKeyChangeTest%][IgniteKernal%client] Security status [authentication=off, sandbox=off, tls/ssl=off] [21:15:12] : [Step 4/5] [2021-11-19 21:15:12,807][INFO ][test-runner-#26142%encryption.CacheGroupKeyChangeTest%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:15:12] : [Step 4/5] [2021-11-19 21:15:12,874][INFO ][db-checkpoint-thread-#26393%grid-1%][Checkpointer] Checkpoint started [checkpointId=eb58831b-2462-43d1-bdec-db80ba4171d9, startPtr=WALPointer [idx=0, fileOff=86661, len=1963], checkpointBeforeLockTime=13ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=199ms, writeCheckpointEntryDuration=18ms, splitAndSortCpPagesDuration=0ms, pages=18, reason='node started'] [21:15:12] : [Step 4/5] [2021-11-19 21:15:12,874][INFO ][db-checkpoint-thread-#26396%grid-0%][Checkpointer] Checkpoint started [checkpointId=70d2d8fb-8734-481a-a707-5e7b6ea33d1a, startPtr=WALPointer [idx=0, fileOff=86661, len=1963], checkpointBeforeLockTime=8ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=1ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=199ms, writeCheckpointEntryDuration=18ms, splitAndSortCpPagesDuration=0ms, pages=18, reason='node started'] [21:15:12]W: [org.apache.ignite:ignite-core] [2021-11-19 21:15:12,901][WARN ][test-runner-#26142%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Persistent Store is not supported on client nodes (Persistent Store's configuration will be ignored). [21:15:12] : [Step 4/5] [2021-11-19 21:15:12,903][INFO ][test-runner-#26142%encryption.CacheGroupKeyChangeTest%][IgniteCacheDatabaseSharedManager] Configured data regions initialized successfully [total=4] [21:15:12] : [Step 4/5] [2021-11-19 21:15:12,905][INFO ][test-runner-#26142%encryption.CacheGroupKeyChangeTest%][ClientListenerProcessor] Client connector processor has started on TCP port 10802 [21:15:12] : [Step 4/5] [2021-11-19 21:15:12,907][INFO ][test-runner-#26142%encryption.CacheGroupKeyChangeTest%][IgniteKernal%client] Non-loopback local IPs: 172.17.0.4 [21:15:12] : [Step 4/5] [2021-11-19 21:15:12,908][INFO ][test-runner-#26142%encryption.CacheGroupKeyChangeTest%][IgniteKernal%client] Enabled local MACs: 0242AC110004 [21:15:12] : [Step 4/5] [2021-11-19 21:15:12,908][INFO ][test-runner-#26142%encryption.CacheGroupKeyChangeTest%][ClusterProcessor] Cluster ID and tag has been read from metastorage: null [21:15:12] : [Step 4/5] [2021-11-19 21:15:12,908][INFO ][test-runner-#26142%encryption.CacheGroupKeyChangeTest%][IgniteClusterImpl] Shutdown policy was updated [oldVal=null, newVal=null] [21:15:12] : [Step 4/5] [2021-11-19 21:15:12,912][INFO ][tcp-disco-srvr-[:47501]-#1384%grid-1%-#26375%grid-1%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=33121] [21:15:12] : [Step 4/5] [2021-11-19 21:15:12,913][INFO ][tcp-disco-srvr-[:47501]-#1384%grid-1%-#26375%grid-1%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=33121] [21:15:12] : [Step 4/5] [2021-11-19 21:15:12,913][INFO ][tcp-disco-sock-reader-[]-#1395%grid-1%-#26500%grid-1%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:33121, rmtPort=33121] [21:15:12] : [Step 4/5] [2021-11-19 21:15:12,914][INFO ][tcp-disco-sock-reader-[f1163f0c 127.0.0.1:33121 client]-#1395%grid-1%-#26500%grid-1%][TestTcpDiscoverySpi] Initialized connection with remote client node [nodeId=f1163f0c-f906-4318-aeb9-1e15a84f1931, rmtAddr=/127.0.0.1:33121] [21:15:12] : [Step 4/5] [2021-11-19 21:15:12,925][INFO ][db-checkpoint-thread-#26396%grid-0%][Checkpointer] Checkpoint finished [cpId=70d2d8fb-8734-481a-a707-5e7b6ea33d1a, pages=18, markPos=WALPointer [idx=0, fileOff=86661, len=1963], walSegmentsCovered=[], markDuration=219ms, pagesWrite=1ms, fsync=49ms, total=277ms] [21:15:12] : [Step 4/5] [2021-11-19 21:15:12,925][INFO ][db-checkpoint-thread-#26393%grid-1%][Checkpointer] Checkpoint finished [cpId=eb58831b-2462-43d1-bdec-db80ba4171d9, pages=18, markPos=WALPointer [idx=0, fileOff=86661, len=1963], walSegmentsCovered=[], markDuration=217ms, pagesWrite=1ms, fsync=50ms, total=281ms] [21:15:12] : [Step 4/5] [2021-11-19 21:15:12,939][INFO ][disco-event-worker-#26258%grid-0%][GridDiscoveryManager] Added new node to topology: TcpDiscoveryNode [id=f1163f0c-f906-4318-aeb9-1e15a84f1931, consistentId=client, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:0], discPort=0, order=3, intOrder=3, lastExchangeTime=1637345712927, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=true] [21:15:12] : [Step 4/5] [2021-11-19 21:15:12,943][INFO ][tcp-client-disco-msg-worker-#1394%client%-#26498%client%][TestTcpDiscoverySpi] Router node: TcpDiscoveryNode [id=1052a2c5-c72c-401d-95d8-7080cbcd9001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637345712938, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false] [21:15:12] : [Step 4/5] [2021-11-19 21:15:12,941][INFO ][disco-event-worker-#26381%grid-1%][GridDiscoveryManager] Added new node to topology: TcpDiscoveryNode [id=f1163f0c-f906-4318-aeb9-1e15a84f1931, consistentId=client, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:0], discPort=0, order=3, intOrder=3, lastExchangeTime=1637345712927, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=true] [21:15:12] : [Step 4/5] [2021-11-19 21:15:12,944][INFO ][disco-event-worker-#26258%grid-0%][GridDiscoveryManager] Topology snapshot [ver=3, locNode=00bad9b2, servers=2, clients=1, state=ACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=00bad9b2-ce92-47f0-af24-2b5fe059d000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=1052a2c5-c72c-401d-95d8-7080cbcd9001, consistentId=grid-1, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=f1163f0c-f906-4318-aeb9-1e15a84f1931, consistentId=client, isClient=true, ver=2.13.0#20211119-sha1:00000000]]] [21:15:12] : [Step 4/5] [2021-11-19 21:15:12,945][INFO ][disco-event-worker-#26381%grid-1%][GridDiscoveryManager] Topology snapshot [ver=3, locNode=1052a2c5, servers=2, clients=1, state=ACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=00bad9b2-ce92-47f0-af24-2b5fe059d000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=1052a2c5-c72c-401d-95d8-7080cbcd9001, consistentId=grid-1, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=f1163f0c-f906-4318-aeb9-1e15a84f1931, consistentId=client, isClient=true, ver=2.13.0#20211119-sha1:00000000]]] [21:15:12] : [Step 4/5] [2021-11-19 21:15:12,946][INFO ][disco-event-worker-#26258%grid-0%][GridDiscoveryManager] ^-- Baseline [id=0, size=2, online=2, offline=0] [21:15:12] : [Step 4/5] [2021-11-19 21:15:12,948][INFO ][disco-event-worker-#26381%grid-1%][GridDiscoveryManager] ^-- Baseline [id=0, size=2, online=2, offline=0] [21:15:12] : [Step 4/5] [2021-11-19 21:15:12,948][INFO ][exchange-worker-#26259%grid-0%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], crd=true, evt=NODE_JOINED, evtNode=f1163f0c-f906-4318-aeb9-1e15a84f1931, customEvt=null, allowMerge=true, exchangeFreeSwitch=false] [21:15:12] : [Step 4/5] [2021-11-19 21:15:12,948][INFO ][exchange-worker-#26382%grid-1%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], crd=false, evt=NODE_JOINED, evtNode=f1163f0c-f906-4318-aeb9-1e15a84f1931, customEvt=null, allowMerge=true, exchangeFreeSwitch=false] [21:15:12] : [Step 4/5] [2021-11-19 21:15:12,949][INFO ][exchange-worker-#26259%grid-0%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], err=null, rebalanced=true, wasRebalanced=true] [21:15:12] : [Step 4/5] [2021-11-19 21:15:12,950][INFO ][tcp-client-disco-msg-worker-#1394%client%-#26498%client%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustEnabled' was changed from 'null' to 'false' [21:15:12] : [Step 4/5] [2021-11-19 21:15:12,950][INFO ][exchange-worker-#26382%grid-1%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], err=null, rebalanced=true, wasRebalanced=true] [21:15:12] : [Step 4/5] [2021-11-19 21:15:12,951][INFO ][tcp-client-disco-msg-worker-#1394%client%-#26498%client%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustTimeout' was changed from 'null' to '300000' [21:15:12] : [Step 4/5] [2021-11-19 21:15:12,952][INFO ][tcp-client-disco-msg-worker-#1394%client%-#26498%client%][IgniteTxManager] Transactions parameter 'collisionsDumpInterval' was changed from 'null' to '1000' [21:15:12] : [Step 4/5] [2021-11-19 21:15:12,953][INFO ][tcp-client-disco-msg-worker-#1394%client%-#26498%client%][IgniteTxManager] Transactions parameter 'longOperationsDumpTimeout' was changed from 'null' to '60000' [21:15:12] : [Step 4/5] [2021-11-19 21:15:12,951][INFO ][exchange-worker-#26259%grid-0%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=00bad9b2-ce92-47f0-af24-2b5fe059d000, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], evt=NODE_JOINED, evtNode=TcpDiscoveryNode [id=f1163f0c-f906-4318-aeb9-1e15a84f1931, consistentId=client, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:0], discPort=0, order=3, intOrder=3, lastExchangeTime=1637345712927, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=true], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0]] [21:15:12] : [Step 4/5] [2021-11-19 21:15:12,953][INFO ][tcp-client-disco-msg-worker-#1394%client%-#26498%client%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpSamplesPerSecondLimit' was changed from 'null' to '5' [21:15:12] : [Step 4/5] [2021-11-19 21:15:12,952][INFO ][exchange-worker-#26382%grid-1%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=1052a2c5-c72c-401d-95d8-7080cbcd9001, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], evt=NODE_JOINED, evtNode=TcpDiscoveryNode [id=f1163f0c-f906-4318-aeb9-1e15a84f1931, consistentId=client, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:0], discPort=0, order=3, intOrder=3, lastExchangeTime=1637345712927, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=true], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0]] [21:15:12] : [Step 4/5] [2021-11-19 21:15:12,955][INFO ][tcp-client-disco-msg-worker-#1394%client%-#26498%client%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpThreshold' was changed from 'null' to '0' [21:15:12] : [Step 4/5] [2021-11-19 21:15:12,954][INFO ][exchange-worker-#26259%grid-0%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (0 ms), stage="Determine exchange type" (0 ms), stage="Exchange done" (5 ms), stage="Total time" (5 ms)] [21:15:12] : [Step 4/5] [2021-11-19 21:15:12,957][INFO ][exchange-worker-#26259%grid-0%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=0]] [21:15:12] : [Step 4/5] [2021-11-19 21:15:12,956][INFO ][tcp-client-disco-msg-worker-#1394%client%-#26498%client%][IgniteTxManager] Transactions parameter 'transactionTimeDumpSamplesCoefficient' was changed from 'null' to '0.0' [21:15:12] : [Step 4/5] [2021-11-19 21:15:12,956][INFO ][exchange-worker-#26382%grid-1%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (1 ms), stage="Determine exchange type" (0 ms), stage="Exchange done" (6 ms), stage="Total time" (7 ms)] [21:15:12] : [Step 4/5] [2021-11-19 21:15:12,958][INFO ][tcp-client-disco-msg-worker-#1394%client%-#26498%client%][IgniteTxManager] Transactions parameter 'txOwnerDumpRequestsAllowed' was changed from 'null' to 'true' [21:15:12] : [Step 4/5] [2021-11-19 21:15:12,958][INFO ][exchange-worker-#26259%grid-0%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], crd=true] [21:15:12] : [Step 4/5] [2021-11-19 21:15:12,959][INFO ][tcp-client-disco-msg-worker-#1394%client%-#26498%client%][ClusterProcessor] epic_lederberg [21:15:12] : [Step 4/5] [2021-11-19 21:15:12,960][INFO ][exchange-worker-#26259%grid-0%][GridCachePartitionExchangeManager] AffinityTopologyVersion [topVer=3, minorTopVer=0], evt=NODE_JOINED, evtNode=f1163f0c-f906-4318-aeb9-1e15a84f1931, client=false] [21:15:12] : [Step 4/5] [2021-11-19 21:15:12,959][INFO ][exchange-worker-#26382%grid-1%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=0]] [21:15:12] : [Step 4/5] [2021-11-19 21:15:12,961][INFO ][disco-notifier-worker-#26495%client%][MvccProcessorImpl] Assigned mvcc coordinator [crd=MvccCoordinator [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], nodeId=00bad9b2-ce92-47f0-af24-2b5fe059d000, ver=1637345711960, local=false, initialized=false]] [21:15:12] : [Step 4/5] [2021-11-19 21:15:12,961][INFO ][exchange-worker-#26382%grid-1%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], crd=false] [21:15:12] : [Step 4/5] [2021-11-19 21:15:12,963][INFO ][sys-#26502%client%][ClusterProcessor] Writing cluster ID and tag to metastorage on ready for write ClusterIdAndTag [id=5bff0be8-7b75-4d20-ad86-5a53d27ee5f4, tag=epic_lederberg] [21:15:12] : [Step 4/5] [2021-11-19 21:15:12,963][INFO ][exchange-worker-#26382%grid-1%][GridCachePartitionExchangeManager] AffinityTopologyVersion [topVer=3, minorTopVer=0], evt=NODE_JOINED, evtNode=f1163f0c-f906-4318-aeb9-1e15a84f1931, client=false] [21:15:12] : [Step 4/5] [2021-11-19 21:15:12,978][INFO ][exchange-worker-#26504%client%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], crd=false, evt=NODE_JOINED, evtNode=f1163f0c-f906-4318-aeb9-1e15a84f1931, customEvt=null, allowMerge=true, exchangeFreeSwitch=false] [21:15:12] : [Step 4/5] [2021-11-19 21:15:12,979][INFO ][exchange-worker-#26504%client%][IgniteCacheDatabaseSharedManager] Data Regions Started: 4 [21:15:12] : [Step 4/5] [2021-11-19 21:15:12,980][INFO ][exchange-worker-#26504%client%][IgniteCacheDatabaseSharedManager] ^-- sysMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:15:12] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB, allocTotal=0MB] [21:15:12] : [Step 4/5] ^-- default region [type=default, persistence=true, lazyAlloc=true, [21:15:12] : [Step 4/5] ... initCfg=100MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB, allocTotal=0MB] [21:15:12] : [Step 4/5] ^-- TxLog region [type=internal, persistence=true, lazyAlloc=false, [21:15:12] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB, allocTotal=0MB] [21:15:12] : [Step 4/5] ^-- volatileDsMemPlc region [type=user, persistence=false, lazyAlloc=true, [21:15:12] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB] [21:15:12] : [Step 4/5] ^-- Ignite persistence [used=0MB] [21:15:12] : [Step 4/5] [21:15:12] : [Step 4/5] [2021-11-19 21:15:12,981][INFO ][exchange-worker-#26504%client%][msg] Components activation performed in 3 ms. [21:15:12] : [Step 4/5] [2021-11-19 21:15:12,983][INFO ][exchange-worker-#26504%client%][GridCacheProcessor] Started cache [name=ignite-sys-cache, id=-2100569601, dataRegionName=sysMemPlc, mode=REPLICATED, atomicity=TRANSACTIONAL, backups=2147483647, mvcc=false] [21:15:12] : [Step 4/5] [2021-11-19 21:15:12,984][INFO ][exchange-worker-#26504%client%][GridCacheProcessor] Starting caches on local join performed in 0 ms. [21:15:12] : [Step 4/5] [2021-11-19 21:15:12,985][INFO ][grid-nio-worker-tcp-comm-1-#26198%TestRecordingCommunicationSpi%][TestRecordingCommunicationSpi] Accepted incoming communication connection [locAddr=/127.0.0.1:47100, rmtAddr=/127.0.0.1:35584] [21:15:12] : [Step 4/5] [2021-11-19 21:15:12,987][INFO ][grid-nio-worker-tcp-comm-0-#26458%TestRecordingCommunicationSpi%][TestRecordingCommunicationSpi] Established outgoing communication connection [locAddr=/127.0.0.1:35584, rmtAddr=/127.0.0.1:47100] [21:15:12] : [Step 4/5] [2021-11-19 21:15:12,988][INFO ][exchange-worker-#26504%client%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], crd=false] [21:15:12] : [Step 4/5] [2021-11-19 21:15:12,991][INFO ][sys-#26235%grid-0%][GridCachePartitionExchangeManager] Fast replied to single message [exchId=GridDhtPartitionExchangeId [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], discoEvt=null, nodeId=f1163f0c, evt=NODE_JOINED], nodeId=f1163f0c-f906-4318-aeb9-1e15a84f1931] [21:15:13] : [Step 4/5] [2021-11-19 21:15:13,001][INFO ][sys-#26507%client%][GridDhtPartitionsExchangeFuture] Received full message, will finish exchange [node=00bad9b2-ce92-47f0-af24-2b5fe059d000, resVer=AffinityTopologyVersion [topVer=3, minorTopVer=0]] [21:15:13] : [Step 4/5] [2021-11-19 21:15:13,003][INFO ][sys-#26507%client%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], err=null, rebalanced=true, wasRebalanced=false] [21:15:13] : [Step 4/5] [2021-11-19 21:15:13,004][INFO ][sys-#26507%client%][GridCacheProcessor] Finish proxy initialization, cacheName=ignite-sys-cache, localNodeId=f1163f0c-f906-4318-aeb9-1e15a84f1931 [21:15:13] : [Step 4/5] [2021-11-19 21:15:13,005][INFO ][sys-#26507%client%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=f1163f0c-f906-4318-aeb9-1e15a84f1931, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], evt=NODE_JOINED, evtNode=TcpDiscoveryNode [id=f1163f0c-f906-4318-aeb9-1e15a84f1931, consistentId=client, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:0], discPort=0, order=3, intOrder=0, lastExchangeTime=1637345712907, loc=true, ver=2.13.0#20211119-sha1:00000000, isClient=true], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0]] [21:15:13] : [Step 4/5] [2021-11-19 21:15:13,005][INFO ][exchange-worker-#26504%client%][GridCachePartitionExchangeManager] AffinityTopologyVersion [topVer=3, minorTopVer=0], evt=NODE_JOINED, evtNode=f1163f0c-f906-4318-aeb9-1e15a84f1931, client=true] [21:15:13] : [Step 4/5] [2021-11-19 21:15:13,006][INFO ][sys-#26507%client%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], stage="Waiting in exchange queue" (16 ms), stage="Exchange parameters initialization" (0 ms), stage="Components activation" (3 ms), stage="Determine exchange type" (3 ms), stage="Waiting for Full message" (15 ms), stage="Affinity recalculation" (2 ms), stage="Full map updating" (0 ms), stage="Exchange done" (2 ms), stage="Total time" (41 ms)] [21:15:13] : [Step 4/5] [2021-11-19 21:15:13,007][INFO ][sys-#26507%client%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], stage="Affinity initialization (local join) [grp=ignite-sys-cache]" (2 ms) (parent=Affinity recalculation)] [21:15:13] : [Step 4/5] [2021-11-19 21:15:13,011][INFO ][test-runner-#26142%encryption.CacheGroupKeyChangeTest%][IgniteKernal%client] To start Console Management & Monitoring run ignitevisorcmd.{sh|bat} [21:15:13] : [Step 4/5] [2021-11-19 21:15:13,012][INFO ][test-runner-#26142%encryption.CacheGroupKeyChangeTest%][IgniteKernal%client] [21:15:13] : [Step 4/5] [21:15:13] : [Step 4/5] >>> +-------------------------------------------+ [21:15:13] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:15:13] : [Step 4/5] >>> +-------------------------------------------+ [21:15:13] : [Step 4/5] >>> OS name: Linux 4.15.0-151-generic amd64 [21:15:13] : [Step 4/5] >>> CPU(s): 24 [21:15:13] : [Step 4/5] >>> Heap: 2.0GB [21:15:13] : [Step 4/5] >>> VM name: 16724@c4dfe9a430b2 [21:15:13] : [Step 4/5] >>> Ignite instance name: client [21:15:13] : [Step 4/5] >>> Local node [ID=F1163F0C-F906-4318-AEB9-1E15A84F1931, order=3, clientMode=true] [21:15:13] : [Step 4/5] >>> Local node addresses: [127.0.0.1] [21:15:13] : [Step 4/5] >>> Local ports: TCP:10802 TCP:47102 [21:15:13] : [Step 4/5] [21:15:13] : [Step 4/5] [2021-11-19 21:15:13,013][INFO ][test-runner-#26142%encryption.CacheGroupKeyChangeTest%][GridDiscoveryManager] Topology snapshot [ver=3, locNode=f1163f0c, servers=2, clients=1, state=ACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=f1163f0c-f906-4318-aeb9-1e15a84f1931, consistentId=client, isClient=true, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=00bad9b2-ce92-47f0-af24-2b5fe059d000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=1052a2c5-c72c-401d-95d8-7080cbcd9001, consistentId=grid-1, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:15:13] : [Step 4/5] [2021-11-19 21:15:13,013][INFO ][test-runner-#26142%encryption.CacheGroupKeyChangeTest%][GridDiscoveryManager] ^-- Baseline [id=0, size=2, online=2, offline=0] [21:15:13] : [Step 4/5] [2021-11-19 21:15:13,014][INFO ][test-runner-#26142%encryption.CacheGroupKeyChangeTest%][G] Node started : [stage="Configure system pool" (0 ms),stage="Start managers" (211 ms),stage="Configure binary metadata" (1 ms),stage="Start processors" (7 ms),stage="Start 'StanByClusterTestProvider' plugin" (0 ms),stage="Start 'PageMemory tracker plugin' plugin" (0 ms),stage="Start 'TestDistibutedConfigurationPlugin' plugin" (0 ms),stage="Start 'NodeValidationPluginProvider' plugin" (0 ms),stage="Init metastore" (1 ms),stage="Finish recovery" (0 ms),stage="Join topology" (54 ms),stage="Await transition" (2 ms),stage="Await exchange" (48 ms),stage="Total time" (324 ms)] [21:15:13] : [Step 4/5] [2021-11-19 21:15:13,015][INFO ][test-runner-#26142%encryption.CacheGroupKeyChangeTest%][root] Node started with the following configuration [id=f1163f0c-f906-4318-aeb9-1e15a84f1931, marshaller=BinaryMarshaller [], discovery=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=5000, ackTimeout=5000, marsh=JdkMarshaller [clsFilter=org.apache.ignite.marshaller.MarshallerUtils$1@f610209], reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], binaryCfg=null, lateAff=true] [21:15:13] : [Step 4/5] [2021-11-19 21:15:13,027][INFO ][exchange-worker-#26259%grid-0%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], crd=true, evt=DISCOVERY_CUSTOM_EVT, evtNode=f1163f0c-f906-4318-aeb9-1e15a84f1931, customEvt=DynamicCacheChangeBatch [id=0e73e593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqs=ArrayList [DynamicCacheChangeRequest [cacheName=encrypted, hasCfg=true, nodeId=f1163f0c-f906-4318-aeb9-1e15a84f1931, clientStartOnly=false, stop=false, destroy=false, disabledAfterStart=false]], exchangeActions=ExchangeActions [startCaches=[encrypted], stopCaches=null, startGrps=[shared], stopGrps=[], resetParts=null, stateChangeRequest=null], startCaches=false], allowMerge=false, exchangeFreeSwitch=false] [21:15:13] : [Step 4/5] [2021-11-19 21:15:13,028][INFO ][exchange-worker-#26382%grid-1%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], crd=false, evt=DISCOVERY_CUSTOM_EVT, evtNode=f1163f0c-f906-4318-aeb9-1e15a84f1931, customEvt=DynamicCacheChangeBatch [id=0e73e593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqs=ArrayList [DynamicCacheChangeRequest [cacheName=encrypted, hasCfg=true, nodeId=f1163f0c-f906-4318-aeb9-1e15a84f1931, clientStartOnly=false, stop=false, destroy=false, disabledAfterStart=false]], exchangeActions=ExchangeActions [startCaches=[encrypted], stopCaches=null, startGrps=[shared], stopGrps=[], resetParts=null, stateChangeRequest=null], startCaches=false], allowMerge=false, exchangeFreeSwitch=false] [21:15:13] : [Step 4/5] [2021-11-19 21:15:13,029][INFO ][exchange-worker-#26504%client%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], crd=false, evt=DISCOVERY_CUSTOM_EVT, evtNode=f1163f0c-f906-4318-aeb9-1e15a84f1931, customEvt=DynamicCacheChangeBatch [id=0e73e593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqs=ArrayList [DynamicCacheChangeRequest [cacheName=encrypted, hasCfg=true, nodeId=f1163f0c-f906-4318-aeb9-1e15a84f1931, clientStartOnly=false, stop=false, destroy=false, disabledAfterStart=false]], exchangeActions=ExchangeActions [startCaches=[encrypted], stopCaches=null, startGrps=[shared], stopGrps=[], resetParts=null, stateChangeRequest=null], startCaches=false], allowMerge=false, exchangeFreeSwitch=false] [21:15:13] : [Step 4/5] [2021-11-19 21:15:13,032][INFO ][exchange-worker-#26382%grid-1%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:15:13] : [Step 4/5] [2021-11-19 21:15:13,039][INFO ][exchange-worker-#26504%client%][GridCacheProcessor] Started cache [name=encrypted, id=1613773252, group=shared, dataRegionName=default, mode=PARTITIONED, atomicity=ATOMIC, backups=0, mvcc=false] [21:15:13] : [Step 4/5] [2021-11-19 21:15:13,040][INFO ][exchange-worker-#26259%grid-0%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:15:13] : [Step 4/5] [2021-11-19 21:15:13,040][INFO ][exchange-worker-#26504%client%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], crd=false] [21:15:13] : [Step 4/5] [2021-11-19 21:15:13,042][INFO ][exchange-worker-#26382%grid-1%][GridCacheProcessor] Started cache [name=encrypted, id=1613773252, group=shared, dataRegionName=default, mode=PARTITIONED, atomicity=ATOMIC, backups=0, mvcc=false] [21:15:13] : [Step 4/5] [2021-11-19 21:15:13,043][INFO ][exchange-worker-#26382%grid-1%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], waitTime=0ms, futInfo=NA, mode=DISTRIBUTED] [21:15:13] : [Step 4/5] [2021-11-19 21:15:13,048][INFO ][exchange-worker-#26259%grid-0%][GridCacheProcessor] Started cache [name=encrypted, id=1613773252, group=shared, dataRegionName=default, mode=PARTITIONED, atomicity=ATOMIC, backups=0, mvcc=false] [21:15:13] : [Step 4/5] [2021-11-19 21:15:13,049][INFO ][exchange-worker-#26259%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], waitTime=0ms, futInfo=NA, mode=DISTRIBUTED] [21:15:13] : [Step 4/5] [2021-11-19 21:15:13,050][INFO ][exchange-worker-#26259%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partitions release latch: ServerLatch [permits=0, pendingAcks=HashSet [], super=CompletableLatch [id=CompletableLatchUid [id=exchange, topVer=AffinityTopologyVersion [topVer=3, minorTopVer=1]]]] [21:15:13] : [Step 4/5] [2021-11-19 21:15:13,050][INFO ][exchange-worker-#26382%grid-1%][GridDhtPartitionsExchangeFuture] Finished waiting for partitions release latch: ClientLatch [coordinator=TcpDiscoveryNode [id=00bad9b2-ce92-47f0-af24-2b5fe059d000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345712463, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], ackSent=true, super=CompletableLatch [id=CompletableLatchUid [id=exchange, topVer=AffinityTopologyVersion [topVer=3, minorTopVer=1]]]] [21:15:13] : [Step 4/5] [2021-11-19 21:15:13,050][INFO ][exchange-worker-#26259%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:15:13] : [Step 4/5] [2021-11-19 21:15:13,052][INFO ][exchange-worker-#26382%grid-1%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:15:13] : [Step 4/5] [2021-11-19 21:15:13,053][INFO ][exchange-worker-#26259%grid-0%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], crd=true] [21:15:13] : [Step 4/5] [2021-11-19 21:15:13,053][INFO ][exchange-worker-#26382%grid-1%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], crd=false] [21:15:13] : [Step 4/5] [2021-11-19 21:15:13,054][INFO ][sys-#26247%grid-0%][GridDhtPartitionsExchangeFuture] Coordinator received single message [ver=AffinityTopologyVersion [topVer=3, minorTopVer=1], node=1052a2c5-c72c-401d-95d8-7080cbcd9001, allReceived=true] [21:15:13] : [Step 4/5] [2021-11-19 21:15:13,055][INFO ][sys-#26247%grid-0%][GridDhtPartitionsExchangeFuture] finishExchangeOnCoordinator [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=1]] [21:15:13] : [Step 4/5] [2021-11-19 21:15:13,056][INFO ][sys-#26247%grid-0%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], err=null, rebalanced=true, wasRebalanced=true] [21:15:13] : [Step 4/5] [2021-11-19 21:15:13,058][INFO ][sys-#26360%grid-1%][GridDhtPartitionsExchangeFuture] Received full message, will finish exchange [node=00bad9b2-ce92-47f0-af24-2b5fe059d000, resVer=AffinityTopologyVersion [topVer=3, minorTopVer=1]] [21:15:13] : [Step 4/5] [2021-11-19 21:15:13,058][INFO ][sys-#26247%grid-0%][GridCacheProcessor] Finish proxy initialization, cacheName=encrypted, localNodeId=00bad9b2-ce92-47f0-af24-2b5fe059d000 [21:15:13] : [Step 4/5] [2021-11-19 21:15:13,063][INFO ][sys-#26247%grid-0%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=00bad9b2-ce92-47f0-af24-2b5fe059d000, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=f1163f0c-f906-4318-aeb9-1e15a84f1931, consistentId=client, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:0], discPort=0, order=3, intOrder=3, lastExchangeTime=1637345712927, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=true], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=3, minorTopVer=1]] [21:15:13] : [Step 4/5] [2021-11-19 21:15:13,063][INFO ][exchange-worker-#26259%grid-0%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=3, minorTopVer=1], force=false, evt=DISCOVERY_CUSTOM_EVT, node=f1163f0c-f906-4318-aeb9-1e15a84f1931] [21:15:13] : [Step 4/5] [2021-11-19 21:15:13,064][INFO ][sys-#26360%grid-1%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], err=null, rebalanced=true, wasRebalanced=true] [21:15:13] : [Step 4/5] [2021-11-19 21:15:13,064][INFO ][sys-#26247%grid-0%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (1 ms), stage="Update caches registry" (8 ms), stage="Start caches" (12 ms), stage="Affinity initialization on cache group start" (0 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Wait partitions release latch [latch=exchange]" (0 ms), stage="Wait partitions release [latch=exchange]" (1 ms), stage="Restore partition states" (0 ms), stage="After states restored callback" (0 ms), stage="WAL history reservation" (0 ms), stage="Waiting for all single messages" (1 ms), stage="Affinity recalculation (crd)" (0 ms), stage="Collect update counters and create affinity messages" (0 ms), stage="Assign partitions states" (0 ms), stage="Validate partitions states" (0 ms), stage="Apply update counters" (0 ms), stage="Full message preparing" (0 ms), stage="Full message sending" (0 ms), stage="Exchange done" (7 ms), stage="Total time" (30 ms), Discovery lag=2 ms, Latest started node id=1052a2c5-c72c-401d-95d8-7080cbcd9001] [21:15:13] : [Step 4/5] [2021-11-19 21:15:13,065][INFO ][sys-#26360%grid-1%][GridCacheProcessor] Finish proxy initialization, cacheName=encrypted, localNodeId=1052a2c5-c72c-401d-95d8-7080cbcd9001 [21:15:13] : [Step 4/5] [2021-11-19 21:15:13,067][INFO ][sys-#26247%grid-0%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], stage="Affinity initialization on cache group start [grp=shared]" (0 ms) (parent=Affinity initialization on cache group start), stage="Restore partition states [grp=shared]" (0 ms) (parent=Restore partition states), stage="Restore partition states [grp=ignite-sys-cache]" (0 ms) (parent=Restore partition states)] [21:15:13] : [Step 4/5] [2021-11-19 21:15:13,068][INFO ][sys-#26360%grid-1%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=1052a2c5-c72c-401d-95d8-7080cbcd9001, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=f1163f0c-f906-4318-aeb9-1e15a84f1931, consistentId=client, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:0], discPort=0, order=3, intOrder=3, lastExchangeTime=1637345712927, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=true], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=3, minorTopVer=1]] [21:15:13] : [Step 4/5] [2021-11-19 21:15:13,070][INFO ][sys-#26360%grid-1%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (1 ms), stage="Update caches registry" (0 ms), stage="Start caches" (11 ms), stage="Affinity initialization on cache group start" (0 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (2 ms), stage="Wait partitions release latch [latch=exchange]" (6 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Restore partition states" (0 ms), stage="After states restored callback" (0 ms), stage="WAL history reservation" (0 ms), stage="Waiting for Full message" (5 ms), stage="Affinity recalculation" (0 ms), stage="Full map updating" (5 ms), stage="Exchange done" (5 ms), stage="Total time" (35 ms)] [21:15:13] : [Step 4/5] [2021-11-19 21:15:13,071][INFO ][sys-#26360%grid-1%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], stage="Affinity initialization on cache group start [grp=shared]" (0 ms) (parent=Affinity initialization on cache group start), stage="Restore partition states [grp=shared]" (0 ms) (parent=Restore partition states), stage="Restore partition states [grp=ignite-sys-cache]" (0 ms) (parent=Restore partition states)] [21:15:13] : [Step 4/5] [2021-11-19 21:15:13,072][INFO ][exchange-worker-#26382%grid-1%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=3, minorTopVer=1], force=false, evt=DISCOVERY_CUSTOM_EVT, node=f1163f0c-f906-4318-aeb9-1e15a84f1931] [21:15:13] : [Step 4/5] [2021-11-19 21:15:13,074][INFO ][sys-#26521%client%][GridDhtPartitionsExchangeFuture] Received full message, will finish exchange [node=00bad9b2-ce92-47f0-af24-2b5fe059d000, resVer=AffinityTopologyVersion [topVer=3, minorTopVer=1]] [21:15:13] : [Step 4/5] [2021-11-19 21:15:13,076][INFO ][sys-#26521%client%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], err=null, rebalanced=true, wasRebalanced=true] [21:15:13] : [Step 4/5] [2021-11-19 21:15:13,077][INFO ][sys-#26521%client%][GridCacheProcessor] Finish proxy initialization, cacheName=encrypted, localNodeId=f1163f0c-f906-4318-aeb9-1e15a84f1931 [21:15:13] : [Step 4/5] [2021-11-19 21:15:13,077][INFO ][exchange-worker-#26504%client%][GridCachePartitionExchangeManager] AffinityTopologyVersion [topVer=3, minorTopVer=1], evt=DISCOVERY_CUSTOM_EVT, evtNode=f1163f0c-f906-4318-aeb9-1e15a84f1931, client=true] [21:15:13] : [Step 4/5] [2021-11-19 21:15:13,077][INFO ][sys-#26521%client%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=f1163f0c-f906-4318-aeb9-1e15a84f1931, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=f1163f0c-f906-4318-aeb9-1e15a84f1931, consistentId=client, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:0], discPort=0, order=3, intOrder=0, lastExchangeTime=1637345712907, loc=true, ver=2.13.0#20211119-sha1:00000000, isClient=true], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=3, minorTopVer=1]] [21:15:13] : [Step 4/5] [2021-11-19 21:15:13,079][INFO ][grid-nio-worker-tcp-comm-1-#26317%TestRecordingCommunicationSpi%][TestRecordingCommunicationSpi] Accepted incoming communication connection [locAddr=/127.0.0.1:47101, rmtAddr=/127.0.0.1:41122] [21:15:13] : [Step 4/5] [2021-11-19 21:15:13,080][INFO ][sys-#26521%client%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (2 ms), stage="Update caches registry" (0 ms), stage="Start caches" (7 ms), stage="Affinity initialization on cache group start" (0 ms), stage="Determine exchange type" (0 ms), stage="Waiting for Full message" (33 ms), stage="Affinity recalculation" (0 ms), stage="Full map updating" (2 ms), stage="Exchange done" (3 ms), stage="Total time" (47 ms)] [21:15:13] : [Step 4/5] [2021-11-19 21:15:13,085][INFO ][grid-nio-worker-tcp-comm-1-#26459%TestRecordingCommunicationSpi%][TestRecordingCommunicationSpi] Established outgoing communication connection [locAddr=/127.0.0.1:41122, rmtAddr=/127.0.0.1:47101] [21:15:13] : [Step 4/5] [2021-11-19 21:15:13,085][INFO ][sys-#26521%client%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], stage="Affinity initialization on cache group start [grp=shared]" (0 ms) (parent=Affinity initialization on cache group start)] [21:15:13] : [Step 4/5] [2021-11-19 21:15:13,170][INFO ][test-runner-#26142%encryption.CacheGroupKeyChangeTest%][root] awaitPartitionMapExchange finished [21:15:13] : [Step 4/5] [2021-11-19 21:15:13,173][INFO ][disco-notifier-worker-#26373%grid-1%][IgniteTestResources] Block message [node=00bad9b2-ce92-47f0-af24-2b5fe059d000, order=1, msg=org.apache.ignite.internal.util.distributed.SingleNodeMessage@2db63c6d] [21:15:13] : [Step 4/5] [2021-11-19 21:15:13,174][INFO ][test-runner-#26142%encryption.CacheGroupKeyChangeTest%][IgniteTestResources] Send blocked message [node=00bad9b2-ce92-47f0-af24-2b5fe059d000, order=1, msg=org.apache.ignite.internal.util.distributed.SingleNodeMessage@2db63c6d] [21:15:13] : [Step 4/5] [2021-11-19 21:15:13,177][INFO ][disco-notifier-worker-#26254%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=-903566235, keyId=1] [21:15:13] : [Step 4/5] [2021-11-19 21:15:13,177][INFO ][disco-notifier-worker-#26373%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=-903566235, keyId=1] [21:15:13] : [Step 4/5] [2021-11-19 21:15:13,177][INFO ][reencrypt-#26529%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=shared] [21:15:13] : [Step 4/5] [2021-11-19 21:15:13,178][INFO ][reencrypt-#26530%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=shared] [21:15:13] : [Step 4/5] [2021-11-19 21:15:13,178][INFO ][exchange-worker-#26259%grid-0%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=2], crd=true, evt=DISCOVERY_CUSTOM_EVT, evtNode=f1163f0c-f906-4318-aeb9-1e15a84f1931, customEvt=DynamicCacheChangeBatch [id=6d83e593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqs=ArrayList [DynamicCacheChangeRequest [cacheName=userCache, hasCfg=true, nodeId=f1163f0c-f906-4318-aeb9-1e15a84f1931, clientStartOnly=false, stop=false, destroy=false, disabledAfterStart=false]], exchangeActions=ExchangeActions [startCaches=[userCache], stopCaches=null, startGrps=[], stopGrps=[], resetParts=null, stateChangeRequest=null], startCaches=false], allowMerge=false, exchangeFreeSwitch=false] [21:15:13] : [Step 4/5] [2021-11-19 21:15:13,179][INFO ][exchange-worker-#26504%client%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=2], crd=false, evt=DISCOVERY_CUSTOM_EVT, evtNode=f1163f0c-f906-4318-aeb9-1e15a84f1931, customEvt=DynamicCacheChangeBatch [id=6d83e593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqs=ArrayList [DynamicCacheChangeRequest [cacheName=userCache, hasCfg=true, nodeId=f1163f0c-f906-4318-aeb9-1e15a84f1931, clientStartOnly=false, stop=false, destroy=false, disabledAfterStart=false]], exchangeActions=ExchangeActions [startCaches=[userCache], stopCaches=null, startGrps=[], stopGrps=[], resetParts=null, stateChangeRequest=null], startCaches=false], allowMerge=false, exchangeFreeSwitch=false] [21:15:13] : [Step 4/5] [2021-11-19 21:15:13,178][INFO ][exchange-worker-#26382%grid-1%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=2], crd=false, evt=DISCOVERY_CUSTOM_EVT, evtNode=f1163f0c-f906-4318-aeb9-1e15a84f1931, customEvt=DynamicCacheChangeBatch [id=6d83e593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqs=ArrayList [DynamicCacheChangeRequest [cacheName=userCache, hasCfg=true, nodeId=f1163f0c-f906-4318-aeb9-1e15a84f1931, clientStartOnly=false, stop=false, destroy=false, disabledAfterStart=false]], exchangeActions=ExchangeActions [startCaches=[userCache], stopCaches=null, startGrps=[], stopGrps=[], resetParts=null, stateChangeRequest=null], startCaches=false], allowMerge=false, exchangeFreeSwitch=false] [21:15:13] : [Step 4/5] [2021-11-19 21:15:13,181][INFO ][exchange-worker-#26259%grid-0%][GridCacheProcessor] Started cache [name=userCache, id=313096823, group=shared, dataRegionName=default, mode=PARTITIONED, atomicity=ATOMIC, backups=0, mvcc=false] [21:15:13] : [Step 4/5] [2021-11-19 21:15:13,182][INFO ][exchange-worker-#26504%client%][GridCacheProcessor] Started cache [name=userCache, id=313096823, group=shared, dataRegionName=default, mode=PARTITIONED, atomicity=ATOMIC, backups=0, mvcc=false] [21:15:13] : [Step 4/5] [2021-11-19 21:15:13,182][INFO ][exchange-worker-#26259%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=2], waitTime=0ms, futInfo=NA, mode=DISTRIBUTED] [21:15:13] : [Step 4/5] [2021-11-19 21:15:13,183][INFO ][exchange-worker-#26504%client%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=2], crd=false] [21:15:13] : [Step 4/5] [2021-11-19 21:15:13,182][INFO ][exchange-worker-#26382%grid-1%][GridCacheProcessor] Started cache [name=userCache, id=313096823, group=shared, dataRegionName=default, mode=PARTITIONED, atomicity=ATOMIC, backups=0, mvcc=false] [21:15:13] : [Step 4/5] [2021-11-19 21:15:13,184][INFO ][exchange-worker-#26382%grid-1%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=2], waitTime=0ms, futInfo=NA, mode=DISTRIBUTED] [21:15:13] : [Step 4/5] [2021-11-19 21:15:13,184][INFO ][exchange-worker-#26259%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partitions release latch: ServerLatch [permits=0, pendingAcks=HashSet [], super=CompletableLatch [id=CompletableLatchUid [id=exchange, topVer=AffinityTopologyVersion [topVer=3, minorTopVer=2]]]] [21:15:13] : [Step 4/5] [2021-11-19 21:15:13,185][INFO ][exchange-worker-#26382%grid-1%][GridDhtPartitionsExchangeFuture] Finished waiting for partitions release latch: ClientLatch [coordinator=TcpDiscoveryNode [id=00bad9b2-ce92-47f0-af24-2b5fe059d000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345712463, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], ackSent=true, super=CompletableLatch [id=CompletableLatchUid [id=exchange, topVer=AffinityTopologyVersion [topVer=3, minorTopVer=2]]]] [21:15:13] : [Step 4/5] [2021-11-19 21:15:13,185][INFO ][exchange-worker-#26259%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=2], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:15:13] : [Step 4/5] [2021-11-19 21:15:13,186][INFO ][exchange-worker-#26382%grid-1%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=2], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:15:13] : [Step 4/5] [2021-11-19 21:15:13,187][INFO ][exchange-worker-#26259%grid-0%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=2], crd=true] [21:15:13] : [Step 4/5] [2021-11-19 21:15:13,188][INFO ][exchange-worker-#26382%grid-1%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=2], crd=false] [21:15:13] : [Step 4/5] [2021-11-19 21:15:13,188][INFO ][sys-#26242%grid-0%][GridDhtPartitionsExchangeFuture] Coordinator received single message [ver=AffinityTopologyVersion [topVer=3, minorTopVer=2], node=1052a2c5-c72c-401d-95d8-7080cbcd9001, allReceived=true] [21:15:13] : [Step 4/5] [2021-11-19 21:15:13,188][INFO ][sys-#26242%grid-0%][GridDhtPartitionsExchangeFuture] finishExchangeOnCoordinator [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=2]] [21:15:13] : [Step 4/5] [2021-11-19 21:15:13,192][INFO ][sys-#26242%grid-0%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=2], err=null, rebalanced=true, wasRebalanced=true] [21:15:13] : [Step 4/5] [2021-11-19 21:15:13,192][INFO ][sys-#26242%grid-0%][GridCacheProcessor] Finish proxy initialization, cacheName=userCache, localNodeId=00bad9b2-ce92-47f0-af24-2b5fe059d000 [21:15:13] : [Step 4/5] [2021-11-19 21:15:13,192][INFO ][sys-#26368%grid-1%][GridDhtPartitionsExchangeFuture] Received full message, will finish exchange [node=00bad9b2-ce92-47f0-af24-2b5fe059d000, resVer=AffinityTopologyVersion [topVer=3, minorTopVer=2]] [21:15:13] : [Step 4/5] [2021-11-19 21:15:13,193][INFO ][sys-#26534%client%][GridDhtPartitionsExchangeFuture] Received full message, will finish exchange [node=00bad9b2-ce92-47f0-af24-2b5fe059d000, resVer=AffinityTopologyVersion [topVer=3, minorTopVer=2]] [21:15:13] : [Step 4/5] [2021-11-19 21:15:13,193][INFO ][exchange-worker-#26259%grid-0%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=3, minorTopVer=2], force=false, evt=DISCOVERY_CUSTOM_EVT, node=f1163f0c-f906-4318-aeb9-1e15a84f1931] [21:15:13] : [Step 4/5] [2021-11-19 21:15:13,193][INFO ][sys-#26242%grid-0%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=00bad9b2-ce92-47f0-af24-2b5fe059d000, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=2], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=f1163f0c-f906-4318-aeb9-1e15a84f1931, consistentId=client, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:0], discPort=0, order=3, intOrder=3, lastExchangeTime=1637345712927, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=true], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=3, minorTopVer=2]] [21:15:13] : [Step 4/5] [2021-11-19 21:15:13,195][INFO ][sys-#26534%client%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=2], err=null, rebalanced=true, wasRebalanced=true] [21:15:13] : [Step 4/5] [2021-11-19 21:15:13,193][INFO ][sys-#26368%grid-1%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=2], err=null, rebalanced=true, wasRebalanced=true] [21:15:13] : [Step 4/5] [2021-11-19 21:15:13,197][INFO ][sys-#26534%client%][GridCacheProcessor] Finish proxy initialization, cacheName=userCache, localNodeId=f1163f0c-f906-4318-aeb9-1e15a84f1931 [21:15:13] : [Step 4/5] [2021-11-19 21:15:13,196][INFO ][sys-#26242%grid-0%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=2], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (1 ms), stage="Update caches registry" (0 ms), stage="Start caches" (1 ms), stage="Affinity initialization on cache group start" (0 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Wait partitions release latch [latch=exchange]" (2 ms), stage="Wait partitions release [latch=exchange]" (1 ms), stage="After states restored callback" (0 ms), stage="WAL history reservation" (0 ms), stage="Waiting for all single messages" (1 ms), stage="Affinity recalculation (crd)" (0 ms), stage="Collect update counters and create affinity messages" (0 ms), stage="Assign partitions states" (0 ms), stage="Validate partitions states" (0 ms), stage="Apply update counters" (0 ms), stage="Full message preparing" (2 ms), stage="Full message sending" (0 ms), stage="Exchange done" (4 ms), stage="Total time" (12 ms), Discovery lag=1 ms, Latest started node id=1052a2c5-c72c-401d-95d8-7080cbcd9001] [21:15:13] : [Step 4/5] [2021-11-19 21:15:13,198][INFO ][sys-#26534%client%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=f1163f0c-f906-4318-aeb9-1e15a84f1931, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=2], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=f1163f0c-f906-4318-aeb9-1e15a84f1931, consistentId=client, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:0], discPort=0, order=3, intOrder=0, lastExchangeTime=1637345712907, loc=true, ver=2.13.0#20211119-sha1:00000000, isClient=true], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=3, minorTopVer=2]] [21:15:13] : [Step 4/5] [2021-11-19 21:15:13,198][INFO ][exchange-worker-#26504%client%][GridCachePartitionExchangeManager] AffinityTopologyVersion [topVer=3, minorTopVer=2], evt=DISCOVERY_CUSTOM_EVT, evtNode=f1163f0c-f906-4318-aeb9-1e15a84f1931, client=true] [21:15:13] : [Step 4/5] [2021-11-19 21:15:13,198][INFO ][sys-#26368%grid-1%][GridCacheProcessor] Finish proxy initialization, cacheName=userCache, localNodeId=1052a2c5-c72c-401d-95d8-7080cbcd9001 [21:15:13] : [Step 4/5] [2021-11-19 21:15:13,201][INFO ][sys-#26534%client%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=2], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (1 ms), stage="Update caches registry" (0 ms), stage="Start caches" (1 ms), stage="Affinity initialization on cache group start" (0 ms), stage="Determine exchange type" (0 ms), stage="Waiting for Full message" (10 ms), stage="Affinity recalculation" (0 ms), stage="Full map updating" (1 ms), stage="Exchange done" (5 ms), stage="Total time" (18 ms)] [21:15:13] : [Step 4/5] [2021-11-19 21:15:13,200][INFO ][sys-#26242%grid-0%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=2], stage="Affinity initialization on cache group start [grp=shared]" (0 ms) (parent=Affinity initialization on cache group start)] [21:15:13] : [Step 4/5] [2021-11-19 21:15:13,203][INFO ][sys-#26534%client%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=2], stage="Affinity initialization on cache group start [grp=shared]" (0 ms) (parent=Affinity initialization on cache group start)] [21:15:13] : [Step 4/5] [2021-11-19 21:15:13,202][INFO ][exchange-worker-#26382%grid-1%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=3, minorTopVer=2], force=false, evt=DISCOVERY_CUSTOM_EVT, node=f1163f0c-f906-4318-aeb9-1e15a84f1931] [21:15:13] : [Step 4/5] [2021-11-19 21:15:13,202][INFO ][sys-#26368%grid-1%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=1052a2c5-c72c-401d-95d8-7080cbcd9001, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=2], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=f1163f0c-f906-4318-aeb9-1e15a84f1931, consistentId=client, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:0], discPort=0, order=3, intOrder=3, lastExchangeTime=1637345712927, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=true], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=3, minorTopVer=2]] [21:15:13] : [Step 4/5] [2021-11-19 21:15:13,206][INFO ][sys-#26368%grid-1%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=2], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (3 ms), stage="Update caches registry" (0 ms), stage="Start caches" (1 ms), stage="Affinity initialization on cache group start" (0 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Wait partitions release latch [latch=exchange]" (2 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="After states restored callback" (0 ms), stage="WAL history reservation" (0 ms), stage="Waiting for Full message" (5 ms), stage="Affinity recalculation" (0 ms), stage="Full map updating" (0 ms), stage="Exchange done" (12 ms), stage="Total time" (23 ms)] [21:15:13] : [Step 4/5] [2021-11-19 21:15:13,207][INFO ][sys-#26368%grid-1%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=2], stage="Affinity initialization on cache group start [grp=shared]" (0 ms) (parent=Affinity initialization on cache group start)] [21:15:13] : [Step 4/5] [2021-11-19 21:15:13,321][INFO ][test-runner-#26142%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=1052a2c5-c72c-401d-95d8-7080cbcd9001, grp=-903566235] [21:15:13] : [Step 4/5] [2021-11-19 21:15:13,545][INFO ][db-checkpoint-thread-#26393%grid-1%][Checkpointer] Checkpoint started [checkpointId=ec780db5-6ce5-4a09-9033-d5f3bf67f4d4, startPtr=WALPointer [idx=0, fileOff=250581, len=2048], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=1ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=98ms, writeCheckpointEntryDuration=123ms, splitAndSortCpPagesDuration=1ms, pages=68, reason='test'] [21:15:14] : [Step 4/5] [2021-11-19 21:15:14,584][INFO ][db-checkpoint-thread-#26393%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=shared] [21:15:14] : [Step 4/5] [2021-11-19 21:15:14,584][INFO ][db-checkpoint-thread-#26393%grid-1%][Checkpointer] Checkpoint finished [cpId=ec780db5-6ce5-4a09-9033-d5f3bf67f4d4, pages=68, markPos=WALPointer [idx=0, fileOff=250581, len=2048], walSegmentsCovered=[], markDuration=224ms, pagesWrite=3ms, fsync=1035ms, total=1263ms] [21:15:14] : [Step 4/5] [2021-11-19 21:15:14,586][INFO ][test-runner-#26142%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00bad9b2-ce92-47f0-af24-2b5fe059d000, grp=-903566235] [21:15:14] : [Step 4/5] [2021-11-19 21:15:14,592][INFO ][db-checkpoint-thread-#26396%grid-0%][Checkpointer] Checkpoint started [checkpointId=0f17d22c-1cd7-4eda-8e6a-bfc405b2e7c9, startPtr=WALPointer [idx=0, fileOff=196993, len=2010], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=3ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=0ms, pages=46, reason='test'] [21:15:14] : [Step 4/5] [2021-11-19 21:15:14,644][INFO ][db-checkpoint-thread-#26396%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=shared] [21:15:14] : [Step 4/5] [2021-11-19 21:15:14,644][INFO ][db-checkpoint-thread-#26396%grid-0%][Checkpointer] Checkpoint finished [cpId=0f17d22c-1cd7-4eda-8e6a-bfc405b2e7c9, pages=46, markPos=WALPointer [idx=0, fileOff=196993, len=2010], walSegmentsCovered=[], markDuration=5ms, pagesWrite=3ms, fsync=48ms, total=57ms] [21:15:14] : [Step 4/5] [21:15:14] >>> Stopping test: CacheGroupKeyChangeTest#testCacheStartOnClientDuringRotation in 3180 ms <<< [21:15:14] : [Step 4/5] [2021-11-19 21:15:14,686][INFO ][main][root] >>> Stopping test: CacheGroupKeyChangeTest#testCacheStartOnClientDuringRotation in 3180 ms <<< [21:15:14] : [Step 4/5] [21:15:14] >>> Heap: 425 MB used / 1932 MB commited / 1932 MB max <<< [21:15:14] : [Step 4/5] [2021-11-19 21:15:14,686][INFO ][main][root] >>> Heap: 425 MB used / 1932 MB commited / 1932 MB max <<< [21:15:14] : [Step 4/5] [21:15:14] >>> Non-Heap: 173 MB used / 190 MB commited / 0 MB max <<< [21:15:14] : [Step 4/5] [2021-11-19 21:15:14,687][INFO ][main][root] >>> Non-Heap: 173 MB used / 190 MB commited / 0 MB max <<< [21:15:14] : [Step 4/5] [2021-11-19 21:15:14,687][INFO ][main][root] >>> Stopping grid [name=client, id=f1163f0c-f906-4318-aeb9-1e15a84f1931] [21:15:14] : [Step 4/5] [2021-11-19 21:15:14,702][INFO ][disco-event-worker-#26258%grid-0%][GridDiscoveryManager] Node left topology: TcpDiscoveryNode [id=f1163f0c-f906-4318-aeb9-1e15a84f1931, consistentId=client, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:0], discPort=0, order=3, intOrder=3, lastExchangeTime=1637345712927, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=true] [21:15:14] : [Step 4/5] [2021-11-19 21:15:14,705][INFO ][main][GridCacheProcessor] Stopped cache [cacheName=ignite-sys-cache] [21:15:14] : [Step 4/5] [2021-11-19 21:15:14,702][INFO ][tcp-disco-sock-reader-[f1163f0c 127.0.0.1:33121 client]-#1395%grid-1%-#26500%grid-1%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:33121, rmtPort=33121, rmtNodeId=f1163f0c-f906-4318-aeb9-1e15a84f1931] [21:15:14] : [Step 4/5] [2021-11-19 21:15:14,702][INFO ][disco-event-worker-#26381%grid-1%][GridDiscoveryManager] Node left topology: TcpDiscoveryNode [id=f1163f0c-f906-4318-aeb9-1e15a84f1931, consistentId=client, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:0], discPort=0, order=3, intOrder=3, lastExchangeTime=1637345712927, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=true] [21:15:14] : [Step 4/5] [2021-11-19 21:15:14,706][INFO ][disco-event-worker-#26258%grid-0%][GridDiscoveryManager] Topology snapshot [ver=4, locNode=00bad9b2, servers=2, clients=0, state=ACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=00bad9b2-ce92-47f0-af24-2b5fe059d000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=1052a2c5-c72c-401d-95d8-7080cbcd9001, consistentId=grid-1, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:15:14] : [Step 4/5] [2021-11-19 21:15:14,706][INFO ][main][GridCacheProcessor] Stopped cache [cacheName=encrypted, group=shared] [21:15:14] : [Step 4/5] [2021-11-19 21:15:14,708][INFO ][disco-event-worker-#26258%grid-0%][GridDiscoveryManager] ^-- Baseline [id=0, size=2, online=2, offline=0] [21:15:14] : [Step 4/5] [2021-11-19 21:15:14,708][INFO ][disco-event-worker-#26381%grid-1%][GridDiscoveryManager] Topology snapshot [ver=4, locNode=1052a2c5, servers=2, clients=0, state=ACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=00bad9b2-ce92-47f0-af24-2b5fe059d000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=1052a2c5-c72c-401d-95d8-7080cbcd9001, consistentId=grid-1, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:15:14]W: [org.apache.ignite:ignite-core] [2021-11-19 21:15:14,709][WARN ][grid-nio-worker-tcp-comm-1-#26198%TestRecordingCommunicationSpi%][TestRecordingCommunicationSpi] Failed to shutdown socket [21:15:14]W: [org.apache.ignite:ignite-core] java.nio.channels.ClosedChannelException [21:15:14]W: [org.apache.ignite:ignite-core] at sun.nio.ch.SocketChannelImpl.shutdownOutput(SocketChannelImpl.java:795) [21:15:14]W: [org.apache.ignite:ignite-core] at sun.nio.ch.SocketAdaptor.shutdownOutput(SocketAdaptor.java:407) [21:15:14]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.close(IgniteUtils.java:4247) [21:15:14]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.closeKey(GridNioServer.java:2784) [21:15:14]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.close(GridNioServer.java:2835) [21:15:14]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.close(GridNioServer.java:2794) [21:15:14]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.bodyInternal(GridNioServer.java:2157) [21:15:14]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.body(GridNioServer.java:1910) [21:15:14]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:125) [21:15:14]W: [org.apache.ignite:ignite-core] at java.lang.Thread.run(Thread.java:748) [21:15:14] : [Step 4/5] [2021-11-19 21:15:14,709][INFO ][main][GridCacheProcessor] Stopped cache [cacheName=userCache, group=shared] [21:15:14] : [Step 4/5] [2021-11-19 21:15:14,710][INFO ][exchange-worker-#26259%grid-0%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], crd=true, evt=NODE_LEFT, evtNode=f1163f0c-f906-4318-aeb9-1e15a84f1931, customEvt=null, allowMerge=true, exchangeFreeSwitch=false] [21:15:14] : [Step 4/5] [2021-11-19 21:15:14,710][INFO ][disco-event-worker-#26381%grid-1%][GridDiscoveryManager] ^-- Baseline [id=0, size=2, online=2, offline=0] [21:15:14] : [Step 4/5] [2021-11-19 21:15:14,715][INFO ][main][GridDeploymentLocalStore] Removed undeployed class: GridDeployment [ts=1637345712992, depMode=SHARED, clsLdr=IsolatedClassLoader{roleName='test'}, clsLdrId=ad73e593d71-f1163f0c-f906-4318-aeb9-1e15a84f1931, userVer=0, loc=true, sampleClsName=org.apache.ignite.internal.processors.cache.distributed.dht.preloader.GridDhtPartitionFullMap, pendingUndeploy=false, undeployed=true, usage=0] [21:15:14] : [Step 4/5] [2021-11-19 21:15:14,716][INFO ][exchange-worker-#26259%grid-0%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], err=null, rebalanced=true, wasRebalanced=true] [21:15:14] : [Step 4/5] [2021-11-19 21:15:14,718][INFO ][exchange-worker-#26382%grid-1%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], crd=false, evt=NODE_LEFT, evtNode=f1163f0c-f906-4318-aeb9-1e15a84f1931, customEvt=null, allowMerge=true, exchangeFreeSwitch=false] [21:15:14] : [Step 4/5] [2021-11-19 21:15:14,718][INFO ][exchange-worker-#26259%grid-0%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=00bad9b2-ce92-47f0-af24-2b5fe059d000, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], evt=NODE_LEFT, evtNode=TcpDiscoveryNode [id=f1163f0c-f906-4318-aeb9-1e15a84f1931, consistentId=client, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:0], discPort=0, order=3, intOrder=3, lastExchangeTime=1637345712927, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=true], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0]] [21:15:14] : [Step 4/5] [2021-11-19 21:15:14,719][INFO ][exchange-worker-#26382%grid-1%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], err=null, rebalanced=true, wasRebalanced=true] [21:15:14] : [Step 4/5] [2021-11-19 21:15:14,720][INFO ][exchange-worker-#26259%grid-0%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (5 ms), stage="Determine exchange type" (0 ms), stage="Exchange done" (4 ms), stage="Total time" (9 ms)] [21:15:14] : [Step 4/5] [2021-11-19 21:15:14,721][INFO ][exchange-worker-#26382%grid-1%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=1052a2c5-c72c-401d-95d8-7080cbcd9001, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], evt=NODE_LEFT, evtNode=TcpDiscoveryNode [id=f1163f0c-f906-4318-aeb9-1e15a84f1931, consistentId=client, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:0], discPort=0, order=3, intOrder=3, lastExchangeTime=1637345712927, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=true], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0]] [21:15:14] : [Step 4/5] [2021-11-19 21:15:14,722][INFO ][exchange-worker-#26259%grid-0%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=0]] [21:15:14] : [Step 4/5] [2021-11-19 21:15:14,724][INFO ][exchange-worker-#26259%grid-0%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], crd=true] [21:15:14] : [Step 4/5] [2021-11-19 21:15:14,723][INFO ][exchange-worker-#26382%grid-1%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (0 ms), stage="Determine exchange type" (0 ms), stage="Exchange done" (4 ms), stage="Total time" (4 ms)] [21:15:14] : [Step 4/5] [2021-11-19 21:15:14,726][INFO ][exchange-worker-#26259%grid-0%][GridCachePartitionExchangeManager] AffinityTopologyVersion [topVer=4, minorTopVer=0], evt=NODE_LEFT, evtNode=f1163f0c-f906-4318-aeb9-1e15a84f1931, client=false] [21:15:14] : [Step 4/5] [2021-11-19 21:15:14,727][INFO ][exchange-worker-#26382%grid-1%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=0]] [21:15:14] : [Step 4/5] [2021-11-19 21:15:14,727][INFO ][exchange-worker-#26382%grid-1%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], crd=false] [21:15:14] : [Step 4/5] [2021-11-19 21:15:14,728][INFO ][exchange-worker-#26382%grid-1%][GridCachePartitionExchangeManager] AffinityTopologyVersion [topVer=4, minorTopVer=0], evt=NODE_LEFT, evtNode=f1163f0c-f906-4318-aeb9-1e15a84f1931, client=false] [21:15:14] : [Step 4/5] [2021-11-19 21:15:14,735][INFO ][main][IgniteKernal%client] [21:15:14] : [Step 4/5] [21:15:14] : [Step 4/5] >>> +------------------------------------------------------+ [21:15:14] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV stopped OK [21:15:14] : [Step 4/5] >>> +------------------------------------------------------+ [21:15:14] : [Step 4/5] >>> Ignite instance name: client [21:15:14] : [Step 4/5] >>> Grid uptime: 00:00:01.724 [21:15:14] : [Step 4/5] [21:15:14] : [Step 4/5] [21:15:14] : [Step 4/5] [2021-11-19 21:15:14,736][INFO ][main][root] >>> Stopping grid [name=grid-1, id=1052a2c5-c72c-401d-95d8-7080cbcd9001] [21:15:14] : [Step 4/5] [2021-11-19 21:15:14,752][INFO ][db-checkpoint-thread-#26393%grid-1%][Checkpointer] Skipping checkpoint (no pages were modified) [checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=1ms, checkpointLockHoldTime=1ms, reason='timeout'] [21:15:14] : [Step 4/5] [2021-11-19 21:15:14,759][INFO ][tcp-disco-sock-reader-[00bad9b2 127.0.0.1:56143]-#1387%grid-1%-#26378%grid-1%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:56143, rmtPort=56143, rmtNodeId=00bad9b2-ce92-47f0-af24-2b5fe059d000] [21:15:14] : [Step 4/5] [2021-11-19 21:15:14,761][INFO ][main][GridCacheProcessor] Stopped cache [cacheName=ignite-sys-cache] [21:15:14] : [Step 4/5] [2021-11-19 21:15:14,761][INFO ][main][GridCacheProcessor] Stopped cache [cacheName=encrypted, group=shared] [21:15:14] : [Step 4/5] [2021-11-19 21:15:14,762][INFO ][main][GridCacheProcessor] Stopped cache [cacheName=userCache, group=shared] [21:15:14] : [Step 4/5] [2021-11-19 21:15:14,764][INFO ][disco-event-worker-#26258%grid-0%][GridDiscoveryManager] Node left topology: TcpDiscoveryNode [id=1052a2c5-c72c-401d-95d8-7080cbcd9001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637345712443, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false] [21:15:14] : [Step 4/5] [2021-11-19 21:15:14,765][INFO ][disco-event-worker-#26258%grid-0%][GridDiscoveryManager] Topology snapshot [ver=5, locNode=00bad9b2, servers=1, clients=0, state=ACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=00bad9b2-ce92-47f0-af24-2b5fe059d000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:15:14] : [Step 4/5] [2021-11-19 21:15:14,766][INFO ][disco-event-worker-#26258%grid-0%][GridDiscoveryManager] ^-- Baseline [id=0, size=2, online=1, offline=1] [21:15:14] : [Step 4/5] [2021-11-19 21:15:14,768][INFO ][exchange-worker-#26259%grid-0%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], crd=true, evt=NODE_LEFT, evtNode=1052a2c5-c72c-401d-95d8-7080cbcd9001, customEvt=null, allowMerge=false, exchangeFreeSwitch=true] [21:15:14] : [Step 4/5] [2021-11-19 21:15:14,768][INFO ][exchange-worker-#26259%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:15:14] : [Step 4/5] [2021-11-19 21:15:14,769][INFO ][exchange-worker-#26259%grid-0%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], err=null, rebalanced=true, wasRebalanced=true] [21:15:14]W: [org.apache.ignite:ignite-core] [2021-11-19 21:15:14,770][WARN ][exchange-worker-#26259%grid-0%][GridDhtPartitionTopologyImpl] Detected lost partitions [grp=shared, parts=[0, 2, 4, 6-7], topVer=AffinityTopologyVersion [topVer=5, minorTopVer=0]] [21:15:14] : [Step 4/5] [2021-11-19 21:15:14,770][INFO ][exchange-worker-#26259%grid-0%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=00bad9b2-ce92-47f0-af24-2b5fe059d000, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], evt=NODE_LEFT, evtNode=TcpDiscoveryNode [id=1052a2c5-c72c-401d-95d8-7080cbcd9001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637345712443, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=5, minorTopVer=0]] [21:15:14] : [Step 4/5] [2021-11-19 21:15:14,771][INFO ][exchange-worker-#26259%grid-0%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (0 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="After states restored callback" (0 ms), stage="WAL history reservation" (0 ms), stage="Finalize update counters" (0 ms), stage="Detect lost partitions" (1 ms), stage="Exchange done" (1 ms), stage="Total time" (2 ms)] [21:15:14] : [Step 4/5] [2021-11-19 21:15:14,772][INFO ][exchange-worker-#26259%grid-0%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], stage="Affinity initialization (exchange-free switch on fully-rebalanced topology) [grp=shared]" (0 ms) (parent=Determine exchange type), stage="Affinity initialization (exchange-free switch on fully-rebalanced topology) [grp=ignite-sys-cache]" (0 ms) (parent=Determine exchange type)] [21:15:14] : [Step 4/5] [2021-11-19 21:15:14,773][INFO ][exchange-worker-#26259%grid-0%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], crd=true] [21:15:14] : [Step 4/5] [2021-11-19 21:15:14,774][INFO ][exchange-worker-#26259%grid-0%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=5, minorTopVer=0], force=false, evt=NODE_LEFT, node=1052a2c5-c72c-401d-95d8-7080cbcd9001] [21:15:14] : [Step 4/5] [2021-11-19 21:15:14,991][INFO ][main][FilePageStoreManager] Cleanup cache stores [total=4, left=0, cleanFiles=false] [21:15:14] : [Step 4/5] [2021-11-19 21:15:14,994][INFO ][main][GridDeploymentLocalStore] Removed undeployed class: GridDeployment [ts=1637345712665, depMode=SHARED, clsLdr=IsolatedClassLoader{roleName='test'}, clsLdrId=a673e593d71-1052a2c5-c72c-401d-95d8-7080cbcd9001, userVer=0, loc=true, sampleClsName=org.apache.ignite.internal.processors.cache.distributed.dht.preloader.IgniteDhtPartitionsToReloadMap, pendingUndeploy=false, undeployed=true, usage=0] [21:15:15] : [Step 4/5] [2021-11-19 21:15:15,002][INFO ][main][IgniteKernal%grid-1] [21:15:15] : [Step 4/5] [21:15:15] : [Step 4/5] >>> +------------------------------------------------------+ [21:15:15] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV stopped OK [21:15:15] : [Step 4/5] >>> +------------------------------------------------------+ [21:15:15] : [Step 4/5] >>> Ignite instance name: grid-1 [21:15:15] : [Step 4/5] >>> Grid uptime: 00:00:02.485 [21:15:15] : [Step 4/5] [21:15:15] : [Step 4/5] [21:15:15] : [Step 4/5] [2021-11-19 21:15:15,003][INFO ][main][root] >>> Stopping grid [name=grid-0, id=00bad9b2-ce92-47f0-af24-2b5fe059d000] [21:15:15] : [Step 4/5] [2021-11-19 21:15:15,010][INFO ][db-checkpoint-thread-#26396%grid-0%][Checkpointer] Skipping checkpoint (no pages were modified) [checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, reason='timeout'] [21:15:15]W: [org.apache.ignite:ignite-core] [2021-11-19 21:15:15,013][WARN ][tcp-disco-sock-reader-[1052a2c5 127.0.0.1:43367]-#1388%grid-0%-#26379%grid-0%][TestTcpDiscoverySpi] Failed to shutdown socket [21:15:15]W: [org.apache.ignite:ignite-core] java.net.SocketException: Socket is closed [21:15:15]W: [org.apache.ignite:ignite-core] at java.net.Socket.shutdownOutput(Socket.java:1568) [21:15:15]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.close(IgniteUtils.java:4247) [21:15:15]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.discovery.tcp.ServerImpl$SocketReader.body(ServerImpl.java:7370) [21:15:15] : [Step 4/5] [2021-11-19 21:15:15,014][INFO ][tcp-disco-sock-reader-[1052a2c5 127.0.0.1:43367]-#1388%grid-0%-#26379%grid-0%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:43367, rmtPort=43367, rmtNodeId=1052a2c5-c72c-401d-95d8-7080cbcd9001] [21:15:15]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.IgniteSpiThread.run(IgniteSpiThread.java:58) [21:15:15] : [Step 4/5] [2021-11-19 21:15:15,016][INFO ][main][GridCacheProcessor] Stopped cache [cacheName=ignite-sys-cache] [21:15:15] : [Step 4/5] [2021-11-19 21:15:15,016][INFO ][main][GridCacheProcessor] Stopped cache [cacheName=encrypted, group=shared] [21:15:15] : [Step 4/5] [2021-11-19 21:15:15,016][INFO ][main][GridCacheProcessor] Stopped cache [cacheName=userCache, group=shared] [21:15:15] : [Step 4/5] [2021-11-19 21:15:15,050][INFO ][main][FilePageStoreManager] Cleanup cache stores [total=4, left=0, cleanFiles=false] [21:15:15] : [Step 4/5] [2021-11-19 21:15:15,051][INFO ][main][GridDeploymentLocalStore] Removed undeployed class: GridDeployment [ts=1637345712655, depMode=SHARED, clsLdr=IsolatedClassLoader{roleName='test'}, clsLdrId=8673e593d71-00bad9b2-ce92-47f0-af24-2b5fe059d000, userVer=0, loc=true, sampleClsName=org.apache.ignite.internal.processors.cache.distributed.dht.preloader.GridDhtPartitionMap, pendingUndeploy=false, undeployed=true, usage=0] [21:15:15] : [Step 4/5] [2021-11-19 21:15:15,057][INFO ][main][IgniteKernal%grid-0] [21:15:15] : [Step 4/5] [21:15:15] : [Step 4/5] >>> +------------------------------------------------------+ [21:15:15] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV stopped OK [21:15:15] : [Step 4/5] >>> +------------------------------------------------------+ [21:15:15] : [Step 4/5] >>> Ignite instance name: grid-0 [21:15:15] : [Step 4/5] >>> Grid uptime: 00:00:03.070 [21:15:15] : [Step 4/5] [21:15:15] : [Step 4/5] [21:15:15] : [Step 4/5] [21:15:15] >>> Starting test: CacheGroupKeyChangeTest#testChangeKeyDuringRebalancing <<< [21:15:15] : [Step 4/5] [2021-11-19 21:15:15,072][INFO ][main][root] >>> Starting test: CacheGroupKeyChangeTest#testChangeKeyDuringRebalancing <<< [21:15:15] : [Step 4/5] [21:15:15] >>> Heap: 431 MB used / 1932 MB commited / 1932 MB max <<< [21:15:15] : [Step 4/5] [2021-11-19 21:15:15,073][INFO ][main][root] >>> Heap: 431 MB used / 1932 MB commited / 1932 MB max <<< [21:15:15] : [Step 4/5] [21:15:15] >>> Non-Heap: 173 MB used / 190 MB commited / 0 MB max <<< [21:15:15] : [Step 4/5] [2021-11-19 21:15:15,073][INFO ][main][root] >>> Non-Heap: 173 MB used / 190 MB commited / 0 MB max <<< [21:15:15]W: [org.apache.ignite:ignite-core] [2021-11-19 21:15:15,080][WARN ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][G] Ignite work directory is not provided, automatically resolved to: /opt/buildagent/work/7bc1c54bc719b67c/work [21:15:15] : [Step 4/5] [2021-11-19 21:15:15,082][INFO ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] [21:15:15] : [Step 4/5] [21:15:15] : [Step 4/5] >>> __________ ________________ [21:15:15] : [Step 4/5] >>> / _/ ___/ |/ / _/_ __/ __/ [21:15:15] : [Step 4/5] >>> _/ // (7 7 // / / / / _/ [21:15:15] : [Step 4/5] >>> /___/\___/_/|_/___/ /_/ /___/ [21:15:15] : [Step 4/5] >>> [21:15:15] : [Step 4/5] >>> ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:15:15] : [Step 4/5] >>> 2021 Copyright(C) Apache Software Foundation [21:15:15] : [Step 4/5] >>> [21:15:15] : [Step 4/5] >>> Ignite documentation: http://ignite.apache.org [21:15:15] : [Step 4/5] [21:15:15] : [Step 4/5] [2021-11-19 21:15:15,083][INFO ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] Config URL: n/a [21:15:15] : [Step 4/5] [2021-11-19 21:15:15,084][INFO ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] IgniteConfiguration [igniteInstanceName=grid-0, pubPoolSize=24, svcPoolSize=24, callbackPoolSize=24, stripedPoolSize=24, sysPoolSize=24, mgmtPoolSize=4, dataStreamerPoolSize=24, utilityCachePoolSize=24, utilityCacheKeepAliveTime=60000, p2pPoolSize=2, qryPoolSize=24, buildIdxPoolSize=4, igniteHome=/opt/buildagent/work/7bc1c54bc719b67c, igniteWorkDir=/opt/buildagent/work/7bc1c54bc719b67c/work, mbeanSrv=com.sun.jmx.mbeanserver.JmxMBeanServer@6fe85038, nodeId=008cb00a-6a9b-4c09-a154-85082cd15000, marsh=BinaryMarshaller [], marshLocJobs=false, daemon=false, p2pEnabled=true, netTimeout=10000, netCompressionLevel=1, sndRetryDelay=1000, sndRetryCnt=3, metricsHistSize=10000, metricsUpdateFreq=1000, metricsExpTime=9223372036854775807, discoSpi=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=0, ackTimeout=0, marsh=null, reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], segPlc=STOP, segResolveAttempts=2, waitForSegOnStart=true, allResolversPassReq=true, segChkFreq=10000, commSpi=TcpCommunicationSpi [connectGate=org.apache.ignite.spi.communication.tcp.internal.ConnectGateway@420085a5, ctxInitLatch=java.util.concurrent.CountDownLatch@3091254f[Count = 1], stopping=false, clientPool=null, nioSrvWrapper=null, stateProvider=null], evtSpi=MemoryEventStorageSpi [expireAgeMs=9223372036854775807, expireCnt=10000, filter=null], colSpi=NoopCollisionSpi [], deploySpi=LocalDeploymentSpi [], indexingSpi=org.apache.ignite.spi.indexing.noop.NoopIndexingSpi@3a9fae78, addrRslvr=null, encryptionSpi=org.apache.ignite.spi.encryption.keystore.KeystoreEncryptionSpi@71f2cf83, tracingSpi=org.apache.ignite.spi.tracing.NoopTracingSpi@2f29aaa, clientMode=false, rebalanceThreadPoolSize=4, rebalanceTimeout=10000, rebalanceBatchesPrefetchCnt=3, rebalanceThrottle=0, rebalanceBatchSize=524288, txCfg=TransactionConfiguration [txSerEnabled=false, dfltIsolation=REPEATABLE_READ, dfltConcurrency=PESSIMISTIC, dfltTxTimeout=0, txTimeoutOnPartitionMapExchange=0, deadlockTimeout=10000, pessimisticTxLogSize=0, pessimisticTxLogLinger=10000, tmLookupClsName=null, txManagerFactory=null, useJtaSync=false], cacheSanityCheckEnabled=true, discoStartupDelay=60000, deployMode=SHARED, p2pMissedCacheSize=100, locHost=127.0.0.1, timeSrvPortBase=31100, timeSrvPortRange=100, failureDetectionTimeout=10000, sysWorkerBlockedTimeout=null, clientFailureDetectionTimeout=10000, metricsLogFreq=0, connectorCfg=null, odbcCfg=null, warmupClos=null, atomicCfg=AtomicConfiguration [seqReserveSize=1000, cacheMode=PARTITIONED, backups=1, aff=null, grpName=null], classLdr=null, sslCtxFactory=null, platformCfg=null, binaryCfg=null, memCfg=null, pstCfg=null, dsCfg=DataStorageConfiguration [sysRegionInitSize=41943040, sysRegionMaxSize=104857600, pageSize=4096, concLvl=0, dfltDataRegConf=DataRegionConfiguration [name=default, maxSize=104857600, initSize=268435456, swapPath=null, pageEvictionMode=DISABLED, pageReplacementMode=CLOCK, evictionThreshold=0.9, emptyPagesPoolSize=100, metricsEnabled=false, metricsSubIntervalCount=5, metricsRateTimeInterval=60000, persistenceEnabled=true, checkpointPageBufSize=0, lazyMemoryAllocation=true, warmUpCfg=null], dataRegions=null, storagePath=null, checkpointFreq=30000, lockWaitTime=10000, checkpointThreads=4, checkpointWriteOrder=SEQUENTIAL, walHistSize=20, maxWalArchiveSize=20971520, walSegments=10, walSegmentSize=1048576, walPath=db/wal, walArchivePath=db/wal/archive, cdcWalPath=db/wal/cdc, cdcEnabled=false, metricsEnabled=false, walMode=LOG_ONLY, walTlbSize=131072, walBuffSize=0, walFlushFreq=2000, walFsyncDelay=1000, walRecordIterBuffSize=67108864, alwaysWriteFullPages=false, fileIOFactory=org.apache.ignite.internal.processors.cache.persistence.file.AsyncFileIOFactory@2db7aa3e, metricsSubIntervalCnt=5, metricsRateTimeInterval=60000, walAutoArchiveAfterInactivity=-1, walForceArchiveTimeout=-1, writeThrottlingEnabled=false, walCompactionEnabled=false, walCompactionLevel=1, checkpointReadLockTimeout=null, walPageCompression=DISABLED, walPageCompressionLevel=null, dfltWarmUpCfg=null, encCfg=org.apache.ignite.configuration.EncryptionConfiguration@5f763cf2, defragmentationThreadPoolSize=4, minWalArchiveSize=-1], snapshotPath=snapshots, activeOnStart=true, activeOnStartPropSetFlag=false, autoActivation=true, autoActivationPropSetFlag=false, clusterStateOnStart=null, sqlConnCfg=null, cliConnCfg=ClientConnectorConfiguration [host=null, port=10800, portRange=100, sockSndBufSize=0, sockRcvBufSize=0, tcpNoDelay=true, maxOpenCursorsPerConn=128, threadPoolSize=24, selectorCnt=12, idleTimeout=0, handshakeTimeout=10000, jdbcEnabled=true, odbcEnabled=true, thinCliEnabled=true, sslEnabled=false, useIgniteSslCtxFactory=true, sslClientAuth=false, sslCtxFactory=null, thinCliCfg=ThinClientConfiguration [maxActiveTxPerConn=100, maxActiveComputeTasksPerConn=0]], mvccVacuumThreadCnt=2, mvccVacuumFreq=5000, authEnabled=false, failureHnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]], commFailureRslvr=null, sqlCfg=SqlConfiguration [longQryWarnTimeout=3000, dfltQryTimeout=0, sqlQryHistSize=1000, validationEnabled=false], asyncContinuationExecutor=null] [21:15:15] : [Step 4/5] [2021-11-19 21:15:15,095][INFO ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] Daemon mode: off [21:15:15] : [Step 4/5] [2021-11-19 21:15:15,096][INFO ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] OS: Linux 4.15.0-151-generic amd64 [21:15:15] : [Step 4/5] [2021-11-19 21:15:15,096][INFO ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] OS user: teamcity [21:15:15] : [Step 4/5] [2021-11-19 21:15:15,096][INFO ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] PID: 16724 [21:15:15] : [Step 4/5] [2021-11-19 21:15:15,097][INFO ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] Language runtime: Java Platform API Specification ver. 1.8 [21:15:15] : [Step 4/5] [2021-11-19 21:15:15,097][INFO ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] VM information: Java(TM) SE Runtime Environment 1.8.0_261-b12 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 25.261-b12 [21:15:15] : [Step 4/5] [2021-11-19 21:15:15,097][INFO ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] VM total memory: 1.9GB [21:15:15] : [Step 4/5] [2021-11-19 21:15:15,097][INFO ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] Remote Management [restart: off, REST: off, JMX (remote: off)] [21:15:15] : [Step 4/5] [2021-11-19 21:15:15,098][INFO ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] Logger: GridTestLog4jLogger [quiet=false, config=null] [21:15:15] : [Step 4/5] [2021-11-19 21:15:15,098][INFO ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] IGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c [21:15:15] : [Step 4/5] [2021-11-19 21:15:15,098][INFO ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] VM arguments: [-DIGNITE_DUMP_THREADS_ON_FAILURE=false, -DMono=/usr/bin/mono-sgen, -DMono4.0_x64=/usr/lib/mono/4.0, -DMono4.5_x64=/usr/lib/mono/4.5, -DMonoVersion=6.12.0.90, -DSKIP_BUILD=false, -Dagent.home.dir=/opt/buildagent, -Dagent.name=aitc-lin02_03, -Dagent.ownPort=9090, -Dagent.work.dir=/opt/buildagent/work, -Dbuild.number=95, -Dbuild.vcs.number=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.1=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.GitHubApacheIgnite=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dclassworlds.conf=/opt/buildagent/temp/buildTmp/teamcity.m2.conf, -Dcom.jetbrains.maven.watcher.report.file=/opt/buildagent/temp/buildTmp/maven-build-info.xml, -Djava.io.tmpdir=/opt/buildagent/temp/buildTmp, -Dmaven.home=/opt/buildagent/tools/maven3_6, -Dmaven.multiModuleProjectDirectory=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.agent.cpuBenchmark=457, -Dteamcity.agent.dotnet.agent_url=http://localhost:9090/RPC2, -Dteamcity.agent.dotnet.build_id=6278078, -Dteamcity.auth.password=*******, -Dteamcity.auth.userId=TeamCityBuildId=6278078, -Dteamcity.build.changedFiles.file=/opt/buildagent/temp/buildTmp/changedFiles6342607772318147725.txt, -Dteamcity.build.checkoutDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.build.id=6278078, -Dteamcity.build.properties.file=/opt/buildagent/temp/buildTmp/teamcity.build5164517880467851002.properties, -Dteamcity.build.tempDir=/opt/buildagent/temp/buildTmp, -Dteamcity.build.workingDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.buildConfName=Basic 3, -Dteamcity.buildType.id=IgniteTests24Java8_Basic3, -Dteamcity.configuration.properties.file=/opt/buildagent/temp/buildTmp/teamcity.config5591980786735343870.properties, -Dteamcity.maven.userSettings.path=/opt/buildagent/temp/buildTmp/maven_settings_585072866407032347.xml, -Dteamcity.maven.watcher.home=/opt/buildagent/plugins/mavenPlugin/maven-watcher-jdk16, -Dteamcity.projectName=Ignite Tests 2.x (JDK 8/11), -Dteamcity.runner.properties.file=/opt/buildagent/temp/buildTmp/teamcity.runner9098465561618137420.properties, -Dteamcity.tests.recentlyFailedTests.file=/opt/buildagent/temp/buildTmp/testsToRunFirst3891775683130404069.txt, -Dteamcity.version=2021.2 (build 99542), -ea, -Xms2g, -Xmx2g, -XX:+HeapDumpOnOutOfMemoryError, -DIGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_TEST_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_UPDATE_NOTIFIER=false, -DIGNITE_NO_DISCO_ORDER=true, -DIGNITE_PERFORMANCE_SUGGESTIONS_DISABLED=true, -Djava.net.preferIPv4Stack=true, -DTEST_SCALE_FACTOR=1.0, -DIGNITE_TEST_PROP_LOG4J_FILE=log4j-tc-test.xml, -DIGNITE_QUIET=false, -DIGNITE_MARSHAL_BUFFERS_RECHECK=1000, -Dmaven.repo.local=/opt/buildagent/.m2/repository] [21:15:15] : [Step 4/5] [2021-11-19 21:15:15,103][INFO ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] System cache's DataRegion size is configured to 40 MB. Use DataStorageConfiguration.systemRegionInitialSize property to change the setting. [21:15:15] : [Step 4/5] [2021-11-19 21:15:15,103][INFO ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] Configured caches [in 'sysMemPlc' dataRegion: ['ignite-sys-cache']] [21:15:15]W: [org.apache.ignite:ignite-core] [2021-11-19 21:15:15,103][WARN ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] Peer class loading is enabled (disable it in production for performance and deployment consistency reasons) [21:15:15] : [Step 4/5] [2021-11-19 21:15:15,104][INFO ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] 3-rd party licenses can be found at: /opt/buildagent/work/7bc1c54bc719b67c/libs/licenses [21:15:15] : [Step 4/5] [2021-11-19 21:15:15,108][INFO ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] Configured plugins: [21:15:15] : [Step 4/5] [2021-11-19 21:15:15,108][INFO ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- StanByClusterTestProvider 1.0 [21:15:15] : [Step 4/5] [2021-11-19 21:15:15,108][INFO ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:15:15] : [Step 4/5] [2021-11-19 21:15:15,108][INFO ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] [21:15:15] : [Step 4/5] [2021-11-19 21:15:15,109][INFO ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- PageMemory tracker plugin 1.0 [21:15:15] : [Step 4/5] [2021-11-19 21:15:15,109][INFO ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:15:15] : [Step 4/5] [2021-11-19 21:15:15,109][INFO ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] [21:15:15] : [Step 4/5] [2021-11-19 21:15:15,109][INFO ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- TestDistibutedConfigurationPlugin 1.0 [21:15:15] : [Step 4/5] [2021-11-19 21:15:15,109][INFO ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:15:15] : [Step 4/5] [2021-11-19 21:15:15,109][INFO ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] [21:15:15] : [Step 4/5] [2021-11-19 21:15:15,110][INFO ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- NodeValidationPluginProvider 1.0 [21:15:15] : [Step 4/5] [2021-11-19 21:15:15,110][INFO ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:15:15] : [Step 4/5] [2021-11-19 21:15:15,110][INFO ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] [21:15:15] : [Step 4/5] [2021-11-19 21:15:15,110][INFO ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][FailureProcessor] Configured failure handler: [hnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]]] [21:15:15] : [Step 4/5] [2021-11-19 21:15:15,141][INFO ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][TestRecordingCommunicationSpi] Successfully bound communication NIO server to TCP port [port=47100, locHost=/127.0.0.1, selectorsCnt=12, selectorSpins=0, pairedConn=false] [21:15:15]W: [org.apache.ignite:ignite-core] [2021-11-19 21:15:15,142][WARN ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][TestRecordingCommunicationSpi] Message queue limit is set to 0 which may lead to potential OOMEs when running cache operations in FULL_ASYNC or PRIMARY_SYNC modes due to message queues growth on sender and receiver sides. [21:15:15] : [Step 4/5] [2021-11-19 21:15:15,145][INFO ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][GridCollisionManager] Collision resolution is disabled (all jobs will be activated upon arrival). [21:15:15] : [Step 4/5] [2021-11-19 21:15:15,145][INFO ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] Security status [authentication=off, sandbox=off, tls/ssl=off] [21:15:15] : [Step 4/5] [2021-11-19 21:15:15,220][INFO ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:15:15] : [Step 4/5] [2021-11-19 21:15:15,322][INFO ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][MaintenanceProcessor] Resolved store directory for node persistent data: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0 [21:15:15] : [Step 4/5] [2021-11-19 21:15:15,323][INFO ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][CacheObjectBinaryProcessorImpl] Resolved directory for serialized binary metadata: /opt/buildagent/work/7bc1c54bc719b67c/work/db/binary_meta/grid_0 [21:15:15] : [Step 4/5] [2021-11-19 21:15:15,328][INFO ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0 [21:15:15] : [Step 4/5] [2021-11-19 21:15:15,329][INFO ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][FileWriteAheadLogManager] Resolved write ahead log work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0 [21:15:15] : [Step 4/5] [2021-11-19 21:15:15,329][INFO ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][FileWriteAheadLogManager] Resolved write ahead log archive directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0 [21:15:15] : [Step 4/5] [2021-11-19 21:15:15,489][INFO ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000000.wal [21:15:15] : [Step 4/5] [2021-11-19 21:15:15,490][INFO ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][FileHandleManagerImpl] Initialized write-ahead log manager [mode=LOG_ONLY] [21:15:15]W: [org.apache.ignite:ignite-core] [2021-11-19 21:15:15,490][WARN ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] DataRegion maxSize=104.9 MB is smaller than defaultInitialSize=268.4 MB, setting initialSize to 104.9 MB [21:15:15] : [Step 4/5] [2021-11-19 21:15:15,496][INFO ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Configured data regions initialized successfully [total=5] [21:15:15] : [Step 4/5] [2021-11-19 21:15:15,684][INFO ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][IgniteSnapshotManager] Resolved snapshot work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/snapshots [21:15:15] : [Step 4/5] [2021-11-19 21:15:15,684][INFO ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][IgniteSnapshotManager] Resolved temp directory for snapshot creation: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0/snp [21:15:15] : [Step 4/5] [2021-11-19 21:15:15,687][INFO ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][ClientListenerProcessor] Client connector processor has started on TCP port 10800 [21:15:15] : [Step 4/5] [2021-11-19 21:15:15,692][INFO ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] Non-loopback local IPs: 172.17.0.4 [21:15:15] : [Step 4/5] [2021-11-19 21:15:15,692][INFO ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] Enabled local MACs: 0242AC110004 [21:15:15] : [Step 4/5] [2021-11-19 21:15:15,695][INFO ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:15:15] : [Step 4/5] [2021-11-19 21:15:15,696][INFO ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:15:15] : [Step 4/5] [2021-11-19 21:15:15,697][INFO ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:15:15] : [Step 4/5] [2021-11-19 21:15:15,699][INFO ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Applying lost metastore updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:15:15] : [Step 4/5] [2021-11-19 21:15:15,700][INFO ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=0 ms] [21:15:15] : [Step 4/5] [2021-11-19 21:15:15,701][INFO ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Restoring partition state for local groups. [21:15:15] : [Step 4/5] [2021-11-19 21:15:15,701][INFO ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=0, partitionsProcessed=0, time=0ms] [21:15:15] : [Step 4/5] [2021-11-19 21:15:15,702][INFO ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][GridEncryptionManager] Encryption keys loaded from metastore. [grps=, masterKeyName=ignite.master.key] [21:15:15] : [Step 4/5] [2021-11-19 21:15:15,707][INFO ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][ClusterProcessor] Cluster ID and tag has been read from metastorage: null [21:15:15] : [Step 4/5] [2021-11-19 21:15:15,708][INFO ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][IgniteClusterImpl] Shutdown policy was updated [oldVal=null, newVal=null] [21:15:15] : [Step 4/5] [2021-11-19 21:15:15,708][INFO ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Checkpoint frequency deviation changed [oldVal=null, newVal=null] [21:15:15] : [Step 4/5] [2021-11-19 21:15:15,934][INFO ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][FilePageStoreManager] Cleanup cache stores [total=1, left=0, cleanFiles=false] [21:15:15] : [Step 4/5] [2021-11-19 21:15:15,937][INFO ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:15:15] : [Step 4/5] [2021-11-19 21:15:15,938][INFO ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:15:15] : [Step 4/5] [2021-11-19 21:15:15,940][INFO ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:15:15] : [Step 4/5] [2021-11-19 21:15:15,940][INFO ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Data Regions Started: 5 [21:15:15] : [Step 4/5] [2021-11-19 21:15:15,941][INFO ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] ^-- sysMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:15:15] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:15:15] : [Step 4/5] ^-- default region [type=default, persistence=true, lazyAlloc=true, [21:15:15] : [Step 4/5] ... initCfg=100MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB, allocTotal=0MB] [21:15:15] : [Step 4/5] ^-- metastoreMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:15:15] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:15:15] : [Step 4/5] ^-- TxLog region [type=internal, persistence=true, lazyAlloc=false, [21:15:15] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:15:15] : [Step 4/5] ^-- volatileDsMemPlc region [type=user, persistence=false, lazyAlloc=true, [21:15:15] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB] [21:15:15] : [Step 4/5] ^-- Ignite persistence [used=0MB] [21:15:15] : [Step 4/5] [21:15:15] : [Step 4/5] [2021-11-19 21:15:15,943][INFO ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Starting binary memory restore for: [-2100569601] [21:15:15] : [Step 4/5] [2021-11-19 21:15:15,951][INFO ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:15:15] : [Step 4/5] [2021-11-19 21:15:15,951][INFO ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:15:15] : [Step 4/5] [2021-11-19 21:15:15,953][INFO ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000000.wal, offset=0, ver=2] [21:15:15] : [Step 4/5] [2021-11-19 21:15:15,957][INFO ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Started cache in recovery mode [name=ignite-sys-cache, id=-2100569601, dataRegionName=sysMemPlc, mode=REPLICATED, atomicity=TRANSACTIONAL, backups=2147483647, mvcc=false] [21:15:15] : [Step 4/5] [2021-11-19 21:15:15,957][INFO ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Binary recovery performed in 14 ms. [21:15:15] : [Step 4/5] [2021-11-19 21:15:15,958][INFO ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:15:15] : [Step 4/5] [2021-11-19 21:15:15,958][INFO ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Applying lost cache updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:15:15] : [Step 4/5] [2021-11-19 21:15:15,961][INFO ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=0 ms] [21:15:15] : [Step 4/5] [2021-11-19 21:15:15,961][INFO ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Restoring partition state for local groups. [21:15:15] : [Step 4/5] [2021-11-19 21:15:15,967][INFO ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=1, partitionsProcessed=100, time=10ms] [21:15:15] : [Step 4/5] [2021-11-19 21:15:15,975][INFO ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][TestTcpDiscoverySpi] Successfully bound to TCP port [port=47500, localHost=localhost/127.0.0.1, locNodeId=008cb00a-6a9b-4c09-a154-85082cd15000] [21:15:15] : [Step 4/5] [2021-11-19 21:15:15,987][INFO ][disco-notifier-worker-#26657%grid-0%][MvccProcessorImpl] Assigned mvcc coordinator [crd=MvccCoordinator [topVer=AffinityTopologyVersion [topVer=1, minorTopVer=0], nodeId=008cb00a-6a9b-4c09-a154-85082cd15000, ver=1637345715983, local=true, initialized=false]] [21:15:15] : [Step 4/5] [2021-11-19 21:15:15,988][INFO ][sys-#26640%grid-0%][ClusterProcessor] Writing cluster ID and tag to metastorage on ready for write ClusterIdAndTag [id=ff5290fc-e3c4-4d9f-988a-68e45d1ee9f7, tag=elated_lamarr] [21:15:15] : [Step 4/5] [2021-11-19 21:15:15,991][INFO ][disco-notifier-worker-#26657%grid-0%][ClusterProcessor] elated_lamarr [21:15:15] : [Step 4/5] [2021-11-19 21:15:15,992][INFO ][disco-notifier-worker-#26657%grid-0%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustEnabled' was changed from 'null' to 'false' [21:15:15] : [Step 4/5] [2021-11-19 21:15:15,993][INFO ][disco-notifier-worker-#26657%grid-0%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustTimeout' was changed from 'null' to '300000' [21:15:15] : [Step 4/5] [2021-11-19 21:15:15,994][INFO ][disco-notifier-worker-#26657%grid-0%][IgniteTxManager] Transactions parameter 'longOperationsDumpTimeout' was changed from 'null' to '60000' [21:15:15] : [Step 4/5] [2021-11-19 21:15:15,994][INFO ][disco-notifier-worker-#26657%grid-0%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpThreshold' was changed from 'null' to '0' [21:15:15] : [Step 4/5] [2021-11-19 21:15:15,995][INFO ][disco-notifier-worker-#26657%grid-0%][IgniteTxManager] Transactions parameter 'transactionTimeDumpSamplesCoefficient' was changed from 'null' to '0.0' [21:15:15] : [Step 4/5] [2021-11-19 21:15:15,995][INFO ][disco-notifier-worker-#26657%grid-0%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpSamplesPerSecondLimit' was changed from 'null' to '5' [21:15:15] : [Step 4/5] [2021-11-19 21:15:15,996][INFO ][disco-notifier-worker-#26657%grid-0%][IgniteTxManager] Transactions parameter 'collisionsDumpInterval' was changed from 'null' to '1000' [21:15:15] : [Step 4/5] [2021-11-19 21:15:15,996][INFO ][disco-notifier-worker-#26657%grid-0%][IgniteTxManager] Transactions parameter 'txOwnerDumpRequestsAllowed' was changed from 'null' to 'true' [21:15:15] : [Step 4/5] [2021-11-19 21:15:15,997][INFO ][disco-notifier-worker-#26657%grid-0%][GridCacheDatabaseSharedManager] Historical rebalance WAL threshold changed [property=historical.rebalance.threshold, oldVal=null, newVal=500] [21:15:16] : [Step 4/5] [2021-11-19 21:15:16,001][INFO ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] To start Console Management & Monitoring run ignitevisorcmd.{sh|bat} [21:15:16] : [Step 4/5] [2021-11-19 21:15:16,002][INFO ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] [21:15:16] : [Step 4/5] [21:15:16] : [Step 4/5] >>> +-------------------------------------------+ [21:15:16] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:15:16] : [Step 4/5] >>> +-------------------------------------------+ [21:15:16] : [Step 4/5] >>> OS name: Linux 4.15.0-151-generic amd64 [21:15:16] : [Step 4/5] >>> CPU(s): 24 [21:15:16] : [Step 4/5] >>> Heap: 2.0GB [21:15:16] : [Step 4/5] >>> VM name: 16724@c4dfe9a430b2 [21:15:16] : [Step 4/5] >>> Ignite instance name: grid-0 [21:15:16] : [Step 4/5] >>> Local node [ID=008CB00A-6A9B-4C09-A154-85082CD15000, order=1, clientMode=false] [21:15:16] : [Step 4/5] >>> Local node addresses: [127.0.0.1] [21:15:16] : [Step 4/5] >>> Local ports: TCP:10800 TCP:47100 TCP:47500 [21:15:16] : [Step 4/5] [21:15:16] : [Step 4/5] [2021-11-19 21:15:16,003][INFO ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] >>> Ignite cluster is in INACTIVE state (limited functionality available). Use control.(sh|bat) script or IgniteCluster.state(ClusterState.ACTIVE) to change the state. [21:15:16] : [Step 4/5] [2021-11-19 21:15:16,005][INFO ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][GridDiscoveryManager] Topology snapshot [ver=1, locNode=008cb00a, servers=1, clients=0, state=INACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=008cb00a-6a9b-4c09-a154-85082cd15000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:15:16] : [Step 4/5] [2021-11-19 21:15:16,006][INFO ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][G] Node started : [stage="Configure system pool" (0 ms),stage="Start managers" (241 ms),stage="Configure binary metadata" (2 ms),stage="Start processors" (366 ms),stage="Start 'StanByClusterTestProvider' plugin" (0 ms),stage="Start 'PageMemory tracker plugin' plugin" (0 ms),stage="Start 'TestDistibutedConfigurationPlugin' plugin" (0 ms),stage="Start 'NodeValidationPluginProvider' plugin" (0 ms),stage="Init metastore" (242 ms),stage="Init and start regions" (8 ms),stage="Restore binary memory" (15 ms),stage="Restore logical state" (9 ms),stage="Finish recovery" (7 ms),stage="Join topology" (12 ms),stage="Await transition" (2 ms),stage="Await exchange" (16 ms),stage="Total time" (920 ms)] [21:15:16] : [Step 4/5] [2021-11-19 21:15:16,007][INFO ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][root] Node started with the following configuration [id=008cb00a-6a9b-4c09-a154-85082cd15000, marshaller=BinaryMarshaller [], discovery=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=5000, ackTimeout=5000, marsh=JdkMarshaller [clsFilter=org.apache.ignite.marshaller.MarshallerUtils$1@10aff6f7], reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], binaryCfg=null, lateAff=true] [21:15:16]W: [org.apache.ignite:ignite-core] [2021-11-19 21:15:16,014][WARN ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][G] Ignite work directory is not provided, automatically resolved to: /opt/buildagent/work/7bc1c54bc719b67c/work [21:15:16] : [Step 4/5] [2021-11-19 21:15:16,016][INFO ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] [21:15:16] : [Step 4/5] [21:15:16] : [Step 4/5] >>> __________ ________________ [21:15:16] : [Step 4/5] >>> / _/ ___/ |/ / _/_ __/ __/ [21:15:16] : [Step 4/5] >>> _/ // (7 7 // / / / / _/ [21:15:16] : [Step 4/5] >>> /___/\___/_/|_/___/ /_/ /___/ [21:15:16] : [Step 4/5] >>> [21:15:16] : [Step 4/5] >>> ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:15:16] : [Step 4/5] >>> 2021 Copyright(C) Apache Software Foundation [21:15:16] : [Step 4/5] >>> [21:15:16] : [Step 4/5] >>> Ignite documentation: http://ignite.apache.org [21:15:16] : [Step 4/5] [21:15:16] : [Step 4/5] [2021-11-19 21:15:16,017][INFO ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] Config URL: n/a [21:15:16] : [Step 4/5] [2021-11-19 21:15:16,017][INFO ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] IgniteConfiguration [igniteInstanceName=grid-1, pubPoolSize=24, svcPoolSize=24, callbackPoolSize=24, stripedPoolSize=24, sysPoolSize=24, mgmtPoolSize=4, dataStreamerPoolSize=24, utilityCachePoolSize=24, utilityCacheKeepAliveTime=60000, p2pPoolSize=2, qryPoolSize=24, buildIdxPoolSize=4, igniteHome=/opt/buildagent/work/7bc1c54bc719b67c, igniteWorkDir=/opt/buildagent/work/7bc1c54bc719b67c/work, mbeanSrv=com.sun.jmx.mbeanserver.JmxMBeanServer@6fe85038, nodeId=1085686a-9887-4e3d-9d8b-a64775ae4001, marsh=BinaryMarshaller [], marshLocJobs=false, daemon=false, p2pEnabled=true, netTimeout=10000, netCompressionLevel=1, sndRetryDelay=1000, sndRetryCnt=3, metricsHistSize=10000, metricsUpdateFreq=1000, metricsExpTime=9223372036854775807, discoSpi=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=0, ackTimeout=0, marsh=null, reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], segPlc=STOP, segResolveAttempts=2, waitForSegOnStart=true, allResolversPassReq=true, segChkFreq=10000, commSpi=TcpCommunicationSpi [connectGate=org.apache.ignite.spi.communication.tcp.internal.ConnectGateway@89ff337, ctxInitLatch=java.util.concurrent.CountDownLatch@3c774eea[Count = 1], stopping=false, clientPool=null, nioSrvWrapper=null, stateProvider=null], evtSpi=MemoryEventStorageSpi [expireAgeMs=9223372036854775807, expireCnt=10000, filter=null], colSpi=NoopCollisionSpi [], deploySpi=LocalDeploymentSpi [], indexingSpi=org.apache.ignite.spi.indexing.noop.NoopIndexingSpi@70653392, addrRslvr=null, encryptionSpi=org.apache.ignite.spi.encryption.keystore.KeystoreEncryptionSpi@39a45606, tracingSpi=org.apache.ignite.spi.tracing.NoopTracingSpi@2b536a08, clientMode=false, rebalanceThreadPoolSize=4, rebalanceTimeout=10000, rebalanceBatchesPrefetchCnt=3, rebalanceThrottle=0, rebalanceBatchSize=524288, txCfg=TransactionConfiguration [txSerEnabled=false, dfltIsolation=REPEATABLE_READ, dfltConcurrency=PESSIMISTIC, dfltTxTimeout=0, txTimeoutOnPartitionMapExchange=0, deadlockTimeout=10000, pessimisticTxLogSize=0, pessimisticTxLogLinger=10000, tmLookupClsName=null, txManagerFactory=null, useJtaSync=false], cacheSanityCheckEnabled=true, discoStartupDelay=60000, deployMode=SHARED, p2pMissedCacheSize=100, locHost=127.0.0.1, timeSrvPortBase=31100, timeSrvPortRange=100, failureDetectionTimeout=10000, sysWorkerBlockedTimeout=null, clientFailureDetectionTimeout=10000, metricsLogFreq=0, connectorCfg=null, odbcCfg=null, warmupClos=null, atomicCfg=AtomicConfiguration [seqReserveSize=1000, cacheMode=PARTITIONED, backups=1, aff=null, grpName=null], classLdr=null, sslCtxFactory=null, platformCfg=null, binaryCfg=null, memCfg=null, pstCfg=null, dsCfg=DataStorageConfiguration [sysRegionInitSize=41943040, sysRegionMaxSize=104857600, pageSize=4096, concLvl=0, dfltDataRegConf=DataRegionConfiguration [name=default, maxSize=104857600, initSize=268435456, swapPath=null, pageEvictionMode=DISABLED, pageReplacementMode=CLOCK, evictionThreshold=0.9, emptyPagesPoolSize=100, metricsEnabled=false, metricsSubIntervalCount=5, metricsRateTimeInterval=60000, persistenceEnabled=true, checkpointPageBufSize=0, lazyMemoryAllocation=true, warmUpCfg=null], dataRegions=null, storagePath=null, checkpointFreq=30000, lockWaitTime=10000, checkpointThreads=4, checkpointWriteOrder=SEQUENTIAL, walHistSize=20, maxWalArchiveSize=20971520, walSegments=10, walSegmentSize=1048576, walPath=db/wal, walArchivePath=db/wal/archive, cdcWalPath=db/wal/cdc, cdcEnabled=false, metricsEnabled=false, walMode=LOG_ONLY, walTlbSize=131072, walBuffSize=0, walFlushFreq=2000, walFsyncDelay=1000, walRecordIterBuffSize=67108864, alwaysWriteFullPages=false, fileIOFactory=org.apache.ignite.internal.processors.cache.persistence.file.AsyncFileIOFactory@5bf16bb, metricsSubIntervalCnt=5, metricsRateTimeInterval=60000, walAutoArchiveAfterInactivity=-1, walForceArchiveTimeout=-1, writeThrottlingEnabled=false, walCompactionEnabled=false, walCompactionLevel=1, checkpointReadLockTimeout=null, walPageCompression=DISABLED, walPageCompressionLevel=null, dfltWarmUpCfg=null, encCfg=org.apache.ignite.configuration.EncryptionConfiguration@44e5fd5d, defragmentationThreadPoolSize=4, minWalArchiveSize=-1], snapshotPath=snapshots, activeOnStart=true, activeOnStartPropSetFlag=false, autoActivation=true, autoActivationPropSetFlag=false, clusterStateOnStart=null, sqlConnCfg=null, cliConnCfg=ClientConnectorConfiguration [host=null, port=10800, portRange=100, sockSndBufSize=0, sockRcvBufSize=0, tcpNoDelay=true, maxOpenCursorsPerConn=128, threadPoolSize=24, selectorCnt=12, idleTimeout=0, handshakeTimeout=10000, jdbcEnabled=true, odbcEnabled=true, thinCliEnabled=true, sslEnabled=false, useIgniteSslCtxFactory=true, sslClientAuth=false, sslCtxFactory=null, thinCliCfg=ThinClientConfiguration [maxActiveTxPerConn=100, maxActiveComputeTasksPerConn=0]], mvccVacuumThreadCnt=2, mvccVacuumFreq=5000, authEnabled=false, failureHnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]], commFailureRslvr=null, sqlCfg=SqlConfiguration [longQryWarnTimeout=3000, dfltQryTimeout=0, sqlQryHistSize=1000, validationEnabled=false], asyncContinuationExecutor=null] [21:15:16] : [Step 4/5] [2021-11-19 21:15:16,027][INFO ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] Daemon mode: off [21:15:16] : [Step 4/5] [2021-11-19 21:15:16,027][INFO ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] OS: Linux 4.15.0-151-generic amd64 [21:15:16] : [Step 4/5] [2021-11-19 21:15:16,027][INFO ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] OS user: teamcity [21:15:16] : [Step 4/5] [2021-11-19 21:15:16,028][INFO ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] PID: 16724 [21:15:16] : [Step 4/5] [2021-11-19 21:15:16,028][INFO ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] Language runtime: Java Platform API Specification ver. 1.8 [21:15:16] : [Step 4/5] [2021-11-19 21:15:16,028][INFO ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] VM information: Java(TM) SE Runtime Environment 1.8.0_261-b12 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 25.261-b12 [21:15:16] : [Step 4/5] [2021-11-19 21:15:16,029][INFO ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] VM total memory: 1.9GB [21:15:16] : [Step 4/5] [2021-11-19 21:15:16,029][INFO ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] Remote Management [restart: off, REST: off, JMX (remote: off)] [21:15:16] : [Step 4/5] [2021-11-19 21:15:16,029][INFO ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] Logger: GridTestLog4jLogger [quiet=false, config=null] [21:15:16] : [Step 4/5] [2021-11-19 21:15:16,030][INFO ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] IGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c [21:15:16] : [Step 4/5] [2021-11-19 21:15:16,030][INFO ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] VM arguments: [-DIGNITE_DUMP_THREADS_ON_FAILURE=false, -DMono=/usr/bin/mono-sgen, -DMono4.0_x64=/usr/lib/mono/4.0, -DMono4.5_x64=/usr/lib/mono/4.5, -DMonoVersion=6.12.0.90, -DSKIP_BUILD=false, -Dagent.home.dir=/opt/buildagent, -Dagent.name=aitc-lin02_03, -Dagent.ownPort=9090, -Dagent.work.dir=/opt/buildagent/work, -Dbuild.number=95, -Dbuild.vcs.number=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.1=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.GitHubApacheIgnite=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dclassworlds.conf=/opt/buildagent/temp/buildTmp/teamcity.m2.conf, -Dcom.jetbrains.maven.watcher.report.file=/opt/buildagent/temp/buildTmp/maven-build-info.xml, -Djava.io.tmpdir=/opt/buildagent/temp/buildTmp, -Dmaven.home=/opt/buildagent/tools/maven3_6, -Dmaven.multiModuleProjectDirectory=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.agent.cpuBenchmark=457, -Dteamcity.agent.dotnet.agent_url=http://localhost:9090/RPC2, -Dteamcity.agent.dotnet.build_id=6278078, -Dteamcity.auth.password=*******, -Dteamcity.auth.userId=TeamCityBuildId=6278078, -Dteamcity.build.changedFiles.file=/opt/buildagent/temp/buildTmp/changedFiles6342607772318147725.txt, -Dteamcity.build.checkoutDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.build.id=6278078, -Dteamcity.build.properties.file=/opt/buildagent/temp/buildTmp/teamcity.build5164517880467851002.properties, -Dteamcity.build.tempDir=/opt/buildagent/temp/buildTmp, -Dteamcity.build.workingDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.buildConfName=Basic 3, -Dteamcity.buildType.id=IgniteTests24Java8_Basic3, -Dteamcity.configuration.properties.file=/opt/buildagent/temp/buildTmp/teamcity.config5591980786735343870.properties, -Dteamcity.maven.userSettings.path=/opt/buildagent/temp/buildTmp/maven_settings_585072866407032347.xml, -Dteamcity.maven.watcher.home=/opt/buildagent/plugins/mavenPlugin/maven-watcher-jdk16, -Dteamcity.projectName=Ignite Tests 2.x (JDK 8/11), -Dteamcity.runner.properties.file=/opt/buildagent/temp/buildTmp/teamcity.runner9098465561618137420.properties, -Dteamcity.tests.recentlyFailedTests.file=/opt/buildagent/temp/buildTmp/testsToRunFirst3891775683130404069.txt, -Dteamcity.version=2021.2 (build 99542), -ea, -Xms2g, -Xmx2g, -XX:+HeapDumpOnOutOfMemoryError, -DIGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_TEST_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_UPDATE_NOTIFIER=false, -DIGNITE_NO_DISCO_ORDER=true, -DIGNITE_PERFORMANCE_SUGGESTIONS_DISABLED=true, -Djava.net.preferIPv4Stack=true, -DTEST_SCALE_FACTOR=1.0, -DIGNITE_TEST_PROP_LOG4J_FILE=log4j-tc-test.xml, -DIGNITE_QUIET=false, -DIGNITE_MARSHAL_BUFFERS_RECHECK=1000, -Dmaven.repo.local=/opt/buildagent/.m2/repository] [21:15:16]W: [org.apache.ignite:ignite-core] [2021-11-19 21:15:16,036][WARN ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] Peer class loading is enabled (disable it in production for performance and deployment consistency reasons) [21:15:16] : [Step 4/5] [2021-11-19 21:15:16,035][INFO ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] System cache's DataRegion size is configured to 40 MB. Use DataStorageConfiguration.systemRegionInitialSize property to change the setting. [21:15:16] : [Step 4/5] [2021-11-19 21:15:16,036][INFO ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] Configured caches [in 'sysMemPlc' dataRegion: ['ignite-sys-cache']] [21:15:16] : [Step 4/5] [2021-11-19 21:15:16,036][INFO ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] 3-rd party licenses can be found at: /opt/buildagent/work/7bc1c54bc719b67c/libs/licenses [21:15:16] : [Step 4/5] [2021-11-19 21:15:16,042][INFO ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] Configured plugins: [21:15:16] : [Step 4/5] [2021-11-19 21:15:16,042][INFO ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- StanByClusterTestProvider 1.0 [21:15:16] : [Step 4/5] [2021-11-19 21:15:16,042][INFO ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:15:16] : [Step 4/5] [2021-11-19 21:15:16,042][INFO ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] [21:15:16] : [Step 4/5] [2021-11-19 21:15:16,043][INFO ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- PageMemory tracker plugin 1.0 [21:15:16] : [Step 4/5] [2021-11-19 21:15:16,043][INFO ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:15:16] : [Step 4/5] [2021-11-19 21:15:16,043][INFO ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] [21:15:16] : [Step 4/5] [2021-11-19 21:15:16,043][INFO ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- TestDistibutedConfigurationPlugin 1.0 [21:15:16] : [Step 4/5] [2021-11-19 21:15:16,044][INFO ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:15:16] : [Step 4/5] [2021-11-19 21:15:16,044][INFO ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] [21:15:16] : [Step 4/5] [2021-11-19 21:15:16,044][INFO ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- NodeValidationPluginProvider 1.0 [21:15:16] : [Step 4/5] [2021-11-19 21:15:16,044][INFO ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:15:16] : [Step 4/5] [2021-11-19 21:15:16,045][INFO ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] [21:15:16] : [Step 4/5] [2021-11-19 21:15:16,045][INFO ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][FailureProcessor] Configured failure handler: [hnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]]] [21:15:16]W: [org.apache.ignite:ignite-core] [2021-11-19 21:15:16,072][WARN ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][TestRecordingCommunicationSpi] Message queue limit is set to 0 which may lead to potential OOMEs when running cache operations in FULL_ASYNC or PRIMARY_SYNC modes due to message queues growth on sender and receiver sides. [21:15:16] : [Step 4/5] [2021-11-19 21:15:16,072][INFO ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][TestRecordingCommunicationSpi] Successfully bound communication NIO server to TCP port [port=47101, locHost=/127.0.0.1, selectorsCnt=12, selectorSpins=0, pairedConn=false] [21:15:16] : [Step 4/5] [2021-11-19 21:15:16,081][INFO ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][GridCollisionManager] Collision resolution is disabled (all jobs will be activated upon arrival). [21:15:16] : [Step 4/5] [2021-11-19 21:15:16,081][INFO ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] Security status [authentication=off, sandbox=off, tls/ssl=off] [21:15:16] : [Step 4/5] [2021-11-19 21:15:16,142][INFO ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:15:16] : [Step 4/5] [2021-11-19 21:15:16,226][INFO ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][MaintenanceProcessor] Resolved store directory for node persistent data: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1 [21:15:16] : [Step 4/5] [2021-11-19 21:15:16,227][INFO ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][CacheObjectBinaryProcessorImpl] Resolved directory for serialized binary metadata: /opt/buildagent/work/7bc1c54bc719b67c/work/db/binary_meta/grid_1 [21:15:16] : [Step 4/5] [2021-11-19 21:15:16,231][INFO ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1 [21:15:16] : [Step 4/5] [2021-11-19 21:15:16,232][INFO ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][FileWriteAheadLogManager] Resolved write ahead log work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1 [21:15:16] : [Step 4/5] [2021-11-19 21:15:16,232][INFO ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][FileWriteAheadLogManager] Resolved write ahead log archive directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1 [21:15:16] : [Step 4/5] [2021-11-19 21:15:16,463][INFO ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000000.wal [21:15:16] : [Step 4/5] [2021-11-19 21:15:16,463][INFO ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][FileHandleManagerImpl] Initialized write-ahead log manager [mode=LOG_ONLY] [21:15:16] : [Step 4/5] [2021-11-19 21:15:16,470][INFO ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Configured data regions initialized successfully [total=5] [21:15:16] : [Step 4/5] [2021-11-19 21:15:16,643][INFO ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][IgniteSnapshotManager] Resolved snapshot work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/snapshots [21:15:16] : [Step 4/5] [2021-11-19 21:15:16,643][INFO ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][IgniteSnapshotManager] Resolved temp directory for snapshot creation: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1/snp [21:15:16] : [Step 4/5] [2021-11-19 21:15:16,646][INFO ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][ClientListenerProcessor] Client connector processor has started on TCP port 10801 [21:15:16] : [Step 4/5] [2021-11-19 21:15:16,649][INFO ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] Non-loopback local IPs: 172.17.0.4 [21:15:16] : [Step 4/5] [2021-11-19 21:15:16,650][INFO ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] Enabled local MACs: 0242AC110004 [21:15:16] : [Step 4/5] [2021-11-19 21:15:16,650][INFO ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:15:16] : [Step 4/5] [2021-11-19 21:15:16,652][INFO ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:15:16] : [Step 4/5] [2021-11-19 21:15:16,652][INFO ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:15:16] : [Step 4/5] [2021-11-19 21:15:16,655][INFO ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Applying lost metastore updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:15:16] : [Step 4/5] [2021-11-19 21:15:16,657][INFO ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=10 ms] [21:15:16] : [Step 4/5] [2021-11-19 21:15:16,657][INFO ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Restoring partition state for local groups. [21:15:16] : [Step 4/5] [2021-11-19 21:15:16,658][INFO ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=0, partitionsProcessed=0, time=0ms] [21:15:16] : [Step 4/5] [2021-11-19 21:15:16,658][INFO ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][GridEncryptionManager] Encryption keys loaded from metastore. [grps=, masterKeyName=ignite.master.key] [21:15:16] : [Step 4/5] [2021-11-19 21:15:16,660][INFO ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][ClusterProcessor] Cluster ID and tag has been read from metastorage: null [21:15:16] : [Step 4/5] [2021-11-19 21:15:16,660][INFO ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][IgniteClusterImpl] Shutdown policy was updated [oldVal=null, newVal=null] [21:15:16] : [Step 4/5] [2021-11-19 21:15:16,660][INFO ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Checkpoint frequency deviation changed [oldVal=null, newVal=null] [21:15:16] : [Step 4/5] [2021-11-19 21:15:16,957][INFO ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][FilePageStoreManager] Cleanup cache stores [total=1, left=0, cleanFiles=false] [21:15:16] : [Step 4/5] [2021-11-19 21:15:16,960][INFO ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:15:16] : [Step 4/5] [2021-11-19 21:15:16,961][INFO ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:15:16] : [Step 4/5] [2021-11-19 21:15:16,963][INFO ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:15:16] : [Step 4/5] [2021-11-19 21:15:16,963][INFO ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Data Regions Started: 5 [21:15:16] : [Step 4/5] [2021-11-19 21:15:16,964][INFO ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] ^-- sysMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:15:16] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:15:16] : [Step 4/5] ^-- default region [type=default, persistence=true, lazyAlloc=true, [21:15:16] : [Step 4/5] ... initCfg=100MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB, allocTotal=0MB] [21:15:16] : [Step 4/5] ^-- metastoreMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:15:16] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:15:16] : [Step 4/5] ^-- TxLog region [type=internal, persistence=true, lazyAlloc=false, [21:15:16] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:15:16] : [Step 4/5] ^-- volatileDsMemPlc region [type=user, persistence=false, lazyAlloc=true, [21:15:16] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB] [21:15:16] : [Step 4/5] ^-- Ignite persistence [used=0MB] [21:15:16] : [Step 4/5] [21:15:16] : [Step 4/5] [2021-11-19 21:15:16,965][INFO ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Starting binary memory restore for: [-2100569601] [21:15:16] : [Step 4/5] [2021-11-19 21:15:16,974][INFO ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:15:16] : [Step 4/5] [2021-11-19 21:15:16,974][INFO ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:15:16] : [Step 4/5] [2021-11-19 21:15:16,978][INFO ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000000.wal, offset=0, ver=2] [21:15:16] : [Step 4/5] [2021-11-19 21:15:16,981][INFO ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Started cache in recovery mode [name=ignite-sys-cache, id=-2100569601, dataRegionName=sysMemPlc, mode=REPLICATED, atomicity=TRANSACTIONAL, backups=2147483647, mvcc=false] [21:15:16] : [Step 4/5] [2021-11-19 21:15:16,982][INFO ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Binary recovery performed in 17 ms. [21:15:16] : [Step 4/5] [2021-11-19 21:15:16,982][INFO ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:15:16] : [Step 4/5] [2021-11-19 21:15:16,982][INFO ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Applying lost cache updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:15:16] : [Step 4/5] [2021-11-19 21:15:16,985][INFO ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=0 ms] [21:15:16] : [Step 4/5] [2021-11-19 21:15:16,985][INFO ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Restoring partition state for local groups. [21:15:17] : [Step 4/5] [2021-11-19 21:15:17,011][INFO ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=1, partitionsProcessed=100, time=31ms] [21:15:17] : [Step 4/5] [2021-11-19 21:15:17,037][INFO ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][TestTcpDiscoverySpi] Successfully bound to TCP port [port=47501, localHost=localhost/127.0.0.1, locNodeId=1085686a-9887-4e3d-9d8b-a64775ae4001] [21:15:17] : [Step 4/5] [2021-11-19 21:15:17,042][INFO ][tcp-disco-srvr-[:47500]-#1400%grid-0%-#26659%grid-0%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=60111] [21:15:17] : [Step 4/5] [2021-11-19 21:15:17,043][INFO ][tcp-disco-srvr-[:47500]-#1400%grid-0%-#26659%grid-0%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=60111] [21:15:17] : [Step 4/5] [2021-11-19 21:15:17,043][INFO ][tcp-disco-sock-reader-[]-#1406%grid-0%-#26779%grid-0%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:60111, rmtPort=60111] [21:15:17] : [Step 4/5] [2021-11-19 21:15:17,045][INFO ][tcp-disco-sock-reader-[1085686a 127.0.0.1:60111]-#1406%grid-0%-#26779%grid-0%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=1085686a-9887-4e3d-9d8b-a64775ae4001, rmtAddr=/127.0.0.1:60111] [21:15:17] : [Step 4/5] [2021-11-19 21:15:17,051][INFO ][tcp-disco-srvr-[:47501]-#1405%grid-1%-#26778%grid-1%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=39521] [21:15:17] : [Step 4/5] [2021-11-19 21:15:17,051][INFO ][tcp-disco-srvr-[:47501]-#1405%grid-1%-#26778%grid-1%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=39521] [21:15:17] : [Step 4/5] [2021-11-19 21:15:17,052][INFO ][tcp-disco-sock-reader-[]-#1407%grid-1%-#26780%grid-1%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:39521, rmtPort=39521] [21:15:17] : [Step 4/5] [2021-11-19 21:15:17,052][INFO ][tcp-disco-sock-reader-[]-#1407%grid-1%-#26780%grid-1%][TestTcpDiscoverySpi] Received ping request from the remote node [rmtNodeId=008cb00a-6a9b-4c09-a154-85082cd15000, rmtAddr=/127.0.0.1:39521, rmtPort=39521] [21:15:17] : [Step 4/5] [2021-11-19 21:15:17,054][INFO ][tcp-disco-sock-reader-[]-#1407%grid-1%-#26780%grid-1%][TestTcpDiscoverySpi] Finished writing ping response [rmtNodeId=008cb00a-6a9b-4c09-a154-85082cd15000, rmtAddr=/127.0.0.1:39521, rmtPort=39521] [21:15:17] : [Step 4/5] [2021-11-19 21:15:17,054][INFO ][tcp-disco-sock-reader-[1085686a 127.0.0.1:60111]-#1406%grid-0%-#26779%grid-0%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:60111, rmtPort=60111, rmtNodeId=1085686a-9887-4e3d-9d8b-a64775ae4001] [21:15:17]W: [org.apache.ignite:ignite-core] [2021-11-19 21:15:17,054][WARN ][tcp-disco-sock-reader-[]-#1407%grid-1%-#26780%grid-1%][TestTcpDiscoverySpi] Failed to shutdown socket [21:15:17]W: [org.apache.ignite:ignite-core] java.net.SocketException: Socket output is already shutdown [21:15:17]W: [org.apache.ignite:ignite-core] at java.net.Socket.shutdownOutput(Socket.java:1572) [21:15:17]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.close(IgniteUtils.java:4247) [21:15:17]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.discovery.tcp.ServerImpl$SocketReader.body(ServerImpl.java:7370) [21:15:17]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.IgniteSpiThread.run(IgniteSpiThread.java:58) [21:15:17] : [Step 4/5] [2021-11-19 21:15:17,057][INFO ][tcp-disco-sock-reader-[]-#1407%grid-1%-#26780%grid-1%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:39521, rmtPort=39521, rmtNodeId=null] [21:15:17] : [Step 4/5] [2021-11-19 21:15:17,058][INFO ][tcp-disco-msg-worker-[crd]-#1399%grid-0%-#26658%grid-0%][GridEncryptionManager] Joining node doesn't have stored group keys [node=1085686a-9887-4e3d-9d8b-a64775ae4001] [21:15:17] : [Step 4/5] [2021-11-19 21:15:17,069][INFO ][tcp-disco-msg-worker-[crd]-#1399%grid-0%-#26658%grid-0%][TestTcpDiscoverySpi] New next node [newNext=TcpDiscoveryNode [id=1085686a-9887-4e3d-9d8b-a64775ae4001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=0, intOrder=2, lastExchangeTime=1637345717040, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false]] [21:15:17] : [Step 4/5] [2021-11-19 21:15:17,070][INFO ][tcp-disco-srvr-[:47501]-#1405%grid-1%-#26778%grid-1%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=40415] [21:15:17] : [Step 4/5] [2021-11-19 21:15:17,071][INFO ][tcp-disco-srvr-[:47501]-#1405%grid-1%-#26778%grid-1%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=40415] [21:15:17] : [Step 4/5] [2021-11-19 21:15:17,071][INFO ][tcp-disco-sock-reader-[]-#1408%grid-1%-#26781%grid-1%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:40415, rmtPort=40415] [21:15:17] : [Step 4/5] [2021-11-19 21:15:17,073][INFO ][tcp-disco-sock-reader-[008cb00a 127.0.0.1:40415]-#1408%grid-1%-#26781%grid-1%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=008cb00a-6a9b-4c09-a154-85082cd15000, rmtAddr=/127.0.0.1:40415] [21:15:17] : [Step 4/5] [2021-11-19 21:15:17,077][INFO ][tcp-disco-msg-worker-[]-#1404%grid-1%-#26777%grid-1%][TestTcpDiscoverySpi] New next node [newNext=TcpDiscoveryNode [id=008cb00a-6a9b-4c09-a154-85082cd15000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345717070, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false]] [21:15:17] : [Step 4/5] [2021-11-19 21:15:17,078][INFO ][tcp-disco-srvr-[:47500]-#1400%grid-0%-#26659%grid-0%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=41673] [21:15:17] : [Step 4/5] [2021-11-19 21:15:17,078][INFO ][tcp-disco-srvr-[:47500]-#1400%grid-0%-#26659%grid-0%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=41673] [21:15:17] : [Step 4/5] [2021-11-19 21:15:17,079][INFO ][tcp-disco-sock-reader-[]-#1409%grid-0%-#26782%grid-0%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:41673, rmtPort=41673] [21:15:17] : [Step 4/5] [2021-11-19 21:15:17,080][INFO ][tcp-disco-sock-reader-[1085686a 127.0.0.1:41673]-#1409%grid-0%-#26782%grid-0%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=1085686a-9887-4e3d-9d8b-a64775ae4001, rmtAddr=/127.0.0.1:41673] [21:15:17] : [Step 4/5] [2021-11-19 21:15:17,082][INFO ][disco-event-worker-#26661%grid-0%][GridDiscoveryManager] Added new node to topology: TcpDiscoveryNode [id=1085686a-9887-4e3d-9d8b-a64775ae4001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637345717040, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false] [21:15:17] : [Step 4/5] [2021-11-19 21:15:17,083][INFO ][disco-event-worker-#26661%grid-0%][GridDiscoveryManager] Topology snapshot [ver=2, locNode=008cb00a, servers=2, clients=0, state=INACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=008cb00a-6a9b-4c09-a154-85082cd15000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=1085686a-9887-4e3d-9d8b-a64775ae4001, consistentId=grid-1, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:15:17] : [Step 4/5] [2021-11-19 21:15:17,086][INFO ][tcp-disco-msg-worker-[008cb00a 127.0.0.1:47500]-#1404%grid-1%-#26777%grid-1%][ClusterProcessor] elated_lamarr [21:15:17] : [Step 4/5] [2021-11-19 21:15:17,086][INFO ][tcp-disco-msg-worker-[008cb00a 127.0.0.1:47500]-#1404%grid-1%-#26777%grid-1%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustEnabled' was changed from 'null' to 'false' [21:15:17] : [Step 4/5] [2021-11-19 21:15:17,087][INFO ][tcp-disco-msg-worker-[008cb00a 127.0.0.1:47500]-#1404%grid-1%-#26777%grid-1%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustTimeout' was changed from 'null' to '300000' [21:15:17] : [Step 4/5] [2021-11-19 21:15:17,087][INFO ][tcp-disco-msg-worker-[008cb00a 127.0.0.1:47500]-#1404%grid-1%-#26777%grid-1%][IgniteTxManager] Transactions parameter 'longOperationsDumpTimeout' was changed from 'null' to '60000' [21:15:17] : [Step 4/5] [2021-11-19 21:15:17,088][INFO ][tcp-disco-msg-worker-[008cb00a 127.0.0.1:47500]-#1404%grid-1%-#26777%grid-1%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpThreshold' was changed from 'null' to '0' [21:15:17] : [Step 4/5] [2021-11-19 21:15:17,089][INFO ][tcp-disco-msg-worker-[008cb00a 127.0.0.1:47500]-#1404%grid-1%-#26777%grid-1%][IgniteTxManager] Transactions parameter 'transactionTimeDumpSamplesCoefficient' was changed from 'null' to '0.0' [21:15:17] : [Step 4/5] [2021-11-19 21:15:17,090][INFO ][tcp-disco-msg-worker-[008cb00a 127.0.0.1:47500]-#1404%grid-1%-#26777%grid-1%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpSamplesPerSecondLimit' was changed from 'null' to '5' [21:15:17] : [Step 4/5] [2021-11-19 21:15:17,090][INFO ][tcp-disco-msg-worker-[008cb00a 127.0.0.1:47500]-#1404%grid-1%-#26777%grid-1%][IgniteTxManager] Transactions parameter 'collisionsDumpInterval' was changed from 'null' to '1000' [21:15:17] : [Step 4/5] [2021-11-19 21:15:17,090][INFO ][tcp-disco-msg-worker-[008cb00a 127.0.0.1:47500]-#1404%grid-1%-#26777%grid-1%][IgniteTxManager] Transactions parameter 'txOwnerDumpRequestsAllowed' was changed from 'null' to 'true' [21:15:17] : [Step 4/5] [2021-11-19 21:15:17,091][INFO ][tcp-disco-msg-worker-[008cb00a 127.0.0.1:47500]-#1404%grid-1%-#26777%grid-1%][GridCacheDatabaseSharedManager] Historical rebalance WAL threshold changed [property=historical.rebalance.threshold, oldVal=null, newVal=500] [21:15:17] : [Step 4/5] [2021-11-19 21:15:17,091][INFO ][disco-notifier-worker-#26776%grid-1%][MvccProcessorImpl] Assigned mvcc coordinator [crd=MvccCoordinator [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=0], nodeId=008cb00a-6a9b-4c09-a154-85082cd15000, ver=1637345715983, local=false, initialized=false]] [21:15:17] : [Step 4/5] [2021-11-19 21:15:17,100][INFO ][sys-#26755%grid-1%][ClusterProcessor] Writing cluster ID and tag to metastorage on ready for write ClusterIdAndTag [id=ff5290fc-e3c4-4d9f-988a-68e45d1ee9f7, tag=elated_lamarr] [21:15:17] : [Step 4/5] [2021-11-19 21:15:17,109][INFO ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] To start Console Management & Monitoring run ignitevisorcmd.{sh|bat} [21:15:17] : [Step 4/5] [2021-11-19 21:15:17,109][INFO ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] [21:15:17] : [Step 4/5] [21:15:17] : [Step 4/5] >>> +-------------------------------------------+ [21:15:17] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:15:17] : [Step 4/5] >>> +-------------------------------------------+ [21:15:17] : [Step 4/5] >>> OS name: Linux 4.15.0-151-generic amd64 [21:15:17] : [Step 4/5] >>> CPU(s): 24 [21:15:17] : [Step 4/5] >>> Heap: 2.0GB [21:15:17] : [Step 4/5] >>> VM name: 16724@c4dfe9a430b2 [21:15:17] : [Step 4/5] >>> Ignite instance name: grid-1 [21:15:17] : [Step 4/5] >>> Local node [ID=1085686A-9887-4E3D-9D8B-A64775AE4001, order=2, clientMode=false] [21:15:17] : [Step 4/5] >>> Local node addresses: [127.0.0.1] [21:15:17] : [Step 4/5] >>> Local ports: TCP:10801 TCP:47101 TCP:47501 [21:15:17] : [Step 4/5] [21:15:17] : [Step 4/5] [2021-11-19 21:15:17,110][INFO ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] >>> Ignite cluster is in INACTIVE state (limited functionality available). Use control.(sh|bat) script or IgniteCluster.state(ClusterState.ACTIVE) to change the state. [21:15:17] : [Step 4/5] [2021-11-19 21:15:17,111][INFO ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][GridDiscoveryManager] Topology snapshot [ver=2, locNode=1085686a, servers=2, clients=0, state=INACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=008cb00a-6a9b-4c09-a154-85082cd15000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=1085686a-9887-4e3d-9d8b-a64775ae4001, consistentId=grid-1, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:15:17] : [Step 4/5] [2021-11-19 21:15:17,112][INFO ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][G] Node started : [stage="Configure system pool" (0 ms),stage="Start managers" (212 ms),stage="Configure binary metadata" (2 ms),stage="Start processors" (419 ms),stage="Start 'StanByClusterTestProvider' plugin" (0 ms),stage="Start 'PageMemory tracker plugin' plugin" (0 ms),stage="Start 'TestDistibutedConfigurationPlugin' plugin" (0 ms),stage="Start 'NodeValidationPluginProvider' plugin" (0 ms),stage="Init metastore" (308 ms),stage="Init and start regions" (8 ms),stage="Restore binary memory" (16 ms),stage="Restore logical state" (29 ms),stage="Finish recovery" (23 ms),stage="Join topology" (55 ms),stage="Await transition" (2 ms),stage="Await exchange" (17 ms),stage="Total time" (1091 ms)] [21:15:17] : [Step 4/5] [2021-11-19 21:15:17,113][INFO ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][root] Node started with the following configuration [id=1085686a-9887-4e3d-9d8b-a64775ae4001, marshaller=BinaryMarshaller [], discovery=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=5000, ackTimeout=5000, marsh=JdkMarshaller [clsFilter=org.apache.ignite.marshaller.MarshallerUtils$1@2f27ce09], reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], binaryCfg=null, lateAff=true] [21:15:17] : [Step 4/5] [2021-11-19 21:15:17,115][INFO ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][GridClusterStateProcessor] Sending activate cluster request with BaselineTopology BaselineTopology [id=0, branchingHash=-2475315501, branchingType='New BaselineTopology', baselineNodes=[grid-1, grid-0]] [21:15:17] : [Step 4/5] [2021-11-19 21:15:17,121][INFO ][disco-notifier-worker-#26657%grid-0%][GridClusterStateProcessor] Received activate cluster request with BaselineTopology[id=0] initiator node ID: 008cb00a-6a9b-4c09-a154-85082cd15000 [21:15:17] : [Step 4/5] [2021-11-19 21:15:17,121][INFO ][disco-notifier-worker-#26657%grid-0%][GridClusterStateProcessor] Started state transition: activate cluster [21:15:17] : [Step 4/5] [2021-11-19 21:15:17,122][INFO ][exchange-worker-#26662%grid-0%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], crd=true, evt=DISCOVERY_CUSTOM_EVT, evtNode=008cb00a-6a9b-4c09-a154-85082cd15000, customEvt=ChangeGlobalStateMessage [id=64b3e593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqId=1d96c46e-f7a1-47ab-b52a-6d75b91619fd, initiatingNodeId=008cb00a-6a9b-4c09-a154-85082cd15000, state=ACTIVE, baselineTopology=BaselineTopology [id=0, branchingHash=-2475315501, branchingType='New BaselineTopology', baselineNodes=[grid-1, grid-0]], forceChangeBaselineTopology=false, timestamp=1637345717115, forceDeactivation=true], allowMerge=false, exchangeFreeSwitch=false] [21:15:17] : [Step 4/5] [2021-11-19 21:15:17,122][INFO ][disco-notifier-worker-#26776%grid-1%][GridClusterStateProcessor] Received activate cluster request with BaselineTopology[id=0] initiator node ID: 008cb00a-6a9b-4c09-a154-85082cd15000 [21:15:17] : [Step 4/5] [2021-11-19 21:15:17,123][INFO ][exchange-worker-#26662%grid-0%][GridDhtPartitionsExchangeFuture] Start activation process [nodeId=008cb00a-6a9b-4c09-a154-85082cd15000, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]]. New state: ACTIVE [21:15:17] : [Step 4/5] [2021-11-19 21:15:17,124][INFO ][exchange-worker-#26662%grid-0%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0 [21:15:17] : [Step 4/5] [2021-11-19 21:15:17,123][INFO ][disco-notifier-worker-#26776%grid-1%][GridClusterStateProcessor] Started state transition: activate cluster [21:15:17] : [Step 4/5] [2021-11-19 21:15:17,126][INFO ][exchange-worker-#26662%grid-0%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000000.wal, offset=8795, ver=2] [21:15:17] : [Step 4/5] [2021-11-19 21:15:17,126][INFO ][exchange-worker-#26785%grid-1%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], crd=false, evt=DISCOVERY_CUSTOM_EVT, evtNode=008cb00a-6a9b-4c09-a154-85082cd15000, customEvt=ChangeGlobalStateMessage [id=64b3e593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqId=1d96c46e-f7a1-47ab-b52a-6d75b91619fd, initiatingNodeId=008cb00a-6a9b-4c09-a154-85082cd15000, state=ACTIVE, baselineTopology=BaselineTopology [id=0, branchingHash=-2475315501, branchingType='New BaselineTopology', baselineNodes=[grid-1, grid-0]], forceChangeBaselineTopology=false, timestamp=1637345717115, forceDeactivation=true], allowMerge=false, exchangeFreeSwitch=false] [21:15:17] : [Step 4/5] [2021-11-19 21:15:17,130][INFO ][exchange-worker-#26662%grid-0%][GridClusterStateProcessor] Writing BaselineTopology[id=0] [21:15:17] : [Step 4/5] [2021-11-19 21:15:17,131][INFO ][exchange-worker-#26785%grid-1%][GridDhtPartitionsExchangeFuture] Start activation process [nodeId=1085686a-9887-4e3d-9d8b-a64775ae4001, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]]. New state: ACTIVE [21:15:17] : [Step 4/5] [2021-11-19 21:15:17,132][INFO ][exchange-worker-#26785%grid-1%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1 [21:15:17] : [Step 4/5] [2021-11-19 21:15:17,134][INFO ][exchange-worker-#26662%grid-0%][GridCacheDatabaseSharedManager] Finish recovery performed in 10 ms. [21:15:17] : [Step 4/5] [2021-11-19 21:15:17,136][INFO ][exchange-worker-#26662%grid-0%][msg] Components activation performed in 12 ms. [21:15:17] : [Step 4/5] [2021-11-19 21:15:17,137][INFO ][exchange-worker-#26785%grid-1%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000000.wal, offset=8795, ver=2] [21:15:17] : [Step 4/5] [2021-11-19 21:15:17,137][INFO ][exchange-worker-#26662%grid-0%][GridCacheProcessor] Finished recovery for cache [cache=ignite-sys-cache, grp=ignite-sys-cache, startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:15:17] : [Step 4/5] [2021-11-19 21:15:17,138][INFO ][exchange-worker-#26662%grid-0%][GridDhtPartitionsExchangeFuture] Successfully activated caches [nodeId=008cb00a-6a9b-4c09-a154-85082cd15000, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], newState=ACTIVE] [21:15:17] : [Step 4/5] [2021-11-19 21:15:17,139][INFO ][exchange-worker-#26662%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:15:17] : [Step 4/5] [2021-11-19 21:15:17,138][INFO ][exchange-worker-#26785%grid-1%][GridClusterStateProcessor] Writing BaselineTopology[id=0] [21:15:17] : [Step 4/5] [2021-11-19 21:15:17,142][INFO ][exchange-worker-#26785%grid-1%][GridCacheDatabaseSharedManager] Finish recovery performed in 9 ms. [21:15:17] : [Step 4/5] [2021-11-19 21:15:17,143][INFO ][exchange-worker-#26785%grid-1%][msg] Components activation performed in 11 ms. [21:15:17] : [Step 4/5] [2021-11-19 21:15:17,143][INFO ][exchange-worker-#26785%grid-1%][GridCacheProcessor] Finished recovery for cache [cache=ignite-sys-cache, grp=ignite-sys-cache, startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:15:17] : [Step 4/5] [2021-11-19 21:15:17,144][INFO ][exchange-worker-#26785%grid-1%][GridDhtPartitionsExchangeFuture] Successfully activated caches [nodeId=1085686a-9887-4e3d-9d8b-a64775ae4001, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], newState=ACTIVE] [21:15:17] : [Step 4/5] [2021-11-19 21:15:17,145][INFO ][exchange-worker-#26785%grid-1%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:15:17] : [Step 4/5] [2021-11-19 21:15:17,148][INFO ][exchange-worker-#26662%grid-0%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], crd=true] [21:15:17] : [Step 4/5] [2021-11-19 21:15:17,156][INFO ][grid-nio-worker-tcp-comm-0-#26600%TestRecordingCommunicationSpi%][TestRecordingCommunicationSpi] Accepted incoming communication connection [locAddr=/127.0.0.1:47100, rmtAddr=/127.0.0.1:35654] [21:15:17] : [Step 4/5] [2021-11-19 21:15:17,158][INFO ][grid-nio-worker-tcp-comm-0-#26719%TestRecordingCommunicationSpi%][TestRecordingCommunicationSpi] Established outgoing communication connection [locAddr=/127.0.0.1:35654, rmtAddr=/127.0.0.1:47100] [21:15:17] : [Step 4/5] [2021-11-19 21:15:17,159][INFO ][exchange-worker-#26785%grid-1%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], crd=false] [21:15:17] : [Step 4/5] [2021-11-19 21:15:17,161][INFO ][sys-#26635%grid-0%][GridDhtPartitionsExchangeFuture] Coordinator received single message [ver=AffinityTopologyVersion [topVer=2, minorTopVer=1], node=1085686a-9887-4e3d-9d8b-a64775ae4001, allReceived=true] [21:15:17] : [Step 4/5] [2021-11-19 21:15:17,161][INFO ][sys-#26635%grid-0%][GridDhtPartitionsExchangeFuture] finishExchangeOnCoordinator [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:15:17] : [Step 4/5] [2021-11-19 21:15:17,167][INFO ][sys-#26635%grid-0%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], err=null, rebalanced=true, wasRebalanced=false] [21:15:17] : [Step 4/5] [2021-11-19 21:15:17,168][INFO ][disco-notifier-worker-#26776%grid-1%][GridClusterStateProcessor] Received state change finish message: ACTIVE [21:15:17] : [Step 4/5] [2021-11-19 21:15:17,168][INFO ][sys-#26759%grid-1%][GridDhtPartitionsExchangeFuture] Received full message, will finish exchange [node=008cb00a-6a9b-4c09-a154-85082cd15000, resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:15:17] : [Step 4/5] [2021-11-19 21:15:17,167][INFO ][disco-notifier-worker-#26657%grid-0%][GridClusterStateProcessor] Received state change finish message: ACTIVE [21:15:17] : [Step 4/5] [2021-11-19 21:15:17,171][INFO ][sys-#26635%grid-0%][GridCacheProcessor] Finish proxy initialization, cacheName=ignite-sys-cache, localNodeId=008cb00a-6a9b-4c09-a154-85082cd15000 [21:15:17] : [Step 4/5] [2021-11-19 21:15:17,171][INFO ][disco-notifier-worker-#26657%grid-0%][GridClusterStateProcessor] Cluster state was changed from INACTIVE to ACTIVE [21:15:17] : [Step 4/5] [2021-11-19 21:15:17,171][INFO ][sys-#26754%grid-1%][GridCachePartitionExchangeManager] Delay process full message without exchange id (there is exchange in progress) [nodeId=008cb00a-6a9b-4c09-a154-85082cd15000] [21:15:17] : [Step 4/5] [2021-11-19 21:15:17,169][INFO ][disco-notifier-worker-#26776%grid-1%][GridClusterStateProcessor] Cluster state was changed from INACTIVE to ACTIVE [21:15:17] : [Step 4/5] [2021-11-19 21:15:17,171][INFO ][sys-#26635%grid-0%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=008cb00a-6a9b-4c09-a154-85082cd15000, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=008cb00a-6a9b-4c09-a154-85082cd15000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345717161, loc=true, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:15:17] : [Step 4/5] [2021-11-19 21:15:17,171][INFO ][exchange-worker-#26662%grid-0%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=2, minorTopVer=1], force=false, evt=DISCOVERY_CUSTOM_EVT, node=008cb00a-6a9b-4c09-a154-85082cd15000] [21:15:17] : [Step 4/5] [2021-11-19 21:15:17,171][INFO ][sys-#26653%grid-0%][DistributedBaselineConfiguration] Baseline auto-adjust is 'disabled' with timeout='300000' ms [21:15:17] : [Step 4/5] [2021-11-19 21:15:17,171][INFO ][sys-#26759%grid-1%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], err=null, rebalanced=true, wasRebalanced=false] [21:15:17] : [Step 4/5] [2021-11-19 21:15:17,174][INFO ][sys-#26653%grid-0%][GridClusterStateProcessor] Successfully performed final activation steps [nodeId=008cb00a-6a9b-4c09-a154-85082cd15000, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:15:17] : [Step 4/5] [2021-11-19 21:15:17,173][INFO ][sys-#26635%grid-0%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (1 ms), stage="Update caches registry" (13 ms), stage="Start caches" (1 ms), stage="Affinity initialization on cache group start" (0 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Restore partition states" (0 ms), stage="After states restored callback" (8 ms), stage="WAL history reservation" (0 ms), stage="Waiting for all single messages" (13 ms), stage="Affinity recalculation (crd)" (0 ms), stage="Collect update counters and create affinity messages" (0 ms), stage="Assign partitions states" (0 ms), stage="Validate partitions states" (0 ms), stage="Ideal affinity diff calculation (enforced)" (0 ms), stage="Apply update counters" (0 ms), stage="Full message preparing" (3 ms), stage="Full message sending" (0 ms), stage="State finish message sending" (0 ms), stage="Detect lost partitions" (2 ms), stage="Exchange done" (3 ms), stage="Total time" (44 ms), Discovery lag=4 ms, Latest started node id=1085686a-9887-4e3d-9d8b-a64775ae4001] [21:15:17] : [Step 4/5] [2021-11-19 21:15:17,176][INFO ][sys-#26759%grid-1%][GridCacheProcessor] Finish proxy initialization, cacheName=ignite-sys-cache, localNodeId=1085686a-9887-4e3d-9d8b-a64775ae4001 [21:15:17] : [Step 4/5] [2021-11-19 21:15:17,178][INFO ][sys-#26635%grid-0%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], stage="Affinity initialization on cache group start [grp=ignite-sys-cache]" (0 ms) (parent=Affinity initialization on cache group start), stage="Affinity centralized initialization (crd) [grp=ignite-sys-cache, crd=true]" (0 ms) (parent=Determine exchange type), stage="Restore partition states [grp=ignite-sys-cache]" (0 ms) (parent=Restore partition states), stage="Affinity recalculation (partitions availability) [grp=ignite-sys-cache]" (0 ms) (parent=Ideal affinity diff calculation (enforced))] [21:15:17] : [Step 4/5] [2021-11-19 21:15:17,183][INFO ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][root] awaitPartitionMapExchange finished [21:15:17] : [Step 4/5] [2021-11-19 21:15:17,179][INFO ][sys-#26759%grid-1%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=1085686a-9887-4e3d-9d8b-a64775ae4001, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=008cb00a-6a9b-4c09-a154-85082cd15000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345717070, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:15:17] : [Step 4/5] [2021-11-19 21:15:17,179][INFO ][exchange-worker-#26785%grid-1%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=2, minorTopVer=1], force=false, evt=DISCOVERY_CUSTOM_EVT, node=008cb00a-6a9b-4c09-a154-85082cd15000] [21:15:17] : [Step 4/5] [2021-11-19 21:15:17,179][INFO ][sys-#26767%grid-1%][DistributedBaselineConfiguration] Baseline auto-adjust is 'disabled' with timeout='300000' ms [21:15:17] : [Step 4/5] [2021-11-19 21:15:17,185][INFO ][sys-#26759%grid-1%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (4 ms), stage="Update caches registry" (12 ms), stage="Start caches" (0 ms), stage="Affinity initialization on cache group start" (0 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Restore partition states" (0 ms), stage="After states restored callback" (6 ms), stage="WAL history reservation" (0 ms), stage="Waiting for Full message" (17 ms), stage="Affinity recalculation" (1 ms), stage="Full map updating" (1 ms), stage="Detect lost partitions" (3 ms), stage="Exchange done" (10 ms), stage="Total time" (54 ms)] [21:15:17] : [Step 4/5] [2021-11-19 21:15:17,186][INFO ][sys-#26767%grid-1%][GridClusterStateProcessor] Successfully performed final activation steps [nodeId=1085686a-9887-4e3d-9d8b-a64775ae4001, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:15:17] : [Step 4/5] [2021-11-19 21:15:17,187][INFO ][sys-#26759%grid-1%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], stage="Affinity initialization on cache group start [grp=ignite-sys-cache]" (0 ms) (parent=Affinity initialization on cache group start), stage="Affinity centralized initialization (crd) [grp=ignite-sys-cache, crd=false]" (0 ms) (parent=Determine exchange type), stage="Restore partition states [grp=ignite-sys-cache]" (0 ms) (parent=Restore partition states), stage="Affinity applying from full message [grp=ignite-sys-cache]" (1 ms) (parent=Affinity recalculation)] [21:15:17] : [Step 4/5] [2021-11-19 21:15:17,190][INFO ][exchange-worker-#26662%grid-0%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], crd=true, evt=DISCOVERY_CUSTOM_EVT, evtNode=008cb00a-6a9b-4c09-a154-85082cd15000, customEvt=DynamicCacheChangeBatch [id=a6b3e593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqs=ArrayList [DynamicCacheChangeRequest [cacheName=encrypted, hasCfg=true, nodeId=008cb00a-6a9b-4c09-a154-85082cd15000, clientStartOnly=false, stop=false, destroy=false, disabledAfterStart=false]], exchangeActions=ExchangeActions [startCaches=[encrypted], stopCaches=null, startGrps=[encrypted], stopGrps=[], resetParts=null, stateChangeRequest=null], startCaches=false], allowMerge=false, exchangeFreeSwitch=false] [21:15:17] : [Step 4/5] [2021-11-19 21:15:17,192][INFO ][exchange-worker-#26662%grid-0%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:15:17] : [Step 4/5] [2021-11-19 21:15:17,190][INFO ][exchange-worker-#26785%grid-1%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], crd=false, evt=DISCOVERY_CUSTOM_EVT, evtNode=008cb00a-6a9b-4c09-a154-85082cd15000, customEvt=DynamicCacheChangeBatch [id=a6b3e593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqs=ArrayList [DynamicCacheChangeRequest [cacheName=encrypted, hasCfg=true, nodeId=008cb00a-6a9b-4c09-a154-85082cd15000, clientStartOnly=false, stop=false, destroy=false, disabledAfterStart=false]], exchangeActions=ExchangeActions [startCaches=[encrypted], stopCaches=null, startGrps=[encrypted], stopGrps=[], resetParts=null, stateChangeRequest=null], startCaches=false], allowMerge=false, exchangeFreeSwitch=false] [21:15:17] : [Step 4/5] [2021-11-19 21:15:17,196][INFO ][exchange-worker-#26785%grid-1%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:15:17] : [Step 4/5] [2021-11-19 21:15:17,197][INFO ][exchange-worker-#26662%grid-0%][GridCacheProcessor] Started cache [name=encrypted, id=1613773252, dataRegionName=default, mode=PARTITIONED, atomicity=ATOMIC, backups=0, mvcc=false] [21:15:17] : [Step 4/5] [2021-11-19 21:15:17,198][INFO ][exchange-worker-#26662%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], waitTime=0ms, futInfo=NA, mode=DISTRIBUTED] [21:15:17] : [Step 4/5] [2021-11-19 21:15:17,203][INFO ][exchange-worker-#26785%grid-1%][GridCacheProcessor] Started cache [name=encrypted, id=1613773252, dataRegionName=default, mode=PARTITIONED, atomicity=ATOMIC, backups=0, mvcc=false] [21:15:17] : [Step 4/5] [2021-11-19 21:15:17,204][INFO ][exchange-worker-#26785%grid-1%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], waitTime=0ms, futInfo=NA, mode=DISTRIBUTED] [21:15:17] : [Step 4/5] [2021-11-19 21:15:17,205][INFO ][exchange-worker-#26662%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partitions release latch: ServerLatch [permits=0, pendingAcks=HashSet [], super=CompletableLatch [id=CompletableLatchUid [id=exchange, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2]]]] [21:15:17] : [Step 4/5] [2021-11-19 21:15:17,206][INFO ][exchange-worker-#26662%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:15:17] : [Step 4/5] [2021-11-19 21:15:17,207][INFO ][exchange-worker-#26785%grid-1%][GridDhtPartitionsExchangeFuture] Finished waiting for partitions release latch: ClientLatch [coordinator=TcpDiscoveryNode [id=008cb00a-6a9b-4c09-a154-85082cd15000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345717070, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], ackSent=true, super=CompletableLatch [id=CompletableLatchUid [id=exchange, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2]]]] [21:15:17] : [Step 4/5] [2021-11-19 21:15:17,208][INFO ][exchange-worker-#26785%grid-1%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:15:17] : [Step 4/5] [2021-11-19 21:15:17,297][INFO ][exchange-worker-#26662%grid-0%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], crd=true] [21:15:17] : [Step 4/5] [2021-11-19 21:15:17,299][INFO ][exchange-worker-#26785%grid-1%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], crd=false] [21:15:17] : [Step 4/5] [2021-11-19 21:15:17,299][INFO ][sys-#26637%grid-0%][GridDhtPartitionsExchangeFuture] Coordinator received single message [ver=AffinityTopologyVersion [topVer=2, minorTopVer=2], node=1085686a-9887-4e3d-9d8b-a64775ae4001, allReceived=true] [21:15:17] : [Step 4/5] [2021-11-19 21:15:17,299][INFO ][sys-#26637%grid-0%][GridDhtPartitionsExchangeFuture] finishExchangeOnCoordinator [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2]] [21:15:17] : [Step 4/5] [2021-11-19 21:15:17,301][INFO ][sys-#26637%grid-0%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], err=null, rebalanced=true, wasRebalanced=true] [21:15:17] : [Step 4/5] [2021-11-19 21:15:17,302][INFO ][sys-#26753%grid-1%][GridDhtPartitionsExchangeFuture] Received full message, will finish exchange [node=008cb00a-6a9b-4c09-a154-85082cd15000, resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2]] [21:15:17] : [Step 4/5] [2021-11-19 21:15:17,302][INFO ][sys-#26637%grid-0%][GridCacheProcessor] Finish proxy initialization, cacheName=encrypted, localNodeId=008cb00a-6a9b-4c09-a154-85082cd15000 [21:15:17] : [Step 4/5] [2021-11-19 21:15:17,303][INFO ][sys-#26753%grid-1%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], err=null, rebalanced=true, wasRebalanced=true] [21:15:17] : [Step 4/5] [2021-11-19 21:15:17,304][INFO ][exchange-worker-#26662%grid-0%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=2, minorTopVer=2], force=false, evt=DISCOVERY_CUSTOM_EVT, node=008cb00a-6a9b-4c09-a154-85082cd15000] [21:15:17] : [Step 4/5] [2021-11-19 21:15:17,304][INFO ][sys-#26637%grid-0%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=008cb00a-6a9b-4c09-a154-85082cd15000, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=008cb00a-6a9b-4c09-a154-85082cd15000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345717183, loc=true, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2]] [21:15:17] : [Step 4/5] [2021-11-19 21:15:17,304][INFO ][sys-#26753%grid-1%][GridCacheProcessor] Finish proxy initialization, cacheName=encrypted, localNodeId=1085686a-9887-4e3d-9d8b-a64775ae4001 [21:15:17] : [Step 4/5] [2021-11-19 21:15:17,306][INFO ][sys-#26637%grid-0%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (1 ms), stage="Update caches registry" (0 ms), stage="Start caches" (6 ms), stage="Affinity initialization on cache group start" (0 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Wait partitions release latch [latch=exchange]" (7 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Restore partition states" (0 ms), stage="After states restored callback" (90 ms), stage="WAL history reservation" (0 ms), stage="Waiting for all single messages" (2 ms), stage="Affinity recalculation (crd)" (0 ms), stage="Collect update counters and create affinity messages" (0 ms), stage="Assign partitions states" (0 ms), stage="Validate partitions states" (0 ms), stage="Apply update counters" (0 ms), stage="Full message preparing" (0 ms), stage="Full message sending" (0 ms), stage="Exchange done" (4 ms), stage="Total time" (110 ms)] [21:15:17] : [Step 4/5] [2021-11-19 21:15:17,307][INFO ][exchange-worker-#26785%grid-1%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=2, minorTopVer=2], force=false, evt=DISCOVERY_CUSTOM_EVT, node=008cb00a-6a9b-4c09-a154-85082cd15000] [21:15:17] : [Step 4/5] [2021-11-19 21:15:17,306][INFO ][sys-#26753%grid-1%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=1085686a-9887-4e3d-9d8b-a64775ae4001, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=008cb00a-6a9b-4c09-a154-85082cd15000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345717070, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2]] [21:15:17] : [Step 4/5] [2021-11-19 21:15:17,308][INFO ][sys-#26637%grid-0%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], stage="Affinity initialization on cache group start [grp=encrypted]" (0 ms) (parent=Affinity initialization on cache group start), stage="Restore partition states [grp=ignite-sys-cache]" (0 ms) (parent=Restore partition states), stage="Restore partition states [grp=encrypted]" (0 ms) (parent=Restore partition states)] [21:15:17] : [Step 4/5] [2021-11-19 21:15:17,311][INFO ][sys-#26753%grid-1%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (4 ms), stage="Update caches registry" (0 ms), stage="Start caches" (9 ms), stage="Affinity initialization on cache group start" (0 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Wait partitions release latch [latch=exchange]" (3 ms), stage="Wait partitions release [latch=exchange]" (89 ms), stage="Restore partition states" (0 ms), stage="After states restored callback" (0 ms), stage="WAL history reservation" (0 ms), stage="Waiting for Full message" (3 ms), stage="Affinity recalculation" (0 ms), stage="Full map updating" (1 ms), stage="Exchange done" (7 ms), stage="Total time" (116 ms)] [21:15:17] : [Step 4/5] [2021-11-19 21:15:17,313][INFO ][sys-#26753%grid-1%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], stage="Affinity initialization on cache group start [grp=encrypted]" (0 ms) (parent=Affinity initialization on cache group start), stage="Restore partition states [grp=ignite-sys-cache]" (0 ms) (parent=Restore partition states), stage="Restore partition states [grp=encrypted]" (0 ms) (parent=Restore partition states)] [21:15:17] : [Step 4/5] [2021-11-19 21:15:17,480][INFO ][db-checkpoint-thread-#26801%grid-1%][Checkpointer] Checkpoint started [checkpointId=82c340ed-5dc1-4436-b1c8-22112e439cc5, startPtr=WALPointer [idx=0, fileOff=86657, len=1963], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=77ms, writeCheckpointEntryDuration=252ms, splitAndSortCpPagesDuration=0ms, pages=18, reason='node started'] [21:15:17] : [Step 4/5] [2021-11-19 21:15:17,480][INFO ][db-checkpoint-thread-#26796%grid-0%][Checkpointer] Checkpoint started [checkpointId=300856c1-7bb9-429b-a997-0243491ef6c7, startPtr=WALPointer [idx=0, fileOff=86657, len=1963], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=1ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=80ms, writeCheckpointEntryDuration=252ms, splitAndSortCpPagesDuration=0ms, pages=18, reason='node started'] [21:15:17] : [Step 4/5] [2021-11-19 21:15:17,653][INFO ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][root] Loading 500000 entries into encrypted [21:15:17] : [Step 4/5] [2021-11-19 21:15:17,729][INFO ][db-checkpoint-thread-#26796%grid-0%][Checkpointer] Checkpoint finished [cpId=300856c1-7bb9-429b-a997-0243491ef6c7, pages=18, markPos=WALPointer [idx=0, fileOff=86657, len=1963], walSegmentsCovered=[], markDuration=335ms, pagesWrite=1ms, fsync=245ms, total=581ms] [21:15:17] : [Step 4/5] [2021-11-19 21:15:17,736][INFO ][db-checkpoint-thread-#26801%grid-1%][Checkpointer] Checkpoint finished [cpId=82c340ed-5dc1-4436-b1c8-22112e439cc5, pages=18, markPos=WALPointer [idx=0, fileOff=86657, len=1963], walSegmentsCovered=[], markDuration=330ms, pagesWrite=1ms, fsync=254ms, total=586ms] [21:15:17] : [Step 4/5] [2021-11-19 21:15:17,788][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=0, segIdx=0, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000000.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000000.wal] [21:15:17] : [Step 4/5] [2021-11-19 21:15:17,797][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000000.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000000.wal] [21:15:17] : [Step 4/5] [2021-11-19 21:15:17,829][INFO ][wal-file-archiver%grid-0-#26788%grid-0%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=0, segIdx=0, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000000.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000000.wal] [21:15:17] : [Step 4/5] [2021-11-19 21:15:17,839][INFO ][wal-file-archiver%grid-0-#26788%grid-0%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000000.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000000.wal] [21:15:18] : [Step 4/5] [2021-11-19 21:15:18,148][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=1, segIdx=1, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000001.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000001.wal] [21:15:18] : [Step 4/5] [2021-11-19 21:15:18,148][INFO ][wal-file-archiver%grid-0-#26788%grid-0%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=1, segIdx=1, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000001.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000001.wal] [21:15:18] : [Step 4/5] [2021-11-19 21:15:18,172][INFO ][wal-file-archiver%grid-0-#26788%grid-0%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000001.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000001.wal] [21:15:18] : [Step 4/5] [2021-11-19 21:15:18,200][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000001.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000001.wal] [21:15:18] : [Step 4/5] [2021-11-19 21:15:18,304][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=2, segIdx=2, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000002.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000002.wal] [21:15:18] : [Step 4/5] [2021-11-19 21:15:18,312][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000002.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000002.wal] [21:15:18] : [Step 4/5] [2021-11-19 21:15:18,344][INFO ][wal-file-archiver%grid-0-#26788%grid-0%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=2, segIdx=2, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000002.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000002.wal] [21:15:18] : [Step 4/5] [2021-11-19 21:15:18,354][INFO ][wal-file-archiver%grid-0-#26788%grid-0%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000002.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000002.wal] [21:15:18] : [Step 4/5] [2021-11-19 21:15:18,610][INFO ][wal-file-archiver%grid-0-#26788%grid-0%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=3, segIdx=3, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000003.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000003.wal] [21:15:18] : [Step 4/5] [2021-11-19 21:15:18,623][INFO ][wal-file-archiver%grid-0-#26788%grid-0%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000003.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000003.wal] [21:15:18] : [Step 4/5] [2021-11-19 21:15:18,624][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=3, segIdx=3, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000003.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000003.wal] [21:15:18] : [Step 4/5] [2021-11-19 21:15:18,636][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000003.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000003.wal] [21:15:18] : [Step 4/5] [2021-11-19 21:15:18,680][INFO ][wal-file-archiver%grid-0-#26788%grid-0%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=4, segIdx=4, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000004.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000004.wal] [21:15:18] : [Step 4/5] [2021-11-19 21:15:18,689][INFO ][wal-file-archiver%grid-0-#26788%grid-0%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000004.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000004.wal] [21:15:18] : [Step 4/5] [2021-11-19 21:15:18,727][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=4, segIdx=4, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000004.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000004.wal] [21:15:18] : [Step 4/5] [2021-11-19 21:15:18,738][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000004.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000004.wal] [21:15:18] : [Step 4/5] [2021-11-19 21:15:18,749][INFO ][db-checkpoint-thread-#26796%grid-0%][Checkpointer] Checkpoint started [checkpointId=197a1dd1-9a06-4e6f-8b59-c8a04b23154f, startPtr=WALPointer [idx=5, fileOff=517058, len=2010], checkpointBeforeLockTime=51ms, checkpointLockWait=1ms, checkpointListenersExecuteTime=2ms, checkpointLockHoldTime=2ms, walCpRecordFsyncDuration=7ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=0ms, pages=428, reason='too big size of WAL without checkpoint'] [21:15:18]W: [org.apache.ignite:ignite-core] [2021-11-19 21:15:18,789][WARN ][checkpoint-runner-IO-#26813%grid-0%][CheckpointPagesWriterFactory] 1 checkpoint pages were not written yet due to unsuccessful page write lock acquisition and will be retried [21:15:18]W: [org.apache.ignite:ignite-core] [2021-11-19 21:15:18,789][WARN ][checkpoint-runner-IO-#26816%grid-0%][CheckpointPagesWriterFactory] 3 checkpoint pages were not written yet due to unsuccessful page write lock acquisition and will be retried [21:15:18]W: [org.apache.ignite:ignite-core] [2021-11-19 21:15:18,789][WARN ][checkpoint-runner-IO-#26815%grid-0%][CheckpointPagesWriterFactory] 4 checkpoint pages were not written yet due to unsuccessful page write lock acquisition and will be retried [21:15:18] : [Step 4/5] [2021-11-19 21:15:18,792][INFO ][wal-file-archiver%grid-0-#26788%grid-0%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=5, segIdx=5, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000005.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000005.wal] [21:15:18] : [Step 4/5] [2021-11-19 21:15:18,801][INFO ][db-checkpoint-thread-#26801%grid-1%][Checkpointer] Checkpoint started [checkpointId=ebcb6588-79d5-4a2f-b470-f319e3ee942a, startPtr=WALPointer [idx=5, fileOff=786476, len=2048], checkpointBeforeLockTime=63ms, checkpointLockWait=2ms, checkpointListenersExecuteTime=1ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=6ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=1ms, pages=568, reason='too big size of WAL without checkpoint'] [21:15:18] : [Step 4/5] [2021-11-19 21:15:18,816][INFO ][wal-file-archiver%grid-0-#26788%grid-0%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000005.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000005.wal] [21:15:18] : [Step 4/5] [2021-11-19 21:15:18,869][INFO ][wal-file-archiver%grid-0-#26788%grid-0%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=6, segIdx=6, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000006.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000006.wal] [21:15:18] : [Step 4/5] [2021-11-19 21:15:18,876][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=5, segIdx=5, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000005.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000005.wal] [21:15:18] : [Step 4/5] [2021-11-19 21:15:18,885][INFO ][wal-file-archiver%grid-0-#26788%grid-0%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000006.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000006.wal] [21:15:18] : [Step 4/5] [2021-11-19 21:15:18,894][INFO ][db-checkpoint-thread-#26796%grid-0%][Checkpointer] Checkpoint finished [cpId=197a1dd1-9a06-4e6f-8b59-c8a04b23154f, pages=428, markPos=WALPointer [idx=5, fileOff=517058, len=2010], walSegmentsCovered=[0 - 4], markDuration=11ms, pagesWrite=80ms, fsync=65ms, total=208ms] [21:15:18] : [Step 4/5] [2021-11-19 21:15:18,910][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000005.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000005.wal] [21:15:18] : [Step 4/5] [2021-11-19 21:15:18,922][INFO ][db-checkpoint-thread-#26796%grid-0%][Checkpointer] Checkpoint started [checkpointId=8c2d9e0c-1af3-402d-8227-884a13326d1d, startPtr=WALPointer [idx=7, fileOff=577839, len=2010], checkpointBeforeLockTime=4ms, checkpointLockWait=2ms, checkpointListenersExecuteTime=2ms, checkpointLockHoldTime=2ms, walCpRecordFsyncDuration=6ms, writeCheckpointEntryDuration=13ms, splitAndSortCpPagesDuration=0ms, pages=218, reason='too big size of WAL without checkpoint'] [21:15:18]W: [org.apache.ignite:ignite-core] [2021-11-19 21:15:18,945][WARN ][checkpoint-runner-IO-#26813%grid-0%][CheckpointPagesWriterFactory] 2 checkpoint pages were not written yet due to unsuccessful page write lock acquisition and will be retried [21:15:18] : [Step 4/5] [2021-11-19 21:15:18,949][INFO ][db-checkpoint-thread-#26801%grid-1%][Checkpointer] Checkpoint finished [cpId=ebcb6588-79d5-4a2f-b470-f319e3ee942a, pages=568, markPos=WALPointer [idx=5, fileOff=786476, len=2048], walSegmentsCovered=[0 - 4], markDuration=10ms, pagesWrite=54ms, fsync=93ms, total=222ms] [21:15:19] : [Step 4/5] [2021-11-19 21:15:19,057][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=6, segIdx=6, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000006.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000006.wal] [21:15:19] : [Step 4/5] [2021-11-19 21:15:19,057][INFO ][wal-file-archiver%grid-0-#26788%grid-0%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=7, segIdx=7, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000007.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000007.wal] [21:15:19] : [Step 4/5] [2021-11-19 21:15:19,284][INFO ][wal-file-archiver%grid-0-#26788%grid-0%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000007.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000007.wal] [21:15:19] : [Step 4/5] [2021-11-19 21:15:19,284][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000006.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000006.wal] [21:15:19] : [Step 4/5] [2021-11-19 21:15:19,286][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=7, segIdx=7, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000007.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000007.wal] [21:15:19] : [Step 4/5] [2021-11-19 21:15:19,287][INFO ][wal-file-archiver%grid-0-#26788%grid-0%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=8, segIdx=8, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000008.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000008.wal] [21:15:19] : [Step 4/5] [2021-11-19 21:15:19,306][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000007.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000007.wal] [21:15:19] : [Step 4/5] [2021-11-19 21:15:19,306][INFO ][db-checkpoint-thread-#26801%grid-1%][Checkpointer] Checkpoint started [checkpointId=e57c7a2a-b829-4a64-ae54-d070fde5fef7, startPtr=WALPointer [idx=7, fileOff=945941, len=2048], checkpointBeforeLockTime=191ms, checkpointLockWait=16ms, checkpointListenersExecuteTime=2ms, checkpointLockHoldTime=2ms, walCpRecordFsyncDuration=126ms, writeCheckpointEntryDuration=21ms, splitAndSortCpPagesDuration=1ms, pages=251, reason='too big size of WAL without checkpoint'] [21:15:19] : [Step 4/5] [2021-11-19 21:15:19,306][INFO ][wal-file-archiver%grid-0-#26788%grid-0%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000008.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000008.wal] [21:15:19] : [Step 4/5] [2021-11-19 21:15:19,317][INFO ][db-checkpoint-thread-#26796%grid-0%][Checkpointer] Checkpoint finished [cpId=8c2d9e0c-1af3-402d-8227-884a13326d1d, pages=218, markPos=WALPointer [idx=7, fileOff=577839, len=2010], walSegmentsCovered=[5 - 6], markDuration=22ms, pagesWrite=220ms, fsync=174ms, total=422ms] [21:15:19] : [Step 4/5] [2021-11-19 21:15:19,380][INFO ][wal-file-archiver%grid-0-#26788%grid-0%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=9, segIdx=9, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000009.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000009.wal] [21:15:19] : [Step 4/5] [2021-11-19 21:15:19,380][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=8, segIdx=8, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000008.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000008.wal] [21:15:19] : [Step 4/5] [2021-11-19 21:15:19,400][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000008.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000008.wal] [21:15:19] : [Step 4/5] [2021-11-19 21:15:19,401][INFO ][wal-file-archiver%grid-0-#26788%grid-0%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000009.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000009.wal] [21:15:19] : [Step 4/5] [2021-11-19 21:15:19,418][INFO ][db-checkpoint-thread-#26801%grid-1%][Checkpointer] Checkpoint finished [cpId=e57c7a2a-b829-4a64-ae54-d070fde5fef7, pages=251, markPos=WALPointer [idx=7, fileOff=945941, len=2048], walSegmentsCovered=[5 - 6], markDuration=152ms, pagesWrite=42ms, fsync=68ms, total=469ms] [21:15:19] : [Step 4/5] [2021-11-19 21:15:19,482][INFO ][wal-file-archiver%grid-0-#26788%grid-0%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=10, segIdx=0, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000000.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000010.wal] [21:15:19] : [Step 4/5] [2021-11-19 21:15:19,486][INFO ][wal-file-cleaner%grid-0-#26789%grid-0%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=1, currSize=10.0 MB, maxSize=20.0 MB] [21:15:19] : [Step 4/5] [2021-11-19 21:15:19,487][INFO ][wal-file-cleaner%grid-0-#26789%grid-0%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:15:19] : [Step 4/5] [2021-11-19 21:15:19,519][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=9, segIdx=9, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000009.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000009.wal] [21:15:19] : [Step 4/5] [2021-11-19 21:15:19,536][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000009.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000009.wal] [21:15:19] : [Step 4/5] [2021-11-19 21:15:19,537][INFO ][wal-file-archiver%grid-0-#26788%grid-0%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000000.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000010.wal] [21:15:19] : [Step 4/5] [2021-11-19 21:15:19,746][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=10, segIdx=0, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000000.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000010.wal] [21:15:19] : [Step 4/5] [2021-11-19 21:15:19,746][INFO ][wal-file-archiver%grid-0-#26788%grid-0%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=11, segIdx=1, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000001.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000011.wal] [21:15:19] : [Step 4/5] [2021-11-19 21:15:19,748][INFO ][wal-file-cleaner%grid-0-#26789%grid-0%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=2, currSize=10.0 MB, maxSize=20.0 MB] [21:15:19] : [Step 4/5] [2021-11-19 21:15:19,749][INFO ][wal-file-cleaner%grid-0-#26789%grid-0%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:15:19] : [Step 4/5] [2021-11-19 21:15:19,754][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=1, currSize=10.0 MB, maxSize=20.0 MB] [21:15:19] : [Step 4/5] [2021-11-19 21:15:19,755][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:15:19] : [Step 4/5] [2021-11-19 21:15:19,870][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000000.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000010.wal] [21:15:19] : [Step 4/5] [2021-11-19 21:15:19,870][INFO ][wal-file-archiver%grid-0-#26788%grid-0%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000001.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000011.wal] [21:15:19] : [Step 4/5] [2021-11-19 21:15:19,880][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=11, segIdx=1, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000001.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000011.wal] [21:15:19] : [Step 4/5] [2021-11-19 21:15:19,881][INFO ][wal-file-archiver%grid-0-#26788%grid-0%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=12, segIdx=2, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000002.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000012.wal] [21:15:19] : [Step 4/5] [2021-11-19 21:15:19,882][INFO ][db-checkpoint-thread-#26796%grid-0%][Checkpointer] Checkpoint started [checkpointId=d7fd3b90-ed95-4bc1-8cc4-6ff4a19a0b5c, startPtr=WALPointer [idx=12, fileOff=536389, len=2010], checkpointBeforeLockTime=27ms, checkpointLockWait=3ms, checkpointListenersExecuteTime=1ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=93ms, writeCheckpointEntryDuration=11ms, splitAndSortCpPagesDuration=1ms, pages=458, reason='too big size of WAL without checkpoint'] [21:15:19] : [Step 4/5] [2021-11-19 21:15:19,883][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=2, currSize=10.0 MB, maxSize=20.0 MB] [21:15:19] : [Step 4/5] [2021-11-19 21:15:19,885][INFO ][wal-file-cleaner%grid-0-#26789%grid-0%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=3, currSize=10.0 MB, maxSize=20.0 MB] [21:15:19] : [Step 4/5] [2021-11-19 21:15:19,886][INFO ][wal-file-cleaner%grid-0-#26789%grid-0%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:15:19] : [Step 4/5] [2021-11-19 21:15:19,885][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:15:19] : [Step 4/5] [2021-11-19 21:15:19,899][INFO ][wal-file-archiver%grid-0-#26788%grid-0%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000002.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000012.wal] [21:15:19] : [Step 4/5] [2021-11-19 21:15:19,899][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000001.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000011.wal] [21:15:19] : [Step 4/5] [2021-11-19 21:15:19,909][INFO ][db-checkpoint-thread-#26801%grid-1%][Checkpointer] Checkpoint started [checkpointId=4fbc9296-339f-48c3-ba9f-05dfa7d59242, startPtr=WALPointer [idx=12, fileOff=241287, len=2048], checkpointBeforeLockTime=4ms, checkpointLockWait=4ms, checkpointListenersExecuteTime=2ms, checkpointLockHoldTime=9ms, walCpRecordFsyncDuration=9ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=1ms, pages=316, reason='too big size of WAL without checkpoint'] [21:15:19] : [Step 4/5] [2021-11-19 21:15:19,985][INFO ][db-checkpoint-thread-#26796%grid-0%][Checkpointer] Checkpoint finished [cpId=d7fd3b90-ed95-4bc1-8cc4-6ff4a19a0b5c, pages=458, markPos=WALPointer [idx=12, fileOff=536389, len=2010], walSegmentsCovered=[7 - 11], markDuration=107ms, pagesWrite=63ms, fsync=39ms, total=239ms] [21:15:20] : [Step 4/5] [2021-11-19 21:15:20,009][INFO ][wal-file-archiver%grid-0-#26788%grid-0%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=13, segIdx=3, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000003.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000013.wal] [21:15:20] : [Step 4/5] [2021-11-19 21:15:20,010][INFO ][db-checkpoint-thread-#26801%grid-1%][Checkpointer] Checkpoint finished [cpId=4fbc9296-339f-48c3-ba9f-05dfa7d59242, pages=316, markPos=WALPointer [idx=12, fileOff=241287, len=2048], walSegmentsCovered=[7 - 11], markDuration=21ms, pagesWrite=34ms, fsync=66ms, total=129ms] [21:15:20] : [Step 4/5] [2021-11-19 21:15:20,009][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=12, segIdx=2, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000002.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000012.wal] [21:15:20] : [Step 4/5] [2021-11-19 21:15:20,011][INFO ][wal-file-cleaner%grid-0-#26789%grid-0%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=4, currSize=10.0 MB, maxSize=20.0 MB] [21:15:20] : [Step 4/5] [2021-11-19 21:15:20,012][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=3, currSize=10.0 MB, maxSize=20.0 MB] [21:15:20] : [Step 4/5] [2021-11-19 21:15:20,014][INFO ][wal-file-cleaner%grid-0-#26789%grid-0%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:15:20] : [Step 4/5] [2021-11-19 21:15:20,014][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:15:20] : [Step 4/5] [2021-11-19 21:15:20,027][INFO ][wal-file-archiver%grid-0-#26788%grid-0%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000003.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000013.wal] [21:15:20] : [Step 4/5] [2021-11-19 21:15:20,032][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000002.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000012.wal] [21:15:20] : [Step 4/5] [2021-11-19 21:15:20,049][INFO ][db-checkpoint-thread-#26796%grid-0%][Checkpointer] Checkpoint started [checkpointId=aa766dc2-3bb6-486c-8d17-bfee83688671, startPtr=WALPointer [idx=14, fileOff=819883, len=2010], checkpointBeforeLockTime=47ms, checkpointLockWait=3ms, checkpointListenersExecuteTime=4ms, checkpointLockHoldTime=6ms, walCpRecordFsyncDuration=5ms, writeCheckpointEntryDuration=2ms, splitAndSortCpPagesDuration=0ms, pages=331, reason='too big size of WAL without checkpoint'] [21:15:20] : [Step 4/5] [2021-11-19 21:15:20,090][INFO ][wal-file-archiver%grid-0-#26788%grid-0%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=14, segIdx=4, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000004.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000014.wal] [21:15:20] : [Step 4/5] [2021-11-19 21:15:20,091][INFO ][wal-file-cleaner%grid-0-#26789%grid-0%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=5, currSize=10.0 MB, maxSize=20.0 MB] [21:15:20] : [Step 4/5] [2021-11-19 21:15:20,093][INFO ][wal-file-cleaner%grid-0-#26789%grid-0%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:15:20] : [Step 4/5] [2021-11-19 21:15:20,105][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=13, segIdx=3, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000003.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000013.wal] [21:15:20] : [Step 4/5] [2021-11-19 21:15:20,106][INFO ][wal-file-archiver%grid-0-#26788%grid-0%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000004.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000014.wal] [21:15:20] : [Step 4/5] [2021-11-19 21:15:20,107][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=4, currSize=10.0 MB, maxSize=20.0 MB] [21:15:20] : [Step 4/5] [2021-11-19 21:15:20,109][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:15:20] : [Step 4/5] [2021-11-19 21:15:20,124][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000003.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000013.wal] [21:15:20] : [Step 4/5] [2021-11-19 21:15:20,150][INFO ][db-checkpoint-thread-#26796%grid-0%][Checkpointer] Checkpoint finished [cpId=aa766dc2-3bb6-486c-8d17-bfee83688671, pages=331, markPos=WALPointer [idx=14, fileOff=819883, len=2010], walSegmentsCovered=[12 - 13], markDuration=14ms, pagesWrite=57ms, fsync=43ms, total=164ms] [21:15:20] : [Step 4/5] [2021-11-19 21:15:20,263][INFO ][wal-file-archiver%grid-0-#26788%grid-0%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=15, segIdx=5, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000005.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000015.wal] [21:15:20] : [Step 4/5] [2021-11-19 21:15:20,265][INFO ][wal-file-cleaner%grid-0-#26789%grid-0%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=6, currSize=10.0 MB, maxSize=20.0 MB] [21:15:20] : [Step 4/5] [2021-11-19 21:15:20,267][INFO ][wal-file-cleaner%grid-0-#26789%grid-0%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:15:20] : [Step 4/5] [2021-11-19 21:15:20,267][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=14, segIdx=4, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000004.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000014.wal] [21:15:20] : [Step 4/5] [2021-11-19 21:15:20,269][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=5, currSize=10.0 MB, maxSize=20.0 MB] [21:15:20] : [Step 4/5] [2021-11-19 21:15:20,271][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:15:20] : [Step 4/5] [2021-11-19 21:15:20,281][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000004.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000014.wal] [21:15:20] : [Step 4/5] [2021-11-19 21:15:20,281][INFO ][wal-file-archiver%grid-0-#26788%grid-0%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000005.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000015.wal] [21:15:20] : [Step 4/5] [2021-11-19 21:15:20,328][INFO ][wal-file-archiver%grid-0-#26788%grid-0%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=16, segIdx=6, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000006.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000016.wal] [21:15:20] : [Step 4/5] [2021-11-19 21:15:20,328][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=15, segIdx=5, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000005.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000015.wal] [21:15:20] : [Step 4/5] [2021-11-19 21:15:20,329][INFO ][wal-file-cleaner%grid-0-#26789%grid-0%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=7, currSize=10.0 MB, maxSize=20.0 MB] [21:15:20] : [Step 4/5] [2021-11-19 21:15:20,331][INFO ][wal-file-cleaner%grid-0-#26789%grid-0%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:15:20] : [Step 4/5] [2021-11-19 21:15:20,332][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=6, currSize=10.0 MB, maxSize=20.0 MB] [21:15:20] : [Step 4/5] [2021-11-19 21:15:20,334][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:15:20] : [Step 4/5] [2021-11-19 21:15:20,574][INFO ][wal-file-archiver%grid-0-#26788%grid-0%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000006.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000016.wal] [21:15:20] : [Step 4/5] [2021-11-19 21:15:20,574][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000005.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000015.wal] [21:15:20] : [Step 4/5] [2021-11-19 21:15:20,653][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=16, segIdx=6, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000006.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000016.wal] [21:15:20] : [Step 4/5] [2021-11-19 21:15:20,653][INFO ][wal-file-archiver%grid-0-#26788%grid-0%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=17, segIdx=7, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000007.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000017.wal] [21:15:20] : [Step 4/5] [2021-11-19 21:15:20,655][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=7, currSize=10.0 MB, maxSize=20.0 MB] [21:15:20] : [Step 4/5] [2021-11-19 21:15:20,655][INFO ][wal-file-cleaner%grid-0-#26789%grid-0%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=8, currSize=10.0 MB, maxSize=20.0 MB] [21:15:20] : [Step 4/5] [2021-11-19 21:15:20,657][INFO ][wal-file-cleaner%grid-0-#26789%grid-0%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:15:20] : [Step 4/5] [2021-11-19 21:15:20,657][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:15:20] : [Step 4/5] [2021-11-19 21:15:20,671][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000006.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000016.wal] [21:15:20] : [Step 4/5] [2021-11-19 21:15:20,672][INFO ][wal-file-archiver%grid-0-#26788%grid-0%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000007.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000017.wal] [21:15:20] : [Step 4/5] [2021-11-19 21:15:20,681][INFO ][db-checkpoint-thread-#26801%grid-1%][Checkpointer] Checkpoint started [checkpointId=9229e39e-d916-48fa-a919-c34df15841df, startPtr=WALPointer [idx=17, fileOff=189505, len=2048], checkpointBeforeLockTime=6ms, checkpointLockWait=5ms, checkpointListenersExecuteTime=6ms, checkpointLockHoldTime=6ms, walCpRecordFsyncDuration=8ms, writeCheckpointEntryDuration=2ms, splitAndSortCpPagesDuration=0ms, pages=345, reason='too big size of WAL without checkpoint'] [21:15:20] : [Step 4/5] [2021-11-19 21:15:20,716][INFO ][wal-file-archiver%grid-0-#26788%grid-0%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=18, segIdx=8, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000008.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000018.wal] [21:15:20] : [Step 4/5] [2021-11-19 21:15:20,717][INFO ][wal-file-cleaner%grid-0-#26789%grid-0%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=9, currSize=10.0 MB, maxSize=20.0 MB] [21:15:20] : [Step 4/5] [2021-11-19 21:15:20,718][INFO ][wal-file-cleaner%grid-0-#26789%grid-0%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:15:20] : [Step 4/5] [2021-11-19 21:15:20,725][INFO ][wal-file-archiver%grid-0-#26788%grid-0%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000008.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000018.wal] [21:15:20] : [Step 4/5] [2021-11-19 21:15:20,745][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=17, segIdx=7, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000007.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000017.wal] [21:15:20] : [Step 4/5] [2021-11-19 21:15:20,745][INFO ][db-checkpoint-thread-#26796%grid-0%][Checkpointer] Checkpoint started [checkpointId=1812010a-1fe1-4a7e-a8f9-ebfe434ea9a3, startPtr=WALPointer [idx=19, fileOff=159691, len=2010], checkpointBeforeLockTime=3ms, checkpointLockWait=4ms, checkpointListenersExecuteTime=2ms, checkpointLockHoldTime=2ms, walCpRecordFsyncDuration=8ms, writeCheckpointEntryDuration=8ms, splitAndSortCpPagesDuration=0ms, pages=321, reason='too big size of WAL without checkpoint'] [21:15:20] : [Step 4/5] [2021-11-19 21:15:20,746][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=8, currSize=10.0 MB, maxSize=20.0 MB] [21:15:20] : [Step 4/5] [2021-11-19 21:15:20,749][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:15:20] : [Step 4/5] [2021-11-19 21:15:20,762][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000007.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000017.wal] [21:15:20] : [Step 4/5] [2021-11-19 21:15:20,837][INFO ][wal-file-archiver%grid-0-#26788%grid-0%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=19, segIdx=9, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000009.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000019.wal] [21:15:20] : [Step 4/5] [2021-11-19 21:15:20,838][INFO ][wal-file-cleaner%grid-0-#26789%grid-0%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=10, currSize=10.0 MB, maxSize=20.0 MB] [21:15:20] : [Step 4/5] [2021-11-19 21:15:20,839][INFO ][wal-file-cleaner%grid-0-#26789%grid-0%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:15:20] : [Step 4/5] [2021-11-19 21:15:20,925][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=18, segIdx=8, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000008.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000018.wal] [21:15:20] : [Step 4/5] [2021-11-19 21:15:20,929][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=9, currSize=10.0 MB, maxSize=20.0 MB] [21:15:20] : [Step 4/5] [2021-11-19 21:15:20,930][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:15:21] : [Step 4/5] [2021-11-19 21:15:21,100][INFO ][wal-file-archiver%grid-0-#26788%grid-0%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000009.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000019.wal] [21:15:21] : [Step 4/5] [2021-11-19 21:15:21,101][INFO ][wal-file-archiver%grid-0-#26788%grid-0%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=20, segIdx=0, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000000.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000020.wal] [21:15:21] : [Step 4/5] [2021-11-19 21:15:21,127][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000008.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000018.wal] [21:15:21] : [Step 4/5] [2021-11-19 21:15:21,127][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=19, segIdx=9, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000009.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000019.wal] [21:15:21] : [Step 4/5] [2021-11-19 21:15:21,127][INFO ][wal-file-cleaner%grid-0-#26789%grid-0%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=11, currSize=10.0 MB, maxSize=20.0 MB] [21:15:21] : [Step 4/5] [2021-11-19 21:15:21,128][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=10, currSize=10.0 MB, maxSize=20.0 MB] [21:15:21] : [Step 4/5] [2021-11-19 21:15:21,129][INFO ][wal-file-cleaner%grid-0-#26789%grid-0%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:15:21] : [Step 4/5] [2021-11-19 21:15:21,130][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:15:21] : [Step 4/5] [2021-11-19 21:15:21,157][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000009.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000019.wal] [21:15:21] : [Step 4/5] [2021-11-19 21:15:21,160][INFO ][wal-file-archiver%grid-0-#26788%grid-0%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000000.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000020.wal] [21:15:21] : [Step 4/5] [2021-11-19 21:15:21,166][INFO ][db-checkpoint-thread-#26796%grid-0%][Checkpointer] Checkpoint finished [cpId=1812010a-1fe1-4a7e-a8f9-ebfe434ea9a3, pages=321, markPos=WALPointer [idx=19, fileOff=159691, len=2010], walSegmentsCovered=[14 - 18], markDuration=20ms, pagesWrite=59ms, fsync=360ms, total=446ms] [21:15:21] : [Step 4/5] [2021-11-19 21:15:21,183][INFO ][db-checkpoint-thread-#26801%grid-1%][Checkpointer] Checkpoint finished [cpId=9229e39e-d916-48fa-a919-c34df15841df, pages=345, markPos=WALPointer [idx=17, fileOff=189505, len=2048], walSegmentsCovered=[12 - 16], markDuration=17ms, pagesWrite=99ms, fsync=402ms, total=529ms] [21:15:21] : [Step 4/5] [2021-11-19 21:15:21,195][INFO ][wal-file-archiver%grid-0-#26788%grid-0%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=21, segIdx=1, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000001.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000021.wal] [21:15:21] : [Step 4/5] [2021-11-19 21:15:21,199][INFO ][wal-file-cleaner%grid-0-#26789%grid-0%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=12, currSize=10.0 MB, maxSize=20.0 MB] [21:15:21] : [Step 4/5] [2021-11-19 21:15:21,200][INFO ][wal-file-cleaner%grid-0-#26789%grid-0%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:15:21] : [Step 4/5] [2021-11-19 21:15:21,203][INFO ][wal-file-archiver%grid-0-#26788%grid-0%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000001.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000021.wal] [21:15:21] : [Step 4/5] [2021-11-19 21:15:21,219][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=20, segIdx=0, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000000.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000020.wal] [21:15:21] : [Step 4/5] [2021-11-19 21:15:21,221][INFO ][db-checkpoint-thread-#26796%grid-0%][Checkpointer] Checkpoint started [checkpointId=012237a5-dc11-4196-84d8-f13c4062e091, startPtr=WALPointer [idx=22, fileOff=466508, len=2010], checkpointBeforeLockTime=43ms, checkpointLockWait=1ms, checkpointListenersExecuteTime=1ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=8ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=0ms, pages=354, reason='too big size of WAL without checkpoint'] [21:15:21] : [Step 4/5] [2021-11-19 21:15:21,221][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=11, currSize=10.0 MB, maxSize=20.0 MB] [21:15:21] : [Step 4/5] [2021-11-19 21:15:21,223][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:15:21] : [Step 4/5] [2021-11-19 21:15:21,233][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000000.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000020.wal] [21:15:21]W: [org.apache.ignite:ignite-core] [2021-11-19 21:15:21,337][WARN ][checkpoint-runner-IO-#26813%grid-0%][CheckpointPagesWriterFactory] 5 checkpoint pages were not written yet due to unsuccessful page write lock acquisition and will be retried [21:15:21] : [Step 4/5] [2021-11-19 21:15:21,380][INFO ][wal-file-archiver%grid-0-#26788%grid-0%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=22, segIdx=2, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000002.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000022.wal] [21:15:21] : [Step 4/5] [2021-11-19 21:15:21,381][INFO ][wal-file-cleaner%grid-0-#26789%grid-0%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=13, currSize=10.0 MB, maxSize=20.0 MB] [21:15:21] : [Step 4/5] [2021-11-19 21:15:21,382][INFO ][wal-file-cleaner%grid-0-#26789%grid-0%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:15:21] : [Step 4/5] [2021-11-19 21:15:21,543][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=21, segIdx=1, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000001.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000021.wal] [21:15:21] : [Step 4/5] [2021-11-19 21:15:21,544][INFO ][wal-file-archiver%grid-0-#26788%grid-0%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000002.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000022.wal] [21:15:21] : [Step 4/5] [2021-11-19 21:15:21,549][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=12, currSize=10.0 MB, maxSize=20.0 MB] [21:15:21] : [Step 4/5] [2021-11-19 21:15:21,550][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:15:21] : [Step 4/5] [2021-11-19 21:15:21,598][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000001.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000021.wal] [21:15:21] : [Step 4/5] [2021-11-19 21:15:21,621][INFO ][wal-file-archiver%grid-0-#26788%grid-0%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=23, segIdx=3, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000003.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000023.wal] [21:15:21] : [Step 4/5] [2021-11-19 21:15:21,647][INFO ][db-checkpoint-thread-#26796%grid-0%][Checkpointer] Checkpoint finished [cpId=012237a5-dc11-4196-84d8-f13c4062e091, pages=354, markPos=WALPointer [idx=22, fileOff=466508, len=2010], walSegmentsCovered=[19 - 21], markDuration=11ms, pagesWrite=164ms, fsync=262ms, total=481ms] [21:15:21] : [Step 4/5] [2021-11-19 21:15:21,648][INFO ][db-checkpoint-thread-#26801%grid-1%][Checkpointer] Checkpoint started [checkpointId=f4943406-1c0e-4c98-a05b-b73efecd913f, startPtr=WALPointer [idx=22, fileOff=326792, len=2048], checkpointBeforeLockTime=368ms, checkpointLockWait=1ms, checkpointListenersExecuteTime=1ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=44ms, writeCheckpointEntryDuration=49ms, splitAndSortCpPagesDuration=1ms, pages=692, reason='too big size of WAL without checkpoint'] [21:15:21] : [Step 4/5] [2021-11-19 21:15:21,651][INFO ][wal-file-cleaner%grid-0-#26789%grid-0%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=14, currSize=10.0 MB, maxSize=20.0 MB] [21:15:21] : [Step 4/5] [2021-11-19 21:15:21,653][INFO ][wal-file-cleaner%grid-0-#26789%grid-0%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:15:21] : [Step 4/5] [2021-11-19 21:15:21,621][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=22, segIdx=2, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000002.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000022.wal] [21:15:21] : [Step 4/5] [2021-11-19 21:15:21,654][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=13, currSize=10.0 MB, maxSize=20.0 MB] [21:15:21] : [Step 4/5] [2021-11-19 21:15:21,657][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:15:21] : [Step 4/5] [2021-11-19 21:15:21,739][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000002.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000022.wal] [21:15:21] : [Step 4/5] [2021-11-19 21:15:21,739][INFO ][wal-file-archiver%grid-0-#26788%grid-0%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000003.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000023.wal] [21:15:21] : [Step 4/5] [2021-11-19 21:15:21,740][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=23, segIdx=3, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000003.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000023.wal] [21:15:21] : [Step 4/5] [2021-11-19 21:15:21,741][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=14, currSize=10.0 MB, maxSize=20.0 MB] [21:15:21] : [Step 4/5] [2021-11-19 21:15:21,743][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:15:21] : [Step 4/5] [2021-11-19 21:15:21,754][INFO ][wal-file-archiver%grid-0-#26788%grid-0%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=24, segIdx=4, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000004.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000024.wal] [21:15:21] : [Step 4/5] [2021-11-19 21:15:21,755][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000003.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000023.wal] [21:15:21] : [Step 4/5] [2021-11-19 21:15:21,759][INFO ][db-checkpoint-thread-#26796%grid-0%][Checkpointer] Checkpoint started [checkpointId=eeede3c3-3ff2-48cf-ab51-febdcca50da8, startPtr=WALPointer [idx=24, fileOff=389341, len=2010], checkpointBeforeLockTime=4ms, checkpointLockWait=3ms, checkpointListenersExecuteTime=3ms, checkpointLockHoldTime=3ms, walCpRecordFsyncDuration=80ms, writeCheckpointEntryDuration=20ms, splitAndSortCpPagesDuration=1ms, pages=212, reason='too big size of WAL without checkpoint'] [21:15:21] : [Step 4/5] [2021-11-19 21:15:21,759][INFO ][wal-file-cleaner%grid-0-#26789%grid-0%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=15, currSize=10.0 MB, maxSize=20.0 MB] [21:15:21] : [Step 4/5] [2021-11-19 21:15:21,761][INFO ][wal-file-cleaner%grid-0-#26789%grid-0%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:15:21] : [Step 4/5] [2021-11-19 21:15:21,780][INFO ][wal-file-archiver%grid-0-#26788%grid-0%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000004.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000024.wal] [21:15:21] : [Step 4/5] [2021-11-19 21:15:21,808][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=24, segIdx=4, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000004.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000024.wal] [21:15:21] : [Step 4/5] [2021-11-19 21:15:21,810][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=15, currSize=10.0 MB, maxSize=20.0 MB] [21:15:21] : [Step 4/5] [2021-11-19 21:15:21,811][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:15:21] : [Step 4/5] [2021-11-19 21:15:21,822][INFO ][wal-file-archiver%grid-0-#26788%grid-0%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=25, segIdx=5, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000005.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000025.wal] [21:15:21] : [Step 4/5] [2021-11-19 21:15:21,824][INFO ][wal-file-cleaner%grid-0-#26789%grid-0%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=16, currSize=10.0 MB, maxSize=20.0 MB] [21:15:21] : [Step 4/5] [2021-11-19 21:15:21,825][INFO ][wal-file-cleaner%grid-0-#26789%grid-0%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:15:21] : [Step 4/5] [2021-11-19 21:15:21,823][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000004.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000024.wal] [21:15:21] : [Step 4/5] [2021-11-19 21:15:21,844][INFO ][wal-file-archiver%grid-0-#26788%grid-0%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000005.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000025.wal] [21:15:21] : [Step 4/5] [2021-11-19 21:15:21,848][INFO ][db-checkpoint-thread-#26801%grid-1%][Checkpointer] Checkpoint finished [cpId=f4943406-1c0e-4c98-a05b-b73efecd913f, pages=692, markPos=WALPointer [idx=22, fileOff=326792, len=2048], walSegmentsCovered=[17 - 21], markDuration=96ms, pagesWrite=102ms, fsync=97ms, total=664ms] [21:15:21] : [Step 4/5] [2021-11-19 21:15:21,865][INFO ][db-checkpoint-thread-#26796%grid-0%][Checkpointer] Checkpoint finished [cpId=eeede3c3-3ff2-48cf-ab51-febdcca50da8, pages=212, markPos=WALPointer [idx=24, fileOff=389341, len=2010], walSegmentsCovered=[22 - 23], markDuration=105ms, pagesWrite=73ms, fsync=32ms, total=217ms] [21:15:21] : [Step 4/5] [2021-11-19 21:15:21,878][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=25, segIdx=5, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000005.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000025.wal] [21:15:21] : [Step 4/5] [2021-11-19 21:15:21,879][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=16, currSize=10.0 MB, maxSize=20.0 MB] [21:15:21] : [Step 4/5] [2021-11-19 21:15:21,880][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:15:21] : [Step 4/5] [2021-11-19 21:15:21,888][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000005.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000025.wal] [21:15:21] : [Step 4/5] [2021-11-19 21:15:21,927][INFO ][wal-file-archiver%grid-0-#26788%grid-0%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=26, segIdx=6, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000006.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000026.wal] [21:15:21] : [Step 4/5] [2021-11-19 21:15:21,932][INFO ][wal-file-cleaner%grid-0-#26789%grid-0%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=17, currSize=10.0 MB, maxSize=20.0 MB] [21:15:21] : [Step 4/5] [2021-11-19 21:15:21,936][INFO ][wal-file-cleaner%grid-0-#26789%grid-0%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:15:21] : [Step 4/5] [2021-11-19 21:15:21,941][INFO ][wal-file-archiver%grid-0-#26788%grid-0%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000006.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000026.wal] [21:15:21] : [Step 4/5] [2021-11-19 21:15:21,943][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=26, segIdx=6, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000006.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000026.wal] [21:15:21] : [Step 4/5] [2021-11-19 21:15:21,948][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=17, currSize=10.0 MB, maxSize=20.0 MB] [21:15:21] : [Step 4/5] [2021-11-19 21:15:21,950][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:15:21] : [Step 4/5] [2021-11-19 21:15:21,956][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000006.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000026.wal] [21:15:22] : [Step 4/5] [2021-11-19 21:15:21,999][INFO ][wal-file-archiver%grid-0-#26788%grid-0%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=27, segIdx=7, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000007.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000027.wal] [21:15:22] : [Step 4/5] [2021-11-19 21:15:22,000][INFO ][wal-file-cleaner%grid-0-#26789%grid-0%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=18, currSize=10.0 MB, maxSize=20.0 MB] [21:15:22] : [Step 4/5] [2021-11-19 21:15:22,001][INFO ][wal-file-cleaner%grid-0-#26789%grid-0%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:15:22] : [Step 4/5] [2021-11-19 21:15:22,003][INFO ][db-checkpoint-thread-#26801%grid-1%][Checkpointer] Checkpoint started [checkpointId=737b9673-c76d-41fd-8104-13954f3dce9d, startPtr=WALPointer [idx=27, fileOff=432360, len=2048], checkpointBeforeLockTime=132ms, checkpointLockWait=2ms, checkpointListenersExecuteTime=2ms, checkpointLockHoldTime=3ms, walCpRecordFsyncDuration=13ms, writeCheckpointEntryDuration=4ms, splitAndSortCpPagesDuration=1ms, pages=641, reason='too big size of WAL without checkpoint'] [21:15:22] : [Step 4/5] [2021-11-19 21:15:22,004][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=27, segIdx=7, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000007.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000027.wal] [21:15:22] : [Step 4/5] [2021-11-19 21:15:22,006][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=18, currSize=10.0 MB, maxSize=20.0 MB] [21:15:22] : [Step 4/5] [2021-11-19 21:15:22,007][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:15:22] : [Step 4/5] [2021-11-19 21:15:22,268][INFO ][wal-file-archiver%grid-0-#26788%grid-0%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000007.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000027.wal] [21:15:22] : [Step 4/5] [2021-11-19 21:15:22,268][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000007.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000027.wal] [21:15:22] : [Step 4/5] [2021-11-19 21:15:22,269][INFO ][wal-file-archiver%grid-0-#26788%grid-0%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=28, segIdx=8, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000008.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000028.wal] [21:15:22] : [Step 4/5] [2021-11-19 21:15:22,270][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=28, segIdx=8, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000008.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000028.wal] [21:15:22] : [Step 4/5] [2021-11-19 21:15:22,271][INFO ][wal-file-cleaner%grid-0-#26789%grid-0%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=19, currSize=10.0 MB, maxSize=20.0 MB] [21:15:22] : [Step 4/5] [2021-11-19 21:15:22,271][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=19, currSize=10.0 MB, maxSize=20.0 MB] [21:15:22] : [Step 4/5] [2021-11-19 21:15:22,272][INFO ][wal-file-cleaner%grid-0-#26789%grid-0%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:15:22] : [Step 4/5] [2021-11-19 21:15:22,273][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:15:22] : [Step 4/5] [2021-11-19 21:15:22,337][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000008.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000028.wal] [21:15:22] : [Step 4/5] [2021-11-19 21:15:22,338][INFO ][wal-file-archiver%grid-0-#26788%grid-0%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000008.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000028.wal] [21:15:22] : [Step 4/5] [2021-11-19 21:15:22,339][INFO ][wal-file-archiver%grid-0-#26788%grid-0%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=29, segIdx=9, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000009.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000029.wal] [21:15:22] : [Step 4/5] [2021-11-19 21:15:22,337][INFO ][db-checkpoint-thread-#26796%grid-0%][Checkpointer] Checkpoint started [checkpointId=023d171a-e7a9-4b8d-b275-a19595f1b24d, startPtr=WALPointer [idx=29, fileOff=499273, len=2010], checkpointBeforeLockTime=27ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=4ms, checkpointLockHoldTime=4ms, walCpRecordFsyncDuration=53ms, writeCheckpointEntryDuration=102ms, splitAndSortCpPagesDuration=0ms, pages=356, reason='too big size of WAL without checkpoint'] [21:15:22] : [Step 4/5] [2021-11-19 21:15:22,340][INFO ][wal-file-cleaner%grid-0-#26789%grid-0%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=20, currSize=10.0 MB, maxSize=20.0 MB] [21:15:22] : [Step 4/5] [2021-11-19 21:15:22,338][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=29, segIdx=9, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000009.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000029.wal] [21:15:22] : [Step 4/5] [2021-11-19 21:15:22,342][INFO ][wal-file-cleaner%grid-0-#26789%grid-0%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:15:22] : [Step 4/5] [2021-11-19 21:15:22,342][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=20, currSize=10.0 MB, maxSize=20.0 MB] [21:15:22] : [Step 4/5] [2021-11-19 21:15:22,344][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:15:22] : [Step 4/5] [2021-11-19 21:15:22,362][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000009.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000029.wal] [21:15:22] : [Step 4/5] [2021-11-19 21:15:22,363][INFO ][wal-file-archiver%grid-0-#26788%grid-0%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000009.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000029.wal] [21:15:22] : [Step 4/5] [2021-11-19 21:15:22,390][INFO ][db-checkpoint-thread-#26801%grid-1%][Checkpointer] Checkpoint finished [cpId=737b9673-c76d-41fd-8104-13954f3dce9d, pages=641, markPos=WALPointer [idx=27, fileOff=432360, len=2048], walSegmentsCovered=[22 - 26], markDuration=22ms, pagesWrite=233ms, fsync=153ms, total=542ms] [21:15:22] : [Step 4/5] [2021-11-19 21:15:22,406][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=30, segIdx=0, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000000.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000030.wal] [21:15:22] : [Step 4/5] [2021-11-19 21:15:22,406][INFO ][wal-file-archiver%grid-0-#26788%grid-0%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=30, segIdx=0, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000000.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000030.wal] [21:15:22] : [Step 4/5] [2021-11-19 21:15:22,407][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=21, currSize=10.0 MB, maxSize=20.0 MB] [21:15:22] : [Step 4/5] [2021-11-19 21:15:22,407][INFO ][wal-file-cleaner%grid-0-#26789%grid-0%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=21, currSize=10.0 MB, maxSize=20.0 MB] [21:15:22] : [Step 4/5] [2021-11-19 21:15:22,408][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:15:22] : [Step 4/5] [2021-11-19 21:15:22,409][INFO ][wal-file-cleaner%grid-0-#26789%grid-0%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:15:22] : [Step 4/5] [2021-11-19 21:15:22,420][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000000.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000030.wal] [21:15:22] : [Step 4/5] [2021-11-19 21:15:22,424][INFO ][wal-file-archiver%grid-0-#26788%grid-0%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000000.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000030.wal] [21:15:22] : [Step 4/5] [2021-11-19 21:15:22,452][INFO ][db-checkpoint-thread-#26801%grid-1%][Checkpointer] Checkpoint started [checkpointId=c6d6f3d6-ee0b-4279-8c8c-52f543fab8e0, startPtr=WALPointer [idx=31, fileOff=740826, len=2048], checkpointBeforeLockTime=27ms, checkpointLockWait=3ms, checkpointListenersExecuteTime=2ms, checkpointLockHoldTime=2ms, walCpRecordFsyncDuration=17ms, writeCheckpointEntryDuration=12ms, splitAndSortCpPagesDuration=0ms, pages=420, reason='too big size of WAL without checkpoint'] [21:15:22] : [Step 4/5] [2021-11-19 21:15:22,471][INFO ][db-checkpoint-thread-#26796%grid-0%][Checkpointer] Checkpoint finished [cpId=023d171a-e7a9-4b8d-b275-a19595f1b24d, pages=356, markPos=WALPointer [idx=29, fileOff=499273, len=2010], walSegmentsCovered=[24 - 28], markDuration=162ms, pagesWrite=96ms, fsync=35ms, total=320ms] [21:15:22] : [Step 4/5] [2021-11-19 21:15:22,483][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=31, segIdx=1, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000001.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000031.wal] [21:15:22] : [Step 4/5] [2021-11-19 21:15:22,487][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=22, currSize=10.0 MB, maxSize=20.0 MB] [21:15:22] : [Step 4/5] [2021-11-19 21:15:22,484][INFO ][wal-file-archiver%grid-0-#26788%grid-0%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=31, segIdx=1, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000001.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000031.wal] [21:15:22] : [Step 4/5] [2021-11-19 21:15:22,488][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:15:22] : [Step 4/5] [2021-11-19 21:15:22,488][INFO ][wal-file-cleaner%grid-0-#26789%grid-0%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=22, currSize=10.0 MB, maxSize=20.0 MB] [21:15:22] : [Step 4/5] [2021-11-19 21:15:22,489][INFO ][wal-file-cleaner%grid-0-#26789%grid-0%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:15:22] : [Step 4/5] [2021-11-19 21:15:22,498][INFO ][wal-file-archiver%grid-0-#26788%grid-0%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000001.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000031.wal] [21:15:22] : [Step 4/5] [2021-11-19 21:15:22,498][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000001.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000031.wal] [21:15:22] : [Step 4/5] [2021-11-19 21:15:22,541][INFO ][db-checkpoint-thread-#26796%grid-0%][Checkpointer] Checkpoint started [checkpointId=c959b0f5-2179-4099-9c99-0f7812a1f4bc, startPtr=WALPointer [idx=32, fileOff=653962, len=2010], checkpointBeforeLockTime=31ms, checkpointLockWait=2ms, checkpointListenersExecuteTime=1ms, checkpointLockHoldTime=2ms, walCpRecordFsyncDuration=24ms, writeCheckpointEntryDuration=10ms, splitAndSortCpPagesDuration=1ms, pages=382, reason='too big size of WAL without checkpoint'] [21:15:22] : [Step 4/5] [2021-11-19 21:15:22,554][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=32, segIdx=2, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000002.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000032.wal] [21:15:22] : [Step 4/5] [2021-11-19 21:15:22,555][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=23, currSize=10.0 MB, maxSize=20.0 MB] [21:15:22] : [Step 4/5] [2021-11-19 21:15:22,557][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:15:22] : [Step 4/5] [2021-11-19 21:15:22,569][INFO ][wal-file-archiver%grid-0-#26788%grid-0%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=32, segIdx=2, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000002.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000032.wal] [21:15:22] : [Step 4/5] [2021-11-19 21:15:22,569][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000002.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000032.wal] [21:15:22] : [Step 4/5] [2021-11-19 21:15:22,570][INFO ][wal-file-cleaner%grid-0-#26789%grid-0%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=23, currSize=10.0 MB, maxSize=20.0 MB] [21:15:22] : [Step 4/5] [2021-11-19 21:15:22,572][INFO ][wal-file-cleaner%grid-0-#26789%grid-0%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:15:22] : [Step 4/5] [2021-11-19 21:15:22,581][INFO ][db-checkpoint-thread-#26801%grid-1%][Checkpointer] Checkpoint finished [cpId=c6d6f3d6-ee0b-4279-8c8c-52f543fab8e0, pages=420, markPos=WALPointer [idx=31, fileOff=740826, len=2048], walSegmentsCovered=[27 - 30], markDuration=32ms, pagesWrite=59ms, fsync=69ms, total=190ms] [21:15:22] : [Step 4/5] [2021-11-19 21:15:22,583][INFO ][wal-file-archiver%grid-0-#26788%grid-0%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000002.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000032.wal] [21:15:22] : [Step 4/5] [2021-11-19 21:15:22,600][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=33, segIdx=3, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000003.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000033.wal] [21:15:22] : [Step 4/5] [2021-11-19 21:15:22,601][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=24, currSize=10.0 MB, maxSize=20.0 MB] [21:15:22] : [Step 4/5] [2021-11-19 21:15:22,604][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:15:22] : [Step 4/5] [2021-11-19 21:15:22,621][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000003.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000033.wal] [21:15:22] : [Step 4/5] [2021-11-19 21:15:22,628][INFO ][db-checkpoint-thread-#26801%grid-1%][Checkpointer] Checkpoint started [checkpointId=fa6caecd-e93a-453a-a881-f8fe5c10376e, startPtr=WALPointer [idx=34, fileOff=523927, len=2048], checkpointBeforeLockTime=29ms, checkpointLockWait=1ms, checkpointListenersExecuteTime=1ms, checkpointLockHoldTime=2ms, walCpRecordFsyncDuration=6ms, writeCheckpointEntryDuration=8ms, splitAndSortCpPagesDuration=0ms, pages=335, reason='too big size of WAL without checkpoint'] [21:15:22] : [Step 4/5] [2021-11-19 21:15:22,636][INFO ][wal-file-archiver%grid-0-#26788%grid-0%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=33, segIdx=3, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000003.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000033.wal] [21:15:22] : [Step 4/5] [2021-11-19 21:15:22,637][INFO ][db-checkpoint-thread-#26796%grid-0%][Checkpointer] Checkpoint finished [cpId=c959b0f5-2179-4099-9c99-0f7812a1f4bc, pages=382, markPos=WALPointer [idx=32, fileOff=653962, len=2010], walSegmentsCovered=[29 - 31], markDuration=38ms, pagesWrite=54ms, fsync=41ms, total=166ms] [21:15:22] : [Step 4/5] [2021-11-19 21:15:22,638][INFO ][wal-file-cleaner%grid-0-#26789%grid-0%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=24, currSize=10.0 MB, maxSize=20.0 MB] [21:15:22] : [Step 4/5] [2021-11-19 21:15:22,639][INFO ][wal-file-cleaner%grid-0-#26789%grid-0%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:15:22] : [Step 4/5] [2021-11-19 21:15:22,651][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=34, segIdx=4, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000004.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000034.wal] [21:15:22] : [Step 4/5] [2021-11-19 21:15:22,655][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=25, currSize=10.0 MB, maxSize=20.0 MB] [21:15:22] : [Step 4/5] [2021-11-19 21:15:22,656][INFO ][wal-file-archiver%grid-0-#26788%grid-0%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000003.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000033.wal] [21:15:22] : [Step 4/5] [2021-11-19 21:15:22,657][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:15:22] : [Step 4/5] [2021-11-19 21:15:22,663][INFO ][db-checkpoint-thread-#26796%grid-0%][Checkpointer] Checkpoint started [checkpointId=b92d3947-e900-481f-b15d-468c427a6ae7, startPtr=WALPointer [idx=34, fileOff=203742, len=2010], checkpointBeforeLockTime=3ms, checkpointLockWait=4ms, checkpointListenersExecuteTime=3ms, checkpointLockHoldTime=3ms, walCpRecordFsyncDuration=13ms, writeCheckpointEntryDuration=3ms, splitAndSortCpPagesDuration=0ms, pages=155, reason='too big size of WAL without checkpoint'] [21:15:22]W: [org.apache.ignite:ignite-core] [2021-11-19 21:15:22,669][WARN ][checkpoint-runner-IO-#26810%grid-1%][CheckpointPagesWriterFactory] 8 checkpoint pages were not written yet due to unsuccessful page write lock acquisition and will be retried [21:15:22] : [Step 4/5] [2021-11-19 21:15:22,676][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000004.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000034.wal] [21:15:22] : [Step 4/5] [2021-11-19 21:15:22,712][INFO ][wal-file-archiver%grid-0-#26788%grid-0%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=34, segIdx=4, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000004.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000034.wal] [21:15:22] : [Step 4/5] [2021-11-19 21:15:22,714][INFO ][wal-file-cleaner%grid-0-#26789%grid-0%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=25, currSize=10.0 MB, maxSize=20.0 MB] [21:15:22] : [Step 4/5] [2021-11-19 21:15:22,715][INFO ][wal-file-cleaner%grid-0-#26789%grid-0%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:15:22] : [Step 4/5] [2021-11-19 21:15:22,725][INFO ][wal-file-archiver%grid-0-#26788%grid-0%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000004.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000034.wal] [21:15:22] : [Step 4/5] [2021-11-19 21:15:22,732][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=35, segIdx=5, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000005.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000035.wal] [21:15:22] : [Step 4/5] [2021-11-19 21:15:22,734][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=26, currSize=10.0 MB, maxSize=20.0 MB] [21:15:22] : [Step 4/5] [2021-11-19 21:15:22,744][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:15:22] : [Step 4/5] [2021-11-19 21:15:22,764][INFO ][db-checkpoint-thread-#26801%grid-1%][Checkpointer] Checkpoint finished [cpId=fa6caecd-e93a-453a-a881-f8fe5c10376e, pages=335, markPos=WALPointer [idx=34, fileOff=523927, len=2048], walSegmentsCovered=[31 - 33], markDuration=17ms, pagesWrite=62ms, fsync=73ms, total=182ms] [21:15:22] : [Step 4/5] [2021-11-19 21:15:22,765][INFO ][wal-file-archiver%grid-0-#26788%grid-0%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=35, segIdx=5, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000005.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000035.wal] [21:15:22] : [Step 4/5] [2021-11-19 21:15:22,768][INFO ][wal-file-cleaner%grid-0-#26789%grid-0%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=26, currSize=10.0 MB, maxSize=20.0 MB] [21:15:22] : [Step 4/5] [2021-11-19 21:15:22,769][INFO ][wal-file-cleaner%grid-0-#26789%grid-0%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:15:22] : [Step 4/5] [2021-11-19 21:15:22,772][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000005.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000035.wal] [21:15:22] : [Step 4/5] [2021-11-19 21:15:22,819][INFO ][db-checkpoint-thread-#26796%grid-0%][Checkpointer] Checkpoint finished [cpId=b92d3947-e900-481f-b15d-468c427a6ae7, pages=155, markPos=WALPointer [idx=34, fileOff=203742, len=2010], walSegmentsCovered=[32 - 33], markDuration=20ms, pagesWrite=60ms, fsync=95ms, total=182ms] [21:15:22] : [Step 4/5] [2021-11-19 21:15:22,819][INFO ][wal-file-archiver%grid-0-#26788%grid-0%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000005.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000035.wal] [21:15:22] : [Step 4/5] [2021-11-19 21:15:22,828][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=36, segIdx=6, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000006.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000036.wal] [21:15:22] : [Step 4/5] [2021-11-19 21:15:22,831][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=27, currSize=10.0 MB, maxSize=20.0 MB] [21:15:22] : [Step 4/5] [2021-11-19 21:15:22,832][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:15:22] : [Step 4/5] [2021-11-19 21:15:22,975][INFO ][wal-file-archiver%grid-0-#26788%grid-0%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=36, segIdx=6, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000006.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000036.wal] [21:15:22] : [Step 4/5] [2021-11-19 21:15:22,976][INFO ][wal-file-cleaner%grid-0-#26789%grid-0%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=27, currSize=10.0 MB, maxSize=20.0 MB] [21:15:22] : [Step 4/5] [2021-11-19 21:15:22,977][INFO ][wal-file-cleaner%grid-0-#26789%grid-0%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:15:23] : [Step 4/5] [2021-11-19 21:15:23,106][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000006.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000036.wal] [21:15:23] : [Step 4/5] [2021-11-19 21:15:23,107][INFO ][db-checkpoint-thread-#26801%grid-1%][Checkpointer] Checkpoint started [checkpointId=52ac476a-ef7e-4cc7-bacf-12cec6151a5a, startPtr=WALPointer [idx=37, fileOff=477424, len=2048], checkpointBeforeLockTime=68ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=1ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=140ms, writeCheckpointEntryDuration=133ms, splitAndSortCpPagesDuration=0ms, pages=330, reason='too big size of WAL without checkpoint'] [21:15:23] : [Step 4/5] [2021-11-19 21:15:23,107][INFO ][wal-file-archiver%grid-0-#26788%grid-0%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000006.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000036.wal] [21:15:23] : [Step 4/5] [2021-11-19 21:15:23,109][INFO ][wal-file-archiver%grid-0-#26788%grid-0%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=37, segIdx=7, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000007.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000037.wal] [21:15:23] : [Step 4/5] [2021-11-19 21:15:23,111][INFO ][wal-file-cleaner%grid-0-#26789%grid-0%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=28, currSize=10.0 MB, maxSize=20.0 MB] [21:15:23] : [Step 4/5] [2021-11-19 21:15:23,113][INFO ][wal-file-cleaner%grid-0-#26789%grid-0%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:15:23] : [Step 4/5] [2021-11-19 21:15:23,107][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=37, segIdx=7, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000007.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000037.wal] [21:15:23] : [Step 4/5] [2021-11-19 21:15:23,116][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=28, currSize=10.0 MB, maxSize=20.0 MB] [21:15:23] : [Step 4/5] [2021-11-19 21:15:23,117][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:15:23] : [Step 4/5] [2021-11-19 21:15:23,133][INFO ][wal-file-archiver%grid-0-#26788%grid-0%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000007.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000037.wal] [21:15:23] : [Step 4/5] [2021-11-19 21:15:23,134][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000007.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000037.wal] [21:15:23] : [Step 4/5] [2021-11-19 21:15:23,177][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=38, segIdx=8, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000008.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000038.wal] [21:15:23] : [Step 4/5] [2021-11-19 21:15:23,184][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=29, currSize=10.0 MB, maxSize=20.0 MB] [21:15:23] : [Step 4/5] [2021-11-19 21:15:23,185][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:15:23] : [Step 4/5] [2021-11-19 21:15:23,201][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000008.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000038.wal] [21:15:23] : [Step 4/5] [2021-11-19 21:15:23,209][INFO ][db-checkpoint-thread-#26801%grid-1%][Checkpointer] Checkpoint finished [cpId=52ac476a-ef7e-4cc7-bacf-12cec6151a5a, pages=330, markPos=WALPointer [idx=37, fileOff=477424, len=2048], walSegmentsCovered=[34 - 36], markDuration=275ms, pagesWrite=41ms, fsync=60ms, total=444ms] [21:15:23] : [Step 4/5] [2021-11-19 21:15:23,232][INFO ][wal-file-archiver%grid-0-#26788%grid-0%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=38, segIdx=8, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000008.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000038.wal] [21:15:23] : [Step 4/5] [2021-11-19 21:15:23,233][INFO ][wal-file-cleaner%grid-0-#26789%grid-0%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=29, currSize=10.0 MB, maxSize=20.0 MB] [21:15:23] : [Step 4/5] [2021-11-19 21:15:23,235][INFO ][wal-file-cleaner%grid-0-#26789%grid-0%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:15:23] : [Step 4/5] [2021-11-19 21:15:23,245][INFO ][wal-file-archiver%grid-0-#26788%grid-0%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000008.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000038.wal] [21:15:23] : [Step 4/5] [2021-11-19 21:15:23,248][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=39, segIdx=9, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000009.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000039.wal] [21:15:23] : [Step 4/5] [2021-11-19 21:15:23,261][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=30, currSize=10.0 MB, maxSize=20.0 MB] [21:15:23] : [Step 4/5] [2021-11-19 21:15:23,263][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:15:23] : [Step 4/5] [2021-11-19 21:15:23,265][INFO ][db-checkpoint-thread-#26796%grid-0%][Checkpointer] Checkpoint started [checkpointId=6873206a-3183-44c9-91ac-397ae7d9379b, startPtr=WALPointer [idx=39, fileOff=346595, len=2010], checkpointBeforeLockTime=4ms, checkpointLockWait=2ms, checkpointListenersExecuteTime=5ms, checkpointLockHoldTime=6ms, walCpRecordFsyncDuration=6ms, writeCheckpointEntryDuration=20ms, splitAndSortCpPagesDuration=0ms, pages=407, reason='too big size of WAL without checkpoint'] [21:15:23] : [Step 4/5] [2021-11-19 21:15:23,274][INFO ][wal-file-archiver%grid-0-#26788%grid-0%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=39, segIdx=9, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000009.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000039.wal] [21:15:23] : [Step 4/5] [2021-11-19 21:15:23,275][INFO ][wal-file-cleaner%grid-0-#26789%grid-0%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=30, currSize=10.0 MB, maxSize=20.0 MB] [21:15:23] : [Step 4/5] [2021-11-19 21:15:23,277][INFO ][wal-file-cleaner%grid-0-#26789%grid-0%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:15:23] : [Step 4/5] [2021-11-19 21:15:23,282][INFO ][db-checkpoint-thread-#26801%grid-1%][Checkpointer] Checkpoint started [checkpointId=bccc8ab1-b407-4e68-8051-4203269b310d, startPtr=WALPointer [idx=40, fileOff=625327, len=2048], checkpointBeforeLockTime=50ms, checkpointLockWait=3ms, checkpointListenersExecuteTime=1ms, checkpointLockHoldTime=2ms, walCpRecordFsyncDuration=9ms, writeCheckpointEntryDuration=7ms, splitAndSortCpPagesDuration=1ms, pages=398, reason='too big size of WAL without checkpoint'] [21:15:23] : [Step 4/5] [2021-11-19 21:15:23,293][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000009.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000039.wal] [21:15:23] : [Step 4/5] [2021-11-19 21:15:23,294][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=40, segIdx=0, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000000.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000040.wal] [21:15:23] : [Step 4/5] [2021-11-19 21:15:23,297][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=31, currSize=10.0 MB, maxSize=20.0 MB] [21:15:23] : [Step 4/5] [2021-11-19 21:15:23,298][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:15:23] : [Step 4/5] [2021-11-19 21:15:23,314][INFO ][wal-file-archiver%grid-0-#26788%grid-0%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000009.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000039.wal] [21:15:23] : [Step 4/5] [2021-11-19 21:15:23,324][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000000.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000040.wal] [21:15:23] : [Step 4/5] [2021-11-19 21:15:23,628][INFO ][wal-file-archiver%grid-0-#26788%grid-0%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=40, segIdx=0, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000000.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000040.wal] [21:15:23] : [Step 4/5] [2021-11-19 21:15:23,628][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=41, segIdx=1, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000001.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000041.wal] [21:15:23] : [Step 4/5] [2021-11-19 21:15:23,630][INFO ][wal-file-cleaner%grid-0-#26789%grid-0%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=31, currSize=10.0 MB, maxSize=20.0 MB] [21:15:23] : [Step 4/5] [2021-11-19 21:15:23,631][INFO ][wal-file-cleaner%grid-0-#26789%grid-0%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:15:23] : [Step 4/5] [2021-11-19 21:15:23,632][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=32, currSize=10.0 MB, maxSize=20.0 MB] [21:15:23] : [Step 4/5] [2021-11-19 21:15:23,633][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:15:23] : [Step 4/5] [2021-11-19 21:15:23,651][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000001.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000041.wal] [21:15:23] : [Step 4/5] [2021-11-19 21:15:23,651][INFO ][wal-file-archiver%grid-0-#26788%grid-0%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000000.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000040.wal] [21:15:23] : [Step 4/5] [2021-11-19 21:15:23,679][INFO ][wal-file-archiver%grid-0-#26788%grid-0%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=41, segIdx=1, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000001.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000041.wal] [21:15:23] : [Step 4/5] [2021-11-19 21:15:23,679][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=42, segIdx=2, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000002.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000042.wal] [21:15:23] : [Step 4/5] [2021-11-19 21:15:23,680][INFO ][wal-file-cleaner%grid-0-#26789%grid-0%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=32, currSize=10.0 MB, maxSize=20.0 MB] [21:15:23] : [Step 4/5] [2021-11-19 21:15:23,680][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=33, currSize=10.0 MB, maxSize=20.0 MB] [21:15:23] : [Step 4/5] [2021-11-19 21:15:23,682][INFO ][wal-file-cleaner%grid-0-#26789%grid-0%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:15:23] : [Step 4/5] [2021-11-19 21:15:23,682][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:15:23] : [Step 4/5] [2021-11-19 21:15:23,682][INFO ][db-checkpoint-thread-#26796%grid-0%][Checkpointer] Checkpoint finished [cpId=6873206a-3183-44c9-91ac-397ae7d9379b, pages=407, markPos=WALPointer [idx=39, fileOff=346595, len=2010], walSegmentsCovered=[34 - 38], markDuration=34ms, pagesWrite=67ms, fsync=349ms, total=456ms] [21:15:23] : [Step 4/5] [2021-11-19 21:15:23,701][INFO ][wal-file-archiver%grid-0-#26788%grid-0%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000001.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000041.wal] [21:15:23] : [Step 4/5] [2021-11-19 21:15:23,702][INFO ][db-checkpoint-thread-#26796%grid-0%][Checkpointer] Checkpoint started [checkpointId=646084dd-716a-43b4-8777-f0e38405859d, startPtr=WALPointer [idx=42, fileOff=368296, len=2010], checkpointBeforeLockTime=3ms, checkpointLockWait=1ms, checkpointListenersExecuteTime=1ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=12ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=1ms, pages=248, reason='too big size of WAL without checkpoint'] [21:15:23] : [Step 4/5] [2021-11-19 21:15:23,702][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000002.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000042.wal] [21:15:23] : [Step 4/5] [2021-11-19 21:15:23,710][INFO ][db-checkpoint-thread-#26801%grid-1%][Checkpointer] Checkpoint finished [cpId=bccc8ab1-b407-4e68-8051-4203269b310d, pages=398, markPos=WALPointer [idx=40, fileOff=625327, len=2048], walSegmentsCovered=[37 - 39], markDuration=20ms, pagesWrite=354ms, fsync=73ms, total=500ms] [21:15:23] : [Step 4/5] [2021-11-19 21:15:23,756][INFO ][wal-file-archiver%grid-0-#26788%grid-0%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=42, segIdx=2, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000002.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000042.wal] [21:15:23] : [Step 4/5] [2021-11-19 21:15:23,758][INFO ][wal-file-cleaner%grid-0-#26789%grid-0%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=33, currSize=10.0 MB, maxSize=20.0 MB] [21:15:23] : [Step 4/5] [2021-11-19 21:15:23,759][INFO ][wal-file-cleaner%grid-0-#26789%grid-0%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:15:23] : [Step 4/5] [2021-11-19 21:15:23,767][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=43, segIdx=3, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000003.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000043.wal] [21:15:23] : [Step 4/5] [2021-11-19 21:15:23,768][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=34, currSize=10.0 MB, maxSize=20.0 MB] [21:15:23] : [Step 4/5] [2021-11-19 21:15:23,768][INFO ][wal-file-archiver%grid-0-#26788%grid-0%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000002.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000042.wal] [21:15:23] : [Step 4/5] [2021-11-19 21:15:23,769][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:15:23] : [Step 4/5] [2021-11-19 21:15:23,782][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000003.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000043.wal] [21:15:23] : [Step 4/5] [2021-11-19 21:15:23,809][INFO ][db-checkpoint-thread-#26796%grid-0%][Checkpointer] Checkpoint finished [cpId=646084dd-716a-43b4-8777-f0e38405859d, pages=248, markPos=WALPointer [idx=42, fileOff=368296, len=2010], walSegmentsCovered=[39 - 41], markDuration=16ms, pagesWrite=69ms, fsync=36ms, total=125ms] [21:15:23] : [Step 4/5] [2021-11-19 21:15:23,825][INFO ][wal-file-archiver%grid-0-#26788%grid-0%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=43, segIdx=3, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000003.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000043.wal] [21:15:23] : [Step 4/5] [2021-11-19 21:15:23,826][INFO ][wal-file-cleaner%grid-0-#26789%grid-0%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=34, currSize=10.0 MB, maxSize=20.0 MB] [21:15:23] : [Step 4/5] [2021-11-19 21:15:23,828][INFO ][wal-file-cleaner%grid-0-#26789%grid-0%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:15:23] : [Step 4/5] [2021-11-19 21:15:23,842][INFO ][wal-file-archiver%grid-0-#26788%grid-0%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000003.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000043.wal] [21:15:23] : [Step 4/5] [2021-11-19 21:15:23,842][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=44, segIdx=4, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000004.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000044.wal] [21:15:23] : [Step 4/5] [2021-11-19 21:15:23,846][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=35, currSize=10.0 MB, maxSize=20.0 MB] [21:15:23] : [Step 4/5] [2021-11-19 21:15:23,848][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:15:23] : [Step 4/5] [2021-11-19 21:15:23,865][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000004.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000044.wal] [21:15:23] : [Step 4/5] [2021-11-19 21:15:23,872][INFO ][db-checkpoint-thread-#26801%grid-1%][Checkpointer] Checkpoint started [checkpointId=6436206f-b485-4f54-b153-ef24075cdd19, startPtr=WALPointer [idx=45, fileOff=219423, len=2048], checkpointBeforeLockTime=141ms, checkpointLockWait=2ms, checkpointListenersExecuteTime=3ms, checkpointLockHoldTime=4ms, walCpRecordFsyncDuration=5ms, writeCheckpointEntryDuration=9ms, splitAndSortCpPagesDuration=0ms, pages=478, reason='too big size of WAL without checkpoint'] [21:15:24] : [Step 4/5] [2021-11-19 21:15:24,042][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=45, segIdx=5, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000005.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000045.wal] [21:15:24] : [Step 4/5] [2021-11-19 21:15:24,043][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=36, currSize=10.0 MB, maxSize=20.0 MB] [21:15:24] : [Step 4/5] [2021-11-19 21:15:24,044][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:15:24] : [Step 4/5] [2021-11-19 21:15:24,044][INFO ][wal-file-archiver%grid-0-#26788%grid-0%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=44, segIdx=4, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000004.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000044.wal] [21:15:24] : [Step 4/5] [2021-11-19 21:15:24,045][INFO ][wal-file-cleaner%grid-0-#26789%grid-0%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=35, currSize=10.0 MB, maxSize=20.0 MB] [21:15:24] : [Step 4/5] [2021-11-19 21:15:24,047][INFO ][wal-file-cleaner%grid-0-#26789%grid-0%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:15:24] : [Step 4/5] [2021-11-19 21:15:24,240][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000005.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000045.wal] [21:15:24] : [Step 4/5] [2021-11-19 21:15:24,240][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=46, segIdx=6, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000006.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000046.wal] [21:15:24] : [Step 4/5] [2021-11-19 21:15:24,241][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=37, currSize=10.0 MB, maxSize=20.0 MB] [21:15:24] : [Step 4/5] [2021-11-19 21:15:24,243][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:15:24] : [Step 4/5] [2021-11-19 21:15:24,240][INFO ][wal-file-archiver%grid-0-#26788%grid-0%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000004.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000044.wal] [21:15:24] : [Step 4/5] [2021-11-19 21:15:24,244][INFO ][wal-file-archiver%grid-0-#26788%grid-0%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=45, segIdx=5, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000005.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000045.wal] [21:15:24] : [Step 4/5] [2021-11-19 21:15:24,248][INFO ][wal-file-cleaner%grid-0-#26789%grid-0%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=36, currSize=10.0 MB, maxSize=20.0 MB] [21:15:24] : [Step 4/5] [2021-11-19 21:15:24,249][INFO ][wal-file-cleaner%grid-0-#26789%grid-0%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:15:24] : [Step 4/5] [2021-11-19 21:15:24,517][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000006.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000046.wal] [21:15:24] : [Step 4/5] [2021-11-19 21:15:24,517][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=47, segIdx=7, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000007.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000047.wal] [21:15:24] : [Step 4/5] [2021-11-19 21:15:24,518][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=38, currSize=10.0 MB, maxSize=20.0 MB] [21:15:24] : [Step 4/5] [2021-11-19 21:15:24,520][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:15:24] : [Step 4/5] [2021-11-19 21:15:24,596][INFO ][wal-file-archiver%grid-0-#26788%grid-0%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000005.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000045.wal] [21:15:24] : [Step 4/5] [2021-11-19 21:15:24,598][INFO ][wal-file-archiver%grid-0-#26788%grid-0%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=46, segIdx=6, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000006.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000046.wal] [21:15:24] : [Step 4/5] [2021-11-19 21:15:24,599][INFO ][wal-file-cleaner%grid-0-#26789%grid-0%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=37, currSize=10.0 MB, maxSize=20.0 MB] [21:15:24] : [Step 4/5] [2021-11-19 21:15:24,600][INFO ][wal-file-cleaner%grid-0-#26789%grid-0%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:15:24] : [Step 4/5] [2021-11-19 21:15:24,606][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000007.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000047.wal] [21:15:24] : [Step 4/5] [2021-11-19 21:15:24,618][INFO ][wal-file-archiver%grid-0-#26788%grid-0%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000006.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000046.wal] [21:15:24] : [Step 4/5] [2021-11-19 21:15:24,628][INFO ][db-checkpoint-thread-#26801%grid-1%][Checkpointer] Checkpoint finished [cpId=6436206f-b485-4f54-b153-ef24075cdd19, pages=478, markPos=WALPointer [idx=45, fileOff=219423, len=2048], walSegmentsCovered=[40 - 44], markDuration=19ms, pagesWrite=212ms, fsync=543ms, total=917ms] [21:15:24] : [Step 4/5] [2021-11-19 21:15:24,716][INFO ][db-checkpoint-thread-#26796%grid-0%][Checkpointer] Checkpoint started [checkpointId=33591154-2ab5-4ade-86fd-8ac7ef1a8b74, startPtr=WALPointer [idx=47, fileOff=262573, len=2010], checkpointBeforeLockTime=9ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=1ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=6ms, writeCheckpointEntryDuration=89ms, splitAndSortCpPagesDuration=0ms, pages=336, reason='too big size of WAL without checkpoint'] [21:15:24] : [Step 4/5] [2021-11-19 21:15:24,724][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=48, segIdx=8, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000008.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000048.wal] [21:15:24] : [Step 4/5] [2021-11-19 21:15:24,725][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=39, currSize=10.0 MB, maxSize=20.0 MB] [21:15:24] : [Step 4/5] [2021-11-19 21:15:24,726][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:15:24] : [Step 4/5] [2021-11-19 21:15:24,724][INFO ][wal-file-archiver%grid-0-#26788%grid-0%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=47, segIdx=7, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000007.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000047.wal] [21:15:24] : [Step 4/5] [2021-11-19 21:15:24,728][INFO ][wal-file-cleaner%grid-0-#26789%grid-0%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=38, currSize=10.0 MB, maxSize=20.0 MB] [21:15:24] : [Step 4/5] [2021-11-19 21:15:24,729][INFO ][wal-file-cleaner%grid-0-#26789%grid-0%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:15:24] : [Step 4/5] [2021-11-19 21:15:24,866][INFO ][wal-file-archiver%grid-0-#26788%grid-0%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000007.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000047.wal] [21:15:24] : [Step 4/5] [2021-11-19 21:15:24,866][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000008.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000048.wal] [21:15:24] : [Step 4/5] [2021-11-19 21:15:24,966][INFO ][wal-file-archiver%grid-0-#26788%grid-0%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=48, segIdx=8, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000008.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000048.wal] [21:15:24] : [Step 4/5] [2021-11-19 21:15:24,968][INFO ][wal-file-cleaner%grid-0-#26789%grid-0%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=39, currSize=10.0 MB, maxSize=20.0 MB] [21:15:24] : [Step 4/5] [2021-11-19 21:15:24,969][INFO ][wal-file-cleaner%grid-0-#26789%grid-0%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:15:24] : [Step 4/5] [2021-11-19 21:15:24,966][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=49, segIdx=9, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000009.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000049.wal] [21:15:24] : [Step 4/5] [2021-11-19 21:15:24,971][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=40, currSize=10.0 MB, maxSize=20.0 MB] [21:15:24] : [Step 4/5] [2021-11-19 21:15:24,972][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:15:25] : [Step 4/5] [2021-11-19 21:15:25,206][INFO ][wal-file-archiver%grid-0-#26788%grid-0%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000008.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000048.wal] [21:15:25] : [Step 4/5] [2021-11-19 21:15:25,206][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000009.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000049.wal] [21:15:25] : [Step 4/5] [2021-11-19 21:15:25,207][INFO ][wal-file-archiver%grid-0-#26788%grid-0%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=49, segIdx=9, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000009.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000049.wal] [21:15:25] : [Step 4/5] [2021-11-19 21:15:25,207][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=50, segIdx=0, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000000.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000050.wal] [21:15:25] : [Step 4/5] [2021-11-19 21:15:25,268][INFO ][wal-file-cleaner%grid-0-#26789%grid-0%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=40, currSize=10.0 MB, maxSize=20.0 MB] [21:15:25] : [Step 4/5] [2021-11-19 21:15:25,269][INFO ][wal-file-cleaner%grid-0-#26789%grid-0%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:15:25] : [Step 4/5] [2021-11-19 21:15:25,268][INFO ][db-checkpoint-thread-#26801%grid-1%][Checkpointer] Checkpoint started [checkpointId=4975962a-9cfb-441c-b427-9ac65fa7be2a, startPtr=WALPointer [idx=50, fileOff=126107, len=2048], checkpointBeforeLockTime=338ms, checkpointLockWait=10ms, checkpointListenersExecuteTime=3ms, checkpointLockHoldTime=3ms, walCpRecordFsyncDuration=24ms, writeCheckpointEntryDuration=263ms, splitAndSortCpPagesDuration=1ms, pages=555, reason='too big size of WAL without checkpoint'] [21:15:25] : [Step 4/5] [2021-11-19 21:15:25,271][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=41, currSize=10.0 MB, maxSize=20.0 MB] [21:15:25] : [Step 4/5] [2021-11-19 21:15:25,273][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:15:25] : [Step 4/5] [2021-11-19 21:15:25,318][INFO ][wal-file-archiver%grid-0-#26788%grid-0%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000009.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000049.wal] [21:15:25] : [Step 4/5] [2021-11-19 21:15:25,318][INFO ][db-checkpoint-thread-#26796%grid-0%][Checkpointer] Checkpoint finished [cpId=33591154-2ab5-4ade-86fd-8ac7ef1a8b74, pages=336, markPos=WALPointer [idx=47, fileOff=262573, len=2010], walSegmentsCovered=[42 - 46], markDuration=97ms, pagesWrite=94ms, fsync=507ms, total=707ms] [21:15:25] : [Step 4/5] [2021-11-19 21:15:25,318][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000000.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000050.wal] [21:15:25] : [Step 4/5] [2021-11-19 21:15:25,319][INFO ][wal-file-archiver%grid-0-#26788%grid-0%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=50, segIdx=0, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000000.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000050.wal] [21:15:25] : [Step 4/5] [2021-11-19 21:15:25,325][INFO ][wal-file-cleaner%grid-0-#26789%grid-0%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=41, currSize=10.0 MB, maxSize=20.0 MB] [21:15:25] : [Step 4/5] [2021-11-19 21:15:25,327][INFO ][wal-file-cleaner%grid-0-#26789%grid-0%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:15:25] : [Step 4/5] [2021-11-19 21:15:25,320][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=51, segIdx=1, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000001.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000051.wal] [21:15:25] : [Step 4/5] [2021-11-19 21:15:25,329][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=42, currSize=10.0 MB, maxSize=20.0 MB] [21:15:25] : [Step 4/5] [2021-11-19 21:15:25,330][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:15:25] : [Step 4/5] [2021-11-19 21:15:25,338][INFO ][wal-file-archiver%grid-0-#26788%grid-0%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000000.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000050.wal] [21:15:25] : [Step 4/5] [2021-11-19 21:15:25,340][INFO ][wal-file-archiver%grid-0-#26788%grid-0%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=51, segIdx=1, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000001.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000051.wal] [21:15:25] : [Step 4/5] [2021-11-19 21:15:25,347][INFO ][wal-file-cleaner%grid-0-#26789%grid-0%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=42, currSize=10.0 MB, maxSize=20.0 MB] [21:15:25] : [Step 4/5] [2021-11-19 21:15:25,347][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000001.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000051.wal] [21:15:25] : [Step 4/5] [2021-11-19 21:15:25,347][INFO ][db-checkpoint-thread-#26796%grid-0%][Checkpointer] Checkpoint started [checkpointId=89c12f01-e7df-421a-bd76-9a5f346222cd, startPtr=WALPointer [idx=51, fileOff=1028266, len=2010], checkpointBeforeLockTime=4ms, checkpointLockWait=1ms, checkpointListenersExecuteTime=1ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=9ms, writeCheckpointEntryDuration=13ms, splitAndSortCpPagesDuration=0ms, pages=322, reason='too big size of WAL without checkpoint'] [21:15:25] : [Step 4/5] [2021-11-19 21:15:25,349][INFO ][wal-file-cleaner%grid-0-#26789%grid-0%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:15:25] : [Step 4/5] [2021-11-19 21:15:25,348][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=52, segIdx=2, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000002.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000052.wal] [21:15:25] : [Step 4/5] [2021-11-19 21:15:25,355][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=43, currSize=10.0 MB, maxSize=20.0 MB] [21:15:25] : [Step 4/5] [2021-11-19 21:15:25,366][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000002.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000052.wal] [21:15:25] : [Step 4/5] [2021-11-19 21:15:25,366][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:15:25] : [Step 4/5] [2021-11-19 21:15:25,367][INFO ][wal-file-archiver%grid-0-#26788%grid-0%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000001.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000051.wal] [21:15:25] : [Step 4/5] [2021-11-19 21:15:25,390][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=53, segIdx=3, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000003.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000053.wal] [21:15:25] : [Step 4/5] [2021-11-19 21:15:25,391][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=44, currSize=10.0 MB, maxSize=20.0 MB] [21:15:25] : [Step 4/5] [2021-11-19 21:15:25,393][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:15:25] : [Step 4/5] [2021-11-19 21:15:25,405][INFO ][db-checkpoint-thread-#26801%grid-1%][Checkpointer] Checkpoint finished [cpId=4975962a-9cfb-441c-b427-9ac65fa7be2a, pages=555, markPos=WALPointer [idx=50, fileOff=126107, len=2048], walSegmentsCovered=[45 - 49], markDuration=294ms, pagesWrite=57ms, fsync=76ms, total=775ms] [21:15:25] : [Step 4/5] [2021-11-19 21:15:25,405][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000003.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000053.wal] [21:15:25] : [Step 4/5] [2021-11-19 21:15:25,460][INFO ][wal-file-archiver%grid-0-#26788%grid-0%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=52, segIdx=2, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000002.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000052.wal] [21:15:25] : [Step 4/5] [2021-11-19 21:15:25,460][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=54, segIdx=4, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000004.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000054.wal] [21:15:25] : [Step 4/5] [2021-11-19 21:15:25,461][INFO ][wal-file-cleaner%grid-0-#26789%grid-0%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=43, currSize=10.0 MB, maxSize=20.0 MB] [21:15:25] : [Step 4/5] [2021-11-19 21:15:25,462][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=45, currSize=10.0 MB, maxSize=20.0 MB] [21:15:25] : [Step 4/5] [2021-11-19 21:15:25,527][INFO ][wal-file-cleaner%grid-0-#26789%grid-0%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:15:25] : [Step 4/5] [2021-11-19 21:15:25,527][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:15:25] : [Step 4/5] [2021-11-19 21:15:25,554][INFO ][db-checkpoint-thread-#26801%grid-1%][Checkpointer] Checkpoint started [checkpointId=aaf0ebed-6fa0-4cd0-956f-4f57e7732ce7, startPtr=WALPointer [idx=54, fileOff=922184, len=2048], checkpointBeforeLockTime=3ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=2ms, checkpointLockHoldTime=2ms, walCpRecordFsyncDuration=49ms, writeCheckpointEntryDuration=95ms, splitAndSortCpPagesDuration=0ms, pages=426, reason='too big size of WAL without checkpoint'] [21:15:25] : [Step 4/5] [2021-11-19 21:15:25,687][INFO ][db-checkpoint-thread-#26796%grid-0%][Checkpointer] Checkpoint finished [cpId=89c12f01-e7df-421a-bd76-9a5f346222cd, pages=322, markPos=WALPointer [idx=51, fileOff=1028266, len=2010], walSegmentsCovered=[47 - 50], markDuration=25ms, pagesWrite=43ms, fsync=295ms, total=368ms] [21:15:25] : [Step 4/5] [2021-11-19 21:15:25,705][INFO ][wal-file-archiver%grid-0-#26788%grid-0%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000002.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000052.wal] [21:15:25] : [Step 4/5] [2021-11-19 21:15:25,705][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000004.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000054.wal] [21:15:25] : [Step 4/5] [2021-11-19 21:15:25,706][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=55, segIdx=5, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000005.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000055.wal] [21:15:25] : [Step 4/5] [2021-11-19 21:15:25,707][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=46, currSize=10.0 MB, maxSize=20.0 MB] [21:15:25] : [Step 4/5] [2021-11-19 21:15:25,709][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:15:25] : [Step 4/5] [2021-11-19 21:15:25,804][INFO ][wal-file-archiver%grid-0-#26788%grid-0%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=53, segIdx=3, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000003.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000053.wal] [21:15:25] : [Step 4/5] [2021-11-19 21:15:25,805][INFO ][wal-file-cleaner%grid-0-#26789%grid-0%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=44, currSize=10.0 MB, maxSize=20.0 MB] [21:15:25] : [Step 4/5] [2021-11-19 21:15:25,806][INFO ][wal-file-cleaner%grid-0-#26789%grid-0%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:15:25] : [Step 4/5] [2021-11-19 21:15:25,846][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000005.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000055.wal] [21:15:25] : [Step 4/5] [2021-11-19 21:15:25,909][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=56, segIdx=6, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000006.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000056.wal] [21:15:25] : [Step 4/5] [2021-11-19 21:15:25,911][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=47, currSize=10.0 MB, maxSize=20.0 MB] [21:15:25] : [Step 4/5] [2021-11-19 21:15:25,912][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:15:25] : [Step 4/5] [2021-11-19 21:15:25,962][INFO ][wal-file-archiver%grid-0-#26788%grid-0%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000003.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000053.wal] [21:15:25] : [Step 4/5] [2021-11-19 21:15:25,977][INFO ][wal-file-archiver%grid-0-#26788%grid-0%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=54, segIdx=4, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000004.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000054.wal] [21:15:25] : [Step 4/5] [2021-11-19 21:15:25,979][INFO ][wal-file-cleaner%grid-0-#26789%grid-0%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=45, currSize=10.0 MB, maxSize=20.0 MB] [21:15:25] : [Step 4/5] [2021-11-19 21:15:25,980][INFO ][wal-file-cleaner%grid-0-#26789%grid-0%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:15:26] : [Step 4/5] [2021-11-19 21:15:26,155][INFO ][db-checkpoint-thread-#26796%grid-0%][Checkpointer] Checkpoint started [checkpointId=7987ca64-e3c3-4aec-9903-9079f787d96f, startPtr=WALPointer [idx=54, fileOff=152265, len=2010], checkpointBeforeLockTime=118ms, checkpointLockWait=1ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=39ms, writeCheckpointEntryDuration=309ms, splitAndSortCpPagesDuration=0ms, pages=171, reason='too big size of WAL without checkpoint'] [21:15:26] : [Step 4/5] [2021-11-19 21:15:26,156][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000006.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000056.wal] [21:15:26] : [Step 4/5] [2021-11-19 21:15:26,157][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=57, segIdx=7, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000007.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000057.wal] [21:15:26] : [Step 4/5] [2021-11-19 21:15:26,164][INFO ][wal-file-archiver%grid-0-#26788%grid-0%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000004.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000054.wal] [21:15:26] : [Step 4/5] [2021-11-19 21:15:26,179][INFO ][wal-file-archiver%grid-0-#26788%grid-0%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=55, segIdx=5, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000005.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000055.wal] [21:15:26] : [Step 4/5] [2021-11-19 21:15:26,178][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=48, currSize=10.0 MB, maxSize=20.0 MB] [21:15:26] : [Step 4/5] [2021-11-19 21:15:26,180][INFO ][wal-file-cleaner%grid-0-#26789%grid-0%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=46, currSize=10.0 MB, maxSize=20.0 MB] [21:15:26] : [Step 4/5] [2021-11-19 21:15:26,181][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:15:26] : [Step 4/5] [2021-11-19 21:15:26,181][INFO ][wal-file-cleaner%grid-0-#26789%grid-0%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:15:26] : [Step 4/5] [2021-11-19 21:15:26,208][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000007.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000057.wal] [21:15:26] : [Step 4/5] [2021-11-19 21:15:26,208][INFO ][db-checkpoint-thread-#26801%grid-1%][Checkpointer] Checkpoint finished [cpId=aaf0ebed-6fa0-4cd0-956f-4f57e7732ce7, pages=426, markPos=WALPointer [idx=54, fileOff=922184, len=2048], walSegmentsCovered=[50 - 53], markDuration=147ms, pagesWrite=129ms, fsync=524ms, total=803ms] [21:15:26] : [Step 4/5] [2021-11-19 21:15:26,208][INFO ][wal-file-archiver%grid-0-#26788%grid-0%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000005.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000055.wal] [21:15:26] : [Step 4/5] [2021-11-19 21:15:26,208][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=58, segIdx=8, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000008.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000058.wal] [21:15:26] : [Step 4/5] [2021-11-19 21:15:26,215][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=49, currSize=10.0 MB, maxSize=20.0 MB] [21:15:26] : [Step 4/5] [2021-11-19 21:15:26,217][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:15:26] : [Step 4/5] [2021-11-19 21:15:26,232][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000008.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000058.wal] [21:15:26] : [Step 4/5] [2021-11-19 21:15:26,233][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=59, segIdx=9, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000009.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000059.wal] [21:15:26] : [Step 4/5] [2021-11-19 21:15:26,234][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=50, currSize=10.0 MB, maxSize=20.0 MB] [21:15:26] : [Step 4/5] [2021-11-19 21:15:26,236][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:15:26] : [Step 4/5] [2021-11-19 21:15:26,248][INFO ][db-checkpoint-thread-#26796%grid-0%][Checkpointer] Checkpoint finished [cpId=7987ca64-e3c3-4aec-9903-9079f787d96f, pages=171, markPos=WALPointer [idx=54, fileOff=152265, len=2010], walSegmentsCovered=[51 - 53], markDuration=350ms, pagesWrite=32ms, fsync=60ms, total=561ms] [21:15:26] : [Step 4/5] [2021-11-19 21:15:26,249][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000009.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000059.wal] [21:15:26] : [Step 4/5] [2021-11-19 21:15:26,250][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=60, segIdx=0, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000000.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000060.wal] [21:15:26] : [Step 4/5] [2021-11-19 21:15:26,251][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=51, currSize=10.0 MB, maxSize=20.0 MB] [21:15:26] : [Step 4/5] [2021-11-19 21:15:26,253][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:15:26] : [Step 4/5] [2021-11-19 21:15:26,268][INFO ][wal-file-archiver%grid-0-#26788%grid-0%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=56, segIdx=6, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000006.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000056.wal] [21:15:26] : [Step 4/5] [2021-11-19 21:15:26,269][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000000.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000060.wal] [21:15:26] : [Step 4/5] [2021-11-19 21:15:26,269][INFO ][wal-file-cleaner%grid-0-#26789%grid-0%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=47, currSize=10.0 MB, maxSize=20.0 MB] [21:15:26] : [Step 4/5] [2021-11-19 21:15:26,270][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=61, segIdx=1, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000001.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000061.wal] [21:15:26] : [Step 4/5] [2021-11-19 21:15:26,271][INFO ][wal-file-cleaner%grid-0-#26789%grid-0%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:15:26] : [Step 4/5] [2021-11-19 21:15:26,271][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=52, currSize=10.0 MB, maxSize=20.0 MB] [21:15:26] : [Step 4/5] [2021-11-19 21:15:26,273][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:15:26] : [Step 4/5] [2021-11-19 21:15:26,290][INFO ][wal-file-archiver%grid-0-#26788%grid-0%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000006.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000056.wal] [21:15:26] : [Step 4/5] [2021-11-19 21:15:26,291][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000001.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000061.wal] [21:15:26] : [Step 4/5] [2021-11-19 21:15:26,291][INFO ][db-checkpoint-thread-#26801%grid-1%][Checkpointer] Checkpoint started [checkpointId=fdf97cfb-702b-4902-97bc-d27994a4301f, startPtr=WALPointer [idx=62, fileOff=700361, len=2048], checkpointBeforeLockTime=34ms, checkpointLockWait=8ms, checkpointListenersExecuteTime=1ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=16ms, writeCheckpointEntryDuration=22ms, splitAndSortCpPagesDuration=1ms, pages=704, reason='too big size of WAL without checkpoint'] [21:15:26] : [Step 4/5] [2021-11-19 21:15:26,291][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=62, segIdx=2, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000002.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000062.wal] [21:15:26] : [Step 4/5] [2021-11-19 21:15:26,296][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=53, currSize=10.0 MB, maxSize=20.0 MB] [21:15:26] : [Step 4/5] [2021-11-19 21:15:26,297][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:15:26] : [Step 4/5] [2021-11-19 21:15:26,299][INFO ][db-checkpoint-thread-#26796%grid-0%][Checkpointer] Checkpoint started [checkpointId=497bb69f-77ab-4f0b-8d9b-ee280319f2a9, startPtr=WALPointer [idx=57, fileOff=22761, len=2010], checkpointBeforeLockTime=21ms, checkpointLockWait=1ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=17ms, writeCheckpointEntryDuration=10ms, splitAndSortCpPagesDuration=0ms, pages=199, reason='too big size of WAL without checkpoint'] [21:15:26] : [Step 4/5] [2021-11-19 21:15:26,320][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000002.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000062.wal] [21:15:26] : [Step 4/5] [2021-11-19 21:15:26,343][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=63, segIdx=3, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000003.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000063.wal] [21:15:26] : [Step 4/5] [2021-11-19 21:15:26,344][INFO ][db-checkpoint-thread-#26796%grid-0%][Checkpointer] Checkpoint finished [cpId=497bb69f-77ab-4f0b-8d9b-ee280319f2a9, pages=199, markPos=WALPointer [idx=57, fileOff=22761, len=2010], walSegmentsCovered=[54 - 56], markDuration=29ms, pagesWrite=16ms, fsync=28ms, total=95ms] [21:15:26] : [Step 4/5] [2021-11-19 21:15:26,345][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=54, currSize=10.0 MB, maxSize=20.0 MB] [21:15:26] : [Step 4/5] [2021-11-19 21:15:26,346][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:15:26] : [Step 4/5] [2021-11-19 21:15:26,360][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000003.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000063.wal] [21:15:26] : [Step 4/5] [2021-11-19 21:15:26,375][INFO ][wal-file-archiver%grid-0-#26788%grid-0%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=57, segIdx=7, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000007.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000057.wal] [21:15:26] : [Step 4/5] [2021-11-19 21:15:26,376][INFO ][wal-file-cleaner%grid-0-#26789%grid-0%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=48, currSize=10.0 MB, maxSize=20.0 MB] [21:15:26] : [Step 4/5] [2021-11-19 21:15:26,377][INFO ][wal-file-cleaner%grid-0-#26789%grid-0%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:15:26] : [Step 4/5] [2021-11-19 21:15:26,467][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=64, segIdx=4, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000004.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000064.wal] [21:15:26] : [Step 4/5] [2021-11-19 21:15:26,468][INFO ][wal-file-archiver%grid-0-#26788%grid-0%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000007.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000057.wal] [21:15:26] : [Step 4/5] [2021-11-19 21:15:26,699][INFO ][wal-file-archiver%grid-0-#26788%grid-0%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=58, segIdx=8, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000008.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000058.wal] [21:15:26] : [Step 4/5] [2021-11-19 21:15:26,703][INFO ][wal-file-cleaner%grid-0-#26789%grid-0%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=49, currSize=10.0 MB, maxSize=20.0 MB] [21:15:26] : [Step 4/5] [2021-11-19 21:15:26,704][INFO ][wal-file-cleaner%grid-0-#26789%grid-0%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:15:26] : [Step 4/5] [2021-11-19 21:15:26,782][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000004.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000064.wal] [21:15:26] : [Step 4/5] [2021-11-19 21:15:26,835][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=65, segIdx=5, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000005.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000065.wal] [21:15:26] : [Step 4/5] [2021-11-19 21:15:26,894][INFO ][wal-file-archiver%grid-0-#26788%grid-0%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000008.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000058.wal] [21:15:27] : [Step 4/5] [2021-11-19 21:15:27,080][INFO ][wal-file-archiver%grid-0-#26788%grid-0%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=59, segIdx=9, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000009.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000059.wal] [21:15:27] : [Step 4/5] [2021-11-19 21:15:27,081][INFO ][db-checkpoint-thread-#26801%grid-1%][Checkpointer] Checkpoint finished [cpId=fdf97cfb-702b-4902-97bc-d27994a4301f, pages=704, markPos=WALPointer [idx=62, fileOff=700361, len=2048], walSegmentsCovered=[54 - 61], markDuration=41ms, pagesWrite=59ms, fsync=730ms, total=872ms] [21:15:27] : [Step 4/5] [2021-11-19 21:15:27,084][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=56, currSize=12.0 MB, maxSize=20.0 MB] [21:15:27] : [Step 4/5] [2021-11-19 21:15:27,085][INFO ][wal-file-cleaner%grid-0-#26789%grid-0%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=50, currSize=10.0 MB, maxSize=20.0 MB] [21:15:27] : [Step 4/5] [2021-11-19 21:15:27,086][INFO ][wal-file-cleaner%grid-0-#26789%grid-0%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:15:27] : [Step 4/5] [2021-11-19 21:15:27,086][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=2, currSize=10.0 MB, maxSize=20.0 MB] [21:15:27] : [Step 4/5] [2021-11-19 21:15:27,103][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000005.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000065.wal] [21:15:27] : [Step 4/5] [2021-11-19 21:15:27,103][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=66, segIdx=6, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000006.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000066.wal] [21:15:27] : [Step 4/5] [2021-11-19 21:15:27,105][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=57, currSize=10.0 MB, maxSize=20.0 MB] [21:15:27] : [Step 4/5] [2021-11-19 21:15:27,106][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:15:27] : [Step 4/5] [2021-11-19 21:15:27,176][INFO ][wal-file-archiver%grid-0-#26788%grid-0%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000009.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000059.wal] [21:15:27] : [Step 4/5] [2021-11-19 21:15:27,176][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000006.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000066.wal] [21:15:27] : [Step 4/5] [2021-11-19 21:15:27,177][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=67, segIdx=7, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000007.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000067.wal] [21:15:27] : [Step 4/5] [2021-11-19 21:15:27,194][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=58, currSize=10.0 MB, maxSize=20.0 MB] [21:15:27] : [Step 4/5] [2021-11-19 21:15:27,195][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000007.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000067.wal] [21:15:27] : [Step 4/5] [2021-11-19 21:15:27,196][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=10.0 MB, maxSize=20.0 MB] [21:15:27] : [Step 4/5] [2021-11-19 21:15:27,210][INFO ][db-checkpoint-thread-#26801%grid-1%][Checkpointer] Checkpoint started [checkpointId=9b8693cb-daa8-42d0-aaa5-2748518d054d, startPtr=WALPointer [idx=68, fileOff=945541, len=2048], checkpointBeforeLockTime=101ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=2ms, checkpointLockHoldTime=2ms, walCpRecordFsyncDuration=9ms, writeCheckpointEntryDuration=15ms, splitAndSortCpPagesDuration=1ms, pages=631, reason='too big size of WAL without checkpoint'] [21:15:27] : [Step 4/5] [2021-11-19 21:15:27,211][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=68, segIdx=8, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000008.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000068.wal] [21:15:27] : [Step 4/5] [2021-11-19 21:15:27,212][INFO ][wal-file-archiver%grid-0-#26788%grid-0%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=60, segIdx=0, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000000.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000060.wal] [21:15:27] : [Step 4/5] [2021-11-19 21:15:27,212][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=59, currSize=10.0 MB, maxSize=20.0 MB] [21:15:27] : [Step 4/5] [2021-11-19 21:15:27,213][INFO ][wal-file-cleaner%grid-0-#26789%grid-0%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=51, currSize=10.0 MB, maxSize=20.0 MB] [21:15:27] : [Step 4/5] [2021-11-19 21:15:27,215][INFO ][wal-file-cleaner%grid-0-#26789%grid-0%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:15:27] : [Step 4/5] [2021-11-19 21:15:27,217][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:15:27] : [Step 4/5] [2021-11-19 21:15:27,229][INFO ][wal-file-archiver%grid-0-#26788%grid-0%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000000.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000060.wal] [21:15:27] : [Step 4/5] [2021-11-19 21:15:27,230][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000008.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000068.wal] [21:15:27] : [Step 4/5] [2021-11-19 21:15:27,274][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=69, segIdx=9, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000009.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000069.wal] [21:15:27] : [Step 4/5] [2021-11-19 21:15:27,276][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=60, currSize=10.0 MB, maxSize=20.0 MB] [21:15:27] : [Step 4/5] [2021-11-19 21:15:27,277][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:15:27] : [Step 4/5] [2021-11-19 21:15:27,288][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000009.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000069.wal] [21:15:27] : [Step 4/5] [2021-11-19 21:15:27,468][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=70, segIdx=0, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000000.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000070.wal] [21:15:27] : [Step 4/5] [2021-11-19 21:15:27,469][INFO ][wal-file-archiver%grid-0-#26788%grid-0%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=61, segIdx=1, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000001.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000061.wal] [21:15:27] : [Step 4/5] [2021-11-19 21:15:27,470][INFO ][wal-file-cleaner%grid-0-#26789%grid-0%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=52, currSize=10.0 MB, maxSize=20.0 MB] [21:15:27] : [Step 4/5] [2021-11-19 21:15:27,537][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=61, currSize=10.0 MB, maxSize=20.0 MB] [21:15:27] : [Step 4/5] [2021-11-19 21:15:27,537][INFO ][wal-file-cleaner%grid-0-#26789%grid-0%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:15:27] : [Step 4/5] [2021-11-19 21:15:27,538][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:15:27] : [Step 4/5] [2021-11-19 21:15:27,729][INFO ][wal-file-archiver%grid-0-#26788%grid-0%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000001.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000061.wal] [21:15:27] : [Step 4/5] [2021-11-19 21:15:27,729][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000000.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000070.wal] [21:15:27] : [Step 4/5] [2021-11-19 21:15:27,729][INFO ][wal-file-archiver%grid-0-#26788%grid-0%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=62, segIdx=2, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000002.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000062.wal] [21:15:27] : [Step 4/5] [2021-11-19 21:15:27,730][INFO ][db-checkpoint-thread-#26796%grid-0%][Checkpointer] Checkpoint started [checkpointId=bcfbe005-6457-407a-bcb7-828ded2eaf07, startPtr=WALPointer [idx=62, fileOff=257958, len=2010], checkpointBeforeLockTime=3ms, checkpointLockWait=1ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=21ms, writeCheckpointEntryDuration=165ms, splitAndSortCpPagesDuration=1ms, pages=348, reason='too big size of WAL without checkpoint'] [21:15:27] : [Step 4/5] [2021-11-19 21:15:27,730][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=71, segIdx=1, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000001.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000071.wal] [21:15:27] : [Step 4/5] [2021-11-19 21:15:27,730][INFO ][wal-file-cleaner%grid-0-#26789%grid-0%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=53, currSize=10.0 MB, maxSize=20.0 MB] [21:15:27] : [Step 4/5] [2021-11-19 21:15:27,732][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=62, currSize=10.0 MB, maxSize=20.0 MB] [21:15:27] : [Step 4/5] [2021-11-19 21:15:27,733][INFO ][wal-file-cleaner%grid-0-#26789%grid-0%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:15:27] : [Step 4/5] [2021-11-19 21:15:27,734][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:15:27] : [Step 4/5] [2021-11-19 21:15:27,750][INFO ][db-checkpoint-thread-#26801%grid-1%][Checkpointer] Checkpoint finished [cpId=9b8693cb-daa8-42d0-aaa5-2748518d054d, pages=631, markPos=WALPointer [idx=68, fileOff=945541, len=2048], walSegmentsCovered=[62 - 67], markDuration=28ms, pagesWrite=67ms, fsync=472ms, total=668ms] [21:15:27] : [Step 4/5] [2021-11-19 21:15:27,750][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000001.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000071.wal] [21:15:27] : [Step 4/5] [2021-11-19 21:15:27,751][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=72, segIdx=2, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000002.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000072.wal] [21:15:27] : [Step 4/5] [2021-11-19 21:15:27,752][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=63, currSize=10.0 MB, maxSize=20.0 MB] [21:15:27] : [Step 4/5] [2021-11-19 21:15:27,750][INFO ][wal-file-archiver%grid-0-#26788%grid-0%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000002.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000062.wal] [21:15:27] : [Step 4/5] [2021-11-19 21:15:27,757][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:15:27] : [Step 4/5] [2021-11-19 21:15:27,766][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000002.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000072.wal] [21:15:27] : [Step 4/5] [2021-11-19 21:15:27,777][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=73, segIdx=3, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000003.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000073.wal] [21:15:27] : [Step 4/5] [2021-11-19 21:15:27,780][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=64, currSize=10.0 MB, maxSize=20.0 MB] [21:15:27] : [Step 4/5] [2021-11-19 21:15:27,782][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:15:27] : [Step 4/5] [2021-11-19 21:15:27,791][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000003.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000073.wal] [21:15:27] : [Step 4/5] [2021-11-19 21:15:27,821][INFO ][wal-file-archiver%grid-0-#26788%grid-0%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=63, segIdx=3, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000003.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000063.wal] [21:15:27] : [Step 4/5] [2021-11-19 21:15:27,821][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=74, segIdx=4, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000004.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000074.wal] [21:15:27] : [Step 4/5] [2021-11-19 21:15:27,822][INFO ][db-checkpoint-thread-#26796%grid-0%][Checkpointer] Checkpoint finished [cpId=bcfbe005-6457-407a-bcb7-828ded2eaf07, pages=348, markPos=WALPointer [idx=62, fileOff=257958, len=2010], walSegmentsCovered=[57 - 61], markDuration=188ms, pagesWrite=50ms, fsync=41ms, total=283ms] [21:15:27] : [Step 4/5] [2021-11-19 21:15:27,822][INFO ][wal-file-cleaner%grid-0-#26789%grid-0%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=54, currSize=10.0 MB, maxSize=20.0 MB] [21:15:27] : [Step 4/5] [2021-11-19 21:15:27,822][INFO ][db-checkpoint-thread-#26801%grid-1%][Checkpointer] Checkpoint started [checkpointId=64b0b540-e582-41f2-9813-b905cc9dab88, startPtr=WALPointer [idx=74, fileOff=696960, len=2048], checkpointBeforeLockTime=39ms, checkpointLockWait=1ms, checkpointListenersExecuteTime=3ms, checkpointLockHoldTime=3ms, walCpRecordFsyncDuration=11ms, writeCheckpointEntryDuration=17ms, splitAndSortCpPagesDuration=1ms, pages=530, reason='too big size of WAL without checkpoint'] [21:15:27] : [Step 4/5] [2021-11-19 21:15:27,823][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=65, currSize=10.0 MB, maxSize=20.0 MB] [21:15:27] : [Step 4/5] [2021-11-19 21:15:27,824][INFO ][wal-file-cleaner%grid-0-#26789%grid-0%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:15:27] : [Step 4/5] [2021-11-19 21:15:27,826][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:15:27] : [Step 4/5] [2021-11-19 21:15:27,843][INFO ][wal-file-archiver%grid-0-#26788%grid-0%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000003.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000063.wal] [21:15:27] : [Step 4/5] [2021-11-19 21:15:27,843][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000004.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000074.wal] [21:15:27] : [Step 4/5] [2021-11-19 21:15:27,851][INFO ][db-checkpoint-thread-#26796%grid-0%][Checkpointer] Checkpoint started [checkpointId=3845d2b3-20a1-47ab-a9f9-fb849d8e3f63, startPtr=WALPointer [idx=64, fileOff=113267, len=2010], checkpointBeforeLockTime=1ms, checkpointLockWait=1ms, checkpointListenersExecuteTime=1ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=15ms, writeCheckpointEntryDuration=10ms, splitAndSortCpPagesDuration=0ms, pages=130, reason='too big size of WAL without checkpoint'] [21:15:27] : [Step 4/5] [2021-11-19 21:15:27,878][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=75, segIdx=5, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000005.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000075.wal] [21:15:27] : [Step 4/5] [2021-11-19 21:15:27,888][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=66, currSize=10.0 MB, maxSize=20.0 MB] [21:15:27] : [Step 4/5] [2021-11-19 21:15:27,889][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:15:27] : [Step 4/5] [2021-11-19 21:15:27,910][INFO ][wal-file-archiver%grid-0-#26788%grid-0%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=64, segIdx=4, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000004.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000064.wal] [21:15:27] : [Step 4/5] [2021-11-19 21:15:27,911][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000005.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000075.wal] [21:15:27] : [Step 4/5] [2021-11-19 21:15:27,912][INFO ][wal-file-cleaner%grid-0-#26789%grid-0%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=55, currSize=10.0 MB, maxSize=20.0 MB] [21:15:27] : [Step 4/5] [2021-11-19 21:15:27,914][INFO ][wal-file-cleaner%grid-0-#26789%grid-0%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:15:27] : [Step 4/5] [2021-11-19 21:15:27,921][INFO ][db-checkpoint-thread-#26796%grid-0%][Checkpointer] Checkpoint finished [cpId=3845d2b3-20a1-47ab-a9f9-fb849d8e3f63, pages=130, markPos=WALPointer [idx=64, fileOff=113267, len=2010], walSegmentsCovered=[62 - 63], markDuration=27ms, pagesWrite=10ms, fsync=59ms, total=98ms] [21:15:27] : [Step 4/5] [2021-11-19 21:15:27,921][INFO ][wal-file-archiver%grid-0-#26788%grid-0%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000004.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000064.wal] [21:15:27] : [Step 4/5] [2021-11-19 21:15:27,935][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=76, segIdx=6, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000006.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000076.wal] [21:15:27] : [Step 4/5] [2021-11-19 21:15:27,936][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=67, currSize=10.0 MB, maxSize=20.0 MB] [21:15:27] : [Step 4/5] [2021-11-19 21:15:27,937][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:15:27] : [Step 4/5] [2021-11-19 21:15:27,951][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000006.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000076.wal] [21:15:27] : [Step 4/5] [2021-11-19 21:15:27,958][INFO ][db-checkpoint-thread-#26801%grid-1%][Checkpointer] Checkpoint finished [cpId=64b0b540-e582-41f2-9813-b905cc9dab88, pages=530, markPos=WALPointer [idx=74, fileOff=696960, len=2048], walSegmentsCovered=[68 - 73], markDuration=34ms, pagesWrite=46ms, fsync=88ms, total=208ms] [21:15:27] : [Step 4/5] [2021-11-19 21:15:27,978][INFO ][wal-file-archiver%grid-0-#26788%grid-0%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=65, segIdx=5, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000005.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000065.wal] [21:15:27] : [Step 4/5] [2021-11-19 21:15:27,979][INFO ][wal-file-cleaner%grid-0-#26789%grid-0%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=56, currSize=10.0 MB, maxSize=20.0 MB] [21:15:27] : [Step 4/5] [2021-11-19 21:15:27,980][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=77, segIdx=7, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000007.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000077.wal] [21:15:27] : [Step 4/5] [2021-11-19 21:15:27,980][INFO ][wal-file-cleaner%grid-0-#26789%grid-0%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:15:27] : [Step 4/5] [2021-11-19 21:15:27,981][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=68, currSize=10.0 MB, maxSize=20.0 MB] [21:15:27] : [Step 4/5] [2021-11-19 21:15:27,982][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:15:27] : [Step 4/5] [2021-11-19 21:15:27,994][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000007.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000077.wal] [21:15:27] : [Step 4/5] [2021-11-19 21:15:27,995][INFO ][wal-file-archiver%grid-0-#26788%grid-0%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000005.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000065.wal] [21:15:28] : [Step 4/5] [2021-11-19 21:15:28,003][INFO ][db-checkpoint-thread-#26801%grid-1%][Checkpointer] Checkpoint started [checkpointId=8e0b4c2c-54ac-477e-8bce-0fcc6bba1901, startPtr=WALPointer [idx=78, fileOff=73522, len=2048], checkpointBeforeLockTime=16ms, checkpointLockWait=5ms, checkpointListenersExecuteTime=2ms, checkpointLockHoldTime=2ms, walCpRecordFsyncDuration=12ms, writeCheckpointEntryDuration=8ms, splitAndSortCpPagesDuration=1ms, pages=359, reason='too big size of WAL without checkpoint'] [21:15:28] : [Step 4/5] [2021-11-19 21:15:28,019][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=78, segIdx=8, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000008.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000078.wal] [21:15:28] : [Step 4/5] [2021-11-19 21:15:28,020][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=69, currSize=10.0 MB, maxSize=20.0 MB] [21:15:28] : [Step 4/5] [2021-11-19 21:15:28,021][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:15:28] : [Step 4/5] [2021-11-19 21:15:28,029][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000008.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000078.wal] [21:15:28] : [Step 4/5] [2021-11-19 21:15:28,066][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=79, segIdx=9, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000009.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000079.wal] [21:15:28] : [Step 4/5] [2021-11-19 21:15:28,067][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=70, currSize=10.0 MB, maxSize=20.0 MB] [21:15:28] : [Step 4/5] [2021-11-19 21:15:28,069][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:15:28] : [Step 4/5] [2021-11-19 21:15:28,079][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000009.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000079.wal] [21:15:28] : [Step 4/5] [2021-11-19 21:15:28,094][INFO ][wal-file-archiver%grid-0-#26788%grid-0%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=66, segIdx=6, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000006.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000066.wal] [21:15:28] : [Step 4/5] [2021-11-19 21:15:28,096][INFO ][wal-file-cleaner%grid-0-#26789%grid-0%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=57, currSize=10.0 MB, maxSize=20.0 MB] [21:15:28] : [Step 4/5] [2021-11-19 21:15:28,098][INFO ][wal-file-cleaner%grid-0-#26789%grid-0%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:15:28] : [Step 4/5] [2021-11-19 21:15:28,114][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=80, segIdx=0, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000000.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000080.wal] [21:15:28] : [Step 4/5] [2021-11-19 21:15:28,115][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=71, currSize=10.0 MB, maxSize=20.0 MB] [21:15:28] : [Step 4/5] [2021-11-19 21:15:28,115][INFO ][db-checkpoint-thread-#26801%grid-1%][Checkpointer] Checkpoint finished [cpId=8e0b4c2c-54ac-477e-8bce-0fcc6bba1901, pages=359, markPos=WALPointer [idx=78, fileOff=73522, len=2048], walSegmentsCovered=[74 - 77], markDuration=24ms, pagesWrite=29ms, fsync=81ms, total=155ms] [21:15:28] : [Step 4/5] [2021-11-19 21:15:28,115][INFO ][wal-file-archiver%grid-0-#26788%grid-0%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000006.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000066.wal] [21:15:28] : [Step 4/5] [2021-11-19 21:15:28,116][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:15:28] : [Step 4/5] [2021-11-19 21:15:28,128][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000000.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000080.wal] [21:15:28] : [Step 4/5] [2021-11-19 21:15:28,136][INFO ][db-checkpoint-thread-#26801%grid-1%][Checkpointer] Checkpoint started [checkpointId=e2046f75-7f5c-476f-8ae7-6ab2c454ddb7, startPtr=WALPointer [idx=81, fileOff=136176, len=2048], checkpointBeforeLockTime=4ms, checkpointLockWait=2ms, checkpointListenersExecuteTime=1ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=4ms, writeCheckpointEntryDuration=9ms, splitAndSortCpPagesDuration=0ms, pages=239, reason='too big size of WAL without checkpoint'] [21:15:28] : [Step 4/5] [2021-11-19 21:15:28,169][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=81, segIdx=1, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000001.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000081.wal] [21:15:28] : [Step 4/5] [2021-11-19 21:15:28,170][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=72, currSize=10.0 MB, maxSize=20.0 MB] [21:15:28] : [Step 4/5] [2021-11-19 21:15:28,172][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:15:28] : [Step 4/5] [2021-11-19 21:15:28,180][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000001.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000081.wal] [21:15:28] : [Step 4/5] [2021-11-19 21:15:28,329][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=82, segIdx=2, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000002.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000082.wal] [21:15:28] : [Step 4/5] [2021-11-19 21:15:28,331][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=73, currSize=10.0 MB, maxSize=20.0 MB] [21:15:28] : [Step 4/5] [2021-11-19 21:15:28,332][INFO ][wal-file-archiver%grid-0-#26788%grid-0%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=67, segIdx=7, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000007.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000067.wal] [21:15:28] : [Step 4/5] [2021-11-19 21:15:28,403][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:15:28] : [Step 4/5] [2021-11-19 21:15:28,408][INFO ][wal-file-cleaner%grid-0-#26789%grid-0%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=58, currSize=10.0 MB, maxSize=20.0 MB] [21:15:28] : [Step 4/5] [2021-11-19 21:15:28,411][INFO ][wal-file-cleaner%grid-0-#26789%grid-0%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:15:28] : [Step 4/5] [2021-11-19 21:15:28,523][INFO ][wal-file-archiver%grid-0-#26788%grid-0%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000007.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000067.wal] [21:15:28] : [Step 4/5] [2021-11-19 21:15:28,523][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000002.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000082.wal] [21:15:28] : [Step 4/5] [2021-11-19 21:15:28,524][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=83, segIdx=3, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000003.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000083.wal] [21:15:28] : [Step 4/5] [2021-11-19 21:15:28,525][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=74, currSize=10.0 MB, maxSize=20.0 MB] [21:15:28] : [Step 4/5] [2021-11-19 21:15:28,527][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:15:28] : [Step 4/5] [2021-11-19 21:15:28,523][INFO ][wal-file-archiver%grid-0-#26788%grid-0%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=68, segIdx=8, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000008.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000068.wal] [21:15:28] : [Step 4/5] [2021-11-19 21:15:28,538][INFO ][wal-file-cleaner%grid-0-#26789%grid-0%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=59, currSize=10.0 MB, maxSize=20.0 MB] [21:15:28] : [Step 4/5] [2021-11-19 21:15:28,538][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000003.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000083.wal] [21:15:28] : [Step 4/5] [2021-11-19 21:15:28,539][INFO ][wal-file-cleaner%grid-0-#26789%grid-0%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:15:28] : [Step 4/5] [2021-11-19 21:15:28,551][INFO ][wal-file-archiver%grid-0-#26788%grid-0%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000008.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000068.wal] [21:15:28] : [Step 4/5] [2021-11-19 21:15:28,551][INFO ][db-checkpoint-thread-#26801%grid-1%][Checkpointer] Checkpoint finished [cpId=e2046f75-7f5c-476f-8ae7-6ab2c454ddb7, pages=239, markPos=WALPointer [idx=81, fileOff=136176, len=2048], walSegmentsCovered=[78 - 80], markDuration=15ms, pagesWrite=37ms, fsync=377ms, total=435ms] [21:15:28] : [Step 4/5] [2021-11-19 21:15:28,565][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=84, segIdx=4, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000004.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000084.wal] [21:15:28] : [Step 4/5] [2021-11-19 21:15:28,566][INFO ][db-checkpoint-thread-#26796%grid-0%][Checkpointer] Checkpoint started [checkpointId=56b8b7eb-5403-4139-82be-95550fc65811, startPtr=WALPointer [idx=69, fileOff=96055, len=2010], checkpointBeforeLockTime=4ms, checkpointLockWait=15ms, checkpointListenersExecuteTime=1ms, checkpointLockHoldTime=2ms, walCpRecordFsyncDuration=6ms, writeCheckpointEntryDuration=15ms, splitAndSortCpPagesDuration=1ms, pages=312, reason='too big size of WAL without checkpoint'] [21:15:28] : [Step 4/5] [2021-11-19 21:15:28,566][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=75, currSize=10.0 MB, maxSize=20.0 MB] [21:15:28] : [Step 4/5] [2021-11-19 21:15:28,568][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:15:28] : [Step 4/5] [2021-11-19 21:15:28,622][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000004.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000084.wal] [21:15:28] : [Step 4/5] [2021-11-19 21:15:28,640][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=85, segIdx=5, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000005.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000085.wal] [21:15:28] : [Step 4/5] [2021-11-19 21:15:28,643][INFO ][db-checkpoint-thread-#26801%grid-1%][Checkpointer] Checkpoint started [checkpointId=ff94ef90-970b-4679-9392-e4107cc9b209, startPtr=WALPointer [idx=85, fileOff=1030653, len=2048], checkpointBeforeLockTime=77ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=1ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=10ms, writeCheckpointEntryDuration=3ms, splitAndSortCpPagesDuration=0ms, pages=547, reason='too big size of WAL without checkpoint'] [21:15:28] : [Step 4/5] [2021-11-19 21:15:28,644][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=76, currSize=10.0 MB, maxSize=20.0 MB] [21:15:28] : [Step 4/5] [2021-11-19 21:15:28,646][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:15:28] : [Step 4/5] [2021-11-19 21:15:28,660][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000005.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000085.wal] [21:15:28] : [Step 4/5] [2021-11-19 21:15:28,684][INFO ][wal-file-archiver%grid-0-#26788%grid-0%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=69, segIdx=9, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000009.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000069.wal] [21:15:28] : [Step 4/5] [2021-11-19 21:15:28,685][INFO ][wal-file-cleaner%grid-0-#26789%grid-0%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=60, currSize=10.0 MB, maxSize=20.0 MB] [21:15:28] : [Step 4/5] [2021-11-19 21:15:28,686][INFO ][wal-file-cleaner%grid-0-#26789%grid-0%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:15:28] : [Step 4/5] [2021-11-19 21:15:28,684][INFO ][db-checkpoint-thread-#26796%grid-0%][Checkpointer] Checkpoint finished [cpId=56b8b7eb-5403-4139-82be-95550fc65811, pages=312, markPos=WALPointer [idx=69, fileOff=96055, len=2010], walSegmentsCovered=[64 - 68], markDuration=25ms, pagesWrite=72ms, fsync=45ms, total=161ms] [21:15:28] : [Step 4/5] [2021-11-19 21:15:28,697][INFO ][wal-file-archiver%grid-0-#26788%grid-0%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000009.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000069.wal] [21:15:28] : [Step 4/5] [2021-11-19 21:15:28,717][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=86, segIdx=6, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000006.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000086.wal] [21:15:28] : [Step 4/5] [2021-11-19 21:15:28,722][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=77, currSize=10.0 MB, maxSize=20.0 MB] [21:15:28] : [Step 4/5] [2021-11-19 21:15:28,723][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:15:28] : [Step 4/5] [2021-11-19 21:15:28,739][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000006.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000086.wal] [21:15:28] : [Step 4/5] [2021-11-19 21:15:28,831][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=87, segIdx=7, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000007.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000087.wal] [21:15:28] : [Step 4/5] [2021-11-19 21:15:28,833][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=78, currSize=10.0 MB, maxSize=20.0 MB] [21:15:28] : [Step 4/5] [2021-11-19 21:15:28,888][INFO ][wal-file-archiver%grid-0-#26788%grid-0%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=70, segIdx=0, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000000.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000070.wal] [21:15:28] : [Step 4/5] [2021-11-19 21:15:28,888][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:15:28] : [Step 4/5] [2021-11-19 21:15:28,889][INFO ][wal-file-cleaner%grid-0-#26789%grid-0%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=61, currSize=10.0 MB, maxSize=20.0 MB] [21:15:28] : [Step 4/5] [2021-11-19 21:15:28,890][INFO ][wal-file-cleaner%grid-0-#26789%grid-0%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:15:29] : [Step 4/5] [2021-11-19 21:15:29,063][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000007.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000087.wal] [21:15:29] : [Step 4/5] [2021-11-19 21:15:29,063][INFO ][wal-file-archiver%grid-0-#26788%grid-0%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000000.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000070.wal] [21:15:29] : [Step 4/5] [2021-11-19 21:15:29,064][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=88, segIdx=8, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000008.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000088.wal] [21:15:29] : [Step 4/5] [2021-11-19 21:15:29,065][INFO ][wal-file-archiver%grid-0-#26788%grid-0%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=71, segIdx=1, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000001.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000071.wal] [21:15:29] : [Step 4/5] [2021-11-19 21:15:29,101][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=79, currSize=10.0 MB, maxSize=20.0 MB] [21:15:29] : [Step 4/5] [2021-11-19 21:15:29,103][INFO ][wal-file-cleaner%grid-0-#26789%grid-0%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=62, currSize=10.0 MB, maxSize=20.0 MB] [21:15:29] : [Step 4/5] [2021-11-19 21:15:29,103][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:15:29] : [Step 4/5] [2021-11-19 21:15:29,104][INFO ][wal-file-cleaner%grid-0-#26789%grid-0%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:15:29] : [Step 4/5] [2021-11-19 21:15:29,164][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000008.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000088.wal] [21:15:29] : [Step 4/5] [2021-11-19 21:15:29,164][INFO ][wal-file-archiver%grid-0-#26788%grid-0%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000001.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000071.wal] [21:15:29] : [Step 4/5] [2021-11-19 21:15:29,165][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=89, segIdx=9, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000009.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000089.wal] [21:15:29] : [Step 4/5] [2021-11-19 21:15:29,166][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=80, currSize=10.0 MB, maxSize=20.0 MB] [21:15:29] : [Step 4/5] [2021-11-19 21:15:29,168][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:15:29] : [Step 4/5] [2021-11-19 21:15:29,177][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000009.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000089.wal] [21:15:29] : [Step 4/5] [2021-11-19 21:15:29,177][INFO ][db-checkpoint-thread-#26801%grid-1%][Checkpointer] Checkpoint finished [cpId=ff94ef90-970b-4679-9392-e4107cc9b209, pages=547, markPos=WALPointer [idx=85, fileOff=1030653, len=2048], walSegmentsCovered=[81 - 84], markDuration=15ms, pagesWrite=74ms, fsync=459ms, total=625ms] [21:15:29] : [Step 4/5] [2021-11-19 21:15:29,201][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=90, segIdx=0, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000000.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000090.wal] [21:15:29] : [Step 4/5] [2021-11-19 21:15:29,202][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=81, currSize=10.0 MB, maxSize=20.0 MB] [21:15:29] : [Step 4/5] [2021-11-19 21:15:29,203][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:15:29] : [Step 4/5] [2021-11-19 21:15:29,211][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000000.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000090.wal] [21:15:29] : [Step 4/5] [2021-11-19 21:15:29,222][INFO ][db-checkpoint-thread-#26801%grid-1%][Checkpointer] Checkpoint started [checkpointId=7bd9554b-b252-4c7a-8129-49029c8d5ac9, startPtr=WALPointer [idx=91, fileOff=494608, len=2048], checkpointBeforeLockTime=33ms, checkpointLockWait=4ms, checkpointListenersExecuteTime=2ms, checkpointLockHoldTime=2ms, walCpRecordFsyncDuration=3ms, writeCheckpointEntryDuration=2ms, splitAndSortCpPagesDuration=0ms, pages=534, reason='too big size of WAL without checkpoint'] [21:15:29] : [Step 4/5] [2021-11-19 21:15:29,235][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=91, segIdx=1, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000001.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000091.wal] [21:15:29] : [Step 4/5] [2021-11-19 21:15:29,236][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=82, currSize=10.0 MB, maxSize=20.0 MB] [21:15:29] : [Step 4/5] [2021-11-19 21:15:29,237][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:15:29] : [Step 4/5] [2021-11-19 21:15:29,247][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000001.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000091.wal] [21:15:29] : [Step 4/5] [2021-11-19 21:15:29,259][INFO ][wal-file-archiver%grid-0-#26788%grid-0%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=72, segIdx=2, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000002.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000072.wal] [21:15:29] : [Step 4/5] [2021-11-19 21:15:29,260][INFO ][wal-file-cleaner%grid-0-#26789%grid-0%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=63, currSize=10.0 MB, maxSize=20.0 MB] [21:15:29] : [Step 4/5] [2021-11-19 21:15:29,262][INFO ][wal-file-cleaner%grid-0-#26789%grid-0%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:15:29] : [Step 4/5] [2021-11-19 21:15:29,271][INFO ][wal-file-archiver%grid-0-#26788%grid-0%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000002.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000072.wal] [21:15:29] : [Step 4/5] [2021-11-19 21:15:29,286][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=92, segIdx=2, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000002.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000092.wal] [21:15:29] : [Step 4/5] [2021-11-19 21:15:29,287][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=83, currSize=10.0 MB, maxSize=20.0 MB] [21:15:29] : [Step 4/5] [2021-11-19 21:15:29,288][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:15:29] : [Step 4/5] [2021-11-19 21:15:29,301][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000002.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000092.wal] [21:15:29] : [Step 4/5] [2021-11-19 21:15:29,341][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=93, segIdx=3, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000003.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000093.wal] [21:15:29] : [Step 4/5] [2021-11-19 21:15:29,342][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=84, currSize=10.0 MB, maxSize=20.0 MB] [21:15:29] : [Step 4/5] [2021-11-19 21:15:29,344][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:15:29] : [Step 4/5] [2021-11-19 21:15:29,361][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000003.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000093.wal] [21:15:29] : [Step 4/5] [2021-11-19 21:15:29,364][INFO ][wal-file-archiver%grid-0-#26788%grid-0%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=73, segIdx=3, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000003.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000073.wal] [21:15:29] : [Step 4/5] [2021-11-19 21:15:29,368][INFO ][wal-file-cleaner%grid-0-#26789%grid-0%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=64, currSize=10.0 MB, maxSize=20.0 MB] [21:15:29] : [Step 4/5] [2021-11-19 21:15:29,376][INFO ][wal-file-cleaner%grid-0-#26789%grid-0%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:15:29] : [Step 4/5] [2021-11-19 21:15:29,376][INFO ][wal-file-archiver%grid-0-#26788%grid-0%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000003.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000073.wal] [21:15:29] : [Step 4/5] [2021-11-19 21:15:29,385][INFO ][db-checkpoint-thread-#26801%grid-1%][Checkpointer] Checkpoint finished [cpId=7bd9554b-b252-4c7a-8129-49029c8d5ac9, pages=534, markPos=WALPointer [idx=91, fileOff=494608, len=2048], walSegmentsCovered=[85 - 90], markDuration=8ms, pagesWrite=82ms, fsync=80ms, total=207ms] [21:15:29] : [Step 4/5] [2021-11-19 21:15:29,398][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=94, segIdx=4, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000004.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000094.wal] [21:15:29] : [Step 4/5] [2021-11-19 21:15:29,399][INFO ][db-checkpoint-thread-#26796%grid-0%][Checkpointer] Checkpoint started [checkpointId=85c6ac3b-c202-4caf-8fec-1d3519612195, startPtr=WALPointer [idx=74, fileOff=252386, len=2010], checkpointBeforeLockTime=8ms, checkpointLockWait=1ms, checkpointListenersExecuteTime=4ms, checkpointLockHoldTime=5ms, walCpRecordFsyncDuration=17ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=0ms, pages=345, reason='too big size of WAL without checkpoint'] [21:15:29] : [Step 4/5] [2021-11-19 21:15:29,403][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=85, currSize=10.0 MB, maxSize=20.0 MB] [21:15:29] : [Step 4/5] [2021-11-19 21:15:29,404][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:15:29] : [Step 4/5] [2021-11-19 21:15:29,415][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000004.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000094.wal] [21:15:29] : [Step 4/5] [2021-11-19 21:15:29,424][INFO ][db-checkpoint-thread-#26801%grid-1%][Checkpointer] Checkpoint started [checkpointId=8bebce6b-ad91-4d94-bdee-9ae9e10dee22, startPtr=WALPointer [idx=95, fileOff=623108, len=2048], checkpointBeforeLockTime=18ms, checkpointLockWait=1ms, checkpointListenersExecuteTime=2ms, checkpointLockHoldTime=2ms, walCpRecordFsyncDuration=7ms, writeCheckpointEntryDuration=9ms, splitAndSortCpPagesDuration=0ms, pages=410, reason='too big size of WAL without checkpoint'] [21:15:29] : [Step 4/5] [2021-11-19 21:15:29,440][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=95, segIdx=5, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000005.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000095.wal] [21:15:29] : [Step 4/5] [2021-11-19 21:15:29,441][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=86, currSize=10.0 MB, maxSize=20.0 MB] [21:15:29] : [Step 4/5] [2021-11-19 21:15:29,443][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:15:29]W: [org.apache.ignite:ignite-core] [2021-11-19 21:15:29,450][WARN ][checkpoint-runner-IO-#26809%grid-1%][CheckpointPagesWriterFactory] 6 checkpoint pages were not written yet due to unsuccessful page write lock acquisition and will be retried [21:15:29] : [Step 4/5] [2021-11-19 21:15:29,468][INFO ][wal-file-archiver%grid-0-#26788%grid-0%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=74, segIdx=4, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000004.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000074.wal] [21:15:29] : [Step 4/5] [2021-11-19 21:15:29,470][INFO ][wal-file-cleaner%grid-0-#26789%grid-0%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=65, currSize=10.0 MB, maxSize=20.0 MB] [21:15:29] : [Step 4/5] [2021-11-19 21:15:29,471][INFO ][wal-file-cleaner%grid-0-#26789%grid-0%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:15:29] : [Step 4/5] [2021-11-19 21:15:29,475][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000005.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000095.wal] [21:15:29] : [Step 4/5] [2021-11-19 21:15:29,485][INFO ][db-checkpoint-thread-#26796%grid-0%][Checkpointer] Checkpoint finished [cpId=85c6ac3b-c202-4caf-8fec-1d3519612195, pages=345, markPos=WALPointer [idx=74, fileOff=252386, len=2010], walSegmentsCovered=[69 - 73], markDuration=25ms, pagesWrite=29ms, fsync=55ms, total=118ms] [21:15:29] : [Step 4/5] [2021-11-19 21:15:29,486][INFO ][wal-file-archiver%grid-0-#26788%grid-0%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000004.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000074.wal] [21:15:29] : [Step 4/5] [2021-11-19 21:15:29,498][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=96, segIdx=6, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000006.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000096.wal] [21:15:29] : [Step 4/5] [2021-11-19 21:15:29,499][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=87, currSize=10.0 MB, maxSize=20.0 MB] [21:15:29] : [Step 4/5] [2021-11-19 21:15:29,500][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:15:29] : [Step 4/5] [2021-11-19 21:15:29,513][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000006.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000096.wal] [21:15:29] : [Step 4/5] [2021-11-19 21:15:29,513][INFO ][db-checkpoint-thread-#26796%grid-0%][Checkpointer] Checkpoint started [checkpointId=8d79d8fb-57aa-4db7-b815-a12304834a50, startPtr=WALPointer [idx=75, fileOff=411657, len=2010], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=1ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=10ms, writeCheckpointEntryDuration=15ms, splitAndSortCpPagesDuration=0ms, pages=102, reason='too big size of WAL without checkpoint'] [21:15:29] : [Step 4/5] [2021-11-19 21:15:29,579][INFO ][wal-file-archiver%grid-0-#26788%grid-0%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=75, segIdx=5, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000005.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000075.wal] [21:15:29] : [Step 4/5] [2021-11-19 21:15:29,581][INFO ][wal-file-cleaner%grid-0-#26789%grid-0%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=66, currSize=10.0 MB, maxSize=20.0 MB] [21:15:29] : [Step 4/5] [2021-11-19 21:15:29,582][INFO ][wal-file-cleaner%grid-0-#26789%grid-0%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:15:29] : [Step 4/5] [2021-11-19 21:15:29,592][INFO ][db-checkpoint-thread-#26801%grid-1%][Checkpointer] Checkpoint finished [cpId=8bebce6b-ad91-4d94-bdee-9ae9e10dee22, pages=410, markPos=WALPointer [idx=95, fileOff=623108, len=2048], walSegmentsCovered=[91 - 94], markDuration=20ms, pagesWrite=29ms, fsync=138ms, total=206ms] [21:15:29] : [Step 4/5] [2021-11-19 21:15:29,624][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=97, segIdx=7, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000007.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000097.wal] [21:15:29] : [Step 4/5] [2021-11-19 21:15:29,701][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=88, currSize=10.0 MB, maxSize=20.0 MB] [21:15:29] : [Step 4/5] [2021-11-19 21:15:29,702][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:15:29] : [Step 4/5] [2021-11-19 21:15:29,753][INFO ][wal-file-archiver%grid-0-#26788%grid-0%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000005.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000075.wal] [21:15:29] : [Step 4/5] [2021-11-19 21:15:29,979][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000007.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000097.wal] [21:15:29] : [Step 4/5] [2021-11-19 21:15:29,979][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=98, segIdx=8, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000008.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000098.wal] [21:15:29] : [Step 4/5] [2021-11-19 21:15:29,979][INFO ][db-checkpoint-thread-#26801%grid-1%][Checkpointer] Checkpoint started [checkpointId=0f71e9ba-80fc-4664-a3ff-07edd234be64, startPtr=WALPointer [idx=98, fileOff=625736, len=2048], checkpointBeforeLockTime=108ms, checkpointLockWait=3ms, checkpointListenersExecuteTime=1ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=57ms, writeCheckpointEntryDuration=218ms, splitAndSortCpPagesDuration=0ms, pages=372, reason='too big size of WAL without checkpoint'] [21:15:29] : [Step 4/5] [2021-11-19 21:15:29,980][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=89, currSize=10.0 MB, maxSize=20.0 MB] [21:15:29] : [Step 4/5] [2021-11-19 21:15:29,982][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:15:30] : [Step 4/5] [2021-11-19 21:15:30,121][INFO ][db-checkpoint-thread-#26796%grid-0%][Checkpointer] Checkpoint finished [cpId=8d79d8fb-57aa-4db7-b815-a12304834a50, pages=102, markPos=WALPointer [idx=75, fileOff=411657, len=2010], walSegmentsCovered=[74], markDuration=28ms, pagesWrite=13ms, fsync=593ms, total=635ms] [21:15:30] : [Step 4/5] [2021-11-19 21:15:30,125][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000008.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000098.wal] [21:15:30] : [Step 4/5] [2021-11-19 21:15:30,126][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=99, segIdx=9, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000009.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000099.wal] [21:15:30] : [Step 4/5] [2021-11-19 21:15:30,126][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=90, currSize=10.0 MB, maxSize=20.0 MB] [21:15:30] : [Step 4/5] [2021-11-19 21:15:30,193][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:15:30] : [Step 4/5] [2021-11-19 21:15:30,344][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000009.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000099.wal] [21:15:30] : [Step 4/5] [2021-11-19 21:15:30,345][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=100, segIdx=0, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000000.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000100.wal] [21:15:30] : [Step 4/5] [2021-11-19 21:15:30,346][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=91, currSize=10.0 MB, maxSize=20.0 MB] [21:15:30] : [Step 4/5] [2021-11-19 21:15:30,347][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:15:30] : [Step 4/5] [2021-11-19 21:15:30,360][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000000.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000100.wal] [21:15:30] : [Step 4/5] [2021-11-19 21:15:30,361][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=101, segIdx=1, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000001.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000101.wal] [21:15:30] : [Step 4/5] [2021-11-19 21:15:30,362][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=92, currSize=10.0 MB, maxSize=20.0 MB] [21:15:30] : [Step 4/5] [2021-11-19 21:15:30,364][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:15:30] : [Step 4/5] [2021-11-19 21:15:30,378][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000001.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000101.wal] [21:15:30] : [Step 4/5] [2021-11-19 21:15:30,393][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=102, segIdx=2, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000002.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000102.wal] [21:15:30] : [Step 4/5] [2021-11-19 21:15:30,394][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=93, currSize=10.0 MB, maxSize=20.0 MB] [21:15:30] : [Step 4/5] [2021-11-19 21:15:30,395][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:15:30] : [Step 4/5] [2021-11-19 21:15:30,408][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000002.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000102.wal] [21:15:30] : [Step 4/5] [2021-11-19 21:15:30,486][INFO ][db-checkpoint-thread-#26801%grid-1%][Checkpointer] Checkpoint finished [cpId=0f71e9ba-80fc-4664-a3ff-07edd234be64, pages=372, markPos=WALPointer [idx=98, fileOff=625736, len=2048], walSegmentsCovered=[95 - 97], markDuration=278ms, pagesWrite=107ms, fsync=328ms, total=824ms] [21:15:30] : [Step 4/5] [2021-11-19 21:15:30,512][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=103, segIdx=3, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000003.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000103.wal] [21:15:30] : [Step 4/5] [2021-11-19 21:15:30,513][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=94, currSize=10.0 MB, maxSize=20.0 MB] [21:15:30] : [Step 4/5] [2021-11-19 21:15:30,515][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:15:30] : [Step 4/5] [2021-11-19 21:15:30,525][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000003.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000103.wal] [21:15:30] : [Step 4/5] [2021-11-19 21:15:30,545][INFO ][db-checkpoint-thread-#26801%grid-1%][Checkpointer] Checkpoint started [checkpointId=db08918c-ffea-47aa-ad23-a03b3e6f73b1, startPtr=WALPointer [idx=104, fileOff=382934, len=2048], checkpointBeforeLockTime=38ms, checkpointLockWait=3ms, checkpointListenersExecuteTime=2ms, checkpointLockHoldTime=2ms, walCpRecordFsyncDuration=4ms, writeCheckpointEntryDuration=10ms, splitAndSortCpPagesDuration=1ms, pages=479, reason='too big size of WAL without checkpoint'] [21:15:30] : [Step 4/5] [2021-11-19 21:15:30,707][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=104, segIdx=4, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000004.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000104.wal] [21:15:30] : [Step 4/5] [2021-11-19 21:15:30,711][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=95, currSize=10.0 MB, maxSize=20.0 MB] [21:15:30] : [Step 4/5] [2021-11-19 21:15:30,712][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:15:30] : [Step 4/5] [2021-11-19 21:15:30,847][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000004.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000104.wal] [21:15:30] : [Step 4/5] [2021-11-19 21:15:30,874][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=105, segIdx=5, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000005.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000105.wal] [21:15:30] : [Step 4/5] [2021-11-19 21:15:30,948][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=96, currSize=10.0 MB, maxSize=20.0 MB] [21:15:30] : [Step 4/5] [2021-11-19 21:15:30,949][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:15:31] : [Step 4/5] [2021-11-19 21:15:31,163][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000005.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000105.wal] [21:15:31] : [Step 4/5] [2021-11-19 21:15:31,164][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=106, segIdx=6, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000006.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000106.wal] [21:15:31] : [Step 4/5] [2021-11-19 21:15:31,164][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=97, currSize=10.0 MB, maxSize=20.0 MB] [21:15:31] : [Step 4/5] [2021-11-19 21:15:31,166][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:15:31] : [Step 4/5] [2021-11-19 21:15:31,343][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000006.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000106.wal] [21:15:31] : [Step 4/5] [2021-11-19 21:15:31,344][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=107, segIdx=7, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000007.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000107.wal] [21:15:31] : [Step 4/5] [2021-11-19 21:15:31,345][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=98, currSize=10.0 MB, maxSize=20.0 MB] [21:15:31] : [Step 4/5] [2021-11-19 21:15:31,346][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:15:31] : [Step 4/5] [2021-11-19 21:15:31,358][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000007.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000107.wal] [21:15:31] : [Step 4/5] [2021-11-19 21:15:31,359][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=108, segIdx=8, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000008.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000108.wal] [21:15:31] : [Step 4/5] [2021-11-19 21:15:31,370][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000008.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000108.wal] [21:15:31] : [Step 4/5] [2021-11-19 21:15:31,383][INFO ][db-checkpoint-thread-#26801%grid-1%][Checkpointer] Checkpoint finished [cpId=db08918c-ffea-47aa-ad23-a03b3e6f73b1, pages=479, markPos=WALPointer [idx=104, fileOff=382934, len=2048], walSegmentsCovered=[98 - 103], markDuration=18ms, pagesWrite=246ms, fsync=591ms, total=896ms] [21:15:31] : [Step 4/5] [2021-11-19 21:15:31,383][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=109, segIdx=9, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000009.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000109.wal] [21:15:31] : [Step 4/5] [2021-11-19 21:15:31,383][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=99, currSize=11.0 MB, maxSize=20.0 MB] [21:15:31] : [Step 4/5] [2021-11-19 21:15:31,386][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=10.0 MB, maxSize=20.0 MB] [21:15:31] : [Step 4/5] [2021-11-19 21:15:31,386][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=100, currSize=10.0 MB, maxSize=20.0 MB] [21:15:31] : [Step 4/5] [2021-11-19 21:15:31,388][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:15:31] : [Step 4/5] [2021-11-19 21:15:31,404][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000009.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000109.wal] [21:15:31] : [Step 4/5] [2021-11-19 21:15:31,405][INFO ][db-checkpoint-thread-#26801%grid-1%][Checkpointer] Checkpoint started [checkpointId=cd3a497e-32f4-4818-8faa-57bd0b100e61, startPtr=WALPointer [idx=110, fileOff=382982, len=2048], checkpointBeforeLockTime=3ms, checkpointLockWait=1ms, checkpointListenersExecuteTime=1ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=11ms, writeCheckpointEntryDuration=5ms, splitAndSortCpPagesDuration=1ms, pages=467, reason='too big size of WAL without checkpoint'] [21:15:31] : [Step 4/5] [2021-11-19 21:15:31,405][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=110, segIdx=0, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000000.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000110.wal] [21:15:31] : [Step 4/5] [2021-11-19 21:15:31,407][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=101, currSize=10.0 MB, maxSize=20.0 MB] [21:15:31] : [Step 4/5] [2021-11-19 21:15:31,409][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:15:31] : [Step 4/5] [2021-11-19 21:15:31,419][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000000.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000110.wal] [21:15:31] : [Step 4/5] [2021-11-19 21:15:31,442][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=111, segIdx=1, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000001.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000111.wal] [21:15:31] : [Step 4/5] [2021-11-19 21:15:31,443][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=102, currSize=10.0 MB, maxSize=20.0 MB] [21:15:31] : [Step 4/5] [2021-11-19 21:15:31,444][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:15:31] : [Step 4/5] [2021-11-19 21:15:31,459][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000001.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000111.wal] [21:15:31] : [Step 4/5] [2021-11-19 21:15:31,499][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=112, segIdx=2, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000002.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000112.wal] [21:15:31] : [Step 4/5] [2021-11-19 21:15:31,500][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=103, currSize=10.0 MB, maxSize=20.0 MB] [21:15:31] : [Step 4/5] [2021-11-19 21:15:31,502][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:15:31] : [Step 4/5] [2021-11-19 21:15:31,514][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000002.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000112.wal] [21:15:31] : [Step 4/5] [2021-11-19 21:15:31,514][INFO ][db-checkpoint-thread-#26801%grid-1%][Checkpointer] Checkpoint finished [cpId=cd3a497e-32f4-4818-8faa-57bd0b100e61, pages=467, markPos=WALPointer [idx=110, fileOff=382982, len=2048], walSegmentsCovered=[104 - 109], markDuration=19ms, pagesWrite=36ms, fsync=72ms, total=131ms] [21:15:31] : [Step 4/5] [2021-11-19 21:15:31,537][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=113, segIdx=3, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000003.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000113.wal] [21:15:31] : [Step 4/5] [2021-11-19 21:15:31,538][INFO ][db-checkpoint-thread-#26801%grid-1%][Checkpointer] Checkpoint started [checkpointId=ea49948d-2791-4655-815f-d2e09f3a2410, startPtr=WALPointer [idx=113, fileOff=967793, len=2048], checkpointBeforeLockTime=6ms, checkpointLockWait=1ms, checkpointListenersExecuteTime=2ms, checkpointLockHoldTime=2ms, walCpRecordFsyncDuration=11ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=1ms, pages=333, reason='too big size of WAL without checkpoint'] [21:15:31] : [Step 4/5] [2021-11-19 21:15:31,538][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=104, currSize=10.0 MB, maxSize=20.0 MB] [21:15:31] : [Step 4/5] [2021-11-19 21:15:31,540][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:15:31] : [Step 4/5] [2021-11-19 21:15:31,555][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000003.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000113.wal] [21:15:31] : [Step 4/5] [2021-11-19 21:15:31,578][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=114, segIdx=4, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000004.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000114.wal] [21:15:31] : [Step 4/5] [2021-11-19 21:15:31,581][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=105, currSize=10.0 MB, maxSize=20.0 MB] [21:15:31] : [Step 4/5] [2021-11-19 21:15:31,582][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:15:31] : [Step 4/5] [2021-11-19 21:15:31,601][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000004.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000114.wal] [21:15:31] : [Step 4/5] [2021-11-19 21:15:31,630][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=115, segIdx=5, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000005.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000115.wal] [21:15:31] : [Step 4/5] [2021-11-19 21:15:31,632][INFO ][db-checkpoint-thread-#26801%grid-1%][Checkpointer] Checkpoint finished [cpId=ea49948d-2791-4655-815f-d2e09f3a2410, pages=333, markPos=WALPointer [idx=113, fileOff=967793, len=2048], walSegmentsCovered=[110 - 112], markDuration=15ms, pagesWrite=26ms, fsync=68ms, total=116ms] [21:15:31] : [Step 4/5] [2021-11-19 21:15:31,632][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=106, currSize=10.0 MB, maxSize=20.0 MB] [21:15:31] : [Step 4/5] [2021-11-19 21:15:31,635][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:15:31] : [Step 4/5] [2021-11-19 21:15:31,650][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000005.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000115.wal] [21:15:31] : [Step 4/5] [2021-11-19 21:15:31,659][INFO ][db-checkpoint-thread-#26801%grid-1%][Checkpointer] Checkpoint started [checkpointId=6093ba0b-b6c0-457c-83ca-fb8ca1364452, startPtr=WALPointer [idx=116, fileOff=377119, len=2048], checkpointBeforeLockTime=3ms, checkpointLockWait=1ms, checkpointListenersExecuteTime=1ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=11ms, writeCheckpointEntryDuration=10ms, splitAndSortCpPagesDuration=0ms, pages=267, reason='too big size of WAL without checkpoint'] [21:15:31] : [Step 4/5] [2021-11-19 21:15:31,669][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=116, segIdx=6, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000006.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000116.wal] [21:15:31] : [Step 4/5] [2021-11-19 21:15:31,670][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=107, currSize=10.0 MB, maxSize=20.0 MB] [21:15:31] : [Step 4/5] [2021-11-19 21:15:31,672][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:15:31] : [Step 4/5] [2021-11-19 21:15:31,697][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000006.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000116.wal] [21:15:31] : [Step 4/5] [2021-11-19 21:15:31,730][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=117, segIdx=7, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000007.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000117.wal] [21:15:31] : [Step 4/5] [2021-11-19 21:15:31,731][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=108, currSize=10.0 MB, maxSize=20.0 MB] [21:15:31] : [Step 4/5] [2021-11-19 21:15:31,732][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:15:32] : [Step 4/5] [2021-11-19 21:15:32,115][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000007.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000117.wal] [21:15:32] : [Step 4/5] [2021-11-19 21:15:32,115][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=118, segIdx=8, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000008.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000118.wal] [21:15:32] : [Step 4/5] [2021-11-19 21:15:32,116][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=109, currSize=10.0 MB, maxSize=20.0 MB] [21:15:32] : [Step 4/5] [2021-11-19 21:15:32,118][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:15:32] : [Step 4/5] [2021-11-19 21:15:32,406][INFO ][db-checkpoint-thread-#26801%grid-1%][Checkpointer] Checkpoint finished [cpId=6093ba0b-b6c0-457c-83ca-fb8ca1364452, pages=267, markPos=WALPointer [idx=116, fileOff=377119, len=2048], walSegmentsCovered=[113 - 115], markDuration=23ms, pagesWrite=29ms, fsync=717ms, total=773ms] [21:15:32] : [Step 4/5] [2021-11-19 21:15:32,427][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000008.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000118.wal] [21:15:32] : [Step 4/5] [2021-11-19 21:15:32,428][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=119, segIdx=9, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000009.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000119.wal] [21:15:32] : [Step 4/5] [2021-11-19 21:15:32,432][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=110, currSize=10.0 MB, maxSize=20.0 MB] [21:15:32] : [Step 4/5] [2021-11-19 21:15:32,434][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:15:32] : [Step 4/5] [2021-11-19 21:15:32,672][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000009.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000119.wal] [21:15:32] : [Step 4/5] [2021-11-19 21:15:32,673][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=120, segIdx=0, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000000.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000120.wal] [21:15:32] : [Step 4/5] [2021-11-19 21:15:32,699][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=111, currSize=10.0 MB, maxSize=20.0 MB] [21:15:32] : [Step 4/5] [2021-11-19 21:15:32,702][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:15:32] : [Step 4/5] [2021-11-19 21:15:32,728][INFO ][db-checkpoint-thread-#26801%grid-1%][Checkpointer] Checkpoint started [checkpointId=2e724c65-68bb-451f-ac9e-66421d85379f, startPtr=WALPointer [idx=122, fileOff=225288, len=2048], checkpointBeforeLockTime=2ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=1ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=157ms, writeCheckpointEntryDuration=160ms, splitAndSortCpPagesDuration=1ms, pages=445, reason='too big size of WAL without checkpoint'] [21:15:32] : [Step 4/5] [2021-11-19 21:15:32,913][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000000.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000120.wal] [21:15:32] : [Step 4/5] [2021-11-19 21:15:32,913][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=121, segIdx=1, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000001.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000121.wal] [21:15:32] : [Step 4/5] [2021-11-19 21:15:32,914][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=112, currSize=10.0 MB, maxSize=20.0 MB] [21:15:32] : [Step 4/5] [2021-11-19 21:15:32,916][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:15:32] : [Step 4/5] [2021-11-19 21:15:32,933][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000001.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000121.wal] [21:15:32] : [Step 4/5] [2021-11-19 21:15:32,934][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=122, segIdx=2, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000002.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000122.wal] [21:15:32] : [Step 4/5] [2021-11-19 21:15:32,935][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=113, currSize=10.0 MB, maxSize=20.0 MB] [21:15:32] : [Step 4/5] [2021-11-19 21:15:32,936][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:15:32] : [Step 4/5] [2021-11-19 21:15:32,950][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000002.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000122.wal] [21:15:32] : [Step 4/5] [2021-11-19 21:15:32,951][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=123, segIdx=3, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000003.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000123.wal] [21:15:32] : [Step 4/5] [2021-11-19 21:15:32,952][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=114, currSize=10.0 MB, maxSize=20.0 MB] [21:15:32] : [Step 4/5] [2021-11-19 21:15:32,953][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:15:32] : [Step 4/5] [2021-11-19 21:15:32,969][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000003.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000123.wal] [21:15:32] : [Step 4/5] [2021-11-19 21:15:32,970][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=124, segIdx=4, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000004.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000124.wal] [21:15:32] : [Step 4/5] [2021-11-19 21:15:32,970][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=115, currSize=10.0 MB, maxSize=20.0 MB] [21:15:32] : [Step 4/5] [2021-11-19 21:15:32,971][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:15:32] : [Step 4/5] [2021-11-19 21:15:32,983][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000004.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000124.wal] [21:15:32] : [Step 4/5] [2021-11-19 21:15:32,989][INFO ][db-checkpoint-thread-#26801%grid-1%][Checkpointer] Checkpoint finished [cpId=2e724c65-68bb-451f-ac9e-66421d85379f, pages=445, markPos=WALPointer [idx=122, fileOff=225288, len=2048], walSegmentsCovered=[116 - 121], markDuration=319ms, pagesWrite=133ms, fsync=127ms, total=581ms] [21:15:33] : [Step 4/5] [2021-11-19 21:15:33,000][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=125, segIdx=5, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000005.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000125.wal] [21:15:33] : [Step 4/5] [2021-11-19 21:15:33,001][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=116, currSize=10.0 MB, maxSize=20.0 MB] [21:15:33] : [Step 4/5] [2021-11-19 21:15:33,002][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:15:33] : [Step 4/5] [2021-11-19 21:15:33,020][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000005.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000125.wal] [21:15:33] : [Step 4/5] [2021-11-19 21:15:33,029][INFO ][db-checkpoint-thread-#26801%grid-1%][Checkpointer] Checkpoint started [checkpointId=d8a32c44-0803-4a3a-8440-73bccb80b01e, startPtr=WALPointer [idx=126, fileOff=308677, len=2048], checkpointBeforeLockTime=16ms, checkpointLockWait=7ms, checkpointListenersExecuteTime=1ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=6ms, writeCheckpointEntryDuration=9ms, splitAndSortCpPagesDuration=0ms, pages=373, reason='too big size of WAL without checkpoint'] [21:15:33] : [Step 4/5] [2021-11-19 21:15:33,051][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=126, segIdx=6, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000006.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000126.wal] [21:15:33] : [Step 4/5] [2021-11-19 21:15:33,052][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=117, currSize=10.0 MB, maxSize=20.0 MB] [21:15:33] : [Step 4/5] [2021-11-19 21:15:33,053][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:15:33] : [Step 4/5] [2021-11-19 21:15:33,062][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000006.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000126.wal] [21:15:33] : [Step 4/5] [2021-11-19 21:15:33,155][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=127, segIdx=7, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000007.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000127.wal] [21:15:33] : [Step 4/5] [2021-11-19 21:15:33,164][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=118, currSize=10.0 MB, maxSize=20.0 MB] [21:15:33] : [Step 4/5] [2021-11-19 21:15:33,166][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:15:33] : [Step 4/5] [2021-11-19 21:15:33,295][INFO ][db-checkpoint-thread-#26801%grid-1%][Checkpointer] Checkpoint finished [cpId=d8a32c44-0803-4a3a-8440-73bccb80b01e, pages=373, markPos=WALPointer [idx=126, fileOff=308677, len=2048], walSegmentsCovered=[122 - 125], markDuration=18ms, pagesWrite=28ms, fsync=237ms, total=306ms] [21:15:33] : [Step 4/5] [2021-11-19 21:15:33,340][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000007.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000127.wal] [21:15:33] : [Step 4/5] [2021-11-19 21:15:33,341][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=128, segIdx=8, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000008.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000128.wal] [21:15:33] : [Step 4/5] [2021-11-19 21:15:33,417][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=119, currSize=10.0 MB, maxSize=20.0 MB] [21:15:33] : [Step 4/5] [2021-11-19 21:15:33,419][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:15:33] : [Step 4/5] [2021-11-19 21:15:33,463][INFO ][db-checkpoint-thread-#26801%grid-1%][Checkpointer] Checkpoint started [checkpointId=a7075bd1-22c1-4412-a1e2-d97251a8c407, startPtr=WALPointer [idx=129, fileOff=349558, len=2048], checkpointBeforeLockTime=3ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=40ms, writeCheckpointEntryDuration=123ms, splitAndSortCpPagesDuration=0ms, pages=336, reason='too big size of WAL without checkpoint'] [21:15:33] : [Step 4/5] [2021-11-19 21:15:33,516][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000008.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000128.wal] [21:15:33] : [Step 4/5] [2021-11-19 21:15:33,516][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=129, segIdx=9, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000009.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000129.wal] [21:15:33] : [Step 4/5] [2021-11-19 21:15:33,587][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=120, currSize=10.0 MB, maxSize=20.0 MB] [21:15:33] : [Step 4/5] [2021-11-19 21:15:33,588][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:15:33] : [Step 4/5] [2021-11-19 21:15:33,750][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000009.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000129.wal] [21:15:33] : [Step 4/5] [2021-11-19 21:15:33,751][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=130, segIdx=0, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000000.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000130.wal] [21:15:33] : [Step 4/5] [2021-11-19 21:15:33,752][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=121, currSize=10.0 MB, maxSize=20.0 MB] [21:15:33] : [Step 4/5] [2021-11-19 21:15:33,753][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:15:33] : [Step 4/5] [2021-11-19 21:15:33,879][INFO ][db-checkpoint-thread-#26801%grid-1%][Checkpointer] Checkpoint finished [cpId=a7075bd1-22c1-4412-a1e2-d97251a8c407, pages=336, markPos=WALPointer [idx=129, fileOff=349558, len=2048], walSegmentsCovered=[126 - 128], markDuration=165ms, pagesWrite=23ms, fsync=392ms, total=583ms] [21:15:33] : [Step 4/5] [2021-11-19 21:15:33,903][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000000.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000130.wal] [21:15:33] : [Step 4/5] [2021-11-19 21:15:33,904][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=131, segIdx=1, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000001.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000131.wal] [21:15:33] : [Step 4/5] [2021-11-19 21:15:33,906][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=122, currSize=10.0 MB, maxSize=20.0 MB] [21:15:33] : [Step 4/5] [2021-11-19 21:15:33,908][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:15:34] : [Step 4/5] [2021-11-19 21:15:34,043][INFO ][db-checkpoint-thread-#26801%grid-1%][Checkpointer] Checkpoint started [checkpointId=3625be9b-dc4a-4889-b6c4-caf69059a765, startPtr=WALPointer [idx=133, fileOff=66588, len=2048], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=1ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=56ms, writeCheckpointEntryDuration=105ms, splitAndSortCpPagesDuration=0ms, pages=258, reason='too big size of WAL without checkpoint'] [21:15:34] : [Step 4/5] [2021-11-19 21:15:34,065][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000001.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000131.wal] [21:15:34] : [Step 4/5] [2021-11-19 21:15:34,066][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=132, segIdx=2, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000002.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000132.wal] [21:15:34] : [Step 4/5] [2021-11-19 21:15:34,103][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=123, currSize=10.0 MB, maxSize=20.0 MB] [21:15:34] : [Step 4/5] [2021-11-19 21:15:34,104][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:15:34] : [Step 4/5] [2021-11-19 21:15:34,184][INFO ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][root] Load data finished [21:15:34]W: [org.apache.ignite:ignite-core] [2021-11-19 21:15:34,190][WARN ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][G] Ignite work directory is not provided, automatically resolved to: /opt/buildagent/work/7bc1c54bc719b67c/work [21:15:34] : [Step 4/5] [2021-11-19 21:15:34,192][INFO ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-2] [21:15:34] : [Step 4/5] [21:15:34] : [Step 4/5] >>> __________ ________________ [21:15:34] : [Step 4/5] >>> / _/ ___/ |/ / _/_ __/ __/ [21:15:34] : [Step 4/5] >>> _/ // (7 7 // / / / / _/ [21:15:34] : [Step 4/5] >>> /___/\___/_/|_/___/ /_/ /___/ [21:15:34] : [Step 4/5] >>> [21:15:34] : [Step 4/5] >>> ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:15:34] : [Step 4/5] >>> 2021 Copyright(C) Apache Software Foundation [21:15:34] : [Step 4/5] >>> [21:15:34] : [Step 4/5] >>> Ignite documentation: http://ignite.apache.org [21:15:34] : [Step 4/5] [21:15:34] : [Step 4/5] [2021-11-19 21:15:34,194][INFO ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-2] Config URL: n/a [21:15:34] : [Step 4/5] [2021-11-19 21:15:34,194][INFO ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-2] IgniteConfiguration [igniteInstanceName=grid-2, pubPoolSize=24, svcPoolSize=24, callbackPoolSize=24, stripedPoolSize=24, sysPoolSize=24, mgmtPoolSize=4, dataStreamerPoolSize=24, utilityCachePoolSize=24, utilityCacheKeepAliveTime=60000, p2pPoolSize=2, qryPoolSize=24, buildIdxPoolSize=4, igniteHome=/opt/buildagent/work/7bc1c54bc719b67c, igniteWorkDir=/opt/buildagent/work/7bc1c54bc719b67c/work, mbeanSrv=com.sun.jmx.mbeanserver.JmxMBeanServer@6fe85038, nodeId=20b6f4b9-0c69-4736-8d5a-f36aa10b9002, marsh=BinaryMarshaller [], marshLocJobs=false, daemon=false, p2pEnabled=true, netTimeout=10000, netCompressionLevel=1, sndRetryDelay=1000, sndRetryCnt=3, metricsHistSize=10000, metricsUpdateFreq=1000, metricsExpTime=9223372036854775807, discoSpi=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=0, ackTimeout=0, marsh=null, reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], segPlc=STOP, segResolveAttempts=2, waitForSegOnStart=true, allResolversPassReq=true, segChkFreq=10000, commSpi=TcpCommunicationSpi [connectGate=org.apache.ignite.spi.communication.tcp.internal.ConnectGateway@1261b681, ctxInitLatch=java.util.concurrent.CountDownLatch@a818bc5[Count = 1], stopping=false, clientPool=null, nioSrvWrapper=null, stateProvider=null], evtSpi=MemoryEventStorageSpi [expireAgeMs=9223372036854775807, expireCnt=10000, filter=null], colSpi=NoopCollisionSpi [], deploySpi=LocalDeploymentSpi [], indexingSpi=org.apache.ignite.spi.indexing.noop.NoopIndexingSpi@30f64f37, addrRslvr=null, encryptionSpi=org.apache.ignite.spi.encryption.keystore.KeystoreEncryptionSpi@c42fee2, tracingSpi=org.apache.ignite.spi.tracing.NoopTracingSpi@ff8351e, clientMode=false, rebalanceThreadPoolSize=4, rebalanceTimeout=10000, rebalanceBatchesPrefetchCnt=3, rebalanceThrottle=0, rebalanceBatchSize=524288, txCfg=TransactionConfiguration [txSerEnabled=false, dfltIsolation=REPEATABLE_READ, dfltConcurrency=PESSIMISTIC, dfltTxTimeout=0, txTimeoutOnPartitionMapExchange=0, deadlockTimeout=10000, pessimisticTxLogSize=0, pessimisticTxLogLinger=10000, tmLookupClsName=null, txManagerFactory=null, useJtaSync=false], cacheSanityCheckEnabled=true, discoStartupDelay=60000, deployMode=SHARED, p2pMissedCacheSize=100, locHost=127.0.0.1, timeSrvPortBase=31100, timeSrvPortRange=100, failureDetectionTimeout=10000, sysWorkerBlockedTimeout=null, clientFailureDetectionTimeout=10000, metricsLogFreq=0, connectorCfg=null, odbcCfg=null, warmupClos=null, atomicCfg=AtomicConfiguration [seqReserveSize=1000, cacheMode=PARTITIONED, backups=1, aff=null, grpName=null], classLdr=null, sslCtxFactory=null, platformCfg=null, binaryCfg=null, memCfg=null, pstCfg=null, dsCfg=DataStorageConfiguration [sysRegionInitSize=41943040, sysRegionMaxSize=104857600, pageSize=4096, concLvl=0, dfltDataRegConf=DataRegionConfiguration [name=default, maxSize=104857600, initSize=268435456, swapPath=null, pageEvictionMode=DISABLED, pageReplacementMode=CLOCK, evictionThreshold=0.9, emptyPagesPoolSize=100, metricsEnabled=false, metricsSubIntervalCount=5, metricsRateTimeInterval=60000, persistenceEnabled=true, checkpointPageBufSize=0, lazyMemoryAllocation=true, warmUpCfg=null], dataRegions=null, storagePath=null, checkpointFreq=30000, lockWaitTime=10000, checkpointThreads=4, checkpointWriteOrder=SEQUENTIAL, walHistSize=20, maxWalArchiveSize=20971520, walSegments=10, walSegmentSize=1048576, walPath=db/wal, walArchivePath=db/wal/archive, cdcWalPath=db/wal/cdc, cdcEnabled=false, metricsEnabled=false, walMode=LOG_ONLY, walTlbSize=131072, walBuffSize=0, walFlushFreq=2000, walFsyncDelay=1000, walRecordIterBuffSize=67108864, alwaysWriteFullPages=false, fileIOFactory=org.apache.ignite.internal.processors.cache.persistence.file.AsyncFileIOFactory@1b1222e3, metricsSubIntervalCnt=5, metricsRateTimeInterval=60000, walAutoArchiveAfterInactivity=-1, walForceArchiveTimeout=-1, writeThrottlingEnabled=false, walCompactionEnabled=false, walCompactionLevel=1, checkpointReadLockTimeout=null, walPageCompression=DISABLED, walPageCompressionLevel=null, dfltWarmUpCfg=null, encCfg=org.apache.ignite.configuration.EncryptionConfiguration@44b87b2a, defragmentationThreadPoolSize=4, minWalArchiveSize=-1], snapshotPath=snapshots, activeOnStart=true, activeOnStartPropSetFlag=false, autoActivation=true, autoActivationPropSetFlag=false, clusterStateOnStart=null, sqlConnCfg=null, cliConnCfg=ClientConnectorConfiguration [host=null, port=10800, portRange=100, sockSndBufSize=0, sockRcvBufSize=0, tcpNoDelay=true, maxOpenCursorsPerConn=128, threadPoolSize=24, selectorCnt=12, idleTimeout=0, handshakeTimeout=10000, jdbcEnabled=true, odbcEnabled=true, thinCliEnabled=true, sslEnabled=false, useIgniteSslCtxFactory=true, sslClientAuth=false, sslCtxFactory=null, thinCliCfg=ThinClientConfiguration [maxActiveTxPerConn=100, maxActiveComputeTasksPerConn=0]], mvccVacuumThreadCnt=2, mvccVacuumFreq=5000, authEnabled=false, failureHnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]], commFailureRslvr=null, sqlCfg=SqlConfiguration [longQryWarnTimeout=3000, dfltQryTimeout=0, sqlQryHistSize=1000, validationEnabled=false], asyncContinuationExecutor=null] [21:15:34] : [Step 4/5] [2021-11-19 21:15:34,207][INFO ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-2] Daemon mode: off [21:15:34] : [Step 4/5] [2021-11-19 21:15:34,207][INFO ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-2] OS: Linux 4.15.0-151-generic amd64 [21:15:34] : [Step 4/5] [2021-11-19 21:15:34,207][INFO ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-2] OS user: teamcity [21:15:34] : [Step 4/5] [2021-11-19 21:15:34,208][INFO ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-2] PID: 16724 [21:15:34] : [Step 4/5] [2021-11-19 21:15:34,208][INFO ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-2] Language runtime: Java Platform API Specification ver. 1.8 [21:15:34] : [Step 4/5] [2021-11-19 21:15:34,208][INFO ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-2] VM information: Java(TM) SE Runtime Environment 1.8.0_261-b12 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 25.261-b12 [21:15:34] : [Step 4/5] [2021-11-19 21:15:34,209][INFO ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-2] VM total memory: 1.9GB [21:15:34] : [Step 4/5] [2021-11-19 21:15:34,209][INFO ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-2] Remote Management [restart: off, REST: off, JMX (remote: off)] [21:15:34] : [Step 4/5] [2021-11-19 21:15:34,210][INFO ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-2] Logger: GridTestLog4jLogger [quiet=false, config=null] [21:15:34] : [Step 4/5] [2021-11-19 21:15:34,210][INFO ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-2] IGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c [21:15:34] : [Step 4/5] [2021-11-19 21:15:34,210][INFO ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-2] VM arguments: [-DIGNITE_DUMP_THREADS_ON_FAILURE=false, -DMono=/usr/bin/mono-sgen, -DMono4.0_x64=/usr/lib/mono/4.0, -DMono4.5_x64=/usr/lib/mono/4.5, -DMonoVersion=6.12.0.90, -DSKIP_BUILD=false, -Dagent.home.dir=/opt/buildagent, -Dagent.name=aitc-lin02_03, -Dagent.ownPort=9090, -Dagent.work.dir=/opt/buildagent/work, -Dbuild.number=95, -Dbuild.vcs.number=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.1=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.GitHubApacheIgnite=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dclassworlds.conf=/opt/buildagent/temp/buildTmp/teamcity.m2.conf, -Dcom.jetbrains.maven.watcher.report.file=/opt/buildagent/temp/buildTmp/maven-build-info.xml, -Djava.io.tmpdir=/opt/buildagent/temp/buildTmp, -Dmaven.home=/opt/buildagent/tools/maven3_6, -Dmaven.multiModuleProjectDirectory=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.agent.cpuBenchmark=457, -Dteamcity.agent.dotnet.agent_url=http://localhost:9090/RPC2, -Dteamcity.agent.dotnet.build_id=6278078, -Dteamcity.auth.password=*******, -Dteamcity.auth.userId=TeamCityBuildId=6278078, -Dteamcity.build.changedFiles.file=/opt/buildagent/temp/buildTmp/changedFiles6342607772318147725.txt, -Dteamcity.build.checkoutDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.build.id=6278078, -Dteamcity.build.properties.file=/opt/buildagent/temp/buildTmp/teamcity.build5164517880467851002.properties, -Dteamcity.build.tempDir=/opt/buildagent/temp/buildTmp, -Dteamcity.build.workingDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.buildConfName=Basic 3, -Dteamcity.buildType.id=IgniteTests24Java8_Basic3, -Dteamcity.configuration.properties.file=/opt/buildagent/temp/buildTmp/teamcity.config5591980786735343870.properties, -Dteamcity.maven.userSettings.path=/opt/buildagent/temp/buildTmp/maven_settings_585072866407032347.xml, -Dteamcity.maven.watcher.home=/opt/buildagent/plugins/mavenPlugin/maven-watcher-jdk16, -Dteamcity.projectName=Ignite Tests 2.x (JDK 8/11), -Dteamcity.runner.properties.file=/opt/buildagent/temp/buildTmp/teamcity.runner9098465561618137420.properties, -Dteamcity.tests.recentlyFailedTests.file=/opt/buildagent/temp/buildTmp/testsToRunFirst3891775683130404069.txt, -Dteamcity.version=2021.2 (build 99542), -ea, -Xms2g, -Xmx2g, -XX:+HeapDumpOnOutOfMemoryError, -DIGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_TEST_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_UPDATE_NOTIFIER=false, -DIGNITE_NO_DISCO_ORDER=true, -DIGNITE_PERFORMANCE_SUGGESTIONS_DISABLED=true, -Djava.net.preferIPv4Stack=true, -DTEST_SCALE_FACTOR=1.0, -DIGNITE_TEST_PROP_LOG4J_FILE=log4j-tc-test.xml, -DIGNITE_QUIET=false, -DIGNITE_MARSHAL_BUFFERS_RECHECK=1000, -Dmaven.repo.local=/opt/buildagent/.m2/repository] [21:15:34] : [Step 4/5] [2021-11-19 21:15:34,217][INFO ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-2] System cache's DataRegion size is configured to 40 MB. Use DataStorageConfiguration.systemRegionInitialSize property to change the setting. [21:15:34] : [Step 4/5] [2021-11-19 21:15:34,217][INFO ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-2] Configured caches [in 'sysMemPlc' dataRegion: ['ignite-sys-cache']] [21:15:34]W: [org.apache.ignite:ignite-core] [2021-11-19 21:15:34,218][WARN ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-2] Peer class loading is enabled (disable it in production for performance and deployment consistency reasons) [21:15:34] : [Step 4/5] [2021-11-19 21:15:34,218][INFO ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-2] 3-rd party licenses can be found at: /opt/buildagent/work/7bc1c54bc719b67c/libs/licenses [21:15:34] : [Step 4/5] [2021-11-19 21:15:34,224][INFO ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] Configured plugins: [21:15:34] : [Step 4/5] [2021-11-19 21:15:34,293][INFO ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- StanByClusterTestProvider 1.0 [21:15:34] : [Step 4/5] [2021-11-19 21:15:34,294][INFO ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:15:34] : [Step 4/5] [2021-11-19 21:15:34,294][INFO ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] [21:15:34] : [Step 4/5] [2021-11-19 21:15:34,295][INFO ][db-checkpoint-thread-#26801%grid-1%][Checkpointer] Checkpoint finished [cpId=3625be9b-dc4a-4889-b6c4-caf69059a765, pages=258, markPos=WALPointer [idx=133, fileOff=66588, len=2048], walSegmentsCovered=[129 - 132], markDuration=163ms, pagesWrite=16ms, fsync=235ms, total=415ms] [21:15:34] : [Step 4/5] [2021-11-19 21:15:34,295][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000002.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000132.wal] [21:15:34] : [Step 4/5] [2021-11-19 21:15:34,297][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=133, segIdx=3, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000003.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000133.wal] [21:15:34] : [Step 4/5] [2021-11-19 21:15:34,297][INFO ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- PageMemory tracker plugin 1.0 [21:15:34] : [Step 4/5] [2021-11-19 21:15:34,298][INFO ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:15:34] : [Step 4/5] [2021-11-19 21:15:34,298][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=124, currSize=10.0 MB, maxSize=20.0 MB] [21:15:34] : [Step 4/5] [2021-11-19 21:15:34,298][INFO ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] [21:15:34] : [Step 4/5] [2021-11-19 21:15:34,299][INFO ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- TestDistibutedConfigurationPlugin 1.0 [21:15:34] : [Step 4/5] [2021-11-19 21:15:34,300][INFO ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:15:34] : [Step 4/5] [2021-11-19 21:15:34,300][INFO ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] [21:15:34] : [Step 4/5] [2021-11-19 21:15:34,300][INFO ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- NodeValidationPluginProvider 1.0 [21:15:34] : [Step 4/5] [2021-11-19 21:15:34,301][INFO ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:15:34] : [Step 4/5] [2021-11-19 21:15:34,301][INFO ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] [21:15:34] : [Step 4/5] [2021-11-19 21:15:34,300][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:15:34] : [Step 4/5] [2021-11-19 21:15:34,301][INFO ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][FailureProcessor] Configured failure handler: [hnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]]] [21:15:34] : [Step 4/5] [2021-11-19 21:15:34,314][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000003.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000133.wal] [21:15:34] : [Step 4/5] [2021-11-19 21:15:34,323][INFO ][db-checkpoint-thread-#26801%grid-1%][Checkpointer] Checkpoint started [checkpointId=c8660259-52eb-4a28-bb46-c77654645537, startPtr=WALPointer [idx=134, fileOff=900603, len=2048], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=1ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=15ms, writeCheckpointEntryDuration=10ms, splitAndSortCpPagesDuration=0ms, pages=117, reason='too big size of WAL without checkpoint'] [21:15:34] : [Step 4/5] [2021-11-19 21:15:34,339][INFO ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][TestRecordingCommunicationSpi] Successfully bound communication NIO server to TCP port [port=47102, locHost=/127.0.0.1, selectorsCnt=12, selectorSpins=0, pairedConn=false] [21:15:34]W: [org.apache.ignite:ignite-core] [2021-11-19 21:15:34,340][WARN ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][TestRecordingCommunicationSpi] Message queue limit is set to 0 which may lead to potential OOMEs when running cache operations in FULL_ASYNC or PRIMARY_SYNC modes due to message queues growth on sender and receiver sides. [21:15:34] : [Step 4/5] [2021-11-19 21:15:34,344][INFO ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][GridCollisionManager] Collision resolution is disabled (all jobs will be activated upon arrival). [21:15:34] : [Step 4/5] [2021-11-19 21:15:34,345][INFO ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-2] Security status [authentication=off, sandbox=off, tls/ssl=off] [21:15:34] : [Step 4/5] [2021-11-19 21:15:34,348][INFO ][db-checkpoint-thread-#26801%grid-1%][Checkpointer] Checkpoint finished [cpId=c8660259-52eb-4a28-bb46-c77654645537, pages=117, markPos=WALPointer [idx=134, fileOff=900603, len=2048], walSegmentsCovered=[133], markDuration=27ms, pagesWrite=12ms, fsync=12ms, total=52ms] [21:15:34] : [Step 4/5] [2021-11-19 21:15:34,404][INFO ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:15:34] : [Step 4/5] [2021-11-19 21:15:34,493][INFO ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][MaintenanceProcessor] Resolved store directory for node persistent data: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_2 [21:15:34] : [Step 4/5] [2021-11-19 21:15:34,494][INFO ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][CacheObjectBinaryProcessorImpl] Resolved directory for serialized binary metadata: /opt/buildagent/work/7bc1c54bc719b67c/work/db/binary_meta/grid_2 [21:15:34] : [Step 4/5] [2021-11-19 21:15:34,497][INFO ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_2 [21:15:34] : [Step 4/5] [2021-11-19 21:15:34,498][INFO ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][FileWriteAheadLogManager] Resolved write ahead log work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_2 [21:15:34] : [Step 4/5] [2021-11-19 21:15:34,498][INFO ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][FileWriteAheadLogManager] Resolved write ahead log archive directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_2 [21:15:34] : [Step 4/5] [2021-11-19 21:15:34,508][INFO ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_2/0000000000000000.wal [21:15:34] : [Step 4/5] [2021-11-19 21:15:34,509][INFO ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][FileHandleManagerImpl] Initialized write-ahead log manager [mode=LOG_ONLY] [21:15:34] : [Step 4/5] [2021-11-19 21:15:34,516][INFO ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Configured data regions initialized successfully [total=5] [21:15:34] : [Step 4/5] [2021-11-19 21:15:34,518][INFO ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][IgniteSnapshotManager] Resolved snapshot work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/snapshots [21:15:34] : [Step 4/5] [2021-11-19 21:15:34,518][INFO ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][IgniteSnapshotManager] Resolved temp directory for snapshot creation: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_2/snp [21:15:34] : [Step 4/5] [2021-11-19 21:15:34,521][INFO ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][ClientListenerProcessor] Client connector processor has started on TCP port 10802 [21:15:34] : [Step 4/5] [2021-11-19 21:15:34,523][INFO ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-2] Non-loopback local IPs: 172.17.0.4 [21:15:34] : [Step 4/5] [2021-11-19 21:15:34,523][INFO ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-2] Enabled local MACs: 0242AC110004 [21:15:34] : [Step 4/5] [2021-11-19 21:15:34,524][INFO ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:15:34] : [Step 4/5] [2021-11-19 21:15:34,526][INFO ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:15:34] : [Step 4/5] [2021-11-19 21:15:34,526][INFO ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:15:34] : [Step 4/5] [2021-11-19 21:15:34,534][INFO ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Applying lost metastore updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:15:34] : [Step 4/5] [2021-11-19 21:15:34,539][INFO ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=0 ms] [21:15:34] : [Step 4/5] [2021-11-19 21:15:34,539][INFO ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Restoring partition state for local groups. [21:15:34] : [Step 4/5] [2021-11-19 21:15:34,540][INFO ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=0, partitionsProcessed=0, time=0ms] [21:15:34] : [Step 4/5] [2021-11-19 21:15:34,540][INFO ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][GridEncryptionManager] Encryption keys loaded from metastore. [grps=, masterKeyName=ignite.master.key] [21:15:34] : [Step 4/5] [2021-11-19 21:15:34,542][INFO ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][ClusterProcessor] Cluster ID and tag has been read from metastorage: null [21:15:34] : [Step 4/5] [2021-11-19 21:15:34,542][INFO ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][IgniteClusterImpl] Shutdown policy was updated [oldVal=null, newVal=null] [21:15:34] : [Step 4/5] [2021-11-19 21:15:34,543][INFO ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Checkpoint frequency deviation changed [oldVal=null, newVal=null] [21:15:34] : [Step 4/5] [2021-11-19 21:15:34,553][INFO ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][FilePageStoreManager] Cleanup cache stores [total=1, left=0, cleanFiles=false] [21:15:34] : [Step 4/5] [2021-11-19 21:15:34,556][INFO ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:15:34] : [Step 4/5] [2021-11-19 21:15:34,558][INFO ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:15:34] : [Step 4/5] [2021-11-19 21:15:34,560][INFO ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:15:34] : [Step 4/5] [2021-11-19 21:15:34,561][INFO ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Data Regions Started: 5 [21:15:34] : [Step 4/5] [2021-11-19 21:15:34,561][INFO ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] ^-- sysMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:15:34] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:15:34] : [Step 4/5] ^-- default region [type=default, persistence=true, lazyAlloc=true, [21:15:34] : [Step 4/5] ... initCfg=100MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB, allocTotal=0MB] [21:15:34] : [Step 4/5] ^-- metastoreMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:15:34] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:15:34] : [Step 4/5] ^-- TxLog region [type=internal, persistence=true, lazyAlloc=false, [21:15:34] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:15:34] : [Step 4/5] ^-- volatileDsMemPlc region [type=user, persistence=false, lazyAlloc=true, [21:15:34] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB] [21:15:34] : [Step 4/5] ^-- Ignite persistence [used=0MB] [21:15:34] : [Step 4/5] [21:15:34] : [Step 4/5] [2021-11-19 21:15:34,563][INFO ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Starting binary memory restore for: [-2100569601] [21:15:34] : [Step 4/5] [2021-11-19 21:15:34,571][INFO ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:15:34] : [Step 4/5] [2021-11-19 21:15:34,571][INFO ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:15:34] : [Step 4/5] [2021-11-19 21:15:34,573][INFO ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_2/0000000000000000.wal, offset=0, ver=2] [21:15:34] : [Step 4/5] [2021-11-19 21:15:34,577][INFO ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Started cache in recovery mode [name=ignite-sys-cache, id=-2100569601, dataRegionName=sysMemPlc, mode=REPLICATED, atomicity=TRANSACTIONAL, backups=2147483647, mvcc=false] [21:15:34] : [Step 4/5] [2021-11-19 21:15:34,578][INFO ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Binary recovery performed in 15 ms. [21:15:34] : [Step 4/5] [2021-11-19 21:15:34,578][INFO ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:15:34] : [Step 4/5] [2021-11-19 21:15:34,578][INFO ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Applying lost cache updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:15:34] : [Step 4/5] [2021-11-19 21:15:34,584][INFO ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=10 ms] [21:15:34] : [Step 4/5] [2021-11-19 21:15:34,584][INFO ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Restoring partition state for local groups. [21:15:34] : [Step 4/5] [2021-11-19 21:15:34,620][INFO ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=1, partitionsProcessed=100, time=30ms] [21:15:34] : [Step 4/5] [2021-11-19 21:15:34,986][INFO ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][TestTcpDiscoverySpi] Successfully bound to TCP port [port=47502, localHost=localhost/127.0.0.1, locNodeId=20b6f4b9-0c69-4736-8d5a-f36aa10b9002] [21:15:34] : [Step 4/5] [2021-11-19 21:15:34,991][INFO ][tcp-disco-srvr-[:47500]-#1400%grid-0%-#26659%grid-0%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=51209] [21:15:34] : [Step 4/5] [2021-11-19 21:15:34,991][INFO ][tcp-disco-srvr-[:47500]-#1400%grid-0%-#26659%grid-0%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=51209] [21:15:34] : [Step 4/5] [2021-11-19 21:15:34,992][INFO ][tcp-disco-sock-reader-[]-#1415%grid-0%-#26933%grid-0%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:51209, rmtPort=51209] [21:15:34] : [Step 4/5] [2021-11-19 21:15:34,993][INFO ][tcp-disco-sock-reader-[20b6f4b9 127.0.0.1:51209]-#1415%grid-0%-#26933%grid-0%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=20b6f4b9-0c69-4736-8d5a-f36aa10b9002, rmtAddr=/127.0.0.1:51209] [21:15:34] : [Step 4/5] [2021-11-19 21:15:34,995][INFO ][tcp-disco-srvr-[:47502]-#1414%grid-2%-#26932%grid-2%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=53859] [21:15:34] : [Step 4/5] [2021-11-19 21:15:34,995][INFO ][tcp-disco-srvr-[:47502]-#1414%grid-2%-#26932%grid-2%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=53859] [21:15:34] : [Step 4/5] [2021-11-19 21:15:34,996][INFO ][tcp-disco-sock-reader-[]-#1416%grid-2%-#26934%grid-2%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:53859, rmtPort=53859] [21:15:34] : [Step 4/5] [2021-11-19 21:15:34,996][INFO ][tcp-disco-sock-reader-[]-#1416%grid-2%-#26934%grid-2%][TestTcpDiscoverySpi] Received ping request from the remote node [rmtNodeId=008cb00a-6a9b-4c09-a154-85082cd15000, rmtAddr=/127.0.0.1:53859, rmtPort=53859] [21:15:34] : [Step 4/5] [2021-11-19 21:15:34,997][INFO ][tcp-disco-sock-reader-[]-#1416%grid-2%-#26934%grid-2%][TestTcpDiscoverySpi] Finished writing ping response [rmtNodeId=008cb00a-6a9b-4c09-a154-85082cd15000, rmtAddr=/127.0.0.1:53859, rmtPort=53859] [21:15:34] : [Step 4/5] [2021-11-19 21:15:34,997][INFO ][tcp-disco-sock-reader-[20b6f4b9 127.0.0.1:51209]-#1415%grid-0%-#26933%grid-0%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:51209, rmtPort=51209, rmtNodeId=20b6f4b9-0c69-4736-8d5a-f36aa10b9002] [21:15:34] : [Step 4/5] [2021-11-19 21:15:34,997][INFO ][tcp-disco-sock-reader-[]-#1416%grid-2%-#26934%grid-2%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:53859, rmtPort=53859, rmtNodeId=null] [21:15:35] : [Step 4/5] [2021-11-19 21:15:34,999][INFO ][tcp-disco-msg-worker-[1085686a 127.0.0.1:47501 crd]-#1399%grid-0%-#26658%grid-0%][GridEncryptionManager] Joining node doesn't have stored group keys [node=20b6f4b9-0c69-4736-8d5a-f36aa10b9002] [21:15:35] : [Step 4/5] [2021-11-19 21:15:35,008][INFO ][tcp-disco-msg-worker-[008cb00a 127.0.0.1:47500]-#1404%grid-1%-#26777%grid-1%][TestTcpDiscoverySpi] New next node [newNext=TcpDiscoveryNode [id=20b6f4b9-0c69-4736-8d5a-f36aa10b9002, consistentId=grid-2, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47502], discPort=47502, order=0, intOrder=3, lastExchangeTime=1637345734999, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false]] [21:15:35] : [Step 4/5] [2021-11-19 21:15:35,009][INFO ][tcp-disco-sock-reader-[1085686a 127.0.0.1:41673]-#1409%grid-0%-#26782%grid-0%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:41673, rmtPort=41673, rmtNodeId=1085686a-9887-4e3d-9d8b-a64775ae4001] [21:15:35] : [Step 4/5] [2021-11-19 21:15:35,009][INFO ][tcp-disco-srvr-[:47502]-#1414%grid-2%-#26932%grid-2%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=46319] [21:15:35] : [Step 4/5] [2021-11-19 21:15:35,010][INFO ][tcp-disco-srvr-[:47502]-#1414%grid-2%-#26932%grid-2%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=46319] [21:15:35] : [Step 4/5] [2021-11-19 21:15:35,010][INFO ][tcp-disco-sock-reader-[]-#1417%grid-2%-#26935%grid-2%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:46319, rmtPort=46319] [21:15:35] : [Step 4/5] [2021-11-19 21:15:35,011][INFO ][tcp-disco-sock-reader-[1085686a 127.0.0.1:46319]-#1417%grid-2%-#26935%grid-2%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=1085686a-9887-4e3d-9d8b-a64775ae4001, rmtAddr=/127.0.0.1:46319] [21:15:35] : [Step 4/5] [2021-11-19 21:15:35,014][INFO ][tcp-disco-msg-worker-[]-#1413%grid-2%-#26931%grid-2%][TestTcpDiscoverySpi] New next node [newNext=TcpDiscoveryNode [id=008cb00a-6a9b-4c09-a154-85082cd15000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345735009, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false]] [21:15:35] : [Step 4/5] [2021-11-19 21:15:35,015][INFO ][tcp-disco-srvr-[:47500]-#1400%grid-0%-#26659%grid-0%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=55181] [21:15:35] : [Step 4/5] [2021-11-19 21:15:35,016][INFO ][tcp-disco-srvr-[:47500]-#1400%grid-0%-#26659%grid-0%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=55181] [21:15:35] : [Step 4/5] [2021-11-19 21:15:35,016][INFO ][tcp-disco-sock-reader-[]-#1418%grid-0%-#26936%grid-0%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:55181, rmtPort=55181] [21:15:35] : [Step 4/5] [2021-11-19 21:15:35,017][INFO ][tcp-disco-sock-reader-[20b6f4b9 127.0.0.1:55181]-#1418%grid-0%-#26936%grid-0%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=20b6f4b9-0c69-4736-8d5a-f36aa10b9002, rmtAddr=/127.0.0.1:55181] [21:15:35] : [Step 4/5] [2021-11-19 21:15:35,020][INFO ][disco-event-worker-#26661%grid-0%][GridDiscoveryManager] Added new node to topology: TcpDiscoveryNode [id=20b6f4b9-0c69-4736-8d5a-f36aa10b9002, consistentId=grid-2, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47502], discPort=47502, order=3, intOrder=3, lastExchangeTime=1637345734988, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false] [21:15:35] : [Step 4/5] [2021-11-19 21:15:35,021][INFO ][disco-event-worker-#26661%grid-0%][GridDiscoveryManager] Topology snapshot [ver=3, locNode=008cb00a, servers=3, clients=0, state=ACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=008cb00a-6a9b-4c09-a154-85082cd15000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=1085686a-9887-4e3d-9d8b-a64775ae4001, consistentId=grid-1, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=20b6f4b9-0c69-4736-8d5a-f36aa10b9002, consistentId=grid-2, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:15:35] : [Step 4/5] [2021-11-19 21:15:35,023][INFO ][disco-event-worker-#26661%grid-0%][GridDiscoveryManager] ^-- Baseline [id=0, size=2, online=2, offline=0] [21:15:35] : [Step 4/5] [2021-11-19 21:15:35,021][INFO ][disco-event-worker-#26784%grid-1%][GridDiscoveryManager] Added new node to topology: TcpDiscoveryNode [id=20b6f4b9-0c69-4736-8d5a-f36aa10b9002, consistentId=grid-2, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47502], discPort=47502, order=3, intOrder=3, lastExchangeTime=1637345734999, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false] [21:15:35] : [Step 4/5] [2021-11-19 21:15:35,024][INFO ][exchange-worker-#26662%grid-0%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], crd=true, evt=NODE_JOINED, evtNode=20b6f4b9-0c69-4736-8d5a-f36aa10b9002, customEvt=null, allowMerge=true, exchangeFreeSwitch=false] [21:15:35] : [Step 4/5] [2021-11-19 21:15:35,024][INFO ][disco-event-worker-#26784%grid-1%][GridDiscoveryManager] Topology snapshot [ver=3, locNode=1085686a, servers=3, clients=0, state=ACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=008cb00a-6a9b-4c09-a154-85082cd15000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=1085686a-9887-4e3d-9d8b-a64775ae4001, consistentId=grid-1, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=20b6f4b9-0c69-4736-8d5a-f36aa10b9002, consistentId=grid-2, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:15:35] : [Step 4/5] [2021-11-19 21:15:35,026][INFO ][tcp-disco-msg-worker-[008cb00a 127.0.0.1:47500]-#1413%grid-2%-#26931%grid-2%][GridEncryptionManager] Store group key received from coordinator [grp=1613773252, keyId=0] [21:15:35] : [Step 4/5] [2021-11-19 21:15:35,025][INFO ][exchange-worker-#26662%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], waitTime=0ms, futInfo=NA, mode=DISTRIBUTED] [21:15:35] : [Step 4/5] [2021-11-19 21:15:35,026][INFO ][disco-event-worker-#26784%grid-1%][GridDiscoveryManager] ^-- Baseline [id=0, size=2, online=2, offline=0] [21:15:35] : [Step 4/5] [2021-11-19 21:15:35,027][INFO ][tcp-disco-msg-worker-[008cb00a 127.0.0.1:47500]-#1413%grid-2%-#26931%grid-2%][ClusterProcessor] elated_lamarr [21:15:35] : [Step 4/5] [2021-11-19 21:15:35,028][INFO ][tcp-disco-msg-worker-[008cb00a 127.0.0.1:47500]-#1413%grid-2%-#26931%grid-2%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustEnabled' was changed from 'null' to 'false' [21:15:35] : [Step 4/5] [2021-11-19 21:15:35,028][INFO ][tcp-disco-msg-worker-[008cb00a 127.0.0.1:47500]-#1413%grid-2%-#26931%grid-2%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustTimeout' was changed from 'null' to '300000' [21:15:35] : [Step 4/5] [2021-11-19 21:15:35,028][INFO ][tcp-disco-msg-worker-[008cb00a 127.0.0.1:47500]-#1413%grid-2%-#26931%grid-2%][IgniteTxManager] Transactions parameter 'longOperationsDumpTimeout' was changed from 'null' to '60000' [21:15:35] : [Step 4/5] [2021-11-19 21:15:35,029][INFO ][tcp-disco-msg-worker-[008cb00a 127.0.0.1:47500]-#1413%grid-2%-#26931%grid-2%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpThreshold' was changed from 'null' to '0' [21:15:35] : [Step 4/5] [2021-11-19 21:15:35,029][INFO ][tcp-disco-msg-worker-[008cb00a 127.0.0.1:47500]-#1413%grid-2%-#26931%grid-2%][IgniteTxManager] Transactions parameter 'transactionTimeDumpSamplesCoefficient' was changed from 'null' to '0.0' [21:15:35] : [Step 4/5] [2021-11-19 21:15:35,030][INFO ][tcp-disco-msg-worker-[008cb00a 127.0.0.1:47500]-#1413%grid-2%-#26931%grid-2%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpSamplesPerSecondLimit' was changed from 'null' to '5' [21:15:35] : [Step 4/5] [2021-11-19 21:15:35,030][INFO ][tcp-disco-msg-worker-[008cb00a 127.0.0.1:47500]-#1413%grid-2%-#26931%grid-2%][IgniteTxManager] Transactions parameter 'collisionsDumpInterval' was changed from 'null' to '1000' [21:15:35] : [Step 4/5] [2021-11-19 21:15:35,031][INFO ][tcp-disco-msg-worker-[008cb00a 127.0.0.1:47500]-#1413%grid-2%-#26931%grid-2%][IgniteTxManager] Transactions parameter 'txOwnerDumpRequestsAllowed' was changed from 'null' to 'true' [21:15:35] : [Step 4/5] [2021-11-19 21:15:35,031][INFO ][tcp-disco-msg-worker-[008cb00a 127.0.0.1:47500]-#1413%grid-2%-#26931%grid-2%][GridCacheDatabaseSharedManager] Historical rebalance WAL threshold changed [property=historical.rebalance.threshold, oldVal=null, newVal=500] [21:15:35] : [Step 4/5] [2021-11-19 21:15:35,028][INFO ][exchange-worker-#26785%grid-1%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], crd=false, evt=NODE_JOINED, evtNode=20b6f4b9-0c69-4736-8d5a-f36aa10b9002, customEvt=null, allowMerge=true, exchangeFreeSwitch=false] [21:15:35] : [Step 4/5] [2021-11-19 21:15:35,033][INFO ][exchange-worker-#26785%grid-1%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], waitTime=0ms, futInfo=NA, mode=DISTRIBUTED] [21:15:35] : [Step 4/5] [2021-11-19 21:15:35,032][INFO ][disco-notifier-worker-#26930%grid-2%][MvccProcessorImpl] Assigned mvcc coordinator [crd=MvccCoordinator [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], nodeId=008cb00a-6a9b-4c09-a154-85082cd15000, ver=1637345715983, local=false, initialized=false]] [21:15:35] : [Step 4/5] [2021-11-19 21:15:35,036][INFO ][exchange-worker-#26662%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partitions release latch: ServerLatch [permits=0, pendingAcks=HashSet [], super=CompletableLatch [id=CompletableLatchUid [id=exchange, topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0]]]] [21:15:35] : [Step 4/5] [2021-11-19 21:15:35,037][INFO ][exchange-worker-#26662%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:15:35] : [Step 4/5] [2021-11-19 21:15:35,038][INFO ][exchange-worker-#26785%grid-1%][GridDhtPartitionsExchangeFuture] Finished waiting for partitions release latch: ClientLatch [coordinator=TcpDiscoveryNode [id=008cb00a-6a9b-4c09-a154-85082cd15000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345717070, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], ackSent=true, super=CompletableLatch [id=CompletableLatchUid [id=exchange, topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0]]]] [21:15:35] : [Step 4/5] [2021-11-19 21:15:35,040][INFO ][exchange-worker-#26785%grid-1%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:15:35] : [Step 4/5] [2021-11-19 21:15:35,043][INFO ][exchange-worker-#26785%grid-1%][GridCacheDatabaseSharedManager] Cache groups with earliest reserved checkpoint and a reason why a previous checkpoint was inapplicable: [[[grpId=1613773252, grpName=encrypted, cp=(d8a32c44-0803-4a3a-8440-73bccb80b01e, 11/19/2021 21:15:32)], reason=Reserved checkpoint is the oldest in history]] [21:15:35] : [Step 4/5] [2021-11-19 21:15:35,044][INFO ][exchange-worker-#26785%grid-1%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], crd=false] [21:15:35] : [Step 4/5] [2021-11-19 21:15:35,037][INFO ][disco-notifier-worker-#26930%grid-2%][GridClusterStateProcessor] Local node is not included in Baseline Topology and will not be used for data storage. Use control.(sh|bat) script or IgniteCluster interface to include the node to Baseline Topology. [21:15:35] : [Step 4/5] [2021-11-19 21:15:35,040][INFO ][exchange-worker-#26662%grid-0%][GridCacheDatabaseSharedManager] Cache groups with earliest reserved checkpoint and a reason why a previous checkpoint was inapplicable: [[[grpId=1613773252, grpName=encrypted, cp=(56b8b7eb-5403-4139-82be-95550fc65811, 11/19/2021 21:15:28)], reason=Reserved checkpoint is the oldest in history]] [21:15:35] : [Step 4/5] [2021-11-19 21:15:35,050][INFO ][sys-#26908%grid-2%][ClusterProcessor] Writing cluster ID and tag to metastorage on ready for write ClusterIdAndTag [id=ff5290fc-e3c4-4d9f-988a-68e45d1ee9f7, tag=elated_lamarr] [21:15:35] : [Step 4/5] [2021-11-19 21:15:35,051][INFO ][exchange-worker-#26662%grid-0%][GridDhtPartitionsExchangeFuture] Coordinator received single message [ver=AffinityTopologyVersion [topVer=3, minorTopVer=0], node=1085686a-9887-4e3d-9d8b-a64775ae4001, remainingNodes=1, allReceived=false] [21:15:35] : [Step 4/5] [2021-11-19 21:15:35,051][INFO ][exchange-worker-#26662%grid-0%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], crd=true] [21:15:35] : [Step 4/5] [2021-11-19 21:15:35,060][INFO ][exchange-worker-#26939%grid-2%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], crd=false, evt=NODE_JOINED, evtNode=20b6f4b9-0c69-4736-8d5a-f36aa10b9002, customEvt=null, allowMerge=true, exchangeFreeSwitch=false] [21:15:35] : [Step 4/5] [2021-11-19 21:15:35,061][INFO ][exchange-worker-#26939%grid-2%][GridCacheProcessor] Stopped cache [cacheName=ignite-sys-cache] [21:15:35] : [Step 4/5] [2021-11-19 21:15:35,062][INFO ][exchange-worker-#26939%grid-2%][GridCacheDatabaseSharedManager] Page memory sysMemPlc for CacheGroupDescriptor [grpId=-2100569601, grpName=null, startTopVer=null, rcvdFrom=008cb00a-6a9b-4c09-a154-85082cd15000, deploymentId=89a3e593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, caches=SingletonMap {ignite-sys-cache=-2100569601}, rcvdFromVer=null, persistenceEnabled=true, walEnabled=true, cacheCfgEnrichment=CacheConfigurationEnrichment [fieldClassNames=HashMap {storeFactory=null, storeSesLsnrs=null, evictFilter=null, interceptor=null, evictPlcFactory=null}], cacheCfgEnriched=false, cacheName=ignite-sys-cache] has invalidated. [21:15:35] : [Step 4/5] [2021-11-19 21:15:35,063][INFO ][exchange-worker-#26939%grid-2%][GridCacheDatabaseSharedManager] Page memory default for CacheGroupDescriptor [grpId=1613773252, grpName=null, startTopVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], rcvdFrom=008cb00a-6a9b-4c09-a154-85082cd15000, deploymentId=96b3e593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, caches=SingletonMap {encrypted=1613773252}, rcvdFromVer=null, persistenceEnabled=true, walEnabled=true, cacheCfgEnrichment=CacheConfigurationEnrichment [fieldClassNames=HashMap {storeFactory=null, storeSesLsnrs=null, evictFilter=null, interceptor=null, evictPlcFactory=null}], cacheCfgEnriched=false, cacheName=encrypted] has invalidated. [21:15:35] : [Step 4/5] [2021-11-19 21:15:35,064][INFO ][exchange-worker-#26939%grid-2%][FilePageStoreManager] Cache stores cleanup started asynchronously [21:15:35] : [Step 4/5] [2021-11-19 21:15:35,064][INFO ][exchange-worker-#26939%grid-2%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_2 [21:15:35] : [Step 4/5] [2021-11-19 21:15:35,218][INFO ][async-file-store-cleanup-task-4-#26940%grid-2%][FilePageStoreManager] Cleanup cache stores [total=2, left=1, cleanFiles=true] [21:15:35] : [Step 4/5] [2021-11-19 21:15:35,220][INFO ][exchange-worker-#26939%grid-2%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_2/0000000000000000.wal, offset=8795, ver=2] [21:15:35] : [Step 4/5] [2021-11-19 21:15:35,224][INFO ][exchange-worker-#26939%grid-2%][GridClusterStateProcessor] Writing BaselineTopology[id=0] [21:15:35] : [Step 4/5] [2021-11-19 21:15:35,228][INFO ][exchange-worker-#26939%grid-2%][GridCacheDatabaseSharedManager] Finish recovery performed in 163 ms. [21:15:35] : [Step 4/5] [2021-11-19 21:15:35,229][INFO ][exchange-worker-#26939%grid-2%][msg] Components activation performed in 165 ms. [21:15:35] : [Step 4/5] [2021-11-19 21:15:35,232][INFO ][sys-#26906%grid-2%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:15:35] : [Step 4/5] [2021-11-19 21:15:35,244][INFO ][exchange-worker-#26939%grid-2%][GridCacheProcessor] Started cache [name=encrypted, id=1613773252, dataRegionName=default, mode=PARTITIONED, atomicity=ATOMIC, backups=0, mvcc=false] [21:15:35] : [Step 4/5] [2021-11-19 21:15:35,244][INFO ][sys-#26909%grid-2%][GridCacheProcessor] Started cache [name=ignite-sys-cache, id=-2100569601, dataRegionName=sysMemPlc, mode=REPLICATED, atomicity=TRANSACTIONAL, backups=2147483647, mvcc=false] [21:15:35] : [Step 4/5] [2021-11-19 21:15:35,245][INFO ][exchange-worker-#26939%grid-2%][GridCacheProcessor] Starting caches on local join performed in 21 ms. [21:15:35] : [Step 4/5] [2021-11-19 21:15:35,247][INFO ][exchange-worker-#26939%grid-2%][GridDhtPartitionsExchangeFuture] Skipped waiting for partitions release future (local node is joining) [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0]] [21:15:35] : [Step 4/5] [2021-11-19 21:15:35,254][INFO ][grid-nio-worker-tcp-comm-1-#26601%TestRecordingCommunicationSpi%][TestRecordingCommunicationSpi] Accepted incoming communication connection [locAddr=/127.0.0.1:47100, rmtAddr=/127.0.0.1:35802] [21:15:35] : [Step 4/5] [2021-11-19 21:15:35,257][INFO ][grid-nio-worker-tcp-comm-0-#26873%TestRecordingCommunicationSpi%][TestRecordingCommunicationSpi] Established outgoing communication connection [locAddr=/127.0.0.1:35802, rmtAddr=/127.0.0.1:47100] [21:15:35] : [Step 4/5] [2021-11-19 21:15:35,257][INFO ][exchange-worker-#26939%grid-2%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], crd=false] [21:15:35] : [Step 4/5] [2021-11-19 21:15:35,258][INFO ][sys-#26653%grid-0%][GridDhtPartitionsExchangeFuture] Coordinator received single message [ver=AffinityTopologyVersion [topVer=3, minorTopVer=0], node=20b6f4b9-0c69-4736-8d5a-f36aa10b9002, allReceived=true] [21:15:35] : [Step 4/5] [2021-11-19 21:15:35,258][INFO ][sys-#26653%grid-0%][GridDhtPartitionsExchangeFuture] Coordinator received all messages, try merge [ver=AffinityTopologyVersion [topVer=3, minorTopVer=0]] [21:15:35] : [Step 4/5] [2021-11-19 21:15:35,259][INFO ][sys-#26653%grid-0%][GridDhtPartitionsExchangeFuture] finishExchangeOnCoordinator [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=0]] [21:15:35] : [Step 4/5] [2021-11-19 21:15:35,261][INFO ][sys-#26653%grid-0%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], err=null, rebalanced=true, wasRebalanced=true] [21:15:35] : [Step 4/5] [2021-11-19 21:15:35,267][INFO ][sys-#26653%grid-0%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=008cb00a-6a9b-4c09-a154-85082cd15000, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], evt=NODE_JOINED, evtNode=TcpDiscoveryNode [id=20b6f4b9-0c69-4736-8d5a-f36aa10b9002, consistentId=grid-2, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47502], discPort=47502, order=3, intOrder=3, lastExchangeTime=1637345734988, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0]] [21:15:35] : [Step 4/5] [2021-11-19 21:15:35,268][INFO ][sys-#26917%grid-2%][GridDhtPartitionsExchangeFuture] Received full message, will finish exchange [node=008cb00a-6a9b-4c09-a154-85082cd15000, resVer=AffinityTopologyVersion [topVer=3, minorTopVer=0]] [21:15:35] : [Step 4/5] [2021-11-19 21:15:35,267][INFO ][sys-#26764%grid-1%][GridDhtPartitionsExchangeFuture] Received full message, will finish exchange [node=008cb00a-6a9b-4c09-a154-85082cd15000, resVer=AffinityTopologyVersion [topVer=3, minorTopVer=0]] [21:15:35] : [Step 4/5] [2021-11-19 21:15:35,269][INFO ][sys-#26917%grid-2%][GridAffinityAssignmentCache] Local node affinity assignment distribution is not ideal [cache=encrypted, expectedPrimary=4.00, actualPrimary=0, expectedBackups=0.00, actualBackups=0, warningThreshold=50.00%] [21:15:35] : [Step 4/5] [2021-11-19 21:15:35,267][INFO ][exchange-worker-#26662%grid-0%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=3, minorTopVer=0], force=false, evt=NODE_JOINED, node=20b6f4b9-0c69-4736-8d5a-f36aa10b9002] [21:15:35] : [Step 4/5] [2021-11-19 21:15:35,272][INFO ][sys-#26917%grid-2%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], err=null, rebalanced=true, wasRebalanced=false] [21:15:35] : [Step 4/5] [2021-11-19 21:15:35,271][INFO ][sys-#26764%grid-1%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], err=null, rebalanced=true, wasRebalanced=true] [21:15:35] : [Step 4/5] [2021-11-19 21:15:35,268][INFO ][sys-#26653%grid-0%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (0 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (1 ms), stage="Wait partitions release latch [latch=exchange]" (10 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="After states restored callback" (0 ms), stage="WAL history reservation" (12 ms), stage="Waiting for all single messages" (207 ms), stage="Exchanges merge" (0 ms), stage="Affinity recalculation (crd)" (1 ms), stage="Collect update counters and create affinity messages" (0 ms), stage="Assign partitions states" (0 ms), stage="Validate partitions states" (0 ms), stage="Apply update counters" (0 ms), stage="Full message preparing" (0 ms), stage="Full message sending" (0 ms), stage="Exchange done" (6 ms), stage="Total time" (237 ms), Discovery lag=14 ms, Latest started node id=20b6f4b9-0c69-4736-8d5a-f36aa10b9002] [21:15:35] : [Step 4/5] [2021-11-19 21:15:35,274][INFO ][exchange-worker-#26785%grid-1%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=3, minorTopVer=0], force=false, evt=NODE_JOINED, node=20b6f4b9-0c69-4736-8d5a-f36aa10b9002] [21:15:35] : [Step 4/5] [2021-11-19 21:15:35,274][INFO ][sys-#26764%grid-1%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=1085686a-9887-4e3d-9d8b-a64775ae4001, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], evt=NODE_JOINED, evtNode=TcpDiscoveryNode [id=20b6f4b9-0c69-4736-8d5a-f36aa10b9002, consistentId=grid-2, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47502], discPort=47502, order=3, intOrder=3, lastExchangeTime=1637345734999, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0]] [21:15:35] : [Step 4/5] [2021-11-19 21:15:35,274][INFO ][sys-#26917%grid-2%][GridCacheProcessor] Finish proxy initialization, cacheName=ignite-sys-cache, localNodeId=20b6f4b9-0c69-4736-8d5a-f36aa10b9002 [21:15:35] : [Step 4/5] [2021-11-19 21:15:35,278][INFO ][sys-#26764%grid-1%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (4 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Wait partitions release latch [latch=exchange]" (7 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="After states restored callback" (0 ms), stage="WAL history reservation" (2 ms), stage="Waiting for Full message" (223 ms), stage="Affinity recalculation" (2 ms), stage="Full map updating" (1 ms), stage="Exchange done" (7 ms), stage="Total time" (246 ms)] [21:15:35] : [Step 4/5] [2021-11-19 21:15:35,277][INFO ][sys-#26653%grid-0%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], stage="Affinity initialization (node join) [grp=ignite-sys-cache, crd=true]" (0 ms) (parent=Affinity recalculation (crd)), stage="Affinity initialization (node join) [grp=encrypted, crd=true]" (0 ms) (parent=Affinity recalculation (crd))] [21:15:35] : [Step 4/5] [2021-11-19 21:15:35,281][INFO ][sys-#26764%grid-1%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], stage="Affinity initialization (node join) [grp=ignite-sys-cache, crd=false]" (1 ms) (parent=Affinity recalculation), stage="Affinity initialization (node join) [grp=encrypted, crd=false]" (1 ms) (parent=Affinity recalculation)] [21:15:35] : [Step 4/5] [2021-11-19 21:15:35,279][INFO ][sys-#26917%grid-2%][GridCacheProcessor] Finish proxy initialization, cacheName=encrypted, localNodeId=20b6f4b9-0c69-4736-8d5a-f36aa10b9002 [21:15:35] : [Step 4/5] [2021-11-19 21:15:35,283][INFO ][sys-#26917%grid-2%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=20b6f4b9-0c69-4736-8d5a-f36aa10b9002, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], evt=NODE_JOINED, evtNode=TcpDiscoveryNode [id=20b6f4b9-0c69-4736-8d5a-f36aa10b9002, consistentId=grid-2, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47502], discPort=47502, order=3, intOrder=3, lastExchangeTime=1637345735080, loc=true, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0]] [21:15:35] : [Step 4/5] [2021-11-19 21:15:35,283][INFO ][exchange-worker-#26939%grid-2%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=3, minorTopVer=0], force=false, evt=NODE_JOINED, node=20b6f4b9-0c69-4736-8d5a-f36aa10b9002] [21:15:35] : [Step 4/5] [2021-11-19 21:15:35,284][INFO ][sys-#26917%grid-2%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], stage="Waiting in exchange queue" (23 ms), stage="Exchange parameters initialization" (0 ms), stage="Baseline change callback" (3 ms), stage="Components activation" (165 ms), stage="Determine exchange type" (17 ms), stage="Preloading notification" (0 ms), stage="Restore partition states" (1 ms), stage="After states restored callback" (2 ms), stage="WAL history reservation" (0 ms), stage="Waiting for Full message" (15 ms), stage="Affinity recalculation" (1 ms), stage="Full map updating" (2 ms), stage="Exchange done" (12 ms), stage="Total time" (241 ms)] [21:15:35] : [Step 4/5] [2021-11-19 21:15:35,286][INFO ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-2] To start Console Management & Monitoring run ignitevisorcmd.{sh|bat} [21:15:35] : [Step 4/5] [2021-11-19 21:15:35,286][INFO ][sys-#26917%grid-2%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], stage="Affinity fetch" (17 ms) (parent=Determine exchange type), stage="Restore partition states [grp=ignite-sys-cache]" (1 ms) (parent=Restore partition states), stage="Restore partition states [grp=encrypted]" (0 ms) (parent=Restore partition states), stage="Affinity initialization (local join) [grp=ignite-sys-cache]" (1 ms) (parent=Affinity recalculation), stage="Affinity initialization (local join) [grp=encrypted]" (0 ms) (parent=Affinity recalculation)] [21:15:35] : [Step 4/5] [2021-11-19 21:15:35,287][INFO ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-2] [21:15:35] : [Step 4/5] [21:15:35] : [Step 4/5] >>> +-------------------------------------------+ [21:15:35] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:15:35] : [Step 4/5] >>> +-------------------------------------------+ [21:15:35] : [Step 4/5] >>> OS name: Linux 4.15.0-151-generic amd64 [21:15:35] : [Step 4/5] >>> CPU(s): 24 [21:15:35] : [Step 4/5] >>> Heap: 2.0GB [21:15:35] : [Step 4/5] >>> VM name: 16724@c4dfe9a430b2 [21:15:35] : [Step 4/5] >>> Ignite instance name: grid-2 [21:15:35] : [Step 4/5] >>> Local node [ID=20B6F4B9-0C69-4736-8D5A-F36AA10B9002, order=3, clientMode=false] [21:15:35] : [Step 4/5] >>> Local node addresses: [127.0.0.1] [21:15:35] : [Step 4/5] >>> Local ports: TCP:10802 TCP:47102 TCP:47502 [21:15:35] : [Step 4/5] [21:15:35] : [Step 4/5] [2021-11-19 21:15:35,289][INFO ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][GridDiscoveryManager] Topology snapshot [ver=3, locNode=20b6f4b9, servers=3, clients=0, state=ACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=008cb00a-6a9b-4c09-a154-85082cd15000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=1085686a-9887-4e3d-9d8b-a64775ae4001, consistentId=grid-1, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=20b6f4b9-0c69-4736-8d5a-f36aa10b9002, consistentId=grid-2, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:15:35] : [Step 4/5] [2021-11-19 21:15:35,290][INFO ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][GridDiscoveryManager] ^-- Baseline [id=0, size=2, online=2, offline=0] [21:15:35] : [Step 4/5] [2021-11-19 21:15:35,291][INFO ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][G] Node started : [stage="Configure system pool" (0 ms),stage="Start managers" (302 ms),stage="Configure binary metadata" (1 ms),stage="Start processors" (27 ms),stage="Start 'StanByClusterTestProvider' plugin" (0 ms),stage="Start 'PageMemory tracker plugin' plugin" (0 ms),stage="Start 'TestDistibutedConfigurationPlugin' plugin" (0 ms),stage="Start 'NodeValidationPluginProvider' plugin" (0 ms),stage="Init metastore" (30 ms),stage="Init and start regions" (9 ms),stage="Restore binary memory" (15 ms),stage="Restore logical state" (42 ms),stage="Finish recovery" (364 ms),stage="Join topology" (47 ms),stage="Await transition" (18 ms),stage="Await exchange" (239 ms),stage="Total time" (1094 ms)] [21:15:35] : [Step 4/5] [2021-11-19 21:15:35,292][INFO ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][root] Node started with the following configuration [id=20b6f4b9-0c69-4736-8d5a-f36aa10b9002, marshaller=BinaryMarshaller [], discovery=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=5000, ackTimeout=5000, marsh=JdkMarshaller [clsFilter=org.apache.ignite.marshaller.MarshallerUtils$1@5c9bc6f1], reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], binaryCfg=null, lateAff=true] [21:15:35] : [Step 4/5] [2021-11-19 21:15:35,293][INFO ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][GridClusterStateProcessor] Sending activate cluster request with BaselineTopology BaselineTopology [id=1, branchingHash=-3712973250, branchingType='New BaselineTopology', baselineNodes=[grid-1, grid-2, grid-0]] [21:15:35] : [Step 4/5] [2021-11-19 21:15:35,296][INFO ][disco-notifier-worker-#26657%grid-0%][GridClusterStateProcessor] Received activate cluster request with BaselineTopology[id=1] initiator node ID: 1085686a-9887-4e3d-9d8b-a64775ae4001 [21:15:35] : [Step 4/5] [2021-11-19 21:15:35,296][INFO ][disco-notifier-worker-#26657%grid-0%][GridClusterStateProcessor] Started state transition: activate cluster [21:15:35] : [Step 4/5] [2021-11-19 21:15:35,297][INFO ][disco-notifier-worker-#26776%grid-1%][GridClusterStateProcessor] Received activate cluster request with BaselineTopology[id=1] initiator node ID: 1085686a-9887-4e3d-9d8b-a64775ae4001 [21:15:35] : [Step 4/5] [2021-11-19 21:15:35,297][INFO ][exchange-worker-#26662%grid-0%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], crd=true, evt=DISCOVERY_CUSTOM_EVT, evtNode=1085686a-9887-4e3d-9d8b-a64775ae4001, customEvt=ChangeGlobalStateMessage [id=6fd3e593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqId=53648a13-de2b-4b8c-bae2-bfb85df8ce9f, initiatingNodeId=1085686a-9887-4e3d-9d8b-a64775ae4001, state=ACTIVE, baselineTopology=BaselineTopology [id=1, branchingHash=-3712973250, branchingType='New BaselineTopology', baselineNodes=[grid-1, grid-2, grid-0]], forceChangeBaselineTopology=true, timestamp=1637345735293, forceDeactivation=false], allowMerge=false, exchangeFreeSwitch=false] [21:15:35] : [Step 4/5] [2021-11-19 21:15:35,299][INFO ][exchange-worker-#26662%grid-0%][GridClusterStateProcessor] Writing BaselineTopology[id=1] [21:15:35] : [Step 4/5] [2021-11-19 21:15:35,298][INFO ][disco-notifier-worker-#26930%grid-2%][GridClusterStateProcessor] Received activate cluster request with BaselineTopology[id=1] initiator node ID: 1085686a-9887-4e3d-9d8b-a64775ae4001 [21:15:35] : [Step 4/5] [2021-11-19 21:15:35,297][INFO ][disco-notifier-worker-#26776%grid-1%][GridClusterStateProcessor] Started state transition: activate cluster [21:15:35] : [Step 4/5] [2021-11-19 21:15:35,299][INFO ][disco-notifier-worker-#26930%grid-2%][GridClusterStateProcessor] Started state transition: activate cluster [21:15:35] : [Step 4/5] [2021-11-19 21:15:35,299][INFO ][exchange-worker-#26662%grid-0%][GridClusterStateProcessor] Writing BaselineTopologyHistoryItem[id=0] [21:15:35] : [Step 4/5] [2021-11-19 21:15:35,300][INFO ][exchange-worker-#26939%grid-2%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], crd=false, evt=DISCOVERY_CUSTOM_EVT, evtNode=1085686a-9887-4e3d-9d8b-a64775ae4001, customEvt=ChangeGlobalStateMessage [id=6fd3e593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqId=53648a13-de2b-4b8c-bae2-bfb85df8ce9f, initiatingNodeId=1085686a-9887-4e3d-9d8b-a64775ae4001, state=ACTIVE, baselineTopology=BaselineTopology [id=1, branchingHash=-3712973250, branchingType='New BaselineTopology', baselineNodes=[grid-1, grid-2, grid-0]], forceChangeBaselineTopology=true, timestamp=1637345735293, forceDeactivation=false], allowMerge=false, exchangeFreeSwitch=false] [21:15:35] : [Step 4/5] [2021-11-19 21:15:35,300][INFO ][exchange-worker-#26785%grid-1%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], crd=false, evt=DISCOVERY_CUSTOM_EVT, evtNode=1085686a-9887-4e3d-9d8b-a64775ae4001, customEvt=ChangeGlobalStateMessage [id=6fd3e593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqId=53648a13-de2b-4b8c-bae2-bfb85df8ce9f, initiatingNodeId=1085686a-9887-4e3d-9d8b-a64775ae4001, state=ACTIVE, baselineTopology=BaselineTopology [id=1, branchingHash=-3712973250, branchingType='New BaselineTopology', baselineNodes=[grid-1, grid-2, grid-0]], forceChangeBaselineTopology=true, timestamp=1637345735293, forceDeactivation=false], allowMerge=false, exchangeFreeSwitch=false] [21:15:35] : [Step 4/5] [2021-11-19 21:15:35,303][INFO ][exchange-worker-#26662%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], waitTime=0ms, futInfo=NA, mode=DISTRIBUTED] [21:15:35] : [Step 4/5] [2021-11-19 21:15:35,302][INFO ][exchange-worker-#26939%grid-2%][GridClusterStateProcessor] Writing BaselineTopology[id=1] [21:15:35] : [Step 4/5] [2021-11-19 21:15:35,303][INFO ][exchange-worker-#26785%grid-1%][GridClusterStateProcessor] Writing BaselineTopology[id=1] [21:15:35] : [Step 4/5] [2021-11-19 21:15:35,304][INFO ][exchange-worker-#26939%grid-2%][GridClusterStateProcessor] Writing BaselineTopologyHistoryItem[id=0] [21:15:35] : [Step 4/5] [2021-11-19 21:15:35,304][INFO ][exchange-worker-#26785%grid-1%][GridClusterStateProcessor] Writing BaselineTopologyHistoryItem[id=0] [21:15:35] : [Step 4/5] [2021-11-19 21:15:35,305][INFO ][sys-#26929%grid-2%][GridAffinityAssignmentCache] Local node affinity assignment distribution is not ideal [cache=encrypted, expectedPrimary=2.67, actualPrimary=0, expectedBackups=0.00, actualBackups=0, warningThreshold=50.00%] [21:15:35] : [Step 4/5] [2021-11-19 21:15:35,306][INFO ][sys-#26771%grid-1%][GridAffinityAssignmentCache] Local node affinity assignment distribution is not ideal [cache=encrypted, expectedPrimary=2.67, actualPrimary=5, expectedBackups=0.00, actualBackups=0, warningThreshold=50.00%] [21:15:35] : [Step 4/5] [2021-11-19 21:15:35,306][INFO ][exchange-worker-#26939%grid-2%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], waitTime=0ms, futInfo=NA, mode=DISTRIBUTED] [21:15:35] : [Step 4/5] [2021-11-19 21:15:35,307][INFO ][exchange-worker-#26785%grid-1%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], waitTime=0ms, futInfo=NA, mode=DISTRIBUTED] [21:15:35] : [Step 4/5] [2021-11-19 21:15:35,308][INFO ][exchange-worker-#26662%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partitions release latch: ServerLatch [permits=0, pendingAcks=HashSet [], super=CompletableLatch [id=CompletableLatchUid [id=exchange, topVer=AffinityTopologyVersion [topVer=3, minorTopVer=1]]]] [21:15:35] : [Step 4/5] [2021-11-19 21:15:35,308][INFO ][exchange-worker-#26939%grid-2%][GridDhtPartitionsExchangeFuture] Finished waiting for partitions release latch: ClientLatch [coordinator=TcpDiscoveryNode [id=008cb00a-6a9b-4c09-a154-85082cd15000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345735009, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], ackSent=true, super=CompletableLatch [id=CompletableLatchUid [id=exchange, topVer=AffinityTopologyVersion [topVer=3, minorTopVer=1]]]] [21:15:35] : [Step 4/5] [2021-11-19 21:15:35,308][INFO ][exchange-worker-#26785%grid-1%][GridDhtPartitionsExchangeFuture] Finished waiting for partitions release latch: ClientLatch [coordinator=TcpDiscoveryNode [id=008cb00a-6a9b-4c09-a154-85082cd15000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345717070, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], ackSent=true, super=CompletableLatch [id=CompletableLatchUid [id=exchange, topVer=AffinityTopologyVersion [topVer=3, minorTopVer=1]]]] [21:15:35] : [Step 4/5] [2021-11-19 21:15:35,309][INFO ][exchange-worker-#26939%grid-2%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:15:35] : [Step 4/5] [2021-11-19 21:15:35,308][INFO ][exchange-worker-#26662%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:15:35] : [Step 4/5] [2021-11-19 21:15:35,310][INFO ][exchange-worker-#26785%grid-1%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:15:35] : [Step 4/5] [2021-11-19 21:15:35,311][INFO ][exchange-worker-#26662%grid-0%][GridCacheDatabaseSharedManager] Cache groups with earliest reserved checkpoint and a reason why a previous checkpoint was inapplicable: [[[grpId=1613773252, grpName=encrypted, cp=(56b8b7eb-5403-4139-82be-95550fc65811, 11/19/2021 21:15:28)], reason=Reserved checkpoint is the oldest in history]] [21:15:35] : [Step 4/5] [2021-11-19 21:15:35,312][INFO ][exchange-worker-#26785%grid-1%][GridCacheDatabaseSharedManager] Cache groups with earliest reserved checkpoint and a reason why a previous checkpoint was inapplicable: [[[grpId=1613773252, grpName=encrypted, cp=(d8a32c44-0803-4a3a-8440-73bccb80b01e, 11/19/2021 21:15:32)], reason=Reserved checkpoint is the oldest in history]] [21:15:35] : [Step 4/5] [2021-11-19 21:15:35,312][INFO ][exchange-worker-#26662%grid-0%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], crd=true] [21:15:35] : [Step 4/5] [2021-11-19 21:15:35,313][INFO ][exchange-worker-#26785%grid-1%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], crd=false] [21:15:35] : [Step 4/5] [2021-11-19 21:15:35,314][INFO ][sys-#26649%grid-0%][GridDhtPartitionsExchangeFuture] Coordinator received single message [ver=AffinityTopologyVersion [topVer=3, minorTopVer=1], node=1085686a-9887-4e3d-9d8b-a64775ae4001, remainingNodes=1, allReceived=false] [21:15:35] : [Step 4/5] [2021-11-19 21:15:35,317][INFO ][exchange-worker-#26939%grid-2%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], crd=false] [21:15:35] : [Step 4/5] [2021-11-19 21:15:35,317][INFO ][sys-#26645%grid-0%][GridDhtPartitionsExchangeFuture] Coordinator received single message [ver=AffinityTopologyVersion [topVer=3, minorTopVer=1], node=20b6f4b9-0c69-4736-8d5a-f36aa10b9002, allReceived=true] [21:15:35] : [Step 4/5] [2021-11-19 21:15:35,317][INFO ][sys-#26645%grid-0%][GridDhtPartitionsExchangeFuture] finishExchangeOnCoordinator [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=1]] [21:15:35] : [Step 4/5] [2021-11-19 21:15:35,321][INFO ][sys-#26645%grid-0%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], err=null, rebalanced=false, wasRebalanced=true] [21:15:35] : [Step 4/5] [2021-11-19 21:15:35,321][INFO ][disco-notifier-worker-#26776%grid-1%][GridClusterStateProcessor] Received state change finish message: ACTIVE [21:15:35] : [Step 4/5] [2021-11-19 21:15:35,323][INFO ][disco-notifier-worker-#26776%grid-1%][GridClusterStateProcessor] Cluster state was changed from ACTIVE to ACTIVE [21:15:35] : [Step 4/5] [2021-11-19 21:15:35,321][INFO ][disco-notifier-worker-#26657%grid-0%][GridClusterStateProcessor] Received state change finish message: ACTIVE [21:15:35] : [Step 4/5] [2021-11-19 21:15:35,323][INFO ][exchange-worker-#26662%grid-0%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=3, minorTopVer=1], force=false, evt=DISCOVERY_CUSTOM_EVT, node=1085686a-9887-4e3d-9d8b-a64775ae4001] [21:15:35] : [Step 4/5] [2021-11-19 21:15:35,323][INFO ][sys-#26645%grid-0%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=008cb00a-6a9b-4c09-a154-85082cd15000, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=1085686a-9887-4e3d-9d8b-a64775ae4001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637345717040, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=false, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=3, minorTopVer=1]] [21:15:35] : [Step 4/5] [2021-11-19 21:15:35,323][INFO ][sys-#26775%grid-1%][GridDhtPartitionsExchangeFuture] Received full message, will finish exchange [node=008cb00a-6a9b-4c09-a154-85082cd15000, resVer=AffinityTopologyVersion [topVer=3, minorTopVer=1]] [21:15:35] : [Step 4/5] [2021-11-19 21:15:35,321][INFO ][sys-#26908%grid-2%][GridDhtPartitionsExchangeFuture] Received full message, will finish exchange [node=008cb00a-6a9b-4c09-a154-85082cd15000, resVer=AffinityTopologyVersion [topVer=3, minorTopVer=1]] [21:15:35] : [Step 4/5] [2021-11-19 21:15:35,326][INFO ][sys-#26645%grid-0%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (1 ms), stage="Determine exchange type" (4 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Wait partitions release latch [latch=exchange]" (4 ms), stage="Wait partitions release [latch=exchange]" (2 ms), stage="After states restored callback" (0 ms), stage="WAL history reservation" (0 ms), stage="Waiting for all single messages" (5 ms), stage="Affinity recalculation (crd)" (0 ms), stage="Collect update counters and create affinity messages" (0 ms), stage="Assign partitions states" (0 ms), stage="Validate partitions states" (0 ms), stage="Ideal affinity diff calculation (enforced)" (0 ms), stage="Apply update counters" (0 ms), stage="Full message preparing" (0 ms), stage="Full message sending" (0 ms), stage="State finish message sending" (0 ms), stage="Exchange done" (4 ms), stage="Total time" (20 ms), Discovery lag=3 ms, Latest started node id=1085686a-9887-4e3d-9d8b-a64775ae4001] [21:15:35] : [Step 4/5] [2021-11-19 21:15:35,324][INFO ][disco-notifier-worker-#26930%grid-2%][GridClusterStateProcessor] Received state change finish message: ACTIVE [21:15:35] : [Step 4/5] [2021-11-19 21:15:35,331][INFO ][disco-notifier-worker-#26930%grid-2%][GridClusterStateProcessor] Cluster state was changed from ACTIVE to ACTIVE [21:15:35] : [Step 4/5] [2021-11-19 21:15:35,324][INFO ][disco-notifier-worker-#26657%grid-0%][GridClusterStateProcessor] Cluster state was changed from ACTIVE to ACTIVE [21:15:35] : [Step 4/5] [2021-11-19 21:15:35,331][INFO ][sys-#26645%grid-0%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], stage="Affinity centralized initialization (crd) [grp=encrypted, crd=true]" (4 ms) (parent=Determine exchange type), stage="Affinity centralized initialization (crd) [grp=ignite-sys-cache, crd=true]" (3 ms) (parent=Determine exchange type), stage="Affinity recalculation (partitions availability) [grp=ignite-sys-cache]" (0 ms) (parent=Ideal affinity diff calculation (enforced)), stage="Affinity recalculation (partitions availability) [grp=encrypted]" (0 ms) (parent=Ideal affinity diff calculation (enforced)), stage="Affinity initialization (enforced) [grp=ignite-sys-cache]" (0 ms) (parent=Ideal affinity diff calculation (enforced))] [21:15:35] : [Step 4/5] [2021-11-19 21:15:35,329][INFO ][sys-#26908%grid-2%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], err=null, rebalanced=false, wasRebalanced=true] [21:15:35] : [Step 4/5] [2021-11-19 21:15:35,328][INFO ][sys-#26775%grid-1%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], err=null, rebalanced=false, wasRebalanced=true] [21:15:35] : [Step 4/5] [2021-11-19 21:15:35,401][INFO ][sys-#26908%grid-2%][CacheGroupContext] Local state for group durability has changed [name=ignite-sys-cache, enabled=false] [21:15:35] : [Step 4/5] [2021-11-19 21:15:35,401][INFO ][sys-#26908%grid-2%][CacheGroupContext] Local state for group durability has been logged to WAL [name=ignite-sys-cache, enabled=false] [21:15:35] : [Step 4/5] [2021-11-19 21:15:35,401][INFO ][exchange-worker-#26785%grid-1%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=3, minorTopVer=1], force=false, evt=DISCOVERY_CUSTOM_EVT, node=1085686a-9887-4e3d-9d8b-a64775ae4001] [21:15:35] : [Step 4/5] [2021-11-19 21:15:35,401][INFO ][sys-#26775%grid-1%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=1085686a-9887-4e3d-9d8b-a64775ae4001, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=1085686a-9887-4e3d-9d8b-a64775ae4001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637345735317, loc=true, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=false, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=3, minorTopVer=1]] [21:15:35] : [Step 4/5] [2021-11-19 21:15:35,405][INFO ][sys-#26775%grid-1%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (2 ms), stage="Determine exchange type" (4 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Wait partitions release latch [latch=exchange]" (2 ms), stage="Wait partitions release [latch=exchange]" (1 ms), stage="After states restored callback" (0 ms), stage="WAL history reservation" (1 ms), stage="Waiting for Full message" (10 ms), stage="Affinity recalculation" (3 ms), stage="Full map updating" (1 ms), stage="Exchange done" (76 ms), stage="Total time" (100 ms)] [21:15:35] : [Step 4/5] [2021-11-19 21:15:35,406][INFO ][sys-#26775%grid-1%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], stage="Affinity centralized initialization (crd) [grp=encrypted, crd=false]" (3 ms) (parent=Determine exchange type), stage="Affinity centralized initialization (crd) [grp=ignite-sys-cache, crd=false]" (2 ms) (parent=Determine exchange type), stage="Affinity applying from full message [grp=ignite-sys-cache]" (3 ms) (parent=Affinity recalculation), stage="Affinity applying from full message [grp=encrypted]" (3 ms) (parent=Affinity recalculation)] [21:15:35] : [Step 4/5] [2021-11-19 21:15:35,404][INFO ][grid-nio-worker-tcp-comm-1-#26720%TestRecordingCommunicationSpi%][TestRecordingCommunicationSpi] Accepted incoming communication connection [locAddr=/127.0.0.1:47101, rmtAddr=/127.0.0.1:41334] [21:15:35] : [Step 4/5] [2021-11-19 21:15:35,410][INFO ][grid-nio-worker-tcp-comm-1-#26874%TestRecordingCommunicationSpi%][TestRecordingCommunicationSpi] Established outgoing communication connection [locAddr=/127.0.0.1:41334, rmtAddr=/127.0.0.1:47101] [21:15:35] : [Step 4/5] [2021-11-19 21:15:35,411][INFO ][sys-#26908%grid-2%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=20b6f4b9-0c69-4736-8d5a-f36aa10b9002, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=1085686a-9887-4e3d-9d8b-a64775ae4001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637345735009, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=false, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=3, minorTopVer=1]] [21:15:35] : [Step 4/5] [2021-11-19 21:15:35,413][INFO ][sys-#26908%grid-2%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (1 ms), stage="Determine exchange type" (4 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Wait partitions release latch [latch=exchange]" (2 ms), stage="Wait partitions release [latch=exchange]" (1 ms), stage="After states restored callback" (5 ms), stage="WAL history reservation" (0 ms), stage="Waiting for Full message" (5 ms), stage="Affinity recalculation" (6 ms), stage="Full map updating" (1 ms), stage="Exchange done" (83 ms), stage="Total time" (108 ms)] [21:15:35] : [Step 4/5] [2021-11-19 21:15:35,415][INFO ][exchange-worker-#26939%grid-2%][GridCachePartitionExchangeManager] Rebalancing scheduled [order=[ignite-sys-cache, encrypted], top=AffinityTopologyVersion [topVer=3, minorTopVer=1], rebalanceId=2, evt=DISCOVERY_CUSTOM_EVT, node=1085686a-9887-4e3d-9d8b-a64775ae4001] [21:15:35] : [Step 4/5] [2021-11-19 21:15:35,415][INFO ][sys-#26908%grid-2%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], stage="Affinity centralized initialization (crd) [grp=encrypted, crd=false]" (4 ms) (parent=Determine exchange type), stage="Affinity centralized initialization (crd) [grp=ignite-sys-cache, crd=false]" (3 ms) (parent=Determine exchange type), stage="Affinity applying from full message [grp=ignite-sys-cache]" (6 ms) (parent=Affinity recalculation), stage="Affinity applying from full message [grp=encrypted]" (6 ms) (parent=Affinity recalculation)] [21:15:35] : [Step 4/5] [2021-11-19 21:15:35,416][INFO ][exchange-worker-#26939%grid-2%][GridDhtPartitionDemander] Prepared rebalancing [grp=ignite-sys-cache, mode=SYNC, supplier=1085686a-9887-4e3d-9d8b-a64775ae4001, partitionsCount=50, topVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], rebalanceId=2] [21:15:35] : [Step 4/5] [2021-11-19 21:15:35,418][INFO ][exchange-worker-#26939%grid-2%][PartitionsEvictManager] Eviction in progress [groups=1, remainingPartsToEvict=0] [21:15:35] : [Step 4/5] [2021-11-19 21:15:35,418][INFO ][exchange-worker-#26939%grid-2%][PartitionsEvictManager] Group eviction in progress [grpName=ignite-sys-cache, grpId=-2100569601, remainingPartsToEvict=1, partsEvictInProgress=0, totalParts=100] [21:15:35] : [Step 4/5] [2021-11-19 21:15:35,419][INFO ][exchange-worker-#26939%grid-2%][PartitionsEvictManager] Partitions have been scheduled for eviction: [grpId=-2100569601, grpName=ignite-sys-cache, clearing=[1]] [21:15:35] : [Step 4/5] [2021-11-19 21:15:35,419][INFO ][disco-notifier-worker-#26776%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=1] [21:15:35] : [Step 4/5] [2021-11-19 21:15:35,419][INFO ][disco-notifier-worker-#26930%grid-2%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=1] [21:15:35] : [Step 4/5] [2021-11-19 21:15:35,419][INFO ][disco-notifier-worker-#26657%grid-0%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=1] [21:15:35] : [Step 4/5] [2021-11-19 21:15:35,420][INFO ][reencrypt-#26955%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:15:35] : [Step 4/5] [2021-11-19 21:15:35,422][INFO ][reencrypt-#26959%grid-0%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:15:35] : [Step 4/5] [2021-11-19 21:15:35,420][INFO ][reencrypt-#26957%grid-2%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:15:35] : [Step 4/5] [2021-11-19 21:15:35,422][INFO ][sys-#26913%grid-2%][GridDhtPartitionDemander] Starting rebalance routine [ignite-sys-cache, topVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], supplier=1085686a-9887-4e3d-9d8b-a64775ae4001, fullPartitions=[1, 3, 5, 7, 9, 11, 13, 15, 17, 19, 21, 23, 25, 27, 29, 31, 33, 35, 37, 39, 41, 43, 45, 47, 49, 51, 53, 55, 57, 59, 61, 63, 65, 67, 69, 71, 73, 75, 77, 79, 81, 83, 85, 87, 89, 91, 93, 95, 97, 99], histPartitions=[], rebalanceId=2] [21:15:35] : [Step 4/5] [2021-11-19 21:15:35,423][INFO ][exchange-worker-#26939%grid-2%][GridDhtPartitionDemander] Prepared rebalancing [grp=ignite-sys-cache, mode=SYNC, supplier=008cb00a-6a9b-4c09-a154-85082cd15000, partitionsCount=50, topVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], rebalanceId=2] [21:15:35]W: [org.apache.ignite:ignite-core] [2021-11-19 21:15:35,425][WARN ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][root] Waiting for topology map update [igniteInstanceName=grid-1, cache=ignite-sys-cache, cacheId=-2100569601, topVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], p=0, affNodesCnt=3, ownersCnt=2, affNodes=[1085686a-9887-4e3d-9d8b-a64775ae4001, 008cb00a-6a9b-4c09-a154-85082cd15000, 20b6f4b9-0c69-4736-8d5a-f36aa10b9002], owners=[008cb00a-6a9b-4c09-a154-85082cd15000, 1085686a-9887-4e3d-9d8b-a64775ae4001], topFut=GridDhtPartitionsExchangeFuture [firstDiscoEvt=DiscoveryCustomEvent [customMsg=null, affTopVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], super=DiscoveryEvent [evtNode=TcpDiscoveryNode [id=1085686a-9887-4e3d-9d8b-a64775ae4001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637345735419, loc=true, ver=2.13.0#20211119-sha1:00000000, isClient=false], topVer=3, msgTemplate=null, span=o.a.i.i.processors.tracing.NoopSpan@61742ff0, nodeId8=1085686a, msg=null, type=DISCOVERY_CUSTOM_EVT, tstamp=1637345735297]], crd=TcpDiscoveryNode [id=008cb00a-6a9b-4c09-a154-85082cd15000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345717070, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], exchId=GridDhtPartitionExchangeId [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], discoEvt=DiscoveryCustomEvent [customMsg=null, affTopVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], super=DiscoveryEvent [evtNode=TcpDiscoveryNode [id=1085686a-9887-4e3d-9d8b-a64775ae4001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637345735419, loc=true, ver=2.13.0#20211119-sha1:00000000, isClient=false], topVer=3, msgTemplate=null, span=o.a.i.i.processors.tracing.NoopSpan@61742ff0, nodeId8=1085686a, msg=null, type=DISCOVERY_CUSTOM_EVT, tstamp=1637345735297]], nodeId=1085686a, evt=DISCOVERY_CUSTOM_EVT], added=true, exchangeType=ALL, initFut=GridFutureAdapter [ignoreInterrupts=false, state=DONE, res=true, hash=1670342931], init=true, lastVer=null, partReleaseFut=PartitionReleaseFuture [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], futures=[ExplicitLockReleaseFuture [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], futures=[]], AtomicUpdateReleaseFuture [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], futures=[]], DataStreamerReleaseFuture [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], futures=[]], LocalTxReleaseFuture [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], futures=[]], AllTxReleaseFuture [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], futures=[RemoteTxReleaseFuture [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], futures=[]]]]]], exchActions=ExchangeActions [startCaches=null, stopCaches=null, startGrps=[], stopGrps=[], resetParts=null, stateChangeRequest=StateChangeRequest [msg=ChangeGlobalStateMessage [id=6fd3e593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqId=53648a13-de2b-4b8c-bae2-bfb85df8ce9f, initiatingNodeId=1085686a-9887-4e3d-9d8b-a64775ae4001, state=ACTIVE, baselineTopology=BaselineTopology [id=1, branchingHash=-3712973250, branchingType='New BaselineTopology', baselineNodes=[grid-1, grid-2, grid-0]], forceChangeBaselineTopology=true, timestamp=1637345735293, forceDeactivation=false], prevBltHistItem=o.a.i.i.processors.cluster.BaselineTopologyHistoryItem@6e79d7f0, prevState=ACTIVE, topVer=AffinityTopologyVersion [topVer=3, minorTopVer=1]]], secCtx=null, affChangeMsg=null, centralizedAff=false, forceAffReassignment=true, exchangeLocE=null, cacheChangeFailureMsgSent=false, done=true, state=DONE, registerCachesFuture=null, startTime=1637345735300, initTime=1637345735300, rebalanced=false, affinityReassign=false, span=o.a.i.i.processors.tracing.NoopSpan@61742ff0, evtLatch=0, remaining=HashSet [008cb00a-6a9b-4c09-a154-85082cd15000, 20b6f4b9-0c69-4736-8d5a-f36aa10b9002], mergedJoinExchMsgs=null, awaitMergedMsgs=0, super=GridFutureAdapter [ignoreInterrupts=false, state=DONE, res=AffinityTopologyVersion [topVer=3, minorTopVer=1], hash=1852859028]], locNode=TcpDiscoveryNode [id=1085686a-9887-4e3d-9d8b-a64775ae4001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637345735419, loc=true, ver=2.13.0#20211119-sha1:00000000, isClient=false]] [21:15:35] : [Step 4/5] [2021-11-19 21:15:35,433][INFO ][rebalance-#26956%grid-2%][GridDhtPartitionDemander] Completed rebalancing [rebalanceId=2, grp=ignite-sys-cache, supplier=1085686a-9887-4e3d-9d8b-a64775ae4001, partitions=50, entries=0, duration=17ms, bytesRcvd=0.0 B, bandwidth=0.0 B/sec, histPartitions=0, histEntries=0, histBytesRcvd=0.0 B, fullPartitions=50, fullEntries=0, fullBytesRcvd=0.0 B, topVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], progress=1/2] [21:15:35] : [Step 4/5] [2021-11-19 21:15:35,427][INFO ][rebalance-striped-#26962%grid-1%][GridDhtPartitionSupplier] Finished supplying rebalancing [grp=ignite-sys-cache, demander=20b6f4b9-0c69-4736-8d5a-f36aa10b9002, topVer=AffinityTopologyVersion [topVer=3, minorTopVer=1]] [21:15:35] : [Step 4/5] [2021-11-19 21:15:35,426][INFO ][sys-#26916%grid-2%][GridDhtPartitionDemander] Starting rebalance routine [ignite-sys-cache, topVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], supplier=008cb00a-6a9b-4c09-a154-85082cd15000, fullPartitions=[0, 2, 4, 6, 8, 10, 12, 14, 16, 18, 20, 22, 24, 26, 28, 30, 32, 34, 36, 38, 40, 42, 44, 46, 48, 50, 52, 54, 56, 58, 60, 62, 64, 66, 68, 70, 72, 74, 76, 78, 80, 82, 84, 86, 88, 90, 92, 94, 96, 98], histPartitions=[], rebalanceId=2] [21:15:35] : [Step 4/5] [2021-11-19 21:15:35,440][INFO ][rebalance-striped-#26966%grid-0%][GridDhtPartitionSupplier] Finished supplying rebalancing [grp=ignite-sys-cache, demander=20b6f4b9-0c69-4736-8d5a-f36aa10b9002, topVer=AffinityTopologyVersion [topVer=3, minorTopVer=1]] [21:15:35] : [Step 4/5] [2021-11-19 21:15:35,442][INFO ][rebalance-#26954%grid-2%][GridDhtPartitionDemander] Completed (final) rebalancing [rebalanceId=2, grp=ignite-sys-cache, supplier=008cb00a-6a9b-4c09-a154-85082cd15000, partitions=50, entries=0, duration=26ms, bytesRcvd=0.0 B, bandwidth=0.0 B/sec, histPartitions=0, histEntries=0, histBytesRcvd=0.0 B, fullPartitions=50, fullEntries=0, fullBytesRcvd=0.0 B, topVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], progress=2/2] [21:15:35] : [Step 4/5] [2021-11-19 21:15:35,572][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=134, segIdx=4, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000004.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000134.wal] [21:15:35] : [Step 4/5] [2021-11-19 21:15:35,572][INFO ][wal-file-archiver%grid-0-#26788%grid-0%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=76, segIdx=6, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000006.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000076.wal] [21:15:35] : [Step 4/5] [2021-11-19 21:15:35,596][INFO ][wal-file-cleaner%grid-0-#26789%grid-0%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=67, currSize=10.0 MB, maxSize=20.0 MB] [21:15:35] : [Step 4/5] [2021-11-19 21:15:35,600][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=125, currSize=10.0 MB, maxSize=20.0 MB] [21:15:35] : [Step 4/5] [2021-11-19 21:15:35,600][INFO ][wal-file-cleaner%grid-0-#26789%grid-0%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:15:35] : [Step 4/5] [2021-11-19 21:15:35,601][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:15:35] : [Step 4/5] [2021-11-19 21:15:35,730][INFO ][db-checkpoint-thread-#26946%grid-2%][Checkpointer] Checkpoint started [checkpointId=48a0b4aa-90de-4ff6-93b3-a213891d0818, startPtr=WALPointer [idx=0, fileOff=89353, len=69], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=1ms, checkpointLockHoldTime=2ms, walCpRecordFsyncDuration=87ms, writeCheckpointEntryDuration=391ms, splitAndSortCpPagesDuration=0ms, pages=23, reason='node started'] [21:15:35] : [Step 4/5] [2021-11-19 21:15:35,766][INFO ][wal-file-archiver%grid-0-#26788%grid-0%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000006.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000076.wal] [21:15:35] : [Step 4/5] [2021-11-19 21:15:35,767][INFO ][wal-file-archiver%grid-0-#26788%grid-0%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=77, segIdx=7, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000007.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000077.wal] [21:15:35] : [Step 4/5] [2021-11-19 21:15:35,768][INFO ][wal-file-cleaner%grid-0-#26789%grid-0%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=68, currSize=10.0 MB, maxSize=20.0 MB] [21:15:35] : [Step 4/5] [2021-11-19 21:15:35,766][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000004.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000134.wal] [21:15:35] : [Step 4/5] [2021-11-19 21:15:35,769][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=135, segIdx=5, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000005.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000135.wal] [21:15:35] : [Step 4/5] [2021-11-19 21:15:35,769][INFO ][wal-file-cleaner%grid-0-#26789%grid-0%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:15:35] : [Step 4/5] [2021-11-19 21:15:35,770][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=126, currSize=10.0 MB, maxSize=20.0 MB] [21:15:35] : [Step 4/5] [2021-11-19 21:15:35,771][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:15:35] : [Step 4/5] [2021-11-19 21:15:35,789][INFO ][wal-file-archiver%grid-0-#26788%grid-0%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000007.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000077.wal] [21:15:35] : [Step 4/5] [2021-11-19 21:15:35,815][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000005.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000135.wal] [21:15:35] : [Step 4/5] [2021-11-19 21:15:35,825][INFO ][wal-file-archiver%grid-0-#26788%grid-0%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=78, segIdx=8, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000008.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000078.wal] [21:15:35] : [Step 4/5] [2021-11-19 21:15:35,826][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=136, segIdx=6, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000006.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000136.wal] [21:15:35] : [Step 4/5] [2021-11-19 21:15:35,826][INFO ][wal-file-cleaner%grid-0-#26789%grid-0%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=69, currSize=10.0 MB, maxSize=20.0 MB] [21:15:35] : [Step 4/5] [2021-11-19 21:15:35,827][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=127, currSize=10.0 MB, maxSize=20.0 MB] [21:15:35] : [Step 4/5] [2021-11-19 21:15:35,828][INFO ][wal-file-cleaner%grid-0-#26789%grid-0%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:15:35] : [Step 4/5] [2021-11-19 21:15:35,834][INFO ][db-checkpoint-thread-#26946%grid-2%][Checkpointer] Checkpoint finished [cpId=48a0b4aa-90de-4ff6-93b3-a213891d0818, pages=23, markPos=WALPointer [idx=0, fileOff=89353, len=69], walSegmentsCovered=[], markDuration=481ms, pagesWrite=2ms, fsync=101ms, total=585ms] [21:15:35] : [Step 4/5] [2021-11-19 21:15:35,834][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:15:35] : [Step 4/5] [2021-11-19 21:15:35,841][INFO ][db-checkpoint-thread-#26946%grid-2%][CacheGroupContext] Local state for group durability has changed [name=ignite-sys-cache, enabled=true] [21:15:35] : [Step 4/5] [2021-11-19 21:15:35,845][INFO ][wal-file-archiver%grid-0-#26788%grid-0%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000008.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000078.wal] [21:15:35] : [Step 4/5] [2021-11-19 21:15:35,856][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000006.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000136.wal] [21:15:36] : [Step 4/5] [2021-11-19 21:15:35,944][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=137, segIdx=7, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000007.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000137.wal] [21:15:36] : [Step 4/5] [2021-11-19 21:15:35,944][INFO ][wal-file-archiver%grid-0-#26788%grid-0%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=79, segIdx=9, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000009.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000079.wal] [21:15:36] : [Step 4/5] [2021-11-19 21:15:36,023][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=128, currSize=10.0 MB, maxSize=20.0 MB] [21:15:36] : [Step 4/5] [2021-11-19 21:15:36,024][INFO ][wal-file-cleaner%grid-0-#26789%grid-0%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=70, currSize=10.0 MB, maxSize=20.0 MB] [21:15:36] : [Step 4/5] [2021-11-19 21:15:36,024][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:15:36] : [Step 4/5] [2021-11-19 21:15:36,026][INFO ][wal-file-cleaner%grid-0-#26789%grid-0%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:15:36] : [Step 4/5] [2021-11-19 21:15:36,089][INFO ][db-checkpoint-thread-#26946%grid-2%][Checkpointer] Checkpoint started [checkpointId=51c2a5b3-ad14-48b6-9561-87d4e4e1402f, startPtr=WALPointer [idx=0, fileOff=212088, len=47], checkpointBeforeLockTime=2ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=5ms, checkpointLockHoldTime=12ms, walCpRecordFsyncDuration=6ms, writeCheckpointEntryDuration=235ms, splitAndSortCpPagesDuration=0ms, pages=20, reason='enable-durability-rebalance-finished--2100569601-AffinityTopologyVersion [topVer=3, minorTopVer=1]'] [21:15:36] : [Step 4/5] [2021-11-19 21:15:36,294][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000007.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000137.wal] [21:15:36] : [Step 4/5] [2021-11-19 21:15:36,294][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=138, segIdx=8, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000008.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000138.wal] [21:15:36] : [Step 4/5] [2021-11-19 21:15:36,357][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=129, currSize=10.0 MB, maxSize=20.0 MB] [21:15:36] : [Step 4/5] [2021-11-19 21:15:36,358][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:15:36] : [Step 4/5] [2021-11-19 21:15:36,411][INFO ][wal-file-archiver%grid-0-#26788%grid-0%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000009.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000079.wal] [21:15:36] : [Step 4/5] [2021-11-19 21:15:36,516][INFO ][wal-file-archiver%grid-0-#26788%grid-0%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=80, segIdx=0, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000000.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000080.wal] [21:15:36] : [Step 4/5] [2021-11-19 21:15:36,517][INFO ][wal-file-cleaner%grid-0-#26789%grid-0%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=71, currSize=10.0 MB, maxSize=20.0 MB] [21:15:36] : [Step 4/5] [2021-11-19 21:15:36,517][INFO ][db-checkpoint-thread-#26796%grid-0%][Checkpointer] Checkpoint started [checkpointId=3f282704-fd24-49eb-83ac-b0c0996220d9, startPtr=WALPointer [idx=80, fileOff=215592, len=2010], checkpointBeforeLockTime=3ms, checkpointLockWait=3ms, checkpointListenersExecuteTime=2ms, checkpointLockHoldTime=2ms, walCpRecordFsyncDuration=98ms, writeCheckpointEntryDuration=387ms, splitAndSortCpPagesDuration=2ms, pages=1001, reason='too big size of WAL without checkpoint'] [21:15:36]W: [org.apache.ignite:ignite-core] [2021-11-19 21:15:36,516][WARN ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][root] Waiting for topology map update [igniteInstanceName=grid-1, cache=ignite-sys-cache, cacheId=-2100569601, topVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], p=0, affNodesCnt=3, ownersCnt=2, affNodes=[1085686a-9887-4e3d-9d8b-a64775ae4001, 008cb00a-6a9b-4c09-a154-85082cd15000, 20b6f4b9-0c69-4736-8d5a-f36aa10b9002], owners=[008cb00a-6a9b-4c09-a154-85082cd15000, 1085686a-9887-4e3d-9d8b-a64775ae4001], topFut=GridDhtPartitionsExchangeFuture [firstDiscoEvt=DiscoveryCustomEvent [customMsg=null, affTopVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], super=DiscoveryEvent [evtNode=TcpDiscoveryNode [id=1085686a-9887-4e3d-9d8b-a64775ae4001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637345736085, loc=true, ver=2.13.0#20211119-sha1:00000000, isClient=false], topVer=3, msgTemplate=null, span=o.a.i.i.processors.tracing.NoopSpan@61742ff0, nodeId8=1085686a, msg=null, type=DISCOVERY_CUSTOM_EVT, tstamp=1637345735297]], crd=TcpDiscoveryNode [id=008cb00a-6a9b-4c09-a154-85082cd15000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345717070, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], exchId=GridDhtPartitionExchangeId [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], discoEvt=DiscoveryCustomEvent [customMsg=null, affTopVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], super=DiscoveryEvent [evtNode=TcpDiscoveryNode [id=1085686a-9887-4e3d-9d8b-a64775ae4001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637345736085, loc=true, ver=2.13.0#20211119-sha1:00000000, isClient=false], topVer=3, msgTemplate=null, span=o.a.i.i.processors.tracing.NoopSpan@61742ff0, nodeId8=1085686a, msg=null, type=DISCOVERY_CUSTOM_EVT, tstamp=1637345735297]], nodeId=1085686a, evt=DISCOVERY_CUSTOM_EVT], added=true, exchangeType=ALL, initFut=GridFutureAdapter [ignoreInterrupts=false, state=DONE, res=true, hash=1670342931], init=true, lastVer=null, partReleaseFut=PartitionReleaseFuture [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], futures=[ExplicitLockReleaseFuture [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], futures=[]], AtomicUpdateReleaseFuture [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], futures=[]], DataStreamerReleaseFuture [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], futures=[]], LocalTxReleaseFuture [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], futures=[]], AllTxReleaseFuture [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], futures=[RemoteTxReleaseFuture [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], futures=[]]]]]], exchActions=ExchangeActions [startCaches=null, stopCaches=null, startGrps=[], stopGrps=[], resetParts=null, stateChangeRequest=StateChangeRequest [msg=ChangeGlobalStateMessage [id=6fd3e593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqId=53648a13-de2b-4b8c-bae2-bfb85df8ce9f, initiatingNodeId=1085686a-9887-4e3d-9d8b-a64775ae4001, state=ACTIVE, baselineTopology=BaselineTopology [id=1, branchingHash=-3712973250, branchingType='New BaselineTopology', baselineNodes=[grid-1, grid-2, grid-0]], forceChangeBaselineTopology=true, timestamp=1637345735293, forceDeactivation=false], prevBltHistItem=o.a.i.i.processors.cluster.BaselineTopologyHistoryItem@6e79d7f0, prevState=ACTIVE, topVer=AffinityTopologyVersion [topVer=3, minorTopVer=1]]], secCtx=null, affChangeMsg=null, centralizedAff=false, forceAffReassignment=true, exchangeLocE=null, cacheChangeFailureMsgSent=false, done=true, state=DONE, registerCachesFuture=null, startTime=1637345735300, initTime=1637345735300, rebalanced=false, affinityReassign=false, span=o.a.i.i.processors.tracing.NoopSpan@61742ff0, evtLatch=0, remaining=HashSet [008cb00a-6a9b-4c09-a154-85082cd15000, 20b6f4b9-0c69-4736-8d5a-f36aa10b9002], mergedJoinExchMsgs=null, awaitMergedMsgs=0, super=GridFutureAdapter [ignoreInterrupts=false, state=DONE, res=AffinityTopologyVersion [topVer=3, minorTopVer=1], hash=1852859028]], locNode=TcpDiscoveryNode [id=1085686a-9887-4e3d-9d8b-a64775ae4001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637345736085, loc=true, ver=2.13.0#20211119-sha1:00000000, isClient=false]] [21:15:36] : [Step 4/5] [2021-11-19 21:15:36,525][INFO ][wal-file-cleaner%grid-0-#26789%grid-0%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:15:36] : [Step 4/5] [2021-11-19 21:15:36,602][INFO ][db-checkpoint-thread-#26946%grid-2%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:15:36] : [Step 4/5] [2021-11-19 21:15:36,602][INFO ][db-checkpoint-thread-#26946%grid-2%][Checkpointer] Checkpoint finished [cpId=51c2a5b3-ad14-48b6-9561-87d4e4e1402f, pages=20, markPos=WALPointer [idx=0, fileOff=212088, len=47], walSegmentsCovered=[], markDuration=254ms, pagesWrite=1ms, fsync=511ms, total=768ms] [21:15:36] : [Step 4/5] [2021-11-19 21:15:36,602][INFO ][exchange-worker-#26939%grid-2%][GridDhtPartitionDemander] Completed rebalance future: RebalanceFuture [state=STARTED, grp=CacheGroupContext [grp=ignite-sys-cache], topVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], rebalanceId=2, routines=2, receivedBytes=1200, receivedKeys=0, partitionsLeft=0, partitionsTotal=100, startTime=1637345735416, endTime=1637345736602, lastCancelledTime=-1, result=true] [21:15:36] : [Step 4/5] [2021-11-19 21:15:36,603][INFO ][db-checkpoint-thread-#26801%grid-1%][Checkpointer] Checkpoint started [checkpointId=d446145e-0c40-4ab8-8c3d-c3ef870d6cd5, startPtr=WALPointer [idx=139, fileOff=379317, len=2048], checkpointBeforeLockTime=1ms, checkpointLockWait=9ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=77ms, writeCheckpointEntryDuration=308ms, splitAndSortCpPagesDuration=1ms, pages=1125, reason='too big size of WAL without checkpoint'] [21:15:36] : [Step 4/5] [2021-11-19 21:15:36,604][INFO ][exchange-worker-#26939%grid-2%][GridDhtPartitionDemander] Completed rebalance chain: [rebalanceId=2, partitions=100, entries=0, duration=1s, bytesRcvd=0.0 B] [21:15:36] : [Step 4/5] [2021-11-19 21:15:36,665][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000008.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000138.wal] [21:15:36] : [Step 4/5] [2021-11-19 21:15:36,726][INFO ][exchange-worker-#26939%grid-2%][CacheGroupContext] Local state for group durability has been logged to WAL [name=ignite-sys-cache, enabled=true] [21:15:36] : [Step 4/5] [2021-11-19 21:15:36,726][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=139, segIdx=9, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000009.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000139.wal] [21:15:36] : [Step 4/5] [2021-11-19 21:15:36,727][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=130, currSize=10.0 MB, maxSize=20.0 MB] [21:15:36] : [Step 4/5] [2021-11-19 21:15:36,729][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:15:36] : [Step 4/5] [2021-11-19 21:15:36,734][INFO ][exchange-worker-#26785%grid-1%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=2], crd=false, evt=DISCOVERY_CUSTOM_EVT, evtNode=008cb00a-6a9b-4c09-a154-85082cd15000, customEvt=CacheAffinityChangeMessage [id=a9e3e593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, topVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], exchId=null, partsMsg=null, exchangeNeeded=true], allowMerge=false, exchangeFreeSwitch=false] [21:15:36] : [Step 4/5] [2021-11-19 21:15:36,735][INFO ][exchange-worker-#26939%grid-2%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=2], crd=false, evt=DISCOVERY_CUSTOM_EVT, evtNode=008cb00a-6a9b-4c09-a154-85082cd15000, customEvt=CacheAffinityChangeMessage [id=a9e3e593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, topVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], exchId=null, partsMsg=null, exchangeNeeded=true], allowMerge=false, exchangeFreeSwitch=false] [21:15:36] : [Step 4/5] [2021-11-19 21:15:36,735][INFO ][exchange-worker-#26662%grid-0%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=2], crd=true, evt=DISCOVERY_CUSTOM_EVT, evtNode=008cb00a-6a9b-4c09-a154-85082cd15000, customEvt=CacheAffinityChangeMessage [id=a9e3e593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, topVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], exchId=null, partsMsg=null, exchangeNeeded=true], allowMerge=false, exchangeFreeSwitch=false] [21:15:36] : [Step 4/5] [2021-11-19 21:15:36,737][INFO ][exchange-worker-#26939%grid-2%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=2], waitTime=0ms, futInfo=NA, mode=DISTRIBUTED] [21:15:36] : [Step 4/5] [2021-11-19 21:15:36,736][INFO ][exchange-worker-#26785%grid-1%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=2], waitTime=0ms, futInfo=NA, mode=DISTRIBUTED] [21:15:36] : [Step 4/5] [2021-11-19 21:15:36,738][INFO ][exchange-worker-#26662%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=2], waitTime=0ms, futInfo=NA, mode=DISTRIBUTED] [21:15:36] : [Step 4/5] [2021-11-19 21:15:36,740][INFO ][exchange-worker-#26662%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partitions release latch: ServerLatch [permits=0, pendingAcks=HashSet [], super=CompletableLatch [id=CompletableLatchUid [id=exchange, topVer=AffinityTopologyVersion [topVer=3, minorTopVer=2]]]] [21:15:36] : [Step 4/5] [2021-11-19 21:15:36,745][INFO ][exchange-worker-#26939%grid-2%][GridDhtPartitionsExchangeFuture] Finished waiting for partitions release latch: ClientLatch [coordinator=TcpDiscoveryNode [id=008cb00a-6a9b-4c09-a154-85082cd15000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345735009, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], ackSent=true, super=CompletableLatch [id=CompletableLatchUid [id=exchange, topVer=AffinityTopologyVersion [topVer=3, minorTopVer=2]]]] [21:15:36] : [Step 4/5] [2021-11-19 21:15:36,745][INFO ][exchange-worker-#26785%grid-1%][GridDhtPartitionsExchangeFuture] Finished waiting for partitions release latch: ClientLatch [coordinator=TcpDiscoveryNode [id=008cb00a-6a9b-4c09-a154-85082cd15000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345717070, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], ackSent=true, super=CompletableLatch [id=CompletableLatchUid [id=exchange, topVer=AffinityTopologyVersion [topVer=3, minorTopVer=2]]]] [21:15:36] : [Step 4/5] [2021-11-19 21:15:36,746][INFO ][exchange-worker-#26939%grid-2%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=2], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:15:36] : [Step 4/5] [2021-11-19 21:15:36,746][INFO ][exchange-worker-#26662%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=2], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:15:36] : [Step 4/5] [2021-11-19 21:15:36,747][INFO ][exchange-worker-#26785%grid-1%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=2], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:15:36] : [Step 4/5] [2021-11-19 21:15:36,749][INFO ][exchange-worker-#26939%grid-2%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=2], crd=false] [21:15:36] : [Step 4/5] [2021-11-19 21:15:36,749][INFO ][exchange-worker-#26662%grid-0%][GridCacheDatabaseSharedManager] Cache groups with earliest reserved checkpoint and a reason why a previous checkpoint was inapplicable: [[[grpId=1613773252, grpName=encrypted, cp=(85c6ac3b-c202-4caf-8fec-1d3519612195, 11/19/2021 21:15:29)], reason=Reserved checkpoint is the oldest in history]] [21:15:36] : [Step 4/5] [2021-11-19 21:15:36,750][INFO ][exchange-worker-#26662%grid-0%][GridDhtPartitionsExchangeFuture] Coordinator received single message [ver=AffinityTopologyVersion [topVer=3, minorTopVer=2], node=20b6f4b9-0c69-4736-8d5a-f36aa10b9002, remainingNodes=1, allReceived=false] [21:15:36] : [Step 4/5] [2021-11-19 21:15:36,749][INFO ][exchange-worker-#26785%grid-1%][GridCacheDatabaseSharedManager] Cache groups with earliest reserved checkpoint and a reason why a previous checkpoint was inapplicable: [[[grpId=1613773252, grpName=encrypted, cp=(3625be9b-dc4a-4889-b6c4-caf69059a765, 11/19/2021 21:15:33)], reason=Reserved checkpoint is the oldest in history]] [21:15:36] : [Step 4/5] [2021-11-19 21:15:36,750][INFO ][exchange-worker-#26662%grid-0%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=2], crd=true] [21:15:36] : [Step 4/5] [2021-11-19 21:15:36,751][INFO ][exchange-worker-#26785%grid-1%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=2], crd=false] [21:15:36] : [Step 4/5] [2021-11-19 21:15:36,752][INFO ][sys-#26635%grid-0%][GridDhtPartitionsExchangeFuture] Coordinator received single message [ver=AffinityTopologyVersion [topVer=3, minorTopVer=2], node=1085686a-9887-4e3d-9d8b-a64775ae4001, allReceived=true] [21:15:36] : [Step 4/5] [2021-11-19 21:15:36,753][INFO ][sys-#26635%grid-0%][GridDhtPartitionsExchangeFuture] finishExchangeOnCoordinator [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=2]] [21:15:36] : [Step 4/5] [2021-11-19 21:15:36,756][INFO ][sys-#26635%grid-0%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=2], err=null, rebalanced=true, wasRebalanced=false] [21:15:36] : [Step 4/5] [2021-11-19 21:15:36,756][INFO ][sys-#26754%grid-1%][GridDhtPartitionsExchangeFuture] Received full message, will finish exchange [node=008cb00a-6a9b-4c09-a154-85082cd15000, resVer=AffinityTopologyVersion [topVer=3, minorTopVer=2]] [21:15:36] : [Step 4/5] [2021-11-19 21:15:36,757][INFO ][exchange-worker-#26662%grid-0%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=3, minorTopVer=2], force=false, evt=DISCOVERY_CUSTOM_EVT, node=008cb00a-6a9b-4c09-a154-85082cd15000] [21:15:36] : [Step 4/5] [2021-11-19 21:15:36,756][INFO ][sys-#26919%grid-2%][GridDhtPartitionsExchangeFuture] Received full message, will finish exchange [node=008cb00a-6a9b-4c09-a154-85082cd15000, resVer=AffinityTopologyVersion [topVer=3, minorTopVer=2]] [21:15:36] : [Step 4/5] [2021-11-19 21:15:36,756][INFO ][sys-#26635%grid-0%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=008cb00a-6a9b-4c09-a154-85082cd15000, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=2], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=008cb00a-6a9b-4c09-a154-85082cd15000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345736730, loc=true, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=3, minorTopVer=2]] [21:15:36] : [Step 4/5] [2021-11-19 21:15:36,760][INFO ][sys-#26635%grid-0%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=2], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (2 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (1 ms), stage="Wait partitions release latch [latch=exchange]" (6 ms), stage="Wait partitions release [latch=exchange]" (2 ms), stage="After states restored callback" (0 ms), stage="WAL history reservation" (1 ms), stage="Waiting for all single messages" (2 ms), stage="Affinity recalculation (crd)" (0 ms), stage="Collect update counters and create affinity messages" (0 ms), stage="Validate partitions states" (0 ms), stage="Apply update counters" (0 ms), stage="Full message preparing" (2 ms), stage="Full message sending" (0 ms), stage="Exchange done" (4 ms), stage="Total time" (20 ms), Discovery lag=1 ms, Latest started node id=20b6f4b9-0c69-4736-8d5a-f36aa10b9002] [21:15:36] : [Step 4/5] [2021-11-19 21:15:36,762][INFO ][sys-#26635%grid-0%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=2], stage="Affinity change by custom message [grp=ignite-sys-cache]" (0 ms) (parent=Determine exchange type)] [21:15:36] : [Step 4/5] [2021-11-19 21:15:36,759][INFO ][sys-#26919%grid-2%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=2], err=null, rebalanced=true, wasRebalanced=false] [21:15:36] : [Step 4/5] [2021-11-19 21:15:36,758][INFO ][sys-#26754%grid-1%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=2], err=null, rebalanced=true, wasRebalanced=false] [21:15:36] : [Step 4/5] [2021-11-19 21:15:36,764][INFO ][exchange-worker-#26939%grid-2%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=3, minorTopVer=2], force=false, evt=DISCOVERY_CUSTOM_EVT, node=008cb00a-6a9b-4c09-a154-85082cd15000] [21:15:36] : [Step 4/5] [2021-11-19 21:15:36,764][INFO ][sys-#26919%grid-2%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=20b6f4b9-0c69-4736-8d5a-f36aa10b9002, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=2], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=008cb00a-6a9b-4c09-a154-85082cd15000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345735009, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=3, minorTopVer=2]] [21:15:36]W: [org.apache.ignite:ignite-core] [2021-11-19 21:15:36,766][WARN ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][root] Finished waiting for topology map update [igniteInstanceName=grid-1, p=0, duration=1332ms] [21:15:36] : [Step 4/5] [2021-11-19 21:15:36,764][INFO ][exchange-worker-#26785%grid-1%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=3, minorTopVer=2], force=false, evt=DISCOVERY_CUSTOM_EVT, node=008cb00a-6a9b-4c09-a154-85082cd15000] [21:15:36] : [Step 4/5] [2021-11-19 21:15:36,764][INFO ][sys-#26754%grid-1%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=1085686a-9887-4e3d-9d8b-a64775ae4001, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=2], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=008cb00a-6a9b-4c09-a154-85082cd15000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345717070, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=3, minorTopVer=2]] [21:15:36] : [Step 4/5] [2021-11-19 21:15:36,767][INFO ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][root] awaitPartitionMapExchange finished [21:15:36] : [Step 4/5] [2021-11-19 21:15:36,766][INFO ][sys-#26919%grid-2%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=2], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (1 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (1 ms), stage="Wait partitions release latch [latch=exchange]" (8 ms), stage="Wait partitions release [latch=exchange]" (1 ms), stage="After states restored callback" (0 ms), stage="WAL history reservation" (0 ms), stage="Waiting for Full message" (8 ms), stage="Affinity recalculation" (2 ms), stage="Full map updating" (0 ms), stage="Exchange done" (6 ms), stage="Total time" (27 ms)] [21:15:36] : [Step 4/5] [2021-11-19 21:15:36,768][INFO ][sys-#26754%grid-1%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=2], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (0 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (2 ms), stage="Wait partitions release latch [latch=exchange]" (8 ms), stage="Wait partitions release [latch=exchange]" (1 ms), stage="After states restored callback" (0 ms), stage="WAL history reservation" (1 ms), stage="Waiting for Full message" (5 ms), stage="Affinity recalculation" (0 ms), stage="Full map updating" (1 ms), stage="Exchange done" (9 ms), stage="Total time" (27 ms)] [21:15:36] : [Step 4/5] [2021-11-19 21:15:36,769][INFO ][sys-#26919%grid-2%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=2], stage="Affinity change by custom message [grp=ignite-sys-cache]" (0 ms) (parent=Determine exchange type)] [21:15:36] : [Step 4/5] [2021-11-19 21:15:36,771][INFO ][sys-#26754%grid-1%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=2], stage="Affinity change by custom message [grp=ignite-sys-cache]" (0 ms) (parent=Determine exchange type)] [21:15:36] : [Step 4/5] [2021-11-19 21:15:36,865][INFO ][wal-file-archiver%grid-0-#26788%grid-0%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000000.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000080.wal] [21:15:36] : [Step 4/5] [2021-11-19 21:15:36,865][INFO ][wal-file-archiver%grid-0-#26788%grid-0%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=81, segIdx=1, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000001.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000081.wal] [21:15:36] : [Step 4/5] [2021-11-19 21:15:36,867][INFO ][wal-file-cleaner%grid-0-#26789%grid-0%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=72, currSize=10.0 MB, maxSize=20.0 MB] [21:15:36] : [Step 4/5] [2021-11-19 21:15:36,868][INFO ][wal-file-cleaner%grid-0-#26789%grid-0%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:15:36] : [Step 4/5] [2021-11-19 21:15:36,910][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000009.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000139.wal] [21:15:36] : [Step 4/5] [2021-11-19 21:15:36,911][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=140, segIdx=0, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000000.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000140.wal] [21:15:36] : [Step 4/5] [2021-11-19 21:15:36,912][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=131, currSize=10.0 MB, maxSize=20.0 MB] [21:15:36] : [Step 4/5] [2021-11-19 21:15:36,913][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:15:36] : [Step 4/5] [2021-11-19 21:15:36,933][INFO ][wal-file-archiver%grid-0-#26788%grid-0%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000001.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000081.wal] [21:15:36] : [Step 4/5] [2021-11-19 21:15:36,933][INFO ][wal-file-archiver%grid-0-#26788%grid-0%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=82, segIdx=2, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000002.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000082.wal] [21:15:36] : [Step 4/5] [2021-11-19 21:15:36,934][INFO ][wal-file-cleaner%grid-0-#26789%grid-0%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=73, currSize=10.0 MB, maxSize=20.0 MB] [21:15:36] : [Step 4/5] [2021-11-19 21:15:36,936][INFO ][wal-file-cleaner%grid-0-#26789%grid-0%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:15:37] : [Step 4/5] [2021-11-19 21:15:37,107][INFO ][wal-file-archiver%grid-0-#26788%grid-0%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000002.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000082.wal] [21:15:37] : [Step 4/5] [2021-11-19 21:15:37,107][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000000.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000140.wal] [21:15:37] : [Step 4/5] [2021-11-19 21:15:37,108][INFO ][wal-file-archiver%grid-0-#26788%grid-0%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=83, segIdx=3, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000003.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000083.wal] [21:15:37] : [Step 4/5] [2021-11-19 21:15:37,109][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=141, segIdx=1, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000001.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000141.wal] [21:15:37] : [Step 4/5] [2021-11-19 21:15:37,110][INFO ][wal-file-cleaner%grid-0-#26789%grid-0%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=74, currSize=10.0 MB, maxSize=20.0 MB] [21:15:37] : [Step 4/5] [2021-11-19 21:15:37,110][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=132, currSize=10.0 MB, maxSize=20.0 MB] [21:15:37] : [Step 4/5] [2021-11-19 21:15:37,110][INFO ][db-checkpoint-thread-#26801%grid-1%][Checkpointer] Checkpoint finished [cpId=d446145e-0c40-4ab8-8c3d-c3ef870d6cd5, pages=1125, markPos=WALPointer [idx=139, fileOff=379317, len=2048], walSegmentsCovered=[134 - 138], markDuration=398ms, pagesWrite=169ms, fsync=326ms, total=903ms] [21:15:37] : [Step 4/5] [2021-11-19 21:15:37,110][INFO ][db-checkpoint-thread-#26796%grid-0%][Checkpointer] Checkpoint finished [cpId=3f282704-fd24-49eb-83ac-b0c0996220d9, pages=1001, markPos=WALPointer [idx=80, fileOff=215592, len=2010], walSegmentsCovered=[75 - 79], markDuration=497ms, pagesWrite=47ms, fsync=538ms, total=1088ms] [21:15:37] : [Step 4/5] [2021-11-19 21:15:37,112][INFO ][wal-file-cleaner%grid-0-#26789%grid-0%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:15:37] : [Step 4/5] [2021-11-19 21:15:37,112][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:15:37] : [Step 4/5] [2021-11-19 21:15:37,136][INFO ][wal-file-archiver%grid-0-#26788%grid-0%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000003.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000083.wal] [21:15:37] : [Step 4/5] [2021-11-19 21:15:37,136][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000001.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000141.wal] [21:15:37] : [Step 4/5] [2021-11-19 21:15:37,137][INFO ][wal-file-archiver%grid-0-#26788%grid-0%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=84, segIdx=4, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000004.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000084.wal] [21:15:37] : [Step 4/5] [2021-11-19 21:15:37,137][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=142, segIdx=2, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000002.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000142.wal] [21:15:37] : [Step 4/5] [2021-11-19 21:15:37,138][INFO ][wal-file-cleaner%grid-0-#26789%grid-0%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=75, currSize=10.0 MB, maxSize=20.0 MB] [21:15:37] : [Step 4/5] [2021-11-19 21:15:37,139][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=133, currSize=10.0 MB, maxSize=20.0 MB] [21:15:37] : [Step 4/5] [2021-11-19 21:15:37,139][INFO ][db-checkpoint-thread-#26796%grid-0%][Checkpointer] Checkpoint started [checkpointId=fb39854b-dc8b-43a3-ad98-ad4fb767b7ca, startPtr=WALPointer [idx=86, fileOff=511697, len=2010], checkpointBeforeLockTime=1ms, checkpointLockWait=11ms, checkpointListenersExecuteTime=3ms, checkpointLockHoldTime=6ms, walCpRecordFsyncDuration=6ms, writeCheckpointEntryDuration=2ms, splitAndSortCpPagesDuration=1ms, pages=1582, reason='too big size of WAL without checkpoint'] [21:15:37] : [Step 4/5] [2021-11-19 21:15:37,139][INFO ][db-checkpoint-thread-#26801%grid-1%][Checkpointer] Checkpoint started [checkpointId=cb545ecf-c932-4c62-aed0-600a76e3e9ef, startPtr=WALPointer [idx=144, fileOff=544969, len=2048], checkpointBeforeLockTime=1ms, checkpointLockWait=13ms, checkpointListenersExecuteTime=1ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=10ms, writeCheckpointEntryDuration=2ms, splitAndSortCpPagesDuration=1ms, pages=1299, reason='too big size of WAL without checkpoint'] [21:15:37] : [Step 4/5] [2021-11-19 21:15:37,141][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:15:37] : [Step 4/5] [2021-11-19 21:15:37,140][INFO ][wal-file-cleaner%grid-0-#26789%grid-0%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:15:37] : [Step 4/5] [2021-11-19 21:15:37,162][INFO ][wal-file-archiver%grid-0-#26788%grid-0%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000004.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000084.wal] [21:15:37] : [Step 4/5] [2021-11-19 21:15:37,162][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000002.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000142.wal] [21:15:37] : [Step 4/5] [2021-11-19 21:15:37,162][INFO ][wal-file-archiver%grid-0-#26788%grid-0%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=85, segIdx=5, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000005.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000085.wal] [21:15:37] : [Step 4/5] [2021-11-19 21:15:37,165][INFO ][wal-file-cleaner%grid-0-#26789%grid-0%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=76, currSize=10.0 MB, maxSize=20.0 MB] [21:15:37] : [Step 4/5] [2021-11-19 21:15:37,163][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=143, segIdx=3, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000003.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000143.wal] [21:15:37] : [Step 4/5] [2021-11-19 21:15:37,167][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=134, currSize=10.0 MB, maxSize=20.0 MB] [21:15:37] : [Step 4/5] [2021-11-19 21:15:37,166][INFO ][wal-file-cleaner%grid-0-#26789%grid-0%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:15:37] : [Step 4/5] [2021-11-19 21:15:37,168][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:15:37] : [Step 4/5] [2021-11-19 21:15:37,181][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000003.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000143.wal] [21:15:37] : [Step 4/5] [2021-11-19 21:15:37,181][INFO ][wal-file-archiver%grid-0-#26788%grid-0%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000005.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000085.wal] [21:15:37] : [Step 4/5] [2021-11-19 21:15:37,181][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=144, segIdx=4, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000004.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000144.wal] [21:15:37] : [Step 4/5] [2021-11-19 21:15:37,182][INFO ][wal-file-archiver%grid-0-#26788%grid-0%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=86, segIdx=6, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000006.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000086.wal] [21:15:37] : [Step 4/5] [2021-11-19 21:15:37,183][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=135, currSize=10.0 MB, maxSize=20.0 MB] [21:15:37] : [Step 4/5] [2021-11-19 21:15:37,183][INFO ][wal-file-cleaner%grid-0-#26789%grid-0%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=77, currSize=10.0 MB, maxSize=20.0 MB] [21:15:37] : [Step 4/5] [2021-11-19 21:15:37,185][INFO ][wal-file-cleaner%grid-0-#26789%grid-0%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:15:37] : [Step 4/5] [2021-11-19 21:15:37,185][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:15:37] : [Step 4/5] [2021-11-19 21:15:37,199][INFO ][wal-file-archiver%grid-0-#26788%grid-0%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000006.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000086.wal] [21:15:37] : [Step 4/5] [2021-11-19 21:15:37,200][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000004.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000144.wal] [21:15:37] : [Step 4/5] [2021-11-19 21:15:37,281][INFO ][wal-file-archiver%grid-0-#26788%grid-0%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=87, segIdx=7, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000007.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000087.wal] [21:15:37] : [Step 4/5] [2021-11-19 21:15:37,281][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=145, segIdx=5, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000005.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000145.wal] [21:15:37] : [Step 4/5] [2021-11-19 21:15:37,282][INFO ][wal-file-cleaner%grid-0-#26789%grid-0%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=78, currSize=10.0 MB, maxSize=20.0 MB] [21:15:37] : [Step 4/5] [2021-11-19 21:15:37,283][INFO ][wal-file-cleaner%grid-0-#26789%grid-0%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:15:37] : [Step 4/5] [2021-11-19 21:15:37,286][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=136, currSize=10.0 MB, maxSize=20.0 MB] [21:15:37] : [Step 4/5] [2021-11-19 21:15:37,288][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:15:37] : [Step 4/5] [2021-11-19 21:15:37,484][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000005.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000145.wal] [21:15:37] : [Step 4/5] [2021-11-19 21:15:37,484][INFO ][wal-file-archiver%grid-0-#26788%grid-0%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000007.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000087.wal] [21:15:37] : [Step 4/5] [2021-11-19 21:15:37,649][INFO ][wal-file-archiver%grid-0-#26788%grid-0%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=88, segIdx=8, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000008.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000088.wal] [21:15:37] : [Step 4/5] [2021-11-19 21:15:37,649][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=146, segIdx=6, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000006.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000146.wal] [21:15:37] : [Step 4/5] [2021-11-19 21:15:37,651][INFO ][wal-file-cleaner%grid-0-#26789%grid-0%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=79, currSize=10.0 MB, maxSize=20.0 MB] [21:15:37] : [Step 4/5] [2021-11-19 21:15:37,651][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=137, currSize=10.0 MB, maxSize=20.0 MB] [21:15:37] : [Step 4/5] [2021-11-19 21:15:37,652][INFO ][wal-file-cleaner%grid-0-#26789%grid-0%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:15:37] : [Step 4/5] [2021-11-19 21:15:37,653][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:15:37] : [Step 4/5] [2021-11-19 21:15:37,932][INFO ][db-checkpoint-thread-#26801%grid-1%][Checkpointer] Checkpoint finished [cpId=cb545ecf-c932-4c62-aed0-600a76e3e9ef, pages=1299, markPos=WALPointer [idx=144, fileOff=544969, len=2048], walSegmentsCovered=[139 - 143], markDuration=16ms, pagesWrite=93ms, fsync=698ms, total=821ms] [21:15:37] : [Step 4/5] [2021-11-19 21:15:37,932][INFO ][db-checkpoint-thread-#26796%grid-0%][Checkpointer] Checkpoint finished [cpId=fb39854b-dc8b-43a3-ad98-ad4fb767b7ca, pages=1582, markPos=WALPointer [idx=86, fileOff=511697, len=2010], walSegmentsCovered=[80 - 85], markDuration=16ms, pagesWrite=105ms, fsync=687ms, total=820ms] [21:15:38] : [Step 4/5] [2021-11-19 21:15:38,030][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000006.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000146.wal] [21:15:38] : [Step 4/5] [2021-11-19 21:15:38,031][INFO ][wal-file-archiver%grid-0-#26788%grid-0%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000008.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000088.wal] [21:15:38] : [Step 4/5] [2021-11-19 21:15:38,032][INFO ][wal-file-archiver%grid-0-#26788%grid-0%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=89, segIdx=9, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000009.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000089.wal] [21:15:38] : [Step 4/5] [2021-11-19 21:15:38,033][INFO ][wal-file-cleaner%grid-0-#26789%grid-0%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=80, currSize=10.0 MB, maxSize=20.0 MB] [21:15:38] : [Step 4/5] [2021-11-19 21:15:38,031][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=147, segIdx=7, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000007.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000147.wal] [21:15:38] : [Step 4/5] [2021-11-19 21:15:38,039][INFO ][wal-file-cleaner%grid-0-#26789%grid-0%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:15:38] : [Step 4/5] [2021-11-19 21:15:38,040][INFO ][db-checkpoint-thread-#26801%grid-1%][Checkpointer] Checkpoint started [checkpointId=c630cd8c-fe61-4caa-b62d-62ea3a30ca06, startPtr=WALPointer [idx=148, fileOff=129106, len=2048], checkpointBeforeLockTime=1ms, checkpointLockWait=2ms, checkpointListenersExecuteTime=1ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=95ms, writeCheckpointEntryDuration=8ms, splitAndSortCpPagesDuration=0ms, pages=907, reason='too big size of WAL without checkpoint'] [21:15:38] : [Step 4/5] [2021-11-19 21:15:38,039][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=138, currSize=10.0 MB, maxSize=20.0 MB] [21:15:38] : [Step 4/5] [2021-11-19 21:15:38,042][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:15:38] : [Step 4/5] [2021-11-19 21:15:38,062][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000007.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000147.wal] [21:15:38] : [Step 4/5] [2021-11-19 21:15:38,062][INFO ][wal-file-archiver%grid-0-#26788%grid-0%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000009.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000089.wal] [21:15:38] : [Step 4/5] [2021-11-19 21:15:38,062][INFO ][wal-file-archiver%grid-0-#26788%grid-0%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=90, segIdx=0, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000000.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000090.wal] [21:15:38] : [Step 4/5] [2021-11-19 21:15:38,062][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=148, segIdx=8, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000008.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000148.wal] [21:15:38] : [Step 4/5] [2021-11-19 21:15:38,064][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=139, currSize=10.0 MB, maxSize=20.0 MB] [21:15:38] : [Step 4/5] [2021-11-19 21:15:38,066][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:15:38] : [Step 4/5] [2021-11-19 21:15:38,062][INFO ][db-checkpoint-thread-#26796%grid-0%][Checkpointer] Checkpoint started [checkpointId=fc09a28d-ddd1-4820-bf94-ef9408a00f4a, startPtr=WALPointer [idx=90, fileOff=466096, len=2010], checkpointBeforeLockTime=0ms, checkpointLockWait=58ms, checkpointListenersExecuteTime=1ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=46ms, writeCheckpointEntryDuration=23ms, splitAndSortCpPagesDuration=1ms, pages=996, reason='too big size of WAL without checkpoint'] [21:15:38] : [Step 4/5] [2021-11-19 21:15:38,064][INFO ][wal-file-cleaner%grid-0-#26789%grid-0%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=81, currSize=10.0 MB, maxSize=20.0 MB] [21:15:38] : [Step 4/5] [2021-11-19 21:15:38,071][INFO ][wal-file-cleaner%grid-0-#26789%grid-0%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:15:38] : [Step 4/5] [2021-11-19 21:15:38,079][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000008.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000148.wal] [21:15:38] : [Step 4/5] [2021-11-19 21:15:38,080][INFO ][wal-file-archiver%grid-0-#26788%grid-0%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000000.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000090.wal] [21:15:38] : [Step 4/5] [2021-11-19 21:15:38,104][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=149, segIdx=9, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000009.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000149.wal] [21:15:38] : [Step 4/5] [2021-11-19 21:15:38,106][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=140, currSize=10.0 MB, maxSize=20.0 MB] [21:15:38] : [Step 4/5] [2021-11-19 21:15:38,107][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:15:38] : [Step 4/5] [2021-11-19 21:15:38,137][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000009.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000149.wal] [21:15:38] : [Step 4/5] [2021-11-19 21:15:38,137][INFO ][db-checkpoint-thread-#26801%grid-1%][Checkpointer] Checkpoint finished [cpId=c630cd8c-fe61-4caa-b62d-62ea3a30ca06, pages=907, markPos=WALPointer [idx=148, fileOff=129106, len=2048], walSegmentsCovered=[144 - 147], markDuration=105ms, pagesWrite=59ms, fsync=38ms, total=205ms] [21:15:38] : [Step 4/5] [2021-11-19 21:15:38,140][INFO ][wal-file-archiver%grid-0-#26788%grid-0%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=91, segIdx=1, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000001.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000091.wal] [21:15:38] : [Step 4/5] [2021-11-19 21:15:38,141][INFO ][wal-file-cleaner%grid-0-#26789%grid-0%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=82, currSize=10.0 MB, maxSize=20.0 MB] [21:15:38] : [Step 4/5] [2021-11-19 21:15:38,142][INFO ][wal-file-cleaner%grid-0-#26789%grid-0%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:15:38] : [Step 4/5] [2021-11-19 21:15:38,168][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=150, segIdx=0, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000000.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000150.wal] [21:15:38] : [Step 4/5] [2021-11-19 21:15:38,265][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=141, currSize=10.0 MB, maxSize=20.0 MB] [21:15:38] : [Step 4/5] [2021-11-19 21:15:38,266][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:15:38] : [Step 4/5] [2021-11-19 21:15:38,309][INFO ][wal-file-archiver%grid-0-#26788%grid-0%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000001.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000091.wal] [21:15:38] : [Step 4/5] [2021-11-19 21:15:38,310][INFO ][wal-file-archiver%grid-0-#26788%grid-0%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=92, segIdx=2, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000002.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000092.wal] [21:15:38] : [Step 4/5] [2021-11-19 21:15:38,311][INFO ][wal-file-cleaner%grid-0-#26789%grid-0%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=83, currSize=10.0 MB, maxSize=20.0 MB] [21:15:38] : [Step 4/5] [2021-11-19 21:15:38,313][INFO ][wal-file-cleaner%grid-0-#26789%grid-0%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:15:38] : [Step 4/5] [2021-11-19 21:15:38,594][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000000.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000150.wal] [21:15:38] : [Step 4/5] [2021-11-19 21:15:38,594][INFO ][wal-file-archiver%grid-0-#26788%grid-0%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000002.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000092.wal] [21:15:38] : [Step 4/5] [2021-11-19 21:15:38,595][INFO ][db-checkpoint-thread-#26801%grid-1%][Checkpointer] Checkpoint started [checkpointId=914b6cd4-6299-4143-8735-87350caa7dd4, startPtr=WALPointer [idx=151, fileOff=158182, len=2048], checkpointBeforeLockTime=1ms, checkpointLockWait=130ms, checkpointListenersExecuteTime=1ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=15ms, writeCheckpointEntryDuration=309ms, splitAndSortCpPagesDuration=1ms, pages=762, reason='too big size of WAL without checkpoint'] [21:15:38] : [Step 4/5] [2021-11-19 21:15:38,594][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=151, segIdx=1, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000001.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000151.wal] [21:15:38] : [Step 4/5] [2021-11-19 21:15:38,595][INFO ][db-checkpoint-thread-#26796%grid-0%][Checkpointer] Checkpoint finished [cpId=fc09a28d-ddd1-4820-bf94-ef9408a00f4a, pages=996, markPos=WALPointer [idx=90, fileOff=466096, len=2010], walSegmentsCovered=[86 - 89], markDuration=78ms, pagesWrite=59ms, fsync=467ms, total=662ms] [21:15:38] : [Step 4/5] [2021-11-19 21:15:38,595][INFO ][wal-file-archiver%grid-0-#26788%grid-0%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=93, segIdx=3, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000003.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000093.wal] [21:15:38] : [Step 4/5] [2021-11-19 21:15:38,597][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=142, currSize=10.0 MB, maxSize=20.0 MB] [21:15:38] : [Step 4/5] [2021-11-19 21:15:38,599][INFO ][wal-file-cleaner%grid-0-#26789%grid-0%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=84, currSize=10.0 MB, maxSize=20.0 MB] [21:15:38] : [Step 4/5] [2021-11-19 21:15:38,599][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:15:38] : [Step 4/5] [2021-11-19 21:15:38,600][INFO ][wal-file-cleaner%grid-0-#26789%grid-0%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:15:38] : [Step 4/5] [2021-11-19 21:15:38,614][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000001.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000151.wal] [21:15:38] : [Step 4/5] [2021-11-19 21:15:38,614][INFO ][wal-file-archiver%grid-0-#26788%grid-0%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000003.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0/0000000000000093.wal] [21:15:38] : [Step 4/5] [2021-11-19 21:15:38,633][INFO ][db-checkpoint-thread-#26796%grid-0%][Checkpointer] Checkpoint started [checkpointId=dd8e9296-45e5-4824-b558-aeacdf2589cb, startPtr=WALPointer [idx=94, fileOff=440994, len=2010], checkpointBeforeLockTime=1ms, checkpointLockWait=20ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=5ms, writeCheckpointEntryDuration=9ms, splitAndSortCpPagesDuration=1ms, pages=1001, reason='too big size of WAL without checkpoint'] [21:15:38] : [Step 4/5] [2021-11-19 21:15:38,647][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=152, segIdx=2, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000002.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000152.wal] [21:15:38] : [Step 4/5] [2021-11-19 21:15:38,649][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=143, currSize=10.0 MB, maxSize=20.0 MB] [21:15:38] : [Step 4/5] [2021-11-19 21:15:38,650][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:15:38] : [Step 4/5] [2021-11-19 21:15:38,671][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000002.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000152.wal] [21:15:38] : [Step 4/5] [2021-11-19 21:15:38,681][INFO ][db-checkpoint-thread-#26801%grid-1%][Checkpointer] Checkpoint finished [cpId=914b6cd4-6299-4143-8735-87350caa7dd4, pages=762, markPos=WALPointer [idx=151, fileOff=158182, len=2048], walSegmentsCovered=[148 - 150], markDuration=327ms, pagesWrite=45ms, fsync=40ms, total=543ms] [21:15:38] : [Step 4/5] [2021-11-19 21:15:38,713][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=153, segIdx=3, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000003.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000153.wal] [21:15:38] : [Step 4/5] [2021-11-19 21:15:38,714][INFO ][db-checkpoint-thread-#26796%grid-0%][Checkpointer] Checkpoint finished [cpId=dd8e9296-45e5-4824-b558-aeacdf2589cb, pages=1001, markPos=WALPointer [idx=94, fileOff=440994, len=2010], walSegmentsCovered=[90 - 93], markDuration=16ms, pagesWrite=48ms, fsync=32ms, total=117ms] [21:15:38] : [Step 4/5] [2021-11-19 21:15:38,714][INFO ][db-checkpoint-thread-#26801%grid-1%][Checkpointer] Checkpoint started [checkpointId=07d9d929-2517-4fe1-8170-a85b9fec5033, startPtr=WALPointer [idx=153, fileOff=981664, len=2048], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=29ms, writeCheckpointEntryDuration=2ms, splitAndSortCpPagesDuration=0ms, pages=701, reason='too big size of WAL without checkpoint'] [21:15:38] : [Step 4/5] [2021-11-19 21:15:38,714][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=144, currSize=10.0 MB, maxSize=20.0 MB] [21:15:38] : [Step 4/5] [2021-11-19 21:15:38,717][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:15:38] : [Step 4/5] [2021-11-19 21:15:38,727][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000003.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000153.wal] [21:15:38] : [Step 4/5] [2021-11-19 21:15:38,769][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=154, segIdx=4, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000004.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000154.wal] [21:15:38] : [Step 4/5] [2021-11-19 21:15:38,770][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=145, currSize=10.0 MB, maxSize=20.0 MB] [21:15:38] : [Step 4/5] [2021-11-19 21:15:38,770][INFO ][db-checkpoint-thread-#26801%grid-1%][Checkpointer] Checkpoint finished [cpId=07d9d929-2517-4fe1-8170-a85b9fec5033, pages=701, markPos=WALPointer [idx=153, fileOff=981664, len=2048], walSegmentsCovered=[151 - 152], markDuration=33ms, pagesWrite=33ms, fsync=21ms, total=88ms] [21:15:38] : [Step 4/5] [2021-11-19 21:15:38,771][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:15:38] : [Step 4/5] [2021-11-19 21:15:38,785][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000004.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000154.wal] [21:15:38] : [Step 4/5] [2021-11-19 21:15:38,805][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=155, segIdx=5, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000005.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000155.wal] [21:15:38] : [Step 4/5] [2021-11-19 21:15:38,806][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=146, currSize=10.0 MB, maxSize=20.0 MB] [21:15:38] : [Step 4/5] [2021-11-19 21:15:38,807][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:15:38] : [Step 4/5] [2021-11-19 21:15:38,816][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000005.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000155.wal] [21:15:38] : [Step 4/5] [2021-11-19 21:15:38,843][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=156, segIdx=6, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000006.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000156.wal] [21:15:38] : [Step 4/5] [2021-11-19 21:15:38,844][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=147, currSize=10.0 MB, maxSize=20.0 MB] [21:15:38] : [Step 4/5] [2021-11-19 21:15:38,845][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:15:38] : [Step 4/5] [2021-11-19 21:15:38,853][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000006.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000156.wal] [21:15:38] : [Step 4/5] [2021-11-19 21:15:38,885][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=157, segIdx=7, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000007.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000157.wal] [21:15:38] : [Step 4/5] [2021-11-19 21:15:38,886][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=148, currSize=10.0 MB, maxSize=20.0 MB] [21:15:38] : [Step 4/5] [2021-11-19 21:15:38,888][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:15:38] : [Step 4/5] [2021-11-19 21:15:38,897][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000007.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000157.wal] [21:15:38] : [Step 4/5] [2021-11-19 21:15:38,899][INFO ][db-checkpoint-thread-#26801%grid-1%][Checkpointer] Checkpoint started [checkpointId=ddeb842a-154a-4286-a59f-8b5ac899c21f, startPtr=WALPointer [idx=158, fileOff=283063, len=2048], checkpointBeforeLockTime=1ms, checkpointLockWait=8ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=3ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=1ms, pages=1091, reason='too big size of WAL without checkpoint'] [21:15:38] : [Step 4/5] [2021-11-19 21:15:38,924][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=158, segIdx=8, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000008.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000158.wal] [21:15:38] : [Step 4/5] [2021-11-19 21:15:38,925][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=149, currSize=10.0 MB, maxSize=20.0 MB] [21:15:38] : [Step 4/5] [2021-11-19 21:15:38,926][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:15:38] : [Step 4/5] [2021-11-19 21:15:38,934][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000008.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000158.wal] [21:15:38] : [Step 4/5] [2021-11-19 21:15:38,972][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=159, segIdx=9, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000009.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000159.wal] [21:15:38] : [Step 4/5] [2021-11-19 21:15:38,973][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=150, currSize=10.0 MB, maxSize=20.0 MB] [21:15:38] : [Step 4/5] [2021-11-19 21:15:38,974][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:15:38] : [Step 4/5] [2021-11-19 21:15:38,991][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000009.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000159.wal] [21:15:39] : [Step 4/5] [2021-11-19 21:15:38,999][INFO ][db-checkpoint-thread-#26801%grid-1%][Checkpointer] Checkpoint finished [cpId=ddeb842a-154a-4286-a59f-8b5ac899c21f, pages=1091, markPos=WALPointer [idx=158, fileOff=283063, len=2048], walSegmentsCovered=[153 - 157], markDuration=6ms, pagesWrite=56ms, fsync=43ms, total=114ms] [21:15:39] : [Step 4/5] [2021-11-19 21:15:39,013][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=160, segIdx=0, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000000.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000160.wal] [21:15:39] : [Step 4/5] [2021-11-19 21:15:39,014][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=151, currSize=10.0 MB, maxSize=20.0 MB] [21:15:39] : [Step 4/5] [2021-11-19 21:15:39,016][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:15:39] : [Step 4/5] [2021-11-19 21:15:39,019][INFO ][db-checkpoint-thread-#26801%grid-1%][Checkpointer] Checkpoint started [checkpointId=e119af82-3779-441c-8fc3-0275d40e183f, startPtr=WALPointer [idx=161, fileOff=58366, len=2048], checkpointBeforeLockTime=0ms, checkpointLockWait=16ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=0ms, writeCheckpointEntryDuration=2ms, splitAndSortCpPagesDuration=0ms, pages=701, reason='too big size of WAL without checkpoint'] [21:15:39] : [Step 4/5] [2021-11-19 21:15:39,033][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000000.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000160.wal] [21:15:39] : [Step 4/5] [2021-11-19 21:15:39,057][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=161, segIdx=1, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000001.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000161.wal] [21:15:39] : [Step 4/5] [2021-11-19 21:15:39,058][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=152, currSize=10.0 MB, maxSize=20.0 MB] [21:15:39] : [Step 4/5] [2021-11-19 21:15:39,060][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:15:39] : [Step 4/5] [2021-11-19 21:15:39,085][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000001.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000161.wal] [21:15:39] : [Step 4/5] [2021-11-19 21:15:39,094][INFO ][db-checkpoint-thread-#26801%grid-1%][Checkpointer] Checkpoint finished [cpId=e119af82-3779-441c-8fc3-0275d40e183f, pages=701, markPos=WALPointer [idx=161, fileOff=58366, len=2048], walSegmentsCovered=[158 - 160], markDuration=4ms, pagesWrite=43ms, fsync=31ms, total=94ms] [21:15:39] : [Step 4/5] [2021-11-19 21:15:39,116][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=162, segIdx=2, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000002.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000162.wal] [21:15:39] : [Step 4/5] [2021-11-19 21:15:39,117][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=153, currSize=10.0 MB, maxSize=20.0 MB] [21:15:39] : [Step 4/5] [2021-11-19 21:15:39,119][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:15:39] : [Step 4/5] [2021-11-19 21:15:39,129][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000002.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000162.wal] [21:15:39] : [Step 4/5] [2021-11-19 21:15:39,156][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=163, segIdx=3, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000003.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000163.wal] [21:15:39] : [Step 4/5] [2021-11-19 21:15:39,157][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=154, currSize=10.0 MB, maxSize=20.0 MB] [21:15:39] : [Step 4/5] [2021-11-19 21:15:39,158][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:15:39] : [Step 4/5] [2021-11-19 21:15:39,169][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000003.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000163.wal] [21:15:39] : [Step 4/5] [2021-11-19 21:15:39,191][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=164, segIdx=4, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000004.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000164.wal] [21:15:39] : [Step 4/5] [2021-11-19 21:15:39,193][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=155, currSize=10.0 MB, maxSize=20.0 MB] [21:15:39] : [Step 4/5] [2021-11-19 21:15:39,194][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:15:39] : [Step 4/5] [2021-11-19 21:15:39,484][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000004.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000164.wal] [21:15:39] : [Step 4/5] [2021-11-19 21:15:39,484][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=165, segIdx=5, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000005.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000165.wal] [21:15:39] : [Step 4/5] [2021-11-19 21:15:39,485][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=156, currSize=10.0 MB, maxSize=20.0 MB] [21:15:39] : [Step 4/5] [2021-11-19 21:15:39,486][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:15:39] : [Step 4/5] [2021-11-19 21:15:39,580][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000005.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000165.wal] [21:15:39] : [Step 4/5] [2021-11-19 21:15:39,591][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=166, segIdx=6, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000006.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000166.wal] [21:15:39] : [Step 4/5] [2021-11-19 21:15:39,593][INFO ][db-checkpoint-thread-#26801%grid-1%][Checkpointer] Checkpoint started [checkpointId=605d2ebc-9bad-4f12-9b65-d6d63fa57550, startPtr=WALPointer [idx=166, fileOff=332971, len=2048], checkpointBeforeLockTime=0ms, checkpointLockWait=11ms, checkpointListenersExecuteTime=1ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=83ms, writeCheckpointEntryDuration=12ms, splitAndSortCpPagesDuration=2ms, pages=1325, reason='too big size of WAL without checkpoint'] [21:15:39] : [Step 4/5] [2021-11-19 21:15:39,594][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=157, currSize=10.0 MB, maxSize=20.0 MB] [21:15:39] : [Step 4/5] [2021-11-19 21:15:39,596][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:15:39] : [Step 4/5] [2021-11-19 21:15:39,605][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000006.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000166.wal] [21:15:39] : [Step 4/5] [2021-11-19 21:15:39,639][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=167, segIdx=7, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000007.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000167.wal] [21:15:39] : [Step 4/5] [2021-11-19 21:15:39,640][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=158, currSize=10.0 MB, maxSize=20.0 MB] [21:15:39] : [Step 4/5] [2021-11-19 21:15:39,642][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:15:39] : [Step 4/5] [2021-11-19 21:15:39,649][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000007.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000167.wal] [21:15:39] : [Step 4/5] [2021-11-19 21:15:39,700][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Starting to copy WAL segment [absIdx=168, segIdx=8, origFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000008.wal, dstFile=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000168.wal] [21:15:39] : [Step 4/5] [2021-11-19 21:15:39,702][INFO ][db-checkpoint-thread-#26801%grid-1%][Checkpointer] Checkpoint finished [cpId=605d2ebc-9bad-4f12-9b65-d6d63fa57550, pages=1325, markPos=WALPointer [idx=166, fileOff=332971, len=2048], walSegmentsCovered=[161 - 165], markDuration=99ms, pagesWrite=63ms, fsync=44ms, total=217ms] [21:15:39] : [Step 4/5] [2021-11-19 21:15:39,705][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Starting to clean WAL archive [highIdx=159, currSize=10.0 MB, maxSize=20.0 MB] [21:15:39] : [Step 4/5] [2021-11-19 21:15:39,706][INFO ][wal-file-cleaner%grid-1-#26793%grid-1%][FileWriteAheadLogManager] Finish clean WAL archive [cleanCnt=1, currSize=9.0 MB, maxSize=20.0 MB] [21:15:39] : [Step 4/5] [2021-11-19 21:15:39,716][INFO ][wal-file-archiver%grid-1-#26792%grid-1%][FileWriteAheadLogManager] Copied file [src=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000008.wal, dst=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1/0000000000000168.wal] [21:15:39] : [Step 4/5] [2021-11-19 21:15:39,724][INFO ][db-checkpoint-thread-#26801%grid-1%][Checkpointer] Checkpoint started [checkpointId=7056057e-d18e-404c-b934-e8cca4a1c623, startPtr=WALPointer [idx=169, fileOff=108274, len=2048], checkpointBeforeLockTime=1ms, checkpointLockWait=4ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=7ms, writeCheckpointEntryDuration=9ms, splitAndSortCpPagesDuration=0ms, pages=701, reason='too big size of WAL without checkpoint'] [21:15:39] : [Step 4/5] [2021-11-19 21:15:39,778][INFO ][db-checkpoint-thread-#26801%grid-1%][Checkpointer] Checkpoint finished [cpId=7056057e-d18e-404c-b934-e8cca4a1c623, pages=701, markPos=WALPointer [idx=169, fileOff=108274, len=2048], walSegmentsCovered=[166 - 168], markDuration=18ms, pagesWrite=34ms, fsync=19ms, total=76ms] [21:15:39] : [Step 4/5] [2021-11-19 21:15:39,790][INFO ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=1085686a-9887-4e3d-9d8b-a64775ae4001, grp=1613773252] [21:15:39] : [Step 4/5] [2021-11-19 21:15:39,793][INFO ][db-checkpoint-thread-#26801%grid-1%][Checkpointer] Checkpoint started [checkpointId=53ae55d9-22af-443f-b690-a789b87939cc, startPtr=WALPointer [idx=169, fileOff=243489, len=2048], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=1ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=0ms, pages=32, reason='test'] [21:15:39] : [Step 4/5] [2021-11-19 21:15:39,803][INFO ][db-checkpoint-thread-#26801%grid-1%][GridEncryptionManager] Previous encryption keys were removed [grpId=1613773252, keyIds=[0]] [21:15:39] : [Step 4/5] [2021-11-19 21:15:39,804][INFO ][db-checkpoint-thread-#26801%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:15:39] : [Step 4/5] [2021-11-19 21:15:39,804][INFO ][db-checkpoint-thread-#26801%grid-1%][Checkpointer] Checkpoint finished [cpId=53ae55d9-22af-443f-b690-a789b87939cc, pages=32, markPos=WALPointer [idx=169, fileOff=243489, len=2048], walSegmentsCovered=[], markDuration=3ms, pagesWrite=2ms, fsync=8ms, total=13ms] [21:15:39] : [Step 4/5] [2021-11-19 21:15:39,920][INFO ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=20b6f4b9-0c69-4736-8d5a-f36aa10b9002, grp=1613773252] [21:15:39] : [Step 4/5] [2021-11-19 21:15:39,920][INFO ][test-runner-#26545%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=008cb00a-6a9b-4c09-a154-85082cd15000, grp=1613773252] [21:15:40] : [Step 4/5] [2021-11-19 21:15:40,187][INFO ][db-checkpoint-thread-#26796%grid-0%][Checkpointer] Checkpoint started [checkpointId=15069788-3997-49fa-919c-a3df0b6c954e, startPtr=WALPointer [idx=94, fileOff=638556, len=2010], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=1ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=88ms, writeCheckpointEntryDuration=177ms, splitAndSortCpPagesDuration=0ms, pages=47, reason='test'] [21:15:40] : [Step 4/5] [2021-11-19 21:15:40,198][INFO ][db-checkpoint-thread-#26796%grid-0%][GridEncryptionManager] Previous encryption keys were removed [grpId=1613773252, keyIds=[0]] [21:15:40] : [Step 4/5] [2021-11-19 21:15:40,198][INFO ][db-checkpoint-thread-#26796%grid-0%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:15:40] : [Step 4/5] [2021-11-19 21:15:40,199][INFO ][db-checkpoint-thread-#26796%grid-0%][Checkpointer] Checkpoint finished [cpId=15069788-3997-49fa-919c-a3df0b6c954e, pages=47, markPos=WALPointer [idx=94, fileOff=638556, len=2010], walSegmentsCovered=[], markDuration=267ms, pagesWrite=2ms, fsync=8ms, total=277ms] [21:15:40] : [Step 4/5] [21:15:40] >>> Stopping test: CacheGroupKeyChangeTest#testChangeKeyDuringRebalancing in 25188 ms <<< [21:15:40] : [Step 4/5] [2021-11-19 21:15:40,263][INFO ][main][root] >>> Stopping test: CacheGroupKeyChangeTest#testChangeKeyDuringRebalancing in 25188 ms <<< [21:15:40] : [Step 4/5] [21:15:40] >>> Heap: 443 MB used / 1906 MB commited / 1906 MB max <<< [21:15:40] : [Step 4/5] [2021-11-19 21:15:40,263][INFO ][main][root] >>> Heap: 443 MB used / 1906 MB commited / 1906 MB max <<< [21:15:40] : [Step 4/5] [21:15:40] >>> Non-Heap: 178 MB used / 195 MB commited / 0 MB max <<< [21:15:40] : [Step 4/5] [2021-11-19 21:15:40,264][INFO ][main][root] >>> Non-Heap: 178 MB used / 195 MB commited / 0 MB max <<< [21:15:40] : [Step 4/5] [2021-11-19 21:15:40,264][INFO ][main][root] >>> Stopping grid [name=grid-1, id=1085686a-9887-4e3d-9d8b-a64775ae4001] [21:15:40] : [Step 4/5] [2021-11-19 21:15:40,273][INFO ][db-checkpoint-thread-#26801%grid-1%][Checkpointer] Checkpoint started [checkpointId=74c36998-605e-4884-8de8-ee40d36b68fe, startPtr=WALPointer [idx=169, fileOff=262823, len=2048], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=1ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=0ms, pages=5, reason='timeout'] [21:15:40] : [Step 4/5] [2021-11-19 21:15:40,279][INFO ][tcp-disco-msg-worker-[1085686a 127.0.0.1:47501 crd]-#1399%grid-0%-#26658%grid-0%][TestTcpDiscoverySpi] New next node [newNext=TcpDiscoveryNode [id=20b6f4b9-0c69-4736-8d5a-f36aa10b9002, consistentId=grid-2, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47502], discPort=47502, order=3, intOrder=3, lastExchangeTime=1637345734988, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false]] [21:15:40] : [Step 4/5] [2021-11-19 21:15:40,280][INFO ][disco-event-worker-#26661%grid-0%][GridDiscoveryManager] Node left topology: TcpDiscoveryNode [id=1085686a-9887-4e3d-9d8b-a64775ae4001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637345717040, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false] [21:15:40] : [Step 4/5] [2021-11-19 21:15:40,280][INFO ][tcp-disco-srvr-[:47502]-#1414%grid-2%-#26932%grid-2%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=56981] [21:15:40] : [Step 4/5] [2021-11-19 21:15:40,280][INFO ][tcp-disco-sock-reader-[008cb00a 127.0.0.1:40415]-#1408%grid-1%-#26781%grid-1%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:40415, rmtPort=40415, rmtNodeId=008cb00a-6a9b-4c09-a154-85082cd15000] [21:15:40] : [Step 4/5] [2021-11-19 21:15:40,282][INFO ][tcp-disco-srvr-[:47502]-#1414%grid-2%-#26932%grid-2%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=56981] [21:15:40] : [Step 4/5] [2021-11-19 21:15:40,282][INFO ][disco-event-worker-#26661%grid-0%][GridDiscoveryManager] Topology snapshot [ver=4, locNode=008cb00a, servers=2, clients=0, state=ACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=008cb00a-6a9b-4c09-a154-85082cd15000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=20b6f4b9-0c69-4736-8d5a-f36aa10b9002, consistentId=grid-2, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:15:40] : [Step 4/5] [2021-11-19 21:15:40,284][INFO ][tcp-disco-sock-reader-[]-#1420%grid-2%-#26973%grid-2%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:56981, rmtPort=56981] [21:15:40] : [Step 4/5] [2021-11-19 21:15:40,284][INFO ][main][GridCacheProcessor] Stopped cache [cacheName=ignite-sys-cache] [21:15:40] : [Step 4/5] [2021-11-19 21:15:40,285][INFO ][disco-event-worker-#26661%grid-0%][GridDiscoveryManager] ^-- Baseline [id=1, size=3, online=2, offline=1] [21:15:40] : [Step 4/5] [2021-11-19 21:15:40,286][INFO ][main][GridCacheProcessor] Stopped cache [cacheName=encrypted] [21:15:40] : [Step 4/5] [2021-11-19 21:15:40,286][INFO ][tcp-disco-sock-reader-[008cb00a 127.0.0.1:56981]-#1420%grid-2%-#26973%grid-2%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=008cb00a-6a9b-4c09-a154-85082cd15000, rmtAddr=/127.0.0.1:56981] [21:15:40]W: [org.apache.ignite:ignite-core] [2021-11-19 21:15:40,286][WARN ][grid-nio-worker-tcp-comm-0-#26600%TestRecordingCommunicationSpi%][TestRecordingCommunicationSpi] Failed to shutdown socket [21:15:40]W: [org.apache.ignite:ignite-core] java.nio.channels.ClosedChannelException [21:15:40]W: [org.apache.ignite:ignite-core] at sun.nio.ch.SocketChannelImpl.shutdownOutput(SocketChannelImpl.java:795) [21:15:40]W: [org.apache.ignite:ignite-core] at sun.nio.ch.SocketAdaptor.shutdownOutput(SocketAdaptor.java:407) [21:15:40]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.close(IgniteUtils.java:4247) [21:15:40]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.closeKey(GridNioServer.java:2784) [21:15:40]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.close(GridNioServer.java:2835) [21:15:40]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.close(GridNioServer.java:2794) [21:15:40]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.bodyInternal(GridNioServer.java:2157) [21:15:40]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.body(GridNioServer.java:1910) [21:15:40]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:125) [21:15:40]W: [org.apache.ignite:ignite-core] at java.lang.Thread.run(Thread.java:748) [21:15:40] : [Step 4/5] [2021-11-19 21:15:40,291][INFO ][disco-event-worker-#26938%grid-2%][GridDiscoveryManager] Node left topology: TcpDiscoveryNode [id=1085686a-9887-4e3d-9d8b-a64775ae4001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637345735009, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false] [21:15:40] : [Step 4/5] [2021-11-19 21:15:40,292][INFO ][main][FilePageStoreManager] Cleanup cache stores [total=4, left=0, cleanFiles=false] [21:15:40] : [Step 4/5] [2021-11-19 21:15:40,293][INFO ][disco-event-worker-#26938%grid-2%][GridDiscoveryManager] Topology snapshot [ver=4, locNode=20b6f4b9, servers=2, clients=0, state=ACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=008cb00a-6a9b-4c09-a154-85082cd15000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=20b6f4b9-0c69-4736-8d5a-f36aa10b9002, consistentId=grid-2, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:15:40] : [Step 4/5] [2021-11-19 21:15:40,293][INFO ][exchange-worker-#26662%grid-0%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], crd=true, evt=NODE_LEFT, evtNode=1085686a-9887-4e3d-9d8b-a64775ae4001, customEvt=null, allowMerge=false, exchangeFreeSwitch=true] [21:15:40] : [Step 4/5] [2021-11-19 21:15:40,294][INFO ][disco-event-worker-#26938%grid-2%][GridDiscoveryManager] ^-- Baseline [id=1, size=3, online=2, offline=1] [21:15:40] : [Step 4/5] [2021-11-19 21:15:40,295][INFO ][exchange-worker-#26662%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:15:40] : [Step 4/5] [2021-11-19 21:15:40,295][INFO ][exchange-worker-#26662%grid-0%][GridCacheDatabaseSharedManager] Cache groups with earliest reserved checkpoint and a reason why a previous checkpoint was inapplicable: [[[grpId=1613773252, grpName=encrypted, cp=(fb39854b-dc8b-43a3-ad98-ad4fb767b7ca, 11/19/2021 21:15:37)], reason=Reserved checkpoint is the oldest in history]] [21:15:40] : [Step 4/5] [2021-11-19 21:15:40,296][INFO ][exchange-worker-#26939%grid-2%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], crd=false, evt=NODE_LEFT, evtNode=1085686a-9887-4e3d-9d8b-a64775ae4001, customEvt=null, allowMerge=false, exchangeFreeSwitch=true] [21:15:40] : [Step 4/5] [2021-11-19 21:15:40,301][INFO ][main][GridDeploymentLocalStore] Removed undeployed class: GridDeployment [ts=1637345717161, depMode=SHARED, clsLdr=IsolatedClassLoader{roleName='test'}, clsLdrId=45b3e593d71-1085686a-9887-4e3d-9d8b-a64775ae4001, userVer=0, loc=true, sampleClsName=org.apache.ignite.internal.processors.cache.distributed.dht.preloader.IgniteDhtPartitionsToReloadMap, pendingUndeploy=false, undeployed=true, usage=0] [21:15:40] : [Step 4/5] [2021-11-19 21:15:40,303][INFO ][exchange-worker-#26662%grid-0%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], err=null, rebalanced=true, wasRebalanced=true] [21:15:40] : [Step 4/5] [2021-11-19 21:15:40,301][INFO ][exchange-worker-#26939%grid-2%][GridAffinityAssignmentCache] Local node affinity assignment distribution is not ideal [cache=encrypted, expectedPrimary=4.00, actualPrimary=0, expectedBackups=0.00, actualBackups=0, warningThreshold=50.00%] [21:15:40] : [Step 4/5] [2021-11-19 21:15:40,306][INFO ][exchange-worker-#26939%grid-2%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:15:40] : [Step 4/5] [2021-11-19 21:15:40,309][INFO ][exchange-worker-#26939%grid-2%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], err=null, rebalanced=true, wasRebalanced=true] [21:15:40]W: [org.apache.ignite:ignite-core] [2021-11-19 21:15:40,310][WARN ][exchange-worker-#26662%grid-0%][GridDhtPartitionTopologyImpl] Detected lost partitions [grp=encrypted, parts=[0, 2, 4, 6-7], topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0]] [21:15:40]W: [org.apache.ignite:ignite-core] [2021-11-19 21:15:40,310][WARN ][sys-#26909%grid-2%][GridDhtPartitionTopologyImpl] Detected lost partitions [grp=encrypted, parts=[0, 2, 4, 6-7], topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0]] [21:15:40] : [Step 4/5] [2021-11-19 21:15:40,311][INFO ][exchange-worker-#26662%grid-0%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=008cb00a-6a9b-4c09-a154-85082cd15000, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], evt=NODE_LEFT, evtNode=TcpDiscoveryNode [id=1085686a-9887-4e3d-9d8b-a64775ae4001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637345717040, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0]] [21:15:40] : [Step 4/5] [2021-11-19 21:15:40,312][INFO ][exchange-worker-#26939%grid-2%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=20b6f4b9-0c69-4736-8d5a-f36aa10b9002, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], evt=NODE_LEFT, evtNode=TcpDiscoveryNode [id=1085686a-9887-4e3d-9d8b-a64775ae4001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637345735009, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0]] [21:15:40] : [Step 4/5] [2021-11-19 21:15:40,313][INFO ][exchange-worker-#26662%grid-0%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (1 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="After states restored callback" (0 ms), stage="WAL history reservation" (3 ms), stage="Finalize update counters" (2 ms), stage="Detect lost partitions" (9 ms), stage="Exchange done" (1 ms), stage="Total time" (16 ms)] [21:15:40] : [Step 4/5] [2021-11-19 21:15:40,314][INFO ][exchange-worker-#26939%grid-2%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (5 ms), stage="Determine exchange type" (4 ms), stage="Preloading notification" (0 ms), stage="After states restored callback" (0 ms), stage="WAL history reservation" (0 ms), stage="Finalize update counters" (1 ms), stage="Detect lost partitions" (3 ms), stage="Exchange done" (2 ms), stage="Total time" (15 ms)] [21:15:40] : [Step 4/5] [2021-11-19 21:15:40,317][INFO ][exchange-worker-#26662%grid-0%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], stage="Affinity initialization (exchange-free switch on fully-rebalanced topology) [grp=ignite-sys-cache]" (0 ms) (parent=Determine exchange type), stage="Affinity initialization (exchange-free switch on fully-rebalanced topology) [grp=encrypted]" (0 ms) (parent=Determine exchange type)] [21:15:40] : [Step 4/5] [2021-11-19 21:15:40,318][INFO ][exchange-worker-#26939%grid-2%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], stage="Affinity initialization (exchange-free switch on fully-rebalanced topology) [grp=encrypted]" (4 ms) (parent=Determine exchange type), stage="Affinity initialization (exchange-free switch on fully-rebalanced topology) [grp=ignite-sys-cache]" (0 ms) (parent=Determine exchange type)] [21:15:40] : [Step 4/5] [2021-11-19 21:15:40,320][INFO ][main][IgniteKernal%grid-1] [21:15:40] : [Step 4/5] [21:15:40] : [Step 4/5] >>> +------------------------------------------------------+ [21:15:40] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV stopped OK [21:15:40] : [Step 4/5] >>> +------------------------------------------------------+ [21:15:40] : [Step 4/5] >>> Ignite instance name: grid-1 [21:15:40] : [Step 4/5] >>> Grid uptime: 00:00:23.210 [21:15:40] : [Step 4/5] [21:15:40] : [Step 4/5] [21:15:40] : [Step 4/5] [2021-11-19 21:15:40,319][INFO ][exchange-worker-#26662%grid-0%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], crd=true] [21:15:40] : [Step 4/5] [2021-11-19 21:15:40,321][INFO ][main][root] >>> Stopping grid [name=grid-2, id=20b6f4b9-0c69-4736-8d5a-f36aa10b9002] [21:15:40] : [Step 4/5] [2021-11-19 21:15:40,320][INFO ][exchange-worker-#26939%grid-2%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=0], crd=false] [21:15:40] : [Step 4/5] [2021-11-19 21:15:40,321][INFO ][exchange-worker-#26662%grid-0%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=4, minorTopVer=0], force=false, evt=NODE_LEFT, node=1085686a-9887-4e3d-9d8b-a64775ae4001] [21:15:40] : [Step 4/5] [2021-11-19 21:15:40,324][INFO ][exchange-worker-#26939%grid-2%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=4, minorTopVer=0], force=false, evt=NODE_LEFT, node=1085686a-9887-4e3d-9d8b-a64775ae4001] [21:15:40] : [Step 4/5] [2021-11-19 21:15:40,338][INFO ][db-checkpoint-thread-#26946%grid-2%][Checkpointer] Checkpoint started [checkpointId=deeb1e02-3b70-4f50-9858-de33079073db, startPtr=WALPointer [idx=0, fileOff=240934, len=1953], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=3ms, checkpointLockHoldTime=7ms, walCpRecordFsyncDuration=0ms, writeCheckpointEntryDuration=2ms, splitAndSortCpPagesDuration=0ms, pages=6, reason='timeout'] [21:15:40] : [Step 4/5] [2021-11-19 21:15:40,350][INFO ][tcp-disco-sock-reader-[008cb00a 127.0.0.1:56981]-#1420%grid-2%-#26973%grid-2%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:56981, rmtPort=56981, rmtNodeId=008cb00a-6a9b-4c09-a154-85082cd15000] [21:15:40]W: [org.apache.ignite:ignite-core] [2021-11-19 21:15:40,351][WARN ][tcp-disco-sock-reader-[1085686a 127.0.0.1:46319]-#1417%grid-2%-#26935%grid-2%][TestTcpDiscoverySpi] Failed to shutdown socket [21:15:40]W: [org.apache.ignite:ignite-core] java.net.SocketException: Socket is closed [21:15:40]W: [org.apache.ignite:ignite-core] at java.net.Socket.shutdownOutput(Socket.java:1568) [21:15:40]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.close(IgniteUtils.java:4247) [21:15:40]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.discovery.tcp.ServerImpl$SocketReader.body(ServerImpl.java:7370) [21:15:40]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.IgniteSpiThread.run(IgniteSpiThread.java:58) [21:15:40] : [Step 4/5] [2021-11-19 21:15:40,351][INFO ][disco-event-worker-#26661%grid-0%][GridDiscoveryManager] Node left topology: TcpDiscoveryNode [id=20b6f4b9-0c69-4736-8d5a-f36aa10b9002, consistentId=grid-2, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47502], discPort=47502, order=3, intOrder=3, lastExchangeTime=1637345734988, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false] [21:15:40] : [Step 4/5] [2021-11-19 21:15:40,353][INFO ][tcp-disco-sock-reader-[1085686a 127.0.0.1:46319]-#1417%grid-2%-#26935%grid-2%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:46319, rmtPort=46319, rmtNodeId=1085686a-9887-4e3d-9d8b-a64775ae4001] [21:15:40] : [Step 4/5] [2021-11-19 21:15:40,354][INFO ][disco-event-worker-#26661%grid-0%][GridDiscoveryManager] Topology snapshot [ver=5, locNode=008cb00a, servers=1, clients=0, state=ACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=008cb00a-6a9b-4c09-a154-85082cd15000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:15:40] : [Step 4/5] [2021-11-19 21:15:40,356][INFO ][main][GridCacheProcessor] Stopped cache [cacheName=ignite-sys-cache] [21:15:40] : [Step 4/5] [2021-11-19 21:15:40,356][INFO ][disco-event-worker-#26661%grid-0%][GridDiscoveryManager] ^-- Baseline [id=1, size=3, online=1, offline=2] [21:15:40] : [Step 4/5] [2021-11-19 21:15:40,356][INFO ][main][GridCacheProcessor] Stopped cache [cacheName=encrypted] [21:15:40] : [Step 4/5] [2021-11-19 21:15:40,364][INFO ][exchange-worker-#26662%grid-0%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], crd=true, evt=NODE_LEFT, evtNode=20b6f4b9-0c69-4736-8d5a-f36aa10b9002, customEvt=null, allowMerge=false, exchangeFreeSwitch=true] [21:15:40] : [Step 4/5] [2021-11-19 21:15:40,368][INFO ][main][FilePageStoreManager] Cleanup cache stores [total=4, left=0, cleanFiles=false] [21:15:40] : [Step 4/5] [2021-11-19 21:15:40,368][INFO ][sys-#26654%grid-0%][GridAffinityAssignmentCache] Local node affinity assignment distribution is not ideal [cache=encrypted, expectedPrimary=8.00, actualPrimary=3, expectedBackups=0.00, actualBackups=0, warningThreshold=50.00%] [21:15:40] : [Step 4/5] [2021-11-19 21:15:40,374][INFO ][main][GridDeploymentLocalStore] Removed undeployed class: GridDeployment [ts=1637345735266, depMode=SHARED, clsLdr=IsolatedClassLoader{roleName='test'}, clsLdrId=2fd3e593d71-20b6f4b9-0c69-4736-8d5a-f36aa10b9002, userVer=0, loc=true, sampleClsName=org.apache.ignite.internal.processors.cache.distributed.dht.preloader.IgniteDhtPartitionCountersMap2, pendingUndeploy=false, undeployed=true, usage=0] [21:15:40] : [Step 4/5] [2021-11-19 21:15:40,374][INFO ][exchange-worker-#26662%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:15:40] : [Step 4/5] [2021-11-19 21:15:40,377][INFO ][exchange-worker-#26662%grid-0%][GridCacheDatabaseSharedManager] Cache groups with earliest reserved checkpoint and a reason why a previous checkpoint was inapplicable: [[[grpId=1613773252, grpName=encrypted, cp=(fb39854b-dc8b-43a3-ad98-ad4fb767b7ca, 11/19/2021 21:15:37)], reason=Reserved checkpoint is the oldest in history]] [21:15:40] : [Step 4/5] [2021-11-19 21:15:40,380][INFO ][exchange-worker-#26662%grid-0%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], err=null, rebalanced=true, wasRebalanced=true] [21:15:40] : [Step 4/5] [2021-11-19 21:15:40,384][INFO ][main][IgniteKernal%grid-2] [21:15:40] : [Step 4/5] [21:15:40] : [Step 4/5] >>> +------------------------------------------------------+ [21:15:40] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV stopped OK [21:15:40] : [Step 4/5] >>> +------------------------------------------------------+ [21:15:40] : [Step 4/5] >>> Ignite instance name: grid-2 [21:15:40] : [Step 4/5] >>> Grid uptime: 00:00:05.107 [21:15:40] : [Step 4/5] [21:15:40] : [Step 4/5] [21:15:40] : [Step 4/5] [2021-11-19 21:15:40,385][INFO ][main][root] >>> Stopping grid [name=grid-0, id=008cb00a-6a9b-4c09-a154-85082cd15000] [21:15:40] : [Step 4/5] [2021-11-19 21:15:40,388][INFO ][exchange-worker-#26662%grid-0%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=008cb00a-6a9b-4c09-a154-85082cd15000, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], evt=NODE_LEFT, evtNode=TcpDiscoveryNode [id=20b6f4b9-0c69-4736-8d5a-f36aa10b9002, consistentId=grid-2, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47502], discPort=47502, order=3, intOrder=3, lastExchangeTime=1637345734988, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=5, minorTopVer=0]] [21:15:40] : [Step 4/5] [2021-11-19 21:15:40,389][INFO ][exchange-worker-#26662%grid-0%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (3 ms), stage="Determine exchange type" (6 ms), stage="Preloading notification" (0 ms), stage="After states restored callback" (2 ms), stage="WAL history reservation" (2 ms), stage="Finalize update counters" (0 ms), stage="Detect lost partitions" (7 ms), stage="Exchange done" (1 ms), stage="Total time" (21 ms)] [21:15:40] : [Step 4/5] [2021-11-19 21:15:40,390][INFO ][exchange-worker-#26662%grid-0%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], stage="Affinity initialization (exchange-free switch on fully-rebalanced topology) [grp=encrypted]" (6 ms) (parent=Determine exchange type), stage="Affinity initialization (exchange-free switch on fully-rebalanced topology) [grp=ignite-sys-cache]" (0 ms) (parent=Determine exchange type)] [21:15:40] : [Step 4/5] [2021-11-19 21:15:40,391][INFO ][exchange-worker-#26662%grid-0%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=5, minorTopVer=0], crd=true] [21:15:40] : [Step 4/5] [2021-11-19 21:15:40,391][INFO ][exchange-worker-#26662%grid-0%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=5, minorTopVer=0], force=false, evt=NODE_LEFT, node=20b6f4b9-0c69-4736-8d5a-f36aa10b9002] [21:15:40] : [Step 4/5] [2021-11-19 21:15:40,400][INFO ][db-checkpoint-thread-#26796%grid-0%][Checkpointer] Checkpoint started [checkpointId=67ae9352-5ac1-4c49-b114-27cb1480a905, startPtr=WALPointer [idx=94, fileOff=657922, len=2010], checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=1ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=0ms, pages=5, reason='timeout'] [21:15:40] : [Step 4/5] [2021-11-19 21:15:40,409][INFO ][tcp-disco-sock-reader-[20b6f4b9 127.0.0.1:55181]-#1418%grid-0%-#26936%grid-0%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:55181, rmtPort=55181, rmtNodeId=20b6f4b9-0c69-4736-8d5a-f36aa10b9002] [21:15:40] : [Step 4/5] [2021-11-19 21:15:40,410][INFO ][main][GridCacheProcessor] Stopped cache [cacheName=ignite-sys-cache] [21:15:40] : [Step 4/5] [2021-11-19 21:15:40,411][INFO ][main][GridCacheProcessor] Stopped cache [cacheName=encrypted] [21:15:40] : [Step 4/5] [2021-11-19 21:15:40,413][INFO ][main][FilePageStoreManager] Cleanup cache stores [total=4, left=0, cleanFiles=false] [21:15:40] : [Step 4/5] [2021-11-19 21:15:40,415][INFO ][main][GridDeploymentLocalStore] Removed undeployed class: GridDeployment [ts=1637345717151, depMode=SHARED, clsLdr=IsolatedClassLoader{roleName='test'}, clsLdrId=25b3e593d71-008cb00a-6a9b-4c09-a154-85082cd15000, userVer=0, loc=true, sampleClsName=org.apache.ignite.internal.processors.cache.distributed.dht.preloader.GridDhtPartitionMap, pendingUndeploy=false, undeployed=true, usage=0] [21:15:40] : [Step 4/5] [2021-11-19 21:15:40,426][INFO ][main][IgniteKernal%grid-0] [21:15:40] : [Step 4/5] [21:15:40] : [Step 4/5] >>> +------------------------------------------------------+ [21:15:40] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV stopped OK [21:15:40] : [Step 4/5] >>> +------------------------------------------------------+ [21:15:40] : [Step 4/5] >>> Ignite instance name: grid-0 [21:15:40] : [Step 4/5] >>> Grid uptime: 00:00:24.425 [21:15:40] : [Step 4/5] [21:15:40] : [Step 4/5] [21:15:40]i: [Step 4/5] ##teamcity[importData type='surefire' path='/opt/buildagent/temp/buildTmp/ignite-tools-junit-reports1777670380320881607/test-org.apache.ignite.testsuites.IgniteBasicWithPersistenceTestSuite1637345439226.xml'] [21:15:40] : [Step 4/5] Importing data from '/opt/buildagent/temp/buildTmp/ignite-tools-junit-reports1777670380320881607/test-org.apache.ignite.testsuites.IgniteBasicWithPersistenceTestSuite1637345439226.xml' (3.84 KB) with 'surefire' processor [21:15:40] : [Step 4/5] [21:15:40] >>> Starting test: CacheGroupKeyChangeTest#testNodeWithOlderKeyBecameCoordinator <<< [21:15:40] : [Step 4/5] [2021-11-19 21:15:40,465][INFO ][main][root] >>> Starting test: CacheGroupKeyChangeTest#testNodeWithOlderKeyBecameCoordinator <<< [21:15:40] : [Step 4/5] [21:15:40] >>> Heap: 461 MB used / 1906 MB commited / 1906 MB max <<< [21:15:40] : [Step 4/5] [2021-11-19 21:15:40,466][INFO ][main][root] >>> Heap: 461 MB used / 1906 MB commited / 1906 MB max <<< [21:15:40] : [Step 4/5] [21:15:40] >>> Non-Heap: 178 MB used / 195 MB commited / 0 MB max <<< [21:15:40] : [Step 4/5] [2021-11-19 21:15:40,466][INFO ][main][root] >>> Non-Heap: 178 MB used / 195 MB commited / 0 MB max <<< [21:15:40]W: [org.apache.ignite:ignite-core] [2021-11-19 21:15:40,474][WARN ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][G] Ignite work directory is not provided, automatically resolved to: /opt/buildagent/work/7bc1c54bc719b67c/work [21:15:40] : [Step 4/5] [2021-11-19 21:15:40,476][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] [21:15:40] : [Step 4/5] [21:15:40] : [Step 4/5] >>> __________ ________________ [21:15:40] : [Step 4/5] >>> / _/ ___/ |/ / _/_ __/ __/ [21:15:40] : [Step 4/5] >>> _/ // (7 7 // / / / / _/ [21:15:40] : [Step 4/5] >>> /___/\___/_/|_/___/ /_/ /___/ [21:15:40] : [Step 4/5] >>> [21:15:40] : [Step 4/5] >>> ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:15:40] : [Step 4/5] >>> 2021 Copyright(C) Apache Software Foundation [21:15:40] : [Step 4/5] >>> [21:15:40] : [Step 4/5] >>> Ignite documentation: http://ignite.apache.org [21:15:40] : [Step 4/5] [21:15:40] : [Step 4/5] [2021-11-19 21:15:40,477][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] Config URL: n/a [21:15:40] : [Step 4/5] [2021-11-19 21:15:40,478][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] IgniteConfiguration [igniteInstanceName=grid-0, pubPoolSize=24, svcPoolSize=24, callbackPoolSize=24, stripedPoolSize=24, sysPoolSize=24, mgmtPoolSize=4, dataStreamerPoolSize=24, utilityCachePoolSize=24, utilityCacheKeepAliveTime=60000, p2pPoolSize=2, qryPoolSize=24, buildIdxPoolSize=4, igniteHome=/opt/buildagent/work/7bc1c54bc719b67c, igniteWorkDir=/opt/buildagent/work/7bc1c54bc719b67c/work, mbeanSrv=com.sun.jmx.mbeanserver.JmxMBeanServer@6fe85038, nodeId=00eebdf5-f37b-4541-825b-78873b80b000, marsh=BinaryMarshaller [], marshLocJobs=false, daemon=false, p2pEnabled=true, netTimeout=10000, netCompressionLevel=1, sndRetryDelay=1000, sndRetryCnt=3, metricsHistSize=10000, metricsUpdateFreq=1000, metricsExpTime=9223372036854775807, discoSpi=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=0, ackTimeout=0, marsh=null, reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], segPlc=STOP, segResolveAttempts=2, waitForSegOnStart=true, allResolversPassReq=true, segChkFreq=10000, commSpi=TcpCommunicationSpi [connectGate=org.apache.ignite.spi.communication.tcp.internal.ConnectGateway@3f859392, ctxInitLatch=java.util.concurrent.CountDownLatch@52ff139b[Count = 1], stopping=false, clientPool=null, nioSrvWrapper=null, stateProvider=null], evtSpi=MemoryEventStorageSpi [expireAgeMs=9223372036854775807, expireCnt=10000, filter=null], colSpi=NoopCollisionSpi [], deploySpi=LocalDeploymentSpi [], indexingSpi=org.apache.ignite.spi.indexing.noop.NoopIndexingSpi@23c29427, addrRslvr=null, encryptionSpi=org.apache.ignite.spi.encryption.keystore.KeystoreEncryptionSpi@35805df5, tracingSpi=org.apache.ignite.spi.tracing.NoopTracingSpi@2636625e, clientMode=false, rebalanceThreadPoolSize=4, rebalanceTimeout=10000, rebalanceBatchesPrefetchCnt=3, rebalanceThrottle=0, rebalanceBatchSize=524288, txCfg=TransactionConfiguration [txSerEnabled=false, dfltIsolation=REPEATABLE_READ, dfltConcurrency=PESSIMISTIC, dfltTxTimeout=0, txTimeoutOnPartitionMapExchange=0, deadlockTimeout=10000, pessimisticTxLogSize=0, pessimisticTxLogLinger=10000, tmLookupClsName=null, txManagerFactory=null, useJtaSync=false], cacheSanityCheckEnabled=true, discoStartupDelay=60000, deployMode=SHARED, p2pMissedCacheSize=100, locHost=127.0.0.1, timeSrvPortBase=31100, timeSrvPortRange=100, failureDetectionTimeout=10000, sysWorkerBlockedTimeout=null, clientFailureDetectionTimeout=10000, metricsLogFreq=0, connectorCfg=null, odbcCfg=null, warmupClos=null, atomicCfg=AtomicConfiguration [seqReserveSize=1000, cacheMode=PARTITIONED, backups=1, aff=null, grpName=null], classLdr=null, sslCtxFactory=null, platformCfg=null, binaryCfg=null, memCfg=null, pstCfg=null, dsCfg=DataStorageConfiguration [sysRegionInitSize=41943040, sysRegionMaxSize=104857600, pageSize=4096, concLvl=0, dfltDataRegConf=DataRegionConfiguration [name=default, maxSize=104857600, initSize=268435456, swapPath=null, pageEvictionMode=DISABLED, pageReplacementMode=CLOCK, evictionThreshold=0.9, emptyPagesPoolSize=100, metricsEnabled=false, metricsSubIntervalCount=5, metricsRateTimeInterval=60000, persistenceEnabled=true, checkpointPageBufSize=0, lazyMemoryAllocation=true, warmUpCfg=null], dataRegions=null, storagePath=null, checkpointFreq=30000, lockWaitTime=10000, checkpointThreads=4, checkpointWriteOrder=SEQUENTIAL, walHistSize=20, maxWalArchiveSize=20971520, walSegments=10, walSegmentSize=1048576, walPath=db/wal, walArchivePath=db/wal/archive, cdcWalPath=db/wal/cdc, cdcEnabled=false, metricsEnabled=false, walMode=LOG_ONLY, walTlbSize=131072, walBuffSize=0, walFlushFreq=2000, walFsyncDelay=1000, walRecordIterBuffSize=67108864, alwaysWriteFullPages=false, fileIOFactory=org.apache.ignite.internal.processors.cache.persistence.file.AsyncFileIOFactory@5a9b2e9b, metricsSubIntervalCnt=5, metricsRateTimeInterval=60000, walAutoArchiveAfterInactivity=-1, walForceArchiveTimeout=-1, writeThrottlingEnabled=false, walCompactionEnabled=false, walCompactionLevel=1, checkpointReadLockTimeout=null, walPageCompression=DISABLED, walPageCompressionLevel=null, dfltWarmUpCfg=null, encCfg=org.apache.ignite.configuration.EncryptionConfiguration@6a9c1bfe, defragmentationThreadPoolSize=4, minWalArchiveSize=-1], snapshotPath=snapshots, activeOnStart=true, activeOnStartPropSetFlag=false, autoActivation=true, autoActivationPropSetFlag=false, clusterStateOnStart=null, sqlConnCfg=null, cliConnCfg=ClientConnectorConfiguration [host=null, port=10800, portRange=100, sockSndBufSize=0, sockRcvBufSize=0, tcpNoDelay=true, maxOpenCursorsPerConn=128, threadPoolSize=24, selectorCnt=12, idleTimeout=0, handshakeTimeout=10000, jdbcEnabled=true, odbcEnabled=true, thinCliEnabled=true, sslEnabled=false, useIgniteSslCtxFactory=true, sslClientAuth=false, sslCtxFactory=null, thinCliCfg=ThinClientConfiguration [maxActiveTxPerConn=100, maxActiveComputeTasksPerConn=0]], mvccVacuumThreadCnt=2, mvccVacuumFreq=5000, authEnabled=false, failureHnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]], commFailureRslvr=null, sqlCfg=SqlConfiguration [longQryWarnTimeout=3000, dfltQryTimeout=0, sqlQryHistSize=1000, validationEnabled=false], asyncContinuationExecutor=null] [21:15:40] : [Step 4/5] [2021-11-19 21:15:40,487][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] Daemon mode: off [21:15:40] : [Step 4/5] [2021-11-19 21:15:40,487][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] OS: Linux 4.15.0-151-generic amd64 [21:15:40] : [Step 4/5] [2021-11-19 21:15:40,488][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] OS user: teamcity [21:15:40] : [Step 4/5] [2021-11-19 21:15:40,488][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] PID: 16724 [21:15:40] : [Step 4/5] [2021-11-19 21:15:40,489][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] Language runtime: Java Platform API Specification ver. 1.8 [21:15:40] : [Step 4/5] [2021-11-19 21:15:40,489][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] VM information: Java(TM) SE Runtime Environment 1.8.0_261-b12 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 25.261-b12 [21:15:40] : [Step 4/5] [2021-11-19 21:15:40,489][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] VM total memory: 1.9GB [21:15:40] : [Step 4/5] [2021-11-19 21:15:40,489][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] Remote Management [restart: off, REST: off, JMX (remote: off)] [21:15:40] : [Step 4/5] [2021-11-19 21:15:40,490][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] Logger: GridTestLog4jLogger [quiet=false, config=null] [21:15:40] : [Step 4/5] [2021-11-19 21:15:40,490][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] IGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c [21:15:40] : [Step 4/5] [2021-11-19 21:15:40,490][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] VM arguments: [-DIGNITE_DUMP_THREADS_ON_FAILURE=false, -DMono=/usr/bin/mono-sgen, -DMono4.0_x64=/usr/lib/mono/4.0, -DMono4.5_x64=/usr/lib/mono/4.5, -DMonoVersion=6.12.0.90, -DSKIP_BUILD=false, -Dagent.home.dir=/opt/buildagent, -Dagent.name=aitc-lin02_03, -Dagent.ownPort=9090, -Dagent.work.dir=/opt/buildagent/work, -Dbuild.number=95, -Dbuild.vcs.number=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.1=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.GitHubApacheIgnite=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dclassworlds.conf=/opt/buildagent/temp/buildTmp/teamcity.m2.conf, -Dcom.jetbrains.maven.watcher.report.file=/opt/buildagent/temp/buildTmp/maven-build-info.xml, -Djava.io.tmpdir=/opt/buildagent/temp/buildTmp, -Dmaven.home=/opt/buildagent/tools/maven3_6, -Dmaven.multiModuleProjectDirectory=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.agent.cpuBenchmark=457, -Dteamcity.agent.dotnet.agent_url=http://localhost:9090/RPC2, -Dteamcity.agent.dotnet.build_id=6278078, -Dteamcity.auth.password=*******, -Dteamcity.auth.userId=TeamCityBuildId=6278078, -Dteamcity.build.changedFiles.file=/opt/buildagent/temp/buildTmp/changedFiles6342607772318147725.txt, -Dteamcity.build.checkoutDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.build.id=6278078, -Dteamcity.build.properties.file=/opt/buildagent/temp/buildTmp/teamcity.build5164517880467851002.properties, -Dteamcity.build.tempDir=/opt/buildagent/temp/buildTmp, -Dteamcity.build.workingDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.buildConfName=Basic 3, -Dteamcity.buildType.id=IgniteTests24Java8_Basic3, -Dteamcity.configuration.properties.file=/opt/buildagent/temp/buildTmp/teamcity.config5591980786735343870.properties, -Dteamcity.maven.userSettings.path=/opt/buildagent/temp/buildTmp/maven_settings_585072866407032347.xml, -Dteamcity.maven.watcher.home=/opt/buildagent/plugins/mavenPlugin/maven-watcher-jdk16, -Dteamcity.projectName=Ignite Tests 2.x (JDK 8/11), -Dteamcity.runner.properties.file=/opt/buildagent/temp/buildTmp/teamcity.runner9098465561618137420.properties, -Dteamcity.tests.recentlyFailedTests.file=/opt/buildagent/temp/buildTmp/testsToRunFirst3891775683130404069.txt, -Dteamcity.version=2021.2 (build 99542), -ea, -Xms2g, -Xmx2g, -XX:+HeapDumpOnOutOfMemoryError, -DIGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_TEST_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_UPDATE_NOTIFIER=false, -DIGNITE_NO_DISCO_ORDER=true, -DIGNITE_PERFORMANCE_SUGGESTIONS_DISABLED=true, -Djava.net.preferIPv4Stack=true, -DTEST_SCALE_FACTOR=1.0, -DIGNITE_TEST_PROP_LOG4J_FILE=log4j-tc-test.xml, -DIGNITE_QUIET=false, -DIGNITE_MARSHAL_BUFFERS_RECHECK=1000, -Dmaven.repo.local=/opt/buildagent/.m2/repository] [21:15:40] : [Step 4/5] [2021-11-19 21:15:40,495][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] System cache's DataRegion size is configured to 40 MB. Use DataStorageConfiguration.systemRegionInitialSize property to change the setting. [21:15:40] : [Step 4/5] [2021-11-19 21:15:40,495][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] Configured caches [in 'sysMemPlc' dataRegion: ['ignite-sys-cache']] [21:15:40]W: [org.apache.ignite:ignite-core] [2021-11-19 21:15:40,496][WARN ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] Peer class loading is enabled (disable it in production for performance and deployment consistency reasons) [21:15:40] : [Step 4/5] [2021-11-19 21:15:40,496][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] 3-rd party licenses can be found at: /opt/buildagent/work/7bc1c54bc719b67c/libs/licenses [21:15:40] : [Step 4/5] [2021-11-19 21:15:40,500][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] Configured plugins: [21:15:40] : [Step 4/5] [2021-11-19 21:15:40,501][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- StanByClusterTestProvider 1.0 [21:15:40] : [Step 4/5] [2021-11-19 21:15:40,501][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:15:40] : [Step 4/5] [2021-11-19 21:15:40,501][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] [21:15:40] : [Step 4/5] [2021-11-19 21:15:40,501][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- PageMemory tracker plugin 1.0 [21:15:40] : [Step 4/5] [2021-11-19 21:15:40,501][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:15:40] : [Step 4/5] [2021-11-19 21:15:40,502][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] [21:15:40] : [Step 4/5] [2021-11-19 21:15:40,502][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- TestDistibutedConfigurationPlugin 1.0 [21:15:40] : [Step 4/5] [2021-11-19 21:15:40,502][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:15:40] : [Step 4/5] [2021-11-19 21:15:40,502][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] [21:15:40] : [Step 4/5] [2021-11-19 21:15:40,502][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- NodeValidationPluginProvider 1.0 [21:15:40] : [Step 4/5] [2021-11-19 21:15:40,503][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:15:40] : [Step 4/5] [2021-11-19 21:15:40,503][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] [21:15:40] : [Step 4/5] [2021-11-19 21:15:40,503][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][FailureProcessor] Configured failure handler: [hnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]]] [21:15:40] : [Step 4/5] [2021-11-19 21:15:40,515][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][TestRecordingCommunicationSpi] Successfully bound communication NIO server to TCP port [port=47100, locHost=/127.0.0.1, selectorsCnt=12, selectorSpins=0, pairedConn=false] [21:15:40]W: [org.apache.ignite:ignite-core] [2021-11-19 21:15:40,515][WARN ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][TestRecordingCommunicationSpi] Message queue limit is set to 0 which may lead to potential OOMEs when running cache operations in FULL_ASYNC or PRIMARY_SYNC modes due to message queues growth on sender and receiver sides. [21:15:40] : [Step 4/5] [2021-11-19 21:15:40,520][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][GridCollisionManager] Collision resolution is disabled (all jobs will be activated upon arrival). [21:15:40] : [Step 4/5] [2021-11-19 21:15:40,520][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] Security status [authentication=off, sandbox=off, tls/ssl=off] [21:15:40] : [Step 4/5] [2021-11-19 21:15:40,585][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:15:40] : [Step 4/5] [2021-11-19 21:15:40,680][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][MaintenanceProcessor] Resolved store directory for node persistent data: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0 [21:15:40] : [Step 4/5] [2021-11-19 21:15:40,683][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][CacheObjectBinaryProcessorImpl] Resolved directory for serialized binary metadata: /opt/buildagent/work/7bc1c54bc719b67c/work/db/binary_meta/grid_0 [21:15:40] : [Step 4/5] [2021-11-19 21:15:40,688][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0 [21:15:40] : [Step 4/5] [2021-11-19 21:15:40,688][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][FileWriteAheadLogManager] Resolved write ahead log work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0 [21:15:40] : [Step 4/5] [2021-11-19 21:15:40,689][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][FileWriteAheadLogManager] Resolved write ahead log archive directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0 [21:15:40] : [Step 4/5] [2021-11-19 21:15:40,793][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000000.wal [21:15:40] : [Step 4/5] [2021-11-19 21:15:40,794][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][FileHandleManagerImpl] Initialized write-ahead log manager [mode=LOG_ONLY] [21:15:40]W: [org.apache.ignite:ignite-core] [2021-11-19 21:15:40,794][WARN ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] DataRegion maxSize=104.9 MB is smaller than defaultInitialSize=268.4 MB, setting initialSize to 104.9 MB [21:15:40] : [Step 4/5] [2021-11-19 21:15:40,799][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Configured data regions initialized successfully [total=5] [21:15:40] : [Step 4/5] Surefire report watcher [21:15:40] : [Surefire report watcher] Watching paths: [21:15:40] : [Surefire report watcher] /opt/buildagent/temp/buildTmp/ignite-tools-junit-reports1777670380320881607/test-org.apache.ignite.testsuites.IgniteBasicWithPersistenceTestSuite1637345439226.xml [21:15:40] : [Step 4/5] [2021-11-19 21:15:40,802][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][IgniteSnapshotManager] Resolved snapshot work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/snapshots [21:15:40] : [Step 4/5] [2021-11-19 21:15:40,802][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][IgniteSnapshotManager] Resolved temp directory for snapshot creation: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0/snp [21:15:40]F: [Step 4/5] org.apache.ignite.testsuites.IgniteBasicWithPersistenceTestSuite [21:15:40]i: [org.apache.ignite.testsuites.IgniteBasicWithPersistenceTestSuite] org.apache.ignite.internal.encryption.CacheGroupKeyChangeTest.testNotAllBltNodesPresent [21:15:40]i: [org.apache.ignite.testsuites.IgniteBasicWithPersistenceTestSuite] org.apache.ignite.internal.encryption.CacheGroupKeyChangeTest.testCacheStartSameGroupDuringRotation [21:15:40]i: [org.apache.ignite.testsuites.IgniteBasicWithPersistenceTestSuite] org.apache.ignite.internal.encryption.CacheGroupKeyChangeTest.testNodeFailsAfterPerform [21:15:40]i: [org.apache.ignite.testsuites.IgniteBasicWithPersistenceTestSuite] org.apache.ignite.internal.encryption.CacheGroupKeyChangeTest.testNodeFailsAfterPrepare [21:15:40]i: [org.apache.ignite.testsuites.IgniteBasicWithPersistenceTestSuite] org.apache.ignite.internal.encryption.CacheGroupKeyChangeTest.testClientJoinDuringRotation [21:15:40]i: [org.apache.ignite.testsuites.IgniteBasicWithPersistenceTestSuite] org.apache.ignite.internal.encryption.CacheGroupKeyChangeTest.testCacheStartDuringRotation [21:15:40]i: [org.apache.ignite.testsuites.IgniteBasicWithPersistenceTestSuite] org.apache.ignite.internal.encryption.CacheGroupKeyChangeTest.testMasterAndCacheGroupKeySimultaneousChange [21:15:40]i: [org.apache.ignite.testsuites.IgniteBasicWithPersistenceTestSuite] org.apache.ignite.internal.encryption.CacheGroupKeyChangeTest.testKeyChangeWithNodeFilter [21:15:40]i: [org.apache.ignite.testsuites.IgniteBasicWithPersistenceTestSuite] org.apache.ignite.internal.encryption.CacheGroupKeyChangeTest.testRejectNodeJoinDuringRotation [21:15:40]i: [org.apache.ignite.testsuites.IgniteBasicWithPersistenceTestSuite] org.apache.ignite.internal.encryption.CacheGroupKeyChangeTest.testWrongCacheGroupSpecified [21:15:40]F: [org.apache.ignite.testsuites.IgniteBasicWithPersistenceTestSuite] org.apache.ignite.internal.encryption.CacheGroupKeyChangeTest.testKeyIdentifierOverflow [21:15:40]i: [org.apache.ignite.internal.encryption.CacheGroupKeyChangeTest.testKeyIdentifierOverflow] [Test Output] class org.apache.ignite.IgniteException: Cache group key change was rejected. Cache group reencryption is in progress [grp=encrypted] at org.apache.ignite.internal.managers.encryption.GroupKeyChangeProcess.start(GroupKeyChangeProcess.java:159) at org.apache.ignite.internal.managers.encryption.GridEncryptionManager.changeCacheGroupKey(GridEncryptionManager.java:744) at org.apache.ignite.internal.encryption.CacheGroupKeyChangeTest.testKeyIdentifierOverflow(CacheGroupKeyChangeTest.java:333) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.apache.ignite.testframework.junits.GridAbstractTest$7.run(GridAbstractTest.java:2432) at java.lang.Thread.run(Thread.java:748) [21:15:40] : [Step 4/5] [2021-11-19 21:15:40,804][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][ClientListenerProcessor] Client connector processor has started on TCP port 10800 [21:15:40]F: [org.apache.ignite.internal.encryption.CacheGroupKeyChangeTest.testKeyIdentifierOverflow] Cache group key change was rejected. Cache group reencryption is in progress [grp=encrypted] [21:15:40]F: [org.apache.ignite.internal.encryption.CacheGroupKeyChangeTest.testKeyIdentifierOverflow] Cache group key change was rejected. Cache group reencryption is in progress [grp=encrypted] [21:15:40]i: [org.apache.ignite.testsuites.IgniteBasicWithPersistenceTestSuite] org.apache.ignite.internal.encryption.CacheGroupKeyChangeTest.testNodeJoinRejectedIfKeyCannotBeReplaced [21:15:40]i: [org.apache.ignite.testsuites.IgniteBasicWithPersistenceTestSuite] org.apache.ignite.internal.encryption.CacheGroupKeyChangeTest.testNodeFailsBeforePerform [21:15:40]i: [org.apache.ignite.testsuites.IgniteBasicWithPersistenceTestSuite] org.apache.ignite.internal.encryption.CacheGroupKeyChangeTest.testNodeFailsBeforePrepare [21:15:40]i: [org.apache.ignite.testsuites.IgniteBasicWithPersistenceTestSuite] org.apache.ignite.internal.encryption.CacheGroupKeyChangeTest.testCacheStartOnClientDuringRotation [21:15:40]i: [org.apache.ignite.testsuites.IgniteBasicWithPersistenceTestSuite] org.apache.ignite.internal.encryption.CacheGroupKeyChangeTest.testChangeKeyDuringRebalancing [21:15:40] : [Step 4/5] [2021-11-19 21:15:40,811][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] Non-loopback local IPs: 172.17.0.4 [21:15:40] : [Step 4/5] [2021-11-19 21:15:40,811][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] Enabled local MACs: 0242AC110004 [21:15:40] : [Step 4/5] [2021-11-19 21:15:40,814][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:15:40] : [Step 4/5] [2021-11-19 21:15:40,815][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:15:40] : [Step 4/5] [2021-11-19 21:15:40,816][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:15:40] : [Step 4/5] [2021-11-19 21:15:40,818][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Applying lost metastore updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:15:40] : [Step 4/5] [2021-11-19 21:15:40,819][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=0 ms] [21:15:40] : [Step 4/5] [2021-11-19 21:15:40,819][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Restoring partition state for local groups. [21:15:40] : [Step 4/5] [2021-11-19 21:15:40,819][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=0, partitionsProcessed=0, time=0ms] [21:15:40] : [Step 4/5] [2021-11-19 21:15:40,820][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][GridEncryptionManager] Encryption keys loaded from metastore. [grps=, masterKeyName=ignite.master.key] [21:15:40] : [Step 4/5] [2021-11-19 21:15:40,825][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][ClusterProcessor] Cluster ID and tag has been read from metastorage: null [21:15:40] : [Step 4/5] [2021-11-19 21:15:40,825][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][IgniteClusterImpl] Shutdown policy was updated [oldVal=null, newVal=null] [21:15:40] : [Step 4/5] [2021-11-19 21:15:40,826][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Checkpoint frequency deviation changed [oldVal=null, newVal=null] [21:15:40] : [Step 4/5] [2021-11-19 21:15:40,836][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][FilePageStoreManager] Cleanup cache stores [total=1, left=0, cleanFiles=false] [21:15:40] : [Step 4/5] [2021-11-19 21:15:40,838][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:15:40] : [Step 4/5] [2021-11-19 21:15:40,839][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:15:40] : [Step 4/5] [2021-11-19 21:15:40,841][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:15:40] : [Step 4/5] [2021-11-19 21:15:40,842][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Data Regions Started: 5 [21:15:40] : [Step 4/5] [2021-11-19 21:15:40,842][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] ^-- sysMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:15:40] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:15:40] : [Step 4/5] ^-- default region [type=default, persistence=true, lazyAlloc=true, [21:15:40] : [Step 4/5] ... initCfg=100MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB, allocTotal=0MB] [21:15:40] : [Step 4/5] ^-- metastoreMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:15:40] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:15:40] : [Step 4/5] ^-- TxLog region [type=internal, persistence=true, lazyAlloc=false, [21:15:40] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:15:40] : [Step 4/5] ^-- volatileDsMemPlc region [type=user, persistence=false, lazyAlloc=true, [21:15:40] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB] [21:15:40] : [Step 4/5] ^-- Ignite persistence [used=0MB] [21:15:40] : [Step 4/5] [21:15:40] : [Step 4/5] [2021-11-19 21:15:40,844][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Starting binary memory restore for: [-2100569601] [21:15:40] : [Step 4/5] [2021-11-19 21:15:40,855][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:15:40] : [Step 4/5] [2021-11-19 21:15:40,856][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:15:40] : [Step 4/5] [2021-11-19 21:15:40,860][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000000.wal, offset=0, ver=2] [21:15:40] : [Step 4/5] [2021-11-19 21:15:40,863][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Started cache in recovery mode [name=ignite-sys-cache, id=-2100569601, dataRegionName=sysMemPlc, mode=REPLICATED, atomicity=TRANSACTIONAL, backups=2147483647, mvcc=false] [21:15:40] : [Step 4/5] [2021-11-19 21:15:40,864][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Binary recovery performed in 20 ms. [21:15:40] : [Step 4/5] [2021-11-19 21:15:40,865][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:15:40] : [Step 4/5] [2021-11-19 21:15:40,865][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Applying lost cache updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:15:40] : [Step 4/5] [2021-11-19 21:15:40,868][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=0 ms] [21:15:40] : [Step 4/5] [2021-11-19 21:15:40,868][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Restoring partition state for local groups. [21:15:40] : [Step 4/5] [2021-11-19 21:15:40,892][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=1, partitionsProcessed=100, time=31ms] [21:15:40] : [Step 4/5] [2021-11-19 21:15:40,899][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][TestTcpDiscoverySpi] Successfully bound to TCP port [port=47500, localHost=localhost/127.0.0.1, locNodeId=00eebdf5-f37b-4541-825b-78873b80b000] [21:15:40] : [Step 4/5] [2021-11-19 21:15:40,910][INFO ][disco-notifier-worker-#27092%grid-0%][MvccProcessorImpl] Assigned mvcc coordinator [crd=MvccCoordinator [topVer=AffinityTopologyVersion [topVer=1, minorTopVer=0], nodeId=00eebdf5-f37b-4541-825b-78873b80b000, ver=1637345740903, local=true, initialized=false]] [21:15:40] : [Step 4/5] [2021-11-19 21:15:40,912][INFO ][sys-#27075%grid-0%][ClusterProcessor] Writing cluster ID and tag to metastorage on ready for write ClusterIdAndTag [id=36dc15e9-5b3a-4d7b-9471-faac5f61178d, tag=angry_villani] [21:15:40] : [Step 4/5] [2021-11-19 21:15:40,916][INFO ][disco-notifier-worker-#27092%grid-0%][ClusterProcessor] angry_villani [21:15:40] : [Step 4/5] [2021-11-19 21:15:40,917][INFO ][disco-notifier-worker-#27092%grid-0%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustEnabled' was changed from 'null' to 'false' [21:15:40] : [Step 4/5] [2021-11-19 21:15:40,918][INFO ][disco-notifier-worker-#27092%grid-0%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustTimeout' was changed from 'null' to '300000' [21:15:40] : [Step 4/5] [2021-11-19 21:15:40,919][INFO ][disco-notifier-worker-#27092%grid-0%][IgniteTxManager] Transactions parameter 'longOperationsDumpTimeout' was changed from 'null' to '60000' [21:15:40] : [Step 4/5] [2021-11-19 21:15:40,919][INFO ][disco-notifier-worker-#27092%grid-0%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpThreshold' was changed from 'null' to '0' [21:15:40] : [Step 4/5] [2021-11-19 21:15:40,920][INFO ][disco-notifier-worker-#27092%grid-0%][IgniteTxManager] Transactions parameter 'transactionTimeDumpSamplesCoefficient' was changed from 'null' to '0.0' [21:15:40] : [Step 4/5] [2021-11-19 21:15:40,920][INFO ][disco-notifier-worker-#27092%grid-0%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpSamplesPerSecondLimit' was changed from 'null' to '5' [21:15:40] : [Step 4/5] [2021-11-19 21:15:40,921][INFO ][disco-notifier-worker-#27092%grid-0%][IgniteTxManager] Transactions parameter 'collisionsDumpInterval' was changed from 'null' to '1000' [21:15:40] : [Step 4/5] [2021-11-19 21:15:40,921][INFO ][disco-notifier-worker-#27092%grid-0%][IgniteTxManager] Transactions parameter 'txOwnerDumpRequestsAllowed' was changed from 'null' to 'true' [21:15:40] : [Step 4/5] [2021-11-19 21:15:40,922][INFO ][disco-notifier-worker-#27092%grid-0%][GridCacheDatabaseSharedManager] Historical rebalance WAL threshold changed [property=historical.rebalance.threshold, oldVal=null, newVal=500] [21:15:40] : [Step 4/5] [2021-11-19 21:15:40,925][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] To start Console Management & Monitoring run ignitevisorcmd.{sh|bat} [21:15:40] : [Step 4/5] [2021-11-19 21:15:40,926][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] [21:15:40] : [Step 4/5] [21:15:40] : [Step 4/5] >>> +-------------------------------------------+ [21:15:40] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:15:40] : [Step 4/5] >>> +-------------------------------------------+ [21:15:40] : [Step 4/5] >>> OS name: Linux 4.15.0-151-generic amd64 [21:15:40] : [Step 4/5] >>> CPU(s): 24 [21:15:40] : [Step 4/5] >>> Heap: 2.0GB [21:15:40] : [Step 4/5] >>> VM name: 16724@c4dfe9a430b2 [21:15:40] : [Step 4/5] >>> Ignite instance name: grid-0 [21:15:40] : [Step 4/5] >>> Local node [ID=00EEBDF5-F37B-4541-825B-78873B80B000, order=1, clientMode=false] [21:15:40] : [Step 4/5] >>> Local node addresses: [127.0.0.1] [21:15:40] : [Step 4/5] >>> Local ports: TCP:10800 TCP:47100 TCP:47500 [21:15:40] : [Step 4/5] [21:15:40] : [Step 4/5] [2021-11-19 21:15:40,927][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] >>> Ignite cluster is in INACTIVE state (limited functionality available). Use control.(sh|bat) script or IgniteCluster.state(ClusterState.ACTIVE) to change the state. [21:15:40] : [Step 4/5] [2021-11-19 21:15:40,927][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][GridDiscoveryManager] Topology snapshot [ver=1, locNode=00eebdf5, servers=1, clients=0, state=INACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=00eebdf5-f37b-4541-825b-78873b80b000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:15:40] : [Step 4/5] [2021-11-19 21:15:40,928][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][G] Node started : [stage="Configure system pool" (0 ms),stage="Start managers" (206 ms),stage="Configure binary metadata" (2 ms),stage="Start processors" (125 ms),stage="Start 'StanByClusterTestProvider' plugin" (0 ms),stage="Start 'PageMemory tracker plugin' plugin" (0 ms),stage="Start 'TestDistibutedConfigurationPlugin' plugin" (0 ms),stage="Start 'NodeValidationPluginProvider' plugin" (0 ms),stage="Init metastore" (25 ms),stage="Init and start regions" (8 ms),stage="Restore binary memory" (20 ms),stage="Restore logical state" (28 ms),stage="Finish recovery" (4 ms),stage="Join topology" (12 ms),stage="Await transition" (2 ms),stage="Await exchange" (15 ms),stage="Total time" (447 ms)] [21:15:40] : [Step 4/5] [2021-11-19 21:15:40,930][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][root] Node started with the following configuration [id=00eebdf5-f37b-4541-825b-78873b80b000, marshaller=BinaryMarshaller [], discovery=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=5000, ackTimeout=5000, marsh=JdkMarshaller [clsFilter=org.apache.ignite.marshaller.MarshallerUtils$1@36fe75f4], reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], binaryCfg=null, lateAff=true] [21:15:40]W: [org.apache.ignite:ignite-core] [2021-11-19 21:15:40,935][WARN ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][G] Ignite work directory is not provided, automatically resolved to: /opt/buildagent/work/7bc1c54bc719b67c/work [21:15:40] : [Step 4/5] [2021-11-19 21:15:40,938][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] [21:15:40] : [Step 4/5] [21:15:40] : [Step 4/5] >>> __________ ________________ [21:15:40] : [Step 4/5] >>> / _/ ___/ |/ / _/_ __/ __/ [21:15:40] : [Step 4/5] >>> _/ // (7 7 // / / / / _/ [21:15:40] : [Step 4/5] >>> /___/\___/_/|_/___/ /_/ /___/ [21:15:40] : [Step 4/5] >>> [21:15:40] : [Step 4/5] >>> ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:15:40] : [Step 4/5] >>> 2021 Copyright(C) Apache Software Foundation [21:15:40] : [Step 4/5] >>> [21:15:40] : [Step 4/5] >>> Ignite documentation: http://ignite.apache.org [21:15:40] : [Step 4/5] [21:15:40] : [Step 4/5] [2021-11-19 21:15:40,938][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] Config URL: n/a [21:15:40] : [Step 4/5] [2021-11-19 21:15:40,939][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] IgniteConfiguration [igniteInstanceName=grid-1, pubPoolSize=24, svcPoolSize=24, callbackPoolSize=24, stripedPoolSize=24, sysPoolSize=24, mgmtPoolSize=4, dataStreamerPoolSize=24, utilityCachePoolSize=24, utilityCacheKeepAliveTime=60000, p2pPoolSize=2, qryPoolSize=24, buildIdxPoolSize=4, igniteHome=/opt/buildagent/work/7bc1c54bc719b67c, igniteWorkDir=/opt/buildagent/work/7bc1c54bc719b67c/work, mbeanSrv=com.sun.jmx.mbeanserver.JmxMBeanServer@6fe85038, nodeId=104aa94c-3e4b-44f4-8a58-47072b7be001, marsh=BinaryMarshaller [], marshLocJobs=false, daemon=false, p2pEnabled=true, netTimeout=10000, netCompressionLevel=1, sndRetryDelay=1000, sndRetryCnt=3, metricsHistSize=10000, metricsUpdateFreq=1000, metricsExpTime=9223372036854775807, discoSpi=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=0, ackTimeout=0, marsh=null, reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], segPlc=STOP, segResolveAttempts=2, waitForSegOnStart=true, allResolversPassReq=true, segChkFreq=10000, commSpi=TcpCommunicationSpi [connectGate=org.apache.ignite.spi.communication.tcp.internal.ConnectGateway@20b31e7b, ctxInitLatch=java.util.concurrent.CountDownLatch@3ec0265f[Count = 1], stopping=false, clientPool=null, nioSrvWrapper=null, stateProvider=null], evtSpi=MemoryEventStorageSpi [expireAgeMs=9223372036854775807, expireCnt=10000, filter=null], colSpi=NoopCollisionSpi [], deploySpi=LocalDeploymentSpi [], indexingSpi=org.apache.ignite.spi.indexing.noop.NoopIndexingSpi@2a8c859b, addrRslvr=null, encryptionSpi=org.apache.ignite.spi.encryption.keystore.KeystoreEncryptionSpi@3bb98cd2, tracingSpi=org.apache.ignite.spi.tracing.NoopTracingSpi@5fa18f65, clientMode=false, rebalanceThreadPoolSize=4, rebalanceTimeout=10000, rebalanceBatchesPrefetchCnt=3, rebalanceThrottle=0, rebalanceBatchSize=524288, txCfg=TransactionConfiguration [txSerEnabled=false, dfltIsolation=REPEATABLE_READ, dfltConcurrency=PESSIMISTIC, dfltTxTimeout=0, txTimeoutOnPartitionMapExchange=0, deadlockTimeout=10000, pessimisticTxLogSize=0, pessimisticTxLogLinger=10000, tmLookupClsName=null, txManagerFactory=null, useJtaSync=false], cacheSanityCheckEnabled=true, discoStartupDelay=60000, deployMode=SHARED, p2pMissedCacheSize=100, locHost=127.0.0.1, timeSrvPortBase=31100, timeSrvPortRange=100, failureDetectionTimeout=10000, sysWorkerBlockedTimeout=null, clientFailureDetectionTimeout=10000, metricsLogFreq=0, connectorCfg=null, odbcCfg=null, warmupClos=null, atomicCfg=AtomicConfiguration [seqReserveSize=1000, cacheMode=PARTITIONED, backups=1, aff=null, grpName=null], classLdr=null, sslCtxFactory=null, platformCfg=null, binaryCfg=null, memCfg=null, pstCfg=null, dsCfg=DataStorageConfiguration [sysRegionInitSize=41943040, sysRegionMaxSize=104857600, pageSize=4096, concLvl=0, dfltDataRegConf=DataRegionConfiguration [name=default, maxSize=104857600, initSize=268435456, swapPath=null, pageEvictionMode=DISABLED, pageReplacementMode=CLOCK, evictionThreshold=0.9, emptyPagesPoolSize=100, metricsEnabled=false, metricsSubIntervalCount=5, metricsRateTimeInterval=60000, persistenceEnabled=true, checkpointPageBufSize=0, lazyMemoryAllocation=true, warmUpCfg=null], dataRegions=null, storagePath=null, checkpointFreq=30000, lockWaitTime=10000, checkpointThreads=4, checkpointWriteOrder=SEQUENTIAL, walHistSize=20, maxWalArchiveSize=20971520, walSegments=10, walSegmentSize=1048576, walPath=db/wal, walArchivePath=db/wal/archive, cdcWalPath=db/wal/cdc, cdcEnabled=false, metricsEnabled=false, walMode=LOG_ONLY, walTlbSize=131072, walBuffSize=0, walFlushFreq=2000, walFsyncDelay=1000, walRecordIterBuffSize=67108864, alwaysWriteFullPages=false, fileIOFactory=org.apache.ignite.internal.processors.cache.persistence.file.AsyncFileIOFactory@72b7f26d, metricsSubIntervalCnt=5, metricsRateTimeInterval=60000, walAutoArchiveAfterInactivity=-1, walForceArchiveTimeout=-1, writeThrottlingEnabled=false, walCompactionEnabled=false, walCompactionLevel=1, checkpointReadLockTimeout=null, walPageCompression=DISABLED, walPageCompressionLevel=null, dfltWarmUpCfg=null, encCfg=org.apache.ignite.configuration.EncryptionConfiguration@c95de86, defragmentationThreadPoolSize=4, minWalArchiveSize=-1], snapshotPath=snapshots, activeOnStart=true, activeOnStartPropSetFlag=false, autoActivation=true, autoActivationPropSetFlag=false, clusterStateOnStart=null, sqlConnCfg=null, cliConnCfg=ClientConnectorConfiguration [host=null, port=10800, portRange=100, sockSndBufSize=0, sockRcvBufSize=0, tcpNoDelay=true, maxOpenCursorsPerConn=128, threadPoolSize=24, selectorCnt=12, idleTimeout=0, handshakeTimeout=10000, jdbcEnabled=true, odbcEnabled=true, thinCliEnabled=true, sslEnabled=false, useIgniteSslCtxFactory=true, sslClientAuth=false, sslCtxFactory=null, thinCliCfg=ThinClientConfiguration [maxActiveTxPerConn=100, maxActiveComputeTasksPerConn=0]], mvccVacuumThreadCnt=2, mvccVacuumFreq=5000, authEnabled=false, failureHnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]], commFailureRslvr=null, sqlCfg=SqlConfiguration [longQryWarnTimeout=3000, dfltQryTimeout=0, sqlQryHistSize=1000, validationEnabled=false], asyncContinuationExecutor=null] [21:15:40] : [Step 4/5] [2021-11-19 21:15:40,948][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] Daemon mode: off [21:15:40] : [Step 4/5] [2021-11-19 21:15:40,948][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] OS: Linux 4.15.0-151-generic amd64 [21:15:40] : [Step 4/5] [2021-11-19 21:15:40,948][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] OS user: teamcity [21:15:40] : [Step 4/5] [2021-11-19 21:15:40,948][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] PID: 16724 [21:15:40] : [Step 4/5] [2021-11-19 21:15:40,949][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] Language runtime: Java Platform API Specification ver. 1.8 [21:15:40] : [Step 4/5] [2021-11-19 21:15:40,949][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] VM information: Java(TM) SE Runtime Environment 1.8.0_261-b12 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 25.261-b12 [21:15:40] : [Step 4/5] [2021-11-19 21:15:40,950][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] VM total memory: 1.9GB [21:15:40] : [Step 4/5] [2021-11-19 21:15:40,950][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] Remote Management [restart: off, REST: off, JMX (remote: off)] [21:15:40] : [Step 4/5] [2021-11-19 21:15:40,950][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] Logger: GridTestLog4jLogger [quiet=false, config=null] [21:15:40] : [Step 4/5] [2021-11-19 21:15:40,950][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] IGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c [21:15:40] : [Step 4/5] [2021-11-19 21:15:40,951][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] VM arguments: [-DIGNITE_DUMP_THREADS_ON_FAILURE=false, -DMono=/usr/bin/mono-sgen, -DMono4.0_x64=/usr/lib/mono/4.0, -DMono4.5_x64=/usr/lib/mono/4.5, -DMonoVersion=6.12.0.90, -DSKIP_BUILD=false, -Dagent.home.dir=/opt/buildagent, -Dagent.name=aitc-lin02_03, -Dagent.ownPort=9090, -Dagent.work.dir=/opt/buildagent/work, -Dbuild.number=95, -Dbuild.vcs.number=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.1=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.GitHubApacheIgnite=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dclassworlds.conf=/opt/buildagent/temp/buildTmp/teamcity.m2.conf, -Dcom.jetbrains.maven.watcher.report.file=/opt/buildagent/temp/buildTmp/maven-build-info.xml, -Djava.io.tmpdir=/opt/buildagent/temp/buildTmp, -Dmaven.home=/opt/buildagent/tools/maven3_6, -Dmaven.multiModuleProjectDirectory=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.agent.cpuBenchmark=457, -Dteamcity.agent.dotnet.agent_url=http://localhost:9090/RPC2, -Dteamcity.agent.dotnet.build_id=6278078, -Dteamcity.auth.password=*******, -Dteamcity.auth.userId=TeamCityBuildId=6278078, -Dteamcity.build.changedFiles.file=/opt/buildagent/temp/buildTmp/changedFiles6342607772318147725.txt, -Dteamcity.build.checkoutDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.build.id=6278078, -Dteamcity.build.properties.file=/opt/buildagent/temp/buildTmp/teamcity.build5164517880467851002.properties, -Dteamcity.build.tempDir=/opt/buildagent/temp/buildTmp, -Dteamcity.build.workingDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.buildConfName=Basic 3, -Dteamcity.buildType.id=IgniteTests24Java8_Basic3, -Dteamcity.configuration.properties.file=/opt/buildagent/temp/buildTmp/teamcity.config5591980786735343870.properties, -Dteamcity.maven.userSettings.path=/opt/buildagent/temp/buildTmp/maven_settings_585072866407032347.xml, -Dteamcity.maven.watcher.home=/opt/buildagent/plugins/mavenPlugin/maven-watcher-jdk16, -Dteamcity.projectName=Ignite Tests 2.x (JDK 8/11), -Dteamcity.runner.properties.file=/opt/buildagent/temp/buildTmp/teamcity.runner9098465561618137420.properties, -Dteamcity.tests.recentlyFailedTests.file=/opt/buildagent/temp/buildTmp/testsToRunFirst3891775683130404069.txt, -Dteamcity.version=2021.2 (build 99542), -ea, -Xms2g, -Xmx2g, -XX:+HeapDumpOnOutOfMemoryError, -DIGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_TEST_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_UPDATE_NOTIFIER=false, -DIGNITE_NO_DISCO_ORDER=true, -DIGNITE_PERFORMANCE_SUGGESTIONS_DISABLED=true, -Djava.net.preferIPv4Stack=true, -DTEST_SCALE_FACTOR=1.0, -DIGNITE_TEST_PROP_LOG4J_FILE=log4j-tc-test.xml, -DIGNITE_QUIET=false, -DIGNITE_MARSHAL_BUFFERS_RECHECK=1000, -Dmaven.repo.local=/opt/buildagent/.m2/repository] [21:15:40] : [Step 4/5] [2021-11-19 21:15:40,956][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] System cache's DataRegion size is configured to 40 MB. Use DataStorageConfiguration.systemRegionInitialSize property to change the setting. [21:15:40] : [Step 4/5] [2021-11-19 21:15:40,956][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] Configured caches [in 'sysMemPlc' dataRegion: ['ignite-sys-cache']] [21:15:40]W: [org.apache.ignite:ignite-core] [2021-11-19 21:15:40,956][WARN ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] Peer class loading is enabled (disable it in production for performance and deployment consistency reasons) [21:15:40] : [Step 4/5] [2021-11-19 21:15:40,957][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] 3-rd party licenses can be found at: /opt/buildagent/work/7bc1c54bc719b67c/libs/licenses [21:15:40] : [Step 4/5] [2021-11-19 21:15:40,961][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] Configured plugins: [21:15:40] : [Step 4/5] [2021-11-19 21:15:40,961][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- StanByClusterTestProvider 1.0 [21:15:40] : [Step 4/5] [2021-11-19 21:15:40,962][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:15:40] : [Step 4/5] [2021-11-19 21:15:40,962][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] [21:15:40] : [Step 4/5] [2021-11-19 21:15:40,962][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- PageMemory tracker plugin 1.0 [21:15:40] : [Step 4/5] [2021-11-19 21:15:40,962][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:15:40] : [Step 4/5] [2021-11-19 21:15:40,962][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] [21:15:40] : [Step 4/5] [2021-11-19 21:15:40,963][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- TestDistibutedConfigurationPlugin 1.0 [21:15:40] : [Step 4/5] [2021-11-19 21:15:40,963][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:15:40] : [Step 4/5] [2021-11-19 21:15:40,963][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] [21:15:40] : [Step 4/5] [2021-11-19 21:15:40,963][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- NodeValidationPluginProvider 1.0 [21:15:40] : [Step 4/5] [2021-11-19 21:15:40,964][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:15:40] : [Step 4/5] [2021-11-19 21:15:40,964][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] [21:15:40] : [Step 4/5] [2021-11-19 21:15:40,964][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][FailureProcessor] Configured failure handler: [hnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]]] [21:15:40] : [Step 4/5] [2021-11-19 21:15:40,980][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][TestRecordingCommunicationSpi] Successfully bound communication NIO server to TCP port [port=47101, locHost=/127.0.0.1, selectorsCnt=12, selectorSpins=0, pairedConn=false] [21:15:40]W: [org.apache.ignite:ignite-core] [2021-11-19 21:15:40,981][WARN ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][TestRecordingCommunicationSpi] Message queue limit is set to 0 which may lead to potential OOMEs when running cache operations in FULL_ASYNC or PRIMARY_SYNC modes due to message queues growth on sender and receiver sides. [21:15:40] : [Step 4/5] [2021-11-19 21:15:40,985][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][GridCollisionManager] Collision resolution is disabled (all jobs will be activated upon arrival). [21:15:40] : [Step 4/5] [2021-11-19 21:15:40,985][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] Security status [authentication=off, sandbox=off, tls/ssl=off] [21:15:41] : [Step 4/5] [2021-11-19 21:15:41,048][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:15:41] : [Step 4/5] [2021-11-19 21:15:41,142][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][MaintenanceProcessor] Resolved store directory for node persistent data: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1 [21:15:41] : [Step 4/5] [2021-11-19 21:15:41,143][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][CacheObjectBinaryProcessorImpl] Resolved directory for serialized binary metadata: /opt/buildagent/work/7bc1c54bc719b67c/work/db/binary_meta/grid_1 [21:15:41] : [Step 4/5] [2021-11-19 21:15:41,147][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1 [21:15:41] : [Step 4/5] [2021-11-19 21:15:41,148][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][FileWriteAheadLogManager] Resolved write ahead log work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1 [21:15:41] : [Step 4/5] [2021-11-19 21:15:41,148][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][FileWriteAheadLogManager] Resolved write ahead log archive directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1 [21:15:41] : [Step 4/5] [2021-11-19 21:15:41,331][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000000.wal [21:15:41] : [Step 4/5] [2021-11-19 21:15:41,331][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][FileHandleManagerImpl] Initialized write-ahead log manager [mode=LOG_ONLY] [21:15:41] : [Step 4/5] [2021-11-19 21:15:41,336][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Configured data regions initialized successfully [total=5] [21:15:41] : [Step 4/5] [2021-11-19 21:15:41,339][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][IgniteSnapshotManager] Resolved snapshot work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/snapshots [21:15:41] : [Step 4/5] [2021-11-19 21:15:41,339][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][IgniteSnapshotManager] Resolved temp directory for snapshot creation: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1/snp [21:15:41] : [Step 4/5] [2021-11-19 21:15:41,342][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][ClientListenerProcessor] Client connector processor has started on TCP port 10801 [21:15:41] : [Step 4/5] [2021-11-19 21:15:41,344][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] Non-loopback local IPs: 172.17.0.4 [21:15:41] : [Step 4/5] [2021-11-19 21:15:41,344][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] Enabled local MACs: 0242AC110004 [21:15:41] : [Step 4/5] [2021-11-19 21:15:41,344][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:15:41] : [Step 4/5] [2021-11-19 21:15:41,346][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:15:41] : [Step 4/5] [2021-11-19 21:15:41,346][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:15:41] : [Step 4/5] [2021-11-19 21:15:41,348][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Applying lost metastore updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:15:41] : [Step 4/5] [2021-11-19 21:15:41,349][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=0 ms] [21:15:41] : [Step 4/5] [2021-11-19 21:15:41,349][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Restoring partition state for local groups. [21:15:41] : [Step 4/5] [2021-11-19 21:15:41,349][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=0, partitionsProcessed=0, time=0ms] [21:15:41] : [Step 4/5] [2021-11-19 21:15:41,350][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][GridEncryptionManager] Encryption keys loaded from metastore. [grps=, masterKeyName=ignite.master.key] [21:15:41] : [Step 4/5] [2021-11-19 21:15:41,351][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][ClusterProcessor] Cluster ID and tag has been read from metastorage: null [21:15:41] : [Step 4/5] [2021-11-19 21:15:41,351][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][IgniteClusterImpl] Shutdown policy was updated [oldVal=null, newVal=null] [21:15:41] : [Step 4/5] [2021-11-19 21:15:41,352][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Checkpoint frequency deviation changed [oldVal=null, newVal=null] [21:15:41] : [Step 4/5] [2021-11-19 21:15:41,362][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][FilePageStoreManager] Cleanup cache stores [total=1, left=0, cleanFiles=false] [21:15:41] : [Step 4/5] [2021-11-19 21:15:41,365][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:15:41] : [Step 4/5] [2021-11-19 21:15:41,366][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:15:41] : [Step 4/5] [2021-11-19 21:15:41,368][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:15:41] : [Step 4/5] [2021-11-19 21:15:41,369][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Data Regions Started: 5 [21:15:41] : [Step 4/5] [2021-11-19 21:15:41,369][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] ^-- sysMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:15:41] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:15:41] : [Step 4/5] ^-- default region [type=default, persistence=true, lazyAlloc=true, [21:15:41] : [Step 4/5] ... initCfg=100MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB, allocTotal=0MB] [21:15:41] : [Step 4/5] ^-- metastoreMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:15:41] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:15:41] : [Step 4/5] ^-- TxLog region [type=internal, persistence=true, lazyAlloc=false, [21:15:41] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:15:41] : [Step 4/5] ^-- volatileDsMemPlc region [type=user, persistence=false, lazyAlloc=true, [21:15:41] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB] [21:15:41] : [Step 4/5] ^-- Ignite persistence [used=0MB] [21:15:41] : [Step 4/5] [21:15:41] : [Step 4/5] [2021-11-19 21:15:41,372][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Starting binary memory restore for: [-2100569601] [21:15:41] : [Step 4/5] [2021-11-19 21:15:41,384][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:15:41] : [Step 4/5] [2021-11-19 21:15:41,384][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=0, len=0], lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:15:41] : [Step 4/5] [2021-11-19 21:15:41,388][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000000.wal, offset=0, ver=2] [21:15:41] : [Step 4/5] [2021-11-19 21:15:41,391][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Started cache in recovery mode [name=ignite-sys-cache, id=-2100569601, dataRegionName=sysMemPlc, mode=REPLICATED, atomicity=TRANSACTIONAL, backups=2147483647, mvcc=false] [21:15:41] : [Step 4/5] [2021-11-19 21:15:41,395][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Binary recovery performed in 23 ms. [21:15:41] : [Step 4/5] [2021-11-19 21:15:41,396][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=null, endMarker=null] [21:15:41] : [Step 4/5] [2021-11-19 21:15:41,396][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Applying lost cache updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=00000000-0000-0000-0000-000000000000] [21:15:41] : [Step 4/5] [2021-11-19 21:15:41,400][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=0 ms] [21:15:41] : [Step 4/5] [2021-11-19 21:15:41,400][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Restoring partition state for local groups. [21:15:41] : [Step 4/5] [2021-11-19 21:15:41,433][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=1, partitionsProcessed=100, time=31ms] [21:15:41] : [Step 4/5] [2021-11-19 21:15:41,456][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][TestTcpDiscoverySpi] Successfully bound to TCP port [port=47501, localHost=localhost/127.0.0.1, locNodeId=104aa94c-3e4b-44f4-8a58-47072b7be001] [21:15:41] : [Step 4/5] [2021-11-19 21:15:41,460][INFO ][tcp-disco-srvr-[:47500]-#1424%grid-0%-#27094%grid-0%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=37379] [21:15:41] : [Step 4/5] [2021-11-19 21:15:41,460][INFO ][tcp-disco-srvr-[:47500]-#1424%grid-0%-#27094%grid-0%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=37379] [21:15:41] : [Step 4/5] [2021-11-19 21:15:41,462][INFO ][tcp-disco-sock-reader-[]-#1430%grid-0%-#27214%grid-0%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:37379, rmtPort=37379] [21:15:41] : [Step 4/5] [2021-11-19 21:15:41,464][INFO ][tcp-disco-sock-reader-[104aa94c 127.0.0.1:37379]-#1430%grid-0%-#27214%grid-0%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=104aa94c-3e4b-44f4-8a58-47072b7be001, rmtAddr=/127.0.0.1:37379] [21:15:41] : [Step 4/5] [2021-11-19 21:15:41,470][INFO ][tcp-disco-srvr-[:47501]-#1429%grid-1%-#27213%grid-1%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=52735] [21:15:41] : [Step 4/5] [2021-11-19 21:15:41,471][INFO ][tcp-disco-srvr-[:47501]-#1429%grid-1%-#27213%grid-1%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=52735] [21:15:41] : [Step 4/5] [2021-11-19 21:15:41,472][INFO ][tcp-disco-sock-reader-[]-#1431%grid-1%-#27215%grid-1%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:52735, rmtPort=52735] [21:15:41] : [Step 4/5] [2021-11-19 21:15:41,472][INFO ][tcp-disco-sock-reader-[]-#1431%grid-1%-#27215%grid-1%][TestTcpDiscoverySpi] Received ping request from the remote node [rmtNodeId=00eebdf5-f37b-4541-825b-78873b80b000, rmtAddr=/127.0.0.1:52735, rmtPort=52735] [21:15:41] : [Step 4/5] [2021-11-19 21:15:41,474][INFO ][tcp-disco-sock-reader-[]-#1431%grid-1%-#27215%grid-1%][TestTcpDiscoverySpi] Finished writing ping response [rmtNodeId=00eebdf5-f37b-4541-825b-78873b80b000, rmtAddr=/127.0.0.1:52735, rmtPort=52735] [21:15:41] : [Step 4/5] [2021-11-19 21:15:41,475][INFO ][tcp-disco-sock-reader-[104aa94c 127.0.0.1:37379]-#1430%grid-0%-#27214%grid-0%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:37379, rmtPort=37379, rmtNodeId=104aa94c-3e4b-44f4-8a58-47072b7be001] [21:15:41]W: [org.apache.ignite:ignite-core] [2021-11-19 21:15:41,475][WARN ][tcp-disco-sock-reader-[]-#1431%grid-1%-#27215%grid-1%][TestTcpDiscoverySpi] Failed to shutdown socket [21:15:41]W: [org.apache.ignite:ignite-core] java.net.SocketException: Socket output is already shutdown [21:15:41]W: [org.apache.ignite:ignite-core] at java.net.Socket.shutdownOutput(Socket.java:1572) [21:15:41]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.close(IgniteUtils.java:4247) [21:15:41]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.discovery.tcp.ServerImpl$SocketReader.body(ServerImpl.java:7370) [21:15:41]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.IgniteSpiThread.run(IgniteSpiThread.java:58) [21:15:41] : [Step 4/5] [2021-11-19 21:15:41,481][INFO ][tcp-disco-sock-reader-[]-#1431%grid-1%-#27215%grid-1%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:52735, rmtPort=52735, rmtNodeId=null] [21:15:41] : [Step 4/5] [2021-11-19 21:15:41,482][INFO ][tcp-disco-msg-worker-[crd]-#1423%grid-0%-#27093%grid-0%][GridEncryptionManager] Joining node doesn't have stored group keys [node=104aa94c-3e4b-44f4-8a58-47072b7be001] [21:15:41] : [Step 4/5] [2021-11-19 21:15:41,494][INFO ][tcp-disco-msg-worker-[crd]-#1423%grid-0%-#27093%grid-0%][TestTcpDiscoverySpi] New next node [newNext=TcpDiscoveryNode [id=104aa94c-3e4b-44f4-8a58-47072b7be001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=0, intOrder=2, lastExchangeTime=1637345741466, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false]] [21:15:41] : [Step 4/5] [2021-11-19 21:15:41,495][INFO ][tcp-disco-srvr-[:47501]-#1429%grid-1%-#27213%grid-1%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=54775] [21:15:41] : [Step 4/5] [2021-11-19 21:15:41,495][INFO ][tcp-disco-srvr-[:47501]-#1429%grid-1%-#27213%grid-1%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=54775] [21:15:41] : [Step 4/5] [2021-11-19 21:15:41,496][INFO ][tcp-disco-sock-reader-[]-#1432%grid-1%-#27216%grid-1%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:54775, rmtPort=54775] [21:15:41] : [Step 4/5] [2021-11-19 21:15:41,497][INFO ][tcp-disco-sock-reader-[00eebdf5 127.0.0.1:54775]-#1432%grid-1%-#27216%grid-1%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=00eebdf5-f37b-4541-825b-78873b80b000, rmtAddr=/127.0.0.1:54775] [21:15:41] : [Step 4/5] [2021-11-19 21:15:41,506][INFO ][tcp-disco-msg-worker-[]-#1428%grid-1%-#27212%grid-1%][TestTcpDiscoverySpi] New next node [newNext=TcpDiscoveryNode [id=00eebdf5-f37b-4541-825b-78873b80b000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345741496, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false]] [21:15:41] : [Step 4/5] [2021-11-19 21:15:41,507][INFO ][tcp-disco-srvr-[:47500]-#1424%grid-0%-#27094%grid-0%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=55841] [21:15:41] : [Step 4/5] [2021-11-19 21:15:41,508][INFO ][tcp-disco-srvr-[:47500]-#1424%grid-0%-#27094%grid-0%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=55841] [21:15:41] : [Step 4/5] [2021-11-19 21:15:41,509][INFO ][tcp-disco-sock-reader-[]-#1433%grid-0%-#27217%grid-0%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:55841, rmtPort=55841] [21:15:41] : [Step 4/5] [2021-11-19 21:15:41,510][INFO ][tcp-disco-sock-reader-[104aa94c 127.0.0.1:55841]-#1433%grid-0%-#27217%grid-0%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=104aa94c-3e4b-44f4-8a58-47072b7be001, rmtAddr=/127.0.0.1:55841] [21:15:41] : [Step 4/5] [2021-11-19 21:15:41,513][INFO ][disco-event-worker-#27096%grid-0%][GridDiscoveryManager] Added new node to topology: TcpDiscoveryNode [id=104aa94c-3e4b-44f4-8a58-47072b7be001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637345741466, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false] [21:15:41] : [Step 4/5] [2021-11-19 21:15:41,514][INFO ][disco-event-worker-#27096%grid-0%][GridDiscoveryManager] Topology snapshot [ver=2, locNode=00eebdf5, servers=2, clients=0, state=INACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=00eebdf5-f37b-4541-825b-78873b80b000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=104aa94c-3e4b-44f4-8a58-47072b7be001, consistentId=grid-1, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:15:41] : [Step 4/5] [2021-11-19 21:15:41,518][INFO ][tcp-disco-msg-worker-[00eebdf5 127.0.0.1:47500]-#1428%grid-1%-#27212%grid-1%][ClusterProcessor] angry_villani [21:15:41] : [Step 4/5] [2021-11-19 21:15:41,518][INFO ][tcp-disco-msg-worker-[00eebdf5 127.0.0.1:47500]-#1428%grid-1%-#27212%grid-1%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustEnabled' was changed from 'null' to 'false' [21:15:41] : [Step 4/5] [2021-11-19 21:15:41,519][INFO ][tcp-disco-msg-worker-[00eebdf5 127.0.0.1:47500]-#1428%grid-1%-#27212%grid-1%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustTimeout' was changed from 'null' to '300000' [21:15:41] : [Step 4/5] [2021-11-19 21:15:41,519][INFO ][tcp-disco-msg-worker-[00eebdf5 127.0.0.1:47500]-#1428%grid-1%-#27212%grid-1%][IgniteTxManager] Transactions parameter 'longOperationsDumpTimeout' was changed from 'null' to '60000' [21:15:41] : [Step 4/5] [2021-11-19 21:15:41,519][INFO ][tcp-disco-msg-worker-[00eebdf5 127.0.0.1:47500]-#1428%grid-1%-#27212%grid-1%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpThreshold' was changed from 'null' to '0' [21:15:41] : [Step 4/5] [2021-11-19 21:15:41,520][INFO ][tcp-disco-msg-worker-[00eebdf5 127.0.0.1:47500]-#1428%grid-1%-#27212%grid-1%][IgniteTxManager] Transactions parameter 'transactionTimeDumpSamplesCoefficient' was changed from 'null' to '0.0' [21:15:41] : [Step 4/5] [2021-11-19 21:15:41,524][INFO ][tcp-disco-msg-worker-[00eebdf5 127.0.0.1:47500]-#1428%grid-1%-#27212%grid-1%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpSamplesPerSecondLimit' was changed from 'null' to '5' [21:15:41] : [Step 4/5] [2021-11-19 21:15:41,525][INFO ][tcp-disco-msg-worker-[00eebdf5 127.0.0.1:47500]-#1428%grid-1%-#27212%grid-1%][IgniteTxManager] Transactions parameter 'collisionsDumpInterval' was changed from 'null' to '1000' [21:15:41] : [Step 4/5] [2021-11-19 21:15:41,526][INFO ][tcp-disco-msg-worker-[00eebdf5 127.0.0.1:47500]-#1428%grid-1%-#27212%grid-1%][IgniteTxManager] Transactions parameter 'txOwnerDumpRequestsAllowed' was changed from 'null' to 'true' [21:15:41] : [Step 4/5] [2021-11-19 21:15:41,526][INFO ][tcp-disco-msg-worker-[00eebdf5 127.0.0.1:47500]-#1428%grid-1%-#27212%grid-1%][GridCacheDatabaseSharedManager] Historical rebalance WAL threshold changed [property=historical.rebalance.threshold, oldVal=null, newVal=500] [21:15:41] : [Step 4/5] [2021-11-19 21:15:41,532][INFO ][disco-notifier-worker-#27211%grid-1%][MvccProcessorImpl] Assigned mvcc coordinator [crd=MvccCoordinator [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=0], nodeId=00eebdf5-f37b-4541-825b-78873b80b000, ver=1637345740903, local=false, initialized=false]] [21:15:41] : [Step 4/5] [2021-11-19 21:15:41,533][INFO ][sys-#27188%grid-1%][ClusterProcessor] Writing cluster ID and tag to metastorage on ready for write ClusterIdAndTag [id=36dc15e9-5b3a-4d7b-9471-faac5f61178d, tag=angry_villani] [21:15:41] : [Step 4/5] [2021-11-19 21:15:41,571][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] To start Console Management & Monitoring run ignitevisorcmd.{sh|bat} [21:15:41] : [Step 4/5] [2021-11-19 21:15:41,571][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] [21:15:41] : [Step 4/5] [21:15:41] : [Step 4/5] >>> +-------------------------------------------+ [21:15:41] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:15:41] : [Step 4/5] >>> +-------------------------------------------+ [21:15:41] : [Step 4/5] >>> OS name: Linux 4.15.0-151-generic amd64 [21:15:41] : [Step 4/5] >>> CPU(s): 24 [21:15:41] : [Step 4/5] >>> Heap: 2.0GB [21:15:41] : [Step 4/5] >>> VM name: 16724@c4dfe9a430b2 [21:15:41] : [Step 4/5] >>> Ignite instance name: grid-1 [21:15:41] : [Step 4/5] >>> Local node [ID=104AA94C-3E4B-44F4-8A58-47072B7BE001, order=2, clientMode=false] [21:15:41] : [Step 4/5] >>> Local node addresses: [127.0.0.1] [21:15:41] : [Step 4/5] >>> Local ports: TCP:10801 TCP:47101 TCP:47501 [21:15:41] : [Step 4/5] [21:15:41] : [Step 4/5] [2021-11-19 21:15:41,572][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] >>> Ignite cluster is in INACTIVE state (limited functionality available). Use control.(sh|bat) script or IgniteCluster.state(ClusterState.ACTIVE) to change the state. [21:15:42]E: [Step 4/5] Failed tests detected [21:15:41] : [Step 4/5] [2021-11-19 21:15:41,573][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][GridDiscoveryManager] Topology snapshot [ver=2, locNode=104aa94c, servers=2, clients=0, state=INACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=00eebdf5-f37b-4541-825b-78873b80b000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=104aa94c-3e4b-44f4-8a58-47072b7be001, consistentId=grid-1, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:15:41] : [Step 4/5] [2021-11-19 21:15:41,574][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][G] Node started : [stage="Configure system pool" (0 ms),stage="Start managers" (207 ms),stage="Configure binary metadata" (2 ms),stage="Start processors" (197 ms),stage="Start 'StanByClusterTestProvider' plugin" (0 ms),stage="Start 'PageMemory tracker plugin' plugin" (0 ms),stage="Start 'TestDistibutedConfigurationPlugin' plugin" (0 ms),stage="Start 'NodeValidationPluginProvider' plugin" (0 ms),stage="Init metastore" (18 ms),stage="Init and start regions" (9 ms),stage="Restore binary memory" (23 ms),stage="Restore logical state" (37 ms),stage="Finish recovery" (18 ms),stage="Join topology" (84 ms),stage="Await transition" (8 ms),stage="Await exchange" (29 ms),stage="Total time" (632 ms)] [21:15:41] : [Step 4/5] [2021-11-19 21:15:41,575][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][root] Node started with the following configuration [id=104aa94c-3e4b-44f4-8a58-47072b7be001, marshaller=BinaryMarshaller [], discovery=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=5000, ackTimeout=5000, marsh=JdkMarshaller [clsFilter=org.apache.ignite.marshaller.MarshallerUtils$1@4049077b], reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], binaryCfg=null, lateAff=true] [21:15:41] : [Step 4/5] [2021-11-19 21:15:41,577][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][GridClusterStateProcessor] Sending activate cluster request with BaselineTopology BaselineTopology [id=0, branchingHash=-2475315501, branchingType='New BaselineTopology', baselineNodes=[grid-1, grid-0]] [21:15:41] : [Step 4/5] [2021-11-19 21:15:41,586][INFO ][disco-notifier-worker-#27092%grid-0%][GridClusterStateProcessor] Received activate cluster request with BaselineTopology[id=0] initiator node ID: 00eebdf5-f37b-4541-825b-78873b80b000 [21:15:41] : [Step 4/5] [2021-11-19 21:15:41,586][INFO ][disco-notifier-worker-#27092%grid-0%][GridClusterStateProcessor] Started state transition: activate cluster [21:15:41] : [Step 4/5] [2021-11-19 21:15:41,588][INFO ][exchange-worker-#27097%grid-0%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], crd=true, evt=DISCOVERY_CUSTOM_EVT, evtNode=00eebdf5-f37b-4541-825b-78873b80b000, customEvt=ChangeGlobalStateMessage [id=9ef3e593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqId=c75fbb3f-9681-4977-a0f0-3b6a74b5882e, initiatingNodeId=00eebdf5-f37b-4541-825b-78873b80b000, state=ACTIVE, baselineTopology=BaselineTopology [id=0, branchingHash=-2475315501, branchingType='New BaselineTopology', baselineNodes=[grid-1, grid-0]], forceChangeBaselineTopology=false, timestamp=1637345741577, forceDeactivation=true], allowMerge=false, exchangeFreeSwitch=false] [21:15:41] : [Step 4/5] [2021-11-19 21:15:41,590][INFO ][exchange-worker-#27097%grid-0%][GridDhtPartitionsExchangeFuture] Start activation process [nodeId=00eebdf5-f37b-4541-825b-78873b80b000, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]]. New state: ACTIVE [21:15:41] : [Step 4/5] [2021-11-19 21:15:41,590][INFO ][exchange-worker-#27097%grid-0%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0 [21:15:41] : [Step 4/5] [2021-11-19 21:15:41,594][INFO ][exchange-worker-#27097%grid-0%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000000.wal, offset=8795, ver=2] [21:15:41] : [Step 4/5] [2021-11-19 21:15:41,595][INFO ][exchange-worker-#27097%grid-0%][GridClusterStateProcessor] Writing BaselineTopology[id=0] [21:15:41] : [Step 4/5] [2021-11-19 21:15:41,597][INFO ][exchange-worker-#27097%grid-0%][GridCacheDatabaseSharedManager] Finish recovery performed in 6 ms. [21:15:41] : [Step 4/5] [2021-11-19 21:15:41,599][INFO ][exchange-worker-#27097%grid-0%][msg] Components activation performed in 9 ms. [21:15:41] : [Step 4/5] [2021-11-19 21:15:41,600][INFO ][exchange-worker-#27097%grid-0%][GridCacheProcessor] Finished recovery for cache [cache=ignite-sys-cache, grp=ignite-sys-cache, startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:15:41] : [Step 4/5] [2021-11-19 21:15:41,601][INFO ][exchange-worker-#27097%grid-0%][GridDhtPartitionsExchangeFuture] Successfully activated caches [nodeId=00eebdf5-f37b-4541-825b-78873b80b000, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], newState=ACTIVE] [21:15:41] : [Step 4/5] [2021-11-19 21:15:41,601][INFO ][disco-notifier-worker-#27211%grid-1%][GridClusterStateProcessor] Received activate cluster request with BaselineTopology[id=0] initiator node ID: 00eebdf5-f37b-4541-825b-78873b80b000 [21:15:41] : [Step 4/5] [2021-11-19 21:15:41,602][INFO ][exchange-worker-#27097%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:15:41] : [Step 4/5] [2021-11-19 21:15:41,612][INFO ][disco-notifier-worker-#27211%grid-1%][GridClusterStateProcessor] Started state transition: activate cluster [21:15:41] : [Step 4/5] [2021-11-19 21:15:41,623][INFO ][exchange-worker-#27220%grid-1%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], crd=false, evt=DISCOVERY_CUSTOM_EVT, evtNode=00eebdf5-f37b-4541-825b-78873b80b000, customEvt=ChangeGlobalStateMessage [id=9ef3e593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqId=c75fbb3f-9681-4977-a0f0-3b6a74b5882e, initiatingNodeId=00eebdf5-f37b-4541-825b-78873b80b000, state=ACTIVE, baselineTopology=BaselineTopology [id=0, branchingHash=-2475315501, branchingType='New BaselineTopology', baselineNodes=[grid-1, grid-0]], forceChangeBaselineTopology=false, timestamp=1637345741577, forceDeactivation=true], allowMerge=false, exchangeFreeSwitch=false] [21:15:41] : [Step 4/5] [2021-11-19 21:15:41,625][INFO ][exchange-worker-#27220%grid-1%][GridDhtPartitionsExchangeFuture] Start activation process [nodeId=104aa94c-3e4b-44f4-8a58-47072b7be001, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]]. New state: ACTIVE [21:15:41] : [Step 4/5] [2021-11-19 21:15:41,625][INFO ][exchange-worker-#27220%grid-1%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1 [21:15:41] : [Step 4/5] [2021-11-19 21:15:41,627][INFO ][exchange-worker-#27097%grid-0%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], crd=true] [21:15:41] : [Step 4/5] [2021-11-19 21:15:41,648][INFO ][exchange-worker-#27220%grid-1%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000000.wal, offset=8795, ver=2] [21:15:41] : [Step 4/5] [2021-11-19 21:15:41,651][INFO ][exchange-worker-#27220%grid-1%][GridClusterStateProcessor] Writing BaselineTopology[id=0] [21:15:41] : [Step 4/5] [2021-11-19 21:15:41,656][INFO ][exchange-worker-#27220%grid-1%][GridCacheDatabaseSharedManager] Finish recovery performed in 27 ms. [21:15:41] : [Step 4/5] [2021-11-19 21:15:41,663][INFO ][exchange-worker-#27220%grid-1%][msg] Components activation performed in 38 ms. [21:15:41] : [Step 4/5] [2021-11-19 21:15:41,665][INFO ][exchange-worker-#27220%grid-1%][GridCacheProcessor] Finished recovery for cache [cache=ignite-sys-cache, grp=ignite-sys-cache, startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:15:41] : [Step 4/5] [2021-11-19 21:15:41,665][INFO ][exchange-worker-#27220%grid-1%][GridDhtPartitionsExchangeFuture] Successfully activated caches [nodeId=104aa94c-3e4b-44f4-8a58-47072b7be001, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], newState=ACTIVE] [21:15:41] : [Step 4/5] [2021-11-19 21:15:41,666][INFO ][exchange-worker-#27220%grid-1%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:15:41] : [Step 4/5] [2021-11-19 21:15:41,690][INFO ][grid-nio-worker-tcp-comm-0-#27035%TestRecordingCommunicationSpi%][TestRecordingCommunicationSpi] Accepted incoming communication connection [locAddr=/127.0.0.1:47100, rmtAddr=/127.0.0.1:35826] [21:15:41] : [Step 4/5] [2021-11-19 21:15:41,693][INFO ][grid-nio-worker-tcp-comm-0-#27154%TestRecordingCommunicationSpi%][TestRecordingCommunicationSpi] Established outgoing communication connection [locAddr=/127.0.0.1:35826, rmtAddr=/127.0.0.1:47100] [21:15:41] : [Step 4/5] [2021-11-19 21:15:41,693][INFO ][exchange-worker-#27220%grid-1%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], crd=false] [21:15:41] : [Step 4/5] [2021-11-19 21:15:41,695][INFO ][sys-#27078%grid-0%][GridDhtPartitionsExchangeFuture] Coordinator received single message [ver=AffinityTopologyVersion [topVer=2, minorTopVer=1], node=104aa94c-3e4b-44f4-8a58-47072b7be001, allReceived=true] [21:15:41] : [Step 4/5] [2021-11-19 21:15:41,696][INFO ][sys-#27078%grid-0%][GridDhtPartitionsExchangeFuture] finishExchangeOnCoordinator [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:15:41] : [Step 4/5] [2021-11-19 21:15:41,700][INFO ][sys-#27078%grid-0%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], err=null, rebalanced=true, wasRebalanced=false] [21:15:41] : [Step 4/5] [2021-11-19 21:15:41,702][INFO ][disco-notifier-worker-#27211%grid-1%][GridClusterStateProcessor] Received state change finish message: ACTIVE [21:15:41] : [Step 4/5] [2021-11-19 21:15:41,701][INFO ][sys-#27192%grid-1%][GridDhtPartitionsExchangeFuture] Received full message, will finish exchange [node=00eebdf5-f37b-4541-825b-78873b80b000, resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:15:41] : [Step 4/5] [2021-11-19 21:15:41,700][INFO ][disco-notifier-worker-#27092%grid-0%][GridClusterStateProcessor] Received state change finish message: ACTIVE [21:15:41] : [Step 4/5] [2021-11-19 21:15:41,703][INFO ][disco-notifier-worker-#27092%grid-0%][GridClusterStateProcessor] Cluster state was changed from INACTIVE to ACTIVE [21:15:41] : [Step 4/5] [2021-11-19 21:15:41,702][INFO ][disco-notifier-worker-#27211%grid-1%][GridClusterStateProcessor] Cluster state was changed from INACTIVE to ACTIVE [21:15:41] : [Step 4/5] [2021-11-19 21:15:41,704][INFO ][sys-#27078%grid-0%][GridCacheProcessor] Finish proxy initialization, cacheName=ignite-sys-cache, localNodeId=00eebdf5-f37b-4541-825b-78873b80b000 [21:15:41] : [Step 4/5] [2021-11-19 21:15:41,703][INFO ][sys-#27198%grid-1%][GridCachePartitionExchangeManager] Delay process full message without exchange id (there is exchange in progress) [nodeId=00eebdf5-f37b-4541-825b-78873b80b000] [21:15:41] : [Step 4/5] [2021-11-19 21:15:41,703][INFO ][sys-#27192%grid-1%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], err=null, rebalanced=true, wasRebalanced=false] [21:15:41] : [Step 4/5] [2021-11-19 21:15:41,705][INFO ][sys-#27078%grid-0%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=00eebdf5-f37b-4541-825b-78873b80b000, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=00eebdf5-f37b-4541-825b-78873b80b000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345741697, loc=true, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:15:41] : [Step 4/5] [2021-11-19 21:15:41,705][INFO ][exchange-worker-#27097%grid-0%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=2, minorTopVer=1], force=false, evt=DISCOVERY_CUSTOM_EVT, node=00eebdf5-f37b-4541-825b-78873b80b000] [21:15:41] : [Step 4/5] [2021-11-19 21:15:41,705][INFO ][sys-#27090%grid-0%][DistributedBaselineConfiguration] Baseline auto-adjust is 'disabled' with timeout='300000' ms [21:15:41] : [Step 4/5] [2021-11-19 21:15:41,709][INFO ][sys-#27090%grid-0%][GridClusterStateProcessor] Successfully performed final activation steps [nodeId=00eebdf5-f37b-4541-825b-78873b80b000, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:15:41] : [Step 4/5] [2021-11-19 21:15:41,708][INFO ][sys-#27078%grid-0%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (2 ms), stage="Update caches registry" (9 ms), stage="Start caches" (1 ms), stage="Affinity initialization on cache group start" (0 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Restore partition states" (0 ms), stage="After states restored callback" (24 ms), stage="WAL history reservation" (0 ms), stage="Waiting for all single messages" (68 ms), stage="Affinity recalculation (crd)" (0 ms), stage="Collect update counters and create affinity messages" (0 ms), stage="Assign partitions states" (0 ms), stage="Validate partitions states" (0 ms), stage="Ideal affinity diff calculation (enforced)" (0 ms), stage="Apply update counters" (0 ms), stage="Full message preparing" (2 ms), stage="Full message sending" (0 ms), stage="State finish message sending" (0 ms), stage="Detect lost partitions" (2 ms), stage="Exchange done" (4 ms), stage="Total time" (112 ms), Discovery lag=29 ms, Latest started node id=104aa94c-3e4b-44f4-8a58-47072b7be001] [21:15:41] : [Step 4/5] [2021-11-19 21:15:41,707][INFO ][sys-#27192%grid-1%][GridCacheProcessor] Finish proxy initialization, cacheName=ignite-sys-cache, localNodeId=104aa94c-3e4b-44f4-8a58-47072b7be001 [21:15:41] : [Step 4/5] [2021-11-19 21:15:41,712][INFO ][sys-#27078%grid-0%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], stage="Affinity initialization on cache group start [grp=ignite-sys-cache]" (0 ms) (parent=Affinity initialization on cache group start), stage="Affinity centralized initialization (crd) [grp=ignite-sys-cache, crd=true]" (0 ms) (parent=Determine exchange type), stage="Restore partition states [grp=ignite-sys-cache]" (0 ms) (parent=Restore partition states), stage="Affinity recalculation (partitions availability) [grp=ignite-sys-cache]" (0 ms) (parent=Ideal affinity diff calculation (enforced))] [21:15:41] : [Step 4/5] [2021-11-19 21:15:41,714][INFO ][sys-#27192%grid-1%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=104aa94c-3e4b-44f4-8a58-47072b7be001, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=00eebdf5-f37b-4541-825b-78873b80b000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345741496, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:15:41] : [Step 4/5] [2021-11-19 21:15:41,714][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][root] awaitPartitionMapExchange finished [21:15:41] : [Step 4/5] [2021-11-19 21:15:41,714][INFO ][exchange-worker-#27220%grid-1%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=2, minorTopVer=1], force=false, evt=DISCOVERY_CUSTOM_EVT, node=00eebdf5-f37b-4541-825b-78873b80b000] [21:15:41] : [Step 4/5] [2021-11-19 21:15:41,713][INFO ][sys-#27193%grid-1%][DistributedBaselineConfiguration] Baseline auto-adjust is 'disabled' with timeout='300000' ms [21:15:41] : [Step 4/5] [2021-11-19 21:15:41,716][INFO ][sys-#27192%grid-1%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (8 ms), stage="Update caches registry" (38 ms), stage="Start caches" (1 ms), stage="Affinity initialization on cache group start" (0 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Restore partition states" (0 ms), stage="After states restored callback" (18 ms), stage="WAL history reservation" (0 ms), stage="Waiting for Full message" (16 ms), stage="Affinity recalculation" (1 ms), stage="Full map updating" (0 ms), stage="Detect lost partitions" (3 ms), stage="Exchange done" (9 ms), stage="Total time" (94 ms)] [21:15:41] : [Step 4/5] [2021-11-19 21:15:41,717][INFO ][sys-#27193%grid-1%][GridClusterStateProcessor] Successfully performed final activation steps [nodeId=104aa94c-3e4b-44f4-8a58-47072b7be001, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:15:41] : [Step 4/5] [2021-11-19 21:15:41,718][INFO ][sys-#27192%grid-1%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], stage="Affinity initialization on cache group start [grp=ignite-sys-cache]" (0 ms) (parent=Affinity initialization on cache group start), stage="Affinity centralized initialization (crd) [grp=ignite-sys-cache, crd=false]" (0 ms) (parent=Determine exchange type), stage="Restore partition states [grp=ignite-sys-cache]" (0 ms) (parent=Restore partition states), stage="Affinity applying from full message [grp=ignite-sys-cache]" (1 ms) (parent=Affinity recalculation)] [21:15:41] : [Step 4/5] [2021-11-19 21:15:41,721][INFO ][exchange-worker-#27220%grid-1%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], crd=false, evt=DISCOVERY_CUSTOM_EVT, evtNode=00eebdf5-f37b-4541-825b-78873b80b000, customEvt=DynamicCacheChangeBatch [id=d004e593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqs=ArrayList [DynamicCacheChangeRequest [cacheName=encrypted, hasCfg=true, nodeId=00eebdf5-f37b-4541-825b-78873b80b000, clientStartOnly=false, stop=false, destroy=false, disabledAfterStart=false]], exchangeActions=ExchangeActions [startCaches=[encrypted], stopCaches=null, startGrps=[encrypted], stopGrps=[], resetParts=null, stateChangeRequest=null], startCaches=false], allowMerge=false, exchangeFreeSwitch=false] [21:15:41] : [Step 4/5] [2021-11-19 21:15:41,721][INFO ][exchange-worker-#27097%grid-0%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], crd=true, evt=DISCOVERY_CUSTOM_EVT, evtNode=00eebdf5-f37b-4541-825b-78873b80b000, customEvt=DynamicCacheChangeBatch [id=d004e593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqs=ArrayList [DynamicCacheChangeRequest [cacheName=encrypted, hasCfg=true, nodeId=00eebdf5-f37b-4541-825b-78873b80b000, clientStartOnly=false, stop=false, destroy=false, disabledAfterStart=false]], exchangeActions=ExchangeActions [startCaches=[encrypted], stopCaches=null, startGrps=[encrypted], stopGrps=[], resetParts=null, stateChangeRequest=null], startCaches=false], allowMerge=false, exchangeFreeSwitch=false] [21:15:41] : [Step 4/5] [2021-11-19 21:15:41,804][INFO ][exchange-worker-#27220%grid-1%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:15:41] : [Step 4/5] [2021-11-19 21:15:41,805][INFO ][exchange-worker-#27097%grid-0%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:15:41] : [Step 4/5] [2021-11-19 21:15:41,812][INFO ][exchange-worker-#27220%grid-1%][GridCacheProcessor] Started cache [name=encrypted, id=1613773252, dataRegionName=default, mode=PARTITIONED, atomicity=ATOMIC, backups=1, mvcc=false] [21:15:41] : [Step 4/5] [2021-11-19 21:15:41,812][INFO ][exchange-worker-#27097%grid-0%][GridCacheProcessor] Started cache [name=encrypted, id=1613773252, dataRegionName=default, mode=PARTITIONED, atomicity=ATOMIC, backups=1, mvcc=false] [21:15:41] : [Step 4/5] [2021-11-19 21:15:41,813][INFO ][exchange-worker-#27220%grid-1%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], waitTime=0ms, futInfo=NA, mode=DISTRIBUTED] [21:15:41] : [Step 4/5] [2021-11-19 21:15:41,813][INFO ][exchange-worker-#27097%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], waitTime=0ms, futInfo=NA, mode=DISTRIBUTED] [21:15:41] : [Step 4/5] [2021-11-19 21:15:41,814][INFO ][exchange-worker-#27097%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partitions release latch: ServerLatch [permits=0, pendingAcks=HashSet [], super=CompletableLatch [id=CompletableLatchUid [id=exchange, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2]]]] [21:15:41] : [Step 4/5] [2021-11-19 21:15:41,814][INFO ][exchange-worker-#27220%grid-1%][GridDhtPartitionsExchangeFuture] Finished waiting for partitions release latch: ClientLatch [coordinator=TcpDiscoveryNode [id=00eebdf5-f37b-4541-825b-78873b80b000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345741496, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], ackSent=true, super=CompletableLatch [id=CompletableLatchUid [id=exchange, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2]]]] [21:15:41] : [Step 4/5] [2021-11-19 21:15:41,815][INFO ][exchange-worker-#27097%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:15:41] : [Step 4/5] [2021-11-19 21:15:41,815][INFO ][exchange-worker-#27220%grid-1%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:15:41] : [Step 4/5] [2021-11-19 21:15:41,817][INFO ][exchange-worker-#27097%grid-0%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], crd=true] [21:15:41] : [Step 4/5] [2021-11-19 21:15:41,817][INFO ][exchange-worker-#27220%grid-1%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], crd=false] [21:15:41] : [Step 4/5] [2021-11-19 21:15:41,819][INFO ][sys-#27070%grid-0%][GridDhtPartitionsExchangeFuture] Coordinator received single message [ver=AffinityTopologyVersion [topVer=2, minorTopVer=2], node=104aa94c-3e4b-44f4-8a58-47072b7be001, allReceived=true] [21:15:41] : [Step 4/5] [2021-11-19 21:15:41,819][INFO ][sys-#27070%grid-0%][GridDhtPartitionsExchangeFuture] finishExchangeOnCoordinator [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2]] [21:15:41] : [Step 4/5] [2021-11-19 21:15:41,821][INFO ][sys-#27070%grid-0%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], err=null, rebalanced=true, wasRebalanced=true] [21:15:41] : [Step 4/5] [2021-11-19 21:15:41,822][INFO ][sys-#27070%grid-0%][GridCacheProcessor] Finish proxy initialization, cacheName=encrypted, localNodeId=00eebdf5-f37b-4541-825b-78873b80b000 [21:15:41] : [Step 4/5] [2021-11-19 21:15:41,822][INFO ][sys-#27070%grid-0%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=00eebdf5-f37b-4541-825b-78873b80b000, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=00eebdf5-f37b-4541-825b-78873b80b000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345741717, loc=true, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2]] [21:15:41] : [Step 4/5] [2021-11-19 21:15:41,822][INFO ][exchange-worker-#27097%grid-0%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=2, minorTopVer=2], force=false, evt=DISCOVERY_CUSTOM_EVT, node=00eebdf5-f37b-4541-825b-78873b80b000] [21:15:41] : [Step 4/5] [2021-11-19 21:15:41,824][INFO ][sys-#27070%grid-0%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (82 ms), stage="Update caches registry" (0 ms), stage="Start caches" (9 ms), stage="Affinity initialization on cache group start" (0 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Wait partitions release latch [latch=exchange]" (0 ms), stage="Wait partitions release [latch=exchange]" (1 ms), stage="Restore partition states" (0 ms), stage="After states restored callback" (0 ms), stage="WAL history reservation" (0 ms), stage="Waiting for all single messages" (2 ms), stage="Affinity recalculation (crd)" (0 ms), stage="Collect update counters and create affinity messages" (0 ms), stage="Assign partitions states" (0 ms), stage="Validate partitions states" (0 ms), stage="Apply update counters" (0 ms), stage="Full message preparing" (0 ms), stage="Full message sending" (0 ms), stage="Exchange done" (2 ms), stage="Total time" (96 ms)] [21:15:41] : [Step 4/5] [2021-11-19 21:15:41,824][INFO ][sys-#27210%grid-1%][GridDhtPartitionsExchangeFuture] Received full message, will finish exchange [node=00eebdf5-f37b-4541-825b-78873b80b000, resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2]] [21:15:41] : [Step 4/5] [2021-11-19 21:15:41,827][INFO ][sys-#27070%grid-0%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], stage="Affinity initialization on cache group start [grp=encrypted]" (0 ms) (parent=Affinity initialization on cache group start), stage="Restore partition states [grp=ignite-sys-cache]" (0 ms) (parent=Restore partition states), stage="Restore partition states [grp=encrypted]" (0 ms) (parent=Restore partition states)] [21:15:41] : [Step 4/5] [2021-11-19 21:15:41,828][INFO ][sys-#27210%grid-1%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], err=null, rebalanced=true, wasRebalanced=true] [21:15:41] : [Step 4/5] [2021-11-19 21:15:41,830][INFO ][sys-#27210%grid-1%][GridCacheProcessor] Finish proxy initialization, cacheName=encrypted, localNodeId=104aa94c-3e4b-44f4-8a58-47072b7be001 [21:15:41] : [Step 4/5] [2021-11-19 21:15:41,831][INFO ][sys-#27210%grid-1%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=104aa94c-3e4b-44f4-8a58-47072b7be001, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=00eebdf5-f37b-4541-825b-78873b80b000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345741496, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2]] [21:15:41] : [Step 4/5] [2021-11-19 21:15:41,831][INFO ][exchange-worker-#27220%grid-1%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=2, minorTopVer=2], force=false, evt=DISCOVERY_CUSTOM_EVT, node=00eebdf5-f37b-4541-825b-78873b80b000] [21:15:41] : [Step 4/5] [2021-11-19 21:15:41,832][INFO ][sys-#27210%grid-1%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (1 ms), stage="Update caches registry" (80 ms), stage="Start caches" (9 ms), stage="Affinity initialization on cache group start" (0 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Wait partitions release latch [latch=exchange]" (1 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Restore partition states" (0 ms), stage="After states restored callback" (0 ms), stage="WAL history reservation" (0 ms), stage="Waiting for Full message" (7 ms), stage="Affinity recalculation" (2 ms), stage="Full map updating" (1 ms), stage="Exchange done" (3 ms), stage="Total time" (104 ms)] [21:15:41] : [Step 4/5] [2021-11-19 21:15:41,834][INFO ][sys-#27210%grid-1%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], stage="Affinity initialization on cache group start [grp=encrypted]" (0 ms) (parent=Affinity initialization on cache group start), stage="Restore partition states [grp=ignite-sys-cache]" (0 ms) (parent=Restore partition states), stage="Restore partition states [grp=encrypted]" (0 ms) (parent=Restore partition states)] [21:15:41] : [Step 4/5] [2021-11-19 21:15:41,984][INFO ][db-checkpoint-thread-#27227%grid-0%][Checkpointer] Checkpoint started [checkpointId=a72c7885-c159-46f4-833a-ad8fc2377927, startPtr=WALPointer [idx=0, fileOff=86657, len=1963], checkpointBeforeLockTime=3ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=112ms, writeCheckpointEntryDuration=245ms, splitAndSortCpPagesDuration=0ms, pages=18, reason='node started'] [21:15:41] : [Step 4/5] [2021-11-19 21:15:41,984][INFO ][db-checkpoint-thread-#27236%grid-1%][Checkpointer] Checkpoint started [checkpointId=9f0ceb2d-0457-4373-8d56-e20dbdc322ee, startPtr=WALPointer [idx=0, fileOff=86657, len=1963], checkpointBeforeLockTime=7ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=55ms, writeCheckpointEntryDuration=245ms, splitAndSortCpPagesDuration=0ms, pages=18, reason='node started'] [21:15:42] : [Step 4/5] [2021-11-19 21:15:42,225][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][root] >>> Stopping grid [name=grid-0, id=00eebdf5-f37b-4541-825b-78873b80b000] [21:15:42] : [Step 4/5] [2021-11-19 21:15:42,386][INFO ][db-checkpoint-thread-#27227%grid-0%][Checkpointer] Checkpoint finished [cpId=a72c7885-c159-46f4-833a-ad8fc2377927, pages=18, markPos=WALPointer [idx=0, fileOff=86657, len=1963], walSegmentsCovered=[], markDuration=358ms, pagesWrite=1ms, fsync=400ms, total=762ms] [21:15:42] : [Step 4/5] [2021-11-19 21:15:42,386][INFO ][db-checkpoint-thread-#27236%grid-1%][Checkpointer] Checkpoint finished [cpId=9f0ceb2d-0457-4373-8d56-e20dbdc322ee, pages=18, markPos=WALPointer [idx=0, fileOff=86657, len=1963], walSegmentsCovered=[], markDuration=302ms, pagesWrite=4ms, fsync=397ms, total=710ms] [21:15:42] : [Step 4/5] [2021-11-19 21:15:42,392][INFO ][tcp-disco-sock-reader-[104aa94c 127.0.0.1:55841]-#1433%grid-0%-#27217%grid-0%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:55841, rmtPort=55841, rmtNodeId=104aa94c-3e4b-44f4-8a58-47072b7be001] [21:15:42] : [Step 4/5] [2021-11-19 21:15:42,392][INFO ][disco-event-worker-#27219%grid-1%][GridDiscoveryManager] Node left topology: TcpDiscoveryNode [id=00eebdf5-f37b-4541-825b-78873b80b000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345741496, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false] [21:15:42] : [Step 4/5] [2021-11-19 21:15:42,394][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Stopped cache [cacheName=ignite-sys-cache] [21:15:42] : [Step 4/5] [2021-11-19 21:15:42,394][INFO ][disco-event-worker-#27219%grid-1%][GridDiscoveryManager] Topology snapshot [ver=3, locNode=104aa94c, servers=1, clients=0, state=ACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=104aa94c-3e4b-44f4-8a58-47072b7be001, consistentId=grid-1, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:15:42] : [Step 4/5] [2021-11-19 21:15:42,394][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Stopped cache [cacheName=encrypted] [21:15:42] : [Step 4/5] [2021-11-19 21:15:42,395][INFO ][disco-event-worker-#27219%grid-1%][GridDiscoveryManager] Coordinator changed [prev=TcpDiscoveryNode [id=00eebdf5-f37b-4541-825b-78873b80b000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345741496, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], cur=TcpDiscoveryNode [id=104aa94c-3e4b-44f4-8a58-47072b7be001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637345742386, loc=true, ver=2.13.0#20211119-sha1:00000000, isClient=false]] [21:15:42] : [Step 4/5] [2021-11-19 21:15:42,396][INFO ][disco-event-worker-#27219%grid-1%][GridDiscoveryManager] ^-- Baseline [id=0, size=2, online=1, offline=1] [21:15:42] : [Step 4/5] [2021-11-19 21:15:42,397][INFO ][disco-event-worker-#27219%grid-1%][MvccProcessorImpl] Assigned mvcc coordinator [crd=MvccCoordinator [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], nodeId=104aa94c-3e4b-44f4-8a58-47072b7be001, ver=1637345740904, local=true, initialized=false]] [21:15:42]W: [org.apache.ignite:ignite-core] [2021-11-19 21:15:42,397][WARN ][grid-nio-worker-tcp-comm-0-#27154%TestRecordingCommunicationSpi%][TestRecordingCommunicationSpi] Failed to shutdown socket [21:15:42]W: [org.apache.ignite:ignite-core] java.nio.channels.ClosedChannelException [21:15:42]W: [org.apache.ignite:ignite-core] at sun.nio.ch.SocketChannelImpl.shutdownOutput(SocketChannelImpl.java:795) [21:15:42]W: [org.apache.ignite:ignite-core] at sun.nio.ch.SocketAdaptor.shutdownOutput(SocketAdaptor.java:407) [21:15:42]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.close(IgniteUtils.java:4247) [21:15:42]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.closeKey(GridNioServer.java:2784) [21:15:42]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.close(GridNioServer.java:2835) [21:15:42]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.close(GridNioServer.java:2794) [21:15:42]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.bodyInternal(GridNioServer.java:2157) [21:15:42]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.body(GridNioServer.java:1910) [21:15:42]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:125) [21:15:42]W: [org.apache.ignite:ignite-core] at java.lang.Thread.run(Thread.java:748) [21:15:42] : [Step 4/5] [2021-11-19 21:15:42,400][INFO ][exchange-worker-#27220%grid-1%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], crd=true, evt=NODE_LEFT, evtNode=00eebdf5-f37b-4541-825b-78873b80b000, customEvt=null, allowMerge=false, exchangeFreeSwitch=true] [21:15:42] : [Step 4/5] [2021-11-19 21:15:42,400][INFO ][sys-#27194%grid-1%][ExchangeLatchManager] Become new coordinator 104aa94c-3e4b-44f4-8a58-47072b7be001 [21:15:42] : [Step 4/5] [2021-11-19 21:15:42,402][INFO ][exchange-worker-#27220%grid-1%][GridAffinityAssignmentCache] Local node affinity assignment distribution is not ideal [cache=encrypted, expectedPrimary=8.00, actualPrimary=8, expectedBackups=8.00, actualBackups=0, warningThreshold=50.00%] [21:15:42] : [Step 4/5] [2021-11-19 21:15:42,403][INFO ][exchange-worker-#27220%grid-1%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:15:42] : [Step 4/5] [2021-11-19 21:15:42,404][INFO ][exchange-worker-#27220%grid-1%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], err=null, rebalanced=true, wasRebalanced=true] [21:15:42] : [Step 4/5] [2021-11-19 21:15:42,405][INFO ][exchange-worker-#27220%grid-1%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=104aa94c-3e4b-44f4-8a58-47072b7be001, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], evt=NODE_LEFT, evtNode=TcpDiscoveryNode [id=00eebdf5-f37b-4541-825b-78873b80b000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345741496, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0]] [21:15:42] : [Step 4/5] [2021-11-19 21:15:42,406][INFO ][exchange-worker-#27220%grid-1%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (2 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="After states restored callback" (0 ms), stage="WAL history reservation" (0 ms), stage="Finalize update counters" (0 ms), stage="Detect lost partitions" (0 ms), stage="Exchange done" (1 ms), stage="Total time" (3 ms)] [21:15:42] : [Step 4/5] [2021-11-19 21:15:42,407][INFO ][exchange-worker-#27220%grid-1%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], stage="Affinity initialization (exchange-free switch on fully-rebalanced topology) [grp=ignite-sys-cache]" (0 ms) (parent=Determine exchange type), stage="Affinity initialization (exchange-free switch on fully-rebalanced topology) [grp=encrypted]" (0 ms) (parent=Determine exchange type)] [21:15:42] : [Step 4/5] [2021-11-19 21:15:42,407][INFO ][exchange-worker-#27220%grid-1%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=0], crd=true] [21:15:42] : [Step 4/5] [2021-11-19 21:15:42,408][INFO ][exchange-worker-#27220%grid-1%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=3, minorTopVer=0], force=false, evt=NODE_LEFT, node=00eebdf5-f37b-4541-825b-78873b80b000] [21:15:42] : [Step 4/5] [2021-11-19 21:15:42,819][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][FilePageStoreManager] Cleanup cache stores [total=4, left=0, cleanFiles=false] [21:15:42] : [Step 4/5] [2021-11-19 21:15:42,821][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][GridDeploymentLocalStore] Removed undeployed class: GridDeployment [ts=1637345741687, depMode=SHARED, clsLdr=IsolatedClassLoader{roleName='test'}, clsLdrId=5ff3e593d71-00eebdf5-f37b-4541-825b-78873b80b000, userVer=0, loc=true, sampleClsName=org.apache.ignite.internal.processors.cache.distributed.dht.preloader.GridDhtPartitionMap, pendingUndeploy=false, undeployed=true, usage=0] [21:15:42] : [Step 4/5] [2021-11-19 21:15:42,829][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] [21:15:42] : [Step 4/5] [21:15:42] : [Step 4/5] >>> +------------------------------------------------------+ [21:15:42] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV stopped OK [21:15:42] : [Step 4/5] >>> +------------------------------------------------------+ [21:15:42] : [Step 4/5] >>> Ignite instance name: grid-0 [21:15:42] : [Step 4/5] >>> Grid uptime: 00:00:01.898 [21:15:42] : [Step 4/5] [21:15:42] : [Step 4/5] [21:15:42] : [Step 4/5] [2021-11-19 21:15:42,840][INFO ][disco-notifier-worker-#27211%grid-1%][GridEncryptionManager] New encryption key for group was added [grpId=1613773252, keyId=1] [21:15:42] : [Step 4/5] [2021-11-19 21:15:42,840][INFO ][reencrypt-#27254%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:15:42] : [Step 4/5] [2021-11-19 21:15:42,844][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=104aa94c-3e4b-44f4-8a58-47072b7be001, grp=1613773252] [21:15:42] : [Step 4/5] [2021-11-19 21:15:42,849][INFO ][db-checkpoint-thread-#27236%grid-1%][Checkpointer] Checkpoint started [checkpointId=dd384b18-8466-41d2-a0af-e450e1b1e0c1, startPtr=WALPointer [idx=0, fileOff=229444, len=2105], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=1ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=1ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=0ms, pages=93, reason='test'] [21:15:43] : [Step 4/5] [2021-11-19 21:15:43,577][INFO ][db-checkpoint-thread-#27236%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:15:43] : [Step 4/5] [2021-11-19 21:15:43,578][INFO ][db-checkpoint-thread-#27236%grid-1%][Checkpointer] Checkpoint finished [cpId=dd384b18-8466-41d2-a0af-e450e1b1e0c1, pages=93, markPos=WALPointer [idx=0, fileOff=229444, len=2105], walSegmentsCovered=[], markDuration=4ms, pagesWrite=8ms, fsync=720ms, total=733ms] [21:15:43] : [Step 4/5] [2021-11-19 21:15:43,579][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][root] >>> Stopping grid [name=grid-1, id=104aa94c-3e4b-44f4-8a58-47072b7be001] [21:15:43] : [Step 4/5] [2021-11-19 21:15:43,585][INFO ][db-checkpoint-thread-#27236%grid-1%][Checkpointer] Skipping checkpoint (no pages were modified) [checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, reason='timeout'] [21:15:43]W: [org.apache.ignite:ignite-core] [2021-11-19 21:15:43,589][WARN ][tcp-disco-sock-reader-[00eebdf5 127.0.0.1:54775]-#1432%grid-1%-#27216%grid-1%][TestTcpDiscoverySpi] Failed to shutdown socket [21:15:43]W: [org.apache.ignite:ignite-core] java.net.SocketException: Socket is closed [21:15:43]W: [org.apache.ignite:ignite-core] at java.net.Socket.shutdownOutput(Socket.java:1568) [21:15:43]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.close(IgniteUtils.java:4247) [21:15:43]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.discovery.tcp.ServerImpl$SocketReader.body(ServerImpl.java:7370) [21:15:43]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.IgniteSpiThread.run(IgniteSpiThread.java:58) [21:15:43] : [Step 4/5] [2021-11-19 21:15:43,590][INFO ][tcp-disco-sock-reader-[00eebdf5 127.0.0.1:54775]-#1432%grid-1%-#27216%grid-1%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:54775, rmtPort=54775, rmtNodeId=00eebdf5-f37b-4541-825b-78873b80b000] [21:15:43] : [Step 4/5] [2021-11-19 21:15:43,590][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Stopped cache [cacheName=ignite-sys-cache] [21:15:43] : [Step 4/5] [2021-11-19 21:15:43,591][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Stopped cache [cacheName=encrypted] [21:15:43] : [Step 4/5] [2021-11-19 21:15:43,772][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][FilePageStoreManager] Cleanup cache stores [total=4, left=0, cleanFiles=false] [21:15:43] : [Step 4/5] [2021-11-19 21:15:43,774][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][GridDeploymentLocalStore] Removed undeployed class: GridDeployment [ts=1637345741697, depMode=SHARED, clsLdr=IsolatedClassLoader{roleName='test'}, clsLdrId=7ff3e593d71-104aa94c-3e4b-44f4-8a58-47072b7be001, userVer=0, loc=true, sampleClsName=org.apache.ignite.internal.processors.cache.distributed.dht.preloader.IgniteDhtPartitionCountersMap2, pendingUndeploy=false, undeployed=true, usage=0] [21:15:43] : [Step 4/5] [2021-11-19 21:15:43,780][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] [21:15:43] : [Step 4/5] [21:15:43] : [Step 4/5] >>> +------------------------------------------------------+ [21:15:43] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV stopped OK [21:15:43] : [Step 4/5] >>> +------------------------------------------------------+ [21:15:43] : [Step 4/5] >>> Ignite instance name: grid-1 [21:15:43] : [Step 4/5] >>> Grid uptime: 00:00:02.206 [21:15:43] : [Step 4/5] [21:15:43] : [Step 4/5] [21:15:43]W: [org.apache.ignite:ignite-core] [2021-11-19 21:15:43,785][WARN ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][G] Ignite work directory is not provided, automatically resolved to: /opt/buildagent/work/7bc1c54bc719b67c/work [21:15:43] : [Step 4/5] [2021-11-19 21:15:43,786][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] [21:15:43] : [Step 4/5] [21:15:43] : [Step 4/5] >>> __________ ________________ [21:15:43] : [Step 4/5] >>> / _/ ___/ |/ / _/_ __/ __/ [21:15:43] : [Step 4/5] >>> _/ // (7 7 // / / / / _/ [21:15:43] : [Step 4/5] >>> /___/\___/_/|_/___/ /_/ /___/ [21:15:43] : [Step 4/5] >>> [21:15:43] : [Step 4/5] >>> ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:15:43] : [Step 4/5] >>> 2021 Copyright(C) Apache Software Foundation [21:15:43] : [Step 4/5] >>> [21:15:43] : [Step 4/5] >>> Ignite documentation: http://ignite.apache.org [21:15:43] : [Step 4/5] [21:15:43] : [Step 4/5] [2021-11-19 21:15:43,787][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] Config URL: n/a [21:15:43] : [Step 4/5] [2021-11-19 21:15:43,787][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] IgniteConfiguration [igniteInstanceName=grid-0, pubPoolSize=24, svcPoolSize=24, callbackPoolSize=24, stripedPoolSize=24, sysPoolSize=24, mgmtPoolSize=4, dataStreamerPoolSize=24, utilityCachePoolSize=24, utilityCacheKeepAliveTime=60000, p2pPoolSize=2, qryPoolSize=24, buildIdxPoolSize=4, igniteHome=/opt/buildagent/work/7bc1c54bc719b67c, igniteWorkDir=/opt/buildagent/work/7bc1c54bc719b67c/work, mbeanSrv=com.sun.jmx.mbeanserver.JmxMBeanServer@6fe85038, nodeId=00a6fc03-d771-41c5-a569-486fa9959000, marsh=BinaryMarshaller [], marshLocJobs=false, daemon=false, p2pEnabled=true, netTimeout=10000, netCompressionLevel=1, sndRetryDelay=1000, sndRetryCnt=3, metricsHistSize=10000, metricsUpdateFreq=1000, metricsExpTime=9223372036854775807, discoSpi=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=0, ackTimeout=0, marsh=null, reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], segPlc=STOP, segResolveAttempts=2, waitForSegOnStart=true, allResolversPassReq=true, segChkFreq=10000, commSpi=TcpCommunicationSpi [connectGate=org.apache.ignite.spi.communication.tcp.internal.ConnectGateway@5e1b3b6, ctxInitLatch=java.util.concurrent.CountDownLatch@1eac27b2[Count = 1], stopping=false, clientPool=null, nioSrvWrapper=null, stateProvider=null], evtSpi=MemoryEventStorageSpi [expireAgeMs=9223372036854775807, expireCnt=10000, filter=null], colSpi=NoopCollisionSpi [], deploySpi=LocalDeploymentSpi [], indexingSpi=org.apache.ignite.spi.indexing.noop.NoopIndexingSpi@7b612a21, addrRslvr=null, encryptionSpi=org.apache.ignite.spi.encryption.keystore.KeystoreEncryptionSpi@328884dc, tracingSpi=org.apache.ignite.spi.tracing.NoopTracingSpi@65b06718, clientMode=false, rebalanceThreadPoolSize=4, rebalanceTimeout=10000, rebalanceBatchesPrefetchCnt=3, rebalanceThrottle=0, rebalanceBatchSize=524288, txCfg=TransactionConfiguration [txSerEnabled=false, dfltIsolation=REPEATABLE_READ, dfltConcurrency=PESSIMISTIC, dfltTxTimeout=0, txTimeoutOnPartitionMapExchange=0, deadlockTimeout=10000, pessimisticTxLogSize=0, pessimisticTxLogLinger=10000, tmLookupClsName=null, txManagerFactory=null, useJtaSync=false], cacheSanityCheckEnabled=true, discoStartupDelay=60000, deployMode=SHARED, p2pMissedCacheSize=100, locHost=127.0.0.1, timeSrvPortBase=31100, timeSrvPortRange=100, failureDetectionTimeout=10000, sysWorkerBlockedTimeout=null, clientFailureDetectionTimeout=10000, metricsLogFreq=0, connectorCfg=null, odbcCfg=null, warmupClos=null, atomicCfg=AtomicConfiguration [seqReserveSize=1000, cacheMode=PARTITIONED, backups=1, aff=null, grpName=null], classLdr=null, sslCtxFactory=null, platformCfg=null, binaryCfg=null, memCfg=null, pstCfg=null, dsCfg=DataStorageConfiguration [sysRegionInitSize=41943040, sysRegionMaxSize=104857600, pageSize=4096, concLvl=0, dfltDataRegConf=DataRegionConfiguration [name=default, maxSize=104857600, initSize=268435456, swapPath=null, pageEvictionMode=DISABLED, pageReplacementMode=CLOCK, evictionThreshold=0.9, emptyPagesPoolSize=100, metricsEnabled=false, metricsSubIntervalCount=5, metricsRateTimeInterval=60000, persistenceEnabled=true, checkpointPageBufSize=0, lazyMemoryAllocation=true, warmUpCfg=null], dataRegions=null, storagePath=null, checkpointFreq=30000, lockWaitTime=10000, checkpointThreads=4, checkpointWriteOrder=SEQUENTIAL, walHistSize=20, maxWalArchiveSize=20971520, walSegments=10, walSegmentSize=1048576, walPath=db/wal, walArchivePath=db/wal/archive, cdcWalPath=db/wal/cdc, cdcEnabled=false, metricsEnabled=false, walMode=LOG_ONLY, walTlbSize=131072, walBuffSize=0, walFlushFreq=2000, walFsyncDelay=1000, walRecordIterBuffSize=67108864, alwaysWriteFullPages=false, fileIOFactory=org.apache.ignite.internal.processors.cache.persistence.file.AsyncFileIOFactory@67a71a2e, metricsSubIntervalCnt=5, metricsRateTimeInterval=60000, walAutoArchiveAfterInactivity=-1, walForceArchiveTimeout=-1, writeThrottlingEnabled=false, walCompactionEnabled=false, walCompactionLevel=1, checkpointReadLockTimeout=null, walPageCompression=DISABLED, walPageCompressionLevel=null, dfltWarmUpCfg=null, encCfg=org.apache.ignite.configuration.EncryptionConfiguration@e62d571, defragmentationThreadPoolSize=4, minWalArchiveSize=-1], snapshotPath=snapshots, activeOnStart=true, activeOnStartPropSetFlag=false, autoActivation=true, autoActivationPropSetFlag=false, clusterStateOnStart=null, sqlConnCfg=null, cliConnCfg=ClientConnectorConfiguration [host=null, port=10800, portRange=100, sockSndBufSize=0, sockRcvBufSize=0, tcpNoDelay=true, maxOpenCursorsPerConn=128, threadPoolSize=24, selectorCnt=12, idleTimeout=0, handshakeTimeout=10000, jdbcEnabled=true, odbcEnabled=true, thinCliEnabled=true, sslEnabled=false, useIgniteSslCtxFactory=true, sslClientAuth=false, sslCtxFactory=null, thinCliCfg=ThinClientConfiguration [maxActiveTxPerConn=100, maxActiveComputeTasksPerConn=0]], mvccVacuumThreadCnt=2, mvccVacuumFreq=5000, authEnabled=false, failureHnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]], commFailureRslvr=null, sqlCfg=SqlConfiguration [longQryWarnTimeout=3000, dfltQryTimeout=0, sqlQryHistSize=1000, validationEnabled=false], asyncContinuationExecutor=null] [21:15:43] : [Step 4/5] [2021-11-19 21:15:43,796][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] Daemon mode: off [21:15:43] : [Step 4/5] [2021-11-19 21:15:43,797][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] OS: Linux 4.15.0-151-generic amd64 [21:15:43] : [Step 4/5] [2021-11-19 21:15:43,797][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] OS user: teamcity [21:15:43] : [Step 4/5] [2021-11-19 21:15:43,797][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] PID: 16724 [21:15:43] : [Step 4/5] [2021-11-19 21:15:43,798][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] Language runtime: Java Platform API Specification ver. 1.8 [21:15:43] : [Step 4/5] [2021-11-19 21:15:43,798][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] VM information: Java(TM) SE Runtime Environment 1.8.0_261-b12 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 25.261-b12 [21:15:43] : [Step 4/5] [2021-11-19 21:15:43,798][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] VM total memory: 1.9GB [21:15:43] : [Step 4/5] [2021-11-19 21:15:43,799][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] Remote Management [restart: off, REST: off, JMX (remote: off)] [21:15:43] : [Step 4/5] [2021-11-19 21:15:43,799][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] Logger: GridTestLog4jLogger [quiet=false, config=null] [21:15:43] : [Step 4/5] [2021-11-19 21:15:43,799][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] IGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c [21:15:43] : [Step 4/5] [2021-11-19 21:15:43,800][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] VM arguments: [-DIGNITE_DUMP_THREADS_ON_FAILURE=false, -DMono=/usr/bin/mono-sgen, -DMono4.0_x64=/usr/lib/mono/4.0, -DMono4.5_x64=/usr/lib/mono/4.5, -DMonoVersion=6.12.0.90, -DSKIP_BUILD=false, -Dagent.home.dir=/opt/buildagent, -Dagent.name=aitc-lin02_03, -Dagent.ownPort=9090, -Dagent.work.dir=/opt/buildagent/work, -Dbuild.number=95, -Dbuild.vcs.number=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.1=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.GitHubApacheIgnite=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dclassworlds.conf=/opt/buildagent/temp/buildTmp/teamcity.m2.conf, -Dcom.jetbrains.maven.watcher.report.file=/opt/buildagent/temp/buildTmp/maven-build-info.xml, -Djava.io.tmpdir=/opt/buildagent/temp/buildTmp, -Dmaven.home=/opt/buildagent/tools/maven3_6, -Dmaven.multiModuleProjectDirectory=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.agent.cpuBenchmark=457, -Dteamcity.agent.dotnet.agent_url=http://localhost:9090/RPC2, -Dteamcity.agent.dotnet.build_id=6278078, -Dteamcity.auth.password=*******, -Dteamcity.auth.userId=TeamCityBuildId=6278078, -Dteamcity.build.changedFiles.file=/opt/buildagent/temp/buildTmp/changedFiles6342607772318147725.txt, -Dteamcity.build.checkoutDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.build.id=6278078, -Dteamcity.build.properties.file=/opt/buildagent/temp/buildTmp/teamcity.build5164517880467851002.properties, -Dteamcity.build.tempDir=/opt/buildagent/temp/buildTmp, -Dteamcity.build.workingDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.buildConfName=Basic 3, -Dteamcity.buildType.id=IgniteTests24Java8_Basic3, -Dteamcity.configuration.properties.file=/opt/buildagent/temp/buildTmp/teamcity.config5591980786735343870.properties, -Dteamcity.maven.userSettings.path=/opt/buildagent/temp/buildTmp/maven_settings_585072866407032347.xml, -Dteamcity.maven.watcher.home=/opt/buildagent/plugins/mavenPlugin/maven-watcher-jdk16, -Dteamcity.projectName=Ignite Tests 2.x (JDK 8/11), -Dteamcity.runner.properties.file=/opt/buildagent/temp/buildTmp/teamcity.runner9098465561618137420.properties, -Dteamcity.tests.recentlyFailedTests.file=/opt/buildagent/temp/buildTmp/testsToRunFirst3891775683130404069.txt, -Dteamcity.version=2021.2 (build 99542), -ea, -Xms2g, -Xmx2g, -XX:+HeapDumpOnOutOfMemoryError, -DIGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_TEST_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_UPDATE_NOTIFIER=false, -DIGNITE_NO_DISCO_ORDER=true, -DIGNITE_PERFORMANCE_SUGGESTIONS_DISABLED=true, -Djava.net.preferIPv4Stack=true, -DTEST_SCALE_FACTOR=1.0, -DIGNITE_TEST_PROP_LOG4J_FILE=log4j-tc-test.xml, -DIGNITE_QUIET=false, -DIGNITE_MARSHAL_BUFFERS_RECHECK=1000, -Dmaven.repo.local=/opt/buildagent/.m2/repository] [21:15:43] : [Step 4/5] [2021-11-19 21:15:43,804][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] System cache's DataRegion size is configured to 40 MB. Use DataStorageConfiguration.systemRegionInitialSize property to change the setting. [21:15:43] : [Step 4/5] [2021-11-19 21:15:43,805][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] Configured caches [in 'sysMemPlc' dataRegion: ['ignite-sys-cache']] [21:15:43]W: [org.apache.ignite:ignite-core] [2021-11-19 21:15:43,805][WARN ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] Peer class loading is enabled (disable it in production for performance and deployment consistency reasons) [21:15:43] : [Step 4/5] [2021-11-19 21:15:43,806][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] 3-rd party licenses can be found at: /opt/buildagent/work/7bc1c54bc719b67c/libs/licenses [21:15:43] : [Step 4/5] [2021-11-19 21:15:43,811][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] Configured plugins: [21:15:43] : [Step 4/5] [2021-11-19 21:15:43,811][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- StanByClusterTestProvider 1.0 [21:15:43] : [Step 4/5] [2021-11-19 21:15:43,811][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:15:43] : [Step 4/5] [2021-11-19 21:15:43,811][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] [21:15:43] : [Step 4/5] [2021-11-19 21:15:43,811][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- PageMemory tracker plugin 1.0 [21:15:43] : [Step 4/5] [2021-11-19 21:15:43,812][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:15:43] : [Step 4/5] [2021-11-19 21:15:43,812][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] [21:15:43] : [Step 4/5] [2021-11-19 21:15:43,812][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- TestDistibutedConfigurationPlugin 1.0 [21:15:43] : [Step 4/5] [2021-11-19 21:15:43,812][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:15:43] : [Step 4/5] [2021-11-19 21:15:43,812][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] [21:15:43] : [Step 4/5] [2021-11-19 21:15:43,813][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- NodeValidationPluginProvider 1.0 [21:15:43] : [Step 4/5] [2021-11-19 21:15:43,813][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:15:43] : [Step 4/5] [2021-11-19 21:15:43,813][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] [21:15:43] : [Step 4/5] [2021-11-19 21:15:43,813][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][FailureProcessor] Configured failure handler: [hnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]]] [21:15:43] : [Step 4/5] [2021-11-19 21:15:43,823][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][TestRecordingCommunicationSpi] Successfully bound communication NIO server to TCP port [port=47100, locHost=/127.0.0.1, selectorsCnt=12, selectorSpins=0, pairedConn=false] [21:15:43]W: [org.apache.ignite:ignite-core] [2021-11-19 21:15:43,824][WARN ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][TestRecordingCommunicationSpi] Message queue limit is set to 0 which may lead to potential OOMEs when running cache operations in FULL_ASYNC or PRIMARY_SYNC modes due to message queues growth on sender and receiver sides. [21:15:43] : [Step 4/5] [2021-11-19 21:15:43,828][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][GridCollisionManager] Collision resolution is disabled (all jobs will be activated upon arrival). [21:15:43] : [Step 4/5] [2021-11-19 21:15:43,829][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] Security status [authentication=off, sandbox=off, tls/ssl=off] [21:15:43] : [Step 4/5] [2021-11-19 21:15:43,889][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:15:43] : [Step 4/5] [2021-11-19 21:15:43,982][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][MaintenanceProcessor] Resolved store directory for node persistent data: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0 [21:15:43] : [Step 4/5] [2021-11-19 21:15:43,983][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][CacheObjectBinaryProcessorImpl] Resolved directory for serialized binary metadata: /opt/buildagent/work/7bc1c54bc719b67c/work/db/binary_meta/grid_0 [21:15:43] : [Step 4/5] [2021-11-19 21:15:43,989][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0 [21:15:43] : [Step 4/5] [2021-11-19 21:15:43,990][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][FileWriteAheadLogManager] Resolved write ahead log work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0 [21:15:43] : [Step 4/5] [2021-11-19 21:15:43,990][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][FileWriteAheadLogManager] Resolved write ahead log archive directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_0 [21:15:43] : [Step 4/5] [2021-11-19 21:15:43,993][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000005.wal [21:15:43] : [Step 4/5] [2021-11-19 21:15:43,993][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000006.wal [21:15:43] : [Step 4/5] [2021-11-19 21:15:43,994][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000008.wal [21:15:43] : [Step 4/5] [2021-11-19 21:15:43,994][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000004.wal [21:15:43] : [Step 4/5] [2021-11-19 21:15:43,995][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000003.wal [21:15:43] : [Step 4/5] [2021-11-19 21:15:43,995][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000002.wal [21:15:43] : [Step 4/5] [2021-11-19 21:15:43,995][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000007.wal [21:15:43] : [Step 4/5] [2021-11-19 21:15:43,996][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000001.wal [21:15:43] : [Step 4/5] [2021-11-19 21:15:43,997][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000009.wal [21:15:43] : [Step 4/5] [2021-11-19 21:15:43,997][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][FileHandleManagerImpl] Initialized write-ahead log manager [mode=LOG_ONLY] [21:15:44] : [Step 4/5] [2021-11-19 21:15:44,005][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Configured data regions initialized successfully [total=5] [21:15:44] : [Step 4/5] [2021-11-19 21:15:44,006][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][IgniteSnapshotManager] Resolved snapshot work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/snapshots [21:15:44] : [Step 4/5] [2021-11-19 21:15:44,007][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][IgniteSnapshotManager] Resolved temp directory for snapshot creation: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0/snp [21:15:44] : [Step 4/5] [2021-11-19 21:15:44,010][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][ClientListenerProcessor] Client connector processor has started on TCP port 10800 [21:15:44] : [Step 4/5] [2021-11-19 21:15:44,017][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] Non-loopback local IPs: 172.17.0.4 [21:15:44] : [Step 4/5] [2021-11-19 21:15:44,018][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] Enabled local MACs: 0242AC110004 [21:15:44] : [Step 4/5] [2021-11-19 21:15:44,021][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=/opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0/cp/1637345741624-a72c7885-c159-46f4-833a-ad8fc2377927-START.bin, endMarker=/opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0/cp/1637345741624-a72c7885-c159-46f4-833a-ad8fc2377927-END.bin] [21:15:44] : [Step 4/5] [2021-11-19 21:15:44,023][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:15:44] : [Step 4/5] [2021-11-19 21:15:44,023][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=86657, len=1963], lastMarked=WALPointer [idx=0, fileOff=86657, len=1963], lastCheckpointId=a72c7885-c159-46f4-833a-ad8fc2377927] [21:15:44] : [Step 4/5] [2021-11-19 21:15:44,026][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Found last checkpoint marker [cpId=a72c7885-c159-46f4-833a-ad8fc2377927, pos=WALPointer [idx=0, fileOff=86657, len=1963]] [21:15:44] : [Step 4/5] [2021-11-19 21:15:44,034][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Applying lost metastore updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=86657, len=1963], lastCheckpointId=a72c7885-c159-46f4-833a-ad8fc2377927] [21:15:44] : [Step 4/5] [2021-11-19 21:15:44,037][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=0 ms] [21:15:44] : [Step 4/5] [2021-11-19 21:15:44,038][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Restoring partition state for local groups. [21:15:44] : [Step 4/5] [2021-11-19 21:15:44,038][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=0, partitionsProcessed=0, time=0ms] [21:15:44] : [Step 4/5] [2021-11-19 21:15:44,053][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][GridClusterStateProcessor] Restoring history for BaselineTopology[id=0] [21:15:44] : [Step 4/5] [2021-11-19 21:15:44,066][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][ClusterProcessor] Cluster ID and tag has been read from metastorage: ClusterIdAndTag [id=36dc15e9-5b3a-4d7b-9471-faac5f61178d, tag=angry_villani] [21:15:44] : [Step 4/5] [2021-11-19 21:15:44,067][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][IgniteClusterImpl] Shutdown policy was updated [oldVal=null, newVal=null] [21:15:44] : [Step 4/5] [2021-11-19 21:15:44,067][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustEnabled' was changed from 'null' to 'false' [21:15:44] : [Step 4/5] [2021-11-19 21:15:44,067][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustTimeout' was changed from 'null' to '300000' [21:15:44] : [Step 4/5] [2021-11-19 21:15:44,068][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][IgniteTxManager] Transactions parameter 'txOwnerDumpRequestsAllowed' was changed from 'null' to 'true' [21:15:44] : [Step 4/5] [2021-11-19 21:15:44,068][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][IgniteTxManager] Transactions parameter 'longOperationsDumpTimeout' was changed from 'null' to '60000' [21:15:44] : [Step 4/5] [2021-11-19 21:15:44,069][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpThreshold' was changed from 'null' to '0' [21:15:44] : [Step 4/5] [2021-11-19 21:15:44,069][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][IgniteTxManager] Transactions parameter 'transactionTimeDumpSamplesCoefficient' was changed from 'null' to '0.0' [21:15:44] : [Step 4/5] [2021-11-19 21:15:44,070][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpSamplesPerSecondLimit' was changed from 'null' to '5' [21:15:44] : [Step 4/5] [2021-11-19 21:15:44,070][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][IgniteTxManager] Transactions parameter 'collisionsDumpInterval' was changed from 'null' to '1000' [21:15:44] : [Step 4/5] [2021-11-19 21:15:44,071][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Historical rebalance WAL threshold changed [property=historical.rebalance.threshold, oldVal=null, newVal=500] [21:15:44] : [Step 4/5] [2021-11-19 21:15:44,071][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Checkpoint frequency deviation changed [oldVal=null, newVal=null] [21:15:44] : [Step 4/5] [2021-11-19 21:15:44,072][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][FilePageStoreManager] Cleanup cache stores [total=1, left=0, cleanFiles=false] [21:15:44] : [Step 4/5] [2021-11-19 21:15:44,074][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:15:44] : [Step 4/5] [2021-11-19 21:15:44,075][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:15:44] : [Step 4/5] [2021-11-19 21:15:44,076][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:15:44] : [Step 4/5] [2021-11-19 21:15:44,077][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Data Regions Started: 5 [21:15:44] : [Step 4/5] [2021-11-19 21:15:44,077][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] ^-- sysMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:15:44] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:15:44] : [Step 4/5] ^-- default region [type=default, persistence=true, lazyAlloc=true, [21:15:44] : [Step 4/5] ... initCfg=100MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB, allocTotal=0MB] [21:15:44] : [Step 4/5] ^-- metastoreMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:15:44] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:15:44] : [Step 4/5] ^-- TxLog region [type=internal, persistence=true, lazyAlloc=false, [21:15:44] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:15:44] : [Step 4/5] ^-- volatileDsMemPlc region [type=user, persistence=false, lazyAlloc=true, [21:15:44] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB] [21:15:44] : [Step 4/5] ^-- Ignite persistence [used=0MB] [21:15:44] : [Step 4/5] [21:15:44] : [Step 4/5] [2021-11-19 21:15:44,079][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Starting binary memory restore for: [-2100569601, 1613773252] [21:15:44] : [Step 4/5] [2021-11-19 21:15:44,091][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=/opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0/cp/1637345741624-a72c7885-c159-46f4-833a-ad8fc2377927-START.bin, endMarker=/opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0/cp/1637345741624-a72c7885-c159-46f4-833a-ad8fc2377927-END.bin] [21:15:44] : [Step 4/5] [2021-11-19 21:15:44,092][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=86657, len=1963], lastMarked=WALPointer [idx=0, fileOff=86657, len=1963], lastCheckpointId=a72c7885-c159-46f4-833a-ad8fc2377927] [21:15:44] : [Step 4/5] [2021-11-19 21:15:44,094][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Found last checkpoint marker [cpId=a72c7885-c159-46f4-833a-ad8fc2377927, pos=WALPointer [idx=0, fileOff=86657, len=1963]] [21:15:44] : [Step 4/5] [2021-11-19 21:15:44,100][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Binary memory state restored at node startup [restoredPtr=WALPointer [idx=0, fileOff=183670, len=0]] [21:15:44] : [Step 4/5] [2021-11-19 21:15:44,105][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000000.wal, offset=183670, ver=2] [21:15:44] : [Step 4/5] [2021-11-19 21:15:44,107][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Started cache in recovery mode [name=ignite-sys-cache, id=-2100569601, dataRegionName=sysMemPlc, mode=REPLICATED, atomicity=TRANSACTIONAL, backups=2147483647, mvcc=false] [21:15:44] : [Step 4/5] [2021-11-19 21:15:44,108][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:15:44] : [Step 4/5] [2021-11-19 21:15:44,111][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Started cache in recovery mode [name=encrypted, id=1613773252, dataRegionName=default, mode=PARTITIONED, atomicity=ATOMIC, backups=1, mvcc=false] [21:15:44] : [Step 4/5] [2021-11-19 21:15:44,112][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Binary recovery performed in 33 ms. [21:15:44] : [Step 4/5] [2021-11-19 21:15:44,113][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=/opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0/cp/1637345741624-a72c7885-c159-46f4-833a-ad8fc2377927-START.bin, endMarker=/opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0/cp/1637345741624-a72c7885-c159-46f4-833a-ad8fc2377927-END.bin] [21:15:44] : [Step 4/5] [2021-11-19 21:15:44,114][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Applying lost cache updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=86657, len=1963], lastCheckpointId=a72c7885-c159-46f4-833a-ad8fc2377927] [21:15:44] : [Step 4/5] [2021-11-19 21:15:44,128][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=100, time=10 ms] [21:15:44] : [Step 4/5] [2021-11-19 21:15:44,128][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Restoring partition state for local groups. [21:15:44] : [Step 4/5] [2021-11-19 21:15:44,163][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=2, partitionsProcessed=108, time=41ms] [21:15:44] : [Step 4/5] [2021-11-19 21:15:44,236][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][TestTcpDiscoverySpi] Successfully bound to TCP port [port=47500, localHost=localhost/127.0.0.1, locNodeId=00a6fc03-d771-41c5-a569-486fa9959000] [21:15:44] : [Step 4/5] [2021-11-19 21:15:44,245][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][GridEncryptionManager] Sending stored group keys to coordinator [grps=1613773252] [21:15:44] : [Step 4/5] [2021-11-19 21:15:44,255][INFO ][disco-notifier-worker-#27367%grid-0%][MvccProcessorImpl] Assigned mvcc coordinator [crd=MvccCoordinator [topVer=AffinityTopologyVersion [topVer=1, minorTopVer=0], nodeId=00a6fc03-d771-41c5-a569-486fa9959000, ver=1637345744250, local=true, initialized=false]] [21:15:44] : [Step 4/5] [2021-11-19 21:15:44,256][INFO ][sys-#27348%grid-0%][ClusterProcessor] Writing cluster ID and tag to metastorage on ready for write ClusterIdAndTag [id=36dc15e9-5b3a-4d7b-9471-faac5f61178d, tag=angry_villani] [21:15:44] : [Step 4/5] [2021-11-19 21:15:44,321][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] To start Console Management & Monitoring run ignitevisorcmd.{sh|bat} [21:15:44] : [Step 4/5] [2021-11-19 21:15:44,322][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] [21:15:44] : [Step 4/5] [21:15:44] : [Step 4/5] >>> +-------------------------------------------+ [21:15:44] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:15:44] : [Step 4/5] >>> +-------------------------------------------+ [21:15:44] : [Step 4/5] >>> OS name: Linux 4.15.0-151-generic amd64 [21:15:44] : [Step 4/5] >>> CPU(s): 24 [21:15:44] : [Step 4/5] >>> Heap: 2.0GB [21:15:44] : [Step 4/5] >>> VM name: 16724@c4dfe9a430b2 [21:15:44] : [Step 4/5] >>> Ignite instance name: grid-0 [21:15:44] : [Step 4/5] >>> Local node [ID=00A6FC03-D771-41C5-A569-486FA9959000, order=1, clientMode=false] [21:15:44] : [Step 4/5] >>> Local node addresses: [127.0.0.1] [21:15:44] : [Step 4/5] >>> Local ports: TCP:10800 TCP:47100 TCP:47500 [21:15:44] : [Step 4/5] [21:15:44] : [Step 4/5] [2021-11-19 21:15:44,323][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-0] >>> Ignite cluster is in INACTIVE state (limited functionality available). Use control.(sh|bat) script or IgniteCluster.state(ClusterState.ACTIVE) to change the state. [21:15:44] : [Step 4/5] [2021-11-19 21:15:44,323][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][GridDiscoveryManager] Topology snapshot [ver=1, locNode=00a6fc03, servers=1, clients=0, state=INACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=00a6fc03-d771-41c5-a569-486fa9959000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:15:44] : [Step 4/5] [2021-11-19 21:15:44,324][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][GridDiscoveryManager] ^-- Baseline [id=0, size=2, online=1, offline=1] [21:15:44] : [Step 4/5] [2021-11-19 21:15:44,324][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][GridDiscoveryManager] ^-- 1 nodes left for auto-activation [grid-1] [21:15:44] : [Step 4/5] [2021-11-19 21:15:44,325][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][G] Node started : [stage="Configure system pool" (0 ms),stage="Start managers" (196 ms),stage="Configure binary metadata" (2 ms),stage="Start processors" (31 ms),stage="Start 'StanByClusterTestProvider' plugin" (0 ms),stage="Start 'PageMemory tracker plugin' plugin" (0 ms),stage="Start 'TestDistibutedConfigurationPlugin' plugin" (0 ms),stage="Start 'NodeValidationPluginProvider' plugin" (0 ms),stage="Init metastore" (55 ms),stage="Init and start regions" (6 ms),stage="Restore binary memory" (33 ms),stage="Restore logical state" (50 ms),stage="Finish recovery" (71 ms),stage="Join topology" (20 ms),stage="Await transition" (3 ms),stage="Await exchange" (65 ms),stage="Total time" (532 ms)] [21:15:44] : [Step 4/5] [2021-11-19 21:15:44,326][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][root] Node started with the following configuration [id=00a6fc03-d771-41c5-a569-486fa9959000, marshaller=BinaryMarshaller [], discovery=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=5000, ackTimeout=5000, marsh=JdkMarshaller [clsFilter=org.apache.ignite.marshaller.MarshallerUtils$1@31d8bf26], reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], binaryCfg=null, lateAff=true] [21:15:44]W: [org.apache.ignite:ignite-core] [2021-11-19 21:15:44,340][WARN ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][G] Ignite work directory is not provided, automatically resolved to: /opt/buildagent/work/7bc1c54bc719b67c/work [21:15:44] : [Step 4/5] [2021-11-19 21:15:44,341][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] [21:15:44] : [Step 4/5] [21:15:44] : [Step 4/5] >>> __________ ________________ [21:15:44] : [Step 4/5] >>> / _/ ___/ |/ / _/_ __/ __/ [21:15:44] : [Step 4/5] >>> _/ // (7 7 // / / / / _/ [21:15:44] : [Step 4/5] >>> /___/\___/_/|_/___/ /_/ /___/ [21:15:44] : [Step 4/5] >>> [21:15:44] : [Step 4/5] >>> ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:15:44] : [Step 4/5] >>> 2021 Copyright(C) Apache Software Foundation [21:15:44] : [Step 4/5] >>> [21:15:44] : [Step 4/5] >>> Ignite documentation: http://ignite.apache.org [21:15:44] : [Step 4/5] [21:15:44] : [Step 4/5] [2021-11-19 21:15:44,342][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] Config URL: n/a [21:15:44] : [Step 4/5] [2021-11-19 21:15:44,343][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] IgniteConfiguration [igniteInstanceName=grid-1, pubPoolSize=24, svcPoolSize=24, callbackPoolSize=24, stripedPoolSize=24, sysPoolSize=24, mgmtPoolSize=4, dataStreamerPoolSize=24, utilityCachePoolSize=24, utilityCacheKeepAliveTime=60000, p2pPoolSize=2, qryPoolSize=24, buildIdxPoolSize=4, igniteHome=/opt/buildagent/work/7bc1c54bc719b67c, igniteWorkDir=/opt/buildagent/work/7bc1c54bc719b67c/work, mbeanSrv=com.sun.jmx.mbeanserver.JmxMBeanServer@6fe85038, nodeId=104f4bc0-8387-42e3-9369-3a2ae7e62001, marsh=BinaryMarshaller [], marshLocJobs=false, daemon=false, p2pEnabled=true, netTimeout=10000, netCompressionLevel=1, sndRetryDelay=1000, sndRetryCnt=3, metricsHistSize=10000, metricsUpdateFreq=1000, metricsExpTime=9223372036854775807, discoSpi=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=0, ackTimeout=0, marsh=null, reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], segPlc=STOP, segResolveAttempts=2, waitForSegOnStart=true, allResolversPassReq=true, segChkFreq=10000, commSpi=TcpCommunicationSpi [connectGate=org.apache.ignite.spi.communication.tcp.internal.ConnectGateway@d3ecdac, ctxInitLatch=java.util.concurrent.CountDownLatch@6ca94[Count = 1], stopping=false, clientPool=null, nioSrvWrapper=null, stateProvider=null], evtSpi=MemoryEventStorageSpi [expireAgeMs=9223372036854775807, expireCnt=10000, filter=null], colSpi=NoopCollisionSpi [], deploySpi=LocalDeploymentSpi [], indexingSpi=org.apache.ignite.spi.indexing.noop.NoopIndexingSpi@165af941, addrRslvr=null, encryptionSpi=org.apache.ignite.spi.encryption.keystore.KeystoreEncryptionSpi@2f027270, tracingSpi=org.apache.ignite.spi.tracing.NoopTracingSpi@45f88f23, clientMode=false, rebalanceThreadPoolSize=4, rebalanceTimeout=10000, rebalanceBatchesPrefetchCnt=3, rebalanceThrottle=0, rebalanceBatchSize=524288, txCfg=TransactionConfiguration [txSerEnabled=false, dfltIsolation=REPEATABLE_READ, dfltConcurrency=PESSIMISTIC, dfltTxTimeout=0, txTimeoutOnPartitionMapExchange=0, deadlockTimeout=10000, pessimisticTxLogSize=0, pessimisticTxLogLinger=10000, tmLookupClsName=null, txManagerFactory=null, useJtaSync=false], cacheSanityCheckEnabled=true, discoStartupDelay=60000, deployMode=SHARED, p2pMissedCacheSize=100, locHost=127.0.0.1, timeSrvPortBase=31100, timeSrvPortRange=100, failureDetectionTimeout=10000, sysWorkerBlockedTimeout=null, clientFailureDetectionTimeout=10000, metricsLogFreq=0, connectorCfg=null, odbcCfg=null, warmupClos=null, atomicCfg=AtomicConfiguration [seqReserveSize=1000, cacheMode=PARTITIONED, backups=1, aff=null, grpName=null], classLdr=null, sslCtxFactory=null, platformCfg=null, binaryCfg=null, memCfg=null, pstCfg=null, dsCfg=DataStorageConfiguration [sysRegionInitSize=41943040, sysRegionMaxSize=104857600, pageSize=4096, concLvl=0, dfltDataRegConf=DataRegionConfiguration [name=default, maxSize=104857600, initSize=268435456, swapPath=null, pageEvictionMode=DISABLED, pageReplacementMode=CLOCK, evictionThreshold=0.9, emptyPagesPoolSize=100, metricsEnabled=false, metricsSubIntervalCount=5, metricsRateTimeInterval=60000, persistenceEnabled=true, checkpointPageBufSize=0, lazyMemoryAllocation=true, warmUpCfg=null], dataRegions=null, storagePath=null, checkpointFreq=30000, lockWaitTime=10000, checkpointThreads=4, checkpointWriteOrder=SEQUENTIAL, walHistSize=20, maxWalArchiveSize=20971520, walSegments=10, walSegmentSize=1048576, walPath=db/wal, walArchivePath=db/wal/archive, cdcWalPath=db/wal/cdc, cdcEnabled=false, metricsEnabled=false, walMode=LOG_ONLY, walTlbSize=131072, walBuffSize=0, walFlushFreq=2000, walFsyncDelay=1000, walRecordIterBuffSize=67108864, alwaysWriteFullPages=false, fileIOFactory=org.apache.ignite.internal.processors.cache.persistence.file.AsyncFileIOFactory@473ec462, metricsSubIntervalCnt=5, metricsRateTimeInterval=60000, walAutoArchiveAfterInactivity=-1, walForceArchiveTimeout=-1, writeThrottlingEnabled=false, walCompactionEnabled=false, walCompactionLevel=1, checkpointReadLockTimeout=null, walPageCompression=DISABLED, walPageCompressionLevel=null, dfltWarmUpCfg=null, encCfg=org.apache.ignite.configuration.EncryptionConfiguration@249ea768, defragmentationThreadPoolSize=4, minWalArchiveSize=-1], snapshotPath=snapshots, activeOnStart=true, activeOnStartPropSetFlag=false, autoActivation=true, autoActivationPropSetFlag=false, clusterStateOnStart=null, sqlConnCfg=null, cliConnCfg=ClientConnectorConfiguration [host=null, port=10800, portRange=100, sockSndBufSize=0, sockRcvBufSize=0, tcpNoDelay=true, maxOpenCursorsPerConn=128, threadPoolSize=24, selectorCnt=12, idleTimeout=0, handshakeTimeout=10000, jdbcEnabled=true, odbcEnabled=true, thinCliEnabled=true, sslEnabled=false, useIgniteSslCtxFactory=true, sslClientAuth=false, sslCtxFactory=null, thinCliCfg=ThinClientConfiguration [maxActiveTxPerConn=100, maxActiveComputeTasksPerConn=0]], mvccVacuumThreadCnt=2, mvccVacuumFreq=5000, authEnabled=false, failureHnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]], commFailureRslvr=null, sqlCfg=SqlConfiguration [longQryWarnTimeout=3000, dfltQryTimeout=0, sqlQryHistSize=1000, validationEnabled=false], asyncContinuationExecutor=null] [21:15:44] : [Step 4/5] [2021-11-19 21:15:44,352][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] Daemon mode: off [21:15:44] : [Step 4/5] [2021-11-19 21:15:44,352][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] OS: Linux 4.15.0-151-generic amd64 [21:15:44] : [Step 4/5] [2021-11-19 21:15:44,352][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] OS user: teamcity [21:15:44] : [Step 4/5] [2021-11-19 21:15:44,353][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] PID: 16724 [21:15:44] : [Step 4/5] [2021-11-19 21:15:44,353][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] Language runtime: Java Platform API Specification ver. 1.8 [21:15:44] : [Step 4/5] [2021-11-19 21:15:44,353][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] VM information: Java(TM) SE Runtime Environment 1.8.0_261-b12 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 25.261-b12 [21:15:44] : [Step 4/5] [2021-11-19 21:15:44,354][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] VM total memory: 1.9GB [21:15:44] : [Step 4/5] [2021-11-19 21:15:44,354][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] Remote Management [restart: off, REST: off, JMX (remote: off)] [21:15:44] : [Step 4/5] [2021-11-19 21:15:44,354][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] Logger: GridTestLog4jLogger [quiet=false, config=null] [21:15:44] : [Step 4/5] [2021-11-19 21:15:44,355][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] IGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c [21:15:44] : [Step 4/5] [2021-11-19 21:15:44,355][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] VM arguments: [-DIGNITE_DUMP_THREADS_ON_FAILURE=false, -DMono=/usr/bin/mono-sgen, -DMono4.0_x64=/usr/lib/mono/4.0, -DMono4.5_x64=/usr/lib/mono/4.5, -DMonoVersion=6.12.0.90, -DSKIP_BUILD=false, -Dagent.home.dir=/opt/buildagent, -Dagent.name=aitc-lin02_03, -Dagent.ownPort=9090, -Dagent.work.dir=/opt/buildagent/work, -Dbuild.number=95, -Dbuild.vcs.number=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.1=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dbuild.vcs.number.GitHubApacheIgnite=c6d91d0fa04338c406d0857a9a1008a36ea8a030, -Dclassworlds.conf=/opt/buildagent/temp/buildTmp/teamcity.m2.conf, -Dcom.jetbrains.maven.watcher.report.file=/opt/buildagent/temp/buildTmp/maven-build-info.xml, -Djava.io.tmpdir=/opt/buildagent/temp/buildTmp, -Dmaven.home=/opt/buildagent/tools/maven3_6, -Dmaven.multiModuleProjectDirectory=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.agent.cpuBenchmark=457, -Dteamcity.agent.dotnet.agent_url=http://localhost:9090/RPC2, -Dteamcity.agent.dotnet.build_id=6278078, -Dteamcity.auth.password=*******, -Dteamcity.auth.userId=TeamCityBuildId=6278078, -Dteamcity.build.changedFiles.file=/opt/buildagent/temp/buildTmp/changedFiles6342607772318147725.txt, -Dteamcity.build.checkoutDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.build.id=6278078, -Dteamcity.build.properties.file=/opt/buildagent/temp/buildTmp/teamcity.build5164517880467851002.properties, -Dteamcity.build.tempDir=/opt/buildagent/temp/buildTmp, -Dteamcity.build.workingDir=/opt/buildagent/work/7bc1c54bc719b67c, -Dteamcity.buildConfName=Basic 3, -Dteamcity.buildType.id=IgniteTests24Java8_Basic3, -Dteamcity.configuration.properties.file=/opt/buildagent/temp/buildTmp/teamcity.config5591980786735343870.properties, -Dteamcity.maven.userSettings.path=/opt/buildagent/temp/buildTmp/maven_settings_585072866407032347.xml, -Dteamcity.maven.watcher.home=/opt/buildagent/plugins/mavenPlugin/maven-watcher-jdk16, -Dteamcity.projectName=Ignite Tests 2.x (JDK 8/11), -Dteamcity.runner.properties.file=/opt/buildagent/temp/buildTmp/teamcity.runner9098465561618137420.properties, -Dteamcity.tests.recentlyFailedTests.file=/opt/buildagent/temp/buildTmp/testsToRunFirst3891775683130404069.txt, -Dteamcity.version=2021.2 (build 99542), -ea, -Xms2g, -Xmx2g, -XX:+HeapDumpOnOutOfMemoryError, -DIGNITE_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_TEST_HOME=/opt/buildagent/work/7bc1c54bc719b67c, -DIGNITE_UPDATE_NOTIFIER=false, -DIGNITE_NO_DISCO_ORDER=true, -DIGNITE_PERFORMANCE_SUGGESTIONS_DISABLED=true, -Djava.net.preferIPv4Stack=true, -DTEST_SCALE_FACTOR=1.0, -DIGNITE_TEST_PROP_LOG4J_FILE=log4j-tc-test.xml, -DIGNITE_QUIET=false, -DIGNITE_MARSHAL_BUFFERS_RECHECK=1000, -Dmaven.repo.local=/opt/buildagent/.m2/repository] [21:15:44] : [Step 4/5] [2021-11-19 21:15:44,359][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] System cache's DataRegion size is configured to 40 MB. Use DataStorageConfiguration.systemRegionInitialSize property to change the setting. [21:15:44] : [Step 4/5] [2021-11-19 21:15:44,360][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] Configured caches [in 'sysMemPlc' dataRegion: ['ignite-sys-cache']] [21:15:44]W: [org.apache.ignite:ignite-core] [2021-11-19 21:15:44,360][WARN ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] Peer class loading is enabled (disable it in production for performance and deployment consistency reasons) [21:15:44] : [Step 4/5] [2021-11-19 21:15:44,361][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] 3-rd party licenses can be found at: /opt/buildagent/work/7bc1c54bc719b67c/libs/licenses [21:15:44] : [Step 4/5] [2021-11-19 21:15:44,365][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] Configured plugins: [21:15:44] : [Step 4/5] [2021-11-19 21:15:44,365][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- StanByClusterTestProvider 1.0 [21:15:44] : [Step 4/5] [2021-11-19 21:15:44,365][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:15:44] : [Step 4/5] [2021-11-19 21:15:44,365][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] [21:15:44] : [Step 4/5] [2021-11-19 21:15:44,366][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- PageMemory tracker plugin 1.0 [21:15:44] : [Step 4/5] [2021-11-19 21:15:44,366][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:15:44] : [Step 4/5] [2021-11-19 21:15:44,366][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] [21:15:44] : [Step 4/5] [2021-11-19 21:15:44,366][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- TestDistibutedConfigurationPlugin 1.0 [21:15:44] : [Step 4/5] [2021-11-19 21:15:44,366][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:15:44] : [Step 4/5] [2021-11-19 21:15:44,367][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] [21:15:44] : [Step 4/5] [2021-11-19 21:15:44,367][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- NodeValidationPluginProvider 1.0 [21:15:44] : [Step 4/5] [2021-11-19 21:15:44,367][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] ^-- null [21:15:44] : [Step 4/5] [2021-11-19 21:15:44,367][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][IgnitePluginProcessor] [21:15:44] : [Step 4/5] [2021-11-19 21:15:44,367][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][FailureProcessor] Configured failure handler: [hnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]]] [21:15:44] : [Step 4/5] [2021-11-19 21:15:44,401][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][TestRecordingCommunicationSpi] Successfully bound communication NIO server to TCP port [port=47101, locHost=/127.0.0.1, selectorsCnt=12, selectorSpins=0, pairedConn=false] [21:15:44]W: [org.apache.ignite:ignite-core] [2021-11-19 21:15:44,401][WARN ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][TestRecordingCommunicationSpi] Message queue limit is set to 0 which may lead to potential OOMEs when running cache operations in FULL_ASYNC or PRIMARY_SYNC modes due to message queues growth on sender and receiver sides. [21:15:44] : [Step 4/5] [2021-11-19 21:15:44,405][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][GridCollisionManager] Collision resolution is disabled (all jobs will be activated upon arrival). [21:15:44] : [Step 4/5] [2021-11-19 21:15:44,406][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] Security status [authentication=off, sandbox=off, tls/ssl=off] [21:15:44] : [Step 4/5] [2021-11-19 21:15:44,470][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][KeystoreEncryptionSpi] Successfully load keyStore [path=/opt/buildagent/work/7bc1c54bc719b67c/modules/core/src/test/resources/tde.jks] [21:15:44] : [Step 4/5] [2021-11-19 21:15:44,559][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][MaintenanceProcessor] Resolved store directory for node persistent data: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1 [21:15:44] : [Step 4/5] [2021-11-19 21:15:44,560][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][CacheObjectBinaryProcessorImpl] Resolved directory for serialized binary metadata: /opt/buildagent/work/7bc1c54bc719b67c/work/db/binary_meta/grid_1 [21:15:44] : [Step 4/5] [2021-11-19 21:15:44,565][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1 [21:15:44] : [Step 4/5] [2021-11-19 21:15:44,565][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][FileWriteAheadLogManager] Resolved write ahead log work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1 [21:15:44] : [Step 4/5] [2021-11-19 21:15:44,566][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][FileWriteAheadLogManager] Resolved write ahead log archive directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/archive/grid_1 [21:15:44] : [Step 4/5] [2021-11-19 21:15:44,568][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000005.wal [21:15:44] : [Step 4/5] [2021-11-19 21:15:44,568][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000006.wal [21:15:44] : [Step 4/5] [2021-11-19 21:15:44,569][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000008.wal [21:15:44] : [Step 4/5] [2021-11-19 21:15:44,569][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000004.wal [21:15:44] : [Step 4/5] [2021-11-19 21:15:44,569][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000003.wal [21:15:44] : [Step 4/5] [2021-11-19 21:15:44,570][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000002.wal [21:15:44] : [Step 4/5] [2021-11-19 21:15:44,570][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000007.wal [21:15:44] : [Step 4/5] [2021-11-19 21:15:44,571][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000001.wal [21:15:44] : [Step 4/5] [2021-11-19 21:15:44,571][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][FileWriteAheadLogManager] Reached logical end of the segment for file /opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000009.wal [21:15:44] : [Step 4/5] [2021-11-19 21:15:44,572][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][FileHandleManagerImpl] Initialized write-ahead log manager [mode=LOG_ONLY] [21:15:44] : [Step 4/5] [2021-11-19 21:15:44,576][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Configured data regions initialized successfully [total=5] [21:15:44] : [Step 4/5] [2021-11-19 21:15:44,649][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][IgniteSnapshotManager] Resolved snapshot work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/snapshots [21:15:44] : [Step 4/5] [2021-11-19 21:15:44,649][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][IgniteSnapshotManager] Resolved temp directory for snapshot creation: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1/snp [21:15:44] : [Step 4/5] [2021-11-19 21:15:44,652][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][ClientListenerProcessor] Client connector processor has started on TCP port 10801 [21:15:44] : [Step 4/5] [2021-11-19 21:15:44,654][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] Non-loopback local IPs: 172.17.0.4 [21:15:44] : [Step 4/5] [2021-11-19 21:15:44,654][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] Enabled local MACs: 0242AC110004 [21:15:44] : [Step 4/5] [2021-11-19 21:15:44,655][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=/opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1/cp/1637345742845-dd384b18-8466-41d2-a0af-e450e1b1e0c1-START.bin, endMarker=/opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1/cp/1637345742845-dd384b18-8466-41d2-a0af-e450e1b1e0c1-END.bin] [21:15:44] : [Step 4/5] [2021-11-19 21:15:44,656][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:15:44] : [Step 4/5] [2021-11-19 21:15:44,656][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=229444, len=2105], lastMarked=WALPointer [idx=0, fileOff=229444, len=2105], lastCheckpointId=dd384b18-8466-41d2-a0af-e450e1b1e0c1] [21:15:44] : [Step 4/5] [2021-11-19 21:15:44,660][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Found last checkpoint marker [cpId=dd384b18-8466-41d2-a0af-e450e1b1e0c1, pos=WALPointer [idx=0, fileOff=229444, len=2105]] [21:15:44] : [Step 4/5] [2021-11-19 21:15:44,661][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Applying lost metastore updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=229444, len=2105], lastCheckpointId=dd384b18-8466-41d2-a0af-e450e1b1e0c1] [21:15:44] : [Step 4/5] [2021-11-19 21:15:44,663][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=0 ms] [21:15:44] : [Step 4/5] [2021-11-19 21:15:44,663][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Restoring partition state for local groups. [21:15:44] : [Step 4/5] [2021-11-19 21:15:44,663][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=0, partitionsProcessed=0, time=0ms] [21:15:44] : [Step 4/5] [2021-11-19 21:15:44,670][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][GridClusterStateProcessor] Restoring history for BaselineTopology[id=0] [21:15:44] : [Step 4/5] [2021-11-19 21:15:44,672][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][ClusterProcessor] Cluster ID and tag has been read from metastorage: ClusterIdAndTag [id=36dc15e9-5b3a-4d7b-9471-faac5f61178d, tag=angry_villani] [21:15:44] : [Step 4/5] [2021-11-19 21:15:44,672][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][IgniteClusterImpl] Shutdown policy was updated [oldVal=null, newVal=null] [21:15:44] : [Step 4/5] [2021-11-19 21:15:44,673][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustEnabled' was changed from 'null' to 'false' [21:15:44] : [Step 4/5] [2021-11-19 21:15:44,673][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][DistributedBaselineConfiguration] Baseline parameter 'baselineAutoAdjustTimeout' was changed from 'null' to '300000' [21:15:44] : [Step 4/5] [2021-11-19 21:15:44,673][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][IgniteTxManager] Transactions parameter 'txOwnerDumpRequestsAllowed' was changed from 'null' to 'true' [21:15:44] : [Step 4/5] [2021-11-19 21:15:44,674][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][IgniteTxManager] Transactions parameter 'longOperationsDumpTimeout' was changed from 'null' to '60000' [21:15:44] : [Step 4/5] [2021-11-19 21:15:44,674][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpThreshold' was changed from 'null' to '0' [21:15:44] : [Step 4/5] [2021-11-19 21:15:44,675][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][IgniteTxManager] Transactions parameter 'transactionTimeDumpSamplesCoefficient' was changed from 'null' to '0.0' [21:15:44] : [Step 4/5] [2021-11-19 21:15:44,675][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][IgniteTxManager] Transactions parameter 'longTransactionTimeDumpSamplesPerSecondLimit' was changed from 'null' to '5' [21:15:44] : [Step 4/5] [2021-11-19 21:15:44,675][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][IgniteTxManager] Transactions parameter 'collisionsDumpInterval' was changed from 'null' to '1000' [21:15:44] : [Step 4/5] [2021-11-19 21:15:44,676][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Historical rebalance WAL threshold changed [property=historical.rebalance.threshold, oldVal=null, newVal=500] [21:15:44] : [Step 4/5] [2021-11-19 21:15:44,677][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Checkpoint frequency deviation changed [oldVal=null, newVal=null] [21:15:44] : [Step 4/5] [2021-11-19 21:15:44,728][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][FilePageStoreManager] Cleanup cache stores [total=1, left=0, cleanFiles=false] [21:15:44] : [Step 4/5] [2021-11-19 21:15:44,731][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:15:44] : [Step 4/5] [2021-11-19 21:15:44,732][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:15:44] : [Step 4/5] [2021-11-19 21:15:44,734][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:15:44] : [Step 4/5] [2021-11-19 21:15:44,735][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Data Regions Started: 5 [21:15:44] : [Step 4/5] [2021-11-19 21:15:44,735][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] ^-- sysMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:15:44] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:15:44] : [Step 4/5] ^-- default region [type=default, persistence=true, lazyAlloc=true, [21:15:44] : [Step 4/5] ... initCfg=100MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB, allocTotal=0MB] [21:15:44] : [Step 4/5] ^-- metastoreMemPlc region [type=internal, persistence=true, lazyAlloc=false, [21:15:44] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:15:44] : [Step 4/5] ^-- TxLog region [type=internal, persistence=true, lazyAlloc=false, [21:15:44] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=99MB, allocTotal=0MB] [21:15:44] : [Step 4/5] ^-- volatileDsMemPlc region [type=user, persistence=false, lazyAlloc=true, [21:15:44] : [Step 4/5] ... initCfg=40MB, maxCfg=100MB, usedRam=0MB, freeRam=100%, allocRam=0MB] [21:15:44] : [Step 4/5] ^-- Ignite persistence [used=0MB] [21:15:44] : [Step 4/5] [21:15:44] : [Step 4/5] [2021-11-19 21:15:44,737][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Starting binary memory restore for: [-2100569601, 1613773252] [21:15:44] : [Step 4/5] [2021-11-19 21:15:44,748][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=/opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1/cp/1637345742845-dd384b18-8466-41d2-a0af-e450e1b1e0c1-START.bin, endMarker=/opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1/cp/1637345742845-dd384b18-8466-41d2-a0af-e450e1b1e0c1-END.bin] [21:15:44] : [Step 4/5] [2021-11-19 21:15:44,748][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=WALPointer [idx=0, fileOff=229444, len=2105], lastMarked=WALPointer [idx=0, fileOff=229444, len=2105], lastCheckpointId=dd384b18-8466-41d2-a0af-e450e1b1e0c1] [21:15:44] : [Step 4/5] [2021-11-19 21:15:44,751][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Found last checkpoint marker [cpId=dd384b18-8466-41d2-a0af-e450e1b1e0c1, pos=WALPointer [idx=0, fileOff=229444, len=2105]] [21:15:44] : [Step 4/5] [2021-11-19 21:15:44,753][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Binary memory state restored at node startup [restoredPtr=WALPointer [idx=0, fileOff=231549, len=0]] [21:15:44] : [Step 4/5] [2021-11-19 21:15:44,755][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000000.wal, offset=231549, ver=2] [21:15:44] : [Step 4/5] [2021-11-19 21:15:44,757][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Started cache in recovery mode [name=ignite-sys-cache, id=-2100569601, dataRegionName=sysMemPlc, mode=REPLICATED, atomicity=TRANSACTIONAL, backups=2147483647, mvcc=false] [21:15:44] : [Step 4/5] [2021-11-19 21:15:44,760][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][PageMemoryImpl] Started page memory [memoryAllocated=100.0 MiB, pages=24792, tableSize=1.9 MiB, replacementSize=3.2 KiB, checkpointBuffer=100.0 MiB] [21:15:44] : [Step 4/5] [2021-11-19 21:15:44,763][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Started cache in recovery mode [name=encrypted, id=1613773252, dataRegionName=default, mode=PARTITIONED, atomicity=ATOMIC, backups=1, mvcc=false] [21:15:44] : [Step 4/5] [2021-11-19 21:15:44,764][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Binary recovery performed in 27 ms. [21:15:44] : [Step 4/5] [2021-11-19 21:15:44,765][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][CheckpointMarkersStorage] Read checkpoint status [startMarker=/opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1/cp/1637345742845-dd384b18-8466-41d2-a0af-e450e1b1e0c1-START.bin, endMarker=/opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1/cp/1637345742845-dd384b18-8466-41d2-a0af-e450e1b1e0c1-END.bin] [21:15:44] : [Step 4/5] [2021-11-19 21:15:44,765][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Applying lost cache updates since last checkpoint record [lastMarked=WALPointer [idx=0, fileOff=229444, len=2105], lastCheckpointId=dd384b18-8466-41d2-a0af-e450e1b1e0c1] [21:15:44] : [Step 4/5] [2021-11-19 21:15:44,768][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][GridCacheDatabaseSharedManager] Finished applying WAL changes [updatesApplied=0, time=0 ms] [21:15:44] : [Step 4/5] [2021-11-19 21:15:44,768][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Restoring partition state for local groups. [21:15:44] : [Step 4/5] [2021-11-19 21:15:44,790][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][GridCacheProcessor] Finished restoring partition state for local groups [groupsProcessed=2, partitionsProcessed=108, time=20ms] [21:15:44] : [Step 4/5] [2021-11-19 21:15:44,935][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][TestTcpDiscoverySpi] Successfully bound to TCP port [port=47501, localHost=localhost/127.0.0.1, locNodeId=104f4bc0-8387-42e3-9369-3a2ae7e62001] [21:15:44] : [Step 4/5] [2021-11-19 21:15:44,938][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][GridEncryptionManager] Sending stored group keys to coordinator [grps=1613773252] [21:15:44] : [Step 4/5] [2021-11-19 21:15:44,943][INFO ][tcp-disco-srvr-[:47500]-#1438%grid-0%-#27369%grid-0%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=48637] [21:15:44] : [Step 4/5] [2021-11-19 21:15:44,944][INFO ][tcp-disco-srvr-[:47500]-#1438%grid-0%-#27369%grid-0%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=48637] [21:15:44] : [Step 4/5] [2021-11-19 21:15:44,946][INFO ][tcp-disco-sock-reader-[]-#1444%grid-0%-#27490%grid-0%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:48637, rmtPort=48637] [21:15:44] : [Step 4/5] [2021-11-19 21:15:44,947][INFO ][tcp-disco-sock-reader-[104f4bc0 127.0.0.1:48637]-#1444%grid-0%-#27490%grid-0%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=104f4bc0-8387-42e3-9369-3a2ae7e62001, rmtAddr=/127.0.0.1:48637] [21:15:44] : [Step 4/5] [2021-11-19 21:15:44,953][INFO ][tcp-disco-srvr-[:47501]-#1443%grid-1%-#27489%grid-1%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=45817] [21:15:44] : [Step 4/5] [2021-11-19 21:15:44,953][INFO ][tcp-disco-srvr-[:47501]-#1443%grid-1%-#27489%grid-1%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=45817] [21:15:44] : [Step 4/5] [2021-11-19 21:15:44,956][INFO ][tcp-disco-sock-reader-[]-#1445%grid-1%-#27491%grid-1%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:45817, rmtPort=45817] [21:15:44] : [Step 4/5] [2021-11-19 21:15:44,957][INFO ][tcp-disco-sock-reader-[]-#1445%grid-1%-#27491%grid-1%][TestTcpDiscoverySpi] Received ping request from the remote node [rmtNodeId=00a6fc03-d771-41c5-a569-486fa9959000, rmtAddr=/127.0.0.1:45817, rmtPort=45817] [21:15:44] : [Step 4/5] [2021-11-19 21:15:44,958][INFO ][tcp-disco-sock-reader-[]-#1445%grid-1%-#27491%grid-1%][TestTcpDiscoverySpi] Finished writing ping response [rmtNodeId=00a6fc03-d771-41c5-a569-486fa9959000, rmtAddr=/127.0.0.1:45817, rmtPort=45817] [21:15:44] : [Step 4/5] [2021-11-19 21:15:44,959][INFO ][tcp-disco-sock-reader-[]-#1445%grid-1%-#27491%grid-1%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:45817, rmtPort=45817, rmtNodeId=null] [21:15:44] : [Step 4/5] [2021-11-19 21:15:44,959][INFO ][tcp-disco-sock-reader-[104f4bc0 127.0.0.1:48637]-#1444%grid-0%-#27490%grid-0%][TestTcpDiscoverySpi] Finished serving remote node connection [rmtAddr=/127.0.0.1:48637, rmtPort=48637, rmtNodeId=104f4bc0-8387-42e3-9369-3a2ae7e62001] [21:15:44] : [Step 4/5] [2021-11-19 21:15:44,977][INFO ][tcp-disco-msg-worker-[crd]-#1437%grid-0%-#27368%grid-0%][TestTcpDiscoverySpi] New next node [newNext=TcpDiscoveryNode [id=104f4bc0-8387-42e3-9369-3a2ae7e62001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=0, intOrder=2, lastExchangeTime=1637345744949, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false]] [21:15:44] : [Step 4/5] [2021-11-19 21:15:44,978][INFO ][tcp-disco-srvr-[:47501]-#1443%grid-1%-#27489%grid-1%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=52199] [21:15:44] : [Step 4/5] [2021-11-19 21:15:44,979][INFO ][tcp-disco-srvr-[:47501]-#1443%grid-1%-#27489%grid-1%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=52199] [21:15:44] : [Step 4/5] [2021-11-19 21:15:44,984][INFO ][tcp-disco-sock-reader-[]-#1446%grid-1%-#27492%grid-1%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:52199, rmtPort=52199] [21:15:44] : [Step 4/5] [2021-11-19 21:15:44,985][INFO ][tcp-disco-sock-reader-[00a6fc03 127.0.0.1:52199]-#1446%grid-1%-#27492%grid-1%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=00a6fc03-d771-41c5-a569-486fa9959000, rmtAddr=/127.0.0.1:52199] [21:15:44] : [Step 4/5] [2021-11-19 21:15:44,990][INFO ][tcp-disco-msg-worker-[]-#1442%grid-1%-#27488%grid-1%][TestTcpDiscoverySpi] New next node [newNext=TcpDiscoveryNode [id=00a6fc03-d771-41c5-a569-486fa9959000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345744979, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false]] [21:15:44] : [Step 4/5] [2021-11-19 21:15:44,991][INFO ][tcp-disco-srvr-[:47500]-#1438%grid-0%-#27369%grid-0%][TestTcpDiscoverySpi] TCP discovery accepted incoming connection [rmtAddr=/127.0.0.1, rmtPort=52471] [21:15:44] : [Step 4/5] [2021-11-19 21:15:44,991][INFO ][tcp-disco-srvr-[:47500]-#1438%grid-0%-#27369%grid-0%][TestTcpDiscoverySpi] TCP discovery spawning a new thread for connection [rmtAddr=/127.0.0.1, rmtPort=52471] [21:15:44] : [Step 4/5] [2021-11-19 21:15:44,992][INFO ][tcp-disco-sock-reader-[]-#1447%grid-0%-#27493%grid-0%][TestTcpDiscoverySpi] Started serving remote node connection [rmtAddr=/127.0.0.1:52471, rmtPort=52471] [21:15:44] : [Step 4/5] [2021-11-19 21:15:44,993][INFO ][tcp-disco-sock-reader-[104f4bc0 127.0.0.1:52471]-#1447%grid-0%-#27493%grid-0%][TestTcpDiscoverySpi] Initialized connection with remote server node [nodeId=104f4bc0-8387-42e3-9369-3a2ae7e62001, rmtAddr=/127.0.0.1:52471] [21:15:44] : [Step 4/5] [2021-11-19 21:15:44,995][INFO ][disco-event-worker-#27371%grid-0%][GridDiscoveryManager] Added new node to topology: TcpDiscoveryNode [id=104f4bc0-8387-42e3-9369-3a2ae7e62001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637345744949, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false] [21:15:44] : [Step 4/5] [2021-11-19 21:15:44,996][INFO ][disco-event-worker-#27371%grid-0%][GridDiscoveryManager] Topology snapshot [ver=2, locNode=00a6fc03, servers=2, clients=0, state=INACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=00a6fc03-d771-41c5-a569-486fa9959000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=104f4bc0-8387-42e3-9369-3a2ae7e62001, consistentId=grid-1, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:15:44] : [Step 4/5] [2021-11-19 21:15:44,997][INFO ][disco-event-worker-#27371%grid-0%][GridDiscoveryManager] ^-- Baseline [id=0, size=2, online=2, offline=0] [21:15:44] : [Step 4/5] [2021-11-19 21:15:44,997][INFO ][disco-event-worker-#27371%grid-0%][GridDiscoveryManager] ^-- All baseline nodes are online, will start auto-activation [21:15:45] : [Step 4/5] [2021-11-19 21:15:45,002][INFO ][tcp-disco-msg-worker-[00a6fc03 127.0.0.1:47500]-#1442%grid-1%-#27488%grid-1%][GridEncryptionManager] Store group key received from coordinator [grp=1613773252, keyId=0] [21:15:45] : [Step 4/5] [2021-11-19 21:15:45,004][INFO ][disco-notifier-worker-#27487%grid-1%][MvccProcessorImpl] Assigned mvcc coordinator [crd=MvccCoordinator [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=0], nodeId=00a6fc03-d771-41c5-a569-486fa9959000, ver=1637345744250, local=false, initialized=false]] [21:15:45] : [Step 4/5] [2021-11-19 21:15:45,005][INFO ][disco-notifier-worker-#27487%grid-1%][GridClusterStateProcessor] Sending activate cluster request with BaselineTopology BaselineTopology [id=0, branchingHash=-2475315501, branchingType='Cluster activation', baselineNodes=[grid-1, grid-0]] [21:15:45] : [Step 4/5] [2021-11-19 21:15:45,008][INFO ][sys-#27466%grid-1%][ClusterProcessor] Writing cluster ID and tag to metastorage on ready for write ClusterIdAndTag [id=36dc15e9-5b3a-4d7b-9471-faac5f61178d, tag=angry_villani] [21:15:45] : [Step 4/5] [2021-11-19 21:15:45,011][INFO ][disco-notifier-worker-#27367%grid-0%][GridClusterStateProcessor] Received activate cluster request with BaselineTopology[id=0] initiator node ID: 104f4bc0-8387-42e3-9369-3a2ae7e62001 [21:15:45] : [Step 4/5] [2021-11-19 21:15:45,011][INFO ][disco-notifier-worker-#27367%grid-0%][GridClusterStateProcessor] Started state transition: activate cluster [21:15:45] : [Step 4/5] [2021-11-19 21:15:45,011][INFO ][exchange-worker-#27372%grid-0%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], crd=true, evt=DISCOVERY_CUSTOM_EVT, evtNode=104f4bc0-8387-42e3-9369-3a2ae7e62001, customEvt=ChangeGlobalStateMessage [id=8f04e593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqId=63cbd5a0-eff0-4a44-8d2c-252524321347, initiatingNodeId=104f4bc0-8387-42e3-9369-3a2ae7e62001, state=ACTIVE, baselineTopology=BaselineTopology [id=0, branchingHash=-2475315501, branchingType='Cluster activation', baselineNodes=[grid-1, grid-0]], forceChangeBaselineTopology=false, timestamp=1637345745005, forceDeactivation=true], allowMerge=false, exchangeFreeSwitch=false] [21:15:45] : [Step 4/5] [2021-11-19 21:15:45,012][INFO ][disco-notifier-worker-#27487%grid-1%][GridClusterStateProcessor] Received activate cluster request with BaselineTopology[id=0] initiator node ID: 104f4bc0-8387-42e3-9369-3a2ae7e62001 [21:15:45] : [Step 4/5] [2021-11-19 21:15:45,013][INFO ][exchange-worker-#27372%grid-0%][GridDhtPartitionsExchangeFuture] Start activation process [nodeId=00a6fc03-d771-41c5-a569-486fa9959000, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]]. New state: ACTIVE [21:15:45] : [Step 4/5] [2021-11-19 21:15:45,013][INFO ][disco-notifier-worker-#27487%grid-1%][GridClusterStateProcessor] Started state transition: activate cluster [21:15:45] : [Step 4/5] [2021-11-19 21:15:45,014][INFO ][exchange-worker-#27372%grid-0%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_0 [21:15:45] : [Step 4/5] [2021-11-19 21:15:45,017][INFO ][exchange-worker-#27372%grid-0%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_0/0000000000000000.wal, offset=262976, ver=2] [21:15:45] : [Step 4/5] [2021-11-19 21:15:45,019][INFO ][exchange-worker-#27372%grid-0%][GridClusterStateProcessor] Writing BaselineTopology[id=0] [21:15:45] : [Step 4/5] [2021-11-19 21:15:45,021][INFO ][exchange-worker-#27372%grid-0%][GridCacheDatabaseSharedManager] Finish recovery performed in 6 ms. [21:15:45] : [Step 4/5] [2021-11-19 21:15:45,022][INFO ][exchange-worker-#27372%grid-0%][msg] Components activation performed in 8 ms. [21:15:45] : [Step 4/5] [2021-11-19 21:15:45,024][INFO ][exchange-worker-#27372%grid-0%][GridCacheProcessor] Finished recovery for cache [cache=ignite-sys-cache, grp=ignite-sys-cache, startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:15:45] : [Step 4/5] [2021-11-19 21:15:45,024][INFO ][sys-#27349%grid-0%][GridCacheProcessor] Finished recovery for cache [cache=encrypted, grp=encrypted, startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:15:45] : [Step 4/5] [2021-11-19 21:15:45,024][INFO ][exchange-worker-#27500%grid-1%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], crd=false, evt=DISCOVERY_CUSTOM_EVT, evtNode=104f4bc0-8387-42e3-9369-3a2ae7e62001, customEvt=ChangeGlobalStateMessage [id=8f04e593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, reqId=63cbd5a0-eff0-4a44-8d2c-252524321347, initiatingNodeId=104f4bc0-8387-42e3-9369-3a2ae7e62001, state=ACTIVE, baselineTopology=BaselineTopology [id=0, branchingHash=-2475315501, branchingType='Cluster activation', baselineNodes=[grid-1, grid-0]], forceChangeBaselineTopology=false, timestamp=1637345745005, forceDeactivation=true], allowMerge=false, exchangeFreeSwitch=false] [21:15:45] : [Step 4/5] [2021-11-19 21:15:45,025][INFO ][exchange-worker-#27372%grid-0%][GridDhtPartitionsExchangeFuture] Successfully activated caches [nodeId=00a6fc03-d771-41c5-a569-486fa9959000, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], newState=ACTIVE] [21:15:45] : [Step 4/5] [2021-11-19 21:15:45,026][INFO ][exchange-worker-#27500%grid-1%][GridDhtPartitionsExchangeFuture] Start activation process [nodeId=104f4bc0-8387-42e3-9369-3a2ae7e62001, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]]. New state: ACTIVE [21:15:45] : [Step 4/5] [2021-11-19 21:15:45,027][INFO ][exchange-worker-#27372%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:15:45] : [Step 4/5] [2021-11-19 21:15:45,027][INFO ][exchange-worker-#27500%grid-1%][FilePageStoreManager] Resolved page store work directory: /opt/buildagent/work/7bc1c54bc719b67c/work/db/grid_1 [21:15:45] : [Step 4/5] [2021-11-19 21:15:45,040][INFO ][exchange-worker-#27500%grid-1%][FileWriteAheadLogManager] Resuming logging to WAL segment [file=/opt/buildagent/work/7bc1c54bc719b67c/work/db/wal/grid_1/0000000000000000.wal, offset=231578, ver=2] [21:15:45] : [Step 4/5] [2021-11-19 21:15:45,040][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] To start Console Management & Monitoring run ignitevisorcmd.{sh|bat} [21:15:45] : [Step 4/5] [2021-11-19 21:15:45,046][INFO ][exchange-worker-#27500%grid-1%][GridClusterStateProcessor] Writing BaselineTopology[id=0] [21:15:45] : [Step 4/5] [2021-11-19 21:15:45,047][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][IgniteKernal%grid-1] [21:15:45] : [Step 4/5] [21:15:45] : [Step 4/5] >>> +-------------------------------------------+ [21:15:45] : [Step 4/5] >>> Ignite ver. 2.13.0-SNAPSHOT#20211119-sha1:DEV [21:15:45] : [Step 4/5] >>> +-------------------------------------------+ [21:15:45] : [Step 4/5] >>> OS name: Linux 4.15.0-151-generic amd64 [21:15:45] : [Step 4/5] >>> CPU(s): 24 [21:15:45] : [Step 4/5] >>> Heap: 2.0GB [21:15:45] : [Step 4/5] >>> VM name: 16724@c4dfe9a430b2 [21:15:45] : [Step 4/5] >>> Ignite instance name: grid-1 [21:15:45] : [Step 4/5] >>> Local node [ID=104F4BC0-8387-42E3-9369-3A2AE7E62001, order=2, clientMode=false] [21:15:45] : [Step 4/5] >>> Local node addresses: [127.0.0.1] [21:15:45] : [Step 4/5] >>> Local ports: TCP:10801 TCP:47101 TCP:47501 [21:15:45] : [Step 4/5] [21:15:45] : [Step 4/5] [2021-11-19 21:15:45,047][INFO ][exchange-worker-#27372%grid-0%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], crd=true] [21:15:45] : [Step 4/5] [2021-11-19 21:15:45,048][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][GridDiscoveryManager] Topology snapshot [ver=2, locNode=104f4bc0, servers=2, clients=0, state=INACTIVE, CPUs=24, offheap=0.1GB, heap=2.0GB, aliveNodes=[TcpDiscoveryNode [id=00a6fc03-d771-41c5-a569-486fa9959000, consistentId=grid-0, isClient=false, ver=2.13.0#20211119-sha1:00000000], TcpDiscoveryNode [id=104f4bc0-8387-42e3-9369-3a2ae7e62001, consistentId=grid-1, isClient=false, ver=2.13.0#20211119-sha1:00000000]]] [21:15:45] : [Step 4/5] [2021-11-19 21:15:45,049][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][GridDiscoveryManager] ^-- Baseline [id=0, size=2, online=2, offline=0] [21:15:45] : [Step 4/5] [2021-11-19 21:15:45,049][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][GridDiscoveryManager] ^-- All baseline nodes are online, will start auto-activation [21:15:45] : [Step 4/5] [2021-11-19 21:15:45,050][INFO ][exchange-worker-#27500%grid-1%][GridCacheDatabaseSharedManager] Finish recovery performed in 22 ms. [21:15:45] : [Step 4/5] [2021-11-19 21:15:45,050][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][G] Node started : [stage="Configure system pool" (0 ms),stage="Start managers" (219 ms),stage="Configure binary metadata" (2 ms),stage="Start processors" (91 ms),stage="Start 'StanByClusterTestProvider' plugin" (0 ms),stage="Start 'PageMemory tracker plugin' plugin" (0 ms),stage="Start 'TestDistibutedConfigurationPlugin' plugin" (0 ms),stage="Start 'NodeValidationPluginProvider' plugin" (0 ms),stage="Init metastore" (74 ms),stage="Init and start regions" (8 ms),stage="Restore binary memory" (27 ms),stage="Restore logical state" (26 ms),stage="Finish recovery" (142 ms),stage="Join topology" (70 ms),stage="Await transition" (5 ms),stage="Await exchange" (40 ms),stage="Total time" (704 ms)] [21:15:45] : [Step 4/5] [2021-11-19 21:15:45,051][INFO ][exchange-worker-#27500%grid-1%][msg] Components activation performed in 24 ms. [21:15:45] : [Step 4/5] [2021-11-19 21:15:45,052][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][root] Node started with the following configuration [id=104f4bc0-8387-42e3-9369-3a2ae7e62001, marshaller=BinaryMarshaller [], discovery=TcpDiscoverySpi [addrRslvr=null, addressFilter=null, sockTimeout=5000, ackTimeout=5000, marsh=JdkMarshaller [clsFilter=org.apache.ignite.marshaller.MarshallerUtils$1@1749fdc8], reconCnt=10, reconDelay=2000, maxAckTimeout=600000, soLinger=0, forceSrvMode=false, clientReconnectDisabled=false, internalLsnr=null, skipAddrsRandomization=false], binaryCfg=null, lateAff=true] [21:15:45] : [Step 4/5] [2021-11-19 21:15:45,054][INFO ][sys-#27468%grid-1%][GridCacheProcessor] Finished recovery for cache [cache=ignite-sys-cache, grp=ignite-sys-cache, startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:15:45] : [Step 4/5] [2021-11-19 21:15:45,054][INFO ][exchange-worker-#27500%grid-1%][GridCacheProcessor] Finished recovery for cache [cache=encrypted, grp=encrypted, startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:15:45] : [Step 4/5] [2021-11-19 21:15:45,055][INFO ][exchange-worker-#27500%grid-1%][GridDhtPartitionsExchangeFuture] Successfully activated caches [nodeId=104f4bc0-8387-42e3-9369-3a2ae7e62001, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], newState=ACTIVE] [21:15:45] : [Step 4/5] [2021-11-19 21:15:45,056][INFO ][exchange-worker-#27500%grid-1%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:15:45] : [Step 4/5] [2021-11-19 21:15:45,065][INFO ][grid-nio-worker-tcp-comm-0-#27309%TestRecordingCommunicationSpi%][TestRecordingCommunicationSpi] Accepted incoming communication connection [locAddr=/127.0.0.1:47100, rmtAddr=/127.0.0.1:35834] [21:15:45] : [Step 4/5] [2021-11-19 21:15:45,067][INFO ][grid-nio-worker-tcp-comm-0-#27429%TestRecordingCommunicationSpi%][TestRecordingCommunicationSpi] Established outgoing communication connection [locAddr=/127.0.0.1:35834, rmtAddr=/127.0.0.1:47100] [21:15:45] : [Step 4/5] [2021-11-19 21:15:45,067][INFO ][exchange-worker-#27500%grid-1%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], crd=false] [21:15:45] : [Step 4/5] [2021-11-19 21:15:45,069][INFO ][sys-#27356%grid-0%][GridDhtPartitionsExchangeFuture] Coordinator received single message [ver=AffinityTopologyVersion [topVer=2, minorTopVer=1], node=104f4bc0-8387-42e3-9369-3a2ae7e62001, allReceived=true] [21:15:45] : [Step 4/5] [2021-11-19 21:15:45,069][INFO ][sys-#27356%grid-0%][GridDhtPartitionsExchangeFuture] finishExchangeOnCoordinator [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:15:45] : [Step 4/5] [2021-11-19 21:15:45,076][INFO ][sys-#27356%grid-0%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], err=null, rebalanced=false, wasRebalanced=false] [21:15:45] : [Step 4/5] [2021-11-19 21:15:45,076][INFO ][disco-notifier-worker-#27487%grid-1%][GridClusterStateProcessor] Received state change finish message: ACTIVE [21:15:45] : [Step 4/5] [2021-11-19 21:15:45,076][INFO ][disco-notifier-worker-#27367%grid-0%][GridClusterStateProcessor] Received state change finish message: ACTIVE [21:15:45] : [Step 4/5] [2021-11-19 21:15:45,077][INFO ][disco-notifier-worker-#27487%grid-1%][GridClusterStateProcessor] Cluster state was changed from INACTIVE to ACTIVE [21:15:45] : [Step 4/5] [2021-11-19 21:15:45,078][INFO ][disco-notifier-worker-#27367%grid-0%][GridClusterStateProcessor] Cluster state was changed from INACTIVE to ACTIVE [21:15:45] : [Step 4/5] [2021-11-19 21:15:45,079][INFO ][sys-#27476%grid-1%][GridCachePartitionExchangeManager] Delay process full message without exchange id (there is exchange in progress) [nodeId=00a6fc03-d771-41c5-a569-486fa9959000] [21:15:45] : [Step 4/5] [2021-11-19 21:15:45,081][INFO ][sys-#27477%grid-1%][GridDhtPartitionsExchangeFuture] Received full message, will finish exchange [node=00a6fc03-d771-41c5-a569-486fa9959000, resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:15:45] : [Step 4/5] [2021-11-19 21:15:45,082][INFO ][sys-#27356%grid-0%][CacheGroupContext] Local state for group durability has changed [name=encrypted, enabled=false] [21:15:45] : [Step 4/5] [2021-11-19 21:15:45,082][INFO ][sys-#27356%grid-0%][CacheGroupContext] Local state for group durability has been logged to WAL [name=encrypted, enabled=false] [21:15:45] : [Step 4/5] [2021-11-19 21:15:45,084][INFO ][sys-#27477%grid-1%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], err=null, rebalanced=false, wasRebalanced=false] [21:15:45] : [Step 4/5] [2021-11-19 21:15:45,084][INFO ][sys-#27356%grid-0%][GridCacheProcessor] Finish proxy initialization, cacheName=ignite-sys-cache, localNodeId=00a6fc03-d771-41c5-a569-486fa9959000 [21:15:45] : [Step 4/5] [2021-11-19 21:15:45,084][INFO ][sys-#27356%grid-0%][GridCacheProcessor] Finish proxy initialization, cacheName=encrypted, localNodeId=00a6fc03-d771-41c5-a569-486fa9959000 [21:15:45] : [Step 4/5] [2021-11-19 21:15:45,085][INFO ][sys-#27354%grid-0%][DistributedBaselineConfiguration] Baseline auto-adjust is 'disabled' with timeout='300000' ms [21:15:45] : [Step 4/5] [2021-11-19 21:15:45,086][INFO ][sys-#27477%grid-1%][GridCacheProcessor] Finish proxy initialization, cacheName=ignite-sys-cache, localNodeId=104f4bc0-8387-42e3-9369-3a2ae7e62001 [21:15:45] : [Step 4/5] [2021-11-19 21:15:45,086][INFO ][sys-#27356%grid-0%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=00a6fc03-d771-41c5-a569-486fa9959000, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=104f4bc0-8387-42e3-9369-3a2ae7e62001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637345744949, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=false, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:15:45] : [Step 4/5] [2021-11-19 21:15:45,087][INFO ][sys-#27477%grid-1%][GridCacheProcessor] Finish proxy initialization, cacheName=encrypted, localNodeId=104f4bc0-8387-42e3-9369-3a2ae7e62001 [21:15:45] : [Step 4/5] [2021-11-19 21:15:45,087][INFO ][exchange-worker-#27372%grid-0%][GridCachePartitionExchangeManager] Rebalancing scheduled [order=[ignite-sys-cache, encrypted], top=AffinityTopologyVersion [topVer=2, minorTopVer=1], rebalanceId=1, evt=DISCOVERY_CUSTOM_EVT, node=104f4bc0-8387-42e3-9369-3a2ae7e62001] [21:15:45] : [Step 4/5] [2021-11-19 21:15:45,090][INFO ][exchange-worker-#27372%grid-0%][GridDhtPartitionDemander] Prepared rebalancing [grp=encrypted, mode=ASYNC, supplier=104f4bc0-8387-42e3-9369-3a2ae7e62001, partitionsCount=8, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], rebalanceId=1] [21:15:45] : [Step 4/5] [2021-11-19 21:15:45,090][INFO ][exchange-worker-#27500%grid-1%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=2, minorTopVer=1], force=false, evt=DISCOVERY_CUSTOM_EVT, node=104f4bc0-8387-42e3-9369-3a2ae7e62001] [21:15:45] : [Step 4/5] [2021-11-19 21:15:45,086][INFO ][sys-#27354%grid-0%][GridClusterStateProcessor] Successfully performed final activation steps [nodeId=00a6fc03-d771-41c5-a569-486fa9959000, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:15:45] : [Step 4/5] [2021-11-19 21:15:45,090][INFO ][sys-#27477%grid-1%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=104f4bc0-8387-42e3-9369-3a2ae7e62001, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=104f4bc0-8387-42e3-9369-3a2ae7e62001, consistentId=grid-1, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47501], discPort=47501, order=2, intOrder=2, lastExchangeTime=1637345745075, loc=true, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=false, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:15:45] : [Step 4/5] [2021-11-19 21:15:45,090][INFO ][sys-#27467%grid-1%][DistributedBaselineConfiguration] Baseline auto-adjust is 'disabled' with timeout='300000' ms [21:15:45] : [Step 4/5] [2021-11-19 21:15:45,088][INFO ][sys-#27356%grid-0%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (1 ms), stage="Update caches registry" (10 ms), stage="Start caches" (1 ms), stage="Affinity initialization on cache group start" (0 ms), stage="Determine exchange type" (1 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Restore partition states" (0 ms), stage="After states restored callback" (19 ms), stage="WAL history reservation" (0 ms), stage="Waiting for all single messages" (22 ms), stage="Affinity recalculation (crd)" (0 ms), stage="Collect update counters and create affinity messages" (0 ms), stage="Assign partitions states" (0 ms), stage="Validate partitions states" (0 ms), stage="Ideal affinity diff calculation (enforced)" (0 ms), stage="Apply update counters" (0 ms), stage="Full message preparing" (2 ms), stage="Full message sending" (0 ms), stage="State finish message sending" (0 ms), stage="Detect lost partitions" (3 ms), stage="Exchange done" (9 ms), stage="Total time" (68 ms), Discovery lag=3 ms, Latest started node id=104f4bc0-8387-42e3-9369-3a2ae7e62001] [21:15:45] : [Step 4/5] [2021-11-19 21:15:45,093][INFO ][sys-#27467%grid-1%][GridClusterStateProcessor] Successfully performed final activation steps [nodeId=104f4bc0-8387-42e3-9369-3a2ae7e62001, client=false, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:15:45] : [Step 4/5] [2021-11-19 21:15:45,093][INFO ][sys-#27477%grid-1%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], stage="Waiting in exchange queue" (9 ms), stage="Exchange parameters initialization" (2 ms), stage="Update caches registry" (27 ms), stage="Start caches" (1 ms), stage="Affinity initialization on cache group start" (0 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Restore partition states" (0 ms), stage="After states restored callback" (5 ms), stage="WAL history reservation" (0 ms), stage="Waiting for Full message" (19 ms), stage="Affinity recalculation" (0 ms), stage="Full map updating" (1 ms), stage="Detect lost partitions" (1 ms), stage="Exchange done" (7 ms), stage="Total time" (72 ms)] [21:15:45] : [Step 4/5] [2021-11-19 21:15:45,096][INFO ][exchange-worker-#27372%grid-0%][PartitionsEvictManager] Eviction in progress [groups=1, remainingPartsToEvict=0] [21:15:45] : [Step 4/5] [2021-11-19 21:15:45,099][INFO ][exchange-worker-#27372%grid-0%][PartitionsEvictManager] Group eviction in progress [grpName=encrypted, grpId=1613773252, remainingPartsToEvict=1, partsEvictInProgress=0, totalParts=8] [21:15:45] : [Step 4/5] [2021-11-19 21:15:45,099][INFO ][exchange-worker-#27372%grid-0%][PartitionsEvictManager] Partitions have been scheduled for eviction: [grpId=1613773252, grpName=encrypted, clearing=[0]] [21:15:45] : [Step 4/5] [2021-11-19 21:15:45,096][INFO ][sys-#27356%grid-0%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], stage="Affinity initialization on cache group start [grp=ignite-sys-cache]" (0 ms) (parent=Affinity initialization on cache group start), stage="Affinity initialization on cache group start [grp=encrypted]" (0 ms) (parent=Affinity initialization on cache group start), stage="Affinity centralized initialization (crd) [grp=ignite-sys-cache, crd=true]" (1 ms) (parent=Determine exchange type), stage="Affinity centralized initialization (crd) [grp=encrypted, crd=true]" (1 ms) (parent=Determine exchange type), stage="Restore partition states [grp=ignite-sys-cache]" (0 ms) (parent=Restore partition states), stage="Restore partition states [grp=encrypted]" (0 ms) (parent=Restore partition states), stage="Affinity recalculation (partitions availability) [grp=ignite-sys-cache]" (0 ms) (parent=Ideal affinity diff calculation (enforced)), stage="Affinity recalculation (partitions availability) [grp=encrypted]" (0 ms) (parent=Ideal affinity diff calculation (enforced))] [21:15:45] : [Step 4/5] [2021-11-19 21:15:45,098][INFO ][sys-#27477%grid-1%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], stage="Affinity initialization on cache group start [grp=ignite-sys-cache]" (0 ms) (parent=Affinity initialization on cache group start), stage="Affinity initialization on cache group start [grp=encrypted]" (0 ms) (parent=Affinity initialization on cache group start), stage="Affinity centralized initialization (crd) [grp=ignite-sys-cache, crd=false]" (0 ms) (parent=Determine exchange type), stage="Affinity centralized initialization (crd) [grp=encrypted, crd=false]" (0 ms) (parent=Determine exchange type), stage="Restore partition states [grp=ignite-sys-cache]" (0 ms) (parent=Restore partition states), stage="Restore partition states [grp=encrypted]" (0 ms) (parent=Restore partition states), stage="Affinity applying from full message [grp=ignite-sys-cache]" (0 ms) (parent=Affinity recalculation), stage="Affinity applying from full message [grp=encrypted]" (0 ms) (parent=Affinity recalculation)] [21:15:45] : [Step 4/5] [2021-11-19 21:15:45,111][INFO ][reencrypt-#27522%grid-1%][CacheGroupPageScanner] Scheduled reencryption [grp=encrypted] [21:15:45] : [Step 4/5] [2021-11-19 21:15:45,121][INFO ][sys-#27357%grid-0%][GridDhtPartitionDemander] Starting rebalance routine [encrypted, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], supplier=104f4bc0-8387-42e3-9369-3a2ae7e62001, fullPartitions=[0-7], histPartitions=[], rebalanceId=1] [21:15:45]W: [org.apache.ignite:ignite-core] [2021-11-19 21:15:45,134][ERROR][rebalance-striped-#27523%grid-1%][IgniteTestResources] Critical system error detected. Will be handled accordingly to configured handler [hnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]], failureCtx=FailureContext [type=CRITICAL_ERROR, err=class o.a.i.i.processors.cache.persistence.tree.CorruptedTreeException: B+Tree is corrupted [groupId=1613773252, pageIds=[], msg=Runtime failure on bounds: [lower=null, upper=null]]]] [21:15:45]W: [org.apache.ignite:ignite-core] class org.apache.ignite.internal.processors.cache.persistence.tree.CorruptedTreeException: B+Tree is corrupted [groupId=1613773252, pageIds=[], msg=Runtime failure on bounds: [lower=null, upper=null]] [21:15:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.BPlusTree.corruptedTreeException(BPlusTree.java:6162) [21:15:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.BPlusTree.find(BPlusTree.java:1124) [21:15:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.tree.CacheDataTree.find(CacheDataTree.java:168) [21:15:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.tree.CacheDataTree.find(CacheDataTree.java:63) [21:15:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.BPlusTree.find(BPlusTree.java:1088) [21:15:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.IgniteCacheOffheapManagerImpl$CacheDataStoreImpl.cursor(IgniteCacheOffheapManagerImpl.java:2897) [21:15:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager$GridCacheDataStore.cursor(GridCacheOffheapManager.java:2890) [21:15:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.IgniteCacheOffheapManagerImpl$6.onHasNext(IgniteCacheOffheapManagerImpl.java:1161) [21:15:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.GridCloseableIteratorAdapter.hasNextX(GridCloseableIteratorAdapter.java:56) [21:15:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.distributed.dht.preloader.IgniteRebalanceIteratorImpl.advance(IgniteRebalanceIteratorImpl.java:81) [21:15:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.distributed.dht.preloader.IgniteRebalanceIteratorImpl.nextX(IgniteRebalanceIteratorImpl.java:144) [21:15:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.distributed.dht.preloader.IgniteRebalanceIteratorImpl.next(IgniteRebalanceIteratorImpl.java:215) [21:15:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.distributed.dht.preloader.IgniteRebalanceIteratorImpl.peek(IgniteRebalanceIteratorImpl.java:155) [21:15:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.distributed.dht.preloader.GridDhtPartitionSupplier.handleDemandMessage(GridDhtPartitionSupplier.java:330) [21:15:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.distributed.dht.preloader.GridDhtPreloader.lambda$handleDemandMessage$1(GridDhtPreloader.java:361) [21:15:45]W: [org.apache.ignite:ignite-core] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [21:15:45]W: [org.apache.ignite:ignite-core] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [21:15:45]W: [org.apache.ignite:ignite-core] at java.lang.Thread.run(Thread.java:748) [21:15:45]W: [org.apache.ignite:ignite-core] Caused by: org.apache.ignite.internal.processors.cache.persistence.tree.BPlusTreeRuntimeException: java.lang.IllegalMonitorStateException: Attempted to release a read lock while not holding it [lock=0000557bc43771f8, state=000000000001ffff] [21:15:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.BPlusTree.findLowerUnbounded(BPlusTree.java:1067) [21:15:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.BPlusTree.find(BPlusTree.java:1106) [21:15:45]W: [org.apache.ignite:ignite-core] ... 16 more [21:15:45]W: [org.apache.ignite:ignite-core] Caused by: java.lang.IllegalMonitorStateException: Attempted to release a read lock while not holding it [lock=0000557bc43771f8, state=000000000001ffff] [21:15:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.OffheapReadWriteLock.readUnlock(OffheapReadWriteLock.java:172) [21:15:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.pagemem.PageMemoryImpl.readUnlockPage(PageMemoryImpl.java:1592) [21:15:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.pagemem.PageMemoryImpl.readUnlock(PageMemoryImpl.java:490) [21:15:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.readUnlock(PageHandler.java:222) [21:15:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.DataStructure.readUnlock(DataStructure.java:265) [21:15:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.BPlusTree.findLowerUnbounded(BPlusTree.java:1059) [21:15:45]W: [org.apache.ignite:ignite-core] ... 17 more [21:15:45]W: [org.apache.ignite:ignite-core] [2021-11-19 21:15:45,144][ERROR][rebalance-striped-#27523%grid-1%][FailureProcessor] A critical problem with persistence data structures was detected. Please make backup of persistence storage and WAL files for further analysis. Persistence storage path: null WAL path: db/wal WAL archive path: db/wal/archive [21:15:45]W: [org.apache.ignite:ignite-core] [2021-11-19 21:15:45,145][ERROR][rebalance-striped-#27523%grid-1%][GridDhtPartitionSupplier] Failed to continue supplying [grp=encrypted, demander=00a6fc03-d771-41c5-a569-486fa9959000, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:15:45]W: [org.apache.ignite:ignite-core] java.lang.AssertionError [21:15:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.diagnostic.pagelocktracker.log.LockLog.toList(LockLog.java:156) [21:15:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.diagnostic.pagelocktracker.log.LockLog.snapshot(LockLog.java:134) [21:15:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.diagnostic.pagelocktracker.log.LockLog.snapshot(LockLog.java:29) [21:15:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.diagnostic.pagelocktracker.PageLockTracker.dump(PageLockTracker.java:355) [21:15:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.diagnostic.pagelocktracker.SharedPageLockTracker.dump(SharedPageLockTracker.java:209) [21:15:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.diagnostic.pagelocktracker.PageLockTrackerManager.dumpLocks(PageLockTrackerManager.java:175) [21:15:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.diagnostic.pagelocktracker.PageLockTrackerManager.dumpLocksToString(PageLockTrackerManager.java:184) [21:15:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.diagnostic.pagelocktracker.PageLockTrackerManager.dumpLocksToLog(PageLockTrackerManager.java:191) [21:15:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.diagnostic.DiagnosticProcessor.onFailure(DiagnosticProcessor.java:96) [21:15:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.failure.FailureProcessor.process(FailureProcessor.java:210) [21:15:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.failure.FailureProcessor.process(FailureProcessor.java:156) [21:15:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.BPlusTree.processFailure(BPlusTree.java:6177) [21:15:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.BPlusTree.corruptedTreeException(BPlusTree.java:6164) [21:15:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.BPlusTree.find(BPlusTree.java:1124) [21:15:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.tree.CacheDataTree.find(CacheDataTree.java:168) [21:15:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.tree.CacheDataTree.find(CacheDataTree.java:63) [21:15:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.BPlusTree.find(BPlusTree.java:1088) [21:15:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.IgniteCacheOffheapManagerImpl$CacheDataStoreImpl.cursor(IgniteCacheOffheapManagerImpl.java:2897) [21:15:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager$GridCacheDataStore.cursor(GridCacheOffheapManager.java:2890) [21:15:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.IgniteCacheOffheapManagerImpl$6.onHasNext(IgniteCacheOffheapManagerImpl.java:1161) [21:15:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.GridCloseableIteratorAdapter.hasNextX(GridCloseableIteratorAdapter.java:56) [21:15:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.distributed.dht.preloader.IgniteRebalanceIteratorImpl.advance(IgniteRebalanceIteratorImpl.java:81) [21:15:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.distributed.dht.preloader.IgniteRebalanceIteratorImpl.nextX(IgniteRebalanceIteratorImpl.java:144) [21:15:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.distributed.dht.preloader.IgniteRebalanceIteratorImpl.next(IgniteRebalanceIteratorImpl.java:215) [21:15:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.distributed.dht.preloader.IgniteRebalanceIteratorImpl.peek(IgniteRebalanceIteratorImpl.java:155) [21:15:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.distributed.dht.preloader.GridDhtPartitionSupplier.handleDemandMessage(GridDhtPartitionSupplier.java:330) [21:15:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.distributed.dht.preloader.GridDhtPreloader.lambda$handleDemandMessage$1(GridDhtPreloader.java:361) [21:15:45]W: [org.apache.ignite:ignite-core] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [21:15:45]W: [org.apache.ignite:ignite-core] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [21:15:45]W: [org.apache.ignite:ignite-core] at java.lang.Thread.run(Thread.java:748) [21:15:45]W: [org.apache.ignite:ignite-core] [2021-11-19 21:15:45,156][ERROR][rebalance-striped-#27523%grid-1%][IgniteTestResources] Critical system error detected. Will be handled accordingly to configured handler [hnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]], failureCtx=FailureContext [type=CRITICAL_ERROR, err=class o.a.i.IgniteCheckedException: Failed to continue supplying [grp=encrypted, demander=00a6fc03-d771-41c5-a569-486fa9959000, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]]]] [21:15:45]W: [org.apache.ignite:ignite-core] class org.apache.ignite.IgniteCheckedException: Failed to continue supplying [grp=encrypted, demander=00a6fc03-d771-41c5-a569-486fa9959000, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1]] [21:15:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.distributed.dht.preloader.GridDhtPartitionSupplier.handleDemandMessage(GridDhtPartitionSupplier.java:528) [21:15:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.distributed.dht.preloader.GridDhtPreloader.lambda$handleDemandMessage$1(GridDhtPreloader.java:361) [21:15:45]W: [org.apache.ignite:ignite-core] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [21:15:45]W: [org.apache.ignite:ignite-core] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [21:15:45]W: [org.apache.ignite:ignite-core] at java.lang.Thread.run(Thread.java:748) [21:15:45]W: [org.apache.ignite:ignite-core] Caused by: java.lang.AssertionError [21:15:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.diagnostic.pagelocktracker.log.LockLog.toList(LockLog.java:156) [21:15:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.diagnostic.pagelocktracker.log.LockLog.snapshot(LockLog.java:134) [21:15:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.diagnostic.pagelocktracker.log.LockLog.snapshot(LockLog.java:29) [21:15:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.diagnostic.pagelocktracker.PageLockTracker.dump(PageLockTracker.java:355) [21:15:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.diagnostic.pagelocktracker.SharedPageLockTracker.dump(SharedPageLockTracker.java:209) [21:15:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.diagnostic.pagelocktracker.PageLockTrackerManager.dumpLocks(PageLockTrackerManager.java:175) [21:15:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.diagnostic.pagelocktracker.PageLockTrackerManager.dumpLocksToString(PageLockTrackerManager.java:184) [21:15:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.diagnostic.pagelocktracker.PageLockTrackerManager.dumpLocksToLog(PageLockTrackerManager.java:191) [21:15:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.diagnostic.DiagnosticProcessor.onFailure(DiagnosticProcessor.java:96) [21:15:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.failure.FailureProcessor.process(FailureProcessor.java:210) [21:15:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.failure.FailureProcessor.process(FailureProcessor.java:156) [21:15:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.BPlusTree.processFailure(BPlusTree.java:6177) [21:15:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.BPlusTree.corruptedTreeException(BPlusTree.java:6164) [21:15:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.BPlusTree.find(BPlusTree.java:1124) [21:15:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.tree.CacheDataTree.find(CacheDataTree.java:168) [21:15:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.tree.CacheDataTree.find(CacheDataTree.java:63) [21:15:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.BPlusTree.find(BPlusTree.java:1088) [21:15:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.IgniteCacheOffheapManagerImpl$CacheDataStoreImpl.cursor(IgniteCacheOffheapManagerImpl.java:2897) [21:15:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager$GridCacheDataStore.cursor(GridCacheOffheapManager.java:2890) [21:15:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.IgniteCacheOffheapManagerImpl$6.onHasNext(IgniteCacheOffheapManagerImpl.java:1161) [21:15:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.GridCloseableIteratorAdapter.hasNextX(GridCloseableIteratorAdapter.java:56) [21:15:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.distributed.dht.preloader.IgniteRebalanceIteratorImpl.advance(IgniteRebalanceIteratorImpl.java:81) [21:15:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.distributed.dht.preloader.IgniteRebalanceIteratorImpl.nextX(IgniteRebalanceIteratorImpl.java:144) [21:15:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.distributed.dht.preloader.IgniteRebalanceIteratorImpl.next(IgniteRebalanceIteratorImpl.java:215) [21:15:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.distributed.dht.preloader.IgniteRebalanceIteratorImpl.peek(IgniteRebalanceIteratorImpl.java:155) [21:15:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.distributed.dht.preloader.GridDhtPartitionSupplier.handleDemandMessage(GridDhtPartitionSupplier.java:330) [21:15:45]W: [org.apache.ignite:ignite-core] ... 4 more [21:15:45] : [Step 4/5] [2021-11-19 21:15:45,160][INFO ][db-checkpoint-thread-#27502%grid-0%][Checkpointer] Checkpoint started [checkpointId=c31bbc27-6e0e-4915-b402-2afca4708821, startPtr=WALPointer [idx=0, fileOff=378640, len=2121], checkpointBeforeLockTime=10ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=1ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=103ms, writeCheckpointEntryDuration=10ms, splitAndSortCpPagesDuration=0ms, pages=102, reason='node started'] [21:15:45] : [Step 4/5] [2021-11-19 21:15:45,160][INFO ][db-checkpoint-thread-#27512%grid-1%][Checkpointer] Checkpoint started [checkpointId=3a5f672d-097c-474b-bd92-587ba3a0520c, startPtr=WALPointer [idx=0, fileOff=379552, len=2121], checkpointBeforeLockTime=5ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=88ms, writeCheckpointEntryDuration=10ms, splitAndSortCpPagesDuration=0ms, pages=29, reason='node started'] [21:15:45] : [Step 4/5] [2021-11-19 21:15:45,158][INFO ][sys-#27358%grid-0%][GridDeploymentLocalStore] Class locally deployed: class [Ljava.lang.StackTraceElement; [21:15:45]W: [org.apache.ignite:ignite-core] [2021-11-19 21:15:45,168][ERROR][rebalance-striped-#27523%grid-1%][IgniteTestResources] Critical system error detected. Will be handled accordingly to configured handler [hnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]], failureCtx=FailureContext [type=CRITICAL_ERROR, err=java.lang.AssertionError]] [21:15:45]W: [org.apache.ignite:ignite-core] java.lang.AssertionError [21:15:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.diagnostic.pagelocktracker.SharedPageLockTracker.dump(SharedPageLockTracker.java:199) [21:15:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.diagnostic.pagelocktracker.PageLockTrackerManager.dumpLocks(PageLockTrackerManager.java:175) [21:15:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.diagnostic.pagelocktracker.PageLockTrackerManager.dumpLocksToString(PageLockTrackerManager.java:184) [21:15:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.diagnostic.pagelocktracker.PageLockTrackerManager.dumpLocksToLog(PageLockTrackerManager.java:191) [21:15:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.diagnostic.DiagnosticProcessor.onFailure(DiagnosticProcessor.java:96) [21:15:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.failure.FailureProcessor.process(FailureProcessor.java:210) [21:15:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.failure.FailureProcessor.process(FailureProcessor.java:156) [21:15:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.distributed.dht.preloader.GridDhtPartitionSupplier.handleDemandMessage(GridDhtPartitionSupplier.java:526) [21:15:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.distributed.dht.preloader.GridDhtPreloader.lambda$handleDemandMessage$1(GridDhtPreloader.java:361) [21:15:45]W: [org.apache.ignite:ignite-core] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [21:15:45]W: [org.apache.ignite:ignite-core] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [21:15:45]W: [org.apache.ignite:ignite-core] at java.lang.Thread.run(Thread.java:748) [21:15:45]W: [org.apache.ignite:ignite-core] [21:15:45]W: [org.apache.ignite:ignite-core] Exception: java.lang.AssertionError thrown from the UncaughtExceptionHandler in thread "rebalance-striped-#27523%grid-1%" [21:15:45]W: [org.apache.ignite:ignite-core] [2021-11-19 21:15:45,181][ERROR][rebalance-#27521%grid-0%][GridDhtPartitionDemander] Rebalancing routine has failed, some partitions could be unavailable for reading [grp=encrypted, rebalanceId=1, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], supplier=104f4bc0-8387-42e3-9369-3a2ae7e62001, unavailablePartitions=[]] [21:15:45]W: [org.apache.ignite:ignite-core] java.lang.AssertionError [21:15:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.diagnostic.pagelocktracker.log.LockLog.toList(LockLog.java:156) [21:15:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.diagnostic.pagelocktracker.log.LockLog.snapshot(LockLog.java:134) [21:15:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.diagnostic.pagelocktracker.log.LockLog.snapshot(LockLog.java:29) [21:15:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.diagnostic.pagelocktracker.PageLockTracker.dump(PageLockTracker.java:355) [21:15:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.diagnostic.pagelocktracker.SharedPageLockTracker.dump(SharedPageLockTracker.java:209) [21:15:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.diagnostic.pagelocktracker.PageLockTrackerManager.dumpLocks(PageLockTrackerManager.java:175) [21:15:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.diagnostic.pagelocktracker.PageLockTrackerManager.dumpLocksToString(PageLockTrackerManager.java:184) [21:15:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.diagnostic.pagelocktracker.PageLockTrackerManager.dumpLocksToLog(PageLockTrackerManager.java:191) [21:15:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.diagnostic.DiagnosticProcessor.onFailure(DiagnosticProcessor.java:96) [21:15:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.failure.FailureProcessor.process(FailureProcessor.java:210) [21:15:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.failure.FailureProcessor.process(FailureProcessor.java:156) [21:15:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.BPlusTree.processFailure(BPlusTree.java:6177) [21:15:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.BPlusTree.corruptedTreeException(BPlusTree.java:6164) [21:15:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.BPlusTree.find(BPlusTree.java:1124) [21:15:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.tree.CacheDataTree.find(CacheDataTree.java:168) [21:15:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.tree.CacheDataTree.find(CacheDataTree.java:63) [21:15:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.tree.BPlusTree.find(BPlusTree.java:1088) [21:15:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.IgniteCacheOffheapManagerImpl$CacheDataStoreImpl.cursor(IgniteCacheOffheapManagerImpl.java:2897) [21:15:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager$GridCacheDataStore.cursor(GridCacheOffheapManager.java:2890) [21:15:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.IgniteCacheOffheapManagerImpl$6.onHasNext(IgniteCacheOffheapManagerImpl.java:1161) [21:15:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.GridCloseableIteratorAdapter.hasNextX(GridCloseableIteratorAdapter.java:56) [21:15:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.distributed.dht.preloader.IgniteRebalanceIteratorImpl.advance(IgniteRebalanceIteratorImpl.java:81) [21:15:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.distributed.dht.preloader.IgniteRebalanceIteratorImpl.nextX(IgniteRebalanceIteratorImpl.java:144) [21:15:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.distributed.dht.preloader.IgniteRebalanceIteratorImpl.next(IgniteRebalanceIteratorImpl.java:215) [21:15:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.distributed.dht.preloader.IgniteRebalanceIteratorImpl.peek(IgniteRebalanceIteratorImpl.java:155) [21:15:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.distributed.dht.preloader.GridDhtPartitionSupplier.handleDemandMessage(GridDhtPartitionSupplier.java:330) [21:15:45]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.distributed.dht.preloader.GridDhtPreloader.lambda$handleDemandMessage$1(GridDhtPreloader.java:361) [21:15:45]W: [org.apache.ignite:ignite-core] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [21:15:45]W: [org.apache.ignite:ignite-core] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [21:15:45]W: [org.apache.ignite:ignite-core] at java.lang.Thread.run(Thread.java:748) [21:15:45] : [Step 4/5] [2021-11-19 21:15:45,221][INFO ][db-checkpoint-thread-#27512%grid-1%][Checkpointer] Checkpoint finished [cpId=3a5f672d-097c-474b-bd92-587ba3a0520c, pages=29, markPos=WALPointer [idx=0, fileOff=379552, len=2121], walSegmentsCovered=[], markDuration=108ms, pagesWrite=21ms, fsync=30ms, total=164ms] [21:15:45] : [Step 4/5] [2021-11-19 21:15:45,264][INFO ][db-checkpoint-thread-#27502%grid-0%][Checkpointer] Checkpoint finished [cpId=c31bbc27-6e0e-4915-b402-2afca4708821, pages=102, markPos=WALPointer [idx=0, fileOff=378640, len=2121], walSegmentsCovered=[], markDuration=123ms, pagesWrite=25ms, fsync=70ms, total=228ms] [21:15:45] : [Step 4/5] [2021-11-19 21:15:45,266][INFO ][db-checkpoint-thread-#27502%grid-0%][CacheGroupContext] Local state for group durability has changed [name=encrypted, enabled=true] [21:15:45] : [Step 4/5] [2021-11-19 21:15:45,280][INFO ][db-checkpoint-thread-#27502%grid-0%][Checkpointer] Checkpoint started [checkpointId=789caead-0700-4d55-b51c-8e880b81e2eb, startPtr=WALPointer [idx=0, fileOff=406471, len=1947], checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=1ms, walCpRecordFsyncDuration=5ms, writeCheckpointEntryDuration=8ms, splitAndSortCpPagesDuration=0ms, pages=46, reason='enable-durability-rebalance-finished-1613773252-AffinityTopologyVersion [topVer=2, minorTopVer=1]'] [21:15:45] : [Step 4/5] [2021-11-19 21:15:45,290][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=104f4bc0-8387-42e3-9369-3a2ae7e62001, grp=1613773252] [21:15:45] : [Step 4/5] [2021-11-19 21:15:45,451][INFO ][db-checkpoint-thread-#27512%grid-1%][Checkpointer] Checkpoint started [checkpointId=7c860a96-0d5a-402b-bf12-a0196414099c, startPtr=WALPointer [idx=0, fileOff=735188, len=2105], checkpointBeforeLockTime=2ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=73ms, writeCheckpointEntryDuration=86ms, splitAndSortCpPagesDuration=0ms, pages=85, reason='test'] [21:15:45] : [Step 4/5] [2021-11-19 21:15:45,521][INFO ][db-checkpoint-thread-#27502%grid-0%][Checkpointer] Checkpoint finished [cpId=789caead-0700-4d55-b51c-8e880b81e2eb, pages=46, markPos=WALPointer [idx=0, fileOff=406471, len=1947], walSegmentsCovered=[], markDuration=15ms, pagesWrite=5ms, fsync=235ms, total=256ms] [21:15:45] : [Step 4/5] [2021-11-19 21:15:45,521][INFO ][exchange-worker-#27372%grid-0%][GridDhtPartitionDemander] Completed rebalance future: RebalanceFuture [state=STARTED, grp=CacheGroupContext [grp=encrypted], topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], rebalanceId=1, routines=1, receivedBytes=0, receivedKeys=0, partitionsLeft=8, partitionsTotal=8, startTime=1637345745090, endTime=1637345745521, lastCancelledTime=-1, result=true] [21:15:45] : [Step 4/5] [2021-11-19 21:15:45,523][INFO ][exchange-worker-#27372%grid-0%][GridDhtPartitionDemander] Completed rebalance chain: [rebalanceId=1, partitions=8, entries=0, duration=433ms, bytesRcvd=0.0 B] [21:15:45] : [Step 4/5] [2021-11-19 21:15:45,523][INFO ][exchange-worker-#27372%grid-0%][CacheGroupContext] Local state for group durability has been logged to WAL [name=encrypted, enabled=true] [21:15:45] : [Step 4/5] [2021-11-19 21:15:45,529][INFO ][exchange-worker-#27372%grid-0%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], crd=true, evt=DISCOVERY_CUSTOM_EVT, evtNode=00a6fc03-d771-41c5-a569-486fa9959000, customEvt=CacheAffinityChangeMessage [id=9414e593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], exchId=null, partsMsg=null, exchangeNeeded=true], allowMerge=false, exchangeFreeSwitch=false] [21:15:45] : [Step 4/5] [2021-11-19 21:15:45,530][INFO ][exchange-worker-#27500%grid-1%][time] Started exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], crd=false, evt=DISCOVERY_CUSTOM_EVT, evtNode=00a6fc03-d771-41c5-a569-486fa9959000, customEvt=CacheAffinityChangeMessage [id=9414e593d71-4f3fd8dd-bad2-4579-bd0c-4d438a1376bf, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=1], exchId=null, partsMsg=null, exchangeNeeded=true], allowMerge=false, exchangeFreeSwitch=false] [21:15:45] : [Step 4/5] [2021-11-19 21:15:45,531][INFO ][exchange-worker-#27372%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], waitTime=0ms, futInfo=NA, mode=DISTRIBUTED] [21:15:45] : [Step 4/5] [2021-11-19 21:15:45,532][INFO ][exchange-worker-#27500%grid-1%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], waitTime=0ms, futInfo=NA, mode=DISTRIBUTED] [21:15:45] : [Step 4/5] [2021-11-19 21:15:45,533][INFO ][exchange-worker-#27372%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partitions release latch: ServerLatch [permits=0, pendingAcks=HashSet [], super=CompletableLatch [id=CompletableLatchUid [id=exchange, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2]]]] [21:15:45] : [Step 4/5] [2021-11-19 21:15:45,533][INFO ][exchange-worker-#27500%grid-1%][GridDhtPartitionsExchangeFuture] Finished waiting for partitions release latch: ClientLatch [coordinator=TcpDiscoveryNode [id=00a6fc03-d771-41c5-a569-486fa9959000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345744979, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], ackSent=true, super=CompletableLatch [id=CompletableLatchUid [id=exchange, topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2]]]] [21:15:45] : [Step 4/5] [2021-11-19 21:15:45,533][INFO ][exchange-worker-#27372%grid-0%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:15:45] : [Step 4/5] [2021-11-19 21:15:45,535][INFO ][exchange-worker-#27500%grid-1%][GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], waitTime=0ms, futInfo=NA, mode=LOCAL] [21:15:45] : [Step 4/5] [2021-11-19 21:15:45,536][INFO ][exchange-worker-#27500%grid-1%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], crd=false] [21:15:45] : [Step 4/5] [2021-11-19 21:15:45,537][INFO ][sys-#27362%grid-0%][GridDhtPartitionsExchangeFuture] Coordinator received single message [ver=AffinityTopologyVersion [topVer=2, minorTopVer=2], node=104f4bc0-8387-42e3-9369-3a2ae7e62001, allReceived=true] [21:15:45] : [Step 4/5] [2021-11-19 21:15:45,538][INFO ][sys-#27362%grid-0%][GridDhtPartitionsExchangeFuture] finishExchangeOnCoordinator [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2]] [21:15:45]W: [org.apache.ignite:ignite-core] [2021-11-19 21:15:45,539][WARN ][sys-#27361%grid-0%][GridDhtPartitionsExchangeFuture] Partition states validation has failed for group: encrypted, msg: Partitions cache sizes are inconsistent for Part 0: [grid-0=0 grid-1=13 ] Part 1: [grid-0=0 grid-1=13 ] Part 2: [grid-0=0 grid-1=13 ] Part 3: [grid-0=0 grid-1=13 ] Part 4: [grid-0=0 grid-1=12 ] Part 5: [grid-0=0 grid-1=12 ] Part 6: [grid-0=0 grid-1=12 ] Part 7: [grid-0=0 grid-1=12 ] [21:15:45] : [Step 4/5] [2021-11-19 21:15:45,535][INFO ][exchange-worker-#27372%grid-0%][time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], crd=true] [21:15:45] : [Step 4/5] [2021-11-19 21:15:45,544][INFO ][sys-#27362%grid-0%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], err=null, rebalanced=true, wasRebalanced=false] [21:15:45] : [Step 4/5] [2021-11-19 21:15:45,545][INFO ][sys-#27362%grid-0%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=00a6fc03-d771-41c5-a569-486fa9959000, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=00a6fc03-d771-41c5-a569-486fa9959000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345745523, loc=true, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2]] [21:15:45] : [Step 4/5] [2021-11-19 21:15:45,545][INFO ][exchange-worker-#27372%grid-0%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=2, minorTopVer=2], force=false, evt=DISCOVERY_CUSTOM_EVT, node=00a6fc03-d771-41c5-a569-486fa9959000] [21:15:45] : [Step 4/5] [2021-11-19 21:15:45,546][INFO ][sys-#27362%grid-0%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (0 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (1 ms), stage="Wait partitions release latch [latch=exchange]" (1 ms), stage="Wait partitions release [latch=exchange]" (1 ms), stage="After states restored callback" (0 ms), stage="WAL history reservation" (0 ms), stage="Waiting for all single messages" (2 ms), stage="Affinity recalculation (crd)" (0 ms), stage="Collect update counters and create affinity messages" (0 ms), stage="Validate partitions states" (2 ms), stage="Apply update counters" (0 ms), stage="Full message preparing" (2 ms), stage="Full message sending" (0 ms), stage="Exchange done" (2 ms), stage="Total time" (11 ms), Discovery lag=1 ms, Latest started node id=104f4bc0-8387-42e3-9369-3a2ae7e62001] [21:15:45] : [Step 4/5] [2021-11-19 21:15:45,547][INFO ][sys-#27464%grid-1%][GridDhtPartitionsExchangeFuture] Received full message, will finish exchange [node=00a6fc03-d771-41c5-a569-486fa9959000, resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2]] [21:15:45] : [Step 4/5] [2021-11-19 21:15:45,551][INFO ][sys-#27464%grid-1%][GridDhtPartitionsExchangeFuture] Finish exchange future [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], err=null, rebalanced=true, wasRebalanced=false] [21:15:45] : [Step 4/5] [2021-11-19 21:15:45,549][INFO ][sys-#27362%grid-0%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], stage="Affinity change by custom message [grp=encrypted]" (0 ms) (parent=Determine exchange type)] [21:15:45] : [Step 4/5] [2021-11-19 21:15:45,552][INFO ][exchange-worker-#27500%grid-1%][GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=2, minorTopVer=2], force=false, evt=DISCOVERY_CUSTOM_EVT, node=00a6fc03-d771-41c5-a569-486fa9959000] [21:15:45] : [Step 4/5] [2021-11-19 21:15:45,552][INFO ][sys-#27464%grid-1%][GridDhtPartitionsExchangeFuture] Completed partition exchange [localNode=104f4bc0-8387-42e3-9369-3a2ae7e62001, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], evt=DISCOVERY_CUSTOM_EVT, evtNode=TcpDiscoveryNode [id=00a6fc03-d771-41c5-a569-486fa9959000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345744979, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=2, minorTopVer=2]] [21:15:45] : [Step 4/5] [2021-11-19 21:15:45,554][INFO ][sys-#27464%grid-1%][GridDhtPartitionsExchangeFuture] Exchange timings [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (1 ms), stage="Determine exchange type" (0 ms), stage="Preloading notification" (0 ms), stage="Wait partitions release [latch=exchange]" (0 ms), stage="Wait partitions release latch [latch=exchange]" (2 ms), stage="Wait partitions release [latch=exchange]" (1 ms), stage="After states restored callback" (0 ms), stage="WAL history reservation" (0 ms), stage="Waiting for Full message" (11 ms), stage="Affinity recalculation" (2 ms), stage="Full map updating" (1 ms), stage="Exchange done" (2 ms), stage="Total time" (20 ms)] [21:15:45] : [Step 4/5] [2021-11-19 21:15:45,555][INFO ][sys-#27464%grid-1%][GridDhtPartitionsExchangeFuture] Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], resVer=AffinityTopologyVersion [topVer=2, minorTopVer=2], stage="Affinity change by custom message [grp=encrypted]" (0 ms) (parent=Determine exchange type)] [21:15:45] : [Step 4/5] [2021-11-19 21:15:45,592][INFO ][db-checkpoint-thread-#27512%grid-1%][CacheGroupPageScanner] Cache group reencryption is finished [grp=encrypted] [21:15:45] : [Step 4/5] [2021-11-19 21:15:45,592][INFO ][db-checkpoint-thread-#27512%grid-1%][Checkpointer] Checkpoint finished [cpId=7c860a96-0d5a-402b-bf12-a0196414099c, pages=85, markPos=WALPointer [idx=0, fileOff=735188, len=2105], walSegmentsCovered=[], markDuration=160ms, pagesWrite=5ms, fsync=135ms, total=302ms] [21:15:45] : [Step 4/5] [2021-11-19 21:15:45,594][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][root] Validating encryption key [node=00a6fc03-d771-41c5-a569-486fa9959000, grp=1613773252] [21:15:45] : [Step 4/5] [2021-11-19 21:15:45,603][INFO ][test-runner-#26980%encryption.CacheGroupKeyChangeTest%][root] Caught expected exception: Cache group key change was rejected. Cannot add new key identifier, it's already present. There existing WAL segments that encrypted with this key [grpId=1613773252, newId=1, currId=0, walSegment=0]. [21:15:59]W: [org.apache.ignite:ignite-core] [2021-11-19 21:15:59,378][ERROR][tcp-disco-msg-worker-[00a6fc03 127.0.0.1:47500]-#1442%grid-1%-#27488%grid-1%][G] Blocked system-critical thread has been detected. This can lead to cluster-wide undefined behaviour [workerName=disco-notifier-worker, threadName=disco-notifier-worker-#27487%grid-1%, blockedFor=13s] [21:15:59]W: [org.apache.ignite:ignite-core] [2021-11-19 21:15:59,385][WARN ][tcp-disco-msg-worker-[00a6fc03 127.0.0.1:47500]-#1442%grid-1%-#27488%grid-1%][IgniteTestResources] Possible failure suppressed accordingly to a configured handler [hnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]], failureCtx=FailureContext [type=SYSTEM_WORKER_BLOCKED, err=class o.a.i.IgniteException: GridWorker [name=disco-notifier-worker, igniteInstanceName=grid-1, finished=false, heartbeatTs=1637345745603]]] [21:15:59]W: [org.apache.ignite:ignite-core] class org.apache.ignite.IgniteException: GridWorker [name=disco-notifier-worker, igniteInstanceName=grid-1, finished=false, heartbeatTs=1637345745603] [21:15:59]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.managers.encryption.GridEncryptionManager.addGroupKey(GridEncryptionManager.java:654) [21:15:59]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.managers.encryption.GroupKeyChangeProcess.lambda$prepare$0(GroupKeyChangeProcess.java:256) [21:15:59]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.managers.encryption.GroupKeyChangeProcess$$Lambda$1212/364051370.call(Unknown Source) [21:15:59]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.managers.encryption.GridEncryptionManager.withMasterKeyChangeReadLock(GridEncryptionManager.java:1679) [21:15:59]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.managers.encryption.GroupKeyChangeProcess.prepare(GroupKeyChangeProcess.java:245) [21:15:59]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.managers.encryption.GroupKeyChangeProcess$$Lambda$284/498072435.apply(Unknown Source) [21:15:59]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.distributed.DistributedProcess.lambda$new$2(DistributedProcess.java:149) [21:15:59]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.distributed.DistributedProcess$$Lambda$278/2056343039.onCustomEvent(Unknown Source) [21:15:59]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.managers.discovery.GridDiscoveryManager$4.onDiscovery0(GridDiscoveryManager.java:774) [21:15:59]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.managers.discovery.GridDiscoveryManager$4.access$7500(GridDiscoveryManager.java:561) [21:15:59]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.managers.discovery.GridDiscoveryManager$4$NotificationTask.run(GridDiscoveryManager.java:996) [21:15:59]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.managers.discovery.GridDiscoveryManager$DiscoveryMessageNotifierWorker.body0(GridDiscoveryManager.java:2871) [21:15:59]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.managers.discovery.GridDiscoveryManager$DiscoveryMessageNotifierWorker.body(GridDiscoveryManager.java:2909) [21:15:59]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:125) [21:15:59]W: [org.apache.ignite:ignite-core] at java.lang.Thread.run(Thread.java:748) [21:15:59]W: [org.apache.ignite:ignite-core] [2021-11-19 21:15:59,393][ERROR][tcp-disco-msg-worker-[00a6fc03 127.0.0.1:47500]-#1442%grid-1%-#27488%grid-1%][TestTcpDiscoverySpi] TcpDiscoverSpi's message worker thread failed abnormally. Stopping the node in order to prevent cluster wide instability. [21:15:59]W: [org.apache.ignite:ignite-core] java.lang.AssertionError [21:15:59]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.diagnostic.pagelocktracker.SharedPageLockTracker.dump(SharedPageLockTracker.java:199) [21:15:59]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.diagnostic.pagelocktracker.PageLockTrackerManager.dumpLocks(PageLockTrackerManager.java:175) [21:15:59]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.diagnostic.pagelocktracker.PageLockTrackerManager.dumpLocksToString(PageLockTrackerManager.java:184) [21:15:59]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.diagnostic.pagelocktracker.PageLockTrackerManager.dumpLocksToLog(PageLockTrackerManager.java:191) [21:15:59]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.diagnostic.DiagnosticProcessor.onFailure(DiagnosticProcessor.java:96) [21:15:59]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.failure.FailureProcessor.process(FailureProcessor.java:210) [21:15:59]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.failure.FailureProcessor.process(FailureProcessor.java:156) [21:15:59]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.IgnitionEx$IgniteNamedInstance$2.apply(IgnitionEx.java:1776) [21:15:59]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.IgnitionEx$IgniteNamedInstance$2.apply(IgnitionEx.java:1766) [21:15:59]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.worker.WorkersRegistry.onIdle(WorkersRegistry.java:232) [21:15:59]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.worker.GridWorker.onIdle(GridWorker.java:306) [21:15:59]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.discovery.tcp.ServerImpl$RingMessageWorker.lambda$new$1(ServerImpl.java:2975) [21:15:59]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.discovery.tcp.ServerImpl$MessageWorker.body(ServerImpl.java:8099) [21:15:59]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.discovery.tcp.ServerImpl$RingMessageWorker.body(ServerImpl.java:3091) [21:15:59]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:125) [21:15:59]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.discovery.tcp.ServerImpl$MessageWorkerThread.body(ServerImpl.java:8037) [21:15:59]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.IgniteSpiThread.run(IgniteSpiThread.java:58) [21:15:59]W: [org.apache.ignite:ignite-core] [2021-11-19 21:15:59,401][ERROR][tcp-disco-msg-worker-[00a6fc03 127.0.0.1:47500]-#1442%grid-1%-#27488%grid-1%][IgniteTestResources] Critical system error detected. Will be handled accordingly to configured handler [hnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]], failureCtx=FailureContext [type=SYSTEM_WORKER_TERMINATION, err=java.lang.AssertionError]] [21:15:59]W: [org.apache.ignite:ignite-core] java.lang.AssertionError [21:15:59]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.diagnostic.pagelocktracker.SharedPageLockTracker.dump(SharedPageLockTracker.java:199) [21:15:59]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.diagnostic.pagelocktracker.PageLockTrackerManager.dumpLocks(PageLockTrackerManager.java:175) [21:15:59]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.diagnostic.pagelocktracker.PageLockTrackerManager.dumpLocksToString(PageLockTrackerManager.java:184) [21:15:59]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.diagnostic.pagelocktracker.PageLockTrackerManager.dumpLocksToLog(PageLockTrackerManager.java:191) [21:15:59]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.diagnostic.DiagnosticProcessor.onFailure(DiagnosticProcessor.java:96) [21:15:59]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.failure.FailureProcessor.process(FailureProcessor.java:210) [21:15:59]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.failure.FailureProcessor.process(FailureProcessor.java:156) [21:15:59]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.IgnitionEx$IgniteNamedInstance$2.apply(IgnitionEx.java:1776) [21:15:59]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.IgnitionEx$IgniteNamedInstance$2.apply(IgnitionEx.java:1766) [21:15:59]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.worker.WorkersRegistry.onIdle(WorkersRegistry.java:232) [21:15:59]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.worker.GridWorker.onIdle(GridWorker.java:306) [21:15:59]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.discovery.tcp.ServerImpl$RingMessageWorker.lambda$new$1(ServerImpl.java:2975) [21:15:59]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.discovery.tcp.ServerImpl$MessageWorker.body(ServerImpl.java:8099) [21:15:59]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.discovery.tcp.ServerImpl$RingMessageWorker.body(ServerImpl.java:3091) [21:15:59]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:125) [21:15:59]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.discovery.tcp.ServerImpl$MessageWorkerThread.body(ServerImpl.java:8037) [21:15:59]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.IgniteSpiThread.run(IgniteSpiThread.java:58) [21:15:59]W: [org.apache.ignite:ignite-core] [2021-11-19 21:15:59,409][ERROR][tcp-disco-msg-worker-[00a6fc03 127.0.0.1:47500]-#1442%grid-1%-#27488%grid-1%][TestTcpDiscoverySpi] Runtime error caught during grid runnable execution: GridWorker [name=tcp-disco-msg-worker-[], igniteInstanceName=grid-1, finished=false, heartbeatTs=1637345759368, hashCode=2084925307, interrupted=false, runner=tcp-disco-msg-worker-[00a6fc03 127.0.0.1:47500]-#1442%grid-1%-#27488%grid-1%], nextNode=[TcpDiscoveryNode [id=00a6fc03-d771-41c5-a569-486fa9959000, consistentId=grid-0, addrs=ArrayList [127.0.0.1], sockAddrs=HashSet [/127.0.0.1:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1637345744979, loc=false, ver=2.13.0#20211119-sha1:00000000, isClient=false]] [21:15:59]W: [org.apache.ignite:ignite-core] java.lang.AssertionError [21:15:59]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.diagnostic.pagelocktracker.SharedPageLockTracker.dump(SharedPageLockTracker.java:199) [21:15:59]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.diagnostic.pagelocktracker.PageLockTrackerManager.dumpLocks(PageLockTrackerManager.java:175) [21:15:59]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.diagnostic.pagelocktracker.PageLockTrackerManager.dumpLocksToString(PageLockTrackerManager.java:184) [21:15:59]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.diagnostic.pagelocktracker.PageLockTrackerManager.dumpLocksToLog(PageLockTrackerManager.java:191) [21:15:59]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.diagnostic.DiagnosticProcessor.onFailure(DiagnosticProcessor.java:96) [21:15:59]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.failure.FailureProcessor.process(FailureProcessor.java:210) [21:15:59]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.failure.FailureProcessor.process(FailureProcessor.java:156) [21:15:59]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.discovery.tcp.ServerImpl$RingMessageWorker.body(ServerImpl.java:3139) [21:15:59]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:125) [21:15:59]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.discovery.tcp.ServerImpl$MessageWorkerThread.body(ServerImpl.java:8037) [21:15:59]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.IgniteSpiThread.run(IgniteSpiThread.java:58) [21:15:59]W: [org.apache.ignite:ignite-core] [2021-11-19 21:15:59,413][ERROR][tcp-disco-msg-worker-[00a6fc03 127.0.0.1:47500]-#1442%grid-1%-#27488%grid-1%][IgniteTestResources] Critical system error detected. Will be handled accordingly to configured handler [hnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]], failureCtx=FailureContext [type=SYSTEM_WORKER_TERMINATION, err=class o.a.i.IgniteException: GridWorker [name=tcp-disco-msg-worker-[], igniteInstanceName=grid-1, finished=true, heartbeatTs=1637345759368]]] [21:15:59]W: [org.apache.ignite:ignite-core] class org.apache.ignite.IgniteException: GridWorker [name=tcp-disco-msg-worker-[], igniteInstanceName=grid-1, finished=true, heartbeatTs=1637345759368] [21:15:59]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.IgnitionEx$IgniteNamedInstance$2.apply(IgnitionEx.java:1768) [21:15:59]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.IgnitionEx$IgniteNamedInstance$2.apply(IgnitionEx.java:1766) [21:15:59]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.worker.WorkersRegistry.onStopped(WorkersRegistry.java:169) [21:15:59]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:160) [21:15:59]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.discovery.tcp.ServerImpl$MessageWorkerThread.body(ServerImpl.java:8037) [21:15:59]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.IgniteSpiThread.run(IgniteSpiThread.java:58) [21:15:59]W: [org.apache.ignite:ignite-core] [2021-11-19 21:15:59,416][ERROR][tcp-disco-msg-worker-[00a6fc03 127.0.0.1:47500]-#1442%grid-1%-#27488%grid-1%][TestTcpDiscoverySpi] Runtime error caught during grid runnable execution: IgniteSpiThread [name=tcp-disco-msg-worker-[00a6fc03 127.0.0.1:47500]-#1442%grid-1%-#27488%grid-1%] [21:15:59]W: [org.apache.ignite:ignite-core] java.lang.AssertionError [21:15:59]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.diagnostic.pagelocktracker.SharedPageLockTracker.dump(SharedPageLockTracker.java:199) [21:15:59]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.diagnostic.pagelocktracker.PageLockTrackerManager.dumpLocks(PageLockTrackerManager.java:175) [21:15:59]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.diagnostic.pagelocktracker.PageLockTrackerManager.dumpLocksToString(PageLockTrackerManager.java:184) [21:15:59]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.diagnostic.pagelocktracker.PageLockTrackerManager.dumpLocksToLog(PageLockTrackerManager.java:191) [21:15:59]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.diagnostic.DiagnosticProcessor.onFailure(DiagnosticProcessor.java:96) [21:15:59]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.failure.FailureProcessor.process(FailureProcessor.java:210) [21:15:59]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.failure.FailureProcessor.process(FailureProcessor.java:156) [21:15:59]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.IgnitionEx$IgniteNamedInstance$2.apply(IgnitionEx.java:1776) [21:15:59]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.IgnitionEx$IgniteNamedInstance$2.apply(IgnitionEx.java:1766) [21:15:59]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.worker.WorkersRegistry.onStopped(WorkersRegistry.java:169) [21:15:59]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:160) [21:15:59]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.discovery.tcp.ServerImpl$MessageWorkerThread.body(ServerImpl.java:8037) [21:15:59]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.IgniteSpiThread.run(IgniteSpiThread.java:58) [21:15:59]W: [org.apache.ignite:ignite-core] Exception in thread "tcp-disco-msg-worker-[00a6fc03 127.0.0.1:47500]-#1442%grid-1%-#27488%grid-1%" java.lang.AssertionError [21:15:59]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.diagnostic.pagelocktracker.SharedPageLockTracker.dump(SharedPageLockTracker.java:199) [21:15:59]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.diagnostic.pagelocktracker.PageLockTrackerManager.dumpLocks(PageLockTrackerManager.java:175) [21:15:59]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.diagnostic.pagelocktracker.PageLockTrackerManager.dumpLocksToString(PageLockTrackerManager.java:184) [21:15:59]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.diagnostic.pagelocktracker.PageLockTrackerManager.dumpLocksToLog(PageLockTrackerManager.java:191) [21:15:59]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.diagnostic.DiagnosticProcessor.onFailure(DiagnosticProcessor.java:96) [21:15:59]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.failure.FailureProcessor.process(FailureProcessor.java:210) [21:15:59]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.failure.FailureProcessor.process(FailureProcessor.java:156) [21:15:59]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.IgnitionEx$IgniteNamedInstance$2.apply(IgnitionEx.java:1776) [21:15:59]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.IgnitionEx$IgniteNamedInstance$2.apply(IgnitionEx.java:1766) [21:15:59]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.worker.WorkersRegistry.onStopped(WorkersRegistry.java:169) [21:15:59]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:160) [21:15:59]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.discovery.tcp.ServerImpl$MessageWorkerThread.body(ServerImpl.java:8037) [21:15:59]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.IgniteSpiThread.run(IgniteSpiThread.java:58) [21:16:00]W: [org.apache.ignite:ignite-core] [2021-11-19 21:16:00,605][ERROR][main][root] Test failed [test=CacheGroupKeyChangeTest#testNodeWithOlderKeyBecameCoordinator, duration=20138] [21:16:00]W: [org.apache.ignite:ignite-core] class org.apache.ignite.lang.IgniteFutureTimeoutException: Timeout was reached before computation completed. [21:16:00]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils$5.apply(IgniteUtils.java:945) [21:16:00]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils$5.apply(IgniteUtils.java:943) [21:16:00]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.IgniteUtils.convertException(IgniteUtils.java:1107) [21:16:00]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.IgniteFutureImpl.convertException(IgniteFutureImpl.java:186) [21:16:00]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.IgniteFutureImpl.get(IgniteFutureImpl.java:165) [21:16:00]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.encryption.CacheGroupKeyChangeTest.testNodeWithOlderKeyBecameCoordinator(CacheGroupKeyChangeTest.java:531) [21:16:00]W: [org.apache.ignite:ignite-core] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) [21:16:00]W: [org.apache.ignite:ignite-core] at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) [21:16:00]W: [org.apache.ignite:ignite-core] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [21:16:00]W: [org.apache.ignite:ignite-core] at java.lang.reflect.Method.invoke(Method.java:498) [21:16:00]W: [org.apache.ignite:ignite-core] at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50) [21:16:00]W: [org.apache.ignite:ignite-core] at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) [21:16:00]W: [org.apache.ignite:ignite-core] at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47) [21:16:00]W: [org.apache.ignite:ignite-core] at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) [21:16:00]W: [org.apache.ignite:ignite-core] at org.apache.ignite.testframework.junits.GridAbstractTest$7.run(GridAbstractTest.java:2432) [21:16:00]W: [org.apache.ignite:ignite-core] at java.lang.Thread.run(Thread.java:748) [21:16:00]W: [org.apache.ignite:ignite-core] Caused by: class org.apache.ignite.internal.IgniteFutureTimeoutCheckedException: Timeout was reached before computation completed. [21:16:00]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.get0(GridFutureAdapter.java:244) [21:16:00]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.get(GridFutureAdapter.java:160) [21:16:00]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.GridFutureAdapter.get(GridFutureAdapter.java:152) [21:16:00]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.future.IgniteFutureImpl.get(IgniteFutureImpl.java:162) [21:16:00]W: [org.apache.ignite:ignite-core] ... 11 more [21:16:00] : [Step 4/5] [21:16:00] >>> Stopping test: CacheGroupKeyChangeTest#testNodeWithOlderKeyBecameCoordinator in 20144 ms <<< [21:16:00] : [Step 4/5] [2021-11-19 21:16:00,611][INFO ][main][root] >>> Stopping test: CacheGroupKeyChangeTest#testNodeWithOlderKeyBecameCoordinator in 20144 ms <<< [21:16:00] : [Step 4/5] [21:16:00] >>> Heap: 265 MB used / 1911 MB commited / 1911 MB max <<< [21:16:00] : [Step 4/5] [2021-11-19 21:16:00,612][INFO ][main][root] >>> Heap: 265 MB used / 1911 MB commited / 1911 MB max <<< [21:16:00] : [Step 4/5] [21:16:00] >>> Non-Heap: 178 MB used / 197 MB commited / 0 MB max <<< [21:16:00] : [Step 4/5] [2021-11-19 21:16:00,612][INFO ][main][root] >>> Non-Heap: 178 MB used / 197 MB commited / 0 MB max <<< [21:16:00] : [Step 4/5] [2021-11-19 21:16:00,613][INFO ][main][root] >>> Stopping grid [name=grid-1, id=104f4bc0-8387-42e3-9369-3a2ae7e62001] [21:16:02]W: [org.apache.ignite:ignite-core] [2021-11-19 21:16:02,416][ERROR][nio-acceptor-tcp-comm-#27441%TestRecordingCommunicationSpi%][G] Blocked system-critical thread has been detected. This can lead to cluster-wide undefined behaviour [workerName=disco-notifier-worker, threadName=disco-notifier-worker-#27487%grid-1%, blockedFor=16s] [21:16:02]W: [org.apache.ignite:ignite-core] [2021-11-19 21:16:02,418][WARN ][nio-acceptor-tcp-comm-#27441%TestRecordingCommunicationSpi%][IgniteTestResources] Possible failure suppressed accordingly to a configured handler [hnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]], failureCtx=FailureContext [type=SYSTEM_WORKER_BLOCKED, err=class o.a.i.IgniteException: GridWorker [name=disco-notifier-worker, igniteInstanceName=grid-1, finished=false, heartbeatTs=1637345745603]]] [21:16:02]W: [org.apache.ignite:ignite-core] class org.apache.ignite.IgniteException: GridWorker [name=disco-notifier-worker, igniteInstanceName=grid-1, finished=false, heartbeatTs=1637345745603] [21:16:02]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.managers.encryption.GridEncryptionManager.addGroupKey(GridEncryptionManager.java:654) [21:16:02]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.managers.encryption.GroupKeyChangeProcess.lambda$prepare$0(GroupKeyChangeProcess.java:256) [21:16:02]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.managers.encryption.GroupKeyChangeProcess$$Lambda$1212/364051370.call(Unknown Source) [21:16:02]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.managers.encryption.GridEncryptionManager.withMasterKeyChangeReadLock(GridEncryptionManager.java:1679) [21:16:02]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.managers.encryption.GroupKeyChangeProcess.prepare(GroupKeyChangeProcess.java:245) [21:16:02]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.managers.encryption.GroupKeyChangeProcess$$Lambda$284/498072435.apply(Unknown Source) [21:16:02]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.distributed.DistributedProcess.lambda$new$2(DistributedProcess.java:149) [21:16:02]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.distributed.DistributedProcess$$Lambda$278/2056343039.onCustomEvent(Unknown Source) [21:16:02]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.managers.discovery.GridDiscoveryManager$4.onDiscovery0(GridDiscoveryManager.java:774) [21:16:02]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.managers.discovery.GridDiscoveryManager$4.access$7500(GridDiscoveryManager.java:561) [21:16:02]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.managers.discovery.GridDiscoveryManager$4$NotificationTask.run(GridDiscoveryManager.java:996) [21:16:02]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.managers.discovery.GridDiscoveryManager$DiscoveryMessageNotifierWorker.body0(GridDiscoveryManager.java:2871) [21:16:02]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.managers.discovery.GridDiscoveryManager$DiscoveryMessageNotifierWorker.body(GridDiscoveryManager.java:2909) [21:16:02]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:125) [21:16:02]W: [org.apache.ignite:ignite-core] at java.lang.Thread.run(Thread.java:748) [21:16:02]W: [org.apache.ignite:ignite-core] [2021-11-19 21:16:02,423][ERROR][nio-acceptor-tcp-comm-#27441%TestRecordingCommunicationSpi%][IgniteTestResources] Critical system error detected. Will be handled accordingly to configured handler [hnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]], failureCtx=FailureContext [type=SYSTEM_WORKER_TERMINATION, err=java.lang.AssertionError]] [21:16:02]W: [org.apache.ignite:ignite-core] java.lang.AssertionError [21:16:02]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.diagnostic.pagelocktracker.SharedPageLockTracker.dump(SharedPageLockTracker.java:199) [21:16:02]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.diagnostic.pagelocktracker.PageLockTrackerManager.dumpLocks(PageLockTrackerManager.java:175) [21:16:02]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.diagnostic.pagelocktracker.PageLockTrackerManager.dumpLocksToString(PageLockTrackerManager.java:184) [21:16:02]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.diagnostic.pagelocktracker.PageLockTrackerManager.dumpLocksToLog(PageLockTrackerManager.java:191) [21:16:02]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.diagnostic.DiagnosticProcessor.onFailure(DiagnosticProcessor.java:96) [21:16:02]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.failure.FailureProcessor.process(FailureProcessor.java:210) [21:16:02]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.failure.FailureProcessor.process(FailureProcessor.java:156) [21:16:02]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.IgnitionEx$IgniteNamedInstance$2.apply(IgnitionEx.java:1776) [21:16:02]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.IgnitionEx$IgniteNamedInstance$2.apply(IgnitionEx.java:1766) [21:16:02]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.worker.WorkersRegistry.onIdle(WorkersRegistry.java:232) [21:16:02]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.worker.GridWorker.onIdle(GridWorker.java:306) [21:16:02]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$GridNioAcceptWorker.accept(GridNioServer.java:3088) [21:16:02]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$GridNioAcceptWorker.body(GridNioServer.java:3022) [21:16:02]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:125) [21:16:02]W: [org.apache.ignite:ignite-core] at java.lang.Thread.run(Thread.java:748) [21:16:02]W: [org.apache.ignite:ignite-core] [2021-11-19 21:16:02,426][ERROR][nio-acceptor-tcp-comm-#27441%TestRecordingCommunicationSpi%][TestRecordingCommunicationSpi] Runtime error caught during grid runnable execution: GridWorker [name=nio-acceptor-tcp-comm, igniteInstanceName=TestRecordingCommunicationSpi, finished=false, heartbeatTs=1637345762410, hashCode=730981235, interrupted=false, runner=nio-acceptor-tcp-comm-#27441%TestRecordingCommunicationSpi%] [21:16:02]W: [org.apache.ignite:ignite-core] java.lang.AssertionError [21:16:02]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.diagnostic.pagelocktracker.SharedPageLockTracker.dump(SharedPageLockTracker.java:199) [21:16:02]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.diagnostic.pagelocktracker.PageLockTrackerManager.dumpLocks(PageLockTrackerManager.java:175) [21:16:02]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.diagnostic.pagelocktracker.PageLockTrackerManager.dumpLocksToString(PageLockTrackerManager.java:184) [21:16:02]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.diagnostic.pagelocktracker.PageLockTrackerManager.dumpLocksToLog(PageLockTrackerManager.java:191) [21:16:02]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.diagnostic.DiagnosticProcessor.onFailure(DiagnosticProcessor.java:96) [21:16:02]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.failure.FailureProcessor.process(FailureProcessor.java:210) [21:16:02]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.failure.FailureProcessor.process(FailureProcessor.java:156) [21:16:02]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.communication.tcp.internal.InboundConnectionHandler.onFailure(InboundConnectionHandler.java:403) [21:16:02]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.nio.GridNioServer$GridNioAcceptWorker.body(GridNioServer.java:3056) [21:16:02]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:125) [21:16:02]W: [org.apache.ignite:ignite-core] at java.lang.Thread.run(Thread.java:748) [21:16:02]W: [org.apache.ignite:ignite-core] [2021-11-19 21:16:02,428][ERROR][nio-acceptor-tcp-comm-#27441%TestRecordingCommunicationSpi%][IgniteTestResources] Critical system error detected. Will be handled accordingly to configured handler [hnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]], failureCtx=FailureContext [type=SYSTEM_WORKER_TERMINATION, err=class o.a.i.IgniteException: GridWorker [name=nio-acceptor-tcp-comm, igniteInstanceName=TestRecordingCommunicationSpi, finished=true, heartbeatTs=1637345762410]]] [21:16:02]W: [org.apache.ignite:ignite-core] class org.apache.ignite.IgniteException: GridWorker [name=nio-acceptor-tcp-comm, igniteInstanceName=TestRecordingCommunicationSpi, finished=true, heartbeatTs=1637345762410] [21:16:02]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.IgnitionEx$IgniteNamedInstance$2.apply(IgnitionEx.java:1768) [21:16:02]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.IgnitionEx$IgniteNamedInstance$2.apply(IgnitionEx.java:1766) [21:16:02]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.worker.WorkersRegistry.onStopped(WorkersRegistry.java:169) [21:16:02]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:160) [21:16:02]W: [org.apache.ignite:ignite-core] at java.lang.Thread.run(Thread.java:748) [21:16:02]W: [org.apache.ignite:ignite-core] Exception in thread "nio-acceptor-tcp-comm-#27441%TestRecordingCommunicationSpi%" java.lang.AssertionError [21:16:02]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.diagnostic.pagelocktracker.SharedPageLockTracker.dump(SharedPageLockTracker.java:199) [21:16:02]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.diagnostic.pagelocktracker.PageLockTrackerManager.dumpLocks(PageLockTrackerManager.java:175) [21:16:02]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.diagnostic.pagelocktracker.PageLockTrackerManager.dumpLocksToString(PageLockTrackerManager.java:184) [21:16:02]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.diagnostic.pagelocktracker.PageLockTrackerManager.dumpLocksToLog(PageLockTrackerManager.java:191) [21:16:02]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.diagnostic.DiagnosticProcessor.onFailure(DiagnosticProcessor.java:96) [21:16:02]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.failure.FailureProcessor.process(FailureProcessor.java:210) [21:16:02]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.failure.FailureProcessor.process(FailureProcessor.java:156) [21:16:02]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.IgnitionEx$IgniteNamedInstance$2.apply(IgnitionEx.java:1776) [21:16:02]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.IgnitionEx$IgniteNamedInstance$2.apply(IgnitionEx.java:1766) [21:16:02]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.worker.WorkersRegistry.onStopped(WorkersRegistry.java:169) [21:16:02]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:160) [21:16:02]W: [org.apache.ignite:ignite-core] at java.lang.Thread.run(Thread.java:748) [21:16:08]W: [org.apache.ignite:ignite-core] [2021-11-19 21:16:08,698][ERROR][grid-timeout-worker-#27428%grid-1%][IgniteTestResources] Critical system error detected. Will be handled accordingly to configured handler [hnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]], failureCtx=FailureContext [type=SYSTEM_WORKER_TERMINATION, err=class o.a.i.IgniteException: GridWorker [name=nio-acceptor-tcp-comm, igniteInstanceName=TestRecordingCommunicationSpi, finished=true, heartbeatTs=1637345762410]]] [21:16:08]W: [org.apache.ignite:ignite-core] class org.apache.ignite.IgniteException: GridWorker [name=nio-acceptor-tcp-comm, igniteInstanceName=TestRecordingCommunicationSpi, finished=true, heartbeatTs=1637345762410] [21:16:08]W: [org.apache.ignite:ignite-core] [2021-11-19 21:16:08,702][ERROR][grid-timeout-worker-#27428%grid-1%][IgniteTestResources] Critical system error detected. Will be handled accordingly to configured handler [hnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]], failureCtx=FailureContext [type=SYSTEM_WORKER_TERMINATION, err=java.lang.AssertionError]] [21:16:08]W: [org.apache.ignite:ignite-core] java.lang.AssertionError [21:16:08]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.diagnostic.pagelocktracker.SharedPageLockTracker.dump(SharedPageLockTracker.java:199) [21:16:08]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.diagnostic.pagelocktracker.PageLockTrackerManager.dumpLocks(PageLockTrackerManager.java:175) [21:16:08]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.diagnostic.pagelocktracker.PageLockTrackerManager.dumpLocksToString(PageLockTrackerManager.java:184) [21:16:08]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.diagnostic.pagelocktracker.PageLockTrackerManager.dumpLocksToLog(PageLockTrackerManager.java:191) [21:16:08]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.diagnostic.DiagnosticProcessor.onFailure(DiagnosticProcessor.java:96) [21:16:08]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.failure.FailureProcessor.process(FailureProcessor.java:210) [21:16:08]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.failure.FailureProcessor.process(FailureProcessor.java:156) [21:16:08]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.IgnitionEx$IgniteNamedInstance$2.apply(IgnitionEx.java:1776) [21:16:08]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.IgnitionEx$IgniteNamedInstance$2.apply(IgnitionEx.java:1766) [21:16:08]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.worker.WorkersRegistry.onIdle(WorkersRegistry.java:218) [21:16:08]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.worker.GridWorker.onIdle(GridWorker.java:306) [21:16:08]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.timeout.GridTimeoutProcessor$TimeoutWorker.body(GridTimeoutProcessor.java:221) [21:16:08]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:125) [21:16:08]W: [org.apache.ignite:ignite-core] at java.lang.Thread.run(Thread.java:748) [21:16:08]W: [org.apache.ignite:ignite-core] [2021-11-19 21:16:08,705][ERROR][grid-timeout-worker-#27428%grid-1%][GridTimeoutProcessor] Runtime error caught during grid runnable execution: GridWorker [name=grid-timeout-worker, igniteInstanceName=grid-1, finished=false, heartbeatTs=1637345768691, hashCode=380210804, interrupted=false, runner=grid-timeout-worker-#27428%grid-1%] [21:16:08]W: [org.apache.ignite:ignite-core] java.lang.AssertionError [21:16:08]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.diagnostic.pagelocktracker.SharedPageLockTracker.dump(SharedPageLockTracker.java:199) [21:16:08]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.diagnostic.pagelocktracker.PageLockTrackerManager.dumpLocks(PageLockTrackerManager.java:175) [21:16:08]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.diagnostic.pagelocktracker.PageLockTrackerManager.dumpLocksToString(PageLockTrackerManager.java:184) [21:16:08]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.diagnostic.pagelocktracker.PageLockTrackerManager.dumpLocksToLog(PageLockTrackerManager.java:191) [21:16:08]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.diagnostic.DiagnosticProcessor.onFailure(DiagnosticProcessor.java:96) [21:16:08]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.failure.FailureProcessor.process(FailureProcessor.java:210) [21:16:08]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.failure.FailureProcessor.process(FailureProcessor.java:156) [21:16:08]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.timeout.GridTimeoutProcessor$TimeoutWorker.body(GridTimeoutProcessor.java:305) [21:16:08]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:125) [21:16:08]W: [org.apache.ignite:ignite-core] at java.lang.Thread.run(Thread.java:748) [21:16:08]W: [org.apache.ignite:ignite-core] [2021-11-19 21:16:08,709][ERROR][grid-timeout-worker-#27428%grid-1%][IgniteTestResources] Critical system error detected. Will be handled accordingly to configured handler [hnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]], failureCtx=FailureContext [type=SYSTEM_WORKER_TERMINATION, err=class o.a.i.IgniteException: GridWorker [name=grid-timeout-worker, igniteInstanceName=grid-1, finished=true, heartbeatTs=1637345768691]]] [21:16:08]W: [org.apache.ignite:ignite-core] class org.apache.ignite.IgniteException: GridWorker [name=grid-timeout-worker, igniteInstanceName=grid-1, finished=true, heartbeatTs=1637345768691] [21:16:08]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.IgnitionEx$IgniteNamedInstance$2.apply(IgnitionEx.java:1768) [21:16:08]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.IgnitionEx$IgniteNamedInstance$2.apply(IgnitionEx.java:1766) [21:16:08]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.worker.WorkersRegistry.onStopped(WorkersRegistry.java:169) [21:16:08]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:160) [21:16:08]W: [org.apache.ignite:ignite-core] at java.lang.Thread.run(Thread.java:748) [21:16:08]W: [org.apache.ignite:ignite-core] Exception in thread "grid-timeout-worker-#27428%grid-1%" java.lang.AssertionError [21:16:08]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.diagnostic.pagelocktracker.SharedPageLockTracker.dump(SharedPageLockTracker.java:199) [21:16:08]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.diagnostic.pagelocktracker.PageLockTrackerManager.dumpLocks(PageLockTrackerManager.java:175) [21:16:08]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.diagnostic.pagelocktracker.PageLockTrackerManager.dumpLocksToString(PageLockTrackerManager.java:184) [21:16:08]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.diagnostic.pagelocktracker.PageLockTrackerManager.dumpLocksToLog(PageLockTrackerManager.java:191) [21:16:08]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.diagnostic.DiagnosticProcessor.onFailure(DiagnosticProcessor.java:96) [21:16:08]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.failure.FailureProcessor.process(FailureProcessor.java:210) [21:16:08]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.failure.FailureProcessor.process(FailureProcessor.java:156) [21:16:08]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.IgnitionEx$IgniteNamedInstance$2.apply(IgnitionEx.java:1776) [21:16:08]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.IgnitionEx$IgniteNamedInstance$2.apply(IgnitionEx.java:1766) [21:16:08]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.worker.WorkersRegistry.onStopped(WorkersRegistry.java:169) [21:16:08]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:160) [21:16:08]W: [org.apache.ignite:ignite-core] at java.lang.Thread.run(Thread.java:748) [21:16:15] : [Step 4/5] [2021-11-19 21:16:15,263][INFO ][db-checkpoint-thread-#27502%grid-0%][Checkpointer] Checkpoint started [checkpointId=ccd53bb6-5be3-4e6a-9170-20f4f8255608, startPtr=WALPointer [idx=0, fileOff=478428, len=2105], checkpointBeforeLockTime=2ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, walCpRecordFsyncDuration=45ms, writeCheckpointEntryDuration=1ms, splitAndSortCpPagesDuration=0ms, pages=18, reason='timeout'] [21:16:15] : [Step 4/5] [2021-11-19 21:16:15,281][INFO ][db-checkpoint-thread-#27502%grid-0%][Checkpointer] Checkpoint finished [cpId=ccd53bb6-5be3-4e6a-9170-20f4f8255608, pages=18, markPos=WALPointer [idx=0, fileOff=478428, len=2105], walSegmentsCovered=[], markDuration=48ms, pagesWrite=0ms, fsync=17ms, total=67ms] [21:16:41] : [Step 4/5] [2021-11-19 21:16:41,968][INFO ][db-checkpoint-thread-#27502%grid-0%][Checkpointer] Skipping checkpoint (no pages were modified) [checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, reason='timeout'] [21:16:44]W: [org.apache.ignite:ignite-core] [2021-11-19 21:16:44,256][WARN ][tcp-disco-ip-finder-cleaner-#1439%grid-0%-#27370%grid-0%][TestTcpDiscoverySpi] Failed to ping node [nodeId=null]. Reached the timeout 10000ms. Cause: Connection refused (Connection refused) [21:17:13] : [Step 4/5] [2021-11-19 21:17:13,318][INFO ][db-checkpoint-thread-#27502%grid-0%][Checkpointer] Skipping checkpoint (no pages were modified) [checkpointBeforeLockTime=2ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, reason='timeout'] [21:19:09] : [Step 4/5] [2021-11-19 21:19:09,353][INFO ][db-checkpoint-thread-#27502%grid-0%][Checkpointer] Skipping checkpoint (no pages were modified) [checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=1ms, checkpointLockHoldTime=1ms, reason='timeout'] [21:21:43] : [Step 4/5] [2021-11-19 21:21:43,682][INFO ][db-checkpoint-thread-#27502%grid-0%][Checkpointer] Skipping checkpoint (no pages were modified) [checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, reason='timeout'] [21:23:50] : [Step 4/5] [2021-11-19 21:23:50,482][INFO ][db-checkpoint-thread-#27502%grid-0%][Checkpointer] Skipping checkpoint (no pages were modified) [checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, reason='timeout'] [21:25:44]W: [org.apache.ignite:ignite-core] [2021-11-19 21:25:44,405][ERROR][tcp-comm-worker-#1440%grid-1%-#27442%grid-1%][IgniteTestResources] Critical system error detected. Will be handled accordingly to configured handler [hnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]], failureCtx=FailureContext [type=SYSTEM_WORKER_TERMINATION, err=class o.a.i.IgniteException: GridWorker [name=grid-timeout-worker, igniteInstanceName=grid-1, finished=true, heartbeatTs=1637345768691]]] [21:25:44]W: [org.apache.ignite:ignite-core] class org.apache.ignite.IgniteException: GridWorker [name=grid-timeout-worker, igniteInstanceName=grid-1, finished=true, heartbeatTs=1637345768691] [21:25:44]W: [org.apache.ignite:ignite-core] [2021-11-19 21:25:44,409][ERROR][tcp-comm-worker-#1440%grid-1%-#27442%grid-1%][IgniteTestResources] Critical system error detected. Will be handled accordingly to configured handler [hnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]], failureCtx=FailureContext [type=SYSTEM_WORKER_TERMINATION, err=java.lang.AssertionError]] [21:25:44]W: [org.apache.ignite:ignite-core] java.lang.AssertionError [21:25:44]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.diagnostic.pagelocktracker.SharedPageLockTracker.dump(SharedPageLockTracker.java:199) [21:25:44]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.diagnostic.pagelocktracker.PageLockTrackerManager.dumpLocks(PageLockTrackerManager.java:175) [21:25:44]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.diagnostic.pagelocktracker.PageLockTrackerManager.dumpLocksToString(PageLockTrackerManager.java:184) [21:25:44]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.diagnostic.pagelocktracker.PageLockTrackerManager.dumpLocksToLog(PageLockTrackerManager.java:191) [21:25:44]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.diagnostic.DiagnosticProcessor.onFailure(DiagnosticProcessor.java:96) [21:25:44]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.failure.FailureProcessor.process(FailureProcessor.java:210) [21:25:44]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.failure.FailureProcessor.process(FailureProcessor.java:156) [21:25:44]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.IgnitionEx$IgniteNamedInstance$2.apply(IgnitionEx.java:1776) [21:25:44]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.IgnitionEx$IgniteNamedInstance$2.apply(IgnitionEx.java:1766) [21:25:44]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.worker.WorkersRegistry.onIdle(WorkersRegistry.java:218) [21:25:44]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.worker.GridWorker.onIdle(GridWorker.java:306) [21:25:44]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.communication.tcp.internal.CommunicationWorker.body(CommunicationWorker.java:178) [21:25:44]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:125) [21:25:44]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.communication.tcp.TcpCommunicationSpi$6.body(TcpCommunicationSpi.java:928) [21:25:44]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.IgniteSpiThread.run(IgniteSpiThread.java:58) [21:25:44]W: [org.apache.ignite:ignite-core] [2021-11-19 21:25:44,413][ERROR][tcp-comm-worker-#1440%grid-1%-#27442%grid-1%][TestRecordingCommunicationSpi] Runtime error caught during grid runnable execution: GridWorker [name=tcp-comm-worker, igniteInstanceName=grid-1, finished=false, heartbeatTs=1637346344394, hashCode=1217710279, interrupted=false, runner=tcp-comm-worker-#1440%grid-1%-#27442%grid-1%] [21:25:44]W: [org.apache.ignite:ignite-core] java.lang.AssertionError [21:25:44]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.diagnostic.pagelocktracker.SharedPageLockTracker.dump(SharedPageLockTracker.java:199) [21:25:44]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.diagnostic.pagelocktracker.PageLockTrackerManager.dumpLocks(PageLockTrackerManager.java:175) [21:25:44]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.diagnostic.pagelocktracker.PageLockTrackerManager.dumpLocksToString(PageLockTrackerManager.java:184) [21:25:44]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.diagnostic.pagelocktracker.PageLockTrackerManager.dumpLocksToLog(PageLockTrackerManager.java:191) [21:25:44]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.diagnostic.DiagnosticProcessor.onFailure(DiagnosticProcessor.java:96) [21:25:44]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.failure.FailureProcessor.process(FailureProcessor.java:210) [21:25:44]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.failure.FailureProcessor.process(FailureProcessor.java:156) [21:25:44]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.communication.tcp.internal.CommunicationWorker.body(CommunicationWorker.java:197) [21:25:44]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:125) [21:25:44]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.communication.tcp.TcpCommunicationSpi$6.body(TcpCommunicationSpi.java:928) [21:25:44]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.IgniteSpiThread.run(IgniteSpiThread.java:58) [21:25:44]W: [org.apache.ignite:ignite-core] [2021-11-19 21:25:44,416][ERROR][tcp-comm-worker-#1440%grid-1%-#27442%grid-1%][IgniteTestResources] Critical system error detected. Will be handled accordingly to configured handler [hnd=NoOpFailureHandler [super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]], failureCtx=FailureContext [type=SYSTEM_WORKER_TERMINATION, err=class o.a.i.IgniteException: GridWorker [name=tcp-comm-worker, igniteInstanceName=grid-1, finished=true, heartbeatTs=1637346344394]]] [21:25:44]W: [org.apache.ignite:ignite-core] class org.apache.ignite.IgniteException: GridWorker [name=tcp-comm-worker, igniteInstanceName=grid-1, finished=true, heartbeatTs=1637346344394] [21:25:44]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.IgnitionEx$IgniteNamedInstance$2.apply(IgnitionEx.java:1768) [21:25:44]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.IgnitionEx$IgniteNamedInstance$2.apply(IgnitionEx.java:1766) [21:25:44]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.worker.WorkersRegistry.onStopped(WorkersRegistry.java:169) [21:25:44]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:160) [21:25:44]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.communication.tcp.TcpCommunicationSpi$6.body(TcpCommunicationSpi.java:928) [21:25:44]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.IgniteSpiThread.run(IgniteSpiThread.java:58) [21:25:44]W: [org.apache.ignite:ignite-core] [2021-11-19 21:25:44,420][ERROR][tcp-comm-worker-#1440%grid-1%-#27442%grid-1%][TestRecordingCommunicationSpi] Runtime error caught during grid runnable execution: IgniteSpiThread [name=tcp-comm-worker-#1440%grid-1%-#27442%grid-1%] [21:25:44]W: [org.apache.ignite:ignite-core] java.lang.AssertionError [21:25:44]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.diagnostic.pagelocktracker.SharedPageLockTracker.dump(SharedPageLockTracker.java:199) [21:25:44]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.diagnostic.pagelocktracker.PageLockTrackerManager.dumpLocks(PageLockTrackerManager.java:175) [21:25:44]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.diagnostic.pagelocktracker.PageLockTrackerManager.dumpLocksToString(PageLockTrackerManager.java:184) [21:25:44]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.diagnostic.pagelocktracker.PageLockTrackerManager.dumpLocksToLog(PageLockTrackerManager.java:191) [21:25:44]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.diagnostic.DiagnosticProcessor.onFailure(DiagnosticProcessor.java:96) [21:25:44]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.failure.FailureProcessor.process(FailureProcessor.java:210) [21:25:44]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.failure.FailureProcessor.process(FailureProcessor.java:156) [21:25:44]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.IgnitionEx$IgniteNamedInstance$2.apply(IgnitionEx.java:1776) [21:25:44]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.IgnitionEx$IgniteNamedInstance$2.apply(IgnitionEx.java:1766) [21:25:44]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.worker.WorkersRegistry.onStopped(WorkersRegistry.java:169) [21:25:44]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:160) [21:25:44]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.communication.tcp.TcpCommunicationSpi$6.body(TcpCommunicationSpi.java:928) [21:25:44]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.IgniteSpiThread.run(IgniteSpiThread.java:58) [21:25:44]W: [org.apache.ignite:ignite-core] Exception in thread "tcp-comm-worker-#1440%grid-1%-#27442%grid-1%" java.lang.AssertionError [21:25:44]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.diagnostic.pagelocktracker.SharedPageLockTracker.dump(SharedPageLockTracker.java:199) [21:25:44]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.diagnostic.pagelocktracker.PageLockTrackerManager.dumpLocks(PageLockTrackerManager.java:175) [21:25:44]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.diagnostic.pagelocktracker.PageLockTrackerManager.dumpLocksToString(PageLockTrackerManager.java:184) [21:25:44]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.cache.persistence.diagnostic.pagelocktracker.PageLockTrackerManager.dumpLocksToLog(PageLockTrackerManager.java:191) [21:25:44]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.diagnostic.DiagnosticProcessor.onFailure(DiagnosticProcessor.java:96) [21:25:44]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.failure.FailureProcessor.process(FailureProcessor.java:210) [21:25:44]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.processors.failure.FailureProcessor.process(FailureProcessor.java:156) [21:25:44]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.IgnitionEx$IgniteNamedInstance$2.apply(IgnitionEx.java:1776) [21:25:44]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.IgnitionEx$IgniteNamedInstance$2.apply(IgnitionEx.java:1766) [21:25:44]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.worker.WorkersRegistry.onStopped(WorkersRegistry.java:169) [21:25:44]W: [org.apache.ignite:ignite-core] at org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:160) [21:25:44]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.communication.tcp.TcpCommunicationSpi$6.body(TcpCommunicationSpi.java:928) [21:25:44]W: [org.apache.ignite:ignite-core] at org.apache.ignite.spi.IgniteSpiThread.run(IgniteSpiThread.java:58) [21:27:03] : [Step 4/5] [2021-11-19 21:27:03,967][INFO ][db-checkpoint-thread-#27502%grid-0%][Checkpointer] Skipping checkpoint (no pages were modified) [checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, reason='timeout'] [21:27:32] : [Step 4/5] [2021-11-19 21:27:32,043][INFO ][db-checkpoint-thread-#27502%grid-0%][Checkpointer] Skipping checkpoint (no pages were modified) [checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=1ms, reason='timeout'] [21:28:02] : [Step 4/5] [2021-11-19 21:28:02,056][INFO ][db-checkpoint-thread-#27502%grid-0%][Checkpointer] Skipping checkpoint (no pages were modified) [checkpointBeforeLockTime=4ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, reason='timeout'] [21:30:45] : [Step 4/5] [2021-11-19 21:30:45,781][INFO ][db-checkpoint-thread-#27502%grid-0%][Checkpointer] Skipping checkpoint (no pages were modified) [checkpointBeforeLockTime=3ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, reason='timeout'] [21:31:18] : [Step 4/5] [2021-11-19 21:31:18,165][INFO ][db-checkpoint-thread-#27502%grid-0%][Checkpointer] Skipping checkpoint (no pages were modified) [checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=1ms, checkpointLockHoldTime=1ms, reason='timeout'] [21:33:22] : [Step 4/5] [2021-11-19 21:33:22,908][INFO ][db-checkpoint-thread-#27502%grid-0%][Checkpointer] Skipping checkpoint (no pages were modified) [checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=1ms, reason='timeout'] [21:34:18] : [Step 4/5] [2021-11-19 21:34:18,580][INFO ][db-checkpoint-thread-#27502%grid-0%][Checkpointer] Skipping checkpoint (no pages were modified) [checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, reason='timeout'] [21:36:20] : [Step 4/5] [2021-11-19 21:36:20,283][INFO ][db-checkpoint-thread-#27502%grid-0%][Checkpointer] Skipping checkpoint (no pages were modified) [checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, reason='timeout'] [21:38:46] : [Step 4/5] [2021-11-19 21:38:46,741][INFO ][db-checkpoint-thread-#27502%grid-0%][Checkpointer] Skipping checkpoint (no pages were modified) [checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=1ms, checkpointLockHoldTime=1ms, reason='timeout'] [21:39:47] : [Step 4/5] [2021-11-19 21:39:47,832][INFO ][db-checkpoint-thread-#27502%grid-0%][Checkpointer] Skipping checkpoint (no pages were modified) [checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, reason='timeout'] [21:42:18] : [Step 4/5] [2021-11-19 21:42:18,069][INFO ][db-checkpoint-thread-#27502%grid-0%][Checkpointer] Skipping checkpoint (no pages were modified) [checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, reason='timeout'] [21:43:16] : [Step 4/5] [2021-11-19 21:43:16,369][INFO ][db-checkpoint-thread-#27502%grid-0%][Checkpointer] Skipping checkpoint (no pages were modified) [checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=1ms, reason='timeout'] [21:45:09] : [Step 4/5] [2021-11-19 21:45:09,139][INFO ][db-checkpoint-thread-#27502%grid-0%][Checkpointer] Skipping checkpoint (no pages were modified) [checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=1ms, checkpointLockHoldTime=1ms, reason='timeout'] [21:45:36] : [Step 4/5] [2021-11-19 21:45:36,197][INFO ][db-checkpoint-thread-#27502%grid-0%][Checkpointer] Skipping checkpoint (no pages were modified) [checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=1ms, reason='timeout'] [21:46:29] : [Step 4/5] [2021-11-19 21:46:29,457][INFO ][db-checkpoint-thread-#27502%grid-0%][Checkpointer] Skipping checkpoint (no pages were modified) [checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=5ms, checkpointLockHoldTime=5ms, reason='timeout'] [21:46:53] : [Step 4/5] [2021-11-19 21:46:53,961][INFO ][db-checkpoint-thread-#27502%grid-0%][Checkpointer] Skipping checkpoint (no pages were modified) [checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, reason='timeout'] [21:47:25] : [Step 4/5] [2021-11-19 21:47:25,399][INFO ][db-checkpoint-thread-#27502%grid-0%][Checkpointer] Skipping checkpoint (no pages were modified) [checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, reason='timeout'] [21:50:48] : [Step 4/5] [2021-11-19 21:50:48,519][INFO ][db-checkpoint-thread-#27502%grid-0%][Checkpointer] Skipping checkpoint (no pages were modified) [checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=1ms, checkpointLockHoldTime=1ms, reason='timeout'] [21:52:06] : [Step 4/5] [2021-11-19 21:52:06,868][INFO ][db-checkpoint-thread-#27502%grid-0%][Checkpointer] Skipping checkpoint (no pages were modified) [checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, reason='timeout'] [21:55:23] : [Step 4/5] [2021-11-19 21:55:23,583][INFO ][db-checkpoint-thread-#27502%grid-0%][Checkpointer] Skipping checkpoint (no pages were modified) [checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=1ms, reason='timeout'] [21:56:22] : [Step 4/5] [2021-11-19 21:56:22,898][INFO ][db-checkpoint-thread-#27502%grid-0%][Checkpointer] Skipping checkpoint (no pages were modified) [checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, reason='timeout'] [21:57:24] : [Step 4/5] [2021-11-19 21:57:24,879][INFO ][db-checkpoint-thread-#27502%grid-0%][Checkpointer] Skipping checkpoint (no pages were modified) [checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, reason='timeout'] [21:57:49] : [Step 4/5] [2021-11-19 21:57:49,391][INFO ][db-checkpoint-thread-#27502%grid-0%][Checkpointer] Skipping checkpoint (no pages were modified) [checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=1ms, checkpointLockHoldTime=1ms, reason='timeout'] [22:01:54] : [Step 4/5] [2021-11-19 22:01:54,388][INFO ][db-checkpoint-thread-#27502%grid-0%][Checkpointer] Skipping checkpoint (no pages were modified) [checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=1ms, reason='timeout'] [22:02:22] : [Step 4/5] [2021-11-19 22:02:22,689][INFO ][db-checkpoint-thread-#27502%grid-0%][Checkpointer] Skipping checkpoint (no pages were modified) [checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, reason='timeout'] [22:02:50] : [Step 4/5] [2021-11-19 22:02:50,632][INFO ][db-checkpoint-thread-#27502%grid-0%][Checkpointer] Skipping checkpoint (no pages were modified) [checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, reason='timeout'] [22:07:44] : [Step 4/5] [2021-11-19 22:07:44,967][INFO ][db-checkpoint-thread-#27502%grid-0%][Checkpointer] Skipping checkpoint (no pages were modified) [checkpointBeforeLockTime=1ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, reason='timeout'] [22:08:11] : [Step 4/5] [2021-11-19 22:08:11,582][INFO ][db-checkpoint-thread-#27502%grid-0%][Checkpointer] Skipping checkpoint (no pages were modified) [checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=0ms, checkpointLockHoldTime=0ms, reason='timeout'] [22:10:34] : [Step 4/5] [2021-11-19 22:10:34,558][INFO ][db-checkpoint-thread-#27502%grid-0%][Checkpointer] Skipping checkpoint (no pages were modified) [checkpointBeforeLockTime=0ms, checkpointLockWait=0ms, checkpointListenersExecuteTime=1ms, checkpointLockHoldTime=1ms, reason='timeout'] Current time: 22:12:37